2023-08-16T23:46:50.950 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-16T23:46:50.951 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} --archive /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431 --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/orig.config.yaml 2023-08-16T23:46:51.011 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-16T23:46:51.103 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431 branch: wip-yuri2-testing-2023-08-16-1142-pacific description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} email: yweinste@redhat.com first_in_suite: false job_id: '7370431' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri2-testing-2023-08-16-1142-pacific ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri2-testing-2023-08-16-1142-pacific sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9687 sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri2-testing-2023-08-16-1142-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 targets: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-16_22:36:42 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-16T23:46:51.103 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa; will attempt to use it 2023-08-16T23:46:51.104 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa/tasks 2023-08-16T23:46:51.104 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-16T23:46:51.106 INFO:teuthology.task.internal:Checking packages... 2023-08-16T23:46:51.151 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '23c07d8f91d3210fa9df54a2a13a9637958c6088' 2023-08-16T23:46:51.151 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-16T23:46:51.152 INFO:teuthology.packaging:ref: None 2023-08-16T23:46:51.153 INFO:teuthology.packaging:tag: None 2023-08-16T23:46:51.153 INFO:teuthology.packaging:branch: wip-yuri2-testing-2023-08-16-1142-pacific 2023-08-16T23:46:51.153 INFO:teuthology.packaging:sha1: 23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-16T23:46:51.154 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri2-testing-2023-08-16-1142-pacific 2023-08-16T23:46:51.302 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-522-g23c07d8f-1focal 2023-08-16T23:46:51.302 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-16T23:46:51.361 INFO:teuthology.task.internal:no buildpackages task found 2023-08-16T23:46:51.361 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-16T23:46:51.372 INFO:teuthology.task.internal:Saving configuration 2023-08-16T23:46:51.392 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-16T23:46:51.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-16T23:46:51.433 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 23:40:28.589204', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-08-16T23:46:51.454 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 23:40:28.591044', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-08-16T23:46:51.455 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-16T23:46:51.464 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-16T23:46:51.465 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-16T23:46:51.465 INFO:teuthology.run_tasks:Running task console_log... 2023-08-16T23:46:51.544 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe5cbac6040>, signals=[15]) 2023-08-16T23:46:51.546 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-16T23:46:51.556 INFO:teuthology.task.internal:Opening connections... 2023-08-16T23:46:51.557 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi153.front.sepia.ceph.com 2023-08-16T23:46:51.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:46:51.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2023-08-16T23:46:51.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:46:51.666 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-16T23:46:51.678 DEBUG:teuthology.orchestra.run.smithi153:> uname -m 2023-08-16T23:46:51.694 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2023-08-16T23:46:51.694 DEBUG:teuthology.orchestra.run.smithi153:> cat /etc/os-release 2023-08-16T23:46:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="Ubuntu" 2023-08-16T23:46:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-16T23:46:51.741 INFO:teuthology.orchestra.run.smithi153.stdout:ID=ubuntu 2023-08-16T23:46:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE=debian 2023-08-16T23:46:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-16T23:46:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="20.04" 2023-08-16T23:46:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-16T23:46:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-16T23:46:51.742 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-16T23:46:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-16T23:46:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_CODENAME=focal 2023-08-16T23:46:51.743 INFO:teuthology.orchestra.run.smithi153.stdout:UBUNTU_CODENAME=focal 2023-08-16T23:46:51.743 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2023-08-16T23:46:51.769 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2023-08-16T23:46:51.776 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2023-08-16T23:46:51.777 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2023-08-16T23:46:51.782 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2023-08-16T23:46:51.782 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-16T23:46:51.782 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2023-08-16T23:46:51.782 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2023-08-16T23:46:51.783 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-16T23:46:51.783 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="20.04" 2023-08-16T23:46:51.783 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-16T23:46:51.783 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-16T23:46:51.783 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-16T23:46:51.783 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-16T23:46:51.784 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=focal 2023-08-16T23:46:51.784 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=focal 2023-08-16T23:46:51.785 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2023-08-16T23:46:51.802 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-16T23:46:51.811 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-16T23:46:51.818 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-16T23:46:51.818 DEBUG:teuthology.orchestra.run.smithi153:> test '!' -e /home/ubuntu/cephtest 2023-08-16T23:46:51.821 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2023-08-16T23:46:51.829 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-16T23:46:51.839 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-16T23:46:51.840 DEBUG:teuthology.orchestra.run.smithi153:> test -z $(ls -A /var/lib/ceph) 2023-08-16T23:46:51.842 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2023-08-16T23:46:51.857 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-16T23:46:51.911 INFO:teuthology.run_tasks:Running task kernel... 2023-08-16T23:46:51.926 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-08-16T23:46:51.928 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-08-16T23:46:51.929 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-16T23:46:51.930 DEBUG:teuthology.orchestra.run.smithi153:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-16T23:46:51.931 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-16T23:46:51.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-16T23:46:51.937 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-08-16T23:46:51.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-16T23:46:51.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-08-16T23:46:52.122 DEBUG:teuthology.task.kernel:sha1 for client.0 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-16T23:46:52.122 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-16T23:46:52.123 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-08-16T23:46:52.129 INFO:teuthology.orchestra.run.smithi153.stdout:5.4.0-124-generic 2023-08-16T23:46:52.130 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-16T23:46:52.130 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-16T23:46:52.131 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-08-16T23:46:52.131 DEBUG:teuthology.orchestra.run.smithi153:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-08-16T23:46:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-08-16T23:46:52.183 DEBUG:teuthology.task.kernel:sha1 for client.1 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-16T23:46:52.183 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-16T23:46:52.184 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-08-16T23:46:52.191 INFO:teuthology.orchestra.run.smithi178.stdout:5.4.0-124-generic 2023-08-16T23:46:52.191 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-16T23:46:52.191 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-16T23:46:52.192 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-08-16T23:46:52.192 DEBUG:teuthology.orchestra.run.smithi178:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-08-16T23:46:52.210 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-08-16T23:46:52.259 INFO:teuthology.orchestra.run.smithi153.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-08-16T23:46:52.261 DEBUG:teuthology.orchestra.run.smithi153:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-08-16T23:46:52.328 INFO:teuthology.orchestra.run.smithi178.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-08-16T23:46:52.330 DEBUG:teuthology.orchestra.run.smithi178:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-08-16T23:46:52.331 DEBUG:teuthology.orchestra.run.smithi153:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-08-16T23:46:52.346 DEBUG:teuthology.orchestra.run.smithi153:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-08-16T23:46:52.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-08-16T23:46:52.418 DEBUG:teuthology.orchestra.run.smithi178:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-08-16T23:47:41.515 INFO:teuthology.orchestra.run.smithi178.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-08-16T23:47:41.516 INFO:teuthology.orchestra.run.smithi178.stderr: * [new branch] main -> origin/main 2023-08-16T23:47:41.561 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190312 -> 20190312 2023-08-16T23:47:41.561 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190416 -> 20190416 2023-08-16T23:47:41.562 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190514 -> 20190514 2023-08-16T23:47:41.562 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190618 -> 20190618 2023-08-16T23:47:41.562 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190717 -> 20190717 2023-08-16T23:47:41.562 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190815 -> 20190815 2023-08-16T23:47:41.564 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190923 -> 20190923 2023-08-16T23:47:41.564 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20191022 -> 20191022 2023-08-16T23:47:41.564 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20191215 -> 20191215 2023-08-16T23:47:41.564 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200122 -> 20200122 2023-08-16T23:47:41.564 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200316 -> 20200316 2023-08-16T23:47:41.565 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200421 -> 20200421 2023-08-16T23:47:41.565 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200519 -> 20200519 2023-08-16T23:47:41.565 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200619 -> 20200619 2023-08-16T23:47:41.565 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200721 -> 20200721 2023-08-16T23:47:41.566 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200817 -> 20200817 2023-08-16T23:47:41.566 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200918 -> 20200918 2023-08-16T23:47:41.566 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201022 -> 20201022 2023-08-16T23:47:41.566 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201118 -> 20201118 2023-08-16T23:47:41.566 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201218 -> 20201218 2023-08-16T23:47:41.566 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210208 -> 20210208 2023-08-16T23:47:41.567 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210315 -> 20210315 2023-08-16T23:47:41.567 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210511 -> 20210511 2023-08-16T23:47:41.567 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210716 -> 20210716 2023-08-16T23:47:41.567 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210818 -> 20210818 2023-08-16T23:47:41.569 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210919 -> 20210919 2023-08-16T23:47:41.569 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20211027 -> 20211027 2023-08-16T23:47:41.569 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20211216 -> 20211216 2023-08-16T23:47:41.569 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220209 -> 20220209 2023-08-16T23:47:41.570 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220310 -> 20220310 2023-08-16T23:47:41.570 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220411 -> 20220411 2023-08-16T23:47:41.570 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220509 -> 20220509 2023-08-16T23:47:41.570 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220610 -> 20220610 2023-08-16T23:47:41.570 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220708 -> 20220708 2023-08-16T23:47:41.570 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220815 -> 20220815 2023-08-16T23:47:41.571 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220913 -> 20220913 2023-08-16T23:47:41.571 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221012 -> 20221012 2023-08-16T23:47:41.571 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221109 -> 20221109 2023-08-16T23:47:41.571 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221214 -> 20221214 2023-08-16T23:47:41.571 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230117 -> 20230117 2023-08-16T23:47:41.571 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230210 -> 20230210 2023-08-16T23:47:41.572 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230310 -> 20230310 2023-08-16T23:47:41.572 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230404 -> 20230404 2023-08-16T23:47:41.572 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230515 -> 20230515 2023-08-16T23:47:41.572 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230625 -> 20230625 2023-08-16T23:47:41.572 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230804 -> 20230804 2023-08-16T23:47:42.281 INFO:teuthology.orchestra.run.smithi153.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-08-16T23:47:42.282 INFO:teuthology.orchestra.run.smithi153.stderr: * [new branch] main -> origin/main 2023-08-16T23:47:42.327 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190312 -> 20190312 2023-08-16T23:47:42.327 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190416 -> 20190416 2023-08-16T23:47:42.327 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190514 -> 20190514 2023-08-16T23:47:42.327 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190618 -> 20190618 2023-08-16T23:47:42.328 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190717 -> 20190717 2023-08-16T23:47:42.329 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190815 -> 20190815 2023-08-16T23:47:42.329 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20190923 -> 20190923 2023-08-16T23:47:42.329 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20191022 -> 20191022 2023-08-16T23:47:42.329 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20191215 -> 20191215 2023-08-16T23:47:42.329 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200122 -> 20200122 2023-08-16T23:47:42.329 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200316 -> 20200316 2023-08-16T23:47:42.330 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200421 -> 20200421 2023-08-16T23:47:42.330 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200519 -> 20200519 2023-08-16T23:47:42.332 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200619 -> 20200619 2023-08-16T23:47:42.333 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200721 -> 20200721 2023-08-16T23:47:42.333 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200817 -> 20200817 2023-08-16T23:47:42.333 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20200918 -> 20200918 2023-08-16T23:47:42.333 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20201022 -> 20201022 2023-08-16T23:47:42.333 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20201118 -> 20201118 2023-08-16T23:47:42.333 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20201218 -> 20201218 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210208 -> 20210208 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210315 -> 20210315 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210511 -> 20210511 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210716 -> 20210716 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210818 -> 20210818 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20210919 -> 20210919 2023-08-16T23:47:42.334 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20211027 -> 20211027 2023-08-16T23:47:42.335 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20211216 -> 20211216 2023-08-16T23:47:42.335 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220209 -> 20220209 2023-08-16T23:47:42.335 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220310 -> 20220310 2023-08-16T23:47:42.335 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220411 -> 20220411 2023-08-16T23:47:42.335 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220509 -> 20220509 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220610 -> 20220610 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220708 -> 20220708 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220815 -> 20220815 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20220913 -> 20220913 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20221012 -> 20221012 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20221109 -> 20221109 2023-08-16T23:47:42.336 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20221214 -> 20221214 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230117 -> 20230117 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230210 -> 20230210 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230310 -> 20230310 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230404 -> 20230404 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230515 -> 20230515 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230625 -> 20230625 2023-08-16T23:47:42.337 INFO:teuthology.orchestra.run.smithi153.stderr: * [new tag] 20230804 -> 20230804 2023-08-16T23:47:44.834 INFO:teuthology.orchestra.run.smithi178.stderr:Updating files: 52% (1627/3107) Updating files: 53% (1647/3107) Updating files: 54% (1678/3107) Updating files: 55% (1709/3107) Updating files: 56% (1740/3107) Updating files: 57% (1771/3107) Updating files: 58% (1803/3107) Updating files: 59% (1834/3107) Updating files: 60% (1865/3107) Updating files: 61% (1896/3107) Updating files: 62% (1927/3107) Updating files: 63% (1958/3107) Updating files: 64% (1989/3107) Updating files: 65% (2020/3107) Updating files: 66% (2051/3107) Updating files: 66% (2081/3107) Updating files: 67% (2082/3107) Updating files: 68% (2113/3107) Updating files: 69% (2144/3107) Updating files: 70% (2175/3107) Updating files: 71% (2206/3107) Updating files: 72% (2238/3107) Updating files: 73% (2269/3107) Updating files: 74% (2300/3107) Updating files: 75% (2331/3107) Updating files: 76% (2362/3107) Updating files: 77% (2393/3107) Updating files: 78% (2424/3107) Updating files: 79% (2455/3107) Updating files: 80% (2486/3107) Updating files: 81% (2517/3107) Updating files: 82% (2548/3107) Updating files: 82% (2574/3107) Updating files: 83% (2579/3107) Updating files: 84% (2610/3107) Updating files: 85% (2641/3107) Updating files: 86% (2673/3107) Updating files: 87% (2704/3107) Updating files: 88% (2735/3107) Updating files: 89% (2766/3107) Updating files: 90% (2797/3107) Updating files: 91% (2828/3107) Updating files: 92% (2859/3107) Updating files: 93% (2890/3107) Updating files: 94% (2921/3107) Updating files: 95% (2952/3107) Updating files: 96% (2983/3107) Updating files: 97% (3014/3107) Updating files: 98% (3045/3107) Updating files: 99% (3076/3107) Updating files: 100% (3107/3107) Updating files: 100% (3107/3107), done. 2023-08-16T23:47:44.839 INFO:teuthology.orchestra.run.smithi178.stdout:HEAD is now at 0e048b06 Merge branch 'for-upstream' of https://github.com/CirrusLogic/linux-firmware 2023-08-16T23:47:44.853 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-16T23:47:44.854 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-16T23:47:44.998 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc4-ga7fb1265323d/ 2023-08-16T23:47:44.999 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc4-ga7fb1265323d_6.5.0-rc4-ga7fb1265323d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc4-ga7fb1265323d/ --input-file=- 2023-08-16T23:47:45.001 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi178.front.sepia.ceph.com to complete... 2023-08-16T23:47:45.597 INFO:teuthology.orchestra.run.smithi153.stderr:Updating files: 52% (1631/3107) Updating files: 53% (1647/3107) Updating files: 54% (1678/3107) Updating files: 55% (1709/3107) Updating files: 56% (1740/3107) Updating files: 57% (1771/3107) Updating files: 58% (1803/3107) Updating files: 59% (1834/3107) Updating files: 60% (1865/3107) Updating files: 61% (1896/3107) Updating files: 62% (1927/3107) Updating files: 63% (1958/3107) Updating files: 64% (1989/3107) Updating files: 65% (2020/3107) Updating files: 66% (2051/3107) Updating files: 67% (2082/3107) Updating files: 68% (2113/3107) Updating files: 69% (2144/3107) Updating files: 70% (2175/3107) Updating files: 71% (2206/3107) Updating files: 72% (2238/3107) Updating files: 73% (2269/3107) Updating files: 74% (2300/3107) Updating files: 75% (2331/3107) Updating files: 76% (2362/3107) Updating files: 77% (2393/3107) Updating files: 78% (2424/3107) Updating files: 79% (2455/3107) Updating files: 80% (2486/3107) Updating files: 81% (2517/3107) Updating files: 82% (2548/3107) Updating files: 82% (2575/3107) Updating files: 83% (2579/3107) Updating files: 84% (2610/3107) Updating files: 85% (2641/3107) Updating files: 86% (2673/3107) Updating files: 87% (2704/3107) Updating files: 88% (2735/3107) Updating files: 89% (2766/3107) Updating files: 90% (2797/3107) Updating files: 91% (2828/3107) Updating files: 92% (2859/3107) Updating files: 93% (2890/3107) Updating files: 94% (2921/3107) Updating files: 95% (2952/3107) Updating files: 96% (2983/3107) Updating files: 97% (3014/3107) Updating files: 98% (3045/3107) Updating files: 99% (3076/3107) Updating files: 100% (3107/3107) Updating files: 100% (3107/3107), done. 2023-08-16T23:47:45.601 INFO:teuthology.orchestra.run.smithi153.stdout:HEAD is now at 0e048b06 Merge branch 'for-upstream' of https://github.com/CirrusLogic/linux-firmware 2023-08-16T23:47:45.616 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-16T23:47:45.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-16T23:47:45.758 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc4-ga7fb1265323d/ 2023-08-16T23:47:45.759 DEBUG:teuthology.orchestra.run.smithi153:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc4-ga7fb1265323d_6.5.0-rc4-ga7fb1265323d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc4-ga7fb1265323d/ --input-file=- 2023-08-16T23:47:45.761 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi153.front.sepia.ceph.com to complete... 2023-08-16T23:47:46.538 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-16 23:47:46 URL:https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc4-ga7fb1265323d/linux-image-6.5.0-rc4-ga7fb1265323d_6.5.0-rc4-ga7fb1265323d-1_amd64.deb [38824580/38824580] -> "/tmp/linux-image.deb" [1] 2023-08-16T23:47:46.539 INFO:teuthology.orchestra.run.smithi178.stderr:FINISHED --2023-08-16 23:47:46-- 2023-08-16T23:47:46.539 INFO:teuthology.orchestra.run.smithi178.stderr:Total wall clock time: 1.5s 2023-08-16T23:47:46.539 INFO:teuthology.orchestra.run.smithi178.stderr:Downloaded: 1 files, 37M in 1.4s (26.7 MB/s) 2023-08-16T23:47:46.541 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-16T23:47:46.542 DEBUG:teuthology.orchestra.run.smithi178:> sudo dpkg -i /tmp/linux-image.deb 2023-08-16T23:47:46.814 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-image-6.5.0-rc4-ga7fb1265323d. 2023-08-16T23:47:47.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-16 23:47:48 URL:https://2.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc4-ga7fb1265323d/linux-image-6.5.0-rc4-ga7fb1265323d_6.5.0-rc4-ga7fb1265323d-1_amd64.deb [38824580/38824580] -> "/tmp/linux-image.deb" [1] 2023-08-16T23:47:47.896 INFO:teuthology.orchestra.run.smithi153.stderr:FINISHED --2023-08-16 23:47:48-- 2023-08-16T23:47:47.896 INFO:teuthology.orchestra.run.smithi153.stderr:Total wall clock time: 2.1s 2023-08-16T23:47:47.896 INFO:teuthology.orchestra.run.smithi153.stderr:Downloaded: 1 files, 37M in 1.7s (22.2 MB/s) 2023-08-16T23:47:47.897 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-16T23:47:47.898 DEBUG:teuthology.orchestra.run.smithi153:> sudo dpkg -i /tmp/linux-image.deb 2023-08-16T23:47:48.208 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package linux-image-6.5.0-rc4-ga7fb1265323d. 2023-08-16T23:47:48.562 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-08-16T23:47:48.567 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-08-16T23:47:48.805 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-6.5.0-rc4-ga7fb1265323d (6.5.0-rc4-ga7fb1265323d-1) ... 2023-08-16T23:47:49.952 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-08-16T23:47:49.957 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-08-16T23:47:50.137 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking linux-image-6.5.0-rc4-ga7fb1265323d (6.5.0-rc4-ga7fb1265323d-1) ... 2023-08-16T23:47:51.883 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-6.5.0-rc4-ga7fb1265323d (6.5.0-rc4-ga7fb1265323d-1) ... 2023-08-16T23:47:52.012 INFO:teuthology.orchestra.run.smithi178.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:47:53.159 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up linux-image-6.5.0-rc4-ga7fb1265323d (6.5.0-rc4-ga7fb1265323d-1) ... 2023-08-16T23:47:53.273 INFO:teuthology.orchestra.run.smithi153.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:17.348 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2023-08-16T23:48:17.353 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-16T23:48:17.376 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2023-08-16T23:48:17.718 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:17.748 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:18.181 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-08-16T23:48:18.194 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-08-16T23:48:18.552 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2023-08-16T23:48:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-16T23:48:18.595 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-08-16T23:48:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:18.940 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:19.336 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-08-16T23:48:19.349 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-08-16T23:48:20.794 INFO:teuthology.orchestra.run.smithi178.stderr:done 2023-08-16T23:48:20.990 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-deb -c /tmp/linux-image.deb 2023-08-16T23:48:20.998 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./ 2023-08-16T23:48:20.999 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./boot/ 2023-08-16T23:48:20.999 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 4380860 2023-08-08 09:07 ./boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:21.015 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 168413 2023-08-08 09:07 ./boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:21.016 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11285248 2023-08-08 09:07 ./boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:21.036 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/ 2023-08-16T23:48:21.037 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/ 2023-08-16T23:48:21.037 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/postinst.d/ 2023-08-16T23:48:21.037 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/postrm.d/ 2023-08-16T23:48:21.037 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/preinst.d/ 2023-08-16T23:48:21.037 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/prerm.d/ 2023-08-16T23:48:21.037 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ 2023-08-16T23:48:21.038 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 490385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/aesni-intel.ko 2023-08-16T23:48:21.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-16T23:48:21.040 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-16T23:48:21.041 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-16T23:48:21.042 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/ 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/ 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/ 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-16T23:48:21.043 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpuid.ko 2023-08-16T23:48:21.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/msr.ko 2023-08-16T23:48:21.044 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/ 2023-08-16T23:48:21.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 348617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-16T23:48:21.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 881929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-16T23:48:21.044 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2276569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-16T23:48:21.054 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ 2023-08-16T23:48:21.054 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/af_alg.ko 2023-08-16T23:48:21.054 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/algif_hash.ko 2023-08-16T23:48:21.054 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/algif_skcipher.ko 2023-08-16T23:48:21.054 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/asymmetric_keys/ 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/ 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-16T23:48:21.055 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-16T23:48:21.056 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-16T23:48:21.057 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cryptd.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_simd.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-16T23:48:21.058 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lrw.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-16T23:48:21.059 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-16T23:48:21.060 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 149193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-16T23:48:21.061 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xts.ko 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_extlog.ko 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-16T23:48:21.062 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/apei/ 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/apei/einj.ko 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-16T23:48:21.063 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-16T23:48:21.064 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-16T23:48:21.065 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-16T23:48:21.066 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_legacy.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-16T23:48:21.067 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_radisys.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-16T23:48:21.068 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rz1000.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-16T23:48:21.069 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-16T23:48:21.070 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-16T23:48:21.071 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/ 2023-08-16T23:48:21.072 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-16T23:48:21.072 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/ 2023-08-16T23:48:21.072 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/ 2023-08-16T23:48:21.072 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-16T23:48:21.072 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/ 2023-08-16T23:48:21.072 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 968433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-16T23:48:21.105 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 173201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-16T23:48:21.106 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/ 2023-08-16T23:48:21.106 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-16T23:48:21.106 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-16T23:48:21.106 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/ 2023-08-16T23:48:21.106 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-16T23:48:21.106 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 259401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/ 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/ 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/applicom.ko 2023-08-16T23:48:21.107 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/ 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-16T23:48:21.108 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 150665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-16T23:48:21.109 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/ 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/nvram.ko 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/ 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-08-16T23:48:21.110 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/ 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-08-16T23:48:21.111 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/ 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-palmas.ko 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-si5351.ko 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-twl6040.ko 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-wm831x.ko 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/ 2023-08-16T23:48:21.112 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 234473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-16T23:48:21.113 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/ 2023-08-16T23:48:21.114 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/ 2023-08-16T23:48:21.114 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-08-16T23:48:21.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 408489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-16T23:48:21.114 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-08-16T23:48:21.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-16T23:48:21.114 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/ 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/ 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ 2023-08-16T23:48:21.115 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/ 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-16T23:48:21.116 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-16T23:48:21.117 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/ 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-gpio.ko 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-max14577.ko 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-max77693.ko 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-max8997.ko 2023-08-16T23:48:21.118 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-palmas.ko 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-sm5502.ko 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/ 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/dmi-sysfs.ko 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/efi/ 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-16T23:48:21.119 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/ 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-adp5520.ko 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-amd8111.ko 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-arizona.ko 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-da9052.ko 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-da9055.ko 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-dln2.ko 2023-08-16T23:48:21.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-f7188x.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-generic.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-kempld.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-lp3943.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-max7300.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-max730x.ko 2023-08-16T23:48:21.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-max732x.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-pca953x.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-sch.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-sch311x.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-tps65912.ko 2023-08-16T23:48:21.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-twl4030.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-twl6040.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-vx855.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-wm831x.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-wm8350.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-wm8994.ko 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/ 2023-08-16T23:48:21.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-a4tech.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-apple.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-belkin.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-cherry.ko 2023-08-16T23:48:21.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-chicony.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-cp2112.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-cypress.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ezkey.ko 2023-08-16T23:48:21.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-generic.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-16T23:48:21.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kensington.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lg-g15.ko 2023-08-16T23:48:21.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-magicmouse.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-microsoft.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-monterey.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-16T23:48:21.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ntrig.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-16T23:48:21.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-16T23:48:21.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-16T23:48:21.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-16T23:48:21.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 143585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-16T23:48:21.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 267689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/ 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 125721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/usbhid.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 217401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-16T23:48:21.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/ 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 301449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-16T23:48:21.135 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-16T23:48:21.136 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-16T23:48:21.137 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-16T23:48:21.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-16T23:48:21.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-16T23:48:21.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-16T23:48:21.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-16T23:48:21.138 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 99601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-16T23:48:21.139 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc2103.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-16T23:48:21.140 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hih6130.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-16T23:48:21.141 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-16T23:48:21.142 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/jc42.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-16T23:48:21.143 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-16T23:48:21.144 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-16T23:48:21.145 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-16T23:48:21.146 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mc13783-adc.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-16T23:48:21.147 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-16T23:48:21.148 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-16T23:48:21.149 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-16T23:48:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smm665.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-16T23:48:21.151 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-16T23:48:21.152 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-16T23:48:21.153 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/ 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/ 2023-08-16T23:48:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/ 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-16T23:48:21.155 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-16T23:48:21.156 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-16T23:48:21.157 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-16T23:48:21.158 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-16T23:48:21.159 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/ 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-08-16T23:48:21.160 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 273641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 876913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 324145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-16T23:48:21.161 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 279345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/ 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/ 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 492561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/ 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 419193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-16T23:48:21.162 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/ 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 739705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 296649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/ocrdma/ 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/usnic/ 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 169017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-08-16T23:48:21.163 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 263177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 111993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-16T23:48:21.164 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/ 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/evbug.ko 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/ff-memless.ko 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ 2023-08-16T23:48:21.165 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/ 2023-08-16T23:48:21.166 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/lkkbd.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/lm8323.ko 2023-08-16T23:48:21.167 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/lm8333.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-08-16T23:48:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/qt1070.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/qt2160.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/stowaway.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/sunkbd.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-08-16T23:48:21.169 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-08-16T23:48:21.170 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/xtkbd.ko 2023-08-16T23:48:21.170 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/matrix-keymap.ko 2023-08-16T23:48:21.170 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/ 2023-08-16T23:48:21.170 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-16T23:48:21.170 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-16T23:48:21.170 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 123681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 335849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/psmouse.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-16T23:48:21.171 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/ 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/ 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/ct82c710.ko 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/parkbd.ko 2023-08-16T23:48:21.172 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/pcips2.ko 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/ps2mult.ko 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serport.ko 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/ 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/ 2023-08-16T23:48:21.173 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/ 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-88pm860x.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-adp5520.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-bd2802.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-da903x.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-da9052.ko 2023-08-16T23:48:21.174 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-gpio.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3533.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm355x.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3642.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp8788.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-max8997.ko 2023-08-16T23:48:21.175 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-mc13783.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-menf21bmc.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-pca9532.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-pca955x.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-pca963x.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-tca6507.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-wm831x-status.ko 2023-08-16T23:48:21.176 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-wm8350.ko 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-16T23:48:21.177 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/ 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/ 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 655473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bufio.ko 2023-08-16T23:48:21.178 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 155993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-era.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log.ko 2023-08-16T23:48:21.179 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-mirror.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-region-hash.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-16T23:48:21.180 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-snapshot.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 181585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-zero.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-16T23:48:21.181 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/ 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 199937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 112609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 160553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 396153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/ 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/ 2023-08-16T23:48:21.182 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 178113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 123305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-16T23:48:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/ 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/88pm800.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/88pm805.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/88pm80x.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/arizona-i2c.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 123721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/arizona.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/bcm590xx.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/cros_ec_dev.ko 2023-08-16T23:48:21.184 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/dln2.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/janz-cmodio.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/kempld-core.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lm3533-core.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lp3943.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-16T23:48:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/max8907.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mc13xxx-core.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/menf21bmc.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/pcf50633-adc.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/pcf50633.ko 2023-08-16T23:48:21.186 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/retu-mfd.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/si476x-core.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/tps65010.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/tps6507x.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-16T23:48:21.187 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wm8994.ko 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ad525x_dpot.ko 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/ 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-16T23:48:21.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/c2port/ 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/c2port/core.ko 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/ 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-16T23:48:21.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ds1682.ko 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/dummy-irq.ko 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/echo/ 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/echo/echo.ko 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/ 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-16T23:48:21.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/genwqe/ 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hmc6352.ko 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ibmasm/ 2023-08-16T23:48:21.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ics932s401.ko 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/ 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-16T23:48:21.192 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/ 2023-08-16T23:48:21.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 125209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-16T23:48:21.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-16T23:48:21.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 309857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-16T23:48:21.235 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/phantom.ko 2023-08-16T23:48:21.236 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ti-st/ 2023-08-16T23:48:21.236 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ti-st/st_drv.ko 2023-08-16T23:48:21.236 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-16T23:48:21.236 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-16T23:48:21.236 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/ 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 183857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/ 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 487865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/ 2023-08-16T23:48:21.237 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/ 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 452657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-16T23:48:21.238 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/ 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 130489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ 2023-08-16T23:48:21.239 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 99113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/ 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/ 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-16T23:48:21.240 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/ 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/ 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/ 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-16T23:48:21.241 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/ 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/ 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-16T23:48:21.242 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/ 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 176881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1422209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-16T23:48:21.243 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 128377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 132289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 312145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/ 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/ 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 323553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/ 2023-08-16T23:48:21.244 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 193433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 347641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1044145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-08-16T23:48:21.245 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 166113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/ 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/ 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 204329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/ 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/ 2023-08-16T23:48:21.246 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 141161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/ 2023-08-16T23:48:21.247 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/ 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/ 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 281329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-16T23:48:21.248 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fujitsu/ 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/ 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 295713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-16T23:48:21.249 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 584249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 246321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/ 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 924081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/ 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 301793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-16T23:48:21.250 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/ 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 514889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 734297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 151841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-16T23:48:21.251 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/ 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/ 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-08-16T23:48:21.252 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 727433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 280513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1096257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-08-16T23:48:21.253 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/ 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-16T23:48:21.254 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/ 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 150905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/ 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 136785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/ 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-16T23:48:21.255 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/ 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 227113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 671393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/ 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-16T23:48:21.256 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/ 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 189817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/samsung/ 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-08-16T23:48:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/ 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 952881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/ 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/ 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-16T23:48:21.258 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/ 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/ 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-08-16T23:48:21.259 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 481681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/ 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 166121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-16T23:48:21.260 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/ 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/ 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/ 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-16T23:48:21.261 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/ 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/ 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/ 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/defxx.ko 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/skfp/ 2023-08-16T23:48:21.262 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 216977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/ 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 235593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/ 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ 2023-08-16T23:48:21.263 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/ 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-08-16T23:48:21.264 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/ 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-16T23:48:21.265 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-16T23:48:21.266 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-16T23:48:21.267 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/plip/ 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/plip/plip.ko 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-16T23:48:21.268 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-16T23:48:21.269 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sb1000.ko 2023-08-16T23:48:21.270 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/ 2023-08-16T23:48:21.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-16T23:48:21.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-16T23:48:21.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-16T23:48:21.270 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/ 2023-08-16T23:48:21.270 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-16T23:48:21.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/ 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/ 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 293481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/ 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 143801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-16T23:48:21.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/ 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/ 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 266601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/ 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-16T23:48:21.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/ 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/ 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pci-stub.ko 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-16T23:48:21.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/ 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 145785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pcmcia.ko 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 112913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/ 2023-08-16T23:48:21.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/broadcom/ 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/samsung/ 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/ 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/ 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-16T23:48:21.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/ 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/ 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec.ko 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-08-16T23:48:21.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/ 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-16T23:48:21.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/ 2023-08-16T23:48:21.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-16T23:48:21.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/ 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ 2023-08-16T23:48:21.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/bq24190_charger.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/bq24735-charger.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/da9030_battery.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/da9052-battery.ko 2023-08-16T23:48:21.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2760_battery.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2780_battery.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2781_battery.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2782_battery.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/gpio-charger.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/isp1704_charger.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/lp8727_charger.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max14577_charger.ko 2023-08-16T23:48:21.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max17040_battery.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max17042_battery.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max8903_charger.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max8925_power.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/sbs-battery.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/test_power.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/tps65090-charger.ko 2023-08-16T23:48:21.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/wm831x_backup.ko 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/wm831x_power.ko 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/wm8350_power.ko 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/ 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/ 2023-08-16T23:48:21.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/ 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-16T23:48:21.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/ 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-da9052.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-da9055.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-da9063.ko 2023-08-16T23:48:21.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-16T23:48:21.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-lp8788.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-16T23:48:21.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t86.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8907.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8925.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8997.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8998.ko 2023-08-16T23:48:21.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-palmas.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-16T23:48:21.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-s35390a.ko 2023-08-16T23:48:21.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-tps65910.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-wm831x.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-wm8350.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-16T23:48:21.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 135169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/ 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 272353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/ 2023-08-16T23:48:21.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 356265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 295801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic94xx/ 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 189321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/ 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-16T23:48:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/ 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 246897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/ 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1172185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/ 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 237169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/ 2023-08-16T23:48:21.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/ 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 308889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/ 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-08-16T23:48:21.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 146785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/ 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 212401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/ 2023-08-16T23:48:21.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 158193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fdomain.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/ 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 262009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 201793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-16T23:48:21.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/imm.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 266521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/ 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 317249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-16T23:48:21.300 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/ 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 314961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 145569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/ 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 217209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/ 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2192497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-16T23:48:21.301 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/ 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 310729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/ 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 659577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-16T23:48:21.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/ 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/ 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-08-16T23:48:21.303 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/ 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 364257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 123489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ppa.ko 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/ 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1860193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-16T23:48:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/ 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 558865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qlogicfas408.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 238801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 173921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 278865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-16T23:48:21.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/ 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 162121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-16T23:48:21.306 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/xen-scsifront.ko 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/ 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/ 2023-08-16T23:48:21.307 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 739089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/ 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 931721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-16T23:48:21.308 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/ 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/ 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/ 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-16T23:48:21.309 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-16T23:48:21.310 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-16T23:48:21.311 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/moxa.ko 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/mxser.ko 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/ 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/ 2023-08-16T23:48:21.312 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/altera_uart.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/ 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-16T23:48:21.313 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/rp2.ko 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/ 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 536897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-16T23:48:21.314 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/ 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_mf624.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_netx.ko 2023-08-16T23:48:21.315 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/ 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/c67x00/ 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/c67x00/c67x00.ko 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ 2023-08-16T23:48:21.316 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 143785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/ 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-16T23:48:21.317 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/common/ 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/common/ulpi.ko 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc2/ 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/ 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-08-16T23:48:21.318 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 444489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/dwc3.ko 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/ 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/ 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-08-16T23:48:21.319 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 92377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-08-16T23:48:21.320 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/ 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-08-16T23:48:21.321 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-08-16T23:48:21.322 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 161321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/libcomposite.ko 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/ 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/bdc/ 2023-08-16T23:48:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 157665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-08-16T23:48:21.324 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 156009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/ 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/bcma-hcd.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-08-16T23:48:21.325 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811_cs.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/ssb-hcd.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/ 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-16T23:48:21.326 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/cytherm.ko 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ehset.ko 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-16T23:48:21.327 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/lvstest.ko 2023-08-16T23:48:21.328 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/ 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbtest.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-16T23:48:21.329 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/mon/ 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/mon/usbmon.ko 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/musb/ 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 301521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/ 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-08-16T23:48:21.330 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-16T23:48:21.331 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/f81232.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 175145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-16T23:48:21.332 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-16T23:48:21.333 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/metro-usb.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mxuport.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-16T23:48:21.334 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 190233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-16T23:48:21.335 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-16T23:48:21.336 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 125505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usbserial.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-16T23:48:21.337 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-16T23:48:21.338 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 180017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/ 2023-08-16T23:48:21.339 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/ 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/ 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-16T23:48:21.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/ 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/ 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/ 2023-08-16T23:48:21.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/as3711_bl.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/bd6107.ko 2023-08-16T23:48:21.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/da903x_bl.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/da9052_bl.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lv5207lp.ko 2023-08-16T23:48:21.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/max8925_bl.ko 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/pandora_bl.ko 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/ 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ 2023-08-16T23:48:21.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/matrox_w1.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/w1-gpio.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/ 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-16T23:48:21.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-16T23:48:21.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/acquirewdt.ko 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/advantechwdt.ko 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-16T23:48:21.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/cpu5wdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/da9052_wdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/da9055_wdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/da9063_wdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/dw_wdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/eurotechwdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-16T23:48:21.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-16T23:48:21.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/kempld_wdt.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/mena21_wdt.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-16T23:48:21.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/retu_wdt.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sc1200wdt.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-16T23:48:21.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-16T23:48:21.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/ 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-16T23:48:21.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/ 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 176417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-scsiback.ko 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/ 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ 2023-08-16T23:48:21.354 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/ 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 165625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/adfs/ 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/adfs/adfs.ko 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/ 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 162617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/afs/ 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 931937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/afs/kafs.ko 2023-08-16T23:48:21.355 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/autofs/ 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/autofs/autofs4.ko 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/ 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/bfs/ 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/bfs/bfs.ko 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-16T23:48:21.356 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/ 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 3471433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/ 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 305745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1315777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/ 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-16T23:48:21.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/configfs/ 2023-08-16T23:48:21.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/configfs/configfs.ko 2023-08-16T23:48:21.358 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/ 2023-08-16T23:48:21.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-16T23:48:21.358 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/ 2023-08-16T23:48:21.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 633825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-16T23:48:21.384 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/efs/ 2023-08-16T23:48:21.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/efs/efs.ko 2023-08-16T23:48:21.385 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/ 2023-08-16T23:48:21.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1500513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-16T23:48:21.385 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/ 2023-08-16T23:48:21.385 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-16T23:48:21.385 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/freevxfs/ 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/freevxfs/freevxfs.ko 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/ 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 226505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/ 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/ 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1226249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-16T23:48:21.386 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/ 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 141241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/ 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 221553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hpfs/ 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 193577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hpfs/hpfs.ko 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/ 2023-08-16T23:48:21.387 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/ 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 420745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/ 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 279041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/ 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/ 2023-08-16T23:48:21.388 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/ 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/ 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/ 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/ 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-16T23:48:21.389 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1053889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv2.ko 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2041809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/ 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/ 2023-08-16T23:48:21.390 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1504905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/ 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 591417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/ 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-16T23:48:21.391 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-16T23:48:21.392 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_ascii.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-16T23:48:21.393 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-16T23:48:21.394 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 165745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 118121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-16T23:48:21.395 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-16T23:48:21.396 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-16T23:48:21.397 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ntfs/ 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 219073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ntfs/ntfs.ko 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 244177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 440785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ 2023-08-16T23:48:21.398 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2589569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/omfs/ 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/omfs/omfs.ko 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/ 2023-08-16T23:48:21.399 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 336473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx4/ 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx4/qnx4.ko 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx6/ 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx6/qnx6.ko 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/ 2023-08-16T23:48:21.400 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/quota_tree.ko 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/quota_v1.ko 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/quota_v2.ko 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/ 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 530697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/ 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-16T23:48:21.401 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/ 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/ 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2660761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/ 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/ 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-16T23:48:21.402 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/ 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/ 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 248049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 160857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/ 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 3998129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-16T23:48:21.403 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/ 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/locking/ 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/locking/locktorture.ko 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/time/ 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/time/test_udelay.ko 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-16T23:48:21.404 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc7.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/ 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/interval_tree_test.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-16T23:48:21.405 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/ 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/ 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/memory-notifier-error-inject.ko 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/notifier-error-inject.ko 2023-08-16T23:48:21.406 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/percpu_test.ko 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/pm-notifier-error-inject.ko 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/ 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 143433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/rbtree_test.ko 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/ 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test-kstrtox.ko 2023-08-16T23:48:21.407 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test-string_helpers.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 4760825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_bpf.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_firmware.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_module.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_user_copy.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-16T23:48:21.408 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/xz/ 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/xz/xz_dec_test.ko 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/ 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/ 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-16T23:48:21.409 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 6985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/ 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-16T23:48:21.410 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/ 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/ 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 198465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-16T23:48:21.411 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/ 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 652553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/ 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-16T23:48:21.412 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 772505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-16T23:48:21.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-16T23:48:21.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-16T23:48:21.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/ 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1046921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/ 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/ 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 194321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-16T23:48:21.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/ 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 390297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-16T23:48:21.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/hsr/ 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/hsr/hsr.ko 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 254601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-16T23:48:21.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-16T23:48:21.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-08-16T23:48:21.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-16T23:48:21.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-16T23:48:21.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-16T23:48:21.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-16T23:48:21.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ 2023-08-16T23:48:21.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_gre.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 92817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-16T23:48:21.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/mip6.ko 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-16T23:48:21.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-16T23:48:21.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-16T23:48:21.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/ 2023-08-16T23:48:21.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/ 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 125873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-16T23:48:21.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/lapb/ 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/lapb/lapb.ko 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/ 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 267257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc2.ko 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/ 2023-08-16T23:48:21.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 291041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/ 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-16T23:48:21.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 114393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 111161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-16T23:48:21.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 114673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 114329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 412481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-16T23:48:21.435 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-16T23:48:21.436 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 408665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-16T23:48:21.437 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 118145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-16T23:48:21.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-16T23:48:21.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 597353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-16T23:48:21.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-16T23:48:21.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-16T23:48:21.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_osf.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_synproxy.ko 2023-08-16T23:48:21.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tproxy.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/x_tables.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-16T23:48:21.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-16T23:48:21.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-16T23:48:21.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-16T23:48:21.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-16T23:48:21.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-16T23:48:21.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-16T23:48:21.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-16T23:48:21.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-16T23:48:21.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpudp.ko 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/ 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/ 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-16T23:48:21.453 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/ 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 379545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/ 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/phonet/ 2023-08-16T23:48:21.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/phonet/phonet.ko 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/phonet/pn_pep.ko 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/ 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 252889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 165081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rxrpc/ 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 820137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rxrpc/rxrpc.ko 2023-08-16T23:48:21.455 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/ 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-16T23:48:21.456 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_cgroup.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-16T23:48:21.457 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-16T23:48:21.458 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq_codel.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-16T23:48:21.459 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-16T23:48:21.460 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-16T23:48:21.461 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/ 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 930369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/ 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/ 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 335569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-16T23:48:21.462 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1514649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/ 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 707401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/ 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 862385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/ 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-16T23:48:21.463 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/ 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/x25/ 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 125097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/x25/x25.ko 2023-08-16T23:48:21.464 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/ 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_algo.ko 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_user.ko 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/ 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/ 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 638591 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-16T23:48:21.465 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 624324 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7656 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.alias.bin 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9821 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 146449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 232695 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 210 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-16T23:48:21.466 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72754 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 879 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 252923 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 307944 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/ 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/share/ 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/share/doc/ 2023-08-16T23:48:21.467 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/share/doc/linux-image-6.5.0-rc4-ga7fb1265323d/ 2023-08-16T23:48:21.468 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 174 2023-08-08 09:07 ./usr/share/doc/linux-image-6.5.0-rc4-ga7fb1265323d/changelog.Debian.gz 2023-08-16T23:48:21.468 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 691 2023-08-08 09:07 ./usr/share/doc/linux-image-6.5.0-rc4-ga7fb1265323d/copyright 2023-08-16T23:48:21.469 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:21.469 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:21.469 DEBUG:teuthology.orchestra.run.smithi178:> egrep '(submenu|menuentry.*6.5.0-rc4-ga7fb1265323d).*{' /boot/grub/grub.cfg 2023-08-16T23:48:21.475 INFO:teuthology.orchestra.run.smithi178.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-08-16T23:48:21.475 INFO:teuthology.orchestra.run.smithi178.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc4-ga7fb1265323d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc4-ga7fb1265323d-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-08-16T23:48:21.476 INFO:teuthology.orchestra.run.smithi178.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc4-ga7fb1265323d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc4-ga7fb1265323d-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-08-16T23:48:21.476 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-08-16T23:48:21.476 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:21.477 DEBUG:teuthology.orchestra.run.smithi178:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-08-16T23:48:21.478 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi178.front.sepia.ceph.com to complete... 2023-08-16T23:48:21.979 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-08-16T23:48:22.151 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-deb -c /tmp/linux-image.deb 2023-08-16T23:48:22.161 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./ 2023-08-16T23:48:22.161 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./boot/ 2023-08-16T23:48:22.161 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 4380860 2023-08-08 09:07 ./boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.176 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 168413 2023-08-08 09:07 ./boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.177 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11285248 2023-08-08 09:07 ./boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.197 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/postinst.d/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/postrm.d/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/preinst.d/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./etc/kernel/prerm.d/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/ 2023-08-16T23:48:22.198 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/ 2023-08-16T23:48:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/ 2023-08-16T23:48:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/ 2023-08-16T23:48:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/ 2023-08-16T23:48:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/ 2023-08-16T23:48:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ 2023-08-16T23:48:22.199 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 490385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/aesni-intel.ko 2023-08-16T23:48:22.201 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-16T23:48:22.201 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 93113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 152241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-16T23:48:22.202 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-16T23:48:22.203 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/ 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/ 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/ 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpuid.ko 2023-08-16T23:48:22.204 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/msr.ko 2023-08-16T23:48:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/ 2023-08-16T23:48:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 348617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-16T23:48:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 881929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-16T23:48:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2276569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-16T23:48:22.214 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ 2023-08-16T23:48:22.214 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/af_alg.ko 2023-08-16T23:48:22.214 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/algif_hash.ko 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/algif_skcipher.ko 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/asymmetric_keys/ 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-08-16T23:48:22.215 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/ 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-16T23:48:22.216 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-16T23:48:22.217 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cryptd.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_simd.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-16T23:48:22.218 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lrw.ko 2023-08-16T23:48:22.219 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-16T23:48:22.220 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 149193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-16T23:48:22.221 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xts.ko 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_extlog.ko 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-16T23:48:22.222 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/apei/ 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/apei/einj.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-16T23:48:22.223 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 88625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci.ko 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci.ko 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-16T23:48:22.224 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-16T23:48:22.225 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-16T23:48:22.226 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_legacy.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-16T23:48:22.227 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-16T23:48:22.228 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-16T23:48:22.228 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-16T23:48:22.228 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-16T23:48:22.228 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-16T23:48:22.228 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-16T23:48:22.228 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_radisys.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rz1000.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-16T23:48:22.229 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-16T23:48:22.230 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ 2023-08-16T23:48:22.231 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/ 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/ 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/ 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 113705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/ 2023-08-16T23:48:22.232 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 968433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-16T23:48:22.245 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2023-08-16T23:48:22.251 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-16T23:48:22.269 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2023-08-16T23:48:22.270 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 173201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-16T23:48:22.270 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/ 2023-08-16T23:48:22.270 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 94297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-16T23:48:22.271 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-16T23:48:22.271 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/ 2023-08-16T23:48:22.271 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 110361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-16T23:48:22.271 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 98225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-16T23:48:22.271 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 259401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-16T23:48:22.271 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/ 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 98129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/ 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/applicom.ko 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-16T23:48:22.272 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/ 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-16T23:48:22.273 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 150665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 139057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/ 2023-08-16T23:48:22.274 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/nvram.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/ 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-08-16T23:48:22.275 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/ 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-08-16T23:48:22.276 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/ 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-palmas.ko 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-si5351.ko 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-twl6040.ko 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/clk/clk-wm831x.ko 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/ 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-16T23:48:22.277 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 234473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/ 2023-08-16T23:48:22.278 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/ 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 408489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/ 2023-08-16T23:48:22.279 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/ 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/ 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ 2023-08-16T23:48:22.280 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 122641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-16T23:48:22.281 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-16T23:48:22.282 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/ 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-gpio.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-max14577.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-max77693.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-max8997.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-palmas.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/extcon/extcon-sm5502.ko 2023-08-16T23:48:22.283 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/ 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/dmi-sysfs.ko 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/efi/ 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/ 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-adp5520.ko 2023-08-16T23:48:22.284 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-amd8111.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-arizona.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-da9052.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-da9055.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-dln2.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-f7188x.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-generic.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-16T23:48:22.285 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-kempld.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-lp3943.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-max7300.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-max730x.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-max732x.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-08-16T23:48:22.286 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-pca953x.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-sch.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-sch311x.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-tps65912.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-twl4030.ko 2023-08-16T23:48:22.287 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-twl6040.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-vx855.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-wm831x.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-wm8350.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-wm8994.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/ 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-a4tech.ko 2023-08-16T23:48:22.288 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-apple.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-belkin.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-cherry.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-chicony.ko 2023-08-16T23:48:22.289 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-cp2112.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-cypress.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ezkey.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-16T23:48:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-generic.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-16T23:48:22.291 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kensington.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-16T23:48:22.292 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lg-g15.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-magicmouse.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-microsoft.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-monterey.ko 2023-08-16T23:48:22.293 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ntrig.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-16T23:48:22.294 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-16T23:48:22.295 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-16T23:48:22.296 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-16T23:48:22.297 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 143585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-16T23:48:22.298 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 267689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/ 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 125721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/usbhid.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-08-16T23:48:22.299 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 217401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/ 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 301449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ 2023-08-16T23:48:22.300 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-16T23:48:22.301 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-16T23:48:22.302 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-16T23:48:22.303 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 99601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-16T23:48:22.304 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc2103.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 94457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-16T23:48:22.305 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-16T23:48:22.306 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hih6130.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-16T23:48:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 129217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-16T23:48:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/jc42.ko 2023-08-16T23:48:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-16T23:48:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-16T23:48:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-16T23:48:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-16T23:48:22.308 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-16T23:48:22.309 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-16T23:48:22.310 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-16T23:48:22.311 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mc13783-adc.ko 2023-08-16T23:48:22.312 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 116697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 82337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-16T23:48:22.313 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-16T23:48:22.314 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-16T23:48:22.315 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smm665.ko 2023-08-16T23:48:22.316 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-16T23:48:22.317 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-16T23:48:22.318 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-08-16T23:48:22.319 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/ 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/ 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/ 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-08-16T23:48:22.320 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 6929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-16T23:48:22.321 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-16T23:48:22.322 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-08-16T23:48:22.323 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-16T23:48:22.324 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/ 2023-08-16T23:48:22.325 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 273641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 876913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-16T23:48:22.326 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 324145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 279345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/ 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/ 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 492561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/ 2023-08-16T23:48:22.327 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 419193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/ 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 739705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 296649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/ocrdma/ 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 153681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/usnic/ 2023-08-16T23:48:22.328 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 169017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 263177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ 2023-08-16T23:48:22.329 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 111993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 129081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 129553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/ 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/evbug.ko 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/ff-memless.ko 2023-08-16T23:48:22.330 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/ 2023-08-16T23:48:22.331 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/lkkbd.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/lm8323.ko 2023-08-16T23:48:22.332 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/lm8333.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-08-16T23:48:22.333 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/qt1070.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/qt2160.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/stowaway.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/sunkbd.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-08-16T23:48:22.334 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/xtkbd.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/matrix-keymap.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/ 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 123681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-08-16T23:48:22.335 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 335849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/psmouse.ko 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/ 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 109849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/ 2023-08-16T23:48:22.336 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/ct82c710.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/parkbd.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/pcips2.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/ps2mult.ko 2023-08-16T23:48:22.337 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serport.ko 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/ 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/ 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/ 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-88pm860x.ko 2023-08-16T23:48:22.338 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-adp5520.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-bd2802.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-da903x.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-da9052.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-gpio.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3533.ko 2023-08-16T23:48:22.339 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm355x.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3642.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp8788.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-max8997.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-mc13783.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-menf21bmc.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-pca9532.ko 2023-08-16T23:48:22.340 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-pca955x.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-pca963x.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-tca6507.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-wm831x-status.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-wm8350.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-16T23:48:22.341 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-16T23:48:22.342 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/ 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/ 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 655473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bufio.ko 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 155993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 107049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-16T23:48:22.343 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-era.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-mirror.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-16T23:48:22.344 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-region-hash.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 109593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-snapshot.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 181585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-16T23:48:22.345 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-zero.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/ 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 199937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-16T23:48:22.346 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 112609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 160553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 396153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/ 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/ 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 178113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-16T23:48:22.347 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 123305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 79017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/ 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/88pm800.ko 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/88pm805.ko 2023-08-16T23:48:22.348 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/88pm80x.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/arizona-i2c.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 123721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/arizona.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/bcm590xx.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/cros_ec_dev.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/dln2.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/janz-cmodio.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/kempld-core.ko 2023-08-16T23:48:22.349 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lm3533-core.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lp3943.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/max8907.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mc13xxx-core.ko 2023-08-16T23:48:22.350 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/menf21bmc.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/pcf50633-adc.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/pcf50633.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/retu-mfd.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/si476x-core.ko 2023-08-16T23:48:22.351 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/tps65010.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/tps6507x.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-16T23:48:22.352 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wm8994.ko 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ad525x_dpot.ko 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/ 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-16T23:48:22.353 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/c2port/ 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/c2port/core.ko 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/ 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ds1682.ko 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/dummy-irq.ko 2023-08-16T23:48:22.354 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/echo/ 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/echo/echo.ko 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/ 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-16T23:48:22.355 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/genwqe/ 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 152137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hmc6352.ko 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ibmasm/ 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ics932s401.ko 2023-08-16T23:48:22.356 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/ 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/ 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 125209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-16T23:48:22.357 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 309857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/phantom.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ti-st/ 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/ti-st/st_drv.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-16T23:48:22.358 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/ 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 183857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/ 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 487865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/ 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/ 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-16T23:48:22.359 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-16T23:48:22.360 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-16T23:48:22.360 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-08-16T23:48:22.360 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 452657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-16T23:48:22.407 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-16T23:48:22.407 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-16T23:48:22.407 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ 2023-08-16T23:48:22.407 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/ 2023-08-16T23:48:22.407 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-16T23:48:22.407 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 130489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-16T23:48:22.408 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 99113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/ 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/ 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/ 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-16T23:48:22.409 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/ 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/ 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/ 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/ 2023-08-16T23:48:22.410 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 104609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-16T23:48:22.411 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/ 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 176881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1422209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 128377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 132289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-16T23:48:22.412 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 312145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/ 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/ 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 323553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/ 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 193433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-16T23:48:22.413 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 347641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1044145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 166113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-16T23:48:22.414 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/ 2023-08-16T23:48:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/ 2023-08-16T23:48:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 204329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-16T23:48:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/ 2023-08-16T23:48:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/ 2023-08-16T23:48:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-16T23:48:22.415 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 141161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/ 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-16T23:48:22.416 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/ 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/ 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 281329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-16T23:48:22.417 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fujitsu/ 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 90465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/ 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 295713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 584249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-16T23:48:22.418 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 246321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/ 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 924081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/ 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 301793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/ 2023-08-16T23:48:22.419 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 514889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 93593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 734297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 151841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 86921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-16T23:48:22.420 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/ 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 122681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/ 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 727433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 280513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-16T23:48:22.421 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1096257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-08-16T23:48:22.422 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 95665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/ 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-16T23:48:22.423 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/ 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 150905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/ 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 136785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/ 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-16T23:48:22.424 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/ 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 227113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 671393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/ 2023-08-16T23:48:22.425 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/ 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 189817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/samsung/ 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-08-16T23:48:22.426 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 104241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/ 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 952881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/ 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/ 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-16T23:48:22.427 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/ 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/ 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-08-16T23:48:22.428 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 481681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/ 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 166121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-16T23:48:22.429 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/ 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/ 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 86465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/ 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-16T23:48:22.430 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/ 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/ 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/ 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/defxx.ko 2023-08-16T23:48:22.431 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/skfp/ 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 216977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/ 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 235593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/ 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-16T23:48:22.432 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 83993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/ 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-16T23:48:22.433 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/ 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-16T23:48:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-16T23:48:22.435 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-16T23:48:22.436 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/plip/ 2023-08-16T23:48:22.437 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/plip/plip.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-16T23:48:22.438 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sb1000.ko 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/ 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-16T23:48:22.439 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/ 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-16T23:48:22.440 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 88193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/ 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 120497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/ 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 293481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/ 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 143801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ 2023-08-16T23:48:22.441 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/ 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/ 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 266601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/ 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 133817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-16T23:48:22.442 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/ 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/ 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-08-16T23:48:22.443 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pci-stub.ko 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/ 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 145785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pcmcia.ko 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-08-16T23:48:22.444 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 112913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/ 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/broadcom/ 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/samsung/ 2023-08-16T23:48:22.445 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/ 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/ 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/ 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/ 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-08-16T23:48:22.446 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/ 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-16T23:48:22.447 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-16T23:48:22.448 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-16T23:48:22.448 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-16T23:48:22.448 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-16T23:48:22.448 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-16T23:48:22.448 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-16T23:48:22.448 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/ 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-16T23:48:22.449 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-16T23:48:22.450 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/ 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ 2023-08-16T23:48:22.451 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/bq24190_charger.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/bq24735-charger.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/da9030_battery.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/da9052-battery.ko 2023-08-16T23:48:22.452 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2760_battery.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2780_battery.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2781_battery.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/ds2782_battery.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/gpio-charger.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/isp1704_charger.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/lp8727_charger.ko 2023-08-16T23:48:22.453 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max14577_charger.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max17040_battery.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max17042_battery.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max8903_charger.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/max8925_power.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/sbs-battery.ko 2023-08-16T23:48:22.454 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/test_power.ko 2023-08-16T23:48:22.455 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/tps65090-charger.ko 2023-08-16T23:48:22.455 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/wm831x_backup.ko 2023-08-16T23:48:22.455 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/wm831x_power.ko 2023-08-16T23:48:22.455 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/power/supply/wm8350_power.ko 2023-08-16T23:48:22.455 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/ 2023-08-16T23:48:22.455 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/ 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/ 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-16T23:48:22.456 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/ 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-08-16T23:48:22.457 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-da9052.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-da9055.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-da9063.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-16T23:48:22.458 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-16T23:48:22.459 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-lp8788.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t86.ko 2023-08-16T23:48:22.460 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8907.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8925.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8997.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max8998.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-palmas.ko 2023-08-16T23:48:22.461 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-08-16T23:48:22.462 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-s35390a.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-08-16T23:48:22.463 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-tps65910.ko 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-wm831x.ko 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-wm8350.ko 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 77617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-16T23:48:22.464 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-16T23:48:22.465 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 135169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-16T23:48:22.465 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-16T23:48:22.465 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/ 2023-08-16T23:48:22.465 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 272353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-16T23:48:22.465 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-16T23:48:22.465 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/ 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 356265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 295801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic94xx/ 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 189321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/ 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 106569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-16T23:48:22.466 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/ 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 246897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/ 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1172185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/ 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 237169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-16T23:48:22.467 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/ 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/ 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 308889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/ 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 76193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-16T23:48:22.468 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 146785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/ 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 212401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-16T23:48:22.469 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/ 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 158193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fdomain.ko 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/ 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 262009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 201793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-16T23:48:22.470 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/imm.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 266521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 101881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/ 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 317249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-16T23:48:22.471 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/ 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 314961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 145569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/ 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 217209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-16T23:48:22.472 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/ 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2192497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/ 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 310729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/ 2023-08-16T23:48:22.473 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 659577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/ 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/ 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-08-16T23:48:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/ 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 364257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 123489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ppa.ko 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/ 2023-08-16T23:48:22.475 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1860193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/ 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 558865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qlogicfas408.ko 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 238801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-16T23:48:22.476 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 173921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 278865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 97705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 115849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-16T23:48:22.477 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/ 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 162121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/xen-scsifront.ko 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 129417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-16T23:48:22.478 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/ 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/ 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 739089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/ 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-16T23:48:22.479 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 931721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 122545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/ 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/ 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/ 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-08-16T23:48:22.480 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-16T23:48:22.481 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-16T23:48:22.482 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/moxa.ko 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 50793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/mxser.ko 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 107545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-16T23:48:22.483 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/ 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/ 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/altera_uart.ko 2023-08-16T23:48:22.484 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/ 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/rp2.ko 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-16T23:48:22.485 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/ 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 536897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/ 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-16T23:48:22.486 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_mf624.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_netx.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-16T23:48:22.487 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/ 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/c67x00/ 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/c67x00/c67x00.ko 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 143785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-08-16T23:48:22.488 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/ 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/common/ 2023-08-16T23:48:22.489 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/common/ulpi.ko 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc2/ 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/ 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 444489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/dwc3/dwc3.ko 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/ 2023-08-16T23:48:22.490 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/ 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-08-16T23:48:22.491 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 92377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 122073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 85841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-08-16T23:48:22.492 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/ 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-08-16T23:48:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-08-16T23:48:22.494 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 62153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15201 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 161321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/libcomposite.ko 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/ 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/bdc/ 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 157665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-08-16T23:48:22.495 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 76033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-08-16T23:48:22.496 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 156009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/ 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/bcma-hcd.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-08-16T23:48:22.497 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811_cs.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/ssb-hcd.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/ 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-16T23:48:22.498 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/cytherm.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ehset.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-16T23:48:22.499 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/lvstest.ko 2023-08-16T23:48:22.500 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/ 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbtest.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-16T23:48:22.501 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/mon/ 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/mon/usbmon.ko 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/musb/ 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 301521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/ 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-08-16T23:48:22.502 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 70209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-16T23:48:22.503 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/f81232.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 175145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-16T23:48:22.504 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 137105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 57937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 107417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-16T23:48:22.505 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/metro-usb.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 78113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mxuport.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-16T23:48:22.506 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 190233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-16T23:48:22.507 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 51297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-16T23:48:22.508 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 125505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usbserial.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-16T23:48:22.509 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-16T23:48:22.510 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 180017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-16T23:48:22.511 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/ 2023-08-16T23:48:22.512 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-16T23:48:22.512 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-16T23:48:22.512 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 105401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-16T23:48:22.512 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/ 2023-08-16T23:48:22.512 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/ 2023-08-16T23:48:22.512 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 153697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 75137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/ 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 113889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-16T23:48:22.513 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 86521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/ 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/ 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-08-16T23:48:22.514 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/as3711_bl.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/bd6107.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/da903x_bl.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/da9052_bl.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-08-16T23:48:22.515 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14769 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lv5207lp.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/max8925_bl.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/pandora_bl.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-08-16T23:48:22.516 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/ 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/matrox_w1.ko 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/w1-gpio.ko 2023-08-16T23:48:22.517 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/ 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-16T23:48:22.518 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/acquirewdt.ko 2023-08-16T23:48:22.519 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19977 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/advantechwdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/cpu5wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/da9052_wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/da9055_wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/da9063_wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/dw_wdt.ko 2023-08-16T23:48:22.520 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/eurotechwdt.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-16T23:48:22.521 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/kempld_wdt.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/mena21_wdt.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-16T23:48:22.522 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/retu_wdt.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-16T23:48:22.523 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sc1200wdt.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-16T23:48:22.524 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-16T23:48:22.525 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/ 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/ 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 176417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 71321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-scsiback.ko 2023-08-16T23:48:22.526 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/ 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/ 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 165625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/adfs/ 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/adfs/adfs.ko 2023-08-16T23:48:22.527 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/ 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 162617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/afs/ 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 931937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/afs/kafs.ko 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/autofs/ 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/autofs/autofs4.ko 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/ 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 64481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-16T23:48:22.528 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/bfs/ 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/bfs/bfs.ko 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/ 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 3471433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/ 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 305745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ 2023-08-16T23:48:22.529 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1315777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/ 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/configfs/ 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/configfs/configfs.ko 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/ 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 29273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-16T23:48:22.530 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/ 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 633825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/efs/ 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/efs/efs.ko 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/ 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1500513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/ 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-16T23:48:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/freevxfs/ 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/freevxfs/freevxfs.ko 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/ 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 226505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/ 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/ 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1226249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-16T23:48:22.532 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/ 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 141241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/ 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 221553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hpfs/ 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 193577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hpfs/hpfs.ko 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/ 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-16T23:48:22.533 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/ 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 420745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/ 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 279041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/ 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 87897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/ 2023-08-16T23:48:22.534 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/ 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/ 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/ 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/ 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 117705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-16T23:48:22.535 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1053889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-16T23:48:22.560 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.562 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv2.ko 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2041809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/ 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/ 2023-08-16T23:48:22.563 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1504905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/ 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 591417 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/ 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-16T23:48:22.564 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_ascii.ko 2023-08-16T23:48:22.565 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-16T23:48:22.566 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-16T23:48:22.567 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 94137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 142673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 165745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 118121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-16T23:48:22.568 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-16T23:48:22.569 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-16T23:48:22.570 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ntfs/ 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 219073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ntfs/ntfs.ko 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 244177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 440785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ 2023-08-16T23:48:22.571 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2589569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/omfs/ 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 52569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/omfs/omfs.ko 2023-08-16T23:48:22.572 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/ 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 336473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx4/ 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx4/qnx4.ko 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx6/ 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 46649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/qnx6/qnx6.ko 2023-08-16T23:48:22.573 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/ 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/quota_tree.ko 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/quota_v1.ko 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/quota/quota_v2.ko 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/ 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 530697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/ 2023-08-16T23:48:22.574 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/ 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/ 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 2660761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/ 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/ 2023-08-16T23:48:22.575 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 134313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/ 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/ 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 248049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 160857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/ 2023-08-16T23:48:22.576 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 3998129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/ 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/locking/ 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 74865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/locking/locktorture.ko 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/time/ 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/time/test_udelay.ko 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 58473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-16T23:48:22.577 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 6833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 6529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc7.ko 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/ 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-16T23:48:22.578 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/interval_tree_test.ko 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/ 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/ 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 6617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-16T23:48:22.579 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/memory-notifier-error-inject.ko 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/notifier-error-inject.ko 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/percpu_test.ko 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/pm-notifier-error-inject.ko 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/ 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 143433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/rbtree_test.ko 2023-08-16T23:48:22.580 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/ 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test-kstrtox.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test-string_helpers.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 4760825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_bpf.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_firmware.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 6369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_module.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/test_user_copy.ko 2023-08-16T23:48:22.581 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/xz/ 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/xz/xz_dec_test.ko 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/ 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ 2023-08-16T23:48:22.582 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/ 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 6985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-16T23:48:22.583 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/ 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-16T23:48:22.584 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/ 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 81017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/ 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 198465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/ 2023-08-16T23:48:22.585 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 652553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/ 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 63825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 772505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-16T23:48:22.586 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7585 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-16T23:48:22.587 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-16T23:48:22.588 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 55937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/ 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1046921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-16T23:48:22.589 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/ 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 124793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/ 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 194321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 56945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 59457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/ 2023-08-16T23:48:22.590 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 390297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/hsr/ 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 100257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/hsr/hsr.ko 2023-08-16T23:48:22.591 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 45169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 254601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-16T23:48:22.592 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48529 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61281 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-16T23:48:22.593 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-08-16T23:48:22.594 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-16T23:48:22.595 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20561 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-08-16T23:48:22.596 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-16T23:48:22.597 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-16T23:48:22.598 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 41577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ 2023-08-16T23:48:22.599 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 80793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_gre.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 92817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-16T23:48:22.600 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19017 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/mip6.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 42209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-16T23:48:22.601 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8913 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10937 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-16T23:48:22.602 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11617 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-16T23:48:22.603 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9009 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 73161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24193 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23305 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/ 2023-08-16T23:48:22.604 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 82929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/ 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 125873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 25865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35049 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-16T23:48:22.605 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 53153 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/lapb/ 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/lapb/lapb.ko 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/ 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23225 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 267257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc2.ko 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/ 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 291041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-16T23:48:22.606 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/ 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 119649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-16T23:48:22.607 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 103121 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 104593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 105129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 114393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 111161 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 114673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-16T23:48:22.608 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 114329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 113217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 116217 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 412481 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-16T23:48:22.609 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10681 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-16T23:48:22.610 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7697 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10993 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 408665 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10177 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-16T23:48:22.611 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 118145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 108393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 66641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-16T23:48:22.612 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10113 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 88513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9593 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 95353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-16T23:48:22.613 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-16T23:48:22.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-16T23:48:22.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-16T23:48:22.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28929 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-16T23:48:22.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-16T23:48:22.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 44025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-16T23:48:22.614 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 597353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 39905 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22713 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 49673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-16T23:48:22.615 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 40721 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11345 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13745 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14185 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-16T23:48:22.616 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13673 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_osf.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-16T23:48:22.617 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12737 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_synproxy.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tproxy.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 89329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/x_tables.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-16T23:48:22.618 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 18169 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10497 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 38857 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13873 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11489 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-16T23:48:22.619 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13289 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19689 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 14337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-16T23:48:22.620 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15577 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-16T23:48:22.621 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11209 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10465 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-16T23:48:22.622 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8801 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7865 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-16T23:48:22.623 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11785 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8001 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-16T23:48:22.624 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8641 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11825 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8297 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7633 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-16T23:48:22.625 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8257 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13329 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-16T23:48:22.626 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16089 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9505 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9473 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8809 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 8553 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15777 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpudp.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11129 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9105 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-16T23:48:22.627 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/ 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13969 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/ 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 12425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/ 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 379545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10321 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-16T23:48:22.628 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 11793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/ 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/phonet/ 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 109961 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/phonet/phonet.ko 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 54761 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/phonet/pn_pep.ko 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/ 2023-08-16T23:48:22.629 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 252889 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 165081 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 67241 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rxrpc/ 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 820137 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rxrpc/rxrpc.ko 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/ 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-16T23:48:22.630 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23537 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 34057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 43817 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20313 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36353 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-16T23:48:22.631 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 36057 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26145 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33945 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19233 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_cgroup.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31377 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31041 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 37953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-16T23:48:22.632 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 60393 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7441 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 13457 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33337 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10625 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7249 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 21649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-16T23:48:22.633 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33753 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 33609 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq_codel.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35433 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 48409 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22073 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 65793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-16T23:48:22.634 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 16065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 30273 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10793 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26065 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 35601 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27545 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-16T23:48:22.635 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 24729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 47849 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 32953 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 26881 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 31425 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 28897 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 27729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/ 2023-08-16T23:48:22.636 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 930369 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 19033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/ 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/ 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 335569 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 61833 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 1514649 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/ 2023-08-16T23:48:22.637 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 707401 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/ 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10025 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 862385 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/ 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15729 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/ 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 84841 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-16T23:48:22.638 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 68033 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 95985 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 10705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 17521 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/x25/ 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 125097 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/x25/x25.ko 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/ 2023-08-16T23:48:22.639 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 22657 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_algo.ko 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 20705 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 102265 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_user.ko 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/ 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/ 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 15513 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 638591 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 624324 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-16T23:48:22.640 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 7656 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 23361 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.alias.bin 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 9821 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 69921 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 146449 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 232695 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 210 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 72754 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-16T23:48:22.641 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 879 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 252923 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 307944 2023-08-08 09:07 ./lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/ 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/share/ 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/share/doc/ 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:drwxr-xr-x root/root 0 2023-08-08 09:07 ./usr/share/doc/linux-image-6.5.0-rc4-ga7fb1265323d/ 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 174 2023-08-08 09:07 ./usr/share/doc/linux-image-6.5.0-rc4-ga7fb1265323d/changelog.Debian.gz 2023-08-16T23:48:22.642 INFO:teuthology.orchestra.run.smithi153.stdout:-rw-r--r-- root/root 691 2023-08-08 09:07 ./usr/share/doc/linux-image-6.5.0-rc4-ga7fb1265323d/copyright 2023-08-16T23:48:22.643 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.644 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.644 DEBUG:teuthology.orchestra.run.smithi153:> egrep '(submenu|menuentry.*6.5.0-rc4-ga7fb1265323d).*{' /boot/grub/grub.cfg 2023-08-16T23:48:22.644 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.651 INFO:teuthology.orchestra.run.smithi153.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-08-16T23:48:22.652 INFO:teuthology.orchestra.run.smithi153.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc4-ga7fb1265323d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc4-ga7fb1265323d-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-08-16T23:48:22.652 INFO:teuthology.orchestra.run.smithi153.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc4-ga7fb1265323d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc4-ga7fb1265323d-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-08-16T23:48:22.652 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-08-16T23:48:22.652 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:22.653 DEBUG:teuthology.orchestra.run.smithi153:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-08-16T23:48:22.697 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi153.front.sepia.ceph.com to complete... 2023-08-16T23:48:22.981 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-08-16T23:48:22.993 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-08-16T23:48:23.455 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub' 2023-08-16T23:48:23.466 INFO:teuthology.orchestra.run.smithi153.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-16T23:48:23.478 INFO:teuthology.orchestra.run.smithi153.stderr:Generating grub configuration file ... 2023-08-16T23:48:23.702 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:23.715 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc4-ga7fb1265323d 2023-08-16T23:48:24.090 INFO:teuthology.orchestra.run.smithi153.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-08-16T23:48:24.101 INFO:teuthology.orchestra.run.smithi153.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-08-16T23:48:24.550 INFO:teuthology.orchestra.run.smithi178.stderr:done 2023-08-16T23:48:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:done 2023-08-16T23:48:55.728 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-16T23:48:55.729 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:48:55.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:48:56.824 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-16T23:48:56.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:48:56.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:49:14.224 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-16T23:49:15.248 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-16T23:49:23.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:49:23.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:49:24.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:49:24.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:49:26.288 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-16T23:49:27.316 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-16T23:49:38.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:49:38.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:49:39.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:49:39.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:49:41.360 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2023-08-16T23:49:56.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:49:56.373 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:49:57.748 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-16T23:50:12.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:50:12.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:50:13.781 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.153 2023-08-16T23:50:28.187 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-08-16T23:50:28.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:50:28.897 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-16T23:50:28.898 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2023-08-16T23:50:28.955 INFO:teuthology.orchestra.run.smithi178.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-16T23:50:28.956 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:50:28.956 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-16T23:50:28.956 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-08-16T23:50:29.958 DEBUG:teuthology.parallel:result is None 2023-08-16T23:50:31.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:50:31.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:50:32.027 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-08-16T23:50:32.752 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:50:32.756 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-16T23:50:32.757 DEBUG:teuthology.orchestra.run.smithi153:> uname -r 2023-08-16T23:50:32.817 INFO:teuthology.orchestra.run.smithi153.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-16T23:50:32.818 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-16T23:50:32.818 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-16T23:50:32.819 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-08-16T23:50:33.820 DEBUG:teuthology.parallel:result is None 2023-08-16T23:50:33.820 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-16T23:50:33.826 INFO:teuthology.task.internal:Creating test directory... 2023-08-16T23:50:33.827 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-16T23:50:33.834 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-16T23:50:33.849 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-16T23:50:33.859 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-16T23:50:33.865 INFO:teuthology.task.internal:Creating archive directory... 2023-08-16T23:50:33.866 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-16T23:50:33.898 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-16T23:50:33.933 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-16T23:50:33.940 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-16T23:50:33.941 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-16T23:50:33.974 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-16T23:50:34.068 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-16T23:50:34.086 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-16T23:50:34.098 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-16T23:50:34.108 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-16T23:50:34.112 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-16T23:50:34.120 INFO:teuthology.task.internal:Configuring sudo... 2023-08-16T23:50:34.121 DEBUG:teuthology.orchestra.run.smithi153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-16T23:50:34.127 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-16T23:50:34.164 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-16T23:50:34.174 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-16T23:50:34.175 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-16T23:50:34.206 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-16T23:50:34.225 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-16T23:50:34.276 DEBUG:teuthology.orchestra.run.smithi153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-16T23:50:34.340 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-16T23:50:34.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-16T23:50:34.422 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-16T23:50:34.443 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-16T23:50:34.506 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-16T23:50:34.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-16T23:50:34.627 DEBUG:teuthology.orchestra.run.smithi153:> sudo service rsyslog restart 2023-08-16T23:50:34.634 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2023-08-16T23:50:34.760 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-16T23:50:34.772 INFO:teuthology.task.internal:Starting timer... 2023-08-16T23:50:34.773 INFO:teuthology.run_tasks:Running task pcp... 2023-08-16T23:50:34.788 INFO:teuthology.run_tasks:Running task selinux... 2023-08-16T23:50:34.803 DEBUG:teuthology.task.selinux:Excluding smithi153: OS 'ubuntu' does not support SELinux 2023-08-16T23:50:34.803 DEBUG:teuthology.task.selinux:Excluding smithi178: OS 'ubuntu' does not support SELinux 2023-08-16T23:50:34.803 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-16T23:50:34.804 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-08-16T23:50:34.804 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-16T23:50:34.804 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-16T23:50:34.816 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-16T23:50:34.817 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-16T23:50:34.841 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-16T23:50:34.842 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi153.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-16T23:58:36.099 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi153.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2023-08-16T23:58:36.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:58:36.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:58:36.203 DEBUG:teuthology.orchestra.run.smithi153:> true 2023-08-16T23:58:36.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi153.front.sepia.ceph.com' 2023-08-16T23:58:36.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:58:36.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-16T23:58:36.542 DEBUG:teuthology.orchestra.run.smithi178:> true 2023-08-16T23:58:36.776 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2023-08-16T23:58:36.777 INFO:teuthology.run_tasks:Running task clock... 2023-08-16T23:58:36.789 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-16T23:58:36.790 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-16T23:58:36.791 DEBUG:teuthology.orchestra.run.smithi153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-16T23:58:36.798 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-16T23:58:36.799 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-16T23:58:36.869 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-08-16T23:58:36.869 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Command line: ntpd -gq 2023-08-16T23:58:36.871 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: proto: precision = 0.042 usec (-24) 2023-08-16T23:58:36.872 INFO:teuthology.orchestra.run.smithi153.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-16T23:58:36.872 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-16T23:58:36.873 INFO:teuthology.orchestra.run.smithi153.stderr:restrict ::: KOD does nothing without LIMITED. 2023-08-16T23:58:36.874 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: restrict ::: KOD does nothing without LIMITED. 2023-08-16T23:58:36.874 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listen and drop on 0 v6wildcard [::]:123 2023-08-16T23:58:36.874 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-08-16T23:58:36.875 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listen normally on 2 lo 127.0.0.1:123 2023-08-16T23:58:36.875 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listen normally on 3 enp3s0f1 172.21.15.153:123 2023-08-16T23:58:36.875 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listen normally on 4 lo [::1]:123 2023-08-16T23:58:36.875 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6deb%5]:123 2023-08-16T23:58:36.875 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:36 ntpd[22411]: Listening on routing socket on fd #22 for interface updates 2023-08-16T23:58:36.895 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-08-16T23:58:36.895 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Command line: ntpd -gq 2023-08-16T23:58:36.896 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: proto: precision = 0.060 usec (-24) 2023-08-16T23:58:36.897 INFO:teuthology.orchestra.run.smithi178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-16T23:58:36.897 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-16T23:58:36.897 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: restrict ::: KOD does nothing without LIMITED. 2023-08-16T23:58:36.898 INFO:teuthology.orchestra.run.smithi178.stderr:restrict ::: KOD does nothing without LIMITED. 2023-08-16T23:58:36.898 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listen and drop on 0 v6wildcard [::]:123 2023-08-16T23:58:36.899 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-08-16T23:58:36.899 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listen normally on 2 lo 127.0.0.1:123 2023-08-16T23:58:36.899 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listen normally on 3 enp3s0f1 172.21.15.178:123 2023-08-16T23:58:36.899 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listen normally on 4 lo [::1]:123 2023-08-16T23:58:36.899 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ef9%5]:123 2023-08-16T23:58:36.899 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:36 ntpd[22410]: Listening on routing socket on fd #22 for interface updates 2023-08-16T23:58:37.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:37 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:37.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:37 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:37 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:37 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:37 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:37.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:37 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:38.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:38.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:38 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:38.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:38.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:38.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:38.901 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:38 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:39.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:39.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:39.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:39.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:39.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:39.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:39.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:39.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:39.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:39.898 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:39.898 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:39.898 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:39 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:40 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:40.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:40 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:40.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:40 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:40.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:40 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:40.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:40 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:40.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:40 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:40.898 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:40 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:41.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:41.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:41 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:41.899 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.900 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.901 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.901 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:41.901 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:41.901 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:41.902 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:41.902 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:41.902 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:41 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:42.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:42.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:42.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:42.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:42.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:42.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:42.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:42.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:42.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:42.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:42.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:42.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:42 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:42.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:42 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:42.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:42 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:42.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:42 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:42.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:42 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:42.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:42 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:42.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:42 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:43 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:43 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:43 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:43.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:43 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:43.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:43 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:43.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:43 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:43.896 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:43.897 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:43.898 INFO:teuthology.orchestra.run.smithi178.stdout:16 Aug 23:58:43 ntpd[22410]: ntpd: time slew -0.002007 s 2023-08-16T23:58:43.898 INFO:teuthology.orchestra.run.smithi178.stdout:ntpd: time slew -0.002007s 2023-08-16T23:58:43.899 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-08-16T23:58:43.899 INFO:teuthology.orchestra.run.smithi178.stderr:16 Aug 23:58:43 ntpd[22410]: can't open /var/log/ntpstats/loopstats.20230816: Permission denied 2023-08-16T23:58:44.046 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2023-08-16T23:58:44.046 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2023-08-16T23:58:44.047 INFO:teuthology.orchestra.run.smithi178.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:44.047 INFO:teuthology.orchestra.run.smithi178.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:44.047 INFO:teuthology.orchestra.run.smithi178.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:44.047 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-16T23:58:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: can't open /var/log/ntpstats/rawstats.20230816: Permission denied 2023-08-16T23:58:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-16T23:58:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: can't open /var/log/ntpstats/peerstats.20230816: Permission denied 2023-08-16T23:58:44.871 INFO:teuthology.orchestra.run.smithi153.stdout:16 Aug 23:58:44 ntpd[22411]: ntpd: time slew +0.003004 s 2023-08-16T23:58:44.871 INFO:teuthology.orchestra.run.smithi153.stdout:ntpd: time slew +0.003004s 2023-08-16T23:58:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-08-16T23:58:44.872 INFO:teuthology.orchestra.run.smithi153.stderr:16 Aug 23:58:44 ntpd[22411]: can't open /var/log/ntpstats/loopstats.20230816: Permission denied 2023-08-16T23:58:45.013 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2023-08-16T23:58:45.013 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2023-08-16T23:58:45.013 INFO:teuthology.orchestra.run.smithi153.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:45.014 INFO:teuthology.orchestra.run.smithi153.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:45.014 INFO:teuthology.orchestra.run.smithi153.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:45.014 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-16T23:58:45.015 INFO:teuthology.run_tasks:Running task install... 2023-08-16T23:58:45.024 DEBUG:teuthology.task.install:project ceph 2023-08-16T23:58:45.025 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}} 2023-08-16T23:58:45.025 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'} 2023-08-16T23:58:45.025 INFO:teuthology.task.install:Using flavor: default 2023-08-16T23:58:45.038 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-16T23:58:45.038 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-16T23:58:45.039 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-key list | grep Ceph 2023-08-16T23:58:45.039 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-key list | grep Ceph 2023-08-16T23:58:45.274 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-08-16T23:58:45.274 INFO:teuthology.orchestra.run.smithi153.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-08-16T23:58:45.412 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-08-16T23:58:45.412 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph.com (release key) 2023-08-16T23:58:45.413 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-08-16T23:58:45.414 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-08-16T23:58:45.414 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-16T23:58:45.423 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-08-16T23:58:45.423 INFO:teuthology.orchestra.run.smithi153.stdout:uid [ unknown] Ceph.com (release key) 2023-08-16T23:58:45.424 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-08-16T23:58:45.425 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-08-16T23:58:45.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-16T23:58:45.575 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default/ 2023-08-16T23:58:45.575 INFO:teuthology.task.install.deb:Package version is 16.2.13-522-g23c07d8f-1focal 2023-08-16T23:58:45.665 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default/ 2023-08-16T23:58:45.670 INFO:teuthology.task.install.deb:Package version is 16.2.13-522-g23c07d8f-1focal 2023-08-16T23:58:45.698 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-16T23:58:45.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-08-16T23:58:45.735 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2023-08-16T23:58:45.842 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-16T23:58:45.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-08-16T23:58:45.879 DEBUG:teuthology.orchestra.run.smithi153:> sudo apt-get update 2023-08-16T23:58:46.020 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-08-16T23:58:46.119 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-08-16T23:58:46.151 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-08-16T23:58:46.151 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-08-16T23:58:46.151 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-08-16T23:58:46.162 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal InRelease 2023-08-16T23:58:46.163 INFO:teuthology.orchestra.run.smithi153.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-08-16T23:58:46.197 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal InRelease 2023-08-16T23:58:46.202 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-08-16T23:58:46.211 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-08-16T23:58:46.219 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-08-16T23:58:46.247 INFO:teuthology.orchestra.run.smithi153.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal Release.gpg 2023-08-16T23:58:46.250 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal Release.gpg 2023-08-16T23:58:46.263 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main i386 Packages [3,094 B] 2023-08-16T23:58:46.286 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-08-16T23:58:46.286 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main i386 Packages [3,094 B] 2023-08-16T23:58:46.312 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2023-08-16T23:58:46.343 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2023-08-16T23:58:47.465 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 28.0 kB in 1s (20.2 kB/s) 2023-08-16T23:58:47.584 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 28.0 kB in 1s (20.4 kB/s) 2023-08-16T23:58:48.685 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2023-08-16T23:58:48.728 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.13-522-g23c07d8f-1focal cephadm=16.2.13-522-g23c07d8f-1focal ceph-mds=16.2.13-522-g23c07d8f-1focal ceph-mgr=16.2.13-522-g23c07d8f-1focal ceph-common=16.2.13-522-g23c07d8f-1focal ceph-fuse=16.2.13-522-g23c07d8f-1focal ceph-test=16.2.13-522-g23c07d8f-1focal radosgw=16.2.13-522-g23c07d8f-1focal python3-rados=16.2.13-522-g23c07d8f-1focal python3-rgw=16.2.13-522-g23c07d8f-1focal python3-cephfs=16.2.13-522-g23c07d8f-1focal python3-rbd=16.2.13-522-g23c07d8f-1focal libcephfs2=16.2.13-522-g23c07d8f-1focal libcephfs-dev=16.2.13-522-g23c07d8f-1focal librados2=16.2.13-522-g23c07d8f-1focal librbd1=16.2.13-522-g23c07d8f-1focal rbd-fuse=16.2.13-522-g23c07d8f-1focal python3-cephfs=16.2.13-522-g23c07d8f-1focal cephfs-shell=16.2.13-522-g23c07d8f-1focal cephfs-top=16.2.13-522-g23c07d8f-1focal cephfs-mirror=16.2.13-522-g23c07d8f-1focal 2023-08-16T23:58:48.814 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-08-16T23:58:48.848 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2023-08-16T23:58:48.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.13-522-g23c07d8f-1focal cephadm=16.2.13-522-g23c07d8f-1focal ceph-mds=16.2.13-522-g23c07d8f-1focal ceph-mgr=16.2.13-522-g23c07d8f-1focal ceph-common=16.2.13-522-g23c07d8f-1focal ceph-fuse=16.2.13-522-g23c07d8f-1focal ceph-test=16.2.13-522-g23c07d8f-1focal radosgw=16.2.13-522-g23c07d8f-1focal python3-rados=16.2.13-522-g23c07d8f-1focal python3-rgw=16.2.13-522-g23c07d8f-1focal python3-cephfs=16.2.13-522-g23c07d8f-1focal python3-rbd=16.2.13-522-g23c07d8f-1focal libcephfs2=16.2.13-522-g23c07d8f-1focal libcephfs-dev=16.2.13-522-g23c07d8f-1focal librados2=16.2.13-522-g23c07d8f-1focal librbd1=16.2.13-522-g23c07d8f-1focal rbd-fuse=16.2.13-522-g23c07d8f-1focal python3-cephfs=16.2.13-522-g23c07d8f-1focal cephfs-shell=16.2.13-522-g23c07d8f-1focal cephfs-top=16.2.13-522-g23c07d8f-1focal cephfs-mirror=16.2.13-522-g23c07d8f-1focal 2023-08-16T23:58:48.984 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-08-16T23:58:49.044 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2023-08-16T23:58:49.045 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2023-08-16T23:58:49.179 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2023-08-16T23:58:49.180 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2023-08-16T23:58:49.227 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2023-08-16T23:58:49.228 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-08-16T23:58:49.228 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-16T23:58:49.229 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2023-08-16T23:58:49.229 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-08-16T23:58:49.230 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-08-16T23:58:49.230 INFO:teuthology.orchestra.run.smithi178.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-08-16T23:58:49.230 INFO:teuthology.orchestra.run.smithi178.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-08-16T23:58:49.231 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-08-16T23:58:49.231 INFO:teuthology.orchestra.run.smithi178.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-08-16T23:58:49.231 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-08-16T23:58:49.231 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-08-16T23:58:49.232 INFO:teuthology.orchestra.run.smithi178.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-08-16T23:58:49.232 INFO:teuthology.orchestra.run.smithi178.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-08-16T23:58:49.232 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-08-16T23:58:49.232 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-08-16T23:58:49.233 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-08-16T23:58:49.233 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-08-16T23:58:49.233 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-08-16T23:58:49.233 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-08-16T23:58:49.234 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-08-16T23:58:49.236 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-08-16T23:58:49.236 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2023-08-16T23:58:49.237 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet 2023-08-16T23:58:49.237 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2023-08-16T23:58:49.237 INFO:teuthology.orchestra.run.smithi178.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-08-16T23:58:49.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-08-16T23:58:49.238 INFO:teuthology.orchestra.run.smithi178.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-08-16T23:58:49.238 INFO:teuthology.orchestra.run.smithi178.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-08-16T23:58:49.238 INFO:teuthology.orchestra.run.smithi178.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-08-16T23:58:49.239 INFO:teuthology.orchestra.run.smithi178.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-08-16T23:58:49.239 INFO:teuthology.orchestra.run.smithi178.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-08-16T23:58:49.241 INFO:teuthology.orchestra.run.smithi178.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-08-16T23:58:49.241 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2023-08-16T23:58:49.241 INFO:teuthology.orchestra.run.smithi178.stdout: btrfs-tools 2023-08-16T23:58:49.348 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2023-08-16T23:58:49.349 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-08-16T23:58:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-16T23:58:49.349 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2023-08-16T23:58:49.349 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-08-16T23:58:49.350 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-08-16T23:58:49.350 INFO:teuthology.orchestra.run.smithi153.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-08-16T23:58:49.350 INFO:teuthology.orchestra.run.smithi153.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-08-16T23:58:49.351 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-08-16T23:58:49.352 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-08-16T23:58:49.353 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug socat 2023-08-16T23:58:49.353 INFO:teuthology.orchestra.run.smithi153.stdout: xmlstarlet 2023-08-16T23:58:49.353 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2023-08-16T23:58:49.353 INFO:teuthology.orchestra.run.smithi153.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-08-16T23:58:49.353 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-08-16T23:58:49.354 INFO:teuthology.orchestra.run.smithi153.stdout:Recommended packages: 2023-08-16T23:58:49.355 INFO:teuthology.orchestra.run.smithi153.stdout: btrfs-tools 2023-08-16T23:58:49.412 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2023-08-16T23:58:49.413 INFO:teuthology.orchestra.run.smithi178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-08-16T23:58:49.413 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-08-16T23:58:49.413 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2023-08-16T23:58:49.414 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2023-08-16T23:58:49.414 INFO:teuthology.orchestra.run.smithi178.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2023-08-16T23:58:49.414 INFO:teuthology.orchestra.run.smithi178.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-08-16T23:58:49.415 INFO:teuthology.orchestra.run.smithi178.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-08-16T23:58:49.415 INFO:teuthology.orchestra.run.smithi178.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-08-16T23:58:49.415 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-08-16T23:58:49.415 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-08-16T23:58:49.415 INFO:teuthology.orchestra.run.smithi178.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-08-16T23:58:49.415 INFO:teuthology.orchestra.run.smithi178.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-08-16T23:58:49.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-08-16T23:58:49.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-08-16T23:58:49.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-08-16T23:58:49.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-08-16T23:58:49.416 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-08-16T23:58:49.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-08-16T23:58:49.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-08-16T23:58:49.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-08-16T23:58:49.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-08-16T23:58:49.417 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2023-08-16T23:58:49.417 INFO:teuthology.orchestra.run.smithi178.stdout: rbd-fuse socat xmlstarlet 2023-08-16T23:58:49.418 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2023-08-16T23:58:49.419 INFO:teuthology.orchestra.run.smithi178.stdout: librados2 librbd1 2023-08-16T23:58:49.532 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2023-08-16T23:58:49.533 INFO:teuthology.orchestra.run.smithi153.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-08-16T23:58:49.533 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-08-16T23:58:49.533 INFO:teuthology.orchestra.run.smithi153.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm cephfs-mirror 2023-08-16T23:58:49.534 INFO:teuthology.orchestra.run.smithi153.stdout: cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 libjaeger libjq1 2023-08-16T23:58:49.534 INFO:teuthology.orchestra.run.smithi153.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2023-08-16T23:58:49.534 INFO:teuthology.orchestra.run.smithi153.stdout: liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2023-08-16T23:58:49.534 INFO:teuthology.orchestra.run.smithi153.stdout: librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-08-16T23:58:49.534 INFO:teuthology.orchestra.run.smithi153.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-08-16T23:58:49.535 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2023-08-16T23:58:49.536 INFO:teuthology.orchestra.run.smithi153.stdout: rbd-fuse socat xmlstarlet 2023-08-16T23:58:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2023-08-16T23:58:49.537 INFO:teuthology.orchestra.run.smithi153.stdout: librados2 librbd1 2023-08-16T23:58:49.576 INFO:teuthology.orchestra.run.smithi178.stdout:2 upgraded, 104 newly installed, 0 to remove and 234 not upgraded. 2023-08-16T23:58:49.576 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 174 MB of archives. 2023-08-16T23:58:49.577 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 805 MB of additional disk space will be used. 2023-08-16T23:58:49.577 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.13-522-g23c07d8f-1focal [3,952 B] 2023-08-16T23:58:49.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.13-522-g23c07d8f-1focal [3,384 kB] 2023-08-16T23:58:49.624 INFO:teuthology.orchestra.run.smithi153.stdout:2 upgraded, 104 newly installed, 0 to remove and 234 not upgraded. 2023-08-16T23:58:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 174 MB of archives. 2023-08-16T23:58:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 805 MB of additional disk space will be used. 2023-08-16T23:58:49.625 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-08-16T23:58:49.631 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-08-16T23:58:49.645 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-08-16T23:58:49.652 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-08-16T23:58:49.678 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-08-16T23:58:49.693 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.13-522-g23c07d8f-1focal [3,952 B] 2023-08-16T23:58:49.707 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-08-16T23:58:49.709 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-08-16T23:58:49.716 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-08-16T23:58:49.719 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-08-16T23:58:49.721 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-08-16T23:58:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.13-522-g23c07d8f-1focal [3,384 kB] 2023-08-16T23:58:49.738 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-08-16T23:58:49.742 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-08-16T23:58:49.743 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-08-16T23:58:49.748 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-08-16T23:58:49.749 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-08-16T23:58:49.750 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-08-16T23:58:49.751 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-08-16T23:58:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-08-16T23:58:49.753 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-08-16T23:58:49.754 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-08-16T23:58:49.760 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-08-16T23:58:49.772 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-08-16T23:58:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-08-16T23:58:49.773 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-08-16T23:58:49.776 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-08-16T23:58:49.777 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-08-16T23:58:49.779 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-08-16T23:58:49.780 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-08-16T23:58:49.782 INFO:teuthology.orchestra.run.smithi153.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-08-16T23:58:49.788 INFO:teuthology.orchestra.run.smithi153.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-08-16T23:58:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-08-16T23:58:49.795 INFO:teuthology.orchestra.run.smithi153.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-08-16T23:58:49.796 INFO:teuthology.orchestra.run.smithi153.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-08-16T23:58:49.798 INFO:teuthology.orchestra.run.smithi153.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-08-16T23:58:49.811 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.13-522-g23c07d8f-1focal [3,384 kB] 2023-08-16T23:58:49.812 INFO:teuthology.orchestra.run.smithi153.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-08-16T23:58:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-08-16T23:58:49.814 INFO:teuthology.orchestra.run.smithi153.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-08-16T23:58:49.816 INFO:teuthology.orchestra.run.smithi153.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-08-16T23:58:49.817 INFO:teuthology.orchestra.run.smithi153.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-08-16T23:58:49.819 INFO:teuthology.orchestra.run.smithi153.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-08-16T23:58:49.831 INFO:teuthology.orchestra.run.smithi153.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-08-16T23:58:49.832 INFO:teuthology.orchestra.run.smithi153.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-08-16T23:58:49.877 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-08-16T23:58:49.935 INFO:teuthology.orchestra.run.smithi153.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-08-16T23:58:49.949 INFO:teuthology.orchestra.run.smithi153.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-08-16T23:58:49.951 INFO:teuthology.orchestra.run.smithi153.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-08-16T23:58:49.965 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.13-522-g23c07d8f-1focal [729 kB] 2023-08-16T23:58:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-08-16T23:58:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-08-16T23:58:49.969 INFO:teuthology.orchestra.run.smithi153.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-08-16T23:58:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-08-16T23:58:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-08-16T23:58:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-08-16T23:58:49.970 INFO:teuthology.orchestra.run.smithi153.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-08-16T23:58:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-08-16T23:58:49.980 INFO:teuthology.orchestra.run.smithi153.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-08-16T23:58:49.986 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.13-522-g23c07d8f-1focal [412 kB] 2023-08-16T23:58:49.999 INFO:teuthology.orchestra.run.smithi153.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-08-16T23:58:50.009 INFO:teuthology.orchestra.run.smithi153.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-08-16T23:58:50.010 INFO:teuthology.orchestra.run.smithi153.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-08-16T23:58:50.010 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.13-522-g23c07d8f-1focal [22.2 kB] 2023-08-16T23:58:50.011 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.13-522-g23c07d8f-1focal [212 kB] 2023-08-16T23:58:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-08-16T23:58:50.011 INFO:teuthology.orchestra.run.smithi153.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-08-16T23:58:50.014 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.13-522-g23c07d8f-1focal [38.4 kB] 2023-08-16T23:58:50.014 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-08-16T23:58:50.015 INFO:teuthology.orchestra.run.smithi153.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-08-16T23:58:50.016 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.13-522-g23c07d8f-1focal [387 kB] 2023-08-16T23:58:50.022 INFO:teuthology.orchestra.run.smithi153.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-08-16T23:58:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-08-16T23:58:50.023 INFO:teuthology.orchestra.run.smithi153.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-08-16T23:58:50.024 INFO:teuthology.orchestra.run.smithi153.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-08-16T23:58:50.035 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-08-16T23:58:50.035 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.13-522-g23c07d8f-1focal [3,686 kB] 2023-08-16T23:58:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-08-16T23:58:50.035 INFO:teuthology.orchestra.run.smithi153.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-08-16T23:58:50.036 INFO:teuthology.orchestra.run.smithi153.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-08-16T23:58:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-08-16T23:58:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-08-16T23:58:50.051 INFO:teuthology.orchestra.run.smithi153.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-08-16T23:58:50.052 INFO:teuthology.orchestra.run.smithi153.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-08-16T23:58:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-08-16T23:58:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-08-16T23:58:50.054 INFO:teuthology.orchestra.run.smithi153.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-08-16T23:58:50.064 INFO:teuthology.orchestra.run.smithi153.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-08-16T23:58:50.071 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-08-16T23:58:50.081 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-08-16T23:58:50.162 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-08-16T23:58:50.180 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-08-16T23:58:50.186 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-08-16T23:58:50.197 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.13-522-g23c07d8f-1focal [116 kB] 2023-08-16T23:58:50.206 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.13-522-g23c07d8f-1focal [448 kB] 2023-08-16T23:58:50.225 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.13-522-g23c07d8f-1focal [22.6 MB] 2023-08-16T23:58:50.375 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-08-16T23:58:50.517 INFO:teuthology.orchestra.run.smithi153.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.13-522-g23c07d8f-1focal [3,384 kB] 2023-08-16T23:58:50.620 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-08-16T23:58:50.652 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-08-16T23:58:50.809 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-08-16T23:58:50.816 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-08-16T23:58:50.825 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-08-16T23:58:50.831 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-08-16T23:58:50.859 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-08-16T23:58:50.864 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-08-16T23:58:50.867 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-08-16T23:58:50.894 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-08-16T23:58:51.065 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-08-16T23:58:51.123 INFO:teuthology.orchestra.run.smithi153.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.13-522-g23c07d8f-1focal [729 kB] 2023-08-16T23:58:51.221 INFO:teuthology.orchestra.run.smithi153.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.13-522-g23c07d8f-1focal [412 kB] 2023-08-16T23:58:51.277 INFO:teuthology.orchestra.run.smithi153.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.13-522-g23c07d8f-1focal [22.2 kB] 2023-08-16T23:58:51.280 INFO:teuthology.orchestra.run.smithi153.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.13-522-g23c07d8f-1focal [212 kB] 2023-08-16T23:58:51.283 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.13-522-g23c07d8f-1focal [5,914 kB] 2023-08-16T23:58:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.13-522-g23c07d8f-1focal [38.4 kB] 2023-08-16T23:58:51.317 INFO:teuthology.orchestra.run.smithi153.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.13-522-g23c07d8f-1focal [387 kB] 2023-08-16T23:58:51.367 INFO:teuthology.orchestra.run.smithi153.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.13-522-g23c07d8f-1focal [3,686 kB] 2023-08-16T23:58:51.383 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-08-16T23:58:51.450 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-08-16T23:58:51.462 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-08-16T23:58:51.585 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.13-522-g23c07d8f-1focal [203 kB] 2023-08-16T23:58:51.592 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.13-522-g23c07d8f-1focal [126 kB] 2023-08-16T23:58:51.596 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.13-522-g23c07d8f-1focal [1,532 kB] 2023-08-16T23:58:51.647 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-08-16T23:58:51.648 INFO:teuthology.orchestra.run.smithi178.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-08-16T23:58:51.655 INFO:teuthology.orchestra.run.smithi178.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-08-16T23:58:51.658 INFO:teuthology.orchestra.run.smithi178.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-08-16T23:58:51.672 INFO:teuthology.orchestra.run.smithi178.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-08-16T23:58:51.679 INFO:teuthology.orchestra.run.smithi178.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.13-522-g23c07d8f-1focal [6,989 kB] 2023-08-16T23:58:51.696 INFO:teuthology.orchestra.run.smithi178.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-08-16T23:58:51.707 INFO:teuthology.orchestra.run.smithi178.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-08-16T23:58:51.871 INFO:teuthology.orchestra.run.smithi153.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.13-522-g23c07d8f-1focal [116 kB] 2023-08-16T23:58:51.873 INFO:teuthology.orchestra.run.smithi178.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-08-16T23:58:51.873 INFO:teuthology.orchestra.run.smithi153.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.13-522-g23c07d8f-1focal [448 kB] 2023-08-16T23:58:51.880 INFO:teuthology.orchestra.run.smithi153.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.13-522-g23c07d8f-1focal [22.6 MB] 2023-08-16T23:58:52.070 INFO:teuthology.orchestra.run.smithi178.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.13-522-g23c07d8f-1focal [26.2 MB] 2023-08-16T23:58:52.215 INFO:teuthology.orchestra.run.smithi178.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-08-16T23:58:52.275 INFO:teuthology.orchestra.run.smithi178.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-08-16T23:58:52.340 INFO:teuthology.orchestra.run.smithi178.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-08-16T23:58:52.347 INFO:teuthology.orchestra.run.smithi178.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-08-16T23:58:52.361 INFO:teuthology.orchestra.run.smithi178.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-08-16T23:58:52.897 INFO:teuthology.orchestra.run.smithi178.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-08-16T23:58:52.949 INFO:teuthology.orchestra.run.smithi178.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-08-16T23:58:52.951 INFO:teuthology.orchestra.run.smithi178.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-08-16T23:58:53.026 INFO:teuthology.orchestra.run.smithi178.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-08-16T23:58:53.027 INFO:teuthology.orchestra.run.smithi178.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-08-16T23:58:53.191 INFO:teuthology.orchestra.run.smithi178.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-08-16T23:58:53.387 INFO:teuthology.orchestra.run.smithi178.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-08-16T23:58:53.433 INFO:teuthology.orchestra.run.smithi178.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-08-16T23:58:53.495 INFO:teuthology.orchestra.run.smithi178.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-08-16T23:58:53.515 INFO:teuthology.orchestra.run.smithi178.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-08-16T23:58:53.593 INFO:teuthology.orchestra.run.smithi178.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-08-16T23:58:53.604 INFO:teuthology.orchestra.run.smithi178.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-08-16T23:58:53.623 INFO:teuthology.orchestra.run.smithi178.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-08-16T23:58:53.634 INFO:teuthology.orchestra.run.smithi178.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.13-522-g23c07d8f-1focal [4,044 B] 2023-08-16T23:58:53.635 INFO:teuthology.orchestra.run.smithi178.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.13-522-g23c07d8f-1focal [833 kB] 2023-08-16T23:58:53.674 INFO:teuthology.orchestra.run.smithi178.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.13-522-g23c07d8f-1focal [2,363 kB] 2023-08-16T23:58:53.719 INFO:teuthology.orchestra.run.smithi178.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-08-16T23:58:53.749 INFO:teuthology.orchestra.run.smithi178.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-08-16T23:58:53.770 INFO:teuthology.orchestra.run.smithi178.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-08-16T23:58:53.816 INFO:teuthology.orchestra.run.smithi178.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.13-522-g23c07d8f-1focal [76.4 kB] 2023-08-16T23:58:53.822 INFO:teuthology.orchestra.run.smithi178.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.13-522-g23c07d8f-1focal [100 kB] 2023-08-16T23:58:53.826 INFO:teuthology.orchestra.run.smithi178.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.13-522-g23c07d8f-1focal [2,823 kB] 2023-08-16T23:58:53.942 INFO:teuthology.orchestra.run.smithi178.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-08-16T23:58:53.999 INFO:teuthology.orchestra.run.smithi178.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.13-522-g23c07d8f-1focal [7,887 kB] 2023-08-16T23:58:54.275 INFO:teuthology.orchestra.run.smithi153.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.13-522-g23c07d8f-1focal [5,914 kB] 2023-08-16T23:58:54.424 INFO:teuthology.orchestra.run.smithi178.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-08-16T23:58:54.474 INFO:teuthology.orchestra.run.smithi178.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-08-16T23:58:54.477 INFO:teuthology.orchestra.run.smithi178.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-08-16T23:58:54.478 INFO:teuthology.orchestra.run.smithi178.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.13-522-g23c07d8f-1focal [4,156 B] 2023-08-16T23:58:54.479 INFO:teuthology.orchestra.run.smithi178.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.13-522-g23c07d8f-1focal [49.3 MB] 2023-08-16T23:58:54.549 INFO:teuthology.orchestra.run.smithi178.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-08-16T23:58:54.550 INFO:teuthology.orchestra.run.smithi178.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-08-16T23:58:54.556 INFO:teuthology.orchestra.run.smithi178.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-08-16T23:58:54.558 INFO:teuthology.orchestra.run.smithi178.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-08-16T23:58:54.572 INFO:teuthology.orchestra.run.smithi178.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-08-16T23:58:54.686 INFO:teuthology.orchestra.run.smithi178.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-08-16T23:58:54.686 INFO:teuthology.orchestra.run.smithi178.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-08-16T23:58:54.853 INFO:teuthology.orchestra.run.smithi178.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-08-16T23:58:54.878 INFO:teuthology.orchestra.run.smithi153.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.13-522-g23c07d8f-1focal [203 kB] 2023-08-16T23:58:54.889 INFO:teuthology.orchestra.run.smithi153.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.13-522-g23c07d8f-1focal [126 kB] 2023-08-16T23:58:54.909 INFO:teuthology.orchestra.run.smithi153.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.13-522-g23c07d8f-1focal [1,532 kB] 2023-08-16T23:58:55.021 INFO:teuthology.orchestra.run.smithi178.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-08-16T23:58:55.063 INFO:teuthology.orchestra.run.smithi153.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.13-522-g23c07d8f-1focal [6,989 kB] 2023-08-16T23:58:55.235 INFO:teuthology.orchestra.run.smithi178.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-08-16T23:58:55.282 INFO:teuthology.orchestra.run.smithi178.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-08-16T23:58:55.303 INFO:teuthology.orchestra.run.smithi178.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-08-16T23:58:55.360 INFO:teuthology.orchestra.run.smithi178.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-08-16T23:58:55.766 INFO:teuthology.orchestra.run.smithi153.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.13-522-g23c07d8f-1focal [26.2 MB] 2023-08-16T23:58:57.492 INFO:teuthology.orchestra.run.smithi178.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.13-522-g23c07d8f-1focal [235 kB] 2023-08-16T23:58:57.495 INFO:teuthology.orchestra.run.smithi178.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.13-522-g23c07d8f-1focal [17.4 kB] 2023-08-16T23:58:57.495 INFO:teuthology.orchestra.run.smithi178.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.13-522-g23c07d8f-1focal [13.0 kB] 2023-08-16T23:58:57.496 INFO:teuthology.orchestra.run.smithi178.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.13-522-g23c07d8f-1focal [21.5 kB] 2023-08-16T23:58:57.496 INFO:teuthology.orchestra.run.smithi178.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.13-522-g23c07d8f-1focal [11.3 MB] 2023-08-16T23:58:58.183 INFO:teuthology.orchestra.run.smithi178.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.13-522-g23c07d8f-1focal [78.2 kB] 2023-08-16T23:58:58.301 INFO:teuthology.orchestra.run.smithi153.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.13-522-g23c07d8f-1focal [4,044 B] 2023-08-16T23:58:58.301 INFO:teuthology.orchestra.run.smithi153.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.13-522-g23c07d8f-1focal [833 kB] 2023-08-16T23:58:58.326 INFO:teuthology.orchestra.run.smithi153.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.13-522-g23c07d8f-1focal [2,363 kB] 2023-08-16T23:58:58.434 INFO:teuthology.orchestra.run.smithi153.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.13-522-g23c07d8f-1focal [76.4 kB] 2023-08-16T23:58:58.436 INFO:teuthology.orchestra.run.smithi153.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.13-522-g23c07d8f-1focal [100 kB] 2023-08-16T23:58:58.439 INFO:teuthology.orchestra.run.smithi153.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.13-522-g23c07d8f-1focal [2,823 kB] 2023-08-16T23:58:58.576 INFO:teuthology.orchestra.run.smithi153.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.13-522-g23c07d8f-1focal [7,887 kB] 2023-08-16T23:58:58.949 INFO:teuthology.orchestra.run.smithi153.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.13-522-g23c07d8f-1focal [4,156 B] 2023-08-16T23:58:58.949 INFO:teuthology.orchestra.run.smithi153.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.13-522-g23c07d8f-1focal [49.3 MB] 2023-08-16T23:58:59.104 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 174 MB in 9s (19.8 MB/s) 2023-08-16T23:58:59.260 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyperclip. 2023-08-16T23:58:59.333 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107759 files and directories currently installed.) 2023-08-16T23:58:59.333 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-08-16T23:58:59.375 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-08-16T23:58:59.669 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-wcwidth. 2023-08-16T23:58:59.681 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-08-16T23:58:59.710 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-08-16T23:59:00.072 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cmd2. 2023-08-16T23:59:00.090 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-08-16T23:59:00.130 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-08-16T23:59:00.424 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjaeger. 2023-08-16T23:59:00.443 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../003-libjaeger_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:00.482 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjaeger (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:00.836 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-08-16T23:59:00.854 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-08-16T23:59:00.935 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-08-16T23:59:01.333 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../005-librbd1_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:01.407 INFO:teuthology.orchestra.run.smithi153.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 16.2.13-522-g23c07d8f-1focal [235 kB] 2023-08-16T23:59:01.409 INFO:teuthology.orchestra.run.smithi153.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 16.2.13-522-g23c07d8f-1focal [17.4 kB] 2023-08-16T23:59:01.409 INFO:teuthology.orchestra.run.smithi153.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 16.2.13-522-g23c07d8f-1focal [13.0 kB] 2023-08-16T23:59:01.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.13-522-g23c07d8f-1focal [21.5 kB] 2023-08-16T23:59:01.410 INFO:teuthology.orchestra.run.smithi153.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.13-522-g23c07d8f-1focal [11.3 MB] 2023-08-16T23:59:01.456 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librbd1 (16.2.13-522-g23c07d8f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-08-16T23:59:02.028 INFO:teuthology.orchestra.run.smithi153.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri2-testing-2023-08-16-1142-pacific/23c07d8f91d3210fa9df54a2a13a9637958c6088/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.13-522-g23c07d8f-1focal [78.2 kB] 2023-08-16T23:59:02.180 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../006-librados2_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:02.303 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librados2 (16.2.13-522-g23c07d8f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-08-16T23:59:02.935 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 174 MB in 12s (13.9 MB/s) 2023-08-16T23:59:03.088 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyperclip. 2023-08-16T23:59:03.123 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs2. 2023-08-16T23:59:03.140 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../007-libcephfs2_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:03.162 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107759 files and directories currently installed.) 2023-08-16T23:59:03.163 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-08-16T23:59:03.180 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:03.202 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-08-16T23:59:03.516 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rados. 2023-08-16T23:59:03.534 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../008-python3-rados_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:03.565 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rados (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:03.838 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-wcwidth. 2023-08-16T23:59:03.857 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-08-16T23:59:03.896 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-08-16T23:59:03.936 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-08-16T23:59:03.957 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:03.996 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-argparse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:04.233 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cmd2. 2023-08-16T23:59:04.253 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-08-16T23:59:04.291 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-08-16T23:59:04.322 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cephfs. 2023-08-16T23:59:04.333 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../010-python3-cephfs_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:04.371 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cephfs (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:04.586 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjaeger. 2023-08-16T23:59:04.605 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../003-libjaeger_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:04.647 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjaeger (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:04.732 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-common. 2023-08-16T23:59:04.750 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:04.790 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:05.014 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-08-16T23:59:05.027 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../004-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-08-16T23:59:05.105 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-08-16T23:59:05.152 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-prettytable. 2023-08-16T23:59:05.171 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2023-08-16T23:59:05.210 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-08-16T23:59:05.505 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rbd. 2023-08-16T23:59:05.523 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../013-python3-rbd_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:05.527 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../005-librbd1_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:05.563 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rbd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:05.648 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librbd1 (16.2.13-522-g23c07d8f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-08-16T23:59:05.941 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-08-16T23:59:05.959 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-08-16T23:59:05.999 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-08-16T23:59:06.385 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-08-16T23:59:06.403 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2023-08-16T23:59:06.422 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../006-librados2_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:06.443 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-08-16T23:59:06.578 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librados2 (16.2.13-522-g23c07d8f-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-08-16T23:59:06.839 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-08-16T23:59:06.857 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-08-16T23:59:06.896 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-08-16T23:59:07.291 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs2. 2023-08-16T23:59:07.308 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librgw2. 2023-08-16T23:59:07.309 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../007-libcephfs2_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:07.328 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../017-librgw2_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:07.368 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librgw2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:07.371 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:07.752 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rados. 2023-08-16T23:59:07.769 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../008-python3-rados_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:07.810 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rados (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:07.977 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rgw. 2023-08-16T23:59:07.996 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../018-python3-rgw_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:08.035 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:08.221 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-08-16T23:59:08.239 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../009-python3-ceph-argparse_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:08.279 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-argparse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:08.387 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-08-16T23:59:08.406 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-08-16T23:59:08.454 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-08-16T23:59:08.624 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cephfs. 2023-08-16T23:59:08.643 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../010-python3-cephfs_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:08.682 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cephfs (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:08.808 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liboath0. 2023-08-16T23:59:08.827 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2023-08-16T23:59:08.866 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-08-16T23:59:09.077 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-ceph-common. 2023-08-16T23:59:09.099 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../011-python3-ceph-common_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:09.135 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:09.227 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libradosstriper1. 2023-08-16T23:59:09.246 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../021-libradosstriper1_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:09.287 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libradosstriper1 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:09.521 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-prettytable. 2023-08-16T23:59:09.540 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-5_all.deb ... 2023-08-16T23:59:09.580 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-08-16T23:59:09.774 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-common. 2023-08-16T23:59:09.791 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../022-ceph-common_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:09.830 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:09.893 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rbd. 2023-08-16T23:59:09.910 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../013-python3-rbd_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:09.949 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rbd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:10.361 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-08-16T23:59:10.379 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../014-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-08-16T23:59:10.419 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-08-16T23:59:10.830 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-08-16T23:59:10.848 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../015-librabbitmq4_0.10.0-1_amd64.deb ... 2023-08-16T23:59:10.909 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-08-16T23:59:11.324 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-08-16T23:59:11.344 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../016-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-08-16T23:59:11.382 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-08-16T23:59:11.787 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package librgw2. 2023-08-16T23:59:11.807 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../017-librgw2_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:11.845 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking librgw2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:12.027 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-base. 2023-08-16T23:59:12.046 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../023-ceph-base_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:12.107 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-base (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:12.487 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rgw. 2023-08-16T23:59:12.501 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../018-python3-rgw_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:12.564 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:12.950 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-08-16T23:59:12.969 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../019-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-08-16T23:59:13.008 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-08-16T23:59:13.365 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cryptography. 2023-08-16T23:59:13.385 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-08-16T23:59:13.395 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liboath0. 2023-08-16T23:59:13.416 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../020-liboath0_2.6.1-1.3_amd64.deb ... 2023-08-16T23:59:13.423 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-08-16T23:59:13.453 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-08-16T23:59:13.820 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-openssl. 2023-08-16T23:59:13.823 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libradosstriper1. 2023-08-16T23:59:13.837 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2023-08-16T23:59:13.841 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../021-libradosstriper1_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:13.876 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-08-16T23:59:13.880 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libradosstriper1 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:14.188 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-08-16T23:59:14.206 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:14.246 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-modules-core (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:14.401 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-common. 2023-08-16T23:59:14.419 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../022-ceph-common_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:14.458 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:14.676 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bcrypt. 2023-08-16T23:59:14.696 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-08-16T23:59:14.735 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-08-16T23:59:15.079 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cherrypy3. 2023-08-16T23:59:15.097 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-08-16T23:59:15.136 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-08-16T23:59:15.498 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jwt. 2023-08-16T23:59:15.517 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-08-16T23:59:15.557 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-08-16T23:59:15.926 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-logutils. 2023-08-16T23:59:15.945 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-08-16T23:59:15.984 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-08-16T23:59:16.320 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-markupsafe. 2023-08-16T23:59:16.341 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-08-16T23:59:16.388 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-08-16T23:59:16.723 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-mako. 2023-08-16T23:59:16.743 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-08-16T23:59:16.758 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-base. 2023-08-16T23:59:16.780 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../023-ceph-base_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:16.781 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-08-16T23:59:16.844 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-base (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:17.176 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplegeneric. 2023-08-16T23:59:17.196 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-08-16T23:59:17.234 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-08-16T23:59:17.599 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-singledispatch. 2023-08-16T23:59:17.613 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-08-16T23:59:17.653 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-08-16T23:59:17.871 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cryptography. 2023-08-16T23:59:17.889 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../024-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-08-16T23:59:17.922 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-08-16T23:59:18.023 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webob. 2023-08-16T23:59:18.035 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-08-16T23:59:18.074 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-08-16T23:59:18.407 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-openssl. 2023-08-16T23:59:18.422 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../025-python3-openssl_19.0.0-1build1_all.deb ... 2023-08-16T23:59:18.434 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-soupsieve. 2023-08-16T23:59:18.450 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-08-16T23:59:18.457 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-08-16T23:59:18.489 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-08-16T23:59:18.793 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-08-16T23:59:18.813 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../026-ceph-mgr-modules-core_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:18.845 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bs4. 2023-08-16T23:59:18.855 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-modules-core (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:18.857 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-08-16T23:59:18.894 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-08-16T23:59:19.248 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-waitress. 2023-08-16T23:59:19.268 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-08-16T23:59:19.313 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-08-16T23:59:19.693 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempita. 2023-08-16T23:59:19.712 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-08-16T23:59:19.751 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-08-16T23:59:19.890 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bcrypt. 2023-08-16T23:59:19.908 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../027-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-08-16T23:59:19.947 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-08-16T23:59:20.079 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-paste. 2023-08-16T23:59:20.097 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-08-16T23:59:20.137 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-08-16T23:59:20.329 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cherrypy3. 2023-08-16T23:59:20.345 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-08-16T23:59:20.383 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-08-16T23:59:20.515 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-08-16T23:59:20.534 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-08-16T23:59:20.573 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-08-16T23:59:20.762 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jwt. 2023-08-16T23:59:20.782 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../029-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-08-16T23:59:20.820 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-08-16T23:59:20.901 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastedeploy. 2023-08-16T23:59:20.919 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-08-16T23:59:20.962 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-08-16T23:59:21.200 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-logutils. 2023-08-16T23:59:21.216 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-08-16T23:59:21.259 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-08-16T23:59:21.304 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webtest. 2023-08-16T23:59:21.323 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-08-16T23:59:21.371 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-08-16T23:59:21.609 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-markupsafe. 2023-08-16T23:59:21.626 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-08-16T23:59:21.668 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-08-16T23:59:21.729 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pecan. 2023-08-16T23:59:21.749 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-08-16T23:59:21.798 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-08-16T23:59:22.036 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-mako. 2023-08-16T23:59:22.056 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-08-16T23:59:22.094 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-08-16T23:59:22.179 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-werkzeug. 2023-08-16T23:59:22.196 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-08-16T23:59:22.235 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-08-16T23:59:22.474 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplegeneric. 2023-08-16T23:59:22.493 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-08-16T23:59:22.531 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-08-16T23:59:22.606 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-08-16T23:59:22.620 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:22.664 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsqlite3-mod-ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:22.908 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-singledispatch. 2023-08-16T23:59:22.927 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-08-16T23:59:23.000 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-08-16T23:59:23.336 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webob. 2023-08-16T23:59:23.354 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-08-16T23:59:23.427 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-08-16T23:59:23.650 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr. 2023-08-16T23:59:23.669 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../047-ceph-mgr_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:23.708 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:23.831 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-soupsieve. 2023-08-16T23:59:23.849 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-08-16T23:59:23.888 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-08-16T23:59:24.228 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mon. 2023-08-16T23:59:24.248 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../048-ceph-mon_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:24.249 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-bs4. 2023-08-16T23:59:24.268 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-08-16T23:59:24.286 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mon (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:24.308 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-08-16T23:59:24.729 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-waitress. 2023-08-16T23:59:24.746 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-08-16T23:59:24.793 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-08-16T23:59:25.172 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-tempita. 2023-08-16T23:59:25.191 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-08-16T23:59:25.230 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-08-16T23:59:25.331 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-osd. 2023-08-16T23:59:25.343 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../049-ceph-osd_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:25.381 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-osd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:25.591 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-paste. 2023-08-16T23:59:25.610 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-08-16T23:59:25.650 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-08-16T23:59:26.019 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-08-16T23:59:26.037 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-08-16T23:59:26.077 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-08-16T23:59:26.448 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastedeploy. 2023-08-16T23:59:26.465 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-08-16T23:59:26.505 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-08-16T23:59:26.893 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webtest. 2023-08-16T23:59:26.910 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-08-16T23:59:26.994 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-08-16T23:59:27.311 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pecan. 2023-08-16T23:59:27.329 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-08-16T23:59:27.394 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-08-16T23:59:27.740 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph. 2023-08-16T23:59:27.755 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../050-ceph_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:27.819 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:27.824 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-werkzeug. 2023-08-16T23:59:27.842 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-08-16T23:59:27.882 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-08-16T23:59:28.172 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-fuse. 2023-08-16T23:59:28.192 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../051-ceph-fuse_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:28.231 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:28.252 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-08-16T23:59:28.271 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:28.316 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libsqlite3-mod-ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:28.659 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mds. 2023-08-16T23:59:28.677 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../052-ceph-mds_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:28.697 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr. 2023-08-16T23:59:28.716 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../047-ceph-mgr_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:28.733 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mds (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:28.756 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:29.274 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mon. 2023-08-16T23:59:29.293 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../048-ceph-mon_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:29.304 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephadm. 2023-08-16T23:59:29.321 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../053-cephadm_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:29.357 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mon (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:29.362 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:29.706 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jinja2. 2023-08-16T23:59:29.724 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2023-08-16T23:59:29.763 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-08-16T23:59:30.150 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-08-16T23:59:30.168 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:30.207 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:30.421 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-osd. 2023-08-16T23:59:30.437 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../049-ceph-osd_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:30.476 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-osd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:30.578 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-repoze.lru. 2023-08-16T23:59:30.596 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2023-08-16T23:59:30.636 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-08-16T23:59:30.967 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjs-underscore. 2023-08-16T23:59:30.982 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-08-16T23:59:31.021 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-08-16T23:59:31.316 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-08-16T23:59:31.335 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-08-16T23:59:31.374 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-08-16T23:59:31.709 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-routes. 2023-08-16T23:59:31.728 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2023-08-16T23:59:31.767 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-08-16T23:59:32.147 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-08-16T23:59:32.166 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:32.229 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-dashboard (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:32.859 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph. 2023-08-16T23:59:32.877 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../050-ceph_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:32.915 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:33.293 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-fuse. 2023-08-16T23:59:33.313 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../051-ceph-fuse_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:33.352 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:33.403 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-decorator. 2023-08-16T23:59:33.422 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-08-16T23:59:33.465 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-08-16T23:59:33.834 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mds. 2023-08-16T23:59:33.840 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-08-16T23:59:33.849 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../052-ceph-mds_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:33.863 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-08-16T23:59:33.887 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mds (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:33.900 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-08-16T23:59:34.209 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-scipy. 2023-08-16T23:59:34.222 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-08-16T23:59:34.259 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-08-16T23:59:34.794 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephadm. 2023-08-16T23:59:34.812 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../053-cephadm_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:34.907 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:35.293 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-jinja2. 2023-08-16T23:59:35.312 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../054-python3-jinja2_2.10.1-2_all.deb ... 2023-08-16T23:59:35.351 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-08-16T23:59:35.701 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-08-16T23:59:35.721 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-08-16T23:59:35.771 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-08-16T23:59:35.779 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-08-16T23:59:35.790 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../055-ceph-mgr-cephadm_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:35.831 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:36.215 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-repoze.lru. 2023-08-16T23:59:36.235 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../056-python3-repoze.lru_0.7-2_all.deb ... 2023-08-16T23:59:36.273 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-08-16T23:59:36.347 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-joblib. 2023-08-16T23:59:36.366 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2023-08-16T23:59:36.404 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-08-16T23:59:36.585 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-underscore. 2023-08-16T23:59:36.603 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../057-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-08-16T23:59:36.642 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-08-16T23:59:36.883 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn. 2023-08-16T23:59:36.902 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-08-16T23:59:36.941 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-08-16T23:59:36.987 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-08-16T23:59:37.005 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../058-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-08-16T23:59:37.044 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-08-16T23:59:37.414 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-routes. 2023-08-16T23:59:37.433 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../059-python3-routes_2.4.1-2_all.deb ... 2023-08-16T23:59:37.472 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-08-16T23:59:37.683 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-08-16T23:59:37.702 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:37.740 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:37.858 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-08-16T23:59:37.878 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../060-ceph-mgr-dashboard_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:37.916 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-dashboard (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:38.952 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cachetools. 2023-08-16T23:59:38.971 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2023-08-16T23:59:39.010 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-08-16T23:59:39.115 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-decorator. 2023-08-16T23:59:39.134 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../061-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-08-16T23:59:39.173 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-08-16T23:59:39.354 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1. 2023-08-16T23:59:39.373 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-08-16T23:59:39.412 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-08-16T23:59:39.526 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-08-16T23:59:39.545 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../062-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-08-16T23:59:39.584 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-08-16T23:59:39.807 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-08-16T23:59:39.827 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-08-16T23:59:39.865 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-08-16T23:59:39.988 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-scipy. 2023-08-16T23:59:40.008 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../063-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-08-16T23:59:40.078 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-08-16T23:59:40.211 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rsa. 2023-08-16T23:59:40.228 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2023-08-16T23:59:40.267 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rsa (4.0-3) ... 2023-08-16T23:59:40.612 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-google-auth. 2023-08-16T23:59:40.632 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2023-08-16T23:59:40.670 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-08-16T23:59:41.065 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-blinker. 2023-08-16T23:59:41.076 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-08-16T23:59:41.117 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-08-16T23:59:41.459 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-oauthlib. 2023-08-16T23:59:41.480 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-08-16T23:59:41.517 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-08-16T23:59:41.563 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-08-16T23:59:41.590 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-08-16T23:59:41.619 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-08-16T23:59:41.888 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-08-16T23:59:41.907 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-08-16T23:59:41.945 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-08-16T23:59:42.223 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-joblib. 2023-08-16T23:59:42.242 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../065-python3-joblib_0.14.0-3_all.deb ... 2023-08-16T23:59:42.281 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-08-16T23:59:42.290 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-websocket. 2023-08-16T23:59:42.312 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-08-16T23:59:42.374 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-08-16T23:59:42.732 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-sklearn. 2023-08-16T23:59:42.743 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-kubernetes. 2023-08-16T23:59:42.746 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../066-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-08-16T23:59:42.761 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-08-16T23:59:42.784 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-08-16T23:59:42.809 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-08-16T23:59:43.430 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-08-16T23:59:43.450 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:43.488 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-k8sevents (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:43.584 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-08-16T23:59:43.605 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:43.667 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:43.866 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libonig5:amd64. 2023-08-16T23:59:43.886 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2023-08-16T23:59:44.140 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-08-16T23:59:44.524 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjq1:amd64. 2023-08-16T23:59:44.543 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-08-16T23:59:44.582 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-08-16T23:59:44.862 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-cachetools. 2023-08-16T23:59:44.874 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../068-python3-cachetools_4.0.0-1_all.deb ... 2023-08-16T23:59:44.920 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-08-16T23:59:44.979 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package jq. 2023-08-16T23:59:44.998 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-08-16T23:59:45.036 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-08-16T23:59:45.272 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1. 2023-08-16T23:59:45.285 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../069-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-08-16T23:59:45.355 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-08-16T23:59:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package socat. 2023-08-16T23:59:45.377 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2023-08-16T23:59:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking socat (1.7.3.3-2) ... 2023-08-16T23:59:45.750 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-08-16T23:59:45.761 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package xmlstarlet. 2023-08-16T23:59:45.770 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../070-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-08-16T23:59:45.780 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-08-16T23:59:45.808 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-08-16T23:59:45.818 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-08-16T23:59:46.197 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-rsa. 2023-08-16T23:59:46.214 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../071-python3-rsa_4.0-3_all.deb ... 2023-08-16T23:59:46.234 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-test. 2023-08-16T23:59:46.250 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../084-ceph-test_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:46.252 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-rsa (4.0-3) ... 2023-08-16T23:59:46.292 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-test (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:46.623 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-google-auth. 2023-08-16T23:59:46.642 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../072-python3-google-auth_1.5.1-2_all.deb ... 2023-08-16T23:59:46.680 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-08-16T23:59:47.067 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-blinker. 2023-08-16T23:59:47.085 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../073-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-08-16T23:59:47.124 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-08-16T23:59:47.494 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-oauthlib. 2023-08-16T23:59:47.513 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../074-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-08-16T23:59:47.552 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-08-16T23:59:47.939 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-08-16T23:59:47.958 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../075-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-08-16T23:59:47.997 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-08-16T23:59:48.394 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-websocket. 2023-08-16T23:59:48.411 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../076-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-08-16T23:59:48.449 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-08-16T23:59:48.816 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-kubernetes. 2023-08-16T23:59:48.835 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../077-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-08-16T23:59:48.899 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-08-16T23:59:49.570 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-08-16T23:59:49.590 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../078-ceph-mgr-k8sevents_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:49.628 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-mgr-k8sevents (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:50.014 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libonig5:amd64. 2023-08-16T23:59:50.029 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../079-libonig5_6.9.4-1_amd64.deb ... 2023-08-16T23:59:50.089 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-08-16T23:59:50.401 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-mirror. 2023-08-16T23:59:50.414 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:50.459 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-mirror (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:50.483 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libjq1:amd64. 2023-08-16T23:59:50.501 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../080-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-08-16T23:59:50.541 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-08-16T23:59:50.808 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-colorama. 2023-08-16T23:59:50.828 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2023-08-16T23:59:50.867 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-08-16T23:59:50.955 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package jq. 2023-08-16T23:59:50.974 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../081-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-08-16T23:59:51.012 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-08-16T23:59:51.186 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-shell. 2023-08-16T23:59:51.205 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../087-cephfs-shell_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:51.244 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-shell (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:51.316 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package socat. 2023-08-16T23:59:51.329 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../082-socat_1.7.3.3-2_amd64.deb ... 2023-08-16T23:59:51.373 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking socat (1.7.3.3-2) ... 2023-08-16T23:59:51.537 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-top. 2023-08-16T23:59:51.556 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../088-cephfs-top_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:51.595 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-top (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:51.702 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package xmlstarlet. 2023-08-16T23:59:51.716 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-08-16T23:59:51.760 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-08-16T23:59:51.856 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs-dev. 2023-08-16T23:59:51.875 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:51.906 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs-dev (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:52.194 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ceph-test. 2023-08-16T23:59:52.213 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../084-ceph-test_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:52.251 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ceph-test (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:52.326 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package nvme-cli. 2023-08-16T23:59:52.345 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-08-16T23:59:52.424 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-08-16T23:59:52.823 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-atomicwrites. 2023-08-16T23:59:52.836 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-08-16T23:59:52.872 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-08-16T23:59:53.209 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-attr. 2023-08-16T23:59:53.228 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2023-08-16T23:59:53.267 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-08-16T23:59:53.612 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webencodings. 2023-08-16T23:59:53.630 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-08-16T23:59:53.669 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-08-16T23:59:54.030 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-html5lib. 2023-08-16T23:59:54.050 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2023-08-16T23:59:54.088 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-08-16T23:59:54.475 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-08-16T23:59:54.494 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-08-16T23:59:54.533 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-08-16T23:59:54.995 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-packaging. 2023-08-16T23:59:55.014 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2023-08-16T23:59:55.052 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-packaging (20.3-1) ... 2023-08-16T23:59:55.396 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastescript. 2023-08-16T23:59:55.410 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-08-16T23:59:55.454 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-08-16T23:59:55.800 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pluggy. 2023-08-16T23:59:55.815 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2023-08-16T23:59:55.857 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-08-16T23:59:56.195 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-psutil. 2023-08-16T23:59:56.207 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-08-16T23:59:56.252 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-08-16T23:59:56.407 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-mirror. 2023-08-16T23:59:56.426 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../085-cephfs-mirror_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:56.464 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-mirror (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:56.588 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-py. 2023-08-16T23:59:56.601 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-08-16T23:59:56.646 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-08-16T23:59:56.876 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-colorama. 2023-08-16T23:59:56.889 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../086-python3-colorama_0.4.3-1build1_all.deb ... 2023-08-16T23:59:56.933 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-08-16T23:59:57.024 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyinotify. 2023-08-16T23:59:57.037 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-08-16T23:59:57.083 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-08-16T23:59:57.254 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-shell. 2023-08-16T23:59:57.274 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../087-cephfs-shell_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:57.311 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-shell (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:57.419 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pytest. 2023-08-16T23:59:57.438 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2023-08-16T23:59:57.476 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-08-16T23:59:57.614 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package cephfs-top. 2023-08-16T23:59:57.634 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../088-cephfs-top_16.2.13-522-g23c07d8f-1focal_all.deb ... 2023-08-16T23:59:57.672 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking cephfs-top (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:57.838 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplejson. 2023-08-16T23:59:57.858 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-08-16T23:59:57.896 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-08-16T23:59:57.976 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libcephfs-dev. 2023-08-16T23:59:57.997 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../089-libcephfs-dev_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:58.033 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libcephfs-dev (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:58.385 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package radosgw. 2023-08-16T23:59:58.404 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../104-radosgw_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:58.448 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking radosgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:58.487 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package nvme-cli. 2023-08-16T23:59:58.506 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-08-16T23:59:58.579 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-08-16T23:59:59.000 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-atomicwrites. 2023-08-16T23:59:59.018 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../091-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-08-16T23:59:59.083 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-08-16T23:59:59.402 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-attr. 2023-08-16T23:59:59.422 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../092-python3-attr_19.3.0-2_all.deb ... 2023-08-16T23:59:59.493 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-08-16T23:59:59.654 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package rbd-fuse. 2023-08-16T23:59:59.674 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../105-rbd-fuse_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-16T23:59:59.711 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking rbd-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-16T23:59:59.872 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-webencodings. 2023-08-16T23:59:59.890 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../093-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-08-16T23:59:59.929 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-08-17T00:00:00.092 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-attr (19.3.0-2) ... 2023-08-17T00:00:00.299 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-html5lib. 2023-08-17T00:00:00.318 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../094-python3-html5lib_1.0.1-2_all.deb ... 2023-08-17T00:00:00.357 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-08-17T00:00:00.450 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-08-17T00:00:00.567 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-08-17T00:00:00.693 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-08-17T00:00:00.760 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-08-17T00:00:00.781 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../095-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-08-17T00:00:00.818 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-08-17T00:00:00.920 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:01.363 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-packaging. 2023-08-17T00:00:01.383 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../096-python3-packaging_20.3-1_all.deb ... 2023-08-17T00:00:01.446 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-packaging (20.3-1) ... 2023-08-17T00:00:01.791 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pastescript. 2023-08-17T00:00:01.810 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../097-python3-pastescript_2.0.2-4_all.deb ... 2023-08-17T00:00:01.859 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user cephadm....done 2023-08-17T00:00:01.865 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-08-17T00:00:02.119 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-08-17T00:00:02.253 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pluggy. 2023-08-17T00:00:02.272 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../098-python3-pluggy_0.13.0-2_all.deb ... 2023-08-17T00:00:02.310 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-08-17T00:00:02.629 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-08-17T00:00:02.673 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-psutil. 2023-08-17T00:00:02.691 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../099-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-08-17T00:00:02.729 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-08-17T00:00:03.024 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-08-17T00:00:03.126 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-py. 2023-08-17T00:00:03.146 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../100-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-08-17T00:00:03.150 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-08-17T00:00:03.183 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-08-17T00:00:03.526 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-08-17T00:00:03.545 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pyinotify. 2023-08-17T00:00:03.565 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-08-17T00:00:03.602 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-08-17T00:00:03.972 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-pytest. 2023-08-17T00:00:03.987 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-08-17T00:00:03.991 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../102-python3-pytest_4.6.9-1_all.deb ... 2023-08-17T00:00:04.031 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-08-17T00:00:04.304 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-08-17T00:00:04.647 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-08-17T00:00:04.982 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-08-17T00:00:05.127 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package python3-simplejson. 2023-08-17T00:00:05.141 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../103-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-08-17T00:00:05.300 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-08-17T00:00:05.437 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-08-17T00:00:05.634 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-argparse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:05.952 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-08-17T00:00:06.078 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-08-17T00:00:06.396 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-08-17T00:00:06.448 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package radosgw. 2023-08-17T00:00:06.462 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../104-radosgw_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-17T00:00:06.507 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking radosgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:06.715 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-08-17T00:00:07.066 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-08-17T00:00:07.501 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-08-17T00:00:07.777 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package rbd-fuse. 2023-08-17T00:00:07.790 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../105-rbd-fuse_16.2.13-522-g23c07d8f-1focal_amd64.deb ... 2023-08-17T00:00:07.819 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-08-17T00:00:07.835 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking rbd-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:08.183 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-attr (19.3.0-2) ... 2023-08-17T00:00:08.254 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-08-17T00:00:08.549 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-08-17T00:00:08.666 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjaeger (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:08.708 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-08-17T00:00:08.835 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-08-17T00:00:08.870 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-08-17T00:00:09.053 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:09.314 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-08-17T00:00:09.719 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-packaging (20.3-1) ... 2023-08-17T00:00:09.834 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user cephadm....done 2023-08-17T00:00:10.043 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-08-17T00:00:10.132 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-08-17T00:00:10.333 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-08-17T00:00:10.520 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-08-17T00:00:10.720 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-08-17T00:00:10.932 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-08-17T00:00:11.134 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-08-17T00:00:11.214 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-08-17T00:00:11.584 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-08-17T00:00:11.630 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-08-17T00:00:12.019 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-08-17T00:00:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-08-17T00:00:12.455 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up socat (1.7.3.3-2) ... 2023-08-17T00:00:12.565 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-08-17T00:00:12.581 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:12.957 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-08-17T00:00:12.962 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-08-17T00:00:13.308 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-08-17T00:00:13.385 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-08-17T00:00:13.509 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-08-17T00:00:13.649 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-08-17T00:00:13.656 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-08-17T00:00:14.008 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-08-17T00:00:14.016 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-argparse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:14.375 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-08-17T00:00:14.393 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-08-17T00:00:14.500 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-08-17T00:00:14.520 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-08-17T00:00:14.835 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-08-17T00:00:14.971 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-08-17T00:00:15.186 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-08-17T00:00:15.324 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-08-17T00:00:15.529 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-08-17T00:00:15.682 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-08-17T00:00:15.842 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-08-17T00:00:15.988 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-08-17T00:00:16.187 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-08-17T00:00:16.330 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-08-17T00:00:16.538 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-08-17T00:00:16.749 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-08-17T00:00:16.897 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-08-17T00:00:17.084 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjaeger (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:17.201 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-08-17T00:00:17.354 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-08-17T00:00:17.602 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-08-17T00:00:17.675 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-08-17T00:00:17.801 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-08-17T00:00:17.946 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-packaging (20.3-1) ... 2023-08-17T00:00:18.186 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-08-17T00:00:18.313 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-08-17T00:00:18.439 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-08-17T00:00:18.646 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-08-17T00:00:18.772 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-08-17T00:00:18.844 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-08-17T00:00:18.898 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-08-17T00:00:19.282 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-08-17T00:00:19.369 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-08-17T00:00:19.625 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librados2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:19.751 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-08-17T00:00:19.754 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-08-17T00:00:20.206 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-08-17T00:00:20.684 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up socat (1.7.3.3-2) ... 2023-08-17T00:00:20.808 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:21.209 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-08-17T00:00:21.541 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librgw2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:21.676 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsqlite3-mod-ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:21.704 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-08-17T00:00:21.801 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-08-17T00:00:21.833 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-08-17T00:00:21.927 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-08-17T00:00:21.948 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-08-17T00:00:22.307 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-08-17T00:00:22.387 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-08-17T00:00:22.700 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-08-17T00:00:22.756 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-08-17T00:00:22.818 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-08-17T00:00:23.107 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-08-17T00:00:23.261 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-08-17T00:00:23.527 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:23.628 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-08-17T00:00:23.653 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-08-17T00:00:24.019 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-08-17T00:00:24.064 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libradosstriper1 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:24.147 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-08-17T00:00:24.190 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-08-17T00:00:24.498 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-08-17T00:00:24.591 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-08-17T00:00:24.850 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-08-17T00:00:25.252 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-08-17T00:00:25.639 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-08-17T00:00:25.876 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librbd1 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:25.969 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-08-17T00:00:25.993 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-08-17T00:00:26.119 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-08-17T00:00:26.120 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-08-17T00:00:26.245 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rsa (4.0-3) ... 2023-08-17T00:00:26.505 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-08-17T00:00:26.597 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-08-17T00:00:26.923 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-08-17T00:00:26.964 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-modules-core (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:27.049 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-08-17T00:00:27.091 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:27.197 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-08-17T00:00:27.352 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-17T00:00:27.352 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-17T00:00:27.626 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-08-17T00:00:28.010 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librados2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:28.136 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-08-17T00:00:28.170 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs-dev (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:28.295 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-08-17T00:00:28.647 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-08-17T00:00:29.040 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-08-17T00:00:29.468 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rados (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:29.593 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-top (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:29.822 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rbd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:29.912 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librgw2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:29.948 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up rbd-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:30.065 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libsqlite3-mod-ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:30.074 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-routes (2.4.1-2) ... 2023-08-17T00:00:30.188 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-08-17T00:00:30.306 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-08-17T00:00:30.434 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-08-17T00:00:30.794 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:30.845 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-08-17T00:00:30.920 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cephfs (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:31.211 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-08-17T00:00:31.279 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-shell (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:31.431 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-08-17T00:00:31.605 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-08-17T00:00:32.024 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs2 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:32.156 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-08-17T00:00:32.559 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libradosstriper1 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:32.578 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:32.684 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-08-17T00:00:33.145 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-08-17T00:00:33.193 INFO:teuthology.orchestra.run.smithi178.stdout:Adding group ceph....done 2023-08-17T00:00:33.632 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user ceph....done 2023-08-17T00:00:33.855 INFO:teuthology.orchestra.run.smithi178.stdout:Setting system user ceph properties....done 2023-08-17T00:00:33.886 INFO:teuthology.orchestra.run.smithi178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-08-17T00:00:34.077 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-08-17T00:00:34.417 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up librbd1 (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:34.543 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-08-17T00:00:34.600 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-08-17T00:00:34.669 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-08-17T00:00:34.828 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rsa (4.0-3) ... 2023-08-17T00:00:35.213 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-08-17T00:00:35.446 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-mirror (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:35.606 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-modules-core (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:35.703 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-17T00:00:35.703 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-17T00:00:35.731 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:35.996 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-17T00:00:35.996 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-17T00:00:36.539 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-test (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:36.665 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up radosgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:36.816 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libcephfs-dev (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:36.942 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-08-17T00:00:36.967 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-17T00:00:36.968 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-17T00:00:37.296 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-08-17T00:00:37.669 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-08-17T00:00:38.138 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rados (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:38.142 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-base (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:38.306 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-top (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:38.534 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rbd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:38.627 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-08-17T00:00:38.660 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up rbd-fuse (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:38.811 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-routes (2.4.1-2) ... 2023-08-17T00:00:39.170 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-08-17T00:00:39.485 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mds (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:39.539 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-rgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:39.666 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-cephfs (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:39.751 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-17T00:00:39.751 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-17T00:00:40.001 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-shell (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:40.127 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-08-17T00:00:40.637 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:40.912 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-17T00:00:40.912 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-17T00:00:41.273 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-common (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:41.722 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-osd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:41.903 INFO:teuthology.orchestra.run.smithi153.stdout:Adding group ceph....done 2023-08-17T00:00:42.369 INFO:teuthology.orchestra.run.smithi153.stdout:Adding system user ceph....done 2023-08-17T00:00:42.586 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-17T00:00:42.586 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-17T00:00:42.616 INFO:teuthology.orchestra.run.smithi153.stdout:Setting system user ceph properties....done 2023-08-17T00:00:42.653 INFO:teuthology.orchestra.run.smithi153.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-08-17T00:00:42.845 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-08-17T00:00:43.408 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-08-17T00:00:43.415 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-k8sevents (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:43.541 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-diskprediction-local (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:43.693 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mon (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:43.948 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-17T00:00:43.949 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-17T00:00:44.350 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up cephfs-mirror (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:44.606 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-17T00:00:44.606 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-08-17T00:00:44.752 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:44.903 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:45.029 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-dashboard (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:45.181 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-08-17T00:00:45.420 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-test (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:45.543 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up radosgw (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:45.883 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-08-17T00:00:45.884 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-17T00:00:45.884 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-17T00:00:46.010 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-08-17T00:00:46.690 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-17T00:00:46.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-08-17T00:00:46.822 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2023-08-17T00:00:47.019 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2023-08-17T00:00:47.019 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2023-08-17T00:00:47.146 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-base (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:47.199 INFO:teuthology.orchestra.run.smithi178.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-08-17T00:00:47.199 INFO:teuthology.orchestra.run.smithi178.stdout:flex is already the newest version (2.6.4-6.2). 2023-08-17T00:00:47.199 INFO:teuthology.orchestra.run.smithi178.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-08-17T00:00:47.199 INFO:teuthology.orchestra.run.smithi178.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-08-17T00:00:47.200 INFO:teuthology.orchestra.run.smithi178.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-08-17T00:00:47.200 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2023-08-17T00:00:47.201 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-08-17T00:00:47.201 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-17T00:00:47.201 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2023-08-17T00:00:47.201 INFO:teuthology.orchestra.run.smithi178.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-08-17T00:00:47.202 INFO:teuthology.orchestra.run.smithi178.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-08-17T00:00:47.202 INFO:teuthology.orchestra.run.smithi178.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-08-17T00:00:47.202 INFO:teuthology.orchestra.run.smithi178.stdout: usb-modeswitch-data wpasupplicant 2023-08-17T00:00:47.202 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2023-08-17T00:00:47.203 INFO:teuthology.orchestra.run.smithi178.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-08-17T00:00:47.203 INFO:teuthology.orchestra.run.smithi178.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-08-17T00:00:47.283 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2023-08-17T00:00:47.284 INFO:teuthology.orchestra.run.smithi178.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-08-17T00:00:47.284 INFO:teuthology.orchestra.run.smithi178.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-08-17T00:00:47.284 INFO:teuthology.orchestra.run.smithi178.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-08-17T00:00:47.285 INFO:teuthology.orchestra.run.smithi178.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-08-17T00:00:47.286 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2023-08-17T00:00:47.286 INFO:teuthology.orchestra.run.smithi178.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-08-17T00:00:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:4 upgraded, 23 newly installed, 0 to remove and 230 not upgraded. 2023-08-17T00:00:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 10.2 MB of archives. 2023-08-17T00:00:47.352 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-08-17T00:00:47.355 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-08-17T00:00:47.485 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-08-17T00:00:47.488 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-08-17T00:00:47.490 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-08-17T00:00:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-08-17T00:00:47.509 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-08-17T00:00:47.511 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-08-17T00:00:47.512 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-08-17T00:00:47.514 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-08-17T00:00:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-08-17T00:00:47.515 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-08-17T00:00:47.519 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-08-17T00:00:47.520 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-08-17T00:00:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-08-17T00:00:47.538 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-08-17T00:00:47.546 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-08-17T00:00:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-08-17T00:00:47.556 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-08-17T00:00:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-08-17T00:00:47.574 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-08-17T00:00:47.586 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-08-17T00:00:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-08-17T00:00:47.616 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-08-17T00:00:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-08-17T00:00:47.620 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-08-17T00:00:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-08-17T00:00:47.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-08-17T00:00:47.659 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-08-17T00:00:48.040 INFO:teuthology.orchestra.run.smithi178.stdout:Preconfiguring packages ... 2023-08-17T00:00:48.226 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 10.2 MB in 0s (31.0 MB/s) 2023-08-17T00:00:48.490 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mds (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:48.546 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115280 files and directories currently installed.) 2023-08-17T00:00:48.551 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-08-17T00:00:48.729 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-08-17T00:00:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-17T00:00:48.766 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-17T00:00:49.608 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-17T00:00:49.871 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-17T00:00:50.377 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-08-17T00:00:50.667 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-osd (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-17T00:00:51.468 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-17T00:00:52.286 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-k8sevents (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:52.396 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115280 files and directories currently installed.) 2023-08-17T00:00:52.398 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-08-17T00:00:52.439 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-diskprediction-local (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:52.525 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-08-17T00:00:52.588 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mon (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:52.855 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-17T00:00:52.855 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-17T00:00:52.950 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-08-17T00:00:53.123 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-08-17T00:00:53.509 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-08-17T00:00:53.687 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-cephadm (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:53.840 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:53.991 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ceph-mgr-dashboard (16.2.13-522-g23c07d8f-1focal) ... 2023-08-17T00:00:54.074 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115280 files and directories currently installed.) 2023-08-17T00:00:54.077 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-08-17T00:00:54.143 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-08-17T00:00:54.210 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-08-17T00:00:54.603 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-08-17T00:00:54.747 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-08-17T00:00:54.772 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-08-17T00:00:54.779 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-08-17T00:00:54.831 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-08-17T00:00:55.202 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package dump. 2023-08-17T00:00:55.229 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-08-17T00:00:55.260 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking dump (0.4b46-6) ... 2023-08-17T00:00:55.438 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-17T00:00:55.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-08-17T00:00:55.567 INFO:teuthology.orchestra.run.smithi153.stdout:Reading package lists... 2023-08-17T00:00:55.598 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package indent. 2023-08-17T00:00:55.617 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-08-17T00:00:55.656 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking indent (2.2.12-1) ... 2023-08-17T00:00:55.764 INFO:teuthology.orchestra.run.smithi153.stdout:Building dependency tree... 2023-08-17T00:00:55.765 INFO:teuthology.orchestra.run.smithi153.stdout:Reading state information... 2023-08-17T00:00:55.934 INFO:teuthology.orchestra.run.smithi153.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-08-17T00:00:55.934 INFO:teuthology.orchestra.run.smithi153.stdout:flex is already the newest version (2.6.4-6.2). 2023-08-17T00:00:55.934 INFO:teuthology.orchestra.run.smithi153.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-08-17T00:00:55.934 INFO:teuthology.orchestra.run.smithi153.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-08-17T00:00:55.935 INFO:teuthology.orchestra.run.smithi153.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-08-17T00:00:55.935 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages were automatically installed and are no longer required: 2023-08-17T00:00:55.935 INFO:teuthology.orchestra.run.smithi153.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-08-17T00:00:55.936 INFO:teuthology.orchestra.run.smithi153.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-17T00:00:55.936 INFO:teuthology.orchestra.run.smithi153.stdout:The following additional packages will be installed: 2023-08-17T00:00:55.936 INFO:teuthology.orchestra.run.smithi153.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-08-17T00:00:55.936 INFO:teuthology.orchestra.run.smithi153.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-08-17T00:00:55.936 INFO:teuthology.orchestra.run.smithi153.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-08-17T00:00:55.936 INFO:teuthology.orchestra.run.smithi153.stdout: usb-modeswitch-data wpasupplicant 2023-08-17T00:00:55.937 INFO:teuthology.orchestra.run.smithi153.stdout:Suggested packages: 2023-08-17T00:00:55.937 INFO:teuthology.orchestra.run.smithi153.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-08-17T00:00:55.937 INFO:teuthology.orchestra.run.smithi153.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-08-17T00:00:56.020 INFO:teuthology.orchestra.run.smithi153.stdout:The following NEW packages will be installed: 2023-08-17T00:00:56.020 INFO:teuthology.orchestra.run.smithi153.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-08-17T00:00:56.021 INFO:teuthology.orchestra.run.smithi153.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-08-17T00:00:56.022 INFO:teuthology.orchestra.run.smithi153.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-08-17T00:00:56.022 INFO:teuthology.orchestra.run.smithi153.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-08-17T00:00:56.022 INFO:teuthology.orchestra.run.smithi153.stdout:The following packages will be upgraded: 2023-08-17T00:00:56.022 INFO:teuthology.orchestra.run.smithi153.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-08-17T00:00:56.136 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-08-17T00:00:56.156 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-08-17T00:00:56.195 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-08-17T00:00:56.212 INFO:teuthology.orchestra.run.smithi153.stdout:4 upgraded, 23 newly installed, 0 to remove and 230 not upgraded. 2023-08-17T00:00:56.213 INFO:teuthology.orchestra.run.smithi153.stdout:Need to get 10.2 MB of archives. 2023-08-17T00:00:56.213 INFO:teuthology.orchestra.run.smithi153.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-08-17T00:00:56.213 INFO:teuthology.orchestra.run.smithi153.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-08-17T00:00:56.588 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-08-17T00:00:56.600 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-08-17T00:00:56.641 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-08-17T00:00:56.839 INFO:teuthology.orchestra.run.smithi153.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-08-17T00:00:56.841 INFO:teuthology.orchestra.run.smithi153.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-08-17T00:00:56.842 INFO:teuthology.orchestra.run.smithi153.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-08-17T00:00:56.936 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-08-17T00:00:56.943 INFO:teuthology.orchestra.run.smithi153.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-08-17T00:00:56.943 INFO:teuthology.orchestra.run.smithi153.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-08-17T00:00:56.952 INFO:teuthology.orchestra.run.smithi153.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-08-17T00:00:56.956 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-08-17T00:00:56.962 INFO:teuthology.orchestra.run.smithi153.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-08-17T00:00:56.963 INFO:teuthology.orchestra.run.smithi153.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-08-17T00:00:56.963 INFO:teuthology.orchestra.run.smithi153.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-08-17T00:00:56.963 INFO:teuthology.orchestra.run.smithi153.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-08-17T00:00:56.992 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-08-17T00:00:57.132 INFO:teuthology.orchestra.run.smithi153.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-08-17T00:00:57.217 INFO:teuthology.orchestra.run.smithi153.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-08-17T00:00:57.372 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-08-17T00:00:57.391 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:00:57.432 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:00:57.514 INFO:teuthology.orchestra.run.smithi153.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-08-17T00:00:57.521 INFO:teuthology.orchestra.run.smithi153.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-08-17T00:00:57.640 INFO:teuthology.orchestra.run.smithi153.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-08-17T00:00:57.728 INFO:teuthology.orchestra.run.smithi153.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-08-17T00:00:57.730 INFO:teuthology.orchestra.run.smithi153.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-08-17T00:00:57.758 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-proxy. 2023-08-17T00:00:57.777 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:00:57.825 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:00:57.826 INFO:teuthology.orchestra.run.smithi153.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-08-17T00:00:57.826 INFO:teuthology.orchestra.run.smithi153.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-08-17T00:00:57.859 INFO:teuthology.orchestra.run.smithi153.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-08-17T00:00:57.899 INFO:teuthology.orchestra.run.smithi153.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-08-17T00:00:58.102 INFO:teuthology.orchestra.run.smithi153.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-08-17T00:00:58.185 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-08-17T00:00:58.205 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:00:58.243 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:00:58.585 INFO:teuthology.orchestra.run.smithi153.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-08-17T00:00:58.592 INFO:teuthology.orchestra.run.smithi153.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-08-17T00:00:58.597 INFO:teuthology.orchestra.run.smithi153.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-08-17T00:00:58.602 INFO:teuthology.orchestra.run.smithi153.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-08-17T00:00:58.640 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libndp0:amd64. 2023-08-17T00:00:58.650 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-08-17T00:00:58.690 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-08-17T00:00:59.034 INFO:teuthology.orchestra.run.smithi153.stdout:Preconfiguring packages ... 2023-08-17T00:00:59.041 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libnm0:amd64. 2023-08-17T00:00:59.061 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-08-17T00:00:59.100 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-08-17T00:00:59.212 INFO:teuthology.orchestra.run.smithi153.stdout:Fetched 10.2 MB in 3s (3,935 kB/s) 2023-08-17T00:00:59.537 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-08-17T00:00:59.555 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:00:59.557 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115280 files and directories currently installed.) 2023-08-17T00:00:59.560 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-08-17T00:00:59.594 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:00:59.761 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-08-17T00:00:59.980 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-proxy. 2023-08-17T00:01:00.001 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:00.038 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:00.325 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-08-17T00:01:00.349 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-08-17T00:01:00.383 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-08-17T00:01:01.012 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-08-17T00:01:01.033 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-08-17T00:01:01.070 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-08-17T00:01:01.361 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-08-17T00:01:01.482 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package modemmanager. 2023-08-17T00:01:01.504 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:01.564 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:02.240 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package wpasupplicant. 2023-08-17T00:01:02.261 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-08-17T00:01:02.298 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-08-17T00:01:02.862 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager. 2023-08-17T00:01:02.888 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-08-17T00:01:02.972 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:03.483 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115280 files and directories currently installed.) 2023-08-17T00:01:03.487 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-08-17T00:01:03.645 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-08-17T00:01:03.762 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ppp. 2023-08-17T00:01:03.782 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-08-17T00:01:04.128 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-08-17T00:01:04.243 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-08-17T00:01:04.293 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-08-17T00:01:04.615 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pptp-linux. 2023-08-17T00:01:04.634 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-08-17T00:01:04.675 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-08-17T00:01:04.695 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-08-17T00:01:05.102 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager-pptp. 2023-08-17T00:01:05.122 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-08-17T00:01:05.196 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-08-17T00:01:05.324 INFO:teuthology.orchestra.run.smithi153.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 115280 files and directories currently installed.) 2023-08-17T00:01:05.327 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-08-17T00:01:05.460 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-08-17T00:01:05.480 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-08-17T00:01:05.500 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-08-17T00:01:05.538 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-08-17T00:01:05.950 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch. 2023-08-17T00:01:05.970 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-08-17T00:01:06.027 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-08-17T00:01:06.039 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-08-17T00:01:06.060 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-08-17T00:01:06.097 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-08-17T00:01:06.456 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-08-17T00:01:06.500 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package dump. 2023-08-17T00:01:06.520 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-08-17T00:01:06.559 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking dump (0.4b46-6) ... 2023-08-17T00:01:06.799 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-08-17T00:01:06.925 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-08-17T00:01:07.014 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package indent. 2023-08-17T00:01:07.033 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-08-17T00:01:07.059 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-08-17T00:01:07.071 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking indent (2.2.12-1) ... 2023-08-17T00:01:07.475 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-08-17T00:01:07.500 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-08-17T00:01:07.500 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-17T00:01:07.500 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-17T00:01:07.560 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-08-17T00:01:07.928 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-08-17T00:01:07.948 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-08-17T00:01:08.011 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-08-17T00:01:08.306 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-08-17T00:01:08.326 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-08-17T00:01:08.328 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-08-17T00:01:08.397 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-08-17T00:01:08.455 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-08-17T00:01:08.581 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-08-17T00:01:08.710 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-08-17T00:01:08.817 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-08-17T00:01:08.833 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-08-17T00:01:08.836 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:08.875 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:01:08.960 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:09.086 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-08-17T00:01:09.197 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmbim-proxy. 2023-08-17T00:01:09.217 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:09.253 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:01:09.643 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-08-17T00:01:09.660 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:09.698 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:10.071 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libndp0:amd64. 2023-08-17T00:01:10.087 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-08-17T00:01:10.126 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-08-17T00:01:10.319 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-08-17T00:01:10.520 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libnm0:amd64. 2023-08-17T00:01:10.541 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-08-17T00:01:10.578 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:10.741 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up dump (0.4b46-6) ... 2023-08-17T00:01:10.873 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-08-17T00:01:10.952 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:11.015 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-08-17T00:01:11.034 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:11.072 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:11.079 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-08-17T00:01:11.361 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up indent (2.2.12-1) ... 2023-08-17T00:01:11.468 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libqmi-proxy. 2023-08-17T00:01:11.489 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-08-17T00:01:11.489 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:11.544 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:11.672 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-08-17T00:01:11.799 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:01:11.924 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-08-17T00:01:12.101 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:12.389 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-08-17T00:01:12.409 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-08-17T00:01:12.447 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-08-17T00:01:12.987 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-08-17T00:01:13.004 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-08-17T00:01:13.044 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-08-17T00:01:13.258 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:13.258 INFO:teuthology.orchestra.run.smithi178.stdout:The following network interfaces were found in /etc/network/interfaces 2023-08-17T00:01:13.259 INFO:teuthology.orchestra.run.smithi178.stdout:which means they are currently configured by ifupdown: 2023-08-17T00:01:13.259 INFO:teuthology.orchestra.run.smithi178.stdout:- enp3s0f1 2023-08-17T00:01:13.259 INFO:teuthology.orchestra.run.smithi178.stdout:If you want to manage those interfaces with NetworkManager instead 2023-08-17T00:01:13.259 INFO:teuthology.orchestra.run.smithi178.stdout:remove their configuration from /etc/network/interfaces. 2023-08-17T00:01:13.259 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:13.483 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-08-17T00:01:13.487 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package modemmanager. 2023-08-17T00:01:13.510 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-08-17T00:01:13.567 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:13.998 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-08-17T00:01:14.269 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package wpasupplicant. 2023-08-17T00:01:14.290 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-08-17T00:01:14.327 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-08-17T00:01:14.899 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-08-17T00:01:14.922 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager. 2023-08-17T00:01:14.936 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-08-17T00:01:15.027 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:15.813 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:01:15.856 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package ppp. 2023-08-17T00:01:15.874 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-08-17T00:01:15.946 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-08-17T00:01:16.120 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:16.241 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:16.363 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-08-17T00:01:16.768 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package pptp-linux. 2023-08-17T00:01:16.786 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-08-17T00:01:16.843 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-08-17T00:01:17.070 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:17.372 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package network-manager-pptp. 2023-08-17T00:01:17.386 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-08-17T00:01:17.386 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-08-17T00:01:17.392 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-08-17T00:01:17.464 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-08-17T00:01:17.783 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-08-17T00:01:17.813 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-08-17T00:01:17.841 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-08-17T00:01:18.286 INFO:teuthology.orchestra.run.smithi153.stdout:Selecting previously unselected package usb-modeswitch. 2023-08-17T00:01:18.295 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-08-17T00:01:18.309 INFO:teuthology.orchestra.run.smithi153.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-08-17T00:01:18.369 INFO:teuthology.orchestra.run.smithi153.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-08-17T00:01:18.421 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-08-17T00:01:18.564 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-08-17T00:01:18.718 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-08-17T00:01:18.723 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-08-17T00:01:19.108 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-08-17T00:01:19.199 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-08-17T00:01:19.267 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-08-17T00:01:19.393 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-08-17T00:01:19.878 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-17T00:01:19.879 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-08-17T00:01:20.796 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-08-17T00:01:20.922 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-08-17T00:01:21.056 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-08-17T00:01:21.207 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-08-17T00:01:21.333 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-08-17T00:01:21.459 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:21.610 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-08-17T00:01:22.826 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-08-17T00:01:23.225 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up dump (0.4b46-6) ... 2023-08-17T00:01:23.333 INFO:teuthology.orchestra.run.smithi153.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-08-17T00:01:23.401 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:23.569 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-08-17T00:01:23.695 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up indent (2.2.12-1) ... 2023-08-17T00:01:23.812 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-08-17T00:01:24.005 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-08-17T00:01:24.126 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:01:24.249 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-08-17T00:01:24.451 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-08-17T00:01:25.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:25.611 INFO:teuthology.orchestra.run.smithi153.stdout:The following network interfaces were found in /etc/network/interfaces 2023-08-17T00:01:25.611 INFO:teuthology.orchestra.run.smithi153.stdout:which means they are currently configured by ifupdown: 2023-08-17T00:01:25.611 INFO:teuthology.orchestra.run.smithi153.stdout:- enp3s0f1 2023-08-17T00:01:25.611 INFO:teuthology.orchestra.run.smithi153.stdout:If you want to manage those interfaces with NetworkManager instead 2023-08-17T00:01:25.611 INFO:teuthology.orchestra.run.smithi153.stdout:remove their configuration from /etc/network/interfaces. 2023-08-17T00:01:25.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:25.777 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-08-17T00:01:25.834 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-08-17T00:01:25.885 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-08-17T00:01:26.351 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-08-17T00:01:27.093 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-17T00:01:27.098 DEBUG:teuthology.parallel:result is None 2023-08-17T00:01:27.274 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-08-17T00:01:28.187 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-08-17T00:01:28.313 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-08-17T00:01:28.464 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:28.632 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-08-17T00:01:28.758 INFO:teuthology.orchestra.run.smithi153.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-08-17T00:01:29.098 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-08-17T00:01:29.098 INFO:teuthology.orchestra.run.smithi153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-08-17T00:01:30.028 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-08-17T00:01:30.162 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-08-17T00:01:30.280 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-08-17T00:01:30.431 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-08-17T00:01:30.973 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-08-17T00:01:37.676 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-08-17T00:01:37.784 INFO:teuthology.orchestra.run.smithi153.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-08-17T00:01:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-17T00:01:39.068 DEBUG:teuthology.parallel:result is None 2023-08-17T00:01:39.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T00:01:39.295 DEBUG:teuthology.orchestra.run.smithi153:> dpkg-query -W -f '${Version}' ceph 2023-08-17T00:01:39.333 INFO:teuthology.orchestra.run.smithi153.stdout:16.2.13-522-g23c07d8f-1focal 2023-08-17T00:01:39.334 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-522-g23c07d8f-1focal 2023-08-17T00:01:39.334 INFO:teuthology.task.install:The correct ceph version 16.2.13-522-g23c07d8f-1focal is installed. 2023-08-17T00:01:39.335 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=23c07d8f91d3210fa9df54a2a13a9637958c6088 2023-08-17T00:01:39.478 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-query -W -f '${Version}' ceph 2023-08-17T00:01:39.516 INFO:teuthology.orchestra.run.smithi178.stdout:16.2.13-522-g23c07d8f-1focal 2023-08-17T00:01:39.516 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-522-g23c07d8f-1focal 2023-08-17T00:01:39.517 INFO:teuthology.task.install:The correct ceph version 16.2.13-522-g23c07d8f-1focal is installed. 2023-08-17T00:01:39.518 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-17T00:01:39.518 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:39.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-17T00:01:39.555 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:39.556 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-17T00:01:39.593 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-17T00:01:39.593 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:39.594 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/daemon-helper 2023-08-17T00:01:39.629 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-17T00:01:39.706 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:39.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2023-08-17T00:01:39.742 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-17T00:01:39.815 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-17T00:01:39.816 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:39.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-17T00:01:39.850 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-17T00:01:39.925 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:39.926 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-17T00:01:39.960 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-17T00:01:40.039 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-17T00:01:40.040 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:40.040 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/usr/bin/stdin-killer 2023-08-17T00:01:40.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-17T00:01:40.156 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:40.156 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2023-08-17T00:01:40.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-17T00:01:40.267 INFO:teuthology.run_tasks:Running task ceph... 2023-08-17T00:01:40.428 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-17T00:01:40.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 777 /var/log/ceph 2023-08-17T00:01:40.436 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2023-08-17T00:01:40.470 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-17T00:01:40.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-17T00:01:40.511 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-17T00:01:40.543 INFO:tasks.ceph:Creating extra log directories... 2023-08-17T00:01:40.544 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-17T00:01:40.586 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-17T00:01:40.711 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-17T00:01:40.712 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-17T00:01:40.712 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-17T00:01:40.712 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:40.713 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-17T00:01:40.729 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-17T00:01:40.861 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:40.861 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-17T00:01:40.883 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-17T00:01:41.019 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-17T00:01:41.020 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-17T00:01:41.020 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431', 'branch': 'wip-yuri2-testing-2023-08-16-1142-pacific', 'description': 'fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7370431', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri2-testing-2023-08-16-1142-pacific'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri2-testing-2023-08-16-1142-pacific', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9687, 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri2-testing-2023-08-16-1142-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_23c07d8f91d3210fa9df54a2a13a9637958c6088/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088', 'targets': {'smithi153.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi178.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '23c07d8f91d3210fa9df54a2a13a9637958c6088'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-16_22:36:42', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-17T00:01:41.021 DEBUG:teuthology.orchestra.run.smithi153:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-17T00:01:41.028 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-17T00:01:41.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo install -d -m0777 -- /var/run/ceph 2023-08-17T00:01:41.091 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2023-08-17T00:01:41.127 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:41.127 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/scratch_devs of=/dev/stdout 2023-08-17T00:01:41.176 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-17T00:01:41.177 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_1 2023-08-17T00:01:41.239 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-17T00:01:41.240 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-08-17T00:01:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-08-16 23:56:41.852400777 +0000 2023-08-17T00:01:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-08-16 23:56:41.336412676 +0000 2023-08-17T00:01:41.240 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-08-16 23:56:41.336412676 +0000 2023-08-17T00:01:41.241 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-08-17T00:01:41.241 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-17T00:01:41.312 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:01:41.312 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:01:41.312 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000663963 s, 771 kB/s 2023-08-17T00:01:41.314 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-17T00:01:41.381 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_2 2023-08-17T00:01:41.442 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-17T00:01:41.442 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:41.442 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-08-17T00:01:41.442 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:41.443 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-08-16 23:56:42.136394228 +0000 2023-08-17T00:01:41.443 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-08-16 23:56:42.132394319 +0000 2023-08-17T00:01:41.443 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-08-16 23:56:42.132394319 +0000 2023-08-17T00:01:41.443 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-08-17T00:01:41.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-17T00:01:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:01:41.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:01:41.516 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000720841 s, 710 kB/s 2023-08-17T00:01:41.517 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-17T00:01:41.586 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_3 2023-08-17T00:01:41.649 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-08-16 23:56:43.444364064 +0000 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-08-16 23:56:42.928375962 +0000 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-08-16 23:56:42.928375962 +0000 2023-08-17T00:01:41.650 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-08-17T00:01:41.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-17T00:01:41.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:01:41.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:01:41.723 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000416296 s, 1.2 MB/s 2023-08-17T00:01:41.724 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-17T00:01:41.793 DEBUG:teuthology.orchestra.run.smithi153:> stat /dev/vg_nvme/lv_4 2023-08-17T00:01:41.853 INFO:teuthology.orchestra.run.smithi153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-17T00:01:41.854 INFO:teuthology.orchestra.run.smithi153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:41.854 INFO:teuthology.orchestra.run.smithi153.stdout:Device: 5h/5d Inode: 516 Links: 1 2023-08-17T00:01:41.854 INFO:teuthology.orchestra.run.smithi153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:41.854 INFO:teuthology.orchestra.run.smithi153.stdout:Access: 2023-08-16 23:56:43.740357238 +0000 2023-08-17T00:01:41.854 INFO:teuthology.orchestra.run.smithi153.stdout:Modify: 2023-08-16 23:56:43.736357329 +0000 2023-08-17T00:01:41.854 INFO:teuthology.orchestra.run.smithi153.stdout:Change: 2023-08-16 23:56:43.736357329 +0000 2023-08-17T00:01:41.855 INFO:teuthology.orchestra.run.smithi153.stdout: Birth: - 2023-08-17T00:01:41.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-17T00:01:41.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:01:41.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:01:41.933 INFO:teuthology.orchestra.run.smithi153.stderr:512 bytes copied, 0.000673769 s, 760 kB/s 2023-08-17T00:01:41.935 DEBUG:teuthology.orchestra.run.smithi153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-17T00:01:41.999 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T00:01:42.000 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:42.001 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2023-08-17T00:01:42.021 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-17T00:01:42.021 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2023-08-17T00:01:42.081 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-17T00:01:42.081 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:42.081 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-08-17T00:01:42.081 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:42.082 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-08-16 23:56:39.808932581 +0000 2023-08-17T00:01:42.082 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-08-16 23:56:39.276944849 +0000 2023-08-17T00:01:42.082 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-08-16 23:56:39.276944849 +0000 2023-08-17T00:01:42.082 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-08-17T00:01:42.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-17T00:01:42.154 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-08-17T00:01:42.155 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-08-17T00:01:42.155 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000578028 s, 886 kB/s 2023-08-17T00:01:42.156 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-17T00:01:42.226 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2023-08-17T00:01:42.290 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-17T00:01:42.290 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:42.291 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 503 Links: 1 2023-08-17T00:01:42.291 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:42.291 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-08-16 23:56:40.604914224 +0000 2023-08-17T00:01:42.292 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-08-16 23:56:40.080926308 +0000 2023-08-17T00:01:42.292 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-08-16 23:56:40.080926308 +0000 2023-08-17T00:01:42.293 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-08-17T00:01:42.293 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-17T00:01:42.365 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-08-17T00:01:42.366 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-08-17T00:01:42.366 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000572897 s, 894 kB/s 2023-08-17T00:01:42.368 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-17T00:01:42.439 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2023-08-17T00:01:42.504 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-17T00:01:42.505 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:42.505 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-08-17T00:01:42.505 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:42.505 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-08-16 23:56:41.428895222 +0000 2023-08-17T00:01:42.505 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-08-16 23:56:40.912907121 +0000 2023-08-17T00:01:42.506 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-08-16 23:56:40.912907121 +0000 2023-08-17T00:01:42.506 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-08-17T00:01:42.506 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-17T00:01:42.578 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-08-17T00:01:42.579 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-08-17T00:01:42.579 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000590327 s, 867 kB/s 2023-08-17T00:01:42.581 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-17T00:01:42.647 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2023-08-17T00:01:42.717 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-17T00:01:42.717 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-17T00:01:42.718 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-08-17T00:01:42.718 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-17T00:01:42.718 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2023-08-16 23:56:42.248876311 +0000 2023-08-17T00:01:42.718 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2023-08-16 23:56:41.712888673 +0000 2023-08-17T00:01:42.718 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2023-08-16 23:56:41.712888673 +0000 2023-08-17T00:01:42.718 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2023-08-17T00:01:42.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-17T00:01:42.792 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2023-08-17T00:01:42.792 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2023-08-17T00:01:42.793 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000469726 s, 1.1 MB/s 2023-08-17T00:01:42.793 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-17T00:01:42.860 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T00:01:42.861 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-17T00:01:42.861 INFO:tasks.ceph:Generating config... 2023-08-17T00:01:42.862 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-17T00:01:42.862 INFO:tasks.ceph:[client] debug client = 20 2023-08-17T00:01:42.863 INFO:tasks.ceph:[client] debug ms = 1 2023-08-17T00:01:42.863 INFO:tasks.ceph:[client] pid file = 2023-08-17T00:01:42.863 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-17T00:01:42.863 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-17T00:01:42.863 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-17T00:01:42.864 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-17T00:01:42.864 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-17T00:01:42.864 INFO:tasks.ceph:[mds] mds cache max size = 1000 2023-08-17T00:01:42.864 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-17T00:01:42.864 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-17T00:01:42.865 INFO:tasks.ceph:[mds] mds log max segments = 1 2023-08-17T00:01:42.866 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-17T00:01:42.866 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-17T00:01:42.866 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-17T00:01:42.866 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-17T00:01:42.867 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-17T00:01:42.867 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-17T00:01:42.867 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-17T00:01:42.867 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-17T00:01:42.867 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-17T00:01:42.868 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-17T00:01:42.868 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-17T00:01:42.868 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-17T00:01:42.868 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-17T00:01:42.869 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-08-17T00:01:42.869 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-17T00:01:42.869 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-17T00:01:42.869 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-17T00:01:42.869 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-17T00:01:42.870 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-17T00:01:42.870 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-17T00:01:42.870 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-17T00:01:42.870 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-17T00:01:42.870 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-17T00:01:42.870 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-17T00:01:42.871 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-17T00:01:42.871 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-17T00:01:42.871 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-17T00:01:42.871 INFO:tasks.ceph:Setting up mon.a... 2023-08-17T00:01:42.872 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-17T00:01:42.945 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.keyring 2023-08-17T00:01:42.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-17T00:01:43.013 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-17T00:01:43.047 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.153'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2023-08-17T00:01:43.048 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-17T00:01:43.049 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:43.049 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-17T00:01:43.106 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.153 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:43.209 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:43.210 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: generated fsid 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:01:43.210 INFO:teuthology.orchestra.run.smithi153.stdout:epoch 0 2023-08-17T00:01:43.210 INFO:teuthology.orchestra.run.smithi153.stdout:fsid 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:01:43.210 INFO:teuthology.orchestra.run.smithi153.stdout:last_changed 2023-08-17T00:01:43.212387+0000 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:created 2023-08-17T00:01:43.212387+0000 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:min_mon_release 0 (unknown) 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:election_strategy: 1 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:0: [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] mon.a 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2023-08-17T00:01:43.211 INFO:teuthology.orchestra.run.smithi153.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-17T00:01:43.213 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-17T00:01:43.233 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 26772232-6872-4f9c-a0de-c26dcf774179... 2023-08-17T00:01:43.234 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:01:43.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:01:43.362 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-08-17T00:01:43.363 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-08-17T00:01:43.363 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:01:43.363 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-08-17T00:01:43.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.363 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-08-17T00:01:43.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.364 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-08-17T00:01:43.369 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.369 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-08-17T00:01:43.369 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-08-17T00:01:43.369 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.370 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:01:43.371 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-08-17T00:01:43.372 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-08-17T00:01:43.373 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-08-17T00:01:43.374 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-08-17T00:01:43.374 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:01:43.374 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2023-08-17T00:01:43.374 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:01:43.374 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.375 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-08-17T00:01:43.375 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-08-17T00:01:43.375 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.375 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-08-17T00:01:43.375 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-08-17T00:01:43.375 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.376 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-08-17T00:01:43.376 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-08-17T00:01:43.376 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.376 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-08-17T00:01:43.376 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-08-17T00:01:43.376 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-08-17T00:01:43.377 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.377 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-08-17T00:01:43.377 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-08-17T00:01:43.378 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.378 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:01:43.378 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.378 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-08-17T00:01:43.378 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.379 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-08-17T00:01:43.379 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.379 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:01:43.380 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-08-17T00:01:43.380 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.380 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-08-17T00:01:43.380 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-08-17T00:01:43.380 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-08-17T00:01:43.380 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:01:43.381 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:01:43.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:01:43.383 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:01:43.384 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:01:43.385 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:01:43.386 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:01:43.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.386 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:01:43.386 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:01:43.386 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:01:43.387 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-08-17T00:01:43.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:01:43.387 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-08-17T00:01:43.388 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-08-17T00:01:43.388 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-08-17T00:01:43.388 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-08-17T00:01:43.388 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:01:43.389 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:01:43.389 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-08-17T00:01:43.389 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-08-17T00:01:43.389 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:01:43.389 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-08-17T00:01:43.390 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout: mds cache max size = 1000 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-08-17T00:01:43.391 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2023-08-17T00:01:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: mds log max segments = 1 2023-08-17T00:01:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-08-17T00:01:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = True 2023-08-17T00:01:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:01:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:01:43.392 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:01:43.393 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-08-17T00:01:43.398 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-08-17T00:01:43.398 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:01:43.398 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-08-17T00:01:43.399 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-08-17T00:01:43.400 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.400 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-08-17T00:01:43.400 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-08-17T00:01:43.400 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-08-17T00:01:43.401 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.402 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-08-17T00:01:43.402 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-08-17T00:01:43.402 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:01:43.402 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:01:43.402 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-08-17T00:01:43.402 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:01:43.403 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.404 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-08-17T00:01:43.404 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-08-17T00:01:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-08-17T00:01:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-08-17T00:01:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-08-17T00:01:43.405 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.406 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-08-17T00:01:43.407 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-08-17T00:01:43.408 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.408 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-08-17T00:01:43.408 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-08-17T00:01:43.408 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.409 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:01:43.410 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-08-17T00:01:43.410 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.411 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-08-17T00:01:43.411 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2023-08-17T00:01:43.412 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-08-17T00:01:43.413 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:01:43.414 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:01:43.415 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-08-17T00:01:43.416 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:01:43.416 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-08-17T00:01:43.416 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-08-17T00:01:43.416 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:01:43.416 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.417 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:01:43.418 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:01:43.418 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:01:43.418 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-08-17T00:01:43.419 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:01:43.419 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-08-17T00:01:43.419 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-08-17T00:01:43.419 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-08-17T00:01:43.420 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:01:43.421 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:01:43.421 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-08-17T00:01:43.421 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-08-17T00:01:43.421 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:01:43.422 INFO:teuthology.orchestra.run.smithi178.stdout: mds cache max size = 1000 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: mds log max segments = 1 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:01:43.423 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:01:43.424 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:01:43.424 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-17T00:01:43.432 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-17T00:01:43.507 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-17T00:01:43.508 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:43.508 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-17T00:01:43.525 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:43.525 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-17T00:01:43.594 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:01:43.836 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:43.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-17T00:01:43.837 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-17T00:01:43.901 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:01:43.902 DEBUG:teuthology.orchestra.run.smithi153:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:43.966 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:01:43.967 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:43.967 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-17T00:01:43.968 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-17T00:01:44.028 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:01:44.029 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:44.090 INFO:tasks.ceph:Setting up mon nodes... 2023-08-17T00:01:44.091 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-17T00:01:44.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-17T00:01:44.184 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-17T00:01:44.189 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-17T00:01:44.289 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-17T00:01:44.297 INFO:tasks.ceph:Setting up mds nodes... 2023-08-17T00:01:44.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-17T00:01:44.390 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-17T00:01:44.398 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-17T00:01:44.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-17T00:01:44.564 INFO:teuthology.orchestra.run.smithi153.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-17T00:01:44.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-17T00:01:44.605 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-17T00:01:44.698 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-17T00:01:44.706 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-17T00:01:44.740 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-17T00:01:44.870 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-17T00:01:44.876 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-17T00:01:44.909 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-17T00:01:44.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-17T00:01:44.977 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-17T00:01:45.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-17T00:01:45.063 INFO:teuthology.orchestra.run.smithi153.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-17T00:01:45.091 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-17T00:01:45.159 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-17T00:01:45.191 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-17T00:01:45.250 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-17T00:01:45.272 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-17T00:01:45.272 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi153.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-17T00:01:45.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-17T00:01:45.308 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T00:01:45.309 INFO:tasks.ceph:role: osd.0 2023-08-17T00:01:45.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:01:45.309 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-17T00:01:45.922 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:01:45.922 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:01:45.923 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:01:45.924 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:01:45.924 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-08-17T00:01:45.925 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-17T00:01:46.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-17T00:01:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:01:46.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:01:46.069 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-17T00:01:46.147 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T00:01:46.147 INFO:tasks.ceph:role: osd.1 2023-08-17T00:01:46.147 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:01:46.148 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-17T00:01:46.709 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:01:46.709 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:01:46.709 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:01:46.710 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:01:46.713 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-08-17T00:01:46.714 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-17T00:01:46.784 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-17T00:01:46.804 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:01:46.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:01:46.807 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-17T00:01:46.884 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T00:01:46.884 INFO:tasks.ceph:role: osd.2 2023-08-17T00:01:46.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:01:46.885 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-17T00:01:47.481 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:01:47.481 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:01:47.481 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:01:47.481 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2023-08-17T00:01:47.481 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:01:47.482 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:01:47.482 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:01:47.482 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:01:47.482 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:01:47.482 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:01:47.485 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-08-17T00:01:47.485 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-17T00:01:47.610 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-17T00:01:47.630 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:01:47.631 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:01:47.631 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-17T00:01:47.706 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-17T00:01:47.706 INFO:tasks.ceph:role: osd.3 2023-08-17T00:01:47.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:01:47.707 DEBUG:teuthology.orchestra.run.smithi153:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-17T00:01:48.303 INFO:teuthology.orchestra.run.smithi153.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout: = reflink=1 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:01:48.304 INFO:teuthology.orchestra.run.smithi153.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:01:48.305 INFO:teuthology.orchestra.run.smithi153.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:01:48.305 INFO:teuthology.orchestra.run.smithi153.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:01:48.308 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi153.front.sepia.ceph.com -o noatime 2023-08-17T00:01:48.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-17T00:01:48.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-17T00:01:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:01:48.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:01:48.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:48.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:48.588+0000 7f5448b13080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-17T00:01:48.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:48.592+0000 7f5448b13080 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-17T00:01:48.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:48.592+0000 7f5448b13080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-17T00:01:48.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:48.592+0000 7f5448b13080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-17T00:01:48.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:48.592+0000 7f5448b13080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-17T00:01:48.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:48.596+0000 7f5448b13080 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-17T00:01:52.132 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-17T00:01:52.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:52.276+0000 7fc777cfa080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-17T00:01:52.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:52.276+0000 7fc777cfa080 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-17T00:01:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:52.276+0000 7fc777cfa080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-17T00:01:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:52.276+0000 7fc777cfa080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-17T00:01:52.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:52.276+0000 7fc777cfa080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-17T00:01:52.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:52.280+0000 7fc777cfa080 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-17T00:01:55.573 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-17T00:01:55.609 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:55.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:55.724+0000 7f7d3dee7080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-17T00:01:55.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:55.724+0000 7f7d3dee7080 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-17T00:01:55.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:55.724+0000 7f7d3dee7080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-17T00:01:55.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:55.724+0000 7f7d3dee7080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-17T00:01:55.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:55.724+0000 7f7d3dee7080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-17T00:01:55.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:55.728+0000 7f7d3dee7080 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-17T00:01:59.260 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-17T00:01:59.293 DEBUG:teuthology.orchestra.run.smithi153:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:01:59.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:59.407+0000 7fb36e8db080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-17T00:01:59.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:59.407+0000 7fb36e8db080 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-17T00:01:59.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:59.407+0000 7fb36e8db080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-17T00:01:59.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:59.407+0000 7fb36e8db080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-17T00:01:59.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:59.407+0000 7fb36e8db080 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-17T00:01:59.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:01:59.411+0000 7fb36e8db080 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-17T00:02:02.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-17T00:02:02.997 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-17T00:02:03.034 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T00:02:03.034 INFO:tasks.ceph:role: osd.4 2023-08-17T00:02:03.034 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:02:03.035 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-17T00:02:03.150 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:02:03.150 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:02:03.150 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:02:03.150 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2023-08-17T00:02:03.150 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:02:03.151 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:02:03.151 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:02:03.151 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:02:03.151 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:02:03.151 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:02:03.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-08-17T00:02:03.154 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-17T00:02:03.188 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-17T00:02:03.255 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:02:03.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:02:03.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-17T00:02:03.335 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T00:02:03.335 INFO:tasks.ceph:role: osd.5 2023-08-17T00:02:03.336 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:02:03.336 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-17T00:02:03.450 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:02:03.451 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:02:03.451 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:02:03.451 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2023-08-17T00:02:03.451 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:02:03.451 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:02:03.452 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:02:03.452 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:02:03.452 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:02:03.452 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:02:03.456 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-08-17T00:02:03.456 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-17T00:02:03.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-17T00:02:03.571 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:02:03.571 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:02:03.573 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-17T00:02:03.653 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T00:02:03.653 INFO:tasks.ceph:role: osd.6 2023-08-17T00:02:03.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:02:03.654 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-17T00:02:03.764 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:02:03.764 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:02:03.764 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:02:03.764 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2023-08-17T00:02:03.765 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:02:03.765 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:02:03.765 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:02:03.765 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:02:03.765 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:02:03.765 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:02:03.769 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-08-17T00:02:03.769 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-17T00:02:03.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-17T00:02:03.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:02:03.885 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:02:03.886 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-17T00:02:03.962 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-17T00:02:03.962 INFO:tasks.ceph:role: osd.7 2023-08-17T00:02:03.963 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:02:03.963 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-17T00:02:04.074 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-17T00:02:04.074 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-17T00:02:04.075 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-17T00:02:04.079 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2023-08-17T00:02:04.080 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-17T00:02:04.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-17T00:02:04.191 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:02:04.191 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2023-08-17T00:02:04.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:02:04.352 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:04.338+0000 7f6d7bae2080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-17T00:02:04.353 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:04.338+0000 7f6d7bae2080 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-17T00:02:04.353 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:04.338+0000 7f6d7bae2080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-17T00:02:04.353 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:04.338+0000 7f6d7bae2080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-17T00:02:04.353 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:04.338+0000 7f6d7bae2080 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-17T00:02:04.354 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:04.342+0000 7f6d7bae2080 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-17T00:02:07.875 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-17T00:02:07.911 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:02:08.029 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:08.018+0000 7f15a6ce9080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-17T00:02:08.029 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:08.018+0000 7f15a6ce9080 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-17T00:02:08.030 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:08.018+0000 7f15a6ce9080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-17T00:02:08.033 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:08.018+0000 7f15a6ce9080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-17T00:02:08.033 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:08.018+0000 7f15a6ce9080 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-17T00:02:08.034 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:08.022+0000 7f15a6ce9080 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-17T00:02:11.022 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:02:11.030 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:02:11.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-17T00:02:11.574 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:02:11.687 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:11.678+0000 7f2d5f168080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-17T00:02:11.688 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:11.682+0000 7f2d5f168080 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-17T00:02:11.688 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:11.682+0000 7f2d5f168080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-17T00:02:11.689 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:11.682+0000 7f2d5f168080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-17T00:02:11.689 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:11.682+0000 7f2d5f168080 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-17T00:02:11.690 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:11.682+0000 7f2d5f168080 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-17T00:02:14.956 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-17T00:02:14.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:02:15.106 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:15.098+0000 7fe48e83a080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-17T00:02:15.108 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:15.098+0000 7fe48e83a080 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-17T00:02:15.108 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:15.098+0000 7fe48e83a080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-17T00:02:15.108 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:15.098+0000 7fe48e83a080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-17T00:02:15.109 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:15.098+0000 7fe48e83a080 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-17T00:02:15.110 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:15.102+0000 7fe48e83a080 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-17T00:02:18.393 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-17T00:02:18.427 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-17T00:02:18.427 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.428 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-17T00:02:18.462 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-17T00:02:18.541 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.542 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-17T00:02:18.615 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-17T00:02:18.692 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-17T00:02:18.766 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.767 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-17T00:02:18.843 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:18.844 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-17T00:02:18.919 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:18.919 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-17T00:02:18.954 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:18.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-17T00:02:19.027 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.027 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-17T00:02:19.108 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-17T00:02:19.187 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.187 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-17T00:02:19.260 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.261 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-17T00:02:19.344 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.345 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-17T00:02:19.420 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:19.420 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-17T00:02:19.440 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:19.441 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-17T00:02:19.503 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.504 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-17T00:02:19.525 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:19.526 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-17T00:02:19.588 INFO:tasks.ceph:Adding keys to all mons... 2023-08-17T00:02:19.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-17T00:02:19.596 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-17T00:02:19.646 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.y] 2023-08-17T00:02:19.646 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA== 2023-08-17T00:02:19.646 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-08-17T00:02:19.647 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ== 2023-08-17T00:02:19.647 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-08-17T00:02:19.648 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg== 2023-08-17T00:02:19.648 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.0] 2023-08-17T00:02:19.648 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ== 2023-08-17T00:02:19.650 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.1] 2023-08-17T00:02:19.650 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg== 2023-08-17T00:02:19.650 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.2] 2023-08-17T00:02:19.650 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg== 2023-08-17T00:02:19.650 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.3] 2023-08-17T00:02:19.651 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg== 2023-08-17T00:02:19.651 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr.x] 2023-08-17T00:02:19.651 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A== 2023-08-17T00:02:19.651 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-08-17T00:02:19.651 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg== 2023-08-17T00:02:19.652 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-08-17T00:02:19.652 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ== 2023-08-17T00:02:19.652 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.4] 2023-08-17T00:02:19.652 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ== 2023-08-17T00:02:19.652 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.5] 2023-08-17T00:02:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw== 2023-08-17T00:02:19.653 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.6] 2023-08-17T00:02:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA== 2023-08-17T00:02:19.653 INFO:teuthology.orchestra.run.smithi153.stdout:[osd.7] 2023-08-17T00:02:19.653 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ== 2023-08-17T00:02:19.653 INFO:teuthology.orchestra.run.smithi153.stdout:[client.0] 2023-08-17T00:02:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q== 2023-08-17T00:02:19.654 INFO:teuthology.orchestra.run.smithi153.stdout:[client.2] 2023-08-17T00:02:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ== 2023-08-17T00:02:19.654 INFO:teuthology.orchestra.run.smithi153.stdout:[client.1] 2023-08-17T00:02:19.654 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig== 2023-08-17T00:02:19.654 INFO:teuthology.orchestra.run.smithi153.stdout:[client.3] 2023-08-17T00:02:19.655 INFO:teuthology.orchestra.run.smithi153.stdout: key = AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA== 2023-08-17T00:02:19.668 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2023-08-17T00:02:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA== 2023-08-17T00:02:19.669 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-08-17T00:02:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ== 2023-08-17T00:02:19.669 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-08-17T00:02:19.669 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg== 2023-08-17T00:02:19.669 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2023-08-17T00:02:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ== 2023-08-17T00:02:19.670 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2023-08-17T00:02:19.670 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg== 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg== 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg== 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A== 2023-08-17T00:02:19.671 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-08-17T00:02:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg== 2023-08-17T00:02:19.672 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-08-17T00:02:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ== 2023-08-17T00:02:19.672 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2023-08-17T00:02:19.672 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ== 2023-08-17T00:02:19.672 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2023-08-17T00:02:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw== 2023-08-17T00:02:19.673 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2023-08-17T00:02:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA== 2023-08-17T00:02:19.673 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2023-08-17T00:02:19.673 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ== 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q== 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout:[client.2] 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ== 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig== 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout:[client.3] 2023-08-17T00:02:19.674 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA== 2023-08-17T00:02:19.675 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T00:02:19.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T00:02:19.793 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:19.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:19.878 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:19.890 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:19.965 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:19.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.054 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.214 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.223 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T00:02:20.302 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-17T00:02:20.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:20.382 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:20.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:20.463 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-17T00:02:20.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.617 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.626 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.708 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.785 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-17T00:02:20.854 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:20.861 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:20.939 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:20.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:21.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:21.034 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:21.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:21.120 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-17T00:02:21.198 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-17T00:02:21.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-17T00:02:21.233 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-17T00:02:21.365 DEBUG:teuthology.orchestra.run.smithi153:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-17T00:02:21.398 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-17T00:02:21.435 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-17T00:02:21.563 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-17T00:02:21.594 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-17T00:02:21.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-17T00:02:21.807 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-17T00:02:21.838 DEBUG:teuthology.orchestra.run.smithi153:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:02:21.845 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-17T00:02:21.905 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-17T00:02:21.906 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-17T00:02:21.906 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-17T00:02:21.914 INFO:tasks.ceph.mon.a:Started 2023-08-17T00:02:21.915 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-17T00:02:21.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-17T00:02:21.959 INFO:tasks.ceph.mon.b:Started 2023-08-17T00:02:21.960 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-17T00:02:21.961 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-17T00:02:21.966 INFO:tasks.ceph.mon.c:Started 2023-08-17T00:02:21.966 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-17T00:02:21.967 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-17T00:02:21.967 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-17T00:02:21.975 INFO:tasks.ceph.mgr.y:Started 2023-08-17T00:02:21.975 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-17T00:02:21.976 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-17T00:02:21.985 INFO:tasks.ceph.mgr.x:Started 2023-08-17T00:02:21.985 INFO:tasks.ceph:Setting crush tunables to default 2023-08-17T00:02:21.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd crush tunables default 2023-08-17T00:02:22.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.129+0000 7f5dd1ab9700 1 Processor -- start 2023-08-17T00:02:22.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.129+0000 7f5dd1ab9700 1 -- start start 2023-08-17T00:02:22.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd1ab9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:22.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd1ab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:22.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd1ab9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc0bfd10 con 0x7f5dcc157600 2023-08-17T00:02:22.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd1ab9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc154860 con 0x7f5dcc0c57a0 2023-08-17T00:02:22.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd1ab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc154af0 con 0x7f5dcc153f50 2023-08-17T00:02:22.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd0ab7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:22.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:22.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd12b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5dcc157600 0x7f5dcc157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44602/0 (socket says 172.21.15.153:44602) 2023-08-17T00:02:22.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 learned_addr learned my addr 172.21.15.153:0/4151616807 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:22.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:22.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:22.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:22.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:22.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:22.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:22.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T00:02:22.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.133+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T00:02:22.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:22.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:22.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:22.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:22.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T00:02:22.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:22.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:22.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:22.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:22.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.337+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T00:02:22.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:22.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:22.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T00:02:22.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:22.741+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T00:02:23.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:23.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:23.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:23.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:23.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:23.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:23.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:23.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:23.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T00:02:23.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:23.545+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T00:02:25.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 msgr2=0x7f5dcc154370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-17T00:02:25.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc153f50 0x7f5dcc154370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:25.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 msgr2=0x7f5dcc0c5b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-17T00:02:25.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5dcc0c57a0 0x7f5dcc0c5b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:25.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v1:172.21.15.153:6789/0 conn(0x7f5dcc157600 legacy=0x7f5dcc157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:25.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:25.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dcc154dd0 con 0x7f5db0005ff0 2023-08-17T00:02:25.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc154860 con 0x7f5db00035b0 2023-08-17T00:02:25.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:25.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:25.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:25.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:25.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.133+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T00:02:25.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.337+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:25.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.337+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:25.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.337+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:25.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.337+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:25.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.337+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T00:02:25.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.741+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:25.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.741+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:25.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.741+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:25.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.741+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:25.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:25.741+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T00:02:26.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:26.545+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:26.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:26.545+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:26.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:26.545+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:26.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:26.545+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:26.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:26.545+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T00:02:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 msgr2=0x7f5db00059f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-17T00:02:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00035b0 0x7f5db00059f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v1:172.21.15.178:6789/0 conn(0x7f5db0005ff0 legacy=0x7f5db00084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 reap_dead start 2023-08-17T00:02:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db000ada0 con 0x7f5db0008c80 2023-08-17T00:02:28.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db00084c0 con 0x7f5db0009e60 2023-08-17T00:02:28.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc154860 con 0x7f5db00059f0 2023-08-17T00:02:28.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:28.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-17T00:02:28.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:28.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:28.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.133+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T00:02:28.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.336+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:28.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.336+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-17T00:02:28.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.336+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:28.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.336+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:28.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.336+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T00:02:28.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.740+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:28.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.740+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-17T00:02:28.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.740+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:28.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.740+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:28.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:28.740+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T00:02:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:29.544+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:29.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:29.544+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-17T00:02:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:29.544+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:29.544+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:29.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:29.544+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2023-08-17T00:02:31.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 msgr2=0x7f5db0009770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-17T00:02:31.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.178:3300/0 conn(0x7f5db00059f0 0x7f5db0009770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:31.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v1:172.21.15.178:6789/0 conn(0x7f5db0009e60 legacy=0x7f5db000a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:31.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 >> v1:172.21.15.153:6789/0 conn(0x7f5db0008c80 legacy=0x7f5db0009060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:31.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:31.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:31.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dcc154860 con 0x7f5db0007f50 2023-08-17T00:02:31.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dca7fc700 1 -- 172.21.15.153:0/4151616807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc154af0 con 0x7f5db00074b0 2023-08-17T00:02:31.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:31.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:31.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:31.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.132+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2023-08-17T00:02:31.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:31.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:31.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.336+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2023-08-17T00:02:31.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:31.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-08-17T00:02:31.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dcbfff700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:31.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:31.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:31.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T00:02:31.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-17T00:02:31.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-17T00:02:31.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-08-17T00:02:31.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:31.740+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2023-08-17T00:02:32.539 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:32.530+0000 7f385bd47500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T00:02:32.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:32.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:32.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 msgr2=0x7f5db00140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:32.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> v2:172.21.15.153:3300/0 conn(0x7f5db0007f50 0x7f5db00140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:32.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dd0ab7700 1 -- 172.21.15.153:0/4151616807 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00086e0 con 0x7f5db00074b0 2023-08-17T00:02:32.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5dc0006db0 tx=0x7f5dc0008040).ready entity=mon.2 client_cookie=39fd00deba951c3e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:32.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dcb7fe700 1 -- 172.21.15.153:0/4151616807 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc001e030 con 0x7f5db00074b0 2023-08-17T00:02:32.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dcb7fe700 1 -- 172.21.15.153:0/4151616807 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc001f040 con 0x7f5db00074b0 2023-08-17T00:02:32.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.544+0000 7f5dcb7fe700 1 -- 172.21.15.153:0/4151616807 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0017b40 con 0x7f5db00074b0 2023-08-17T00:02:32.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 msgr2=0x7f5db0007890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:32.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd1ab9700 1 --2- 172.21.15.153:0/4151616807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5db00074b0 0x7f5db0007890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f5dc0006db0 tx=0x7f5dc0008040).stop 2023-08-17T00:02:32.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd12b8700 1 -- 172.21.15.153:0/4151616807 reap_dead start 2023-08-17T00:02:32.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/4151616807 shutdown_connections 2023-08-17T00:02:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/4151616807 >> 172.21.15.153:0/4151616807 conn(0x7f5dcc062a70 msgr2=0x7f5dcc0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/4151616807 shutdown_connections 2023-08-17T00:02:32.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.548+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/4151616807 wait complete. 2023-08-17T00:02:32.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 Processor -- start 2023-08-17T00:02:32.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 -- start start 2023-08-17T00:02:32.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5db00074b0 0x7f5dcc0c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:32.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 0x7f5dcc0abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:32.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc0c1a60 0x7f5dcc0c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:32.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0b0620 con 0x7f5dcc0abb30 2023-08-17T00:02:32.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0ac4a0 con 0x7f5db00074b0 2023-08-17T00:02:32.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd1ab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dcc0afa10 con 0x7f5dcc0c1a60 2023-08-17T00:02:32.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 0x7f5dcc0abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:32.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dcbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 0x7f5dcc0abfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42534/0 (socket says 172.21.15.153:42534) 2023-08-17T00:02:32.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dcbfff700 1 -- 172.21.15.153:0/3756958757 learned_addr learned my addr 172.21.15.153:0/3756958757 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:32.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd0ab7700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5db00074b0 0x7f5dcc0c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:32.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.552+0000 7f5dd12b8700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc0c1a60 0x7f5dcc0c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:32.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dcbfff700 1 -- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc0c1a60 msgr2=0x7f5dcc0c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:32.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc0c1a60 0x7f5dcc0c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:32.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dcbfff700 1 -- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5db00074b0 msgr2=0x7f5dcc0c2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:32.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5db00074b0 0x7f5dcc0c2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:32.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dcbfff700 1 -- 172.21.15.153:0/3756958757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db00084c0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dcbfff700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 0x7f5dcc0abfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f5db8019a90 tx=0x7f5db8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:32.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db801e070 con 0x7f5dcc0abb30 2023-08-17T00:02:32.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dcc0afcf0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db8017740 con 0x7f5dcc0abb30 2023-08-17T00:02:32.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8016ce0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dcc0b02b0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f5db8012040 con 0x7f5dcc0abb30 2023-08-17T00:02:32.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f5db802c760 con 0x7f5dcc0abb30 2023-08-17T00:02:32.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.556+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dcc06b4c0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.560+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f5db8023de0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.579 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:32.572+0000 7fd3cf75f500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-17T00:02:32.622 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:32.614+0000 7f385bd47500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T00:02:32.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.628+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5dcc0bf9a0 con 0x7f5dcc0abb30 2023-08-17T00:02:32.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dc8ff9700 1 -- 172.21.15.153:0/3756958757 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5db8023630 con 0x7f5dcc0abb30 2023-08-17T00:02:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 msgr2=0x7f5dcc0abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 0x7f5dcc0abfb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f5db8019a90 tx=0x7f5db8008040).stop 2023-08-17T00:02:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 shutdown_connections 2023-08-17T00:02:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dcc0c1a60 0x7f5dcc0c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5dcc0abb30 0x7f5dcc0abfb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 --2- 172.21.15.153:0/3756958757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5db00074b0 0x7f5dcc0c2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 >> 172.21.15.153:0/3756958757 conn(0x7f5dcc062a70 msgr2=0x7f5dcc156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 shutdown_connections 2023-08-17T00:02:32.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:32.636+0000 7f5dd1ab9700 1 -- 172.21.15.153:0/3756958757 wait complete. 2023-08-17T00:02:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:adjusted tunables profile to default 2023-08-17T00:02:32.662 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:32.656+0000 7fd3cf75f500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-17T00:02:32.663 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-17T00:02:32.663 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:32.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-17T00:02:32.696 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:32.696 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-17T00:02:32.771 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:32.771 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-17T00:02:32.847 DEBUG:teuthology.orchestra.run.smithi153:> set -ex 2023-08-17T00:02:32.847 DEBUG:teuthology.orchestra.run.smithi153:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-17T00:02:32.919 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:32.920 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-17T00:02:32.956 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:32.957 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-17T00:02:33.032 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:33.033 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-17T00:02:33.112 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2023-08-17T00:02:33.112 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-17T00:02:33.193 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 1969b88b-c81b-4fac-b199-213b2b513b68 0 2023-08-17T00:02:33.355 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:33.346+0000 7f385bd47500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T00:02:33.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.374+0000 7fb036df9700 1 Processor -- start 2023-08-17T00:02:33.382 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.374+0000 7fb036df9700 1 -- start start 2023-08-17T00:02:33.385 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb0300a8df0 0x7fb0300c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.385 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 0x7fb030068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0301585a0 con 0x7fb030061fa0 2023-08-17T00:02:33.386 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb030066400 con 0x7fb0300a8df0 2023-08-17T00:02:33.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb030069170 con 0x7fb030068820 2023-08-17T00:02:33.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 0x7fb030068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 0x7fb030068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:55268/0 (socket says 172.21.15.178:55268) 2023-08-17T00:02:33.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 -- 172.21.15.178:0/2897182367 learned_addr learned my addr 172.21.15.178:0/2897182367 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:33.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb035df7700 1 --2- 172.21.15.178:0/2897182367 >> v2:172.21.15.153:3300/0 conn(0x7fb0300a8df0 0x7fb0300c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.387 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 -- 172.21.15.178:0/2897182367 >> v2:172.21.15.153:3300/0 conn(0x7fb0300a8df0 msgr2=0x7fb0300c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:33.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 --2- 172.21.15.178:0/2897182367 >> v2:172.21.15.153:3300/0 conn(0x7fb0300a8df0 0x7fb0300c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 -- 172.21.15.178:0/2897182367 >> v1:172.21.15.153:6789/0 conn(0x7fb030061fa0 legacy=0x7fb030062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:33.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 -- 172.21.15.178:0/2897182367 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0300b9d30 con 0x7fb030068820 2023-08-17T00:02:33.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb0355f6700 1 --2- 172.21.15.178:0/2897182367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 0x7fb030068c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb020006fd0 tx=0x7fb0200090f0).ready entity=mon.2 client_cookie=499b5c79c73c39b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:33.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb034df5700 1 -- 172.21.15.178:0/2897182367 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000b600 con 0x7fb030068820 2023-08-17T00:02:33.388 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb034df5700 1 -- 172.21.15.178:0/2897182367 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000b760 con 0x7fb030068820 2023-08-17T00:02:33.389 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb034df5700 1 -- 172.21.15.178:0/2897182367 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bae0 con 0x7fb030068820 2023-08-17T00:02:33.389 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- 172.21.15.178:0/2897182367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 msgr2=0x7fb030068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.390 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 --2- 172.21.15.178:0/2897182367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 0x7fb030068c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb020006fd0 tx=0x7fb0200090f0).stop 2023-08-17T00:02:33.390 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- 172.21.15.178:0/2897182367 shutdown_connections 2023-08-17T00:02:33.392 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 --2- 172.21.15.178:0/2897182367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb030068820 0x7fb030068c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.392 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 --2- 172.21.15.178:0/2897182367 >> v2:172.21.15.153:3300/0 conn(0x7fb0300a8df0 0x7fb0300c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.394 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- 172.21.15.178:0/2897182367 >> 172.21.15.178:0/2897182367 conn(0x7fb0300c6620 msgr2=0x7fb0300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:33.394 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- 172.21.15.178:0/2897182367 shutdown_connections 2023-08-17T00:02:33.395 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.378+0000 7fb036df9700 1 -- 172.21.15.178:0/2897182367 wait complete. 2023-08-17T00:02:33.397 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.382+0000 7fb036df9700 1 Processor -- start 2023-08-17T00:02:33.398 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.382+0000 7fb036df9700 1 -- start start 2023-08-17T00:02:33.398 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 0x7fb030169110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.398 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb030068820 0x7fb03015a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.399 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0300a8df0 0x7fb0300bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.399 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03015af50 con 0x7fb030068820 2023-08-17T00:02:33.399 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300be640 con 0x7fb030061fa0 2023-08-17T00:02:33.399 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb030169600 con 0x7fb0300a8df0 2023-08-17T00:02:33.400 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 0x7fb030169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 0x7fb030169110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48114/0 (socket says 172.21.15.178:48114) 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 -- 172.21.15.178:0/3833513545 learned_addr learned my addr 172.21.15.178:0/3833513545 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb0365f8700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0300a8df0 0x7fb0300bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb0355f6700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb030068820 0x7fb03015a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 -- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0300a8df0 msgr2=0x7fb0300bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0300a8df0 0x7fb0300bf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.401 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 -- 172.21.15.178:0/3833513545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb030068820 msgr2=0x7fb03015a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.402 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb030068820 0x7fb03015a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.402 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 -- 172.21.15.178:0/3833513545 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020009370 con 0x7fb030061fa0 2023-08-17T00:02:33.402 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb0355f6700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb030068820 0x7fb03015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:33.402 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb035df7700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 0x7fb030169110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb02c00d890 tx=0x7fb02c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:33.403 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c0125f0 con 0x7fb030061fa0 2023-08-17T00:02:33.403 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c012750 con 0x7fb030061fa0 2023-08-17T00:02:33.403 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0300bda30 con 0x7fb030061fa0 2023-08-17T00:02:33.403 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c012ad0 con 0x7fb030061fa0 2023-08-17T00:02:33.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0300bdff0 con 0x7fb030061fa0 2023-08-17T00:02:33.404 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fb02c0136e0 con 0x7fb030061fa0 2023-08-17T00:02:33.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.386+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7fb02c013970 con 0x7fb030061fa0 2023-08-17T00:02:33.405 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.390+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03006b4c0 con 0x7fb030061fa0 2023-08-17T00:02:33.406 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:33.392+0000 7fd3cf75f500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-17T00:02:33.406 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.394+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fb02c013bf0 con 0x7fb030061fa0 2023-08-17T00:02:33.479 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.470+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1969b88b-c81b-4fac-b199-213b2b513b68", "id": 0} v 0) v1 -- 0x7fb030064010 con 0x7fb030061fa0 2023-08-17T00:02:33.487 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.478+0000 7fb025ffb700 1 -- 172.21.15.178:0/3833513545 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1969b88b-c81b-4fac-b199-213b2b513b68", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb02c01d460 con 0x7fb030061fa0 2023-08-17T00:02:33.488 INFO:teuthology.orchestra.run.smithi178.stdout:0 2023-08-17T00:02:33.489 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 msgr2=0x7fb030169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.490 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 0x7fb030169110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fb02c00d890 tx=0x7fb02c008040).stop 2023-08-17T00:02:33.491 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 shutdown_connections 2023-08-17T00:02:33.491 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0300a8df0 0x7fb0300bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.491 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb030068820 0x7fb03015a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.492 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 --2- 172.21.15.178:0/3833513545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb030061fa0 0x7fb030169110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.492 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 >> 172.21.15.178:0/3833513545 conn(0x7fb0300c6620 msgr2=0x7fb0300ab2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:33.493 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 shutdown_connections 2023-08-17T00:02:33.493 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.482+0000 7fb036df9700 1 -- 172.21.15.178:0/3833513545 wait complete. 2023-08-17T00:02:33.507 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 7f30a16f-3732-4b50-867d-711abe9e1a92 1 2023-08-17T00:02:33.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.650+0000 7faed1fb9700 1 Processor -- start 2023-08-17T00:02:33.660 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.650+0000 7faed1fb9700 1 -- start start 2023-08-17T00:02:33.661 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed1fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.662 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed1fb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc0bfd10 con 0x7faecc0c11b0 2023-08-17T00:02:33.662 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed1fb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc158420 con 0x7faecc153f50 2023-08-17T00:02:33.662 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed1fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc154af0 con 0x7faecc0c57a0 2023-08-17T00:02:33.663 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faecbfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7faecc153f50 0x7faecc157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:50034/0 (socket says 172.21.15.178:50034) 2023-08-17T00:02:33.663 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faecbfff700 1 -- 172.21.15.178:0/3146242314 learned_addr learned my addr 172.21.15.178:0/3146242314 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-08-17T00:02:33.663 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed0fb7700 1 --2- 172.21.15.178:0/3146242314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faecb7fe700 1 -- 172.21.15.178:0/3146242314 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553863193 0 0) 0x7faecc158420 con 0x7faecc153f50 2023-08-17T00:02:33.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faecb7fe700 1 -- 172.21.15.178:0/3146242314 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faebc0033f0 con 0x7faecc153f50 2023-08-17T00:02:33.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed0fb7700 1 -- 172.21.15.178:0/3146242314 >> v1:172.21.15.178:6789/0 conn(0x7faecc153f50 legacy=0x7faecc157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.664 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed0fb7700 1 -- 172.21.15.178:0/3146242314 >> v1:172.21.15.153:6789/0 conn(0x7faecc0c11b0 legacy=0x7faecc157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.665 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed0fb7700 1 -- 172.21.15.178:0/3146242314 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc154dd0 con 0x7faecc0c57a0 2023-08-17T00:02:33.665 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.654+0000 7faed0fb7700 1 --2- 172.21.15.178:0/3146242314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c5b80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7faec0009790 tx=0x7faec0009060).ready entity=mon.2 client_cookie=47b862ab15cb5698 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:33.666 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faecb7fe700 1 -- 172.21.15.178:0/3146242314 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000f510 con 0x7faecc0c57a0 2023-08-17T00:02:33.666 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faecb7fe700 1 -- 172.21.15.178:0/3146242314 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000f670 con 0x7faecc0c57a0 2023-08-17T00:02:33.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faecb7fe700 1 -- 172.21.15.178:0/3146242314 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000f9f0 con 0x7faecc0c57a0 2023-08-17T00:02:33.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 -- 172.21.15.178:0/3146242314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 msgr2=0x7faecc0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 --2- 172.21.15.178:0/3146242314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c5b80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7faec0009790 tx=0x7faec0009060).stop 2023-08-17T00:02:33.668 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 -- 172.21.15.178:0/3146242314 shutdown_connections 2023-08-17T00:02:33.669 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 --2- 172.21.15.178:0/3146242314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c5b80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.670 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 -- 172.21.15.178:0/3146242314 >> 172.21.15.178:0/3146242314 conn(0x7faecc062a70 msgr2=0x7faecc0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:33.670 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 -- 172.21.15.178:0/3146242314 shutdown_connections 2023-08-17T00:02:33.670 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.658+0000 7faed1fb9700 1 -- 172.21.15.178:0/3146242314 wait complete. 2023-08-17T00:02:33.674 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 Processor -- start 2023-08-17T00:02:33.674 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 -- start start 2023-08-17T00:02:33.674 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 0x7faecc0c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.674 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.674 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faecc153f50 0x7faecc150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.674 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c1940 con 0x7faecc153f50 2023-08-17T00:02:33.675 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0b06c0 con 0x7faecc0c11b0 2023-08-17T00:02:33.675 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed1fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0c1b50 con 0x7faecc0c57a0 2023-08-17T00:02:33.675 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 0x7faecc0c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.675 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 0x7faecc0c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48122/0 (socket says 172.21.15.178:48122) 2023-08-17T00:02:33.675 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 -- 172.21.15.178:0/1141126193 learned_addr learned my addr 172.21.15.178:0/1141126193 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:33.676 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faecbfff700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.676 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed17b8700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faecc153f50 0x7faecc150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.676 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 -- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 msgr2=0x7faecc0c3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.676 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 -- 172.21.15.178:0/1141126193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faecc153f50 msgr2=0x7faecc150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faecc153f50 0x7faecc150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed0fb7700 1 -- 172.21.15.178:0/1141126193 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec00092a0 con 0x7faecc0c11b0 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.662+0000 7faed17b8700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faecc153f50 0x7faecc150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faed0fb7700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 0x7faecc0c2630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7faec0009e30 tx=0x7faec0017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000f7e0 con 0x7faecc0c11b0 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000f940 con 0x7faecc0c11b0 2023-08-17T00:02:33.677 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0023670 con 0x7faecc0c11b0 2023-08-17T00:02:33.678 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc0c1e30 con 0x7faecc0c11b0 2023-08-17T00:02:33.678 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc0c2b20 con 0x7faecc0c11b0 2023-08-17T00:02:33.678 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7faec000f070 con 0x7faecc0c11b0 2023-08-17T00:02:33.678 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7faec001a7e0 con 0x7faecc0c11b0 2023-08-17T00:02:33.679 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.666+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc0c2d40 con 0x7faecc0c11b0 2023-08-17T00:02:33.679 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.670+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7faec001e070 con 0x7faecc0c11b0 2023-08-17T00:02:33.752 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.742+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7f30a16f-3732-4b50-867d-711abe9e1a92", "id": 1} v 0) v1 -- 0x7faecc06b4c0 con 0x7faecc0c11b0 2023-08-17T00:02:33.760 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faec8ff9700 1 -- 172.21.15.178:0/1141126193 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7f30a16f-3732-4b50-867d-711abe9e1a92", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7faec001aa20 con 0x7faecc0c11b0 2023-08-17T00:02:33.760 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-08-17T00:02:33.762 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 msgr2=0x7faecc0c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.762 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 0x7faecc0c2630 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7faec0009e30 tx=0x7faec0017000).stop 2023-08-17T00:02:33.762 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 shutdown_connections 2023-08-17T00:02:33.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faecc153f50 0x7faecc150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faecc0c57a0 0x7faecc0c3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 --2- 172.21.15.178:0/1141126193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faecc0c11b0 0x7faecc0c2630 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 >> 172.21.15.178:0/1141126193 conn(0x7faecc062a70 msgr2=0x7faecc0c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:33.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 shutdown_connections 2023-08-17T00:02:33.763 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.754+0000 7faed1fb9700 1 -- 172.21.15.178:0/1141126193 wait complete. 2023-08-17T00:02:33.780 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 1ff82dc3-9026-4869-9ef6-399407eea4c1 2 2023-08-17T00:02:33.930 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.922+0000 7f4c1b769700 1 Processor -- start 2023-08-17T00:02:33.930 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.922+0000 7f4c1b769700 1 -- start start 2023-08-17T00:02:33.933 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c1b769700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c14153e90 0x7f4c140c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.934 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c1b769700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c140641f0 0x7f4c14061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.934 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c1b769700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140c0330 con 0x7f4c14153ab0 2023-08-17T00:02:33.934 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c1b769700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c141542f0 con 0x7f4c14153e90 2023-08-17T00:02:33.935 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c1b769700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140c0ed0 con 0x7f4c140641f0 2023-08-17T00:02:33.935 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19505700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4c14153ab0 0x7f4c140c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:50038/0 (socket says 172.21.15.178:50038) 2023-08-17T00:02:33.935 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19505700 1 -- 172.21.15.178:0/4118601116 learned_addr learned my addr 172.21.15.178:0/4118601116 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-08-17T00:02:33.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19d06700 1 --2- 172.21.15.178:0/4118601116 >> v2:172.21.15.178:3300/0 conn(0x7f4c140641f0 0x7f4c14061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.936 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c18d04700 1 --2- 172.21.15.178:0/4118601116 >> v2:172.21.15.153:3300/0 conn(0x7f4c14153e90 0x7f4c140c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.939 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c0bfff700 1 -- 172.21.15.178:0/4118601116 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959177180 0 0) 0x7f4c140c0330 con 0x7f4c14153ab0 2023-08-17T00:02:33.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c0bfff700 1 -- 172.21.15.178:0/4118601116 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c000033f0 con 0x7f4c14153ab0 2023-08-17T00:02:33.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19d06700 1 -- 172.21.15.178:0/4118601116 >> v2:172.21.15.153:3300/0 conn(0x7f4c14153e90 msgr2=0x7f4c140c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:33.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19d06700 1 --2- 172.21.15.178:0/4118601116 >> v2:172.21.15.153:3300/0 conn(0x7f4c14153e90 0x7f4c140c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.940 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19d06700 1 -- 172.21.15.178:0/4118601116 >> v1:172.21.15.178:6789/0 conn(0x7f4c14153ab0 legacy=0x7f4c140c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19d06700 1 -- 172.21.15.178:0/4118601116 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14064660 con 0x7f4c140641f0 2023-08-17T00:02:33.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c19d06700 1 --2- 172.21.15.178:0/4118601116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c14061fa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4c1406c0c0 tx=0x7f4c0c009780).ready entity=mon.1 client_cookie=3426a53f59bbfba6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:33.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c0bfff700 1 -- 172.21.15.178:0/4118601116 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00e070 con 0x7f4c140641f0 2023-08-17T00:02:33.941 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c0bfff700 1 -- 172.21.15.178:0/4118601116 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00bab0 con 0x7f4c140641f0 2023-08-17T00:02:33.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.926+0000 7f4c0bfff700 1 -- 172.21.15.178:0/4118601116 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00be30 con 0x7f4c140641f0 2023-08-17T00:02:33.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 -- 172.21.15.178:0/4118601116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 msgr2=0x7f4c14061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 --2- 172.21.15.178:0/4118601116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c14061fa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f4c1406c0c0 tx=0x7f4c0c009780).stop 2023-08-17T00:02:33.942 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 -- 172.21.15.178:0/4118601116 shutdown_connections 2023-08-17T00:02:33.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 --2- 172.21.15.178:0/4118601116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c14061fa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 --2- 172.21.15.178:0/4118601116 >> v2:172.21.15.153:3300/0 conn(0x7f4c14153e90 0x7f4c140c59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 -- 172.21.15.178:0/4118601116 >> 172.21.15.178:0/4118601116 conn(0x7f4c140caaa0 msgr2=0x7f4c140caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:33.943 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 -- 172.21.15.178:0/4118601116 shutdown_connections 2023-08-17T00:02:33.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 -- 172.21.15.178:0/4118601116 wait complete. 2023-08-17T00:02:33.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 Processor -- start 2023-08-17T00:02:33.944 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 -- start start 2023-08-17T00:02:33.948 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.930+0000 7f4c1b769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c140c3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.948 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c14153ab0 0x7f4c14157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.948 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c14153e90 0x7f4c1415a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:33.949 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1413e290 con 0x7f4c14153ab0 2023-08-17T00:02:33.949 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140c42b0 con 0x7f4c140641f0 2023-08-17T00:02:33.949 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14156a10 con 0x7f4c14153e90 2023-08-17T00:02:33.949 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c140c3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.950 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c140c3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48140/0 (socket says 172.21.15.178:48140) 2023-08-17T00:02:33.950 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 -- 172.21.15.178:0/1532353048 learned_addr learned my addr 172.21.15.178:0/1532353048 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:33.950 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19d06700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c14153e90 0x7f4c1415a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c18d04700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c14153ab0 0x7f4c14157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 -- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c14153e90 msgr2=0x7f4c1415a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c14153e90 0x7f4c1415a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 -- 172.21.15.178:0/1532353048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c14153ab0 msgr2=0x7f4c14157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c14153ab0 0x7f4c14157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 -- 172.21.15.178:0/1532353048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c009a20 con 0x7f4c140641f0 2023-08-17T00:02:33.951 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c19505700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c140c3dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4c10001ed0 tx=0x7f4c10007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100072e0 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10007440 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c14156cf0 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100057a0 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c141572b0 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f4c10010070 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f4c10013e00 con 0x7f4c140641f0 2023-08-17T00:02:33.952 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.934+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1406b530 con 0x7f4c140641f0 2023-08-17T00:02:33.953 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:33.938+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f4c10018020 con 0x7f4c140641f0 2023-08-17T00:02:34.020 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.014+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ff82dc3-9026-4869-9ef6-399407eea4c1", "id": 2} v 0) v1 -- 0x7f4c14063080 con 0x7f4c140641f0 2023-08-17T00:02:34.029 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c097fa700 1 -- 172.21.15.178:0/1532353048 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ff82dc3-9026-4869-9ef6-399407eea4c1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c10005db0 con 0x7f4c140641f0 2023-08-17T00:02:34.029 INFO:teuthology.orchestra.run.smithi178.stdout:2 2023-08-17T00:02:34.030 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 msgr2=0x7f4c140c3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.030 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c140c3dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f4c10001ed0 tx=0x7f4c10007c70).stop 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 shutdown_connections 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c14153e90 0x7f4c1415a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c14153ab0 0x7f4c14157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 --2- 172.21.15.178:0/1532353048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c140641f0 0x7f4c140c3dc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 >> 172.21.15.178:0/1532353048 conn(0x7f4c140caaa0 msgr2=0x7f4c14152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 shutdown_connections 2023-08-17T00:02:34.031 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.022+0000 7f4c1b769700 1 -- 172.21.15.178:0/1532353048 wait complete. 2023-08-17T00:02:34.034 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.026+0000 7f385bd47500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T00:02:34.049 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 80d9c3af-d21a-44eb-a74b-e2b90bea159b 3 2023-08-17T00:02:34.083 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:34.076+0000 7fd3cf75f500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-17T00:02:34.206 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.198+0000 7f2f13f69700 1 Processor -- start 2023-08-17T00:02:34.206 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.198+0000 7f2f13f69700 1 -- start start 2023-08-17T00:02:34.208 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f13f69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f0c153ab0 0x7f2f0c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.208 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f13f69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f0c0c7ba0 0x7f2f0c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.208 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f13f69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0aa750 con 0x7f2f0c0c8d50 2023-08-17T00:02:34.208 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f13f69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c9dd0 con 0x7f2f0c0c7ba0 2023-08-17T00:02:34.209 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f13f69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0aacf0 con 0x7f2f0c153ab0 2023-08-17T00:02:34.209 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f0c153ab0 0x7f2f0c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.210 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f12506700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f0c0c7ba0 0x7f2f0c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.210 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f0c153ab0 0x7f2f0c153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48154/0 (socket says 172.21.15.178:48154) 2023-08-17T00:02:34.210 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 -- 172.21.15.178:0/3661180022 learned_addr learned my addr 172.21.15.178:0/3661180022 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 -- 172.21.15.178:0/3661180022 >> v2:172.21.15.153:3300/0 conn(0x7f2f0c0c7ba0 msgr2=0x7f2f0c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:34.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 --2- 172.21.15.178:0/3661180022 >> v2:172.21.15.153:3300/0 conn(0x7f2f0c0c7ba0 0x7f2f0c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 -- 172.21.15.178:0/3661180022 >> v1:172.21.15.178:6789/0 conn(0x7f2f0c0c8d50 legacy=0x7f2f0c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f10d03700 1 -- 172.21.15.178:0/3661180022 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003438137 0 0) 0x7f2f0c0aa750 con 0x7f2f0c0c8d50 2023-08-17T00:02:34.211 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 -- 172.21.15.178:0/3661180022 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0c5ca0 con 0x7f2f0c153ab0 2023-08-17T00:02:34.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f11d05700 1 --2- 172.21.15.178:0/3661180022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c153e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2f0c0cba90 tx=0x7f2f080090f0).ready entity=mon.1 client_cookie=91190075bc78e47d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f10d03700 1 -- 172.21.15.178:0/3661180022 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800b520 con 0x7f2f0c153ab0 2023-08-17T00:02:34.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f10d03700 1 -- 172.21.15.178:0/3661180022 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0800b680 con 0x7f2f0c153ab0 2023-08-17T00:02:34.213 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.202+0000 7f2f10d03700 1 -- 172.21.15.178:0/3661180022 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0800ba20 con 0x7f2f0c153ab0 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 -- 172.21.15.178:0/3661180022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 msgr2=0x7f2f0c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3661180022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c153e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2f0c0cba90 tx=0x7f2f080090f0).stop 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 -- 172.21.15.178:0/3661180022 shutdown_connections 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3661180022 >> v2:172.21.15.153:3300/0 conn(0x7f2f0c0c7ba0 0x7f2f0c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3661180022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c153e90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 -- 172.21.15.178:0/3661180022 >> 172.21.15.178:0/3661180022 conn(0x7f2f0c061fa0 msgr2=0x7f2f0c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.214 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 -- 172.21.15.178:0/3661180022 shutdown_connections 2023-08-17T00:02:34.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 -- 172.21.15.178:0/3661180022 wait complete. 2023-08-17T00:02:34.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 Processor -- start 2023-08-17T00:02:34.215 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.206+0000 7f2f13f69700 1 -- start start 2023-08-17T00:02:34.216 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f0c0c7ba0 0x7f2f0c0c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0c8d50 0x7f2f0c0c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c2340 con 0x7f2f0c0c7ba0 2023-08-17T00:02:34.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c2620 con 0x7f2f0c153ab0 2023-08-17T00:02:34.217 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0c2900 con 0x7f2f0c0c8d50 2023-08-17T00:02:34.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c0b0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48156/0 (socket says 172.21.15.178:48156) 2023-08-17T00:02:34.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 -- 172.21.15.178:0/3920597115 learned_addr learned my addr 172.21.15.178:0/3920597115 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f11504700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0c8d50 0x7f2f0c0c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f11d05700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f0c0c7ba0 0x7f2f0c0c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.219 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 -- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0c8d50 msgr2=0x7f2f0c0c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0c8d50 0x7f2f0c0c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 -- 172.21.15.178:0/3920597115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f0c0c7ba0 msgr2=0x7f2f0c0c1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f0c0c7ba0 0x7f2f0c0c1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.220 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 -- 172.21.15.178:0/3920597115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009370 con 0x7f2f0c153ab0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f12506700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c0b0020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2f04009ef0 tx=0x7f2f0400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400cc20 con 0x7f2f0c153ab0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0400f040 con 0x7f2f0c153ab0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04013400 con 0x7f2f0c153ab0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c0c2be0 con 0x7f2f0c153ab0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f2f04013a10 con 0x7f2f0c153ab0 2023-08-17T00:02:34.221 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c0c4b70 con 0x7f2f0c153ab0 2023-08-17T00:02:34.222 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.210+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f2f0401b820 con 0x7f2f0c153ab0 2023-08-17T00:02:34.222 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.214+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c06b530 con 0x7f2f0c153ab0 2023-08-17T00:02:34.223 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.218+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2f0401b360 con 0x7f2f0c153ab0 2023-08-17T00:02:34.246 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.238+0000 7f385bd47500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T00:02:34.288 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:34.284+0000 7fd3cf75f500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-17T00:02:34.296 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.290+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "80d9c3af-d21a-44eb-a74b-e2b90bea159b", "id": 3} v 0) v1 -- 0x7f2f0c0c9810 con 0x7f2f0c153ab0 2023-08-17T00:02:34.305 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f01ffb700 1 -- 172.21.15.178:0/3920597115 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "80d9c3af-d21a-44eb-a74b-e2b90bea159b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f0401b5c0 con 0x7f2f0c153ab0 2023-08-17T00:02:34.305 INFO:teuthology.orchestra.run.smithi178.stdout:3 2023-08-17T00:02:34.306 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 msgr2=0x7f2f0c0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.306 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c0b0020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f2f04009ef0 tx=0x7f2f0400b040).stop 2023-08-17T00:02:34.306 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 shutdown_connections 2023-08-17T00:02:34.306 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f0c153ab0 0x7f2f0c0b0020 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.307 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f0c0c8d50 0x7f2f0c0c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.307 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 --2- 172.21.15.178:0/3920597115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f0c0c7ba0 0x7f2f0c0c1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.307 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 >> 172.21.15.178:0/3920597115 conn(0x7f2f0c061fa0 msgr2=0x7f2f0c150970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.307 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 shutdown_connections 2023-08-17T00:02:34.307 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.298+0000 7f2f13f69700 1 -- 172.21.15.178:0/3920597115 wait complete. 2023-08-17T00:02:34.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 8471906c-9ca7-47db-91eb-5bc3fe5091b6 4 2023-08-17T00:02:34.459 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.450+0000 7f976891a700 1 Processor -- start 2023-08-17T00:02:34.459 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.450+0000 7f976891a700 1 -- start start 2023-08-17T00:02:34.464 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 0x7f97640c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97640c5ea0 0x7f97640634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97640639a0 0x7f9764157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9764154e90 con 0x7f97640c5ea0 2023-08-17T00:02:34.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9764063e10 con 0x7f97640639a0 2023-08-17T00:02:34.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9764153fc0 con 0x7f97640acf30 2023-08-17T00:02:34.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97640639a0 0x7f9764157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 0x7f97640c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 0x7f97640c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:55318/0 (socket says 172.21.15.178:55318) 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97640639a0 0x7f9764157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48168/0 (socket says 172.21.15.178:48168) 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 -- 172.21.15.178:0/268933800 learned_addr learned my addr 172.21.15.178:0/268933800 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f975a59c700 1 --2- 172.21.15.178:0/268933800 >> v2:172.21.15.153:3300/0 conn(0x7f97640c5ea0 0x7f97640634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 -- 172.21.15.178:0/268933800 >> v2:172.21.15.178:3300/0 conn(0x7f97640639a0 msgr2=0x7f9764157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:34.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 --2- 172.21.15.178:0/268933800 >> v2:172.21.15.178:3300/0 conn(0x7f97640639a0 0x7f9764157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.467 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 -- 172.21.15.178:0/268933800 >> v2:172.21.15.153:3300/0 conn(0x7f97640c5ea0 msgr2=0x7f97640634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:34.467 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 --2- 172.21.15.178:0/268933800 >> v2:172.21.15.153:3300/0 conn(0x7f97640c5ea0 0x7f97640634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.467 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 -- 172.21.15.178:0/268933800 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9764154280 con 0x7f97640acf30 2023-08-17T00:02:34.467 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f9762d9d700 1 --2- 172.21.15.178:0/268933800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 0x7f97640c1020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9764064150 tx=0x7f97540090f0).ready entity=mon.2 client_cookie=a8f47a3d713b88c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976259c700 1 -- 172.21.15.178:0/268933800 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400b520 con 0x7f97640acf30 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976259c700 1 -- 172.21.15.178:0/268933800 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975400b680 con 0x7f97640acf30 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976259c700 1 -- 172.21.15.178:0/268933800 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400ba20 con 0x7f97640acf30 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 -- 172.21.15.178:0/268933800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 msgr2=0x7f97640c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.454+0000 7f976891a700 1 --2- 172.21.15.178:0/268933800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 0x7f97640c1020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f9764064150 tx=0x7f97540090f0).stop 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- 172.21.15.178:0/268933800 shutdown_connections 2023-08-17T00:02:34.468 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 --2- 172.21.15.178:0/268933800 >> v2:172.21.15.178:3300/0 conn(0x7f97640639a0 0x7f9764157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 --2- 172.21.15.178:0/268933800 >> v2:172.21.15.153:3300/0 conn(0x7f97640c5ea0 0x7f97640634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 --2- 172.21.15.178:0/268933800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640acf30 0x7f97640c1020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- 172.21.15.178:0/268933800 >> 172.21.15.178:0/268933800 conn(0x7f97640cb330 msgr2=0x7f97640c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- 172.21.15.178:0/268933800 shutdown_connections 2023-08-17T00:02:34.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- 172.21.15.178:0/268933800 wait complete. 2023-08-17T00:02:34.471 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 Processor -- start 2023-08-17T00:02:34.471 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- start start 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640639a0 0x7f97640ae200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97640acf30 0x7f9764144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 0x7f97641565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97640af480 con 0x7f97640acf30 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764144900 con 0x7f97640b00d0 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976891a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97640ae870 con 0x7f97640639a0 2023-08-17T00:02:34.472 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f9762d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640639a0 0x7f97640ae200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 0x7f97641565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 0x7f97641565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48180/0 (socket says 172.21.15.178:48180) 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f976359e700 1 -- 172.21.15.178:0/1809317910 learned_addr learned my addr 172.21.15.178:0/1809317910 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.458+0000 7f9762d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640639a0 0x7f97640ae200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:55328/0 (socket says 172.21.15.178:55328) 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f975a59c700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97640acf30 0x7f9764144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976359e700 1 -- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640639a0 msgr2=0x7f97640ae200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.473 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976359e700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640639a0 0x7f97640ae200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976359e700 1 -- 172.21.15.178:0/1809317910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97640acf30 msgr2=0x7f9764144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976359e700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97640acf30 0x7f9764144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976359e700 1 -- 172.21.15.178:0/1809317910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9754009370 con 0x7f97640b00d0 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976359e700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 0x7f97641565d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f975c009e90 tx=0x7f975c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00caa0 con 0x7f97640b00d0 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975c00f040 con 0x7f97640b00d0 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97640aeb50 con 0x7f97640b00d0 2023-08-17T00:02:34.474 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975c00ce10 con 0x7f97640b00d0 2023-08-17T00:02:34.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97640af110 con 0x7f97640b00d0 2023-08-17T00:02:34.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f975c013870 con 0x7f97640b00d0 2023-08-17T00:02:34.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f975c013b00 con 0x7f97640b00d0 2023-08-17T00:02:34.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.462+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97640abb50 con 0x7f97640b00d0 2023-08-17T00:02:34.475 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.466+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f97640abb50 con 0x7f97640b00d0 2023-08-17T00:02:34.553 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.546+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8471906c-9ca7-47db-91eb-5bc3fe5091b6", "id": 4} v 0) v1 -- 0x7f97640af5f0 con 0x7f97640b00d0 2023-08-17T00:02:34.562 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.554+0000 7f975b7fe700 1 -- 172.21.15.178:0/1809317910 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8471906c-9ca7-47db-91eb-5bc3fe5091b6", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f975c01d5f0 con 0x7f97640b00d0 2023-08-17T00:02:34.562 INFO:teuthology.orchestra.run.smithi178.stdout:4 2023-08-17T00:02:34.563 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.554+0000 7f385bd47500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T00:02:34.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 msgr2=0x7f97641565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.564 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 0x7f97641565d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f975c009e90 tx=0x7f975c00b040).stop 2023-08-17T00:02:34.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 shutdown_connections 2023-08-17T00:02:34.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97640b00d0 0x7f97641565d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97640acf30 0x7f9764144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 --2- 172.21.15.178:0/1809317910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97640639a0 0x7f97640ae200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.565 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 >> 172.21.15.178:0/1809317910 conn(0x7f97640cb330 msgr2=0x7f9764152130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 shutdown_connections 2023-08-17T00:02:34.566 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.558+0000 7f976891a700 1 -- 172.21.15.178:0/1809317910 wait complete. 2023-08-17T00:02:34.582 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new df266beb-aa49-4403-a360-0f6345ad9639 5 2023-08-17T00:02:34.613 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:34.604+0000 7fd3cf75f500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-17T00:02:34.727 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.718+0000 7f000f1a9700 1 Processor -- start 2023-08-17T00:02:34.728 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000f1a9700 1 -- start start 2023-08-17T00:02:34.730 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000f1a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00080c7dc0 0x7f0008066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.730 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000f1a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00080bc7a0 con 0x7f0008066b10 2023-08-17T00:02:34.730 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000f1a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0008151b60 con 0x7f00080645a0 2023-08-17T00:02:34.730 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000f1a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0008064a30 con 0x7f00080c7dc0 2023-08-17T00:02:34.731 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000d746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00080c7dc0 0x7f0008066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.731 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f0007fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f00080645a0 0x7f0008063140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:50050/0 (socket says 172.21.15.178:50050) 2023-08-17T00:02:34.731 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f0007fff700 1 -- 172.21.15.178:0/2247705586 learned_addr learned my addr 172.21.15.178:0/2247705586 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-08-17T00:02:34.731 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000d746700 1 -- 172.21.15.178:0/2247705586 >> v1:172.21.15.178:6789/0 conn(0x7f00080645a0 legacy=0x7f0008063140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.732 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000d746700 1 -- 172.21.15.178:0/2247705586 >> v1:172.21.15.153:6789/0 conn(0x7f0008066b10 legacy=0x7f00080c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.732 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000d746700 1 -- 172.21.15.178:0/2247705586 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00080be540 con 0x7f00080c7dc0 2023-08-17T00:02:34.732 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.722+0000 7f000d746700 1 --2- 172.21.15.178:0/2247705586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00080c7dc0 0x7f0008066ef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0000009e90 tx=0x7f0000009780).ready entity=mon.2 client_cookie=7a3ba3b15a02eb6f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.733 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f00077fe700 1 -- 172.21.15.178:0/2247705586 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000e070 con 0x7f00080c7dc0 2023-08-17T00:02:34.733 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f00077fe700 1 -- 172.21.15.178:0/2247705586 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000bc30 con 0x7f00080c7dc0 2023-08-17T00:02:34.733 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f00077fe700 1 -- 172.21.15.178:0/2247705586 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0000012410 con 0x7f00080c7dc0 2023-08-17T00:02:34.733 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 -- 172.21.15.178:0/2247705586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00080c7dc0 msgr2=0x7f0008066ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.733 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 --2- 172.21.15.178:0/2247705586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00080c7dc0 0x7f0008066ef0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f0000009e90 tx=0x7f0000009780).stop 2023-08-17T00:02:34.734 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 -- 172.21.15.178:0/2247705586 shutdown_connections 2023-08-17T00:02:34.734 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 --2- 172.21.15.178:0/2247705586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00080c7dc0 0x7f0008066ef0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.734 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 -- 172.21.15.178:0/2247705586 >> 172.21.15.178:0/2247705586 conn(0x7f00080aa820 msgr2=0x7f00080aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.734 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 -- 172.21.15.178:0/2247705586 shutdown_connections 2023-08-17T00:02:34.734 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 -- 172.21.15.178:0/2247705586 wait complete. 2023-08-17T00:02:34.735 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.726+0000 7f000f1a9700 1 Processor -- start 2023-08-17T00:02:34.735 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 -- start start 2023-08-17T00:02:34.742 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0008066b10 0x7f0008164ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 0x7f0008148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000814e9a0 0x7f0008164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00080bcb10 con 0x7f000814e9a0 2023-08-17T00:02:34.773 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00081670e0 con 0x7f00080c7dc0 2023-08-17T00:02:34.775 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00080c3170 con 0x7f0008066b10 2023-08-17T00:02:34.775 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 0x7f0008148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.775 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000cf45700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0008066b10 0x7f0008164ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.776 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 0x7f0008148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48194/0 (socket says 172.21.15.178:48194) 2023-08-17T00:02:34.776 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 -- 172.21.15.178:0/4194148845 learned_addr learned my addr 172.21.15.178:0/4194148845 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.776 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000d746700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000814e9a0 0x7f0008164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 -- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0008066b10 msgr2=0x7f0008164ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0008066b10 0x7f0008164ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 -- 172.21.15.178:0/4194148845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000814e9a0 msgr2=0x7f0008164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000814e9a0 0x7f0008164770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.777 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 -- 172.21.15.178:0/4194148845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000009a20 con 0x7f00080c7dc0 2023-08-17T00:02:34.778 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0007fff700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 0x7f0008148dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efff400c4a0 tx=0x7efff4007c30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.778 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400cea0 con 0x7f00080c7dc0 2023-08-17T00:02:34.778 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff40072e0 con 0x7f00080c7dc0 2023-08-17T00:02:34.778 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4005670 con 0x7f00080c7dc0 2023-08-17T00:02:34.778 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00081492b0 con 0x7f00080c7dc0 2023-08-17T00:02:34.779 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000814f1d0 con 0x7f00080c7dc0 2023-08-17T00:02:34.779 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7efff4010070 con 0x7f00080c7dc0 2023-08-17T00:02:34.779 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.730+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7efff4005d00 con 0x7f00080c7dc0 2023-08-17T00:02:34.781 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.734+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00080c32e0 con 0x7f00080c7dc0 2023-08-17T00:02:34.782 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.734+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f00080c32e0 con 0x7f00080c7dc0 2023-08-17T00:02:34.782 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.750+0000 7f385bd47500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T00:02:34.817 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:34.812+0000 7fd3cf75f500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-17T00:02:34.818 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.810+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df266beb-aa49-4403-a360-0f6345ad9639", "id": 5} v 0) v1 -- 0x7f0008151e40 con 0x7f00080c7dc0 2023-08-17T00:02:34.825 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f0004ff9700 1 -- 172.21.15.178:0/4194148845 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df266beb-aa49-4403-a360-0f6345ad9639", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00081492b0 con 0x7f00080c7dc0 2023-08-17T00:02:34.826 INFO:teuthology.orchestra.run.smithi178.stdout:5 2023-08-17T00:02:34.827 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 msgr2=0x7f0008148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.827 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 0x7f0008148dc0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7efff400c4a0 tx=0x7efff4007c30).stop 2023-08-17T00:02:34.827 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 shutdown_connections 2023-08-17T00:02:34.827 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f000814e9a0 0x7f0008164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.827 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00080c7dc0 0x7f0008148dc0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.827 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 --2- 172.21.15.178:0/4194148845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0008066b10 0x7f0008164ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.828 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 >> 172.21.15.178:0/4194148845 conn(0x7f00080aa820 msgr2=0x7f00080c7550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.828 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 shutdown_connections 2023-08-17T00:02:34.828 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.818+0000 7f000f1a9700 1 -- 172.21.15.178:0/4194148845 wait complete. 2023-08-17T00:02:34.831 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.822+0000 7f385bd47500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T00:02:34.844 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff 6 2023-08-17T00:02:34.895 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:34.888+0000 7fd3cf75f500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-17T00:02:34.922 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.914+0000 7f385bd47500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T00:02:34.983 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.974+0000 7f2e90e5b700 1 Processor -- start 2023-08-17T00:02:34.984 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- start start 2023-08-17T00:02:34.985 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0a8b70 0x7f2e8c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.985 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e8c0a8f50 0x7f2e8c0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.985 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c065240 con 0x7f2e8c0656d0 2023-08-17T00:02:34.986 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c062ea0 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.986 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0638a0 con 0x7f2e8c0a8b70 2023-08-17T00:02:34.986 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e8c0a8f50 0x7f2e8c0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.986 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e8c0a8f50 0x7f2e8c0629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48208/0 (socket says 172.21.15.178:48208) 2023-08-17T00:02:34.986 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 -- 172.21.15.178:0/504684224 learned_addr learned my addr 172.21.15.178:0/504684224 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.986 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e8a59c700 1 --2- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0a8b70 0x7f2e8c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.987 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:34.980+0000 7fd3cf75f500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-17T00:02:34.988 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 -- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0a8b70 msgr2=0x7f2e8c0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 --2- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0a8b70 0x7f2e8c0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 -- 172.21.15.178:0/504684224 >> v1:172.21.15.153:6789/0 conn(0x7f2e8c0656d0 legacy=0x7f2e8c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 -- 172.21.15.178:0/504684224 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c064910 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e81d9b700 1 --2- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0629b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2e7c006fd0 tx=0x7f2e7c0090f0).ready entity=mon.1 client_cookie=e34b5f1fc57a58e3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e89d9b700 1 -- 172.21.15.178:0/504684224 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00b600 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e89d9b700 1 -- 172.21.15.178:0/504684224 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c00b760 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.989 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e89d9b700 1 -- 172.21.15.178:0/504684224 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c00bae0 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 msgr2=0x7f2e8c0629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0629b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2e7c006fd0 tx=0x7f2e7c0090f0).stop 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- 172.21.15.178:0/504684224 shutdown_connections 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0629b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/504684224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0a8b70 0x7f2e8c0632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- 172.21.15.178:0/504684224 >> 172.21.15.178:0/504684224 conn(0x7f2e8c0c7150 msgr2=0x7f2e8c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:34.990 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.978+0000 7f2e90e5b700 1 -- 172.21.15.178:0/504684224 shutdown_connections 2023-08-17T00:02:34.991 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 -- 172.21.15.178:0/504684224 wait complete. 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 Processor -- start 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 -- start start 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0656d0 0x7f2e8c146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e8c0a8b70 0x7f2e8c15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c155310 con 0x7f2e8c0a8b70 2023-08-17T00:02:34.993 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c15a850 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.994 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e90e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1693b0 con 0x7f2e8c0656d0 2023-08-17T00:02:34.994 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8a59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0656d0 0x7f2e8c146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.994 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8ad9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.994 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8a59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0656d0 0x7f2e8c146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:55360/0 (socket says 172.21.15.178:55360) 2023-08-17T00:02:34.994 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8a59c700 1 -- 172.21.15.178:0/2370383467 learned_addr learned my addr 172.21.15.178:0/2370383467 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e81d9b700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e8c0a8b70 0x7f2e8c15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8ad9d700 1 -- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0656d0 msgr2=0x7f2e8c146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8ad9d700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0656d0 0x7f2e8c146ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8ad9d700 1 -- 172.21.15.178:0/2370383467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e8c0a8b70 msgr2=0x7f2e8c15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8ad9d700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e8c0a8b70 0x7f2e8c15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e8ad9d700 1 -- 172.21.15.178:0/2370383467 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c009370 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.995 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.982+0000 7f2e81d9b700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e8c0a8b70 0x7f2e8c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:34.996 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e8ad9d700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0bf730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f2e8400b810 tx=0x7f2e84009250).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:34.996 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84001500 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.996 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84001680 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.996 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c169690 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.996 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84001a40 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.996 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c15a4e0 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.997 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f2e84018030 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.997 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f2e84011e40 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.997 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.986+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c15a9c0 con 0x7f2e8c0a8f50 2023-08-17T00:02:34.997 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:34.990+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f2e84020060 con 0x7f2e8c0a8f50 2023-08-17T00:02:35.006 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:34.998+0000 7f385bd47500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T00:02:35.067 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:35.060+0000 7fd3cf75f500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-17T00:02:35.073 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.066+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff", "id": 6} v 0) v1 -- 0x7f2e8c06b530 con 0x7f2e8c0a8f50 2023-08-17T00:02:35.080 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e82ffd700 1 -- 172.21.15.178:0/2370383467 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2e84016070 con 0x7f2e8c0a8f50 2023-08-17T00:02:35.081 INFO:teuthology.orchestra.run.smithi178.stdout:6 2023-08-17T00:02:35.083 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 msgr2=0x7f2e8c0bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.084 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0bf730 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f2e8400b810 tx=0x7f2e84009250).stop 2023-08-17T00:02:35.084 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 shutdown_connections 2023-08-17T00:02:35.084 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e8c0a8f50 0x7f2e8c0bf730 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.084 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e8c0a8b70 0x7f2e8c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.084 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 --2- 172.21.15.178:0/2370383467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e8c0656d0 0x7f2e8c146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.085 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 >> 172.21.15.178:0/2370383467 conn(0x7f2e8c0c7150 msgr2=0x7f2e8c0c5e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:35.085 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 shutdown_connections 2023-08-17T00:02:35.085 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.074+0000 7f2e90e5b700 1 -- 172.21.15.178:0/2370383467 wait complete. 2023-08-17T00:02:35.100 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 1ff7c332-f204-41a0-a83d-bf2278444a50 7 2023-08-17T00:02:35.246 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.238+0000 7fa90b547700 1 Processor -- start 2023-08-17T00:02:35.246 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.238+0000 7fa90b547700 1 -- start start 2023-08-17T00:02:35.249 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90b547700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa904150880 0x7fa9040a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.250 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90b547700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa904068f30 0x7fa904064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.250 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90b547700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9040ab9b0 con 0x7fa9040a8e60 2023-08-17T00:02:35.250 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90b547700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9040aada0 con 0x7fa904150880 2023-08-17T00:02:35.250 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90b547700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9040ab080 con 0x7fa904068f30 2023-08-17T00:02:35.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90ad46700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa904068f30 0x7fa904064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa909d44700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa9040a8e60 0x7fa904068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:50054/0 (socket says 172.21.15.178:50054) 2023-08-17T00:02:35.251 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa909d44700 1 -- 172.21.15.178:0/3205232919 learned_addr learned my addr 172.21.15.178:0/3205232919 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-08-17T00:02:35.252 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90a545700 1 --2- 172.21.15.178:0/3205232919 >> v2:172.21.15.153:3300/0 conn(0x7fa904150880 0x7fa9040a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.254 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90ad46700 1 -- 172.21.15.178:0/3205232919 >> v2:172.21.15.153:3300/0 conn(0x7fa904150880 msgr2=0x7fa9040a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:35.255 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90ad46700 1 --2- 172.21.15.178:0/3205232919 >> v2:172.21.15.153:3300/0 conn(0x7fa904150880 0x7fa9040a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.255 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90ad46700 1 -- 172.21.15.178:0/3205232919 >> v1:172.21.15.178:6789/0 conn(0x7fa9040a8e60 legacy=0x7fa904068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.255 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa909543700 1 -- 172.21.15.178:0/3205232919 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481446161 0 0) 0x7fa9040ab9b0 con 0x7fa9040a8e60 2023-08-17T00:02:35.255 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90ad46700 1 -- 172.21.15.178:0/3205232919 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040ab360 con 0x7fa904068f30 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa90ad46700 1 --2- 172.21.15.178:0/3205232919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa904068f30 0x7fa904064670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa9040c20a0 tx=0x7fa8fc009060).ready entity=mon.1 client_cookie=5057588c6b90d71f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa909543700 1 -- 172.21.15.178:0/3205232919 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc0090d0 con 0x7fa904068f30 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa909543700 1 -- 172.21.15.178:0/3205232919 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc00f510 con 0x7fa904068f30 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.242+0000 7fa909543700 1 -- 172.21.15.178:0/3205232919 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00f890 con 0x7fa904068f30 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 -- 172.21.15.178:0/3205232919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa904068f30 msgr2=0x7fa904064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 --2- 172.21.15.178:0/3205232919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa904068f30 0x7fa904064670 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa9040c20a0 tx=0x7fa8fc009060).stop 2023-08-17T00:02:35.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 -- 172.21.15.178:0/3205232919 shutdown_connections 2023-08-17T00:02:35.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 --2- 172.21.15.178:0/3205232919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa904068f30 0x7fa904064670 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 --2- 172.21.15.178:0/3205232919 >> v2:172.21.15.153:3300/0 conn(0x7fa904150880 0x7fa9040a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 -- 172.21.15.178:0/3205232919 >> 172.21.15.178:0/3205232919 conn(0x7fa9040c6620 msgr2=0x7fa9040c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:35.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 -- 172.21.15.178:0/3205232919 shutdown_connections 2023-08-17T00:02:35.258 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.246+0000 7fa90b547700 1 -- 172.21.15.178:0/3205232919 wait complete. 2023-08-17T00:02:35.260 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 Processor -- start 2023-08-17T00:02:35.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 -- start start 2023-08-17T00:02:35.264 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa904068f30 0x7fa904153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.264 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 0x7fa9040bec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.264 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa904150880 0x7fa904154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.264 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040be7f0 con 0x7fa904068f30 2023-08-17T00:02:35.265 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa904168040 con 0x7fa9040a8e60 2023-08-17T00:02:35.265 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9040bdec0 con 0x7fa904150880 2023-08-17T00:02:35.265 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 0x7fa9040bec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.266 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 0x7fa9040bec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:48234/0 (socket says 172.21.15.178:48234) 2023-08-17T00:02:35.266 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 -- 172.21.15.178:0/2525516302 learned_addr learned my addr 172.21.15.178:0/2525516302 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:02:35.266 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90ad46700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa904150880 0x7fa904154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.266 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90a545700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa904068f30 0x7fa904153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.267 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 -- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa904150880 msgr2=0x7fa904154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.267 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa904150880 0x7fa904154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.267 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 -- 172.21.15.178:0/2525516302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa904068f30 msgr2=0x7fa904153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.267 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa904068f30 0x7fa904153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.268 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 -- 172.21.15.178:0/2525516302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc0092a0 con 0x7fa9040a8e60 2023-08-17T00:02:35.268 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90ad46700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa904150880 0x7fa904154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:35.268 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90a545700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa904068f30 0x7fa904153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:35.269 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa909d44700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 0x7fa9040bec80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa8f400c4e0 tx=0x7fa8f4007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:35.269 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40072e0 con 0x7fa9040a8e60 2023-08-17T00:02:35.269 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f4007440 con 0x7fa9040a8e60 2023-08-17T00:02:35.270 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40057a0 con 0x7fa9040a8e60 2023-08-17T00:02:35.270 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9040be1a0 con 0x7fa9040a8e60 2023-08-17T00:02:35.270 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa904153a40 con 0x7fa9040a8e60 2023-08-17T00:02:35.270 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7fa8f4010070 con 0x7fa9040a8e60 2023-08-17T00:02:35.271 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.250+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7fa8f4005e30 con 0x7fa9040a8e60 2023-08-17T00:02:35.272 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.254+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90406b4c0 con 0x7fa9040a8e60 2023-08-17T00:02:35.273 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.258+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7fa8f40138b0 con 0x7fa9040a8e60 2023-08-17T00:02:35.341 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.334+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ff7c332-f204-41a0-a83d-bf2278444a50", "id": 7} v 0) v1 -- 0x7fa9040be620 con 0x7fa9040a8e60 2023-08-17T00:02:35.354 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa8fa7fc700 1 -- 172.21.15.178:0/2525516302 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ff7c332-f204-41a0-a83d-bf2278444a50", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa8f4013a50 con 0x7fa9040a8e60 2023-08-17T00:02:35.355 INFO:teuthology.orchestra.run.smithi178.stdout:7 2023-08-17T00:02:35.359 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 msgr2=0x7fa9040bec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.360 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 0x7fa9040bec80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa8f400c4e0 tx=0x7fa8f4007c70).stop 2023-08-17T00:02:35.360 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 shutdown_connections 2023-08-17T00:02:35.361 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa904150880 0x7fa904154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.361 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9040a8e60 0x7fa9040bec80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.362 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 --2- 172.21.15.178:0/2525516302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa904068f30 0x7fa904153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.362 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 >> 172.21.15.178:0/2525516302 conn(0x7fa9040c6620 msgr2=0x7fa90414faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:35.363 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 shutdown_connections 2023-08-17T00:02:35.363 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:02:35.346+0000 7fa90b547700 1 -- 172.21.15.178:0/2525516302 wait complete. 2023-08-17T00:02:35.374 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-17T00:02:35.375 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-17T00:02:35.388 INFO:tasks.ceph.osd.0:Started 2023-08-17T00:02:35.389 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-17T00:02:35.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-17T00:02:35.395 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:35.386+0000 7f385bd47500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T00:02:35.395 INFO:tasks.ceph.osd.1:Started 2023-08-17T00:02:35.396 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-17T00:02:35.396 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-17T00:02:35.403 INFO:tasks.ceph.osd.2:Started 2023-08-17T00:02:35.403 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-17T00:02:35.404 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-17T00:02:35.413 INFO:tasks.ceph.osd.3:Started 2023-08-17T00:02:35.414 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-17T00:02:35.414 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-17T00:02:35.422 INFO:tasks.ceph.osd.4:Started 2023-08-17T00:02:35.423 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-17T00:02:35.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-17T00:02:35.430 INFO:tasks.ceph.osd.5:Started 2023-08-17T00:02:35.431 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-17T00:02:35.431 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-17T00:02:35.436 INFO:tasks.ceph.osd.6:Started 2023-08-17T00:02:35.437 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-17T00:02:35.437 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-17T00:02:35.445 INFO:tasks.ceph.osd.7:Started 2023-08-17T00:02:35.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:35.453 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:35.444+0000 7fd3cf75f500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-17T00:02:35.564 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:35.558+0000 7f385bd47500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T00:02:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 Processor -- start 2023-08-17T00:02:35.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 -- start start 2023-08-17T00:02:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f42c40c57c0 0x7f42c415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42c40acc70 0x7f42c4158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4063ea0 con 0x7f42c4157d60 2023-08-17T00:02:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c415c9b0 con 0x7f42c40c57c0 2023-08-17T00:02:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40ad3e0 con 0x7f42c40acc70 2023-08-17T00:02:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f42c40c57c0 0x7f42c415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f42c40c57c0 0x7f42c415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43394/0 (socket says 172.21.15.153:43394) 2023-08-17T00:02:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 -- 172.21.15.153:0/29104211 learned_addr learned my addr 172.21.15.153:0/29104211 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 -- 172.21.15.153:0/29104211 >> v2:172.21.15.178:3300/0 conn(0x7f42c40acc70 msgr2=0x7f42c4158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 --2- 172.21.15.153:0/29104211 >> v2:172.21.15.178:3300/0 conn(0x7f42c40acc70 0x7f42c4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 -- 172.21.15.153:0/29104211 >> v1:172.21.15.178:6789/0 conn(0x7f42c4157d60 legacy=0x7f42c40c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 -- 172.21.15.153:0/29104211 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40c0810 con 0x7f42c40c57c0 2023-08-17T00:02:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c1d9b700 1 --2- 172.21.15.153:0/29104211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40c57c0 0x7f42c415c4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f42c4069670 tx=0x7f42b80090f0).ready entity=mon.0 client_cookie=99ba3277b7a867eb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c159a700 1 -- 172.21.15.153:0/29104211 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800b580 con 0x7f42c40c57c0 2023-08-17T00:02:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c159a700 1 -- 172.21.15.153:0/29104211 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b800b6e0 con 0x7f42c40c57c0 2023-08-17T00:02:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.604+0000 7f42c159a700 1 -- 172.21.15.153:0/29104211 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b800ba60 con 0x7f42c40c57c0 2023-08-17T00:02:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- 172.21.15.153:0/29104211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40c57c0 msgr2=0x7f42c415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 --2- 172.21.15.153:0/29104211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40c57c0 0x7f42c415c4c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f42c4069670 tx=0x7f42b80090f0).stop 2023-08-17T00:02:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- 172.21.15.153:0/29104211 shutdown_connections 2023-08-17T00:02:35.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 --2- 172.21.15.153:0/29104211 >> v2:172.21.15.178:3300/0 conn(0x7f42c40acc70 0x7f42c4158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:35.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 --2- 172.21.15.153:0/29104211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40c57c0 0x7f42c415c4c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- 172.21.15.153:0/29104211 >> 172.21.15.153:0/29104211 conn(0x7f42c4062a70 msgr2=0x7f42c40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:35.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- 172.21.15.153:0/29104211 shutdown_connections 2023-08-17T00:02:35.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- 172.21.15.153:0/29104211 wait complete. 2023-08-17T00:02:35.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 Processor -- start 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- start start 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 0x7f42c416b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c40c57c0 0x7f42c41442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c4157d60 0x7f42c415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c416a200 con 0x7f42c40acc70 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c416a4e0 con 0x7f42c4157d60 2023-08-17T00:02:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c416a7c0 con 0x7f42c40c57c0 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.608+0000 7f42c259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 0x7f42c416b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 0x7f42c416b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43404/0 (socket says 172.21.15.153:43404) 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 -- 172.21.15.153:0/355530488 learned_addr learned my addr 172.21.15.153:0/355530488 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c2d9d700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c4157d60 0x7f42c415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c1d9b700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c40c57c0 0x7f42c41442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 -- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c40c57c0 msgr2=0x7f42c41442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c40c57c0 0x7f42c41442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 -- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c4157d60 msgr2=0x7f42c415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c4157d60 0x7f42c415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 -- 172.21.15.153:0/355530488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009370 con 0x7f42c40acc70 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c259c700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 0x7f42c416b2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f42b400b490 tx=0x7f42b4006f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4002320 con 0x7f42c40acc70 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b40024c0 con 0x7f42c40acc70 2023-08-17T00:02:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c416aaa0 con 0x7f42c40acc70 2023-08-17T00:02:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4002880 con 0x7f42c40acc70 2023-08-17T00:02:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c41447a0 con 0x7f42c40acc70 2023-08-17T00:02:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f42b400f030 con 0x7f42c40acc70 2023-08-17T00:02:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f42b4012410 con 0x7f42c40acc70 2023-08-17T00:02:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.612+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c406b4c0 con 0x7f42c40acc70 2023-08-17T00:02:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.616+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f42b4012a90 con 0x7f42c40acc70 2023-08-17T00:02:35.641 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:35.636+0000 7fd3cf75f500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-17T00:02:35.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.728+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42c40aa580 con 0x7f42c40acc70 2023-08-17T00:02:35.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42b27fc700 1 -- 172.21.15.153:0/355530488 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f42b4012c30 con 0x7f42c40acc70 2023-08-17T00:02:35.737 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:35.737 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":10,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:35.342505+0000","last_up_change":"0.000000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:35.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 msgr2=0x7f42c416b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:35.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 0x7f42c416b2a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f42b400b490 tx=0x7f42b4006f00).stop 2023-08-17T00:02:35.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 shutdown_connections 2023-08-17T00:02:35.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42c4157d60 0x7f42c415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42c40c57c0 0x7f42c41442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 --2- 172.21.15.153:0/355530488 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f42c40acc70 0x7f42c416b2a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:35.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 >> 172.21.15.153:0/355530488 conn(0x7f42c4062a70 msgr2=0x7f42c40c8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:35.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 shutdown_connections 2023-08-17T00:02:35.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:35.732+0000 7f42c359e700 1 -- 172.21.15.153:0/355530488 wait complete. 2023-08-17T00:02:35.757 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-17T00:02:35.758 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-17T00:02:35.889 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:35.882+0000 7f385bd47500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T00:02:36.020 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:36.004+0000 7fd3cf75f500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-17T00:02:36.051 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-08-17T00:02:36.044+0000 7f00df4eb080 -1 Falling back to public interface 2023-08-17T00:02:36.051 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-08-17T00:02:36.044+0000 7febdb638080 -1 Falling back to public interface 2023-08-17T00:02:36.051 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-08-17T00:02:36.044+0000 7f00ddc62700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2023-08-17T00:02:36.052 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-08-17T00:02:36.044+0000 7f8260ae0080 -1 Falling back to public interface 2023-08-17T00:02:36.077 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-08-17T00:02:36.062+0000 7f6db9d6e080 -1 Falling back to public interface 2023-08-17T00:02:36.082 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-08-17T00:02:36.076+0000 7f1ee6ee4080 -1 Falling back to public interface 2023-08-17T00:02:36.086 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-08-17T00:02:36.078+0000 7f015d6e6080 -1 Falling back to public interface 2023-08-17T00:02:36.105 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-08-17T00:02:36.094+0000 7fca658fb080 -1 Falling back to public interface 2023-08-17T00:02:36.110 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-08-17T00:02:36.102+0000 7f5907f49080 -1 Falling back to public interface 2023-08-17T00:02:36.130 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:36.122+0000 7f385bd47500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T00:02:36.219 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:36.212+0000 7fd3cf75f500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-17T00:02:36.307 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:36.294+0000 7f385bd47500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T00:02:36.378 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:36.372+0000 7fd3cf75f500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-17T00:02:36.382 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:36.374+0000 7f385bd47500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T00:02:36.451 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:36.444+0000 7fd3cf75f500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-17T00:02:36.565 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:36.585 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:36.578+0000 7f385bd47500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T00:02:36.630 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:36.624+0000 7fd3cf75f500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-17T00:02:36.697 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 Processor -- start 2023-08-17T00:02:36.698 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 -- start start 2023-08-17T00:02:36.699 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900a9e90 0x7f06900c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:36.699 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06900c75e0 0x7f06900c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:36.699 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06900c0ee0 0x7f0690063690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:36.700 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0690154130 con 0x7f06900c0ee0 2023-08-17T00:02:36.700 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900ab1b0 con 0x7f06900c75e0 2023-08-17T00:02:36.700 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.692+0000 7f06966b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06900c1760 con 0x7f06900a9e90 2023-08-17T00:02:36.701 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06900c0ee0 0x7f0690063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:36.701 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0694eb6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06900c75e0 0x7f06900c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:36.701 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06956b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900a9e90 0x7f06900c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06900c0ee0 0x7f0690063690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43412/0 (socket says 172.21.15.153:43412) 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0694eb6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06900c75e0 0x7f06900c09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:53474/0 (socket says 172.21.15.153:53474) 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 -- 172.21.15.153:0/2774983458 learned_addr learned my addr 172.21.15.153:0/2774983458 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 -- 172.21.15.153:0/2774983458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900a9e90 msgr2=0x7f06900c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 --2- 172.21.15.153:0/2774983458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900a9e90 0x7f06900c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 -- 172.21.15.153:0/2774983458 >> v2:172.21.15.178:3300/0 conn(0x7f06900c75e0 msgr2=0x7f06900c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:36.702 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 --2- 172.21.15.153:0/2774983458 >> v2:172.21.15.178:3300/0 conn(0x7f06900c75e0 0x7f06900c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.703 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 -- 172.21.15.153:0/2774983458 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900aab60 con 0x7f06900c0ee0 2023-08-17T00:02:36.703 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0695eb8700 1 --2- 172.21.15.153:0/2774983458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900c0ee0 0x7f0690063690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f06900835c0 tx=0x7f0688009840).ready entity=mon.0 client_cookie=8cb61394d8a943f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:36.704 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0687fff700 1 -- 172.21.15.153:0/2774983458 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800e070 con 0x7f06900c0ee0 2023-08-17T00:02:36.704 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0687fff700 1 -- 172.21.15.153:0/2774983458 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068800b970 con 0x7f06900c0ee0 2023-08-17T00:02:36.704 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f0687fff700 1 -- 172.21.15.153:0/2774983458 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800bcf0 con 0x7f06900c0ee0 2023-08-17T00:02:36.704 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 -- 172.21.15.153:0/2774983458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900c0ee0 msgr2=0x7f0690063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:36.705 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 --2- 172.21.15.153:0/2774983458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900c0ee0 0x7f0690063690 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f06900835c0 tx=0x7f0688009840).stop 2023-08-17T00:02:36.705 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 -- 172.21.15.153:0/2774983458 shutdown_connections 2023-08-17T00:02:36.705 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 --2- 172.21.15.153:0/2774983458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900c0ee0 0x7f0690063690 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.705 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 --2- 172.21.15.153:0/2774983458 >> v2:172.21.15.178:3300/0 conn(0x7f06900c75e0 0x7f06900c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.705 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 --2- 172.21.15.153:0/2774983458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900a9e90 0x7f06900c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.705 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 -- 172.21.15.153:0/2774983458 >> 172.21.15.153:0/2774983458 conn(0x7f06900696d0 msgr2=0x7f0690069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:36.706 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 -- 172.21.15.153:0/2774983458 shutdown_connections 2023-08-17T00:02:36.706 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.696+0000 7f06966b9700 1 -- 172.21.15.153:0/2774983458 wait complete. 2023-08-17T00:02:36.706 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.700+0000 7f06966b9700 1 Processor -- start 2023-08-17T00:02:36.706 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.700+0000 7f06966b9700 1 -- start start 2023-08-17T00:02:36.717 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:36.702+0000 7f385bd47500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T00:02:36.721 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 0x7f06901675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:36.722 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06900c0ee0 0x7f069014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:36.723 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900c75e0 0x7f06900c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:36.723 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0690168550 con 0x7f06900a9e90 2023-08-17T00:02:36.723 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06900c8d10 con 0x7f06900c0ee0 2023-08-17T00:02:36.723 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0690167f90 con 0x7f06900c75e0 2023-08-17T00:02:36.724 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 0x7f06901675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:36.724 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 0x7f06901675b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43420/0 (socket says 172.21.15.153:43420) 2023-08-17T00:02:36.724 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 -- 172.21.15.153:0/3963301699 learned_addr learned my addr 172.21.15.153:0/3963301699 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:36.724 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f0694eb6700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06900c0ee0 0x7f069014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:36.724 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f0695eb8700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900c75e0 0x7f06900c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:36.724 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 -- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900c75e0 msgr2=0x7f06900c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:36.725 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900c75e0 0x7f06900c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.725 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 -- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06900c0ee0 msgr2=0x7f069014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:36.725 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06900c0ee0 0x7f069014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.725 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 -- 172.21.15.153:0/3963301699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688009ae0 con 0x7f06900a9e90 2023-08-17T00:02:36.726 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f0695eb8700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900c75e0 0x7f06900c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:36.726 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06956b7700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 0x7f06901675b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f068c00e950 tx=0x7f068c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:36.726 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00c850 con 0x7f06900a9e90 2023-08-17T00:02:36.726 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00c9b0 con 0x7f06900a9e90 2023-08-17T00:02:36.726 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c00cd30 con 0x7f06900a9e90 2023-08-17T00:02:36.726 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0690168270 con 0x7f06900a9e90 2023-08-17T00:02:36.727 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900c3df0 con 0x7f06900a9e90 2023-08-17T00:02:36.727 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 1) v1 ==== 491+0+0 (secure 0 0 0) 0x7f068c022070 con 0x7f06900a9e90 2023-08-17T00:02:36.727 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.704+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f068c01bb00 con 0x7f06900a9e90 2023-08-17T00:02:36.727 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.708+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06900c8800 con 0x7f06900a9e90 2023-08-17T00:02:36.727 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.708+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73265 (secure 0 0 0) 0x7f068c03ae50 con 0x7f06900a9e90 2023-08-17T00:02:36.745 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:36.740+0000 7fd3cf75f500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-17T00:02:36.781 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.772+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f069006bed0 con 0x7f06900a9e90 2023-08-17T00:02:36.781 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06857fa700 1 -- 172.21.15.153:0/3963301699 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7045 (secure 0 0 0) 0x7f068c029070 con 0x7f06900a9e90 2023-08-17T00:02:36.781 INFO:teuthology.misc.health.smithi153.stdout: 2023-08-17T00:02:36.781 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":10,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:35.342505+0000","last_up_change":"0.000000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:36.782 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 msgr2=0x7f06901675b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:36.782 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 0x7f06901675b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f068c00e950 tx=0x7f068c009060).stop 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 shutdown_connections 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06900c75e0 0x7f06900c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06900c0ee0 0x7f069014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 --2- 172.21.15.153:0/3963301699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06900a9e90 0x7f06901675b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 >> 172.21.15.153:0/3963301699 conn(0x7f06900696d0 msgr2=0x7f0690154270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 shutdown_connections 2023-08-17T00:02:36.783 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:36.776+0000 7f06966b9700 1 -- 172.21.15.153:0/3963301699 wait complete. 2023-08-17T00:02:36.799 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-17T00:02:37.067 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:37.058+0000 7f385bd47500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T00:02:37.080 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:37.076+0000 7fd3cf75f500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-17T00:02:37.143 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:37.134+0000 7f385bd47500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T00:02:37.157 INFO:tasks.ceph.mgr.y.smithi153.stderr:2023-08-17T00:02:37.152+0000 7fd3cf75f500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-17T00:02:38.182 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:38.174+0000 7f383c2da700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-17T00:02:38.182 INFO:tasks.ceph.mgr.x.smithi178.stderr:2023-08-17T00:02:38.174+0000 7f383c2da700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-17T00:02:40.161 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-08-17T00:02:40.153+0000 7f6db9d6e080 -1 osd.4 0 log_to_monitors {default=true} 2023-08-17T00:02:40.200 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-08-17T00:02:40.196+0000 7f00df4eb080 -1 osd.0 0 log_to_monitors {default=true} 2023-08-17T00:02:40.255 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-08-17T00:02:40.248+0000 7febdb638080 -1 osd.3 0 log_to_monitors {default=true} 2023-08-17T00:02:40.275 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-08-17T00:02:40.268+0000 7f1ee6ee4080 -1 osd.1 0 log_to_monitors {default=true} 2023-08-17T00:02:40.282 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-08-17T00:02:40.273+0000 7f015d6e6080 -1 osd.6 0 log_to_monitors {default=true} 2023-08-17T00:02:40.315 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-08-17T00:02:40.308+0000 7f8260ae0080 -1 osd.2 0 log_to_monitors {default=true} 2023-08-17T00:02:40.316 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-08-17T00:02:40.305+0000 7fca658fb080 -1 osd.5 0 log_to_monitors {default=true} 2023-08-17T00:02:40.333 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-08-17T00:02:40.325+0000 7f5907f49080 -1 osd.7 0 log_to_monitors {default=true} 2023-08-17T00:02:41.097 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:02:41.105 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:02:41.206 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-08-17T00:02:41.197+0000 7f6db550e700 -1 osd.4 0 waiting for initial osdmap 2023-08-17T00:02:41.216 INFO:tasks.ceph.osd.4.smithi178.stderr:2023-08-17T00:02:41.205+0000 7f6db2282700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.208 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-08-17T00:02:42.203+0000 7f1ee1dc1700 -1 osd.1 0 waiting for initial osdmap 2023-08-17T00:02:42.210 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-08-17T00:02:42.203+0000 7f825b989700 -1 osd.2 0 waiting for initial osdmap 2023-08-17T00:02:42.210 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-08-17T00:02:42.203+0000 7febd6dd8700 -1 osd.3 0 waiting for initial osdmap 2023-08-17T00:02:42.212 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-08-17T00:02:42.207+0000 7f00da439700 -1 osd.0 0 waiting for initial osdmap 2023-08-17T00:02:42.213 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-08-17T00:02:42.205+0000 7fca608a4700 -1 osd.5 0 waiting for initial osdmap 2023-08-17T00:02:42.214 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-08-17T00:02:42.205+0000 7f015854b700 -1 osd.6 0 waiting for initial osdmap 2023-08-17T00:02:42.214 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-08-17T00:02:42.205+0000 7f59036e9700 -1 osd.7 0 waiting for initial osdmap 2023-08-17T00:02:42.222 INFO:tasks.ceph.osd.6.smithi178.stderr:2023-08-17T00:02:42.213+0000 7f01552bf700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.223 INFO:tasks.ceph.osd.7.smithi178.stderr:2023-08-17T00:02:42.213+0000 7f590045d700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.223 INFO:tasks.ceph.osd.5.smithi178.stderr:2023-08-17T00:02:42.213+0000 7fca5d618700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.224 INFO:tasks.ceph.osd.1.smithi153.stderr:2023-08-17T00:02:42.215+0000 7f1edeb35700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.224 INFO:tasks.ceph.osd.2.smithi153.stderr:2023-08-17T00:02:42.219+0000 7f82586fd700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.225 INFO:tasks.ceph.osd.0.smithi153.stderr:2023-08-17T00:02:42.219+0000 7f00d71ad700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:42.225 INFO:tasks.ceph.osd.3.smithi153.stderr:2023-08-17T00:02:42.219+0000 7febd3b4c700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-17T00:02:43.611 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:43.760 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.751+0000 7f13d99a9700 1 Processor -- start 2023-08-17T00:02:43.760 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.751+0000 7f13d99a9700 1 -- start start 2023-08-17T00:02:43.763 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d99a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13d414e2f0 0x7f13d4150b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:43.763 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d99a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13d4151d20 0x7f13d40c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:43.764 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d99a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40bb3b0 con 0x7f13d414df10 2023-08-17T00:02:43.764 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d99a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d4151180 con 0x7f13d414e2f0 2023-08-17T00:02:43.764 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d99a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d4151460 con 0x7f13d4151d20 2023-08-17T00:02:43.765 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13d414e2f0 0x7f13d4150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:43.765 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13d414e2f0 0x7f13d4150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43448/0 (socket says 172.21.15.153:43448) 2023-08-17T00:02:43.765 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.755+0000 7f13d27fc700 1 -- 172.21.15.153:0/302743639 learned_addr learned my addr 172.21.15.153:0/302743639 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:43.765 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d37fe700 1 --2- 172.21.15.153:0/302743639 >> v2:172.21.15.178:3300/0 conn(0x7f13d4151d20 0x7f13d40c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:43.765 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d27fc700 1 -- 172.21.15.153:0/302743639 >> v2:172.21.15.178:3300/0 conn(0x7f13d4151d20 msgr2=0x7f13d40c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:43.765 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d27fc700 1 --2- 172.21.15.153:0/302743639 >> v2:172.21.15.178:3300/0 conn(0x7f13d4151d20 0x7f13d40c2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.766 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d27fc700 1 -- 172.21.15.153:0/302743639 >> v1:172.21.15.178:6789/0 conn(0x7f13d414df10 legacy=0x7f13d40bcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:43.766 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d27fc700 1 -- 172.21.15.153:0/302743639 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4151740 con 0x7f13d414e2f0 2023-08-17T00:02:43.766 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d27fc700 1 --2- 172.21.15.153:0/302743639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d414e2f0 0x7f13d4150b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f13d4066800 tx=0x7f13c80090f0).ready entity=mon.0 client_cookie=4effc25b366416ef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:43.767 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d1ffb700 1 -- 172.21.15.153:0/302743639 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800b520 con 0x7f13d414e2f0 2023-08-17T00:02:43.767 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d1ffb700 1 -- 172.21.15.153:0/302743639 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800b680 con 0x7f13d414e2f0 2023-08-17T00:02:43.767 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d1ffb700 1 -- 172.21.15.153:0/302743639 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800ba00 con 0x7f13d414e2f0 2023-08-17T00:02:43.767 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 -- 172.21.15.153:0/302743639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d414e2f0 msgr2=0x7f13d4150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:43.767 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 --2- 172.21.15.153:0/302743639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d414e2f0 0x7f13d4150b50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f13d4066800 tx=0x7f13c80090f0).stop 2023-08-17T00:02:43.767 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 -- 172.21.15.153:0/302743639 shutdown_connections 2023-08-17T00:02:43.768 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 --2- 172.21.15.153:0/302743639 >> v2:172.21.15.178:3300/0 conn(0x7f13d4151d20 0x7f13d40c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.768 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 --2- 172.21.15.153:0/302743639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d414e2f0 0x7f13d4150b50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.768 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 -- 172.21.15.153:0/302743639 >> 172.21.15.153:0/302743639 conn(0x7f13d4061fa0 msgr2=0x7f13d40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:43.768 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 -- 172.21.15.153:0/302743639 shutdown_connections 2023-08-17T00:02:43.768 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.759+0000 7f13d99a9700 1 -- 172.21.15.153:0/302743639 wait complete. 2023-08-17T00:02:43.770 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.763+0000 7f13d99a9700 1 Processor -- start 2023-08-17T00:02:43.770 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.763+0000 7f13d99a9700 1 -- start start 2023-08-17T00:02:43.772 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d414df10 0x7f13d40bdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:43.772 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d414e2f0 0x7f13d4143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:43.772 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 0x7f13d41545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:43.772 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d41529a0 con 0x7f13d4151d20 2023-08-17T00:02:43.772 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40be3d0 con 0x7f13d414df10 2023-08-17T00:02:43.772 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d40a8410 con 0x7f13d414e2f0 2023-08-17T00:02:43.773 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 0x7f13d41545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 0x7f13d41545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43456/0 (socket says 172.21.15.153:43456) 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 -- 172.21.15.153:0/3339362835 learned_addr learned my addr 172.21.15.153:0/3339362835 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d2ffd700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d414df10 0x7f13d40bdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d27fc700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d414e2f0 0x7f13d4143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 -- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d414e2f0 msgr2=0x7f13d4143cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d414e2f0 0x7f13d4143cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 -- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d414df10 msgr2=0x7f13d40bdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:43.774 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d414df10 0x7f13d40bdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.775 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 -- 172.21.15.153:0/3339362835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c8009370 con 0x7f13d4151d20 2023-08-17T00:02:43.775 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d27fc700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d414e2f0 0x7f13d4143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:43.775 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d37fe700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 0x7f13d41545d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f13cc009df0 tx=0x7f13cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:43.775 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00cb50 con 0x7f13d4151d20 2023-08-17T00:02:43.776 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc00f040 con 0x7f13d4151d20 2023-08-17T00:02:43.776 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc00cec0 con 0x7f13d4151d20 2023-08-17T00:02:43.776 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d4152350 con 0x7f13d4151d20 2023-08-17T00:02:43.776 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.767+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d41441a0 con 0x7f13d4151d20 2023-08-17T00:02:43.776 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.771+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d41521b0 con 0x7f13d4151d20 2023-08-17T00:02:43.777 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.771+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f13cc013610 con 0x7f13d4151d20 2023-08-17T00:02:43.778 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.771+0000 7f13baffd700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13c005a180 0x7f13c005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:43.778 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.771+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f13cc074460 con 0x7f13d4151d20 2023-08-17T00:02:43.779 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.771+0000 7f13d2ffd700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13c005a180 0x7f13c005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:43.780 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.775+0000 7f13d2ffd700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13c005a180 0x7f13c005c640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f13c4003900 tx=0x7f13c4007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:43.785 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.779+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13d41521b0 con 0x7f13d4151d20 2023-08-17T00:02:43.949 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.943+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d41521b0 con 0x7f13d4151d20 2023-08-17T00:02:43.951 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.943+0000 7f13baffd700 1 -- 172.21.15.153:0/3339362835 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10499 (secure 0 0 0) 0x7f13d41521b0 con 0x7f13d4151d20 2023-08-17T00:02:43.952 INFO:teuthology.misc.health.smithi153.stdout: 2023-08-17T00:02:43.952 INFO:teuthology.misc.health.smithi153.stdout:{"epoch":14,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:43.205525+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:43.953 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13c005a180 msgr2=0x7f13c005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:43.953 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13c005a180 0x7f13c005c640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f13c4003900 tx=0x7f13c4007d40).stop 2023-08-17T00:02:43.954 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 msgr2=0x7f13d41545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:43.954 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 0x7f13d41545d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f13cc009df0 tx=0x7f13cc00b040).stop 2023-08-17T00:02:43.954 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 shutdown_connections 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13c005a180 0x7f13c005c640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13d4151d20 0x7f13d41545d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d414e2f0 0x7f13d4143cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 --2- 172.21.15.153:0/3339362835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d414df10 0x7f13d40bdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 >> 172.21.15.153:0/3339362835 conn(0x7f13d4061fa0 msgr2=0x7f13d414cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 shutdown_connections 2023-08-17T00:02:43.955 INFO:teuthology.misc.health.smithi153.stderr:2023-08-17T00:02:43.947+0000 7f13d99a9700 1 -- 172.21.15.153:0/3339362835 wait complete. 2023-08-17T00:02:43.972 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-17T00:02:43.973 INFO:tasks.ceph:Creating RBD pool 2023-08-17T00:02:43.973 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-17T00:02:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c38cb9700 1 Processor -- start 2023-08-17T00:02:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c38cb9700 1 -- start start 2023-08-17T00:02:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c38cb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c340c57a0 0x7f4c340c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c38cb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c340bfd10 con 0x7f4c340c11b0 2023-08-17T00:02:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c38cb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c34158420 con 0x7f4c34153f50 2023-08-17T00:02:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c38cb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c34154af0 con 0x7f4c340c57a0 2023-08-17T00:02:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c340c57a0 0x7f4c340c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c340c57a0 0x7f4c340c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43460/0 (socket says 172.21.15.153:43460) 2023-08-17T00:02:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 -- 172.21.15.153:0/528361596 learned_addr learned my addr 172.21.15.153:0/528361596 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:44.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 -- 172.21.15.153:0/528361596 >> v1:172.21.15.178:6789/0 conn(0x7f4c34153f50 legacy=0x7f4c34157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:44.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 -- 172.21.15.153:0/528361596 >> v1:172.21.15.153:6789/0 conn(0x7f4c340c11b0 legacy=0x7f4c34157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 -- 172.21.15.153:0/528361596 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34154dd0 con 0x7f4c340c57a0 2023-08-17T00:02:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.119+0000 7f4c337fe700 1 --2- 172.21.15.153:0/528361596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c5b80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4c24006fd0 tx=0x7f4c240090f0).ready entity=mon.0 client_cookie=3fcd0982dd238d9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c32ffd700 1 -- 172.21.15.153:0/528361596 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400b600 con 0x7f4c340c57a0 2023-08-17T00:02:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c32ffd700 1 -- 172.21.15.153:0/528361596 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2400b760 con 0x7f4c340c57a0 2023-08-17T00:02:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c32ffd700 1 -- 172.21.15.153:0/528361596 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400bae0 con 0x7f4c340c57a0 2023-08-17T00:02:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 -- 172.21.15.153:0/528361596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 msgr2=0x7f4c340c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/528361596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c5b80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f4c24006fd0 tx=0x7f4c240090f0).stop 2023-08-17T00:02:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 -- 172.21.15.153:0/528361596 shutdown_connections 2023-08-17T00:02:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/528361596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c5b80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 -- 172.21.15.153:0/528361596 >> 172.21.15.153:0/528361596 conn(0x7f4c34062a70 msgr2=0x7f4c340ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:44.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 -- 172.21.15.153:0/528361596 shutdown_connections 2023-08-17T00:02:44.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 -- 172.21.15.153:0/528361596 wait complete. 2023-08-17T00:02:44.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.123+0000 7f4c38cb9700 1 Processor -- start 2023-08-17T00:02:44.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 -- start start 2023-08-17T00:02:44.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c340c11b0 0x7f4c34146830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c34153f50 0x7f4c34168510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340c7840 con 0x7f4c340c57a0 2023-08-17T00:02:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c34168080 con 0x7f4c34153f50 2023-08-17T00:02:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340c7280 con 0x7f4c340c11b0 2023-08-17T00:02:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43476/0 (socket says 172.21.15.153:43476) 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 -- 172.21.15.153:0/3844146412 learned_addr learned my addr 172.21.15.153:0/3844146412 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c337fe700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c340c11b0 0x7f4c34146830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c33fff700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c34153f50 0x7f4c34168510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 -- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c340c11b0 msgr2=0x7f4c34146830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c340c11b0 0x7f4c34146830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 -- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c34153f50 msgr2=0x7f4c34168510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c34153f50 0x7f4c34168510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 -- 172.21.15.153:0/3844146412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009370 con 0x7f4c340c57a0 2023-08-17T00:02:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2affd700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c9ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4c1c00b460 tx=0x7f4c1c006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c012410 con 0x7f4c340c57a0 2023-08-17T00:02:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c0125b0 con 0x7f4c340c57a0 2023-08-17T00:02:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c012970 con 0x7f4c340c57a0 2023-08-17T00:02:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c340c7560 con 0x7f4c340c57a0 2023-08-17T00:02:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.127+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c340ca3b0 con 0x7f4c340c57a0 2023-08-17T00:02:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.131+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c341681f0 con 0x7f4c340c57a0 2023-08-17T00:02:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.131+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4c1c00f030 con 0x7f4c340c57a0 2023-08-17T00:02:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.131+0000 7f4c2bfff700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1405a180 0x7f4c1405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:44.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.131+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7f4c1c073590 con 0x7f4c340c57a0 2023-08-17T00:02:44.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.135+0000 7f4c337fe700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1405a180 0x7f4c1405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:44.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.135+0000 7f4c337fe700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1405a180 0x7f4c1405c640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4c24009130 tx=0x7f4c24017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.139+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c1c047690 con 0x7f4c340c57a0 2023-08-17T00:02:44.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:44.303+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f4c3406b4c0 con 0x7f4c340c57a0 2023-08-17T00:02:45.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.235+0000 7f4c2bfff700 1 -- 172.21.15.153:0/3844146412 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4c1c04acb0 con 0x7f4c340c57a0 2023-08-17T00:02:45.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1405a180 msgr2=0x7f4c1405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:45.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1405a180 0x7f4c1405c640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f4c24009130 tx=0x7f4c24017000).stop 2023-08-17T00:02:45.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 msgr2=0x7f4c340c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c9ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f4c1c00b460 tx=0x7f4c1c006f20).stop 2023-08-17T00:02:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 shutdown_connections 2023-08-17T00:02:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1405a180 0x7f4c1405c640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c34153f50 0x7f4c34168510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c340c57a0 0x7f4c340c9ec0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 --2- 172.21.15.153:0/3844146412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c340c11b0 0x7f4c34146830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.239+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 >> 172.21.15.153:0/3844146412 conn(0x7f4c34062a70 msgr2=0x7f4c340aa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.243+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 shutdown_connections 2023-08-17T00:02:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.243+0000 7f4c38cb9700 1 -- 172.21.15.153:0/3844146412 wait complete. 2023-08-17T00:02:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'rbd' created 2023-08-17T00:02:45.270 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-17T00:02:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.411+0000 7fdab0af1700 1 Processor -- start 2023-08-17T00:02:45.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.411+0000 7fdab0af1700 1 -- start start 2023-08-17T00:02:45.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.415+0000 7fdab0af1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdaac0ad250 0x7fdaac0c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:45.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.415+0000 7fdab0af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:45.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.415+0000 7fdab0af1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaac155170 con 0x7fdaac0bfe50 2023-08-17T00:02:45.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.415+0000 7fdab0af1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaac0ad630 con 0x7fdaac0ad250 2023-08-17T00:02:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.415+0000 7fdab0af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac0c02e0 con 0x7fdaac0626b0 2023-08-17T00:02:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.415+0000 7fdaaa59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdaac0ad250 0x7fdaac0c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaa3fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fdaac0bfe50 0x7fdaac061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:54528/0 (socket says 172.21.15.153:54528) 2023-08-17T00:02:45.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaa3fff700 1 -- 172.21.15.153:0/3386087067 learned_addr learned my addr 172.21.15.153:0/3386087067 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaaad9d700 1 --2- 172.21.15.153:0/3386087067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaa9d9b700 1 -- 172.21.15.153:0/3386087067 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432387325 0 0) 0x7fdaac155170 con 0x7fdaac0bfe50 2023-08-17T00:02:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaaa59c700 1 -- 172.21.15.153:0/3386087067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 msgr2=0x7fdaac154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaaa59c700 1 --2- 172.21.15.153:0/3386087067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaaa59c700 1 -- 172.21.15.153:0/3386087067 >> v1:172.21.15.178:6789/0 conn(0x7fdaac0bfe50 legacy=0x7fdaac061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaaa59c700 1 -- 172.21.15.153:0/3386087067 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0c04c0 con 0x7fdaac0ad250 2023-08-17T00:02:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaaa59c700 1 --2- 172.21.15.153:0/3386087067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0ad250 0x7fdaac0c1560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fda9c009760 tx=0x7fda9c009060).ready entity=mon.0 client_cookie=37cc91bfcfb81e09 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaa9d9b700 1 -- 172.21.15.153:0/3386087067 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0090d0 con 0x7fdaac0ad250 2023-08-17T00:02:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaa9d9b700 1 -- 172.21.15.153:0/3386087067 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda9c00f510 con 0x7fdaac0ad250 2023-08-17T00:02:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdaa9d9b700 1 -- 172.21.15.153:0/3386087067 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda9c00f890 con 0x7fdaac0ad250 2023-08-17T00:02:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 -- 172.21.15.153:0/3386087067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0ad250 msgr2=0x7fdaac0c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3386087067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0ad250 0x7fdaac0c1560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fda9c009760 tx=0x7fda9c009060).stop 2023-08-17T00:02:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 -- 172.21.15.153:0/3386087067 shutdown_connections 2023-08-17T00:02:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3386087067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3386087067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0ad250 0x7fdaac0c1560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 -- 172.21.15.153:0/3386087067 >> 172.21.15.153:0/3386087067 conn(0x7fdaac0caa10 msgr2=0x7fdaac0cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 -- 172.21.15.153:0/3386087067 shutdown_connections 2023-08-17T00:02:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.419+0000 7fdab0af1700 1 -- 172.21.15.153:0/3386087067 wait complete. 2023-08-17T00:02:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 Processor -- start 2023-08-17T00:02:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 -- start start 2023-08-17T00:02:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac13ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 0x7fdaac165210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaac165700 0x7fdaac164040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac164fc0 con 0x7fdaac0bfe50 2023-08-17T00:02:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac164a00 con 0x7fdaac165700 2023-08-17T00:02:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac164ce0 con 0x7fdaac0626b0 2023-08-17T00:02:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 0x7fdaac165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 0x7fdaac165210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33436/0 (socket says 172.21.15.153:33436) 2023-08-17T00:02:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 -- 172.21.15.153:0/3140104572 learned_addr learned my addr 172.21.15.153:0/3140104572 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:45.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaaad9d700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaac165700 0x7fdaac164040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:45.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaaa59c700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac13ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:45.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 -- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 msgr2=0x7fdaac13ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac13ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 -- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaac165700 msgr2=0x7fdaac164040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaac165700 0x7fdaac164040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 -- 172.21.15.153:0/3140104572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0092a0 con 0x7fdaac0bfe50 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaaad9d700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaac165700 0x7fdaac164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa3fff700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 0x7fdaac165210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fda9400c4e0 tx=0x7fda94007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940072e0 con 0x7fdaac0bfe50 2023-08-17T00:02:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda94007440 con 0x7fdaac0bfe50 2023-08-17T00:02:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940057a0 con 0x7fdaac0bfe50 2023-08-17T00:02:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaac0c3b60 con 0x7fdaac0bfe50 2023-08-17T00:02:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.423+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac13f460 con 0x7fdaac0bfe50 2023-08-17T00:02:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.427+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac0c39c0 con 0x7fdaac0bfe50 2023-08-17T00:02:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.427+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fda94010070 con 0x7fdaac0bfe50 2023-08-17T00:02:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.427+0000 7fdaa27fc700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda8c05a150 0x7fda8c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.427+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5258+0+0 (secure 0 0 0) 0x7fda94073740 con 0x7fdaac0bfe50 2023-08-17T00:02:45.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.431+0000 7fdaaa59c700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda8c05a150 0x7fda8c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:45.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.431+0000 7fdaaa59c700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda8c05a150 0x7fda8c05c610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fdaac05e9f0 tx=0x7fda9c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:45.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.435+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdaac0c39c0 con 0x7fdaac0bfe50 2023-08-17T00:02:45.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:45.599+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdaac06b530 con 0x7fdaac0bfe50 2023-08-17T00:02:46.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.255+0000 7fdaa27fc700 1 -- 172.21.15.153:0/3140104572 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7fda94047440 con 0x7fdaac0bfe50 2023-08-17T00:02:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda8c05a150 msgr2=0x7fda8c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda8c05a150 0x7fda8c05c610 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fdaac05e9f0 tx=0x7fda9c017000).stop 2023-08-17T00:02:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 msgr2=0x7fdaac165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 0x7fdaac165210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fda9400c4e0 tx=0x7fda94007c70).stop 2023-08-17T00:02:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 shutdown_connections 2023-08-17T00:02:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda8c05a150 0x7fda8c05c610 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdaac165700 0x7fdaac164040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdaac0bfe50 0x7fdaac165210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 --2- 172.21.15.153:0/3140104572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdaac0626b0 0x7fdaac13ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 >> 172.21.15.153:0/3140104572 conn(0x7fdaac0caa10 msgr2=0x7fdaac0c74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 shutdown_connections 2023-08-17T00:02:46.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.259+0000 7fdab0af1700 1 -- 172.21.15.153:0/3140104572 wait complete. 2023-08-17T00:02:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-17T00:02:46.287 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-17T00:02:46.288 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:02:46.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:02:46.296 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:02:46.297 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:02:46.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:02:46.302 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:02:46.303 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:02:46.303 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:02:46.311 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:02:46.312 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:02:46.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:02:46.316 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:02:46.317 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-17T00:02:46.318 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:46.399 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:02:46.408 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:02:46.423 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:02:46.425 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:02:46.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.471+0000 7f2e7a279700 1 Processor -- start 2023-08-17T00:02:46.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.475+0000 7f2e7a279700 1 -- start start 2023-08-17T00:02:46.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.475+0000 7f2e7a279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.475+0000 7f2e7a279700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e740c01a0 0x7f2e740c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.475+0000 7f2e7a279700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e740bfd10 con 0x7f2e740c57a0 2023-08-17T00:02:46.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.475+0000 7f2e7a279700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e74154860 con 0x7f2e740c01a0 2023-08-17T00:02:46.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.475+0000 7f2e7a279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74154af0 con 0x7f2e74153f50 2023-08-17T00:02:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e78a76700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79277700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2e740c57a0 0x7f2e740c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:54562/0 (socket says 172.21.15.153:54562) 2023-08-17T00:02:46.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79277700 1 -- 172.21.15.153:0/2081204869 learned_addr learned my addr 172.21.15.153:0/2081204869 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79a78700 1 --2- 172.21.15.153:0/2081204869 >> v2:172.21.15.178:3300/0 conn(0x7f2e740c01a0 0x7f2e740c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79a78700 1 -- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 msgr2=0x7f2e74154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79a78700 1 --2- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79a78700 1 -- 172.21.15.153:0/2081204869 >> v1:172.21.15.178:6789/0 conn(0x7f2e740c57a0 legacy=0x7f2e740c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79a78700 1 -- 172.21.15.153:0/2081204869 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74154dd0 con 0x7f2e740c01a0 2023-08-17T00:02:46.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e79a78700 1 --2- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e740c0630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2e6c009e60 tx=0x7f2e6c009780).ready entity=mon.1 client_cookie=fdf197b9887de063 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:46.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e6bfff700 1 -- 172.21.15.153:0/2081204869 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c00e070 con 0x7f2e740c01a0 2023-08-17T00:02:46.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e6bfff700 1 -- 172.21.15.153:0/2081204869 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c00bb60 con 0x7f2e740c01a0 2023-08-17T00:02:46.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e6bfff700 1 -- 172.21.15.153:0/2081204869 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c012410 con 0x7f2e740c01a0 2023-08-17T00:02:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 -- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 msgr2=0x7f2e740c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e740c0630 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2e6c009e60 tx=0x7f2e6c009780).stop 2023-08-17T00:02:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 -- 172.21.15.153:0/2081204869 shutdown_connections 2023-08-17T00:02:46.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e740c0630 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2081204869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 -- 172.21.15.153:0/2081204869 >> 172.21.15.153:0/2081204869 conn(0x7f2e74062a70 msgr2=0x7f2e740ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:46.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 -- 172.21.15.153:0/2081204869 shutdown_connections 2023-08-17T00:02:46.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.479+0000 7f2e7a279700 1 -- 172.21.15.153:0/2081204869 wait complete. 2023-08-17T00:02:46.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.483+0000 7f2e7a279700 1 Processor -- start 2023-08-17T00:02:46.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.483+0000 7f2e7a279700 1 -- start start 2023-08-17T00:02:46.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e7a279700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e741433a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e7a279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 0x7f2e74063390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e7a279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e7a279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e74063d70 con 0x7f2e740c57a0 2023-08-17T00:02:46.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e7a279700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740aee80 con 0x7f2e740c01a0 2023-08-17T00:02:46.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e7a279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740ae270 con 0x7f2e74153f50 2023-08-17T00:02:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 0x7f2e74063390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 0x7f2e74063390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33478/0 (socket says 172.21.15.153:33478) 2023-08-17T00:02:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 -- 172.21.15.153:0/2278447915 learned_addr learned my addr 172.21.15.153:0/2278447915 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e79a78700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e79277700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e741433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 -- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 msgr2=0x7f2e74063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74063880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 -- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 msgr2=0x7f2e741433a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e741433a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 -- 172.21.15.153:0/2278447915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009a20 con 0x7f2e740c57a0 2023-08-17T00:02:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.487+0000 7f2e78a76700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 0x7f2e74063390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2e6400e930 tx=0x7f2e64009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.491+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64012600 con 0x7f2e740c57a0 2023-08-17T00:02:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.491+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64012760 con 0x7f2e740c57a0 2023-08-17T00:02:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.491+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e740ae550 con 0x7f2e740c57a0 2023-08-17T00:02:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.491+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64012ae0 con 0x7f2e740c57a0 2023-08-17T00:02:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.491+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740aeb10 con 0x7f2e740c57a0 2023-08-17T00:02:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.491+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740af030 con 0x7f2e740c57a0 2023-08-17T00:02:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.495+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2e64022070 con 0x7f2e740c57a0 2023-08-17T00:02:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.495+0000 7f2e697fa700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e5805a150 0x7f2e5805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.495+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2e64074120 con 0x7f2e740c57a0 2023-08-17T00:02:46.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.495+0000 7f2e79277700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e5805a150 0x7f2e5805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.499+0000 7f2e79277700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e5805a150 0x7f2e5805c610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2e70007fd0 tx=0x7f2e70009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:46.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.503+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e740af030 con 0x7f2e740c57a0 2023-08-17T00:02:46.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.659+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e740aeff0 con 0x7f2e740c57a0 2023-08-17T00:02:46.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.659+0000 7f2e697fa700 1 -- 172.21.15.153:0/2278447915 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f2e64047e10 con 0x7f2e740c57a0 2023-08-17T00:02:46.668 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:46.668 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":17,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:46.245992+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:46.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e5805a150 msgr2=0x7f2e5805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e5805a150 0x7f2e5805c610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2e70007fd0 tx=0x7f2e70009040).stop 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 msgr2=0x7f2e74063390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 0x7f2e74063390 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f2e6400e930 tx=0x7f2e64009060).stop 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 shutdown_connections 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e5805a150 0x7f2e5805c610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e74153f50 0x7f2e74063880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e740c57a0 0x7f2e74063390 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 --2- 172.21.15.153:0/2278447915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e740c01a0 0x7f2e741433a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 >> 172.21.15.153:0/2278447915 conn(0x7f2e74062a70 msgr2=0x7f2e74156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 shutdown_connections 2023-08-17T00:02:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.663+0000 7f2e7a279700 1 -- 172.21.15.153:0/2278447915 wait complete. 2023-08-17T00:02:46.691 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:02:46.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:02:46.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.847+0000 7f2a58ddb700 1 Processor -- start 2023-08-17T00:02:46.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.847+0000 7f2a58ddb700 1 -- start start 2023-08-17T00:02:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a58ddb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a54064870 0x7f2a54064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a58ddb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a54061fa0 con 0x7f2a54151b90 2023-08-17T00:02:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a58ddb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a541523d0 con 0x7f2a54151f70 2023-08-17T00:02:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a58ddb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540c3fb0 con 0x7f2a54064870 2023-08-17T00:02:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2a54151b90 0x7f2a54063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33580/0 (socket says 172.21.15.153:33580) 2023-08-17T00:02:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5259c700 1 -- 172.21.15.153:0/3415245905 learned_addr learned my addr 172.21.15.153:0/3415245905 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:46.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a52d9d700 1 --2- 172.21.15.153:0/3415245905 >> v2:172.21.15.153:3300/0 conn(0x7f2a54064870 0x7f2a54064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890255360 0 0) 0x7f2a54061fa0 con 0x7f2a54151b90 2023-08-17T00:02:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a3c0033f0 con 0x7f2a54151b90 2023-08-17T00:02:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009605079 0 0) 0x7f2a541523d0 con 0x7f2a54151f70 2023-08-17T00:02:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a54061fa0 con 0x7f2a54151f70 2023-08-17T00:02:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a52d9d700 1 -- 172.21.15.153:0/3415245905 >> v1:172.21.15.178:6789/0 conn(0x7f2a54151f70 legacy=0x7f2a54065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a52d9d700 1 -- 172.21.15.153:0/3415245905 >> v1:172.21.15.153:6789/0 conn(0x7f2a54151b90 legacy=0x7f2a54063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117619519 0 0) 0x7f2a3c0033f0 con 0x7f2a54151b90 2023-08-17T00:02:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a52d9d700 1 -- 172.21.15.153:0/3415245905 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a540651b0 con 0x7f2a54064870 2023-08-17T00:02:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.851+0000 7f2a52d9d700 1 --2- 172.21.15.153:0/3415245905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54064870 0x7f2a54064cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2a4c009e60 tx=0x7f2a4c009780).ready entity=mon.0 client_cookie=1d3df1eda6b51872 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00e070 con 0x7f2a54064870 2023-08-17T00:02:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00b7a0 con 0x7f2a54064870 2023-08-17T00:02:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a5159a700 1 -- 172.21.15.153:0/3415245905 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44001470 con 0x7f2a54064870 2023-08-17T00:02:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3415245905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54064870 msgr2=0x7f2a54064cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3415245905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54064870 0x7f2a54064cc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f2a4c009e60 tx=0x7f2a4c009780).stop 2023-08-17T00:02:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3415245905 shutdown_connections 2023-08-17T00:02:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3415245905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54064870 0x7f2a54064cc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3415245905 >> 172.21.15.153:0/3415245905 conn(0x7f2a540c7150 msgr2=0x7f2a540c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3415245905 shutdown_connections 2023-08-17T00:02:46.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3415245905 wait complete. 2023-08-17T00:02:46.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 Processor -- start 2023-08-17T00:02:46.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.855+0000 7f2a58ddb700 1 -- start start 2023-08-17T00:02:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a54064870 0x7f2a540bf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 0x7f2a5414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a54151f70 0x7f2a540bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540a7d90 con 0x7f2a54151b90 2023-08-17T00:02:46.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540be290 con 0x7f2a54064870 2023-08-17T00:02:46.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540be570 con 0x7f2a54151f70 2023-08-17T00:02:46.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 0x7f2a5414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 0x7f2a5414c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33492/0 (socket says 172.21.15.153:33492) 2023-08-17T00:02:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 -- 172.21.15.153:0/3355231365 learned_addr learned my addr 172.21.15.153:0/3355231365 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a52d9d700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a54151f70 0x7f2a540bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a5259c700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a54064870 0x7f2a540bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 -- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a54151f70 msgr2=0x7f2a540bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a54151f70 0x7f2a540bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 -- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a54064870 msgr2=0x7f2a540bf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:46.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a54064870 0x7f2a540bf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:46.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 -- 172.21.15.153:0/3355231365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c009a20 con 0x7f2a54151b90 2023-08-17T00:02:46.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a51d9b700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 0x7f2a5414c360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2a4800c440 tx=0x7f2a48007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:46.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800f470 con 0x7f2a54151b90 2023-08-17T00:02:46.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4800f5d0 con 0x7f2a54151b90 2023-08-17T00:02:46.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4800f990 con 0x7f2a54151b90 2023-08-17T00:02:46.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a540be850 con 0x7f2a54151b90 2023-08-17T00:02:46.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.859+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a540bee10 con 0x7f2a54151b90 2023-08-17T00:02:46.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.863+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5406b530 con 0x7f2a54151b90 2023-08-17T00:02:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.863+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2a48019030 con 0x7f2a54151b90 2023-08-17T00:02:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.863+0000 7f2a427fc700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a3405a150 0x7f2a3405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.863+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2a48073350 con 0x7f2a54151b90 2023-08-17T00:02:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.863+0000 7f2a5259c700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a3405a150 0x7f2a3405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.867+0000 7f2a5259c700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a3405a150 0x7f2a3405c610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2a44001660 tx=0x7f2a440014e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:46.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:46.871+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a48047040 con 0x7f2a54151b90 2023-08-17T00:02:47.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.031+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2a540c3ab0 con 0x7f2a54151b90 2023-08-17T00:02:47.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.031+0000 7f2a427fc700 1 -- 172.21.15.153:0/3355231365 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2a4804a660 con 0x7f2a54151b90 2023-08-17T00:02:47.038 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:02:47.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a3405a150 msgr2=0x7f2a3405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a3405a150 0x7f2a3405c610 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2a44001660 tx=0x7f2a440014e0).stop 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 msgr2=0x7f2a5414c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 0x7f2a5414c360 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2a4800c440 tx=0x7f2a48007c90).stop 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 shutdown_connections 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a3405a150 0x7f2a3405c610 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a54151f70 0x7f2a540bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a54151b90 0x7f2a5414c360 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 --2- 172.21.15.153:0/3355231365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a54064870 0x7f2a540bf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 >> 172.21.15.153:0/3355231365 conn(0x7f2a540c7150 msgr2=0x7f2a540c4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:47.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 shutdown_connections 2023-08-17T00:02:47.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.035+0000 7f2a58ddb700 1 -- 172.21.15.153:0/3355231365 wait complete. 2023-08-17T00:02:47.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:02:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.211+0000 7fb6588f0700 1 Processor -- start 2023-08-17T00:02:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.211+0000 7fb6588f0700 1 -- start start 2023-08-17T00:02:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.211+0000 7fb6588f0700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb654153f50 0x7fb654154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.211+0000 7fb6588f0700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540bfd10 con 0x7fb6540c01a0 2023-08-17T00:02:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.211+0000 7fb6588f0700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb654154860 con 0x7fb6540c57a0 2023-08-17T00:02:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.211+0000 7fb6588f0700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb654154af0 con 0x7fb654153f50 2023-08-17T00:02:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb65359e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb6540c01a0 0x7fb6540c0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33596/0 (socket says 172.21.15.153:33596) 2023-08-17T00:02:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb65359e700 1 -- 172.21.15.153:0/1277930294 learned_addr learned my addr 172.21.15.153:0/1277930294 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb64bfff700 1 --2- 172.21.15.153:0/1277930294 >> v2:172.21.15.153:3300/0 conn(0x7fb654153f50 0x7fb654154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb64bfff700 1 -- 172.21.15.153:0/1277930294 >> v1:172.21.15.178:6789/0 conn(0x7fb6540c57a0 legacy=0x7fb6540c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb64bfff700 1 -- 172.21.15.153:0/1277930294 >> v1:172.21.15.153:6789/0 conn(0x7fb6540c01a0 legacy=0x7fb6540c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb64bfff700 1 -- 172.21.15.153:0/1277930294 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb654154dd0 con 0x7fb654153f50 2023-08-17T00:02:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb65259c700 1 -- 172.21.15.153:0/1277930294 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524261053 0 0) 0x7fb6540bfd10 con 0x7fb6540c01a0 2023-08-17T00:02:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb64bfff700 1 --2- 172.21.15.153:0/1277930294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654153f50 0x7fb654154370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb63c009760 tx=0x7fb63c009060).ready entity=mon.0 client_cookie=ed7199214435ec3b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb65259c700 1 -- 172.21.15.153:0/1277930294 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00b580 con 0x7fb654153f50 2023-08-17T00:02:47.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb65259c700 1 -- 172.21.15.153:0/1277930294 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00b6e0 con 0x7fb654153f50 2023-08-17T00:02:47.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb65259c700 1 -- 172.21.15.153:0/1277930294 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00ba60 con 0x7fb654153f50 2023-08-17T00:02:47.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 -- 172.21.15.153:0/1277930294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654153f50 msgr2=0x7fb654154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 --2- 172.21.15.153:0/1277930294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654153f50 0x7fb654154370 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fb63c009760 tx=0x7fb63c009060).stop 2023-08-17T00:02:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 -- 172.21.15.153:0/1277930294 shutdown_connections 2023-08-17T00:02:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 --2- 172.21.15.153:0/1277930294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb654153f50 0x7fb654154370 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 -- 172.21.15.153:0/1277930294 >> 172.21.15.153:0/1277930294 conn(0x7fb654062a70 msgr2=0x7fb6540ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 -- 172.21.15.153:0/1277930294 shutdown_connections 2023-08-17T00:02:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.215+0000 7fb6588f0700 1 -- 172.21.15.153:0/1277930294 wait complete. 2023-08-17T00:02:47.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 Processor -- start 2023-08-17T00:02:47.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 -- start start 2023-08-17T00:02:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6540c01a0 0x7fb65414a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 0x7fb6540c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb654153f50 0x7fb6540c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c4610 con 0x7fb6540c57a0 2023-08-17T00:02:47.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65414a8f0 con 0x7fb6540c01a0 2023-08-17T00:02:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb6588f0700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c3a00 con 0x7fb654153f50 2023-08-17T00:02:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb64bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 0x7fb6540c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb64bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 0x7fb6540c3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33506/0 (socket says 172.21.15.153:33506) 2023-08-17T00:02:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb64bfff700 1 -- 172.21.15.153:0/491784491 learned_addr learned my addr 172.21.15.153:0/491784491 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.219+0000 7fb652d9d700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6540c01a0 0x7fb65414a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb65359e700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb654153f50 0x7fb6540c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64bfff700 1 -- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb654153f50 msgr2=0x7fb6540c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64bfff700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb654153f50 0x7fb6540c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64bfff700 1 -- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6540c01a0 msgr2=0x7fb65414a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64bfff700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6540c01a0 0x7fb65414a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64bfff700 1 -- 172.21.15.153:0/491784491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0092a0 con 0x7fb6540c57a0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64bfff700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 0x7fb6540c3040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb63c009eb0 tx=0x7fb63c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00b850 con 0x7fb6540c57a0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c00b9b0 con 0x7fb6540c57a0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540c3ce0 con 0x7fb6540c57a0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c01b620 con 0x7fb6540c57a0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540c42a0 con 0x7fb6540c57a0 2023-08-17T00:02:47.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6540c4780 con 0x7fb6540c57a0 2023-08-17T00:02:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.223+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb63c02b070 con 0x7fb6540c57a0 2023-08-17T00:02:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.227+0000 7fb64affd700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb63405a120 0x7fb63405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.227+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb63c0757a0 con 0x7fb6540c57a0 2023-08-17T00:02:47.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.227+0000 7fb652d9d700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb63405a120 0x7fb63405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.227+0000 7fb652d9d700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb63405a120 0x7fb63405c5e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb644003860 tx=0x7fb644007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.231+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb63c049490 con 0x7fb6540c57a0 2023-08-17T00:02:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.391+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb65406b4c0 con 0x7fb6540c57a0 2023-08-17T00:02:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb64affd700 1 -- 172.21.15.153:0/491784491 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb63c0290a0 con 0x7fb6540c57a0 2023-08-17T00:02:47.401 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:02:47.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb63405a120 msgr2=0x7fb63405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb63405a120 0x7fb63405c5e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fb644003860 tx=0x7fb644007d40).stop 2023-08-17T00:02:47.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 msgr2=0x7fb6540c3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 0x7fb6540c3040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fb63c009eb0 tx=0x7fb63c017000).stop 2023-08-17T00:02:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 shutdown_connections 2023-08-17T00:02:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb63405a120 0x7fb63405c5e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb654153f50 0x7fb6540c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6540c57a0 0x7fb6540c3040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 --2- 172.21.15.153:0/491784491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6540c01a0 0x7fb65414a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 >> 172.21.15.153:0/491784491 conn(0x7fb654062a70 msgr2=0x7fb6540aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 shutdown_connections 2023-08-17T00:02:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.395+0000 7fb6588f0700 1 -- 172.21.15.153:0/491784491 wait complete. 2023-08-17T00:02:47.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:02:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.571+0000 7fcdaa01b700 1 Processor -- start 2023-08-17T00:02:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.571+0000 7fcdaa01b700 1 -- start start 2023-08-17T00:02:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4151b90 0x7fcda4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcda4063290 0x7fcda4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcda4065b50 0x7fcda4064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda40c3fb0 con 0x7fcda4065b50 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda4152460 con 0x7fcda4063290 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda4061fa0 con 0x7fcda4151b90 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcda4065b50 0x7fcda4064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcda4065b50 0x7fcda4064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33516/0 (socket says 172.21.15.153:33516) 2023-08-17T00:02:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 -- 172.21.15.153:0/169374352 learned_addr learned my addr 172.21.15.153:0/169374352 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda37fe700 1 --2- 172.21.15.153:0/169374352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4151b90 0x7fcda4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 -- 172.21.15.153:0/169374352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4151b90 msgr2=0x7fcda4151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 --2- 172.21.15.153:0/169374352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4151b90 0x7fcda4151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcd9affd700 1 --2- 172.21.15.153:0/169374352 >> v2:172.21.15.178:3300/0 conn(0x7fcda4063290 0x7fcda4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 -- 172.21.15.153:0/169374352 >> v2:172.21.15.178:3300/0 conn(0x7fcda4063290 msgr2=0x7fcda4065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 --2- 172.21.15.153:0/169374352 >> v2:172.21.15.178:3300/0 conn(0x7fcda4063290 0x7fcda4065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 -- 172.21.15.153:0/169374352 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda40621f0 con 0x7fcda4065b50 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcd9affd700 1 --2- 172.21.15.153:0/169374352 >> v2:172.21.15.178:3300/0 conn(0x7fcda4063290 0x7fcda4065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda3fff700 1 --2- 172.21.15.153:0/169374352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4065b50 0x7fcda4064870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fcda4068340 tx=0x7fcd9c0090f0).ready entity=mon.0 client_cookie=e5ed39e85b38330b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda2ffd700 1 -- 172.21.15.153:0/169374352 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00b600 con 0x7fcda4065b50 2023-08-17T00:02:47.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda2ffd700 1 -- 172.21.15.153:0/169374352 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c00b760 con 0x7fcda4065b50 2023-08-17T00:02:47.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcda2ffd700 1 -- 172.21.15.153:0/169374352 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00bae0 con 0x7fcda4065b50 2023-08-17T00:02:47.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- 172.21.15.153:0/169374352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4065b50 msgr2=0x7fcda4064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/169374352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4065b50 0x7fcda4064870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fcda4068340 tx=0x7fcd9c0090f0).stop 2023-08-17T00:02:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- 172.21.15.153:0/169374352 shutdown_connections 2023-08-17T00:02:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/169374352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4065b50 0x7fcda4064870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/169374352 >> v2:172.21.15.178:3300/0 conn(0x7fcda4063290 0x7fcda4065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/169374352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4151b90 0x7fcda4151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- 172.21.15.153:0/169374352 >> 172.21.15.153:0/169374352 conn(0x7fcda40c7150 msgr2=0x7fcda40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- 172.21.15.153:0/169374352 shutdown_connections 2023-08-17T00:02:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.575+0000 7fcdaa01b700 1 -- 172.21.15.153:0/169374352 wait complete. 2023-08-17T00:02:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 Processor -- start 2023-08-17T00:02:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 -- start start 2023-08-17T00:02:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda4063290 0x7fcda4152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4065b50 0x7fcda414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 0x7fcda414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda414b7d0 con 0x7fcda4151b90 2023-08-17T00:02:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40aa1a0 con 0x7fcda4063290 2023-08-17T00:02:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcdaa01b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda40aa480 con 0x7fcda4065b50 2023-08-17T00:02:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcda3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 0x7fcda414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcda3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 0x7fcda414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33532/0 (socket says 172.21.15.153:33532) 2023-08-17T00:02:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.579+0000 7fcda3fff700 1 -- 172.21.15.153:0/2798867687 learned_addr learned my addr 172.21.15.153:0/2798867687 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda37fe700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda4063290 0x7fcda4152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcd9affd700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4065b50 0x7fcda414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda3fff700 1 -- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4065b50 msgr2=0x7fcda414adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda3fff700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4065b50 0x7fcda414adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda3fff700 1 -- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda4063290 msgr2=0x7fcda4152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda3fff700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda4063290 0x7fcda4152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda3fff700 1 -- 172.21.15.153:0/2798867687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c009370 con 0x7fcda4151b90 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda37fe700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda4063290 0x7fcda4152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcda3fff700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 0x7fcda414b2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcd9c009130 tx=0x7fcd9c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00bae0 con 0x7fcda4151b90 2023-08-17T00:02:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c01c420 con 0x7fcda4151b90 2023-08-17T00:02:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda40aa760 con 0x7fcda4151b90 2023-08-17T00:02:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c01c7e0 con 0x7fcda4151b90 2023-08-17T00:02:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda40aad20 con 0x7fcda4151b90 2023-08-17T00:02:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.583+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda40aaf10 con 0x7fcda4151b90 2023-08-17T00:02:47.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.587+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcd9c02c070 con 0x7fcda4151b90 2023-08-17T00:02:47.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.587+0000 7fcd9bfff700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd8405e560 0x7fcd84060a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.587+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcd9c075c40 con 0x7fcda4151b90 2023-08-17T00:02:47.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.587+0000 7fcda37fe700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd8405e560 0x7fcd84060a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.587+0000 7fcda37fe700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd8405e560 0x7fcd84060a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcd94007460 tx=0x7fcd9400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.591+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd9c0a48f0 con 0x7fcda4151b90 2023-08-17T00:02:47.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.791+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcda40624d0 con 0x7fcda4151b90 2023-08-17T00:02:47.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.791+0000 7fcd9bfff700 1 -- 172.21.15.153:0/2798867687 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3536 (secure 0 0 0) 0x7fcd9c020020 con 0x7fcda4151b90 2023-08-17T00:02:47.798 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:47.798 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-17T00:02:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.791+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd8405e560 msgr2=0x7fcd84060a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.791+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd8405e560 0x7fcd84060a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcd94007460 tx=0x7fcd9400b040).stop 2023-08-17T00:02:47.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.791+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 msgr2=0x7fcda414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.791+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 0x7fcda414b2e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fcd9c009130 tx=0x7fcd9c017000).stop 2023-08-17T00:02:47.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 shutdown_connections 2023-08-17T00:02:47.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd8405e560 0x7fcd84060a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcda4151b90 0x7fcda414b2e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcda4065b50 0x7fcda414adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 --2- 172.21.15.153:0/2798867687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcda4063290 0x7fcda4152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 >> 172.21.15.153:0/2798867687 conn(0x7fcda40c7150 msgr2=0x7fcda40c5e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:47.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 shutdown_connections 2023-08-17T00:02:47.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.795+0000 7fcdaa01b700 1 -- 172.21.15.153:0/2798867687 wait complete. 2023-08-17T00:02:47.804 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 3 2023-08-17T00:02:47.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:47.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 Processor -- start 2023-08-17T00:02:47.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 -- start start 2023-08-17T00:02:47.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7484151f70 0x7f7484065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f7484064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7484061fa0 con 0x7f7484151b90 2023-08-17T00:02:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74840c3fb0 con 0x7f7484151f70 2023-08-17T00:02:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.971+0000 7f748ac1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74841523d0 con 0x7f7484065b50 2023-08-17T00:02:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7484151f70 0x7f7484065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f74891b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f7484064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7484151f70 0x7f7484065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:56062/0 (socket says 172.21.15.153:56062) 2023-08-17T00:02:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 -- 172.21.15.153:0/3857764448 learned_addr learned my addr 172.21.15.153:0/3857764448 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:47.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f74889b7700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7484151b90 0x7f7484063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:54582/0 (socket says 172.21.15.153:54582) 2023-08-17T00:02:47.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 -- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 msgr2=0x7f7484064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:47.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 --2- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f7484064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 -- 172.21.15.153:0/3857764448 >> v1:172.21.15.178:6789/0 conn(0x7f7484151b90 legacy=0x7f7484063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 -- 172.21.15.153:0/3857764448 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840621f0 con 0x7f7484151f70 2023-08-17T00:02:47.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747bfff700 1 --2- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484065660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7474006fd0 tx=0x7f74740090f0).ready entity=mon.1 client_cookie=10fa2978eb893b0b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747b7fe700 1 -- 172.21.15.153:0/3857764448 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400b580 con 0x7f7484151f70 2023-08-17T00:02:47.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747b7fe700 1 -- 172.21.15.153:0/3857764448 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400b6e0 con 0x7f7484151f70 2023-08-17T00:02:47.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f747b7fe700 1 -- 172.21.15.153:0/3857764448 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400ba80 con 0x7f7484151f70 2023-08-17T00:02:47.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f748ac1b700 1 -- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 msgr2=0x7f7484065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484065660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f7474006fd0 tx=0x7f74740090f0).stop 2023-08-17T00:02:47.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f748ac1b700 1 -- 172.21.15.153:0/3857764448 shutdown_connections 2023-08-17T00:02:47.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f7484064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3857764448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484065660 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.975+0000 7f748ac1b700 1 -- 172.21.15.153:0/3857764448 >> 172.21.15.153:0/3857764448 conn(0x7f74840c7150 msgr2=0x7f74840c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:47.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.979+0000 7f748ac1b700 1 -- 172.21.15.153:0/3857764448 shutdown_connections 2023-08-17T00:02:47.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.979+0000 7f748ac1b700 1 -- 172.21.15.153:0/3857764448 wait complete. 2023-08-17T00:02:47.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.979+0000 7f748ac1b700 1 Processor -- start 2023-08-17T00:02:47.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.979+0000 7f748ac1b700 1 -- start start 2023-08-17T00:02:47.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f74840a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 0x7f7484152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484153930 con 0x7f7484151b90 2023-08-17T00:02:47.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7484147570 con 0x7f7484151f70 2023-08-17T00:02:47.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74840bfd80 con 0x7f7484065b50 2023-08-17T00:02:47.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 0x7f7484152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 0x7f7484152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33546/0 (socket says 172.21.15.153:33546) 2023-08-17T00:02:47.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 -- 172.21.15.153:0/3519171508 learned_addr learned my addr 172.21.15.153:0/3519171508 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:47.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f74891b8700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f74889b7700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f74840a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 -- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 msgr2=0x7f74840a7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f74840a7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 -- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 msgr2=0x7f7484153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:47.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:47.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 -- 172.21.15.153:0/3519171508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7474009370 con 0x7f7484151b90 2023-08-17T00:02:47.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f747bfff700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 0x7f7484152f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f748405e420 tx=0x7f7474017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:47.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7474006d90 con 0x7f7484151b90 2023-08-17T00:02:47.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7474000bc0 con 0x7f7484151b90 2023-08-17T00:02:47.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74840c1050 con 0x7f7484151b90 2023-08-17T00:02:47.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400b850 con 0x7f7484151b90 2023-08-17T00:02:47.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.983+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74840c1610 con 0x7f7484151b90 2023-08-17T00:02:47.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.987+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f748406b530 con 0x7f7484151b90 2023-08-17T00:02:47.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.987+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f747402c070 con 0x7f7484151b90 2023-08-17T00:02:47.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.991+0000 7f7478ff9700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f747005a150 0x7f747005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:47.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.991+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7474075560 con 0x7f7484151b90 2023-08-17T00:02:47.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.991+0000 7f74889b7700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f747005a150 0x7f747005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:47.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.991+0000 7f74889b7700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f747005a150 0x7f747005c610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7480000c00 tx=0x7f7480007cf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:47.995+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7474049360 con 0x7f7484151b90 2023-08-17T00:02:48.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.167+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f748414f7d0 con 0x7f7484151b90 2023-08-17T00:02:48.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.167+0000 7f7478ff9700 1 -- 172.21.15.153:0/3519171508 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13757 (secure 0 0 0) 0x7f747402a030 con 0x7f7484151b90 2023-08-17T00:02:48.175 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:48.175 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":18,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:47.257283+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f747005a150 msgr2=0x7f747005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f747005a150 0x7f747005c610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7480000c00 tx=0x7f7480007cf0).stop 2023-08-17T00:02:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 msgr2=0x7f7484152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 0x7f7484152f50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f748405e420 tx=0x7f7474017000).stop 2023-08-17T00:02:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 shutdown_connections 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f747005a150 0x7f747005c610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7484151f70 0x7f7484153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7484151b90 0x7f7484152f50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 --2- 172.21.15.153:0/3519171508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7484065b50 0x7f74840a7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.171+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 >> 172.21.15.153:0/3519171508 conn(0x7f74840c7150 msgr2=0x7f74840c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.175+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 shutdown_connections 2023-08-17T00:02:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.175+0000 7f748ac1b700 1 -- 172.21.15.153:0/3519171508 wait complete. 2023-08-17T00:02:48.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:02:48.203 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:02:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.363+0000 7f37c2f69700 1 Processor -- start 2023-08-17T00:02:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.363+0000 7f37c2f69700 1 -- start start 2023-08-17T00:02:48.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c2f69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37bc0c7940 0x7f37bc0c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c2f69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37bc0a45f0 0x7f37bc1515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c2f69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37bc0695b0 con 0x7f37bc069120 2023-08-17T00:02:48.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c2f69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc0a64a0 con 0x7f37bc0a45f0 2023-08-17T00:02:48.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c2f69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37bc0a4a80 con 0x7f37bc0c7940 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37bbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f37bc069120 0x7f37bc0a5d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33608/0 (socket says 172.21.15.153:33608) 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37bbfff700 1 -- 172.21.15.153:0/2496477373 learned_addr learned my addr 172.21.15.153:0/2496477373 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c0d05700 1 --2- 172.21.15.153:0/2496477373 >> v2:172.21.15.178:3300/0 conn(0x7f37bc0c7940 0x7f37bc0c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c1506700 1 --2- 172.21.15.153:0/2496477373 >> v2:172.21.15.153:3300/0 conn(0x7f37bc0a45f0 0x7f37bc1515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c1506700 1 -- 172.21.15.153:0/2496477373 >> v2:172.21.15.178:3300/0 conn(0x7f37bc0c7940 msgr2=0x7f37bc0c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c1506700 1 --2- 172.21.15.153:0/2496477373 >> v2:172.21.15.178:3300/0 conn(0x7f37bc0c7940 0x7f37bc0c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c1506700 1 -- 172.21.15.153:0/2496477373 >> v1:172.21.15.153:6789/0 conn(0x7f37bc069120 legacy=0x7f37bc0a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c1506700 1 -- 172.21.15.153:0/2496477373 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0a4cf0 con 0x7f37bc0a45f0 2023-08-17T00:02:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37bb7fe700 1 -- 172.21.15.153:0/2496477373 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106768290 0 0) 0x7f37a8001110 con 0x7f37bc069120 2023-08-17T00:02:48.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37c1506700 1 --2- 172.21.15.153:0/2496477373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0a45f0 0x7f37bc1515c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f37bc06a720 tx=0x7f37b4009780).ready entity=mon.0 client_cookie=ec42864855f5aef0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37bb7fe700 1 -- 172.21.15.153:0/2496477373 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b400e070 con 0x7f37bc0a45f0 2023-08-17T00:02:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37bb7fe700 1 -- 172.21.15.153:0/2496477373 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b400bb60 con 0x7f37bc0a45f0 2023-08-17T00:02:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.367+0000 7f37bb7fe700 1 -- 172.21.15.153:0/2496477373 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4012410 con 0x7f37bc0a45f0 2023-08-17T00:02:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 -- 172.21.15.153:0/2496477373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0a45f0 msgr2=0x7f37bc1515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 --2- 172.21.15.153:0/2496477373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0a45f0 0x7f37bc1515c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f37bc06a720 tx=0x7f37b4009780).stop 2023-08-17T00:02:48.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 -- 172.21.15.153:0/2496477373 shutdown_connections 2023-08-17T00:02:48.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 --2- 172.21.15.153:0/2496477373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0a45f0 0x7f37bc1515c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 --2- 172.21.15.153:0/2496477373 >> v2:172.21.15.178:3300/0 conn(0x7f37bc0c7940 0x7f37bc0c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 -- 172.21.15.153:0/2496477373 >> 172.21.15.153:0/2496477373 conn(0x7f37bc0aa820 msgr2=0x7f37bc0aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:48.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 -- 172.21.15.153:0/2496477373 shutdown_connections 2023-08-17T00:02:48.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 -- 172.21.15.153:0/2496477373 wait complete. 2023-08-17T00:02:48.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.371+0000 7f37c2f69700 1 Processor -- start 2023-08-17T00:02:48.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 -- start start 2023-08-17T00:02:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37bc069120 0x7f37bc16c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37bc0a45f0 0x7f37bc143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 0x7f37bc14c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc16cad0 con 0x7f37bc0c7940 2023-08-17T00:02:48.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc14b330 con 0x7f37bc0a45f0 2023-08-17T00:02:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c2f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37bc063360 con 0x7f37bc069120 2023-08-17T00:02:48.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 0x7f37bc14c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 0x7f37bc14c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33560/0 (socket says 172.21.15.153:33560) 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 -- 172.21.15.153:0/953902178 learned_addr learned my addr 172.21.15.153:0/953902178 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c0d05700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37bc069120 0x7f37bc16c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37bbfff700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37bc0a45f0 0x7f37bc143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 -- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37bc069120 msgr2=0x7f37bc16c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37bc069120 0x7f37bc16c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 -- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37bc0a45f0 msgr2=0x7f37bc143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37bc0a45f0 0x7f37bc143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 -- 172.21.15.153:0/953902178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b4009a20 con 0x7f37bc0c7940 2023-08-17T00:02:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c0d05700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37bc069120 0x7f37bc16c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.375+0000 7f37c1506700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 0x7f37bc14c910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f37b400b6c0 tx=0x7f37b4009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4009440 con 0x7f37bc0c7940 2023-08-17T00:02:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b401d630 con 0x7f37bc0c7940 2023-08-17T00:02:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b401d9b0 con 0x7f37bc0c7940 2023-08-17T00:02:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37bc063640 con 0x7f37bc0c7940 2023-08-17T00:02:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37bc063c00 con 0x7f37bc0c7940 2023-08-17T00:02:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37bc06b530 con 0x7f37bc0c7940 2023-08-17T00:02:48.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f37b4026410 con 0x7f37bc0c7940 2023-08-17T00:02:48.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37b8ff9700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37a005a180 0x7f37a005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.379+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f37b4075c30 con 0x7f37bc0c7940 2023-08-17T00:02:48.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.383+0000 7f37c0d05700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37a005a180 0x7f37a005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.383+0000 7f37c0d05700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37a005a180 0x7f37a005c640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f37b0009b60 tx=0x7f37b0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.387+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37b40499d0 con 0x7f37bc0c7940 2023-08-17T00:02:48.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.547+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f37bc0a4fd0 con 0x7f37bc0c7940 2023-08-17T00:02:48.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.551+0000 7f37b8ff9700 1 -- 172.21.15.153:0/953902178 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f37b404cff0 con 0x7f37bc0c7940 2023-08-17T00:02:48.557 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:02:48.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37a005a180 msgr2=0x7f37a005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37a005a180 0x7f37a005c640 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f37b0009b60 tx=0x7f37b0008040).stop 2023-08-17T00:02:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 msgr2=0x7f37bc14c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 0x7f37bc14c910 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f37b400b6c0 tx=0x7f37b4009780).stop 2023-08-17T00:02:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 shutdown_connections 2023-08-17T00:02:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37a005a180 0x7f37a005c640 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37bc0c7940 0x7f37bc14c910 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37bc0a45f0 0x7f37bc143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 --2- 172.21.15.153:0/953902178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37bc069120 0x7f37bc16c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 >> 172.21.15.153:0/953902178 conn(0x7f37bc0aa820 msgr2=0x7f37bc0c4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 shutdown_connections 2023-08-17T00:02:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.555+0000 7f37c2f69700 1 -- 172.21.15.153:0/953902178 wait complete. 2023-08-17T00:02:48.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:02:48.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.735+0000 7f975f59e700 1 Processor -- start 2023-08-17T00:02:48.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975f59e700 1 -- start start 2023-08-17T00:02:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97600c1190 0x7f9760153db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9760154ae0 con 0x7f9760069630 2023-08-17T00:02:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975f59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9760064fd0 con 0x7f9760069250 2023-08-17T00:02:48.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97600664a0 con 0x7f97600c1190 2023-08-17T00:02:48.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975dd9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9760069630 0x7f97600c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33624/0 (socket says 172.21.15.153:33624) 2023-08-17T00:02:48.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.739+0000 7f975dd9b700 1 -- 172.21.15.153:0/3819650695 learned_addr learned my addr 172.21.15.153:0/3819650695 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:48.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975ed9d700 1 --2- 172.21.15.153:0/3819650695 >> v2:172.21.15.153:3300/0 conn(0x7f97600c1190 0x7f9760153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210879222 0 0) 0x7f9760154ae0 con 0x7f9760069630 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97480033f0 con 0x7f9760069630 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622721581 0 0) 0x7f9760064fd0 con 0x7f9760069250 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9760154ae0 con 0x7f9760069250 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975ed9d700 1 -- 172.21.15.153:0/3819650695 >> v1:172.21.15.178:6789/0 conn(0x7f9760069250 legacy=0x7f9760065d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975ed9d700 1 -- 172.21.15.153:0/3819650695 >> v1:172.21.15.153:6789/0 conn(0x7f9760069630 legacy=0x7f97600c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975ed9d700 1 -- 172.21.15.153:0/3819650695 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600652b0 con 0x7f97600c1190 2023-08-17T00:02:48.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975ed9d700 1 --2- 172.21.15.153:0/3819650695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f9760153db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9758009e60 tx=0x7f9758009780).ready entity=mon.0 client_cookie=f46920ed7240d9fe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800e070 con 0x7f97600c1190 2023-08-17T00:02:48.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975800bab0 con 0x7f97600c1190 2023-08-17T00:02:48.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975d59a700 1 -- 172.21.15.153:0/3819650695 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975800be30 con 0x7f97600c1190 2023-08-17T00:02:48.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 -- 172.21.15.153:0/3819650695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 msgr2=0x7f9760153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 --2- 172.21.15.153:0/3819650695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f9760153db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f9758009e60 tx=0x7f9758009780).stop 2023-08-17T00:02:48.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 -- 172.21.15.153:0/3819650695 shutdown_connections 2023-08-17T00:02:48.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 --2- 172.21.15.153:0/3819650695 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f9760153db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 -- 172.21.15.153:0/3819650695 >> 172.21.15.153:0/3819650695 conn(0x7f97600c6620 msgr2=0x7f97600c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:48.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 -- 172.21.15.153:0/3819650695 shutdown_connections 2023-08-17T00:02:48.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.743+0000 7f975f59e700 1 -- 172.21.15.153:0/3819650695 wait complete. 2023-08-17T00:02:48.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 Processor -- start 2023-08-17T00:02:48.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 -- start start 2023-08-17T00:02:48.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9760069250 0x7f976014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9760069630 0x7f9760164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f976014b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976014ee60 con 0x7f97600c1190 2023-08-17T00:02:48.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760164cf0 con 0x7f9760069250 2023-08-17T00:02:48.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976014e250 con 0x7f9760069630 2023-08-17T00:02:48.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f976014b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f976014b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33570/0 (socket says 172.21.15.153:33570) 2023-08-17T00:02:48.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 -- 172.21.15.153:0/4248307714 learned_addr learned my addr 172.21.15.153:0/4248307714 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:48.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 -- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9760069630 msgr2=0x7f9760164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9760069630 0x7f9760164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:48.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 -- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9760069250 msgr2=0x7f976014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9760069250 0x7f976014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:48.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 -- 172.21.15.153:0/4248307714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9758009a20 con 0x7f97600c1190 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.747+0000 7f975ed9d700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f976014b2a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f975800b610 tx=0x7f9758009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975801d630 con 0x7f97600c1190 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975801d790 con 0x7f97600c1190 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975801db10 con 0x7f97600c1190 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976014e530 con 0x7f97600c1190 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976014eaf0 con 0x7f97600c1190 2023-08-17T00:02:48.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976006b4c0 con 0x7f97600c1190 2023-08-17T00:02:48.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.751+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9758026410 con 0x7f97600c1190 2023-08-17T00:02:48.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.755+0000 7f974e7fc700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f974005a180 0x7f974005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:48.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.755+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9758075e20 con 0x7f97600c1190 2023-08-17T00:02:48.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.755+0000 7f975e59c700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f974005a180 0x7f974005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:48.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.755+0000 7f975e59c700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f974005a180 0x7f974005c640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f97601672f0 tx=0x7f9750007840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:48.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.759+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9758049ab0 con 0x7f97600c1190 2023-08-17T00:02:48.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.923+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f976014efa0 con 0x7f97600c1190 2023-08-17T00:02:48.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.923+0000 7f974e7fc700 1 -- 172.21.15.153:0/4248307714 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f975804d0d0 con 0x7f97600c1190 2023-08-17T00:02:48.933 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:02:48.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f974005a180 msgr2=0x7f974005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f974005a180 0x7f974005c640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f97601672f0 tx=0x7f9750007840).stop 2023-08-17T00:02:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 msgr2=0x7f976014b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f976014b2a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f975800b610 tx=0x7f9758009780).stop 2023-08-17T00:02:48.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 shutdown_connections 2023-08-17T00:02:48.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f974005a180 0x7f974005c640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97600c1190 0x7f976014b2a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:48.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9760069630 0x7f9760164800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:48.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 --2- 172.21.15.153:0/4248307714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9760069250 0x7f976014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 >> 172.21.15.153:0/4248307714 conn(0x7f97600c6620 msgr2=0x7f97600687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 shutdown_connections 2023-08-17T00:02:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:48.927+0000 7f975f59e700 1 -- 172.21.15.153:0/4248307714 wait complete. 2023-08-17T00:02:48.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:02:49.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.095+0000 7f4d55ae4700 1 Processor -- start 2023-08-17T00:02:49.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.099+0000 7f4d55ae4700 1 -- start start 2023-08-17T00:02:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.099+0000 7f4d55ae4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d500abf10 0x7f4d50068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.099+0000 7f4d55ae4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d500ac2f0 0x7f4d50068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.099+0000 7f4d55ae4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d501545e0 con 0x7f4d500c0a80 2023-08-17T00:02:49.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.099+0000 7f4d55ae4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d50069200 con 0x7f4d500ac2f0 2023-08-17T00:02:49.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.099+0000 7f4d55ae4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d500c1c50 con 0x7f4d500abf10 2023-08-17T00:02:49.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d500ac2f0 0x7f4d50068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d500ac2f0 0x7f4d50068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33582/0 (socket says 172.21.15.153:33582) 2023-08-17T00:02:49.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 -- 172.21.15.153:0/1566199253 learned_addr learned my addr 172.21.15.153:0/1566199253 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:49.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d54ae2700 1 --2- 172.21.15.153:0/1566199253 >> v2:172.21.15.178:3300/0 conn(0x7f4d500abf10 0x7f4d50068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 -- 172.21.15.153:0/1566199253 >> v2:172.21.15.178:3300/0 conn(0x7f4d500abf10 msgr2=0x7f4d50068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:49.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 --2- 172.21.15.153:0/1566199253 >> v2:172.21.15.178:3300/0 conn(0x7f4d500abf10 0x7f4d50068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 -- 172.21.15.153:0/1566199253 >> v1:172.21.15.178:6789/0 conn(0x7f4d500c0a80 legacy=0x7f4d500c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 -- 172.21.15.153:0/1566199253 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d500a96d0 con 0x7f4d500ac2f0 2023-08-17T00:02:49.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4ffff700 1 --2- 172.21.15.153:0/1566199253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500ac2f0 0x7f4d50068d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4d500c3f30 tx=0x7f4d3c0090f0).ready entity=mon.0 client_cookie=e6019a1f4e582806 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:49.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4f7fe700 1 -- 172.21.15.153:0/1566199253 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00b520 con 0x7f4d500ac2f0 2023-08-17T00:02:49.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4f7fe700 1 -- 172.21.15.153:0/1566199253 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c00b680 con 0x7f4d500ac2f0 2023-08-17T00:02:49.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d4f7fe700 1 -- 172.21.15.153:0/1566199253 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c00ba20 con 0x7f4d500ac2f0 2023-08-17T00:02:49.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1566199253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500ac2f0 msgr2=0x7f4d50068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1566199253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500ac2f0 0x7f4d50068d10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f4d500c3f30 tx=0x7f4d3c0090f0).stop 2023-08-17T00:02:49.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1566199253 shutdown_connections 2023-08-17T00:02:49.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1566199253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500ac2f0 0x7f4d50068d10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1566199253 >> v2:172.21.15.178:3300/0 conn(0x7f4d500abf10 0x7f4d50068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1566199253 >> 172.21.15.153:0/1566199253 conn(0x7f4d500c6620 msgr2=0x7f4d500c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1566199253 shutdown_connections 2023-08-17T00:02:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.103+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1566199253 wait complete. 2023-08-17T00:02:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.107+0000 7f4d55ae4700 1 Processor -- start 2023-08-17T00:02:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.107+0000 7f4d55ae4700 1 -- start start 2023-08-17T00:02:49.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d500abf10 0x7f4d50159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d500ac2f0 0x7f4d500bf550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 0x7f4d50167c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500bf0c0 con 0x7f4d500c0a80 2023-08-17T00:02:49.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500bfa40 con 0x7f4d500ac2f0 2023-08-17T00:02:49.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d500be4b0 con 0x7f4d500abf10 2023-08-17T00:02:49.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 0x7f4d50167c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 0x7f4d50167c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33584/0 (socket says 172.21.15.153:33584) 2023-08-17T00:02:49.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 -- 172.21.15.153:0/1349977245 learned_addr learned my addr 172.21.15.153:0/1349977245 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:49.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d54ae2700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d500abf10 0x7f4d50159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d4ffff700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d500ac2f0 0x7f4d500bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 -- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d500abf10 msgr2=0x7f4d50159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d500abf10 0x7f4d50159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 -- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d500ac2f0 msgr2=0x7f4d500bf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d500ac2f0 0x7f4d500bf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 -- 172.21.15.153:0/1349977245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009370 con 0x7f4d500c0a80 2023-08-17T00:02:49.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d552e3700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 0x7f4d50167c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4d4800c790 tx=0x7f4d480015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:49.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800e4a0 con 0x7f4d500c0a80 2023-08-17T00:02:49.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4800e600 con 0x7f4d500c0a80 2023-08-17T00:02:49.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d500be790 con 0x7f4d500c0a80 2023-08-17T00:02:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4800e980 con 0x7f4d500c0a80 2023-08-17T00:02:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d500bed50 con 0x7f4d500c0a80 2023-08-17T00:02:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.111+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d50066200 con 0x7f4d500c0a80 2023-08-17T00:02:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.115+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d48019030 con 0x7f4d500c0a80 2023-08-17T00:02:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.115+0000 7f4d4cff9700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d3405a150 0x7f4d3405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.115+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4d48073340 con 0x7f4d500c0a80 2023-08-17T00:02:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.119+0000 7f4d54ae2700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d3405a150 0x7f4d3405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.119+0000 7f4d54ae2700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d3405a150 0x7f4d3405c610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4d44006fd0 tx=0x7f4d44006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.123+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d50066200 con 0x7f4d500c0a80 2023-08-17T00:02:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.287+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f4d50066200 con 0x7f4d500c0a80 2023-08-17T00:02:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.287+0000 7f4d4cff9700 1 -- 172.21.15.153:0/1349977245 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7f4d50066200 con 0x7f4d500c0a80 2023-08-17T00:02:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:49.294 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:02:49.294 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:02:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:02:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:02:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:02:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:02:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:02:49.295 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:02:49.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:02:49.296 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:02:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d3405a150 msgr2=0x7f4d3405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d3405a150 0x7f4d3405c610 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f4d44006fd0 tx=0x7f4d44006f40).stop 2023-08-17T00:02:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 msgr2=0x7f4d50167c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 0x7f4d50167c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f4d4800c790 tx=0x7f4d480015e0).stop 2023-08-17T00:02:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 shutdown_connections 2023-08-17T00:02:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d3405a150 0x7f4d3405c610 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d500c0a80 0x7f4d50167c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d500ac2f0 0x7f4d500bf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 --2- 172.21.15.153:0/1349977245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d500abf10 0x7f4d50159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 >> 172.21.15.153:0/1349977245 conn(0x7f4d500c6620 msgr2=0x7f4d500c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 shutdown_connections 2023-08-17T00:02:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.291+0000 7f4d55ae4700 1 -- 172.21.15.153:0/1349977245 wait complete. 2023-08-17T00:02:49.315 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:02:49.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:02:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.467+0000 7f79e6879700 1 Processor -- start 2023-08-17T00:02:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.467+0000 7f79e6879700 1 -- start start 2023-08-17T00:02:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6879700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e00632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6879700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79e0153d90 0x7f79e00a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6879700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79e00cb450 0x7f79e00a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6879700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00aa180 con 0x7f79e00cb450 2023-08-17T00:02:49.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6879700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e00c00d0 con 0x7f79e0153d90 2023-08-17T00:02:49.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6879700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00bf810 con 0x7f79e01539b0 2023-08-17T00:02:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79e00cb450 0x7f79e00a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79e00cb450 0x7f79e00a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33598/0 (socket says 172.21.15.153:33598) 2023-08-17T00:02:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 -- 172.21.15.153:0/1879343213 learned_addr learned my addr 172.21.15.153:0/1879343213 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 -- 172.21.15.153:0/1879343213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 msgr2=0x7f79e00632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e5877700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e00632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e00632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 -- 172.21.15.153:0/1879343213 >> v2:172.21.15.178:3300/0 conn(0x7f79e0153d90 msgr2=0x7f79e00a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e5076700 1 --2- 172.21.15.153:0/1879343213 >> v2:172.21.15.178:3300/0 conn(0x7f79e0153d90 0x7f79e00a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 --2- 172.21.15.153:0/1879343213 >> v2:172.21.15.178:3300/0 conn(0x7f79e0153d90 0x7f79e00a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 -- 172.21.15.153:0/1879343213 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00aa910 con 0x7f79e00cb450 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e5877700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e00632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e5076700 1 --2- 172.21.15.153:0/1879343213 >> v2:172.21.15.178:3300/0 conn(0x7f79e0153d90 0x7f79e00a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e6078700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e00a9c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f79e0046c50 tx=0x7f79d8009840).ready entity=mon.0 client_cookie=f2f15683390c17d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e4875700 1 -- 172.21.15.153:0/1879343213 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800e070 con 0x7f79e00cb450 2023-08-17T00:02:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e4875700 1 -- 172.21.15.153:0/1879343213 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d800ba50 con 0x7f79e00cb450 2023-08-17T00:02:49.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.471+0000 7f79e4875700 1 -- 172.21.15.153:0/1879343213 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800bdd0 con 0x7f79e00cb450 2023-08-17T00:02:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 -- 172.21.15.153:0/1879343213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 msgr2=0x7f79e00a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e00a9c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f79e0046c50 tx=0x7f79d8009840).stop 2023-08-17T00:02:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 -- 172.21.15.153:0/1879343213 shutdown_connections 2023-08-17T00:02:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e00a9c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 --2- 172.21.15.153:0/1879343213 >> v2:172.21.15.178:3300/0 conn(0x7f79e0153d90 0x7f79e00a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 --2- 172.21.15.153:0/1879343213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e00632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 -- 172.21.15.153:0/1879343213 >> 172.21.15.153:0/1879343213 conn(0x7f79e0062a10 msgr2=0x7f79e00ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:49.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 -- 172.21.15.153:0/1879343213 shutdown_connections 2023-08-17T00:02:49.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 -- 172.21.15.153:0/1879343213 wait complete. 2023-08-17T00:02:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 Processor -- start 2023-08-17T00:02:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.475+0000 7f79e6879700 1 -- start start 2023-08-17T00:02:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e0164190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0153d90 0x7f79e014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c4200 con 0x7f79e00cb450 2023-08-17T00:02:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c35f0 con 0x7f79e0153d90 2023-08-17T00:02:49.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e00c38d0 con 0x7f79e01539b0 2023-08-17T00:02:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e0164190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e0164190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33600/0 (socket says 172.21.15.153:33600) 2023-08-17T00:02:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 -- 172.21.15.153:0/1470332024 learned_addr learned my addr 172.21.15.153:0/1470332024 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:49.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5076700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6078700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0153d90 0x7f79e014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 -- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 msgr2=0x7f79e014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 -- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0153d90 msgr2=0x7f79e014e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0153d90 0x7f79e014e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 -- 172.21.15.153:0/1470332024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8009ae0 con 0x7f79e00cb450 2023-08-17T00:02:49.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e5877700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e0164190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f79dc00c880 tx=0x7f79dc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc010580 con 0x7f79e00cb450 2023-08-17T00:02:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0106e0 con 0x7f79e00cb450 2023-08-17T00:02:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc010a60 con 0x7f79e00cb450 2023-08-17T00:02:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e00c3bb0 con 0x7f79e00cb450 2023-08-17T00:02:49.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.479+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e014e8c0 con 0x7f79e00cb450 2023-08-17T00:02:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.483+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e0046dd0 con 0x7f79e00cb450 2023-08-17T00:02:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.483+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f79dc01a410 con 0x7f79e00cb450 2023-08-17T00:02:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.483+0000 7f79d5ffb700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f79c405a150 0x7f79c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.487+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f79dc0737c0 con 0x7f79e00cb450 2023-08-17T00:02:49.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.487+0000 7f79e5076700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f79c405a150 0x7f79c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:49.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.487+0000 7f79e5076700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f79c405a150 0x7f79c405c610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79e0161d50 tx=0x7f79d0006f90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.491+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79dc047560 con 0x7f79e00cb450 2023-08-17T00:02:49.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:49.651+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f79e00bfa80 con 0x7f79e00cb450 2023-08-17T00:02:50.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.295+0000 7f79d5ffb700 1 -- 172.21.15.153:0/1470332024 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 152+0+0 (secure 0 0 0) 0x7f79dc04ab80 con 0x7f79e00cb450 2023-08-17T00:02:50.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f79c405a150 msgr2=0x7f79c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f79c405a150 0x7f79c405c610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f79e0161d50 tx=0x7f79d0006f90).stop 2023-08-17T00:02:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 msgr2=0x7f79e0164190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e0164190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f79dc00c880 tx=0x7f79dc008040).stop 2023-08-17T00:02:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 shutdown_connections 2023-08-17T00:02:50.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f79c405a150 0x7f79c405c610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79e0153d90 0x7f79e014e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79e01539b0 0x7f79e014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 --2- 172.21.15.153:0/1470332024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79e00cb450 0x7f79e0164190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 >> 172.21.15.153:0/1470332024 conn(0x7f79e0062a10 msgr2=0x7f79e014f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:50.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 shutdown_connections 2023-08-17T00:02:50.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.299+0000 7f79e6879700 1 -- 172.21.15.153:0/1470332024 wait complete. 2023-08-17T00:02:50.318 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:02:50.336 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:02:50.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.499+0000 7ff3c9907700 1 Processor -- start 2023-08-17T00:02:50.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.499+0000 7ff3c9907700 1 -- start start 2023-08-17T00:02:50.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c9907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c4153f50 0x7ff3c4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c9907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff3c40c01a0 0x7ff3c40c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c9907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c40bfd10 con 0x7ff3c40c57a0 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c9907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c4154860 con 0x7ff3c4153f50 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c9907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c4154af0 con 0x7ff3c40c01a0 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c4153f50 0x7ff3c4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3c4153f50 0x7ff3c4154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33614/0 (socket says 172.21.15.153:33614) 2023-08-17T00:02:50.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c3fff700 1 -- 172.21.15.153:0/2144633217 learned_addr learned my addr 172.21.15.153:0/2144633217 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c3fff700 1 -- 172.21.15.153:0/2144633217 >> v2:172.21.15.178:3300/0 conn(0x7ff3c40c01a0 msgr2=0x7ff3c40c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.503+0000 7ff3c3fff700 1 --2- 172.21.15.153:0/2144633217 >> v2:172.21.15.178:3300/0 conn(0x7ff3c40c01a0 0x7ff3c40c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:50.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c3fff700 1 -- 172.21.15.153:0/2144633217 >> v1:172.21.15.178:6789/0 conn(0x7ff3c40c57a0 legacy=0x7ff3c40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:50.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c3fff700 1 -- 172.21.15.153:0/2144633217 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c4154dd0 con 0x7ff3c4153f50 2023-08-17T00:02:50.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c3fff700 1 --2- 172.21.15.153:0/2144633217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4154370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff3c406a440 tx=0x7ff3b00090f0).ready entity=mon.0 client_cookie=b89d67ad69908b36 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:50.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c37fe700 1 -- 172.21.15.153:0/2144633217 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000b5a0 con 0x7ff3c4153f50 2023-08-17T00:02:50.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c37fe700 1 -- 172.21.15.153:0/2144633217 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b000b700 con 0x7ff3c4153f50 2023-08-17T00:02:50.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c37fe700 1 -- 172.21.15.153:0/2144633217 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000ba80 con 0x7ff3c4153f50 2023-08-17T00:02:50.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 -- 172.21.15.153:0/2144633217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 msgr2=0x7ff3c4154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2144633217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4154370 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ff3c406a440 tx=0x7ff3b00090f0).stop 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 -- 172.21.15.153:0/2144633217 shutdown_connections 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2144633217 >> v2:172.21.15.178:3300/0 conn(0x7ff3c40c01a0 0x7ff3c40c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2144633217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4154370 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 -- 172.21.15.153:0/2144633217 >> 172.21.15.153:0/2144633217 conn(0x7ff3c4062a70 msgr2=0x7ff3c40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 -- 172.21.15.153:0/2144633217 shutdown_connections 2023-08-17T00:02:50.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.507+0000 7ff3c9907700 1 -- 172.21.15.153:0/2144633217 wait complete. 2023-08-17T00:02:50.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.511+0000 7ff3c9907700 1 Processor -- start 2023-08-17T00:02:50.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.511+0000 7ff3c9907700 1 -- start start 2023-08-17T00:02:50.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c40c01a0 0x7ff3c4152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:50.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c40c57a0 0x7ff3c40c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:50.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:50.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c4155310 con 0x7ff3c4153f50 2023-08-17T00:02:50.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40c27f0 con 0x7ff3c40c01a0 2023-08-17T00:02:50.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c40c1940 con 0x7ff3c40c57a0 2023-08-17T00:02:50.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:50.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33618/0 (socket says 172.21.15.153:33618) 2023-08-17T00:02:50.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 -- 172.21.15.153:0/2980328669 learned_addr learned my addr 172.21.15.153:0/2980328669 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:50.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c8905700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c40c01a0 0x7ff3c4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:50.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c3fff700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c40c57a0 0x7ff3c40c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:50.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 -- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c40c57a0 msgr2=0x7ff3c40c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:50.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c40c57a0 0x7ff3c40c2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 -- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c40c01a0 msgr2=0x7ff3c4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:50.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c40c01a0 0x7ff3c4152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:50.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 -- 172.21.15.153:0/2980328669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0009370 con 0x7ff3c4153f50 2023-08-17T00:02:50.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9106700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4155ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff3bc00b790 tx=0x7ff3bc009330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:50.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00d500 con 0x7ff3c4153f50 2023-08-17T00:02:50.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc00d680 con 0x7ff3c4153f50 2023-08-17T00:02:50.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c40c1be0 con 0x7ff3c4153f50 2023-08-17T00:02:50.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00da40 con 0x7ff3c4153f50 2023-08-17T00:02:50.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.515+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c40c21a0 con 0x7ff3c4153f50 2023-08-17T00:02:50.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.519+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c40c2980 con 0x7ff3c4153f50 2023-08-17T00:02:50.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.519+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff3bc018030 con 0x7ff3c4153f50 2023-08-17T00:02:50.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.523+0000 7ff3c0ff9700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3a805a150 0x7ff3a805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:50.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.523+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff3bc073820 con 0x7ff3c4153f50 2023-08-17T00:02:50.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.523+0000 7ff3c8905700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3a805a150 0x7ff3a805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:50.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.523+0000 7ff3c8905700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3a805a150 0x7ff3a805c610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff3b800b940 tx=0x7ff3b8006ee0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:50.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.527+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3bc047560 con 0x7ff3c4153f50 2023-08-17T00:02:50.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:50.691+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff3c406b4c0 con 0x7ff3c4153f50 2023-08-17T00:02:51.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.307+0000 7ff3c0ff9700 1 -- 172.21.15.153:0/2980328669 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff3bc04ab80 con 0x7ff3c4153f50 2023-08-17T00:02:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.319+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3a805a150 msgr2=0x7ff3a805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.319+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3a805a150 0x7ff3a805c610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7ff3b800b940 tx=0x7ff3b8006ee0).stop 2023-08-17T00:02:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.319+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 msgr2=0x7ff3c4155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.319+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4155ef0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff3bc00b790 tx=0x7ff3bc009330).stop 2023-08-17T00:02:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.323+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 shutdown_connections 2023-08-17T00:02:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.323+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3a805a150 0x7ff3a805c610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.323+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3c4153f50 0x7ff3c4155ef0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.323+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3c40c57a0 0x7ff3c40c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.323+0000 7ff3c9907700 1 --2- 172.21.15.153:0/2980328669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3c40c01a0 0x7ff3c4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.323+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 >> 172.21.15.153:0/2980328669 conn(0x7ff3c4062a70 msgr2=0x7ff3c4063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.331+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 shutdown_connections 2023-08-17T00:02:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.331+0000 7ff3c9907700 1 -- 172.21.15.153:0/2980328669 wait complete. 2023-08-17T00:02:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:02:51.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:02:51.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.527+0000 7f8efae1b700 1 Processor -- start 2023-08-17T00:02:51.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.527+0000 7f8efae1b700 1 -- start start 2023-08-17T00:02:51.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8efae1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8efae1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ef40c8d50 0x7f8ef40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8efae1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ef40c7490 0x7f8ef40c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8efae1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40aa750 con 0x7f8ef40c7490 2023-08-17T00:02:51.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8efae1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40c7e30 con 0x7f8ef40c8d50 2023-08-17T00:02:51.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8efae1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40c9dd0 con 0x7f8ef4153ab0 2023-08-17T00:02:51.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ef40c7490 0x7f8ef40c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ef40c7490 0x7f8ef40c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33620/0 (socket says 172.21.15.153:33620) 2023-08-17T00:02:51.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef3fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ef40c8d50 0x7f8ef40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 -- 172.21.15.153:0/2180770131 learned_addr learned my addr 172.21.15.153:0/2180770131 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:51.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef8bb7700 1 --2- 172.21.15.153:0/2180770131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 -- 172.21.15.153:0/2180770131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 msgr2=0x7f8ef4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:51.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 --2- 172.21.15.153:0/2180770131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 -- 172.21.15.153:0/2180770131 >> v2:172.21.15.178:3300/0 conn(0x7f8ef40c8d50 msgr2=0x7f8ef40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:51.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 --2- 172.21.15.153:0/2180770131 >> v2:172.21.15.178:3300/0 conn(0x7f8ef40c8d50 0x7f8ef40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 -- 172.21.15.153:0/2180770131 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40aacf0 con 0x7f8ef40c7490 2023-08-17T00:02:51.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef3fff700 1 --2- 172.21.15.153:0/2180770131 >> v2:172.21.15.178:3300/0 conn(0x7f8ef40c8d50 0x7f8ef40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:51.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef93b8700 1 --2- 172.21.15.153:0/2180770131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef40c7940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8ef405e680 tx=0x7f8eec009840).ready entity=mon.0 client_cookie=6312f327d5e92dc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:51.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef37fe700 1 -- 172.21.15.153:0/2180770131 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00e070 con 0x7f8ef40c7490 2023-08-17T00:02:51.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef37fe700 1 -- 172.21.15.153:0/2180770131 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00b970 con 0x7f8ef40c7490 2023-08-17T00:02:51.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.531+0000 7f8ef37fe700 1 -- 172.21.15.153:0/2180770131 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec00bcf0 con 0x7f8ef40c7490 2023-08-17T00:02:51.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 -- 172.21.15.153:0/2180770131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 msgr2=0x7f8ef40c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2180770131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef40c7940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f8ef405e680 tx=0x7f8eec009840).stop 2023-08-17T00:02:51.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 -- 172.21.15.153:0/2180770131 shutdown_connections 2023-08-17T00:02:51.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2180770131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef40c7940 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2180770131 >> v2:172.21.15.178:3300/0 conn(0x7f8ef40c8d50 0x7f8ef40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2180770131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 -- 172.21.15.153:0/2180770131 >> 172.21.15.153:0/2180770131 conn(0x7f8ef4061fa0 msgr2=0x7f8ef40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:51.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 -- 172.21.15.153:0/2180770131 shutdown_connections 2023-08-17T00:02:51.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.535+0000 7f8efae1b700 1 -- 172.21.15.153:0/2180770131 wait complete. 2023-08-17T00:02:51.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 Processor -- start 2023-08-17T00:02:51.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 -- start start 2023-08-17T00:02:51.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef41509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ef40c8d50 0x7f8ef40a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef40aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4164220 con 0x7f8ef40c7490 2023-08-17T00:02:51.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41644c0 con 0x7f8ef40c8d50 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40a2160 con 0x7f8ef4153ab0 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef41509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef41509d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33634/0 (socket says 172.21.15.153:33634) 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 -- 172.21.15.153:0/2053744227 learned_addr learned my addr 172.21.15.153:0/2053744227 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef93b8700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef40aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 -- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 msgr2=0x7f8ef40aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef3fff700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ef40c8d50 0x7f8ef40a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef40aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 -- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ef40c8d50 msgr2=0x7f8ef40a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ef40c8d50 0x7f8ef40a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 -- 172.21.15.153:0/2053744227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee00092a0 con 0x7f8ef40c7490 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef93b8700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef40aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef3fff700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ef40c8d50 0x7f8ef40a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:51.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef8bb7700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef41509d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8ee800e950 tx=0x7f8ee8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800c850 con 0x7f8ef40c7490 2023-08-17T00:02:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee800c9b0 con 0x7f8ef40c7490 2023-08-17T00:02:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eec009ae0 con 0x7f8ef40c7490 2023-08-17T00:02:51.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800cd30 con 0x7f8ef40c7490 2023-08-17T00:02:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.539+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef40a2720 con 0x7f8ef40c7490 2023-08-17T00:02:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.543+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef40a2940 con 0x7f8ef40c7490 2023-08-17T00:02:51.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.543+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8ee8022070 con 0x7f8ef40c7490 2023-08-17T00:02:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.543+0000 7f8ef0ff9700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8ed805a150 0x7f8ed805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.543+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f8ee8074690 con 0x7f8ef40c7490 2023-08-17T00:02:51.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.547+0000 7f8ef3fff700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8ed805a150 0x7f8ed805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.547+0000 7f8ef3fff700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8ed805a150 0x7f8ed805c610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8ee0009270 tx=0x7f8ee0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.551+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ee8048090 con 0x7f8ef40c7490 2023-08-17T00:02:51.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.747+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8ef406b530 con 0x7f8ef40c7490 2023-08-17T00:02:51.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.755+0000 7f8ef0ff9700 1 -- 172.21.15.153:0/2053744227 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8ee80160c0 con 0x7f8ef40c7490 2023-08-17T00:02:51.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.763+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8ed805a150 msgr2=0x7f8ed805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.763+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8ed805a150 0x7f8ed805c610 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f8ee0009270 tx=0x7f8ee0008040).stop 2023-08-17T00:02:51.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.763+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 msgr2=0x7f8ef41509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.763+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef41509d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f8ee800e950 tx=0x7f8ee8009060).stop 2023-08-17T00:02:51.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 shutdown_connections 2023-08-17T00:02:51.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8ed805a150 0x7f8ed805c610 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ef4153ab0 0x7f8ef40aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ef40c8d50 0x7f8ef40a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 --2- 172.21.15.153:0/2053744227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ef40c7490 0x7f8ef41509d0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0x7f8ee800e950 tx=0x7f8ee8009060).stop 2023-08-17T00:02:51.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 >> 172.21.15.153:0/2053744227 conn(0x7f8ef4061fa0 msgr2=0x7f8ef4151590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:51.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 shutdown_connections 2023-08-17T00:02:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.771+0000 7f8efae1b700 1 -- 172.21.15.153:0/2053744227 wait complete. 2023-08-17T00:02:51.786 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 3 and data pool 4 2023-08-17T00:02:51.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:51.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 Processor -- start 2023-08-17T00:02:51.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 -- start start 2023-08-17T00:02:51.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01ec0689c0 0x7f01ec068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01ec1560f0 0x7f01ec0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec065da0 con 0x7f01ec151530 2023-08-17T00:02:51.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec155c60 con 0x7f01ec1560f0 2023-08-17T00:02:51.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01f0b07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec156550 con 0x7f01ec0689c0 2023-08-17T00:02:51.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01e2ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01ec1560f0 0x7f01ec0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01e2ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f01ec1560f0 0x7f01ec0c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33646/0 (socket says 172.21.15.153:33646) 2023-08-17T00:02:51.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.959+0000 7f01e2ffd700 1 -- 172.21.15.153:0/2750475405 learned_addr learned my addr 172.21.15.153:0/2750475405 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:51.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01eb7fe700 1 --2- 172.21.15.153:0/2750475405 >> v2:172.21.15.178:3300/0 conn(0x7f01ec0689c0 0x7f01ec068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01e2ffd700 1 -- 172.21.15.153:0/2750475405 >> v2:172.21.15.178:3300/0 conn(0x7f01ec0689c0 msgr2=0x7f01ec068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:51.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01e2ffd700 1 --2- 172.21.15.153:0/2750475405 >> v2:172.21.15.178:3300/0 conn(0x7f01ec0689c0 0x7f01ec068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01e2ffd700 1 -- 172.21.15.153:0/2750475405 >> v1:172.21.15.153:6789/0 conn(0x7f01ec151530 legacy=0x7f01ec1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01e2ffd700 1 -- 172.21.15.153:0/2750475405 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec065ff0 con 0x7f01ec1560f0 2023-08-17T00:02:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01eb7fe700 1 --2- 172.21.15.153:0/2750475405 >> v2:172.21.15.178:3300/0 conn(0x7f01ec0689c0 0x7f01ec068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01e2ffd700 1 --2- 172.21.15.153:0/2750475405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0c0270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f01ec0c2d60 tx=0x7f01d40090f0).ready entity=mon.0 client_cookie=f9b791d41eb3b736 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01eaffd700 1 -- 172.21.15.153:0/2750475405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400b600 con 0x7f01ec1560f0 2023-08-17T00:02:51.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01eaffd700 1 -- 172.21.15.153:0/2750475405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d400b760 con 0x7f01ec1560f0 2023-08-17T00:02:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01eaffd700 1 -- 172.21.15.153:0/2750475405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400bae0 con 0x7f01ec1560f0 2023-08-17T00:02:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 -- 172.21.15.153:0/2750475405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 msgr2=0x7f01ec0c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2750475405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0c0270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f01ec0c2d60 tx=0x7f01d40090f0).stop 2023-08-17T00:02:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 -- 172.21.15.153:0/2750475405 shutdown_connections 2023-08-17T00:02:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2750475405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0c0270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2750475405 >> v2:172.21.15.178:3300/0 conn(0x7f01ec0689c0 0x7f01ec068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 -- 172.21.15.153:0/2750475405 >> 172.21.15.153:0/2750475405 conn(0x7f01ec0c6620 msgr2=0x7f01ec0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:51.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 -- 172.21.15.153:0/2750475405 shutdown_connections 2023-08-17T00:02:51.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.963+0000 7f01f0b07700 1 -- 172.21.15.153:0/2750475405 wait complete. 2023-08-17T00:02:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 Processor -- start 2023-08-17T00:02:51.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 -- start start 2023-08-17T00:02:51.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01ec0689c0 0x7f01ec150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01ec151530 0x7f01ec168aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0c1a70 con 0x7f01ec1560f0 2023-08-17T00:02:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec150730 con 0x7f01ec151530 2023-08-17T00:02:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01f0b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec168f90 con 0x7f01ec0689c0 2023-08-17T00:02:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.967+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0bc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33660/0 (socket says 172.21.15.153:33660) 2023-08-17T00:02:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 -- 172.21.15.153:0/2208657487 learned_addr learned my addr 172.21.15.153:0/2208657487 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01e2ffd700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01ec151530 0x7f01ec168aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01eb7fe700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01ec0689c0 0x7f01ec150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 -- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01ec0689c0 msgr2=0x7f01ec150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01ec0689c0 0x7f01ec150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 -- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01ec151530 msgr2=0x7f01ec168aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01ec151530 0x7f01ec168aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 -- 172.21.15.153:0/2208657487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4009370 con 0x7f01ec1560f0 2023-08-17T00:02:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01eb7fe700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01ec0689c0 0x7f01ec150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01ebfff700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0bc0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f01e4002230 tx=0x7f01e40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4010510 con 0x7f01ec1560f0 2023-08-17T00:02:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e4010670 con 0x7f01ec1560f0 2023-08-17T00:02:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0c0e60 con 0x7f01ec1560f0 2023-08-17T00:02:51.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40109f0 con 0x7f01ec1560f0 2023-08-17T00:02:51.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0c1420 con 0x7f01ec1560f0 2023-08-17T00:02:51.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.971+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec0bd5a0 con 0x7f01ec1560f0 2023-08-17T00:02:51.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.975+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f01e4010070 con 0x7f01ec1560f0 2023-08-17T00:02:51.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.975+0000 7f01e3fff700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f01cc05a150 0x7f01cc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:51.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.975+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f01e4073e40 con 0x7f01ec1560f0 2023-08-17T00:02:51.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.975+0000 7f01eb7fe700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f01cc05a150 0x7f01cc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:51.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.975+0000 7f01eb7fe700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f01cc05a150 0x7f01cc05c610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f01dc00bbc0 tx=0x7f01dc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:51.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:51.979+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f01ec0bd5a0 con 0x7f01ec1560f0 2023-08-17T00:02:52.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.147+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01ec0bd5a0 con 0x7f01ec1560f0 2023-08-17T00:02:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.147+0000 7f01e3fff700 1 -- 172.21.15.153:0/2208657487 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f01ec0bd5a0 con 0x7f01ec1560f0 2023-08-17T00:02:52.157 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:52.157 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:51.755211+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:52.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f01cc05a150 msgr2=0x7f01cc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f01cc05a150 0x7f01cc05c610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f01dc00bbc0 tx=0x7f01dc008040).stop 2023-08-17T00:02:52.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 msgr2=0x7f01ec0bc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0bc0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f01e4002230 tx=0x7f01e40015e0).stop 2023-08-17T00:02:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 shutdown_connections 2023-08-17T00:02:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f01cc05a150 0x7f01cc05c610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f01ec1560f0 0x7f01ec0bc0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01ec151530 0x7f01ec168aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 --2- 172.21.15.153:0/2208657487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01ec0689c0 0x7f01ec150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 >> 172.21.15.153:0/2208657487 conn(0x7f01ec0c6620 msgr2=0x7f01ec0c0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 shutdown_connections 2023-08-17T00:02:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.151+0000 7f01f0b07700 1 -- 172.21.15.153:0/2208657487 wait complete. 2023-08-17T00:02:52.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:52.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.331+0000 7f51cdc79700 1 Processor -- start 2023-08-17T00:02:52.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.331+0000 7f51cdc79700 1 -- start start 2023-08-17T00:02:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cdc79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f51c8154370 0x7f51c80c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cdc79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80bfd10 con 0x7f51c8153f50 2023-08-17T00:02:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cdc79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c8154af0 con 0x7f51c80c57a0 2023-08-17T00:02:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cdc79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c8154dd0 con 0x7f51c8154370 2023-08-17T00:02:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f51c8153f50 0x7f51c80c01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33636/0 (socket says 172.21.15.153:33636) 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c7fff700 1 -- 172.21.15.153:0/4042381009 learned_addr learned my addr 172.21.15.153:0/4042381009 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cd478700 1 --2- 172.21.15.153:0/4042381009 >> v2:172.21.15.153:3300/0 conn(0x7f51c8154370 0x7f51c80c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857347591 0 0) 0x7f51c80bfd10 con 0x7f51c8153f50 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51b80033f0 con 0x7f51c8153f50 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280888209 0 0) 0x7f51c8154af0 con 0x7f51c80c57a0 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c80bfd10 con 0x7f51c80c57a0 2023-08-17T00:02:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cd478700 1 -- 172.21.15.153:0/4042381009 >> v1:172.21.15.178:6789/0 conn(0x7f51c80c57a0 legacy=0x7f51c80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cd478700 1 -- 172.21.15.153:0/4042381009 >> v1:172.21.15.153:6789/0 conn(0x7f51c8153f50 legacy=0x7f51c80c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cd478700 1 -- 172.21.15.153:0/4042381009 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80bf9a0 con 0x7f51c8154370 2023-08-17T00:02:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51cd478700 1 --2- 172.21.15.153:0/4042381009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c8154370 0x7f51c80c08b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f51c0009e60 tx=0x7f51c0009780).ready entity=mon.0 client_cookie=71ccfc9aca8612c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c000e070 con 0x7f51c8154370 2023-08-17T00:02:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c000bab0 con 0x7f51c8154370 2023-08-17T00:02:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.335+0000 7f51c77fe700 1 -- 172.21.15.153:0/4042381009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c000be30 con 0x7f51c8154370 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- 172.21.15.153:0/4042381009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c8154370 msgr2=0x7f51c80c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 --2- 172.21.15.153:0/4042381009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c8154370 0x7f51c80c08b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f51c0009e60 tx=0x7f51c0009780).stop 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- 172.21.15.153:0/4042381009 shutdown_connections 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 --2- 172.21.15.153:0/4042381009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c8154370 0x7f51c80c08b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- 172.21.15.153:0/4042381009 >> 172.21.15.153:0/4042381009 conn(0x7f51c8062a70 msgr2=0x7f51c80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- 172.21.15.153:0/4042381009 shutdown_connections 2023-08-17T00:02:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- 172.21.15.153:0/4042381009 wait complete. 2023-08-17T00:02:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 Processor -- start 2023-08-17T00:02:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- start start 2023-08-17T00:02:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 0x7f51c815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c8153f50 0x7f51c8152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c8154370 0x7f51c8152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8152b10 con 0x7f51c80c57a0 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8142e80 con 0x7f51c8153f50 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.339+0000 7f51cdc79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8142270 con 0x7f51c8154370 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 0x7f51c815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 0x7f51c815a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33688/0 (socket says 172.21.15.153:33688) 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 -- 172.21.15.153:0/3020325545 learned_addr learned my addr 172.21.15.153:0/3020325545 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51c7fff700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c8153f50 0x7f51c8152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 -- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c8154370 msgr2=0x7f51c8152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51cd478700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c8154370 0x7f51c8152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c8154370 0x7f51c8152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 -- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c8153f50 msgr2=0x7f51c8152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c8153f50 0x7f51c8152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 -- 172.21.15.153:0/3020325545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c0009a20 con 0x7f51c80c57a0 2023-08-17T00:02:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51c7fff700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c8153f50 0x7f51c8152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51cd478700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c8154370 0x7f51c8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51ccc77700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 0x7f51c815a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f51bc00c3a0 tx=0x7f51bc007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00f470 con 0x7f51c80c57a0 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00f5d0 con 0x7f51c80c57a0 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00f780 con 0x7f51c80c57a0 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c8142550 con 0x7f51c80c57a0 2023-08-17T00:02:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c8142b10 con 0x7f51c80c57a0 2023-08-17T00:02:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.343+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c806b4c0 con 0x7f51c80c57a0 2023-08-17T00:02:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.347+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f51bc010070 con 0x7f51c80c57a0 2023-08-17T00:02:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.347+0000 7f51c4ff9700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f51ac05a150 0x7f51ac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.347+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f51bc073510 con 0x7f51c80c57a0 2023-08-17T00:02:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.347+0000 7f51c7fff700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f51ac05a150 0x7f51ac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.347+0000 7f51c7fff700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f51ac05a150 0x7f51ac05c610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f51b4005750 tx=0x7f51b4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.355+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f51bc046eb0 con 0x7f51c80c57a0 2023-08-17T00:02:52.438 INFO:tasks.ceph.mds.d.smithi178.stderr:2023-08-17T00:02:52.429+0000 7fc46bc88700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:02:52.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.511+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51c81547e0 con 0x7f51c80c57a0 2023-08-17T00:02:52.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.515+0000 7f51c4ff9700 1 -- 172.21.15.153:0/3020325545 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f51bc04a4d0 con 0x7f51c80c57a0 2023-08-17T00:02:52.526 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:52.526 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":21,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:51.755211+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:52.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f51ac05a150 msgr2=0x7f51ac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f51ac05a150 0x7f51ac05c610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f51b4005750 tx=0x7f51b4009040).stop 2023-08-17T00:02:52.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 msgr2=0x7f51c815a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 0x7f51c815a500 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f51bc00c3a0 tx=0x7f51bc007c40).stop 2023-08-17T00:02:52.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 shutdown_connections 2023-08-17T00:02:52.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f51ac05a150 0x7f51ac05c610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51c8154370 0x7f51c8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51c8153f50 0x7f51c8152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 --2- 172.21.15.153:0/3020325545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51c80c57a0 0x7f51c815a500 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 >> 172.21.15.153:0/3020325545 conn(0x7f51c8062a70 msgr2=0x7f51c80ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:52.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 shutdown_connections 2023-08-17T00:02:52.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.519+0000 7f51cdc79700 1 -- 172.21.15.153:0/3020325545 wait complete. 2023-08-17T00:02:52.545 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:02:52.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.699+0000 7fa90dff9700 1 Processor -- start 2023-08-17T00:02:52.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.699+0000 7fa90dff9700 1 -- start start 2023-08-17T00:02:52.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90dff9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 0x7fa9080c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90dff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c11b0 0x7fa908154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90dff9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080bfd10 con 0x7fa908153f50 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90dff9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa908154860 con 0x7fa9080c57a0 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90dff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908154af0 con 0x7fa9080c11b0 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90cff7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 0x7fa9080c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90d7f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c11b0 0x7fa908154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90cff7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 0x7fa9080c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:56214/0 (socket says 172.21.15.153:56214) 2023-08-17T00:02:52.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90cff7700 1 -- 172.21.15.153:0/2573015574 learned_addr learned my addr 172.21.15.153:0/2573015574 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:52.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa907fff700 1 --1- 172.21.15.153:0/2573015574 >> v1:172.21.15.178:6789/0 conn(0x7fa908153f50 0x7fa908157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:54618/0 (socket says 172.21.15.153:54618) 2023-08-17T00:02:52.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90d7f8700 1 -- 172.21.15.153:0/2573015574 >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 msgr2=0x7fa9080c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:52.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90d7f8700 1 --2- 172.21.15.153:0/2573015574 >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 0x7fa9080c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90d7f8700 1 -- 172.21.15.153:0/2573015574 >> v1:172.21.15.178:6789/0 conn(0x7fa908153f50 legacy=0x7fa908157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90d7f8700 1 -- 172.21.15.153:0/2573015574 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa908154dd0 con 0x7fa9080c11b0 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90cff7700 1 --2- 172.21.15.153:0/2573015574 >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 0x7fa9080c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa90d7f8700 1 --2- 172.21.15.153:0/2573015574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c11b0 0x7fa908154370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fa900009e60 tx=0x7fa900009780).ready entity=mon.2 client_cookie=dca3526fda68972f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa9077fe700 1 -- 172.21.15.153:0/2573015574 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000e070 con 0x7fa9080c11b0 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa9077fe700 1 -- 172.21.15.153:0/2573015574 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90000bb60 con 0x7fa9080c11b0 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.703+0000 7fa9077fe700 1 -- 172.21.15.153:0/2573015574 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900012410 con 0x7fa9080c11b0 2023-08-17T00:02:52.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 -- 172.21.15.153:0/2573015574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c11b0 msgr2=0x7fa908154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 --2- 172.21.15.153:0/2573015574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c11b0 0x7fa908154370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fa900009e60 tx=0x7fa900009780).stop 2023-08-17T00:02:52.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 -- 172.21.15.153:0/2573015574 shutdown_connections 2023-08-17T00:02:52.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 --2- 172.21.15.153:0/2573015574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9080c11b0 0x7fa908154370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 --2- 172.21.15.153:0/2573015574 >> v2:172.21.15.178:3300/0 conn(0x7fa9080c57a0 0x7fa9080c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 -- 172.21.15.153:0/2573015574 >> 172.21.15.153:0/2573015574 conn(0x7fa908062a70 msgr2=0x7fa9080ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:52.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 -- 172.21.15.153:0/2573015574 shutdown_connections 2023-08-17T00:02:52.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 -- 172.21.15.153:0/2573015574 wait complete. 2023-08-17T00:02:52.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 Processor -- start 2023-08-17T00:02:52.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.707+0000 7fa90dff9700 1 -- start start 2023-08-17T00:02:52.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080c11b0 0x7fa9080ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 0x7fa908165140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa908153f50 0x7fa9080a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ae4e0 con 0x7fa9080c57a0 2023-08-17T00:02:52.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080ad8d0 con 0x7fa9080c11b0 2023-08-17T00:02:52.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9080adbb0 con 0x7fa908153f50 2023-08-17T00:02:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 0x7fa908165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 0x7fa908165140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33696/0 (socket says 172.21.15.153:33696) 2023-08-17T00:02:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 -- 172.21.15.153:0/3303457768 learned_addr learned my addr 172.21.15.153:0/3303457768 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:52.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90d7f8700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa908153f50 0x7fa9080a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90cff7700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080c11b0 0x7fa9080ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 -- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa908153f50 msgr2=0x7fa9080a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa908153f50 0x7fa9080a9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 -- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080c11b0 msgr2=0x7fa9080ac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080c11b0 0x7fa9080ac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 -- 172.21.15.153:0/3303457768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8fc009370 con 0x7fa9080c57a0 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa907fff700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 0x7fa908165140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa8f4007fd0 tx=0x7fa8f4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f400ce10 con 0x7fa9080c57a0 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f40072e0 con 0x7fa9080c57a0 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa900009a20 con 0x7fa9080c57a0 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f40056e0 con 0x7fa9080c57a0 2023-08-17T00:02:52.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.711+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9080ae170 con 0x7fa9080c57a0 2023-08-17T00:02:52.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.715+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90806b4c0 con 0x7fa9080c57a0 2023-08-17T00:02:52.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.715+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa8f4010070 con 0x7fa9080c57a0 2023-08-17T00:02:52.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.715+0000 7fa904ff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa8ec05a150 0x7fa8ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:52.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.715+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa8f40736b0 con 0x7fa9080c57a0 2023-08-17T00:02:52.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.719+0000 7fa90cff7700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa8ec05a150 0x7fa8ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:52.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.719+0000 7fa90cff7700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa8ec05a150 0x7fa8ec05c610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa8fc006fd0 tx=0x7fa8fc0090f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:52.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.723+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa8f40471e0 con 0x7fa9080c57a0 2023-08-17T00:02:52.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:52.919+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa9080ae330 con 0x7fa9080c57a0 2023-08-17T00:02:53.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.771+0000 7fa904ff9700 1 -- 172.21.15.153:0/3303457768 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa8f404a800 con 0x7fa9080c57a0 2023-08-17T00:02:53.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa8ec05a150 msgr2=0x7fa8ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa8ec05a150 0x7fa8ec05c610 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fa8fc006fd0 tx=0x7fa8fc0090f0).stop 2023-08-17T00:02:53.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 msgr2=0x7fa908165140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 0x7fa908165140 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa8f4007fd0 tx=0x7fa8f4007df0).stop 2023-08-17T00:02:53.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 shutdown_connections 2023-08-17T00:02:53.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa8ec05a150 0x7fa8ec05c610 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa908153f50 0x7fa9080a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9080c57a0 0x7fa908165140 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 --2- 172.21.15.153:0/3303457768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9080c11b0 0x7fa9080ac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 >> 172.21.15.153:0/3303457768 conn(0x7fa908062a70 msgr2=0x7fa908157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:53.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 shutdown_connections 2023-08-17T00:02:53.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.775+0000 7fa90dff9700 1 -- 172.21.15.153:0/3303457768 wait complete. 2023-08-17T00:02:53.807 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:02:53.808 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:02:53.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.967+0000 7fe5b8b79700 1 Processor -- start 2023-08-17T00:02:53.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.967+0000 7fe5b8b79700 1 -- start start 2023-08-17T00:02:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5b4151c40 0x7fe5b41560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b4065da0 con 0x7fe5b4068da0 2023-08-17T00:02:53.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b4155c60 con 0x7fe5b40689c0 2023-08-17T00:02:53.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b4069200 con 0x7fe5b4151c40 2023-08-17T00:02:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5b4151c40 0x7fe5b41560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5abfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe5b4068da0 0x7fe5b4151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33640/0 (socket says 172.21.15.153:33640) 2023-08-17T00:02:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5abfff700 1 -- 172.21.15.153:0/394393282 learned_addr learned my addr 172.21.15.153:0/394393282 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b3fff700 1 -- 172.21.15.153:0/394393282 >> v1:172.21.15.178:6789/0 conn(0x7fe5b40689c0 legacy=0x7fe5b40c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b3fff700 1 -- 172.21.15.153:0/394393282 >> v1:172.21.15.153:6789/0 conn(0x7fe5b4068da0 legacy=0x7fe5b4151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b3fff700 1 -- 172.21.15.153:0/394393282 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b4065ff0 con 0x7fe5b4151c40 2023-08-17T00:02:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b3fff700 1 --2- 172.21.15.153:0/394393282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b4151c40 0x7fe5b41560f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe5ac009e60 tx=0x7fe5ac009780).ready entity=mon.0 client_cookie=73ec991614bc4183 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b2ffd700 1 -- 172.21.15.153:0/394393282 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00e070 con 0x7fe5b4151c40 2023-08-17T00:02:53.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b2ffd700 1 -- 172.21.15.153:0/394393282 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ac00bc30 con 0x7fe5b4151c40 2023-08-17T00:02:53.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b2ffd700 1 -- 172.21.15.153:0/394393282 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac012410 con 0x7fe5b4151c40 2023-08-17T00:02:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- 172.21.15.153:0/394393282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b4151c40 msgr2=0x7fe5b41560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/394393282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b4151c40 0x7fe5b41560f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fe5ac009e60 tx=0x7fe5ac009780).stop 2023-08-17T00:02:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- 172.21.15.153:0/394393282 shutdown_connections 2023-08-17T00:02:53.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/394393282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b4151c40 0x7fe5b41560f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- 172.21.15.153:0/394393282 >> 172.21.15.153:0/394393282 conn(0x7fe5b40c6620 msgr2=0x7fe5b40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:53.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- 172.21.15.153:0/394393282 shutdown_connections 2023-08-17T00:02:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- 172.21.15.153:0/394393282 wait complete. 2023-08-17T00:02:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 Processor -- start 2023-08-17T00:02:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- start start 2023-08-17T00:02:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 0x7fe5b41682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5b4068da0 0x7fe5b40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5b4151c40 0x7fe5b4153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b41688e0 con 0x7fe5b40689c0 2023-08-17T00:02:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40a8810 con 0x7fe5b4068da0 2023-08-17T00:02:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.971+0000 7fe5b8b79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b41645e0 con 0x7fe5b4151c40 2023-08-17T00:02:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 0x7fe5b41682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 0x7fe5b41682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33710/0 (socket says 172.21.15.153:33710) 2023-08-17T00:02:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 -- 172.21.15.153:0/2349985796 learned_addr learned my addr 172.21.15.153:0/2349985796 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b3fff700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5b4151c40 0x7fe5b4153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:53.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 -- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5b4151c40 msgr2=0x7fe5b4153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5abfff700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5b4068da0 0x7fe5b40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:53.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5b4151c40 0x7fe5b4153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 -- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5b4068da0 msgr2=0x7fe5b40a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:53.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5b4068da0 0x7fe5b40a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 -- 172.21.15.153:0/2349985796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac009a20 con 0x7fe5b40689c0 2023-08-17T00:02:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5abfff700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5b4068da0 0x7fe5b40a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b37fe700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 0x7fe5b41682e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe5a400c470 tx=0x7fe5a4007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4007020 con 0x7fe5b40689c0 2023-08-17T00:02:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4007180 con 0x7fe5b40689c0 2023-08-17T00:02:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b40a3d60 con 0x7fe5b40689c0 2023-08-17T00:02:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4007520 con 0x7fe5b40689c0 2023-08-17T00:02:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b40a8250 con 0x7fe5b40689c0 2023-08-17T00:02:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.975+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b41643b0 con 0x7fe5b40689c0 2023-08-17T00:02:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.979+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe5a4010070 con 0x7fe5b40689c0 2023-08-17T00:02:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.979+0000 7fe5ab7fe700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe59405a150 0x7fe59405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.979+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe5a4073a70 con 0x7fe5b40689c0 2023-08-17T00:02:53.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.979+0000 7fe5abfff700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe59405a150 0x7fe59405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:53.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.979+0000 7fe5abfff700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe59405a150 0x7fe59405c610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe5b40c5df0 tx=0x7fe59c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:53.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:53.987+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5b41643b0 con 0x7fe5b40689c0 2023-08-17T00:02:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.179+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe5b41643b0 con 0x7fe5b40689c0 2023-08-17T00:02:54.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.783+0000 7fe5ab7fe700 1 -- 172.21.15.153:0/2349985796 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5b41643b0 con 0x7fe5b40689c0 2023-08-17T00:02:54.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe59405a150 msgr2=0x7fe59405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:54.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe59405a150 0x7fe59405c610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fe5b40c5df0 tx=0x7fe59c009040).stop 2023-08-17T00:02:54.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 msgr2=0x7fe5b41682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:54.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 0x7fe5b41682e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fe5a400c470 tx=0x7fe5a4007df0).stop 2023-08-17T00:02:54.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 shutdown_connections 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe59405a150 0x7fe59405c610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5b4151c40 0x7fe5b4153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5b4068da0 0x7fe5b40a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 --2- 172.21.15.153:0/2349985796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5b40689c0 0x7fe5b41682e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 >> 172.21.15.153:0/2349985796 conn(0x7fe5b40c6620 msgr2=0x7fe5b40a9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 shutdown_connections 2023-08-17T00:02:54.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.787+0000 7fe5b8b79700 1 -- 172.21.15.153:0/2349985796 wait complete. 2023-08-17T00:02:54.813 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:02:54.814 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:02:54.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.967+0000 7fa38af07700 1 Processor -- start 2023-08-17T00:02:54.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.967+0000 7fa38af07700 1 -- start start 2023-08-17T00:02:54.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa38af07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa384069250 0x7fa384069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:54.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa38af07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa384154ae0 con 0x7fa3840c1190 2023-08-17T00:02:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa38af07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa384064fd0 con 0x7fa384065d90 2023-08-17T00:02:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa38af07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3840652b0 con 0x7fa384069250 2023-08-17T00:02:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa384069250 0x7fa384069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:54.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa384069250 0x7fa384069630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55766/0 (socket says 172.21.15.153:55766) 2023-08-17T00:02:54.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 -- 172.21.15.153:0/3446082296 learned_addr learned my addr 172.21.15.153:0/3446082296 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:54.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 -- 172.21.15.153:0/3446082296 >> v1:172.21.15.178:6789/0 conn(0x7fa384065d90 legacy=0x7fa3840c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:54.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 -- 172.21.15.153:0/3446082296 >> v1:172.21.15.153:6789/0 conn(0x7fa3840c1190 legacy=0x7fa384153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:54.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 -- 172.21.15.153:0/3446082296 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa384065590 con 0x7fa384069250 2023-08-17T00:02:54.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa389f05700 1 --2- 172.21.15.153:0/3446082296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384069630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa380006fd0 tx=0x7fa3800090f0).ready entity=mon.0 client_cookie=17223d59b54b2366 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:54.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa388f03700 1 -- 172.21.15.153:0/3446082296 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000b600 con 0x7fa384069250 2023-08-17T00:02:54.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa388f03700 1 -- 172.21.15.153:0/3446082296 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38000b760 con 0x7fa384069250 2023-08-17T00:02:54.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.971+0000 7fa388f03700 1 -- 172.21.15.153:0/3446082296 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000bb00 con 0x7fa384069250 2023-08-17T00:02:54.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 -- 172.21.15.153:0/3446082296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 msgr2=0x7fa384069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:54.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 --2- 172.21.15.153:0/3446082296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384069630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fa380006fd0 tx=0x7fa3800090f0).stop 2023-08-17T00:02:54.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 -- 172.21.15.153:0/3446082296 shutdown_connections 2023-08-17T00:02:54.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 --2- 172.21.15.153:0/3446082296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384069630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 -- 172.21.15.153:0/3446082296 >> 172.21.15.153:0/3446082296 conn(0x7fa3840c6620 msgr2=0x7fa3840c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:54.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 -- 172.21.15.153:0/3446082296 shutdown_connections 2023-08-17T00:02:54.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 -- 172.21.15.153:0/3446082296 wait complete. 2023-08-17T00:02:54.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.975+0000 7fa38af07700 1 Processor -- start 2023-08-17T00:02:54.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 -- start start 2023-08-17T00:02:54.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa384065d90 0x7fa384156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3840c1190 0x7fa3840a7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384156660 con 0x7fa384069250 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa384155770 con 0x7fa384065d90 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa384155a50 con 0x7fa3840c1190 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:54.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55770/0 (socket says 172.21.15.153:55770) 2023-08-17T00:02:54.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 -- 172.21.15.153:0/3344187334 learned_addr learned my addr 172.21.15.153:0/3344187334 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:54.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389f05700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa384065d90 0x7fa384156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:54.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38a706700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3840c1190 0x7fa3840a7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:54.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 -- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3840c1190 msgr2=0x7fa3840a7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:54.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3840c1190 0x7fa3840a7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 -- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa384065d90 msgr2=0x7fa384156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:54.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa384065d90 0x7fa384156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:54.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 -- 172.21.15.153:0/3344187334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa380009310 con 0x7fa384069250 2023-08-17T00:02:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa389704700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384149b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa37400b460 tx=0x7fa374006f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374012410 con 0x7fa384069250 2023-08-17T00:02:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3740125b0 con 0x7fa384069250 2023-08-17T00:02:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa374012970 con 0x7fa384069250 2023-08-17T00:02:54.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.979+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa384155d30 con 0x7fa384069250 2023-08-17T00:02:54.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.983+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3841562f0 con 0x7fa384069250 2023-08-17T00:02:54.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.983+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38406b4c0 con 0x7fa384069250 2023-08-17T00:02:54.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.983+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa37400f030 con 0x7fa384069250 2023-08-17T00:02:54.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.987+0000 7fa379ffb700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa36805a180 0x7fa36805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:54.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.987+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa374073bc0 con 0x7fa384069250 2023-08-17T00:02:54.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.987+0000 7fa389f05700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa36805a180 0x7fa36805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:54.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.987+0000 7fa389f05700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa36805a180 0x7fa36805c640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa380009130 tx=0x7fa380017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:54.991+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa374047560 con 0x7fa384069250 2023-08-17T00:02:55.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.187+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa384064010 con 0x7fa384069250 2023-08-17T00:02:55.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.187+0000 7fa379ffb700 1 -- 172.21.15.153:0/3344187334 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7fa37404ab80 con 0x7fa384069250 2023-08-17T00:02:55.193 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:55.193 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:02:55.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa36805a180 msgr2=0x7fa36805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa36805a180 0x7fa36805c640 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa380009130 tx=0x7fa380017000).stop 2023-08-17T00:02:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 msgr2=0x7fa384149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384149b80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa37400b460 tx=0x7fa374006f20).stop 2023-08-17T00:02:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 shutdown_connections 2023-08-17T00:02:55.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa36805a180 0x7fa36805c640 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3840c1190 0x7fa3840a7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa384069250 0x7fa384149b80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 --2- 172.21.15.153:0/3344187334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa384065d90 0x7fa384156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 >> 172.21.15.153:0/3344187334 conn(0x7fa3840c6620 msgr2=0x7fa3840c1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:55.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 shutdown_connections 2023-08-17T00:02:55.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.191+0000 7fa38af07700 1 -- 172.21.15.153:0/3344187334 wait complete. 2023-08-17T00:02:55.201 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:02:55.215 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:55.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 Processor -- start 2023-08-17T00:02:55.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 -- start start 2023-08-17T00:02:55.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa71c0689c0 0x7fa71c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 0x7fa71c0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c065da0 con 0x7fa71c151530 2023-08-17T00:02:55.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c155c60 con 0x7fa71c0689c0 2023-08-17T00:02:55.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721879700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c156550 con 0x7fa71c1560f0 2023-08-17T00:02:55.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721078700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa71c151530 0x7fa71c1519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35622/0 (socket says 172.21.15.153:35622) 2023-08-17T00:02:55.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa721078700 1 -- 172.21.15.153:0/4141216463 learned_addr learned my addr 172.21.15.153:0/4141216463 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:55.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579408413 0 0) 0x7fa71c065da0 con 0x7fa71c151530 2023-08-17T00:02:55.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa720877700 1 --2- 172.21.15.153:0/4141216463 >> v2:172.21.15.178:3300/0 conn(0x7fa71c0689c0 0x7fa71c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa713fff700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 0x7fa71c0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.367+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7040033f0 con 0x7fa71c151530 2023-08-17T00:02:55.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1489923457 0 0) 0x7fa7040033f0 con 0x7fa71c151530 2023-08-17T00:02:55.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 msgr2=0x7fa71c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:55.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 0x7fa71c0c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 >> v2:172.21.15.178:3300/0 conn(0x7fa71c0689c0 msgr2=0x7fa71c068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 --2- 172.21.15.153:0/4141216463 >> v2:172.21.15.178:3300/0 conn(0x7fa71c0689c0 0x7fa71c068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c065ff0 con 0x7fa71c151530 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fa7140017f0 con 0x7fa71c151530 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 >> v1:172.21.15.153:6789/0 conn(0x7fa71c151530 legacy=0x7fa71c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7040038e0 0x7fa704003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa704004690 0x7fa704004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 0x7fa704005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c155c60 con 0x7fa7040038e0 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c156550 con 0x7fa704004690 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70400b8e0 con 0x7fa71c1560f0 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7040038e0 0x7fa704003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa721078700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 0x7fa704005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 -- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 msgr2=0x7fa704005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c1560f0 0x7fa704005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa713fff700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa704004690 0x7fa704004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 -- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa704004690 msgr2=0x7fa704004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa704004690 0x7fa704004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 -- 172.21.15.153:0/4141216463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040033f0 con 0x7fa7040038e0 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa713fff700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa704004690 0x7fa704004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa720877700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7040038e0 0x7fa704003d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa718006fd0 tx=0x7fa718006f40).ready entity=mon.0 client_cookie=34d8621080bb83c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718009430 con 0x7fa7040038e0 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71800e640 con 0x7fa7040038e0 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa7137fe700 1 -- 172.21.15.153:0/4141216463 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71800e9c0 con 0x7fa7040038e0 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa721879700 1 -- 172.21.15.153:0/4141216463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7040038e0 msgr2=0x7fa704003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa721879700 1 --2- 172.21.15.153:0/4141216463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7040038e0 0x7fa704003d00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fa718006fd0 tx=0x7fa718006f40).stop 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.371+0000 7fa721078700 1 -- 172.21.15.153:0/4141216463 reap_dead start 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.375+0000 7fa721879700 1 -- 172.21.15.153:0/4141216463 shutdown_connections 2023-08-17T00:02:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.375+0000 7fa721879700 1 -- 172.21.15.153:0/4141216463 >> 172.21.15.153:0/4141216463 conn(0x7fa71c0c6620 msgr2=0x7fa71c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:55.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.375+0000 7fa721879700 1 -- 172.21.15.153:0/4141216463 shutdown_connections 2023-08-17T00:02:55.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.375+0000 7fa721879700 1 -- 172.21.15.153:0/4141216463 wait complete. 2023-08-17T00:02:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.375+0000 7fa721879700 1 Processor -- start 2023-08-17T00:02:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.375+0000 7fa721879700 1 -- start start 2023-08-17T00:02:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7040038e0 0x7fa71c0ba960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 0x7fa71c163f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c0bc290 0x7fa71c0bc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0bbe70 con 0x7fa71c153540 2023-08-17T00:02:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c167290 con 0x7fa7040038e0 2023-08-17T00:02:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0bb1f0 con 0x7fa71c0bc290 2023-08-17T00:02:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 0x7fa71c163f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 0x7fa71c163f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55790/0 (socket says 172.21.15.153:55790) 2023-08-17T00:02:55.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 -- 172.21.15.153:0/3826965357 learned_addr learned my addr 172.21.15.153:0/3826965357 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:55.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa720877700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7040038e0 0x7fa71c0ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721078700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c0bc290 0x7fa71c0bc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 -- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c0bc290 msgr2=0x7fa71c0bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c0bc290 0x7fa71c0bc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 -- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7040038e0 msgr2=0x7fa71c0ba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7040038e0 0x7fa71c0ba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 -- 172.21.15.153:0/3826965357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0bb4d0 con 0x7fa71c153540 2023-08-17T00:02:55.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa713fff700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 0x7fa71c163f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa70c010a70 tx=0x7fa70c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:55.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c010e50 con 0x7fa71c153540 2023-08-17T00:02:55.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00e870 con 0x7fa71c153540 2023-08-17T00:02:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c0bb7b0 con 0x7fa71c153540 2023-08-17T00:02:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00ebf0 con 0x7fa71c153540 2023-08-17T00:02:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c0bae50 con 0x7fa71c153540 2023-08-17T00:02:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.379+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c0bbfb0 con 0x7fa71c153540 2023-08-17T00:02:55.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.383+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa70c024070 con 0x7fa71c153540 2023-08-17T00:02:55.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.383+0000 7fa710ff9700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa70805a180 0x7fa70805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.383+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa70c074640 con 0x7fa71c153540 2023-08-17T00:02:55.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.383+0000 7fa720877700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa70805a180 0x7fa70805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.387+0000 7fa720877700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa70805a180 0x7fa70805c640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa718006f80 tx=0x7fa71801a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:55.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.391+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa71c0bbfb0 con 0x7fa71c153540 2023-08-17T00:02:55.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.551+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa71c0bbfb0 con 0x7fa71c153540 2023-08-17T00:02:55.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.555+0000 7fa710ff9700 1 -- 172.21.15.153:0/3826965357 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fa71c0bbfb0 con 0x7fa71c153540 2023-08-17T00:02:55.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:55.559 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:55.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa70805a180 msgr2=0x7fa70805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa70805a180 0x7fa70805c640 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa718006f80 tx=0x7fa71801a000).stop 2023-08-17T00:02:55.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 msgr2=0x7fa71c163f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 0x7fa71c163f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fa70c010a70 tx=0x7fa70c008040).stop 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 shutdown_connections 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa70805a180 0x7fa70805c640 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa71c0bc290 0x7fa71c0bc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa71c153540 0x7fa71c163f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 --2- 172.21.15.153:0/3826965357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7040038e0 0x7fa71c0ba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 >> 172.21.15.153:0/3826965357 conn(0x7fa71c0c6620 msgr2=0x7fa71c1519c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 shutdown_connections 2023-08-17T00:02:55.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.559+0000 7fa721879700 1 -- 172.21.15.153:0/3826965357 wait complete. 2023-08-17T00:02:55.583 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:02:55.584 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:02:55.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 Processor -- start 2023-08-17T00:02:55.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 -- start start 2023-08-17T00:02:55.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b80689c0 0x7f46b8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46b81560f0 0x7f46b80c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b8065da0 con 0x7f46b8151530 2023-08-17T00:02:55.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b8155c60 con 0x7f46b81560f0 2023-08-17T00:02:55.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.735+0000 7f46bca1a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8156550 con 0x7f46b80689c0 2023-08-17T00:02:55.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b759e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46b8151530 0x7f46b81519e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35628/0 (socket says 172.21.15.153:35628) 2023-08-17T00:02:55.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b759e700 1 -- 172.21.15.153:0/2413020501 learned_addr learned my addr 172.21.15.153:0/2413020501 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:55.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46ae59c700 1 --2- 172.21.15.153:0/2413020501 >> v2:172.21.15.153:3300/0 conn(0x7f46b81560f0 0x7f46b80c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b6d9d700 1 --2- 172.21.15.153:0/2413020501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b80689c0 0x7f46b8068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b659c700 1 -- 172.21.15.153:0/2413020501 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098859870 0 0) 0x7f46b8065da0 con 0x7f46b8151530 2023-08-17T00:02:55.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b659c700 1 -- 172.21.15.153:0/2413020501 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a40033f0 con 0x7f46b8151530 2023-08-17T00:02:55.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46ae59c700 1 -- 172.21.15.153:0/2413020501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b80689c0 msgr2=0x7f46b8068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:55.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46ae59c700 1 --2- 172.21.15.153:0/2413020501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b80689c0 0x7f46b8068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46ae59c700 1 -- 172.21.15.153:0/2413020501 >> v1:172.21.15.153:6789/0 conn(0x7f46b8151530 legacy=0x7f46b81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46ae59c700 1 -- 172.21.15.153:0/2413020501 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b8065ff0 con 0x7f46b81560f0 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46ae59c700 1 --2- 172.21.15.153:0/2413020501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b80c0270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f46a0009790 tx=0x7f46a0009060).ready entity=mon.0 client_cookie=283e33c4f6797286 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b659c700 1 -- 172.21.15.153:0/2413020501 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00090d0 con 0x7f46b81560f0 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b659c700 1 -- 172.21.15.153:0/2413020501 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000d4a0 con 0x7f46b81560f0 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46b659c700 1 -- 172.21.15.153:0/2413020501 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000d820 con 0x7f46b81560f0 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 -- 172.21.15.153:0/2413020501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 msgr2=0x7f46b80c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 --2- 172.21.15.153:0/2413020501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b80c0270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f46a0009790 tx=0x7f46a0009060).stop 2023-08-17T00:02:55.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 -- 172.21.15.153:0/2413020501 shutdown_connections 2023-08-17T00:02:55.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 --2- 172.21.15.153:0/2413020501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b80c0270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 --2- 172.21.15.153:0/2413020501 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b80689c0 0x7f46b8068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 -- 172.21.15.153:0/2413020501 >> 172.21.15.153:0/2413020501 conn(0x7f46b80c6620 msgr2=0x7f46b80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:55.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 -- 172.21.15.153:0/2413020501 shutdown_connections 2023-08-17T00:02:55.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.739+0000 7f46bca1a700 1 -- 172.21.15.153:0/2413020501 wait complete. 2023-08-17T00:02:55.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.743+0000 7f46bca1a700 1 Processor -- start 2023-08-17T00:02:55.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.743+0000 7f46bca1a700 1 -- start start 2023-08-17T00:02:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46b80689c0 0x7f46b80a7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b8151530 0x7f46b80bc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b81676c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8152960 con 0x7f46b81560f0 2023-08-17T00:02:55.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8152c40 con 0x7f46b80689c0 2023-08-17T00:02:55.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8152f20 con 0x7f46b8151530 2023-08-17T00:02:55.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b81676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46b80689c0 0x7f46b80a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b81676c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55806/0 (socket says 172.21.15.153:55806) 2023-08-17T00:02:55.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 -- 172.21.15.153:0/3982528901 learned_addr learned my addr 172.21.15.153:0/3982528901 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:55.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46ae59c700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b8151530 0x7f46b80bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 -- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b8151530 msgr2=0x7f46b80bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b8151530 0x7f46b80bc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 -- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46b80689c0 msgr2=0x7f46b80a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46b80689c0 0x7f46b80a7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 -- 172.21.15.153:0/3982528901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00092a0 con 0x7f46b81560f0 2023-08-17T00:02:55.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46b759e700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b81676c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f46b0005ad0 tx=0x7f46b0001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:55.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005d30 con 0x7f46b81560f0 2023-08-17T00:02:55.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0005e90 con 0x7f46b81560f0 2023-08-17T00:02:55.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0007320 con 0x7f46b81560f0 2023-08-17T00:02:55.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b8153200 con 0x7f46b81560f0 2023-08-17T00:02:55.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b81534e0 con 0x7f46b81560f0 2023-08-17T00:02:55.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.747+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b80ba020 con 0x7f46b81560f0 2023-08-17T00:02:55.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.751+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f46b0010030 con 0x7f46b81560f0 2023-08-17T00:02:55.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.751+0000 7f46af7fe700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f469805a150 0x7f469805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:55.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.751+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f46b0073f70 con 0x7f46b81560f0 2023-08-17T00:02:55.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.751+0000 7f46b6d9d700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f469805a150 0x7f469805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:55.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.751+0000 7f46b6d9d700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f469805a150 0x7f469805c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f46a8006fd0 tx=0x7f46a8006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:55.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.759+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46b00a28f0 con 0x7f46b81560f0 2023-08-17T00:02:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.919+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46b80662d0 con 0x7f469805a150 2023-08-17T00:02:55.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.939+0000 7f46af7fe700 1 -- 172.21.15.153:0/3982528901 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336319 (secure 0 0 0) 0x7f46b80662d0 con 0x7f469805a150 2023-08-17T00:02:55.949 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f469805a150 msgr2=0x7f469805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f469805a150 0x7f469805c610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f46a8006fd0 tx=0x7f46a8006f40).stop 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 msgr2=0x7f46b81676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b81676c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f46b0005ad0 tx=0x7f46b0001650).stop 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 shutdown_connections 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f469805a150 0x7f469805c610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46b81560f0 0x7f46b81676c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46b8151530 0x7f46b80bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 --2- 172.21.15.153:0/3982528901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46b80689c0 0x7f46b80a7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:55.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 >> 172.21.15.153:0/3982528901 conn(0x7f46b80c6620 msgr2=0x7f46b8062ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 shutdown_connections 2023-08-17T00:02:55.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:55.947+0000 7f46bca1a700 1 -- 172.21.15.153:0/3982528901 wait complete. 2023-08-17T00:02:55.955 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:02:55.973 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T00:02:55.166778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":669868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.794978+0000","last_change":"2023-08-17T00:02:51.792258+0000","last_active":"2023-08-17T00:02:51.794978+0000","last_peered":"2023-08-17T00:02:51.794978+0000","last_clean":"2023-08-17T00:02:51.794978+0000","last_became_active":"2023-08-17T00:02:51.791987+0000","last_became_peered":"2023-08-17T00:02:51.791987+0000","last_unstale":"2023-08-17T00:02:51.794978+0000","last_undegraded":"2023-08-17T00:02:51.794978+0000","last_fullsized":"2023-08-17T00:02:51.794978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774573+0000","last_change":"2023-08-17T00:02:51.339335+0000","last_active":"2023-08-17T00:02:51.774573+0000","last_peered":"2023-08-17T00:02:51.774573+0000","last_clean":"2023-08-17T00:02:51.774573+0000","last_became_active":"2023-08-17T00:02:51.338962+0000","last_became_peered":"2023-08-17T00:02:51.338962+0000","last_unstale":"2023-08-17T00:02:51.774573+0000","last_undegraded":"2023-08-17T00:02:51.774573+0000","last_fullsized":"2023-08-17T00:02:51.774573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802676+0000","last_change":"2023-08-17T00:02:51.791169+0000","last_active":"2023-08-17T00:02:51.802676+0000","last_peered":"2023-08-17T00:02:51.802676+0000","last_clean":"2023-08-17T00:02:51.802676+0000","last_became_active":"2023-08-17T00:02:51.790753+0000","last_became_peered":"2023-08-17T00:02:51.790753+0000","last_unstale":"2023-08-17T00:02:51.802676+0000","last_undegraded":"2023-08-17T00:02:51.802676+0000","last_fullsized":"2023-08-17T00:02:51.802676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802597+0000","last_change":"2023-08-17T00:02:51.349913+0000","last_active":"2023-08-17T00:02:51.802597+0000","last_peered":"2023-08-17T00:02:51.802597+0000","last_clean":"2023-08-17T00:02:51.802597+0000","last_became_active":"2023-08-17T00:02:51.349595+0000","last_became_peered":"2023-08-17T00:02:51.349595+0000","last_unstale":"2023-08-17T00:02:51.802597+0000","last_undegraded":"2023-08-17T00:02:51.802597+0000","last_fullsized":"2023-08-17T00:02:51.802597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770825+0000","last_change":"2023-08-17T00:02:51.342535+0000","last_active":"2023-08-17T00:02:51.770825+0000","last_peered":"2023-08-17T00:02:51.770825+0000","last_clean":"2023-08-17T00:02:51.770825+0000","last_became_active":"2023-08-17T00:02:51.342270+0000","last_became_peered":"2023-08-17T00:02:51.342270+0000","last_unstale":"2023-08-17T00:02:51.770825+0000","last_undegraded":"2023-08-17T00:02:51.770825+0000","last_fullsized":"2023-08-17T00:02:51.770825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802817+0000","last_change":"2023-08-17T00:02:51.794750+0000","last_active":"2023-08-17T00:02:51.802817+0000","last_peered":"2023-08-17T00:02:51.802817+0000","last_clean":"2023-08-17T00:02:51.802817+0000","last_became_active":"2023-08-17T00:02:51.794394+0000","last_became_peered":"2023-08-17T00:02:51.794394+0000","last_unstale":"2023-08-17T00:02:51.802817+0000","last_undegraded":"2023-08-17T00:02:51.802817+0000","last_fullsized":"2023-08-17T00:02:51.802817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.786225+0000","last_change":"2023-08-17T00:02:51.360726+0000","last_active":"2023-08-17T00:02:51.786225+0000","last_peered":"2023-08-17T00:02:51.786225+0000","last_clean":"2023-08-17T00:02:51.786225+0000","last_became_active":"2023-08-17T00:02:51.360479+0000","last_became_peered":"2023-08-17T00:02:51.360479+0000","last_unstale":"2023-08-17T00:02:51.786225+0000","last_undegraded":"2023-08-17T00:02:51.786225+0000","last_fullsized":"2023-08-17T00:02:51.786225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800703+0000","last_change":"2023-08-17T00:02:51.787355+0000","last_active":"2023-08-17T00:02:51.800703+0000","last_peered":"2023-08-17T00:02:51.800703+0000","last_clean":"2023-08-17T00:02:51.800703+0000","last_became_active":"2023-08-17T00:02:51.787048+0000","last_became_peered":"2023-08-17T00:02:51.787048+0000","last_unstale":"2023-08-17T00:02:51.800703+0000","last_undegraded":"2023-08-17T00:02:51.800703+0000","last_fullsized":"2023-08-17T00:02:51.800703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803300+0000","last_change":"2023-08-17T00:02:51.338960+0000","last_active":"2023-08-17T00:02:51.803300+0000","last_peered":"2023-08-17T00:02:51.803300+0000","last_clean":"2023-08-17T00:02:51.803300+0000","last_became_active":"2023-08-17T00:02:51.338664+0000","last_became_peered":"2023-08-17T00:02:51.338664+0000","last_unstale":"2023-08-17T00:02:51.803300+0000","last_undegraded":"2023-08-17T00:02:51.803300+0000","last_fullsized":"2023-08-17T00:02:51.803300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802710+0000","last_change":"2023-08-17T00:02:51.799132+0000","last_active":"2023-08-17T00:02:51.802710+0000","last_peered":"2023-08-17T00:02:51.802710+0000","last_clean":"2023-08-17T00:02:51.802710+0000","last_became_active":"2023-08-17T00:02:51.798805+0000","last_became_peered":"2023-08-17T00:02:51.798805+0000","last_unstale":"2023-08-17T00:02:51.802710+0000","last_undegraded":"2023-08-17T00:02:51.802710+0000","last_fullsized":"2023-08-17T00:02:51.802710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775014+0000","last_change":"2023-08-17T00:02:51.346796+0000","last_active":"2023-08-17T00:02:51.775014+0000","last_peered":"2023-08-17T00:02:51.775014+0000","last_clean":"2023-08-17T00:02:51.775014+0000","last_became_active":"2023-08-17T00:02:51.346406+0000","last_became_peered":"2023-08-17T00:02:51.346406+0000","last_unstale":"2023-08-17T00:02:51.775014+0000","last_undegraded":"2023-08-17T00:02:51.775014+0000","last_fullsized":"2023-08-17T00:02:51.775014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803115+0000","last_change":"2023-08-17T00:02:51.799601+0000","last_active":"2023-08-17T00:02:51.803115+0000","last_peered":"2023-08-17T00:02:51.803115+0000","last_clean":"2023-08-17T00:02:51.803115+0000","last_became_active":"2023-08-17T00:02:51.795434+0000","last_became_peered":"2023-08-17T00:02:51.795434+0000","last_unstale":"2023-08-17T00:02:51.803115+0000","last_undegraded":"2023-08-17T00:02:51.803115+0000","last_fullsized":"2023-08-17T00:02:51.803115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799219+0000","last_change":"2023-08-17T00:02:51.349039+0000","last_active":"2023-08-17T00:02:51.799219+0000","last_peered":"2023-08-17T00:02:51.799219+0000","last_clean":"2023-08-17T00:02:51.799219+0000","last_became_active":"2023-08-17T00:02:51.348701+0000","last_became_peered":"2023-08-17T00:02:51.348701+0000","last_unstale":"2023-08-17T00:02:51.799219+0000","last_undegraded":"2023-08-17T00:02:51.799219+0000","last_fullsized":"2023-08-17T00:02:51.799219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799387+0000","last_change":"2023-08-17T00:02:51.792387+0000","last_active":"2023-08-17T00:02:51.799387+0000","last_peered":"2023-08-17T00:02:51.799387+0000","last_clean":"2023-08-17T00:02:51.799387+0000","last_became_active":"2023-08-17T00:02:51.792133+0000","last_became_peered":"2023-08-17T00:02:51.792133+0000","last_unstale":"2023-08-17T00:02:51.799387+0000","last_undegraded":"2023-08-17T00:02:51.799387+0000","last_fullsized":"2023-08-17T00:02:51.799387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767037+0000","last_change":"2023-08-17T00:02:51.342138+0000","last_active":"2023-08-17T00:02:51.767037+0000","last_peered":"2023-08-17T00:02:51.767037+0000","last_clean":"2023-08-17T00:02:51.767037+0000","last_became_active":"2023-08-17T00:02:51.341316+0000","last_became_peered":"2023-08-17T00:02:51.341316+0000","last_unstale":"2023-08-17T00:02:51.767037+0000","last_undegraded":"2023-08-17T00:02:51.767037+0000","last_fullsized":"2023-08-17T00:02:51.767037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803438+0000","last_change":"2023-08-17T00:02:51.791960+0000","last_active":"2023-08-17T00:02:51.803438+0000","last_peered":"2023-08-17T00:02:51.803438+0000","last_clean":"2023-08-17T00:02:51.803438+0000","last_became_active":"2023-08-17T00:02:51.791680+0000","last_became_peered":"2023-08-17T00:02:51.791680+0000","last_unstale":"2023-08-17T00:02:51.803438+0000","last_undegraded":"2023-08-17T00:02:51.803438+0000","last_fullsized":"2023-08-17T00:02:51.803438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774692+0000","last_change":"2023-08-17T00:02:51.350536+0000","last_active":"2023-08-17T00:02:51.774692+0000","last_peered":"2023-08-17T00:02:51.774692+0000","last_clean":"2023-08-17T00:02:51.774692+0000","last_became_active":"2023-08-17T00:02:51.350180+0000","last_became_peered":"2023-08-17T00:02:51.350180+0000","last_unstale":"2023-08-17T00:02:51.774692+0000","last_undegraded":"2023-08-17T00:02:51.774692+0000","last_fullsized":"2023-08-17T00:02:51.774692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802758+0000","last_change":"2023-08-17T00:02:51.797907+0000","last_active":"2023-08-17T00:02:51.802758+0000","last_peered":"2023-08-17T00:02:51.802758+0000","last_clean":"2023-08-17T00:02:51.802758+0000","last_became_active":"2023-08-17T00:02:51.797480+0000","last_became_peered":"2023-08-17T00:02:51.797480+0000","last_unstale":"2023-08-17T00:02:51.802758+0000","last_undegraded":"2023-08-17T00:02:51.802758+0000","last_fullsized":"2023-08-17T00:02:51.802758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770167+0000","last_change":"2023-08-17T00:02:51.351104+0000","last_active":"2023-08-17T00:02:51.770167+0000","last_peered":"2023-08-17T00:02:51.770167+0000","last_clean":"2023-08-17T00:02:51.770167+0000","last_became_active":"2023-08-17T00:02:51.350791+0000","last_became_peered":"2023-08-17T00:02:51.350791+0000","last_unstale":"2023-08-17T00:02:51.770167+0000","last_undegraded":"2023-08-17T00:02:51.770167+0000","last_fullsized":"2023-08-17T00:02:51.770167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802476+0000","last_change":"2023-08-17T00:02:51.794083+0000","last_active":"2023-08-17T00:02:51.802476+0000","last_peered":"2023-08-17T00:02:51.802476+0000","last_clean":"2023-08-17T00:02:51.802476+0000","last_became_active":"2023-08-17T00:02:51.793757+0000","last_became_peered":"2023-08-17T00:02:51.793757+0000","last_unstale":"2023-08-17T00:02:51.802476+0000","last_undegraded":"2023-08-17T00:02:51.802476+0000","last_fullsized":"2023-08-17T00:02:51.802476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776347+0000","last_change":"2023-08-17T00:02:51.350940+0000","last_active":"2023-08-17T00:02:51.776347+0000","last_peered":"2023-08-17T00:02:51.776347+0000","last_clean":"2023-08-17T00:02:51.776347+0000","last_became_active":"2023-08-17T00:02:51.350441+0000","last_became_peered":"2023-08-17T00:02:51.350441+0000","last_unstale":"2023-08-17T00:02:51.776347+0000","last_undegraded":"2023-08-17T00:02:51.776347+0000","last_fullsized":"2023-08-17T00:02:51.776347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782080+0000","last_change":"2023-08-17T00:02:51.778464+0000","last_active":"2023-08-17T00:02:51.782080+0000","last_peered":"2023-08-17T00:02:51.782080+0000","last_clean":"2023-08-17T00:02:51.782080+0000","last_became_active":"2023-08-17T00:02:51.778226+0000","last_became_peered":"2023-08-17T00:02:51.778226+0000","last_unstale":"2023-08-17T00:02:51.782080+0000","last_undegraded":"2023-08-17T00:02:51.782080+0000","last_fullsized":"2023-08-17T00:02:51.782080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772282+0000","last_change":"2023-08-17T00:02:51.340239+0000","last_active":"2023-08-17T00:02:51.772282+0000","last_peered":"2023-08-17T00:02:51.772282+0000","last_clean":"2023-08-17T00:02:51.772282+0000","last_became_active":"2023-08-17T00:02:51.339974+0000","last_became_peered":"2023-08-17T00:02:51.339974+0000","last_unstale":"2023-08-17T00:02:51.772282+0000","last_undegraded":"2023-08-17T00:02:51.772282+0000","last_fullsized":"2023-08-17T00:02:51.772282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798032+0000","last_change":"2023-08-17T00:02:51.792139+0000","last_active":"2023-08-17T00:02:51.798032+0000","last_peered":"2023-08-17T00:02:51.798032+0000","last_clean":"2023-08-17T00:02:51.798032+0000","last_became_active":"2023-08-17T00:02:51.791871+0000","last_became_peered":"2023-08-17T00:02:51.791871+0000","last_unstale":"2023-08-17T00:02:51.798032+0000","last_undegraded":"2023-08-17T00:02:51.798032+0000","last_fullsized":"2023-08-17T00:02:51.798032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776993+0000","last_change":"2023-08-17T00:02:51.346632+0000","last_active":"2023-08-17T00:02:51.776993+0000","last_peered":"2023-08-17T00:02:51.776993+0000","last_clean":"2023-08-17T00:02:51.776993+0000","last_became_active":"2023-08-17T00:02:51.346360+0000","last_became_peered":"2023-08-17T00:02:51.346360+0000","last_unstale":"2023-08-17T00:02:51.776993+0000","last_undegraded":"2023-08-17T00:02:51.776993+0000","last_fullsized":"2023-08-17T00:02:51.776993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795767+0000","last_change":"2023-08-17T00:02:51.791363+0000","last_active":"2023-08-17T00:02:51.795767+0000","last_peered":"2023-08-17T00:02:51.795767+0000","last_clean":"2023-08-17T00:02:51.795767+0000","last_became_active":"2023-08-17T00:02:51.791061+0000","last_became_peered":"2023-08-17T00:02:51.791061+0000","last_unstale":"2023-08-17T00:02:51.795767+0000","last_undegraded":"2023-08-17T00:02:51.795767+0000","last_fullsized":"2023-08-17T00:02:51.795767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780186+0000","last_change":"2023-08-17T00:02:51.354878+0000","last_active":"2023-08-17T00:02:51.780186+0000","last_peered":"2023-08-17T00:02:51.780186+0000","last_clean":"2023-08-17T00:02:51.780186+0000","last_became_active":"2023-08-17T00:02:51.354620+0000","last_became_peered":"2023-08-17T00:02:51.354620+0000","last_unstale":"2023-08-17T00:02:51.780186+0000","last_undegraded":"2023-08-17T00:02:51.780186+0000","last_fullsized":"2023-08-17T00:02:51.780186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790458+0000","last_change":"2023-08-17T00:02:51.786538+0000","last_active":"2023-08-17T00:02:51.790458+0000","last_peered":"2023-08-17T00:02:51.790458+0000","last_clean":"2023-08-17T00:02:51.790458+0000","last_became_active":"2023-08-17T00:02:51.786215+0000","last_became_peered":"2023-08-17T00:02:51.786215+0000","last_unstale":"2023-08-17T00:02:51.790458+0000","last_undegraded":"2023-08-17T00:02:51.790458+0000","last_fullsized":"2023-08-17T00:02:51.790458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775020+0000","last_change":"2023-08-17T00:02:51.350207+0000","last_active":"2023-08-17T00:02:51.775020+0000","last_peered":"2023-08-17T00:02:51.775020+0000","last_clean":"2023-08-17T00:02:51.775020+0000","last_became_active":"2023-08-17T00:02:51.349890+0000","last_became_peered":"2023-08-17T00:02:51.349890+0000","last_unstale":"2023-08-17T00:02:51.775020+0000","last_undegraded":"2023-08-17T00:02:51.775020+0000","last_fullsized":"2023-08-17T00:02:51.775020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790419+0000","last_change":"2023-08-17T00:02:51.787178+0000","last_active":"2023-08-17T00:02:51.790419+0000","last_peered":"2023-08-17T00:02:51.790419+0000","last_clean":"2023-08-17T00:02:51.790419+0000","last_became_active":"2023-08-17T00:02:51.786896+0000","last_became_peered":"2023-08-17T00:02:51.786896+0000","last_unstale":"2023-08-17T00:02:51.790419+0000","last_undegraded":"2023-08-17T00:02:51.790419+0000","last_fullsized":"2023-08-17T00:02:51.790419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769107+0000","last_change":"2023-08-17T00:02:51.351372+0000","last_active":"2023-08-17T00:02:51.769107+0000","last_peered":"2023-08-17T00:02:51.769107+0000","last_clean":"2023-08-17T00:02:51.769107+0000","last_became_active":"2023-08-17T00:02:51.350520+0000","last_became_peered":"2023-08-17T00:02:51.350520+0000","last_unstale":"2023-08-17T00:02:51.769107+0000","last_undegraded":"2023-08-17T00:02:51.769107+0000","last_fullsized":"2023-08-17T00:02:51.769107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790239+0000","last_change":"2023-08-17T00:02:51.786052+0000","last_active":"2023-08-17T00:02:51.790239+0000","last_peered":"2023-08-17T00:02:51.790239+0000","last_clean":"2023-08-17T00:02:51.790239+0000","last_became_active":"2023-08-17T00:02:51.784778+0000","last_became_peered":"2023-08-17T00:02:51.784778+0000","last_unstale":"2023-08-17T00:02:51.790239+0000","last_undegraded":"2023-08-17T00:02:51.790239+0000","last_fullsized":"2023-08-17T00:02:51.790239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780523+0000","last_change":"2023-08-17T00:02:51.352623+0000","last_active":"2023-08-17T00:02:51.780523+0000","last_peered":"2023-08-17T00:02:51.780523+0000","last_clean":"2023-08-17T00:02:51.780523+0000","last_became_active":"2023-08-17T00:02:51.352286+0000","last_became_peered":"2023-08-17T00:02:51.352286+0000","last_unstale":"2023-08-17T00:02:51.780523+0000","last_undegraded":"2023-08-17T00:02:51.780523+0000","last_fullsized":"2023-08-17T00:02:51.780523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803784+0000","last_change":"2023-08-17T00:02:51.801853+0000","last_active":"2023-08-17T00:02:51.803784+0000","last_peered":"2023-08-17T00:02:51.803784+0000","last_clean":"2023-08-17T00:02:51.803784+0000","last_became_active":"2023-08-17T00:02:51.801540+0000","last_became_peered":"2023-08-17T00:02:51.801540+0000","last_unstale":"2023-08-17T00:02:51.803784+0000","last_undegraded":"2023-08-17T00:02:51.803784+0000","last_fullsized":"2023-08-17T00:02:51.803784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:51.338361+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:51.338040+0000","last_became_peered":"2023-08-17T00:02:51.338040+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802658+0000","last_change":"2023-08-17T00:02:51.788068+0000","last_active":"2023-08-17T00:02:51.802658+0000","last_peered":"2023-08-17T00:02:51.802658+0000","last_clean":"2023-08-17T00:02:51.802658+0000","last_became_active":"2023-08-17T00:02:51.787734+0000","last_became_peered":"2023-08-17T00:02:51.787734+0000","last_unstale":"2023-08-17T00:02:51.802658+0000","last_undegraded":"2023-08-17T00:02:51.802658+0000","last_fullsized":"2023-08-17T00:02:51.802658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801530+0000","last_change":"2023-08-17T00:02:51.350761+0000","last_active":"2023-08-17T00:02:51.801530+0000","last_peered":"2023-08-17T00:02:51.801530+0000","last_clean":"2023-08-17T00:02:51.801530+0000","last_became_active":"2023-08-17T00:02:51.347875+0000","last_became_peered":"2023-08-17T00:02:51.347875+0000","last_unstale":"2023-08-17T00:02:51.801530+0000","last_undegraded":"2023-08-17T00:02:51.801530+0000","last_fullsized":"2023-08-17T00:02:51.801530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799118+0000","last_change":"2023-08-17T00:02:51.788452+0000","last_active":"2023-08-17T00:02:51.799118+0000","last_peered":"2023-08-17T00:02:51.799118+0000","last_clean":"2023-08-17T00:02:51.799118+0000","last_became_active":"2023-08-17T00:02:51.788147+0000","last_became_peered":"2023-08-17T00:02:51.788147+0000","last_unstale":"2023-08-17T00:02:51.799118+0000","last_undegraded":"2023-08-17T00:02:51.799118+0000","last_fullsized":"2023-08-17T00:02:51.799118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789445+0000","last_change":"2023-08-17T00:02:51.355054+0000","last_active":"2023-08-17T00:02:51.789445+0000","last_peered":"2023-08-17T00:02:51.789445+0000","last_clean":"2023-08-17T00:02:51.789445+0000","last_became_active":"2023-08-17T00:02:51.354677+0000","last_became_peered":"2023-08-17T00:02:51.354677+0000","last_unstale":"2023-08-17T00:02:51.789445+0000","last_undegraded":"2023-08-17T00:02:51.789445+0000","last_fullsized":"2023-08-17T00:02:51.789445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802453+0000","last_change":"2023-08-17T00:02:51.794268+0000","last_active":"2023-08-17T00:02:51.802453+0000","last_peered":"2023-08-17T00:02:51.802453+0000","last_clean":"2023-08-17T00:02:51.802453+0000","last_became_active":"2023-08-17T00:02:51.793909+0000","last_became_peered":"2023-08-17T00:02:51.793909+0000","last_unstale":"2023-08-17T00:02:51.802453+0000","last_undegraded":"2023-08-17T00:02:51.802453+0000","last_fullsized":"2023-08-17T00:02:51.802453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802558+0000","last_change":"2023-08-17T00:02:51.351466+0000","last_active":"2023-08-17T00:02:51.802558+0000","last_peered":"2023-08-17T00:02:51.802558+0000","last_clean":"2023-08-17T00:02:51.802558+0000","last_became_active":"2023-08-17T00:02:51.350746+0000","last_became_peered":"2023-08-17T00:02:51.350746+0000","last_unstale":"2023-08-17T00:02:51.802558+0000","last_undegraded":"2023-08-17T00:02:51.802558+0000","last_fullsized":"2023-08-17T00:02:51.802558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799918+0000","last_change":"2023-08-17T00:02:51.789270+0000","last_active":"2023-08-17T00:02:51.799918+0000","last_peered":"2023-08-17T00:02:51.799918+0000","last_clean":"2023-08-17T00:02:51.799918+0000","last_became_active":"2023-08-17T00:02:51.789010+0000","last_became_peered":"2023-08-17T00:02:51.789010+0000","last_unstale":"2023-08-17T00:02:51.799918+0000","last_undegraded":"2023-08-17T00:02:51.799918+0000","last_fullsized":"2023-08-17T00:02:51.799918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766901+0000","last_change":"2023-08-17T00:02:51.334024+0000","last_active":"2023-08-17T00:02:51.766901+0000","last_peered":"2023-08-17T00:02:51.766901+0000","last_clean":"2023-08-17T00:02:51.766901+0000","last_became_active":"2023-08-17T00:02:51.332857+0000","last_became_peered":"2023-08-17T00:02:51.332857+0000","last_unstale":"2023-08-17T00:02:51.766901+0000","last_undegraded":"2023-08-17T00:02:51.766901+0000","last_fullsized":"2023-08-17T00:02:51.766901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799394+0000","last_change":"2023-08-17T00:02:51.792683+0000","last_active":"2023-08-17T00:02:51.799394+0000","last_peered":"2023-08-17T00:02:51.799394+0000","last_clean":"2023-08-17T00:02:51.799394+0000","last_became_active":"2023-08-17T00:02:51.792366+0000","last_became_peered":"2023-08-17T00:02:51.792366+0000","last_unstale":"2023-08-17T00:02:51.799394+0000","last_undegraded":"2023-08-17T00:02:51.799394+0000","last_fullsized":"2023-08-17T00:02:51.799394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771706+0000","last_change":"2023-08-17T00:02:51.349003+0000","last_active":"2023-08-17T00:02:51.771706+0000","last_peered":"2023-08-17T00:02:51.771706+0000","last_clean":"2023-08-17T00:02:51.771706+0000","last_became_active":"2023-08-17T00:02:51.347537+0000","last_became_peered":"2023-08-17T00:02:51.347537+0000","last_unstale":"2023-08-17T00:02:51.771706+0000","last_undegraded":"2023-08-17T00:02:51.771706+0000","last_fullsized":"2023-08-17T00:02:51.771706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802086+0000","last_change":"2023-08-17T00:02:51.792987+0000","last_active":"2023-08-17T00:02:51.802086+0000","last_peered":"2023-08-17T00:02:51.802086+0000","last_clean":"2023-08-17T00:02:51.802086+0000","last_became_active":"2023-08-17T00:02:51.792614+0000","last_became_peered":"2023-08-17T00:02:51.792614+0000","last_unstale":"2023-08-17T00:02:51.802086+0000","last_undegraded":"2023-08-17T00:02:51.802086+0000","last_fullsized":"2023-08-17T00:02:51.802086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767113+0000","last_change":"2023-08-17T00:02:51.341657+0000","last_active":"2023-08-17T00:02:51.767113+0000","last_peered":"2023-08-17T00:02:51.767113+0000","last_clean":"2023-08-17T00:02:51.767113+0000","last_became_active":"2023-08-17T00:02:51.340926+0000","last_became_peered":"2023-08-17T00:02:51.340926+0000","last_unstale":"2023-08-17T00:02:51.767113+0000","last_undegraded":"2023-08-17T00:02:51.767113+0000","last_fullsized":"2023-08-17T00:02:51.767113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802511+0000","last_change":"2023-08-17T00:02:51.794147+0000","last_active":"2023-08-17T00:02:51.802511+0000","last_peered":"2023-08-17T00:02:51.802511+0000","last_clean":"2023-08-17T00:02:51.802511+0000","last_became_active":"2023-08-17T00:02:51.793842+0000","last_became_peered":"2023-08-17T00:02:51.793842+0000","last_unstale":"2023-08-17T00:02:51.802511+0000","last_undegraded":"2023-08-17T00:02:51.802511+0000","last_fullsized":"2023-08-17T00:02:51.802511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770938+0000","last_change":"2023-08-17T00:02:51.344894+0000","last_active":"2023-08-17T00:02:51.770938+0000","last_peered":"2023-08-17T00:02:51.770938+0000","last_clean":"2023-08-17T00:02:51.770938+0000","last_became_active":"2023-08-17T00:02:51.344238+0000","last_became_peered":"2023-08-17T00:02:51.344238+0000","last_unstale":"2023-08-17T00:02:51.770938+0000","last_undegraded":"2023-08-17T00:02:51.770938+0000","last_fullsized":"2023-08-17T00:02:51.770938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802630+0000","last_change":"2023-08-17T00:02:51.793264+0000","last_active":"2023-08-17T00:02:51.802630+0000","last_peered":"2023-08-17T00:02:51.802630+0000","last_clean":"2023-08-17T00:02:51.802630+0000","last_became_active":"2023-08-17T00:02:51.792918+0000","last_became_peered":"2023-08-17T00:02:51.792918+0000","last_unstale":"2023-08-17T00:02:51.802630+0000","last_undegraded":"2023-08-17T00:02:51.802630+0000","last_fullsized":"2023-08-17T00:02:51.802630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775453+0000","last_change":"2023-08-17T00:02:51.339413+0000","last_active":"2023-08-17T00:02:51.775453+0000","last_peered":"2023-08-17T00:02:51.775453+0000","last_clean":"2023-08-17T00:02:51.775453+0000","last_became_active":"2023-08-17T00:02:51.339094+0000","last_became_peered":"2023-08-17T00:02:51.339094+0000","last_unstale":"2023-08-17T00:02:51.775453+0000","last_undegraded":"2023-08-17T00:02:51.775453+0000","last_fullsized":"2023-08-17T00:02:51.775453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802813+0000","last_change":"2023-08-17T00:02:51.795000+0000","last_active":"2023-08-17T00:02:51.802813+0000","last_peered":"2023-08-17T00:02:51.802813+0000","last_clean":"2023-08-17T00:02:51.802813+0000","last_became_active":"2023-08-17T00:02:51.794722+0000","last_became_peered":"2023-08-17T00:02:51.794722+0000","last_unstale":"2023-08-17T00:02:51.802813+0000","last_undegraded":"2023-08-17T00:02:51.802813+0000","last_fullsized":"2023-08-17T00:02:51.802813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776484+0000","last_change":"2023-08-17T00:02:51.343058+0000","last_active":"2023-08-17T00:02:51.776484+0000","last_peered":"2023-08-17T00:02:51.776484+0000","last_clean":"2023-08-17T00:02:51.776484+0000","last_became_active":"2023-08-17T00:02:51.342764+0000","last_became_peered":"2023-08-17T00:02:51.342764+0000","last_unstale":"2023-08-17T00:02:51.776484+0000","last_undegraded":"2023-08-17T00:02:51.776484+0000","last_fullsized":"2023-08-17T00:02:51.776484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803681+0000","last_change":"2023-08-17T00:02:51.800364+0000","last_active":"2023-08-17T00:02:51.803681+0000","last_peered":"2023-08-17T00:02:51.803681+0000","last_clean":"2023-08-17T00:02:51.803681+0000","last_became_active":"2023-08-17T00:02:51.800036+0000","last_became_peered":"2023-08-17T00:02:51.800036+0000","last_unstale":"2023-08-17T00:02:51.803681+0000","last_undegraded":"2023-08-17T00:02:51.803681+0000","last_fullsized":"2023-08-17T00:02:51.803681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772373+0000","last_change":"2023-08-17T00:02:51.341857+0000","last_active":"2023-08-17T00:02:51.772373+0000","last_peered":"2023-08-17T00:02:51.772373+0000","last_clean":"2023-08-17T00:02:51.772373+0000","last_became_active":"2023-08-17T00:02:51.339418+0000","last_became_peered":"2023-08-17T00:02:51.339418+0000","last_unstale":"2023-08-17T00:02:51.772373+0000","last_undegraded":"2023-08-17T00:02:51.772373+0000","last_fullsized":"2023-08-17T00:02:51.772373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800439+0000","last_change":"2023-08-17T00:02:51.784928+0000","last_active":"2023-08-17T00:02:51.800439+0000","last_peered":"2023-08-17T00:02:51.800439+0000","last_clean":"2023-08-17T00:02:51.800439+0000","last_became_active":"2023-08-17T00:02:51.784604+0000","last_became_peered":"2023-08-17T00:02:51.784604+0000","last_unstale":"2023-08-17T00:02:51.800439+0000","last_undegraded":"2023-08-17T00:02:51.800439+0000","last_fullsized":"2023-08-17T00:02:51.800439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793473+0000","last_change":"2023-08-17T00:02:51.343843+0000","last_active":"2023-08-17T00:02:51.793473+0000","last_peered":"2023-08-17T00:02:51.793473+0000","last_clean":"2023-08-17T00:02:51.793473+0000","last_became_active":"2023-08-17T00:02:51.340985+0000","last_became_peered":"2023-08-17T00:02:51.340985+0000","last_unstale":"2023-08-17T00:02:51.793473+0000","last_undegraded":"2023-08-17T00:02:51.793473+0000","last_fullsized":"2023-08-17T00:02:51.793473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800767+0000","last_change":"2023-08-17T00:02:51.785256+0000","last_active":"2023-08-17T00:02:51.800767+0000","last_peered":"2023-08-17T00:02:51.800767+0000","last_clean":"2023-08-17T00:02:51.800767+0000","last_became_active":"2023-08-17T00:02:51.784962+0000","last_became_peered":"2023-08-17T00:02:51.784962+0000","last_unstale":"2023-08-17T00:02:51.800767+0000","last_undegraded":"2023-08-17T00:02:51.800767+0000","last_fullsized":"2023-08-17T00:02:51.800767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802680+0000","last_change":"2023-08-17T00:02:51.350355+0000","last_active":"2023-08-17T00:02:51.802680+0000","last_peered":"2023-08-17T00:02:51.802680+0000","last_clean":"2023-08-17T00:02:51.802680+0000","last_became_active":"2023-08-17T00:02:51.350063+0000","last_became_peered":"2023-08-17T00:02:51.350063+0000","last_unstale":"2023-08-17T00:02:51.802680+0000","last_undegraded":"2023-08-17T00:02:51.802680+0000","last_fullsized":"2023-08-17T00:02:51.802680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798718+0000","last_change":"2023-08-17T00:02:51.785857+0000","last_active":"2023-08-17T00:02:51.798718+0000","last_peered":"2023-08-17T00:02:51.798718+0000","last_clean":"2023-08-17T00:02:51.798718+0000","last_became_active":"2023-08-17T00:02:51.785548+0000","last_became_peered":"2023-08-17T00:02:51.785548+0000","last_unstale":"2023-08-17T00:02:51.798718+0000","last_undegraded":"2023-08-17T00:02:51.798718+0000","last_fullsized":"2023-08-17T00:02:51.798718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770921+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:02:51.770921+0000","last_peered":"2023-08-17T00:02:51.770921+0000","last_clean":"2023-08-17T00:02:51.770921+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:02:51.770921+0000","last_undegraded":"2023-08-17T00:02:51.770921+0000","last_fullsized":"2023-08-17T00:02:51.770921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772354+0000","last_change":"2023-08-17T00:02:51.349328+0000","last_active":"2023-08-17T00:02:51.772354+0000","last_peered":"2023-08-17T00:02:51.772354+0000","last_clean":"2023-08-17T00:02:51.772354+0000","last_became_active":"2023-08-17T00:02:51.348912+0000","last_became_peered":"2023-08-17T00:02:51.348912+0000","last_unstale":"2023-08-17T00:02:51.772354+0000","last_undegraded":"2023-08-17T00:02:51.772354+0000","last_fullsized":"2023-08-17T00:02:51.772354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798870+0000","last_change":"2023-08-17T00:02:51.786668+0000","last_active":"2023-08-17T00:02:51.798870+0000","last_peered":"2023-08-17T00:02:51.798870+0000","last_clean":"2023-08-17T00:02:51.798870+0000","last_became_active":"2023-08-17T00:02:51.785985+0000","last_became_peered":"2023-08-17T00:02:51.785985+0000","last_unstale":"2023-08-17T00:02:51.798870+0000","last_undegraded":"2023-08-17T00:02:51.798870+0000","last_fullsized":"2023-08-17T00:02:51.798870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772460+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:02:51.772460+0000","last_peered":"2023-08-17T00:02:51.772460+0000","last_clean":"2023-08-17T00:02:51.772460+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:02:51.772460+0000","last_undegraded":"2023-08-17T00:02:51.772460+0000","last_fullsized":"2023-08-17T00:02:51.772460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797184+0000","last_change":"2023-08-17T00:02:51.335559+0000","last_active":"2023-08-17T00:02:51.797184+0000","last_peered":"2023-08-17T00:02:51.797184+0000","last_clean":"2023-08-17T00:02:51.797184+0000","last_became_active":"2023-08-17T00:02:51.335182+0000","last_became_peered":"2023-08-17T00:02:51.335182+0000","last_unstale":"2023-08-17T00:02:51.797184+0000","last_undegraded":"2023-08-17T00:02:51.797184+0000","last_fullsized":"2023-08-17T00:02:51.797184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801377+0000","last_change":"2023-08-17T00:02:51.787570+0000","last_active":"2023-08-17T00:02:51.801377+0000","last_peered":"2023-08-17T00:02:51.801377+0000","last_clean":"2023-08-17T00:02:51.801377+0000","last_became_active":"2023-08-17T00:02:51.787256+0000","last_became_peered":"2023-08-17T00:02:51.787256+0000","last_unstale":"2023-08-17T00:02:51.801377+0000","last_undegraded":"2023-08-17T00:02:51.801377+0000","last_fullsized":"2023-08-17T00:02:51.801377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773440+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:02:51.773440+0000","last_peered":"2023-08-17T00:02:51.773440+0000","last_clean":"2023-08-17T00:02:51.773440+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:02:51.773440+0000","last_undegraded":"2023-08-17T00:02:51.773440+0000","last_fullsized":"2023-08-17T00:02:51.773440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780285+0000","last_change":"2023-08-17T00:02:51.343304+0000","last_active":"2023-08-17T00:02:51.780285+0000","last_peered":"2023-08-17T00:02:51.780285+0000","last_clean":"2023-08-17T00:02:51.780285+0000","last_became_active":"2023-08-17T00:02:51.343028+0000","last_became_peered":"2023-08-17T00:02:51.343028+0000","last_unstale":"2023-08-17T00:02:51.780285+0000","last_undegraded":"2023-08-17T00:02:51.780285+0000","last_fullsized":"2023-08-17T00:02:51.780285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796085+0000","last_change":"2023-08-17T00:02:51.788638+0000","last_active":"2023-08-17T00:02:51.796085+0000","last_peered":"2023-08-17T00:02:51.796085+0000","last_clean":"2023-08-17T00:02:51.796085+0000","last_became_active":"2023-08-17T00:02:51.787316+0000","last_became_peered":"2023-08-17T00:02:51.787316+0000","last_unstale":"2023-08-17T00:02:51.796085+0000","last_undegraded":"2023-08-17T00:02:51.796085+0000","last_fullsized":"2023-08-17T00:02:51.796085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774757+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:02:51.774757+0000","last_peered":"2023-08-17T00:02:51.774757+0000","last_clean":"2023-08-17T00:02:51.774757+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:02:51.774757+0000","last_undegraded":"2023-08-17T00:02:51.774757+0000","last_fullsized":"2023-08-17T00:02:51.774757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768333+0000","last_change":"2023-08-17T00:02:51.340968+0000","last_active":"2023-08-17T00:02:51.768333+0000","last_peered":"2023-08-17T00:02:51.768333+0000","last_clean":"2023-08-17T00:02:51.768333+0000","last_became_active":"2023-08-17T00:02:51.340352+0000","last_became_peered":"2023-08-17T00:02:51.340352+0000","last_unstale":"2023-08-17T00:02:51.768333+0000","last_undegraded":"2023-08-17T00:02:51.768333+0000","last_fullsized":"2023-08-17T00:02:51.768333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789054+0000","last_change":"2023-08-17T00:02:51.786773+0000","last_active":"2023-08-17T00:02:51.789054+0000","last_peered":"2023-08-17T00:02:51.789054+0000","last_clean":"2023-08-17T00:02:51.789054+0000","last_became_active":"2023-08-17T00:02:51.786393+0000","last_became_peered":"2023-08-17T00:02:51.786393+0000","last_unstale":"2023-08-17T00:02:51.789054+0000","last_undegraded":"2023-08-17T00:02:51.789054+0000","last_fullsized":"2023-08-17T00:02:51.789054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769417+0000","last_change":"2023-08-17T00:02:51.345508+0000","last_active":"2023-08-17T00:02:51.769417+0000","last_peered":"2023-08-17T00:02:51.769417+0000","last_clean":"2023-08-17T00:02:51.769417+0000","last_became_active":"2023-08-17T00:02:51.345226+0000","last_became_peered":"2023-08-17T00:02:51.345226+0000","last_unstale":"2023-08-17T00:02:51.769417+0000","last_undegraded":"2023-08-17T00:02:51.769417+0000","last_fullsized":"2023-08-17T00:02:51.769417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769322+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:02:51.769322+0000","last_peered":"2023-08-17T00:02:51.769322+0000","last_clean":"2023-08-17T00:02:51.769322+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:02:51.769322+0000","last_undegraded":"2023-08-17T00:02:51.769322+0000","last_fullsized":"2023-08-17T00:02:51.769322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799559+0000","last_change":"2023-08-17T00:02:51.796855+0000","last_active":"2023-08-17T00:02:51.799559+0000","last_peered":"2023-08-17T00:02:51.799559+0000","last_clean":"2023-08-17T00:02:51.799559+0000","last_became_active":"2023-08-17T00:02:51.796562+0000","last_became_peered":"2023-08-17T00:02:51.796562+0000","last_unstale":"2023-08-17T00:02:51.799559+0000","last_undegraded":"2023-08-17T00:02:51.799559+0000","last_fullsized":"2023-08-17T00:02:51.799559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775324+0000","last_change":"2023-08-17T00:02:51.350272+0000","last_active":"2023-08-17T00:02:51.775324+0000","last_peered":"2023-08-17T00:02:51.775324+0000","last_clean":"2023-08-17T00:02:51.775324+0000","last_became_active":"2023-08-17T00:02:51.350003+0000","last_became_peered":"2023-08-17T00:02:51.350003+0000","last_unstale":"2023-08-17T00:02:51.775324+0000","last_undegraded":"2023-08-17T00:02:51.775324+0000","last_fullsized":"2023-08-17T00:02:51.775324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.781497+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:02:51.781497+0000","last_peered":"2023-08-17T00:02:51.781497+0000","last_clean":"2023-08-17T00:02:51.781497+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:02:51.781497+0000","last_undegraded":"2023-08-17T00:02:51.781497+0000","last_fullsized":"2023-08-17T00:02:51.781497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798023+0000","last_change":"2023-08-17T00:02:51.790967+0000","last_active":"2023-08-17T00:02:51.798023+0000","last_peered":"2023-08-17T00:02:51.798023+0000","last_clean":"2023-08-17T00:02:51.798023+0000","last_became_active":"2023-08-17T00:02:51.787858+0000","last_became_peered":"2023-08-17T00:02:51.787858+0000","last_unstale":"2023-08-17T00:02:51.798023+0000","last_undegraded":"2023-08-17T00:02:51.798023+0000","last_fullsized":"2023-08-17T00:02:51.798023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.777967+0000","last_change":"2023-08-17T00:02:51.348713+0000","last_active":"2023-08-17T00:02:51.777967+0000","last_peered":"2023-08-17T00:02:51.777967+0000","last_clean":"2023-08-17T00:02:51.777967+0000","last_became_active":"2023-08-17T00:02:51.348409+0000","last_became_peered":"2023-08-17T00:02:51.348409+0000","last_unstale":"2023-08-17T00:02:51.777967+0000","last_undegraded":"2023-08-17T00:02:51.777967+0000","last_fullsized":"2023-08-17T00:02:51.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770267+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:02:51.770267+0000","last_peered":"2023-08-17T00:02:51.770267+0000","last_clean":"2023-08-17T00:02:51.770267+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:02:51.770267+0000","last_undegraded":"2023-08-17T00:02:51.770267+0000","last_fullsized":"2023-08-17T00:02:51.770267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803930+0000","last_change":"2023-08-17T00:02:51.797864+0000","last_active":"2023-08-17T00:02:51.803930+0000","last_peered":"2023-08-17T00:02:51.803930+0000","last_clean":"2023-08-17T00:02:51.803930+0000","last_became_active":"2023-08-17T00:02:51.797388+0000","last_became_peered":"2023-08-17T00:02:51.797388+0000","last_unstale":"2023-08-17T00:02:51.803930+0000","last_undegraded":"2023-08-17T00:02:51.803930+0000","last_fullsized":"2023-08-17T00:02:51.803930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774238+0000","last_change":"2023-08-17T00:02:51.353342+0000","last_active":"2023-08-17T00:02:51.774238+0000","last_peered":"2023-08-17T00:02:51.774238+0000","last_clean":"2023-08-17T00:02:51.774238+0000","last_became_active":"2023-08-17T00:02:51.351707+0000","last_became_peered":"2023-08-17T00:02:51.351707+0000","last_unstale":"2023-08-17T00:02:51.774238+0000","last_undegraded":"2023-08-17T00:02:51.774238+0000","last_fullsized":"2023-08-17T00:02:51.774238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766976+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:02:51.766976+0000","last_peered":"2023-08-17T00:02:51.766976+0000","last_clean":"2023-08-17T00:02:51.766976+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:02:51.766976+0000","last_undegraded":"2023-08-17T00:02:51.766976+0000","last_fullsized":"2023-08-17T00:02:51.766976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790259+0000","last_change":"2023-08-17T00:02:51.786227+0000","last_active":"2023-08-17T00:02:51.790259+0000","last_peered":"2023-08-17T00:02:51.790259+0000","last_clean":"2023-08-17T00:02:51.790259+0000","last_became_active":"2023-08-17T00:02:51.785164+0000","last_became_peered":"2023-08-17T00:02:51.785164+0000","last_unstale":"2023-08-17T00:02:51.790259+0000","last_undegraded":"2023-08-17T00:02:51.790259+0000","last_fullsized":"2023-08-17T00:02:51.790259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771433+0000","last_change":"2023-08-17T00:02:51.349191+0000","last_active":"2023-08-17T00:02:51.771433+0000","last_peered":"2023-08-17T00:02:51.771433+0000","last_clean":"2023-08-17T00:02:51.771433+0000","last_became_active":"2023-08-17T00:02:51.348834+0000","last_became_peered":"2023-08-17T00:02:51.348834+0000","last_unstale":"2023-08-17T00:02:51.771433+0000","last_undegraded":"2023-08-17T00:02:51.771433+0000","last_fullsized":"2023-08-17T00:02:51.771433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803745+0000","last_change":"2023-08-17T00:02:51.801602+0000","last_active":"2023-08-17T00:02:51.803745+0000","last_peered":"2023-08-17T00:02:51.803745+0000","last_clean":"2023-08-17T00:02:51.803745+0000","last_became_active":"2023-08-17T00:02:51.801300+0000","last_became_peered":"2023-08-17T00:02:51.801300+0000","last_unstale":"2023-08-17T00:02:51.803745+0000","last_undegraded":"2023-08-17T00:02:51.803745+0000","last_fullsized":"2023-08-17T00:02:51.803745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768468+0000","last_change":"2023-08-17T00:02:51.340158+0000","last_active":"2023-08-17T00:02:51.768468+0000","last_peered":"2023-08-17T00:02:51.768468+0000","last_clean":"2023-08-17T00:02:51.768468+0000","last_became_active":"2023-08-17T00:02:51.339871+0000","last_became_peered":"2023-08-17T00:02:51.339871+0000","last_unstale":"2023-08-17T00:02:51.768468+0000","last_undegraded":"2023-08-17T00:02:51.768468+0000","last_fullsized":"2023-08-17T00:02:51.768468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798765+0000","last_change":"2023-08-17T00:02:51.785968+0000","last_active":"2023-08-17T00:02:51.798765+0000","last_peered":"2023-08-17T00:02:51.798765+0000","last_clean":"2023-08-17T00:02:51.798765+0000","last_became_active":"2023-08-17T00:02:51.785695+0000","last_became_peered":"2023-08-17T00:02:51.785695+0000","last_unstale":"2023-08-17T00:02:51.798765+0000","last_undegraded":"2023-08-17T00:02:51.798765+0000","last_fullsized":"2023-08-17T00:02:51.798765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769227+0000","last_change":"2023-08-17T00:02:51.339180+0000","last_active":"2023-08-17T00:02:51.769227+0000","last_peered":"2023-08-17T00:02:51.769227+0000","last_clean":"2023-08-17T00:02:51.769227+0000","last_became_active":"2023-08-17T00:02:51.338880+0000","last_became_peered":"2023-08-17T00:02:51.338880+0000","last_unstale":"2023-08-17T00:02:51.769227+0000","last_undegraded":"2023-08-17T00:02:51.769227+0000","last_fullsized":"2023-08-17T00:02:51.769227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790291+0000","last_change":"2023-08-17T00:02:51.786531+0000","last_active":"2023-08-17T00:02:51.790291+0000","last_peered":"2023-08-17T00:02:51.790291+0000","last_clean":"2023-08-17T00:02:51.790291+0000","last_became_active":"2023-08-17T00:02:51.785774+0000","last_became_peered":"2023-08-17T00:02:51.785774+0000","last_unstale":"2023-08-17T00:02:51.790291+0000","last_undegraded":"2023-08-17T00:02:51.790291+0000","last_fullsized":"2023-08-17T00:02:51.790291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795538+0000","last_change":"2023-08-17T00:02:51.344586+0000","last_active":"2023-08-17T00:02:51.795538+0000","last_peered":"2023-08-17T00:02:51.795538+0000","last_clean":"2023-08-17T00:02:51.795538+0000","last_became_active":"2023-08-17T00:02:51.344320+0000","last_became_peered":"2023-08-17T00:02:51.344320+0000","last_unstale":"2023-08-17T00:02:51.795538+0000","last_undegraded":"2023-08-17T00:02:51.795538+0000","last_fullsized":"2023-08-17T00:02:51.795538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795736+0000","last_change":"2023-08-17T00:02:51.789022+0000","last_active":"2023-08-17T00:02:51.795736+0000","last_peered":"2023-08-17T00:02:51.795736+0000","last_clean":"2023-08-17T00:02:51.795736+0000","last_became_active":"2023-08-17T00:02:51.788756+0000","last_became_peered":"2023-08-17T00:02:51.788756+0000","last_unstale":"2023-08-17T00:02:51.795736+0000","last_undegraded":"2023-08-17T00:02:51.795736+0000","last_fullsized":"2023-08-17T00:02:51.795736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775104+0000","last_change":"2023-08-17T00:02:51.352334+0000","last_active":"2023-08-17T00:02:51.775104+0000","last_peered":"2023-08-17T00:02:51.775104+0000","last_clean":"2023-08-17T00:02:51.775104+0000","last_became_active":"2023-08-17T00:02:51.352057+0000","last_became_peered":"2023-08-17T00:02:51.352057+0000","last_unstale":"2023-08-17T00:02:51.775104+0000","last_undegraded":"2023-08-17T00:02:51.775104+0000","last_fullsized":"2023-08-17T00:02:51.775104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790438+0000","last_change":"2023-08-17T00:02:51.786511+0000","last_active":"2023-08-17T00:02:51.790438+0000","last_peered":"2023-08-17T00:02:51.790438+0000","last_clean":"2023-08-17T00:02:51.790438+0000","last_became_active":"2023-08-17T00:02:51.786141+0000","last_became_peered":"2023-08-17T00:02:51.786141+0000","last_unstale":"2023-08-17T00:02:51.790438+0000","last_undegraded":"2023-08-17T00:02:51.790438+0000","last_fullsized":"2023-08-17T00:02:51.790438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773255+0000","last_change":"2023-08-17T00:02:51.351567+0000","last_active":"2023-08-17T00:02:51.773255+0000","last_peered":"2023-08-17T00:02:51.773255+0000","last_clean":"2023-08-17T00:02:51.773255+0000","last_became_active":"2023-08-17T00:02:51.351119+0000","last_became_peered":"2023-08-17T00:02:51.351119+0000","last_unstale":"2023-08-17T00:02:51.773255+0000","last_undegraded":"2023-08-17T00:02:51.773255+0000","last_fullsized":"2023-08-17T00:02:51.773255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798841+0000","last_change":"2023-08-17T00:02:51.786494+0000","last_active":"2023-08-17T00:02:51.798841+0000","last_peered":"2023-08-17T00:02:51.798841+0000","last_clean":"2023-08-17T00:02:51.798841+0000","last_became_active":"2023-08-17T00:02:51.786239+0000","last_became_peered":"2023-08-17T00:02:51.786239+0000","last_unstale":"2023-08-17T00:02:51.798841+0000","last_undegraded":"2023-08-17T00:02:51.798841+0000","last_fullsized":"2023-08-17T00:02:51.798841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.788577+0000","last_change":"2023-08-17T00:02:51.341388+0000","last_active":"2023-08-17T00:02:51.788577+0000","last_peered":"2023-08-17T00:02:51.788577+0000","last_clean":"2023-08-17T00:02:51.788577+0000","last_became_active":"2023-08-17T00:02:51.341095+0000","last_became_peered":"2023-08-17T00:02:51.341095+0000","last_unstale":"2023-08-17T00:02:51.788577+0000","last_undegraded":"2023-08-17T00:02:51.788577+0000","last_fullsized":"2023-08-17T00:02:51.788577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802878+0000","last_change":"2023-08-17T00:02:51.795136+0000","last_active":"2023-08-17T00:02:51.802878+0000","last_peered":"2023-08-17T00:02:51.802878+0000","last_clean":"2023-08-17T00:02:51.802878+0000","last_became_active":"2023-08-17T00:02:51.794509+0000","last_became_peered":"2023-08-17T00:02:51.794509+0000","last_unstale":"2023-08-17T00:02:51.802878+0000","last_undegraded":"2023-08-17T00:02:51.802878+0000","last_fullsized":"2023-08-17T00:02:51.802878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803177+0000","last_change":"2023-08-17T00:02:51.347636+0000","last_active":"2023-08-17T00:02:51.803177+0000","last_peered":"2023-08-17T00:02:51.803177+0000","last_clean":"2023-08-17T00:02:51.803177+0000","last_became_active":"2023-08-17T00:02:51.347360+0000","last_became_peered":"2023-08-17T00:02:51.347360+0000","last_unstale":"2023-08-17T00:02:51.803177+0000","last_undegraded":"2023-08-17T00:02:51.803177+0000","last_fullsized":"2023-08-17T00:02:51.803177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784923+0000","last_change":"2023-08-17T00:02:51.774675+0000","last_active":"2023-08-17T00:02:51.784923+0000","last_peered":"2023-08-17T00:02:51.784923+0000","last_clean":"2023-08-17T00:02:51.784923+0000","last_became_active":"2023-08-17T00:02:51.774422+0000","last_became_peered":"2023-08-17T00:02:51.774422+0000","last_unstale":"2023-08-17T00:02:51.784923+0000","last_undegraded":"2023-08-17T00:02:51.784923+0000","last_fullsized":"2023-08-17T00:02:51.784923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795262+0000","last_change":"2023-08-17T00:02:51.344092+0000","last_active":"2023-08-17T00:02:51.795262+0000","last_peered":"2023-08-17T00:02:51.795262+0000","last_clean":"2023-08-17T00:02:51.795262+0000","last_became_active":"2023-08-17T00:02:51.343804+0000","last_became_peered":"2023-08-17T00:02:51.343804+0000","last_unstale":"2023-08-17T00:02:51.795262+0000","last_undegraded":"2023-08-17T00:02:51.795262+0000","last_fullsized":"2023-08-17T00:02:51.795262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803841+0000","last_change":"2023-08-17T00:02:51.796680+0000","last_active":"2023-08-17T00:02:51.803841+0000","last_peered":"2023-08-17T00:02:51.803841+0000","last_clean":"2023-08-17T00:02:51.803841+0000","last_became_active":"2023-08-17T00:02:51.795190+0000","last_became_peered":"2023-08-17T00:02:51.795190+0000","last_unstale":"2023-08-17T00:02:51.803841+0000","last_undegraded":"2023-08-17T00:02:51.803841+0000","last_fullsized":"2023-08-17T00:02:51.803841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768352+0000","last_change":"2023-08-17T00:02:51.349898+0000","last_active":"2023-08-17T00:02:51.768352+0000","last_peered":"2023-08-17T00:02:51.768352+0000","last_clean":"2023-08-17T00:02:51.768352+0000","last_became_active":"2023-08-17T00:02:51.349378+0000","last_became_peered":"2023-08-17T00:02:51.349378+0000","last_unstale":"2023-08-17T00:02:51.768352+0000","last_undegraded":"2023-08-17T00:02:51.768352+0000","last_fullsized":"2023-08-17T00:02:51.768352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803909+0000","last_change":"2023-08-17T00:02:51.797648+0000","last_active":"2023-08-17T00:02:51.803909+0000","last_peered":"2023-08-17T00:02:51.803909+0000","last_clean":"2023-08-17T00:02:51.803909+0000","last_became_active":"2023-08-17T00:02:51.797021+0000","last_became_peered":"2023-08-17T00:02:51.797021+0000","last_unstale":"2023-08-17T00:02:51.803909+0000","last_undegraded":"2023-08-17T00:02:51.803909+0000","last_fullsized":"2023-08-17T00:02:51.803909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779519+0000","last_change":"2023-08-17T00:02:51.341554+0000","last_active":"2023-08-17T00:02:51.779519+0000","last_peered":"2023-08-17T00:02:51.779519+0000","last_clean":"2023-08-17T00:02:51.779519+0000","last_became_active":"2023-08-17T00:02:51.341189+0000","last_became_peered":"2023-08-17T00:02:51.341189+0000","last_unstale":"2023-08-17T00:02:51.779519+0000","last_undegraded":"2023-08-17T00:02:51.779519+0000","last_fullsized":"2023-08-17T00:02:51.779519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790275+0000","last_change":"2023-08-17T00:02:51.786385+0000","last_active":"2023-08-17T00:02:51.790275+0000","last_peered":"2023-08-17T00:02:51.790275+0000","last_clean":"2023-08-17T00:02:51.790275+0000","last_became_active":"2023-08-17T00:02:51.785450+0000","last_became_peered":"2023-08-17T00:02:51.785450+0000","last_unstale":"2023-08-17T00:02:51.790275+0000","last_undegraded":"2023-08-17T00:02:51.790275+0000","last_fullsized":"2023-08-17T00:02:51.790275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802399+0000","last_change":"2023-08-17T00:02:51.341982+0000","last_active":"2023-08-17T00:02:51.802399+0000","last_peered":"2023-08-17T00:02:51.802399+0000","last_clean":"2023-08-17T00:02:51.802399+0000","last_became_active":"2023-08-17T00:02:51.341697+0000","last_became_peered":"2023-08-17T00:02:51.341697+0000","last_unstale":"2023-08-17T00:02:51.802399+0000","last_undegraded":"2023-08-17T00:02:51.802399+0000","last_fullsized":"2023-08-17T00:02:51.802399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800153+0000","last_change":"2023-08-17T00:02:51.798361+0000","last_active":"2023-08-17T00:02:51.800153+0000","last_peered":"2023-08-17T00:02:51.800153+0000","last_clean":"2023-08-17T00:02:51.800153+0000","last_became_active":"2023-08-17T00:02:51.797985+0000","last_became_peered":"2023-08-17T00:02:51.797985+0000","last_unstale":"2023-08-17T00:02:51.800153+0000","last_undegraded":"2023-08-17T00:02:51.800153+0000","last_fullsized":"2023-08-17T00:02:51.800153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779410+0000","last_change":"2023-08-17T00:02:51.345285+0000","last_active":"2023-08-17T00:02:51.779410+0000","last_peered":"2023-08-17T00:02:51.779410+0000","last_clean":"2023-08-17T00:02:51.779410+0000","last_became_active":"2023-08-17T00:02:51.345012+0000","last_became_peered":"2023-08-17T00:02:51.345012+0000","last_unstale":"2023-08-17T00:02:51.779410+0000","last_undegraded":"2023-08-17T00:02:51.779410+0000","last_fullsized":"2023-08-17T00:02:51.779410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.791563+0000","last_change":"2023-08-17T00:02:51.780780+0000","last_active":"2023-08-17T00:02:51.791563+0000","last_peered":"2023-08-17T00:02:51.791563+0000","last_clean":"2023-08-17T00:02:51.791563+0000","last_became_active":"2023-08-17T00:02:51.780499+0000","last_became_peered":"2023-08-17T00:02:51.780499+0000","last_unstale":"2023-08-17T00:02:51.791563+0000","last_undegraded":"2023-08-17T00:02:51.791563+0000","last_fullsized":"2023-08-17T00:02:51.791563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796009+0000","last_change":"2023-08-17T00:02:51.346726+0000","last_active":"2023-08-17T00:02:51.796009+0000","last_peered":"2023-08-17T00:02:51.796009+0000","last_clean":"2023-08-17T00:02:51.796009+0000","last_became_active":"2023-08-17T00:02:51.346453+0000","last_became_peered":"2023-08-17T00:02:51.346453+0000","last_unstale":"2023-08-17T00:02:51.796009+0000","last_undegraded":"2023-08-17T00:02:51.796009+0000","last_fullsized":"2023-08-17T00:02:51.796009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803474+0000","last_change":"2023-08-17T00:02:51.791605+0000","last_active":"2023-08-17T00:02:51.803474+0000","last_peered":"2023-08-17T00:02:51.803474+0000","last_clean":"2023-08-17T00:02:51.803474+0000","last_became_active":"2023-08-17T00:02:51.791337+0000","last_became_peered":"2023-08-17T00:02:51.791337+0000","last_unstale":"2023-08-17T00:02:51.803474+0000","last_undegraded":"2023-08-17T00:02:51.803474+0000","last_fullsized":"2023-08-17T00:02:51.803474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.806325+0000","last_change":"2023-08-17T00:02:51.346596+0000","last_active":"2023-08-17T00:02:51.806325+0000","last_peered":"2023-08-17T00:02:51.806325+0000","last_clean":"2023-08-17T00:02:51.806325+0000","last_became_active":"2023-08-17T00:02:51.346313+0000","last_became_peered":"2023-08-17T00:02:51.346313+0000","last_unstale":"2023-08-17T00:02:51.806325+0000","last_undegraded":"2023-08-17T00:02:51.806325+0000","last_fullsized":"2023-08-17T00:02:51.806325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798176+0000","last_change":"2023-08-17T00:02:51.793285+0000","last_active":"2023-08-17T00:02:51.798176+0000","last_peered":"2023-08-17T00:02:51.798176+0000","last_clean":"2023-08-17T00:02:51.798176+0000","last_became_active":"2023-08-17T00:02:51.791718+0000","last_became_peered":"2023-08-17T00:02:51.791718+0000","last_unstale":"2023-08-17T00:02:51.798176+0000","last_undegraded":"2023-08-17T00:02:51.798176+0000","last_fullsized":"2023-08-17T00:02:51.798176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771929+0000","last_change":"2023-08-17T00:02:51.344568+0000","last_active":"2023-08-17T00:02:51.771929+0000","last_peered":"2023-08-17T00:02:51.771929+0000","last_clean":"2023-08-17T00:02:51.771929+0000","last_became_active":"2023-08-17T00:02:51.344185+0000","last_became_peered":"2023-08-17T00:02:51.344185+0000","last_unstale":"2023-08-17T00:02:51.771929+0000","last_undegraded":"2023-08-17T00:02:51.771929+0000","last_fullsized":"2023-08-17T00:02:51.771929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802759+0000","last_change":"2023-08-17T00:02:51.794651+0000","last_active":"2023-08-17T00:02:51.802759+0000","last_peered":"2023-08-17T00:02:51.802759+0000","last_clean":"2023-08-17T00:02:51.802759+0000","last_became_active":"2023-08-17T00:02:51.794341+0000","last_became_peered":"2023-08-17T00:02:51.794341+0000","last_unstale":"2023-08-17T00:02:51.802759+0000","last_undegraded":"2023-08-17T00:02:51.802759+0000","last_fullsized":"2023-08-17T00:02:51.802759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774235+0000","last_change":"2023-08-17T00:02:51.344305+0000","last_active":"2023-08-17T00:02:51.774235+0000","last_peered":"2023-08-17T00:02:51.774235+0000","last_clean":"2023-08-17T00:02:51.774235+0000","last_became_active":"2023-08-17T00:02:51.341191+0000","last_became_peered":"2023-08-17T00:02:51.341191+0000","last_unstale":"2023-08-17T00:02:51.774235+0000","last_undegraded":"2023-08-17T00:02:51.774235+0000","last_fullsized":"2023-08-17T00:02:51.774235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795708+0000","last_change":"2023-08-17T00:02:51.789154+0000","last_active":"2023-08-17T00:02:51.795708+0000","last_peered":"2023-08-17T00:02:51.795708+0000","last_clean":"2023-08-17T00:02:51.795708+0000","last_became_active":"2023-08-17T00:02:51.788807+0000","last_became_peered":"2023-08-17T00:02:51.788807+0000","last_unstale":"2023-08-17T00:02:51.795708+0000","last_undegraded":"2023-08-17T00:02:51.795708+0000","last_fullsized":"2023-08-17T00:02:51.795708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766911+0000","last_change":"2023-08-17T00:02:51.342636+0000","last_active":"2023-08-17T00:02:51.766911+0000","last_peered":"2023-08-17T00:02:51.766911+0000","last_clean":"2023-08-17T00:02:51.766911+0000","last_became_active":"2023-08-17T00:02:51.342340+0000","last_became_peered":"2023-08-17T00:02:51.342340+0000","last_unstale":"2023-08-17T00:02:51.766911+0000","last_undegraded":"2023-08-17T00:02:51.766911+0000","last_fullsized":"2023-08-17T00:02:51.766911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802639+0000","last_change":"2023-08-17T00:02:51.797499+0000","last_active":"2023-08-17T00:02:51.802639+0000","last_peered":"2023-08-17T00:02:51.802639+0000","last_clean":"2023-08-17T00:02:51.802639+0000","last_became_active":"2023-08-17T00:02:51.797168+0000","last_became_peered":"2023-08-17T00:02:51.797168+0000","last_unstale":"2023-08-17T00:02:51.802639+0000","last_undegraded":"2023-08-17T00:02:51.802639+0000","last_fullsized":"2023-08-17T00:02:51.802639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797340+0000","last_change":"2023-08-17T00:02:51.789012+0000","last_active":"2023-08-17T00:02:51.797340+0000","last_peered":"2023-08-17T00:02:51.797340+0000","last_clean":"2023-08-17T00:02:51.797340+0000","last_became_active":"2023-08-17T00:02:51.788464+0000","last_became_peered":"2023-08-17T00:02:51.788464+0000","last_unstale":"2023-08-17T00:02:51.797340+0000","last_undegraded":"2023-08-17T00:02:51.797340+0000","last_fullsized":"2023-08-17T00:02:51.797340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775204+0000","last_change":"2023-08-17T00:02:51.339223+0000","last_active":"2023-08-17T00:02:51.775204+0000","last_peered":"2023-08-17T00:02:51.775204+0000","last_clean":"2023-08-17T00:02:51.775204+0000","last_became_active":"2023-08-17T00:02:51.338872+0000","last_became_peered":"2023-08-17T00:02:51.338872+0000","last_unstale":"2023-08-17T00:02:51.775204+0000","last_undegraded":"2023-08-17T00:02:51.775204+0000","last_fullsized":"2023-08-17T00:02:51.775204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799128+0000","last_change":"2023-08-17T00:02:51.788420+0000","last_active":"2023-08-17T00:02:51.799128+0000","last_peered":"2023-08-17T00:02:51.799128+0000","last_clean":"2023-08-17T00:02:51.799128+0000","last_became_active":"2023-08-17T00:02:51.788155+0000","last_became_peered":"2023-08-17T00:02:51.788155+0000","last_unstale":"2023-08-17T00:02:51.799128+0000","last_undegraded":"2023-08-17T00:02:51.799128+0000","last_fullsized":"2023-08-17T00:02:51.799128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773169+0000","last_change":"2023-08-17T00:02:51.337198+0000","last_active":"2023-08-17T00:02:51.773169+0000","last_peered":"2023-08-17T00:02:51.773169+0000","last_clean":"2023-08-17T00:02:51.773169+0000","last_became_active":"2023-08-17T00:02:51.336537+0000","last_became_peered":"2023-08-17T00:02:51.336537+0000","last_unstale":"2023-08-17T00:02:51.773169+0000","last_undegraded":"2023-08-17T00:02:51.773169+0000","last_fullsized":"2023-08-17T00:02:51.773169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795487+0000","last_change":"2023-08-17T00:02:51.787948+0000","last_active":"2023-08-17T00:02:51.795487+0000","last_peered":"2023-08-17T00:02:51.795487+0000","last_clean":"2023-08-17T00:02:51.795487+0000","last_became_active":"2023-08-17T00:02:51.787702+0000","last_became_peered":"2023-08-17T00:02:51.787702+0000","last_unstale":"2023-08-17T00:02:51.795487+0000","last_undegraded":"2023-08-17T00:02:51.795487+0000","last_fullsized":"2023-08-17T00:02:51.795487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801892+0000","last_change":"2023-08-17T00:02:51.348795+0000","last_active":"2023-08-17T00:02:51.801892+0000","last_peered":"2023-08-17T00:02:51.801892+0000","last_clean":"2023-08-17T00:02:51.801892+0000","last_became_active":"2023-08-17T00:02:51.341835+0000","last_became_peered":"2023-08-17T00:02:51.341835+0000","last_unstale":"2023-08-17T00:02:51.801892+0000","last_undegraded":"2023-08-17T00:02:51.801892+0000","last_fullsized":"2023-08-17T00:02:51.801892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802783+0000","last_change":"2023-08-17T00:02:51.797751+0000","last_active":"2023-08-17T00:02:51.802783+0000","last_peered":"2023-08-17T00:02:51.802783+0000","last_clean":"2023-08-17T00:02:51.802783+0000","last_became_active":"2023-08-17T00:02:51.797486+0000","last_became_peered":"2023-08-17T00:02:51.797486+0000","last_unstale":"2023-08-17T00:02:51.802783+0000","last_undegraded":"2023-08-17T00:02:51.802783+0000","last_fullsized":"2023-08-17T00:02:51.802783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793391+0000","last_change":"2023-08-17T00:02:51.344236+0000","last_active":"2023-08-17T00:02:51.793391+0000","last_peered":"2023-08-17T00:02:51.793391+0000","last_clean":"2023-08-17T00:02:51.793391+0000","last_became_active":"2023-08-17T00:02:51.343935+0000","last_became_peered":"2023-08-17T00:02:51.343935+0000","last_unstale":"2023-08-17T00:02:51.793391+0000","last_undegraded":"2023-08-17T00:02:51.793391+0000","last_fullsized":"2023-08-17T00:02:51.793391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796985+0000","last_change":"2023-08-17T00:02:51.781786+0000","last_active":"2023-08-17T00:02:51.796985+0000","last_peered":"2023-08-17T00:02:51.796985+0000","last_clean":"2023-08-17T00:02:51.796985+0000","last_became_active":"2023-08-17T00:02:51.781472+0000","last_became_peered":"2023-08-17T00:02:51.781472+0000","last_unstale":"2023-08-17T00:02:51.796985+0000","last_undegraded":"2023-08-17T00:02:51.796985+0000","last_fullsized":"2023-08-17T00:02:51.796985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802048+0000","last_change":"2023-08-17T00:02:51.339145+0000","last_active":"2023-08-17T00:02:51.802048+0000","last_peered":"2023-08-17T00:02:51.802048+0000","last_clean":"2023-08-17T00:02:51.802048+0000","last_became_active":"2023-08-17T00:02:51.338710+0000","last_became_peered":"2023-08-17T00:02:51.338710+0000","last_unstale":"2023-08-17T00:02:51.802048+0000","last_undegraded":"2023-08-17T00:02:51.802048+0000","last_fullsized":"2023-08-17T00:02:51.802048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784977+0000","last_change":"2023-08-17T00:02:51.779058+0000","last_active":"2023-08-17T00:02:51.784977+0000","last_peered":"2023-08-17T00:02:51.784977+0000","last_clean":"2023-08-17T00:02:51.784977+0000","last_became_active":"2023-08-17T00:02:51.778796+0000","last_became_peered":"2023-08-17T00:02:51.778796+0000","last_unstale":"2023-08-17T00:02:51.784977+0000","last_undegraded":"2023-08-17T00:02:51.784977+0000","last_fullsized":"2023-08-17T00:02:51.784977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774792+0000","last_change":"2023-08-17T00:02:51.337656+0000","last_active":"2023-08-17T00:02:51.774792+0000","last_peered":"2023-08-17T00:02:51.774792+0000","last_clean":"2023-08-17T00:02:51.774792+0000","last_became_active":"2023-08-17T00:02:51.337333+0000","last_became_peered":"2023-08-17T00:02:51.337333+0000","last_unstale":"2023-08-17T00:02:51.774792+0000","last_undegraded":"2023-08-17T00:02:51.774792+0000","last_fullsized":"2023-08-17T00:02:51.774792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784887+0000","last_change":"2023-08-17T00:02:51.779981+0000","last_active":"2023-08-17T00:02:51.784887+0000","last_peered":"2023-08-17T00:02:51.784887+0000","last_clean":"2023-08-17T00:02:51.784887+0000","last_became_active":"2023-08-17T00:02:51.779712+0000","last_became_peered":"2023-08-17T00:02:51.779712+0000","last_unstale":"2023-08-17T00:02:51.784887+0000","last_undegraded":"2023-08-17T00:02:51.784887+0000","last_fullsized":"2023-08-17T00:02:51.784887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775012+0000","last_change":"2023-08-17T00:02:51.339106+0000","last_active":"2023-08-17T00:02:51.775012+0000","last_peered":"2023-08-17T00:02:51.775012+0000","last_clean":"2023-08-17T00:02:51.775012+0000","last_became_active":"2023-08-17T00:02:51.338781+0000","last_became_peered":"2023-08-17T00:02:51.338781+0000","last_unstale":"2023-08-17T00:02:51.775012+0000","last_undegraded":"2023-08-17T00:02:51.775012+0000","last_fullsized":"2023-08-17T00:02:51.775012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782043+0000","last_change":"2023-08-17T00:02:51.778317+0000","last_active":"2023-08-17T00:02:51.782043+0000","last_peered":"2023-08-17T00:02:51.782043+0000","last_clean":"2023-08-17T00:02:51.782043+0000","last_became_active":"2023-08-17T00:02:51.778029+0000","last_became_peered":"2023-08-17T00:02:51.778029+0000","last_unstale":"2023-08-17T00:02:51.782043+0000","last_undegraded":"2023-08-17T00:02:51.782043+0000","last_fullsized":"2023-08-17T00:02:51.782043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793540+0000","last_change":"2023-08-17T00:02:51.345678+0000","last_active":"2023-08-17T00:02:51.793540+0000","last_peered":"2023-08-17T00:02:51.793540+0000","last_clean":"2023-08-17T00:02:51.793540+0000","last_became_active":"2023-08-17T00:02:51.345185+0000","last_became_peered":"2023-08-17T00:02:51.345185+0000","last_unstale":"2023-08-17T00:02:51.793540+0000","last_undegraded":"2023-08-17T00:02:51.793540+0000","last_fullsized":"2023-08-17T00:02:51.793540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":84071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:02:55.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:02:56.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.171+0000 7f2249c1b700 1 Processor -- start 2023-08-17T00:02:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.171+0000 7f2249c1b700 1 -- start start 2023-08-17T00:02:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2249c1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f22440a8b70 0x7f22440632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2249c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 0x7f22440bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2249c1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2244065240 con 0x7f22440a8f50 2023-08-17T00:02:56.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2249c1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2244062e60 con 0x7f22440a8b70 2023-08-17T00:02:56.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2249c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22440638a0 con 0x7f22440629b0 2023-08-17T00:02:56.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f223bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f22440a8f50 0x7f22440656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35638/0 (socket says 172.21.15.153:35638) 2023-08-17T00:02:56.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f223bfff700 1 -- 172.21.15.153:0/114676222 learned_addr learned my addr 172.21.15.153:0/114676222 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2243fff700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 0x7f22440bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f22437fe700 1 --2- 172.21.15.153:0/114676222 >> v2:172.21.15.178:3300/0 conn(0x7f22440a8b70 0x7f22440632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074628950 0 0) 0x7f2244065240 con 0x7f22440a8f50 2023-08-17T00:02:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22300033f0 con 0x7f22440a8f50 2023-08-17T00:02:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3657133005 0 0) 0x7f22300033f0 con 0x7f22440a8f50 2023-08-17T00:02:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 msgr2=0x7f22440bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 0x7f22440bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 >> v2:172.21.15.178:3300/0 conn(0x7f22440a8b70 msgr2=0x7f22440632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 --2- 172.21.15.153:0/114676222 >> v2:172.21.15.178:3300/0 conn(0x7f22440a8b70 0x7f22440632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2244065de0 con 0x7f22440a8f50 2023-08-17T00:02:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f222c001470 con 0x7f22440a8f50 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 >> v1:172.21.15.153:6789/0 conn(0x7f22440a8f50 legacy=0x7f22440656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300038e0 0x7f2230003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230004690 0x7f2230004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 0x7f2230005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244062e60 con 0x7f22300038e0 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440638a0 con 0x7f2230004690 2023-08-17T00:02:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223000b8e0 con 0x7f22440629b0 2023-08-17T00:02:56.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f22437fe700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300038e0 0x7f2230003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.175+0000 7f223bfff700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230004690 0x7f2230004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2243fff700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 0x7f2230005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f22437fe700 1 -- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 msgr2=0x7f2230005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:56.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f22437fe700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22440629b0 0x7f2230005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f22437fe700 1 -- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230004690 msgr2=0x7f2230004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:56.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f22437fe700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230004690 0x7f2230004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f22437fe700 1 -- 172.21.15.153:0/114676222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300033f0 con 0x7f22300038e0 2023-08-17T00:02:56.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f223bfff700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230004690 0x7f2230004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:56.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f22437fe700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300038e0 0x7f2230003d00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2234009a80 tx=0x7f2234009060).ready entity=mon.0 client_cookie=2d070d541fdc87c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:56.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234009430 con 0x7f22300038e0 2023-08-17T00:02:56.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400e640 con 0x7f22300038e0 2023-08-17T00:02:56.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2242ffd700 1 -- 172.21.15.153:0/114676222 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400e9c0 con 0x7f22300038e0 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2249c1b700 1 -- 172.21.15.153:0/114676222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300038e0 msgr2=0x7f2230003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2249c1b700 1 --2- 172.21.15.153:0/114676222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300038e0 0x7f2230003d00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f2234009a80 tx=0x7f2234009060).stop 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2243fff700 1 -- 172.21.15.153:0/114676222 reap_dead start 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2249c1b700 1 -- 172.21.15.153:0/114676222 shutdown_connections 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2249c1b700 1 -- 172.21.15.153:0/114676222 >> 172.21.15.153:0/114676222 conn(0x7f22440c7150 msgr2=0x7f22440c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2249c1b700 1 -- 172.21.15.153:0/114676222 shutdown_connections 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.179+0000 7f2249c1b700 1 -- 172.21.15.153:0/114676222 wait complete. 2023-08-17T00:02:56.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 Processor -- start 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 -- start start 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300038e0 0x7f224416cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 0x7f22440c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2244154fd0 0x7f22440c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22440c5e90 con 0x7f2244154b70 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2244158fe0 con 0x7f2244154fd0 2023-08-17T00:02:56.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2249c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224416d290 con 0x7f22300038e0 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 0x7f22440c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 0x7f22440c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55824/0 (socket says 172.21.15.153:55824) 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 -- 172.21.15.153:0/346192651 learned_addr learned my addr 172.21.15.153:0/346192651 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f22437fe700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300038e0 0x7f224416cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f2243fff700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2244154fd0 0x7f22440c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 -- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300038e0 msgr2=0x7f224416cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300038e0 0x7f224416cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 -- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2244154fd0 msgr2=0x7f22440c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2244154fd0 0x7f22440c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 -- 172.21.15.153:0/346192651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440ac080 con 0x7f2244154b70 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.183+0000 7f223bfff700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 0x7f22440c54b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f222c0079d0 tx=0x7f222c001e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c011590 con 0x7f2244154b70 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c0116f0 con 0x7f2244154b70 2023-08-17T00:02:56.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22440ac360 con 0x7f2244154b70 2023-08-17T00:02:56.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c011a70 con 0x7f2244154b70 2023-08-17T00:02:56.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2244158c70 con 0x7f2244154b70 2023-08-17T00:02:56.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2244159170 con 0x7f2244154b70 2023-08-17T00:02:56.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.187+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f222c01b030 con 0x7f2244154b70 2023-08-17T00:02:56.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.191+0000 7f223b7fe700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f222405a180 0x7f222405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.191+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f222c0738e0 con 0x7f2244154b70 2023-08-17T00:02:56.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.191+0000 7f22437fe700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f222405a180 0x7f222405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.191+0000 7f22437fe700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f222405a180 0x7f222405c640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2234006c40 tx=0x7f223401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:56.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.195+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f222c047330 con 0x7f2244154b70 2023-08-17T00:02:56.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.355+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f224406b530 con 0x7f222405a180 2023-08-17T00:02:56.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.375+0000 7f223b7fe700 1 -- 172.21.15.153:0/346192651 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336319 (secure 0 0 0) 0x7f224406b530 con 0x7f222405a180 2023-08-17T00:02:56.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.383+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f222405a180 msgr2=0x7f222405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.383+0000 7f2249c1b700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f222405a180 0x7f222405c640 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2234006c40 tx=0x7f223401a000).stop 2023-08-17T00:02:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 msgr2=0x7f22440c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 0x7f22440c54b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f222c0079d0 tx=0x7f222c001e90).stop 2023-08-17T00:02:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 shutdown_connections 2023-08-17T00:02:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f222405a180 0x7f222405c640 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2244154fd0 0x7f22440c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2244154b70 0x7f22440c54b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 --2- 172.21.15.153:0/346192651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300038e0 0x7f224416cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 >> 172.21.15.153:0/346192651 conn(0x7f22440c7150 msgr2=0x7f22441577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 shutdown_connections 2023-08-17T00:02:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.387+0000 7f2249c1b700 1 -- 172.21.15.153:0/346192651 wait complete. 2023-08-17T00:02:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:02:56.409 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-08-17T00:02:55.166778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":238,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":669868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.794978+0000","last_change":"2023-08-17T00:02:51.792258+0000","last_active":"2023-08-17T00:02:51.794978+0000","last_peered":"2023-08-17T00:02:51.794978+0000","last_clean":"2023-08-17T00:02:51.794978+0000","last_became_active":"2023-08-17T00:02:51.791987+0000","last_became_peered":"2023-08-17T00:02:51.791987+0000","last_unstale":"2023-08-17T00:02:51.794978+0000","last_undegraded":"2023-08-17T00:02:51.794978+0000","last_fullsized":"2023-08-17T00:02:51.794978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774573+0000","last_change":"2023-08-17T00:02:51.339335+0000","last_active":"2023-08-17T00:02:51.774573+0000","last_peered":"2023-08-17T00:02:51.774573+0000","last_clean":"2023-08-17T00:02:51.774573+0000","last_became_active":"2023-08-17T00:02:51.338962+0000","last_became_peered":"2023-08-17T00:02:51.338962+0000","last_unstale":"2023-08-17T00:02:51.774573+0000","last_undegraded":"2023-08-17T00:02:51.774573+0000","last_fullsized":"2023-08-17T00:02:51.774573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802676+0000","last_change":"2023-08-17T00:02:51.791169+0000","last_active":"2023-08-17T00:02:51.802676+0000","last_peered":"2023-08-17T00:02:51.802676+0000","last_clean":"2023-08-17T00:02:51.802676+0000","last_became_active":"2023-08-17T00:02:51.790753+0000","last_became_peered":"2023-08-17T00:02:51.790753+0000","last_unstale":"2023-08-17T00:02:51.802676+0000","last_undegraded":"2023-08-17T00:02:51.802676+0000","last_fullsized":"2023-08-17T00:02:51.802676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802597+0000","last_change":"2023-08-17T00:02:51.349913+0000","last_active":"2023-08-17T00:02:51.802597+0000","last_peered":"2023-08-17T00:02:51.802597+0000","last_clean":"2023-08-17T00:02:51.802597+0000","last_became_active":"2023-08-17T00:02:51.349595+0000","last_became_peered":"2023-08-17T00:02:51.349595+0000","last_unstale":"2023-08-17T00:02:51.802597+0000","last_undegraded":"2023-08-17T00:02:51.802597+0000","last_fullsized":"2023-08-17T00:02:51.802597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770825+0000","last_change":"2023-08-17T00:02:51.342535+0000","last_active":"2023-08-17T00:02:51.770825+0000","last_peered":"2023-08-17T00:02:51.770825+0000","last_clean":"2023-08-17T00:02:51.770825+0000","last_became_active":"2023-08-17T00:02:51.342270+0000","last_became_peered":"2023-08-17T00:02:51.342270+0000","last_unstale":"2023-08-17T00:02:51.770825+0000","last_undegraded":"2023-08-17T00:02:51.770825+0000","last_fullsized":"2023-08-17T00:02:51.770825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802817+0000","last_change":"2023-08-17T00:02:51.794750+0000","last_active":"2023-08-17T00:02:51.802817+0000","last_peered":"2023-08-17T00:02:51.802817+0000","last_clean":"2023-08-17T00:02:51.802817+0000","last_became_active":"2023-08-17T00:02:51.794394+0000","last_became_peered":"2023-08-17T00:02:51.794394+0000","last_unstale":"2023-08-17T00:02:51.802817+0000","last_undegraded":"2023-08-17T00:02:51.802817+0000","last_fullsized":"2023-08-17T00:02:51.802817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.786225+0000","last_change":"2023-08-17T00:02:51.360726+0000","last_active":"2023-08-17T00:02:51.786225+0000","last_peered":"2023-08-17T00:02:51.786225+0000","last_clean":"2023-08-17T00:02:51.786225+0000","last_became_active":"2023-08-17T00:02:51.360479+0000","last_became_peered":"2023-08-17T00:02:51.360479+0000","last_unstale":"2023-08-17T00:02:51.786225+0000","last_undegraded":"2023-08-17T00:02:51.786225+0000","last_fullsized":"2023-08-17T00:02:51.786225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800703+0000","last_change":"2023-08-17T00:02:51.787355+0000","last_active":"2023-08-17T00:02:51.800703+0000","last_peered":"2023-08-17T00:02:51.800703+0000","last_clean":"2023-08-17T00:02:51.800703+0000","last_became_active":"2023-08-17T00:02:51.787048+0000","last_became_peered":"2023-08-17T00:02:51.787048+0000","last_unstale":"2023-08-17T00:02:51.800703+0000","last_undegraded":"2023-08-17T00:02:51.800703+0000","last_fullsized":"2023-08-17T00:02:51.800703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803300+0000","last_change":"2023-08-17T00:02:51.338960+0000","last_active":"2023-08-17T00:02:51.803300+0000","last_peered":"2023-08-17T00:02:51.803300+0000","last_clean":"2023-08-17T00:02:51.803300+0000","last_became_active":"2023-08-17T00:02:51.338664+0000","last_became_peered":"2023-08-17T00:02:51.338664+0000","last_unstale":"2023-08-17T00:02:51.803300+0000","last_undegraded":"2023-08-17T00:02:51.803300+0000","last_fullsized":"2023-08-17T00:02:51.803300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802710+0000","last_change":"2023-08-17T00:02:51.799132+0000","last_active":"2023-08-17T00:02:51.802710+0000","last_peered":"2023-08-17T00:02:51.802710+0000","last_clean":"2023-08-17T00:02:51.802710+0000","last_became_active":"2023-08-17T00:02:51.798805+0000","last_became_peered":"2023-08-17T00:02:51.798805+0000","last_unstale":"2023-08-17T00:02:51.802710+0000","last_undegraded":"2023-08-17T00:02:51.802710+0000","last_fullsized":"2023-08-17T00:02:51.802710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775014+0000","last_change":"2023-08-17T00:02:51.346796+0000","last_active":"2023-08-17T00:02:51.775014+0000","last_peered":"2023-08-17T00:02:51.775014+0000","last_clean":"2023-08-17T00:02:51.775014+0000","last_became_active":"2023-08-17T00:02:51.346406+0000","last_became_peered":"2023-08-17T00:02:51.346406+0000","last_unstale":"2023-08-17T00:02:51.775014+0000","last_undegraded":"2023-08-17T00:02:51.775014+0000","last_fullsized":"2023-08-17T00:02:51.775014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803115+0000","last_change":"2023-08-17T00:02:51.799601+0000","last_active":"2023-08-17T00:02:51.803115+0000","last_peered":"2023-08-17T00:02:51.803115+0000","last_clean":"2023-08-17T00:02:51.803115+0000","last_became_active":"2023-08-17T00:02:51.795434+0000","last_became_peered":"2023-08-17T00:02:51.795434+0000","last_unstale":"2023-08-17T00:02:51.803115+0000","last_undegraded":"2023-08-17T00:02:51.803115+0000","last_fullsized":"2023-08-17T00:02:51.803115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799219+0000","last_change":"2023-08-17T00:02:51.349039+0000","last_active":"2023-08-17T00:02:51.799219+0000","last_peered":"2023-08-17T00:02:51.799219+0000","last_clean":"2023-08-17T00:02:51.799219+0000","last_became_active":"2023-08-17T00:02:51.348701+0000","last_became_peered":"2023-08-17T00:02:51.348701+0000","last_unstale":"2023-08-17T00:02:51.799219+0000","last_undegraded":"2023-08-17T00:02:51.799219+0000","last_fullsized":"2023-08-17T00:02:51.799219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799387+0000","last_change":"2023-08-17T00:02:51.792387+0000","last_active":"2023-08-17T00:02:51.799387+0000","last_peered":"2023-08-17T00:02:51.799387+0000","last_clean":"2023-08-17T00:02:51.799387+0000","last_became_active":"2023-08-17T00:02:51.792133+0000","last_became_peered":"2023-08-17T00:02:51.792133+0000","last_unstale":"2023-08-17T00:02:51.799387+0000","last_undegraded":"2023-08-17T00:02:51.799387+0000","last_fullsized":"2023-08-17T00:02:51.799387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767037+0000","last_change":"2023-08-17T00:02:51.342138+0000","last_active":"2023-08-17T00:02:51.767037+0000","last_peered":"2023-08-17T00:02:51.767037+0000","last_clean":"2023-08-17T00:02:51.767037+0000","last_became_active":"2023-08-17T00:02:51.341316+0000","last_became_peered":"2023-08-17T00:02:51.341316+0000","last_unstale":"2023-08-17T00:02:51.767037+0000","last_undegraded":"2023-08-17T00:02:51.767037+0000","last_fullsized":"2023-08-17T00:02:51.767037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803438+0000","last_change":"2023-08-17T00:02:51.791960+0000","last_active":"2023-08-17T00:02:51.803438+0000","last_peered":"2023-08-17T00:02:51.803438+0000","last_clean":"2023-08-17T00:02:51.803438+0000","last_became_active":"2023-08-17T00:02:51.791680+0000","last_became_peered":"2023-08-17T00:02:51.791680+0000","last_unstale":"2023-08-17T00:02:51.803438+0000","last_undegraded":"2023-08-17T00:02:51.803438+0000","last_fullsized":"2023-08-17T00:02:51.803438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774692+0000","last_change":"2023-08-17T00:02:51.350536+0000","last_active":"2023-08-17T00:02:51.774692+0000","last_peered":"2023-08-17T00:02:51.774692+0000","last_clean":"2023-08-17T00:02:51.774692+0000","last_became_active":"2023-08-17T00:02:51.350180+0000","last_became_peered":"2023-08-17T00:02:51.350180+0000","last_unstale":"2023-08-17T00:02:51.774692+0000","last_undegraded":"2023-08-17T00:02:51.774692+0000","last_fullsized":"2023-08-17T00:02:51.774692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802758+0000","last_change":"2023-08-17T00:02:51.797907+0000","last_active":"2023-08-17T00:02:51.802758+0000","last_peered":"2023-08-17T00:02:51.802758+0000","last_clean":"2023-08-17T00:02:51.802758+0000","last_became_active":"2023-08-17T00:02:51.797480+0000","last_became_peered":"2023-08-17T00:02:51.797480+0000","last_unstale":"2023-08-17T00:02:51.802758+0000","last_undegraded":"2023-08-17T00:02:51.802758+0000","last_fullsized":"2023-08-17T00:02:51.802758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770167+0000","last_change":"2023-08-17T00:02:51.351104+0000","last_active":"2023-08-17T00:02:51.770167+0000","last_peered":"2023-08-17T00:02:51.770167+0000","last_clean":"2023-08-17T00:02:51.770167+0000","last_became_active":"2023-08-17T00:02:51.350791+0000","last_became_peered":"2023-08-17T00:02:51.350791+0000","last_unstale":"2023-08-17T00:02:51.770167+0000","last_undegraded":"2023-08-17T00:02:51.770167+0000","last_fullsized":"2023-08-17T00:02:51.770167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802476+0000","last_change":"2023-08-17T00:02:51.794083+0000","last_active":"2023-08-17T00:02:51.802476+0000","last_peered":"2023-08-17T00:02:51.802476+0000","last_clean":"2023-08-17T00:02:51.802476+0000","last_became_active":"2023-08-17T00:02:51.793757+0000","last_became_peered":"2023-08-17T00:02:51.793757+0000","last_unstale":"2023-08-17T00:02:51.802476+0000","last_undegraded":"2023-08-17T00:02:51.802476+0000","last_fullsized":"2023-08-17T00:02:51.802476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776347+0000","last_change":"2023-08-17T00:02:51.350940+0000","last_active":"2023-08-17T00:02:51.776347+0000","last_peered":"2023-08-17T00:02:51.776347+0000","last_clean":"2023-08-17T00:02:51.776347+0000","last_became_active":"2023-08-17T00:02:51.350441+0000","last_became_peered":"2023-08-17T00:02:51.350441+0000","last_unstale":"2023-08-17T00:02:51.776347+0000","last_undegraded":"2023-08-17T00:02:51.776347+0000","last_fullsized":"2023-08-17T00:02:51.776347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782080+0000","last_change":"2023-08-17T00:02:51.778464+0000","last_active":"2023-08-17T00:02:51.782080+0000","last_peered":"2023-08-17T00:02:51.782080+0000","last_clean":"2023-08-17T00:02:51.782080+0000","last_became_active":"2023-08-17T00:02:51.778226+0000","last_became_peered":"2023-08-17T00:02:51.778226+0000","last_unstale":"2023-08-17T00:02:51.782080+0000","last_undegraded":"2023-08-17T00:02:51.782080+0000","last_fullsized":"2023-08-17T00:02:51.782080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772282+0000","last_change":"2023-08-17T00:02:51.340239+0000","last_active":"2023-08-17T00:02:51.772282+0000","last_peered":"2023-08-17T00:02:51.772282+0000","last_clean":"2023-08-17T00:02:51.772282+0000","last_became_active":"2023-08-17T00:02:51.339974+0000","last_became_peered":"2023-08-17T00:02:51.339974+0000","last_unstale":"2023-08-17T00:02:51.772282+0000","last_undegraded":"2023-08-17T00:02:51.772282+0000","last_fullsized":"2023-08-17T00:02:51.772282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798032+0000","last_change":"2023-08-17T00:02:51.792139+0000","last_active":"2023-08-17T00:02:51.798032+0000","last_peered":"2023-08-17T00:02:51.798032+0000","last_clean":"2023-08-17T00:02:51.798032+0000","last_became_active":"2023-08-17T00:02:51.791871+0000","last_became_peered":"2023-08-17T00:02:51.791871+0000","last_unstale":"2023-08-17T00:02:51.798032+0000","last_undegraded":"2023-08-17T00:02:51.798032+0000","last_fullsized":"2023-08-17T00:02:51.798032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776993+0000","last_change":"2023-08-17T00:02:51.346632+0000","last_active":"2023-08-17T00:02:51.776993+0000","last_peered":"2023-08-17T00:02:51.776993+0000","last_clean":"2023-08-17T00:02:51.776993+0000","last_became_active":"2023-08-17T00:02:51.346360+0000","last_became_peered":"2023-08-17T00:02:51.346360+0000","last_unstale":"2023-08-17T00:02:51.776993+0000","last_undegraded":"2023-08-17T00:02:51.776993+0000","last_fullsized":"2023-08-17T00:02:51.776993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795767+0000","last_change":"2023-08-17T00:02:51.791363+0000","last_active":"2023-08-17T00:02:51.795767+0000","last_peered":"2023-08-17T00:02:51.795767+0000","last_clean":"2023-08-17T00:02:51.795767+0000","last_became_active":"2023-08-17T00:02:51.791061+0000","last_became_peered":"2023-08-17T00:02:51.791061+0000","last_unstale":"2023-08-17T00:02:51.795767+0000","last_undegraded":"2023-08-17T00:02:51.795767+0000","last_fullsized":"2023-08-17T00:02:51.795767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780186+0000","last_change":"2023-08-17T00:02:51.354878+0000","last_active":"2023-08-17T00:02:51.780186+0000","last_peered":"2023-08-17T00:02:51.780186+0000","last_clean":"2023-08-17T00:02:51.780186+0000","last_became_active":"2023-08-17T00:02:51.354620+0000","last_became_peered":"2023-08-17T00:02:51.354620+0000","last_unstale":"2023-08-17T00:02:51.780186+0000","last_undegraded":"2023-08-17T00:02:51.780186+0000","last_fullsized":"2023-08-17T00:02:51.780186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790458+0000","last_change":"2023-08-17T00:02:51.786538+0000","last_active":"2023-08-17T00:02:51.790458+0000","last_peered":"2023-08-17T00:02:51.790458+0000","last_clean":"2023-08-17T00:02:51.790458+0000","last_became_active":"2023-08-17T00:02:51.786215+0000","last_became_peered":"2023-08-17T00:02:51.786215+0000","last_unstale":"2023-08-17T00:02:51.790458+0000","last_undegraded":"2023-08-17T00:02:51.790458+0000","last_fullsized":"2023-08-17T00:02:51.790458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775020+0000","last_change":"2023-08-17T00:02:51.350207+0000","last_active":"2023-08-17T00:02:51.775020+0000","last_peered":"2023-08-17T00:02:51.775020+0000","last_clean":"2023-08-17T00:02:51.775020+0000","last_became_active":"2023-08-17T00:02:51.349890+0000","last_became_peered":"2023-08-17T00:02:51.349890+0000","last_unstale":"2023-08-17T00:02:51.775020+0000","last_undegraded":"2023-08-17T00:02:51.775020+0000","last_fullsized":"2023-08-17T00:02:51.775020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790419+0000","last_change":"2023-08-17T00:02:51.787178+0000","last_active":"2023-08-17T00:02:51.790419+0000","last_peered":"2023-08-17T00:02:51.790419+0000","last_clean":"2023-08-17T00:02:51.790419+0000","last_became_active":"2023-08-17T00:02:51.786896+0000","last_became_peered":"2023-08-17T00:02:51.786896+0000","last_unstale":"2023-08-17T00:02:51.790419+0000","last_undegraded":"2023-08-17T00:02:51.790419+0000","last_fullsized":"2023-08-17T00:02:51.790419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769107+0000","last_change":"2023-08-17T00:02:51.351372+0000","last_active":"2023-08-17T00:02:51.769107+0000","last_peered":"2023-08-17T00:02:51.769107+0000","last_clean":"2023-08-17T00:02:51.769107+0000","last_became_active":"2023-08-17T00:02:51.350520+0000","last_became_peered":"2023-08-17T00:02:51.350520+0000","last_unstale":"2023-08-17T00:02:51.769107+0000","last_undegraded":"2023-08-17T00:02:51.769107+0000","last_fullsized":"2023-08-17T00:02:51.769107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790239+0000","last_change":"2023-08-17T00:02:51.786052+0000","last_active":"2023-08-17T00:02:51.790239+0000","last_peered":"2023-08-17T00:02:51.790239+0000","last_clean":"2023-08-17T00:02:51.790239+0000","last_became_active":"2023-08-17T00:02:51.784778+0000","last_became_peered":"2023-08-17T00:02:51.784778+0000","last_unstale":"2023-08-17T00:02:51.790239+0000","last_undegraded":"2023-08-17T00:02:51.790239+0000","last_fullsized":"2023-08-17T00:02:51.790239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780523+0000","last_change":"2023-08-17T00:02:51.352623+0000","last_active":"2023-08-17T00:02:51.780523+0000","last_peered":"2023-08-17T00:02:51.780523+0000","last_clean":"2023-08-17T00:02:51.780523+0000","last_became_active":"2023-08-17T00:02:51.352286+0000","last_became_peered":"2023-08-17T00:02:51.352286+0000","last_unstale":"2023-08-17T00:02:51.780523+0000","last_undegraded":"2023-08-17T00:02:51.780523+0000","last_fullsized":"2023-08-17T00:02:51.780523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803784+0000","last_change":"2023-08-17T00:02:51.801853+0000","last_active":"2023-08-17T00:02:51.803784+0000","last_peered":"2023-08-17T00:02:51.803784+0000","last_clean":"2023-08-17T00:02:51.803784+0000","last_became_active":"2023-08-17T00:02:51.801540+0000","last_became_peered":"2023-08-17T00:02:51.801540+0000","last_unstale":"2023-08-17T00:02:51.803784+0000","last_undegraded":"2023-08-17T00:02:51.803784+0000","last_fullsized":"2023-08-17T00:02:51.803784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:51.338361+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:51.338040+0000","last_became_peered":"2023-08-17T00:02:51.338040+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802658+0000","last_change":"2023-08-17T00:02:51.788068+0000","last_active":"2023-08-17T00:02:51.802658+0000","last_peered":"2023-08-17T00:02:51.802658+0000","last_clean":"2023-08-17T00:02:51.802658+0000","last_became_active":"2023-08-17T00:02:51.787734+0000","last_became_peered":"2023-08-17T00:02:51.787734+0000","last_unstale":"2023-08-17T00:02:51.802658+0000","last_undegraded":"2023-08-17T00:02:51.802658+0000","last_fullsized":"2023-08-17T00:02:51.802658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801530+0000","last_change":"2023-08-17T00:02:51.350761+0000","last_active":"2023-08-17T00:02:51.801530+0000","last_peered":"2023-08-17T00:02:51.801530+0000","last_clean":"2023-08-17T00:02:51.801530+0000","last_became_active":"2023-08-17T00:02:51.347875+0000","last_became_peered":"2023-08-17T00:02:51.347875+0000","last_unstale":"2023-08-17T00:02:51.801530+0000","last_undegraded":"2023-08-17T00:02:51.801530+0000","last_fullsized":"2023-08-17T00:02:51.801530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799118+0000","last_change":"2023-08-17T00:02:51.788452+0000","last_active":"2023-08-17T00:02:51.799118+0000","last_peered":"2023-08-17T00:02:51.799118+0000","last_clean":"2023-08-17T00:02:51.799118+0000","last_became_active":"2023-08-17T00:02:51.788147+0000","last_became_peered":"2023-08-17T00:02:51.788147+0000","last_unstale":"2023-08-17T00:02:51.799118+0000","last_undegraded":"2023-08-17T00:02:51.799118+0000","last_fullsized":"2023-08-17T00:02:51.799118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789445+0000","last_change":"2023-08-17T00:02:51.355054+0000","last_active":"2023-08-17T00:02:51.789445+0000","last_peered":"2023-08-17T00:02:51.789445+0000","last_clean":"2023-08-17T00:02:51.789445+0000","last_became_active":"2023-08-17T00:02:51.354677+0000","last_became_peered":"2023-08-17T00:02:51.354677+0000","last_unstale":"2023-08-17T00:02:51.789445+0000","last_undegraded":"2023-08-17T00:02:51.789445+0000","last_fullsized":"2023-08-17T00:02:51.789445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802453+0000","last_change":"2023-08-17T00:02:51.794268+0000","last_active":"2023-08-17T00:02:51.802453+0000","last_peered":"2023-08-17T00:02:51.802453+0000","last_clean":"2023-08-17T00:02:51.802453+0000","last_became_active":"2023-08-17T00:02:51.793909+0000","last_became_peered":"2023-08-17T00:02:51.793909+0000","last_unstale":"2023-08-17T00:02:51.802453+0000","last_undegraded":"2023-08-17T00:02:51.802453+0000","last_fullsized":"2023-08-17T00:02:51.802453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802558+0000","last_change":"2023-08-17T00:02:51.351466+0000","last_active":"2023-08-17T00:02:51.802558+0000","last_peered":"2023-08-17T00:02:51.802558+0000","last_clean":"2023-08-17T00:02:51.802558+0000","last_became_active":"2023-08-17T00:02:51.350746+0000","last_became_peered":"2023-08-17T00:02:51.350746+0000","last_unstale":"2023-08-17T00:02:51.802558+0000","last_undegraded":"2023-08-17T00:02:51.802558+0000","last_fullsized":"2023-08-17T00:02:51.802558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799918+0000","last_change":"2023-08-17T00:02:51.789270+0000","last_active":"2023-08-17T00:02:51.799918+0000","last_peered":"2023-08-17T00:02:51.799918+0000","last_clean":"2023-08-17T00:02:51.799918+0000","last_became_active":"2023-08-17T00:02:51.789010+0000","last_became_peered":"2023-08-17T00:02:51.789010+0000","last_unstale":"2023-08-17T00:02:51.799918+0000","last_undegraded":"2023-08-17T00:02:51.799918+0000","last_fullsized":"2023-08-17T00:02:51.799918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766901+0000","last_change":"2023-08-17T00:02:51.334024+0000","last_active":"2023-08-17T00:02:51.766901+0000","last_peered":"2023-08-17T00:02:51.766901+0000","last_clean":"2023-08-17T00:02:51.766901+0000","last_became_active":"2023-08-17T00:02:51.332857+0000","last_became_peered":"2023-08-17T00:02:51.332857+0000","last_unstale":"2023-08-17T00:02:51.766901+0000","last_undegraded":"2023-08-17T00:02:51.766901+0000","last_fullsized":"2023-08-17T00:02:51.766901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799394+0000","last_change":"2023-08-17T00:02:51.792683+0000","last_active":"2023-08-17T00:02:51.799394+0000","last_peered":"2023-08-17T00:02:51.799394+0000","last_clean":"2023-08-17T00:02:51.799394+0000","last_became_active":"2023-08-17T00:02:51.792366+0000","last_became_peered":"2023-08-17T00:02:51.792366+0000","last_unstale":"2023-08-17T00:02:51.799394+0000","last_undegraded":"2023-08-17T00:02:51.799394+0000","last_fullsized":"2023-08-17T00:02:51.799394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771706+0000","last_change":"2023-08-17T00:02:51.349003+0000","last_active":"2023-08-17T00:02:51.771706+0000","last_peered":"2023-08-17T00:02:51.771706+0000","last_clean":"2023-08-17T00:02:51.771706+0000","last_became_active":"2023-08-17T00:02:51.347537+0000","last_became_peered":"2023-08-17T00:02:51.347537+0000","last_unstale":"2023-08-17T00:02:51.771706+0000","last_undegraded":"2023-08-17T00:02:51.771706+0000","last_fullsized":"2023-08-17T00:02:51.771706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802086+0000","last_change":"2023-08-17T00:02:51.792987+0000","last_active":"2023-08-17T00:02:51.802086+0000","last_peered":"2023-08-17T00:02:51.802086+0000","last_clean":"2023-08-17T00:02:51.802086+0000","last_became_active":"2023-08-17T00:02:51.792614+0000","last_became_peered":"2023-08-17T00:02:51.792614+0000","last_unstale":"2023-08-17T00:02:51.802086+0000","last_undegraded":"2023-08-17T00:02:51.802086+0000","last_fullsized":"2023-08-17T00:02:51.802086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767113+0000","last_change":"2023-08-17T00:02:51.341657+0000","last_active":"2023-08-17T00:02:51.767113+0000","last_peered":"2023-08-17T00:02:51.767113+0000","last_clean":"2023-08-17T00:02:51.767113+0000","last_became_active":"2023-08-17T00:02:51.340926+0000","last_became_peered":"2023-08-17T00:02:51.340926+0000","last_unstale":"2023-08-17T00:02:51.767113+0000","last_undegraded":"2023-08-17T00:02:51.767113+0000","last_fullsized":"2023-08-17T00:02:51.767113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802511+0000","last_change":"2023-08-17T00:02:51.794147+0000","last_active":"2023-08-17T00:02:51.802511+0000","last_peered":"2023-08-17T00:02:51.802511+0000","last_clean":"2023-08-17T00:02:51.802511+0000","last_became_active":"2023-08-17T00:02:51.793842+0000","last_became_peered":"2023-08-17T00:02:51.793842+0000","last_unstale":"2023-08-17T00:02:51.802511+0000","last_undegraded":"2023-08-17T00:02:51.802511+0000","last_fullsized":"2023-08-17T00:02:51.802511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770938+0000","last_change":"2023-08-17T00:02:51.344894+0000","last_active":"2023-08-17T00:02:51.770938+0000","last_peered":"2023-08-17T00:02:51.770938+0000","last_clean":"2023-08-17T00:02:51.770938+0000","last_became_active":"2023-08-17T00:02:51.344238+0000","last_became_peered":"2023-08-17T00:02:51.344238+0000","last_unstale":"2023-08-17T00:02:51.770938+0000","last_undegraded":"2023-08-17T00:02:51.770938+0000","last_fullsized":"2023-08-17T00:02:51.770938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802630+0000","last_change":"2023-08-17T00:02:51.793264+0000","last_active":"2023-08-17T00:02:51.802630+0000","last_peered":"2023-08-17T00:02:51.802630+0000","last_clean":"2023-08-17T00:02:51.802630+0000","last_became_active":"2023-08-17T00:02:51.792918+0000","last_became_peered":"2023-08-17T00:02:51.792918+0000","last_unstale":"2023-08-17T00:02:51.802630+0000","last_undegraded":"2023-08-17T00:02:51.802630+0000","last_fullsized":"2023-08-17T00:02:51.802630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775453+0000","last_change":"2023-08-17T00:02:51.339413+0000","last_active":"2023-08-17T00:02:51.775453+0000","last_peered":"2023-08-17T00:02:51.775453+0000","last_clean":"2023-08-17T00:02:51.775453+0000","last_became_active":"2023-08-17T00:02:51.339094+0000","last_became_peered":"2023-08-17T00:02:51.339094+0000","last_unstale":"2023-08-17T00:02:51.775453+0000","last_undegraded":"2023-08-17T00:02:51.775453+0000","last_fullsized":"2023-08-17T00:02:51.775453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802813+0000","last_change":"2023-08-17T00:02:51.795000+0000","last_active":"2023-08-17T00:02:51.802813+0000","last_peered":"2023-08-17T00:02:51.802813+0000","last_clean":"2023-08-17T00:02:51.802813+0000","last_became_active":"2023-08-17T00:02:51.794722+0000","last_became_peered":"2023-08-17T00:02:51.794722+0000","last_unstale":"2023-08-17T00:02:51.802813+0000","last_undegraded":"2023-08-17T00:02:51.802813+0000","last_fullsized":"2023-08-17T00:02:51.802813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776484+0000","last_change":"2023-08-17T00:02:51.343058+0000","last_active":"2023-08-17T00:02:51.776484+0000","last_peered":"2023-08-17T00:02:51.776484+0000","last_clean":"2023-08-17T00:02:51.776484+0000","last_became_active":"2023-08-17T00:02:51.342764+0000","last_became_peered":"2023-08-17T00:02:51.342764+0000","last_unstale":"2023-08-17T00:02:51.776484+0000","last_undegraded":"2023-08-17T00:02:51.776484+0000","last_fullsized":"2023-08-17T00:02:51.776484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803681+0000","last_change":"2023-08-17T00:02:51.800364+0000","last_active":"2023-08-17T00:02:51.803681+0000","last_peered":"2023-08-17T00:02:51.803681+0000","last_clean":"2023-08-17T00:02:51.803681+0000","last_became_active":"2023-08-17T00:02:51.800036+0000","last_became_peered":"2023-08-17T00:02:51.800036+0000","last_unstale":"2023-08-17T00:02:51.803681+0000","last_undegraded":"2023-08-17T00:02:51.803681+0000","last_fullsized":"2023-08-17T00:02:51.803681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772373+0000","last_change":"2023-08-17T00:02:51.341857+0000","last_active":"2023-08-17T00:02:51.772373+0000","last_peered":"2023-08-17T00:02:51.772373+0000","last_clean":"2023-08-17T00:02:51.772373+0000","last_became_active":"2023-08-17T00:02:51.339418+0000","last_became_peered":"2023-08-17T00:02:51.339418+0000","last_unstale":"2023-08-17T00:02:51.772373+0000","last_undegraded":"2023-08-17T00:02:51.772373+0000","last_fullsized":"2023-08-17T00:02:51.772373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800439+0000","last_change":"2023-08-17T00:02:51.784928+0000","last_active":"2023-08-17T00:02:51.800439+0000","last_peered":"2023-08-17T00:02:51.800439+0000","last_clean":"2023-08-17T00:02:51.800439+0000","last_became_active":"2023-08-17T00:02:51.784604+0000","last_became_peered":"2023-08-17T00:02:51.784604+0000","last_unstale":"2023-08-17T00:02:51.800439+0000","last_undegraded":"2023-08-17T00:02:51.800439+0000","last_fullsized":"2023-08-17T00:02:51.800439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793473+0000","last_change":"2023-08-17T00:02:51.343843+0000","last_active":"2023-08-17T00:02:51.793473+0000","last_peered":"2023-08-17T00:02:51.793473+0000","last_clean":"2023-08-17T00:02:51.793473+0000","last_became_active":"2023-08-17T00:02:51.340985+0000","last_became_peered":"2023-08-17T00:02:51.340985+0000","last_unstale":"2023-08-17T00:02:51.793473+0000","last_undegraded":"2023-08-17T00:02:51.793473+0000","last_fullsized":"2023-08-17T00:02:51.793473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800767+0000","last_change":"2023-08-17T00:02:51.785256+0000","last_active":"2023-08-17T00:02:51.800767+0000","last_peered":"2023-08-17T00:02:51.800767+0000","last_clean":"2023-08-17T00:02:51.800767+0000","last_became_active":"2023-08-17T00:02:51.784962+0000","last_became_peered":"2023-08-17T00:02:51.784962+0000","last_unstale":"2023-08-17T00:02:51.800767+0000","last_undegraded":"2023-08-17T00:02:51.800767+0000","last_fullsized":"2023-08-17T00:02:51.800767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802680+0000","last_change":"2023-08-17T00:02:51.350355+0000","last_active":"2023-08-17T00:02:51.802680+0000","last_peered":"2023-08-17T00:02:51.802680+0000","last_clean":"2023-08-17T00:02:51.802680+0000","last_became_active":"2023-08-17T00:02:51.350063+0000","last_became_peered":"2023-08-17T00:02:51.350063+0000","last_unstale":"2023-08-17T00:02:51.802680+0000","last_undegraded":"2023-08-17T00:02:51.802680+0000","last_fullsized":"2023-08-17T00:02:51.802680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798718+0000","last_change":"2023-08-17T00:02:51.785857+0000","last_active":"2023-08-17T00:02:51.798718+0000","last_peered":"2023-08-17T00:02:51.798718+0000","last_clean":"2023-08-17T00:02:51.798718+0000","last_became_active":"2023-08-17T00:02:51.785548+0000","last_became_peered":"2023-08-17T00:02:51.785548+0000","last_unstale":"2023-08-17T00:02:51.798718+0000","last_undegraded":"2023-08-17T00:02:51.798718+0000","last_fullsized":"2023-08-17T00:02:51.798718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770921+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:02:51.770921+0000","last_peered":"2023-08-17T00:02:51.770921+0000","last_clean":"2023-08-17T00:02:51.770921+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:02:51.770921+0000","last_undegraded":"2023-08-17T00:02:51.770921+0000","last_fullsized":"2023-08-17T00:02:51.770921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772354+0000","last_change":"2023-08-17T00:02:51.349328+0000","last_active":"2023-08-17T00:02:51.772354+0000","last_peered":"2023-08-17T00:02:51.772354+0000","last_clean":"2023-08-17T00:02:51.772354+0000","last_became_active":"2023-08-17T00:02:51.348912+0000","last_became_peered":"2023-08-17T00:02:51.348912+0000","last_unstale":"2023-08-17T00:02:51.772354+0000","last_undegraded":"2023-08-17T00:02:51.772354+0000","last_fullsized":"2023-08-17T00:02:51.772354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798870+0000","last_change":"2023-08-17T00:02:51.786668+0000","last_active":"2023-08-17T00:02:51.798870+0000","last_peered":"2023-08-17T00:02:51.798870+0000","last_clean":"2023-08-17T00:02:51.798870+0000","last_became_active":"2023-08-17T00:02:51.785985+0000","last_became_peered":"2023-08-17T00:02:51.785985+0000","last_unstale":"2023-08-17T00:02:51.798870+0000","last_undegraded":"2023-08-17T00:02:51.798870+0000","last_fullsized":"2023-08-17T00:02:51.798870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772460+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:02:51.772460+0000","last_peered":"2023-08-17T00:02:51.772460+0000","last_clean":"2023-08-17T00:02:51.772460+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:02:51.772460+0000","last_undegraded":"2023-08-17T00:02:51.772460+0000","last_fullsized":"2023-08-17T00:02:51.772460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797184+0000","last_change":"2023-08-17T00:02:51.335559+0000","last_active":"2023-08-17T00:02:51.797184+0000","last_peered":"2023-08-17T00:02:51.797184+0000","last_clean":"2023-08-17T00:02:51.797184+0000","last_became_active":"2023-08-17T00:02:51.335182+0000","last_became_peered":"2023-08-17T00:02:51.335182+0000","last_unstale":"2023-08-17T00:02:51.797184+0000","last_undegraded":"2023-08-17T00:02:51.797184+0000","last_fullsized":"2023-08-17T00:02:51.797184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801377+0000","last_change":"2023-08-17T00:02:51.787570+0000","last_active":"2023-08-17T00:02:51.801377+0000","last_peered":"2023-08-17T00:02:51.801377+0000","last_clean":"2023-08-17T00:02:51.801377+0000","last_became_active":"2023-08-17T00:02:51.787256+0000","last_became_peered":"2023-08-17T00:02:51.787256+0000","last_unstale":"2023-08-17T00:02:51.801377+0000","last_undegraded":"2023-08-17T00:02:51.801377+0000","last_fullsized":"2023-08-17T00:02:51.801377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773440+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:02:51.773440+0000","last_peered":"2023-08-17T00:02:51.773440+0000","last_clean":"2023-08-17T00:02:51.773440+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:02:51.773440+0000","last_undegraded":"2023-08-17T00:02:51.773440+0000","last_fullsized":"2023-08-17T00:02:51.773440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780285+0000","last_change":"2023-08-17T00:02:51.343304+0000","last_active":"2023-08-17T00:02:51.780285+0000","last_peered":"2023-08-17T00:02:51.780285+0000","last_clean":"2023-08-17T00:02:51.780285+0000","last_became_active":"2023-08-17T00:02:51.343028+0000","last_became_peered":"2023-08-17T00:02:51.343028+0000","last_unstale":"2023-08-17T00:02:51.780285+0000","last_undegraded":"2023-08-17T00:02:51.780285+0000","last_fullsized":"2023-08-17T00:02:51.780285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796085+0000","last_change":"2023-08-17T00:02:51.788638+0000","last_active":"2023-08-17T00:02:51.796085+0000","last_peered":"2023-08-17T00:02:51.796085+0000","last_clean":"2023-08-17T00:02:51.796085+0000","last_became_active":"2023-08-17T00:02:51.787316+0000","last_became_peered":"2023-08-17T00:02:51.787316+0000","last_unstale":"2023-08-17T00:02:51.796085+0000","last_undegraded":"2023-08-17T00:02:51.796085+0000","last_fullsized":"2023-08-17T00:02:51.796085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774757+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:02:51.774757+0000","last_peered":"2023-08-17T00:02:51.774757+0000","last_clean":"2023-08-17T00:02:51.774757+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:02:51.774757+0000","last_undegraded":"2023-08-17T00:02:51.774757+0000","last_fullsized":"2023-08-17T00:02:51.774757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768333+0000","last_change":"2023-08-17T00:02:51.340968+0000","last_active":"2023-08-17T00:02:51.768333+0000","last_peered":"2023-08-17T00:02:51.768333+0000","last_clean":"2023-08-17T00:02:51.768333+0000","last_became_active":"2023-08-17T00:02:51.340352+0000","last_became_peered":"2023-08-17T00:02:51.340352+0000","last_unstale":"2023-08-17T00:02:51.768333+0000","last_undegraded":"2023-08-17T00:02:51.768333+0000","last_fullsized":"2023-08-17T00:02:51.768333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789054+0000","last_change":"2023-08-17T00:02:51.786773+0000","last_active":"2023-08-17T00:02:51.789054+0000","last_peered":"2023-08-17T00:02:51.789054+0000","last_clean":"2023-08-17T00:02:51.789054+0000","last_became_active":"2023-08-17T00:02:51.786393+0000","last_became_peered":"2023-08-17T00:02:51.786393+0000","last_unstale":"2023-08-17T00:02:51.789054+0000","last_undegraded":"2023-08-17T00:02:51.789054+0000","last_fullsized":"2023-08-17T00:02:51.789054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769417+0000","last_change":"2023-08-17T00:02:51.345508+0000","last_active":"2023-08-17T00:02:51.769417+0000","last_peered":"2023-08-17T00:02:51.769417+0000","last_clean":"2023-08-17T00:02:51.769417+0000","last_became_active":"2023-08-17T00:02:51.345226+0000","last_became_peered":"2023-08-17T00:02:51.345226+0000","last_unstale":"2023-08-17T00:02:51.769417+0000","last_undegraded":"2023-08-17T00:02:51.769417+0000","last_fullsized":"2023-08-17T00:02:51.769417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769322+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:02:51.769322+0000","last_peered":"2023-08-17T00:02:51.769322+0000","last_clean":"2023-08-17T00:02:51.769322+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:02:51.769322+0000","last_undegraded":"2023-08-17T00:02:51.769322+0000","last_fullsized":"2023-08-17T00:02:51.769322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799559+0000","last_change":"2023-08-17T00:02:51.796855+0000","last_active":"2023-08-17T00:02:51.799559+0000","last_peered":"2023-08-17T00:02:51.799559+0000","last_clean":"2023-08-17T00:02:51.799559+0000","last_became_active":"2023-08-17T00:02:51.796562+0000","last_became_peered":"2023-08-17T00:02:51.796562+0000","last_unstale":"2023-08-17T00:02:51.799559+0000","last_undegraded":"2023-08-17T00:02:51.799559+0000","last_fullsized":"2023-08-17T00:02:51.799559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775324+0000","last_change":"2023-08-17T00:02:51.350272+0000","last_active":"2023-08-17T00:02:51.775324+0000","last_peered":"2023-08-17T00:02:51.775324+0000","last_clean":"2023-08-17T00:02:51.775324+0000","last_became_active":"2023-08-17T00:02:51.350003+0000","last_became_peered":"2023-08-17T00:02:51.350003+0000","last_unstale":"2023-08-17T00:02:51.775324+0000","last_undegraded":"2023-08-17T00:02:51.775324+0000","last_fullsized":"2023-08-17T00:02:51.775324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.781497+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:02:51.781497+0000","last_peered":"2023-08-17T00:02:51.781497+0000","last_clean":"2023-08-17T00:02:51.781497+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:02:51.781497+0000","last_undegraded":"2023-08-17T00:02:51.781497+0000","last_fullsized":"2023-08-17T00:02:51.781497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798023+0000","last_change":"2023-08-17T00:02:51.790967+0000","last_active":"2023-08-17T00:02:51.798023+0000","last_peered":"2023-08-17T00:02:51.798023+0000","last_clean":"2023-08-17T00:02:51.798023+0000","last_became_active":"2023-08-17T00:02:51.787858+0000","last_became_peered":"2023-08-17T00:02:51.787858+0000","last_unstale":"2023-08-17T00:02:51.798023+0000","last_undegraded":"2023-08-17T00:02:51.798023+0000","last_fullsized":"2023-08-17T00:02:51.798023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.777967+0000","last_change":"2023-08-17T00:02:51.348713+0000","last_active":"2023-08-17T00:02:51.777967+0000","last_peered":"2023-08-17T00:02:51.777967+0000","last_clean":"2023-08-17T00:02:51.777967+0000","last_became_active":"2023-08-17T00:02:51.348409+0000","last_became_peered":"2023-08-17T00:02:51.348409+0000","last_unstale":"2023-08-17T00:02:51.777967+0000","last_undegraded":"2023-08-17T00:02:51.777967+0000","last_fullsized":"2023-08-17T00:02:51.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770267+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:02:51.770267+0000","last_peered":"2023-08-17T00:02:51.770267+0000","last_clean":"2023-08-17T00:02:51.770267+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:02:51.770267+0000","last_undegraded":"2023-08-17T00:02:51.770267+0000","last_fullsized":"2023-08-17T00:02:51.770267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803930+0000","last_change":"2023-08-17T00:02:51.797864+0000","last_active":"2023-08-17T00:02:51.803930+0000","last_peered":"2023-08-17T00:02:51.803930+0000","last_clean":"2023-08-17T00:02:51.803930+0000","last_became_active":"2023-08-17T00:02:51.797388+0000","last_became_peered":"2023-08-17T00:02:51.797388+0000","last_unstale":"2023-08-17T00:02:51.803930+0000","last_undegraded":"2023-08-17T00:02:51.803930+0000","last_fullsized":"2023-08-17T00:02:51.803930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774238+0000","last_change":"2023-08-17T00:02:51.353342+0000","last_active":"2023-08-17T00:02:51.774238+0000","last_peered":"2023-08-17T00:02:51.774238+0000","last_clean":"2023-08-17T00:02:51.774238+0000","last_became_active":"2023-08-17T00:02:51.351707+0000","last_became_peered":"2023-08-17T00:02:51.351707+0000","last_unstale":"2023-08-17T00:02:51.774238+0000","last_undegraded":"2023-08-17T00:02:51.774238+0000","last_fullsized":"2023-08-17T00:02:51.774238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766976+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:02:51.766976+0000","last_peered":"2023-08-17T00:02:51.766976+0000","last_clean":"2023-08-17T00:02:51.766976+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:02:51.766976+0000","last_undegraded":"2023-08-17T00:02:51.766976+0000","last_fullsized":"2023-08-17T00:02:51.766976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790259+0000","last_change":"2023-08-17T00:02:51.786227+0000","last_active":"2023-08-17T00:02:51.790259+0000","last_peered":"2023-08-17T00:02:51.790259+0000","last_clean":"2023-08-17T00:02:51.790259+0000","last_became_active":"2023-08-17T00:02:51.785164+0000","last_became_peered":"2023-08-17T00:02:51.785164+0000","last_unstale":"2023-08-17T00:02:51.790259+0000","last_undegraded":"2023-08-17T00:02:51.790259+0000","last_fullsized":"2023-08-17T00:02:51.790259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771433+0000","last_change":"2023-08-17T00:02:51.349191+0000","last_active":"2023-08-17T00:02:51.771433+0000","last_peered":"2023-08-17T00:02:51.771433+0000","last_clean":"2023-08-17T00:02:51.771433+0000","last_became_active":"2023-08-17T00:02:51.348834+0000","last_became_peered":"2023-08-17T00:02:51.348834+0000","last_unstale":"2023-08-17T00:02:51.771433+0000","last_undegraded":"2023-08-17T00:02:51.771433+0000","last_fullsized":"2023-08-17T00:02:51.771433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803745+0000","last_change":"2023-08-17T00:02:51.801602+0000","last_active":"2023-08-17T00:02:51.803745+0000","last_peered":"2023-08-17T00:02:51.803745+0000","last_clean":"2023-08-17T00:02:51.803745+0000","last_became_active":"2023-08-17T00:02:51.801300+0000","last_became_peered":"2023-08-17T00:02:51.801300+0000","last_unstale":"2023-08-17T00:02:51.803745+0000","last_undegraded":"2023-08-17T00:02:51.803745+0000","last_fullsized":"2023-08-17T00:02:51.803745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768468+0000","last_change":"2023-08-17T00:02:51.340158+0000","last_active":"2023-08-17T00:02:51.768468+0000","last_peered":"2023-08-17T00:02:51.768468+0000","last_clean":"2023-08-17T00:02:51.768468+0000","last_became_active":"2023-08-17T00:02:51.339871+0000","last_became_peered":"2023-08-17T00:02:51.339871+0000","last_unstale":"2023-08-17T00:02:51.768468+0000","last_undegraded":"2023-08-17T00:02:51.768468+0000","last_fullsized":"2023-08-17T00:02:51.768468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798765+0000","last_change":"2023-08-17T00:02:51.785968+0000","last_active":"2023-08-17T00:02:51.798765+0000","last_peered":"2023-08-17T00:02:51.798765+0000","last_clean":"2023-08-17T00:02:51.798765+0000","last_became_active":"2023-08-17T00:02:51.785695+0000","last_became_peered":"2023-08-17T00:02:51.785695+0000","last_unstale":"2023-08-17T00:02:51.798765+0000","last_undegraded":"2023-08-17T00:02:51.798765+0000","last_fullsized":"2023-08-17T00:02:51.798765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769227+0000","last_change":"2023-08-17T00:02:51.339180+0000","last_active":"2023-08-17T00:02:51.769227+0000","last_peered":"2023-08-17T00:02:51.769227+0000","last_clean":"2023-08-17T00:02:51.769227+0000","last_became_active":"2023-08-17T00:02:51.338880+0000","last_became_peered":"2023-08-17T00:02:51.338880+0000","last_unstale":"2023-08-17T00:02:51.769227+0000","last_undegraded":"2023-08-17T00:02:51.769227+0000","last_fullsized":"2023-08-17T00:02:51.769227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790291+0000","last_change":"2023-08-17T00:02:51.786531+0000","last_active":"2023-08-17T00:02:51.790291+0000","last_peered":"2023-08-17T00:02:51.790291+0000","last_clean":"2023-08-17T00:02:51.790291+0000","last_became_active":"2023-08-17T00:02:51.785774+0000","last_became_peered":"2023-08-17T00:02:51.785774+0000","last_unstale":"2023-08-17T00:02:51.790291+0000","last_undegraded":"2023-08-17T00:02:51.790291+0000","last_fullsized":"2023-08-17T00:02:51.790291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795538+0000","last_change":"2023-08-17T00:02:51.344586+0000","last_active":"2023-08-17T00:02:51.795538+0000","last_peered":"2023-08-17T00:02:51.795538+0000","last_clean":"2023-08-17T00:02:51.795538+0000","last_became_active":"2023-08-17T00:02:51.344320+0000","last_became_peered":"2023-08-17T00:02:51.344320+0000","last_unstale":"2023-08-17T00:02:51.795538+0000","last_undegraded":"2023-08-17T00:02:51.795538+0000","last_fullsized":"2023-08-17T00:02:51.795538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795736+0000","last_change":"2023-08-17T00:02:51.789022+0000","last_active":"2023-08-17T00:02:51.795736+0000","last_peered":"2023-08-17T00:02:51.795736+0000","last_clean":"2023-08-17T00:02:51.795736+0000","last_became_active":"2023-08-17T00:02:51.788756+0000","last_became_peered":"2023-08-17T00:02:51.788756+0000","last_unstale":"2023-08-17T00:02:51.795736+0000","last_undegraded":"2023-08-17T00:02:51.795736+0000","last_fullsized":"2023-08-17T00:02:51.795736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775104+0000","last_change":"2023-08-17T00:02:51.352334+0000","last_active":"2023-08-17T00:02:51.775104+0000","last_peered":"2023-08-17T00:02:51.775104+0000","last_clean":"2023-08-17T00:02:51.775104+0000","last_became_active":"2023-08-17T00:02:51.352057+0000","last_became_peered":"2023-08-17T00:02:51.352057+0000","last_unstale":"2023-08-17T00:02:51.775104+0000","last_undegraded":"2023-08-17T00:02:51.775104+0000","last_fullsized":"2023-08-17T00:02:51.775104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790438+0000","last_change":"2023-08-17T00:02:51.786511+0000","last_active":"2023-08-17T00:02:51.790438+0000","last_peered":"2023-08-17T00:02:51.790438+0000","last_clean":"2023-08-17T00:02:51.790438+0000","last_became_active":"2023-08-17T00:02:51.786141+0000","last_became_peered":"2023-08-17T00:02:51.786141+0000","last_unstale":"2023-08-17T00:02:51.790438+0000","last_undegraded":"2023-08-17T00:02:51.790438+0000","last_fullsized":"2023-08-17T00:02:51.790438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773255+0000","last_change":"2023-08-17T00:02:51.351567+0000","last_active":"2023-08-17T00:02:51.773255+0000","last_peered":"2023-08-17T00:02:51.773255+0000","last_clean":"2023-08-17T00:02:51.773255+0000","last_became_active":"2023-08-17T00:02:51.351119+0000","last_became_peered":"2023-08-17T00:02:51.351119+0000","last_unstale":"2023-08-17T00:02:51.773255+0000","last_undegraded":"2023-08-17T00:02:51.773255+0000","last_fullsized":"2023-08-17T00:02:51.773255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798841+0000","last_change":"2023-08-17T00:02:51.786494+0000","last_active":"2023-08-17T00:02:51.798841+0000","last_peered":"2023-08-17T00:02:51.798841+0000","last_clean":"2023-08-17T00:02:51.798841+0000","last_became_active":"2023-08-17T00:02:51.786239+0000","last_became_peered":"2023-08-17T00:02:51.786239+0000","last_unstale":"2023-08-17T00:02:51.798841+0000","last_undegraded":"2023-08-17T00:02:51.798841+0000","last_fullsized":"2023-08-17T00:02:51.798841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.788577+0000","last_change":"2023-08-17T00:02:51.341388+0000","last_active":"2023-08-17T00:02:51.788577+0000","last_peered":"2023-08-17T00:02:51.788577+0000","last_clean":"2023-08-17T00:02:51.788577+0000","last_became_active":"2023-08-17T00:02:51.341095+0000","last_became_peered":"2023-08-17T00:02:51.341095+0000","last_unstale":"2023-08-17T00:02:51.788577+0000","last_undegraded":"2023-08-17T00:02:51.788577+0000","last_fullsized":"2023-08-17T00:02:51.788577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802878+0000","last_change":"2023-08-17T00:02:51.795136+0000","last_active":"2023-08-17T00:02:51.802878+0000","last_peered":"2023-08-17T00:02:51.802878+0000","last_clean":"2023-08-17T00:02:51.802878+0000","last_became_active":"2023-08-17T00:02:51.794509+0000","last_became_peered":"2023-08-17T00:02:51.794509+0000","last_unstale":"2023-08-17T00:02:51.802878+0000","last_undegraded":"2023-08-17T00:02:51.802878+0000","last_fullsized":"2023-08-17T00:02:51.802878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803177+0000","last_change":"2023-08-17T00:02:51.347636+0000","last_active":"2023-08-17T00:02:51.803177+0000","last_peered":"2023-08-17T00:02:51.803177+0000","last_clean":"2023-08-17T00:02:51.803177+0000","last_became_active":"2023-08-17T00:02:51.347360+0000","last_became_peered":"2023-08-17T00:02:51.347360+0000","last_unstale":"2023-08-17T00:02:51.803177+0000","last_undegraded":"2023-08-17T00:02:51.803177+0000","last_fullsized":"2023-08-17T00:02:51.803177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784923+0000","last_change":"2023-08-17T00:02:51.774675+0000","last_active":"2023-08-17T00:02:51.784923+0000","last_peered":"2023-08-17T00:02:51.784923+0000","last_clean":"2023-08-17T00:02:51.784923+0000","last_became_active":"2023-08-17T00:02:51.774422+0000","last_became_peered":"2023-08-17T00:02:51.774422+0000","last_unstale":"2023-08-17T00:02:51.784923+0000","last_undegraded":"2023-08-17T00:02:51.784923+0000","last_fullsized":"2023-08-17T00:02:51.784923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795262+0000","last_change":"2023-08-17T00:02:51.344092+0000","last_active":"2023-08-17T00:02:51.795262+0000","last_peered":"2023-08-17T00:02:51.795262+0000","last_clean":"2023-08-17T00:02:51.795262+0000","last_became_active":"2023-08-17T00:02:51.343804+0000","last_became_peered":"2023-08-17T00:02:51.343804+0000","last_unstale":"2023-08-17T00:02:51.795262+0000","last_undegraded":"2023-08-17T00:02:51.795262+0000","last_fullsized":"2023-08-17T00:02:51.795262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803841+0000","last_change":"2023-08-17T00:02:51.796680+0000","last_active":"2023-08-17T00:02:51.803841+0000","last_peered":"2023-08-17T00:02:51.803841+0000","last_clean":"2023-08-17T00:02:51.803841+0000","last_became_active":"2023-08-17T00:02:51.795190+0000","last_became_peered":"2023-08-17T00:02:51.795190+0000","last_unstale":"2023-08-17T00:02:51.803841+0000","last_undegraded":"2023-08-17T00:02:51.803841+0000","last_fullsized":"2023-08-17T00:02:51.803841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768352+0000","last_change":"2023-08-17T00:02:51.349898+0000","last_active":"2023-08-17T00:02:51.768352+0000","last_peered":"2023-08-17T00:02:51.768352+0000","last_clean":"2023-08-17T00:02:51.768352+0000","last_became_active":"2023-08-17T00:02:51.349378+0000","last_became_peered":"2023-08-17T00:02:51.349378+0000","last_unstale":"2023-08-17T00:02:51.768352+0000","last_undegraded":"2023-08-17T00:02:51.768352+0000","last_fullsized":"2023-08-17T00:02:51.768352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803909+0000","last_change":"2023-08-17T00:02:51.797648+0000","last_active":"2023-08-17T00:02:51.803909+0000","last_peered":"2023-08-17T00:02:51.803909+0000","last_clean":"2023-08-17T00:02:51.803909+0000","last_became_active":"2023-08-17T00:02:51.797021+0000","last_became_peered":"2023-08-17T00:02:51.797021+0000","last_unstale":"2023-08-17T00:02:51.803909+0000","last_undegraded":"2023-08-17T00:02:51.803909+0000","last_fullsized":"2023-08-17T00:02:51.803909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779519+0000","last_change":"2023-08-17T00:02:51.341554+0000","last_active":"2023-08-17T00:02:51.779519+0000","last_peered":"2023-08-17T00:02:51.779519+0000","last_clean":"2023-08-17T00:02:51.779519+0000","last_became_active":"2023-08-17T00:02:51.341189+0000","last_became_peered":"2023-08-17T00:02:51.341189+0000","last_unstale":"2023-08-17T00:02:51.779519+0000","last_undegraded":"2023-08-17T00:02:51.779519+0000","last_fullsized":"2023-08-17T00:02:51.779519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790275+0000","last_change":"2023-08-17T00:02:51.786385+0000","last_active":"2023-08-17T00:02:51.790275+0000","last_peered":"2023-08-17T00:02:51.790275+0000","last_clean":"2023-08-17T00:02:51.790275+0000","last_became_active":"2023-08-17T00:02:51.785450+0000","last_became_peered":"2023-08-17T00:02:51.785450+0000","last_unstale":"2023-08-17T00:02:51.790275+0000","last_undegraded":"2023-08-17T00:02:51.790275+0000","last_fullsized":"2023-08-17T00:02:51.790275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802399+0000","last_change":"2023-08-17T00:02:51.341982+0000","last_active":"2023-08-17T00:02:51.802399+0000","last_peered":"2023-08-17T00:02:51.802399+0000","last_clean":"2023-08-17T00:02:51.802399+0000","last_became_active":"2023-08-17T00:02:51.341697+0000","last_became_peered":"2023-08-17T00:02:51.341697+0000","last_unstale":"2023-08-17T00:02:51.802399+0000","last_undegraded":"2023-08-17T00:02:51.802399+0000","last_fullsized":"2023-08-17T00:02:51.802399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800153+0000","last_change":"2023-08-17T00:02:51.798361+0000","last_active":"2023-08-17T00:02:51.800153+0000","last_peered":"2023-08-17T00:02:51.800153+0000","last_clean":"2023-08-17T00:02:51.800153+0000","last_became_active":"2023-08-17T00:02:51.797985+0000","last_became_peered":"2023-08-17T00:02:51.797985+0000","last_unstale":"2023-08-17T00:02:51.800153+0000","last_undegraded":"2023-08-17T00:02:51.800153+0000","last_fullsized":"2023-08-17T00:02:51.800153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779410+0000","last_change":"2023-08-17T00:02:51.345285+0000","last_active":"2023-08-17T00:02:51.779410+0000","last_peered":"2023-08-17T00:02:51.779410+0000","last_clean":"2023-08-17T00:02:51.779410+0000","last_became_active":"2023-08-17T00:02:51.345012+0000","last_became_peered":"2023-08-17T00:02:51.345012+0000","last_unstale":"2023-08-17T00:02:51.779410+0000","last_undegraded":"2023-08-17T00:02:51.779410+0000","last_fullsized":"2023-08-17T00:02:51.779410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.791563+0000","last_change":"2023-08-17T00:02:51.780780+0000","last_active":"2023-08-17T00:02:51.791563+0000","last_peered":"2023-08-17T00:02:51.791563+0000","last_clean":"2023-08-17T00:02:51.791563+0000","last_became_active":"2023-08-17T00:02:51.780499+0000","last_became_peered":"2023-08-17T00:02:51.780499+0000","last_unstale":"2023-08-17T00:02:51.791563+0000","last_undegraded":"2023-08-17T00:02:51.791563+0000","last_fullsized":"2023-08-17T00:02:51.791563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796009+0000","last_change":"2023-08-17T00:02:51.346726+0000","last_active":"2023-08-17T00:02:51.796009+0000","last_peered":"2023-08-17T00:02:51.796009+0000","last_clean":"2023-08-17T00:02:51.796009+0000","last_became_active":"2023-08-17T00:02:51.346453+0000","last_became_peered":"2023-08-17T00:02:51.346453+0000","last_unstale":"2023-08-17T00:02:51.796009+0000","last_undegraded":"2023-08-17T00:02:51.796009+0000","last_fullsized":"2023-08-17T00:02:51.796009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803474+0000","last_change":"2023-08-17T00:02:51.791605+0000","last_active":"2023-08-17T00:02:51.803474+0000","last_peered":"2023-08-17T00:02:51.803474+0000","last_clean":"2023-08-17T00:02:51.803474+0000","last_became_active":"2023-08-17T00:02:51.791337+0000","last_became_peered":"2023-08-17T00:02:51.791337+0000","last_unstale":"2023-08-17T00:02:51.803474+0000","last_undegraded":"2023-08-17T00:02:51.803474+0000","last_fullsized":"2023-08-17T00:02:51.803474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.806325+0000","last_change":"2023-08-17T00:02:51.346596+0000","last_active":"2023-08-17T00:02:51.806325+0000","last_peered":"2023-08-17T00:02:51.806325+0000","last_clean":"2023-08-17T00:02:51.806325+0000","last_became_active":"2023-08-17T00:02:51.346313+0000","last_became_peered":"2023-08-17T00:02:51.346313+0000","last_unstale":"2023-08-17T00:02:51.806325+0000","last_undegraded":"2023-08-17T00:02:51.806325+0000","last_fullsized":"2023-08-17T00:02:51.806325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798176+0000","last_change":"2023-08-17T00:02:51.793285+0000","last_active":"2023-08-17T00:02:51.798176+0000","last_peered":"2023-08-17T00:02:51.798176+0000","last_clean":"2023-08-17T00:02:51.798176+0000","last_became_active":"2023-08-17T00:02:51.791718+0000","last_became_peered":"2023-08-17T00:02:51.791718+0000","last_unstale":"2023-08-17T00:02:51.798176+0000","last_undegraded":"2023-08-17T00:02:51.798176+0000","last_fullsized":"2023-08-17T00:02:51.798176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771929+0000","last_change":"2023-08-17T00:02:51.344568+0000","last_active":"2023-08-17T00:02:51.771929+0000","last_peered":"2023-08-17T00:02:51.771929+0000","last_clean":"2023-08-17T00:02:51.771929+0000","last_became_active":"2023-08-17T00:02:51.344185+0000","last_became_peered":"2023-08-17T00:02:51.344185+0000","last_unstale":"2023-08-17T00:02:51.771929+0000","last_undegraded":"2023-08-17T00:02:51.771929+0000","last_fullsized":"2023-08-17T00:02:51.771929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802759+0000","last_change":"2023-08-17T00:02:51.794651+0000","last_active":"2023-08-17T00:02:51.802759+0000","last_peered":"2023-08-17T00:02:51.802759+0000","last_clean":"2023-08-17T00:02:51.802759+0000","last_became_active":"2023-08-17T00:02:51.794341+0000","last_became_peered":"2023-08-17T00:02:51.794341+0000","last_unstale":"2023-08-17T00:02:51.802759+0000","last_undegraded":"2023-08-17T00:02:51.802759+0000","last_fullsized":"2023-08-17T00:02:51.802759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774235+0000","last_change":"2023-08-17T00:02:51.344305+0000","last_active":"2023-08-17T00:02:51.774235+0000","last_peered":"2023-08-17T00:02:51.774235+0000","last_clean":"2023-08-17T00:02:51.774235+0000","last_became_active":"2023-08-17T00:02:51.341191+0000","last_became_peered":"2023-08-17T00:02:51.341191+0000","last_unstale":"2023-08-17T00:02:51.774235+0000","last_undegraded":"2023-08-17T00:02:51.774235+0000","last_fullsized":"2023-08-17T00:02:51.774235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795708+0000","last_change":"2023-08-17T00:02:51.789154+0000","last_active":"2023-08-17T00:02:51.795708+0000","last_peered":"2023-08-17T00:02:51.795708+0000","last_clean":"2023-08-17T00:02:51.795708+0000","last_became_active":"2023-08-17T00:02:51.788807+0000","last_became_peered":"2023-08-17T00:02:51.788807+0000","last_unstale":"2023-08-17T00:02:51.795708+0000","last_undegraded":"2023-08-17T00:02:51.795708+0000","last_fullsized":"2023-08-17T00:02:51.795708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766911+0000","last_change":"2023-08-17T00:02:51.342636+0000","last_active":"2023-08-17T00:02:51.766911+0000","last_peered":"2023-08-17T00:02:51.766911+0000","last_clean":"2023-08-17T00:02:51.766911+0000","last_became_active":"2023-08-17T00:02:51.342340+0000","last_became_peered":"2023-08-17T00:02:51.342340+0000","last_unstale":"2023-08-17T00:02:51.766911+0000","last_undegraded":"2023-08-17T00:02:51.766911+0000","last_fullsized":"2023-08-17T00:02:51.766911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802639+0000","last_change":"2023-08-17T00:02:51.797499+0000","last_active":"2023-08-17T00:02:51.802639+0000","last_peered":"2023-08-17T00:02:51.802639+0000","last_clean":"2023-08-17T00:02:51.802639+0000","last_became_active":"2023-08-17T00:02:51.797168+0000","last_became_peered":"2023-08-17T00:02:51.797168+0000","last_unstale":"2023-08-17T00:02:51.802639+0000","last_undegraded":"2023-08-17T00:02:51.802639+0000","last_fullsized":"2023-08-17T00:02:51.802639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797340+0000","last_change":"2023-08-17T00:02:51.789012+0000","last_active":"2023-08-17T00:02:51.797340+0000","last_peered":"2023-08-17T00:02:51.797340+0000","last_clean":"2023-08-17T00:02:51.797340+0000","last_became_active":"2023-08-17T00:02:51.788464+0000","last_became_peered":"2023-08-17T00:02:51.788464+0000","last_unstale":"2023-08-17T00:02:51.797340+0000","last_undegraded":"2023-08-17T00:02:51.797340+0000","last_fullsized":"2023-08-17T00:02:51.797340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775204+0000","last_change":"2023-08-17T00:02:51.339223+0000","last_active":"2023-08-17T00:02:51.775204+0000","last_peered":"2023-08-17T00:02:51.775204+0000","last_clean":"2023-08-17T00:02:51.775204+0000","last_became_active":"2023-08-17T00:02:51.338872+0000","last_became_peered":"2023-08-17T00:02:51.338872+0000","last_unstale":"2023-08-17T00:02:51.775204+0000","last_undegraded":"2023-08-17T00:02:51.775204+0000","last_fullsized":"2023-08-17T00:02:51.775204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799128+0000","last_change":"2023-08-17T00:02:51.788420+0000","last_active":"2023-08-17T00:02:51.799128+0000","last_peered":"2023-08-17T00:02:51.799128+0000","last_clean":"2023-08-17T00:02:51.799128+0000","last_became_active":"2023-08-17T00:02:51.788155+0000","last_became_peered":"2023-08-17T00:02:51.788155+0000","last_unstale":"2023-08-17T00:02:51.799128+0000","last_undegraded":"2023-08-17T00:02:51.799128+0000","last_fullsized":"2023-08-17T00:02:51.799128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773169+0000","last_change":"2023-08-17T00:02:51.337198+0000","last_active":"2023-08-17T00:02:51.773169+0000","last_peered":"2023-08-17T00:02:51.773169+0000","last_clean":"2023-08-17T00:02:51.773169+0000","last_became_active":"2023-08-17T00:02:51.336537+0000","last_became_peered":"2023-08-17T00:02:51.336537+0000","last_unstale":"2023-08-17T00:02:51.773169+0000","last_undegraded":"2023-08-17T00:02:51.773169+0000","last_fullsized":"2023-08-17T00:02:51.773169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795487+0000","last_change":"2023-08-17T00:02:51.787948+0000","last_active":"2023-08-17T00:02:51.795487+0000","last_peered":"2023-08-17T00:02:51.795487+0000","last_clean":"2023-08-17T00:02:51.795487+0000","last_became_active":"2023-08-17T00:02:51.787702+0000","last_became_peered":"2023-08-17T00:02:51.787702+0000","last_unstale":"2023-08-17T00:02:51.795487+0000","last_undegraded":"2023-08-17T00:02:51.795487+0000","last_fullsized":"2023-08-17T00:02:51.795487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801892+0000","last_change":"2023-08-17T00:02:51.348795+0000","last_active":"2023-08-17T00:02:51.801892+0000","last_peered":"2023-08-17T00:02:51.801892+0000","last_clean":"2023-08-17T00:02:51.801892+0000","last_became_active":"2023-08-17T00:02:51.341835+0000","last_became_peered":"2023-08-17T00:02:51.341835+0000","last_unstale":"2023-08-17T00:02:51.801892+0000","last_undegraded":"2023-08-17T00:02:51.801892+0000","last_fullsized":"2023-08-17T00:02:51.801892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802783+0000","last_change":"2023-08-17T00:02:51.797751+0000","last_active":"2023-08-17T00:02:51.802783+0000","last_peered":"2023-08-17T00:02:51.802783+0000","last_clean":"2023-08-17T00:02:51.802783+0000","last_became_active":"2023-08-17T00:02:51.797486+0000","last_became_peered":"2023-08-17T00:02:51.797486+0000","last_unstale":"2023-08-17T00:02:51.802783+0000","last_undegraded":"2023-08-17T00:02:51.802783+0000","last_fullsized":"2023-08-17T00:02:51.802783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793391+0000","last_change":"2023-08-17T00:02:51.344236+0000","last_active":"2023-08-17T00:02:51.793391+0000","last_peered":"2023-08-17T00:02:51.793391+0000","last_clean":"2023-08-17T00:02:51.793391+0000","last_became_active":"2023-08-17T00:02:51.343935+0000","last_became_peered":"2023-08-17T00:02:51.343935+0000","last_unstale":"2023-08-17T00:02:51.793391+0000","last_undegraded":"2023-08-17T00:02:51.793391+0000","last_fullsized":"2023-08-17T00:02:51.793391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796985+0000","last_change":"2023-08-17T00:02:51.781786+0000","last_active":"2023-08-17T00:02:51.796985+0000","last_peered":"2023-08-17T00:02:51.796985+0000","last_clean":"2023-08-17T00:02:51.796985+0000","last_became_active":"2023-08-17T00:02:51.781472+0000","last_became_peered":"2023-08-17T00:02:51.781472+0000","last_unstale":"2023-08-17T00:02:51.796985+0000","last_undegraded":"2023-08-17T00:02:51.796985+0000","last_fullsized":"2023-08-17T00:02:51.796985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802048+0000","last_change":"2023-08-17T00:02:51.339145+0000","last_active":"2023-08-17T00:02:51.802048+0000","last_peered":"2023-08-17T00:02:51.802048+0000","last_clean":"2023-08-17T00:02:51.802048+0000","last_became_active":"2023-08-17T00:02:51.338710+0000","last_became_peered":"2023-08-17T00:02:51.338710+0000","last_unstale":"2023-08-17T00:02:51.802048+0000","last_undegraded":"2023-08-17T00:02:51.802048+0000","last_fullsized":"2023-08-17T00:02:51.802048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784977+0000","last_change":"2023-08-17T00:02:51.779058+0000","last_active":"2023-08-17T00:02:51.784977+0000","last_peered":"2023-08-17T00:02:51.784977+0000","last_clean":"2023-08-17T00:02:51.784977+0000","last_became_active":"2023-08-17T00:02:51.778796+0000","last_became_peered":"2023-08-17T00:02:51.778796+0000","last_unstale":"2023-08-17T00:02:51.784977+0000","last_undegraded":"2023-08-17T00:02:51.784977+0000","last_fullsized":"2023-08-17T00:02:51.784977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774792+0000","last_change":"2023-08-17T00:02:51.337656+0000","last_active":"2023-08-17T00:02:51.774792+0000","last_peered":"2023-08-17T00:02:51.774792+0000","last_clean":"2023-08-17T00:02:51.774792+0000","last_became_active":"2023-08-17T00:02:51.337333+0000","last_became_peered":"2023-08-17T00:02:51.337333+0000","last_unstale":"2023-08-17T00:02:51.774792+0000","last_undegraded":"2023-08-17T00:02:51.774792+0000","last_fullsized":"2023-08-17T00:02:51.774792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784887+0000","last_change":"2023-08-17T00:02:51.779981+0000","last_active":"2023-08-17T00:02:51.784887+0000","last_peered":"2023-08-17T00:02:51.784887+0000","last_clean":"2023-08-17T00:02:51.784887+0000","last_became_active":"2023-08-17T00:02:51.779712+0000","last_became_peered":"2023-08-17T00:02:51.779712+0000","last_unstale":"2023-08-17T00:02:51.784887+0000","last_undegraded":"2023-08-17T00:02:51.784887+0000","last_fullsized":"2023-08-17T00:02:51.784887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775012+0000","last_change":"2023-08-17T00:02:51.339106+0000","last_active":"2023-08-17T00:02:51.775012+0000","last_peered":"2023-08-17T00:02:51.775012+0000","last_clean":"2023-08-17T00:02:51.775012+0000","last_became_active":"2023-08-17T00:02:51.338781+0000","last_became_peered":"2023-08-17T00:02:51.338781+0000","last_unstale":"2023-08-17T00:02:51.775012+0000","last_undegraded":"2023-08-17T00:02:51.775012+0000","last_fullsized":"2023-08-17T00:02:51.775012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782043+0000","last_change":"2023-08-17T00:02:51.778317+0000","last_active":"2023-08-17T00:02:51.782043+0000","last_peered":"2023-08-17T00:02:51.782043+0000","last_clean":"2023-08-17T00:02:51.782043+0000","last_became_active":"2023-08-17T00:02:51.778029+0000","last_became_peered":"2023-08-17T00:02:51.778029+0000","last_unstale":"2023-08-17T00:02:51.782043+0000","last_undegraded":"2023-08-17T00:02:51.782043+0000","last_fullsized":"2023-08-17T00:02:51.782043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793540+0000","last_change":"2023-08-17T00:02:51.345678+0000","last_active":"2023-08-17T00:02:51.793540+0000","last_peered":"2023-08-17T00:02:51.793540+0000","last_clean":"2023-08-17T00:02:51.793540+0000","last_became_active":"2023-08-17T00:02:51.345185+0000","last_became_peered":"2023-08-17T00:02:51.345185+0000","last_unstale":"2023-08-17T00:02:51.793540+0000","last_undegraded":"2023-08-17T00:02:51.793540+0000","last_fullsized":"2023-08-17T00:02:51.793540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]}]},{"osd":6,"up_from":14,"seq":60129542147,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542147,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542147,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0209999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542147,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":84071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542148,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:02:56.423 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:02:56.424 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-17T00:02:56.424 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-17T00:02:56.424 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-17T00:02:56.425 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-17T00:02:56.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 Processor -- start 2023-08-17T00:02:56.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 -- start start 2023-08-17T00:02:56.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb2c151530 0x7fdb2c1519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb2c065da0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb2c155c60 con 0x7fdb2c151530 2023-08-17T00:02:56.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb31479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c156550 con 0x7fdb2c0689c0 2023-08-17T00:02:56.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb2bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb2bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:37906/0 (socket says 172.21.15.153:37906) 2023-08-17T00:02:56.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb2bfff700 1 -- 172.21.15.153:0/2817018990 learned_addr learned my addr 172.21.15.153:0/2817018990 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:56.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb30c78700 1 --2- 172.21.15.153:0/2817018990 >> v2:172.21.15.178:3300/0 conn(0x7fdb2c151530 0x7fdb2c1519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.615+0000 7fdb2b7fe700 1 --1- 172.21.15.153:0/2817018990 >> v1:172.21.15.178:6789/0 conn(0x7fdb2c1560f0 0x7fdb2c0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55666/0 (socket says 172.21.15.153:55666) 2023-08-17T00:02:56.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb2affd700 1 -- 172.21.15.153:0/2817018990 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140197403 0 0) 0x7fdb2c065da0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb2affd700 1 -- 172.21.15.153:0/2817018990 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb140033f0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb30c78700 1 -- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 msgr2=0x7fdb2c068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb30c78700 1 --2- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb30c78700 1 -- 172.21.15.153:0/2817018990 >> v1:172.21.15.178:6789/0 conn(0x7fdb2c1560f0 legacy=0x7fdb2c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb30c78700 1 -- 172.21.15.153:0/2817018990 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c065ff0 con 0x7fdb2c151530 2023-08-17T00:02:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb2bfff700 1 --2- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb30c78700 1 --2- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c1519e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fdb1c009790 tx=0x7fdb1c009060).ready entity=mon.1 client_cookie=8e425b6613f5faf3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb2affd700 1 -- 172.21.15.153:0/2817018990 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c0090d0 con 0x7fdb2c151530 2023-08-17T00:02:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb2affd700 1 -- 172.21.15.153:0/2817018990 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c00d4a0 con 0x7fdb2c151530 2023-08-17T00:02:56.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb2affd700 1 -- 172.21.15.153:0/2817018990 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c00d820 con 0x7fdb2c151530 2023-08-17T00:02:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 -- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 msgr2=0x7fdb2c1519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 --2- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c1519e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fdb1c009790 tx=0x7fdb1c009060).stop 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 -- 172.21.15.153:0/2817018990 shutdown_connections 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 --2- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c1519e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 --2- 172.21.15.153:0/2817018990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 -- 172.21.15.153:0/2817018990 >> 172.21.15.153:0/2817018990 conn(0x7fdb2c0c6620 msgr2=0x7fdb2c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 -- 172.21.15.153:0/2817018990 shutdown_connections 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.619+0000 7fdb31479700 1 -- 172.21.15.153:0/2817018990 wait complete. 2023-08-17T00:02:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.623+0000 7fdb31479700 1 Processor -- start 2023-08-17T00:02:56.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.623+0000 7fdb31479700 1 -- start start 2023-08-17T00:02:56.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c0a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 0x7fdb2c0a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0a8f70 con 0x7fdb2c1560f0 2023-08-17T00:02:56.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c1443d0 con 0x7fdb2c151530 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2c0c1130 con 0x7fdb2c0689c0 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 0x7fdb2c0a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 0x7fdb2c0a8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55836/0 (socket says 172.21.15.153:55836) 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 -- 172.21.15.153:0/1124496543 learned_addr learned my addr 172.21.15.153:0/1124496543 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb2b7fe700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c0a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb2bfff700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 -- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 msgr2=0x7fdb2c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 -- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 msgr2=0x7fdb2c0a8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c0a8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 -- 172.21.15.153:0/1124496543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb24009ae0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb30c78700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 0x7fdb2c0a8a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fdb1c00d260 tx=0x7fdb1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c006910 con 0x7fdb2c1560f0 2023-08-17T00:02:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1c012ad0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1c012e90 con 0x7fdb2c1560f0 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.627+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c0092a0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.631+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb2c153510 con 0x7fdb2c1560f0 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.631+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb2c06b4c0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.631+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdb1c00f070 con 0x7fdb2c1560f0 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.635+0000 7fdb13fff700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb1805a180 0x7fdb1805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.635+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb1c075600 con 0x7fdb2c1560f0 2023-08-17T00:02:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.635+0000 7fdb2bfff700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb1805a180 0x7fdb1805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.635+0000 7fdb2bfff700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb1805a180 0x7fdb1805c640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fdb240072d0 tx=0x7fdb2400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:56.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.643+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb1c048f40 con 0x7fdb2c1560f0 2023-08-17T00:02:56.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.839+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdb2c0662d0 con 0x7fdb2c1560f0 2023-08-17T00:02:56.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.847+0000 7fdb13fff700 1 -- 172.21.15.153:0/1124496543 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+141719 (secure 0 0 0) 0x7fdb1c006b30 con 0x7fdb2c1560f0 2023-08-17T00:02:56.851 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:56.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb1805a180 msgr2=0x7fdb1805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb1805a180 0x7fdb1805c640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fdb240072d0 tx=0x7fdb2400b040).stop 2023-08-17T00:02:56.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 msgr2=0x7fdb2c0a8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:56.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 0x7fdb2c0a8a80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fdb1c00d260 tx=0x7fdb1c016000).stop 2023-08-17T00:02:56.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 shutdown_connections 2023-08-17T00:02:56.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb1805a180 0x7fdb1805c640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb2c1560f0 0x7fdb2c0a8a80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb2c151530 0x7fdb2c0a8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 --2- 172.21.15.153:0/1124496543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb2c0689c0 0x7fdb2c152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:56.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 >> 172.21.15.153:0/1124496543 conn(0x7fdb2c0c6620 msgr2=0x7fdb2c0bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:56.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 shutdown_connections 2023-08-17T00:02:56.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:56.851+0000 7fdb31479700 1 -- 172.21.15.153:0/1124496543 wait complete. 2023-08-17T00:02:56.873 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":32723},{"type":"v1","addr":"172.21.15.178:6833","nonce":32723}]},"active_addr":"172.21.15.178:6833/32723","active_change":"2023-08-17T00:02:37.147923+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3983505413}]},{"addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":2483973294}]}]} 2023-08-17T00:02:56.877 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-17T00:02:56.877 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-17T00:02:56.877 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:57.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.031+0000 7fab7e21b700 1 Processor -- start 2023-08-17T00:02:57.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.031+0000 7fab7e21b700 1 -- start start 2023-08-17T00:02:57.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab7e21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d50 0x7fab780632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab7e21b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab78154130 0x7fab780629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab7e21b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab780656d0 0x7fab78065b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab7e21b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab78065240 con 0x7fab78154130 2023-08-17T00:02:57.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab7e21b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab78062ea0 con 0x7fab780656d0 2023-08-17T00:02:57.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab7e21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab78063880 con 0x7fab78153d50 2023-08-17T00:02:57.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab78154130 0x7fab780629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab78154130 0x7fab780629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55852/0 (socket says 172.21.15.153:55852) 2023-08-17T00:02:57.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 -- 172.21.15.153:0/209384114 learned_addr learned my addr 172.21.15.153:0/209384114 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:57.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab77fff700 1 --2- 172.21.15.153:0/209384114 >> v2:172.21.15.178:3300/0 conn(0x7fab780656d0 0x7fab78065b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab777fe700 1 --2- 172.21.15.153:0/209384114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d50 0x7fab780632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 -- 172.21.15.153:0/209384114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d50 msgr2=0x7fab780632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:57.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 --2- 172.21.15.153:0/209384114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d50 0x7fab780632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 -- 172.21.15.153:0/209384114 >> v2:172.21.15.178:3300/0 conn(0x7fab780656d0 msgr2=0x7fab78065b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:57.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 --2- 172.21.15.153:0/209384114 >> v2:172.21.15.178:3300/0 conn(0x7fab780656d0 0x7fab78065b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.035+0000 7fab6effd700 1 -- 172.21.15.153:0/209384114 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab78064910 con 0x7fab78154130 2023-08-17T00:02:57.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab6effd700 1 --2- 172.21.15.153:0/209384114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78154130 0x7fab780629b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fab780c38c0 tx=0x7fab600090f0).ready entity=mon.0 client_cookie=322dc7b3ee6d8ccd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab76ffd700 1 -- 172.21.15.153:0/209384114 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000b520 con 0x7fab78154130 2023-08-17T00:02:57.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab76ffd700 1 -- 172.21.15.153:0/209384114 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000b680 con 0x7fab78154130 2023-08-17T00:02:57.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab76ffd700 1 -- 172.21.15.153:0/209384114 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000ba20 con 0x7fab78154130 2023-08-17T00:02:57.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 -- 172.21.15.153:0/209384114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78154130 msgr2=0x7fab780629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 --2- 172.21.15.153:0/209384114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78154130 0x7fab780629b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fab780c38c0 tx=0x7fab600090f0).stop 2023-08-17T00:02:57.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 -- 172.21.15.153:0/209384114 shutdown_connections 2023-08-17T00:02:57.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 --2- 172.21.15.153:0/209384114 >> v2:172.21.15.178:3300/0 conn(0x7fab780656d0 0x7fab78065b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 --2- 172.21.15.153:0/209384114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78154130 0x7fab780629b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 --2- 172.21.15.153:0/209384114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab78153d50 0x7fab780632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 -- 172.21.15.153:0/209384114 >> 172.21.15.153:0/209384114 conn(0x7fab780c7150 msgr2=0x7fab780c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:57.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 -- 172.21.15.153:0/209384114 shutdown_connections 2023-08-17T00:02:57.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.039+0000 7fab7e21b700 1 -- 172.21.15.153:0/209384114 wait complete. 2023-08-17T00:02:57.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 Processor -- start 2023-08-17T00:02:57.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 -- start start 2023-08-17T00:02:57.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780656d0 0x7fab78147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 0x7fab780bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab78154130 0x7fab780bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780c0320 con 0x7fab78153d50 2023-08-17T00:02:57.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab780aa070 con 0x7fab78154130 2023-08-17T00:02:57.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.043+0000 7fab7e21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab780bf070 con 0x7fab780656d0 2023-08-17T00:02:57.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 0x7fab780bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 0x7fab780bf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55862/0 (socket says 172.21.15.153:55862) 2023-08-17T00:02:57.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 -- 172.21.15.153:0/3816446267 learned_addr learned my addr 172.21.15.153:0/3816446267 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:57.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab77fff700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab78154130 0x7fab780bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab777fe700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780656d0 0x7fab78147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 -- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780656d0 msgr2=0x7fab78147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780656d0 0x7fab78147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 -- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab78154130 msgr2=0x7fab780bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab78154130 0x7fab780bfe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 -- 172.21.15.153:0/3816446267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009370 con 0x7fab78153d50 2023-08-17T00:02:57.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6effd700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 0x7fab780bf940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fab60006fd0 tx=0x7fab60017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60006d90 con 0x7fab78153d50 2023-08-17T00:02:57.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab60000bc0 con 0x7fab78153d50 2023-08-17T00:02:57.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab780aa330 con 0x7fab78153d50 2023-08-17T00:02:57.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000ba20 con 0x7fab78153d50 2023-08-17T00:02:57.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.047+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab780beab0 con 0x7fab78153d50 2023-08-17T00:02:57.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.051+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab780aa4c0 con 0x7fab78153d50 2023-08-17T00:02:57.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.051+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fab6000f070 con 0x7fab78153d50 2023-08-17T00:02:57.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.051+0000 7fab6ffff700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab5805a150 0x7fab5805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.051+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fab60075a80 con 0x7fab78153d50 2023-08-17T00:02:57.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.051+0000 7fab777fe700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab5805a150 0x7fab5805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.051+0000 7fab777fe700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab5805a150 0x7fab5805c610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fab6800bb10 tx=0x7fab68008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.059+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab600494d0 con 0x7fab78153d50 2023-08-17T00:02:57.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.215+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab7806b530 con 0x7fab78153d50 2023-08-17T00:02:57.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.215+0000 7fab6ffff700 1 -- 172.21.15.153:0/3816446267 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fab6004caf0 con 0x7fab78153d50 2023-08-17T00:02:57.220 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:57.221 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:57.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab5805a150 msgr2=0x7fab5805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab5805a150 0x7fab5805c610 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fab6800bb10 tx=0x7fab68008040).stop 2023-08-17T00:02:57.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 msgr2=0x7fab780bf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 0x7fab780bf940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fab60006fd0 tx=0x7fab60017000).stop 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 shutdown_connections 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab5805a150 0x7fab5805c610 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab78154130 0x7fab780bfe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab78153d50 0x7fab780bf940 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 --2- 172.21.15.153:0/3816446267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab780656d0 0x7fab78147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.219+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 >> 172.21.15.153:0/3816446267 conn(0x7fab780c7150 msgr2=0x7fab780c4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:57.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.223+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 shutdown_connections 2023-08-17T00:02:57.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.223+0000 7fab7e21b700 1 -- 172.21.15.153:0/3816446267 wait complete. 2023-08-17T00:02:57.246 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-17T00:02:57.247 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:02:57.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.403+0000 7f4126569700 1 Processor -- start 2023-08-17T00:02:57.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4126569700 1 -- start start 2023-08-17T00:02:57.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4126569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4120153ab0 0x7f4120153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4126569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41200c7ba0 0x7f41200c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4126569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41200aa750 con 0x7f41200c8d50 2023-08-17T00:02:57.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4126569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41200c9dd0 con 0x7f4120153ab0 2023-08-17T00:02:57.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4126569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41200aacf0 con 0x7f41200c7ba0 2023-08-17T00:02:57.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4120153ab0 0x7f4120153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f41177fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f41200c8d50 0x7f41200c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35650/0 (socket says 172.21.15.153:35650) 2023-08-17T00:02:57.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f41177fe700 1 -- 172.21.15.153:0/1931667933 learned_addr learned my addr 172.21.15.153:0/1931667933 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:57.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f4124b06700 1 --2- 172.21.15.153:0/1931667933 >> v2:172.21.15.178:3300/0 conn(0x7f41200c7ba0 0x7f41200c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411ffff700 1 -- 172.21.15.153:0/1931667933 >> v2:172.21.15.178:3300/0 conn(0x7f41200c7ba0 msgr2=0x7f41200c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:57.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411ffff700 1 --2- 172.21.15.153:0/1931667933 >> v2:172.21.15.178:3300/0 conn(0x7f41200c7ba0 0x7f41200c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411ffff700 1 -- 172.21.15.153:0/1931667933 >> v1:172.21.15.153:6789/0 conn(0x7f41200c8d50 legacy=0x7f41200c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411ffff700 1 -- 172.21.15.153:0/1931667933 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41200c5ca0 con 0x7f4120153ab0 2023-08-17T00:02:57.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411ffff700 1 --2- 172.21.15.153:0/1931667933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4120153ab0 0x7f4120153e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f412005ea10 tx=0x7f4110009060).ready entity=mon.0 client_cookie=ff52864c8898114b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411f7fe700 1 -- 172.21.15.153:0/1931667933 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41100090d0 con 0x7f4120153ab0 2023-08-17T00:02:57.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411f7fe700 1 -- 172.21.15.153:0/1931667933 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000b580 con 0x7f4120153ab0 2023-08-17T00:02:57.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.407+0000 7f411f7fe700 1 -- 172.21.15.153:0/1931667933 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000b900 con 0x7f4120153ab0 2023-08-17T00:02:57.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- 172.21.15.153:0/1931667933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4120153ab0 msgr2=0x7f4120153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 --2- 172.21.15.153:0/1931667933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4120153ab0 0x7f4120153e90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f412005ea10 tx=0x7f4110009060).stop 2023-08-17T00:02:57.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- 172.21.15.153:0/1931667933 shutdown_connections 2023-08-17T00:02:57.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 --2- 172.21.15.153:0/1931667933 >> v2:172.21.15.178:3300/0 conn(0x7f41200c7ba0 0x7f41200c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 --2- 172.21.15.153:0/1931667933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4120153ab0 0x7f4120153e90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- 172.21.15.153:0/1931667933 >> 172.21.15.153:0/1931667933 conn(0x7f4120061fa0 msgr2=0x7f41200623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:57.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- 172.21.15.153:0/1931667933 shutdown_connections 2023-08-17T00:02:57.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- 172.21.15.153:0/1931667933 wait complete. 2023-08-17T00:02:57.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 Processor -- start 2023-08-17T00:02:57.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- start start 2023-08-17T00:02:57.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 0x7f41201506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41200c8d50 0x7f41200c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4120153ab0 0x7f41200c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41200c4420 con 0x7f41200c7ba0 2023-08-17T00:02:57.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41201568a0 con 0x7f41200c8d50 2023-08-17T00:02:57.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.411+0000 7f4126569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41200ae340 con 0x7f4120153ab0 2023-08-17T00:02:57.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 0x7f41201506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 0x7f41201506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55888/0 (socket says 172.21.15.153:55888) 2023-08-17T00:02:57.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 -- 172.21.15.153:0/2812783429 learned_addr learned my addr 172.21.15.153:0/2812783429 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:57.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f4124b06700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4120153ab0 0x7f41200c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f41177fe700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41200c8d50 0x7f41200c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 -- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4120153ab0 msgr2=0x7f41200c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4120153ab0 0x7f41200c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 -- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41200c8d50 msgr2=0x7f41200c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41200c8d50 0x7f41200c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 -- 172.21.15.153:0/2812783429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41100092a0 con 0x7f41200c7ba0 2023-08-17T00:02:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f41177fe700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41200c8d50 0x7f41200c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:57.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411ffff700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 0x7f41201506c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4110009fd0 tx=0x7f4110017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000b6f0 con 0x7f41200c7ba0 2023-08-17T00:02:57.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000b850 con 0x7f41200c7ba0 2023-08-17T00:02:57.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41200c2b30 con 0x7f41200c7ba0 2023-08-17T00:02:57.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411001b650 con 0x7f41200c7ba0 2023-08-17T00:02:57.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41200ada90 con 0x7f41200c7ba0 2023-08-17T00:02:57.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.415+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412006b530 con 0x7f41200c7ba0 2023-08-17T00:02:57.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.419+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f411002a070 con 0x7f41200c7ba0 2023-08-17T00:02:57.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.419+0000 7f411cff9700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f410005a150 0x7f410005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.419+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f41100757b0 con 0x7f41200c7ba0 2023-08-17T00:02:57.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.419+0000 7f41177fe700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f410005a150 0x7f410005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.419+0000 7f41177fe700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f410005a150 0x7f410005c610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f412015a440 tx=0x7f4108009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.427+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4110049260 con 0x7f41200c7ba0 2023-08-17T00:02:57.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.583+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41200c9810 con 0x7f41200c7ba0 2023-08-17T00:02:57.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.583+0000 7f411cff9700 1 -- 172.21.15.153:0/2812783429 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f4110028090 con 0x7f41200c7ba0 2023-08-17T00:02:57.587 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:02:57.587 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:02:57.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.583+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f410005a150 msgr2=0x7f410005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.583+0000 7f4126569700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f410005a150 0x7f410005c610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f412015a440 tx=0x7f4108009040).stop 2023-08-17T00:02:57.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.583+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 msgr2=0x7f41201506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.583+0000 7f4126569700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 0x7f41201506c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4110009fd0 tx=0x7f4110017000).stop 2023-08-17T00:02:57.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 shutdown_connections 2023-08-17T00:02:57.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f410005a150 0x7f410005c610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4120153ab0 0x7f41200c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41200c8d50 0x7f41200c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 --2- 172.21.15.153:0/2812783429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41200c7ba0 0x7f41201506c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 >> 172.21.15.153:0/2812783429 conn(0x7f4120061fa0 msgr2=0x7f4120155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 shutdown_connections 2023-08-17T00:02:57.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.587+0000 7f4126569700 1 -- 172.21.15.153:0/2812783429 wait complete. 2023-08-17T00:02:57.611 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-17T00:02:57.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.771+0000 7f89761b9700 1 Processor -- start 2023-08-17T00:02:57.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.771+0000 7f89761b9700 1 -- start start 2023-08-17T00:02:57.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89761b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8970153f50 0x7f8970154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89761b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c01a0 0x7f89700c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89761b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89700bfd10 con 0x7f89700c57a0 2023-08-17T00:02:57.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89761b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8970154860 con 0x7f8970153f50 2023-08-17T00:02:57.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89761b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8970154af0 con 0x7f89700c01a0 2023-08-17T00:02:57.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89749b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8970153f50 0x7f8970154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89749b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8970153f50 0x7f8970154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55904/0 (socket says 172.21.15.153:55904) 2023-08-17T00:02:57.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89749b6700 1 -- 172.21.15.153:0/2032984288 learned_addr learned my addr 172.21.15.153:0/2032984288 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:57.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.775+0000 7f89759b8700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c01a0 0x7f89700c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89749b6700 1 -- 172.21.15.153:0/2032984288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c01a0 msgr2=0x7f89700c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:57.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89749b6700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c01a0 0x7f89700c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89749b6700 1 -- 172.21.15.153:0/2032984288 >> v1:172.21.15.178:6789/0 conn(0x7f89700c57a0 legacy=0x7f89700c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89749b6700 1 -- 172.21.15.153:0/2032984288 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8970154dd0 con 0x7f8970153f50 2023-08-17T00:02:57.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89759b8700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c01a0 0x7f89700c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89749b6700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f8970154370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8960006fd0 tx=0x7f89600090f0).ready entity=mon.0 client_cookie=7780958a57b2dc5c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f8967fff700 1 -- 172.21.15.153:0/2032984288 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000b600 con 0x7f8970153f50 2023-08-17T00:02:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f8967fff700 1 -- 172.21.15.153:0/2032984288 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896000b760 con 0x7f8970153f50 2023-08-17T00:02:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f8967fff700 1 -- 172.21.15.153:0/2032984288 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896000bae0 con 0x7f8970153f50 2023-08-17T00:02:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 -- 172.21.15.153:0/2032984288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 msgr2=0x7f8970154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f8970154370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f8960006fd0 tx=0x7f89600090f0).stop 2023-08-17T00:02:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 -- 172.21.15.153:0/2032984288 shutdown_connections 2023-08-17T00:02:57.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c01a0 0x7f89700c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 --2- 172.21.15.153:0/2032984288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f8970154370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 -- 172.21.15.153:0/2032984288 >> 172.21.15.153:0/2032984288 conn(0x7f8970062a70 msgr2=0x7f89700ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:57.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 -- 172.21.15.153:0/2032984288 shutdown_connections 2023-08-17T00:02:57.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.779+0000 7f89761b9700 1 -- 172.21.15.153:0/2032984288 wait complete. 2023-08-17T00:02:57.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 Processor -- start 2023-08-17T00:02:57.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 -- start start 2023-08-17T00:02:57.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89700c01a0 0x7f8970165280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c57a0 0x7f89700c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f89700c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89700c81b0 con 0x7f8970153f50 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8970165770 con 0x7f89700c01a0 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89761b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89700c75a0 con 0x7f89700c57a0 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f89700c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f89700c9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55920/0 (socket says 172.21.15.153:55920) 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 -- 172.21.15.153:0/2997086164 learned_addr learned my addr 172.21.15.153:0/2997086164 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:57.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89749b6700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c57a0 0x7f89700c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89751b7700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89700c01a0 0x7f8970165280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 -- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c57a0 msgr2=0x7f89700c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c57a0 0x7f89700c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 -- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89700c01a0 msgr2=0x7f8970165280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89700c01a0 0x7f8970165280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89759b8700 1 -- 172.21.15.153:0/2997086164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8960009370 con 0x7f8970153f50 2023-08-17T00:02:57.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.783+0000 7f89749b6700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89700c57a0 0x7f89700c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:57.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89759b8700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f89700c9170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8968009fc0 tx=0x7f89680099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800dd40 con 0x7f8970153f50 2023-08-17T00:02:57.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f896800f040 con 0x7f8970153f50 2023-08-17T00:02:57.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89700c7880 con 0x7f8970153f50 2023-08-17T00:02:57.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f896800dea0 con 0x7f8970153f50 2023-08-17T00:02:57.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89700c7e40 con 0x7f8970153f50 2023-08-17T00:02:57.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f897006b4c0 con 0x7f8970153f50 2023-08-17T00:02:57.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.787+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8968013890 con 0x7f8970153f50 2023-08-17T00:02:57.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89657fa700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f895405a150 0x7f895405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f89680749e0 con 0x7f8970153f50 2023-08-17T00:02:57.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89657fa700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f89540634f0 0x7f8954065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 --> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8954065fd0 con 0x7f89540634f0 2023-08-17T00:02:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8968079220 con 0x7f8970153f50 2023-08-17T00:02:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89751b7700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f895405a150 0x7f895405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89749b6700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f89540634f0 0x7f8954065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89751b7700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f895405a150 0x7f895405c610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f896c003640 tx=0x7f896c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.791+0000 7f89749b6700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f89540634f0 0x7f8954065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:57.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.795+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== osd.0 v2:172.21.15.153:6800/32815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f8954065fd0 con 0x7f89540634f0 2023-08-17T00:02:57.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 --> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f89700bf9a0 con 0x7f89540634f0 2023-08-17T00:02:57.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89657fa700 1 -- 172.21.15.153:0/2997086164 <== osd.0 v2:172.21.15.153:6800/32815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f89700bf9a0 con 0x7f89540634f0 2023-08-17T00:02:57.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f89540634f0 msgr2=0x7f8954065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f89540634f0 0x7f8954065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f895405a150 msgr2=0x7f895405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f895405a150 0x7f895405c610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f896c003640 tx=0x7f896c009040).stop 2023-08-17T00:02:57.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 msgr2=0x7f89700c9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:57.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 --2- 172.21.15.153:0/2997086164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8970153f50 0x7f89700c9170 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f8968009fc0 tx=0x7f89680099b0).stop 2023-08-17T00:02:57.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89759b8700 1 -- 172.21.15.153:0/2997086164 reap_dead start 2023-08-17T00:02:57.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 shutdown_connections 2023-08-17T00:02:57.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 >> 172.21.15.153:0/2997086164 conn(0x7f8970062a70 msgr2=0x7f8970063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:57.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 shutdown_connections 2023-08-17T00:02:57.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.811+0000 7f89761b9700 1 -- 172.21.15.153:0/2997086164 wait complete. 2023-08-17T00:02:57.834 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2023-08-17T00:02:57.834 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-17T00:02:57.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.991+0000 7f178afb9700 1 Processor -- start 2023-08-17T00:02:57.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.991+0000 7f178afb9700 1 -- start start 2023-08-17T00:02:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178afb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1784068820 0x7f1784068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178afb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17840a96d0 0x7f17840a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178afb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17841585a0 con 0x7f17840a8df0 2023-08-17T00:02:57.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178afb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17840c1ba0 con 0x7f17840a96d0 2023-08-17T00:02:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178afb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1784066400 con 0x7f1784068820 2023-08-17T00:02:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178a7b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17840a96d0 0x7f17840a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f1789fb7700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f17840a8df0 0x7f17840c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55692/0 (socket says 172.21.15.153:55692) 2023-08-17T00:02:57.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f1789fb7700 1 -- 172.21.15.153:0/3872827280 learned_addr learned my addr 172.21.15.153:0/3872827280 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f17897b6700 1 --2- 172.21.15.153:0/3872827280 >> v2:172.21.15.178:3300/0 conn(0x7f1784068820 0x7f1784068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178a7b8700 1 -- 172.21.15.153:0/3872827280 >> v2:172.21.15.178:3300/0 conn(0x7f1784068820 msgr2=0x7f1784068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178a7b8700 1 --2- 172.21.15.153:0/3872827280 >> v2:172.21.15.178:3300/0 conn(0x7f1784068820 0x7f1784068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:57.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f1788fb5700 1 -- 172.21.15.153:0/3872827280 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144753975 0 0) 0x7f17841585a0 con 0x7f17840a8df0 2023-08-17T00:02:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178a7b8700 1 -- 172.21.15.153:0/3872827280 >> v1:172.21.15.178:6789/0 conn(0x7f17840a8df0 legacy=0x7f17840c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178a7b8700 1 -- 172.21.15.153:0/3872827280 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784069170 con 0x7f17840a96d0 2023-08-17T00:02:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f178a7b8700 1 --2- 172.21.15.153:0/3872827280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f17840a9b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f17840c2ef0 tx=0x7f177c009780).ready entity=mon.0 client_cookie=76718172d20f05fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f1788fb5700 1 -- 172.21.15.153:0/3872827280 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00e070 con 0x7f17840a96d0 2023-08-17T00:02:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f1788fb5700 1 -- 172.21.15.153:0/3872827280 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00bb60 con 0x7f17840a96d0 2023-08-17T00:02:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.995+0000 7f1788fb5700 1 -- 172.21.15.153:0/3872827280 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c012410 con 0x7f17840a96d0 2023-08-17T00:02:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- 172.21.15.153:0/3872827280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 msgr2=0x7f17840a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 --2- 172.21.15.153:0/3872827280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f17840a9b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f17840c2ef0 tx=0x7f177c009780).stop 2023-08-17T00:02:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- 172.21.15.153:0/3872827280 shutdown_connections 2023-08-17T00:02:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 --2- 172.21.15.153:0/3872827280 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f17840a9b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 --2- 172.21.15.153:0/3872827280 >> v2:172.21.15.178:3300/0 conn(0x7f1784068820 0x7f1784068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- 172.21.15.153:0/3872827280 >> 172.21.15.153:0/3872827280 conn(0x7f17840c6620 msgr2=0x7f17840c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- 172.21.15.153:0/3872827280 shutdown_connections 2023-08-17T00:02:58.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- 172.21.15.153:0/3872827280 wait complete. 2023-08-17T00:02:58.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 Processor -- start 2023-08-17T00:02:58.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- start start 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784068820 0x7f1784156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17840a8df0 0x7f1784156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f178415a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840bed60 con 0x7f17840a96d0 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840be150 con 0x7f17840a8df0 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:57.999+0000 7f178afb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17840be430 con 0x7f1784068820 2023-08-17T00:02:58.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f178415a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f17897b6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17840a8df0 0x7f1784156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f1789fb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784068820 0x7f1784156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f178415a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55932/0 (socket says 172.21.15.153:55932) 2023-08-17T00:02:58.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 -- 172.21.15.153:0/1380510514 learned_addr learned my addr 172.21.15.153:0/1380510514 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 -- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784068820 msgr2=0x7f1784156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784068820 0x7f1784156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 -- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17840a8df0 msgr2=0x7f1784156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17840a8df0 0x7f1784156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 -- 172.21.15.153:0/1380510514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c009a20 con 0x7f17840a96d0 2023-08-17T00:02:58.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f17897b6700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17840a8df0 0x7f1784156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:58.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f1789fb7700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1784068820 0x7f1784156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:58.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178a7b8700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f178415a190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f177c00b6c0 tx=0x7f177c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c012410 con 0x7f17840a96d0 2023-08-17T00:02:58.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c01d630 con 0x7f17840a96d0 2023-08-17T00:02:58.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17840be710 con 0x7f17840a96d0 2023-08-17T00:02:58.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c01d9b0 con 0x7f17840a96d0 2023-08-17T00:02:58.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1784156a70 con 0x7f17840a96d0 2023-08-17T00:02:58.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.003+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f178406b4c0 con 0x7f17840a96d0 2023-08-17T00:02:58.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f177c026410 con 0x7f17840a96d0 2023-08-17T00:02:58.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1779ffb700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f176805a180 0x7f176805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f177c0760c0 con 0x7f17840a96d0 2023-08-17T00:02:58.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1779ffb700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f1768063520 0x7f1768065980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 --> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1768066000 con 0x7f1768063520 2023-08-17T00:02:58.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f177c078620 con 0x7f17840a96d0 2023-08-17T00:02:58.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f1789fb7700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f176805a180 0x7f176805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.007+0000 7f17897b6700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f1768063520 0x7f1768065980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.011+0000 7f1789fb7700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f176805a180 0x7f176805c640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1780006860 tx=0x7f1780007dc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.011+0000 7f17897b6700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f1768063520 0x7f1768065980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.011+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== osd.1 v2:172.21.15.153:6824/32819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f1768066000 con 0x7f1768063520 2023-08-17T00:02:58.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.027+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 --> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1784064010 con 0x7f1768063520 2023-08-17T00:02:58.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f1779ffb700 1 -- 172.21.15.153:0/1380510514 <== osd.1 v2:172.21.15.153:6824/32819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1784064010 con 0x7f1768063520 2023-08-17T00:02:58.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f1768063520 msgr2=0x7f1768065980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f1768063520 0x7f1768065980 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f176805a180 msgr2=0x7f176805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f176805a180 0x7f176805c640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f1780006860 tx=0x7f1780007dc0).stop 2023-08-17T00:02:58.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 msgr2=0x7f178415a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 --2- 172.21.15.153:0/1380510514 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17840a96d0 0x7f178415a190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f177c00b6c0 tx=0x7f177c009780).stop 2023-08-17T00:02:58.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178a7b8700 1 -- 172.21.15.153:0/1380510514 reap_dead start 2023-08-17T00:02:58.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 shutdown_connections 2023-08-17T00:02:58.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 >> 172.21.15.153:0/1380510514 conn(0x7f17840c6620 msgr2=0x7f1784157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 shutdown_connections 2023-08-17T00:02:58.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.031+0000 7f178afb9700 1 -- 172.21.15.153:0/1380510514 wait complete. 2023-08-17T00:02:58.053 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:02:58.054 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-17T00:02:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 Processor -- start 2023-08-17T00:02:58.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 -- start start 2023-08-17T00:02:58.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b10068da0 0x7f0b101560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b10151530 0x7f0b101519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b10065da0 con 0x7f0b100689c0 2023-08-17T00:02:58.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b10069200 con 0x7f0b10151530 2023-08-17T00:02:58.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b15eb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b10155c60 con 0x7f0b10068da0 2023-08-17T00:02:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b14eb7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0b100689c0 0x7f0b100c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35666/0 (socket says 172.21.15.153:35666) 2023-08-17T00:02:58.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b14eb7700 1 -- 172.21.15.153:0/1673925855 learned_addr learned my addr 172.21.15.153:0/1673925855 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b156b8700 1 --2- 172.21.15.153:0/1673925855 >> v2:172.21.15.153:3300/0 conn(0x7f0b10151530 0x7f0b101519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b0ffff700 1 --2- 172.21.15.153:0/1673925855 >> v2:172.21.15.178:3300/0 conn(0x7f0b10068da0 0x7f0b101560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b0f7fe700 1 -- 172.21.15.153:0/1673925855 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179930390 0 0) 0x7f0b10065da0 con 0x7f0b100689c0 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b0f7fe700 1 -- 172.21.15.153:0/1673925855 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b000033f0 con 0x7f0b100689c0 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b156b8700 1 -- 172.21.15.153:0/1673925855 >> v2:172.21.15.178:3300/0 conn(0x7f0b10068da0 msgr2=0x7f0b101560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b156b8700 1 --2- 172.21.15.153:0/1673925855 >> v2:172.21.15.178:3300/0 conn(0x7f0b10068da0 0x7f0b101560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b156b8700 1 -- 172.21.15.153:0/1673925855 >> v1:172.21.15.153:6789/0 conn(0x7f0b100689c0 legacy=0x7f0b100c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b156b8700 1 -- 172.21.15.153:0/1673925855 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10065ff0 con 0x7f0b10151530 2023-08-17T00:02:58.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.211+0000 7f0b0ffff700 1 --2- 172.21.15.153:0/1673925855 >> v2:172.21.15.178:3300/0 conn(0x7f0b10068da0 0x7f0b101560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:58.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b156b8700 1 --2- 172.21.15.153:0/1673925855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b101519c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f0b100bff90 tx=0x7f0b08009780).ready entity=mon.0 client_cookie=cba8806018699d24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b0f7fe700 1 -- 172.21.15.153:0/1673925855 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0800e070 con 0x7f0b10151530 2023-08-17T00:02:58.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b0f7fe700 1 -- 172.21.15.153:0/1673925855 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0800bb60 con 0x7f0b10151530 2023-08-17T00:02:58.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b0f7fe700 1 -- 172.21.15.153:0/1673925855 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b08012410 con 0x7f0b10151530 2023-08-17T00:02:58.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 -- 172.21.15.153:0/1673925855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 msgr2=0x7f0b101519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 --2- 172.21.15.153:0/1673925855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b101519c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f0b100bff90 tx=0x7f0b08009780).stop 2023-08-17T00:02:58.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 -- 172.21.15.153:0/1673925855 shutdown_connections 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 --2- 172.21.15.153:0/1673925855 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b101519c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 --2- 172.21.15.153:0/1673925855 >> v2:172.21.15.178:3300/0 conn(0x7f0b10068da0 0x7f0b101560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 -- 172.21.15.153:0/1673925855 >> 172.21.15.153:0/1673925855 conn(0x7f0b100c6620 msgr2=0x7f0b100c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 -- 172.21.15.153:0/1673925855 shutdown_connections 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 -- 172.21.15.153:0/1673925855 wait complete. 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.215+0000 7f0b15eb9700 1 Processor -- start 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 -- start start 2023-08-17T00:02:58.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b100689c0 0x7f0b100c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b10068da0 0x7f0b10167e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b1016bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100b6770 con 0x7f0b10151530 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b10150d60 con 0x7f0b10068da0 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b100b5ba0 con 0x7f0b100689c0 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b1016bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b1016bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55946/0 (socket says 172.21.15.153:55946) 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 -- 172.21.15.153:0/3192579818 learned_addr learned my addr 172.21.15.153:0/3192579818 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b0ffff700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b10068da0 0x7f0b10167e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b14eb7700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b100689c0 0x7f0b100c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 -- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b100689c0 msgr2=0x7f0b100c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b100689c0 0x7f0b100c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 -- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b10068da0 msgr2=0x7f0b10167e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b10068da0 0x7f0b10167e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 -- 172.21.15.153:0/3192579818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08009a20 con 0x7f0b10151530 2023-08-17T00:02:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b14eb7700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b100689c0 0x7f0b100c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:02:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b156b8700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b1016bc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0b0800b6c0 tx=0x7f0b08009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0801d630 con 0x7f0b10151530 2023-08-17T00:02:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0801d790 con 0x7f0b10151530 2023-08-17T00:02:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b100b5e40 con 0x7f0b10151530 2023-08-17T00:02:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0801db10 con 0x7f0b10151530 2023-08-17T00:02:58.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.219+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b100b6400 con 0x7f0b10151530 2023-08-17T00:02:58.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0b1006b4c0 con 0x7f0b10151530 2023-08-17T00:02:58.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0b08026410 con 0x7f0b10151530 2023-08-17T00:02:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0cff9700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0af405a150 0x7f0af405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b08076350 con 0x7f0b10151530 2023-08-17T00:02:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0cff9700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7f0af40634f0 0x7f0af4065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 --> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0af4065fd0 con 0x7f0af40634f0 2023-08-17T00:02:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b080788b0 con 0x7f0b10151530 2023-08-17T00:02:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b14eb7700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0af405a150 0x7f0af405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.223+0000 7f0b0ffff700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7f0af40634f0 0x7f0af4065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.227+0000 7f0b0ffff700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7f0af40634f0 0x7f0af4065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.227+0000 7f0b14eb7700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0af405a150 0x7f0af405c610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0b04004f10 tx=0x7f0b04009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.227+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== osd.2 v2:172.21.15.153:6803/32817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f0af4065fd0 con 0x7f0af40634f0 2023-08-17T00:02:58.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.243+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 --> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0b10152910 con 0x7f0af40634f0 2023-08-17T00:02:58.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b0cff9700 1 -- 172.21.15.153:0/3192579818 <== osd.2 v2:172.21.15.153:6803/32817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0b10152910 con 0x7f0af40634f0 2023-08-17T00:02:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7f0af40634f0 msgr2=0x7f0af4065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7f0af40634f0 0x7f0af4065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0af405a150 msgr2=0x7f0af405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0af405a150 0x7f0af405c610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0b04004f10 tx=0x7f0b04009040).stop 2023-08-17T00:02:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 msgr2=0x7f0b1016bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 --2- 172.21.15.153:0/3192579818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b10151530 0x7f0b1016bc00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f0b0800b6c0 tx=0x7f0b08009780).stop 2023-08-17T00:02:58.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b156b8700 1 -- 172.21.15.153:0/3192579818 reap_dead start 2023-08-17T00:02:58.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 shutdown_connections 2023-08-17T00:02:58.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 >> 172.21.15.153:0/3192579818 conn(0x7f0b100c6620 msgr2=0x7f0b100bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 shutdown_connections 2023-08-17T00:02:58.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.247+0000 7f0b15eb9700 1 -- 172.21.15.153:0/3192579818 wait complete. 2023-08-17T00:02:58.274 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:02:58.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-17T00:02:58.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.431+0000 7fbd540db700 1 Processor -- start 2023-08-17T00:02:58.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.431+0000 7fbd540db700 1 -- start start 2023-08-17T00:02:58.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd540db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbd4c0a8b70 0x7fbd4c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd540db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd540db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c065240 con 0x7fbd4c0656d0 2023-08-17T00:02:58.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd540db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c062ea0 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd540db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0638a0 con 0x7fbd4c0a8f50 2023-08-17T00:02:58.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbd4c0a8b70 0x7fbd4c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbd4c0a8b70 0x7fbd4c0632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55962/0 (socket says 172.21.15.153:55962) 2023-08-17T00:02:58.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 -- 172.21.15.153:0/997048219 learned_addr learned my addr 172.21.15.153:0/997048219 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51676700 1 --2- 172.21.15.153:0/997048219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 -- 172.21.15.153:0/997048219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 msgr2=0x7fbd4c0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:58.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 --2- 172.21.15.153:0/997048219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 -- 172.21.15.153:0/997048219 >> v1:172.21.15.178:6789/0 conn(0x7fbd4c0656d0 legacy=0x7fbd4c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 -- 172.21.15.153:0/997048219 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c064910 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd51e77700 1 --2- 172.21.15.153:0/997048219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0632e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fbd48006fd0 tx=0x7fbd480090f0).ready entity=mon.0 client_cookie=2f3db38cbab77fde server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd50e75700 1 -- 172.21.15.153:0/997048219 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800b580 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd50e75700 1 -- 172.21.15.153:0/997048219 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4800b6e0 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.435+0000 7fbd50e75700 1 -- 172.21.15.153:0/997048219 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4800ba60 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 -- 172.21.15.153:0/997048219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 msgr2=0x7fbd4c0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 --2- 172.21.15.153:0/997048219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0632e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fbd48006fd0 tx=0x7fbd480090f0).stop 2023-08-17T00:02:58.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 -- 172.21.15.153:0/997048219 shutdown_connections 2023-08-17T00:02:58.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 --2- 172.21.15.153:0/997048219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 --2- 172.21.15.153:0/997048219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0632e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 -- 172.21.15.153:0/997048219 >> 172.21.15.153:0/997048219 conn(0x7fbd4c0c7150 msgr2=0x7fbd4c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 -- 172.21.15.153:0/997048219 shutdown_connections 2023-08-17T00:02:58.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 -- 172.21.15.153:0/997048219 wait complete. 2023-08-17T00:02:58.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 Processor -- start 2023-08-17T00:02:58.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.439+0000 7fbd540db700 1 -- start start 2023-08-17T00:02:58.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4c0656d0 0x7fbd4c14c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0c5c50 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c168a00 con 0x7fbd4c0656d0 2023-08-17T00:02:58.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c158fe0 con 0x7fbd4c0a8f50 2023-08-17T00:02:58.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55970/0 (socket says 172.21.15.153:55970) 2023-08-17T00:02:58.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 -- 172.21.15.153:0/489297967 learned_addr learned my addr 172.21.15.153:0/489297967 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd52678700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51e77700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4c0656d0 0x7fbd4c14c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 -- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 msgr2=0x7fbd4c0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbd4c0a8f50 0x7fbd4c0c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 -- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4c0656d0 msgr2=0x7fbd4c14c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbd4c0656d0 0x7fbd4c14c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 -- 172.21.15.153:0/489297967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48009370 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd51676700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0c5270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fbd3c00e900 tx=0x7fbd3c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012600 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c012760 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c0aa330 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c012ae0 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.443+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c158c70 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd4c06b530 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbd3c022070 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd41ffb700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd3005a150 0x7fbd3005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbd3c0741f0 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd41ffb700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7fbd300634f0 0x7fbd30065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 --> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd30065fd0 con 0x7fbd300634f0 2023-08-17T00:02:58.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd3c076860 con 0x7fbd4c0a8b70 2023-08-17T00:02:58.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd51e77700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd3005a150 0x7fbd3005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.447+0000 7fbd52678700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7fbd300634f0 0x7fbd30065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.451+0000 7fbd52678700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7fbd300634f0 0x7fbd30065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.451+0000 7fbd51e77700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd3005a150 0x7fbd3005c610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbd48009130 tx=0x7fbd48017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.451+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== osd.3 v2:172.21.15.153:6801/32816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fbd30065fd0 con 0x7fbd300634f0 2023-08-17T00:02:58.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.467+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 --> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd4c159150 con 0x7fbd300634f0 2023-08-17T00:02:58.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.467+0000 7fbd41ffb700 1 -- 172.21.15.153:0/489297967 <== osd.3 v2:172.21.15.153:6801/32816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd4c159150 con 0x7fbd300634f0 2023-08-17T00:02:58.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.467+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7fbd300634f0 msgr2=0x7fbd30065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.467+0000 7fbd540db700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7fbd300634f0 0x7fbd30065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd3005a150 msgr2=0x7fbd3005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd3005a150 0x7fbd3005c610 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fbd48009130 tx=0x7fbd48017000).stop 2023-08-17T00:02:58.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 msgr2=0x7fbd4c0c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 --2- 172.21.15.153:0/489297967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbd4c0a8b70 0x7fbd4c0c5270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fbd3c00e900 tx=0x7fbd3c009060).stop 2023-08-17T00:02:58.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd52678700 1 -- 172.21.15.153:0/489297967 reap_dead start 2023-08-17T00:02:58.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 shutdown_connections 2023-08-17T00:02:58.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 >> 172.21.15.153:0/489297967 conn(0x7fbd4c0c7150 msgr2=0x7fbd4c155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 shutdown_connections 2023-08-17T00:02:58.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.471+0000 7fbd540db700 1 -- 172.21.15.153:0/489297967 wait complete. 2023-08-17T00:02:58.494 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:02:58.495 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-17T00:02:58.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 Processor -- start 2023-08-17T00:02:58.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 -- start start 2023-08-17T00:02:58.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50d4151f70 0x7f50d4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f50d4065b50 0x7f50d4064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d4061fa0 con 0x7f50d4151b90 2023-08-17T00:02:58.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d40c3fb0 con 0x7f50d4151f70 2023-08-17T00:02:58.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50dc65b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d41523d0 con 0x7f50d4065b50 2023-08-17T00:02:58.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50d4151f70 0x7f50d4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50d4151f70 0x7f50d4065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55986/0 (socket says 172.21.15.153:55986) 2023-08-17T00:02:58.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 -- 172.21.15.153:0/1075108348 learned_addr learned my addr 172.21.15.153:0/1075108348 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 -- 172.21.15.153:0/1075108348 >> v2:172.21.15.178:3300/0 conn(0x7f50d4065b50 msgr2=0x7f50d4064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:58.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 --2- 172.21.15.153:0/1075108348 >> v2:172.21.15.178:3300/0 conn(0x7f50d4065b50 0x7f50d4064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:58.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 -- 172.21.15.153:0/1075108348 >> v1:172.21.15.178:6789/0 conn(0x7f50d4151b90 legacy=0x7f50d4063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:58.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 -- 172.21.15.153:0/1075108348 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40621f0 con 0x7f50d4151f70 2023-08-17T00:02:58.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d9bf6700 1 --2- 172.21.15.153:0/1075108348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4151f70 0x7f50d4065660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f50d40bd6b0 tx=0x7f50c40090f0).ready entity=mon.0 client_cookie=db739a7a977b0a26 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.667+0000 7f50d93f5700 1 -- 172.21.15.153:0/1075108348 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400b5a0 con 0x7f50d4151f70 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50d93f5700 1 -- 172.21.15.153:0/1075108348 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c400b700 con 0x7f50d4151f70 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50d93f5700 1 -- 172.21.15.153:0/1075108348 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c400ba80 con 0x7f50d4151f70 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 -- 172.21.15.153:0/1075108348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4151f70 msgr2=0x7f50d4065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 --2- 172.21.15.153:0/1075108348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4151f70 0x7f50d4065660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f50d40bd6b0 tx=0x7f50c40090f0).stop 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 -- 172.21.15.153:0/1075108348 shutdown_connections 2023-08-17T00:02:58.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 --2- 172.21.15.153:0/1075108348 >> v2:172.21.15.178:3300/0 conn(0x7f50d4065b50 0x7f50d4064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:02:58.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 --2- 172.21.15.153:0/1075108348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4151f70 0x7f50d4065660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 -- 172.21.15.153:0/1075108348 >> 172.21.15.153:0/1075108348 conn(0x7f50d40c7150 msgr2=0x7f50d40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 -- 172.21.15.153:0/1075108348 shutdown_connections 2023-08-17T00:02:58.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 -- 172.21.15.153:0/1075108348 wait complete. 2023-08-17T00:02:58.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.671+0000 7f50dc65b700 1 Processor -- start 2023-08-17T00:02:58.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 -- start start 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4065b50 0x7f50d40a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4151b90 0x7f50d40a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d4151f70 0x7f50d414fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40a59a0 con 0x7f50d4065b50 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40a5c20 con 0x7f50d4151f70 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40a5f00 con 0x7f50d4151b90 2023-08-17T00:02:58.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4065b50 0x7f50d40a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4065b50 0x7f50d40a69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55990/0 (socket says 172.21.15.153:55990) 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 -- 172.21.15.153:0/4095430195 learned_addr learned my addr 172.21.15.153:0/4095430195 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50d9bf6700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4151b90 0x7f50d40a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dabf8700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d4151f70 0x7f50d414fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 -- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4151b90 msgr2=0x7f50d40a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4151b90 0x7f50d40a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 -- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d4151f70 msgr2=0x7f50d414fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d4151f70 0x7f50d414fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 -- 172.21.15.153:0/4095430195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4009370 con 0x7f50d4065b50 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50d9bf6700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4151b90 0x7f50d40a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dabf8700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d4151f70 0x7f50d414fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50da3f7700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4065b50 0x7f50d40a69e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f50d000c440 tx=0x7f50d0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000f470 con 0x7f50d4065b50 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d000f5f0 con 0x7f50d4065b50 2023-08-17T00:02:58.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000f9b0 con 0x7f50d4065b50 2023-08-17T00:02:58.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d40a61e0 con 0x7f50d4065b50 2023-08-17T00:02:58.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.675+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d40a7810 con 0x7f50d4065b50 2023-08-17T00:02:58.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.679+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f50d406b530 con 0x7f50d4065b50 2023-08-17T00:02:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.679+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f50d0019030 con 0x7f50d4065b50 2023-08-17T00:02:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.679+0000 7f50ca7fc700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f50b805a150 0x7f50b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f50d00735e0 con 0x7f50d4065b50 2023-08-17T00:02:58.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50ca7fc700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f50b80634f0 0x7f50b8065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 --> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f50b8065fd0 con 0x7f50b80634f0 2023-08-17T00:02:58.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50d0075b40 con 0x7f50d4065b50 2023-08-17T00:02:58.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50d9bf6700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f50b805a150 0x7f50b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50dabf8700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f50b80634f0 0x7f50b8065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50d9bf6700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f50b805a150 0x7f50b805c610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f50c4009130 tx=0x7f50c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.683+0000 7f50dabf8700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f50b80634f0 0x7f50b8065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.687+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== osd.4 v2:172.21.15.178:6800/33066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f50b8065fd0 con 0x7f50b80634f0 2023-08-17T00:02:58.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 --> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f50d40624d0 con 0x7f50b80634f0 2023-08-17T00:02:58.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50ca7fc700 1 -- 172.21.15.153:0/4095430195 <== osd.4 v2:172.21.15.178:6800/33066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f50d40624d0 con 0x7f50b80634f0 2023-08-17T00:02:58.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f50b80634f0 msgr2=0x7f50b8065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f50b80634f0 0x7f50b8065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f50b805a150 msgr2=0x7f50b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f50b805a150 0x7f50b805c610 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f50c4009130 tx=0x7f50c4015000).stop 2023-08-17T00:02:58.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4065b50 msgr2=0x7f50d40a69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 --2- 172.21.15.153:0/4095430195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50d4065b50 0x7f50d40a69e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f50d000c440 tx=0x7f50d0007de0).stop 2023-08-17T00:02:58.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dabf8700 1 -- 172.21.15.153:0/4095430195 reap_dead start 2023-08-17T00:02:58.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 shutdown_connections 2023-08-17T00:02:58.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 >> 172.21.15.153:0/4095430195 conn(0x7f50d40c7150 msgr2=0x7f50d4063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 shutdown_connections 2023-08-17T00:02:58.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.703+0000 7f50dc65b700 1 -- 172.21.15.153:0/4095430195 wait complete. 2023-08-17T00:02:58.727 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-08-17T00:02:58.727 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-17T00:02:58.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 Processor -- start 2023-08-17T00:02:58.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 -- start start 2023-08-17T00:02:58.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd7d8153910 0x7fd7d8153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d80a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d8095110 con 0x7fd7d80a8280 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d8094e70 con 0x7fd7d8153910 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.887+0000 7fd7dcc79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80a7840 con 0x7fd7d80a5400 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd7d80a8280 0x7fd7d80955a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35680/0 (socket says 172.21.15.153:35680) 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d7fff700 1 -- 172.21.15.153:0/1046497891 learned_addr learned my addr 172.21.15.153:0/1046497891 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d77fe700 1 --2- 172.21.15.153:0/1046497891 >> v2:172.21.15.178:3300/0 conn(0x7fd7d8153910 0x7fd7d8153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d6ffd700 1 --2- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d80a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d67fc700 1 -- 172.21.15.153:0/1046497891 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3325197381 0 0) 0x7fd7d8095110 con 0x7fd7d80a8280 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d77fe700 1 -- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 msgr2=0x7fd7d80a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d77fe700 1 --2- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d80a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d77fe700 1 -- 172.21.15.153:0/1046497891 >> v1:172.21.15.153:6789/0 conn(0x7fd7d80a8280 legacy=0x7fd7d80955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d77fe700 1 -- 172.21.15.153:0/1046497891 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d80a7b20 con 0x7fd7d8153910 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d77fe700 1 --2- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 0x7fd7d8153cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd7c8006fd0 tx=0x7fd7c8006f40).ready entity=mon.1 client_cookie=ad997ec43a3fafea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d67fc700 1 -- 172.21.15.153:0/1046497891 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8005880 con 0x7fd7d8153910 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d67fc700 1 -- 172.21.15.153:0/1046497891 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c80059e0 con 0x7fd7d8153910 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7d67fc700 1 -- 172.21.15.153:0/1046497891 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8005d60 con 0x7fd7d8153910 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 msgr2=0x7fd7d8153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 --2- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 0x7fd7d8153cf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fd7c8006fd0 tx=0x7fd7c8006f40).stop 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1046497891 shutdown_connections 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 --2- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d80a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 --2- 172.21.15.153:0/1046497891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 0x7fd7d8153cf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1046497891 >> 172.21.15.153:0/1046497891 conn(0x7fd7d80c5170 msgr2=0x7fd7d80c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1046497891 shutdown_connections 2023-08-17T00:02:58.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.891+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1046497891 wait complete. 2023-08-17T00:02:58.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.895+0000 7fd7dcc79700 1 Processor -- start 2023-08-17T00:02:58.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.895+0000 7fd7dcc79700 1 -- start start 2023-08-17T00:02:58.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7dcc79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d813bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7dcc79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7d80a8280 0x7fd7d8163a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7dcc79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 0x7fd7d8163ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7dcc79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80acf80 con 0x7fd7d80a8280 2023-08-17T00:02:58.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7dcc79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80ac3b0 con 0x7fd7d8153910 2023-08-17T00:02:58.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7dcc79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d80ac650 con 0x7fd7d80a5400 2023-08-17T00:02:58.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7d80a8280 0x7fd7d8163a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7d80a8280 0x7fd7d8163a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56000/0 (socket says 172.21.15.153:56000) 2023-08-17T00:02:58.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 -- 172.21.15.153:0/1801012500 learned_addr learned my addr 172.21.15.153:0/1801012500 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:58.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d813bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d7fff700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 0x7fd7d8163ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 -- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 msgr2=0x7fd7d813bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7d80a5400 0x7fd7d813bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 -- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 msgr2=0x7fd7d8163ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7d8153910 0x7fd7d8163ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 -- 172.21.15.153:0/1801012500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009250 con 0x7fd7d80a8280 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.899+0000 7fd7d6ffd700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7d80a8280 0x7fd7d8163a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd7cc00e930 tx=0x7fd7cc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.903+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc012600 con 0x7fd7d80a8280 2023-08-17T00:02:58.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.903+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc012760 con 0x7fd7d80a8280 2023-08-17T00:02:58.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.903+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc012ae0 con 0x7fd7d80a8280 2023-08-17T00:02:58.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.903+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7d80ac930 con 0x7fd7d80a8280 2023-08-17T00:02:58.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.903+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d813c2a0 con 0x7fd7d80a8280 2023-08-17T00:02:58.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.903+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7d806b4c0 con 0x7fd7d80a8280 2023-08-17T00:02:58.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd7cc022070 con 0x7fd7d80a8280 2023-08-17T00:02:58.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7bf7fe700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd7c405a150 0x7fd7c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd7cc074430 con 0x7fd7d80a8280 2023-08-17T00:02:58.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7bf7fe700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7fd7c40634f0 0x7fd7c4065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:58.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7c4065fd0 con 0x7fd7c40634f0 2023-08-17T00:02:58.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7cc076aa0 con 0x7fd7d80a8280 2023-08-17T00:02:58.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7d77fe700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd7c405a150 0x7fd7c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7d7fff700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7fd7c40634f0 0x7fd7c4065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:58.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7d77fe700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd7c405a150 0x7fd7c405c610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd7c8006fa0 tx=0x7fd7c8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.907+0000 7fd7d7fff700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7fd7c40634f0 0x7fd7c4065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:58.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.911+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== osd.5 v2:172.21.15.178:6816/33067 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7fd7c4065fd0 con 0x7fd7c40634f0 2023-08-17T00:02:58.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.927+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7d80ad0c0 con 0x7fd7c40634f0 2023-08-17T00:02:58.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7bf7fe700 1 -- 172.21.15.153:0/1801012500 <== osd.5 v2:172.21.15.178:6816/33067 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7d80ad0c0 con 0x7fd7c40634f0 2023-08-17T00:02:58.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7fd7c40634f0 msgr2=0x7fd7c4065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7fd7c40634f0 0x7fd7c4065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:58.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd7c405a150 msgr2=0x7fd7c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd7c405a150 0x7fd7c405c610 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd7c8006fa0 tx=0x7fd7c8015000).stop 2023-08-17T00:02:58.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7d80a8280 msgr2=0x7fd7d8163a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:58.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 --2- 172.21.15.153:0/1801012500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd7d80a8280 0x7fd7d8163a00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd7cc00e930 tx=0x7fd7cc009060).stop 2023-08-17T00:02:58.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7d7fff700 1 -- 172.21.15.153:0/1801012500 reap_dead start 2023-08-17T00:02:58.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 shutdown_connections 2023-08-17T00:02:58.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 >> 172.21.15.153:0/1801012500 conn(0x7fd7d80c5170 msgr2=0x7fd7d80bd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:58.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 shutdown_connections 2023-08-17T00:02:58.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:58.931+0000 7fd7dcc79700 1 -- 172.21.15.153:0/1801012500 wait complete. 2023-08-17T00:02:58.954 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2023-08-17T00:02:58.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-17T00:02:59.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.123+0000 7f9afce1b700 1 Processor -- start 2023-08-17T00:02:59.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.123+0000 7f9afce1b700 1 -- start start 2023-08-17T00:02:59.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af80a8b70 0x7f9af80632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80629b0 0x7f9af80bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af8065240 con 0x7f9af80a8f50 2023-08-17T00:02:59.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af8062e60 con 0x7f9af80a8b70 2023-08-17T00:02:59.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af80638a0 con 0x7f9af80629b0 2023-08-17T00:02:59.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af80a8b70 0x7f9af80632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9af80a8b70 0x7f9af80632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56006/0 (socket says 172.21.15.153:56006) 2023-08-17T00:02:59.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 -- 172.21.15.153:0/2851221819 learned_addr learned my addr 172.21.15.153:0/2851221819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:59.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af6d9d700 1 --2- 172.21.15.153:0/2851221819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80629b0 0x7f9af80bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 -- 172.21.15.153:0/2851221819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80629b0 msgr2=0x7f9af80bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 --2- 172.21.15.153:0/2851221819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80629b0 0x7f9af80bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 -- 172.21.15.153:0/2851221819 >> v1:172.21.15.178:6789/0 conn(0x7f9af80a8f50 legacy=0x7f9af80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 -- 172.21.15.153:0/2851221819 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8065de0 con 0x7f9af80a8b70 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af559a700 1 -- 172.21.15.153:0/2851221819 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735272942 0 0) 0x7f9af8065240 con 0x7f9af80a8f50 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af659c700 1 --2- 172.21.15.153:0/2851221819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8b70 0x7f9af80632e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9ae8006fd0 tx=0x7f9ae80090f0).ready entity=mon.0 client_cookie=1afa9881887ab742 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af559a700 1 -- 172.21.15.153:0/2851221819 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800b580 con 0x7f9af80a8b70 2023-08-17T00:02:59.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af559a700 1 -- 172.21.15.153:0/2851221819 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800b6e0 con 0x7f9af80a8b70 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9af559a700 1 -- 172.21.15.153:0/2851221819 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800ba60 con 0x7f9af80a8b70 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 -- 172.21.15.153:0/2851221819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8b70 msgr2=0x7f9af80632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.127+0000 7f9afce1b700 1 --2- 172.21.15.153:0/2851221819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8b70 0x7f9af80632e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9ae8006fd0 tx=0x7f9ae80090f0).stop 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 -- 172.21.15.153:0/2851221819 shutdown_connections 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 --2- 172.21.15.153:0/2851221819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80629b0 0x7f9af80bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 --2- 172.21.15.153:0/2851221819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8b70 0x7f9af80632e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 -- 172.21.15.153:0/2851221819 >> 172.21.15.153:0/2851221819 conn(0x7f9af80c7150 msgr2=0x7f9af80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 -- 172.21.15.153:0/2851221819 shutdown_connections 2023-08-17T00:02:59.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 -- 172.21.15.153:0/2851221819 wait complete. 2023-08-17T00:02:59.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 Processor -- start 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.131+0000 7f9afce1b700 1 -- start start 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af80629b0 0x7f9af80bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80a8b70 0x7f9af816bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8f50 0x7f9af814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af8158c80 con 0x7f9af80a8f50 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af80bd720 con 0x7f9af80629b0 2023-08-17T00:02:59.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af80bda00 con 0x7f9af80a8b70 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8f50 0x7f9af814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8f50 0x7f9af814db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56012/0 (socket says 172.21.15.153:56012) 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 -- 172.21.15.153:0/2518101591 learned_addr learned my addr 172.21.15.153:0/2518101591 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af659c700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af80629b0 0x7f9af80bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af5d9b700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80a8b70 0x7f9af816bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 -- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80a8b70 msgr2=0x7f9af816bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af80a8b70 0x7f9af816bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 -- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af80629b0 msgr2=0x7f9af80bfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af80629b0 0x7f9af80bfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 -- 172.21.15.153:0/2518101591 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009370 con 0x7f9af80a8f50 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af659c700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af80629b0 0x7f9af80bfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9af6d9d700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8f50 0x7f9af814db60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f9af0009e90 tx=0x7f9af000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af000cc20 con 0x7f9af80a8f50 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af000f040 con 0x7f9af80a8f50 2023-08-17T00:02:59.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af0013400 con 0x7f9af80a8f50 2023-08-17T00:02:59.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af80bdce0 con 0x7f9af80a8f50 2023-08-17T00:02:59.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af80be2a0 con 0x7f9af80a8f50 2023-08-17T00:02:59.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.135+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9af806b530 con 0x7f9af80a8f50 2023-08-17T00:02:59.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9af00137b0 con 0x7f9af80a8f50 2023-08-17T00:02:59.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9ae67fc700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad805a150 0x7f9ad805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9af0074c40 con 0x7f9af80a8f50 2023-08-17T00:02:59.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9ae67fc700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f9ad80634f0 0x7f9ad8065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 --> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ad8065fd0 con 0x7f9ad80634f0 2023-08-17T00:02:59.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9af00791c0 con 0x7f9af80a8f50 2023-08-17T00:02:59.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9af659c700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad805a150 0x7f9ad805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9af5d9b700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f9ad80634f0 0x7f9ad8065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9af659c700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad805a150 0x7f9ad805c610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9ae8009fd0 tx=0x7f9ae8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.139+0000 7f9af5d9b700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f9ad80634f0 0x7f9ad8065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.143+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== osd.6 v2:172.21.15.178:6808/33068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f9ad8065fd0 con 0x7f9ad80634f0 2023-08-17T00:02:59.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.159+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 --> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9af80be4c0 con 0x7f9ad80634f0 2023-08-17T00:02:59.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9ae67fc700 1 -- 172.21.15.153:0/2518101591 <== osd.6 v2:172.21.15.178:6808/33068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9af80be4c0 con 0x7f9ad80634f0 2023-08-17T00:02:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f9ad80634f0 msgr2=0x7f9ad8065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f9ad80634f0 0x7f9ad8065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad805a150 msgr2=0x7f9ad805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad805a150 0x7f9ad805c610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f9ae8009fd0 tx=0x7f9ae8017000).stop 2023-08-17T00:02:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8f50 msgr2=0x7f9af814db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 --2- 172.21.15.153:0/2518101591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af80a8f50 0x7f9af814db60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f9af0009e90 tx=0x7f9af000b040).stop 2023-08-17T00:02:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9af6d9d700 1 -- 172.21.15.153:0/2518101591 reap_dead start 2023-08-17T00:02:59.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 shutdown_connections 2023-08-17T00:02:59.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 >> 172.21.15.153:0/2518101591 conn(0x7f9af80c7150 msgr2=0x7f9af81511c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 shutdown_connections 2023-08-17T00:02:59.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.163+0000 7f9afce1b700 1 -- 172.21.15.153:0/2518101591 wait complete. 2023-08-17T00:02:59.189 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:02:59.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-17T00:02:59.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.343+0000 7f5bf71b9700 1 Processor -- start 2023-08-17T00:02:59.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.343+0000 7f5bf71b9700 1 -- start start 2023-08-17T00:02:59.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf71b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5bf0154b40 0x7f5bf0154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf71b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0068e90 0x7f5bf00bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf71b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf00be9e0 con 0x7f5bf00bee70 2023-08-17T00:02:59.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf71b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf00692d0 con 0x7f5bf0154b40 2023-08-17T00:02:59.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf71b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00aae40 con 0x7f5bf0068e90 2023-08-17T00:02:59.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf69b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5bf00bee70 0x7f5bf0067e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35690/0 (socket says 172.21.15.153:35690) 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf69b8700 1 -- 172.21.15.153:0/3939966209 learned_addr learned my addr 172.21.15.153:0/3939966209 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf61b7700 1 --2- 172.21.15.153:0/3939966209 >> v2:172.21.15.178:3300/0 conn(0x7f5bf0154b40 0x7f5bf0154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf59b6700 1 --2- 172.21.15.153:0/3939966209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0068e90 0x7f5bf00bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf51b5700 1 -- 172.21.15.153:0/3939966209 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980448485 0 0) 0x7f5bf00be9e0 con 0x7f5bf00bee70 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf51b5700 1 -- 172.21.15.153:0/3939966209 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bdc0033f0 con 0x7f5bf00bee70 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf59b6700 1 -- 172.21.15.153:0/3939966209 >> v2:172.21.15.178:3300/0 conn(0x7f5bf0154b40 msgr2=0x7f5bf0154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:59.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf59b6700 1 --2- 172.21.15.153:0/3939966209 >> v2:172.21.15.178:3300/0 conn(0x7f5bf0154b40 0x7f5bf0154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf59b6700 1 -- 172.21.15.153:0/3939966209 >> v1:172.21.15.153:6789/0 conn(0x7f5bf00bee70 legacy=0x7f5bf0067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.347+0000 7f5bf59b6700 1 -- 172.21.15.153:0/3939966209 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf00bddd0 con 0x7f5bf0068e90 2023-08-17T00:02:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf59b6700 1 --2- 172.21.15.153:0/3939966209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0068e90 0x7f5bf00bd5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5be000db80 tx=0x7f5be000d500).ready entity=mon.2 client_cookie=6bf83cc33cdb105c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf51b5700 1 -- 172.21.15.153:0/3939966209 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0012070 con 0x7f5bf0068e90 2023-08-17T00:02:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf51b5700 1 -- 172.21.15.153:0/3939966209 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000d2e0 con 0x7f5bf0068e90 2023-08-17T00:02:59.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf51b5700 1 -- 172.21.15.153:0/3939966209 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000f7d0 con 0x7f5bf0068e90 2023-08-17T00:02:59.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 -- 172.21.15.153:0/3939966209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0068e90 msgr2=0x7f5bf00bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 --2- 172.21.15.153:0/3939966209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0068e90 0x7f5bf00bd5f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f5be000db80 tx=0x7f5be000d500).stop 2023-08-17T00:02:59.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 -- 172.21.15.153:0/3939966209 shutdown_connections 2023-08-17T00:02:59.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 --2- 172.21.15.153:0/3939966209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0068e90 0x7f5bf00bd5f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 --2- 172.21.15.153:0/3939966209 >> v2:172.21.15.178:3300/0 conn(0x7f5bf0154b40 0x7f5bf0154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 -- 172.21.15.153:0/3939966209 >> 172.21.15.153:0/3939966209 conn(0x7f5bf00c9160 msgr2=0x7f5bf00c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 -- 172.21.15.153:0/3939966209 shutdown_connections 2023-08-17T00:02:59.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 -- 172.21.15.153:0/3939966209 wait complete. 2023-08-17T00:02:59.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 Processor -- start 2023-08-17T00:02:59.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.351+0000 7f5bf71b9700 1 -- start start 2023-08-17T00:02:59.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf0068e90 0x7f5bf014f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bf00bee70 0x7f5bf014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0154b40 0x7f5bf0150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf00c0d80 con 0x7f5bf00bee70 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf014ff10 con 0x7f5bf0068e90 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf014e840 con 0x7f5bf0154b40 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bf00bee70 0x7f5bf014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bf00bee70 0x7f5bf014cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56014/0 (socket says 172.21.15.153:56014) 2023-08-17T00:02:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 -- 172.21.15.153:0/1501742771 learned_addr learned my addr 172.21.15.153:0/1501742771 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf61b7700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf0068e90 0x7f5bf014f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf69b8700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0154b40 0x7f5bf0150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 -- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0154b40 msgr2=0x7f5bf0150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf0154b40 0x7f5bf0150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 -- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf0068e90 msgr2=0x7f5bf014f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf0068e90 0x7f5bf014f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 -- 172.21.15.153:0/1501742771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be000d740 con 0x7f5bf00bee70 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf61b7700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf0068e90 0x7f5bf014f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf59b6700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bf00bee70 0x7f5bf014cfc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5be000f330 tx=0x7f5bf006a690).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000c6b0 con 0x7f5bf00bee70 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be000c810 con 0x7f5bf00bee70 2023-08-17T00:02:59.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be000cbb0 con 0x7f5bf00bee70 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf014eb20 con 0x7f5bf00bee70 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.355+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf014fad0 con 0x7f5bf00bee70 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5bf006b4c0 con 0x7f5bf00bee70 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5be001f040 con 0x7f5bf00bee70 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5be67fc700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5bd405a150 0x7f5bd405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5be0079600 con 0x7f5bf00bee70 2023-08-17T00:02:59.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5be67fc700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f5bd40634f0 0x7f5bd4065950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 --> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5bd4065fd0 con 0x7f5bd40634f0 2023-08-17T00:02:59.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5be007bb60 con 0x7f5bf00bee70 2023-08-17T00:02:59.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.359+0000 7f5bf61b7700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5bd405a150 0x7f5bd405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.363+0000 7f5bf69b8700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f5bd40634f0 0x7f5bd4065950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.363+0000 7f5bf61b7700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5bd405a150 0x7f5bd405c610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5bec009f90 tx=0x7f5bec009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.363+0000 7f5bf69b8700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f5bd40634f0 0x7f5bd4065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.363+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== osd.7 v2:172.21.15.178:6824/33069 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f5bd4065fd0 con 0x7f5bd40634f0 2023-08-17T00:02:59.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 --> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5bf01533f0 con 0x7f5bd40634f0 2023-08-17T00:02:59.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5be67fc700 1 -- 172.21.15.153:0/1501742771 <== osd.7 v2:172.21.15.178:6824/33069 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5bf01533f0 con 0x7f5bd40634f0 2023-08-17T00:02:59.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f5bd40634f0 msgr2=0x7f5bd4065950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f5bd40634f0 0x7f5bd4065950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5bd405a150 msgr2=0x7f5bd405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5bd405a150 0x7f5bd405c610 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5bec009f90 tx=0x7f5bec009060).stop 2023-08-17T00:02:59.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bf00bee70 msgr2=0x7f5bf014cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 --2- 172.21.15.153:0/1501742771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5bf00bee70 0x7f5bf014cfc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f5be000f330 tx=0x7f5bf006a690).stop 2023-08-17T00:02:59.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf69b8700 1 -- 172.21.15.153:0/1501742771 reap_dead start 2023-08-17T00:02:59.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 shutdown_connections 2023-08-17T00:02:59.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 >> 172.21.15.153:0/1501742771 conn(0x7f5bf00c9160 msgr2=0x7f5bf0154f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 shutdown_connections 2023-08-17T00:02:59.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.383+0000 7f5bf71b9700 1 -- 172.21.15.153:0/1501742771 wait complete. 2023-08-17T00:02:59.408 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2023-08-17T00:02:59.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-17T00:02:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9916cb9700 1 Processor -- start 2023-08-17T00:02:59.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9916cb9700 1 -- start start 2023-08-17T00:02:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9916cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991015c4c0 0x7f99100acc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9916cb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9910063ea0 con 0x7f99100c57c0 2023-08-17T00:02:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9916cb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99100c0810 con 0x7f9910157d60 2023-08-17T00:02:59.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9916cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100ad3e0 con 0x7f991015c4c0 2023-08-17T00:02:59.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f99154b6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f99100c57c0 0x7f9910158140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35696/0 (socket says 172.21.15.153:35696) 2023-08-17T00:02:59.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f99154b6700 1 -- 172.21.15.153:0/195129730 learned_addr learned my addr 172.21.15.153:0/195129730 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:59.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f99164b8700 1 --2- 172.21.15.153:0/195129730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991015c4c0 0x7f99100acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9914cb5700 1 -- 172.21.15.153:0/195129730 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975089426 0 0) 0x7f9910063ea0 con 0x7f99100c57c0 2023-08-17T00:02:59.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.571+0000 7f9914cb5700 1 -- 172.21.15.153:0/195129730 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98fc0033f0 con 0x7f99100c57c0 2023-08-17T00:02:59.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f99164b8700 1 -- 172.21.15.153:0/195129730 >> v1:172.21.15.178:6789/0 conn(0x7f9910157d60 legacy=0x7f99100c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9914cb5700 1 -- 172.21.15.153:0/195129730 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2056364827 0 0) 0x7f99100c0810 con 0x7f9910157d60 2023-08-17T00:02:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f99164b8700 1 -- 172.21.15.153:0/195129730 >> v1:172.21.15.153:6789/0 conn(0x7f99100c57c0 legacy=0x7f9910158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f99164b8700 1 -- 172.21.15.153:0/195129730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99100ad160 con 0x7f991015c4c0 2023-08-17T00:02:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f99164b8700 1 --2- 172.21.15.153:0/195129730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991015c4c0 0x7f99100acc70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9908009e90 tx=0x7f9908009780).ready entity=mon.2 client_cookie=614a0c7203c79afe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9914cb5700 1 -- 172.21.15.153:0/195129730 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800e070 con 0x7f991015c4c0 2023-08-17T00:02:59.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9914cb5700 1 -- 172.21.15.153:0/195129730 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990800b850 con 0x7f991015c4c0 2023-08-17T00:02:59.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9914cb5700 1 -- 172.21.15.153:0/195129730 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9900001470 con 0x7f991015c4c0 2023-08-17T00:02:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 -- 172.21.15.153:0/195129730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991015c4c0 msgr2=0x7f99100acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 --2- 172.21.15.153:0/195129730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991015c4c0 0x7f99100acc70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f9908009e90 tx=0x7f9908009780).stop 2023-08-17T00:02:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 -- 172.21.15.153:0/195129730 shutdown_connections 2023-08-17T00:02:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 --2- 172.21.15.153:0/195129730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f991015c4c0 0x7f99100acc70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 -- 172.21.15.153:0/195129730 >> 172.21.15.153:0/195129730 conn(0x7f9910062a70 msgr2=0x7f99100ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 -- 172.21.15.153:0/195129730 shutdown_connections 2023-08-17T00:02:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.575+0000 7f9916cb9700 1 -- 172.21.15.153:0/195129730 wait complete. 2023-08-17T00:02:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 Processor -- start 2023-08-17T00:02:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 -- start start 2023-08-17T00:02:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99100c57c0 0x7f991014c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9910157d60 0x7f99100c3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 0x7f99100c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100c47d0 con 0x7f991015c4c0 2023-08-17T00:02:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99100aa7c0 con 0x7f99100c57c0 2023-08-17T00:02:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9916cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99100ab620 con 0x7f9910157d60 2023-08-17T00:02:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 0x7f99100c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 0x7f99100c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56022/0 (socket says 172.21.15.153:56022) 2023-08-17T00:02:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 -- 172.21.15.153:0/2137324331 learned_addr learned my addr 172.21.15.153:0/2137324331 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99154b6700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9910157d60 0x7f99100c3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9915cb7700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99100c57c0 0x7f991014c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 -- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9910157d60 msgr2=0x7f99100c3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9910157d60 0x7f99100c3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 -- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99100c57c0 msgr2=0x7f991014c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99100c57c0 0x7f991014c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 -- 172.21.15.153:0/2137324331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9908009a20 con 0x7f991015c4c0 2023-08-17T00:02:59.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f9915cb7700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99100c57c0 0x7f991014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:02:59.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.579+0000 7f99164b8700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 0x7f99100c42e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f990800b6c0 tx=0x7f9908009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990800ba90 con 0x7f991015c4c0 2023-08-17T00:02:59.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f990801d650 con 0x7f991015c4c0 2023-08-17T00:02:59.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99100aaa10 con 0x7f991015c4c0 2023-08-17T00:02:59.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990801d9f0 con 0x7f991015c4c0 2023-08-17T00:02:59.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99100aafd0 con 0x7f991015c4c0 2023-08-17T00:02:59.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99100cb460 con 0x7f991015c4c0 2023-08-17T00:02:59.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.583+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9908027460 con 0x7f991015c4c0 2023-08-17T00:02:59.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.587+0000 7f9905ffb700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98f405a150 0x7f98f405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.587+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9908076320 con 0x7f991015c4c0 2023-08-17T00:02:59.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.587+0000 7f9915cb7700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98f405a150 0x7f98f405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.587+0000 7f9915cb7700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98f405a150 0x7f98f405c610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f990c001670 tx=0x7f990c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.591+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9908049d70 con 0x7f991015c4c0 2023-08-17T00:02:59.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.751+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f991006b4c0 con 0x7f991015c4c0 2023-08-17T00:02:59.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.751+0000 7f9905ffb700 1 -- 172.21.15.153:0/2137324331 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f990804d390 con 0x7f991015c4c0 2023-08-17T00:02:59.755 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2023-08-17T00:02:59.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98f405a150 msgr2=0x7f98f405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98f405a150 0x7f98f405c610 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f990c001670 tx=0x7f990c009040).stop 2023-08-17T00:02:59.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 msgr2=0x7f99100c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 0x7f99100c42e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f990800b6c0 tx=0x7f9908009780).stop 2023-08-17T00:02:59.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 shutdown_connections 2023-08-17T00:02:59.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98f405a150 0x7f98f405c610 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f991015c4c0 0x7f99100c42e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9910157d60 0x7f99100c3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 --2- 172.21.15.153:0/2137324331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99100c57c0 0x7f991014c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 >> 172.21.15.153:0/2137324331 conn(0x7f9910062a70 msgr2=0x7f99101572f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 shutdown_connections 2023-08-17T00:02:59.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.755+0000 7f9916cb9700 1 -- 172.21.15.153:0/2137324331 wait complete. 2023-08-17T00:02:59.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2023-08-17T00:02:59.782 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-17T00:02:59.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.931+0000 7f11aa479700 1 Processor -- start 2023-08-17T00:02:59.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.931+0000 7f11aa479700 1 -- start start 2023-08-17T00:02:59.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11aa479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a4153f50 0x7f11a4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11aa479700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f11a40c01a0 0x7f11a40c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11aa479700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a40bfd10 con 0x7f11a40c57a0 2023-08-17T00:02:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11aa479700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a4154860 con 0x7f11a40c01a0 2023-08-17T00:02:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11aa479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a4154af0 con 0x7f11a4153f50 2023-08-17T00:02:59.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9c78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f11a40c01a0 0x7f11a40c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9477700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f11a40c57a0 0x7f11a40c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35706/0 (socket says 172.21.15.153:35706) 2023-08-17T00:02:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9477700 1 -- 172.21.15.153:0/25049597 learned_addr learned my addr 172.21.15.153:0/25049597 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:02:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a8c76700 1 --2- 172.21.15.153:0/25049597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a4153f50 0x7f11a4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9c78700 1 -- 172.21.15.153:0/25049597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a4153f50 msgr2=0x7f11a4154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:02:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9c78700 1 --2- 172.21.15.153:0/25049597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a4153f50 0x7f11a4154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9c78700 1 -- 172.21.15.153:0/25049597 >> v1:172.21.15.153:6789/0 conn(0x7f11a40c57a0 legacy=0x7f11a40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9c78700 1 -- 172.21.15.153:0/25049597 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a4154dd0 con 0x7f11a40c01a0 2023-08-17T00:02:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f11a9c78700 1 --2- 172.21.15.153:0/25049597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a40c01a0 0x7f11a40c0630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f119c009e60 tx=0x7f119c009780).ready entity=mon.0 client_cookie=c8cdc51c575bac8e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f119bfff700 1 -- 172.21.15.153:0/25049597 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00e070 con 0x7f11a40c01a0 2023-08-17T00:02:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f119bfff700 1 -- 172.21.15.153:0/25049597 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00bb60 con 0x7f11a40c01a0 2023-08-17T00:02:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.935+0000 7f119bfff700 1 -- 172.21.15.153:0/25049597 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c012410 con 0x7f11a40c01a0 2023-08-17T00:02:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 -- 172.21.15.153:0/25049597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a40c01a0 msgr2=0x7f11a40c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 --2- 172.21.15.153:0/25049597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a40c01a0 0x7f11a40c0630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f119c009e60 tx=0x7f119c009780).stop 2023-08-17T00:02:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 -- 172.21.15.153:0/25049597 shutdown_connections 2023-08-17T00:02:59.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 --2- 172.21.15.153:0/25049597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a40c01a0 0x7f11a40c0630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 --2- 172.21.15.153:0/25049597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a4153f50 0x7f11a4154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 -- 172.21.15.153:0/25049597 >> 172.21.15.153:0/25049597 conn(0x7f11a4062a70 msgr2=0x7f11a40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:02:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 -- 172.21.15.153:0/25049597 shutdown_connections 2023-08-17T00:02:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 -- 172.21.15.153:0/25049597 wait complete. 2023-08-17T00:02:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 Processor -- start 2023-08-17T00:02:59.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.939+0000 7f11aa479700 1 -- start start 2023-08-17T00:02:59.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a40c01a0 0x7f11a413efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a40c57a0 0x7f11a40c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 0x7f11a40c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40c4100 con 0x7f11a4153f50 2023-08-17T00:02:59.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40c43e0 con 0x7f11a40c01a0 2023-08-17T00:02:59.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a40c46c0 con 0x7f11a40c57a0 2023-08-17T00:02:59.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 0x7f11a40c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 0x7f11a40c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56050/0 (socket says 172.21.15.153:56050) 2023-08-17T00:02:59.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 -- 172.21.15.153:0/597878357 learned_addr learned my addr 172.21.15.153:0/597878357 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:02:59.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9477700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a40c01a0 0x7f11a413efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a8c76700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a40c57a0 0x7f11a40c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 -- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a40c57a0 msgr2=0x7f11a40c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a40c57a0 0x7f11a40c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 -- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a40c01a0 msgr2=0x7f11a413efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a40c01a0 0x7f11a413efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 -- 172.21.15.153:0/597878357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c009a20 con 0x7f11a4153f50 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11a9c78700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 0x7f11a40c3b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f119c00b6c0 tx=0x7f119c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c012410 con 0x7f11a4153f50 2023-08-17T00:02:59.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c01d630 con 0x7f11a4153f50 2023-08-17T00:02:59.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a40c49a0 con 0x7f11a4153f50 2023-08-17T00:02:59.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c01d9f0 con 0x7f11a4153f50 2023-08-17T00:02:59.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.943+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a40c1a90 con 0x7f11a4153f50 2023-08-17T00:02:59.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.947+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a406b4c0 con 0x7f11a4153f50 2023-08-17T00:02:59.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.947+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f119c026410 con 0x7f11a4153f50 2023-08-17T00:02:59.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.947+0000 7f11997fa700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f118805a120 0x7f118805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:02:59.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.947+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f119c076090 con 0x7f11a4153f50 2023-08-17T00:02:59.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.951+0000 7f11a9477700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f118805a120 0x7f118805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:02:59.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.951+0000 7f11a9477700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f118805a120 0x7f118805c5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f11a0007fd0 tx=0x7f11a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:02:59.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:02:59.951+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f119c0499d0 con 0x7f11a4153f50 2023-08-17T00:03:00.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.194+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f11a40bf9a0 con 0x7f11a4153f50 2023-08-17T00:03:00.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.198+0000 7f11997fa700 1 -- 172.21.15.153:0/597878357 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f119c04cff0 con 0x7f11a4153f50 2023-08-17T00:03:00.201 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:03:00.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f118805a120 msgr2=0x7f118805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f118805a120 0x7f118805c5e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f11a0007fd0 tx=0x7f11a0009040).stop 2023-08-17T00:03:00.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 msgr2=0x7f11a40c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 0x7f11a40c3b10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f119c00b6c0 tx=0x7f119c009780).stop 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 shutdown_connections 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f118805a120 0x7f118805c5e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a4153f50 0x7f11a40c3b10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a40c57a0 0x7f11a40c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 --2- 172.21.15.153:0/597878357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a40c01a0 0x7f11a413efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 >> 172.21.15.153:0/597878357 conn(0x7f11a4062a70 msgr2=0x7f11a4156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 shutdown_connections 2023-08-17T00:03:00.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.202+0000 7f11aa479700 1 -- 172.21.15.153:0/597878357 wait complete. 2023-08-17T00:03:00.227 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.1 2023-08-17T00:03:00.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-17T00:03:00.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 Processor -- start 2023-08-17T00:03:00.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 -- start start 2023-08-17T00:03:00.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdab00689c0 0x7fdab0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab01560f0 0x7fdab00c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdab0151530 0x7fdab01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab0065da0 con 0x7fdab0151530 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdab0155c60 con 0x7fdab00689c0 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.378+0000 7fdab5db9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0156550 con 0x7fdab01560f0 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdab0151530 0x7fdab01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdab0151530 0x7fdab01519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56056/0 (socket says 172.21.15.153:56056) 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 -- 172.21.15.153:0/2646696498 learned_addr learned my addr 172.21.15.153:0/2646696498 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab4db7700 1 --2- 172.21.15.153:0/2646696498 >> v2:172.21.15.178:3300/0 conn(0x7fdab00689c0 0x7fdab0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdaaffff700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab01560f0 0x7fdab00c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 -- 172.21.15.153:0/2646696498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab01560f0 msgr2=0x7fdab00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab01560f0 0x7fdab00c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 -- 172.21.15.153:0/2646696498 >> v2:172.21.15.178:3300/0 conn(0x7fdab00689c0 msgr2=0x7fdab0068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 --2- 172.21.15.153:0/2646696498 >> v2:172.21.15.178:3300/0 conn(0x7fdab00689c0 0x7fdab0068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 -- 172.21.15.153:0/2646696498 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0065ff0 con 0x7fdab0151530 2023-08-17T00:03:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab4db7700 1 --2- 172.21.15.153:0/2646696498 >> v2:172.21.15.178:3300/0 conn(0x7fdab00689c0 0x7fdab0068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdaaffff700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab01560f0 0x7fdab00c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab55b8700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151530 0x7fdab01519c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdab00c2d60 tx=0x7fdaa8009840).ready entity=mon.0 client_cookie=a8144a5c77ed8dd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdaaf7fe700 1 -- 172.21.15.153:0/2646696498 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800e070 con 0x7fdab0151530 2023-08-17T00:03:00.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdaaf7fe700 1 -- 172.21.15.153:0/2646696498 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa800ba50 con 0x7fdab0151530 2023-08-17T00:03:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdaaf7fe700 1 -- 172.21.15.153:0/2646696498 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa800bdd0 con 0x7fdab0151530 2023-08-17T00:03:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 -- 172.21.15.153:0/2646696498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151530 msgr2=0x7fdab01519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151530 0x7fdab01519c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fdab00c2d60 tx=0x7fdaa8009840).stop 2023-08-17T00:03:00.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 -- 172.21.15.153:0/2646696498 shutdown_connections 2023-08-17T00:03:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab01560f0 0x7fdab00c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 --2- 172.21.15.153:0/2646696498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab0151530 0x7fdab01519c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 --2- 172.21.15.153:0/2646696498 >> v2:172.21.15.178:3300/0 conn(0x7fdab00689c0 0x7fdab0068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 -- 172.21.15.153:0/2646696498 >> 172.21.15.153:0/2646696498 conn(0x7fdab00c6620 msgr2=0x7fdab00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 -- 172.21.15.153:0/2646696498 shutdown_connections 2023-08-17T00:03:00.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.382+0000 7fdab5db9700 1 -- 172.21.15.153:0/2646696498 wait complete. 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 Processor -- start 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 -- start start 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab00689c0 0x7fdab0150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab0151530 0x7fdab0152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 0x7fdab00c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00c1a70 con 0x7fdab01560f0 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00c0e60 con 0x7fdab00689c0 2023-08-17T00:03:00.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab5db9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab00c1140 con 0x7fdab0151530 2023-08-17T00:03:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 0x7fdab00c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 0x7fdab00c1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56058/0 (socket says 172.21.15.153:56058) 2023-08-17T00:03:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 -- 172.21.15.153:0/3987748611 learned_addr learned my addr 172.21.15.153:0/3987748611 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdaaffff700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab0151530 0x7fdab0152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab4db7700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab00689c0 0x7fdab0150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 -- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab0151530 msgr2=0x7fdab0152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab0151530 0x7fdab0152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 -- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab00689c0 msgr2=0x7fdab0150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab00689c0 0x7fdab0150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 -- 172.21.15.153:0/3987748611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa8009ae0 con 0x7fdab01560f0 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab4db7700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab00689c0 0x7fdab0150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.386+0000 7fdab55b8700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 0x7fdab00c1f00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fdaa8009fd0 tx=0x7fdaa8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:00.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa80092e0 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa801e470 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab00c1420 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa801e7f0 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab01512a0 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab00c1be0 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.390+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdaa8025030 con 0x7fdab01560f0 2023-08-17T00:03:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.394+0000 7fdaacff9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda9405a150 0x7fda9405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.394+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdaa8075940 con 0x7fdab01560f0 2023-08-17T00:03:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.394+0000 7fdab4db7700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda9405a150 0x7fda9405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.394+0000 7fdab4db7700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda9405a150 0x7fda9405c610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fdaa40088e0 tx=0x7fdaa4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:00.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.398+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdaa8049390 con 0x7fdab01560f0 2023-08-17T00:03:00.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.558+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdab00662d0 con 0x7fdab01560f0 2023-08-17T00:03:00.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.558+0000 7fdaacff9700 1 -- 172.21.15.153:0/3987748611 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdaa8023030 con 0x7fdab01560f0 2023-08-17T00:03:00.564 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:03:00.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda9405a150 msgr2=0x7fda9405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda9405a150 0x7fda9405c610 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fdaa40088e0 tx=0x7fdaa4008040).stop 2023-08-17T00:03:00.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 msgr2=0x7fdab00c1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 0x7fdab00c1f00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fdaa8009fd0 tx=0x7fdaa8009840).stop 2023-08-17T00:03:00.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 shutdown_connections 2023-08-17T00:03:00.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda9405a150 0x7fda9405c610 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdab01560f0 0x7fdab00c1f00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdab0151530 0x7fdab0152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 --2- 172.21.15.153:0/3987748611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdab00689c0 0x7fdab0150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 >> 172.21.15.153:0/3987748611 conn(0x7fdab00c6620 msgr2=0x7fdab00a8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:00.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 shutdown_connections 2023-08-17T00:03:00.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.562+0000 7fdab5db9700 1 -- 172.21.15.153:0/3987748611 wait complete. 2023-08-17T00:03:00.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2023-08-17T00:03:00.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-17T00:03:00.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 Processor -- start 2023-08-17T00:03:00.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 -- start start 2023-08-17T00:03:00.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef68068820 0x7fef68068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef681585a0 con 0x7fef680a8df0 2023-08-17T00:03:00.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef680c1ba0 con 0x7fef68068820 2023-08-17T00:03:00.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6e6b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef68066400 con 0x7fef680a96d0 2023-08-17T00:03:00.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6ceb6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef68068820 0x7fef68068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6d6b7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fef680a8df0 0x7fef680c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35722/0 (socket says 172.21.15.153:35722) 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6deb8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.738+0000 7fef6d6b7700 1 -- 172.21.15.153:0/3972488820 learned_addr learned my addr 172.21.15.153:0/3972488820 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3972488820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 msgr2=0x7fef680a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6ceb6700 1 --2- 172.21.15.153:0/3972488820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3972488820 >> v1:172.21.15.153:6789/0 conn(0x7fef680a8df0 legacy=0x7fef680c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef5ffff700 1 -- 172.21.15.153:0/3972488820 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107159282 0 0) 0x7fef681585a0 con 0x7fef680a8df0 2023-08-17T00:03:00.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3972488820 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68069170 con 0x7fef68068820 2023-08-17T00:03:00.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6deb8700 1 --2- 172.21.15.153:0/3972488820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:00.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6ceb6700 1 --2- 172.21.15.153:0/3972488820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef68068820 0x7fef68068c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fef58009760 tx=0x7fef58009060).ready entity=mon.0 client_cookie=e4be694c0ef010bd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:00.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef5ffff700 1 -- 172.21.15.153:0/3972488820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800f510 con 0x7fef68068820 2023-08-17T00:03:00.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef5ffff700 1 -- 172.21.15.153:0/3972488820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800f670 con 0x7fef68068820 2023-08-17T00:03:00.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef5ffff700 1 -- 172.21.15.153:0/3972488820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800f9f0 con 0x7fef68068820 2023-08-17T00:03:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3972488820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef68068820 msgr2=0x7fef68068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3972488820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef68068820 0x7fef68068c80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fef58009760 tx=0x7fef58009060).stop 2023-08-17T00:03:00.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3972488820 shutdown_connections 2023-08-17T00:03:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3972488820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3972488820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef68068820 0x7fef68068c80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3972488820 >> 172.21.15.153:0/3972488820 conn(0x7fef680c6620 msgr2=0x7fef680c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3972488820 shutdown_connections 2023-08-17T00:03:00.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.742+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3972488820 wait complete. 2023-08-17T00:03:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 Processor -- start 2023-08-17T00:03:00.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 -- start start 2023-08-17T00:03:00.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef68068820 0x7fef6815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 0x7fef68157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6815d060 con 0x7fef680a8df0 2023-08-17T00:03:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6815c170 con 0x7fef68068820 2023-08-17T00:03:00.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6e6b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6815c450 con 0x7fef680a96d0 2023-08-17T00:03:00.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6ceb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 0x7fef68157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6deb8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6ceb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 0x7fef68157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56076/0 (socket says 172.21.15.153:56076) 2023-08-17T00:03:00.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.746+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3618517452 learned_addr learned my addr 172.21.15.153:0/3618517452 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:00.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6d6b7700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef68068820 0x7fef6815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 msgr2=0x7fef680bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6ceb6700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef68068820 msgr2=0x7fef6815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6ceb6700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef68068820 0x7fef6815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6ceb6700 1 -- 172.21.15.153:0/3618517452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef60009a20 con 0x7fef680a8df0 2023-08-17T00:03:00.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6ceb6700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 0x7fef68157a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef680668e0 tx=0x7fef58017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:00.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5800f7e0 con 0x7fef680a8df0 2023-08-17T00:03:00.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5800f940 con 0x7fef680a8df0 2023-08-17T00:03:00.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5801b660 con 0x7fef680a8df0 2023-08-17T00:03:00.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef580092a0 con 0x7fef680a8df0 2023-08-17T00:03:00.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6815ca10 con 0x7fef680a8df0 2023-08-17T00:03:00.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.750+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6806b4c0 con 0x7fef680a8df0 2023-08-17T00:03:00.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.754+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fef5802b070 con 0x7fef680a8df0 2023-08-17T00:03:00.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.754+0000 7fef5d7fa700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef4c05a150 0x7fef4c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:00.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.754+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fef58075900 con 0x7fef680a8df0 2023-08-17T00:03:00.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.754+0000 7fef6d6b7700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef4c05a150 0x7fef4c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:00.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.754+0000 7fef6d6b7700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef4c05a150 0x7fef4c05c610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fef64001360 tx=0x7fef64009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:00.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.758+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef580492a0 con 0x7fef680a8df0 2023-08-17T00:03:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.922+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fef6815cdb0 con 0x7fef680a8df0 2023-08-17T00:03:00.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.922+0000 7fef5d7fa700 1 -- 172.21.15.153:0/3618517452 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef58029090 con 0x7fef680a8df0 2023-08-17T00:03:00.926 INFO:teuthology.orchestra.run.smithi153.stdout:60129542148 2023-08-17T00:03:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.922+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef4c05a150 msgr2=0x7fef4c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.922+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef4c05a150 0x7fef4c05c610 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fef64001360 tx=0x7fef64009040).stop 2023-08-17T00:03:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.922+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 msgr2=0x7fef68157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.922+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 0x7fef68157a30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fef680668e0 tx=0x7fef58017000).stop 2023-08-17T00:03:00.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 shutdown_connections 2023-08-17T00:03:00.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef4c05a150 0x7fef4c05c610 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef680a96d0 0x7fef680bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef680a8df0 0x7fef68157a30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 --2- 172.21.15.153:0/3618517452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef68068820 0x7fef6815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:00.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 >> 172.21.15.153:0/3618517452 conn(0x7fef680c6620 msgr2=0x7fef680bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:00.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 shutdown_connections 2023-08-17T00:03:00.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:00.926+0000 7fef6e6b9700 1 -- 172.21.15.153:0/3618517452 wait complete. 2023-08-17T00:03:00.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.3 2023-08-17T00:03:00.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-17T00:03:01.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 Processor -- start 2023-08-17T00:03:01.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 -- start start 2023-08-17T00:03:01.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4cdc0689c0 0x7f4cdc068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4cdc151530 0x7f4cdc1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc065da0 con 0x7f4cdc1560f0 2023-08-17T00:03:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc155c60 con 0x7f4cdc151530 2023-08-17T00:03:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4ce0b07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cdc156550 con 0x7f4cdc0689c0 2023-08-17T00:03:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4cdc151530 0x7f4cdc1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4cdc151530 0x7f4cdc1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56082/0 (socket says 172.21.15.153:56082) 2023-08-17T00:03:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 -- 172.21.15.153:0/1436748508 learned_addr learned my addr 172.21.15.153:0/1436748508 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdb7fe700 1 --2- 172.21.15.153:0/1436748508 >> v2:172.21.15.178:3300/0 conn(0x7f4cdc0689c0 0x7f4cdc068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 -- 172.21.15.153:0/1436748508 >> v2:172.21.15.178:3300/0 conn(0x7f4cdc0689c0 msgr2=0x7f4cdc068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 --2- 172.21.15.153:0/1436748508 >> v2:172.21.15.178:3300/0 conn(0x7f4cdc0689c0 0x7f4cdc068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 -- 172.21.15.153:0/1436748508 >> v1:172.21.15.178:6789/0 conn(0x7f4cdc1560f0 legacy=0x7f4cdc0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.102+0000 7f4cdbfff700 1 -- 172.21.15.153:0/1436748508 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc065ff0 con 0x7f4cdc151530 2023-08-17T00:03:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4cdbfff700 1 --2- 172.21.15.153:0/1436748508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc151530 0x7f4cdc1519c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f4cdc0c2d60 tx=0x7f4cd4009840).ready entity=mon.0 client_cookie=5d743da4ff26a727 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4cdaffd700 1 -- 172.21.15.153:0/1436748508 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400e070 con 0x7f4cdc151530 2023-08-17T00:03:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4cdaffd700 1 -- 172.21.15.153:0/1436748508 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400ba20 con 0x7f4cdc151530 2023-08-17T00:03:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4cdaffd700 1 -- 172.21.15.153:0/1436748508 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd400bda0 con 0x7f4cdc151530 2023-08-17T00:03:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1436748508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc151530 msgr2=0x7f4cdc1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1436748508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc151530 0x7f4cdc1519c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f4cdc0c2d60 tx=0x7f4cd4009840).stop 2023-08-17T00:03:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1436748508 shutdown_connections 2023-08-17T00:03:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1436748508 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc151530 0x7f4cdc1519c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1436748508 >> v2:172.21.15.178:3300/0 conn(0x7f4cdc0689c0 0x7f4cdc068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1436748508 >> 172.21.15.153:0/1436748508 conn(0x7f4cdc0c6620 msgr2=0x7f4cdc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1436748508 shutdown_connections 2023-08-17T00:03:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.106+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1436748508 wait complete. 2023-08-17T00:03:01.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 Processor -- start 2023-08-17T00:03:01.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 -- start start 2023-08-17T00:03:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 0x7f4cdc0a0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cdc151530 0x7f4cdc0a65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cdc1560f0 0x7f4cdc161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0a6ad0 con 0x7f4cdc0689c0 2023-08-17T00:03:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0a6d90 con 0x7f4cdc1560f0 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.110+0000 7f4ce0b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0a7070 con 0x7f4cdc151530 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 0x7f4cdc0a0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 0x7f4cdc0a0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56088/0 (socket says 172.21.15.153:56088) 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 -- 172.21.15.153:0/1550695300 learned_addr learned my addr 172.21.15.153:0/1550695300 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cd2ffd700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cdc151530 0x7f4cdc0a65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdbfff700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cdc1560f0 0x7f4cdc161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 -- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cdc151530 msgr2=0x7f4cdc0a65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cdc151530 0x7f4cdc0a65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 -- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cdc1560f0 msgr2=0x7f4cdc161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cdc1560f0 0x7f4cdc161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 -- 172.21.15.153:0/1550695300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009ae0 con 0x7f4cdc0689c0 2023-08-17T00:03:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdbfff700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cdc1560f0 0x7f4cdc161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cdb7fe700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 0x7f4cdc0a0160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4ccc00e8d0 tx=0x7f4ccc006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00c640 con 0x7f4cdc0689c0 2023-08-17T00:03:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc00c7a0 con 0x7f4cdc0689c0 2023-08-17T00:03:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc0a7350 con 0x7f4cdc0689c0 2023-08-17T00:03:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc00cb20 con 0x7f4cdc0689c0 2023-08-17T00:03:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc0a7910 con 0x7f4cdc0689c0 2023-08-17T00:03:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.114+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc06b4c0 con 0x7f4cdc0689c0 2023-08-17T00:03:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.118+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4ccc022070 con 0x7f4cdc0689c0 2023-08-17T00:03:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.118+0000 7f4cd3fff700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cbc05a180 0x7f4cbc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.118+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4ccc0744c0 con 0x7f4cdc0689c0 2023-08-17T00:03:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.118+0000 7f4cd2ffd700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cbc05a180 0x7f4cbc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.118+0000 7f4cd2ffd700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cbc05a180 0x7f4cbc05c640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4cdc0a11b0 tx=0x7f4cc4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.126+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ccc047f70 con 0x7f4cdc0689c0 2023-08-17T00:03:01.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.286+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4cdc0bd130 con 0x7f4cdc0689c0 2023-08-17T00:03:01.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4cd3fff700 1 -- 172.21.15.153:0/1550695300 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ccc04be60 con 0x7f4cdc0689c0 2023-08-17T00:03:01.293 INFO:teuthology.orchestra.run.smithi153.stdout:55834574854 2023-08-17T00:03:01.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cbc05a180 msgr2=0x7f4cbc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cbc05a180 0x7f4cbc05c640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4cdc0a11b0 tx=0x7f4cc4009040).stop 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 msgr2=0x7f4cdc0a0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 0x7f4cdc0a0160 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f4ccc00e8d0 tx=0x7f4ccc006f40).stop 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 shutdown_connections 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cbc05a180 0x7f4cbc05c640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4cdc1560f0 0x7f4cdc161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4cdc151530 0x7f4cdc0a65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 --2- 172.21.15.153:0/1550695300 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4cdc0689c0 0x7f4cdc0a0160 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 >> 172.21.15.153:0/1550695300 conn(0x7f4cdc0c6620 msgr2=0x7f4cdc0a8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:01.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 shutdown_connections 2023-08-17T00:03:01.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.290+0000 7f4ce0b07700 1 -- 172.21.15.153:0/1550695300 wait complete. 2023-08-17T00:03:01.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-08-17T00:03:01.315 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-17T00:03:01.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 Processor -- start 2023-08-17T00:03:01.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 -- start start 2023-08-17T00:03:01.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151b90 0x7f3fec151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fec064870 0x7f3fec064d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec065210 con 0x7f3fec063290 2023-08-17T00:03:01.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0c3fb0 con 0x7f3fec064870 2023-08-17T00:03:01.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.466+0000 7f3ff349b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec152460 con 0x7f3fec151b90 2023-08-17T00:03:01.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fec064870 0x7f3fec064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fec064870 0x7f3fec064d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56090/0 (socket says 172.21.15.153:56090) 2023-08-17T00:03:01.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 -- 172.21.15.153:0/3125801676 learned_addr learned my addr 172.21.15.153:0/3125801676 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:01.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff0a36700 1 --1- 172.21.15.153:0/3125801676 >> v1:172.21.15.178:6789/0 conn(0x7f3fec063290 0x7f3fec065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55756/0 (socket says 172.21.15.153:55756) 2023-08-17T00:03:01.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1237700 1 --2- 172.21.15.153:0/3125801676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151b90 0x7f3fec151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 -- 172.21.15.153:0/3125801676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151b90 msgr2=0x7f3fec151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:01.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 --2- 172.21.15.153:0/3125801676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151b90 0x7f3fec151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 -- 172.21.15.153:0/3125801676 >> v1:172.21.15.178:6789/0 conn(0x7f3fec063290 legacy=0x7f3fec065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 -- 172.21.15.153:0/3125801676 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec061fa0 con 0x7f3fec064870 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3fe3fff700 1 -- 172.21.15.153:0/3125801676 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341280094 0 0) 0x7f3fdc001110 con 0x7f3fec063290 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff1a38700 1 --2- 172.21.15.153:0/3125801676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec064870 0x7f3fec064d20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3fe4009f20 tx=0x7f3fe4009840).ready entity=mon.0 client_cookie=109fd2e5971eb98b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3fe3fff700 1 -- 172.21.15.153:0/3125801676 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400e070 con 0x7f3fec064870 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3fe3fff700 1 -- 172.21.15.153:0/3125801676 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400b9d0 con 0x7f3fec064870 2023-08-17T00:03:01.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3fe3fff700 1 -- 172.21.15.153:0/3125801676 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400bd50 con 0x7f3fec064870 2023-08-17T00:03:01.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff349b700 1 -- 172.21.15.153:0/3125801676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec064870 msgr2=0x7f3fec064d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff349b700 1 --2- 172.21.15.153:0/3125801676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec064870 0x7f3fec064d20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f3fe4009f20 tx=0x7f3fe4009840).stop 2023-08-17T00:03:01.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff349b700 1 -- 172.21.15.153:0/3125801676 shutdown_connections 2023-08-17T00:03:01.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff349b700 1 --2- 172.21.15.153:0/3125801676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec064870 0x7f3fec064d20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff349b700 1 --2- 172.21.15.153:0/3125801676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151b90 0x7f3fec151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.470+0000 7f3ff349b700 1 -- 172.21.15.153:0/3125801676 >> 172.21.15.153:0/3125801676 conn(0x7f3fec0c7150 msgr2=0x7f3fec0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:01.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.474+0000 7f3ff349b700 1 -- 172.21.15.153:0/3125801676 shutdown_connections 2023-08-17T00:03:01.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.474+0000 7f3ff349b700 1 -- 172.21.15.153:0/3125801676 wait complete. 2023-08-17T00:03:01.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.474+0000 7f3ff349b700 1 Processor -- start 2023-08-17T00:03:01.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.474+0000 7f3ff349b700 1 -- start start 2023-08-17T00:03:01.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec063290 0x7f3fec1483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec064870 0x7f3fec149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 0x7f3fec14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec14a590 con 0x7f3fec151b90 2023-08-17T00:03:01.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0aa310 con 0x7f3fec063290 2023-08-17T00:03:01.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec14ca00 con 0x7f3fec064870 2023-08-17T00:03:01.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 0x7f3fec14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 0x7f3fec14a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56094/0 (socket says 172.21.15.153:56094) 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 -- 172.21.15.153:0/4199837303 learned_addr learned my addr 172.21.15.153:0/4199837303 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff0a36700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec064870 0x7f3fec149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1237700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec063290 0x7f3fec1483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 -- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec064870 msgr2=0x7f3fec149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec064870 0x7f3fec149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 -- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec063290 msgr2=0x7f3fec1483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec063290 0x7f3fec1483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 -- 172.21.15.153:0/4199837303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009ae0 con 0x7f3fec151b90 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff0a36700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec064870 0x7f3fec149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1237700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec063290 0x7f3fec1483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff1a38700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 0x7f3fec14a0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3fe400be70 tx=0x7f3fe4009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400b640 con 0x7f3fec151b90 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe401e470 con 0x7f3fec151b90 2023-08-17T00:03:01.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec14cce0 con 0x7f3fec151b90 2023-08-17T00:03:01.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe401e810 con 0x7f3fec151b90 2023-08-17T00:03:01.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.478+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec1654f0 con 0x7f3fec151b90 2023-08-17T00:03:01.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.482+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec06b530 con 0x7f3fec151b90 2023-08-17T00:03:01.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.482+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3fe4025030 con 0x7f3fec151b90 2023-08-17T00:03:01.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.482+0000 7f3fe17fa700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fd005a150 0x7f3fd005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.482+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3fe40757d0 con 0x7f3fec151b90 2023-08-17T00:03:01.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.482+0000 7f3ff1237700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fd005a150 0x7f3fd005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.486+0000 7f3ff1237700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fd005a150 0x7f3fd005c610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3fe8006d80 tx=0x7f3fe8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.490+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fe4049280 con 0x7f3fec151b90 2023-08-17T00:03:01.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.650+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3fec0621f0 con 0x7f3fec151b90 2023-08-17T00:03:01.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.650+0000 7f3fe17fa700 1 -- 172.21.15.153:0/4199837303 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3fe4023070 con 0x7f3fec151b90 2023-08-17T00:03:01.655 INFO:teuthology.orchestra.run.smithi153.stdout:60129542150 2023-08-17T00:03:01.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fd005a150 msgr2=0x7f3fd005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fd005a150 0x7f3fd005c610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f3fe8006d80 tx=0x7f3fe8008040).stop 2023-08-17T00:03:01.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 msgr2=0x7f3fec14a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 0x7f3fec14a0a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f3fe400be70 tx=0x7f3fe4009840).stop 2023-08-17T00:03:01.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 shutdown_connections 2023-08-17T00:03:01.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fd005a150 0x7f3fd005c610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151b90 0x7f3fec14a0a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec064870 0x7f3fec149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 --2- 172.21.15.153:0/4199837303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec063290 0x7f3fec1483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 >> 172.21.15.153:0/4199837303 conn(0x7f3fec0c7150 msgr2=0x7f3fec149330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:01.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 shutdown_connections 2023-08-17T00:03:01.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.654+0000 7f3ff349b700 1 -- 172.21.15.153:0/4199837303 wait complete. 2023-08-17T00:03:01.678 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542150 for osd.5 2023-08-17T00:03:01.678 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-17T00:03:01.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.834+0000 7f667f969700 1 Processor -- start 2023-08-17T00:03:01.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.834+0000 7f667f969700 1 -- start start 2023-08-17T00:03:01.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.834+0000 7f667f969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66780c7450 0x7f66780c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.834+0000 7f667f969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66780aa680 con 0x7f667814def0 2023-08-17T00:03:01.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667f969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66780c6110 con 0x7f66780c59c0 2023-08-17T00:03:01.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667f969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6678158850 con 0x7f66780c7450 2023-08-17T00:03:01.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f66780c59c0 0x7f6678154c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55766/0 (socket says 172.21.15.153:55766) 2023-08-17T00:03:01.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667d705700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f667814def0 0x7f667814e2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35730/0 (socket says 172.21.15.153:35730) 2023-08-17T00:03:01.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 -- 172.21.15.153:0/504261725 learned_addr learned my addr 172.21.15.153:0/504261725 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:01.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667df06700 1 --2- 172.21.15.153:0/504261725 >> v2:172.21.15.178:3300/0 conn(0x7f66780c7450 0x7f66780c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012658367 0 0) 0x7f66780c6110 con 0x7f66780c59c0 2023-08-17T00:03:01.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66640033f0 con 0x7f66780c59c0 2023-08-17T00:03:01.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844787349 0 0) 0x7f66780aa680 con 0x7f667814def0 2023-08-17T00:03:01.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66780c6110 con 0x7f667814def0 2023-08-17T00:03:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1251879872 0 0) 0x7f66780c6110 con 0x7f667814def0 2023-08-17T00:03:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 >> v2:172.21.15.178:3300/0 conn(0x7f66780c7450 msgr2=0x7f66780c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 --2- 172.21.15.153:0/504261725 >> v2:172.21.15.178:3300/0 conn(0x7f66780c7450 0x7f66780c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 >> v1:172.21.15.178:6789/0 conn(0x7f66780c59c0 legacy=0x7f6678154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780c5e70 con 0x7f667814def0 2023-08-17T00:03:01.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f6674001470 con 0x7f667814def0 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 >> v1:172.21.15.153:6789/0 conn(0x7f667814def0 legacy=0x7f667814e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664003aa0 0x7f6664003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6664004690 0x7f6664004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6664005000 0x7f666400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6668001230 con 0x7f6664004690 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6678158850 con 0x7f6664003aa0 2023-08-17T00:03:01.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666400bf60 con 0x7f6664005000 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6664004690 0x7f6664004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667d705700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664003aa0 0x7f6664003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 -- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6664005000 msgr2=0x7f666400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6664005000 0x7f666400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 -- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664003aa0 msgr2=0x7f6664003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664003aa0 0x7f6664003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 -- 172.21.15.153:0/504261725 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780c6110 con 0x7f6664004690 2023-08-17T00:03:01.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667d705700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664003aa0 0x7f6664003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:01.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667df06700 1 -- 172.21.15.153:0/504261725 reap_dead start 2023-08-17T00:03:01.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.838+0000 7f667cf04700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6664004690 0x7f6664004b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6668007fd0 tx=0x7f6668001d20).ready entity=mon.0 client_cookie=cfcc31960e697cff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007890 con 0x7f6664004690 2023-08-17T00:03:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6668007170 con 0x7f6664004690 2023-08-17T00:03:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f666ffff700 1 -- 172.21.15.153:0/504261725 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668007530 con 0x7f6664004690 2023-08-17T00:03:01.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 -- 172.21.15.153:0/504261725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6664004690 msgr2=0x7f6664004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6664004690 0x7f6664004b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6668007fd0 tx=0x7f6668001d20).stop 2023-08-17T00:03:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 -- 172.21.15.153:0/504261725 shutdown_connections 2023-08-17T00:03:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 --2- 172.21.15.153:0/504261725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6664004690 0x7f6664004b10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 -- 172.21.15.153:0/504261725 >> 172.21.15.153:0/504261725 conn(0x7f6678061fa0 msgr2=0x7f66780623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 -- 172.21.15.153:0/504261725 shutdown_connections 2023-08-17T00:03:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.842+0000 7f667f969700 1 -- 172.21.15.153:0/504261725 wait complete. 2023-08-17T00:03:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 Processor -- start 2023-08-17T00:03:01.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 -- start start 2023-08-17T00:03:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664004690 0x7f66780c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66780c4660 0x7f6678063590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 0x7f66781394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6678156100 con 0x7f6678063a80 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6678063f00 con 0x7f6664004690 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667f969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66780c30d0 con 0x7f66780c4660 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 0x7f66781394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 0x7f66781394b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56108/0 (socket says 172.21.15.153:56108) 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667df06700 1 -- 172.21.15.153:0/3078724737 learned_addr learned my addr 172.21.15.153:0/3078724737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:01.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667d705700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664004690 0x7f66780c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.846+0000 7f667cf04700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66780c4660 0x7f6678063590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667df06700 1 -- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66780c4660 msgr2=0x7f6678063590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667df06700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66780c4660 0x7f6678063590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667df06700 1 -- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664004690 msgr2=0x7f66780c4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667df06700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664004690 0x7f66780c4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667df06700 1 -- 172.21.15.153:0/3078724737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66780c33b0 con 0x7f6678063a80 2023-08-17T00:03:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667df06700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 0x7f66781394b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f66780caa30 tx=0x7f667000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6670009ac0 con 0x7f6678063a80 2023-08-17T00:03:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667000f040 con 0x7f6678063a80 2023-08-17T00:03:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667000c9e0 con 0x7f6678063a80 2023-08-17T00:03:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66780c3690 con 0x7f6678063a80 2023-08-17T00:03:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66780c3c50 con 0x7f6678063a80 2023-08-17T00:03:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667806b530 con 0x7f6678063a80 2023-08-17T00:03:01.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.850+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f667001d460 con 0x7f6678063a80 2023-08-17T00:03:01.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.854+0000 7f666d7fa700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f665c05a150 0x7f665c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:01.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.854+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6670074620 con 0x7f6678063a80 2023-08-17T00:03:01.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.854+0000 7f667d705700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f665c05a150 0x7f665c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:01.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.854+0000 7f667d705700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f665c05a150 0x7f665c05c610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6674001ed0 tx=0x7f6674007040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:01.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:01.862+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f667004b990 con 0x7f6678063a80 2023-08-17T00:03:02.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.026+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6678157a90 con 0x7f6678063a80 2023-08-17T00:03:02.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.026+0000 7f666d7fa700 1 -- 172.21.15.153:0/3078724737 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f667004b580 con 0x7f6678063a80 2023-08-17T00:03:02.031 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2023-08-17T00:03:02.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f665c05a150 msgr2=0x7f665c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f665c05a150 0x7f665c05c610 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f6674001ed0 tx=0x7f6674007040).stop 2023-08-17T00:03:02.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 msgr2=0x7f66781394b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 0x7f66781394b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f66780caa30 tx=0x7f667000b040).stop 2023-08-17T00:03:02.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 shutdown_connections 2023-08-17T00:03:02.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f665c05a150 0x7f665c05c610 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6678063a80 0x7f66781394b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66780c4660 0x7f6678063590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 --2- 172.21.15.153:0/3078724737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6664004690 0x7f66780c4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 >> 172.21.15.153:0/3078724737 conn(0x7f6678061fa0 msgr2=0x7f667814e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:02.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 shutdown_connections 2023-08-17T00:03:02.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.030+0000 7f667f969700 1 -- 172.21.15.153:0/3078724737 wait complete. 2023-08-17T00:03:02.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542149 for osd.6 2023-08-17T00:03:02.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-17T00:03:02.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.214+0000 7f26f585b700 1 Processor -- start 2023-08-17T00:03:02.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.214+0000 7f26f585b700 1 -- start start 2023-08-17T00:03:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26f585b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26f0153bb0 0x7f26f0066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26f585b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f26f0063fd0 0x7f26f0066e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26f585b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f00c6150 con 0x7f26f0153f90 2023-08-17T00:03:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26f585b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f00c3330 con 0x7f26f0153bb0 2023-08-17T00:03:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26f585b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f0064d40 con 0x7f26f0063fd0 2023-08-17T00:03:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ef7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f26f0153f90 0x7f26f00bd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35736/0 (socket says 172.21.15.153:35736) 2023-08-17T00:03:02.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ef7fe700 1 -- 172.21.15.153:0/3801846475 learned_addr learned my addr 172.21.15.153:0/3801846475 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:02.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26eeffd700 1 --2- 172.21.15.153:0/3801846475 >> v2:172.21.15.153:3300/0 conn(0x7f26f0153bb0 0x7f26f0066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26e7fff700 1 --2- 172.21.15.153:0/3801846475 >> v2:172.21.15.178:3300/0 conn(0x7f26f0063fd0 0x7f26f0066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ee7fc700 1 -- 172.21.15.153:0/3801846475 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837162841 0 0) 0x7f26f00c6150 con 0x7f26f0153f90 2023-08-17T00:03:02.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ee7fc700 1 -- 172.21.15.153:0/3801846475 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26dc0033f0 con 0x7f26f0153f90 2023-08-17T00:03:02.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26eeffd700 1 -- 172.21.15.153:0/3801846475 >> v2:172.21.15.178:3300/0 conn(0x7f26f0063fd0 msgr2=0x7f26f0066e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:02.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26eeffd700 1 --2- 172.21.15.153:0/3801846475 >> v2:172.21.15.178:3300/0 conn(0x7f26f0063fd0 0x7f26f0066e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26eeffd700 1 -- 172.21.15.153:0/3801846475 >> v1:172.21.15.153:6789/0 conn(0x7f26f0153f90 legacy=0x7f26f00bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26eeffd700 1 -- 172.21.15.153:0/3801846475 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f00644a0 con 0x7f26f0153bb0 2023-08-17T00:03:02.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26eeffd700 1 --2- 172.21.15.153:0/3801846475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153bb0 0x7f26f0066990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f26f00aea10 tx=0x7f26e0009060).ready entity=mon.0 client_cookie=a28392484de5d4b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:02.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ee7fc700 1 -- 172.21.15.153:0/3801846475 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000d4a0 con 0x7f26f0153bb0 2023-08-17T00:03:02.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ee7fc700 1 -- 172.21.15.153:0/3801846475 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e000d600 con 0x7f26f0153bb0 2023-08-17T00:03:02.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.218+0000 7f26ee7fc700 1 -- 172.21.15.153:0/3801846475 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e000d980 con 0x7f26f0153bb0 2023-08-17T00:03:02.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 -- 172.21.15.153:0/3801846475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153bb0 msgr2=0x7f26f0066990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 --2- 172.21.15.153:0/3801846475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153bb0 0x7f26f0066990 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f26f00aea10 tx=0x7f26e0009060).stop 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 -- 172.21.15.153:0/3801846475 shutdown_connections 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 --2- 172.21.15.153:0/3801846475 >> v2:172.21.15.178:3300/0 conn(0x7f26f0063fd0 0x7f26f0066e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 --2- 172.21.15.153:0/3801846475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153bb0 0x7f26f0066990 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 -- 172.21.15.153:0/3801846475 >> 172.21.15.153:0/3801846475 conn(0x7f26f00c92e0 msgr2=0x7f26f00c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 -- 172.21.15.153:0/3801846475 shutdown_connections 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 -- 172.21.15.153:0/3801846475 wait complete. 2023-08-17T00:03:02.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 Processor -- start 2023-08-17T00:03:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.222+0000 7f26f585b700 1 -- start start 2023-08-17T00:03:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26f0063fd0 0x7f26f0149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26f0153bb0 0x7f26f01674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 0x7f26f01679d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f00bf900 con 0x7f26f0153f90 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0167fa0 con 0x7f26f0063fd0 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f0168280 con 0x7f26f0153bb0 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 0x7f26f01679d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 0x7f26f01679d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56122/0 (socket says 172.21.15.153:56122) 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 -- 172.21.15.153:0/1312461415 learned_addr learned my addr 172.21.15.153:0/1312461415 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26e7fff700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26f0153bb0 0x7f26f01674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26eeffd700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26f0063fd0 0x7f26f0149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 -- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26f0153bb0 msgr2=0x7f26f01674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26f0153bb0 0x7f26f01674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 -- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26f0063fd0 msgr2=0x7f26f0149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26f0063fd0 0x7f26f0149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 -- 172.21.15.153:0/1312461415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e00092a0 con 0x7f26f0153f90 2023-08-17T00:03:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26ef7fe700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 0x7f26f01679d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f26e8005ad0 tx=0x7f26e80015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8005d30 con 0x7f26f0153f90 2023-08-17T00:03:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e8005e90 con 0x7f26f0153f90 2023-08-17T00:03:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e80072e0 con 0x7f26f0153f90 2023-08-17T00:03:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f00bfba0 con 0x7f26f0153f90 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.226+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f0149a60 con 0x7f26f0153f90 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.230+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f006b530 con 0x7f26f0153f90 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.230+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f26e8010070 con 0x7f26f0153f90 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.230+0000 7f26e6ffd700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26d005a180 0x7f26d005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.230+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f26e80738d0 con 0x7f26f0153f90 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.230+0000 7f26eeffd700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26d005a180 0x7f26d005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.230+0000 7f26eeffd700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26d005a180 0x7f26d005c640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f26e000d260 tx=0x7f26e0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:02.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.238+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f26e8047270 con 0x7f26f0153f90 2023-08-17T00:03:02.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f26f0064780 con 0x7f26f0153f90 2023-08-17T00:03:02.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26e6ffd700 1 -- 172.21.15.153:0/1312461415 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f26e8018020 con 0x7f26f0153f90 2023-08-17T00:03:02.402 INFO:teuthology.orchestra.run.smithi153.stdout:60129542149 2023-08-17T00:03:02.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26d005a180 msgr2=0x7f26d005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26d005a180 0x7f26d005c640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f26e000d260 tx=0x7f26e0016000).stop 2023-08-17T00:03:02.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 msgr2=0x7f26f01679d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 0x7f26f01679d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f26e8005ad0 tx=0x7f26e80015b0).stop 2023-08-17T00:03:02.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 shutdown_connections 2023-08-17T00:03:02.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26d005a180 0x7f26d005c640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26f0153f90 0x7f26f01679d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26f0153bb0 0x7f26f01674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 --2- 172.21.15.153:0/1312461415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26f0063fd0 0x7f26f0149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 >> 172.21.15.153:0/1312461415 conn(0x7f26f00c92e0 msgr2=0x7f26f0151c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:02.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.398+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 shutdown_connections 2023-08-17T00:03:02.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.402+0000 7f26f585b700 1 -- 172.21.15.153:0/1312461415 wait complete. 2023-08-17T00:03:02.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2023-08-17T00:03:02.426 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-17T00:03:02.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:03:02.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.578+0000 7f32c431b700 1 Processor -- start 2023-08-17T00:03:02.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.578+0000 7f32c431b700 1 -- start start 2023-08-17T00:03:02.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.578+0000 7f32c431b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f32bc0a8b70 0x7f32bc0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c431b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc065240 con 0x7f32bc0629b0 2023-08-17T00:03:02.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c431b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32bc062e40 con 0x7f32bc0a8f50 2023-08-17T00:03:02.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c431b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32bc0638a0 con 0x7f32bc0a8b70 2023-08-17T00:03:02.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c28b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f32bc0629b0 0x7f32bc0bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35740/0 (socket says 172.21.15.153:35740) 2023-08-17T00:03:02.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c28b8700 1 -- 172.21.15.153:0/178655258 learned_addr learned my addr 172.21.15.153:0/178655258 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:02.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 --2- 172.21.15.153:0/178655258 >> v2:172.21.15.178:3300/0 conn(0x7f32bc0a8b70 0x7f32bc0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162780481 0 0) 0x7f32bc065240 con 0x7f32bc0629b0 2023-08-17T00:03:02.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32a80033f0 con 0x7f32bc0629b0 2023-08-17T00:03:02.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627605214 0 0) 0x7f32bc062e40 con 0x7f32bc0a8f50 2023-08-17T00:03:02.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32bc065240 con 0x7f32bc0a8f50 2023-08-17T00:03:02.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574519583 0 0) 0x7f32a80033f0 con 0x7f32bc0629b0 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 >> v2:172.21.15.178:3300/0 conn(0x7f32bc0a8b70 msgr2=0x7f32bc0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 --2- 172.21.15.153:0/178655258 >> v2:172.21.15.178:3300/0 conn(0x7f32bc0a8b70 0x7f32bc0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 >> v1:172.21.15.178:6789/0 conn(0x7f32bc0a8f50 legacy=0x7f32bc0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc065de0 con 0x7f32bc0629b0 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f32b40017f0 con 0x7f32bc0629b0 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 >> v1:172.21.15.153:6789/0 conn(0x7f32bc0629b0 legacy=0x7f32bc0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a8003a70 0x7f32a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8004690 0x7f32a8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32a8005000 0x7f32a800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0638a0 con 0x7f32a8003a70 2023-08-17T00:03:02.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a800bf60 con 0x7f32a8005000 2023-08-17T00:03:02.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a800c0d0 con 0x7f32a8004690 2023-08-17T00:03:02.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a8003a70 0x7f32a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c28b8700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32a8005000 0x7f32a800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c18b6700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8004690 0x7f32a8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 -- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8004690 msgr2=0x7f32a8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:02.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8004690 0x7f32a8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 -- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32a8005000 msgr2=0x7f32a800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:02.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32a8005000 0x7f32a800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c20b7700 1 -- 172.21.15.153:0/178655258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80033f0 con 0x7f32a8003a70 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.582+0000 7f32c28b8700 1 -- 172.21.15.153:0/178655258 reap_dead start 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c20b7700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a8003a70 0x7f32a8003e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f32b8009a80 tx=0x7f32b8009060).ready entity=mon.0 client_cookie=ace5702ce2bc328c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8009430 con 0x7f32a8003a70 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b800e640 con 0x7f32a8003a70 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c10b5700 1 -- 172.21.15.153:0/178655258 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b800e9c0 con 0x7f32a8003a70 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 -- 172.21.15.153:0/178655258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a8003a70 msgr2=0x7f32a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a8003a70 0x7f32a8003e70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f32b8009a80 tx=0x7f32b8009060).stop 2023-08-17T00:03:02.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 -- 172.21.15.153:0/178655258 shutdown_connections 2023-08-17T00:03:02.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 --2- 172.21.15.153:0/178655258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32a8003a70 0x7f32a8003e70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 -- 172.21.15.153:0/178655258 >> 172.21.15.153:0/178655258 conn(0x7f32bc0c7150 msgr2=0x7f32bc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:02.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 -- 172.21.15.153:0/178655258 shutdown_connections 2023-08-17T00:03:02.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 -- 172.21.15.153:0/178655258 wait complete. 2023-08-17T00:03:02.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 Processor -- start 2023-08-17T00:03:02.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.586+0000 7f32c431b700 1 -- start start 2023-08-17T00:03:02.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8003a70 0x7f32bc145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 0x7f32bc16c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32bc16c610 0x7f32bc156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc16ca90 con 0x7f32bc168b60 2023-08-17T00:03:02.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc15a3d0 con 0x7f32bc16c610 2023-08-17T00:03:02.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32bc0a9930 con 0x7f32a8003a70 2023-08-17T00:03:02.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 0x7f32bc16c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 0x7f32bc16c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56136/0 (socket says 172.21.15.153:56136) 2023-08-17T00:03:02.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 -- 172.21.15.153:0/1266977042 learned_addr learned my addr 172.21.15.153:0/1266977042 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:02.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c20b7700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8003a70 0x7f32bc145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c28b8700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32bc16c610 0x7f32bc156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 -- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8003a70 msgr2=0x7f32bc145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8003a70 0x7f32bc145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 -- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32bc16c610 msgr2=0x7f32bc156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32bc16c610 0x7f32bc156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 -- 172.21.15.153:0/1266977042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc16cc70 con 0x7f32bc168b60 2023-08-17T00:03:02.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c28b8700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32bc16c610 0x7f32bc156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:02.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c18b6700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 0x7f32bc16c120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f32ac00e610 tx=0x7f32ac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:02.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac001570 con 0x7f32bc168b60 2023-08-17T00:03:02.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ac0016d0 con 0x7f32bc168b60 2023-08-17T00:03:02.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32bc16cf50 con 0x7f32bc168b60 2023-08-17T00:03:02.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ac001a50 con 0x7f32bc168b60 2023-08-17T00:03:02.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32bc15a060 con 0x7f32bc168b60 2023-08-17T00:03:02.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.590+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32bc06b530 con 0x7f32bc168b60 2023-08-17T00:03:02.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.594+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f32ac014430 con 0x7f32bc168b60 2023-08-17T00:03:02.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.594+0000 7f32b27fc700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f32a005a150 0x7f32a005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:02.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.594+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f32ac073fe0 con 0x7f32bc168b60 2023-08-17T00:03:02.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.594+0000 7f32c20b7700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f32a005a150 0x7f32a005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:02.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.598+0000 7f32c20b7700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f32a005a150 0x7f32a005c610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f32b8006d50 tx=0x7f32b801a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:02.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.598+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f32ac0a28f0 con 0x7f32bc168b60 2023-08-17T00:03:02.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.754+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32bc064910 con 0x7f32a005a150 2023-08-17T00:03:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.770+0000 7f32b27fc700 1 -- 172.21.15.153:0/1266977042 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336170 (secure 0 0 0) 0x7f32bc064910 con 0x7f32a005a150 2023-08-17T00:03:02.786 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:02.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f32a005a150 msgr2=0x7f32a005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f32a005a150 0x7f32a005c610 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f32b8006d50 tx=0x7f32b801a000).stop 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 msgr2=0x7f32bc16c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 0x7f32bc16c120 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f32ac00e610 tx=0x7f32ac009040).stop 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 shutdown_connections 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f32a005a150 0x7f32a005c610 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32bc16c610 0x7f32bc156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32bc168b60 0x7f32bc16c120 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 --2- 172.21.15.153:0/1266977042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32a8003a70 0x7f32bc145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:02.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 >> 172.21.15.153:0/1266977042 conn(0x7f32bc0c7150 msgr2=0x7f32bc0c2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:02.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 shutdown_connections 2023-08-17T00:03:02.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.778+0000 7f32c431b700 1 -- 172.21.15.153:0/1266977042 wait complete. 2023-08-17T00:03:02.790 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:03:02.805 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-08-17T00:03:01.169415+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":669868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002637"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.794978+0000","last_change":"2023-08-17T00:02:51.792258+0000","last_active":"2023-08-17T00:02:51.794978+0000","last_peered":"2023-08-17T00:02:51.794978+0000","last_clean":"2023-08-17T00:02:51.794978+0000","last_became_active":"2023-08-17T00:02:51.791987+0000","last_became_peered":"2023-08-17T00:02:51.791987+0000","last_unstale":"2023-08-17T00:02:51.794978+0000","last_undegraded":"2023-08-17T00:02:51.794978+0000","last_fullsized":"2023-08-17T00:02:51.794978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774573+0000","last_change":"2023-08-17T00:02:51.339335+0000","last_active":"2023-08-17T00:02:51.774573+0000","last_peered":"2023-08-17T00:02:51.774573+0000","last_clean":"2023-08-17T00:02:51.774573+0000","last_became_active":"2023-08-17T00:02:51.338962+0000","last_became_peered":"2023-08-17T00:02:51.338962+0000","last_unstale":"2023-08-17T00:02:51.774573+0000","last_undegraded":"2023-08-17T00:02:51.774573+0000","last_fullsized":"2023-08-17T00:02:51.774573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802676+0000","last_change":"2023-08-17T00:02:51.791169+0000","last_active":"2023-08-17T00:02:51.802676+0000","last_peered":"2023-08-17T00:02:51.802676+0000","last_clean":"2023-08-17T00:02:51.802676+0000","last_became_active":"2023-08-17T00:02:51.790753+0000","last_became_peered":"2023-08-17T00:02:51.790753+0000","last_unstale":"2023-08-17T00:02:51.802676+0000","last_undegraded":"2023-08-17T00:02:51.802676+0000","last_fullsized":"2023-08-17T00:02:51.802676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802597+0000","last_change":"2023-08-17T00:02:51.349913+0000","last_active":"2023-08-17T00:02:51.802597+0000","last_peered":"2023-08-17T00:02:51.802597+0000","last_clean":"2023-08-17T00:02:51.802597+0000","last_became_active":"2023-08-17T00:02:51.349595+0000","last_became_peered":"2023-08-17T00:02:51.349595+0000","last_unstale":"2023-08-17T00:02:51.802597+0000","last_undegraded":"2023-08-17T00:02:51.802597+0000","last_fullsized":"2023-08-17T00:02:51.802597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770825+0000","last_change":"2023-08-17T00:02:51.342535+0000","last_active":"2023-08-17T00:02:51.770825+0000","last_peered":"2023-08-17T00:02:51.770825+0000","last_clean":"2023-08-17T00:02:51.770825+0000","last_became_active":"2023-08-17T00:02:51.342270+0000","last_became_peered":"2023-08-17T00:02:51.342270+0000","last_unstale":"2023-08-17T00:02:51.770825+0000","last_undegraded":"2023-08-17T00:02:51.770825+0000","last_fullsized":"2023-08-17T00:02:51.770825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802817+0000","last_change":"2023-08-17T00:02:51.794750+0000","last_active":"2023-08-17T00:02:51.802817+0000","last_peered":"2023-08-17T00:02:51.802817+0000","last_clean":"2023-08-17T00:02:51.802817+0000","last_became_active":"2023-08-17T00:02:51.794394+0000","last_became_peered":"2023-08-17T00:02:51.794394+0000","last_unstale":"2023-08-17T00:02:51.802817+0000","last_undegraded":"2023-08-17T00:02:51.802817+0000","last_fullsized":"2023-08-17T00:02:51.802817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.786225+0000","last_change":"2023-08-17T00:02:51.360726+0000","last_active":"2023-08-17T00:02:51.786225+0000","last_peered":"2023-08-17T00:02:51.786225+0000","last_clean":"2023-08-17T00:02:51.786225+0000","last_became_active":"2023-08-17T00:02:51.360479+0000","last_became_peered":"2023-08-17T00:02:51.360479+0000","last_unstale":"2023-08-17T00:02:51.786225+0000","last_undegraded":"2023-08-17T00:02:51.786225+0000","last_fullsized":"2023-08-17T00:02:51.786225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800703+0000","last_change":"2023-08-17T00:02:51.787355+0000","last_active":"2023-08-17T00:02:51.800703+0000","last_peered":"2023-08-17T00:02:51.800703+0000","last_clean":"2023-08-17T00:02:51.800703+0000","last_became_active":"2023-08-17T00:02:51.787048+0000","last_became_peered":"2023-08-17T00:02:51.787048+0000","last_unstale":"2023-08-17T00:02:51.800703+0000","last_undegraded":"2023-08-17T00:02:51.800703+0000","last_fullsized":"2023-08-17T00:02:51.800703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803300+0000","last_change":"2023-08-17T00:02:51.338960+0000","last_active":"2023-08-17T00:02:51.803300+0000","last_peered":"2023-08-17T00:02:51.803300+0000","last_clean":"2023-08-17T00:02:51.803300+0000","last_became_active":"2023-08-17T00:02:51.338664+0000","last_became_peered":"2023-08-17T00:02:51.338664+0000","last_unstale":"2023-08-17T00:02:51.803300+0000","last_undegraded":"2023-08-17T00:02:51.803300+0000","last_fullsized":"2023-08-17T00:02:51.803300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802710+0000","last_change":"2023-08-17T00:02:51.799132+0000","last_active":"2023-08-17T00:02:51.802710+0000","last_peered":"2023-08-17T00:02:51.802710+0000","last_clean":"2023-08-17T00:02:51.802710+0000","last_became_active":"2023-08-17T00:02:51.798805+0000","last_became_peered":"2023-08-17T00:02:51.798805+0000","last_unstale":"2023-08-17T00:02:51.802710+0000","last_undegraded":"2023-08-17T00:02:51.802710+0000","last_fullsized":"2023-08-17T00:02:51.802710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775014+0000","last_change":"2023-08-17T00:02:51.346796+0000","last_active":"2023-08-17T00:02:51.775014+0000","last_peered":"2023-08-17T00:02:51.775014+0000","last_clean":"2023-08-17T00:02:51.775014+0000","last_became_active":"2023-08-17T00:02:51.346406+0000","last_became_peered":"2023-08-17T00:02:51.346406+0000","last_unstale":"2023-08-17T00:02:51.775014+0000","last_undegraded":"2023-08-17T00:02:51.775014+0000","last_fullsized":"2023-08-17T00:02:51.775014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803115+0000","last_change":"2023-08-17T00:02:51.799601+0000","last_active":"2023-08-17T00:02:51.803115+0000","last_peered":"2023-08-17T00:02:51.803115+0000","last_clean":"2023-08-17T00:02:51.803115+0000","last_became_active":"2023-08-17T00:02:51.795434+0000","last_became_peered":"2023-08-17T00:02:51.795434+0000","last_unstale":"2023-08-17T00:02:51.803115+0000","last_undegraded":"2023-08-17T00:02:51.803115+0000","last_fullsized":"2023-08-17T00:02:51.803115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799219+0000","last_change":"2023-08-17T00:02:51.349039+0000","last_active":"2023-08-17T00:02:51.799219+0000","last_peered":"2023-08-17T00:02:51.799219+0000","last_clean":"2023-08-17T00:02:51.799219+0000","last_became_active":"2023-08-17T00:02:51.348701+0000","last_became_peered":"2023-08-17T00:02:51.348701+0000","last_unstale":"2023-08-17T00:02:51.799219+0000","last_undegraded":"2023-08-17T00:02:51.799219+0000","last_fullsized":"2023-08-17T00:02:51.799219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799387+0000","last_change":"2023-08-17T00:02:51.792387+0000","last_active":"2023-08-17T00:02:51.799387+0000","last_peered":"2023-08-17T00:02:51.799387+0000","last_clean":"2023-08-17T00:02:51.799387+0000","last_became_active":"2023-08-17T00:02:51.792133+0000","last_became_peered":"2023-08-17T00:02:51.792133+0000","last_unstale":"2023-08-17T00:02:51.799387+0000","last_undegraded":"2023-08-17T00:02:51.799387+0000","last_fullsized":"2023-08-17T00:02:51.799387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767037+0000","last_change":"2023-08-17T00:02:51.342138+0000","last_active":"2023-08-17T00:02:51.767037+0000","last_peered":"2023-08-17T00:02:51.767037+0000","last_clean":"2023-08-17T00:02:51.767037+0000","last_became_active":"2023-08-17T00:02:51.341316+0000","last_became_peered":"2023-08-17T00:02:51.341316+0000","last_unstale":"2023-08-17T00:02:51.767037+0000","last_undegraded":"2023-08-17T00:02:51.767037+0000","last_fullsized":"2023-08-17T00:02:51.767037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803438+0000","last_change":"2023-08-17T00:02:51.791960+0000","last_active":"2023-08-17T00:02:51.803438+0000","last_peered":"2023-08-17T00:02:51.803438+0000","last_clean":"2023-08-17T00:02:51.803438+0000","last_became_active":"2023-08-17T00:02:51.791680+0000","last_became_peered":"2023-08-17T00:02:51.791680+0000","last_unstale":"2023-08-17T00:02:51.803438+0000","last_undegraded":"2023-08-17T00:02:51.803438+0000","last_fullsized":"2023-08-17T00:02:51.803438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774692+0000","last_change":"2023-08-17T00:02:51.350536+0000","last_active":"2023-08-17T00:02:51.774692+0000","last_peered":"2023-08-17T00:02:51.774692+0000","last_clean":"2023-08-17T00:02:51.774692+0000","last_became_active":"2023-08-17T00:02:51.350180+0000","last_became_peered":"2023-08-17T00:02:51.350180+0000","last_unstale":"2023-08-17T00:02:51.774692+0000","last_undegraded":"2023-08-17T00:02:51.774692+0000","last_fullsized":"2023-08-17T00:02:51.774692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802758+0000","last_change":"2023-08-17T00:02:51.797907+0000","last_active":"2023-08-17T00:02:51.802758+0000","last_peered":"2023-08-17T00:02:51.802758+0000","last_clean":"2023-08-17T00:02:51.802758+0000","last_became_active":"2023-08-17T00:02:51.797480+0000","last_became_peered":"2023-08-17T00:02:51.797480+0000","last_unstale":"2023-08-17T00:02:51.802758+0000","last_undegraded":"2023-08-17T00:02:51.802758+0000","last_fullsized":"2023-08-17T00:02:51.802758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770167+0000","last_change":"2023-08-17T00:02:51.351104+0000","last_active":"2023-08-17T00:02:51.770167+0000","last_peered":"2023-08-17T00:02:51.770167+0000","last_clean":"2023-08-17T00:02:51.770167+0000","last_became_active":"2023-08-17T00:02:51.350791+0000","last_became_peered":"2023-08-17T00:02:51.350791+0000","last_unstale":"2023-08-17T00:02:51.770167+0000","last_undegraded":"2023-08-17T00:02:51.770167+0000","last_fullsized":"2023-08-17T00:02:51.770167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802476+0000","last_change":"2023-08-17T00:02:51.794083+0000","last_active":"2023-08-17T00:02:51.802476+0000","last_peered":"2023-08-17T00:02:51.802476+0000","last_clean":"2023-08-17T00:02:51.802476+0000","last_became_active":"2023-08-17T00:02:51.793757+0000","last_became_peered":"2023-08-17T00:02:51.793757+0000","last_unstale":"2023-08-17T00:02:51.802476+0000","last_undegraded":"2023-08-17T00:02:51.802476+0000","last_fullsized":"2023-08-17T00:02:51.802476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776347+0000","last_change":"2023-08-17T00:02:51.350940+0000","last_active":"2023-08-17T00:02:51.776347+0000","last_peered":"2023-08-17T00:02:51.776347+0000","last_clean":"2023-08-17T00:02:51.776347+0000","last_became_active":"2023-08-17T00:02:51.350441+0000","last_became_peered":"2023-08-17T00:02:51.350441+0000","last_unstale":"2023-08-17T00:02:51.776347+0000","last_undegraded":"2023-08-17T00:02:51.776347+0000","last_fullsized":"2023-08-17T00:02:51.776347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782080+0000","last_change":"2023-08-17T00:02:51.778464+0000","last_active":"2023-08-17T00:02:51.782080+0000","last_peered":"2023-08-17T00:02:51.782080+0000","last_clean":"2023-08-17T00:02:51.782080+0000","last_became_active":"2023-08-17T00:02:51.778226+0000","last_became_peered":"2023-08-17T00:02:51.778226+0000","last_unstale":"2023-08-17T00:02:51.782080+0000","last_undegraded":"2023-08-17T00:02:51.782080+0000","last_fullsized":"2023-08-17T00:02:51.782080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-17T00:02:52.768272+0000","last_change":"2023-08-17T00:02:51.340239+0000","last_active":"2023-08-17T00:02:52.768272+0000","last_peered":"2023-08-17T00:02:52.768272+0000","last_clean":"2023-08-17T00:02:52.768272+0000","last_became_active":"2023-08-17T00:02:51.339974+0000","last_became_peered":"2023-08-17T00:02:51.339974+0000","last_unstale":"2023-08-17T00:02:52.768272+0000","last_undegraded":"2023-08-17T00:02:52.768272+0000","last_fullsized":"2023-08-17T00:02:52.768272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798032+0000","last_change":"2023-08-17T00:02:51.792139+0000","last_active":"2023-08-17T00:02:51.798032+0000","last_peered":"2023-08-17T00:02:51.798032+0000","last_clean":"2023-08-17T00:02:51.798032+0000","last_became_active":"2023-08-17T00:02:51.791871+0000","last_became_peered":"2023-08-17T00:02:51.791871+0000","last_unstale":"2023-08-17T00:02:51.798032+0000","last_undegraded":"2023-08-17T00:02:51.798032+0000","last_fullsized":"2023-08-17T00:02:51.798032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776993+0000","last_change":"2023-08-17T00:02:51.346632+0000","last_active":"2023-08-17T00:02:51.776993+0000","last_peered":"2023-08-17T00:02:51.776993+0000","last_clean":"2023-08-17T00:02:51.776993+0000","last_became_active":"2023-08-17T00:02:51.346360+0000","last_became_peered":"2023-08-17T00:02:51.346360+0000","last_unstale":"2023-08-17T00:02:51.776993+0000","last_undegraded":"2023-08-17T00:02:51.776993+0000","last_fullsized":"2023-08-17T00:02:51.776993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795767+0000","last_change":"2023-08-17T00:02:51.791363+0000","last_active":"2023-08-17T00:02:51.795767+0000","last_peered":"2023-08-17T00:02:51.795767+0000","last_clean":"2023-08-17T00:02:51.795767+0000","last_became_active":"2023-08-17T00:02:51.791061+0000","last_became_peered":"2023-08-17T00:02:51.791061+0000","last_unstale":"2023-08-17T00:02:51.795767+0000","last_undegraded":"2023-08-17T00:02:51.795767+0000","last_fullsized":"2023-08-17T00:02:51.795767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780186+0000","last_change":"2023-08-17T00:02:51.354878+0000","last_active":"2023-08-17T00:02:51.780186+0000","last_peered":"2023-08-17T00:02:51.780186+0000","last_clean":"2023-08-17T00:02:51.780186+0000","last_became_active":"2023-08-17T00:02:51.354620+0000","last_became_peered":"2023-08-17T00:02:51.354620+0000","last_unstale":"2023-08-17T00:02:51.780186+0000","last_undegraded":"2023-08-17T00:02:51.780186+0000","last_fullsized":"2023-08-17T00:02:51.780186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790458+0000","last_change":"2023-08-17T00:02:51.786538+0000","last_active":"2023-08-17T00:02:51.790458+0000","last_peered":"2023-08-17T00:02:51.790458+0000","last_clean":"2023-08-17T00:02:51.790458+0000","last_became_active":"2023-08-17T00:02:51.786215+0000","last_became_peered":"2023-08-17T00:02:51.786215+0000","last_unstale":"2023-08-17T00:02:51.790458+0000","last_undegraded":"2023-08-17T00:02:51.790458+0000","last_fullsized":"2023-08-17T00:02:51.790458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775020+0000","last_change":"2023-08-17T00:02:51.350207+0000","last_active":"2023-08-17T00:02:51.775020+0000","last_peered":"2023-08-17T00:02:51.775020+0000","last_clean":"2023-08-17T00:02:51.775020+0000","last_became_active":"2023-08-17T00:02:51.349890+0000","last_became_peered":"2023-08-17T00:02:51.349890+0000","last_unstale":"2023-08-17T00:02:51.775020+0000","last_undegraded":"2023-08-17T00:02:51.775020+0000","last_fullsized":"2023-08-17T00:02:51.775020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790419+0000","last_change":"2023-08-17T00:02:51.787178+0000","last_active":"2023-08-17T00:02:51.790419+0000","last_peered":"2023-08-17T00:02:51.790419+0000","last_clean":"2023-08-17T00:02:51.790419+0000","last_became_active":"2023-08-17T00:02:51.786896+0000","last_became_peered":"2023-08-17T00:02:51.786896+0000","last_unstale":"2023-08-17T00:02:51.790419+0000","last_undegraded":"2023-08-17T00:02:51.790419+0000","last_fullsized":"2023-08-17T00:02:51.790419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769107+0000","last_change":"2023-08-17T00:02:51.351372+0000","last_active":"2023-08-17T00:02:51.769107+0000","last_peered":"2023-08-17T00:02:51.769107+0000","last_clean":"2023-08-17T00:02:51.769107+0000","last_became_active":"2023-08-17T00:02:51.350520+0000","last_became_peered":"2023-08-17T00:02:51.350520+0000","last_unstale":"2023-08-17T00:02:51.769107+0000","last_undegraded":"2023-08-17T00:02:51.769107+0000","last_fullsized":"2023-08-17T00:02:51.769107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790239+0000","last_change":"2023-08-17T00:02:51.786052+0000","last_active":"2023-08-17T00:02:51.790239+0000","last_peered":"2023-08-17T00:02:51.790239+0000","last_clean":"2023-08-17T00:02:51.790239+0000","last_became_active":"2023-08-17T00:02:51.784778+0000","last_became_peered":"2023-08-17T00:02:51.784778+0000","last_unstale":"2023-08-17T00:02:51.790239+0000","last_undegraded":"2023-08-17T00:02:51.790239+0000","last_fullsized":"2023-08-17T00:02:51.790239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780523+0000","last_change":"2023-08-17T00:02:51.352623+0000","last_active":"2023-08-17T00:02:51.780523+0000","last_peered":"2023-08-17T00:02:51.780523+0000","last_clean":"2023-08-17T00:02:51.780523+0000","last_became_active":"2023-08-17T00:02:51.352286+0000","last_became_peered":"2023-08-17T00:02:51.352286+0000","last_unstale":"2023-08-17T00:02:51.780523+0000","last_undegraded":"2023-08-17T00:02:51.780523+0000","last_fullsized":"2023-08-17T00:02:51.780523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803784+0000","last_change":"2023-08-17T00:02:51.801853+0000","last_active":"2023-08-17T00:02:51.803784+0000","last_peered":"2023-08-17T00:02:51.803784+0000","last_clean":"2023-08-17T00:02:51.803784+0000","last_became_active":"2023-08-17T00:02:51.801540+0000","last_became_peered":"2023-08-17T00:02:51.801540+0000","last_unstale":"2023-08-17T00:02:51.803784+0000","last_undegraded":"2023-08-17T00:02:51.803784+0000","last_fullsized":"2023-08-17T00:02:51.803784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:51.338361+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:51.338040+0000","last_became_peered":"2023-08-17T00:02:51.338040+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802658+0000","last_change":"2023-08-17T00:02:51.788068+0000","last_active":"2023-08-17T00:02:51.802658+0000","last_peered":"2023-08-17T00:02:51.802658+0000","last_clean":"2023-08-17T00:02:51.802658+0000","last_became_active":"2023-08-17T00:02:51.787734+0000","last_became_peered":"2023-08-17T00:02:51.787734+0000","last_unstale":"2023-08-17T00:02:51.802658+0000","last_undegraded":"2023-08-17T00:02:51.802658+0000","last_fullsized":"2023-08-17T00:02:51.802658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801530+0000","last_change":"2023-08-17T00:02:51.350761+0000","last_active":"2023-08-17T00:02:51.801530+0000","last_peered":"2023-08-17T00:02:51.801530+0000","last_clean":"2023-08-17T00:02:51.801530+0000","last_became_active":"2023-08-17T00:02:51.347875+0000","last_became_peered":"2023-08-17T00:02:51.347875+0000","last_unstale":"2023-08-17T00:02:51.801530+0000","last_undegraded":"2023-08-17T00:02:51.801530+0000","last_fullsized":"2023-08-17T00:02:51.801530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799118+0000","last_change":"2023-08-17T00:02:51.788452+0000","last_active":"2023-08-17T00:02:51.799118+0000","last_peered":"2023-08-17T00:02:51.799118+0000","last_clean":"2023-08-17T00:02:51.799118+0000","last_became_active":"2023-08-17T00:02:51.788147+0000","last_became_peered":"2023-08-17T00:02:51.788147+0000","last_unstale":"2023-08-17T00:02:51.799118+0000","last_undegraded":"2023-08-17T00:02:51.799118+0000","last_fullsized":"2023-08-17T00:02:51.799118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789445+0000","last_change":"2023-08-17T00:02:51.355054+0000","last_active":"2023-08-17T00:02:51.789445+0000","last_peered":"2023-08-17T00:02:51.789445+0000","last_clean":"2023-08-17T00:02:51.789445+0000","last_became_active":"2023-08-17T00:02:51.354677+0000","last_became_peered":"2023-08-17T00:02:51.354677+0000","last_unstale":"2023-08-17T00:02:51.789445+0000","last_undegraded":"2023-08-17T00:02:51.789445+0000","last_fullsized":"2023-08-17T00:02:51.789445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802453+0000","last_change":"2023-08-17T00:02:51.794268+0000","last_active":"2023-08-17T00:02:51.802453+0000","last_peered":"2023-08-17T00:02:51.802453+0000","last_clean":"2023-08-17T00:02:51.802453+0000","last_became_active":"2023-08-17T00:02:51.793909+0000","last_became_peered":"2023-08-17T00:02:51.793909+0000","last_unstale":"2023-08-17T00:02:51.802453+0000","last_undegraded":"2023-08-17T00:02:51.802453+0000","last_fullsized":"2023-08-17T00:02:51.802453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802558+0000","last_change":"2023-08-17T00:02:51.351466+0000","last_active":"2023-08-17T00:02:51.802558+0000","last_peered":"2023-08-17T00:02:51.802558+0000","last_clean":"2023-08-17T00:02:51.802558+0000","last_became_active":"2023-08-17T00:02:51.350746+0000","last_became_peered":"2023-08-17T00:02:51.350746+0000","last_unstale":"2023-08-17T00:02:51.802558+0000","last_undegraded":"2023-08-17T00:02:51.802558+0000","last_fullsized":"2023-08-17T00:02:51.802558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799918+0000","last_change":"2023-08-17T00:02:51.789270+0000","last_active":"2023-08-17T00:02:51.799918+0000","last_peered":"2023-08-17T00:02:51.799918+0000","last_clean":"2023-08-17T00:02:51.799918+0000","last_became_active":"2023-08-17T00:02:51.789010+0000","last_became_peered":"2023-08-17T00:02:51.789010+0000","last_unstale":"2023-08-17T00:02:51.799918+0000","last_undegraded":"2023-08-17T00:02:51.799918+0000","last_fullsized":"2023-08-17T00:02:51.799918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766901+0000","last_change":"2023-08-17T00:02:51.334024+0000","last_active":"2023-08-17T00:02:51.766901+0000","last_peered":"2023-08-17T00:02:51.766901+0000","last_clean":"2023-08-17T00:02:51.766901+0000","last_became_active":"2023-08-17T00:02:51.332857+0000","last_became_peered":"2023-08-17T00:02:51.332857+0000","last_unstale":"2023-08-17T00:02:51.766901+0000","last_undegraded":"2023-08-17T00:02:51.766901+0000","last_fullsized":"2023-08-17T00:02:51.766901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799394+0000","last_change":"2023-08-17T00:02:51.792683+0000","last_active":"2023-08-17T00:02:51.799394+0000","last_peered":"2023-08-17T00:02:51.799394+0000","last_clean":"2023-08-17T00:02:51.799394+0000","last_became_active":"2023-08-17T00:02:51.792366+0000","last_became_peered":"2023-08-17T00:02:51.792366+0000","last_unstale":"2023-08-17T00:02:51.799394+0000","last_undegraded":"2023-08-17T00:02:51.799394+0000","last_fullsized":"2023-08-17T00:02:51.799394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771706+0000","last_change":"2023-08-17T00:02:51.349003+0000","last_active":"2023-08-17T00:02:51.771706+0000","last_peered":"2023-08-17T00:02:51.771706+0000","last_clean":"2023-08-17T00:02:51.771706+0000","last_became_active":"2023-08-17T00:02:51.347537+0000","last_became_peered":"2023-08-17T00:02:51.347537+0000","last_unstale":"2023-08-17T00:02:51.771706+0000","last_undegraded":"2023-08-17T00:02:51.771706+0000","last_fullsized":"2023-08-17T00:02:51.771706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802086+0000","last_change":"2023-08-17T00:02:51.792987+0000","last_active":"2023-08-17T00:02:51.802086+0000","last_peered":"2023-08-17T00:02:51.802086+0000","last_clean":"2023-08-17T00:02:51.802086+0000","last_became_active":"2023-08-17T00:02:51.792614+0000","last_became_peered":"2023-08-17T00:02:51.792614+0000","last_unstale":"2023-08-17T00:02:51.802086+0000","last_undegraded":"2023-08-17T00:02:51.802086+0000","last_fullsized":"2023-08-17T00:02:51.802086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767113+0000","last_change":"2023-08-17T00:02:51.341657+0000","last_active":"2023-08-17T00:02:51.767113+0000","last_peered":"2023-08-17T00:02:51.767113+0000","last_clean":"2023-08-17T00:02:51.767113+0000","last_became_active":"2023-08-17T00:02:51.340926+0000","last_became_peered":"2023-08-17T00:02:51.340926+0000","last_unstale":"2023-08-17T00:02:51.767113+0000","last_undegraded":"2023-08-17T00:02:51.767113+0000","last_fullsized":"2023-08-17T00:02:51.767113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802511+0000","last_change":"2023-08-17T00:02:51.794147+0000","last_active":"2023-08-17T00:02:51.802511+0000","last_peered":"2023-08-17T00:02:51.802511+0000","last_clean":"2023-08-17T00:02:51.802511+0000","last_became_active":"2023-08-17T00:02:51.793842+0000","last_became_peered":"2023-08-17T00:02:51.793842+0000","last_unstale":"2023-08-17T00:02:51.802511+0000","last_undegraded":"2023-08-17T00:02:51.802511+0000","last_fullsized":"2023-08-17T00:02:51.802511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770938+0000","last_change":"2023-08-17T00:02:51.344894+0000","last_active":"2023-08-17T00:02:51.770938+0000","last_peered":"2023-08-17T00:02:51.770938+0000","last_clean":"2023-08-17T00:02:51.770938+0000","last_became_active":"2023-08-17T00:02:51.344238+0000","last_became_peered":"2023-08-17T00:02:51.344238+0000","last_unstale":"2023-08-17T00:02:51.770938+0000","last_undegraded":"2023-08-17T00:02:51.770938+0000","last_fullsized":"2023-08-17T00:02:51.770938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802630+0000","last_change":"2023-08-17T00:02:51.793264+0000","last_active":"2023-08-17T00:02:51.802630+0000","last_peered":"2023-08-17T00:02:51.802630+0000","last_clean":"2023-08-17T00:02:51.802630+0000","last_became_active":"2023-08-17T00:02:51.792918+0000","last_became_peered":"2023-08-17T00:02:51.792918+0000","last_unstale":"2023-08-17T00:02:51.802630+0000","last_undegraded":"2023-08-17T00:02:51.802630+0000","last_fullsized":"2023-08-17T00:02:51.802630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775453+0000","last_change":"2023-08-17T00:02:51.339413+0000","last_active":"2023-08-17T00:02:51.775453+0000","last_peered":"2023-08-17T00:02:51.775453+0000","last_clean":"2023-08-17T00:02:51.775453+0000","last_became_active":"2023-08-17T00:02:51.339094+0000","last_became_peered":"2023-08-17T00:02:51.339094+0000","last_unstale":"2023-08-17T00:02:51.775453+0000","last_undegraded":"2023-08-17T00:02:51.775453+0000","last_fullsized":"2023-08-17T00:02:51.775453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802813+0000","last_change":"2023-08-17T00:02:51.795000+0000","last_active":"2023-08-17T00:02:51.802813+0000","last_peered":"2023-08-17T00:02:51.802813+0000","last_clean":"2023-08-17T00:02:51.802813+0000","last_became_active":"2023-08-17T00:02:51.794722+0000","last_became_peered":"2023-08-17T00:02:51.794722+0000","last_unstale":"2023-08-17T00:02:51.802813+0000","last_undegraded":"2023-08-17T00:02:51.802813+0000","last_fullsized":"2023-08-17T00:02:51.802813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776484+0000","last_change":"2023-08-17T00:02:51.343058+0000","last_active":"2023-08-17T00:02:51.776484+0000","last_peered":"2023-08-17T00:02:51.776484+0000","last_clean":"2023-08-17T00:02:51.776484+0000","last_became_active":"2023-08-17T00:02:51.342764+0000","last_became_peered":"2023-08-17T00:02:51.342764+0000","last_unstale":"2023-08-17T00:02:51.776484+0000","last_undegraded":"2023-08-17T00:02:51.776484+0000","last_fullsized":"2023-08-17T00:02:51.776484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803681+0000","last_change":"2023-08-17T00:02:51.800364+0000","last_active":"2023-08-17T00:02:51.803681+0000","last_peered":"2023-08-17T00:02:51.803681+0000","last_clean":"2023-08-17T00:02:51.803681+0000","last_became_active":"2023-08-17T00:02:51.800036+0000","last_became_peered":"2023-08-17T00:02:51.800036+0000","last_unstale":"2023-08-17T00:02:51.803681+0000","last_undegraded":"2023-08-17T00:02:51.803681+0000","last_fullsized":"2023-08-17T00:02:51.803681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772373+0000","last_change":"2023-08-17T00:02:51.341857+0000","last_active":"2023-08-17T00:02:51.772373+0000","last_peered":"2023-08-17T00:02:51.772373+0000","last_clean":"2023-08-17T00:02:51.772373+0000","last_became_active":"2023-08-17T00:02:51.339418+0000","last_became_peered":"2023-08-17T00:02:51.339418+0000","last_unstale":"2023-08-17T00:02:51.772373+0000","last_undegraded":"2023-08-17T00:02:51.772373+0000","last_fullsized":"2023-08-17T00:02:51.772373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800439+0000","last_change":"2023-08-17T00:02:51.784928+0000","last_active":"2023-08-17T00:02:51.800439+0000","last_peered":"2023-08-17T00:02:51.800439+0000","last_clean":"2023-08-17T00:02:51.800439+0000","last_became_active":"2023-08-17T00:02:51.784604+0000","last_became_peered":"2023-08-17T00:02:51.784604+0000","last_unstale":"2023-08-17T00:02:51.800439+0000","last_undegraded":"2023-08-17T00:02:51.800439+0000","last_fullsized":"2023-08-17T00:02:51.800439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793473+0000","last_change":"2023-08-17T00:02:51.343843+0000","last_active":"2023-08-17T00:02:51.793473+0000","last_peered":"2023-08-17T00:02:51.793473+0000","last_clean":"2023-08-17T00:02:51.793473+0000","last_became_active":"2023-08-17T00:02:51.340985+0000","last_became_peered":"2023-08-17T00:02:51.340985+0000","last_unstale":"2023-08-17T00:02:51.793473+0000","last_undegraded":"2023-08-17T00:02:51.793473+0000","last_fullsized":"2023-08-17T00:02:51.793473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800767+0000","last_change":"2023-08-17T00:02:51.785256+0000","last_active":"2023-08-17T00:02:51.800767+0000","last_peered":"2023-08-17T00:02:51.800767+0000","last_clean":"2023-08-17T00:02:51.800767+0000","last_became_active":"2023-08-17T00:02:51.784962+0000","last_became_peered":"2023-08-17T00:02:51.784962+0000","last_unstale":"2023-08-17T00:02:51.800767+0000","last_undegraded":"2023-08-17T00:02:51.800767+0000","last_fullsized":"2023-08-17T00:02:51.800767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802680+0000","last_change":"2023-08-17T00:02:51.350355+0000","last_active":"2023-08-17T00:02:51.802680+0000","last_peered":"2023-08-17T00:02:51.802680+0000","last_clean":"2023-08-17T00:02:51.802680+0000","last_became_active":"2023-08-17T00:02:51.350063+0000","last_became_peered":"2023-08-17T00:02:51.350063+0000","last_unstale":"2023-08-17T00:02:51.802680+0000","last_undegraded":"2023-08-17T00:02:51.802680+0000","last_fullsized":"2023-08-17T00:02:51.802680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798718+0000","last_change":"2023-08-17T00:02:51.785857+0000","last_active":"2023-08-17T00:02:51.798718+0000","last_peered":"2023-08-17T00:02:51.798718+0000","last_clean":"2023-08-17T00:02:51.798718+0000","last_became_active":"2023-08-17T00:02:51.785548+0000","last_became_peered":"2023-08-17T00:02:51.785548+0000","last_unstale":"2023-08-17T00:02:51.798718+0000","last_undegraded":"2023-08-17T00:02:51.798718+0000","last_fullsized":"2023-08-17T00:02:51.798718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770921+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:02:51.770921+0000","last_peered":"2023-08-17T00:02:51.770921+0000","last_clean":"2023-08-17T00:02:51.770921+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:02:51.770921+0000","last_undegraded":"2023-08-17T00:02:51.770921+0000","last_fullsized":"2023-08-17T00:02:51.770921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772354+0000","last_change":"2023-08-17T00:02:51.349328+0000","last_active":"2023-08-17T00:02:51.772354+0000","last_peered":"2023-08-17T00:02:51.772354+0000","last_clean":"2023-08-17T00:02:51.772354+0000","last_became_active":"2023-08-17T00:02:51.348912+0000","last_became_peered":"2023-08-17T00:02:51.348912+0000","last_unstale":"2023-08-17T00:02:51.772354+0000","last_undegraded":"2023-08-17T00:02:51.772354+0000","last_fullsized":"2023-08-17T00:02:51.772354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798870+0000","last_change":"2023-08-17T00:02:51.786668+0000","last_active":"2023-08-17T00:02:51.798870+0000","last_peered":"2023-08-17T00:02:51.798870+0000","last_clean":"2023-08-17T00:02:51.798870+0000","last_became_active":"2023-08-17T00:02:51.785985+0000","last_became_peered":"2023-08-17T00:02:51.785985+0000","last_unstale":"2023-08-17T00:02:51.798870+0000","last_undegraded":"2023-08-17T00:02:51.798870+0000","last_fullsized":"2023-08-17T00:02:51.798870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772460+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:02:51.772460+0000","last_peered":"2023-08-17T00:02:51.772460+0000","last_clean":"2023-08-17T00:02:51.772460+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:02:51.772460+0000","last_undegraded":"2023-08-17T00:02:51.772460+0000","last_fullsized":"2023-08-17T00:02:51.772460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797184+0000","last_change":"2023-08-17T00:02:51.335559+0000","last_active":"2023-08-17T00:02:51.797184+0000","last_peered":"2023-08-17T00:02:51.797184+0000","last_clean":"2023-08-17T00:02:51.797184+0000","last_became_active":"2023-08-17T00:02:51.335182+0000","last_became_peered":"2023-08-17T00:02:51.335182+0000","last_unstale":"2023-08-17T00:02:51.797184+0000","last_undegraded":"2023-08-17T00:02:51.797184+0000","last_fullsized":"2023-08-17T00:02:51.797184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801377+0000","last_change":"2023-08-17T00:02:51.787570+0000","last_active":"2023-08-17T00:02:51.801377+0000","last_peered":"2023-08-17T00:02:51.801377+0000","last_clean":"2023-08-17T00:02:51.801377+0000","last_became_active":"2023-08-17T00:02:51.787256+0000","last_became_peered":"2023-08-17T00:02:51.787256+0000","last_unstale":"2023-08-17T00:02:51.801377+0000","last_undegraded":"2023-08-17T00:02:51.801377+0000","last_fullsized":"2023-08-17T00:02:51.801377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773440+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:02:51.773440+0000","last_peered":"2023-08-17T00:02:51.773440+0000","last_clean":"2023-08-17T00:02:51.773440+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:02:51.773440+0000","last_undegraded":"2023-08-17T00:02:51.773440+0000","last_fullsized":"2023-08-17T00:02:51.773440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780285+0000","last_change":"2023-08-17T00:02:51.343304+0000","last_active":"2023-08-17T00:02:51.780285+0000","last_peered":"2023-08-17T00:02:51.780285+0000","last_clean":"2023-08-17T00:02:51.780285+0000","last_became_active":"2023-08-17T00:02:51.343028+0000","last_became_peered":"2023-08-17T00:02:51.343028+0000","last_unstale":"2023-08-17T00:02:51.780285+0000","last_undegraded":"2023-08-17T00:02:51.780285+0000","last_fullsized":"2023-08-17T00:02:51.780285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796085+0000","last_change":"2023-08-17T00:02:51.788638+0000","last_active":"2023-08-17T00:02:51.796085+0000","last_peered":"2023-08-17T00:02:51.796085+0000","last_clean":"2023-08-17T00:02:51.796085+0000","last_became_active":"2023-08-17T00:02:51.787316+0000","last_became_peered":"2023-08-17T00:02:51.787316+0000","last_unstale":"2023-08-17T00:02:51.796085+0000","last_undegraded":"2023-08-17T00:02:51.796085+0000","last_fullsized":"2023-08-17T00:02:51.796085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774757+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:02:51.774757+0000","last_peered":"2023-08-17T00:02:51.774757+0000","last_clean":"2023-08-17T00:02:51.774757+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:02:51.774757+0000","last_undegraded":"2023-08-17T00:02:51.774757+0000","last_fullsized":"2023-08-17T00:02:51.774757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768333+0000","last_change":"2023-08-17T00:02:51.340968+0000","last_active":"2023-08-17T00:02:51.768333+0000","last_peered":"2023-08-17T00:02:51.768333+0000","last_clean":"2023-08-17T00:02:51.768333+0000","last_became_active":"2023-08-17T00:02:51.340352+0000","last_became_peered":"2023-08-17T00:02:51.340352+0000","last_unstale":"2023-08-17T00:02:51.768333+0000","last_undegraded":"2023-08-17T00:02:51.768333+0000","last_fullsized":"2023-08-17T00:02:51.768333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789054+0000","last_change":"2023-08-17T00:02:51.786773+0000","last_active":"2023-08-17T00:02:51.789054+0000","last_peered":"2023-08-17T00:02:51.789054+0000","last_clean":"2023-08-17T00:02:51.789054+0000","last_became_active":"2023-08-17T00:02:51.786393+0000","last_became_peered":"2023-08-17T00:02:51.786393+0000","last_unstale":"2023-08-17T00:02:51.789054+0000","last_undegraded":"2023-08-17T00:02:51.789054+0000","last_fullsized":"2023-08-17T00:02:51.789054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769417+0000","last_change":"2023-08-17T00:02:51.345508+0000","last_active":"2023-08-17T00:02:51.769417+0000","last_peered":"2023-08-17T00:02:51.769417+0000","last_clean":"2023-08-17T00:02:51.769417+0000","last_became_active":"2023-08-17T00:02:51.345226+0000","last_became_peered":"2023-08-17T00:02:51.345226+0000","last_unstale":"2023-08-17T00:02:51.769417+0000","last_undegraded":"2023-08-17T00:02:51.769417+0000","last_fullsized":"2023-08-17T00:02:51.769417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769322+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:02:51.769322+0000","last_peered":"2023-08-17T00:02:51.769322+0000","last_clean":"2023-08-17T00:02:51.769322+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:02:51.769322+0000","last_undegraded":"2023-08-17T00:02:51.769322+0000","last_fullsized":"2023-08-17T00:02:51.769322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799559+0000","last_change":"2023-08-17T00:02:51.796855+0000","last_active":"2023-08-17T00:02:51.799559+0000","last_peered":"2023-08-17T00:02:51.799559+0000","last_clean":"2023-08-17T00:02:51.799559+0000","last_became_active":"2023-08-17T00:02:51.796562+0000","last_became_peered":"2023-08-17T00:02:51.796562+0000","last_unstale":"2023-08-17T00:02:51.799559+0000","last_undegraded":"2023-08-17T00:02:51.799559+0000","last_fullsized":"2023-08-17T00:02:51.799559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775324+0000","last_change":"2023-08-17T00:02:51.350272+0000","last_active":"2023-08-17T00:02:51.775324+0000","last_peered":"2023-08-17T00:02:51.775324+0000","last_clean":"2023-08-17T00:02:51.775324+0000","last_became_active":"2023-08-17T00:02:51.350003+0000","last_became_peered":"2023-08-17T00:02:51.350003+0000","last_unstale":"2023-08-17T00:02:51.775324+0000","last_undegraded":"2023-08-17T00:02:51.775324+0000","last_fullsized":"2023-08-17T00:02:51.775324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.781497+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:02:51.781497+0000","last_peered":"2023-08-17T00:02:51.781497+0000","last_clean":"2023-08-17T00:02:51.781497+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:02:51.781497+0000","last_undegraded":"2023-08-17T00:02:51.781497+0000","last_fullsized":"2023-08-17T00:02:51.781497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798023+0000","last_change":"2023-08-17T00:02:51.790967+0000","last_active":"2023-08-17T00:02:51.798023+0000","last_peered":"2023-08-17T00:02:51.798023+0000","last_clean":"2023-08-17T00:02:51.798023+0000","last_became_active":"2023-08-17T00:02:51.787858+0000","last_became_peered":"2023-08-17T00:02:51.787858+0000","last_unstale":"2023-08-17T00:02:51.798023+0000","last_undegraded":"2023-08-17T00:02:51.798023+0000","last_fullsized":"2023-08-17T00:02:51.798023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.777967+0000","last_change":"2023-08-17T00:02:51.348713+0000","last_active":"2023-08-17T00:02:51.777967+0000","last_peered":"2023-08-17T00:02:51.777967+0000","last_clean":"2023-08-17T00:02:51.777967+0000","last_became_active":"2023-08-17T00:02:51.348409+0000","last_became_peered":"2023-08-17T00:02:51.348409+0000","last_unstale":"2023-08-17T00:02:51.777967+0000","last_undegraded":"2023-08-17T00:02:51.777967+0000","last_fullsized":"2023-08-17T00:02:51.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770267+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:02:51.770267+0000","last_peered":"2023-08-17T00:02:51.770267+0000","last_clean":"2023-08-17T00:02:51.770267+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:02:51.770267+0000","last_undegraded":"2023-08-17T00:02:51.770267+0000","last_fullsized":"2023-08-17T00:02:51.770267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803930+0000","last_change":"2023-08-17T00:02:51.797864+0000","last_active":"2023-08-17T00:02:51.803930+0000","last_peered":"2023-08-17T00:02:51.803930+0000","last_clean":"2023-08-17T00:02:51.803930+0000","last_became_active":"2023-08-17T00:02:51.797388+0000","last_became_peered":"2023-08-17T00:02:51.797388+0000","last_unstale":"2023-08-17T00:02:51.803930+0000","last_undegraded":"2023-08-17T00:02:51.803930+0000","last_fullsized":"2023-08-17T00:02:51.803930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774238+0000","last_change":"2023-08-17T00:02:51.353342+0000","last_active":"2023-08-17T00:02:51.774238+0000","last_peered":"2023-08-17T00:02:51.774238+0000","last_clean":"2023-08-17T00:02:51.774238+0000","last_became_active":"2023-08-17T00:02:51.351707+0000","last_became_peered":"2023-08-17T00:02:51.351707+0000","last_unstale":"2023-08-17T00:02:51.774238+0000","last_undegraded":"2023-08-17T00:02:51.774238+0000","last_fullsized":"2023-08-17T00:02:51.774238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766976+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:02:51.766976+0000","last_peered":"2023-08-17T00:02:51.766976+0000","last_clean":"2023-08-17T00:02:51.766976+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:02:51.766976+0000","last_undegraded":"2023-08-17T00:02:51.766976+0000","last_fullsized":"2023-08-17T00:02:51.766976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790259+0000","last_change":"2023-08-17T00:02:51.786227+0000","last_active":"2023-08-17T00:02:51.790259+0000","last_peered":"2023-08-17T00:02:51.790259+0000","last_clean":"2023-08-17T00:02:51.790259+0000","last_became_active":"2023-08-17T00:02:51.785164+0000","last_became_peered":"2023-08-17T00:02:51.785164+0000","last_unstale":"2023-08-17T00:02:51.790259+0000","last_undegraded":"2023-08-17T00:02:51.790259+0000","last_fullsized":"2023-08-17T00:02:51.790259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771433+0000","last_change":"2023-08-17T00:02:51.349191+0000","last_active":"2023-08-17T00:02:51.771433+0000","last_peered":"2023-08-17T00:02:51.771433+0000","last_clean":"2023-08-17T00:02:51.771433+0000","last_became_active":"2023-08-17T00:02:51.348834+0000","last_became_peered":"2023-08-17T00:02:51.348834+0000","last_unstale":"2023-08-17T00:02:51.771433+0000","last_undegraded":"2023-08-17T00:02:51.771433+0000","last_fullsized":"2023-08-17T00:02:51.771433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803745+0000","last_change":"2023-08-17T00:02:51.801602+0000","last_active":"2023-08-17T00:02:51.803745+0000","last_peered":"2023-08-17T00:02:51.803745+0000","last_clean":"2023-08-17T00:02:51.803745+0000","last_became_active":"2023-08-17T00:02:51.801300+0000","last_became_peered":"2023-08-17T00:02:51.801300+0000","last_unstale":"2023-08-17T00:02:51.803745+0000","last_undegraded":"2023-08-17T00:02:51.803745+0000","last_fullsized":"2023-08-17T00:02:51.803745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768468+0000","last_change":"2023-08-17T00:02:51.340158+0000","last_active":"2023-08-17T00:02:51.768468+0000","last_peered":"2023-08-17T00:02:51.768468+0000","last_clean":"2023-08-17T00:02:51.768468+0000","last_became_active":"2023-08-17T00:02:51.339871+0000","last_became_peered":"2023-08-17T00:02:51.339871+0000","last_unstale":"2023-08-17T00:02:51.768468+0000","last_undegraded":"2023-08-17T00:02:51.768468+0000","last_fullsized":"2023-08-17T00:02:51.768468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798765+0000","last_change":"2023-08-17T00:02:51.785968+0000","last_active":"2023-08-17T00:02:51.798765+0000","last_peered":"2023-08-17T00:02:51.798765+0000","last_clean":"2023-08-17T00:02:51.798765+0000","last_became_active":"2023-08-17T00:02:51.785695+0000","last_became_peered":"2023-08-17T00:02:51.785695+0000","last_unstale":"2023-08-17T00:02:51.798765+0000","last_undegraded":"2023-08-17T00:02:51.798765+0000","last_fullsized":"2023-08-17T00:02:51.798765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769227+0000","last_change":"2023-08-17T00:02:51.339180+0000","last_active":"2023-08-17T00:02:51.769227+0000","last_peered":"2023-08-17T00:02:51.769227+0000","last_clean":"2023-08-17T00:02:51.769227+0000","last_became_active":"2023-08-17T00:02:51.338880+0000","last_became_peered":"2023-08-17T00:02:51.338880+0000","last_unstale":"2023-08-17T00:02:51.769227+0000","last_undegraded":"2023-08-17T00:02:51.769227+0000","last_fullsized":"2023-08-17T00:02:51.769227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790291+0000","last_change":"2023-08-17T00:02:51.786531+0000","last_active":"2023-08-17T00:02:51.790291+0000","last_peered":"2023-08-17T00:02:51.790291+0000","last_clean":"2023-08-17T00:02:51.790291+0000","last_became_active":"2023-08-17T00:02:51.785774+0000","last_became_peered":"2023-08-17T00:02:51.785774+0000","last_unstale":"2023-08-17T00:02:51.790291+0000","last_undegraded":"2023-08-17T00:02:51.790291+0000","last_fullsized":"2023-08-17T00:02:51.790291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795538+0000","last_change":"2023-08-17T00:02:51.344586+0000","last_active":"2023-08-17T00:02:51.795538+0000","last_peered":"2023-08-17T00:02:51.795538+0000","last_clean":"2023-08-17T00:02:51.795538+0000","last_became_active":"2023-08-17T00:02:51.344320+0000","last_became_peered":"2023-08-17T00:02:51.344320+0000","last_unstale":"2023-08-17T00:02:51.795538+0000","last_undegraded":"2023-08-17T00:02:51.795538+0000","last_fullsized":"2023-08-17T00:02:51.795538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795736+0000","last_change":"2023-08-17T00:02:51.789022+0000","last_active":"2023-08-17T00:02:51.795736+0000","last_peered":"2023-08-17T00:02:51.795736+0000","last_clean":"2023-08-17T00:02:51.795736+0000","last_became_active":"2023-08-17T00:02:51.788756+0000","last_became_peered":"2023-08-17T00:02:51.788756+0000","last_unstale":"2023-08-17T00:02:51.795736+0000","last_undegraded":"2023-08-17T00:02:51.795736+0000","last_fullsized":"2023-08-17T00:02:51.795736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775104+0000","last_change":"2023-08-17T00:02:51.352334+0000","last_active":"2023-08-17T00:02:51.775104+0000","last_peered":"2023-08-17T00:02:51.775104+0000","last_clean":"2023-08-17T00:02:51.775104+0000","last_became_active":"2023-08-17T00:02:51.352057+0000","last_became_peered":"2023-08-17T00:02:51.352057+0000","last_unstale":"2023-08-17T00:02:51.775104+0000","last_undegraded":"2023-08-17T00:02:51.775104+0000","last_fullsized":"2023-08-17T00:02:51.775104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790438+0000","last_change":"2023-08-17T00:02:51.786511+0000","last_active":"2023-08-17T00:02:51.790438+0000","last_peered":"2023-08-17T00:02:51.790438+0000","last_clean":"2023-08-17T00:02:51.790438+0000","last_became_active":"2023-08-17T00:02:51.786141+0000","last_became_peered":"2023-08-17T00:02:51.786141+0000","last_unstale":"2023-08-17T00:02:51.790438+0000","last_undegraded":"2023-08-17T00:02:51.790438+0000","last_fullsized":"2023-08-17T00:02:51.790438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773255+0000","last_change":"2023-08-17T00:02:51.351567+0000","last_active":"2023-08-17T00:02:51.773255+0000","last_peered":"2023-08-17T00:02:51.773255+0000","last_clean":"2023-08-17T00:02:51.773255+0000","last_became_active":"2023-08-17T00:02:51.351119+0000","last_became_peered":"2023-08-17T00:02:51.351119+0000","last_unstale":"2023-08-17T00:02:51.773255+0000","last_undegraded":"2023-08-17T00:02:51.773255+0000","last_fullsized":"2023-08-17T00:02:51.773255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798841+0000","last_change":"2023-08-17T00:02:51.786494+0000","last_active":"2023-08-17T00:02:51.798841+0000","last_peered":"2023-08-17T00:02:51.798841+0000","last_clean":"2023-08-17T00:02:51.798841+0000","last_became_active":"2023-08-17T00:02:51.786239+0000","last_became_peered":"2023-08-17T00:02:51.786239+0000","last_unstale":"2023-08-17T00:02:51.798841+0000","last_undegraded":"2023-08-17T00:02:51.798841+0000","last_fullsized":"2023-08-17T00:02:51.798841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.788577+0000","last_change":"2023-08-17T00:02:51.341388+0000","last_active":"2023-08-17T00:02:51.788577+0000","last_peered":"2023-08-17T00:02:51.788577+0000","last_clean":"2023-08-17T00:02:51.788577+0000","last_became_active":"2023-08-17T00:02:51.341095+0000","last_became_peered":"2023-08-17T00:02:51.341095+0000","last_unstale":"2023-08-17T00:02:51.788577+0000","last_undegraded":"2023-08-17T00:02:51.788577+0000","last_fullsized":"2023-08-17T00:02:51.788577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802878+0000","last_change":"2023-08-17T00:02:51.795136+0000","last_active":"2023-08-17T00:02:51.802878+0000","last_peered":"2023-08-17T00:02:51.802878+0000","last_clean":"2023-08-17T00:02:51.802878+0000","last_became_active":"2023-08-17T00:02:51.794509+0000","last_became_peered":"2023-08-17T00:02:51.794509+0000","last_unstale":"2023-08-17T00:02:51.802878+0000","last_undegraded":"2023-08-17T00:02:51.802878+0000","last_fullsized":"2023-08-17T00:02:51.802878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803177+0000","last_change":"2023-08-17T00:02:51.347636+0000","last_active":"2023-08-17T00:02:51.803177+0000","last_peered":"2023-08-17T00:02:51.803177+0000","last_clean":"2023-08-17T00:02:51.803177+0000","last_became_active":"2023-08-17T00:02:51.347360+0000","last_became_peered":"2023-08-17T00:02:51.347360+0000","last_unstale":"2023-08-17T00:02:51.803177+0000","last_undegraded":"2023-08-17T00:02:51.803177+0000","last_fullsized":"2023-08-17T00:02:51.803177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784923+0000","last_change":"2023-08-17T00:02:51.774675+0000","last_active":"2023-08-17T00:02:51.784923+0000","last_peered":"2023-08-17T00:02:51.784923+0000","last_clean":"2023-08-17T00:02:51.784923+0000","last_became_active":"2023-08-17T00:02:51.774422+0000","last_became_peered":"2023-08-17T00:02:51.774422+0000","last_unstale":"2023-08-17T00:02:51.784923+0000","last_undegraded":"2023-08-17T00:02:51.784923+0000","last_fullsized":"2023-08-17T00:02:51.784923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795262+0000","last_change":"2023-08-17T00:02:51.344092+0000","last_active":"2023-08-17T00:02:51.795262+0000","last_peered":"2023-08-17T00:02:51.795262+0000","last_clean":"2023-08-17T00:02:51.795262+0000","last_became_active":"2023-08-17T00:02:51.343804+0000","last_became_peered":"2023-08-17T00:02:51.343804+0000","last_unstale":"2023-08-17T00:02:51.795262+0000","last_undegraded":"2023-08-17T00:02:51.795262+0000","last_fullsized":"2023-08-17T00:02:51.795262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803841+0000","last_change":"2023-08-17T00:02:51.796680+0000","last_active":"2023-08-17T00:02:51.803841+0000","last_peered":"2023-08-17T00:02:51.803841+0000","last_clean":"2023-08-17T00:02:51.803841+0000","last_became_active":"2023-08-17T00:02:51.795190+0000","last_became_peered":"2023-08-17T00:02:51.795190+0000","last_unstale":"2023-08-17T00:02:51.803841+0000","last_undegraded":"2023-08-17T00:02:51.803841+0000","last_fullsized":"2023-08-17T00:02:51.803841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768352+0000","last_change":"2023-08-17T00:02:51.349898+0000","last_active":"2023-08-17T00:02:51.768352+0000","last_peered":"2023-08-17T00:02:51.768352+0000","last_clean":"2023-08-17T00:02:51.768352+0000","last_became_active":"2023-08-17T00:02:51.349378+0000","last_became_peered":"2023-08-17T00:02:51.349378+0000","last_unstale":"2023-08-17T00:02:51.768352+0000","last_undegraded":"2023-08-17T00:02:51.768352+0000","last_fullsized":"2023-08-17T00:02:51.768352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803909+0000","last_change":"2023-08-17T00:02:51.797648+0000","last_active":"2023-08-17T00:02:51.803909+0000","last_peered":"2023-08-17T00:02:51.803909+0000","last_clean":"2023-08-17T00:02:51.803909+0000","last_became_active":"2023-08-17T00:02:51.797021+0000","last_became_peered":"2023-08-17T00:02:51.797021+0000","last_unstale":"2023-08-17T00:02:51.803909+0000","last_undegraded":"2023-08-17T00:02:51.803909+0000","last_fullsized":"2023-08-17T00:02:51.803909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779519+0000","last_change":"2023-08-17T00:02:51.341554+0000","last_active":"2023-08-17T00:02:51.779519+0000","last_peered":"2023-08-17T00:02:51.779519+0000","last_clean":"2023-08-17T00:02:51.779519+0000","last_became_active":"2023-08-17T00:02:51.341189+0000","last_became_peered":"2023-08-17T00:02:51.341189+0000","last_unstale":"2023-08-17T00:02:51.779519+0000","last_undegraded":"2023-08-17T00:02:51.779519+0000","last_fullsized":"2023-08-17T00:02:51.779519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790275+0000","last_change":"2023-08-17T00:02:51.786385+0000","last_active":"2023-08-17T00:02:51.790275+0000","last_peered":"2023-08-17T00:02:51.790275+0000","last_clean":"2023-08-17T00:02:51.790275+0000","last_became_active":"2023-08-17T00:02:51.785450+0000","last_became_peered":"2023-08-17T00:02:51.785450+0000","last_unstale":"2023-08-17T00:02:51.790275+0000","last_undegraded":"2023-08-17T00:02:51.790275+0000","last_fullsized":"2023-08-17T00:02:51.790275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802399+0000","last_change":"2023-08-17T00:02:51.341982+0000","last_active":"2023-08-17T00:02:51.802399+0000","last_peered":"2023-08-17T00:02:51.802399+0000","last_clean":"2023-08-17T00:02:51.802399+0000","last_became_active":"2023-08-17T00:02:51.341697+0000","last_became_peered":"2023-08-17T00:02:51.341697+0000","last_unstale":"2023-08-17T00:02:51.802399+0000","last_undegraded":"2023-08-17T00:02:51.802399+0000","last_fullsized":"2023-08-17T00:02:51.802399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800153+0000","last_change":"2023-08-17T00:02:51.798361+0000","last_active":"2023-08-17T00:02:51.800153+0000","last_peered":"2023-08-17T00:02:51.800153+0000","last_clean":"2023-08-17T00:02:51.800153+0000","last_became_active":"2023-08-17T00:02:51.797985+0000","last_became_peered":"2023-08-17T00:02:51.797985+0000","last_unstale":"2023-08-17T00:02:51.800153+0000","last_undegraded":"2023-08-17T00:02:51.800153+0000","last_fullsized":"2023-08-17T00:02:51.800153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779410+0000","last_change":"2023-08-17T00:02:51.345285+0000","last_active":"2023-08-17T00:02:51.779410+0000","last_peered":"2023-08-17T00:02:51.779410+0000","last_clean":"2023-08-17T00:02:51.779410+0000","last_became_active":"2023-08-17T00:02:51.345012+0000","last_became_peered":"2023-08-17T00:02:51.345012+0000","last_unstale":"2023-08-17T00:02:51.779410+0000","last_undegraded":"2023-08-17T00:02:51.779410+0000","last_fullsized":"2023-08-17T00:02:51.779410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.791563+0000","last_change":"2023-08-17T00:02:51.780780+0000","last_active":"2023-08-17T00:02:51.791563+0000","last_peered":"2023-08-17T00:02:51.791563+0000","last_clean":"2023-08-17T00:02:51.791563+0000","last_became_active":"2023-08-17T00:02:51.780499+0000","last_became_peered":"2023-08-17T00:02:51.780499+0000","last_unstale":"2023-08-17T00:02:51.791563+0000","last_undegraded":"2023-08-17T00:02:51.791563+0000","last_fullsized":"2023-08-17T00:02:51.791563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796009+0000","last_change":"2023-08-17T00:02:51.346726+0000","last_active":"2023-08-17T00:02:51.796009+0000","last_peered":"2023-08-17T00:02:51.796009+0000","last_clean":"2023-08-17T00:02:51.796009+0000","last_became_active":"2023-08-17T00:02:51.346453+0000","last_became_peered":"2023-08-17T00:02:51.346453+0000","last_unstale":"2023-08-17T00:02:51.796009+0000","last_undegraded":"2023-08-17T00:02:51.796009+0000","last_fullsized":"2023-08-17T00:02:51.796009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803474+0000","last_change":"2023-08-17T00:02:51.791605+0000","last_active":"2023-08-17T00:02:51.803474+0000","last_peered":"2023-08-17T00:02:51.803474+0000","last_clean":"2023-08-17T00:02:51.803474+0000","last_became_active":"2023-08-17T00:02:51.791337+0000","last_became_peered":"2023-08-17T00:02:51.791337+0000","last_unstale":"2023-08-17T00:02:51.803474+0000","last_undegraded":"2023-08-17T00:02:51.803474+0000","last_fullsized":"2023-08-17T00:02:51.803474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.806325+0000","last_change":"2023-08-17T00:02:51.346596+0000","last_active":"2023-08-17T00:02:51.806325+0000","last_peered":"2023-08-17T00:02:51.806325+0000","last_clean":"2023-08-17T00:02:51.806325+0000","last_became_active":"2023-08-17T00:02:51.346313+0000","last_became_peered":"2023-08-17T00:02:51.346313+0000","last_unstale":"2023-08-17T00:02:51.806325+0000","last_undegraded":"2023-08-17T00:02:51.806325+0000","last_fullsized":"2023-08-17T00:02:51.806325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798176+0000","last_change":"2023-08-17T00:02:51.793285+0000","last_active":"2023-08-17T00:02:51.798176+0000","last_peered":"2023-08-17T00:02:51.798176+0000","last_clean":"2023-08-17T00:02:51.798176+0000","last_became_active":"2023-08-17T00:02:51.791718+0000","last_became_peered":"2023-08-17T00:02:51.791718+0000","last_unstale":"2023-08-17T00:02:51.798176+0000","last_undegraded":"2023-08-17T00:02:51.798176+0000","last_fullsized":"2023-08-17T00:02:51.798176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771929+0000","last_change":"2023-08-17T00:02:51.344568+0000","last_active":"2023-08-17T00:02:51.771929+0000","last_peered":"2023-08-17T00:02:51.771929+0000","last_clean":"2023-08-17T00:02:51.771929+0000","last_became_active":"2023-08-17T00:02:51.344185+0000","last_became_peered":"2023-08-17T00:02:51.344185+0000","last_unstale":"2023-08-17T00:02:51.771929+0000","last_undegraded":"2023-08-17T00:02:51.771929+0000","last_fullsized":"2023-08-17T00:02:51.771929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802759+0000","last_change":"2023-08-17T00:02:51.794651+0000","last_active":"2023-08-17T00:02:51.802759+0000","last_peered":"2023-08-17T00:02:51.802759+0000","last_clean":"2023-08-17T00:02:51.802759+0000","last_became_active":"2023-08-17T00:02:51.794341+0000","last_became_peered":"2023-08-17T00:02:51.794341+0000","last_unstale":"2023-08-17T00:02:51.802759+0000","last_undegraded":"2023-08-17T00:02:51.802759+0000","last_fullsized":"2023-08-17T00:02:51.802759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774235+0000","last_change":"2023-08-17T00:02:51.344305+0000","last_active":"2023-08-17T00:02:51.774235+0000","last_peered":"2023-08-17T00:02:51.774235+0000","last_clean":"2023-08-17T00:02:51.774235+0000","last_became_active":"2023-08-17T00:02:51.341191+0000","last_became_peered":"2023-08-17T00:02:51.341191+0000","last_unstale":"2023-08-17T00:02:51.774235+0000","last_undegraded":"2023-08-17T00:02:51.774235+0000","last_fullsized":"2023-08-17T00:02:51.774235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795708+0000","last_change":"2023-08-17T00:02:51.789154+0000","last_active":"2023-08-17T00:02:51.795708+0000","last_peered":"2023-08-17T00:02:51.795708+0000","last_clean":"2023-08-17T00:02:51.795708+0000","last_became_active":"2023-08-17T00:02:51.788807+0000","last_became_peered":"2023-08-17T00:02:51.788807+0000","last_unstale":"2023-08-17T00:02:51.795708+0000","last_undegraded":"2023-08-17T00:02:51.795708+0000","last_fullsized":"2023-08-17T00:02:51.795708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766911+0000","last_change":"2023-08-17T00:02:51.342636+0000","last_active":"2023-08-17T00:02:51.766911+0000","last_peered":"2023-08-17T00:02:51.766911+0000","last_clean":"2023-08-17T00:02:51.766911+0000","last_became_active":"2023-08-17T00:02:51.342340+0000","last_became_peered":"2023-08-17T00:02:51.342340+0000","last_unstale":"2023-08-17T00:02:51.766911+0000","last_undegraded":"2023-08-17T00:02:51.766911+0000","last_fullsized":"2023-08-17T00:02:51.766911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802639+0000","last_change":"2023-08-17T00:02:51.797499+0000","last_active":"2023-08-17T00:02:51.802639+0000","last_peered":"2023-08-17T00:02:51.802639+0000","last_clean":"2023-08-17T00:02:51.802639+0000","last_became_active":"2023-08-17T00:02:51.797168+0000","last_became_peered":"2023-08-17T00:02:51.797168+0000","last_unstale":"2023-08-17T00:02:51.802639+0000","last_undegraded":"2023-08-17T00:02:51.802639+0000","last_fullsized":"2023-08-17T00:02:51.802639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797340+0000","last_change":"2023-08-17T00:02:51.789012+0000","last_active":"2023-08-17T00:02:51.797340+0000","last_peered":"2023-08-17T00:02:51.797340+0000","last_clean":"2023-08-17T00:02:51.797340+0000","last_became_active":"2023-08-17T00:02:51.788464+0000","last_became_peered":"2023-08-17T00:02:51.788464+0000","last_unstale":"2023-08-17T00:02:51.797340+0000","last_undegraded":"2023-08-17T00:02:51.797340+0000","last_fullsized":"2023-08-17T00:02:51.797340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775204+0000","last_change":"2023-08-17T00:02:51.339223+0000","last_active":"2023-08-17T00:02:51.775204+0000","last_peered":"2023-08-17T00:02:51.775204+0000","last_clean":"2023-08-17T00:02:51.775204+0000","last_became_active":"2023-08-17T00:02:51.338872+0000","last_became_peered":"2023-08-17T00:02:51.338872+0000","last_unstale":"2023-08-17T00:02:51.775204+0000","last_undegraded":"2023-08-17T00:02:51.775204+0000","last_fullsized":"2023-08-17T00:02:51.775204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799128+0000","last_change":"2023-08-17T00:02:51.788420+0000","last_active":"2023-08-17T00:02:51.799128+0000","last_peered":"2023-08-17T00:02:51.799128+0000","last_clean":"2023-08-17T00:02:51.799128+0000","last_became_active":"2023-08-17T00:02:51.788155+0000","last_became_peered":"2023-08-17T00:02:51.788155+0000","last_unstale":"2023-08-17T00:02:51.799128+0000","last_undegraded":"2023-08-17T00:02:51.799128+0000","last_fullsized":"2023-08-17T00:02:51.799128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773169+0000","last_change":"2023-08-17T00:02:51.337198+0000","last_active":"2023-08-17T00:02:51.773169+0000","last_peered":"2023-08-17T00:02:51.773169+0000","last_clean":"2023-08-17T00:02:51.773169+0000","last_became_active":"2023-08-17T00:02:51.336537+0000","last_became_peered":"2023-08-17T00:02:51.336537+0000","last_unstale":"2023-08-17T00:02:51.773169+0000","last_undegraded":"2023-08-17T00:02:51.773169+0000","last_fullsized":"2023-08-17T00:02:51.773169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795487+0000","last_change":"2023-08-17T00:02:51.787948+0000","last_active":"2023-08-17T00:02:51.795487+0000","last_peered":"2023-08-17T00:02:51.795487+0000","last_clean":"2023-08-17T00:02:51.795487+0000","last_became_active":"2023-08-17T00:02:51.787702+0000","last_became_peered":"2023-08-17T00:02:51.787702+0000","last_unstale":"2023-08-17T00:02:51.795487+0000","last_undegraded":"2023-08-17T00:02:51.795487+0000","last_fullsized":"2023-08-17T00:02:51.795487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801892+0000","last_change":"2023-08-17T00:02:51.348795+0000","last_active":"2023-08-17T00:02:51.801892+0000","last_peered":"2023-08-17T00:02:51.801892+0000","last_clean":"2023-08-17T00:02:51.801892+0000","last_became_active":"2023-08-17T00:02:51.341835+0000","last_became_peered":"2023-08-17T00:02:51.341835+0000","last_unstale":"2023-08-17T00:02:51.801892+0000","last_undegraded":"2023-08-17T00:02:51.801892+0000","last_fullsized":"2023-08-17T00:02:51.801892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802783+0000","last_change":"2023-08-17T00:02:51.797751+0000","last_active":"2023-08-17T00:02:51.802783+0000","last_peered":"2023-08-17T00:02:51.802783+0000","last_clean":"2023-08-17T00:02:51.802783+0000","last_became_active":"2023-08-17T00:02:51.797486+0000","last_became_peered":"2023-08-17T00:02:51.797486+0000","last_unstale":"2023-08-17T00:02:51.802783+0000","last_undegraded":"2023-08-17T00:02:51.802783+0000","last_fullsized":"2023-08-17T00:02:51.802783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793391+0000","last_change":"2023-08-17T00:02:51.344236+0000","last_active":"2023-08-17T00:02:51.793391+0000","last_peered":"2023-08-17T00:02:51.793391+0000","last_clean":"2023-08-17T00:02:51.793391+0000","last_became_active":"2023-08-17T00:02:51.343935+0000","last_became_peered":"2023-08-17T00:02:51.343935+0000","last_unstale":"2023-08-17T00:02:51.793391+0000","last_undegraded":"2023-08-17T00:02:51.793391+0000","last_fullsized":"2023-08-17T00:02:51.793391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796985+0000","last_change":"2023-08-17T00:02:51.781786+0000","last_active":"2023-08-17T00:02:51.796985+0000","last_peered":"2023-08-17T00:02:51.796985+0000","last_clean":"2023-08-17T00:02:51.796985+0000","last_became_active":"2023-08-17T00:02:51.781472+0000","last_became_peered":"2023-08-17T00:02:51.781472+0000","last_unstale":"2023-08-17T00:02:51.796985+0000","last_undegraded":"2023-08-17T00:02:51.796985+0000","last_fullsized":"2023-08-17T00:02:51.796985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802048+0000","last_change":"2023-08-17T00:02:51.339145+0000","last_active":"2023-08-17T00:02:51.802048+0000","last_peered":"2023-08-17T00:02:51.802048+0000","last_clean":"2023-08-17T00:02:51.802048+0000","last_became_active":"2023-08-17T00:02:51.338710+0000","last_became_peered":"2023-08-17T00:02:51.338710+0000","last_unstale":"2023-08-17T00:02:51.802048+0000","last_undegraded":"2023-08-17T00:02:51.802048+0000","last_fullsized":"2023-08-17T00:02:51.802048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784977+0000","last_change":"2023-08-17T00:02:51.779058+0000","last_active":"2023-08-17T00:02:51.784977+0000","last_peered":"2023-08-17T00:02:51.784977+0000","last_clean":"2023-08-17T00:02:51.784977+0000","last_became_active":"2023-08-17T00:02:51.778796+0000","last_became_peered":"2023-08-17T00:02:51.778796+0000","last_unstale":"2023-08-17T00:02:51.784977+0000","last_undegraded":"2023-08-17T00:02:51.784977+0000","last_fullsized":"2023-08-17T00:02:51.784977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774792+0000","last_change":"2023-08-17T00:02:51.337656+0000","last_active":"2023-08-17T00:02:51.774792+0000","last_peered":"2023-08-17T00:02:51.774792+0000","last_clean":"2023-08-17T00:02:51.774792+0000","last_became_active":"2023-08-17T00:02:51.337333+0000","last_became_peered":"2023-08-17T00:02:51.337333+0000","last_unstale":"2023-08-17T00:02:51.774792+0000","last_undegraded":"2023-08-17T00:02:51.774792+0000","last_fullsized":"2023-08-17T00:02:51.774792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784887+0000","last_change":"2023-08-17T00:02:51.779981+0000","last_active":"2023-08-17T00:02:51.784887+0000","last_peered":"2023-08-17T00:02:51.784887+0000","last_clean":"2023-08-17T00:02:51.784887+0000","last_became_active":"2023-08-17T00:02:51.779712+0000","last_became_peered":"2023-08-17T00:02:51.779712+0000","last_unstale":"2023-08-17T00:02:51.784887+0000","last_undegraded":"2023-08-17T00:02:51.784887+0000","last_fullsized":"2023-08-17T00:02:51.784887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775012+0000","last_change":"2023-08-17T00:02:51.339106+0000","last_active":"2023-08-17T00:02:51.775012+0000","last_peered":"2023-08-17T00:02:51.775012+0000","last_clean":"2023-08-17T00:02:51.775012+0000","last_became_active":"2023-08-17T00:02:51.338781+0000","last_became_peered":"2023-08-17T00:02:51.338781+0000","last_unstale":"2023-08-17T00:02:51.775012+0000","last_undegraded":"2023-08-17T00:02:51.775012+0000","last_fullsized":"2023-08-17T00:02:51.775012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782043+0000","last_change":"2023-08-17T00:02:51.778317+0000","last_active":"2023-08-17T00:02:51.782043+0000","last_peered":"2023-08-17T00:02:51.782043+0000","last_clean":"2023-08-17T00:02:51.782043+0000","last_became_active":"2023-08-17T00:02:51.778029+0000","last_became_peered":"2023-08-17T00:02:51.778029+0000","last_unstale":"2023-08-17T00:02:51.782043+0000","last_undegraded":"2023-08-17T00:02:51.782043+0000","last_fullsized":"2023-08-17T00:02:51.782043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793540+0000","last_change":"2023-08-17T00:02:51.345678+0000","last_active":"2023-08-17T00:02:51.793540+0000","last_peered":"2023-08-17T00:02:51.793540+0000","last_clean":"2023-08-17T00:02:51.793540+0000","last_became_active":"2023-08-17T00:02:51.345185+0000","last_became_peered":"2023-08-17T00:02:51.345185+0000","last_unstale":"2023-08-17T00:02:51.793540+0000","last_undegraded":"2023-08-17T00:02:51.793540+0000","last_fullsized":"2023-08-17T00:02:51.793540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":84071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:03:02.816 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:03:02.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.994+0000 7fd2cf59e700 1 Processor -- start 2023-08-17T00:03:03.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.994+0000 7fd2cf59e700 1 -- start start 2023-08-17T00:03:03.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2cf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2d0150e80 0x7fd2d00642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2cf59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d0151eb0 con 0x7fd2d00c3730 2023-08-17T00:03:03.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2cf59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d0151330 con 0x7fd2d00c3b10 2023-08-17T00:03:03.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2cf59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d0151610 con 0x7fd2d0150e80 2023-08-17T00:03:03.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2ce59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd2d00c3730 0x7fd2d00bc520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35754/0 (socket says 172.21.15.153:35754) 2023-08-17T00:03:03.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2ce59c700 1 -- 172.21.15.153:0/3377578115 learned_addr learned my addr 172.21.15.153:0/3377578115 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:03.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:02.998+0000 7fd2cdd9b700 1 --2- 172.21.15.153:0/3377578115 >> v2:172.21.15.153:3300/0 conn(0x7fd2d0150e80 0x7fd2d00642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cd59a700 1 -- 172.21.15.153:0/3377578115 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105576116 0 0) 0x7fd2d0151eb0 con 0x7fd2d00c3730 2023-08-17T00:03:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cd59a700 1 -- 172.21.15.153:0/3377578115 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b80033f0 con 0x7fd2d00c3730 2023-08-17T00:03:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/3377578115 >> v1:172.21.15.178:6789/0 conn(0x7fd2d00c3b10 legacy=0x7fd2d0066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/3377578115 >> v1:172.21.15.153:6789/0 conn(0x7fd2d00c3730 legacy=0x7fd2d00bc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cd59a700 1 -- 172.21.15.153:0/3377578115 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2565462790 0 0) 0x7fd2b80033f0 con 0x7fd2d00c3730 2023-08-17T00:03:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/3377578115 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d01518f0 con 0x7fd2d0150e80 2023-08-17T00:03:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cdd9b700 1 --2- 172.21.15.153:0/3377578115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d0150e80 0x7fd2d00642d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd2c4009760 tx=0x7fd2c4009060).ready entity=mon.0 client_cookie=6a0e34e16d2c62b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cd59a700 1 -- 172.21.15.153:0/3377578115 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0001470 con 0x7fd2d0150e80 2023-08-17T00:03:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cd59a700 1 -- 172.21.15.153:0/3377578115 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4009130 con 0x7fd2d0150e80 2023-08-17T00:03:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cd59a700 1 -- 172.21.15.153:0/3377578115 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4011610 con 0x7fd2d0150e80 2023-08-17T00:03:03.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 -- 172.21.15.153:0/3377578115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d0150e80 msgr2=0x7fd2d00642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/3377578115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d0150e80 0x7fd2d00642d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd2c4009760 tx=0x7fd2c4009060).stop 2023-08-17T00:03:03.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 -- 172.21.15.153:0/3377578115 shutdown_connections 2023-08-17T00:03:03.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/3377578115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d0150e80 0x7fd2d00642d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 -- 172.21.15.153:0/3377578115 >> 172.21.15.153:0/3377578115 conn(0x7fd2d0069700 msgr2=0x7fd2d0069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 -- 172.21.15.153:0/3377578115 shutdown_connections 2023-08-17T00:03:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.002+0000 7fd2cf59e700 1 -- 172.21.15.153:0/3377578115 wait complete. 2023-08-17T00:03:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 Processor -- start 2023-08-17T00:03:03.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 -- start start 2023-08-17T00:03:03.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d00c3730 0x7fd2d0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 0x7fd2d0152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d0150e80 0x7fd2d00c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0154290 con 0x7fd2d00c3b10 2023-08-17T00:03:03.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0152550 con 0x7fd2d00c3730 2023-08-17T00:03:03.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cf59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0152760 con 0x7fd2d0150e80 2023-08-17T00:03:03.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 0x7fd2d0152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 0x7fd2d0152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56160/0 (socket says 172.21.15.153:56160) 2023-08-17T00:03:03.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/2721752503 learned_addr learned my addr 172.21.15.153:0/2721752503 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d0150e80 msgr2=0x7fd2d00c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d0150e80 0x7fd2d00c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d00c3730 msgr2=0x7fd2d0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d00c3730 0x7fd2d0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 -- 172.21.15.153:0/2721752503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c40092a0 con 0x7fd2d00c3b10 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.006+0000 7fd2cdd9b700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 0x7fd2d0152060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fd2d006a770 tx=0x7fd2c4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40109a0 con 0x7fd2d00c3b10 2023-08-17T00:03:03.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c4010b00 con 0x7fd2d00c3b10 2023-08-17T00:03:03.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d0152a40 con 0x7fd2d00c3b10 2023-08-17T00:03:03.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4010e80 con 0x7fd2d00c3b10 2023-08-17T00:03:03.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d00ab5e0 con 0x7fd2d00c3b10 2023-08-17T00:03:03.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d00ab800 con 0x7fd2d00c3b10 2023-08-17T00:03:03.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd2c400f070 con 0x7fd2d00c3b10 2023-08-17T00:03:03.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.010+0000 7fd2be7fc700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b005a120 0x7fd2b005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.014+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2c40756e0 con 0x7fd2d00c3b10 2023-08-17T00:03:03.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.014+0000 7fd2ce59c700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b005a120 0x7fd2b005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.014+0000 7fd2ce59c700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b005a120 0x7fd2b005c5e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd2c0000c00 tx=0x7fd2c00012e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.018+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd2c4049080 con 0x7fd2d00c3b10 2023-08-17T00:03:03.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.174+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2d006b4c0 con 0x7fd2b005a120 2023-08-17T00:03:03.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.190+0000 7fd2be7fc700 1 -- 172.21.15.153:0/2721752503 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+336170 (secure 0 0 0) 0x7fd2d006b4c0 con 0x7fd2b005a120 2023-08-17T00:03:03.197 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:03.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.198+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b005a120 msgr2=0x7fd2b005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.198+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b005a120 0x7fd2b005c5e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fd2c0000c00 tx=0x7fd2c00012e0).stop 2023-08-17T00:03:03.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.198+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 msgr2=0x7fd2d0152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.198+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 0x7fd2d0152060 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fd2d006a770 tx=0x7fd2c4014000).stop 2023-08-17T00:03:03.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 shutdown_connections 2023-08-17T00:03:03.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b005a120 0x7fd2b005c5e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d0150e80 0x7fd2d00c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:03.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d00c3b10 0x7fd2d0152060 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 --2- 172.21.15.153:0/2721752503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d00c3730 0x7fd2d0153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:03.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 >> 172.21.15.153:0/2721752503 conn(0x7fd2d0069700 msgr2=0x7fd2d0065650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:03.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 shutdown_connections 2023-08-17T00:03:03.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.202+0000 7fd2cf59e700 1 -- 172.21.15.153:0/2721752503 wait complete. 2023-08-17T00:03:03.208 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:03:03.227 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-08-17T00:03:03.170460+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2378592,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752596128,"statfs":{"total":773094113280,"available":770658435072,"internally_reserved":0,"allocated":1867776,"data_stored":669868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003682"},"pg_stats":[{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.794978+0000","last_change":"2023-08-17T00:02:51.792258+0000","last_active":"2023-08-17T00:02:51.794978+0000","last_peered":"2023-08-17T00:02:51.794978+0000","last_clean":"2023-08-17T00:02:51.794978+0000","last_became_active":"2023-08-17T00:02:51.791987+0000","last_became_peered":"2023-08-17T00:02:51.791987+0000","last_unstale":"2023-08-17T00:02:51.794978+0000","last_undegraded":"2023-08-17T00:02:51.794978+0000","last_fullsized":"2023-08-17T00:02:51.794978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774573+0000","last_change":"2023-08-17T00:02:51.339335+0000","last_active":"2023-08-17T00:02:51.774573+0000","last_peered":"2023-08-17T00:02:51.774573+0000","last_clean":"2023-08-17T00:02:51.774573+0000","last_became_active":"2023-08-17T00:02:51.338962+0000","last_became_peered":"2023-08-17T00:02:51.338962+0000","last_unstale":"2023-08-17T00:02:51.774573+0000","last_undegraded":"2023-08-17T00:02:51.774573+0000","last_fullsized":"2023-08-17T00:02:51.774573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802676+0000","last_change":"2023-08-17T00:02:51.791169+0000","last_active":"2023-08-17T00:02:51.802676+0000","last_peered":"2023-08-17T00:02:51.802676+0000","last_clean":"2023-08-17T00:02:51.802676+0000","last_became_active":"2023-08-17T00:02:51.790753+0000","last_became_peered":"2023-08-17T00:02:51.790753+0000","last_unstale":"2023-08-17T00:02:51.802676+0000","last_undegraded":"2023-08-17T00:02:51.802676+0000","last_fullsized":"2023-08-17T00:02:51.802676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802597+0000","last_change":"2023-08-17T00:02:51.349913+0000","last_active":"2023-08-17T00:02:51.802597+0000","last_peered":"2023-08-17T00:02:51.802597+0000","last_clean":"2023-08-17T00:02:51.802597+0000","last_became_active":"2023-08-17T00:02:51.349595+0000","last_became_peered":"2023-08-17T00:02:51.349595+0000","last_unstale":"2023-08-17T00:02:51.802597+0000","last_undegraded":"2023-08-17T00:02:51.802597+0000","last_fullsized":"2023-08-17T00:02:51.802597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770825+0000","last_change":"2023-08-17T00:02:51.342535+0000","last_active":"2023-08-17T00:02:51.770825+0000","last_peered":"2023-08-17T00:02:51.770825+0000","last_clean":"2023-08-17T00:02:51.770825+0000","last_became_active":"2023-08-17T00:02:51.342270+0000","last_became_peered":"2023-08-17T00:02:51.342270+0000","last_unstale":"2023-08-17T00:02:51.770825+0000","last_undegraded":"2023-08-17T00:02:51.770825+0000","last_fullsized":"2023-08-17T00:02:51.770825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802817+0000","last_change":"2023-08-17T00:02:51.794750+0000","last_active":"2023-08-17T00:02:51.802817+0000","last_peered":"2023-08-17T00:02:51.802817+0000","last_clean":"2023-08-17T00:02:51.802817+0000","last_became_active":"2023-08-17T00:02:51.794394+0000","last_became_peered":"2023-08-17T00:02:51.794394+0000","last_unstale":"2023-08-17T00:02:51.802817+0000","last_undegraded":"2023-08-17T00:02:51.802817+0000","last_fullsized":"2023-08-17T00:02:51.802817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.786225+0000","last_change":"2023-08-17T00:02:51.360726+0000","last_active":"2023-08-17T00:02:51.786225+0000","last_peered":"2023-08-17T00:02:51.786225+0000","last_clean":"2023-08-17T00:02:51.786225+0000","last_became_active":"2023-08-17T00:02:51.360479+0000","last_became_peered":"2023-08-17T00:02:51.360479+0000","last_unstale":"2023-08-17T00:02:51.786225+0000","last_undegraded":"2023-08-17T00:02:51.786225+0000","last_fullsized":"2023-08-17T00:02:51.786225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800703+0000","last_change":"2023-08-17T00:02:51.787355+0000","last_active":"2023-08-17T00:02:51.800703+0000","last_peered":"2023-08-17T00:02:51.800703+0000","last_clean":"2023-08-17T00:02:51.800703+0000","last_became_active":"2023-08-17T00:02:51.787048+0000","last_became_peered":"2023-08-17T00:02:51.787048+0000","last_unstale":"2023-08-17T00:02:51.800703+0000","last_undegraded":"2023-08-17T00:02:51.800703+0000","last_fullsized":"2023-08-17T00:02:51.800703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803300+0000","last_change":"2023-08-17T00:02:51.338960+0000","last_active":"2023-08-17T00:02:51.803300+0000","last_peered":"2023-08-17T00:02:51.803300+0000","last_clean":"2023-08-17T00:02:51.803300+0000","last_became_active":"2023-08-17T00:02:51.338664+0000","last_became_peered":"2023-08-17T00:02:51.338664+0000","last_unstale":"2023-08-17T00:02:51.803300+0000","last_undegraded":"2023-08-17T00:02:51.803300+0000","last_fullsized":"2023-08-17T00:02:51.803300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802710+0000","last_change":"2023-08-17T00:02:51.799132+0000","last_active":"2023-08-17T00:02:51.802710+0000","last_peered":"2023-08-17T00:02:51.802710+0000","last_clean":"2023-08-17T00:02:51.802710+0000","last_became_active":"2023-08-17T00:02:51.798805+0000","last_became_peered":"2023-08-17T00:02:51.798805+0000","last_unstale":"2023-08-17T00:02:51.802710+0000","last_undegraded":"2023-08-17T00:02:51.802710+0000","last_fullsized":"2023-08-17T00:02:51.802710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775014+0000","last_change":"2023-08-17T00:02:51.346796+0000","last_active":"2023-08-17T00:02:51.775014+0000","last_peered":"2023-08-17T00:02:51.775014+0000","last_clean":"2023-08-17T00:02:51.775014+0000","last_became_active":"2023-08-17T00:02:51.346406+0000","last_became_peered":"2023-08-17T00:02:51.346406+0000","last_unstale":"2023-08-17T00:02:51.775014+0000","last_undegraded":"2023-08-17T00:02:51.775014+0000","last_fullsized":"2023-08-17T00:02:51.775014+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803115+0000","last_change":"2023-08-17T00:02:51.799601+0000","last_active":"2023-08-17T00:02:51.803115+0000","last_peered":"2023-08-17T00:02:51.803115+0000","last_clean":"2023-08-17T00:02:51.803115+0000","last_became_active":"2023-08-17T00:02:51.795434+0000","last_became_peered":"2023-08-17T00:02:51.795434+0000","last_unstale":"2023-08-17T00:02:51.803115+0000","last_undegraded":"2023-08-17T00:02:51.803115+0000","last_fullsized":"2023-08-17T00:02:51.803115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799219+0000","last_change":"2023-08-17T00:02:51.349039+0000","last_active":"2023-08-17T00:02:51.799219+0000","last_peered":"2023-08-17T00:02:51.799219+0000","last_clean":"2023-08-17T00:02:51.799219+0000","last_became_active":"2023-08-17T00:02:51.348701+0000","last_became_peered":"2023-08-17T00:02:51.348701+0000","last_unstale":"2023-08-17T00:02:51.799219+0000","last_undegraded":"2023-08-17T00:02:51.799219+0000","last_fullsized":"2023-08-17T00:02:51.799219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799387+0000","last_change":"2023-08-17T00:02:51.792387+0000","last_active":"2023-08-17T00:02:51.799387+0000","last_peered":"2023-08-17T00:02:51.799387+0000","last_clean":"2023-08-17T00:02:51.799387+0000","last_became_active":"2023-08-17T00:02:51.792133+0000","last_became_peered":"2023-08-17T00:02:51.792133+0000","last_unstale":"2023-08-17T00:02:51.799387+0000","last_undegraded":"2023-08-17T00:02:51.799387+0000","last_fullsized":"2023-08-17T00:02:51.799387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767037+0000","last_change":"2023-08-17T00:02:51.342138+0000","last_active":"2023-08-17T00:02:51.767037+0000","last_peered":"2023-08-17T00:02:51.767037+0000","last_clean":"2023-08-17T00:02:51.767037+0000","last_became_active":"2023-08-17T00:02:51.341316+0000","last_became_peered":"2023-08-17T00:02:51.341316+0000","last_unstale":"2023-08-17T00:02:51.767037+0000","last_undegraded":"2023-08-17T00:02:51.767037+0000","last_fullsized":"2023-08-17T00:02:51.767037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803438+0000","last_change":"2023-08-17T00:02:51.791960+0000","last_active":"2023-08-17T00:02:51.803438+0000","last_peered":"2023-08-17T00:02:51.803438+0000","last_clean":"2023-08-17T00:02:51.803438+0000","last_became_active":"2023-08-17T00:02:51.791680+0000","last_became_peered":"2023-08-17T00:02:51.791680+0000","last_unstale":"2023-08-17T00:02:51.803438+0000","last_undegraded":"2023-08-17T00:02:51.803438+0000","last_fullsized":"2023-08-17T00:02:51.803438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774692+0000","last_change":"2023-08-17T00:02:51.350536+0000","last_active":"2023-08-17T00:02:51.774692+0000","last_peered":"2023-08-17T00:02:51.774692+0000","last_clean":"2023-08-17T00:02:51.774692+0000","last_became_active":"2023-08-17T00:02:51.350180+0000","last_became_peered":"2023-08-17T00:02:51.350180+0000","last_unstale":"2023-08-17T00:02:51.774692+0000","last_undegraded":"2023-08-17T00:02:51.774692+0000","last_fullsized":"2023-08-17T00:02:51.774692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802758+0000","last_change":"2023-08-17T00:02:51.797907+0000","last_active":"2023-08-17T00:02:51.802758+0000","last_peered":"2023-08-17T00:02:51.802758+0000","last_clean":"2023-08-17T00:02:51.802758+0000","last_became_active":"2023-08-17T00:02:51.797480+0000","last_became_peered":"2023-08-17T00:02:51.797480+0000","last_unstale":"2023-08-17T00:02:51.802758+0000","last_undegraded":"2023-08-17T00:02:51.802758+0000","last_fullsized":"2023-08-17T00:02:51.802758+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770167+0000","last_change":"2023-08-17T00:02:51.351104+0000","last_active":"2023-08-17T00:02:51.770167+0000","last_peered":"2023-08-17T00:02:51.770167+0000","last_clean":"2023-08-17T00:02:51.770167+0000","last_became_active":"2023-08-17T00:02:51.350791+0000","last_became_peered":"2023-08-17T00:02:51.350791+0000","last_unstale":"2023-08-17T00:02:51.770167+0000","last_undegraded":"2023-08-17T00:02:51.770167+0000","last_fullsized":"2023-08-17T00:02:51.770167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802476+0000","last_change":"2023-08-17T00:02:51.794083+0000","last_active":"2023-08-17T00:02:51.802476+0000","last_peered":"2023-08-17T00:02:51.802476+0000","last_clean":"2023-08-17T00:02:51.802476+0000","last_became_active":"2023-08-17T00:02:51.793757+0000","last_became_peered":"2023-08-17T00:02:51.793757+0000","last_unstale":"2023-08-17T00:02:51.802476+0000","last_undegraded":"2023-08-17T00:02:51.802476+0000","last_fullsized":"2023-08-17T00:02:51.802476+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776347+0000","last_change":"2023-08-17T00:02:51.350940+0000","last_active":"2023-08-17T00:02:51.776347+0000","last_peered":"2023-08-17T00:02:51.776347+0000","last_clean":"2023-08-17T00:02:51.776347+0000","last_became_active":"2023-08-17T00:02:51.350441+0000","last_became_peered":"2023-08-17T00:02:51.350441+0000","last_unstale":"2023-08-17T00:02:51.776347+0000","last_undegraded":"2023-08-17T00:02:51.776347+0000","last_fullsized":"2023-08-17T00:02:51.776347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782080+0000","last_change":"2023-08-17T00:02:51.778464+0000","last_active":"2023-08-17T00:02:51.782080+0000","last_peered":"2023-08-17T00:02:51.782080+0000","last_clean":"2023-08-17T00:02:51.782080+0000","last_became_active":"2023-08-17T00:02:51.778226+0000","last_became_peered":"2023-08-17T00:02:51.778226+0000","last_unstale":"2023-08-17T00:02:51.782080+0000","last_undegraded":"2023-08-17T00:02:51.782080+0000","last_fullsized":"2023-08-17T00:02:51.782080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"22'1","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-08-17T00:02:52.768272+0000","last_change":"2023-08-17T00:02:51.340239+0000","last_active":"2023-08-17T00:02:52.768272+0000","last_peered":"2023-08-17T00:02:52.768272+0000","last_clean":"2023-08-17T00:02:52.768272+0000","last_became_active":"2023-08-17T00:02:51.339974+0000","last_became_peered":"2023-08-17T00:02:51.339974+0000","last_unstale":"2023-08-17T00:02:52.768272+0000","last_undegraded":"2023-08-17T00:02:52.768272+0000","last_fullsized":"2023-08-17T00:02:52.768272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798032+0000","last_change":"2023-08-17T00:02:51.792139+0000","last_active":"2023-08-17T00:02:51.798032+0000","last_peered":"2023-08-17T00:02:51.798032+0000","last_clean":"2023-08-17T00:02:51.798032+0000","last_became_active":"2023-08-17T00:02:51.791871+0000","last_became_peered":"2023-08-17T00:02:51.791871+0000","last_unstale":"2023-08-17T00:02:51.798032+0000","last_undegraded":"2023-08-17T00:02:51.798032+0000","last_fullsized":"2023-08-17T00:02:51.798032+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776993+0000","last_change":"2023-08-17T00:02:51.346632+0000","last_active":"2023-08-17T00:02:51.776993+0000","last_peered":"2023-08-17T00:02:51.776993+0000","last_clean":"2023-08-17T00:02:51.776993+0000","last_became_active":"2023-08-17T00:02:51.346360+0000","last_became_peered":"2023-08-17T00:02:51.346360+0000","last_unstale":"2023-08-17T00:02:51.776993+0000","last_undegraded":"2023-08-17T00:02:51.776993+0000","last_fullsized":"2023-08-17T00:02:51.776993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795767+0000","last_change":"2023-08-17T00:02:51.791363+0000","last_active":"2023-08-17T00:02:51.795767+0000","last_peered":"2023-08-17T00:02:51.795767+0000","last_clean":"2023-08-17T00:02:51.795767+0000","last_became_active":"2023-08-17T00:02:51.791061+0000","last_became_peered":"2023-08-17T00:02:51.791061+0000","last_unstale":"2023-08-17T00:02:51.795767+0000","last_undegraded":"2023-08-17T00:02:51.795767+0000","last_fullsized":"2023-08-17T00:02:51.795767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780186+0000","last_change":"2023-08-17T00:02:51.354878+0000","last_active":"2023-08-17T00:02:51.780186+0000","last_peered":"2023-08-17T00:02:51.780186+0000","last_clean":"2023-08-17T00:02:51.780186+0000","last_became_active":"2023-08-17T00:02:51.354620+0000","last_became_peered":"2023-08-17T00:02:51.354620+0000","last_unstale":"2023-08-17T00:02:51.780186+0000","last_undegraded":"2023-08-17T00:02:51.780186+0000","last_fullsized":"2023-08-17T00:02:51.780186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790458+0000","last_change":"2023-08-17T00:02:51.786538+0000","last_active":"2023-08-17T00:02:51.790458+0000","last_peered":"2023-08-17T00:02:51.790458+0000","last_clean":"2023-08-17T00:02:51.790458+0000","last_became_active":"2023-08-17T00:02:51.786215+0000","last_became_peered":"2023-08-17T00:02:51.786215+0000","last_unstale":"2023-08-17T00:02:51.790458+0000","last_undegraded":"2023-08-17T00:02:51.790458+0000","last_fullsized":"2023-08-17T00:02:51.790458+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775020+0000","last_change":"2023-08-17T00:02:51.350207+0000","last_active":"2023-08-17T00:02:51.775020+0000","last_peered":"2023-08-17T00:02:51.775020+0000","last_clean":"2023-08-17T00:02:51.775020+0000","last_became_active":"2023-08-17T00:02:51.349890+0000","last_became_peered":"2023-08-17T00:02:51.349890+0000","last_unstale":"2023-08-17T00:02:51.775020+0000","last_undegraded":"2023-08-17T00:02:51.775020+0000","last_fullsized":"2023-08-17T00:02:51.775020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790419+0000","last_change":"2023-08-17T00:02:51.787178+0000","last_active":"2023-08-17T00:02:51.790419+0000","last_peered":"2023-08-17T00:02:51.790419+0000","last_clean":"2023-08-17T00:02:51.790419+0000","last_became_active":"2023-08-17T00:02:51.786896+0000","last_became_peered":"2023-08-17T00:02:51.786896+0000","last_unstale":"2023-08-17T00:02:51.790419+0000","last_undegraded":"2023-08-17T00:02:51.790419+0000","last_fullsized":"2023-08-17T00:02:51.790419+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769107+0000","last_change":"2023-08-17T00:02:51.351372+0000","last_active":"2023-08-17T00:02:51.769107+0000","last_peered":"2023-08-17T00:02:51.769107+0000","last_clean":"2023-08-17T00:02:51.769107+0000","last_became_active":"2023-08-17T00:02:51.350520+0000","last_became_peered":"2023-08-17T00:02:51.350520+0000","last_unstale":"2023-08-17T00:02:51.769107+0000","last_undegraded":"2023-08-17T00:02:51.769107+0000","last_fullsized":"2023-08-17T00:02:51.769107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790239+0000","last_change":"2023-08-17T00:02:51.786052+0000","last_active":"2023-08-17T00:02:51.790239+0000","last_peered":"2023-08-17T00:02:51.790239+0000","last_clean":"2023-08-17T00:02:51.790239+0000","last_became_active":"2023-08-17T00:02:51.784778+0000","last_became_peered":"2023-08-17T00:02:51.784778+0000","last_unstale":"2023-08-17T00:02:51.790239+0000","last_undegraded":"2023-08-17T00:02:51.790239+0000","last_fullsized":"2023-08-17T00:02:51.790239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780523+0000","last_change":"2023-08-17T00:02:51.352623+0000","last_active":"2023-08-17T00:02:51.780523+0000","last_peered":"2023-08-17T00:02:51.780523+0000","last_clean":"2023-08-17T00:02:51.780523+0000","last_became_active":"2023-08-17T00:02:51.352286+0000","last_became_peered":"2023-08-17T00:02:51.352286+0000","last_unstale":"2023-08-17T00:02:51.780523+0000","last_undegraded":"2023-08-17T00:02:51.780523+0000","last_fullsized":"2023-08-17T00:02:51.780523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803784+0000","last_change":"2023-08-17T00:02:51.801853+0000","last_active":"2023-08-17T00:02:51.803784+0000","last_peered":"2023-08-17T00:02:51.803784+0000","last_clean":"2023-08-17T00:02:51.803784+0000","last_became_active":"2023-08-17T00:02:51.801540+0000","last_became_peered":"2023-08-17T00:02:51.801540+0000","last_unstale":"2023-08-17T00:02:51.803784+0000","last_undegraded":"2023-08-17T00:02:51.803784+0000","last_fullsized":"2023-08-17T00:02:51.803784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:51.338361+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:51.338040+0000","last_became_peered":"2023-08-17T00:02:51.338040+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802658+0000","last_change":"2023-08-17T00:02:51.788068+0000","last_active":"2023-08-17T00:02:51.802658+0000","last_peered":"2023-08-17T00:02:51.802658+0000","last_clean":"2023-08-17T00:02:51.802658+0000","last_became_active":"2023-08-17T00:02:51.787734+0000","last_became_peered":"2023-08-17T00:02:51.787734+0000","last_unstale":"2023-08-17T00:02:51.802658+0000","last_undegraded":"2023-08-17T00:02:51.802658+0000","last_fullsized":"2023-08-17T00:02:51.802658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801530+0000","last_change":"2023-08-17T00:02:51.350761+0000","last_active":"2023-08-17T00:02:51.801530+0000","last_peered":"2023-08-17T00:02:51.801530+0000","last_clean":"2023-08-17T00:02:51.801530+0000","last_became_active":"2023-08-17T00:02:51.347875+0000","last_became_peered":"2023-08-17T00:02:51.347875+0000","last_unstale":"2023-08-17T00:02:51.801530+0000","last_undegraded":"2023-08-17T00:02:51.801530+0000","last_fullsized":"2023-08-17T00:02:51.801530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799118+0000","last_change":"2023-08-17T00:02:51.788452+0000","last_active":"2023-08-17T00:02:51.799118+0000","last_peered":"2023-08-17T00:02:51.799118+0000","last_clean":"2023-08-17T00:02:51.799118+0000","last_became_active":"2023-08-17T00:02:51.788147+0000","last_became_peered":"2023-08-17T00:02:51.788147+0000","last_unstale":"2023-08-17T00:02:51.799118+0000","last_undegraded":"2023-08-17T00:02:51.799118+0000","last_fullsized":"2023-08-17T00:02:51.799118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789445+0000","last_change":"2023-08-17T00:02:51.355054+0000","last_active":"2023-08-17T00:02:51.789445+0000","last_peered":"2023-08-17T00:02:51.789445+0000","last_clean":"2023-08-17T00:02:51.789445+0000","last_became_active":"2023-08-17T00:02:51.354677+0000","last_became_peered":"2023-08-17T00:02:51.354677+0000","last_unstale":"2023-08-17T00:02:51.789445+0000","last_undegraded":"2023-08-17T00:02:51.789445+0000","last_fullsized":"2023-08-17T00:02:51.789445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802453+0000","last_change":"2023-08-17T00:02:51.794268+0000","last_active":"2023-08-17T00:02:51.802453+0000","last_peered":"2023-08-17T00:02:51.802453+0000","last_clean":"2023-08-17T00:02:51.802453+0000","last_became_active":"2023-08-17T00:02:51.793909+0000","last_became_peered":"2023-08-17T00:02:51.793909+0000","last_unstale":"2023-08-17T00:02:51.802453+0000","last_undegraded":"2023-08-17T00:02:51.802453+0000","last_fullsized":"2023-08-17T00:02:51.802453+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802558+0000","last_change":"2023-08-17T00:02:51.351466+0000","last_active":"2023-08-17T00:02:51.802558+0000","last_peered":"2023-08-17T00:02:51.802558+0000","last_clean":"2023-08-17T00:02:51.802558+0000","last_became_active":"2023-08-17T00:02:51.350746+0000","last_became_peered":"2023-08-17T00:02:51.350746+0000","last_unstale":"2023-08-17T00:02:51.802558+0000","last_undegraded":"2023-08-17T00:02:51.802558+0000","last_fullsized":"2023-08-17T00:02:51.802558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799918+0000","last_change":"2023-08-17T00:02:51.789270+0000","last_active":"2023-08-17T00:02:51.799918+0000","last_peered":"2023-08-17T00:02:51.799918+0000","last_clean":"2023-08-17T00:02:51.799918+0000","last_became_active":"2023-08-17T00:02:51.789010+0000","last_became_peered":"2023-08-17T00:02:51.789010+0000","last_unstale":"2023-08-17T00:02:51.799918+0000","last_undegraded":"2023-08-17T00:02:51.799918+0000","last_fullsized":"2023-08-17T00:02:51.799918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766901+0000","last_change":"2023-08-17T00:02:51.334024+0000","last_active":"2023-08-17T00:02:51.766901+0000","last_peered":"2023-08-17T00:02:51.766901+0000","last_clean":"2023-08-17T00:02:51.766901+0000","last_became_active":"2023-08-17T00:02:51.332857+0000","last_became_peered":"2023-08-17T00:02:51.332857+0000","last_unstale":"2023-08-17T00:02:51.766901+0000","last_undegraded":"2023-08-17T00:02:51.766901+0000","last_fullsized":"2023-08-17T00:02:51.766901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799394+0000","last_change":"2023-08-17T00:02:51.792683+0000","last_active":"2023-08-17T00:02:51.799394+0000","last_peered":"2023-08-17T00:02:51.799394+0000","last_clean":"2023-08-17T00:02:51.799394+0000","last_became_active":"2023-08-17T00:02:51.792366+0000","last_became_peered":"2023-08-17T00:02:51.792366+0000","last_unstale":"2023-08-17T00:02:51.799394+0000","last_undegraded":"2023-08-17T00:02:51.799394+0000","last_fullsized":"2023-08-17T00:02:51.799394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771706+0000","last_change":"2023-08-17T00:02:51.349003+0000","last_active":"2023-08-17T00:02:51.771706+0000","last_peered":"2023-08-17T00:02:51.771706+0000","last_clean":"2023-08-17T00:02:51.771706+0000","last_became_active":"2023-08-17T00:02:51.347537+0000","last_became_peered":"2023-08-17T00:02:51.347537+0000","last_unstale":"2023-08-17T00:02:51.771706+0000","last_undegraded":"2023-08-17T00:02:51.771706+0000","last_fullsized":"2023-08-17T00:02:51.771706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802086+0000","last_change":"2023-08-17T00:02:51.792987+0000","last_active":"2023-08-17T00:02:51.802086+0000","last_peered":"2023-08-17T00:02:51.802086+0000","last_clean":"2023-08-17T00:02:51.802086+0000","last_became_active":"2023-08-17T00:02:51.792614+0000","last_became_peered":"2023-08-17T00:02:51.792614+0000","last_unstale":"2023-08-17T00:02:51.802086+0000","last_undegraded":"2023-08-17T00:02:51.802086+0000","last_fullsized":"2023-08-17T00:02:51.802086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.767113+0000","last_change":"2023-08-17T00:02:51.341657+0000","last_active":"2023-08-17T00:02:51.767113+0000","last_peered":"2023-08-17T00:02:51.767113+0000","last_clean":"2023-08-17T00:02:51.767113+0000","last_became_active":"2023-08-17T00:02:51.340926+0000","last_became_peered":"2023-08-17T00:02:51.340926+0000","last_unstale":"2023-08-17T00:02:51.767113+0000","last_undegraded":"2023-08-17T00:02:51.767113+0000","last_fullsized":"2023-08-17T00:02:51.767113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802511+0000","last_change":"2023-08-17T00:02:51.794147+0000","last_active":"2023-08-17T00:02:51.802511+0000","last_peered":"2023-08-17T00:02:51.802511+0000","last_clean":"2023-08-17T00:02:51.802511+0000","last_became_active":"2023-08-17T00:02:51.793842+0000","last_became_peered":"2023-08-17T00:02:51.793842+0000","last_unstale":"2023-08-17T00:02:51.802511+0000","last_undegraded":"2023-08-17T00:02:51.802511+0000","last_fullsized":"2023-08-17T00:02:51.802511+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770938+0000","last_change":"2023-08-17T00:02:51.344894+0000","last_active":"2023-08-17T00:02:51.770938+0000","last_peered":"2023-08-17T00:02:51.770938+0000","last_clean":"2023-08-17T00:02:51.770938+0000","last_became_active":"2023-08-17T00:02:51.344238+0000","last_became_peered":"2023-08-17T00:02:51.344238+0000","last_unstale":"2023-08-17T00:02:51.770938+0000","last_undegraded":"2023-08-17T00:02:51.770938+0000","last_fullsized":"2023-08-17T00:02:51.770938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802630+0000","last_change":"2023-08-17T00:02:51.793264+0000","last_active":"2023-08-17T00:02:51.802630+0000","last_peered":"2023-08-17T00:02:51.802630+0000","last_clean":"2023-08-17T00:02:51.802630+0000","last_became_active":"2023-08-17T00:02:51.792918+0000","last_became_peered":"2023-08-17T00:02:51.792918+0000","last_unstale":"2023-08-17T00:02:51.802630+0000","last_undegraded":"2023-08-17T00:02:51.802630+0000","last_fullsized":"2023-08-17T00:02:51.802630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775453+0000","last_change":"2023-08-17T00:02:51.339413+0000","last_active":"2023-08-17T00:02:51.775453+0000","last_peered":"2023-08-17T00:02:51.775453+0000","last_clean":"2023-08-17T00:02:51.775453+0000","last_became_active":"2023-08-17T00:02:51.339094+0000","last_became_peered":"2023-08-17T00:02:51.339094+0000","last_unstale":"2023-08-17T00:02:51.775453+0000","last_undegraded":"2023-08-17T00:02:51.775453+0000","last_fullsized":"2023-08-17T00:02:51.775453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802813+0000","last_change":"2023-08-17T00:02:51.795000+0000","last_active":"2023-08-17T00:02:51.802813+0000","last_peered":"2023-08-17T00:02:51.802813+0000","last_clean":"2023-08-17T00:02:51.802813+0000","last_became_active":"2023-08-17T00:02:51.794722+0000","last_became_peered":"2023-08-17T00:02:51.794722+0000","last_unstale":"2023-08-17T00:02:51.802813+0000","last_undegraded":"2023-08-17T00:02:51.802813+0000","last_fullsized":"2023-08-17T00:02:51.802813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.776484+0000","last_change":"2023-08-17T00:02:51.343058+0000","last_active":"2023-08-17T00:02:51.776484+0000","last_peered":"2023-08-17T00:02:51.776484+0000","last_clean":"2023-08-17T00:02:51.776484+0000","last_became_active":"2023-08-17T00:02:51.342764+0000","last_became_peered":"2023-08-17T00:02:51.342764+0000","last_unstale":"2023-08-17T00:02:51.776484+0000","last_undegraded":"2023-08-17T00:02:51.776484+0000","last_fullsized":"2023-08-17T00:02:51.776484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803681+0000","last_change":"2023-08-17T00:02:51.800364+0000","last_active":"2023-08-17T00:02:51.803681+0000","last_peered":"2023-08-17T00:02:51.803681+0000","last_clean":"2023-08-17T00:02:51.803681+0000","last_became_active":"2023-08-17T00:02:51.800036+0000","last_became_peered":"2023-08-17T00:02:51.800036+0000","last_unstale":"2023-08-17T00:02:51.803681+0000","last_undegraded":"2023-08-17T00:02:51.803681+0000","last_fullsized":"2023-08-17T00:02:51.803681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772373+0000","last_change":"2023-08-17T00:02:51.341857+0000","last_active":"2023-08-17T00:02:51.772373+0000","last_peered":"2023-08-17T00:02:51.772373+0000","last_clean":"2023-08-17T00:02:51.772373+0000","last_became_active":"2023-08-17T00:02:51.339418+0000","last_became_peered":"2023-08-17T00:02:51.339418+0000","last_unstale":"2023-08-17T00:02:51.772373+0000","last_undegraded":"2023-08-17T00:02:51.772373+0000","last_fullsized":"2023-08-17T00:02:51.772373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800439+0000","last_change":"2023-08-17T00:02:51.784928+0000","last_active":"2023-08-17T00:02:51.800439+0000","last_peered":"2023-08-17T00:02:51.800439+0000","last_clean":"2023-08-17T00:02:51.800439+0000","last_became_active":"2023-08-17T00:02:51.784604+0000","last_became_peered":"2023-08-17T00:02:51.784604+0000","last_unstale":"2023-08-17T00:02:51.800439+0000","last_undegraded":"2023-08-17T00:02:51.800439+0000","last_fullsized":"2023-08-17T00:02:51.800439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793473+0000","last_change":"2023-08-17T00:02:51.343843+0000","last_active":"2023-08-17T00:02:51.793473+0000","last_peered":"2023-08-17T00:02:51.793473+0000","last_clean":"2023-08-17T00:02:51.793473+0000","last_became_active":"2023-08-17T00:02:51.340985+0000","last_became_peered":"2023-08-17T00:02:51.340985+0000","last_unstale":"2023-08-17T00:02:51.793473+0000","last_undegraded":"2023-08-17T00:02:51.793473+0000","last_fullsized":"2023-08-17T00:02:51.793473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800767+0000","last_change":"2023-08-17T00:02:51.785256+0000","last_active":"2023-08-17T00:02:51.800767+0000","last_peered":"2023-08-17T00:02:51.800767+0000","last_clean":"2023-08-17T00:02:51.800767+0000","last_became_active":"2023-08-17T00:02:51.784962+0000","last_became_peered":"2023-08-17T00:02:51.784962+0000","last_unstale":"2023-08-17T00:02:51.800767+0000","last_undegraded":"2023-08-17T00:02:51.800767+0000","last_fullsized":"2023-08-17T00:02:51.800767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802680+0000","last_change":"2023-08-17T00:02:51.350355+0000","last_active":"2023-08-17T00:02:51.802680+0000","last_peered":"2023-08-17T00:02:51.802680+0000","last_clean":"2023-08-17T00:02:51.802680+0000","last_became_active":"2023-08-17T00:02:51.350063+0000","last_became_peered":"2023-08-17T00:02:51.350063+0000","last_unstale":"2023-08-17T00:02:51.802680+0000","last_undegraded":"2023-08-17T00:02:51.802680+0000","last_fullsized":"2023-08-17T00:02:51.802680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798718+0000","last_change":"2023-08-17T00:02:51.785857+0000","last_active":"2023-08-17T00:02:51.798718+0000","last_peered":"2023-08-17T00:02:51.798718+0000","last_clean":"2023-08-17T00:02:51.798718+0000","last_became_active":"2023-08-17T00:02:51.785548+0000","last_became_peered":"2023-08-17T00:02:51.785548+0000","last_unstale":"2023-08-17T00:02:51.798718+0000","last_undegraded":"2023-08-17T00:02:51.798718+0000","last_fullsized":"2023-08-17T00:02:51.798718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770921+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:02:51.770921+0000","last_peered":"2023-08-17T00:02:51.770921+0000","last_clean":"2023-08-17T00:02:51.770921+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:02:51.770921+0000","last_undegraded":"2023-08-17T00:02:51.770921+0000","last_fullsized":"2023-08-17T00:02:51.770921+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772354+0000","last_change":"2023-08-17T00:02:51.349328+0000","last_active":"2023-08-17T00:02:51.772354+0000","last_peered":"2023-08-17T00:02:51.772354+0000","last_clean":"2023-08-17T00:02:51.772354+0000","last_became_active":"2023-08-17T00:02:51.348912+0000","last_became_peered":"2023-08-17T00:02:51.348912+0000","last_unstale":"2023-08-17T00:02:51.772354+0000","last_undegraded":"2023-08-17T00:02:51.772354+0000","last_fullsized":"2023-08-17T00:02:51.772354+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798870+0000","last_change":"2023-08-17T00:02:51.786668+0000","last_active":"2023-08-17T00:02:51.798870+0000","last_peered":"2023-08-17T00:02:51.798870+0000","last_clean":"2023-08-17T00:02:51.798870+0000","last_became_active":"2023-08-17T00:02:51.785985+0000","last_became_peered":"2023-08-17T00:02:51.785985+0000","last_unstale":"2023-08-17T00:02:51.798870+0000","last_undegraded":"2023-08-17T00:02:51.798870+0000","last_fullsized":"2023-08-17T00:02:51.798870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.772460+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:02:51.772460+0000","last_peered":"2023-08-17T00:02:51.772460+0000","last_clean":"2023-08-17T00:02:51.772460+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:02:51.772460+0000","last_undegraded":"2023-08-17T00:02:51.772460+0000","last_fullsized":"2023-08-17T00:02:51.772460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797184+0000","last_change":"2023-08-17T00:02:51.335559+0000","last_active":"2023-08-17T00:02:51.797184+0000","last_peered":"2023-08-17T00:02:51.797184+0000","last_clean":"2023-08-17T00:02:51.797184+0000","last_became_active":"2023-08-17T00:02:51.335182+0000","last_became_peered":"2023-08-17T00:02:51.335182+0000","last_unstale":"2023-08-17T00:02:51.797184+0000","last_undegraded":"2023-08-17T00:02:51.797184+0000","last_fullsized":"2023-08-17T00:02:51.797184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801377+0000","last_change":"2023-08-17T00:02:51.787570+0000","last_active":"2023-08-17T00:02:51.801377+0000","last_peered":"2023-08-17T00:02:51.801377+0000","last_clean":"2023-08-17T00:02:51.801377+0000","last_became_active":"2023-08-17T00:02:51.787256+0000","last_became_peered":"2023-08-17T00:02:51.787256+0000","last_unstale":"2023-08-17T00:02:51.801377+0000","last_undegraded":"2023-08-17T00:02:51.801377+0000","last_fullsized":"2023-08-17T00:02:51.801377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773440+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:02:51.773440+0000","last_peered":"2023-08-17T00:02:51.773440+0000","last_clean":"2023-08-17T00:02:51.773440+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:02:51.773440+0000","last_undegraded":"2023-08-17T00:02:51.773440+0000","last_fullsized":"2023-08-17T00:02:51.773440+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.780285+0000","last_change":"2023-08-17T00:02:51.343304+0000","last_active":"2023-08-17T00:02:51.780285+0000","last_peered":"2023-08-17T00:02:51.780285+0000","last_clean":"2023-08-17T00:02:51.780285+0000","last_became_active":"2023-08-17T00:02:51.343028+0000","last_became_peered":"2023-08-17T00:02:51.343028+0000","last_unstale":"2023-08-17T00:02:51.780285+0000","last_undegraded":"2023-08-17T00:02:51.780285+0000","last_fullsized":"2023-08-17T00:02:51.780285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796085+0000","last_change":"2023-08-17T00:02:51.788638+0000","last_active":"2023-08-17T00:02:51.796085+0000","last_peered":"2023-08-17T00:02:51.796085+0000","last_clean":"2023-08-17T00:02:51.796085+0000","last_became_active":"2023-08-17T00:02:51.787316+0000","last_became_peered":"2023-08-17T00:02:51.787316+0000","last_unstale":"2023-08-17T00:02:51.796085+0000","last_undegraded":"2023-08-17T00:02:51.796085+0000","last_fullsized":"2023-08-17T00:02:51.796085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774757+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:02:51.774757+0000","last_peered":"2023-08-17T00:02:51.774757+0000","last_clean":"2023-08-17T00:02:51.774757+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:02:51.774757+0000","last_undegraded":"2023-08-17T00:02:51.774757+0000","last_fullsized":"2023-08-17T00:02:51.774757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768333+0000","last_change":"2023-08-17T00:02:51.340968+0000","last_active":"2023-08-17T00:02:51.768333+0000","last_peered":"2023-08-17T00:02:51.768333+0000","last_clean":"2023-08-17T00:02:51.768333+0000","last_became_active":"2023-08-17T00:02:51.340352+0000","last_became_peered":"2023-08-17T00:02:51.340352+0000","last_unstale":"2023-08-17T00:02:51.768333+0000","last_undegraded":"2023-08-17T00:02:51.768333+0000","last_fullsized":"2023-08-17T00:02:51.768333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.789054+0000","last_change":"2023-08-17T00:02:51.786773+0000","last_active":"2023-08-17T00:02:51.789054+0000","last_peered":"2023-08-17T00:02:51.789054+0000","last_clean":"2023-08-17T00:02:51.789054+0000","last_became_active":"2023-08-17T00:02:51.786393+0000","last_became_peered":"2023-08-17T00:02:51.786393+0000","last_unstale":"2023-08-17T00:02:51.789054+0000","last_undegraded":"2023-08-17T00:02:51.789054+0000","last_fullsized":"2023-08-17T00:02:51.789054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769417+0000","last_change":"2023-08-17T00:02:51.345508+0000","last_active":"2023-08-17T00:02:51.769417+0000","last_peered":"2023-08-17T00:02:51.769417+0000","last_clean":"2023-08-17T00:02:51.769417+0000","last_became_active":"2023-08-17T00:02:51.345226+0000","last_became_peered":"2023-08-17T00:02:51.345226+0000","last_unstale":"2023-08-17T00:02:51.769417+0000","last_undegraded":"2023-08-17T00:02:51.769417+0000","last_fullsized":"2023-08-17T00:02:51.769417+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769322+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:02:51.769322+0000","last_peered":"2023-08-17T00:02:51.769322+0000","last_clean":"2023-08-17T00:02:51.769322+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:02:51.769322+0000","last_undegraded":"2023-08-17T00:02:51.769322+0000","last_fullsized":"2023-08-17T00:02:51.769322+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799559+0000","last_change":"2023-08-17T00:02:51.796855+0000","last_active":"2023-08-17T00:02:51.799559+0000","last_peered":"2023-08-17T00:02:51.799559+0000","last_clean":"2023-08-17T00:02:51.799559+0000","last_became_active":"2023-08-17T00:02:51.796562+0000","last_became_peered":"2023-08-17T00:02:51.796562+0000","last_unstale":"2023-08-17T00:02:51.799559+0000","last_undegraded":"2023-08-17T00:02:51.799559+0000","last_fullsized":"2023-08-17T00:02:51.799559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775324+0000","last_change":"2023-08-17T00:02:51.350272+0000","last_active":"2023-08-17T00:02:51.775324+0000","last_peered":"2023-08-17T00:02:51.775324+0000","last_clean":"2023-08-17T00:02:51.775324+0000","last_became_active":"2023-08-17T00:02:51.350003+0000","last_became_peered":"2023-08-17T00:02:51.350003+0000","last_unstale":"2023-08-17T00:02:51.775324+0000","last_undegraded":"2023-08-17T00:02:51.775324+0000","last_fullsized":"2023-08-17T00:02:51.775324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.781497+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:02:51.781497+0000","last_peered":"2023-08-17T00:02:51.781497+0000","last_clean":"2023-08-17T00:02:51.781497+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:02:51.781497+0000","last_undegraded":"2023-08-17T00:02:51.781497+0000","last_fullsized":"2023-08-17T00:02:51.781497+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798023+0000","last_change":"2023-08-17T00:02:51.790967+0000","last_active":"2023-08-17T00:02:51.798023+0000","last_peered":"2023-08-17T00:02:51.798023+0000","last_clean":"2023-08-17T00:02:51.798023+0000","last_became_active":"2023-08-17T00:02:51.787858+0000","last_became_peered":"2023-08-17T00:02:51.787858+0000","last_unstale":"2023-08-17T00:02:51.798023+0000","last_undegraded":"2023-08-17T00:02:51.798023+0000","last_fullsized":"2023-08-17T00:02:51.798023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.777967+0000","last_change":"2023-08-17T00:02:51.348713+0000","last_active":"2023-08-17T00:02:51.777967+0000","last_peered":"2023-08-17T00:02:51.777967+0000","last_clean":"2023-08-17T00:02:51.777967+0000","last_became_active":"2023-08-17T00:02:51.348409+0000","last_became_peered":"2023-08-17T00:02:51.348409+0000","last_unstale":"2023-08-17T00:02:51.777967+0000","last_undegraded":"2023-08-17T00:02:51.777967+0000","last_fullsized":"2023-08-17T00:02:51.777967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.770267+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:02:51.770267+0000","last_peered":"2023-08-17T00:02:51.770267+0000","last_clean":"2023-08-17T00:02:51.770267+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:02:51.770267+0000","last_undegraded":"2023-08-17T00:02:51.770267+0000","last_fullsized":"2023-08-17T00:02:51.770267+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803930+0000","last_change":"2023-08-17T00:02:51.797864+0000","last_active":"2023-08-17T00:02:51.803930+0000","last_peered":"2023-08-17T00:02:51.803930+0000","last_clean":"2023-08-17T00:02:51.803930+0000","last_became_active":"2023-08-17T00:02:51.797388+0000","last_became_peered":"2023-08-17T00:02:51.797388+0000","last_unstale":"2023-08-17T00:02:51.803930+0000","last_undegraded":"2023-08-17T00:02:51.803930+0000","last_fullsized":"2023-08-17T00:02:51.803930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774238+0000","last_change":"2023-08-17T00:02:51.353342+0000","last_active":"2023-08-17T00:02:51.774238+0000","last_peered":"2023-08-17T00:02:51.774238+0000","last_clean":"2023-08-17T00:02:51.774238+0000","last_became_active":"2023-08-17T00:02:51.351707+0000","last_became_peered":"2023-08-17T00:02:51.351707+0000","last_unstale":"2023-08-17T00:02:51.774238+0000","last_undegraded":"2023-08-17T00:02:51.774238+0000","last_fullsized":"2023-08-17T00:02:51.774238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768195+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:02:51.768195+0000","last_peered":"2023-08-17T00:02:51.768195+0000","last_clean":"2023-08-17T00:02:51.768195+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:02:51.768195+0000","last_undegraded":"2023-08-17T00:02:51.768195+0000","last_fullsized":"2023-08-17T00:02:51.768195+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766976+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:02:51.766976+0000","last_peered":"2023-08-17T00:02:51.766976+0000","last_clean":"2023-08-17T00:02:51.766976+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:02:51.766976+0000","last_undegraded":"2023-08-17T00:02:51.766976+0000","last_fullsized":"2023-08-17T00:02:51.766976+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790259+0000","last_change":"2023-08-17T00:02:51.786227+0000","last_active":"2023-08-17T00:02:51.790259+0000","last_peered":"2023-08-17T00:02:51.790259+0000","last_clean":"2023-08-17T00:02:51.790259+0000","last_became_active":"2023-08-17T00:02:51.785164+0000","last_became_peered":"2023-08-17T00:02:51.785164+0000","last_unstale":"2023-08-17T00:02:51.790259+0000","last_undegraded":"2023-08-17T00:02:51.790259+0000","last_fullsized":"2023-08-17T00:02:51.790259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771433+0000","last_change":"2023-08-17T00:02:51.349191+0000","last_active":"2023-08-17T00:02:51.771433+0000","last_peered":"2023-08-17T00:02:51.771433+0000","last_clean":"2023-08-17T00:02:51.771433+0000","last_became_active":"2023-08-17T00:02:51.348834+0000","last_became_peered":"2023-08-17T00:02:51.348834+0000","last_unstale":"2023-08-17T00:02:51.771433+0000","last_undegraded":"2023-08-17T00:02:51.771433+0000","last_fullsized":"2023-08-17T00:02:51.771433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803745+0000","last_change":"2023-08-17T00:02:51.801602+0000","last_active":"2023-08-17T00:02:51.803745+0000","last_peered":"2023-08-17T00:02:51.803745+0000","last_clean":"2023-08-17T00:02:51.803745+0000","last_became_active":"2023-08-17T00:02:51.801300+0000","last_became_peered":"2023-08-17T00:02:51.801300+0000","last_unstale":"2023-08-17T00:02:51.803745+0000","last_undegraded":"2023-08-17T00:02:51.803745+0000","last_fullsized":"2023-08-17T00:02:51.803745+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768468+0000","last_change":"2023-08-17T00:02:51.340158+0000","last_active":"2023-08-17T00:02:51.768468+0000","last_peered":"2023-08-17T00:02:51.768468+0000","last_clean":"2023-08-17T00:02:51.768468+0000","last_became_active":"2023-08-17T00:02:51.339871+0000","last_became_peered":"2023-08-17T00:02:51.339871+0000","last_unstale":"2023-08-17T00:02:51.768468+0000","last_undegraded":"2023-08-17T00:02:51.768468+0000","last_fullsized":"2023-08-17T00:02:51.768468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798765+0000","last_change":"2023-08-17T00:02:51.785968+0000","last_active":"2023-08-17T00:02:51.798765+0000","last_peered":"2023-08-17T00:02:51.798765+0000","last_clean":"2023-08-17T00:02:51.798765+0000","last_became_active":"2023-08-17T00:02:51.785695+0000","last_became_peered":"2023-08-17T00:02:51.785695+0000","last_unstale":"2023-08-17T00:02:51.798765+0000","last_undegraded":"2023-08-17T00:02:51.798765+0000","last_fullsized":"2023-08-17T00:02:51.798765+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.769227+0000","last_change":"2023-08-17T00:02:51.339180+0000","last_active":"2023-08-17T00:02:51.769227+0000","last_peered":"2023-08-17T00:02:51.769227+0000","last_clean":"2023-08-17T00:02:51.769227+0000","last_became_active":"2023-08-17T00:02:51.338880+0000","last_became_peered":"2023-08-17T00:02:51.338880+0000","last_unstale":"2023-08-17T00:02:51.769227+0000","last_undegraded":"2023-08-17T00:02:51.769227+0000","last_fullsized":"2023-08-17T00:02:51.769227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790291+0000","last_change":"2023-08-17T00:02:51.786531+0000","last_active":"2023-08-17T00:02:51.790291+0000","last_peered":"2023-08-17T00:02:51.790291+0000","last_clean":"2023-08-17T00:02:51.790291+0000","last_became_active":"2023-08-17T00:02:51.785774+0000","last_became_peered":"2023-08-17T00:02:51.785774+0000","last_unstale":"2023-08-17T00:02:51.790291+0000","last_undegraded":"2023-08-17T00:02:51.790291+0000","last_fullsized":"2023-08-17T00:02:51.790291+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795538+0000","last_change":"2023-08-17T00:02:51.344586+0000","last_active":"2023-08-17T00:02:51.795538+0000","last_peered":"2023-08-17T00:02:51.795538+0000","last_clean":"2023-08-17T00:02:51.795538+0000","last_became_active":"2023-08-17T00:02:51.344320+0000","last_became_peered":"2023-08-17T00:02:51.344320+0000","last_unstale":"2023-08-17T00:02:51.795538+0000","last_undegraded":"2023-08-17T00:02:51.795538+0000","last_fullsized":"2023-08-17T00:02:51.795538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795736+0000","last_change":"2023-08-17T00:02:51.789022+0000","last_active":"2023-08-17T00:02:51.795736+0000","last_peered":"2023-08-17T00:02:51.795736+0000","last_clean":"2023-08-17T00:02:51.795736+0000","last_became_active":"2023-08-17T00:02:51.788756+0000","last_became_peered":"2023-08-17T00:02:51.788756+0000","last_unstale":"2023-08-17T00:02:51.795736+0000","last_undegraded":"2023-08-17T00:02:51.795736+0000","last_fullsized":"2023-08-17T00:02:51.795736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775104+0000","last_change":"2023-08-17T00:02:51.352334+0000","last_active":"2023-08-17T00:02:51.775104+0000","last_peered":"2023-08-17T00:02:51.775104+0000","last_clean":"2023-08-17T00:02:51.775104+0000","last_became_active":"2023-08-17T00:02:51.352057+0000","last_became_peered":"2023-08-17T00:02:51.352057+0000","last_unstale":"2023-08-17T00:02:51.775104+0000","last_undegraded":"2023-08-17T00:02:51.775104+0000","last_fullsized":"2023-08-17T00:02:51.775104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790438+0000","last_change":"2023-08-17T00:02:51.786511+0000","last_active":"2023-08-17T00:02:51.790438+0000","last_peered":"2023-08-17T00:02:51.790438+0000","last_clean":"2023-08-17T00:02:51.790438+0000","last_became_active":"2023-08-17T00:02:51.786141+0000","last_became_peered":"2023-08-17T00:02:51.786141+0000","last_unstale":"2023-08-17T00:02:51.790438+0000","last_undegraded":"2023-08-17T00:02:51.790438+0000","last_fullsized":"2023-08-17T00:02:51.790438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773255+0000","last_change":"2023-08-17T00:02:51.351567+0000","last_active":"2023-08-17T00:02:51.773255+0000","last_peered":"2023-08-17T00:02:51.773255+0000","last_clean":"2023-08-17T00:02:51.773255+0000","last_became_active":"2023-08-17T00:02:51.351119+0000","last_became_peered":"2023-08-17T00:02:51.351119+0000","last_unstale":"2023-08-17T00:02:51.773255+0000","last_undegraded":"2023-08-17T00:02:51.773255+0000","last_fullsized":"2023-08-17T00:02:51.773255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798841+0000","last_change":"2023-08-17T00:02:51.786494+0000","last_active":"2023-08-17T00:02:51.798841+0000","last_peered":"2023-08-17T00:02:51.798841+0000","last_clean":"2023-08-17T00:02:51.798841+0000","last_became_active":"2023-08-17T00:02:51.786239+0000","last_became_peered":"2023-08-17T00:02:51.786239+0000","last_unstale":"2023-08-17T00:02:51.798841+0000","last_undegraded":"2023-08-17T00:02:51.798841+0000","last_fullsized":"2023-08-17T00:02:51.798841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.788577+0000","last_change":"2023-08-17T00:02:51.341388+0000","last_active":"2023-08-17T00:02:51.788577+0000","last_peered":"2023-08-17T00:02:51.788577+0000","last_clean":"2023-08-17T00:02:51.788577+0000","last_became_active":"2023-08-17T00:02:51.341095+0000","last_became_peered":"2023-08-17T00:02:51.341095+0000","last_unstale":"2023-08-17T00:02:51.788577+0000","last_undegraded":"2023-08-17T00:02:51.788577+0000","last_fullsized":"2023-08-17T00:02:51.788577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802878+0000","last_change":"2023-08-17T00:02:51.795136+0000","last_active":"2023-08-17T00:02:51.802878+0000","last_peered":"2023-08-17T00:02:51.802878+0000","last_clean":"2023-08-17T00:02:51.802878+0000","last_became_active":"2023-08-17T00:02:51.794509+0000","last_became_peered":"2023-08-17T00:02:51.794509+0000","last_unstale":"2023-08-17T00:02:51.802878+0000","last_undegraded":"2023-08-17T00:02:51.802878+0000","last_fullsized":"2023-08-17T00:02:51.802878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803177+0000","last_change":"2023-08-17T00:02:51.347636+0000","last_active":"2023-08-17T00:02:51.803177+0000","last_peered":"2023-08-17T00:02:51.803177+0000","last_clean":"2023-08-17T00:02:51.803177+0000","last_became_active":"2023-08-17T00:02:51.347360+0000","last_became_peered":"2023-08-17T00:02:51.347360+0000","last_unstale":"2023-08-17T00:02:51.803177+0000","last_undegraded":"2023-08-17T00:02:51.803177+0000","last_fullsized":"2023-08-17T00:02:51.803177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784923+0000","last_change":"2023-08-17T00:02:51.774675+0000","last_active":"2023-08-17T00:02:51.784923+0000","last_peered":"2023-08-17T00:02:51.784923+0000","last_clean":"2023-08-17T00:02:51.784923+0000","last_became_active":"2023-08-17T00:02:51.774422+0000","last_became_peered":"2023-08-17T00:02:51.774422+0000","last_unstale":"2023-08-17T00:02:51.784923+0000","last_undegraded":"2023-08-17T00:02:51.784923+0000","last_fullsized":"2023-08-17T00:02:51.784923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795262+0000","last_change":"2023-08-17T00:02:51.344092+0000","last_active":"2023-08-17T00:02:51.795262+0000","last_peered":"2023-08-17T00:02:51.795262+0000","last_clean":"2023-08-17T00:02:51.795262+0000","last_became_active":"2023-08-17T00:02:51.343804+0000","last_became_peered":"2023-08-17T00:02:51.343804+0000","last_unstale":"2023-08-17T00:02:51.795262+0000","last_undegraded":"2023-08-17T00:02:51.795262+0000","last_fullsized":"2023-08-17T00:02:51.795262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803841+0000","last_change":"2023-08-17T00:02:51.796680+0000","last_active":"2023-08-17T00:02:51.803841+0000","last_peered":"2023-08-17T00:02:51.803841+0000","last_clean":"2023-08-17T00:02:51.803841+0000","last_became_active":"2023-08-17T00:02:51.795190+0000","last_became_peered":"2023-08-17T00:02:51.795190+0000","last_unstale":"2023-08-17T00:02:51.803841+0000","last_undegraded":"2023-08-17T00:02:51.803841+0000","last_fullsized":"2023-08-17T00:02:51.803841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.768352+0000","last_change":"2023-08-17T00:02:51.349898+0000","last_active":"2023-08-17T00:02:51.768352+0000","last_peered":"2023-08-17T00:02:51.768352+0000","last_clean":"2023-08-17T00:02:51.768352+0000","last_became_active":"2023-08-17T00:02:51.349378+0000","last_became_peered":"2023-08-17T00:02:51.349378+0000","last_unstale":"2023-08-17T00:02:51.768352+0000","last_undegraded":"2023-08-17T00:02:51.768352+0000","last_fullsized":"2023-08-17T00:02:51.768352+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803909+0000","last_change":"2023-08-17T00:02:51.797648+0000","last_active":"2023-08-17T00:02:51.803909+0000","last_peered":"2023-08-17T00:02:51.803909+0000","last_clean":"2023-08-17T00:02:51.803909+0000","last_became_active":"2023-08-17T00:02:51.797021+0000","last_became_peered":"2023-08-17T00:02:51.797021+0000","last_unstale":"2023-08-17T00:02:51.803909+0000","last_undegraded":"2023-08-17T00:02:51.803909+0000","last_fullsized":"2023-08-17T00:02:51.803909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779519+0000","last_change":"2023-08-17T00:02:51.341554+0000","last_active":"2023-08-17T00:02:51.779519+0000","last_peered":"2023-08-17T00:02:51.779519+0000","last_clean":"2023-08-17T00:02:51.779519+0000","last_became_active":"2023-08-17T00:02:51.341189+0000","last_became_peered":"2023-08-17T00:02:51.341189+0000","last_unstale":"2023-08-17T00:02:51.779519+0000","last_undegraded":"2023-08-17T00:02:51.779519+0000","last_fullsized":"2023-08-17T00:02:51.779519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.790275+0000","last_change":"2023-08-17T00:02:51.786385+0000","last_active":"2023-08-17T00:02:51.790275+0000","last_peered":"2023-08-17T00:02:51.790275+0000","last_clean":"2023-08-17T00:02:51.790275+0000","last_became_active":"2023-08-17T00:02:51.785450+0000","last_became_peered":"2023-08-17T00:02:51.785450+0000","last_unstale":"2023-08-17T00:02:51.790275+0000","last_undegraded":"2023-08-17T00:02:51.790275+0000","last_fullsized":"2023-08-17T00:02:51.790275+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802399+0000","last_change":"2023-08-17T00:02:51.341982+0000","last_active":"2023-08-17T00:02:51.802399+0000","last_peered":"2023-08-17T00:02:51.802399+0000","last_clean":"2023-08-17T00:02:51.802399+0000","last_became_active":"2023-08-17T00:02:51.341697+0000","last_became_peered":"2023-08-17T00:02:51.341697+0000","last_unstale":"2023-08-17T00:02:51.802399+0000","last_undegraded":"2023-08-17T00:02:51.802399+0000","last_fullsized":"2023-08-17T00:02:51.802399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.800153+0000","last_change":"2023-08-17T00:02:51.798361+0000","last_active":"2023-08-17T00:02:51.800153+0000","last_peered":"2023-08-17T00:02:51.800153+0000","last_clean":"2023-08-17T00:02:51.800153+0000","last_became_active":"2023-08-17T00:02:51.797985+0000","last_became_peered":"2023-08-17T00:02:51.797985+0000","last_unstale":"2023-08-17T00:02:51.800153+0000","last_undegraded":"2023-08-17T00:02:51.800153+0000","last_fullsized":"2023-08-17T00:02:51.800153+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.779410+0000","last_change":"2023-08-17T00:02:51.345285+0000","last_active":"2023-08-17T00:02:51.779410+0000","last_peered":"2023-08-17T00:02:51.779410+0000","last_clean":"2023-08-17T00:02:51.779410+0000","last_became_active":"2023-08-17T00:02:51.345012+0000","last_became_peered":"2023-08-17T00:02:51.345012+0000","last_unstale":"2023-08-17T00:02:51.779410+0000","last_undegraded":"2023-08-17T00:02:51.779410+0000","last_fullsized":"2023-08-17T00:02:51.779410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.791563+0000","last_change":"2023-08-17T00:02:51.780780+0000","last_active":"2023-08-17T00:02:51.791563+0000","last_peered":"2023-08-17T00:02:51.791563+0000","last_clean":"2023-08-17T00:02:51.791563+0000","last_became_active":"2023-08-17T00:02:51.780499+0000","last_became_peered":"2023-08-17T00:02:51.780499+0000","last_unstale":"2023-08-17T00:02:51.791563+0000","last_undegraded":"2023-08-17T00:02:51.791563+0000","last_fullsized":"2023-08-17T00:02:51.791563+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.33","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796009+0000","last_change":"2023-08-17T00:02:51.346726+0000","last_active":"2023-08-17T00:02:51.796009+0000","last_peered":"2023-08-17T00:02:51.796009+0000","last_clean":"2023-08-17T00:02:51.796009+0000","last_became_active":"2023-08-17T00:02:51.346453+0000","last_became_peered":"2023-08-17T00:02:51.346453+0000","last_unstale":"2023-08-17T00:02:51.796009+0000","last_undegraded":"2023-08-17T00:02:51.796009+0000","last_fullsized":"2023-08-17T00:02:51.796009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.803474+0000","last_change":"2023-08-17T00:02:51.791605+0000","last_active":"2023-08-17T00:02:51.803474+0000","last_peered":"2023-08-17T00:02:51.803474+0000","last_clean":"2023-08-17T00:02:51.803474+0000","last_became_active":"2023-08-17T00:02:51.791337+0000","last_became_peered":"2023-08-17T00:02:51.791337+0000","last_unstale":"2023-08-17T00:02:51.803474+0000","last_undegraded":"2023-08-17T00:02:51.803474+0000","last_fullsized":"2023-08-17T00:02:51.803474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.34","version":"21'4","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.806325+0000","last_change":"2023-08-17T00:02:51.346596+0000","last_active":"2023-08-17T00:02:51.806325+0000","last_peered":"2023-08-17T00:02:51.806325+0000","last_clean":"2023-08-17T00:02:51.806325+0000","last_became_active":"2023-08-17T00:02:51.346313+0000","last_became_peered":"2023-08-17T00:02:51.346313+0000","last_unstale":"2023-08-17T00:02:51.806325+0000","last_undegraded":"2023-08-17T00:02:51.806325+0000","last_fullsized":"2023-08-17T00:02:51.806325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.798176+0000","last_change":"2023-08-17T00:02:51.793285+0000","last_active":"2023-08-17T00:02:51.798176+0000","last_peered":"2023-08-17T00:02:51.798176+0000","last_clean":"2023-08-17T00:02:51.798176+0000","last_became_active":"2023-08-17T00:02:51.791718+0000","last_became_peered":"2023-08-17T00:02:51.791718+0000","last_unstale":"2023-08-17T00:02:51.798176+0000","last_undegraded":"2023-08-17T00:02:51.798176+0000","last_fullsized":"2023-08-17T00:02:51.798176+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.771929+0000","last_change":"2023-08-17T00:02:51.344568+0000","last_active":"2023-08-17T00:02:51.771929+0000","last_peered":"2023-08-17T00:02:51.771929+0000","last_clean":"2023-08-17T00:02:51.771929+0000","last_became_active":"2023-08-17T00:02:51.344185+0000","last_became_peered":"2023-08-17T00:02:51.344185+0000","last_unstale":"2023-08-17T00:02:51.771929+0000","last_undegraded":"2023-08-17T00:02:51.771929+0000","last_fullsized":"2023-08-17T00:02:51.771929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802759+0000","last_change":"2023-08-17T00:02:51.794651+0000","last_active":"2023-08-17T00:02:51.802759+0000","last_peered":"2023-08-17T00:02:51.802759+0000","last_clean":"2023-08-17T00:02:51.802759+0000","last_became_active":"2023-08-17T00:02:51.794341+0000","last_became_peered":"2023-08-17T00:02:51.794341+0000","last_unstale":"2023-08-17T00:02:51.802759+0000","last_undegraded":"2023-08-17T00:02:51.802759+0000","last_fullsized":"2023-08-17T00:02:51.802759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774235+0000","last_change":"2023-08-17T00:02:51.344305+0000","last_active":"2023-08-17T00:02:51.774235+0000","last_peered":"2023-08-17T00:02:51.774235+0000","last_clean":"2023-08-17T00:02:51.774235+0000","last_became_active":"2023-08-17T00:02:51.341191+0000","last_became_peered":"2023-08-17T00:02:51.341191+0000","last_unstale":"2023-08-17T00:02:51.774235+0000","last_undegraded":"2023-08-17T00:02:51.774235+0000","last_fullsized":"2023-08-17T00:02:51.774235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795708+0000","last_change":"2023-08-17T00:02:51.789154+0000","last_active":"2023-08-17T00:02:51.795708+0000","last_peered":"2023-08-17T00:02:51.795708+0000","last_clean":"2023-08-17T00:02:51.795708+0000","last_became_active":"2023-08-17T00:02:51.788807+0000","last_became_peered":"2023-08-17T00:02:51.788807+0000","last_unstale":"2023-08-17T00:02:51.795708+0000","last_undegraded":"2023-08-17T00:02:51.795708+0000","last_fullsized":"2023-08-17T00:02:51.795708+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.766911+0000","last_change":"2023-08-17T00:02:51.342636+0000","last_active":"2023-08-17T00:02:51.766911+0000","last_peered":"2023-08-17T00:02:51.766911+0000","last_clean":"2023-08-17T00:02:51.766911+0000","last_became_active":"2023-08-17T00:02:51.342340+0000","last_became_peered":"2023-08-17T00:02:51.342340+0000","last_unstale":"2023-08-17T00:02:51.766911+0000","last_undegraded":"2023-08-17T00:02:51.766911+0000","last_fullsized":"2023-08-17T00:02:51.766911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802639+0000","last_change":"2023-08-17T00:02:51.797499+0000","last_active":"2023-08-17T00:02:51.802639+0000","last_peered":"2023-08-17T00:02:51.802639+0000","last_clean":"2023-08-17T00:02:51.802639+0000","last_became_active":"2023-08-17T00:02:51.797168+0000","last_became_peered":"2023-08-17T00:02:51.797168+0000","last_unstale":"2023-08-17T00:02:51.802639+0000","last_undegraded":"2023-08-17T00:02:51.802639+0000","last_fullsized":"2023-08-17T00:02:51.802639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.797340+0000","last_change":"2023-08-17T00:02:51.789012+0000","last_active":"2023-08-17T00:02:51.797340+0000","last_peered":"2023-08-17T00:02:51.797340+0000","last_clean":"2023-08-17T00:02:51.797340+0000","last_became_active":"2023-08-17T00:02:51.788464+0000","last_became_peered":"2023-08-17T00:02:51.788464+0000","last_unstale":"2023-08-17T00:02:51.797340+0000","last_undegraded":"2023-08-17T00:02:51.797340+0000","last_fullsized":"2023-08-17T00:02:51.797340+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775204+0000","last_change":"2023-08-17T00:02:51.339223+0000","last_active":"2023-08-17T00:02:51.775204+0000","last_peered":"2023-08-17T00:02:51.775204+0000","last_clean":"2023-08-17T00:02:51.775204+0000","last_became_active":"2023-08-17T00:02:51.338872+0000","last_became_peered":"2023-08-17T00:02:51.338872+0000","last_unstale":"2023-08-17T00:02:51.775204+0000","last_undegraded":"2023-08-17T00:02:51.775204+0000","last_fullsized":"2023-08-17T00:02:51.775204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.799128+0000","last_change":"2023-08-17T00:02:51.788420+0000","last_active":"2023-08-17T00:02:51.799128+0000","last_peered":"2023-08-17T00:02:51.799128+0000","last_clean":"2023-08-17T00:02:51.799128+0000","last_became_active":"2023-08-17T00:02:51.788155+0000","last_became_peered":"2023-08-17T00:02:51.788155+0000","last_unstale":"2023-08-17T00:02:51.799128+0000","last_undegraded":"2023-08-17T00:02:51.799128+0000","last_fullsized":"2023-08-17T00:02:51.799128+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.773169+0000","last_change":"2023-08-17T00:02:51.337198+0000","last_active":"2023-08-17T00:02:51.773169+0000","last_peered":"2023-08-17T00:02:51.773169+0000","last_clean":"2023-08-17T00:02:51.773169+0000","last_became_active":"2023-08-17T00:02:51.336537+0000","last_became_peered":"2023-08-17T00:02:51.336537+0000","last_unstale":"2023-08-17T00:02:51.773169+0000","last_undegraded":"2023-08-17T00:02:51.773169+0000","last_fullsized":"2023-08-17T00:02:51.773169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.795487+0000","last_change":"2023-08-17T00:02:51.787948+0000","last_active":"2023-08-17T00:02:51.795487+0000","last_peered":"2023-08-17T00:02:51.795487+0000","last_clean":"2023-08-17T00:02:51.795487+0000","last_became_active":"2023-08-17T00:02:51.787702+0000","last_became_peered":"2023-08-17T00:02:51.787702+0000","last_unstale":"2023-08-17T00:02:51.795487+0000","last_undegraded":"2023-08-17T00:02:51.795487+0000","last_fullsized":"2023-08-17T00:02:51.795487+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.801892+0000","last_change":"2023-08-17T00:02:51.348795+0000","last_active":"2023-08-17T00:02:51.801892+0000","last_peered":"2023-08-17T00:02:51.801892+0000","last_clean":"2023-08-17T00:02:51.801892+0000","last_became_active":"2023-08-17T00:02:51.341835+0000","last_became_peered":"2023-08-17T00:02:51.341835+0000","last_unstale":"2023-08-17T00:02:51.801892+0000","last_undegraded":"2023-08-17T00:02:51.801892+0000","last_fullsized":"2023-08-17T00:02:51.801892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802783+0000","last_change":"2023-08-17T00:02:51.797751+0000","last_active":"2023-08-17T00:02:51.802783+0000","last_peered":"2023-08-17T00:02:51.802783+0000","last_clean":"2023-08-17T00:02:51.802783+0000","last_became_active":"2023-08-17T00:02:51.797486+0000","last_became_peered":"2023-08-17T00:02:51.797486+0000","last_unstale":"2023-08-17T00:02:51.802783+0000","last_undegraded":"2023-08-17T00:02:51.802783+0000","last_fullsized":"2023-08-17T00:02:51.802783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793391+0000","last_change":"2023-08-17T00:02:51.344236+0000","last_active":"2023-08-17T00:02:51.793391+0000","last_peered":"2023-08-17T00:02:51.793391+0000","last_clean":"2023-08-17T00:02:51.793391+0000","last_became_active":"2023-08-17T00:02:51.343935+0000","last_became_peered":"2023-08-17T00:02:51.343935+0000","last_unstale":"2023-08-17T00:02:51.793391+0000","last_undegraded":"2023-08-17T00:02:51.793391+0000","last_fullsized":"2023-08-17T00:02:51.793391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.796985+0000","last_change":"2023-08-17T00:02:51.781786+0000","last_active":"2023-08-17T00:02:51.796985+0000","last_peered":"2023-08-17T00:02:51.796985+0000","last_clean":"2023-08-17T00:02:51.796985+0000","last_became_active":"2023-08-17T00:02:51.781472+0000","last_became_peered":"2023-08-17T00:02:51.781472+0000","last_unstale":"2023-08-17T00:02:51.796985+0000","last_undegraded":"2023-08-17T00:02:51.796985+0000","last_fullsized":"2023-08-17T00:02:51.796985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"21'2","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.802048+0000","last_change":"2023-08-17T00:02:51.339145+0000","last_active":"2023-08-17T00:02:51.802048+0000","last_peered":"2023-08-17T00:02:51.802048+0000","last_clean":"2023-08-17T00:02:51.802048+0000","last_became_active":"2023-08-17T00:02:51.338710+0000","last_became_peered":"2023-08-17T00:02:51.338710+0000","last_unstale":"2023-08-17T00:02:51.802048+0000","last_undegraded":"2023-08-17T00:02:51.802048+0000","last_fullsized":"2023-08-17T00:02:51.802048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784977+0000","last_change":"2023-08-17T00:02:51.779058+0000","last_active":"2023-08-17T00:02:51.784977+0000","last_peered":"2023-08-17T00:02:51.784977+0000","last_clean":"2023-08-17T00:02:51.784977+0000","last_became_active":"2023-08-17T00:02:51.778796+0000","last_became_peered":"2023-08-17T00:02:51.778796+0000","last_unstale":"2023-08-17T00:02:51.784977+0000","last_undegraded":"2023-08-17T00:02:51.784977+0000","last_fullsized":"2023-08-17T00:02:51.784977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.774792+0000","last_change":"2023-08-17T00:02:51.337656+0000","last_active":"2023-08-17T00:02:51.774792+0000","last_peered":"2023-08-17T00:02:51.774792+0000","last_clean":"2023-08-17T00:02:51.774792+0000","last_became_active":"2023-08-17T00:02:51.337333+0000","last_became_peered":"2023-08-17T00:02:51.337333+0000","last_unstale":"2023-08-17T00:02:51.774792+0000","last_undegraded":"2023-08-17T00:02:51.774792+0000","last_fullsized":"2023-08-17T00:02:51.774792+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.784887+0000","last_change":"2023-08-17T00:02:51.779981+0000","last_active":"2023-08-17T00:02:51.784887+0000","last_peered":"2023-08-17T00:02:51.784887+0000","last_clean":"2023-08-17T00:02:51.784887+0000","last_became_active":"2023-08-17T00:02:51.779712+0000","last_became_peered":"2023-08-17T00:02:51.779712+0000","last_unstale":"2023-08-17T00:02:51.784887+0000","last_undegraded":"2023-08-17T00:02:51.784887+0000","last_fullsized":"2023-08-17T00:02:51.784887+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.775012+0000","last_change":"2023-08-17T00:02:51.339106+0000","last_active":"2023-08-17T00:02:51.775012+0000","last_peered":"2023-08-17T00:02:51.775012+0000","last_clean":"2023-08-17T00:02:51.775012+0000","last_became_active":"2023-08-17T00:02:51.338781+0000","last_became_peered":"2023-08-17T00:02:51.338781+0000","last_unstale":"2023-08-17T00:02:51.775012+0000","last_undegraded":"2023-08-17T00:02:51.775012+0000","last_fullsized":"2023-08-17T00:02:51.775012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.782043+0000","last_change":"2023-08-17T00:02:51.778317+0000","last_active":"2023-08-17T00:02:51.782043+0000","last_peered":"2023-08-17T00:02:51.782043+0000","last_clean":"2023-08-17T00:02:51.782043+0000","last_became_active":"2023-08-17T00:02:51.778029+0000","last_became_peered":"2023-08-17T00:02:51.778029+0000","last_unstale":"2023-08-17T00:02:51.782043+0000","last_undegraded":"2023-08-17T00:02:51.782043+0000","last_fullsized":"2023-08-17T00:02:51.782043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:51.299758+0000","last_clean_scrub_stamp":"2023-08-17T00:02:51.299758+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"21'3","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-08-17T00:02:51.793540+0000","last_change":"2023-08-17T00:02:51.345678+0000","last_active":"2023-08-17T00:02:51.793540+0000","last_peered":"2023-08-17T00:02:51.793540+0000","last_clean":"2023-08-17T00:02:51.793540+0000","last_became_active":"2023-08-17T00:02:51.345185+0000","last_became_peered":"2023-08-17T00:02:51.345185+0000","last_unstale":"2023-08-17T00:02:51.793540+0000","last_undegraded":"2023-08-17T00:02:51.793540+0000","last_fullsized":"2023-08-17T00:02:51.793540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:50.287171+0000","last_clean_scrub_stamp":"2023-08-17T00:02:50.287171+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]}]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.194}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.349}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297316,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074524,"statfs":{"total":96636764160,"available":96332312576,"internally_reserved":0,"allocated":225280,"data_stored":83157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.171}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":83801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2030000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297324,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074516,"statfs":{"total":96636764160,"available":96332304384,"internally_reserved":0,"allocated":233472,"data_stored":84071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.599}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297336,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074504,"statfs":{"total":96636764160,"available":96332292096,"internally_reserved":0,"allocated":245760,"data_stored":84749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297320,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074520,"statfs":{"total":96636764160,"available":96332308480,"internally_reserved":0,"allocated":229376,"data_stored":83227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.726}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.488}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:03:03.238 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-17T00:03:03.238 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-17T00:03:03.239 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-17T00:03:03.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-17T00:03:03.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.426+0000 7f99d359e700 1 Processor -- start 2023-08-17T00:03:03.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.426+0000 7f99d359e700 1 -- start start 2023-08-17T00:03:03.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d4153f50 0x7f99d4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f99d40c01a0 0x7f99d40c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d359e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40bfd10 con 0x7f99d40c57a0 2023-08-17T00:03:03.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d4154860 con 0x7f99d40c01a0 2023-08-17T00:03:03.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4154af0 con 0x7f99d4153f50 2023-08-17T00:03:03.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f99d40c01a0 0x7f99d40c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f99d40c01a0 0x7f99d40c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56170/0 (socket says 172.21.15.153:56170) 2023-08-17T00:03:03.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 -- 172.21.15.153:0/1356112363 learned_addr learned my addr 172.21.15.153:0/1356112363 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:03.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99cbfff700 1 --2- 172.21.15.153:0/1356112363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d4153f50 0x7f99d4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 -- 172.21.15.153:0/1356112363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d4153f50 msgr2=0x7f99d4154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:03.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 --2- 172.21.15.153:0/1356112363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d4153f50 0x7f99d4154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 -- 172.21.15.153:0/1356112363 >> v1:172.21.15.178:6789/0 conn(0x7f99d40c57a0 legacy=0x7f99d40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 -- 172.21.15.153:0/1356112363 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d4154dd0 con 0x7f99d40c01a0 2023-08-17T00:03:03.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d2d9d700 1 --2- 172.21.15.153:0/1356112363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d40c0630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f99cc009f20 tx=0x7f99cc009840).ready entity=mon.0 client_cookie=eac8e8a0ad22298 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d1d9b700 1 -- 172.21.15.153:0/1356112363 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00e070 con 0x7f99d40c01a0 2023-08-17T00:03:03.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d1d9b700 1 -- 172.21.15.153:0/1356112363 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc00b9d0 con 0x7f99d40c01a0 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.430+0000 7f99d1d9b700 1 -- 172.21.15.153:0/1356112363 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00bd50 con 0x7f99d40c01a0 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 -- 172.21.15.153:0/1356112363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 msgr2=0x7f99d40c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 --2- 172.21.15.153:0/1356112363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d40c0630 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f99cc009f20 tx=0x7f99cc009840).stop 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 -- 172.21.15.153:0/1356112363 shutdown_connections 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 --2- 172.21.15.153:0/1356112363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d40c0630 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 --2- 172.21.15.153:0/1356112363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d4153f50 0x7f99d4154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 -- 172.21.15.153:0/1356112363 >> 172.21.15.153:0/1356112363 conn(0x7f99d4062a70 msgr2=0x7f99d40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:03.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 -- 172.21.15.153:0/1356112363 shutdown_connections 2023-08-17T00:03:03.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.434+0000 7f99d359e700 1 -- 172.21.15.153:0/1356112363 wait complete. 2023-08-17T00:03:03.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 Processor -- start 2023-08-17T00:03:03.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 -- start start 2023-08-17T00:03:03.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d41652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d40c57a0 0x7f99d413ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99d4153f50 0x7f99d413ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4165060 con 0x7f99d40c01a0 2023-08-17T00:03:03.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40ab630 con 0x7f99d4153f50 2023-08-17T00:03:03.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40ac170 con 0x7f99d40c57a0 2023-08-17T00:03:03.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d41652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99cbfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d40c57a0 0x7f99d413ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d41652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56172/0 (socket says 172.21.15.153:56172) 2023-08-17T00:03:03.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 -- 172.21.15.153:0/427899539 learned_addr learned my addr 172.21.15.153:0/427899539 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:03.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d2d9d700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99d4153f50 0x7f99d413ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 -- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d40c57a0 msgr2=0x7f99d413ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d40c57a0 0x7f99d413ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 -- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99d4153f50 msgr2=0x7f99d413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99d4153f50 0x7f99d413ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d259c700 1 -- 172.21.15.153:0/427899539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009ae0 con 0x7f99d40c01a0 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.438+0000 7f99d2d9d700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99d4153f50 0x7f99d413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99d259c700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d41652e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f99c400c440 tx=0x7f99c4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4012400 con 0x7f99d40c01a0 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c4012560 con 0x7f99d40c01a0 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d40ab840 con 0x7f99d40c01a0 2023-08-17T00:03:03.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4012900 con 0x7f99d40c01a0 2023-08-17T00:03:03.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d40abe00 con 0x7f99d40c01a0 2023-08-17T00:03:03.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d406b4c0 con 0x7f99d40c01a0 2023-08-17T00:03:03.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.442+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f99c4019030 con 0x7f99d40c01a0 2023-08-17T00:03:03.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.446+0000 7f99ca7fc700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99b805a150 0x7f99b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.446+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99c4073880 con 0x7f99d40c01a0 2023-08-17T00:03:03.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.446+0000 7f99cbfff700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99b805a150 0x7f99b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.446+0000 7f99cbfff700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99b805a150 0x7f99b805c610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f99d40ad2f0 tx=0x7f99bc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.450+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99c4047220 con 0x7f99d40c01a0 2023-08-17T00:03:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.638+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f99d40bf9a0 con 0x7f99d40c01a0 2023-08-17T00:03:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.642+0000 7f99ca7fc700 1 -- 172.21.15.153:0/427899539 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f99c404a840 con 0x7f99d40c01a0 2023-08-17T00:03:03.645 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99b805a150 msgr2=0x7f99b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99b805a150 0x7f99b805c610 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f99d40ad2f0 tx=0x7f99bc009060).stop 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 msgr2=0x7f99d41652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d41652e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f99c400c440 tx=0x7f99c4007db0).stop 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 shutdown_connections 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99b805a150 0x7f99b805c610 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99d4153f50 0x7f99d413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99d40c57a0 0x7f99d413ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 --2- 172.21.15.153:0/427899539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99d40c01a0 0x7f99d41652e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 >> 172.21.15.153:0/427899539 conn(0x7f99d4062a70 msgr2=0x7f99d40c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 shutdown_connections 2023-08-17T00:03:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.646+0000 7f99d359e700 1 -- 172.21.15.153:0/427899539 wait complete. 2023-08-17T00:03:03.669 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-17T00:03:03.669 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-17T00:03:03.670 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:03.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f99515a9700 1 Processor -- start 2023-08-17T00:03:03.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f99515a9700 1 -- start start 2023-08-17T00:03:03.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f99515a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f994c151b90 0x7f994c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f99515a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c061fa0 con 0x7f994c063290 2023-08-17T00:03:03.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f99515a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994c0621f0 con 0x7f994c064870 2023-08-17T00:03:03.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f99515a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994c0c3fb0 con 0x7f994c151b90 2023-08-17T00:03:03.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f994affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f994c151b90 0x7f994c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f994affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f994c151b90 0x7f994c151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56178/0 (socket says 172.21.15.153:56178) 2023-08-17T00:03:03.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f994affd700 1 -- 172.21.15.153:0/27310709 learned_addr learned my addr 172.21.15.153:0/27310709 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:03.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f994affd700 1 -- 172.21.15.153:0/27310709 >> v1:172.21.15.178:6789/0 conn(0x7f994c064870 legacy=0x7f994c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f994affd700 1 -- 172.21.15.153:0/27310709 >> v1:172.21.15.153:6789/0 conn(0x7f994c063290 legacy=0x7f994c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.822+0000 7f994affd700 1 -- 172.21.15.153:0/27310709 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c0624d0 con 0x7f994c151b90 2023-08-17T00:03:03.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f994affd700 1 --2- 172.21.15.153:0/27310709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c151b90 0x7f994c151f70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f993c006fd0 tx=0x7f993c0090f0).ready entity=mon.0 client_cookie=147fc787d00a9bfe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f994a7fc700 1 -- 172.21.15.153:0/27310709 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00b600 con 0x7f994c151b90 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f994a7fc700 1 -- 172.21.15.153:0/27310709 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00b760 con 0x7f994c151b90 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f994a7fc700 1 -- 172.21.15.153:0/27310709 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bae0 con 0x7f994c151b90 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 -- 172.21.15.153:0/27310709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c151b90 msgr2=0x7f994c151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 --2- 172.21.15.153:0/27310709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c151b90 0x7f994c151f70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f993c006fd0 tx=0x7f993c0090f0).stop 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 -- 172.21.15.153:0/27310709 shutdown_connections 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 --2- 172.21.15.153:0/27310709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c151b90 0x7f994c151f70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 -- 172.21.15.153:0/27310709 >> 172.21.15.153:0/27310709 conn(0x7f994c0c7150 msgr2=0x7f994c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:03.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 -- 172.21.15.153:0/27310709 shutdown_connections 2023-08-17T00:03:03.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.826+0000 7f99515a9700 1 -- 172.21.15.153:0/27310709 wait complete. 2023-08-17T00:03:03.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 Processor -- start 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 -- start start 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f994c063290 0x7f994c148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 0x7f994c0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f994c151b90 0x7f994c153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0abb40 con 0x7f994c064870 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c1493c0 con 0x7f994c063290 2023-08-17T00:03:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f99515a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c0be3e0 con 0x7f994c151b90 2023-08-17T00:03:03.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 0x7f994c0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 0x7f994c0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56190/0 (socket says 172.21.15.153:56190) 2023-08-17T00:03:03.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 -- 172.21.15.153:0/3258305163 learned_addr learned my addr 172.21.15.153:0/3258305163 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:03.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f994affd700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f994c063290 0x7f994c148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f994b7fe700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f994c151b90 0x7f994c153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 -- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f994c151b90 msgr2=0x7f994c153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f994c151b90 0x7f994c153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 -- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f994c063290 msgr2=0x7f994c148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f994c063290 0x7f994c148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 -- 172.21.15.153:0/3258305163 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009370 con 0x7f994c064870 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9943fff700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 0x7f994c0c0c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f993400c440 tx=0x7f9934007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.830+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993400ce90 con 0x7f994c064870 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.834+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9934007020 con 0x7f994c064870 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.834+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f994c0c1470 con 0x7f994c064870 2023-08-17T00:03:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.834+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99340073e0 con 0x7f994c064870 2023-08-17T00:03:03.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.834+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f994c0c1a30 con 0x7f994c064870 2023-08-17T00:03:03.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.834+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994c0be570 con 0x7f994c064870 2023-08-17T00:03:03.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.834+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9934010070 con 0x7f994c064870 2023-08-17T00:03:03.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.838+0000 7f9942ffd700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f992c05a180 0x7f992c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:03.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.838+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9934073230 con 0x7f994c064870 2023-08-17T00:03:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.838+0000 7f994affd700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f992c05a180 0x7f992c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:03.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.838+0000 7f994affd700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f992c05a180 0x7f992c05c640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f993c009130 tx=0x7f993c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:03.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:03.842+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9934046ce0 con 0x7f994c064870 2023-08-17T00:03:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.006+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f994c0c3ab0 con 0x7f994c064870 2023-08-17T00:03:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.006+0000 7f9942ffd700 1 -- 172.21.15.153:0/3258305163 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f993404a300 con 0x7f994c064870 2023-08-17T00:03:04.013 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:04.013 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f992c05a180 msgr2=0x7f992c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f992c05a180 0x7f992c05c640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f993c009130 tx=0x7f993c017000).stop 2023-08-17T00:03:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 msgr2=0x7f994c0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 0x7f994c0c0c80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f993400c440 tx=0x7f9934007e00).stop 2023-08-17T00:03:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 shutdown_connections 2023-08-17T00:03:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f992c05a180 0x7f992c05c640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f994c151b90 0x7f994c153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f994c064870 0x7f994c0c0c80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 --2- 172.21.15.153:0/3258305163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f994c063290 0x7f994c148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 >> 172.21.15.153:0/3258305163 conn(0x7f994c0c7150 msgr2=0x7f994c150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 shutdown_connections 2023-08-17T00:03:04.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.010+0000 7f99515a9700 1 -- 172.21.15.153:0/3258305163 wait complete. 2023-08-17T00:03:04.037 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:04.037 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:04.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.202+0000 7f1a086f1700 1 Processor -- start 2023-08-17T00:03:04.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.202+0000 7f1a086f1700 1 -- start start 2023-08-17T00:03:04.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a086f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a00153ab0 0x7f1a00153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a086f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1a000c8d50 0x7f1a000c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a086f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a000aa750 con 0x7f1a000c7490 2023-08-17T00:03:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a086f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a000c9dd0 con 0x7f1a000c8d50 2023-08-17T00:03:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a086f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000aacf0 con 0x7f1a00153ab0 2023-08-17T00:03:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a06c8e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1a000c7490 0x7f1a00063660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35770/0 (socket says 172.21.15.153:35770) 2023-08-17T00:03:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a06c8e700 1 -- 172.21.15.153:0/1219458745 learned_addr learned my addr 172.21.15.153:0/1219458745 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a05c8c700 1 --2- 172.21.15.153:0/1219458745 >> v2:172.21.15.153:3300/0 conn(0x7f1a000c8d50 0x7f1a000c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0648d700 1 --2- 172.21.15.153:0/1219458745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a00153ab0 0x7f1a00153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0548b700 1 -- 172.21.15.153:0/1219458745 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135263723 0 0) 0x7f1a000aa750 con 0x7f1a000c7490 2023-08-17T00:03:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0548b700 1 -- 172.21.15.153:0/1219458745 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ec0033f0 con 0x7f1a000c7490 2023-08-17T00:03:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0648d700 1 -- 172.21.15.153:0/1219458745 >> v2:172.21.15.153:3300/0 conn(0x7f1a000c8d50 msgr2=0x7f1a000c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0648d700 1 --2- 172.21.15.153:0/1219458745 >> v2:172.21.15.153:3300/0 conn(0x7f1a000c8d50 0x7f1a000c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0648d700 1 -- 172.21.15.153:0/1219458745 >> v1:172.21.15.153:6789/0 conn(0x7f1a000c7490 legacy=0x7f1a00063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0648d700 1 -- 172.21.15.153:0/1219458745 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000c5ca0 con 0x7f1a00153ab0 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0648d700 1 --2- 172.21.15.153:0/1219458745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a00153ab0 0x7f1a00153e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f19fc009760 tx=0x7f19fc009060).ready entity=mon.2 client_cookie=24fec1620e99b593 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0548b700 1 -- 172.21.15.153:0/1219458745 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0090d0 con 0x7f1a00153ab0 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0548b700 1 -- 172.21.15.153:0/1219458745 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc00d4a0 con 0x7f1a00153ab0 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.206+0000 7f1a0548b700 1 -- 172.21.15.153:0/1219458745 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00d820 con 0x7f1a00153ab0 2023-08-17T00:03:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 -- 172.21.15.153:0/1219458745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a00153ab0 msgr2=0x7f1a00153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 --2- 172.21.15.153:0/1219458745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a00153ab0 0x7f1a00153e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f19fc009760 tx=0x7f19fc009060).stop 2023-08-17T00:03:04.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 -- 172.21.15.153:0/1219458745 shutdown_connections 2023-08-17T00:03:04.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 --2- 172.21.15.153:0/1219458745 >> v2:172.21.15.153:3300/0 conn(0x7f1a000c8d50 0x7f1a000c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 --2- 172.21.15.153:0/1219458745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a00153ab0 0x7f1a00153e90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 -- 172.21.15.153:0/1219458745 >> 172.21.15.153:0/1219458745 conn(0x7f1a00061fa0 msgr2=0x7f1a000623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:04.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 -- 172.21.15.153:0/1219458745 shutdown_connections 2023-08-17T00:03:04.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 -- 172.21.15.153:0/1219458745 wait complete. 2023-08-17T00:03:04.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 Processor -- start 2023-08-17T00:03:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.210+0000 7f1a086f1700 1 -- start start 2023-08-17T00:03:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a000c7490 0x7f1a000c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a000c8d50 0x7f1a000a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 0x7f1a000afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c3170 con 0x7f1a00153ab0 2023-08-17T00:03:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c20c0 con 0x7f1a000c7490 2023-08-17T00:03:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000c23a0 con 0x7f1a000c8d50 2023-08-17T00:03:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 0x7f1a000afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 0x7f1a000afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56204/0 (socket says 172.21.15.153:56204) 2023-08-17T00:03:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 -- 172.21.15.153:0/828164045 learned_addr learned my addr 172.21.15.153:0/828164045 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:04.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a05c8c700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a000c8d50 0x7f1a000a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a0648d700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a000c7490 0x7f1a000c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 -- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a000c8d50 msgr2=0x7f1a000a9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a000c8d50 0x7f1a000a9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 -- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a000c7490 msgr2=0x7f1a000c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a000c7490 0x7f1a000c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 -- 172.21.15.153:0/828164045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19fc0092a0 con 0x7f1a00153ab0 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a06c8e700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 0x7f1a000afd00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f19f8005ad0 tx=0x7f19f80015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8005d30 con 0x7f1a00153ab0 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8005e90 con 0x7f1a00153ab0 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80072e0 con 0x7f1a00153ab0 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a000c2680 con 0x7f1a00153ab0 2023-08-17T00:03:04.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.214+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a000aa370 con 0x7f1a00153ab0 2023-08-17T00:03:04.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.218+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0006b530 con 0x7f1a00153ab0 2023-08-17T00:03:04.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.218+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f19f8010070 con 0x7f1a00153ab0 2023-08-17T00:03:04.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.218+0000 7f19f67fc700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19e405a150 0x7f19e405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.218+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f19f8073930 con 0x7f1a00153ab0 2023-08-17T00:03:04.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.218+0000 7f1a0648d700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19e405a150 0x7f19e405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.222+0000 7f1a0648d700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19e405a150 0x7f19e405c610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f19fc009270 tx=0x7f19fc016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.226+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19f8047350 con 0x7f1a00153ab0 2023-08-17T00:03:04.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.386+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f1a000c9810 con 0x7f1a00153ab0 2023-08-17T00:03:04.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.386+0000 7f19f67fc700 1 -- 172.21.15.153:0/828164045 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f19f8018020 con 0x7f1a00153ab0 2023-08-17T00:03:04.392 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:04.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19e405a150 msgr2=0x7f19e405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19e405a150 0x7f19e405c610 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f19fc009270 tx=0x7f19fc016000).stop 2023-08-17T00:03:04.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 msgr2=0x7f1a000afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 0x7f1a000afd00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f19f8005ad0 tx=0x7f19f80015b0).stop 2023-08-17T00:03:04.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 shutdown_connections 2023-08-17T00:03:04.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19e405a150 0x7f19e405c610 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1a00153ab0 0x7f1a000afd00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a000c8d50 0x7f1a000a9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 --2- 172.21.15.153:0/828164045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a000c7490 0x7f1a000c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 >> 172.21.15.153:0/828164045 conn(0x7f1a00061fa0 msgr2=0x7f1a00151120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:04.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 shutdown_connections 2023-08-17T00:03:04.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.390+0000 7f1a086f1700 1 -- 172.21.15.153:0/828164045 wait complete. 2023-08-17T00:03:04.416 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:04.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 Processor -- start 2023-08-17T00:03:04.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 -- start start 2023-08-17T00:03:04.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71980c57a0 0x7f71980c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7198153f50 0x7f7198154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f7198157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71980bfd10 con 0x7f7198153f50 2023-08-17T00:03:04.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7198154860 con 0x7f71980c57a0 2023-08-17T00:03:04.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.570+0000 7f719759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7198154af0 con 0x7f7198157600 2023-08-17T00:03:04.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7198153f50 0x7f7198154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7198153f50 0x7f7198154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56216/0 (socket says 172.21.15.153:56216) 2023-08-17T00:03:04.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 -- 172.21.15.153:0/2464714104 learned_addr learned my addr 172.21.15.153:0/2464714104 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719659c700 1 --2- 172.21.15.153:0/2464714104 >> v2:172.21.15.178:3300/0 conn(0x7f71980c57a0 0x7f71980c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7196d9d700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f7198157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 -- 172.21.15.153:0/2464714104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 msgr2=0x7f7198157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:04.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f7198157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 -- 172.21.15.153:0/2464714104 >> v2:172.21.15.178:3300/0 conn(0x7f71980c57a0 msgr2=0x7f71980c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 --2- 172.21.15.153:0/2464714104 >> v2:172.21.15.178:3300/0 conn(0x7f71980c57a0 0x7f71980c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 -- 172.21.15.153:0/2464714104 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198154dd0 con 0x7f7198153f50 2023-08-17T00:03:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7196d9d700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f7198157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f7195d9b700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7198153f50 0x7f7198154370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f71980c54c0 tx=0x7f718c0090f0).ready entity=mon.0 client_cookie=6958f8ae7afae23f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719559a700 1 -- 172.21.15.153:0/2464714104 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00b520 con 0x7f7198153f50 2023-08-17T00:03:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719559a700 1 -- 172.21.15.153:0/2464714104 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c00b680 con 0x7f7198153f50 2023-08-17T00:03:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719559a700 1 -- 172.21.15.153:0/2464714104 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c00ba00 con 0x7f7198153f50 2023-08-17T00:03:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 -- 172.21.15.153:0/2464714104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7198153f50 msgr2=0x7f7198154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7198153f50 0x7f7198154370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f71980c54c0 tx=0x7f718c0090f0).stop 2023-08-17T00:03:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 -- 172.21.15.153:0/2464714104 shutdown_connections 2023-08-17T00:03:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f7198157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 --2- 172.21.15.153:0/2464714104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7198153f50 0x7f7198154370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 --2- 172.21.15.153:0/2464714104 >> v2:172.21.15.178:3300/0 conn(0x7f71980c57a0 0x7f71980c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 -- 172.21.15.153:0/2464714104 >> 172.21.15.153:0/2464714104 conn(0x7f7198062a70 msgr2=0x7f71980ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 -- 172.21.15.153:0/2464714104 shutdown_connections 2023-08-17T00:03:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.574+0000 7f719759e700 1 -- 172.21.15.153:0/2464714104 wait complete. 2023-08-17T00:03:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 Processor -- start 2023-08-17T00:03:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 -- start start 2023-08-17T00:03:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 0x7f719813efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7198153f50 0x7f71980c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f71980c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980aef40 con 0x7f71980c57a0 2023-08-17T00:03:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71980ae330 con 0x7f7198153f50 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71980ae610 con 0x7f7198157600 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 0x7f719813efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 0x7f719813efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56224/0 (socket says 172.21.15.153:56224) 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f719659c700 1 -- 172.21.15.153:0/248054582 learned_addr learned my addr 172.21.15.153:0/248054582 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.578+0000 7f7196d9d700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f71980c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f7195d9b700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7198153f50 0x7f71980c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719659c700 1 -- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 msgr2=0x7f71980c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719659c700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f71980c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719659c700 1 -- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7198153f50 msgr2=0x7f71980c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719659c700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7198153f50 0x7f71980c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719659c700 1 -- 172.21.15.153:0/248054582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c009370 con 0x7f71980c57a0 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f7195d9b700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7198153f50 0x7f71980c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719659c700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 0x7f719813efc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f718800e900 tx=0x7f7188009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188012600 con 0x7f71980c57a0 2023-08-17T00:03:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7188012760 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71980ae8f0 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7188012ae0 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719813f4b0 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.582+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f719806b4c0 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.586+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7188022070 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.586+0000 7f71867fc700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717805a150 0x7f717805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.586+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7188074430 con 0x7f71980c57a0 2023-08-17T00:03:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.586+0000 7f7195d9b700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717805a150 0x7f717805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.586+0000 7f7195d9b700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717805a150 0x7f717805c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f718c009130 tx=0x7f718c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.590+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7188047dd0 con 0x7f71980c57a0 2023-08-17T00:03:04.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.750+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f71980bf9a0 con 0x7f71980c57a0 2023-08-17T00:03:04.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.750+0000 7f71867fc700 1 -- 172.21.15.153:0/248054582 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f718804b3f0 con 0x7f71980c57a0 2023-08-17T00:03:04.756 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:04.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717805a150 msgr2=0x7f717805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717805a150 0x7f717805c610 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f718c009130 tx=0x7f718c017000).stop 2023-08-17T00:03:04.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 msgr2=0x7f719813efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 0x7f719813efc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f718800e900 tx=0x7f7188009060).stop 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 shutdown_connections 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717805a150 0x7f717805c610 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7198157600 0x7f71980c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7198153f50 0x7f71980c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 --2- 172.21.15.153:0/248054582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71980c57a0 0x7f719813efc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 >> 172.21.15.153:0/248054582 conn(0x7f7198062a70 msgr2=0x7f7198156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:04.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 shutdown_connections 2023-08-17T00:03:04.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.754+0000 7f719759e700 1 -- 172.21.15.153:0/248054582 wait complete. 2023-08-17T00:03:04.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:04.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.934+0000 7fca840f1700 1 Processor -- start 2023-08-17T00:03:04.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.934+0000 7fca840f1700 1 -- start start 2023-08-17T00:03:04.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca840f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca7c153ab0 0x7fca7c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca840f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0aa750 con 0x7fca7c0c7ba0 2023-08-17T00:03:04.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca840f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0c9dd0 con 0x7fca7c0c8d50 2023-08-17T00:03:04.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca840f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0aacf0 con 0x7fca7c153ab0 2023-08-17T00:03:04.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca8268e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fca7c0c7ba0 0x7fca7c0ab180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35772/0 (socket says 172.21.15.153:35772) 2023-08-17T00:03:04.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca8268e700 1 -- 172.21.15.153:0/2511100753 learned_addr learned my addr 172.21.15.153:0/2511100753 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:04.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca81e8d700 1 --2- 172.21.15.153:0/2511100753 >> v2:172.21.15.178:3300/0 conn(0x7fca7c153ab0 0x7fca7c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683826788 0 0) 0x7fca7c0aa750 con 0x7fca7c0c7ba0 2023-08-17T00:03:04.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca680033f0 con 0x7fca7c0c7ba0 2023-08-17T00:03:04.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400515864 0 0) 0x7fca7c0c9dd0 con 0x7fca7c0c8d50 2023-08-17T00:03:04.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca7c0aa750 con 0x7fca7c0c8d50 2023-08-17T00:03:04.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1250285191 0 0) 0x7fca680033f0 con 0x7fca7c0c7ba0 2023-08-17T00:03:04.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca81e8d700 1 -- 172.21.15.153:0/2511100753 >> v1:172.21.15.178:6789/0 conn(0x7fca7c0c8d50 legacy=0x7fca7c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca81e8d700 1 -- 172.21.15.153:0/2511100753 >> v1:172.21.15.153:6789/0 conn(0x7fca7c0c7ba0 legacy=0x7fca7c0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca81e8d700 1 -- 172.21.15.153:0/2511100753 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0c5ca0 con 0x7fca7c153ab0 2023-08-17T00:03:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.938+0000 7fca81e8d700 1 --2- 172.21.15.153:0/2511100753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c153e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fca78009760 tx=0x7fca78009060).ready entity=mon.1 client_cookie=e0410bd39bde5dcd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740017f0 con 0x7fca7c153ab0 2023-08-17T00:03:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca780090d0 con 0x7fca7c153ab0 2023-08-17T00:03:04.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca80e8b700 1 -- 172.21.15.153:0/2511100753 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011610 con 0x7fca7c153ab0 2023-08-17T00:03:04.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 -- 172.21.15.153:0/2511100753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 msgr2=0x7fca7c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 --2- 172.21.15.153:0/2511100753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c153e90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fca78009760 tx=0x7fca78009060).stop 2023-08-17T00:03:04.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 -- 172.21.15.153:0/2511100753 shutdown_connections 2023-08-17T00:03:04.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 --2- 172.21.15.153:0/2511100753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c153e90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 -- 172.21.15.153:0/2511100753 >> 172.21.15.153:0/2511100753 conn(0x7fca7c061fa0 msgr2=0x7fca7c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:04.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 -- 172.21.15.153:0/2511100753 shutdown_connections 2023-08-17T00:03:04.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.942+0000 7fca840f1700 1 -- 172.21.15.153:0/2511100753 wait complete. 2023-08-17T00:03:04.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 Processor -- start 2023-08-17T00:03:04.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 -- start start 2023-08-17T00:03:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0c7ba0 0x7fca7c0c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 0x7fca7c1678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c0a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c168890 con 0x7fca7c0c8d50 2023-08-17T00:03:04.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c14f470 con 0x7fca7c153ab0 2023-08-17T00:03:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca840f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0adc40 con 0x7fca7c0c7ba0 2023-08-17T00:03:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 0x7fca7c1678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 0x7fca7c1678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56228/0 (socket says 172.21.15.153:56228) 2023-08-17T00:03:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 -- 172.21.15.153:0/527246535 learned_addr learned my addr 172.21.15.153:0/527246535 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8268e700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c0a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca81e8d700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0c7ba0 0x7fca7c0c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 -- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0c7ba0 msgr2=0x7fca7c0c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0c7ba0 0x7fca7c0c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 -- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 msgr2=0x7fca7c0a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c0a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.946+0000 7fca8168c700 1 -- 172.21.15.153:0/527246535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780092a0 con 0x7fca7c0c8d50 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca8168c700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 0x7fca7c1678a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fca6c00c4c0 tx=0x7fca6c007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00ce30 con 0x7fca7c0c8d50 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c167d90 con 0x7fca7c0c8d50 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00f470 con 0x7fca7c0c8d50 2023-08-17T00:03:04.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00f810 con 0x7fca7c0c8d50 2023-08-17T00:03:04.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c1682d0 con 0x7fca7c0c8d50 2023-08-17T00:03:04.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c0ada10 con 0x7fca7c0c8d50 2023-08-17T00:03:04.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.950+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fca6c019030 con 0x7fca7c0c8d50 2023-08-17T00:03:04.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.954+0000 7fca71ffb700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca6005a150 0x7fca6005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:04.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.954+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fca6c073550 con 0x7fca7c0c8d50 2023-08-17T00:03:04.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.954+0000 7fca81e8d700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca6005a150 0x7fca6005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:04.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.954+0000 7fca81e8d700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca6005a150 0x7fca6005c610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fca78006be0 tx=0x7fca78016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:04.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:04.962+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca6c047000 con 0x7fca7c0c8d50 2023-08-17T00:03:05.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.122+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca7c06b530 con 0x7fca7c0c8d50 2023-08-17T00:03:05.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.122+0000 7fca71ffb700 1 -- 172.21.15.153:0/527246535 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca6c04a620 con 0x7fca7c0c8d50 2023-08-17T00:03:05.130 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:05.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca6005a150 msgr2=0x7fca6005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca6005a150 0x7fca6005c610 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fca78006be0 tx=0x7fca78016000).stop 2023-08-17T00:03:05.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 msgr2=0x7fca7c1678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 0x7fca7c1678a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fca6c00c4c0 tx=0x7fca6c007c90).stop 2023-08-17T00:03:05.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 shutdown_connections 2023-08-17T00:03:05.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca6005a150 0x7fca6005c610 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c153ab0 0x7fca7c0a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca7c0c8d50 0x7fca7c1678a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 --2- 172.21.15.153:0/527246535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0c7ba0 0x7fca7c0c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 >> 172.21.15.153:0/527246535 conn(0x7fca7c061fa0 msgr2=0x7fca7c150c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:05.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 shutdown_connections 2023-08-17T00:03:05.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.126+0000 7fca840f1700 1 -- 172.21.15.153:0/527246535 wait complete. 2023-08-17T00:03:05.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:05.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 Processor -- start 2023-08-17T00:03:05.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 -- start start 2023-08-17T00:03:05.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f298c0c3730 0x7f298c0bc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f298c150e80 0x7f298c0642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c151eb0 con 0x7f298c0c3b10 2023-08-17T00:03:05.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0bca10 con 0x7f298c0c3730 2023-08-17T00:03:05.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f2990c79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c151330 con 0x7f298c150e80 2023-08-17T00:03:05.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f298bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f298c0c3b10 0x7f298c066ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36660/0 (socket says 172.21.15.153:36660) 2023-08-17T00:03:05.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f298bfff700 1 -- 172.21.15.153:0/1555990348 learned_addr learned my addr 172.21.15.153:0/1555990348 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f298b7fe700 1 --2- 172.21.15.153:0/1555990348 >> v2:172.21.15.153:3300/0 conn(0x7f298c0c3730 0x7f298c0bc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.310+0000 7f298affd700 1 --2- 172.21.15.153:0/1555990348 >> v2:172.21.15.178:3300/0 conn(0x7f298c150e80 0x7f298c0642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298a7fc700 1 -- 172.21.15.153:0/1555990348 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767560336 0 0) 0x7f298c151eb0 con 0x7f298c0c3b10 2023-08-17T00:03:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298a7fc700 1 -- 172.21.15.153:0/1555990348 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29740033f0 con 0x7f298c0c3b10 2023-08-17T00:03:05.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298b7fe700 1 -- 172.21.15.153:0/1555990348 >> v2:172.21.15.178:3300/0 conn(0x7f298c150e80 msgr2=0x7f298c0642d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:05.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298b7fe700 1 --2- 172.21.15.153:0/1555990348 >> v2:172.21.15.178:3300/0 conn(0x7f298c150e80 0x7f298c0642d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298b7fe700 1 -- 172.21.15.153:0/1555990348 >> v1:172.21.15.153:6789/0 conn(0x7f298c0c3b10 legacy=0x7f298c066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298b7fe700 1 -- 172.21.15.153:0/1555990348 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c151610 con 0x7f298c0c3730 2023-08-17T00:03:05.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298b7fe700 1 --2- 172.21.15.153:0/1555990348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3730 0x7f298c0bc520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f298c0be610 tx=0x7f297c009060).ready entity=mon.0 client_cookie=b837081f691341c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298a7fc700 1 -- 172.21.15.153:0/1555990348 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c0090d0 con 0x7f298c0c3730 2023-08-17T00:03:05.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298a7fc700 1 -- 172.21.15.153:0/1555990348 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c00d4a0 con 0x7f298c0c3730 2023-08-17T00:03:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f298a7fc700 1 -- 172.21.15.153:0/1555990348 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297c00d820 con 0x7f298c0c3730 2023-08-17T00:03:05.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 -- 172.21.15.153:0/1555990348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3730 msgr2=0x7f298c0bc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 --2- 172.21.15.153:0/1555990348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3730 0x7f298c0bc520 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f298c0be610 tx=0x7f297c009060).stop 2023-08-17T00:03:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 -- 172.21.15.153:0/1555990348 shutdown_connections 2023-08-17T00:03:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 --2- 172.21.15.153:0/1555990348 >> v2:172.21.15.178:3300/0 conn(0x7f298c150e80 0x7f298c0642d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 --2- 172.21.15.153:0/1555990348 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3730 0x7f298c0bc520 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 -- 172.21.15.153:0/1555990348 >> 172.21.15.153:0/1555990348 conn(0x7f298c069700 msgr2=0x7f298c069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 -- 172.21.15.153:0/1555990348 shutdown_connections 2023-08-17T00:03:05.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.314+0000 7f2990c79700 1 -- 172.21.15.153:0/1555990348 wait complete. 2023-08-17T00:03:05.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 Processor -- start 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 -- start start 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0c3730 0x7f298c14f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 0x7f298c0a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c150e80 0x7f298c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0c0090 con 0x7f298c0c3b10 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a5210 con 0x7f298c0c3730 2023-08-17T00:03:05.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f2990c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0aa570 con 0x7f298c150e80 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f298affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 0x7f298c0a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f298affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 0x7f298c0a4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46164/0 (socket says 172.21.15.153:46164) 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f298affd700 1 -- 172.21.15.153:0/3649154427 learned_addr learned my addr 172.21.15.153:0/3649154427 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f298b7fe700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0c3730 0x7f298c14f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.318+0000 7f298bfff700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c150e80 0x7f298c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298affd700 1 -- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c150e80 msgr2=0x7f298c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298affd700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c150e80 0x7f298c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298affd700 1 -- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0c3730 msgr2=0x7f298c14f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298affd700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0c3730 0x7f298c14f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298affd700 1 -- 172.21.15.153:0/3649154427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f297c0092a0 con 0x7f298c0c3b10 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298bfff700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c150e80 0x7f298c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f298affd700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 0x7f298c0a4830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f298000e900 tx=0x7f2980009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000c670 con 0x7f298c0c3b10 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298000c7d0 con 0x7f298c0c3b10 2023-08-17T00:03:05.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c0aa780 con 0x7f298c0c3b10 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000cb50 con 0x7f298c0c3b10 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c0aad40 con 0x7f298c0c3b10 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c06b4c0 con 0x7f298c0c3b10 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.322+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2980022070 con 0x7f298c0c3b10 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.326+0000 7f29737fe700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f297805a150 0x7f297805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.326+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2980074490 con 0x7f298c0c3b10 2023-08-17T00:03:05.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.326+0000 7f298b7fe700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f297805a150 0x7f297805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.326+0000 7f298b7fe700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f297805a150 0x7f297805c610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f297c009fd0 tx=0x7f297c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:05.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.330+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2980047ec0 con 0x7f298c0c3b10 2023-08-17T00:03:05.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.490+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f298c0650c0 con 0x7f298c0c3b10 2023-08-17T00:03:05.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.490+0000 7f29737fe700 1 -- 172.21.15.153:0/3649154427 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2980016020 con 0x7f298c0c3b10 2023-08-17T00:03:05.495 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:05.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f297805a150 msgr2=0x7f297805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f297805a150 0x7f297805c610 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f297c009fd0 tx=0x7f297c016000).stop 2023-08-17T00:03:05.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 msgr2=0x7f298c0a4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 0x7f298c0a4830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f298000e900 tx=0x7f2980009060).stop 2023-08-17T00:03:05.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 shutdown_connections 2023-08-17T00:03:05.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f297805a150 0x7f297805c610 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c150e80 0x7f298c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c0c3b10 0x7f298c0a4830 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 --2- 172.21.15.153:0/3649154427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0c3730 0x7f298c14f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 >> 172.21.15.153:0/3649154427 conn(0x7f298c069700 msgr2=0x7f298c0a5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:05.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 shutdown_connections 2023-08-17T00:03:05.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.494+0000 7f2990c79700 1 -- 172.21.15.153:0/3649154427 wait complete. 2023-08-17T00:03:05.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:05.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 Processor -- start 2023-08-17T00:03:05.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 -- start start 2023-08-17T00:03:05.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0880689c0 0x7fc088068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc088151530 0x7fc0881519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc088065da0 con 0x7fc0881560f0 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088155c60 con 0x7fc088151530 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08d547700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088156550 con 0x7fc0880689c0 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc088151530 0x7fc0881519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc088151530 0x7fc0881519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46176/0 (socket says 172.21.15.153:46176) 2023-08-17T00:03:05.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 -- 172.21.15.153:0/837530021 learned_addr learned my addr 172.21.15.153:0/837530021 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:05.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc087fff700 1 --2- 172.21.15.153:0/837530021 >> v2:172.21.15.178:3300/0 conn(0x7fc0880689c0 0x7fc088068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 -- 172.21.15.153:0/837530021 >> v2:172.21.15.178:3300/0 conn(0x7fc0880689c0 msgr2=0x7fc088068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 --2- 172.21.15.153:0/837530021 >> v2:172.21.15.178:3300/0 conn(0x7fc0880689c0 0x7fc088068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 -- 172.21.15.153:0/837530021 >> v1:172.21.15.178:6789/0 conn(0x7fc0881560f0 legacy=0x7fc0880c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.662+0000 7fc08cd46700 1 -- 172.21.15.153:0/837530021 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088065ff0 con 0x7fc088151530 2023-08-17T00:03:05.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08cd46700 1 --2- 172.21.15.153:0/837530021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc088151530 0x7fc0881519c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc0880c2d60 tx=0x7fc080009840).ready entity=mon.0 client_cookie=ec7d0a3dd86674a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc086ffd700 1 -- 172.21.15.153:0/837530021 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000e070 con 0x7fc088151530 2023-08-17T00:03:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc086ffd700 1 -- 172.21.15.153:0/837530021 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000ba20 con 0x7fc088151530 2023-08-17T00:03:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc086ffd700 1 -- 172.21.15.153:0/837530021 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000bda0 con 0x7fc088151530 2023-08-17T00:03:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 -- 172.21.15.153:0/837530021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc088151530 msgr2=0x7fc0881519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 --2- 172.21.15.153:0/837530021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc088151530 0x7fc0881519c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc0880c2d60 tx=0x7fc080009840).stop 2023-08-17T00:03:05.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 -- 172.21.15.153:0/837530021 shutdown_connections 2023-08-17T00:03:05.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 --2- 172.21.15.153:0/837530021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc088151530 0x7fc0881519c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 --2- 172.21.15.153:0/837530021 >> v2:172.21.15.178:3300/0 conn(0x7fc0880689c0 0x7fc088068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 -- 172.21.15.153:0/837530021 >> 172.21.15.153:0/837530021 conn(0x7fc0880c6620 msgr2=0x7fc0880c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:05.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 -- 172.21.15.153:0/837530021 shutdown_connections 2023-08-17T00:03:05.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 -- 172.21.15.153:0/837530021 wait complete. 2023-08-17T00:03:05.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.666+0000 7fc08d547700 1 Processor -- start 2023-08-17T00:03:05.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 -- start start 2023-08-17T00:03:05.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0880689c0 0x7fc0881642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc088151530 0x7fc088144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 0x7fc0881528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881450c0 con 0x7fc0881560f0 2023-08-17T00:03:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088153d40 con 0x7fc088151530 2023-08-17T00:03:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc088153130 con 0x7fc0880689c0 2023-08-17T00:03:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 0x7fc0881528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 0x7fc0881528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46182/0 (socket says 172.21.15.153:46182) 2023-08-17T00:03:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 -- 172.21.15.153:0/265832296 learned_addr learned my addr 172.21.15.153:0/265832296 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:05.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 -- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0880689c0 msgr2=0x7fc0881642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0880689c0 0x7fc0881642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:05.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 -- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc088151530 msgr2=0x7fc088144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc0877fe700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc088151530 0x7fc088144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc088151530 0x7fc088144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 -- 172.21.15.153:0/265832296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080009ae0 con 0x7fc0881560f0 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc0877fe700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc088151530 0x7fc088144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08cd46700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 0x7fc0881528e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc08000b6c0 tx=0x7fc080009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0800092e0 con 0x7fc0881560f0 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08001e470 con 0x7fc0881560f0 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc088153410 con 0x7fc0881560f0 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08001e7f0 con 0x7fc0881560f0 2023-08-17T00:03:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.670+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0881539d0 con 0x7fc0881560f0 2023-08-17T00:03:05.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.674+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08806b4c0 con 0x7fc0881560f0 2023-08-17T00:03:05.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.674+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc080025030 con 0x7fc0881560f0 2023-08-17T00:03:05.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.674+0000 7fc07ffff700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc06805a150 0x7fc06805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:05.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.674+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc080075900 con 0x7fc0881560f0 2023-08-17T00:03:05.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.678+0000 7fc087fff700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc06805a150 0x7fc06805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:05.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.678+0000 7fc087fff700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc06805a150 0x7fc06805c610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc078006fd0 tx=0x7fc078006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:05.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.682+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0800492a0 con 0x7fc0881560f0 2023-08-17T00:03:05.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.878+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc088153eb0 con 0x7fc0881560f0 2023-08-17T00:03:05.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.878+0000 7fc07ffff700 1 -- 172.21.15.153:0/265832296 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7fc080023070 con 0x7fc0881560f0 2023-08-17T00:03:05.884 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:05.884 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc06805a150 msgr2=0x7fc06805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc06805a150 0x7fc06805c610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fc078006fd0 tx=0x7fc078006f40).stop 2023-08-17T00:03:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 msgr2=0x7fc0881528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 0x7fc0881528e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fc08000b6c0 tx=0x7fc080009840).stop 2023-08-17T00:03:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 shutdown_connections 2023-08-17T00:03:05.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc06805a150 0x7fc06805c610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0881560f0 0x7fc0881528e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc088151530 0x7fc088144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:05.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 --2- 172.21.15.153:0/265832296 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0880689c0 0x7fc0881642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:05.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 >> 172.21.15.153:0/265832296 conn(0x7fc0880c6620 msgr2=0x7fc0880c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:05.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 shutdown_connections 2023-08-17T00:03:05.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:05.882+0000 7fc08d547700 1 -- 172.21.15.153:0/265832296 wait complete. 2023-08-17T00:03:05.889 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:05.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:06.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 Processor -- start 2023-08-17T00:03:06.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 -- start start 2023-08-17T00:03:06.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d8c151f70 0x7f0d8c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0d8c065b50 0x7f0d8c064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d8c061fa0 con 0x7f0d8c151b90 2023-08-17T00:03:06.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c3fb0 con 0x7f0d8c065b50 2023-08-17T00:03:06.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d9471b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c1523d0 con 0x7f0d8c151f70 2023-08-17T00:03:06.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d92cb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0d8c065b50 0x7f0d8c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d92cb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0d8c065b50 0x7f0d8c064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46186/0 (socket says 172.21.15.153:46186) 2023-08-17T00:03:06.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d92cb8700 1 -- 172.21.15.153:0/3349695716 learned_addr learned my addr 172.21.15.153:0/3349695716 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:06.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.062+0000 7f0d91cb6700 1 --2- 172.21.15.153:0/3349695716 >> v2:172.21.15.178:3300/0 conn(0x7f0d8c151f70 0x7f0d8c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d92cb8700 1 -- 172.21.15.153:0/3349695716 >> v2:172.21.15.178:3300/0 conn(0x7f0d8c151f70 msgr2=0x7f0d8c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:06.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d92cb8700 1 --2- 172.21.15.153:0/3349695716 >> v2:172.21.15.178:3300/0 conn(0x7f0d8c151f70 0x7f0d8c065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d92cb8700 1 -- 172.21.15.153:0/3349695716 >> v1:172.21.15.178:6789/0 conn(0x7f0d8c151b90 legacy=0x7f0d8c063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d92cb8700 1 -- 172.21.15.153:0/3349695716 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c0621f0 con 0x7f0d8c065b50 2023-08-17T00:03:06.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d91cb6700 1 --2- 172.21.15.153:0/3349695716 >> v2:172.21.15.178:3300/0 conn(0x7f0d8c151f70 0x7f0d8c065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:06.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d92cb8700 1 --2- 172.21.15.153:0/3349695716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c064870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0d8c05ebc0 tx=0x7f0d84009840).ready entity=mon.0 client_cookie=fd98fbac1705dba1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d914b5700 1 -- 172.21.15.153:0/3349695716 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400e070 con 0x7f0d8c065b50 2023-08-17T00:03:06.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d914b5700 1 -- 172.21.15.153:0/3349695716 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8400ba50 con 0x7f0d8c065b50 2023-08-17T00:03:06.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d914b5700 1 -- 172.21.15.153:0/3349695716 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400bdd0 con 0x7f0d8c065b50 2023-08-17T00:03:06.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 -- 172.21.15.153:0/3349695716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 msgr2=0x7f0d8c064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 --2- 172.21.15.153:0/3349695716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c064870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f0d8c05ebc0 tx=0x7f0d84009840).stop 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 -- 172.21.15.153:0/3349695716 shutdown_connections 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 --2- 172.21.15.153:0/3349695716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c064870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 --2- 172.21.15.153:0/3349695716 >> v2:172.21.15.178:3300/0 conn(0x7f0d8c151f70 0x7f0d8c065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 -- 172.21.15.153:0/3349695716 >> 172.21.15.153:0/3349695716 conn(0x7f0d8c0c7150 msgr2=0x7f0d8c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 -- 172.21.15.153:0/3349695716 shutdown_connections 2023-08-17T00:03:06.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.066+0000 7f0d9471b700 1 -- 172.21.15.153:0/3349695716 wait complete. 2023-08-17T00:03:06.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 Processor -- start 2023-08-17T00:03:06.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 -- start start 2023-08-17T00:03:06.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d8c151b90 0x7f0d8c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d8c151f70 0x7f0d8c13ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c1550b0 con 0x7f0d8c065b50 2023-08-17T00:03:06.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c1544a0 con 0x7f0d8c151b90 2023-08-17T00:03:06.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d9471b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c154780 con 0x7f0d8c151f70 2023-08-17T00:03:06.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46192/0 (socket says 172.21.15.153:46192) 2023-08-17T00:03:06.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 -- 172.21.15.153:0/1703361709 learned_addr learned my addr 172.21.15.153:0/1703361709 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:06.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d92cb8700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d8c151f70 0x7f0d8c13ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d91cb6700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d8c151b90 0x7f0d8c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 -- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d8c151f70 msgr2=0x7f0d8c13ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d8c151f70 0x7f0d8c13ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 -- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d8c151b90 msgr2=0x7f0d8c14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d8c151b90 0x7f0d8c14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.070+0000 7f0d924b7700 1 -- 172.21.15.153:0/1703361709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84009ae0 con 0x7f0d8c065b50 2023-08-17T00:03:06.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d924b7700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c153b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0d8800c4c0 tx=0x7f0d88007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8800ce70 con 0x7f0d8c065b50 2023-08-17T00:03:06.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d88001e90 con 0x7f0d8c065b50 2023-08-17T00:03:06.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d88007250 con 0x7f0d8c065b50 2023-08-17T00:03:06.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c154a60 con 0x7f0d8c065b50 2023-08-17T00:03:06.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c154040 con 0x7f0d8c065b50 2023-08-17T00:03:06.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c155260 con 0x7f0d8c065b50 2023-08-17T00:03:06.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.074+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0d88010070 con 0x7f0d8c065b50 2023-08-17T00:03:06.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.078+0000 7f0d827fc700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d7005a150 0x7f0d7005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.078+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0d88073880 con 0x7f0d8c065b50 2023-08-17T00:03:06.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.078+0000 7f0d91cb6700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d7005a150 0x7f0d7005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.078+0000 7f0d91cb6700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d7005a150 0x7f0d7005c610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0d8c0c06a0 tx=0x7f0d7c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.082+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d88047330 con 0x7f0d8c065b50 2023-08-17T00:03:06.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.250+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d8c06b530 con 0x7f0d8c065b50 2023-08-17T00:03:06.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.250+0000 7f0d827fc700 1 -- 172.21.15.153:0/1703361709 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f0d8804a950 con 0x7f0d8c065b50 2023-08-17T00:03:06.258 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:06.258 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:06.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d7005a150 msgr2=0x7f0d7005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d7005a150 0x7f0d7005c610 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f0d8c0c06a0 tx=0x7f0d7c008040).stop 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 msgr2=0x7f0d8c153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c153b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f0d8800c4c0 tx=0x7f0d88007e00).stop 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 shutdown_connections 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d7005a150 0x7f0d7005c610 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d8c151f70 0x7f0d8c13ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d8c151b90 0x7f0d8c14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.254+0000 7f0d9471b700 1 --2- 172.21.15.153:0/1703361709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d8c065b50 0x7f0d8c153b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.258+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 >> 172.21.15.153:0/1703361709 conn(0x7f0d8c0c7150 msgr2=0x7f0d8c063190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:06.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.258+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 shutdown_connections 2023-08-17T00:03:06.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.258+0000 7f0d9471b700 1 -- 172.21.15.153:0/1703361709 wait complete. 2023-08-17T00:03:06.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:06.283 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:06.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.438+0000 7f75a2ff9700 1 Processor -- start 2023-08-17T00:03:06.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.438+0000 7f75a2ff9700 1 -- start start 2023-08-17T00:03:06.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a2ff9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f759c0a9c40 0x7f759c0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a2ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0ca4f0 0x7f759c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a2ff9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759c0ab690 con 0x7f759c0c9f00 2023-08-17T00:03:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a2ff9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759c0c9a70 con 0x7f759c0a9c40 2023-08-17T00:03:06.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a2ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c153fa0 con 0x7f759c0ca4f0 2023-08-17T00:03:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a17f6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0ca4f0 0x7f759c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a27f8700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f759c0c9f00 0x7f759c157640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:35848/0 (socket says 172.21.15.153:35848) 2023-08-17T00:03:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a27f8700 1 -- 172.21.15.153:0/951268804 learned_addr learned my addr 172.21.15.153:0/951268804 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.442+0000 7f75a1ff7700 1 --2- 172.21.15.153:0/951268804 >> v2:172.21.15.178:3300/0 conn(0x7f759c0a9c40 0x7f759c0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a17f6700 1 -- 172.21.15.153:0/951268804 >> v2:172.21.15.178:3300/0 conn(0x7f759c0a9c40 msgr2=0x7f759c0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:06.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a17f6700 1 --2- 172.21.15.153:0/951268804 >> v2:172.21.15.178:3300/0 conn(0x7f759c0a9c40 0x7f759c0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a17f6700 1 -- 172.21.15.153:0/951268804 >> v1:172.21.15.178:6789/0 conn(0x7f759c0c9f00 legacy=0x7f759c157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a0ff5700 1 -- 172.21.15.153:0/951268804 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104278445 0 0) 0x7f7594001490 con 0x7f759c0c9f00 2023-08-17T00:03:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a17f6700 1 -- 172.21.15.153:0/951268804 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c0c9140 con 0x7f759c0ca4f0 2023-08-17T00:03:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a17f6700 1 --2- 172.21.15.153:0/951268804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0ca4f0 0x7f759c061fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f758c009760 tx=0x7f758c009060).ready entity=mon.2 client_cookie=1327983d4c59cf94 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a0ff5700 1 -- 172.21.15.153:0/951268804 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f510 con 0x7f759c0ca4f0 2023-08-17T00:03:06.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a0ff5700 1 -- 172.21.15.153:0/951268804 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c00f670 con 0x7f759c0ca4f0 2023-08-17T00:03:06.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a0ff5700 1 -- 172.21.15.153:0/951268804 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f9f0 con 0x7f759c0ca4f0 2023-08-17T00:03:06.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 -- 172.21.15.153:0/951268804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0ca4f0 msgr2=0x7f759c061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/951268804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0ca4f0 0x7f759c061fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f758c009760 tx=0x7f758c009060).stop 2023-08-17T00:03:06.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 -- 172.21.15.153:0/951268804 shutdown_connections 2023-08-17T00:03:06.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/951268804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0ca4f0 0x7f759c061fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/951268804 >> v2:172.21.15.178:3300/0 conn(0x7f759c0a9c40 0x7f759c0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 -- 172.21.15.153:0/951268804 >> 172.21.15.153:0/951268804 conn(0x7f759c0cb370 msgr2=0x7f759c0c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:06.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 -- 172.21.15.153:0/951268804 shutdown_connections 2023-08-17T00:03:06.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.446+0000 7f75a2ff9700 1 -- 172.21.15.153:0/951268804 wait complete. 2023-08-17T00:03:06.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 Processor -- start 2023-08-17T00:03:06.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 -- start start 2023-08-17T00:03:06.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0a9c40 0x7f759c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 0x7f759c16c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759c0ca4f0 0x7f759c0af3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c169980 con 0x7f759c0c9f00 2023-08-17T00:03:06.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759c168e00 con 0x7f759c0ca4f0 2023-08-17T00:03:06.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a2ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759c1690e0 con 0x7f759c0a9c40 2023-08-17T00:03:06.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 0x7f759c16c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 0x7f759c16c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46198/0 (socket says 172.21.15.153:46198) 2023-08-17T00:03:06.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 -- 172.21.15.153:0/2877748389 learned_addr learned my addr 172.21.15.153:0/2877748389 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a1ff7700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0a9c40 0x7f759c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a27f8700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759c0ca4f0 0x7f759c0af3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 -- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0a9c40 msgr2=0x7f759c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0a9c40 0x7f759c14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 -- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759c0ca4f0 msgr2=0x7f759c0af3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759c0ca4f0 0x7f759c0af3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.450+0000 7f75a17f6700 1 -- 172.21.15.153:0/2877748389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c0092a0 con 0x7f759c0c9f00 2023-08-17T00:03:06.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f75a17f6700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 0x7f759c16c820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f758c009e00 tx=0x7f758c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c00f7e0 con 0x7f759c0c9f00 2023-08-17T00:03:06.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c00f940 con 0x7f759c0c9f00 2023-08-17T00:03:06.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c1693c0 con 0x7f759c0c9f00 2023-08-17T00:03:06.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c01b660 con 0x7f759c0c9f00 2023-08-17T00:03:06.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c0aed80 con 0x7f759c0c9f00 2023-08-17T00:03:06.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.454+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f759c1541f0 con 0x7f759c0c9f00 2023-08-17T00:03:06.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.458+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f758c00f070 con 0x7f759c0c9f00 2023-08-17T00:03:06.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.458+0000 7f7591ffb700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f758005a150 0x7f758005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.458+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f758c0753e0 con 0x7f759c0c9f00 2023-08-17T00:03:06.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.458+0000 7f75a1ff7700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f758005a150 0x7f758005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.462+0000 7f75a1ff7700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f758005a150 0x7f758005c610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7598009c30 tx=0x7f7598009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.466+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f759c1541f0 con 0x7f759c0c9f00 2023-08-17T00:03:06.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.618+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f759c1541f0 con 0x7f759c0c9f00 2023-08-17T00:03:06.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.618+0000 7f7591ffb700 1 -- 172.21.15.153:0/2877748389 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f759c1541f0 con 0x7f759c0c9f00 2023-08-17T00:03:06.625 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f758005a150 msgr2=0x7f758005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f758005a150 0x7f758005c610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f7598009c30 tx=0x7f7598009060).stop 2023-08-17T00:03:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 msgr2=0x7f759c16c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 0x7f759c16c820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f758c009e00 tx=0x7f758c017000).stop 2023-08-17T00:03:06.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 shutdown_connections 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f758005a150 0x7f758005c610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759c0ca4f0 0x7f759c0af3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f759c0c9f00 0x7f759c16c820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 --2- 172.21.15.153:0/2877748389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f759c0a9c40 0x7f759c14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 >> 172.21.15.153:0/2877748389 conn(0x7f759c0cb370 msgr2=0x7f759c061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 shutdown_connections 2023-08-17T00:03:06.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.622+0000 7f75a2ff9700 1 -- 172.21.15.153:0/2877748389 wait complete. 2023-08-17T00:03:06.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:06.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.810+0000 7fe1a9969700 1 Processor -- start 2023-08-17T00:03:06.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.810+0000 7fe1a9969700 1 -- start start 2023-08-17T00:03:06.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.810+0000 7fe1a9969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1a414c3d0 0x7fe1a41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.810+0000 7fe1a9969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4155670 con 0x7fe1a414bff0 2023-08-17T00:03:06.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.810+0000 7fe1a9969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1a4152640 con 0x7fe1a40a6760 2023-08-17T00:03:06.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.810+0000 7fe1a9969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1a4095790 con 0x7fe1a414c3d0 2023-08-17T00:03:06.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe1a414bff0 0x7fe1a4095080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36664/0 (socket says 172.21.15.153:36664) 2023-08-17T00:03:06.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a2ffd700 1 -- 172.21.15.153:0/4149490139 learned_addr learned my addr 172.21.15.153:0/4149490139 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:06.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a27fc700 1 --2- 172.21.15.153:0/4149490139 >> v2:172.21.15.153:3300/0 conn(0x7fe1a414c3d0 0x7fe1a41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752210366 0 0) 0x7fe1a4155670 con 0x7fe1a414bff0 2023-08-17T00:03:06.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe18c0033f0 con 0x7fe1a414bff0 2023-08-17T00:03:06.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126593029 0 0) 0x7fe1a4152640 con 0x7fe1a40a6760 2023-08-17T00:03:06.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a4155670 con 0x7fe1a40a6760 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a27fc700 1 -- 172.21.15.153:0/4149490139 >> v1:172.21.15.178:6789/0 conn(0x7fe1a40a6760 legacy=0x7fe1a40a6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a27fc700 1 -- 172.21.15.153:0/4149490139 >> v1:172.21.15.153:6789/0 conn(0x7fe1a414bff0 legacy=0x7fe1a4095080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a27fc700 1 -- 172.21.15.153:0/4149490139 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a4152920 con 0x7fe1a414c3d0 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a27fc700 1 --2- 172.21.15.153:0/4149490139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a41520a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe198009760 tx=0x7fe198009060).ready entity=mon.0 client_cookie=106f59513ae496ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe198009120 con 0x7fe1a414c3d0 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19800d4a0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a1ffb700 1 -- 172.21.15.153:0/4149490139 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19800d820 con 0x7fe1a414c3d0 2023-08-17T00:03:06.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 -- 172.21.15.153:0/4149490139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 msgr2=0x7fe1a41520a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 --2- 172.21.15.153:0/4149490139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a41520a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fe198009760 tx=0x7fe198009060).stop 2023-08-17T00:03:06.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 -- 172.21.15.153:0/4149490139 shutdown_connections 2023-08-17T00:03:06.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 --2- 172.21.15.153:0/4149490139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a41520a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 -- 172.21.15.153:0/4149490139 >> 172.21.15.153:0/4149490139 conn(0x7fe1a40c7800 msgr2=0x7fe1a40c7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:06.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 -- 172.21.15.153:0/4149490139 shutdown_connections 2023-08-17T00:03:06.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.814+0000 7fe1a9969700 1 -- 172.21.15.153:0/4149490139 wait complete. 2023-08-17T00:03:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 Processor -- start 2023-08-17T00:03:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 -- start start 2023-08-17T00:03:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40a6760 0x7fe1a414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a414bff0 0x7fe1a40bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a4154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a414c950 con 0x7fe1a414c3d0 2023-08-17T00:03:06.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40a87c0 con 0x7fe1a414bff0 2023-08-17T00:03:06.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.818+0000 7fe1a9969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a40c0110 con 0x7fe1a40a6760 2023-08-17T00:03:06.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a4154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a4154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46218/0 (socket says 172.21.15.153:46218) 2023-08-17T00:03:06.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 -- 172.21.15.153:0/1912498004 learned_addr learned my addr 172.21.15.153:0/1912498004 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:06.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a27fc700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a414bff0 0x7fe1a40bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 -- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40a6760 msgr2=0x7fe1a414b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40a6760 0x7fe1a414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:06.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 -- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a414bff0 msgr2=0x7fe1a40bf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a414bff0 0x7fe1a40bf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 -- 172.21.15.153:0/1912498004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980092a0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a27fc700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a414bff0 0x7fe1a40bf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:06.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a37fe700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a4154400 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe19c00c710 tx=0x7fe19c00cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c010510 con 0x7fe1a414c3d0 2023-08-17T00:03:06.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19c010670 con 0x7fe1a414c3d0 2023-08-17T00:03:06.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a40c03f0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19c0109f0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a414b790 con 0x7fe1a414c3d0 2023-08-17T00:03:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.822+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a40a82b0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.826+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe19c010070 con 0x7fe1a414c3d0 2023-08-17T00:03:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.826+0000 7fe18affd700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19005a150 0x7fe19005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.826+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe19c073fb0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.826+0000 7fe1a2ffd700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19005a150 0x7fe19005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:06.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.826+0000 7fe1a2ffd700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19005a150 0x7fe19005c610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fe194005750 tx=0x7fe194007850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:06.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.830+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1a40a82b0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.986+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe1a40a82b0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe18affd700 1 -- 172.21.15.153:0/1912498004 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe1a40a82b0 con 0x7fe1a414c3d0 2023-08-17T00:03:06.993 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19005a150 msgr2=0x7fe19005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19005a150 0x7fe19005c610 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fe194005750 tx=0x7fe194007850).stop 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 msgr2=0x7fe1a4154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a4154400 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fe19c00c710 tx=0x7fe19c00cad0).stop 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 shutdown_connections 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19005a150 0x7fe19005c610 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a414c3d0 0x7fe1a4154400 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a414bff0 0x7fe1a40bf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 --2- 172.21.15.153:0/1912498004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40a6760 0x7fe1a414b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 >> 172.21.15.153:0/1912498004 conn(0x7fe1a40c7800 msgr2=0x7fe1a4151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 shutdown_connections 2023-08-17T00:03:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:06.990+0000 7fe1a9969700 1 -- 172.21.15.153:0/1912498004 wait complete. 2023-08-17T00:03:07.015 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:07.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 Processor -- start 2023-08-17T00:03:07.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 -- start start 2023-08-17T00:03:07.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9640a8b70 0x7fd9640632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8f50 0x7fd9640629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9640656d0 0x7fd9640bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964065240 con 0x7fd9640a8b70 2023-08-17T00:03:07.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964062ea0 con 0x7fd9640656d0 2023-08-17T00:03:07.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd969569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640638a0 con 0x7fd9640a8f50 2023-08-17T00:03:07.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.178+0000 7fd962ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9640a8b70 0x7fd9640632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd9640a8b70 0x7fd9640632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46234/0 (socket says 172.21.15.153:46234) 2023-08-17T00:03:07.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 -- 172.21.15.153:0/1741886881 learned_addr learned my addr 172.21.15.153:0/1741886881 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:07.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd95bfff700 1 --2- 172.21.15.153:0/1741886881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8f50 0x7fd9640629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd9637fe700 1 --2- 172.21.15.153:0/1741886881 >> v2:172.21.15.178:3300/0 conn(0x7fd9640656d0 0x7fd9640bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 -- 172.21.15.153:0/1741886881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8f50 msgr2=0x7fd9640629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:07.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 --2- 172.21.15.153:0/1741886881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8f50 0x7fd9640629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 -- 172.21.15.153:0/1741886881 >> v2:172.21.15.178:3300/0 conn(0x7fd9640656d0 msgr2=0x7fd9640bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:07.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 --2- 172.21.15.153:0/1741886881 >> v2:172.21.15.178:3300/0 conn(0x7fd9640656d0 0x7fd9640bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 -- 172.21.15.153:0/1741886881 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd964064910 con 0x7fd9640a8b70 2023-08-17T00:03:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd962ffd700 1 --2- 172.21.15.153:0/1741886881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8b70 0x7fd9640632e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd9640c0980 tx=0x7fd9540090f0).ready entity=mon.0 client_cookie=68096f7be6c860ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd9627fc700 1 -- 172.21.15.153:0/1741886881 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400f510 con 0x7fd9640a8b70 2023-08-17T00:03:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd9627fc700 1 -- 172.21.15.153:0/1741886881 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95400f670 con 0x7fd9640a8b70 2023-08-17T00:03:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd9627fc700 1 -- 172.21.15.153:0/1741886881 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95400fa10 con 0x7fd9640a8b70 2023-08-17T00:03:07.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 -- 172.21.15.153:0/1741886881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8b70 msgr2=0x7fd9640632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 --2- 172.21.15.153:0/1741886881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8b70 0x7fd9640632e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd9640c0980 tx=0x7fd9540090f0).stop 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 -- 172.21.15.153:0/1741886881 shutdown_connections 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 --2- 172.21.15.153:0/1741886881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8f50 0x7fd9640629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 --2- 172.21.15.153:0/1741886881 >> v2:172.21.15.178:3300/0 conn(0x7fd9640656d0 0x7fd9640bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 --2- 172.21.15.153:0/1741886881 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8b70 0x7fd9640632e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 -- 172.21.15.153:0/1741886881 >> 172.21.15.153:0/1741886881 conn(0x7fd9640c7150 msgr2=0x7fd9640c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:07.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 -- 172.21.15.153:0/1741886881 shutdown_connections 2023-08-17T00:03:07.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.182+0000 7fd969569700 1 -- 172.21.15.153:0/1741886881 wait complete. 2023-08-17T00:03:07.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 Processor -- start 2023-08-17T00:03:07.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 -- start start 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9640656d0 0x7fd9641588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8b70 0x7fd96415b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8f50 0x7fd964146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96415bc30 con 0x7fd9640a8f50 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640a9690 con 0x7fd9640656d0 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd969569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9640aa1d0 con 0x7fd9640a8b70 2023-08-17T00:03:07.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8f50 0x7fd964146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd95bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8b70 0x7fd96415b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd95bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8b70 0x7fd96415b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:55136/0 (socket says 172.21.15.153:55136) 2023-08-17T00:03:07.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd962ffd700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9640656d0 0x7fd9641588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd95bfff700 1 -- 172.21.15.153:0/3460082935 learned_addr learned my addr 172.21.15.153:0/3460082935 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:07.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 -- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8b70 msgr2=0x7fd96415b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8b70 0x7fd96415b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 -- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9640656d0 msgr2=0x7fd9641588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9640656d0 0x7fd9641588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 -- 172.21.15.153:0/3460082935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd954009370 con 0x7fd9640a8f50 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.186+0000 7fd9637fe700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8f50 0x7fd964146b60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd95c009e50 tx=0x7fd95c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00caa0 con 0x7fd9640a8f50 2023-08-17T00:03:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c00f040 con 0x7fd9640a8f50 2023-08-17T00:03:07.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd964147050 con 0x7fd9640a8f50 2023-08-17T00:03:07.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c00ce10 con 0x7fd9640a8f50 2023-08-17T00:03:07.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9640a9b80 con 0x7fd9640a8f50 2023-08-17T00:03:07.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640aa340 con 0x7fd9640a8f50 2023-08-17T00:03:07.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.190+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd95c013610 con 0x7fd9640a8f50 2023-08-17T00:03:07.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.194+0000 7fd95affd700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd94405a120 0x7fd94405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.194+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd95c074b10 con 0x7fd9640a8f50 2023-08-17T00:03:07.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.194+0000 7fd962ffd700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd94405a120 0x7fd94405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.194+0000 7fd962ffd700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd94405a120 0x7fd94405c5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd9540091e0 tx=0x7fd954017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.198+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd95c048450 con 0x7fd9640a8f50 2023-08-17T00:03:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd96406b530 con 0x7fd9640a8f50 2023-08-17T00:03:07.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd95affd700 1 -- 172.21.15.153:0/3460082935 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd95c04ba70 con 0x7fd9640a8f50 2023-08-17T00:03:07.366 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd94405a120 msgr2=0x7fd94405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd94405a120 0x7fd94405c5e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd9540091e0 tx=0x7fd954017000).stop 2023-08-17T00:03:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8f50 msgr2=0x7fd964146b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8f50 0x7fd964146b60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd95c009e50 tx=0x7fd95c00b040).stop 2023-08-17T00:03:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 shutdown_connections 2023-08-17T00:03:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd94405a120 0x7fd94405c5e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd9640a8f50 0x7fd964146b60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9640a8b70 0x7fd96415b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 --2- 172.21.15.153:0/3460082935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9640656d0 0x7fd9641588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.362+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 >> 172.21.15.153:0/3460082935 conn(0x7fd9640c7150 msgr2=0x7fd9640c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:07.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.366+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 shutdown_connections 2023-08-17T00:03:07.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.366+0000 7fd969569700 1 -- 172.21.15.153:0/3460082935 wait complete. 2023-08-17T00:03:07.390 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:07.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.542+0000 7f1909f47700 1 Processor -- start 2023-08-17T00:03:07.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 -- start start 2023-08-17T00:03:07.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19040bdef0 0x7f19040c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19040c36d0 0x7f19040c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1904066ce0 0x7f1904067190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1904067680 con 0x7f19040c36d0 2023-08-17T00:03:07.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19040c3240 con 0x7f19040bdef0 2023-08-17T00:03:07.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909f47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1904154040 con 0x7f1904066ce0 2023-08-17T00:03:07.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1903fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19040c36d0 0x7f19040c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1903fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19040c36d0 0x7f19040c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46260/0 (socket says 172.21.15.153:46260) 2023-08-17T00:03:07.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1903fff700 1 -- 172.21.15.153:0/3316198179 learned_addr learned my addr 172.21.15.153:0/3316198179 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:07.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1908f45700 1 --2- 172.21.15.153:0/3316198179 >> v2:172.21.15.178:3300/0 conn(0x7f19040bdef0 0x7f19040c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1903fff700 1 -- 172.21.15.153:0/3316198179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1904066ce0 msgr2=0x7f1904067190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:07.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.546+0000 7f1909746700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1904066ce0 0x7f1904067190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1903fff700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1904066ce0 0x7f1904067190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1903fff700 1 -- 172.21.15.153:0/3316198179 >> v2:172.21.15.178:3300/0 conn(0x7f19040bdef0 msgr2=0x7f19040c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:07.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1903fff700 1 --2- 172.21.15.153:0/3316198179 >> v2:172.21.15.178:3300/0 conn(0x7f19040bdef0 0x7f19040c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1903fff700 1 -- 172.21.15.153:0/3316198179 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040c2630 con 0x7f19040c36d0 2023-08-17T00:03:07.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1908f45700 1 --2- 172.21.15.153:0/3316198179 >> v2:172.21.15.178:3300/0 conn(0x7f19040bdef0 0x7f19040c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:07.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909746700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1904066ce0 0x7f1904067190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:07.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1903fff700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040c36d0 0x7f19040c20a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f19040c7510 tx=0x7f18f00090f0).ready entity=mon.0 client_cookie=594bf19c2c984eef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f19037fe700 1 -- 172.21.15.153:0/3316198179 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000b600 con 0x7f19040c36d0 2023-08-17T00:03:07.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f19037fe700 1 -- 172.21.15.153:0/3316198179 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000b760 con 0x7f19040c36d0 2023-08-17T00:03:07.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f19037fe700 1 -- 172.21.15.153:0/3316198179 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000bb00 con 0x7f19040c36d0 2023-08-17T00:03:07.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 -- 172.21.15.153:0/3316198179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040c36d0 msgr2=0x7f19040c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040c36d0 0x7f19040c20a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f19040c7510 tx=0x7f18f00090f0).stop 2023-08-17T00:03:07.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 -- 172.21.15.153:0/3316198179 shutdown_connections 2023-08-17T00:03:07.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1904066ce0 0x7f1904067190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 --2- 172.21.15.153:0/3316198179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040c36d0 0x7f19040c20a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 --2- 172.21.15.153:0/3316198179 >> v2:172.21.15.178:3300/0 conn(0x7f19040bdef0 0x7f19040c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 -- 172.21.15.153:0/3316198179 >> 172.21.15.153:0/3316198179 conn(0x7f1904069740 msgr2=0x7f1904069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 -- 172.21.15.153:0/3316198179 shutdown_connections 2023-08-17T00:03:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.550+0000 7f1909f47700 1 -- 172.21.15.153:0/3316198179 wait complete. 2023-08-17T00:03:07.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 Processor -- start 2023-08-17T00:03:07.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 -- start start 2023-08-17T00:03:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1904066ce0 0x7f19041638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 0x7f19040a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19040c36d0 0x7f19040a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904165340 con 0x7f19040bdef0 2023-08-17T00:03:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1904165620 con 0x7f1904066ce0 2023-08-17T00:03:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.554+0000 7f1909f47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1904165900 con 0x7f19040c36d0 2023-08-17T00:03:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 0x7f19040a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 0x7f19040a97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46272/0 (socket says 172.21.15.153:46272) 2023-08-17T00:03:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 -- 172.21.15.153:0/2660864328 learned_addr learned my addr 172.21.15.153:0/2660864328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1908f45700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1904066ce0 0x7f19041638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1909746700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19040c36d0 0x7f19040a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 -- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19040c36d0 msgr2=0x7f19040a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19040c36d0 0x7f19040a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 -- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1904066ce0 msgr2=0x7f19041638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1904066ce0 0x7f19041638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 -- 172.21.15.153:0/2660864328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f0009370 con 0x7f19040bdef0 2023-08-17T00:03:07.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1903fff700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 0x7f19040a97d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f18f0011000 tx=0x7f18f0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000bec0 con 0x7f19040bdef0 2023-08-17T00:03:07.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f000b8d0 con 0x7f19040bdef0 2023-08-17T00:03:07.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1904165be0 con 0x7f19040bdef0 2023-08-17T00:03:07.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f000ba40 con 0x7f19040bdef0 2023-08-17T00:03:07.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.558+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1904163de0 con 0x7f19040bdef0 2023-08-17T00:03:07.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.562+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190406b4c0 con 0x7f19040bdef0 2023-08-17T00:03:07.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.562+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f18f002c070 con 0x7f19040bdef0 2023-08-17T00:03:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.562+0000 7f1900ff9700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18e805a150 0x7f18e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.562+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f18f0075dc0 con 0x7f19040bdef0 2023-08-17T00:03:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.562+0000 7f1908f45700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18e805a150 0x7f18e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.566+0000 7f1908f45700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18e805a150 0x7f18e805c610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f19040a8df0 tx=0x7f18f8007850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.566+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18f0049760 con 0x7f19040bdef0 2023-08-17T00:03:07.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19040c2910 con 0x7f19040bdef0 2023-08-17T00:03:07.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1900ff9700 1 -- 172.21.15.153:0/2660864328 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18f002a030 con 0x7f19040bdef0 2023-08-17T00:03:07.730 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:07.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18e805a150 msgr2=0x7f18e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18e805a150 0x7f18e805c610 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f19040a8df0 tx=0x7f18f8007850).stop 2023-08-17T00:03:07.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 msgr2=0x7f19040a97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 0x7f19040a97d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f18f0011000 tx=0x7f18f0017000).stop 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 shutdown_connections 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18e805a150 0x7f18e805c610 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19040c36d0 0x7f19040a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19040bdef0 0x7f19040a97d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 --2- 172.21.15.153:0/2660864328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1904066ce0 0x7f19041638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 >> 172.21.15.153:0/2660864328 conn(0x7f1904069740 msgr2=0x7f19040bd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 shutdown_connections 2023-08-17T00:03:07.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.726+0000 7f1909f47700 1 -- 172.21.15.153:0/2660864328 wait complete. 2023-08-17T00:03:07.755 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:07.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.910+0000 7f9adb69b700 1 Processor -- start 2023-08-17T00:03:07.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.910+0000 7f9adb69b700 1 -- start start 2023-08-17T00:03:07.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9adb69b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ad40a89c0 0x7f9ad40a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9adb69b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ad40c0c80 0x7f9ad40bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9adb69b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad40bc0b0 con 0x7f9ad41505d0 2023-08-17T00:03:07.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9adb69b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40bd590 con 0x7f9ad40c0c80 2023-08-17T00:03:07.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9adb69b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad4062fb0 con 0x7f9ad40a89c0 2023-08-17T00:03:07.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ad40c0c80 0x7f9ad40bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ad40c0c80 0x7f9ad40bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46288/0 (socket says 172.21.15.153:46288) 2023-08-17T00:03:07.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 -- 172.21.15.153:0/395888724 learned_addr learned my addr 172.21.15.153:0/395888724 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:07.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad9437700 1 --2- 172.21.15.153:0/395888724 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40a89c0 0x7f9ad40a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 -- 172.21.15.153:0/395888724 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40a89c0 msgr2=0x7f9ad40a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:07.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 --2- 172.21.15.153:0/395888724 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40a89c0 0x7f9ad40a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 -- 172.21.15.153:0/395888724 >> v1:172.21.15.178:6789/0 conn(0x7f9ad41505d0 legacy=0x7f9ad4150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 -- 172.21.15.153:0/395888724 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40bb780 con 0x7f9ad40c0c80 2023-08-17T00:03:07.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad9437700 1 --2- 172.21.15.153:0/395888724 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40a89c0 0x7f9ad40a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:07.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9ad8c36700 1 --2- 172.21.15.153:0/395888724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40bcdb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9ad4067fc0 tx=0x7f9ac40090f0).ready entity=mon.0 client_cookie=d99c2daa5286e27d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9acbfff700 1 -- 172.21.15.153:0/395888724 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400b600 con 0x7f9ad40c0c80 2023-08-17T00:03:07.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9acbfff700 1 -- 172.21.15.153:0/395888724 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400b760 con 0x7f9ad40c0c80 2023-08-17T00:03:07.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.914+0000 7f9acbfff700 1 -- 172.21.15.153:0/395888724 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400bae0 con 0x7f9ad40c0c80 2023-08-17T00:03:07.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 -- 172.21.15.153:0/395888724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 msgr2=0x7f9ad40bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 --2- 172.21.15.153:0/395888724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40bcdb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f9ad4067fc0 tx=0x7f9ac40090f0).stop 2023-08-17T00:03:07.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 -- 172.21.15.153:0/395888724 shutdown_connections 2023-08-17T00:03:07.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 --2- 172.21.15.153:0/395888724 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40bcdb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 --2- 172.21.15.153:0/395888724 >> v2:172.21.15.178:3300/0 conn(0x7f9ad40a89c0 0x7f9ad40a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 -- 172.21.15.153:0/395888724 >> 172.21.15.153:0/395888724 conn(0x7f9ad40c7150 msgr2=0x7f9ad40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:07.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 -- 172.21.15.153:0/395888724 shutdown_connections 2023-08-17T00:03:07.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 -- 172.21.15.153:0/395888724 wait complete. 2023-08-17T00:03:07.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 Processor -- start 2023-08-17T00:03:07.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.918+0000 7f9adb69b700 1 -- start start 2023-08-17T00:03:07.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40a89c0 0x7f9ad40ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad41505d0 0x7f9ad414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40a9d20 con 0x7f9ad40c0c80 2023-08-17T00:03:07.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40aa000 con 0x7f9ad40a89c0 2023-08-17T00:03:07.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40aa2e0 con 0x7f9ad41505d0 2023-08-17T00:03:07.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46294/0 (socket says 172.21.15.153:46294) 2023-08-17T00:03:07.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 -- 172.21.15.153:0/205718763 learned_addr learned my addr 172.21.15.153:0/205718763 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:07.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad9437700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40a89c0 0x7f9ad40ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad9c38700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad41505d0 0x7f9ad414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 -- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad41505d0 msgr2=0x7f9ad414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad41505d0 0x7f9ad414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 -- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40a89c0 msgr2=0x7f9ad40ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:07.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40a89c0 0x7f9ad40ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:07.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 -- 172.21.15.153:0/205718763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4009370 con 0x7f9ad40c0c80 2023-08-17T00:03:07.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ad8c36700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40a9690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9ad405e420 tx=0x7f9ac4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400b8d0 con 0x7f9ad40c0c80 2023-08-17T00:03:07.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400ba30 con 0x7f9ad40c0c80 2023-08-17T00:03:07.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad40aa5c0 con 0x7f9ad40c0c80 2023-08-17T00:03:07.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac401c650 con 0x7f9ad40c0c80 2023-08-17T00:03:07.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad414fc50 con 0x7f9ad40c0c80 2023-08-17T00:03:07.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.922+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad406b530 con 0x7f9ad40c0c80 2023-08-17T00:03:07.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.926+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9ac400f070 con 0x7f9ad40c0c80 2023-08-17T00:03:07.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.926+0000 7f9ac97fa700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:07.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.926+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ac4075850 con 0x7f9ad40c0c80 2023-08-17T00:03:07.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.926+0000 7f9ad9437700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:07.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.926+0000 7f9ad9437700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9ad0007740 tx=0x7f9ad00099d0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:07.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:07.930+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ac40491f0 con 0x7f9ad40c0c80 2023-08-17T00:03:08.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.122+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ad40bba60 con 0x7f9ad40c0c80 2023-08-17T00:03:08.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.126+0000 7f9ac97fa700 1 -- 172.21.15.153:0/205718763 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f9ac404c810 con 0x7f9ad40c0c80 2023-08-17T00:03:08.130 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:08.130 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 msgr2=0x7f9ab805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f9ad0007740 tx=0x7f9ad00099d0).stop 2023-08-17T00:03:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 msgr2=0x7f9ad40a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40a9690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f9ad405e420 tx=0x7f9ac4017000).stop 2023-08-17T00:03:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 shutdown_connections 2023-08-17T00:03:08.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad41505d0 0x7f9ad414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c0c80 0x7f9ad40a9690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 --2- 172.21.15.153:0/205718763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40a89c0 0x7f9ad40ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 >> 172.21.15.153:0/205718763 conn(0x7f9ad40c7150 msgr2=0x7f9ad40a80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:08.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 shutdown_connections 2023-08-17T00:03:08.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.130+0000 7f9adb69b700 1 -- 172.21.15.153:0/205718763 wait complete. 2023-08-17T00:03:08.137 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:08.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:08.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.302+0000 7f0bb525b700 1 Processor -- start 2023-08-17T00:03:08.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.302+0000 7f0bb525b700 1 -- start start 2023-08-17T00:03:08.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0bb525b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bb0151b90 0x7f0bb0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0bb525b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0bb0064870 0x7f0bb0064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0bb525b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb0061fa0 con 0x7f0bb0063290 2023-08-17T00:03:08.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0bb525b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb00c3fb0 con 0x7f0bb0064870 2023-08-17T00:03:08.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0bb525b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bb0152460 con 0x7f0bb0151b90 2023-08-17T00:03:08.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0bb0064870 0x7f0bb0064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0bb0064870 0x7f0bb0064cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46302/0 (socket says 172.21.15.153:46302) 2023-08-17T00:03:08.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 -- 172.21.15.153:0/1394348507 learned_addr learned my addr 172.21.15.153:0/1394348507 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:08.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0bae59c700 1 --1- 172.21.15.153:0/1394348507 >> v1:172.21.15.153:6789/0 conn(0x7f0bb0063290 0x7f0bb0065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36670/0 (socket says 172.21.15.153:36670) 2023-08-17T00:03:08.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baed9d700 1 --2- 172.21.15.153:0/1394348507 >> v2:172.21.15.178:3300/0 conn(0x7f0bb0151b90 0x7f0bb0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 -- 172.21.15.153:0/1394348507 >> v2:172.21.15.178:3300/0 conn(0x7f0bb0151b90 msgr2=0x7f0bb0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:08.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 --2- 172.21.15.153:0/1394348507 >> v2:172.21.15.178:3300/0 conn(0x7f0bb0151b90 0x7f0bb0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 -- 172.21.15.153:0/1394348507 >> v1:172.21.15.153:6789/0 conn(0x7f0bb0063290 legacy=0x7f0bb0065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 -- 172.21.15.153:0/1394348507 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00651b0 con 0x7f0bb0064870 2023-08-17T00:03:08.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.306+0000 7f0baf59e700 1 --2- 172.21.15.153:0/1394348507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0064870 0x7f0bb0064cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0bb00682a0 tx=0x7f0ba8009840).ready entity=mon.0 client_cookie=5157604f398f350 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:08.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0badd9b700 1 -- 172.21.15.153:0/1394348507 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800e070 con 0x7f0bb0064870 2023-08-17T00:03:08.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0badd9b700 1 -- 172.21.15.153:0/1394348507 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba800ba50 con 0x7f0bb0064870 2023-08-17T00:03:08.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0badd9b700 1 -- 172.21.15.153:0/1394348507 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba800bdd0 con 0x7f0bb0064870 2023-08-17T00:03:08.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 -- 172.21.15.153:0/1394348507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0064870 msgr2=0x7f0bb0064cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 --2- 172.21.15.153:0/1394348507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0064870 0x7f0bb0064cc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f0bb00682a0 tx=0x7f0ba8009840).stop 2023-08-17T00:03:08.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 -- 172.21.15.153:0/1394348507 shutdown_connections 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 --2- 172.21.15.153:0/1394348507 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0064870 0x7f0bb0064cc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 --2- 172.21.15.153:0/1394348507 >> v2:172.21.15.178:3300/0 conn(0x7f0bb0151b90 0x7f0bb0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 -- 172.21.15.153:0/1394348507 >> 172.21.15.153:0/1394348507 conn(0x7f0bb00c7150 msgr2=0x7f0bb00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 -- 172.21.15.153:0/1394348507 shutdown_connections 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 -- 172.21.15.153:0/1394348507 wait complete. 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.310+0000 7f0bb525b700 1 Processor -- start 2023-08-17T00:03:08.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 -- start start 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0063290 0x7f0bb00a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0064870 0x7f0bb0154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 0x7f0bb0147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00a8120 con 0x7f0bb0151b90 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0167a00 con 0x7f0bb0063290 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0167ce0 con 0x7f0bb0064870 2023-08-17T00:03:08.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 0x7f0bb0147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 0x7f0bb0147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46314/0 (socket says 172.21.15.153:46314) 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 -- 172.21.15.153:0/3328210344 learned_addr learned my addr 172.21.15.153:0/3328210344 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baed9d700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0063290 0x7f0bb00a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bae59c700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0064870 0x7f0bb0154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 -- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0064870 msgr2=0x7f0bb0154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0064870 0x7f0bb0154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 -- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0063290 msgr2=0x7f0bb00a7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0063290 0x7f0bb00a7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 -- 172.21.15.153:0/3328210344 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba8009ae0 con 0x7f0bb0151b90 2023-08-17T00:03:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baed9d700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0063290 0x7f0bb00a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:08.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0baf59e700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 0x7f0bb0147c90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0ba8009fd0 tx=0x7f0ba8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8009500 con 0x7f0bb0151b90 2023-08-17T00:03:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba80092e0 con 0x7f0bb0151b90 2023-08-17T00:03:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba801d620 con 0x7f0bb0151b90 2023-08-17T00:03:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb0167fc0 con 0x7f0bb0151b90 2023-08-17T00:03:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.314+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb0155310 con 0x7f0bb0151b90 2023-08-17T00:03:08.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.318+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb01499f0 con 0x7f0bb0151b90 2023-08-17T00:03:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.318+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0ba801b040 con 0x7f0bb0151b90 2023-08-17T00:03:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.318+0000 7f0b96ffd700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9c05a180 0x7f0b9c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.318+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ba8075b00 con 0x7f0bb0151b90 2023-08-17T00:03:08.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.322+0000 7f0baed9d700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9c05a180 0x7f0b9c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.322+0000 7f0baed9d700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9c05a180 0x7f0b9c05c640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0ba0006fd0 tx=0x7f0ba0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:08.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.330+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0bb01499f0 con 0x7f0bb0151b90 2023-08-17T00:03:08.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.490+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bb006b530 con 0x7f0bb0151b90 2023-08-17T00:03:08.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.490+0000 7f0b96ffd700 1 -- 172.21.15.153:0/3328210344 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f0ba80495b0 con 0x7f0bb0151b90 2023-08-17T00:03:08.497 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:08.497 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9c05a180 msgr2=0x7f0b9c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9c05a180 0x7f0b9c05c640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f0ba0006fd0 tx=0x7f0ba0008040).stop 2023-08-17T00:03:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 msgr2=0x7f0bb0147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 0x7f0bb0147c90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f0ba8009fd0 tx=0x7f0ba8009840).stop 2023-08-17T00:03:08.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 shutdown_connections 2023-08-17T00:03:08.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9c05a180 0x7f0b9c05c640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0151b90 0x7f0bb0147c90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0064870 0x7f0bb0154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 --2- 172.21.15.153:0/3328210344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0063290 0x7f0bb00a7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 >> 172.21.15.153:0/3328210344 conn(0x7f0bb00c7150 msgr2=0x7f0bb00a8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:08.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 shutdown_connections 2023-08-17T00:03:08.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.494+0000 7f0bb525b700 1 -- 172.21.15.153:0/3328210344 wait complete. 2023-08-17T00:03:08.520 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:08.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.674+0000 7f3ede01b700 1 Processor -- start 2023-08-17T00:03:08.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ede01b700 1 -- start start 2023-08-17T00:03:08.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ede01b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ed8151b90 0x7f3ed8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ede01b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed8061fa0 con 0x7f3ed8063290 2023-08-17T00:03:08.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ede01b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ed80621f0 con 0x7f3ed8064870 2023-08-17T00:03:08.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ede01b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ed80c3fb0 con 0x7f3ed8151b90 2023-08-17T00:03:08.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ecffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3ed8063290 0x7f3ed8065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36672/0 (socket says 172.21.15.153:36672) 2023-08-17T00:03:08.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ecffff700 1 -- 172.21.15.153:0/1720244041 learned_addr learned my addr 172.21.15.153:0/1720244041 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ed77fe700 1 --2- 172.21.15.153:0/1720244041 >> v2:172.21.15.153:3300/0 conn(0x7f3ed8151b90 0x7f3ed8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.678+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 351743259 0 0) 0x7f3ed8061fa0 con 0x7f3ed8063290 2023-08-17T00:03:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ec40033f0 con 0x7f3ed8063290 2023-08-17T00:03:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397181706 0 0) 0x7f3ed80621f0 con 0x7f3ed8064870 2023-08-17T00:03:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8061fa0 con 0x7f3ed8064870 2023-08-17T00:03:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed77fe700 1 -- 172.21.15.153:0/1720244041 >> v1:172.21.15.178:6789/0 conn(0x7f3ed8064870 legacy=0x7f3ed80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed77fe700 1 -- 172.21.15.153:0/1720244041 >> v1:172.21.15.153:6789/0 conn(0x7f3ed8063290 legacy=0x7f3ed8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed77fe700 1 -- 172.21.15.153:0/1720244041 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed80624d0 con 0x7f3ed8151b90 2023-08-17T00:03:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed77fe700 1 --2- 172.21.15.153:0/1720244041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8151b90 0x7f3ed8151f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f3ec8009760 tx=0x7f3ec8009060).ready entity=mon.0 client_cookie=c980744e7aa9295f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:08.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800d4a0 con 0x7f3ed8151b90 2023-08-17T00:03:08.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec800d600 con 0x7f3ed8151b90 2023-08-17T00:03:08.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ed6ffd700 1 -- 172.21.15.153:0/1720244041 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800d980 con 0x7f3ed8151b90 2023-08-17T00:03:08.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 -- 172.21.15.153:0/1720244041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8151b90 msgr2=0x7f3ed8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 --2- 172.21.15.153:0/1720244041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8151b90 0x7f3ed8151f70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f3ec8009760 tx=0x7f3ec8009060).stop 2023-08-17T00:03:08.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 -- 172.21.15.153:0/1720244041 shutdown_connections 2023-08-17T00:03:08.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 --2- 172.21.15.153:0/1720244041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8151b90 0x7f3ed8151f70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 -- 172.21.15.153:0/1720244041 >> 172.21.15.153:0/1720244041 conn(0x7f3ed80c7150 msgr2=0x7f3ed80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:08.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 -- 172.21.15.153:0/1720244041 shutdown_connections 2023-08-17T00:03:08.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.682+0000 7f3ede01b700 1 -- 172.21.15.153:0/1720244041 wait complete. 2023-08-17T00:03:08.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 Processor -- start 2023-08-17T00:03:08.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 -- start start 2023-08-17T00:03:08.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 0x7f3ed814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ed8064870 0x7f3ed80aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ed8151b90 0x7f3ed80aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed8157b00 con 0x7f3ed8063290 2023-08-17T00:03:08.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80ab6a0 con 0x7f3ed8151b90 2023-08-17T00:03:08.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80ab980 con 0x7f3ed8064870 2023-08-17T00:03:08.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 0x7f3ed814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 0x7f3ed814efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46326/0 (socket says 172.21.15.153:46326) 2023-08-17T00:03:08.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 -- 172.21.15.153:0/2738935947 learned_addr learned my addr 172.21.15.153:0/2738935947 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:08.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed7fff700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ed8151b90 0x7f3ed80aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ecffff700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ed8064870 0x7f3ed80aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 -- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ed8064870 msgr2=0x7f3ed80aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ed8064870 0x7f3ed80aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 -- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ed8151b90 msgr2=0x7f3ed80aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ed8151b90 0x7f3ed80aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 -- 172.21.15.153:0/2738935947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec80092a0 con 0x7f3ed8063290 2023-08-17T00:03:08.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ed77fe700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 0x7f3ed814efd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3ed805e420 tx=0x7f3ec8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:08.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800dcf0 con 0x7f3ed8063290 2023-08-17T00:03:08.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec800de50 con 0x7f3ed8063290 2023-08-17T00:03:08.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed80abc60 con 0x7f3ed8063290 2023-08-17T00:03:08.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec800d980 con 0x7f3ed8063290 2023-08-17T00:03:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.686+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed814f4c0 con 0x7f3ed8063290 2023-08-17T00:03:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.690+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed806b530 con 0x7f3ed8063290 2023-08-17T00:03:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.690+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3ec800f070 con 0x7f3ed8063290 2023-08-17T00:03:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.690+0000 7f3ecf7fe700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3eb805a180 0x7f3eb805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.690+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ec8075650 con 0x7f3ed8063290 2023-08-17T00:03:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.694+0000 7f3ecffff700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3eb805a180 0x7f3eb805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:08.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.694+0000 7f3ecffff700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3eb805a180 0x7f3eb805c640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3ed80bdbe0 tx=0x7f3ec0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:08.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.698+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ec8048f90 con 0x7f3ed8063290 2023-08-17T00:03:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.890+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ed80c2e90 con 0x7f3ed8063290 2023-08-17T00:03:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.890+0000 7f3ecf7fe700 1 -- 172.21.15.153:0/2738935947 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f3ec804c5b0 con 0x7f3ed8063290 2023-08-17T00:03:08.895 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:08.896 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3eb805a180 msgr2=0x7f3eb805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3eb805a180 0x7f3eb805c640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f3ed80bdbe0 tx=0x7f3ec0009040).stop 2023-08-17T00:03:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 msgr2=0x7f3ed814efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 0x7f3ed814efd0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f3ed805e420 tx=0x7f3ec8016000).stop 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 shutdown_connections 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3eb805a180 0x7f3eb805c640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ed8151b90 0x7f3ed80aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ed8064870 0x7f3ed80aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 --2- 172.21.15.153:0/2738935947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ed8063290 0x7f3ed814efd0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 >> 172.21.15.153:0/2738935947 conn(0x7f3ed80c7150 msgr2=0x7f3ed80c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 shutdown_connections 2023-08-17T00:03:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:08.894+0000 7f3ede01b700 1 -- 172.21.15.153:0/2738935947 wait complete. 2023-08-17T00:03:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:09.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:02:51.755991+0000', 'modified': '2023-08-17T00:02:54.775082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4276}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4276': {'gid': 4276, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6837/3379453475', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6836', 'nonce': 3379453475}, {'type': 'v1', 'addr': '172.21.15.178:6837', 'nonce': 3379453475}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:03:09.320 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:03:09.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-17T00:03:09.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.482+0000 7f25063f9700 1 Processor -- start 2023-08-17T00:03:09.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.486+0000 7f25063f9700 1 -- start start 2023-08-17T00:03:09.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.486+0000 7f25063f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25000c5ea0 0x7f25000634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.486+0000 7f25063f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2500154e90 con 0x7f25000acf30 2023-08-17T00:03:09.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.486+0000 7f25063f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2500153fc0 con 0x7f25000639a0 2023-08-17T00:03:09.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.486+0000 7f25063f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25000c1730 con 0x7f25000c5ea0 2023-08-17T00:03:09.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25053f7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f25000acf30 0x7f25000c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36676/0 (socket says 172.21.15.153:36676) 2023-08-17T00:03:09.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25053f7700 1 -- 172.21.15.153:0/3738503529 learned_addr learned my addr 172.21.15.153:0/3738503529 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:09.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f2504bf6700 1 --2- 172.21.15.153:0/3738503529 >> v2:172.21.15.153:3300/0 conn(0x7f25000c5ea0 0x7f25000634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f2504bf6700 1 -- 172.21.15.153:0/3738503529 >> v1:172.21.15.178:6789/0 conn(0x7f25000639a0 legacy=0x7f25000bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f2504bf6700 1 -- 172.21.15.153:0/3738503529 >> v1:172.21.15.153:6789/0 conn(0x7f25000acf30 legacy=0x7f25000c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f2504bf6700 1 -- 172.21.15.153:0/3738503529 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2500154280 con 0x7f25000c5ea0 2023-08-17T00:03:09.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f2504bf6700 1 --2- 172.21.15.153:0/3738503529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000c5ea0 0x7f25000634b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f24f0009760 tx=0x7f24f0009060).ready entity=mon.0 client_cookie=fc4b18a2db545d0b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f24f7fff700 1 -- 172.21.15.153:0/3738503529 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000b580 con 0x7f25000c5ea0 2023-08-17T00:03:09.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f24f7fff700 1 -- 172.21.15.153:0/3738503529 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f000b6e0 con 0x7f25000c5ea0 2023-08-17T00:03:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f24f7fff700 1 -- 172.21.15.153:0/3738503529 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f000ba60 con 0x7f25000c5ea0 2023-08-17T00:03:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 -- 172.21.15.153:0/3738503529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000c5ea0 msgr2=0x7f25000634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 --2- 172.21.15.153:0/3738503529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000c5ea0 0x7f25000634b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f24f0009760 tx=0x7f24f0009060).stop 2023-08-17T00:03:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 -- 172.21.15.153:0/3738503529 shutdown_connections 2023-08-17T00:03:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 --2- 172.21.15.153:0/3738503529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000c5ea0 0x7f25000634b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 -- 172.21.15.153:0/3738503529 >> 172.21.15.153:0/3738503529 conn(0x7f25000cb330 msgr2=0x7f25000c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 -- 172.21.15.153:0/3738503529 shutdown_connections 2023-08-17T00:03:09.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.490+0000 7f25063f9700 1 -- 172.21.15.153:0/3738503529 wait complete. 2023-08-17T00:03:09.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 Processor -- start 2023-08-17T00:03:09.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 -- start start 2023-08-17T00:03:09.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 0x7f2500150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25000acf30 0x7f25000aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25000aeff0 0x7f25001574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000adaf0 con 0x7f25000639a0 2023-08-17T00:03:09.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25000ae670 con 0x7f25000acf30 2023-08-17T00:03:09.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25063f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2500150f80 con 0x7f25000aeff0 2023-08-17T00:03:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25053f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 0x7f2500150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25053f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 0x7f2500150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46344/0 (socket says 172.21.15.153:46344) 2023-08-17T00:03:09.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25053f7700 1 -- 172.21.15.153:0/99005670 learned_addr learned my addr 172.21.15.153:0/99005670 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f2505bf8700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25000aeff0 0x7f25001574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f2504bf6700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25000acf30 0x7f25000aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25053f7700 1 -- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25000aeff0 msgr2=0x7f25001574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.494+0000 7f25053f7700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25000aeff0 0x7f25001574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f25053f7700 1 -- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25000acf30 msgr2=0x7f25000aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f25053f7700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25000acf30 0x7f25000aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f25053f7700 1 -- 172.21.15.153:0/99005670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f00092a0 con 0x7f25000639a0 2023-08-17T00:03:09.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f2504bf6700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25000acf30 0x7f25000aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:09.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f25053f7700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 0x7f2500150a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f24fc00c490 tx=0x7f24fc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f24f57fa700 1 -- 172.21.15.153:0/99005670 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0072e0 con 0x7f25000639a0 2023-08-17T00:03:09.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f24f57fa700 1 -- 172.21.15.153:0/99005670 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc007440 con 0x7f25000639a0 2023-08-17T00:03:09.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25000add40 con 0x7f25000639a0 2023-08-17T00:03:09.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f24f57fa700 1 -- 172.21.15.153:0/99005670 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0057a0 con 0x7f25000639a0 2023-08-17T00:03:09.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.498+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000ae300 con 0x7f25000639a0 2023-08-17T00:03:09.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f24f57fa700 1 -- 172.21.15.153:0/99005670 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f24fc010070 con 0x7f25000639a0 2023-08-17T00:03:09.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f24f57fa700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f24e405a150 0x7f24e405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f24f57fa700 1 -- 172.21.15.153:0/99005670 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f24fc0738a0 con 0x7f25000639a0 2023-08-17T00:03:09.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f2504bf6700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f24e405a150 0x7f24e405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f25119d2740 1 Processor -- start 2023-08-17T00:03:09.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f25119d2740 1 -- start start 2023-08-17T00:03:09.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.502+0000 7f2504bf6700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f24e405a150 0x7f24e405c610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f25000aa210 tx=0x7f24f0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1c43f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff380 0x1bfd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c4e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b6d5c0 con 0x1c43b60 2023-08-17T00:03:09.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b82e90 con 0x1bff380 2023-08-17T00:03:09.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b49220 con 0x1bfdd90 2023-08-17T00:03:09.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1c43f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1c43f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46350/0 (socket says 172.21.15.153:46350) 2023-08-17T00:03:09.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 -- 172.21.15.153:0/3243181975 learned_addr learned my addr 172.21.15.153:0/3243181975 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:09.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f2505bf8700 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c4e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f2504bf6700 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff380 0x1bfd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 -- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 msgr2=0x1c4e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c4e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 -- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff380 msgr2=0x1bfd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff380 0x1bfd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 -- 172.21.15.153:0/3243181975 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b8e500 con 0x1c43b60 2023-08-17T00:03:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f2504bf6700 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff380 0x1bfd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25053f7700 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1c43f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f24fc04add0 tx=0x7f24fc00f000).ready entity=mon.0 client_cookie=1031ba45a0b1bada server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f24ea7fc700 1 -- 172.21.15.153:0/3243181975 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc054030 con 0x1c43b60 2023-08-17T00:03:09.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f24ea7fc700 1 -- 172.21.15.153:0/3243181975 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24fc0492a0 con 0x1c43b60 2023-08-17T00:03:09.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f24ea7fc700 1 -- 172.21.15.153:0/3243181975 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24fc04c030 con 0x1c43b60 2023-08-17T00:03:09.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- 172.21.15.153:0/3243181975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 msgr2=0x1c43f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1c43f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f24fc04add0 tx=0x7f24fc00f000).stop 2023-08-17T00:03:09.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- 172.21.15.153:0/3243181975 shutdown_connections 2023-08-17T00:03:09.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c4e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bff380 0x1bfd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 --2- 172.21.15.153:0/3243181975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1c43f40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- 172.21.15.153:0/3243181975 >> 172.21.15.153:0/3243181975 conn(0x19e1550 msgr2=0x1c02e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:09.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- 172.21.15.153:0/3243181975 shutdown_connections 2023-08-17T00:03:09.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.506+0000 7f25119d2740 1 -- 172.21.15.153:0/3243181975 wait complete. 2023-08-17T00:03:09.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 -- start start 2023-08-17T00:03:09.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 Processor -- start 2023-08-17T00:03:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c27a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c42220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1bfc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b4e110 con 0x1bff380 2023-08-17T00:03:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c27f40 con 0x1c43b60 2023-08-17T00:03:09.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c2b310 con 0x1bfdd90 2023-08-17T00:03:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f25119d2740 10 client.0 ll_register_callbacks cb 0x1bba3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:03:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.510+0000 7f2504bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c42220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c42220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46364/0 (socket says 172.21.15.153:46364) 2023-08-17T00:03:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 -- 172.21.15.153:0/827325068 learned_addr learned my addr 172.21.15.153:0/827325068 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:09.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25053f7700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c27a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2505bf8700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1bfc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 -- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 msgr2=0x1c27a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c27a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 -- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 msgr2=0x1bfc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1bfc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 -- 172.21.15.153:0/827325068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25000ae300 con 0x1bff380 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f2504bf6700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c42220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f24f0000e50 tx=0x7f24f001d070).ready entity=mon.0 client_cookie=46dbb0c5e6f7ba84 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f24df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f24df7fe700 1 -- 172.21.15.153:0/827325068 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f001bc40 con 0x1bff380 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f24df7fe700 1 -- 172.21.15.153:0/827325068 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f24f001bda0 con 0x1bff380 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b78c60 con 0x1bff380 2023-08-17T00:03:09.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f24df7fe700 1 -- 172.21.15.153:0/827325068 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f002e680 con 0x1bff380 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 10 client.4668 fetch_fsmap learned FSMap version 7 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1b7bf80 con 0x1bff380 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f24df7fe700 1 -- 172.21.15.153:0/827325068 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b78c60 con 0x1bff380 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f24df7fe700 1 -- 172.21.15.153:0/827325068 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f24f002e7e0 con 0x1bff380 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 10 client.4668 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T00:03:09.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 20 client.4668 populate_metadata read hostname 'smithi153' 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c47420 0x1c29fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 4 client.4668 mds_command: new command op to 4276 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 --> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b6f1b0 con 0x1c47420 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.514+0000 7f25053f7700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c47420 0x1c29fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25053f7700 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c47420 0x1c29fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=48a8e16f6c2e89dc server_cookie=6c229b7f7794e885 in_seq=0 out_seq=0 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f24df7fe700 10 client.4668 ms_handle_connect on v2:172.21.15.178:6836/3379453475 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f24df7fe700 1 -- 172.21.15.153:0/827325068 <== mds.0 v2:172.21.15.178:6836/3379453475 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1b6f1b0 con 0x1c47420 2023-08-17T00:03:09.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f24df7fe700 10 client.4668 handle_command_reply: tid=0 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 client.4668 shutdown 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 msgr2=0x1c42220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c42220 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f24f0000e50 tx=0x7f24f001d070).stop 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 shutdown_connections 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c47420 0x1c29fd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1bfc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c42220 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 --2- 172.21.15.153:0/827325068 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1c27a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 >> 172.21.15.153:0/827325068 conn(0x19e1550 msgr2=0x1c43150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:09.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f24df7fe700 0 client.4668 ms_handle_reset on v2:172.21.15.178:6836/3379453475 2023-08-17T00:03:09.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 shutdown_connections 2023-08-17T00:03:09.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 1 -- 172.21.15.153:0/827325068 wait complete. 2023-08-17T00:03:09.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.518+0000 7f25119d2740 20 client.4668 trim_cache size 0 max 16384 2023-08-17T00:03:09.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 Processor -- start 2023-08-17T00:03:09.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 -- start start 2023-08-17T00:03:09.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfdd90 0x1c02e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff380 0x1c03370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1ca68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bfd5c0 con 0x1c43b60 2023-08-17T00:03:09.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b89cd0 con 0x1bfdd90 2023-08-17T00:03:09.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c03860 con 0x1bff380 2023-08-17T00:03:09.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1ca68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1ca68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46376/0 (socket says 172.21.15.153:46376) 2023-08-17T00:03:09.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 -- 172.21.15.153:0/3743705211 learned_addr learned my addr 172.21.15.153:0/3743705211 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:09.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f25053f7700 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfdd90 0x1c02e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2504bf6700 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff380 0x1c03370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 -- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff380 msgr2=0x1c03370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff380 0x1c03370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 -- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfdd90 msgr2=0x1c02e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfdd90 0x1c02e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 -- 172.21.15.153:0/3743705211 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bfc5f0 con 0x1c43b60 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2504bf6700 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff380 0x1c03370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:09.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f2505bf8700 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1ca68a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f24f8002ce0 tx=0x7f24f8001530).ready entity=mon.0 client_cookie=4e8838ee6883d798 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f24eaffd700 1 -- 172.21.15.153:0/3743705211 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8002a50 con 0x1c43b60 2023-08-17T00:03:09.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f24eaffd700 1 -- 172.21.15.153:0/3743705211 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8013920 con 0x1c43b60 2023-08-17T00:03:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.538+0000 7f24eaffd700 1 -- 172.21.15.153:0/3743705211 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8013ca0 con 0x1c43b60 2023-08-17T00:03:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 -- 172.21.15.153:0/3743705211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 msgr2=0x1ca68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1ca68a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f24f8002ce0 tx=0x7f24f8001530).stop 2023-08-17T00:03:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 -- 172.21.15.153:0/3743705211 shutdown_connections 2023-08-17T00:03:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c43b60 0x1ca68a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bff380 0x1c03370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 --2- 172.21.15.153:0/3743705211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bfdd90 0x1c02e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 -- 172.21.15.153:0/3743705211 >> 172.21.15.153:0/3743705211 conn(0x19e1550 msgr2=0x1c444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:09.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 -- 172.21.15.153:0/3743705211 shutdown_connections 2023-08-17T00:03:09.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 -- 172.21.15.153:0/3743705211 wait complete. 2023-08-17T00:03:09.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.542+0000 7f25119d2740 1 -- start start 2023-08-17T00:03:09.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 Processor -- start 2023-08-17T00:03:09.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1ca2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c2b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1c2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bfd0a0 con 0x1bff380 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c2be30 con 0x1c43b60 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c56be0 con 0x1bfdd90 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 10 client.0 ll_register_callbacks cb 0x7f24f0002f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c2b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c2b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46380/0 (socket says 172.21.15.153:46380) 2023-08-17T00:03:09.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 -- 172.21.15.153:0/1871838229 learned_addr learned my addr 172.21.15.153:0/1871838229 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:09.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25053f7700 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1ca2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 -- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 msgr2=0x1ca2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1ca2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 -- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 msgr2=0x1c2b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:09.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1c2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:09.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 -- 172.21.15.153:0/1871838229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f800f040 con 0x1bff380 2023-08-17T00:03:09.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f2504bf6700 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c2b450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f24f000b340 tx=0x7f24f0027070).ready entity=mon.0 client_cookie=8460465087d1d819 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f24df7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f24df7fe700 1 -- 172.21.15.153:0/1871838229 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f0025450 con 0x1bff380 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c47fe0 con 0x1bff380 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f24df7fe700 1 -- 172.21.15.153:0/1871838229 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f24f00255b0 con 0x1bff380 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f24df7fe700 1 -- 172.21.15.153:0/1871838229 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f0025980 con 0x1bff380 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 10 client.4674 fetch_fsmap learned FSMap version 7 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x7f2500157d20 con 0x1bff380 2023-08-17T00:03:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f24df7fe700 1 -- 172.21.15.153:0/1871838229 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c47fe0 con 0x1bff380 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f24df7fe700 1 -- 172.21.15.153:0/1871838229 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f24f0041060 con 0x1bff380 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 10 client.4674 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.546+0000 7f25119d2740 20 client.4674 populate_metadata read hostname 'smithi153' 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c54870 0x1c54c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 4 client.4674 mds_command: new command op to 4276 tid=0[{"prefix": "status"}] 2023-08-17T00:03:09.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 --> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f24fc0492a0 con 0x1c54870 2023-08-17T00:03:09.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25053f7700 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c54870 0x1c54c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:09.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25053f7700 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c54870 0x1c54c50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=567c9d15c46909ac server_cookie=65744951552354b9 in_seq=0 out_seq=0 2023-08-17T00:03:09.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f24df7fe700 10 client.4674 ms_handle_connect on v2:172.21.15.178:6836/3379453475 2023-08-17T00:03:09.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f24df7fe700 1 -- 172.21.15.153:0/1871838229 <== mds.0 v2:172.21.15.178:6836/3379453475 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7f24fc0492a0 con 0x1c54870 2023-08-17T00:03:09.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f24df7fe700 10 client.4674 handle_command_reply: tid=0 2023-08-17T00:03:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 client.4674 shutdown 2023-08-17T00:03:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 msgr2=0x1c2b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c2b450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f24f000b340 tx=0x7f24f0027070).stop 2023-08-17T00:03:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 shutdown_connections 2023-08-17T00:03:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:6836/3379453475,v1:172.21.15.178:6837/3379453475] conn(0x1c54870 0x1c54c50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c43b60 0x1c2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bff380 0x1c2b450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 --2- 172.21.15.153:0/1871838229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1bfdd90 0x1ca2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 >> 172.21.15.153:0/1871838229 conn(0x19e1550 msgr2=0x1c02e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f24df7fe700 0 client.4674 ms_handle_reset on v2:172.21.15.178:6836/3379453475 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 shutdown_connections 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 1 -- 172.21.15.153:0/1871838229 wait complete. 2023-08-17T00:03:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25119d2740 20 client.4674 trim_cache size 0 max 16384 2023-08-17T00:03:09.561 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:03:09.561 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:03:09.561 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:03:09.561 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4276, 2023-08-17T00:03:09.561 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 17.789760787999999, 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 7, 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 22, 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 22, 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 23.122675656999998 2023-08-17T00:03:09.562 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:03:09.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f24e405a150 msgr2=0x7f24e405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25063f9700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f24e405a150 0x7f24e405c610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f25000aa210 tx=0x7f24f0017000).stop 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 msgr2=0x7f2500150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.550+0000 7f25063f9700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 0x7f2500150a90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f24fc00c490 tx=0x7f24fc007df0).stop 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 shutdown_connections 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f24e405a150 0x7f24e405c610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25000aeff0 0x7f25001574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25000acf30 0x7f25000aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 --2- 172.21.15.153:0/99005670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25000639a0 0x7f2500150a90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:09.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 >> 172.21.15.153:0/99005670 conn(0x7f25000cb330 msgr2=0x7f2500156820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:09.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 shutdown_connections 2023-08-17T00:03:09.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:09.554+0000 7f25063f9700 1 -- 172.21.15.153:0/99005670 wait complete. 2023-08-17T00:03:09.577 INFO:teuthology.run_tasks:Running task kclient... 2023-08-17T00:03:09.606 INFO:tasks.kclient:Mounting kernel clients... 2023-08-17T00:03:09.606 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-17T00:03:09.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.607 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:03:09.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.624 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-08-17T00:03:09.708 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-08-17T00:03:09.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:03:09.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.712 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:03:09.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-08-17T00:03:09.865 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-08-17T00:03:09.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:03:09.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.869 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-08-17T00:03:09.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.892 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-08-17T00:03:09.982 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-08-17T00:03:09.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:03:09.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:09.988 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-08-17T00:03:10.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.051 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-08-17T00:03:10.135 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-08-17T00:03:10.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:03:10.139 INFO:tasks.kclient:client.0 config is {} 2023-08-17T00:03:10.139 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:03:10.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.270+0000 7fc61405b700 1 Processor -- start 2023-08-17T00:03:10.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.270+0000 7fc61405b700 1 -- start start 2023-08-17T00:03:10.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc61405b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c5bf0 0x7fc60c0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:10.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc61405b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc60c0c78d0 0x7fc60c153640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:10.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc61405b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60c066260 con 0x7fc60c0666f0 2023-08-17T00:03:10.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc61405b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c0c7e40 con 0x7fc60c0c78d0 2023-08-17T00:03:10.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc61405b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60c065c10 con 0x7fc60c0c5bf0 2023-08-17T00:03:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6115f6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc60c0666f0 0x7fc60c0c71c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36684/0 (socket says 172.21.15.153:36684) 2023-08-17T00:03:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6115f6700 1 -- 172.21.15.153:0/1653348129 learned_addr learned my addr 172.21.15.153:0/1653348129 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc611df7700 1 --2- 172.21.15.153:0/1653348129 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c5bf0 0x7fc60c0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6125f8700 1 --2- 172.21.15.153:0/1653348129 >> v2:172.21.15.153:3300/0 conn(0x7fc60c0c78d0 0x7fc60c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:10.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc610df5700 1 -- 172.21.15.153:0/1653348129 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813662071 0 0) 0x7fc60c066260 con 0x7fc60c0666f0 2023-08-17T00:03:10.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc610df5700 1 -- 172.21.15.153:0/1653348129 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f80033f0 con 0x7fc60c0666f0 2023-08-17T00:03:10.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6125f8700 1 -- 172.21.15.153:0/1653348129 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c5bf0 msgr2=0x7fc60c0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:10.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6125f8700 1 --2- 172.21.15.153:0/1653348129 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c5bf0 0x7fc60c0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6125f8700 1 -- 172.21.15.153:0/1653348129 >> v1:172.21.15.153:6789/0 conn(0x7fc60c0666f0 legacy=0x7fc60c0c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:10.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6125f8700 1 -- 172.21.15.153:0/1653348129 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60c065ef0 con 0x7fc60c0c78d0 2023-08-17T00:03:10.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.274+0000 7fc6125f8700 1 --2- 172.21.15.153:0/1653348129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0c78d0 0x7fc60c153640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fc60c0cbb20 tx=0x7fc604009780).ready entity=mon.0 client_cookie=f5d9139d25cfa2e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:10.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc610df5700 1 -- 172.21.15.153:0/1653348129 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400e070 con 0x7fc60c0c78d0 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc610df5700 1 -- 172.21.15.153:0/1653348129 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60400bab0 con 0x7fc60c0c78d0 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc610df5700 1 -- 172.21.15.153:0/1653348129 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60400be30 con 0x7fc60c0c78d0 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 -- 172.21.15.153:0/1653348129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0c78d0 msgr2=0x7fc60c153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 --2- 172.21.15.153:0/1653348129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0c78d0 0x7fc60c153640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fc60c0cbb20 tx=0x7fc604009780).stop 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 -- 172.21.15.153:0/1653348129 shutdown_connections 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 --2- 172.21.15.153:0/1653348129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0c78d0 0x7fc60c153640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 --2- 172.21.15.153:0/1653348129 >> v2:172.21.15.178:3300/0 conn(0x7fc60c0c5bf0 0x7fc60c0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 -- 172.21.15.153:0/1653348129 >> 172.21.15.153:0/1653348129 conn(0x7fc60c067820 msgr2=0x7fc60c067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:10.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 -- 172.21.15.153:0/1653348129 shutdown_connections 2023-08-17T00:03:10.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.278+0000 7fc61405b700 1 -- 172.21.15.153:0/1653348129 wait complete. 2023-08-17T00:03:10.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 Processor -- start 2023-08-17T00:03:10.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 -- start start 2023-08-17T00:03:10.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 0x7fc60c163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:10.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c5bf0 0x7fc60c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:10.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c0c78d0 0x7fc60c0ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:10.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c14fda0 con 0x7fc60c0666f0 2023-08-17T00:03:10.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c1644a0 con 0x7fc60c0c78d0 2023-08-17T00:03:10.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc61405b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60c164780 con 0x7fc60c0c5bf0 2023-08-17T00:03:10.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 0x7fc60c163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:10.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 0x7fc60c163e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46400/0 (socket says 172.21.15.153:46400) 2023-08-17T00:03:10.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 -- 172.21.15.153:0/386479258 learned_addr learned my addr 172.21.15.153:0/386479258 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:10.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc6125f8700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c0c78d0 0x7fc60c0ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:10.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc6115f6700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c5bf0 0x7fc60c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 -- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c5bf0 msgr2=0x7fc60c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c5bf0 0x7fc60c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 -- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c0c78d0 msgr2=0x7fc60c0ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c0c78d0 0x7fc60c0ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc611df7700 1 -- 172.21.15.153:0/386479258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604009a20 con 0x7fc60c0666f0 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.286+0000 7fc6115f6700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c5bf0 0x7fc60c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:10.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc611df7700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 0x7fc60c163e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fc60800e930 tx=0x7fc608009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:10.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800eed0 con 0x7fc60c0666f0 2023-08-17T00:03:10.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc60c164a60 con 0x7fc60c0666f0 2023-08-17T00:03:10.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800c850 con 0x7fc60c0666f0 2023-08-17T00:03:10.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800cbd0 con 0x7fc60c0666f0 2023-08-17T00:03:10.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc60c14f960 con 0x7fc60c0666f0 2023-08-17T00:03:10.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc60c0c6750 con 0x7fc60c0666f0 2023-08-17T00:03:10.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.290+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc608022070 con 0x7fc60c0666f0 2023-08-17T00:03:10.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.294+0000 7fc601ffb700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5f005a180 0x7fc5f005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:10.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.294+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc608074630 con 0x7fc60c0666f0 2023-08-17T00:03:10.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.294+0000 7fc6115f6700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5f005a180 0x7fc5f005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:10.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.294+0000 7fc6115f6700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5f005a180 0x7fc5f005c640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc5fc005750 tx=0x7fc5fc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:10.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.298+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc60c0c6750 con 0x7fc60c0666f0 2023-08-17T00:03:10.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.494+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc60c0c6750 con 0x7fc60c0666f0 2023-08-17T00:03:10.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc601ffb700 1 -- 172.21.15.153:0/386479258 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc60c0c6750 con 0x7fc60c0666f0 2023-08-17T00:03:10.502 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:03:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5f005a180 msgr2=0x7fc5f005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5f005a180 0x7fc5f005c640 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fc5fc005750 tx=0x7fc5fc009040).stop 2023-08-17T00:03:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 msgr2=0x7fc60c163e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 0x7fc60c163e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fc60800e930 tx=0x7fc608009060).stop 2023-08-17T00:03:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 shutdown_connections 2023-08-17T00:03:10.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5f005a180 0x7fc5f005c640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc60c0c78d0 0x7fc60c0ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc60c0c5bf0 0x7fc60c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 --2- 172.21.15.153:0/386479258 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc60c0666f0 0x7fc60c163e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.498+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 >> 172.21.15.153:0/386479258 conn(0x7fc60c067820 msgr2=0x7fc60c151dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.502+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 shutdown_connections 2023-08-17T00:03:10.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:10.502+0000 7fc61405b700 1 -- 172.21.15.153:0/386479258 wait complete. 2023-08-17T00:03:10.523 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T00:03:10.523 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:03:10.524 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:03:10.524 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:03:10.525 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:03:10.525 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T00:03:10.525 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T00:03:10.526 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:03:10.526 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:03:10.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.527 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:03:10.548 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:10.548 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:10.548 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:10.549 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:10.549 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:10.549 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:10.549 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:10.550 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:10.550 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:03:10.550 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:10.550 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:10.551 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:03:10.551 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:10.551 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:10.552 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:03:10.552 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:10.552 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:03:10.552 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42423sec preferred_lft 42423sec 2023-08-17T00:03:10.552 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:03:10.553 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:10.553 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:03:10.553 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:10.553 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:03:10.554 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:10.555 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-17T00:03:10.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.555 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:10.556 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:10.556 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add name ceph-brx type bridge 2023-08-17T00:03:10.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr flush dev ceph-brx 2023-08-17T00:03:10.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set ceph-brx up 2023-08-17T00:03:10.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-17T00:03:10.558 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:10.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.711 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:03:10.746 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:03:10.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.750 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:03:10.826 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:03:10.826 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:03:10.826 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:03:10.827 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:03:10.827 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:03:10.827 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:03:10.827 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:03:10.828 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:03:10.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.829 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:10.829 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:10.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:03:10.830 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:03:10.831 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:03:10.831 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:10.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.962 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:03:10.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:10.981 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2023-08-17T00:03:11.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:11.047 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:11.047 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:11.047 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:03:11.048 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-17T00:03:11.048 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:11.170 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-17T00:03:11.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:11.171 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:11.172 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:11.172 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-17T00:03:11.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-17T00:03:11.174 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-17T00:03:11.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-17T00:03:11.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-17T00:03:11.175 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:11.177 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:03:11.188 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:03:11.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:11.378 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:11.378 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:11.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:03:11.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.0 master ceph-brx 2023-08-17T00:03:11.378 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:11.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:11.447 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:03:11.461 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:03:11.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:11.587 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:11.588 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:11.732 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:11.732 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:11.736 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:03:11.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:11.737 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:03:11.771 INFO:tasks.kclient:client.2 config is {} 2023-08-17T00:03:11.772 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:03:11.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 Processor -- start 2023-08-17T00:03:11.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 -- start start 2023-08-17T00:03:11.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8801539b0 0x7fe880153d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe880066d40 0x7fe8801582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8800bba40 0x7fe8800c6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8800671b0 con 0x7fe880066d40 2023-08-17T00:03:11.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8801587b0 con 0x7fe8801539b0 2023-08-17T00:03:11.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe884cf1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe880065720 con 0x7fe8800bba40 2023-08-17T00:03:11.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe880066d40 0x7fe8801582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe880066d40 0x7fe8801582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46404/0 (socket says 172.21.15.153:46404) 2023-08-17T00:03:11.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 -- 172.21.15.153:0/193055973 learned_addr learned my addr 172.21.15.153:0/193055973 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:11.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe87ed9d700 1 --2- 172.21.15.153:0/193055973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8800bba40 0x7fe8800c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe87e59c700 1 --2- 172.21.15.153:0/193055973 >> v2:172.21.15.178:3300/0 conn(0x7fe8801539b0 0x7fe880153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 -- 172.21.15.153:0/193055973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8800bba40 msgr2=0x7fe8800c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 --2- 172.21.15.153:0/193055973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8800bba40 0x7fe8800c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 -- 172.21.15.153:0/193055973 >> v2:172.21.15.178:3300/0 conn(0x7fe8801539b0 msgr2=0x7fe880153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.946+0000 7fe875d9b700 1 --2- 172.21.15.153:0/193055973 >> v2:172.21.15.178:3300/0 conn(0x7fe8801539b0 0x7fe880153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe875d9b700 1 -- 172.21.15.153:0/193055973 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800a8ce0 con 0x7fe880066d40 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe87e59c700 1 --2- 172.21.15.153:0/193055973 >> v2:172.21.15.178:3300/0 conn(0x7fe8801539b0 0x7fe880153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:11.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe875d9b700 1 --2- 172.21.15.153:0/193055973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880066d40 0x7fe8801582c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe8800c4340 tx=0x7fe8680090f0).ready entity=mon.0 client_cookie=d788c3a0c9a75d1d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe87dd9b700 1 -- 172.21.15.153:0/193055973 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800b600 con 0x7fe880066d40 2023-08-17T00:03:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe87dd9b700 1 -- 172.21.15.153:0/193055973 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800b760 con 0x7fe880066d40 2023-08-17T00:03:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe87dd9b700 1 -- 172.21.15.153:0/193055973 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800bae0 con 0x7fe880066d40 2023-08-17T00:03:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 -- 172.21.15.153:0/193055973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880066d40 msgr2=0x7fe8801582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 --2- 172.21.15.153:0/193055973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880066d40 0x7fe8801582c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe8800c4340 tx=0x7fe8680090f0).stop 2023-08-17T00:03:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 -- 172.21.15.153:0/193055973 shutdown_connections 2023-08-17T00:03:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 --2- 172.21.15.153:0/193055973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8800bba40 0x7fe8800c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 --2- 172.21.15.153:0/193055973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe880066d40 0x7fe8801582c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 --2- 172.21.15.153:0/193055973 >> v2:172.21.15.178:3300/0 conn(0x7fe8801539b0 0x7fe880153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 -- 172.21.15.153:0/193055973 >> 172.21.15.153:0/193055973 conn(0x7fe88005dca0 msgr2=0x7fe88005e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 -- 172.21.15.153:0/193055973 shutdown_connections 2023-08-17T00:03:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.950+0000 7fe884cf1700 1 -- 172.21.15.153:0/193055973 wait complete. 2023-08-17T00:03:11.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 Processor -- start 2023-08-17T00:03:11.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 -- start start 2023-08-17T00:03:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe880066d40 0x7fe88014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8800bba40 0x7fe880155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 0x7fe8800bc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800bddb0 con 0x7fe8801539b0 2023-08-17T00:03:11.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88014f8c0 con 0x7fe8800bba40 2023-08-17T00:03:11.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe884cf1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88014fba0 con 0x7fe880066d40 2023-08-17T00:03:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 0x7fe8800bc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 0x7fe8800bc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46406/0 (socket says 172.21.15.153:46406) 2023-08-17T00:03:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 -- 172.21.15.153:0/218755838 learned_addr learned my addr 172.21.15.153:0/218755838 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87e59c700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe880066d40 0x7fe88014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe875d9b700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8800bba40 0x7fe880155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 -- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe880066d40 msgr2=0x7fe88014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:11.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe880066d40 0x7fe88014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 -- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8800bba40 msgr2=0x7fe880155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:11.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8800bba40 0x7fe880155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:11.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.954+0000 7fe87ed9d700 1 -- 172.21.15.153:0/218755838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009370 con 0x7fe8801539b0 2023-08-17T00:03:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe87ed9d700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 0x7fe8800bc830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fe87800d890 tx=0x7fe878008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8780125f0 con 0x7fe8801539b0 2023-08-17T00:03:11.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe878012750 con 0x7fe8801539b0 2023-08-17T00:03:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800bd760 con 0x7fe8801539b0 2023-08-17T00:03:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878012ad0 con 0x7fe8801539b0 2023-08-17T00:03:11.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88014bda0 con 0x7fe8801539b0 2023-08-17T00:03:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8800bdf20 con 0x7fe8801539b0 2023-08-17T00:03:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.958+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe878013480 con 0x7fe8801539b0 2023-08-17T00:03:11.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.962+0000 7fe876ffd700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe86005a120 0x7fe86005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:11.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.962+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe878073f80 con 0x7fe8801539b0 2023-08-17T00:03:11.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.962+0000 7fe87e59c700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe86005a120 0x7fe86005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:11.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.962+0000 7fe87e59c700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe86005a120 0x7fe86005c5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe870007600 tx=0x7fe870009850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:11.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:11.966+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8780479d0 con 0x7fe8801539b0 2023-08-17T00:03:12.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.162+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe880046dd0 con 0x7fe8801539b0 2023-08-17T00:03:12.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.162+0000 7fe876ffd700 1 -- 172.21.15.153:0/218755838 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe87804aff0 con 0x7fe8801539b0 2023-08-17T00:03:12.168 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:03:12.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.166+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe86005a120 msgr2=0x7fe86005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.166+0000 7fe884cf1700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe86005a120 0x7fe86005c5e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fe870007600 tx=0x7fe870009850).stop 2023-08-17T00:03:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.166+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 msgr2=0x7fe8800bc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:12.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.166+0000 7fe884cf1700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 0x7fe8800bc830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fe87800d890 tx=0x7fe878008040).stop 2023-08-17T00:03:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 shutdown_connections 2023-08-17T00:03:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe86005a120 0x7fe86005c5e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8801539b0 0x7fe8800bc830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:12.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8800bba40 0x7fe880155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 --2- 172.21.15.153:0/218755838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe880066d40 0x7fe88014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 >> 172.21.15.153:0/218755838 conn(0x7fe88005dca0 msgr2=0x7fe8800c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 shutdown_connections 2023-08-17T00:03:12.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:12.170+0000 7fe884cf1700 1 -- 172.21.15.153:0/218755838 wait complete. 2023-08-17T00:03:12.191 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T00:03:12.192 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:03:12.192 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:03:12.193 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-17T00:03:12.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-17T00:03:12.193 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T00:03:12.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T00:03:12.194 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:03:12.195 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-17T00:03:12.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.196 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:03:12.215 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.216 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:03:12.217 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:03:12.217 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:12.218 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:03:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:03:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-08-17T00:03:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:03:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:03:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:03:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.221 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:03:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:03:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link tentative 2023-08-17T00:03:12.222 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.222 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:03:12.293 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:03:12.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.295 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:03:12.358 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:03:12.358 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:03:12.358 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:03:12.358 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:03:12.358 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:03:12.359 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:03:12.359 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:03:12.359 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:03:12.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.359 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:12.360 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:12.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:03:12.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:03:12.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:03:12.361 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:12.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.498 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:03:12.515 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:03:12.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.518 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list-id 2023-08-17T00:03:12.580 INFO:teuthology.orchestra.run.smithi153.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-17T00:03:12.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.582 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:12.582 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:12.583 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:03:12.583 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-17T00:03:12.584 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:12.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.698 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-17T00:03:12.733 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:12.733 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:12.733 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:12.734 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.734 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:12.734 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.734 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:03:12.735 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 92:2a:20:b1:fe:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T00:03:12.735 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T00:03:12.735 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.736 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::902a:20ff:feb1:fed2/64 scope link tentative 2023-08-17T00:03:12.736 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-17T00:03:12.822 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:12.823 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:12.823 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:12.823 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.823 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:12.823 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.823 INFO:teuthology.orchestra.run.smithi153.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:03:12.824 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 92:2a:20:b1:fe:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T00:03:12.824 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T00:03:12.824 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.824 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::902a:20ff:feb1:fed2/64 scope link 2023-08-17T00:03:12.824 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:12.825 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-17T00:03:12.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:12.826 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:12.826 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:12.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-17T00:03:12.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-17T00:03:12.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-17T00:03:12.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-17T00:03:12.827 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-17T00:03:12.828 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:13.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.025 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:13.025 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:13.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.1 up 2023-08-17T00:03:13.026 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set dev brx.1 master ceph-brx 2023-08-17T00:03:13.026 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:13.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.103 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.2 2023-08-17T00:03:13.121 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:03:13.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:13.239 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:13.240 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:13.261 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=2,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:13.262 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=2,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:13.267 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:03:13.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.267 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-17T00:03:13.298 INFO:tasks.kclient:client.1 config is {} 2023-08-17T00:03:13.299 DEBUG:teuthology.orchestra.run.smithi178:> ceph fs ls 2023-08-17T00:03:13.435 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.429+0000 7fc924ef1700 1 Processor -- start 2023-08-17T00:03:13.435 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.429+0000 7fc924ef1700 1 -- start start 2023-08-17T00:03:13.438 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc924ef1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc92013b060 0x7fc9200bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.439 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc924ef1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc92013b440 0x7fc9200be200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.439 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc924ef1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.439 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc924ef1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc920156260 con 0x7fc92013b060 2023-08-17T00:03:13.439 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc924ef1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9200c7570 con 0x7fc92013b440 2023-08-17T00:03:13.439 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc924ef1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9201555e0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91dd9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc92013b440 0x7fc9200be200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:57528/0 (socket says 172.21.15.178:57528) 2023-08-17T00:03:13.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 -- 172.21.15.178:0/3531011782 learned_addr learned my addr 172.21.15.178:0/3531011782 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:03:13.440 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91e59c700 1 --2- 172.21.15.178:0/3531011782 >> v2:172.21.15.153:3300/0 conn(0x7fc92013b060 0x7fc9200bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.443 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 -- 172.21.15.178:0/3531011782 >> v2:172.21.15.178:3300/0 conn(0x7fc92013b440 msgr2=0x7fc9200be200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:13.443 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 --2- 172.21.15.178:0/3531011782 >> v2:172.21.15.178:3300/0 conn(0x7fc92013b440 0x7fc9200be200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.443 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 -- 172.21.15.178:0/3531011782 >> v2:172.21.15.153:3300/0 conn(0x7fc92013b060 msgr2=0x7fc9200bdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:13.443 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 --2- 172.21.15.178:0/3531011782 >> v2:172.21.15.153:3300/0 conn(0x7fc92013b060 0x7fc9200bdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.444 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 -- 172.21.15.178:0/3531011782 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9201558c0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.444 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91ed9d700 1 --2- 172.21.15.178:0/3531011782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c7080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc918006fd0 tx=0x7fc9180090f0).ready entity=mon.2 client_cookie=5ea736366d14f6f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:13.445 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.433+0000 7fc91d59a700 1 -- 172.21.15.178:0/3531011782 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800f510 con 0x7fc9200c6bf0 2023-08-17T00:03:13.445 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc91d59a700 1 -- 172.21.15.178:0/3531011782 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91800f670 con 0x7fc9200c6bf0 2023-08-17T00:03:13.445 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc91d59a700 1 -- 172.21.15.178:0/3531011782 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91800f9f0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.446 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 -- 172.21.15.178:0/3531011782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 msgr2=0x7fc9200c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:13.446 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 --2- 172.21.15.178:0/3531011782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c7080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fc918006fd0 tx=0x7fc9180090f0).stop 2023-08-17T00:03:13.446 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 -- 172.21.15.178:0/3531011782 shutdown_connections 2023-08-17T00:03:13.446 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 --2- 172.21.15.178:0/3531011782 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c7080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.447 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 --2- 172.21.15.178:0/3531011782 >> v2:172.21.15.178:3300/0 conn(0x7fc92013b440 0x7fc9200be200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.447 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 --2- 172.21.15.178:0/3531011782 >> v2:172.21.15.153:3300/0 conn(0x7fc92013b060 0x7fc9200bdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.447 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 -- 172.21.15.178:0/3531011782 >> 172.21.15.178:0/3531011782 conn(0x7fc920069110 msgr2=0x7fc920090a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:13.447 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 -- 172.21.15.178:0/3531011782 shutdown_connections 2023-08-17T00:03:13.448 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.437+0000 7fc924ef1700 1 -- 172.21.15.178:0/3531011782 wait complete. 2023-08-17T00:03:13.451 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 Processor -- start 2023-08-17T00:03:13.451 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 -- start start 2023-08-17T00:03:13.452 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.452 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc92013b060 0x7fc9201322d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.452 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc92013b440 0x7fc9200a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.452 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc920152e90 con 0x7fc92013b060 2023-08-17T00:03:13.453 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c1df0 con 0x7fc92013b440 2023-08-17T00:03:13.453 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc924ef1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9200c20d0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.453 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.454 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91ed9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc92013b440 0x7fc9200a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.454 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:57536/0 (socket says 172.21.15.178:57536) 2023-08-17T00:03:13.454 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 -- 172.21.15.178:0/408337884 learned_addr learned my addr 172.21.15.178:0/408337884 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:03:13.454 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91dd9b700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc92013b060 0x7fc9201322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.455 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 -- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc92013b440 msgr2=0x7fc9200a5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:13.455 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc92013b440 0x7fc9200a5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.455 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 -- 172.21.15.178:0/408337884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc92013b060 msgr2=0x7fc9201322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:13.455 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc92013b060 0x7fc9201322d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.455 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 -- 172.21.15.178:0/408337884 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc918009370 con 0x7fc9200c6bf0 2023-08-17T00:03:13.456 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91ed9d700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc92013b440 0x7fc9200a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:13.464 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.441+0000 7fc91e59c700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c2bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc910009ef0 tx=0x7fc91000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:13.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000cc20 con 0x7fc9200c6bf0 2023-08-17T00:03:13.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000f040 con 0x7fc9200c6bf0 2023-08-17T00:03:13.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9200c23b0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.465 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc910013400 con 0x7fc9200c6bf0 2023-08-17T00:03:13.466 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9200c30a0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc920046dd0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.469 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.445+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc910013770 con 0x7fc9200c6bf0 2023-08-17T00:03:13.470 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.449+0000 7fc90e7fc700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc90005a150 0x7fc90005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:13.470 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.449+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc910074ae0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.471 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.449+0000 7fc91dd9b700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc90005a150 0x7fc90005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:13.471 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.449+0000 7fc91dd9b700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc90005a150 0x7fc90005c610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc9200c3f30 tx=0x7fc914008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:13.471 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.457+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc910048590 con 0x7fc9200c6bf0 2023-08-17T00:03:13.658 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.653+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc920067350 con 0x7fc9200c6bf0 2023-08-17T00:03:13.659 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.653+0000 7fc90e7fc700 1 -- 172.21.15.178:0/408337884 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc91004bbb0 con 0x7fc9200c6bf0 2023-08-17T00:03:13.659 INFO:teuthology.orchestra.run.smithi178.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:03:13.666 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc90005a150 msgr2=0x7fc90005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:13.666 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc90005a150 0x7fc90005c610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc9200c3f30 tx=0x7fc914008040).stop 2023-08-17T00:03:13.666 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 msgr2=0x7fc9200c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:13.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c2bb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fc910009ef0 tx=0x7fc91000b040).stop 2023-08-17T00:03:13.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 shutdown_connections 2023-08-17T00:03:13.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc90005a150 0x7fc90005c610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.667 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc92013b440 0x7fc9200a5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.668 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc92013b060 0x7fc9201322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.668 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 --2- 172.21.15.178:0/408337884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9200c6bf0 0x7fc9200c2bb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:13.668 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 >> 172.21.15.178:0/408337884 conn(0x7fc920069110 msgr2=0x7fc920139770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:13.668 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 shutdown_connections 2023-08-17T00:03:13.668 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:13.661+0000 7fc924ef1700 1 -- 172.21.15.178:0/408337884 wait complete. 2023-08-17T00:03:13.681 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T00:03:13.681 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:03:13.681 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2023-08-17T00:03:13.682 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-17T00:03:13.682 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-17T00:03:13.682 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T00:03:13.682 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T00:03:13.682 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:03:13.683 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-17T00:03:13.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.683 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2023-08-17T00:03:13.701 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:13.701 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:13.701 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2023-08-17T00:03:13.702 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:13.703 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:03:13.704 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42426sec preferred_lft 42426sec 2023-08-17T00:03:13.704 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ec4:7aff:fe88:7ef9/64 scope link 2023-08-17T00:03:13.704 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:13.704 INFO:teuthology.orchestra.run.smithi178.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:03:13.705 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 02:42:b0:37:8c:3c brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:13.705 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:03:13.705 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:13.710 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-17T00:03:13.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.711 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:13.712 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:13.712 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add name ceph-brx type bridge 2023-08-17T00:03:13.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr flush dev ceph-brx 2023-08-17T00:03:13.713 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set ceph-brx up 2023-08-17T00:03:13.714 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-17T00:03:13.714 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:13.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.870 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:03:13.900 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-08-17T00:03:13.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.904 DEBUG:teuthology.orchestra.run.smithi178:> route 2023-08-17T00:03:13.988 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2023-08-17T00:03:13.988 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:03:13.988 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:03:13.989 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:03:13.989 INFO:teuthology.orchestra.run.smithi178.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:03:13.989 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:03:13.989 INFO:teuthology.orchestra.run.smithi178.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:03:13.989 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:03:13.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:13.990 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:13.990 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:13.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:03:13.990 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:03:13.991 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:03:13.991 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:14.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.124 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-08-17T00:03:14.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.143 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2023-08-17T00:03:14.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.201 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:14.201 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:14.201 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-17T00:03:14.202 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-17T00:03:14.202 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:14.320 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-17T00:03:14.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.321 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:14.322 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:14.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-17T00:03:14.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-17T00:03:14.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-17T00:03:14.322 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-17T00:03:14.323 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-17T00:03:14.323 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:14.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.498 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:14.498 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:14.499 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.0 up 2023-08-17T00:03:14.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.0 master ceph-brx 2023-08-17T00:03:14.500 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:14.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.573 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p /home/ubuntu/cephtest/mnt.1 2023-08-17T00:03:14.590 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:03:14.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:14.708 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:14.708 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:14.823 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=1,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:14.824 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=1,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:14.828 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:03:14.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:14.829 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-17T00:03:14.862 INFO:tasks.kclient:client.3 config is {} 2023-08-17T00:03:14.863 DEBUG:teuthology.orchestra.run.smithi178:> ceph fs ls 2023-08-17T00:03:15.036 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.033+0000 7f8ea2546700 1 Processor -- start 2023-08-17T00:03:15.037 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.033+0000 7f8ea2546700 1 -- start start 2023-08-17T00:03:15.040 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:15.040 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c1506b0 con 0x7f8e9c0bc320 2023-08-17T00:03:15.040 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c150970 con 0x7f8e9c0c3690 2023-08-17T00:03:15.041 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c150c50 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.041 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea0ae3700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f8e9c0c3690 0x7f8e9c0c1c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:37086/0 (socket says 172.21.15.178:37086) 2023-08-17T00:03:15.041 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea0ae3700 1 -- 172.21.15.178:0/179676871 learned_addr learned my addr 172.21.15.178:0/179676871 (peer_addr_for_me v1:172.21.15.178:0/0) 2023-08-17T00:03:15.042 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9bfff700 1 --2- 172.21.15.178:0/179676871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:15.042 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9bfff700 1 -- 172.21.15.178:0/179676871 >> v1:172.21.15.178:6789/0 conn(0x7f8e9c0c3690 legacy=0x7f8e9c0c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.042 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9b7fe700 1 -- 172.21.15.178:0/179676871 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195021243 0 0) 0x7f8e9c150970 con 0x7f8e9c0c3690 2023-08-17T00:03:15.042 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9bfff700 1 -- 172.21.15.178:0/179676871 >> v1:172.21.15.153:6789/0 conn(0x7f8e9c0bc320 legacy=0x7f8e9c0c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.042 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9bfff700 1 -- 172.21.15.178:0/179676871 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c150f30 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.043 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9bfff700 1 --2- 172.21.15.178:0/179676871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0bd1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8e8c009790 tx=0x7f8e8c009060).ready entity=mon.2 client_cookie=9861d3471b66cf5f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:15.043 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9b7fe700 1 -- 172.21.15.178:0/179676871 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c010620 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.044 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9b7fe700 1 -- 172.21.15.178:0/179676871 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c010780 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.044 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8e9b7fe700 1 -- 172.21.15.178:0/179676871 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c010b00 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.044 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- 172.21.15.178:0/179676871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0bcdc0 msgr2=0x7f8e9c0bd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 --2- 172.21.15.178:0/179676871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0bd1a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f8e8c009790 tx=0x7f8e8c009060).stop 2023-08-17T00:03:15.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- 172.21.15.178:0/179676871 shutdown_connections 2023-08-17T00:03:15.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 --2- 172.21.15.178:0/179676871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0bd1a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- 172.21.15.178:0/179676871 >> 172.21.15.178:0/179676871 conn(0x7f8e9c05dca0 msgr2=0x7f8e9c05e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:15.045 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- 172.21.15.178:0/179676871 shutdown_connections 2023-08-17T00:03:15.046 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.037+0000 7f8ea2546700 1 -- 172.21.15.178:0/179676871 wait complete. 2023-08-17T00:03:15.046 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.041+0000 7f8ea2546700 1 Processor -- start 2023-08-17T00:03:15.046 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.041+0000 7f8ea2546700 1 -- start start 2023-08-17T00:03:15.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e9c0bc320 0x7f8e9c13f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:15.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:15.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0c3690 0x7f8e9c0a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:15.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c13f890 con 0x7f8e9c0bc320 2023-08-17T00:03:15.048 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0aac20 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.049 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0aa010 con 0x7f8e9c0c3690 2023-08-17T00:03:15.050 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:15.050 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea0ae3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0c3690 0x7f8e9c0a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:15.050 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:40498/0 (socket says 172.21.15.178:40498) 2023-08-17T00:03:15.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 -- 172.21.15.178:0/1056003132 learned_addr learned my addr 172.21.15.178:0/1056003132 (peer_addr_for_me v2:172.21.15.178:0/0) 2023-08-17T00:03:15.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e9bfff700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e9c0bc320 0x7f8e9c13f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:15.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 -- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0c3690 msgr2=0x7f8e9c0a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0c3690 0x7f8e9c0a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 -- 172.21.15.178:0/1056003132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e9c0bc320 msgr2=0x7f8e9c13f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.051 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e9c0bc320 0x7f8e9c13f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 -- 172.21.15.178:0/1056003132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0092a0 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e93fff700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0ab0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8e8400c440 tx=0x7f8e84007d70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84007020 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84001e90 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e840073b0 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c0aa2f0 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.052 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.045+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0aa8b0 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.049+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0aadb0 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.053 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.049+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8e84010070 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.054 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.049+0000 7f8e98ff9700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e7c05a180 0x7f8e7c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:15.055 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.049+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e84073860 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.055 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.049+0000 7f8e9bfff700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e7c05a180 0x7f8e7c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:15.056 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.053+0000 7f8e9bfff700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e7c05a180 0x7f8e7c05c640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8e8c0096e0 tx=0x7f8e8c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:15.062 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.057+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e84047200 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.256 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.253+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8e9c0688e0 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.257 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.253+0000 7f8e98ff9700 1 -- 172.21.15.178:0/1056003132 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8e8404a820 con 0x7f8e9c0bcdc0 2023-08-17T00:03:15.257 INFO:teuthology.orchestra.run.smithi178.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:03:15.261 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e7c05a180 msgr2=0x7f8e7c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.262 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e7c05a180 0x7f8e7c05c640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8e8c0096e0 tx=0x7f8e8c016000).stop 2023-08-17T00:03:15.262 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 msgr2=0x7f8e9c0ab0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:15.262 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0ab0b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f8e8400c440 tx=0x7f8e84007d70).stop 2023-08-17T00:03:15.262 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 shutdown_connections 2023-08-17T00:03:15.262 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e7c05a180 0x7f8e7c05c640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.262 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e9c0c3690 0x7f8e9c0a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e9c0bcdc0 0x7f8e9c0ab0b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.263 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 --2- 172.21.15.178:0/1056003132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e9c0bc320 0x7f8e9c13f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:15.265 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 >> 172.21.15.178:0/1056003132 conn(0x7f8e9c05dca0 msgr2=0x7f8e9c0a8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:15.265 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 shutdown_connections 2023-08-17T00:03:15.265 INFO:teuthology.orchestra.run.smithi178.stderr:2023-08-17T00:03:15.257+0000 7f8ea2546700 1 -- 172.21.15.178:0/1056003132 wait complete. 2023-08-17T00:03:15.282 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-17T00:03:15.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:03:15.282 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2023-08-17T00:03:15.283 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-17T00:03:15.283 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-17T00:03:15.283 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-17T00:03:15.283 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-17T00:03:15.283 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:03:15.284 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-17T00:03:15.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.284 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2023-08-17T00:03:15.303 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:15.303 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:15.304 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:15.304 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.304 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:15.304 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.305 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:15.305 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:15.305 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2023-08-17T00:03:15.305 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:15.306 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:15.306 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2023-08-17T00:03:15.306 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:15.306 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:15.306 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:03:15.307 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:15.307 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:03:15.307 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42425sec preferred_lft 42425sec 2023-08-17T00:03:15.308 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ec4:7aff:fe88:7ef9/64 scope link 2023-08-17T00:03:15.308 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.308 INFO:teuthology.orchestra.run.smithi178.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:03:15.308 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 02:42:b0:37:8c:3c brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:15.308 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether a2:85:3f:52:7c:97 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::9004:ebff:fe7a:cbe1/64 scope link tentative 2023-08-17T00:03:15.309 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.310 INFO:teuthology.orchestra.run.smithi178.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:03:15.310 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether a2:85:3f:52:7c:97 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-17T00:03:15.310 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::a085:3fff:fe52:7c97/64 scope link tentative 2023-08-17T00:03:15.310 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.312 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:03:15.389 INFO:teuthology.orchestra.run.smithi178.stdout:1 2023-08-17T00:03:15.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.393 DEBUG:teuthology.orchestra.run.smithi178:> route 2023-08-17T00:03:15.455 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2023-08-17T00:03:15.455 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:03:15.455 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:03:15.455 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:03:15.455 INFO:teuthology.orchestra.run.smithi178.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:03:15.456 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:03:15.456 INFO:teuthology.orchestra.run.smithi178.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:03:15.456 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:03:15.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.457 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:15.457 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:15.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:03:15.458 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:03:15.458 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:03:15.458 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:15.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.588 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-08-17T00:03:15.605 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-17T00:03:15.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.607 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2023-08-17T00:03:15.665 INFO:teuthology.orchestra.run.smithi178.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-17T00:03:15.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.666 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:15.666 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:15.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-17T00:03:15.666 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-17T00:03:15.666 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:15.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.783 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-17T00:03:15.820 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:15.820 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:15.820 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:15.820 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.820 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:15.821 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.821 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:03:15.821 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 8e:9a:19:03:18:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T00:03:15.821 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T00:03:15.822 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.822 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::8c9a:19ff:fe03:1878/64 scope link tentative 2023-08-17T00:03:15.822 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.823 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-17T00:03:15.904 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:15.904 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:15.905 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.906 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:03:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 8e:9a:19:03:18:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-17T00:03:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-17T00:03:15.906 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::8c9a:19ff:fe03:1878/64 scope link tentative 2023-08-17T00:03:15.907 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:15.908 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-17T00:03:15.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:15.909 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:15.909 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:15.910 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-17T00:03:15.910 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-17T00:03:15.910 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-17T00:03:15.910 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-17T00:03:15.911 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-17T00:03:15.911 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:16.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:16.101 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2023-08-17T00:03:16.101 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2023-08-17T00:03:16.102 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.1 up 2023-08-17T00:03:16.102 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.1 master ceph-brx 2023-08-17T00:03:16.102 DEBUG:teuthology.orchestra.run.smithi178:> ') 2023-08-17T00:03:16.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:16.179 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p /home/ubuntu/cephtest/mnt.3 2023-08-17T00:03:16.195 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:03:16.195 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:16.311 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:16.312 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:16.334 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,name=3,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:16.335 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,name=3,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:16.340 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:03:16.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:16.341 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-17T00:03:16.369 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-17T00:03:16.392 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:16.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.542+0000 7f7967507700 1 Processor -- start 2023-08-17T00:03:16.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7967507700 1 -- start start 2023-08-17T00:03:16.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7967507700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7960068f30 0x7f79600c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7967507700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79601545e0 con 0x7f79600abf10 2023-08-17T00:03:16.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7967507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79600a96d0 con 0x7f79600ac2f0 2023-08-17T00:03:16.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7967507700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79600c1c50 con 0x7f7960068f30 2023-08-17T00:03:16.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7966505700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f79600abf10 0x7f7960068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47222/0 (socket says 172.21.15.153:47222) 2023-08-17T00:03:16.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7966505700 1 -- 172.21.15.153:0/1143859547 learned_addr learned my addr 172.21.15.153:0/1143859547 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:16.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965d04700 1 --2- 172.21.15.153:0/1143859547 >> v2:172.21.15.178:3300/0 conn(0x7f7960068f30 0x7f79600c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965d04700 1 -- 172.21.15.153:0/1143859547 >> v1:172.21.15.178:6789/0 conn(0x7f79600ac2f0 legacy=0x7f7960156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965d04700 1 -- 172.21.15.153:0/1143859547 >> v1:172.21.15.153:6789/0 conn(0x7f79600abf10 legacy=0x7f7960068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965503700 1 -- 172.21.15.153:0/1143859547 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093716544 0 0) 0x7f79601545e0 con 0x7f79600abf10 2023-08-17T00:03:16.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965d04700 1 -- 172.21.15.153:0/1143859547 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960064b80 con 0x7f7960068f30 2023-08-17T00:03:16.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965d04700 1 --2- 172.21.15.153:0/1143859547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7960068f30 0x7f79600c0a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7950009760 tx=0x7f7950009060).ready entity=mon.1 client_cookie=68289172de2955ae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:16.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.546+0000 7f7965503700 1 -- 172.21.15.153:0/1143859547 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950009120 con 0x7f7960068f30 2023-08-17T00:03:16.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7965503700 1 -- 172.21.15.153:0/1143859547 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000b580 con 0x7f7960068f30 2023-08-17T00:03:16.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7965503700 1 -- 172.21.15.153:0/1143859547 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795000b900 con 0x7f7960068f30 2023-08-17T00:03:16.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 -- 172.21.15.153:0/1143859547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7960068f30 msgr2=0x7f79600c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 --2- 172.21.15.153:0/1143859547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7960068f30 0x7f79600c0a80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7950009760 tx=0x7f7950009060).stop 2023-08-17T00:03:16.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 -- 172.21.15.153:0/1143859547 shutdown_connections 2023-08-17T00:03:16.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 --2- 172.21.15.153:0/1143859547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7960068f30 0x7f79600c0a80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 -- 172.21.15.153:0/1143859547 >> 172.21.15.153:0/1143859547 conn(0x7f79600c6620 msgr2=0x7f79600c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:16.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 -- 172.21.15.153:0/1143859547 shutdown_connections 2023-08-17T00:03:16.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.550+0000 7f7967507700 1 -- 172.21.15.153:0/1143859547 wait complete. 2023-08-17T00:03:16.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 Processor -- start 2023-08-17T00:03:16.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 -- start start 2023-08-17T00:03:16.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 0x7f7960155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79600abf10 0x7f79600bc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79600ac2f0 0x7f7960159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796014a450 con 0x7f7960068f30 2023-08-17T00:03:16.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79600bc650 con 0x7f79600abf10 2023-08-17T00:03:16.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7967507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79600bb750 con 0x7f79600ac2f0 2023-08-17T00:03:16.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 0x7f7960155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 0x7f7960155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42178/0 (socket says 172.21.15.153:42178) 2023-08-17T00:03:16.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 -- 172.21.15.153:0/2672379395 learned_addr learned my addr 172.21.15.153:0/2672379395 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:16.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7965d04700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79600abf10 0x7f79600bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966d06700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79600ac2f0 0x7f7960159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 -- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79600ac2f0 msgr2=0x7f7960159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79600ac2f0 0x7f7960159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 -- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79600abf10 msgr2=0x7f79600bc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79600abf10 0x7f79600bc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966505700 1 -- 172.21.15.153:0/2672379395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79500092a0 con 0x7f7960068f30 2023-08-17T00:03:16.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.554+0000 7f7966d06700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79600ac2f0 0x7f7960159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:16.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f7966505700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 0x7f7960155330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f795c007fd0 tx=0x7f795c007ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00ce90 con 0x7f7960068f30 2023-08-17T00:03:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c0072e0 con 0x7f7960068f30 2023-08-17T00:03:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79601559c0 con 0x7f7960068f30 2023-08-17T00:03:16.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c005670 con 0x7f7960068f30 2023-08-17T00:03:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79600bb470 con 0x7f7960068f30 2023-08-17T00:03:16.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.558+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79600c6bb0 con 0x7f7960068f30 2023-08-17T00:03:16.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.562+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f795c01a060 con 0x7f7960068f30 2023-08-17T00:03:16.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.562+0000 7f79567fc700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794405a150 0x7f794405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.562+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f795c073880 con 0x7f7960068f30 2023-08-17T00:03:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.562+0000 7f7965d04700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794405a150 0x7f794405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.566+0000 7f7965d04700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794405a150 0x7f794405c610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7950009760 tx=0x7f7950017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:16.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.570+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79600c6bb0 con 0x7f7960068f30 2023-08-17T00:03:16.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.730+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79600c6bb0 con 0x7f7960068f30 2023-08-17T00:03:16.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.734+0000 7f79567fc700 1 -- 172.21.15.153:0/2672379395 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f79600c6bb0 con 0x7f7960068f30 2023-08-17T00:03:16.739 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:16.739 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:16.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.734+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794405a150 msgr2=0x7f794405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.734+0000 7f7967507700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794405a150 0x7f794405c610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7950009760 tx=0x7f7950017000).stop 2023-08-17T00:03:16.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 msgr2=0x7f7960155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 0x7f7960155330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f795c007fd0 tx=0x7f795c007ac0).stop 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 shutdown_connections 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794405a150 0x7f794405c610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79600ac2f0 0x7f7960159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79600abf10 0x7f79600bc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 --2- 172.21.15.153:0/2672379395 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7960068f30 0x7f7960155330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 >> 172.21.15.153:0/2672379395 conn(0x7f79600c6620 msgr2=0x7f79600a9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:16.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 shutdown_connections 2023-08-17T00:03:16.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.738+0000 7f7967507700 1 -- 172.21.15.153:0/2672379395 wait complete. 2023-08-17T00:03:16.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:16.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:16.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.914+0000 7f7646db9700 1 Processor -- start 2023-08-17T00:03:16.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.914+0000 7f7646db9700 1 -- start start 2023-08-17T00:03:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7646db9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76400c57a0 0x7f76400c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7646db9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7640153f50 0x7f7640154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7646db9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76400bfd10 con 0x7f7640157600 2023-08-17T00:03:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7646db9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7640154860 con 0x7f7640153f50 2023-08-17T00:03:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7646db9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7640154af0 con 0x7f76400c57a0 2023-08-17T00:03:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7640153f50 0x7f7640154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7640153f50 0x7f7640154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42184/0 (socket says 172.21.15.153:42184) 2023-08-17T00:03:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 -- 172.21.15.153:0/3275345465 learned_addr learned my addr 172.21.15.153:0/3275345465 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7645db7700 1 --2- 172.21.15.153:0/3275345465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76400c57a0 0x7f76400c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 -- 172.21.15.153:0/3275345465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76400c57a0 msgr2=0x7f76400c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 --2- 172.21.15.153:0/3275345465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76400c57a0 0x7f76400c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 -- 172.21.15.153:0/3275345465 >> v1:172.21.15.178:6789/0 conn(0x7f7640157600 legacy=0x7f7640157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 -- 172.21.15.153:0/3275345465 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640154dd0 con 0x7f7640153f50 2023-08-17T00:03:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f76455b6700 1 --2- 172.21.15.153:0/3275345465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7640153f50 0x7f7640154370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7630006fd0 tx=0x7f76300090f0).ready entity=mon.0 client_cookie=90cd898588cb712a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.918+0000 7f7644db5700 1 -- 172.21.15.153:0/3275345465 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000b600 con 0x7f7640153f50 2023-08-17T00:03:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7644db5700 1 -- 172.21.15.153:0/3275345465 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763000b760 con 0x7f7640153f50 2023-08-17T00:03:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7644db5700 1 -- 172.21.15.153:0/3275345465 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763000bae0 con 0x7f7640153f50 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 -- 172.21.15.153:0/3275345465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7640153f50 msgr2=0x7f7640154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 --2- 172.21.15.153:0/3275345465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7640153f50 0x7f7640154370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f7630006fd0 tx=0x7f76300090f0).stop 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 -- 172.21.15.153:0/3275345465 shutdown_connections 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 --2- 172.21.15.153:0/3275345465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7640153f50 0x7f7640154370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 --2- 172.21.15.153:0/3275345465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76400c57a0 0x7f76400c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 -- 172.21.15.153:0/3275345465 >> 172.21.15.153:0/3275345465 conn(0x7f7640062a70 msgr2=0x7f76400ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 -- 172.21.15.153:0/3275345465 shutdown_connections 2023-08-17T00:03:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.922+0000 7f7646db9700 1 -- 172.21.15.153:0/3275345465 wait complete. 2023-08-17T00:03:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 Processor -- start 2023-08-17T00:03:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 -- start start 2023-08-17T00:03:16.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 0x7f7640146240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7640153f50 0x7f76400ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7640157600 0x7f76400aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400acf80 con 0x7f76400c57a0 2023-08-17T00:03:16.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76400b0540 con 0x7f7640153f50 2023-08-17T00:03:16.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7646db9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76400c8180 con 0x7f7640157600 2023-08-17T00:03:16.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 0x7f7640146240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 0x7f7640146240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42190/0 (socket says 172.21.15.153:42190) 2023-08-17T00:03:16.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 -- 172.21.15.153:0/1820494902 learned_addr learned my addr 172.21.15.153:0/1820494902 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f76455b6700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7640153f50 0x7f76400ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f76465b8700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7640157600 0x7f76400aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 -- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7640157600 msgr2=0x7f76400aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7640157600 0x7f76400aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 -- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7640153f50 msgr2=0x7f76400ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7640153f50 0x7f76400ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 -- 172.21.15.153:0/1820494902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7630009370 con 0x7f76400c57a0 2023-08-17T00:03:16.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f76465b8700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7640157600 0x7f76400aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f76455b6700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7640153f50 0x7f76400ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.926+0000 7f7645db7700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 0x7f7640146240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f763c00d890 tx=0x7f763c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c0125f0 con 0x7f76400c57a0 2023-08-17T00:03:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f763c012750 con 0x7f76400c57a0 2023-08-17T00:03:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76400c7f00 con 0x7f76400c57a0 2023-08-17T00:03:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f763c012ad0 con 0x7f76400c57a0 2023-08-17T00:03:16.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76400c8c20 con 0x7f76400c57a0 2023-08-17T00:03:16.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76400c4cc0 con 0x7f76400c57a0 2023-08-17T00:03:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.930+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f763c013480 con 0x7f76400c57a0 2023-08-17T00:03:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.934+0000 7f7635ffb700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f762405a1a0 0x7f762405c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.934+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f763c073ff0 con 0x7f76400c57a0 2023-08-17T00:03:16.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.934+0000 7f76455b6700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f762405a1a0 0x7f762405c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.934+0000 7f76455b6700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f762405a1a0 0x7f762405c660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7630006fd0 tx=0x7f7630017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:16.942+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f763c0a28f0 con 0x7f76400c57a0 2023-08-17T00:03:17.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.106+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f764006b4c0 con 0x7f76400c57a0 2023-08-17T00:03:17.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.110+0000 7f7635ffb700 1 -- 172.21.15.153:0/1820494902 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f763c0479d0 con 0x7f76400c57a0 2023-08-17T00:03:17.113 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:17.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f762405a1a0 msgr2=0x7f762405c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f762405a1a0 0x7f762405c660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f7630006fd0 tx=0x7f7630017000).stop 2023-08-17T00:03:17.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 msgr2=0x7f7640146240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 0x7f7640146240 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f763c00d890 tx=0x7f763c008040).stop 2023-08-17T00:03:17.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 shutdown_connections 2023-08-17T00:03:17.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f762405a1a0 0x7f762405c660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7640157600 0x7f76400aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7640153f50 0x7f76400ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 --2- 172.21.15.153:0/1820494902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76400c57a0 0x7f7640146240 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 >> 172.21.15.153:0/1820494902 conn(0x7f7640062a70 msgr2=0x7f76400aa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:17.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 shutdown_connections 2023-08-17T00:03:17.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.114+0000 7f7646db9700 1 -- 172.21.15.153:0/1820494902 wait complete. 2023-08-17T00:03:17.138 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.294+0000 7f7e82e39700 1 Processor -- start 2023-08-17T00:03:17.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.294+0000 7f7e82e39700 1 -- start start 2023-08-17T00:03:17.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c1505e0 0x7f7e7c0c6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e7c067500 0x7f7e7c0c6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82e39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c151b30 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c05e600 con 0x7f7e7c067500 2023-08-17T00:03:17.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0c69f0 con 0x7f7e7c1505e0 2023-08-17T00:03:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81e37700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c1505e0 0x7f7e7c0c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81636700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7e7c0c32b0 0x7f7e7c154230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:57154/0 (socket says 172.21.15.153:57154) 2023-08-17T00:03:17.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81636700 1 -- 172.21.15.153:0/2167168789 learned_addr learned my addr 172.21.15.153:0/2167168789 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:17.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82638700 1 --2- 172.21.15.153:0/2167168789 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c067500 0x7f7e7c0c6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e80e35700 1 -- 172.21.15.153:0/2167168789 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922560006 0 0) 0x7f7e7c151b30 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e80e35700 1 -- 172.21.15.153:0/2167168789 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e680033f0 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81e37700 1 -- 172.21.15.153:0/2167168789 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c067500 msgr2=0x7f7e7c0c6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:17.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81e37700 1 --2- 172.21.15.153:0/2167168789 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c067500 0x7f7e7c0c6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81e37700 1 -- 172.21.15.153:0/2167168789 >> v1:172.21.15.178:6789/0 conn(0x7f7e7c0c32b0 legacy=0x7f7e7c154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81e37700 1 -- 172.21.15.153:0/2167168789 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c150f20 con 0x7f7e7c1505e0 2023-08-17T00:03:17.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e82638700 1 --2- 172.21.15.153:0/2167168789 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c067500 0x7f7e7c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.298+0000 7f7e81e37700 1 --2- 172.21.15.153:0/2167168789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c1505e0 0x7f7e7c0c6010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7e7800ba00 tx=0x7f7e7800b300).ready entity=mon.2 client_cookie=50ac599b83add2cc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e80e35700 1 -- 172.21.15.153:0/2167168789 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800b370 con 0x7f7e7c1505e0 2023-08-17T00:03:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e80e35700 1 -- 172.21.15.153:0/2167168789 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800d8c0 con 0x7f7e7c1505e0 2023-08-17T00:03:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e80e35700 1 -- 172.21.15.153:0/2167168789 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800dc40 con 0x7f7e7c1505e0 2023-08-17T00:03:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 -- 172.21.15.153:0/2167168789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c1505e0 msgr2=0x7f7e7c0c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 --2- 172.21.15.153:0/2167168789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c1505e0 0x7f7e7c0c6010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f7e7800ba00 tx=0x7f7e7800b300).stop 2023-08-17T00:03:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 -- 172.21.15.153:0/2167168789 shutdown_connections 2023-08-17T00:03:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 --2- 172.21.15.153:0/2167168789 >> v2:172.21.15.178:3300/0 conn(0x7f7e7c067500 0x7f7e7c0c6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 --2- 172.21.15.153:0/2167168789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c1505e0 0x7f7e7c0c6010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 -- 172.21.15.153:0/2167168789 >> 172.21.15.153:0/2167168789 conn(0x7f7e7c064d60 msgr2=0x7f7e7c065140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:17.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 -- 172.21.15.153:0/2167168789 shutdown_connections 2023-08-17T00:03:17.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 -- 172.21.15.153:0/2167168789 wait complete. 2023-08-17T00:03:17.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 Processor -- start 2023-08-17T00:03:17.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.302+0000 7f7e82e39700 1 -- start start 2023-08-17T00:03:17.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c067500 0x7f7e7c0bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 0x7f7e7c0a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c1505e0 0x7f7e7c1633c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0aa770 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0c0330 con 0x7f7e7c1505e0 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0aaa30 con 0x7f7e7c067500 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 0x7f7e7c0a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 0x7f7e7c0a4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42198/0 (socket says 172.21.15.153:42198) 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 -- 172.21.15.153:0/3188778013 learned_addr learned my addr 172.21.15.153:0/3188778013 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81e37700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c067500 0x7f7e7c0bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82638700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c1505e0 0x7f7e7c1633c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 -- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c067500 msgr2=0x7f7e7c0bf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c067500 0x7f7e7c0bf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 -- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c1505e0 msgr2=0x7f7e7c1633c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c1505e0 0x7f7e7c1633c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 -- 172.21.15.153:0/3188778013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74009a20 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e81636700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 0x7f7e7c0a4270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7e6c00c420 tx=0x7f7e6c007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:17.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0070d0 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c007230 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7800b540 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0075b0 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.306+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c0bfd70 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.310+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c06b4c0 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.310+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7e6c01a060 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.314+0000 7f7e71ffb700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e6005a150 0x7f7e6005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.314+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7e6c073710 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.314+0000 7f7e81e37700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e6005a150 0x7f7e6005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.314+0000 7f7e81e37700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e6005a150 0x7f7e6005c610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7e7800d680 tx=0x7f7e7800b300).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:17.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.318+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e6c0471c0 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.474+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e7c151250 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.478+0000 7f7e71ffb700 1 -- 172.21.15.153:0/3188778013 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e6c018070 con 0x7f7e7c0c32b0 2023-08-17T00:03:17.482 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:17.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e6005a150 msgr2=0x7f7e6005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e6005a150 0x7f7e6005c610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f7e7800d680 tx=0x7f7e7800b300).stop 2023-08-17T00:03:17.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 msgr2=0x7f7e7c0a4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 0x7f7e7c0a4270 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f7e6c00c420 tx=0x7f7e6c007bf0).stop 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 shutdown_connections 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e6005a150 0x7f7e6005c610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e7c1505e0 0x7f7e7c1633c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e7c0c32b0 0x7f7e7c0a4270 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 --2- 172.21.15.153:0/3188778013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e7c067500 0x7f7e7c0bf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 >> 172.21.15.153:0/3188778013 conn(0x7f7e7c064d60 msgr2=0x7f7e7c14e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:17.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 shutdown_connections 2023-08-17T00:03:17.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.482+0000 7f7e82e39700 1 -- 172.21.15.153:0/3188778013 wait complete. 2023-08-17T00:03:17.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:17.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 Processor -- start 2023-08-17T00:03:17.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 -- start start 2023-08-17T00:03:17.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c5ea0 0x7f61f80634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f61f80639a0 0x7f61f80bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f8154e90 con 0x7f61f80acf30 2023-08-17T00:03:17.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80c1730 con 0x7f61f80639a0 2023-08-17T00:03:17.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.658+0000 7f61f759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8063e10 con 0x7f61f80c5ea0 2023-08-17T00:03:17.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f61f80639a0 0x7f61f80bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f5d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c5ea0 0x7f61f80634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f61f80acf30 0x7f61f80c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47230/0 (socket says 172.21.15.153:47230) 2023-08-17T00:03:17.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f659c700 1 -- 172.21.15.153:0/1870008506 learned_addr learned my addr 172.21.15.153:0/1870008506 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:17.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f5d9b700 1 -- 172.21.15.153:0/1870008506 >> v2:172.21.15.153:3300/0 conn(0x7f61f80639a0 msgr2=0x7f61f80bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f5d9b700 1 --2- 172.21.15.153:0/1870008506 >> v2:172.21.15.153:3300/0 conn(0x7f61f80639a0 0x7f61f80bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f5d9b700 1 -- 172.21.15.153:0/1870008506 >> v1:172.21.15.153:6789/0 conn(0x7f61f80acf30 legacy=0x7f61f80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f5d9b700 1 -- 172.21.15.153:0/1870008506 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8153fc0 con 0x7f61f80c5ea0 2023-08-17T00:03:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f5d9b700 1 --2- 172.21.15.153:0/1870008506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c5ea0 0x7f61f80634b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f61ec009760 tx=0x7f61ec009060).ready entity=mon.2 client_cookie=2b93be6133246ee server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:17.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f559a700 1 -- 172.21.15.153:0/1870008506 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0090d0 con 0x7f61f80c5ea0 2023-08-17T00:03:17.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f559a700 1 -- 172.21.15.153:0/1870008506 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ec00f510 con 0x7f61f80c5ea0 2023-08-17T00:03:17.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f559a700 1 -- 172.21.15.153:0/1870008506 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec00f890 con 0x7f61f80c5ea0 2023-08-17T00:03:17.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f759e700 1 -- 172.21.15.153:0/1870008506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c5ea0 msgr2=0x7f61f80634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.662+0000 7f61f759e700 1 --2- 172.21.15.153:0/1870008506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c5ea0 0x7f61f80634b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f61ec009760 tx=0x7f61ec009060).stop 2023-08-17T00:03:17.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- 172.21.15.153:0/1870008506 shutdown_connections 2023-08-17T00:03:17.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 --2- 172.21.15.153:0/1870008506 >> v2:172.21.15.153:3300/0 conn(0x7f61f80639a0 0x7f61f80bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 --2- 172.21.15.153:0/1870008506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c5ea0 0x7f61f80634b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- 172.21.15.153:0/1870008506 >> 172.21.15.153:0/1870008506 conn(0x7f61f80cb330 msgr2=0x7f61f80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:17.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- 172.21.15.153:0/1870008506 shutdown_connections 2023-08-17T00:03:17.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- 172.21.15.153:0/1870008506 wait complete. 2023-08-17T00:03:17.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 Processor -- start 2023-08-17T00:03:17.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- start start 2023-08-17T00:03:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 0x7f61f81587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80acf30 0x7f61f8158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c43e0 0x7f61f80c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80afda0 con 0x7f61f80639a0 2023-08-17T00:03:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80c3340 con 0x7f61f80acf30 2023-08-17T00:03:17.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.666+0000 7f61f759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80c3620 con 0x7f61f80c43e0 2023-08-17T00:03:17.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 0x7f61f81587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 0x7f61f81587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42204/0 (socket says 172.21.15.153:42204) 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 -- 172.21.15.153:0/834308877 learned_addr learned my addr 172.21.15.153:0/834308877 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f6d9d700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c43e0 0x7f61f80c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f5d9b700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80acf30 0x7f61f8158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 -- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c43e0 msgr2=0x7f61f80c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c43e0 0x7f61f80c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 -- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80acf30 msgr2=0x7f61f8158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80acf30 0x7f61f8158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 -- 172.21.15.153:0/834308877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec0092a0 con 0x7f61f80639a0 2023-08-17T00:03:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f659c700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 0x7f61f81587f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f61e800c4c0 tx=0x7f61e8007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80072e0 con 0x7f61f80639a0 2023-08-17T00:03:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e8007440 con 0x7f61f80639a0 2023-08-17T00:03:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80057a0 con 0x7f61f80639a0 2023-08-17T00:03:17.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f80c3900 con 0x7f61f80639a0 2023-08-17T00:03:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f80c3ec0 con 0x7f61f80639a0 2023-08-17T00:03:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.670+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f806b4c0 con 0x7f61f80639a0 2023-08-17T00:03:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.674+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f61e8010070 con 0x7f61f80639a0 2023-08-17T00:03:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.674+0000 7f61e67fc700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f61d805a150 0x7f61d805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:17.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.674+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f61e80736b0 con 0x7f61f80639a0 2023-08-17T00:03:17.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.674+0000 7f61f5d9b700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f61d805a150 0x7f61d805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.678+0000 7f61f5d9b700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f61d805a150 0x7f61d805c610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f61ec009fd0 tx=0x7f61ec017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:17.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.678+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f61e8047050 con 0x7f61f80639a0 2023-08-17T00:03:17.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.838+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61f8154280 con 0x7f61f80639a0 2023-08-17T00:03:17.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61e67fc700 1 -- 172.21.15.153:0/834308877 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f61e804a670 con 0x7f61f80639a0 2023-08-17T00:03:17.845 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f61d805a150 msgr2=0x7f61d805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f61d805a150 0x7f61d805c610 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f61ec009fd0 tx=0x7f61ec017000).stop 2023-08-17T00:03:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 msgr2=0x7f61f81587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 0x7f61f81587f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f61e800c4c0 tx=0x7f61e8007db0).stop 2023-08-17T00:03:17.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 shutdown_connections 2023-08-17T00:03:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f61d805a150 0x7f61d805c610 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61f80c43e0 0x7f61f80c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f61f80acf30 0x7f61f8158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 --2- 172.21.15.153:0/834308877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f61f80639a0 0x7f61f81587f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 >> 172.21.15.153:0/834308877 conn(0x7f61f80cb330 msgr2=0x7f61f8152540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 shutdown_connections 2023-08-17T00:03:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:17.842+0000 7f61f759e700 1 -- 172.21.15.153:0/834308877 wait complete. 2023-08-17T00:03:17.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:18.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.022+0000 7fd2e359e700 1 Processor -- start 2023-08-17T00:03:18.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.022+0000 7fd2e359e700 1 -- start start 2023-08-17T00:03:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2e40c57a0 0x7fd2e40c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd2e40c11b0 0x7fd2e4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e359e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e40bfd10 con 0x7fd2e4153f50 2023-08-17T00:03:18.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4154860 con 0x7fd2e40c57a0 2023-08-17T00:03:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4154af0 con 0x7fd2e40c11b0 2023-08-17T00:03:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2e40c57a0 0x7fd2e40c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2e40c57a0 0x7fd2e40c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42210/0 (socket says 172.21.15.153:42210) 2023-08-17T00:03:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e259c700 1 -- 172.21.15.153:0/3202173387 learned_addr learned my addr 172.21.15.153:0/3202173387 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:18.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.026+0000 7fd2e2d9d700 1 --2- 172.21.15.153:0/3202173387 >> v2:172.21.15.178:3300/0 conn(0x7fd2e40c11b0 0x7fd2e4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e259c700 1 -- 172.21.15.153:0/3202173387 >> v2:172.21.15.178:3300/0 conn(0x7fd2e40c11b0 msgr2=0x7fd2e4154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:18.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e259c700 1 --2- 172.21.15.153:0/3202173387 >> v2:172.21.15.178:3300/0 conn(0x7fd2e40c11b0 0x7fd2e4154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e259c700 1 -- 172.21.15.153:0/3202173387 >> v1:172.21.15.178:6789/0 conn(0x7fd2e4153f50 legacy=0x7fd2e4157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e259c700 1 -- 172.21.15.153:0/3202173387 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4154dd0 con 0x7fd2e40c57a0 2023-08-17T00:03:18.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e259c700 1 --2- 172.21.15.153:0/3202173387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c57a0 0x7fd2e40c5b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd2e406a440 tx=0x7fd2d40090f0).ready entity=mon.0 client_cookie=edc390334d55cf69 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e159a700 1 -- 172.21.15.153:0/3202173387 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400b520 con 0x7fd2e40c57a0 2023-08-17T00:03:18.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e159a700 1 -- 172.21.15.153:0/3202173387 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400b680 con 0x7fd2e40c57a0 2023-08-17T00:03:18.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e159a700 1 -- 172.21.15.153:0/3202173387 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400ba00 con 0x7fd2e40c57a0 2023-08-17T00:03:18.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 -- 172.21.15.153:0/3202173387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c57a0 msgr2=0x7fd2e40c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 --2- 172.21.15.153:0/3202173387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c57a0 0x7fd2e40c5b80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd2e406a440 tx=0x7fd2d40090f0).stop 2023-08-17T00:03:18.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 -- 172.21.15.153:0/3202173387 shutdown_connections 2023-08-17T00:03:18.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 --2- 172.21.15.153:0/3202173387 >> v2:172.21.15.178:3300/0 conn(0x7fd2e40c11b0 0x7fd2e4154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 --2- 172.21.15.153:0/3202173387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c57a0 0x7fd2e40c5b80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 -- 172.21.15.153:0/3202173387 >> 172.21.15.153:0/3202173387 conn(0x7fd2e4062a70 msgr2=0x7fd2e40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:18.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 -- 172.21.15.153:0/3202173387 shutdown_connections 2023-08-17T00:03:18.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.030+0000 7fd2e359e700 1 -- 172.21.15.153:0/3202173387 wait complete. 2023-08-17T00:03:18.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 Processor -- start 2023-08-17T00:03:18.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 -- start start 2023-08-17T00:03:18.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 0x7fd2e4167130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2e40c57a0 0x7fd2e4150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2e4153f50 0x7fd2e4155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4166090 con 0x7fd2e40c11b0 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4166370 con 0x7fd2e4153f50 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4166650 con 0x7fd2e40c57a0 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 0x7fd2e4167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 0x7fd2e4167130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42226/0 (socket says 172.21.15.153:42226) 2023-08-17T00:03:18.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 -- 172.21.15.153:0/2394982150 learned_addr learned my addr 172.21.15.153:0/2394982150 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:18.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e2d9d700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2e4153f50 0x7fd2e4155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e1d9b700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2e40c57a0 0x7fd2e4150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 -- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2e40c57a0 msgr2=0x7fd2e4150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2e40c57a0 0x7fd2e4150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 -- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2e4153f50 msgr2=0x7fd2e4155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2e4153f50 0x7fd2e4155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.034+0000 7fd2e259c700 1 -- 172.21.15.153:0/2394982150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d4009370 con 0x7fd2e40c11b0 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2e259c700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 0x7fd2e4167130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd2d4009130 tx=0x7fd2d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4000bc0 con 0x7fd2e40c11b0 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400b7f0 con 0x7fd2e40c11b0 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e4166930 con 0x7fd2e40c11b0 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d4000d20 con 0x7fd2e40c11b0 2023-08-17T00:03:18.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e4151230 con 0x7fd2e40c11b0 2023-08-17T00:03:18.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e4151510 con 0x7fd2e40c11b0 2023-08-17T00:03:18.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.038+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd2d402c070 con 0x7fd2e40c11b0 2023-08-17T00:03:18.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.042+0000 7fd2d27fc700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2c405a150 0x7fd2c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.042+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2d4075d70 con 0x7fd2e40c11b0 2023-08-17T00:03:18.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.042+0000 7fd2e1d9b700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2c405a150 0x7fd2c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.042+0000 7fd2e1d9b700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2c405a150 0x7fd2c405c610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd2d80036d0 tx=0x7fd2d8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.046+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd2d4049710 con 0x7fd2e40c11b0 2023-08-17T00:03:18.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.206+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2e406b4c0 con 0x7fd2e40c11b0 2023-08-17T00:03:18.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.210+0000 7fd2d27fc700 1 -- 172.21.15.153:0/2394982150 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2d402a070 con 0x7fd2e40c11b0 2023-08-17T00:03:18.214 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:18.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2c405a150 msgr2=0x7fd2c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2c405a150 0x7fd2c405c610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fd2d80036d0 tx=0x7fd2d8009040).stop 2023-08-17T00:03:18.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 msgr2=0x7fd2e4167130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 0x7fd2e4167130 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd2d4009130 tx=0x7fd2d4017000).stop 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 shutdown_connections 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2c405a150 0x7fd2c405c610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2e4153f50 0x7fd2e4155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2e40c57a0 0x7fd2e4150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 --2- 172.21.15.153:0/2394982150 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2e40c11b0 0x7fd2e4167130 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 >> 172.21.15.153:0/2394982150 conn(0x7fd2e4062a70 msgr2=0x7fd2e4063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:18.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 shutdown_connections 2023-08-17T00:03:18.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.214+0000 7fd2e359e700 1 -- 172.21.15.153:0/2394982150 wait complete. 2023-08-17T00:03:18.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:18.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.386+0000 7fb63d09b700 1 Processor -- start 2023-08-17T00:03:18.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.386+0000 7fb63d09b700 1 -- start start 2023-08-17T00:03:18.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb638151b90 0x7fb638151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb638064870 0x7fb638064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb638061fa0 con 0x7fb638063290 2023-08-17T00:03:18.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380c3fb0 con 0x7fb638151b90 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb638152460 con 0x7fb638064870 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb638151b90 0x7fb638151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb638151b90 0x7fb638151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42228/0 (socket says 172.21.15.153:42228) 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 -- 172.21.15.153:0/3892913766 learned_addr learned my addr 172.21.15.153:0/3892913766 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63759e700 1 --2- 172.21.15.153:0/3892913766 >> v2:172.21.15.178:3300/0 conn(0x7fb638064870 0x7fb638064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 -- 172.21.15.153:0/3892913766 >> v2:172.21.15.178:3300/0 conn(0x7fb638064870 msgr2=0x7fb638064cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:18.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 --2- 172.21.15.153:0/3892913766 >> v2:172.21.15.178:3300/0 conn(0x7fb638064870 0x7fb638064cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 -- 172.21.15.153:0/3892913766 >> v1:172.21.15.153:6789/0 conn(0x7fb638063290 legacy=0x7fb638065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63659c700 1 -- 172.21.15.153:0/3892913766 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251626560 0 0) 0x7fb638061fa0 con 0x7fb638063290 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 -- 172.21.15.153:0/3892913766 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380651b0 con 0x7fb638151b90 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb636d9d700 1 --2- 172.21.15.153:0/3892913766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb638151f70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb6380bd6b0 tx=0x7fb6280090f0).ready entity=mon.0 client_cookie=6bbe9b762ea808df server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63659c700 1 -- 172.21.15.153:0/3892913766 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800b520 con 0x7fb638151b90 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63659c700 1 -- 172.21.15.153:0/3892913766 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800b680 con 0x7fb638151b90 2023-08-17T00:03:18.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63659c700 1 -- 172.21.15.153:0/3892913766 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800ba00 con 0x7fb638151b90 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- 172.21.15.153:0/3892913766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 msgr2=0x7fb638151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 --2- 172.21.15.153:0/3892913766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb638151f70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7fb6380bd6b0 tx=0x7fb6280090f0).stop 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- 172.21.15.153:0/3892913766 shutdown_connections 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 --2- 172.21.15.153:0/3892913766 >> v2:172.21.15.178:3300/0 conn(0x7fb638064870 0x7fb638064cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 --2- 172.21.15.153:0/3892913766 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb638151f70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- 172.21.15.153:0/3892913766 >> 172.21.15.153:0/3892913766 conn(0x7fb6380c7150 msgr2=0x7fb6380c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:18.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- 172.21.15.153:0/3892913766 shutdown_connections 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.390+0000 7fb63d09b700 1 -- 172.21.15.153:0/3892913766 wait complete. 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 Processor -- start 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 -- start start 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb638063290 0x7fb638154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb638064870 0x7fb6380a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb6380c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6381685d0 con 0x7fb638151b90 2023-08-17T00:03:18.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb638154b30 con 0x7fb638063290 2023-08-17T00:03:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63d09b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb638167ca0 con 0x7fb638064870 2023-08-17T00:03:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb6380c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb6380c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42232/0 (socket says 172.21.15.153:42232) 2023-08-17T00:03:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb63759e700 1 -- 172.21.15.153:0/997623892 learned_addr learned my addr 172.21.15.153:0/997623892 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb62ffff700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb638064870 0x7fb6380a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.394+0000 7fb636d9d700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb638063290 0x7fb638154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63759e700 1 -- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb638064870 msgr2=0x7fb6380a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63759e700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb638064870 0x7fb6380a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63759e700 1 -- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb638063290 msgr2=0x7fb638154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63759e700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb638063290 0x7fb638154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63759e700 1 -- 172.21.15.153:0/997623892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb628009370 con 0x7fb638151b90 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb636d9d700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb638063290 0x7fb638154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63759e700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb6380c2710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb630009e90 tx=0x7fb63000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000cc20 con 0x7fb638151b90 2023-08-17T00:03:18.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000f040 con 0x7fb638151b90 2023-08-17T00:03:18.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb638167f80 con 0x7fb638151b90 2023-08-17T00:03:18.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb630013400 con 0x7fb638151b90 2023-08-17T00:03:18.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6380a5cb0 con 0x7fb638151b90 2023-08-17T00:03:18.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb638168780 con 0x7fb638151b90 2023-08-17T00:03:18.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.398+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb6300137b0 con 0x7fb638151b90 2023-08-17T00:03:18.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.402+0000 7fb62effd700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb61805a150 0x7fb61805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.402+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb630074c40 con 0x7fb638151b90 2023-08-17T00:03:18.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.402+0000 7fb636d9d700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb61805a150 0x7fb61805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.402+0000 7fb636d9d700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb61805a150 0x7fb61805c610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb62800b2e0 tx=0x7fb628017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.406+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb638168780 con 0x7fb638151b90 2023-08-17T00:03:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.562+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb63806b530 con 0x7fb638151b90 2023-08-17T00:03:18.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.566+0000 7fb62effd700 1 -- 172.21.15.153:0/997623892 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb63004c010 con 0x7fb638151b90 2023-08-17T00:03:18.571 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:18.572 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb61805a150 msgr2=0x7fb61805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb61805a150 0x7fb61805c610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb62800b2e0 tx=0x7fb628017000).stop 2023-08-17T00:03:18.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 msgr2=0x7fb6380c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb6380c2710 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fb630009e90 tx=0x7fb63000b040).stop 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 shutdown_connections 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb61805a150 0x7fb61805c610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb638151b90 0x7fb6380c2710 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb638064870 0x7fb6380a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 --2- 172.21.15.153:0/997623892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb638063290 0x7fb638154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 >> 172.21.15.153:0/997623892 conn(0x7fb6380c7150 msgr2=0x7fb638068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 shutdown_connections 2023-08-17T00:03:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.570+0000 7fb63d09b700 1 -- 172.21.15.153:0/997623892 wait complete. 2023-08-17T00:03:18.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:18.596 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.754+0000 7fb3c9f69700 1 Processor -- start 2023-08-17T00:03:18.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.754+0000 7fb3c9f69700 1 -- start start 2023-08-17T00:03:18.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.754+0000 7fb3c9f69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3c4153d50 0x7fb3c40632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c9f69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c4065240 con 0x7fb3c4154130 2023-08-17T00:03:18.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c9f69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c4063880 con 0x7fb3c40656d0 2023-08-17T00:03:18.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c9f69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c4064910 con 0x7fb3c4153d50 2023-08-17T00:03:18.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb3c4154130 0x7fb3c40629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47242/0 (socket says 172.21.15.153:47242) 2023-08-17T00:03:18.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c2ffd700 1 -- 172.21.15.153:0/4174111969 learned_addr learned my addr 172.21.15.153:0/4174111969 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:18.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c37fe700 1 --2- 172.21.15.153:0/4174111969 >> v2:172.21.15.178:3300/0 conn(0x7fb3c4153d50 0x7fb3c40632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c27fc700 1 -- 172.21.15.153:0/4174111969 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894035566 0 0) 0x7fb3c4065240 con 0x7fb3c4154130 2023-08-17T00:03:18.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c27fc700 1 -- 172.21.15.153:0/4174111969 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3ac0033f0 con 0x7fb3c4154130 2023-08-17T00:03:18.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c27fc700 1 -- 172.21.15.153:0/4174111969 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 489457128 0 0) 0x7fb3ac0033f0 con 0x7fb3c4154130 2023-08-17T00:03:18.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c37fe700 1 -- 172.21.15.153:0/4174111969 >> v1:172.21.15.178:6789/0 conn(0x7fb3c40656d0 legacy=0x7fb3c40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c37fe700 1 -- 172.21.15.153:0/4174111969 >> v1:172.21.15.153:6789/0 conn(0x7fb3c4154130 legacy=0x7fb3c40629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c37fe700 1 -- 172.21.15.153:0/4174111969 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4064bf0 con 0x7fb3c4153d50 2023-08-17T00:03:18.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c37fe700 1 --2- 172.21.15.153:0/4174111969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c4153d50 0x7fb3c40632e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb3b4009760 tx=0x7fb3b4009060).ready entity=mon.1 client_cookie=ebad85d6eba97908 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c27fc700 1 -- 172.21.15.153:0/4174111969 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8001470 con 0x7fb3c4153d50 2023-08-17T00:03:18.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c27fc700 1 -- 172.21.15.153:0/4174111969 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b4009130 con 0x7fb3c4153d50 2023-08-17T00:03:18.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c27fc700 1 -- 172.21.15.153:0/4174111969 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4011610 con 0x7fb3c4153d50 2023-08-17T00:03:18.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c9f69700 1 -- 172.21.15.153:0/4174111969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c4153d50 msgr2=0x7fb3c40632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.758+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/4174111969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c4153d50 0x7fb3c40632e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fb3b4009760 tx=0x7fb3b4009060).stop 2023-08-17T00:03:18.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 -- 172.21.15.153:0/4174111969 shutdown_connections 2023-08-17T00:03:18.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/4174111969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c4153d50 0x7fb3c40632e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 -- 172.21.15.153:0/4174111969 >> 172.21.15.153:0/4174111969 conn(0x7fb3c40c7150 msgr2=0x7fb3c40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:18.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 -- 172.21.15.153:0/4174111969 shutdown_connections 2023-08-17T00:03:18.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 -- 172.21.15.153:0/4174111969 wait complete. 2023-08-17T00:03:18.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 Processor -- start 2023-08-17T00:03:18.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.762+0000 7fb3c9f69700 1 -- start start 2023-08-17T00:03:18.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c40656d0 0x7fb3c4149690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3c4153d50 0x7fb3c40a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 0x7fb3c40a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40aa6a0 con 0x7fb3c4154130 2023-08-17T00:03:18.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40a9b80 con 0x7fb3c40656d0 2023-08-17T00:03:18.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c40a9e00 con 0x7fb3c4153d50 2023-08-17T00:03:18.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 0x7fb3c40a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c2ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3c4153d50 0x7fb3c40a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 0x7fb3c40a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42236/0 (socket says 172.21.15.153:42236) 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 -- 172.21.15.153:0/1938600079 learned_addr learned my addr 172.21.15.153:0/1938600079 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c37fe700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c40656d0 0x7fb3c4149690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 -- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3c4153d50 msgr2=0x7fb3c40a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3c4153d50 0x7fb3c40a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 -- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c40656d0 msgr2=0x7fb3c4149690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c40656d0 0x7fb3c4149690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 -- 172.21.15.153:0/1938600079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b40092a0 con 0x7fb3c4154130 2023-08-17T00:03:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c3fff700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 0x7fb3c40a9690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb3bc00c790 tx=0x7fb3bc0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00e4a0 con 0x7fb3c4154130 2023-08-17T00:03:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00e600 con 0x7fb3c4154130 2023-08-17T00:03:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00e980 con 0x7fb3c4154130 2023-08-17T00:03:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c40aa0e0 con 0x7fb3c4154130 2023-08-17T00:03:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.766+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c4155580 con 0x7fb3c4154130 2023-08-17T00:03:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.770+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c41577c0 con 0x7fb3c4154130 2023-08-17T00:03:18.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.770+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb3bc019030 con 0x7fb3c4154130 2023-08-17T00:03:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.770+0000 7fb3ab7fe700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3b005a150 0x7fb3b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.770+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb3bc073690 con 0x7fb3c4154130 2023-08-17T00:03:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.774+0000 7fb3c37fe700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3b005a150 0x7fb3b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.774+0000 7fb3c37fe700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3b005a150 0x7fb3b005c610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb3b4000e50 tx=0x7fb3b4014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.778+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3bc0471f0 con 0x7fb3c4154130 2023-08-17T00:03:18.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.938+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb3c4155790 con 0x7fb3c4154130 2023-08-17T00:03:18.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.938+0000 7fb3ab7fe700 1 -- 172.21.15.153:0/1938600079 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb3bc04a810 con 0x7fb3c4154130 2023-08-17T00:03:18.945 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:18.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3b005a150 msgr2=0x7fb3b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3b005a150 0x7fb3b005c610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fb3b4000e50 tx=0x7fb3b4014000).stop 2023-08-17T00:03:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 msgr2=0x7fb3c40a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:18.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 0x7fb3c40a9690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb3bc00c790 tx=0x7fb3bc0015e0).stop 2023-08-17T00:03:18.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 shutdown_connections 2023-08-17T00:03:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3b005a150 0x7fb3b005c610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3c4154130 0x7fb3c40a9690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3c4153d50 0x7fb3c40a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 --2- 172.21.15.153:0/1938600079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3c40656d0 0x7fb3c4149690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:18.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 >> 172.21.15.153:0/1938600079 conn(0x7fb3c40c7150 msgr2=0x7fb3c4068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:18.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 shutdown_connections 2023-08-17T00:03:18.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:18.942+0000 7fb3c9f69700 1 -- 172.21.15.153:0/1938600079 wait complete. 2023-08-17T00:03:18.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:19.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7dca39700 1 Processor -- start 2023-08-17T00:03:19.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7dca39700 1 -- start start 2023-08-17T00:03:19.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7dca39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7d8154370 0x7fb7d80c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7dca39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80bfd10 con 0x7fb7d8153f50 2023-08-17T00:03:19.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7dca39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d8154af0 con 0x7fb7d80c57a0 2023-08-17T00:03:19.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7dca39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d8154dd0 con 0x7fb7d8154370 2023-08-17T00:03:19.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7d7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7d8154370 0x7fb7d80c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7d7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb7d8154370 0x7fb7d80c08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42248/0 (socket says 172.21.15.153:42248) 2023-08-17T00:03:19.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7d7fff700 1 -- 172.21.15.153:0/3485133084 learned_addr learned my addr 172.21.15.153:0/3485133084 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:19.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.122+0000 7fb7d6ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb7d8153f50 0x7fb7d80c01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47246/0 (socket says 172.21.15.153:47246) 2023-08-17T00:03:19.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d7fff700 1 -- 172.21.15.153:0/3485133084 >> v1:172.21.15.178:6789/0 conn(0x7fb7d80c57a0 legacy=0x7fb7d80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d7fff700 1 -- 172.21.15.153:0/3485133084 >> v1:172.21.15.153:6789/0 conn(0x7fb7d8153f50 legacy=0x7fb7d80c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d67fc700 1 -- 172.21.15.153:0/3485133084 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098683384 0 0) 0x7fb7d80bfd10 con 0x7fb7d8153f50 2023-08-17T00:03:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d7fff700 1 -- 172.21.15.153:0/3485133084 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80bf9a0 con 0x7fb7d8154370 2023-08-17T00:03:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d7fff700 1 --2- 172.21.15.153:0/3485133084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8154370 0x7fb7d80c08b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb7d0009f20 tx=0x7fb7d0009840).ready entity=mon.0 client_cookie=cfa2709a2496bffc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d67fc700 1 -- 172.21.15.153:0/3485133084 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000e070 con 0x7fb7d8154370 2023-08-17T00:03:19.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d67fc700 1 -- 172.21.15.153:0/3485133084 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000ba80 con 0x7fb7d8154370 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7d67fc700 1 -- 172.21.15.153:0/3485133084 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000be00 con 0x7fb7d8154370 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 -- 172.21.15.153:0/3485133084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8154370 msgr2=0x7fb7d80c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 --2- 172.21.15.153:0/3485133084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8154370 0x7fb7d80c08b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb7d0009f20 tx=0x7fb7d0009840).stop 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 -- 172.21.15.153:0/3485133084 shutdown_connections 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 --2- 172.21.15.153:0/3485133084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8154370 0x7fb7d80c08b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 -- 172.21.15.153:0/3485133084 >> 172.21.15.153:0/3485133084 conn(0x7fb7d8062a70 msgr2=0x7fb7d80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:19.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 -- 172.21.15.153:0/3485133084 shutdown_connections 2023-08-17T00:03:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.126+0000 7fb7dca39700 1 -- 172.21.15.153:0/3485133084 wait complete. 2023-08-17T00:03:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 Processor -- start 2023-08-17T00:03:19.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 -- start start 2023-08-17T00:03:19.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7d80c57a0 0x7fb7d80b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 0x7fb7d815a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7d8154370 0x7fb7d81451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80b07e0 con 0x7fb7d8153f50 2023-08-17T00:03:19.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d815adc0 con 0x7fb7d80c57a0 2023-08-17T00:03:19.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.130+0000 7fb7dca39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8155cc0 con 0x7fb7d8154370 2023-08-17T00:03:19.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 0x7fb7d815a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 0x7fb7d815a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42252/0 (socket says 172.21.15.153:42252) 2023-08-17T00:03:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 -- 172.21.15.153:0/4110918490 learned_addr learned my addr 172.21.15.153:0/4110918490 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d7fff700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7d8154370 0x7fb7d81451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d77fe700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7d80c57a0 0x7fb7d80b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 -- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7d8154370 msgr2=0x7fb7d81451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7d8154370 0x7fb7d81451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 -- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7d80c57a0 msgr2=0x7fb7d80b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7d80c57a0 0x7fb7d80b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 -- 172.21.15.153:0/4110918490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d0009ae0 con 0x7fb7d8153f50 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d77fe700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7d80c57a0 0x7fb7d80b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7d6ffd700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 0x7fb7d815a8d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fb7cc00c4c0 tx=0x7fb7cc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0072e0 con 0x7fb7d8153f50 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc007440 con 0x7fb7d8153f50 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8155fa0 con 0x7fb7d8153f50 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc005930 con 0x7fb7d8153f50 2023-08-17T00:03:19.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.134+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d8156560 con 0x7fb7d8153f50 2023-08-17T00:03:19.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.138+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d8156780 con 0x7fb7d8153f50 2023-08-17T00:03:19.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.138+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb7cc010070 con 0x7fb7d8153f50 2023-08-17T00:03:19.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.138+0000 7fb7bf7fe700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb7c405a180 0x7fb7c405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.138+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb7cc073890 con 0x7fb7d8153f50 2023-08-17T00:03:19.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.138+0000 7fb7d77fe700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb7c405a180 0x7fb7c405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.142+0000 7fb7d77fe700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb7c405a180 0x7fb7c405c640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb7c8001670 tx=0x7fb7c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.142+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7cc047230 con 0x7fb7d8153f50 2023-08-17T00:03:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.302+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb7d806b4c0 con 0x7fb7d8153f50 2023-08-17T00:03:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.302+0000 7fb7bf7fe700 1 -- 172.21.15.153:0/4110918490 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb7cc007d50 con 0x7fb7d8153f50 2023-08-17T00:03:19.309 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.306+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb7c405a180 msgr2=0x7fb7c405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.306+0000 7fb7dca39700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb7c405a180 0x7fb7c405c640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb7c8001670 tx=0x7fb7c8009040).stop 2023-08-17T00:03:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.306+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 msgr2=0x7fb7d815a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.306+0000 7fb7dca39700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 0x7fb7d815a8d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fb7cc00c4c0 tx=0x7fb7cc007c10).stop 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 shutdown_connections 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb7c405a180 0x7fb7c405c640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7d8154370 0x7fb7d81451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7d8153f50 0x7fb7d815a8d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 --2- 172.21.15.153:0/4110918490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7d80c57a0 0x7fb7d80b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 >> 172.21.15.153:0/4110918490 conn(0x7fb7d8062a70 msgr2=0x7fb7d8063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 shutdown_connections 2023-08-17T00:03:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.310+0000 7fb7dca39700 1 -- 172.21.15.153:0/4110918490 wait complete. 2023-08-17T00:03:19.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:19.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 Processor -- start 2023-08-17T00:03:19.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 -- start start 2023-08-17T00:03:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e10151f70 0x7f1e10065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e10065b50 0x7f1e10064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e10061fa0 con 0x7f1e10151b90 2023-08-17T00:03:19.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e100c3fb0 con 0x7f1e10065b50 2023-08-17T00:03:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e183a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e101523d0 con 0x7f1e10151f70 2023-08-17T00:03:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e16946700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e10065b50 0x7f1e10064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e16946700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e10065b50 0x7f1e10064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42262/0 (socket says 172.21.15.153:42262) 2023-08-17T00:03:19.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.486+0000 7f1e16946700 1 -- 172.21.15.153:0/2037241555 learned_addr learned my addr 172.21.15.153:0/2037241555 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:19.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e16946700 1 -- 172.21.15.153:0/2037241555 >> v2:172.21.15.178:3300/0 conn(0x7f1e10151f70 msgr2=0x7f1e10065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:19.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e16946700 1 --2- 172.21.15.153:0/2037241555 >> v2:172.21.15.178:3300/0 conn(0x7f1e10151f70 0x7f1e10065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:19.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e16946700 1 -- 172.21.15.153:0/2037241555 >> v1:172.21.15.153:6789/0 conn(0x7f1e10151b90 legacy=0x7f1e10063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e16946700 1 -- 172.21.15.153:0/2037241555 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e100621f0 con 0x7f1e10065b50 2023-08-17T00:03:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e16946700 1 --2- 172.21.15.153:0/2037241555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10065b50 0x7f1e10064870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1e1005ebc0 tx=0x7f1e080090f0).ready entity=mon.0 client_cookie=5bd6137d17dc3f94 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e15143700 1 -- 172.21.15.153:0/2037241555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800b600 con 0x7f1e10065b50 2023-08-17T00:03:19.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e15143700 1 -- 172.21.15.153:0/2037241555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0800b760 con 0x7f1e10065b50 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e15143700 1 -- 172.21.15.153:0/2037241555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0800bae0 con 0x7f1e10065b50 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 -- 172.21.15.153:0/2037241555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10065b50 msgr2=0x7f1e10064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2037241555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10065b50 0x7f1e10064870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f1e1005ebc0 tx=0x7f1e080090f0).stop 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 -- 172.21.15.153:0/2037241555 shutdown_connections 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2037241555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10065b50 0x7f1e10064870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2037241555 >> v2:172.21.15.178:3300/0 conn(0x7f1e10151f70 0x7f1e10065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 -- 172.21.15.153:0/2037241555 >> 172.21.15.153:0/2037241555 conn(0x7f1e100c7150 msgr2=0x7f1e100c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 -- 172.21.15.153:0/2037241555 shutdown_connections 2023-08-17T00:03:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.490+0000 7f1e183a9700 1 -- 172.21.15.153:0/2037241555 wait complete. 2023-08-17T00:03:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 Processor -- start 2023-08-17T00:03:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 -- start start 2023-08-17T00:03:19.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e10065b50 0x7f1e10162380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 0x7f1e10154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e10151f70 0x7f1e10163490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10163320 con 0x7f1e10151b90 2023-08-17T00:03:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10162d60 con 0x7f1e10065b50 2023-08-17T00:03:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e183a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e10163040 con 0x7f1e10151f70 2023-08-17T00:03:19.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 0x7f1e10154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 0x7f1e10154c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42270/0 (socket says 172.21.15.153:42270) 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 -- 172.21.15.153:0/2241274707 learned_addr learned my addr 172.21.15.153:0/2241274707 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e16946700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e10151f70 0x7f1e10163490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e16145700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e10065b50 0x7f1e10162380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 -- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e10151f70 msgr2=0x7f1e10163490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e10151f70 0x7f1e10163490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 -- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e10065b50 msgr2=0x7f1e10162380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e10065b50 0x7f1e10162380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.494+0000 7f1e15944700 1 -- 172.21.15.153:0/2241274707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08009370 con 0x7f1e10151b90 2023-08-17T00:03:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e15944700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 0x7f1e10154c60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f1e0000b490 tx=0x7f1e00009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00002320 con 0x7f1e10151b90 2023-08-17T00:03:19.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1014d610 con 0x7f1e10151b90 2023-08-17T00:03:19.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00002480 con 0x7f1e10151b90 2023-08-17T00:03:19.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00002840 con 0x7f1e10151b90 2023-08-17T00:03:19.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e10148990 con 0x7f1e10151b90 2023-08-17T00:03:19.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1014d470 con 0x7f1e10151b90 2023-08-17T00:03:19.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.498+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1e0000f030 con 0x7f1e10151b90 2023-08-17T00:03:19.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.502+0000 7f1e067fc700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1df405a150 0x7f1df405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.502+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e00073e30 con 0x7f1e10151b90 2023-08-17T00:03:19.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.502+0000 7f1e16145700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1df405a150 0x7f1df405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.502+0000 7f1e16145700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1df405a150 0x7f1df405c610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1e0c003e70 tx=0x7f1e0c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.510+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e1014d470 con 0x7f1e10151b90 2023-08-17T00:03:19.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.670+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e1014d470 con 0x7f1e10151b90 2023-08-17T00:03:19.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.670+0000 7f1e067fc700 1 -- 172.21.15.153:0/2241274707 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e1014d470 con 0x7f1e10151b90 2023-08-17T00:03:19.677 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1df405a150 msgr2=0x7f1df405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1df405a150 0x7f1df405c610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f1e0c003e70 tx=0x7f1e0c009040).stop 2023-08-17T00:03:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 msgr2=0x7f1e10154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 0x7f1e10154c60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f1e0000b490 tx=0x7f1e00009060).stop 2023-08-17T00:03:19.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 shutdown_connections 2023-08-17T00:03:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1df405a150 0x7f1df405c610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e10151f70 0x7f1e10163490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e10151b90 0x7f1e10154c60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 --2- 172.21.15.153:0/2241274707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e10065b50 0x7f1e10162380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 >> 172.21.15.153:0/2241274707 conn(0x7f1e100c7150 msgr2=0x7f1e1014f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:19.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 shutdown_connections 2023-08-17T00:03:19.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.674+0000 7f1e183a9700 1 -- 172.21.15.153:0/2241274707 wait complete. 2023-08-17T00:03:19.702 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:19.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.854+0000 7fc25481a700 1 Processor -- start 2023-08-17T00:03:19.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.854+0000 7fc25481a700 1 -- start start 2023-08-17T00:03:19.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc25481a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2500acf30 0x7fc2500c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc25481a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2500c5ea0 0x7fc2500634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc25481a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500639a0 0x7fc250157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc25481a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc250154e90 con 0x7fc2500acf30 2023-08-17T00:03:19.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc25481a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc250063df0 con 0x7fc2500c5ea0 2023-08-17T00:03:19.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc25481a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc250153fc0 con 0x7fc2500639a0 2023-08-17T00:03:19.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2500acf30 0x7fc2500c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc2500acf30 0x7fc2500c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42278/0 (socket says 172.21.15.153:42278) 2023-08-17T00:03:19.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 -- 172.21.15.153:0/3755791317 learned_addr learned my addr 172.21.15.153:0/3755791317 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:19.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24f59e700 1 --2- 172.21.15.153:0/3755791317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500639a0 0x7fc250157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24e59c700 1 --2- 172.21.15.153:0/3755791317 >> v2:172.21.15.178:3300/0 conn(0x7fc2500c5ea0 0x7fc2500634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 -- 172.21.15.153:0/3755791317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500639a0 msgr2=0x7fc250157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:19.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/3755791317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500639a0 0x7fc250157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 -- 172.21.15.153:0/3755791317 >> v2:172.21.15.178:3300/0 conn(0x7fc2500c5ea0 msgr2=0x7fc2500634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:19.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/3755791317 >> v2:172.21.15.178:3300/0 conn(0x7fc2500c5ea0 0x7fc2500634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.858+0000 7fc24ed9d700 1 -- 172.21.15.153:0/3755791317 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc250154280 con 0x7fc2500acf30 2023-08-17T00:03:19.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/3755791317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2500acf30 0x7fc2500c1020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fc2500b0a60 tx=0x7fc2400090f0).ready entity=mon.0 client_cookie=83216c3d820f1454 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc24dd9b700 1 -- 172.21.15.153:0/3755791317 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000f510 con 0x7fc2500acf30 2023-08-17T00:03:19.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc24dd9b700 1 -- 172.21.15.153:0/3755791317 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24000f670 con 0x7fc2500acf30 2023-08-17T00:03:19.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc24dd9b700 1 -- 172.21.15.153:0/3755791317 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000fa10 con 0x7fc2500acf30 2023-08-17T00:03:19.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 -- 172.21.15.153:0/3755791317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2500acf30 msgr2=0x7fc2500c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 --2- 172.21.15.153:0/3755791317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2500acf30 0x7fc2500c1020 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fc2500b0a60 tx=0x7fc2400090f0).stop 2023-08-17T00:03:19.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 -- 172.21.15.153:0/3755791317 shutdown_connections 2023-08-17T00:03:19.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 --2- 172.21.15.153:0/3755791317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500639a0 0x7fc250157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 --2- 172.21.15.153:0/3755791317 >> v2:172.21.15.178:3300/0 conn(0x7fc2500c5ea0 0x7fc2500634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 --2- 172.21.15.153:0/3755791317 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2500acf30 0x7fc2500c1020 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 -- 172.21.15.153:0/3755791317 >> 172.21.15.153:0/3755791317 conn(0x7fc2500cb330 msgr2=0x7fc2500c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:19.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 -- 172.21.15.153:0/3755791317 shutdown_connections 2023-08-17T00:03:19.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.862+0000 7fc25481a700 1 -- 172.21.15.153:0/3755791317 wait complete. 2023-08-17T00:03:19.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.866+0000 7fc25481a700 1 Processor -- start 2023-08-17T00:03:19.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.866+0000 7fc25481a700 1 -- start start 2023-08-17T00:03:19.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2500639a0 0x7fc250150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500acf30 0x7fc2500af410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 0x7fc25014d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500ad840 con 0x7fc250166e50 2023-08-17T00:03:19.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500afc20 con 0x7fc2500639a0 2023-08-17T00:03:19.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500aff00 con 0x7fc2500acf30 2023-08-17T00:03:19.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 0x7fc25014d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 0x7fc25014d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42280/0 (socket says 172.21.15.153:42280) 2023-08-17T00:03:19.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 -- 172.21.15.153:0/2339485914 learned_addr learned my addr 172.21.15.153:0/2339485914 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:19.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2500639a0 0x7fc250150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24e59c700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500acf30 0x7fc2500af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 -- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500acf30 msgr2=0x7fc2500af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500acf30 0x7fc2500af410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 -- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2500639a0 msgr2=0x7fc250150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:19.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2500639a0 0x7fc250150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 -- 172.21.15.153:0/2339485914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc240009370 con 0x7fc250166e50 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2500639a0 0x7fc250150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc24f59e700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 0x7fc25014d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fc248009e90 tx=0x7fc24800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800cc20 con 0x7fc250166e50 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800f040 con 0x7fc250166e50 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2500b01e0 con 0x7fc250166e50 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248013400 con 0x7fc250166e50 2023-08-17T00:03:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2500af900 con 0x7fc250166e50 2023-08-17T00:03:19.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.870+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2500adc40 con 0x7fc250166e50 2023-08-17T00:03:19.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.874+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc2480137b0 con 0x7fc250166e50 2023-08-17T00:03:19.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.874+0000 7fc236ffd700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc23c05a150 0x7fc23c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:19.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.874+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc248074be0 con 0x7fc250166e50 2023-08-17T00:03:19.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.874+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc23c05a150 0x7fc23c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:19.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.878+0000 7fc24ed9d700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc23c05a150 0x7fc23c05c610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc2500b0a60 tx=0x7fc240016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:19.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:19.882+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc248048580 con 0x7fc250166e50 2023-08-17T00:03:20.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.046+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2500b03d0 con 0x7fc250166e50 2023-08-17T00:03:20.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.046+0000 7fc236ffd700 1 -- 172.21.15.153:0/2339485914 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc24804bba0 con 0x7fc250166e50 2023-08-17T00:03:20.052 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:20.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc23c05a150 msgr2=0x7fc23c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc23c05a150 0x7fc23c05c610 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fc2500b0a60 tx=0x7fc240016000).stop 2023-08-17T00:03:20.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 msgr2=0x7fc25014d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 0x7fc25014d3f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7fc248009e90 tx=0x7fc24800b040).stop 2023-08-17T00:03:20.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 shutdown_connections 2023-08-17T00:03:20.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc23c05a150 0x7fc23c05c610 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc250166e50 0x7fc25014d3f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2500acf30 0x7fc2500af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 --2- 172.21.15.153:0/2339485914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc2500639a0 0x7fc250150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 >> 172.21.15.153:0/2339485914 conn(0x7fc2500cb330 msgr2=0x7fc2501534d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:20.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 shutdown_connections 2023-08-17T00:03:20.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.050+0000 7fc25481a700 1 -- 172.21.15.153:0/2339485914 wait complete. 2023-08-17T00:03:20.078 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:20.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.230+0000 7fb79ecf1700 1 Processor -- start 2023-08-17T00:03:20.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb79ecf1700 1 -- start start 2023-08-17T00:03:20.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb79ecf1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb798151f20 0x7fb7980c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb79ecf1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7980be4b0 0x7fb7980c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb79ecf1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7980c4f90 con 0x7fb798151b40 2023-08-17T00:03:20.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb79ecf1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7980aad60 con 0x7fb798151f20 2023-08-17T00:03:20.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb79ecf1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7980c40d0 con 0x7fb7980be4b0 2023-08-17T00:03:20.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.234+0000 7fb797fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb798151f20 0x7fb7980c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb798151f20 0x7fb7980c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42294/0 (socket says 172.21.15.153:42294) 2023-08-17T00:03:20.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 -- 172.21.15.153:0/2238217163 learned_addr learned my addr 172.21.15.153:0/2238217163 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:20.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79d28e700 1 --2- 172.21.15.153:0/2238217163 >> v2:172.21.15.178:3300/0 conn(0x7fb7980be4b0 0x7fb7980c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb7977fe700 1 -- 172.21.15.153:0/2238217163 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744846404 0 0) 0x7fb7980c4f90 con 0x7fb798151b40 2023-08-17T00:03:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb7977fe700 1 -- 172.21.15.153:0/2238217163 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7880033f0 con 0x7fb798151b40 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 -- 172.21.15.153:0/2238217163 >> v2:172.21.15.178:3300/0 conn(0x7fb7980be4b0 msgr2=0x7fb7980c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 --2- 172.21.15.153:0/2238217163 >> v2:172.21.15.178:3300/0 conn(0x7fb7980be4b0 0x7fb7980c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 -- 172.21.15.153:0/2238217163 >> v1:172.21.15.178:6789/0 conn(0x7fb798151b40 legacy=0x7fb7980bdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 -- 172.21.15.153:0/2238217163 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7980c4380 con 0x7fb798151f20 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb797fff700 1 --2- 172.21.15.153:0/2238217163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980c5a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb7980bda60 tx=0x7fb7840090f0).ready entity=mon.0 client_cookie=461695dcd13875ba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb7977fe700 1 -- 172.21.15.153:0/2238217163 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400f510 con 0x7fb798151f20 2023-08-17T00:03:20.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb7977fe700 1 -- 172.21.15.153:0/2238217163 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb78400f670 con 0x7fb798151f20 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb7977fe700 1 -- 172.21.15.153:0/2238217163 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78400fa10 con 0x7fb798151f20 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 -- 172.21.15.153:0/2238217163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 msgr2=0x7fb7980c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/2238217163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980c5a10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb7980bda60 tx=0x7fb7840090f0).stop 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 -- 172.21.15.153:0/2238217163 shutdown_connections 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/2238217163 >> v2:172.21.15.178:3300/0 conn(0x7fb7980be4b0 0x7fb7980c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/2238217163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980c5a10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 -- 172.21.15.153:0/2238217163 >> 172.21.15.153:0/2238217163 conn(0x7fb7980c92e0 msgr2=0x7fb7980c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:20.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 -- 172.21.15.153:0/2238217163 shutdown_connections 2023-08-17T00:03:20.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.238+0000 7fb79ecf1700 1 -- 172.21.15.153:0/2238217163 wait complete. 2023-08-17T00:03:20.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 Processor -- start 2023-08-17T00:03:20.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 -- start start 2023-08-17T00:03:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7980be4b0 0x7fb79813fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb798151b40 0x7fb79809fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798164de0 con 0x7fb798151f20 2023-08-17T00:03:20.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798165bd0 con 0x7fb7980be4b0 2023-08-17T00:03:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ecf1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb798164fc0 con 0x7fb798151b40 2023-08-17T00:03:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79d28e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79d28e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42306/0 (socket says 172.21.15.153:42306) 2023-08-17T00:03:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79d28e700 1 -- 172.21.15.153:0/27044760 learned_addr learned my addr 172.21.15.153:0/27044760 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:20.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb79ca8d700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7980be4b0 0x7fb79813fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.242+0000 7fb797fff700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb798151b40 0x7fb79809fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79d28e700 1 -- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb798151b40 msgr2=0x7fb79809fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79d28e700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb798151b40 0x7fb79809fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79d28e700 1 -- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7980be4b0 msgr2=0x7fb79813fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79d28e700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7980be4b0 0x7fb79813fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79d28e700 1 -- 172.21.15.153:0/27044760 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb784009370 con 0x7fb798151f20 2023-08-17T00:03:20.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79d28e700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980a9210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb790009ef0 tx=0x7fb79000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79000cc20 con 0x7fb798151f20 2023-08-17T00:03:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000f040 con 0x7fb798151f20 2023-08-17T00:03:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7981652a0 con 0x7fb798151f20 2023-08-17T00:03:20.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790013400 con 0x7fb798151f20 2023-08-17T00:03:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb798165860 con 0x7fb798151f20 2023-08-17T00:03:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.246+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb798165d60 con 0x7fb798151f20 2023-08-17T00:03:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.250+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb7900137b0 con 0x7fb798151f20 2023-08-17T00:03:20.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.250+0000 7fb794ff9700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb77c05a150 0x7fb77c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.250+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb790074b20 con 0x7fb798151f20 2023-08-17T00:03:20.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.250+0000 7fb79ca8d700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb77c05a150 0x7fb77c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.254+0000 7fb79ca8d700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb77c05a150 0x7fb77c05c610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb78c003930 tx=0x7fb78c007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.258+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb7900485d0 con 0x7fb798151f20 2023-08-17T00:03:20.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.418+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb79806b530 con 0x7fb798151f20 2023-08-17T00:03:20.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb794ff9700 1 -- 172.21.15.153:0/27044760 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fb79004bbf0 con 0x7fb798151f20 2023-08-17T00:03:20.426 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:20.427 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb77c05a150 msgr2=0x7fb77c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb77c05a150 0x7fb77c05c610 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb78c003930 tx=0x7fb78c007bd0).stop 2023-08-17T00:03:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 msgr2=0x7fb7980a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980a9210 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fb790009ef0 tx=0x7fb79000b040).stop 2023-08-17T00:03:20.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 shutdown_connections 2023-08-17T00:03:20.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb77c05a150 0x7fb77c05c610 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb798151f20 0x7fb7980a9210 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb798151b40 0x7fb79809fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 --2- 172.21.15.153:0/27044760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7980be4b0 0x7fb79813fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.422+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 >> 172.21.15.153:0/27044760 conn(0x7fb7980c92e0 msgr2=0x7fb798150f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.426+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 shutdown_connections 2023-08-17T00:03:20.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.426+0000 7fb79ecf1700 1 -- 172.21.15.153:0/27044760 wait complete. 2023-08-17T00:03:20.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:20.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:20.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.606+0000 7f16452ff700 1 Processor -- start 2023-08-17T00:03:20.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.606+0000 7f16452ff700 1 -- start start 2023-08-17T00:03:20.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f16452ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164015b460 0x7f16400bbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f16452ff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1640065f10 0x7f16400647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f16452ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1640066660 con 0x7f164015b080 2023-08-17T00:03:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f16452ff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16400bcea0 con 0x7f1640065f10 2023-08-17T00:03:20.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f16452ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400bc490 con 0x7f164015b460 2023-08-17T00:03:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1640065f10 0x7f16400647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1640065f10 0x7f16400647c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42310/0 (socket says 172.21.15.153:42310) 2023-08-17T00:03:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 -- 172.21.15.153:0/2791904042 learned_addr learned my addr 172.21.15.153:0/2791904042 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163e7fc700 1 --2- 172.21.15.153:0/2791904042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164015b460 0x7f16400bbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 -- 172.21.15.153:0/2791904042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164015b460 msgr2=0x7f16400bbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 --2- 172.21.15.153:0/2791904042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164015b460 0x7f16400bbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 -- 172.21.15.153:0/2791904042 >> v1:172.21.15.178:6789/0 conn(0x7f164015b080 legacy=0x7f16400c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 -- 172.21.15.153:0/2791904042 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1640062a00 con 0x7f1640065f10 2023-08-17T00:03:20.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163f7fe700 1 --2- 172.21.15.153:0/2791904042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1640065f10 0x7f16400647c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1638009f20 tx=0x7f1638009840).ready entity=mon.0 client_cookie=f2d55f12e157ffb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163dffb700 1 -- 172.21.15.153:0/2791904042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800e070 con 0x7f1640065f10 2023-08-17T00:03:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163dffb700 1 -- 172.21.15.153:0/2791904042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163800b9d0 con 0x7f1640065f10 2023-08-17T00:03:20.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.610+0000 7f163dffb700 1 -- 172.21.15.153:0/2791904042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163800bd50 con 0x7f1640065f10 2023-08-17T00:03:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 -- 172.21.15.153:0/2791904042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1640065f10 msgr2=0x7f16400647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 --2- 172.21.15.153:0/2791904042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1640065f10 0x7f16400647c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f1638009f20 tx=0x7f1638009840).stop 2023-08-17T00:03:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 -- 172.21.15.153:0/2791904042 shutdown_connections 2023-08-17T00:03:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 --2- 172.21.15.153:0/2791904042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1640065f10 0x7f16400647c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 --2- 172.21.15.153:0/2791904042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f164015b460 0x7f16400bbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 -- 172.21.15.153:0/2791904042 >> 172.21.15.153:0/2791904042 conn(0x7f16400c2fb0 msgr2=0x7f16400c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 -- 172.21.15.153:0/2791904042 shutdown_connections 2023-08-17T00:03:20.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 -- 172.21.15.153:0/2791904042 wait complete. 2023-08-17T00:03:20.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 Processor -- start 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.614+0000 7f16452ff700 1 -- start start 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1640065f10 0x7f16400a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164015b080 0x7f16400a7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 0x7f16400a7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400bd790 con 0x7f164015b460 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16400bfe10 con 0x7f164015b080 2023-08-17T00:03:20.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16400a7d40 con 0x7f1640065f10 2023-08-17T00:03:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 0x7f16400a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 0x7f16400a7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42318/0 (socket says 172.21.15.153:42318) 2023-08-17T00:03:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 -- 172.21.15.153:0/1416037078 learned_addr learned my addr 172.21.15.153:0/1416037078 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163effd700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1640065f10 0x7f16400a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163e7fc700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164015b080 0x7f16400a7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 -- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1640065f10 msgr2=0x7f16400a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1640065f10 0x7f16400a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 -- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164015b080 msgr2=0x7f16400a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164015b080 0x7f16400a7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 -- 172.21.15.153:0/1416037078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638009ae0 con 0x7f164015b460 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f163f7fe700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 0x7f16400a7850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f163800b610 tx=0x7f1638009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16380092e0 con 0x7f164015b460 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163801e470 con 0x7f164015b460 2023-08-17T00:03:20.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163801e7f0 con 0x7f164015b460 2023-08-17T00:03:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16400aafc0 con 0x7f164015b460 2023-08-17T00:03:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.618+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16400ab580 con 0x7f164015b460 2023-08-17T00:03:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.622+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16400bd8d0 con 0x7f164015b460 2023-08-17T00:03:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.622+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1638025030 con 0x7f164015b460 2023-08-17T00:03:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.622+0000 7f1626ffd700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f162c05a150 0x7f162c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.622+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f16380756d0 con 0x7f164015b460 2023-08-17T00:03:20.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.622+0000 7f163effd700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f162c05a150 0x7f162c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.626+0000 7f163effd700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f162c05a150 0x7f162c05c610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1630003900 tx=0x7f1630007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.630+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f16400bd8d0 con 0x7f164015b460 2023-08-17T00:03:20.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.790+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f16400bd8d0 con 0x7f164015b460 2023-08-17T00:03:20.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f1626ffd700 1 -- 172.21.15.153:0/1416037078 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f16400bd8d0 con 0x7f164015b460 2023-08-17T00:03:20.798 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:20.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f162c05a150 msgr2=0x7f162c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f162c05a150 0x7f162c05c610 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f1630003900 tx=0x7f1630007d40).stop 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 msgr2=0x7f16400a7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 0x7f16400a7850 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f163800b610 tx=0x7f1638009840).stop 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 shutdown_connections 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f162c05a150 0x7f162c05c610 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f164015b460 0x7f16400a7850 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f164015b080 0x7f16400a7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 --2- 172.21.15.153:0/1416037078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1640065f10 0x7f16400a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 >> 172.21.15.153:0/1416037078 conn(0x7f16400c2fb0 msgr2=0x7f164015d190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:20.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 shutdown_connections 2023-08-17T00:03:20.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.794+0000 7f16452ff700 1 -- 172.21.15.153:0/1416037078 wait complete. 2023-08-17T00:03:20.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:20.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.970+0000 7fc74d9b9700 1 Processor -- start 2023-08-17T00:03:20.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.970+0000 7fc74d9b9700 1 -- start start 2023-08-17T00:03:20.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74d9b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7480c57a0 0x7fc7480c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74d9b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7480c11b0 0x7fc748154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74d9b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7480bfd10 con 0x7fc748153f50 2023-08-17T00:03:20.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74d9b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc748154860 con 0x7fc7480c57a0 2023-08-17T00:03:20.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74d9b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc748154af0 con 0x7fc7480c11b0 2023-08-17T00:03:20.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7480c57a0 0x7fc7480c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74d1b8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7480c11b0 0x7fc748154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7480c57a0 0x7fc7480c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42326/0 (socket says 172.21.15.153:42326) 2023-08-17T00:03:20.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 -- 172.21.15.153:0/1634044641 learned_addr learned my addr 172.21.15.153:0/1634044641 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:20.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 -- 172.21.15.153:0/1634044641 >> v2:172.21.15.178:3300/0 conn(0x7fc7480c11b0 msgr2=0x7fc748154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:20.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 --2- 172.21.15.153:0/1634044641 >> v2:172.21.15.178:3300/0 conn(0x7fc7480c11b0 0x7fc748154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 -- 172.21.15.153:0/1634044641 >> v1:172.21.15.153:6789/0 conn(0x7fc748153f50 legacy=0x7fc748157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 -- 172.21.15.153:0/1634044641 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc748154dd0 con 0x7fc7480c57a0 2023-08-17T00:03:20.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc74c9b7700 1 --2- 172.21.15.153:0/1634044641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c5b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fc74806a440 tx=0x7fc73c0090f0).ready entity=mon.0 client_cookie=61d49f73950fde7b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc7477fe700 1 -- 172.21.15.153:0/1634044641 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00b520 con 0x7fc7480c57a0 2023-08-17T00:03:20.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc7477fe700 1 -- 172.21.15.153:0/1634044641 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c00b680 con 0x7fc7480c57a0 2023-08-17T00:03:20.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.974+0000 7fc7477fe700 1 -- 172.21.15.153:0/1634044641 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c00ba00 con 0x7fc7480c57a0 2023-08-17T00:03:20.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 -- 172.21.15.153:0/1634044641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 msgr2=0x7fc7480c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/1634044641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c5b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fc74806a440 tx=0x7fc73c0090f0).stop 2023-08-17T00:03:20.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 -- 172.21.15.153:0/1634044641 shutdown_connections 2023-08-17T00:03:20.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/1634044641 >> v2:172.21.15.178:3300/0 conn(0x7fc7480c11b0 0x7fc748154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/1634044641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c5b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 -- 172.21.15.153:0/1634044641 >> 172.21.15.153:0/1634044641 conn(0x7fc748062a70 msgr2=0x7fc7480ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:20.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 -- 172.21.15.153:0/1634044641 shutdown_connections 2023-08-17T00:03:20.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 -- 172.21.15.153:0/1634044641 wait complete. 2023-08-17T00:03:20.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 Processor -- start 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.978+0000 7fc74d9b9700 1 -- start start 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7480c11b0 0x7fc7480ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc748153f50 0x7fc7480c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480c3590 con 0x7fc7480c57a0 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74816bd90 con 0x7fc7480c11b0 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74816bfe0 con 0x7fc748153f50 2023-08-17T00:03:20.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74c9b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7480c11b0 0x7fc7480ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42332/0 (socket says 172.21.15.153:42332) 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 -- 172.21.15.153:0/235777759 learned_addr learned my addr 172.21.15.153:0/235777759 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d1b8700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc748153f50 0x7fc7480c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 -- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc748153f50 msgr2=0x7fc7480c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc748153f50 0x7fc7480c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 -- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7480c11b0 msgr2=0x7fc7480ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7480c11b0 0x7fc7480ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 -- 172.21.15.153:0/235777759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c009370 con 0x7fc7480c57a0 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc747fff700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c2bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc73400c4c0 tx=0x7fc734007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400ce70 con 0x7fc7480c57a0 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc734001e90 con 0x7fc7480c57a0 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc734007250 con 0x7fc7480c57a0 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74816c2c0 con 0x7fc7480c57a0 2023-08-17T00:03:20.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.982+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74816c880 con 0x7fc7480c57a0 2023-08-17T00:03:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.986+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc74806b4c0 con 0x7fc7480c57a0 2023-08-17T00:03:20.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.986+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc734010070 con 0x7fc7480c57a0 2023-08-17T00:03:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.986+0000 7fc744ff9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc72c05a150 0x7fc72c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.986+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc734073800 con 0x7fc7480c57a0 2023-08-17T00:03:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.986+0000 7fc74c9b7700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc72c05a150 0x7fc72c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:20.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.990+0000 7fc74c9b7700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc72c05a150 0x7fc72c05c610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc73c009130 tx=0x7fc73c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:20.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:20.994+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc7340472b0 con 0x7fc7480c57a0 2023-08-17T00:03:21.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.150+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc7480bf9a0 con 0x7fc7480c57a0 2023-08-17T00:03:21.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.150+0000 7fc744ff9700 1 -- 172.21.15.153:0/235777759 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc73404a8d0 con 0x7fc7480c57a0 2023-08-17T00:03:21.157 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.154+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc72c05a150 msgr2=0x7fc72c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.154+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc72c05a150 0x7fc72c05c610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fc73c009130 tx=0x7fc73c017000).stop 2023-08-17T00:03:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.154+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 msgr2=0x7fc7480c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.154+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c2bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fc73400c4c0 tx=0x7fc734007e00).stop 2023-08-17T00:03:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 shutdown_connections 2023-08-17T00:03:21.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc72c05a150 0x7fc72c05c610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc748153f50 0x7fc7480c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480c57a0 0x7fc7480c2bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 --2- 172.21.15.153:0/235777759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7480c11b0 0x7fc7480ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 >> 172.21.15.153:0/235777759 conn(0x7fc748062a70 msgr2=0x7fc748063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:21.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 shutdown_connections 2023-08-17T00:03:21.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.158+0000 7fc74d9b9700 1 -- 172.21.15.153:0/235777759 wait complete. 2023-08-17T00:03:21.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:21.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.338+0000 7f76fe639700 1 Processor -- start 2023-08-17T00:03:21.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.338+0000 7f76fe639700 1 -- start start 2023-08-17T00:03:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fe639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f8154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fe639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76f80c01a0 0x7f76f80c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fe639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f80bfd10 con 0x7f76f80c57a0 2023-08-17T00:03:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fe639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f8154860 con 0x7f76f80c01a0 2023-08-17T00:03:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fe639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8154af0 con 0x7f76f8153f50 2023-08-17T00:03:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76f80c01a0 0x7f76f80c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76f80c01a0 0x7f76f80c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42334/0 (socket says 172.21.15.153:42334) 2023-08-17T00:03:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 -- 172.21.15.153:0/3497988559 learned_addr learned my addr 172.21.15.153:0/3497988559 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fce36700 1 --2- 172.21.15.153:0/3497988559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 -- 172.21.15.153:0/3497988559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 msgr2=0x7f76f8154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 --2- 172.21.15.153:0/3497988559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f8154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 -- 172.21.15.153:0/3497988559 >> v1:172.21.15.178:6789/0 conn(0x7f76f80c57a0 legacy=0x7f76f80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 -- 172.21.15.153:0/3497988559 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8154dd0 con 0x7f76f80c01a0 2023-08-17T00:03:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76fde38700 1 --2- 172.21.15.153:0/3497988559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f80c0630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f76f0009f20 tx=0x7f76f0009840).ready entity=mon.0 client_cookie=517c870e471ccfe0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.342+0000 7f76effff700 1 -- 172.21.15.153:0/3497988559 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000e070 con 0x7f76f80c01a0 2023-08-17T00:03:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76effff700 1 -- 172.21.15.153:0/3497988559 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f000b9d0 con 0x7f76f80c01a0 2023-08-17T00:03:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76effff700 1 -- 172.21.15.153:0/3497988559 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f000bd50 con 0x7f76f80c01a0 2023-08-17T00:03:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 -- 172.21.15.153:0/3497988559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 msgr2=0x7f76f80c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 --2- 172.21.15.153:0/3497988559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f80c0630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f76f0009f20 tx=0x7f76f0009840).stop 2023-08-17T00:03:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 -- 172.21.15.153:0/3497988559 shutdown_connections 2023-08-17T00:03:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 --2- 172.21.15.153:0/3497988559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f80c0630 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 --2- 172.21.15.153:0/3497988559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f8154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 -- 172.21.15.153:0/3497988559 >> 172.21.15.153:0/3497988559 conn(0x7f76f8062a70 msgr2=0x7f76f80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 -- 172.21.15.153:0/3497988559 shutdown_connections 2023-08-17T00:03:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 -- 172.21.15.153:0/3497988559 wait complete. 2023-08-17T00:03:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 Processor -- start 2023-08-17T00:03:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.346+0000 7f76fe639700 1 -- start start 2023-08-17T00:03:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fe639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f81652e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fe639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c57a0 0x7f76f813ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fe639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f813ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fe639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8165060 con 0x7f76f80c01a0 2023-08-17T00:03:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fe639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80ab630 con 0x7f76f80c57a0 2023-08-17T00:03:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fe639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80ac170 con 0x7f76f8153f50 2023-08-17T00:03:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f81652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f81652e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42336/0 (socket says 172.21.15.153:42336) 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 -- 172.21.15.153:0/3916269650 learned_addr learned my addr 172.21.15.153:0/3916269650 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fde38700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f813ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fce36700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c57a0 0x7f76f813ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 -- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 msgr2=0x7f76f813ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f813ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 -- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c57a0 msgr2=0x7f76f813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c57a0 0x7f76f813ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 -- 172.21.15.153:0/3916269650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009ae0 con 0x7f76f80c01a0 2023-08-17T00:03:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.350+0000 7f76fd637700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f81652e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f76f400c440 tx=0x7f76f4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40123f0 con 0x7f76f80c01a0 2023-08-17T00:03:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f4001e90 con 0x7f76f80c01a0 2023-08-17T00:03:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f80ab840 con 0x7f76f80c01a0 2023-08-17T00:03:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4012780 con 0x7f76f80c01a0 2023-08-17T00:03:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f80abe00 con 0x7f76f80c01a0 2023-08-17T00:03:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f806b4c0 con 0x7f76f80c01a0 2023-08-17T00:03:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.354+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f76f4010070 con 0x7f76f80c01a0 2023-08-17T00:03:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.358+0000 7f76ed7fa700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76dc05a150 0x7f76dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.358+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f76f4073200 con 0x7f76f80c01a0 2023-08-17T00:03:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.358+0000 7f76fce36700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76dc05a150 0x7f76dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.358+0000 7f76fce36700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76dc05a150 0x7f76dc05c610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f76f80ad2f0 tx=0x7f76e8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.362+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76f4046cb0 con 0x7f76f80c01a0 2023-08-17T00:03:21.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.522+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76f80bf9a0 con 0x7f76f80c01a0 2023-08-17T00:03:21.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.522+0000 7f76ed7fa700 1 -- 172.21.15.153:0/3916269650 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f76f404a2d0 con 0x7f76f80c01a0 2023-08-17T00:03:21.528 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:21.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76dc05a150 msgr2=0x7f76dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76dc05a150 0x7f76dc05c610 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f76f80ad2f0 tx=0x7f76e8009060).stop 2023-08-17T00:03:21.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 msgr2=0x7f76f81652e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f81652e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f76f400c440 tx=0x7f76f4007db0).stop 2023-08-17T00:03:21.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 shutdown_connections 2023-08-17T00:03:21.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76dc05a150 0x7f76dc05c610 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76f8153f50 0x7f76f813ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76f80c57a0 0x7f76f813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 --2- 172.21.15.153:0/3916269650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76f80c01a0 0x7f76f81652e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 >> 172.21.15.153:0/3916269650 conn(0x7f76f8062a70 msgr2=0x7f76f80c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:21.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 shutdown_connections 2023-08-17T00:03:21.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.526+0000 7f76fe639700 1 -- 172.21.15.153:0/3916269650 wait complete. 2023-08-17T00:03:21.551 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:21.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.706+0000 7fc94dd46700 1 Processor -- start 2023-08-17T00:03:21.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.706+0000 7fc94dd46700 1 -- start start 2023-08-17T00:03:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc94dd46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480a8b70 0x7fc9480632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc94dd46700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9480a8f50 0x7fc9480629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc94dd46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9480656d0 0x7fc9480bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc94dd46700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc948065240 con 0x7fc9480656d0 2023-08-17T00:03:21.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc94dd46700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc948062ea0 con 0x7fc9480a8f50 2023-08-17T00:03:21.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc94dd46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480638a0 con 0x7fc9480a8b70 2023-08-17T00:03:21.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9480656d0 0x7fc9480bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc9480656d0 0x7fc9480bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42348/0 (socket says 172.21.15.153:42348) 2023-08-17T00:03:21.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 -- 172.21.15.153:0/671691689 learned_addr learned my addr 172.21.15.153:0/671691689 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:21.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc93effd700 1 --2- 172.21.15.153:0/671691689 >> v2:172.21.15.178:3300/0 conn(0x7fc9480a8f50 0x7fc9480629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc9477fe700 1 --2- 172.21.15.153:0/671691689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480a8b70 0x7fc9480632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 -- 172.21.15.153:0/671691689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480a8b70 msgr2=0x7fc9480632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:21.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 --2- 172.21.15.153:0/671691689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480a8b70 0x7fc9480632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 -- 172.21.15.153:0/671691689 >> v2:172.21.15.178:3300/0 conn(0x7fc9480a8f50 msgr2=0x7fc9480629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:21.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 --2- 172.21.15.153:0/671691689 >> v2:172.21.15.178:3300/0 conn(0x7fc9480a8f50 0x7fc9480629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 -- 172.21.15.153:0/671691689 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc948064910 con 0x7fc9480656d0 2023-08-17T00:03:21.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.710+0000 7fc947fff700 1 --2- 172.21.15.153:0/671691689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480656d0 0x7fc9480bbdc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc948068340 tx=0x7fc9400090f0).ready entity=mon.0 client_cookie=2480b6e86ad1d6f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc946ffd700 1 -- 172.21.15.153:0/671691689 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94000f510 con 0x7fc9480656d0 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc946ffd700 1 -- 172.21.15.153:0/671691689 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94000f670 con 0x7fc9480656d0 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc946ffd700 1 -- 172.21.15.153:0/671691689 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94000fa10 con 0x7fc9480656d0 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 -- 172.21.15.153:0/671691689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480656d0 msgr2=0x7fc9480bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 --2- 172.21.15.153:0/671691689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480656d0 0x7fc9480bbdc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fc948068340 tx=0x7fc9400090f0).stop 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 -- 172.21.15.153:0/671691689 shutdown_connections 2023-08-17T00:03:21.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 --2- 172.21.15.153:0/671691689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480656d0 0x7fc9480bbdc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 --2- 172.21.15.153:0/671691689 >> v2:172.21.15.178:3300/0 conn(0x7fc9480a8f50 0x7fc9480629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 --2- 172.21.15.153:0/671691689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480a8b70 0x7fc9480632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 -- 172.21.15.153:0/671691689 >> 172.21.15.153:0/671691689 conn(0x7fc9480c7150 msgr2=0x7fc9480c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 -- 172.21.15.153:0/671691689 shutdown_connections 2023-08-17T00:03:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.714+0000 7fc94dd46700 1 -- 172.21.15.153:0/671691689 wait complete. 2023-08-17T00:03:21.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 Processor -- start 2023-08-17T00:03:21.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 -- start start 2023-08-17T00:03:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480656d0 0x7fc9480c0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 0x7fc94815a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9480a8f50 0x7fc948153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948159db0 con 0x7fc9480a8b70 2023-08-17T00:03:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948159480 con 0x7fc9480a8f50 2023-08-17T00:03:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc94dd46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc948159760 con 0x7fc9480656d0 2023-08-17T00:03:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc93effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 0x7fc94815a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc93effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 0x7fc94815a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42362/0 (socket says 172.21.15.153:42362) 2023-08-17T00:03:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc93effd700 1 -- 172.21.15.153:0/2849637227 learned_addr learned my addr 172.21.15.153:0/2849637227 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.718+0000 7fc9477fe700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480656d0 0x7fc9480c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc947fff700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9480a8f50 0x7fc948153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93effd700 1 -- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480656d0 msgr2=0x7fc9480c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93effd700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480656d0 0x7fc9480c0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93effd700 1 -- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9480a8f50 msgr2=0x7fc948153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93effd700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9480a8f50 0x7fc948153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93effd700 1 -- 172.21.15.153:0/2849637227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940009370 con 0x7fc9480a8b70 2023-08-17T00:03:21.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc947fff700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9480a8f50 0x7fc948153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:21.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93effd700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 0x7fc94815a240 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc930009e10 tx=0x7fc93000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93000cb50 con 0x7fc9480a8b70 2023-08-17T00:03:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93000f040 con 0x7fc9480a8b70 2023-08-17T00:03:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc948159a40 con 0x7fc9480a8b70 2023-08-17T00:03:21.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc930013400 con 0x7fc9480a8b70 2023-08-17T00:03:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480bef50 con 0x7fc9480a8b70 2023-08-17T00:03:21.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.722+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc948159f20 con 0x7fc9480a8b70 2023-08-17T00:03:21.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.726+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc930013770 con 0x7fc9480a8b70 2023-08-17T00:03:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.726+0000 7fc93ffff700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc92805a150 0x7fc92805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.726+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc930074ab0 con 0x7fc9480a8b70 2023-08-17T00:03:21.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.726+0000 7fc9477fe700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc92805a150 0x7fc92805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:21.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.730+0000 7fc9477fe700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc92805a150 0x7fc92805c610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fc9481581c0 tx=0x7fc938009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:21.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.730+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc930048450 con 0x7fc9480a8b70 2023-08-17T00:03:21.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.890+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc948064bf0 con 0x7fc9480a8b70 2023-08-17T00:03:21.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.890+0000 7fc93ffff700 1 -- 172.21.15.153:0/2849637227 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc93004ba70 con 0x7fc9480a8b70 2023-08-17T00:03:21.896 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:21.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc92805a150 msgr2=0x7fc92805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc92805a150 0x7fc92805c610 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fc9481581c0 tx=0x7fc938009060).stop 2023-08-17T00:03:21.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 msgr2=0x7fc94815a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:21.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 0x7fc94815a240 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7fc930009e10 tx=0x7fc93000b040).stop 2023-08-17T00:03:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 shutdown_connections 2023-08-17T00:03:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc92805a150 0x7fc92805c610 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9480a8f50 0x7fc948153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc9480a8b70 0x7fc94815a240 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 --2- 172.21.15.153:0/2849637227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9480656d0 0x7fc9480c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 >> 172.21.15.153:0/2849637227 conn(0x7fc9480c7150 msgr2=0x7fc9480c5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:21.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 shutdown_connections 2023-08-17T00:03:21.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:21.894+0000 7fc94dd46700 1 -- 172.21.15.153:0/2849637227 wait complete. 2023-08-17T00:03:21.919 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:22.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.070+0000 7fd67359e700 1 Processor -- start 2023-08-17T00:03:22.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 -- start start 2023-08-17T00:03:22.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd6740689c0 0x7fd674068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd6741560f0 0x7fd6740c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd674151530 0x7fd6741519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd674065da0 con 0x7fd674151530 2023-08-17T00:03:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd674155c60 con 0x7fd6740689c0 2023-08-17T00:03:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd674156550 con 0x7fd6741560f0 2023-08-17T00:03:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd674151530 0x7fd6741519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd67259c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd6740689c0 0x7fd674068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd674151530 0x7fd6741519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42378/0 (socket says 172.21.15.153:42378) 2023-08-17T00:03:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 -- 172.21.15.153:0/2295370851 learned_addr learned my addr 172.21.15.153:0/2295370851 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd671d9b700 1 --2- 172.21.15.153:0/2295370851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd6741560f0 0x7fd6740c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 -- 172.21.15.153:0/2295370851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd6741560f0 msgr2=0x7fd6740c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:22.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 --2- 172.21.15.153:0/2295370851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd6741560f0 0x7fd6740c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 -- 172.21.15.153:0/2295370851 >> v2:172.21.15.178:3300/0 conn(0x7fd6740689c0 msgr2=0x7fd674068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:22.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 --2- 172.21.15.153:0/2295370851 >> v2:172.21.15.178:3300/0 conn(0x7fd6740689c0 0x7fd674068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.074+0000 7fd672d9d700 1 -- 172.21.15.153:0/2295370851 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd674065ff0 con 0x7fd674151530 2023-08-17T00:03:22.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd672d9d700 1 --2- 172.21.15.153:0/2295370851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd674151530 0x7fd6741519c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd6740c2d60 tx=0x7fd66c009840).ready entity=mon.0 client_cookie=7747859c140dfab server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67159a700 1 -- 172.21.15.153:0/2295370851 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00e070 con 0x7fd674151530 2023-08-17T00:03:22.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67159a700 1 -- 172.21.15.153:0/2295370851 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c00b970 con 0x7fd674151530 2023-08-17T00:03:22.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67159a700 1 -- 172.21.15.153:0/2295370851 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00bcf0 con 0x7fd674151530 2023-08-17T00:03:22.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 -- 172.21.15.153:0/2295370851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd674151530 msgr2=0x7fd6741519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 --2- 172.21.15.153:0/2295370851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd674151530 0x7fd6741519c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fd6740c2d60 tx=0x7fd66c009840).stop 2023-08-17T00:03:22.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 -- 172.21.15.153:0/2295370851 shutdown_connections 2023-08-17T00:03:22.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 --2- 172.21.15.153:0/2295370851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd6741560f0 0x7fd6740c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 --2- 172.21.15.153:0/2295370851 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd674151530 0x7fd6741519c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 --2- 172.21.15.153:0/2295370851 >> v2:172.21.15.178:3300/0 conn(0x7fd6740689c0 0x7fd674068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 -- 172.21.15.153:0/2295370851 >> 172.21.15.153:0/2295370851 conn(0x7fd6740c6620 msgr2=0x7fd6740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:22.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 -- 172.21.15.153:0/2295370851 shutdown_connections 2023-08-17T00:03:22.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 -- 172.21.15.153:0/2295370851 wait complete. 2023-08-17T00:03:22.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.078+0000 7fd67359e700 1 Processor -- start 2023-08-17T00:03:22.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 -- start start 2023-08-17T00:03:22.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 0x7fd6740baf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd674151530 0x7fd6740bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6741560f0 0x7fd674164130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740bca90 con 0x7fd6740689c0 2023-08-17T00:03:22.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740bb520 con 0x7fd6741560f0 2023-08-17T00:03:22.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6740bb800 con 0x7fd674151530 2023-08-17T00:03:22.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 0x7fd6740baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 0x7fd6740baf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42382/0 (socket says 172.21.15.153:42382) 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 -- 172.21.15.153:0/1966519420 learned_addr learned my addr 172.21.15.153:0/1966519420 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd671d9b700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd674151530 0x7fd6740bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd672d9d700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6741560f0 0x7fd674164130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 -- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd674151530 msgr2=0x7fd6740bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd674151530 0x7fd6740bc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 -- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6741560f0 msgr2=0x7fd674164130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6741560f0 0x7fd674164130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 -- 172.21.15.153:0/1966519420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c009ae0 con 0x7fd6740689c0 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67259c700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 0x7fd6740baf60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd66400e8d0 tx=0x7fd664006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664012600 con 0x7fd6740689c0 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664012760 con 0x7fd6740689c0 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6740bbae0 con 0x7fd6740689c0 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664012ae0 con 0x7fd6740689c0 2023-08-17T00:03:22.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.082+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6740bc0a0 con 0x7fd6740689c0 2023-08-17T00:03:22.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.086+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd674153a00 con 0x7fd6740689c0 2023-08-17T00:03:22.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.086+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd664022070 con 0x7fd6740689c0 2023-08-17T00:03:22.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.086+0000 7fd6627fc700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd65405a150 0x7fd65405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.090+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd664074370 con 0x7fd6740689c0 2023-08-17T00:03:22.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.090+0000 7fd671d9b700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd65405a150 0x7fd65405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.090+0000 7fd671d9b700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd65405a150 0x7fd65405c610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd6740bb450 tx=0x7fd668009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.094+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd664047e60 con 0x7fd6740689c0 2023-08-17T00:03:22.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.258+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6740662d0 con 0x7fd6740689c0 2023-08-17T00:03:22.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.258+0000 7fd6627fc700 1 -- 172.21.15.153:0/1966519420 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fd664016070 con 0x7fd6740689c0 2023-08-17T00:03:22.265 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:22.265 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:22.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.262+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd65405a150 msgr2=0x7fd65405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.262+0000 7fd67359e700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd65405a150 0x7fd65405c610 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fd6740bb450 tx=0x7fd668009060).stop 2023-08-17T00:03:22.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.262+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 msgr2=0x7fd6740baf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.262+0000 7fd67359e700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 0x7fd6740baf60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7fd66400e8d0 tx=0x7fd664006f40).stop 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 shutdown_connections 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd65405a150 0x7fd65405c610 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6741560f0 0x7fd674164130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd674151530 0x7fd6740bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 --2- 172.21.15.153:0/1966519420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd6740689c0 0x7fd6740baf60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 >> 172.21.15.153:0/1966519420 conn(0x7fd6740c6620 msgr2=0x7fd6740c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:22.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 shutdown_connections 2023-08-17T00:03:22.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.266+0000 7fd67359e700 1 -- 172.21.15.153:0/1966519420 wait complete. 2023-08-17T00:03:22.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:22.291 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:22.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.454+0000 7f64dd279700 1 Processor -- start 2023-08-17T00:03:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.454+0000 7f64dd279700 1 -- start start 2023-08-17T00:03:22.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dd279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d8153f50 0x7f64d8154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dd279700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64d80c01a0 0x7f64d80c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dd279700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d80bfd10 con 0x7f64d80c57a0 2023-08-17T00:03:22.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dd279700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d8154860 con 0x7f64d80c01a0 2023-08-17T00:03:22.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dd279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8154af0 con 0x7f64d8153f50 2023-08-17T00:03:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64d80c01a0 0x7f64d80c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d8153f50 0x7f64d8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64d80c01a0 0x7f64d80c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:52344/0 (socket says 172.21.15.153:52344) 2023-08-17T00:03:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 -- 172.21.15.153:0/1902854593 learned_addr learned my addr 172.21.15.153:0/1902854593 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 -- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d8153f50 msgr2=0x7f64d8154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 --2- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d8153f50 0x7f64d8154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 -- 172.21.15.153:0/1902854593 >> v1:172.21.15.178:6789/0 conn(0x7f64d80c57a0 legacy=0x7f64d80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 -- 172.21.15.153:0/1902854593 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8154dd0 con 0x7f64d80c01a0 2023-08-17T00:03:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64dca78700 1 --2- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80c0630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f64d0006fd0 tx=0x7f64d00090f0).ready entity=mon.1 client_cookie=a04254a4447f14fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.458+0000 7f64d77fe700 1 -- 172.21.15.153:0/1902854593 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000b580 con 0x7f64d80c01a0 2023-08-17T00:03:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64d77fe700 1 -- 172.21.15.153:0/1902854593 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000b6e0 con 0x7f64d80c01a0 2023-08-17T00:03:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64d77fe700 1 -- 172.21.15.153:0/1902854593 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000ba60 con 0x7f64d80c01a0 2023-08-17T00:03:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 -- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 msgr2=0x7f64d80c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 --2- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80c0630 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f64d0006fd0 tx=0x7f64d00090f0).stop 2023-08-17T00:03:22.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 -- 172.21.15.153:0/1902854593 shutdown_connections 2023-08-17T00:03:22.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 --2- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80c0630 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 --2- 172.21.15.153:0/1902854593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d8153f50 0x7f64d8154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 -- 172.21.15.153:0/1902854593 >> 172.21.15.153:0/1902854593 conn(0x7f64d8062a70 msgr2=0x7f64d80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 -- 172.21.15.153:0/1902854593 shutdown_connections 2023-08-17T00:03:22.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.462+0000 7f64dd279700 1 -- 172.21.15.153:0/1902854593 wait complete. 2023-08-17T00:03:22.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 Processor -- start 2023-08-17T00:03:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 -- start start 2023-08-17T00:03:22.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80aa660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 0x7f64d80ac490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8153f50 0x7f64d8150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80c2130 con 0x7f64d8153f50 2023-08-17T00:03:22.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80ac980 con 0x7f64d80c01a0 2023-08-17T00:03:22.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dd279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d80aacb0 con 0x7f64d80c57a0 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 0x7f64d80ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 0x7f64d80ac490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:37540/0 (socket says 172.21.15.153:37540) 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64cf7fe700 1 -- 172.21.15.153:0/3317489784 learned_addr learned my addr 172.21.15.153:0/3317489784 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.466+0000 7f64dca78700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8153f50 0x7f64d8150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64d7fff700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64cf7fe700 1 -- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 msgr2=0x7f64d80aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64cf7fe700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80aa660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64cf7fe700 1 -- 172.21.15.153:0/3317489784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8153f50 msgr2=0x7f64d8150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64cf7fe700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8153f50 0x7f64d8150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64cf7fe700 1 -- 172.21.15.153:0/3317489784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0009370 con 0x7f64d80c57a0 2023-08-17T00:03:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64cf7fe700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 0x7f64d80ac490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f64c0009ef0 tx=0x7f64c000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c000cb70 con 0x7f64d80c57a0 2023-08-17T00:03:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c000f040 con 0x7f64d80c57a0 2023-08-17T00:03:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d80aaf90 con 0x7f64d80c57a0 2023-08-17T00:03:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0013400 con 0x7f64d80c57a0 2023-08-17T00:03:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d80ab550 con 0x7f64d80c57a0 2023-08-17T00:03:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.470+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d81559f0 con 0x7f64d80c57a0 2023-08-17T00:03:22.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.474+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f64c0035ba0 con 0x7f64d80c57a0 2023-08-17T00:03:22.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.474+0000 7f64d4ff9700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64b805a150 0x7f64b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.474+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f64c0074be0 con 0x7f64d80c57a0 2023-08-17T00:03:22.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.474+0000 7f64d7fff700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64b805a150 0x7f64b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.478+0000 7f64d7fff700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64b805a150 0x7f64b805c610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f64c8003860 tx=0x7f64c8007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.482+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64c0048600 con 0x7f64d80c57a0 2023-08-17T00:03:22.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.642+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f64d81559f0 con 0x7f64d80c57a0 2023-08-17T00:03:22.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.646+0000 7f64d4ff9700 1 -- 172.21.15.153:0/3317489784 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f64d81559f0 con 0x7f64d80c57a0 2023-08-17T00:03:22.650 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64b805a150 msgr2=0x7f64b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64b805a150 0x7f64b805c610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f64c8003860 tx=0x7f64c8007d40).stop 2023-08-17T00:03:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 msgr2=0x7f64d80ac490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 0x7f64d80ac490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f64c0009ef0 tx=0x7f64c000b040).stop 2023-08-17T00:03:22.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 shutdown_connections 2023-08-17T00:03:22.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64b805a150 0x7f64b805c610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64d8153f50 0x7f64d8150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64d80c57a0 0x7f64d80ac490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 --2- 172.21.15.153:0/3317489784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64d80c01a0 0x7f64d80aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 >> 172.21.15.153:0/3317489784 conn(0x7f64d8062a70 msgr2=0x7f64d8153380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:22.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 shutdown_connections 2023-08-17T00:03:22.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.650+0000 7f64dd279700 1 -- 172.21.15.153:0/3317489784 wait complete. 2023-08-17T00:03:22.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:22.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.834+0000 7eff1689b700 1 Processor -- start 2023-08-17T00:03:22.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.834+0000 7eff1689b700 1 -- start start 2023-08-17T00:03:22.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff1689b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff10065e80 0x7eff100631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff1689b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10154310 0x7eff100c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff1689b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff10062d50 con 0x7eff100c2ba0 2023-08-17T00:03:22.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff1689b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff100c34f0 con 0x7eff10065e80 2023-08-17T00:03:22.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff1689b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff10154aa0 con 0x7eff10154310 2023-08-17T00:03:22.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff10065e80 0x7eff100631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff10065e80 0x7eff100631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42392/0 (socket says 172.21.15.153:42392) 2023-08-17T00:03:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 -- 172.21.15.153:0/3215678495 learned_addr learned my addr 172.21.15.153:0/3215678495 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff14e38700 1 --2- 172.21.15.153:0/3215678495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10154310 0x7eff100c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 -- 172.21.15.153:0/3215678495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10154310 msgr2=0x7eff100c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 --2- 172.21.15.153:0/3215678495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10154310 0x7eff100c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 -- 172.21.15.153:0/3215678495 >> v1:172.21.15.178:6789/0 conn(0x7eff100c2ba0 legacy=0x7eff10153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.838+0000 7eff0ffff700 1 -- 172.21.15.153:0/3215678495 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff10062140 con 0x7eff10065e80 2023-08-17T00:03:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff0ffff700 1 --2- 172.21.15.153:0/3215678495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff10065e80 0x7eff100631e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7eff00009830 tx=0x7eff000090f0).ready entity=mon.0 client_cookie=ebce18542009c84b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff0f7fe700 1 -- 172.21.15.153:0/3215678495 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000b580 con 0x7eff10065e80 2023-08-17T00:03:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff0f7fe700 1 -- 172.21.15.153:0/3215678495 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000b6e0 con 0x7eff10065e80 2023-08-17T00:03:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff0f7fe700 1 -- 172.21.15.153:0/3215678495 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000ba80 con 0x7eff10065e80 2023-08-17T00:03:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 -- 172.21.15.153:0/3215678495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff10065e80 msgr2=0x7eff100631e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 --2- 172.21.15.153:0/3215678495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff10065e80 0x7eff100631e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7eff00009830 tx=0x7eff000090f0).stop 2023-08-17T00:03:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 -- 172.21.15.153:0/3215678495 shutdown_connections 2023-08-17T00:03:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 --2- 172.21.15.153:0/3215678495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10154310 0x7eff100c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 --2- 172.21.15.153:0/3215678495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff10065e80 0x7eff100631e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 -- 172.21.15.153:0/3215678495 >> 172.21.15.153:0/3215678495 conn(0x7eff100c39c0 msgr2=0x7eff100c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 -- 172.21.15.153:0/3215678495 shutdown_connections 2023-08-17T00:03:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.842+0000 7eff1689b700 1 -- 172.21.15.153:0/3215678495 wait complete. 2023-08-17T00:03:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 Processor -- start 2023-08-17T00:03:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 -- start start 2023-08-17T00:03:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10065e80 0x7eff10132240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 0x7eff1005dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff10154310 0x7eff1005e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff10146220 con 0x7eff100c2ba0 2023-08-17T00:03:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1005e5c0 con 0x7eff10154310 2023-08-17T00:03:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff100aaea0 con 0x7eff10065e80 2023-08-17T00:03:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 0x7eff1005dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 0x7eff1005dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42406/0 (socket says 172.21.15.153:42406) 2023-08-17T00:03:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 -- 172.21.15.153:0/2770456662 learned_addr learned my addr 172.21.15.153:0/2770456662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff14e38700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff10154310 0x7eff1005e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff0ffff700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10065e80 0x7eff10132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 -- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10065e80 msgr2=0x7eff10132240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10065e80 0x7eff10132240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 -- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff10154310 msgr2=0x7eff1005e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff10154310 0x7eff1005e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 -- 172.21.15.153:0/2770456662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009370 con 0x7eff100c2ba0 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff0ffff700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10065e80 0x7eff10132240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff077fe700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 0x7eff1005dbe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7efef800c4f0 tx=0x7efef8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef8007020 con 0x7eff100c2ba0 2023-08-17T00:03:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef8001e90 con 0x7eff100c2ba0 2023-08-17T00:03:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef80073b0 con 0x7eff100c2ba0 2023-08-17T00:03:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.846+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff101534b0 con 0x7eff100c2ba0 2023-08-17T00:03:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.850+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff100aab30 con 0x7eff100c2ba0 2023-08-17T00:03:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.850+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff100aa990 con 0x7eff100c2ba0 2023-08-17T00:03:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.850+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efef8010070 con 0x7eff100c2ba0 2023-08-17T00:03:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.854+0000 7eff0cff9700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef005a150 0x7efef005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.854+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efef80739c0 con 0x7eff100c2ba0 2023-08-17T00:03:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.854+0000 7eff0ffff700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef005a150 0x7efef005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.854+0000 7eff0ffff700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef005a150 0x7efef005c610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7eff0000b340 tx=0x7eff00017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:22.858+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff100aa990 con 0x7eff100c2ba0 2023-08-17T00:03:23.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.014+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff100aa990 con 0x7eff100c2ba0 2023-08-17T00:03:23.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.014+0000 7eff0cff9700 1 -- 172.21.15.153:0/2770456662 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff100aa990 con 0x7eff100c2ba0 2023-08-17T00:03:23.021 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:23.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef005a150 msgr2=0x7efef005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef005a150 0x7efef005c610 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7eff0000b340 tx=0x7eff00017000).stop 2023-08-17T00:03:23.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 msgr2=0x7eff1005dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 0x7eff1005dbe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7efef800c4f0 tx=0x7efef8007e00).stop 2023-08-17T00:03:23.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 shutdown_connections 2023-08-17T00:03:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef005a150 0x7efef005c610 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff10154310 0x7eff1005e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff100c2ba0 0x7eff1005dbe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 --2- 172.21.15.153:0/2770456662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff10065e80 0x7eff10132240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 >> 172.21.15.153:0/2770456662 conn(0x7eff100c39c0 msgr2=0x7eff100a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 shutdown_connections 2023-08-17T00:03:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.018+0000 7eff1689b700 1 -- 172.21.15.153:0/2770456662 wait complete. 2023-08-17T00:03:23.046 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.206+0000 7f7ec67f9700 1 Processor -- start 2023-08-17T00:03:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.206+0000 7f7ec67f9700 1 -- start start 2023-08-17T00:03:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ec0153f50 0x7f7ec0154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c01a0 0x7f7ec00c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec00bfd10 con 0x7f7ec00c57a0 2023-08-17T00:03:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec0154860 con 0x7f7ec0153f50 2023-08-17T00:03:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec0154af0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec57f7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ec00c57a0 0x7f7ec00c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47264/0 (socket says 172.21.15.153:47264) 2023-08-17T00:03:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec57f7700 1 -- 172.21.15.153:0/2324906519 learned_addr learned my addr 172.21.15.153:0/2324906519 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec5ff8700 1 --2- 172.21.15.153:0/2324906519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c01a0 0x7f7ec00c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec4ff6700 1 --2- 172.21.15.153:0/2324906519 >> v2:172.21.15.178:3300/0 conn(0x7f7ec0153f50 0x7f7ec0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7eb7fff700 1 -- 172.21.15.153:0/2324906519 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44639743 0 0) 0x7f7ec00bfd10 con 0x7f7ec00c57a0 2023-08-17T00:03:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7eb7fff700 1 -- 172.21.15.153:0/2324906519 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eac0033f0 con 0x7f7ec00c57a0 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec5ff8700 1 -- 172.21.15.153:0/2324906519 >> v2:172.21.15.178:3300/0 conn(0x7f7ec0153f50 msgr2=0x7f7ec0154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec5ff8700 1 --2- 172.21.15.153:0/2324906519 >> v2:172.21.15.178:3300/0 conn(0x7f7ec0153f50 0x7f7ec0154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec5ff8700 1 -- 172.21.15.153:0/2324906519 >> v1:172.21.15.153:6789/0 conn(0x7f7ec00c57a0 legacy=0x7f7ec00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec5ff8700 1 -- 172.21.15.153:0/2324906519 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec0154dd0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec5ff8700 1 --2- 172.21.15.153:0/2324906519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c01a0 0x7f7ec00c0630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7eb8009e60 tx=0x7f7eb8009780).ready entity=mon.2 client_cookie=379179ab8150aa5f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7eb7fff700 1 -- 172.21.15.153:0/2324906519 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800e070 con 0x7f7ec00c01a0 2023-08-17T00:03:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7eb7fff700 1 -- 172.21.15.153:0/2324906519 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb800bab0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7eb7fff700 1 -- 172.21.15.153:0/2324906519 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb800be30 con 0x7f7ec00c01a0 2023-08-17T00:03:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2324906519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c01a0 msgr2=0x7f7ec00c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2324906519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c01a0 0x7f7ec00c0630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f7eb8009e60 tx=0x7f7eb8009780).stop 2023-08-17T00:03:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2324906519 shutdown_connections 2023-08-17T00:03:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2324906519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c01a0 0x7f7ec00c0630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2324906519 >> v2:172.21.15.178:3300/0 conn(0x7f7ec0153f50 0x7f7ec0154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.210+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2324906519 >> 172.21.15.153:0/2324906519 conn(0x7f7ec0062a70 msgr2=0x7f7ec00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2324906519 shutdown_connections 2023-08-17T00:03:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2324906519 wait complete. 2023-08-17T00:03:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 Processor -- start 2023-08-17T00:03:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 -- start start 2023-08-17T00:03:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 0x7f7ec00c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c57a0 0x7f7ec01530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec0153f50 0x7f7ec01535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00c2980 con 0x7f7ec00c01a0 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00c1e30 con 0x7f7ec0153f50 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.214+0000 7f7ec67f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec00b0720 con 0x7f7ec00c57a0 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 0x7f7ec00c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 0x7f7ec00c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42408/0 (socket says 172.21.15.153:42408) 2023-08-17T00:03:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 -- 172.21.15.153:0/2304445127 learned_addr learned my addr 172.21.15.153:0/2304445127 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:23.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec4ff6700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c57a0 0x7f7ec01530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec5ff8700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec0153f50 0x7f7ec01535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 -- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c57a0 msgr2=0x7f7ec01530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c57a0 0x7f7ec01530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 -- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec0153f50 msgr2=0x7f7ec01535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec0153f50 0x7f7ec01535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 -- 172.21.15.153:0/2304445127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb8009a20 con 0x7f7ec00c01a0 2023-08-17T00:03:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec5ff8700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec0153f50 0x7f7ec01535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec57f7700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 0x7f7ec00c1940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f7ebc00c590 tx=0x7f7ebc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0072e0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ebc007440 con 0x7f7ec00c01a0 2023-08-17T00:03:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec00aea70 con 0x7f7ec00c01a0 2023-08-17T00:03:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ebc0057a0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec00c26a0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.218+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec006b4c0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.222+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7ebc01a060 con 0x7f7ec00c01a0 2023-08-17T00:03:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.222+0000 7f7eb57fa700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ea405a150 0x7f7ea405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.222+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7ebc073480 con 0x7f7ec00c01a0 2023-08-17T00:03:23.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.222+0000 7f7ec4ff6700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ea405a150 0x7f7ea405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.222+0000 7f7ec4ff6700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ea405a150 0x7f7ea405c610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7ec00a8c80 tx=0x7f7eb0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:23.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.226+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ebc046f30 con 0x7f7ec00c01a0 2023-08-17T00:03:23.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.394+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7ec00bf9a0 con 0x7f7ec00c01a0 2023-08-17T00:03:23.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.398+0000 7f7eb57fa700 1 -- 172.21.15.153:0/2304445127 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7ebc018020 con 0x7f7ec00c01a0 2023-08-17T00:03:23.410 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:23.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ea405a150 msgr2=0x7f7ea405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ea405a150 0x7f7ea405c610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7ec00a8c80 tx=0x7f7eb0009060).stop 2023-08-17T00:03:23.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 msgr2=0x7f7ec00c1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 0x7f7ec00c1940 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f7ebc00c590 tx=0x7f7ebc007c80).stop 2023-08-17T00:03:23.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 shutdown_connections 2023-08-17T00:03:23.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ea405a150 0x7f7ea405c610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ec0153f50 0x7f7ec01535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ec00c57a0 0x7f7ec01530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 --2- 172.21.15.153:0/2304445127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ec00c01a0 0x7f7ec00c1940 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 >> 172.21.15.153:0/2304445127 conn(0x7f7ec0062a70 msgr2=0x7f7ec0063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:23.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 shutdown_connections 2023-08-17T00:03:23.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.402+0000 7f7ec67f9700 1 -- 172.21.15.153:0/2304445127 wait complete. 2023-08-17T00:03:23.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:23.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.586+0000 7f3974968700 1 Processor -- start 2023-08-17T00:03:23.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.586+0000 7f3974968700 1 -- start start 2023-08-17T00:03:23.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f3974968700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700c5ea0 0x7f39700634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f3974968700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f39700639a0 0x7f39700bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f3974968700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3970154e90 con 0x7f39700acf30 2023-08-17T00:03:23.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f3974968700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39700c1730 con 0x7f39700639a0 2023-08-17T00:03:23.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f3974968700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3970063e10 con 0x7f39700c5ea0 2023-08-17T00:03:23.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f39700acf30 0x7f39700c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47266/0 (socket says 172.21.15.153:47266) 2023-08-17T00:03:23.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396ed9d700 1 -- 172.21.15.153:0/3339882975 learned_addr learned my addr 172.21.15.153:0/3339882975 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396f59e700 1 --2- 172.21.15.153:0/3339882975 >> v2:172.21.15.178:3300/0 conn(0x7f39700639a0 0x7f39700bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396e59c700 1 --2- 172.21.15.153:0/3339882975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700c5ea0 0x7f39700634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396dd9b700 1 -- 172.21.15.153:0/3339882975 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180646295 0 0) 0x7f3970154e90 con 0x7f39700acf30 2023-08-17T00:03:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396dd9b700 1 -- 172.21.15.153:0/3339882975 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39580033f0 con 0x7f39700acf30 2023-08-17T00:03:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396e59c700 1 -- 172.21.15.153:0/3339882975 >> v2:172.21.15.178:3300/0 conn(0x7f39700639a0 msgr2=0x7f39700bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:23.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396e59c700 1 --2- 172.21.15.153:0/3339882975 >> v2:172.21.15.178:3300/0 conn(0x7f39700639a0 0x7f39700bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396e59c700 1 -- 172.21.15.153:0/3339882975 >> v1:172.21.15.153:6789/0 conn(0x7f39700acf30 legacy=0x7f39700c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396e59c700 1 -- 172.21.15.153:0/3339882975 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3970153fc0 con 0x7f39700c5ea0 2023-08-17T00:03:23.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396e59c700 1 --2- 172.21.15.153:0/3339882975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700c5ea0 0x7f39700634b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3964009760 tx=0x7f3964009060).ready entity=mon.2 client_cookie=bedfcbe1b208664f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396dd9b700 1 -- 172.21.15.153:0/3339882975 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39640090d0 con 0x7f39700c5ea0 2023-08-17T00:03:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396dd9b700 1 -- 172.21.15.153:0/3339882975 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396400d4a0 con 0x7f39700c5ea0 2023-08-17T00:03:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.590+0000 7f396dd9b700 1 -- 172.21.15.153:0/3339882975 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396400d820 con 0x7f39700c5ea0 2023-08-17T00:03:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 -- 172.21.15.153:0/3339882975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700c5ea0 msgr2=0x7f39700634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 --2- 172.21.15.153:0/3339882975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700c5ea0 0x7f39700634b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f3964009760 tx=0x7f3964009060).stop 2023-08-17T00:03:23.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 -- 172.21.15.153:0/3339882975 shutdown_connections 2023-08-17T00:03:23.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 --2- 172.21.15.153:0/3339882975 >> v2:172.21.15.178:3300/0 conn(0x7f39700639a0 0x7f39700bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 --2- 172.21.15.153:0/3339882975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700c5ea0 0x7f39700634b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 -- 172.21.15.153:0/3339882975 >> 172.21.15.153:0/3339882975 conn(0x7f39700cb330 msgr2=0x7f39700c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:23.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 -- 172.21.15.153:0/3339882975 shutdown_connections 2023-08-17T00:03:23.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.594+0000 7f3974968700 1 -- 172.21.15.153:0/3339882975 wait complete. 2023-08-17T00:03:23.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 Processor -- start 2023-08-17T00:03:23.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 -- start start 2023-08-17T00:03:23.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39700639a0 0x7f39700c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700acf30 0x7f39700aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 0x7f39700ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700c83d0 con 0x7f39700b0480 2023-08-17T00:03:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700c85c0 con 0x7f39700639a0 2023-08-17T00:03:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f3974968700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700c88a0 con 0x7f39700acf30 2023-08-17T00:03:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f396f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 0x7f39700ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f396f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 0x7f39700ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42420/0 (socket says 172.21.15.153:42420) 2023-08-17T00:03:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.598+0000 7f396f59e700 1 -- 172.21.15.153:0/277763811 learned_addr learned my addr 172.21.15.153:0/277763811 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396ed9d700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39700639a0 0x7f39700c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396e59c700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700acf30 0x7f39700aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396f59e700 1 -- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700acf30 msgr2=0x7f39700aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396f59e700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700acf30 0x7f39700aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396f59e700 1 -- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39700639a0 msgr2=0x7f39700c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396f59e700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39700639a0 0x7f39700c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396f59e700 1 -- 172.21.15.153:0/277763811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640092a0 con 0x7f39700b0480 2023-08-17T00:03:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396e59c700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700acf30 0x7f39700aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f396f59e700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 0x7f39700ad840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f3968009e90 tx=0x7f396800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396800cb50 con 0x7f39700b0480 2023-08-17T00:03:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396800f040 con 0x7f39700b0480 2023-08-17T00:03:23.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39700c8b80 con 0x7f39700b0480 2023-08-17T00:03:23.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396800cec0 con 0x7f39700b0480 2023-08-17T00:03:23.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39700c9140 con 0x7f39700b0480 2023-08-17T00:03:23.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.602+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f397006b4c0 con 0x7f39700b0480 2023-08-17T00:03:23.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.606+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3968013610 con 0x7f39700b0480 2023-08-17T00:03:23.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.606+0000 7f3956ffd700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f395c05a150 0x7f395c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:23.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.606+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3968074aa0 con 0x7f39700b0480 2023-08-17T00:03:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.606+0000 7f396ed9d700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f395c05a150 0x7f395c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.606+0000 7f396ed9d700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f395c05a150 0x7f395c05c610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3960005750 tx=0x7f3960009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.610+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3968048550 con 0x7f39700b0480 2023-08-17T00:03:23.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.770+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3970154280 con 0x7f39700b0480 2023-08-17T00:03:23.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.770+0000 7f3956ffd700 1 -- 172.21.15.153:0/277763811 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f396804bb70 con 0x7f39700b0480 2023-08-17T00:03:23.778 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:23.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f395c05a150 msgr2=0x7f395c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f395c05a150 0x7f395c05c610 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3960005750 tx=0x7f3960009040).stop 2023-08-17T00:03:23.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 msgr2=0x7f39700ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 0x7f39700ad840 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f3968009e90 tx=0x7f396800b040).stop 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 shutdown_connections 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f395c05a150 0x7f395c05c610 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39700b0480 0x7f39700ad840 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39700acf30 0x7f39700aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 --2- 172.21.15.153:0/277763811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39700639a0 0x7f39700c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 >> 172.21.15.153:0/277763811 conn(0x7f39700cb330 msgr2=0x7f39700c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:23.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.774+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 shutdown_connections 2023-08-17T00:03:23.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:23.778+0000 7f3974968700 1 -- 172.21.15.153:0/277763811 wait complete. 2023-08-17T00:03:23.868 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-08-17T00:03:23.871 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2023-08-17T00:03:24.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 Processor -- start 2023-08-17T00:03:24.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 -- start start 2023-08-17T00:03:24.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a10068da0 0x7f2a101560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a10065da0 con 0x7f2a100689c0 2023-08-17T00:03:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a10069200 con 0x7f2a10068da0 2023-08-17T00:03:24.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a14ce4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a10155c60 con 0x7f2a10151530 2023-08-17T00:03:24.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a0ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a07fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a10068da0 0x7f2a101560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a0f7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2a100689c0 0x7f2a100c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:57240/0 (socket says 172.21.15.153:57240) 2023-08-17T00:03:24.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a0f7fe700 1 -- 172.21.15.153:0/1062230852 learned_addr learned my addr 172.21.15.153:0/1062230852 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:24.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.026+0000 7f2a0ffff700 1 --2- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:37612/0 (socket says 172.21.15.153:37612) 2023-08-17T00:03:24.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a0effd700 1 -- 172.21.15.153:0/1062230852 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3526136582 0 0) 0x7f2a10065da0 con 0x7f2a100689c0 2023-08-17T00:03:24.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a0effd700 1 -- 172.21.15.153:0/1062230852 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29fc0033f0 con 0x7f2a100689c0 2023-08-17T00:03:24.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a07fff700 1 -- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10151530 msgr2=0x7f2a101519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:24.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a07fff700 1 --2- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a07fff700 1 -- 172.21.15.153:0/1062230852 >> v1:172.21.15.178:6789/0 conn(0x7f2a100689c0 legacy=0x7f2a100c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a07fff700 1 -- 172.21.15.153:0/1062230852 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10065ff0 con 0x7f2a10068da0 2023-08-17T00:03:24.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a07fff700 1 --2- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a10068da0 0x7f2a101560f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f29f8009760 tx=0x7f29f8009060).ready entity=mon.1 client_cookie=f0be48da764ca7bd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:24.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a0effd700 1 -- 172.21.15.153:0/1062230852 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f80090d0 con 0x7f2a10068da0 2023-08-17T00:03:24.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a0effd700 1 -- 172.21.15.153:0/1062230852 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29f800d4a0 con 0x7f2a10068da0 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a0effd700 1 -- 172.21.15.153:0/1062230852 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29f800d820 con 0x7f2a10068da0 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 -- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a10068da0 msgr2=0x7f2a101560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a10068da0 0x7f2a101560f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f29f8009760 tx=0x7f29f8009060).stop 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 -- 172.21.15.153:0/1062230852 shutdown_connections 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/1062230852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a10068da0 0x7f2a101560f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 -- 172.21.15.153:0/1062230852 >> 172.21.15.153:0/1062230852 conn(0x7f2a100c6620 msgr2=0x7f2a100c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 -- 172.21.15.153:0/1062230852 shutdown_connections 2023-08-17T00:03:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.030+0000 7f2a14ce4700 1 -- 172.21.15.153:0/1062230852 wait complete. 2023-08-17T00:03:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 Processor -- start 2023-08-17T00:03:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 -- start start 2023-08-17T00:03:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a100689c0 0x7f2a100bd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10068da0 0x7f2a100bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100bf0e0 con 0x7f2a10151530 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100be4d0 con 0x7f2a100689c0 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a14ce4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a100be7b0 con 0x7f2a10068da0 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.034+0000 7f2a0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42434/0 (socket says 172.21.15.153:42434) 2023-08-17T00:03:24.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 -- 172.21.15.153:0/3419846553 learned_addr learned my addr 172.21.15.153:0/3419846553 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0f7fe700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a100689c0 0x7f2a100bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a07fff700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10068da0 0x7f2a100bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 -- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10068da0 msgr2=0x7f2a100bdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10068da0 0x7f2a100bdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 -- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a100689c0 msgr2=0x7f2a100bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a100689c0 0x7f2a100bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 -- 172.21.15.153:0/3419846553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80092a0 con 0x7f2a10151530 2023-08-17T00:03:24.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a0ffff700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 0x7f2a101519c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f2a08009e90 tx=0x7f2a0800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:24.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800caa0 con 0x7f2a10151530 2023-08-17T00:03:24.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0800f040 con 0x7f2a10151530 2023-08-17T00:03:24.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800ce10 con 0x7f2a10151530 2023-08-17T00:03:24.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a100bea90 con 0x7f2a10151530 2023-08-17T00:03:24.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a10150520 con 0x7f2a10151530 2023-08-17T00:03:24.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.038+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a100bf250 con 0x7f2a10151530 2023-08-17T00:03:24.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.042+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2a08013610 con 0x7f2a10151530 2023-08-17T00:03:24.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.042+0000 7f2a077fe700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29f005a150 0x7f29f005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.042+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2a08074bd0 con 0x7f2a10151530 2023-08-17T00:03:24.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.042+0000 7f2a0f7fe700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29f005a150 0x7f29f005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.042+0000 7f2a0f7fe700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29f005a150 0x7f29f005c610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f2a000057a0 tx=0x7f2a00009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.050+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a08048570 con 0x7f2a10151530 2023-08-17T00:03:24.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.262+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f2a1006b4c0 con 0x7f2a10151530 2023-08-17T00:03:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.394+0000 7f2a077fe700 1 -- 172.21.15.153:0/3419846553 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v50) v1 ==== 151+0+0 (secure 0 0 0) 0x7f2a0804bb90 con 0x7f2a10151530 2023-08-17T00:03:24.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29f005a150 msgr2=0x7f29f005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29f005a150 0x7f29f005c610 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f2a000057a0 tx=0x7f2a00009040).stop 2023-08-17T00:03:24.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 msgr2=0x7f2a101519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 0x7f2a101519c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f2a08009e90 tx=0x7f2a0800b040).stop 2023-08-17T00:03:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 shutdown_connections 2023-08-17T00:03:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29f005a150 0x7f29f005c610 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a10151530 0x7f2a101519c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a10068da0 0x7f2a100bdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 --2- 172.21.15.153:0/3419846553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a100689c0 0x7f2a100bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 >> 172.21.15.153:0/3419846553 conn(0x7f2a100c6620 msgr2=0x7f2a100bbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:24.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 shutdown_connections 2023-08-17T00:03:24.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.398+0000 7f2a14ce4700 1 -- 172.21.15.153:0/3419846553 wait complete. 2023-08-17T00:03:24.426 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:03:24.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.586+0000 7f39effff700 1 Processor -- start 2023-08-17T00:03:24.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.590+0000 7f39effff700 1 -- start start 2023-08-17T00:03:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.590+0000 7f39effff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f00c57a0 0x7f39f00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.590+0000 7f39effff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39f0153f50 0x7f39f0154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.590+0000 7f39effff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f00bfd10 con 0x7f39f0157600 2023-08-17T00:03:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.590+0000 7f39effff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f0154860 con 0x7f39f0153f50 2023-08-17T00:03:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.590+0000 7f39effff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f0154af0 con 0x7f39f00c57a0 2023-08-17T00:03:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39f0153f50 0x7f39f0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39f0153f50 0x7f39f0154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42440/0 (socket says 172.21.15.153:42440) 2023-08-17T00:03:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 -- 172.21.15.153:0/3171209577 learned_addr learned my addr 172.21.15.153:0/3171209577 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:24.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39eeffd700 1 --2- 172.21.15.153:0/3171209577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f00c57a0 0x7f39f00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 -- 172.21.15.153:0/3171209577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f00c57a0 msgr2=0x7f39f00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 --2- 172.21.15.153:0/3171209577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f00c57a0 0x7f39f00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 -- 172.21.15.153:0/3171209577 >> v1:172.21.15.153:6789/0 conn(0x7f39f0157600 legacy=0x7f39f0157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 -- 172.21.15.153:0/3171209577 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0154dd0 con 0x7f39f0153f50 2023-08-17T00:03:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39ee7fc700 1 --2- 172.21.15.153:0/3171209577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f0154370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f39e4006fd0 tx=0x7f39e40090f0).ready entity=mon.0 client_cookie=eadca6664cf20e87 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39edffb700 1 -- 172.21.15.153:0/3171209577 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400b580 con 0x7f39f0153f50 2023-08-17T00:03:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39edffb700 1 -- 172.21.15.153:0/3171209577 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400b6e0 con 0x7f39f0153f50 2023-08-17T00:03:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39edffb700 1 -- 172.21.15.153:0/3171209577 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400ba60 con 0x7f39f0153f50 2023-08-17T00:03:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 -- 172.21.15.153:0/3171209577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 msgr2=0x7f39f0154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 --2- 172.21.15.153:0/3171209577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f0154370 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f39e4006fd0 tx=0x7f39e40090f0).stop 2023-08-17T00:03:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 -- 172.21.15.153:0/3171209577 shutdown_connections 2023-08-17T00:03:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 --2- 172.21.15.153:0/3171209577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f0154370 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 --2- 172.21.15.153:0/3171209577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f00c57a0 0x7f39f00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 -- 172.21.15.153:0/3171209577 >> 172.21.15.153:0/3171209577 conn(0x7f39f0062a70 msgr2=0x7f39f00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 -- 172.21.15.153:0/3171209577 shutdown_connections 2023-08-17T00:03:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.594+0000 7f39effff700 1 -- 172.21.15.153:0/3171209577 wait complete. 2023-08-17T00:03:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 Processor -- start 2023-08-17T00:03:24.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 -- start start 2023-08-17T00:03:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39f00c57a0 0x7f39f01645e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f00c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f0157600 0x7f39f0167230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00c8290 con 0x7f39f0153f50 2023-08-17T00:03:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00c7710 con 0x7f39f00c57a0 2023-08-17T00:03:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39effff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f00c79f0 con 0x7f39f0157600 2023-08-17T00:03:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f00c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f00c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42446/0 (socket says 172.21.15.153:42446) 2023-08-17T00:03:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 -- 172.21.15.153:0/4102217908 learned_addr learned my addr 172.21.15.153:0/4102217908 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39eeffd700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39f00c57a0 0x7f39f01645e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ef7fe700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f0157600 0x7f39f0167230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 -- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f0157600 msgr2=0x7f39f0167230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f0157600 0x7f39f0167230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 -- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39f00c57a0 msgr2=0x7f39f01645e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39f00c57a0 0x7f39f01645e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 -- 172.21.15.153:0/4102217908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009370 con 0x7f39f0153f50 2023-08-17T00:03:24.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.598+0000 7f39ee7fc700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f00c9b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f39e4006df0 tx=0x7f39e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:24.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400b850 con 0x7f39f0153f50 2023-08-17T00:03:24.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400b9b0 con 0x7f39f0153f50 2023-08-17T00:03:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f00c7cd0 con 0x7f39f0153f50 2023-08-17T00:03:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e401b660 con 0x7f39f0153f50 2023-08-17T00:03:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f00ca080 con 0x7f39f0153f50 2023-08-17T00:03:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f006b4c0 con 0x7f39f0153f50 2023-08-17T00:03:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f39e402b070 con 0x7f39f0153f50 2023-08-17T00:03:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.602+0000 7f39d6ffd700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39dc05a150 0x7f39dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.606+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f39e4075bc0 con 0x7f39f0153f50 2023-08-17T00:03:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.606+0000 7f39eeffd700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39dc05a150 0x7f39dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:24.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.606+0000 7f39eeffd700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39dc05a150 0x7f39dc05c610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f39e0009b20 tx=0x7f39e0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:24.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.610+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39e40495e0 con 0x7f39f0153f50 2023-08-17T00:03:24.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.774+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f39f00bf9a0 con 0x7f39f0153f50 2023-08-17T00:03:24.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.782+0000 7f39d6ffd700 1 -- 172.21.15.153:0/4102217908 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f39e4029070 con 0x7f39f0153f50 2023-08-17T00:03:24.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39dc05a150 msgr2=0x7f39dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39dc05a150 0x7f39dc05c610 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f39e0009b20 tx=0x7f39e0008040).stop 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 msgr2=0x7f39f00c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f00c9b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f39e4006df0 tx=0x7f39e4017000).stop 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 shutdown_connections 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39dc05a150 0x7f39dc05c610 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39f0157600 0x7f39f0167230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39f0153f50 0x7f39f00c9b90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 --2- 172.21.15.153:0/4102217908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39f00c57a0 0x7f39f01645e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 >> 172.21.15.153:0/4102217908 conn(0x7f39f0062a70 msgr2=0x7f39f00aa910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 shutdown_connections 2023-08-17T00:03:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:24.786+0000 7f39effff700 1 -- 172.21.15.153:0/4102217908 wait complete. 2023-08-17T00:03:24.811 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:03:24.812 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:03:24.857 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:03:24.902 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:03:24.903 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:03:24.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:03:24.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-08-17T00:03:25.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:03:25.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:25.010 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:03:25.040 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-17T00:03:25.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:03:25.041 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-08-17T00:03:25.111 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:03:25.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:25.112 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-17T00:03:25.136 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-17T00:03:25.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:03:25.137 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-08-17T00:03:25.218 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:03:25.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:25.219 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-17T00:03:25.239 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-17T00:03:25.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:03:25.239 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-08-17T00:03:25.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:03:25.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:25.329 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-17T00:03:25.348 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:03:25.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.506+0000 7f2b213db700 1 Processor -- start 2023-08-17T00:03:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.510+0000 7f2b213db700 1 -- start start 2023-08-17T00:03:25.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.510+0000 7f2b213db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 0x7f2b1c0bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.510+0000 7f2b213db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2b1c1503d0 0x7f2b1c0bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.510+0000 7f2b213db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0a9170 con 0x7f2b1c14fff0 2023-08-17T00:03:25.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.510+0000 7f2b213db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c0bcfd0 con 0x7f2b1c1503d0 2023-08-17T00:03:25.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.510+0000 7f2b213db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0c1b90 con 0x7f2b1c153da0 2023-08-17T00:03:25.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2b1c14fff0 0x7f2b1c062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54136/0 (socket says 172.21.15.153:54136) 2023-08-17T00:03:25.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1affd700 1 -- 172.21.15.153:0/1895616410 learned_addr learned my addr 172.21.15.153:0/1895616410 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:25.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1b7fe700 1 --2- 172.21.15.153:0/1895616410 >> v2:172.21.15.178:3300/0 conn(0x7f2b1c1503d0 0x7f2b1c0bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 0x7f2b1c0bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1343398017 0 0) 0x7f2b1c0a9170 con 0x7f2b1c14fff0 2023-08-17T00:03:25.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b080033f0 con 0x7f2b1c14fff0 2023-08-17T00:03:25.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 64627675 0 0) 0x7f2b080033f0 con 0x7f2b1c14fff0 2023-08-17T00:03:25.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 msgr2=0x7f2b1c0bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 0x7f2b1c0bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 >> v2:172.21.15.178:3300/0 conn(0x7f2b1c1503d0 msgr2=0x7f2b1c0bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 --2- 172.21.15.153:0/1895616410 >> v2:172.21.15.178:3300/0 conn(0x7f2b1c1503d0 0x7f2b1c0bbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c154280 con 0x7f2b1c14fff0 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f2b0c0017f0 con 0x7f2b1c14fff0 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 >> v1:172.21.15.153:6789/0 conn(0x7f2b1c14fff0 legacy=0x7f2b1c062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 0x7f2b080038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b08003e10 0x7f2b08004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b08004b80 0x7f2b08005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0bcfd0 con 0x7f2b08003e10 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0c1b90 con 0x7f2b08004b80 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0800daf0 con 0x7f2b1c153da0 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b08003e10 0x7f2b08004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1affd700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 0x7f2b080038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1b7fe700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b08004b80 0x7f2b08005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 -- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 msgr2=0x7f2b080038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b1c153da0 0x7f2b080038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 -- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b08004b80 msgr2=0x7f2b08005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b08004b80 0x7f2b08005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 -- 172.21.15.153:0/1895616410 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080033f0 con 0x7f2b08003e10 2023-08-17T00:03:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b13fff700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b08003e10 0x7f2b08004690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2b04009ab0 tx=0x7f2b04009060).ready entity=mon.0 client_cookie=56b711c83f061d01 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:25.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04009430 con 0x7f2b08003e10 2023-08-17T00:03:25.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400e640 con 0x7f2b08003e10 2023-08-17T00:03:25.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.514+0000 7f2b1a7fc700 1 -- 172.21.15.153:0/1895616410 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400e9c0 con 0x7f2b08003e10 2023-08-17T00:03:25.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 -- 172.21.15.153:0/1895616410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b08003e10 msgr2=0x7f2b08004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 --2- 172.21.15.153:0/1895616410 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b08003e10 0x7f2b08004690 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f2b04009ab0 tx=0x7f2b04009060).stop 2023-08-17T00:03:25.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b1b7fe700 1 -- 172.21.15.153:0/1895616410 reap_dead start 2023-08-17T00:03:25.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 -- 172.21.15.153:0/1895616410 shutdown_connections 2023-08-17T00:03:25.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 -- 172.21.15.153:0/1895616410 >> 172.21.15.153:0/1895616410 conn(0x7f2b1c0c7150 msgr2=0x7f2b1c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:25.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 -- 172.21.15.153:0/1895616410 shutdown_connections 2023-08-17T00:03:25.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 -- 172.21.15.153:0/1895616410 wait complete. 2023-08-17T00:03:25.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 Processor -- start 2023-08-17T00:03:25.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.518+0000 7f2b213db700 1 -- start start 2023-08-17T00:03:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b08003e10 0x7f2b1c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 0x7f2b1c1433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c0c51c0 0x7f2b1c0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c1535d0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0abc90 con 0x7f2b1c0c51c0 2023-08-17T00:03:25.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0c5b30 con 0x7f2b08003e10 2023-08-17T00:03:25.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 0x7f2b1c1433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 0x7f2b1c1433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51906/0 (socket says 172.21.15.153:51906) 2023-08-17T00:03:25.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 -- 172.21.15.153:0/2033677647 learned_addr learned my addr 172.21.15.153:0/2033677647 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:25.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b1b7fe700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c0c51c0 0x7f2b1c0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b1affd700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b08003e10 0x7f2b1c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 -- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b08003e10 msgr2=0x7f2b1c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b08003e10 0x7f2b1c1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 -- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c0c51c0 msgr2=0x7f2b1c0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c0c51c0 0x7f2b1c0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 -- 172.21.15.153:0/2033677647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c0ab110 con 0x7f2b1c0aac80 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b1b7fe700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c0c51c0 0x7f2b1c0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b13fff700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 0x7f2b1c1433c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f2b0401dfd0 tx=0x7f2b0401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:25.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04000ce0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0400e7b0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b04026690 con 0x7f2b1c0aac80 2023-08-17T00:03:25.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1c0ab3f0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.522+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c0ab9b0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.526+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c06b530 con 0x7f2b1c0aac80 2023-08-17T00:03:25.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.526+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2b0402c020 con 0x7f2b1c0aac80 2023-08-17T00:03:25.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.526+0000 7f2b12ffd700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2afc05a180 0x7f2afc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.526+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2b04075ca0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.526+0000 7f2b1affd700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2afc05a180 0x7f2afc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.530+0000 7f2b1affd700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2afc05a180 0x7f2afc05c640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2b0c007e50 tx=0x7f2b0c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:25.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.534+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2b040496d0 con 0x7f2b1c0aac80 2023-08-17T00:03:25.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.726+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b1c154560 con 0x7f2b1c0aac80 2023-08-17T00:03:25.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.726+0000 7f2b12ffd700 1 -- 172.21.15.153:0/2033677647 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f2b04016070 con 0x7f2b1c0aac80 2023-08-17T00:03:25.731 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:25.731 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:25.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2afc05a180 msgr2=0x7f2afc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2afc05a180 0x7f2afc05c640 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f2b0c007e50 tx=0x7f2b0c009040).stop 2023-08-17T00:03:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 msgr2=0x7f2b1c1433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 0x7f2b1c1433c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f2b0401dfd0 tx=0x7f2b0401a000).stop 2023-08-17T00:03:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 shutdown_connections 2023-08-17T00:03:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2afc05a180 0x7f2afc05c640 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b1c0c51c0 0x7f2b1c0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2b1c0aac80 0x7f2b1c1433c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 --2- 172.21.15.153:0/2033677647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b08003e10 0x7f2b1c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 >> 172.21.15.153:0/2033677647 conn(0x7f2b1c0c7150 msgr2=0x7f2b1c065480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:25.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 shutdown_connections 2023-08-17T00:03:25.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.730+0000 7f2b213db700 1 -- 172.21.15.153:0/2033677647 wait complete. 2023-08-17T00:03:25.739 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:25.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:25.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.910+0000 7fc080a9b700 1 Processor -- start 2023-08-17T00:03:25.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.910+0000 7fc080a9b700 1 -- start start 2023-08-17T00:03:25.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.910+0000 7fc080a9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc07c151760 0x7fc07c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.910+0000 7fc080a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c063780 0x7fc07c065080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.910+0000 7fc080a9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c062e90 con 0x7fc07c063320 2023-08-17T00:03:25.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc080a9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c061fa0 con 0x7fc07c151760 2023-08-17T00:03:25.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc080a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c062280 con 0x7fc07c063780 2023-08-17T00:03:25.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc07c151760 0x7fc07c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc07c151760 0x7fc07c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51912/0 (socket says 172.21.15.153:51912) 2023-08-17T00:03:25.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 -- 172.21.15.153:0/890760275 learned_addr learned my addr 172.21.15.153:0/890760275 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:25.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc073fff700 1 --1- 172.21.15.153:0/890760275 >> v1:172.21.15.178:6789/0 conn(0x7fc07c063320 0x7fc07c0c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:49680/0 (socket says 172.21.15.153:49680) 2023-08-17T00:03:25.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07ad9d700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c063780 0x7fc07c065080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 -- 172.21.15.153:0/890760275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c063780 msgr2=0x7fc07c065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:25.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c063780 0x7fc07c065080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 -- 172.21.15.153:0/890760275 >> v1:172.21.15.178:6789/0 conn(0x7fc07c063320 legacy=0x7fc07c0c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc079d9b700 1 -- 172.21.15.153:0/890760275 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130138240 0 0) 0x7fc07c062e90 con 0x7fc07c063320 2023-08-17T00:03:25.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 -- 172.21.15.153:0/890760275 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c062560 con 0x7fc07c151760 2023-08-17T00:03:25.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07ad9d700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c063780 0x7fc07c065080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:25.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc07a59c700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c151760 0x7fc07c151b40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fc06c006fd0 tx=0x7fc06c0090f0).ready entity=mon.0 client_cookie=8b2f29815de3283 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:25.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc079d9b700 1 -- 172.21.15.153:0/890760275 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00b580 con 0x7fc07c151760 2023-08-17T00:03:25.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc079d9b700 1 -- 172.21.15.153:0/890760275 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00b6e0 con 0x7fc07c151760 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.914+0000 7fc079d9b700 1 -- 172.21.15.153:0/890760275 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c00ba80 con 0x7fc07c151760 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 -- 172.21.15.153:0/890760275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c151760 msgr2=0x7fc07c151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c151760 0x7fc07c151b40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fc06c006fd0 tx=0x7fc06c0090f0).stop 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 -- 172.21.15.153:0/890760275 shutdown_connections 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c063780 0x7fc07c065080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 --2- 172.21.15.153:0/890760275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c151760 0x7fc07c151b40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 -- 172.21.15.153:0/890760275 >> 172.21.15.153:0/890760275 conn(0x7fc07c0c30b0 msgr2=0x7fc07c0c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:25.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 -- 172.21.15.153:0/890760275 shutdown_connections 2023-08-17T00:03:25.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 -- 172.21.15.153:0/890760275 wait complete. 2023-08-17T00:03:25.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 Processor -- start 2023-08-17T00:03:25.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.918+0000 7fc080a9b700 1 -- start start 2023-08-17T00:03:25.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc07c063320 0x7fc07c14b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 0x7fc07c0aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c151760 0x7fc07c0a5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c164880 con 0x7fc07c063780 2023-08-17T00:03:25.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c164b60 con 0x7fc07c063320 2023-08-17T00:03:25.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c164e40 con 0x7fc07c151760 2023-08-17T00:03:25.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 0x7fc07c0aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 0x7fc07c0aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51926/0 (socket says 172.21.15.153:51926) 2023-08-17T00:03:25.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 -- 172.21.15.153:0/1743509320 learned_addr learned my addr 172.21.15.153:0/1743509320 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:25.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 -- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c151760 msgr2=0x7fc07c0a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc07ad9d700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c151760 0x7fc07c0a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc07a59c700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc07c063320 0x7fc07c14b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c151760 0x7fc07c0a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 -- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc07c063320 msgr2=0x7fc07c14b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc07c063320 0x7fc07c14b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 -- 172.21.15.153:0/1743509320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009a20 con 0x7fc07c063780 2023-08-17T00:03:25.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc07ad9d700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c151760 0x7fc07c0a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc07a59c700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc07c063320 0x7fc07c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc073fff700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 0x7fc07c0aabb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fc06400c560 tx=0x7fc064007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640072e0 con 0x7fc07c063780 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc064007440 con 0x7fc07c063780 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640058f0 con 0x7fc07c063780 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c009370 con 0x7fc07c063780 2023-08-17T00:03:25.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c0ab0a0 con 0x7fc07c063780 2023-08-17T00:03:25.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.922+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c06b4c0 con 0x7fc07c063780 2023-08-17T00:03:25.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.926+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc064010070 con 0x7fc07c063780 2023-08-17T00:03:25.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.926+0000 7fc0727fc700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc05c05a150 0x7fc05c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:25.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.926+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc064073930 con 0x7fc07c063780 2023-08-17T00:03:25.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.926+0000 7fc07a59c700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc05c05a150 0x7fc05c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:25.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.926+0000 7fc07a59c700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc05c05a150 0x7fc05c05c610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc06c009fd0 tx=0x7fc06c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:25.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:25.930+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0640472d0 con 0x7fc07c063780 2023-08-17T00:03:26.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.094+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc07c062840 con 0x7fc07c063780 2023-08-17T00:03:26.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc0727fc700 1 -- 172.21.15.153:0/1743509320 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fc06404a8f0 con 0x7fc07c063780 2023-08-17T00:03:26.102 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:26.102 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc05c05a150 msgr2=0x7fc05c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc05c05a150 0x7fc05c05c610 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7fc06c009fd0 tx=0x7fc06c017000).stop 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 msgr2=0x7fc07c0aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 0x7fc07c0aabb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fc06400c560 tx=0x7fc064007c90).stop 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 shutdown_connections 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc05c05a150 0x7fc05c05c610 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc07c151760 0x7fc07c0a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc07c063780 0x7fc07c0aabb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 --2- 172.21.15.153:0/1743509320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc07c063320 0x7fc07c14b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.098+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 >> 172.21.15.153:0/1743509320 conn(0x7fc07c0c30b0 msgr2=0x7fc07c14c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:26.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.102+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 shutdown_connections 2023-08-17T00:03:26.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.102+0000 7fc080a9b700 1 -- 172.21.15.153:0/1743509320 wait complete. 2023-08-17T00:03:26.126 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:02:49.715312+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:02:50.767571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:03:26.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.282+0000 7fad36439700 1 Processor -- start 2023-08-17T00:03:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad36439700 1 -- start start 2023-08-17T00:03:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad36439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad300c5ea0 0x7fad300634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad36439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad36439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad30154e90 con 0x7fad300acf30 2023-08-17T00:03:26.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad36439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad300c1730 con 0x7fad300c5ea0 2023-08-17T00:03:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad36439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad30063df0 con 0x7fad300639a0 2023-08-17T00:03:26.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad34c36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad300c5ea0 0x7fad300634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad35437700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fad300acf30 0x7fad300c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54150/0 (socket says 172.21.15.153:54150) 2023-08-17T00:03:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad35437700 1 -- 172.21.15.153:0/2430554265 learned_addr learned my addr 172.21.15.153:0/2430554265 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:26.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad35c38700 1 --2- 172.21.15.153:0/2430554265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad34c36700 1 -- 172.21.15.153:0/2430554265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 msgr2=0x7fad300bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad34c36700 1 --2- 172.21.15.153:0/2430554265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad34c36700 1 -- 172.21.15.153:0/2430554265 >> v1:172.21.15.153:6789/0 conn(0x7fad300acf30 legacy=0x7fad300c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad34c36700 1 -- 172.21.15.153:0/2430554265 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30153fc0 con 0x7fad300c5ea0 2023-08-17T00:03:26.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.286+0000 7fad34c36700 1 --2- 172.21.15.153:0/2430554265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300c5ea0 0x7fad300634b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fad20009760 tx=0x7fad20009060).ready entity=mon.0 client_cookie=fd38ed6253f1dbda server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:26.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad27fff700 1 -- 172.21.15.153:0/2430554265 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200090d0 con 0x7fad300c5ea0 2023-08-17T00:03:26.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad27fff700 1 -- 172.21.15.153:0/2430554265 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2000f510 con 0x7fad300c5ea0 2023-08-17T00:03:26.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad27fff700 1 -- 172.21.15.153:0/2430554265 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2000f890 con 0x7fad300c5ea0 2023-08-17T00:03:26.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 -- 172.21.15.153:0/2430554265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300c5ea0 msgr2=0x7fad300634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 --2- 172.21.15.153:0/2430554265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300c5ea0 0x7fad300634b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fad20009760 tx=0x7fad20009060).stop 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 -- 172.21.15.153:0/2430554265 shutdown_connections 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 --2- 172.21.15.153:0/2430554265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 --2- 172.21.15.153:0/2430554265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300c5ea0 0x7fad300634b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 -- 172.21.15.153:0/2430554265 >> 172.21.15.153:0/2430554265 conn(0x7fad300cb330 msgr2=0x7fad300c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 -- 172.21.15.153:0/2430554265 shutdown_connections 2023-08-17T00:03:26.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 -- 172.21.15.153:0/2430554265 wait complete. 2023-08-17T00:03:26.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 Processor -- start 2023-08-17T00:03:26.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.290+0000 7fad36439700 1 -- start start 2023-08-17T00:03:26.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300acf30 0x7fad300c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 0x7fad300c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300c1bd0 con 0x7fad30148920 2023-08-17T00:03:26.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300c4320 con 0x7fad300acf30 2023-08-17T00:03:26.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300c4600 con 0x7fad300639a0 2023-08-17T00:03:26.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 0x7fad300c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad34c36700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300acf30 0x7fad300c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 0x7fad300c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51946/0 (socket says 172.21.15.153:51946) 2023-08-17T00:03:26.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 -- 172.21.15.153:0/2638398237 learned_addr learned my addr 172.21.15.153:0/2638398237 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad34c36700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300acf30 0x7fad300c53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:51024/0 (socket says 172.21.15.153:51024) 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35437700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 -- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 msgr2=0x7fad300b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 -- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300acf30 msgr2=0x7fad300c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300acf30 0x7fad300c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 -- 172.21.15.153:0/2638398237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200092a0 con 0x7fad30148920 2023-08-17T00:03:26.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad35c38700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 0x7fad300c3a60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fad28009e90 tx=0x7fad2800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:26.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800caa0 con 0x7fad30148920 2023-08-17T00:03:26.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2800f040 con 0x7fad30148920 2023-08-17T00:03:26.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800ce10 con 0x7fad30148920 2023-08-17T00:03:26.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad300c48e0 con 0x7fad30148920 2023-08-17T00:03:26.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.294+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad300c4ea0 con 0x7fad30148920 2023-08-17T00:03:26.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.298+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3006b4c0 con 0x7fad30148920 2023-08-17T00:03:26.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.298+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fad28013610 con 0x7fad30148920 2023-08-17T00:03:26.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.298+0000 7fad257fa700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1405a180 0x7fad1405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.298+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fad28074ae0 con 0x7fad30148920 2023-08-17T00:03:26.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.302+0000 7fad35437700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1405a180 0x7fad1405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.302+0000 7fad35437700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1405a180 0x7fad1405c640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fad2c007fd0 tx=0x7fad2c007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:26.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.306+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad28048480 con 0x7fad30148920 2023-08-17T00:03:26.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.461+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fad30154280 con 0x7fad30148920 2023-08-17T00:03:26.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad257fa700 1 -- 172.21.15.153:0/2638398237 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fad2804baa0 con 0x7fad30148920 2023-08-17T00:03:26.470 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:26.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1405a180 msgr2=0x7fad1405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1405a180 0x7fad1405c640 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fad2c007fd0 tx=0x7fad2c007d30).stop 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 msgr2=0x7fad300c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 0x7fad300c3a60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fad28009e90 tx=0x7fad2800b040).stop 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 shutdown_connections 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1405a180 0x7fad1405c640 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad30148920 0x7fad300c3a60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300acf30 0x7fad300c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 --2- 172.21.15.153:0/2638398237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad300639a0 0x7fad300b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 >> 172.21.15.153:0/2638398237 conn(0x7fad300cb330 msgr2=0x7fad30152350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:26.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 shutdown_connections 2023-08-17T00:03:26.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.465+0000 7fad36439700 1 -- 172.21.15.153:0/2638398237 wait complete. 2023-08-17T00:03:26.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.645+0000 7f707ce5b700 1 Processor -- start 2023-08-17T00:03:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707ce5b700 1 -- start start 2023-08-17T00:03:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707ce5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70780c2b70 0x7f70781542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707ce5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70781547b0 0x7f7078062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707ce5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7078063950 con 0x7f70780634a0 2023-08-17T00:03:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707ce5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7078155280 con 0x7f70781547b0 2023-08-17T00:03:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707ce5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7078066140 con 0x7f70780c2b70 2023-08-17T00:03:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70781547b0 0x7f7078062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70781547b0 0x7f7078062fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51960/0 (socket says 172.21.15.153:51960) 2023-08-17T00:03:26.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 -- 172.21.15.153:0/685156133 learned_addr learned my addr 172.21.15.153:0/685156133 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:26.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f707659c700 1 --2- 172.21.15.153:0/685156133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70780c2b70 0x7f70781542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 -- 172.21.15.153:0/685156133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70780c2b70 msgr2=0x7f70781542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:26.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 --2- 172.21.15.153:0/685156133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70780c2b70 0x7f70781542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 -- 172.21.15.153:0/685156133 >> v1:172.21.15.153:6789/0 conn(0x7f70780634a0 legacy=0x7f70780bbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.649+0000 7f7075d9b700 1 -- 172.21.15.153:0/685156133 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078154cc0 con 0x7f70781547b0 2023-08-17T00:03:26.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f7075d9b700 1 --2- 172.21.15.153:0/685156133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70781547b0 0x7f7078062fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f706c006fd0 tx=0x7f706c0090f0).ready entity=mon.0 client_cookie=3ff266778681cb95 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:26.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707559a700 1 -- 172.21.15.153:0/685156133 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00b600 con 0x7f70781547b0 2023-08-17T00:03:26.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707559a700 1 -- 172.21.15.153:0/685156133 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c00b760 con 0x7f70781547b0 2023-08-17T00:03:26.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707559a700 1 -- 172.21.15.153:0/685156133 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00bb00 con 0x7f70781547b0 2023-08-17T00:03:26.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 -- 172.21.15.153:0/685156133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70781547b0 msgr2=0x7f7078062fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 --2- 172.21.15.153:0/685156133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70781547b0 0x7f7078062fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f706c006fd0 tx=0x7f706c0090f0).stop 2023-08-17T00:03:26.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 -- 172.21.15.153:0/685156133 shutdown_connections 2023-08-17T00:03:26.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 --2- 172.21.15.153:0/685156133 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70781547b0 0x7f7078062fb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 --2- 172.21.15.153:0/685156133 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70780c2b70 0x7f70781542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 -- 172.21.15.153:0/685156133 >> 172.21.15.153:0/685156133 conn(0x7f70780c41d0 msgr2=0x7f7078068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:26.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 -- 172.21.15.153:0/685156133 shutdown_connections 2023-08-17T00:03:26.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 -- 172.21.15.153:0/685156133 wait complete. 2023-08-17T00:03:26.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.653+0000 7f707ce5b700 1 Processor -- start 2023-08-17T00:03:26.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 -- start start 2023-08-17T00:03:26.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70780634a0 0x7f707814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 0x7f7078164c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70781547b0 0x7f7078155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078165c40 con 0x7f70780c2b70 2023-08-17T00:03:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7078165680 con 0x7f70780634a0 2023-08-17T00:03:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707ce5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7078165960 con 0x7f70781547b0 2023-08-17T00:03:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 0x7f7078164c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 0x7f7078164c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51968/0 (socket says 172.21.15.153:51968) 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 -- 172.21.15.153:0/205591721 learned_addr learned my addr 172.21.15.153:0/205591721 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7076d9d700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70781547b0 0x7f7078155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f707659c700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70780634a0 0x7f707814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 -- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70781547b0 msgr2=0x7f7078155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70781547b0 0x7f7078155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 -- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70780634a0 msgr2=0x7f707814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70780634a0 0x7f707814e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 -- 172.21.15.153:0/205591721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c009370 con 0x7f70780c2b70 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7076d9d700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70781547b0 0x7f7078155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.657+0000 7f7075d9b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 0x7f7078164c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f706c011000 tx=0x7f706c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00bec0 con 0x7f70780c2b70 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c006930 con 0x7f70780c2b70 2023-08-17T00:03:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70780bf810 con 0x7f70780c2b70 2023-08-17T00:03:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c00bb00 con 0x7f70780c2b70 2023-08-17T00:03:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7078158020 con 0x7f70780c2b70 2023-08-17T00:03:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707806b530 con 0x7f70780c2b70 2023-08-17T00:03:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.661+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f706c00f070 con 0x7f70780c2b70 2023-08-17T00:03:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.665+0000 7f70667fc700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f705805a180 0x7f705805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.665+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f706c075d00 con 0x7f70780c2b70 2023-08-17T00:03:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.665+0000 7f707659c700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f705805a180 0x7f705805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.665+0000 7f707659c700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f705805a180 0x7f705805c640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7078157bc0 tx=0x7f7068008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.669+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f706c0496a0 con 0x7f70780c2b70 2023-08-17T00:03:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.825+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f707806a090 con 0x7f70780c2b70 2023-08-17T00:03:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.825+0000 7f70667fc700 1 -- 172.21.15.153:0/205591721 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f706c04ccc0 con 0x7f70780c2b70 2023-08-17T00:03:26.839 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f705805a180 msgr2=0x7f705805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f705805a180 0x7f705805c640 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f7078157bc0 tx=0x7f7068008040).stop 2023-08-17T00:03:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 msgr2=0x7f7078164c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:26.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 0x7f7078164c70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f706c011000 tx=0x7f706c017000).stop 2023-08-17T00:03:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 shutdown_connections 2023-08-17T00:03:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f705805a180 0x7f705805c640 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70781547b0 0x7f7078155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70780c2b70 0x7f7078164c70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 --2- 172.21.15.153:0/205591721 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70780634a0 0x7f707814e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:26.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 >> 172.21.15.153:0/205591721 conn(0x7f70780c41d0 msgr2=0x7f70780bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:26.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 shutdown_connections 2023-08-17T00:03:26.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:26.829+0000 7f707ce5b700 1 -- 172.21.15.153:0/205591721 wait complete. 2023-08-17T00:03:26.854 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:03:27.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.009+0000 7f22beab9700 1 Processor -- start 2023-08-17T00:03:27.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22beab9700 1 -- start start 2023-08-17T00:03:27.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22beab9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22b8150880 0x7f22b80a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22beab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8068f30 0x7f22b8064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22beab9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b80ab9b0 con 0x7f22b80a8e60 2023-08-17T00:03:27.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22beab9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80aada0 con 0x7f22b8150880 2023-08-17T00:03:27.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22beab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80ab080 con 0x7f22b8068f30 2023-08-17T00:03:27.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22bdab7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22b8150880 0x7f22b80a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22bdab7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22b8150880 0x7f22b80a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51978/0 (socket says 172.21.15.153:51978) 2023-08-17T00:03:27.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.013+0000 7f22bdab7700 1 -- 172.21.15.153:0/138632233 learned_addr learned my addr 172.21.15.153:0/138632233 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:27.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22be2b8700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8068f30 0x7f22b8064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bdab7700 1 -- 172.21.15.153:0/138632233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8068f30 msgr2=0x7f22b8064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:27.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bdab7700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8068f30 0x7f22b8064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bdab7700 1 -- 172.21.15.153:0/138632233 >> v1:172.21.15.153:6789/0 conn(0x7f22b80a8e60 legacy=0x7f22b8068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bdab7700 1 -- 172.21.15.153:0/138632233 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80ab360 con 0x7f22b8150880 2023-08-17T00:03:27.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22be2b8700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8068f30 0x7f22b8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:27.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bdab7700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b8150880 0x7f22b80a8970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f22b4006fd0 tx=0x7f22b400b3b0).ready entity=mon.0 client_cookie=d28bf612fb6442f3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bcab5700 1 -- 172.21.15.153:0/138632233 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b400b420 con 0x7f22b8150880 2023-08-17T00:03:27.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bcab5700 1 -- 172.21.15.153:0/138632233 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b400db40 con 0x7f22b8150880 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22bcab5700 1 -- 172.21.15.153:0/138632233 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4010470 con 0x7f22b8150880 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 -- 172.21.15.153:0/138632233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b8150880 msgr2=0x7f22b80a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b8150880 0x7f22b80a8970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f22b4006fd0 tx=0x7f22b400b3b0).stop 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 -- 172.21.15.153:0/138632233 shutdown_connections 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8068f30 0x7f22b8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 --2- 172.21.15.153:0/138632233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b8150880 0x7f22b80a8970 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 -- 172.21.15.153:0/138632233 >> 172.21.15.153:0/138632233 conn(0x7f22b80c6620 msgr2=0x7f22b80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:27.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 -- 172.21.15.153:0/138632233 shutdown_connections 2023-08-17T00:03:27.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.017+0000 7f22beab9700 1 -- 172.21.15.153:0/138632233 wait complete. 2023-08-17T00:03:27.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 Processor -- start 2023-08-17T00:03:27.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 -- start start 2023-08-17T00:03:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22b8068f30 0x7f22b8064e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 0x7f22b8065340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 0x7f22b8152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b8065830 con 0x7f22b80a8e60 2023-08-17T00:03:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80bcf30 con 0x7f22b8068f30 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22beab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80bd8f0 con 0x7f22b8150880 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22bd2b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 0x7f22b8065340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22be2b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 0x7f22b8152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22bdab7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22b8068f30 0x7f22b8064e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22be2b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 0x7f22b8152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:58660/0 (socket says 172.21.15.153:58660) 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22be2b8700 1 -- 172.21.15.153:0/702176893 learned_addr learned my addr 172.21.15.153:0/702176893 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.021+0000 7f22bd2b6700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 0x7f22b8065340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51986/0 (socket says 172.21.15.153:51986) 2023-08-17T00:03:27.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bdab7700 1 -- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 msgr2=0x7f22b8152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bdab7700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 0x7f22b8152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bdab7700 1 -- 172.21.15.153:0/702176893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 msgr2=0x7f22b8065340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bdab7700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 0x7f22b8065340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bdab7700 1 -- 172.21.15.153:0/702176893 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b400b5b0 con 0x7f22b8068f30 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bd2b6700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 0x7f22b8065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22be2b8700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 0x7f22b8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22bdab7700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22b8068f30 0x7f22b8064e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f22b4016000 tx=0x7f22b400b3b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4019660 con 0x7f22b8068f30 2023-08-17T00:03:27.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b40197c0 con 0x7f22b8068f30 2023-08-17T00:03:27.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b8153b00 con 0x7f22b8068f30 2023-08-17T00:03:27.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b4019b80 con 0x7f22b8068f30 2023-08-17T00:03:27.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b80bde70 con 0x7f22b8068f30 2023-08-17T00:03:27.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.025+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b806b4c0 con 0x7f22b8068f30 2023-08-17T00:03:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.029+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f22b402a070 con 0x7f22b8068f30 2023-08-17T00:03:27.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.029+0000 7f22adffb700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f229c05a150 0x7f229c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.029+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22b4075bd0 con 0x7f22b8068f30 2023-08-17T00:03:27.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.029+0000 7f22bd2b6700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f229c05a150 0x7f229c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.029+0000 7f22bd2b6700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f229c05a150 0x7f229c05c610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f22b80625e0 tx=0x7f22a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.041+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22b4049740 con 0x7f22b8068f30 2023-08-17T00:03:27.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.201+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22b8064010 con 0x7f22b8068f30 2023-08-17T00:03:27.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.201+0000 7f22adffb700 1 -- 172.21.15.153:0/702176893 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22b4028020 con 0x7f22b8068f30 2023-08-17T00:03:27.209 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:27.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.205+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f229c05a150 msgr2=0x7f229c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.205+0000 7f22beab9700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f229c05a150 0x7f229c05c610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f22b80625e0 tx=0x7f22a8009040).stop 2023-08-17T00:03:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.205+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22b8068f30 msgr2=0x7f22b8064e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.205+0000 7f22beab9700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22b8068f30 0x7f22b8064e50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f22b4016000 tx=0x7f22b400b3b0).stop 2023-08-17T00:03:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 shutdown_connections 2023-08-17T00:03:27.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f229c05a150 0x7f229c05c610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22b8150880 0x7f22b8152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22b80a8e60 0x7f22b8065340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 --2- 172.21.15.153:0/702176893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22b8068f30 0x7f22b8064e50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 >> 172.21.15.153:0/702176893 conn(0x7f22b80c6620 msgr2=0x7f22b8062850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:27.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 shutdown_connections 2023-08-17T00:03:27.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.209+0000 7f22beab9700 1 -- 172.21.15.153:0/702176893 wait complete. 2023-08-17T00:03:27.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:03:27.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 Processor -- start 2023-08-17T00:03:27.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 -- start start 2023-08-17T00:03:27.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f718c061fa0 0x7f718c068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c0c29f0 con 0x7f718c1398d0 2023-08-17T00:03:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0698a0 con 0x7f718c061fa0 2023-08-17T00:03:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.393+0000 7f7192e1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0c2c30 con 0x7f718c069410 2023-08-17T00:03:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f718c061fa0 0x7f718c068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7190bb7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f718c1398d0 0x7f718c0c22e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54174/0 (socket says 172.21.15.153:54174) 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7190bb7700 1 -- 172.21.15.153:0/2538226158 learned_addr learned my addr 172.21.15.153:0/2538226158 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f71913b8700 1 --2- 172.21.15.153:0/2538226158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718bfff700 1 -- 172.21.15.153:0/2538226158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 msgr2=0x7f718c0c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718bfff700 1 --2- 172.21.15.153:0/2538226158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718bfff700 1 -- 172.21.15.153:0/2538226158 >> v1:172.21.15.153:6789/0 conn(0x7f718c1398d0 legacy=0x7f718c0c22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718bfff700 1 -- 172.21.15.153:0/2538226158 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c0c2f10 con 0x7f718c061fa0 2023-08-17T00:03:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718bfff700 1 --2- 172.21.15.153:0/2538226158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c061fa0 0x7f718c068f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f7178009760 tx=0x7f7178009060).ready entity=mon.0 client_cookie=f7dee440b53f0e2e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718b7fe700 1 -- 172.21.15.153:0/2538226158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71780090d0 con 0x7f718c061fa0 2023-08-17T00:03:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718b7fe700 1 -- 172.21.15.153:0/2538226158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800b580 con 0x7f718c061fa0 2023-08-17T00:03:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f718b7fe700 1 -- 172.21.15.153:0/2538226158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800b900 con 0x7f718c061fa0 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 -- 172.21.15.153:0/2538226158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c061fa0 msgr2=0x7f718c068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 --2- 172.21.15.153:0/2538226158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c061fa0 0x7f718c068f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f7178009760 tx=0x7f7178009060).stop 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 -- 172.21.15.153:0/2538226158 shutdown_connections 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 --2- 172.21.15.153:0/2538226158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 --2- 172.21.15.153:0/2538226158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c061fa0 0x7f718c068f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 -- 172.21.15.153:0/2538226158 >> 172.21.15.153:0/2538226158 conn(0x7f718c0c79c0 msgr2=0x7f718c0c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:27.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 -- 172.21.15.153:0/2538226158 shutdown_connections 2023-08-17T00:03:27.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.397+0000 7f7192e1b700 1 -- 172.21.15.153:0/2538226158 wait complete. 2023-08-17T00:03:27.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 Processor -- start 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 -- start start 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f718c061fa0 0x7f718c14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 0x7f718c0ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0abe40 con 0x7f718c1398d0 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0bf050 con 0x7f718c061fa0 2023-08-17T00:03:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7192e1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c0bf610 con 0x7f718c069410 2023-08-17T00:03:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 0x7f718c0ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 0x7f718c0ab950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52012/0 (socket says 172.21.15.153:52012) 2023-08-17T00:03:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 -- 172.21.15.153:0/4141123125 learned_addr learned my addr 172.21.15.153:0/4141123125 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:27.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f718bfff700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f7190bb7700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f718c061fa0 0x7f718c14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 -- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 msgr2=0x7f718c0ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 -- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f718c061fa0 msgr2=0x7f718c14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f718c061fa0 0x7f718c14f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 -- 172.21.15.153:0/4141123125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780092a0 con 0x7f718c1398d0 2023-08-17T00:03:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f718bfff700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.401+0000 7f71913b8700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 0x7f718c0ab950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f7184009fa0 tx=0x7f7184009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.405+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400ed20 con 0x7f718c1398d0 2023-08-17T00:03:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.405+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718400ee80 con 0x7f718c1398d0 2023-08-17T00:03:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.405+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718c153e90 con 0x7f718c1398d0 2023-08-17T00:03:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.405+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184014610 con 0x7f718c1398d0 2023-08-17T00:03:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.405+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c0bf2a0 con 0x7f718c1398d0 2023-08-17T00:03:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.405+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c0bf780 con 0x7f718c1398d0 2023-08-17T00:03:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.409+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f718401b030 con 0x7f718c1398d0 2023-08-17T00:03:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.409+0000 7f7188ff9700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717005a180 0x7f717005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.409+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f71840746a0 con 0x7f718c1398d0 2023-08-17T00:03:27.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.409+0000 7f7190bb7700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717005a180 0x7f717005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.413+0000 7f7190bb7700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717005a180 0x7f717005c640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7180000c00 tx=0x7f7180009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.417+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7184047fe0 con 0x7f718c1398d0 2023-08-17T00:03:27.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.577+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f718c06b530 con 0x7f718c1398d0 2023-08-17T00:03:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.577+0000 7f7188ff9700 1 -- 172.21.15.153:0/4141123125 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f718404b600 con 0x7f718c1398d0 2023-08-17T00:03:27.583 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:03:27.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717005a180 msgr2=0x7f717005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717005a180 0x7f717005c640 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f7180000c00 tx=0x7f7180009040).stop 2023-08-17T00:03:27.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 msgr2=0x7f718c0ab950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 0x7f718c0ab950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f7184009fa0 tx=0x7f7184009900).stop 2023-08-17T00:03:27.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 shutdown_connections 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f717005a180 0x7f717005c640 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f718c1398d0 0x7f718c0ab950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f718c069410 0x7f718c0ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 --2- 172.21.15.153:0/4141123125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f718c061fa0 0x7f718c14f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 >> 172.21.15.153:0/4141123125 conn(0x7f718c0c79c0 msgr2=0x7f718c0bd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 shutdown_connections 2023-08-17T00:03:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.581+0000 7f7192e1b700 1 -- 172.21.15.153:0/4141123125 wait complete. 2023-08-17T00:03:27.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:27.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.757+0000 7fbf2db46700 1 Processor -- start 2023-08-17T00:03:27.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 -- start start 2023-08-17T00:03:27.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf280a89c0 0x7fbf280a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf280c0c80 0x7fbf280bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf28150a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280bd590 con 0x7fbf280c0c80 2023-08-17T00:03:27.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf280bc0b0 con 0x7fbf280a89c0 2023-08-17T00:03:27.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf2db46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280bb780 con 0x7fbf281505d0 2023-08-17T00:03:27.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf1ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf280c0c80 0x7fbf280bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf277fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf280a89c0 0x7fbf280a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf1ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf280c0c80 0x7fbf280bcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52016/0 (socket says 172.21.15.153:52016) 2023-08-17T00:03:27.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf1ffff700 1 -- 172.21.15.153:0/3448467719 learned_addr learned my addr 172.21.15.153:0/3448467719 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.761+0000 7fbf27fff700 1 --2- 172.21.15.153:0/3448467719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf28150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf1ffff700 1 -- 172.21.15.153:0/3448467719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 msgr2=0x7fbf28150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf1ffff700 1 --2- 172.21.15.153:0/3448467719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf28150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf1ffff700 1 -- 172.21.15.153:0/3448467719 >> v2:172.21.15.178:3300/0 conn(0x7fbf280a89c0 msgr2=0x7fbf280a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf1ffff700 1 --2- 172.21.15.153:0/3448467719 >> v2:172.21.15.178:3300/0 conn(0x7fbf280a89c0 0x7fbf280a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf1ffff700 1 -- 172.21.15.153:0/3448467719 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280bba60 con 0x7fbf280c0c80 2023-08-17T00:03:27.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf277fe700 1 --2- 172.21.15.153:0/3448467719 >> v2:172.21.15.178:3300/0 conn(0x7fbf280a89c0 0x7fbf280a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf1ffff700 1 --2- 172.21.15.153:0/3448467719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280c0c80 0x7fbf280bcdb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbf28067fc0 tx=0x7fbf100090f0).ready entity=mon.0 client_cookie=cc7a2d7720986ba1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf26ffd700 1 -- 172.21.15.153:0/3448467719 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000f510 con 0x7fbf280c0c80 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf26ffd700 1 -- 172.21.15.153:0/3448467719 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000f670 con 0x7fbf280c0c80 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf26ffd700 1 -- 172.21.15.153:0/3448467719 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000fa10 con 0x7fbf280c0c80 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 -- 172.21.15.153:0/3448467719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280c0c80 msgr2=0x7fbf280bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 --2- 172.21.15.153:0/3448467719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280c0c80 0x7fbf280bcdb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fbf28067fc0 tx=0x7fbf100090f0).stop 2023-08-17T00:03:27.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 -- 172.21.15.153:0/3448467719 shutdown_connections 2023-08-17T00:03:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 --2- 172.21.15.153:0/3448467719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf28150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 --2- 172.21.15.153:0/3448467719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280c0c80 0x7fbf280bcdb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 --2- 172.21.15.153:0/3448467719 >> v2:172.21.15.178:3300/0 conn(0x7fbf280a89c0 0x7fbf280a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 -- 172.21.15.153:0/3448467719 >> 172.21.15.153:0/3448467719 conn(0x7fbf280c7150 msgr2=0x7fbf280c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 -- 172.21.15.153:0/3448467719 shutdown_connections 2023-08-17T00:03:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.765+0000 7fbf2db46700 1 -- 172.21.15.153:0/3448467719 wait complete. 2023-08-17T00:03:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 Processor -- start 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 -- start start 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 0x7fbf28138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf280c0c80 0x7fbf280bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf280bfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf281652a0 con 0x7fbf280a89c0 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280c0250 con 0x7fbf280c0c80 2023-08-17T00:03:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.769+0000 7fbf2db46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280a4790 con 0x7fbf281505d0 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 0x7fbf28138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 0x7fbf28138dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52022/0 (socket says 172.21.15.153:52022) 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 -- 172.21.15.153:0/1250925894 learned_addr learned my addr 172.21.15.153:0/1250925894 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf1ffff700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf280c0c80 0x7fbf280bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf27fff700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf280bfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 -- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 msgr2=0x7fbf280bfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf280bfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 -- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf280c0c80 msgr2=0x7fbf280bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf280c0c80 0x7fbf280bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 -- 172.21.15.153:0/1250925894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180092a0 con 0x7fbf280a89c0 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf27fff700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf280bfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf277fe700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 0x7fbf28138dd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fbf1800e980 tx=0x7fbf18009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18009560 con 0x7fbf280a89c0 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1800c850 con 0x7fbf280a89c0 2023-08-17T00:03:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800cbd0 con 0x7fbf280a89c0 2023-08-17T00:03:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10009370 con 0x7fbf280a89c0 2023-08-17T00:03:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf28164fc0 con 0x7fbf280a89c0 2023-08-17T00:03:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.773+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf28165410 con 0x7fbf280a89c0 2023-08-17T00:03:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.777+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbf18022070 con 0x7fbf280a89c0 2023-08-17T00:03:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.777+0000 7fbf1f7fe700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf0805a120 0x7fbf0805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.777+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbf180744d0 con 0x7fbf280a89c0 2023-08-17T00:03:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.777+0000 7fbf1ffff700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf0805a120 0x7fbf0805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.777+0000 7fbf1ffff700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf0805a120 0x7fbf0805c5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fbf280ac760 tx=0x7fbf10016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.781+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf28165410 con 0x7fbf280a89c0 2023-08-17T00:03:27.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.973+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf28165410 con 0x7fbf280a89c0 2023-08-17T00:03:27.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf1f7fe700 1 -- 172.21.15.153:0/1250925894 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7fbf28165410 con 0x7fbf280a89c0 2023-08-17T00:03:27.982 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:27.982 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:27.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf0805a120 msgr2=0x7fbf0805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf0805a120 0x7fbf0805c5e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fbf280ac760 tx=0x7fbf10016000).stop 2023-08-17T00:03:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 msgr2=0x7fbf28138dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 0x7fbf28138dd0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fbf1800e980 tx=0x7fbf18009060).stop 2023-08-17T00:03:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 shutdown_connections 2023-08-17T00:03:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf0805a120 0x7fbf0805c5e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf281505d0 0x7fbf280bfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf280c0c80 0x7fbf280bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 --2- 172.21.15.153:0/1250925894 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf280a89c0 0x7fbf28138dd0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 >> 172.21.15.153:0/1250925894 conn(0x7fbf280c7150 msgr2=0x7fbf2814be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:27.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.977+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 shutdown_connections 2023-08-17T00:03:27.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:27.981+0000 7fbf2db46700 1 -- 172.21.15.153:0/1250925894 wait complete. 2023-08-17T00:03:27.989 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:28.008 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:28.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.161+0000 7fe7d0df9700 1 Processor -- start 2023-08-17T00:03:28.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.161+0000 7fe7d0df9700 1 -- start start 2023-08-17T00:03:28.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7d0df9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7cc153910 0x7fe7cc153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7d0df9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe7cc0a5400 0x7fe7cc0a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7d0df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc095110 con 0x7fe7cc0a8280 2023-08-17T00:03:28.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7d0df9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc094e70 con 0x7fe7cc0a5400 2023-08-17T00:03:28.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7d0df9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc0a7840 con 0x7fe7cc153910 2023-08-17T00:03:28.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7cbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe7cc0a8280 0x7fe7cc0955a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54186/0 (socket says 172.21.15.153:54186) 2023-08-17T00:03:28.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7cbfff700 1 -- 172.21.15.153:0/2073817493 learned_addr learned my addr 172.21.15.153:0/2073817493 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:28.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7caffd700 1 --2- 172.21.15.153:0/2073817493 >> v2:172.21.15.153:3300/0 conn(0x7fe7cc0a5400 0x7fe7cc0a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7cb7fe700 1 --2- 172.21.15.153:0/2073817493 >> v2:172.21.15.178:3300/0 conn(0x7fe7cc153910 0x7fe7cc153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7caffd700 1 -- 172.21.15.153:0/2073817493 >> v2:172.21.15.178:3300/0 conn(0x7fe7cc153910 msgr2=0x7fe7cc153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7caffd700 1 --2- 172.21.15.153:0/2073817493 >> v2:172.21.15.178:3300/0 conn(0x7fe7cc153910 0x7fe7cc153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7caffd700 1 -- 172.21.15.153:0/2073817493 >> v1:172.21.15.153:6789/0 conn(0x7fe7cc0a8280 legacy=0x7fe7cc0955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.165+0000 7fe7caffd700 1 -- 172.21.15.153:0/2073817493 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0a7b20 con 0x7fe7cc0a5400 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7caffd700 1 --2- 172.21.15.153:0/2073817493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc0a5400 0x7fe7cc0a6ef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe7cc06bba0 tx=0x7fe7c0009060).ready entity=mon.0 client_cookie=40c37122bb64a480 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7ca7fc700 1 -- 172.21.15.153:0/2073817493 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c00090d0 con 0x7fe7cc0a5400 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7ca7fc700 1 -- 172.21.15.153:0/2073817493 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c000f510 con 0x7fe7cc0a5400 2023-08-17T00:03:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7ca7fc700 1 -- 172.21.15.153:0/2073817493 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c000f890 con 0x7fe7cc0a5400 2023-08-17T00:03:28.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 -- 172.21.15.153:0/2073817493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc0a5400 msgr2=0x7fe7cc0a6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/2073817493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc0a5400 0x7fe7cc0a6ef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe7cc06bba0 tx=0x7fe7c0009060).stop 2023-08-17T00:03:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 -- 172.21.15.153:0/2073817493 shutdown_connections 2023-08-17T00:03:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/2073817493 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc0a5400 0x7fe7cc0a6ef0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/2073817493 >> v2:172.21.15.178:3300/0 conn(0x7fe7cc153910 0x7fe7cc153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 -- 172.21.15.153:0/2073817493 >> 172.21.15.153:0/2073817493 conn(0x7fe7cc0c5170 msgr2=0x7fe7cc0c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 -- 172.21.15.153:0/2073817493 shutdown_connections 2023-08-17T00:03:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.169+0000 7fe7d0df9700 1 -- 172.21.15.153:0/2073817493 wait complete. 2023-08-17T00:03:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 Processor -- start 2023-08-17T00:03:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 -- start start 2023-08-17T00:03:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7cc0a5400 0x7fe7cc152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7cc0a8280 0x7fe7cc0a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 0x7fe7cc13fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0bfbe0 con 0x7fe7cc153910 2023-08-17T00:03:28.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0bfec0 con 0x7fe7cc0a8280 2023-08-17T00:03:28.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7d0df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0c01a0 con 0x7fe7cc0a5400 2023-08-17T00:03:28.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 0x7fe7cc13fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 0x7fe7cc13fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52046/0 (socket says 172.21.15.153:52046) 2023-08-17T00:03:28.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 -- 172.21.15.153:0/3088788303 learned_addr learned my addr 172.21.15.153:0/3088788303 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:28.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cb7fe700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7cc0a5400 0x7fe7cc152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7caffd700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7cc0a8280 0x7fe7cc0a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 -- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7cc0a5400 msgr2=0x7fe7cc152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7cc0a5400 0x7fe7cc152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 -- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7cc0a8280 msgr2=0x7fe7cc0a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7cc0a8280 0x7fe7cc0a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 -- 172.21.15.153:0/3088788303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00092a0 con 0x7fe7cc153910 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.173+0000 7fe7cbfff700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 0x7fe7cc13fce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe7c400c790 tx=0x7fe7c40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4005d30 con 0x7fe7cc153910 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c4005e90 con 0x7fe7cc153910 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4007320 con 0x7fe7cc153910 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc0c0480 con 0x7fe7cc153910 2023-08-17T00:03:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc0bf910 con 0x7fe7cc153910 2023-08-17T00:03:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc0c09a0 con 0x7fe7cc153910 2023-08-17T00:03:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe7c4010030 con 0x7fe7cc153910 2023-08-17T00:03:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7b37fe700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe7b805a150 0x7fe7b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.177+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe7c4073ff0 con 0x7fe7cc153910 2023-08-17T00:03:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.181+0000 7fe7cb7fe700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe7b805a150 0x7fe7b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.181+0000 7fe7cb7fe700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe7b805a150 0x7fe7b805c610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe7bc009200 tx=0x7fe7bc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.185+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7cc0c09a0 con 0x7fe7cc153910 2023-08-17T00:03:28.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.349+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7cc0c09a0 con 0x7fe7cc153910 2023-08-17T00:03:28.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7b37fe700 1 -- 172.21.15.153:0/3088788303 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fe7cc0c09a0 con 0x7fe7cc153910 2023-08-17T00:03:28.359 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:28.359 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:28.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe7b805a150 msgr2=0x7fe7b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe7b805a150 0x7fe7b805c610 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fe7bc009200 tx=0x7fe7bc008040).stop 2023-08-17T00:03:28.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 msgr2=0x7fe7cc13fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 0x7fe7cc13fce0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fe7c400c790 tx=0x7fe7c40015e0).stop 2023-08-17T00:03:28.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 shutdown_connections 2023-08-17T00:03:28.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.353+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe7b805a150 0x7fe7b805c610 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.357+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7cc153910 0x7fe7cc13fce0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.357+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7cc0a8280 0x7fe7cc0a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.357+0000 7fe7d0df9700 1 --2- 172.21.15.153:0/3088788303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7cc0a5400 0x7fe7cc152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.357+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 >> 172.21.15.153:0/3088788303 conn(0x7fe7cc0c5170 msgr2=0x7fe7cc0c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:28.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.357+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 shutdown_connections 2023-08-17T00:03:28.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.357+0000 7fe7d0df9700 1 -- 172.21.15.153:0/3088788303 wait complete. 2023-08-17T00:03:28.383 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:03:28.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:28.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.537+0000 7f5c0ae1b700 1 Processor -- start 2023-08-17T00:03:28.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 -- start start 2023-08-17T00:03:28.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c04066b10 0x7f5c04066ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c040645a0 0x7f5c04069120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c040c76b0 0x7f5c040c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c04064a30 con 0x7f5c040645a0 2023-08-17T00:03:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c04069610 con 0x7f5c04066b10 2023-08-17T00:03:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.541+0000 7f5c0ae1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040bcb10 con 0x7f5c040c76b0 2023-08-17T00:03:28.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c040645a0 0x7f5c04069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c08bb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c04066b10 0x7f5c04066ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c093b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c040c76b0 0x7f5c040c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c040645a0 0x7f5c04069120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52060/0 (socket says 172.21.15.153:52060) 2023-08-17T00:03:28.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c08bb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c04066b10 0x7f5c04066ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:51070/0 (socket says 172.21.15.153:51070) 2023-08-17T00:03:28.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 -- 172.21.15.153:0/3860433465 learned_addr learned my addr 172.21.15.153:0/3860433465 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:28.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 -- 172.21.15.153:0/3860433465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c040c76b0 msgr2=0x7f5c040c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:28.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 --2- 172.21.15.153:0/3860433465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c040c76b0 0x7f5c040c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 -- 172.21.15.153:0/3860433465 >> v2:172.21.15.178:3300/0 conn(0x7f5c04066b10 msgr2=0x7f5c04066ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:28.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 --2- 172.21.15.153:0/3860433465 >> v2:172.21.15.178:3300/0 conn(0x7f5c04066b10 0x7f5c04066ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 -- 172.21.15.153:0/3860433465 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040bc7a0 con 0x7f5c040645a0 2023-08-17T00:03:28.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c03fff700 1 --2- 172.21.15.153:0/3860433465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040645a0 0x7f5c04069120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5c04082210 tx=0x7f5bf000b300).ready entity=mon.0 client_cookie=2c7791ef8a3e6ea4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c037fe700 1 -- 172.21.15.153:0/3860433465 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000da70 con 0x7f5c040645a0 2023-08-17T00:03:28.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c037fe700 1 -- 172.21.15.153:0/3860433465 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000dbd0 con 0x7f5c040645a0 2023-08-17T00:03:28.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c037fe700 1 -- 172.21.15.153:0/3860433465 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0005880 con 0x7f5c040645a0 2023-08-17T00:03:28.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/3860433465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040645a0 msgr2=0x7f5c04069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/3860433465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040645a0 0x7f5c04069120 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5c04082210 tx=0x7f5bf000b300).stop 2023-08-17T00:03:28.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/3860433465 shutdown_connections 2023-08-17T00:03:28.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/3860433465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c040c76b0 0x7f5c040c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/3860433465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040645a0 0x7f5c04069120 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/3860433465 >> v2:172.21.15.178:3300/0 conn(0x7f5c04066b10 0x7f5c04066ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.545+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/3860433465 >> 172.21.15.153:0/3860433465 conn(0x7f5c040aa820 msgr2=0x7f5c040aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:28.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.549+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/3860433465 shutdown_connections 2023-08-17T00:03:28.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.549+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/3860433465 wait complete. 2023-08-17T00:03:28.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.549+0000 7f5c0ae1b700 1 Processor -- start 2023-08-17T00:03:28.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.549+0000 7f5c0ae1b700 1 -- start start 2023-08-17T00:03:28.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c04066b10 0x7f5c04144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 0x7f5c04063140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04063630 0x7f5c040a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04093ae0 con 0x7f5c040c76b0 2023-08-17T00:03:28.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c04063a90 con 0x7f5c04063630 2023-08-17T00:03:28.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c040a90a0 con 0x7f5c04066b10 2023-08-17T00:03:28.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 0x7f5c04063140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 0x7f5c04063140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52064/0 (socket says 172.21.15.153:52064) 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 -- 172.21.15.153:0/2220209658 learned_addr learned my addr 172.21.15.153:0/2220209658 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c093b8700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04063630 0x7f5c040a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c08bb7700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c04066b10 0x7f5c04144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 -- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c04066b10 msgr2=0x7f5c04144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c04066b10 0x7f5c04144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 -- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04063630 msgr2=0x7f5c040a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04063630 0x7f5c040a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 -- 172.21.15.153:0/2220209658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf000b5a0 con 0x7f5c040c76b0 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c03fff700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 0x7f5c04063140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5bf000d5d0 tx=0x7f5bf000b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0006d50 con 0x7f5c040c76b0 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf0005880 con 0x7f5c040c76b0 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c040a9380 con 0x7f5c040c76b0 2023-08-17T00:03:28.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf0022560 con 0x7f5c040c76b0 2023-08-17T00:03:28.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.553+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c04093770 con 0x7f5c040c76b0 2023-08-17T00:03:28.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.557+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c04093c50 con 0x7f5c040c76b0 2023-08-17T00:03:28.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.557+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5bf0029030 con 0x7f5c040c76b0 2023-08-17T00:03:28.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.557+0000 7f5c00ff9700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5be805a150 0x7f5be805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.557+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5bf0078cb0 con 0x7f5c040c76b0 2023-08-17T00:03:28.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.557+0000 7f5c08bb7700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5be805a150 0x7f5be805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.561+0000 7f5c08bb7700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5be805a150 0x7f5be805c610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5bf8009ba0 tx=0x7f5bf8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.565+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5bf004c810 con 0x7f5c040c76b0 2023-08-17T00:03:28.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.757+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c0406b530 con 0x7f5c040c76b0 2023-08-17T00:03:28.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.757+0000 7f5c00ff9700 1 -- 172.21.15.153:0/2220209658 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f5bf0027030 con 0x7f5c040c76b0 2023-08-17T00:03:28.764 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:28.765 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:28.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5be805a150 msgr2=0x7f5be805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5be805a150 0x7f5be805c610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f5bf8009ba0 tx=0x7f5bf8009060).stop 2023-08-17T00:03:28.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 msgr2=0x7f5c04063140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 0x7f5c04063140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f5bf000d5d0 tx=0x7f5bf000b300).stop 2023-08-17T00:03:28.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 shutdown_connections 2023-08-17T00:03:28.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5be805a150 0x7f5be805c610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c04063630 0x7f5c040a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c040c76b0 0x7f5c04063140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 --2- 172.21.15.153:0/2220209658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c04066b10 0x7f5c04144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 >> 172.21.15.153:0/2220209658 conn(0x7f5c040aa820 msgr2=0x7f5c04150380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:28.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 shutdown_connections 2023-08-17T00:03:28.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.761+0000 7f5c0ae1b700 1 -- 172.21.15.153:0/2220209658 wait complete. 2023-08-17T00:03:28.770 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:28.786 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:28.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.933+0000 7f200d6b9700 1 Processor -- start 2023-08-17T00:03:28.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.933+0000 7f200d6b9700 1 -- start start 2023-08-17T00:03:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2008150880 0x7f20080a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2008068f30 0x7f2008064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20080ab9b0 con 0x7f20080a8e60 2023-08-17T00:03:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080aada0 con 0x7f2008068f30 2023-08-17T00:03:28.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080ab080 con 0x7f2008150880 2023-08-17T00:03:28.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2008068f30 0x7f2008064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2008068f30 0x7f2008064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52070/0 (socket says 172.21.15.153:52070) 2023-08-17T00:03:28.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 -- 172.21.15.153:0/3263306478 learned_addr learned my addr 172.21.15.153:0/3263306478 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f2007fff700 1 --2- 172.21.15.153:0/3263306478 >> v2:172.21.15.178:3300/0 conn(0x7f2008150880 0x7f20080a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 -- 172.21.15.153:0/3263306478 >> v2:172.21.15.178:3300/0 conn(0x7f2008150880 msgr2=0x7f20080a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 --2- 172.21.15.153:0/3263306478 >> v2:172.21.15.178:3300/0 conn(0x7f2008150880 0x7f20080a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 -- 172.21.15.153:0/3263306478 >> v1:172.21.15.178:6789/0 conn(0x7f20080a8e60 legacy=0x7f2008068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 -- 172.21.15.153:0/3263306478 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080ab360 con 0x7f2008068f30 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200ceb8700 1 --2- 172.21.15.153:0/3263306478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2008068f30 0x7f2008064670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f2008066830 tx=0x7f2000009840).ready entity=mon.0 client_cookie=99431f5ea6771737 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f20077fe700 1 -- 172.21.15.153:0/3263306478 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000e070 con 0x7f2008068f30 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f20077fe700 1 -- 172.21.15.153:0/3263306478 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000ba50 con 0x7f2008068f30 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f20077fe700 1 -- 172.21.15.153:0/3263306478 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000bdd0 con 0x7f2008068f30 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- 172.21.15.153:0/3263306478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2008068f30 msgr2=0x7f2008064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3263306478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2008068f30 0x7f2008064670 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f2008066830 tx=0x7f2000009840).stop 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- 172.21.15.153:0/3263306478 shutdown_connections 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3263306478 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2008068f30 0x7f2008064670 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3263306478 >> v2:172.21.15.178:3300/0 conn(0x7f2008150880 0x7f20080a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- 172.21.15.153:0/3263306478 >> 172.21.15.153:0/3263306478 conn(0x7f20080c6620 msgr2=0x7f20080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:28.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- 172.21.15.153:0/3263306478 shutdown_connections 2023-08-17T00:03:28.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.937+0000 7f200d6b9700 1 -- 172.21.15.153:0/3263306478 wait complete. 2023-08-17T00:03:28.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.941+0000 7f200d6b9700 1 Processor -- start 2023-08-17T00:03:28.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.941+0000 7f200d6b9700 1 -- start start 2023-08-17T00:03:28.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2008068f30 0x7f2008153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 0x7f2008163cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2008150880 0x7f2008156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008153e80 con 0x7f20080a8e60 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20081641b0 con 0x7f2008068f30 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2008164c60 con 0x7f2008150880 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 0x7f2008163cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 0x7f2008163cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52082/0 (socket says 172.21.15.153:52082) 2023-08-17T00:03:28.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 -- 172.21.15.153:0/3142870546 learned_addr learned my addr 172.21.15.153:0/3142870546 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200ceb8700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2008150880 0x7f2008156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f2007fff700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2008068f30 0x7f2008153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 -- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2008150880 msgr2=0x7f2008156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2008150880 0x7f2008156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 -- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2008068f30 msgr2=0x7f2008153990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2008068f30 0x7f2008153990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:28.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 -- 172.21.15.153:0/3142870546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000009ae0 con 0x7f20080a8e60 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f1fff7fe700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 0x7f2008163cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1ff000c4c0 tx=0x7f1ff0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0007020 con 0x7f20080a8e60 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0001e90 con 0x7f20080a8e60 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080bd760 con 0x7f20080a8e60 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff00073d0 con 0x7f20080a8e60 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.945+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20081646a0 con 0x7f20080a8e60 2023-08-17T00:03:28.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.949+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080bd8f0 con 0x7f20080a8e60 2023-08-17T00:03:28.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.949+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1ff0010070 con 0x7f20080a8e60 2023-08-17T00:03:28.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.949+0000 7f2004ff9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1fec05a180 0x7f1fec05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:28.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.949+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ff0073a20 con 0x7f20080a8e60 2023-08-17T00:03:28.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.953+0000 7f2007fff700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1fec05a180 0x7f1fec05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:28.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.953+0000 7f2007fff700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1fec05a180 0x7f1fec05c640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f20080bccd0 tx=0x7f1ff8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:28.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:28.957+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ff00473c0 con 0x7f20080a8e60 2023-08-17T00:03:29.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.149+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20080ab640 con 0x7f20080a8e60 2023-08-17T00:03:29.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f2004ff9700 1 -- 172.21.15.153:0/3142870546 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4495 (secure 0 0 0) 0x7f1ff004a9e0 con 0x7f20080a8e60 2023-08-17T00:03:29.158 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:29.158 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2579365936","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2579365936},{"type":"v1","addr":"172.21.15.153:6833","nonce":2579365936}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2953273036","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2953273036},{"type":"v1","addr":"172.21.15.153:6835","nonce":2953273036}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1243642376","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1243642376},{"type":"v1","addr":"172.21.15.178:6835","nonce":1243642376}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:02:51.755991+0000","modified":"2023-08-17T00:02:54.775082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4276},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4276":{"gid":4276,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6837/3379453475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3379453475},{"type":"v1","addr":"172.21.15.178:6837","nonce":3379453475}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-08-17T00:03:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1fec05a180 msgr2=0x7f1fec05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1fec05a180 0x7f1fec05c640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f20080bccd0 tx=0x7f1ff8008040).stop 2023-08-17T00:03:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 msgr2=0x7f2008163cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 0x7f2008163cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f1ff000c4c0 tx=0x7f1ff0007e00).stop 2023-08-17T00:03:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 shutdown_connections 2023-08-17T00:03:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1fec05a180 0x7f1fec05c640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2008150880 0x7f2008156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f20080a8e60 0x7f2008163cc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 --2- 172.21.15.153:0/3142870546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2008068f30 0x7f2008153990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.153+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 >> 172.21.15.153:0/3142870546 conn(0x7f20080c6620 msgr2=0x7f20080c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.157+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 shutdown_connections 2023-08-17T00:03:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.157+0000 7f200d6b9700 1 -- 172.21.15.153:0/3142870546 wait complete. 2023-08-17T00:03:29.164 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 7 2023-08-17T00:03:29.181 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:29.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1aea707700 1 Processor -- start 2023-08-17T00:03:29.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1aea707700 1 -- start start 2023-08-17T00:03:29.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1aea707700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ae40a8df0 0x7f1ae40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1aea707700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae41585a0 con 0x7f1ae40aa6e0 2023-08-17T00:03:29.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1aea707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae4066400 con 0x7f1ae4068820 2023-08-17T00:03:29.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1aea707700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae4062dc0 con 0x7f1ae40a8df0 2023-08-17T00:03:29.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.333+0000 7f1ae9f06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1ae40aa6e0 0x7f1ae40626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54188/0 (socket says 172.21.15.153:54188) 2023-08-17T00:03:29.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1ae9f06700 1 -- 172.21.15.153:0/1004773243 learned_addr learned my addr 172.21.15.153:0/1004773243 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:29.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1ae9705700 1 --2- 172.21.15.153:0/1004773243 >> v2:172.21.15.178:3300/0 conn(0x7f1ae40a8df0 0x7f1ae40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 705664509 0 0) 0x7f1ae41585a0 con 0x7f1ae40aa6e0 2023-08-17T00:03:29.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad00033f0 con 0x7f1ae40aa6e0 2023-08-17T00:03:29.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197133282 0 0) 0x7f1ae4066400 con 0x7f1ae4068820 2023-08-17T00:03:29.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ae41585a0 con 0x7f1ae4068820 2023-08-17T00:03:29.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1ae9705700 1 -- 172.21.15.153:0/1004773243 >> v1:172.21.15.178:6789/0 conn(0x7f1ae4068820 legacy=0x7f1ae4061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1ae9705700 1 -- 172.21.15.153:0/1004773243 >> v1:172.21.15.153:6789/0 conn(0x7f1ae40aa6e0 legacy=0x7f1ae40626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1ae9705700 1 -- 172.21.15.153:0/1004773243 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae40b9d30 con 0x7f1ae40a8df0 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1ae9705700 1 --2- 172.21.15.153:0/1004773243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40a8df0 0x7f1ae40c1490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1ae0006fd0 tx=0x7f1ae0006f40).ready entity=mon.1 client_cookie=80b481b79290b51b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0005880 con 0x7f1ae40a8df0 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00059e0 con 0x7f1ae40a8df0 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1adbfff700 1 -- 172.21.15.153:0/1004773243 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0005d60 con 0x7f1ae40a8df0 2023-08-17T00:03:29.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 -- 172.21.15.153:0/1004773243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40a8df0 msgr2=0x7f1ae40c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 --2- 172.21.15.153:0/1004773243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40a8df0 0x7f1ae40c1490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f1ae0006fd0 tx=0x7f1ae0006f40).stop 2023-08-17T00:03:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 -- 172.21.15.153:0/1004773243 shutdown_connections 2023-08-17T00:03:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 --2- 172.21.15.153:0/1004773243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40a8df0 0x7f1ae40c1490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 -- 172.21.15.153:0/1004773243 >> 172.21.15.153:0/1004773243 conn(0x7f1ae40c6620 msgr2=0x7f1ae40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 -- 172.21.15.153:0/1004773243 shutdown_connections 2023-08-17T00:03:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.337+0000 7f1aea707700 1 -- 172.21.15.153:0/1004773243 wait complete. 2023-08-17T00:03:29.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 Processor -- start 2023-08-17T00:03:29.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 -- start start 2023-08-17T00:03:29.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 0x7f1ae40be950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae40a8df0 0x7f1ae40c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40aa6e0 0x7f1ae40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae40c5880 con 0x7f1ae4068820 2023-08-17T00:03:29.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae40bf310 con 0x7f1ae40aa6e0 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1aea707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae40bf5f0 con 0x7f1ae40a8df0 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1ae9705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 0x7f1ae40be950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1ae9705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 0x7f1ae40be950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52094/0 (socket says 172.21.15.153:52094) 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.341+0000 7f1ae9705700 1 -- 172.21.15.153:0/1451448940 learned_addr learned my addr 172.21.15.153:0/1451448940 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9f06700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40aa6e0 0x7f1ae40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9705700 1 -- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae40a8df0 msgr2=0x7f1ae40c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae8f04700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae40a8df0 0x7f1ae40c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9705700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae40a8df0 0x7f1ae40c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9705700 1 -- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40aa6e0 msgr2=0x7f1ae40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9705700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40aa6e0 0x7f1ae40c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9705700 1 -- 172.21.15.153:0/1451448940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae0009250 con 0x7f1ae4068820 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9f06700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40aa6e0 0x7f1ae40c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae8f04700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae40a8df0 0x7f1ae40c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ae9705700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 0x7f1ae40be950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1ae0006fa0 tx=0x7f1ae0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:29.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000d6b0 con 0x7f1ae4068820 2023-08-17T00:03:29.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000d810 con 0x7f1ae4068820 2023-08-17T00:03:29.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000dbb0 con 0x7f1ae4068820 2023-08-17T00:03:29.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae40bf8d0 con 0x7f1ae4068820 2023-08-17T00:03:29.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae40bfe90 con 0x7f1ae4068820 2023-08-17T00:03:29.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae40c00d0 con 0x7f1ae4068820 2023-08-17T00:03:29.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.345+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1ae0025030 con 0x7f1ae4068820 2023-08-17T00:03:29.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.349+0000 7f1ad97fa700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ac805a150 0x7f1ac805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.349+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ae0075790 con 0x7f1ae4068820 2023-08-17T00:03:29.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.349+0000 7f1ae8f04700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ac805a150 0x7f1ac805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.349+0000 7f1ae8f04700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ac805a150 0x7f1ac805c610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1ae41563d0 tx=0x7f1ad4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:29.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.353+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ae40c00d0 con 0x7f1ae4068820 2023-08-17T00:03:29.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.513+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ae4064010 con 0x7f1ae4068820 2023-08-17T00:03:29.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.517+0000 7f1ad97fa700 1 -- 172.21.15.153:0/1451448940 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f1ae0023070 con 0x7f1ae4068820 2023-08-17T00:03:29.523 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:29.524 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":22,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:02:52.759804+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:02:49.715312+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-17T00:02:50.767571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:29.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ac805a150 msgr2=0x7f1ac805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ac805a150 0x7f1ac805c610 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1ae41563d0 tx=0x7f1ad4009040).stop 2023-08-17T00:03:29.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 msgr2=0x7f1ae40be950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 0x7f1ae40be950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f1ae0006fa0 tx=0x7f1ae0015000).stop 2023-08-17T00:03:29.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 shutdown_connections 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ac805a150 0x7f1ac805c610 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ae40aa6e0 0x7f1ae40c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ae40a8df0 0x7f1ae40c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 --2- 172.21.15.153:0/1451448940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ae4068820 0x7f1ae40be950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 >> 172.21.15.153:0/1451448940 conn(0x7f1ae40c6620 msgr2=0x7f1ae4061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 shutdown_connections 2023-08-17T00:03:29.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.521+0000 7f1aea707700 1 -- 172.21.15.153:0/1451448940 wait complete. 2023-08-17T00:03:29.546 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:03:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 Processor -- start 2023-08-17T00:03:29.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 -- start start 2023-08-17T00:03:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8200689c0 0x7ff820068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8201519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff820065da0 con 0x7ff8201560f0 2023-08-17T00:03:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff820155c60 con 0x7ff8200689c0 2023-08-17T00:03:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff827079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff820156550 con 0x7ff820151530 2023-08-17T00:03:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff826077700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8200689c0 0x7ff820068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff826878700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8201519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff825876700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff8201560f0 0x7ff8200c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:49712/0 (socket says 172.21.15.153:49712) 2023-08-17T00:03:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.693+0000 7ff825876700 1 -- 172.21.15.153:0/717620529 learned_addr learned my addr 172.21.15.153:0/717620529 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff826878700 1 -- 172.21.15.153:0/717620529 >> v2:172.21.15.178:3300/0 conn(0x7ff8200689c0 msgr2=0x7ff820068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff826878700 1 --2- 172.21.15.153:0/717620529 >> v2:172.21.15.178:3300/0 conn(0x7ff8200689c0 0x7ff820068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff826878700 1 -- 172.21.15.153:0/717620529 >> v1:172.21.15.178:6789/0 conn(0x7ff8201560f0 legacy=0x7ff8200c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff826878700 1 -- 172.21.15.153:0/717620529 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820065ff0 con 0x7ff820151530 2023-08-17T00:03:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff826878700 1 --2- 172.21.15.153:0/717620529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8201519c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff818009e60 tx=0x7ff818009780).ready entity=mon.2 client_cookie=7048cd3d3613460d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff825075700 1 -- 172.21.15.153:0/717620529 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81800e070 con 0x7ff820151530 2023-08-17T00:03:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff825075700 1 -- 172.21.15.153:0/717620529 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81800bb60 con 0x7ff820151530 2023-08-17T00:03:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff825075700 1 -- 172.21.15.153:0/717620529 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818012410 con 0x7ff820151530 2023-08-17T00:03:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 -- 172.21.15.153:0/717620529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 msgr2=0x7ff8201519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 --2- 172.21.15.153:0/717620529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8201519c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7ff818009e60 tx=0x7ff818009780).stop 2023-08-17T00:03:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 -- 172.21.15.153:0/717620529 shutdown_connections 2023-08-17T00:03:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 --2- 172.21.15.153:0/717620529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8201519c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 --2- 172.21.15.153:0/717620529 >> v2:172.21.15.178:3300/0 conn(0x7ff8200689c0 0x7ff820068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 -- 172.21.15.153:0/717620529 >> 172.21.15.153:0/717620529 conn(0x7ff8200c6620 msgr2=0x7ff8200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 -- 172.21.15.153:0/717620529 shutdown_connections 2023-08-17T00:03:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.697+0000 7ff827079700 1 -- 172.21.15.153:0/717620529 wait complete. 2023-08-17T00:03:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 Processor -- start 2023-08-17T00:03:29.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 -- start start 2023-08-17T00:03:29.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 0x7ff8200a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8200a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8201560f0 0x7ff82014f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff820164060 con 0x7ff8200689c0 2023-08-17T00:03:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff820164e80 con 0x7ff8201560f0 2023-08-17T00:03:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff827079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200a65e0 con 0x7ff820151530 2023-08-17T00:03:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.701+0000 7ff826077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 0x7ff8200a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 0x7ff8200a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52102/0 (socket says 172.21.15.153:52102) 2023-08-17T00:03:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826878700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8201560f0 0x7ff82014f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 -- 172.21.15.153:0/1636380877 learned_addr learned my addr 172.21.15.153:0/1636380877 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:29.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff825876700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8200a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 -- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 msgr2=0x7ff8200a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8200a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 -- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8201560f0 msgr2=0x7ff82014f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:29.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8201560f0 0x7ff82014f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 -- 172.21.15.153:0/1636380877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff818009a20 con 0x7ff8200689c0 2023-08-17T00:03:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826878700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8201560f0 0x7ff82014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff826077700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 0x7ff8200a60f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff81c00e8d0 tx=0x7ff81c006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c012600 con 0x7ff8200689c0 2023-08-17T00:03:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81c012760 con 0x7ff8200689c0 2023-08-17T00:03:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c012ae0 con 0x7ff8200689c0 2023-08-17T00:03:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff820164270 con 0x7ff8200689c0 2023-08-17T00:03:29.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.705+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff820164830 con 0x7ff8200689c0 2023-08-17T00:03:29.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.709+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff82006b4c0 con 0x7ff8200689c0 2023-08-17T00:03:29.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.709+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff81c022070 con 0x7ff8200689c0 2023-08-17T00:03:29.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.709+0000 7ff8167fc700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80405a150 0x7ff80405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:29.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.709+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff81c074400 con 0x7ff8200689c0 2023-08-17T00:03:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.709+0000 7ff825876700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80405a150 0x7ff80405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.709+0000 7ff825876700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80405a150 0x7ff80405c610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff8200a7b00 tx=0x7ff810007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:29.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.713+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff81c047da0 con 0x7ff8200689c0 2023-08-17T00:03:29.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:29.913+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff820063750 con 0x7ff8200689c0 2023-08-17T00:03:30.423 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:03:30.417+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:03:30.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.429+0000 7ff8167fc700 1 -- 172.21.15.153:0/1636380877 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff81c016020 con 0x7ff8200689c0 2023-08-17T00:03:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80405a150 msgr2=0x7ff80405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80405a150 0x7ff80405c610 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff8200a7b00 tx=0x7ff810007d30).stop 2023-08-17T00:03:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 msgr2=0x7ff8200a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 0x7ff8200a60f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7ff81c00e8d0 tx=0x7ff81c006f40).stop 2023-08-17T00:03:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 shutdown_connections 2023-08-17T00:03:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80405a150 0x7ff80405c610 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8201560f0 0x7ff82014f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff820151530 0x7ff8200a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 --2- 172.21.15.153:0/1636380877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200689c0 0x7ff8200a60f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 >> 172.21.15.153:0/1636380877 conn(0x7ff8200c6620 msgr2=0x7ff820061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:30.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 shutdown_connections 2023-08-17T00:03:30.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.433+0000 7ff827079700 1 -- 172.21.15.153:0/1636380877 wait complete. 2023-08-17T00:03:30.442 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:03:30.446 INFO:tasks.ceph.mds.d.smithi178.stderr: -1930> 2023-08-17T00:02:52.429+0000 7fc46bc88700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:03:30.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:03:30.488 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:03:30.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 Processor -- start 2023-08-17T00:03:30.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 -- start start 2023-08-17T00:03:30.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5588068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55880c1190 0x7f5588068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55881545e0 con 0x7f55880ac2f0 2023-08-17T00:03:30.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5588069200 con 0x7f55880c1190 2023-08-17T00:03:30.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f558cf07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55880c1c50 con 0x7f55880abf10 2023-08-17T00:03:30.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f5586ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f55880ac2f0 0x7f55880c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54198/0 (socket says 172.21.15.153:54198) 2023-08-17T00:03:30.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f5586ffd700 1 -- 172.21.15.153:0/790662732 learned_addr learned my addr 172.21.15.153:0/790662732 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:30.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f5587fff700 1 --2- 172.21.15.153:0/790662732 >> v2:172.21.15.178:3300/0 conn(0x7f55880c1190 0x7f5588068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.617+0000 7f55877fe700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5588068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924616130 0 0) 0x7f55881545e0 con 0x7f55880ac2f0 2023-08-17T00:03:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55700033f0 con 0x7f55880ac2f0 2023-08-17T00:03:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2508832298 0 0) 0x7f55700033f0 con 0x7f55880ac2f0 2023-08-17T00:03:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 msgr2=0x7f5588068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5588068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 >> v2:172.21.15.178:3300/0 conn(0x7f55880c1190 msgr2=0x7f5588068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 --2- 172.21.15.153:0/790662732 >> v2:172.21.15.178:3300/0 conn(0x7f55880c1190 0x7f5588068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55880a96d0 con 0x7f55880ac2f0 2023-08-17T00:03:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f557c001470 con 0x7f55880ac2f0 2023-08-17T00:03:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f5587fff700 1 --2- 172.21.15.153:0/790662732 >> v2:172.21.15.178:3300/0 conn(0x7f55880c1190 0x7f5588068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 >> v1:172.21.15.153:6789/0 conn(0x7f55880ac2f0 legacy=0x7f55880c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55700038e0 0x7f5570003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5570004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5570004b80 0x7f5570005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588069200 con 0x7f55700038e0 2023-08-17T00:03:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55880c1c50 con 0x7f5570004b80 2023-08-17T00:03:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557000b960 con 0x7f55880abf10 2023-08-17T00:03:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f5586ffd700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5570004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55700038e0 0x7f5570003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f5587fff700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5570004b80 0x7f5570005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 -- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 msgr2=0x7f5570004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5570004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 -- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5570004b80 msgr2=0x7f5570005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5570004b80 0x7f5570005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 -- 172.21.15.153:0/790662732 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700033f0 con 0x7f55700038e0 2023-08-17T00:03:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f5586ffd700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55880abf10 0x7f5570004690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f5587fff700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5570004b80 0x7f5570005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55877fe700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55700038e0 0x7f5570003d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f5578006fd0 tx=0x7f5578006f40).ready entity=mon.0 client_cookie=208099b4b3d47050 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578009430 con 0x7f55700038e0 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557800e640 con 0x7f55700038e0 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f55867fc700 1 -- 172.21.15.153:0/790662732 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800e9c0 con 0x7f55700038e0 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f558cf07700 1 -- 172.21.15.153:0/790662732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55700038e0 msgr2=0x7f5570003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f558cf07700 1 --2- 172.21.15.153:0/790662732 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55700038e0 0x7f5570003d00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f5578006fd0 tx=0x7f5578006f40).stop 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f5587fff700 1 -- 172.21.15.153:0/790662732 reap_dead start 2023-08-17T00:03:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f558cf07700 1 -- 172.21.15.153:0/790662732 shutdown_connections 2023-08-17T00:03:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.621+0000 7f558cf07700 1 -- 172.21.15.153:0/790662732 >> 172.21.15.153:0/790662732 conn(0x7f55880c6620 msgr2=0x7f55880c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.625+0000 7f558cf07700 1 -- 172.21.15.153:0/790662732 shutdown_connections 2023-08-17T00:03:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.625+0000 7f558cf07700 1 -- 172.21.15.153:0/790662732 wait complete. 2023-08-17T00:03:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.625+0000 7f558cf07700 1 Processor -- start 2023-08-17T00:03:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 -- start start 2023-08-17T00:03:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 0x7f5588164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f558814cec0 0x7f5588158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5588165210 0x7f5588150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588156420 con 0x7f558814cae0 2023-08-17T00:03:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588165040 con 0x7f5588165210 2023-08-17T00:03:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588159310 con 0x7f558814cec0 2023-08-17T00:03:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 0x7f5588164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 0x7f5588164b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52112/0 (socket says 172.21.15.153:52112) 2023-08-17T00:03:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 -- 172.21.15.153:0/3923094599 learned_addr learned my addr 172.21.15.153:0/3923094599 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f5587fff700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5588165210 0x7f5588150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f5586ffd700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f558814cec0 0x7f5588158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 -- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f558814cec0 msgr2=0x7f5588158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f558814cec0 0x7f5588158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 -- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5588165210 msgr2=0x7f5588150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5588165210 0x7f5588150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 -- 172.21.15.153:0/3923094599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588156600 con 0x7f558814cae0 2023-08-17T00:03:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f55877fe700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 0x7f5588164b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5570005650 tx=0x7f557801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578009430 con 0x7f558814cae0 2023-08-17T00:03:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557800ed30 con 0x7f558814cae0 2023-08-17T00:03:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55881568e0 con 0x7f558814cae0 2023-08-17T00:03:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.629+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800eea0 con 0x7f558814cae0 2023-08-17T00:03:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.633+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5588156ea0 con 0x7f558814cae0 2023-08-17T00:03:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.633+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55880bfb50 con 0x7f558814cae0 2023-08-17T00:03:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.633+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f557802c020 con 0x7f558814cae0 2023-08-17T00:03:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.637+0000 7f556f7fe700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f557405a180 0x7f557405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.637+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5578075cd0 con 0x7f558814cae0 2023-08-17T00:03:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.637+0000 7f5586ffd700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f557405a180 0x7f557405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:30.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.637+0000 7f5586ffd700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f557405a180 0x7f557405c640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f557c001200 tx=0x7f5588064af0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.645+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55880bfb50 con 0x7f558814cae0 2023-08-17T00:03:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:30.837+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f55880bfb50 con 0x7f558814cae0 2023-08-17T00:03:31.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.441+0000 7f556f7fe700 1 -- 172.21.15.153:0/3923094599 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55880bfb50 con 0x7f558814cae0 2023-08-17T00:03:31.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f557405a180 msgr2=0x7f557405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:31.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f557405a180 0x7f557405c640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f557c001200 tx=0x7f5588064af0).stop 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 msgr2=0x7f5588164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 0x7f5588164b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f5570005650 tx=0x7f557801a000).stop 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 shutdown_connections 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f557405a180 0x7f557405c640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5588165210 0x7f5588150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f558814cec0 0x7f5588158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 --2- 172.21.15.153:0/3923094599 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f558814cae0 0x7f5588164b50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 >> 172.21.15.153:0/3923094599 conn(0x7f55880c6620 msgr2=0x7f55880629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:31.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 shutdown_connections 2023-08-17T00:03:31.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.445+0000 7f558cf07700 1 -- 172.21.15.153:0/3923094599 wait complete. 2023-08-17T00:03:31.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:03:31.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.641+0000 7f72d15b9700 1 Processor -- start 2023-08-17T00:03:31.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.641+0000 7f72d15b9700 1 -- start start 2023-08-17T00:03:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d15b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc153d90 0x7f72cc0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d15b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72cc0cb450 0x7f72cc0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d15b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0c00d0 con 0x7f72cc1539b0 2023-08-17T00:03:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d15b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc0639c0 con 0x7f72cc0cb450 2023-08-17T00:03:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d15b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0aa180 con 0x7f72cc153d90 2023-08-17T00:03:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d0db8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72cc0cb450 0x7f72cc0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72cbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f72cc1539b0 0x7f72cc0632b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54206/0 (socket says 172.21.15.153:54206) 2023-08-17T00:03:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72cbfff700 1 -- 172.21.15.153:0/3463173483 learned_addr learned my addr 172.21.15.153:0/3463173483 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72c37fe700 1 --2- 172.21.15.153:0/3463173483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc153d90 0x7f72cc0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d0db8700 1 -- 172.21.15.153:0/3463173483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc153d90 msgr2=0x7f72cc0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:31.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d0db8700 1 --2- 172.21.15.153:0/3463173483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc153d90 0x7f72cc0a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d0db8700 1 -- 172.21.15.153:0/3463173483 >> v1:172.21.15.153:6789/0 conn(0x7f72cc1539b0 legacy=0x7f72cc0632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:31.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d0db8700 1 -- 172.21.15.153:0/3463173483 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc0bf810 con 0x7f72cc0cb450 2023-08-17T00:03:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72d0db8700 1 --2- 172.21.15.153:0/3463173483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc0cb450 0x7f72cc0a9c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f72c4009760 tx=0x7f72c4009060).ready entity=mon.0 client_cookie=54ba5655580c12b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72cb7fe700 1 -- 172.21.15.153:0/3463173483 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400f510 con 0x7f72cc0cb450 2023-08-17T00:03:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72cb7fe700 1 -- 172.21.15.153:0/3463173483 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c400f670 con 0x7f72cc0cb450 2023-08-17T00:03:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.645+0000 7f72cb7fe700 1 -- 172.21.15.153:0/3463173483 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c400f9f0 con 0x7f72cc0cb450 2023-08-17T00:03:31.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 -- 172.21.15.153:0/3463173483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc0cb450 msgr2=0x7f72cc0a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 --2- 172.21.15.153:0/3463173483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc0cb450 0x7f72cc0a9c90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f72c4009760 tx=0x7f72c4009060).stop 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 -- 172.21.15.153:0/3463173483 shutdown_connections 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 --2- 172.21.15.153:0/3463173483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc0cb450 0x7f72cc0a9c90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 --2- 172.21.15.153:0/3463173483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc153d90 0x7f72cc0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 -- 172.21.15.153:0/3463173483 >> 172.21.15.153:0/3463173483 conn(0x7f72cc062a10 msgr2=0x7f72cc0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 -- 172.21.15.153:0/3463173483 shutdown_connections 2023-08-17T00:03:31.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 -- 172.21.15.153:0/3463173483 wait complete. 2023-08-17T00:03:31.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.649+0000 7f72d15b9700 1 Processor -- start 2023-08-17T00:03:31.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 -- start start 2023-08-17T00:03:31.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb450 0x7f72cc0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:31.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc1539b0 0x7f72cc1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:31.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 0x7f72cc152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:31.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc1530b0 con 0x7f72cc153d90 2023-08-17T00:03:31.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c15e0 con 0x7f72cc0cb450 2023-08-17T00:03:31.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d15b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c2d40 con 0x7f72cc1539b0 2023-08-17T00:03:31.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 0x7f72cc152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:31.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 0x7f72cc152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52130/0 (socket says 172.21.15.153:52130) 2023-08-17T00:03:31.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 -- 172.21.15.153:0/274559829 learned_addr learned my addr 172.21.15.153:0/274559829 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:31.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72c37fe700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc1539b0 0x7f72cc1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:31.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72cbfff700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb450 0x7f72cc0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 -- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc1539b0 msgr2=0x7f72cc1526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc1539b0 0x7f72cc1526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 -- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb450 msgr2=0x7f72cc0c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb450 0x7f72cc0c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 -- 172.21.15.153:0/274559829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40092a0 con 0x7f72cc153d90 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72cbfff700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb450 0x7f72cc0c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:31.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.653+0000 7f72d0db8700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 0x7f72cc152bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f72c4011000 tx=0x7f72c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:31.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c40116c0 con 0x7f72cc153d90 2023-08-17T00:03:31.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c401e070 con 0x7f72cc153d90 2023-08-17T00:03:31.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4011a70 con 0x7f72cc153d90 2023-08-17T00:03:31.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc0c09d0 con 0x7f72cc153d90 2023-08-17T00:03:31.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc0c0f90 con 0x7f72cc153d90 2023-08-17T00:03:31.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc046dd0 con 0x7f72cc153d90 2023-08-17T00:03:31.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.657+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f72c400f070 con 0x7f72cc153d90 2023-08-17T00:03:31.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.661+0000 7f72c8ff9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72ac05a150 0x7f72ac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:31.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.661+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f72c40754d0 con 0x7f72cc153d90 2023-08-17T00:03:31.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.661+0000 7f72cbfff700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72ac05a150 0x7f72ac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:31.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.661+0000 7f72cbfff700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72ac05a150 0x7f72ac05c610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f72bc007fd0 tx=0x7f72bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:31.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.665+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72c4048ee0 con 0x7f72cc153d90 2023-08-17T00:03:31.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:31.829+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f72cc081f80 con 0x7f72cc153d90 2023-08-17T00:03:32.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.445+0000 7f72c8ff9700 1 -- 172.21.15.153:0/274559829 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7f72c4028020 con 0x7f72cc153d90 2023-08-17T00:03:32.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.449+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72ac05a150 msgr2=0x7f72ac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:32.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.449+0000 7f72d15b9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72ac05a150 0x7f72ac05c610 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f72bc007fd0 tx=0x7f72bc009040).stop 2023-08-17T00:03:32.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.449+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 msgr2=0x7f72cc152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:32.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.449+0000 7f72d15b9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 0x7f72cc152bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f72c4011000 tx=0x7f72c4017000).stop 2023-08-17T00:03:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 shutdown_connections 2023-08-17T00:03:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72ac05a150 0x7f72ac05c610 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72cc153d90 0x7f72cc152bc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72cc1539b0 0x7f72cc1526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 --2- 172.21.15.153:0/274559829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72cc0cb450 0x7f72cc0c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 >> 172.21.15.153:0/274559829 conn(0x7f72cc062a10 msgr2=0x7f72cc14d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:32.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 shutdown_connections 2023-08-17T00:03:32.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.453+0000 7f72d15b9700 1 -- 172.21.15.153:0/274559829 wait complete. 2023-08-17T00:03:32.460 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:03:32.480 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:03:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.637+0000 7f7ae5039700 1 Processor -- start 2023-08-17T00:03:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.637+0000 7f7ae5039700 1 -- start start 2023-08-17T00:03:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae5039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00c5750 0x7f7ae00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae5039700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ae00c0110 0x7f7ae00c05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae5039700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00bfc80 con 0x7f7ae00a9cd0 2023-08-17T00:03:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae5039700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00c6be0 con 0x7f7ae00c0110 2023-08-17T00:03:32.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae5039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00c60a0 con 0x7f7ae00c5750 2023-08-17T00:03:32.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00c5750 0x7f7ae00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:32.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae4838700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ae00c0110 0x7f7ae00c05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7adffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7ae00a9cd0 0x7f7ae0153ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:49718/0 (socket says 172.21.15.153:49718) 2023-08-17T00:03:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7adffff700 1 -- 172.21.15.153:0/778864350 learned_addr learned my addr 172.21.15.153:0/778864350 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:32.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae4838700 1 -- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00c5750 msgr2=0x7f7ae00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae4838700 1 --2- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00c5750 0x7f7ae00c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae4838700 1 -- 172.21.15.153:0/778864350 >> v1:172.21.15.178:6789/0 conn(0x7f7ae00a9cd0 legacy=0x7f7ae0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.641+0000 7f7ae4838700 1 -- 172.21.15.153:0/778864350 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00aa0b0 con 0x7f7ae00c0110 2023-08-17T00:03:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00c5750 0x7f7ae00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:32.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae4838700 1 --2- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c0110 0x7f7ae00c05a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7ad8009e60 tx=0x7f7ad8009780).ready entity=mon.1 client_cookie=28c4e19308581a9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:32.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7adf7fe700 1 -- 172.21.15.153:0/778864350 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800e070 con 0x7f7ae00c0110 2023-08-17T00:03:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7adf7fe700 1 -- 172.21.15.153:0/778864350 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad800bb60 con 0x7f7ae00c0110 2023-08-17T00:03:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7adf7fe700 1 -- 172.21.15.153:0/778864350 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8012410 con 0x7f7ae00c0110 2023-08-17T00:03:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 -- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c0110 msgr2=0x7f7ae00c05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 --2- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c0110 0x7f7ae00c05a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7ad8009e60 tx=0x7f7ad8009780).stop 2023-08-17T00:03:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 -- 172.21.15.153:0/778864350 shutdown_connections 2023-08-17T00:03:32.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 --2- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c0110 0x7f7ae00c05a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 --2- 172.21.15.153:0/778864350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00c5750 0x7f7ae00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 -- 172.21.15.153:0/778864350 >> 172.21.15.153:0/778864350 conn(0x7f7ae0062a70 msgr2=0x7f7ae00ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 -- 172.21.15.153:0/778864350 shutdown_connections 2023-08-17T00:03:32.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.645+0000 7f7ae5039700 1 -- 172.21.15.153:0/778864350 wait complete. 2023-08-17T00:03:32.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 Processor -- start 2023-08-17T00:03:32.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 -- start start 2023-08-17T00:03:32.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00a9cd0 0x7f7ae00c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 0x7f7ae00aba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c5750 0x7f7ae0140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00c2550 con 0x7f7ae00c0110 2023-08-17T00:03:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00add10 con 0x7f7ae00c5750 2023-08-17T00:03:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae5039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00adff0 con 0x7f7ae00a9cd0 2023-08-17T00:03:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 0x7f7ae00aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ad77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 0x7f7ae00aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52140/0 (socket says 172.21.15.153:52140) 2023-08-17T00:03:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1180043595 learned_addr learned my addr 172.21.15.153:0/1180043595 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7adffff700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00a9cd0 0x7f7ae00c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:32.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.649+0000 7f7ae4838700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c5750 0x7f7ae0140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:32.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00a9cd0 msgr2=0x7f7ae00c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:32.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00a9cd0 0x7f7ae00c47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c5750 msgr2=0x7f7ae0140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:32.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c5750 0x7f7ae0140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:32.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ad77fe700 1 -- 172.21.15.153:0/1180043595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac80092a0 con 0x7f7ae00c0110 2023-08-17T00:03:32.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ad77fe700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 0x7f7ae00aba10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7ac800ea20 tx=0x7f7ac8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:32.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800ee60 con 0x7f7ae00c0110 2023-08-17T00:03:32.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac800c850 con 0x7f7ae00c0110 2023-08-17T00:03:32.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad8009a20 con 0x7f7ae00c0110 2023-08-17T00:03:32.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac800cbd0 con 0x7f7ae00c0110 2023-08-17T00:03:32.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae00ae5b0 con 0x7f7ae00c0110 2023-08-17T00:03:32.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.653+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae0046dd0 con 0x7f7ae00c0110 2023-08-17T00:03:32.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.657+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7ac8022070 con 0x7f7ae00c0110 2023-08-17T00:03:32.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.657+0000 7f7adcff9700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ac005a150 0x7f7ac005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:32.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.657+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f7ac80743d0 con 0x7f7ae00c0110 2023-08-17T00:03:32.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.657+0000 7f7adffff700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ac005a150 0x7f7ac005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:32.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.661+0000 7f7adffff700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ac005a150 0x7f7ac005c610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7ad0007fd0 tx=0x7f7ad0000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:32.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.665+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7ac8047ed0 con 0x7f7ae00c0110 2023-08-17T00:03:32.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:32.825+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7ae0064070 con 0x7f7ae00c0110 2023-08-17T00:03:33.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.457+0000 7f7adcff9700 1 -- 172.21.15.153:0/1180043595 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7ac804b4f0 con 0x7f7ae00c0110 2023-08-17T00:03:33.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ac005a150 msgr2=0x7f7ac005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:33.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ac005a150 0x7f7ac005c610 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f7ad0007fd0 tx=0x7f7ad0000bc0).stop 2023-08-17T00:03:33.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 msgr2=0x7f7ae00aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:33.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 0x7f7ae00aba10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7ac800ea20 tx=0x7f7ac8009060).stop 2023-08-17T00:03:33.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 shutdown_connections 2023-08-17T00:03:33.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7ac005a150 0x7f7ac005c610 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ae00c5750 0x7f7ae0140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ae00c0110 0x7f7ae00aba10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 --2- 172.21.15.153:0/1180043595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ae00a9cd0 0x7f7ae00c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 >> 172.21.15.153:0/1180043595 conn(0x7f7ae0062a70 msgr2=0x7f7ae00acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 shutdown_connections 2023-08-17T00:03:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.465+0000 7f7ae5039700 1 -- 172.21.15.153:0/1180043595 wait complete. 2023-08-17T00:03:33.476 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:03:33.494 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:03:33.494 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:03:33.495 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:03:33.495 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:03:33.495 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:03:33.495 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:03:33.495 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:03:33.496 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:03:33.496 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:03:33.496 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:03:33.496 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:03:33.497 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:03:33.497 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:03:33.497 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:03:33.497 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:03:33.497 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:03:33.515 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:03:33.516 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:03:33.517 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:03:33.518 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:03:33.519 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:03:33.519 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:03:33.520 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:03:33.520 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:03:33.567 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:03:33.567 DEBUG:teuthology.parallel:result is None 2023-08-17T00:03:33.569 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:03:33.570 DEBUG:teuthology.parallel:result is None 2023-08-17T00:03:33.572 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:03:33.572 DEBUG:teuthology.parallel:result is None 2023-08-17T00:03:33.575 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:03:33.576 DEBUG:teuthology.parallel:result is None 2023-08-17T00:03:33.576 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:03:33.673 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:03:33.682 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:03:33.682 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:03:33.687 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:03:33.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.725+0000 7f41f149b700 1 Processor -- start 2023-08-17T00:03:33.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.725+0000 7f41f149b700 1 -- start start 2023-08-17T00:03:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41ec066070 0x7f41ec0c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec0c2c50 0x7f41ec0c1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec065be0 con 0x7f41ec157b40 2023-08-17T00:03:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0664d0 con 0x7f41ec066070 2023-08-17T00:03:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec0c30a0 con 0x7f41ec0c2c50 2023-08-17T00:03:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41ec066070 0x7f41ec0c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f41ec066070 0x7f41ec0c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52190/0 (socket says 172.21.15.153:52190) 2023-08-17T00:03:33.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 -- 172.21.15.153:0/4104090495 learned_addr learned my addr 172.21.15.153:0/4104090495 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:33.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41eb7fe700 1 --2- 172.21.15.153:0/4104090495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec0c2c50 0x7f41ec0c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:33.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 -- 172.21.15.153:0/4104090495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec0c2c50 msgr2=0x7f41ec0c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:33.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 --2- 172.21.15.153:0/4104090495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec0c2c50 0x7f41ec0c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 -- 172.21.15.153:0/4104090495 >> v1:172.21.15.178:6789/0 conn(0x7f41ec157b40 legacy=0x7f41ec157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:33.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 -- 172.21.15.153:0/4104090495 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec064fd0 con 0x7f41ec066070 2023-08-17T00:03:33.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41ea7fc700 1 --2- 172.21.15.153:0/4104090495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec066070 0x7f41ec0c2760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f41e0006fd0 tx=0x7f41e00090f0).ready entity=mon.0 client_cookie=9cd94125832571c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:33.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41e9ffb700 1 -- 172.21.15.153:0/4104090495 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000b600 con 0x7f41ec066070 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41e9ffb700 1 -- 172.21.15.153:0/4104090495 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000b760 con 0x7f41ec066070 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41e9ffb700 1 -- 172.21.15.153:0/4104090495 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e000bb00 con 0x7f41ec066070 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- 172.21.15.153:0/4104090495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec066070 msgr2=0x7f41ec0c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/4104090495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec066070 0x7f41ec0c2760 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f41e0006fd0 tx=0x7f41e00090f0).stop 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- 172.21.15.153:0/4104090495 shutdown_connections 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/4104090495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec0c2c50 0x7f41ec0c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/4104090495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec066070 0x7f41ec0c2760 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- 172.21.15.153:0/4104090495 >> 172.21.15.153:0/4104090495 conn(0x7f41ec0c7500 msgr2=0x7f41ec0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:33.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- 172.21.15.153:0/4104090495 shutdown_connections 2023-08-17T00:03:33.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.729+0000 7f41f149b700 1 -- 172.21.15.153:0/4104090495 wait complete. 2023-08-17T00:03:33.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.733+0000 7f41f149b700 1 Processor -- start 2023-08-17T00:03:33.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.733+0000 7f41f149b700 1 -- start start 2023-08-17T00:03:33.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.733+0000 7f41f149b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ec066070 0x7f41ec14c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:33.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 0x7f41ec0a8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:33.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec157b40 0x7f41ec0a9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:33.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec0a9620 con 0x7f41ec0c2c50 2023-08-17T00:03:33.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec166000 con 0x7f41ec066070 2023-08-17T00:03:33.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec1653f0 con 0x7f41ec157b40 2023-08-17T00:03:33.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 0x7f41ec0a8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:33.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 0x7f41ec0a8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52202/0 (socket says 172.21.15.153:52202) 2023-08-17T00:03:33.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 -- 172.21.15.153:0/983480026 learned_addr learned my addr 172.21.15.153:0/983480026 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:33.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41eb7fe700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec157b40 0x7f41ec0a9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:33.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41eaffd700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ec066070 0x7f41ec14c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:33.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 -- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec157b40 msgr2=0x7f41ec0a9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:33.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec157b40 0x7f41ec0a9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 -- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ec066070 msgr2=0x7f41ec14c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:33.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ec066070 0x7f41ec14c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:33.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 -- 172.21.15.153:0/983480026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0009370 con 0x7f41ec0c2c50 2023-08-17T00:03:33.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41ea7fc700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 0x7f41ec0a8c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f41ec068840 tx=0x7f41e0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:33.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0006d90 con 0x7f41ec0c2c50 2023-08-17T00:03:33.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e000bec0 con 0x7f41ec0c2c50 2023-08-17T00:03:33.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e0024470 con 0x7f41ec0c2c50 2023-08-17T00:03:33.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec1656d0 con 0x7f41ec0c2c50 2023-08-17T00:03:33.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.737+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec165c90 con 0x7f41ec0c2c50 2023-08-17T00:03:33.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.741+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec166190 con 0x7f41ec0c2c50 2023-08-17T00:03:33.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.741+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f41e000f070 con 0x7f41ec0c2c50 2023-08-17T00:03:33.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.741+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41d805a150 0x7f41d805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:33.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.741+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f41e0075870 con 0x7f41ec0c2c50 2023-08-17T00:03:33.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.741+0000 7f41eaffd700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41d805a150 0x7f41d805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:33.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.741+0000 7f41eaffd700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41d805a150 0x7f41d805c610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f41ec0c0de0 tx=0x7f41dc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:33.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.749+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41e0049620 con 0x7f41ec0c2c50 2023-08-17T00:03:33.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:33.917+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f41ec069cd0 con 0x7f41ec0c2c50 2023-08-17T00:03:34.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.725+0000 7f41d2ffd700 1 -- 172.21.15.153:0/983480026 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f41e0029030 con 0x7f41ec0c2c50 2023-08-17T00:03:34.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41d805a150 msgr2=0x7f41d805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:34.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41d805a150 0x7f41d805c610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f41ec0c0de0 tx=0x7f41dc009040).stop 2023-08-17T00:03:34.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 msgr2=0x7f41ec0a8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:34.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 0x7f41ec0a8c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f41ec068840 tx=0x7f41e0017000).stop 2023-08-17T00:03:34.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 shutdown_connections 2023-08-17T00:03:34.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41d805a150 0x7f41d805c610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41ec157b40 0x7f41ec0a9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41ec0c2c50 0x7f41ec0a8c40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 --2- 172.21.15.153:0/983480026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41ec066070 0x7f41ec14c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 >> 172.21.15.153:0/983480026 conn(0x7f41ec0c7500 msgr2=0x7f41ec14c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:34.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 shutdown_connections 2023-08-17T00:03:34.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.729+0000 7f41f149b700 1 -- 172.21.15.153:0/983480026 wait complete. 2023-08-17T00:03:34.738 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:03:34.759 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:03:34.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 Processor -- start 2023-08-17T00:03:34.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 -- start start 2023-08-17T00:03:34.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa6840abf10 0x7fa684068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6840c1190 0x7fa684068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6841545e0 con 0x7fa6840ac2f0 2023-08-17T00:03:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa684069200 con 0x7fa6840abf10 2023-08-17T00:03:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa688a8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840c1c50 con 0x7fa6840c1190 2023-08-17T00:03:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa6837fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa6840abf10 0x7fa684068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:34.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa6837fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa6840abf10 0x7fa684068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52206/0 (socket says 172.21.15.153:52206) 2023-08-17T00:03:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.921+0000 7fa6837fe700 1 -- 172.21.15.153:0/3158713221 learned_addr learned my addr 172.21.15.153:0/3158713221 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa683fff700 1 --2- 172.21.15.153:0/3158713221 >> v2:172.21.15.178:3300/0 conn(0x7fa6840c1190 0x7fa684068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6837fe700 1 -- 172.21.15.153:0/3158713221 >> v2:172.21.15.178:3300/0 conn(0x7fa6840c1190 msgr2=0x7fa684068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6837fe700 1 --2- 172.21.15.153:0/3158713221 >> v2:172.21.15.178:3300/0 conn(0x7fa6840c1190 0x7fa684068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6837fe700 1 -- 172.21.15.153:0/3158713221 >> v1:172.21.15.178:6789/0 conn(0x7fa6840ac2f0 legacy=0x7fa6840c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:34.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6837fe700 1 -- 172.21.15.153:0/3158713221 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840a96d0 con 0x7fa6840abf10 2023-08-17T00:03:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6837fe700 1 --2- 172.21.15.153:0/3158713221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840abf10 0x7fa684068820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa68414e8a0 tx=0x7fa6740090f0).ready entity=mon.0 client_cookie=7dc4648d5a3b42a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:34.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6827fc700 1 -- 172.21.15.153:0/3158713221 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674009160 con 0x7fa6840abf10 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6827fc700 1 -- 172.21.15.153:0/3158713221 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400b600 con 0x7fa6840abf10 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa6827fc700 1 -- 172.21.15.153:0/3158713221 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67400b980 con 0x7fa6840abf10 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 -- 172.21.15.153:0/3158713221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840abf10 msgr2=0x7fa684068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 --2- 172.21.15.153:0/3158713221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840abf10 0x7fa684068820 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fa68414e8a0 tx=0x7fa6740090f0).stop 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 -- 172.21.15.153:0/3158713221 shutdown_connections 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 --2- 172.21.15.153:0/3158713221 >> v2:172.21.15.178:3300/0 conn(0x7fa6840c1190 0x7fa684068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 --2- 172.21.15.153:0/3158713221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840abf10 0x7fa684068820 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 -- 172.21.15.153:0/3158713221 >> 172.21.15.153:0/3158713221 conn(0x7fa6840c6620 msgr2=0x7fa6840c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:34.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 -- 172.21.15.153:0/3158713221 shutdown_connections 2023-08-17T00:03:34.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.925+0000 7fa688a8f700 1 -- 172.21.15.153:0/3158713221 wait complete. 2023-08-17T00:03:34.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.929+0000 7fa688a8f700 1 Processor -- start 2023-08-17T00:03:34.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.929+0000 7fa688a8f700 1 -- start start 2023-08-17T00:03:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840abf10 0x7fa6841685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840ac2f0 0x7fa684167380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840c1190 0x7fa6840c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa684150410 con 0x7fa6840c1190 2023-08-17T00:03:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840bfe60 con 0x7fa6840abf10 2023-08-17T00:03:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c0100 con 0x7fa6840ac2f0 2023-08-17T00:03:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa683fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840c1190 0x7fa6840c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840abf10 0x7fa6841685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa683fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840c1190 0x7fa6840c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52210/0 (socket says 172.21.15.153:52210) 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa683fff700 1 -- 172.21.15.153:0/1640157080 learned_addr learned my addr 172.21.15.153:0/1640157080 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa682ffd700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840ac2f0 0x7fa684167380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 -- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840ac2f0 msgr2=0x7fa684167380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840ac2f0 0x7fa684167380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 -- 172.21.15.153:0/1640157080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840c1190 msgr2=0x7fa6840c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840c1190 0x7fa6840c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 -- 172.21.15.153:0/1640157080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674009310 con 0x7fa6840abf10 2023-08-17T00:03:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa6837fe700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840abf10 0x7fa6841685a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa674014000 tx=0x7fa674017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674000c90 con 0x7fa6840abf10 2023-08-17T00:03:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67400b770 con 0x7fa6840abf10 2023-08-17T00:03:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67401b640 con 0x7fa6840abf10 2023-08-17T00:03:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6840c03e0 con 0x7fa6840abf10 2023-08-17T00:03:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.933+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa684167870 con 0x7fa6840abf10 2023-08-17T00:03:34.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.937+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68406b4c0 con 0x7fa6840abf10 2023-08-17T00:03:34.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.937+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa67402b070 con 0x7fa6840abf10 2023-08-17T00:03:34.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.937+0000 7fa67b7fe700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa66405a180 0x7fa66405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:34.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.937+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa674075440 con 0x7fa6840abf10 2023-08-17T00:03:34.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.937+0000 7fa682ffd700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa66405a180 0x7fa66405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.941+0000 7fa682ffd700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa66405a180 0x7fa66405c640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa68413f3e0 tx=0x7fa66c007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:34.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:34.945+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6740490d0 con 0x7fa6840abf10 2023-08-17T00:03:35.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.165+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa684064010 con 0x7fa6840abf10 2023-08-17T00:03:35.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.165+0000 7fa67b7fe700 1 -- 172.21.15.153:0/1640157080 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fa674029090 con 0x7fa6840abf10 2023-08-17T00:03:35.173 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:35.173 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:03:35.174 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:03:35.174 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.174 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:03:35.174 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:03:35.175 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.175 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.175 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:03:35.175 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:03:35.176 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.176 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.176 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.176 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.177 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:03:35.177 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:03:35.177 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.177 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:03:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:03:35.178 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.179 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.179 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.179 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.179 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:03:35.179 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:03:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:03:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:03:35.180 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.181 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.182 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:03:35.183 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:03:35.183 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.183 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.183 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.183 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.184 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.185 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.185 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:03:35.185 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:03:35.185 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.186 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:03:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:03:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.188 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.189 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.189 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.189 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.189 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:03:35.190 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:03:35.190 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.190 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.190 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.191 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.191 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.191 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.191 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.192 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:03:35.192 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:03:35.192 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.192 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.193 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.193 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.193 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.193 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.193 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.194 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:03:35.194 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:03:35.194 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.194 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.195 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.195 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.195 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.196 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.196 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:03:35.196 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:03:35.196 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.197 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:03:35.197 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:03:35.197 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.197 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:03:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:03:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.199 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.199 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:03:35.199 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:03:35.199 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:03:35.199 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.200 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.200 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:03:35.200 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:03:35.200 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.201 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.201 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:03:35.201 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:03:35.202 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:03:35.202 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.202 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.202 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:03:35.202 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:03:35.203 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.203 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.203 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:03:35.203 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:03:35.204 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:03:35.204 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.204 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.204 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:03:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:03:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:03:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:03:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:03:35.205 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.206 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.207 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mds", 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCYY91kCElWERAA9IByS/XSYhyL9FTynNhr5g==", 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mds" 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-mgr", 2023-08-17T00:03:35.208 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCYY91kx1RWERAAPF3bhiLEf5WJg9InwJNXzg==", 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-osd", 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCYY91ksV9WERAALxO8GG64m0V4uQxTTkUR7g==", 2023-08-17T00:03:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-osd" 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd", 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCYY91kempWERAAQhCV7tdrzXVNXn4e1+epEQ==", 2023-08-17T00:03:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCYY91knHVWERAAS+OFj2fImR9PfLHMUcZ/rg==", 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.bootstrap-rgw", 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCYY91k7YFWERAA7b0L0Xg6Gb9wPiHVMnGkEg==", 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-17T00:03:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:03:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:03:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:03:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:03:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:03:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:03:35.215 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:03:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa66405a180 msgr2=0x7fa66405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa66405a180 0x7fa66405c640 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fa68413f3e0 tx=0x7fa66c007d40).stop 2023-08-17T00:03:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840abf10 msgr2=0x7fa6841685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840abf10 0x7fa6841685a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fa674014000 tx=0x7fa674017000).stop 2023-08-17T00:03:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 shutdown_connections 2023-08-17T00:03:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa66405a180 0x7fa66405c640 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6840c1190 0x7fa6840c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6840ac2f0 0x7fa684167380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 --2- 172.21.15.153:0/1640157080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6840abf10 0x7fa6841685a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 >> 172.21.15.153:0/1640157080 conn(0x7fa6840c6620 msgr2=0x7fa684068910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:35.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 shutdown_connections 2023-08-17T00:03:35.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.169+0000 7fa688a8f700 1 -- 172.21.15.153:0/1640157080 wait complete. 2023-08-17T00:03:35.219 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-17T00:03:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 Processor -- start 2023-08-17T00:03:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 -- start start 2023-08-17T00:03:35.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae50150880 0x7fae500a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae500a8e60 0x7fae50068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500ab9b0 con 0x7fae500aa8c0 2023-08-17T00:03:35.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500aada0 con 0x7fae500a8e60 2023-08-17T00:03:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.373+0000 7fae54fb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae500ab080 con 0x7fae50150880 2023-08-17T00:03:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae500a8e60 0x7fae50068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae500a8e60 0x7fae50068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59526/0 (socket says 172.21.15.153:59526) 2023-08-17T00:03:35.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 -- 172.21.15.153:0/3373205421 learned_addr learned my addr 172.21.15.153:0/3373205421 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 -- 172.21.15.153:0/3373205421 >> v2:172.21.15.178:3300/0 conn(0x7fae50150880 msgr2=0x7fae500a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 --2- 172.21.15.153:0/3373205421 >> v2:172.21.15.178:3300/0 conn(0x7fae50150880 0x7fae500a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 -- 172.21.15.153:0/3373205421 >> v1:172.21.15.178:6789/0 conn(0x7fae500aa8c0 legacy=0x7fae500c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 -- 172.21.15.153:0/3373205421 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500ab360 con 0x7fae500a8e60 2023-08-17T00:03:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4effd700 1 --2- 172.21.15.153:0/3373205421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a8e60 0x7fae50068820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fae50066830 tx=0x7fae440090f0).ready entity=mon.0 client_cookie=6ebc86b6fb704fbb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:35.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4e7fc700 1 -- 172.21.15.153:0/3373205421 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400b5a0 con 0x7fae500a8e60 2023-08-17T00:03:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4e7fc700 1 -- 172.21.15.153:0/3373205421 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4400b700 con 0x7fae500a8e60 2023-08-17T00:03:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae4e7fc700 1 -- 172.21.15.153:0/3373205421 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4400baa0 con 0x7fae500a8e60 2023-08-17T00:03:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 -- 172.21.15.153:0/3373205421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a8e60 msgr2=0x7fae50068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 --2- 172.21.15.153:0/3373205421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a8e60 0x7fae50068820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fae50066830 tx=0x7fae440090f0).stop 2023-08-17T00:03:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 -- 172.21.15.153:0/3373205421 shutdown_connections 2023-08-17T00:03:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 --2- 172.21.15.153:0/3373205421 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a8e60 0x7fae50068820 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 --2- 172.21.15.153:0/3373205421 >> v2:172.21.15.178:3300/0 conn(0x7fae50150880 0x7fae500a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 -- 172.21.15.153:0/3373205421 >> 172.21.15.153:0/3373205421 conn(0x7fae500c6620 msgr2=0x7fae500c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 -- 172.21.15.153:0/3373205421 shutdown_connections 2023-08-17T00:03:35.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.377+0000 7fae54fb9700 1 -- 172.21.15.153:0/3373205421 wait complete. 2023-08-17T00:03:35.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 Processor -- start 2023-08-17T00:03:35.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 -- start start 2023-08-17T00:03:35.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500a8e60 0x7fae50150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae500aa8c0 0x7fae5014e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 0x7fae5014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014e0a0 con 0x7fae50150880 2023-08-17T00:03:35.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50167c60 con 0x7fae500aa8c0 2023-08-17T00:03:35.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae54fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae50151240 con 0x7fae500a8e60 2023-08-17T00:03:35.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 0x7fae5014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 0x7fae5014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59536/0 (socket says 172.21.15.153:59536) 2023-08-17T00:03:35.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 -- 172.21.15.153:0/877643249 learned_addr learned my addr 172.21.15.153:0/877643249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:35.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4effd700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae500aa8c0 0x7fae5014e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500a8e60 0x7fae50150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 -- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500a8e60 msgr2=0x7fae50150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500a8e60 0x7fae50150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 -- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae500aa8c0 msgr2=0x7fae5014e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae500aa8c0 0x7fae5014e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 -- 172.21.15.153:0/877643249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae44009370 con 0x7fae50150880 2023-08-17T00:03:35.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.381+0000 7fae4ffff700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 0x7fae5014ac30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fae4800b840 tx=0x7fae48009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:35.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800d500 con 0x7fae50150880 2023-08-17T00:03:35.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800d680 con 0x7fae50150880 2023-08-17T00:03:35.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae50151520 con 0x7fae50150880 2023-08-17T00:03:35.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800da40 con 0x7fae50150880 2023-08-17T00:03:35.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae50151ae0 con 0x7fae50150880 2023-08-17T00:03:35.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae50167df0 con 0x7fae50150880 2023-08-17T00:03:35.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.385+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fae48018030 con 0x7fae50150880 2023-08-17T00:03:35.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.389+0000 7fae377fe700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a150 0x7fae3c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.389+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fae48073760 con 0x7fae50150880 2023-08-17T00:03:35.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.389+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a150 0x7fae3c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.389+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a150 0x7fae3c05c610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fae40006fd0 tx=0x7fae40008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:35.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.389+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae480474a0 con 0x7fae50150880 2023-08-17T00:03:35.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.605+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fae5006b4c0 con 0x7fae50150880 2023-08-17T00:03:35.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.613+0000 7fae377fe700 1 -- 172.21.15.153:0/877643249 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7fae4804aac0 con 0x7fae50150880 2023-08-17T00:03:35.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a150 msgr2=0x7fae3c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a150 0x7fae3c05c610 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7fae40006fd0 tx=0x7fae40008040).stop 2023-08-17T00:03:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 msgr2=0x7fae5014ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 0x7fae5014ac30 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7fae4800b840 tx=0x7fae48009270).stop 2023-08-17T00:03:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 shutdown_connections 2023-08-17T00:03:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a150 0x7fae3c05c610 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae50150880 0x7fae5014ac30 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae500aa8c0 0x7fae5014e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 --2- 172.21.15.153:0/877643249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500a8e60 0x7fae50150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 >> 172.21.15.153:0/877643249 conn(0x7fae500c6620 msgr2=0x7fae500c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:35.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 shutdown_connections 2023-08-17T00:03:35.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.617+0000 7fae54fb9700 1 -- 172.21.15.153:0/877643249 wait complete. 2023-08-17T00:03:35.627 INFO:teuthology.orchestra.run.smithi153.stderr:updated 2023-08-17T00:03:35.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-17T00:03:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.801+0000 7f28f43db700 1 Processor -- start 2023-08-17T00:03:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.801+0000 7f28f43db700 1 -- start start 2023-08-17T00:03:35.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f43db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 0x7f28ec0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f43db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28ec154130 0x7f28ec0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f43db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec065240 con 0x7f28ec0656d0 2023-08-17T00:03:35.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f43db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec062ea0 con 0x7f28ec154130 2023-08-17T00:03:35.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f43db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec063880 con 0x7f28ec153d50 2023-08-17T00:03:35.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1976700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28ec154130 0x7f28ec0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 0x7f28ec0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1976700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28ec154130 0x7f28ec0629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:50970/0 (socket says 172.21.15.153:50970) 2023-08-17T00:03:35.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 0x7f28ec0632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:48558/0 (socket says 172.21.15.153:48558) 2023-08-17T00:03:35.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1976700 1 -- 172.21.15.153:0/1082236163 learned_addr learned my addr 172.21.15.153:0/1082236163 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 -- 172.21.15.153:0/1082236163 >> v2:172.21.15.178:3300/0 conn(0x7f28ec154130 msgr2=0x7f28ec0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 --2- 172.21.15.153:0/1082236163 >> v2:172.21.15.178:3300/0 conn(0x7f28ec154130 0x7f28ec0629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 -- 172.21.15.153:0/1082236163 >> v1:172.21.15.178:6789/0 conn(0x7f28ec0656d0 legacy=0x7f28ec0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 -- 172.21.15.153:0/1082236163 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec064910 con 0x7f28ec153d50 2023-08-17T00:03:35.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1175700 1 -- 172.21.15.153:0/1082236163 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618037612 0 0) 0x7f28ec065240 con 0x7f28ec0656d0 2023-08-17T00:03:35.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f2177700 1 --2- 172.21.15.153:0/1082236163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 0x7f28ec0632e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f28e8009760 tx=0x7f28e8009060).ready entity=mon.2 client_cookie=e7e4ce241da3c268 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1175700 1 -- 172.21.15.153:0/1082236163 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e80090d0 con 0x7f28ec153d50 2023-08-17T00:03:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1175700 1 -- 172.21.15.153:0/1082236163 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800f510 con 0x7f28ec153d50 2023-08-17T00:03:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.805+0000 7f28f1175700 1 -- 172.21.15.153:0/1082236163 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800f890 con 0x7f28ec153d50 2023-08-17T00:03:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 -- 172.21.15.153:0/1082236163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 msgr2=0x7f28ec0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 --2- 172.21.15.153:0/1082236163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 0x7f28ec0632e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f28e8009760 tx=0x7f28e8009060).stop 2023-08-17T00:03:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 -- 172.21.15.153:0/1082236163 shutdown_connections 2023-08-17T00:03:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 --2- 172.21.15.153:0/1082236163 >> v2:172.21.15.178:3300/0 conn(0x7f28ec154130 0x7f28ec0629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 --2- 172.21.15.153:0/1082236163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec153d50 0x7f28ec0632e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 -- 172.21.15.153:0/1082236163 >> 172.21.15.153:0/1082236163 conn(0x7f28ec0c7150 msgr2=0x7f28ec0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 -- 172.21.15.153:0/1082236163 shutdown_connections 2023-08-17T00:03:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.809+0000 7f28f43db700 1 -- 172.21.15.153:0/1082236163 wait complete. 2023-08-17T00:03:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 Processor -- start 2023-08-17T00:03:35.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 -- start start 2023-08-17T00:03:35.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 0x7f28ec0aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28ec153d50 0x7f28ec0bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec154130 0x7f28ec0bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0abe90 con 0x7f28ec0656d0 2023-08-17T00:03:35.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec157360 con 0x7f28ec153d50 2023-08-17T00:03:35.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f43db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0ac320 con 0x7f28ec154130 2023-08-17T00:03:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 0x7f28ec0aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f1976700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28ec153d50 0x7f28ec0bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 0x7f28ec0aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59544/0 (socket says 172.21.15.153:59544) 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 -- 172.21.15.153:0/1887909092 learned_addr learned my addr 172.21.15.153:0/1887909092 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2978700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec154130 0x7f28ec0bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 -- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec154130 msgr2=0x7f28ec0bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec154130 0x7f28ec0bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 -- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28ec153d50 msgr2=0x7f28ec0bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28ec153d50 0x7f28ec0bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 -- 172.21.15.153:0/1887909092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80092a0 con 0x7f28ec0656d0 2023-08-17T00:03:35.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.813+0000 7f28f2177700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 0x7f28ec0aaca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f28e8009e00 tx=0x7f28e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:35.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800f680 con 0x7f28ec0656d0 2023-08-17T00:03:35.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e800f7e0 con 0x7f28ec0656d0 2023-08-17T00:03:35.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec0ab280 con 0x7f28ec0656d0 2023-08-17T00:03:35.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e800fea0 con 0x7f28ec0656d0 2023-08-17T00:03:35.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec0ab840 con 0x7f28ec0656d0 2023-08-17T00:03:35.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec06b530 con 0x7f28ec0656d0 2023-08-17T00:03:35.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.817+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f28e8021070 con 0x7f28ec0656d0 2023-08-17T00:03:35.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.821+0000 7f28e27fc700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28d005a150 0x7f28d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:35.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.821+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f28e8075590 con 0x7f28ec0656d0 2023-08-17T00:03:35.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.821+0000 7f28f1976700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28d005a150 0x7f28d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:35.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.821+0000 7f28f1976700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28d005a150 0x7f28d005c610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f28ec0bcd90 tx=0x7f28dc0090f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:35.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:35.825+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28e8049220 con 0x7f28ec0656d0 2023-08-17T00:03:36.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.041+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f28ec064bf0 con 0x7f28ec0656d0 2023-08-17T00:03:36.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.045+0000 7f28e27fc700 1 -- 172.21.15.153:0/1887909092 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f28e80280a0 con 0x7f28ec0656d0 2023-08-17T00:03:36.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28d005a150 msgr2=0x7f28d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28d005a150 0x7f28d005c610 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f28ec0bcd90 tx=0x7f28dc0090f0).stop 2023-08-17T00:03:36.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 msgr2=0x7f28ec0aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 0x7f28ec0aaca0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f28e8009e00 tx=0x7f28e8017000).stop 2023-08-17T00:03:36.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 shutdown_connections 2023-08-17T00:03:36.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28d005a150 0x7f28d005c610 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28ec154130 0x7f28ec0bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28ec153d50 0x7f28ec0bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 --2- 172.21.15.153:0/1887909092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28ec0656d0 0x7f28ec0aaca0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 >> 172.21.15.153:0/1887909092 conn(0x7f28ec0c7150 msgr2=0x7f28ec0c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:36.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 shutdown_connections 2023-08-17T00:03:36.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.049+0000 7f28f43db700 1 -- 172.21.15.153:0/1887909092 wait complete. 2023-08-17T00:03:36.057 INFO:teuthology.orchestra.run.smithi153.stderr:updated 2023-08-17T00:03:36.075 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-17T00:03:36.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.233+0000 7efec8b07700 1 Processor -- start 2023-08-17T00:03:36.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.233+0000 7efec8b07700 1 -- start start 2023-08-17T00:03:36.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efec40a8df0 0x7efec40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec40aa6e0 0x7efec4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec41585a0 con 0x7efec4068820 2023-08-17T00:03:36.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec4066400 con 0x7efec40a8df0 2023-08-17T00:03:36.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec4069170 con 0x7efec40aa6e0 2023-08-17T00:03:36.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efec4068820 0x7efec4061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43768/0 (socket says 172.21.15.153:43768) 2023-08-17T00:03:36.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec2ffd700 1 -- 172.21.15.153:0/4155289075 learned_addr learned my addr 172.21.15.153:0/4155289075 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:36.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec37fe700 1 --2- 172.21.15.153:0/4155289075 >> v2:172.21.15.178:3300/0 conn(0x7efec40a8df0 0x7efec40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec3fff700 1 --2- 172.21.15.153:0/4155289075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec40aa6e0 0x7efec4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec27fc700 1 -- 172.21.15.153:0/4155289075 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766498408 0 0) 0x7efec41585a0 con 0x7efec4068820 2023-08-17T00:03:36.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec27fc700 1 -- 172.21.15.153:0/4155289075 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeac0033f0 con 0x7efec4068820 2023-08-17T00:03:36.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec3fff700 1 -- 172.21.15.153:0/4155289075 >> v2:172.21.15.178:3300/0 conn(0x7efec40a8df0 msgr2=0x7efec40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:36.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec3fff700 1 --2- 172.21.15.153:0/4155289075 >> v2:172.21.15.178:3300/0 conn(0x7efec40a8df0 0x7efec40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec3fff700 1 -- 172.21.15.153:0/4155289075 >> v1:172.21.15.153:6789/0 conn(0x7efec4068820 legacy=0x7efec4061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec3fff700 1 -- 172.21.15.153:0/4155289075 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec40b9d30 con 0x7efec40aa6e0 2023-08-17T00:03:36.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec3fff700 1 --2- 172.21.15.153:0/4155289075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec40aa6e0 0x7efec4068c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efebc009e60 tx=0x7efebc009780).ready entity=mon.2 client_cookie=143f6d46cf4141f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:36.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec27fc700 1 -- 172.21.15.153:0/4155289075 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00e070 con 0x7efec40aa6e0 2023-08-17T00:03:36.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec27fc700 1 -- 172.21.15.153:0/4155289075 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00bab0 con 0x7efec40aa6e0 2023-08-17T00:03:36.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec27fc700 1 -- 172.21.15.153:0/4155289075 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00be30 con 0x7efec40aa6e0 2023-08-17T00:03:36.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- 172.21.15.153:0/4155289075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec40aa6e0 msgr2=0x7efec4068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 --2- 172.21.15.153:0/4155289075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec40aa6e0 0x7efec4068c80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7efebc009e60 tx=0x7efebc009780).stop 2023-08-17T00:03:36.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- 172.21.15.153:0/4155289075 shutdown_connections 2023-08-17T00:03:36.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 --2- 172.21.15.153:0/4155289075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec40aa6e0 0x7efec4068c80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 --2- 172.21.15.153:0/4155289075 >> v2:172.21.15.178:3300/0 conn(0x7efec40a8df0 0x7efec40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- 172.21.15.153:0/4155289075 >> 172.21.15.153:0/4155289075 conn(0x7efec40c6620 msgr2=0x7efec40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:36.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.237+0000 7efec8b07700 1 -- 172.21.15.153:0/4155289075 shutdown_connections 2023-08-17T00:03:36.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 -- 172.21.15.153:0/4155289075 wait complete. 2023-08-17T00:03:36.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 Processor -- start 2023-08-17T00:03:36.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 -- start start 2023-08-17T00:03:36.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec4068820 0x7efec40be190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 0x7efec4157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec40aa6e0 0x7efec40bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40b51e0 con 0x7efec40a8df0 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec40ba470 con 0x7efec40aa6e0 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec8b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40befc0 con 0x7efec4068820 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 0x7efec4157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 0x7efec4157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59558/0 (socket says 172.21.15.153:59558) 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.241+0000 7efec2ffd700 1 -- 172.21.15.153:0/561809056 learned_addr learned my addr 172.21.15.153:0/561809056 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec3fff700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec40aa6e0 0x7efec40bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec37fe700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec4068820 0x7efec40be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec2ffd700 1 -- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec4068820 msgr2=0x7efec40be190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec2ffd700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec4068820 0x7efec40be190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec2ffd700 1 -- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec40aa6e0 msgr2=0x7efec40bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec2ffd700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec40aa6e0 0x7efec40bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec2ffd700 1 -- 172.21.15.153:0/561809056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009a20 con 0x7efec40a8df0 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec2ffd700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 0x7efec4157a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7efeb800c420 tx=0x7efeb8007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80070d0 con 0x7efec40a8df0 2023-08-17T00:03:36.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8007230 con 0x7efec40a8df0 2023-08-17T00:03:36.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80075b0 con 0x7efec40a8df0 2023-08-17T00:03:36.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec40bea00 con 0x7efec40a8df0 2023-08-17T00:03:36.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec40ba100 con 0x7efec40a8df0 2023-08-17T00:03:36.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.245+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec40ba600 con 0x7efec40a8df0 2023-08-17T00:03:36.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.249+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efeb8010070 con 0x7efec40a8df0 2023-08-17T00:03:36.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.249+0000 7efeab7fe700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efeb005a150 0x7efeb005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.249+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efeb8073380 con 0x7efec40a8df0 2023-08-17T00:03:36.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.249+0000 7efec37fe700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efeb005a150 0x7efeb005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.253+0000 7efec37fe700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efeb005a150 0x7efeb005c610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7efeb4006fd0 tx=0x7efeb4006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:36.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.257+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efeb8047180 con 0x7efec40a8df0 2023-08-17T00:03:36.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.469+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efec4064010 con 0x7efec40a8df0 2023-08-17T00:03:36.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.477+0000 7efeab7fe700 1 -- 172.21.15.153:0/561809056 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7efeb804a7a0 con 0x7efec40a8df0 2023-08-17T00:03:36.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efeb005a150 msgr2=0x7efeb005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efeb005a150 0x7efeb005c610 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7efeb4006fd0 tx=0x7efeb4006f40).stop 2023-08-17T00:03:36.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 msgr2=0x7efec4157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 0x7efec4157a80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7efeb800c420 tx=0x7efeb8007c80).stop 2023-08-17T00:03:36.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 shutdown_connections 2023-08-17T00:03:36.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efeb005a150 0x7efeb005c610 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efec40aa6e0 0x7efec40bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efec40a8df0 0x7efec4157a80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 --2- 172.21.15.153:0/561809056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efec4068820 0x7efec40be190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 >> 172.21.15.153:0/561809056 conn(0x7efec40c6620 msgr2=0x7efec40ab4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:36.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 shutdown_connections 2023-08-17T00:03:36.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.481+0000 7efec8b07700 1 -- 172.21.15.153:0/561809056 wait complete. 2023-08-17T00:03:36.492 INFO:teuthology.orchestra.run.smithi153.stderr:updated 2023-08-17T00:03:36.508 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-17T00:03:36.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.657+0000 7f4530d07700 1 Processor -- start 2023-08-17T00:03:36.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.657+0000 7f4530d07700 1 -- start start 2023-08-17T00:03:36.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f4530d07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f452c0a8df0 0x7f452c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f4530d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f452c0aa6e0 0x7f452c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f4530d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c1585a0 con 0x7f452c068820 2023-08-17T00:03:36.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f4530d07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452c066400 con 0x7f452c0aa6e0 2023-08-17T00:03:36.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f4530d07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452c069170 con 0x7f452c0a8df0 2023-08-17T00:03:36.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f452c0aa6e0 0x7f452c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f452c0aa6e0 0x7f452c068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59572/0 (socket says 172.21.15.153:59572) 2023-08-17T00:03:36.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 -- 172.21.15.153:0/1057562612 learned_addr learned my addr 172.21.15.153:0/1057562612 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:36.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452b7fe700 1 --2- 172.21.15.153:0/1057562612 >> v2:172.21.15.178:3300/0 conn(0x7f452c0a8df0 0x7f452c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 -- 172.21.15.153:0/1057562612 >> v2:172.21.15.178:3300/0 conn(0x7f452c0a8df0 msgr2=0x7f452c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:36.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 --2- 172.21.15.153:0/1057562612 >> v2:172.21.15.178:3300/0 conn(0x7f452c0a8df0 0x7f452c0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 -- 172.21.15.153:0/1057562612 >> v1:172.21.15.178:6789/0 conn(0x7f452c068820 legacy=0x7f452c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 -- 172.21.15.153:0/1057562612 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0b9d30 con 0x7f452c0aa6e0 2023-08-17T00:03:36.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452bfff700 1 --2- 172.21.15.153:0/1057562612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c068c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f452c0c3f30 tx=0x7f4524009840).ready entity=mon.0 client_cookie=85a3f9720a0dc594 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:36.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452a7fc700 1 -- 172.21.15.153:0/1057562612 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400e070 con 0x7f452c0aa6e0 2023-08-17T00:03:36.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452a7fc700 1 -- 172.21.15.153:0/1057562612 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452400ba20 con 0x7f452c0aa6e0 2023-08-17T00:03:36.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.661+0000 7f452a7fc700 1 -- 172.21.15.153:0/1057562612 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400bda0 con 0x7f452c0aa6e0 2023-08-17T00:03:36.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 -- 172.21.15.153:0/1057562612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 msgr2=0x7f452c068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 --2- 172.21.15.153:0/1057562612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c068c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f452c0c3f30 tx=0x7f4524009840).stop 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 -- 172.21.15.153:0/1057562612 shutdown_connections 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 --2- 172.21.15.153:0/1057562612 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c068c80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 --2- 172.21.15.153:0/1057562612 >> v2:172.21.15.178:3300/0 conn(0x7f452c0a8df0 0x7f452c0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 -- 172.21.15.153:0/1057562612 >> 172.21.15.153:0/1057562612 conn(0x7f452c0c6620 msgr2=0x7f452c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 -- 172.21.15.153:0/1057562612 shutdown_connections 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 -- 172.21.15.153:0/1057562612 wait complete. 2023-08-17T00:03:36.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 Processor -- start 2023-08-17T00:03:36.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.665+0000 7f4530d07700 1 -- start start 2023-08-17T00:03:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c068820 0x7f452c0c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0a8df0 0x7f452c149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c14a350 con 0x7f452c0aa6e0 2023-08-17T00:03:36.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0bacd0 con 0x7f452c0a8df0 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c0ba0c0 con 0x7f452c068820 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c068820 0x7f452c0c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c149e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59584/0 (socket says 172.21.15.153:59584) 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 -- 172.21.15.153:0/3539158249 learned_addr learned my addr 172.21.15.153:0/3539158249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452affd700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0a8df0 0x7f452c149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 -- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c068820 msgr2=0x7f452c0c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c068820 0x7f452c0c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 -- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0a8df0 msgr2=0x7f452c149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0a8df0 0x7f452c149970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 -- 172.21.15.153:0/3539158249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524009ae0 con 0x7f452c0aa6e0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f452bfff700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c149e60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f452400b6c0 tx=0x7f4524009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452400bda0 con 0x7f452c0aa6e0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45240092e0 con 0x7f452c0aa6e0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c0ba3a0 con 0x7f452c0aa6e0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452401d6b0 con 0x7f452c0aa6e0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.669+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c0ba960 con 0x7f452c0aa6e0 2023-08-17T00:03:36.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.673+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c0b6380 con 0x7f452c0aa6e0 2023-08-17T00:03:36.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.673+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4524024030 con 0x7f452c0aa6e0 2023-08-17T00:03:36.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.673+0000 7f45137fe700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f451805a150 0x7f451805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:36.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.673+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4524075090 con 0x7f452c0aa6e0 2023-08-17T00:03:36.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.673+0000 7f452b7fe700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f451805a150 0x7f451805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:36.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.677+0000 7f452b7fe700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f451805a150 0x7f451805c610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f451c006fd0 tx=0x7f451c006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:36.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.677+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4524048f40 con 0x7f452c0aa6e0 2023-08-17T00:03:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.893+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f452c0bae40 con 0x7f452c0aa6e0 2023-08-17T00:03:36.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.901+0000 7f45137fe700 1 -- 172.21.15.153:0/3539158249 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4524022070 con 0x7f452c0aa6e0 2023-08-17T00:03:36.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.901+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f451805a150 msgr2=0x7f451805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.901+0000 7f4530d07700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f451805a150 0x7f451805c610 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f451c006fd0 tx=0x7f451c006f40).stop 2023-08-17T00:03:36.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.901+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 msgr2=0x7f452c149e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:36.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.901+0000 7f4530d07700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c149e60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f452400b6c0 tx=0x7f4524009840).stop 2023-08-17T00:03:36.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 shutdown_connections 2023-08-17T00:03:36.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f451805a150 0x7f451805c610 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f452c0aa6e0 0x7f452c149e60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f452c0a8df0 0x7f452c149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 --2- 172.21.15.153:0/3539158249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f452c068820 0x7f452c0c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:36.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 >> 172.21.15.153:0/3539158249 conn(0x7f452c0c6620 msgr2=0x7f452c0ab260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:36.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 shutdown_connections 2023-08-17T00:03:36.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:36.905+0000 7f4530d07700 1 -- 172.21.15.153:0/3539158249 wait complete. 2023-08-17T00:03:36.914 INFO:teuthology.orchestra.run.smithi153.stderr:updated 2023-08-17T00:03:36.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-17T00:03:37.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 Processor -- start 2023-08-17T00:03:37.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 -- start start 2023-08-17T00:03:37.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f71b0068da0 0x7f71b01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71b0151530 0x7f71b01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b0065da0 con 0x7f71b00689c0 2023-08-17T00:03:37.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b0069200 con 0x7f71b0068da0 2023-08-17T00:03:37.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71b4db9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b0155c60 con 0x7f71b0151530 2023-08-17T00:03:37.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.081+0000 7f71a6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f71b0068da0 0x7f71b01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f71b0068da0 0x7f71b01560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59596/0 (socket says 172.21.15.153:59596) 2023-08-17T00:03:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 -- 172.21.15.153:0/351646915 learned_addr learned my addr 172.21.15.153:0/351646915 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71affff700 1 --2- 172.21.15.153:0/351646915 >> v2:172.21.15.178:3300/0 conn(0x7f71b0151530 0x7f71b01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71aeffd700 1 -- 172.21.15.153:0/351646915 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292151948 0 0) 0x7f71b0065da0 con 0x7f71b00689c0 2023-08-17T00:03:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71aeffd700 1 -- 172.21.15.153:0/351646915 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f719c0033f0 con 0x7f71b00689c0 2023-08-17T00:03:37.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 -- 172.21.15.153:0/351646915 >> v2:172.21.15.178:3300/0 conn(0x7f71b0151530 msgr2=0x7f71b01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:37.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 --2- 172.21.15.153:0/351646915 >> v2:172.21.15.178:3300/0 conn(0x7f71b0151530 0x7f71b01519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 -- 172.21.15.153:0/351646915 >> v1:172.21.15.178:6789/0 conn(0x7f71b00689c0 legacy=0x7f71b00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 -- 172.21.15.153:0/351646915 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0065ff0 con 0x7f71b0068da0 2023-08-17T00:03:37.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71affff700 1 --2- 172.21.15.153:0/351646915 >> v2:172.21.15.178:3300/0 conn(0x7f71b0151530 0x7f71b01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:37.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71a6ffd700 1 --2- 172.21.15.153:0/351646915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b0068da0 0x7f71b01560f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f71b0063b00 tx=0x7f71980090f0).ready entity=mon.0 client_cookie=13c290914638947b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71aeffd700 1 -- 172.21.15.153:0/351646915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800f510 con 0x7f71b0068da0 2023-08-17T00:03:37.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71aeffd700 1 -- 172.21.15.153:0/351646915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800f670 con 0x7f71b0068da0 2023-08-17T00:03:37.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71aeffd700 1 -- 172.21.15.153:0/351646915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800f9f0 con 0x7f71b0068da0 2023-08-17T00:03:37.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 -- 172.21.15.153:0/351646915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b0068da0 msgr2=0x7f71b01560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 --2- 172.21.15.153:0/351646915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b0068da0 0x7f71b01560f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f71b0063b00 tx=0x7f71980090f0).stop 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 -- 172.21.15.153:0/351646915 shutdown_connections 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 --2- 172.21.15.153:0/351646915 >> v2:172.21.15.178:3300/0 conn(0x7f71b0151530 0x7f71b01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 --2- 172.21.15.153:0/351646915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b0068da0 0x7f71b01560f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 -- 172.21.15.153:0/351646915 >> 172.21.15.153:0/351646915 conn(0x7f71b00c6620 msgr2=0x7f71b00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 -- 172.21.15.153:0/351646915 shutdown_connections 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.085+0000 7f71b4db9700 1 -- 172.21.15.153:0/351646915 wait complete. 2023-08-17T00:03:37.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 Processor -- start 2023-08-17T00:03:37.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 -- start start 2023-08-17T00:03:37.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 0x7f71b014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b0068da0 0x7f71b00bc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0151530 0x7f71b00bf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00bbd60 con 0x7f71b00689c0 2023-08-17T00:03:37.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00bb0e0 con 0x7f71b0068da0 2023-08-17T00:03:37.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71b4db9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00bb3c0 con 0x7f71b0151530 2023-08-17T00:03:37.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71af7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 0x7f71b014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71a6ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b0068da0 0x7f71b00bc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71af7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 0x7f71b014dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59598/0 (socket says 172.21.15.153:59598) 2023-08-17T00:03:37.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71af7fe700 1 -- 172.21.15.153:0/1614605223 learned_addr learned my addr 172.21.15.153:0/1614605223 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:37.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71affff700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0151530 0x7f71b00bf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71af7fe700 1 -- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0151530 msgr2=0x7f71b00bf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.089+0000 7f71af7fe700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0151530 0x7f71b00bf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71af7fe700 1 -- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b0068da0 msgr2=0x7f71b00bc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71af7fe700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b0068da0 0x7f71b00bc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71af7fe700 1 -- 172.21.15.153:0/1614605223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009a20 con 0x7f71b00689c0 2023-08-17T00:03:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71a6ffd700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b0068da0 0x7f71b00bc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71af7fe700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 0x7f71b014dd60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f71a000c420 tx=0x7f71a0007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000ce20 con 0x7f71b00689c0 2023-08-17T00:03:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a000f470 con 0x7f71b00689c0 2023-08-17T00:03:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7198009370 con 0x7f71b00689c0 2023-08-17T00:03:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f830 con 0x7f71b00689c0 2023-08-17T00:03:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b00bb980 con 0x7f71b00689c0 2023-08-17T00:03:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b006b4c0 con 0x7f71b00689c0 2023-08-17T00:03:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.093+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f71a0010070 con 0x7f71b00689c0 2023-08-17T00:03:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.097+0000 7f71a7fff700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f719005a150 0x7f719005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.097+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f71a0073380 con 0x7f71b00689c0 2023-08-17T00:03:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.097+0000 7f71a6ffd700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f719005a150 0x7f719005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.097+0000 7f71a6ffd700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f719005a150 0x7f719005c610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f71b00b9f30 tx=0x7f7198016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.101+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f71a0047070 con 0x7f71b00689c0 2023-08-17T00:03:37.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.313+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f71b00bcfc0 con 0x7f71b00689c0 2023-08-17T00:03:37.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.321+0000 7f71a7fff700 1 -- 172.21.15.153:0/1614605223 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71a004a690 con 0x7f71b00689c0 2023-08-17T00:03:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f719005a150 msgr2=0x7f719005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f719005a150 0x7f719005c610 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f71b00b9f30 tx=0x7f7198016000).stop 2023-08-17T00:03:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 msgr2=0x7f71b014dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 0x7f71b014dd60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f71a000c420 tx=0x7f71a0007c30).stop 2023-08-17T00:03:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 shutdown_connections 2023-08-17T00:03:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f719005a150 0x7f719005c610 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71b0151530 0x7f71b00bf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71b0068da0 0x7f71b00bc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 --2- 172.21.15.153:0/1614605223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71b00689c0 0x7f71b014dd60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 >> 172.21.15.153:0/1614605223 conn(0x7f71b00c6620 msgr2=0x7f71b0061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 shutdown_connections 2023-08-17T00:03:37.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.325+0000 7f71b4db9700 1 -- 172.21.15.153:0/1614605223 wait complete. 2023-08-17T00:03:37.333 INFO:teuthology.orchestra.run.smithi153.stderr:updated 2023-08-17T00:03:37.352 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-17T00:03:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.501+0000 7fe45ce39700 1 Processor -- start 2023-08-17T00:03:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.501+0000 7fe45ce39700 1 -- start start 2023-08-17T00:03:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4580c57a0 0x7fe4580c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4580c11b0 0x7fe458154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4580bfd10 con 0x7fe458153f50 2023-08-17T00:03:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe458154860 con 0x7fe4580c11b0 2023-08-17T00:03:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe458154af0 con 0x7fe4580c57a0 2023-08-17T00:03:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4580c11b0 0x7fe458154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe4580c11b0 0x7fe458154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59614/0 (socket says 172.21.15.153:59614) 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 -- 172.21.15.153:0/2628825676 learned_addr learned my addr 172.21.15.153:0/2628825676 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe4577fe700 1 --2- 172.21.15.153:0/2628825676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4580c57a0 0x7fe4580c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 -- 172.21.15.153:0/2628825676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4580c57a0 msgr2=0x7fe4580c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 --2- 172.21.15.153:0/2628825676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4580c57a0 0x7fe4580c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 -- 172.21.15.153:0/2628825676 >> v1:172.21.15.178:6789/0 conn(0x7fe458153f50 legacy=0x7fe458157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 -- 172.21.15.153:0/2628825676 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe458154dd0 con 0x7fe4580c11b0 2023-08-17T00:03:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe457fff700 1 --2- 172.21.15.153:0/2628825676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe458154370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe450009f20 tx=0x7fe450009840).ready entity=mon.0 client_cookie=8bbf5142cbe4df9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe4567fc700 1 -- 172.21.15.153:0/2628825676 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000e070 con 0x7fe4580c11b0 2023-08-17T00:03:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe4567fc700 1 -- 172.21.15.153:0/2628825676 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45000ba80 con 0x7fe4580c11b0 2023-08-17T00:03:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe4567fc700 1 -- 172.21.15.153:0/2628825676 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000be00 con 0x7fe4580c11b0 2023-08-17T00:03:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- 172.21.15.153:0/2628825676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 msgr2=0x7fe458154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2628825676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe458154370 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fe450009f20 tx=0x7fe450009840).stop 2023-08-17T00:03:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- 172.21.15.153:0/2628825676 shutdown_connections 2023-08-17T00:03:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2628825676 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe458154370 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2628825676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4580c57a0 0x7fe4580c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- 172.21.15.153:0/2628825676 >> 172.21.15.153:0/2628825676 conn(0x7fe458062a70 msgr2=0x7fe4580ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- 172.21.15.153:0/2628825676 shutdown_connections 2023-08-17T00:03:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.505+0000 7fe45ce39700 1 -- 172.21.15.153:0/2628825676 wait complete. 2023-08-17T00:03:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 Processor -- start 2023-08-17T00:03:37.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 -- start start 2023-08-17T00:03:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe4580ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4580c57a0 0x7fe4580aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe458153f50 0x7fe4580ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580af4d0 con 0x7fe4580c11b0 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580af7a0 con 0x7fe4580c57a0 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe45ce39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580af9f0 con 0x7fe458153f50 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe4580ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe4580ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59620/0 (socket says 172.21.15.153:59620) 2023-08-17T00:03:37.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 -- 172.21.15.153:0/2952627023 learned_addr learned my addr 172.21.15.153:0/2952627023 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 -- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe458153f50 msgr2=0x7fe4580ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe458153f50 0x7fe4580ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 -- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4580c57a0 msgr2=0x7fe4580aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4580c57a0 0x7fe4580aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.509+0000 7fe4577fe700 1 -- 172.21.15.153:0/2952627023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe450009ae0 con 0x7fe4580c11b0 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe4577fe700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe4580ae240 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fe44800d890 tx=0x7fe448008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480125f0 con 0x7fe4580c11b0 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe448012750 con 0x7fe4580c11b0 2023-08-17T00:03:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4580afcd0 con 0x7fe4580c11b0 2023-08-17T00:03:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe448012ad0 con 0x7fe4580c11b0 2023-08-17T00:03:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4580b0290 con 0x7fe4580c11b0 2023-08-17T00:03:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45806b4c0 con 0x7fe4580c11b0 2023-08-17T00:03:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.513+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe448013480 con 0x7fe4580c11b0 2023-08-17T00:03:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.517+0000 7fe43f7fe700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe44405a150 0x7fe44405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.517+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe448073e30 con 0x7fe4580c11b0 2023-08-17T00:03:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.517+0000 7fe456ffd700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe44405a150 0x7fe44405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.517+0000 7fe456ffd700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe44405a150 0x7fe44405c610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fe45805e6b0 tx=0x7fe44c0079c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.521+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe448047ac0 con 0x7fe4580c11b0 2023-08-17T00:03:37.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.733+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe4580bf9a0 con 0x7fe4580c11b0 2023-08-17T00:03:37.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.741+0000 7fe43f7fe700 1 -- 172.21.15.153:0/2952627023 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe44804b0e0 con 0x7fe4580c11b0 2023-08-17T00:03:37.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe44405a150 msgr2=0x7fe44405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe44405a150 0x7fe44405c610 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fe45805e6b0 tx=0x7fe44c0079c0).stop 2023-08-17T00:03:37.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 msgr2=0x7fe4580ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe4580ae240 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7fe44800d890 tx=0x7fe448008040).stop 2023-08-17T00:03:37.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 shutdown_connections 2023-08-17T00:03:37.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe44405a150 0x7fe44405c610 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe458153f50 0x7fe4580ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:37.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4580c57a0 0x7fe4580aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:03:37.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 --2- 172.21.15.153:0/2952627023 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4580c11b0 0x7fe4580ae240 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 >> 172.21.15.153:0/2952627023 conn(0x7fe458062a70 msgr2=0x7fe4580c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:37.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 shutdown_connections 2023-08-17T00:03:37.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.745+0000 7fe45ce39700 1 -- 172.21.15.153:0/2952627023 wait complete. 2023-08-17T00:03:37.754 INFO:teuthology.orchestra.run.smithi153.stderr:updated 2023-08-17T00:03:37.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:37.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 Processor -- start 2023-08-17T00:03:37.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 -- start start 2023-08-17T00:03:37.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 0x7f6ac80c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ac8068820 0x7f6ac8068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac81585a0 con 0x7f6ac8061fa0 2023-08-17T00:03:37.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac8066400 con 0x7f6ac8068820 2023-08-17T00:03:37.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6acccb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac8069170 con 0x7f6ac80a8df0 2023-08-17T00:03:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ac8068820 0x7f6ac8068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 0x7f6ac80c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6ac8068820 0x7f6ac8068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59622/0 (socket says 172.21.15.153:59622) 2023-08-17T00:03:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 0x7f6ac80c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:51066/0 (socket says 172.21.15.153:51066) 2023-08-17T00:03:37.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac6ffd700 1 -- 172.21.15.153:0/4114640452 learned_addr learned my addr 172.21.15.153:0/4114640452 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac67fc700 1 -- 172.21.15.153:0/4114640452 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811422956 0 0) 0x7f6ac81585a0 con 0x7f6ac8061fa0 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.925+0000 7f6ac67fc700 1 -- 172.21.15.153:0/4114640452 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab00033f0 con 0x7f6ac8061fa0 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac6ffd700 1 -- 172.21.15.153:0/4114640452 >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 msgr2=0x7f6ac80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac6ffd700 1 --2- 172.21.15.153:0/4114640452 >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 0x7f6ac80c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac6ffd700 1 -- 172.21.15.153:0/4114640452 >> v1:172.21.15.178:6789/0 conn(0x7f6ac8061fa0 legacy=0x7f6ac8062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac6ffd700 1 -- 172.21.15.153:0/4114640452 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80b9d30 con 0x7f6ac8068820 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac77fe700 1 --2- 172.21.15.153:0/4114640452 >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 0x7f6ac80c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:37.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac6ffd700 1 --2- 172.21.15.153:0/4114640452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac8068820 0x7f6ac8068c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f6ac80c3f30 tx=0x7f6abc0090f0).ready entity=mon.0 client_cookie=329155acfcdb022d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac67fc700 1 -- 172.21.15.153:0/4114640452 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00f510 con 0x7f6ac8068820 2023-08-17T00:03:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac67fc700 1 -- 172.21.15.153:0/4114640452 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc00f670 con 0x7f6ac8068820 2023-08-17T00:03:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6ac67fc700 1 -- 172.21.15.153:0/4114640452 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc00fa10 con 0x7f6ac8068820 2023-08-17T00:03:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 -- 172.21.15.153:0/4114640452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac8068820 msgr2=0x7f6ac8068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 --2- 172.21.15.153:0/4114640452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac8068820 0x7f6ac8068c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f6ac80c3f30 tx=0x7f6abc0090f0).stop 2023-08-17T00:03:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 -- 172.21.15.153:0/4114640452 shutdown_connections 2023-08-17T00:03:37.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 --2- 172.21.15.153:0/4114640452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac8068820 0x7f6ac8068c80 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 --2- 172.21.15.153:0/4114640452 >> v2:172.21.15.178:3300/0 conn(0x7f6ac80a8df0 0x7f6ac80c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 -- 172.21.15.153:0/4114640452 >> 172.21.15.153:0/4114640452 conn(0x7f6ac80c6620 msgr2=0x7f6ac80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 -- 172.21.15.153:0/4114640452 shutdown_connections 2023-08-17T00:03:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.929+0000 7f6acccb9700 1 -- 172.21.15.153:0/4114640452 wait complete. 2023-08-17T00:03:37.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 Processor -- start 2023-08-17T00:03:37.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 -- start start 2023-08-17T00:03:37.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac8061fa0 0x7f6ac8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac8068820 0x7f6ac8062430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 0x7f6ac8062920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8062e10 con 0x7f6ac80a8df0 2023-08-17T00:03:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8168390 con 0x7f6ac8068820 2023-08-17T00:03:37.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6acccb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80bae90 con 0x7f6ac8061fa0 2023-08-17T00:03:37.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 0x7f6ac8062920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 0x7f6ac8062920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59628/0 (socket says 172.21.15.153:59628) 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 -- 172.21.15.153:0/1920116525 learned_addr learned my addr 172.21.15.153:0/1920116525 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac6ffd700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac8068820 0x7f6ac8062430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac77fe700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac8061fa0 0x7f6ac8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 -- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac8061fa0 msgr2=0x7f6ac8156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac8061fa0 0x7f6ac8156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 -- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac8068820 msgr2=0x7f6ac8062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac8068820 0x7f6ac8062430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.933+0000 7f6ac7fff700 1 -- 172.21.15.153:0/1920116525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8009250 con 0x7f6ac80a8df0 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6ac7fff700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 0x7f6ac8062920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f6ac000c7c0 tx=0x7f6ac000cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0002020 con 0x7f6ac80a8df0 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac0002180 con 0x7f6ac80a8df0 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc009370 con 0x7f6ac80a8df0 2023-08-17T00:03:37.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0001590 con 0x7f6ac80a8df0 2023-08-17T00:03:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac80bb450 con 0x7f6ac80a8df0 2023-08-17T00:03:37.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.937+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac806b4c0 con 0x7f6ac80a8df0 2023-08-17T00:03:37.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.941+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6ac0010070 con 0x7f6ac80a8df0 2023-08-17T00:03:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.941+0000 7f6aaf7fe700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ab405a180 0x7f6ab405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.941+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6ac00731d0 con 0x7f6ac80a8df0 2023-08-17T00:03:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.941+0000 7f6ac77fe700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ab405a180 0x7f6ab405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:37.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.941+0000 7f6ac77fe700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ab405a180 0x7f6ab405c640 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6ab8006fd0 tx=0x7f6ab8006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:37.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:37.945+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ac0046fd0 con 0x7f6ac80a8df0 2023-08-17T00:03:38.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.109+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ac8064010 con 0x7f6ac80a8df0 2023-08-17T00:03:38.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.109+0000 7f6aaf7fe700 1 -- 172.21.15.153:0/1920116525 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+13760 (secure 0 0 0) 0x7f6ac004a5f0 con 0x7f6ac80a8df0 2023-08-17T00:03:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:38.117 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":30,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:03:34.720604+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:38.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ab405a180 msgr2=0x7f6ab405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ab405a180 0x7f6ab405c640 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f6ab8006fd0 tx=0x7f6ab8006f40).stop 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 msgr2=0x7f6ac8062920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 0x7f6ac8062920 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f6ac000c7c0 tx=0x7f6ac000cad0).stop 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 shutdown_connections 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ab405a180 0x7f6ab405c640 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac80a8df0 0x7f6ac8062920 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac8068820 0x7f6ac8062430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 --2- 172.21.15.153:0/1920116525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac8061fa0 0x7f6ac8156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 >> 172.21.15.153:0/1920116525 conn(0x7f6ac80c6620 msgr2=0x7f6ac80bff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:38.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 shutdown_connections 2023-08-17T00:03:38.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.113+0000 7f6acccb9700 1 -- 172.21.15.153:0/1920116525 wait complete. 2023-08-17T00:03:38.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:03:38.139 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:03:38.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.297+0000 7fc87ac5b700 1 Processor -- start 2023-08-17T00:03:38.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.297+0000 7fc87ac5b700 1 -- start start 2023-08-17T00:03:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc87ac5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8740a8b70 0x7fc8740632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc87ac5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8740629b0 0x7fc8740bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc87ac5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc874065240 con 0x7fc8740a8f50 2023-08-17T00:03:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc87ac5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc874062e40 con 0x7fc8740a8b70 2023-08-17T00:03:38.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc87ac5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8740638a0 con 0x7fc8740629b0 2023-08-17T00:03:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8740a8b70 0x7fc8740632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8740a8b70 0x7fc8740632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59636/0 (socket says 172.21.15.153:59636) 2023-08-17T00:03:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 -- 172.21.15.153:0/3690248187 learned_addr learned my addr 172.21.15.153:0/3690248187 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8791f8700 1 --2- 172.21.15.153:0/3690248187 >> v2:172.21.15.178:3300/0 conn(0x7fc8740629b0 0x7fc8740bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 -- 172.21.15.153:0/3690248187 >> v2:172.21.15.178:3300/0 conn(0x7fc8740629b0 msgr2=0x7fc8740bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 --2- 172.21.15.153:0/3690248187 >> v2:172.21.15.178:3300/0 conn(0x7fc8740629b0 0x7fc8740bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 -- 172.21.15.153:0/3690248187 >> v1:172.21.15.178:6789/0 conn(0x7fc8740a8f50 legacy=0x7fc8740656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 -- 172.21.15.153:0/3690248187 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc874065de0 con 0x7fc8740a8b70 2023-08-17T00:03:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8789f7700 1 --2- 172.21.15.153:0/3690248187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8b70 0x7fc8740632e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fc874069b10 tx=0x7fc8680090f0).ready entity=mon.0 client_cookie=df6aacf82b5c9efe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8737fe700 1 -- 172.21.15.153:0/3690248187 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800b520 con 0x7fc8740a8b70 2023-08-17T00:03:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8737fe700 1 -- 172.21.15.153:0/3690248187 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86800b680 con 0x7fc8740a8b70 2023-08-17T00:03:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.301+0000 7fc8737fe700 1 -- 172.21.15.153:0/3690248187 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86800ba00 con 0x7fc8740a8b70 2023-08-17T00:03:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 -- 172.21.15.153:0/3690248187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8b70 msgr2=0x7fc8740632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/3690248187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8b70 0x7fc8740632e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fc874069b10 tx=0x7fc8680090f0).stop 2023-08-17T00:03:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 -- 172.21.15.153:0/3690248187 shutdown_connections 2023-08-17T00:03:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/3690248187 >> v2:172.21.15.178:3300/0 conn(0x7fc8740629b0 0x7fc8740bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/3690248187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8b70 0x7fc8740632e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 -- 172.21.15.153:0/3690248187 >> 172.21.15.153:0/3690248187 conn(0x7fc8740c7150 msgr2=0x7fc8740c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 -- 172.21.15.153:0/3690248187 shutdown_connections 2023-08-17T00:03:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.305+0000 7fc87ac5b700 1 -- 172.21.15.153:0/3690248187 wait complete. 2023-08-17T00:03:38.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 Processor -- start 2023-08-17T00:03:38.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 -- start start 2023-08-17T00:03:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8740629b0 0x7fc87414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8740a8b70 0x7fc8740bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 0x7fc8740a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87414c7b0 con 0x7fc8740a8f50 2023-08-17T00:03:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740bd720 con 0x7fc8740629b0 2023-08-17T00:03:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc87ac5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740be580 con 0x7fc8740a8b70 2023-08-17T00:03:38.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc8791f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 0x7fc8740a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc8791f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 0x7fc8740a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59652/0 (socket says 172.21.15.153:59652) 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc8791f8700 1 -- 172.21.15.153:0/13129039 learned_addr learned my addr 172.21.15.153:0/13129039 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc8789f7700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8740629b0 0x7fc87414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.309+0000 7fc873fff700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8740a8b70 0x7fc8740bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8791f8700 1 -- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8740a8b70 msgr2=0x7fc8740bea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8791f8700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8740a8b70 0x7fc8740bea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8791f8700 1 -- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8740629b0 msgr2=0x7fc87414c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8791f8700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8740629b0 0x7fc87414c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8791f8700 1 -- 172.21.15.153:0/13129039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009370 con 0x7fc8740a8f50 2023-08-17T00:03:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8789f7700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8740629b0 0x7fc87414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc8791f8700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 0x7fc8740a9fb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fc86c009ec0 tx=0x7fc86c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00cb70 con 0x7fc8740a8f50 2023-08-17T00:03:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00f040 con 0x7fc8740a8f50 2023-08-17T00:03:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8740c02c0 con 0x7fc8740a8f50 2023-08-17T00:03:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00cee0 con 0x7fc8740a8f50 2023-08-17T00:03:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8740bdc50 con 0x7fc8740a8f50 2023-08-17T00:03:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.313+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc87406b530 con 0x7fc8740a8f50 2023-08-17T00:03:38.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.317+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc86c013610 con 0x7fc8740a8f50 2023-08-17T00:03:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.317+0000 7fc870ff9700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc85805a150 0x7fc85805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.317+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc86c0747c0 con 0x7fc8740a8f50 2023-08-17T00:03:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.317+0000 7fc8789f7700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc85805a150 0x7fc85805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.321+0000 7fc8789f7700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc85805a150 0x7fc85805c610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fc868009130 tx=0x7fc868017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:38.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.325+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc86c0484b0 con 0x7fc8740a8f50 2023-08-17T00:03:38.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.545+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc8740be6c0 con 0x7fc8740a8f50 2023-08-17T00:03:38.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.545+0000 7fc870ff9700 1 -- 172.21.15.153:0/13129039 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v30) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc86c04bad0 con 0x7fc8740a8f50 2023-08-17T00:03:38.552 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:03:38.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc85805a150 msgr2=0x7fc85805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc85805a150 0x7fc85805c610 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fc868009130 tx=0x7fc868017000).stop 2023-08-17T00:03:38.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 msgr2=0x7fc8740a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 0x7fc8740a9fb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fc86c009ec0 tx=0x7fc86c00b040).stop 2023-08-17T00:03:38.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 shutdown_connections 2023-08-17T00:03:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc85805a150 0x7fc85805c610 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8740a8f50 0x7fc8740a9fb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8740a8b70 0x7fc8740bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 --2- 172.21.15.153:0/13129039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8740629b0 0x7fc87414c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 >> 172.21.15.153:0/13129039 conn(0x7fc8740c7150 msgr2=0x7fc8740c4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:38.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 shutdown_connections 2023-08-17T00:03:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.549+0000 7fc87ac5b700 1 -- 172.21.15.153:0/13129039 wait complete. 2023-08-17T00:03:38.578 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:03:38.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 Processor -- start 2023-08-17T00:03:38.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 -- start start 2023-08-17T00:03:38.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f76ec153e90 0x7f76ec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76ec0c7980 0x7f76ec0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0aa750 con 0x7f76ec153ab0 2023-08-17T00:03:38.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0c9dd0 con 0x7f76ec0c7980 2023-08-17T00:03:38.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f3ddb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0aacf0 con 0x7f76ec153e90 2023-08-17T00:03:38.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f1b77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f76ec153ab0 0x7f76ec0c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43784/0 (socket says 172.21.15.153:43784) 2023-08-17T00:03:38.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f1b77700 1 -- 172.21.15.153:0/1795679456 learned_addr learned my addr 172.21.15.153:0/1795679456 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:38.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.737+0000 7f76f2378700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f76ec0c7980 0x7f76ec0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f1376700 1 --2- 172.21.15.153:0/1795679456 >> v2:172.21.15.178:3300/0 conn(0x7f76ec153e90 0x7f76ec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f0b75700 1 -- 172.21.15.153:0/1795679456 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768173592 0 0) 0x7f76ec0aa750 con 0x7f76ec153ab0 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f0b75700 1 -- 172.21.15.153:0/1795679456 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d80033f0 con 0x7f76ec153ab0 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f2378700 1 -- 172.21.15.153:0/1795679456 >> v2:172.21.15.178:3300/0 conn(0x7f76ec153e90 msgr2=0x7f76ec0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f2378700 1 --2- 172.21.15.153:0/1795679456 >> v2:172.21.15.178:3300/0 conn(0x7f76ec153e90 0x7f76ec0c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f2378700 1 -- 172.21.15.153:0/1795679456 >> v1:172.21.15.153:6789/0 conn(0x7f76ec153ab0 legacy=0x7f76ec0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f2378700 1 -- 172.21.15.153:0/1795679456 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec1542f0 con 0x7f76ec0c7980 2023-08-17T00:03:38.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f2378700 1 --2- 172.21.15.153:0/1795679456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec0c7980 0x7f76ec0ab180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f76ec083da0 tx=0x7f76e4009780).ready entity=mon.0 client_cookie=810baf0047efe5e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:38.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f0b75700 1 -- 172.21.15.153:0/1795679456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400e070 con 0x7f76ec0c7980 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f0b75700 1 -- 172.21.15.153:0/1795679456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e400bab0 con 0x7f76ec0c7980 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f0b75700 1 -- 172.21.15.153:0/1795679456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e400be30 con 0x7f76ec0c7980 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1795679456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec0c7980 msgr2=0x7f76ec0ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1795679456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec0c7980 0x7f76ec0ab180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f76ec083da0 tx=0x7f76e4009780).stop 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1795679456 shutdown_connections 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1795679456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec0c7980 0x7f76ec0ab180 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1795679456 >> v2:172.21.15.178:3300/0 conn(0x7f76ec153e90 0x7f76ec0c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1795679456 >> 172.21.15.153:0/1795679456 conn(0x7f76ec061fa0 msgr2=0x7f76ec0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1795679456 shutdown_connections 2023-08-17T00:03:38.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.741+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1795679456 wait complete. 2023-08-17T00:03:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.745+0000 7f76f3ddb700 1 Processor -- start 2023-08-17T00:03:38.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.745+0000 7f76f3ddb700 1 -- start start 2023-08-17T00:03:38.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0c7980 0x7f76ec1427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 0x7f76ec0c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec153e90 0x7f76ec0c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0c4820 con 0x7f76ec153ab0 2023-08-17T00:03:38.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec142cc0 con 0x7f76ec153e90 2023-08-17T00:03:38.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0ae750 con 0x7f76ec0c7980 2023-08-17T00:03:38.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 0x7f76ec0c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 0x7f76ec0c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59658/0 (socket says 172.21.15.153:59658) 2023-08-17T00:03:38.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 -- 172.21.15.153:0/1236525730 learned_addr learned my addr 172.21.15.153:0/1236525730 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:38.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1b77700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0c7980 0x7f76ec1427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f2378700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec153e90 0x7f76ec0c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 -- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0c7980 msgr2=0x7f76ec1427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0c7980 0x7f76ec1427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 -- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec153e90 msgr2=0x7f76ec0c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec153e90 0x7f76ec0c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 -- 172.21.15.153:0/1236525730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e4009a20 con 0x7f76ec153ab0 2023-08-17T00:03:38.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f1376700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 0x7f76ec0c3e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f76dc00e960 tx=0x7f76dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00c850 con 0x7f76ec153ab0 2023-08-17T00:03:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc00c9b0 con 0x7f76ec153ab0 2023-08-17T00:03:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76dc00cd30 con 0x7f76ec153ab0 2023-08-17T00:03:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec0adb40 con 0x7f76ec153ab0 2023-08-17T00:03:38.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec0ae100 con 0x7f76ec153ab0 2023-08-17T00:03:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.749+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec06b530 con 0x7f76ec153ab0 2023-08-17T00:03:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.753+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f76dc022070 con 0x7f76ec153ab0 2023-08-17T00:03:38.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.753+0000 7f76e1ffb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76d005a150 0x7f76d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:38.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.753+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f76dc0742c0 con 0x7f76ec153ab0 2023-08-17T00:03:38.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.753+0000 7f76f1b77700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76d005a150 0x7f76d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:38.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.753+0000 7f76f1b77700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76d005a150 0x7f76d005c610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f76ec159720 tx=0x7f76e8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:38.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.757+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f76dc047fb0 con 0x7f76ec153ab0 2023-08-17T00:03:38.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.921+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f76ec0ae890 con 0x7f76ec153ab0 2023-08-17T00:03:38.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.921+0000 7f76e1ffb700 1 -- 172.21.15.153:0/1236525730 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f76dc04b5d0 con 0x7f76ec153ab0 2023-08-17T00:03:38.928 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:03:38.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76d005a150 msgr2=0x7f76d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76d005a150 0x7f76d005c610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f76ec159720 tx=0x7f76e8009040).stop 2023-08-17T00:03:38.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 msgr2=0x7f76ec0c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:38.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 0x7f76ec0c3e40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f76dc00e960 tx=0x7f76dc009060).stop 2023-08-17T00:03:38.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 shutdown_connections 2023-08-17T00:03:38.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f76d005a150 0x7f76d005c610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f76ec153e90 0x7f76ec0c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f76ec153ab0 0x7f76ec0c3e40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 --2- 172.21.15.153:0/1236525730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f76ec0c7980 0x7f76ec1427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:38.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 >> 172.21.15.153:0/1236525730 conn(0x7f76ec061fa0 msgr2=0x7f76ec0bf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:38.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.925+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 shutdown_connections 2023-08-17T00:03:38.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:38.929+0000 7f76f3ddb700 1 -- 172.21.15.153:0/1236525730 wait complete. 2023-08-17T00:03:38.953 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:03:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.105+0000 7fb12759e700 1 Processor -- start 2023-08-17T00:03:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.105+0000 7fb12759e700 1 -- start start 2023-08-17T00:03:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb1280c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1280aa6e0 0x7fb128068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1281585a0 con 0x7fb128068820 2023-08-17T00:03:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb128066400 con 0x7fb1280aa6e0 2023-08-17T00:03:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb128069170 con 0x7fb1280a8df0 2023-08-17T00:03:39.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb126d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb1280aa6e0 0x7fb128068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb125d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb128068820 0x7fb128061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43790/0 (socket says 172.21.15.153:43790) 2023-08-17T00:03:39.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb125d9b700 1 -- 172.21.15.153:0/1021140520 learned_addr learned my addr 172.21.15.153:0/1021140520 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12659c700 1 --2- 172.21.15.153:0/1021140520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb1280c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb126d9d700 1 -- 172.21.15.153:0/1021140520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 msgr2=0x7fb1280c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb126d9d700 1 --2- 172.21.15.153:0/1021140520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb1280c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb126d9d700 1 -- 172.21.15.153:0/1021140520 >> v1:172.21.15.153:6789/0 conn(0x7fb128068820 legacy=0x7fb128061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12559a700 1 -- 172.21.15.153:0/1021140520 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284245494 0 0) 0x7fb1281585a0 con 0x7fb128068820 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb126d9d700 1 -- 172.21.15.153:0/1021140520 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280b9d30 con 0x7fb1280aa6e0 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb126d9d700 1 --2- 172.21.15.153:0/1021140520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1280aa6e0 0x7fb128068c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fb120009e60 tx=0x7fb120009780).ready entity=mon.0 client_cookie=955350fd4c89867e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12559a700 1 -- 172.21.15.153:0/1021140520 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12000e070 con 0x7fb1280aa6e0 2023-08-17T00:03:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12559a700 1 -- 172.21.15.153:0/1021140520 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12000bb60 con 0x7fb1280aa6e0 2023-08-17T00:03:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12559a700 1 -- 172.21.15.153:0/1021140520 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120012410 con 0x7fb1280aa6e0 2023-08-17T00:03:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 -- 172.21.15.153:0/1021140520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1280aa6e0 msgr2=0x7fb128068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.109+0000 7fb12759e700 1 --2- 172.21.15.153:0/1021140520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1280aa6e0 0x7fb128068c80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fb120009e60 tx=0x7fb120009780).stop 2023-08-17T00:03:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 -- 172.21.15.153:0/1021140520 shutdown_connections 2023-08-17T00:03:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 --2- 172.21.15.153:0/1021140520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb1280aa6e0 0x7fb128068c80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 --2- 172.21.15.153:0/1021140520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb1280c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 -- 172.21.15.153:0/1021140520 >> 172.21.15.153:0/1021140520 conn(0x7fb1280c6620 msgr2=0x7fb1280c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 -- 172.21.15.153:0/1021140520 shutdown_connections 2023-08-17T00:03:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 -- 172.21.15.153:0/1021140520 wait complete. 2023-08-17T00:03:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 Processor -- start 2023-08-17T00:03:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.113+0000 7fb12759e700 1 -- start start 2023-08-17T00:03:39.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 0x7fb128156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb128168120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1280aa6e0 0x7fb128158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280bef90 con 0x7fb128068820 2023-08-17T00:03:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128159a70 con 0x7fb1280aa6e0 2023-08-17T00:03:39.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280be6a0 con 0x7fb1280a8df0 2023-08-17T00:03:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 0x7fb128156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 0x7fb128156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59670/0 (socket says 172.21.15.153:59670) 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 -- 172.21.15.153:0/2688057307 learned_addr learned my addr 172.21.15.153:0/2688057307 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb125d9b700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb128168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 -- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 msgr2=0x7fb128168120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb126d9d700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1280aa6e0 0x7fb128158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb128168120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 -- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1280aa6e0 msgr2=0x7fb128158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1280aa6e0 0x7fb128158f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 -- 172.21.15.153:0/2688057307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009a20 con 0x7fb128068820 2023-08-17T00:03:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12659c700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 0x7fb128156c90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb11800e900 tx=0x7fb118006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800c640 con 0x7fb128068820 2023-08-17T00:03:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11800c7a0 con 0x7fb128068820 2023-08-17T00:03:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11800cb20 con 0x7fb128068820 2023-08-17T00:03:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1280be940 con 0x7fb128068820 2023-08-17T00:03:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.117+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128157180 con 0x7fb128068820 2023-08-17T00:03:39.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.121+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12806b4c0 con 0x7fb128068820 2023-08-17T00:03:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.121+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb118022070 con 0x7fb128068820 2023-08-17T00:03:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.121+0000 7fb1167fc700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb10805a150 0x7fb10805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.121+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb118074150 con 0x7fb128068820 2023-08-17T00:03:39.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.121+0000 7fb125d9b700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb10805a150 0x7fb10805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.125+0000 7fb125d9b700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb10805a150 0x7fb10805c610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb1280abde0 tx=0x7fb11c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.125+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb118047e40 con 0x7fb128068820 2023-08-17T00:03:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.289+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb128064010 con 0x7fb128068820 2023-08-17T00:03:39.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.289+0000 7fb1167fc700 1 -- 172.21.15.153:0/2688057307 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb118016020 con 0x7fb128068820 2023-08-17T00:03:39.296 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:39.296 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:03:39.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:39.296 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:03:39.297 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:03:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb10805a150 msgr2=0x7fb10805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb10805a150 0x7fb10805c610 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fb1280abde0 tx=0x7fb11c009040).stop 2023-08-17T00:03:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 msgr2=0x7fb128156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 0x7fb128156c90 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fb11800e900 tx=0x7fb118006f40).stop 2023-08-17T00:03:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 shutdown_connections 2023-08-17T00:03:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb10805a150 0x7fb10805c610 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1280aa6e0 0x7fb128158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1280a8df0 0x7fb128168120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 --2- 172.21.15.153:0/2688057307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb128068820 0x7fb128156c90 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 >> 172.21.15.153:0/2688057307 conn(0x7fb1280c6620 msgr2=0x7fb128157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 shutdown_connections 2023-08-17T00:03:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.293+0000 7fb12759e700 1 -- 172.21.15.153:0/2688057307 wait complete. 2023-08-17T00:03:39.320 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:03:39.321 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:03:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.485+0000 7f6d02db9700 1 Processor -- start 2023-08-17T00:03:39.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.485+0000 7f6d02db9700 1 -- start start 2023-08-17T00:03:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d02db9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6cfc1539b0 0x7f6cfc0632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d02db9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6cfc0a9eb0 0x7f6cfc0c0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d02db9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc0c00d0 con 0x7f6cfc153d90 2023-08-17T00:03:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d02db9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0bf810 con 0x7f6cfc0a9eb0 2023-08-17T00:03:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d02db9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0aa910 con 0x7f6cfc1539b0 2023-08-17T00:03:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d015b6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6cfc153d90 0x7f6cfc0a97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43796/0 (socket says 172.21.15.153:43796) 2023-08-17T00:03:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d015b6700 1 -- 172.21.15.153:0/4277513371 learned_addr learned my addr 172.21.15.153:0/4277513371 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d01db7700 1 --2- 172.21.15.153:0/4277513371 >> v2:172.21.15.178:3300/0 conn(0x7f6cfc1539b0 0x7f6cfc0632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d025b8700 1 --2- 172.21.15.153:0/4277513371 >> v2:172.21.15.153:3300/0 conn(0x7f6cfc0a9eb0 0x7f6cfc0c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d01db7700 1 -- 172.21.15.153:0/4277513371 >> v2:172.21.15.153:3300/0 conn(0x7f6cfc0a9eb0 msgr2=0x7f6cfc0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d01db7700 1 --2- 172.21.15.153:0/4277513371 >> v2:172.21.15.153:3300/0 conn(0x7f6cfc0a9eb0 0x7f6cfc0c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d01db7700 1 -- 172.21.15.153:0/4277513371 >> v1:172.21.15.153:6789/0 conn(0x7f6cfc153d90 legacy=0x7f6cfc0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d01db7700 1 -- 172.21.15.153:0/4277513371 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc0bfa80 con 0x7f6cfc1539b0 2023-08-17T00:03:39.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.489+0000 7f6d01db7700 1 --2- 172.21.15.153:0/4277513371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc0632b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6cfc083e40 tx=0x7f6cf8006f40).ready entity=mon.1 client_cookie=43be7a510da81a80 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d00db5700 1 -- 172.21.15.153:0/4277513371 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8005880 con 0x7f6cfc1539b0 2023-08-17T00:03:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d00db5700 1 -- 172.21.15.153:0/4277513371 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf80059e0 con 0x7f6cfc1539b0 2023-08-17T00:03:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d00db5700 1 -- 172.21.15.153:0/4277513371 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8005d60 con 0x7f6cfc1539b0 2023-08-17T00:03:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 -- 172.21.15.153:0/4277513371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 msgr2=0x7f6cfc0632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 --2- 172.21.15.153:0/4277513371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc0632b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f6cfc083e40 tx=0x7f6cf8006f40).stop 2023-08-17T00:03:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 -- 172.21.15.153:0/4277513371 shutdown_connections 2023-08-17T00:03:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 --2- 172.21.15.153:0/4277513371 >> v2:172.21.15.153:3300/0 conn(0x7f6cfc0a9eb0 0x7f6cfc0c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 --2- 172.21.15.153:0/4277513371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc0632b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 -- 172.21.15.153:0/4277513371 >> 172.21.15.153:0/4277513371 conn(0x7f6cfc062a10 msgr2=0x7f6cfc0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 -- 172.21.15.153:0/4277513371 shutdown_connections 2023-08-17T00:03:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.493+0000 7f6d02db9700 1 -- 172.21.15.153:0/4277513371 wait complete. 2023-08-17T00:03:39.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.497+0000 7f6d02db9700 1 Processor -- start 2023-08-17T00:03:39.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.497+0000 7f6d02db9700 1 -- start start 2023-08-17T00:03:39.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d02db9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 0x7f6cfc167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d02db9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc164b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d02db9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cfc153d90 0x7f6cfc165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d02db9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc167f40 con 0x7f6cfc153d90 2023-08-17T00:03:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d02db9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc165730 con 0x7f6cfc1539b0 2023-08-17T00:03:39.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d02db9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc168150 con 0x7f6cfc0a9eb0 2023-08-17T00:03:39.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d01db7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 0x7f6cfc167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d01db7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 0x7f6cfc167a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:48674/0 (socket says 172.21.15.153:48674) 2023-08-17T00:03:39.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d01db7700 1 -- 172.21.15.153:0/1714406098 learned_addr learned my addr 172.21.15.153:0/1714406098 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d025b8700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cfc153d90 0x7f6cfc165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 -- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 msgr2=0x7f6cfc167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 0x7f6cfc167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 -- 172.21.15.153:0/1714406098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cfc153d90 msgr2=0x7f6cfc165040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cfc153d90 0x7f6cfc165040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 -- 172.21.15.153:0/1714406098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8009250 con 0x7f6cfc1539b0 2023-08-17T00:03:39.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d01db7700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 0x7f6cfc167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.501+0000 7f6d015b6700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc164b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6cec00c440 tx=0x7f6cec007d50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0070d0 con 0x7f6cfc1539b0 2023-08-17T00:03:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec007230 con 0x7f6cfc1539b0 2023-08-17T00:03:39.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec0075d0 con 0x7f6cfc1539b0 2023-08-17T00:03:39.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc168430 con 0x7f6cfc1539b0 2023-08-17T00:03:39.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc0c4430 con 0x7f6cfc1539b0 2023-08-17T00:03:39.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc165590 con 0x7f6cfc1539b0 2023-08-17T00:03:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.505+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6cec010070 con 0x7f6cfc1539b0 2023-08-17T00:03:39.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.509+0000 7f6cf1ffb700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ce005a150 0x7f6ce005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:39.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.509+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6cec073100 con 0x7f6cfc1539b0 2023-08-17T00:03:39.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.509+0000 7f6d01db7700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ce005a150 0x7f6ce005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:39.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.509+0000 7f6d01db7700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ce005a150 0x7f6ce005c610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6cf8005fd0 tx=0x7f6cf8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.517+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6cfc165590 con 0x7f6cfc1539b0 2023-08-17T00:03:39.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:39.677+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f6cfc165590 con 0x7f6cfc1539b0 2023-08-17T00:03:40.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.521+0000 7f6cf1ffb700 1 -- 172.21.15.153:0/1714406098 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 152+0+0 (secure 0 0 0) 0x7f6cfc165590 con 0x7f6cfc1539b0 2023-08-17T00:03:40.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ce005a150 msgr2=0x7f6ce005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:40.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ce005a150 0x7f6ce005c610 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f6cf8005fd0 tx=0x7f6cf8016000).stop 2023-08-17T00:03:40.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 msgr2=0x7f6cfc164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:40.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc164b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f6cec00c440 tx=0x7f6cec007d50).stop 2023-08-17T00:03:40.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 shutdown_connections 2023-08-17T00:03:40.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ce005a150 0x7f6ce005c610 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6cfc153d90 0x7f6cfc165040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cfc1539b0 0x7f6cfc164b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 --2- 172.21.15.153:0/1714406098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cfc0a9eb0 0x7f6cfc167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.529+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 >> 172.21.15.153:0/1714406098 conn(0x7f6cfc062a10 msgr2=0x7f6cfc0c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:40.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.533+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 shutdown_connections 2023-08-17T00:03:40.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.533+0000 7f6d02db9700 1 -- 172.21.15.153:0/1714406098 wait complete. 2023-08-17T00:03:40.542 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:03:40.555 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:03:40.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.717+0000 7ff0f8f69700 1 Processor -- start 2023-08-17T00:03:40.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.717+0000 7ff0f8f69700 1 -- start start 2023-08-17T00:03:40.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f8f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:40.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f8f69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0f40c8d50 0x7ff0f40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:40.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f8f69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40aa750 con 0x7ff0f40c7490 2023-08-17T00:03:40.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f8f69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40c9dd0 con 0x7ff0f40c8d50 2023-08-17T00:03:40.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f8f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40aacf0 con 0x7ff0f4153ab0 2023-08-17T00:03:40.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:40.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:48686/0 (socket says 172.21.15.153:48686) 2023-08-17T00:03:40.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 -- 172.21.15.153:0/2140063755 learned_addr learned my addr 172.21.15.153:0/2140063755 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:40.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f1d9b700 1 --2- 172.21.15.153:0/2140063755 >> v2:172.21.15.178:3300/0 conn(0x7ff0f40c8d50 0x7ff0f40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:40.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f159a700 1 -- 172.21.15.153:0/2140063755 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503935920 0 0) 0x7ff0f40aa750 con 0x7ff0f40c7490 2023-08-17T00:03:40.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f159a700 1 -- 172.21.15.153:0/2140063755 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0dc0033f0 con 0x7ff0f40c7490 2023-08-17T00:03:40.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 -- 172.21.15.153:0/2140063755 >> v2:172.21.15.178:3300/0 conn(0x7ff0f40c8d50 msgr2=0x7ff0f40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 --2- 172.21.15.153:0/2140063755 >> v2:172.21.15.178:3300/0 conn(0x7ff0f40c8d50 0x7ff0f40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 -- 172.21.15.153:0/2140063755 >> v1:172.21.15.178:6789/0 conn(0x7ff0f40c7490 legacy=0x7ff0f4063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 -- 172.21.15.153:0/2140063755 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40c5ca0 con 0x7ff0f4153ab0 2023-08-17T00:03:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f259c700 1 --2- 172.21.15.153:0/2140063755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4153e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff0e4006fd0 tx=0x7ff0e40090f0).ready entity=mon.2 client_cookie=300c788cc54bb458 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f159a700 1 -- 172.21.15.153:0/2140063755 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400f510 con 0x7ff0f4153ab0 2023-08-17T00:03:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f159a700 1 -- 172.21.15.153:0/2140063755 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400f670 con 0x7ff0f4153ab0 2023-08-17T00:03:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.721+0000 7ff0f159a700 1 -- 172.21.15.153:0/2140063755 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400fa10 con 0x7ff0f4153ab0 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 -- 172.21.15.153:0/2140063755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 msgr2=0x7ff0f4153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/2140063755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4153e90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff0e4006fd0 tx=0x7ff0e40090f0).stop 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 -- 172.21.15.153:0/2140063755 shutdown_connections 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/2140063755 >> v2:172.21.15.178:3300/0 conn(0x7ff0f40c8d50 0x7ff0f40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/2140063755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4153e90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 -- 172.21.15.153:0/2140063755 >> 172.21.15.153:0/2140063755 conn(0x7ff0f4061fa0 msgr2=0x7ff0f40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 -- 172.21.15.153:0/2140063755 shutdown_connections 2023-08-17T00:03:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.725+0000 7ff0f8f69700 1 -- 172.21.15.153:0/2140063755 wait complete. 2023-08-17T00:03:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 Processor -- start 2023-08-17T00:03:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 -- start start 2023-08-17T00:03:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0f40c7490 0x7ff0f414fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 0x7ff0f4163e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4155100 con 0x7ff0f40c8d50 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c3430 con 0x7ff0f40c7490 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f8f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40c2e50 con 0x7ff0f4153ab0 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 0x7ff0f4163e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f259c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0f40c7490 0x7ff0f414fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 0x7ff0f4163e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59690/0 (socket says 172.21.15.153:59690) 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f1d9b700 1 -- 172.21.15.153:0/3920124874 learned_addr learned my addr 172.21.15.153:0/3920124874 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.729+0000 7ff0f2d9d700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f259c700 1 -- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 msgr2=0x7ff0f4164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f259c700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4164300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f259c700 1 -- 172.21.15.153:0/3920124874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 msgr2=0x7ff0f4163e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f259c700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 0x7ff0f4163e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f259c700 1 -- 172.21.15.153:0/3920124874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e4009370 con 0x7ff0f40c7490 2023-08-17T00:03:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f1d9b700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 0x7ff0f4163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f259c700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0f40c7490 0x7ff0f414fbf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff0f405ea40 tx=0x7ff0e4017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4006d90 con 0x7ff0f40c7490 2023-08-17T00:03:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e4006990 con 0x7ff0f40c7490 2023-08-17T00:03:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4000bc0 con 0x7ff0f40c7490 2023-08-17T00:03:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f41500e0 con 0x7ff0f40c7490 2023-08-17T00:03:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f40c30c0 con 0x7ff0f40c7490 2023-08-17T00:03:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f406b530 con 0x7ff0f40c7490 2023-08-17T00:03:40.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.733+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff0e402c070 con 0x7ff0f40c7490 2023-08-17T00:03:40.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.737+0000 7ff0e27fc700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff0d405a150 0x7ff0d405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:40.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.737+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5639+0+0 (secure 0 0 0) 0x7ff0e40755c0 con 0x7ff0f40c7490 2023-08-17T00:03:40.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.737+0000 7ff0f1d9b700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff0d405a150 0x7ff0d405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.737+0000 7ff0f1d9b700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff0d405a150 0x7ff0d405c610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff0f41547c0 tx=0x7ff0e8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.745+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0e4049140 con 0x7ff0f40c7490 2023-08-17T00:03:40.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:40.913+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff0f40c9810 con 0x7ff0f40c7490 2023-08-17T00:03:41.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:03:41.287 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:03:41.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.541+0000 7ff0e27fc700 1 -- 172.21.15.153:0/3920124874 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff0e402a070 con 0x7ff0f40c7490 2023-08-17T00:03:41.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff0d405a150 msgr2=0x7ff0d405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff0d405a150 0x7ff0d405c610 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7ff0f41547c0 tx=0x7ff0e8009060).stop 2023-08-17T00:03:41.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0f40c7490 msgr2=0x7ff0f414fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0f40c7490 0x7ff0f414fbf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7ff0f405ea40 tx=0x7ff0e4017000).stop 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 shutdown_connections 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff0d405a150 0x7ff0d405c610 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0f4153ab0 0x7ff0f4164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0f40c8d50 0x7ff0f4163e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 --2- 172.21.15.153:0/3920124874 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff0f40c7490 0x7ff0f414fbf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 >> 172.21.15.153:0/3920124874 conn(0x7ff0f4061fa0 msgr2=0x7ff0f41514f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:41.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 shutdown_connections 2023-08-17T00:03:41.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.549+0000 7ff0f8f69700 1 -- 172.21.15.153:0/3920124874 wait complete. 2023-08-17T00:03:41.566 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:03:41.582 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:03:41.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 Processor -- start 2023-08-17T00:03:41.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 -- start start 2023-08-17T00:03:41.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f7c154130 0x7f8f7c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:41.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c0656d0 0x7f8f7c0bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:41.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c065240 con 0x7f8f7c153d50 2023-08-17T00:03:41.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c063880 con 0x7f8f7c154130 2023-08-17T00:03:41.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.733+0000 7f8f81d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c064910 con 0x7f8f7c0656d0 2023-08-17T00:03:41.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f7c154130 0x7f8f7c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8f7c154130 0x7f8f7c0632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59700/0 (socket says 172.21.15.153:59700) 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 -- 172.21.15.153:0/312917571 learned_addr learned my addr 172.21.15.153:0/312917571 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7bfff700 1 --2- 172.21.15.153:0/312917571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c0656d0 0x7f8f7c0bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 -- 172.21.15.153:0/312917571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c0656d0 msgr2=0x7f8f7c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 --2- 172.21.15.153:0/312917571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c0656d0 0x7f8f7c0bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 -- 172.21.15.153:0/312917571 >> v1:172.21.15.153:6789/0 conn(0x7f8f7c153d50 legacy=0x7f8f7c0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 -- 172.21.15.153:0/312917571 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c064bf0 con 0x7f8f7c154130 2023-08-17T00:03:41.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7affd700 1 --2- 172.21.15.153:0/312917571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c154130 0x7f8f7c0632e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f8f70006fd0 tx=0x7f8f700090f0).ready entity=mon.0 client_cookie=cde112adafa19252 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:41.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7a7fc700 1 -- 172.21.15.153:0/312917571 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000b600 con 0x7f8f7c154130 2023-08-17T00:03:41.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7a7fc700 1 -- 172.21.15.153:0/312917571 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7000b760 con 0x7f8f7c154130 2023-08-17T00:03:41.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f7a7fc700 1 -- 172.21.15.153:0/312917571 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7000bb00 con 0x7f8f7c154130 2023-08-17T00:03:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 -- 172.21.15.153:0/312917571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c154130 msgr2=0x7f8f7c0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 --2- 172.21.15.153:0/312917571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c154130 0x7f8f7c0632e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f8f70006fd0 tx=0x7f8f700090f0).stop 2023-08-17T00:03:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 -- 172.21.15.153:0/312917571 shutdown_connections 2023-08-17T00:03:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 --2- 172.21.15.153:0/312917571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c0656d0 0x7f8f7c0bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 --2- 172.21.15.153:0/312917571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c154130 0x7f8f7c0632e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 -- 172.21.15.153:0/312917571 >> 172.21.15.153:0/312917571 conn(0x7f8f7c0c7150 msgr2=0x7f8f7c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:41.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 -- 172.21.15.153:0/312917571 shutdown_connections 2023-08-17T00:03:41.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.737+0000 7f8f81d69700 1 -- 172.21.15.153:0/312917571 wait complete. 2023-08-17T00:03:41.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 Processor -- start 2023-08-17T00:03:41.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 -- start start 2023-08-17T00:03:41.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 0x7f8f7c0a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:41.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c153d50 0x7f8f7c167ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:41.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f7c154130 0x7f8f7c168090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:41.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c168580 con 0x7f8f7c0656d0 2023-08-17T00:03:41.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c150f70 con 0x7f8f7c154130 2023-08-17T00:03:41.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.741+0000 7f8f81d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0a9690 con 0x7f8f7c153d50 2023-08-17T00:03:41.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 0x7f8f7c0a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:41.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 0x7f8f7c0a8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59708/0 (socket says 172.21.15.153:59708) 2023-08-17T00:03:41.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 -- 172.21.15.153:0/644968517 learned_addr learned my addr 172.21.15.153:0/644968517 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:41.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7bfff700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f7c154130 0x7f8f7c168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:41.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7affd700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c153d50 0x7f8f7c167ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 -- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c153d50 msgr2=0x7f8f7c167ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c153d50 0x7f8f7c167ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 -- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f7c154130 msgr2=0x7f8f7c168090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f7c154130 0x7f8f7c168090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 -- 172.21.15.153:0/644968517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70009370 con 0x7f8f7c0656d0 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7bfff700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f7c154130 0x7f8f7c168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:41.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f7b7fe700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 0x7f8f7c0a8100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8f6c00c440 tx=0x7f8f6c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:41.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c007020 con 0x7f8f7c0656d0 2023-08-17T00:03:41.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c007180 con 0x7f8f7c0656d0 2023-08-17T00:03:41.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c155490 con 0x7f8f7c0656d0 2023-08-17T00:03:41.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c007520 con 0x7f8f7c0656d0 2023-08-17T00:03:41.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c155d30 con 0x7f8f7c0656d0 2023-08-17T00:03:41.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.745+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c06b530 con 0x7f8f7c0656d0 2023-08-17T00:03:41.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.749+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8f6c010070 con 0x7f8f7c0656d0 2023-08-17T00:03:41.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.749+0000 7f8f637fe700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f6805a150 0x7f8f6805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:41.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.749+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f8f6c0732a0 con 0x7f8f7c0656d0 2023-08-17T00:03:41.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.749+0000 7f8f7affd700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f6805a150 0x7f8f6805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:41.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.753+0000 7f8f7affd700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f6805a150 0x7f8f6805c610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8f7c151740 tx=0x7f8f70017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:41.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.757+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8f6c046db0 con 0x7f8f7c0656d0 2023-08-17T00:03:41.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.949+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8f7c064ed0 con 0x7f8f7c0656d0 2023-08-17T00:03:41.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.965+0000 7f8f637fe700 1 -- 172.21.15.153:0/644968517 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8f6c04a3d0 con 0x7f8f7c0656d0 2023-08-17T00:03:41.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f6805a150 msgr2=0x7f8f6805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f6805a150 0x7f8f6805c610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f8f7c151740 tx=0x7f8f70017000).stop 2023-08-17T00:03:41.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 msgr2=0x7f8f7c0a8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:41.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 0x7f8f7c0a8100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f8f6c00c440 tx=0x7f8f6c007e00).stop 2023-08-17T00:03:41.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 shutdown_connections 2023-08-17T00:03:41.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f6805a150 0x7f8f6805c610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.977+0000 7f8f81d69700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f7c154130 0x7f8f7c168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.981+0000 7f8f81d69700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f7c153d50 0x7f8f7c167ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.981+0000 7f8f81d69700 1 --2- 172.21.15.153:0/644968517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f7c0656d0 0x7f8f7c0a8100 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:41.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.981+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 >> 172.21.15.153:0/644968517 conn(0x7f8f7c0c7150 msgr2=0x7f8f7c0c4750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:41.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.981+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 shutdown_connections 2023-08-17T00:03:41.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:41.981+0000 7f8f81d69700 1 -- 172.21.15.153:0/644968517 wait complete. 2023-08-17T00:03:41.993 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 5 and data pool 6 2023-08-17T00:03:42.014 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:42.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.165+0000 7f41d53b9700 1 Processor -- start 2023-08-17T00:03:42.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.165+0000 7f41d53b9700 1 -- start start 2023-08-17T00:03:42.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41d53b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41d00c5ea0 0x7f41d00634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41d53b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d0154e90 con 0x7f41d00639a0 2023-08-17T00:03:42.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41d53b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d0153fc0 con 0x7f41d00acf30 2023-08-17T00:03:42.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41d53b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d00c1730 con 0x7f41d00c5ea0 2023-08-17T00:03:42.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41d4bb8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f41d00639a0 0x7f41d00bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43810/0 (socket says 172.21.15.153:43810) 2023-08-17T00:03:42.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41d4bb8700 1 -- 172.21.15.153:0/1694263717 learned_addr learned my addr 172.21.15.153:0/1694263717 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:42.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41cf7fe700 1 --2- 172.21.15.153:0/1694263717 >> v2:172.21.15.178:3300/0 conn(0x7f41d00c5ea0 0x7f41d00634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41ceffd700 1 -- 172.21.15.153:0/1694263717 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371904706 0 0) 0x7f41d0154e90 con 0x7f41d00639a0 2023-08-17T00:03:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41ceffd700 1 -- 172.21.15.153:0/1694263717 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41bc0033f0 con 0x7f41d00639a0 2023-08-17T00:03:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41cf7fe700 1 -- 172.21.15.153:0/1694263717 >> v1:172.21.15.178:6789/0 conn(0x7f41d00acf30 legacy=0x7f41d00c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41ceffd700 1 -- 172.21.15.153:0/1694263717 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4230900049 0 0) 0x7f41bc0033f0 con 0x7f41d00639a0 2023-08-17T00:03:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41cf7fe700 1 -- 172.21.15.153:0/1694263717 >> v1:172.21.15.153:6789/0 conn(0x7f41d00639a0 legacy=0x7f41d00bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41cf7fe700 1 -- 172.21.15.153:0/1694263717 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d0154280 con 0x7f41d00c5ea0 2023-08-17T00:03:42.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41cf7fe700 1 --2- 172.21.15.153:0/1694263717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00c5ea0 0x7f41d00634b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f41b8009760 tx=0x7f41b8009060).ready entity=mon.1 client_cookie=38d05e460c79cfcf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41ceffd700 1 -- 172.21.15.153:0/1694263717 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c80017f0 con 0x7f41d00c5ea0 2023-08-17T00:03:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41ceffd700 1 -- 172.21.15.153:0/1694263717 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b8011400 con 0x7f41d00c5ea0 2023-08-17T00:03:42.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.169+0000 7f41ceffd700 1 -- 172.21.15.153:0/1694263717 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011780 con 0x7f41d00c5ea0 2023-08-17T00:03:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 -- 172.21.15.153:0/1694263717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00c5ea0 msgr2=0x7f41d00634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 --2- 172.21.15.153:0/1694263717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00c5ea0 0x7f41d00634b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f41b8009760 tx=0x7f41b8009060).stop 2023-08-17T00:03:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 -- 172.21.15.153:0/1694263717 shutdown_connections 2023-08-17T00:03:42.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 --2- 172.21.15.153:0/1694263717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00c5ea0 0x7f41d00634b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 -- 172.21.15.153:0/1694263717 >> 172.21.15.153:0/1694263717 conn(0x7f41d00cb330 msgr2=0x7f41d00c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:42.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 -- 172.21.15.153:0/1694263717 shutdown_connections 2023-08-17T00:03:42.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 -- 172.21.15.153:0/1694263717 wait complete. 2023-08-17T00:03:42.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.173+0000 7f41d53b9700 1 Processor -- start 2023-08-17T00:03:42.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 -- start start 2023-08-17T00:03:42.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 0x7f41d0150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41d00acf30 0x7f41d00ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00aecd0 0x7f41d00c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00c1e40 con 0x7f41d00639a0 2023-08-17T00:03:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00c4510 con 0x7f41d00aecd0 2023-08-17T00:03:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d53b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d00c8e90 con 0x7f41d00acf30 2023-08-17T00:03:42.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 0x7f41d0150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 0x7f41d0150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59710/0 (socket says 172.21.15.153:59710) 2023-08-17T00:03:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41cffff700 1 -- 172.21.15.153:0/3773472073 learned_addr learned my addr 172.21.15.153:0/3773472073 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41d4bb8700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00aecd0 0x7f41d00c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.177+0000 7f41cf7fe700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41d00acf30 0x7f41d00ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41cffff700 1 -- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41d00acf30 msgr2=0x7f41d00ae7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41cffff700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41d00acf30 0x7f41d00ae7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41cffff700 1 -- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00aecd0 msgr2=0x7f41d00c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41cffff700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00aecd0 0x7f41d00c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41cffff700 1 -- 172.21.15.153:0/3773472073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80092a0 con 0x7f41d00639a0 2023-08-17T00:03:42.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41cffff700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 0x7f41d0150690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f41c000c4c0 tx=0x7f41c0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c000ce70 con 0x7f41d00639a0 2023-08-17T00:03:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c0001e90 con 0x7f41d00639a0 2023-08-17T00:03:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d00c9170 con 0x7f41d00639a0 2023-08-17T00:03:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0007250 con 0x7f41d00639a0 2023-08-17T00:03:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d00ca140 con 0x7f41d00639a0 2023-08-17T00:03:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.181+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d00c93b0 con 0x7f41d00639a0 2023-08-17T00:03:42.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.185+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f41c0010070 con 0x7f41d00639a0 2023-08-17T00:03:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.185+0000 7f41c7fff700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b005a150 0x7f41b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.185+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f41c0073920 con 0x7f41d00639a0 2023-08-17T00:03:42.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.185+0000 7f41cf7fe700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b005a150 0x7f41b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.189+0000 7f41cf7fe700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b005a150 0x7f41b005c610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f41d00c3330 tx=0x7f41b8014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.193+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41d00c93b0 con 0x7f41d00639a0 2023-08-17T00:03:42.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.357+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41d00c1910 con 0x7f41d00639a0 2023-08-17T00:03:42.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41c7fff700 1 -- 172.21.15.153:0/3773472073 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f41c00472c0 con 0x7f41d00639a0 2023-08-17T00:03:42.367 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:42.367 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":33,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:03:41.952394+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:03:39.751729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T00:03:40.984291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:42.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b005a150 msgr2=0x7f41b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b005a150 0x7f41b005c610 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f41d00c3330 tx=0x7f41b8014000).stop 2023-08-17T00:03:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 msgr2=0x7f41d0150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 0x7f41d0150690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f41c000c4c0 tx=0x7f41c0007e00).stop 2023-08-17T00:03:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 shutdown_connections 2023-08-17T00:03:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b005a150 0x7f41b005c610 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d00aecd0 0x7f41d00c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41d00acf30 0x7f41d00ae7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 --2- 172.21.15.153:0/3773472073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d00639a0 0x7f41d0150690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.361+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 >> 172.21.15.153:0/3773472073 conn(0x7f41d00cb330 msgr2=0x7f41d01524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:42.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.365+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 shutdown_connections 2023-08-17T00:03:42.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.365+0000 7f41d53b9700 1 -- 172.21.15.153:0/3773472073 wait complete. 2023-08-17T00:03:42.391 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:42.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 Processor -- start 2023-08-17T00:03:42.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 -- start start 2023-08-17T00:03:42.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa38153ab0 0x7faa38153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa380c7ba0 0x7faa380c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa380aa750 con 0x7faa380c8d50 2023-08-17T00:03:42.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380c9dd0 con 0x7faa38153ab0 2023-08-17T00:03:42.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3fe1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa380aacf0 con 0x7faa380c7ba0 2023-08-17T00:03:42.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3dbb7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa38153ab0 0x7faa38153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3dbb7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa38153ab0 0x7faa38153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59720/0 (socket says 172.21.15.153:59720) 2023-08-17T00:03:42.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3dbb7700 1 -- 172.21.15.153:0/18732136 learned_addr learned my addr 172.21.15.153:0/18732136 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:42.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.541+0000 7faa3e3b8700 1 --2- 172.21.15.153:0/18732136 >> v2:172.21.15.178:3300/0 conn(0x7faa380c7ba0 0x7faa380c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3dbb7700 1 -- 172.21.15.153:0/18732136 >> v2:172.21.15.178:3300/0 conn(0x7faa380c7ba0 msgr2=0x7faa380c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:42.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3dbb7700 1 --2- 172.21.15.153:0/18732136 >> v2:172.21.15.178:3300/0 conn(0x7faa380c7ba0 0x7faa380c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3dbb7700 1 -- 172.21.15.153:0/18732136 >> v1:172.21.15.153:6789/0 conn(0x7faa380c8d50 legacy=0x7faa380c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3dbb7700 1 -- 172.21.15.153:0/18732136 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa380c5ca0 con 0x7faa38153ab0 2023-08-17T00:03:42.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3dbb7700 1 --2- 172.21.15.153:0/18732136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa38153e90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7faa3805ea10 tx=0x7faa340090f0).ready entity=mon.0 client_cookie=9aa156d8c2168fe2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3cbb5700 1 -- 172.21.15.153:0/18732136 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400b600 con 0x7faa38153ab0 2023-08-17T00:03:42.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3cbb5700 1 -- 172.21.15.153:0/18732136 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3400b760 con 0x7faa38153ab0 2023-08-17T00:03:42.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3cbb5700 1 -- 172.21.15.153:0/18732136 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3400bb00 con 0x7faa38153ab0 2023-08-17T00:03:42.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 -- 172.21.15.153:0/18732136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 msgr2=0x7faa38153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/18732136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa38153e90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7faa3805ea10 tx=0x7faa340090f0).stop 2023-08-17T00:03:42.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 -- 172.21.15.153:0/18732136 shutdown_connections 2023-08-17T00:03:42.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/18732136 >> v2:172.21.15.178:3300/0 conn(0x7faa380c7ba0 0x7faa380c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/18732136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa38153e90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 -- 172.21.15.153:0/18732136 >> 172.21.15.153:0/18732136 conn(0x7faa38061fa0 msgr2=0x7faa380623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:42.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 -- 172.21.15.153:0/18732136 shutdown_connections 2023-08-17T00:03:42.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.545+0000 7faa3fe1b700 1 -- 172.21.15.153:0/18732136 wait complete. 2023-08-17T00:03:42.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 Processor -- start 2023-08-17T00:03:42.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 -- start start 2023-08-17T00:03:42.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa380c7ba0 0x7faa381506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa380c8d50 0x7faa380c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa380c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa380c4420 con 0x7faa38153ab0 2023-08-17T00:03:42.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa381568a0 con 0x7faa380c8d50 2023-08-17T00:03:42.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa380ae340 con 0x7faa380c7ba0 2023-08-17T00:03:42.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa380c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa380c3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59730/0 (socket says 172.21.15.153:59730) 2023-08-17T00:03:42.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 -- 172.21.15.153:0/1889043806 learned_addr learned my addr 172.21.15.153:0/1889043806 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:42.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3d3b6700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa380c8d50 0x7faa380c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3dbb7700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa380c7ba0 0x7faa381506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 -- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa380c7ba0 msgr2=0x7faa381506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa380c7ba0 0x7faa381506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 -- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa380c8d50 msgr2=0x7faa380c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa380c8d50 0x7faa380c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 -- 172.21.15.153:0/1889043806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34009370 con 0x7faa38153ab0 2023-08-17T00:03:42.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3dbb7700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa380c7ba0 0x7faa381506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:42.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3e3b8700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa380c3f30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7faa30007f30 tx=0x7faa300098e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000ec40 con 0x7faa38153ab0 2023-08-17T00:03:42.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000eda0 con 0x7faa38153ab0 2023-08-17T00:03:42.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30014610 con 0x7faa38153ab0 2023-08-17T00:03:42.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.549+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa380c2b30 con 0x7faa38153ab0 2023-08-17T00:03:42.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.553+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa380adcf0 con 0x7faa38153ab0 2023-08-17T00:03:42.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.553+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3806b530 con 0x7faa38153ab0 2023-08-17T00:03:42.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.553+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7faa3001b030 con 0x7faa38153ab0 2023-08-17T00:03:42.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.557+0000 7faa2dffb700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa1c05a150 0x7faa1c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.557+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa300744c0 con 0x7faa38153ab0 2023-08-17T00:03:42.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.557+0000 7faa3dbb7700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa1c05a150 0x7faa1c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.557+0000 7faa3dbb7700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa1c05a150 0x7faa1c05c610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7faa34009fd0 tx=0x7faa34017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.561+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa30047f70 con 0x7faa38153ab0 2023-08-17T00:03:42.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.717+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa380c9810 con 0x7faa38153ab0 2023-08-17T00:03:42.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa2dffb700 1 -- 172.21.15.153:0/1889043806 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16989 (secure 0 0 0) 0x7faa3004be60 con 0x7faa38153ab0 2023-08-17T00:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:42.726 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":33,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:03:41.952394+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:03:39.751729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T00:03:40.984291+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa1c05a150 msgr2=0x7faa1c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa1c05a150 0x7faa1c05c610 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7faa34009fd0 tx=0x7faa34017000).stop 2023-08-17T00:03:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 msgr2=0x7faa380c3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa380c3f30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7faa30007f30 tx=0x7faa300098e0).stop 2023-08-17T00:03:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 shutdown_connections 2023-08-17T00:03:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa1c05a150 0x7faa1c05c610 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa38153ab0 0x7faa380c3f30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa380c8d50 0x7faa380c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 --2- 172.21.15.153:0/1889043806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa380c7ba0 0x7faa381506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 >> 172.21.15.153:0/1889043806 conn(0x7faa38061fa0 msgr2=0x7faa38155d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:42.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 shutdown_connections 2023-08-17T00:03:42.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.721+0000 7faa3fe1b700 1 -- 172.21.15.153:0/1889043806 wait complete. 2023-08-17T00:03:42.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:03:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.905+0000 7fb2f3f69700 1 Processor -- start 2023-08-17T00:03:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.905+0000 7fb2f3f69700 1 -- start start 2023-08-17T00:03:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f3f69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2ec153e90 0x7fb2ec0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f3f69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec0aa750 con 0x7fb2ec153ab0 2023-08-17T00:03:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f3f69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ec1542f0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f3f69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c9dd0 con 0x7fb2ec153e90 2023-08-17T00:03:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f1d05700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb2ec153ab0 0x7fb2ec0c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43830/0 (socket says 172.21.15.153:43830) 2023-08-17T00:03:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f1d05700 1 -- 172.21.15.153:0/1538345494 learned_addr learned my addr 172.21.15.153:0/1538345494 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f1504700 1 --2- 172.21.15.153:0/1538345494 >> v2:172.21.15.178:3300/0 conn(0x7fb2ec153e90 0x7fb2ec0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415035761 0 0) 0x7fb2ec0aa750 con 0x7fb2ec153ab0 2023-08-17T00:03:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d80033f0 con 0x7fb2ec153ab0 2023-08-17T00:03:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051419558 0 0) 0x7fb2ec1542f0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec0aa750 con 0x7fb2ec0c7980 2023-08-17T00:03:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f1504700 1 -- 172.21.15.153:0/1538345494 >> v1:172.21.15.178:6789/0 conn(0x7fb2ec0c7980 legacy=0x7fb2ec0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f1504700 1 -- 172.21.15.153:0/1538345494 >> v1:172.21.15.153:6789/0 conn(0x7fb2ec153ab0 legacy=0x7fb2ec0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.909+0000 7fb2f1504700 1 -- 172.21.15.153:0/1538345494 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec0aacf0 con 0x7fb2ec153e90 2023-08-17T00:03:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f1504700 1 --2- 172.21.15.153:0/1538345494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec0c7490 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb2dc009760 tx=0x7fb2dc009060).ready entity=mon.1 client_cookie=139202c0df9de484 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc009120 con 0x7fb2ec153e90 2023-08-17T00:03:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc00d4a0 con 0x7fb2ec153e90 2023-08-17T00:03:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f0d03700 1 -- 172.21.15.153:0/1538345494 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc00d820 con 0x7fb2ec153e90 2023-08-17T00:03:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 -- 172.21.15.153:0/1538345494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 msgr2=0x7fb2ec0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/1538345494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec0c7490 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fb2dc009760 tx=0x7fb2dc009060).stop 2023-08-17T00:03:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 -- 172.21.15.153:0/1538345494 shutdown_connections 2023-08-17T00:03:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/1538345494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec0c7490 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 -- 172.21.15.153:0/1538345494 >> 172.21.15.153:0/1538345494 conn(0x7fb2ec061fa0 msgr2=0x7fb2ec0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 -- 172.21.15.153:0/1538345494 shutdown_connections 2023-08-17T00:03:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 -- 172.21.15.153:0/1538345494 wait complete. 2023-08-17T00:03:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 Processor -- start 2023-08-17T00:03:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.913+0000 7fb2f3f69700 1 -- start start 2023-08-17T00:03:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 0x7fb2ec0b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2ec153ab0 0x7fb2ec0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec157b40 con 0x7fb2ec0c7980 2023-08-17T00:03:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec157830 con 0x7fb2ec153e90 2023-08-17T00:03:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec0c2cf0 con 0x7fb2ec153ab0 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 0x7fb2ec0b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 0x7fb2ec0b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59742/0 (socket says 172.21.15.153:59742) 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 -- 172.21.15.153:0/632365390 learned_addr learned my addr 172.21.15.153:0/632365390 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f2506700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1504700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2ec153ab0 0x7fb2ec0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 -- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2ec153ab0 msgr2=0x7fb2ec0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2ec153ab0 0x7fb2ec0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 -- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 msgr2=0x7fb2ec151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 -- 172.21.15.153:0/632365390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0092a0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f1d05700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 0x7fb2ec0b0610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fb2e800c560 tx=0x7fb2e8007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80072e0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ec0c2fd0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8007440 con 0x7fb2ec0c7980 2023-08-17T00:03:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80057a0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.917+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ec0c29c0 con 0x7fb2ec0c7980 2023-08-17T00:03:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.921+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ec06b530 con 0x7fb2ec0c7980 2023-08-17T00:03:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.921+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb2e801a060 con 0x7fb2ec0c7980 2023-08-17T00:03:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.921+0000 7fb2e1ffb700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2d005a180 0x7fb2d005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.921+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb2e8073830 con 0x7fb2ec0c7980 2023-08-17T00:03:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.921+0000 7fb2f1504700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2d005a180 0x7fb2d005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.925+0000 7fb2f1504700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2d005a180 0x7fb2d005c640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb2dc006d60 tx=0x7fb2dc016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:42.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:42.929+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2e80472e0 con 0x7fb2ec0c7980 2023-08-17T00:03:43.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.129+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb2ec063010 con 0x7fb2ec0c7980 2023-08-17T00:03:43.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.969+0000 7fb2e1ffb700 1 -- 172.21.15.153:0/632365390 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb2e8018070 con 0x7fb2ec0c7980 2023-08-17T00:03:43.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.973+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2d005a180 msgr2=0x7fb2d005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:43.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.973+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2d005a180 0x7fb2d005c640 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb2dc006d60 tx=0x7fb2dc016000).stop 2023-08-17T00:03:43.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.973+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 msgr2=0x7fb2ec0b0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:43.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.973+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 0x7fb2ec0b0610 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fb2e800c560 tx=0x7fb2e8007d20).stop 2023-08-17T00:03:43.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 shutdown_connections 2023-08-17T00:03:43.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2d005a180 0x7fb2d005c640 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:43.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ec153e90 0x7fb2ec151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:43.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2ec153ab0 0x7fb2ec0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:43.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 --2- 172.21.15.153:0/632365390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ec0c7980 0x7fb2ec0b0610 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:43.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 >> 172.21.15.153:0/632365390 conn(0x7fb2ec061fa0 msgr2=0x7fb2ec0a9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:43.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 shutdown_connections 2023-08-17T00:03:43.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:43.977+0000 7fb2f3f69700 1 -- 172.21.15.153:0/632365390 wait complete. 2023-08-17T00:03:44.003 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:03:44.004 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:03:44.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.169+0000 7f457f4e4700 1 Processor -- start 2023-08-17T00:03:44.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.169+0000 7f457f4e4700 1 -- start start 2023-08-17T00:03:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457f4e4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4578068da0 0x7f45781560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457f4e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578151530 0x7f45781519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457f4e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4578065da0 con 0x7f45780689c0 2023-08-17T00:03:44.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457f4e4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4578069200 con 0x7f4578068da0 2023-08-17T00:03:44.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457f4e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4578155c60 con 0x7f4578151530 2023-08-17T00:03:44.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4578068da0 0x7f45781560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:44.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4578068da0 0x7f45781560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59758/0 (socket says 172.21.15.153:59758) 2023-08-17T00:03:44.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 -- 172.21.15.153:0/2212203308 learned_addr learned my addr 172.21.15.153:0/2212203308 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:44.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457ece3700 1 --2- 172.21.15.153:0/2212203308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578151530 0x7f45781519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:44.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 -- 172.21.15.153:0/2212203308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578151530 msgr2=0x7f45781519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:44.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 --2- 172.21.15.153:0/2212203308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578151530 0x7f45781519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 -- 172.21.15.153:0/2212203308 >> v1:172.21.15.178:6789/0 conn(0x7f45780689c0 legacy=0x7f45780c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:44.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 -- 172.21.15.153:0/2212203308 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4578065ff0 con 0x7f4578068da0 2023-08-17T00:03:44.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457dce1700 1 --2- 172.21.15.153:0/2212203308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578068da0 0x7f45781560f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f4568006fd0 tx=0x7f45680090f0).ready entity=mon.0 client_cookie=2b782ce78fb8214e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457d4e0700 1 -- 172.21.15.153:0/2212203308 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456800b580 con 0x7f4578068da0 2023-08-17T00:03:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457d4e0700 1 -- 172.21.15.153:0/2212203308 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456800b6e0 con 0x7f4578068da0 2023-08-17T00:03:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.173+0000 7f457d4e0700 1 -- 172.21.15.153:0/2212203308 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456800ba80 con 0x7f4578068da0 2023-08-17T00:03:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 -- 172.21.15.153:0/2212203308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578068da0 msgr2=0x7f45781560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:44.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2212203308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578068da0 0x7f45781560f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f4568006fd0 tx=0x7f45680090f0).stop 2023-08-17T00:03:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 -- 172.21.15.153:0/2212203308 shutdown_connections 2023-08-17T00:03:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2212203308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578151530 0x7f45781519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2212203308 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578068da0 0x7f45781560f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 -- 172.21.15.153:0/2212203308 >> 172.21.15.153:0/2212203308 conn(0x7f45780c6620 msgr2=0x7f45780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 -- 172.21.15.153:0/2212203308 shutdown_connections 2023-08-17T00:03:44.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 -- 172.21.15.153:0/2212203308 wait complete. 2023-08-17T00:03:44.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 Processor -- start 2023-08-17T00:03:44.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.177+0000 7f457f4e4700 1 -- start start 2023-08-17T00:03:44.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45780689c0 0x7f45780bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:44.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578068da0 0x7f4578150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:44.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 0x7f4578169090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:44.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780be9f0 con 0x7f4578151530 2023-08-17T00:03:44.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578150c50 con 0x7f45780689c0 2023-08-17T00:03:44.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45780bec40 con 0x7f4578068da0 2023-08-17T00:03:44.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 0x7f4578169090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 0x7f4578169090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:59762/0 (socket says 172.21.15.153:59762) 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 -- 172.21.15.153:0/2127296839 learned_addr learned my addr 172.21.15.153:0/2127296839 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457dce1700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578068da0 0x7f4578150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457e4e2700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45780689c0 0x7f45780bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 -- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578068da0 msgr2=0x7f4578150760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578068da0 0x7f4578150760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 -- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45780689c0 msgr2=0x7f45780bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:44.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45780689c0 0x7f45780bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 -- 172.21.15.153:0/2127296839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568009370 con 0x7f4578151530 2023-08-17T00:03:44.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457ece3700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 0x7f4578169090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f4570009df0 tx=0x7f457000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:44.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000caa0 con 0x7f4578151530 2023-08-17T00:03:44.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457000f040 con 0x7f4578151530 2023-08-17T00:03:44.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45780bef20 con 0x7f4578151530 2023-08-17T00:03:44.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457000ce10 con 0x7f4578151530 2023-08-17T00:03:44.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.181+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45780bf4e0 con 0x7f4578151530 2023-08-17T00:03:44.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.185+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45780bf6d0 con 0x7f4578151530 2023-08-17T00:03:44.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.185+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4570013610 con 0x7f4578151530 2023-08-17T00:03:44.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.185+0000 7f456e7fc700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f455c05a1a0 0x7f455c05c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:44.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.189+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4570074900 con 0x7f4578151530 2023-08-17T00:03:44.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.189+0000 7f457e4e2700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f455c05a1a0 0x7f455c05c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:44.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.189+0000 7f457e4e2700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f455c05a1a0 0x7f455c05c660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4574007fd0 tx=0x7f4574007d90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:44.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.189+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45700483d0 con 0x7f4578151530 2023-08-17T00:03:44.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.389+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4578063750 con 0x7f4578151530 2023-08-17T00:03:44.479 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:03:44.473+0000 7fb85409e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:03:44.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.981+0000 7f456e7fc700 1 -- 172.21.15.153:0/2127296839 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f457004b9f0 con 0x7f4578151530 2023-08-17T00:03:44.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f455c05a1a0 msgr2=0x7f455c05c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:44.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f455c05a1a0 0x7f455c05c660 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f4574007fd0 tx=0x7f4574007d90).stop 2023-08-17T00:03:44.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 msgr2=0x7f4578169090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:44.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 0x7f4578169090 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f4570009df0 tx=0x7f457000b040).stop 2023-08-17T00:03:44.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 shutdown_connections 2023-08-17T00:03:44.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f455c05a1a0 0x7f455c05c660 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4578151530 0x7f4578169090 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4578068da0 0x7f4578150760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 --2- 172.21.15.153:0/2127296839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45780689c0 0x7f45780bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:44.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.985+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 >> 172.21.15.153:0/2127296839 conn(0x7f45780c6620 msgr2=0x7f4578064dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:44.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.989+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 shutdown_connections 2023-08-17T00:03:44.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:44.989+0000 7f457f4e4700 1 -- 172.21.15.153:0/2127296839 wait complete. 2023-08-17T00:03:45.016 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:03:45.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:45.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86433b9700 1 Processor -- start 2023-08-17T00:03:45.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86433b9700 1 -- start start 2023-08-17T00:03:45.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86433b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f863c068da0 0x7f863c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86433b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c065da0 con 0x7f863c0689c0 2023-08-17T00:03:45.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86433b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863c155c60 con 0x7f863c151530 2023-08-17T00:03:45.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86433b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863c069200 con 0x7f863c068da0 2023-08-17T00:03:45.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f8641bb6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f863c068da0 0x7f863c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f8641bb6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f863c068da0 0x7f863c1560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41244/0 (socket says 172.21.15.153:41244) 2023-08-17T00:03:45.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f86423b7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f863c0689c0 0x7f863c0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37650/0 (socket says 172.21.15.153:37650) 2023-08-17T00:03:45.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.173+0000 7f8641bb6700 1 -- 172.21.15.153:0/320559512 learned_addr learned my addr 172.21.15.153:0/320559512 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:45.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f8641bb6700 1 -- 172.21.15.153:0/320559512 >> v1:172.21.15.178:6789/0 conn(0x7f863c151530 legacy=0x7f863c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f8641bb6700 1 -- 172.21.15.153:0/320559512 >> v1:172.21.15.153:6789/0 conn(0x7f863c0689c0 legacy=0x7f863c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f8641bb6700 1 -- 172.21.15.153:0/320559512 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c065ff0 con 0x7f863c068da0 2023-08-17T00:03:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f8641bb6700 1 --2- 172.21.15.153:0/320559512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c068da0 0x7f863c1560f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f862c006fd0 tx=0x7f862c0090f0).ready entity=mon.0 client_cookie=b5b5f2f7a1efa99f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86413b5700 1 -- 172.21.15.153:0/320559512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00b600 con 0x7f863c068da0 2023-08-17T00:03:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86413b5700 1 -- 172.21.15.153:0/320559512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862c00b760 con 0x7f863c068da0 2023-08-17T00:03:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86413b5700 1 -- 172.21.15.153:0/320559512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862c00bb00 con 0x7f863c068da0 2023-08-17T00:03:45.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 -- 172.21.15.153:0/320559512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c068da0 msgr2=0x7f863c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 --2- 172.21.15.153:0/320559512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c068da0 0x7f863c1560f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f862c006fd0 tx=0x7f862c0090f0).stop 2023-08-17T00:03:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 -- 172.21.15.153:0/320559512 shutdown_connections 2023-08-17T00:03:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 --2- 172.21.15.153:0/320559512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c068da0 0x7f863c1560f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 -- 172.21.15.153:0/320559512 >> 172.21.15.153:0/320559512 conn(0x7f863c0c6620 msgr2=0x7f863c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:45.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 -- 172.21.15.153:0/320559512 shutdown_connections 2023-08-17T00:03:45.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.177+0000 7f86433b9700 1 -- 172.21.15.153:0/320559512 wait complete. 2023-08-17T00:03:45.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.181+0000 7f86433b9700 1 Processor -- start 2023-08-17T00:03:45.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.181+0000 7f86433b9700 1 -- start start 2023-08-17T00:03:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f863c0689c0 0x7f863c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f863c068da0 0x7f863c158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 0x7f863c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c157bc0 con 0x7f863c151530 2023-08-17T00:03:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863c157ea0 con 0x7f863c068da0 2023-08-17T00:03:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f863c158180 con 0x7f863c0689c0 2023-08-17T00:03:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 0x7f863c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 0x7f863c157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41248/0 (socket says 172.21.15.153:41248) 2023-08-17T00:03:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 -- 172.21.15.153:0/3418444581 learned_addr learned my addr 172.21.15.153:0/3418444581 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86423b7700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f863c0689c0 0x7f863c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8641bb6700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f863c068da0 0x7f863c158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 -- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f863c0689c0 msgr2=0x7f863c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f863c0689c0 0x7f863c15dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 -- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f863c068da0 msgr2=0x7f863c158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f863c068da0 0x7f863c158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 -- 172.21.15.153:0/3418444581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c009370 con 0x7f863c151530 2023-08-17T00:03:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f8642bb8700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 0x7f863c157100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f8634002230 tx=0x7f86340015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400e4a0 con 0x7f863c151530 2023-08-17T00:03:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f863c158460 con 0x7f863c151530 2023-08-17T00:03:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863400e600 con 0x7f863c151530 2023-08-17T00:03:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863400e980 con 0x7f863c151530 2023-08-17T00:03:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.185+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f863c154d50 con 0x7f863c151530 2023-08-17T00:03:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.189+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863c158960 con 0x7f863c151530 2023-08-17T00:03:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.189+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8634019030 con 0x7f863c151530 2023-08-17T00:03:45.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.189+0000 7f86327fc700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f862005a150 0x7f862005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.189+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f86340736e0 con 0x7f863c151530 2023-08-17T00:03:45.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.189+0000 7f86423b7700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f862005a150 0x7f862005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.193+0000 7f86423b7700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f862005a150 0x7f862005c610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8638000fb0 tx=0x7f8638007cf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.197+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8634047240 con 0x7f863c151530 2023-08-17T00:03:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.393+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f863c06b4c0 con 0x7f863c151530 2023-08-17T00:03:45.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.393+0000 7f86327fc700 1 -- 172.21.15.153:0/3418444581 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f863404a860 con 0x7f863c151530 2023-08-17T00:03:45.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:45.400 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:03:41.953300+0000","modified":"2023-08-17T00:03:44.973789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1653485600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1653485600},{"type":"v1","addr":"172.21.15.153:6835","nonce":1653485600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T00:03:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f862005a150 msgr2=0x7f862005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f862005a150 0x7f862005c610 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f8638000fb0 tx=0x7f8638007cf0).stop 2023-08-17T00:03:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 msgr2=0x7f863c157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 0x7f863c157100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f8634002230 tx=0x7f86340015e0).stop 2023-08-17T00:03:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 shutdown_connections 2023-08-17T00:03:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f862005a150 0x7f862005c610 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f863c151530 0x7f863c157100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f863c068da0 0x7f863c158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 --2- 172.21.15.153:0/3418444581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f863c0689c0 0x7f863c15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 >> 172.21.15.153:0/3418444581 conn(0x7f863c0c6620 msgr2=0x7f863c0c01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 shutdown_connections 2023-08-17T00:03:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.397+0000 7f86433b9700 1 -- 172.21.15.153:0/3418444581 wait complete. 2023-08-17T00:03:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 14 2023-08-17T00:03:45.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:03:45.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.569+0000 7ff94d25b700 1 Processor -- start 2023-08-17T00:03:45.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.569+0000 7ff94d25b700 1 -- start start 2023-08-17T00:03:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.569+0000 7ff94d25b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff948151f70 0x7ff948065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.569+0000 7ff94d25b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff948061fa0 con 0x7ff948065b50 2023-08-17T00:03:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.569+0000 7ff94d25b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9481523d0 con 0x7ff948151b90 2023-08-17T00:03:45.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.569+0000 7ff94d25b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9480c3fb0 con 0x7ff948151f70 2023-08-17T00:03:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff948151f70 0x7ff948065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94759e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff948065b50 0x7ff948064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37662/0 (socket says 172.21.15.153:37662) 2023-08-17T00:03:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94759e700 1 -- 172.21.15.153:0/3577674343 learned_addr learned my addr 172.21.15.153:0/3577674343 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94659c700 1 -- 172.21.15.153:0/3577674343 >> v1:172.21.15.178:6789/0 conn(0x7ff948151b90 legacy=0x7ff948063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94659c700 1 -- 172.21.15.153:0/3577674343 >> v1:172.21.15.153:6789/0 conn(0x7ff948065b50 legacy=0x7ff948064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94659c700 1 -- 172.21.15.153:0/3577674343 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9480621f0 con 0x7ff948151f70 2023-08-17T00:03:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff945d9b700 1 -- 172.21.15.153:0/3577674343 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416438758 0 0) 0x7ff948061fa0 con 0x7ff948065b50 2023-08-17T00:03:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94659c700 1 --2- 172.21.15.153:0/3577674343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff948065660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7ff93c009760 tx=0x7ff93c009060).ready entity=mon.0 client_cookie=4a6b4555677e1e26 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff945d9b700 1 -- 172.21.15.153:0/3577674343 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00b520 con 0x7ff948151f70 2023-08-17T00:03:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff945d9b700 1 -- 172.21.15.153:0/3577674343 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c00b680 con 0x7ff948151f70 2023-08-17T00:03:45.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff945d9b700 1 -- 172.21.15.153:0/3577674343 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c00ba00 con 0x7ff948151f70 2023-08-17T00:03:45.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 -- 172.21.15.153:0/3577674343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 msgr2=0x7ff948065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 --2- 172.21.15.153:0/3577674343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff948065660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7ff93c009760 tx=0x7ff93c009060).stop 2023-08-17T00:03:45.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 -- 172.21.15.153:0/3577674343 shutdown_connections 2023-08-17T00:03:45.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 --2- 172.21.15.153:0/3577674343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff948065660 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 -- 172.21.15.153:0/3577674343 >> 172.21.15.153:0/3577674343 conn(0x7ff9480c7150 msgr2=0x7ff9480c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:45.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 -- 172.21.15.153:0/3577674343 shutdown_connections 2023-08-17T00:03:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.573+0000 7ff94d25b700 1 -- 172.21.15.153:0/3577674343 wait complete. 2023-08-17T00:03:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 Processor -- start 2023-08-17T00:03:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 -- start start 2023-08-17T00:03:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff948065b50 0x7ff948155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff948151b90 0x7ff9481480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff9480bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9481527e0 con 0x7ff948151f70 2023-08-17T00:03:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480c1160 con 0x7ff948151b90 2023-08-17T00:03:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9480c1440 con 0x7ff948065b50 2023-08-17T00:03:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff9480bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff9480bd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41258/0 (socket says 172.21.15.153:41258) 2023-08-17T00:03:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 -- 172.21.15.153:0/1206313858 learned_addr learned my addr 172.21.15.153:0/1206313858 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94659c700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff948151b90 0x7ff9481480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 -- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff948065b50 msgr2=0x7ff948155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff946d9d700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff948065b50 0x7ff948155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff948065b50 0x7ff948155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 -- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff948151b90 msgr2=0x7ff9481480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff948151b90 0x7ff9481480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 -- 172.21.15.153:0/1206313858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c0092a0 con 0x7ff948151f70 2023-08-17T00:03:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94659c700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff948151b90 0x7ff9481480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff946d9d700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff948065b50 0x7ff948155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94759e700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff9480bd720 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff94000c7e0 tx=0x7ff940007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940005d30 con 0x7ff948151f70 2023-08-17T00:03:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940005e90 con 0x7ff948151f70 2023-08-17T00:03:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9480c1720 con 0x7ff948151f70 2023-08-17T00:03:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.577+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940007320 con 0x7ff948151f70 2023-08-17T00:03:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.581+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9480c1ce0 con 0x7ff948151f70 2023-08-17T00:03:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.581+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9480bba10 con 0x7ff948151f70 2023-08-17T00:03:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.581+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff940010030 con 0x7ff948151f70 2023-08-17T00:03:45.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.585+0000 7ff92effd700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93405a180 0x7ff93405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.585+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff940074120 con 0x7ff948151f70 2023-08-17T00:03:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.585+0000 7ff946d9d700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93405a180 0x7ff93405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.585+0000 7ff946d9d700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93405a180 0x7ff93405c640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff9380026f0 tx=0x7ff938009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.589+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9480bba10 con 0x7ff948151f70 2023-08-17T00:03:45.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.745+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9480bba10 con 0x7ff948151f70 2023-08-17T00:03:45.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.749+0000 7ff92effd700 1 -- 172.21.15.153:0/1206313858 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16976 (secure 0 0 0) 0x7ff9480bba10 con 0x7ff948151f70 2023-08-17T00:03:45.754 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:45.754 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":34,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:03:42.957663+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:03:39.751729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T00:03:40.984291+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:03:45.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93405a180 msgr2=0x7ff93405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93405a180 0x7ff93405c640 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff9380026f0 tx=0x7ff938009040).stop 2023-08-17T00:03:45.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 msgr2=0x7ff9480bd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff9480bd720 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff94000c7e0 tx=0x7ff940007f90).stop 2023-08-17T00:03:45.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 shutdown_connections 2023-08-17T00:03:45.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93405a180 0x7ff93405c640 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff948151f70 0x7ff9480bd720 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff948151b90 0x7ff9481480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 --2- 172.21.15.153:0/1206313858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff948065b50 0x7ff948155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 >> 172.21.15.153:0/1206313858 conn(0x7ff9480c7150 msgr2=0x7ff948063290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:45.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 shutdown_connections 2023-08-17T00:03:45.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.753+0000 7ff94d25b700 1 -- 172.21.15.153:0/1206313858 wait complete. 2023-08-17T00:03:45.779 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:03:45.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:03:45.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 Processor -- start 2023-08-17T00:03:45.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 -- start start 2023-08-17T00:03:45.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ac80c5ea0 0x7f7ac80634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ac80639a0 0x7f7ac80bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac8154e90 con 0x7f7ac80acf30 2023-08-17T00:03:45.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac80c1730 con 0x7f7ac80639a0 2023-08-17T00:03:45.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8153fc0 con 0x7f7ac80c5ea0 2023-08-17T00:03:45.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ac80639a0 0x7f7ac80bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ac80acf30 0x7f7ac80c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37668/0 (socket says 172.21.15.153:37668) 2023-08-17T00:03:45.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.933+0000 7f7ac659c700 1 -- 172.21.15.153:0/711811523 learned_addr learned my addr 172.21.15.153:0/711811523 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:45.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac5d9b700 1 --2- 172.21.15.153:0/711811523 >> v2:172.21.15.178:3300/0 conn(0x7f7ac80c5ea0 0x7f7ac80634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac6d9d700 1 -- 172.21.15.153:0/711811523 >> v2:172.21.15.178:3300/0 conn(0x7f7ac80c5ea0 msgr2=0x7f7ac80634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac6d9d700 1 --2- 172.21.15.153:0/711811523 >> v2:172.21.15.178:3300/0 conn(0x7f7ac80c5ea0 0x7f7ac80634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac6d9d700 1 -- 172.21.15.153:0/711811523 >> v1:172.21.15.153:6789/0 conn(0x7f7ac80acf30 legacy=0x7f7ac80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac6d9d700 1 -- 172.21.15.153:0/711811523 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8154280 con 0x7f7ac80639a0 2023-08-17T00:03:45.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac6d9d700 1 --2- 172.21.15.153:0/711811523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80639a0 0x7f7ac80bfad0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7ac80b0a60 tx=0x7f7ac0009780).ready entity=mon.0 client_cookie=411f858df4754ccc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac559a700 1 -- 172.21.15.153:0/711811523 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac000e070 con 0x7f7ac80639a0 2023-08-17T00:03:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac559a700 1 -- 172.21.15.153:0/711811523 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac000bc30 con 0x7f7ac80639a0 2023-08-17T00:03:45.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac559a700 1 -- 172.21.15.153:0/711811523 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac0012410 con 0x7f7ac80639a0 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 -- 172.21.15.153:0/711811523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80639a0 msgr2=0x7f7ac80bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 --2- 172.21.15.153:0/711811523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80639a0 0x7f7ac80bfad0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f7ac80b0a60 tx=0x7f7ac0009780).stop 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 -- 172.21.15.153:0/711811523 shutdown_connections 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 --2- 172.21.15.153:0/711811523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80639a0 0x7f7ac80bfad0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 --2- 172.21.15.153:0/711811523 >> v2:172.21.15.178:3300/0 conn(0x7f7ac80c5ea0 0x7f7ac80634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 -- 172.21.15.153:0/711811523 >> 172.21.15.153:0/711811523 conn(0x7f7ac80cb330 msgr2=0x7f7ac80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:45.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 -- 172.21.15.153:0/711811523 shutdown_connections 2023-08-17T00:03:45.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.937+0000 7f7ac759e700 1 -- 172.21.15.153:0/711811523 wait complete. 2023-08-17T00:03:45.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 Processor -- start 2023-08-17T00:03:45.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 -- start start 2023-08-17T00:03:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ac80639a0 0x7f7ac80c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 0x7f7ac8145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ac80c4530 0x7f7ac80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80b07a0 con 0x7f7ac80acf30 2023-08-17T00:03:45.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80afc20 con 0x7f7ac80639a0 2023-08-17T00:03:45.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac80aff00 con 0x7f7ac80c4530 2023-08-17T00:03:45.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 0x7f7ac8145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 0x7f7ac8145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41282/0 (socket says 172.21.15.153:41282) 2023-08-17T00:03:45.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 -- 172.21.15.153:0/3436140907 learned_addr learned my addr 172.21.15.153:0/3436140907 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:45.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac659c700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ac80639a0 0x7f7ac80c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac6d9d700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ac80c4530 0x7f7ac80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 -- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ac80c4530 msgr2=0x7f7ac80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ac80c4530 0x7f7ac80aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 -- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ac80639a0 msgr2=0x7f7ac80c4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ac80639a0 0x7f7ac80c4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.941+0000 7f7ac5d9b700 1 -- 172.21.15.153:0/3436140907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac0009a20 con 0x7f7ac80acf30 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ac5d9b700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 0x7f7ac8145220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f7abc00d890 tx=0x7f7abc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc011590 con 0x7f7ac80acf30 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0116f0 con 0x7f7ac80acf30 2023-08-17T00:03:45.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac80b01e0 con 0x7f7ac80acf30 2023-08-17T00:03:45.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc011a70 con 0x7f7ac80acf30 2023-08-17T00:03:45.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac8151920 con 0x7f7ac80acf30 2023-08-17T00:03:45.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac806b4c0 con 0x7f7ac80acf30 2023-08-17T00:03:45.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.945+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7abc012420 con 0x7f7ac80acf30 2023-08-17T00:03:45.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.949+0000 7f7ab67fc700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7aa805a180 0x7f7aa805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:45.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.949+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7abc073b70 con 0x7f7ac80acf30 2023-08-17T00:03:45.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.949+0000 7f7ac659c700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7aa805a180 0x7f7aa805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:45.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.949+0000 7f7ac659c700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7aa805a180 0x7f7aa805c640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f7ab8007fd0 tx=0x7f7ab8007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:45.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:45.953+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7abc0475c0 con 0x7f7ac80acf30 2023-08-17T00:03:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.113+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ac8154560 con 0x7f7aa805a180 2023-08-17T00:03:46.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.133+0000 7f7ab67fc700 1 -- 172.21.15.153:0/3436140907 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344697 (secure 0 0 0) 0x7f7ac8154560 con 0x7f7aa805a180 2023-08-17T00:03:46.145 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:46.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7aa805a180 msgr2=0x7f7aa805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7aa805a180 0x7f7aa805c640 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f7ab8007fd0 tx=0x7f7ab8007d30).stop 2023-08-17T00:03:46.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 msgr2=0x7f7ac8145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 0x7f7ac8145220 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f7abc00d890 tx=0x7f7abc008040).stop 2023-08-17T00:03:46.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 shutdown_connections 2023-08-17T00:03:46.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7aa805a180 0x7f7aa805c640 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ac80c4530 0x7f7ac80aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ac80acf30 0x7f7ac8145220 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 --2- 172.21.15.153:0/3436140907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ac80639a0 0x7f7ac80c4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 >> 172.21.15.153:0/3436140907 conn(0x7f7ac80cb330 msgr2=0x7f7ac80c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:46.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 shutdown_connections 2023-08-17T00:03:46.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.141+0000 7f7ac759e700 1 -- 172.21.15.153:0/3436140907 wait complete. 2023-08-17T00:03:46.154 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:03:46.167 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-08-17T00:03:45.185108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379784,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594936,"statfs":{"total":773094113280,"available":770657214464,"internally_reserved":0,"allocated":3088384,"data_stored":1243364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4297,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.267787"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.985568+0000","last_change":"2023-08-17T00:03:41.981753+0000","last_active":"2023-08-17T00:03:41.985568+0000","last_peered":"2023-08-17T00:03:41.985568+0000","last_clean":"2023-08-17T00:03:41.985568+0000","last_became_active":"2023-08-17T00:03:41.981482+0000","last_became_peered":"2023-08-17T00:03:41.981482+0000","last_unstale":"2023-08-17T00:03:41.985568+0000","last_undegraded":"2023-08-17T00:03:41.985568+0000","last_fullsized":"2023-08-17T00:03:41.985568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.003021+0000","last_change":"2023-08-17T00:03:41.563353+0000","last_active":"2023-08-17T00:03:42.003021+0000","last_peered":"2023-08-17T00:03:42.003021+0000","last_clean":"2023-08-17T00:03:42.003021+0000","last_became_active":"2023-08-17T00:03:41.562996+0000","last_became_peered":"2023-08-17T00:03:41.562996+0000","last_unstale":"2023-08-17T00:03:42.003021+0000","last_undegraded":"2023-08-17T00:03:42.003021+0000","last_fullsized":"2023-08-17T00:03:42.003021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000284+0000","last_change":"2023-08-17T00:03:41.992500+0000","last_active":"2023-08-17T00:03:42.000284+0000","last_peered":"2023-08-17T00:03:42.000284+0000","last_clean":"2023-08-17T00:03:42.000284+0000","last_became_active":"2023-08-17T00:03:41.992159+0000","last_became_peered":"2023-08-17T00:03:41.992159+0000","last_unstale":"2023-08-17T00:03:42.000284+0000","last_undegraded":"2023-08-17T00:03:42.000284+0000","last_fullsized":"2023-08-17T00:03:42.000284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967093+0000","last_change":"2023-08-17T00:03:41.554840+0000","last_active":"2023-08-17T00:03:41.967093+0000","last_peered":"2023-08-17T00:03:41.967093+0000","last_clean":"2023-08-17T00:03:41.967093+0000","last_became_active":"2023-08-17T00:03:41.554467+0000","last_became_peered":"2023-08-17T00:03:41.554467+0000","last_unstale":"2023-08-17T00:03:41.967093+0000","last_undegraded":"2023-08-17T00:03:41.967093+0000","last_fullsized":"2023-08-17T00:03:41.967093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997836+0000","last_change":"2023-08-17T00:03:41.992691+0000","last_active":"2023-08-17T00:03:41.997836+0000","last_peered":"2023-08-17T00:03:41.997836+0000","last_clean":"2023-08-17T00:03:41.997836+0000","last_became_active":"2023-08-17T00:03:41.990566+0000","last_became_peered":"2023-08-17T00:03:41.990566+0000","last_unstale":"2023-08-17T00:03:41.997836+0000","last_undegraded":"2023-08-17T00:03:41.997836+0000","last_fullsized":"2023-08-17T00:03:41.997836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.979254+0000","last_change":"2023-08-17T00:03:41.556623+0000","last_active":"2023-08-17T00:03:41.979254+0000","last_peered":"2023-08-17T00:03:41.979254+0000","last_clean":"2023-08-17T00:03:41.979254+0000","last_became_active":"2023-08-17T00:03:41.556249+0000","last_became_peered":"2023-08-17T00:03:41.556249+0000","last_unstale":"2023-08-17T00:03:41.979254+0000","last_undegraded":"2023-08-17T00:03:41.979254+0000","last_fullsized":"2023-08-17T00:03:41.979254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.986090+0000","last_change":"2023-08-17T00:03:41.982831+0000","last_active":"2023-08-17T00:03:41.986090+0000","last_peered":"2023-08-17T00:03:41.986090+0000","last_clean":"2023-08-17T00:03:41.986090+0000","last_became_active":"2023-08-17T00:03:41.982555+0000","last_became_peered":"2023-08-17T00:03:41.982555+0000","last_unstale":"2023-08-17T00:03:41.986090+0000","last_undegraded":"2023-08-17T00:03:41.986090+0000","last_fullsized":"2023-08-17T00:03:41.986090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993154+0000","last_change":"2023-08-17T00:03:41.568211+0000","last_active":"2023-08-17T00:03:41.993154+0000","last_peered":"2023-08-17T00:03:41.993154+0000","last_clean":"2023-08-17T00:03:41.993154+0000","last_became_active":"2023-08-17T00:03:41.567928+0000","last_became_peered":"2023-08-17T00:03:41.567928+0000","last_unstale":"2023-08-17T00:03:41.993154+0000","last_undegraded":"2023-08-17T00:03:41.993154+0000","last_fullsized":"2023-08-17T00:03:41.993154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998191+0000","last_change":"2023-08-17T00:03:41.988489+0000","last_active":"2023-08-17T00:03:41.998191+0000","last_peered":"2023-08-17T00:03:41.998191+0000","last_clean":"2023-08-17T00:03:41.998191+0000","last_became_active":"2023-08-17T00:03:41.988063+0000","last_became_peered":"2023-08-17T00:03:41.988063+0000","last_unstale":"2023-08-17T00:03:41.998191+0000","last_undegraded":"2023-08-17T00:03:41.998191+0000","last_fullsized":"2023-08-17T00:03:41.998191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994204+0000","last_change":"2023-08-17T00:03:41.560395+0000","last_active":"2023-08-17T00:03:41.994204+0000","last_peered":"2023-08-17T00:03:41.994204+0000","last_clean":"2023-08-17T00:03:41.994204+0000","last_became_active":"2023-08-17T00:03:41.560084+0000","last_became_peered":"2023-08-17T00:03:41.560084+0000","last_unstale":"2023-08-17T00:03:41.994204+0000","last_undegraded":"2023-08-17T00:03:41.994204+0000","last_fullsized":"2023-08-17T00:03:41.994204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989926+0000","last_change":"2023-08-17T00:03:41.983241+0000","last_active":"2023-08-17T00:03:41.989926+0000","last_peered":"2023-08-17T00:03:41.989926+0000","last_clean":"2023-08-17T00:03:41.989926+0000","last_became_active":"2023-08-17T00:03:41.982939+0000","last_became_peered":"2023-08-17T00:03:41.982939+0000","last_unstale":"2023-08-17T00:03:41.989926+0000","last_undegraded":"2023-08-17T00:03:41.989926+0000","last_fullsized":"2023-08-17T00:03:41.989926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990936+0000","last_change":"2023-08-17T00:03:41.561397+0000","last_active":"2023-08-17T00:03:41.990936+0000","last_peered":"2023-08-17T00:03:41.990936+0000","last_clean":"2023-08-17T00:03:41.990936+0000","last_became_active":"2023-08-17T00:03:41.560951+0000","last_became_peered":"2023-08-17T00:03:41.560951+0000","last_unstale":"2023-08-17T00:03:41.990936+0000","last_undegraded":"2023-08-17T00:03:41.990936+0000","last_fullsized":"2023-08-17T00:03:41.990936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994708+0000","last_change":"2023-08-17T00:03:41.989567+0000","last_active":"2023-08-17T00:03:41.994708+0000","last_peered":"2023-08-17T00:03:41.994708+0000","last_clean":"2023-08-17T00:03:41.994708+0000","last_became_active":"2023-08-17T00:03:41.989150+0000","last_became_peered":"2023-08-17T00:03:41.989150+0000","last_unstale":"2023-08-17T00:03:41.994708+0000","last_undegraded":"2023-08-17T00:03:41.994708+0000","last_fullsized":"2023-08-17T00:03:41.994708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969034+0000","last_change":"2023-08-17T00:03:41.568583+0000","last_active":"2023-08-17T00:03:41.969034+0000","last_peered":"2023-08-17T00:03:41.969034+0000","last_clean":"2023-08-17T00:03:41.969034+0000","last_became_active":"2023-08-17T00:03:41.568317+0000","last_became_peered":"2023-08-17T00:03:41.568317+0000","last_unstale":"2023-08-17T00:03:41.969034+0000","last_undegraded":"2023-08-17T00:03:41.969034+0000","last_fullsized":"2023-08-17T00:03:41.969034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.999081+0000","last_change":"2023-08-17T00:03:41.997358+0000","last_active":"2023-08-17T00:03:41.999081+0000","last_peered":"2023-08-17T00:03:41.999081+0000","last_clean":"2023-08-17T00:03:41.999081+0000","last_became_active":"2023-08-17T00:03:41.997084+0000","last_became_peered":"2023-08-17T00:03:41.997084+0000","last_unstale":"2023-08-17T00:03:41.999081+0000","last_undegraded":"2023-08-17T00:03:41.999081+0000","last_fullsized":"2023-08-17T00:03:41.999081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969254+0000","last_change":"2023-08-17T00:03:41.557613+0000","last_active":"2023-08-17T00:03:41.969254+0000","last_peered":"2023-08-17T00:03:41.969254+0000","last_clean":"2023-08-17T00:03:41.969254+0000","last_became_active":"2023-08-17T00:03:41.557192+0000","last_became_peered":"2023-08-17T00:03:41.557192+0000","last_unstale":"2023-08-17T00:03:41.969254+0000","last_undegraded":"2023-08-17T00:03:41.969254+0000","last_fullsized":"2023-08-17T00:03:41.969254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.995904+0000","last_change":"2023-08-17T00:03:41.994545+0000","last_active":"2023-08-17T00:03:41.995904+0000","last_peered":"2023-08-17T00:03:41.995904+0000","last_clean":"2023-08-17T00:03:41.995904+0000","last_became_active":"2023-08-17T00:03:41.994255+0000","last_became_peered":"2023-08-17T00:03:41.994255+0000","last_unstale":"2023-08-17T00:03:41.995904+0000","last_undegraded":"2023-08-17T00:03:41.995904+0000","last_fullsized":"2023-08-17T00:03:41.995904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.975256+0000","last_change":"2023-08-17T00:03:41.559108+0000","last_active":"2023-08-17T00:03:41.975256+0000","last_peered":"2023-08-17T00:03:41.975256+0000","last_clean":"2023-08-17T00:03:41.975256+0000","last_became_active":"2023-08-17T00:03:41.558814+0000","last_became_peered":"2023-08-17T00:03:41.558814+0000","last_unstale":"2023-08-17T00:03:41.975256+0000","last_undegraded":"2023-08-17T00:03:41.975256+0000","last_fullsized":"2023-08-17T00:03:41.975256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002723+0000","last_change":"2023-08-17T00:03:41.988576+0000","last_active":"2023-08-17T00:03:42.002723+0000","last_peered":"2023-08-17T00:03:42.002723+0000","last_clean":"2023-08-17T00:03:42.002723+0000","last_became_active":"2023-08-17T00:03:41.988283+0000","last_became_peered":"2023-08-17T00:03:41.988283+0000","last_unstale":"2023-08-17T00:03:42.002723+0000","last_undegraded":"2023-08-17T00:03:42.002723+0000","last_fullsized":"2023-08-17T00:03:42.002723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969285+0000","last_change":"2023-08-17T00:03:41.553597+0000","last_active":"2023-08-17T00:03:41.969285+0000","last_peered":"2023-08-17T00:03:41.969285+0000","last_clean":"2023-08-17T00:03:41.969285+0000","last_became_active":"2023-08-17T00:03:41.553176+0000","last_became_peered":"2023-08-17T00:03:41.553176+0000","last_unstale":"2023-08-17T00:03:41.969285+0000","last_undegraded":"2023-08-17T00:03:41.969285+0000","last_fullsized":"2023-08-17T00:03:41.969285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990052+0000","last_change":"2023-08-17T00:03:41.985305+0000","last_active":"2023-08-17T00:03:41.990052+0000","last_peered":"2023-08-17T00:03:41.990052+0000","last_clean":"2023-08-17T00:03:41.990052+0000","last_became_active":"2023-08-17T00:03:41.984998+0000","last_became_peered":"2023-08-17T00:03:41.984998+0000","last_unstale":"2023-08-17T00:03:41.990052+0000","last_undegraded":"2023-08-17T00:03:41.990052+0000","last_fullsized":"2023-08-17T00:03:41.990052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973700+0000","last_change":"2023-08-17T00:03:41.554975+0000","last_active":"2023-08-17T00:03:41.973700+0000","last_peered":"2023-08-17T00:03:41.973700+0000","last_clean":"2023-08-17T00:03:41.973700+0000","last_became_active":"2023-08-17T00:03:41.554709+0000","last_became_peered":"2023-08-17T00:03:41.554709+0000","last_unstale":"2023-08-17T00:03:41.973700+0000","last_undegraded":"2023-08-17T00:03:41.973700+0000","last_fullsized":"2023-08-17T00:03:41.973700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994960+0000","last_change":"2023-08-17T00:03:41.992227+0000","last_active":"2023-08-17T00:03:41.994960+0000","last_peered":"2023-08-17T00:03:41.994960+0000","last_clean":"2023-08-17T00:03:41.994960+0000","last_became_active":"2023-08-17T00:03:41.991945+0000","last_became_peered":"2023-08-17T00:03:41.991945+0000","last_unstale":"2023-08-17T00:03:41.994960+0000","last_undegraded":"2023-08-17T00:03:41.994960+0000","last_fullsized":"2023-08-17T00:03:41.994960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002384+0000","last_change":"2023-08-17T00:03:41.564247+0000","last_active":"2023-08-17T00:03:42.002384+0000","last_peered":"2023-08-17T00:03:42.002384+0000","last_clean":"2023-08-17T00:03:42.002384+0000","last_became_active":"2023-08-17T00:03:41.563939+0000","last_became_peered":"2023-08-17T00:03:41.563939+0000","last_unstale":"2023-08-17T00:03:42.002384+0000","last_undegraded":"2023-08-17T00:03:42.002384+0000","last_fullsized":"2023-08-17T00:03:42.002384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000196+0000","last_change":"2023-08-17T00:03:41.993086+0000","last_active":"2023-08-17T00:03:42.000196+0000","last_peered":"2023-08-17T00:03:42.000196+0000","last_clean":"2023-08-17T00:03:42.000196+0000","last_became_active":"2023-08-17T00:03:41.992645+0000","last_became_peered":"2023-08-17T00:03:41.992645+0000","last_unstale":"2023-08-17T00:03:42.000196+0000","last_undegraded":"2023-08-17T00:03:42.000196+0000","last_fullsized":"2023-08-17T00:03:42.000196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000546+0000","last_change":"2023-08-17T00:03:41.565498+0000","last_active":"2023-08-17T00:03:42.000546+0000","last_peered":"2023-08-17T00:03:42.000546+0000","last_clean":"2023-08-17T00:03:42.000546+0000","last_became_active":"2023-08-17T00:03:41.565171+0000","last_became_peered":"2023-08-17T00:03:41.565171+0000","last_unstale":"2023-08-17T00:03:42.000546+0000","last_undegraded":"2023-08-17T00:03:42.000546+0000","last_fullsized":"2023-08-17T00:03:42.000546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.999898+0000","last_change":"2023-08-17T00:03:41.995000+0000","last_active":"2023-08-17T00:03:41.999898+0000","last_peered":"2023-08-17T00:03:41.999898+0000","last_clean":"2023-08-17T00:03:41.999898+0000","last_became_active":"2023-08-17T00:03:41.994698+0000","last_became_peered":"2023-08-17T00:03:41.994698+0000","last_unstale":"2023-08-17T00:03:41.999898+0000","last_undegraded":"2023-08-17T00:03:41.999898+0000","last_fullsized":"2023-08-17T00:03:41.999898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.966414+0000","last_change":"2023-08-17T00:03:41.551051+0000","last_active":"2023-08-17T00:03:41.966414+0000","last_peered":"2023-08-17T00:03:41.966414+0000","last_clean":"2023-08-17T00:03:41.966414+0000","last_became_active":"2023-08-17T00:03:41.550755+0000","last_became_peered":"2023-08-17T00:03:41.550755+0000","last_unstale":"2023-08-17T00:03:41.966414+0000","last_undegraded":"2023-08-17T00:03:41.966414+0000","last_fullsized":"2023-08-17T00:03:41.966414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994308+0000","last_change":"2023-08-17T00:03:41.988523+0000","last_active":"2023-08-17T00:03:41.994308+0000","last_peered":"2023-08-17T00:03:41.994308+0000","last_clean":"2023-08-17T00:03:41.994308+0000","last_became_active":"2023-08-17T00:03:41.988274+0000","last_became_peered":"2023-08-17T00:03:41.988274+0000","last_unstale":"2023-08-17T00:03:41.994308+0000","last_undegraded":"2023-08-17T00:03:41.994308+0000","last_fullsized":"2023-08-17T00:03:41.994308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965380+0000","last_change":"2023-08-17T00:03:41.557906+0000","last_active":"2023-08-17T00:03:41.965380+0000","last_peered":"2023-08-17T00:03:41.965380+0000","last_clean":"2023-08-17T00:03:41.965380+0000","last_became_active":"2023-08-17T00:03:41.557623+0000","last_became_peered":"2023-08-17T00:03:41.557623+0000","last_unstale":"2023-08-17T00:03:41.965380+0000","last_undegraded":"2023-08-17T00:03:41.965380+0000","last_fullsized":"2023-08-17T00:03:41.965380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000423+0000","last_change":"2023-08-17T00:03:41.996306+0000","last_active":"2023-08-17T00:03:42.000423+0000","last_peered":"2023-08-17T00:03:42.000423+0000","last_clean":"2023-08-17T00:03:42.000423+0000","last_became_active":"2023-08-17T00:03:41.996017+0000","last_became_peered":"2023-08-17T00:03:41.996017+0000","last_unstale":"2023-08-17T00:03:42.000423+0000","last_undegraded":"2023-08-17T00:03:42.000423+0000","last_fullsized":"2023-08-17T00:03:42.000423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996292+0000","last_change":"2023-08-17T00:03:41.558007+0000","last_active":"2023-08-17T00:03:41.996292+0000","last_peered":"2023-08-17T00:03:41.996292+0000","last_clean":"2023-08-17T00:03:41.996292+0000","last_became_active":"2023-08-17T00:03:41.556901+0000","last_became_peered":"2023-08-17T00:03:41.556901+0000","last_unstale":"2023-08-17T00:03:41.996292+0000","last_undegraded":"2023-08-17T00:03:41.996292+0000","last_fullsized":"2023-08-17T00:03:41.996292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996190+0000","last_change":"2023-08-17T00:03:41.980427+0000","last_active":"2023-08-17T00:03:41.996190+0000","last_peered":"2023-08-17T00:03:41.996190+0000","last_clean":"2023-08-17T00:03:41.996190+0000","last_became_active":"2023-08-17T00:03:41.980144+0000","last_became_peered":"2023-08-17T00:03:41.980144+0000","last_unstale":"2023-08-17T00:03:41.996190+0000","last_undegraded":"2023-08-17T00:03:41.996190+0000","last_fullsized":"2023-08-17T00:03:41.996190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974962+0000","last_change":"2023-08-17T00:03:41.564455+0000","last_active":"2023-08-17T00:03:41.974962+0000","last_peered":"2023-08-17T00:03:41.974962+0000","last_clean":"2023-08-17T00:03:41.974962+0000","last_became_active":"2023-08-17T00:03:41.563673+0000","last_became_peered":"2023-08-17T00:03:41.563673+0000","last_unstale":"2023-08-17T00:03:41.974962+0000","last_undegraded":"2023-08-17T00:03:41.974962+0000","last_fullsized":"2023-08-17T00:03:41.974962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990749+0000","last_change":"2023-08-17T00:03:41.982961+0000","last_active":"2023-08-17T00:03:41.990749+0000","last_peered":"2023-08-17T00:03:41.990749+0000","last_clean":"2023-08-17T00:03:41.990749+0000","last_became_active":"2023-08-17T00:03:41.982684+0000","last_became_peered":"2023-08-17T00:03:41.982684+0000","last_unstale":"2023-08-17T00:03:41.990749+0000","last_undegraded":"2023-08-17T00:03:41.990749+0000","last_fullsized":"2023-08-17T00:03:41.990749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974768+0000","last_change":"2023-08-17T00:03:41.560281+0000","last_active":"2023-08-17T00:03:41.974768+0000","last_peered":"2023-08-17T00:03:41.974768+0000","last_clean":"2023-08-17T00:03:41.974768+0000","last_became_active":"2023-08-17T00:03:41.559965+0000","last_became_peered":"2023-08-17T00:03:41.559965+0000","last_unstale":"2023-08-17T00:03:41.974768+0000","last_undegraded":"2023-08-17T00:03:41.974768+0000","last_fullsized":"2023-08-17T00:03:41.974768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002749+0000","last_change":"2023-08-17T00:03:41.998083+0000","last_active":"2023-08-17T00:03:42.002749+0000","last_peered":"2023-08-17T00:03:42.002749+0000","last_clean":"2023-08-17T00:03:42.002749+0000","last_became_active":"2023-08-17T00:03:41.996727+0000","last_became_peered":"2023-08-17T00:03:41.996727+0000","last_unstale":"2023-08-17T00:03:42.002749+0000","last_undegraded":"2023-08-17T00:03:42.002749+0000","last_fullsized":"2023-08-17T00:03:42.002749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990413+0000","last_change":"2023-08-17T00:03:41.550679+0000","last_active":"2023-08-17T00:03:41.990413+0000","last_peered":"2023-08-17T00:03:41.990413+0000","last_clean":"2023-08-17T00:03:41.990413+0000","last_became_active":"2023-08-17T00:03:41.550368+0000","last_became_peered":"2023-08-17T00:03:41.550368+0000","last_unstale":"2023-08-17T00:03:41.990413+0000","last_undegraded":"2023-08-17T00:03:41.990413+0000","last_fullsized":"2023-08-17T00:03:41.990413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002754+0000","last_change":"2023-08-17T00:03:41.997234+0000","last_active":"2023-08-17T00:03:42.002754+0000","last_peered":"2023-08-17T00:03:42.002754+0000","last_clean":"2023-08-17T00:03:42.002754+0000","last_became_active":"2023-08-17T00:03:41.996987+0000","last_became_peered":"2023-08-17T00:03:41.996987+0000","last_unstale":"2023-08-17T00:03:42.002754+0000","last_undegraded":"2023-08-17T00:03:42.002754+0000","last_fullsized":"2023-08-17T00:03:42.002754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.984057+0000","last_change":"2023-08-17T00:03:41.566895+0000","last_active":"2023-08-17T00:03:41.984057+0000","last_peered":"2023-08-17T00:03:41.984057+0000","last_clean":"2023-08-17T00:03:41.984057+0000","last_became_active":"2023-08-17T00:03:41.566428+0000","last_became_peered":"2023-08-17T00:03:41.566428+0000","last_unstale":"2023-08-17T00:03:41.984057+0000","last_undegraded":"2023-08-17T00:03:41.984057+0000","last_fullsized":"2023-08-17T00:03:41.984057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000459+0000","last_change":"2023-08-17T00:03:41.996066+0000","last_active":"2023-08-17T00:03:42.000459+0000","last_peered":"2023-08-17T00:03:42.000459+0000","last_clean":"2023-08-17T00:03:42.000459+0000","last_became_active":"2023-08-17T00:03:41.994156+0000","last_became_peered":"2023-08-17T00:03:41.994156+0000","last_unstale":"2023-08-17T00:03:42.000459+0000","last_undegraded":"2023-08-17T00:03:42.000459+0000","last_fullsized":"2023-08-17T00:03:42.000459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996412+0000","last_change":"2023-08-17T00:03:41.568069+0000","last_active":"2023-08-17T00:03:41.996412+0000","last_peered":"2023-08-17T00:03:41.996412+0000","last_clean":"2023-08-17T00:03:41.996412+0000","last_became_active":"2023-08-17T00:03:41.567712+0000","last_became_peered":"2023-08-17T00:03:41.567712+0000","last_unstale":"2023-08-17T00:03:41.996412+0000","last_undegraded":"2023-08-17T00:03:41.996412+0000","last_fullsized":"2023-08-17T00:03:41.996412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991805+0000","last_change":"2023-08-17T00:03:41.989621+0000","last_active":"2023-08-17T00:03:41.991805+0000","last_peered":"2023-08-17T00:03:41.991805+0000","last_clean":"2023-08-17T00:03:41.991805+0000","last_became_active":"2023-08-17T00:03:41.986609+0000","last_became_peered":"2023-08-17T00:03:41.986609+0000","last_unstale":"2023-08-17T00:03:41.991805+0000","last_undegraded":"2023-08-17T00:03:41.991805+0000","last_fullsized":"2023-08-17T00:03:41.991805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969061+0000","last_change":"2023-08-17T00:03:41.558248+0000","last_active":"2023-08-17T00:03:41.969061+0000","last_peered":"2023-08-17T00:03:41.969061+0000","last_clean":"2023-08-17T00:03:41.969061+0000","last_became_active":"2023-08-17T00:03:41.557994+0000","last_became_peered":"2023-08-17T00:03:41.557994+0000","last_unstale":"2023-08-17T00:03:41.969061+0000","last_undegraded":"2023-08-17T00:03:41.969061+0000","last_fullsized":"2023-08-17T00:03:41.969061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002605+0000","last_change":"2023-08-17T00:03:41.993920+0000","last_active":"2023-08-17T00:03:42.002605+0000","last_peered":"2023-08-17T00:03:42.002605+0000","last_clean":"2023-08-17T00:03:42.002605+0000","last_became_active":"2023-08-17T00:03:41.993561+0000","last_became_peered":"2023-08-17T00:03:41.993561+0000","last_unstale":"2023-08-17T00:03:42.002605+0000","last_undegraded":"2023-08-17T00:03:42.002605+0000","last_fullsized":"2023-08-17T00:03:42.002605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.984051+0000","last_change":"2023-08-17T00:03:41.568033+0000","last_active":"2023-08-17T00:03:41.984051+0000","last_peered":"2023-08-17T00:03:41.984051+0000","last_clean":"2023-08-17T00:03:41.984051+0000","last_became_active":"2023-08-17T00:03:41.567761+0000","last_became_peered":"2023-08-17T00:03:41.567761+0000","last_unstale":"2023-08-17T00:03:41.984051+0000","last_undegraded":"2023-08-17T00:03:41.984051+0000","last_fullsized":"2023-08-17T00:03:41.984051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996373+0000","last_change":"2023-08-17T00:03:41.978906+0000","last_active":"2023-08-17T00:03:41.996373+0000","last_peered":"2023-08-17T00:03:41.996373+0000","last_clean":"2023-08-17T00:03:41.996373+0000","last_became_active":"2023-08-17T00:03:41.978633+0000","last_became_peered":"2023-08-17T00:03:41.978633+0000","last_unstale":"2023-08-17T00:03:41.996373+0000","last_undegraded":"2023-08-17T00:03:41.996373+0000","last_fullsized":"2023-08-17T00:03:41.996373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969018+0000","last_change":"2023-08-17T00:03:41.563741+0000","last_active":"2023-08-17T00:03:41.969018+0000","last_peered":"2023-08-17T00:03:41.969018+0000","last_clean":"2023-08-17T00:03:41.969018+0000","last_became_active":"2023-08-17T00:03:41.561844+0000","last_became_peered":"2023-08-17T00:03:41.561844+0000","last_unstale":"2023-08-17T00:03:41.969018+0000","last_undegraded":"2023-08-17T00:03:41.969018+0000","last_fullsized":"2023-08-17T00:03:41.969018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000271+0000","last_change":"2023-08-17T00:03:41.992848+0000","last_active":"2023-08-17T00:03:42.000271+0000","last_peered":"2023-08-17T00:03:42.000271+0000","last_clean":"2023-08-17T00:03:42.000271+0000","last_became_active":"2023-08-17T00:03:41.992493+0000","last_became_peered":"2023-08-17T00:03:41.992493+0000","last_unstale":"2023-08-17T00:03:42.000271+0000","last_undegraded":"2023-08-17T00:03:42.000271+0000","last_fullsized":"2023-08-17T00:03:42.000271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965986+0000","last_change":"2023-08-17T00:03:41.563204+0000","last_active":"2023-08-17T00:03:41.965986+0000","last_peered":"2023-08-17T00:03:41.965986+0000","last_clean":"2023-08-17T00:03:41.965986+0000","last_became_active":"2023-08-17T00:03:41.562920+0000","last_became_peered":"2023-08-17T00:03:41.562920+0000","last_unstale":"2023-08-17T00:03:41.965986+0000","last_undegraded":"2023-08-17T00:03:41.965986+0000","last_fullsized":"2023-08-17T00:03:41.965986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996431+0000","last_change":"2023-08-17T00:03:41.979831+0000","last_active":"2023-08-17T00:03:41.996431+0000","last_peered":"2023-08-17T00:03:41.996431+0000","last_clean":"2023-08-17T00:03:41.996431+0000","last_became_active":"2023-08-17T00:03:41.979571+0000","last_became_peered":"2023-08-17T00:03:41.979571+0000","last_unstale":"2023-08-17T00:03:41.996431+0000","last_undegraded":"2023-08-17T00:03:41.996431+0000","last_fullsized":"2023-08-17T00:03:41.996431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969295+0000","last_change":"2023-08-17T00:03:41.560641+0000","last_active":"2023-08-17T00:03:41.969295+0000","last_peered":"2023-08-17T00:03:41.969295+0000","last_clean":"2023-08-17T00:03:41.969295+0000","last_became_active":"2023-08-17T00:03:41.560350+0000","last_became_peered":"2023-08-17T00:03:41.560350+0000","last_unstale":"2023-08-17T00:03:41.969295+0000","last_undegraded":"2023-08-17T00:03:41.969295+0000","last_fullsized":"2023-08-17T00:03:41.969295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.985508+0000","last_change":"2023-08-17T00:03:41.977231+0000","last_active":"2023-08-17T00:03:41.985508+0000","last_peered":"2023-08-17T00:03:41.985508+0000","last_clean":"2023-08-17T00:03:41.985508+0000","last_became_active":"2023-08-17T00:03:41.976965+0000","last_became_peered":"2023-08-17T00:03:41.976965+0000","last_unstale":"2023-08-17T00:03:41.985508+0000","last_undegraded":"2023-08-17T00:03:41.985508+0000","last_fullsized":"2023-08-17T00:03:41.985508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967394+0000","last_change":"2023-08-17T00:03:41.564756+0000","last_active":"2023-08-17T00:03:41.967394+0000","last_peered":"2023-08-17T00:03:41.967394+0000","last_clean":"2023-08-17T00:03:41.967394+0000","last_became_active":"2023-08-17T00:03:41.564476+0000","last_became_peered":"2023-08-17T00:03:41.564476+0000","last_unstale":"2023-08-17T00:03:41.967394+0000","last_undegraded":"2023-08-17T00:03:41.967394+0000","last_fullsized":"2023-08-17T00:03:41.967394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002612+0000","last_change":"2023-08-17T00:03:41.994714+0000","last_active":"2023-08-17T00:03:42.002612+0000","last_peered":"2023-08-17T00:03:42.002612+0000","last_clean":"2023-08-17T00:03:42.002612+0000","last_became_active":"2023-08-17T00:03:41.994201+0000","last_became_peered":"2023-08-17T00:03:41.994201+0000","last_unstale":"2023-08-17T00:03:42.002612+0000","last_undegraded":"2023-08-17T00:03:42.002612+0000","last_fullsized":"2023-08-17T00:03:42.002612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.971034+0000","last_change":"2023-08-17T00:03:41.562755+0000","last_active":"2023-08-17T00:03:41.971034+0000","last_peered":"2023-08-17T00:03:41.971034+0000","last_clean":"2023-08-17T00:03:41.971034+0000","last_became_active":"2023-08-17T00:03:41.562429+0000","last_became_peered":"2023-08-17T00:03:41.562429+0000","last_unstale":"2023-08-17T00:03:41.971034+0000","last_undegraded":"2023-08-17T00:03:41.971034+0000","last_fullsized":"2023-08-17T00:03:41.971034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998170+0000","last_change":"2023-08-17T00:03:41.988455+0000","last_active":"2023-08-17T00:03:41.998170+0000","last_peered":"2023-08-17T00:03:41.998170+0000","last_clean":"2023-08-17T00:03:41.998170+0000","last_became_active":"2023-08-17T00:03:41.987892+0000","last_became_peered":"2023-08-17T00:03:41.987892+0000","last_unstale":"2023-08-17T00:03:41.998170+0000","last_undegraded":"2023-08-17T00:03:41.998170+0000","last_fullsized":"2023-08-17T00:03:41.998170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.964692+0000","last_change":"2023-08-17T00:03:41.559744+0000","last_active":"2023-08-17T00:03:41.964692+0000","last_peered":"2023-08-17T00:03:41.964692+0000","last_clean":"2023-08-17T00:03:41.964692+0000","last_became_active":"2023-08-17T00:03:41.559432+0000","last_became_peered":"2023-08-17T00:03:41.559432+0000","last_unstale":"2023-08-17T00:03:41.964692+0000","last_undegraded":"2023-08-17T00:03:41.964692+0000","last_fullsized":"2023-08-17T00:03:41.964692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000250+0000","last_change":"2023-08-17T00:03:41.995383+0000","last_active":"2023-08-17T00:03:42.000250+0000","last_peered":"2023-08-17T00:03:42.000250+0000","last_clean":"2023-08-17T00:03:42.000250+0000","last_became_active":"2023-08-17T00:03:41.995069+0000","last_became_peered":"2023-08-17T00:03:41.995069+0000","last_unstale":"2023-08-17T00:03:42.000250+0000","last_undegraded":"2023-08-17T00:03:42.000250+0000","last_fullsized":"2023-08-17T00:03:42.000250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.964305+0000","last_change":"2023-08-17T00:03:41.567896+0000","last_active":"2023-08-17T00:03:41.964305+0000","last_peered":"2023-08-17T00:03:41.964305+0000","last_clean":"2023-08-17T00:03:41.964305+0000","last_became_active":"2023-08-17T00:03:41.567575+0000","last_became_peered":"2023-08-17T00:03:41.567575+0000","last_unstale":"2023-08-17T00:03:41.964305+0000","last_undegraded":"2023-08-17T00:03:41.964305+0000","last_fullsized":"2023-08-17T00:03:41.964305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991314+0000","last_change":"2023-08-17T00:03:41.988220+0000","last_active":"2023-08-17T00:03:41.991314+0000","last_peered":"2023-08-17T00:03:41.991314+0000","last_clean":"2023-08-17T00:03:41.991314+0000","last_became_active":"2023-08-17T00:03:41.987712+0000","last_became_peered":"2023-08-17T00:03:41.987712+0000","last_unstale":"2023-08-17T00:03:41.991314+0000","last_undegraded":"2023-08-17T00:03:41.991314+0000","last_fullsized":"2023-08-17T00:03:41.991314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969144+0000","last_change":"2023-08-17T00:03:41.553589+0000","last_active":"2023-08-17T00:03:41.969144+0000","last_peered":"2023-08-17T00:03:41.969144+0000","last_clean":"2023-08-17T00:03:41.969144+0000","last_became_active":"2023-08-17T00:03:41.553310+0000","last_became_peered":"2023-08-17T00:03:41.553310+0000","last_unstale":"2023-08-17T00:03:41.969144+0000","last_undegraded":"2023-08-17T00:03:41.969144+0000","last_fullsized":"2023-08-17T00:03:41.969144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990705+0000","last_change":"2023-08-17T00:03:41.986682+0000","last_active":"2023-08-17T00:03:41.990705+0000","last_peered":"2023-08-17T00:03:41.990705+0000","last_clean":"2023-08-17T00:03:41.990705+0000","last_became_active":"2023-08-17T00:03:41.986404+0000","last_became_peered":"2023-08-17T00:03:41.986404+0000","last_unstale":"2023-08-17T00:03:41.990705+0000","last_undegraded":"2023-08-17T00:03:41.990705+0000","last_fullsized":"2023-08-17T00:03:41.990705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974063+0000","last_change":"2023-08-17T00:03:41.560529+0000","last_active":"2023-08-17T00:03:41.974063+0000","last_peered":"2023-08-17T00:03:41.974063+0000","last_clean":"2023-08-17T00:03:41.974063+0000","last_became_active":"2023-08-17T00:03:41.560231+0000","last_became_peered":"2023-08-17T00:03:41.560231+0000","last_unstale":"2023-08-17T00:03:41.974063+0000","last_undegraded":"2023-08-17T00:03:41.974063+0000","last_fullsized":"2023-08-17T00:03:41.974063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000023+0000","last_change":"2023-08-17T00:03:41.996066+0000","last_active":"2023-08-17T00:03:42.000023+0000","last_peered":"2023-08-17T00:03:42.000023+0000","last_clean":"2023-08-17T00:03:42.000023+0000","last_became_active":"2023-08-17T00:03:41.995510+0000","last_became_peered":"2023-08-17T00:03:41.995510+0000","last_unstale":"2023-08-17T00:03:42.000023+0000","last_undegraded":"2023-08-17T00:03:42.000023+0000","last_fullsized":"2023-08-17T00:03:42.000023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994218+0000","last_change":"2023-08-17T00:03:41.556436+0000","last_active":"2023-08-17T00:03:41.994218+0000","last_peered":"2023-08-17T00:03:41.994218+0000","last_clean":"2023-08-17T00:03:41.994218+0000","last_became_active":"2023-08-17T00:03:41.555969+0000","last_became_peered":"2023-08-17T00:03:41.555969+0000","last_unstale":"2023-08-17T00:03:41.994218+0000","last_undegraded":"2023-08-17T00:03:41.994218+0000","last_fullsized":"2023-08-17T00:03:41.994218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.003896+0000","last_change":"2023-08-17T00:03:42.002936+0000","last_active":"2023-08-17T00:03:42.003896+0000","last_peered":"2023-08-17T00:03:42.003896+0000","last_clean":"2023-08-17T00:03:42.003896+0000","last_became_active":"2023-08-17T00:03:42.002639+0000","last_became_peered":"2023-08-17T00:03:42.002639+0000","last_unstale":"2023-08-17T00:03:42.003896+0000","last_undegraded":"2023-08-17T00:03:42.003896+0000","last_fullsized":"2023-08-17T00:03:42.003896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993374+0000","last_change":"2023-08-17T00:03:41.561576+0000","last_active":"2023-08-17T00:03:41.993374+0000","last_peered":"2023-08-17T00:03:41.993374+0000","last_clean":"2023-08-17T00:03:41.993374+0000","last_became_active":"2023-08-17T00:03:41.561318+0000","last_became_peered":"2023-08-17T00:03:41.561318+0000","last_unstale":"2023-08-17T00:03:41.993374+0000","last_undegraded":"2023-08-17T00:03:41.993374+0000","last_fullsized":"2023-08-17T00:03:41.993374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.999954+0000","last_change":"2023-08-17T00:03:41.995683+0000","last_active":"2023-08-17T00:03:41.999954+0000","last_peered":"2023-08-17T00:03:41.999954+0000","last_clean":"2023-08-17T00:03:41.999954+0000","last_became_active":"2023-08-17T00:03:41.995418+0000","last_became_peered":"2023-08-17T00:03:41.995418+0000","last_unstale":"2023-08-17T00:03:41.999954+0000","last_undegraded":"2023-08-17T00:03:41.999954+0000","last_fullsized":"2023-08-17T00:03:41.999954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996204+0000","last_change":"2023-08-17T00:03:41.564711+0000","last_active":"2023-08-17T00:03:41.996204+0000","last_peered":"2023-08-17T00:03:41.996204+0000","last_clean":"2023-08-17T00:03:41.996204+0000","last_became_active":"2023-08-17T00:03:41.564208+0000","last_became_peered":"2023-08-17T00:03:41.564208+0000","last_unstale":"2023-08-17T00:03:41.996204+0000","last_undegraded":"2023-08-17T00:03:41.996204+0000","last_fullsized":"2023-08-17T00:03:41.996204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.003881+0000","last_change":"2023-08-17T00:03:42.002911+0000","last_active":"2023-08-17T00:03:42.003881+0000","last_peered":"2023-08-17T00:03:42.003881+0000","last_clean":"2023-08-17T00:03:42.003881+0000","last_became_active":"2023-08-17T00:03:42.002680+0000","last_became_peered":"2023-08-17T00:03:42.002680+0000","last_unstale":"2023-08-17T00:03:42.003881+0000","last_undegraded":"2023-08-17T00:03:42.003881+0000","last_fullsized":"2023-08-17T00:03:42.003881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.971132+0000","last_change":"2023-08-17T00:03:41.562780+0000","last_active":"2023-08-17T00:03:41.971132+0000","last_peered":"2023-08-17T00:03:41.971132+0000","last_clean":"2023-08-17T00:03:41.971132+0000","last_became_active":"2023-08-17T00:03:41.562492+0000","last_became_peered":"2023-08-17T00:03:41.562492+0000","last_unstale":"2023-08-17T00:03:41.971132+0000","last_undegraded":"2023-08-17T00:03:41.971132+0000","last_fullsized":"2023-08-17T00:03:41.971132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.983734+0000","last_change":"2023-08-17T00:03:41.976735+0000","last_active":"2023-08-17T00:03:41.983734+0000","last_peered":"2023-08-17T00:03:41.983734+0000","last_clean":"2023-08-17T00:03:41.983734+0000","last_became_active":"2023-08-17T00:03:41.976462+0000","last_became_peered":"2023-08-17T00:03:41.976462+0000","last_unstale":"2023-08-17T00:03:41.983734+0000","last_undegraded":"2023-08-17T00:03:41.983734+0000","last_fullsized":"2023-08-17T00:03:41.983734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.968974+0000","last_change":"2023-08-17T00:03:41.553587+0000","last_active":"2023-08-17T00:03:41.968974+0000","last_peered":"2023-08-17T00:03:41.968974+0000","last_clean":"2023-08-17T00:03:41.968974+0000","last_became_active":"2023-08-17T00:03:41.553261+0000","last_became_peered":"2023-08-17T00:03:41.553261+0000","last_unstale":"2023-08-17T00:03:41.968974+0000","last_undegraded":"2023-08-17T00:03:41.968974+0000","last_fullsized":"2023-08-17T00:03:41.968974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996079+0000","last_change":"2023-08-17T00:03:41.975217+0000","last_active":"2023-08-17T00:03:41.996079+0000","last_peered":"2023-08-17T00:03:41.996079+0000","last_clean":"2023-08-17T00:03:41.996079+0000","last_became_active":"2023-08-17T00:03:41.974946+0000","last_became_peered":"2023-08-17T00:03:41.974946+0000","last_unstale":"2023-08-17T00:03:41.996079+0000","last_undegraded":"2023-08-17T00:03:41.996079+0000","last_fullsized":"2023-08-17T00:03:41.996079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.975579+0000","last_change":"2023-08-17T00:03:41.558693+0000","last_active":"2023-08-17T00:03:41.975579+0000","last_peered":"2023-08-17T00:03:41.975579+0000","last_clean":"2023-08-17T00:03:41.975579+0000","last_became_active":"2023-08-17T00:03:41.558382+0000","last_became_peered":"2023-08-17T00:03:41.558382+0000","last_unstale":"2023-08-17T00:03:41.975579+0000","last_undegraded":"2023-08-17T00:03:41.975579+0000","last_fullsized":"2023-08-17T00:03:41.975579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002681+0000","last_change":"2023-08-17T00:03:41.999462+0000","last_active":"2023-08-17T00:03:42.002681+0000","last_peered":"2023-08-17T00:03:42.002681+0000","last_clean":"2023-08-17T00:03:42.002681+0000","last_became_active":"2023-08-17T00:03:41.999116+0000","last_became_peered":"2023-08-17T00:03:41.999116+0000","last_unstale":"2023-08-17T00:03:42.002681+0000","last_undegraded":"2023-08-17T00:03:42.002681+0000","last_fullsized":"2023-08-17T00:03:42.002681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965629+0000","last_change":"2023-08-17T00:03:41.546915+0000","last_active":"2023-08-17T00:03:41.965629+0000","last_peered":"2023-08-17T00:03:41.965629+0000","last_clean":"2023-08-17T00:03:41.965629+0000","last_became_active":"2023-08-17T00:03:41.546629+0000","last_became_peered":"2023-08-17T00:03:41.546629+0000","last_unstale":"2023-08-17T00:03:41.965629+0000","last_undegraded":"2023-08-17T00:03:41.965629+0000","last_fullsized":"2023-08-17T00:03:41.965629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994635+0000","last_change":"2023-08-17T00:03:41.986589+0000","last_active":"2023-08-17T00:03:41.994635+0000","last_peered":"2023-08-17T00:03:41.994635+0000","last_clean":"2023-08-17T00:03:41.994635+0000","last_became_active":"2023-08-17T00:03:41.986263+0000","last_became_peered":"2023-08-17T00:03:41.986263+0000","last_unstale":"2023-08-17T00:03:41.994635+0000","last_undegraded":"2023-08-17T00:03:41.994635+0000","last_fullsized":"2023-08-17T00:03:41.994635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974735+0000","last_change":"2023-08-17T00:03:41.547097+0000","last_active":"2023-08-17T00:03:41.974735+0000","last_peered":"2023-08-17T00:03:41.974735+0000","last_clean":"2023-08-17T00:03:41.974735+0000","last_became_active":"2023-08-17T00:03:41.546806+0000","last_became_peered":"2023-08-17T00:03:41.546806+0000","last_unstale":"2023-08-17T00:03:41.974735+0000","last_undegraded":"2023-08-17T00:03:41.974735+0000","last_fullsized":"2023-08-17T00:03:41.974735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989875+0000","last_change":"2023-08-17T00:03:41.985320+0000","last_active":"2023-08-17T00:03:41.989875+0000","last_peered":"2023-08-17T00:03:41.989875+0000","last_clean":"2023-08-17T00:03:41.989875+0000","last_became_active":"2023-08-17T00:03:41.984870+0000","last_became_peered":"2023-08-17T00:03:41.984870+0000","last_unstale":"2023-08-17T00:03:41.989875+0000","last_undegraded":"2023-08-17T00:03:41.989875+0000","last_fullsized":"2023-08-17T00:03:41.989875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967972+0000","last_change":"2023-08-17T00:03:41.551170+0000","last_active":"2023-08-17T00:03:41.967972+0000","last_peered":"2023-08-17T00:03:41.967972+0000","last_clean":"2023-08-17T00:03:41.967972+0000","last_became_active":"2023-08-17T00:03:41.550853+0000","last_became_peered":"2023-08-17T00:03:41.550853+0000","last_unstale":"2023-08-17T00:03:41.967972+0000","last_undegraded":"2023-08-17T00:03:41.967972+0000","last_fullsized":"2023-08-17T00:03:41.967972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002598+0000","last_change":"2023-08-17T00:03:41.997911+0000","last_active":"2023-08-17T00:03:42.002598+0000","last_peered":"2023-08-17T00:03:42.002598+0000","last_clean":"2023-08-17T00:03:42.002598+0000","last_became_active":"2023-08-17T00:03:41.997633+0000","last_became_peered":"2023-08-17T00:03:41.997633+0000","last_unstale":"2023-08-17T00:03:42.002598+0000","last_undegraded":"2023-08-17T00:03:42.002598+0000","last_fullsized":"2023-08-17T00:03:42.002598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974603+0000","last_change":"2023-08-17T00:03:41.561072+0000","last_active":"2023-08-17T00:03:41.974603+0000","last_peered":"2023-08-17T00:03:41.974603+0000","last_clean":"2023-08-17T00:03:41.974603+0000","last_became_active":"2023-08-17T00:03:41.560843+0000","last_became_peered":"2023-08-17T00:03:41.560843+0000","last_unstale":"2023-08-17T00:03:41.974603+0000","last_undegraded":"2023-08-17T00:03:41.974603+0000","last_fullsized":"2023-08-17T00:03:41.974603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000152+0000","last_change":"2023-08-17T00:03:41.988891+0000","last_active":"2023-08-17T00:03:42.000152+0000","last_peered":"2023-08-17T00:03:42.000152+0000","last_clean":"2023-08-17T00:03:42.000152+0000","last_became_active":"2023-08-17T00:03:41.988559+0000","last_became_peered":"2023-08-17T00:03:41.988559+0000","last_unstale":"2023-08-17T00:03:42.000152+0000","last_undegraded":"2023-08-17T00:03:42.000152+0000","last_fullsized":"2023-08-17T00:03:42.000152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000573+0000","last_change":"2023-08-17T00:03:41.555091+0000","last_active":"2023-08-17T00:03:42.000573+0000","last_peered":"2023-08-17T00:03:42.000573+0000","last_clean":"2023-08-17T00:03:42.000573+0000","last_became_active":"2023-08-17T00:03:41.554805+0000","last_became_peered":"2023-08-17T00:03:41.554805+0000","last_unstale":"2023-08-17T00:03:42.000573+0000","last_undegraded":"2023-08-17T00:03:42.000573+0000","last_fullsized":"2023-08-17T00:03:42.000573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989883+0000","last_change":"2023-08-17T00:03:41.983622+0000","last_active":"2023-08-17T00:03:41.989883+0000","last_peered":"2023-08-17T00:03:41.989883+0000","last_clean":"2023-08-17T00:03:41.989883+0000","last_became_active":"2023-08-17T00:03:41.983345+0000","last_became_peered":"2023-08-17T00:03:41.983345+0000","last_unstale":"2023-08-17T00:03:41.989883+0000","last_undegraded":"2023-08-17T00:03:41.989883+0000","last_fullsized":"2023-08-17T00:03:41.989883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993601+0000","last_change":"2023-08-17T00:03:41.569113+0000","last_active":"2023-08-17T00:03:41.993601+0000","last_peered":"2023-08-17T00:03:41.993601+0000","last_clean":"2023-08-17T00:03:41.993601+0000","last_became_active":"2023-08-17T00:03:41.568669+0000","last_became_peered":"2023-08-17T00:03:41.568669+0000","last_unstale":"2023-08-17T00:03:41.993601+0000","last_undegraded":"2023-08-17T00:03:41.993601+0000","last_fullsized":"2023-08-17T00:03:41.993601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000420+0000","last_change":"2023-08-17T00:03:41.996053+0000","last_active":"2023-08-17T00:03:42.000420+0000","last_peered":"2023-08-17T00:03:42.000420+0000","last_clean":"2023-08-17T00:03:42.000420+0000","last_became_active":"2023-08-17T00:03:41.993750+0000","last_became_peered":"2023-08-17T00:03:41.993750+0000","last_unstale":"2023-08-17T00:03:42.000420+0000","last_undegraded":"2023-08-17T00:03:42.000420+0000","last_fullsized":"2023-08-17T00:03:42.000420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991431+0000","last_change":"2023-08-17T00:03:41.564950+0000","last_active":"2023-08-17T00:03:41.991431+0000","last_peered":"2023-08-17T00:03:41.991431+0000","last_clean":"2023-08-17T00:03:41.991431+0000","last_became_active":"2023-08-17T00:03:41.564163+0000","last_became_peered":"2023-08-17T00:03:41.564163+0000","last_unstale":"2023-08-17T00:03:41.991431+0000","last_undegraded":"2023-08-17T00:03:41.991431+0000","last_fullsized":"2023-08-17T00:03:41.991431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997938+0000","last_change":"2023-08-17T00:03:41.993404+0000","last_active":"2023-08-17T00:03:41.997938+0000","last_peered":"2023-08-17T00:03:41.997938+0000","last_clean":"2023-08-17T00:03:41.997938+0000","last_became_active":"2023-08-17T00:03:41.993118+0000","last_became_peered":"2023-08-17T00:03:41.993118+0000","last_unstale":"2023-08-17T00:03:41.997938+0000","last_undegraded":"2023-08-17T00:03:41.997938+0000","last_fullsized":"2023-08-17T00:03:41.997938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.983937+0000","last_change":"2023-08-17T00:03:41.567714+0000","last_active":"2023-08-17T00:03:41.983937+0000","last_peered":"2023-08-17T00:03:41.983937+0000","last_clean":"2023-08-17T00:03:41.983937+0000","last_became_active":"2023-08-17T00:03:41.567405+0000","last_became_peered":"2023-08-17T00:03:41.567405+0000","last_unstale":"2023-08-17T00:03:41.983937+0000","last_undegraded":"2023-08-17T00:03:41.983937+0000","last_fullsized":"2023-08-17T00:03:41.983937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996618+0000","last_change":"2023-08-17T00:03:41.982068+0000","last_active":"2023-08-17T00:03:41.996618+0000","last_peered":"2023-08-17T00:03:41.996618+0000","last_clean":"2023-08-17T00:03:41.996618+0000","last_became_active":"2023-08-17T00:03:41.981751+0000","last_became_peered":"2023-08-17T00:03:41.981751+0000","last_unstale":"2023-08-17T00:03:41.996618+0000","last_undegraded":"2023-08-17T00:03:41.996618+0000","last_fullsized":"2023-08-17T00:03:41.996618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973599+0000","last_change":"2023-08-17T00:03:41.559987+0000","last_active":"2023-08-17T00:03:41.973599+0000","last_peered":"2023-08-17T00:03:41.973599+0000","last_clean":"2023-08-17T00:03:41.973599+0000","last_became_active":"2023-08-17T00:03:41.559738+0000","last_became_peered":"2023-08-17T00:03:41.559738+0000","last_unstale":"2023-08-17T00:03:41.973599+0000","last_undegraded":"2023-08-17T00:03:41.973599+0000","last_fullsized":"2023-08-17T00:03:41.973599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996593+0000","last_change":"2023-08-17T00:03:41.995472+0000","last_active":"2023-08-17T00:03:41.996593+0000","last_peered":"2023-08-17T00:03:41.996593+0000","last_clean":"2023-08-17T00:03:41.996593+0000","last_became_active":"2023-08-17T00:03:41.995004+0000","last_became_peered":"2023-08-17T00:03:41.995004+0000","last_unstale":"2023-08-17T00:03:41.996593+0000","last_undegraded":"2023-08-17T00:03:41.996593+0000","last_fullsized":"2023-08-17T00:03:41.996593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991494+0000","last_change":"2023-08-17T00:03:41.557437+0000","last_active":"2023-08-17T00:03:41.991494+0000","last_peered":"2023-08-17T00:03:41.991494+0000","last_clean":"2023-08-17T00:03:41.991494+0000","last_became_active":"2023-08-17T00:03:41.556865+0000","last_became_peered":"2023-08-17T00:03:41.556865+0000","last_unstale":"2023-08-17T00:03:41.991494+0000","last_undegraded":"2023-08-17T00:03:41.991494+0000","last_fullsized":"2023-08-17T00:03:41.991494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994704+0000","last_change":"2023-08-17T00:03:41.989310+0000","last_active":"2023-08-17T00:03:41.994704+0000","last_peered":"2023-08-17T00:03:41.994704+0000","last_clean":"2023-08-17T00:03:41.994704+0000","last_became_active":"2023-08-17T00:03:41.988949+0000","last_became_peered":"2023-08-17T00:03:41.988949+0000","last_unstale":"2023-08-17T00:03:41.994704+0000","last_undegraded":"2023-08-17T00:03:41.994704+0000","last_fullsized":"2023-08-17T00:03:41.994704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002771+0000","last_change":"2023-08-17T00:03:41.563451+0000","last_active":"2023-08-17T00:03:42.002771+0000","last_peered":"2023-08-17T00:03:42.002771+0000","last_clean":"2023-08-17T00:03:42.002771+0000","last_became_active":"2023-08-17T00:03:41.563133+0000","last_became_peered":"2023-08-17T00:03:41.563133+0000","last_unstale":"2023-08-17T00:03:42.002771+0000","last_undegraded":"2023-08-17T00:03:42.002771+0000","last_fullsized":"2023-08-17T00:03:42.002771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000167+0000","last_change":"2023-08-17T00:03:41.993485+0000","last_active":"2023-08-17T00:03:42.000167+0000","last_peered":"2023-08-17T00:03:42.000167+0000","last_clean":"2023-08-17T00:03:42.000167+0000","last_became_active":"2023-08-17T00:03:41.993163+0000","last_became_peered":"2023-08-17T00:03:41.993163+0000","last_unstale":"2023-08-17T00:03:42.000167+0000","last_undegraded":"2023-08-17T00:03:42.000167+0000","last_fullsized":"2023-08-17T00:03:42.000167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000562+0000","last_change":"2023-08-17T00:03:41.558838+0000","last_active":"2023-08-17T00:03:42.000562+0000","last_peered":"2023-08-17T00:03:42.000562+0000","last_clean":"2023-08-17T00:03:42.000562+0000","last_became_active":"2023-08-17T00:03:41.558549+0000","last_became_peered":"2023-08-17T00:03:41.558549+0000","last_unstale":"2023-08-17T00:03:42.000562+0000","last_undegraded":"2023-08-17T00:03:42.000562+0000","last_fullsized":"2023-08-17T00:03:42.000562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000222+0000","last_change":"2023-08-17T00:03:41.994664+0000","last_active":"2023-08-17T00:03:42.000222+0000","last_peered":"2023-08-17T00:03:42.000222+0000","last_clean":"2023-08-17T00:03:42.000222+0000","last_became_active":"2023-08-17T00:03:41.994406+0000","last_became_peered":"2023-08-17T00:03:41.994406+0000","last_unstale":"2023-08-17T00:03:42.000222+0000","last_undegraded":"2023-08-17T00:03:42.000222+0000","last_fullsized":"2023-08-17T00:03:42.000222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974532+0000","last_change":"2023-08-17T00:03:41.563297+0000","last_active":"2023-08-17T00:03:41.974532+0000","last_peered":"2023-08-17T00:03:41.974532+0000","last_clean":"2023-08-17T00:03:41.974532+0000","last_became_active":"2023-08-17T00:03:41.562989+0000","last_became_peered":"2023-08-17T00:03:41.562989+0000","last_unstale":"2023-08-17T00:03:41.974532+0000","last_undegraded":"2023-08-17T00:03:41.974532+0000","last_fullsized":"2023-08-17T00:03:41.974532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990696+0000","last_change":"2023-08-17T00:03:41.983560+0000","last_active":"2023-08-17T00:03:41.990696+0000","last_peered":"2023-08-17T00:03:41.990696+0000","last_clean":"2023-08-17T00:03:41.990696+0000","last_became_active":"2023-08-17T00:03:41.983292+0000","last_became_peered":"2023-08-17T00:03:41.983292+0000","last_unstale":"2023-08-17T00:03:41.990696+0000","last_undegraded":"2023-08-17T00:03:41.990696+0000","last_fullsized":"2023-08-17T00:03:41.990696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.966657+0000","last_change":"2023-08-17T00:03:41.549432+0000","last_active":"2023-08-17T00:03:41.966657+0000","last_peered":"2023-08-17T00:03:41.966657+0000","last_clean":"2023-08-17T00:03:41.966657+0000","last_became_active":"2023-08-17T00:03:41.549055+0000","last_became_peered":"2023-08-17T00:03:41.549055+0000","last_unstale":"2023-08-17T00:03:41.966657+0000","last_undegraded":"2023-08-17T00:03:41.966657+0000","last_fullsized":"2023-08-17T00:03:41.966657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997806+0000","last_change":"2023-08-17T00:03:41.994496+0000","last_active":"2023-08-17T00:03:41.997806+0000","last_peered":"2023-08-17T00:03:41.997806+0000","last_clean":"2023-08-17T00:03:41.997806+0000","last_became_active":"2023-08-17T00:03:41.994183+0000","last_became_peered":"2023-08-17T00:03:41.994183+0000","last_unstale":"2023-08-17T00:03:41.997806+0000","last_undegraded":"2023-08-17T00:03:41.997806+0000","last_fullsized":"2023-08-17T00:03:41.997806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.988400+0000","last_change":"2023-08-17T00:03:41.551406+0000","last_active":"2023-08-17T00:03:41.988400+0000","last_peered":"2023-08-17T00:03:41.988400+0000","last_clean":"2023-08-17T00:03:41.988400+0000","last_became_active":"2023-08-17T00:03:41.551132+0000","last_became_peered":"2023-08-17T00:03:41.551132+0000","last_unstale":"2023-08-17T00:03:41.988400+0000","last_undegraded":"2023-08-17T00:03:41.988400+0000","last_fullsized":"2023-08-17T00:03:41.988400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000282+0000","last_change":"2023-08-17T00:03:41.989931+0000","last_active":"2023-08-17T00:03:42.000282+0000","last_peered":"2023-08-17T00:03:42.000282+0000","last_clean":"2023-08-17T00:03:42.000282+0000","last_became_active":"2023-08-17T00:03:41.988782+0000","last_became_peered":"2023-08-17T00:03:41.988782+0000","last_unstale":"2023-08-17T00:03:42.000282+0000","last_undegraded":"2023-08-17T00:03:42.000282+0000","last_fullsized":"2023-08-17T00:03:42.000282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.983833+0000","last_change":"2023-08-17T00:03:41.566990+0000","last_active":"2023-08-17T00:03:41.983833+0000","last_peered":"2023-08-17T00:03:41.983833+0000","last_clean":"2023-08-17T00:03:41.983833+0000","last_became_active":"2023-08-17T00:03:41.566391+0000","last_became_peered":"2023-08-17T00:03:41.566391+0000","last_unstale":"2023-08-17T00:03:41.983833+0000","last_undegraded":"2023-08-17T00:03:41.983833+0000","last_fullsized":"2023-08-17T00:03:41.983833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002587+0000","last_change":"2023-08-17T00:03:41.984454+0000","last_active":"2023-08-17T00:03:42.002587+0000","last_peered":"2023-08-17T00:03:42.002587+0000","last_clean":"2023-08-17T00:03:42.002587+0000","last_became_active":"2023-08-17T00:03:41.984143+0000","last_became_peered":"2023-08-17T00:03:41.984143+0000","last_unstale":"2023-08-17T00:03:42.002587+0000","last_undegraded":"2023-08-17T00:03:42.002587+0000","last_fullsized":"2023-08-17T00:03:42.002587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.976225+0000","last_change":"2023-08-17T00:03:41.551235+0000","last_active":"2023-08-17T00:03:41.976225+0000","last_peered":"2023-08-17T00:03:41.976225+0000","last_clean":"2023-08-17T00:03:41.976225+0000","last_became_active":"2023-08-17T00:03:41.550916+0000","last_became_peered":"2023-08-17T00:03:41.550916+0000","last_unstale":"2023-08-17T00:03:41.976225+0000","last_undegraded":"2023-08-17T00:03:41.976225+0000","last_fullsized":"2023-08-17T00:03:41.976225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998235+0000","last_change":"2023-08-17T00:03:41.988833+0000","last_active":"2023-08-17T00:03:41.998235+0000","last_peered":"2023-08-17T00:03:41.998235+0000","last_clean":"2023-08-17T00:03:41.998235+0000","last_became_active":"2023-08-17T00:03:41.988514+0000","last_became_peered":"2023-08-17T00:03:41.988514+0000","last_unstale":"2023-08-17T00:03:41.998235+0000","last_undegraded":"2023-08-17T00:03:41.998235+0000","last_fullsized":"2023-08-17T00:03:41.998235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.984760+0000","last_change":"2023-08-17T00:03:41.559344+0000","last_active":"2023-08-17T00:03:41.984760+0000","last_peered":"2023-08-17T00:03:41.984760+0000","last_clean":"2023-08-17T00:03:41.984760+0000","last_became_active":"2023-08-17T00:03:41.559025+0000","last_became_peered":"2023-08-17T00:03:41.559025+0000","last_unstale":"2023-08-17T00:03:41.984760+0000","last_undegraded":"2023-08-17T00:03:41.984760+0000","last_fullsized":"2023-08-17T00:03:41.984760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996391+0000","last_change":"2023-08-17T00:03:41.980273+0000","last_active":"2023-08-17T00:03:41.996391+0000","last_peered":"2023-08-17T00:03:41.996391+0000","last_clean":"2023-08-17T00:03:41.996391+0000","last_became_active":"2023-08-17T00:03:41.979984+0000","last_became_peered":"2023-08-17T00:03:41.979984+0000","last_unstale":"2023-08-17T00:03:41.996391+0000","last_undegraded":"2023-08-17T00:03:41.996391+0000","last_fullsized":"2023-08-17T00:03:41.996391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969826+0000","last_change":"2023-08-17T00:03:41.560105+0000","last_active":"2023-08-17T00:03:41.969826+0000","last_peered":"2023-08-17T00:03:41.969826+0000","last_clean":"2023-08-17T00:03:41.969826+0000","last_became_active":"2023-08-17T00:03:41.558348+0000","last_became_peered":"2023-08-17T00:03:41.558348+0000","last_unstale":"2023-08-17T00:03:41.969826+0000","last_undegraded":"2023-08-17T00:03:41.969826+0000","last_fullsized":"2023-08-17T00:03:41.969826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.975151+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:03:41.975151+0000","last_peered":"2023-08-17T00:03:41.975151+0000","last_clean":"2023-08-17T00:03:41.975151+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:03:41.975151+0000","last_undegraded":"2023-08-17T00:03:41.975151+0000","last_fullsized":"2023-08-17T00:03:41.975151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.980208+0000","last_change":"2023-08-17T00:03:41.978506+0000","last_active":"2023-08-17T00:03:41.980208+0000","last_peered":"2023-08-17T00:03:41.980208+0000","last_clean":"2023-08-17T00:03:41.980208+0000","last_became_active":"2023-08-17T00:03:41.978223+0000","last_became_peered":"2023-08-17T00:03:41.978223+0000","last_unstale":"2023-08-17T00:03:41.980208+0000","last_undegraded":"2023-08-17T00:03:41.980208+0000","last_fullsized":"2023-08-17T00:03:41.980208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973699+0000","last_change":"2023-08-17T00:03:41.552698+0000","last_active":"2023-08-17T00:03:41.973699+0000","last_peered":"2023-08-17T00:03:41.973699+0000","last_clean":"2023-08-17T00:03:41.973699+0000","last_became_active":"2023-08-17T00:03:41.552211+0000","last_became_peered":"2023-08-17T00:03:41.552211+0000","last_unstale":"2023-08-17T00:03:41.973699+0000","last_undegraded":"2023-08-17T00:03:41.973699+0000","last_fullsized":"2023-08-17T00:03:41.973699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969420+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:03:41.969420+0000","last_peered":"2023-08-17T00:03:41.969420+0000","last_clean":"2023-08-17T00:03:41.969420+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:03:41.969420+0000","last_undegraded":"2023-08-17T00:03:41.969420+0000","last_fullsized":"2023-08-17T00:03:41.969420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997956+0000","last_change":"2023-08-17T00:03:41.993421+0000","last_active":"2023-08-17T00:03:41.997956+0000","last_peered":"2023-08-17T00:03:41.997956+0000","last_clean":"2023-08-17T00:03:41.997956+0000","last_became_active":"2023-08-17T00:03:41.992817+0000","last_became_peered":"2023-08-17T00:03:41.992817+0000","last_unstale":"2023-08-17T00:03:41.997956+0000","last_undegraded":"2023-08-17T00:03:41.997956+0000","last_fullsized":"2023-08-17T00:03:41.997956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.964431+0000","last_change":"2023-08-17T00:03:41.557323+0000","last_active":"2023-08-17T00:03:41.964431+0000","last_peered":"2023-08-17T00:03:41.964431+0000","last_clean":"2023-08-17T00:03:41.964431+0000","last_became_active":"2023-08-17T00:03:41.556980+0000","last_became_peered":"2023-08-17T00:03:41.556980+0000","last_unstale":"2023-08-17T00:03:41.964431+0000","last_undegraded":"2023-08-17T00:03:41.964431+0000","last_fullsized":"2023-08-17T00:03:41.964431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973770+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:03:41.973770+0000","last_peered":"2023-08-17T00:03:41.973770+0000","last_clean":"2023-08-17T00:03:41.973770+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:03:41.973770+0000","last_undegraded":"2023-08-17T00:03:41.973770+0000","last_fullsized":"2023-08-17T00:03:41.973770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.988731+0000","last_change":"2023-08-17T00:03:41.984905+0000","last_active":"2023-08-17T00:03:41.988731+0000","last_peered":"2023-08-17T00:03:41.988731+0000","last_clean":"2023-08-17T00:03:41.988731+0000","last_became_active":"2023-08-17T00:03:41.984602+0000","last_became_peered":"2023-08-17T00:03:41.984602+0000","last_unstale":"2023-08-17T00:03:41.988731+0000","last_undegraded":"2023-08-17T00:03:41.988731+0000","last_fullsized":"2023-08-17T00:03:41.988731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967198+0000","last_change":"2023-08-17T00:03:41.565002+0000","last_active":"2023-08-17T00:03:41.967198+0000","last_peered":"2023-08-17T00:03:41.967198+0000","last_clean":"2023-08-17T00:03:41.967198+0000","last_became_active":"2023-08-17T00:03:41.564541+0000","last_became_peered":"2023-08-17T00:03:41.564541+0000","last_unstale":"2023-08-17T00:03:41.967198+0000","last_undegraded":"2023-08-17T00:03:41.967198+0000","last_fullsized":"2023-08-17T00:03:41.967198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.966761+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:03:41.966761+0000","last_peered":"2023-08-17T00:03:41.966761+0000","last_clean":"2023-08-17T00:03:41.966761+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:03:41.966761+0000","last_undegraded":"2023-08-17T00:03:41.966761+0000","last_fullsized":"2023-08-17T00:03:41.966761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990674+0000","last_change":"2023-08-17T00:03:41.986837+0000","last_active":"2023-08-17T00:03:41.990674+0000","last_peered":"2023-08-17T00:03:41.990674+0000","last_clean":"2023-08-17T00:03:41.990674+0000","last_became_active":"2023-08-17T00:03:41.986540+0000","last_became_peered":"2023-08-17T00:03:41.986540+0000","last_unstale":"2023-08-17T00:03:41.990674+0000","last_undegraded":"2023-08-17T00:03:41.990674+0000","last_fullsized":"2023-08-17T00:03:41.990674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974643+0000","last_change":"2023-08-17T00:03:41.555624+0000","last_active":"2023-08-17T00:03:41.974643+0000","last_peered":"2023-08-17T00:03:41.974643+0000","last_clean":"2023-08-17T00:03:41.974643+0000","last_became_active":"2023-08-17T00:03:41.555292+0000","last_became_peered":"2023-08-17T00:03:41.555292+0000","last_unstale":"2023-08-17T00:03:41.974643+0000","last_undegraded":"2023-08-17T00:03:41.974643+0000","last_fullsized":"2023-08-17T00:03:41.974643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.977133+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:03:41.977133+0000","last_peered":"2023-08-17T00:03:41.977133+0000","last_clean":"2023-08-17T00:03:41.977133+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:03:41.977133+0000","last_undegraded":"2023-08-17T00:03:41.977133+0000","last_fullsized":"2023-08-17T00:03:41.977133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002435+0000","last_change":"2023-08-17T00:03:41.983417+0000","last_active":"2023-08-17T00:03:42.002435+0000","last_peered":"2023-08-17T00:03:42.002435+0000","last_clean":"2023-08-17T00:03:42.002435+0000","last_became_active":"2023-08-17T00:03:41.983138+0000","last_became_peered":"2023-08-17T00:03:41.983138+0000","last_unstale":"2023-08-17T00:03:42.002435+0000","last_undegraded":"2023-08-17T00:03:42.002435+0000","last_fullsized":"2023-08-17T00:03:42.002435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974865+0000","last_change":"2023-08-17T00:03:41.557729+0000","last_active":"2023-08-17T00:03:41.974865+0000","last_peered":"2023-08-17T00:03:41.974865+0000","last_clean":"2023-08-17T00:03:41.974865+0000","last_became_active":"2023-08-17T00:03:41.557339+0000","last_became_peered":"2023-08-17T00:03:41.557339+0000","last_unstale":"2023-08-17T00:03:41.974865+0000","last_undegraded":"2023-08-17T00:03:41.974865+0000","last_fullsized":"2023-08-17T00:03:41.974865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.972677+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:03:41.972677+0000","last_peered":"2023-08-17T00:03:41.972677+0000","last_clean":"2023-08-17T00:03:41.972677+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:03:41.972677+0000","last_undegraded":"2023-08-17T00:03:41.972677+0000","last_fullsized":"2023-08-17T00:03:41.972677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989582+0000","last_change":"2023-08-17T00:03:41.987487+0000","last_active":"2023-08-17T00:03:41.989582+0000","last_peered":"2023-08-17T00:03:41.989582+0000","last_clean":"2023-08-17T00:03:41.989582+0000","last_became_active":"2023-08-17T00:03:41.987077+0000","last_became_peered":"2023-08-17T00:03:41.987077+0000","last_unstale":"2023-08-17T00:03:41.989582+0000","last_undegraded":"2023-08-17T00:03:41.989582+0000","last_fullsized":"2023-08-17T00:03:41.989582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993151+0000","last_change":"2023-08-17T00:03:41.553821+0000","last_active":"2023-08-17T00:03:41.993151+0000","last_peered":"2023-08-17T00:03:41.993151+0000","last_clean":"2023-08-17T00:03:41.993151+0000","last_became_active":"2023-08-17T00:03:41.553555+0000","last_became_peered":"2023-08-17T00:03:41.553555+0000","last_unstale":"2023-08-17T00:03:41.993151+0000","last_undegraded":"2023-08-17T00:03:41.993151+0000","last_fullsized":"2023-08-17T00:03:41.993151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974140+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:03:41.974140+0000","last_peered":"2023-08-17T00:03:41.974140+0000","last_clean":"2023-08-17T00:03:41.974140+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:03:41.974140+0000","last_undegraded":"2023-08-17T00:03:41.974140+0000","last_fullsized":"2023-08-17T00:03:41.974140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998474+0000","last_change":"2023-08-17T00:03:41.992069+0000","last_active":"2023-08-17T00:03:41.998474+0000","last_peered":"2023-08-17T00:03:41.998474+0000","last_clean":"2023-08-17T00:03:41.998474+0000","last_became_active":"2023-08-17T00:03:41.991791+0000","last_became_peered":"2023-08-17T00:03:41.991791+0000","last_unstale":"2023-08-17T00:03:41.998474+0000","last_undegraded":"2023-08-17T00:03:41.998474+0000","last_fullsized":"2023-08-17T00:03:41.998474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965220+0000","last_change":"2023-08-17T00:03:41.568004+0000","last_active":"2023-08-17T00:03:41.965220+0000","last_peered":"2023-08-17T00:03:41.965220+0000","last_clean":"2023-08-17T00:03:41.965220+0000","last_became_active":"2023-08-17T00:03:41.566190+0000","last_became_peered":"2023-08-17T00:03:41.566190+0000","last_unstale":"2023-08-17T00:03:41.965220+0000","last_undegraded":"2023-08-17T00:03:41.965220+0000","last_fullsized":"2023-08-17T00:03:41.965220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973565+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:03:41.973565+0000","last_peered":"2023-08-17T00:03:41.973565+0000","last_clean":"2023-08-17T00:03:41.973565+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:03:41.973565+0000","last_undegraded":"2023-08-17T00:03:41.973565+0000","last_fullsized":"2023-08-17T00:03:41.973565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974812+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:03:41.974812+0000","last_peered":"2023-08-17T00:03:41.974812+0000","last_clean":"2023-08-17T00:03:41.974812+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:03:41.974812+0000","last_undegraded":"2023-08-17T00:03:41.974812+0000","last_fullsized":"2023-08-17T00:03:41.974812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":156590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":150742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":156520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":156610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.51}]},{"osd":2,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.286}]},{"osd":5,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.097},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.6240000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.8640000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.5660000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":157718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":157504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.083},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.167}]},{"osd":5,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.458},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.3740000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.236}]},{"osd":7,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.29},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.329}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":157096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.044},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.3480000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.24},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.278}]},{"osd":6,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.119},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.147}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":150584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:03:46.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:03:46.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.361+0000 7fa7a9547700 1 Processor -- start 2023-08-17T00:03:46.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a9547700 1 -- start start 2023-08-17T00:03:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a9547700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7a40be7e0 0x7fa7a40bebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a9547700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa7a40a8610 0x7fa7a4151370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a9547700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7a40a54a0 con 0x7fa7a40a8aa0 2023-08-17T00:03:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a9547700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40a5780 con 0x7fa7a40be7e0 2023-08-17T00:03:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a9547700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7a40a5a60 con 0x7fa7a40a8610 2023-08-17T00:03:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7a40be7e0 0x7fa7a40bebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7a40be7e0 0x7fa7a40bebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41290/0 (socket says 172.21.15.153:41290) 2023-08-17T00:03:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a3fff700 1 -- 172.21.15.153:0/4291370852 learned_addr learned my addr 172.21.15.153:0/4291370852 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.365+0000 7fa7a37fe700 1 --2- 172.21.15.153:0/4291370852 >> v2:172.21.15.178:3300/0 conn(0x7fa7a40a8610 0x7fa7a4151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a3fff700 1 -- 172.21.15.153:0/4291370852 >> v2:172.21.15.178:3300/0 conn(0x7fa7a40a8610 msgr2=0x7fa7a4151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a3fff700 1 --2- 172.21.15.153:0/4291370852 >> v2:172.21.15.178:3300/0 conn(0x7fa7a40a8610 0x7fa7a4151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a3fff700 1 -- 172.21.15.153:0/4291370852 >> v1:172.21.15.178:6789/0 conn(0x7fa7a40a8aa0 legacy=0x7fa7a40c4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a3fff700 1 -- 172.21.15.153:0/4291370852 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a40a5d40 con 0x7fa7a40be7e0 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a3fff700 1 --2- 172.21.15.153:0/4291370852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a40bebc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fa7a406bc00 tx=0x7fa7940090f0).ready entity=mon.0 client_cookie=6f0fa5a51c4b4c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a2ffd700 1 -- 172.21.15.153:0/4291370852 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400b600 con 0x7fa7a40be7e0 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a2ffd700 1 -- 172.21.15.153:0/4291370852 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79400b760 con 0x7fa7a40be7e0 2023-08-17T00:03:46.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a2ffd700 1 -- 172.21.15.153:0/4291370852 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400bae0 con 0x7fa7a40be7e0 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 -- 172.21.15.153:0/4291370852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 msgr2=0x7fa7a40bebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 --2- 172.21.15.153:0/4291370852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a40bebc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fa7a406bc00 tx=0x7fa7940090f0).stop 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 -- 172.21.15.153:0/4291370852 shutdown_connections 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 --2- 172.21.15.153:0/4291370852 >> v2:172.21.15.178:3300/0 conn(0x7fa7a40a8610 0x7fa7a4151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 --2- 172.21.15.153:0/4291370852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a40bebc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 -- 172.21.15.153:0/4291370852 >> 172.21.15.153:0/4291370852 conn(0x7fa7a40c5170 msgr2=0x7fa7a40c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 -- 172.21.15.153:0/4291370852 shutdown_connections 2023-08-17T00:03:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.369+0000 7fa7a9547700 1 -- 172.21.15.153:0/4291370852 wait complete. 2023-08-17T00:03:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 Processor -- start 2023-08-17T00:03:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 -- start start 2023-08-17T00:03:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7a40a8610 0x7fa7a4159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7a40a8aa0 0x7fa7a4146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a4167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4154f60 con 0x7fa7a40be7e0 2023-08-17T00:03:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4159560 con 0x7fa7a40a8aa0 2023-08-17T00:03:46.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a4154350 con 0x7fa7a40a8610 2023-08-17T00:03:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a4167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a4167710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41296/0 (socket says 172.21.15.153:41296) 2023-08-17T00:03:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 -- 172.21.15.153:0/2564415657 learned_addr learned my addr 172.21.15.153:0/2564415657 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a3fff700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7a40a8610 0x7fa7a4159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a37fe700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7a40a8aa0 0x7fa7a4146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 -- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7a40a8610 msgr2=0x7fa7a4159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7a40a8610 0x7fa7a4159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 -- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7a40a8aa0 msgr2=0x7fa7a4146200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7a40a8aa0 0x7fa7a4146200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 -- 172.21.15.153:0/2564415657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa794009310 con 0x7fa7a40be7e0 2023-08-17T00:03:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a8d46700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a4167710 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa79c00c7c0 tx=0x7fa79c001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00e4a0 con 0x7fa7a40be7e0 2023-08-17T00:03:46.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c00e600 con 0x7fa7a40be7e0 2023-08-17T00:03:46.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c00e980 con 0x7fa7a40be7e0 2023-08-17T00:03:46.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.373+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a4154630 con 0x7fa7a40be7e0 2023-08-17T00:03:46.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.377+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a4154bf0 con 0x7fa7a40be7e0 2023-08-17T00:03:46.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.377+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a4155110 con 0x7fa7a40be7e0 2023-08-17T00:03:46.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.377+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa79c019030 con 0x7fa7a40be7e0 2023-08-17T00:03:46.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.381+0000 7fa78bfff700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa79005a180 0x7fa79005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.381+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa79c0735e0 con 0x7fa7a40be7e0 2023-08-17T00:03:46.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.381+0000 7fa7a3fff700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa79005a180 0x7fa79005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.381+0000 7fa7a3fff700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa79005a180 0x7fa79005c640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa794009130 tx=0x7fa794017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:46.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.385+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa7a4155110 con 0x7fa7a40be7e0 2023-08-17T00:03:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.541+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7a406b4c0 con 0x7fa79005a180 2023-08-17T00:03:46.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.557+0000 7fa78bfff700 1 -- 172.21.15.153:0/2564415657 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344697 (secure 0 0 0) 0x7fa7a406b4c0 con 0x7fa79005a180 2023-08-17T00:03:46.565 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa79005a180 msgr2=0x7fa79005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa79005a180 0x7fa79005c640 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fa794009130 tx=0x7fa794017000).stop 2023-08-17T00:03:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 msgr2=0x7fa7a4167710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a4167710 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa79c00c7c0 tx=0x7fa79c001560).stop 2023-08-17T00:03:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 shutdown_connections 2023-08-17T00:03:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa79005a180 0x7fa79005c640 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7a40be7e0 0x7fa7a4167710 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7a40a8aa0 0x7fa7a4146200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 --2- 172.21.15.153:0/2564415657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7a40a8610 0x7fa7a4159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 >> 172.21.15.153:0/2564415657 conn(0x7fa7a40c5170 msgr2=0x7fa7a4150450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 shutdown_connections 2023-08-17T00:03:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.565+0000 7fa7a9547700 1 -- 172.21.15.153:0/2564415657 wait complete. 2023-08-17T00:03:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:03:46.592 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-08-17T00:03:45.185108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2379784,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":2376704,"kb_avail":752594936,"statfs":{"total":773094113280,"available":770657214464,"internally_reserved":0,"allocated":3088384,"data_stored":1243364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2433744896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4297,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-50,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.267787"},"pg_stats":[{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.985568+0000","last_change":"2023-08-17T00:03:41.981753+0000","last_active":"2023-08-17T00:03:41.985568+0000","last_peered":"2023-08-17T00:03:41.985568+0000","last_clean":"2023-08-17T00:03:41.985568+0000","last_became_active":"2023-08-17T00:03:41.981482+0000","last_became_peered":"2023-08-17T00:03:41.981482+0000","last_unstale":"2023-08-17T00:03:41.985568+0000","last_undegraded":"2023-08-17T00:03:41.985568+0000","last_fullsized":"2023-08-17T00:03:41.985568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.003021+0000","last_change":"2023-08-17T00:03:41.563353+0000","last_active":"2023-08-17T00:03:42.003021+0000","last_peered":"2023-08-17T00:03:42.003021+0000","last_clean":"2023-08-17T00:03:42.003021+0000","last_became_active":"2023-08-17T00:03:41.562996+0000","last_became_peered":"2023-08-17T00:03:41.562996+0000","last_unstale":"2023-08-17T00:03:42.003021+0000","last_undegraded":"2023-08-17T00:03:42.003021+0000","last_fullsized":"2023-08-17T00:03:42.003021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000284+0000","last_change":"2023-08-17T00:03:41.992500+0000","last_active":"2023-08-17T00:03:42.000284+0000","last_peered":"2023-08-17T00:03:42.000284+0000","last_clean":"2023-08-17T00:03:42.000284+0000","last_became_active":"2023-08-17T00:03:41.992159+0000","last_became_peered":"2023-08-17T00:03:41.992159+0000","last_unstale":"2023-08-17T00:03:42.000284+0000","last_undegraded":"2023-08-17T00:03:42.000284+0000","last_fullsized":"2023-08-17T00:03:42.000284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967093+0000","last_change":"2023-08-17T00:03:41.554840+0000","last_active":"2023-08-17T00:03:41.967093+0000","last_peered":"2023-08-17T00:03:41.967093+0000","last_clean":"2023-08-17T00:03:41.967093+0000","last_became_active":"2023-08-17T00:03:41.554467+0000","last_became_peered":"2023-08-17T00:03:41.554467+0000","last_unstale":"2023-08-17T00:03:41.967093+0000","last_undegraded":"2023-08-17T00:03:41.967093+0000","last_fullsized":"2023-08-17T00:03:41.967093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997836+0000","last_change":"2023-08-17T00:03:41.992691+0000","last_active":"2023-08-17T00:03:41.997836+0000","last_peered":"2023-08-17T00:03:41.997836+0000","last_clean":"2023-08-17T00:03:41.997836+0000","last_became_active":"2023-08-17T00:03:41.990566+0000","last_became_peered":"2023-08-17T00:03:41.990566+0000","last_unstale":"2023-08-17T00:03:41.997836+0000","last_undegraded":"2023-08-17T00:03:41.997836+0000","last_fullsized":"2023-08-17T00:03:41.997836+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.979254+0000","last_change":"2023-08-17T00:03:41.556623+0000","last_active":"2023-08-17T00:03:41.979254+0000","last_peered":"2023-08-17T00:03:41.979254+0000","last_clean":"2023-08-17T00:03:41.979254+0000","last_became_active":"2023-08-17T00:03:41.556249+0000","last_became_peered":"2023-08-17T00:03:41.556249+0000","last_unstale":"2023-08-17T00:03:41.979254+0000","last_undegraded":"2023-08-17T00:03:41.979254+0000","last_fullsized":"2023-08-17T00:03:41.979254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.986090+0000","last_change":"2023-08-17T00:03:41.982831+0000","last_active":"2023-08-17T00:03:41.986090+0000","last_peered":"2023-08-17T00:03:41.986090+0000","last_clean":"2023-08-17T00:03:41.986090+0000","last_became_active":"2023-08-17T00:03:41.982555+0000","last_became_peered":"2023-08-17T00:03:41.982555+0000","last_unstale":"2023-08-17T00:03:41.986090+0000","last_undegraded":"2023-08-17T00:03:41.986090+0000","last_fullsized":"2023-08-17T00:03:41.986090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993154+0000","last_change":"2023-08-17T00:03:41.568211+0000","last_active":"2023-08-17T00:03:41.993154+0000","last_peered":"2023-08-17T00:03:41.993154+0000","last_clean":"2023-08-17T00:03:41.993154+0000","last_became_active":"2023-08-17T00:03:41.567928+0000","last_became_peered":"2023-08-17T00:03:41.567928+0000","last_unstale":"2023-08-17T00:03:41.993154+0000","last_undegraded":"2023-08-17T00:03:41.993154+0000","last_fullsized":"2023-08-17T00:03:41.993154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998191+0000","last_change":"2023-08-17T00:03:41.988489+0000","last_active":"2023-08-17T00:03:41.998191+0000","last_peered":"2023-08-17T00:03:41.998191+0000","last_clean":"2023-08-17T00:03:41.998191+0000","last_became_active":"2023-08-17T00:03:41.988063+0000","last_became_peered":"2023-08-17T00:03:41.988063+0000","last_unstale":"2023-08-17T00:03:41.998191+0000","last_undegraded":"2023-08-17T00:03:41.998191+0000","last_fullsized":"2023-08-17T00:03:41.998191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994204+0000","last_change":"2023-08-17T00:03:41.560395+0000","last_active":"2023-08-17T00:03:41.994204+0000","last_peered":"2023-08-17T00:03:41.994204+0000","last_clean":"2023-08-17T00:03:41.994204+0000","last_became_active":"2023-08-17T00:03:41.560084+0000","last_became_peered":"2023-08-17T00:03:41.560084+0000","last_unstale":"2023-08-17T00:03:41.994204+0000","last_undegraded":"2023-08-17T00:03:41.994204+0000","last_fullsized":"2023-08-17T00:03:41.994204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989926+0000","last_change":"2023-08-17T00:03:41.983241+0000","last_active":"2023-08-17T00:03:41.989926+0000","last_peered":"2023-08-17T00:03:41.989926+0000","last_clean":"2023-08-17T00:03:41.989926+0000","last_became_active":"2023-08-17T00:03:41.982939+0000","last_became_peered":"2023-08-17T00:03:41.982939+0000","last_unstale":"2023-08-17T00:03:41.989926+0000","last_undegraded":"2023-08-17T00:03:41.989926+0000","last_fullsized":"2023-08-17T00:03:41.989926+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990936+0000","last_change":"2023-08-17T00:03:41.561397+0000","last_active":"2023-08-17T00:03:41.990936+0000","last_peered":"2023-08-17T00:03:41.990936+0000","last_clean":"2023-08-17T00:03:41.990936+0000","last_became_active":"2023-08-17T00:03:41.560951+0000","last_became_peered":"2023-08-17T00:03:41.560951+0000","last_unstale":"2023-08-17T00:03:41.990936+0000","last_undegraded":"2023-08-17T00:03:41.990936+0000","last_fullsized":"2023-08-17T00:03:41.990936+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994708+0000","last_change":"2023-08-17T00:03:41.989567+0000","last_active":"2023-08-17T00:03:41.994708+0000","last_peered":"2023-08-17T00:03:41.994708+0000","last_clean":"2023-08-17T00:03:41.994708+0000","last_became_active":"2023-08-17T00:03:41.989150+0000","last_became_peered":"2023-08-17T00:03:41.989150+0000","last_unstale":"2023-08-17T00:03:41.994708+0000","last_undegraded":"2023-08-17T00:03:41.994708+0000","last_fullsized":"2023-08-17T00:03:41.994708+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969034+0000","last_change":"2023-08-17T00:03:41.568583+0000","last_active":"2023-08-17T00:03:41.969034+0000","last_peered":"2023-08-17T00:03:41.969034+0000","last_clean":"2023-08-17T00:03:41.969034+0000","last_became_active":"2023-08-17T00:03:41.568317+0000","last_became_peered":"2023-08-17T00:03:41.568317+0000","last_unstale":"2023-08-17T00:03:41.969034+0000","last_undegraded":"2023-08-17T00:03:41.969034+0000","last_fullsized":"2023-08-17T00:03:41.969034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.999081+0000","last_change":"2023-08-17T00:03:41.997358+0000","last_active":"2023-08-17T00:03:41.999081+0000","last_peered":"2023-08-17T00:03:41.999081+0000","last_clean":"2023-08-17T00:03:41.999081+0000","last_became_active":"2023-08-17T00:03:41.997084+0000","last_became_peered":"2023-08-17T00:03:41.997084+0000","last_unstale":"2023-08-17T00:03:41.999081+0000","last_undegraded":"2023-08-17T00:03:41.999081+0000","last_fullsized":"2023-08-17T00:03:41.999081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969254+0000","last_change":"2023-08-17T00:03:41.557613+0000","last_active":"2023-08-17T00:03:41.969254+0000","last_peered":"2023-08-17T00:03:41.969254+0000","last_clean":"2023-08-17T00:03:41.969254+0000","last_became_active":"2023-08-17T00:03:41.557192+0000","last_became_peered":"2023-08-17T00:03:41.557192+0000","last_unstale":"2023-08-17T00:03:41.969254+0000","last_undegraded":"2023-08-17T00:03:41.969254+0000","last_fullsized":"2023-08-17T00:03:41.969254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.995904+0000","last_change":"2023-08-17T00:03:41.994545+0000","last_active":"2023-08-17T00:03:41.995904+0000","last_peered":"2023-08-17T00:03:41.995904+0000","last_clean":"2023-08-17T00:03:41.995904+0000","last_became_active":"2023-08-17T00:03:41.994255+0000","last_became_peered":"2023-08-17T00:03:41.994255+0000","last_unstale":"2023-08-17T00:03:41.995904+0000","last_undegraded":"2023-08-17T00:03:41.995904+0000","last_fullsized":"2023-08-17T00:03:41.995904+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.975256+0000","last_change":"2023-08-17T00:03:41.559108+0000","last_active":"2023-08-17T00:03:41.975256+0000","last_peered":"2023-08-17T00:03:41.975256+0000","last_clean":"2023-08-17T00:03:41.975256+0000","last_became_active":"2023-08-17T00:03:41.558814+0000","last_became_peered":"2023-08-17T00:03:41.558814+0000","last_unstale":"2023-08-17T00:03:41.975256+0000","last_undegraded":"2023-08-17T00:03:41.975256+0000","last_fullsized":"2023-08-17T00:03:41.975256+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002723+0000","last_change":"2023-08-17T00:03:41.988576+0000","last_active":"2023-08-17T00:03:42.002723+0000","last_peered":"2023-08-17T00:03:42.002723+0000","last_clean":"2023-08-17T00:03:42.002723+0000","last_became_active":"2023-08-17T00:03:41.988283+0000","last_became_peered":"2023-08-17T00:03:41.988283+0000","last_unstale":"2023-08-17T00:03:42.002723+0000","last_undegraded":"2023-08-17T00:03:42.002723+0000","last_fullsized":"2023-08-17T00:03:42.002723+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969285+0000","last_change":"2023-08-17T00:03:41.553597+0000","last_active":"2023-08-17T00:03:41.969285+0000","last_peered":"2023-08-17T00:03:41.969285+0000","last_clean":"2023-08-17T00:03:41.969285+0000","last_became_active":"2023-08-17T00:03:41.553176+0000","last_became_peered":"2023-08-17T00:03:41.553176+0000","last_unstale":"2023-08-17T00:03:41.969285+0000","last_undegraded":"2023-08-17T00:03:41.969285+0000","last_fullsized":"2023-08-17T00:03:41.969285+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990052+0000","last_change":"2023-08-17T00:03:41.985305+0000","last_active":"2023-08-17T00:03:41.990052+0000","last_peered":"2023-08-17T00:03:41.990052+0000","last_clean":"2023-08-17T00:03:41.990052+0000","last_became_active":"2023-08-17T00:03:41.984998+0000","last_became_peered":"2023-08-17T00:03:41.984998+0000","last_unstale":"2023-08-17T00:03:41.990052+0000","last_undegraded":"2023-08-17T00:03:41.990052+0000","last_fullsized":"2023-08-17T00:03:41.990052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973700+0000","last_change":"2023-08-17T00:03:41.554975+0000","last_active":"2023-08-17T00:03:41.973700+0000","last_peered":"2023-08-17T00:03:41.973700+0000","last_clean":"2023-08-17T00:03:41.973700+0000","last_became_active":"2023-08-17T00:03:41.554709+0000","last_became_peered":"2023-08-17T00:03:41.554709+0000","last_unstale":"2023-08-17T00:03:41.973700+0000","last_undegraded":"2023-08-17T00:03:41.973700+0000","last_fullsized":"2023-08-17T00:03:41.973700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994960+0000","last_change":"2023-08-17T00:03:41.992227+0000","last_active":"2023-08-17T00:03:41.994960+0000","last_peered":"2023-08-17T00:03:41.994960+0000","last_clean":"2023-08-17T00:03:41.994960+0000","last_became_active":"2023-08-17T00:03:41.991945+0000","last_became_peered":"2023-08-17T00:03:41.991945+0000","last_unstale":"2023-08-17T00:03:41.994960+0000","last_undegraded":"2023-08-17T00:03:41.994960+0000","last_fullsized":"2023-08-17T00:03:41.994960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002384+0000","last_change":"2023-08-17T00:03:41.564247+0000","last_active":"2023-08-17T00:03:42.002384+0000","last_peered":"2023-08-17T00:03:42.002384+0000","last_clean":"2023-08-17T00:03:42.002384+0000","last_became_active":"2023-08-17T00:03:41.563939+0000","last_became_peered":"2023-08-17T00:03:41.563939+0000","last_unstale":"2023-08-17T00:03:42.002384+0000","last_undegraded":"2023-08-17T00:03:42.002384+0000","last_fullsized":"2023-08-17T00:03:42.002384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000196+0000","last_change":"2023-08-17T00:03:41.993086+0000","last_active":"2023-08-17T00:03:42.000196+0000","last_peered":"2023-08-17T00:03:42.000196+0000","last_clean":"2023-08-17T00:03:42.000196+0000","last_became_active":"2023-08-17T00:03:41.992645+0000","last_became_peered":"2023-08-17T00:03:41.992645+0000","last_unstale":"2023-08-17T00:03:42.000196+0000","last_undegraded":"2023-08-17T00:03:42.000196+0000","last_fullsized":"2023-08-17T00:03:42.000196+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000546+0000","last_change":"2023-08-17T00:03:41.565498+0000","last_active":"2023-08-17T00:03:42.000546+0000","last_peered":"2023-08-17T00:03:42.000546+0000","last_clean":"2023-08-17T00:03:42.000546+0000","last_became_active":"2023-08-17T00:03:41.565171+0000","last_became_peered":"2023-08-17T00:03:41.565171+0000","last_unstale":"2023-08-17T00:03:42.000546+0000","last_undegraded":"2023-08-17T00:03:42.000546+0000","last_fullsized":"2023-08-17T00:03:42.000546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.999898+0000","last_change":"2023-08-17T00:03:41.995000+0000","last_active":"2023-08-17T00:03:41.999898+0000","last_peered":"2023-08-17T00:03:41.999898+0000","last_clean":"2023-08-17T00:03:41.999898+0000","last_became_active":"2023-08-17T00:03:41.994698+0000","last_became_peered":"2023-08-17T00:03:41.994698+0000","last_unstale":"2023-08-17T00:03:41.999898+0000","last_undegraded":"2023-08-17T00:03:41.999898+0000","last_fullsized":"2023-08-17T00:03:41.999898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.966414+0000","last_change":"2023-08-17T00:03:41.551051+0000","last_active":"2023-08-17T00:03:41.966414+0000","last_peered":"2023-08-17T00:03:41.966414+0000","last_clean":"2023-08-17T00:03:41.966414+0000","last_became_active":"2023-08-17T00:03:41.550755+0000","last_became_peered":"2023-08-17T00:03:41.550755+0000","last_unstale":"2023-08-17T00:03:41.966414+0000","last_undegraded":"2023-08-17T00:03:41.966414+0000","last_fullsized":"2023-08-17T00:03:41.966414+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994308+0000","last_change":"2023-08-17T00:03:41.988523+0000","last_active":"2023-08-17T00:03:41.994308+0000","last_peered":"2023-08-17T00:03:41.994308+0000","last_clean":"2023-08-17T00:03:41.994308+0000","last_became_active":"2023-08-17T00:03:41.988274+0000","last_became_peered":"2023-08-17T00:03:41.988274+0000","last_unstale":"2023-08-17T00:03:41.994308+0000","last_undegraded":"2023-08-17T00:03:41.994308+0000","last_fullsized":"2023-08-17T00:03:41.994308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965380+0000","last_change":"2023-08-17T00:03:41.557906+0000","last_active":"2023-08-17T00:03:41.965380+0000","last_peered":"2023-08-17T00:03:41.965380+0000","last_clean":"2023-08-17T00:03:41.965380+0000","last_became_active":"2023-08-17T00:03:41.557623+0000","last_became_peered":"2023-08-17T00:03:41.557623+0000","last_unstale":"2023-08-17T00:03:41.965380+0000","last_undegraded":"2023-08-17T00:03:41.965380+0000","last_fullsized":"2023-08-17T00:03:41.965380+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000423+0000","last_change":"2023-08-17T00:03:41.996306+0000","last_active":"2023-08-17T00:03:42.000423+0000","last_peered":"2023-08-17T00:03:42.000423+0000","last_clean":"2023-08-17T00:03:42.000423+0000","last_became_active":"2023-08-17T00:03:41.996017+0000","last_became_peered":"2023-08-17T00:03:41.996017+0000","last_unstale":"2023-08-17T00:03:42.000423+0000","last_undegraded":"2023-08-17T00:03:42.000423+0000","last_fullsized":"2023-08-17T00:03:42.000423+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.30","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996292+0000","last_change":"2023-08-17T00:03:41.558007+0000","last_active":"2023-08-17T00:03:41.996292+0000","last_peered":"2023-08-17T00:03:41.996292+0000","last_clean":"2023-08-17T00:03:41.996292+0000","last_became_active":"2023-08-17T00:03:41.556901+0000","last_became_peered":"2023-08-17T00:03:41.556901+0000","last_unstale":"2023-08-17T00:03:41.996292+0000","last_undegraded":"2023-08-17T00:03:41.996292+0000","last_fullsized":"2023-08-17T00:03:41.996292+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996190+0000","last_change":"2023-08-17T00:03:41.980427+0000","last_active":"2023-08-17T00:03:41.996190+0000","last_peered":"2023-08-17T00:03:41.996190+0000","last_clean":"2023-08-17T00:03:41.996190+0000","last_became_active":"2023-08-17T00:03:41.980144+0000","last_became_peered":"2023-08-17T00:03:41.980144+0000","last_unstale":"2023-08-17T00:03:41.996190+0000","last_undegraded":"2023-08-17T00:03:41.996190+0000","last_fullsized":"2023-08-17T00:03:41.996190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974962+0000","last_change":"2023-08-17T00:03:41.564455+0000","last_active":"2023-08-17T00:03:41.974962+0000","last_peered":"2023-08-17T00:03:41.974962+0000","last_clean":"2023-08-17T00:03:41.974962+0000","last_became_active":"2023-08-17T00:03:41.563673+0000","last_became_peered":"2023-08-17T00:03:41.563673+0000","last_unstale":"2023-08-17T00:03:41.974962+0000","last_undegraded":"2023-08-17T00:03:41.974962+0000","last_fullsized":"2023-08-17T00:03:41.974962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990749+0000","last_change":"2023-08-17T00:03:41.982961+0000","last_active":"2023-08-17T00:03:41.990749+0000","last_peered":"2023-08-17T00:03:41.990749+0000","last_clean":"2023-08-17T00:03:41.990749+0000","last_became_active":"2023-08-17T00:03:41.982684+0000","last_became_peered":"2023-08-17T00:03:41.982684+0000","last_unstale":"2023-08-17T00:03:41.990749+0000","last_undegraded":"2023-08-17T00:03:41.990749+0000","last_fullsized":"2023-08-17T00:03:41.990749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974768+0000","last_change":"2023-08-17T00:03:41.560281+0000","last_active":"2023-08-17T00:03:41.974768+0000","last_peered":"2023-08-17T00:03:41.974768+0000","last_clean":"2023-08-17T00:03:41.974768+0000","last_became_active":"2023-08-17T00:03:41.559965+0000","last_became_peered":"2023-08-17T00:03:41.559965+0000","last_unstale":"2023-08-17T00:03:41.974768+0000","last_undegraded":"2023-08-17T00:03:41.974768+0000","last_fullsized":"2023-08-17T00:03:41.974768+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002749+0000","last_change":"2023-08-17T00:03:41.998083+0000","last_active":"2023-08-17T00:03:42.002749+0000","last_peered":"2023-08-17T00:03:42.002749+0000","last_clean":"2023-08-17T00:03:42.002749+0000","last_became_active":"2023-08-17T00:03:41.996727+0000","last_became_peered":"2023-08-17T00:03:41.996727+0000","last_unstale":"2023-08-17T00:03:42.002749+0000","last_undegraded":"2023-08-17T00:03:42.002749+0000","last_fullsized":"2023-08-17T00:03:42.002749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990413+0000","last_change":"2023-08-17T00:03:41.550679+0000","last_active":"2023-08-17T00:03:41.990413+0000","last_peered":"2023-08-17T00:03:41.990413+0000","last_clean":"2023-08-17T00:03:41.990413+0000","last_became_active":"2023-08-17T00:03:41.550368+0000","last_became_peered":"2023-08-17T00:03:41.550368+0000","last_unstale":"2023-08-17T00:03:41.990413+0000","last_undegraded":"2023-08-17T00:03:41.990413+0000","last_fullsized":"2023-08-17T00:03:41.990413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002754+0000","last_change":"2023-08-17T00:03:41.997234+0000","last_active":"2023-08-17T00:03:42.002754+0000","last_peered":"2023-08-17T00:03:42.002754+0000","last_clean":"2023-08-17T00:03:42.002754+0000","last_became_active":"2023-08-17T00:03:41.996987+0000","last_became_peered":"2023-08-17T00:03:41.996987+0000","last_unstale":"2023-08-17T00:03:42.002754+0000","last_undegraded":"2023-08-17T00:03:42.002754+0000","last_fullsized":"2023-08-17T00:03:42.002754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.984057+0000","last_change":"2023-08-17T00:03:41.566895+0000","last_active":"2023-08-17T00:03:41.984057+0000","last_peered":"2023-08-17T00:03:41.984057+0000","last_clean":"2023-08-17T00:03:41.984057+0000","last_became_active":"2023-08-17T00:03:41.566428+0000","last_became_peered":"2023-08-17T00:03:41.566428+0000","last_unstale":"2023-08-17T00:03:41.984057+0000","last_undegraded":"2023-08-17T00:03:41.984057+0000","last_fullsized":"2023-08-17T00:03:41.984057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000459+0000","last_change":"2023-08-17T00:03:41.996066+0000","last_active":"2023-08-17T00:03:42.000459+0000","last_peered":"2023-08-17T00:03:42.000459+0000","last_clean":"2023-08-17T00:03:42.000459+0000","last_became_active":"2023-08-17T00:03:41.994156+0000","last_became_peered":"2023-08-17T00:03:41.994156+0000","last_unstale":"2023-08-17T00:03:42.000459+0000","last_undegraded":"2023-08-17T00:03:42.000459+0000","last_fullsized":"2023-08-17T00:03:42.000459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996412+0000","last_change":"2023-08-17T00:03:41.568069+0000","last_active":"2023-08-17T00:03:41.996412+0000","last_peered":"2023-08-17T00:03:41.996412+0000","last_clean":"2023-08-17T00:03:41.996412+0000","last_became_active":"2023-08-17T00:03:41.567712+0000","last_became_peered":"2023-08-17T00:03:41.567712+0000","last_unstale":"2023-08-17T00:03:41.996412+0000","last_undegraded":"2023-08-17T00:03:41.996412+0000","last_fullsized":"2023-08-17T00:03:41.996412+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991805+0000","last_change":"2023-08-17T00:03:41.989621+0000","last_active":"2023-08-17T00:03:41.991805+0000","last_peered":"2023-08-17T00:03:41.991805+0000","last_clean":"2023-08-17T00:03:41.991805+0000","last_became_active":"2023-08-17T00:03:41.986609+0000","last_became_peered":"2023-08-17T00:03:41.986609+0000","last_unstale":"2023-08-17T00:03:41.991805+0000","last_undegraded":"2023-08-17T00:03:41.991805+0000","last_fullsized":"2023-08-17T00:03:41.991805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969061+0000","last_change":"2023-08-17T00:03:41.558248+0000","last_active":"2023-08-17T00:03:41.969061+0000","last_peered":"2023-08-17T00:03:41.969061+0000","last_clean":"2023-08-17T00:03:41.969061+0000","last_became_active":"2023-08-17T00:03:41.557994+0000","last_became_peered":"2023-08-17T00:03:41.557994+0000","last_unstale":"2023-08-17T00:03:41.969061+0000","last_undegraded":"2023-08-17T00:03:41.969061+0000","last_fullsized":"2023-08-17T00:03:41.969061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002605+0000","last_change":"2023-08-17T00:03:41.993920+0000","last_active":"2023-08-17T00:03:42.002605+0000","last_peered":"2023-08-17T00:03:42.002605+0000","last_clean":"2023-08-17T00:03:42.002605+0000","last_became_active":"2023-08-17T00:03:41.993561+0000","last_became_peered":"2023-08-17T00:03:41.993561+0000","last_unstale":"2023-08-17T00:03:42.002605+0000","last_undegraded":"2023-08-17T00:03:42.002605+0000","last_fullsized":"2023-08-17T00:03:42.002605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.984051+0000","last_change":"2023-08-17T00:03:41.568033+0000","last_active":"2023-08-17T00:03:41.984051+0000","last_peered":"2023-08-17T00:03:41.984051+0000","last_clean":"2023-08-17T00:03:41.984051+0000","last_became_active":"2023-08-17T00:03:41.567761+0000","last_became_peered":"2023-08-17T00:03:41.567761+0000","last_unstale":"2023-08-17T00:03:41.984051+0000","last_undegraded":"2023-08-17T00:03:41.984051+0000","last_fullsized":"2023-08-17T00:03:41.984051+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996373+0000","last_change":"2023-08-17T00:03:41.978906+0000","last_active":"2023-08-17T00:03:41.996373+0000","last_peered":"2023-08-17T00:03:41.996373+0000","last_clean":"2023-08-17T00:03:41.996373+0000","last_became_active":"2023-08-17T00:03:41.978633+0000","last_became_peered":"2023-08-17T00:03:41.978633+0000","last_unstale":"2023-08-17T00:03:41.996373+0000","last_undegraded":"2023-08-17T00:03:41.996373+0000","last_fullsized":"2023-08-17T00:03:41.996373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969018+0000","last_change":"2023-08-17T00:03:41.563741+0000","last_active":"2023-08-17T00:03:41.969018+0000","last_peered":"2023-08-17T00:03:41.969018+0000","last_clean":"2023-08-17T00:03:41.969018+0000","last_became_active":"2023-08-17T00:03:41.561844+0000","last_became_peered":"2023-08-17T00:03:41.561844+0000","last_unstale":"2023-08-17T00:03:41.969018+0000","last_undegraded":"2023-08-17T00:03:41.969018+0000","last_fullsized":"2023-08-17T00:03:41.969018+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000271+0000","last_change":"2023-08-17T00:03:41.992848+0000","last_active":"2023-08-17T00:03:42.000271+0000","last_peered":"2023-08-17T00:03:42.000271+0000","last_clean":"2023-08-17T00:03:42.000271+0000","last_became_active":"2023-08-17T00:03:41.992493+0000","last_became_peered":"2023-08-17T00:03:41.992493+0000","last_unstale":"2023-08-17T00:03:42.000271+0000","last_undegraded":"2023-08-17T00:03:42.000271+0000","last_fullsized":"2023-08-17T00:03:42.000271+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965986+0000","last_change":"2023-08-17T00:03:41.563204+0000","last_active":"2023-08-17T00:03:41.965986+0000","last_peered":"2023-08-17T00:03:41.965986+0000","last_clean":"2023-08-17T00:03:41.965986+0000","last_became_active":"2023-08-17T00:03:41.562920+0000","last_became_peered":"2023-08-17T00:03:41.562920+0000","last_unstale":"2023-08-17T00:03:41.965986+0000","last_undegraded":"2023-08-17T00:03:41.965986+0000","last_fullsized":"2023-08-17T00:03:41.965986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996431+0000","last_change":"2023-08-17T00:03:41.979831+0000","last_active":"2023-08-17T00:03:41.996431+0000","last_peered":"2023-08-17T00:03:41.996431+0000","last_clean":"2023-08-17T00:03:41.996431+0000","last_became_active":"2023-08-17T00:03:41.979571+0000","last_became_peered":"2023-08-17T00:03:41.979571+0000","last_unstale":"2023-08-17T00:03:41.996431+0000","last_undegraded":"2023-08-17T00:03:41.996431+0000","last_fullsized":"2023-08-17T00:03:41.996431+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969295+0000","last_change":"2023-08-17T00:03:41.560641+0000","last_active":"2023-08-17T00:03:41.969295+0000","last_peered":"2023-08-17T00:03:41.969295+0000","last_clean":"2023-08-17T00:03:41.969295+0000","last_became_active":"2023-08-17T00:03:41.560350+0000","last_became_peered":"2023-08-17T00:03:41.560350+0000","last_unstale":"2023-08-17T00:03:41.969295+0000","last_undegraded":"2023-08-17T00:03:41.969295+0000","last_fullsized":"2023-08-17T00:03:41.969295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.985508+0000","last_change":"2023-08-17T00:03:41.977231+0000","last_active":"2023-08-17T00:03:41.985508+0000","last_peered":"2023-08-17T00:03:41.985508+0000","last_clean":"2023-08-17T00:03:41.985508+0000","last_became_active":"2023-08-17T00:03:41.976965+0000","last_became_peered":"2023-08-17T00:03:41.976965+0000","last_unstale":"2023-08-17T00:03:41.985508+0000","last_undegraded":"2023-08-17T00:03:41.985508+0000","last_fullsized":"2023-08-17T00:03:41.985508+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967394+0000","last_change":"2023-08-17T00:03:41.564756+0000","last_active":"2023-08-17T00:03:41.967394+0000","last_peered":"2023-08-17T00:03:41.967394+0000","last_clean":"2023-08-17T00:03:41.967394+0000","last_became_active":"2023-08-17T00:03:41.564476+0000","last_became_peered":"2023-08-17T00:03:41.564476+0000","last_unstale":"2023-08-17T00:03:41.967394+0000","last_undegraded":"2023-08-17T00:03:41.967394+0000","last_fullsized":"2023-08-17T00:03:41.967394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002612+0000","last_change":"2023-08-17T00:03:41.994714+0000","last_active":"2023-08-17T00:03:42.002612+0000","last_peered":"2023-08-17T00:03:42.002612+0000","last_clean":"2023-08-17T00:03:42.002612+0000","last_became_active":"2023-08-17T00:03:41.994201+0000","last_became_peered":"2023-08-17T00:03:41.994201+0000","last_unstale":"2023-08-17T00:03:42.002612+0000","last_undegraded":"2023-08-17T00:03:42.002612+0000","last_fullsized":"2023-08-17T00:03:42.002612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.971034+0000","last_change":"2023-08-17T00:03:41.562755+0000","last_active":"2023-08-17T00:03:41.971034+0000","last_peered":"2023-08-17T00:03:41.971034+0000","last_clean":"2023-08-17T00:03:41.971034+0000","last_became_active":"2023-08-17T00:03:41.562429+0000","last_became_peered":"2023-08-17T00:03:41.562429+0000","last_unstale":"2023-08-17T00:03:41.971034+0000","last_undegraded":"2023-08-17T00:03:41.971034+0000","last_fullsized":"2023-08-17T00:03:41.971034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998170+0000","last_change":"2023-08-17T00:03:41.988455+0000","last_active":"2023-08-17T00:03:41.998170+0000","last_peered":"2023-08-17T00:03:41.998170+0000","last_clean":"2023-08-17T00:03:41.998170+0000","last_became_active":"2023-08-17T00:03:41.987892+0000","last_became_peered":"2023-08-17T00:03:41.987892+0000","last_unstale":"2023-08-17T00:03:41.998170+0000","last_undegraded":"2023-08-17T00:03:41.998170+0000","last_fullsized":"2023-08-17T00:03:41.998170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.964692+0000","last_change":"2023-08-17T00:03:41.559744+0000","last_active":"2023-08-17T00:03:41.964692+0000","last_peered":"2023-08-17T00:03:41.964692+0000","last_clean":"2023-08-17T00:03:41.964692+0000","last_became_active":"2023-08-17T00:03:41.559432+0000","last_became_peered":"2023-08-17T00:03:41.559432+0000","last_unstale":"2023-08-17T00:03:41.964692+0000","last_undegraded":"2023-08-17T00:03:41.964692+0000","last_fullsized":"2023-08-17T00:03:41.964692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000250+0000","last_change":"2023-08-17T00:03:41.995383+0000","last_active":"2023-08-17T00:03:42.000250+0000","last_peered":"2023-08-17T00:03:42.000250+0000","last_clean":"2023-08-17T00:03:42.000250+0000","last_became_active":"2023-08-17T00:03:41.995069+0000","last_became_peered":"2023-08-17T00:03:41.995069+0000","last_unstale":"2023-08-17T00:03:42.000250+0000","last_undegraded":"2023-08-17T00:03:42.000250+0000","last_fullsized":"2023-08-17T00:03:42.000250+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.964305+0000","last_change":"2023-08-17T00:03:41.567896+0000","last_active":"2023-08-17T00:03:41.964305+0000","last_peered":"2023-08-17T00:03:41.964305+0000","last_clean":"2023-08-17T00:03:41.964305+0000","last_became_active":"2023-08-17T00:03:41.567575+0000","last_became_peered":"2023-08-17T00:03:41.567575+0000","last_unstale":"2023-08-17T00:03:41.964305+0000","last_undegraded":"2023-08-17T00:03:41.964305+0000","last_fullsized":"2023-08-17T00:03:41.964305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991314+0000","last_change":"2023-08-17T00:03:41.988220+0000","last_active":"2023-08-17T00:03:41.991314+0000","last_peered":"2023-08-17T00:03:41.991314+0000","last_clean":"2023-08-17T00:03:41.991314+0000","last_became_active":"2023-08-17T00:03:41.987712+0000","last_became_peered":"2023-08-17T00:03:41.987712+0000","last_unstale":"2023-08-17T00:03:41.991314+0000","last_undegraded":"2023-08-17T00:03:41.991314+0000","last_fullsized":"2023-08-17T00:03:41.991314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969144+0000","last_change":"2023-08-17T00:03:41.553589+0000","last_active":"2023-08-17T00:03:41.969144+0000","last_peered":"2023-08-17T00:03:41.969144+0000","last_clean":"2023-08-17T00:03:41.969144+0000","last_became_active":"2023-08-17T00:03:41.553310+0000","last_became_peered":"2023-08-17T00:03:41.553310+0000","last_unstale":"2023-08-17T00:03:41.969144+0000","last_undegraded":"2023-08-17T00:03:41.969144+0000","last_fullsized":"2023-08-17T00:03:41.969144+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990705+0000","last_change":"2023-08-17T00:03:41.986682+0000","last_active":"2023-08-17T00:03:41.990705+0000","last_peered":"2023-08-17T00:03:41.990705+0000","last_clean":"2023-08-17T00:03:41.990705+0000","last_became_active":"2023-08-17T00:03:41.986404+0000","last_became_peered":"2023-08-17T00:03:41.986404+0000","last_unstale":"2023-08-17T00:03:41.990705+0000","last_undegraded":"2023-08-17T00:03:41.990705+0000","last_fullsized":"2023-08-17T00:03:41.990705+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974063+0000","last_change":"2023-08-17T00:03:41.560529+0000","last_active":"2023-08-17T00:03:41.974063+0000","last_peered":"2023-08-17T00:03:41.974063+0000","last_clean":"2023-08-17T00:03:41.974063+0000","last_became_active":"2023-08-17T00:03:41.560231+0000","last_became_peered":"2023-08-17T00:03:41.560231+0000","last_unstale":"2023-08-17T00:03:41.974063+0000","last_undegraded":"2023-08-17T00:03:41.974063+0000","last_fullsized":"2023-08-17T00:03:41.974063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000023+0000","last_change":"2023-08-17T00:03:41.996066+0000","last_active":"2023-08-17T00:03:42.000023+0000","last_peered":"2023-08-17T00:03:42.000023+0000","last_clean":"2023-08-17T00:03:42.000023+0000","last_became_active":"2023-08-17T00:03:41.995510+0000","last_became_peered":"2023-08-17T00:03:41.995510+0000","last_unstale":"2023-08-17T00:03:42.000023+0000","last_undegraded":"2023-08-17T00:03:42.000023+0000","last_fullsized":"2023-08-17T00:03:42.000023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994218+0000","last_change":"2023-08-17T00:03:41.556436+0000","last_active":"2023-08-17T00:03:41.994218+0000","last_peered":"2023-08-17T00:03:41.994218+0000","last_clean":"2023-08-17T00:03:41.994218+0000","last_became_active":"2023-08-17T00:03:41.555969+0000","last_became_peered":"2023-08-17T00:03:41.555969+0000","last_unstale":"2023-08-17T00:03:41.994218+0000","last_undegraded":"2023-08-17T00:03:41.994218+0000","last_fullsized":"2023-08-17T00:03:41.994218+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.003896+0000","last_change":"2023-08-17T00:03:42.002936+0000","last_active":"2023-08-17T00:03:42.003896+0000","last_peered":"2023-08-17T00:03:42.003896+0000","last_clean":"2023-08-17T00:03:42.003896+0000","last_became_active":"2023-08-17T00:03:42.002639+0000","last_became_peered":"2023-08-17T00:03:42.002639+0000","last_unstale":"2023-08-17T00:03:42.003896+0000","last_undegraded":"2023-08-17T00:03:42.003896+0000","last_fullsized":"2023-08-17T00:03:42.003896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993374+0000","last_change":"2023-08-17T00:03:41.561576+0000","last_active":"2023-08-17T00:03:41.993374+0000","last_peered":"2023-08-17T00:03:41.993374+0000","last_clean":"2023-08-17T00:03:41.993374+0000","last_became_active":"2023-08-17T00:03:41.561318+0000","last_became_peered":"2023-08-17T00:03:41.561318+0000","last_unstale":"2023-08-17T00:03:41.993374+0000","last_undegraded":"2023-08-17T00:03:41.993374+0000","last_fullsized":"2023-08-17T00:03:41.993374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.999954+0000","last_change":"2023-08-17T00:03:41.995683+0000","last_active":"2023-08-17T00:03:41.999954+0000","last_peered":"2023-08-17T00:03:41.999954+0000","last_clean":"2023-08-17T00:03:41.999954+0000","last_became_active":"2023-08-17T00:03:41.995418+0000","last_became_peered":"2023-08-17T00:03:41.995418+0000","last_unstale":"2023-08-17T00:03:41.999954+0000","last_undegraded":"2023-08-17T00:03:41.999954+0000","last_fullsized":"2023-08-17T00:03:41.999954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996204+0000","last_change":"2023-08-17T00:03:41.564711+0000","last_active":"2023-08-17T00:03:41.996204+0000","last_peered":"2023-08-17T00:03:41.996204+0000","last_clean":"2023-08-17T00:03:41.996204+0000","last_became_active":"2023-08-17T00:03:41.564208+0000","last_became_peered":"2023-08-17T00:03:41.564208+0000","last_unstale":"2023-08-17T00:03:41.996204+0000","last_undegraded":"2023-08-17T00:03:41.996204+0000","last_fullsized":"2023-08-17T00:03:41.996204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.003881+0000","last_change":"2023-08-17T00:03:42.002911+0000","last_active":"2023-08-17T00:03:42.003881+0000","last_peered":"2023-08-17T00:03:42.003881+0000","last_clean":"2023-08-17T00:03:42.003881+0000","last_became_active":"2023-08-17T00:03:42.002680+0000","last_became_peered":"2023-08-17T00:03:42.002680+0000","last_unstale":"2023-08-17T00:03:42.003881+0000","last_undegraded":"2023-08-17T00:03:42.003881+0000","last_fullsized":"2023-08-17T00:03:42.003881+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.971132+0000","last_change":"2023-08-17T00:03:41.562780+0000","last_active":"2023-08-17T00:03:41.971132+0000","last_peered":"2023-08-17T00:03:41.971132+0000","last_clean":"2023-08-17T00:03:41.971132+0000","last_became_active":"2023-08-17T00:03:41.562492+0000","last_became_peered":"2023-08-17T00:03:41.562492+0000","last_unstale":"2023-08-17T00:03:41.971132+0000","last_undegraded":"2023-08-17T00:03:41.971132+0000","last_fullsized":"2023-08-17T00:03:41.971132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.983734+0000","last_change":"2023-08-17T00:03:41.976735+0000","last_active":"2023-08-17T00:03:41.983734+0000","last_peered":"2023-08-17T00:03:41.983734+0000","last_clean":"2023-08-17T00:03:41.983734+0000","last_became_active":"2023-08-17T00:03:41.976462+0000","last_became_peered":"2023-08-17T00:03:41.976462+0000","last_unstale":"2023-08-17T00:03:41.983734+0000","last_undegraded":"2023-08-17T00:03:41.983734+0000","last_fullsized":"2023-08-17T00:03:41.983734+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.968974+0000","last_change":"2023-08-17T00:03:41.553587+0000","last_active":"2023-08-17T00:03:41.968974+0000","last_peered":"2023-08-17T00:03:41.968974+0000","last_clean":"2023-08-17T00:03:41.968974+0000","last_became_active":"2023-08-17T00:03:41.553261+0000","last_became_peered":"2023-08-17T00:03:41.553261+0000","last_unstale":"2023-08-17T00:03:41.968974+0000","last_undegraded":"2023-08-17T00:03:41.968974+0000","last_fullsized":"2023-08-17T00:03:41.968974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996079+0000","last_change":"2023-08-17T00:03:41.975217+0000","last_active":"2023-08-17T00:03:41.996079+0000","last_peered":"2023-08-17T00:03:41.996079+0000","last_clean":"2023-08-17T00:03:41.996079+0000","last_became_active":"2023-08-17T00:03:41.974946+0000","last_became_peered":"2023-08-17T00:03:41.974946+0000","last_unstale":"2023-08-17T00:03:41.996079+0000","last_undegraded":"2023-08-17T00:03:41.996079+0000","last_fullsized":"2023-08-17T00:03:41.996079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.975579+0000","last_change":"2023-08-17T00:03:41.558693+0000","last_active":"2023-08-17T00:03:41.975579+0000","last_peered":"2023-08-17T00:03:41.975579+0000","last_clean":"2023-08-17T00:03:41.975579+0000","last_became_active":"2023-08-17T00:03:41.558382+0000","last_became_peered":"2023-08-17T00:03:41.558382+0000","last_unstale":"2023-08-17T00:03:41.975579+0000","last_undegraded":"2023-08-17T00:03:41.975579+0000","last_fullsized":"2023-08-17T00:03:41.975579+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002681+0000","last_change":"2023-08-17T00:03:41.999462+0000","last_active":"2023-08-17T00:03:42.002681+0000","last_peered":"2023-08-17T00:03:42.002681+0000","last_clean":"2023-08-17T00:03:42.002681+0000","last_became_active":"2023-08-17T00:03:41.999116+0000","last_became_peered":"2023-08-17T00:03:41.999116+0000","last_unstale":"2023-08-17T00:03:42.002681+0000","last_undegraded":"2023-08-17T00:03:42.002681+0000","last_fullsized":"2023-08-17T00:03:42.002681+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965629+0000","last_change":"2023-08-17T00:03:41.546915+0000","last_active":"2023-08-17T00:03:41.965629+0000","last_peered":"2023-08-17T00:03:41.965629+0000","last_clean":"2023-08-17T00:03:41.965629+0000","last_became_active":"2023-08-17T00:03:41.546629+0000","last_became_peered":"2023-08-17T00:03:41.546629+0000","last_unstale":"2023-08-17T00:03:41.965629+0000","last_undegraded":"2023-08-17T00:03:41.965629+0000","last_fullsized":"2023-08-17T00:03:41.965629+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994635+0000","last_change":"2023-08-17T00:03:41.986589+0000","last_active":"2023-08-17T00:03:41.994635+0000","last_peered":"2023-08-17T00:03:41.994635+0000","last_clean":"2023-08-17T00:03:41.994635+0000","last_became_active":"2023-08-17T00:03:41.986263+0000","last_became_peered":"2023-08-17T00:03:41.986263+0000","last_unstale":"2023-08-17T00:03:41.994635+0000","last_undegraded":"2023-08-17T00:03:41.994635+0000","last_fullsized":"2023-08-17T00:03:41.994635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974735+0000","last_change":"2023-08-17T00:03:41.547097+0000","last_active":"2023-08-17T00:03:41.974735+0000","last_peered":"2023-08-17T00:03:41.974735+0000","last_clean":"2023-08-17T00:03:41.974735+0000","last_became_active":"2023-08-17T00:03:41.546806+0000","last_became_peered":"2023-08-17T00:03:41.546806+0000","last_unstale":"2023-08-17T00:03:41.974735+0000","last_undegraded":"2023-08-17T00:03:41.974735+0000","last_fullsized":"2023-08-17T00:03:41.974735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989875+0000","last_change":"2023-08-17T00:03:41.985320+0000","last_active":"2023-08-17T00:03:41.989875+0000","last_peered":"2023-08-17T00:03:41.989875+0000","last_clean":"2023-08-17T00:03:41.989875+0000","last_became_active":"2023-08-17T00:03:41.984870+0000","last_became_peered":"2023-08-17T00:03:41.984870+0000","last_unstale":"2023-08-17T00:03:41.989875+0000","last_undegraded":"2023-08-17T00:03:41.989875+0000","last_fullsized":"2023-08-17T00:03:41.989875+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967972+0000","last_change":"2023-08-17T00:03:41.551170+0000","last_active":"2023-08-17T00:03:41.967972+0000","last_peered":"2023-08-17T00:03:41.967972+0000","last_clean":"2023-08-17T00:03:41.967972+0000","last_became_active":"2023-08-17T00:03:41.550853+0000","last_became_peered":"2023-08-17T00:03:41.550853+0000","last_unstale":"2023-08-17T00:03:41.967972+0000","last_undegraded":"2023-08-17T00:03:41.967972+0000","last_fullsized":"2023-08-17T00:03:41.967972+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002598+0000","last_change":"2023-08-17T00:03:41.997911+0000","last_active":"2023-08-17T00:03:42.002598+0000","last_peered":"2023-08-17T00:03:42.002598+0000","last_clean":"2023-08-17T00:03:42.002598+0000","last_became_active":"2023-08-17T00:03:41.997633+0000","last_became_peered":"2023-08-17T00:03:41.997633+0000","last_unstale":"2023-08-17T00:03:42.002598+0000","last_undegraded":"2023-08-17T00:03:42.002598+0000","last_fullsized":"2023-08-17T00:03:42.002598+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974603+0000","last_change":"2023-08-17T00:03:41.561072+0000","last_active":"2023-08-17T00:03:41.974603+0000","last_peered":"2023-08-17T00:03:41.974603+0000","last_clean":"2023-08-17T00:03:41.974603+0000","last_became_active":"2023-08-17T00:03:41.560843+0000","last_became_peered":"2023-08-17T00:03:41.560843+0000","last_unstale":"2023-08-17T00:03:41.974603+0000","last_undegraded":"2023-08-17T00:03:41.974603+0000","last_fullsized":"2023-08-17T00:03:41.974603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000152+0000","last_change":"2023-08-17T00:03:41.988891+0000","last_active":"2023-08-17T00:03:42.000152+0000","last_peered":"2023-08-17T00:03:42.000152+0000","last_clean":"2023-08-17T00:03:42.000152+0000","last_became_active":"2023-08-17T00:03:41.988559+0000","last_became_peered":"2023-08-17T00:03:41.988559+0000","last_unstale":"2023-08-17T00:03:42.000152+0000","last_undegraded":"2023-08-17T00:03:42.000152+0000","last_fullsized":"2023-08-17T00:03:42.000152+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000573+0000","last_change":"2023-08-17T00:03:41.555091+0000","last_active":"2023-08-17T00:03:42.000573+0000","last_peered":"2023-08-17T00:03:42.000573+0000","last_clean":"2023-08-17T00:03:42.000573+0000","last_became_active":"2023-08-17T00:03:41.554805+0000","last_became_peered":"2023-08-17T00:03:41.554805+0000","last_unstale":"2023-08-17T00:03:42.000573+0000","last_undegraded":"2023-08-17T00:03:42.000573+0000","last_fullsized":"2023-08-17T00:03:42.000573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989883+0000","last_change":"2023-08-17T00:03:41.983622+0000","last_active":"2023-08-17T00:03:41.989883+0000","last_peered":"2023-08-17T00:03:41.989883+0000","last_clean":"2023-08-17T00:03:41.989883+0000","last_became_active":"2023-08-17T00:03:41.983345+0000","last_became_peered":"2023-08-17T00:03:41.983345+0000","last_unstale":"2023-08-17T00:03:41.989883+0000","last_undegraded":"2023-08-17T00:03:41.989883+0000","last_fullsized":"2023-08-17T00:03:41.989883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.14","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993601+0000","last_change":"2023-08-17T00:03:41.569113+0000","last_active":"2023-08-17T00:03:41.993601+0000","last_peered":"2023-08-17T00:03:41.993601+0000","last_clean":"2023-08-17T00:03:41.993601+0000","last_became_active":"2023-08-17T00:03:41.568669+0000","last_became_peered":"2023-08-17T00:03:41.568669+0000","last_unstale":"2023-08-17T00:03:41.993601+0000","last_undegraded":"2023-08-17T00:03:41.993601+0000","last_fullsized":"2023-08-17T00:03:41.993601+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000420+0000","last_change":"2023-08-17T00:03:41.996053+0000","last_active":"2023-08-17T00:03:42.000420+0000","last_peered":"2023-08-17T00:03:42.000420+0000","last_clean":"2023-08-17T00:03:42.000420+0000","last_became_active":"2023-08-17T00:03:41.993750+0000","last_became_peered":"2023-08-17T00:03:41.993750+0000","last_unstale":"2023-08-17T00:03:42.000420+0000","last_undegraded":"2023-08-17T00:03:42.000420+0000","last_fullsized":"2023-08-17T00:03:42.000420+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991431+0000","last_change":"2023-08-17T00:03:41.564950+0000","last_active":"2023-08-17T00:03:41.991431+0000","last_peered":"2023-08-17T00:03:41.991431+0000","last_clean":"2023-08-17T00:03:41.991431+0000","last_became_active":"2023-08-17T00:03:41.564163+0000","last_became_peered":"2023-08-17T00:03:41.564163+0000","last_unstale":"2023-08-17T00:03:41.991431+0000","last_undegraded":"2023-08-17T00:03:41.991431+0000","last_fullsized":"2023-08-17T00:03:41.991431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997938+0000","last_change":"2023-08-17T00:03:41.993404+0000","last_active":"2023-08-17T00:03:41.997938+0000","last_peered":"2023-08-17T00:03:41.997938+0000","last_clean":"2023-08-17T00:03:41.997938+0000","last_became_active":"2023-08-17T00:03:41.993118+0000","last_became_peered":"2023-08-17T00:03:41.993118+0000","last_unstale":"2023-08-17T00:03:41.997938+0000","last_undegraded":"2023-08-17T00:03:41.997938+0000","last_fullsized":"2023-08-17T00:03:41.997938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.983937+0000","last_change":"2023-08-17T00:03:41.567714+0000","last_active":"2023-08-17T00:03:41.983937+0000","last_peered":"2023-08-17T00:03:41.983937+0000","last_clean":"2023-08-17T00:03:41.983937+0000","last_became_active":"2023-08-17T00:03:41.567405+0000","last_became_peered":"2023-08-17T00:03:41.567405+0000","last_unstale":"2023-08-17T00:03:41.983937+0000","last_undegraded":"2023-08-17T00:03:41.983937+0000","last_fullsized":"2023-08-17T00:03:41.983937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996618+0000","last_change":"2023-08-17T00:03:41.982068+0000","last_active":"2023-08-17T00:03:41.996618+0000","last_peered":"2023-08-17T00:03:41.996618+0000","last_clean":"2023-08-17T00:03:41.996618+0000","last_became_active":"2023-08-17T00:03:41.981751+0000","last_became_peered":"2023-08-17T00:03:41.981751+0000","last_unstale":"2023-08-17T00:03:41.996618+0000","last_undegraded":"2023-08-17T00:03:41.996618+0000","last_fullsized":"2023-08-17T00:03:41.996618+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973599+0000","last_change":"2023-08-17T00:03:41.559987+0000","last_active":"2023-08-17T00:03:41.973599+0000","last_peered":"2023-08-17T00:03:41.973599+0000","last_clean":"2023-08-17T00:03:41.973599+0000","last_became_active":"2023-08-17T00:03:41.559738+0000","last_became_peered":"2023-08-17T00:03:41.559738+0000","last_unstale":"2023-08-17T00:03:41.973599+0000","last_undegraded":"2023-08-17T00:03:41.973599+0000","last_fullsized":"2023-08-17T00:03:41.973599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996593+0000","last_change":"2023-08-17T00:03:41.995472+0000","last_active":"2023-08-17T00:03:41.996593+0000","last_peered":"2023-08-17T00:03:41.996593+0000","last_clean":"2023-08-17T00:03:41.996593+0000","last_became_active":"2023-08-17T00:03:41.995004+0000","last_became_peered":"2023-08-17T00:03:41.995004+0000","last_unstale":"2023-08-17T00:03:41.996593+0000","last_undegraded":"2023-08-17T00:03:41.996593+0000","last_fullsized":"2023-08-17T00:03:41.996593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.991494+0000","last_change":"2023-08-17T00:03:41.557437+0000","last_active":"2023-08-17T00:03:41.991494+0000","last_peered":"2023-08-17T00:03:41.991494+0000","last_clean":"2023-08-17T00:03:41.991494+0000","last_became_active":"2023-08-17T00:03:41.556865+0000","last_became_peered":"2023-08-17T00:03:41.556865+0000","last_unstale":"2023-08-17T00:03:41.991494+0000","last_undegraded":"2023-08-17T00:03:41.991494+0000","last_fullsized":"2023-08-17T00:03:41.991494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.994704+0000","last_change":"2023-08-17T00:03:41.989310+0000","last_active":"2023-08-17T00:03:41.994704+0000","last_peered":"2023-08-17T00:03:41.994704+0000","last_clean":"2023-08-17T00:03:41.994704+0000","last_became_active":"2023-08-17T00:03:41.988949+0000","last_became_peered":"2023-08-17T00:03:41.988949+0000","last_unstale":"2023-08-17T00:03:41.994704+0000","last_undegraded":"2023-08-17T00:03:41.994704+0000","last_fullsized":"2023-08-17T00:03:41.994704+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002771+0000","last_change":"2023-08-17T00:03:41.563451+0000","last_active":"2023-08-17T00:03:42.002771+0000","last_peered":"2023-08-17T00:03:42.002771+0000","last_clean":"2023-08-17T00:03:42.002771+0000","last_became_active":"2023-08-17T00:03:41.563133+0000","last_became_peered":"2023-08-17T00:03:41.563133+0000","last_unstale":"2023-08-17T00:03:42.002771+0000","last_undegraded":"2023-08-17T00:03:42.002771+0000","last_fullsized":"2023-08-17T00:03:42.002771+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000167+0000","last_change":"2023-08-17T00:03:41.993485+0000","last_active":"2023-08-17T00:03:42.000167+0000","last_peered":"2023-08-17T00:03:42.000167+0000","last_clean":"2023-08-17T00:03:42.000167+0000","last_became_active":"2023-08-17T00:03:41.993163+0000","last_became_peered":"2023-08-17T00:03:41.993163+0000","last_unstale":"2023-08-17T00:03:42.000167+0000","last_undegraded":"2023-08-17T00:03:42.000167+0000","last_fullsized":"2023-08-17T00:03:42.000167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000562+0000","last_change":"2023-08-17T00:03:41.558838+0000","last_active":"2023-08-17T00:03:42.000562+0000","last_peered":"2023-08-17T00:03:42.000562+0000","last_clean":"2023-08-17T00:03:42.000562+0000","last_became_active":"2023-08-17T00:03:41.558549+0000","last_became_peered":"2023-08-17T00:03:41.558549+0000","last_unstale":"2023-08-17T00:03:42.000562+0000","last_undegraded":"2023-08-17T00:03:42.000562+0000","last_fullsized":"2023-08-17T00:03:42.000562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000222+0000","last_change":"2023-08-17T00:03:41.994664+0000","last_active":"2023-08-17T00:03:42.000222+0000","last_peered":"2023-08-17T00:03:42.000222+0000","last_clean":"2023-08-17T00:03:42.000222+0000","last_became_active":"2023-08-17T00:03:41.994406+0000","last_became_peered":"2023-08-17T00:03:41.994406+0000","last_unstale":"2023-08-17T00:03:42.000222+0000","last_undegraded":"2023-08-17T00:03:42.000222+0000","last_fullsized":"2023-08-17T00:03:42.000222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974532+0000","last_change":"2023-08-17T00:03:41.563297+0000","last_active":"2023-08-17T00:03:41.974532+0000","last_peered":"2023-08-17T00:03:41.974532+0000","last_clean":"2023-08-17T00:03:41.974532+0000","last_became_active":"2023-08-17T00:03:41.562989+0000","last_became_peered":"2023-08-17T00:03:41.562989+0000","last_unstale":"2023-08-17T00:03:41.974532+0000","last_undegraded":"2023-08-17T00:03:41.974532+0000","last_fullsized":"2023-08-17T00:03:41.974532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990696+0000","last_change":"2023-08-17T00:03:41.983560+0000","last_active":"2023-08-17T00:03:41.990696+0000","last_peered":"2023-08-17T00:03:41.990696+0000","last_clean":"2023-08-17T00:03:41.990696+0000","last_became_active":"2023-08-17T00:03:41.983292+0000","last_became_peered":"2023-08-17T00:03:41.983292+0000","last_unstale":"2023-08-17T00:03:41.990696+0000","last_undegraded":"2023-08-17T00:03:41.990696+0000","last_fullsized":"2023-08-17T00:03:41.990696+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.966657+0000","last_change":"2023-08-17T00:03:41.549432+0000","last_active":"2023-08-17T00:03:41.966657+0000","last_peered":"2023-08-17T00:03:41.966657+0000","last_clean":"2023-08-17T00:03:41.966657+0000","last_became_active":"2023-08-17T00:03:41.549055+0000","last_became_peered":"2023-08-17T00:03:41.549055+0000","last_unstale":"2023-08-17T00:03:41.966657+0000","last_undegraded":"2023-08-17T00:03:41.966657+0000","last_fullsized":"2023-08-17T00:03:41.966657+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997806+0000","last_change":"2023-08-17T00:03:41.994496+0000","last_active":"2023-08-17T00:03:41.997806+0000","last_peered":"2023-08-17T00:03:41.997806+0000","last_clean":"2023-08-17T00:03:41.997806+0000","last_became_active":"2023-08-17T00:03:41.994183+0000","last_became_peered":"2023-08-17T00:03:41.994183+0000","last_unstale":"2023-08-17T00:03:41.997806+0000","last_undegraded":"2023-08-17T00:03:41.997806+0000","last_fullsized":"2023-08-17T00:03:41.997806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.988400+0000","last_change":"2023-08-17T00:03:41.551406+0000","last_active":"2023-08-17T00:03:41.988400+0000","last_peered":"2023-08-17T00:03:41.988400+0000","last_clean":"2023-08-17T00:03:41.988400+0000","last_became_active":"2023-08-17T00:03:41.551132+0000","last_became_peered":"2023-08-17T00:03:41.551132+0000","last_unstale":"2023-08-17T00:03:41.988400+0000","last_undegraded":"2023-08-17T00:03:41.988400+0000","last_fullsized":"2023-08-17T00:03:41.988400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.000282+0000","last_change":"2023-08-17T00:03:41.989931+0000","last_active":"2023-08-17T00:03:42.000282+0000","last_peered":"2023-08-17T00:03:42.000282+0000","last_clean":"2023-08-17T00:03:42.000282+0000","last_became_active":"2023-08-17T00:03:41.988782+0000","last_became_peered":"2023-08-17T00:03:41.988782+0000","last_unstale":"2023-08-17T00:03:42.000282+0000","last_undegraded":"2023-08-17T00:03:42.000282+0000","last_fullsized":"2023-08-17T00:03:42.000282+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.983833+0000","last_change":"2023-08-17T00:03:41.566990+0000","last_active":"2023-08-17T00:03:41.983833+0000","last_peered":"2023-08-17T00:03:41.983833+0000","last_clean":"2023-08-17T00:03:41.983833+0000","last_became_active":"2023-08-17T00:03:41.566391+0000","last_became_peered":"2023-08-17T00:03:41.566391+0000","last_unstale":"2023-08-17T00:03:41.983833+0000","last_undegraded":"2023-08-17T00:03:41.983833+0000","last_fullsized":"2023-08-17T00:03:41.983833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002587+0000","last_change":"2023-08-17T00:03:41.984454+0000","last_active":"2023-08-17T00:03:42.002587+0000","last_peered":"2023-08-17T00:03:42.002587+0000","last_clean":"2023-08-17T00:03:42.002587+0000","last_became_active":"2023-08-17T00:03:41.984143+0000","last_became_peered":"2023-08-17T00:03:41.984143+0000","last_unstale":"2023-08-17T00:03:42.002587+0000","last_undegraded":"2023-08-17T00:03:42.002587+0000","last_fullsized":"2023-08-17T00:03:42.002587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.976225+0000","last_change":"2023-08-17T00:03:41.551235+0000","last_active":"2023-08-17T00:03:41.976225+0000","last_peered":"2023-08-17T00:03:41.976225+0000","last_clean":"2023-08-17T00:03:41.976225+0000","last_became_active":"2023-08-17T00:03:41.550916+0000","last_became_peered":"2023-08-17T00:03:41.550916+0000","last_unstale":"2023-08-17T00:03:41.976225+0000","last_undegraded":"2023-08-17T00:03:41.976225+0000","last_fullsized":"2023-08-17T00:03:41.976225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998235+0000","last_change":"2023-08-17T00:03:41.988833+0000","last_active":"2023-08-17T00:03:41.998235+0000","last_peered":"2023-08-17T00:03:41.998235+0000","last_clean":"2023-08-17T00:03:41.998235+0000","last_became_active":"2023-08-17T00:03:41.988514+0000","last_became_peered":"2023-08-17T00:03:41.988514+0000","last_unstale":"2023-08-17T00:03:41.998235+0000","last_undegraded":"2023-08-17T00:03:41.998235+0000","last_fullsized":"2023-08-17T00:03:41.998235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.984760+0000","last_change":"2023-08-17T00:03:41.559344+0000","last_active":"2023-08-17T00:03:41.984760+0000","last_peered":"2023-08-17T00:03:41.984760+0000","last_clean":"2023-08-17T00:03:41.984760+0000","last_became_active":"2023-08-17T00:03:41.559025+0000","last_became_peered":"2023-08-17T00:03:41.559025+0000","last_unstale":"2023-08-17T00:03:41.984760+0000","last_undegraded":"2023-08-17T00:03:41.984760+0000","last_fullsized":"2023-08-17T00:03:41.984760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.996391+0000","last_change":"2023-08-17T00:03:41.980273+0000","last_active":"2023-08-17T00:03:41.996391+0000","last_peered":"2023-08-17T00:03:41.996391+0000","last_clean":"2023-08-17T00:03:41.996391+0000","last_became_active":"2023-08-17T00:03:41.979984+0000","last_became_peered":"2023-08-17T00:03:41.979984+0000","last_unstale":"2023-08-17T00:03:41.996391+0000","last_undegraded":"2023-08-17T00:03:41.996391+0000","last_fullsized":"2023-08-17T00:03:41.996391+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969826+0000","last_change":"2023-08-17T00:03:41.560105+0000","last_active":"2023-08-17T00:03:41.969826+0000","last_peered":"2023-08-17T00:03:41.969826+0000","last_clean":"2023-08-17T00:03:41.969826+0000","last_became_active":"2023-08-17T00:03:41.558348+0000","last_became_peered":"2023-08-17T00:03:41.558348+0000","last_unstale":"2023-08-17T00:03:41.969826+0000","last_undegraded":"2023-08-17T00:03:41.969826+0000","last_fullsized":"2023-08-17T00:03:41.969826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.975151+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:03:41.975151+0000","last_peered":"2023-08-17T00:03:41.975151+0000","last_clean":"2023-08-17T00:03:41.975151+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:03:41.975151+0000","last_undegraded":"2023-08-17T00:03:41.975151+0000","last_fullsized":"2023-08-17T00:03:41.975151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.980208+0000","last_change":"2023-08-17T00:03:41.978506+0000","last_active":"2023-08-17T00:03:41.980208+0000","last_peered":"2023-08-17T00:03:41.980208+0000","last_clean":"2023-08-17T00:03:41.980208+0000","last_became_active":"2023-08-17T00:03:41.978223+0000","last_became_peered":"2023-08-17T00:03:41.978223+0000","last_unstale":"2023-08-17T00:03:41.980208+0000","last_undegraded":"2023-08-17T00:03:41.980208+0000","last_fullsized":"2023-08-17T00:03:41.980208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973699+0000","last_change":"2023-08-17T00:03:41.552698+0000","last_active":"2023-08-17T00:03:41.973699+0000","last_peered":"2023-08-17T00:03:41.973699+0000","last_clean":"2023-08-17T00:03:41.973699+0000","last_became_active":"2023-08-17T00:03:41.552211+0000","last_became_peered":"2023-08-17T00:03:41.552211+0000","last_unstale":"2023-08-17T00:03:41.973699+0000","last_undegraded":"2023-08-17T00:03:41.973699+0000","last_fullsized":"2023-08-17T00:03:41.973699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.969420+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:03:41.969420+0000","last_peered":"2023-08-17T00:03:41.969420+0000","last_clean":"2023-08-17T00:03:41.969420+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:03:41.969420+0000","last_undegraded":"2023-08-17T00:03:41.969420+0000","last_fullsized":"2023-08-17T00:03:41.969420+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.997956+0000","last_change":"2023-08-17T00:03:41.993421+0000","last_active":"2023-08-17T00:03:41.997956+0000","last_peered":"2023-08-17T00:03:41.997956+0000","last_clean":"2023-08-17T00:03:41.997956+0000","last_became_active":"2023-08-17T00:03:41.992817+0000","last_became_peered":"2023-08-17T00:03:41.992817+0000","last_unstale":"2023-08-17T00:03:41.997956+0000","last_undegraded":"2023-08-17T00:03:41.997956+0000","last_fullsized":"2023-08-17T00:03:41.997956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.964431+0000","last_change":"2023-08-17T00:03:41.557323+0000","last_active":"2023-08-17T00:03:41.964431+0000","last_peered":"2023-08-17T00:03:41.964431+0000","last_clean":"2023-08-17T00:03:41.964431+0000","last_became_active":"2023-08-17T00:03:41.556980+0000","last_became_peered":"2023-08-17T00:03:41.556980+0000","last_unstale":"2023-08-17T00:03:41.964431+0000","last_undegraded":"2023-08-17T00:03:41.964431+0000","last_fullsized":"2023-08-17T00:03:41.964431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973770+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:03:41.973770+0000","last_peered":"2023-08-17T00:03:41.973770+0000","last_clean":"2023-08-17T00:03:41.973770+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:03:41.973770+0000","last_undegraded":"2023-08-17T00:03:41.973770+0000","last_fullsized":"2023-08-17T00:03:41.973770+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.988731+0000","last_change":"2023-08-17T00:03:41.984905+0000","last_active":"2023-08-17T00:03:41.988731+0000","last_peered":"2023-08-17T00:03:41.988731+0000","last_clean":"2023-08-17T00:03:41.988731+0000","last_became_active":"2023-08-17T00:03:41.984602+0000","last_became_peered":"2023-08-17T00:03:41.984602+0000","last_unstale":"2023-08-17T00:03:41.988731+0000","last_undegraded":"2023-08-17T00:03:41.988731+0000","last_fullsized":"2023-08-17T00:03:41.988731+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.967198+0000","last_change":"2023-08-17T00:03:41.565002+0000","last_active":"2023-08-17T00:03:41.967198+0000","last_peered":"2023-08-17T00:03:41.967198+0000","last_clean":"2023-08-17T00:03:41.967198+0000","last_became_active":"2023-08-17T00:03:41.564541+0000","last_became_peered":"2023-08-17T00:03:41.564541+0000","last_unstale":"2023-08-17T00:03:41.967198+0000","last_undegraded":"2023-08-17T00:03:41.967198+0000","last_fullsized":"2023-08-17T00:03:41.967198+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.966761+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:03:41.966761+0000","last_peered":"2023-08-17T00:03:41.966761+0000","last_clean":"2023-08-17T00:03:41.966761+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:03:41.966761+0000","last_undegraded":"2023-08-17T00:03:41.966761+0000","last_fullsized":"2023-08-17T00:03:41.966761+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.990674+0000","last_change":"2023-08-17T00:03:41.986837+0000","last_active":"2023-08-17T00:03:41.990674+0000","last_peered":"2023-08-17T00:03:41.990674+0000","last_clean":"2023-08-17T00:03:41.990674+0000","last_became_active":"2023-08-17T00:03:41.986540+0000","last_became_peered":"2023-08-17T00:03:41.986540+0000","last_unstale":"2023-08-17T00:03:41.990674+0000","last_undegraded":"2023-08-17T00:03:41.990674+0000","last_fullsized":"2023-08-17T00:03:41.990674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974643+0000","last_change":"2023-08-17T00:03:41.555624+0000","last_active":"2023-08-17T00:03:41.974643+0000","last_peered":"2023-08-17T00:03:41.974643+0000","last_clean":"2023-08-17T00:03:41.974643+0000","last_became_active":"2023-08-17T00:03:41.555292+0000","last_became_peered":"2023-08-17T00:03:41.555292+0000","last_unstale":"2023-08-17T00:03:41.974643+0000","last_undegraded":"2023-08-17T00:03:41.974643+0000","last_fullsized":"2023-08-17T00:03:41.974643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.977133+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:03:41.977133+0000","last_peered":"2023-08-17T00:03:41.977133+0000","last_clean":"2023-08-17T00:03:41.977133+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:03:41.977133+0000","last_undegraded":"2023-08-17T00:03:41.977133+0000","last_fullsized":"2023-08-17T00:03:41.977133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:42.002435+0000","last_change":"2023-08-17T00:03:41.983417+0000","last_active":"2023-08-17T00:03:42.002435+0000","last_peered":"2023-08-17T00:03:42.002435+0000","last_clean":"2023-08-17T00:03:42.002435+0000","last_became_active":"2023-08-17T00:03:41.983138+0000","last_became_peered":"2023-08-17T00:03:41.983138+0000","last_unstale":"2023-08-17T00:03:42.002435+0000","last_undegraded":"2023-08-17T00:03:42.002435+0000","last_fullsized":"2023-08-17T00:03:42.002435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974865+0000","last_change":"2023-08-17T00:03:41.557729+0000","last_active":"2023-08-17T00:03:41.974865+0000","last_peered":"2023-08-17T00:03:41.974865+0000","last_clean":"2023-08-17T00:03:41.974865+0000","last_became_active":"2023-08-17T00:03:41.557339+0000","last_became_peered":"2023-08-17T00:03:41.557339+0000","last_unstale":"2023-08-17T00:03:41.974865+0000","last_undegraded":"2023-08-17T00:03:41.974865+0000","last_fullsized":"2023-08-17T00:03:41.974865+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.972677+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:03:41.972677+0000","last_peered":"2023-08-17T00:03:41.972677+0000","last_clean":"2023-08-17T00:03:41.972677+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:03:41.972677+0000","last_undegraded":"2023-08-17T00:03:41.972677+0000","last_fullsized":"2023-08-17T00:03:41.972677+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.989582+0000","last_change":"2023-08-17T00:03:41.987487+0000","last_active":"2023-08-17T00:03:41.989582+0000","last_peered":"2023-08-17T00:03:41.989582+0000","last_clean":"2023-08-17T00:03:41.989582+0000","last_became_active":"2023-08-17T00:03:41.987077+0000","last_became_peered":"2023-08-17T00:03:41.987077+0000","last_unstale":"2023-08-17T00:03:41.989582+0000","last_undegraded":"2023-08-17T00:03:41.989582+0000","last_fullsized":"2023-08-17T00:03:41.989582+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.993151+0000","last_change":"2023-08-17T00:03:41.553821+0000","last_active":"2023-08-17T00:03:41.993151+0000","last_peered":"2023-08-17T00:03:41.993151+0000","last_clean":"2023-08-17T00:03:41.993151+0000","last_became_active":"2023-08-17T00:03:41.553555+0000","last_became_peered":"2023-08-17T00:03:41.553555+0000","last_unstale":"2023-08-17T00:03:41.993151+0000","last_undegraded":"2023-08-17T00:03:41.993151+0000","last_fullsized":"2023-08-17T00:03:41.993151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974140+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:03:41.974140+0000","last_peered":"2023-08-17T00:03:41.974140+0000","last_clean":"2023-08-17T00:03:41.974140+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:03:41.974140+0000","last_undegraded":"2023-08-17T00:03:41.974140+0000","last_fullsized":"2023-08-17T00:03:41.974140+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.998474+0000","last_change":"2023-08-17T00:03:41.992069+0000","last_active":"2023-08-17T00:03:41.998474+0000","last_peered":"2023-08-17T00:03:41.998474+0000","last_clean":"2023-08-17T00:03:41.998474+0000","last_became_active":"2023-08-17T00:03:41.991791+0000","last_became_peered":"2023-08-17T00:03:41.991791+0000","last_unstale":"2023-08-17T00:03:41.998474+0000","last_undegraded":"2023-08-17T00:03:41.998474+0000","last_fullsized":"2023-08-17T00:03:41.998474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:41.518038+0000","last_clean_scrub_stamp":"2023-08-17T00:03:41.518038+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.965220+0000","last_change":"2023-08-17T00:03:41.568004+0000","last_active":"2023-08-17T00:03:41.965220+0000","last_peered":"2023-08-17T00:03:41.965220+0000","last_clean":"2023-08-17T00:03:41.965220+0000","last_became_active":"2023-08-17T00:03:41.566190+0000","last_became_peered":"2023-08-17T00:03:41.566190+0000","last_unstale":"2023-08-17T00:03:41.965220+0000","last_undegraded":"2023-08-17T00:03:41.965220+0000","last_fullsized":"2023-08-17T00:03:41.965220+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:03:40.505866+0000","last_clean_scrub_stamp":"2023-08-17T00:03:40.505866+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.973565+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:03:41.973565+0000","last_peered":"2023-08-17T00:03:41.973565+0000","last_clean":"2023-08-17T00:03:41.973565+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:03:41.973565+0000","last_undegraded":"2023-08-17T00:03:41.973565+0000","last_fullsized":"2023-08-17T00:03:41.973565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-08-17T00:03:41.974812+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:03:41.974812+0000","last_peered":"2023-08-17T00:03:41.974812+0000","last_clean":"2023-08-17T00:03:41.974812+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:03:41.974812+0000","last_undegraded":"2023-08-17T00:03:41.974812+0000","last_fullsized":"2023-08-17T00:03:41.974812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":156590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]}]},{"osd":6,"up_from":14,"seq":60129542158,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297464,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074376,"statfs":{"total":96636764160,"available":96332161024,"internally_reserved":0,"allocated":376832,"data_stored":150742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542159,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297468,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074372,"statfs":{"total":96636764160,"available":96332156928,"internally_reserved":0,"allocated":380928,"data_stored":156520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]}]},{"osd":3,"up_from":14,"seq":60129542158,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":156610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.95999999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":1.51}]},{"osd":2,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.90700000000000003}]},{"osd":4,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.621,"5min":1.621,"15min":1.621},"last":1.286}]},{"osd":5,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.8220000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"last":1.097},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.6240000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.7050000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.8640000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.5660000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542158,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":157718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.244}]}]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297480,"kb_used_data":384,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074360,"statfs":{"total":96636764160,"available":96332144640,"internally_reserved":0,"allocated":393216,"data_stored":157504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.99099999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":1.083},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.9530000000000001,"5min":1.9530000000000001,"15min":1.9530000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":1.167}]},{"osd":5,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"max":{"1min":2.1219999999999999,"5min":2.1219999999999999,"15min":2.1219999999999999},"last":1.458},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.3740000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":1.236}]},{"osd":7,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":1.046,"5min":1.046,"15min":1.046},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.29},{"interface":"front","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":1.329}]}]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297476,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074364,"statfs":{"total":96636764160,"available":96332148736,"internally_reserved":0,"allocated":389120,"data_stored":157096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.88800000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.29,"5min":1.29,"15min":1.29},"last":0.80600000000000005},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":1.044},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.3480000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.24},{"interface":"front","average":{"1min":1.351,"5min":1.351,"15min":1.351},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.278}]},{"osd":6,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:03:43 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.119},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.147}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297472,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074368,"statfs":{"total":96636764160,"available":96332152832,"internally_reserved":0,"allocated":385024,"data_stored":150584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:03:46.600 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:03:46.600 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:03:46.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.789+0000 7f13a5e9d700 1 Processor -- start 2023-08-17T00:03:46.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 -- start start 2023-08-17T00:03:46.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13a00689c0 0x7f13a0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a01560f0 0x7f13a00c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13a0151530 0x7f13a01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a0065da0 con 0x7f13a00689c0 2023-08-17T00:03:46.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a0155c60 con 0x7f13a0151530 2023-08-17T00:03:46.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a5e9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a0156550 con 0x7f13a01560f0 2023-08-17T00:03:46.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13a00689c0 0x7f13a0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a569c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13a0151530 0x7f13a01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13a00689c0 0x7f13a0068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41302/0 (socket says 172.21.15.153:41302) 2023-08-17T00:03:46.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f1397fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a01560f0 0x7f13a00c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 -- 172.21.15.153:0/427839749 learned_addr learned my addr 172.21.15.153:0/427839749 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:46.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 -- 172.21.15.153:0/427839749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a01560f0 msgr2=0x7f13a00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:46.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/427839749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a01560f0 0x7f13a00c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 -- 172.21.15.153:0/427839749 >> v2:172.21.15.178:3300/0 conn(0x7f13a0151530 msgr2=0x7f13a01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:46.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/427839749 >> v2:172.21.15.178:3300/0 conn(0x7f13a0151530 0x7f13a01519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 -- 172.21.15.153:0/427839749 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a0065ff0 con 0x7f13a00689c0 2023-08-17T00:03:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.793+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/427839749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a00689c0 0x7f13a0068da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f13a0063720 tx=0x7f139c009060).ready entity=mon.0 client_cookie=6d14a0d596457659 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13977fe700 1 -- 172.21.15.153:0/427839749 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c005880 con 0x7f13a00689c0 2023-08-17T00:03:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13977fe700 1 -- 172.21.15.153:0/427839749 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139c0059e0 con 0x7f13a00689c0 2023-08-17T00:03:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13977fe700 1 -- 172.21.15.153:0/427839749 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139c005d60 con 0x7f13a00689c0 2023-08-17T00:03:46.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 -- 172.21.15.153:0/427839749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a00689c0 msgr2=0x7f13a0068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/427839749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a00689c0 0x7f13a0068da0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f13a0063720 tx=0x7f139c009060).stop 2023-08-17T00:03:46.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 -- 172.21.15.153:0/427839749 shutdown_connections 2023-08-17T00:03:46.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/427839749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a01560f0 0x7f13a00c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/427839749 >> v2:172.21.15.178:3300/0 conn(0x7f13a0151530 0x7f13a01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/427839749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a00689c0 0x7f13a0068da0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 -- 172.21.15.153:0/427839749 >> 172.21.15.153:0/427839749 conn(0x7f13a00c6620 msgr2=0x7f13a00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:46.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 -- 172.21.15.153:0/427839749 shutdown_connections 2023-08-17T00:03:46.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.797+0000 7f13a5e9d700 1 -- 172.21.15.153:0/427839749 wait complete. 2023-08-17T00:03:46.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 Processor -- start 2023-08-17T00:03:46.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 -- start start 2023-08-17T00:03:46.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a00689c0 0x7f13a00a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 0x7f13a00b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a01560f0 0x7f13a014dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00ba650 con 0x7f13a0151530 2023-08-17T00:03:46.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00ba930 con 0x7f13a01560f0 2023-08-17T00:03:46.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a5e9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a00bac10 con 0x7f13a00689c0 2023-08-17T00:03:46.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 0x7f13a00b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 0x7f13a00b9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41318/0 (socket says 172.21.15.153:41318) 2023-08-17T00:03:46.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 -- 172.21.15.153:0/1268173383 learned_addr learned my addr 172.21.15.153:0/1268173383 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:46.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a00689c0 0x7f13a00a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a569c700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a01560f0 0x7f13a014dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 -- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a00689c0 msgr2=0x7f13a00a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a00689c0 0x7f13a00a7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 -- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a01560f0 msgr2=0x7f13a014dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a01560f0 0x7f13a014dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 -- 172.21.15.153:0/1268173383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c009300 con 0x7f13a0151530 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a569c700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a01560f0 0x7f13a014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:46.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a00689c0 0x7f13a00a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:46.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.801+0000 7f1397fff700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 0x7f13a00b9f90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f139000e930 tx=0x7f1390009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:46.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000eed0 con 0x7f13a0151530 2023-08-17T00:03:46.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000c850 con 0x7f13a0151530 2023-08-17T00:03:46.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a00baef0 con 0x7f13a0151530 2023-08-17T00:03:46.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139000cbd0 con 0x7f13a0151530 2023-08-17T00:03:46.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a014e250 con 0x7f13a0151530 2023-08-17T00:03:46.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a00bb370 con 0x7f13a0151530 2023-08-17T00:03:46.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1390022070 con 0x7f13a0151530 2023-08-17T00:03:46.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f1394ff9700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f138c05a150 0x7f138c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:46.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.805+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1390074510 con 0x7f13a0151530 2023-08-17T00:03:46.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.809+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f138c05a150 0x7f138c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:46.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.809+0000 7f13a4e9b700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f138c05a150 0x7f138c05c610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f139c009150 tx=0x7f139c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:46.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:46.817+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1390047fc0 con 0x7f13a0151530 2023-08-17T00:03:47.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.029+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f13a006b4c0 con 0x7f13a0151530 2023-08-17T00:03:47.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.033+0000 7f1394ff9700 1 -- 172.21.15.153:0/1268173383 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f139004b5e0 con 0x7f13a0151530 2023-08-17T00:03:47.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f138c05a150 msgr2=0x7f138c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f138c05a150 0x7f138c05c610 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f139c009150 tx=0x7f139c016000).stop 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 msgr2=0x7f13a00b9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 0x7f13a00b9f90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f139000e930 tx=0x7f1390009060).stop 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 shutdown_connections 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f138c05a150 0x7f138c05c610 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13a01560f0 0x7f13a014dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13a0151530 0x7f13a00b9f90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 --2- 172.21.15.153:0/1268173383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13a00689c0 0x7f13a00a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 >> 172.21.15.153:0/1268173383 conn(0x7f13a00c6620 msgr2=0x7f13a0062bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:47.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 shutdown_connections 2023-08-17T00:03:47.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.037+0000 7f13a5e9d700 1 -- 172.21.15.153:0/1268173383 wait complete. 2023-08-17T00:03:47.047 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:03:47.065 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:03:47.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.209+0000 7f10cd707700 1 Processor -- start 2023-08-17T00:03:47.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.209+0000 7f10cd707700 1 -- start start 2023-08-17T00:03:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.209+0000 7f10cd707700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10c8068da0 0x7f10c81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:47.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.209+0000 7f10cd707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8151530 0x7f10c81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.209+0000 7f10cd707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10c8065da0 con 0x7f10c80689c0 2023-08-17T00:03:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.209+0000 7f10cd707700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10c8069200 con 0x7f10c8068da0 2023-08-17T00:03:47.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8155c60 con 0x7f10c8151530 2023-08-17T00:03:47.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10c8068da0 0x7f10c81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10c8068da0 0x7f10c81560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41328/0 (socket says 172.21.15.153:41328) 2023-08-17T00:03:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 -- 172.21.15.153:0/3901127506 learned_addr learned my addr 172.21.15.153:0/3901127506 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10ccf06700 1 --2- 172.21.15.153:0/3901127506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8151530 0x7f10c81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 -- 172.21.15.153:0/3901127506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8151530 msgr2=0x7f10c81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 --2- 172.21.15.153:0/3901127506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8151530 0x7f10c81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 -- 172.21.15.153:0/3901127506 >> v1:172.21.15.178:6789/0 conn(0x7f10c80689c0 legacy=0x7f10c80c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 -- 172.21.15.153:0/3901127506 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c8065ff0 con 0x7f10c8068da0 2023-08-17T00:03:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c77fe700 1 --2- 172.21.15.153:0/3901127506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c8068da0 0x7f10c81560f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f10bc006fd0 tx=0x7f10bc0090f0).ready entity=mon.0 client_cookie=b3718a97f8c09d31 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c6ffd700 1 -- 172.21.15.153:0/3901127506 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00b600 con 0x7f10c8068da0 2023-08-17T00:03:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c6ffd700 1 -- 172.21.15.153:0/3901127506 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10bc00b760 con 0x7f10c8068da0 2023-08-17T00:03:47.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10c6ffd700 1 -- 172.21.15.153:0/3901127506 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc00bb00 con 0x7f10c8068da0 2023-08-17T00:03:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 -- 172.21.15.153:0/3901127506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c8068da0 msgr2=0x7f10c81560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 --2- 172.21.15.153:0/3901127506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c8068da0 0x7f10c81560f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f10bc006fd0 tx=0x7f10bc0090f0).stop 2023-08-17T00:03:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 -- 172.21.15.153:0/3901127506 shutdown_connections 2023-08-17T00:03:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 --2- 172.21.15.153:0/3901127506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8151530 0x7f10c81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 --2- 172.21.15.153:0/3901127506 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c8068da0 0x7f10c81560f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.213+0000 7f10cd707700 1 -- 172.21.15.153:0/3901127506 >> 172.21.15.153:0/3901127506 conn(0x7f10c80c6620 msgr2=0x7f10c80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.217+0000 7f10cd707700 1 -- 172.21.15.153:0/3901127506 shutdown_connections 2023-08-17T00:03:47.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.217+0000 7f10cd707700 1 -- 172.21.15.153:0/3901127506 wait complete. 2023-08-17T00:03:47.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.217+0000 7f10cd707700 1 Processor -- start 2023-08-17T00:03:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 -- start start 2023-08-17T00:03:47.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 0x7f10c80ba130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8068da0 0x7f10c813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c8151530 0x7f10c813fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c81574a0 con 0x7f10c80689c0 2023-08-17T00:03:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8156890 con 0x7f10c8151530 2023-08-17T00:03:47.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10c8156b70 con 0x7f10c8068da0 2023-08-17T00:03:47.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 0x7f10c80ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 0x7f10c80ba130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41342/0 (socket says 172.21.15.153:41342) 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 -- 172.21.15.153:0/3829774826 learned_addr learned my addr 172.21.15.153:0/3829774826 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10ccf06700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c8151530 0x7f10c813fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c77fe700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8068da0 0x7f10c813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 -- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8068da0 msgr2=0x7f10c813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8068da0 0x7f10c813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 -- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c8151530 msgr2=0x7f10c813fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c8151530 0x7f10c813fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 -- 172.21.15.153:0/3829774826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc009370 con 0x7f10c80689c0 2023-08-17T00:03:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10c7fff700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 0x7f10c80ba130 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f10b800c440 tx=0x7f10b8007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007020 con 0x7f10c80689c0 2023-08-17T00:03:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b8007180 con 0x7f10c80689c0 2023-08-17T00:03:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c8156e50 con 0x7f10c80689c0 2023-08-17T00:03:47.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8007520 con 0x7f10c80689c0 2023-08-17T00:03:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.221+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c813ffb0 con 0x7f10c80689c0 2023-08-17T00:03:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.225+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c81565e0 con 0x7f10c80689c0 2023-08-17T00:03:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.225+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f10b8010070 con 0x7f10c80689c0 2023-08-17T00:03:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.225+0000 7f10affff700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10b405a150 0x7f10b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.225+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f10b8073240 con 0x7f10c80689c0 2023-08-17T00:03:47.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.229+0000 7f10c77fe700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10b405a150 0x7f10b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:47.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.229+0000 7f10c77fe700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10b405a150 0x7f10b405c610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f10bc00b3c0 tx=0x7f10bc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:47.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.233+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10b8046cf0 con 0x7f10c80689c0 2023-08-17T00:03:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.429+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10c806b4c0 con 0x7f10c80689c0 2023-08-17T00:03:47.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.429+0000 7f10affff700 1 -- 172.21.15.153:0/3829774826 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f10b804a310 con 0x7f10c80689c0 2023-08-17T00:03:47.437 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:03:47.437 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:03:41.953300+0000","modified":"2023-08-17T00:03:44.973789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/1653485600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1653485600},{"type":"v1","addr":"172.21.15.153:6835","nonce":1653485600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T00:03:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10b405a150 msgr2=0x7f10b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10b405a150 0x7f10b405c610 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f10bc00b3c0 tx=0x7f10bc017000).stop 2023-08-17T00:03:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 msgr2=0x7f10c80ba130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 0x7f10c80ba130 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f10b800c440 tx=0x7f10b8007e50).stop 2023-08-17T00:03:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 shutdown_connections 2023-08-17T00:03:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10b405a150 0x7f10b405c610 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10c8151530 0x7f10c813fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10c8068da0 0x7f10c813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 --2- 172.21.15.153:0/3829774826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10c80689c0 0x7f10c80ba130 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 >> 172.21.15.153:0/3829774826 conn(0x7f10c80c6620 msgr2=0x7f10c80c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:47.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 shutdown_connections 2023-08-17T00:03:47.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:47.437+0000 7f10cd707700 1 -- 172.21.15.153:0/3829774826 wait complete. 2023-08-17T00:03:47.445 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 14 2023-08-17T00:03:47.864 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:03:41.953300+0000', 'modified': '2023-08-17T00:03:44.973789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4971}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4971': {'gid': 4971, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.153:6835/1653485600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 1653485600}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1653485600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:03:47.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:03:47.865 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T00:03:48.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.021+0000 7f5c5b69b700 1 Processor -- start 2023-08-17T00:03:48.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.021+0000 7f5c5b69b700 1 -- start start 2023-08-17T00:03:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c5b69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c54153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c5b69b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c540c7ba0 0x7f5c540c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c5b69b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c540aa750 con 0x7f5c540c8d50 2023-08-17T00:03:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c5b69b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c540c9dd0 con 0x7f5c540c7ba0 2023-08-17T00:03:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c5b69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540aacf0 con 0x7f5c54153ab0 2023-08-17T00:03:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c58c36700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5c540c8d50 0x7f5c540c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37674/0 (socket says 172.21.15.153:37674) 2023-08-17T00:03:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c58c36700 1 -- 172.21.15.153:0/1247231482 learned_addr learned my addr 172.21.15.153:0/1247231482 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59c38700 1 --2- 172.21.15.153:0/1247231482 >> v2:172.21.15.178:3300/0 conn(0x7f5c540c7ba0 0x7f5c540c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59437700 1 --2- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c54153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c4bfff700 1 -- 172.21.15.153:0/1247231482 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4292320761 0 0) 0x7f5c540aa750 con 0x7f5c540c8d50 2023-08-17T00:03:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c4bfff700 1 -- 172.21.15.153:0/1247231482 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c400033f0 con 0x7f5c540c8d50 2023-08-17T00:03:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59c38700 1 -- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 msgr2=0x7f5c54153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59c38700 1 --2- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c54153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59c38700 1 -- 172.21.15.153:0/1247231482 >> v1:172.21.15.153:6789/0 conn(0x7f5c540c8d50 legacy=0x7f5c540c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59c38700 1 -- 172.21.15.153:0/1247231482 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c540c5ca0 con 0x7f5c540c7ba0 2023-08-17T00:03:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c59c38700 1 --2- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c91b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f5c4c009e60 tx=0x7f5c4c009780).ready entity=mon.1 client_cookie=e72a1a62ddafc739 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c4bfff700 1 -- 172.21.15.153:0/1247231482 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00e070 con 0x7f5c540c7ba0 2023-08-17T00:03:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c4bfff700 1 -- 172.21.15.153:0/1247231482 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c00bab0 con 0x7f5c540c7ba0 2023-08-17T00:03:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.025+0000 7f5c4bfff700 1 -- 172.21.15.153:0/1247231482 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00be30 con 0x7f5c540c7ba0 2023-08-17T00:03:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c7ba0 msgr2=0x7f5c540c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c91b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f5c4c009e60 tx=0x7f5c4c009780).stop 2023-08-17T00:03:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1247231482 shutdown_connections 2023-08-17T00:03:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c91b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1247231482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c54153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1247231482 >> 172.21.15.153:0/1247231482 conn(0x7f5c54061fa0 msgr2=0x7f5c540623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1247231482 shutdown_connections 2023-08-17T00:03:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1247231482 wait complete. 2023-08-17T00:03:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 Processor -- start 2023-08-17T00:03:48.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.029+0000 7f5c5b69b700 1 -- start start 2023-08-17T00:03:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c8d50 0x7f5c540c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c540c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54154d60 con 0x7f5c540c7ba0 2023-08-17T00:03:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5414e2c0 con 0x7f5c540c8d50 2023-08-17T00:03:48.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540ada10 con 0x7f5c54153ab0 2023-08-17T00:03:48.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41356/0 (socket says 172.21.15.153:41356) 2023-08-17T00:03:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 -- 172.21.15.153:0/1163040247 learned_addr learned my addr 172.21.15.153:0/1163040247 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59c38700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c540c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c58c36700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c8d50 0x7f5c540c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 -- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 msgr2=0x7f5c540c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c540c1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 -- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c8d50 msgr2=0x7f5c540c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c8d50 0x7f5c540c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 -- 172.21.15.153:0/1163040247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c009a20 con 0x7f5c540c7ba0 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59c38700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c540c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c58c36700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c8d50 0x7f5c540c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c59437700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c4200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5c5000e930 tx=0x7f5c50009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c497fa700 1 -- 172.21.15.153:0/1163040247 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000c640 con 0x7f5c540c7ba0 2023-08-17T00:03:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c497fa700 1 -- 172.21.15.153:0/1163040247 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5000c7a0 con 0x7f5c540c7ba0 2023-08-17T00:03:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c540c36d0 con 0x7f5c540c7ba0 2023-08-17T00:03:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c497fa700 1 -- 172.21.15.153:0/1163040247 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5000cb20 con 0x7f5c540c7ba0 2023-08-17T00:03:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.033+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c540c4890 con 0x7f5c540c7ba0 2023-08-17T00:03:48.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.037+0000 7f5c497fa700 1 -- 172.21.15.153:0/1163040247 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5c50022070 con 0x7f5c540c7ba0 2023-08-17T00:03:48.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.037+0000 7f5c497fa700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.037+0000 7f5c497fa700 1 -- 172.21.15.153:0/1163040247 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c50074560 con 0x7f5c540c7ba0 2023-08-17T00:03:48.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.037+0000 7f5c58c36700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.037+0000 7f5c65a30740 1 Processor -- start 2023-08-17T00:03:48.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.037+0000 7f5c65a30740 1 -- start start 2023-08-17T00:03:48.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5c44005750 tx=0x7f5c44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xdacdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xdaee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaf2f0 0xd68350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xcd65c0 con 0xd6b7f0 2023-08-17T00:03:48.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xcebe90 con 0xdaf2f0 2023-08-17T00:03:48.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xcb2220 con 0xdaca10 2023-08-17T00:03:48.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xdaee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xdaee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41358/0 (socket says 172.21.15.153:41358) 2023-08-17T00:03:48.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 -- 172.21.15.153:0/449014640 learned_addr learned my addr 172.21.15.153:0/449014640 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:48.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c59437700 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xdacdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c59c38700 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaf2f0 0xd68350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 -- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 msgr2=0xdacdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xdacdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 -- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaf2f0 msgr2=0xd68350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaf2f0 0xd68350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 -- 172.21.15.153:0/449014640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xcf7500 con 0xd6b7f0 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c59c38700 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaf2f0 0xd68350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c58c36700 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xdaee00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5c44007320 tx=0x7f5c44007000).ready entity=mon.0 client_cookie=8096973dbaee7fb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c3e7fc700 1 -- 172.21.15.153:0/449014640 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44014400 con 0xd6b7f0 2023-08-17T00:03:48.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c3e7fc700 1 -- 172.21.15.153:0/449014640 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c44014560 con 0xd6b7f0 2023-08-17T00:03:48.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c3e7fc700 1 -- 172.21.15.153:0/449014640 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c44014920 con 0xd6b7f0 2023-08-17T00:03:48.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- 172.21.15.153:0/449014640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 msgr2=0xdaee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xdaee00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f5c44007320 tx=0x7f5c44007000).stop 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- 172.21.15.153:0/449014640 shutdown_connections 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaf2f0 0xd68350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xdaee00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 --2- 172.21.15.153:0/449014640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xdacdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- 172.21.15.153:0/449014640 >> 172.21.15.153:0/449014640 conn(0xb4a550 msgr2=0xd6be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- 172.21.15.153:0/449014640 shutdown_connections 2023-08-17T00:03:48.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.041+0000 7f5c65a30740 1 -- 172.21.15.153:0/449014640 wait complete. 2023-08-17T00:03:48.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 -- start start 2023-08-17T00:03:48.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 Processor -- start 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd90bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xd95c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 0xdab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xcb7110 con 0xdaf2f0 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xd910a0 con 0xd6b7f0 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xdb12b0 con 0xdaca10 2023-08-17T00:03:48.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c65a30740 10 client.0 ll_register_callbacks cb 0xd233c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:03:48.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.045+0000 7f5c59c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 0xdab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 0xdab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41372/0 (socket says 172.21.15.153:41372) 2023-08-17T00:03:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 -- 172.21.15.153:0/4186434000 learned_addr learned my addr 172.21.15.153:0/4186434000 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59437700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd90bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c58c36700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xd95c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 -- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 msgr2=0xd95c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xd95c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 -- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 msgr2=0xd90bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd90bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 -- 172.21.15.153:0/4186434000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c400033f0 con 0xdaf2f0 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59c38700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 0xdab550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5c540c1a50 tx=0x7f5c540c9f10).ready entity=mon.0 client_cookie=a46ec818386cd4cb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:03:48.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 1 -- 172.21.15.153:0/4186434000 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c012c60 con 0xdaf2f0 2023-08-17T00:03:48.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xce1c60 con 0xdaf2f0 2023-08-17T00:03:48.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 1 -- 172.21.15.153:0/4186434000 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c4c012dc0 con 0xdaf2f0 2023-08-17T00:03:48.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 1 -- 172.21.15.153:0/4186434000 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c4c01e610 con 0xdaf2f0 2023-08-17T00:03:48.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 10 client.5154 fetch_fsmap learned FSMap version 14 2023-08-17T00:03:48.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0xce4f80 con 0xdaf2f0 2023-08-17T00:03:48.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 1 -- 172.21.15.153:0/4186434000 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xce1c60 con 0xdaf2f0 2023-08-17T00:03:48.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 1 -- 172.21.15.153:0/4186434000 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5c4c0273f0 con 0xdaf2f0 2023-08-17T00:03:48.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 10 client.5154 fetch_fsmap finished waiting for FSMap version 14 2023-08-17T00:03:48.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 10 client.5154 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:03:48.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 20 client.5154 populate_metadata read hostname 'smithi153' 2023-08-17T00:03:48.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xd926f0 0xdaff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 4 client.5154 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xcd81b0 con 0xd926f0 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59437700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xd926f0 0xdaff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c59437700 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xd926f0 0xdaff70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1c21c5c069f509a7 server_cookie=d73e3ec3121f5ab in_seq=0 out_seq=0 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.049+0000 7f5c337fe700 10 client.5154 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c337fe700 1 -- 172.21.15.153:0/4186434000 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xcd81b0 con 0xd926f0 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c337fe700 10 client.5154 handle_command_reply: tid=0 2023-08-17T00:03:48.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 client.5154 shutdown 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 msgr2=0xdab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 0xdab550 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f5c540c1a50 tx=0x7f5c540c9f10).stop 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 shutdown_connections 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xd926f0 0xdaff70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaf2f0 0xdab550 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaca10 0xd95c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 --2- 172.21.15.153:0/4186434000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd90bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c337fe700 0 client.5154 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:03:48.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 >> 172.21.15.153:0/4186434000 conn(0xb4a550 msgr2=0xdad650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 shutdown_connections 2023-08-17T00:03:48.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 1 -- 172.21.15.153:0/4186434000 wait complete. 2023-08-17T00:03:48.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.053+0000 7f5c65a30740 20 client.5154 trim_cache size 0 max 16384 2023-08-17T00:03:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 Processor -- start 2023-08-17T00:03:48.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 -- start start 2023-08-17T00:03:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xd97eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaca10 0xd911e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xd94d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xdc0ec0 con 0xd6b7f0 2023-08-17T00:03:48.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xdbd490 con 0xdaca10 2023-08-17T00:03:48.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xdad8c0 con 0xdaf2f0 2023-08-17T00:03:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xd97eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xd97eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41376/0 (socket says 172.21.15.153:41376) 2023-08-17T00:03:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 -- 172.21.15.153:0/277035012 learned_addr learned my addr 172.21.15.153:0/277035012 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c58c36700 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaca10 0xd911e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59c38700 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xd94d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 -- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 msgr2=0xd94d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xd94d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 -- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaca10 msgr2=0xd911e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaca10 0xd911e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.073+0000 7f5c59437700 1 -- 172.21.15.153:0/277035012 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c540ae360 con 0xd6b7f0 2023-08-17T00:03:48.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c59437700 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xd97eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f5c50000c00 tx=0x7f5c5001d040).ready entity=mon.0 client_cookie=8177bdb0b2b076dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c3effd700 1 -- 172.21.15.153:0/277035012 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50050040 con 0xd6b7f0 2023-08-17T00:03:48.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c3effd700 1 -- 172.21.15.153:0/277035012 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50049f60 con 0xd6b7f0 2023-08-17T00:03:48.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c3effd700 1 -- 172.21.15.153:0/277035012 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50051210 con 0xd6b7f0 2023-08-17T00:03:48.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 -- 172.21.15.153:0/277035012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 msgr2=0xd97eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xd97eb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f5c50000c00 tx=0x7f5c5001d040).stop 2023-08-17T00:03:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 -- 172.21.15.153:0/277035012 shutdown_connections 2023-08-17T00:03:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xd94d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdaca10 0xd911e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 --2- 172.21.15.153:0/277035012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xd6b7f0 0xd97eb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 -- 172.21.15.153:0/277035012 >> 172.21.15.153:0/277035012 conn(0xb4a550 msgr2=0xd66540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 -- 172.21.15.153:0/277035012 shutdown_connections 2023-08-17T00:03:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 -- 172.21.15.153:0/277035012 wait complete. 2023-08-17T00:03:48.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.077+0000 7f5c65a30740 1 -- start start 2023-08-17T00:03:48.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 Processor -- start 2023-08-17T00:03:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd95900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaca10 0xdaff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xdb0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb0930 con 0xdaca10 2023-08-17T00:03:48.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe14a70 con 0xd6b7f0 2023-08-17T00:03:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xdc0000 con 0xdaf2f0 2023-08-17T00:03:48.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c65a30740 10 client.0 ll_register_callbacks cb 0x7f5c50006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c58c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaca10 0xdaff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c59437700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd95900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c59437700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd95900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:33996/0 (socket says 172.21.15.153:33996) 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c58c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaca10 0xdaff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41392/0 (socket says 172.21.15.153:41392) 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c59437700 1 -- 172.21.15.153:0/1553786650 learned_addr learned my addr 172.21.15.153:0/1553786650 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.081+0000 7f5c59c38700 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xdb0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c59437700 1 -- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 msgr2=0xdb0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c59437700 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xdb0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c59437700 1 -- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaca10 msgr2=0xdaff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c59437700 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaca10 0xdaff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c59437700 1 -- 172.21.15.153:0/1553786650 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c540c4890 con 0xd6b7f0 2023-08-17T00:03:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c59437700 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd95900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f5c5004baf0 tx=0x7f5c50053000).ready entity=mon.1 client_cookie=ac61aa5d4e6b93e4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c337fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:03:48.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c337fe700 1 -- 172.21.15.153:0/1553786650 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50050040 con 0xd6b7f0 2023-08-17T00:03:48.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c337fe700 1 -- 172.21.15.153:0/1553786650 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c5000eda0 con 0xd6b7f0 2023-08-17T00:03:48.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c44014560 con 0xd6b7f0 2023-08-17T00:03:48.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c337fe700 1 -- 172.21.15.153:0/1553786650 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c500740b0 con 0xd6b7f0 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c65a30740 10 client.5041 fetch_fsmap learned FSMap version 14 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0xce0420 con 0xd6b7f0 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.085+0000 7f5c337fe700 1 -- 172.21.15.153:0/1553786650 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c44014560 con 0xd6b7f0 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c337fe700 1 -- 172.21.15.153:0/1553786650 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 14) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5c5004b0b0 con 0xd6b7f0 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 10 client.5041 fetch_fsmap finished waiting for FSMap version 14 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 10 client.5041 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:03:48.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 20 client.5041 populate_metadata read hostname 'smithi153' 2023-08-17T00:03:48.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xe13960 0xe13d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 4 client.5041 mds_command: new command op to 4971 tid=0[{"prefix": "status"}] 2023-08-17T00:03:48.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "status"}) v1 -- 0xba14e0 con 0xe13960 2023-08-17T00:03:48.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c58c36700 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xe13960 0xe13d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c58c36700 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xe13960 0xe13d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f034330925382420 server_cookie=a63718503d60aecf in_seq=0 out_seq=0 2023-08-17T00:03:48.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c337fe700 10 client.5041 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:03:48.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c337fe700 1 -- 172.21.15.153:0/1553786650 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0xba14e0 con 0xe13960 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c337fe700 10 client.5041 handle_command_reply: tid=0 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 client.5041 shutdown 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 msgr2=0xd95900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd95900 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f5c5004baf0 tx=0x7f5c50053000).stop 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 shutdown_connections 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdaf2f0 0xdb0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0xe13960 0xe13d40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xdaca10 0xdaff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 --2- 172.21.15.153:0/1553786650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xd6b7f0 0xd95900 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c337fe700 0 client.5041 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 >> 172.21.15.153:0/1553786650 conn(0xb4a550 msgr2=0xdbf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 shutdown_connections 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 1 -- 172.21.15.153:0/1553786650 wait complete. 2023-08-17T00:03:48.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c65a30740 20 client.5041 trim_cache size 0 max 16384 2023-08-17T00:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 4971, 2023-08-17T00:03:48.099 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.1332022430000004, 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 14, 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 34, 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 34, 2023-08-17T00:03:48.100 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 14.406354196000001 2023-08-17T00:03:48.101 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:03:48.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 msgr2=0x7f5c3805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f5c44005750 tx=0x7f5c44009040).stop 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 msgr2=0x7f5c540c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c4200 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f5c5000e930 tx=0x7f5c50009060).stop 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 shutdown_connections 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54153ab0 0x7f5c540c1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540c8d50 0x7f5c540c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.089+0000 7f5c5b69b700 1 --2- 172.21.15.153:0/1163040247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540c7ba0 0x7f5c540c4200 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.093+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 >> 172.21.15.153:0/1163040247 conn(0x7f5c54061fa0 msgr2=0x7f5c54063f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.093+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 shutdown_connections 2023-08-17T00:03:48.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.093+0000 7f5c5b69b700 1 -- 172.21.15.153:0/1163040247 wait complete. 2023-08-17T00:03:48.117 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:03:48.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.241+0000 7f9f45e5b700 1 Processor -- start 2023-08-17T00:03:48.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.241+0000 7f9f45e5b700 1 -- start start 2023-08-17T00:03:48.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f45e5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f400c69b0 0x7f9f40066830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f45e5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400c71b0 con 0x7f9f400c6d90 2023-08-17T00:03:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f45e5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f40062550 con 0x7f9f40151c60 2023-08-17T00:03:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f45e5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f401520d0 con 0x7f9f400c69b0 2023-08-17T00:03:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f3f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f400c69b0 0x7f9f40066830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f37fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9f400c6d90 0x7f9f40151550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37688/0 (socket says 172.21.15.153:37688) 2023-08-17T00:03:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f37fff700 1 -- 172.21.15.153:0/2266474070 learned_addr learned my addr 172.21.15.153:0/2266474070 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f3f7fe700 1 --2- 172.21.15.153:0/2266474070 >> v2:172.21.15.153:3300/0 conn(0x7f9f400c69b0 0x7f9f40066830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41396/0 (socket says 172.21.15.153:41396) 2023-08-17T00:03:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/2266474070 >> v1:172.21.15.178:6789/0 conn(0x7f9f40151c60 legacy=0x7f9f40065530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/2266474070 >> v1:172.21.15.153:6789/0 conn(0x7f9f400c6d90 legacy=0x7f9f40151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/2266474070 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400629e0 con 0x7f9f400c69b0 2023-08-17T00:03:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.245+0000 7f9f3f7fe700 1 --2- 172.21.15.153:0/2266474070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f40066830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f9f30009760 tx=0x7f9f30009060).ready entity=mon.0 client_cookie=6346d40ef0fe65c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f3effd700 1 -- 172.21.15.153:0/2266474070 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000b580 con 0x7f9f400c69b0 2023-08-17T00:03:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f3effd700 1 -- 172.21.15.153:0/2266474070 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3000b6e0 con 0x7f9f400c69b0 2023-08-17T00:03:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f3effd700 1 -- 172.21.15.153:0/2266474070 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000ba60 con 0x7f9f400c69b0 2023-08-17T00:03:48.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 -- 172.21.15.153:0/2266474070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 msgr2=0x7f9f40066830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/2266474070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f40066830 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f9f30009760 tx=0x7f9f30009060).stop 2023-08-17T00:03:48.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 -- 172.21.15.153:0/2266474070 shutdown_connections 2023-08-17T00:03:48.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/2266474070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f40066830 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 -- 172.21.15.153:0/2266474070 >> 172.21.15.153:0/2266474070 conn(0x7f9f4005dca0 msgr2=0x7f9f4005e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 -- 172.21.15.153:0/2266474070 shutdown_connections 2023-08-17T00:03:48.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 -- 172.21.15.153:0/2266474070 wait complete. 2023-08-17T00:03:48.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 Processor -- start 2023-08-17T00:03:48.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.249+0000 7f9f45e5b700 1 -- start start 2023-08-17T00:03:48.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f400a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f400c6d90 0x7f9f400aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f40151c60 0x7f9f400aadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400be7e0 con 0x7f9f400c69b0 2023-08-17T00:03:48.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400bd8f0 con 0x7f9f400c6d90 2023-08-17T00:03:48.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400bdbd0 con 0x7f9f40151c60 2023-08-17T00:03:48.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f400a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f400a7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41402/0 (socket says 172.21.15.153:41402) 2023-08-17T00:03:48.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/1379161957 learned_addr learned my addr 172.21.15.153:0/1379161957 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3ffff700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f40151c60 0x7f9f400aadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f37fff700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f400c6d90 0x7f9f400aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f40151c60 msgr2=0x7f9f400aadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f40151c60 0x7f9f400aadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f400c6d90 msgr2=0x7f9f400aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f400c6d90 0x7f9f400aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 -- 172.21.15.153:0/1379161957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f300092a0 con 0x7f9f400c69b0 2023-08-17T00:03:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f37fff700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f400c6d90 0x7f9f400aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:03:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f3f7fe700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f400a7dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9f30009eb0 tx=0x7f9f30017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3000ba60 con 0x7f9f400c69b0 2023-08-17T00:03:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f400bdeb0 con 0x7f9f400c69b0 2023-08-17T00:03:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f30000c90 con 0x7f9f400c69b0 2023-08-17T00:03:48.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3001b620 con 0x7f9f400c69b0 2023-08-17T00:03:48.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.253+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f400be470 con 0x7f9f400c69b0 2023-08-17T00:03:48.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.257+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f40046dd0 con 0x7f9f400c69b0 2023-08-17T00:03:48.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.257+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9f3002c070 con 0x7f9f400c69b0 2023-08-17T00:03:48.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.257+0000 7f9f377fe700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f2005a150 0x7f9f2005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:48.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.257+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9f30075de0 con 0x7f9f400c69b0 2023-08-17T00:03:48.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.257+0000 7f9f37fff700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f2005a150 0x7f9f2005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:48.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.261+0000 7f9f37fff700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f2005a150 0x7f9f2005c610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f9f4014ce00 tx=0x7f9f28009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:48.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.265+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f30049780 con 0x7f9f400c69b0 2023-08-17T00:03:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.457+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f400688e0 con 0x7f9f400c69b0 2023-08-17T00:03:48.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f377fe700 1 -- 172.21.15.153:0/1379161957 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9f30006c70 con 0x7f9f400c69b0 2023-08-17T00:03:48.466 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:03:48.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f2005a150 msgr2=0x7f9f2005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f2005a150 0x7f9f2005c610 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f9f4014ce00 tx=0x7f9f28009040).stop 2023-08-17T00:03:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 msgr2=0x7f9f400a7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f400a7dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f9f30009eb0 tx=0x7f9f30017000).stop 2023-08-17T00:03:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 shutdown_connections 2023-08-17T00:03:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f2005a150 0x7f9f2005c610 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f40151c60 0x7f9f400aadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f400c6d90 0x7f9f400aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 --2- 172.21.15.153:0/1379161957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f400c69b0 0x7f9f400a7dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 >> 172.21.15.153:0/1379161957 conn(0x7f9f4005dca0 msgr2=0x7f9f40066500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 shutdown_connections 2023-08-17T00:03:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:48.461+0000 7f9f45e5b700 1 -- 172.21.15.153:0/1379161957 wait complete. 2023-08-17T00:03:48.485 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:03:48.485 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:03:48.486 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:03:48.486 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:03:48.486 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:03:48.487 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:03:48.487 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:03:48.487 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:03:48.487 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:03:48.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.488 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:03:48.507 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:03:48.508 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:03:48.508 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:03:48.508 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.508 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:03:48.508 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:03:48.509 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42385sec preferred_lft 42385sec 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.510 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:03:48.511 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:48.511 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:03:48.511 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.511 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:03:48.511 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:03:48.511 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:03:48.512 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.513 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:03:48.513 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:03:48.513 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:03:48.513 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:03:48.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.514 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:03:48.592 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:03:48.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.595 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:03:48.660 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:03:48.660 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:03:48.660 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:03:48.661 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:03:48.661 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:03:48.661 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:03:48.661 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:03:48.661 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:03:48.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.663 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:03:48.663 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:03:48.663 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:03:48.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:03:48.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:03:48.665 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:03:48.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.806 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:03:48.822 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:03:48.823 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:03:48.824 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:03:48.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:03:48.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:48.898 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:03:48.959 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:03:48.960 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:49.076 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:03:49.107 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:03:49.112 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:03:49.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:03:49.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:03:49.146 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-08-17T00:03:49.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.345+0000 7f162d61b700 1 Processor -- start 2023-08-17T00:03:49.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.345+0000 7f162d61b700 1 -- start start 2023-08-17T00:03:49.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f162d61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280a9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:49.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f162d61b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f16280a9c50 0x7f16280c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:49.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f162d61b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280aa0c0 con 0x7f1628153800 2023-08-17T00:03:49.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f162d61b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1628063d70 con 0x7f16280a9c50 2023-08-17T00:03:49.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f162d61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280bf730 con 0x7f1628153be0 2023-08-17T00:03:49.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f1626ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1628153800 0x7f16280632b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37700/0 (socket says 172.21.15.153:37700) 2023-08-17T00:03:49.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f1626ffd700 1 -- 172.21.15.153:0/3090036451 learned_addr learned my addr 172.21.15.153:0/3090036451 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:03:49.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f16277fe700 1 --2- 172.21.15.153:0/3090036451 >> v2:172.21.15.178:3300/0 conn(0x7f16280a9c50 0x7f16280c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:49.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f16267fc700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280a9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:49.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.349+0000 7f1625ffb700 1 -- 172.21.15.153:0/3090036451 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773656602 0 0) 0x7f16280aa0c0 con 0x7f1628153800 2023-08-17T00:03:49.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f1625ffb700 1 -- 172.21.15.153:0/3090036451 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16100033f0 con 0x7f1628153800 2023-08-17T00:03:49.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f16277fe700 1 -- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 msgr2=0x7f16280a9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:03:49.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f16277fe700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280a9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:49.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f16277fe700 1 -- 172.21.15.153:0/3090036451 >> v1:172.21.15.153:6789/0 conn(0x7f1628153800 legacy=0x7f16280632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:49.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f16277fe700 1 -- 172.21.15.153:0/3090036451 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280bfa10 con 0x7f16280a9c50 2023-08-17T00:03:49.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f16267fc700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:03:49.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f16277fe700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280a9c50 0x7f16280c04f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f1620009e60 tx=0x7f1620009780).ready entity=mon.1 client_cookie=8569d35b37c0fdb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:49.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f1625ffb700 1 -- 172.21.15.153:0/3090036451 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000e070 con 0x7f16280a9c50 2023-08-17T00:03:49.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f1625ffb700 1 -- 172.21.15.153:0/3090036451 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162000bab0 con 0x7f16280a9c50 2023-08-17T00:03:49.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f1625ffb700 1 -- 172.21.15.153:0/3090036451 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162000be30 con 0x7f16280a9c50 2023-08-17T00:03:49.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 -- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280a9c50 msgr2=0x7f16280c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:49.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280a9c50 0x7f16280c04f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f1620009e60 tx=0x7f1620009780).stop 2023-08-17T00:03:49.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 -- 172.21.15.153:0/3090036451 shutdown_connections 2023-08-17T00:03:49.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16280a9c50 0x7f16280c04f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:49.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 --2- 172.21.15.153:0/3090036451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280a9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:49.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 -- 172.21.15.153:0/3090036451 >> 172.21.15.153:0/3090036451 conn(0x7f1628062a30 msgr2=0x7f16280ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:49.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 -- 172.21.15.153:0/3090036451 shutdown_connections 2023-08-17T00:03:49.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.353+0000 7f162d61b700 1 -- 172.21.15.153:0/3090036451 wait complete. 2023-08-17T00:03:49.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 Processor -- start 2023-08-17T00:03:49.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 -- start start 2023-08-17T00:03:49.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 0x7f162813d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:49.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628153800 0x7f16280c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:49.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:49.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c4aa0 con 0x7f16280a9c50 2023-08-17T00:03:49.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c3a00 con 0x7f1628153800 2023-08-17T00:03:49.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f162d61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280c3ce0 con 0x7f1628153be0 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 0x7f162813d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 0x7f162813d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41412/0 (socket says 172.21.15.153:41412) 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 -- 172.21.15.153:0/1757011358 learned_addr learned my addr 172.21.15.153:0/1757011358 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f16267fc700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628153800 0x7f16280c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f16277fe700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 -- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 msgr2=0x7f16280c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:49.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:49.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 -- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628153800 msgr2=0x7f16280c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:49.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628153800 0x7f16280c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:49.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 -- 172.21.15.153:0/1757011358 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c0092a0 con 0x7f16280a9c50 2023-08-17T00:03:49.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.357+0000 7f1626ffd700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 0x7f162813d950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f161800c590 tx=0x7f1618007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:49.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180072e0 con 0x7f16280a9c50 2023-08-17T00:03:49.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1618007440 con 0x7f16280a9c50 2023-08-17T00:03:49.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1620009a20 con 0x7f16280a9c50 2023-08-17T00:03:49.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180057a0 con 0x7f16280a9c50 2023-08-17T00:03:49.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16280c42a0 con 0x7f16280a9c50 2023-08-17T00:03:49.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1628046dd0 con 0x7f16280a9c50 2023-08-17T00:03:49.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.361+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f161801a060 con 0x7f16280a9c50 2023-08-17T00:03:49.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.365+0000 7f160effd700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f161405a150 0x7f161405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:03:49.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.365+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1618073820 con 0x7f16280a9c50 2023-08-17T00:03:49.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.365+0000 7f16267fc700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f161405a150 0x7f161405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:03:49.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.365+0000 7f16267fc700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f161405a150 0x7f161405c610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f16280c59c0 tx=0x7f161c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:03:49.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.369+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f16180471c0 con 0x7f16280a9c50 2023-08-17T00:03:49.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:49.569+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f16280a9a30 con 0x7f16280a9c50 2023-08-17T00:03:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.093+0000 7f160effd700 1 -- 172.21.15.153:0/1757011358 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v15) v1 ==== 167+0+0 (secure 0 0 0) 0x7f1618018070 con 0x7f16280a9c50 2023-08-17T00:03:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f161405a150 msgr2=0x7f161405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:50.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f161405a150 0x7f161405c610 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f16280c59c0 tx=0x7f161c009060).stop 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 msgr2=0x7f162813d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 0x7f162813d950 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f161800c590 tx=0x7f1618007c80).stop 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 shutdown_connections 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f161405a150 0x7f161405c610 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1628153be0 0x7f16280c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1628153800 0x7f16280c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 --2- 172.21.15.153:0/1757011358 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16280a9c50 0x7f162813d950 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:03:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 >> 172.21.15.153:0/1757011358 conn(0x7f1628062a30 msgr2=0x7f16280c7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:03:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 shutdown_connections 2023-08-17T00:03:50.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:03:50.097+0000 7f162d61b700 1 -- 172.21.15.153:0/1757011358 wait complete. 2023-08-17T00:03:50.106 INFO:teuthology.orchestra.run.smithi153.stderr:enabled new snapshots 2023-08-17T00:03:50.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:03:50.124 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2023-08-17T00:03:50.153 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:03:50.154 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:03:50.154 DEBUG:teuthology.orchestra.run.smithi153:> import uuid 2023-08-17T00:03:50.154 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:03:50.155 DEBUG:teuthology.orchestra.run.smithi153:> n = 2000 2023-08-17T00:03:50.155 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = False 2023-08-17T00:03:50.155 DEBUG:teuthology.orchestra.run.smithi153:> if 3 > 0: 2023-08-17T00:03:50.156 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = True 2023-08-17T00:03:50.156 DEBUG:teuthology.orchestra.run.smithi153:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2023-08-17T00:03:50.156 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:03:50.156 DEBUG:teuthology.orchestra.run.smithi153:> dpath = os.path.dirname(path) 2023-08-17T00:03:50.157 DEBUG:teuthology.orchestra.run.smithi153:> fnameprefix = os.path.basename(path) 2023-08-17T00:03:50.157 DEBUG:teuthology.orchestra.run.smithi153:> os.makedirs(dpath, exist_ok=True) 2023-08-17T00:03:50.157 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:03:50.157 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:03:50.158 DEBUG:teuthology.orchestra.run.smithi153:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-08-17T00:03:50.158 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:03:50.158 DEBUG:teuthology.orchestra.run.smithi153:> for i in range(n): 2023-08-17T00:03:50.158 DEBUG:teuthology.orchestra.run.smithi153:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-08-17T00:03:50.159 DEBUG:teuthology.orchestra.run.smithi153:> with open(fpath, '"'"'w'"'"') as f: 2023-08-17T00:03:50.159 DEBUG:teuthology.orchestra.run.smithi153:> f.write(f"{i}") 2023-08-17T00:03:50.159 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:03:50.160 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2023-08-17T00:03:50.160 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(f.fileno()) 2023-08-17T00:03:50.160 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:03:50.160 DEBUG:teuthology.orchestra.run.smithi153:> os.unlink(fpath) 2023-08-17T00:03:50.161 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:03:50.161 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2023-08-17T00:03:50.161 DEBUG:teuthology.orchestra.run.smithi153:> if create_hard_links: 2023-08-17T00:03:50.161 DEBUG:teuthology.orchestra.run.smithi153:> for j in range(3): 2023-08-17T00:03:50.162 DEBUG:teuthology.orchestra.run.smithi153:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-08-17T00:03:50.162 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:03:50.162 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2023-08-17T00:03:50.162 DEBUG:teuthology.orchestra.run.smithi153:> finally: 2023-08-17T00:03:50.163 DEBUG:teuthology.orchestra.run.smithi153:> os.close(dirfd) 2023-08-17T00:03:50.163 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:04:11.359 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:04:11.366 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:04:32.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:04:32.338 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-08-17T00:04:32.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:04:32.386 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2023-08-17T00:04:41.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:04:41.454 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:05:11.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:05:11.542 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:05:11.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:05:11.826 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-08-17T00:05:11.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2023-08-17T00:05:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.044+0000 7fb72759e700 1 Processor -- start 2023-08-17T00:05:12.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.044+0000 7fb72759e700 1 -- start start 2023-08-17T00:05:12.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.048+0000 7fb72759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280673f0 0x7fb72815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.048+0000 7fb72759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280c3240 con 0x7fb7280c36d0 2023-08-17T00:05:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.048+0000 7fb72759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb728154040 con 0x7fb7280bdef0 2023-08-17T00:05:12.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.048+0000 7fb72759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280c2630 con 0x7fb7280673f0 2023-08-17T00:05:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.048+0000 7fb725d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb7280c36d0 0x7fb728066ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34368/0 (socket says 172.21.15.153:34368) 2023-08-17T00:05:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb725d9b700 1 -- 172.21.15.153:0/3683555040 learned_addr learned my addr 172.21.15.153:0/3683555040 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb726d9d700 1 --2- 172.21.15.153:0/3683555040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280673f0 0x7fb72815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72559a700 1 -- 172.21.15.153:0/3683555040 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4006142067 0 0) 0x7fb7280c3240 con 0x7fb7280c36d0 2023-08-17T00:05:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72559a700 1 -- 172.21.15.153:0/3683555040 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7100033f0 con 0x7fb7280c36d0 2023-08-17T00:05:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb726d9d700 1 -- 172.21.15.153:0/3683555040 >> v1:172.21.15.178:6789/0 conn(0x7fb7280bdef0 legacy=0x7fb7280c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb726d9d700 1 -- 172.21.15.153:0/3683555040 >> v1:172.21.15.153:6789/0 conn(0x7fb7280c36d0 legacy=0x7fb728066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb726d9d700 1 -- 172.21.15.153:0/3683555040 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280c2910 con 0x7fb7280673f0 2023-08-17T00:05:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb726d9d700 1 --2- 172.21.15.153:0/3683555040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280673f0 0x7fb72815eb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb720009e90 tx=0x7fb720009780).ready entity=mon.2 client_cookie=4b57f4d8c9b8e3f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72559a700 1 -- 172.21.15.153:0/3683555040 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72000e070 con 0x7fb7280673f0 2023-08-17T00:05:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72559a700 1 -- 172.21.15.153:0/3683555040 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72000bb60 con 0x7fb7280673f0 2023-08-17T00:05:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72559a700 1 -- 172.21.15.153:0/3683555040 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720012410 con 0x7fb7280673f0 2023-08-17T00:05:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 -- 172.21.15.153:0/3683555040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280673f0 msgr2=0x7fb72815eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 --2- 172.21.15.153:0/3683555040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280673f0 0x7fb72815eb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fb720009e90 tx=0x7fb720009780).stop 2023-08-17T00:05:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 -- 172.21.15.153:0/3683555040 shutdown_connections 2023-08-17T00:05:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 --2- 172.21.15.153:0/3683555040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280673f0 0x7fb72815eb60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 -- 172.21.15.153:0/3683555040 >> 172.21.15.153:0/3683555040 conn(0x7fb728069740 msgr2=0x7fb728069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 -- 172.21.15.153:0/3683555040 shutdown_connections 2023-08-17T00:05:12.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.052+0000 7fb72759e700 1 -- 172.21.15.153:0/3683555040 wait complete. 2023-08-17T00:05:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.056+0000 7fb72759e700 1 Processor -- start 2023-08-17T00:05:12.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.056+0000 7fb72759e700 1 -- start start 2023-08-17T00:05:12.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7280673f0 0x7fb7281653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 0x7fb728157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280c36d0 0x7fb7280c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281658d0 con 0x7fb7280bdef0 2023-08-17T00:05:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280bea30 con 0x7fb7280673f0 2023-08-17T00:05:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7280bed10 con 0x7fb7280c36d0 2023-08-17T00:05:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 0x7fb728157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 0x7fb728157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36218/0 (socket says 172.21.15.153:36218) 2023-08-17T00:05:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 -- 172.21.15.153:0/3865292807 learned_addr learned my addr 172.21.15.153:0/3865292807 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 -- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280c36d0 msgr2=0x7fb7280c0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280c36d0 0x7fb7280c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 -- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7280673f0 msgr2=0x7fb7281653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72659c700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7280673f0 0x7fb7281653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7280673f0 0x7fb7281653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 -- 172.21.15.153:0/3865292807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009a20 con 0x7fb7280bdef0 2023-08-17T00:05:12.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72659c700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7280673f0 0x7fb7281653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb725d9b700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 0x7fb728157be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fb71c00c420 tx=0x7fb71c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb7167fc700 1 -- 172.21.15.153:0/3865292807 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0072e0 con 0x7fb7280bdef0 2023-08-17T00:05:12.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb7167fc700 1 -- 172.21.15.153:0/3865292807 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c007440 con 0x7fb7280bdef0 2023-08-17T00:05:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb7167fc700 1 -- 172.21.15.153:0/3865292807 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c0057a0 con 0x7fb7280bdef0 2023-08-17T00:05:12.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7280beff0 con 0x7fb7280bdef0 2023-08-17T00:05:12.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.060+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7280bf5b0 con 0x7fb7280bdef0 2023-08-17T00:05:12.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.064+0000 7fb7167fc700 1 -- 172.21.15.153:0/3865292807 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb71c010070 con 0x7fb7280bdef0 2023-08-17T00:05:12.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.064+0000 7fb7167fc700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb70805a150 0x7fb70805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.064+0000 7fb7167fc700 1 -- 172.21.15.153:0/3865292807 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb71c0737e0 con 0x7fb7280bdef0 2023-08-17T00:05:12.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.064+0000 7fb72659c700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb70805a150 0x7fb70805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb72659c700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb70805a150 0x7fb70805c610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb718001710 tx=0x7fb718009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 Processor -- start 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- start start 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x278b2f0 0x278b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x27442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2747c20 0x27447b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2694160 con 0x27477a0 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x26b4ff0 con 0x278b2f0 2023-08-17T00:05:12.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2789c60 con 0x2747c20 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x27442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x27442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36232/0 (socket says 172.21.15.153:36232) 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 -- 172.21.15.153:0/507397838 learned_addr learned my addr 172.21.15.153:0/507397838 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb726d9d700 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2747c20 0x27447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb72659c700 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x278b2f0 0x278b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 -- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2747c20 msgr2=0x27447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2747c20 0x27447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 -- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x278b2f0 msgr2=0x278b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x278b2f0 0x278b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 -- 172.21.15.153:0/507397838 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x26c1fd0 con 0x27477a0 2023-08-17T00:05:12.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb725d9b700 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x27442c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fb71c00cfd0 tx=0x7fb71c00f000).ready entity=mon.0 client_cookie=3399a1e90843c094 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb7077fe700 1 -- 172.21.15.153:0/507397838 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c049220 con 0x27477a0 2023-08-17T00:05:12.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb7077fe700 1 -- 172.21.15.153:0/507397838 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c04f040 con 0x27477a0 2023-08-17T00:05:12.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb7077fe700 1 -- 172.21.15.153:0/507397838 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c04a370 con 0x27477a0 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- 172.21.15.153:0/507397838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 msgr2=0x27442c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x27442c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fb71c00cfd0 tx=0x7fb71c00f000).stop 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- 172.21.15.153:0/507397838 shutdown_connections 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2747c20 0x27447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x27442c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 --2- 172.21.15.153:0/507397838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x278b2f0 0x278b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- 172.21.15.153:0/507397838 >> 172.21.15.153:0/507397838 conn(0x2527640 msgr2=0x2748200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- 172.21.15.153:0/507397838 shutdown_connections 2023-08-17T00:05:12.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.068+0000 7fb736bc2740 1 -- 172.21.15.153:0/507397838 wait complete. 2023-08-17T00:05:12.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 -- start start 2023-08-17T00:05:12.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 Processor -- start 2023-08-17T00:05:12.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x278d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2787e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x279a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x278c720 con 0x278b2f0 2023-08-17T00:05:12.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x278ca00 con 0x2747c20 2023-08-17T00:05:12.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x278cce0 con 0x27477a0 2023-08-17T00:05:12.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 10 client.0 ll_register_callbacks cb 0x26ff440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:12.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x279a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x279a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36240/0 (socket says 172.21.15.153:36240) 2023-08-17T00:05:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 -- 172.21.15.153:0/2332862690 learned_addr learned my addr 172.21.15.153:0/2332862690 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb725d9b700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2787e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb72659c700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x278d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 -- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 msgr2=0x278d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x278d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 -- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 msgr2=0x2787e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2787e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 -- 172.21.15.153:0/2332862690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7280bf5b0 con 0x278b2f0 2023-08-17T00:05:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x279a2e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb7280c74e0 tx=0x7fb720009780).ready entity=mon.0 client_cookie=a23a672fc7b1d5d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb704ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb704ff9700 1 -- 172.21.15.153:0/2332862690 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720012410 con 0x278b2f0 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x26becb0 con 0x278b2f0 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb704ff9700 1 -- 172.21.15.153:0/2332862690 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb72001d3f0 con 0x278b2f0 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb704ff9700 1 -- 172.21.15.153:0/2332862690 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb720007000 con 0x278b2f0 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 10 client.5187 fetch_fsmap learned FSMap version 27 2023-08-17T00:05:12.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.072+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x26bd470 con 0x278b2f0 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb704ff9700 1 -- 172.21.15.153:0/2332862690 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x26becb0 con 0x278b2f0 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb704ff9700 1 -- 172.21.15.153:0/2332862690 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb72001d7c0 con 0x278b2f0 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 10 client.5187 fetch_fsmap finished waiting for FSMap version 27 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 10 client.5187 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 20 client.5187 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27736c0 0x2773aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 4 client.5187 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x26b5200 con 0x27736c0 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb72659c700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27736c0 0x2773aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb72659c700 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27736c0 0x2773aa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9143ca8fae425c87 server_cookie=38a688ce1825b2f4 in_seq=0 out_seq=0 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb704ff9700 10 client.5187 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb704ff9700 1 -- 172.21.15.153:0/2332862690 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x26b5200 con 0x27736c0 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb704ff9700 10 client.5187 handle_command_reply: tid=0 2023-08-17T00:05:12.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 client.5187 shutdown 2023-08-17T00:05:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 msgr2=0x279a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x279a2e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fb7280c74e0 tx=0x7fb720009780).stop 2023-08-17T00:05:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 shutdown_connections 2023-08-17T00:05:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27736c0 0x2773aa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x279a2e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2787e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2332862690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x278d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 >> 172.21.15.153:0/2332862690 conn(0x2527640 msgr2=0x2746640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb704ff9700 0 client.5187 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 shutdown_connections 2023-08-17T00:05:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 1 -- 172.21.15.153:0/2332862690 wait complete. 2023-08-17T00:05:12.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.076+0000 7fb736bc2740 20 client.5187 trim_cache size 0 max 16384 2023-08-17T00:05:12.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.100+0000 7fb736bc2740 1 Processor -- start 2023-08-17T00:05:12.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.100+0000 7fb736bc2740 1 -- start start 2023-08-17T00:05:12.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x2743b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2774270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x278b2f0 0x2772380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb736bc2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x26fb540 con 0x27477a0 2023-08-17T00:05:12.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2774270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb725d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2774270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:57118/0 (socket says 172.21.15.153:57118) 2023-08-17T00:05:12.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb725d9b700 1 -- 172.21.15.153:0/2678783891 learned_addr learned my addr 172.21.15.153:0/2678783891 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x26f0940 con 0x2747c20 2023-08-17T00:05:12.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x278d9a0 con 0x278b2f0 2023-08-17T00:05:12.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.104+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x278b2f0 0x2772380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb72659c700 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x2743b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb726d9d700 1 -- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 msgr2=0x2774270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2774270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb726d9d700 1 -- 172.21.15.153:0/2678783891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 msgr2=0x2743b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x2743b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb726d9d700 1 -- 172.21.15.153:0/2678783891 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27864f0 con 0x278b2f0 2023-08-17T00:05:12.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.108+0000 7fb726d9d700 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x278b2f0 0x2772380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb7200097c0 tx=0x7fb72001e000).ready entity=mon.2 client_cookie=ea3cf1cde55e11f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.112+0000 7fb707fff700 1 -- 172.21.15.153:0/2678783891 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72001d3f0 con 0x278b2f0 2023-08-17T00:05:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.112+0000 7fb707fff700 1 -- 172.21.15.153:0/2678783891 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72001dc80 con 0x278b2f0 2023-08-17T00:05:12.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb707fff700 1 -- 172.21.15.153:0/2678783891 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720012410 con 0x278b2f0 2023-08-17T00:05:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x278b2f0 msgr2=0x2772380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x278b2f0 0x2772380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb7200097c0 tx=0x7fb72001e000).stop 2023-08-17T00:05:12.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 shutdown_connections 2023-08-17T00:05:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x278b2f0 0x2772380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2774270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 --2- 172.21.15.153:0/2678783891 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27477a0 0x2743b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 >> 172.21.15.153:0/2678783891 conn(0x2527640 msgr2=0x2742ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.116+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 shutdown_connections 2023-08-17T00:05:12.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.120+0000 7fb736bc2740 1 -- 172.21.15.153:0/2678783891 wait complete. 2023-08-17T00:05:12.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.120+0000 7fb736bc2740 1 -- start start 2023-08-17T00:05:12.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.120+0000 7fb736bc2740 1 Processor -- start 2023-08-17T00:05:12.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x27e5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2788780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb736bc2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x2788c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb72659c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x27e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb736bc2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2789160 con 0x278b2f0 2023-08-17T00:05:12.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb736bc2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f1500 con 0x2747c20 2023-08-17T00:05:12.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb736bc2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27e8a80 con 0x27477a0 2023-08-17T00:05:12.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb72659c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x27e5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:36642/0 (socket says 172.21.15.153:36642) 2023-08-17T00:05:12.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb72659c700 1 -- 172.21.15.153:0/1633553273 learned_addr learned my addr 172.21.15.153:0/1633553273 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb725d9b700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2788780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.124+0000 7fb726d9d700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x2788c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb72659c700 1 -- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 msgr2=0x2788780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb72659c700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2788780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb72659c700 1 -- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 msgr2=0x2788c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb72659c700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x2788c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb72659c700 1 -- 172.21.15.153:0/1633553273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x26bd470 con 0x27477a0 2023-08-17T00:05:12.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb736bc2740 10 client.0 ll_register_callbacks cb 0x7fb720015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:12.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb71c04f040 con 0x27477a0 2023-08-17T00:05:12.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb72659c700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x27e5150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb718012a30 tx=0x7fb718012000).ready entity=mon.2 client_cookie=83df27a44fccb437 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb704ff9700 10 client.4805 ms_handle_connect on v2:172.21.15.178:3301/0 2023-08-17T00:05:12.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb704ff9700 1 -- 172.21.15.153:0/1633553273 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb718022c10 con 0x27477a0 2023-08-17T00:05:12.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb704ff9700 1 -- 172.21.15.153:0/1633553273 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb718022d70 con 0x27477a0 2023-08-17T00:05:12.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb704ff9700 1 -- 172.21.15.153:0/1633553273 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb71802b420 con 0x27477a0 2023-08-17T00:05:12.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb736bc2740 10 client.4805 fetch_fsmap learned FSMap version 27 2023-08-17T00:05:12.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({fsmap=27}) v3 -- 0x7fb7280c0ab0 con 0x27477a0 2023-08-17T00:05:12.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.128+0000 7fb704ff9700 1 -- 172.21.15.153:0/1633553273 <== mon.2 v2:172.21.15.178:3301/0 4 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb71802b810 con 0x27477a0 2023-08-17T00:05:12.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb736bc2740 10 client.4805 fetch_fsmap finished waiting for FSMap version 27 2023-08-17T00:05:12.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb736bc2740 10 client.4805 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:12.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb736bc2740 20 client.4805 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:12.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb736bc2740 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27e4b50 0x27f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb736bc2740 4 client.4805 mds_command: new command op to 4971 tid=0[{"prefix": "perf dump"}] 2023-08-17T00:05:12.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x257e5d0 con 0x27e4b50 2023-08-17T00:05:12.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb725d9b700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27e4b50 0x27f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb725d9b700 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27e4b50 0x27f04a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e61a97b71f563e10 server_cookie=bfdc3ca428b4870b in_seq=0 out_seq=0 2023-08-17T00:05:12.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb704ff9700 10 client.4805 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb704ff9700 1 -- 172.21.15.153:0/1633553273 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17065 (crc 0 0 0) 0x257e5d0 con 0x27e4b50 2023-08-17T00:05:12.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.132+0000 7fb704ff9700 10 client.4805 handle_command_reply: tid=0 2023-08-17T00:05:12.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 client.4805 shutdown 2023-08-17T00:05:12.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 msgr2=0x27e5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x27e5150 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb718012a30 tx=0x7fb718012000).stop 2023-08-17T00:05:12.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 shutdown_connections 2023-08-17T00:05:12.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x27e4b50 0x27f04a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x278b2f0 0x2788c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2747c20 0x2788780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 --2- 172.21.15.153:0/1633553273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27477a0 0x27e5150 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 >> 172.21.15.153:0/1633553273 conn(0x2527640 msgr2=0x27875b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb704ff9700 0 client.4805 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 shutdown_connections 2023-08-17T00:05:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.136+0000 7fb736bc2740 1 -- 172.21.15.153:0/1633553273 wait complete. 2023-08-17T00:05:12.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.140+0000 7fb736bc2740 20 client.4805 trim_cache size 0 max 16384 2023-08-17T00:05:12.148 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 4171, 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 4174, 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1195146, 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 33426368, 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 9, 2023-08-17T00:05:12.149 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.706742093, 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.383809941, 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.101570500, 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.172837403, 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4173, 2023-08-17T00:05:12.150 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 8.284111982, 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001985169 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2, 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000291, 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000145 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.151 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 4126, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 4108, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1292506, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 31268987, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:05:12.152 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.543291176, 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.257312307, 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.099880505, 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.153948157, 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4108, 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.861160996, 2023-08-17T00:05:12.153 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000696485 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.154 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 32354, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 54979, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 11085496, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 54289306, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 10.488118149, 2023-08-17T00:05:12.155 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 8.612387435, 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 2.133815866, 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.262981397, 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 54977, 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.811713389, 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000087522 2023-08-17T00:05:12.156 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 50670, 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.015387113, 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000303 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-08-17T00:05:12.157 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4696, 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 20.396195189, 2023-08-17T00:05:12.158 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004343312 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 38, 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1794, 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.447783674, 2023-08-17T00:05:12.159 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000807014 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 28572, 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 28572, 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-08-17T00:05:12.160 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 28572, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 747.668790934, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.026167884 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch": 0, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 46, 2023-08-17T00:05:12.161 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 10011, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 5947, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 4064, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 1514, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 7058, 2023-08-17T00:05:12.162 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 110, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 110, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 2, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 134304, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 131108, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2023-08-17T00:05:12.163 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 1979, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 503016, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2023-08-17T00:05:12.164 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-08-17T00:05:12.165 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2023-08-17T00:05:12.166 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 2189, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 5827, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 5270, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 2000, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 66, 2023-08-17T00:05:12.167 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 13956 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 1762, 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 4250, 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 1892, 2023-08-17T00:05:12.168 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 4568, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2023-08-17T00:05:12.169 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2023-08-17T00:05:12.170 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-08-17T00:05:12.170 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2023-08-17T00:05:12.170 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-08-17T00:05:12.170 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-08-17T00:05:12.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.170 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 24326, 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 21394, 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 20349, 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 3977, 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 1045, 2023-08-17T00:05:12.171 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 30, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 25, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 23, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 7, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 2, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 71309637, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 85021730, 2023-08-17T00:05:12.172 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4511, 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 107.696353073, 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.023874163 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.173 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 2014, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 2014, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 0, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 13, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 13, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 0, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 11085, 2023-08-17T00:05:12.174 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 20022, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 8937, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 110, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 9112, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 9002, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 101032, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 340196 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.175 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 73422, 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 28572, 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 5, 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-08-17T00:05:12.176 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2000, 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.568616762, 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001284308 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.001925013, 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000240626 2023-08-17T00:05:12.177 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.178 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-08-17T00:05:12.178 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.178 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.178 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.178 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.178 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-08-17T00:05:12.179 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6000, 2023-08-17T00:05:12.179 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 11.523985464, 2023-08-17T00:05:12.179 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001920664 2023-08-17T00:05:12.180 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.180 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-08-17T00:05:12.180 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 7983, 2023-08-17T00:05:12.180 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.245165167, 2023-08-17T00:05:12.181 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000531775 2023-08-17T00:05:12.181 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.181 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-08-17T00:05:12.182 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.182 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.182 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.183 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.183 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-08-17T00:05:12.183 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.183 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.184 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.184 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.184 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-08-17T00:05:12.184 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.185 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.185 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.185 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.186 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-08-17T00:05:12.186 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.186 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.187 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.187 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.187 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-08-17T00:05:12.187 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:12.188 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000197985, 2023-08-17T00:05:12.188 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000197985 2023-08-17T00:05:12.188 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.189 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-08-17T00:05:12.189 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.189 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.189 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.189 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-08-17T00:05:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.006026584, 2023-08-17T00:05:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.006026584 2023-08-17T00:05:12.190 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-08-17T00:05:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.191 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.192 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-08-17T00:05:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.014648629, 2023-08-17T00:05:12.193 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014648629 2023-08-17T00:05:12.194 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.194 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-08-17T00:05:12.194 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.194 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.195 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.195 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.195 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-08-17T00:05:12.196 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:05:12.196 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.119574408, 2023-08-17T00:05:12.196 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014946801 2023-08-17T00:05:12.196 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.197 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-08-17T00:05:12.197 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4568, 2023-08-17T00:05:12.197 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 699.321269101, 2023-08-17T00:05:12.198 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.153091346 2023-08-17T00:05:12.198 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.198 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-08-17T00:05:12.198 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.199 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.199 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.199 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.199 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-08-17T00:05:12.200 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.200 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.200 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.200 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.201 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-08-17T00:05:12.201 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:12.201 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.018928280, 2023-08-17T00:05:12.202 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.018928280 2023-08-17T00:05:12.202 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.202 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-08-17T00:05:12.202 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.203 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.203 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.203 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.203 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-08-17T00:05:12.203 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:12.204 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000585659, 2023-08-17T00:05:12.204 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000585659 2023-08-17T00:05:12.204 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.204 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-08-17T00:05:12.204 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-08-17T00:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.205 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.206 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.207 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.208 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-08-17T00:05:12.208 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8000, 2023-08-17T00:05:12.208 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 29.847867882, 2023-08-17T00:05:12.208 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003730983 2023-08-17T00:05:12.208 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.209 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-08-17T00:05:12.210 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 16993, 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 16993, 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 79 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 19052, 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 19052, 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-08-17T00:05:12.211 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-08-17T00:05:12.212 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_bytes": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_items": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_bytes": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_items": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_bytes": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_items": 0, 2023-08-17T00:05:12.213 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_bytes": 0, 2023-08-17T00:05:12.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_items": 0, 2023-08-17T00:05:12.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-17T00:05:12.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-08-17T00:05:12.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-08-17T00:05:12.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-08-17T00:05:12.214 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-08-17T00:05:12.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-08-17T00:05:12.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-17T00:05:12.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-08-17T00:05:12.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-08-17T00:05:12.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-08-17T00:05:12.215 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-08-17T00:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-08-17T00:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-08-17T00:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-08-17T00:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-08-17T00:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-08-17T00:05:12.216 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 8267022, 2023-08-17T00:05:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 2187, 2023-08-17T00:05:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2023-08-17T00:05:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2023-08-17T00:05:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-08-17T00:05:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-08-17T00:05:12.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-08-17T00:05:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-08-17T00:05:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-08-17T00:05:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-08-17T00:05:12.218 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 6776, 2023-08-17T00:05:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 92, 2023-08-17T00:05:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-08-17T00:05:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-08-17T00:05:12.219 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-08-17T00:05:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-08-17T00:05:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 14375912, 2023-08-17T00:05:12.220 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 545252, 2023-08-17T00:05:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-08-17T00:05:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-08-17T00:05:12.221 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-08-17T00:05:12.222 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-08-17T00:05:12.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.222 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-08-17T00:05:12.222 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 13, 2023-08-17T00:05:12.223 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-08-17T00:05:12.223 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 11135, 2023-08-17T00:05:12.223 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 91857430, 2023-08-17T00:05:12.223 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 32, 2023-08-17T00:05:12.224 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 11121, 2023-08-17T00:05:12.224 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-08-17T00:05:12.224 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 11134, 2023-08-17T00:05:12.225 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 20169 2023-08-17T00:05:12.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.225 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 11134, 2023-08-17T00:05:12.225 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 65, 2023-08-17T00:05:12.226 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 11069, 2023-08-17T00:05:12.226 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-08-17T00:05:12.226 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-08-17T00:05:12.226 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 33, 2023-08-17T00:05:12.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 4456, 2023-08-17T00:05:12.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 65, 2023-08-17T00:05:12.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 4576, 2023-08-17T00:05:12.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 59, 2023-08-17T00:05:12.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-08-17T00:05:12.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-08-17T00:05:12.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 1654, 2023-08-17T00:05:12.229 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2023-08-17T00:05:12.229 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 245, 2023-08-17T00:05:12.229 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-08-17T00:05:12.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-08-17T00:05:12.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-08-17T00:05:12.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 0, 2023-08-17T00:05:12.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 8912, 2023-08-17T00:05:12.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-08-17T00:05:12.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-08-17T00:05:12.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-08-17T00:05:12.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-08-17T00:05:12.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-08-17T00:05:12.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-08-17T00:05:12.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-08-17T00:05:12.233 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-08-17T00:05:12.233 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-08-17T00:05:12.233 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2023-08-17T00:05:12.234 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-08-17T00:05:12.234 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-08-17T00:05:12.234 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-08-17T00:05:12.234 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-08-17T00:05:12.235 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-08-17T00:05:12.235 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-08-17T00:05:12.235 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-08-17T00:05:12.235 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-08-17T00:05:12.236 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-08-17T00:05:12.236 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-08-17T00:05:12.236 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-08-17T00:05:12.236 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-08-17T00:05:12.237 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-08-17T00:05:12.237 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-08-17T00:05:12.237 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-08-17T00:05:12.238 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-08-17T00:05:12.238 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 36, 2023-08-17T00:05:12.238 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-08-17T00:05:12.238 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 3, 2023-08-17T00:05:12.239 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 8, 2023-08-17T00:05:12.239 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 8, 2023-08-17T00:05:12.239 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-08-17T00:05:12.239 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-08-17T00:05:12.240 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 135, 2023-08-17T00:05:12.240 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2023-08-17T00:05:12.240 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 34 2023-08-17T00:05:12.241 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.241 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-08-17T00:05:12.241 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2023-08-17T00:05:12.241 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-08-17T00:05:12.242 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-08-17T00:05:12.242 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-08-17T00:05:12.242 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.242 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-08-17T00:05:12.243 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 32, 2023-08-17T00:05:12.243 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 32, 2023-08-17T00:05:12.243 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 32, 2023-08-17T00:05:12.244 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 32, 2023-08-17T00:05:12.244 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 1832, 2023-08-17T00:05:12.244 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 64 2023-08-17T00:05:12.244 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.244 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-17T00:05:12.244 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 40649, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 10380399, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 40649, 2023-08-17T00:05:12.245 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 40649, 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 10380399, 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.246 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:05:12.247 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 11134, 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 92061754, 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 11121, 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 92061754, 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:12.248 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 13, 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-08-17T00:05:12.249 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 11134, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 11134, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 11121, 2023-08-17T00:05:12.250 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 11121, 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-08-17T00:05:12.251 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 1892, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 204324, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 1892, 2023-08-17T00:05:12.252 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 65, 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 204324, 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.253 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x5650caa71cc0": { 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 142646, 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 24326, 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 80827426, 2023-08-17T00:05:12.254 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 24326, 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4511, 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 80684780, 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:12.255 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:12.256 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:12.256 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:12.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.256 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.256 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:05:12.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb70805a150 msgr2=0x7fb70805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb70805a150 0x7fb70805c610 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fb718001710 tx=0x7fb718009040).stop 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 msgr2=0x7fb728157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 0x7fb728157be0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fb71c00c420 tx=0x7fb71c007c50).stop 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 shutdown_connections 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb70805a150 0x7fb70805c610 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7280c36d0 0x7fb7280c0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7280bdef0 0x7fb728157be0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 --2- 172.21.15.153:0/3865292807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7280673f0 0x7fb7281653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 >> 172.21.15.153:0/3865292807 conn(0x7fb728069740 msgr2=0x7fb7280aa7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 shutdown_connections 2023-08-17T00:05:12.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.144+0000 7fb72759e700 1 -- 172.21.15.153:0/3865292807 wait complete. 2023-08-17T00:05:12.259 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1762 2023-08-17T00:05:12.260 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2023-08-17T00:05:12.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d59907700 1 Processor -- start 2023-08-17T00:05:12.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d59907700 1 -- start start 2023-08-17T00:05:12.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d59907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d54153d90 0x7f1d540a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d59907700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540c00d0 con 0x7f1d540cb450 2023-08-17T00:05:12.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d59907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d540bf810 con 0x7f1d541539b0 2023-08-17T00:05:12.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d59907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d540639c0 con 0x7f1d54153d90 2023-08-17T00:05:12.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.400+0000 7f1d4bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d54153d90 0x7f1d540a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59106700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1d540cb450 0x7f1d540c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34374/0 (socket says 172.21.15.153:34374) 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59106700 1 -- 172.21.15.153:0/1145367765 learned_addr learned my addr 172.21.15.153:0/1145367765 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4b7fe700 1 -- 172.21.15.153:0/1145367765 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717020427 0 0) 0x7f1d540c00d0 con 0x7f1d540cb450 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4b7fe700 1 -- 172.21.15.153:0/1145367765 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c0033f0 con 0x7f1d540cb450 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4bfff700 1 -- 172.21.15.153:0/1145367765 >> v1:172.21.15.178:6789/0 conn(0x7f1d541539b0 legacy=0x7f1d540632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4bfff700 1 -- 172.21.15.153:0/1145367765 >> v1:172.21.15.153:6789/0 conn(0x7f1d540cb450 legacy=0x7f1d540c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4bfff700 1 -- 172.21.15.153:0/1145367765 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d540aa910 con 0x7f1d54153d90 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4b7fe700 1 -- 172.21.15.153:0/1145367765 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1566968312 0 0) 0x7f1d3c0033f0 con 0x7f1d540cb450 2023-08-17T00:05:12.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/1145367765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d54153d90 0x7f1d540a97a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f1d50009760 tx=0x7f1d50009060).ready entity=mon.0 client_cookie=a2a565c7a6e73631 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4b7fe700 1 -- 172.21.15.153:0/1145367765 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000f510 con 0x7f1d54153d90 2023-08-17T00:05:12.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4b7fe700 1 -- 172.21.15.153:0/1145367765 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5000f670 con 0x7f1d54153d90 2023-08-17T00:05:12.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d4b7fe700 1 -- 172.21.15.153:0/1145367765 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5000f9f0 con 0x7f1d54153d90 2023-08-17T00:05:12.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 -- 172.21.15.153:0/1145367765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d54153d90 msgr2=0x7f1d540a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 --2- 172.21.15.153:0/1145367765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d54153d90 0x7f1d540a97a0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f1d50009760 tx=0x7f1d50009060).stop 2023-08-17T00:05:12.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 -- 172.21.15.153:0/1145367765 shutdown_connections 2023-08-17T00:05:12.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 --2- 172.21.15.153:0/1145367765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d54153d90 0x7f1d540a97a0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 -- 172.21.15.153:0/1145367765 >> 172.21.15.153:0/1145367765 conn(0x7f1d54062a10 msgr2=0x7f1d540ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 -- 172.21.15.153:0/1145367765 shutdown_connections 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 -- 172.21.15.153:0/1145367765 wait complete. 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.404+0000 7f1d59907700 1 Processor -- start 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 -- start start 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 0x7f1d54157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d541539b0 0x7f1d541502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d54153d90 0x7f1d541507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d541519a0 con 0x7f1d540cb450 2023-08-17T00:05:12.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54150d90 con 0x7f1d541539b0 2023-08-17T00:05:12.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d54151070 con 0x7f1d54153d90 2023-08-17T00:05:12.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 0x7f1d54157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 0x7f1d54157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36276/0 (socket says 172.21.15.153:36276) 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 -- 172.21.15.153:0/3946675816 learned_addr learned my addr 172.21.15.153:0/3946675816 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d541539b0 0x7f1d541502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59106700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d54153d90 0x7f1d541507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 -- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d54153d90 msgr2=0x7f1d541507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d54153d90 0x7f1d541507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 -- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d541539b0 msgr2=0x7f1d541502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d541539b0 0x7f1d541502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 -- 172.21.15.153:0/3946675816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500092a0 con 0x7f1d540cb450 2023-08-17T00:05:12.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59106700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d54153d90 0x7f1d541507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:12.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d58905700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 0x7f1d54157f50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1d4400c4c0 tx=0x7f1d44007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d48ff9700 1 -- 172.21.15.153:0/3946675816 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44007020 con 0x7f1d540cb450 2023-08-17T00:05:12.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d48ff9700 1 -- 172.21.15.153:0/3946675816 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d44007180 con 0x7f1d540cb450 2023-08-17T00:05:12.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d48ff9700 1 -- 172.21.15.153:0/3946675816 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d44007520 con 0x7f1d540cb450 2023-08-17T00:05:12.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d54151350 con 0x7f1d540cb450 2023-08-17T00:05:12.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.408+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d541644a0 con 0x7f1d540cb450 2023-08-17T00:05:12.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.412+0000 7f1d48ff9700 1 -- 172.21.15.153:0/3946675816 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1d44010070 con 0x7f1d540cb450 2023-08-17T00:05:12.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.412+0000 7f1d48ff9700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d4005a150 0x7f1d4005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.412+0000 7f1d48ff9700 1 -- 172.21.15.153:0/3946675816 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1d44073bc0 con 0x7f1d540cb450 2023-08-17T00:05:12.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d4005a150 0x7f1d4005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 Processor -- start 2023-08-17T00:05:12.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d4005a150 0x7f1d4005c610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1d5414d620 tx=0x7f1d50017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 -- start start 2023-08-17T00:05:12.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x2889d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28b2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28877b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x280dc50 con 0x28b35b0 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x288e480 con 0x288cdf0 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x288d250 con 0x288ca10 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28b2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28b2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36288/0 (socket says 172.21.15.153:36288) 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 -- 172.21.15.153:0/3480932619 learned_addr learned my addr 172.21.15.153:0/3480932619 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d59106700 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28877b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d58905700 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x2889d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 -- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 msgr2=0x2889d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x2889d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 -- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 msgr2=0x28877b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28877b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 -- 172.21.15.153:0/3480932619 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2806b90 con 0x28b35b0 2023-08-17T00:05:12.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d58905700 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x2889d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28b2ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f1d50009e00 tx=0x7f1d5001e070).ready entity=mon.0 client_cookie=b22d06888b604c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d3a7fc700 1 -- 172.21.15.153:0/3480932619 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5001c8b0 con 0x28b35b0 2023-08-17T00:05:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d3a7fc700 1 -- 172.21.15.153:0/3480932619 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5001ca10 con 0x28b35b0 2023-08-17T00:05:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.416+0000 7f1d3a7fc700 1 -- 172.21.15.153:0/3480932619 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d5001cd90 con 0x28b35b0 2023-08-17T00:05:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- 172.21.15.153:0/3480932619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 msgr2=0x28b2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28b2ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f1d50009e00 tx=0x7f1d5001e070).stop 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- 172.21.15.153:0/3480932619 shutdown_connections 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28877b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28b2ed0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- 172.21.15.153:0/3480932619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x2889d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- 172.21.15.153:0/3480932619 >> 172.21.15.153:0/3480932619 conn(0x266c8f0 msgr2=0x288d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- 172.21.15.153:0/3480932619 shutdown_connections 2023-08-17T00:05:12.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- 172.21.15.153:0/3480932619 wait complete. 2023-08-17T00:05:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- start start 2023-08-17T00:05:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 Processor -- start 2023-08-17T00:05:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 0x28e01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28d46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b35b0 0x28d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e0a80 con 0x288ca10 2023-08-17T00:05:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e0d60 con 0x288cdf0 2023-08-17T00:05:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28e1040 con 0x28b35b0 2023-08-17T00:05:12.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d64f21740 10 client.0 ll_register_callbacks cb 0x2844f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 0x28e01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 0x28e01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36296/0 (socket says 172.21.15.153:36296) 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 -- 172.21.15.153:0/2257932981 learned_addr learned my addr 172.21.15.153:0/2257932981 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d59106700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b35b0 0x28d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28d46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 -- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b35b0 msgr2=0x28d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b35b0 0x28d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 -- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 msgr2=0x28d46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28d46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.420+0000 7f1d58905700 1 -- 172.21.15.153:0/2257932981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d540aa910 con 0x288ca10 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d58905700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 0x28e01f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f1d4400c490 tx=0x7f1d4400f000).ready entity=mon.0 client_cookie=350e5871ad68a0ad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 1 -- 172.21.15.153:0/2257932981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4404a960 con 0x288ca10 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2803870 con 0x288ca10 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 1 -- 172.21.15.153:0/2257932981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1d44050b90 con 0x288ca10 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 1 -- 172.21.15.153:0/2257932981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d4404afd0 con 0x288ca10 2023-08-17T00:05:12.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 10 client.5208 fetch_fsmap learned FSMap version 27 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x2802030 con 0x288ca10 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 1 -- 172.21.15.153:0/2257932981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2803870 con 0x288ca10 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 1 -- 172.21.15.153:0/2257932981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1d44047050 con 0x288ca10 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 10 client.5208 fetch_fsmap finished waiting for FSMap version 27 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 10 client.5208 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 20 client.5208 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:12.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28e1d30 0x28e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 4 client.5208 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:05:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27f9dc0 con 0x28e1d30 2023-08-17T00:05:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28e1d30 0x28e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 10 client.5208 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d4bfff700 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28e1d30 0x28e2110 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f8024c17dd9e1778 server_cookie=b7dc9e428ac49082 in_seq=0 out_seq=0 2023-08-17T00:05:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 1 -- 172.21.15.153:0/2257932981 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x27f9dc0 con 0x28e1d30 2023-08-17T00:05:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 10 client.5208 handle_command_reply: tid=0 2023-08-17T00:05:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 client.5208 shutdown 2023-08-17T00:05:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 msgr2=0x28e01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 0x28e01f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f1d4400c490 tx=0x7f1d4400f000).stop 2023-08-17T00:05:12.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 shutdown_connections 2023-08-17T00:05:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b35b0 0x28d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x28d46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28e1d30 0x28e2110 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2257932981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288ca10 0x28e01f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d337fe700 0 client.5208 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 >> 172.21.15.153:0/2257932981 conn(0x266c8f0 msgr2=0x2887720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.424+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 shutdown_connections 2023-08-17T00:05:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.428+0000 7f1d64f21740 1 -- 172.21.15.153:0/2257932981 wait complete. 2023-08-17T00:05:12.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.428+0000 7f1d64f21740 20 client.5208 trim_cache size 0 max 16384 2023-08-17T00:05:12.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 Processor -- start 2023-08-17T00:05:12.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 -- start start 2023-08-17T00:05:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x28d1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x2886410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x2886900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2803870 con 0x28b35b0 2023-08-17T00:05:12.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2887cb0 con 0x288cdf0 2023-08-17T00:05:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27f9dc0 con 0x288ca10 2023-08-17T00:05:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x2886900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x2886900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36306/0 (socket says 172.21.15.153:36306) 2023-08-17T00:05:12.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 -- 172.21.15.153:0/2773772118 learned_addr learned my addr 172.21.15.153:0/2773772118 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 -- 172.21.15.153:0/2773772118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 msgr2=0x28d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x28d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 -- 172.21.15.153:0/2773772118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 msgr2=0x2886410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x2886410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 -- 172.21.15.153:0/2773772118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5414e720 con 0x28b35b0 2023-08-17T00:05:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d59106700 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x2886900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f1d4c005f40 tx=0x7f1d4c009040).ready entity=mon.0 client_cookie=fd40e4e5e9e7b265 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d3affd700 1 -- 172.21.15.153:0/2773772118 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c005ad0 con 0x28b35b0 2023-08-17T00:05:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d3affd700 1 -- 172.21.15.153:0/2773772118 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c00d070 con 0x28b35b0 2023-08-17T00:05:12.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.444+0000 7f1d3affd700 1 -- 172.21.15.153:0/2773772118 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0074e0 con 0x28b35b0 2023-08-17T00:05:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 -- 172.21.15.153:0/2773772118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 msgr2=0x2886900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x2886900 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f1d4c005f40 tx=0x7f1d4c009040).stop 2023-08-17T00:05:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 -- 172.21.15.153:0/2773772118 shutdown_connections 2023-08-17T00:05:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x2886900 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288cdf0 0x2886410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 --2- 172.21.15.153:0/2773772118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288ca10 0x28d1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 -- 172.21.15.153:0/2773772118 >> 172.21.15.153:0/2773772118 conn(0x266c8f0 msgr2=0x28d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 -- 172.21.15.153:0/2773772118 shutdown_connections 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.448+0000 7f1d64f21740 1 -- 172.21.15.153:0/2773772118 wait complete. 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- start start 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 Processor -- start 2023-08-17T00:05:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288ca10 0x29298f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288cdf0 0x2935a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cc370 con 0x28b35b0 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x292cd50 con 0x288ca10 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29364f0 con 0x288cdf0 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 10 client.0 ll_register_callbacks cb 0x7f1d4404abc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:12.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36308/0 (socket says 172.21.15.153:36308) 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 -- 172.21.15.153:0/1921071096 learned_addr learned my addr 172.21.15.153:0/1921071096 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 -- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288cdf0 msgr2=0x2935a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288cdf0 0x2935a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d58905700 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288ca10 0x29298f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 -- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288ca10 msgr2=0x29298f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288ca10 0x29298f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 -- 172.21.15.153:0/1921071096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4c005ca0 con 0x28b35b0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d59106700 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28ccd80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f1d4c001fb0 tx=0x7f1d4c01a000).ready entity=mon.0 client_cookie=b49c24f39c0e0f56 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d337fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d337fe700 1 -- 172.21.15.153:0/1921071096 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c0015b0 con 0x28b35b0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d337fe700 1 -- 172.21.15.153:0/1921071096 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1d4c005ad0 con 0x28b35b0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d5001ca10 con 0x28b35b0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d337fe700 1 -- 172.21.15.153:0/1921071096 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d4c015430 con 0x28b35b0 2023-08-17T00:05:12.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 10 client.5214 fetch_fsmap learned FSMap version 27 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x2801d80 con 0x28b35b0 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d337fe700 1 -- 172.21.15.153:0/1921071096 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d5001ca10 con 0x28b35b0 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d337fe700 1 -- 172.21.15.153:0/1921071096 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1d4c01e040 con 0x28b35b0 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 10 client.5214 fetch_fsmap finished waiting for FSMap version 27 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 10 client.5214 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 20 client.5214 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:12.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28cd270 0x28b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 4 client.5214 mds_command: new command op to 4971 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2023-08-17T00:05:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) v1 -- 0x26c3880 con 0x28cd270 2023-08-17T00:05:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.452+0000 7f1d58905700 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28cd270 0x28b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.456+0000 7f1d337fe700 10 client.5214 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.456+0000 7f1d58905700 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28cd270 0x28b5a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9ee221f424c05cb2 server_cookie=b3ac54259ee248d4 in_seq=0 out_seq=0 2023-08-17T00:05:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d337fe700 1 -- 172.21.15.153:0/1921071096 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x26c3880 con 0x28cd270 2023-08-17T00:05:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d337fe700 10 client.5214 handle_command_reply: tid=0 2023-08-17T00:05:12.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 client.5214 shutdown 2023-08-17T00:05:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 msgr2=0x28ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28ccd80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f1d4c001fb0 tx=0x7f1d4c01a000).stop 2023-08-17T00:05:12.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 shutdown_connections 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x28cd270 0x28b5a80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b35b0 0x28ccd80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x288cdf0 0x2935a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 --2- 172.21.15.153:0/1921071096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288ca10 0x29298f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d337fe700 0 client.5214 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 >> 172.21.15.153:0/1921071096 conn(0x266c8f0 msgr2=0x28d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 shutdown_connections 2023-08-17T00:05:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 1 -- 172.21.15.153:0/1921071096 wait complete. 2023-08-17T00:05:12.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.464+0000 7f1d64f21740 20 client.5214 trim_cache size 0 max 16384 2023-08-17T00:05:12.473 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:05:12.473 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:05:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "6b42980d-2e74-4c3c-b69b-583deeb5e140", 2023-08-17T00:05:12.474 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:05:12.474 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:05:12.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d4005a150 msgr2=0x7f1d4005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d4005a150 0x7f1d4005c610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1d5414d620 tx=0x7f1d50017000).stop 2023-08-17T00:05:12.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 msgr2=0x7f1d54157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 0x7f1d54157f50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f1d4400c4c0 tx=0x7f1d44007df0).stop 2023-08-17T00:05:12.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 shutdown_connections 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d4005a150 0x7f1d4005c610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d54153d90 0x7f1d541507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d541539b0 0x7f1d541502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 --2- 172.21.15.153:0/3946675816 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d540cb450 0x7f1d54157f50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 >> 172.21.15.153:0/3946675816 conn(0x7f1d54062a10 msgr2=0x7f1d5414dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 shutdown_connections 2023-08-17T00:05:12.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.468+0000 7f1d59907700 1 -- 172.21.15.153:0/3946675816 wait complete. 2023-08-17T00:05:12.492 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-08-17T00:05:12.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.652+0000 7fcbe648f700 1 Processor -- start 2023-08-17T00:05:12.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.652+0000 7fcbe648f700 1 -- start start 2023-08-17T00:05:12.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbe00c57a0 0x7fcbe00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbe00c11b0 0x7fcbe0154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe00bfd10 con 0x7fcbe0153f50 2023-08-17T00:05:12.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe0154860 con 0x7fcbe00c11b0 2023-08-17T00:05:12.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe0154af0 con 0x7fcbe00c57a0 2023-08-17T00:05:12.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbe00c57a0 0x7fcbe00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbe00c57a0 0x7fcbe00c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:57190/0 (socket says 172.21.15.153:57190) 2023-08-17T00:05:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 -- 172.21.15.153:0/3869647560 learned_addr learned my addr 172.21.15.153:0/3869647560 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 -- 172.21.15.153:0/3869647560 >> v2:172.21.15.153:3300/0 conn(0x7fcbe00c11b0 msgr2=0x7fcbe0154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 --2- 172.21.15.153:0/3869647560 >> v2:172.21.15.153:3300/0 conn(0x7fcbe00c11b0 0x7fcbe0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 -- 172.21.15.153:0/3869647560 >> v1:172.21.15.153:6789/0 conn(0x7fcbe0153f50 legacy=0x7fcbe0157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 -- 172.21.15.153:0/3869647560 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0154dd0 con 0x7fcbe00c57a0 2023-08-17T00:05:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe548d700 1 --2- 172.21.15.153:0/3869647560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c57a0 0x7fcbe00c5b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fcbe00c54c0 tx=0x7fcbdc0090f0).ready entity=mon.1 client_cookie=ebc229b5817bb2ee server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbd7fff700 1 -- 172.21.15.153:0/3869647560 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00b5a0 con 0x7fcbe00c57a0 2023-08-17T00:05:12.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbd7fff700 1 -- 172.21.15.153:0/3869647560 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00b700 con 0x7fcbe00c57a0 2023-08-17T00:05:12.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbd7fff700 1 -- 172.21.15.153:0/3869647560 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00ba80 con 0x7fcbe00c57a0 2023-08-17T00:05:12.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 -- 172.21.15.153:0/3869647560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c57a0 msgr2=0x7fcbe00c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.656+0000 7fcbe648f700 1 --2- 172.21.15.153:0/3869647560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c57a0 0x7fcbe00c5b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fcbe00c54c0 tx=0x7fcbdc0090f0).stop 2023-08-17T00:05:12.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 -- 172.21.15.153:0/3869647560 shutdown_connections 2023-08-17T00:05:12.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 --2- 172.21.15.153:0/3869647560 >> v2:172.21.15.153:3300/0 conn(0x7fcbe00c11b0 0x7fcbe0154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:12.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 --2- 172.21.15.153:0/3869647560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c57a0 0x7fcbe00c5b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 -- 172.21.15.153:0/3869647560 >> 172.21.15.153:0/3869647560 conn(0x7fcbe0062a70 msgr2=0x7fcbe00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 -- 172.21.15.153:0/3869647560 shutdown_connections 2023-08-17T00:05:12.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 -- 172.21.15.153:0/3869647560 wait complete. 2023-08-17T00:05:12.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 Processor -- start 2023-08-17T00:05:12.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.660+0000 7fcbe648f700 1 -- start start 2023-08-17T00:05:12.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe648f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 0x7fcbe014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe648f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbe00c57a0 0x7fcbe00c2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe648f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbe0153f50 0x7fcbe01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe648f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00accb0 con 0x7fcbe0153f50 2023-08-17T00:05:12.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe648f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00ae9a0 con 0x7fcbe00c11b0 2023-08-17T00:05:12.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe648f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe00aec80 con 0x7fcbe00c57a0 2023-08-17T00:05:12.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbe0153f50 0x7fcbe01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 0x7fcbe014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 0x7fcbe014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:57206/0 (socket says 172.21.15.153:57206) 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe548d700 1 -- 172.21.15.153:0/2228665930 learned_addr learned my addr 172.21.15.153:0/2228665930 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbe00c57a0 0x7fcbe00c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 -- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbe00c57a0 msgr2=0x7fcbe00c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbe00c57a0 0x7fcbe00c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 -- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 msgr2=0x7fcbe014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 0x7fcbe014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 -- 172.21.15.153:0/2228665930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009370 con 0x7fcbe0153f50 2023-08-17T00:05:12.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe548d700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 0x7fcbe014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:12.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbe00c57a0 0x7fcbe00c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:12.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.664+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbe0153f50 0x7fcbe01557b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fcbd800b810 tx=0x7fcbd8009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.668+0000 7fcbd57fa700 1 -- 172.21.15.153:0/2228665930 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800d4a0 con 0x7fcbe0153f50 2023-08-17T00:05:12.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.668+0000 7fcbd57fa700 1 -- 172.21.15.153:0/2228665930 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd800d620 con 0x7fcbe0153f50 2023-08-17T00:05:12.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.668+0000 7fcbd57fa700 1 -- 172.21.15.153:0/2228665930 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800d9e0 con 0x7fcbe0153f50 2023-08-17T00:05:12.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.668+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe00aef60 con 0x7fcbe0153f50 2023-08-17T00:05:12.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.668+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe00af520 con 0x7fcbe0153f50 2023-08-17T00:05:12.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.672+0000 7fcbd57fa700 1 -- 172.21.15.153:0/2228665930 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcbd8018030 con 0x7fcbe0153f50 2023-08-17T00:05:12.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.672+0000 7fcbf1ab8740 1 Processor -- start 2023-08-17T00:05:12.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.672+0000 7fcbd57fa700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbc405a1a0 0x7fcbc405c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.672+0000 7fcbf1ab8740 1 -- start start 2023-08-17T00:05:12.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.672+0000 7fcbd57fa700 1 -- 172.21.15.153:0/2228665930 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcbd80737a0 con 0x7fcbe0153f50 2023-08-17T00:05:12.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.672+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbc405a1a0 0x7fcbc405c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbc405a1a0 0x7fcbc405c660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fcbe00c9d50 tx=0x7fcbd0006ee0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 0x2221220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21cb2a0 0x21cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x211d1a0 con 0x221aed0 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21d03a0 con 0x221b2b0 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x221c180 con 0x21cb2a0 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 0x2221220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 0x2221220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36334/0 (socket says 172.21.15.153:36334) 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 -- 172.21.15.153:0/4184500953 learned_addr learned my addr 172.21.15.153:0/4184500953 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21cb2a0 0x21cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 -- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21cb2a0 msgr2=0x21cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21cb2a0 0x21cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 -- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 msgr2=0x21cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 -- 172.21.15.153:0/4184500953 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x214b010 con 0x221aed0 2023-08-17T00:05:12.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbe548d700 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 0x2221220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fcbdc006b60 tx=0x7fcbdc015000).ready entity=mon.0 client_cookie=28219ea2cde5aeef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbca7fc700 1 -- 172.21.15.153:0/4184500953 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc020070 con 0x221aed0 2023-08-17T00:05:12.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbca7fc700 1 -- 172.21.15.153:0/4184500953 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00bec0 con 0x221aed0 2023-08-17T00:05:12.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.676+0000 7fcbca7fc700 1 -- 172.21.15.153:0/4184500953 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00b870 con 0x221aed0 2023-08-17T00:05:12.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/4184500953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 msgr2=0x2221220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 0x2221220 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7fcbdc006b60 tx=0x7fcbdc015000).stop 2023-08-17T00:05:12.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/4184500953 shutdown_connections 2023-08-17T00:05:12.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21cb2a0 0x21cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/4184500953 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221aed0 0x2221220 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/4184500953 >> 172.21.15.153:0/4184500953 conn(0x1fb0680 msgr2=0x2220720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/4184500953 shutdown_connections 2023-08-17T00:05:12.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/4184500953 wait complete. 2023-08-17T00:05:12.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 -- start start 2023-08-17T00:05:12.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.680+0000 7fcbf1ab8740 1 Processor -- start 2023-08-17T00:05:12.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x221d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x2219cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x221df00 con 0x21cb2a0 2023-08-17T00:05:12.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x221e1e0 con 0x221b2b0 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x221e4c0 con 0x221aed0 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 10 client.0 ll_register_callbacks cb 0x2188400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe4c8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x221d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe4c8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:36694/0 (socket says 172.21.15.153:36694) 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe4c8c700 1 -- 172.21.15.153:0/947516042 learned_addr learned my addr 172.21.15.153:0/947516042 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x2219cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 -- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 msgr2=0x2203eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 -- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 msgr2=0x2219cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x2219cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 -- 172.21.15.153:0/947516042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe0154dd0 con 0x21cb2a0 2023-08-17T00:05:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbe548d700 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x221d360 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fcbdc026000 tx=0x7fcbdc020000).ready entity=mon.0 client_cookie=f06f0b8f53078ebe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/947516042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc006930 con 0x21cb2a0 2023-08-17T00:05:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/947516042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcbdc006b60 con 0x21cb2a0 2023-08-17T00:05:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.684+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2147cf0 con 0x21cb2a0 2023-08-17T00:05:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/947516042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbdc037450 con 0x21cb2a0 2023-08-17T00:05:12.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 10 client.5223 fetch_fsmap learned FSMap version 27 2023-08-17T00:05:12.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x21464b0 con 0x21cb2a0 2023-08-17T00:05:12.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/947516042 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2147cf0 con 0x21cb2a0 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/947516042 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcbdc0098e0 con 0x21cb2a0 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 10 client.5223 fetch_fsmap finished waiting for FSMap version 27 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 10 client.5223 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 20 client.5223 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2204f90 0x2205370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 4 client.5223 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:05:12.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x213e240 con 0x2204f90 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2204f90 0x2205370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2204f90 0x2205370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2122b231d5377c18 server_cookie=2f573dd753dddaa7 in_seq=0 out_seq=0 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbbf7fe700 10 client.5223 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/947516042 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x213e240 con 0x2204f90 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbbf7fe700 10 client.5223 handle_command_reply: tid=0 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.688+0000 7fcbf1ab8740 1 client.5223 shutdown 2023-08-17T00:05:12.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 msgr2=0x221d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x221d360 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fcbdc026000 tx=0x7fcbdc020000).stop 2023-08-17T00:05:12.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 shutdown_connections 2023-08-17T00:05:12.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x2219cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2204f90 0x2205370 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/947516042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x221d360 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbbf7fe700 0 client.5223 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 >> 172.21.15.153:0/947516042 conn(0x1fb0680 msgr2=0x221b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 shutdown_connections 2023-08-17T00:05:12.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/947516042 wait complete. 2023-08-17T00:05:12.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.692+0000 7fcbf1ab8740 20 client.5223 trim_cache size 0 max 16384 2023-08-17T00:05:12.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.716+0000 7fcbf1ab8740 1 Processor -- start 2023-08-17T00:05:12.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.716+0000 7fcbf1ab8740 1 -- start start 2023-08-17T00:05:12.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 0x2202ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221b2b0 0x2203a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2204260 con 0x221b2b0 2023-08-17T00:05:12.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x219c600 con 0x21cb2a0 2023-08-17T00:05:12.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21d0200 con 0x221aed0 2023-08-17T00:05:12.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 0x2202ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:36706/0 (socket says 172.21.15.153:36706) 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 0x2202ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:57236/0 (socket says 172.21.15.153:57236) 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 -- 172.21.15.153:0/3627447765 learned_addr learned my addr 172.21.15.153:0/3627447765 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221b2b0 0x2203a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 -- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 msgr2=0x2202ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 0x2202ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 -- 172.21.15.153:0/3627447765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221b2b0 msgr2=0x2203a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221b2b0 0x2203a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 -- 172.21.15.153:0/3627447765 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe0156000 con 0x221aed0 2023-08-17T00:05:12.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe548d700 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 0x2202ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:12.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcbd000edf0 tx=0x7fcbd0022040).ready entity=mon.2 client_cookie=8d5baef9c70c9d29 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbcaffd700 1 -- 172.21.15.153:0/3627447765 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd0020a80 con 0x221aed0 2023-08-17T00:05:12.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbcaffd700 1 -- 172.21.15.153:0/3627447765 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd0020be0 con 0x221aed0 2023-08-17T00:05:12.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbcaffd700 1 -- 172.21.15.153:0/3627447765 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd00283f0 con 0x221aed0 2023-08-17T00:05:12.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 msgr2=0x2203540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fcbd000edf0 tx=0x7fcbd0022040).stop 2023-08-17T00:05:12.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/3627447765 shutdown_connections 2023-08-17T00:05:12.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x221b2b0 0x2203a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x2203540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/3627447765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21cb2a0 0x2202ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/3627447765 >> 172.21.15.153:0/3627447765 conn(0x1fb0680 msgr2=0x21ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/3627447765 shutdown_connections 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.720+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/3627447765 wait complete. 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 -- start start 2023-08-17T00:05:12.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 Processor -- start 2023-08-17T00:05:12.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x2277d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x21fe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21fe6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2221550 con 0x21cb2a0 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21febe0 con 0x221b2b0 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x227cf30 con 0x221aed0 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbf1ab8740 10 client.0 ll_register_callbacks cb 0x7fcbdc027070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x2277d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x2277d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:36354/0 (socket says 172.21.15.153:36354) 2023-08-17T00:05:12.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 -- 172.21.15.153:0/324730254 learned_addr learned my addr 172.21.15.153:0/324730254 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:12.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x21fe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe5c8e700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21fe6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 -- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 msgr2=0x21fe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x21fe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 -- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 msgr2=0x21fe6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:12.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21fe6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.724+0000 7fcbe548d700 1 -- 172.21.15.153:0/324730254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x21464b0 con 0x21cb2a0 2023-08-17T00:05:12.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbe548d700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x2277d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fcbdc037af0 tx=0x7fcbdc02c000).ready entity=mon.0 client_cookie=3ff2ca5d39bd1c6c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/324730254 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc020040 con 0x21cb2a0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/324730254 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(36..36 src has 1..36) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcbdc037b70 con 0x21cb2a0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22204a0 con 0x21cb2a0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/324730254 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbdc037600 con 0x21cb2a0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 10 client.5229 fetch_fsmap learned FSMap version 27 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x7fcbd0020440 con 0x21cb2a0 2023-08-17T00:05:12.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/324730254 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22204a0 con 0x21cb2a0 2023-08-17T00:05:12.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/324730254 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcbdc037760 con 0x21cb2a0 2023-08-17T00:05:12.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 10 client.5229 fetch_fsmap finished waiting for FSMap version 27 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 10 client.5229 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 20 client.5229 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2202610 0x21fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 4 client.5229 mds_command: new command op to 4971 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2119200 con 0x2202610 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2202610 0x21fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:12.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbe4c8c700 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2202610 0x21fca80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6785c7d561efb6a6 server_cookie=4809bf8ccfd7949a in_seq=0 out_seq=0 2023-08-17T00:05:12.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 10 client.5229 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 1 -- 172.21.15.153:0/324730254 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+274 (crc 0 0 0) 0x2119200 con 0x2202610 2023-08-17T00:05:12.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbbf7fe700 10 client.5229 handle_command_reply: tid=0 2023-08-17T00:05:12.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.728+0000 7fcbf1ab8740 1 client.5229 shutdown 2023-08-17T00:05:12.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 msgr2=0x2277d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x2277d80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fcbdc037af0 tx=0x7fcbdc02c000).stop 2023-08-17T00:05:12.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 shutdown_connections 2023-08-17T00:05:12.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x221b2b0 0x21fe6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x221aed0 0x21fe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x2202610 0x21fca80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 --2- 172.21.15.153:0/324730254 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21cb2a0 0x2277d80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 >> 172.21.15.153:0/324730254 conn(0x1fb0680 msgr2=0x2202aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbbf7fe700 0 client.5229 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:12.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 shutdown_connections 2023-08-17T00:05:12.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 1 -- 172.21.15.153:0/324730254 wait complete. 2023-08-17T00:05:12.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbf1ab8740 20 client.5229 trim_cache size 0 max 16384 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "scrub active (259 inodes in the stack)", 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: "6b42980d-2e74-4c3c-b69b-583deeb5e140": { 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "6b42980d-2e74-4c3c-b69b-583deeb5e140", 2023-08-17T00:05:12.741 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive,scrub_mdsdir" 2023-08-17T00:05:12.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.742 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:12.742 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:05:12.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbc405a1a0 msgr2=0x7fcbc405c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbc405a1a0 0x7fcbc405c660 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7fcbe00c9d50 tx=0x7fcbd0006ee0).stop 2023-08-17T00:05:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbe0153f50 msgr2=0x7fcbe01557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbe0153f50 0x7fcbe01557b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fcbd800b810 tx=0x7fcbd8009270).stop 2023-08-17T00:05:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 shutdown_connections 2023-08-17T00:05:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbc405a1a0 0x7fcbc405c660 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbe0153f50 0x7fcbe01557b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbe00c57a0 0x7fcbe00c2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 --2- 172.21.15.153:0/2228665930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbe00c11b0 0x7fcbe014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 >> 172.21.15.153:0/2228665930 conn(0x7fcbe0062a70 msgr2=0x7fcbe0063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 shutdown_connections 2023-08-17T00:05:12.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:12.732+0000 7fcbe648f700 1 -- 172.21.15.153:0/2228665930 wait complete. 2023-08-17T00:05:12.757 INFO:tasks.cephfs.filesystem:scrub status for tag:6b42980d-2e74-4c3c-b69b-583deeb5e140 - {'path': '/', 'tag': '6b42980d-2e74-4c3c-b69b-583deeb5e140', 'options': 'recursive,scrub_mdsdir'} 2023-08-17T00:05:42.758 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-08-17T00:05:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.925+0000 7f1e2a81b700 1 Processor -- start 2023-08-17T00:05:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.925+0000 7f1e2a81b700 1 -- start start 2023-08-17T00:05:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.925+0000 7f1e2a81b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e24153ab0 0x7f1e24153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e2a81b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e240c7ba0 0x7f1e240c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e2a81b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e240aa750 con 0x7f1e240c8d50 2023-08-17T00:05:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e2a81b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240c9dd0 con 0x7f1e240c7ba0 2023-08-17T00:05:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e2a81b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e240aacf0 con 0x7f1e24153ab0 2023-08-17T00:05:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e240c7ba0 0x7f1e240c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e237fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e240c8d50 0x7f1e240c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:58214/0 (socket says 172.21.15.153:58214) 2023-08-17T00:05:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e240c7ba0 0x7f1e240c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34144/0 (socket says 172.21.15.153:34144) 2023-08-17T00:05:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e237fe700 1 -- 172.21.15.153:0/275572387 learned_addr learned my addr 172.21.15.153:0/275572387 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e23fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e24153ab0 0x7f1e24153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 -- 172.21.15.153:0/275572387 >> v2:172.21.15.178:3300/0 conn(0x7f1e24153ab0 msgr2=0x7f1e24153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 --2- 172.21.15.153:0/275572387 >> v2:172.21.15.178:3300/0 conn(0x7f1e24153ab0 0x7f1e24153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 -- 172.21.15.153:0/275572387 >> v1:172.21.15.153:6789/0 conn(0x7f1e240c8d50 legacy=0x7f1e240c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 -- 172.21.15.153:0/275572387 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e240c5ca0 con 0x7f1e240c7ba0 2023-08-17T00:05:42.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e28db8700 1 --2- 172.21.15.153:0/275572387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c7ba0 0x7f1e240c91b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f1e240cba90 tx=0x7f1e1c009780).ready entity=mon.0 client_cookie=b5c4adbc2fc475a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e22ffd700 1 -- 172.21.15.153:0/275572387 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c00e070 con 0x7f1e240c7ba0 2023-08-17T00:05:42.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e22ffd700 1 -- 172.21.15.153:0/275572387 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c00bb60 con 0x7f1e240c7ba0 2023-08-17T00:05:42.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e22ffd700 1 -- 172.21.15.153:0/275572387 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c012410 con 0x7f1e240c7ba0 2023-08-17T00:05:42.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e2a81b700 1 -- 172.21.15.153:0/275572387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c7ba0 msgr2=0x7f1e240c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.929+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/275572387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c7ba0 0x7f1e240c91b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f1e240cba90 tx=0x7f1e1c009780).stop 2023-08-17T00:05:42.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 -- 172.21.15.153:0/275572387 shutdown_connections 2023-08-17T00:05:42.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/275572387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c7ba0 0x7f1e240c91b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/275572387 >> v2:172.21.15.178:3300/0 conn(0x7f1e24153ab0 0x7f1e24153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 -- 172.21.15.153:0/275572387 >> 172.21.15.153:0/275572387 conn(0x7f1e24061fa0 msgr2=0x7f1e240623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 -- 172.21.15.153:0/275572387 shutdown_connections 2023-08-17T00:05:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 -- 172.21.15.153:0/275572387 wait complete. 2023-08-17T00:05:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.933+0000 7f1e2a81b700 1 Processor -- start 2023-08-17T00:05:42.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 -- start start 2023-08-17T00:05:42.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e240c7ba0 0x7f1e240ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 0x7f1e240af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e24153ab0 0x7f1e2414c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240af630 con 0x7f1e240c8d50 2023-08-17T00:05:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240b0910 con 0x7f1e240c7ba0 2023-08-17T00:05:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e2a81b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e240b0480 con 0x7f1e24153ab0 2023-08-17T00:05:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 0x7f1e240af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 0x7f1e240af140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34152/0 (socket says 172.21.15.153:34152) 2023-08-17T00:05:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 -- 172.21.15.153:0/1527153289 learned_addr learned my addr 172.21.15.153:0/1527153289 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e240c7ba0 0x7f1e240ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e28db8700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e24153ab0 0x7f1e2414c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 -- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e24153ab0 msgr2=0x7f1e2414c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e24153ab0 0x7f1e2414c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 -- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e240c7ba0 msgr2=0x7f1e240ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e240c7ba0 0x7f1e240ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 -- 172.21.15.153:0/1527153289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009a20 con 0x7f1e240c8d50 2023-08-17T00:05:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e28db8700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e24153ab0 0x7f1e2414c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.937+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 0x7f1e240af140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f1e18007fd0 tx=0x7f1e18007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.941+0000 7f1e0bfff700 1 -- 172.21.15.153:0/1527153289 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180072e0 con 0x7f1e240c8d50 2023-08-17T00:05:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.941+0000 7f1e0bfff700 1 -- 172.21.15.153:0/1527153289 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18007440 con 0x7f1e240c8d50 2023-08-17T00:05:42.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.941+0000 7f1e0bfff700 1 -- 172.21.15.153:0/1527153289 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e180057a0 con 0x7f1e240c8d50 2023-08-17T00:05:42.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.941+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e240af870 con 0x7f1e240c8d50 2023-08-17T00:05:42.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.941+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e240afe30 con 0x7f1e240c8d50 2023-08-17T00:05:42.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.941+0000 7f1e0bfff700 1 -- 172.21.15.153:0/1527153289 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1e18010070 con 0x7f1e240c8d50 2023-08-17T00:05:42.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.945+0000 7f1e0bfff700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e1005a150 0x7f1e1005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.945+0000 7f1e0bfff700 1 -- 172.21.15.153:0/1527153289 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f1e18073780 con 0x7f1e240c8d50 2023-08-17T00:05:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.945+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e1005a150 0x7f1e1005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.945+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e1005a150 0x7f1e1005c610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1e14009b90 tx=0x7f1e14009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.945+0000 7f1e34baa740 1 Processor -- start 2023-08-17T00:05:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 -- start start 2023-08-17T00:05:42.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 0x24e1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24eb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24eb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x23eb1a0 con 0x24e0d20 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x249f300 con 0x24c4ce0 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x249e730 con 0x24c4860 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 0x24e1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 0x24e1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34154/0 (socket says 172.21.15.153:34154) 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 -- 172.21.15.153:0/2794985704 learned_addr learned my addr 172.21.15.153:0/2794985704 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e237fe700 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e28db8700 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24eb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 -- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 msgr2=0x24eb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24eb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 -- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 msgr2=0x24eb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24eb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 -- 172.21.15.153:0/2794985704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2419010 con 0x24e0d20 2023-08-17T00:05:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.949+0000 7f1e23fff700 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 0x24e1100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f1e14011c90 tx=0x7f1e14017000).ready entity=mon.0 client_cookie=74c4a49ae114a5d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e097fa700 1 -- 172.21.15.153:0/2794985704 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e140149a0 con 0x24e0d20 2023-08-17T00:05:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e097fa700 1 -- 172.21.15.153:0/2794985704 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e14014b00 con 0x24e0d20 2023-08-17T00:05:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e097fa700 1 -- 172.21.15.153:0/2794985704 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14014e80 con 0x24e0d20 2023-08-17T00:05:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 -- 172.21.15.153:0/2794985704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 msgr2=0x24e1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 0x24e1100 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f1e14011c90 tx=0x7f1e14017000).stop 2023-08-17T00:05:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 -- 172.21.15.153:0/2794985704 shutdown_connections 2023-08-17T00:05:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24eb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 --2- 172.21.15.153:0/2794985704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24e0d20 0x24e1100 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 -- 172.21.15.153:0/2794985704 >> 172.21.15.153:0/2794985704 conn(0x227e680 msgr2=0x249f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:42.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 -- 172.21.15.153:0/2794985704 shutdown_connections 2023-08-17T00:05:42.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 -- 172.21.15.153:0/2794985704 wait complete. 2023-08-17T00:05:42.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 -- start start 2023-08-17T00:05:42.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.953+0000 7f1e34baa740 1 Processor -- start 2023-08-17T00:05:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24c6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 0x24bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24e0d20 0x24df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c6d10 con 0x24c4ce0 2023-08-17T00:05:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e2850 con 0x24e0d20 2023-08-17T00:05:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24c6e90 con 0x24c4860 2023-08-17T00:05:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 10 client.0 ll_register_callbacks cb 0x2456400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 0x24bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 0x24bffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34164/0 (socket says 172.21.15.153:34164) 2023-08-17T00:05:42.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 -- 172.21.15.153:0/1134483862 learned_addr learned my addr 172.21.15.153:0/1134483862 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:42.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e28db8700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24e0d20 0x24df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 -- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 msgr2=0x24c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 -- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24e0d20 msgr2=0x24df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24e0d20 0x24df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 -- 172.21.15.153:0/1134483862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e140118e0 con 0x24c4ce0 2023-08-17T00:05:42.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:42.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e28db8700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24e0d20 0x24df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:42.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 0x24bffe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f1e18047310 tx=0x7f1e18052040).ready entity=mon.0 client_cookie=d2ceff945ca24727 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e027fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:42.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e027fc700 1 -- 172.21.15.153:0/1134483862 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1804ab80 con 0x24c4ce0 2023-08-17T00:05:42.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e027fc700 1 -- 172.21.15.153:0/1134483862 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f1e18071e40 con 0x24c4ce0 2023-08-17T00:05:42.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23e7200 con 0x24c4ce0 2023-08-17T00:05:42.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e027fc700 1 -- 172.21.15.153:0/1134483862 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e1801ce30 con 0x24c4ce0 2023-08-17T00:05:42.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 10 client.5244 fetch_fsmap learned FSMap version 30 2023-08-17T00:05:42.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x24144b0 con 0x24c4ce0 2023-08-17T00:05:42.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e027fc700 1 -- 172.21.15.153:0/1134483862 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23e7200 con 0x24c4ce0 2023-08-17T00:05:42.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e027fc700 1 -- 172.21.15.153:0/1134483862 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e18057030 con 0x24c4ce0 2023-08-17T00:05:42.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 10 client.5244 fetch_fsmap finished waiting for FSMap version 30 2023-08-17T00:05:42.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 10 client.5244 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:42.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 20 client.5244 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:42.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24cb010 0x24cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 4 client.5244 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:05:42.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.957+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2415cf0 con 0x24cb010 2023-08-17T00:05:42.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24cb010 0x24cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e027fc700 10 client.5244 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:42.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24cb010 0x24cb3f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f3e380966a93fb4f server_cookie=72434ca977b0a2f2 in_seq=0 out_seq=0 2023-08-17T00:05:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e027fc700 1 -- 172.21.15.153:0/1134483862 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2415cf0 con 0x24cb010 2023-08-17T00:05:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e027fc700 10 client.5244 handle_command_reply: tid=0 2023-08-17T00:05:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 client.5244 shutdown 2023-08-17T00:05:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 msgr2=0x24bffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 0x24bffe0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f1e18047310 tx=0x7f1e18052040).stop 2023-08-17T00:05:42.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 shutdown_connections 2023-08-17T00:05:42.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24e0d20 0x24df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24cb010 0x24cb3f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4ce0 0x24bffe0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e027fc700 0 client.5244 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:42.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1134483862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4860 0x24c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 >> 172.21.15.153:0/1134483862 conn(0x227e680 msgr2=0x249a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:42.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 shutdown_connections 2023-08-17T00:05:42.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 1 -- 172.21.15.153:0/1134483862 wait complete. 2023-08-17T00:05:42.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.961+0000 7f1e34baa740 20 client.5244 trim_cache size 0 max 16384 2023-08-17T00:05:42.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 Processor -- start 2023-08-17T00:05:42.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 -- start start 2023-08-17T00:05:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227e680 0x249ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24c3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e67c0 con 0x24c4860 2023-08-17T00:05:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e5b80 con 0x24c4ce0 2023-08-17T00:05:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24c5760 con 0x227e680 2023-08-17T00:05:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24c3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e28db8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e23fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227e680 0x249ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24c3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34180/0 (socket says 172.21.15.153:34180) 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.981+0000 7f1e237fe700 1 -- 172.21.15.153:0/1203374619 learned_addr learned my addr 172.21.15.153:0/1203374619 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e237fe700 1 -- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227e680 msgr2=0x249ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227e680 0x249ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e237fe700 1 -- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 msgr2=0x24c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e237fe700 1 -- 172.21.15.153:0/1203374619 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e24150d70 con 0x24c4860 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e23fff700 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227e680 0x249ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e28db8700 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e237fe700 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24c3510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f1e18001140 tx=0x7f1e18055000).ready entity=mon.0 client_cookie=74c9ca5004dd2b2a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e09ffb700 1 -- 172.21.15.153:0/1203374619 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1804a950 con 0x24c4860 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e09ffb700 1 -- 172.21.15.153:0/1203374619 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18050030 con 0x24c4860 2023-08-17T00:05:42.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e09ffb700 1 -- 172.21.15.153:0/1203374619 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1804ab80 con 0x24c4860 2023-08-17T00:05:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 -- 172.21.15.153:0/1203374619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 msgr2=0x24c3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24c3510 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f1e18001140 tx=0x7f1e18055000).stop 2023-08-17T00:05:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 -- 172.21.15.153:0/1203374619 shutdown_connections 2023-08-17T00:05:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24c4ce0 0x24c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24c3510 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 --2- 172.21.15.153:0/1203374619 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x227e680 0x249ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 -- 172.21.15.153:0/1203374619 >> 172.21.15.153:0/1203374619 conn(0x24e6950 msgr2=0x24f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 -- 172.21.15.153:0/1203374619 shutdown_connections 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 -- 172.21.15.153:0/1203374619 wait complete. 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 -- start start 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.985+0000 7f1e34baa740 1 Processor -- start 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227e680 0x24c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24e49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4ce0 0x24e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c61e0 con 0x24c4860 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2504020 con 0x227e680 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24e5380 con 0x24c4ce0 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 10 client.0 ll_register_callbacks cb 0x7f1e1804a770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24e49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24e49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34196/0 (socket says 172.21.15.153:34196) 2023-08-17T00:05:42.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 -- 172.21.15.153:0/4054344261 learned_addr learned my addr 172.21.15.153:0/4054344261 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e28db8700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4ce0 0x24e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e23fff700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227e680 0x24c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 -- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4ce0 msgr2=0x24e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4ce0 0x24e4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 -- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227e680 msgr2=0x24c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227e680 0x24c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:42.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 -- 172.21.15.153:0/4054344261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2419010 con 0x24c4860 2023-08-17T00:05:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e23fff700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227e680 0x24c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e237fe700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24e49a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f1e18071d50 tx=0x7f1e18067040).ready entity=mon.0 client_cookie=f171b6c27b682585 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e027fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e027fc700 1 -- 172.21.15.153:0/4054344261 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1804a950 con 0x24c4860 2023-08-17T00:05:42.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e027fc700 1 -- 172.21.15.153:0/4054344261 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f1e18071e40 con 0x24c4860 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1e14014b00 con 0x24c4860 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e027fc700 1 -- 172.21.15.153:0/4054344261 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e1804ab80 con 0x24c4860 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 10 client.5250 fetch_fsmap learned FSMap version 30 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x7f1e240c5ca0 con 0x24c4860 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e027fc700 1 -- 172.21.15.153:0/4054344261 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18027020 con 0x24c4860 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e027fc700 1 -- 172.21.15.153:0/4054344261 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1e18071920 con 0x24c4860 2023-08-17T00:05:42.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 10 client.5250 fetch_fsmap finished waiting for FSMap version 30 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 10 client.5250 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 20 client.5250 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24e0d20 0x24fab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 4 client.5250 mds_command: new command op to 4971 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x240c240 con 0x24e0d20 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.989+0000 7f1e23fff700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24e0d20 0x24fab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e23fff700 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24e0d20 0x24fab60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e502588a660034a server_cookie=3bc805a5a2b6549b in_seq=0 out_seq=0 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e027fc700 10 client.5250 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e027fc700 1 -- 172.21.15.153:0/4054344261 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x240c240 con 0x24e0d20 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e027fc700 10 client.5250 handle_command_reply: tid=0 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 client.5250 shutdown 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 msgr2=0x24e49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24e49a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f1e18071d50 tx=0x7f1e18067040).stop 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 shutdown_connections 2023-08-17T00:05:43.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24c4ce0 0x24e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x24e0d20 0x24fab60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24c4860 0x24e49a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 --2- 172.21.15.153:0/4054344261 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x227e680 0x24c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 >> 172.21.15.153:0/4054344261 conn(0x24e6950 msgr2=0x24f4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e027fc700 0 client.5250 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 shutdown_connections 2023-08-17T00:05:43.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 1 -- 172.21.15.153:0/4054344261 wait complete. 2023-08-17T00:05:43.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e34baa740 20 client.5250 trim_cache size 0 max 16384 2023-08-17T00:05:43.003 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:05:43.003 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:05:43.003 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:05:43.004 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:05:43.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e1005a150 msgr2=0x7f1e1005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e1005a150 0x7f1e1005c610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f1e14009b90 tx=0x7f1e14009060).stop 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 msgr2=0x7f1e240af140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 0x7f1e240af140 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f1e18007fd0 tx=0x7f1e18007df0).stop 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 shutdown_connections 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e1005a150 0x7f1e1005c610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e24153ab0 0x7f1e2414c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e240c8d50 0x7f1e240af140 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 --2- 172.21.15.153:0/1527153289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e240c7ba0 0x7f1e240ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 >> 172.21.15.153:0/1527153289 conn(0x7f1e24061fa0 msgr2=0x7f1e24151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 shutdown_connections 2023-08-17T00:05:43.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:42.993+0000 7f1e2a81b700 1 -- 172.21.15.153:0/1527153289 wait complete. 2023-08-17T00:05:43.019 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:05:43.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2023-08-17T00:05:43.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.173+0000 7f8f0e1b9700 1 Processor -- start 2023-08-17T00:05:43.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0e1b9700 1 -- start start 2023-08-17T00:05:43.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0e1b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f08068820 0x7f8f08068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0e1b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f081585a0 con 0x7f8f080a8df0 2023-08-17T00:05:43.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0e1b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f08066400 con 0x7f8f080a96d0 2023-08-17T00:05:43.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0e1b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080c1ba0 con 0x7f8f08068820 2023-08-17T00:05:43.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0d1b7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8f080a8df0 0x7f8f080c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:58224/0 (socket says 172.21.15.153:58224) 2023-08-17T00:05:43.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/2832783791 learned_addr learned my addr 172.21.15.153:0/2832783791 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:43.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/2832783791 >> v2:172.21.15.178:3300/0 conn(0x7f8f08068820 0x7f8f08068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8efffff700 1 -- 172.21.15.153:0/2832783791 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131563540 0 0) 0x7f8f081585a0 con 0x7f8f080a8df0 2023-08-17T00:05:43.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8efffff700 1 -- 172.21.15.153:0/2832783791 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef40033f0 con 0x7f8f080a8df0 2023-08-17T00:05:43.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/2832783791 >> v1:172.21.15.178:6789/0 conn(0x7f8f080a96d0 legacy=0x7f8f080a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/2832783791 >> v1:172.21.15.153:6789/0 conn(0x7f8f080a8df0 legacy=0x7f8f080c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/2832783791 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f08069170 con 0x7f8f08068820 2023-08-17T00:05:43.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.177+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/2832783791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f08068c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8ef8009760 tx=0x7f8ef8009060).ready entity=mon.1 client_cookie=d48b3c86303bbce3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8efffff700 1 -- 172.21.15.153:0/2832783791 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef80090d0 con 0x7f8f08068820 2023-08-17T00:05:43.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8efffff700 1 -- 172.21.15.153:0/2832783791 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef800f510 con 0x7f8f08068820 2023-08-17T00:05:43.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8efffff700 1 -- 172.21.15.153:0/2832783791 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef800f890 con 0x7f8f08068820 2023-08-17T00:05:43.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/2832783791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 msgr2=0x7f8f08068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/2832783791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f08068c80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f8ef8009760 tx=0x7f8ef8009060).stop 2023-08-17T00:05:43.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/2832783791 shutdown_connections 2023-08-17T00:05:43.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/2832783791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f08068c80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/2832783791 >> 172.21.15.153:0/2832783791 conn(0x7f8f080c6620 msgr2=0x7f8f080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/2832783791 shutdown_connections 2023-08-17T00:05:43.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.181+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/2832783791 wait complete. 2023-08-17T00:05:43.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 Processor -- start 2023-08-17T00:05:43.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 -- start start 2023-08-17T00:05:43.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f081585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 0x7f8f08155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f080a96d0 0x7f8f080bf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08159770 con 0x7f8f080a8df0 2023-08-17T00:05:43.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08158b60 con 0x7f8f08068820 2023-08-17T00:05:43.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0e1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08158e40 con 0x7f8f080a96d0 2023-08-17T00:05:43.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0c9b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 0x7f8f08155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0c9b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 0x7f8f08155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34198/0 (socket says 172.21.15.153:34198) 2023-08-17T00:05:43.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.185+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/4120462871 learned_addr learned my addr 172.21.15.153:0/4120462871 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0d9b8700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f080a96d0 0x7f8f080bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f081585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f080a96d0 msgr2=0x7f8f080bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f080a96d0 0x7f8f080bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 msgr2=0x7f8f081585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f081585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/4120462871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef80092a0 con 0x7f8f080a8df0 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f081585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 0x7f8f08155570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f8ef8009e00 tx=0x7f8ef8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8efd7fa700 1 -- 172.21.15.153:0/4120462871 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8011ca0 con 0x7f8f080a8df0 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8efd7fa700 1 -- 172.21.15.153:0/4120462871 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef8011e00 con 0x7f8f080a8df0 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f08159120 con 0x7f8f080a8df0 2023-08-17T00:05:43.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8efd7fa700 1 -- 172.21.15.153:0/4120462871 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef801b670 con 0x7f8f080a8df0 2023-08-17T00:05:43.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.189+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08155a60 con 0x7f8f080a8df0 2023-08-17T00:05:43.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.193+0000 7f8efd7fa700 1 -- 172.21.15.153:0/4120462871 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8ef800f070 con 0x7f8f080a8df0 2023-08-17T00:05:43.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.193+0000 7f8efd7fa700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8eec05a150 0x7f8eec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.193+0000 7f8efd7fa700 1 -- 172.21.15.153:0/4120462871 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f8ef80759f0 con 0x7f8f080a8df0 2023-08-17T00:05:43.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.193+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8eec05a150 0x7f8eec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8eec05a150 0x7f8eec05c610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8f04000c00 tx=0x7f8f04009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 Processor -- start 2023-08-17T00:05:43.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 -- start start 2023-08-17T00:05:43.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x13076d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1210160 con 0x12c3c20 2023-08-17T00:05:43.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1230ff0 con 0x12c37a0 2023-08-17T00:05:43.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1305c60 con 0x13072f0 2023-08-17T00:05:43.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12c07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34210/0 (socket says 172.21.15.153:34210) 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 -- 172.21.15.153:0/450516640 learned_addr learned my addr 172.21.15.153:0/450516640 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x13076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 -- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 msgr2=0x13076d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x13076d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 -- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 msgr2=0x12c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.197+0000 7f8f0d9b8700 1 -- 172.21.15.153:0/450516640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x123dfd0 con 0x12c3c20 2023-08-17T00:05:43.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f0d9b8700 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12c07b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f8f00003bf0 tx=0x7f8f00009040).ready entity=mon.0 client_cookie=bba2c0d205ba005c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8ef27fc700 1 -- 172.21.15.153:0/450516640 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00006c30 con 0x12c3c20 2023-08-17T00:05:43.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8ef27fc700 1 -- 172.21.15.153:0/450516640 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00006d90 con 0x12c3c20 2023-08-17T00:05:43.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8ef27fc700 1 -- 172.21.15.153:0/450516640 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00007280 con 0x12c3c20 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 -- 172.21.15.153:0/450516640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 msgr2=0x12c07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12c07b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f8f00003bf0 tx=0x7f8f00009040).stop 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 -- 172.21.15.153:0/450516640 shutdown_connections 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12c07b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 --2- 172.21.15.153:0/450516640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x13076d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 -- 172.21.15.153:0/450516640 >> 172.21.15.153:0/450516640 conn(0x10a3640 msgr2=0x12c4200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 -- 172.21.15.153:0/450516640 shutdown_connections 2023-08-17T00:05:43.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 -- 172.21.15.153:0/450516640 wait complete. 2023-08-17T00:05:43.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.201+0000 7f8f19790740 1 -- start start 2023-08-17T00:05:43.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 Processor -- start 2023-08-17T00:05:43.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12e9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x12bd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12ec7e0 con 0x12c3c20 2023-08-17T00:05:43.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x13166a0 con 0x12c37a0 2023-08-17T00:05:43.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12ea360 con 0x13072f0 2023-08-17T00:05:43.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 10 client.0 ll_register_callbacks cb 0x127b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:43.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12ec2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34220/0 (socket says 172.21.15.153:34220) 2023-08-17T00:05:43.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/832776690 learned_addr learned my addr 172.21.15.153:0/832776690 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12e9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0d9b8700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x12bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 msgr2=0x12bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x12bd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 msgr2=0x12e9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12e9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 -- 172.21.15.153:0/832776690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0000f040 con 0x12c3c20 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12ec2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f8ef8049440 tx=0x7f8ef8003040).ready entity=mon.0 client_cookie=6d63e2983bd50063 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8ee77fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8ee77fe700 1 -- 172.21.15.153:0/832776690 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef804cd00 con 0x12c3c20 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8ee77fe700 1 -- 172.21.15.153:0/832776690 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f8ef8023570 con 0x12c3c20 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x123acb0 con 0x12c3c20 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8ee77fe700 1 -- 172.21.15.153:0/832776690 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ef804c480 con 0x12c3c20 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 10 client.5262 fetch_fsmap learned FSMap version 30 2023-08-17T00:05:43.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.205+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x1239470 con 0x12c3c20 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8ee77fe700 1 -- 172.21.15.153:0/832776690 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x123acb0 con 0x12c3c20 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8ee77fe700 1 -- 172.21.15.153:0/832776690 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8ef8051040 con 0x12c3c20 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 10 client.5262 fetch_fsmap finished waiting for FSMap version 30 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 10 client.5262 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 20 client.5262 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x12ee800 0x12eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 4 client.5262 mds_command: new command op to 4971 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:05:43.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1231200 con 0x12ee800 2023-08-17T00:05:43.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x12ee800 0x12eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x12ee800 0x12eebe0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a5d0b9523d2d3efa server_cookie=27e5cb7d9f8eb700 in_seq=0 out_seq=0 2023-08-17T00:05:43.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8ee77fe700 10 client.5262 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:43.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8ee77fe700 1 -- 172.21.15.153:0/832776690 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1231200 con 0x12ee800 2023-08-17T00:05:43.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8ee77fe700 10 client.5262 handle_command_reply: tid=0 2023-08-17T00:05:43.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 client.5262 shutdown 2023-08-17T00:05:43.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 msgr2=0x12ec2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12ec2f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f8ef8049440 tx=0x7f8ef8003040).stop 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 shutdown_connections 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x13072f0 0x12bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x12ee800 0x12eebe0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c3c20 0x12ec2f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 --2- 172.21.15.153:0/832776690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c37a0 0x12e9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 >> 172.21.15.153:0/832776690 conn(0x10a3640 msgr2=0x12c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8ee77fe700 0 client.5262 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:43.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 shutdown_connections 2023-08-17T00:05:43.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 1 -- 172.21.15.153:0/832776690 wait complete. 2023-08-17T00:05:43.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.209+0000 7f8f19790740 20 client.5262 trim_cache size 0 max 16384 2023-08-17T00:05:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.225+0000 7f8f19790740 1 Processor -- start 2023-08-17T00:05:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 -- start start 2023-08-17T00:05:43.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c37a0 0x131f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c3c20 0x131fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x13072f0 0x1304c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1219e80 con 0x13072f0 2023-08-17T00:05:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x12bfb70 con 0x12c3c20 2023-08-17T00:05:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x123acb0 con 0x12c37a0 2023-08-17T00:05:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x13072f0 0x1304c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x13072f0 0x1304c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34232/0 (socket says 172.21.15.153:34232) 2023-08-17T00:05:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d9b8700 1 -- 172.21.15.153:0/3452960621 learned_addr learned my addr 172.21.15.153:0/3452960621 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c3c20 0x131fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c37a0 0x131f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c3c20 msgr2=0x131fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c3c20 0x131fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/3452960621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x13072f0 msgr2=0x1304c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x13072f0 0x1304c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/3452960621 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080c5dd0 con 0x12c37a0 2023-08-17T00:05:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c37a0 0x131f800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x12ef310 tx=0x7f8f04007000).ready entity=mon.2 client_cookie=6d3690eafdefdd33 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8ef2ffd700 1 -- 172.21.15.153:0/3452960621 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0401c040 con 0x12c37a0 2023-08-17T00:05:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8ef2ffd700 1 -- 172.21.15.153:0/3452960621 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04026070 con 0x12c37a0 2023-08-17T00:05:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8ef2ffd700 1 -- 172.21.15.153:0/3452960621 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04005e80 con 0x12c37a0 2023-08-17T00:05:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 -- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c37a0 msgr2=0x131f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.229+0000 7f8f19790740 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c37a0 0x131f800 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x12ef310 tx=0x7f8f04007000).stop 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- 172.21.15.153:0/3452960621 shutdown_connections 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x13072f0 0x1304c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c3c20 0x131fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 --2- 172.21.15.153:0/3452960621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c37a0 0x131f800 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- 172.21.15.153:0/3452960621 >> 172.21.15.153:0/3452960621 conn(0x10a3640 msgr2=0x12c22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- 172.21.15.153:0/3452960621 shutdown_connections 2023-08-17T00:05:43.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- 172.21.15.153:0/3452960621 wait complete. 2023-08-17T00:05:43.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- start start 2023-08-17T00:05:43.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 Processor -- start 2023-08-17T00:05:43.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 0x131fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c3c20 0x13619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13072f0 0x1361ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12eae80 con 0x12c37a0 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x13623d0 con 0x13072f0 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12bdc00 con 0x12c3c20 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f19790740 10 client.0 ll_register_callbacks cb 0x7f8ef804cb10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 0x131fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 0x131fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34248/0 (socket says 172.21.15.153:34248) 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/2675353329 learned_addr learned my addr 172.21.15.153:0/2675353329 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c3c20 0x13619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d9b8700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13072f0 0x1361ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c3c20 msgr2=0x13619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c3c20 0x13619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13072f0 msgr2=0x1361ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13072f0 0x1361ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.233+0000 7f8f0d1b7700 1 -- 172.21.15.153:0/2675353329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef40033f0 con 0x12c37a0 2023-08-17T00:05:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f0d1b7700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 0x131fc40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f8f04002490 tx=0x7f8f04017000).ready entity=mon.0 client_cookie=7ed3baa781b97541 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:05:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 1 -- 172.21.15.153:0/2675353329 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040226d0 con 0x12c37a0 2023-08-17T00:05:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f00006d90 con 0x12c37a0 2023-08-17T00:05:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 1 -- 172.21.15.153:0/2675353329 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f8f04022830 con 0x12c37a0 2023-08-17T00:05:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 1 -- 172.21.15.153:0/2675353329 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f04022c00 con 0x12c37a0 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 10 client.5268 fetch_fsmap learned FSMap version 30 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x12391c0 con 0x12c37a0 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 1 -- 172.21.15.153:0/2675353329 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00006d90 con 0x12c37a0 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 1 -- 172.21.15.153:0/2675353329 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8f0402c460 con 0x12c37a0 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 10 client.5268 fetch_fsmap finished waiting for FSMap version 30 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 10 client.5268 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 20 client.5268 populate_metadata read hostname 'smithi153' 2023-08-17T00:05:43.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x1364a80 0x1304c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 4 client.5268 mds_command: new command op to 4971 tid=0[{"prefix": "perf dump"}] 2023-08-17T00:05:43.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 --> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x10fa5d0 con 0x1364a80 2023-08-17T00:05:43.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x1364a80 0x1304c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8f0c9b6700 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x1364a80 0x1304c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7794d40b3988f0bb server_cookie=fc15953b699e6a69 in_seq=0 out_seq=0 2023-08-17T00:05:43.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.237+0000 7f8ee77fe700 10 client.5268 ms_handle_connect on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8ee77fe700 1 -- 172.21.15.153:0/2675353329 <== mds.0 v2:172.21.15.153:6834/1653485600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17057 (crc 0 0 0) 0x10fa5d0 con 0x1364a80 2023-08-17T00:05:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8ee77fe700 10 client.5268 handle_command_reply: tid=0 2023-08-17T00:05:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 client.5268 shutdown 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 msgr2=0x131fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 0x131fc40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f8f04002490 tx=0x7f8f04017000).stop 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 shutdown_connections 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x13072f0 0x1361ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c3c20 0x13619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:6834/1653485600,v1:172.21.15.153:6835/1653485600] conn(0x1364a80 0x1304c30 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 --2- 172.21.15.153:0/2675353329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c37a0 0x131fc40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 >> 172.21.15.153:0/2675353329 conn(0x10a3640 msgr2=0x12c4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8ee77fe700 0 client.5268 ms_handle_reset on v2:172.21.15.153:6834/1653485600 2023-08-17T00:05:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 shutdown_connections 2023-08-17T00:05:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 1 -- 172.21.15.153:0/2675353329 wait complete. 2023-08-17T00:05:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f19790740 20 client.5268 trim_cache size 0 max 16384 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 5516, 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 5513, 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1611149, 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 34118733, 2023-08-17T00:05:43.249 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 17, 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 6, 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.852078119, 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.436217903, 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.138026525, 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.210441591, 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:05:43.250 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5512, 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 8.451648176, 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001533317 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10, 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000001659, 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000165 2023-08-17T00:05:43.251 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 5689, 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 5666, 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1779685, 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 32255581, 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 5, 2023-08-17T00:05:43.252 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.710874916, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.342763545, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.130763574, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.191180878, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5666, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.070346132, 2023-08-17T00:05:43.253 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000541889 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.254 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 33151, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 55747, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 11514885, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 55944935, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 8, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:05:43.255 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 10.587493023, 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 8.655358256, 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 2.152499691, 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.284554160, 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 55745, 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.893723184, 2023-08-17T00:05:43.256 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000087787 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 50672, 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.015389539, 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000303 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.257 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6015, 2023-08-17T00:05:43.258 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 20.782553580, 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003455121 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3131, 2023-08-17T00:05:43.259 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.726433408, 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000551400 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 28572, 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 28572, 2023-08-17T00:05:43.260 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 28572, 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 747.668790934, 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.026167884 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2023-08-17T00:05:43.261 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch": 0, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 63, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 7658, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 5352, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 2306, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2023-08-17T00:05:43.262 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 11, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 8001, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 2, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 2, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 2, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 134305, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 131109, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2023-08-17T00:05:43.263 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 1979, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 12053, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2023-08-17T00:05:43.264 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 1775, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2023-08-17T00:05:43.265 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 1775, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 13, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 2, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 11, 2023-08-17T00:05:43.266 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 1762, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 2189, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 5827, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 5270, 2023-08-17T00:05:43.267 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 2000, 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 67, 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 13956 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2023-08-17T00:05:43.268 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 4250, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 3654, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 4568, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-08-17T00:05:43.269 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 1, 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-08-17T00:05:43.270 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 26095, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 25910, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 25910, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 1209, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 1024, 2023-08-17T00:05:43.271 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 32, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 31, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 31, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 2, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 1, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 85980246, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 86092054, 2023-08-17T00:05:43.272 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4515, 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 107.756277205, 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.023866285 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.273 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 14, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 2016, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 2002, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 13, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 13, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 0, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 7766, 2023-08-17T00:05:43.274 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 20022, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 12256, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 2, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 9112, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 9110, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 82352, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 340196 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.275 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 73422, 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 28572, 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 7, 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-08-17T00:05:43.276 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2000, 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.568616762, 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001284308 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.001925013, 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000240626 2023-08-17T00:05:43.277 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6000, 2023-08-17T00:05:43.278 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 11.523985464, 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001920664 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 7983, 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.245165167, 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000531775 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.279 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.280 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.281 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000197985, 2023-08-17T00:05:43.282 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000197985 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-08-17T00:05:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.006026584, 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.006026584 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.014648629, 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014648629 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.285 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-08-17T00:05:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:05:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.119574408, 2023-08-17T00:05:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014946801 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4568, 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 699.321269101, 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.153091346 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-08-17T00:05:43.287 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.288 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.018928280, 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.018928280 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.289 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000585659, 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000585659 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.290 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.291 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.292 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.293 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8000, 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 29.847867882, 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003730983 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-08-17T00:05:43.294 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.295 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 16993, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 16993, 2023-08-17T00:05:43.296 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 109 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 19052, 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 19052, 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-08-17T00:05:43.297 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-08-17T00:05:43.298 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_bytes": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_items": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_bytes": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_items": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_bytes": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_items": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_bytes": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_items": 0, 2023-08-17T00:05:43.299 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-17T00:05:43.300 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-08-17T00:05:43.301 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 175602, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 94, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-08-17T00:05:43.302 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 6880, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 94, 2023-08-17T00:05:43.303 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 5793940, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 304083, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-08-17T00:05:43.304 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-08-17T00:05:43.305 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 14766, 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 93927589, 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 32, 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 14765, 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 14765, 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 23842 2023-08-17T00:05:43.306 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 14765, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 1850, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 12915, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 50, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 4456, 2023-08-17T00:05:43.307 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 73, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 4586, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 70, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 1654, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2023-08-17T00:05:43.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 2050, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1777, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 8912, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-08-17T00:05:43.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-08-17T00:05:43.310 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-08-17T00:05:43.311 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-08-17T00:05:43.312 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 38, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 5, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 8, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 8, 2023-08-17T00:05:43.313 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 163, 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 51 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-08-17T00:05:43.314 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 32, 2023-08-17T00:05:43.315 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 32, 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 3654, 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:43.316 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 44352, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 11378913, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 44352, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:05:43.317 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 44352, 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 11378913, 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.318 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:05:43.319 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 14765, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 94309875, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 14765, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 94309875, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.320 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:43.321 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 14765, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 14765, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 14765, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 14765, 2023-08-17T00:05:43.322 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-08-17T00:05:43.323 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 3654, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 382286, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 3654, 2023-08-17T00:05:43.324 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 71, 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 382286, 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.325 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x5650caa71cc0": { 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 26095, 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 81897750, 2023-08-17T00:05:43.326 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 26095, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4515, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 81897750, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:05:43.327 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:05:43.328 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:05:43.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.328 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:43.328 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8eec05a150 msgr2=0x7f8eec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8eec05a150 0x7f8eec05c610 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8f04000c00 tx=0x7f8f04009040).stop 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 msgr2=0x7f8f08155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 0x7f8f08155570 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f8ef8009e00 tx=0x7f8ef8017000).stop 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 shutdown_connections 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8eec05a150 0x7f8eec05c610 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f080a96d0 0x7f8f080bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8f080a8df0 0x7f8f08155570 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 --2- 172.21.15.153:0/4120462871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f08068820 0x7f8f081585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 >> 172.21.15.153:0/4120462871 conn(0x7f8f080c6620 msgr2=0x7f8f08157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 shutdown_connections 2023-08-17T00:05:43.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.241+0000 7f8f0e1b9700 1 -- 172.21.15.153:0/4120462871 wait complete. 2023-08-17T00:05:43.331 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:05:43.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:05:43.375 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:05:43.419 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:05:43.419 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:05:43.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:05:43.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:05:43.514 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:05:43.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:05:43.515 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:05:43.534 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:05:43.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.733+0000 7f3149c9b700 1 Processor -- start 2023-08-17T00:05:43.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.733+0000 7f3149c9b700 1 -- start start 2023-08-17T00:05:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f3149c9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3144151b90 0x7f3144151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f3149c9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f3144065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f3149c9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3144061fa0 con 0x7f3144065b50 2023-08-17T00:05:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f3149c9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440c3fb0 con 0x7f3144151b90 2023-08-17T00:05:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f3149c9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3144152460 con 0x7f3144063290 2023-08-17T00:05:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f31437fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3144151b90 0x7f3144151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f31437fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3144151b90 0x7f3144151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:33522/0 (socket says 172.21.15.153:33522) 2023-08-17T00:05:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f31437fe700 1 -- 172.21.15.153:0/3694775087 learned_addr learned my addr 172.21.15.153:0/3694775087 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.737+0000 7f3142ffd700 1 --2- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f3144065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31437fe700 1 -- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 msgr2=0x7f3144065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31437fe700 1 --2- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f3144065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31437fe700 1 -- 172.21.15.153:0/3694775087 >> v1:172.21.15.178:6789/0 conn(0x7f3144065b50 legacy=0x7f3144064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31437fe700 1 -- 172.21.15.153:0/3694775087 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440621f0 con 0x7f3144151b90 2023-08-17T00:05:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31437fe700 1 --2- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f3144151f70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3134006fd0 tx=0x7f31340090f0).ready entity=mon.1 client_cookie=a494ee3bc8f805b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31427fc700 1 -- 172.21.15.153:0/3694775087 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400b580 con 0x7f3144151b90 2023-08-17T00:05:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31427fc700 1 -- 172.21.15.153:0/3694775087 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313400b6e0 con 0x7f3144151b90 2023-08-17T00:05:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f31427fc700 1 -- 172.21.15.153:0/3694775087 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400ba80 con 0x7f3144151b90 2023-08-17T00:05:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 -- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 msgr2=0x7f3144151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f3144151f70 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3134006fd0 tx=0x7f31340090f0).stop 2023-08-17T00:05:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 -- 172.21.15.153:0/3694775087 shutdown_connections 2023-08-17T00:05:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f3144065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3694775087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f3144151f70 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 -- 172.21.15.153:0/3694775087 >> 172.21.15.153:0/3694775087 conn(0x7f31440c7150 msgr2=0x7f31440c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 -- 172.21.15.153:0/3694775087 shutdown_connections 2023-08-17T00:05:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.741+0000 7f3149c9b700 1 -- 172.21.15.153:0/3694775087 wait complete. 2023-08-17T00:05:43.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.745+0000 7f3149c9b700 1 Processor -- start 2023-08-17T00:05:43.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.745+0000 7f3149c9b700 1 -- start start 2023-08-17T00:05:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f31440a7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144065b50 0x7f31440bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f31440be130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c1a80 con 0x7f3144065b50 2023-08-17T00:05:43.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c1d20 con 0x7f3144151b90 2023-08-17T00:05:43.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c2000 con 0x7f3144063290 2023-08-17T00:05:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f31437fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f31440a7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144065b50 0x7f31440bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f31437fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f31440a7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:58652/0 (socket says 172.21.15.153:58652) 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f31437fe700 1 -- 172.21.15.153:0/3734814188 learned_addr learned my addr 172.21.15.153:0/3734814188 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3143fff700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f31440be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 -- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 msgr2=0x7f31440a7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f31440a7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 -- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 msgr2=0x7f31440be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f31440be130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 -- 172.21.15.153:0/3734814188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134009370 con 0x7f3144065b50 2023-08-17T00:05:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3142ffd700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144065b50 0x7f31440bd720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f313800e850 tx=0x7f3138009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138012600 con 0x7f3144065b50 2023-08-17T00:05:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138012760 con 0x7f3144065b50 2023-08-17T00:05:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440c22e0 con 0x7f3144065b50 2023-08-17T00:05:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138012ae0 con 0x7f3144065b50 2023-08-17T00:05:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.749+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31440a7580 con 0x7f3144065b50 2023-08-17T00:05:43.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.753+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314406b530 con 0x7f3144065b50 2023-08-17T00:05:43.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.753+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3138022070 con 0x7f3144065b50 2023-08-17T00:05:43.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.753+0000 7f312b7fe700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f313005a120 0x7f313005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:43.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.753+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f3138074620 con 0x7f3144065b50 2023-08-17T00:05:43.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.757+0000 7f31437fe700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f313005a120 0x7f313005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:43.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.757+0000 7f31437fe700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f313005a120 0x7f313005c5e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3134009fd0 tx=0x7f3134017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:43.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.761+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3138047f80 con 0x7f3144065b50 2023-08-17T00:05:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.953+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31440bb8b0 con 0x7f3144065b50 2023-08-17T00:05:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f312b7fe700 1 -- 172.21.15.153:0/3734814188 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f3138016020 con 0x7f3144065b50 2023-08-17T00:05:43.961 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:43.961 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:03:41.953300+0000","modified":"2023-08-17T00:05:26.313106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/1653485600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1653485600},{"type":"v1","addr":"172.21.15.153:6835","nonce":1653485600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T00:05:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f313005a120 msgr2=0x7f313005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f313005a120 0x7f313005c5e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f3134009fd0 tx=0x7f3134017000).stop 2023-08-17T00:05:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144065b50 msgr2=0x7f31440bd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144065b50 0x7f31440bd720 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f313800e850 tx=0x7f3138009060).stop 2023-08-17T00:05:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 shutdown_connections 2023-08-17T00:05:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f313005a120 0x7f313005c5e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144151b90 0x7f31440be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144065b50 0x7f31440bd720 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 --2- 172.21.15.153:0/3734814188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144063290 0x7f31440a7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 >> 172.21.15.153:0/3734814188 conn(0x7f31440c7150 msgr2=0x7f314414f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:43.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.957+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 shutdown_connections 2023-08-17T00:05:43.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:43.961+0000 7f3149c9b700 1 -- 172.21.15.153:0/3734814188 wait complete. 2023-08-17T00:05:43.966 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 30 2023-08-17T00:05:43.983 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:05:44.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 Processor -- start 2023-08-17T00:05:44.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 -- start start 2023-08-17T00:05:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f678c068f30 0x7f678c0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f678c0ac2f0 0x7f678c0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f678c1545e0 con 0x7f678c0abf10 2023-08-17T00:05:44.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c0c1c50 con 0x7f678c0ac2f0 2023-08-17T00:05:44.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f678c064b80 con 0x7f678c068f30 2023-08-17T00:05:44.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f678c0ac2f0 0x7f678c0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f678c0ac2f0 0x7f678c0c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34260/0 (socket says 172.21.15.153:34260) 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f678ad9d700 1 -- 172.21.15.153:0/1822625548 learned_addr learned my addr 172.21.15.153:0/1822625548 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.129+0000 7f6781d9b700 1 --2- 172.21.15.153:0/1822625548 >> v2:172.21.15.178:3300/0 conn(0x7f678c068f30 0x7f678c0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678ad9d700 1 -- 172.21.15.153:0/1822625548 >> v2:172.21.15.178:3300/0 conn(0x7f678c068f30 msgr2=0x7f678c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678ad9d700 1 --2- 172.21.15.153:0/1822625548 >> v2:172.21.15.178:3300/0 conn(0x7f678c068f30 0x7f678c0c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678ad9d700 1 -- 172.21.15.153:0/1822625548 >> v1:172.21.15.153:6789/0 conn(0x7f678c0abf10 legacy=0x7f678c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678ad9d700 1 -- 172.21.15.153:0/1822625548 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c0c1460 con 0x7f678c0ac2f0 2023-08-17T00:05:44.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678ad9d700 1 --2- 172.21.15.153:0/1822625548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c0ac2f0 0x7f678c0c0f70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f678c0693d0 tx=0x7f6784009840).ready entity=mon.0 client_cookie=1343c295be2956c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f6789d9b700 1 -- 172.21.15.153:0/1822625548 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400e070 con 0x7f678c0ac2f0 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f6789d9b700 1 -- 172.21.15.153:0/1822625548 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678400ba20 con 0x7f678c0ac2f0 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f6789d9b700 1 -- 172.21.15.153:0/1822625548 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678400bda0 con 0x7f678c0ac2f0 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 -- 172.21.15.153:0/1822625548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c0ac2f0 msgr2=0x7f678c0c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 --2- 172.21.15.153:0/1822625548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c0ac2f0 0x7f678c0c0f70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f678c0693d0 tx=0x7f6784009840).stop 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 -- 172.21.15.153:0/1822625548 shutdown_connections 2023-08-17T00:05:44.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 --2- 172.21.15.153:0/1822625548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c0ac2f0 0x7f678c0c0f70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 --2- 172.21.15.153:0/1822625548 >> v2:172.21.15.178:3300/0 conn(0x7f678c068f30 0x7f678c0c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 -- 172.21.15.153:0/1822625548 >> 172.21.15.153:0/1822625548 conn(0x7f678c0c6620 msgr2=0x7f678c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 -- 172.21.15.153:0/1822625548 shutdown_connections 2023-08-17T00:05:44.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.133+0000 7f678b59e700 1 -- 172.21.15.153:0/1822625548 wait complete. 2023-08-17T00:05:44.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 Processor -- start 2023-08-17T00:05:44.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 -- start start 2023-08-17T00:05:44.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 0x7f678c1652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f678c0abf10 0x7f678c166f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f678c0ac2f0 0x7f678c0bfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c14ad20 con 0x7f678c068f30 2023-08-17T00:05:44.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c14a460 con 0x7f678c0ac2f0 2023-08-17T00:05:44.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c14a6d0 con 0x7f678c0abf10 2023-08-17T00:05:44.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 0x7f678c1652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 0x7f678c1652d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34274/0 (socket says 172.21.15.153:34274) 2023-08-17T00:05:44.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.137+0000 7f678a59c700 1 -- 172.21.15.153:0/2465744477 learned_addr learned my addr 172.21.15.153:0/2465744477 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:44.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678ad9d700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f678c0ac2f0 0x7f678c0bfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f6781d9b700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f678c0abf10 0x7f678c166f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678a59c700 1 -- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f678c0abf10 msgr2=0x7f678c166f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678a59c700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f678c0abf10 0x7f678c166f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678a59c700 1 -- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f678c0ac2f0 msgr2=0x7f678c0bfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678a59c700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f678c0ac2f0 0x7f678c0bfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678a59c700 1 -- 172.21.15.153:0/2465744477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6784009ae0 con 0x7f678c068f30 2023-08-17T00:05:44.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678a59c700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 0x7f678c1652d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f677c00c4f0 tx=0x7f677c007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c013450 con 0x7f678c068f30 2023-08-17T00:05:44.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0135b0 con 0x7f678c068f30 2023-08-17T00:05:44.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f678c0a96d0 con 0x7f678c068f30 2023-08-17T00:05:44.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c013930 con 0x7f678c068f30 2023-08-17T00:05:44.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f678c0c0440 con 0x7f678c068f30 2023-08-17T00:05:44.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.141+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f678c06b4c0 con 0x7f678c068f30 2023-08-17T00:05:44.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:05:44.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.145+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f677c010070 con 0x7f678c068f30 2023-08-17T00:05:44.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.145+0000 7f6782ffd700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f676c05a150 0x7f676c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.153 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:05:44.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.145+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f677c073cf0 con 0x7f678c068f30 2023-08-17T00:05:44.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.145+0000 7f6781d9b700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f676c05a150 0x7f676c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.145+0000 7f6781d9b700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f676c05a150 0x7f676c05c610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f678c161d40 tx=0x7f6774008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.153+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f677c0476c0 con 0x7f678c068f30 2023-08-17T00:05:44.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.317+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f678c0c1690 con 0x7f678c068f30 2023-08-17T00:05:44.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.317+0000 7f6782ffd700 1 -- 172.21.15.153:0/2465744477 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17372 (secure 0 0 0) 0x7f677c04ace0 con 0x7f678c068f30 2023-08-17T00:05:44.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:44.324 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:05:22.108566+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:03:39.751729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T00:03:40.984291+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]},{"pgid":"6.20","mappings":[{"from":4,"to":2}]},{"pgid":"6.26","mappings":[{"from":4,"to":7}]},{"pgid":"6.2f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:05:44.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.321+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f676c05a150 msgr2=0x7f676c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.321+0000 7f678b59e700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f676c05a150 0x7f676c05c610 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f678c161d40 tx=0x7f6774008040).stop 2023-08-17T00:05:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 msgr2=0x7f678c1652d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 0x7f678c1652d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f677c00c4f0 tx=0x7f677c007d80).stop 2023-08-17T00:05:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 shutdown_connections 2023-08-17T00:05:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f676c05a150 0x7f676c05c610 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f678c0ac2f0 0x7f678c0bfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f678c0abf10 0x7f678c166f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 --2- 172.21.15.153:0/2465744477 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f678c068f30 0x7f678c1652d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 >> 172.21.15.153:0/2465744477 conn(0x7f678c0c6620 msgr2=0x7f678c14de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 shutdown_connections 2023-08-17T00:05:44.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.325+0000 7f678b59e700 1 -- 172.21.15.153:0/2465744477 wait complete. 2023-08-17T00:05:44.347 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:03:39.751729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:03:40.984291+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 37, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:05:44.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:05:44.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aab61b700 1 Processor -- start 2023-08-17T00:05:44.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aab61b700 1 -- start start 2023-08-17T00:05:44.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aab61b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8aa40bc4d0 0x7f8aa40a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aab61b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa4065240 con 0x7f8aa40a8b70 2023-08-17T00:05:44.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aab61b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa40638a0 con 0x7f8aa40632e0 2023-08-17T00:05:44.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aab61b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa4065de0 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aa9bb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8aa40bc4d0 0x7f8aa40a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aa93b7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8aa40a8b70 0x7f8aa40656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:58248/0 (socket says 172.21.15.153:58248) 2023-08-17T00:05:44.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.505+0000 7f8aa93b7700 1 -- 172.21.15.153:0/2372884040 learned_addr learned my addr 172.21.15.153:0/2372884040 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:44.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8a9bfff700 1 -- 172.21.15.153:0/2372884040 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699576717 0 0) 0x7f8aa4065240 con 0x7f8aa40a8b70 2023-08-17T00:05:44.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8a9bfff700 1 -- 172.21.15.153:0/2372884040 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a900033f0 con 0x7f8aa40a8b70 2023-08-17T00:05:44.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2372884040 >> v1:172.21.15.178:6789/0 conn(0x7f8aa40632e0 legacy=0x7f8aa40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8a9bfff700 1 -- 172.21.15.153:0/2372884040 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1502606294 0 0) 0x7f8aa40638a0 con 0x7f8aa40632e0 2023-08-17T00:05:44.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2372884040 >> v1:172.21.15.153:6789/0 conn(0x7f8aa40a8b70 legacy=0x7f8aa40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2372884040 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa4064910 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aa9bb8700 1 --2- 172.21.15.153:0/2372884040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40a8f50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f8a9c009e60 tx=0x7f8a9c009780).ready entity=mon.0 client_cookie=9cc00fdf97a6a315 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8a9bfff700 1 -- 172.21.15.153:0/2372884040 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00e070 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8a9bfff700 1 -- 172.21.15.153:0/2372884040 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c00bb60 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8a9bfff700 1 -- 172.21.15.153:0/2372884040 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00bee0 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 -- 172.21.15.153:0/2372884040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 msgr2=0x7f8aa40a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2372884040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40a8f50 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f8a9c009e60 tx=0x7f8a9c009780).stop 2023-08-17T00:05:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 -- 172.21.15.153:0/2372884040 shutdown_connections 2023-08-17T00:05:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2372884040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40a8f50 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 -- 172.21.15.153:0/2372884040 >> 172.21.15.153:0/2372884040 conn(0x7f8aa40c7150 msgr2=0x7f8aa40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 -- 172.21.15.153:0/2372884040 shutdown_connections 2023-08-17T00:05:44.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.509+0000 7f8aab61b700 1 -- 172.21.15.153:0/2372884040 wait complete. 2023-08-17T00:05:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 Processor -- start 2023-08-17T00:05:44.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 -- start start 2023-08-17T00:05:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa40632e0 0x7f8aa416c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa40a8b70 0x7f8aa41696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa416c620 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa416c8f0 con 0x7f8aa40632e0 2023-08-17T00:05:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.513+0000 7f8aab61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa416cbd0 con 0x7f8aa40a8b70 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40bfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34294/0 (socket says 172.21.15.153:34294) 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2762554883 learned_addr learned my addr 172.21.15.153:0/2762554883 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa93b7700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa40632e0 0x7f8aa416c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa8bb6700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa40a8b70 0x7f8aa41696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa40a8b70 msgr2=0x7f8aa41696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa40a8b70 0x7f8aa41696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa40632e0 msgr2=0x7f8aa416c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa40632e0 0x7f8aa416c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 -- 172.21.15.153:0/2762554883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a9c009a20 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa93b7700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa40632e0 0x7f8aa416c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aa9bb8700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40bfd40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8aa405e420 tx=0x7f8a9c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c01c660 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9c01c7c0 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa416ceb0 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c01cb40 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4169ba0 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.517+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa415a080 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.521+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8a9c01d420 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.521+0000 7f8a997fa700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a8805a150 0x7f8a8805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.521+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f8a9c0762f0 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.521+0000 7f8aa93b7700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a8805a150 0x7f8a8805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.521+0000 7f8aa93b7700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a8805a150 0x7f8a8805c610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f8aa416c090 tx=0x7f8aa0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.529+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a9c049b70 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8aa406b530 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8a997fa700 1 -- 172.21.15.153:0/2762554883 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8a9c04d190 con 0x7f8aa40bc4d0 2023-08-17T00:05:44.689 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:05:44.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a8805a150 msgr2=0x7f8a8805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a8805a150 0x7f8a8805c610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f8aa416c090 tx=0x7f8aa0009040).stop 2023-08-17T00:05:44.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 msgr2=0x7f8aa40bfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40bfd40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f8aa405e420 tx=0x7f8a9c009780).stop 2023-08-17T00:05:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 shutdown_connections 2023-08-17T00:05:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a8805a150 0x7f8a8805c610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8aa40bc4d0 0x7f8aa40bfd40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8aa40a8b70 0x7f8aa41696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 --2- 172.21.15.153:0/2762554883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8aa40632e0 0x7f8aa416c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.685+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 >> 172.21.15.153:0/2762554883 conn(0x7f8aa40c7150 msgr2=0x7f8aa40656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.689+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 shutdown_connections 2023-08-17T00:05:44.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.689+0000 7f8aab61b700 1 -- 172.21.15.153:0/2762554883 wait complete. 2023-08-17T00:05:44.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:05:44.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.861+0000 7fbec5adb700 1 Processor -- start 2023-08-17T00:05:44.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.861+0000 7fbec5adb700 1 -- start start 2023-08-17T00:05:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbec5adb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbec0153e90 0x7fbec00c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbec5adb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbec00c7980 0x7fbec00ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbec5adb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec00aa750 con 0x7fbec0153ab0 2023-08-17T00:05:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbec5adb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec00c9dd0 con 0x7fbec0153e90 2023-08-17T00:05:44.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbec5adb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbec00aacf0 con 0x7fbec00c7980 2023-08-17T00:05:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbec0153e90 0x7fbec00c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbec0153e90 0x7fbec00c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34304/0 (socket says 172.21.15.153:34304) 2023-08-17T00:05:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 -- 172.21.15.153:0/1869354707 learned_addr learned my addr 172.21.15.153:0/1869354707 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebffff700 1 --2- 172.21.15.153:0/1869354707 >> v2:172.21.15.178:3300/0 conn(0x7fbec00c7980 0x7fbec00ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 -- 172.21.15.153:0/1869354707 >> v2:172.21.15.178:3300/0 conn(0x7fbec00c7980 msgr2=0x7fbec00ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 --2- 172.21.15.153:0/1869354707 >> v2:172.21.15.178:3300/0 conn(0x7fbec00c7980 0x7fbec00ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 -- 172.21.15.153:0/1869354707 >> v1:172.21.15.178:6789/0 conn(0x7fbec0153ab0 legacy=0x7fbec00c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:44.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 -- 172.21.15.153:0/1869354707 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec01542f0 con 0x7fbec0153e90 2023-08-17T00:05:44.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebffff700 1 --2- 172.21.15.153:0/1869354707 >> v2:172.21.15.178:3300/0 conn(0x7fbec00c7980 0x7fbec00ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:44.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebeffd700 1 --2- 172.21.15.153:0/1869354707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0153e90 0x7fbec00c7490 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fbec005ea10 tx=0x7fbeb40090f0).ready entity=mon.0 client_cookie=28b5325c7d26914b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebe7fc700 1 -- 172.21.15.153:0/1869354707 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400b5a0 con 0x7fbec0153e90 2023-08-17T00:05:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebe7fc700 1 -- 172.21.15.153:0/1869354707 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb400b700 con 0x7fbec0153e90 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.865+0000 7fbebe7fc700 1 -- 172.21.15.153:0/1869354707 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb400baa0 con 0x7fbec0153e90 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 -- 172.21.15.153:0/1869354707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0153e90 msgr2=0x7fbec00c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 --2- 172.21.15.153:0/1869354707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0153e90 0x7fbec00c7490 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fbec005ea10 tx=0x7fbeb40090f0).stop 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 -- 172.21.15.153:0/1869354707 shutdown_connections 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 --2- 172.21.15.153:0/1869354707 >> v2:172.21.15.178:3300/0 conn(0x7fbec00c7980 0x7fbec00ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 --2- 172.21.15.153:0/1869354707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec0153e90 0x7fbec00c7490 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 -- 172.21.15.153:0/1869354707 >> 172.21.15.153:0/1869354707 conn(0x7fbec0061fa0 msgr2=0x7fbec00623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 -- 172.21.15.153:0/1869354707 shutdown_connections 2023-08-17T00:05:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.869+0000 7fbec5adb700 1 -- 172.21.15.153:0/1869354707 wait complete. 2023-08-17T00:05:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 Processor -- start 2023-08-17T00:05:44.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 -- start start 2023-08-17T00:05:44.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 0x7fbec0167bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec0153ab0 0x7fbec01592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec0153e90 0x7fbec01502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec01597c0 con 0x7fbec00c7980 2023-08-17T00:05:44.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec0168ae0 con 0x7fbec0153e90 2023-08-17T00:05:44.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec0164850 con 0x7fbec0153ab0 2023-08-17T00:05:44.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 0x7fbec0167bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 0x7fbec0167bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:34310/0 (socket says 172.21.15.153:34310) 2023-08-17T00:05:44.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 -- 172.21.15.153:0/2992568556 learned_addr learned my addr 172.21.15.153:0/2992568556 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:44.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebeffd700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec0153ab0 0x7fbec01592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebffff700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec0153e90 0x7fbec01502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 -- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec0153ab0 msgr2=0x7fbec01592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec0153ab0 0x7fbec01592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 -- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec0153e90 msgr2=0x7fbec01502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec0153e90 0x7fbec01502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 -- 172.21.15.153:0/2992568556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4009370 con 0x7fbec00c7980 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbebf7fe700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 0x7fbec0167bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fbeb000c470 tx=0x7fbeb0007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0012400 con 0x7fbec00c7980 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0012580 con 0x7fbec00c7980 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec0168240 con 0x7fbec00c7980 2023-08-17T00:05:44.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.873+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0012940 con 0x7fbec00c7980 2023-08-17T00:05:44.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.877+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec0168800 con 0x7fbec00c7980 2023-08-17T00:05:44.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.877+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec0164620 con 0x7fbec00c7980 2023-08-17T00:05:44.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.877+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbeb0019030 con 0x7fbec00c7980 2023-08-17T00:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.877+0000 7fbea77fe700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbeac05a150 0x7fbeac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:44.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.877+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fbeb0073430 con 0x7fbec00c7980 2023-08-17T00:05:44.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.881+0000 7fbebeffd700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbeac05a150 0x7fbeac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:44.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.881+0000 7fbebeffd700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbeac05a150 0x7fbeac05c610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbeb4009130 tx=0x7fbeb4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:44.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:44.885+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbec0164620 con 0x7fbec00c7980 2023-08-17T00:05:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.045+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbec0164620 con 0x7fbec00c7980 2023-08-17T00:05:45.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.045+0000 7fbea77fe700 1 -- 172.21.15.153:0/2992568556 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbec0164620 con 0x7fbec00c7980 2023-08-17T00:05:45.051 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:05:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.049+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbeac05a150 msgr2=0x7fbeac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.049+0000 7fbec5adb700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbeac05a150 0x7fbeac05c610 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fbeb4009130 tx=0x7fbeb4015000).stop 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.049+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 msgr2=0x7fbec0167bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.049+0000 7fbec5adb700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 0x7fbec0167bf0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fbeb000c470 tx=0x7fbeb0007de0).stop 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 shutdown_connections 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbeac05a150 0x7fbeac05c610 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbec0153e90 0x7fbec01502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbec0153ab0 0x7fbec01592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 --2- 172.21.15.153:0/2992568556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbec00c7980 0x7fbec0167bf0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 >> 172.21.15.153:0/2992568556 conn(0x7fbec0061fa0 msgr2=0x7fbec01514d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 shutdown_connections 2023-08-17T00:05:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.053+0000 7fbec5adb700 1 -- 172.21.15.153:0/2992568556 wait complete. 2023-08-17T00:05:45.074 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:05:45.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.233+0000 7ff63045b700 1 Processor -- start 2023-08-17T00:05:45.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.233+0000 7ff63045b700 1 -- start start 2023-08-17T00:05:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff63045b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff628153ab0 0x7ff628153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff63045b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c8d50 0x7ff6280c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff63045b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6280aa750 con 0x7ff6280c7490 2023-08-17T00:05:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff63045b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6280c9dd0 con 0x7ff628153ab0 2023-08-17T00:05:45.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff63045b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280aacf0 con 0x7ff6280c8d50 2023-08-17T00:05:45.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff628153ab0 0x7ff628153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff628153ab0 0x7ff628153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39170/0 (socket says 172.21.15.153:39170) 2023-08-17T00:05:45.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 -- 172.21.15.153:0/1592690768 learned_addr learned my addr 172.21.15.153:0/1592690768 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:45.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62d9f6700 1 --2- 172.21.15.153:0/1592690768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c8d50 0x7ff6280c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 -- 172.21.15.153:0/1592690768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c8d50 msgr2=0x7ff6280c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:45.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 --2- 172.21.15.153:0/1592690768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c8d50 0x7ff6280c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 -- 172.21.15.153:0/1592690768 >> v1:172.21.15.178:6789/0 conn(0x7ff6280c7490 legacy=0x7ff628063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 -- 172.21.15.153:0/1592690768 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280c5ca0 con 0x7ff628153ab0 2023-08-17T00:05:45.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62e1f7700 1 --2- 172.21.15.153:0/1592690768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff628153ab0 0x7ff628153e90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff624006fd0 tx=0x7ff6240090f0).ready entity=mon.0 client_cookie=ea5648e0e43ff68c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:45.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62d1f5700 1 -- 172.21.15.153:0/1592690768 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400b600 con 0x7ff628153ab0 2023-08-17T00:05:45.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62d1f5700 1 -- 172.21.15.153:0/1592690768 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62400b760 con 0x7ff628153ab0 2023-08-17T00:05:45.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.237+0000 7ff62d1f5700 1 -- 172.21.15.153:0/1592690768 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62400bb00 con 0x7ff628153ab0 2023-08-17T00:05:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 -- 172.21.15.153:0/1592690768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff628153ab0 msgr2=0x7ff628153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 --2- 172.21.15.153:0/1592690768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff628153ab0 0x7ff628153e90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff624006fd0 tx=0x7ff6240090f0).stop 2023-08-17T00:05:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 -- 172.21.15.153:0/1592690768 shutdown_connections 2023-08-17T00:05:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 --2- 172.21.15.153:0/1592690768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c8d50 0x7ff6280c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 --2- 172.21.15.153:0/1592690768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff628153ab0 0x7ff628153e90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 -- 172.21.15.153:0/1592690768 >> 172.21.15.153:0/1592690768 conn(0x7ff628061fa0 msgr2=0x7ff6280623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:45.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 -- 172.21.15.153:0/1592690768 shutdown_connections 2023-08-17T00:05:45.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 -- 172.21.15.153:0/1592690768 wait complete. 2023-08-17T00:05:45.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.241+0000 7ff63045b700 1 Processor -- start 2023-08-17T00:05:45.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 -- start start 2023-08-17T00:05:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c7490 0x7ff6280c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 0x7ff6280aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff628153ab0 0x7ff628157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280c2df0 con 0x7ff6280c8d50 2023-08-17T00:05:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff628156e70 con 0x7ff628153ab0 2023-08-17T00:05:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff628151430 con 0x7ff6280c7490 2023-08-17T00:05:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 0x7ff6280aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 0x7ff6280aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39176/0 (socket says 172.21.15.153:39176) 2023-08-17T00:05:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 -- 172.21.15.153:0/1288568299 learned_addr learned my addr 172.21.15.153:0/1288568299 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62e1f7700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c7490 0x7ff6280c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62e9f8700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff628153ab0 0x7ff628157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 -- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c7490 msgr2=0x7ff6280c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c7490 0x7ff6280c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 -- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff628153ab0 msgr2=0x7ff628157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff628153ab0 0x7ff628157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 -- 172.21.15.153:0/1288568299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624009370 con 0x7ff6280c8d50 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62e9f8700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff628153ab0 0x7ff628157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff62d9f6700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 0x7ff6280aeae0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7ff61800d890 tx=0x7ff618008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180125f0 con 0x7ff6280c8d50 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff618012750 con 0x7ff6280c8d50 2023-08-17T00:05:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff628156540 con 0x7ff6280c8d50 2023-08-17T00:05:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.245+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618012ad0 con 0x7ff6280c8d50 2023-08-17T00:05:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.249+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff628156b00 con 0x7ff6280c8d50 2023-08-17T00:05:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.249+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62806b530 con 0x7ff6280c8d50 2023-08-17T00:05:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.249+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff618013480 con 0x7ff6280c8d50 2023-08-17T00:05:45.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.249+0000 7ff61e7fc700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff60c05a180 0x7ff60c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.249+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7ff618073ff0 con 0x7ff6280c8d50 2023-08-17T00:05:45.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.253+0000 7ff62e1f7700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff60c05a180 0x7ff60c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.253+0000 7ff62e1f7700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff60c05a180 0x7ff60c05c640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff62400b3c0 tx=0x7ff624017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:45.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.257+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff618047960 con 0x7ff6280c8d50 2023-08-17T00:05:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.421+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6280c9810 con 0x7ff6280c8d50 2023-08-17T00:05:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.425+0000 7ff61e7fc700 1 -- 172.21.15.153:0/1288568299 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff61804af80 con 0x7ff6280c8d50 2023-08-17T00:05:45.429 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:05:45.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff60c05a180 msgr2=0x7ff60c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff60c05a180 0x7ff60c05c640 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7ff62400b3c0 tx=0x7ff624017000).stop 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 msgr2=0x7ff6280aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 0x7ff6280aeae0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7ff61800d890 tx=0x7ff618008040).stop 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 shutdown_connections 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff60c05a180 0x7ff60c05c640 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff628153ab0 0x7ff628157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6280c8d50 0x7ff6280aeae0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 --2- 172.21.15.153:0/1288568299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6280c7490 0x7ff6280c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 >> 172.21.15.153:0/1288568299 conn(0x7ff628061fa0 msgr2=0x7ff628151700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 shutdown_connections 2023-08-17T00:05:45.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.429+0000 7ff63045b700 1 -- 172.21.15.153:0/1288568299 wait complete. 2023-08-17T00:05:45.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:05:45.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.613+0000 7fc55bb69700 1 Processor -- start 2023-08-17T00:05:45.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.613+0000 7fc55bb69700 1 -- start start 2023-08-17T00:05:45.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc55bb69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5540632e0 0x7fc5540a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc55bb69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5540629b0 0x7fc5540bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc55bb69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc554065240 con 0x7fc5540a8b70 2023-08-17T00:05:45.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc55bb69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5540638a0 con 0x7fc5540629b0 2023-08-17T00:05:45.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc55bb69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc554065de0 con 0x7fc5540632e0 2023-08-17T00:05:45.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc55a106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc5540629b0 0x7fc5540bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc559104700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5540632e0 0x7fc5540a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc559104700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc5540632e0 0x7fc5540a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:52032/0 (socket says 172.21.15.153:52032) 2023-08-17T00:05:45.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc559104700 1 -- 172.21.15.153:0/1491728096 learned_addr learned my addr 172.21.15.153:0/1491728096 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:45.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc559104700 1 -- 172.21.15.153:0/1491728096 >> v2:172.21.15.153:3300/0 conn(0x7fc5540629b0 msgr2=0x7fc5540bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:45.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.617+0000 7fc559104700 1 --2- 172.21.15.153:0/1491728096 >> v2:172.21.15.153:3300/0 conn(0x7fc5540629b0 0x7fc5540bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc559104700 1 -- 172.21.15.153:0/1491728096 >> v1:172.21.15.178:6789/0 conn(0x7fc5540a8b70 legacy=0x7fc5540656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:45.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc559104700 1 -- 172.21.15.153:0/1491728096 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc554062e20 con 0x7fc5540632e0 2023-08-17T00:05:45.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc559104700 1 --2- 172.21.15.153:0/1491728096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc5540a8f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc554069d30 tx=0x7fc5440090f0).ready entity=mon.1 client_cookie=f405a6896dde4cb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:45.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc558903700 1 -- 172.21.15.153:0/1491728096 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400b520 con 0x7fc5540632e0 2023-08-17T00:05:45.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc558903700 1 -- 172.21.15.153:0/1491728096 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54400b680 con 0x7fc5540632e0 2023-08-17T00:05:45.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc558903700 1 -- 172.21.15.153:0/1491728096 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54400ba00 con 0x7fc5540632e0 2023-08-17T00:05:45.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 -- 172.21.15.153:0/1491728096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 msgr2=0x7fc5540a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 --2- 172.21.15.153:0/1491728096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc5540a8f50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fc554069d30 tx=0x7fc5440090f0).stop 2023-08-17T00:05:45.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 -- 172.21.15.153:0/1491728096 shutdown_connections 2023-08-17T00:05:45.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 --2- 172.21.15.153:0/1491728096 >> v2:172.21.15.153:3300/0 conn(0x7fc5540629b0 0x7fc5540bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 --2- 172.21.15.153:0/1491728096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc5540a8f50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 -- 172.21.15.153:0/1491728096 >> 172.21.15.153:0/1491728096 conn(0x7fc5540c7150 msgr2=0x7fc5540c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:45.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 -- 172.21.15.153:0/1491728096 shutdown_connections 2023-08-17T00:05:45.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.621+0000 7fc55bb69700 1 -- 172.21.15.153:0/1491728096 wait complete. 2023-08-17T00:05:45.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 Processor -- start 2023-08-17T00:05:45.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 -- start start 2023-08-17T00:05:45.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 0x7fc5540a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc554159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5540a8b70 0x7fc554159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55415ae80 con 0x7fc5540629b0 2023-08-17T00:05:45.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540a98c0 con 0x7fc5540632e0 2023-08-17T00:05:45.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc55bb69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5541692a0 con 0x7fc5540a8b70 2023-08-17T00:05:45.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc559905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 0x7fc5540a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc559905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 0x7fc5540a7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39194/0 (socket says 172.21.15.153:39194) 2023-08-17T00:05:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.625+0000 7fc559905700 1 -- 172.21.15.153:0/3924390753 learned_addr learned my addr 172.21.15.153:0/3924390753 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc55a106700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5540a8b70 0x7fc554159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559104700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc554159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559905700 1 -- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5540a8b70 msgr2=0x7fc554159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559905700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5540a8b70 0x7fc554159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559905700 1 -- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 msgr2=0x7fc554159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559905700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc554159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559905700 1 -- 172.21.15.153:0/3924390753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544009370 con 0x7fc5540629b0 2023-08-17T00:05:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc559905700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 0x7fc5540a7e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fc55000c470 tx=0x7fc550007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550007020 con 0x7fc5540629b0 2023-08-17T00:05:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc550007180 con 0x7fc5540629b0 2023-08-17T00:05:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55415a5e0 con 0x7fc5540629b0 2023-08-17T00:05:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550007520 con 0x7fc5540629b0 2023-08-17T00:05:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55415aba0 con 0x7fc5540629b0 2023-08-17T00:05:45.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.629+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5540a9690 con 0x7fc5540629b0 2023-08-17T00:05:45.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.633+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc550010070 con 0x7fc5540629b0 2023-08-17T00:05:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.633+0000 7fc549ffb700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc53805a150 0x7fc53805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.633+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fc550073370 con 0x7fc5540629b0 2023-08-17T00:05:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.633+0000 7fc559104700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc53805a150 0x7fc53805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:45.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.637+0000 7fc559104700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc53805a150 0x7fc53805c610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fc544009130 tx=0x7fc544017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.641+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc5540a9690 con 0x7fc5540629b0 2023-08-17T00:05:45.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.805+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5540a9690 con 0x7fc5540629b0 2023-08-17T00:05:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.805+0000 7fc549ffb700 1 -- 172.21.15.153:0/3924390753 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5540a9690 con 0x7fc5540629b0 2023-08-17T00:05:45.810 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:05:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc53805a150 msgr2=0x7fc53805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc53805a150 0x7fc53805c610 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7fc544009130 tx=0x7fc544017000).stop 2023-08-17T00:05:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 msgr2=0x7fc5540a7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 0x7fc5540a7e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fc55000c470 tx=0x7fc550007e00).stop 2023-08-17T00:05:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 shutdown_connections 2023-08-17T00:05:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc53805a150 0x7fc53805c610 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5540a8b70 0x7fc554159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc5540632e0 0x7fc554159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 --2- 172.21.15.153:0/3924390753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc5540629b0 0x7fc5540a7e00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 >> 172.21.15.153:0/3924390753 conn(0x7fc5540c7150 msgr2=0x7fc5540656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 shutdown_connections 2023-08-17T00:05:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.809+0000 7fc55bb69700 1 -- 172.21.15.153:0/3924390753 wait complete. 2023-08-17T00:05:45.832 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:05:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.993+0000 7ff401569700 1 Processor -- start 2023-08-17T00:05:45.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.993+0000 7ff401569700 1 -- start start 2023-08-17T00:05:46.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff401569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3fc151b90 0x7ff3fc151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff401569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff401569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff3fc065b50 0x7ff3fc064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff401569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc0c3fb0 con 0x7ff3fc151b90 2023-08-17T00:05:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff401569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3fc152460 con 0x7ff3fc065b50 2023-08-17T00:05:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff401569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc061fa0 con 0x7ff3fc063290 2023-08-17T00:05:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3fc151b90 0x7ff3fc151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff3fc151b90 0x7ff3fc151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39206/0 (socket says 172.21.15.153:39206) 2023-08-17T00:05:46.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 -- 172.21.15.153:0/2317383573 learned_addr learned my addr 172.21.15.153:0/2317383573 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:46.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3fa7fc700 1 --2- 172.21.15.153:0/2317383573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3fb7fe700 1 --2- 172.21.15.153:0/2317383573 >> v2:172.21.15.178:3300/0 conn(0x7ff3fc065b50 0x7ff3fc064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 -- 172.21.15.153:0/2317383573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 msgr2=0x7ff3fc065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:46.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 --2- 172.21.15.153:0/2317383573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 -- 172.21.15.153:0/2317383573 >> v2:172.21.15.178:3300/0 conn(0x7ff3fc065b50 msgr2=0x7ff3fc064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 --2- 172.21.15.153:0/2317383573 >> v2:172.21.15.178:3300/0 conn(0x7ff3fc065b50 0x7ff3fc064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3faffd700 1 -- 172.21.15.153:0/2317383573 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0621f0 con 0x7ff3fc151b90 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:45.997+0000 7ff3fb7fe700 1 --2- 172.21.15.153:0/2317383573 >> v2:172.21.15.178:3300/0 conn(0x7ff3fc065b50 0x7ff3fc064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff3faffd700 1 --2- 172.21.15.153:0/2317383573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc151b90 0x7ff3fc151f70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff3fc066010 tx=0x7ff3ec0090f0).ready entity=mon.0 client_cookie=8859e2c06906648d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff3f9ffb700 1 -- 172.21.15.153:0/2317383573 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00f510 con 0x7ff3fc151b90 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff3f9ffb700 1 -- 172.21.15.153:0/2317383573 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3ec00f670 con 0x7ff3fc151b90 2023-08-17T00:05:46.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff3f9ffb700 1 -- 172.21.15.153:0/2317383573 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00fa10 con 0x7ff3fc151b90 2023-08-17T00:05:46.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 -- 172.21.15.153:0/2317383573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc151b90 msgr2=0x7ff3fc151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 --2- 172.21.15.153:0/2317383573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc151b90 0x7ff3fc151f70 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff3fc066010 tx=0x7ff3ec0090f0).stop 2023-08-17T00:05:46.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 -- 172.21.15.153:0/2317383573 shutdown_connections 2023-08-17T00:05:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 --2- 172.21.15.153:0/2317383573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 --2- 172.21.15.153:0/2317383573 >> v2:172.21.15.178:3300/0 conn(0x7ff3fc065b50 0x7ff3fc064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 --2- 172.21.15.153:0/2317383573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc151b90 0x7ff3fc151f70 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 -- 172.21.15.153:0/2317383573 >> 172.21.15.153:0/2317383573 conn(0x7ff3fc0c7150 msgr2=0x7ff3fc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 -- 172.21.15.153:0/2317383573 shutdown_connections 2023-08-17T00:05:46.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.001+0000 7ff401569700 1 -- 172.21.15.153:0/2317383573 wait complete. 2023-08-17T00:05:46.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 Processor -- start 2023-08-17T00:05:46.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 -- start start 2023-08-17T00:05:46.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 0x7ff3fc0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3fc151b90 0x7ff3fc147b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0c2250 con 0x7ff3fc065b50 2023-08-17T00:05:46.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0c1640 con 0x7ff3fc151b90 2023-08-17T00:05:46.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff401569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3fc0c1920 con 0x7ff3fc063290 2023-08-17T00:05:46.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff3fa7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 0x7ff3fc0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff3fa7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 0x7ff3fc0c0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39208/0 (socket says 172.21.15.153:39208) 2023-08-17T00:05:46.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff3fa7fc700 1 -- 172.21.15.153:0/332677371 learned_addr learned my addr 172.21.15.153:0/332677371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:46.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff3faffd700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.005+0000 7ff3fb7fe700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3fc151b90 0x7ff3fc147b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3fa7fc700 1 -- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 msgr2=0x7ff3fc147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3fa7fc700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3fa7fc700 1 -- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3fc151b90 msgr2=0x7ff3fc147b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3fa7fc700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3fc151b90 0x7ff3fc147b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3fa7fc700 1 -- 172.21.15.153:0/332677371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009a20 con 0x7ff3fc065b50 2023-08-17T00:05:46.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3fa7fc700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 0x7ff3fc0c0c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff3f000e950 tx=0x7ff3f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000c6a0 con 0x7ff3fc065b50 2023-08-17T00:05:46.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f000c800 con 0x7ff3fc065b50 2023-08-17T00:05:46.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f000cb80 con 0x7ff3fc065b50 2023-08-17T00:05:46.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec009370 con 0x7ff3fc065b50 2023-08-17T00:05:46.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3fc0c1ee0 con 0x7ff3fc065b50 2023-08-17T00:05:46.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.009+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3fc0c23c0 con 0x7ff3fc065b50 2023-08-17T00:05:46.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.013+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff3f0022070 con 0x7ff3fc065b50 2023-08-17T00:05:46.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.013+0000 7ff3e2ffd700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3e805a150 0x7ff3e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.013+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7ff3f0074660 con 0x7ff3fc065b50 2023-08-17T00:05:46.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.013+0000 7ff3faffd700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3e805a150 0x7ff3e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.013+0000 7ff3faffd700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3e805a150 0x7ff3e805c610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff3fc066010 tx=0x7ff3ec016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.017+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff3f0047f40 con 0x7ff3fc065b50 2023-08-17T00:05:46.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.213+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3fc0624d0 con 0x7ff3fc065b50 2023-08-17T00:05:46.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.213+0000 7ff3e2ffd700 1 -- 172.21.15.153:0/332677371 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4502 (secure 0 0 0) 0x7ff3f0016090 con 0x7ff3fc065b50 2023-08-17T00:05:46.218 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:46.218 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:03:41.953300+0000","modified":"2023-08-17T00:05:26.313106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/1653485600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1653485600},{"type":"v1","addr":"172.21.15.153:6835","nonce":1653485600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T00:05:46.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3e805a150 msgr2=0x7ff3e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3e805a150 0x7ff3e805c610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7ff3fc066010 tx=0x7ff3ec016000).stop 2023-08-17T00:05:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 msgr2=0x7ff3fc0c0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 0x7ff3fc0c0c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff3f000e950 tx=0x7ff3f0009060).stop 2023-08-17T00:05:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 shutdown_connections 2023-08-17T00:05:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3e805a150 0x7ff3e805c610 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3fc151b90 0x7ff3fc147b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3fc065b50 0x7ff3fc0c0c80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 --2- 172.21.15.153:0/332677371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3fc063290 0x7ff3fc147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 >> 172.21.15.153:0/332677371 conn(0x7ff3fc0c7150 msgr2=0x7ff3fc1492c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:46.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 shutdown_connections 2023-08-17T00:05:46.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.217+0000 7ff401569700 1 -- 172.21.15.153:0/332677371 wait complete. 2023-08-17T00:05:46.223 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 30 2023-08-17T00:05:46.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:05:46.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.397+0000 7fb386746700 1 Processor -- start 2023-08-17T00:05:46.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.397+0000 7fb386746700 1 -- start start 2023-08-17T00:05:46.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb386746700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3800a8b70 0x7fb3800632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb386746700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3800a8f50 0x7fb3800629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb386746700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb380065240 con 0x7fb3800656d0 2023-08-17T00:05:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb386746700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb380062ea0 con 0x7fb3800a8b70 2023-08-17T00:05:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb386746700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3800638a0 con 0x7fb3800a8f50 2023-08-17T00:05:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3800a8b70 0x7fb3800632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3800a8b70 0x7fb3800632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39214/0 (socket says 172.21.15.153:39214) 2023-08-17T00:05:46.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 -- 172.21.15.153:0/3052478336 learned_addr learned my addr 172.21.15.153:0/3052478336 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:46.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb3777fe700 1 --2- 172.21.15.153:0/3052478336 >> v2:172.21.15.178:3300/0 conn(0x7fb3800a8f50 0x7fb3800629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 -- 172.21.15.153:0/3052478336 >> v2:172.21.15.178:3300/0 conn(0x7fb3800a8f50 msgr2=0x7fb3800629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 --2- 172.21.15.153:0/3052478336 >> v2:172.21.15.178:3300/0 conn(0x7fb3800a8f50 0x7fb3800629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 -- 172.21.15.153:0/3052478336 >> v1:172.21.15.178:6789/0 conn(0x7fb3800656d0 legacy=0x7fb3800bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 -- 172.21.15.153:0/3052478336 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb380064910 con 0x7fb3800a8b70 2023-08-17T00:05:46.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37ffff700 1 --2- 172.21.15.153:0/3052478336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8b70 0x7fb3800632e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fb380069d30 tx=0x7fb370009840).ready entity=mon.0 client_cookie=53f33120b6717340 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37f7fe700 1 -- 172.21.15.153:0/3052478336 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000e070 con 0x7fb3800a8b70 2023-08-17T00:05:46.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37f7fe700 1 -- 172.21.15.153:0/3052478336 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37000ba10 con 0x7fb3800a8b70 2023-08-17T00:05:46.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.401+0000 7fb37f7fe700 1 -- 172.21.15.153:0/3052478336 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000bd90 con 0x7fb3800a8b70 2023-08-17T00:05:46.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 -- 172.21.15.153:0/3052478336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8b70 msgr2=0x7fb3800632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 --2- 172.21.15.153:0/3052478336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8b70 0x7fb3800632e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fb380069d30 tx=0x7fb370009840).stop 2023-08-17T00:05:46.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 -- 172.21.15.153:0/3052478336 shutdown_connections 2023-08-17T00:05:46.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 --2- 172.21.15.153:0/3052478336 >> v2:172.21.15.178:3300/0 conn(0x7fb3800a8f50 0x7fb3800629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 --2- 172.21.15.153:0/3052478336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8b70 0x7fb3800632e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 -- 172.21.15.153:0/3052478336 >> 172.21.15.153:0/3052478336 conn(0x7fb3800c7150 msgr2=0x7fb3800c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:46.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 -- 172.21.15.153:0/3052478336 shutdown_connections 2023-08-17T00:05:46.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 -- 172.21.15.153:0/3052478336 wait complete. 2023-08-17T00:05:46.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 Processor -- start 2023-08-17T00:05:46.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.405+0000 7fb386746700 1 -- start start 2023-08-17T00:05:46.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3800656d0 0x7fb3800c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3800a8b70 0x7fb380154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 0x7fb380154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3800ab3f0 con 0x7fb3800a8f50 2023-08-17T00:05:46.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb380154ff0 con 0x7fb3800a8b70 2023-08-17T00:05:46.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb380159e70 con 0x7fb3800656d0 2023-08-17T00:05:46.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 0x7fb380154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 0x7fb380154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39222/0 (socket says 172.21.15.153:39222) 2023-08-17T00:05:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 -- 172.21.15.153:0/547566138 learned_addr learned my addr 172.21.15.153:0/547566138 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb37ffff700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3800656d0 0x7fb3800c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb3777fe700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3800a8b70 0x7fb380154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 -- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3800656d0 msgr2=0x7fb3800c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3800656d0 0x7fb3800c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 -- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3800a8b70 msgr2=0x7fb380154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3800a8b70 0x7fb380154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 -- 172.21.15.153:0/547566138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370009ae0 con 0x7fb3800a8f50 2023-08-17T00:05:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb384ce3700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 0x7fb380154b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fb37800c490 tx=0x7fb378007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb378002ea0 con 0x7fb3800a8f50 2023-08-17T00:05:46.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37800f470 con 0x7fb3800a8f50 2023-08-17T00:05:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb38015a150 con 0x7fb3800a8f50 2023-08-17T00:05:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37800f810 con 0x7fb3800a8f50 2023-08-17T00:05:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.409+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb38015a430 con 0x7fb3800a8f50 2023-08-17T00:05:46.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.413+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3800ab5a0 con 0x7fb3800a8f50 2023-08-17T00:05:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.413+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb378010070 con 0x7fb3800a8f50 2023-08-17T00:05:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.413+0000 7fb37cff9700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb36005a150 0x7fb36005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.413+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fb378073500 con 0x7fb3800a8f50 2023-08-17T00:05:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.413+0000 7fb37ffff700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb36005a150 0x7fb36005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.417+0000 7fb37ffff700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb36005a150 0x7fb36005c610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fb380158e20 tx=0x7fb370009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.421+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3800ab5a0 con 0x7fb3800a8f50 2023-08-17T00:05:46.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.581+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3800ab530 con 0x7fb3800a8f50 2023-08-17T00:05:46.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.581+0000 7fb37cff9700 1 -- 172.21.15.153:0/547566138 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17372 (secure 0 0 0) 0x7fb378046ed0 con 0x7fb3800a8f50 2023-08-17T00:05:46.588 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:46.588 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:05:22.108566+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:03:39.751729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T00:03:40.984291+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]},{"pgid":"6.20","mappings":[{"from":4,"to":2}]},{"pgid":"6.26","mappings":[{"from":4,"to":7}]},{"pgid":"6.2f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:05:46.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb36005a150 msgr2=0x7fb36005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb36005a150 0x7fb36005c610 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fb380158e20 tx=0x7fb370009840).stop 2023-08-17T00:05:46.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 msgr2=0x7fb380154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 0x7fb380154b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fb37800c490 tx=0x7fb378007de0).stop 2023-08-17T00:05:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 shutdown_connections 2023-08-17T00:05:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb36005a150 0x7fb36005c610 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3800a8f50 0x7fb380154b00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3800a8b70 0x7fb380154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 --2- 172.21.15.153:0/547566138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3800656d0 0x7fb3800c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 >> 172.21.15.153:0/547566138 conn(0x7fb3800c7150 msgr2=0x7fb3800c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:46.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 shutdown_connections 2023-08-17T00:05:46.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.585+0000 7fb386746700 1 -- 172.21.15.153:0/547566138 wait complete. 2023-08-17T00:05:46.611 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:05:46.611 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:05:46.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 Processor -- start 2023-08-17T00:05:46.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 -- start start 2023-08-17T00:05:46.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa1dc0a8df0 0x7fa1dc0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1dc1585a0 con 0x7fa1dc061fa0 2023-08-17T00:05:46.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1dc066400 con 0x7fa1dc0a8df0 2023-08-17T00:05:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e29b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc069170 con 0x7fa1dc068820 2023-08-17T00:05:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e19b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa1dc0a8df0 0x7fa1dc0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e21b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa1dc061fa0 0x7fa1dc062400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50354/0 (socket says 172.21.15.153:50354) 2023-08-17T00:05:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e21b8700 1 -- 172.21.15.153:0/197249713 learned_addr learned my addr 172.21.15.153:0/197249713 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:46.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e11b6700 1 --2- 172.21.15.153:0/197249713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.765+0000 7fa1e09b5700 1 -- 172.21.15.153:0/197249713 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286620333 0 0) 0x7fa1dc1585a0 con 0x7fa1dc061fa0 2023-08-17T00:05:46.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e09b5700 1 -- 172.21.15.153:0/197249713 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c80033f0 con 0x7fa1dc061fa0 2023-08-17T00:05:46.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e19b7700 1 -- 172.21.15.153:0/197249713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 msgr2=0x7fa1dc068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:46.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e19b7700 1 --2- 172.21.15.153:0/197249713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e19b7700 1 -- 172.21.15.153:0/197249713 >> v1:172.21.15.153:6789/0 conn(0x7fa1dc061fa0 legacy=0x7fa1dc062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e19b7700 1 -- 172.21.15.153:0/197249713 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc0b9d30 con 0x7fa1dc0a8df0 2023-08-17T00:05:46.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e19b7700 1 --2- 172.21.15.153:0/197249713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc0c1490 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fa1d8009750 tx=0x7fa1d8009060).ready entity=mon.0 client_cookie=11d25b1bcb6fc9a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e09b5700 1 -- 172.21.15.153:0/197249713 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800d4a0 con 0x7fa1dc0a8df0 2023-08-17T00:05:46.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e09b5700 1 -- 172.21.15.153:0/197249713 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d800d600 con 0x7fa1dc0a8df0 2023-08-17T00:05:46.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e09b5700 1 -- 172.21.15.153:0/197249713 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d800d980 con 0x7fa1dc0a8df0 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 -- 172.21.15.153:0/197249713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc0a8df0 msgr2=0x7fa1dc0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/197249713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc0c1490 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7fa1d8009750 tx=0x7fa1d8009060).stop 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 -- 172.21.15.153:0/197249713 shutdown_connections 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/197249713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/197249713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc0c1490 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 -- 172.21.15.153:0/197249713 >> 172.21.15.153:0/197249713 conn(0x7fa1dc0c6620 msgr2=0x7fa1dc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:46.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 -- 172.21.15.153:0/197249713 shutdown_connections 2023-08-17T00:05:46.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.769+0000 7fa1e29b9700 1 -- 172.21.15.153:0/197249713 wait complete. 2023-08-17T00:05:46.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 Processor -- start 2023-08-17T00:05:46.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 -- start start 2023-08-17T00:05:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 0x7fa1dc0bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc15af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0bcc60 con 0x7fa1dc061fa0 2023-08-17T00:05:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc158a70 con 0x7fa1dc0a8df0 2023-08-17T00:05:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e29b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc0bc6a0 con 0x7fa1dc068820 2023-08-17T00:05:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 0x7fa1dc0bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 0x7fa1dc0bc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39242/0 (socket says 172.21.15.153:39242) 2023-08-17T00:05:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 -- 172.21.15.153:0/929929556 learned_addr learned my addr 172.21.15.153:0/929929556 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:46.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e11b6700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e21b8700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc15af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 -- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 msgr2=0x7fa1dc15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc15cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 -- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0a8df0 msgr2=0x7fa1dc15af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc15af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 -- 172.21.15.153:0/929929556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8009240 con 0x7fa1dc061fa0 2023-08-17T00:05:46.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1e19b7700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 0x7fa1dc0bc040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fa1d8010000 tx=0x7fa1d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d8000d10 con 0x7fa1dc061fa0 2023-08-17T00:05:46.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d800d770 con 0x7fa1dc061fa0 2023-08-17T00:05:46.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.773+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d801c420 con 0x7fa1dc061fa0 2023-08-17T00:05:46.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.777+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1dc0bc980 con 0x7fa1dc061fa0 2023-08-17T00:05:46.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.777+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1dc15d4e0 con 0x7fa1dc061fa0 2023-08-17T00:05:46.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.777+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1dc06b4c0 con 0x7fa1dc061fa0 2023-08-17T00:05:46.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.777+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa1d800f070 con 0x7fa1dc061fa0 2023-08-17T00:05:46.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.777+0000 7fa1d1ffb700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa1c005a150 0x7fa1c005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:46.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.777+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fa1d80756d0 con 0x7fa1dc061fa0 2023-08-17T00:05:46.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.781+0000 7fa1e11b6700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa1c005a150 0x7fa1c005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:46.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.781+0000 7fa1e11b6700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa1c005a150 0x7fa1c005c610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fa1dc0b99c0 tx=0x7fa1cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:46.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.785+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa1d8049030 con 0x7fa1dc061fa0 2023-08-17T00:05:46.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.977+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1dc064010 con 0x7fa1dc061fa0 2023-08-17T00:05:46.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1d1ffb700 1 -- 172.21.15.153:0/929929556 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fa1d804c650 con 0x7fa1dc061fa0 2023-08-17T00:05:46.984 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:46.985 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:03:41.953300+0000","modified":"2023-08-17T00:05:26.313106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/1653485600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1653485600},{"type":"v1","addr":"172.21.15.153:6835","nonce":1653485600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T00:05:46.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa1c005a150 msgr2=0x7fa1c005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa1c005a150 0x7fa1c005c610 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fa1dc0b99c0 tx=0x7fa1cc008040).stop 2023-08-17T00:05:46.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 msgr2=0x7fa1dc0bc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:46.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 0x7fa1dc0bc040 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7fa1d8010000 tx=0x7fa1d8016000).stop 2023-08-17T00:05:46.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 shutdown_connections 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa1c005a150 0x7fa1c005c610 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa1dc0a8df0 0x7fa1dc15af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa1dc068820 0x7fa1dc15cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 --2- 172.21.15.153:0/929929556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa1dc061fa0 0x7fa1dc0bc040 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 >> 172.21.15.153:0/929929556 conn(0x7fa1dc0c6620 msgr2=0x7fa1dc0c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 shutdown_connections 2023-08-17T00:05:46.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:46.981+0000 7fa1e29b9700 1 -- 172.21.15.153:0/929929556 wait complete. 2023-08-17T00:05:46.989 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 30 2023-08-17T00:05:47.008 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:05:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.161+0000 7f964a969700 1 Processor -- start 2023-08-17T00:05:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f964a969700 1 -- start start 2023-08-17T00:05:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f964a969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9644151b90 0x7f9644151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f964a969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9644064870 0x7f9644064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f964a969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9644061fa0 con 0x7f9644063290 2023-08-17T00:05:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f964a969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96440c3fb0 con 0x7f9644064870 2023-08-17T00:05:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f964a969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9644152460 con 0x7f9644151b90 2023-08-17T00:05:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9644064870 0x7f9644064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9644064870 0x7f9644064cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39250/0 (socket says 172.21.15.153:39250) 2023-08-17T00:05:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 -- 172.21.15.153:0/2367407838 learned_addr learned my addr 172.21.15.153:0/2367407838 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9643fff700 1 --2- 172.21.15.153:0/2367407838 >> v2:172.21.15.178:3300/0 conn(0x7f9644151b90 0x7f9644151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 -- 172.21.15.153:0/2367407838 >> v2:172.21.15.178:3300/0 conn(0x7f9644151b90 msgr2=0x7f9644151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 --2- 172.21.15.153:0/2367407838 >> v2:172.21.15.178:3300/0 conn(0x7f9644151b90 0x7f9644151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 -- 172.21.15.153:0/2367407838 >> v1:172.21.15.178:6789/0 conn(0x7f9644063290 legacy=0x7f9644065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.165+0000 7f9648f06700 1 -- 172.21.15.153:0/2367407838 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96440651b0 con 0x7f9644064870 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f9648f06700 1 --2- 172.21.15.153:0/2367407838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f9644064cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f96440682a0 tx=0x7f963c0090f0).ready entity=mon.0 client_cookie=d19fae3a4e53b3ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f96437fe700 1 -- 172.21.15.153:0/2367407838 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00b520 con 0x7f9644064870 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f96437fe700 1 -- 172.21.15.153:0/2367407838 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f963c00b680 con 0x7f9644064870 2023-08-17T00:05:47.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f96437fe700 1 -- 172.21.15.153:0/2367407838 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f963c00ba00 con 0x7f9644064870 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 -- 172.21.15.153:0/2367407838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 msgr2=0x7f9644064cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 --2- 172.21.15.153:0/2367407838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f9644064cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f96440682a0 tx=0x7f963c0090f0).stop 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 -- 172.21.15.153:0/2367407838 shutdown_connections 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 --2- 172.21.15.153:0/2367407838 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f9644064cc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 --2- 172.21.15.153:0/2367407838 >> v2:172.21.15.178:3300/0 conn(0x7f9644151b90 0x7f9644151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 -- 172.21.15.153:0/2367407838 >> 172.21.15.153:0/2367407838 conn(0x7f96440c7150 msgr2=0x7f96440c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:47.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 -- 172.21.15.153:0/2367407838 shutdown_connections 2023-08-17T00:05:47.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.169+0000 7f964a969700 1 -- 172.21.15.153:0/2367407838 wait complete. 2023-08-17T00:05:47.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 Processor -- start 2023-08-17T00:05:47.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 -- start start 2023-08-17T00:05:47.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9644063290 0x7f964414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f964414c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9644151b90 0x7f9644154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644148ed0 con 0x7f9644064870 2023-08-17T00:05:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9644153940 con 0x7f9644151b90 2023-08-17T00:05:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f964a969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9644153c20 con 0x7f9644063290 2023-08-17T00:05:47.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f963b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f964414c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f963b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f964414c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39260/0 (socket says 172.21.15.153:39260) 2023-08-17T00:05:47.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f963b7fe700 1 -- 172.21.15.153:0/1380797216 learned_addr learned my addr 172.21.15.153:0/1380797216 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:47.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f9643fff700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9644063290 0x7f964414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.173+0000 7f9648f06700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9644151b90 0x7f9644154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f963b7fe700 1 -- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9644063290 msgr2=0x7f964414bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f963b7fe700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9644063290 0x7f964414bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f963b7fe700 1 -- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9644151b90 msgr2=0x7f9644154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f963b7fe700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9644151b90 0x7f9644154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f963b7fe700 1 -- 172.21.15.153:0/1380797216 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c009370 con 0x7f9644064870 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f9648f06700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9644151b90 0x7f9644154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f963b7fe700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f964414c9d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f962c00c4c0 tx=0x7f962c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c007020 con 0x7f9644064870 2023-08-17T00:05:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962c001e90 con 0x7f9644064870 2023-08-17T00:05:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9644153f00 con 0x7f9644064870 2023-08-17T00:05:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c0073b0 con 0x7f9644064870 2023-08-17T00:05:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964414c190 con 0x7f9644064870 2023-08-17T00:05:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.177+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9644151880 con 0x7f9644064870 2023-08-17T00:05:47.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.181+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f962c010070 con 0x7f9644064870 2023-08-17T00:05:47.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.181+0000 7f9640ff9700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f962405a150 0x7f962405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.181+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f962c073a90 con 0x7f9644064870 2023-08-17T00:05:47.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.181+0000 7f9643fff700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f962405a150 0x7f962405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.181+0000 7f9643fff700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f962405a150 0x7f962405c610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f9634009fd0 tx=0x7f963400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.189+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f962c047370 con 0x7f9644064870 2023-08-17T00:05:47.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.389+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96440621f0 con 0x7f9644064870 2023-08-17T00:05:47.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.389+0000 7f9640ff9700 1 -- 172.21.15.153:0/1380797216 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f962c04a990 con 0x7f9644064870 2023-08-17T00:05:47.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:47.396 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":30,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:03:41.953300+0000","modified":"2023-08-17T00:05:26.313106+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4971},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4971":{"gid":4971,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/1653485600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1653485600},{"type":"v1","addr":"172.21.15.153:6835","nonce":1653485600}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-08-17T00:05:47.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f962405a150 msgr2=0x7f962405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f962405a150 0x7f962405c610 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f9634009fd0 tx=0x7f963400b040).stop 2023-08-17T00:05:47.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 msgr2=0x7f964414c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f964414c9d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f962c00c4c0 tx=0x7f962c007e00).stop 2023-08-17T00:05:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 shutdown_connections 2023-08-17T00:05:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f962405a150 0x7f962405c610 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9644151b90 0x7f9644154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9644064870 0x7f964414c9d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 --2- 172.21.15.153:0/1380797216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9644063290 0x7f964414bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.393+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 >> 172.21.15.153:0/1380797216 conn(0x7f96440c7150 msgr2=0x7f96440c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.397+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 shutdown_connections 2023-08-17T00:05:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.397+0000 7f964a969700 1 -- 172.21.15.153:0/1380797216 wait complete. 2023-08-17T00:05:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 30 2023-08-17T00:05:47.419 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:05:47.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.565+0000 7f8b36107700 1 Processor -- start 2023-08-17T00:05:47.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.565+0000 7f8b36107700 1 -- start start 2023-08-17T00:05:47.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.565+0000 7f8b36107700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b30068da0 0x7f8b301560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.565+0000 7f8b36107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30151530 0x7f8b301519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.565+0000 7f8b36107700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b30065da0 con 0x7f8b300689c0 2023-08-17T00:05:47.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.565+0000 7f8b36107700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b30069200 con 0x7f8b30068da0 2023-08-17T00:05:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30155c60 con 0x7f8b30151530 2023-08-17T00:05:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b30068da0 0x7f8b301560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8b30068da0 0x7f8b301560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39276/0 (socket says 172.21.15.153:39276) 2023-08-17T00:05:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 -- 172.21.15.153:0/1436006260 learned_addr learned my addr 172.21.15.153:0/1436006260 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b35906700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30151530 0x7f8b301519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 -- 172.21.15.153:0/1436006260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30151530 msgr2=0x7f8b301519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:47.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30151530 0x7f8b301519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 -- 172.21.15.153:0/1436006260 >> v1:172.21.15.153:6789/0 conn(0x7f8b300689c0 legacy=0x7f8b300c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 -- 172.21.15.153:0/1436006260 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b30065ff0 con 0x7f8b30068da0 2023-08-17T00:05:47.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b35906700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30151530 0x7f8b301519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:47.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b34904700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30068da0 0x7f8b301560f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f8b20006fd0 tx=0x7f8b200090f0).ready entity=mon.0 client_cookie=ca44c0bb2682c705 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b27fff700 1 -- 172.21.15.153:0/1436006260 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000b600 con 0x7f8b30068da0 2023-08-17T00:05:47.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b27fff700 1 -- 172.21.15.153:0/1436006260 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2000b760 con 0x7f8b30068da0 2023-08-17T00:05:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b27fff700 1 -- 172.21.15.153:0/1436006260 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2000bb00 con 0x7f8b30068da0 2023-08-17T00:05:47.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 -- 172.21.15.153:0/1436006260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30068da0 msgr2=0x7f8b301560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30068da0 0x7f8b301560f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f8b20006fd0 tx=0x7f8b200090f0).stop 2023-08-17T00:05:47.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 -- 172.21.15.153:0/1436006260 shutdown_connections 2023-08-17T00:05:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30151530 0x7f8b301519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 --2- 172.21.15.153:0/1436006260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30068da0 0x7f8b301560f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 -- 172.21.15.153:0/1436006260 >> 172.21.15.153:0/1436006260 conn(0x7f8b300c6620 msgr2=0x7f8b300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 -- 172.21.15.153:0/1436006260 shutdown_connections 2023-08-17T00:05:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.569+0000 7f8b36107700 1 -- 172.21.15.153:0/1436006260 wait complete. 2023-08-17T00:05:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 Processor -- start 2023-08-17T00:05:47.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 -- start start 2023-08-17T00:05:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b300689c0 0x7f8b30154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30068da0 0x7f8b30152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30151530 0x7f8b30146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301540b0 con 0x7f8b30151530 2023-08-17T00:05:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b301534a0 con 0x7f8b300689c0 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b36107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b30153780 con 0x7f8b30068da0 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.573+0000 7f8b35906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30151530 0x7f8b30146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b34904700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30068da0 0x7f8b30152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b34904700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30068da0 0x7f8b30152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:33628/0 (socket says 172.21.15.153:33628) 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b34904700 1 -- 172.21.15.153:0/2636578901 learned_addr learned my addr 172.21.15.153:0/2636578901 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35105700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b300689c0 0x7f8b30154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35906700 1 -- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30068da0 msgr2=0x7f8b30152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35906700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30068da0 0x7f8b30152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35906700 1 -- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b300689c0 msgr2=0x7f8b30154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35906700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b300689c0 0x7f8b30154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35906700 1 -- 172.21.15.153:0/2636578901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009370 con 0x7f8b30151530 2023-08-17T00:05:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b35906700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30151530 0x7f8b30146250 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f8b2800cf30 tx=0x7f8b28007840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2800ae40 con 0x7f8b30151530 2023-08-17T00:05:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b28016470 con 0x7f8b30151530 2023-08-17T00:05:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b30153a60 con 0x7f8b30151530 2023-08-17T00:05:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b280167f0 con 0x7f8b30151530 2023-08-17T00:05:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b301531c0 con 0x7f8b30151530 2023-08-17T00:05:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.577+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b30154260 con 0x7f8b30151530 2023-08-17T00:05:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.581+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8b2800d440 con 0x7f8b30151530 2023-08-17T00:05:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.581+0000 7f8b257fa700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8b1405a180 0x7f8b1405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.581+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f8b28074f50 con 0x7f8b30151530 2023-08-17T00:05:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.581+0000 7f8b35105700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8b1405a180 0x7f8b1405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.581+0000 7f8b35105700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8b1405a180 0x7f8b1405c640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8b2c000c00 tx=0x7f8b2c007d20).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.585+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8b30154260 con 0x7f8b30151530 2023-08-17T00:05:47.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.749+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b301541f0 con 0x7f8b30151530 2023-08-17T00:05:47.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.749+0000 7f8b257fa700 1 -- 172.21.15.153:0/2636578901 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+17372 (secure 0 0 0) 0x7f8b280487d0 con 0x7f8b30151530 2023-08-17T00:05:47.755 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:47.755 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:05:22.108566+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:03:39.751729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-17T00:03:40.984291+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":37,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.23","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]},{"pgid":"5.3c","mappings":[{"from":4,"to":5}]},{"pgid":"6.20","mappings":[{"from":4,"to":2}]},{"pgid":"6.26","mappings":[{"from":4,"to":7}]},{"pgid":"6.2f","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:05:47.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8b1405a180 msgr2=0x7f8b1405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8b1405a180 0x7f8b1405c640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f8b2c000c00 tx=0x7f8b2c007d20).stop 2023-08-17T00:05:47.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30151530 msgr2=0x7f8b30146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30151530 0x7f8b30146250 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f8b2800cf30 tx=0x7f8b28007840).stop 2023-08-17T00:05:47.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 shutdown_connections 2023-08-17T00:05:47.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8b1405a180 0x7f8b1405c640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b30151530 0x7f8b30146250 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b30068da0 0x7f8b30152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 --2- 172.21.15.153:0/2636578901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b300689c0 0x7f8b30154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 >> 172.21.15.153:0/2636578901 conn(0x7f8b300c6620 msgr2=0x7f8b300bffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:47.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 shutdown_connections 2023-08-17T00:05:47.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.753+0000 7f8b36107700 1 -- 172.21.15.153:0/2636578901 wait complete. 2023-08-17T00:05:47.778 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:05:47.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.933+0000 7fe4246f1700 1 Processor -- start 2023-08-17T00:05:47.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.933+0000 7fe4246f1700 1 -- start start 2023-08-17T00:05:47.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c151b90 0x7fe41c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe41c063290 0x7fe41c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe41c065b50 0x7fe41c064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0c3fb0 con 0x7fe41c063290 2023-08-17T00:05:47.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c152460 con 0x7fe41c065b50 2023-08-17T00:05:47.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c061fa0 con 0x7fe41c151b90 2023-08-17T00:05:47.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe41c063290 0x7fe41c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe41c063290 0x7fe41c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39284/0 (socket says 172.21.15.153:39284) 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 -- 172.21.15.153:0/1486805756 learned_addr learned my addr 172.21.15.153:0/1486805756 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe422c8e700 1 --2- 172.21.15.153:0/1486805756 >> v2:172.21.15.178:3300/0 conn(0x7fe41c065b50 0x7fe41c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe42248d700 1 --2- 172.21.15.153:0/1486805756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c151b90 0x7fe41c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 -- 172.21.15.153:0/1486805756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c151b90 msgr2=0x7fe41c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 --2- 172.21.15.153:0/1486805756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c151b90 0x7fe41c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 -- 172.21.15.153:0/1486805756 >> v2:172.21.15.178:3300/0 conn(0x7fe41c065b50 msgr2=0x7fe41c064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 --2- 172.21.15.153:0/1486805756 >> v2:172.21.15.178:3300/0 conn(0x7fe41c065b50 0x7fe41c064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 -- 172.21.15.153:0/1486805756 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0621f0 con 0x7fe41c063290 2023-08-17T00:05:47.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe422c8e700 1 --2- 172.21.15.153:0/1486805756 >> v2:172.21.15.178:3300/0 conn(0x7fe41c065b50 0x7fe41c064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:47.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe421c8c700 1 --2- 172.21.15.153:0/1486805756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c063290 0x7fe41c065660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe41c0a9df0 tx=0x7fe40c0090f0).ready entity=mon.0 client_cookie=73f8695ea3bb9004 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe42148b700 1 -- 172.21.15.153:0/1486805756 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00b600 con 0x7fe41c063290 2023-08-17T00:05:47.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe42148b700 1 -- 172.21.15.153:0/1486805756 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00b760 con 0x7fe41c063290 2023-08-17T00:05:47.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe42148b700 1 -- 172.21.15.153:0/1486805756 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00bae0 con 0x7fe41c063290 2023-08-17T00:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- 172.21.15.153:0/1486805756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c063290 msgr2=0x7fe41c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1486805756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c063290 0x7fe41c065660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe41c0a9df0 tx=0x7fe40c0090f0).stop 2023-08-17T00:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- 172.21.15.153:0/1486805756 shutdown_connections 2023-08-17T00:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1486805756 >> v2:172.21.15.178:3300/0 conn(0x7fe41c065b50 0x7fe41c064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1486805756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c063290 0x7fe41c065660 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1486805756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c151b90 0x7fe41c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- 172.21.15.153:0/1486805756 >> 172.21.15.153:0/1486805756 conn(0x7fe41c0c7150 msgr2=0x7fe41c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- 172.21.15.153:0/1486805756 shutdown_connections 2023-08-17T00:05:47.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.937+0000 7fe4246f1700 1 -- 172.21.15.153:0/1486805756 wait complete. 2023-08-17T00:05:47.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 Processor -- start 2023-08-17T00:05:47.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 -- start start 2023-08-17T00:05:47.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c063290 0x7fe41c164320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 0x7fe41c0bfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c151b90 0x7fe41c154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c163f00 con 0x7fe41c065b50 2023-08-17T00:05:47.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c155060 con 0x7fe41c151b90 2023-08-17T00:05:47.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe4246f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c155340 con 0x7fe41c063290 2023-08-17T00:05:47.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 0x7fe41c0bfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 0x7fe41c0bfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39288/0 (socket says 172.21.15.153:39288) 2023-08-17T00:05:47.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 -- 172.21.15.153:0/1557646024 learned_addr learned my addr 172.21.15.153:0/1557646024 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:47.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe422c8e700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c151b90 0x7fe41c154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe42248d700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c063290 0x7fe41c164320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 -- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c063290 msgr2=0x7fe41c164320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c063290 0x7fe41c164320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 -- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c151b90 msgr2=0x7fe41c154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c151b90 0x7fe41c154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 -- 172.21.15.153:0/1557646024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c009370 con 0x7fe41c065b50 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.941+0000 7fe421c8c700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 0x7fe41c0bfc40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe41c05e420 tx=0x7fe40c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00b8d0 con 0x7fe41c065b50 2023-08-17T00:05:47.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00ba30 con 0x7fe41c065b50 2023-08-17T00:05:47.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c01b660 con 0x7fe41c065b50 2023-08-17T00:05:47.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c163840 con 0x7fe41c065b50 2023-08-17T00:05:47.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c0a9fe0 con 0x7fe41c065b50 2023-08-17T00:05:47.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c164040 con 0x7fe41c065b50 2023-08-17T00:05:47.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.945+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe40c02b070 con 0x7fe41c065b50 2023-08-17T00:05:47.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.949+0000 7fe4127fc700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe40005a180 0x7fe40005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:47.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.949+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fe40c075aa0 con 0x7fe41c065b50 2023-08-17T00:05:47.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.949+0000 7fe42248d700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe40005a180 0x7fe40005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:47.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.949+0000 7fe42248d700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe40005a180 0x7fe40005c640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe418006fd0 tx=0x7fe418008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:47.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:47.957+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe41c164040 con 0x7fe41c065b50 2023-08-17T00:05:48.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:48.149+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe41c164040 con 0x7fe41c065b50 2023-08-17T00:05:49.126 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:05:49.125+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:05:49.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.133+0000 7fe4127fc700 1 -- 172.21.15.153:0/1557646024 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v31) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe41c164040 con 0x7fe41c065b50 2023-08-17T00:05:49.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe40005a180 msgr2=0x7fe40005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:49.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe40005a180 0x7fe40005c640 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe418006fd0 tx=0x7fe418008040).stop 2023-08-17T00:05:49.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 msgr2=0x7fe41c0bfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:49.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 0x7fe41c0bfc40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fe41c05e420 tx=0x7fe40c017000).stop 2023-08-17T00:05:49.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 shutdown_connections 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe40005a180 0x7fe40005c640 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c151b90 0x7fe41c154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe41c065b50 0x7fe41c0bfc40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 --2- 172.21.15.153:0/1557646024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c063290 0x7fe41c164320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 >> 172.21.15.153:0/1557646024 conn(0x7fe41c0c7150 msgr2=0x7fe41c0693e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 shutdown_connections 2023-08-17T00:05:49.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.137+0000 7fe4246f1700 1 -- 172.21.15.153:0/1557646024 wait complete. 2023-08-17T00:05:49.143 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:05:49.161 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:05:49.209 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:05:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 Processor -- start 2023-08-17T00:05:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 -- start start 2023-08-17T00:05:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e28150880 0x7f8e280a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e28068f30 0x7f8e28064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280ab9b0 con 0x7f8e280a8e60 2023-08-17T00:05:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280aada0 con 0x7f8e28150880 2023-08-17T00:05:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e280ab080 con 0x7f8e28068f30 2023-08-17T00:05:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e28150880 0x7f8e280a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:49.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e26d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e28068f30 0x7f8e28064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:49.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e28150880 0x7f8e280a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39320/0 (socket says 172.21.15.153:39320) 2023-08-17T00:05:49.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.313+0000 7f8e2659c700 1 -- 172.21.15.153:0/3184532996 learned_addr learned my addr 172.21.15.153:0/3184532996 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2559a700 1 -- 172.21.15.153:0/3184532996 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313769128 0 0) 0x7f8e280ab9b0 con 0x7f8e280a8e60 2023-08-17T00:05:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2659c700 1 -- 172.21.15.153:0/3184532996 >> v2:172.21.15.178:3300/0 conn(0x7f8e28068f30 msgr2=0x7f8e28064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2659c700 1 --2- 172.21.15.153:0/3184532996 >> v2:172.21.15.178:3300/0 conn(0x7f8e28068f30 0x7f8e28064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2659c700 1 -- 172.21.15.153:0/3184532996 >> v1:172.21.15.178:6789/0 conn(0x7f8e280a8e60 legacy=0x7f8e28068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2659c700 1 -- 172.21.15.153:0/3184532996 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280ab360 con 0x7f8e28150880 2023-08-17T00:05:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2659c700 1 --2- 172.21.15.153:0/3184532996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280a8970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f8e280c20a0 tx=0x7f8e1800b300).ready entity=mon.0 client_cookie=5b9d7a561120c36e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2559a700 1 -- 172.21.15.153:0/3184532996 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800da70 con 0x7f8e28150880 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2559a700 1 -- 172.21.15.153:0/3184532996 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800dbd0 con 0x7f8e28150880 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2559a700 1 -- 172.21.15.153:0/3184532996 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18005880 con 0x7f8e28150880 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 -- 172.21.15.153:0/3184532996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 msgr2=0x7f8e280a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 --2- 172.21.15.153:0/3184532996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280a8970 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f8e280c20a0 tx=0x7f8e1800b300).stop 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 -- 172.21.15.153:0/3184532996 shutdown_connections 2023-08-17T00:05:49.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 --2- 172.21.15.153:0/3184532996 >> v2:172.21.15.178:3300/0 conn(0x7f8e28068f30 0x7f8e28064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 --2- 172.21.15.153:0/3184532996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280a8970 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 -- 172.21.15.153:0/3184532996 >> 172.21.15.153:0/3184532996 conn(0x7f8e280c6620 msgr2=0x7f8e280c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 -- 172.21.15.153:0/3184532996 shutdown_connections 2023-08-17T00:05:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.317+0000 7f8e2759e700 1 -- 172.21.15.153:0/3184532996 wait complete. 2023-08-17T00:05:49.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 Processor -- start 2023-08-17T00:05:49.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 -- start start 2023-08-17T00:05:49.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e28068f30 0x7f8e28156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:49.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e280a8e60 0x7f8e28154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:49.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280bfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:49.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e280bdee0 con 0x7f8e28150880 2023-08-17T00:05:49.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28157440 con 0x7f8e280a8e60 2023-08-17T00:05:49.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28154fb0 con 0x7f8e28068f30 2023-08-17T00:05:49.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280bfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:49.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280bfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39322/0 (socket says 172.21.15.153:39322) 2023-08-17T00:05:49.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 -- 172.21.15.153:0/2516068983 learned_addr learned my addr 172.21.15.153:0/2516068983 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e25d9b700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e280a8e60 0x7f8e28154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e2659c700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e28068f30 0x7f8e28156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 -- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e28068f30 msgr2=0x7f8e28156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e28068f30 0x7f8e28156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 -- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e280a8e60 msgr2=0x7f8e28154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e280a8e60 0x7f8e28154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:49.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.321+0000 7f8e26d9d700 1 -- 172.21.15.153:0/2516068983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1800b5a0 con 0x7f8e28150880 2023-08-17T00:05:49.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e26d9d700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280bfdd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f8e20009ef0 tx=0x7f8e2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:49.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20009c50 con 0x7f8e28150880 2023-08-17T00:05:49.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000f040 con 0x7f8e28150880 2023-08-17T00:05:49.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e28157680 con 0x7f8e28150880 2023-08-17T00:05:49.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000cd40 con 0x7f8e28150880 2023-08-17T00:05:49.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e28157c40 con 0x7f8e28150880 2023-08-17T00:05:49.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e280be020 con 0x7f8e28150880 2023-08-17T00:05:49.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.325+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8e20013610 con 0x7f8e28150880 2023-08-17T00:05:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.329+0000 7f8e167fc700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e0805a150 0x7f8e0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.329+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f8e20074bf0 con 0x7f8e28150880 2023-08-17T00:05:49.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.329+0000 7f8e2659c700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e0805a150 0x7f8e0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:49.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.329+0000 7f8e2659c700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e0805a150 0x7f8e0805c610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8e1800b3f0 tx=0x7f8e1800b300).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:49.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.333+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8e20048470 con 0x7f8e28150880 2023-08-17T00:05:49.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:49.533+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8e280ab640 con 0x7f8e28150880 2023-08-17T00:05:50.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.133+0000 7f8e167fc700 1 -- 172.21.15.153:0/2516068983 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8e2004ba90 con 0x7f8e28150880 2023-08-17T00:05:50.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e0805a150 msgr2=0x7f8e0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e0805a150 0x7f8e0805c610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f8e1800b3f0 tx=0x7f8e1800b300).stop 2023-08-17T00:05:50.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 msgr2=0x7f8e280bfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280bfdd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f8e20009ef0 tx=0x7f8e2000b040).stop 2023-08-17T00:05:50.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 shutdown_connections 2023-08-17T00:05:50.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e0805a150 0x7f8e0805c610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e28150880 0x7f8e280bfdd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e280a8e60 0x7f8e28154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 --2- 172.21.15.153:0/2516068983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e28068f30 0x7f8e28156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 >> 172.21.15.153:0/2516068983 conn(0x7f8e280c6620 msgr2=0x7f8e280c5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 shutdown_connections 2023-08-17T00:05:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.137+0000 7f8e2759e700 1 -- 172.21.15.153:0/2516068983 wait complete. 2023-08-17T00:05:50.165 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:05:50.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.333+0000 7f6b69307700 1 Processor -- start 2023-08-17T00:05:50.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.333+0000 7f6b69307700 1 -- start start 2023-08-17T00:05:50.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b69307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:50.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b69307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640bfc80 con 0x7f6b640c5e60 2023-08-17T00:05:50.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b69307700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b640aa0b0 con 0x7f6b641543b0 2023-08-17T00:05:50.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b69307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640c6be0 con 0x7f6b640a9cd0 2023-08-17T00:05:50.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b68b06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6b640c5e60 0x7f6b640c0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50386/0 (socket says 172.21.15.153:50386) 2023-08-17T00:05:50.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b68b06700 1 -- 172.21.15.153:0/1888631459 learned_addr learned my addr 172.21.15.153:0/1888631459 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:50.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b63fff700 1 --2- 172.21.15.153:0/1888631459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:50.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b63fff700 1 -- 172.21.15.153:0/1888631459 >> v1:172.21.15.178:6789/0 conn(0x7f6b641543b0 legacy=0x7f6b640c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b63fff700 1 -- 172.21.15.153:0/1888631459 >> v1:172.21.15.153:6789/0 conn(0x7f6b640c5e60 legacy=0x7f6b640c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b63fff700 1 -- 172.21.15.153:0/1888631459 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b641549e0 con 0x7f6b640a9cd0 2023-08-17T00:05:50.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.337+0000 7f6b62ffd700 1 -- 172.21.15.153:0/1888631459 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1483825226 0 0) 0x7f6b640bfc80 con 0x7f6b640c5e60 2023-08-17T00:05:50.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b63fff700 1 --2- 172.21.15.153:0/1888631459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64153ec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6b54009790 tx=0x7f6b54009060).ready entity=mon.2 client_cookie=4a6b7b17830fee3a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:50.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b62ffd700 1 -- 172.21.15.153:0/1888631459 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400b5a0 con 0x7f6b640a9cd0 2023-08-17T00:05:50.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b62ffd700 1 -- 172.21.15.153:0/1888631459 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b5400b700 con 0x7f6b640a9cd0 2023-08-17T00:05:50.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b62ffd700 1 -- 172.21.15.153:0/1888631459 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5400ba80 con 0x7f6b640a9cd0 2023-08-17T00:05:50.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 -- 172.21.15.153:0/1888631459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 msgr2=0x7f6b64153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 --2- 172.21.15.153:0/1888631459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64153ec0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6b54009790 tx=0x7f6b54009060).stop 2023-08-17T00:05:50.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 -- 172.21.15.153:0/1888631459 shutdown_connections 2023-08-17T00:05:50.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 --2- 172.21.15.153:0/1888631459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64153ec0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 -- 172.21.15.153:0/1888631459 >> 172.21.15.153:0/1888631459 conn(0x7f6b64062a70 msgr2=0x7f6b640ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:50.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 -- 172.21.15.153:0/1888631459 shutdown_connections 2023-08-17T00:05:50.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.341+0000 7f6b69307700 1 -- 172.21.15.153:0/1888631459 wait complete. 2023-08-17T00:05:50.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 Processor -- start 2023-08-17T00:05:50.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 -- start start 2023-08-17T00:05:50.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:50.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b640c5e60 0x7f6b64148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:50.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 0x7f6b640ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:50.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640ad7a0 con 0x7f6b641543b0 2023-08-17T00:05:50.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b640c4870 con 0x7f6b640c5e60 2023-08-17T00:05:50.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b69307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b64164e50 con 0x7f6b640a9cd0 2023-08-17T00:05:50.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b68b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 0x7f6b640ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:50.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b68b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 0x7f6b640ab7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39324/0 (socket says 172.21.15.153:39324) 2023-08-17T00:05:50.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b68b06700 1 -- 172.21.15.153:0/1709683530 learned_addr learned my addr 172.21.15.153:0/1709683530 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:50.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b63fff700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:50.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.345+0000 7f6b637fe700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b640c5e60 0x7f6b64148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b637fe700 1 -- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 msgr2=0x7f6b64164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b637fe700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b637fe700 1 -- 172.21.15.153:0/1709683530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 msgr2=0x7f6b640ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b637fe700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 0x7f6b640ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b637fe700 1 -- 172.21.15.153:0/1709683530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540092a0 con 0x7f6b640c5e60 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b68b06700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 0x7f6b640ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b637fe700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b640c5e60 0x7f6b64148eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6b5800c410 tx=0x7f6b58007d40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:50.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5800cea0 con 0x7f6b640c5e60 2023-08-17T00:05:50.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b58007020 con 0x7f6b640c5e60 2023-08-17T00:05:50.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b580073c0 con 0x7f6b640c5e60 2023-08-17T00:05:50.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b640af100 con 0x7f6b640c5e60 2023-08-17T00:05:50.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b640adc90 con 0x7f6b640c5e60 2023-08-17T00:05:50.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.349+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b64046dd0 con 0x7f6b640c5e60 2023-08-17T00:05:50.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.353+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6b58010070 con 0x7f6b640c5e60 2023-08-17T00:05:50.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.353+0000 7f6b4bfff700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5005a180 0x7f6b5005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:50.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.353+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6b580731f0 con 0x7f6b640c5e60 2023-08-17T00:05:50.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.353+0000 7f6b63fff700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5005a180 0x7f6b5005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:50.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.353+0000 7f6b63fff700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5005a180 0x7f6b5005c640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f6b540096e0 tx=0x7f6b54015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:50.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.357+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b58046b80 con 0x7f6b640c5e60 2023-08-17T00:05:50.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:50.521+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6b64064070 con 0x7f6b640c5e60 2023-08-17T00:05:51.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.357+0000 7f6b4bfff700 1 -- 172.21.15.153:0/1709683530 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6b5804a1a0 con 0x7f6b640c5e60 2023-08-17T00:05:51.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5005a180 msgr2=0x7f6b5005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5005a180 0x7f6b5005c640 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f6b540096e0 tx=0x7f6b54015000).stop 2023-08-17T00:05:51.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b640c5e60 msgr2=0x7f6b64148eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b640c5e60 0x7f6b64148eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6b5800c410 tx=0x7f6b58007d40).stop 2023-08-17T00:05:51.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 shutdown_connections 2023-08-17T00:05:51.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5005a180 0x7f6b5005c640 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b641543b0 0x7f6b640ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b640c5e60 0x7f6b64148eb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 --2- 172.21.15.153:0/1709683530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b640a9cd0 0x7f6b64164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 >> 172.21.15.153:0/1709683530 conn(0x7f6b64062a70 msgr2=0x7f6b640c0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:51.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 shutdown_connections 2023-08-17T00:05:51.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.361+0000 7f6b69307700 1 -- 172.21.15.153:0/1709683530 wait complete. 2023-08-17T00:05:51.369 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:05:51.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:05:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.549+0000 7f3d4ffff700 1 Processor -- start 2023-08-17T00:05:51.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.549+0000 7f3d4ffff700 1 -- start start 2023-08-17T00:05:51.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d500a9cd0 0x7f3d50153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d500bfc80 con 0x7f3d501543b0 2023-08-17T00:05:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4ffff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d500aa0b0 con 0x7f3d500c5e60 2023-08-17T00:05:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4ffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d500c6be0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d500a9cd0 0x7f3d50153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d500a9cd0 0x7f3d50153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39326/0 (socket says 172.21.15.153:39326) 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4effd700 1 -- 172.21.15.153:0/2072436143 learned_addr learned my addr 172.21.15.153:0/2072436143 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.553+0000 7f3d4effd700 1 -- 172.21.15.153:0/2072436143 >> v1:172.21.15.178:6789/0 conn(0x7f3d500c5e60 legacy=0x7f3d500c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4effd700 1 -- 172.21.15.153:0/2072436143 >> v1:172.21.15.153:6789/0 conn(0x7f3d501543b0 legacy=0x7f3d500c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4effd700 1 -- 172.21.15.153:0/2072436143 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d501549e0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4dffb700 1 -- 172.21.15.153:0/2072436143 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590066770 0 0) 0x7f3d500bfc80 con 0x7f3d501543b0 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4effd700 1 --2- 172.21.15.153:0/2072436143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50153ec0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f3d40006fd0 tx=0x7f3d400090f0).ready entity=mon.0 client_cookie=a364fe28e942e5ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:51.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4dffb700 1 -- 172.21.15.153:0/2072436143 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000b600 con 0x7f3d500a9cd0 2023-08-17T00:05:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4dffb700 1 -- 172.21.15.153:0/2072436143 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4000b760 con 0x7f3d500a9cd0 2023-08-17T00:05:51.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4dffb700 1 -- 172.21.15.153:0/2072436143 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000bae0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 -- 172.21.15.153:0/2072436143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 msgr2=0x7f3d50153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/2072436143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50153ec0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f3d40006fd0 tx=0x7f3d400090f0).stop 2023-08-17T00:05:51.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 -- 172.21.15.153:0/2072436143 shutdown_connections 2023-08-17T00:05:51.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/2072436143 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50153ec0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 -- 172.21.15.153:0/2072436143 >> 172.21.15.153:0/2072436143 conn(0x7f3d50062a70 msgr2=0x7f3d500ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:51.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 -- 172.21.15.153:0/2072436143 shutdown_connections 2023-08-17T00:05:51.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.557+0000 7f3d4ffff700 1 -- 172.21.15.153:0/2072436143 wait complete. 2023-08-17T00:05:51.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 Processor -- start 2023-08-17T00:05:51.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 -- start start 2023-08-17T00:05:51.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50163820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:51.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d500c5e60 0x7f3d50163d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:51.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d501543b0 0x7f3d501677c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:51.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d50141fd0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500c2a20 con 0x7f3d500c5e60 2023-08-17T00:05:51.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d500c2d00 con 0x7f3d501543b0 2023-08-17T00:05:51.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50163820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:51.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50163820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39342/0 (socket says 172.21.15.153:39342) 2023-08-17T00:05:51.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 -- 172.21.15.153:0/1631441312 learned_addr learned my addr 172.21.15.153:0/1631441312 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:51.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4e7fc700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d500c5e60 0x7f3d50163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:51.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4f7fe700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d501543b0 0x7f3d501677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:51.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 -- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d501543b0 msgr2=0x7f3d501677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d501543b0 0x7f3d501677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 -- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d500c5e60 msgr2=0x7f3d50163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:51.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d500c5e60 0x7f3d50163d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:51.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.561+0000 7f3d4effd700 1 -- 172.21.15.153:0/1631441312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40009370 con 0x7f3d500a9cd0 2023-08-17T00:05:51.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d4effd700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50163820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f3d40009130 tx=0x7f3d40017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:51.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4000bae0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d40000c90 con 0x7f3d500a9cd0 2023-08-17T00:05:51.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d500c2fe0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d4001b660 con 0x7f3d500a9cd0 2023-08-17T00:05:51.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d500c35a0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.565+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d50046dd0 con 0x7f3d500a9cd0 2023-08-17T00:05:51.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.569+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3d4002b070 con 0x7f3d500a9cd0 2023-08-17T00:05:51.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.569+0000 7f3d36ffd700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d3c05a150 0x7f3d3c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:51.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.569+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5856+0+0 (secure 0 0 0) 0x7f3d40075a40 con 0x7f3d500a9cd0 2023-08-17T00:05:51.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.569+0000 7f3d4e7fc700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d3c05a150 0x7f3d3c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:51.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.569+0000 7f3d4e7fc700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d3c05a150 0x7f3d3c05c610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3d500c1aa0 tx=0x7f3d44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:51.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.573+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d40049510 con 0x7f3d500a9cd0 2023-08-17T00:05:51.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:51.737+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d50064070 con 0x7f3d500a9cd0 2023-08-17T00:05:52.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.369+0000 7f3d36ffd700 1 -- 172.21.15.153:0/1631441312 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d40029070 con 0x7f3d500a9cd0 2023-08-17T00:05:52.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d3c05a150 msgr2=0x7f3d3c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d3c05a150 0x7f3d3c05c610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3d500c1aa0 tx=0x7f3d44009040).stop 2023-08-17T00:05:52.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 msgr2=0x7f3d50163820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50163820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f3d40009130 tx=0x7f3d40017000).stop 2023-08-17T00:05:52.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 shutdown_connections 2023-08-17T00:05:52.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d3c05a150 0x7f3d3c05c610 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d501543b0 0x7f3d501677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d500c5e60 0x7f3d50163d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 --2- 172.21.15.153:0/1631441312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d500a9cd0 0x7f3d50163820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 >> 172.21.15.153:0/1631441312 conn(0x7f3d50062a70 msgr2=0x7f3d500631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:52.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 shutdown_connections 2023-08-17T00:05:52.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.377+0000 7f3d4ffff700 1 -- 172.21.15.153:0/1631441312 wait complete. 2023-08-17T00:05:52.384 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:05:52.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:05:52.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.557+0000 7f3e9b59e700 1 Processor -- start 2023-08-17T00:05:52.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.557+0000 7f3e9b59e700 1 -- start start 2023-08-17T00:05:52.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.557+0000 7f3e9b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3e9c0acf30 0x7f3e9c0c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c154e90 con 0x7f3e9c063bc0 2023-08-17T00:05:52.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c153fc0 con 0x7f3e9c0c5ea0 2023-08-17T00:05:52.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c154280 con 0x7f3e9c0acf30 2023-08-17T00:05:52.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9ad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3e9c063bc0 0x7f3e9c0bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50398/0 (socket says 172.21.15.153:50398) 2023-08-17T00:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9ad9d700 1 -- 172.21.15.153:0/2404610811 learned_addr learned my addr 172.21.15.153:0/2404610811 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9a59c700 1 --2- 172.21.15.153:0/2404610811 >> v2:172.21.15.178:3300/0 conn(0x7f3e9c0acf30 0x7f3e9c0c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9959a700 1 -- 172.21.15.153:0/2404610811 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21468842 0 0) 0x7f3e9c154e90 con 0x7f3e9c063bc0 2023-08-17T00:05:52.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9959a700 1 -- 172.21.15.153:0/2404610811 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e840033f0 con 0x7f3e9c063bc0 2023-08-17T00:05:52.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2404610811 >> v1:172.21.15.178:6789/0 conn(0x7f3e9c0c5ea0 legacy=0x7f3e9c0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2404610811 >> v1:172.21.15.153:6789/0 conn(0x7f3e9c063bc0 legacy=0x7f3e9c0bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2404610811 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c154560 con 0x7f3e9c0acf30 2023-08-17T00:05:52.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9a59c700 1 --2- 172.21.15.153:0/2404610811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c1020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3e8c009760 tx=0x7f3e8c009060).ready entity=mon.1 client_cookie=a47013b2627c7d50 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:52.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9959a700 1 -- 172.21.15.153:0/2404610811 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00f510 con 0x7f3e9c0acf30 2023-08-17T00:05:52.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9959a700 1 -- 172.21.15.153:0/2404610811 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c00f670 con 0x7f3e9c0acf30 2023-08-17T00:05:52.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9959a700 1 -- 172.21.15.153:0/2404610811 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00f9f0 con 0x7f3e9c0acf30 2023-08-17T00:05:52.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2404610811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 msgr2=0x7f3e9c0c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.561+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2404610811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c1020 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3e8c009760 tx=0x7f3e8c009060).stop 2023-08-17T00:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2404610811 shutdown_connections 2023-08-17T00:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2404610811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c1020 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2404610811 >> 172.21.15.153:0/2404610811 conn(0x7f3e9c0cb330 msgr2=0x7f3e9c0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2404610811 shutdown_connections 2023-08-17T00:05:52.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2404610811 wait complete. 2023-08-17T00:05:52.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 Processor -- start 2023-08-17T00:05:52.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.565+0000 7f3e9b59e700 1 -- start start 2023-08-17T00:05:52.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 0x7f3e9c140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9c0c0790 0x7f3e9c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0c3310 con 0x7f3e9c063bc0 2023-08-17T00:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0c0c10 con 0x7f3e9c0acf30 2023-08-17T00:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0c2700 con 0x7f3e9c0c0790 2023-08-17T00:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 0x7f3e9c140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 0x7f3e9c140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39352/0 (socket says 172.21.15.153:39352) 2023-08-17T00:05:52.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2717072160 learned_addr learned my addr 172.21.15.153:0/2717072160 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9c0c0790 msgr2=0x7f3e9c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9c0c0790 0x7f3e9c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 msgr2=0x7f3e9c0c02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e99d9b700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 -- 172.21.15.153:0/2717072160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0092a0 con 0x7f3e9c063bc0 2023-08-17T00:05:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e99d9b700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9a59c700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 0x7f3e9c140c30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f3e8c006df0 tx=0x7f3e8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c00f9f0 con 0x7f3e9c063bc0 2023-08-17T00:05:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c000c90 con 0x7f3e9c063bc0 2023-08-17T00:05:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c0c29e0 con 0x7f3e9c063bc0 2023-08-17T00:05:52.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c01b660 con 0x7f3e9c063bc0 2023-08-17T00:05:52.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.569+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c0c2fa0 con 0x7f3e9c063bc0 2023-08-17T00:05:52.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.573+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c06b4c0 con 0x7f3e9c063bc0 2023-08-17T00:05:52.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.573+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3e8c00f070 con 0x7f3e9c063bc0 2023-08-17T00:05:52.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.573+0000 7f3e8a7fc700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e7c05a150 0x7f3e7c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.573+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3e8c075900 con 0x7f3e9c063bc0 2023-08-17T00:05:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.573+0000 7f3e99d9b700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e7c05a150 0x7f3e7c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.573+0000 7f3e99d9b700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e7c05a150 0x7f3e7c05c610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3e9c156950 tx=0x7f3e90009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:52.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.581+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e8c049540 con 0x7f3e9c063bc0 2023-08-17T00:05:52.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.741+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3e9c154840 con 0x7f3e9c063bc0 2023-08-17T00:05:52.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.749+0000 7f3e8a7fc700 1 -- 172.21.15.153:0/2717072160 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3e8c028020 con 0x7f3e9c063bc0 2023-08-17T00:05:52.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e7c05a150 msgr2=0x7f3e7c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e7c05a150 0x7f3e7c05c610 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f3e9c156950 tx=0x7f3e90009040).stop 2023-08-17T00:05:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 msgr2=0x7f3e9c140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 0x7f3e9c140c30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f3e8c006df0 tx=0x7f3e8c017000).stop 2023-08-17T00:05:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 shutdown_connections 2023-08-17T00:05:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e7c05a150 0x7f3e7c05c610 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e9c0c0790 0x7f3e9c0c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e9c0acf30 0x7f3e9c0c02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 --2- 172.21.15.153:0/2717072160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e9c063bc0 0x7f3e9c140c30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 >> 172.21.15.153:0/2717072160 conn(0x7f3e9c0cb330 msgr2=0x7f3e9c155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 shutdown_connections 2023-08-17T00:05:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.753+0000 7f3e9b59e700 1 -- 172.21.15.153:0/2717072160 wait complete. 2023-08-17T00:05:52.777 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2023-08-17T00:05:52.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.921+0000 7f4ef9039700 1 Processor -- start 2023-08-17T00:05:52.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.921+0000 7f4ef9039700 1 -- start start 2023-08-17T00:05:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef9039700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ef40a8df0 0x7f4ef40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef9039700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ef4068820 0x7f4ef4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef9039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4061fa0 0x7f4ef4062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef9039700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef41585a0 con 0x7f4ef40a8df0 2023-08-17T00:05:52.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef9039700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef4066400 con 0x7f4ef4068820 2023-08-17T00:05:52.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef9039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef4069170 con 0x7f4ef4061fa0 2023-08-17T00:05:52.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4ef3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4ef40a8df0 0x7f4ef40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4eeb7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ef4068820 0x7f4ef4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4eeb7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ef4068820 0x7f4ef4068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:52200/0 (socket says 172.21.15.153:52200) 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.925+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/2797955089 learned_addr learned my addr 172.21.15.153:0/2797955089 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef8838700 1 --2- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4061fa0 0x7f4ef4062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4061fa0 msgr2=0x7f4ef4062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4eeb7fe700 1 --2- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4061fa0 0x7f4ef4062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/2797955089 >> v2:172.21.15.153:3300/0 conn(0x7f4ef40a8df0 msgr2=0x7f4ef40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:52.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4eeb7fe700 1 --2- 172.21.15.153:0/2797955089 >> v2:172.21.15.153:3300/0 conn(0x7f4ef40a8df0 0x7f4ef40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/2797955089 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40b9d30 con 0x7f4ef4068820 2023-08-17T00:05:52.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef3fff700 1 --2- 172.21.15.153:0/2797955089 >> v2:172.21.15.153:3300/0 conn(0x7f4ef40a8df0 0x7f4ef40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:52.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4eeb7fe700 1 --2- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef4068820 0x7f4ef4068c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4ef40c2ef0 tx=0x7f4edc0090f0).ready entity=mon.1 client_cookie=34d9505ffaf31542 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef37fe700 1 -- 172.21.15.153:0/2797955089 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00f510 con 0x7f4ef4068820 2023-08-17T00:05:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef37fe700 1 -- 172.21.15.153:0/2797955089 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc00f670 con 0x7f4ef4068820 2023-08-17T00:05:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef37fe700 1 -- 172.21.15.153:0/2797955089 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00fa10 con 0x7f4ef4068820 2023-08-17T00:05:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 -- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef4068820 msgr2=0x7f4ef4068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 --2- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef4068820 0x7f4ef4068c80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f4ef40c2ef0 tx=0x7f4edc0090f0).stop 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 -- 172.21.15.153:0/2797955089 shutdown_connections 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 --2- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4061fa0 0x7f4ef4062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 --2- 172.21.15.153:0/2797955089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef4068820 0x7f4ef4068c80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 --2- 172.21.15.153:0/2797955089 >> v2:172.21.15.153:3300/0 conn(0x7f4ef40a8df0 0x7f4ef40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 -- 172.21.15.153:0/2797955089 >> 172.21.15.153:0/2797955089 conn(0x7f4ef40c6620 msgr2=0x7f4ef40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 -- 172.21.15.153:0/2797955089 shutdown_connections 2023-08-17T00:05:52.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.929+0000 7f4ef9039700 1 -- 172.21.15.153:0/2797955089 wait complete. 2023-08-17T00:05:52.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.933+0000 7f4ef9039700 1 Processor -- start 2023-08-17T00:05:52.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.933+0000 7f4ef9039700 1 -- start start 2023-08-17T00:05:52.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.933+0000 7f4ef9039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 0x7f4ef40b9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.933+0000 7f4ef9039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4068820 0x7f4ef4157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.933+0000 7f4ef9039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef40a8df0 0x7f4ef40bc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef9039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40becc0 con 0x7f4ef4061fa0 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef9039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef40b9780 con 0x7f4ef40a8df0 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef9039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef415af90 con 0x7f4ef4068820 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 0x7f4ef40b9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4068820 0x7f4ef4157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 0x7f4ef40b9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39374/0 (socket says 172.21.15.153:39374) 2023-08-17T00:05:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef3fff700 1 -- 172.21.15.153:0/3196865669 learned_addr learned my addr 172.21.15.153:0/3196865669 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:52.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef8838700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef40a8df0 0x7f4ef40bc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef40a8df0 msgr2=0x7f4ef40bc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef40a8df0 0x7f4ef40bc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/3196865669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 msgr2=0x7f4ef40b9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 0x7f4ef40b9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:52.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 -- 172.21.15.153:0/3196865669 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee4009240 con 0x7f4ef4068820 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef3fff700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 0x7f4ef40b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4eeb7fe700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4068820 0x7f4ef4157110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4edc014000 tx=0x7f4edc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc006d90 con 0x7f4ef4068820 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4edc000bc0 con 0x7f4ef4068820 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4edc009370 con 0x7f4ef4068820 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc024470 con 0x7f4ef4068820 2023-08-17T00:05:52.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef40be950 con 0x7f4ef4068820 2023-08-17T00:05:52.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef40be7b0 con 0x7f4ef4068820 2023-08-17T00:05:52.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.937+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4edc00f070 con 0x7f4ef4068820 2023-08-17T00:05:52.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.941+0000 7f4ef0ff9700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ed405a150 0x7f4ed405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.941+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4edc075870 con 0x7f4ef4068820 2023-08-17T00:05:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.941+0000 7f4ef3fff700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ed405a150 0x7f4ed405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.941+0000 7f4ef3fff700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ed405a150 0x7f4ed405c610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4ee4009fd0 tx=0x7f4ee4009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:52.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:52.953+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4ef40be7b0 con 0x7f4ef4068820 2023-08-17T00:05:53.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.169+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f4ef406b4c0 con 0x7f4ef4068820 2023-08-17T00:05:53.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.377+0000 7f4ef0ff9700 1 -- 172.21.15.153:0/3196865669 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v160) v1 ==== 148+0+0 (secure 0 0 0) 0x7f4edc049510 con 0x7f4ef4068820 2023-08-17T00:05:53.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ed405a150 msgr2=0x7f4ed405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ed405a150 0x7f4ed405c610 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f4ee4009fd0 tx=0x7f4ee4009060).stop 2023-08-17T00:05:53.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4068820 msgr2=0x7f4ef4157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4068820 0x7f4ef4157110 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f4edc014000 tx=0x7f4edc017000).stop 2023-08-17T00:05:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 shutdown_connections 2023-08-17T00:05:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ed405a150 0x7f4ed405c610 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ef40a8df0 0x7f4ef40bc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ef4068820 0x7f4ef4157110 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 --2- 172.21.15.153:0/3196865669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ef4061fa0 0x7f4ef40b9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 >> 172.21.15.153:0/3196865669 conn(0x7f4ef40c6620 msgr2=0x7f4ef40c59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:53.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 shutdown_connections 2023-08-17T00:05:53.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.381+0000 7f4ef9039700 1 -- 172.21.15.153:0/3196865669 wait complete. 2023-08-17T00:05:53.408 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2023-08-17T00:05:53.409 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-08-17T00:05:53.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2023-08-17T00:05:53.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.565+0000 7f3b49279700 1 Processor -- start 2023-08-17T00:05:53.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.565+0000 7f3b49279700 1 -- start start 2023-08-17T00:05:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b49279700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b440689c0 0x7f3b44068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b49279700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b44065da0 con 0x7f3b441560f0 2023-08-17T00:05:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b49279700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b44155c60 con 0x7f3b44151530 2023-08-17T00:05:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b49279700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b44156550 con 0x7f3b440689c0 2023-08-17T00:05:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b440689c0 0x7f3b44068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b440689c0 0x7f3b44068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39378/0 (socket says 172.21.15.153:39378) 2023-08-17T00:05:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 -- 172.21.15.153:0/4005423528 learned_addr learned my addr 172.21.15.153:0/4005423528 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 -- 172.21.15.153:0/4005423528 >> v1:172.21.15.178:6789/0 conn(0x7f3b44151530 legacy=0x7f3b441519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 -- 172.21.15.153:0/4005423528 >> v1:172.21.15.153:6789/0 conn(0x7f3b441560f0 legacy=0x7f3b440c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 -- 172.21.15.153:0/4005423528 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b44065ff0 con 0x7f3b440689c0 2023-08-17T00:05:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b43fff700 1 --2- 172.21.15.153:0/4005423528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b44068da0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f3b3c009f70 tx=0x7f3b3c009840).ready entity=mon.0 client_cookie=8c975ffb99e1ccf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b42ffd700 1 -- 172.21.15.153:0/4005423528 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00e070 con 0x7f3b440689c0 2023-08-17T00:05:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b42ffd700 1 -- 172.21.15.153:0/4005423528 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c00bad0 con 0x7f3b440689c0 2023-08-17T00:05:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.569+0000 7f3b42ffd700 1 -- 172.21.15.153:0/4005423528 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00be50 con 0x7f3b440689c0 2023-08-17T00:05:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 -- 172.21.15.153:0/4005423528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 msgr2=0x7f3b44068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 --2- 172.21.15.153:0/4005423528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b44068da0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f3b3c009f70 tx=0x7f3b3c009840).stop 2023-08-17T00:05:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 -- 172.21.15.153:0/4005423528 shutdown_connections 2023-08-17T00:05:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 --2- 172.21.15.153:0/4005423528 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b44068da0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 -- 172.21.15.153:0/4005423528 >> 172.21.15.153:0/4005423528 conn(0x7f3b440c6620 msgr2=0x7f3b440c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 -- 172.21.15.153:0/4005423528 shutdown_connections 2023-08-17T00:05:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.573+0000 7f3b49279700 1 -- 172.21.15.153:0/4005423528 wait complete. 2023-08-17T00:05:53.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 Processor -- start 2023-08-17T00:05:53.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 -- start start 2023-08-17T00:05:53.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b4414dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:53.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b44151530 0x7f3b440c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:53.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b441560f0 0x7f3b440c2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:53.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440c0a80 con 0x7f3b440689c0 2023-08-17T00:05:53.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440c0cd0 con 0x7f3b44151530 2023-08-17T00:05:53.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b49279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440c0fb0 con 0x7f3b441560f0 2023-08-17T00:05:53.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b4414dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:53.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b4414dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39386/0 (socket says 172.21.15.153:39386) 2023-08-17T00:05:53.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 -- 172.21.15.153:0/2437803536 learned_addr learned my addr 172.21.15.153:0/2437803536 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:53.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b437fe700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b44151530 0x7f3b440c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:53.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b48a78700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b441560f0 0x7f3b440c2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:53.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 -- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b441560f0 msgr2=0x7f3b440c2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b441560f0 0x7f3b440c2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 -- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b44151530 msgr2=0x7f3b440c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:53.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b44151530 0x7f3b440c1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:53.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 -- 172.21.15.153:0/2437803536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c009ae0 con 0x7f3b440689c0 2023-08-17T00:05:53.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b48a78700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b441560f0 0x7f3b440c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:53.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b437fe700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b44151530 0x7f3b440c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:53.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.577+0000 7f3b43fff700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b4414dcf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f3b3c00b770 tx=0x7f3b3c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00be50 con 0x7f3b440689c0 2023-08-17T00:05:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c01d460 con 0x7f3b440689c0 2023-08-17T00:05:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b440c1290 con 0x7f3b440689c0 2023-08-17T00:05:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c01d820 con 0x7f3b440689c0 2023-08-17T00:05:53.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b440c1850 con 0x7f3b440689c0 2023-08-17T00:05:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b440bfaa0 con 0x7f3b440689c0 2023-08-17T00:05:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.581+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3b3c024030 con 0x7f3b440689c0 2023-08-17T00:05:53.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.585+0000 7f3b3bfff700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b2405a150 0x7f3b2405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.585+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3b3c075560 con 0x7f3b440689c0 2023-08-17T00:05:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.585+0000 7f3b437fe700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b2405a150 0x7f3b2405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.585+0000 7f3b437fe700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b2405a150 0x7f3b2405c610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3b440a8eb0 tx=0x7f3b2c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:53.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.589+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b3c0492b0 con 0x7f3b440689c0 2023-08-17T00:05:53.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:53.809+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f3b4406b4c0 con 0x7f3b440689c0 2023-08-17T00:05:54.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.377+0000 7f3b3bfff700 1 -- 172.21.15.153:0/2437803536 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v161) v1 ==== 146+0+0 (secure 0 0 0) 0x7f3b3c022070 con 0x7f3b440689c0 2023-08-17T00:05:54.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.381+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b2405a150 msgr2=0x7f3b2405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b2405a150 0x7f3b2405c610 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f3b440a8eb0 tx=0x7f3b2c009040).stop 2023-08-17T00:05:54.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 msgr2=0x7f3b4414dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b4414dcf0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f3b3c00b770 tx=0x7f3b3c009840).stop 2023-08-17T00:05:54.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 shutdown_connections 2023-08-17T00:05:54.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b2405a150 0x7f3b2405c610 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b441560f0 0x7f3b440c2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b44151530 0x7f3b440c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 --2- 172.21.15.153:0/2437803536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b440689c0 0x7f3b4414dcf0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 >> 172.21.15.153:0/2437803536 conn(0x7f3b440c6620 msgr2=0x7f3b44061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 shutdown_connections 2023-08-17T00:05:54.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.385+0000 7f3b49279700 1 -- 172.21.15.153:0/2437803536 wait complete. 2023-08-17T00:05:54.410 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:05:54.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.569+0000 7f8518bb9700 1 Processor -- start 2023-08-17T00:05:54.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.569+0000 7f8518bb9700 1 -- start start 2023-08-17T00:05:54.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8518bb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f85140c57a0 0x7f85140c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:54.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8518bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:54.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8518bb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140bfd10 con 0x7f8514153f50 2023-08-17T00:05:54.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8518bb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8514154860 con 0x7f85140c57a0 2023-08-17T00:05:54.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8518bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514154af0 con 0x7f85140c11b0 2023-08-17T00:05:54.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8512ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8514153f50 0x7f8514157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50414/0 (socket says 172.21.15.153:50414) 2023-08-17T00:05:54.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8512ffd700 1 -- 172.21.15.153:0/2116853842 learned_addr learned my addr 172.21.15.153:0/2116853842 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:54.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f85137fe700 1 --2- 172.21.15.153:0/2116853842 >> v2:172.21.15.178:3300/0 conn(0x7f85140c57a0 0x7f85140c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:54.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8513fff700 1 --2- 172.21.15.153:0/2116853842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:54.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f85127fc700 1 -- 172.21.15.153:0/2116853842 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984181563 0 0) 0x7f85140bfd10 con 0x7f8514153f50 2023-08-17T00:05:54.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8513fff700 1 -- 172.21.15.153:0/2116853842 >> v2:172.21.15.178:3300/0 conn(0x7f85140c57a0 msgr2=0x7f85140c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:54.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8513fff700 1 --2- 172.21.15.153:0/2116853842 >> v2:172.21.15.178:3300/0 conn(0x7f85140c57a0 0x7f85140c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8513fff700 1 -- 172.21.15.153:0/2116853842 >> v1:172.21.15.153:6789/0 conn(0x7f8514153f50 legacy=0x7f8514157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.573+0000 7f8513fff700 1 -- 172.21.15.153:0/2116853842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514154dd0 con 0x7f85140c11b0 2023-08-17T00:05:54.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8513fff700 1 --2- 172.21.15.153:0/2116853842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514154370 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f850c009e60 tx=0x7f850c009780).ready entity=mon.2 client_cookie=5afbd12928ff6e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:54.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f85127fc700 1 -- 172.21.15.153:0/2116853842 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00e070 con 0x7f85140c11b0 2023-08-17T00:05:54.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f85127fc700 1 -- 172.21.15.153:0/2116853842 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00bb60 con 0x7f85140c11b0 2023-08-17T00:05:54.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f85127fc700 1 -- 172.21.15.153:0/2116853842 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c012410 con 0x7f85140c11b0 2023-08-17T00:05:54.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 -- 172.21.15.153:0/2116853842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 msgr2=0x7f8514154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 --2- 172.21.15.153:0/2116853842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514154370 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f850c009e60 tx=0x7f850c009780).stop 2023-08-17T00:05:54.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 -- 172.21.15.153:0/2116853842 shutdown_connections 2023-08-17T00:05:54.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 --2- 172.21.15.153:0/2116853842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514154370 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 --2- 172.21.15.153:0/2116853842 >> v2:172.21.15.178:3300/0 conn(0x7f85140c57a0 0x7f85140c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 -- 172.21.15.153:0/2116853842 >> 172.21.15.153:0/2116853842 conn(0x7f8514062a70 msgr2=0x7f85140ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:54.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 -- 172.21.15.153:0/2116853842 shutdown_connections 2023-08-17T00:05:54.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.577+0000 7f8518bb9700 1 -- 172.21.15.153:0/2116853842 wait complete. 2023-08-17T00:05:54.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 Processor -- start 2023-08-17T00:05:54.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 -- start start 2023-08-17T00:05:54.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c57a0 0x7f851414ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 0x7f8514063390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140af2f0 con 0x7f8514153f50 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8514153820 con 0x7f85140c57a0 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8518bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85140ae9c0 con 0x7f85140c11b0 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8513fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 0x7f8514063390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8513fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 0x7f8514063390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39388/0 (socket says 172.21.15.153:39388) 2023-08-17T00:05:54.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8513fff700 1 -- 172.21.15.153:0/3748925453 learned_addr learned my addr 172.21.15.153:0/3748925453 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:54.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f8512ffd700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c57a0 0x7f851414ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.581+0000 7f85137fe700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8513fff700 1 -- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 msgr2=0x7f8514153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8513fff700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8513fff700 1 -- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c57a0 msgr2=0x7f851414ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8513fff700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c57a0 0x7f851414ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8513fff700 1 -- 172.21.15.153:0/3748925453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009a20 con 0x7f8514153f50 2023-08-17T00:05:54.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8513fff700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 0x7f8514063390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f850c00b6c0 tx=0x7f850c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c01d630 con 0x7f8514153f50 2023-08-17T00:05:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c01d790 con 0x7f8514153f50 2023-08-17T00:05:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c01db30 con 0x7f8514153f50 2023-08-17T00:05:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85140aeca0 con 0x7f8514153f50 2023-08-17T00:05:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514168170 con 0x7f8514153f50 2023-08-17T00:05:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.585+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85140af460 con 0x7f8514153f50 2023-08-17T00:05:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.589+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f850c026410 con 0x7f8514153f50 2023-08-17T00:05:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.589+0000 7f84fb7fe700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f850005a150 0x7f850005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.589+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f850c076110 con 0x7f8514153f50 2023-08-17T00:05:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.589+0000 7f85137fe700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f850005a150 0x7f850005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.589+0000 7f85137fe700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f850005a150 0x7f850005c610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f8504009bc0 tx=0x7f8504008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.593+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f850c04d890 con 0x7f8514153f50 2023-08-17T00:05:54.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.753+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f851406b4c0 con 0x7f8514153f50 2023-08-17T00:05:54.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.765+0000 7f84fb7fe700 1 -- 172.21.15.153:0/3748925453 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f850c04d480 con 0x7f8514153f50 2023-08-17T00:05:54.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f850005a150 msgr2=0x7f850005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f850005a150 0x7f850005c610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f8504009bc0 tx=0x7f8504008040).stop 2023-08-17T00:05:54.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 msgr2=0x7f8514063390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:54.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 0x7f8514063390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f850c00b6c0 tx=0x7f850c009780).stop 2023-08-17T00:05:54.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 shutdown_connections 2023-08-17T00:05:54.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f850005a150 0x7f850005c610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8514153f50 0x7f8514063390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85140c57a0 0x7f851414ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 --2- 172.21.15.153:0/3748925453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85140c11b0 0x7f8514153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 >> 172.21.15.153:0/3748925453 conn(0x7f8514062a70 msgr2=0x7f85140c8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:54.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 shutdown_connections 2023-08-17T00:05:54.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:54.769+0000 7f8518bb9700 1 -- 172.21.15.153:0/3748925453 wait complete. 2023-08-17T00:05:54.792 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:05:54.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:05:54.835 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:05:54.880 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:05:54.881 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:05:54.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:05:55.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.037+0000 7f19bef47700 1 Processor -- start 2023-08-17T00:05:55.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.037+0000 7f19bef47700 1 -- start start 2023-08-17T00:05:55.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bef47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 0x7f19b80c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bef47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b81585a0 con 0x7f19b80aa6e0 2023-08-17T00:05:55.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bef47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b8066400 con 0x7f19b8068820 2023-08-17T00:05:55.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bef47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8062dc0 con 0x7f19b80a8df0 2023-08-17T00:05:55.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19be746700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f19b80aa6e0 0x7f19b80626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40960/0 (socket says 172.21.15.153:40960) 2023-08-17T00:05:55.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19be746700 1 -- 172.21.15.153:0/2622080865 learned_addr learned my addr 172.21.15.153:0/2622080865 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:55.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 0x7f19b80c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73345050 0 0) 0x7f19b81585a0 con 0x7f19b80aa6e0 2023-08-17T00:05:55.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a40033f0 con 0x7f19b80aa6e0 2023-08-17T00:05:55.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311994301 0 0) 0x7f19b8066400 con 0x7f19b8068820 2023-08-17T00:05:55.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b81585a0 con 0x7f19b8068820 2023-08-17T00:05:55.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2425249617 0 0) 0x7f19a40033f0 con 0x7f19b80aa6e0 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 msgr2=0x7f19b80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 0x7f19b80c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 >> v1:172.21.15.178:6789/0 conn(0x7f19b8068820 legacy=0x7f19b8061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80b9d30 con 0x7f19b80aa6e0 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 0x7f19b80c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f19b0001470 con 0x7f19b80aa6e0 2023-08-17T00:05:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 >> v1:172.21.15.153:6789/0 conn(0x7f19b80aa6e0 legacy=0x7f19b80626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a4004b00 0x7f19a4004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4003630 0x7f19a4003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 0x7f19a4003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b8062dc0 con 0x7f19a4004b00 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a400b8e0 con 0x7f19a4003630 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a400ba70 con 0x7f19b80a8df0 2023-08-17T00:05:55.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a4004b00 0x7f19a4004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bd744700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4003630 0x7f19a4003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 -- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 msgr2=0x7f19a4003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19b80a8df0 0x7f19a4003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 -- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4003630 msgr2=0x7f19a4003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4003630 0x7f19a4003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bdf45700 1 -- 172.21.15.153:0/2622080865 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009a20 con 0x7f19a4004b00 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.041+0000 7f19bd744700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a4003630 0x7f19a4003ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:55.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bdf45700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a4004b00 0x7f19a4004f00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f19b400e570 tx=0x7f19b400b040).ready entity=mon.0 client_cookie=7dd4d1e9c6f134f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:55.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4009ca0 con 0x7f19a4004b00 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b400f040 con 0x7f19a4004b00 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bcf43700 1 -- 172.21.15.153:0/2622080865 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4013400 con 0x7f19a4004b00 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 -- 172.21.15.153:0/2622080865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a4004b00 msgr2=0x7f19a4004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 --2- 172.21.15.153:0/2622080865 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a4004b00 0x7f19a4004f00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f19b400e570 tx=0x7f19b400b040).stop 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19be746700 1 -- 172.21.15.153:0/2622080865 reap_dead start 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 -- 172.21.15.153:0/2622080865 shutdown_connections 2023-08-17T00:05:55.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 -- 172.21.15.153:0/2622080865 >> 172.21.15.153:0/2622080865 conn(0x7f19b80c6620 msgr2=0x7f19b80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:55.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 -- 172.21.15.153:0/2622080865 shutdown_connections 2023-08-17T00:05:55.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 -- 172.21.15.153:0/2622080865 wait complete. 2023-08-17T00:05:55.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 Processor -- start 2023-08-17T00:05:55.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.045+0000 7f19bef47700 1 -- start start 2023-08-17T00:05:55.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a4004b00 0x7f19b80bb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 0x7f19b80bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b80c0220 0x7f19b80bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80bc6f0 con 0x7f19b80bcb80 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80bbae0 con 0x7f19b80c0220 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80bbdc0 con 0x7f19a4004b00 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 0x7f19b80bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 0x7f19b80bfd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37072/0 (socket says 172.21.15.153:37072) 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 -- 172.21.15.153:0/3334914239 learned_addr learned my addr 172.21.15.153:0/3334914239 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bdf45700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a4004b00 0x7f19b80bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19be746700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b80c0220 0x7f19b80bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 -- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a4004b00 msgr2=0x7f19b80bb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a4004b00 0x7f19b80bb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 -- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b80c0220 msgr2=0x7f19b80bdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b80c0220 0x7f19b80bdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 -- 172.21.15.153:0/3334914239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80bc0a0 con 0x7f19b80bcb80 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19be746700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b80c0220 0x7f19b80bdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bd744700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 0x7f19b80bfd30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f19a800d5b0 tx=0x7f19a8009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80104e0 con 0x7f19b80bcb80 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a8010640 con 0x7f19b80bcb80 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a80109c0 con 0x7f19b80bcb80 2023-08-17T00:05:55.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b80bc380 con 0x7f19b80bcb80 2023-08-17T00:05:55.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.049+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80bd000 con 0x7f19b80bcb80 2023-08-17T00:05:55.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.053+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b80bc8a0 con 0x7f19b80bcb80 2023-08-17T00:05:55.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.053+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f19a801a030 con 0x7f19b80bcb80 2023-08-17T00:05:55.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.053+0000 7f19adffb700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f199c05a180 0x7f199c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.053+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f19a80736e0 con 0x7f19b80bcb80 2023-08-17T00:05:55.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.053+0000 7f19bdf45700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f199c05a180 0x7f199c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.057+0000 7f19bdf45700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f199c05a180 0x7f199c05c640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f19b400e3b0 tx=0x7f19b401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:55.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.061+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19b80bc8a0 con 0x7f19b80bcb80 2023-08-17T00:05:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.257+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19b80bc8a0 con 0x7f19b80bcb80 2023-08-17T00:05:55.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19adffb700 1 -- 172.21.15.153:0/3334914239 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f19b80bc8a0 con 0x7f19b80bcb80 2023-08-17T00:05:55.264 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:55.264 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":32,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4664,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1153763000","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1153763000},{"type":"v1","addr":"172.21.15.178:6837","nonce":1153763000}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/3629274566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3629274566},{"type":"v1","addr":"172.21.15.178:6835","nonce":3629274566}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4965,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/2179520669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2179520669},{"type":"v1","addr":"172.21.15.153:6833","nonce":2179520669}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5355,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1024191544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":1024191544},{"type":"v1","addr":"172.21.15.153:6835","nonce":1024191544}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[]} 2023-08-17T00:05:55.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f199c05a180 msgr2=0x7f199c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f199c05a180 0x7f199c05c640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f19b400e3b0 tx=0x7f19b401a000).stop 2023-08-17T00:05:55.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 msgr2=0x7f19b80bfd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 0x7f19b80bfd30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f19a800d5b0 tx=0x7f19a8009040).stop 2023-08-17T00:05:55.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 shutdown_connections 2023-08-17T00:05:55.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f199c05a180 0x7f199c05c640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19b80c0220 0x7f19b80bdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19b80bcb80 0x7f19b80bfd30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 --2- 172.21.15.153:0/3334914239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a4004b00 0x7f19b80bb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.261+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 >> 172.21.15.153:0/3334914239 conn(0x7f19b80c6620 msgr2=0x7f19b80aafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:55.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.265+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 shutdown_connections 2023-08-17T00:05:55.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.265+0000 7f19bef47700 1 -- 172.21.15.153:0/3334914239 wait complete. 2023-08-17T00:05:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 32 2023-08-17T00:05:55.289 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:05:55.289 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:05:55.289 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:05:55.289 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:05:55.290 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:05:55.290 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:05:55.290 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:05:55.290 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:05:55.291 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:05:55.291 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:05:55.291 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:05:55.291 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:05:55.292 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:05:55.292 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:05:55.292 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:05:55.292 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:05:55.308 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:05:55.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:05:55.310 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:05:55.310 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:05:55.311 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:05:55.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:05:55.312 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:05:55.313 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:05:55.361 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:05:55.362 DEBUG:teuthology.parallel:result is None 2023-08-17T00:05:55.366 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:05:55.367 DEBUG:teuthology.parallel:result is None 2023-08-17T00:05:55.368 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:05:55.368 DEBUG:teuthology.parallel:result is None 2023-08-17T00:05:55.373 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:05:55.373 DEBUG:teuthology.parallel:result is None 2023-08-17T00:05:55.374 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:05:55.469 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:05:55.470 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:05:55.476 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:05:55.480 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:05:55.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.525+0000 7feec97b9700 1 Processor -- start 2023-08-17T00:05:55.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.525+0000 7feec97b9700 1 -- start start 2023-08-17T00:05:55.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec97b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feec40689c0 0x7feec4068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec97b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feec41560f0 0x7feec40c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec97b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec4065da0 con 0x7feec4151530 2023-08-17T00:05:55.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec97b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec4155c60 con 0x7feec40689c0 2023-08-17T00:05:55.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec97b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec4156550 con 0x7feec41560f0 2023-08-17T00:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feec40689c0 0x7feec4068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec8fb8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feec4151530 0x7feec41519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40984/0 (socket says 172.21.15.153:40984) 2023-08-17T00:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec8fb8700 1 -- 172.21.15.153:0/1855651033 learned_addr learned my addr 172.21.15.153:0/1855651033 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:55.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feebb7fe700 1 --2- 172.21.15.153:0/1855651033 >> v2:172.21.15.178:3300/0 conn(0x7feec41560f0 0x7feec40c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec3fff700 1 -- 172.21.15.153:0/1855651033 >> v2:172.21.15.178:3300/0 conn(0x7feec41560f0 msgr2=0x7feec40c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:55.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec3fff700 1 --2- 172.21.15.153:0/1855651033 >> v2:172.21.15.178:3300/0 conn(0x7feec41560f0 0x7feec40c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec3fff700 1 -- 172.21.15.153:0/1855651033 >> v1:172.21.15.153:6789/0 conn(0x7feec4151530 legacy=0x7feec41519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec3fff700 1 -- 172.21.15.153:0/1855651033 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4065ff0 con 0x7feec40689c0 2023-08-17T00:05:55.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec37fe700 1 -- 172.21.15.153:0/1855651033 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438354242 0 0) 0x7feec4065da0 con 0x7feec4151530 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feebb7fe700 1 --2- 172.21.15.153:0/1855651033 >> v2:172.21.15.178:3300/0 conn(0x7feec41560f0 0x7feec40c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec3fff700 1 --2- 172.21.15.153:0/1855651033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec40689c0 0x7feec4068da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7feec40bff90 tx=0x7feeb4006f40).ready entity=mon.0 client_cookie=ae189e7d6c3ac88c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec37fe700 1 -- 172.21.15.153:0/1855651033 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4005880 con 0x7feec40689c0 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec37fe700 1 -- 172.21.15.153:0/1855651033 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb40059e0 con 0x7feec40689c0 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.529+0000 7feec37fe700 1 -- 172.21.15.153:0/1855651033 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4005d60 con 0x7feec40689c0 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 -- 172.21.15.153:0/1855651033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec40689c0 msgr2=0x7feec4068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 --2- 172.21.15.153:0/1855651033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec40689c0 0x7feec4068da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7feec40bff90 tx=0x7feeb4006f40).stop 2023-08-17T00:05:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 -- 172.21.15.153:0/1855651033 shutdown_connections 2023-08-17T00:05:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 --2- 172.21.15.153:0/1855651033 >> v2:172.21.15.178:3300/0 conn(0x7feec41560f0 0x7feec40c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 --2- 172.21.15.153:0/1855651033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec40689c0 0x7feec4068da0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 -- 172.21.15.153:0/1855651033 >> 172.21.15.153:0/1855651033 conn(0x7feec40c6620 msgr2=0x7feec40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 -- 172.21.15.153:0/1855651033 shutdown_connections 2023-08-17T00:05:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 -- 172.21.15.153:0/1855651033 wait complete. 2023-08-17T00:05:55.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.533+0000 7feec97b9700 1 Processor -- start 2023-08-17T00:05:55.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 -- start start 2023-08-17T00:05:55.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec40689c0 0x7feec4150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 0x7feec4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec41560f0 0x7feec40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4151cc0 con 0x7feec4151530 2023-08-17T00:05:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4151f60 con 0x7feec41560f0 2023-08-17T00:05:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec4152240 con 0x7feec40689c0 2023-08-17T00:05:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 0x7feec4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 0x7feec4154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37114/0 (socket says 172.21.15.153:37114) 2023-08-17T00:05:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 -- 172.21.15.153:0/820927131 learned_addr learned my addr 172.21.15.153:0/820927131 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec3fff700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec40689c0 0x7feec4150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec8fb8700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec41560f0 0x7feec40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 -- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec40689c0 msgr2=0x7feec4150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec40689c0 0x7feec4150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 -- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec41560f0 msgr2=0x7feec40a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec41560f0 0x7feec40a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 -- 172.21.15.153:0/820927131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac009a20 con 0x7feec4151530 2023-08-17T00:05:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feebb7fe700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 0x7feec4154a80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7feeac00c0c0 tx=0x7feeac00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:55.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac00cc00 con 0x7feec4151530 2023-08-17T00:05:55.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeac00f040 con 0x7feec4151530 2023-08-17T00:05:55.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb4009250 con 0x7feec4151530 2023-08-17T00:05:55.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeac013400 con 0x7feec4151530 2023-08-17T00:05:55.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.537+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec4152800 con 0x7feec4151530 2023-08-17T00:05:55.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.541+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec406b4c0 con 0x7feec4151530 2023-08-17T00:05:55.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.541+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7feeac0137b0 con 0x7feec4151530 2023-08-17T00:05:55.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.545+0000 7feec0ff9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea405a150 0x7feea405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.545+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5355+0+0 (secure 0 0 0) 0x7feeac074820 con 0x7feec4151530 2023-08-17T00:05:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.545+0000 7feec3fff700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea405a150 0x7feea405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.545+0000 7feec3fff700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea405a150 0x7feea405c610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7feeb4009fd0 tx=0x7feeb4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.549+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feeac0485d0 con 0x7feec4151530 2023-08-17T00:05:55.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:55.725+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feec40662d0 con 0x7feec4151530 2023-08-17T00:05:56.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec0ff9700 1 -- 172.21.15.153:0/820927131 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7feeac04bbf0 con 0x7feec4151530 2023-08-17T00:05:56.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea405a150 msgr2=0x7feea405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea405a150 0x7feea405c610 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7feeb4009fd0 tx=0x7feeb4015000).stop 2023-08-17T00:05:56.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 msgr2=0x7feec4154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 0x7feec4154a80 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7feeac00c0c0 tx=0x7feeac00b040).stop 2023-08-17T00:05:56.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 shutdown_connections 2023-08-17T00:05:56.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea405a150 0x7feea405c610 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feec41560f0 0x7feec40a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feec4151530 0x7feec4154a80 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 --2- 172.21.15.153:0/820927131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feec40689c0 0x7feec4150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 >> 172.21.15.153:0/820927131 conn(0x7feec40c6620 msgr2=0x7feec40bdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:56.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.513+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 shutdown_connections 2023-08-17T00:05:56.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.517+0000 7feec97b9700 1 -- 172.21.15.153:0/820927131 wait complete. 2023-08-17T00:05:56.521 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:05:56.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:05:56.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.697+0000 7f43b7439700 1 Processor -- start 2023-08-17T00:05:56.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.697+0000 7f43b7439700 1 -- start start 2023-08-17T00:05:56.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43b0068da0 0x7f43b01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f43b0151530 0x7f43b01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b0065da0 con 0x7f43b00689c0 2023-08-17T00:05:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b0069200 con 0x7f43b0068da0 2023-08-17T00:05:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b0155c60 con 0x7f43b0151530 2023-08-17T00:05:56.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b6437700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f43b00689c0 0x7f43b00c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40986/0 (socket says 172.21.15.153:40986) 2023-08-17T00:05:56.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b6437700 1 -- 172.21.15.153:0/2275535269 learned_addr learned my addr 172.21.15.153:0/2275535269 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:56.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5c36700 1 --2- 172.21.15.153:0/2275535269 >> v2:172.21.15.153:3300/0 conn(0x7f43b0068da0 0x7f43b01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:56.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b6c38700 1 --2- 172.21.15.153:0/2275535269 >> v2:172.21.15.178:3300/0 conn(0x7f43b0151530 0x7f43b01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5c36700 1 -- 172.21.15.153:0/2275535269 >> v2:172.21.15.178:3300/0 conn(0x7f43b0151530 msgr2=0x7f43b01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5c36700 1 --2- 172.21.15.153:0/2275535269 >> v2:172.21.15.178:3300/0 conn(0x7f43b0151530 0x7f43b01519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5c36700 1 -- 172.21.15.153:0/2275535269 >> v1:172.21.15.153:6789/0 conn(0x7f43b00689c0 legacy=0x7f43b00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5c36700 1 -- 172.21.15.153:0/2275535269 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b0065ff0 con 0x7f43b0068da0 2023-08-17T00:05:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5435700 1 -- 172.21.15.153:0/2275535269 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782980244 0 0) 0x7f43b0065da0 con 0x7f43b00689c0 2023-08-17T00:05:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5c36700 1 --2- 172.21.15.153:0/2275535269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b01560f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f43b0063b00 tx=0x7f43a0009060).ready entity=mon.0 client_cookie=e6b5eda9c938b1a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:56.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5435700 1 -- 172.21.15.153:0/2275535269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a00090d0 con 0x7f43b0068da0 2023-08-17T00:05:56.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5435700 1 -- 172.21.15.153:0/2275535269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000f510 con 0x7f43b0068da0 2023-08-17T00:05:56.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b5435700 1 -- 172.21.15.153:0/2275535269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a000f890 con 0x7f43b0068da0 2023-08-17T00:05:56.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- 172.21.15.153:0/2275535269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 msgr2=0x7f43b01560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 --2- 172.21.15.153:0/2275535269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b01560f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f43b0063b00 tx=0x7f43a0009060).stop 2023-08-17T00:05:56.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- 172.21.15.153:0/2275535269 shutdown_connections 2023-08-17T00:05:56.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 --2- 172.21.15.153:0/2275535269 >> v2:172.21.15.178:3300/0 conn(0x7f43b0151530 0x7f43b01519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 --2- 172.21.15.153:0/2275535269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b01560f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- 172.21.15.153:0/2275535269 >> 172.21.15.153:0/2275535269 conn(0x7f43b00c6620 msgr2=0x7f43b00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:56.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- 172.21.15.153:0/2275535269 shutdown_connections 2023-08-17T00:05:56.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.701+0000 7f43b7439700 1 -- 172.21.15.153:0/2275535269 wait complete. 2023-08-17T00:05:56.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 Processor -- start 2023-08-17T00:05:56.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 -- start start 2023-08-17T00:05:56.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b00689c0 0x7f43b0164570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:56.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b00ba9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:56.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b0151530 0x7f43b00bf460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:56.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0152a20 con 0x7f43b0068da0 2023-08-17T00:05:56.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0164a60 con 0x7f43b0151530 2023-08-17T00:05:56.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b7439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b0151da0 con 0x7f43b00689c0 2023-08-17T00:05:56.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b00ba9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:56.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b00ba9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37130/0 (socket says 172.21.15.153:37130) 2023-08-17T00:05:56.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 -- 172.21.15.153:0/3789936641 learned_addr learned my addr 172.21.15.153:0/3789936641 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:56.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b6437700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b00689c0 0x7f43b0164570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:56.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b6c38700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b0151530 0x7f43b00bf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:56.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 -- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b00689c0 msgr2=0x7f43b0164570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b00689c0 0x7f43b0164570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 -- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b0151530 msgr2=0x7f43b00bf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b0151530 0x7f43b00bf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 -- 172.21.15.153:0/3789936641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a00092a0 con 0x7f43b0068da0 2023-08-17T00:05:56.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.705+0000 7f43b5c36700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b00ba9a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f43a0009dd0 tx=0x7f43a0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:56.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.709+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a0006950 con 0x7f43b0068da0 2023-08-17T00:05:56.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.709+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a000fc50 con 0x7f43b0068da0 2023-08-17T00:05:56.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.709+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a001b440 con 0x7f43b0068da0 2023-08-17T00:05:56.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.709+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b0152080 con 0x7f43b0068da0 2023-08-17T00:05:56.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.709+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b0152640 con 0x7f43b0068da0 2023-08-17T00:05:56.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.709+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b006b4c0 con 0x7f43b0068da0 2023-08-17T00:05:56.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.713+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f43a000f070 con 0x7f43b0068da0 2023-08-17T00:05:56.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.713+0000 7f43a67fc700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439405a150 0x7f439405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.713+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f43a0075f30 con 0x7f43b0068da0 2023-08-17T00:05:56.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.713+0000 7f43b6437700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439405a150 0x7f439405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:56.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.713+0000 7f43b6437700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439405a150 0x7f439405c610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f43ac002670 tx=0x7f43ac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:56.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.717+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43a009e8f0 con 0x7f43b0068da0 2023-08-17T00:05:56.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.921+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43b0063720 con 0x7f43b0068da0 2023-08-17T00:05:56.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.925+0000 7f43a67fc700 1 -- 172.21.15.153:0/3789936641 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f43a004d6d0 con 0x7f43b0068da0 2023-08-17T00:05:56.928 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:56.928 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.929 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:05:56.930 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:05:56.930 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.930 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:05:56.931 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:05:56.931 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:05:56.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:05:56.931 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.933 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.935 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.936 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:05:56.936 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:05:56.936 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:05:56.937 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.938 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.941 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:05:56.941 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:05:56.941 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.941 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.942 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.942 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:05:56.944 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.945 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:05:56.946 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:05:56.948 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.949 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:05:56.950 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:05:56.950 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:05:56.950 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:05:56.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.951 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:05:56.951 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:05:56.951 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.951 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:05:56.951 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:05:56.952 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:05:56.952 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.952 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.952 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.952 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:56.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:05:56.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.955 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:56.955 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:05:56.955 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:05:56.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439405a150 msgr2=0x7f439405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439405a150 0x7f439405c610 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f43ac002670 tx=0x7f43ac009040).stop 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 msgr2=0x7f43b00ba9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b00ba9a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f43a0009dd0 tx=0x7f43a0017000).stop 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 shutdown_connections 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439405a150 0x7f439405c610 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43b0151530 0x7f43b00bf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43b0068da0 0x7f43b00ba9a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 --2- 172.21.15.153:0/3789936641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43b00689c0 0x7f43b0164570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 >> 172.21.15.153:0/3789936641 conn(0x7f43b00c6620 msgr2=0x7f43b00645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 shutdown_connections 2023-08-17T00:05:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:56.929+0000 7f43b7439700 1 -- 172.21.15.153:0/3789936641 wait complete. 2023-08-17T00:05:56.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:05:57.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.113+0000 7f46e6a8f700 1 Processor -- start 2023-08-17T00:05:57.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.113+0000 7f46e6a8f700 1 -- start start 2023-08-17T00:05:57.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.113+0000 7f46e6a8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46e00689c0 0x7f46e0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.113+0000 7f46e6a8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e0065da0 con 0x7f46e01560f0 2023-08-17T00:05:57.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.113+0000 7f46e6a8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e0155c60 con 0x7f46e0151530 2023-08-17T00:05:57.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.113+0000 7f46e6a8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e0156550 con 0x7f46e00689c0 2023-08-17T00:05:57.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e5a8d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46e00689c0 0x7f46e0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e528c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46e01560f0 0x7f46e00c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40992/0 (socket says 172.21.15.153:40992) 2023-08-17T00:05:57.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e528c700 1 -- 172.21.15.153:0/3177034635 learned_addr learned my addr 172.21.15.153:0/3177034635 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:57.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e5a8d700 1 -- 172.21.15.153:0/3177034635 >> v1:172.21.15.178:6789/0 conn(0x7f46e0151530 legacy=0x7f46e01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e5a8d700 1 -- 172.21.15.153:0/3177034635 >> v1:172.21.15.153:6789/0 conn(0x7f46e01560f0 legacy=0x7f46e00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e4a8b700 1 -- 172.21.15.153:0/3177034635 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118478608 0 0) 0x7f46e0155c60 con 0x7f46e0151530 2023-08-17T00:05:57.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e5a8d700 1 -- 172.21.15.153:0/3177034635 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0065ff0 con 0x7f46e00689c0 2023-08-17T00:05:57.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e5a8d700 1 --2- 172.21.15.153:0/3177034635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0068da0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f46dc006fd0 tx=0x7f46dc006f40).ready entity=mon.0 client_cookie=2acbff09c27a4471 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e4a8b700 1 -- 172.21.15.153:0/3177034635 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc005880 con 0x7f46e00689c0 2023-08-17T00:05:57.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e4a8b700 1 -- 172.21.15.153:0/3177034635 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc0059e0 con 0x7f46e00689c0 2023-08-17T00:05:57.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e4a8b700 1 -- 172.21.15.153:0/3177034635 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc005d60 con 0x7f46e00689c0 2023-08-17T00:05:57.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 -- 172.21.15.153:0/3177034635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 msgr2=0x7f46e0068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/3177034635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0068da0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f46dc006fd0 tx=0x7f46dc006f40).stop 2023-08-17T00:05:57.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 -- 172.21.15.153:0/3177034635 shutdown_connections 2023-08-17T00:05:57.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/3177034635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0068da0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 -- 172.21.15.153:0/3177034635 >> 172.21.15.153:0/3177034635 conn(0x7f46e00c6620 msgr2=0x7f46e00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:57.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 -- 172.21.15.153:0/3177034635 shutdown_connections 2023-08-17T00:05:57.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.117+0000 7f46e6a8f700 1 -- 172.21.15.153:0/3177034635 wait complete. 2023-08-17T00:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 Processor -- start 2023-08-17T00:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 -- start start 2023-08-17T00:05:57.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e0151530 0x7f46e0161c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e01560f0 0x7f46e0154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0154490 con 0x7f46e00689c0 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e01657f0 con 0x7f46e01560f0 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.121+0000 7f46e6a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0153e80 con 0x7f46e0151530 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0165300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37160/0 (socket says 172.21.15.153:37160) 2023-08-17T00:05:57.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 -- 172.21.15.153:0/1582993579 learned_addr learned my addr 172.21.15.153:0/1582993579 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:57.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e528c700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e0151530 0x7f46e0161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e628e700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e01560f0 0x7f46e0154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 -- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e0151530 msgr2=0x7f46e0161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e0151530 0x7f46e0161c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 -- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e01560f0 msgr2=0x7f46e0154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e01560f0 0x7f46e0154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 -- 172.21.15.153:0/1582993579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc009250 con 0x7f46e00689c0 2023-08-17T00:05:57.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e528c700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e0151530 0x7f46e0161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:57.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e5a8d700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0165300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f46e00667d0 tx=0x7f46dc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00f510 con 0x7f46e00689c0 2023-08-17T00:05:57.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00f690 con 0x7f46e00689c0 2023-08-17T00:05:57.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00fa50 con 0x7f46e00689c0 2023-08-17T00:05:57.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e0152600 con 0x7f46e00689c0 2023-08-17T00:05:57.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.125+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e0154120 con 0x7f46e00689c0 2023-08-17T00:05:57.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.129+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e006b4c0 con 0x7f46e00689c0 2023-08-17T00:05:57.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.129+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f46dc00f070 con 0x7f46e00689c0 2023-08-17T00:05:57.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.129+0000 7f46d5ffb700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46c405a150 0x7f46c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.129+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f46dc0757e0 con 0x7f46e00689c0 2023-08-17T00:05:57.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.129+0000 7f46e528c700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46c405a150 0x7f46c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.129+0000 7f46e528c700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46c405a150 0x7f46c405c610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f46e00c2c60 tx=0x7f46d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.133+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46dc0495e0 con 0x7f46e00689c0 2023-08-17T00:05:57.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.293+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46e00662d0 con 0x7f46e00689c0 2023-08-17T00:05:57.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.297+0000 7f46d5ffb700 1 -- 172.21.15.153:0/1582993579 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13760 (secure 0 0 0) 0x7f46dc04cc00 con 0x7f46e00689c0 2023-08-17T00:05:57.301 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:57.301 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":46,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:05:56.505729+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:05:57.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46c405a150 msgr2=0x7f46c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46c405a150 0x7f46c405c610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f46e00c2c60 tx=0x7f46d0009040).stop 2023-08-17T00:05:57.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 msgr2=0x7f46e0165300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0165300 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f46e00667d0 tx=0x7f46dc015000).stop 2023-08-17T00:05:57.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 shutdown_connections 2023-08-17T00:05:57.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46c405a150 0x7f46c405c610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46e01560f0 0x7f46e0154920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46e0151530 0x7f46e0161c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 --2- 172.21.15.153:0/1582993579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46e00689c0 0x7f46e0165300 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 >> 172.21.15.153:0/1582993579 conn(0x7f46e00c6620 msgr2=0x7f46e0062830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:57.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 shutdown_connections 2023-08-17T00:05:57.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.301+0000 7f46e6a8f700 1 -- 172.21.15.153:0/1582993579 wait complete. 2023-08-17T00:05:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:05:57.328 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:05:57.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.493+0000 7f8d8b3db700 1 Processor -- start 2023-08-17T00:05:57.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.493+0000 7f8d8b3db700 1 -- start start 2023-08-17T00:05:57.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8d84153ab0 0x7f8d84153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d840c7490 0x7f8d840c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840aa750 con 0x7f8d840c7490 2023-08-17T00:05:57.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840c9dd0 con 0x7f8d84153ab0 2023-08-17T00:05:57.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840aacf0 con 0x7f8d840c8d50 2023-08-17T00:05:57.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d840c7490 0x7f8d840c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d840c7490 0x7f8d840c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37170/0 (socket says 172.21.15.153:37170) 2023-08-17T00:05:57.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 -- 172.21.15.153:0/409876036 learned_addr learned my addr 172.21.15.153:0/409876036 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:57.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d88976700 1 --2- 172.21.15.153:0/409876036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89177700 1 --2- 172.21.15.153:0/409876036 >> v2:172.21.15.178:3300/0 conn(0x7f8d84153ab0 0x7f8d84153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 -- 172.21.15.153:0/409876036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 msgr2=0x7f8d840c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 --2- 172.21.15.153:0/409876036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 -- 172.21.15.153:0/409876036 >> v2:172.21.15.178:3300/0 conn(0x7f8d84153ab0 msgr2=0x7f8d84153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 --2- 172.21.15.153:0/409876036 >> v2:172.21.15.178:3300/0 conn(0x7f8d84153ab0 0x7f8d84153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 -- 172.21.15.153:0/409876036 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840c7e10 con 0x7f8d840c7490 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89177700 1 --2- 172.21.15.153:0/409876036 >> v2:172.21.15.178:3300/0 conn(0x7f8d84153ab0 0x7f8d84153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:57.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d89978700 1 --2- 172.21.15.153:0/409876036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d840c7920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f8d840cba90 tx=0x7f8d7c009840).ready entity=mon.0 client_cookie=53919cdf2b5ed1c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d7bfff700 1 -- 172.21.15.153:0/409876036 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00e070 con 0x7f8d840c7490 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d7bfff700 1 -- 172.21.15.153:0/409876036 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7c00ba50 con 0x7f8d840c7490 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d7bfff700 1 -- 172.21.15.153:0/409876036 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00bdd0 con 0x7f8d840c7490 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 -- 172.21.15.153:0/409876036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 msgr2=0x7f8d840c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.497+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/409876036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d840c7920 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f8d840cba90 tx=0x7f8d7c009840).stop 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 -- 172.21.15.153:0/409876036 shutdown_connections 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/409876036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/409876036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d840c7920 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/409876036 >> v2:172.21.15.178:3300/0 conn(0x7f8d84153ab0 0x7f8d84153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 -- 172.21.15.153:0/409876036 >> 172.21.15.153:0/409876036 conn(0x7f8d84061fa0 msgr2=0x7f8d840623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:57.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 -- 172.21.15.153:0/409876036 shutdown_connections 2023-08-17T00:05:57.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 -- 172.21.15.153:0/409876036 wait complete. 2023-08-17T00:05:57.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 Processor -- start 2023-08-17T00:05:57.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.501+0000 7f8d8b3db700 1 -- start start 2023-08-17T00:05:57.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d84163650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84153ab0 0x7f8d8414ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414e8b0 con 0x7f8d840c7490 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414dca0 con 0x7f8d84153ab0 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8414df80 con 0x7f8d840c8d50 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d84163650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d84163650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37186/0 (socket says 172.21.15.153:37186) 2023-08-17T00:05:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 -- 172.21.15.153:0/3668269525 learned_addr learned my addr 172.21.15.153:0/3668269525 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d88976700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89978700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84153ab0 0x7f8d8414ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 -- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 msgr2=0x7f8d840c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 -- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84153ab0 msgr2=0x7f8d8414ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84153ab0 0x7f8d8414ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 -- 172.21.15.153:0/3668269525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c009ae0 con 0x7f8d840c7490 2023-08-17T00:05:57.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89978700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84153ab0 0x7f8d8414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:57.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d89177700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d84163650 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f8d8000c880 tx=0x7f8d80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80010580 con 0x7f8d840c7490 2023-08-17T00:05:57.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d800106e0 con 0x7f8d840c7490 2023-08-17T00:05:57.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8414e260 con 0x7f8d840c7490 2023-08-17T00:05:57.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d80010a60 con 0x7f8d840c7490 2023-08-17T00:05:57.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.505+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d84163b40 con 0x7f8d840c7490 2023-08-17T00:05:57.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.509+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8406b530 con 0x7f8d840c7490 2023-08-17T00:05:57.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.509+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8d8001b460 con 0x7f8d840c7490 2023-08-17T00:05:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.509+0000 7f8d797fa700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d6805a180 0x7f8d6805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.509+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8d80073d70 con 0x7f8d840c7490 2023-08-17T00:05:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.513+0000 7f8d88976700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d6805a180 0x7f8d6805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.513+0000 7f8d88976700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d6805a180 0x7f8d6805c640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8d84063d50 tx=0x7f8d74008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.517+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d80047b10 con 0x7f8d840c7490 2023-08-17T00:05:57.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.681+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8d84063010 con 0x7f8d840c7490 2023-08-17T00:05:57.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.681+0000 7f8d797fa700 1 -- 172.21.15.153:0/3668269525 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v46) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8d8004b130 con 0x7f8d840c7490 2023-08-17T00:05:57.685 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:05:57.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d6805a180 msgr2=0x7f8d6805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d6805a180 0x7f8d6805c640 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f8d84063d50 tx=0x7f8d74008040).stop 2023-08-17T00:05:57.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 msgr2=0x7f8d84163650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d84163650 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f8d8000c880 tx=0x7f8d80008040).stop 2023-08-17T00:05:57.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 shutdown_connections 2023-08-17T00:05:57.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d6805a180 0x7f8d6805c640 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84153ab0 0x7f8d8414ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d840c8d50 0x7f8d840c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 --2- 172.21.15.153:0/3668269525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d840c7490 0x7f8d84163650 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 >> 172.21.15.153:0/3668269525 conn(0x7f8d84061fa0 msgr2=0x7f8d84152990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:57.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 shutdown_connections 2023-08-17T00:05:57.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.685+0000 7f8d8b3db700 1 -- 172.21.15.153:0/3668269525 wait complete. 2023-08-17T00:05:57.706 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:05:57.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.865+0000 7f873f59e700 1 Processor -- start 2023-08-17T00:05:57.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.865+0000 7f873f59e700 1 -- start start 2023-08-17T00:05:57.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8740150880 0x7f87400a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f87400a8e60 0x7f8740068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400aa8c0 0x7f8740068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8740069200 con 0x7f87400a8e60 2023-08-17T00:05:57.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87400ab9b0 con 0x7f8740150880 2023-08-17T00:05:57.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400aada0 con 0x7f87400aa8c0 2023-08-17T00:05:57.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f87400a8e60 0x7f8740068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f87400a8e60 0x7f8740068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37196/0 (socket says 172.21.15.153:37196) 2023-08-17T00:05:57.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 -- 172.21.15.153:0/2936983655 learned_addr learned my addr 172.21.15.153:0/2936983655 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:57.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873ed9d700 1 --2- 172.21.15.153:0/2936983655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400aa8c0 0x7f8740068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873e59c700 1 --2- 172.21.15.153:0/2936983655 >> v2:172.21.15.178:3300/0 conn(0x7f8740150880 0x7f87400a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 -- 172.21.15.153:0/2936983655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400aa8c0 msgr2=0x7f8740068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 --2- 172.21.15.153:0/2936983655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400aa8c0 0x7f8740068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 -- 172.21.15.153:0/2936983655 >> v2:172.21.15.178:3300/0 conn(0x7f8740150880 msgr2=0x7f87400a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 --2- 172.21.15.153:0/2936983655 >> v2:172.21.15.178:3300/0 conn(0x7f8740150880 0x7f87400a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 -- 172.21.15.153:0/2936983655 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87400ab080 con 0x7f87400a8e60 2023-08-17T00:05:57.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873e59c700 1 --2- 172.21.15.153:0/2936983655 >> v2:172.21.15.178:3300/0 conn(0x7f8740150880 0x7f87400a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:57.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f8737fff700 1 --2- 172.21.15.153:0/2936983655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400a8e60 0x7f8740068820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f8740066830 tx=0x7f872800b3b0).ready entity=mon.0 client_cookie=bbec6091c7c16e28 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873dd9b700 1 -- 172.21.15.153:0/2936983655 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872800db10 con 0x7f87400a8e60 2023-08-17T00:05:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873dd9b700 1 -- 172.21.15.153:0/2936983655 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872800dc70 con 0x7f87400a8e60 2023-08-17T00:05:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873dd9b700 1 -- 172.21.15.153:0/2936983655 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728010470 con 0x7f87400a8e60 2023-08-17T00:05:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- 172.21.15.153:0/2936983655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400a8e60 msgr2=0x7f8740068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- 172.21.15.153:0/2936983655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400a8e60 0x7f8740068820 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f8740066830 tx=0x7f872800b3b0).stop 2023-08-17T00:05:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- 172.21.15.153:0/2936983655 shutdown_connections 2023-08-17T00:05:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- 172.21.15.153:0/2936983655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87400aa8c0 0x7f8740068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- 172.21.15.153:0/2936983655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400a8e60 0x7f8740068820 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 --2- 172.21.15.153:0/2936983655 >> v2:172.21.15.178:3300/0 conn(0x7f8740150880 0x7f87400a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- 172.21.15.153:0/2936983655 >> 172.21.15.153:0/2936983655 conn(0x7f87400c6620 msgr2=0x7f87400c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:57.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- 172.21.15.153:0/2936983655 shutdown_connections 2023-08-17T00:05:57.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.869+0000 7f873f59e700 1 -- 172.21.15.153:0/2936983655 wait complete. 2023-08-17T00:05:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.873+0000 7f873f59e700 1 Processor -- start 2023-08-17T00:05:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.873+0000 7f873f59e700 1 -- start start 2023-08-17T00:05:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87400a8e60 0x7f87400bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 0x7f8740152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8740150880 0x7f8740146210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740150c60 con 0x7f87400aa8c0 2023-08-17T00:05:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87400be550 con 0x7f87400a8e60 2023-08-17T00:05:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87400be830 con 0x7f8740150880 2023-08-17T00:05:57.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 0x7f8740152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 0x7f8740152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37202/0 (socket says 172.21.15.153:37202) 2023-08-17T00:05:57.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 -- 172.21.15.153:0/1301724630 learned_addr learned my addr 172.21.15.153:0/1301724630 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:57.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873e59c700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87400a8e60 0x7f87400bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f873ed9d700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8740150880 0x7f8740146210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 -- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8740150880 msgr2=0x7f8740146210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8740150880 0x7f8740146210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 -- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87400a8e60 msgr2=0x7f87400bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87400a8e60 0x7f87400bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 -- 172.21.15.153:0/1301724630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872800b610 con 0x7f87400aa8c0 2023-08-17T00:05:57.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f8737fff700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 0x7f8740152f20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f87400669d0 tx=0x7f872800b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.877+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728006910 con 0x7f87400aa8c0 2023-08-17T00:05:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.881+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728000c90 con 0x7f87400aa8c0 2023-08-17T00:05:57.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.881+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280198b0 con 0x7f87400aa8c0 2023-08-17T00:05:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.881+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8740150eb0 con 0x7f87400aa8c0 2023-08-17T00:05:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.881+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8740153410 con 0x7f87400aa8c0 2023-08-17T00:05:57.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.881+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8740151330 con 0x7f87400aa8c0 2023-08-17T00:05:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.881+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f872802a070 con 0x7f87400aa8c0 2023-08-17T00:05:57.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.885+0000 7f87367fc700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f872005a150 0x7f872005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.885+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8728075470 con 0x7f87400aa8c0 2023-08-17T00:05:57.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.885+0000 7f873e59c700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f872005a150 0x7f872005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:57.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.885+0000 7f873e59c700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f872005a150 0x7f872005c610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f87400c5c50 tx=0x7f8730008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:57.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:57.889+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8728049160 con 0x7f87400aa8c0 2023-08-17T00:05:58.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.049+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f87400ab360 con 0x7f87400aa8c0 2023-08-17T00:05:58.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f87367fc700 1 -- 172.21.15.153:0/1301724630 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v46) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8728028070 con 0x7f87400aa8c0 2023-08-17T00:05:58.057 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:05:58.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f872005a150 msgr2=0x7f872005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f872005a150 0x7f872005c610 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f87400c5c50 tx=0x7f8730008040).stop 2023-08-17T00:05:58.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 msgr2=0x7f8740152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 0x7f8740152f20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f87400669d0 tx=0x7f872800b3b0).stop 2023-08-17T00:05:58.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 shutdown_connections 2023-08-17T00:05:58.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f872005a150 0x7f872005c610 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8740150880 0x7f8740146210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87400aa8c0 0x7f8740152f20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 --2- 172.21.15.153:0/1301724630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87400a8e60 0x7f87400bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 >> 172.21.15.153:0/1301724630 conn(0x7f87400c6620 msgr2=0x7f8740146bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:58.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 shutdown_connections 2023-08-17T00:05:58.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.053+0000 7f873f59e700 1 -- 172.21.15.153:0/1301724630 wait complete. 2023-08-17T00:05:58.081 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:05:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.225+0000 7f59cd947700 1 Processor -- start 2023-08-17T00:05:58.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.225+0000 7f59cd947700 1 -- start start 2023-08-17T00:05:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cd947700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c80689c0 0x7f59c8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cd947700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59c8151530 0x7f59c81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cd947700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c8065da0 con 0x7f59c81560f0 2023-08-17T00:05:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cd947700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c8155c60 con 0x7f59c8151530 2023-08-17T00:05:58.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cd947700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8156550 con 0x7f59c80689c0 2023-08-17T00:05:58.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c7fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f59c81560f0 0x7f59c80c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:52828/0 (socket says 172.21.15.153:52828) 2023-08-17T00:05:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cc945700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c80689c0 0x7f59c8068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c7fff700 1 -- 172.21.15.153:0/2453039800 learned_addr learned my addr 172.21.15.153:0/2453039800 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cd146700 1 --2- 172.21.15.153:0/2453039800 >> v2:172.21.15.178:3300/0 conn(0x7f59c8151530 0x7f59c81519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c77fe700 1 -- 172.21.15.153:0/2453039800 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341196583 0 0) 0x7f59c8065da0 con 0x7f59c81560f0 2023-08-17T00:05:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c77fe700 1 -- 172.21.15.153:0/2453039800 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59b80033f0 con 0x7f59c81560f0 2023-08-17T00:05:58.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cc945700 1 -- 172.21.15.153:0/2453039800 >> v2:172.21.15.178:3300/0 conn(0x7f59c8151530 msgr2=0x7f59c81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:58.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cc945700 1 --2- 172.21.15.153:0/2453039800 >> v2:172.21.15.178:3300/0 conn(0x7f59c8151530 0x7f59c81519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cc945700 1 -- 172.21.15.153:0/2453039800 >> v1:172.21.15.178:6789/0 conn(0x7f59c81560f0 legacy=0x7f59c80c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cc945700 1 -- 172.21.15.153:0/2453039800 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c8065ff0 con 0x7f59c80689c0 2023-08-17T00:05:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59cc945700 1 --2- 172.21.15.153:0/2453039800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c80689c0 0x7f59c8068da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f59bc009760 tx=0x7f59bc006f40).ready entity=mon.2 client_cookie=aebf327fda1ed970 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c77fe700 1 -- 172.21.15.153:0/2453039800 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc005880 con 0x7f59c80689c0 2023-08-17T00:05:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c77fe700 1 -- 172.21.15.153:0/2453039800 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59bc0059e0 con 0x7f59c80689c0 2023-08-17T00:05:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.229+0000 7f59c77fe700 1 -- 172.21.15.153:0/2453039800 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59bc005d60 con 0x7f59c80689c0 2023-08-17T00:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 -- 172.21.15.153:0/2453039800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c80689c0 msgr2=0x7f59c8068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 --2- 172.21.15.153:0/2453039800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c80689c0 0x7f59c8068da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f59bc009760 tx=0x7f59bc006f40).stop 2023-08-17T00:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 -- 172.21.15.153:0/2453039800 shutdown_connections 2023-08-17T00:05:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 --2- 172.21.15.153:0/2453039800 >> v2:172.21.15.178:3300/0 conn(0x7f59c8151530 0x7f59c81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 --2- 172.21.15.153:0/2453039800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c80689c0 0x7f59c8068da0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 -- 172.21.15.153:0/2453039800 >> 172.21.15.153:0/2453039800 conn(0x7f59c80c6620 msgr2=0x7f59c80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 -- 172.21.15.153:0/2453039800 shutdown_connections 2023-08-17T00:05:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 -- 172.21.15.153:0/2453039800 wait complete. 2023-08-17T00:05:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.233+0000 7f59cd947700 1 Processor -- start 2023-08-17T00:05:58.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 -- start start 2023-08-17T00:05:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 0x7f59c80a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c8151530 0x7f59c80bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c81560f0 0x7f59c80bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80bcac0 con 0x7f59c80689c0 2023-08-17T00:05:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8166830 con 0x7f59c8151530 2023-08-17T00:05:58.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8151a60 con 0x7f59c81560f0 2023-08-17T00:05:58.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cc945700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 0x7f59c80a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cc945700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 0x7f59c80a0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37210/0 (socket says 172.21.15.153:37210) 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cc945700 1 -- 172.21.15.153:0/3097886102 learned_addr learned my addr 172.21.15.153:0/3097886102 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c81560f0 0x7f59c80bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59c7fff700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c8151530 0x7f59c80bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 -- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c8151530 msgr2=0x7f59c80bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c8151530 0x7f59c80bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 -- 172.21.15.153:0/3097886102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 msgr2=0x7f59c80a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 0x7f59c80a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 -- 172.21.15.153:0/3097886102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc009250 con 0x7f59c81560f0 2023-08-17T00:05:58.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cc945700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 0x7f59c80a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:58.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd146700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c81560f0 0x7f59c80bc5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f59c000ecc0 tx=0x7f59c000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:58.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000c8c0 con 0x7f59c81560f0 2023-08-17T00:05:58.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000f040 con 0x7f59c81560f0 2023-08-17T00:05:58.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.237+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c8151d40 con 0x7f59c81560f0 2023-08-17T00:05:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.241+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000cc30 con 0x7f59c81560f0 2023-08-17T00:05:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.241+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c8152300 con 0x7f59c81560f0 2023-08-17T00:05:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.241+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8152520 con 0x7f59c81560f0 2023-08-17T00:05:58.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.241+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f59c001d460 con 0x7f59c81560f0 2023-08-17T00:05:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.245+0000 7f59c4ff9700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59ac05a150 0x7f59ac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.245+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f59c0074650 con 0x7f59c81560f0 2023-08-17T00:05:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.245+0000 7f59cc945700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59ac05a150 0x7f59ac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.245+0000 7f59cc945700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59ac05a150 0x7f59ac05c610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f59bc00d260 tx=0x7f59bc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:58.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.253+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f59c00482e0 con 0x7f59c81560f0 2023-08-17T00:05:58.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.417+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f59c80662d0 con 0x7f59c81560f0 2023-08-17T00:05:58.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.417+0000 7f59c4ff9700 1 -- 172.21.15.153:0/3097886102 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+143 (secure 0 0 0) 0x7f59c004b900 con 0x7f59c81560f0 2023-08-17T00:05:58.421 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:05:58.421 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:05:58.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:58.422 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:05:58.422 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:05:58.422 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:05:58.422 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:05:58.423 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:05:58.423 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:05:58.423 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:05:58.423 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:05:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59ac05a150 msgr2=0x7f59ac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59ac05a150 0x7f59ac05c610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f59bc00d260 tx=0x7f59bc015000).stop 2023-08-17T00:05:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c81560f0 msgr2=0x7f59c80bc5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c81560f0 0x7f59c80bc5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f59c000ecc0 tx=0x7f59c000b040).stop 2023-08-17T00:05:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 shutdown_connections 2023-08-17T00:05:58.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59ac05a150 0x7f59ac05c610 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59c81560f0 0x7f59c80bc5d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59c8151530 0x7f59c80bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 --2- 172.21.15.153:0/3097886102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59c80689c0 0x7f59c80a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 >> 172.21.15.153:0/3097886102 conn(0x7f59c80c6620 msgr2=0x7f59c80c4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 shutdown_connections 2023-08-17T00:05:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.421+0000 7f59cd947700 1 -- 172.21.15.153:0/3097886102 wait complete. 2023-08-17T00:05:58.445 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:05:58.446 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:05:58.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.605+0000 7f3ddcbdb700 1 Processor -- start 2023-08-17T00:05:58.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.605+0000 7f3ddcbdb700 1 -- start start 2023-08-17T00:05:58.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3ddcbdb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3dd80674b0 0x7f3dd8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3ddcbdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8063980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3ddcbdb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd8155380 con 0x7f3dd814e2b0 2023-08-17T00:05:58.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3ddcbdb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd80c1d10 con 0x7f3dd80674b0 2023-08-17T00:05:58.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3ddcbdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd8063e70 con 0x7f3dd814e690 2023-08-17T00:05:58.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3dcffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3dd80674b0 0x7f3dd8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3dd6d9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3dd659c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f3dd814e2b0 0x7f3dd8066da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:52832/0 (socket says 172.21.15.153:52832) 2023-08-17T00:05:58.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3dd659c700 1 -- 172.21.15.153:0/3323357494 learned_addr learned my addr 172.21.15.153:0/3323357494 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:58.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3dd5d9b700 1 -- 172.21.15.153:0/3323357494 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915159826 0 0) 0x7f3dc8001110 con 0x7f3dd814e2b0 2023-08-17T00:05:58.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.609+0000 7f3dd5d9b700 1 -- 172.21.15.153:0/3323357494 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc40033f0 con 0x7f3dd814e2b0 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd6d9d700 1 -- 172.21.15.153:0/3323357494 >> v2:172.21.15.178:3300/0 conn(0x7f3dd80674b0 msgr2=0x7f3dd8154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd6d9d700 1 --2- 172.21.15.153:0/3323357494 >> v2:172.21.15.178:3300/0 conn(0x7f3dd80674b0 0x7f3dd8154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd6d9d700 1 -- 172.21.15.153:0/3323357494 >> v1:172.21.15.178:6789/0 conn(0x7f3dd814e2b0 legacy=0x7f3dd8066da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd6d9d700 1 -- 172.21.15.153:0/3323357494 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd80640c0 con 0x7f3dd814e690 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dcffff700 1 --2- 172.21.15.153:0/3323357494 >> v2:172.21.15.178:3300/0 conn(0x7f3dd80674b0 0x7f3dd8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd6d9d700 1 --2- 172.21.15.153:0/3323357494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8063980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3dd0009e60 tx=0x7f3dd0009780).ready entity=mon.2 client_cookie=9845d2873eec9968 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:58.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd5d9b700 1 -- 172.21.15.153:0/3323357494 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000e070 con 0x7f3dd814e690 2023-08-17T00:05:58.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd5d9b700 1 -- 172.21.15.153:0/3323357494 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd000bab0 con 0x7f3dd814e690 2023-08-17T00:05:58.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3dd5d9b700 1 -- 172.21.15.153:0/3323357494 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd000be30 con 0x7f3dd814e690 2023-08-17T00:05:58.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/3323357494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 msgr2=0x7f3dd8063980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/3323357494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8063980 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f3dd0009e60 tx=0x7f3dd0009780).stop 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/3323357494 shutdown_connections 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/3323357494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8063980 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/3323357494 >> v2:172.21.15.178:3300/0 conn(0x7f3dd80674b0 0x7f3dd8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/3323357494 >> 172.21.15.153:0/3323357494 conn(0x7f3dd80c41b0 msgr2=0x7f3dd80c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/3323357494 shutdown_connections 2023-08-17T00:05:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.613+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/3323357494 wait complete. 2023-08-17T00:05:58.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 Processor -- start 2023-08-17T00:05:58.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 -- start start 2023-08-17T00:05:58.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80674b0 0x7f3dd80c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 0x7f3dd80bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80c1740 con 0x7f3dd814e2b0 2023-08-17T00:05:58.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80c1460 con 0x7f3dd80674b0 2023-08-17T00:05:58.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3ddcbdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd80be8e0 con 0x7f3dd814e690 2023-08-17T00:05:58.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3dcffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 0x7f3dd80bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3dcffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 0x7f3dd80bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37216/0 (socket says 172.21.15.153:37216) 2023-08-17T00:05:58.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3dcffff700 1 -- 172.21.15.153:0/4248378991 learned_addr learned my addr 172.21.15.153:0/4248378991 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:58.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3dd6d9d700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.617+0000 7f3dd659c700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80674b0 0x7f3dd80c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dcffff700 1 -- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 msgr2=0x7f3dd8139240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dcffff700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8139240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dcffff700 1 -- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80674b0 msgr2=0x7f3dd80c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:58.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dcffff700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80674b0 0x7f3dd80c0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:58.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dcffff700 1 -- 172.21.15.153:0/4248378991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00092a0 con 0x7f3dd814e2b0 2023-08-17T00:05:58.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dd659c700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80674b0 0x7f3dd80c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:58.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dcffff700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 0x7f3dd80bf3c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f3dc000e980 tx=0x7f3dc0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:58.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000ee70 con 0x7f3dd814e2b0 2023-08-17T00:05:58.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc000c7f0 con 0x7f3dd814e2b0 2023-08-17T00:05:58.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc000cb70 con 0x7f3dd814e2b0 2023-08-17T00:05:58.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd0009a20 con 0x7f3dd814e2b0 2023-08-17T00:05:58.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd80beea0 con 0x7f3dd814e2b0 2023-08-17T00:05:58.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd806b530 con 0x7f3dd814e2b0 2023-08-17T00:05:58.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.621+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3dc0022070 con 0x7f3dd814e2b0 2023-08-17T00:05:58.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.625+0000 7f3dce7fc700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3db805a150 0x7f3db805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:58.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.625+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3dc0074120 con 0x7f3dd814e2b0 2023-08-17T00:05:58.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.625+0000 7f3dd659c700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3db805a150 0x7f3db805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:58.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.625+0000 7f3dd659c700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3db805a150 0x7f3db805c610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f3dc8007fd0 tx=0x7f3dc8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:58.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.629+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3dc0047f20 con 0x7f3dd814e2b0 2023-08-17T00:05:58.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:58.785+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3dd80643a0 con 0x7f3dd814e2b0 2023-08-17T00:05:59.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.417+0000 7f3dce7fc700 1 -- 172.21.15.153:0/4248378991 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3dc004b540 con 0x7f3dd814e2b0 2023-08-17T00:05:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3db805a150 msgr2=0x7f3db805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3db805a150 0x7f3db805c610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f3dc8007fd0 tx=0x7f3dc8009040).stop 2023-08-17T00:05:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 msgr2=0x7f3dd80bf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 0x7f3dd80bf3c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f3dc000e980 tx=0x7f3dc0009060).stop 2023-08-17T00:05:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 shutdown_connections 2023-08-17T00:05:59.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3db805a150 0x7f3db805c610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3dd814e690 0x7f3dd8139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3dd814e2b0 0x7f3dd80bf3c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 --2- 172.21.15.153:0/4248378991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3dd80674b0 0x7f3dd80c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.429+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 >> 172.21.15.153:0/4248378991 conn(0x7f3dd80c41b0 msgr2=0x7f3dd813a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:59.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.433+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 shutdown_connections 2023-08-17T00:05:59.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.433+0000 7f3ddcbdb700 1 -- 172.21.15.153:0/4248378991 wait complete. 2023-08-17T00:05:59.437 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:05:59.454 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:05:59.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.625+0000 7f0ccf28f700 1 Processor -- start 2023-08-17T00:05:59.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.625+0000 7f0ccf28f700 1 -- start start 2023-08-17T00:05:59.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccf28f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0cc80acf30 0x7f0cc80c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccf28f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc8154e90 con 0x7f0cc80c5ea0 2023-08-17T00:05:59.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccf28f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc8153fc0 con 0x7f0cc8063bc0 2023-08-17T00:05:59.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccf28f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc8154280 con 0x7f0cc80acf30 2023-08-17T00:05:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccda8c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0cc80c5ea0 0x7f0cc80634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40998/0 (socket says 172.21.15.153:40998) 2023-08-17T00:05:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccda8c700 1 -- 172.21.15.153:0/314432706 learned_addr learned my addr 172.21.15.153:0/314432706 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:05:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924703093 0 0) 0x7f0cc8154e90 con 0x7f0cc80c5ea0 2023-08-17T00:05:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0cce28d700 1 --2- 172.21.15.153:0/314432706 >> v2:172.21.15.178:3300/0 conn(0x7f0cc80acf30 0x7f0cc80c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb40033f0 con 0x7f0cc80c5ea0 2023-08-17T00:05:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2346738876 0 0) 0x7f0cb40033f0 con 0x7f0cc80c5ea0 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 >> v2:172.21.15.178:3300/0 conn(0x7f0cc80acf30 msgr2=0x7f0cc80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 --2- 172.21.15.153:0/314432706 >> v2:172.21.15.178:3300/0 conn(0x7f0cc80acf30 0x7f0cc80c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 >> v1:172.21.15.178:6789/0 conn(0x7f0cc8063bc0 legacy=0x7f0cc80bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc8154560 con 0x7f0cc80c5ea0 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f0cb8001470 con 0x7f0cc80c5ea0 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 >> v1:172.21.15.153:6789/0 conn(0x7f0cc80c5ea0 legacy=0x7f0cc80634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cb4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb4004690 0x7f0cb4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb4005050 0x7f0cb400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8154280 con 0x7f0cb40038e0 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb400bfc0 con 0x7f0cb4005050 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb400c180 con 0x7f0cb4004690 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0cce28d700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cb4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.629+0000 7f0ccea8e700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb4005050 0x7f0cb400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0cce28d700 1 -- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb4004690 msgr2=0x7f0cb4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0cce28d700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cb4004690 0x7f0cb4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0cce28d700 1 -- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb4005050 msgr2=0x7f0cb400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0cce28d700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb4005050 0x7f0cb400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0cce28d700 1 -- 172.21.15.153:0/314432706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb40033f0 con 0x7f0cb40038e0 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccea8e700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cb4005050 0x7f0cb400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:05:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccea8e700 1 -- 172.21.15.153:0/314432706 reap_dead start 2023-08-17T00:05:59.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0cce28d700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cb4003ce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f0cc400b9d0 tx=0x7f0cc4008040).ready entity=mon.0 client_cookie=f95488865452298 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400b340 con 0x7f0cb40038e0 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc4013480 con 0x7f0cb40038e0 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccd28b700 1 -- 172.21.15.153:0/314432706 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4013800 con 0x7f0cb40038e0 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 -- 172.21.15.153:0/314432706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 msgr2=0x7f0cb4003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cb4003ce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f0cc400b9d0 tx=0x7f0cc4008040).stop 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 -- 172.21.15.153:0/314432706 shutdown_connections 2023-08-17T00:05:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/314432706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cb4003ce0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 -- 172.21.15.153:0/314432706 >> 172.21.15.153:0/314432706 conn(0x7f0cc80cb330 msgr2=0x7f0cc80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:05:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 -- 172.21.15.153:0/314432706 shutdown_connections 2023-08-17T00:05:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.633+0000 7f0ccf28f700 1 -- 172.21.15.153:0/314432706 wait complete. 2023-08-17T00:05:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.637+0000 7f0ccf28f700 1 Processor -- start 2023-08-17T00:05:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.637+0000 7f0ccf28f700 1 -- start start 2023-08-17T00:05:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.637+0000 7f0ccf28f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cc80afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.637+0000 7f0ccf28f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc8150660 0x7f0cc80c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccf28f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc80c9230 0x7f0cc80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccf28f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80c8da0 con 0x7f0cb40038e0 2023-08-17T00:05:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccf28f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80c8470 con 0x7f0cc80c9230 2023-08-17T00:05:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccf28f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80c8750 con 0x7f0cc8150660 2023-08-17T00:05:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cc80afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cc80afd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37242/0 (socket says 172.21.15.153:37242) 2023-08-17T00:05:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 -- 172.21.15.153:0/698658597 learned_addr learned my addr 172.21.15.153:0/698658597 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:05:59.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccda8c700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc8150660 0x7f0cc80c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccea8e700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc80c9230 0x7f0cc80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 -- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc8150660 msgr2=0x7f0cc80c2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:59.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc8150660 0x7f0cc80c2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 -- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc80c9230 msgr2=0x7f0cc80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:05:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc80c9230 0x7f0cc80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:05:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 -- 172.21.15.153:0/698658597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80c8a30 con 0x7f0cb40038e0 2023-08-17T00:05:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccda8c700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc8150660 0x7f0cc80c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccea8e700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc80c9230 0x7f0cc80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:05:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cce28d700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cc80afd10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0cb400bf90 tx=0x7f0cc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:59.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4012840 con 0x7f0cb40038e0 2023-08-17T00:05:59.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc40129c0 con 0x7f0cb40038e0 2023-08-17T00:05:59.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc80b05a0 con 0x7f0cb40038e0 2023-08-17T00:05:59.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc4012d80 con 0x7f0cb40038e0 2023-08-17T00:05:59.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.641+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc80b0200 con 0x7f0cb40038e0 2023-08-17T00:05:59.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.645+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc80c9d40 con 0x7f0cb40038e0 2023-08-17T00:05:59.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.645+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0cc402c070 con 0x7f0cb40038e0 2023-08-17T00:05:59.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.645+0000 7f0cbe7fc700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0cac05a180 0x7f0cac05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:05:59.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.645+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f0cc4075340 con 0x7f0cb40038e0 2023-08-17T00:05:59.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.649+0000 7f0ccda8c700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0cac05a180 0x7f0cac05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:05:59.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.649+0000 7f0ccda8c700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0cac05a180 0x7f0cac05c640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f0cc80ca860 tx=0x7f0cb8001560).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:05:59.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.653+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0cc4048fd0 con 0x7f0cb40038e0 2023-08-17T00:05:59.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:05:59.809+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0cc806b4c0 con 0x7f0cb40038e0 2023-08-17T00:06:00.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.429+0000 7f0cbe7fc700 1 -- 172.21.15.153:0/698658597 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0cc402a0d0 con 0x7f0cb40038e0 2023-08-17T00:06:00.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0cac05a180 msgr2=0x7f0cac05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0cac05a180 0x7f0cac05c640 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f0cc80ca860 tx=0x7f0cb8001560).stop 2023-08-17T00:06:00.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 msgr2=0x7f0cc80afd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cc80afd10 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f0cb400bf90 tx=0x7f0cc4008040).stop 2023-08-17T00:06:00.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 shutdown_connections 2023-08-17T00:06:00.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0cac05a180 0x7f0cac05c640 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cc80c9230 0x7f0cc80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cc8150660 0x7f0cc80c2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 --2- 172.21.15.153:0/698658597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0cb40038e0 0x7f0cc80afd10 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 >> 172.21.15.153:0/698658597 conn(0x7f0cc80cb330 msgr2=0x7f0cc81524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:00.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.441+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 shutdown_connections 2023-08-17T00:06:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.449+0000 7f0ccf28f700 1 -- 172.21.15.153:0/698658597 wait complete. 2023-08-17T00:06:00.459 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:06:00.477 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:06:00.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.629+0000 7f271a379700 1 Processor -- start 2023-08-17T00:06:00.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.633+0000 7f271a379700 1 -- start start 2023-08-17T00:06:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.633+0000 7f271a379700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27140c57a0 0x7f27140c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f271a379700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27140c11b0 0x7f2714154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f271a379700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140bfd10 con 0x7f2714153f50 2023-08-17T00:06:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f271a379700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2714154860 con 0x7f27140c11b0 2023-08-17T00:06:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f271a379700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2714154af0 con 0x7f27140c57a0 2023-08-17T00:06:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2718b76700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2714153f50 0x7f2714157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41000/0 (socket says 172.21.15.153:41000) 2023-08-17T00:06:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2718b76700 1 -- 172.21.15.153:0/621546689 learned_addr learned my addr 172.21.15.153:0/621546689 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719b78700 1 --2- 172.21.15.153:0/621546689 >> v2:172.21.15.178:3300/0 conn(0x7f27140c11b0 0x7f2714154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719377700 1 --2- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27140c57a0 0x7f27140c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f270bfff700 1 -- 172.21.15.153:0/621546689 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924740578 0 0) 0x7f27140bfd10 con 0x7f2714153f50 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f270bfff700 1 -- 172.21.15.153:0/621546689 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27000033f0 con 0x7f2714153f50 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719b78700 1 -- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27140c57a0 msgr2=0x7f27140c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719b78700 1 --2- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27140c57a0 0x7f27140c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719b78700 1 -- 172.21.15.153:0/621546689 >> v1:172.21.15.153:6789/0 conn(0x7f2714153f50 legacy=0x7f2714157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f270bfff700 1 -- 172.21.15.153:0/621546689 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2701315681 0 0) 0x7f27000033f0 con 0x7f2714153f50 2023-08-17T00:06:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719b78700 1 -- 172.21.15.153:0/621546689 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714154dd0 con 0x7f27140c11b0 2023-08-17T00:06:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f2719b78700 1 --2- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714154370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f270c009e60 tx=0x7f270c009780).ready entity=mon.1 client_cookie=1f9ad0785b6e4e67 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f270bfff700 1 -- 172.21.15.153:0/621546689 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c00e070 con 0x7f27140c11b0 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f270bfff700 1 -- 172.21.15.153:0/621546689 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c00b7a0 con 0x7f27140c11b0 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.637+0000 7f270bfff700 1 -- 172.21.15.153:0/621546689 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704001470 con 0x7f27140c11b0 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 -- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 msgr2=0x7f2714154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 --2- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714154370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f270c009e60 tx=0x7f270c009780).stop 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 -- 172.21.15.153:0/621546689 shutdown_connections 2023-08-17T00:06:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 --2- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714154370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 --2- 172.21.15.153:0/621546689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27140c57a0 0x7f27140c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 -- 172.21.15.153:0/621546689 >> 172.21.15.153:0/621546689 conn(0x7f2714062a70 msgr2=0x7f27140ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 -- 172.21.15.153:0/621546689 shutdown_connections 2023-08-17T00:06:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.641+0000 7f271a379700 1 -- 172.21.15.153:0/621546689 wait complete. 2023-08-17T00:06:00.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 Processor -- start 2023-08-17T00:06:00.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 -- start start 2023-08-17T00:06:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714166b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 0x7f27140c3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714153f50 0x7f27140af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c3320 con 0x7f27140c57a0 2023-08-17T00:06:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c2710 con 0x7f27140c11b0 2023-08-17T00:06:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f271a379700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140c29f0 con 0x7f2714153f50 2023-08-17T00:06:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 0x7f27140c3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 0x7f27140c3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37244/0 (socket says 172.21.15.153:37244) 2023-08-17T00:06:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 -- 172.21.15.153:0/908545584 learned_addr learned my addr 172.21.15.153:0/908545584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2719377700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714166b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2719b78700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714153f50 0x7f27140af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 -- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714153f50 msgr2=0x7f27140af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714153f50 0x7f27140af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 -- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 msgr2=0x7f2714166b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714166b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 -- 172.21.15.153:0/908545584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009a20 con 0x7f27140c57a0 2023-08-17T00:06:00.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2719377700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714166b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:00.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.645+0000 7f2718b76700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 0x7f27140c3f60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f270400c7e0 tx=0x7f2704001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.649+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040072e0 con 0x7f27140c57a0 2023-08-17T00:06:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.649+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2704007440 con 0x7f27140c57a0 2023-08-17T00:06:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.649+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040057a0 con 0x7f27140c57a0 2023-08-17T00:06:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.649+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140c2cd0 con 0x7f27140c57a0 2023-08-17T00:06:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.649+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27140c2350 con 0x7f27140c57a0 2023-08-17T00:06:00.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.649+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f271406b4c0 con 0x7f27140c57a0 2023-08-17T00:06:00.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.653+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2704010070 con 0x7f27140c57a0 2023-08-17T00:06:00.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.653+0000 7f27097fa700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26f805a150 0x7f26f805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:00.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.653+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f27040739c0 con 0x7f27140c57a0 2023-08-17T00:06:00.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.653+0000 7f2719377700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26f805a150 0x7f26f805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:00.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.653+0000 7f2719377700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26f805a150 0x7f26f805c610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f2710009f90 tx=0x7f2710009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:00.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.661+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27040473c0 con 0x7f27140c57a0 2023-08-17T00:06:00.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.857+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27140bf9a0 con 0x7f27140c57a0 2023-08-17T00:06:00.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.869+0000 7f27097fa700 1 -- 172.21.15.153:0/908545584 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v34) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2704001aa0 con 0x7f27140c57a0 2023-08-17T00:06:00.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26f805a150 msgr2=0x7f26f805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26f805a150 0x7f26f805c610 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f2710009f90 tx=0x7f2710009060).stop 2023-08-17T00:06:00.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 msgr2=0x7f27140c3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:00.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 0x7f27140c3f60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f270400c7e0 tx=0x7f2704001660).stop 2023-08-17T00:06:00.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 shutdown_connections 2023-08-17T00:06:00.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26f805a150 0x7f26f805c610 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0x7f2710009f90 tx=0x7f2710009060).stop 2023-08-17T00:06:00.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2714153f50 0x7f27140af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27140c57a0 0x7f27140c3f60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 --2- 172.21.15.153:0/908545584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27140c11b0 0x7f2714166b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:00.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.877+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 >> 172.21.15.153:0/908545584 conn(0x7f2714062a70 msgr2=0x7f27140c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:00.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.881+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 shutdown_connections 2023-08-17T00:06:00.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:00.881+0000 7f271a379700 1 -- 172.21.15.153:0/908545584 wait complete. 2023-08-17T00:06:00.891 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 7 and data pool 8 2023-08-17T00:06:00.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:01.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 Processor -- start 2023-08-17T00:06:01.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 -- start start 2023-08-17T00:06:01.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 0x7f4d34151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34063290 0x7f4d34065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d34061fa0 con 0x7f4d34065b50 2023-08-17T00:06:01.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340c3fb0 con 0x7f4d34151b90 2023-08-17T00:06:01.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.069+0000 7f4d3b65b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34152460 con 0x7f4d34063290 2023-08-17T00:06:01.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d393f7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 0x7f4d34151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d38bf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34063290 0x7f4d34065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d393f7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 0x7f4d34151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40460/0 (socket says 172.21.15.153:40460) 2023-08-17T00:06:01.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d393f7700 1 -- 172.21.15.153:0/598478564 learned_addr learned my addr 172.21.15.153:0/598478564 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:01.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d2bfff700 1 -- 172.21.15.153:0/598478564 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281385786 0 0) 0x7f4d34061fa0 con 0x7f4d34065b50 2023-08-17T00:06:01.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d2bfff700 1 -- 172.21.15.153:0/598478564 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d200033f0 con 0x7f4d34065b50 2023-08-17T00:06:01.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d38bf6700 1 -- 172.21.15.153:0/598478564 >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 msgr2=0x7f4d34151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:01.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d38bf6700 1 --2- 172.21.15.153:0/598478564 >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 0x7f4d34151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d38bf6700 1 -- 172.21.15.153:0/598478564 >> v1:172.21.15.178:6789/0 conn(0x7f4d34065b50 legacy=0x7f4d34064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d38bf6700 1 -- 172.21.15.153:0/598478564 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340621f0 con 0x7f4d34063290 2023-08-17T00:06:01.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d393f7700 1 --2- 172.21.15.153:0/598478564 >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 0x7f4d34151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:01.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d38bf6700 1 --2- 172.21.15.153:0/598478564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34063290 0x7f4d34065660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4d24009760 tx=0x7f4d24009060).ready entity=mon.2 client_cookie=22f792174b52a6d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d2bfff700 1 -- 172.21.15.153:0/598478564 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240090d0 con 0x7f4d34063290 2023-08-17T00:06:01.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d2bfff700 1 -- 172.21.15.153:0/598478564 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400d4a0 con 0x7f4d34063290 2023-08-17T00:06:01.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d2bfff700 1 -- 172.21.15.153:0/598478564 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400d820 con 0x7f4d34063290 2023-08-17T00:06:01.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d3b65b700 1 -- 172.21.15.153:0/598478564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34063290 msgr2=0x7f4d34065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/598478564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34063290 0x7f4d34065660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f4d24009760 tx=0x7f4d24009060).stop 2023-08-17T00:06:01.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d3b65b700 1 -- 172.21.15.153:0/598478564 shutdown_connections 2023-08-17T00:06:01.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/598478564 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34063290 0x7f4d34065660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/598478564 >> v2:172.21.15.178:3300/0 conn(0x7f4d34151b90 0x7f4d34151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.073+0000 7f4d3b65b700 1 -- 172.21.15.153:0/598478564 >> 172.21.15.153:0/598478564 conn(0x7f4d340c7150 msgr2=0x7f4d340c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:01.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.077+0000 7f4d3b65b700 1 -- 172.21.15.153:0/598478564 shutdown_connections 2023-08-17T00:06:01.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.077+0000 7f4d3b65b700 1 -- 172.21.15.153:0/598478564 wait complete. 2023-08-17T00:06:01.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 Processor -- start 2023-08-17T00:06:01.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 -- start start 2023-08-17T00:06:01.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 0x7f4d34144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34065b50 0x7f4d340ab7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34151b90 0x7f4d340abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340ac1a0 con 0x7f4d34063290 2023-08-17T00:06:01.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d34168440 con 0x7f4d34151b90 2023-08-17T00:06:01.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340a6f90 con 0x7f4d34065b50 2023-08-17T00:06:01.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 0x7f4d34144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 0x7f4d34144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37246/0 (socket says 172.21.15.153:37246) 2023-08-17T00:06:01.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 -- 172.21.15.153:0/2910208906 learned_addr learned my addr 172.21.15.153:0/2910208906 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:01.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d39bf8700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34151b90 0x7f4d340abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d38bf6700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34065b50 0x7f4d340ab7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 -- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34065b50 msgr2=0x7f4d340ab7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34065b50 0x7f4d340ab7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 -- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34151b90 msgr2=0x7f4d340abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34151b90 0x7f4d340abcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 -- 172.21.15.153:0/2910208906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30009370 con 0x7f4d34063290 2023-08-17T00:06:01.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d38bf6700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34065b50 0x7f4d340ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:01.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d39bf8700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34151b90 0x7f4d340abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:01.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d393f7700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 0x7f4d34144180 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f4d30006d00 tx=0x7f4d300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000eee0 con 0x7f4d34063290 2023-08-17T00:06:01.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3000c850 con 0x7f4d34063290 2023-08-17T00:06:01.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000cbd0 con 0x7f4d34063290 2023-08-17T00:06:01.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d240092a0 con 0x7f4d34063290 2023-08-17T00:06:01.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.081+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d340a7550 con 0x7f4d34063290 2023-08-17T00:06:01.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.085+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3406b530 con 0x7f4d34063290 2023-08-17T00:06:01.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.085+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d30022070 con 0x7f4d34063290 2023-08-17T00:06:01.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.085+0000 7f4d297fa700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a150 0x7f4d1805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.085+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4d30074570 con 0x7f4d34063290 2023-08-17T00:06:01.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.085+0000 7f4d38bf6700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a150 0x7f4d1805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.089+0000 7f4d38bf6700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a150 0x7f4d1805c610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4d340c5430 tx=0x7f4d24016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.093+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d30048020 con 0x7f4d34063290 2023-08-17T00:06:01.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.253+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d340624d0 con 0x7f4d34063290 2023-08-17T00:06:01.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.257+0000 7f4d297fa700 1 -- 172.21.15.153:0/2910208906 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16989 (secure 0 0 0) 0x7f4d30016090 con 0x7f4d34063290 2023-08-17T00:06:01.261 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:01.261 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":49,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:00.861622+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:05:58.859718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T00:05:59.885036+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:01.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a150 msgr2=0x7f4d1805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a150 0x7f4d1805c610 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f4d340c5430 tx=0x7f4d24016000).stop 2023-08-17T00:06:01.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 msgr2=0x7f4d34144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 0x7f4d34144180 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f4d30006d00 tx=0x7f4d300090f0).stop 2023-08-17T00:06:01.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 shutdown_connections 2023-08-17T00:06:01.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a150 0x7f4d1805c610 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d34151b90 0x7f4d340abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d34065b50 0x7f4d340ab7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 --2- 172.21.15.153:0/2910208906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d34063290 0x7f4d34144180 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 >> 172.21.15.153:0/2910208906 conn(0x7f4d340c7150 msgr2=0x7f4d340a9ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 shutdown_connections 2023-08-17T00:06:01.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.261+0000 7f4d3b65b700 1 -- 172.21.15.153:0/2910208906 wait complete. 2023-08-17T00:06:01.285 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:01.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.433+0000 7fc60d8db700 1 Processor -- start 2023-08-17T00:06:01.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc60d8db700 1 -- start start 2023-08-17T00:06:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc60d8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc6080a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc60d8db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc6081505d0 0x7fc608150a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc60d8db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6080bc0b0 con 0x7fc6080c0c80 2023-08-17T00:06:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc60d8db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6080bd590 con 0x7fc6081505d0 2023-08-17T00:06:01.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc60d8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc608062fb0 con 0x7fc6080a89c0 2023-08-17T00:06:01.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc5fffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc6080c0c80 0x7fc6080bcdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41012/0 (socket says 172.21.15.153:41012) 2023-08-17T00:06:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc5fffff700 1 -- 172.21.15.153:0/3199826042 learned_addr learned my addr 172.21.15.153:0/3199826042 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc6077fe700 1 --2- 172.21.15.153:0/3199826042 >> v2:172.21.15.153:3300/0 conn(0x7fc6081505d0 0x7fc608150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc606ffd700 1 --2- 172.21.15.153:0/3199826042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc6080a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc6067fc700 1 -- 172.21.15.153:0/3199826042 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301440251 0 0) 0x7fc6080bc0b0 con 0x7fc6080c0c80 2023-08-17T00:06:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc6067fc700 1 -- 172.21.15.153:0/3199826042 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f40033f0 con 0x7fc6080c0c80 2023-08-17T00:06:01.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc6077fe700 1 -- 172.21.15.153:0/3199826042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 msgr2=0x7fc6080a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.437+0000 7fc6077fe700 1 --2- 172.21.15.153:0/3199826042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc6080a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc6077fe700 1 -- 172.21.15.153:0/3199826042 >> v1:172.21.15.153:6789/0 conn(0x7fc6080c0c80 legacy=0x7fc6080bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc6077fe700 1 -- 172.21.15.153:0/3199826042 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080bb780 con 0x7fc6081505d0 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc6077fe700 1 --2- 172.21.15.153:0/3199826042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc608150a80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fc600009790 tx=0x7fc600009060).ready entity=mon.0 client_cookie=22d9b6f8fb90f606 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc6067fc700 1 -- 172.21.15.153:0/3199826042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6000090d0 con 0x7fc6081505d0 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc6067fc700 1 -- 172.21.15.153:0/3199826042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60000d4a0 con 0x7fc6081505d0 2023-08-17T00:06:01.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc6067fc700 1 -- 172.21.15.153:0/3199826042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000d820 con 0x7fc6081505d0 2023-08-17T00:06:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 -- 172.21.15.153:0/3199826042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 msgr2=0x7fc608150a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 --2- 172.21.15.153:0/3199826042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc608150a80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7fc600009790 tx=0x7fc600009060).stop 2023-08-17T00:06:01.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 -- 172.21.15.153:0/3199826042 shutdown_connections 2023-08-17T00:06:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 --2- 172.21.15.153:0/3199826042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc608150a80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 --2- 172.21.15.153:0/3199826042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc6080a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 -- 172.21.15.153:0/3199826042 >> 172.21.15.153:0/3199826042 conn(0x7fc6080c7150 msgr2=0x7fc6080c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 -- 172.21.15.153:0/3199826042 shutdown_connections 2023-08-17T00:06:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 -- 172.21.15.153:0/3199826042 wait complete. 2023-08-17T00:06:01.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 Processor -- start 2023-08-17T00:06:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.441+0000 7fc60d8db700 1 -- start start 2023-08-17T00:06:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc608142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6080c0c80 0x7fc6080bee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc6080bf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080bf840 con 0x7fc6081505d0 2023-08-17T00:06:01.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6080a5900 con 0x7fc6080c0c80 2023-08-17T00:06:01.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc608168490 con 0x7fc6080a89c0 2023-08-17T00:06:01.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc6080bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc6080bf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37260/0 (socket says 172.21.15.153:37260) 2023-08-17T00:06:01.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 -- 172.21.15.153:0/2360917957 learned_addr learned my addr 172.21.15.153:0/2360917957 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:01.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc606ffd700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc608142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc5fffff700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6080c0c80 0x7fc6080bee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 -- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 msgr2=0x7fc608142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc608142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 -- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6080c0c80 msgr2=0x7fc6080bee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6080c0c80 0x7fc6080bee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 -- 172.21.15.153:0/2360917957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6000092a0 con 0x7fc6081505d0 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc6077fe700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc6080bf350 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fc600012740 tx=0x7fc600016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600006cd0 con 0x7fc6081505d0 2023-08-17T00:06:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600012b70 con 0x7fc6081505d0 2023-08-17T00:06:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6080a4fd0 con 0x7fc6081505d0 2023-08-17T00:06:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60001c420 con 0x7fc6081505d0 2023-08-17T00:06:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.445+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6080a5590 con 0x7fc6081505d0 2023-08-17T00:06:01.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.449+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6081640d0 con 0x7fc6081505d0 2023-08-17T00:06:01.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.449+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc60000f070 con 0x7fc6081505d0 2023-08-17T00:06:01.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.449+0000 7fc5feffd700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5e805a180 0x7fc5e805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.449+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc600075720 con 0x7fc6081505d0 2023-08-17T00:06:01.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.453+0000 7fc606ffd700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5e805a180 0x7fc5e805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.453+0000 7fc606ffd700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5e805a180 0x7fc5e805c640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fc5f8009c30 tx=0x7fc5f8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.457+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc600049060 con 0x7fc6081505d0 2023-08-17T00:06:01.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.613+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc60806b530 con 0x7fc6081505d0 2023-08-17T00:06:01.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.613+0000 7fc5feffd700 1 -- 172.21.15.153:0/2360917957 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16989 (secure 0 0 0) 0x7fc60004c680 con 0x7fc6081505d0 2023-08-17T00:06:01.618 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:01.618 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":49,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:00.861622+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:05:58.859718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T00:05:59.885036+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:01.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5e805a180 msgr2=0x7fc5e805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5e805a180 0x7fc5e805c640 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fc5f8009c30 tx=0x7fc5f8009060).stop 2023-08-17T00:06:01.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 msgr2=0x7fc6080bf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc6080bf350 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fc600012740 tx=0x7fc600016000).stop 2023-08-17T00:06:01.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 shutdown_connections 2023-08-17T00:06:01.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc5e805a180 0x7fc5e805c640 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc6081505d0 0x7fc6080bf350 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6080c0c80 0x7fc6080bee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 --2- 172.21.15.153:0/2360917957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc6080a89c0 0x7fc608142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 >> 172.21.15.153:0/2360917957 conn(0x7fc6080c7150 msgr2=0x7fc608068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 shutdown_connections 2023-08-17T00:06:01.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.617+0000 7fc60d8db700 1 -- 172.21.15.153:0/2360917957 wait complete. 2023-08-17T00:06:01.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:06:01.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.793+0000 7fdf491b9700 1 Processor -- start 2023-08-17T00:06:01.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.793+0000 7fdf491b9700 1 -- start start 2023-08-17T00:06:01.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf491b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf440acf30 0x7fdf440c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf491b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf440c5ea0 0x7fdf440634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf491b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf44154e90 con 0x7fdf440639a0 2023-08-17T00:06:01.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf491b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf44153fc0 con 0x7fdf440acf30 2023-08-17T00:06:01.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf491b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf44154280 con 0x7fdf440c5ea0 2023-08-17T00:06:01.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf489b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdf440639a0 0x7fdf44157590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41028/0 (socket says 172.21.15.153:41028) 2023-08-17T00:06:01.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf489b8700 1 -- 172.21.15.153:0/98632377 learned_addr learned my addr 172.21.15.153:0/98632377 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:01.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf43fff700 1 --2- 172.21.15.153:0/98632377 >> v2:172.21.15.153:3300/0 conn(0x7fdf440acf30 0x7fdf440c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf437fe700 1 --2- 172.21.15.153:0/98632377 >> v2:172.21.15.178:3300/0 conn(0x7fdf440c5ea0 0x7fdf440634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf43fff700 1 -- 172.21.15.153:0/98632377 >> v2:172.21.15.178:3300/0 conn(0x7fdf440c5ea0 msgr2=0x7fdf440634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:01.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf43fff700 1 --2- 172.21.15.153:0/98632377 >> v2:172.21.15.178:3300/0 conn(0x7fdf440c5ea0 0x7fdf440634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.797+0000 7fdf42ffd700 1 -- 172.21.15.153:0/98632377 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063625473 0 0) 0x7fdf44154e90 con 0x7fdf440639a0 2023-08-17T00:06:01.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf43fff700 1 -- 172.21.15.153:0/98632377 >> v1:172.21.15.153:6789/0 conn(0x7fdf440639a0 legacy=0x7fdf44157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf43fff700 1 -- 172.21.15.153:0/98632377 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf44154560 con 0x7fdf440acf30 2023-08-17T00:06:01.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf43fff700 1 --2- 172.21.15.153:0/98632377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c1020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fdf440b0a60 tx=0x7fdf34009060).ready entity=mon.0 client_cookie=f604f074247cac05 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf42ffd700 1 -- 172.21.15.153:0/98632377 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400f510 con 0x7fdf440acf30 2023-08-17T00:06:01.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf42ffd700 1 -- 172.21.15.153:0/98632377 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3400f670 con 0x7fdf440acf30 2023-08-17T00:06:01.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf42ffd700 1 -- 172.21.15.153:0/98632377 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3400f9f0 con 0x7fdf440acf30 2023-08-17T00:06:01.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 -- 172.21.15.153:0/98632377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 msgr2=0x7fdf440c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 --2- 172.21.15.153:0/98632377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c1020 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fdf440b0a60 tx=0x7fdf34009060).stop 2023-08-17T00:06:01.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 -- 172.21.15.153:0/98632377 shutdown_connections 2023-08-17T00:06:01.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 --2- 172.21.15.153:0/98632377 >> v2:172.21.15.178:3300/0 conn(0x7fdf440c5ea0 0x7fdf440634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 --2- 172.21.15.153:0/98632377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c1020 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 -- 172.21.15.153:0/98632377 >> 172.21.15.153:0/98632377 conn(0x7fdf440cb330 msgr2=0x7fdf440c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:01.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 -- 172.21.15.153:0/98632377 shutdown_connections 2023-08-17T00:06:01.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.801+0000 7fdf491b9700 1 -- 172.21.15.153:0/98632377 wait complete. 2023-08-17T00:06:01.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 Processor -- start 2023-08-17T00:06:01.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 -- start start 2023-08-17T00:06:01.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf440639a0 0x7fdf440afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf440c3400 0x7fdf440ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44151d40 con 0x7fdf440acf30 2023-08-17T00:06:01.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440ae420 con 0x7fdf440c3400 2023-08-17T00:06:01.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.805+0000 7fdf491b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf440ae700 con 0x7fdf440639a0 2023-08-17T00:06:01.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37276/0 (socket says 172.21.15.153:37276) 2023-08-17T00:06:01.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 -- 172.21.15.153:0/3056883862 learned_addr learned my addr 172.21.15.153:0/3056883862 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:01.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf43fff700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf440639a0 0x7fdf440afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 -- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf440639a0 msgr2=0x7fdf440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf489b8700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf440c3400 0x7fdf440ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf440639a0 0x7fdf440afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 -- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf440c3400 msgr2=0x7fdf440ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:01.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf440c3400 0x7fdf440ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:01.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 -- 172.21.15.153:0/3056883862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf340092a0 con 0x7fdf440acf30 2023-08-17T00:06:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf43fff700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf440639a0 0x7fdf440afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf489b8700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf440c3400 0x7fdf440ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf437fe700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c2f10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fdf3800e900 tx=0x7fdf38009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800c640 con 0x7fdf440acf30 2023-08-17T00:06:01.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3800c7a0 con 0x7fdf440acf30 2023-08-17T00:06:01.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf440af2a0 con 0x7fdf440acf30 2023-08-17T00:06:01.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800cb20 con 0x7fdf440acf30 2023-08-17T00:06:01.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf440af860 con 0x7fdf440acf30 2023-08-17T00:06:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440afa80 con 0x7fdf440acf30 2023-08-17T00:06:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.809+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdf38022070 con 0x7fdf440acf30 2023-08-17T00:06:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.813+0000 7fdf2bfff700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf3005a150 0x7fdf3005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.813+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf380744f0 con 0x7fdf440acf30 2023-08-17T00:06:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.813+0000 7fdf43fff700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf3005a150 0x7fdf3005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.813+0000 7fdf43fff700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf3005a150 0x7fdf3005c610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fdf34006e00 tx=0x7fdf34017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:01.817+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf38047e90 con 0x7fdf440acf30 2023-08-17T00:06:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.013+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdf4406b4c0 con 0x7fdf440acf30 2023-08-17T00:06:02.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.881+0000 7fdf2bfff700 1 -- 172.21.15.153:0/3056883862 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdf380160b0 con 0x7fdf440acf30 2023-08-17T00:06:02.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf3005a150 msgr2=0x7fdf3005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:02.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf3005a150 0x7fdf3005c610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fdf34006e00 tx=0x7fdf34017000).stop 2023-08-17T00:06:02.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 msgr2=0x7fdf440c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:02.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c2f10 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fdf3800e900 tx=0x7fdf38009060).stop 2023-08-17T00:06:02.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 shutdown_connections 2023-08-17T00:06:02.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf3005a150 0x7fdf3005c610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:02.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf440c3400 0x7fdf440ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:02.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf440acf30 0x7fdf440c2f10 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:02.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 --2- 172.21.15.153:0/3056883862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf440639a0 0x7fdf440afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:02.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 >> 172.21.15.153:0/3056883862 conn(0x7fdf440cb330 msgr2=0x7fdf44152120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:02.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 shutdown_connections 2023-08-17T00:06:02.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:02.885+0000 7fdf491b9700 1 -- 172.21.15.153:0/3056883862 wait complete. 2023-08-17T00:06:02.912 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:06:02.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:06:03.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.073+0000 7face8f1b700 1 Processor -- start 2023-08-17T00:06:03.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.073+0000 7face8f1b700 1 -- start start 2023-08-17T00:06:03.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face8f1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7face4151f70 0x7face4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:03.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face8f1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face4061fa0 con 0x7face4065b50 2023-08-17T00:06:03.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face8f1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7face41523d0 con 0x7face4151b90 2023-08-17T00:06:03.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face8f1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7face40c3fb0 con 0x7face4151f70 2023-08-17T00:06:03.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face2d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7face4065b50 0x7face4064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41030/0 (socket says 172.21.15.153:41030) 2023-08-17T00:06:03.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face2d9d700 1 -- 172.21.15.153:0/163390497 learned_addr learned my addr 172.21.15.153:0/163390497 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:03.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face1d9b700 1 --2- 172.21.15.153:0/163390497 >> v2:172.21.15.153:3300/0 conn(0x7face4151f70 0x7face4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:03.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face159a700 1 -- 172.21.15.153:0/163390497 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185862126 0 0) 0x7face4061fa0 con 0x7face4065b50 2023-08-17T00:06:03.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face159a700 1 -- 172.21.15.153:0/163390497 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faccc0033f0 con 0x7face4065b50 2023-08-17T00:06:03.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face159a700 1 -- 172.21.15.153:0/163390497 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127666461 0 0) 0x7face41523d0 con 0x7face4151b90 2023-08-17T00:06:03.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face159a700 1 -- 172.21.15.153:0/163390497 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face4061fa0 con 0x7face4151b90 2023-08-17T00:06:03.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face1d9b700 1 -- 172.21.15.153:0/163390497 >> v1:172.21.15.178:6789/0 conn(0x7face4151b90 legacy=0x7face4063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face1d9b700 1 -- 172.21.15.153:0/163390497 >> v1:172.21.15.153:6789/0 conn(0x7face4065b50 legacy=0x7face4064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face159a700 1 -- 172.21.15.153:0/163390497 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3210992469 0 0) 0x7faccc0033f0 con 0x7face4065b50 2023-08-17T00:06:03.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.077+0000 7face1d9b700 1 -- 172.21.15.153:0/163390497 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face40621f0 con 0x7face4151f70 2023-08-17T00:06:03.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face1d9b700 1 --2- 172.21.15.153:0/163390497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151f70 0x7face4065660 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7facd8009760 tx=0x7facd8009060).ready entity=mon.0 client_cookie=aa17aefe49674b15 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:03.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face159a700 1 -- 172.21.15.153:0/163390497 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facdc0017f0 con 0x7face4151f70 2023-08-17T00:06:03.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face159a700 1 -- 172.21.15.153:0/163390497 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8011400 con 0x7face4151f70 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face159a700 1 -- 172.21.15.153:0/163390497 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8011780 con 0x7face4151f70 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 -- 172.21.15.153:0/163390497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151f70 msgr2=0x7face4065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 --2- 172.21.15.153:0/163390497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151f70 0x7face4065660 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7facd8009760 tx=0x7facd8009060).stop 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 -- 172.21.15.153:0/163390497 shutdown_connections 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 --2- 172.21.15.153:0/163390497 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151f70 0x7face4065660 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 -- 172.21.15.153:0/163390497 >> 172.21.15.153:0/163390497 conn(0x7face40c7150 msgr2=0x7face40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:03.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 -- 172.21.15.153:0/163390497 shutdown_connections 2023-08-17T00:06:03.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.081+0000 7face8f1b700 1 -- 172.21.15.153:0/163390497 wait complete. 2023-08-17T00:06:03.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 Processor -- start 2023-08-17T00:06:03.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 -- start start 2023-08-17T00:06:03.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7face4065b50 0x7face40aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:03.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 0x7face41402a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:03.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7face4151f70 0x7face4068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:03.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face4153d40 con 0x7face4151b90 2023-08-17T00:06:03.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face40ab380 con 0x7face4065b50 2023-08-17T00:06:03.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face8f1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7face40ab660 con 0x7face4151f70 2023-08-17T00:06:03.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 0x7face41402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:03.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 0x7face41402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37290/0 (socket says 172.21.15.153:37290) 2023-08-17T00:06:03.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 -- 172.21.15.153:0/1675289009 learned_addr learned my addr 172.21.15.153:0/1675289009 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:03.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face2d9d700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7face4151f70 0x7face4068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:03.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face259c700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7face4065b50 0x7face40aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:03.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 -- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7face4151f70 msgr2=0x7face4068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7face4151f70 0x7face4068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 -- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7face4065b50 msgr2=0x7face40aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7face4065b50 0x7face40aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 -- 172.21.15.153:0/1675289009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80092a0 con 0x7face4151b90 2023-08-17T00:06:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.085+0000 7face1d9b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 0x7face41402a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7facd8009d50 tx=0x7facd8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:03.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd80107c0 con 0x7face4151b90 2023-08-17T00:06:03.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd8010920 con 0x7face4151b90 2023-08-17T00:06:03.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd8010ca0 con 0x7face4151b90 2023-08-17T00:06:03.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face40ab940 con 0x7face4151b90 2023-08-17T00:06:03.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face40abc20 con 0x7face4151b90 2023-08-17T00:06:03.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face4153eb0 con 0x7face4151b90 2023-08-17T00:06:03.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7facd800f070 con 0x7face4151b90 2023-08-17T00:06:03.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.089+0000 7facd27fc700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7facc405a120 0x7facc405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:03.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.093+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facd8075600 con 0x7face4151b90 2023-08-17T00:06:03.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.093+0000 7face259c700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7facc405a120 0x7facc405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:03.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.093+0000 7face259c700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7facc405a120 0x7facc405c5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7facd4003930 tx=0x7facd4007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:03.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.101+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7facd8048fa0 con 0x7face4151b90 2023-08-17T00:06:03.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.293+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7face406b530 con 0x7face4151b90 2023-08-17T00:06:03.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7facd27fc700 1 -- 172.21.15.153:0/1675289009 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7facd804c5c0 con 0x7face4151b90 2023-08-17T00:06:03.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7facc405a120 msgr2=0x7facc405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7facc405a120 0x7facc405c5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7facd4003930 tx=0x7facd4007bd0).stop 2023-08-17T00:06:03.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 msgr2=0x7face41402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:03.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 0x7face41402a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7facd8009d50 tx=0x7facd8016000).stop 2023-08-17T00:06:03.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 shutdown_connections 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7facc405a120 0x7facc405c5e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7face4151f70 0x7face4068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7face4151b90 0x7face41402a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 --2- 172.21.15.153:0/1675289009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7face4065b50 0x7face40aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 >> 172.21.15.153:0/1675289009 conn(0x7face40c7150 msgr2=0x7face414ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 shutdown_connections 2023-08-17T00:06:03.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:03.893+0000 7face8f1b700 1 -- 172.21.15.153:0/1675289009 wait complete. 2023-08-17T00:06:03.921 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:06:03.922 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:04.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 Processor -- start 2023-08-17T00:06:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 -- start start 2023-08-17T00:06:04.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c54068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 0x7f5c540a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c541585a0 con 0x7f5c540a8df0 2023-08-17T00:06:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c540c1ba0 con 0x7f5c540a96d0 2023-08-17T00:06:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5aa39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c54066400 con 0x7f5c54068820 2023-08-17T00:06:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c59236700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c54068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5a238700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 0x7f5c540a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5a238700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 0x7f5c540a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40512/0 (socket says 172.21.15.153:40512) 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.081+0000 7f5c5a238700 1 -- 172.21.15.153:0/759799304 learned_addr learned my addr 172.21.15.153:0/759799304 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c59236700 1 -- 172.21.15.153:0/759799304 >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 msgr2=0x7f5c540a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c59236700 1 --2- 172.21.15.153:0/759799304 >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 0x7f5c540a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c59236700 1 -- 172.21.15.153:0/759799304 >> v1:172.21.15.178:6789/0 conn(0x7f5c540a8df0 legacy=0x7f5c540c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c59236700 1 -- 172.21.15.153:0/759799304 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54069170 con 0x7f5c54068820 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5a238700 1 --2- 172.21.15.153:0/759799304 >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 0x7f5c540a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:04.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c59236700 1 --2- 172.21.15.153:0/759799304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c54068c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5c44009760 tx=0x7f5c44009060).ready entity=mon.2 client_cookie=ad57c86e06f2f8cb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c58a35700 1 -- 172.21.15.153:0/759799304 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400f510 con 0x7f5c54068820 2023-08-17T00:06:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c58a35700 1 -- 172.21.15.153:0/759799304 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4400f670 con 0x7f5c54068820 2023-08-17T00:06:04.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c58a35700 1 -- 172.21.15.153:0/759799304 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4400f9f0 con 0x7f5c54068820 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 -- 172.21.15.153:0/759799304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 msgr2=0x7f5c54068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/759799304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c54068c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f5c44009760 tx=0x7f5c44009060).stop 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 -- 172.21.15.153:0/759799304 shutdown_connections 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/759799304 >> v2:172.21.15.178:3300/0 conn(0x7f5c540a96d0 0x7f5c540a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/759799304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c54068c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 -- 172.21.15.153:0/759799304 >> 172.21.15.153:0/759799304 conn(0x7f5c540c6620 msgr2=0x7f5c540c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:04.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 -- 172.21.15.153:0/759799304 shutdown_connections 2023-08-17T00:06:04.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.085+0000 7f5c5aa39700 1 -- 172.21.15.153:0/759799304 wait complete. 2023-08-17T00:06:04.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 Processor -- start 2023-08-17T00:06:04.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 -- start start 2023-08-17T00:06:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c540bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540a8df0 0x7f5c540bb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 0x7f5c540bb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540bbc50 con 0x7f5c540a96d0 2023-08-17T00:06:04.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540bbf30 con 0x7f5c540a8df0 2023-08-17T00:06:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5aa39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c540bc210 con 0x7f5c54068820 2023-08-17T00:06:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5a238700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 0x7f5c540bb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5a238700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 0x7f5c540bb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37292/0 (socket says 172.21.15.153:37292) 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c5a238700 1 -- 172.21.15.153:0/2462898914 learned_addr learned my addr 172.21.15.153:0/2462898914 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c59236700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540a8df0 0x7f5c540bb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.089+0000 7f5c59a37700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c540bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5a238700 1 -- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 msgr2=0x7f5c540bfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5a238700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c540bfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5a238700 1 -- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540a8df0 msgr2=0x7f5c540bb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5a238700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540a8df0 0x7f5c540bb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5a238700 1 -- 172.21.15.153:0/2462898914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4c009ae0 con 0x7f5c540a96d0 2023-08-17T00:06:04.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5a238700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 0x7f5c540bb5c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5c4c009f30 tx=0x7f5c4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c0092e0 con 0x7f5c540a96d0 2023-08-17T00:06:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4c00f040 con 0x7f5c540a96d0 2023-08-17T00:06:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c440092a0 con 0x7f5c540a96d0 2023-08-17T00:06:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4c00cb70 con 0x7f5c540a96d0 2023-08-17T00:06:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c540bc7d0 con 0x7f5c540a96d0 2023-08-17T00:06:04.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.093+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c5406b4c0 con 0x7f5c540a96d0 2023-08-17T00:06:04.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.097+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5c4c01b030 con 0x7f5c540a96d0 2023-08-17T00:06:04.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.097+0000 7f5c49ffb700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.097+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5c4c073fd0 con 0x7f5c540a96d0 2023-08-17T00:06:04.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.097+0000 7f5c59a37700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.101+0000 7f5c59a37700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5c50007fd0 tx=0x7f5c50007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.105+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c4c047a20 con 0x7f5c540a96d0 2023-08-17T00:06:04.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.293+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c5405e300 con 0x7f5c540a96d0 2023-08-17T00:06:04.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c49ffb700 1 -- 172.21.15.153:0/2462898914 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f5c4c04b040 con 0x7f5c540a96d0 2023-08-17T00:06:04.301 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:04.301 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:03.881472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 msgr2=0x7f5c3805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f5c50007fd0 tx=0x7f5c50007d30).stop 2023-08-17T00:06:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 msgr2=0x7f5c540bb5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 0x7f5c540bb5c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5c4c009f30 tx=0x7f5c4c00b040).stop 2023-08-17T00:06:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 shutdown_connections 2023-08-17T00:06:04.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c3805a150 0x7f5c3805c610 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c540a96d0 0x7f5c540bb5c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c540a8df0 0x7f5c540bb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 --2- 172.21.15.153:0/2462898914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c54068820 0x7f5c540bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.297+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 >> 172.21.15.153:0/2462898914 conn(0x7f5c540c6620 msgr2=0x7f5c540694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:04.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.301+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 shutdown_connections 2023-08-17T00:06:04.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.301+0000 7f5c5aa39700 1 -- 172.21.15.153:0/2462898914 wait complete. 2023-08-17T00:06:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 38 2023-08-17T00:06:04.322 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:04.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.473+0000 7f37aa479700 1 Processor -- start 2023-08-17T00:06:04.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.473+0000 7f37aa479700 1 -- start start 2023-08-17T00:06:04.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37a40a8df0 0x7f37a40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37a4068820 0x7f37a4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a41585a0 con 0x7f37a4061fa0 2023-08-17T00:06:04.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a4066400 con 0x7f37a4068820 2023-08-17T00:06:04.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a4069170 con 0x7f37a40a8df0 2023-08-17T00:06:04.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37a4068820 0x7f37a4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37a4068820 0x7f37a4068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37308/0 (socket says 172.21.15.153:37308) 2023-08-17T00:06:04.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 -- 172.21.15.153:0/416416863 learned_addr learned my addr 172.21.15.153:0/416416863 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:04.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a9c78700 1 --1- 172.21.15.153:0/416416863 >> v1:172.21.15.153:6789/0 conn(0x7f37a4061fa0 0x7f37a4062430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41034/0 (socket says 172.21.15.153:41034) 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a9477700 1 --2- 172.21.15.153:0/416416863 >> v2:172.21.15.178:3300/0 conn(0x7f37a40a8df0 0x7f37a40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 -- 172.21.15.153:0/416416863 >> v2:172.21.15.178:3300/0 conn(0x7f37a40a8df0 msgr2=0x7f37a40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 --2- 172.21.15.153:0/416416863 >> v2:172.21.15.178:3300/0 conn(0x7f37a40a8df0 0x7f37a40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 -- 172.21.15.153:0/416416863 >> v1:172.21.15.153:6789/0 conn(0x7f37a4061fa0 legacy=0x7f37a4062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 -- 172.21.15.153:0/416416863 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a40b9d30 con 0x7f37a4068820 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a9477700 1 --2- 172.21.15.153:0/416416863 >> v2:172.21.15.178:3300/0 conn(0x7f37a40a8df0 0x7f37a40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:04.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37a8c76700 1 --2- 172.21.15.153:0/416416863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a4068c80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f37a40c3f30 tx=0x7f37940090f0).ready entity=mon.0 client_cookie=82e71f901bf82171 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f379bfff700 1 -- 172.21.15.153:0/416416863 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400b600 con 0x7f37a4068820 2023-08-17T00:06:04.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f379bfff700 1 -- 172.21.15.153:0/416416863 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379400b760 con 0x7f37a4068820 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f379bfff700 1 -- 172.21.15.153:0/416416863 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400bae0 con 0x7f37a4068820 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 -- 172.21.15.153:0/416416863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 msgr2=0x7f37a4068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 --2- 172.21.15.153:0/416416863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a4068c80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f37a40c3f30 tx=0x7f37940090f0).stop 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 -- 172.21.15.153:0/416416863 shutdown_connections 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 --2- 172.21.15.153:0/416416863 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a4068c80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 --2- 172.21.15.153:0/416416863 >> v2:172.21.15.178:3300/0 conn(0x7f37a40a8df0 0x7f37a40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.477+0000 7f37aa479700 1 -- 172.21.15.153:0/416416863 >> 172.21.15.153:0/416416863 conn(0x7f37a40c6620 msgr2=0x7f37a40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:04.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.481+0000 7f37aa479700 1 -- 172.21.15.153:0/416416863 shutdown_connections 2023-08-17T00:06:04.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.481+0000 7f37aa479700 1 -- 172.21.15.153:0/416416863 wait complete. 2023-08-17T00:06:04.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.481+0000 7f37aa479700 1 Processor -- start 2023-08-17T00:06:04.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.481+0000 7f37aa479700 1 -- start start 2023-08-17T00:06:04.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a4061fa0 0x7f37a4155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a40bbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a40a8df0 0x7f37a40ab320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4169ac0 con 0x7f37a4068820 2023-08-17T00:06:04.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a40bbb40 con 0x7f37a4061fa0 2023-08-17T00:06:04.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a4168eb0 con 0x7f37a40a8df0 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a40bbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a40bbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37320/0 (socket says 172.21.15.153:37320) 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 -- 172.21.15.153:0/3836216812 learned_addr learned my addr 172.21.15.153:0/3836216812 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a9c78700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a40a8df0 0x7f37a40ab320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a9477700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a4061fa0 0x7f37a4155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 -- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a40a8df0 msgr2=0x7f37a40ab320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a40a8df0 0x7f37a40ab320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 -- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a4061fa0 msgr2=0x7f37a4155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a4061fa0 0x7f37a4155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 -- 172.21.15.153:0/3836216812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794009370 con 0x7f37a4068820 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37a8c76700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a40bbe70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f37a40668e0 tx=0x7f3794017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400bae0 con 0x7f37a4068820 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3794000c90 con 0x7f37a4068820 2023-08-17T00:06:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a4169190 con 0x7f37a4068820 2023-08-17T00:06:04.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379401b640 con 0x7f37a4068820 2023-08-17T00:06:04.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.485+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a4169750 con 0x7f37a4068820 2023-08-17T00:06:04.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.489+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a40b9ef0 con 0x7f37a4068820 2023-08-17T00:06:04.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.489+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f379402b070 con 0x7f37a4068820 2023-08-17T00:06:04.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.489+0000 7f37997fa700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378805a180 0x7f378805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.489+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3794075ba0 con 0x7f37a4068820 2023-08-17T00:06:04.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.489+0000 7f37a9477700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378805a180 0x7f378805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.493+0000 7f37a9477700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378805a180 0x7f378805c640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f37a000aa70 tx=0x7f37a0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.493+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37a40b9ef0 con 0x7f37a4068820 2023-08-17T00:06:04.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.653+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37a40b9ef0 con 0x7f37a4068820 2023-08-17T00:06:04.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37997fa700 1 -- 172.21.15.153:0/3836216812 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f37a40b9ef0 con 0x7f37a4068820 2023-08-17T00:06:04.660 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:04.660 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":50,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:01.866515+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:05:58.859718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T00:05:59.885036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:04.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378805a180 msgr2=0x7f378805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378805a180 0x7f378805c640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f37a000aa70 tx=0x7f37a0008040).stop 2023-08-17T00:06:04.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 msgr2=0x7f37a40bbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a40bbe70 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f37a40668e0 tx=0x7f3794017000).stop 2023-08-17T00:06:04.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 shutdown_connections 2023-08-17T00:06:04.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378805a180 0x7f378805c640 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a40a8df0 0x7f37a40ab320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a4068820 0x7f37a40bbe70 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 --2- 172.21.15.153:0/3836216812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a4061fa0 0x7f37a4155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 >> 172.21.15.153:0/3836216812 conn(0x7f37a40c6620 msgr2=0x7f37a4156af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:04.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.657+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 shutdown_connections 2023-08-17T00:06:04.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.661+0000 7f37aa479700 1 -- 172.21.15.153:0/3836216812 wait complete. 2023-08-17T00:06:04.682 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:06:04.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:04.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.837+0000 7f597581b700 1 Processor -- start 2023-08-17T00:06:04.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.837+0000 7f597581b700 1 -- start start 2023-08-17T00:06:04.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f597581b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59700a8b70 0x7f59700632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f597581b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8f50 0x7f59700629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f597581b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5970065240 con 0x7f59700656d0 2023-08-17T00:06:04.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f597581b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5970062ea0 con 0x7f59700a8b70 2023-08-17T00:06:04.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f597581b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700638a0 con 0x7f59700a8f50 2023-08-17T00:06:04.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8f50 0x7f59700629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59700a8b70 0x7f59700632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596e7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8f50 0x7f59700629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:58302/0 (socket says 172.21.15.153:58302) 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f59700a8b70 0x7f59700632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40548/0 (socket says 172.21.15.153:40548) 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596e7fc700 1 -- 172.21.15.153:0/2275634979 learned_addr learned my addr 172.21.15.153:0/2275634979 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596f7fe700 1 --1- 172.21.15.153:0/2275634979 >> v1:172.21.15.178:6789/0 conn(0x7f59700656d0 0x7f59700bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:52886/0 (socket says 172.21.15.153:52886) 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 -- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8f50 msgr2=0x7f59700629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 --2- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8f50 0x7f59700629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 -- 172.21.15.153:0/2275634979 >> v1:172.21.15.178:6789/0 conn(0x7f59700656d0 legacy=0x7f59700bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 -- 172.21.15.153:0/2275634979 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5970064910 con 0x7f59700a8b70 2023-08-17T00:06:04.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.841+0000 7f596effd700 1 --2- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700a8b70 0x7f59700632e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f5960009760 tx=0x7f5960009060).ready entity=mon.1 client_cookie=4982025246c5f3b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f596dffb700 1 -- 172.21.15.153:0/2275634979 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000f510 con 0x7f59700a8b70 2023-08-17T00:06:04.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f596dffb700 1 -- 172.21.15.153:0/2275634979 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000f670 con 0x7f59700a8b70 2023-08-17T00:06:04.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f596dffb700 1 -- 172.21.15.153:0/2275634979 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000f9f0 con 0x7f59700a8b70 2023-08-17T00:06:04.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 -- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700a8b70 msgr2=0x7f59700632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 --2- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700a8b70 0x7f59700632e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f5960009760 tx=0x7f5960009060).stop 2023-08-17T00:06:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 -- 172.21.15.153:0/2275634979 shutdown_connections 2023-08-17T00:06:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 --2- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8f50 0x7f59700629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 --2- 172.21.15.153:0/2275634979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700a8b70 0x7f59700632e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 -- 172.21.15.153:0/2275634979 >> 172.21.15.153:0/2275634979 conn(0x7f59700c7150 msgr2=0x7f59700c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 -- 172.21.15.153:0/2275634979 shutdown_connections 2023-08-17T00:06:04.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.845+0000 7f597581b700 1 -- 172.21.15.153:0/2275634979 wait complete. 2023-08-17T00:06:04.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 Processor -- start 2023-08-17T00:06:04.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 -- start start 2023-08-17T00:06:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700656d0 0x7f59700aad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8b70 0x7f59701589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 0x7f5970149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5970158e90 con 0x7f59700a8f50 2023-08-17T00:06:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597014a1b0 con 0x7f59700656d0 2023-08-17T00:06:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.849+0000 7f597581b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59700ab3d0 con 0x7f59700a8b70 2023-08-17T00:06:04.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 0x7f5970149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 0x7f5970149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37332/0 (socket says 172.21.15.153:37332) 2023-08-17T00:06:04.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 -- 172.21.15.153:0/2087248323 learned_addr learned my addr 172.21.15.153:0/2087248323 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:04.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596e7fc700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8b70 0x7f59701589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596effd700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700656d0 0x7f59700aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 -- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8b70 msgr2=0x7f59701589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8b70 0x7f59701589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 -- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700656d0 msgr2=0x7f59700aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:04.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700656d0 0x7f59700aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:04.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 -- 172.21.15.153:0/2087248323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600092a0 con 0x7f59700a8f50 2023-08-17T00:06:04.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f596f7fe700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 0x7f5970149cc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f596800c790 tx=0x7f59680015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968005c70 con 0x7f59700a8f50 2023-08-17T00:06:04.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968005dd0 con 0x7f59700a8f50 2023-08-17T00:06:04.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968007320 con 0x7f59700a8f50 2023-08-17T00:06:04.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59700ab6b0 con 0x7f59700a8f50 2023-08-17T00:06:04.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59700abc70 con 0x7f59700a8f50 2023-08-17T00:06:04.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.853+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597006b530 con 0x7f59700a8f50 2023-08-17T00:06:04.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.857+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5968010030 con 0x7f59700a8f50 2023-08-17T00:06:04.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.857+0000 7f5956ffd700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f595c05a150 0x7f595c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:04.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.857+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5968073e60 con 0x7f59700a8f50 2023-08-17T00:06:04.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.857+0000 7f596effd700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f595c05a150 0x7f595c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:04.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.857+0000 7f596effd700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f595c05a150 0x7f595c05c610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f5960009fd0 tx=0x7f5960017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:04.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:04.865+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5968047910 con 0x7f59700a8f50 2023-08-17T00:06:05.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.020+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5970064bf0 con 0x7f595c05a150 2023-08-17T00:06:05.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.040+0000 7f5956ffd700 1 -- 172.21.15.153:0/2087248323 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+349388 (secure 0 0 0) 0x7f5970064bf0 con 0x7f595c05a150 2023-08-17T00:06:05.053 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:05.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f595c05a150 msgr2=0x7f595c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f595c05a150 0x7f595c05c610 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f5960009fd0 tx=0x7f5960017000).stop 2023-08-17T00:06:05.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 msgr2=0x7f5970149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 0x7f5970149cc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f596800c790 tx=0x7f59680015e0).stop 2023-08-17T00:06:05.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 shutdown_connections 2023-08-17T00:06:05.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f595c05a150 0x7f595c05c610 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59700a8f50 0x7f5970149cc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59700a8b70 0x7f59701589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 --2- 172.21.15.153:0/2087248323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59700656d0 0x7f59700aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 >> 172.21.15.153:0/2087248323 conn(0x7f59700c7150 msgr2=0x7f5970068790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 shutdown_connections 2023-08-17T00:06:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.048+0000 7f597581b700 1 -- 172.21.15.153:0/2087248323 wait complete. 2023-08-17T00:06:05.057 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:05.074 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2023-08-17T00:06:03.240118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450652,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752524068,"statfs":{"total":773094113280,"available":770584645632,"internally_reserved":0,"allocated":4354048,"data_stored":1870225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2589947,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1898,"num_read_kb":-2200,"num_write":-19456,"num_write_kb":-94719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-117,"num_bytes_recovered":-352,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.133806"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903876+0000","last_change":"2023-08-17T00:06:00.890861+0000","last_active":"2023-08-17T00:06:00.903876+0000","last_peered":"2023-08-17T00:06:00.903876+0000","last_clean":"2023-08-17T00:06:00.903876+0000","last_became_active":"2023-08-17T00:06:00.890539+0000","last_became_peered":"2023-08-17T00:06:00.890539+0000","last_unstale":"2023-08-17T00:06:00.903876+0000","last_undegraded":"2023-08-17T00:06:00.903876+0000","last_fullsized":"2023-08-17T00:06:00.903876+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875543+0000","last_change":"2023-08-17T00:06:00.452924+0000","last_active":"2023-08-17T00:06:00.875543+0000","last_peered":"2023-08-17T00:06:00.875543+0000","last_clean":"2023-08-17T00:06:00.875543+0000","last_became_active":"2023-08-17T00:06:00.452595+0000","last_became_peered":"2023-08-17T00:06:00.452595+0000","last_unstale":"2023-08-17T00:06:00.875543+0000","last_undegraded":"2023-08-17T00:06:00.875543+0000","last_fullsized":"2023-08-17T00:06:00.875543+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.904127+0000","last_change":"2023-08-17T00:06:00.896119+0000","last_active":"2023-08-17T00:06:00.904127+0000","last_peered":"2023-08-17T00:06:00.904127+0000","last_clean":"2023-08-17T00:06:00.904127+0000","last_became_active":"2023-08-17T00:06:00.895834+0000","last_became_peered":"2023-08-17T00:06:00.895834+0000","last_unstale":"2023-08-17T00:06:00.904127+0000","last_undegraded":"2023-08-17T00:06:00.904127+0000","last_fullsized":"2023-08-17T00:06:00.904127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.900623+0000","last_change":"2023-08-17T00:06:00.883149+0000","last_active":"2023-08-17T00:06:00.900623+0000","last_peered":"2023-08-17T00:06:00.900623+0000","last_clean":"2023-08-17T00:06:00.900623+0000","last_became_active":"2023-08-17T00:06:00.882250+0000","last_became_peered":"2023-08-17T00:06:00.882250+0000","last_unstale":"2023-08-17T00:06:00.900623+0000","last_undegraded":"2023-08-17T00:06:00.900623+0000","last_fullsized":"2023-08-17T00:06:00.900623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875195+0000","last_change":"2023-08-17T00:06:00.454628+0000","last_active":"2023-08-17T00:06:00.875195+0000","last_peered":"2023-08-17T00:06:00.875195+0000","last_clean":"2023-08-17T00:06:00.875195+0000","last_became_active":"2023-08-17T00:06:00.454328+0000","last_became_peered":"2023-08-17T00:06:00.454328+0000","last_unstale":"2023-08-17T00:06:00.875195+0000","last_undegraded":"2023-08-17T00:06:00.875195+0000","last_fullsized":"2023-08-17T00:06:00.875195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.904101+0000","last_change":"2023-08-17T00:06:00.895618+0000","last_active":"2023-08-17T00:06:00.904101+0000","last_peered":"2023-08-17T00:06:00.904101+0000","last_clean":"2023-08-17T00:06:00.904101+0000","last_became_active":"2023-08-17T00:06:00.894717+0000","last_became_peered":"2023-08-17T00:06:00.894717+0000","last_unstale":"2023-08-17T00:06:00.904101+0000","last_undegraded":"2023-08-17T00:06:00.904101+0000","last_fullsized":"2023-08-17T00:06:00.904101+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903990+0000","last_change":"2023-08-17T00:06:00.894302+0000","last_active":"2023-08-17T00:06:00.903990+0000","last_peered":"2023-08-17T00:06:00.903990+0000","last_clean":"2023-08-17T00:06:00.903990+0000","last_became_active":"2023-08-17T00:06:00.894011+0000","last_became_peered":"2023-08-17T00:06:00.894011+0000","last_unstale":"2023-08-17T00:06:00.903990+0000","last_undegraded":"2023-08-17T00:06:00.903990+0000","last_fullsized":"2023-08-17T00:06:00.903990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903725+0000","last_change":"2023-08-17T00:06:00.887835+0000","last_active":"2023-08-17T00:06:00.903725+0000","last_peered":"2023-08-17T00:06:00.903725+0000","last_clean":"2023-08-17T00:06:00.903725+0000","last_became_active":"2023-08-17T00:06:00.887509+0000","last_became_peered":"2023-08-17T00:06:00.887509+0000","last_unstale":"2023-08-17T00:06:00.903725+0000","last_undegraded":"2023-08-17T00:06:00.903725+0000","last_fullsized":"2023-08-17T00:06:00.903725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.900733+0000","last_change":"2023-08-17T00:06:00.884528+0000","last_active":"2023-08-17T00:06:00.900733+0000","last_peered":"2023-08-17T00:06:00.900733+0000","last_clean":"2023-08-17T00:06:00.900733+0000","last_became_active":"2023-08-17T00:06:00.884227+0000","last_became_peered":"2023-08-17T00:06:00.884227+0000","last_unstale":"2023-08-17T00:06:00.900733+0000","last_undegraded":"2023-08-17T00:06:00.900733+0000","last_fullsized":"2023-08-17T00:06:00.900733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901297+0000","last_change":"2023-08-17T00:06:00.885417+0000","last_active":"2023-08-17T00:06:00.901297+0000","last_peered":"2023-08-17T00:06:00.901297+0000","last_clean":"2023-08-17T00:06:00.901297+0000","last_became_active":"2023-08-17T00:06:00.885130+0000","last_became_peered":"2023-08-17T00:06:00.885130+0000","last_unstale":"2023-08-17T00:06:00.901297+0000","last_undegraded":"2023-08-17T00:06:00.901297+0000","last_fullsized":"2023-08-17T00:06:00.901297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873803+0000","last_change":"2023-08-17T00:06:00.454119+0000","last_active":"2023-08-17T00:06:00.873803+0000","last_peered":"2023-08-17T00:06:00.873803+0000","last_clean":"2023-08-17T00:06:00.873803+0000","last_became_active":"2023-08-17T00:06:00.453837+0000","last_became_peered":"2023-08-17T00:06:00.453837+0000","last_unstale":"2023-08-17T00:06:00.873803+0000","last_undegraded":"2023-08-17T00:06:00.873803+0000","last_fullsized":"2023-08-17T00:06:00.873803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875706+0000","last_change":"2023-08-17T00:06:00.452267+0000","last_active":"2023-08-17T00:06:00.875706+0000","last_peered":"2023-08-17T00:06:00.875706+0000","last_clean":"2023-08-17T00:06:00.875706+0000","last_became_active":"2023-08-17T00:06:00.451157+0000","last_became_peered":"2023-08-17T00:06:00.451157+0000","last_unstale":"2023-08-17T00:06:00.875706+0000","last_undegraded":"2023-08-17T00:06:00.875706+0000","last_fullsized":"2023-08-17T00:06:00.875706+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903773+0000","last_change":"2023-08-17T00:06:00.888863+0000","last_active":"2023-08-17T00:06:00.903773+0000","last_peered":"2023-08-17T00:06:00.903773+0000","last_clean":"2023-08-17T00:06:00.903773+0000","last_became_active":"2023-08-17T00:06:00.888528+0000","last_became_peered":"2023-08-17T00:06:00.888528+0000","last_unstale":"2023-08-17T00:06:00.903773+0000","last_undegraded":"2023-08-17T00:06:00.903773+0000","last_fullsized":"2023-08-17T00:06:00.903773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.872262+0000","last_change":"2023-08-17T00:06:00.463145+0000","last_active":"2023-08-17T00:06:00.872262+0000","last_peered":"2023-08-17T00:06:00.872262+0000","last_clean":"2023-08-17T00:06:00.872262+0000","last_became_active":"2023-08-17T00:06:00.462860+0000","last_became_peered":"2023-08-17T00:06:00.462860+0000","last_unstale":"2023-08-17T00:06:00.872262+0000","last_undegraded":"2023-08-17T00:06:00.872262+0000","last_fullsized":"2023-08-17T00:06:00.872262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873858+0000","last_change":"2023-08-17T00:06:00.454465+0000","last_active":"2023-08-17T00:06:00.873858+0000","last_peered":"2023-08-17T00:06:00.873858+0000","last_clean":"2023-08-17T00:06:00.873858+0000","last_became_active":"2023-08-17T00:06:00.454185+0000","last_became_peered":"2023-08-17T00:06:00.454185+0000","last_unstale":"2023-08-17T00:06:00.873858+0000","last_undegraded":"2023-08-17T00:06:00.873858+0000","last_fullsized":"2023-08-17T00:06:00.873858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.602539+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:05:55.602539+0000","last_peered":"2023-08-17T00:05:55.602539+0000","last_clean":"2023-08-17T00:05:55.602539+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:05:55.602539+0000","last_undegraded":"2023-08-17T00:05:55.602539+0000","last_fullsized":"2023-08-17T00:05:55.602539+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875629+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:00.875629+0000","last_peered":"2023-08-17T00:06:00.875629+0000","last_clean":"2023-08-17T00:06:00.875629+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:00.875629+0000","last_undegraded":"2023-08-17T00:06:00.875629+0000","last_fullsized":"2023-08-17T00:06:00.875629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.602500+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:05:55.602500+0000","last_peered":"2023-08-17T00:05:55.602500+0000","last_clean":"2023-08-17T00:05:55.602500+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:05:55.602500+0000","last_undegraded":"2023-08-17T00:05:55.602500+0000","last_fullsized":"2023-08-17T00:05:55.602500+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.502056+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:05:55.502056+0000","last_peered":"2023-08-17T00:05:55.502056+0000","last_clean":"2023-08-17T00:05:55.502056+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:05:55.502056+0000","last_undegraded":"2023-08-17T00:05:55.502056+0000","last_fullsized":"2023-08-17T00:05:55.502056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.602468+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:05:55.602468+0000","last_peered":"2023-08-17T00:05:55.602468+0000","last_clean":"2023-08-17T00:05:55.602468+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:05:55.602468+0000","last_undegraded":"2023-08-17T00:05:55.602468+0000","last_fullsized":"2023-08-17T00:05:55.602468+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901533+0000","last_change":"2023-08-17T00:06:00.886705+0000","last_active":"2023-08-17T00:06:00.901533+0000","last_peered":"2023-08-17T00:06:00.901533+0000","last_clean":"2023-08-17T00:06:00.901533+0000","last_became_active":"2023-08-17T00:06:00.886424+0000","last_became_peered":"2023-08-17T00:06:00.886424+0000","last_unstale":"2023-08-17T00:06:00.901533+0000","last_undegraded":"2023-08-17T00:06:00.901533+0000","last_fullsized":"2023-08-17T00:06:00.901533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875074+0000","last_change":"2023-08-17T00:06:00.452582+0000","last_active":"2023-08-17T00:06:00.875074+0000","last_peered":"2023-08-17T00:06:00.875074+0000","last_clean":"2023-08-17T00:06:00.875074+0000","last_became_active":"2023-08-17T00:06:00.452169+0000","last_became_peered":"2023-08-17T00:06:00.452169+0000","last_unstale":"2023-08-17T00:06:00.875074+0000","last_undegraded":"2023-08-17T00:06:00.875074+0000","last_fullsized":"2023-08-17T00:06:00.875074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.598219+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:05:55.598219+0000","last_peered":"2023-08-17T00:05:55.598219+0000","last_clean":"2023-08-17T00:05:55.598219+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:05:55.598219+0000","last_undegraded":"2023-08-17T00:05:55.598219+0000","last_fullsized":"2023-08-17T00:05:55.598219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.602469+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:05:55.602469+0000","last_peered":"2023-08-17T00:05:55.602469+0000","last_clean":"2023-08-17T00:05:55.602469+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:05:55.602469+0000","last_undegraded":"2023-08-17T00:05:55.602469+0000","last_fullsized":"2023-08-17T00:05:55.602469+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:00.418153+0000","last_change":"2023-08-17T00:06:00.418153+0000","last_active":"2023-08-17T00:06:00.418153+0000","last_peered":"2023-08-17T00:06:00.418153+0000","last_clean":"2023-08-17T00:06:00.418153+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:00.418153+0000","last_undegraded":"2023-08-17T00:06:00.418153+0000","last_fullsized":"2023-08-17T00:06:00.418153+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:05:59.403077+0000","last_change":"2023-08-17T00:05:59.403077+0000","last_active":"2023-08-17T00:05:59.403077+0000","last_peered":"2023-08-17T00:05:59.403077+0000","last_clean":"2023-08-17T00:05:59.403077+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:05:59.403077+0000","last_undegraded":"2023-08-17T00:05:59.403077+0000","last_fullsized":"2023-08-17T00:05:59.403077+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.602460+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:05:55.602460+0000","last_peered":"2023-08-17T00:05:55.602460+0000","last_clean":"2023-08-17T00:05:55.602460+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:05:55.602460+0000","last_undegraded":"2023-08-17T00:05:55.602460+0000","last_fullsized":"2023-08-17T00:05:55.602460+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":31,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-17T00:05:55.599592+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:05:55.599592+0000","last_peered":"2023-08-17T00:05:55.599592+0000","last_clean":"2023-08-17T00:05:55.599592+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:05:55.599592+0000","last_undegraded":"2023-08-17T00:05:55.599592+0000","last_fullsized":"2023-08-17T00:05:55.599592+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305812,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94066028,"statfs":{"total":96636764160,"available":96323612672,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.306,"15min":1.4350000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.909,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.371},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.337,"15min":1.4890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4710000000000001,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":1.131}]},{"osd":1,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.353,"15min":1.5009999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.345,"15min":1.4890000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4299999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.3959999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.236,"15min":1.3460000000000001},"min":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3400000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.395,"15min":1.5149999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8120000000000001,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.321}]},{"osd":3,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2849999999999999,"15min":1.373},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.357,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.198},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.6220000000000001,"15min":1.788},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.958,"5min":13.074999999999999,"15min":13.074999999999999},"last":1.4239999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.5720000000000001,"15min":1.778},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6419999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.4870000000000001,"15min":1.6259999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4470000000000001,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.716,"15min":1.9199999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.012,"5min":14.435,"15min":14.435},"last":1.03},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.6699999999999999,"15min":1.8520000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6779999999999999,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.286}]},{"osd":6,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.6890000000000001,"15min":1.8540000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.7649999999999999,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.546},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.6140000000000001,"15min":1.754},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.706,"5min":11.365,"15min":11.365},"last":1.522}]}]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309908,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061932,"statfs":{"total":96636764160,"available":96319418368,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0389999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.6509999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.2589999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.089,"15min":1.077},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.99399999999999999,"15min":0.97199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.2559999999999998,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":1.202},{"interface":"front","average":{"1min":1.284,"5min":1.2290000000000001,"15min":1.244},"min":{"1min":0.873,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.4359999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.145,"15min":1.137},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.304,"15min":1.276},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.4409999999999998,"5min":5.29,"15min":5.29},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2410000000000001,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.337}]},{"osd":5,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2989999999999999,"15min":1.27},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.3599999999999999,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.361}]},{"osd":7,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3009999999999999,"15min":1.2989999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":4.6429999999999998},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4570000000000001,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.8999999999999999,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.3899999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305812,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94066028,"statfs":{"total":96636764160,"available":96323612672,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.468,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2410000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":1.208},{"interface":"front","average":{"1min":1.083,"5min":1.6379999999999999,"15min":1.9119999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4670000000000001,"5min":16.838999999999999,"15min":16.838999999999999},"last":1.169}]},{"osd":1,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2110000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.494,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.101},{"interface":"front","average":{"1min":1.079,"5min":1.4159999999999999,"15min":1.5760000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.462,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":1.5}]},{"osd":2,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.6619999999999999,"15min":1.9179999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4179999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.516,"15min":1.7},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.367,"5min":11.949,"15min":11.949},"last":0.995}]},{"osd":3,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.5649999999999999,"15min":1.754},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.575,"5min":13.125,"15min":13.125},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.4630000000000001,"15min":1.6060000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.2569999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.734,"15min":1.98},"min":{"1min":0.877,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.591,"5min":17.510000000000002,"15min":17.510000000000002},"last":1.429},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.8819999999999999,"15min":2.1680000000000001},"min":{"1min":0.92500000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.292}]},{"osd":6,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.8280000000000001,"15min":2.0899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.7350000000000001,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.825,"15min":2.0840000000000001},"min":{"1min":0.79400000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":17.050000000000001,"15min":17.050000000000001},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.966,"15min":2.2250000000000001},"min":{"1min":1.0089999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.2599999999999998,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.405},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.861,"15min":2.0710000000000002},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8120000000000001,"5min":14.818,"15min":14.818},"last":1.3720000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305812,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94066028,"statfs":{"total":96636764160,"available":96323612672,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2909999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82599999999999996,"15min":0.85599999999999998},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.173,"5min":1.224,"15min":1.224},"last":0.998}]},{"osd":1,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.81200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.282,"5min":1.357,"15min":1.357},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.498,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89300000000000002,"15min":0.93200000000000005},"min":{"1min":0.48599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.089,"5min":1.0369999999999999,"15min":1.0600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0429999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.206,"15min":1.236},"min":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":3.9449999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.26},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.234,"15min":1.2529999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.9790000000000001,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.393}]},{"osd":5,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2709999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.286}]},{"osd":6,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.3140000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.238},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.206,"15min":1.2430000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":1.343}]},{"osd":7,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2310000000000001,"15min":1.2889999999999999},"min":{"1min":0.76800000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.488,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.151,"5min":1.2490000000000001,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5249999999999999,"5min":1.756,"15min":1.756},"last":1.2130000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309908,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061932,"statfs":{"total":96636764160,"available":96319418368,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.91600000000000004},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1439999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.827,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2549999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0840000000000001,"15min":1.149},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9159999999999999,"5min":3.911,"15min":3.911},"last":1.0389999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.3080000000000001},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9530000000000001,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.115},{"interface":"front","average":{"1min":1.032,"5min":1.03,"15min":1.0800000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.2530000000000001,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.80300000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.7290000000000001,"15min":2.04},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6739999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":1.056},{"interface":"front","average":{"1min":1.23,"5min":1.5509999999999999,"15min":1.7330000000000001},"min":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.0649999999999999,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.421}]},{"osd":5,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.681,"15min":1.889},"min":{"1min":0.748,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1440000000000001,"5min":12.914,"15min":12.914},"last":1.621},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4910000000000001,"15min":1.645},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.3460000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.6419999999999999,"15min":1.861},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7689999999999999,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.456},{"interface":"front","average":{"1min":1.276,"5min":1.6830000000000001,"15min":1.899},"min":{"1min":0.86199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.2210000000000001,"5min":12.698,"15min":12.698},"last":1.532}]},{"osd":7,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.6479999999999999,"15min":1.8240000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.72,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.651,"15min":1.8340000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.956,"5min":11.417,"15min":11.417},"last":1.5629999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.496,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2110000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.878,"5min":0.97599999999999998,"15min":0.92200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4359999999999999,"5min":13.093,"15min":13.093},"last":1.1699999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.91500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1639999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.353,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":1.204},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.054,"15min":1.0289999999999999},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.234,"5min":12.981999999999999,"15min":12.981999999999999},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2969999999999999,"15min":1.2},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.222,"5min":20.548999999999999,"15min":20.548999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.272,"15min":1.258},"min":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.492,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.3560000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.4239999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.4810000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.329},{"interface":"front","average":{"1min":1.194,"5min":1.294,"15min":1.3069999999999999},"min":{"1min":0.82599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.446,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.2509999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3400000000000001,"15min":1.302},"min":{"1min":0.84599999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.4830000000000001,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.24,"15min":1.2350000000000001},"min":{"1min":0.77900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4490000000000001,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.3049999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5580000000000001,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.4359999999999999,"15min":1.4199999999999999},"min":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.492,"5min":13.131,"15min":13.131},"last":1.2310000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305812,"kb_used_data":524,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94066028,"statfs":{"total":96636764160,"available":96323612672,"internally_reserved":0,"allocated":536576,"data_stored":230347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.78900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3120000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.236,"5min":1.423,"15min":1.423},"last":0.93600000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0900000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.88900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":1.0529999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85199999999999998,"15min":0.875},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0069999999999999,"15min":1.0489999999999999},"min":{"1min":0.52100000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.194,"5min":1.611,"15min":1.611},"last":0.90900000000000003}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.135},"min":{"1min":0.747,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.431,"5min":1.619,"15min":1.619},"last":1.105},{"interface":"front","average":{"1min":1.153,"5min":1.194,"15min":1.212},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3740000000000001,"5min":1.905,"15min":1.905},"last":1.036}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2370000000000001,"15min":1.2989999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.139},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.266,"15min":1.3220000000000001},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4750000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2769999999999999,"15min":1.3200000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5669999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.242,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.4950000000000001,"5min":1.72,"15min":1.72},"last":1.444}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.256,"15min":1.2989999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5029999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.395},{"interface":"front","average":{"1min":1.198,"5min":1.24,"15min":1.2909999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.524,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.415}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065968,"statfs":{"total":96636764160,"available":96323551232,"internally_reserved":0,"allocated":598016,"data_stored":257796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.0249999999999999,"15min":1.091},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.292,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.012,"15min":1.071},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1639999999999999,"15min":1.1990000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.226,"15min":1.2749999999999999},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.0509999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.117,"15min":1.161},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.581,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.204},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.129,"15min":1.194},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.335,"5min":1.617,"15min":1.617},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.1080000000000001,"15min":1.1659999999999999},"min":{"1min":0.79600000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1930000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.238},{"interface":"front","average":{"1min":1.101,"5min":1.218,"15min":1.2729999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4870000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1970000000000001,"15min":1.2310000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4390000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.23,"15min":1.29},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3480000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.306,"15min":1.3740000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6240000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.294},{"interface":"front","average":{"1min":1.169,"5min":1.391,"15min":1.47},"min":{"1min":0.82099999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4490000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.226}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.282,"15min":1.347},"min":{"1min":0.873,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.403,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3779999999999999,"15min":1.45},"min":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5289999999999999,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:05.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:05.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.264+0000 7f4929d07700 1 Processor -- start 2023-08-17T00:06:05.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.264+0000 7f4929d07700 1 -- start start 2023-08-17T00:06:05.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929d07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4924153910 0x7f4924153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 0x7f49240a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a8280 0x7f49240a86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929d07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4924094e70 con 0x7f49240a5400 2023-08-17T00:06:05.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929d07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4924095110 con 0x7f4924153910 2023-08-17T00:06:05.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240a7840 con 0x7f49240a8280 2023-08-17T00:06:05.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4923fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 0x7f49240a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4923fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 0x7f49240a6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43480/0 (socket says 172.21.15.153:43480) 2023-08-17T00:06:05.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4928d05700 1 --2- 172.21.15.153:0/1111376979 >> v2:172.21.15.178:3300/0 conn(0x7f4924153910 0x7f4924153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4923fff700 1 -- 172.21.15.153:0/1111376979 learned_addr learned my addr 172.21.15.153:0/1111376979 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4929506700 1 --2- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a8280 0x7f49240a86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4928d05700 1 -- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a8280 msgr2=0x7f49240a86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4928d05700 1 --2- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a8280 0x7f49240a86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4928d05700 1 -- 172.21.15.153:0/1111376979 >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 msgr2=0x7f49240a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4928d05700 1 --2- 172.21.15.153:0/1111376979 >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 0x7f49240a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4928d05700 1 -- 172.21.15.153:0/1111376979 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49240a7b20 con 0x7f4924153910 2023-08-17T00:06:05.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.268+0000 7f4923fff700 1 --2- 172.21.15.153:0/1111376979 >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 0x7f49240a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:05.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4928d05700 1 --2- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4924153910 0x7f4924153cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f492406bba0 tx=0x7f4918006f40).ready entity=mon.1 client_cookie=3789d0369362cf85 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f49237fe700 1 -- 172.21.15.153:0/1111376979 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918005880 con 0x7f4924153910 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f49237fe700 1 -- 172.21.15.153:0/1111376979 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49180059e0 con 0x7f4924153910 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f49237fe700 1 -- 172.21.15.153:0/1111376979 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918005d60 con 0x7f4924153910 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 -- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4924153910 msgr2=0x7f4924153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 --2- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4924153910 0x7f4924153cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f492406bba0 tx=0x7f4918006f40).stop 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 -- 172.21.15.153:0/1111376979 shutdown_connections 2023-08-17T00:06:05.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 --2- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a8280 0x7f49240a86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 --2- 172.21.15.153:0/1111376979 >> v2:172.21.15.153:3300/0 conn(0x7f49240a5400 0x7f49240a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 --2- 172.21.15.153:0/1111376979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4924153910 0x7f4924153cf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 -- 172.21.15.153:0/1111376979 >> 172.21.15.153:0/1111376979 conn(0x7f49240c5170 msgr2=0x7f49240c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:05.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 -- 172.21.15.153:0/1111376979 shutdown_connections 2023-08-17T00:06:05.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.272+0000 7f4929d07700 1 -- 172.21.15.153:0/1111376979 wait complete. 2023-08-17T00:06:05.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 Processor -- start 2023-08-17T00:06:05.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 -- start start 2023-08-17T00:06:05.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a5400 0x7f4924167620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49240a8280 0x7f4924167b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 0x7f49240c1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492414c7b0 con 0x7f4924153910 2023-08-17T00:06:05.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49240adf50 con 0x7f49240a8280 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49240c00c0 con 0x7f49240a5400 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 0x7f49240c1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 0x7f49240c1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43488/0 (socket says 172.21.15.153:43488) 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4929506700 1 -- 172.21.15.153:0/1019128074 learned_addr learned my addr 172.21.15.153:0/1019128074 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4928d05700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a5400 0x7f4924167620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.276+0000 7f4923fff700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49240a8280 0x7f4924167b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929506700 1 -- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a5400 msgr2=0x7f4924167620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929506700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a5400 0x7f4924167620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929506700 1 -- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49240a8280 msgr2=0x7f4924167b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929506700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49240a8280 0x7f4924167b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929506700 1 -- 172.21.15.153:0/1019128074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4910009370 con 0x7f4924153910 2023-08-17T00:06:05.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929506700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 0x7f49240c1f70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f491c009ec0 tx=0x7f491c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:05.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00cb70 con 0x7f4924153910 2023-08-17T00:06:05.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f491c00f040 con 0x7f4924153910 2023-08-17T00:06:05.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4918009250 con 0x7f4924153910 2023-08-17T00:06:05.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00cee0 con 0x7f4924153910 2023-08-17T00:06:05.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49240add20 con 0x7f4924153910 2023-08-17T00:06:05.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.280+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4924095e40 con 0x7f4924153910 2023-08-17T00:06:05.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.284+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f491c013610 con 0x7f4924153910 2023-08-17T00:06:05.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.284+0000 7f4920ff9700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f490805a180 0x7f490805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.284+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f491c074af0 con 0x7f4924153910 2023-08-17T00:06:05.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.284+0000 7f4928d05700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f490805a180 0x7f490805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.284+0000 7f4928d05700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f490805a180 0x7f490805c640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4918006f80 tx=0x7f4918015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:05.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.292+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4924095e40 con 0x7f4924153910 2023-08-17T00:06:05.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.444+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4924095e40 con 0x7f490805a180 2023-08-17T00:06:05.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.464+0000 7f4920ff9700 1 -- 172.21.15.153:0/1019128074 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359072 (secure 0 0 0) 0x7f4924095e40 con 0x7f490805a180 2023-08-17T00:06:05.474 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f490805a180 msgr2=0x7f490805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f490805a180 0x7f490805c640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f4918006f80 tx=0x7f4918015000).stop 2023-08-17T00:06:05.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 msgr2=0x7f49240c1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 0x7f49240c1f70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f491c009ec0 tx=0x7f491c00b040).stop 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 shutdown_connections 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f490805a180 0x7f490805c640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4924153910 0x7f49240c1f70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49240a8280 0x7f4924167b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 --2- 172.21.15.153:0/1019128074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49240a5400 0x7f4924167620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 >> 172.21.15.153:0/1019128074 conn(0x7f49240c5170 msgr2=0x7f49240c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 shutdown_connections 2023-08-17T00:06:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.472+0000 7f4929d07700 1 -- 172.21.15.153:0/1019128074 wait complete. 2023-08-17T00:06:05.478 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:05.497 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2023-08-17T00:06:05.240793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":262,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2451040,"kb_used_data":4640,"kb_used_omap":0,"kb_used_meta":2446336,"kb_avail":752523680,"statfs":{"total":773094113280,"available":770584248320,"internally_reserved":0,"allocated":4751360,"data_stored":2061652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2505048064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2589947,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1898,"num_read_kb":-2200,"num_write":-19456,"num_write_kb":-94719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-117,"num_bytes_recovered":-352,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.133806"},"pg_stats":[{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906080+0000","last_change":"2023-08-17T00:06:00.898917+0000","last_active":"2023-08-17T00:06:00.906080+0000","last_peered":"2023-08-17T00:06:00.906080+0000","last_clean":"2023-08-17T00:06:00.906080+0000","last_became_active":"2023-08-17T00:06:00.898651+0000","last_became_peered":"2023-08-17T00:06:00.898651+0000","last_unstale":"2023-08-17T00:06:00.906080+0000","last_undegraded":"2023-08-17T00:06:00.906080+0000","last_fullsized":"2023-08-17T00:06:00.906080+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3f","version":"49'3","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.904396+0000","last_change":"2023-08-17T00:06:00.460562+0000","last_active":"2023-08-17T00:06:00.904396+0000","last_peered":"2023-08-17T00:06:00.904396+0000","last_clean":"2023-08-17T00:06:00.904396+0000","last_became_active":"2023-08-17T00:06:00.459953+0000","last_became_peered":"2023-08-17T00:06:00.459953+0000","last_unstale":"2023-08-17T00:06:00.904396+0000","last_undegraded":"2023-08-17T00:06:00.904396+0000","last_fullsized":"2023-08-17T00:06:00.904396+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.907593+0000","last_change":"2023-08-17T00:06:00.904547+0000","last_active":"2023-08-17T00:06:00.907593+0000","last_peered":"2023-08-17T00:06:00.907593+0000","last_clean":"2023-08-17T00:06:00.907593+0000","last_became_active":"2023-08-17T00:06:00.904288+0000","last_became_peered":"2023-08-17T00:06:00.904288+0000","last_unstale":"2023-08-17T00:06:00.907593+0000","last_undegraded":"2023-08-17T00:06:00.907593+0000","last_fullsized":"2023-08-17T00:06:00.907593+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.878817+0000","last_change":"2023-08-17T00:06:00.463849+0000","last_active":"2023-08-17T00:06:00.878817+0000","last_peered":"2023-08-17T00:06:00.878817+0000","last_clean":"2023-08-17T00:06:00.878817+0000","last_became_active":"2023-08-17T00:06:00.463590+0000","last_became_peered":"2023-08-17T00:06:00.463590+0000","last_unstale":"2023-08-17T00:06:00.878817+0000","last_undegraded":"2023-08-17T00:06:00.878817+0000","last_fullsized":"2023-08-17T00:06:00.878817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906475+0000","last_change":"2023-08-17T00:06:00.905434+0000","last_active":"2023-08-17T00:06:00.906475+0000","last_peered":"2023-08-17T00:06:00.906475+0000","last_clean":"2023-08-17T00:06:00.906475+0000","last_became_active":"2023-08-17T00:06:00.904825+0000","last_became_peered":"2023-08-17T00:06:00.904825+0000","last_unstale":"2023-08-17T00:06:00.906475+0000","last_undegraded":"2023-08-17T00:06:00.906475+0000","last_fullsized":"2023-08-17T00:06:00.906475+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.882756+0000","last_change":"2023-08-17T00:06:00.459567+0000","last_active":"2023-08-17T00:06:00.882756+0000","last_peered":"2023-08-17T00:06:00.882756+0000","last_clean":"2023-08-17T00:06:00.882756+0000","last_became_active":"2023-08-17T00:06:00.458649+0000","last_became_peered":"2023-08-17T00:06:00.458649+0000","last_unstale":"2023-08-17T00:06:00.882756+0000","last_undegraded":"2023-08-17T00:06:00.882756+0000","last_fullsized":"2023-08-17T00:06:00.882756+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906260+0000","last_change":"2023-08-17T00:06:00.904385+0000","last_active":"2023-08-17T00:06:00.906260+0000","last_peered":"2023-08-17T00:06:00.906260+0000","last_clean":"2023-08-17T00:06:00.906260+0000","last_became_active":"2023-08-17T00:06:00.903399+0000","last_became_peered":"2023-08-17T00:06:00.903399+0000","last_unstale":"2023-08-17T00:06:00.906260+0000","last_undegraded":"2023-08-17T00:06:00.906260+0000","last_fullsized":"2023-08-17T00:06:00.906260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3c","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.894430+0000","last_change":"2023-08-17T00:06:00.453730+0000","last_active":"2023-08-17T00:06:00.894430+0000","last_peered":"2023-08-17T00:06:00.894430+0000","last_clean":"2023-08-17T00:06:00.894430+0000","last_became_active":"2023-08-17T00:06:00.453464+0000","last_became_peered":"2023-08-17T00:06:00.453464+0000","last_unstale":"2023-08-17T00:06:00.894430+0000","last_undegraded":"2023-08-17T00:06:00.894430+0000","last_fullsized":"2023-08-17T00:06:00.894430+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906211+0000","last_change":"2023-08-17T00:06:00.902821+0000","last_active":"2023-08-17T00:06:00.906211+0000","last_peered":"2023-08-17T00:06:00.906211+0000","last_clean":"2023-08-17T00:06:00.906211+0000","last_became_active":"2023-08-17T00:06:00.902504+0000","last_became_peered":"2023-08-17T00:06:00.902504+0000","last_unstale":"2023-08-17T00:06:00.906211+0000","last_undegraded":"2023-08-17T00:06:00.906211+0000","last_fullsized":"2023-08-17T00:06:00.906211+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903237+0000","last_change":"2023-08-17T00:06:00.455461+0000","last_active":"2023-08-17T00:06:00.903237+0000","last_peered":"2023-08-17T00:06:00.903237+0000","last_clean":"2023-08-17T00:06:00.903237+0000","last_became_active":"2023-08-17T00:06:00.455004+0000","last_became_peered":"2023-08-17T00:06:00.455004+0000","last_unstale":"2023-08-17T00:06:00.903237+0000","last_undegraded":"2023-08-17T00:06:00.903237+0000","last_fullsized":"2023-08-17T00:06:00.903237+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901763+0000","last_change":"2023-08-17T00:06:00.897878+0000","last_active":"2023-08-17T00:06:00.901763+0000","last_peered":"2023-08-17T00:06:00.901763+0000","last_clean":"2023-08-17T00:06:00.901763+0000","last_became_active":"2023-08-17T00:06:00.897579+0000","last_became_peered":"2023-08-17T00:06:00.897579+0000","last_unstale":"2023-08-17T00:06:00.901763+0000","last_undegraded":"2023-08-17T00:06:00.901763+0000","last_fullsized":"2023-08-17T00:06:00.901763+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3a","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.895244+0000","last_change":"2023-08-17T00:06:00.464202+0000","last_active":"2023-08-17T00:06:00.895244+0000","last_peered":"2023-08-17T00:06:00.895244+0000","last_clean":"2023-08-17T00:06:00.895244+0000","last_became_active":"2023-08-17T00:06:00.463914+0000","last_became_peered":"2023-08-17T00:06:00.463914+0000","last_unstale":"2023-08-17T00:06:00.895244+0000","last_undegraded":"2023-08-17T00:06:00.895244+0000","last_fullsized":"2023-08-17T00:06:00.895244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.893590+0000","last_change":"2023-08-17T00:06:00.891389+0000","last_active":"2023-08-17T00:06:00.893590+0000","last_peered":"2023-08-17T00:06:00.893590+0000","last_clean":"2023-08-17T00:06:00.893590+0000","last_became_active":"2023-08-17T00:06:00.890840+0000","last_became_peered":"2023-08-17T00:06:00.890840+0000","last_unstale":"2023-08-17T00:06:00.893590+0000","last_undegraded":"2023-08-17T00:06:00.893590+0000","last_fullsized":"2023-08-17T00:06:00.893590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.882134+0000","last_change":"2023-08-17T00:06:00.462068+0000","last_active":"2023-08-17T00:06:00.882134+0000","last_peered":"2023-08-17T00:06:00.882134+0000","last_clean":"2023-08-17T00:06:00.882134+0000","last_became_active":"2023-08-17T00:06:00.461774+0000","last_became_peered":"2023-08-17T00:06:00.461774+0000","last_unstale":"2023-08-17T00:06:00.882134+0000","last_undegraded":"2023-08-17T00:06:00.882134+0000","last_fullsized":"2023-08-17T00:06:00.882134+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903876+0000","last_change":"2023-08-17T00:06:00.890861+0000","last_active":"2023-08-17T00:06:00.903876+0000","last_peered":"2023-08-17T00:06:00.903876+0000","last_clean":"2023-08-17T00:06:00.903876+0000","last_became_active":"2023-08-17T00:06:00.890539+0000","last_became_peered":"2023-08-17T00:06:00.890539+0000","last_unstale":"2023-08-17T00:06:00.903876+0000","last_undegraded":"2023-08-17T00:06:00.903876+0000","last_fullsized":"2023-08-17T00:06:00.903876+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873377+0000","last_change":"2023-08-17T00:06:00.445101+0000","last_active":"2023-08-17T00:06:00.873377+0000","last_peered":"2023-08-17T00:06:00.873377+0000","last_clean":"2023-08-17T00:06:00.873377+0000","last_became_active":"2023-08-17T00:06:00.444767+0000","last_became_peered":"2023-08-17T00:06:00.444767+0000","last_unstale":"2023-08-17T00:06:00.873377+0000","last_undegraded":"2023-08-17T00:06:00.873377+0000","last_fullsized":"2023-08-17T00:06:00.873377+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.905280+0000","last_change":"2023-08-17T00:06:00.896143+0000","last_active":"2023-08-17T00:06:00.905280+0000","last_peered":"2023-08-17T00:06:00.905280+0000","last_clean":"2023-08-17T00:06:00.905280+0000","last_became_active":"2023-08-17T00:06:00.895885+0000","last_became_peered":"2023-08-17T00:06:00.895885+0000","last_unstale":"2023-08-17T00:06:00.905280+0000","last_undegraded":"2023-08-17T00:06:00.905280+0000","last_fullsized":"2023-08-17T00:06:00.905280+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.886833+0000","last_change":"2023-08-17T00:06:00.465074+0000","last_active":"2023-08-17T00:06:00.886833+0000","last_peered":"2023-08-17T00:06:00.886833+0000","last_clean":"2023-08-17T00:06:00.886833+0000","last_became_active":"2023-08-17T00:06:00.464818+0000","last_became_peered":"2023-08-17T00:06:00.464818+0000","last_unstale":"2023-08-17T00:06:00.886833+0000","last_undegraded":"2023-08-17T00:06:00.886833+0000","last_fullsized":"2023-08-17T00:06:00.886833+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.898713+0000","last_change":"2023-08-17T00:06:00.897204+0000","last_active":"2023-08-17T00:06:00.898713+0000","last_peered":"2023-08-17T00:06:00.898713+0000","last_clean":"2023-08-17T00:06:00.898713+0000","last_became_active":"2023-08-17T00:06:00.896836+0000","last_became_peered":"2023-08-17T00:06:00.896836+0000","last_unstale":"2023-08-17T00:06:00.898713+0000","last_undegraded":"2023-08-17T00:06:00.898713+0000","last_fullsized":"2023-08-17T00:06:00.898713+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875543+0000","last_change":"2023-08-17T00:06:00.452924+0000","last_active":"2023-08-17T00:06:00.875543+0000","last_peered":"2023-08-17T00:06:00.875543+0000","last_clean":"2023-08-17T00:06:00.875543+0000","last_became_active":"2023-08-17T00:06:00.452595+0000","last_became_peered":"2023-08-17T00:06:00.452595+0000","last_unstale":"2023-08-17T00:06:00.875543+0000","last_undegraded":"2023-08-17T00:06:00.875543+0000","last_fullsized":"2023-08-17T00:06:00.875543+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906070+0000","last_change":"2023-08-17T00:06:00.901003+0000","last_active":"2023-08-17T00:06:00.906070+0000","last_peered":"2023-08-17T00:06:00.906070+0000","last_clean":"2023-08-17T00:06:00.906070+0000","last_became_active":"2023-08-17T00:06:00.900742+0000","last_became_peered":"2023-08-17T00:06:00.900742+0000","last_unstale":"2023-08-17T00:06:00.906070+0000","last_undegraded":"2023-08-17T00:06:00.906070+0000","last_fullsized":"2023-08-17T00:06:00.906070+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873990+0000","last_change":"2023-08-17T00:06:00.454609+0000","last_active":"2023-08-17T00:06:00.873990+0000","last_peered":"2023-08-17T00:06:00.873990+0000","last_clean":"2023-08-17T00:06:00.873990+0000","last_became_active":"2023-08-17T00:06:00.454330+0000","last_became_peered":"2023-08-17T00:06:00.454330+0000","last_unstale":"2023-08-17T00:06:00.873990+0000","last_undegraded":"2023-08-17T00:06:00.873990+0000","last_fullsized":"2023-08-17T00:06:00.873990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.910536+0000","last_change":"2023-08-17T00:06:00.900458+0000","last_active":"2023-08-17T00:06:00.910536+0000","last_peered":"2023-08-17T00:06:00.910536+0000","last_clean":"2023-08-17T00:06:00.910536+0000","last_became_active":"2023-08-17T00:06:00.900176+0000","last_became_peered":"2023-08-17T00:06:00.900176+0000","last_unstale":"2023-08-17T00:06:00.910536+0000","last_undegraded":"2023-08-17T00:06:00.910536+0000","last_fullsized":"2023-08-17T00:06:00.910536+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.34","version":"49'4","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.910992+0000","last_change":"2023-08-17T00:06:00.458612+0000","last_active":"2023-08-17T00:06:00.910992+0000","last_peered":"2023-08-17T00:06:00.910992+0000","last_clean":"2023-08-17T00:06:00.910992+0000","last_became_active":"2023-08-17T00:06:00.458346+0000","last_became_peered":"2023-08-17T00:06:00.458346+0000","last_unstale":"2023-08-17T00:06:00.910992+0000","last_undegraded":"2023-08-17T00:06:00.910992+0000","last_fullsized":"2023-08-17T00:06:00.910992+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.898190+0000","last_change":"2023-08-17T00:06:00.889814+0000","last_active":"2023-08-17T00:06:00.898190+0000","last_peered":"2023-08-17T00:06:00.898190+0000","last_clean":"2023-08-17T00:06:00.898190+0000","last_became_active":"2023-08-17T00:06:00.889519+0000","last_became_peered":"2023-08-17T00:06:00.889519+0000","last_unstale":"2023-08-17T00:06:00.898190+0000","last_undegraded":"2023-08-17T00:06:00.898190+0000","last_fullsized":"2023-08-17T00:06:00.898190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.33","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.895898+0000","last_change":"2023-08-17T00:06:00.464106+0000","last_active":"2023-08-17T00:06:00.895898+0000","last_peered":"2023-08-17T00:06:00.895898+0000","last_clean":"2023-08-17T00:06:00.895898+0000","last_became_active":"2023-08-17T00:06:00.463805+0000","last_became_peered":"2023-08-17T00:06:00.463805+0000","last_unstale":"2023-08-17T00:06:00.895898+0000","last_undegraded":"2023-08-17T00:06:00.895898+0000","last_fullsized":"2023-08-17T00:06:00.895898+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.904127+0000","last_change":"2023-08-17T00:06:00.896119+0000","last_active":"2023-08-17T00:06:00.904127+0000","last_peered":"2023-08-17T00:06:00.904127+0000","last_clean":"2023-08-17T00:06:00.904127+0000","last_became_active":"2023-08-17T00:06:00.895834+0000","last_became_peered":"2023-08-17T00:06:00.895834+0000","last_unstale":"2023-08-17T00:06:00.904127+0000","last_undegraded":"2023-08-17T00:06:00.904127+0000","last_fullsized":"2023-08-17T00:06:00.904127+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873370+0000","last_change":"2023-08-17T00:06:00.456757+0000","last_active":"2023-08-17T00:06:00.873370+0000","last_peered":"2023-08-17T00:06:00.873370+0000","last_clean":"2023-08-17T00:06:00.873370+0000","last_became_active":"2023-08-17T00:06:00.456490+0000","last_became_peered":"2023-08-17T00:06:00.456490+0000","last_unstale":"2023-08-17T00:06:00.873370+0000","last_undegraded":"2023-08-17T00:06:00.873370+0000","last_fullsized":"2023-08-17T00:06:00.873370+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896281+0000","last_change":"2023-08-17T00:06:00.890435+0000","last_active":"2023-08-17T00:06:00.896281+0000","last_peered":"2023-08-17T00:06:00.896281+0000","last_clean":"2023-08-17T00:06:00.896281+0000","last_became_active":"2023-08-17T00:06:00.890062+0000","last_became_peered":"2023-08-17T00:06:00.890062+0000","last_unstale":"2023-08-17T00:06:00.896281+0000","last_undegraded":"2023-08-17T00:06:00.896281+0000","last_fullsized":"2023-08-17T00:06:00.896281+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873132+0000","last_change":"2023-08-17T00:06:00.452683+0000","last_active":"2023-08-17T00:06:00.873132+0000","last_peered":"2023-08-17T00:06:00.873132+0000","last_clean":"2023-08-17T00:06:00.873132+0000","last_became_active":"2023-08-17T00:06:00.452400+0000","last_became_peered":"2023-08-17T00:06:00.452400+0000","last_unstale":"2023-08-17T00:06:00.873132+0000","last_undegraded":"2023-08-17T00:06:00.873132+0000","last_fullsized":"2023-08-17T00:06:00.873132+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.902047+0000","last_change":"2023-08-17T00:06:00.899856+0000","last_active":"2023-08-17T00:06:00.902047+0000","last_peered":"2023-08-17T00:06:00.902047+0000","last_clean":"2023-08-17T00:06:00.902047+0000","last_became_active":"2023-08-17T00:06:00.898400+0000","last_became_peered":"2023-08-17T00:06:00.898400+0000","last_unstale":"2023-08-17T00:06:00.902047+0000","last_undegraded":"2023-08-17T00:06:00.902047+0000","last_fullsized":"2023-08-17T00:06:00.902047+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.30","version":"49'4","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.902495+0000","last_change":"2023-08-17T00:06:00.453932+0000","last_active":"2023-08-17T00:06:00.902495+0000","last_peered":"2023-08-17T00:06:00.902495+0000","last_clean":"2023-08-17T00:06:00.902495+0000","last_became_active":"2023-08-17T00:06:00.453635+0000","last_became_peered":"2023-08-17T00:06:00.453635+0000","last_unstale":"2023-08-17T00:06:00.902495+0000","last_undegraded":"2023-08-17T00:06:00.902495+0000","last_fullsized":"2023-08-17T00:06:00.902495+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896255+0000","last_change":"2023-08-17T00:06:00.891946+0000","last_active":"2023-08-17T00:06:00.896255+0000","last_peered":"2023-08-17T00:06:00.896255+0000","last_clean":"2023-08-17T00:06:00.896255+0000","last_became_active":"2023-08-17T00:06:00.891659+0000","last_became_peered":"2023-08-17T00:06:00.891659+0000","last_unstale":"2023-08-17T00:06:00.896255+0000","last_undegraded":"2023-08-17T00:06:00.896255+0000","last_fullsized":"2023-08-17T00:06:00.896255+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.877346+0000","last_change":"2023-08-17T00:06:00.460527+0000","last_active":"2023-08-17T00:06:00.877346+0000","last_peered":"2023-08-17T00:06:00.877346+0000","last_clean":"2023-08-17T00:06:00.877346+0000","last_became_active":"2023-08-17T00:06:00.460275+0000","last_became_peered":"2023-08-17T00:06:00.460275+0000","last_unstale":"2023-08-17T00:06:00.877346+0000","last_undegraded":"2023-08-17T00:06:00.877346+0000","last_fullsized":"2023-08-17T00:06:00.877346+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.900623+0000","last_change":"2023-08-17T00:06:00.883149+0000","last_active":"2023-08-17T00:06:00.900623+0000","last_peered":"2023-08-17T00:06:00.900623+0000","last_clean":"2023-08-17T00:06:00.900623+0000","last_became_active":"2023-08-17T00:06:00.882250+0000","last_became_peered":"2023-08-17T00:06:00.882250+0000","last_unstale":"2023-08-17T00:06:00.900623+0000","last_undegraded":"2023-08-17T00:06:00.900623+0000","last_fullsized":"2023-08-17T00:06:00.900623+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.884502+0000","last_change":"2023-08-17T00:06:00.460469+0000","last_active":"2023-08-17T00:06:00.884502+0000","last_peered":"2023-08-17T00:06:00.884502+0000","last_clean":"2023-08-17T00:06:00.884502+0000","last_became_active":"2023-08-17T00:06:00.460203+0000","last_became_peered":"2023-08-17T00:06:00.460203+0000","last_unstale":"2023-08-17T00:06:00.884502+0000","last_undegraded":"2023-08-17T00:06:00.884502+0000","last_fullsized":"2023-08-17T00:06:00.884502+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.910020+0000","last_change":"2023-08-17T00:06:00.907166+0000","last_active":"2023-08-17T00:06:00.910020+0000","last_peered":"2023-08-17T00:06:00.910020+0000","last_clean":"2023-08-17T00:06:00.910020+0000","last_became_active":"2023-08-17T00:06:00.906900+0000","last_became_peered":"2023-08-17T00:06:00.906900+0000","last_unstale":"2023-08-17T00:06:00.910020+0000","last_undegraded":"2023-08-17T00:06:00.910020+0000","last_fullsized":"2023-08-17T00:06:00.910020+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901998+0000","last_change":"2023-08-17T00:06:00.456564+0000","last_active":"2023-08-17T00:06:00.901998+0000","last_peered":"2023-08-17T00:06:00.901998+0000","last_clean":"2023-08-17T00:06:00.901998+0000","last_became_active":"2023-08-17T00:06:00.456262+0000","last_became_peered":"2023-08-17T00:06:00.456262+0000","last_unstale":"2023-08-17T00:06:00.901998+0000","last_undegraded":"2023-08-17T00:06:00.901998+0000","last_fullsized":"2023-08-17T00:06:00.901998+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896018+0000","last_change":"2023-08-17T00:06:00.892960+0000","last_active":"2023-08-17T00:06:00.896018+0000","last_peered":"2023-08-17T00:06:00.896018+0000","last_clean":"2023-08-17T00:06:00.896018+0000","last_became_active":"2023-08-17T00:06:00.891970+0000","last_became_peered":"2023-08-17T00:06:00.891970+0000","last_unstale":"2023-08-17T00:06:00.896018+0000","last_undegraded":"2023-08-17T00:06:00.896018+0000","last_fullsized":"2023-08-17T00:06:00.896018+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875195+0000","last_change":"2023-08-17T00:06:00.454628+0000","last_active":"2023-08-17T00:06:00.875195+0000","last_peered":"2023-08-17T00:06:00.875195+0000","last_clean":"2023-08-17T00:06:00.875195+0000","last_became_active":"2023-08-17T00:06:00.454328+0000","last_became_peered":"2023-08-17T00:06:00.454328+0000","last_unstale":"2023-08-17T00:06:00.875195+0000","last_undegraded":"2023-08-17T00:06:00.875195+0000","last_fullsized":"2023-08-17T00:06:00.875195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896440+0000","last_change":"2023-08-17T00:06:00.887755+0000","last_active":"2023-08-17T00:06:00.896440+0000","last_peered":"2023-08-17T00:06:00.896440+0000","last_clean":"2023-08-17T00:06:00.896440+0000","last_became_active":"2023-08-17T00:06:00.887499+0000","last_became_peered":"2023-08-17T00:06:00.887499+0000","last_unstale":"2023-08-17T00:06:00.896440+0000","last_undegraded":"2023-08-17T00:06:00.896440+0000","last_fullsized":"2023-08-17T00:06:00.896440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.898169+0000","last_change":"2023-08-17T00:06:00.453148+0000","last_active":"2023-08-17T00:06:00.898169+0000","last_peered":"2023-08-17T00:06:00.898169+0000","last_clean":"2023-08-17T00:06:00.898169+0000","last_became_active":"2023-08-17T00:06:00.452318+0000","last_became_peered":"2023-08-17T00:06:00.452318+0000","last_unstale":"2023-08-17T00:06:00.898169+0000","last_undegraded":"2023-08-17T00:06:00.898169+0000","last_fullsized":"2023-08-17T00:06:00.898169+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906190+0000","last_change":"2023-08-17T00:06:00.902801+0000","last_active":"2023-08-17T00:06:00.906190+0000","last_peered":"2023-08-17T00:06:00.906190+0000","last_clean":"2023-08-17T00:06:00.906190+0000","last_became_active":"2023-08-17T00:06:00.902496+0000","last_became_peered":"2023-08-17T00:06:00.902496+0000","last_unstale":"2023-08-17T00:06:00.906190+0000","last_undegraded":"2023-08-17T00:06:00.906190+0000","last_fullsized":"2023-08-17T00:06:00.906190+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.881013+0000","last_change":"2023-08-17T00:06:00.455265+0000","last_active":"2023-08-17T00:06:00.881013+0000","last_peered":"2023-08-17T00:06:00.881013+0000","last_clean":"2023-08-17T00:06:00.881013+0000","last_became_active":"2023-08-17T00:06:00.454963+0000","last_became_peered":"2023-08-17T00:06:00.454963+0000","last_unstale":"2023-08-17T00:06:00.881013+0000","last_undegraded":"2023-08-17T00:06:00.881013+0000","last_fullsized":"2023-08-17T00:06:00.881013+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.904101+0000","last_change":"2023-08-17T00:06:00.895618+0000","last_active":"2023-08-17T00:06:00.904101+0000","last_peered":"2023-08-17T00:06:00.904101+0000","last_clean":"2023-08-17T00:06:00.904101+0000","last_became_active":"2023-08-17T00:06:00.894717+0000","last_became_peered":"2023-08-17T00:06:00.894717+0000","last_unstale":"2023-08-17T00:06:00.904101+0000","last_undegraded":"2023-08-17T00:06:00.904101+0000","last_fullsized":"2023-08-17T00:06:00.904101+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.886365+0000","last_change":"2023-08-17T00:06:00.457828+0000","last_active":"2023-08-17T00:06:00.886365+0000","last_peered":"2023-08-17T00:06:00.886365+0000","last_clean":"2023-08-17T00:06:00.886365+0000","last_became_active":"2023-08-17T00:06:00.457545+0000","last_became_peered":"2023-08-17T00:06:00.457545+0000","last_unstale":"2023-08-17T00:06:00.886365+0000","last_undegraded":"2023-08-17T00:06:00.886365+0000","last_fullsized":"2023-08-17T00:06:00.886365+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901977+0000","last_change":"2023-08-17T00:06:00.896835+0000","last_active":"2023-08-17T00:06:00.901977+0000","last_peered":"2023-08-17T00:06:00.901977+0000","last_clean":"2023-08-17T00:06:00.901977+0000","last_became_active":"2023-08-17T00:06:00.896580+0000","last_became_peered":"2023-08-17T00:06:00.896580+0000","last_unstale":"2023-08-17T00:06:00.901977+0000","last_undegraded":"2023-08-17T00:06:00.901977+0000","last_fullsized":"2023-08-17T00:06:00.901977+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.877637+0000","last_change":"2023-08-17T00:06:00.455614+0000","last_active":"2023-08-17T00:06:00.877637+0000","last_peered":"2023-08-17T00:06:00.877637+0000","last_clean":"2023-08-17T00:06:00.877637+0000","last_became_active":"2023-08-17T00:06:00.455351+0000","last_became_peered":"2023-08-17T00:06:00.455351+0000","last_unstale":"2023-08-17T00:06:00.877637+0000","last_undegraded":"2023-08-17T00:06:00.877637+0000","last_fullsized":"2023-08-17T00:06:00.877637+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903990+0000","last_change":"2023-08-17T00:06:00.894302+0000","last_active":"2023-08-17T00:06:00.903990+0000","last_peered":"2023-08-17T00:06:00.903990+0000","last_clean":"2023-08-17T00:06:00.903990+0000","last_became_active":"2023-08-17T00:06:00.894011+0000","last_became_peered":"2023-08-17T00:06:00.894011+0000","last_unstale":"2023-08-17T00:06:00.903990+0000","last_undegraded":"2023-08-17T00:06:00.903990+0000","last_fullsized":"2023-08-17T00:06:00.903990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.871601+0000","last_change":"2023-08-17T00:06:00.457223+0000","last_active":"2023-08-17T00:06:00.871601+0000","last_peered":"2023-08-17T00:06:00.871601+0000","last_clean":"2023-08-17T00:06:00.871601+0000","last_became_active":"2023-08-17T00:06:00.456914+0000","last_became_peered":"2023-08-17T00:06:00.456914+0000","last_unstale":"2023-08-17T00:06:00.871601+0000","last_undegraded":"2023-08-17T00:06:00.871601+0000","last_fullsized":"2023-08-17T00:06:00.871601+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903725+0000","last_change":"2023-08-17T00:06:00.887835+0000","last_active":"2023-08-17T00:06:00.903725+0000","last_peered":"2023-08-17T00:06:00.903725+0000","last_clean":"2023-08-17T00:06:00.903725+0000","last_became_active":"2023-08-17T00:06:00.887509+0000","last_became_peered":"2023-08-17T00:06:00.887509+0000","last_unstale":"2023-08-17T00:06:00.903725+0000","last_undegraded":"2023-08-17T00:06:00.903725+0000","last_fullsized":"2023-08-17T00:06:00.903725+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.874407+0000","last_change":"2023-08-17T00:06:00.454580+0000","last_active":"2023-08-17T00:06:00.874407+0000","last_peered":"2023-08-17T00:06:00.874407+0000","last_clean":"2023-08-17T00:06:00.874407+0000","last_became_active":"2023-08-17T00:06:00.454307+0000","last_became_peered":"2023-08-17T00:06:00.454307+0000","last_unstale":"2023-08-17T00:06:00.874407+0000","last_undegraded":"2023-08-17T00:06:00.874407+0000","last_fullsized":"2023-08-17T00:06:00.874407+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.900733+0000","last_change":"2023-08-17T00:06:00.884528+0000","last_active":"2023-08-17T00:06:00.900733+0000","last_peered":"2023-08-17T00:06:00.900733+0000","last_clean":"2023-08-17T00:06:00.900733+0000","last_became_active":"2023-08-17T00:06:00.884227+0000","last_became_peered":"2023-08-17T00:06:00.884227+0000","last_unstale":"2023-08-17T00:06:00.900733+0000","last_undegraded":"2023-08-17T00:06:00.900733+0000","last_fullsized":"2023-08-17T00:06:00.900733+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.886607+0000","last_change":"2023-08-17T00:06:00.463338+0000","last_active":"2023-08-17T00:06:00.886607+0000","last_peered":"2023-08-17T00:06:00.886607+0000","last_clean":"2023-08-17T00:06:00.886607+0000","last_became_active":"2023-08-17T00:06:00.462883+0000","last_became_peered":"2023-08-17T00:06:00.462883+0000","last_unstale":"2023-08-17T00:06:00.886607+0000","last_undegraded":"2023-08-17T00:06:00.886607+0000","last_fullsized":"2023-08-17T00:06:00.886607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.897440+0000","last_change":"2023-08-17T00:06:00.892702+0000","last_active":"2023-08-17T00:06:00.897440+0000","last_peered":"2023-08-17T00:06:00.897440+0000","last_clean":"2023-08-17T00:06:00.897440+0000","last_became_active":"2023-08-17T00:06:00.892396+0000","last_became_peered":"2023-08-17T00:06:00.892396+0000","last_unstale":"2023-08-17T00:06:00.897440+0000","last_undegraded":"2023-08-17T00:06:00.897440+0000","last_fullsized":"2023-08-17T00:06:00.897440+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.885843+0000","last_change":"2023-08-17T00:06:00.459192+0000","last_active":"2023-08-17T00:06:00.885843+0000","last_peered":"2023-08-17T00:06:00.885843+0000","last_clean":"2023-08-17T00:06:00.885843+0000","last_became_active":"2023-08-17T00:06:00.458907+0000","last_became_peered":"2023-08-17T00:06:00.458907+0000","last_unstale":"2023-08-17T00:06:00.885843+0000","last_undegraded":"2023-08-17T00:06:00.885843+0000","last_fullsized":"2023-08-17T00:06:00.885843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896458+0000","last_change":"2023-08-17T00:06:00.888238+0000","last_active":"2023-08-17T00:06:00.896458+0000","last_peered":"2023-08-17T00:06:00.896458+0000","last_clean":"2023-08-17T00:06:00.896458+0000","last_became_active":"2023-08-17T00:06:00.887988+0000","last_became_peered":"2023-08-17T00:06:00.887988+0000","last_unstale":"2023-08-17T00:06:00.896458+0000","last_undegraded":"2023-08-17T00:06:00.896458+0000","last_fullsized":"2023-08-17T00:06:00.896458+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.871468+0000","last_change":"2023-08-17T00:06:00.463553+0000","last_active":"2023-08-17T00:06:00.871468+0000","last_peered":"2023-08-17T00:06:00.871468+0000","last_clean":"2023-08-17T00:06:00.871468+0000","last_became_active":"2023-08-17T00:06:00.462105+0000","last_became_peered":"2023-08-17T00:06:00.462105+0000","last_unstale":"2023-08-17T00:06:00.871468+0000","last_undegraded":"2023-08-17T00:06:00.871468+0000","last_fullsized":"2023-08-17T00:06:00.871468+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901297+0000","last_change":"2023-08-17T00:06:00.885417+0000","last_active":"2023-08-17T00:06:00.901297+0000","last_peered":"2023-08-17T00:06:00.901297+0000","last_clean":"2023-08-17T00:06:00.901297+0000","last_became_active":"2023-08-17T00:06:00.885130+0000","last_became_peered":"2023-08-17T00:06:00.885130+0000","last_unstale":"2023-08-17T00:06:00.901297+0000","last_undegraded":"2023-08-17T00:06:00.901297+0000","last_fullsized":"2023-08-17T00:06:00.901297+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.877304+0000","last_change":"2023-08-17T00:06:00.456633+0000","last_active":"2023-08-17T00:06:00.877304+0000","last_peered":"2023-08-17T00:06:00.877304+0000","last_clean":"2023-08-17T00:06:00.877304+0000","last_became_active":"2023-08-17T00:06:00.456322+0000","last_became_peered":"2023-08-17T00:06:00.456322+0000","last_unstale":"2023-08-17T00:06:00.877304+0000","last_undegraded":"2023-08-17T00:06:00.877304+0000","last_fullsized":"2023-08-17T00:06:00.877304+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901374+0000","last_change":"2023-08-17T00:06:00.900177+0000","last_active":"2023-08-17T00:06:00.901374+0000","last_peered":"2023-08-17T00:06:00.901374+0000","last_clean":"2023-08-17T00:06:00.901374+0000","last_became_active":"2023-08-17T00:06:00.899439+0000","last_became_peered":"2023-08-17T00:06:00.899439+0000","last_unstale":"2023-08-17T00:06:00.901374+0000","last_undegraded":"2023-08-17T00:06:00.901374+0000","last_fullsized":"2023-08-17T00:06:00.901374+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.878602+0000","last_change":"2023-08-17T00:06:00.458488+0000","last_active":"2023-08-17T00:06:00.878602+0000","last_peered":"2023-08-17T00:06:00.878602+0000","last_clean":"2023-08-17T00:06:00.878602+0000","last_became_active":"2023-08-17T00:06:00.458231+0000","last_became_peered":"2023-08-17T00:06:00.458231+0000","last_unstale":"2023-08-17T00:06:00.878602+0000","last_undegraded":"2023-08-17T00:06:00.878602+0000","last_fullsized":"2023-08-17T00:06:00.878602+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901997+0000","last_change":"2023-08-17T00:06:00.899833+0000","last_active":"2023-08-17T00:06:00.901997+0000","last_peered":"2023-08-17T00:06:00.901997+0000","last_clean":"2023-08-17T00:06:00.901997+0000","last_became_active":"2023-08-17T00:06:00.898053+0000","last_became_peered":"2023-08-17T00:06:00.898053+0000","last_unstale":"2023-08-17T00:06:00.901997+0000","last_undegraded":"2023-08-17T00:06:00.901997+0000","last_fullsized":"2023-08-17T00:06:00.901997+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873487+0000","last_change":"2023-08-17T00:06:00.447622+0000","last_active":"2023-08-17T00:06:00.873487+0000","last_peered":"2023-08-17T00:06:00.873487+0000","last_clean":"2023-08-17T00:06:00.873487+0000","last_became_active":"2023-08-17T00:06:00.447361+0000","last_became_peered":"2023-08-17T00:06:00.447361+0000","last_unstale":"2023-08-17T00:06:00.873487+0000","last_undegraded":"2023-08-17T00:06:00.873487+0000","last_fullsized":"2023-08-17T00:06:00.873487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906947+0000","last_change":"2023-08-17T00:06:00.897248+0000","last_active":"2023-08-17T00:06:00.906947+0000","last_peered":"2023-08-17T00:06:00.906947+0000","last_clean":"2023-08-17T00:06:00.906947+0000","last_became_active":"2023-08-17T00:06:00.896907+0000","last_became_peered":"2023-08-17T00:06:00.896907+0000","last_unstale":"2023-08-17T00:06:00.906947+0000","last_undegraded":"2023-08-17T00:06:00.906947+0000","last_fullsized":"2023-08-17T00:06:00.906947+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903326+0000","last_change":"2023-08-17T00:06:00.460735+0000","last_active":"2023-08-17T00:06:00.903326+0000","last_peered":"2023-08-17T00:06:00.903326+0000","last_clean":"2023-08-17T00:06:00.903326+0000","last_became_active":"2023-08-17T00:06:00.460297+0000","last_became_peered":"2023-08-17T00:06:00.460297+0000","last_unstale":"2023-08-17T00:06:00.903326+0000","last_undegraded":"2023-08-17T00:06:00.903326+0000","last_fullsized":"2023-08-17T00:06:00.903326+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.909038+0000","last_change":"2023-08-17T00:06:00.898842+0000","last_active":"2023-08-17T00:06:00.909038+0000","last_peered":"2023-08-17T00:06:00.909038+0000","last_clean":"2023-08-17T00:06:00.909038+0000","last_became_active":"2023-08-17T00:06:00.898558+0000","last_became_peered":"2023-08-17T00:06:00.898558+0000","last_unstale":"2023-08-17T00:06:00.909038+0000","last_undegraded":"2023-08-17T00:06:00.909038+0000","last_fullsized":"2023-08-17T00:06:00.909038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.904398+0000","last_change":"2023-08-17T00:06:00.461533+0000","last_active":"2023-08-17T00:06:00.904398+0000","last_peered":"2023-08-17T00:06:00.904398+0000","last_clean":"2023-08-17T00:06:00.904398+0000","last_became_active":"2023-08-17T00:06:00.461197+0000","last_became_peered":"2023-08-17T00:06:00.461197+0000","last_unstale":"2023-08-17T00:06:00.904398+0000","last_undegraded":"2023-08-17T00:06:00.904398+0000","last_fullsized":"2023-08-17T00:06:00.904398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.898351+0000","last_change":"2023-08-17T00:06:00.896877+0000","last_active":"2023-08-17T00:06:00.898351+0000","last_peered":"2023-08-17T00:06:00.898351+0000","last_clean":"2023-08-17T00:06:00.898351+0000","last_became_active":"2023-08-17T00:06:00.896559+0000","last_became_peered":"2023-08-17T00:06:00.896559+0000","last_unstale":"2023-08-17T00:06:00.898351+0000","last_undegraded":"2023-08-17T00:06:00.898351+0000","last_fullsized":"2023-08-17T00:06:00.898351+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.895595+0000","last_change":"2023-08-17T00:06:00.454064+0000","last_active":"2023-08-17T00:06:00.895595+0000","last_peered":"2023-08-17T00:06:00.895595+0000","last_clean":"2023-08-17T00:06:00.895595+0000","last_became_active":"2023-08-17T00:06:00.453670+0000","last_became_peered":"2023-08-17T00:06:00.453670+0000","last_unstale":"2023-08-17T00:06:00.895595+0000","last_undegraded":"2023-08-17T00:06:00.895595+0000","last_fullsized":"2023-08-17T00:06:00.895595+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.891689+0000","last_change":"2023-08-17T00:06:00.884031+0000","last_active":"2023-08-17T00:06:00.891689+0000","last_peered":"2023-08-17T00:06:00.891689+0000","last_clean":"2023-08-17T00:06:00.891689+0000","last_became_active":"2023-08-17T00:06:00.883706+0000","last_became_peered":"2023-08-17T00:06:00.883706+0000","last_unstale":"2023-08-17T00:06:00.891689+0000","last_undegraded":"2023-08-17T00:06:00.891689+0000","last_fullsized":"2023-08-17T00:06:00.891689+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.877912+0000","last_change":"2023-08-17T00:06:00.464176+0000","last_active":"2023-08-17T00:06:00.877912+0000","last_peered":"2023-08-17T00:06:00.877912+0000","last_clean":"2023-08-17T00:06:00.877912+0000","last_became_active":"2023-08-17T00:06:00.463881+0000","last_became_peered":"2023-08-17T00:06:00.463881+0000","last_unstale":"2023-08-17T00:06:00.877912+0000","last_undegraded":"2023-08-17T00:06:00.877912+0000","last_fullsized":"2023-08-17T00:06:00.877912+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901472+0000","last_change":"2023-08-17T00:06:00.895082+0000","last_active":"2023-08-17T00:06:00.901472+0000","last_peered":"2023-08-17T00:06:00.901472+0000","last_clean":"2023-08-17T00:06:00.901472+0000","last_became_active":"2023-08-17T00:06:00.894516+0000","last_became_peered":"2023-08-17T00:06:00.894516+0000","last_unstale":"2023-08-17T00:06:00.901472+0000","last_undegraded":"2023-08-17T00:06:00.901472+0000","last_fullsized":"2023-08-17T00:06:00.901472+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873803+0000","last_change":"2023-08-17T00:06:00.454119+0000","last_active":"2023-08-17T00:06:00.873803+0000","last_peered":"2023-08-17T00:06:00.873803+0000","last_clean":"2023-08-17T00:06:00.873803+0000","last_became_active":"2023-08-17T00:06:00.453837+0000","last_became_peered":"2023-08-17T00:06:00.453837+0000","last_unstale":"2023-08-17T00:06:00.873803+0000","last_undegraded":"2023-08-17T00:06:00.873803+0000","last_fullsized":"2023-08-17T00:06:00.873803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906863+0000","last_change":"2023-08-17T00:06:00.898069+0000","last_active":"2023-08-17T00:06:00.906863+0000","last_peered":"2023-08-17T00:06:00.906863+0000","last_clean":"2023-08-17T00:06:00.906863+0000","last_became_active":"2023-08-17T00:06:00.897805+0000","last_became_peered":"2023-08-17T00:06:00.897805+0000","last_unstale":"2023-08-17T00:06:00.906863+0000","last_undegraded":"2023-08-17T00:06:00.906863+0000","last_fullsized":"2023-08-17T00:06:00.906863+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.882057+0000","last_change":"2023-08-17T00:06:00.462095+0000","last_active":"2023-08-17T00:06:00.882057+0000","last_peered":"2023-08-17T00:06:00.882057+0000","last_clean":"2023-08-17T00:06:00.882057+0000","last_became_active":"2023-08-17T00:06:00.461835+0000","last_became_peered":"2023-08-17T00:06:00.461835+0000","last_unstale":"2023-08-17T00:06:00.882057+0000","last_undegraded":"2023-08-17T00:06:00.882057+0000","last_fullsized":"2023-08-17T00:06:00.882057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.891052+0000","last_change":"2023-08-17T00:06:00.883946+0000","last_active":"2023-08-17T00:06:00.891052+0000","last_peered":"2023-08-17T00:06:00.891052+0000","last_clean":"2023-08-17T00:06:00.891052+0000","last_became_active":"2023-08-17T00:06:00.883640+0000","last_became_peered":"2023-08-17T00:06:00.883640+0000","last_unstale":"2023-08-17T00:06:00.891052+0000","last_undegraded":"2023-08-17T00:06:00.891052+0000","last_fullsized":"2023-08-17T00:06:00.891052+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.885464+0000","last_change":"2023-08-17T00:06:00.465219+0000","last_active":"2023-08-17T00:06:00.885464+0000","last_peered":"2023-08-17T00:06:00.885464+0000","last_clean":"2023-08-17T00:06:00.885464+0000","last_became_active":"2023-08-17T00:06:00.464827+0000","last_became_peered":"2023-08-17T00:06:00.464827+0000","last_unstale":"2023-08-17T00:06:00.885464+0000","last_undegraded":"2023-08-17T00:06:00.885464+0000","last_fullsized":"2023-08-17T00:06:00.885464+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.908891+0000","last_change":"2023-08-17T00:06:00.908074+0000","last_active":"2023-08-17T00:06:00.908891+0000","last_peered":"2023-08-17T00:06:00.908891+0000","last_clean":"2023-08-17T00:06:00.908891+0000","last_became_active":"2023-08-17T00:06:00.907763+0000","last_became_peered":"2023-08-17T00:06:00.907763+0000","last_unstale":"2023-08-17T00:06:00.908891+0000","last_undegraded":"2023-08-17T00:06:00.908891+0000","last_fullsized":"2023-08-17T00:06:00.908891+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875706+0000","last_change":"2023-08-17T00:06:00.452267+0000","last_active":"2023-08-17T00:06:00.875706+0000","last_peered":"2023-08-17T00:06:00.875706+0000","last_clean":"2023-08-17T00:06:00.875706+0000","last_became_active":"2023-08-17T00:06:00.451157+0000","last_became_peered":"2023-08-17T00:06:00.451157+0000","last_unstale":"2023-08-17T00:06:00.875706+0000","last_undegraded":"2023-08-17T00:06:00.875706+0000","last_fullsized":"2023-08-17T00:06:00.875706+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.891836+0000","last_change":"2023-08-17T00:06:00.887941+0000","last_active":"2023-08-17T00:06:00.891836+0000","last_peered":"2023-08-17T00:06:00.891836+0000","last_clean":"2023-08-17T00:06:00.891836+0000","last_became_active":"2023-08-17T00:06:00.887667+0000","last_became_peered":"2023-08-17T00:06:00.887667+0000","last_unstale":"2023-08-17T00:06:00.891836+0000","last_undegraded":"2023-08-17T00:06:00.891836+0000","last_fullsized":"2023-08-17T00:06:00.891836+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.881072+0000","last_change":"2023-08-17T00:06:00.453822+0000","last_active":"2023-08-17T00:06:00.881072+0000","last_peered":"2023-08-17T00:06:00.881072+0000","last_clean":"2023-08-17T00:06:00.881072+0000","last_became_active":"2023-08-17T00:06:00.453320+0000","last_became_peered":"2023-08-17T00:06:00.453320+0000","last_unstale":"2023-08-17T00:06:00.881072+0000","last_undegraded":"2023-08-17T00:06:00.881072+0000","last_fullsized":"2023-08-17T00:06:00.881072+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901106+0000","last_change":"2023-08-17T00:06:00.897834+0000","last_active":"2023-08-17T00:06:00.901106+0000","last_peered":"2023-08-17T00:06:00.901106+0000","last_clean":"2023-08-17T00:06:00.901106+0000","last_became_active":"2023-08-17T00:06:00.897555+0000","last_became_peered":"2023-08-17T00:06:00.897555+0000","last_unstale":"2023-08-17T00:06:00.901106+0000","last_undegraded":"2023-08-17T00:06:00.901106+0000","last_fullsized":"2023-08-17T00:06:00.901106+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.884598+0000","last_change":"2023-08-17T00:06:00.458319+0000","last_active":"2023-08-17T00:06:00.884598+0000","last_peered":"2023-08-17T00:06:00.884598+0000","last_clean":"2023-08-17T00:06:00.884598+0000","last_became_active":"2023-08-17T00:06:00.458018+0000","last_became_peered":"2023-08-17T00:06:00.458018+0000","last_unstale":"2023-08-17T00:06:00.884598+0000","last_undegraded":"2023-08-17T00:06:00.884598+0000","last_fullsized":"2023-08-17T00:06:00.884598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.902038+0000","last_change":"2023-08-17T00:06:00.899460+0000","last_active":"2023-08-17T00:06:00.902038+0000","last_peered":"2023-08-17T00:06:00.902038+0000","last_clean":"2023-08-17T00:06:00.902038+0000","last_became_active":"2023-08-17T00:06:00.899164+0000","last_became_peered":"2023-08-17T00:06:00.899164+0000","last_unstale":"2023-08-17T00:06:00.902038+0000","last_undegraded":"2023-08-17T00:06:00.902038+0000","last_fullsized":"2023-08-17T00:06:00.902038+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"49'3","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906784+0000","last_change":"2023-08-17T00:06:00.466397+0000","last_active":"2023-08-17T00:06:00.906784+0000","last_peered":"2023-08-17T00:06:00.906784+0000","last_clean":"2023-08-17T00:06:00.906784+0000","last_became_active":"2023-08-17T00:06:00.466068+0000","last_became_peered":"2023-08-17T00:06:00.466068+0000","last_unstale":"2023-08-17T00:06:00.906784+0000","last_undegraded":"2023-08-17T00:06:00.906784+0000","last_fullsized":"2023-08-17T00:06:00.906784+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896325+0000","last_change":"2023-08-17T00:06:00.891412+0000","last_active":"2023-08-17T00:06:00.896325+0000","last_peered":"2023-08-17T00:06:00.896325+0000","last_clean":"2023-08-17T00:06:00.896325+0000","last_became_active":"2023-08-17T00:06:00.890806+0000","last_became_peered":"2023-08-17T00:06:00.890806+0000","last_unstale":"2023-08-17T00:06:00.896325+0000","last_undegraded":"2023-08-17T00:06:00.896325+0000","last_fullsized":"2023-08-17T00:06:00.896325+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.900964+0000","last_change":"2023-08-17T00:06:00.456406+0000","last_active":"2023-08-17T00:06:00.900964+0000","last_peered":"2023-08-17T00:06:00.900964+0000","last_clean":"2023-08-17T00:06:00.900964+0000","last_became_active":"2023-08-17T00:06:00.456137+0000","last_became_peered":"2023-08-17T00:06:00.456137+0000","last_unstale":"2023-08-17T00:06:00.900964+0000","last_undegraded":"2023-08-17T00:06:00.900964+0000","last_fullsized":"2023-08-17T00:06:00.900964+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896173+0000","last_change":"2023-08-17T00:06:00.893026+0000","last_active":"2023-08-17T00:06:00.896173+0000","last_peered":"2023-08-17T00:06:00.896173+0000","last_clean":"2023-08-17T00:06:00.896173+0000","last_became_active":"2023-08-17T00:06:00.892711+0000","last_became_peered":"2023-08-17T00:06:00.892711+0000","last_unstale":"2023-08-17T00:06:00.896173+0000","last_undegraded":"2023-08-17T00:06:00.896173+0000","last_fullsized":"2023-08-17T00:06:00.896173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.908145+0000","last_change":"2023-08-17T00:06:00.451505+0000","last_active":"2023-08-17T00:06:00.908145+0000","last_peered":"2023-08-17T00:06:00.908145+0000","last_clean":"2023-08-17T00:06:00.908145+0000","last_became_active":"2023-08-17T00:06:00.451238+0000","last_became_peered":"2023-08-17T00:06:00.451238+0000","last_unstale":"2023-08-17T00:06:00.908145+0000","last_undegraded":"2023-08-17T00:06:00.908145+0000","last_fullsized":"2023-08-17T00:06:00.908145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901524+0000","last_change":"2023-08-17T00:06:00.897007+0000","last_active":"2023-08-17T00:06:00.901524+0000","last_peered":"2023-08-17T00:06:00.901524+0000","last_clean":"2023-08-17T00:06:00.901524+0000","last_became_active":"2023-08-17T00:06:00.896503+0000","last_became_peered":"2023-08-17T00:06:00.896503+0000","last_unstale":"2023-08-17T00:06:00.901524+0000","last_undegraded":"2023-08-17T00:06:00.901524+0000","last_fullsized":"2023-08-17T00:06:00.901524+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.879605+0000","last_change":"2023-08-17T00:06:00.455669+0000","last_active":"2023-08-17T00:06:00.879605+0000","last_peered":"2023-08-17T00:06:00.879605+0000","last_clean":"2023-08-17T00:06:00.879605+0000","last_became_active":"2023-08-17T00:06:00.455184+0000","last_became_peered":"2023-08-17T00:06:00.455184+0000","last_unstale":"2023-08-17T00:06:00.879605+0000","last_undegraded":"2023-08-17T00:06:00.879605+0000","last_fullsized":"2023-08-17T00:06:00.879605+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906254+0000","last_change":"2023-08-17T00:06:00.902154+0000","last_active":"2023-08-17T00:06:00.906254+0000","last_peered":"2023-08-17T00:06:00.906254+0000","last_clean":"2023-08-17T00:06:00.906254+0000","last_became_active":"2023-08-17T00:06:00.901756+0000","last_became_peered":"2023-08-17T00:06:00.901756+0000","last_unstale":"2023-08-17T00:06:00.906254+0000","last_undegraded":"2023-08-17T00:06:00.906254+0000","last_fullsized":"2023-08-17T00:06:00.906254+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875947+0000","last_change":"2023-08-17T00:06:00.457226+0000","last_active":"2023-08-17T00:06:00.875947+0000","last_peered":"2023-08-17T00:06:00.875947+0000","last_clean":"2023-08-17T00:06:00.875947+0000","last_became_active":"2023-08-17T00:06:00.456937+0000","last_became_peered":"2023-08-17T00:06:00.456937+0000","last_unstale":"2023-08-17T00:06:00.875947+0000","last_undegraded":"2023-08-17T00:06:00.875947+0000","last_fullsized":"2023-08-17T00:06:00.875947+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903773+0000","last_change":"2023-08-17T00:06:00.888863+0000","last_active":"2023-08-17T00:06:00.903773+0000","last_peered":"2023-08-17T00:06:00.903773+0000","last_clean":"2023-08-17T00:06:00.903773+0000","last_became_active":"2023-08-17T00:06:00.888528+0000","last_became_peered":"2023-08-17T00:06:00.888528+0000","last_unstale":"2023-08-17T00:06:00.903773+0000","last_undegraded":"2023-08-17T00:06:00.903773+0000","last_fullsized":"2023-08-17T00:06:00.903773+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.10","version":"49'4","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.905129+0000","last_change":"2023-08-17T00:06:00.455958+0000","last_active":"2023-08-17T00:06:00.905129+0000","last_peered":"2023-08-17T00:06:00.905129+0000","last_clean":"2023-08-17T00:06:00.905129+0000","last_became_active":"2023-08-17T00:06:00.455691+0000","last_became_peered":"2023-08-17T00:06:00.455691+0000","last_unstale":"2023-08-17T00:06:00.905129+0000","last_undegraded":"2023-08-17T00:06:00.905129+0000","last_fullsized":"2023-08-17T00:06:00.905129+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896318+0000","last_change":"2023-08-17T00:06:00.895103+0000","last_active":"2023-08-17T00:06:00.896318+0000","last_peered":"2023-08-17T00:06:00.896318+0000","last_clean":"2023-08-17T00:06:00.896318+0000","last_became_active":"2023-08-17T00:06:00.894823+0000","last_became_peered":"2023-08-17T00:06:00.894823+0000","last_unstale":"2023-08-17T00:06:00.896318+0000","last_undegraded":"2023-08-17T00:06:00.896318+0000","last_fullsized":"2023-08-17T00:06:00.896318+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.903090+0000","last_change":"2023-08-17T00:06:00.461420+0000","last_active":"2023-08-17T00:06:00.903090+0000","last_peered":"2023-08-17T00:06:00.903090+0000","last_clean":"2023-08-17T00:06:00.903090+0000","last_became_active":"2023-08-17T00:06:00.461127+0000","last_became_peered":"2023-08-17T00:06:00.461127+0000","last_unstale":"2023-08-17T00:06:00.903090+0000","last_undegraded":"2023-08-17T00:06:00.903090+0000","last_fullsized":"2023-08-17T00:06:00.903090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.895007+0000","last_change":"2023-08-17T00:06:00.890270+0000","last_active":"2023-08-17T00:06:00.895007+0000","last_peered":"2023-08-17T00:06:00.895007+0000","last_clean":"2023-08-17T00:06:00.895007+0000","last_became_active":"2023-08-17T00:06:00.889884+0000","last_became_peered":"2023-08-17T00:06:00.889884+0000","last_unstale":"2023-08-17T00:06:00.895007+0000","last_undegraded":"2023-08-17T00:06:00.895007+0000","last_fullsized":"2023-08-17T00:06:00.895007+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.e","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.902900+0000","last_change":"2023-08-17T00:06:00.457536+0000","last_active":"2023-08-17T00:06:00.902900+0000","last_peered":"2023-08-17T00:06:00.902900+0000","last_clean":"2023-08-17T00:06:00.902900+0000","last_became_active":"2023-08-17T00:06:00.457265+0000","last_became_peered":"2023-08-17T00:06:00.457265+0000","last_unstale":"2023-08-17T00:06:00.902900+0000","last_undegraded":"2023-08-17T00:06:00.902900+0000","last_fullsized":"2023-08-17T00:06:00.902900+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.910749+0000","last_change":"2023-08-17T00:06:00.904425+0000","last_active":"2023-08-17T00:06:00.910749+0000","last_peered":"2023-08-17T00:06:00.910749+0000","last_clean":"2023-08-17T00:06:00.910749+0000","last_became_active":"2023-08-17T00:06:00.904121+0000","last_became_peered":"2023-08-17T00:06:00.904121+0000","last_unstale":"2023-08-17T00:06:00.910749+0000","last_undegraded":"2023-08-17T00:06:00.910749+0000","last_fullsized":"2023-08-17T00:06:00.910749+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.882798+0000","last_change":"2023-08-17T00:06:00.459216+0000","last_active":"2023-08-17T00:06:00.882798+0000","last_peered":"2023-08-17T00:06:00.882798+0000","last_clean":"2023-08-17T00:06:00.882798+0000","last_became_active":"2023-08-17T00:06:00.458944+0000","last_became_peered":"2023-08-17T00:06:00.458944+0000","last_unstale":"2023-08-17T00:06:00.882798+0000","last_undegraded":"2023-08-17T00:06:00.882798+0000","last_fullsized":"2023-08-17T00:06:00.882798+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.906230+0000","last_change":"2023-08-17T00:06:00.903564+0000","last_active":"2023-08-17T00:06:00.906230+0000","last_peered":"2023-08-17T00:06:00.906230+0000","last_clean":"2023-08-17T00:06:00.906230+0000","last_became_active":"2023-08-17T00:06:00.903072+0000","last_became_peered":"2023-08-17T00:06:00.903072+0000","last_unstale":"2023-08-17T00:06:00.906230+0000","last_undegraded":"2023-08-17T00:06:00.906230+0000","last_fullsized":"2023-08-17T00:06:00.906230+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.878006+0000","last_change":"2023-08-17T00:06:00.463156+0000","last_active":"2023-08-17T00:06:00.878006+0000","last_peered":"2023-08-17T00:06:00.878006+0000","last_clean":"2023-08-17T00:06:00.878006+0000","last_became_active":"2023-08-17T00:06:00.462829+0000","last_became_peered":"2023-08-17T00:06:00.462829+0000","last_unstale":"2023-08-17T00:06:00.878006+0000","last_undegraded":"2023-08-17T00:06:00.878006+0000","last_fullsized":"2023-08-17T00:06:00.878006+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.910547+0000","last_change":"2023-08-17T00:06:00.900563+0000","last_active":"2023-08-17T00:06:00.910547+0000","last_peered":"2023-08-17T00:06:00.910547+0000","last_clean":"2023-08-17T00:06:00.910547+0000","last_became_active":"2023-08-17T00:06:00.900195+0000","last_became_peered":"2023-08-17T00:06:00.900195+0000","last_unstale":"2023-08-17T00:06:00.910547+0000","last_undegraded":"2023-08-17T00:06:00.910547+0000","last_fullsized":"2023-08-17T00:06:00.910547+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"49'1","reported_seq":11,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.892611+0000","last_change":"2023-08-17T00:06:00.451414+0000","last_active":"2023-08-17T00:06:00.892611+0000","last_peered":"2023-08-17T00:06:00.892611+0000","last_clean":"2023-08-17T00:06:00.892611+0000","last_became_active":"2023-08-17T00:06:00.450949+0000","last_became_peered":"2023-08-17T00:06:00.450949+0000","last_unstale":"2023-08-17T00:06:00.892611+0000","last_undegraded":"2023-08-17T00:06:00.892611+0000","last_fullsized":"2023-08-17T00:06:00.892611+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901137+0000","last_change":"2023-08-17T00:06:00.897783+0000","last_active":"2023-08-17T00:06:00.901137+0000","last_peered":"2023-08-17T00:06:00.901137+0000","last_clean":"2023-08-17T00:06:00.901137+0000","last_became_active":"2023-08-17T00:06:00.897458+0000","last_became_peered":"2023-08-17T00:06:00.897458+0000","last_unstale":"2023-08-17T00:06:00.901137+0000","last_undegraded":"2023-08-17T00:06:00.901137+0000","last_fullsized":"2023-08-17T00:06:00.901137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.872262+0000","last_change":"2023-08-17T00:06:00.463145+0000","last_active":"2023-08-17T00:06:00.872262+0000","last_peered":"2023-08-17T00:06:00.872262+0000","last_clean":"2023-08-17T00:06:00.872262+0000","last_became_active":"2023-08-17T00:06:00.462860+0000","last_became_peered":"2023-08-17T00:06:00.462860+0000","last_unstale":"2023-08-17T00:06:00.872262+0000","last_undegraded":"2023-08-17T00:06:00.872262+0000","last_fullsized":"2023-08-17T00:06:00.872262+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.896156+0000","last_change":"2023-08-17T00:06:00.893889+0000","last_active":"2023-08-17T00:06:00.896156+0000","last_peered":"2023-08-17T00:06:00.896156+0000","last_clean":"2023-08-17T00:06:00.896156+0000","last_became_active":"2023-08-17T00:06:00.893594+0000","last_became_peered":"2023-08-17T00:06:00.893594+0000","last_unstale":"2023-08-17T00:06:00.896156+0000","last_undegraded":"2023-08-17T00:06:00.896156+0000","last_fullsized":"2023-08-17T00:06:00.896156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873257+0000","last_change":"2023-08-17T00:06:00.457314+0000","last_active":"2023-08-17T00:06:00.873257+0000","last_peered":"2023-08-17T00:06:00.873257+0000","last_clean":"2023-08-17T00:06:00.873257+0000","last_became_active":"2023-08-17T00:06:00.457044+0000","last_became_peered":"2023-08-17T00:06:00.457044+0000","last_unstale":"2023-08-17T00:06:00.873257+0000","last_undegraded":"2023-08-17T00:06:00.873257+0000","last_fullsized":"2023-08-17T00:06:00.873257+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.905847+0000","last_change":"2023-08-17T00:06:00.894649+0000","last_active":"2023-08-17T00:06:00.905847+0000","last_peered":"2023-08-17T00:06:00.905847+0000","last_clean":"2023-08-17T00:06:00.905847+0000","last_became_active":"2023-08-17T00:06:00.894368+0000","last_became_peered":"2023-08-17T00:06:00.894368+0000","last_unstale":"2023-08-17T00:06:00.905847+0000","last_undegraded":"2023-08-17T00:06:00.905847+0000","last_fullsized":"2023-08-17T00:06:00.905847+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873609+0000","last_change":"2023-08-17T00:06:00.452535+0000","last_active":"2023-08-17T00:06:00.873609+0000","last_peered":"2023-08-17T00:06:00.873609+0000","last_clean":"2023-08-17T00:06:00.873609+0000","last_became_active":"2023-08-17T00:06:00.452247+0000","last_became_peered":"2023-08-17T00:06:00.452247+0000","last_unstale":"2023-08-17T00:06:00.873609+0000","last_undegraded":"2023-08-17T00:06:00.873609+0000","last_fullsized":"2023-08-17T00:06:00.873609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.910708+0000","last_change":"2023-08-17T00:06:00.904170+0000","last_active":"2023-08-17T00:06:00.910708+0000","last_peered":"2023-08-17T00:06:00.910708+0000","last_clean":"2023-08-17T00:06:00.910708+0000","last_became_active":"2023-08-17T00:06:00.903870+0000","last_became_peered":"2023-08-17T00:06:00.903870+0000","last_unstale":"2023-08-17T00:06:00.910708+0000","last_undegraded":"2023-08-17T00:06:00.910708+0000","last_fullsized":"2023-08-17T00:06:00.910708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.873858+0000","last_change":"2023-08-17T00:06:00.454465+0000","last_active":"2023-08-17T00:06:00.873858+0000","last_peered":"2023-08-17T00:06:00.873858+0000","last_clean":"2023-08-17T00:06:00.873858+0000","last_became_active":"2023-08-17T00:06:00.454185+0000","last_became_peered":"2023-08-17T00:06:00.454185+0000","last_unstale":"2023-08-17T00:06:00.873858+0000","last_undegraded":"2023-08-17T00:06:00.873858+0000","last_fullsized":"2023-08-17T00:06:00.873858+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.880796+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:06:00.880796+0000","last_peered":"2023-08-17T00:06:00.880796+0000","last_clean":"2023-08-17T00:06:00.880796+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:06:00.880796+0000","last_undegraded":"2023-08-17T00:06:00.880796+0000","last_fullsized":"2023-08-17T00:06:00.880796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.895667+0000","last_change":"2023-08-17T00:06:00.894031+0000","last_active":"2023-08-17T00:06:00.895667+0000","last_peered":"2023-08-17T00:06:00.895667+0000","last_clean":"2023-08-17T00:06:00.895667+0000","last_became_active":"2023-08-17T00:06:00.893724+0000","last_became_peered":"2023-08-17T00:06:00.893724+0000","last_unstale":"2023-08-17T00:06:00.895667+0000","last_undegraded":"2023-08-17T00:06:00.895667+0000","last_fullsized":"2023-08-17T00:06:00.895667+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.874292+0000","last_change":"2023-08-17T00:06:00.454036+0000","last_active":"2023-08-17T00:06:00.874292+0000","last_peered":"2023-08-17T00:06:00.874292+0000","last_clean":"2023-08-17T00:06:00.874292+0000","last_became_active":"2023-08-17T00:06:00.452677+0000","last_became_peered":"2023-08-17T00:06:00.452677+0000","last_unstale":"2023-08-17T00:06:00.874292+0000","last_undegraded":"2023-08-17T00:06:00.874292+0000","last_fullsized":"2023-08-17T00:06:00.874292+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875629+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:00.875629+0000","last_peered":"2023-08-17T00:06:00.875629+0000","last_clean":"2023-08-17T00:06:00.875629+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:00.875629+0000","last_undegraded":"2023-08-17T00:06:00.875629+0000","last_fullsized":"2023-08-17T00:06:00.875629+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.905863+0000","last_change":"2023-08-17T00:06:00.901368+0000","last_active":"2023-08-17T00:06:00.905863+0000","last_peered":"2023-08-17T00:06:00.905863+0000","last_clean":"2023-08-17T00:06:00.905863+0000","last_became_active":"2023-08-17T00:06:00.901068+0000","last_became_peered":"2023-08-17T00:06:00.901068+0000","last_unstale":"2023-08-17T00:06:00.905863+0000","last_undegraded":"2023-08-17T00:06:00.905863+0000","last_fullsized":"2023-08-17T00:06:00.905863+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.881339+0000","last_change":"2023-08-17T00:06:00.460845+0000","last_active":"2023-08-17T00:06:00.881339+0000","last_peered":"2023-08-17T00:06:00.881339+0000","last_clean":"2023-08-17T00:06:00.881339+0000","last_became_active":"2023-08-17T00:06:00.460532+0000","last_became_peered":"2023-08-17T00:06:00.460532+0000","last_unstale":"2023-08-17T00:06:00.881339+0000","last_undegraded":"2023-08-17T00:06:00.881339+0000","last_fullsized":"2023-08-17T00:06:00.881339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.886820+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:06:00.886820+0000","last_peered":"2023-08-17T00:06:00.886820+0000","last_clean":"2023-08-17T00:06:00.886820+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:06:00.886820+0000","last_undegraded":"2023-08-17T00:06:00.886820+0000","last_fullsized":"2023-08-17T00:06:00.886820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.892064+0000","last_change":"2023-08-17T00:06:00.885231+0000","last_active":"2023-08-17T00:06:00.892064+0000","last_peered":"2023-08-17T00:06:00.892064+0000","last_clean":"2023-08-17T00:06:00.892064+0000","last_became_active":"2023-08-17T00:06:00.884876+0000","last_became_peered":"2023-08-17T00:06:00.884876+0000","last_unstale":"2023-08-17T00:06:00.892064+0000","last_undegraded":"2023-08-17T00:06:00.892064+0000","last_fullsized":"2023-08-17T00:06:00.892064+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.876087+0000","last_change":"2023-08-17T00:06:00.454704+0000","last_active":"2023-08-17T00:06:00.876087+0000","last_peered":"2023-08-17T00:06:00.876087+0000","last_clean":"2023-08-17T00:06:00.876087+0000","last_became_active":"2023-08-17T00:06:00.454382+0000","last_became_peered":"2023-08-17T00:06:00.454382+0000","last_unstale":"2023-08-17T00:06:00.876087+0000","last_undegraded":"2023-08-17T00:06:00.876087+0000","last_fullsized":"2023-08-17T00:06:00.876087+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.874136+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:06:00.874136+0000","last_peered":"2023-08-17T00:06:00.874136+0000","last_clean":"2023-08-17T00:06:00.874136+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:06:00.874136+0000","last_undegraded":"2023-08-17T00:06:00.874136+0000","last_fullsized":"2023-08-17T00:06:00.874136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.899194+0000","last_change":"2023-08-17T00:06:00.896052+0000","last_active":"2023-08-17T00:06:00.899194+0000","last_peered":"2023-08-17T00:06:00.899194+0000","last_clean":"2023-08-17T00:06:00.899194+0000","last_became_active":"2023-08-17T00:06:00.895741+0000","last_became_peered":"2023-08-17T00:06:00.895741+0000","last_unstale":"2023-08-17T00:06:00.899194+0000","last_undegraded":"2023-08-17T00:06:00.899194+0000","last_fullsized":"2023-08-17T00:06:00.899194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"49'2","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.898623+0000","last_change":"2023-08-17T00:06:00.463097+0000","last_active":"2023-08-17T00:06:00.898623+0000","last_peered":"2023-08-17T00:06:00.898623+0000","last_clean":"2023-08-17T00:06:00.898623+0000","last_became_active":"2023-08-17T00:06:00.462819+0000","last_became_peered":"2023-08-17T00:06:00.462819+0000","last_unstale":"2023-08-17T00:06:00.898623+0000","last_undegraded":"2023-08-17T00:06:00.898623+0000","last_fullsized":"2023-08-17T00:06:00.898623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.882143+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:06:00.882143+0000","last_peered":"2023-08-17T00:06:00.882143+0000","last_clean":"2023-08-17T00:06:00.882143+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:06:00.882143+0000","last_undegraded":"2023-08-17T00:06:00.882143+0000","last_fullsized":"2023-08-17T00:06:00.882143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.901533+0000","last_change":"2023-08-17T00:06:00.886705+0000","last_active":"2023-08-17T00:06:00.901533+0000","last_peered":"2023-08-17T00:06:00.901533+0000","last_clean":"2023-08-17T00:06:00.901533+0000","last_became_active":"2023-08-17T00:06:00.886424+0000","last_became_peered":"2023-08-17T00:06:00.886424+0000","last_unstale":"2023-08-17T00:06:00.901533+0000","last_undegraded":"2023-08-17T00:06:00.901533+0000","last_fullsized":"2023-08-17T00:06:00.901533+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.875074+0000","last_change":"2023-08-17T00:06:00.452582+0000","last_active":"2023-08-17T00:06:00.875074+0000","last_peered":"2023-08-17T00:06:00.875074+0000","last_clean":"2023-08-17T00:06:00.875074+0000","last_became_active":"2023-08-17T00:06:00.452169+0000","last_became_peered":"2023-08-17T00:06:00.452169+0000","last_unstale":"2023-08-17T00:06:00.875074+0000","last_undegraded":"2023-08-17T00:06:00.875074+0000","last_fullsized":"2023-08-17T00:06:00.875074+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.887734+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:06:00.887734+0000","last_peered":"2023-08-17T00:06:00.887734+0000","last_clean":"2023-08-17T00:06:00.887734+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:06:00.887734+0000","last_undegraded":"2023-08-17T00:06:00.887734+0000","last_fullsized":"2023-08-17T00:06:00.887734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.891318+0000","last_change":"2023-08-17T00:06:00.885487+0000","last_active":"2023-08-17T00:06:00.891318+0000","last_peered":"2023-08-17T00:06:00.891318+0000","last_clean":"2023-08-17T00:06:00.891318+0000","last_became_active":"2023-08-17T00:06:00.884939+0000","last_became_peered":"2023-08-17T00:06:00.884939+0000","last_unstale":"2023-08-17T00:06:00.891318+0000","last_undegraded":"2023-08-17T00:06:00.891318+0000","last_fullsized":"2023-08-17T00:06:00.891318+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.886722+0000","last_change":"2023-08-17T00:06:00.463148+0000","last_active":"2023-08-17T00:06:00.886722+0000","last_peered":"2023-08-17T00:06:00.886722+0000","last_clean":"2023-08-17T00:06:00.886722+0000","last_became_active":"2023-08-17T00:06:00.462463+0000","last_became_peered":"2023-08-17T00:06:00.462463+0000","last_unstale":"2023-08-17T00:06:00.886722+0000","last_undegraded":"2023-08-17T00:06:00.886722+0000","last_fullsized":"2023-08-17T00:06:00.886722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.886514+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:06:00.886514+0000","last_peered":"2023-08-17T00:06:00.886514+0000","last_clean":"2023-08-17T00:06:00.886514+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:06:00.886514+0000","last_undegraded":"2023-08-17T00:06:00.886514+0000","last_fullsized":"2023-08-17T00:06:00.886514+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.898116+0000","last_change":"2023-08-17T00:06:00.894668+0000","last_active":"2023-08-17T00:06:00.898116+0000","last_peered":"2023-08-17T00:06:00.898116+0000","last_clean":"2023-08-17T00:06:00.898116+0000","last_became_active":"2023-08-17T00:06:00.894282+0000","last_became_peered":"2023-08-17T00:06:00.894282+0000","last_unstale":"2023-08-17T00:06:00.898116+0000","last_undegraded":"2023-08-17T00:06:00.898116+0000","last_fullsized":"2023-08-17T00:06:00.898116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:00.418153+0000","last_clean_scrub_stamp":"2023-08-17T00:06:00.418153+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.874307+0000","last_change":"2023-08-17T00:06:00.448529+0000","last_active":"2023-08-17T00:06:00.874307+0000","last_peered":"2023-08-17T00:06:00.874307+0000","last_clean":"2023-08-17T00:06:00.874307+0000","last_became_active":"2023-08-17T00:06:00.448277+0000","last_became_peered":"2023-08-17T00:06:00.448277+0000","last_unstale":"2023-08-17T00:06:00.874307+0000","last_undegraded":"2023-08-17T00:06:00.874307+0000","last_fullsized":"2023-08-17T00:06:00.874307+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:05:59.403077+0000","last_clean_scrub_stamp":"2023-08-17T00:05:59.403077+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.880596+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:06:00.880596+0000","last_peered":"2023-08-17T00:06:00.880596+0000","last_clean":"2023-08-17T00:06:00.880596+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:06:00.880596+0000","last_undegraded":"2023-08-17T00:06:00.880596+0000","last_fullsized":"2023-08-17T00:06:00.880596+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":35,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-08-17T00:06:00.881412+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:06:00.881412+0000","last_peered":"2023-08-17T00:06:00.881412+0000","last_clean":"2023-08-17T00:06:00.881412+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:06:00.881412+0000","last_undegraded":"2023-08-17T00:06:00.881412+0000","last_fullsized":"2023-08-17T00:06:00.881412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542186,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065968,"statfs":{"total":96636764160,"available":96323551232,"internally_reserved":0,"allocated":598016,"data_stored":258078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.306,"15min":1.4350000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.909,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":1.01},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.337,"15min":1.4890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4710000000000001,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":1.131}]},{"osd":1,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.353,"15min":1.5009999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":0.875},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.345,"15min":1.4890000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4299999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.236,"15min":1.3460000000000001},"min":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3400000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":1.296},{"interface":"front","average":{"1min":1.147,"5min":1.395,"15min":1.5149999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8120000000000001,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.2490000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2849999999999999,"15min":1.373},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.357,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.454},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.6220000000000001,"15min":1.788},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.958,"5min":13.074999999999999,"15min":13.074999999999999},"last":1.407}]},{"osd":4,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.5720000000000001,"15min":1.778},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6419999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.4870000000000001,"15min":1.6259999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4470000000000001,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.379}]},{"osd":5,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.716,"15min":1.9199999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.012,"5min":14.435,"15min":14.435},"last":1.353},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.6699999999999999,"15min":1.8520000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6779999999999999,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.242}]},{"osd":6,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.6890000000000001,"15min":1.8540000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.7649999999999999,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.333},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.6140000000000001,"15min":1.754},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.706,"5min":11.365,"15min":11.365},"last":1.181}]}]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309960,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061880,"statfs":{"total":96636764160,"available":96319365120,"internally_reserved":0,"allocated":589824,"data_stored":257200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0389999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.6509999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.032},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":1.2050000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.089,"15min":1.077},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.99399999999999999,"15min":0.97199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":1.181}]},{"osd":2,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.2559999999999998,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":1.151},{"interface":"front","average":{"1min":1.284,"5min":1.2290000000000001,"15min":1.244},"min":{"1min":0.873,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.2989999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.145,"15min":1.137},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.284},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.304,"15min":1.276},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.4409999999999998,"5min":5.29,"15min":5.29},"last":1.345}]},{"osd":4,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2410000000000001,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.105}]},{"osd":5,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2989999999999999,"15min":1.27},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.3599999999999999,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.377}]},{"osd":7,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3009999999999999,"15min":1.2989999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":4.6429999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4570000000000001,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.8999999999999999,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.2589999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065968,"statfs":{"total":96636764160,"available":96323551232,"internally_reserved":0,"allocated":598016,"data_stored":257864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.468,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2410000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":1.131},{"interface":"front","average":{"1min":1.083,"5min":1.6379999999999999,"15min":1.9119999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4670000000000001,"5min":16.838999999999999,"15min":16.838999999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2110000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.494,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.169},{"interface":"front","average":{"1min":1.079,"5min":1.4159999999999999,"15min":1.5760000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.462,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":1.2190000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.6619999999999999,"15min":1.9179999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4179999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.516,"15min":1.7},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.367,"5min":11.949,"15min":11.949},"last":1.246}]},{"osd":3,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.5649999999999999,"15min":1.754},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.575,"5min":13.125,"15min":13.125},"last":1.272},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.4630000000000001,"15min":1.6060000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.327}]},{"osd":4,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.734,"15min":1.98},"min":{"1min":0.877,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.591,"5min":17.510000000000002,"15min":17.510000000000002},"last":1.292},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.8819999999999999,"15min":2.1680000000000001},"min":{"1min":0.92500000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":19.591000000000001,"15min":19.591000000000001},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.8280000000000001,"15min":2.0899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.7350000000000001,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.29,"5min":1.825,"15min":2.0840000000000001},"min":{"1min":0.79400000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":17.050000000000001,"15min":17.050000000000001},"last":1.008}]},{"osd":7,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.966,"15min":2.2250000000000001},"min":{"1min":1.0089999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.2599999999999998,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.861,"15min":2.0710000000000002},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8120000000000001,"5min":14.818,"15min":14.818},"last":1.375}]}]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305864,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065976,"statfs":{"total":96636764160,"available":96323559424,"internally_reserved":0,"allocated":589824,"data_stored":257220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.79200000000000004,"15min":0.78400000000000003},"min":{"1min":0.40000000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.2909999999999999,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":1.1539999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82599999999999996,"15min":0.85599999999999998},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.173,"5min":1.224,"15min":1.224},"last":0.92600000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":0.81200000000000006},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.282,"5min":1.357,"15min":1.357},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.93300000000000005,"15min":0.96099999999999997},"min":{"1min":0.498,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89300000000000002,"15min":0.93200000000000005},"min":{"1min":0.48599999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.756,"5min":1.756,"15min":1.756},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.0369999999999999,"15min":1.0600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3340000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.206,"15min":1.236},"min":{"1min":0.69399999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":3.9449999999999998,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.736},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.234,"15min":1.2529999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":3.9790000000000001,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.54}]},{"osd":5,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.2310000000000001,"15min":1.2709999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.389},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2889999999999999,"15min":1.3149999999999999},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.429}]},{"osd":6,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.288,"15min":1.3140000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.514},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.206,"15min":1.2430000000000001},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":1.462}]},{"osd":7,"last update":"Thu Aug 17 00:05:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.2310000000000001,"15min":1.2889999999999999},"min":{"1min":0.76800000000000002,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.488,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.587},{"interface":"front","average":{"1min":1.151,"5min":1.2490000000000001,"15min":1.288},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.5249999999999999,"5min":1.756,"15min":1.756},"last":1.7889999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309968,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061872,"statfs":{"total":96636764160,"available":96319356928,"internally_reserved":0,"allocated":598016,"data_stored":258610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.91600000000000004},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1439999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.827,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.79500000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2549999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0840000000000001,"15min":1.149},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9159999999999999,"5min":3.911,"15min":3.911},"last":1.1799999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.3080000000000001},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9530000000000001,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.002},{"interface":"front","average":{"1min":1.032,"5min":1.03,"15min":1.0800000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.2530000000000001,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.83899999999999997}]},{"osd":4,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.7290000000000001,"15min":2.04},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6739999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":1.04},{"interface":"front","average":{"1min":1.23,"5min":1.5509999999999999,"15min":1.7330000000000001},"min":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.0649999999999999,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.4359999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.681,"15min":1.889},"min":{"1min":0.748,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1440000000000001,"5min":12.914,"15min":12.914},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4910000000000001,"15min":1.645},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.4890000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.6419999999999999,"15min":1.861},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7689999999999999,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.6830000000000001,"15min":1.899},"min":{"1min":0.86199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.2210000000000001,"5min":12.698,"15min":12.698},"last":1.5449999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.6479999999999999,"15min":1.8240000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.72,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.403},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.651,"15min":1.8340000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.956,"5min":11.417,"15min":11.417},"last":1.5129999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301764,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94070076,"statfs":{"total":96636764160,"available":96327757824,"internally_reserved":0,"allocated":585728,"data_stored":257130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.496,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2110000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.878,"5min":0.97599999999999998,"15min":0.92200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4359999999999999,"5min":13.093,"15min":13.093},"last":0.86699999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.91500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1639999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":1.145}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.353,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":1.228},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.054,"15min":1.0289999999999999},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.234,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.82199999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2969999999999999,"15min":1.2},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.222,"5min":20.548999999999999,"15min":20.548999999999999},"last":1.042},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.272,"15min":1.258},"min":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.492,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.3260000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.4239999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.4810000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.133},{"interface":"front","average":{"1min":1.194,"5min":1.294,"15min":1.3069999999999999},"min":{"1min":0.82599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.446,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.1120000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3400000000000001,"15min":1.302},"min":{"1min":0.84599999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.4830000000000001,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.24,"15min":1.2350000000000001},"min":{"1min":0.77900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4490000000000001,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":0.93600000000000005}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5580000000000001,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.4359999999999999,"15min":1.4199999999999999},"min":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.492,"5min":13.131,"15min":13.131},"last":1.0920000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305868,"kb_used_data":580,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065972,"statfs":{"total":96636764160,"available":96323555328,"internally_reserved":0,"allocated":593920,"data_stored":257754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.752,"15min":0.78900000000000003},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.3120000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78100000000000003,"15min":0.79900000000000004},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.236,"5min":1.423,"15min":1.423},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0900000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.02},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.87,"15min":0.88900000000000001},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.292,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.85199999999999998,"15min":0.875},"min":{"1min":0.48699999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":1.0069999999999999,"15min":1.0489999999999999},"min":{"1min":0.52100000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.194,"5min":1.611,"15min":1.611},"last":1.0920000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1040000000000001,"15min":1.135},"min":{"1min":0.747,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.431,"5min":1.619,"15min":1.619},"last":0.995},{"interface":"front","average":{"1min":1.153,"5min":1.194,"15min":1.212},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.3740000000000001,"5min":1.905,"15min":1.905},"last":1.173}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.2370000000000001,"15min":1.2989999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3879999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.377},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.266,"15min":1.3220000000000001},"min":{"1min":0.77800000000000002,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4750000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2989999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.2769999999999999,"15min":1.3200000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5669999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.242,"15min":1.292},"min":{"1min":0.85199999999999998,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.4950000000000001,"5min":1.72,"15min":1.72},"last":1.3240000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.256,"15min":1.2989999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.5029999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.119},{"interface":"front","average":{"1min":1.198,"5min":1.24,"15min":1.2909999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.524,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.238}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065968,"statfs":{"total":96636764160,"available":96323551232,"internally_reserved":0,"allocated":598016,"data_stored":257796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":1.0249999999999999,"15min":1.091},"min":{"1min":0.47199999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.292,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":1.1359999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":1.012,"15min":1.071},"min":{"1min":0.41999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.149,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1819999999999999,"5min":1.1639999999999999,"15min":1.1990000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.0470000000000002,"5min":3.0470000000000002,"15min":3.0470000000000002},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.226,"15min":1.2749999999999999},"min":{"1min":0.51700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":3.0110000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.0509999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.117,"15min":1.161},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.581,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":1.204},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.129,"15min":1.194},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.335,"5min":1.617,"15min":1.617},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.1080000000000001,"15min":1.1659999999999999},"min":{"1min":0.79600000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1930000000000001,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.238},{"interface":"front","average":{"1min":1.101,"5min":1.218,"15min":1.2729999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.4870000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.1970000000000001,"15min":1.2310000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.4390000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.23,"15min":1.29},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.3480000000000001,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1.3260000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.306,"15min":1.3740000000000001},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6240000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.294},{"interface":"front","average":{"1min":1.169,"5min":1.391,"15min":1.47},"min":{"1min":0.82099999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.4490000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":1.226}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.282,"15min":1.347},"min":{"1min":0.873,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.403,"5min":1.9990000000000001,"15min":1.9990000000000001},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.3779999999999999,"15min":1.45},"min":{"1min":0.78600000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.5289999999999999,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:05.505 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:06:05.505 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:06:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333f439700 1 Processor -- start 2023-08-17T00:06:05.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333f439700 1 -- start start 2023-08-17T00:06:05.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333f439700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33380c57a0 0x7f33380c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333f439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33380bfd10 con 0x7f3338153f50 2023-08-17T00:06:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333f439700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3338158420 con 0x7f33380c11b0 2023-08-17T00:06:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333f439700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3338154af0 con 0x7f33380c57a0 2023-08-17T00:06:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333dc36700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3338153f50 0x7f3338157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37616/0 (socket says 172.21.15.153:37616) 2023-08-17T00:06:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333dc36700 1 -- 172.21.15.153:0/2785846752 learned_addr learned my addr 172.21.15.153:0/2785846752 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.700+0000 7f333e437700 1 --2- 172.21.15.153:0/2785846752 >> v2:172.21.15.178:3300/0 conn(0x7f33380c57a0 0x7f33380c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333e437700 1 -- 172.21.15.153:0/2785846752 >> v1:172.21.15.178:6789/0 conn(0x7f33380c11b0 legacy=0x7f3338157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333d435700 1 -- 172.21.15.153:0/2785846752 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151599426 0 0) 0x7f33380bfd10 con 0x7f3338153f50 2023-08-17T00:06:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333e437700 1 -- 172.21.15.153:0/2785846752 >> v1:172.21.15.153:6789/0 conn(0x7f3338153f50 legacy=0x7f3338157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333e437700 1 -- 172.21.15.153:0/2785846752 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338154dd0 con 0x7f33380c57a0 2023-08-17T00:06:05.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333e437700 1 --2- 172.21.15.153:0/2785846752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33380c57a0 0x7f33380c5b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3334009760 tx=0x7f3334009060).ready entity=mon.1 client_cookie=118e943c891222a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333d435700 1 -- 172.21.15.153:0/2785846752 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400b580 con 0x7f33380c57a0 2023-08-17T00:06:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333d435700 1 -- 172.21.15.153:0/2785846752 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333400b6e0 con 0x7f33380c57a0 2023-08-17T00:06:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333d435700 1 -- 172.21.15.153:0/2785846752 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400ba60 con 0x7f33380c57a0 2023-08-17T00:06:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 -- 172.21.15.153:0/2785846752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33380c57a0 msgr2=0x7f33380c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 --2- 172.21.15.153:0/2785846752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33380c57a0 0x7f33380c5b80 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f3334009760 tx=0x7f3334009060).stop 2023-08-17T00:06:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 -- 172.21.15.153:0/2785846752 shutdown_connections 2023-08-17T00:06:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 --2- 172.21.15.153:0/2785846752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33380c57a0 0x7f33380c5b80 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 -- 172.21.15.153:0/2785846752 >> 172.21.15.153:0/2785846752 conn(0x7f3338062a70 msgr2=0x7f33380ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 -- 172.21.15.153:0/2785846752 shutdown_connections 2023-08-17T00:06:05.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.704+0000 7f333f439700 1 -- 172.21.15.153:0/2785846752 wait complete. 2023-08-17T00:06:05.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 Processor -- start 2023-08-17T00:06:05.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 -- start start 2023-08-17T00:06:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 0x7f3338157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c57a0 0x7f3338164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338153f50 0x7f3338143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33380c3420 con 0x7f33380c11b0 2023-08-17T00:06:05.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338165000 con 0x7f3338153f50 2023-08-17T00:06:05.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333f439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33381652e0 con 0x7f33380c57a0 2023-08-17T00:06:05.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 0x7f3338157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 0x7f3338157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43504/0 (socket says 172.21.15.153:43504) 2023-08-17T00:06:05.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 -- 172.21.15.153:0/2785000668 learned_addr learned my addr 172.21.15.153:0/2785000668 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:05.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333dc36700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c57a0 0x7f3338164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333ec38700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338153f50 0x7f3338143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 -- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c57a0 msgr2=0x7f3338164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c57a0 0x7f3338164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 -- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338153f50 msgr2=0x7f3338143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338153f50 0x7f3338143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333e437700 1 -- 172.21.15.153:0/2785000668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33340092a0 con 0x7f33380c11b0 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333ec38700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338153f50 0x7f3338143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.708+0000 7f333dc36700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c57a0 0x7f3338164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f333e437700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 0x7f3338157d60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f3334009eb0 tx=0x7f3334017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:05.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400ba60 con 0x7f33380c11b0 2023-08-17T00:06:05.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33381655c0 con 0x7f33380c11b0 2023-08-17T00:06:05.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334000c90 con 0x7f33380c11b0 2023-08-17T00:06:05.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333401b650 con 0x7f33380c11b0 2023-08-17T00:06:05.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3338164c30 con 0x7f33380c11b0 2023-08-17T00:06:05.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333806b4c0 con 0x7f33380c11b0 2023-08-17T00:06:05.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.712+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f333402a070 con 0x7f33380c11b0 2023-08-17T00:06:05.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.716+0000 7f332e7fc700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f331c05a150 0x7f331c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:05.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.716+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f33340759b0 con 0x7f33380c11b0 2023-08-17T00:06:05.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.716+0000 7f333dc36700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f331c05a150 0x7f331c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:05.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.716+0000 7f333dc36700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f331c05a150 0x7f331c05c610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3338162360 tx=0x7f3328009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:05.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.720+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3334049350 con 0x7f33380c11b0 2023-08-17T00:06:05.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.932+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f33380bf9a0 con 0x7f33380c11b0 2023-08-17T00:06:05.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.940+0000 7f332e7fc700 1 -- 172.21.15.153:0/2785000668 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3334028020 con 0x7f33380c11b0 2023-08-17T00:06:05.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f331c05a150 msgr2=0x7f331c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f331c05a150 0x7f331c05c610 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3338162360 tx=0x7f3328009040).stop 2023-08-17T00:06:05.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 msgr2=0x7f3338157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 0x7f3338157d60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f3334009eb0 tx=0x7f3334017000).stop 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 shutdown_connections 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f331c05a150 0x7f331c05c610 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3338153f50 0x7f3338143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33380c57a0 0x7f3338164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 --2- 172.21.15.153:0/2785000668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33380c11b0 0x7f3338157d60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:05.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 >> 172.21.15.153:0/2785000668 conn(0x7f3338062a70 msgr2=0x7f33380ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:05.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 shutdown_connections 2023-08-17T00:06:05.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:05.944+0000 7f333f439700 1 -- 172.21.15.153:0/2785000668 wait complete. 2023-08-17T00:06:05.951 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:06:05.969 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:06.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.120+0000 7f1402df9700 1 Processor -- start 2023-08-17T00:06:06.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1402df9700 1 -- start start 2023-08-17T00:06:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1402df9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f13fc0689c0 0x7f13fc068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1402df9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13fc151530 0x7f13fc1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1402df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13fc065da0 con 0x7f13fc1560f0 2023-08-17T00:06:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1402df9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc155c60 con 0x7f13fc0689c0 2023-08-17T00:06:06.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1402df9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc156550 con 0x7f13fc151530 2023-08-17T00:06:06.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f14015f6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f13fc1560f0 0x7f13fc0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37626/0 (socket says 172.21.15.153:37626) 2023-08-17T00:06:06.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f14015f6700 1 -- 172.21.15.153:0/2311158417 learned_addr learned my addr 172.21.15.153:0/2311158417 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:06.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1401df7700 1 --2- 172.21.15.153:0/2311158417 >> v2:172.21.15.153:3300/0 conn(0x7f13fc0689c0 0x7f13fc068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f14025f8700 1 --2- 172.21.15.153:0/2311158417 >> v2:172.21.15.178:3300/0 conn(0x7f13fc151530 0x7f13fc1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1400df5700 1 -- 172.21.15.153:0/2311158417 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252886057 0 0) 0x7f13fc065da0 con 0x7f13fc1560f0 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1400df5700 1 -- 172.21.15.153:0/2311158417 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e80033f0 con 0x7f13fc1560f0 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1401df7700 1 -- 172.21.15.153:0/2311158417 >> v2:172.21.15.178:3300/0 conn(0x7f13fc151530 msgr2=0x7f13fc1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1401df7700 1 --2- 172.21.15.153:0/2311158417 >> v2:172.21.15.178:3300/0 conn(0x7f13fc151530 0x7f13fc1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1401df7700 1 -- 172.21.15.153:0/2311158417 >> v1:172.21.15.153:6789/0 conn(0x7f13fc1560f0 legacy=0x7f13fc0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1401df7700 1 -- 172.21.15.153:0/2311158417 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc065ff0 con 0x7f13fc0689c0 2023-08-17T00:06:06.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.124+0000 7f1401df7700 1 --2- 172.21.15.153:0/2311158417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0689c0 0x7f13fc068da0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f13fc063b00 tx=0x7f13f8009780).ready entity=mon.0 client_cookie=982b70ffb76411a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1400df5700 1 -- 172.21.15.153:0/2311158417 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800e070 con 0x7f13fc0689c0 2023-08-17T00:06:06.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1400df5700 1 -- 172.21.15.153:0/2311158417 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f800bb60 con 0x7f13fc0689c0 2023-08-17T00:06:06.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1400df5700 1 -- 172.21.15.153:0/2311158417 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8012410 con 0x7f13fc0689c0 2023-08-17T00:06:06.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 -- 172.21.15.153:0/2311158417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0689c0 msgr2=0x7f13fc068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 --2- 172.21.15.153:0/2311158417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0689c0 0x7f13fc068da0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f13fc063b00 tx=0x7f13f8009780).stop 2023-08-17T00:06:06.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 -- 172.21.15.153:0/2311158417 shutdown_connections 2023-08-17T00:06:06.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 --2- 172.21.15.153:0/2311158417 >> v2:172.21.15.178:3300/0 conn(0x7f13fc151530 0x7f13fc1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 --2- 172.21.15.153:0/2311158417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0689c0 0x7f13fc068da0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 -- 172.21.15.153:0/2311158417 >> 172.21.15.153:0/2311158417 conn(0x7f13fc0c6620 msgr2=0x7f13fc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:06.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 -- 172.21.15.153:0/2311158417 shutdown_connections 2023-08-17T00:06:06.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.128+0000 7f1402df9700 1 -- 172.21.15.153:0/2311158417 wait complete. 2023-08-17T00:06:06.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 Processor -- start 2023-08-17T00:06:06.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 -- start start 2023-08-17T00:06:06.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0689c0 0x7f13fc0a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc151530 0x7f13fc0a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 0x7f13fc153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0c0a80 con 0x7f13fc1560f0 2023-08-17T00:06:06.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0a8140 con 0x7f13fc0689c0 2023-08-17T00:06:06.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0a8420 con 0x7f13fc151530 2023-08-17T00:06:06.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 0x7f13fc153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 0x7f13fc153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43528/0 (socket says 172.21.15.153:43528) 2023-08-17T00:06:06.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 -- 172.21.15.153:0/593146541 learned_addr learned my addr 172.21.15.153:0/593146541 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:06.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14015f6700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc151530 0x7f13fc0a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1401df7700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0689c0 0x7f13fc0a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 -- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc151530 msgr2=0x7f13fc0a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc151530 0x7f13fc0a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 -- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0689c0 msgr2=0x7f13fc0a50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0689c0 0x7f13fc0a50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 -- 172.21.15.153:0/593146541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8009a20 con 0x7f13fc1560f0 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1401df7700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0689c0 0x7f13fc0a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f14025f8700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 0x7f13fc153da0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f13f400d890 tx=0x7f13f4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f40125f0 con 0x7f13fc1560f0 2023-08-17T00:06:06.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4012750 con 0x7f13fc1560f0 2023-08-17T00:06:06.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc0a8700 con 0x7f13fc1560f0 2023-08-17T00:06:06.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.132+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4012ad0 con 0x7f13fc1560f0 2023-08-17T00:06:06.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.136+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc0a55e0 con 0x7f13fc1560f0 2023-08-17T00:06:06.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.136+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc0a5860 con 0x7f13fc1560f0 2023-08-17T00:06:06.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.136+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f13f4013480 con 0x7f13fc1560f0 2023-08-17T00:06:06.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.140+0000 7f13f1ffb700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13e005a150 0x7f13e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.140+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f13f4074350 con 0x7f13fc1560f0 2023-08-17T00:06:06.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.140+0000 7f1401df7700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13e005a150 0x7f13e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.140+0000 7f1401df7700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13e005a150 0x7f13e005c610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f13fc154870 tx=0x7f13f8009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.144+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13f4047da0 con 0x7f13fc1560f0 2023-08-17T00:06:06.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.336+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13fc0662d0 con 0x7f13fc1560f0 2023-08-17T00:06:06.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f13f1ffb700 1 -- 172.21.15.153:0/593146541 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f13f404b3c0 con 0x7f13fc1560f0 2023-08-17T00:06:06.344 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:06.344 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:03.881472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:06.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13e005a150 msgr2=0x7f13e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13e005a150 0x7f13e005c610 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f13fc154870 tx=0x7f13f8009780).stop 2023-08-17T00:06:06.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 msgr2=0x7f13fc153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 0x7f13fc153da0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f13f400d890 tx=0x7f13f4008040).stop 2023-08-17T00:06:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 shutdown_connections 2023-08-17T00:06:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13e005a150 0x7f13e005c610 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc1560f0 0x7f13fc153da0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc151530 0x7f13fc0a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 --2- 172.21.15.153:0/593146541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0689c0 0x7f13fc0a50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 >> 172.21.15.153:0/593146541 conn(0x7f13fc0c6620 msgr2=0x7f13fc0a8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 shutdown_connections 2023-08-17T00:06:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.340+0000 7f1402df9700 1 -- 172.21.15.153:0/593146541 wait complete. 2023-08-17T00:06:06.349 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 38 2023-08-17T00:06:06.404 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:06:06.400+0000 7fea97191700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:06:06.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:06:00.861959+0000', 'modified': '2023-08-17T00:06:03.881472+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5427}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5427': {'gid': 5427, 'name': 'c', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/1057651106', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 1057651106}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1057651106}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:06:06.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:06:06.772 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T00:06:06.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.928+0000 7f5412f07700 1 Processor -- start 2023-08-17T00:06:06.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.928+0000 7f5412f07700 1 -- start start 2023-08-17T00:06:06.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412f07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f540c068820 0x7f540c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412f07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f540c0a96d0 0x7f540c0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412f07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c1585a0 con 0x7f540c0a8df0 2023-08-17T00:06:06.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412f07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c0c1ba0 con 0x7f540c0a96d0 2023-08-17T00:06:06.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412f07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c066400 con 0x7f540c068820 2023-08-17T00:06:06.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5411f05700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f540c0a8df0 0x7f540c0c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37630/0 (socket says 172.21.15.153:37630) 2023-08-17T00:06:06.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5411f05700 1 -- 172.21.15.153:0/3944262021 learned_addr learned my addr 172.21.15.153:0/3944262021 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:06.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5411704700 1 --2- 172.21.15.153:0/3944262021 >> v2:172.21.15.178:3300/0 conn(0x7f540c068820 0x7f540c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412706700 1 --2- 172.21.15.153:0/3944262021 >> v2:172.21.15.153:3300/0 conn(0x7f540c0a96d0 0x7f540c0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5410f03700 1 -- 172.21.15.153:0/3944262021 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27132515 0 0) 0x7f540c1585a0 con 0x7f540c0a8df0 2023-08-17T00:06:06.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5410f03700 1 -- 172.21.15.153:0/3944262021 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f80033f0 con 0x7f540c0a8df0 2023-08-17T00:06:06.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412706700 1 -- 172.21.15.153:0/3944262021 >> v2:172.21.15.178:3300/0 conn(0x7f540c068820 msgr2=0x7f540c068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412706700 1 --2- 172.21.15.153:0/3944262021 >> v2:172.21.15.178:3300/0 conn(0x7f540c068820 0x7f540c068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412706700 1 -- 172.21.15.153:0/3944262021 >> v1:172.21.15.153:6789/0 conn(0x7f540c0a8df0 legacy=0x7f540c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.932+0000 7f5412706700 1 -- 172.21.15.153:0/3944262021 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c069170 con 0x7f540c0a96d0 2023-08-17T00:06:06.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412706700 1 --2- 172.21.15.153:0/3944262021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0a96d0 0x7f540c0a9b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f540c0c2ef0 tx=0x7f5404009780).ready entity=mon.0 client_cookie=22a10faded94f778 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5410f03700 1 -- 172.21.15.153:0/3944262021 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400e070 con 0x7f540c0a96d0 2023-08-17T00:06:06.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5410f03700 1 -- 172.21.15.153:0/3944262021 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400bab0 con 0x7f540c0a96d0 2023-08-17T00:06:06.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5410f03700 1 -- 172.21.15.153:0/3944262021 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540400be30 con 0x7f540c0a96d0 2023-08-17T00:06:06.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 -- 172.21.15.153:0/3944262021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0a96d0 msgr2=0x7f540c0a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 --2- 172.21.15.153:0/3944262021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0a96d0 0x7f540c0a9b60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f540c0c2ef0 tx=0x7f5404009780).stop 2023-08-17T00:06:06.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 -- 172.21.15.153:0/3944262021 shutdown_connections 2023-08-17T00:06:06.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 --2- 172.21.15.153:0/3944262021 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c0a96d0 0x7f540c0a9b60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 --2- 172.21.15.153:0/3944262021 >> v2:172.21.15.178:3300/0 conn(0x7f540c068820 0x7f540c068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 -- 172.21.15.153:0/3944262021 >> 172.21.15.153:0/3944262021 conn(0x7f540c0c6620 msgr2=0x7f540c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:06.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 -- 172.21.15.153:0/3944262021 shutdown_connections 2023-08-17T00:06:06.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 -- 172.21.15.153:0/3944262021 wait complete. 2023-08-17T00:06:06.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.936+0000 7f5412f07700 1 Processor -- start 2023-08-17T00:06:06.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 -- start start 2023-08-17T00:06:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 0x7f540c144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0a8df0 0x7f540c0bf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0a96d0 0x7f540c0bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c158ea0 con 0x7f540c068820 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1590f0 con 0x7f540c0a8df0 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c1593d0 con 0x7f540c0a96d0 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 0x7f540c144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 0x7f540c144280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43554/0 (socket says 172.21.15.153:43554) 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 -- 172.21.15.153:0/1381443357 learned_addr learned my addr 172.21.15.153:0/1381443357 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412706700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0a96d0 0x7f540c0bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411704700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0a8df0 0x7f540c0bf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 -- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0a96d0 msgr2=0x7f540c0bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0a96d0 0x7f540c0bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 -- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0a8df0 msgr2=0x7f540c0bf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0a8df0 0x7f540c0bf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 -- 172.21.15.153:0/1381443357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009a20 con 0x7f540c068820 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5411f05700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 0x7f540c144280 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f540800c410 tx=0x7f5408007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5401ffb700 1 -- 172.21.15.153:0/1381443357 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080072e0 con 0x7f540c068820 2023-08-17T00:06:06.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5401ffb700 1 -- 172.21.15.153:0/1381443357 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408007440 con 0x7f540c068820 2023-08-17T00:06:06.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5401ffb700 1 -- 172.21.15.153:0/1381443357 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408005880 con 0x7f540c068820 2023-08-17T00:06:06.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.940+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c1596b0 con 0x7f540c068820 2023-08-17T00:06:06.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.944+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c159c70 con 0x7f540c068820 2023-08-17T00:06:06.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.944+0000 7f5401ffb700 1 -- 172.21.15.153:0/1381443357 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5408010070 con 0x7f540c068820 2023-08-17T00:06:06.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5401ffb700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53f005a180 0x7f53f005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5401ffb700 1 -- 172.21.15.153:0/1381443357 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5408073720 con 0x7f540c068820 2023-08-17T00:06:06.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 Processor -- start 2023-08-17T00:06:06.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 -- start start 2023-08-17T00:06:06.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5411704700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53f005a180 0x7f53f005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1ef1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1efc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5411704700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53f005a180 0x7f53f005c640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f540c0c6e50 tx=0x7f53fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e1b5c0 con 0x1eabd90 2023-08-17T00:06:06.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e30e90 con 0x1ead380 2023-08-17T00:06:06.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1df7220 con 0x1ef1b60 2023-08-17T00:06:06.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1efc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1efc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43556/0 (socket says 172.21.15.153:43556) 2023-08-17T00:06:06.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 -- 172.21.15.153:0/1942499729 learned_addr learned my addr 172.21.15.153:0/1942499729 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:06.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5411f05700 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1ef1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5411704700 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 -- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 msgr2=0x1ef1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1ef1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 -- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 msgr2=0x1eab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 -- 172.21.15.153:0/1942499729 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e3c500 con 0x1eabd90 2023-08-17T00:06:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5411704700 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:06.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f5412706700 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1efc760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f54040070b0 tx=0x7f5404009780).ready entity=mon.0 client_cookie=b0daef7a27d769dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f53eeffd700 1 -- 172.21.15.153:0/1942499729 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54040070e0 con 0x1eabd90 2023-08-17T00:06:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.948+0000 7f53eeffd700 1 -- 172.21.15.153:0/1942499729 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400bcf0 con 0x1eabd90 2023-08-17T00:06:06.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f53eeffd700 1 -- 172.21.15.153:0/1942499729 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404012830 con 0x1eabd90 2023-08-17T00:06:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- 172.21.15.153:0/1942499729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 msgr2=0x1efc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1efc760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f54040070b0 tx=0x7f5404009780).stop 2023-08-17T00:06:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- 172.21.15.153:0/1942499729 shutdown_connections 2023-08-17T00:06:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1efc760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- 172.21.15.153:0/1942499729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1ef1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- 172.21.15.153:0/1942499729 >> 172.21.15.153:0/1942499729 conn(0x1c8f550 msgr2=0x1eb0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:06.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- 172.21.15.153:0/1942499729 shutdown_connections 2023-08-17T00:06:06.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- 172.21.15.153:0/1942499729 wait complete. 2023-08-17T00:06:06.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- start start 2023-08-17T00:06:06.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 Processor -- start 2023-08-17T00:06:06.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eaa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1eaa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1dfc110 con 0x1eabd90 2023-08-17T00:06:06.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eaac70 con 0x1ead380 2023-08-17T00:06:06.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ef4970 con 0x1ef1b60 2023-08-17T00:06:06.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.952+0000 7f541e52a740 10 client.0 ll_register_callbacks cb 0x1e683c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:06.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43562/0 (socket says 172.21.15.153:43562) 2023-08-17T00:06:06.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 -- 172.21.15.153:0/179527682 learned_addr learned my addr 172.21.15.153:0/179527682 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:06.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411704700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eaa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5412706700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1eaa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 -- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 msgr2=0x1eaa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1eaa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 -- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 msgr2=0x1eaa290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eaa290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 -- 172.21.15.153:0/179527682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c069170 con 0x1eabd90 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411704700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eaa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411f05700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f5408007db0 tx=0x7f540800f000).ready entity=mon.0 client_cookie=14750ab5ce51564 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:06.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 1 -- 172.21.15.153:0/179527682 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408005e80 con 0x1eabd90 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e26c60 con 0x1eabd90 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 1 -- 172.21.15.153:0/179527682 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f540804a380 con 0x1eabd90 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 1 -- 172.21.15.153:0/179527682 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5408046c80 con 0x1eabd90 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 10 client.5574 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1e29f80 con 0x1eabd90 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 1 -- 172.21.15.153:0/179527682 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e26c60 con 0x1eabd90 2023-08-17T00:06:06.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 1 -- 172.21.15.153:0/179527682 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5408046de0 con 0x1eabd90 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 10 client.5574 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 10 client.5574 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 20 client.5574 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1edcc60 0x1edbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 4 client.5574 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e1d1b0 con 0x1edcc60 2023-08-17T00:06:06.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411704700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1edcc60 0x1edbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f5411704700 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1edcc60 0x1edbdc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=35051d5e71829280 server_cookie=4e107f4101e46276 in_seq=0 out_seq=0 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.956+0000 7f53e7fff700 10 client.5574 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f53e7fff700 1 -- 172.21.15.153:0/179527682 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1e1d1b0 con 0x1edcc60 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f53e7fff700 10 client.5574 handle_command_reply: tid=0 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 client.5574 shutdown 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 msgr2=0x1ed5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f5408007db0 tx=0x7f540800f000).stop 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 shutdown_connections 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1edcc60 0x1edbdc0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1eaa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ead380 0x1eaa290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 --2- 172.21.15.153:0/179527682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f53e7fff700 0 client.5574 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 >> 172.21.15.153:0/179527682 conn(0x1c8f550 msgr2=0x1ef7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:06.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 shutdown_connections 2023-08-17T00:06:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 1 -- 172.21.15.153:0/179527682 wait complete. 2023-08-17T00:06:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.960+0000 7f541e52a740 20 client.5574 trim_cache size 0 max 16384 2023-08-17T00:06:06.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.976+0000 7f541e52a740 1 Processor -- start 2023-08-17T00:06:06.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.976+0000 7f541e52a740 1 -- start start 2023-08-17T00:06:06.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ead380 0x1ead760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ef1b60 0x1eadc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ef22a0 con 0x1eabd90 2023-08-17T00:06:06.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ef0120 con 0x1ef1b60 2023-08-17T00:06:06.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eafde0 con 0x1ead380 2023-08-17T00:06:06.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5412706700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ef1b60 0x1eadc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43568/0 (socket says 172.21.15.153:43568) 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 -- 172.21.15.153:0/3578690521 learned_addr learned my addr 172.21.15.153:0/3578690521 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411704700 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ead380 0x1ead760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 -- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ead380 msgr2=0x1ead760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ead380 0x1ead760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 -- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ef1b60 msgr2=0x1eadc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ef1b60 0x1eadc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 -- 172.21.15.153:0/3578690521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c0bc320 con 0x1eabd90 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5412706700 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ef1b60 0x1eadc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f5411f05700 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f540800cfd0 tx=0x7f540805c000).ready entity=mon.0 client_cookie=a0b5bc23f3d13ecc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f53ef7fe700 1 -- 172.21.15.153:0/3578690521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408005e80 con 0x1eabd90 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f53ef7fe700 1 -- 172.21.15.153:0/3578690521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540804ac00 con 0x1eabd90 2023-08-17T00:06:06.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f53ef7fe700 1 -- 172.21.15.153:0/3578690521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540804a380 con 0x1eabd90 2023-08-17T00:06:06.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 -- 172.21.15.153:0/3578690521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 msgr2=0x1ed5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.980+0000 7f541e52a740 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5360 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f540800cfd0 tx=0x7f540805c000).stop 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 -- 172.21.15.153:0/3578690521 shutdown_connections 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ef1b60 0x1eadc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ead380 0x1ead760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 --2- 172.21.15.153:0/3578690521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1eabd90 0x1ed5360 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 -- 172.21.15.153:0/3578690521 >> 172.21.15.153:0/3578690521 conn(0x1c8f550 msgr2=0x1eda420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:06.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 -- 172.21.15.153:0/3578690521 shutdown_connections 2023-08-17T00:06:06.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 -- 172.21.15.153:0/3578690521 wait complete. 2023-08-17T00:06:06.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 -- start start 2023-08-17T00:06:06.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.984+0000 7f541e52a740 1 Processor -- start 2023-08-17T00:06:06.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eabd90 0x1eadba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 0x1f57eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1f583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f111d0 con 0x1ead380 2023-08-17T00:06:06.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f126a0 con 0x1eabd90 2023-08-17T00:06:06.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eae890 con 0x1ef1b60 2023-08-17T00:06:06.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 10 client.0 ll_register_callbacks cb 0x7f540804a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 0x1f57eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 0x1f57eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43584/0 (socket says 172.21.15.153:43584) 2023-08-17T00:06:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 -- 172.21.15.153:0/4058100624 learned_addr learned my addr 172.21.15.153:0/4058100624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411f05700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eabd90 0x1eadba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5412706700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1f583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 -- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 msgr2=0x1f583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1f583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 -- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eabd90 msgr2=0x1eadba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eabd90 0x1eadba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 -- 172.21.15.153:0/4058100624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e3c500 con 0x1ead380 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f5411704700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 0x1f57eb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f540c1582c0 tx=0x7f53fc016000).ready entity=mon.0 client_cookie=2b65e3832ee07cae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:06.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f53e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f53e7fff700 1 -- 172.21.15.153:0/4058100624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc027e70 con 0x1ead380 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f540400bcf0 con 0x1ead380 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f53e7fff700 1 -- 172.21.15.153:0/4058100624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f53fc015690 con 0x1ead380 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f53e7fff700 1 -- 172.21.15.153:0/4058100624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53fc015aa0 con 0x1ead380 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 10 client.5580 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1e29f80 con 0x1ead380 2023-08-17T00:06:06.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f53e7fff700 1 -- 172.21.15.153:0/4058100624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540400bcf0 con 0x1ead380 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f53e7fff700 1 -- 172.21.15.153:0/4058100624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f53fc015c00 con 0x1ead380 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 10 client.5580 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 10 client.5580 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 20 client.5580 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1f5c490 0x1f5c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 4 client.5580 mds_command: new command op to 5427 tid=0[{"prefix": "status"}] 2023-08-17T00:06:06.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.988+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ce64e0 con 0x1f5c490 2023-08-17T00:06:06.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5411f05700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1f5c490 0x1f5c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f53e7fff700 10 client.5580 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5411f05700 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1f5c490 0x1f5c870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ae51fe34d8cb5a52 server_cookie=555e483b6c38b1dd in_seq=0 out_seq=0 2023-08-17T00:06:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f53e7fff700 1 -- 172.21.15.153:0/4058100624 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1ce64e0 con 0x1f5c490 2023-08-17T00:06:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f53e7fff700 10 client.5580 handle_command_reply: tid=0 2023-08-17T00:06:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 client.5580 shutdown 2023-08-17T00:06:07.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 msgr2=0x1f57eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 0x1f57eb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f540c1582c0 tx=0x7f53fc016000).stop 2023-08-17T00:06:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 shutdown_connections 2023-08-17T00:06:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1f5c490 0x1f5c870 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ef1b60 0x1f583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f53e7fff700 0 client.5580 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:07.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ead380 0x1f57eb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 --2- 172.21.15.153:0/4058100624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1eabd90 0x1eadba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 >> 172.21.15.153:0/4058100624 conn(0x1c8f550 msgr2=0x1edbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:07.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 shutdown_connections 2023-08-17T00:06:07.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 1 -- 172.21.15.153:0/4058100624 wait complete. 2023-08-17T00:06:07.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f541e52a740 20 client.5580 trim_cache size 0 max 16384 2023-08-17T00:06:07.002 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:06:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:06:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 5427, 2023-08-17T00:06:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:06:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:06:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:06:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.129099268, 2023-08-17T00:06:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 38, 2023-08-17T00:06:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 50, 2023-08-17T00:06:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 50, 2023-08-17T00:06:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.522482778000001 2023-08-17T00:06:07.004 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:07.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53f005a180 msgr2=0x7f53f005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53f005a180 0x7f53f005c640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f540c0c6e50 tx=0x7f53fc008040).stop 2023-08-17T00:06:07.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 msgr2=0x7f540c144280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 0x7f540c144280 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f540800c410 tx=0x7f5408007b00).stop 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 shutdown_connections 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53f005a180 0x7f53f005c640 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f540c0a96d0 0x7f540c0bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f540c0a8df0 0x7f540c0bf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 --2- 172.21.15.153:0/1381443357 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f540c068820 0x7f540c144280 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 >> 172.21.15.153:0/1381443357 conn(0x7f540c0c6620 msgr2=0x7f540c0c59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:07.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 shutdown_connections 2023-08-17T00:06:07.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:06.992+0000 7f5412f07700 1 -- 172.21.15.153:0/1381443357 wait complete. 2023-08-17T00:06:07.017 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:06:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.140+0000 7f94f359e700 1 Processor -- start 2023-08-17T00:06:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.140+0000 7f94f359e700 1 -- start start 2023-08-17T00:06:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94f4153a40 0x7f94f40c08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153e20 0x7f94f40c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94f4061f00 0x7f94f4062390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f4062880 con 0x7f94f4153a40 2023-08-17T00:06:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40c9c00 con 0x7f94f4061f00 2023-08-17T00:06:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40c9ee0 con 0x7f94f4153e20 2023-08-17T00:06:07.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94f4153a40 0x7f94f40c08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94f4153a40 0x7f94f40c08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43594/0 (socket says 172.21.15.153:43594) 2023-08-17T00:06:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 -- 172.21.15.153:0/1534799990 learned_addr learned my addr 172.21.15.153:0/1534799990 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f2d9d700 1 --2- 172.21.15.153:0/1534799990 >> v2:172.21.15.178:3300/0 conn(0x7f94f4061f00 0x7f94f4062390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f1d9b700 1 --2- 172.21.15.153:0/1534799990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153e20 0x7f94f40c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 -- 172.21.15.153:0/1534799990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153e20 msgr2=0x7f94f40c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 --2- 172.21.15.153:0/1534799990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153e20 0x7f94f40c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 -- 172.21.15.153:0/1534799990 >> v2:172.21.15.178:3300/0 conn(0x7f94f4061f00 msgr2=0x7f94f4062390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:07.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 --2- 172.21.15.153:0/1534799990 >> v2:172.21.15.178:3300/0 conn(0x7f94f4061f00 0x7f94f4062390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 -- 172.21.15.153:0/1534799990 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40ca1c0 con 0x7f94f4153a40 2023-08-17T00:06:07.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f259c700 1 --2- 172.21.15.153:0/1534799990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4153a40 0x7f94f40c08a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f94f40ad850 tx=0x7f94e40090f0).ready entity=mon.0 client_cookie=caf0e9c4714680f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:07.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f159a700 1 -- 172.21.15.153:0/1534799990 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e400f510 con 0x7f94f4153a40 2023-08-17T00:06:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f159a700 1 -- 172.21.15.153:0/1534799990 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e400f670 con 0x7f94f4153a40 2023-08-17T00:06:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.144+0000 7f94f159a700 1 -- 172.21.15.153:0/1534799990 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e400f9f0 con 0x7f94f4153a40 2023-08-17T00:06:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 -- 172.21.15.153:0/1534799990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4153a40 msgr2=0x7f94f40c08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 --2- 172.21.15.153:0/1534799990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4153a40 0x7f94f40c08a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f94f40ad850 tx=0x7f94e40090f0).stop 2023-08-17T00:06:07.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 -- 172.21.15.153:0/1534799990 shutdown_connections 2023-08-17T00:06:07.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 --2- 172.21.15.153:0/1534799990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153e20 0x7f94f40c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 --2- 172.21.15.153:0/1534799990 >> v2:172.21.15.178:3300/0 conn(0x7f94f4061f00 0x7f94f4062390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 --2- 172.21.15.153:0/1534799990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4153a40 0x7f94f40c08a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 -- 172.21.15.153:0/1534799990 >> 172.21.15.153:0/1534799990 conn(0x7f94f4063da0 msgr2=0x7f94f4067820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 -- 172.21.15.153:0/1534799990 shutdown_connections 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 -- 172.21.15.153:0/1534799990 wait complete. 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 Processor -- start 2023-08-17T00:06:07.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.148+0000 7f94f359e700 1 -- start start 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4061f00 0x7f94f4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 0x7f94f40aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f4153e20 0x7f94f40aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40ab030 con 0x7f94f4061f00 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4156fa0 con 0x7f94f4153e20 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40abad0 con 0x7f94f4153a40 2023-08-17T00:06:07.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4061f00 0x7f94f4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 0x7f94f40aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f2d9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f4153e20 0x7f94f40aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 0x7f94f40aa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:56350/0 (socket says 172.21.15.153:56350) 2023-08-17T00:06:07.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 -- 172.21.15.153:0/2845099242 learned_addr learned my addr 172.21.15.153:0/2845099242 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:07.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 -- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f4153e20 msgr2=0x7f94f40aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f4153e20 0x7f94f40aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 -- 172.21.15.153:0/2845099242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4061f00 msgr2=0x7f94f4154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4061f00 0x7f94f4154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 -- 172.21.15.153:0/2845099242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e4009370 con 0x7f94f4153a40 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f1d9b700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 0x7f94f40aa650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f94e800e930 tx=0x7f94e8009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8012600 con 0x7f94f4153a40 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8012760 con 0x7f94f4153a40 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f40abe50 con 0x7f94f4153a40 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e8012ae0 con 0x7f94f4153a40 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.152+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f40ab510 con 0x7f94f4153a40 2023-08-17T00:06:07.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.156+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f40abfe0 con 0x7f94f4153a40 2023-08-17T00:06:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.156+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f94e8022070 con 0x7f94f4153a40 2023-08-17T00:06:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.156+0000 7f94e27fc700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94d405a150 0x7f94d405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:07.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.156+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f94e80743a0 con 0x7f94f4153a40 2023-08-17T00:06:07.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.160+0000 7f94f259c700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94d405a150 0x7f94d405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:07.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.160+0000 7f94f259c700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94d405a150 0x7f94d405c610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f94e4009130 tx=0x7f94e4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:07.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.168+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94e8047d40 con 0x7f94f4153a40 2023-08-17T00:06:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.364+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94f40ca4a0 con 0x7f94f4153a40 2023-08-17T00:06:07.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.364+0000 7f94e27fc700 1 -- 172.21.15.153:0/2845099242 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94e8016070 con 0x7f94f4153a40 2023-08-17T00:06:07.370 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:06:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94d405a150 msgr2=0x7f94d405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94d405a150 0x7f94d405c610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f94e4009130 tx=0x7f94e4017000).stop 2023-08-17T00:06:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 msgr2=0x7f94f40aa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 0x7f94f40aa650 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f94e800e930 tx=0x7f94e8009060).stop 2023-08-17T00:06:07.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 shutdown_connections 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94d405a150 0x7f94d405c610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94f4153e20 0x7f94f40aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94f4153a40 0x7f94f40aa650 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 --2- 172.21.15.153:0/2845099242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94f4061f00 0x7f94f4154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 >> 172.21.15.153:0/2845099242 conn(0x7f94f4063da0 msgr2=0x7f94f40bff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 shutdown_connections 2023-08-17T00:06:07.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:07.368+0000 7f94f359e700 1 -- 172.21.15.153:0/2845099242 wait complete. 2023-08-17T00:06:07.390 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:06:07.390 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:06:07.390 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:06:07.391 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:06:07.391 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:06:07.391 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:06:07.391 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:06:07.392 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:06:07.392 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:06:07.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.393 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:06:07.410 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:06:07.410 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:06:07.411 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:06:07.412 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42246sec preferred_lft 42246sec 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:06:07.413 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.414 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:06:07.415 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:06:07.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.416 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:06:07.486 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:06:07.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.489 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:06:07.550 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:06:07.550 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:06:07.551 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:06:07.551 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:06:07.551 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:06:07.551 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:06:07.551 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:06:07.551 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:06:07.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.553 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:06:07.553 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:06:07.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:06:07.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:06:07.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:06:07.554 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:06:07.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.690 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:06:07.707 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:06:07.707 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:06:07.708 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:06:07.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:06:07.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.787 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:06:07.844 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:06:07.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:06:07.968 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:06:07.968 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:06:07.991 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:06:07.992 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:06:07.997 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:06:07.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:07.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:06:08.029 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2023-08-17T00:06:08.030 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2023-08-17T00:06:08.030 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2023-08-17T00:06:08.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:08.031 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2023-08-17T00:06:08.103 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:06:08.104 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:06:08.104 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:06:08.104 DEBUG:teuthology.orchestra.run.smithi153:> import json 2023-08-17T00:06:08.105 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2023-08-17T00:06:08.105 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:06:08.106 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:06:08.106 DEBUG:teuthology.orchestra.run.smithi153:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2023-08-17T00:06:08.106 DEBUG:teuthology.orchestra.run.smithi153:> except OSError as e: 2023-08-17T00:06:08.106 DEBUG:teuthology.orchestra.run.smithi153:> sys.exit(e.errno) 2023-08-17T00:06:08.107 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:06:08.107 DEBUG:teuthology.orchestra.run.smithi153:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-08-17T00:06:08.107 DEBUG:teuthology.orchestra.run.smithi153:> print(json.dumps( 2023-08-17T00:06:08.108 DEBUG:teuthology.orchestra.run.smithi153:> dict([(a, getattr(s, a)) for a in attrs]), 2023-08-17T00:06:08.108 DEBUG:teuthology.orchestra.run.smithi153:> indent=2)) 2023-08-17T00:06:08.108 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:06:08.421 INFO:teuthology.orchestra.run.smithi153.stderr:daemon-helper: command failed with exit status 2 2023-08-17T00:06:08.433 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-08-17T00:06:08.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:08.435 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2023-08-17T00:06:08.506 INFO:teuthology.orchestra.run.smithi153.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2023-08-17T00:06:08.866 INFO:teuthology.orchestra.run.smithi153.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2023-08-17T00:06:13.087 INFO:teuthology.orchestra.run.smithi153.stderr:Updating files: 45% (636/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 72% (1007/1398) Updating files: 72% (1013/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2023-08-17T00:06:13.094 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2023-08-17T00:06:13.095 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2023-08-17T00:06:13.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:13.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.288+0000 7f11b52b9700 1 Processor -- start 2023-08-17T00:06:13.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.288+0000 7f11b52b9700 1 -- start start 2023-08-17T00:06:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.288+0000 7f11b52b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11b00689c0 0x7f11b0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b01560f0 0x7f11b00c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b0065da0 con 0x7f11b0151530 2023-08-17T00:06:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b0155c60 con 0x7f11b00689c0 2023-08-17T00:06:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0156550 con 0x7f11b01560f0 2023-08-17T00:06:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11b00689c0 0x7f11b0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b01560f0 0x7f11b00c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11b00689c0 0x7f11b0068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:49700/0 (socket says 172.21.15.153:49700) 2023-08-17T00:06:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 -- 172.21.15.153:0/3808593333 learned_addr learned my addr 172.21.15.153:0/3808593333 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b4ab8700 1 --1- 172.21.15.153:0/3808593333 >> v1:172.21.15.178:6789/0 conn(0x7f11b0151530 0x7f11b01519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:51824/0 (socket says 172.21.15.153:51824) 2023-08-17T00:06:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 -- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b01560f0 msgr2=0x7f11b00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 --2- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b01560f0 0x7f11b00c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 -- 172.21.15.153:0/3808593333 >> v1:172.21.15.178:6789/0 conn(0x7f11b0151530 legacy=0x7f11b01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 -- 172.21.15.153:0/3808593333 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b0065ff0 con 0x7f11b00689c0 2023-08-17T00:06:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11affff700 1 --2- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b00689c0 0x7f11b0068da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f11a0009810 tx=0x7f11a0009060).ready entity=mon.1 client_cookie=eb212f0bf2ae80ca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11af7fe700 1 -- 172.21.15.153:0/3808593333 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0005880 con 0x7f11b00689c0 2023-08-17T00:06:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11af7fe700 1 -- 172.21.15.153:0/3808593333 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a00059e0 con 0x7f11b00689c0 2023-08-17T00:06:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11af7fe700 1 -- 172.21.15.153:0/3808593333 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0005d60 con 0x7f11b00689c0 2023-08-17T00:06:13.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b00689c0 msgr2=0x7f11b0068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 --2- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b00689c0 0x7f11b0068da0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f11a0009810 tx=0x7f11a0009060).stop 2023-08-17T00:06:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- 172.21.15.153:0/3808593333 shutdown_connections 2023-08-17T00:06:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 --2- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b01560f0 0x7f11b00c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 --2- 172.21.15.153:0/3808593333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b00689c0 0x7f11b0068da0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- 172.21.15.153:0/3808593333 >> 172.21.15.153:0/3808593333 conn(0x7f11b00c6620 msgr2=0x7f11b00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.292+0000 7f11b52b9700 1 -- 172.21.15.153:0/3808593333 shutdown_connections 2023-08-17T00:06:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.296+0000 7f11b52b9700 1 -- 172.21.15.153:0/3808593333 wait complete. 2023-08-17T00:06:13.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.296+0000 7f11b52b9700 1 Processor -- start 2023-08-17T00:06:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.296+0000 7f11b52b9700 1 -- start start 2023-08-17T00:06:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b00689c0 0x7f11b0150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 0x7f11b00ba960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b01560f0 0x7f11b01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0151310 con 0x7f11b0151530 2023-08-17T00:06:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0152e50 con 0x7f11b01560f0 2023-08-17T00:06:13.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0152240 con 0x7f11b00689c0 2023-08-17T00:06:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 0x7f11b00ba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 0x7f11b00ba960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43626/0 (socket says 172.21.15.153:43626) 2023-08-17T00:06:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 -- 172.21.15.153:0/337671708 learned_addr learned my addr 172.21.15.153:0/337671708 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11affff700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b00689c0 0x7f11b0150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b4ab8700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b01560f0 0x7f11b01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 -- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b00689c0 msgr2=0x7f11b0150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b00689c0 0x7f11b0150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 -- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b01560f0 msgr2=0x7f11b01532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b01560f0 0x7f11b01532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 -- 172.21.15.153:0/337671708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0009300 con 0x7f11b0151530 2023-08-17T00:06:13.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11a77fe700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 0x7f11b00ba960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f1198009ef0 tx=0x7f119800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119800cb70 con 0x7f11b0151530 2023-08-17T00:06:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119800f040 con 0x7f11b0151530 2023-08-17T00:06:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198013400 con 0x7f11b0151530 2023-08-17T00:06:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b0152520 con 0x7f11b0151530 2023-08-17T00:06:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.300+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b0152ae0 con 0x7f11b0151530 2023-08-17T00:06:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.304+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b0152fe0 con 0x7f11b0151530 2023-08-17T00:06:13.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.304+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1198013770 con 0x7f11b0151530 2023-08-17T00:06:13.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.304+0000 7f11acff9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119005a180 0x7f119005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.304+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1198074b20 con 0x7f11b0151530 2023-08-17T00:06:13.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.304+0000 7f11affff700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119005a180 0x7f119005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.308+0000 7f11affff700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119005a180 0x7f119005c640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f11a000b340 tx=0x7f11a0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.312+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1198048500 con 0x7f11b0151530 2023-08-17T00:06:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.504+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11b006b4c0 con 0x7f11b0151530 2023-08-17T00:06:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11acff9700 1 -- 172.21.15.153:0/337671708 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f119804bb20 con 0x7f11b0151530 2023-08-17T00:06:13.512 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:13.513 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:03.881472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119005a180 msgr2=0x7f119005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119005a180 0x7f119005c640 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f11a000b340 tx=0x7f11a0016000).stop 2023-08-17T00:06:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 msgr2=0x7f11b00ba960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 0x7f11b00ba960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f1198009ef0 tx=0x7f119800b040).stop 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 shutdown_connections 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119005a180 0x7f119005c640 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11b01560f0 0x7f11b01532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11b0151530 0x7f11b00ba960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 --2- 172.21.15.153:0/337671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11b00689c0 0x7f11b0150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 >> 172.21.15.153:0/337671708 conn(0x7f11b00c6620 msgr2=0x7f11b00bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 shutdown_connections 2023-08-17T00:06:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.508+0000 7f11b52b9700 1 -- 172.21.15.153:0/337671708 wait complete. 2023-08-17T00:06:13.517 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 38 2023-08-17T00:06:13.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/i/dont/exist 2023-08-17T00:06:13.685 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:13.685 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": -2 2023-08-17T00:06:13.685 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:13.699 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2023-08-17T00:06:13.700 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2023-08-17T00:06:13.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2023-08-17T00:06:13.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.856+0000 7f46a5a9b700 1 Processor -- start 2023-08-17T00:06:13.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.856+0000 7f46a5a9b700 1 -- start start 2023-08-17T00:06:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f46a5a9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f46a01518a0 0x7f46a0151c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f46a5a9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46a00a45f0 0x7f46a00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f46a5a9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a00a58e0 con 0x7f46a0069120 2023-08-17T00:06:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f46a5a9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00a6480 con 0x7f46a00a45f0 2023-08-17T00:06:13.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f46a5a9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a0069580 con 0x7f46a01518a0 2023-08-17T00:06:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f469ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46a00a45f0 0x7f46a00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f4697fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46a0069120 0x7f46a00a5d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37634/0 (socket says 172.21.15.153:37634) 2023-08-17T00:06:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f4697fff700 1 -- 172.21.15.153:0/3144364229 learned_addr learned my addr 172.21.15.153:0/3144364229 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:13.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.860+0000 7f469f7fe700 1 --2- 172.21.15.153:0/3144364229 >> v2:172.21.15.178:3300/0 conn(0x7f46a01518a0 0x7f46a0151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469effd700 1 -- 172.21.15.153:0/3144364229 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1391034279 0 0) 0x7f46a00a58e0 con 0x7f46a0069120 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469ffff700 1 -- 172.21.15.153:0/3144364229 >> v2:172.21.15.178:3300/0 conn(0x7f46a01518a0 msgr2=0x7f46a0151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469ffff700 1 --2- 172.21.15.153:0/3144364229 >> v2:172.21.15.178:3300/0 conn(0x7f46a01518a0 0x7f46a0151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469ffff700 1 -- 172.21.15.153:0/3144364229 >> v1:172.21.15.153:6789/0 conn(0x7f46a0069120 legacy=0x7f46a00a5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469ffff700 1 -- 172.21.15.153:0/3144364229 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00a4a40 con 0x7f46a00a45f0 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469ffff700 1 --2- 172.21.15.153:0/3144364229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a00a45f0 0x7f46a00c7740 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f46a006a720 tx=0x7f4698009780).ready entity=mon.0 client_cookie=5f7dcc7b7a01b6bf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469effd700 1 -- 172.21.15.153:0/3144364229 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800e070 con 0x7f46a00a45f0 2023-08-17T00:06:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469effd700 1 -- 172.21.15.153:0/3144364229 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800bb60 con 0x7f46a00a45f0 2023-08-17T00:06:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f469effd700 1 -- 172.21.15.153:0/3144364229 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698012410 con 0x7f46a00a45f0 2023-08-17T00:06:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 -- 172.21.15.153:0/3144364229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a00a45f0 msgr2=0x7f46a00c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/3144364229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a00a45f0 0x7f46a00c7740 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f46a006a720 tx=0x7f4698009780).stop 2023-08-17T00:06:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 -- 172.21.15.153:0/3144364229 shutdown_connections 2023-08-17T00:06:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/3144364229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a00a45f0 0x7f46a00c7740 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/3144364229 >> v2:172.21.15.178:3300/0 conn(0x7f46a01518a0 0x7f46a0151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 -- 172.21.15.153:0/3144364229 >> 172.21.15.153:0/3144364229 conn(0x7f46a00aa820 msgr2=0x7f46a00aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 -- 172.21.15.153:0/3144364229 shutdown_connections 2023-08-17T00:06:13.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.864+0000 7f46a5a9b700 1 -- 172.21.15.153:0/3144364229 wait complete. 2023-08-17T00:06:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 Processor -- start 2023-08-17T00:06:13.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 -- start start 2023-08-17T00:06:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a0069120 0x7f46a0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a00a45f0 0x7f46a0065ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 0x7f46a00c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00669e0 con 0x7f46a01518a0 2023-08-17T00:06:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0150a80 con 0x7f46a00a45f0 2023-08-17T00:06:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f46a5a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a0066700 con 0x7f46a0069120 2023-08-17T00:06:13.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 0x7f46a00c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 0x7f46a00c0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43640/0 (socket says 172.21.15.153:43640) 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 -- 172.21.15.153:0/803809690 learned_addr learned my addr 172.21.15.153:0/803809690 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469f7fe700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a0069120 0x7f46a0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f4697fff700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a00a45f0 0x7f46a0065ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 -- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a0069120 msgr2=0x7f46a0150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a0069120 0x7f46a0150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 -- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a00a45f0 msgr2=0x7f46a0065ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a00a45f0 0x7f46a0065ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.868+0000 7f469ffff700 1 -- 172.21.15.153:0/803809690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009a20 con 0x7f46a01518a0 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.872+0000 7f469ffff700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 0x7f46a00c0b10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f469800b6c0 tx=0x7f4698009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.872+0000 7f46977fe700 1 -- 172.21.15.153:0/803809690 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698021070 con 0x7f46a01518a0 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.872+0000 7f46977fe700 1 -- 172.21.15.153:0/803809690 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469801d630 con 0x7f46a01518a0 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.872+0000 7f46977fe700 1 -- 172.21.15.153:0/803809690 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469801d9f0 con 0x7f46a01518a0 2023-08-17T00:06:13.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.872+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a00a6760 con 0x7f46a01518a0 2023-08-17T00:06:13.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.872+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a00a6d20 con 0x7f46a01518a0 2023-08-17T00:06:13.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46977fe700 1 -- 172.21.15.153:0/803809690 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f469801dd60 con 0x7f46a01518a0 2023-08-17T00:06:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46977fe700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46977fe700 1 -- 172.21.15.153:0/803809690 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f46980762a0 con 0x7f46a01518a0 2023-08-17T00:06:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 Processor -- start 2023-08-17T00:06:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 -- start start 2023-08-17T00:06:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f469f7fe700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c58bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c5eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f469f7fe700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f4690009b20 tx=0x7f4690008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c9f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1baa280 con 0x1c83f20 2023-08-17T00:06:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c5d5a0 con 0x1c83b40 2023-08-17T00:06:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c5dad0 con 0x1c5dd90 2023-08-17T00:06:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c9f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43652/0 (socket says 172.21.15.153:43652) 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.876+0000 7f469ffff700 1 -- 172.21.15.153:0/2637626704 learned_addr learned my addr 172.21.15.153:0/2637626704 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469f7fe700 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c58bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f4697fff700 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c5eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469ffff700 1 -- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 msgr2=0x1c5eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469ffff700 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c5eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469ffff700 1 -- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 msgr2=0x1c58bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469ffff700 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c58bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469ffff700 1 -- 172.21.15.153:0/2637626704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bd80f0 con 0x1c83f20 2023-08-17T00:06:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f469ffff700 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c9f040 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f4698049da0 tx=0x7f469800e000).ready entity=mon.0 client_cookie=211dc4364e02fee0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f4694ff9700 1 -- 172.21.15.153:0/2637626704 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469804d8a0 con 0x1c83f20 2023-08-17T00:06:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f4694ff9700 1 -- 172.21.15.153:0/2637626704 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469804bca0 con 0x1c83f20 2023-08-17T00:06:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f4694ff9700 1 -- 172.21.15.153:0/2637626704 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4698010be0 con 0x1c83f20 2023-08-17T00:06:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 -- 172.21.15.153:0/2637626704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 msgr2=0x1c9f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c9f040 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f4698049da0 tx=0x7f469800e000).stop 2023-08-17T00:06:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 -- 172.21.15.153:0/2637626704 shutdown_connections 2023-08-17T00:06:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c9f040 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c5eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2637626704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c58bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 -- 172.21.15.153:0/2637626704 >> 172.21.15.153:0/2637626704 conn(0x1a3d890 msgr2=0x1c5e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 -- 172.21.15.153:0/2637626704 shutdown_connections 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 -- 172.21.15.153:0/2637626704 wait complete. 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 -- start start 2023-08-17T00:06:13.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.880+0000 7f46afe0f740 1 Processor -- start 2023-08-17T00:06:13.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c6eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c6f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c8aab0 con 0x1c83f20 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c85440 con 0x1c83b40 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c832e0 con 0x1c5dd90 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 10 client.0 ll_register_callbacks cb 0x1c15910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c6f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c6f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43654/0 (socket says 172.21.15.153:43654) 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 -- 172.21.15.153:0/1038785625 learned_addr learned my addr 172.21.15.153:0/1038785625 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469f7fe700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f4697fff700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c6eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 -- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 msgr2=0x1c88ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c88ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 -- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 msgr2=0x1c6eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c6eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 -- 172.21.15.153:0/1038785625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a00a6d20 con 0x1c83f20 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469ffff700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c6f030 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4698049e00 tx=0x7f4698030000).ready entity=mon.0 client_cookie=5ce269e0b5a223ea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f467dffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f467dffb700 1 -- 172.21.15.153:0/1038785625 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800e040 con 0x1c83f20 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f467dffb700 1 -- 172.21.15.153:0/1038785625 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f469804a0e0 con 0x1c83f20 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bd4dd0 con 0x1c83f20 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f467dffb700 1 -- 172.21.15.153:0/1038785625 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f469803aea0 con 0x1c83f20 2023-08-17T00:06:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 10 client.5604 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x1bd3590 con 0x1c83f20 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f467dffb700 1 -- 172.21.15.153:0/1038785625 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bd4dd0 con 0x1c83f20 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f467dffb700 1 -- 172.21.15.153:0/1038785625 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f469804cdf0 con 0x1c83f20 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 10 client.5604 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 10 client.5604 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 20 client.5604 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc4870 0x1cc6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 4 client.5604 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bcb320 con 0x1cc4870 2023-08-17T00:06:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.884+0000 7f469f7fe700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc4870 0x1cc6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f469f7fe700 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc4870 0x1cc6c60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b0d0a665e1790e0b server_cookie=b40b00d3ac9d3d81 in_seq=0 out_seq=0 2023-08-17T00:06:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f467dffb700 10 client.5604 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f467dffb700 1 -- 172.21.15.153:0/1038785625 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1bcb320 con 0x1cc4870 2023-08-17T00:06:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f467dffb700 10 client.5604 handle_command_reply: tid=0 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 client.5604 shutdown 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 msgr2=0x1c6f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c6f030 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f4698049e00 tx=0x7f4698030000).stop 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 shutdown_connections 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc4870 0x1cc6c60 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c6f030 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1c6eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 --2- 172.21.15.153:0/1038785625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f467dffb700 0 client.5604 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 >> 172.21.15.153:0/1038785625 conn(0x1a3d890 msgr2=0x1c56e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 shutdown_connections 2023-08-17T00:06:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 1 -- 172.21.15.153:0/1038785625 wait complete. 2023-08-17T00:06:13.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.888+0000 7f46afe0f740 20 client.5604 trim_cache size 0 max 16384 2023-08-17T00:06:13.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.904+0000 7f46afe0f740 1 Processor -- start 2023-08-17T00:06:13.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.904+0000 7f46afe0f740 1 -- start start 2023-08-17T00:06:13.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c87540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1cb1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c58970 con 0x1c83f20 2023-08-17T00:06:13.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ca5450 con 0x1c83b40 2023-08-17T00:06:13.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bb42f0 con 0x1c5dd90 2023-08-17T00:06:13.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c581b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43668/0 (socket says 172.21.15.153:43668) 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 -- 172.21.15.153:0/148704790 learned_addr learned my addr 172.21.15.153:0/148704790 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469f7fe700 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c87540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f4697fff700 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1cb1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 -- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 msgr2=0x1c87540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c87540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 -- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 msgr2=0x1cb1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1cb1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 -- 172.21.15.153:0/148704790 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c88e20 con 0x1c83f20 2023-08-17T00:06:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f469ffff700 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c581b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4698009870 tx=0x7f4698032070).ready entity=mon.0 client_cookie=977b5dabea9a7ea5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46957fa700 1 -- 172.21.15.153:0/148704790 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800e070 con 0x1c83f20 2023-08-17T00:06:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46957fa700 1 -- 172.21.15.153:0/148704790 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4698034070 con 0x1c83f20 2023-08-17T00:06:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46957fa700 1 -- 172.21.15.153:0/148704790 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469803aea0 con 0x1c83f20 2023-08-17T00:06:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- 172.21.15.153:0/148704790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 msgr2=0x1c581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c581b0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f4698009870 tx=0x7f4698032070).stop 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- 172.21.15.153:0/148704790 shutdown_connections 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83f20 0x1c581b0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c83b40 0x1cb1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 --2- 172.21.15.153:0/148704790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c5dd90 0x1c87540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- 172.21.15.153:0/148704790 >> 172.21.15.153:0/148704790 conn(0x1a3d890 msgr2=0x1ccac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- 172.21.15.153:0/148704790 shutdown_connections 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.908+0000 7f46afe0f740 1 -- 172.21.15.153:0/148704790 wait complete. 2023-08-17T00:06:13.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 -- start start 2023-08-17T00:06:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 Processor -- start 2023-08-17T00:06:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5dd90 0x1c57250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 0x1c58120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c83f20 0x1c9cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d0f7e0 con 0x1c83b40 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c9bd10 con 0x1c5dd90 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c57740 con 0x1c83f20 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 10 client.0 ll_register_callbacks cb 0x7f4698010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 0x1c58120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 0x1c58120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43684/0 (socket says 172.21.15.153:43684) 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 -- 172.21.15.153:0/2681528712 learned_addr learned my addr 172.21.15.153:0/2681528712 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f469ffff700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c83f20 0x1c9cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f469f7fe700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5dd90 0x1c57250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 -- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c83f20 msgr2=0x1c9cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c83f20 0x1c9cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 -- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5dd90 msgr2=0x1c57250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5dd90 0x1c57250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 -- 172.21.15.153:0/2681528712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1bd3590 con 0x1c83b40 2023-08-17T00:06:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f4697fff700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 0x1c58120 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x1c5e1d0 tx=0x7f4688009040).ready entity=mon.0 client_cookie=6cf712a96df9d983 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f467dffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f467dffb700 1 -- 172.21.15.153:0/2681528712 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688013c00 con 0x1c83b40 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f469804bca0 con 0x1c83b40 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.912+0000 7f467dffb700 1 -- 172.21.15.153:0/2681528712 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4688013d60 con 0x1c83b40 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 1 -- 172.21.15.153:0/2681528712 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46880072e0 con 0x1c83b40 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 10 client.5610 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x7f46a00c1360 con 0x1c83b40 2023-08-17T00:06:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 1 -- 172.21.15.153:0/2681528712 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469804bca0 con 0x1c83b40 2023-08-17T00:06:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 1 -- 172.21.15.153:0/2681528712 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4688005670 con 0x1c83b40 2023-08-17T00:06:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 10 client.5610 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 10 client.5610 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 20 client.5610 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1d0f110 0x1c9d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 4 client.5610 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x1a94820 con 0x1d0f110 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f469f7fe700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1d0f110 0x1c9d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f469f7fe700 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1d0f110 0x1c9d4d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c93dd0fa4dd1b52d server_cookie=33fb9c27c7a4542f in_seq=0 out_seq=0 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 10 client.5610 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 1 -- 172.21.15.153:0/2681528712 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x1a94820 con 0x1d0f110 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 10 client.5610 handle_command_reply: tid=0 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 client.5610 shutdown 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 msgr2=0x1c58120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 0x1c58120 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x1c5e1d0 tx=0x7f4688009040).stop 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 shutdown_connections 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1d0f110 0x1c9d4d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c83f20 0x1c9cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c83b40 0x1c58120 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f467dffb700 0 client.5610 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 --2- 172.21.15.153:0/2681528712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c5dd90 0x1c57250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 >> 172.21.15.153:0/2681528712 conn(0x1a3d890 msgr2=0x1ca3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 shutdown_connections 2023-08-17T00:06:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 1 -- 172.21.15.153:0/2681528712 wait complete. 2023-08-17T00:06:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.916+0000 7f46afe0f740 20 client.5610 trim_cache size 0 max 16384 2023-08-17T00:06:13.928 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:13.928 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": -2 2023-08-17T00:06:13.928 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 msgr2=0x7f468005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f4690009b20 tx=0x7f4690008040).stop 2023-08-17T00:06:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 msgr2=0x7f46a00c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 0x7f46a00c0b10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f469800b6c0 tx=0x7f4698009780).stop 2023-08-17T00:06:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 shutdown_connections 2023-08-17T00:06:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a01518a0 0x7f46a00c0b10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a00a45f0 0x7f46a0065ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 --2- 172.21.15.153:0/803809690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a0069120 0x7f46a0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 >> 172.21.15.153:0/803809690 conn(0x7f46a00aa820 msgr2=0x7f46a00c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 shutdown_connections 2023-08-17T00:06:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:13.920+0000 7f46a5a9b700 1 -- 172.21.15.153:0/803809690 wait complete. 2023-08-17T00:06:13.945 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2023-08-17T00:06:13.945 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2023-08-17T00:06:13.945 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2023-08-17T00:06:13.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:14.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.100+0000 7fc0d73b9700 1 Processor -- start 2023-08-17T00:06:14.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.100+0000 7fc0d73b9700 1 -- start start 2023-08-17T00:06:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d73b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0d00689c0 0x7fc0d0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d73b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0d0151530 0x7fc0d01519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d73b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d0065da0 con 0x7fc0d01560f0 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d73b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d0155c60 con 0x7fc0d0151530 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d73b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d0156550 con 0x7fc0d00689c0 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0d0151530 0x7fc0d01519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d63b7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0d00689c0 0x7fc0d0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0d0151530 0x7fc0d01519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43692/0 (socket says 172.21.15.153:43692) 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2334675677 learned_addr learned my addr 172.21.15.153:0/2334675677 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2334675677 >> v2:172.21.15.178:3300/0 conn(0x7fc0d00689c0 msgr2=0x7fc0d0068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 --2- 172.21.15.153:0/2334675677 >> v2:172.21.15.178:3300/0 conn(0x7fc0d00689c0 0x7fc0d0068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2334675677 >> v1:172.21.15.178:6789/0 conn(0x7fc0d01560f0 legacy=0x7fc0d00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2334675677 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d0065ff0 con 0x7fc0d0151530 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d6bb8700 1 --2- 172.21.15.153:0/2334675677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d0151530 0x7fc0d01519c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fc0d00c2d60 tx=0x7fc0c8009840).ready entity=mon.0 client_cookie=b6e67e13d1277695 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d53b5700 1 -- 172.21.15.153:0/2334675677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800e070 con 0x7fc0d0151530 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d53b5700 1 -- 172.21.15.153:0/2334675677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c800ba20 con 0x7fc0d0151530 2023-08-17T00:06:14.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.104+0000 7fc0d53b5700 1 -- 172.21.15.153:0/2334675677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c800bda0 con 0x7fc0d0151530 2023-08-17T00:06:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2334675677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d0151530 msgr2=0x7fc0d01519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2334675677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d0151530 0x7fc0d01519c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7fc0d00c2d60 tx=0x7fc0c8009840).stop 2023-08-17T00:06:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2334675677 shutdown_connections 2023-08-17T00:06:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2334675677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d0151530 0x7fc0d01519c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2334675677 >> v2:172.21.15.178:3300/0 conn(0x7fc0d00689c0 0x7fc0d0068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2334675677 >> 172.21.15.153:0/2334675677 conn(0x7fc0d00c6620 msgr2=0x7fc0d00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:14.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2334675677 shutdown_connections 2023-08-17T00:06:14.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2334675677 wait complete. 2023-08-17T00:06:14.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 Processor -- start 2023-08-17T00:06:14.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.108+0000 7fc0d73b9700 1 -- start start 2023-08-17T00:06:14.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0d00689c0 0x7fc0d01528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0d0151530 0x7fc0d0150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 0x7fc0d00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00a3be0 con 0x7fc0d01560f0 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00a61a0 con 0x7fc0d00689c0 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d00a6480 con 0x7fc0d0151530 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 0x7fc0d00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 0x7fc0d00a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43696/0 (socket says 172.21.15.153:43696) 2023-08-17T00:06:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2304740568 learned_addr learned my addr 172.21.15.153:0/2304740568 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:14.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d63b7700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0d00689c0 0x7fc0d01528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d5bb6700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0d0151530 0x7fc0d0150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0d0151530 msgr2=0x7fc0d0150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0d0151530 0x7fc0d0150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0d00689c0 msgr2=0x7fc0d01528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0d00689c0 0x7fc0d01528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 -- 172.21.15.153:0/2304740568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c8009ae0 con 0x7fc0d01560f0 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d6bb8700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 0x7fc0d00a57c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc0c800b6c0 tx=0x7fc0c8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c80092e0 con 0x7fc0d01560f0 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c801e470 con 0x7fc0d01560f0 2023-08-17T00:06:14.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d00a6760 con 0x7fc0d01560f0 2023-08-17T00:06:14.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c801e7f0 con 0x7fc0d01560f0 2023-08-17T00:06:14.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d0154e90 con 0x7fc0d01560f0 2023-08-17T00:06:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.112+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d00a3a10 con 0x7fc0d01560f0 2023-08-17T00:06:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.116+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc0c8025030 con 0x7fc0d01560f0 2023-08-17T00:06:14.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.116+0000 7fc0c67fc700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0b405a150 0x7fc0b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.116+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc0c80758e0 con 0x7fc0d01560f0 2023-08-17T00:06:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.116+0000 7fc0d63b7700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0b405a150 0x7fc0b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.120+0000 7fc0d63b7700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0b405a150 0x7fc0b405c610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc0cc009200 tx=0x7fc0cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.124+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0c8049280 con 0x7fc0d01560f0 2023-08-17T00:06:14.220 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:06:14.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:06:14.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.316+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0d00a3d20 con 0x7fc0d01560f0 2023-08-17T00:06:14.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.316+0000 7fc0c67fc700 1 -- 172.21.15.153:0/2304740568 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fc0c8023070 con 0x7fc0d01560f0 2023-08-17T00:06:14.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:14.323 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:03.881472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0b405a150 msgr2=0x7fc0b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0b405a150 0x7fc0b405c610 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fc0cc009200 tx=0x7fc0cc008040).stop 2023-08-17T00:06:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 msgr2=0x7fc0d00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 0x7fc0d00a57c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fc0c800b6c0 tx=0x7fc0c8009840).stop 2023-08-17T00:06:14.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 shutdown_connections 2023-08-17T00:06:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0b405a150 0x7fc0b405c610 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0d01560f0 0x7fc0d00a57c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0d0151530 0x7fc0d0150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 --2- 172.21.15.153:0/2304740568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0d00689c0 0x7fc0d01528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 >> 172.21.15.153:0/2304740568 conn(0x7fc0d00c6620 msgr2=0x7fc0d00c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:14.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 shutdown_connections 2023-08-17T00:06:14.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.320+0000 7fc0d73b9700 1 -- 172.21.15.153:0/2304740568 wait complete. 2023-08-17T00:06:14.327 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 38 2023-08-17T00:06:14.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/suites 2023-08-17T00:06:14.762 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:14.762 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:14.762 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:14.779 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:14.780 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2023-08-17T00:06:14.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2023-08-17T00:06:14.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.932+0000 7f727e307700 1 Processor -- start 2023-08-17T00:06:14.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.932+0000 7f727e307700 1 -- start start 2023-08-17T00:06:14.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727e307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780c5ea0 0x7f72780634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727e307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72780639a0 0x7f72780bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727e307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7278154e90 con 0x7f72780acf30 2023-08-17T00:06:14.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727e307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72780c1730 con 0x7f72780639a0 2023-08-17T00:06:14.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727e307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278063e10 con 0x7f72780c5ea0 2023-08-17T00:06:14.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727d305700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f72780acf30 0x7f72780c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37648/0 (socket says 172.21.15.153:37648) 2023-08-17T00:06:14.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727d305700 1 -- 172.21.15.153:0/3190941703 learned_addr learned my addr 172.21.15.153:0/3190941703 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727db06700 1 --2- 172.21.15.153:0/3190941703 >> v2:172.21.15.153:3300/0 conn(0x7f72780639a0 0x7f72780bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727cb04700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780c5ea0 0x7f72780634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f726ffff700 1 -- 172.21.15.153:0/3190941703 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804114587 0 0) 0x7f7278154e90 con 0x7f72780acf30 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f726ffff700 1 -- 172.21.15.153:0/3190941703 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72640033f0 con 0x7f72780acf30 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727db06700 1 -- 172.21.15.153:0/3190941703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780c5ea0 msgr2=0x7f72780634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727db06700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780c5ea0 0x7f72780634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727db06700 1 -- 172.21.15.153:0/3190941703 >> v1:172.21.15.153:6789/0 conn(0x7f72780acf30 legacy=0x7f72780c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727db06700 1 -- 172.21.15.153:0/3190941703 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278153fc0 con 0x7f72780639a0 2023-08-17T00:06:14.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727cb04700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780c5ea0 0x7f72780634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:14.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f727db06700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780bfad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f7270009e60 tx=0x7f7270009780).ready entity=mon.0 client_cookie=c204fc7222a2a675 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f726ffff700 1 -- 172.21.15.153:0/3190941703 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727000e070 con 0x7f72780639a0 2023-08-17T00:06:14.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f726ffff700 1 -- 172.21.15.153:0/3190941703 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000bb60 con 0x7f72780639a0 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.936+0000 7f726ffff700 1 -- 172.21.15.153:0/3190941703 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7270012410 con 0x7f72780639a0 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 -- 172.21.15.153:0/3190941703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 msgr2=0x7f72780bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780bfad0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f7270009e60 tx=0x7f7270009780).stop 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 -- 172.21.15.153:0/3190941703 shutdown_connections 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780bfad0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 --2- 172.21.15.153:0/3190941703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780c5ea0 0x7f72780634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 -- 172.21.15.153:0/3190941703 >> 172.21.15.153:0/3190941703 conn(0x7f72780cb330 msgr2=0x7f72780c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:14.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 -- 172.21.15.153:0/3190941703 shutdown_connections 2023-08-17T00:06:14.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 -- 172.21.15.153:0/3190941703 wait complete. 2023-08-17T00:06:14.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 Processor -- start 2023-08-17T00:06:14.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.940+0000 7f727e307700 1 -- start start 2023-08-17T00:06:14.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780acf30 0x7f7278152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7278153030 0x7f72780c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72780b07d0 con 0x7f72780639a0 2023-08-17T00:06:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72780b0340 con 0x7f7278153030 2023-08-17T00:06:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72780af730 con 0x7f72780acf30 2023-08-17T00:06:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43720/0 (socket says 172.21.15.153:43720) 2023-08-17T00:06:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 -- 172.21.15.153:0/572955500 learned_addr learned my addr 172.21.15.153:0/572955500 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:14.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727cb04700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780acf30 0x7f7278152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727db06700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7278153030 0x7f72780c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 -- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780acf30 msgr2=0x7f7278152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780acf30 0x7f7278152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 -- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7278153030 msgr2=0x7f72780c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7278153030 0x7f72780c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 -- 172.21.15.153:0/572955500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7270009a20 con 0x7f72780639a0 2023-08-17T00:06:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727d305700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780aef40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f7274001ed0 tx=0x7f7274007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f726d7fa700 1 -- 172.21.15.153:0/572955500 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72740072e0 con 0x7f72780639a0 2023-08-17T00:06:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f726d7fa700 1 -- 172.21.15.153:0/572955500 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274007440 con 0x7f72780639a0 2023-08-17T00:06:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f726d7fa700 1 -- 172.21.15.153:0/572955500 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72740057a0 con 0x7f72780639a0 2023-08-17T00:06:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72780afa10 con 0x7f72780639a0 2023-08-17T00:06:14.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.944+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72780affd0 con 0x7f72780639a0 2023-08-17T00:06:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.948+0000 7f726d7fa700 1 -- 172.21.15.153:0/572955500 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7274010070 con 0x7f72780639a0 2023-08-17T00:06:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.948+0000 7f726d7fa700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f725c05a150 0x7f725c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.948+0000 7f726d7fa700 1 -- 172.21.15.153:0/572955500 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f72740736a0 con 0x7f72780639a0 2023-08-17T00:06:14.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727cb04700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f725c05a150 0x7f725c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727cb04700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f725c05a150 0x7f725c05c610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f7268006d80 tx=0x7f7268008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 Processor -- start 2023-08-17T00:06:14.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 -- start start 2023-08-17T00:06:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 0x1145ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11899c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x1187420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x107cd70 con 0x11895e0 2023-08-17T00:06:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x116bed0 con 0x1186fa0 2023-08-17T00:06:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1144ac0 con 0x116c160 2023-08-17T00:06:14.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 0x1145ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 0x1145ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43724/0 (socket says 172.21.15.153:43724) 2023-08-17T00:06:14.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 -- 172.21.15.153:0/3552228392 learned_addr learned my addr 172.21.15.153:0/3552228392 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 -- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 msgr2=0x11899c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11899c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 -- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 msgr2=0x1187420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727db06700 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x1187420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x1187420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.952+0000 7f727d305700 1 -- 172.21.15.153:0/3552228392 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10c0120 con 0x11895e0 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f727d305700 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 0x1145ca0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f727404aa80 tx=0x7f727404c040).ready entity=mon.0 client_cookie=99201cd9b20e4da1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f72627fc700 1 -- 172.21.15.153:0/3552228392 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f727404f040 con 0x11895e0 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f72627fc700 1 -- 172.21.15.153:0/3552228392 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274049020 con 0x11895e0 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f72627fc700 1 -- 172.21.15.153:0/3552228392 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7274047520 con 0x11895e0 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 -- 172.21.15.153:0/3552228392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 msgr2=0x1145ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 0x1145ca0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f727404aa80 tx=0x7f727404c040).stop 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 -- 172.21.15.153:0/3552228392 shutdown_connections 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x1187420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11899c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 --2- 172.21.15.153:0/3552228392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11895e0 0x1145ca0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 -- 172.21.15.153:0/3552228392 >> 172.21.15.153:0/3552228392 conn(0xf25930 msgr2=0x1146370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 -- 172.21.15.153:0/3552228392 shutdown_connections 2023-08-17T00:06:14.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 -- 172.21.15.153:0/3552228392 wait complete. 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 -- start start 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 Processor -- start 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.956+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116c160 0x1172620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x1198180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x11436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11989d0 con 0x1186fa0 2023-08-17T00:06:14.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x118b2f0 con 0x116c160 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x118b540 con 0x11895e0 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 10 client.0 ll_register_callbacks cb 0x10fd880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x1198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x1198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60844/0 (socket says 172.21.15.153:60844) 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 -- 172.21.15.153:0/1294207253 learned_addr learned my addr 172.21.15.153:0/1294207253 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727d305700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116c160 0x1172620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727db06700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x11436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 -- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 msgr2=0x11436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x11436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 -- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116c160 msgr2=0x1172620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116c160 0x1172620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 -- 172.21.15.153:0/1294207253 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72780affd0 con 0x1186fa0 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727d305700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116c160 0x1172620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727cb04700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x1198180 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f72780c46a0 tx=0x7f7268014000).ready entity=mon.0 client_cookie=aef2d46b54e72a38 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f72577fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f72577fe700 1 -- 172.21.15.153:0/1294207253 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800b2b0 con 0x1186fa0 2023-08-17T00:06:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f72577fe700 1 -- 172.21.15.153:0/1294207253 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f726801e400 con 0x1186fa0 2023-08-17T00:06:14.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10bce00 con 0x1186fa0 2023-08-17T00:06:14.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f72577fe700 1 -- 172.21.15.153:0/1294207253 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726801e7d0 con 0x1186fa0 2023-08-17T00:06:14.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 10 client.5631 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:14.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x10bb5c0 con 0x1186fa0 2023-08-17T00:06:14.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f72577fe700 1 -- 172.21.15.153:0/1294207253 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10bce00 con 0x1186fa0 2023-08-17T00:06:14.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f72577fe700 1 -- 172.21.15.153:0/1294207253 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f726801e930 con 0x1186fa0 2023-08-17T00:06:14.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 10 client.5631 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 10 client.5631 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 20 client.5631 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1186180 0x1186560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 4 client.5631 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10b3350 con 0x1186180 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.960+0000 7f727d305700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1186180 0x1186560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f727d305700 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1186180 0x1186560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ba2df61356382a0 server_cookie=29ec4461854a56fc in_seq=0 out_seq=0 2023-08-17T00:06:14.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f72577fe700 10 client.5631 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f72577fe700 1 -- 172.21.15.153:0/1294207253 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x10b3350 con 0x1186180 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f72577fe700 10 client.5631 handle_command_reply: tid=0 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 client.5631 shutdown 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 msgr2=0x1198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x1198180 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f72780c46a0 tx=0x7f7268014000).stop 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 shutdown_connections 2023-08-17T00:06:14.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1186180 0x1186560 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x11436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x1198180 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f72577fe700 0 client.5631 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 --2- 172.21.15.153:0/1294207253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x116c160 0x1172620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 >> 172.21.15.153:0/1294207253 conn(0xf25930 msgr2=0x1169c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 shutdown_connections 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 1 -- 172.21.15.153:0/1294207253 wait complete. 2023-08-17T00:06:14.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.964+0000 7f7289928740 20 client.5631 trim_cache size 0 max 16384 2023-08-17T00:06:14.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 Processor -- start 2023-08-17T00:06:14.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 -- start start 2023-08-17T00:06:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x116c160 0x1141050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x116ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x116b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x109c670 con 0x116c160 2023-08-17T00:06:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x118bf30 con 0x1186fa0 2023-08-17T00:06:14.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1141810 con 0x11895e0 2023-08-17T00:06:14.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727db06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x116b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x116c160 0x1141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x116ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x116c160 0x1141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60860/0 (socket says 172.21.15.153:60860) 2023-08-17T00:06:14.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727d305700 1 -- 172.21.15.153:0/3462145817 learned_addr learned my addr 172.21.15.153:0/3462145817 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:14.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 -- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 msgr2=0x116b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x116b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 -- 172.21.15.153:0/3462145817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x116c160 msgr2=0x1141050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:14.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x116c160 0x1141050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 -- 172.21.15.153:0/3462145817 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72780c42d0 con 0x1186fa0 2023-08-17T00:06:14.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f727cb04700 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x116ce90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f72780c46a0 tx=0x7f7268021000).ready entity=mon.1 client_cookie=498866fb0e218794 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:14.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7262ffd700 1 -- 172.21.15.153:0/3462145817 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726800b290 con 0x1186fa0 2023-08-17T00:06:14.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.984+0000 7f7262ffd700 1 -- 172.21.15.153:0/3462145817 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726801e400 con 0x1186fa0 2023-08-17T00:06:14.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7262ffd700 1 -- 172.21.15.153:0/3462145817 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726801e9e0 con 0x1186fa0 2023-08-17T00:06:14.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 -- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 msgr2=0x116ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:14.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x116ce90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f72780c46a0 tx=0x7f7268021000).stop 2023-08-17T00:06:14.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 -- 172.21.15.153:0/3462145817 shutdown_connections 2023-08-17T00:06:14.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11895e0 0x116b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1186fa0 0x116ce90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 --2- 172.21.15.153:0/3462145817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x116c160 0x1141050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:14.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 -- 172.21.15.153:0/3462145817 >> 172.21.15.153:0/3462145817 conn(0xf25930 msgr2=0x116a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:14.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 -- 172.21.15.153:0/3462145817 shutdown_connections 2023-08-17T00:06:14.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 -- 172.21.15.153:0/3462145817 wait complete. 2023-08-17T00:06:14.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 -- start start 2023-08-17T00:06:14.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.988+0000 7f7289928740 1 Processor -- start 2023-08-17T00:06:14.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x11ef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11895e0 0x11efb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:14.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f09b0 con 0x1186fa0 2023-08-17T00:06:14.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1169dd0 con 0x11895e0 2023-08-17T00:06:14.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1197bf0 con 0x116c160 2023-08-17T00:06:14.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 10 client.0 ll_register_callbacks cb 0x7f726800fb30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:14.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x11ef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:14.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x11ef670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60862/0 (socket says 172.21.15.153:60862) 2023-08-17T00:06:14.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 -- 172.21.15.153:0/2065872916 learned_addr learned my addr 172.21.15.153:0/2065872916 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:15.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727d305700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727db06700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11895e0 0x11efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 -- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 msgr2=0x11e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:15.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 -- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11895e0 msgr2=0x11efb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:15.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11895e0 0x11efb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 -- 172.21.15.153:0/2065872916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x10bb5c0 con 0x1186fa0 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f727cb04700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x11ef670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f726800fa80 tx=0x7f726802e000).ready entity=mon.0 client_cookie=c04bae3d500cea5e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f72577fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f72577fe700 1 -- 172.21.15.153:0/2065872916 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268002f30 con 0x1186fa0 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7274049020 con 0x1186fa0 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f72577fe700 1 -- 172.21.15.153:0/2065872916 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7268040ca0 con 0x1186fa0 2023-08-17T00:06:15.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f72577fe700 1 -- 172.21.15.153:0/2065872916 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f726800b290 con 0x1186fa0 2023-08-17T00:06:15.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 10 client.5637 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:15.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x10bb310 con 0x1186fa0 2023-08-17T00:06:15.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f72577fe700 1 -- 172.21.15.153:0/2065872916 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7274049020 con 0x1186fa0 2023-08-17T00:06:15.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f72577fe700 1 -- 172.21.15.153:0/2065872916 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f726802da20 con 0x1186fa0 2023-08-17T00:06:15.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 10 client.5637 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:15.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 10 client.5637 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:15.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 20 client.5637 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:15.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x11f0050 0x11676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 4 client.5637 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2023-08-17T00:06:15.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.992+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0xf7c8c0 con 0x11f0050 2023-08-17T00:06:15.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f727d305700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x11f0050 0x11676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f727d305700 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x11f0050 0x11676e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=324ccb8dd65d37f1 server_cookie=794f012b7e715dc0 in_seq=0 out_seq=0 2023-08-17T00:06:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f72577fe700 10 client.5637 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f72577fe700 1 -- 172.21.15.153:0/2065872916 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xf7c8c0 con 0x11f0050 2023-08-17T00:06:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f72577fe700 10 client.5637 handle_command_reply: tid=0 2023-08-17T00:06:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 client.5637 shutdown 2023-08-17T00:06:15.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 msgr2=0x11ef670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x11ef670 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f726800fa80 tx=0x7f726802e000).stop 2023-08-17T00:06:15.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 shutdown_connections 2023-08-17T00:06:15.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x11f0050 0x11676e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11895e0 0x11efb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1186fa0 0x11ef670 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 --2- 172.21.15.153:0/2065872916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x116c160 0x11e6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f72577fe700 0 client.5637 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:15.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 >> 172.21.15.153:0/2065872916 conn(0xf25930 msgr2=0x116b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:15.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 shutdown_connections 2023-08-17T00:06:15.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 1 -- 172.21.15.153:0/2065872916 wait complete. 2023-08-17T00:06:15.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:14.996+0000 7f7289928740 20 client.5637 trim_cache size 0 max 16384 2023-08-17T00:06:15.009 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:15.010 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:15.010 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "1f6b5ede-6aaa-476d-a766-40dc39f6380e", 2023-08-17T00:06:15.010 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:15.011 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:15.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f725c05a150 msgr2=0x7f725c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f725c05a150 0x7f725c05c610 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f7268006d80 tx=0x7f7268008040).stop 2023-08-17T00:06:15.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 msgr2=0x7f72780aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780aef40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f7274001ed0 tx=0x7f7274007c70).stop 2023-08-17T00:06:15.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 shutdown_connections 2023-08-17T00:06:15.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f725c05a150 0x7f725c05c610 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7278153030 0x7f72780c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72780acf30 0x7f7278152b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 --2- 172.21.15.153:0/572955500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72780639a0 0x7f72780aef40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 >> 172.21.15.153:0/572955500 conn(0x7f72780cb330 msgr2=0x7f7278155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:15.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 shutdown_connections 2023-08-17T00:06:15.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.000+0000 7f727e307700 1 -- 172.21.15.153:0/572955500 wait complete. 2023-08-17T00:06:15.024 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': '1f6b5ede-6aaa-476d-a766-40dc39f6380e', 'mode': 'asynchronous'}' 2023-08-17T00:06:15.024 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-08-17T00:06:15.025 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2023-08-17T00:06:15.025 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.176+0000 7ffbd88da700 1 Processor -- start 2023-08-17T00:06:15.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.176+0000 7ffbd88da700 1 -- start start 2023-08-17T00:06:15.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffbd40a8df0 0x7ffbd40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbd4068820 0x7ffbd4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4061fa0 0x7ffbd4062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd41585a0 con 0x7ffbd4068820 2023-08-17T00:06:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd4066400 con 0x7ffbd40a8df0 2023-08-17T00:06:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd4069170 con 0x7ffbd4061fa0 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbd4068820 0x7ffbd4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffbd4068820 0x7ffbd4068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60864/0 (socket says 172.21.15.153:60864) 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 -- 172.21.15.153:0/1087935880 learned_addr learned my addr 172.21.15.153:0/1087935880 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd2d9d700 1 --2- 172.21.15.153:0/1087935880 >> v2:172.21.15.178:3300/0 conn(0x7ffbd40a8df0 0x7ffbd40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd359e700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4061fa0 0x7ffbd4062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 -- 172.21.15.153:0/1087935880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4061fa0 msgr2=0x7ffbd4062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:15.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4061fa0 0x7ffbd4062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 -- 172.21.15.153:0/1087935880 >> v2:172.21.15.178:3300/0 conn(0x7ffbd40a8df0 msgr2=0x7ffbd40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 --2- 172.21.15.153:0/1087935880 >> v2:172.21.15.178:3300/0 conn(0x7ffbd40a8df0 0x7ffbd40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 -- 172.21.15.153:0/1087935880 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd40b9d30 con 0x7ffbd4068820 2023-08-17T00:06:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd359e700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4061fa0 0x7ffbd4062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:15.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbca59c700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4068820 0x7ffbd4068c80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7ffbd40c3f30 tx=0x7ffbbc0090f0).ready entity=mon.0 client_cookie=5a02c7d0710ed6b2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd259c700 1 -- 172.21.15.153:0/1087935880 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc00b600 con 0x7ffbd4068820 2023-08-17T00:06:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd259c700 1 -- 172.21.15.153:0/1087935880 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc00b760 con 0x7ffbd4068820 2023-08-17T00:06:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd259c700 1 -- 172.21.15.153:0/1087935880 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc00bae0 con 0x7ffbd4068820 2023-08-17T00:06:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- 172.21.15.153:0/1087935880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4068820 msgr2=0x7ffbd4068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4068820 0x7ffbd4068c80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7ffbd40c3f30 tx=0x7ffbbc0090f0).stop 2023-08-17T00:06:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- 172.21.15.153:0/1087935880 shutdown_connections 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4061fa0 0x7ffbd4062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- 172.21.15.153:0/1087935880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4068820 0x7ffbd4068c80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 --2- 172.21.15.153:0/1087935880 >> v2:172.21.15.178:3300/0 conn(0x7ffbd40a8df0 0x7ffbd40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- 172.21.15.153:0/1087935880 >> 172.21.15.153:0/1087935880 conn(0x7ffbd40c6620 msgr2=0x7ffbd40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- 172.21.15.153:0/1087935880 shutdown_connections 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.180+0000 7ffbd88da700 1 -- 172.21.15.153:0/1087935880 wait complete. 2023-08-17T00:06:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 Processor -- start 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 -- start start 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 0x7ffbd4156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4068820 0x7ffbd41695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd40a8df0 0x7ffbd40bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40ba900 con 0x7ffbd4061fa0 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40bda90 con 0x7ffbd40a8df0 2023-08-17T00:06:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd88da700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd40bdd60 con 0x7ffbd4068820 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.184+0000 7ffbd2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 0x7ffbd4156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 0x7ffbd4156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60872/0 (socket says 172.21.15.153:60872) 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 -- 172.21.15.153:0/814608589 learned_addr learned my addr 172.21.15.153:0/814608589 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd359e700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd40a8df0 0x7ffbd40bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbca59c700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4068820 0x7ffbd41695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 -- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4068820 msgr2=0x7ffbd41695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4068820 0x7ffbd41695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 -- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd40a8df0 msgr2=0x7ffbd40bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd40a8df0 0x7ffbd40bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 -- 172.21.15.153:0/814608589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc009370 con 0x7ffbd4061fa0 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd359e700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd40a8df0 0x7ffbd40bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd2d9d700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 0x7ffbd4156cf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ffbc400d860 tx=0x7ffbc4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40125f0 con 0x7ffbd4061fa0 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4012750 con 0x7ffbd4061fa0 2023-08-17T00:06:15.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4012ad0 con 0x7ffbd4061fa0 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd40be040 con 0x7ffbd4061fa0 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd40beb80 con 0x7ffbd4061fa0 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.188+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd40ba6d0 con 0x7ffbd4061fa0 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.192+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ffbc4013480 con 0x7ffbd4061fa0 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.192+0000 7ffbcb7fe700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffbb405a150 0x7ffbb405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.192+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffbc4074660 con 0x7ffbd4061fa0 2023-08-17T00:06:15.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.192+0000 7ffbca59c700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffbb405a150 0x7ffbb405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.192+0000 7ffbca59c700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffbb405a150 0x7ffbb405c610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ffbbc009130 tx=0x7ffbbc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:15.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.196+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffbd40ba6d0 con 0x7ffbd4061fa0 2023-08-17T00:06:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.388+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd40ba6d0 con 0x7ffbd4061fa0 2023-08-17T00:06:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.388+0000 7ffbcb7fe700 1 -- 172.21.15.153:0/814608589 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4501 (secure 0 0 0) 0x7ffbd40ba6d0 con 0x7ffbd4061fa0 2023-08-17T00:06:15.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:15.395 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:03.881472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:15.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffbb405a150 msgr2=0x7ffbb405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffbb405a150 0x7ffbb405c610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7ffbbc009130 tx=0x7ffbbc017000).stop 2023-08-17T00:06:15.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 msgr2=0x7ffbd4156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:15.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 0x7ffbd4156cf0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ffbc400d860 tx=0x7ffbc4008040).stop 2023-08-17T00:06:15.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 shutdown_connections 2023-08-17T00:06:15.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffbb405a150 0x7ffbb405c610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffbd40a8df0 0x7ffbd40bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffbd4068820 0x7ffbd41695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 --2- 172.21.15.153:0/814608589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffbd4061fa0 0x7ffbd4156cf0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:15.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 >> 172.21.15.153:0/814608589 conn(0x7ffbd40c6620 msgr2=0x7ffbd40c0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:15.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 shutdown_connections 2023-08-17T00:06:15.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:15.396+0000 7ffbd88da700 1 -- 172.21.15.153:0/814608589 wait complete. 2023-08-17T00:06:15.403 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 38 2023-08-17T00:06:15.417 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-08-17T00:06:15.900 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:15.900 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:15.900 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:15.913 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:15.914 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2023-08-17T00:06:15.914 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-08-17T00:06:16.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 Processor -- start 2023-08-17T00:06:16.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 -- start start 2023-08-17T00:06:16.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95780a8df0 0x7f95780c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9578068820 0x7f9578068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578061fa0 0x7f9578062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95781585a0 con 0x7f95780a8df0 2023-08-17T00:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9578066400 con 0x7f9578068820 2023-08-17T00:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e9f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9578069170 con 0x7f9578061fa0 2023-08-17T00:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95780a8df0 0x7f95780c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95780a8df0 0x7f95780c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60884/0 (socket says 172.21.15.153:60884) 2023-08-17T00:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 -- 172.21.15.153:0/3046787717 learned_addr learned my addr 172.21.15.153:0/3046787717 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d1f6700 1 --2- 172.21.15.153:0/3046787717 >> v2:172.21.15.178:3300/0 conn(0x7f9578068820 0x7f9578068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e1f8700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578061fa0 0x7f9578062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 -- 172.21.15.153:0/3046787717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578061fa0 msgr2=0x7f9578062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578061fa0 0x7f9578062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 -- 172.21.15.153:0/3046787717 >> v2:172.21.15.178:3300/0 conn(0x7f9578068820 msgr2=0x7f9578068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 --2- 172.21.15.153:0/3046787717 >> v2:172.21.15.178:3300/0 conn(0x7f9578068820 0x7f9578068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 -- 172.21.15.153:0/3046787717 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780b9d30 con 0x7f95780a8df0 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957e1f8700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578061fa0 0x7f9578062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957d9f7700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780c1490 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f95780c2ef0 tx=0x7f9574009060).ready entity=mon.0 client_cookie=abe937cc88fa8424 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957c9f5700 1 -- 172.21.15.153:0/3046787717 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574005880 con 0x7f95780a8df0 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957c9f5700 1 -- 172.21.15.153:0/3046787717 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95740059e0 con 0x7f95780a8df0 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.064+0000 7f957c9f5700 1 -- 172.21.15.153:0/3046787717 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574005d60 con 0x7f95780a8df0 2023-08-17T00:06:16.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 -- 172.21.15.153:0/3046787717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 msgr2=0x7f95780c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780c1490 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f95780c2ef0 tx=0x7f9574009060).stop 2023-08-17T00:06:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 -- 172.21.15.153:0/3046787717 shutdown_connections 2023-08-17T00:06:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578061fa0 0x7f9578062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 --2- 172.21.15.153:0/3046787717 >> v2:172.21.15.178:3300/0 conn(0x7f9578068820 0x7f9578068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 --2- 172.21.15.153:0/3046787717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780c1490 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 -- 172.21.15.153:0/3046787717 >> 172.21.15.153:0/3046787717 conn(0x7f95780c6620 msgr2=0x7f95780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 -- 172.21.15.153:0/3046787717 shutdown_connections 2023-08-17T00:06:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 -- 172.21.15.153:0/3046787717 wait complete. 2023-08-17T00:06:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 Processor -- start 2023-08-17T00:06:16.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.068+0000 7f957e9f9700 1 -- start start 2023-08-17T00:06:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9578061fa0 0x7f9578156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578068820 0x7f95780bf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780bfba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780bf220 con 0x7f95780a8df0 2023-08-17T00:06:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780be610 con 0x7f9578061fa0 2023-08-17T00:06:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780be8f0 con 0x7f9578068820 2023-08-17T00:06:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780bfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780bfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60888/0 (socket says 172.21.15.153:60888) 2023-08-17T00:06:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 -- 172.21.15.153:0/112622797 learned_addr learned my addr 172.21.15.153:0/112622797 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957d9f7700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9578061fa0 0x7f9578156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957d1f6700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578068820 0x7f95780bf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 -- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578068820 msgr2=0x7f95780bf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578068820 0x7f95780bf6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 -- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9578061fa0 msgr2=0x7f9578156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9578061fa0 0x7f9578156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 -- 172.21.15.153:0/112622797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9574009300 con 0x7f95780a8df0 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e1f8700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780bfba0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f957000cef0 tx=0x7f9570007860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f956dffb700 1 -- 172.21.15.153:0/112622797 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000ad20 con 0x7f95780a8df0 2023-08-17T00:06:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f956dffb700 1 -- 172.21.15.153:0/112622797 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000ae80 con 0x7f95780a8df0 2023-08-17T00:06:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95780bebd0 con 0x7f95780a8df0 2023-08-17T00:06:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f956dffb700 1 -- 172.21.15.153:0/112622797 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570016610 con 0x7f95780a8df0 2023-08-17T00:06:16.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.072+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9578157270 con 0x7f95780a8df0 2023-08-17T00:06:16.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.076+0000 7f956dffb700 1 -- 172.21.15.153:0/112622797 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f95700203f0 con 0x7f95780a8df0 2023-08-17T00:06:16.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f956dffb700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f955c05a150 0x7f955c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f956dffb700 1 -- 172.21.15.153:0/112622797 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9570074c70 con 0x7f95780a8df0 2023-08-17T00:06:16.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f955c05a150 0x7f955c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 Processor -- start 2023-08-17T00:06:16.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 -- start start 2023-08-17T00:06:16.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f955c05a150 0x7f955c05c610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f957400b3c0 tx=0x7f9574016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28b9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2870c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x2875b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f7320 con 0x28b98f0 2023-08-17T00:06:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27bd760 con 0x28755e0 2023-08-17T00:06:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x289bdd0 con 0x2872b10 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28b9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28b9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60890/0 (socket says 172.21.15.153:60890) 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 -- 172.21.15.153:0/2684616038 learned_addr learned my addr 172.21.15.153:0/2684616038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 -- 172.21.15.153:0/2684616038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 msgr2=0x2870c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2870c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 -- 172.21.15.153:0/2684616038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 msgr2=0x2875b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x2875b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.080+0000 7f957d9f7700 1 -- 172.21.15.153:0/2684616038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27f0260 con 0x28b98f0 2023-08-17T00:06:16.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f957d9f7700 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28b9cd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f95780668e0 tx=0x7f957401e070).ready entity=mon.0 client_cookie=c1f5902ab9c4c33a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9562ffd700 1 -- 172.21.15.153:0/2684616038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400b600 con 0x28b98f0 2023-08-17T00:06:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9562ffd700 1 -- 172.21.15.153:0/2684616038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400b760 con 0x28b98f0 2023-08-17T00:06:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9562ffd700 1 -- 172.21.15.153:0/2684616038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957400bae0 con 0x28b98f0 2023-08-17T00:06:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- 172.21.15.153:0/2684616038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 msgr2=0x28b9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28b9cd0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f95780668e0 tx=0x7f957401e070).stop 2023-08-17T00:06:16.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- 172.21.15.153:0/2684616038 shutdown_connections 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x2875b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2870c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2684616038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28b9cd0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- 172.21.15.153:0/2684616038 >> 172.21.15.153:0/2684616038 conn(0x2655ad0 msgr2=0x2876660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- 172.21.15.153:0/2684616038 shutdown_connections 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- 172.21.15.153:0/2684616038 wait complete. 2023-08-17T00:06:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- start start 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 Processor -- start 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 0x28997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b98f0 0x28731d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2870a50 con 0x2872b10 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x289ee50 con 0x28755e0 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28a1890 con 0x28b98f0 2023-08-17T00:06:16.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.084+0000 7f9589ffb740 10 client.0 ll_register_callbacks cb 0x282d950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 0x28997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 0x28997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60902/0 (socket says 172.21.15.153:60902) 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 -- 172.21.15.153:0/1732783833 learned_addr learned my addr 172.21.15.153:0/1732783833 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957e1f8700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b98f0 0x28731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d1f6700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 -- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b98f0 msgr2=0x28731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b98f0 0x28731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 -- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 msgr2=0x28a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 -- 172.21.15.153:0/1732783833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95780b9d30 con 0x2872b10 2023-08-17T00:06:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d9f7700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 0x28997e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f9574009f30 tx=0x7f9574027000).ready entity=mon.0 client_cookie=e23632a79f9a1517 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9557fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9557fff700 1 -- 172.21.15.153:0/1732783833 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740117a0 con 0x2872b10 2023-08-17T00:06:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27ecf40 con 0x2872b10 2023-08-17T00:06:16.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9557fff700 1 -- 172.21.15.153:0/1732783833 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9574011900 con 0x2872b10 2023-08-17T00:06:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9557fff700 1 -- 172.21.15.153:0/1732783833 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9574011cd0 con 0x2872b10 2023-08-17T00:06:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 10 client.5655 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x27eb700 con 0x2872b10 2023-08-17T00:06:16.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9557fff700 1 -- 172.21.15.153:0/1732783833 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27ecf40 con 0x2872b10 2023-08-17T00:06:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9557fff700 1 -- 172.21.15.153:0/1732783833 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9574037440 con 0x2872b10 2023-08-17T00:06:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 10 client.5655 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:16.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 10 client.5655 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 20 client.5655 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x286ef40 0x286f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 4 client.5655 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:16.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27e3490 con 0x286ef40 2023-08-17T00:06:16.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.088+0000 7f957d1f6700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x286ef40 0x286f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f957d1f6700 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x286ef40 0x286f320 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=94a02a5f6bfd821a server_cookie=1c4e3ba3b7228818 in_seq=0 out_seq=0 2023-08-17T00:06:16.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9557fff700 10 client.5655 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9557fff700 1 -- 172.21.15.153:0/1732783833 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x27e3490 con 0x286ef40 2023-08-17T00:06:16.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9557fff700 10 client.5655 handle_command_reply: tid=0 2023-08-17T00:06:16.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 client.5655 shutdown 2023-08-17T00:06:16.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 msgr2=0x28997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 0x28997e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f9574009f30 tx=0x7f9574027000).stop 2023-08-17T00:06:16.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 shutdown_connections 2023-08-17T00:06:16.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x286ef40 0x286f320 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28b98f0 0x28731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9557fff700 0 client.5655 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1732783833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2872b10 0x28997e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 >> 172.21.15.153:0/1732783833 conn(0x2655ad0 msgr2=0x289b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 shutdown_connections 2023-08-17T00:06:16.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 1 -- 172.21.15.153:0/1732783833 wait complete. 2023-08-17T00:06:16.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.092+0000 7f9589ffb740 20 client.5655 trim_cache size 0 max 16384 2023-08-17T00:06:16.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.108+0000 7f9589ffb740 1 Processor -- start 2023-08-17T00:06:16.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.108+0000 7f9589ffb740 1 -- start start 2023-08-17T00:06:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2874370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 0x289c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28b98f0 0x289cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f9589ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2872fd0 con 0x28755e0 2023-08-17T00:06:16.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x286c2b0 con 0x28b98f0 2023-08-17T00:06:16.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2829f70 con 0x2872b10 2023-08-17T00:06:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 0x289c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 0x289c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60904/0 (socket says 172.21.15.153:60904) 2023-08-17T00:06:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 -- 172.21.15.153:0/2349840647 learned_addr learned my addr 172.21.15.153:0/2349840647 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957e1f8700 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28b98f0 0x289cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d9f7700 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2874370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 -- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 msgr2=0x2874370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2874370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 -- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28b98f0 msgr2=0x289cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28b98f0 0x289cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 -- 172.21.15.153:0/2349840647 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780ab2c0 con 0x28755e0 2023-08-17T00:06:16.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f957d1f6700 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 0x289c8b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f95780b6720 tx=0x7f9568016710).ready entity=mon.0 client_cookie=f4166a2186cd9eb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f95637fe700 1 -- 172.21.15.153:0/2349840647 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568016a60 con 0x28755e0 2023-08-17T00:06:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f95637fe700 1 -- 172.21.15.153:0/2349840647 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568016bc0 con 0x28755e0 2023-08-17T00:06:16.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.112+0000 7f95637fe700 1 -- 172.21.15.153:0/2349840647 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956801d3f0 con 0x28755e0 2023-08-17T00:06:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 -- 172.21.15.153:0/2349840647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 msgr2=0x289c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 0x289c8b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f95780b6720 tx=0x7f9568016710).stop 2023-08-17T00:06:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 -- 172.21.15.153:0/2349840647 shutdown_connections 2023-08-17T00:06:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28b98f0 0x289cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28755e0 0x289c8b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 --2- 172.21.15.153:0/2349840647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x2874370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 -- 172.21.15.153:0/2349840647 >> 172.21.15.153:0/2349840647 conn(0x2655ad0 msgr2=0x286fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 -- 172.21.15.153:0/2349840647 shutdown_connections 2023-08-17T00:06:16.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 -- 172.21.15.153:0/2349840647 wait complete. 2023-08-17T00:06:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 -- start start 2023-08-17T00:06:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.116+0000 7f9589ffb740 1 Processor -- start 2023-08-17T00:06:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x291dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x291e3d0 con 0x28b98f0 2023-08-17T00:06:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28dac90 con 0x28755e0 2023-08-17T00:06:16.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d2730 con 0x2872b10 2023-08-17T00:06:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 10 client.0 ll_register_callbacks cb 0x7f9574005ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28d1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60910/0 (socket says 172.21.15.153:60910) 2023-08-17T00:06:16.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 -- 172.21.15.153:0/1234205 learned_addr learned my addr 172.21.15.153:0/1234205 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957d9f7700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x291dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957d1f6700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 -- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 msgr2=0x291dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x291dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 -- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 msgr2=0x28a08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 -- 172.21.15.153:0/1234205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956800e040 con 0x28b98f0 2023-08-17T00:06:16.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957d1f6700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f957e1f8700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28d1c60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9570048660 tx=0x7f957004f040).ready entity=mon.0 client_cookie=f3874ac2a060efa8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9557fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9557fff700 1 -- 172.21.15.153:0/1234205 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570056070 con 0x28b98f0 2023-08-17T00:06:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f957400b760 con 0x28b98f0 2023-08-17T00:06:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9557fff700 1 -- 172.21.15.153:0/1234205 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9570048ad0 con 0x28b98f0 2023-08-17T00:06:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9557fff700 1 -- 172.21.15.153:0/1234205 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9570048060 con 0x28b98f0 2023-08-17T00:06:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 10 client.5661 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:16.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x27eb450 con 0x28b98f0 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9557fff700 1 -- 172.21.15.153:0/1234205 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957400b760 con 0x28b98f0 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9557fff700 1 -- 172.21.15.153:0/1234205 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f95700481c0 con 0x28b98f0 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 10 client.5661 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 10 client.5661 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 20 client.5661 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2874ef0 0x28d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 4 client.5661 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.120+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x26aca60 con 0x2874ef0 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f957d9f7700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2874ef0 0x28d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9557fff700 10 client.5661 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f957d9f7700 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2874ef0 0x28d2150 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4ce37d1a22c7ccfb server_cookie=365ddf3cc05f79b3 in_seq=0 out_seq=0 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9557fff700 1 -- 172.21.15.153:0/1234205 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x26aca60 con 0x2874ef0 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9557fff700 10 client.5661 handle_command_reply: tid=0 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 client.5661 shutdown 2023-08-17T00:06:16.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 msgr2=0x28d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28d1c60 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9570048660 tx=0x7f957004f040).stop 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 shutdown_connections 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2874ef0 0x28d2150 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28b98f0 0x28d1c60 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28755e0 0x28a08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 --2- 172.21.15.153:0/1234205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2872b10 0x291dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9557fff700 0 client.5661 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 >> 172.21.15.153:0/1234205 conn(0x2655ad0 msgr2=0x28bc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 shutdown_connections 2023-08-17T00:06:16.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 1 -- 172.21.15.153:0/1234205 wait complete. 2023-08-17T00:06:16.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f9589ffb740 20 client.5661 trim_cache size 0 max 16384 2023-08-17T00:06:16.137 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "344a108b-d84b-4ced-bbd4-8b17e41e06f9", 2023-08-17T00:06:16.138 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:16.138 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:16.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f955c05a150 msgr2=0x7f955c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f957e9f9700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f955c05a150 0x7f955c05c610 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f957400b3c0 tx=0x7f9574016000).stop 2023-08-17T00:06:16.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 msgr2=0x7f95780bfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.124+0000 7f957e9f9700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780bfba0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f957000cef0 tx=0x7f9570007860).stop 2023-08-17T00:06:16.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 shutdown_connections 2023-08-17T00:06:16.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f955c05a150 0x7f955c05c610 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95780a8df0 0x7f95780bfba0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9578068820 0x7f95780bf6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 --2- 172.21.15.153:0/112622797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9578061fa0 0x7f9578156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 >> 172.21.15.153:0/112622797 conn(0x7f95780c6620 msgr2=0x7f95780c5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 shutdown_connections 2023-08-17T00:06:16.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.128+0000 7f957e9f9700 1 -- 172.21.15.153:0/112622797 wait complete. 2023-08-17T00:06:16.150 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '344a108b-d84b-4ced-bbd4-8b17e41e06f9', 'mode': 'asynchronous'}' 2023-08-17T00:06:16.151 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2023-08-17T00:06:16.151 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2023-08-17T00:06:16.152 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:16.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 Processor -- start 2023-08-17T00:06:16.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 -- start start 2023-08-17T00:06:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0151b90 0x7f49e0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49e0063290 0x7f49e0065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e0061fa0 con 0x7f49e0065b50 2023-08-17T00:06:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e00c3fb0 con 0x7f49e0063290 2023-08-17T00:06:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49e4cdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0152460 con 0x7f49e0151b90 2023-08-17T00:06:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49d5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49e0063290 0x7f49e0065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49ded9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f49e0065b50 0x7f49e0064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53800/0 (socket says 172.21.15.153:53800) 2023-08-17T00:06:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49d5d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f49e0063290 0x7f49e0065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60922/0 (socket says 172.21.15.153:60922) 2023-08-17T00:06:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49ded9d700 1 -- 172.21.15.153:0/2384703790 learned_addr learned my addr 172.21.15.153:0/2384703790 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49de59c700 1 --2- 172.21.15.153:0/2384703790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0151b90 0x7f49e0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49d5d9b700 1 -- 172.21.15.153:0/2384703790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0151b90 msgr2=0x7f49e0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.300+0000 7f49d5d9b700 1 --2- 172.21.15.153:0/2384703790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0151b90 0x7f49e0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49d5d9b700 1 -- 172.21.15.153:0/2384703790 >> v1:172.21.15.153:6789/0 conn(0x7f49e0065b50 legacy=0x7f49e0064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49d5d9b700 1 -- 172.21.15.153:0/2384703790 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00621f0 con 0x7f49e0063290 2023-08-17T00:06:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49d5d9b700 1 --2- 172.21.15.153:0/2384703790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0063290 0x7f49e0065660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f49c8009760 tx=0x7f49c8009060).ready entity=mon.0 client_cookie=7675b453f94ede09 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49ddd9b700 1 -- 172.21.15.153:0/2384703790 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800f510 con 0x7f49e0063290 2023-08-17T00:06:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49ddd9b700 1 -- 172.21.15.153:0/2384703790 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800f670 con 0x7f49e0063290 2023-08-17T00:06:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49ddd9b700 1 -- 172.21.15.153:0/2384703790 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800f9f0 con 0x7f49e0063290 2023-08-17T00:06:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 -- 172.21.15.153:0/2384703790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0063290 msgr2=0x7f49e0065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/2384703790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0063290 0x7f49e0065660 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f49c8009760 tx=0x7f49c8009060).stop 2023-08-17T00:06:16.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 -- 172.21.15.153:0/2384703790 shutdown_connections 2023-08-17T00:06:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/2384703790 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0063290 0x7f49e0065660 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/2384703790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0151b90 0x7f49e0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 -- 172.21.15.153:0/2384703790 >> 172.21.15.153:0/2384703790 conn(0x7f49e00c7150 msgr2=0x7f49e00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 -- 172.21.15.153:0/2384703790 shutdown_connections 2023-08-17T00:06:16.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.304+0000 7f49e4cdb700 1 -- 172.21.15.153:0/2384703790 wait complete. 2023-08-17T00:06:16.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 Processor -- start 2023-08-17T00:06:16.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 -- start start 2023-08-17T00:06:16.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0063290 0x7f49e013c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 0x7f49e0164f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e0151b90 0x7f49e0163460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0164aa0 con 0x7f49e0065b50 2023-08-17T00:06:16.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0163e90 con 0x7f49e0151b90 2023-08-17T00:06:16.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49e4cdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e0164170 con 0x7f49e0063290 2023-08-17T00:06:16.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 0x7f49e0164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 0x7f49e0164f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60928/0 (socket says 172.21.15.153:60928) 2023-08-17T00:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 -- 172.21.15.153:0/9003003 learned_addr learned my addr 172.21.15.153:0/9003003 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49de59c700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0063290 0x7f49e013c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49ded9d700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e0151b90 0x7f49e0163460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 -- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0063290 msgr2=0x7f49e013c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0063290 0x7f49e013c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 -- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e0151b90 msgr2=0x7f49e0163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e0151b90 0x7f49e0163460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 -- 172.21.15.153:0/9003003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80092a0 con 0x7f49e0065b50 2023-08-17T00:06:16.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.308+0000 7f49d5d9b700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 0x7f49e0164f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f49c8011000 tx=0x7f49c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c800f7e0 con 0x7f49e0065b50 2023-08-17T00:06:16.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c800f940 con 0x7f49e0065b50 2023-08-17T00:06:16.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c801b660 con 0x7f49e0065b50 2023-08-17T00:06:16.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0164450 con 0x7f49e0065b50 2023-08-17T00:06:16.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e013ce70 con 0x7f49e0065b50 2023-08-17T00:06:16.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e0164c10 con 0x7f49e0065b50 2023-08-17T00:06:16.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.312+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f49c800f070 con 0x7f49e0065b50 2023-08-17T00:06:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.316+0000 7f49d6ffd700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f49c005a150 0x7f49c005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.316+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f49c8075af0 con 0x7f49e0065b50 2023-08-17T00:06:16.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.316+0000 7f49de59c700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f49c005a150 0x7f49c005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.316+0000 7f49de59c700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f49c005a150 0x7f49c005c610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f49d0009fd0 tx=0x7f49d000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.320+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f49c8049540 con 0x7f49e0065b50 2023-08-17T00:06:16.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.524+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49e006b530 con 0x7f49e0065b50 2023-08-17T00:06:16.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.524+0000 7f49d6ffd700 1 -- 172.21.15.153:0/9003003 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f49c804cb60 con 0x7f49e0065b50 2023-08-17T00:06:16.530 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:16.530 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":38,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:03.881472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:16.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f49c005a150 msgr2=0x7f49c005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f49c005a150 0x7f49c005c610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f49d0009fd0 tx=0x7f49d000b040).stop 2023-08-17T00:06:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 msgr2=0x7f49e0164f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 0x7f49e0164f30 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f49c8011000 tx=0x7f49c8017000).stop 2023-08-17T00:06:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 shutdown_connections 2023-08-17T00:06:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f49c005a150 0x7f49c005c610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e0151b90 0x7f49e0163460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f49e0065b50 0x7f49e0164f30 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 --2- 172.21.15.153:0/9003003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e0063290 0x7f49e013c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 >> 172.21.15.153:0/9003003 conn(0x7f49e00c7150 msgr2=0x7f49e014f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 shutdown_connections 2023-08-17T00:06:16.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.528+0000 7f49e4cdb700 1 -- 172.21.15.153:0/9003003 wait complete. 2023-08-17T00:06:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 38 2023-08-17T00:06:16.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2023-08-17T00:06:16.707 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:16.708 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:16.708 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:16.724 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:16.725 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2023-08-17T00:06:16.725 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2023-08-17T00:06:16.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.880+0000 7fee15ff9700 1 Processor -- start 2023-08-17T00:06:16.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.880+0000 7fee15ff9700 1 -- start start 2023-08-17T00:06:16.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee15ff9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee10151c40 0x7fee101560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee15ff9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee10065da0 con 0x7fee100689c0 2023-08-17T00:06:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee15ff9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee10155c60 con 0x7fee10068da0 2023-08-17T00:06:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee15ff9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee10069200 con 0x7fee10151c40 2023-08-17T00:06:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee157f8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee10151c40 0x7fee101560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee14ff7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fee100689c0 0x7fee100c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53814/0 (socket says 172.21.15.153:53814) 2023-08-17T00:06:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee157f8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee10151c40 0x7fee101560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40348/0 (socket says 172.21.15.153:40348) 2023-08-17T00:06:16.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee14ff7700 1 -- 172.21.15.153:0/1988455287 learned_addr learned my addr 172.21.15.153:0/1988455287 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:16.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.884+0000 7fee0ffff700 1 --1- 172.21.15.153:0/1988455287 >> v1:172.21.15.178:6789/0 conn(0x7fee10068da0 0x7fee10151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:39984/0 (socket says 172.21.15.153:39984) 2023-08-17T00:06:16.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee157f8700 1 -- 172.21.15.153:0/1988455287 >> v1:172.21.15.178:6789/0 conn(0x7fee10068da0 legacy=0x7fee10151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee157f8700 1 -- 172.21.15.153:0/1988455287 >> v1:172.21.15.153:6789/0 conn(0x7fee100689c0 legacy=0x7fee100c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee0f7fe700 1 -- 172.21.15.153:0/1988455287 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616485923 0 0) 0x7fee10155c60 con 0x7fee10068da0 2023-08-17T00:06:16.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee157f8700 1 -- 172.21.15.153:0/1988455287 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10065ff0 con 0x7fee10151c40 2023-08-17T00:06:16.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee157f8700 1 --2- 172.21.15.153:0/1988455287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee101560f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fee08009e60 tx=0x7fee08009780).ready entity=mon.1 client_cookie=d49ed1bbbb3f3eee server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee0f7fe700 1 -- 172.21.15.153:0/1988455287 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800e070 con 0x7fee10151c40 2023-08-17T00:06:16.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee0f7fe700 1 -- 172.21.15.153:0/1988455287 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0800bb30 con 0x7fee10151c40 2023-08-17T00:06:16.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee0f7fe700 1 -- 172.21.15.153:0/1988455287 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800beb0 con 0x7fee10151c40 2023-08-17T00:06:16.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 -- 172.21.15.153:0/1988455287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 msgr2=0x7fee101560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 --2- 172.21.15.153:0/1988455287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee101560f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fee08009e60 tx=0x7fee08009780).stop 2023-08-17T00:06:16.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 -- 172.21.15.153:0/1988455287 shutdown_connections 2023-08-17T00:06:16.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 --2- 172.21.15.153:0/1988455287 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee101560f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 -- 172.21.15.153:0/1988455287 >> 172.21.15.153:0/1988455287 conn(0x7fee100c6620 msgr2=0x7fee100c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 -- 172.21.15.153:0/1988455287 shutdown_connections 2023-08-17T00:06:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.888+0000 7fee15ff9700 1 -- 172.21.15.153:0/1988455287 wait complete. 2023-08-17T00:06:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 Processor -- start 2023-08-17T00:06:16.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 -- start start 2023-08-17T00:06:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 0x7fee100bfde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10068da0 0x7fee1009f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee100a75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100c02d0 con 0x7fee100689c0 2023-08-17T00:06:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee100bed40 con 0x7fee10151c40 2023-08-17T00:06:16.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee15ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee100bf020 con 0x7fee10068da0 2023-08-17T00:06:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 0x7fee100bfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 0x7fee100bfde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60930/0 (socket says 172.21.15.153:60930) 2023-08-17T00:06:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 -- 172.21.15.153:0/628872607 learned_addr learned my addr 172.21.15.153:0/628872607 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee0ffff700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10068da0 0x7fee1009f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee157f8700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee100a75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 -- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10068da0 msgr2=0x7fee1009f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10068da0 0x7fee1009f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 -- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 msgr2=0x7fee100a75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee100a75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 -- 172.21.15.153:0/628872607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08009a20 con 0x7fee100689c0 2023-08-17T00:06:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee157f8700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee100a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee0ffff700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10068da0 0x7fee1009f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.892+0000 7fee14ff7700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 0x7fee100bfde0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fee0400c510 tx=0x7fee04007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.896+0000 7fee0cff9700 1 -- 172.21.15.153:0/628872607 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee040072e0 con 0x7fee100689c0 2023-08-17T00:06:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.896+0000 7fee0cff9700 1 -- 172.21.15.153:0/628872607 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04007440 con 0x7fee100689c0 2023-08-17T00:06:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.896+0000 7fee0cff9700 1 -- 172.21.15.153:0/628872607 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee040058a0 con 0x7fee100689c0 2023-08-17T00:06:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.896+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee100bf300 con 0x7fee100689c0 2023-08-17T00:06:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.896+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee100bf8c0 con 0x7fee100689c0 2023-08-17T00:06:16.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.896+0000 7fee0cff9700 1 -- 172.21.15.153:0/628872607 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fee04010070 con 0x7fee100689c0 2023-08-17T00:06:16.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee0cff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedf405a150 0x7fedf405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee0cff9700 1 -- 172.21.15.153:0/628872607 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee04073630 con 0x7fee100689c0 2023-08-17T00:06:16.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee0ffff700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedf405a150 0x7fedf405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee0ffff700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedf405a150 0x7fedf405c610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fedfc0047d0 tx=0x7fedfc007c60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 Processor -- start 2023-08-17T00:06:16.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 -- start start 2023-08-17T00:06:16.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x2179240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x217b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x20cb1b0 con 0x217e200 2023-08-17T00:06:16.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20ed4a0 con 0x21c0230 2023-08-17T00:06:16.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.900+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21a4900 con 0x21c0b00 2023-08-17T00:06:16.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21c0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60934/0 (socket says 172.21.15.153:60934) 2023-08-17T00:06:16.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 -- 172.21.15.153:0/1071651131 learned_addr learned my addr 172.21.15.153:0/1071651131 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee14ff7700 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x2179240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee157f8700 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x217b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 -- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 msgr2=0x217b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x217b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 -- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 msgr2=0x2179240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x2179240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 -- 172.21.15.153:0/1071651131 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20f9020 con 0x217e200 2023-08-17T00:06:16.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee0ffff700 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21c0610 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fedfc001b10 tx=0x7fedfc00a000).ready entity=mon.0 client_cookie=74fd6ad4feeda0d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fedf9ffb700 1 -- 172.21.15.153:0/1071651131 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc01c070 con 0x217e200 2023-08-17T00:06:16.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fedf9ffb700 1 -- 172.21.15.153:0/1071651131 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc017890 con 0x217e200 2023-08-17T00:06:16.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fedf9ffb700 1 -- 172.21.15.153:0/1071651131 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc017c50 con 0x217e200 2023-08-17T00:06:16.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 -- 172.21.15.153:0/1071651131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 msgr2=0x21c0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21c0610 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fedfc001b10 tx=0x7fedfc00a000).stop 2023-08-17T00:06:16.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 -- 172.21.15.153:0/1071651131 shutdown_connections 2023-08-17T00:06:16.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x217b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21c0610 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 --2- 172.21.15.153:0/1071651131 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x2179240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 -- 172.21.15.153:0/1071651131 >> 172.21.15.153:0/1071651131 conn(0x1f5e690 msgr2=0x217f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 -- 172.21.15.153:0/1071651131 shutdown_connections 2023-08-17T00:06:16.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 -- 172.21.15.153:0/1071651131 wait complete. 2023-08-17T00:06:16.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 -- start start 2023-08-17T00:06:16.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.904+0000 7fee215d5740 1 Processor -- start 2023-08-17T00:06:16.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x21d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x21d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x21a7630 con 0x217e200 2023-08-17T00:06:16.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21a7af0 con 0x21c0230 2023-08-17T00:06:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21a7dd0 con 0x21c0b00 2023-08-17T00:06:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 10 client.0 ll_register_callbacks cb 0x2136490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60944/0 (socket says 172.21.15.153:60944) 2023-08-17T00:06:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 -- 172.21.15.153:0/3454691567 learned_addr learned my addr 172.21.15.153:0/3454691567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee157f8700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x21d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee0ffff700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x21d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 -- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 msgr2=0x21d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x21d16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 -- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 msgr2=0x21d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x21d11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 -- 172.21.15.153:0/3454691567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedfc0017b0 con 0x217e200 2023-08-17T00:06:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee14ff7700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21a4e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fee040472a0 tx=0x7fee0400f000).ready entity=mon.0 client_cookie=28b08012948f29e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fedeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fedeeffd700 1 -- 172.21.15.153:0/3454691567 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04005ea0 con 0x217e200 2023-08-17T00:06:16.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fedeeffd700 1 -- 172.21.15.153:0/3454691567 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee04010300 con 0x217e200 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x20f5d00 con 0x217e200 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fedeeffd700 1 -- 172.21.15.153:0/3454691567 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee0404ab10 con 0x217e200 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 10 client.5682 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x20f44c0 con 0x217e200 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fedeeffd700 1 -- 172.21.15.153:0/3454691567 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x20f5d00 con 0x217e200 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fedeeffd700 1 -- 172.21.15.153:0/3454691567 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fee0404a290 con 0x217e200 2023-08-17T00:06:16.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 10 client.5682 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:16.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 10 client.5682 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:16.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 20 client.5682 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:16.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x21aa230 0x21aa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 4 client.5682 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:16.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x20ec250 con 0x21aa230 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.908+0000 7fee0ffff700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x21aa230 0x21aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee0ffff700 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x21aa230 0x21aa610 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b70acb11ef0bb226 server_cookie=4615abf3d9429d5f in_seq=0 out_seq=0 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fedeeffd700 10 client.5682 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fedeeffd700 1 -- 172.21.15.153:0/3454691567 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x20ec250 con 0x21aa230 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fedeeffd700 10 client.5682 handle_command_reply: tid=0 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 client.5682 shutdown 2023-08-17T00:06:16.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 msgr2=0x21a4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21a4e40 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fee040472a0 tx=0x7fee0400f000).stop 2023-08-17T00:06:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 shutdown_connections 2023-08-17T00:06:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x21aa230 0x21aa610 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0b00 0x21d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21c0230 0x21d11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 --2- 172.21.15.153:0/3454691567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x217e200 0x21a4e40 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 >> 172.21.15.153:0/3454691567 conn(0x1f5e690 msgr2=0x21a3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fedeeffd700 0 client.5682 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 shutdown_connections 2023-08-17T00:06:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 1 -- 172.21.15.153:0/3454691567 wait complete. 2023-08-17T00:06:16.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.912+0000 7fee215d5740 20 client.5682 trim_cache size 0 max 16384 2023-08-17T00:06:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 Processor -- start 2023-08-17T00:06:16.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 -- start start 2023-08-17T00:06:16.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x21a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x21d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x217d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x21bfe80 con 0x21c0b00 2023-08-17T00:06:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21d2140 con 0x217aa00 2023-08-17T00:06:16.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21aa900 con 0x21c0230 2023-08-17T00:06:16.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x21d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x21d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60946/0 (socket says 172.21.15.153:60946) 2023-08-17T00:06:16.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee0ffff700 1 -- 172.21.15.153:0/501264325 learned_addr learned my addr 172.21.15.153:0/501264325 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x217d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee14ff7700 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x21a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 -- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 msgr2=0x21a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x21a5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 -- 172.21.15.153:0/501264325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 msgr2=0x21d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x21d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 -- 172.21.15.153:0/501264325 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10065010 con 0x217aa00 2023-08-17T00:06:16.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee0ffff700 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x21d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:16.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fee157f8700 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x217d370 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fee100c2d60 tx=0x7fee08009780).ready entity=mon.1 client_cookie=4eb4fd72de047393 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fedfa7fc700 1 -- 172.21.15.153:0/501264325 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08023070 con 0x217aa00 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fedfa7fc700 1 -- 172.21.15.153:0/501264325 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08012620 con 0x217aa00 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.932+0000 7fedfa7fc700 1 -- 172.21.15.153:0/501264325 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080129a0 con 0x217aa00 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 msgr2=0x217d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x217d370 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fee100c2d60 tx=0x7fee08009780).stop 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- 172.21.15.153:0/501264325 shutdown_connections 2023-08-17T00:06:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x217d370 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x21d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- 172.21.15.153:0/501264325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x21a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- 172.21.15.153:0/501264325 >> 172.21.15.153:0/501264325 conn(0x1f5e690 msgr2=0x21a3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- 172.21.15.153:0/501264325 shutdown_connections 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- 172.21.15.153:0/501264325 wait complete. 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- start start 2023-08-17T00:06:16.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 Processor -- start 2023-08-17T00:06:16.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x222a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x2233860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x2233d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2232840 con 0x21c0b00 2023-08-17T00:06:16.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21a1330 con 0x217aa00 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21a1580 con 0x21c0230 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee215d5740 10 client.0 ll_register_callbacks cb 0x7fee0404a9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee157f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x2233d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee157f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x2233d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60956/0 (socket says 172.21.15.153:60956) 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee157f8700 1 -- 172.21.15.153:0/2825773624 learned_addr learned my addr 172.21.15.153:0/2825773624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee14ff7700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x222a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.936+0000 7fee0ffff700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x2233860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee157f8700 1 -- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 msgr2=0x2233860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee157f8700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x2233860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee157f8700 1 -- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 msgr2=0x222a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee157f8700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x222a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee157f8700 1 -- 172.21.15.153:0/2825773624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x20f9020 con 0x21c0b00 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee157f8700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x2233d50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fee08011000 tx=0x7fee08023000).ready entity=mon.0 client_cookie=ab3573d757bd7f9a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:16.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:16.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 1 -- 172.21.15.153:0/2825773624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08028740 con 0x21c0b00 2023-08-17T00:06:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 1 -- 172.21.15.153:0/2825773624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fee08032ca0 con 0x21c0b00 2023-08-17T00:06:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fedfc017890 con 0x21c0b00 2023-08-17T00:06:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 1 -- 172.21.15.153:0/2825773624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee08032e60 con 0x21c0b00 2023-08-17T00:06:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 10 client.5688 fetch_fsmap learned FSMap version 38 2023-08-17T00:06:16.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x7fee10065ff0 con 0x21c0b00 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 1 -- 172.21.15.153:0/2825773624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc017890 con 0x21c0b00 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 1 -- 172.21.15.153:0/2825773624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 38) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fee08028ab0 con 0x21c0b00 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 10 client.5688 fetch_fsmap finished waiting for FSMap version 38 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 10 client.5688 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 20 client.5688 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2234240 0x2231500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:16.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 4 client.5688 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/"}] 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x1fb5620 con 0x2234240 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee14ff7700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2234240 0x2231500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fedeeffd700 10 client.5688 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.940+0000 7fee14ff7700 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2234240 0x2231500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=48db7dbe60cc25e6 server_cookie=295b07b08940383d in_seq=0 out_seq=0 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fedeeffd700 1 -- 172.21.15.153:0/2825773624 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1fb5620 con 0x2234240 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fedeeffd700 10 client.5688 handle_command_reply: tid=0 2023-08-17T00:06:16.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 client.5688 shutdown 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 msgr2=0x2233d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x2233d50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7fee08011000 tx=0x7fee08023000).stop 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 shutdown_connections 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2234240 0x2231500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x21c0b00 0x2233d50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21c0230 0x2233860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 --2- 172.21.15.153:0/2825773624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x217aa00 0x222a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fedeeffd700 0 client.5688 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 >> 172.21.15.153:0/2825773624 conn(0x1f5e690 msgr2=0x21a8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 shutdown_connections 2023-08-17T00:06:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 1 -- 172.21.15.153:0/2825773624 wait complete. 2023-08-17T00:06:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee215d5740 20 client.5688 trim_cache size 0 max 16384 2023-08-17T00:06:16.954 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:16.954 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:16.954 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "f83e82a3-e0e4-4b91-994c-cd4cd280f728", 2023-08-17T00:06:16.954 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:16.954 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:16.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedf405a150 msgr2=0x7fedf405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedf405a150 0x7fedf405c610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fedfc0047d0 tx=0x7fedfc007c60).stop 2023-08-17T00:06:16.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 msgr2=0x7fee100bfde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:16.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 0x7fee100bfde0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fee0400c510 tx=0x7fee04007c10).stop 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 shutdown_connections 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedf405a150 0x7fedf405c610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee10151c40 0x7fee100a75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee10068da0 0x7fee1009f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 --2- 172.21.15.153:0/628872607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fee100689c0 0x7fee100bfde0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 >> 172.21.15.153:0/628872607 conn(0x7fee100c6620 msgr2=0x7fee100645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:16.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 shutdown_connections 2023-08-17T00:06:16.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:16.944+0000 7fee15ff9700 1 -- 172.21.15.153:0/628872607 wait complete. 2023-08-17T00:06:16.970 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': 'f83e82a3-e0e4-4b91-994c-cd4cd280f728', 'mode': 'asynchronous'}' 2023-08-17T00:06:16.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:16.971 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2023-08-17T00:06:16.994 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2023-08-17T00:06:16.995 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:17.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.196+0000 7f22ebb69700 1 Processor -- start 2023-08-17T00:06:17.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.196+0000 7f22ebb69700 1 -- start start 2023-08-17T00:06:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4151b90 0x7f22e4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22e4064870 0x7f22e4064d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e4065210 con 0x7f22e4063290 2023-08-17T00:06:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40c3fb0 con 0x7f22e4064870 2023-08-17T00:06:17.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4152460 con 0x7f22e4151b90 2023-08-17T00:06:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22e4064870 0x7f22e4064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22e4064870 0x7f22e4064d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60964/0 (socket says 172.21.15.153:60964) 2023-08-17T00:06:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 -- 172.21.15.153:0/2805742456 learned_addr learned my addr 172.21.15.153:0/2805742456 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22e9905700 1 --2- 172.21.15.153:0/2805742456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4151b90 0x7f22e4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 -- 172.21.15.153:0/2805742456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4151b90 msgr2=0x7f22e4151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 --2- 172.21.15.153:0/2805742456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4151b90 0x7f22e4151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 -- 172.21.15.153:0/2805742456 >> v1:172.21.15.178:6789/0 conn(0x7f22e4063290 legacy=0x7f22e4065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 -- 172.21.15.153:0/2805742456 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e4061fa0 con 0x7f22e4064870 2023-08-17T00:06:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ea106700 1 --2- 172.21.15.153:0/2805742456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4064870 0x7f22e4064d20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f22dc009f20 tx=0x7f22dc009840).ready entity=mon.0 client_cookie=5ea95c7307453b96 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22e8903700 1 -- 172.21.15.153:0/2805742456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00e070 con 0x7f22e4064870 2023-08-17T00:06:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22e8903700 1 -- 172.21.15.153:0/2805742456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc00b9d0 con 0x7f22e4064870 2023-08-17T00:06:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22e8903700 1 -- 172.21.15.153:0/2805742456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00bd50 con 0x7f22e4064870 2023-08-17T00:06:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 -- 172.21.15.153:0/2805742456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4064870 msgr2=0x7f22e4064d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.200+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2805742456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4064870 0x7f22e4064d20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f22dc009f20 tx=0x7f22dc009840).stop 2023-08-17T00:06:17.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 -- 172.21.15.153:0/2805742456 shutdown_connections 2023-08-17T00:06:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2805742456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4064870 0x7f22e4064d20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2805742456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4151b90 0x7f22e4151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 -- 172.21.15.153:0/2805742456 >> 172.21.15.153:0/2805742456 conn(0x7f22e40c7150 msgr2=0x7f22e40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 -- 172.21.15.153:0/2805742456 shutdown_connections 2023-08-17T00:06:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 -- 172.21.15.153:0/2805742456 wait complete. 2023-08-17T00:06:17.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 Processor -- start 2023-08-17T00:06:17.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.204+0000 7f22ebb69700 1 -- start start 2023-08-17T00:06:17.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 0x7f22e414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4064870 0x7f22e414dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22e4151b90 0x7f22e4164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e414e250 con 0x7f22e4063290 2023-08-17T00:06:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40c0db0 con 0x7f22e4151b90 2023-08-17T00:06:17.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40a7db0 con 0x7f22e4064870 2023-08-17T00:06:17.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 0x7f22e414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 0x7f22e414d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60968/0 (socket says 172.21.15.153:60968) 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 -- 172.21.15.153:0/2470691319 learned_addr learned my addr 172.21.15.153:0/2470691319 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9104700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4064870 0x7f22e414dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ea106700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22e4151b90 0x7f22e4164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 -- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4064870 msgr2=0x7f22e414dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4064870 0x7f22e414dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 -- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22e4151b90 msgr2=0x7f22e4164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22e4151b90 0x7f22e4164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 -- 172.21.15.153:0/2470691319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc009ae0 con 0x7f22e4063290 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9104700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4064870 0x7f22e414dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22e9905700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 0x7f22e414d870 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f22e000e900 tx=0x7f22e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000c640 con 0x7f22e4063290 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e000c7a0 con 0x7f22e4063290 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4155280 con 0x7f22e4063290 2023-08-17T00:06:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e000cb20 con 0x7f22e4063290 2023-08-17T00:06:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.208+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e40a82e0 con 0x7f22e4063290 2023-08-17T00:06:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.212+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e406b530 con 0x7f22e4063290 2023-08-17T00:06:17.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.212+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f22e0022070 con 0x7f22e4063290 2023-08-17T00:06:17.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.212+0000 7f22d9ffb700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22c805a180 0x7f22c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.212+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22e0074350 con 0x7f22e4063290 2023-08-17T00:06:17.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.212+0000 7f22e9104700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22c805a180 0x7f22c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.216+0000 7f22e9104700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22c805a180 0x7f22c805c640 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f22e40c2e60 tx=0x7f22d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:17.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.220+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f22e0047e00 con 0x7f22e4063290 2023-08-17T00:06:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.412+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22e40621f0 con 0x7f22e4063290 2023-08-17T00:06:17.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.412+0000 7f22d9ffb700 1 -- 172.21.15.153:0/2470691319 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f22e0016020 con 0x7f22e4063290 2023-08-17T00:06:17.419 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:17.419 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:17.339126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22c805a180 msgr2=0x7f22c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22c805a180 0x7f22c805c640 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f22e40c2e60 tx=0x7f22d4009040).stop 2023-08-17T00:06:17.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 msgr2=0x7f22e414d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 0x7f22e414d870 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f22e000e900 tx=0x7f22e0009060).stop 2023-08-17T00:06:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 shutdown_connections 2023-08-17T00:06:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22c805a180 0x7f22c805c640 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f22e4151b90 0x7f22e4164710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22e4064870 0x7f22e414dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 --2- 172.21.15.153:0/2470691319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22e4063290 0x7f22e414d870 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 >> 172.21.15.153:0/2470691319 conn(0x7f22e40c7150 msgr2=0x7f22e40c50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:17.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 shutdown_connections 2023-08-17T00:06:17.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.416+0000 7f22ebb69700 1 -- 172.21.15.153:0/2470691319 wait complete. 2023-08-17T00:06:17.424 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 39 2023-08-17T00:06:17.442 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2023-08-17T00:06:17.608 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:17.608 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:17.609 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:17.623 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:17.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:17.624 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2023-08-17T00:06:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:06:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:06:17.681 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343783 s, 30.5 MB/s 2023-08-17T00:06:17.682 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2023-08-17T00:06:17.683 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.836+0000 7f5b156db700 1 Processor -- start 2023-08-17T00:06:17.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b156db700 1 -- start start 2023-08-17T00:06:17.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b156db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b100a56e0 0x7f5b100a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b156db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b10151a40 con 0x7f5b100bb470 2023-08-17T00:06:17.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b156db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b100649d0 con 0x7f5b10061fa0 2023-08-17T00:06:17.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b156db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b100647c0 con 0x7f5b100a56e0 2023-08-17T00:06:17.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b0e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5b100bb470 0x7f5b100c20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53830/0 (socket says 172.21.15.153:53830) 2023-08-17T00:06:17.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.840+0000 7f5b0e7fc700 1 -- 172.21.15.153:0/2836041869 learned_addr learned my addr 172.21.15.153:0/2836041869 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:17.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 --2- 172.21.15.153:0/2836041869 >> v2:172.21.15.178:3300/0 conn(0x7f5b100a56e0 0x7f5b100a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1016798486 0 0) 0x7f5b10151a40 con 0x7f5b100bb470 2023-08-17T00:06:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af80033f0 con 0x7f5b100bb470 2023-08-17T00:06:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847638939 0 0) 0x7f5b100649d0 con 0x7f5b10061fa0 2023-08-17T00:06:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b10151a40 con 0x7f5b10061fa0 2023-08-17T00:06:17.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3514086766 0 0) 0x7f5af80033f0 con 0x7f5b100bb470 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 >> v2:172.21.15.178:3300/0 conn(0x7f5b100a56e0 msgr2=0x7f5b100a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 --2- 172.21.15.153:0/2836041869 >> v2:172.21.15.178:3300/0 conn(0x7f5b100a56e0 0x7f5b100a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 >> v1:172.21.15.178:6789/0 conn(0x7f5b10061fa0 legacy=0x7f5b100bc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10064cb0 con 0x7f5b100bb470 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f5b04001470 con 0x7f5b100bb470 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 >> v1:172.21.15.153:6789/0 conn(0x7f5b100bb470 legacy=0x7f5b100c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5af8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af8004690 0x7f5af8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af8005050 0x7f5af800daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100647c0 con 0x7f5af8003a70 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af800e1d0 con 0x7f5af8004690 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af800e390 con 0x7f5af8005050 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5af8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0e7fc700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af8004690 0x7f5af8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0f7fe700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af8005050 0x7f5af800daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 -- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af8005050 msgr2=0x7f5af800daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5af8005050 0x7f5af800daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 -- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af8004690 msgr2=0x7f5af8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5af8004690 0x7f5af8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0f7fe700 1 -- 172.21.15.153:0/2836041869 reap_dead start 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 -- 172.21.15.153:0/2836041869 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80033f0 con 0x7f5af8003a70 2023-08-17T00:06:17.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0effd700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5af8003e70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f5b00009a80 tx=0x7f5b00009060).ready entity=mon.0 client_cookie=46110f26fbb43be server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00009430 con 0x7f5af8003a70 2023-08-17T00:06:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000e640 con 0x7f5af8003a70 2023-08-17T00:06:17.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.844+0000 7f5b0dffb700 1 -- 172.21.15.153:0/2836041869 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000e9c0 con 0x7f5af8003a70 2023-08-17T00:06:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 -- 172.21.15.153:0/2836041869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 msgr2=0x7f5af8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5af8003e70 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f5b00009a80 tx=0x7f5b00009060).stop 2023-08-17T00:06:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 -- 172.21.15.153:0/2836041869 shutdown_connections 2023-08-17T00:06:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 --2- 172.21.15.153:0/2836041869 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5af8003e70 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 -- 172.21.15.153:0/2836041869 >> 172.21.15.153:0/2836041869 conn(0x7f5b100c2fb0 msgr2=0x7f5b100c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 -- 172.21.15.153:0/2836041869 shutdown_connections 2023-08-17T00:06:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 -- 172.21.15.153:0/2836041869 wait complete. 2023-08-17T00:06:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 Processor -- start 2023-08-17T00:06:17.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.848+0000 7f5b156db700 1 -- start start 2023-08-17T00:06:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5b10163cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1015fc40 0x7f5b1009f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1009fda0 0x7f5b100ab610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101641a0 con 0x7f5af8003a70 2023-08-17T00:06:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10160420 con 0x7f5b1009fda0 2023-08-17T00:06:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b10160700 con 0x7f5b1015fc40 2023-08-17T00:06:17.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5b10163cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5b10163cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60986/0 (socket says 172.21.15.153:60986) 2023-08-17T00:06:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 -- 172.21.15.153:0/1397404735 learned_addr learned my addr 172.21.15.153:0/1397404735 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0e7fc700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1015fc40 0x7f5b1009f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0f7fe700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1009fda0 0x7f5b100ab610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 -- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1015fc40 msgr2=0x7f5b1009f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1015fc40 0x7f5b1009f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 -- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1009fda0 msgr2=0x7f5b100ab610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1009fda0 0x7f5b100ab610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:17.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 -- 172.21.15.153:0/1397404735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b101609e0 con 0x7f5af8003a70 2023-08-17T00:06:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b0effd700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5b10163cb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f5b0000e4b0 tx=0x7f5b0001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000ed30 con 0x7f5af8003a70 2023-08-17T00:06:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0000ee90 con 0x7f5af8003a70 2023-08-17T00:06:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10160fb0 con 0x7f5af8003a70 2023-08-17T00:06:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b000243f0 con 0x7f5af8003a70 2023-08-17T00:06:17.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.852+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100abb00 con 0x7f5af8003a70 2023-08-17T00:06:17.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.856+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b10160e10 con 0x7f5af8003a70 2023-08-17T00:06:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.856+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5b0002b030 con 0x7f5af8003a70 2023-08-17T00:06:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.856+0000 7f5af6ffd700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a180 0x7f5afc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.860+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5b000753b0 con 0x7f5af8003a70 2023-08-17T00:06:17.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.860+0000 7f5b0e7fc700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a180 0x7f5afc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:17.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.860+0000 7f5b0e7fc700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a180 0x7f5afc05c640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5b100ac300 tx=0x7f5b04001e10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:17.864+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b10160e10 con 0x7f5af8003a70 2023-08-17T00:06:18.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.060+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b10160e10 con 0x7f5af8003a70 2023-08-17T00:06:18.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.060+0000 7f5af6ffd700 1 -- 172.21.15.153:0/1397404735 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f5b10160e10 con 0x7f5af8003a70 2023-08-17T00:06:18.067 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:18.067 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:17.339126+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":7,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:18.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a180 msgr2=0x7f5afc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a180 0x7f5afc05c640 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f5b100ac300 tx=0x7f5b04001e10).stop 2023-08-17T00:06:18.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 msgr2=0x7f5b10163cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5b10163cb0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f5b0000e4b0 tx=0x7f5b0001a000).stop 2023-08-17T00:06:18.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 shutdown_connections 2023-08-17T00:06:18.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a180 0x7f5afc05c640 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b1009fda0 0x7f5b100ab610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b1015fc40 0x7f5b1009f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 --2- 172.21.15.153:0/1397404735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5af8003a70 0x7f5b10163cb0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 >> 172.21.15.153:0/1397404735 conn(0x7f5b100c2fb0 msgr2=0x7f5b100c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 shutdown_connections 2023-08-17T00:06:18.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.064+0000 7f5b156db700 1 -- 172.21.15.153:0/1397404735 wait complete. 2023-08-17T00:06:18.074 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 39 2023-08-17T00:06:18.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2023-08-17T00:06:18.253 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:18.253 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:18.254 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:18.268 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:18.269 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:06:18.269 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:06:18.269 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:06:18.270 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:06:18.270 DEBUG:teuthology.orchestra.run.smithi153:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2023-08-17T00:06:18.270 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:06:18.366 INFO:teuthology.orchestra.run.smithi153.stdout:1099511630187 2023-08-17T00:06:18.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-08-17T00:06:18.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.756+0000 7f9079d07700 1 Processor -- start 2023-08-17T00:06:18.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.756+0000 7f9079d07700 1 -- start start 2023-08-17T00:06:18.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079d07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9074154370 0x7f90740c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079d07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90740bfd10 con 0x7f90740c57a0 2023-08-17T00:06:18.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9074154af0 con 0x7f9074153f50 2023-08-17T00:06:18.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079d07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9074154dd0 con 0x7f9074154370 2023-08-17T00:06:18.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9078d05700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f90740c57a0 0x7f90740c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53836/0 (socket says 172.21.15.153:53836) 2023-08-17T00:06:18.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9078d05700 1 -- 172.21.15.153:0/2324833823 learned_addr learned my addr 172.21.15.153:0/2324833823 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:18.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079506700 1 --2- 172.21.15.153:0/2324833823 >> v2:172.21.15.178:3300/0 conn(0x7f9074154370 0x7f90740c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f90737fe700 1 -- 172.21.15.153:0/2324833823 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223106183 0 0) 0x7f90740bfd10 con 0x7f90740c57a0 2023-08-17T00:06:18.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079506700 1 -- 172.21.15.153:0/2324833823 >> v1:172.21.15.178:6789/0 conn(0x7f9074153f50 legacy=0x7f90740c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079506700 1 -- 172.21.15.153:0/2324833823 >> v1:172.21.15.153:6789/0 conn(0x7f90740c57a0 legacy=0x7f90740c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079506700 1 -- 172.21.15.153:0/2324833823 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90740bf9a0 con 0x7f9074154370 2023-08-17T00:06:18.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f9079506700 1 --2- 172.21.15.153:0/2324833823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074154370 0x7f90740c08b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f906c009e60 tx=0x7f906c009780).ready entity=mon.1 client_cookie=c16bc3ed0e6c4066 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f90737fe700 1 -- 172.21.15.153:0/2324833823 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c00e070 con 0x7f9074154370 2023-08-17T00:06:18.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f90737fe700 1 -- 172.21.15.153:0/2324833823 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906c00bc30 con 0x7f9074154370 2023-08-17T00:06:18.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.760+0000 7f90737fe700 1 -- 172.21.15.153:0/2324833823 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c012410 con 0x7f9074154370 2023-08-17T00:06:18.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 -- 172.21.15.153:0/2324833823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074154370 msgr2=0x7f90740c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 --2- 172.21.15.153:0/2324833823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074154370 0x7f90740c08b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f906c009e60 tx=0x7f906c009780).stop 2023-08-17T00:06:18.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 -- 172.21.15.153:0/2324833823 shutdown_connections 2023-08-17T00:06:18.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 --2- 172.21.15.153:0/2324833823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074154370 0x7f90740c08b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 -- 172.21.15.153:0/2324833823 >> 172.21.15.153:0/2324833823 conn(0x7f9074062a70 msgr2=0x7f90740ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 -- 172.21.15.153:0/2324833823 shutdown_connections 2023-08-17T00:06:18.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 -- 172.21.15.153:0/2324833823 wait complete. 2023-08-17T00:06:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 Processor -- start 2023-08-17T00:06:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.764+0000 7f9079d07700 1 -- start start 2023-08-17T00:06:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 0x7f90740b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074153f50 0x7f90740c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074154370 0x7f9074158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740c2b50 con 0x7f90740c57a0 2023-08-17T00:06:18.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90740ae220 con 0x7f9074153f50 2023-08-17T00:06:18.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90740c22b0 con 0x7f9074154370 2023-08-17T00:06:18.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 0x7f90740b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 0x7f90740b0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60990/0 (socket says 172.21.15.153:60990) 2023-08-17T00:06:18.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 -- 172.21.15.153:0/2838485113 learned_addr learned my addr 172.21.15.153:0/2838485113 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079506700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074154370 0x7f9074158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9073fff700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074153f50 0x7f90740c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 -- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074154370 msgr2=0x7f9074158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074154370 0x7f9074158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 -- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074153f50 msgr2=0x7f90740c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074153f50 0x7f90740c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 -- 172.21.15.153:0/2838485113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c009a20 con 0x7f90740c57a0 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9078d05700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 0x7f90740b0250 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f906800c4c0 tx=0x7f9068007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9070ff9700 1 -- 172.21.15.153:0/2838485113 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680070d0 con 0x7f90740c57a0 2023-08-17T00:06:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9070ff9700 1 -- 172.21.15.153:0/2838485113 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068007230 con 0x7f90740c57a0 2023-08-17T00:06:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90740c2590 con 0x7f90740c57a0 2023-08-17T00:06:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9070ff9700 1 -- 172.21.15.153:0/2838485113 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90680075d0 con 0x7f90740c57a0 2023-08-17T00:06:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.768+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90740b0740 con 0x7f90740c57a0 2023-08-17T00:06:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.772+0000 7f9070ff9700 1 -- 172.21.15.153:0/2838485113 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f906801a060 con 0x7f90740c57a0 2023-08-17T00:06:18.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.772+0000 7f9070ff9700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905805a150 0x7f905805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.772+0000 7f9070ff9700 1 -- 172.21.15.153:0/2838485113 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f90680737c0 con 0x7f90740c57a0 2023-08-17T00:06:18.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.776+0000 7f9073fff700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905805a150 0x7f905805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.776+0000 7f9073fff700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905805a150 0x7f905805c610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9074156260 tx=0x7f9060009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.776+0000 7f908531a740 1 Processor -- start 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.776+0000 7f908531a740 1 -- start start 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5e8c0 0x2a84a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 0x2a5eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a59e90 0x2a5ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ab1a0 con 0x2a5f270 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a59a00 con 0x2a5e8c0 2023-08-17T00:06:18.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a593f0 con 0x2a59e90 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 0x2a5eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 0x2a5eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60998/0 (socket says 172.21.15.153:60998) 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 -- 172.21.15.153:0/3889948885 learned_addr learned my addr 172.21.15.153:0/3889948885 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9078d05700 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5e8c0 0x2a84a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9079506700 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a59e90 0x2a5ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 -- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a59e90 msgr2=0x2a5ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a59e90 0x2a5ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 -- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5e8c0 msgr2=0x2a84a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5e8c0 0x2a84a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 -- 172.21.15.153:0/3889948885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29eae30 con 0x2a5f270 2023-08-17T00:06:18.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f9073fff700 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 0x2a5eca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f906000f720 tx=0x7f9060013000).ready entity=mon.0 client_cookie=98650a2141667a0c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f905dffb700 1 -- 172.21.15.153:0/3889948885 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060020450 con 0x2a5f270 2023-08-17T00:06:18.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f905dffb700 1 -- 172.21.15.153:0/3889948885 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600205b0 con 0x2a5f270 2023-08-17T00:06:18.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f905dffb700 1 -- 172.21.15.153:0/3889948885 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060020930 con 0x2a5f270 2023-08-17T00:06:18.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- 172.21.15.153:0/3889948885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 msgr2=0x2a5eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 0x2a5eca0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f906000f720 tx=0x7f9060013000).stop 2023-08-17T00:06:18.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- 172.21.15.153:0/3889948885 shutdown_connections 2023-08-17T00:06:18.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a59e90 0x2a5ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a5f270 0x2a5eca0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 --2- 172.21.15.153:0/3889948885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5e8c0 0x2a84a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- 172.21.15.153:0/3889948885 >> 172.21.15.153:0/3889948885 conn(0x283e680 msgr2=0x2aa5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- 172.21.15.153:0/3889948885 shutdown_connections 2023-08-17T00:06:18.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- 172.21.15.153:0/3889948885 wait complete. 2023-08-17T00:06:18.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.780+0000 7f908531a740 1 -- start start 2023-08-17T00:06:18.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 Processor -- start 2023-08-17T00:06:18.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a9c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9d270 con 0x2a59e90 2023-08-17T00:06:18.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9f230 con 0x2a5f270 2023-08-17T00:06:18.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a85ac0 con 0x2a5e8c0 2023-08-17T00:06:18.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 10 client.0 ll_register_callbacks cb 0x29a1b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a9c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a9c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32768/0 (socket says 172.21.15.153:32768) 2023-08-17T00:06:18.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 -- 172.21.15.153:0/2739240677 learned_addr learned my addr 172.21.15.153:0/2739240677 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9079506700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9073fff700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 -- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 msgr2=0x2a7efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 -- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 msgr2=0x2ab2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 -- 172.21.15.153:0/2739240677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9074154af0 con 0x2a59e90 2023-08-17T00:06:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9078d05700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a9c9e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9068047320 tx=0x7f906800f000).ready entity=mon.0 client_cookie=d07b3d1753e615a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9052ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9052ffd700 1 -- 172.21.15.153:0/2739240677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068071ea0 con 0x2a59e90 2023-08-17T00:06:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9052ffd700 1 -- 172.21.15.153:0/2739240677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9068046c10 con 0x2a59e90 2023-08-17T00:06:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29d5cf0 con 0x2a59e90 2023-08-17T00:06:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f9052ffd700 1 -- 172.21.15.153:0/2739240677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9068055070 con 0x2a59e90 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 10 client.5712 fetch_fsmap learned FSMap version 39 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.784+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x29d9010 con 0x2a59e90 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9052ffd700 1 -- 172.21.15.153:0/2739240677 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29d5cf0 con 0x2a59e90 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9052ffd700 1 -- 172.21.15.153:0/2739240677 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9068049d80 con 0x2a59e90 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 10 client.5712 fetch_fsmap finished waiting for FSMap version 39 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 10 client.5712 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 20 client.5712 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:18.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a878f0 0x2ab55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 4 client.5712 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29cc240 con 0x2a878f0 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9073fff700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a878f0 0x2ab55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9073fff700 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a878f0 0x2ab55d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=abb1d71f227fc944 server_cookie=a676e532f5aa11af in_seq=0 out_seq=0 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9052ffd700 10 client.5712 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9052ffd700 1 -- 172.21.15.153:0/2739240677 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x29cc240 con 0x2a878f0 2023-08-17T00:06:18.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9052ffd700 10 client.5712 handle_command_reply: tid=0 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 client.5712 shutdown 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 msgr2=0x2a9c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a9c9e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f9068047320 tx=0x7f906800f000).stop 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 shutdown_connections 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a878f0 0x2ab55d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 --2- 172.21.15.153:0/2739240677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a9c9e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f9052ffd700 0 client.5712 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:18.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 >> 172.21.15.153:0/2739240677 conn(0x283e680 msgr2=0x2a83ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 shutdown_connections 2023-08-17T00:06:18.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 1 -- 172.21.15.153:0/2739240677 wait complete. 2023-08-17T00:06:18.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.788+0000 7f908531a740 20 client.5712 trim_cache size 0 max 16384 2023-08-17T00:06:18.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.804+0000 7f908531a740 1 Processor -- start 2023-08-17T00:06:18.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.804+0000 7f908531a740 1 -- start start 2023-08-17T00:06:18.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a7ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a598c0 con 0x2a59e90 2023-08-17T00:06:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9fa30 con 0x2a5f270 2023-08-17T00:06:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a7e8b0 con 0x2a5e8c0 2023-08-17T00:06:18.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a7ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a7ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32784/0 (socket says 172.21.15.153:32784) 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 -- 172.21.15.153:0/4252546154 learned_addr learned my addr 172.21.15.153:0/4252546154 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9073fff700 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9079506700 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 -- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 msgr2=0x2a7e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 -- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 msgr2=0x2ab1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 -- 172.21.15.153:0/4252546154 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a7f320 con 0x2a59e90 2023-08-17T00:06:18.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9079506700 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:18.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f9078d05700 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a7ded0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9068001080 tx=0x7f9068061000).ready entity=mon.0 client_cookie=cca322baa1f0dbce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f905e7fc700 1 -- 172.21.15.153:0/4252546154 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906804adc0 con 0x2a59e90 2023-08-17T00:06:18.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f905e7fc700 1 -- 172.21.15.153:0/4252546154 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068047160 con 0x2a59e90 2023-08-17T00:06:18.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f905e7fc700 1 -- 172.21.15.153:0/4252546154 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9068046c10 con 0x2a59e90 2023-08-17T00:06:18.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- 172.21.15.153:0/4252546154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 msgr2=0x2a7ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a7ded0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f9068001080 tx=0x7f9068061000).stop 2023-08-17T00:06:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- 172.21.15.153:0/4252546154 shutdown_connections 2023-08-17T00:06:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2ab1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2a7e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 --2- 172.21.15.153:0/4252546154 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a59e90 0x2a7ded0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- 172.21.15.153:0/4252546154 >> 172.21.15.153:0/4252546154 conn(0x283e680 msgr2=0x2a7f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- 172.21.15.153:0/4252546154 shutdown_connections 2023-08-17T00:06:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.808+0000 7f908531a740 1 -- 172.21.15.153:0/4252546154 wait complete. 2023-08-17T00:06:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 -- start start 2023-08-17T00:06:18.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 Processor -- start 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2aa05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2aa0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 0x2a88420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a84140 con 0x2b07790 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2aa0fa0 con 0x2a5f270 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aa4930 con 0x2a5e8c0 2023-08-17T00:06:18.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f908531a740 10 client.0 ll_register_callbacks cb 0x7f906804a960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f9079506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 0x2a88420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f9079506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 0x2a88420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32788/0 (socket says 172.21.15.153:32788) 2023-08-17T00:06:18.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.812+0000 7f9079506700 1 -- 172.21.15.153:0/3098425007 learned_addr learned my addr 172.21.15.153:0/3098425007 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9078d05700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2aa05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9073fff700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2aa0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9079506700 1 -- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 msgr2=0x2aa05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9079506700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2aa05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9079506700 1 -- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 msgr2=0x2aa0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9079506700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2aa0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9079506700 1 -- 172.21.15.153:0/3098425007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x29d9010 con 0x2b07790 2023-08-17T00:06:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9078d05700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2aa05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9073fff700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2aa0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9079506700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 0x2a88420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f9074083860 tx=0x7f906c009780).ready entity=mon.0 client_cookie=2c6413f30b23ce13 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 1 -- 172.21.15.153:0/3098425007 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906c025070 con 0x2b07790 2023-08-17T00:06:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90600205b0 con 0x2b07790 2023-08-17T00:06:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 1 -- 172.21.15.153:0/3098425007 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f906c01f620 con 0x2b07790 2023-08-17T00:06:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 1 -- 172.21.15.153:0/3098425007 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f906c01fa40 con 0x2b07790 2023-08-17T00:06:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 10 client.5718 fetch_fsmap learned FSMap version 39 2023-08-17T00:06:18.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x7f9074158d50 con 0x2b07790 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 1 -- 172.21.15.153:0/3098425007 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90600205b0 con 0x2b07790 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 1 -- 172.21.15.153:0/3098425007 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f906c01fba0 con 0x2b07790 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 10 client.5718 fetch_fsmap finished waiting for FSMap version 39 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 10 client.5718 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 20 client.5718 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a88910 0x2a88d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 4 client.5718 mds_command: new command op to 5427 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:06:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x2895610 con 0x2a88910 2023-08-17T00:06:18.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9078d05700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a88910 0x2a88d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9078d05700 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a88910 0x2a88d20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3a5c30088b3afb1e server_cookie=34e24a4d956fdc72 in_seq=0 out_seq=0 2023-08-17T00:06:18.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 10 client.5718 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:18.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 1 -- 172.21.15.153:0/3098425007 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x2895610 con 0x2a88910 2023-08-17T00:06:18.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f9052ffd700 10 client.5718 handle_command_reply: tid=0 2023-08-17T00:06:18.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 client.5718 shutdown 2023-08-17T00:06:18.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 msgr2=0x2a88420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 0x2a88420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f9074083860 tx=0x7f906c009780).stop 2023-08-17T00:06:18.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 shutdown_connections 2023-08-17T00:06:18.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.816+0000 7f908531a740 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2a88910 0x2a88d20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b07790 0x2a88420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5f270 0x2aa0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 1 --2- 172.21.15.153:0/3098425007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a5e8c0 0x2aa05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 >> 172.21.15.153:0/3098425007 conn(0x283e680 msgr2=0x2a7e080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9052ffd700 0 client.5718 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:18.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 shutdown_connections 2023-08-17T00:06:18.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 1 -- 172.21.15.153:0/3098425007 wait complete. 2023-08-17T00:06:18.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f908531a740 20 client.5718 trim_cache size 0 max 16384 2023-08-17T00:06:18.831 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-08-17T00:06:18.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905805a150 msgr2=0x7f905805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905805a150 0x7f905805c610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9074156260 tx=0x7f9060009040).stop 2023-08-17T00:06:18.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 msgr2=0x7f90740b0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 0x7f90740b0250 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f906800c4c0 tx=0x7f9068007e40).stop 2023-08-17T00:06:18.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 shutdown_connections 2023-08-17T00:06:18.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905805a150 0x7f905805c610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9074154370 0x7f9074158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9074153f50 0x7f90740c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 --2- 172.21.15.153:0/2838485113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90740c57a0 0x7f90740b0250 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 >> 172.21.15.153:0/2838485113 conn(0x7f9074062a70 msgr2=0x7f90741567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 shutdown_connections 2023-08-17T00:06:18.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.820+0000 7f9079d07700 1 -- 172.21.15.153:0/2838485113 wait complete. 2023-08-17T00:06:18.846 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096b.00000000 parent 2023-08-17T00:06:18.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.896+0000 7f6f71324d00 1 Processor -- start 2023-08-17T00:06:18.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.896+0000 7f6f71324d00 1 -- start start 2023-08-17T00:06:18.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f71324d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b50cc70 0x556f8b5b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f71324d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 0x556f8b50e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f71324d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b5b8600 0x556f8b5299e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f71324d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8b453ce0 con 0x556f8b5b3b50 2023-08-17T00:06:18.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f71324d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8b50cac0 con 0x556f8b5b8600 2023-08-17T00:06:18.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f71324d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f8b5af770 con 0x556f8b50cc70 2023-08-17T00:06:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 0x556f8b50e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 0x556f8b50e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32818/0 (socket says 172.21.15.153:32818) 2023-08-17T00:06:18.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 -- 172.21.15.153:0/3353526396 learned_addr learned my addr 172.21.15.153:0/3353526396 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f6ec45700 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b50cc70 0x556f8b5b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f6f446700 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b5b8600 0x556f8b5299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 -- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b50cc70 msgr2=0x556f8b5b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b50cc70 0x556f8b5b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 -- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b5b8600 msgr2=0x556f8b5299e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b5b8600 0x556f8b5299e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 -- 172.21.15.153:0/3353526396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f58005cf0 con 0x556f8b5b3b50 2023-08-17T00:06:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f66444700 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 0x556f8b50e390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x556f8b479150 tx=0x7f6f58015000).ready entity=mon.0 client_cookie=f2ba58b385454980 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f6dc43700 1 -- 172.21.15.153:0/3353526396 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58007ea0 con 0x556f8b5b3b50 2023-08-17T00:06:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f6dc43700 1 -- 172.21.15.153:0/3353526396 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58005330 con 0x556f8b5b3b50 2023-08-17T00:06:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.900+0000 7f6f6dc43700 1 -- 172.21.15.153:0/3353526396 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58007610 con 0x556f8b5b3b50 2023-08-17T00:06:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 -- 172.21.15.153:0/3353526396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 msgr2=0x556f8b50e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 0x556f8b50e390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x556f8b479150 tx=0x7f6f58015000).stop 2023-08-17T00:06:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 -- 172.21.15.153:0/3353526396 shutdown_connections 2023-08-17T00:06:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b5b8600 0x556f8b5299e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b3b50 0x556f8b50e390 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3353526396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b50cc70 0x556f8b5b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 -- 172.21.15.153:0/3353526396 >> 172.21.15.153:0/3353526396 conn(0x556f8b52b770 msgr2=0x556f8b50a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 -- 172.21.15.153:0/3353526396 shutdown_connections 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 -- 172.21.15.153:0/3353526396 wait complete. 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 Processor -- start 2023-08-17T00:06:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.904+0000 7f6f71324d00 1 -- start start 2023-08-17T00:06:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b50cc70 0x556f8b52a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b5b3b50 0x556f8b510770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b8600 0x556f8b5ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8b5102e0 con 0x556f8b5b8600 2023-08-17T00:06:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556f8b50f6d0 con 0x556f8b50cc70 2023-08-17T00:06:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556f8b50f9b0 con 0x556f8b5b3b50 2023-08-17T00:06:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b8600 0x556f8b5ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b8600 0x556f8b5ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32820/0 (socket says 172.21.15.153:32820) 2023-08-17T00:06:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 -- 172.21.15.153:0/3591264009 learned_addr learned my addr 172.21.15.153:0/3591264009 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6ec45700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b50cc70 0x556f8b52a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f66444700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b5b3b50 0x556f8b510770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 -- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b5b3b50 msgr2=0x556f8b510770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556f8b5b3b50 0x556f8b510770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 -- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b50cc70 msgr2=0x556f8b52a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556f8b50cc70 0x556f8b52a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 -- 172.21.15.153:0/3591264009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556f8b47d4e0 con 0x556f8b5b8600 2023-08-17T00:06:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f6f446700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b8600 0x556f8b5ae720 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f6f6800d210 tx=0x7f6f68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f67fff700 1 -- 172.21.15.153:0/3591264009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6800dd50 con 0x556f8b5b8600 2023-08-17T00:06:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f67fff700 1 -- 172.21.15.153:0/3591264009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f680060d0 con 0x556f8b5b8600 2023-08-17T00:06:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556f8b47d230 con 0x556f8b5b8600 2023-08-17T00:06:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f67fff700 1 -- 172.21.15.153:0/3591264009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f68004520 con 0x556f8b5b8600 2023-08-17T00:06:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.908+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556f8b44ca70 con 0x556f8b5b8600 2023-08-17T00:06:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.912+0000 7f6f67fff700 1 -- 172.21.15.153:0/3591264009 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6f68004890 con 0x556f8b5b8600 2023-08-17T00:06:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.912+0000 7f6f67fff700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f50058c30 0x7f6f5005b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.912+0000 7f6f67fff700 1 -- 172.21.15.153:0/3591264009 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6f68072db0 con 0x556f8b5b8600 2023-08-17T00:06:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.916+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556f8b5b03e0 0x556f8b5b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.916+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- osd_op(unknown.0.0:1 8.a 8:51f47cfd:::1000000096b.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected e50) v8 -- 0x556f8b5b0ce0 con 0x556f8b5b03e0 2023-08-17T00:06:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.916+0000 7f6f6ec45700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f50058c30 0x7f6f5005b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.916+0000 7f6f66444700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556f8b5b03e0 0x556f8b5b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.916+0000 7f6f6ec45700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f50058c30 0x7f6f5005b0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6f60005fd0 tx=0x7f6f6000c040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.916+0000 7f6f66444700 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556f8b5b03e0 0x556f8b5b07f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f66444700 1 -- 172.21.15.153:0/3591264009 <== osd.5 v2:172.21.15.178:6816/33067 1 ==== osd_op_reply(1 1000000096b.00000000 [rmxattr] v50'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6f58000bc0 con 0x556f8b5b03e0 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556f8b5b03e0 msgr2=0x556f8b5b07f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556f8b5b03e0 0x556f8b5b07f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f50058c30 msgr2=0x7f6f5005b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f50058c30 0x7f6f5005b0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6f60005fd0 tx=0x7f6f6000c040).stop 2023-08-17T00:06:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b8600 msgr2=0x556f8b5ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 --2- 172.21.15.153:0/3591264009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556f8b5b8600 0x556f8b5ae720 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f6f6800d210 tx=0x7f6f68008040).stop 2023-08-17T00:06:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f6f446700 1 -- 172.21.15.153:0/3591264009 reap_dead start 2023-08-17T00:06:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 shutdown_connections 2023-08-17T00:06:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 >> 172.21.15.153:0/3591264009 conn(0x556f8b52b770 msgr2=0x556f8b4db930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 shutdown_connections 2023-08-17T00:06:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:18.920+0000 7f6f71324d00 1 -- 172.21.15.153:0/3591264009 wait complete. 2023-08-17T00:06:18.931 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2023-08-17T00:06:18.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2023-08-17T00:06:19.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.140+0000 7faf525f9700 1 Processor -- start 2023-08-17T00:06:19.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.140+0000 7faf525f9700 1 -- start start 2023-08-17T00:06:19.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf4c0a8df0 0x7faf4c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faf4c068820 0x7faf4c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c1585a0 con 0x7faf4c061fa0 2023-08-17T00:06:19.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c066400 con 0x7faf4c0a8df0 2023-08-17T00:06:19.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c069170 con 0x7faf4c068820 2023-08-17T00:06:19.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf4c0a8df0 0x7faf4c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf4c0a8df0 0x7faf4c0c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32826/0 (socket says 172.21.15.153:32826) 2023-08-17T00:06:19.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 -- 172.21.15.153:0/4197774656 learned_addr learned my addr 172.21.15.153:0/4197774656 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf50df6700 1 --2- 172.21.15.153:0/4197774656 >> v2:172.21.15.178:3300/0 conn(0x7faf4c068820 0x7faf4c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 -- 172.21.15.153:0/4197774656 >> v2:172.21.15.178:3300/0 conn(0x7faf4c068820 msgr2=0x7faf4c068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 --2- 172.21.15.153:0/4197774656 >> v2:172.21.15.178:3300/0 conn(0x7faf4c068820 0x7faf4c068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 -- 172.21.15.153:0/4197774656 >> v1:172.21.15.178:6789/0 conn(0x7faf4c061fa0 legacy=0x7faf4c062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 -- 172.21.15.153:0/4197774656 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0b9d30 con 0x7faf4c0a8df0 2023-08-17T00:06:19.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf515f7700 1 --2- 172.21.15.153:0/4197774656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c0a8df0 0x7faf4c0c1490 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7faf4c0c2ef0 tx=0x7faf48009060).ready entity=mon.0 client_cookie=355ecdabf0a731c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf43fff700 1 -- 172.21.15.153:0/4197774656 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48005880 con 0x7faf4c0a8df0 2023-08-17T00:06:19.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf43fff700 1 -- 172.21.15.153:0/4197774656 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf480059e0 con 0x7faf4c0a8df0 2023-08-17T00:06:19.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf43fff700 1 -- 172.21.15.153:0/4197774656 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48005d60 con 0x7faf4c0a8df0 2023-08-17T00:06:19.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 -- 172.21.15.153:0/4197774656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c0a8df0 msgr2=0x7faf4c0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 --2- 172.21.15.153:0/4197774656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c0a8df0 0x7faf4c0c1490 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7faf4c0c2ef0 tx=0x7faf48009060).stop 2023-08-17T00:06:19.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 -- 172.21.15.153:0/4197774656 shutdown_connections 2023-08-17T00:06:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 --2- 172.21.15.153:0/4197774656 >> v2:172.21.15.178:3300/0 conn(0x7faf4c068820 0x7faf4c068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 --2- 172.21.15.153:0/4197774656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c0a8df0 0x7faf4c0c1490 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.144+0000 7faf525f9700 1 -- 172.21.15.153:0/4197774656 >> 172.21.15.153:0/4197774656 conn(0x7faf4c0c6620 msgr2=0x7faf4c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.148+0000 7faf525f9700 1 -- 172.21.15.153:0/4197774656 shutdown_connections 2023-08-17T00:06:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.148+0000 7faf525f9700 1 -- 172.21.15.153:0/4197774656 wait complete. 2023-08-17T00:06:19.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.148+0000 7faf525f9700 1 Processor -- start 2023-08-17T00:06:19.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.148+0000 7faf525f9700 1 -- start start 2023-08-17T00:06:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 0x7faf4c0bef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf4c068820 0x7faf4c0be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf4c0a8df0 0x7faf4c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0bf3f0 con 0x7faf4c061fa0 2023-08-17T00:06:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0c01f0 con 0x7faf4c068820 2023-08-17T00:06:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c0bea70 con 0x7faf4c0a8df0 2023-08-17T00:06:19.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 0x7faf4c0bef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 0x7faf4c0bef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32828/0 (socket says 172.21.15.153:32828) 2023-08-17T00:06:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 -- 172.21.15.153:0/3207913401 learned_addr learned my addr 172.21.15.153:0/3207913401 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf50df6700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf4c068820 0x7faf4c0be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf51df8700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf4c0a8df0 0x7faf4c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 -- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf4c0a8df0 msgr2=0x7faf4c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf4c0a8df0 0x7faf4c155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 -- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf4c068820 msgr2=0x7faf4c0be580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf4c068820 0x7faf4c0be580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 -- 172.21.15.153:0/3207913401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48009300 con 0x7faf4c061fa0 2023-08-17T00:06:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf515f7700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 0x7faf4c0bef00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7faf48006570 tx=0x7faf48016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf417fa700 1 -- 172.21.15.153:0/3207913401 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800b7b0 con 0x7faf4c061fa0 2023-08-17T00:06:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf417fa700 1 -- 172.21.15.153:0/3207913401 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4800b930 con 0x7faf4c061fa0 2023-08-17T00:06:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf417fa700 1 -- 172.21.15.153:0/3207913401 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4800bcf0 con 0x7faf4c061fa0 2023-08-17T00:06:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c0bf5e0 con 0x7faf4c061fa0 2023-08-17T00:06:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.152+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c0bfba0 con 0x7faf4c061fa0 2023-08-17T00:06:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.156+0000 7faf417fa700 1 -- 172.21.15.153:0/3207913401 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7faf4802a070 con 0x7faf4c061fa0 2023-08-17T00:06:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.156+0000 7faf417fa700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faf3005a150 0x7faf3005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.156+0000 7faf417fa700 1 -- 172.21.15.153:0/3207913401 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faf480751d0 con 0x7faf4c061fa0 2023-08-17T00:06:19.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.156+0000 7faf50df6700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faf3005a150 0x7faf3005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf50df6700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faf3005a150 0x7faf3005c610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7faf3c006fd0 tx=0x7faf3c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 Processor -- start 2023-08-17T00:06:19.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 -- start start 2023-08-17T00:06:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cb76e0 0x1c74300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c6fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bbf2d0 con 0x1c73f20 2023-08-17T00:06:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bee240 con 0x1c6f750 2023-08-17T00:06:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c6efe0 con 0x1cb76e0 2023-08-17T00:06:19.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32840/0 (socket says 172.21.15.153:32840) 2023-08-17T00:06:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 -- 172.21.15.153:0/1437614841 learned_addr learned my addr 172.21.15.153:0/1437614841 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf50df6700 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cb76e0 0x1c74300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf51df8700 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c6fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 -- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cb76e0 msgr2=0x1c74300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cb76e0 0x1c74300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 -- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 msgr2=0x1c6fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c6fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 -- 172.21.15.153:0/1437614841 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bff9d0 con 0x1c73f20 2023-08-17T00:06:19.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.160+0000 7faf515f7700 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7faf4804c870 tx=0x7faf48075040).ready entity=mon.0 client_cookie=d8be8d58a96cd58b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf367fc700 1 -- 172.21.15.153:0/1437614841 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48052070 con 0x1c73f20 2023-08-17T00:06:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf367fc700 1 -- 172.21.15.153:0/1437614841 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4804c2a0 con 0x1c73f20 2023-08-17T00:06:19.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf367fc700 1 -- 172.21.15.153:0/1437614841 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4804c8e0 con 0x1c73f20 2023-08-17T00:06:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 -- 172.21.15.153:0/1437614841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 msgr2=0x1c9a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a290 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7faf4804c870 tx=0x7faf48075040).stop 2023-08-17T00:06:19.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 -- 172.21.15.153:0/1437614841 shutdown_connections 2023-08-17T00:06:19.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c6fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cb76e0 0x1c74300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1437614841 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a290 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 -- 172.21.15.153:0/1437614841 >> 172.21.15.153:0/1437614841 conn(0x1a52980 msgr2=0x1c74aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 -- 172.21.15.153:0/1437614841 shutdown_connections 2023-08-17T00:06:19.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 -- 172.21.15.153:0/1437614841 wait complete. 2023-08-17T00:06:19.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 -- start start 2023-08-17T00:06:19.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.164+0000 7faf5dbee740 1 Processor -- start 2023-08-17T00:06:19.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c97330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cc6c00 0x1c9e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c9b1f0 con 0x1c73f20 2023-08-17T00:06:19.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cc74c0 con 0x1c6f750 2023-08-17T00:06:19.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c9e470 con 0x1cc6c00 2023-08-17T00:06:19.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 10 client.0 ll_register_callbacks cb 0x1c2ba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:19.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32844/0 (socket says 172.21.15.153:32844) 2023-08-17T00:06:19.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 -- 172.21.15.153:0/2895108294 learned_addr learned my addr 172.21.15.153:0/2895108294 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf51df8700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cc6c00 0x1c9e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf515f7700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c97330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 -- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cc6c00 msgr2=0x1c9e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cc6c00 0x1c9e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 -- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 msgr2=0x1c97330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c97330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 -- 172.21.15.153:0/2895108294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c0bfba0 con 0x1c73f20 2023-08-17T00:06:19.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf51df8700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cc6c00 0x1c9e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:19.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf515f7700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c97330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:19.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf50df6700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a7e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7faf3c00ff40 tx=0x7faf3c016040).ready entity=mon.0 client_cookie=a3975e023edee792 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:19.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2895108294 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c020480 con 0x1c73f20 2023-08-17T00:06:19.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2895108294 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faf3c0205e0 con 0x1c73f20 2023-08-17T00:06:19.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bb2cc0 con 0x1c73f20 2023-08-17T00:06:19.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2895108294 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf3c0209b0 con 0x1c73f20 2023-08-17T00:06:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 10 client.5742 fetch_fsmap learned FSMap version 39 2023-08-17T00:06:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x1bed140 con 0x1c73f20 2023-08-17T00:06:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2895108294 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bb2cc0 con 0x1c73f20 2023-08-17T00:06:19.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2895108294 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faf3c020b10 con 0x1c73f20 2023-08-17T00:06:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 10 client.5742 fetch_fsmap finished waiting for FSMap version 39 2023-08-17T00:06:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 10 client.5742 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:19.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 20 client.5742 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc6fe0 0x1cbb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 4 client.5742 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1be9e20 con 0x1cc6fe0 2023-08-17T00:06:19.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf515f7700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc6fe0 0x1cbb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf515f7700 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc6fe0 0x1cbb380 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b278ebcdf7a157ce server_cookie=93d0d53117781654 in_seq=0 out_seq=0 2023-08-17T00:06:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.168+0000 7faf2b7fe700 10 client.5742 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2895108294 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1be9e20 con 0x1cc6fe0 2023-08-17T00:06:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf2b7fe700 10 client.5742 handle_command_reply: tid=0 2023-08-17T00:06:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 client.5742 shutdown 2023-08-17T00:06:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 msgr2=0x1c9a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a7e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7faf3c00ff40 tx=0x7faf3c016040).stop 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 shutdown_connections 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1cc6fe0 0x1cbb380 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cc6c00 0x1c9e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c73f20 0x1c9a7e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2895108294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c97330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf2b7fe700 0 client.5742 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 >> 172.21.15.153:0/2895108294 conn(0x1a52980 msgr2=0x1c99080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 shutdown_connections 2023-08-17T00:06:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 1 -- 172.21.15.153:0/2895108294 wait complete. 2023-08-17T00:06:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.172+0000 7faf5dbee740 20 client.5742 trim_cache size 0 max 16384 2023-08-17T00:06:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.188+0000 7faf5dbee740 1 Processor -- start 2023-08-17T00:06:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.188+0000 7faf5dbee740 1 -- start start 2023-08-17T00:06:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c99080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 0x1c99570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1c98340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf5dbee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c136a0 con 0x1cc6c00 2023-08-17T00:06:19.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bb6c20 con 0x1c6f750 2023-08-17T00:06:19.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c9d400 con 0x1c9e8e0 2023-08-17T00:06:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 0x1c99570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf515f7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c99080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 0x1c99570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32850/0 (socket says 172.21.15.153:32850) 2023-08-17T00:06:19.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf51df8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1c98340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 -- 172.21.15.153:0/1597193228 learned_addr learned my addr 172.21.15.153:0/1597193228 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 -- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 msgr2=0x1c98340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1c98340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 -- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 msgr2=0x1c99080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c99080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 -- 172.21.15.153:0/1597193228 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c157d90 con 0x1cc6c00 2023-08-17T00:06:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf515f7700 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c99080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf50df6700 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 0x1c99570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7faf3c00f9d0 tx=0x7faf3c020000).ready entity=mon.0 client_cookie=70bfb8a532e98a97 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf36ffd700 1 -- 172.21.15.153:0/1597193228 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c013a70 con 0x1cc6c00 2023-08-17T00:06:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf36ffd700 1 -- 172.21.15.153:0/1597193228 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c020480 con 0x1cc6c00 2023-08-17T00:06:19.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.192+0000 7faf36ffd700 1 -- 172.21.15.153:0/1597193228 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c020be0 con 0x1cc6c00 2023-08-17T00:06:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 -- 172.21.15.153:0/1597193228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 msgr2=0x1c99570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 0x1c99570 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7faf3c00f9d0 tx=0x7faf3c020000).stop 2023-08-17T00:06:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 -- 172.21.15.153:0/1597193228 shutdown_connections 2023-08-17T00:06:19.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1c98340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cc6c00 0x1c99570 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 --2- 172.21.15.153:0/1597193228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c6f750 0x1c99080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 -- 172.21.15.153:0/1597193228 >> 172.21.15.153:0/1597193228 conn(0x1a52980 msgr2=0x1c719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 -- 172.21.15.153:0/1597193228 shutdown_connections 2023-08-17T00:06:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 -- 172.21.15.153:0/1597193228 wait complete. 2023-08-17T00:06:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 -- start start 2023-08-17T00:06:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.196+0000 7faf5dbee740 1 Processor -- start 2023-08-17T00:06:19.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 0x1d1c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1d1cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1cc6c00 0x1c95a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c9cf40 con 0x1c6f750 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d1d030 con 0x1cc6c00 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c70540 con 0x1c9e8e0 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 10 client.0 ll_register_callbacks cb 0x7faf3c00fa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:19.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 0x1d1c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 0x1d1c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32856/0 (socket says 172.21.15.153:32856) 2023-08-17T00:06:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 -- 172.21.15.153:0/2302511909 learned_addr learned my addr 172.21.15.153:0/2302511909 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf50df6700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1d1cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf51df8700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1cc6c00 0x1c95a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 -- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 msgr2=0x1d1cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1d1cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 -- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1cc6c00 msgr2=0x1c95a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1cc6c00 0x1c95a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 -- 172.21.15.153:0/2302511909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1bff9d0 con 0x1c6f750 2023-08-17T00:06:19.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf51df8700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1cc6c00 0x1c95a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:19.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf515f7700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 0x1d1c610 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7faf48006c40 tx=0x7faf48075040).ready entity=mon.0 client_cookie=68397dd38c04537 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:19.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2302511909 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf48052040 con 0x1c6f750 2023-08-17T00:06:19.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2302511909 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faf4802ec90 con 0x1c6f750 2023-08-17T00:06:19.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf4804c2a0 con 0x1c6f750 2023-08-17T00:06:19.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2302511909 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf4802ee50 con 0x1c6f750 2023-08-17T00:06:19.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 10 client.5748 fetch_fsmap learned FSMap version 39 2023-08-17T00:06:19.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x1bed140 con 0x1c6f750 2023-08-17T00:06:19.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2302511909 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4804c2a0 con 0x1c6f750 2023-08-17T00:06:19.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2302511909 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faf4804cb70 con 0x1c6f750 2023-08-17T00:06:19.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 10 client.5748 fetch_fsmap finished waiting for FSMap version 39 2023-08-17T00:06:19.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 10 client.5748 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:19.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 20 client.5748 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:19.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c6afe0 0x1c95f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 4 client.5748 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2023-08-17T00:06:19.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.200+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) v1 -- 0x1be0370 con 0x1c6afe0 2023-08-17T00:06:19.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf50df6700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c6afe0 0x1c95f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf50df6700 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c6afe0 0x1c95f70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1b17298eaef68dc7 server_cookie=637c3b91d4665ad9 in_seq=0 out_seq=0 2023-08-17T00:06:19.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf2b7fe700 10 client.5748 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf2b7fe700 1 -- 172.21.15.153:0/2302511909 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1be0370 con 0x1c6afe0 2023-08-17T00:06:19.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf2b7fe700 10 client.5748 handle_command_reply: tid=0 2023-08-17T00:06:19.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 client.5748 shutdown 2023-08-17T00:06:19.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 msgr2=0x1d1c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.220 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:06:19.204+0000 7fea9398a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096b [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v663 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5057=0-4194304@1} caps={5057=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5057 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55e18d1d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1000000096b:[<0x10000000001/new_file_0 v663>,<0x10000000000/ceph-qa-suite v57>,<0x1/scrub_test_path v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-08-17T00:06:19.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 0x1d1c610 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7faf48006c40 tx=0x7faf48075040).stop 2023-08-17T00:06:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 shutdown_connections 2023-08-17T00:06:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c6afe0 0x1c95f70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1cc6c00 0x1c95a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c9e8e0 0x1d1cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf2b7fe700 0 client.5748 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 --2- 172.21.15.153:0/2302511909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c6f750 0x1d1c610 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 >> 172.21.15.153:0/2302511909 conn(0x1a52980 msgr2=0x1cc5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 shutdown_connections 2023-08-17T00:06:19.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 1 -- 172.21.15.153:0/2302511909 wait complete. 2023-08-17T00:06:19.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf5dbee740 20 client.5748 trim_cache size 0 max 16384 2023-08-17T00:06:19.224 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:19.224 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "71a73e88-8364-4f8e-86db-68215b86408f", 2023-08-17T00:06:19.225 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:19.225 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faf3005a150 msgr2=0x7faf3005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf525f9700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faf3005a150 0x7faf3005c610 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7faf3c006fd0 tx=0x7faf3c008040).stop 2023-08-17T00:06:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 msgr2=0x7faf4c0bef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.204+0000 7faf525f9700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 0x7faf4c0bef00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7faf48006570 tx=0x7faf48016000).stop 2023-08-17T00:06:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 shutdown_connections 2023-08-17T00:06:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faf3005a150 0x7faf3005c610 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf4c0a8df0 0x7faf4c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf4c068820 0x7faf4c0be580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 --2- 172.21.15.153:0/3207913401 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf4c061fa0 0x7faf4c0bef00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 >> 172.21.15.153:0/3207913401 conn(0x7faf4c0c6620 msgr2=0x7faf4c0c0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 shutdown_connections 2023-08-17T00:06:19.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.208+0000 7faf525f9700 1 -- 172.21.15.153:0/3207913401 wait complete. 2023-08-17T00:06:19.231 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '71a73e88-8364-4f8e-86db-68215b86408f', 'mode': 'asynchronous'}' 2023-08-17T00:06:19.232 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-08-17T00:06:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.388+0000 7f807e307700 1 Processor -- start 2023-08-17T00:06:19.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.388+0000 7f807e307700 1 -- start start 2023-08-17T00:06:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807e307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807e307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8078151530 0x7f80781519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807e307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8078065da0 con 0x7f80781560f0 2023-08-17T00:06:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807e307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8078155c60 con 0x7f8078151530 2023-08-17T00:06:19.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807e307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8078156550 con 0x7f80780689c0 2023-08-17T00:06:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807cb04700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f80781560f0 0x7f80780c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53864/0 (socket says 172.21.15.153:53864) 2023-08-17T00:06:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807cb04700 1 -- 172.21.15.153:0/2793141908 learned_addr learned my addr 172.21.15.153:0/2793141908 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807db06700 1 --2- 172.21.15.153:0/2793141908 >> v2:172.21.15.153:3300/0 conn(0x7f8078151530 0x7f80781519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807d305700 1 --2- 172.21.15.153:0/2793141908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f806ffff700 1 -- 172.21.15.153:0/2793141908 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753998592 0 0) 0x7f8078065da0 con 0x7f80781560f0 2023-08-17T00:06:19.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f806ffff700 1 -- 172.21.15.153:0/2793141908 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80640033f0 con 0x7f80781560f0 2023-08-17T00:06:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f806ffff700 1 -- 172.21.15.153:0/2793141908 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 158219196 0 0) 0x7f80640033f0 con 0x7f80781560f0 2023-08-17T00:06:19.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807db06700 1 -- 172.21.15.153:0/2793141908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 msgr2=0x7f8078068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807db06700 1 --2- 172.21.15.153:0/2793141908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807db06700 1 -- 172.21.15.153:0/2793141908 >> v1:172.21.15.153:6789/0 conn(0x7f80781560f0 legacy=0x7f80780c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807db06700 1 -- 172.21.15.153:0/2793141908 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078065ff0 con 0x7f8078151530 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f807db06700 1 --2- 172.21.15.153:0/2793141908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f80781519e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f8070009e90 tx=0x7f8070009780).ready entity=mon.0 client_cookie=b5a01e5befd4a216 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f806ffff700 1 -- 172.21.15.153:0/2793141908 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f807000e070 con 0x7f8078151530 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f806ffff700 1 -- 172.21.15.153:0/2793141908 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f807000b7a0 con 0x7f8078151530 2023-08-17T00:06:19.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.392+0000 7f806ffff700 1 -- 172.21.15.153:0/2793141908 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068001470 con 0x7f8078151530 2023-08-17T00:06:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 -- 172.21.15.153:0/2793141908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 msgr2=0x7f80781519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 --2- 172.21.15.153:0/2793141908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f80781519e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f8070009e90 tx=0x7f8070009780).stop 2023-08-17T00:06:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 -- 172.21.15.153:0/2793141908 shutdown_connections 2023-08-17T00:06:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 --2- 172.21.15.153:0/2793141908 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f80781519e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 --2- 172.21.15.153:0/2793141908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 -- 172.21.15.153:0/2793141908 >> 172.21.15.153:0/2793141908 conn(0x7f80780c6620 msgr2=0x7f80780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 -- 172.21.15.153:0/2793141908 shutdown_connections 2023-08-17T00:06:19.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 -- 172.21.15.153:0/2793141908 wait complete. 2023-08-17T00:06:19.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.396+0000 7f807e307700 1 Processor -- start 2023-08-17T00:06:19.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 -- start start 2023-08-17T00:06:19.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f8078167580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80781560f0 0x7f80780645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8078165080 con 0x7f8078151530 2023-08-17T00:06:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80781655f0 con 0x7f80781560f0 2023-08-17T00:06:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807e307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80781481f0 con 0x7f80780689c0 2023-08-17T00:06:19.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f8078167580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f8078167580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32882/0 (socket says 172.21.15.153:32882) 2023-08-17T00:06:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 -- 172.21.15.153:0/3811217903 learned_addr learned my addr 172.21.15.153:0/3811217903 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807db06700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80781560f0 0x7f80780645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807d305700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 -- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 msgr2=0x7f8078147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 -- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80781560f0 msgr2=0x7f80780645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80781560f0 0x7f80780645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 -- 172.21.15.153:0/3811217903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8070009a20 con 0x7f8078151530 2023-08-17T00:06:19.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f807cb04700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f8078167580 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f806800c810 tx=0x7f8068001aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.400+0000 7f806d7fa700 1 -- 172.21.15.153:0/3811217903 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068007320 con 0x7f8078151530 2023-08-17T00:06:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.404+0000 7f806d7fa700 1 -- 172.21.15.153:0/3811217903 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80680074a0 con 0x7f8078151530 2023-08-17T00:06:19.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.404+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8078167ef0 con 0x7f8078151530 2023-08-17T00:06:19.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.404+0000 7f806d7fa700 1 -- 172.21.15.153:0/3811217903 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80680059f0 con 0x7f8078151530 2023-08-17T00:06:19.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.404+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8078165280 con 0x7f8078151530 2023-08-17T00:06:19.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.404+0000 7f806d7fa700 1 -- 172.21.15.153:0/3811217903 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8068010030 con 0x7f8078151530 2023-08-17T00:06:19.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.408+0000 7f806d7fa700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f805c05a150 0x7f805c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.408+0000 7f806d7fa700 1 -- 172.21.15.153:0/3811217903 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8068073fc0 con 0x7f8078151530 2023-08-17T00:06:19.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.408+0000 7f807d305700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f805c05a150 0x7f805c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.408+0000 7f807d305700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f805c05a150 0x7f805c05c610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f80780a8b50 tx=0x7f8074006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.408+0000 7f80898fa740 1 Processor -- start 2023-08-17T00:06:19.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.408+0000 7f80898fa740 1 -- start start 2023-08-17T00:06:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b77f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac71a0 con 0x2bbc9f0 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bbd9b0 con 0x2b7b330 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ba1960 con 0x2bbcdd0 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32898/0 (socket says 172.21.15.153:32898) 2023-08-17T00:06:19.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 -- 172.21.15.153:0/3385069561 learned_addr learned my addr 172.21.15.153:0/3385069561 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807cb04700 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807db06700 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b77f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 -- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 msgr2=0x2b77f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b77f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 -- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 msgr2=0x2b765b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b765b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 -- 172.21.15.153:0/3385069561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2af5010 con 0x2bbc9f0 2023-08-17T00:06:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f807d305700 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba1050 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f8074005d80 tx=0x7f8074016000).ready entity=mon.0 client_cookie=93058a29d54fd07e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80627fc700 1 -- 172.21.15.153:0/3385069561 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8074005e80 con 0x2bbc9f0 2023-08-17T00:06:19.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80627fc700 1 -- 172.21.15.153:0/3385069561 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074006240 con 0x2bbc9f0 2023-08-17T00:06:19.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80627fc700 1 -- 172.21.15.153:0/3385069561 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80740065c0 con 0x2bbc9f0 2023-08-17T00:06:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 -- 172.21.15.153:0/3385069561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 msgr2=0x2ba1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.412+0000 7f80898fa740 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba1050 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f8074005d80 tx=0x7f8074016000).stop 2023-08-17T00:06:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- 172.21.15.153:0/3385069561 shutdown_connections 2023-08-17T00:06:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b77f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b765b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 --2- 172.21.15.153:0/3385069561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba1050 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- 172.21.15.153:0/3385069561 >> 172.21.15.153:0/3385069561 conn(0x295a680 msgr2=0x2bc1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- 172.21.15.153:0/3385069561 shutdown_connections 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- 172.21.15.153:0/3385069561 wait complete. 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- start start 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 Processor -- start 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b79ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2ba3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ba3b40 con 0x2bbc9f0 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ba6bc0 con 0x2b7b330 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b7a580 con 0x2bbcdd0 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f80898fa740 10 client.0 ll_register_callbacks cb 0x2b32400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32902/0 (socket says 172.21.15.153:32902) 2023-08-17T00:06:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807cb04700 1 -- 172.21.15.153:0/4002249671 learned_addr learned my addr 172.21.15.153:0/4002249671 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807d305700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b79ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807db06700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2ba3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807cb04700 1 -- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 msgr2=0x2ba3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.416+0000 7f807cb04700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2ba3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807cb04700 1 -- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 msgr2=0x2b79ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807cb04700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b79ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807cb04700 1 -- 172.21.15.153:0/4002249671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8074005a70 con 0x2bbc9f0 2023-08-17T00:06:19.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807d305700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b79ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807cb04700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba3160 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f806804b320 tx=0x7f806800f000).ready entity=mon.0 client_cookie=457ed6befe8f1e18 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 1 -- 172.21.15.153:0/4002249671 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806804b5c0 con 0x2bbc9f0 2023-08-17T00:06:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 1 -- 172.21.15.153:0/4002249671 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8068047d30 con 0x2bbc9f0 2023-08-17T00:06:19.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2ac3200 con 0x2bbc9f0 2023-08-17T00:06:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 1 -- 172.21.15.153:0/4002249671 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8068047ef0 con 0x2bbc9f0 2023-08-17T00:06:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 10 client.5763 fetch_fsmap learned FSMap version 39 2023-08-17T00:06:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x2af04b0 con 0x2bbc9f0 2023-08-17T00:06:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 1 -- 172.21.15.153:0/4002249671 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2ac3200 con 0x2bbc9f0 2023-08-17T00:06:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 1 -- 172.21.15.153:0/4002249671 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8068047410 con 0x2bbc9f0 2023-08-17T00:06:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 10 client.5763 fetch_fsmap finished waiting for FSMap version 39 2023-08-17T00:06:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 10 client.5763 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 20 client.5763 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2b92230 0x2ba5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 4 client.5763 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:19.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2af1cf0 con 0x2b92230 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807d305700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2b92230 0x2ba5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f807d305700 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2b92230 0x2ba5ef0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5e2652a5d3603d28 server_cookie=ee4ddf113babf47d in_seq=0 out_seq=0 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 10 client.5763 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 1 -- 172.21.15.153:0/4002249671 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2af1cf0 con 0x2b92230 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80577fe700 10 client.5763 handle_command_reply: tid=0 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.420+0000 7f80898fa740 1 client.5763 shutdown 2023-08-17T00:06:19.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 msgr2=0x2ba3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba3160 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f806804b320 tx=0x7f806800f000).stop 2023-08-17T00:06:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 shutdown_connections 2023-08-17T00:06:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2b92230 0x2ba5ef0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2ba3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2ba3160 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80577fe700 0 client.5763 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 --2- 172.21.15.153:0/4002249671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b79ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 >> 172.21.15.153:0/4002249671 conn(0x295a680 msgr2=0x2b75bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 shutdown_connections 2023-08-17T00:06:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 1 -- 172.21.15.153:0/4002249671 wait complete. 2023-08-17T00:06:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.424+0000 7f80898fa740 20 client.5763 trim_cache size 0 max 16384 2023-08-17T00:06:19.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.440+0000 7f80898fa740 1 Processor -- start 2023-08-17T00:06:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.440+0000 7f80898fa740 1 -- start start 2023-08-17T00:06:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b9e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2b7aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b9ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b3e240 con 0x2bbc9f0 2023-08-17T00:06:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bbe0f0 con 0x2b7b330 2023-08-17T00:06:19.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2bc19f0 con 0x2bbcdd0 2023-08-17T00:06:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2b7aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2b7aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32910/0 (socket says 172.21.15.153:32910) 2023-08-17T00:06:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807db06700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b9ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807d305700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b9e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 -- 172.21.15.153:0/2300460897 learned_addr learned my addr 172.21.15.153:0/2300460897 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 -- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 msgr2=0x2b9ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b9ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 -- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 msgr2=0x2b9e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b9e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 -- 172.21.15.153:0/2300460897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078064df0 con 0x2bbc9f0 2023-08-17T00:06:19.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807d305700 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:19.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f807cb04700 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2b7aa70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f80680725a0 tx=0x7f8068058000).ready entity=mon.0 client_cookie=6e1a948a6db388b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f8062ffd700 1 -- 172.21.15.153:0/2300460897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806804b5c0 con 0x2bbc9f0 2023-08-17T00:06:19.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f8062ffd700 1 -- 172.21.15.153:0/2300460897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8068007110 con 0x2bbc9f0 2023-08-17T00:06:19.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f8062ffd700 1 -- 172.21.15.153:0/2300460897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8068047410 con 0x2bbc9f0 2023-08-17T00:06:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- 172.21.15.153:0/2300460897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 msgr2=0x2b7aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2b7aa70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f80680725a0 tx=0x7f8068058000).stop 2023-08-17T00:06:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- 172.21.15.153:0/2300460897 shutdown_connections 2023-08-17T00:06:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2b9ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2bbc9f0 0x2b7aa70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 --2- 172.21.15.153:0/2300460897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2b9e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- 172.21.15.153:0/2300460897 >> 172.21.15.153:0/2300460897 conn(0x295a680 msgr2=0x2bd0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.444+0000 7f80898fa740 1 -- 172.21.15.153:0/2300460897 shutdown_connections 2023-08-17T00:06:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 -- 172.21.15.153:0/2300460897 wait complete. 2023-08-17T00:06:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 -- start start 2023-08-17T00:06:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 Processor -- start 2023-08-17T00:06:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2bbb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2bba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 0x2bcf7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bbaf50 con 0x2ba3040 2023-08-17T00:06:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2bd6e00 con 0x2b7b330 2023-08-17T00:06:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2bd7040 con 0x2bbcdd0 2023-08-17T00:06:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f80898fa740 10 client.0 ll_register_callbacks cb 0x7f8068050f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:19.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 0x2bcf7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 0x2bcf7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32918/0 (socket says 172.21.15.153:32918) 2023-08-17T00:06:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 -- 172.21.15.153:0/4167579246 learned_addr learned my addr 172.21.15.153:0/4167579246 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807d305700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2bbb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807cb04700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2bba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 -- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 msgr2=0x2bba540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2bba540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 -- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 msgr2=0x2bbb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2bbb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.448+0000 7f807db06700 1 -- 172.21.15.153:0/4167579246 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2af5010 con 0x2ba3040 2023-08-17T00:06:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f807cb04700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2bba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:19.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f807db06700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 0x2bcf7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f8070011000 tx=0x7f8070009780).ready entity=mon.0 client_cookie=b4f87fe9f94c7e76 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:19.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:19.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 1 -- 172.21.15.153:0/4167579246 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070026070 con 0x2ba3040 2023-08-17T00:06:19.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8074006240 con 0x2ba3040 2023-08-17T00:06:19.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 1 -- 172.21.15.153:0/4167579246 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f80700217b0 con 0x2ba3040 2023-08-17T00:06:19.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 1 -- 172.21.15.153:0/4167579246 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8070021b80 con 0x2ba3040 2023-08-17T00:06:19.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 10 client.5769 fetch_fsmap learned FSMap version 39 2023-08-17T00:06:19.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x2af04b0 con 0x2ba3040 2023-08-17T00:06:19.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 1 -- 172.21.15.153:0/4167579246 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8074006240 con 0x2ba3040 2023-08-17T00:06:19.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 1 -- 172.21.15.153:0/4167579246 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8070021ce0 con 0x2ba3040 2023-08-17T00:06:19.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 10 client.5769 fetch_fsmap finished waiting for FSMap version 39 2023-08-17T00:06:19.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 10 client.5769 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:19.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 20 client.5769 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:19.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2bcfc90 0x2b74930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:19.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 4 client.5769 mds_command: new command op to 5427 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:06:19.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2ae8240 con 0x2bcfc90 2023-08-17T00:06:19.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f807d305700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2bcfc90 0x2b74930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:19.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f807d305700 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2bcfc90 0x2b74930 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4e601e35573f72f5 server_cookie=2f0b1484c4b4b100 in_seq=0 out_seq=0 2023-08-17T00:06:19.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 10 client.5769 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 1 -- 172.21.15.153:0/4167579246 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+696 (crc 0 0 0) 0x2ae8240 con 0x2bcfc90 2023-08-17T00:06:19.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 10 client.5769 handle_command_reply: tid=0 2023-08-17T00:06:19.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 client.5769 shutdown 2023-08-17T00:06:19.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 msgr2=0x2bcf7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 0x2bcf7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f8070011000 tx=0x7f8070009780).stop 2023-08-17T00:06:19.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 shutdown_connections 2023-08-17T00:06:19.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2bcfc90 0x2b74930 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ba3040 0x2bcf7a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2bbcdd0 0x2bba540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 --2- 172.21.15.153:0/4167579246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b7b330 0x2bbb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80577fe700 0 client.5769 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:19.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.452+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 >> 172.21.15.153:0/4167579246 conn(0x295a680 msgr2=0x2b9ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 shutdown_connections 2023-08-17T00:06:19.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f80898fa740 1 -- 172.21.15.153:0/4167579246 wait complete. 2023-08-17T00:06:19.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f80898fa740 20 client.5769 trim_cache size 0 max 16384 2023-08-17T00:06:19.475 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:19.476 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:06:19.476 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:06:19.476 INFO:teuthology.orchestra.run.smithi153.stdout: "344a108b-d84b-4ced-bbd4-8b17e41e06f9": { 2023-08-17T00:06:19.477 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml", 2023-08-17T00:06:19.477 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "344a108b-d84b-4ced-bbd4-8b17e41e06f9", 2023-08-17T00:06:19.477 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "" 2023-08-17T00:06:19.477 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:19.478 INFO:teuthology.orchestra.run.smithi153.stdout: "71a73e88-8364-4f8e-86db-68215b86408f": { 2023-08-17T00:06:19.478 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2023-08-17T00:06:19.478 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "71a73e88-8364-4f8e-86db-68215b86408f", 2023-08-17T00:06:19.478 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "" 2023-08-17T00:06:19.478 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:19.479 INFO:teuthology.orchestra.run.smithi153.stdout: "f83e82a3-e0e4-4b91-994c-cd4cd280f728": { 2023-08-17T00:06:19.479 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2023-08-17T00:06:19.479 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "f83e82a3-e0e4-4b91-994c-cd4cd280f728", 2023-08-17T00:06:19.479 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "" 2023-08-17T00:06:19.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:19.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:19.480 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:19.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f805c05a150 msgr2=0x7f805c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f805c05a150 0x7f805c05c610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f80780a8b50 tx=0x7f8074006f40).stop 2023-08-17T00:06:19.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 msgr2=0x7f8078167580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:19.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f8078167580 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f806800c810 tx=0x7f8068001aa0).stop 2023-08-17T00:06:19.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 shutdown_connections 2023-08-17T00:06:19.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f805c05a150 0x7f805c05c610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80781560f0 0x7f80780645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8078151530 0x7f8078167580 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 --2- 172.21.15.153:0/3811217903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80780689c0 0x7f8078147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 >> 172.21.15.153:0/3811217903 conn(0x7f80780c6620 msgr2=0x7f80780c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 shutdown_connections 2023-08-17T00:06:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:19.456+0000 7f807e307700 1 -- 172.21.15.153:0/3811217903 wait complete. 2023-08-17T00:06:21.365 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:06:21.360+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-08-17T00:06:24.487 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-08-17T00:06:24.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.648+0000 7f9acb946700 1 Processor -- start 2023-08-17T00:06:24.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.648+0000 7f9acb946700 1 -- start start 2023-08-17T00:06:24.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9acb946700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9ac4153ab0 0x7f9ac4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9acb946700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ac40c59e0 0x7f9ac40641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9acb946700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40c0330 con 0x7f9ac40c07c0 2023-08-17T00:06:24.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9acb946700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40646e0 con 0x7f9ac40c59e0 2023-08-17T00:06:24.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9acb946700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac40c5e40 con 0x7f9ac4153ab0 2023-08-17T00:06:24.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9ac8ee1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ac40c59e0 0x7f9ac40641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9ac8ee1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ac40c59e0 0x7f9ac40641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32930/0 (socket says 172.21.15.153:32930) 2023-08-17T00:06:24.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/1672085111 learned_addr learned my addr 172.21.15.153:0/1672085111 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.652+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/1672085111 >> v2:172.21.15.178:3300/0 conn(0x7f9ac4153ab0 0x7f9ac4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/1672085111 >> v2:172.21.15.178:3300/0 conn(0x7f9ac4153ab0 msgr2=0x7f9ac4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/1672085111 >> v2:172.21.15.178:3300/0 conn(0x7f9ac4153ab0 0x7f9ac4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/1672085111 >> v1:172.21.15.178:6789/0 conn(0x7f9ac40c07c0 legacy=0x7f9ac4061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/1672085111 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40c60a0 con 0x7f9ac40c59e0 2023-08-17T00:06:24.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9abbfff700 1 -- 172.21.15.153:0/1672085111 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860659478 0 0) 0x7f9ac40c0330 con 0x7f9ac40c07c0 2023-08-17T00:06:24.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/1672085111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c59e0 0x7f9ac40641f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f9ac405eb60 tx=0x7f9ab40090f0).ready entity=mon.0 client_cookie=3c7df6db71bc6f4c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9abbfff700 1 -- 172.21.15.153:0/1672085111 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400b520 con 0x7f9ac40c59e0 2023-08-17T00:06:24.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9abbfff700 1 -- 172.21.15.153:0/1672085111 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab400b680 con 0x7f9ac40c59e0 2023-08-17T00:06:24.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9abbfff700 1 -- 172.21.15.153:0/1672085111 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400ba20 con 0x7f9ac40c59e0 2023-08-17T00:06:24.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 -- 172.21.15.153:0/1672085111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c59e0 msgr2=0x7f9ac40641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 --2- 172.21.15.153:0/1672085111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c59e0 0x7f9ac40641f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f9ac405eb60 tx=0x7f9ab40090f0).stop 2023-08-17T00:06:24.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 -- 172.21.15.153:0/1672085111 shutdown_connections 2023-08-17T00:06:24.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 --2- 172.21.15.153:0/1672085111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c59e0 0x7f9ac40641f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 --2- 172.21.15.153:0/1672085111 >> v2:172.21.15.178:3300/0 conn(0x7f9ac4153ab0 0x7f9ac4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 -- 172.21.15.153:0/1672085111 >> 172.21.15.153:0/1672085111 conn(0x7f9ac40caaa0 msgr2=0x7f9ac40caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 -- 172.21.15.153:0/1672085111 shutdown_connections 2023-08-17T00:06:24.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.656+0000 7f9acb946700 1 -- 172.21.15.153:0/1672085111 wait complete. 2023-08-17T00:06:24.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 Processor -- start 2023-08-17T00:06:24.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 -- start start 2023-08-17T00:06:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 0x7f9ac40ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac40c59e0 0x7f9ac4146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac4153ab0 0x7f9ac40af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40adf20 con 0x7f9ac40c07c0 2023-08-17T00:06:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40c38b0 con 0x7f9ac40c59e0 2023-08-17T00:06:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9acb946700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40aed20 con 0x7f9ac4153ab0 2023-08-17T00:06:24.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 0x7f9ac40ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 0x7f9ac40ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32944/0 (socket says 172.21.15.153:32944) 2023-08-17T00:06:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 -- 172.21.15.153:0/3651995799 learned_addr learned my addr 172.21.15.153:0/3651995799 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac4153ab0 0x7f9ac40af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac40c59e0 0x7f9ac4146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 -- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac4153ab0 msgr2=0x7f9ac40af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac4153ab0 0x7f9ac40af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 -- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac40c59e0 msgr2=0x7f9ac4146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac40c59e0 0x7f9ac4146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.660+0000 7f9ac96e2700 1 -- 172.21.15.153:0/3651995799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4009370 con 0x7f9ac40c07c0 2023-08-17T00:06:24.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.664+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 0x7f9ac40ada30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f9ac000e900 tx=0x7f9ac0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.664+0000 7f9ab97fa700 1 -- 172.21.15.153:0/3651995799 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000c640 con 0x7f9ac40c07c0 2023-08-17T00:06:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.664+0000 7f9ab97fa700 1 -- 172.21.15.153:0/3651995799 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac000c7a0 con 0x7f9ac40c07c0 2023-08-17T00:06:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.664+0000 7f9ab97fa700 1 -- 172.21.15.153:0/3651995799 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000cb20 con 0x7f9ac40c07c0 2023-08-17T00:06:24.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.664+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac4147160 con 0x7f9ac40c07c0 2023-08-17T00:06:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.664+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac40ae3f0 con 0x7f9ac40c07c0 2023-08-17T00:06:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ab97fa700 1 -- 172.21.15.153:0/3651995799 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9ac0022070 con 0x7f9ac40c07c0 2023-08-17T00:06:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ab97fa700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa805a150 0x7f9aa805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ab97fa700 1 -- 172.21.15.153:0/3651995799 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ac00743d0 con 0x7f9ac40c07c0 2023-08-17T00:06:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa805a150 0x7f9aa805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa805a150 0x7f9aa805c610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9ac414b5a0 tx=0x7f9ab4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ad5cc6740 1 Processor -- start 2023-08-17T00:06:24.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.668+0000 7f9ad5cc6740 1 -- start start 2023-08-17T00:06:24.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf39100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf43630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xe431a0 con 0xf1cce0 2023-08-17T00:06:24.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xef7300 con 0xf38d20 2023-08-17T00:06:24.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xef6730 con 0xf1c860 2023-08-17T00:06:24.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf43630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf43630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32948/0 (socket says 172.21.15.153:32948) 2023-08-17T00:06:24.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 -- 172.21.15.153:0/347376723 learned_addr learned my addr 172.21.15.153:0/347376723 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf39100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 -- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 msgr2=0xf43140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf43140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 -- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 msgr2=0xf39100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf39100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 -- 172.21.15.153:0/347376723 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe71010 con 0xf1cce0 2023-08-17T00:06:24.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf39100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:24.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf43630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f9abc003c50 tx=0x7f9abc009040).ready entity=mon.0 client_cookie=b2dd0cec51858686 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9aae7fc700 1 -- 172.21.15.153:0/347376723 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0030d0 con 0xf1cce0 2023-08-17T00:06:24.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9aae7fc700 1 -- 172.21.15.153:0/347376723 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc003230 con 0xf1cce0 2023-08-17T00:06:24.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9aae7fc700 1 -- 172.21.15.153:0/347376723 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc00e860 con 0xf1cce0 2023-08-17T00:06:24.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.672+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/347376723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 msgr2=0xf43630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf43630 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f9abc003c50 tx=0x7f9abc009040).stop 2023-08-17T00:06:24.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/347376723 shutdown_connections 2023-08-17T00:06:24.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf43630 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf43140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/347376723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf39100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/347376723 >> 172.21.15.153:0/347376723 conn(0xcd6680 msgr2=0xef77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/347376723 shutdown_connections 2023-08-17T00:06:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/347376723 wait complete. 2023-08-17T00:06:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- start start 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 Processor -- start 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1c860 0xf18180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf1ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf38d20 0xf1f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf49920 con 0xf1cce0 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf1f7c0 con 0xf1c860 2023-08-17T00:06:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf1e600 con 0xf38d20 2023-08-17T00:06:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ad5cc6740 10 client.0 ll_register_callbacks cb 0xeae400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ac8ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf1ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ac8ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf1ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32952/0 (socket says 172.21.15.153:32952) 2023-08-17T00:06:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/417168382 learned_addr learned my addr 172.21.15.153:0/417168382 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf38d20 0xf1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.676+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1c860 0xf18180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf38d20 msgr2=0xf1f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf38d20 0xf1f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1c860 msgr2=0xf18180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1c860 0xf18180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/417168382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc00f040 con 0xf1cce0 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf1ec50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f9ab4006de0 tx=0x7f9ab401f070).ready entity=mon.0 client_cookie=c1f80f31817e1043 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:24.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 1 -- 172.21.15.153:0/417168382 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4027610 con 0xf1cce0 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 1 -- 172.21.15.153:0/417168382 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ab4027770 con 0xf1cce0 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe3f200 con 0xf1cce0 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 1 -- 172.21.15.153:0/417168382 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab4027980 con 0xf1cce0 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 10 client.5781 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0xe6c4b0 con 0xf1cce0 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 1 -- 172.21.15.153:0/417168382 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe3f200 con 0xf1cce0 2023-08-17T00:06:24.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 1 -- 172.21.15.153:0/417168382 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9ab4027ae0 con 0xf1cce0 2023-08-17T00:06:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 10 client.5781 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 10 client.5781 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 20 client.5781 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf353a0 0xf357b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 4 client.5781 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe6dcf0 con 0xf353a0 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf353a0 0xf357b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf353a0 0xf357b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=62e94509f5c3c098 server_cookie=a1843e53dc217180 in_seq=0 out_seq=0 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 10 client.5781 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 1 -- 172.21.15.153:0/417168382 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xe6dcf0 con 0xf353a0 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.680+0000 7f9aa37fe700 10 client.5781 handle_command_reply: tid=0 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 client.5781 shutdown 2023-08-17T00:06:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 msgr2=0xf1ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf1ec50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f9ab4006de0 tx=0x7f9ab401f070).stop 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 shutdown_connections 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf353a0 0xf357b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf38d20 0xf1f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf1ec50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9aa37fe700 0 client.5781 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/417168382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1c860 0xf18180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 >> 172.21.15.153:0/417168382 conn(0xcd6680 msgr2=0xf1c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 shutdown_connections 2023-08-17T00:06:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/417168382 wait complete. 2023-08-17T00:06:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.684+0000 7f9ad5cc6740 20 client.5781 trim_cache size 0 max 16384 2023-08-17T00:06:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 Processor -- start 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 -- start start 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xef1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf37c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf17fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xef3200 con 0xf1cce0 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xebd540 con 0xf38d20 2023-08-17T00:06:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xef2340 con 0xf1c860 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf37c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf37c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32954/0 (socket says 172.21.15.153:32954) 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2532914146 learned_addr learned my addr 172.21.15.153:0/2532914146 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xef1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf17fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 msgr2=0xef1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xef1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 msgr2=0xf17fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf17fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2532914146 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40aea90 con 0xf1cce0 2023-08-17T00:06:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.704+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf37c90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f9ab4000c40 tx=0x7f9ab4029070).ready entity=mon.0 client_cookie=827ff20e31db7373 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9aaeffd700 1 -- 172.21.15.153:0/2532914146 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab401dd70 con 0xf1cce0 2023-08-17T00:06:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9aaeffd700 1 -- 172.21.15.153:0/2532914146 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab400beb0 con 0xf1cce0 2023-08-17T00:06:24.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9aaeffd700 1 -- 172.21.15.153:0/2532914146 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4027610 con 0xf1cce0 2023-08-17T00:06:24.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2532914146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 msgr2=0xf37c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf37c90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f9ab4000c40 tx=0x7f9ab4029070).stop 2023-08-17T00:06:24.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2532914146 shutdown_connections 2023-08-17T00:06:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf17fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf37c90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2532914146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xef1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2532914146 >> 172.21.15.153:0/2532914146 conn(0xcd6680 msgr2=0xef5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2532914146 shutdown_connections 2023-08-17T00:06:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2532914146 wait complete. 2023-08-17T00:06:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 -- start start 2023-08-17T00:06:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.708+0000 7f9ad5cc6740 1 Processor -- start 2023-08-17T00:06:24.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf17380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf9f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf9f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf3d880 con 0xf1cce0 2023-08-17T00:06:24.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf36fe0 con 0xf38d20 2023-08-17T00:06:24.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf1b0a0 con 0xf1c860 2023-08-17T00:06:24.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 10 client.0 ll_register_callbacks cb 0x7f9ab4000c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:24.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf9f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf9f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32958/0 (socket says 172.21.15.153:32958) 2023-08-17T00:06:24.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2247572707 learned_addr learned my addr 172.21.15.153:0/2247572707 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac9ee3700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf9f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf17380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 msgr2=0xf17380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf17380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 msgr2=0xf9f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf9f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 -- 172.21.15.153:0/2247572707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe6c4b0 con 0xf1cce0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf17380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ac8ee1700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf9f4d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f9ab400b2e0 tx=0x7f9ab4038000).ready entity=mon.0 client_cookie=aff4409bd9ad42c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9aa37fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9aa37fe700 1 -- 172.21.15.153:0/2247572707 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4048440 con 0xf1cce0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9abc003230 con 0xf1cce0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9aa37fe700 1 -- 172.21.15.153:0/2247572707 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ab4049e00 con 0xf1cce0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9aa37fe700 1 -- 172.21.15.153:0/2247572707 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab4037630 con 0xf1cce0 2023-08-17T00:06:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 10 client.5787 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0xe6c200 con 0xf1cce0 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9aa37fe700 1 -- 172.21.15.153:0/2247572707 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc003230 con 0xf1cce0 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9aa37fe700 1 -- 172.21.15.153:0/2247572707 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9ab4037790 con 0xf1cce0 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 10 client.5787 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 10 client.5787 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 20 client.5787 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:24.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf16a90 0xf52ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 4 client.5787 mds_command: new command op to 5427 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.712+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xe64240 con 0xf16a90 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf16a90 0xf52ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ac96e2700 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf16a90 0xf52ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=11342a59aac05dab server_cookie=dd931613d0d4118d in_seq=0 out_seq=0 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9aa37fe700 10 client.5787 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9aa37fe700 1 -- 172.21.15.153:0/2247572707 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xe64240 con 0xf16a90 2023-08-17T00:06:24.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9aa37fe700 10 client.5787 handle_command_reply: tid=0 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 client.5787 shutdown 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 msgr2=0xf9f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf9f4d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f9ab400b2e0 tx=0x7f9ab4038000).stop 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 shutdown_connections 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0xf16a90 0xf52ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf38d20 0xf9f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1cce0 0xf9f4d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 --2- 172.21.15.153:0/2247572707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1c860 0xf17380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9aa37fe700 0 client.5787 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 >> 172.21.15.153:0/2247572707 conn(0xcd6680 msgr2=0xef68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 shutdown_connections 2023-08-17T00:06:24.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 1 -- 172.21.15.153:0/2247572707 wait complete. 2023-08-17T00:06:24.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9ad5cc6740 20 client.5787 trim_cache size 0 max 16384 2023-08-17T00:06:24.732 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:06:24.732 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:06:24.732 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:24.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa805a150 msgr2=0x7f9aa805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa805a150 0x7f9aa805c610 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f9ac414b5a0 tx=0x7f9ab4017000).stop 2023-08-17T00:06:24.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 msgr2=0x7f9ac40ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 0x7f9ac40ada30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f9ac000e900 tx=0x7f9ac0009060).stop 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 shutdown_connections 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa805a150 0x7f9aa805c610 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac4153ab0 0x7f9ac40af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac40c59e0 0x7f9ac4146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 --2- 172.21.15.153:0/3651995799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac40c07c0 0x7f9ac40ada30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 >> 172.21.15.153:0/3651995799 conn(0x7f9ac40caaa0 msgr2=0x7f9ac414ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.716+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 shutdown_connections 2023-08-17T00:06:24.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.720+0000 7f9acb946700 1 -- 172.21.15.153:0/3651995799 wait complete. 2023-08-17T00:06:24.744 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:06:24.744 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-08-17T00:06:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.900+0000 7f8abe5f9700 1 Processor -- start 2023-08-17T00:06:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.900+0000 7f8abe5f9700 1 -- start start 2023-08-17T00:06:24.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abe5f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 0x7f8ab80634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abe5f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ab80639a0 0x7f8ab80bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abe5f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab8154e90 con 0x7f8ab80acf30 2023-08-17T00:06:24.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abe5f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80c1730 con 0x7f8ab80639a0 2023-08-17T00:06:24.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abe5f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab8063e10 con 0x7f8ab80c5ea0 2023-08-17T00:06:24.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abddf8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ab80639a0 0x7f8ab80bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 0x7f8ab80634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 0x7f8ab80634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:43362/0 (socket says 172.21.15.153:43362) 2023-08-17T00:06:24.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 -- 172.21.15.153:0/3541823246 learned_addr learned my addr 172.21.15.153:0/3541823246 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abd5f7700 1 --1- 172.21.15.153:0/3541823246 >> v1:172.21.15.178:6789/0 conn(0x7f8ab80acf30 0x7f8ab80c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:40062/0 (socket says 172.21.15.153:40062) 2023-08-17T00:06:24.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 -- 172.21.15.153:0/3541823246 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80639a0 msgr2=0x7f8ab80bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/3541823246 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80639a0 0x7f8ab80bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 -- 172.21.15.153:0/3541823246 >> v1:172.21.15.178:6789/0 conn(0x7f8ab80acf30 legacy=0x7f8ab80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 -- 172.21.15.153:0/3541823246 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8153fc0 con 0x7f8ab80c5ea0 2023-08-17T00:06:24.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/3541823246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 0x7f8ab80634b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8aa8006fd0 tx=0x7f8aa80090f0).ready entity=mon.2 client_cookie=8ad29a7ae5eff27f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8aaffff700 1 -- 172.21.15.153:0/3541823246 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800b580 con 0x7f8ab80c5ea0 2023-08-17T00:06:24.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8aaffff700 1 -- 172.21.15.153:0/3541823246 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800b6e0 con 0x7f8ab80c5ea0 2023-08-17T00:06:24.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.904+0000 7f8aaffff700 1 -- 172.21.15.153:0/3541823246 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800ba80 con 0x7f8ab80c5ea0 2023-08-17T00:06:24.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 -- 172.21.15.153:0/3541823246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 msgr2=0x7f8ab80634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/3541823246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 0x7f8ab80634b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f8aa8006fd0 tx=0x7f8aa80090f0).stop 2023-08-17T00:06:24.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 -- 172.21.15.153:0/3541823246 shutdown_connections 2023-08-17T00:06:24.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/3541823246 >> v2:172.21.15.153:3300/0 conn(0x7f8ab80639a0 0x7f8ab80bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/3541823246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80c5ea0 0x7f8ab80634b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 -- 172.21.15.153:0/3541823246 >> 172.21.15.153:0/3541823246 conn(0x7f8ab80cb330 msgr2=0x7f8ab80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 -- 172.21.15.153:0/3541823246 shutdown_connections 2023-08-17T00:06:24.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 -- 172.21.15.153:0/3541823246 wait complete. 2023-08-17T00:06:24.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 Processor -- start 2023-08-17T00:06:24.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.908+0000 7f8abe5f9700 1 -- start start 2023-08-17T00:06:24.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80639a0 0x7f8ab80c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ab80acf30 0x7f8ab80af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 0x7f8ab80c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c20e0 con 0x7f8ab80afc60 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b07c0 con 0x7f8ab80acf30 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80c1a60 con 0x7f8ab80639a0 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 0x7f8ab80c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 0x7f8ab80c2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32978/0 (socket says 172.21.15.153:32978) 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 -- 172.21.15.153:0/1995585999 learned_addr learned my addr 172.21.15.153:0/1995585999 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80639a0 0x7f8ab80c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ab80acf30 0x7f8ab80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 -- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80639a0 msgr2=0x7f8ab80c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80639a0 0x7f8ab80c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 -- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ab80acf30 msgr2=0x7f8ab80af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ab80acf30 0x7f8ab80af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 -- 172.21.15.153:0/1995585999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009370 con 0x7f8ab80afc60 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 0x7f8ab80c2500 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f8ab0009e90 tx=0x7f8ab000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8aad7fa700 1 -- 172.21.15.153:0/1995585999 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000caa0 con 0x7f8ab80afc60 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8aad7fa700 1 -- 172.21.15.153:0/1995585999 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab000f040 con 0x7f8ab80afc60 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab80b04e0 con 0x7f8ab80afc60 2023-08-17T00:06:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8aad7fa700 1 -- 172.21.15.153:0/1995585999 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab000ce10 con 0x7f8ab80afc60 2023-08-17T00:06:24.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.912+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80c45f0 con 0x7f8ab80afc60 2023-08-17T00:06:24.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.916+0000 7f8aad7fa700 1 -- 172.21.15.153:0/1995585999 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8ab0013610 con 0x7f8ab80afc60 2023-08-17T00:06:24.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.916+0000 7f8aad7fa700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a9c05a150 0x7f8a9c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.916+0000 7f8aad7fa700 1 -- 172.21.15.153:0/1995585999 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ab0074bd0 con 0x7f8ab80afc60 2023-08-17T00:06:24.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a9c05a150 0x7f8a9c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 Processor -- start 2023-08-17T00:06:24.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a9c05a150 0x7f8a9c05c610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f8ab80ac920 tx=0x7f8ab4007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 -- start start 2023-08-17T00:06:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20df8c0 0x2105a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20e0270 0x20dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x20dca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x202c1a0 con 0x20dae90 2023-08-17T00:06:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20daa00 con 0x20e0270 2023-08-17T00:06:24.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20da3f0 con 0x20df8c0 2023-08-17T00:06:24.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x20dca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x20dca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:32990/0 (socket says 172.21.15.153:32990) 2023-08-17T00:06:24.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abddf8700 1 -- 172.21.15.153:0/1536365435 learned_addr learned my addr 172.21.15.153:0/1536365435 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20df8c0 0x2105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.920+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20e0270 0x20dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abddf8700 1 -- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20df8c0 msgr2=0x2105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20df8c0 0x2105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abddf8700 1 -- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20e0270 msgr2=0x20dfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20e0270 0x20dfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abddf8700 1 -- 172.21.15.153:0/1536365435 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x206be30 con 0x20dae90 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20e0270 0x20dfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x20dca20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f8ab004bbc0 tx=0x7f8ab0009780).ready entity=mon.0 client_cookie=17dbd397e2d24c10 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8aa27fc700 1 -- 172.21.15.153:0/1536365435 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab004a440 con 0x20dae90 2023-08-17T00:06:24.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8aa27fc700 1 -- 172.21.15.153:0/1536365435 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0048940 con 0x20dae90 2023-08-17T00:06:24.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8aa27fc700 1 -- 172.21.15.153:0/1536365435 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab004b930 con 0x20dae90 2023-08-17T00:06:24.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1536365435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 msgr2=0x20dca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x20dca20 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f8ab004bbc0 tx=0x7f8ab0009780).stop 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1536365435 shutdown_connections 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x20dca20 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20e0270 0x20dfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1536365435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20df8c0 0x2105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1536365435 >> 172.21.15.153:0/1536365435 conn(0x1ebf680 msgr2=0x2126960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1536365435 shutdown_connections 2023-08-17T00:06:24.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1536365435 wait complete. 2023-08-17T00:06:24.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 -- start start 2023-08-17T00:06:24.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.924+0000 7f8ac9bf8740 1 Processor -- start 2023-08-17T00:06:24.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2135ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x2136090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x21079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2136580 con 0x20e0270 2023-08-17T00:06:24.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21088a0 con 0x20df8c0 2023-08-17T00:06:24.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2125f00 con 0x20dae90 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 10 client.0 ll_register_callbacks cb 0x2022b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x21079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x21079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33006/0 (socket says 172.21.15.153:33006) 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 -- 172.21.15.153:0/2027252202 learned_addr learned my addr 172.21.15.153:0/2027252202 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x2136090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2135ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 -- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 msgr2=0x2135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2135ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 -- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 msgr2=0x2136090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x2136090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 -- 172.21.15.153:0/2027252202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab8153fc0 con 0x20e0270 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abddf8700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x21079f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f8ab000c680 tx=0x7f8ab0055000).ready entity=mon.0 client_cookie=7eb9897f12ffc797 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8a977fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8a977fe700 1 -- 172.21.15.153:0/2027252202 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0048020 con 0x20e0270 2023-08-17T00:06:24.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8a977fe700 1 -- 172.21.15.153:0/2027252202 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ab0048180 con 0x20e0270 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2056cf0 con 0x20e0270 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8a977fe700 1 -- 172.21.15.153:0/2027252202 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab0048340 con 0x20e0270 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 10 client.5799 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7f8ab80c45f0 con 0x20e0270 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8a977fe700 1 -- 172.21.15.153:0/2027252202 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2056cf0 con 0x20e0270 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8a977fe700 1 -- 172.21.15.153:0/2027252202 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8ab0058030 con 0x20e0270 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 10 client.5799 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:24.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 10 client.5799 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:24.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 20 client.5799 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:24.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2108430 0x2123590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 4 client.5799 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:24.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x204d240 con 0x2108430 2023-08-17T00:06:24.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.928+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2108430 0x2123590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8a977fe700 10 client.5799 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2108430 0x2123590 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7762ecdda1cf933b server_cookie=77d1cb407da8854b in_seq=0 out_seq=0 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8a977fe700 1 -- 172.21.15.153:0/2027252202 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x204d240 con 0x2108430 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8a977fe700 10 client.5799 handle_command_reply: tid=0 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 client.5799 shutdown 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 msgr2=0x21079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x21079f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f8ab000c680 tx=0x7f8ab0055000).stop 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 shutdown_connections 2023-08-17T00:06:24.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2108430 0x2123590 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x21079f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x2136090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8a977fe700 0 client.5799 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/2027252202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2135ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 >> 172.21.15.153:0/2027252202 conn(0x1ebf680 msgr2=0x2104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 shutdown_connections 2023-08-17T00:06:24.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/2027252202 wait complete. 2023-08-17T00:06:24.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.932+0000 7f8ac9bf8740 20 client.5799 trim_cache size 0 max 16384 2023-08-17T00:06:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.948+0000 7f8ac9bf8740 1 Processor -- start 2023-08-17T00:06:24.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.948+0000 7f8ac9bf8740 1 -- start start 2023-08-17T00:06:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x2104d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x210a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20e0270 0x210ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x21324c0 con 0x20dae90 2023-08-17T00:06:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21059d0 con 0x20df8c0 2023-08-17T00:06:24.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2056cf0 con 0x20e0270 2023-08-17T00:06:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x2104d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x2104d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33016/0 (socket says 172.21.15.153:33016) 2023-08-17T00:06:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 -- 172.21.15.153:0/1041044179 learned_addr learned my addr 172.21.15.153:0/1041044179 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x210a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20e0270 0x210ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 -- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20e0270 msgr2=0x210ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20e0270 0x210ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 -- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 msgr2=0x210a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x210a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 -- 172.21.15.153:0/1041044179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8155430 con 0x20dae90 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x210a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x2104d50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x2126890 tx=0x7f8ab4009000).ready entity=mon.0 client_cookie=ea63d77bd8248068 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8aa2ffd700 1 -- 172.21.15.153:0/1041044179 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab401c040 con 0x20dae90 2023-08-17T00:06:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8aa2ffd700 1 -- 172.21.15.153:0/1041044179 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4029070 con 0x20dae90 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8aa2ffd700 1 -- 172.21.15.153:0/1041044179 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4016c40 con 0x20dae90 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1041044179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 msgr2=0x2104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.952+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x2104d50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x2126890 tx=0x7f8ab4009000).stop 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1041044179 shutdown_connections 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20e0270 0x210ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x210a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1041044179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20dae90 0x2104d50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1041044179 >> 172.21.15.153:0/1041044179 conn(0x1ebf680 msgr2=0x2131c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1041044179 shutdown_connections 2023-08-17T00:06:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1041044179 wait complete. 2023-08-17T00:06:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- start start 2023-08-17T00:06:24.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 Processor -- start 2023-08-17T00:06:24.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2121d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x21949a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x2194e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x21956c0 con 0x20e0270 2023-08-17T00:06:24.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2107020 con 0x20df8c0 2023-08-17T00:06:24.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21212e0 con 0x20dae90 2023-08-17T00:06:24.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8ac9bf8740 10 client.0 ll_register_callbacks cb 0x7f8ab0009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:24.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x2194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8abddf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x2194e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35198/0 (socket says 172.21.15.153:35198) 2023-08-17T00:06:24.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8abddf8700 1 -- 172.21.15.153:0/1153098922 learned_addr learned my addr 172.21.15.153:0/1153098922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.956+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x21949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abddf8700 1 -- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 msgr2=0x2121d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2121d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abddf8700 1 -- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 msgr2=0x21949a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x21949a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abddf8700 1 -- 172.21.15.153:0/1153098922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab8154e90 con 0x20e0270 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abcdf6700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x21949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abddf8700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x2194e90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8ab00099f0 tx=0x7f8ab005b000).ready entity=mon.0 client_cookie=caaa221ca4a5d21c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 1 -- 172.21.15.153:0/1153098922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab004b4e0 con 0x20e0270 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 1 -- 172.21.15.153:0/1153098922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ab0013ab0 con 0x20e0270 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2101240 con 0x20e0270 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 1 -- 172.21.15.153:0/1153098922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab0013e80 con 0x20e0270 2023-08-17T00:06:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 10 client.5805 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:24.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x205a010 con 0x20e0270 2023-08-17T00:06:24.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 1 -- 172.21.15.153:0/1153098922 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab0029070 con 0x20e0270 2023-08-17T00:06:24.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 1 -- 172.21.15.153:0/1153098922 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8ab0072d40 con 0x20e0270 2023-08-17T00:06:24.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 10 client.5805 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 10 client.5805 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 20 client.5805 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2191050 0x2104d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 4 client.5805 mds_command: new command op to 5427 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f8ab0048940 con 0x2191050 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2191050 0x2104d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8abd5f7700 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2191050 0x2104d50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de0089ea72be933 server_cookie=447f1b17579be681 in_seq=0 out_seq=0 2023-08-17T00:06:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 10 client.5805 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 1 -- 172.21.15.153:0/1153098922 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+167 (crc 0 0 0) 0x7f8ab0048940 con 0x2191050 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8a977fe700 10 client.5805 handle_command_reply: tid=0 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 client.5805 shutdown 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 msgr2=0x2194e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.960+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x2194e90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8ab00099f0 tx=0x7f8ab005b000).stop 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 shutdown_connections 2023-08-17T00:06:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2191050 0x2104d50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20e0270 0x2194e90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20df8c0 0x21949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8a977fe700 0 client.5805 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 --2- 172.21.15.153:0/1153098922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20dae90 0x2121d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 >> 172.21.15.153:0/1153098922 conn(0x1ebf680 msgr2=0x2131c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 shutdown_connections 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 1 -- 172.21.15.153:0/1153098922 wait complete. 2023-08-17T00:06:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8ac9bf8740 20 client.5805 trim_cache size 0 max 16384 2023-08-17T00:06:24.972 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:06:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "damage_type": "backtrace", 2023-08-17T00:06:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 872255211, 2023-08-17T00:06:24.972 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 1099511630187, 2023-08-17T00:06:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2023-08-17T00:06:24.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:24.973 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a9c05a150 msgr2=0x7f8a9c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a9c05a150 0x7f8a9c05c610 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f8ab80ac920 tx=0x7f8ab4007d30).stop 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 msgr2=0x7f8ab80c2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 0x7f8ab80c2500 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f8ab0009e90 tx=0x7f8ab000b040).stop 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 shutdown_connections 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a9c05a150 0x7f8a9c05c610 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ab80afc60 0x7f8ab80c2500 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ab80acf30 0x7f8ab80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 --2- 172.21.15.153:0/1995585999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ab80639a0 0x7f8ab80c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:24.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 >> 172.21.15.153:0/1995585999 conn(0x7f8ab80cb330 msgr2=0x7f8ab8152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:24.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 shutdown_connections 2023-08-17T00:06:24.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:24.964+0000 7f8abe5f9700 1 -- 172.21.15.153:0/1995585999 wait complete. 2023-08-17T00:06:24.990 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:25.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.136+0000 7f9e4ab07700 1 Processor -- start 2023-08-17T00:06:25.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.136+0000 7f9e4ab07700 1 -- start start 2023-08-17T00:06:25.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4ab07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e44068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4ab07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9e440ac2f0 0x7f9e44068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4ab07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e441545e0 con 0x7f9e440c0a80 2023-08-17T00:06:25.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4ab07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e44069200 con 0x7f9e440ac2f0 2023-08-17T00:06:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4ab07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440c1c50 con 0x7f9e440abf10 2023-08-17T00:06:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49304700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9e440ac2f0 0x7f9e44068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4a306700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9e440c0a80 0x7f9e44156750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:50086/0 (socket says 172.21.15.153:50086) 2023-08-17T00:06:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e4a306700 1 -- 172.21.15.153:0/4046787110 learned_addr learned my addr 172.21.15.153:0/4046787110 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:25.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49b05700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e44068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e48b03700 1 -- 172.21.15.153:0/4046787110 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3869565946 0 0) 0x7f9e441545e0 con 0x7f9e440c0a80 2023-08-17T00:06:25.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e48b03700 1 -- 172.21.15.153:0/4046787110 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e300033f0 con 0x7f9e440c0a80 2023-08-17T00:06:25.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49304700 1 -- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 msgr2=0x7f9e44068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49304700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e44068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49304700 1 -- 172.21.15.153:0/4046787110 >> v1:172.21.15.178:6789/0 conn(0x7f9e440c0a80 legacy=0x7f9e44156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49304700 1 -- 172.21.15.153:0/4046787110 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440a96d0 con 0x7f9e440ac2f0 2023-08-17T00:06:25.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49b05700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e44068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.140+0000 7f9e49304700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44068d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f9e34009760 tx=0x7f9e34009060).ready entity=mon.1 client_cookie=7a9965af6f61f93b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e48b03700 1 -- 172.21.15.153:0/4046787110 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340090d0 con 0x7f9e440ac2f0 2023-08-17T00:06:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e48b03700 1 -- 172.21.15.153:0/4046787110 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3400d4a0 con 0x7f9e440ac2f0 2023-08-17T00:06:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e48b03700 1 -- 172.21.15.153:0/4046787110 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400d820 con 0x7f9e440ac2f0 2023-08-17T00:06:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 msgr2=0x7f9e44068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44068d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f9e34009760 tx=0x7f9e34009060).stop 2023-08-17T00:06:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4046787110 shutdown_connections 2023-08-17T00:06:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44068d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4046787110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e44068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4046787110 >> 172.21.15.153:0/4046787110 conn(0x7f9e440c6620 msgr2=0x7f9e440c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4046787110 shutdown_connections 2023-08-17T00:06:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.144+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4046787110 wait complete. 2023-08-17T00:06:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 Processor -- start 2023-08-17T00:06:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 -- start start 2023-08-17T00:06:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e441560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 0x7f9e44158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44155c40 con 0x7f9e440c0a80 2023-08-17T00:06:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44157440 con 0x7f9e440ac2f0 2023-08-17T00:06:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4ab07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44155310 con 0x7f9e440abf10 2023-08-17T00:06:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4a306700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 0x7f9e44158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4a306700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 0x7f9e44158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35212/0 (socket says 172.21.15.153:35212) 2023-08-17T00:06:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e49b05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e441560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e4a306700 1 -- 172.21.15.153:0/4239537892 learned_addr learned my addr 172.21.15.153:0/4239537892 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.148+0000 7f9e49304700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4a306700 1 -- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 msgr2=0x7f9e441560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4a306700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e441560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4a306700 1 -- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 msgr2=0x7f9e44156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4a306700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4a306700 1 -- 172.21.15.153:0/4239537892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40009250 con 0x7f9e440c0a80 2023-08-17T00:06:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e49b05700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e441560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4a306700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 0x7f9e44158a50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9e3c00c790 tx=0x7f9e3c007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c005d30 con 0x7f9e440c0a80 2023-08-17T00:06:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c005e90 con 0x7f9e440c0a80 2023-08-17T00:06:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e340092a0 con 0x7f9e440c0a80 2023-08-17T00:06:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c007320 con 0x7f9e440c0a80 2023-08-17T00:06:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e441558d0 con 0x7f9e440c0a80 2023-08-17T00:06:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.152+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e44155db0 con 0x7f9e440c0a80 2023-08-17T00:06:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.156+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9e3c010070 con 0x7f9e440c0a80 2023-08-17T00:06:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.156+0000 7f9e39ffb700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e2805a1a0 0x7f9e2805c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.156+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e3c0738b0 con 0x7f9e440c0a80 2023-08-17T00:06:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.156+0000 7f9e49b05700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e2805a1a0 0x7f9e2805c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.156+0000 7f9e49b05700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e2805a1a0 0x7f9e2805c660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9e40006fd0 tx=0x7f9e40006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.164+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e3c0472d0 con 0x7f9e440c0a80 2023-08-17T00:06:25.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.356+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e4406b4c0 con 0x7f9e440c0a80 2023-08-17T00:06:25.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e39ffb700 1 -- 172.21.15.153:0/4239537892 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f9e3c04a8f0 con 0x7f9e440c0a80 2023-08-17T00:06:25.364 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:25.364 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e2805a1a0 msgr2=0x7f9e2805c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e2805a1a0 0x7f9e2805c660 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f9e40006fd0 tx=0x7f9e40006f40).stop 2023-08-17T00:06:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 msgr2=0x7f9e44158a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 0x7f9e44158a50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9e3c00c790 tx=0x7f9e3c007f50).stop 2023-08-17T00:06:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 shutdown_connections 2023-08-17T00:06:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e2805a1a0 0x7f9e2805c660 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e440c0a80 0x7f9e44158a50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e440ac2f0 0x7f9e44156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 --2- 172.21.15.153:0/4239537892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e440abf10 0x7f9e441560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 >> 172.21.15.153:0/4239537892 conn(0x7f9e440c6620 msgr2=0x7f9e4414dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 shutdown_connections 2023-08-17T00:06:25.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.360+0000 7f9e4ab07700 1 -- 172.21.15.153:0/4239537892 wait complete. 2023-08-17T00:06:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:25.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 872255211 2023-08-17T00:06:25.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.552+0000 7f3cebfff700 1 Processor -- start 2023-08-17T00:06:25.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.552+0000 7f3cebfff700 1 -- start start 2023-08-17T00:06:25.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3cebfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3cec0a8a60 0x7f3cec154150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3cebfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3cec0a8e40 0x7f3cec068af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3cebfff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec065200 con 0x7f3cec066110 2023-08-17T00:06:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3cebfff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec153cc0 con 0x7f3cec0a8e40 2023-08-17T00:06:25.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3cebfff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec154640 con 0x7f3cec0a8a60 2023-08-17T00:06:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3ce27fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3cec066110 0x7f3cec064af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40924/0 (socket says 172.21.15.153:40924) 2023-08-17T00:06:25.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.556+0000 7f3ce27fc700 1 -- 172.21.15.153:0/2655737853 learned_addr learned my addr 172.21.15.153:0/2655737853 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193794053 0 0) 0x7f3cdc001110 con 0x7f3cec066110 2023-08-17T00:06:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2655737853 >> v2:172.21.15.178:3300/0 conn(0x7f3cec0a8a60 0x7f3cec154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd80033f0 con 0x7f3cec066110 2023-08-17T00:06:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1828358230 0 0) 0x7f3cd80033f0 con 0x7f3cec066110 2023-08-17T00:06:25.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 >> v2:172.21.15.178:3300/0 conn(0x7f3cec0a8a60 msgr2=0x7f3cec154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 --2- 172.21.15.153:0/2655737853 >> v2:172.21.15.178:3300/0 conn(0x7f3cec0a8a60 0x7f3cec154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 >> v2:172.21.15.153:3300/0 conn(0x7f3cec0a8e40 msgr2=0x7f3cec068af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 --2- 172.21.15.153:0/2655737853 >> v2:172.21.15.153:3300/0 conn(0x7f3cec0a8e40 0x7f3cec068af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.560+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec065440 con 0x7f3cec066110 2023-08-17T00:06:25.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f3cdc001600 con 0x7f3cec066110 2023-08-17T00:06:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 >> v1:172.21.15.153:6789/0 conn(0x7f3cec066110 legacy=0x7f3cec064af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd8003bc0 0x7f3cd8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8006680 0x7f3cd8008b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd8009360 0x7f3cd800b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec153cc0 con 0x7f3cd8006680 2023-08-17T00:06:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec154640 con 0x7f3cd8009360 2023-08-17T00:06:25.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd800c130 con 0x7f3cd8003bc0 2023-08-17T00:06:25.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd8003bc0 0x7f3cd8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8006680 0x7f3cd8008b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.564+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd8009360 0x7f3cd800b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd8009360 msgr2=0x7f3cd800b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd8009360 0x7f3cd800b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2655737853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8006680 msgr2=0x7f3cd8008b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8006680 0x7f3cd8008b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2655737853 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80033f0 con 0x7f3cd8003bc0 2023-08-17T00:06:25.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8006680 0x7f3cd8008b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:25.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd8009360 0x7f3cd800b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:25.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.568+0000 7f3ceb7fe700 1 -- 172.21.15.153:0/2655737853 reap_dead start 2023-08-17T00:06:25.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.572+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd8003bc0 0x7f3cd8005fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3cd4007290 tx=0x7f3cd4005910).ready entity=mon.2 client_cookie=2987ddaa07b4bf0a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.572+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4005c00 con 0x7f3cd8003bc0 2023-08-17T00:06:25.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.572+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4013040 con 0x7f3cd8003bc0 2023-08-17T00:06:25.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cea7fc700 1 -- 172.21.15.153:0/2655737853 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400d920 con 0x7f3cd8003bc0 2023-08-17T00:06:25.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 -- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd8003bc0 msgr2=0x7f3cd8005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd8003bc0 0x7f3cd8005fb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3cd4007290 tx=0x7f3cd4005910).stop 2023-08-17T00:06:25.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 -- 172.21.15.153:0/2655737853 shutdown_connections 2023-08-17T00:06:25.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 --2- 172.21.15.153:0/2655737853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd8003bc0 0x7f3cd8005fb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 -- 172.21.15.153:0/2655737853 >> 172.21.15.153:0/2655737853 conn(0x7f3cec0c6480 msgr2=0x7f3cec0c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 -- 172.21.15.153:0/2655737853 shutdown_connections 2023-08-17T00:06:25.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.576+0000 7f3cebfff700 1 -- 172.21.15.153:0/2655737853 wait complete. 2023-08-17T00:06:25.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 Processor -- start 2023-08-17T00:06:25.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 -- start start 2023-08-17T00:06:25.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 0x7f3cec166ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cec0a0e40 0x7f3cec152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cec0ab300 0x7f3cec0ab780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0a36f0 con 0x7f3cd8003bc0 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0abc70 con 0x7f3cec0a0e40 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.580+0000 7f3cebfff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0a1640 con 0x7f3cec0ab300 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 0x7f3cec166ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 0x7f3cec166ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35250/0 (socket says 172.21.15.153:35250) 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2667662176 learned_addr learned my addr 172.21.15.153:0/2667662176 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cec0ab300 0x7f3cec0ab780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cec0a0e40 0x7f3cec152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cec0ab300 msgr2=0x7f3cec0ab780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cec0ab300 0x7f3cec0ab780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cec0a0e40 msgr2=0x7f3cec152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cec0a0e40 0x7f3cec152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2667662176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0a2dc0 con 0x7f3cd8003bc0 2023-08-17T00:06:25.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cec0ab300 0x7f3cec0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:25.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.584+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 0x7f3cec166ee0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f3cd4000e10 tx=0x7f3cd401c000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.596+0000 7f3ce37fe700 1 -- 172.21.15.153:0/2667662176 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400d070 con 0x7f3cd8003bc0 2023-08-17T00:06:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.596+0000 7f3cebfff700 1 -- 172.21.15.153:0/2667662176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec0a30a0 con 0x7f3cd8003bc0 2023-08-17T00:06:25.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.596+0000 7f3cebfff700 1 -- 172.21.15.153:0/2667662176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec0a12a0 con 0x7f3cd8003bc0 2023-08-17T00:06:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.604+0000 7f3cfba6a740 1 Processor -- start 2023-08-17T00:06:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.604+0000 7f3cfba6a740 1 -- start start 2023-08-17T00:06:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x284dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28507c0 0x282f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28065e0 0x284b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27561d0 con 0x28507c0 2023-08-17T00:06:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27788b0 con 0x284d830 2023-08-17T00:06:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x277ffe0 con 0x28065e0 2023-08-17T00:06:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ceb7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x284dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ceb7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x284dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:47884/0 (socket says 172.21.15.153:47884) 2023-08-17T00:06:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ceb7fe700 1 -- 172.21.15.153:0/467981651 learned_addr learned my addr 172.21.15.153:0/467981651 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28065e0 0x284b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ce37fe700 1 -- 172.21.15.153:0/2667662176 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4018990 con 0x7f3cd8003bc0 2023-08-17T00:06:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ce37fe700 1 -- 172.21.15.153:0/2667662176 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4018d10 con 0x7f3cd8003bc0 2023-08-17T00:06:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ceb7fe700 1 -- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28065e0 msgr2=0x284b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.608+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28065e0 0x284b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3ceb7fe700 1 -- 172.21.15.153:0/467981651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28507c0 msgr2=0x282f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28507c0 0x282f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3ceb7fe700 1 -- 172.21.15.153:0/467981651 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2784040 con 0x284d830 2023-08-17T00:06:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28065e0 0x284b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x284dc10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f3cec069890 tx=0x7f3ce40075f0).ready entity=mon.1 client_cookie=71840a52e17531ad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cebfff700 1 -- 172.21.15.153:0/467981651 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4007e00 con 0x284d830 2023-08-17T00:06:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cebfff700 1 -- 172.21.15.153:0/467981651 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400d660 con 0x284d830 2023-08-17T00:06:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cebfff700 1 -- 172.21.15.153:0/467981651 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce400d9e0 con 0x284d830 2023-08-17T00:06:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 -- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 msgr2=0x284dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x284dc10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f3cec069890 tx=0x7f3ce40075f0).stop 2023-08-17T00:06:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 -- 172.21.15.153:0/467981651 shutdown_connections 2023-08-17T00:06:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28065e0 0x284b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28507c0 0x282f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/467981651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x284dc10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.612+0000 7f3cfba6a740 1 -- 172.21.15.153:0/467981651 >> 172.21.15.153:0/467981651 conn(0x25e96d0 msgr2=0x280a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.620+0000 7f3ce37fe700 1 -- 172.21.15.153:0/2667662176 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3cd4029430 con 0x7f3cd8003bc0 2023-08-17T00:06:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3ce37fe700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ccc05a1a0 0x7f3ccc05c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3ce37fe700 1 -- 172.21.15.153:0/2667662176 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3cd4076b50 con 0x7f3cd8003bc0 2023-08-17T00:06:25.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ccc05a1a0 0x7f3ccc05c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3cfba6a740 1 -- 172.21.15.153:0/467981651 shutdown_connections 2023-08-17T00:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3cfba6a740 1 -- 172.21.15.153:0/467981651 wait complete. 2023-08-17T00:06:25.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ccc05a1a0 0x7f3ccc05c660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3cdc001730 tx=0x7f3cdc00a040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.624+0000 7f3cfba6a740 1 -- start start 2023-08-17T00:06:25.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.628+0000 7f3cfba6a740 1 Processor -- start 2023-08-17T00:06:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.628+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28065e0 0x2830c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.628+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x282e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.628+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2834d90 0x285d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ce27fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x282e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ce27fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x282e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:47900/0 (socket says 172.21.15.153:47900) 2023-08-17T00:06:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ce27fc700 1 -- 172.21.15.153:0/1827806584 learned_addr learned my addr 172.21.15.153:0/1827806584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2834d90 0x285d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2777060 con 0x28065e0 2023-08-17T00:06:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2831830 con 0x284d830 2023-08-17T00:06:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x285c7d0 con 0x2834d90 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3cfba6a740 10 client.0 ll_register_callbacks cb 0x27c18e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28065e0 0x2830c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceaffd700 1 -- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2834d90 msgr2=0x285d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2834d90 0x285d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceaffd700 1 -- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 msgr2=0x282e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x282e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ceaffd700 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce400f400 con 0x28065e0 2023-08-17T00:06:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.632+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x282e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.652+0000 7f3cd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:25.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.652+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28065e0 0x2830c20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f3cd4005d30 tx=0x7f3cd4014000).ready entity=mon.0 client_cookie=47c898f1e6415c2f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.664+0000 7f3cd17fa700 1 -- 172.21.15.153:0/1827806584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd404e0f0 con 0x28065e0 2023-08-17T00:06:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.664+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2780d20 con 0x28065e0 2023-08-17T00:06:25.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.668+0000 7f3cd17fa700 1 -- 172.21.15.153:0/1827806584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3cd4053890 con 0x28065e0 2023-08-17T00:06:25.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.668+0000 7f3cd17fa700 1 -- 172.21.15.153:0/1827806584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cd404e0f0 con 0x28065e0 2023-08-17T00:06:25.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.668+0000 7f3cfba6a740 10 client.5817 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:25.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.668+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x277f4e0 con 0x28065e0 2023-08-17T00:06:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.668+0000 7f3cd17fa700 1 -- 172.21.15.153:0/1827806584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2780d20 con 0x28065e0 2023-08-17T00:06:25.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.672+0000 7f3cd17fa700 1 -- 172.21.15.153:0/1827806584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3cd4074cc0 con 0x28065e0 2023-08-17T00:06:25.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.672+0000 7f3cfba6a740 10 client.5817 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:25.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.672+0000 7f3cfba6a740 10 client.5817 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:06:25.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3cfba6a740 20 client.5817 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:25.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x28343c0 0x284f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3cfba6a740 4 client.5817 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:25.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2777270 con 0x28343c0 2023-08-17T00:06:25.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x28343c0 0x284f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x28343c0 0x284f650 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2c1e301ab35827b6 server_cookie=289362baa620a654 in_seq=0 out_seq=0 2023-08-17T00:06:25.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.676+0000 7f3cd17fa700 10 client.5817 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cd17fa700 1 -- 172.21.15.153:0/1827806584 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2777270 con 0x28343c0 2023-08-17T00:06:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cd17fa700 10 client.5817 handle_command_reply: tid=0 2023-08-17T00:06:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 client.5817 shutdown 2023-08-17T00:06:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28065e0 msgr2=0x2830c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28065e0 0x2830c20 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f3cd4005d30 tx=0x7f3cd4014000).stop 2023-08-17T00:06:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 shutdown_connections 2023-08-17T00:06:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x28343c0 0x284f650 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2834d90 0x285d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x284d830 0x282e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/1827806584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28065e0 0x2830c20 secure :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0x7f3cd4005d30 tx=0x7f3cd4014000).stop 2023-08-17T00:06:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 >> 172.21.15.153:0/1827806584 conn(0x25e96d0 msgr2=0x2802c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.680+0000 7f3cd17fa700 0 client.5817 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.684+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 shutdown_connections 2023-08-17T00:06:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.684+0000 7f3cfba6a740 1 -- 172.21.15.153:0/1827806584 wait complete. 2023-08-17T00:06:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.684+0000 7f3cfba6a740 20 client.5817 trim_cache size 0 max 16384 2023-08-17T00:06:25.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 Processor -- start 2023-08-17T00:06:25.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 -- start start 2023-08-17T00:06:25.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 0x2833430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x2802e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x280a520 0x2836180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x284a110 con 0x2834d90 2023-08-17T00:06:25.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x284cd00 con 0x280a520 2023-08-17T00:06:25.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27020d0 con 0x284d830 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 0x2833430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 0x2833430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35288/0 (socket says 172.21.15.153:35288) 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2652246576 learned_addr learned my addr 172.21.15.153:0/2652246576 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x280a520 0x2836180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.704+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x2802e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 msgr2=0x2802e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x2802e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x280a520 msgr2=0x2836180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x280a520 0x2836180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2652246576 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x277f230 con 0x2834d90 2023-08-17T00:06:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 0x2833430 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f3cd40187e0 tx=0x7f3cd4032000).ready entity=mon.0 client_cookie=7c67002aaaddd548 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cd3fff700 1 -- 172.21.15.153:0/2652246576 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd404e0f0 con 0x2834d90 2023-08-17T00:06:25.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cd3fff700 1 -- 172.21.15.153:0/2652246576 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4049f40 con 0x2834d90 2023-08-17T00:06:25.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cd3fff700 1 -- 172.21.15.153:0/2652246576 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4053220 con 0x2834d90 2023-08-17T00:06:25.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2652246576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 msgr2=0x2833430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 0x2833430 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f3cd40187e0 tx=0x7f3cd4032000).stop 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2652246576 shutdown_connections 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x280a520 0x2836180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x2802e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2652246576 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2834d90 0x2833430 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2652246576 >> 172.21.15.153:0/2652246576 conn(0x25e96d0 msgr2=0x2808df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2652246576 shutdown_connections 2023-08-17T00:06:25.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2652246576 wait complete. 2023-08-17T00:06:25.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 -- start start 2023-08-17T00:06:25.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.708+0000 7f3cfba6a740 1 Processor -- start 2023-08-17T00:06:25.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 0x282d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2834d90 0x2835170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x28b6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x282ddd0 con 0x280a520 2023-08-17T00:06:25.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28b7040 con 0x2834d90 2023-08-17T00:06:25.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x284be20 con 0x284d830 2023-08-17T00:06:25.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 10 client.0 ll_register_callbacks cb 0x7f3ce4007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:25.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 0x282d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 0x282d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35300/0 (socket says 172.21.15.153:35300) 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2861173468 learned_addr learned my addr 172.21.15.153:0/2861173468 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceb7fe700 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x28b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 msgr2=0x28b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x28b6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2834d90 msgr2=0x2835170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2834d90 0x2835170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 -- 172.21.15.153:0/2861173468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x277f4e0 con 0x280a520 2023-08-17T00:06:25.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ceaffd700 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 0x282d5f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f3cd404a650 tx=0x7f3cd4034070).ready entity=mon.0 client_cookie=fced14046dc9ec60 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 1 -- 172.21.15.153:0/2861173468 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd404e0f0 con 0x280a520 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 1 -- 172.21.15.153:0/2861173468 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3cd4053890 con 0x280a520 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ce400d660 con 0x280a520 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 1 -- 172.21.15.153:0/2861173468 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cd4005880 con 0x280a520 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 10 client.5823 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x26879d0 con 0x280a520 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 1 -- 172.21.15.153:0/2861173468 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce400d660 con 0x280a520 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 1 -- 172.21.15.153:0/2861173468 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3cd4074cc0 con 0x280a520 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 10 client.5823 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 10 client.5823 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 20 client.5823 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2835660 0x28b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 4 client.5823 mds_command: new command op to 5427 tid=0[{"prefix": "damage rm", "damage_id": 872255211}] 2023-08-17T00:06:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "damage rm", "damage_id": 872255211}) v1 -- 0x2640660 con 0x2835660 2023-08-17T00:06:25.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2835660 0x28b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3ce27fc700 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2835660 0x28b6710 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=58daf7d1bc1d7a72 server_cookie=adf5ee792221999b in_seq=0 out_seq=0 2023-08-17T00:06:25.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 10 client.5823 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:25.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 1 -- 172.21.15.153:0/2861173468 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x2640660 con 0x2835660 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cd17fa700 10 client.5823 handle_command_reply: tid=0 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.712+0000 7f3cfba6a740 1 client.5823 shutdown 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 msgr2=0x282d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 0x282d5f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f3cd404a650 tx=0x7f3cd4034070).stop 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 shutdown_connections 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2835660 0x28b6710 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x284d830 0x28b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2834d90 0x2835170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 --2- 172.21.15.153:0/2861173468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x280a520 0x282d5f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 >> 172.21.15.153:0/2861173468 conn(0x25e96d0 msgr2=0x2849300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cd17fa700 0 client.5823 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 shutdown_connections 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 1 -- 172.21.15.153:0/2861173468 wait complete. 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3cfba6a740 20 client.5823 trim_cache size 0 max 16384 2023-08-17T00:06:25.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 -- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ccc05a1a0 msgr2=0x7f3ccc05c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ccc05a1a0 0x7f3ccc05c660 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f3cdc001730 tx=0x7f3cdc00a040).stop 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 -- 172.21.15.153:0/2667662176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 msgr2=0x7f3cec166ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 0x7f3cec166ee0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f3cd4000e10 tx=0x7f3cd401c000).stop 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 -- 172.21.15.153:0/2667662176 shutdown_connections 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ccc05a1a0 0x7f3ccc05c660 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cec0ab300 0x7f3cec0ab780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cec0a0e40 0x7f3cec152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 --2- 172.21.15.153:0/2667662176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3cd8003bc0 0x7f3cec166ee0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 -- 172.21.15.153:0/2667662176 >> 172.21.15.153:0/2667662176 conn(0x7f3cec0c6480 msgr2=0x7f3cec0629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 -- 172.21.15.153:0/2667662176 shutdown_connections 2023-08-17T00:06:25.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.716+0000 7f3ce0ff9700 1 -- 172.21.15.153:0/2667662176 wait complete. 2023-08-17T00:06:25.737 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2023-08-17T00:06:25.738 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:25.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 Processor -- start 2023-08-17T00:06:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 -- start start 2023-08-17T00:06:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b98068f30 0x7f0b980c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b980c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b981545e0 con 0x7f0b980abf10 2023-08-17T00:06:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980c1c50 con 0x7f0b98068f30 2023-08-17T00:06:25.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.888+0000 7f0b9ddb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b98064b80 con 0x7f0b980ac2f0 2023-08-17T00:06:25.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b98068f30 0x7f0b980c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b98068f30 0x7f0b980c0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35310/0 (socket says 172.21.15.153:35310) 2023-08-17T00:06:25.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 -- 172.21.15.153:0/3080377703 learned_addr learned my addr 172.21.15.153:0/3080377703 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9d5b8700 1 --2- 172.21.15.153:0/3080377703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b980c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 -- 172.21.15.153:0/3080377703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 msgr2=0x7f0b980c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:25.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 --2- 172.21.15.153:0/3080377703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b980c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 -- 172.21.15.153:0/3080377703 >> v1:172.21.15.178:6789/0 conn(0x7f0b980abf10 legacy=0x7f0b98068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 -- 172.21.15.153:0/3080377703 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980c1460 con 0x7f0b98068f30 2023-08-17T00:06:25.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b97fff700 1 --2- 172.21.15.153:0/3080377703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b98068f30 0x7f0b980c0a80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0b88006fd0 tx=0x7f0b880090f0).ready entity=mon.0 client_cookie=ad62be5625f3c5e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b977fe700 1 -- 172.21.15.153:0/3080377703 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800b600 con 0x7f0b98068f30 2023-08-17T00:06:25.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b977fe700 1 -- 172.21.15.153:0/3080377703 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800b760 con 0x7f0b98068f30 2023-08-17T00:06:25.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b977fe700 1 -- 172.21.15.153:0/3080377703 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800bae0 con 0x7f0b98068f30 2023-08-17T00:06:25.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/3080377703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b98068f30 msgr2=0x7f0b980c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/3080377703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b98068f30 0x7f0b980c0a80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f0b88006fd0 tx=0x7f0b880090f0).stop 2023-08-17T00:06:25.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/3080377703 shutdown_connections 2023-08-17T00:06:25.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/3080377703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b980c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/3080377703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b98068f30 0x7f0b980c0a80 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/3080377703 >> 172.21.15.153:0/3080377703 conn(0x7f0b980c6620 msgr2=0x7f0b980c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:25.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/3080377703 shutdown_connections 2023-08-17T00:06:25.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.892+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/3080377703 wait complete. 2023-08-17T00:06:25.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.896+0000 7f0b9ddb9700 1 Processor -- start 2023-08-17T00:06:25.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.896+0000 7f0b9ddb9700 1 -- start start 2023-08-17T00:06:25.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b98068f30 0x7f0b980bd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 0x7f0b9814cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b9814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980bd040 con 0x7f0b980abf10 2023-08-17T00:06:25.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980bec20 con 0x7f0b98068f30 2023-08-17T00:06:25.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9814d0b0 con 0x7f0b980ac2f0 2023-08-17T00:06:25.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 0x7f0b9814cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9cdb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b98068f30 0x7f0b980bd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 0x7f0b9814cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35320/0 (socket says 172.21.15.153:35320) 2023-08-17T00:06:25.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 -- 172.21.15.153:0/2194395277 learned_addr learned my addr 172.21.15.153:0/2194395277 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:25.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9d5b8700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b9814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 -- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 msgr2=0x7f0b9814ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b9814ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 -- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b98068f30 msgr2=0x7f0b980bd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:25.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b98068f30 0x7f0b980bd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:25.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 -- 172.21.15.153:0/2194395277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88009370 con 0x7f0b980abf10 2023-08-17T00:06:25.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b97fff700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 0x7f0b9814cbc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0b88011000 tx=0x7f0b88017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800be50 con 0x7f0b980abf10 2023-08-17T00:06:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800b8d0 con 0x7f0b980abf10 2023-08-17T00:06:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8801c650 con 0x7f0b980abf10 2023-08-17T00:06:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b980a96d0 con 0x7f0b980abf10 2023-08-17T00:06:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.900+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b980be2f0 con 0x7f0b980abf10 2023-08-17T00:06:25.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.904+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b980bedb0 con 0x7f0b980abf10 2023-08-17T00:06:25.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.904+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0b8802c070 con 0x7f0b980abf10 2023-08-17T00:06:25.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.904+0000 7f0b94ff9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b8405a150 0x7f0b8405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:25.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.904+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b88075bf0 con 0x7f0b980abf10 2023-08-17T00:06:25.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.904+0000 7f0b9cdb7700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b8405a150 0x7f0b8405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:25.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.908+0000 7f0b9cdb7700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b8405a150 0x7f0b8405c610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f0b8c007fd0 tx=0x7f0b8c007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:25.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:25.912+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b880496a0 con 0x7f0b980abf10 2023-08-17T00:06:26.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.100+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b9806b4c0 con 0x7f0b980abf10 2023-08-17T00:06:26.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.104+0000 7f0b94ff9700 1 -- 172.21.15.153:0/2194395277 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f0b88020070 con 0x7f0b980abf10 2023-08-17T00:06:26.108 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:26.108 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b8405a150 msgr2=0x7f0b8405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b8405a150 0x7f0b8405c610 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f0b8c007fd0 tx=0x7f0b8c007d30).stop 2023-08-17T00:06:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 msgr2=0x7f0b9814cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 0x7f0b9814cbc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f0b88011000 tx=0x7f0b88017000).stop 2023-08-17T00:06:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 shutdown_connections 2023-08-17T00:06:26.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b8405a150 0x7f0b8405c610 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b980ac2f0 0x7f0b9814ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b980abf10 0x7f0b9814cbc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 --2- 172.21.15.153:0/2194395277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b98068f30 0x7f0b980bd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 >> 172.21.15.153:0/2194395277 conn(0x7f0b980c6620 msgr2=0x7f0b98062e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:26.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 shutdown_connections 2023-08-17T00:06:26.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.108+0000 7f0b9ddb9700 1 -- 172.21.15.153:0/2194395277 wait complete. 2023-08-17T00:06:26.115 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:26.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2023-08-17T00:06:26.287 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:26.287 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:26.287 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:26.302 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:26.303 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2023-08-17T00:06:26.303 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2023-08-17T00:06:26.303 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2023-08-17T00:06:26.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:26.304 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2023-08-17T00:06:26.326 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:06:26.327 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:06:26.327 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:06:26.327 DEBUG:teuthology.orchestra.run.smithi153:> import json 2023-08-17T00:06:26.327 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2023-08-17T00:06:26.328 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:06:26.328 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:06:26.328 DEBUG:teuthology.orchestra.run.smithi153:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2023-08-17T00:06:26.329 DEBUG:teuthology.orchestra.run.smithi153:> except OSError as e: 2023-08-17T00:06:26.329 DEBUG:teuthology.orchestra.run.smithi153:> sys.exit(e.errno) 2023-08-17T00:06:26.329 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:06:26.329 DEBUG:teuthology.orchestra.run.smithi153:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-08-17T00:06:26.330 DEBUG:teuthology.orchestra.run.smithi153:> print(json.dumps( 2023-08-17T00:06:26.330 DEBUG:teuthology.orchestra.run.smithi153:> dict([(a, getattr(s, a)) for a in attrs]), 2023-08-17T00:06:26.330 DEBUG:teuthology.orchestra.run.smithi153:> indent=2)) 2023-08-17T00:06:26.330 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:06:26.470 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:26.470 INFO:teuthology.orchestra.run.smithi153.stdout: "st_mode": 16893, 2023-08-17T00:06:26.470 INFO:teuthology.orchestra.run.smithi153.stdout: "st_ino": 1099511627777, 2023-08-17T00:06:26.470 INFO:teuthology.orchestra.run.smithi153.stdout: "st_dev": 49, 2023-08-17T00:06:26.470 INFO:teuthology.orchestra.run.smithi153.stdout: "st_nlink": 16, 2023-08-17T00:06:26.471 INFO:teuthology.orchestra.run.smithi153.stdout: "st_uid": 1000, 2023-08-17T00:06:26.471 INFO:teuthology.orchestra.run.smithi153.stdout: "st_gid": 1267, 2023-08-17T00:06:26.471 INFO:teuthology.orchestra.run.smithi153.stdout: "st_size": 18, 2023-08-17T00:06:26.471 INFO:teuthology.orchestra.run.smithi153.stdout: "st_atime": 1692230768.5009596, 2023-08-17T00:06:26.471 INFO:teuthology.orchestra.run.smithi153.stdout: "st_mtime": 1692230777.6408355, 2023-08-17T00:06:26.472 INFO:teuthology.orchestra.run.smithi153.stdout: "st_ctime": 1692230777.6408355 2023-08-17T00:06:26.472 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:26.654 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2023-08-17T00:06:26.655 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2023-08-17T00:06:26.655 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:26.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.840+0000 7ff081439700 1 Processor -- start 2023-08-17T00:06:26.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.840+0000 7ff081439700 1 -- start start 2023-08-17T00:06:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff07c0689c0 0x7ff07c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff07c151530 0x7ff07c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c065da0 con 0x7ff07c1560f0 2023-08-17T00:06:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c155c60 con 0x7ff07c151530 2023-08-17T00:06:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c156550 con 0x7ff07c0689c0 2023-08-17T00:06:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff0737fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff07c1560f0 0x7ff07c0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40930/0 (socket says 172.21.15.153:40930) 2023-08-17T00:06:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff0737fe700 1 -- 172.21.15.153:0/201021264 learned_addr learned my addr 172.21.15.153:0/201021264 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:26.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff080c38700 1 --2- 172.21.15.153:0/201021264 >> v2:172.21.15.153:3300/0 conn(0x7ff07c151530 0x7ff07c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07bfff700 1 --2- 172.21.15.153:0/201021264 >> v2:172.21.15.178:3300/0 conn(0x7ff07c0689c0 0x7ff07c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07b7fe700 1 -- 172.21.15.153:0/201021264 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884369477 0 0) 0x7ff07c065da0 con 0x7ff07c1560f0 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07b7fe700 1 -- 172.21.15.153:0/201021264 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0680033f0 con 0x7ff07c1560f0 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff080c38700 1 -- 172.21.15.153:0/201021264 >> v2:172.21.15.178:3300/0 conn(0x7ff07c0689c0 msgr2=0x7ff07c068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff080c38700 1 --2- 172.21.15.153:0/201021264 >> v2:172.21.15.178:3300/0 conn(0x7ff07c0689c0 0x7ff07c068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff080c38700 1 -- 172.21.15.153:0/201021264 >> v1:172.21.15.153:6789/0 conn(0x7ff07c1560f0 legacy=0x7ff07c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:26.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff080c38700 1 -- 172.21.15.153:0/201021264 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c065ff0 con 0x7ff07c151530 2023-08-17T00:06:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07bfff700 1 --2- 172.21.15.153:0/201021264 >> v2:172.21.15.178:3300/0 conn(0x7ff07c0689c0 0x7ff07c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff080c38700 1 --2- 172.21.15.153:0/201021264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c1519c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7ff07c0c2d60 tx=0x7ff074009780).ready entity=mon.0 client_cookie=7d3f6483a4c462e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07b7fe700 1 -- 172.21.15.153:0/201021264 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07400e070 con 0x7ff07c151530 2023-08-17T00:06:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07b7fe700 1 -- 172.21.15.153:0/201021264 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07400bb60 con 0x7ff07c151530 2023-08-17T00:06:26.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff07b7fe700 1 -- 172.21.15.153:0/201021264 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074012410 con 0x7ff07c151530 2023-08-17T00:06:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- 172.21.15.153:0/201021264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 msgr2=0x7ff07c1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 --2- 172.21.15.153:0/201021264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c1519c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7ff07c0c2d60 tx=0x7ff074009780).stop 2023-08-17T00:06:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- 172.21.15.153:0/201021264 shutdown_connections 2023-08-17T00:06:26.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 --2- 172.21.15.153:0/201021264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c1519c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 --2- 172.21.15.153:0/201021264 >> v2:172.21.15.178:3300/0 conn(0x7ff07c0689c0 0x7ff07c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- 172.21.15.153:0/201021264 >> 172.21.15.153:0/201021264 conn(0x7ff07c0c6620 msgr2=0x7ff07c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- 172.21.15.153:0/201021264 shutdown_connections 2023-08-17T00:06:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.844+0000 7ff081439700 1 -- 172.21.15.153:0/201021264 wait complete. 2023-08-17T00:06:26.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 Processor -- start 2023-08-17T00:06:26.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 -- start start 2023-08-17T00:06:26.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff07c0689c0 0x7ff07c0b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:26.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:26.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff07c1560f0 0x7ff07c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b6560 con 0x7ff07c151530 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b60d0 con 0x7ff07c0689c0 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff081439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b51e0 con 0x7ff07c1560f0 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35342/0 (socket says 172.21.15.153:35342) 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 -- 172.21.15.153:0/851948890 learned_addr learned my addr 172.21.15.153:0/851948890 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:26.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff07bfff700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff07c0689c0 0x7ff07c0b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 -- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff07c1560f0 msgr2=0x7ff07c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff07c1560f0 0x7ff07c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 -- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff07c0689c0 msgr2=0x7ff07c0b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff07c0689c0 0x7ff07c0b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 -- 172.21.15.153:0/851948890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074009a20 con 0x7ff07c151530 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff07bfff700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff07c0689c0 0x7ff07c0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.848+0000 7ff0737fe700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c150a90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7ff06400c420 tx=0x7ff064007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640072e0 con 0x7ff07c151530 2023-08-17T00:06:26.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff064007440 con 0x7ff07c151530 2023-08-17T00:06:26.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640057a0 con 0x7ff07c151530 2023-08-17T00:06:26.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c0b54c0 con 0x7ff07c151530 2023-08-17T00:06:26.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c0b5a80 con 0x7ff07c151530 2023-08-17T00:06:26.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c0b6260 con 0x7ff07c151530 2023-08-17T00:06:26.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff064010070 con 0x7ff07c151530 2023-08-17T00:06:26.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.852+0000 7ff078ff9700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff05c05a150 0x7ff05c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:26.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.856+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff0640737e0 con 0x7ff07c151530 2023-08-17T00:06:26.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.856+0000 7ff07bfff700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff05c05a150 0x7ff05c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:26.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.856+0000 7ff07bfff700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff05c05a150 0x7ff05c05c610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff06c006d20 tx=0x7ff06c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:26.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:26.860+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff064047210 con 0x7ff07c151530 2023-08-17T00:06:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.056+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff07c06b4c0 con 0x7ff07c151530 2023-08-17T00:06:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.056+0000 7ff078ff9700 1 -- 172.21.15.153:0/851948890 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7ff06404a830 con 0x7ff07c151530 2023-08-17T00:06:27.063 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:27.063 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff05c05a150 msgr2=0x7ff05c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff05c05a150 0x7ff05c05c610 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7ff06c006d20 tx=0x7ff06c008040).stop 2023-08-17T00:06:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 msgr2=0x7ff07c150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c150a90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7ff06400c420 tx=0x7ff064007c80).stop 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 shutdown_connections 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff05c05a150 0x7ff05c05c610 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff07c1560f0 0x7ff07c061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff07c151530 0x7ff07c150a90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 --2- 172.21.15.153:0/851948890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff07c0689c0 0x7ff07c0b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 >> 172.21.15.153:0/851948890 conn(0x7ff07c0c6620 msgr2=0x7ff07c0c53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 shutdown_connections 2023-08-17T00:06:27.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.060+0000 7ff081439700 1 -- 172.21.15.153:0/851948890 wait complete. 2023-08-17T00:06:27.066 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:27.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/i/dont/exist 2023-08-17T00:06:27.217 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:27.217 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": -2 2023-08-17T00:06:27.218 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:27.229 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2023-08-17T00:06:27.229 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2023-08-17T00:06:27.229 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2023-08-17T00:06:27.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.384+0000 7fbed521b700 1 Processor -- start 2023-08-17T00:06:27.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.384+0000 7fbed521b700 1 -- start start 2023-08-17T00:06:27.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed0153ab0 0x7fbed0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbed00c59e0 0x7fbed00641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed00c0330 con 0x7fbed00c07c0 2023-08-17T00:06:27.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbed00646e0 con 0x7fbed00c59e0 2023-08-17T00:06:27.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed00c5e40 con 0x7fbed0153ab0 2023-08-17T00:06:27.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbece59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbed00c59e0 0x7fbed00641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbeced9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed0153ab0 0x7fbed0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbecf59e700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fbed00c07c0 0x7fbed0061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:50112/0 (socket says 172.21.15.153:50112) 2023-08-17T00:06:27.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbecf59e700 1 -- 172.21.15.153:0/2740027587 learned_addr learned my addr 172.21.15.153:0/2740027587 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:27.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbece59c700 1 -- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed0153ab0 msgr2=0x7fbed0153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbece59c700 1 --2- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed0153ab0 0x7fbed0153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbece59c700 1 -- 172.21.15.153:0/2740027587 >> v1:172.21.15.178:6789/0 conn(0x7fbed00c07c0 legacy=0x7fbed0061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbece59c700 1 -- 172.21.15.153:0/2740027587 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00c60a0 con 0x7fbed00c59e0 2023-08-17T00:06:27.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbece59c700 1 --2- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c59e0 0x7fbed00641f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbec4009760 tx=0x7fbec4009060).ready entity=mon.1 client_cookie=fb832b0cd2f8bf1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbecdd9b700 1 -- 172.21.15.153:0/2740027587 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec40090d0 con 0x7fbed00c59e0 2023-08-17T00:06:27.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbecdd9b700 1 -- 172.21.15.153:0/2740027587 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec400f510 con 0x7fbed00c59e0 2023-08-17T00:06:27.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbecdd9b700 1 -- 172.21.15.153:0/2740027587 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400f890 con 0x7fbed00c59e0 2023-08-17T00:06:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 -- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c59e0 msgr2=0x7fbed00641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.388+0000 7fbed521b700 1 --2- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c59e0 0x7fbed00641f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fbec4009760 tx=0x7fbec4009060).stop 2023-08-17T00:06:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.392+0000 7fbed521b700 1 -- 172.21.15.153:0/2740027587 shutdown_connections 2023-08-17T00:06:27.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.392+0000 7fbed521b700 1 --2- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c59e0 0x7fbed00641f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.392+0000 7fbed521b700 1 --2- 172.21.15.153:0/2740027587 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed0153ab0 0x7fbed0153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.392+0000 7fbed521b700 1 -- 172.21.15.153:0/2740027587 >> 172.21.15.153:0/2740027587 conn(0x7fbed00caaa0 msgr2=0x7fbed00caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.392+0000 7fbed521b700 1 -- 172.21.15.153:0/2740027587 shutdown_connections 2023-08-17T00:06:27.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.392+0000 7fbed521b700 1 -- 172.21.15.153:0/2740027587 wait complete. 2023-08-17T00:06:27.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 Processor -- start 2023-08-17T00:06:27.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 -- start start 2023-08-17T00:06:27.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c07c0 0x7fbed0143820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed00c59e0 0x7fbed00ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 0x7fbed00adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0143d10 con 0x7fbed0153ab0 2023-08-17T00:06:27.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0156d00 con 0x7fbed00c07c0 2023-08-17T00:06:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed0164bc0 con 0x7fbed00c59e0 2023-08-17T00:06:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 0x7fbed00adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 0x7fbed00adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35344/0 (socket says 172.21.15.153:35344) 2023-08-17T00:06:27.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 -- 172.21.15.153:0/3222043299 learned_addr learned my addr 172.21.15.153:0/3222043299 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbece59c700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed00c59e0 0x7fbed00ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbeced9d700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c07c0 0x7fbed0143820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 -- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed00c59e0 msgr2=0x7fbed00ada30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed00c59e0 0x7fbed00ada30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 -- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c07c0 msgr2=0x7fbed0143820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c07c0 0x7fbed0143820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 -- 172.21.15.153:0/3222043299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec40092a0 con 0x7fbed0153ab0 2023-08-17T00:06:27.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbecf59e700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 0x7fbed00adf20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fbec800c790 tx=0x7fbec80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbeb6ffd700 1 -- 172.21.15.153:0/3222043299 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8005d30 con 0x7fbed0153ab0 2023-08-17T00:06:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbeb6ffd700 1 -- 172.21.15.153:0/3222043299 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec8005e90 con 0x7fbed0153ab0 2023-08-17T00:06:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.396+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed0164ea0 con 0x7fbed0153ab0 2023-08-17T00:06:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.400+0000 7fbeb6ffd700 1 -- 172.21.15.153:0/3222043299 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec8007320 con 0x7fbed0153ab0 2023-08-17T00:06:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.400+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed0156990 con 0x7fbed0153ab0 2023-08-17T00:06:27.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.400+0000 7fbeb6ffd700 1 -- 172.21.15.153:0/3222043299 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbec8010030 con 0x7fbed0153ab0 2023-08-17T00:06:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeb6ffd700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbebc05a180 0x7fbebc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 Processor -- start 2023-08-17T00:06:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeb6ffd700 1 -- 172.21.15.153:0/3222043299 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbec8073f00 con 0x7fbed0153ab0 2023-08-17T00:06:27.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 -- start start 2023-08-17T00:06:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeced9d700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbebc05a180 0x7fbebc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1cb1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c864d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd8280 con 0x1cd25b0 2023-08-17T00:06:27.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c86000 con 0x1ccd1f0 2023-08-17T00:06:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c8b640 con 0x1c88790 2023-08-17T00:06:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeced9d700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbebc05a180 0x7fbebc05c640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbec0009b90 tx=0x7fbec0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35360/0 (socket says 172.21.15.153:35360) 2023-08-17T00:06:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 -- 172.21.15.153:0/4030345302 learned_addr learned my addr 172.21.15.153:0/4030345302 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbecf59e700 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c864d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeced9d700 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1cb1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 -- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 msgr2=0x1c864d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c864d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 -- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 msgr2=0x1cb1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1cb1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 -- 172.21.15.153:0/4030345302 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1c060f0 con 0x1cd25b0 2023-08-17T00:06:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeced9d700 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1cb1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:27.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbece59c700 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccd5d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fbed006a1f0 tx=0x7fbec4017000).ready entity=mon.0 client_cookie=78adfa7e697ae819 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeaffff700 1 -- 172.21.15.153:0/4030345302 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400fd60 con 0x1cd25b0 2023-08-17T00:06:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeaffff700 1 -- 172.21.15.153:0/4030345302 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec400f680 con 0x1cd25b0 2023-08-17T00:06:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.404+0000 7fbeaffff700 1 -- 172.21.15.153:0/4030345302 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4025430 con 0x1cd25b0 2023-08-17T00:06:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4030345302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 msgr2=0x1ccd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccd5d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fbed006a1f0 tx=0x7fbec4017000).stop 2023-08-17T00:06:27.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4030345302 shutdown_connections 2023-08-17T00:06:27.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c864d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccd5d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4030345302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1cb1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4030345302 >> 172.21.15.153:0/4030345302 conn(0x1a6b890 msgr2=0x1c8c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4030345302 shutdown_connections 2023-08-17T00:06:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4030345302 wait complete. 2023-08-17T00:06:27.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 -- start start 2023-08-17T00:06:27.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.408+0000 7fbedf5c2740 1 Processor -- start 2023-08-17T00:06:27.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1cb5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c868f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1cb4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cb6220 con 0x1cd25b0 2023-08-17T00:06:27.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ccc330 con 0x1ccd1f0 2023-08-17T00:06:27.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cb6450 con 0x1c88790 2023-08-17T00:06:27.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 10 client.0 ll_register_callbacks cb 0x1c43910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:27.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1cb4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1cb4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35364/0 (socket says 172.21.15.153:35364) 2023-08-17T00:06:27.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 -- 172.21.15.153:0/446961215 learned_addr learned my addr 172.21.15.153:0/446961215 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbece59c700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c868f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbeced9d700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1cb5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 -- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 msgr2=0x1cb5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1cb5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 -- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 msgr2=0x1c868f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c868f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 -- 172.21.15.153:0/446961215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed00c60a0 con 0x1cd25b0 2023-08-17T00:06:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbeced9d700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1cb5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbecf59e700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1cb4810 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fbec804b490 tx=0x7fbec804e040).ready entity=mon.0 client_cookie=8c5ce9189e25461a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 1 -- 172.21.15.153:0/446961215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec801a510 con 0x1cd25b0 2023-08-17T00:06:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 1 -- 172.21.15.153:0/446961215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbec804aa50 con 0x1cd25b0 2023-08-17T00:06:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1c02dd0 con 0x1cd25b0 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 1 -- 172.21.15.153:0/446961215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec804ac10 con 0x1cd25b0 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 10 client.5847 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x1c01590 con 0x1cd25b0 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 1 -- 172.21.15.153:0/446961215 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1c02dd0 con 0x1cd25b0 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 1 -- 172.21.15.153:0/446961215 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbec8007690 con 0x1cd25b0 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 10 client.5847 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 10 client.5847 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 20 client.5847 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c89fa0 0x1c8a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 4 client.5847 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bf9320 con 0x1c89fa0 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbeced9d700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c89fa0 0x1c8a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbeced9d700 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c89fa0 0x1c8a3b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c69048d8baff343f server_cookie=5af9aeb610950686 in_seq=0 out_seq=0 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.412+0000 7fbead7fa700 10 client.5847 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbead7fa700 1 -- 172.21.15.153:0/446961215 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1bf9320 con 0x1c89fa0 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbead7fa700 10 client.5847 handle_command_reply: tid=0 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 client.5847 shutdown 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 msgr2=0x1cb4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1cb4810 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fbec804b490 tx=0x7fbec804e040).stop 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 shutdown_connections 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c89fa0 0x1c8a3b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1cb4810 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c868f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/446961215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1cb5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 >> 172.21.15.153:0/446961215 conn(0x1a6b890 msgr2=0x1cb0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbead7fa700 0 client.5847 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 shutdown_connections 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 1 -- 172.21.15.153:0/446961215 wait complete. 2023-08-17T00:06:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.416+0000 7fbedf5c2740 20 client.5847 trim_cache size 0 max 16384 2023-08-17T00:06:27.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 Processor -- start 2023-08-17T00:06:27.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 -- start start 2023-08-17T00:06:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 0x1c8a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ccd1f0 0x1ccd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cd25b0 0x1c871a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ccf1a0 con 0x1ccd1f0 2023-08-17T00:06:27.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c4f750 con 0x1c88790 2023-08-17T00:06:27.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1cca720 con 0x1cd25b0 2023-08-17T00:06:27.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbece59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ccd1f0 0x1ccd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 0x1c8a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cd25b0 0x1c871a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 0x1c8a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:47982/0 (socket says 172.21.15.153:47982) 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 -- 172.21.15.153:0/623380161 learned_addr learned my addr 172.21.15.153:0/623380161 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 -- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cd25b0 msgr2=0x1c871a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cd25b0 0x1c871a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 -- 172.21.15.153:0/623380161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ccd1f0 msgr2=0x1ccd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ccd1f0 0x1ccd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 -- 172.21.15.153:0/623380161 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed0062300 con 0x1c88790 2023-08-17T00:06:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbece59c700 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ccd1f0 0x1ccd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.432+0000 7fbeced9d700 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 0x1c8a3b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fbec00115a0 tx=0x7fbec0025280).ready entity=mon.1 client_cookie=5887f3e5291c5240 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbeb4ff9700 1 -- 172.21.15.153:0/623380161 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0025070 con 0x1c88790 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbeb4ff9700 1 -- 172.21.15.153:0/623380161 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec0020b30 con 0x1c88790 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbeb4ff9700 1 -- 172.21.15.153:0/623380161 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec0020ca0 con 0x1c88790 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 -- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 msgr2=0x1c8a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 0x1c8a3b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fbec00115a0 tx=0x7fbec0025280).stop 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 -- 172.21.15.153:0/623380161 shutdown_connections 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1cd25b0 0x1c871a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ccd1f0 0x1ccd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/623380161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c88790 0x1c8a3b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 -- 172.21.15.153:0/623380161 >> 172.21.15.153:0/623380161 conn(0x1a6b890 msgr2=0x1ce2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 -- 172.21.15.153:0/623380161 shutdown_connections 2023-08-17T00:06:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 -- 172.21.15.153:0/623380161 wait complete. 2023-08-17T00:06:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 -- start start 2023-08-17T00:06:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 Processor -- start 2023-08-17T00:06:27.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c84e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c87280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.436+0000 7fbedf5c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c896c0 con 0x1cd25b0 2023-08-17T00:06:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cdd3f0 con 0x1ccd1f0 2023-08-17T00:06:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c85850 con 0x1c88790 2023-08-17T00:06:27.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 10 client.0 ll_register_callbacks cb 0x7fbec8001740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:27.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35388/0 (socket says 172.21.15.153:35388) 2023-08-17T00:06:27.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 -- 172.21.15.153:0/4061291110 learned_addr learned my addr 172.21.15.153:0/4061291110 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbece59c700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c87280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 -- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 msgr2=0x1c84e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbeced9d700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c84e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c84e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 -- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 msgr2=0x1c87280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c87280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 -- 172.21.15.153:0/4061291110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1c060f0 con 0x1cd25b0 2023-08-17T00:06:27.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbece59c700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c87280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:27.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbeced9d700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c84e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:27.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbecf59e700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccb3b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fbec80498b0 tx=0x7fbec8054000).ready entity=mon.0 client_cookie=580a3f26b148972e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 1 -- 172.21.15.153:0/4061291110 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec801a510 con 0x1cd25b0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 1 -- 172.21.15.153:0/4061291110 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbec801eca0 con 0x1cd25b0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbec400f680 con 0x1cd25b0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 1 -- 172.21.15.153:0/4061291110 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbec801ee60 con 0x1cd25b0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 10 client.5853 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7fbec0011cd0 con 0x1cd25b0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 1 -- 172.21.15.153:0/4061291110 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec400f680 con 0x1cd25b0 2023-08-17T00:06:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 1 -- 172.21.15.153:0/4061291110 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbec8047560 con 0x1cd25b0 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 10 client.5853 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 20 client.5853 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c87770 0x1ccb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 4 client.5853 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x1ac2820 con 0x1c87770 2023-08-17T00:06:27.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbeced9d700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c87770 0x1ccb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbeced9d700 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c87770 0x1ccb8a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=107eca14a60f39ff server_cookie=494e88d160b812da in_seq=0 out_seq=0 2023-08-17T00:06:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 10 client.5853 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 1 -- 172.21.15.153:0/4061291110 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x1ac2820 con 0x1c87770 2023-08-17T00:06:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbead7fa700 10 client.5853 handle_command_reply: tid=0 2023-08-17T00:06:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.440+0000 7fbedf5c2740 1 client.5853 shutdown 2023-08-17T00:06:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 msgr2=0x1ccb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccb3b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7fbec80498b0 tx=0x7fbec8054000).stop 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 shutdown_connections 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x1c87770 0x1ccb8a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1cd25b0 0x1ccb3b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbead7fa700 0 client.5853 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ccd1f0 0x1c87280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 --2- 172.21.15.153:0/4061291110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c88790 0x1c84e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 >> 172.21.15.153:0/4061291110 conn(0x1a6b890 msgr2=0x1ce2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 shutdown_connections 2023-08-17T00:06:27.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 1 -- 172.21.15.153:0/4061291110 wait complete. 2023-08-17T00:06:27.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbedf5c2740 20 client.5853 trim_cache size 0 max 16384 2023-08-17T00:06:27.456 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:27.456 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": -2 2023-08-17T00:06:27.456 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:27.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbebc05a180 msgr2=0x7fbebc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbebc05a180 0x7fbebc05c640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fbec0009b90 tx=0x7fbec0009060).stop 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 msgr2=0x7fbed00adf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 0x7fbed00adf20 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fbec800c790 tx=0x7fbec80015e0).stop 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 shutdown_connections 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbebc05a180 0x7fbebc05c640 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbed0153ab0 0x7fbed00adf20 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbed00c59e0 0x7fbed00ada30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 --2- 172.21.15.153:0/3222043299 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbed00c07c0 0x7fbed0143820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 >> 172.21.15.153:0/3222043299 conn(0x7fbed00caaa0 msgr2=0x7fbed0155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 shutdown_connections 2023-08-17T00:06:27.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.444+0000 7fbed521b700 1 -- 172.21.15.153:0/3222043299 wait complete. 2023-08-17T00:06:27.467 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2023-08-17T00:06:27.468 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2023-08-17T00:06:27.468 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2023-08-17T00:06:27.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0452907700 1 Processor -- start 2023-08-17T00:06:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0452907700 1 -- start start 2023-08-17T00:06:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0452907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f044c0a8df0 0x7f044c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0452907700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c1585a0 con 0x7f044c068820 2023-08-17T00:06:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0452907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f044c066400 con 0x7f044c0aa6e0 2023-08-17T00:06:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0452907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044c062dc0 con 0x7f044c0a8df0 2023-08-17T00:06:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0451104700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f044c068820 0x7f044c061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40932/0 (socket says 172.21.15.153:40932) 2023-08-17T00:06:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.608+0000 7f0451104700 1 -- 172.21.15.153:0/3449156173 learned_addr learned my addr 172.21.15.153:0/3449156173 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:27.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451905700 1 --2- 172.21.15.153:0/3449156173 >> v2:172.21.15.178:3300/0 conn(0x7f044c0a8df0 0x7f044c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063590832 0 0) 0x7f044c1585a0 con 0x7f044c068820 2023-08-17T00:06:27.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04380033f0 con 0x7f044c068820 2023-08-17T00:06:27.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176417685 0 0) 0x7f04380033f0 con 0x7f044c068820 2023-08-17T00:06:27.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 >> v2:172.21.15.178:3300/0 conn(0x7f044c0a8df0 msgr2=0x7f044c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 --2- 172.21.15.153:0/3449156173 >> v2:172.21.15.178:3300/0 conn(0x7f044c0a8df0 0x7f044c0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 >> v1:172.21.15.178:6789/0 conn(0x7f044c0aa6e0 legacy=0x7f044c0626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c0b9d30 con 0x7f044c068820 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f043c001470 con 0x7f044c068820 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 >> v1:172.21.15.153:6789/0 conn(0x7f044c068820 legacy=0x7f044c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04380038e0 0x7f0438003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f0438004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0438005050 0x7f043800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c062dc0 con 0x7f04380038e0 2023-08-17T00:06:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043800bfc0 con 0x7f0438004690 2023-08-17T00:06:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043800c180 con 0x7f0438005050 2023-08-17T00:06:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f0438004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451905700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04380038e0 0x7f0438003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452106700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0438005050 0x7f043800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 -- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0438005050 msgr2=0x7f043800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0438005050 0x7f043800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 -- 172.21.15.153:0/3449156173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04380038e0 msgr2=0x7f0438003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04380038e0 0x7f0438003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 -- 172.21.15.153:0/3449156173 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380033f0 con 0x7f0438004690 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452106700 1 -- 172.21.15.153:0/3449156173 reap_dead start 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0451104700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f0438004b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f043c00c160 tx=0x7f043c001e70).ready entity=mon.1 client_cookie=3c24432570d85a54 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c007a40 con 0x7f0438004690 2023-08-17T00:06:27.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c00ca90 con 0x7f0438004690 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0450903700 1 -- 172.21.15.153:0/3449156173 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c00ce30 con 0x7f0438004690 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 -- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 msgr2=0x7f0438004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f0438004b10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f043c00c160 tx=0x7f043c001e70).stop 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 -- 172.21.15.153:0/3449156173 shutdown_connections 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 --2- 172.21.15.153:0/3449156173 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f0438004b10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 -- 172.21.15.153:0/3449156173 >> 172.21.15.153:0/3449156173 conn(0x7f044c0c6620 msgr2=0x7f044c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 -- 172.21.15.153:0/3449156173 shutdown_connections 2023-08-17T00:06:27.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.612+0000 7f0452907700 1 -- 172.21.15.153:0/3449156173 wait complete. 2023-08-17T00:06:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 Processor -- start 2023-08-17T00:06:27.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 -- start start 2023-08-17T00:06:27.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f044c168390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 0x7f044c0ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f044c0baeb0 0x7f044c0bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0bb460 con 0x7f044c16b130 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c158530 con 0x7f0438004690 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c158810 con 0x7f044c0baeb0 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 0x7f044c0ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 0x7f044c0ba9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35412/0 (socket says 172.21.15.153:35412) 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 -- 172.21.15.153:0/2246812898 learned_addr learned my addr 172.21.15.153:0/2246812898 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451905700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f044c168390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0452106700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f044c0baeb0 0x7f044c0bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 -- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f044c0baeb0 msgr2=0x7f044c0bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f044c0baeb0 0x7f044c0bbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 -- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 msgr2=0x7f044c168390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f044c168390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451104700 1 -- 172.21.15.153:0/2246812898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c158af0 con 0x7f044c16b130 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.616+0000 7f0451905700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f044c168390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0451104700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 0x7f044c0ba9c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f043800c150 tx=0x7f043c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0441ffb700 1 -- 172.21.15.153:0/2246812898 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0075c0 con 0x7f044c16b130 2023-08-17T00:06:27.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0441ffb700 1 -- 172.21.15.153:0/2246812898 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c018070 con 0x7f044c16b130 2023-08-17T00:06:27.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c168880 con 0x7f044c16b130 2023-08-17T00:06:27.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0441ffb700 1 -- 172.21.15.153:0/2246812898 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c004900 con 0x7f044c16b130 2023-08-17T00:06:27.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c16b5b0 con 0x7f044c16b130 2023-08-17T00:06:27.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.620+0000 7f0441ffb700 1 -- 172.21.15.153:0/2246812898 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f043c01d070 con 0x7f044c16b130 2023-08-17T00:06:27.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.624+0000 7f0441ffb700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f043005a150 0x7f043005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.624+0000 7f0441ffb700 1 -- 172.21.15.153:0/2246812898 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f043c074a40 con 0x7f044c16b130 2023-08-17T00:06:27.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.624+0000 7f0451905700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f043005a150 0x7f043005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.624+0000 7f0451905700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f043005a150 0x7f043005c610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f044c05d580 tx=0x7f0448008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.624+0000 7f045df07740 1 Processor -- start 2023-08-17T00:06:27.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.624+0000 7f045df07740 1 -- start start 2023-08-17T00:06:27.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x1667ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16a9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x159ed70 con 0x16a8fa0 2023-08-17T00:06:27.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x168ded0 con 0x168e160 2023-08-17T00:06:27.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1666ac0 con 0x16ab5e0 2023-08-17T00:06:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16a9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35418/0 (socket says 172.21.15.153:35418) 2023-08-17T00:06:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 -- 172.21.15.153:0/492514791 learned_addr learned my addr 172.21.15.153:0/492514791 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0451104700 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0451905700 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x1667ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 -- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 msgr2=0x1667ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x1667ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 -- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 msgr2=0x16ab9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16ab9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 -- 172.21.15.153:0/492514791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x15e2120 con 0x16a8fa0 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0452106700 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16a9420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f044c069400 tx=0x7f0444009040).ready entity=mon.0 client_cookie=6967073c307d7fb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0436ffd700 1 -- 172.21.15.153:0/492514791 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444003030 con 0x16a8fa0 2023-08-17T00:06:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0436ffd700 1 -- 172.21.15.153:0/492514791 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444003190 con 0x16a8fa0 2023-08-17T00:06:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f0436ffd700 1 -- 172.21.15.153:0/492514791 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444002680 con 0x16a8fa0 2023-08-17T00:06:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- 172.21.15.153:0/492514791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 msgr2=0x16a9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16a9420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f044c069400 tx=0x7f0444009040).stop 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- 172.21.15.153:0/492514791 shutdown_connections 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16a9420 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16ab9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 --2- 172.21.15.153:0/492514791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x1667ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- 172.21.15.153:0/492514791 >> 172.21.15.153:0/492514791 conn(0x1447930 msgr2=0x1668370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- 172.21.15.153:0/492514791 shutdown_connections 2023-08-17T00:06:27.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- 172.21.15.153:0/492514791 wait complete. 2023-08-17T00:06:27.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 -- start start 2023-08-17T00:06:27.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.628+0000 7f045df07740 1 Processor -- start 2023-08-17T00:06:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x168e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x168ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16ae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x168ef20 con 0x16a8fa0 2023-08-17T00:06:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a88a0 con 0x168e160 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16a6270 con 0x16ab5e0 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 10 client.0 ll_register_callbacks cb 0x161f880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x168ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x168ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35420/0 (socket says 172.21.15.153:35420) 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 -- 172.21.15.153:0/1634020182 learned_addr learned my addr 172.21.15.153:0/1634020182 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451905700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x168e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0452106700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16ae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 -- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 msgr2=0x16ae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16ae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 -- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 msgr2=0x168e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x168e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 -- 172.21.15.153:0/1634020182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044400f040 con 0x16a8fa0 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451905700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x168e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0452106700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451104700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x168ea30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f043c0485a0 tx=0x7f043c001a90).ready entity=mon.0 client_cookie=b1abcc5ac53e66be server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f042bfff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f042bfff700 1 -- 172.21.15.153:0/1634020182 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c04b590 con 0x16a8fa0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x15dee00 con 0x16a8fa0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f042bfff700 1 -- 172.21.15.153:0/1634020182 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f043c04b6f0 con 0x16a8fa0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f042bfff700 1 -- 172.21.15.153:0/1634020182 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f043c0480a0 con 0x16a8fa0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 10 client.5865 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x15dd5c0 con 0x16a8fa0 2023-08-17T00:06:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f042bfff700 1 -- 172.21.15.153:0/1634020182 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x15dee00 con 0x16a8fa0 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f042bfff700 1 -- 172.21.15.153:0/1634020182 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f043c04b000 con 0x16a8fa0 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 10 client.5865 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 10 client.5865 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 20 client.5865 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x16bdfc0 0x16be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 4 client.5865 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x15d5350 con 0x16bdfc0 2023-08-17T00:06:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.632+0000 7f0451905700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x16bdfc0 0x16be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f0451905700 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x16bdfc0 0x16be3a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=de23f83a1e6f24c3 server_cookie=fe14ad24869790cf in_seq=0 out_seq=0 2023-08-17T00:06:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f042bfff700 10 client.5865 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f042bfff700 1 -- 172.21.15.153:0/1634020182 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x15d5350 con 0x16bdfc0 2023-08-17T00:06:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f042bfff700 10 client.5865 handle_command_reply: tid=0 2023-08-17T00:06:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 client.5865 shutdown 2023-08-17T00:06:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 msgr2=0x168ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x168ea30 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f043c0485a0 tx=0x7f043c001a90).stop 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 shutdown_connections 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x16bdfc0 0x16be3a0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16ae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x168ea30 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 --2- 172.21.15.153:0/1634020182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x168e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 >> 172.21.15.153:0/1634020182 conn(0x1447930 msgr2=0x16a9380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f042bfff700 0 client.5865 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 shutdown_connections 2023-08-17T00:06:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 1 -- 172.21.15.153:0/1634020182 wait complete. 2023-08-17T00:06:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.636+0000 7f045df07740 20 client.5865 trim_cache size 0 max 16384 2023-08-17T00:06:27.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 Processor -- start 2023-08-17T00:06:27.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 -- start start 2023-08-17T00:06:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16c4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x16ae380 con 0x16a8fa0 2023-08-17T00:06:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16c4af0 con 0x168e160 2023-08-17T00:06:27.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15dd5c0 con 0x16ab5e0 2023-08-17T00:06:27.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f0451104700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f0451104700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35424/0 (socket says 172.21.15.153:35424) 2023-08-17T00:06:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f0451104700 1 -- 172.21.15.153:0/2593689793 learned_addr learned my addr 172.21.15.153:0/2593689793 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f0452106700 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.652+0000 7f0451905700 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f0451104700 1 -- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 msgr2=0x16a88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f0451104700 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16a88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f0451104700 1 -- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 msgr2=0x16a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f0451104700 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f0451104700 1 -- 172.21.15.153:0/2593689793 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c0bc430 con 0x16a8fa0 2023-08-17T00:06:27.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f0451104700 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16c4600 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f043c04bda0 tx=0x7f043c02e000).ready entity=mon.0 client_cookie=2f61a8a7ab892ad1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f04377fe700 1 -- 172.21.15.153:0/2593689793 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c04ba00 con 0x16a8fa0 2023-08-17T00:06:27.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f04377fe700 1 -- 172.21.15.153:0/2593689793 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c0073b0 con 0x16a8fa0 2023-08-17T00:06:27.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f04377fe700 1 -- 172.21.15.153:0/2593689793 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0480a0 con 0x16a8fa0 2023-08-17T00:06:27.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 -- 172.21.15.153:0/2593689793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 msgr2=0x16c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16c4600 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f043c04bda0 tx=0x7f043c02e000).stop 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 -- 172.21.15.153:0/2593689793 shutdown_connections 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16ab5e0 0x16a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16a8fa0 0x16c4600 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 --2- 172.21.15.153:0/2593689793 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168e160 0x16a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 -- 172.21.15.153:0/2593689793 >> 172.21.15.153:0/2593689793 conn(0x1447930 msgr2=0x168f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 -- 172.21.15.153:0/2593689793 shutdown_connections 2023-08-17T00:06:27.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 -- 172.21.15.153:0/2593689793 wait complete. 2023-08-17T00:06:27.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.656+0000 7f045df07740 1 -- start start 2023-08-17T00:06:27.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 Processor -- start 2023-08-17T00:06:27.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 0x167c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ab5e0 0x17061b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16bc8d0 0x170f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1710370 con 0x168e160 2023-08-17T00:06:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16a98d0 con 0x16ab5e0 2023-08-17T00:06:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16bc440 con 0x16bc8d0 2023-08-17T00:06:27.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f045df07740 10 client.0 ll_register_callbacks cb 0x7f043c0484b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 0x167c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 0x167c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35440/0 (socket says 172.21.15.153:35440) 2023-08-17T00:06:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 -- 172.21.15.153:0/2710145241 learned_addr learned my addr 172.21.15.153:0/2710145241 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451104700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ab5e0 0x17061b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0452106700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16bc8d0 0x170f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 -- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16bc8d0 msgr2=0x170f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16bc8d0 0x170f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 -- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ab5e0 msgr2=0x17061b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ab5e0 0x17061b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 -- 172.21.15.153:0/2710145241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044400f040 con 0x168e160 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0452106700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16bc8d0 0x170f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f0451905700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 0x167c680 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0448006fd0 tx=0x7f0448017000).ready entity=mon.0 client_cookie=ce2a5632c25c260f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.660+0000 7f042bfff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 1 -- 172.21.15.153:0/2710145241 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0448028070 con 0x168e160 2023-08-17T00:06:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0444003190 con 0x168e160 2023-08-17T00:06:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 1 -- 172.21.15.153:0/2710145241 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f044802b440 con 0x168e160 2023-08-17T00:06:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 1 -- 172.21.15.153:0/2710145241 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f044802b810 con 0x168e160 2023-08-17T00:06:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 10 client.5871 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x15dd310 con 0x168e160 2023-08-17T00:06:27.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 1 -- 172.21.15.153:0/2710145241 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0444003190 con 0x168e160 2023-08-17T00:06:27.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 1 -- 172.21.15.153:0/2710145241 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f044802b970 con 0x168e160 2023-08-17T00:06:27.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 10 client.5871 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:27.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 10 client.5871 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:27.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 20 client.5871 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x170fd20 0x168ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 4 client.5871 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x149e8c0 con 0x170fd20 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f0451104700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x170fd20 0x168ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 10 client.5871 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f0451104700 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x170fd20 0x168ac20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2b59e8ec8a2f09a1 server_cookie=8ce11b2069f5d4f2 in_seq=0 out_seq=0 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 1 -- 172.21.15.153:0/2710145241 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x149e8c0 con 0x170fd20 2023-08-17T00:06:27.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 10 client.5871 handle_command_reply: tid=0 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 client.5871 shutdown 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 msgr2=0x167c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 0x167c680 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f0448006fd0 tx=0x7f0448017000).stop 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 shutdown_connections 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x170fd20 0x168ac20 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16bc8d0 0x170f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f042bfff700 0 client.5871 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16ab5e0 0x17061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 --2- 172.21.15.153:0/2710145241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168e160 0x167c680 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.664+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 >> 172.21.15.153:0/2710145241 conn(0x1447930 msgr2=0x168e540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 shutdown_connections 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f045df07740 1 -- 172.21.15.153:0/2710145241 wait complete. 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f045df07740 20 client.5871 trim_cache size 0 max 16384 2023-08-17T00:06:27.675 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "dfa573dd-35aa-4a24-ab71-01d8cf10f08b", 2023-08-17T00:06:27.676 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:27.676 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f043005a150 msgr2=0x7f043005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f043005a150 0x7f043005c610 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f044c05d580 tx=0x7f0448008040).stop 2023-08-17T00:06:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 msgr2=0x7f044c0ba9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 0x7f044c0ba9c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f043800c150 tx=0x7f043c015000).stop 2023-08-17T00:06:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 shutdown_connections 2023-08-17T00:06:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f043005a150 0x7f043005c610 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f044c0baeb0 0x7f044c0bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f044c16b130 0x7f044c0ba9c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 --2- 172.21.15.153:0/2246812898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0438004690 0x7f044c168390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 >> 172.21.15.153:0/2246812898 conn(0x7f044c0c6620 msgr2=0x7f044c157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 shutdown_connections 2023-08-17T00:06:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.668+0000 7f0452907700 1 -- 172.21.15.153:0/2246812898 wait complete. 2023-08-17T00:06:27.692 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'dfa573dd-35aa-4a24-ab71-01d8cf10f08b', 'mode': 'asynchronous'}' 2023-08-17T00:06:27.692 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2023-08-17T00:06:27.692 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-08-17T00:06:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.840+0000 7f90c27b9700 1 Processor -- start 2023-08-17T00:06:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.840+0000 7f90c27b9700 1 -- start start 2023-08-17T00:06:27.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90bc0c57a0 0x7f90bc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc153f50 0x7f90bc154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90bc0bfd10 con 0x7f90bc157600 2023-08-17T00:06:27.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90bc154860 con 0x7f90bc0c57a0 2023-08-17T00:06:27.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc154af0 con 0x7f90bc153f50 2023-08-17T00:06:27.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c1fb8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f90bc157600 0x7f90bc157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40948/0 (socket says 172.21.15.153:40948) 2023-08-17T00:06:27.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c1fb8700 1 -- 172.21.15.153:0/1563669229 learned_addr learned my addr 172.21.15.153:0/1563669229 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:27.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c17b7700 1 --2- 172.21.15.153:0/1563669229 >> v2:172.21.15.178:3300/0 conn(0x7f90bc0c57a0 0x7f90bc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/1563669229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc153f50 0x7f90bc154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90b3fff700 1 -- 172.21.15.153:0/1563669229 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674950959 0 0) 0x7f90bc0bfd10 con 0x7f90bc157600 2023-08-17T00:06:27.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90b3fff700 1 -- 172.21.15.153:0/1563669229 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90a80033f0 con 0x7f90bc157600 2023-08-17T00:06:27.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c0fb6700 1 -- 172.21.15.153:0/1563669229 >> v2:172.21.15.178:3300/0 conn(0x7f90bc0c57a0 msgr2=0x7f90bc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/1563669229 >> v2:172.21.15.178:3300/0 conn(0x7f90bc0c57a0 0x7f90bc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c0fb6700 1 -- 172.21.15.153:0/1563669229 >> v1:172.21.15.153:6789/0 conn(0x7f90bc157600 legacy=0x7f90bc157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c0fb6700 1 -- 172.21.15.153:0/1563669229 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc154dd0 con 0x7f90bc153f50 2023-08-17T00:06:27.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/1563669229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc153f50 0x7f90bc154370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f90ac009760 tx=0x7f90ac009060).ready entity=mon.2 client_cookie=bb781038a104a8f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90b3fff700 1 -- 172.21.15.153:0/1563669229 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00d4a0 con 0x7f90bc153f50 2023-08-17T00:06:27.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90b3fff700 1 -- 172.21.15.153:0/1563669229 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac00d600 con 0x7f90bc153f50 2023-08-17T00:06:27.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90b3fff700 1 -- 172.21.15.153:0/1563669229 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00d980 con 0x7f90bc153f50 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- 172.21.15.153:0/1563669229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc153f50 msgr2=0x7f90bc154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 --2- 172.21.15.153:0/1563669229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc153f50 0x7f90bc154370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f90ac009760 tx=0x7f90ac009060).stop 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- 172.21.15.153:0/1563669229 shutdown_connections 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 --2- 172.21.15.153:0/1563669229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc153f50 0x7f90bc154370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 --2- 172.21.15.153:0/1563669229 >> v2:172.21.15.178:3300/0 conn(0x7f90bc0c57a0 0x7f90bc0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- 172.21.15.153:0/1563669229 >> 172.21.15.153:0/1563669229 conn(0x7f90bc062a70 msgr2=0x7f90bc0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- 172.21.15.153:0/1563669229 shutdown_connections 2023-08-17T00:06:27.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.844+0000 7f90c27b9700 1 -- 172.21.15.153:0/1563669229 wait complete. 2023-08-17T00:06:27.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 Processor -- start 2023-08-17T00:06:27.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 -- start start 2023-08-17T00:06:27.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc0c57a0 0x7f90bc14c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 0x7f90bc0afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90bc157600 0x7f90bc0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0b08a0 con 0x7f90bc153f50 2023-08-17T00:06:27.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0adf70 con 0x7f90bc157600 2023-08-17T00:06:27.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.848+0000 7f90c27b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc0ad960 con 0x7f90bc0c57a0 2023-08-17T00:06:27.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 0x7f90bc0afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 0x7f90bc0afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35452/0 (socket says 172.21.15.153:35452) 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 -- 172.21.15.153:0/683304029 learned_addr learned my addr 172.21.15.153:0/683304029 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c17b7700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc0c57a0 0x7f90bc14c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90bc157600 0x7f90bc0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 -- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc0c57a0 msgr2=0x7f90bc14c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc0c57a0 0x7f90bc14c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 -- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90bc157600 msgr2=0x7f90bc0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90bc157600 0x7f90bc0b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 -- 172.21.15.153:0/683304029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0092a0 con 0x7f90bc153f50 2023-08-17T00:06:27.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90bc157600 0x7f90bc0b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:27.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 0x7f90bc0afec0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f90ac009d50 tx=0x7f90ac016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90b17fa700 1 -- 172.21.15.153:0/683304029 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac021070 con 0x7f90bc153f50 2023-08-17T00:06:27.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90b17fa700 1 -- 172.21.15.153:0/683304029 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ac000d00 con 0x7f90bc153f50 2023-08-17T00:06:27.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc0c3fb0 con 0x7f90bc153f50 2023-08-17T00:06:27.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90b17fa700 1 -- 172.21.15.153:0/683304029 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac00d980 con 0x7f90bc153f50 2023-08-17T00:06:27.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.852+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc0c4290 con 0x7f90bc153f50 2023-08-17T00:06:27.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.856+0000 7f90b17fa700 1 -- 172.21.15.153:0/683304029 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f90ac00f070 con 0x7f90bc153f50 2023-08-17T00:06:27.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.856+0000 7f90b17fa700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f90a005a150 0x7f90a005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.856+0000 7f90b17fa700 1 -- 172.21.15.153:0/683304029 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f90ac0755e0 con 0x7f90bc153f50 2023-08-17T00:06:27.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.856+0000 7f90c17b7700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f90a005a150 0x7f90a005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f90a005a150 0x7f90a005c610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f90b8009fd0 tx=0x7f90b800b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 Processor -- start 2023-08-17T00:06:27.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 -- start start 2023-08-17T00:06:27.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x201bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2020b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa2320 con 0x20648f0 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f68760 con 0x201db10 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2046dd0 con 0x20205e0 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2064cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35468/0 (socket says 172.21.15.153:35468) 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 -- 172.21.15.153:0/3421814954 learned_addr learned my addr 172.21.15.153:0/3421814954 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2020b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x201bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 -- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 msgr2=0x2020b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2020b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 -- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 msgr2=0x201bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x201bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 -- 172.21.15.153:0/3421814954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f9b260 con 0x20648f0 2023-08-17T00:06:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.860+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2064cd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f90b8009b50 tx=0x7f90b8017000).ready entity=mon.0 client_cookie=e3b937109abb17fe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90a67fc700 1 -- 172.21.15.153:0/3421814954 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8023070 con 0x20648f0 2023-08-17T00:06:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90a67fc700 1 -- 172.21.15.153:0/3421814954 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800f040 con 0x20648f0 2023-08-17T00:06:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90a67fc700 1 -- 172.21.15.153:0/3421814954 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b800e040 con 0x20648f0 2023-08-17T00:06:27.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 -- 172.21.15.153:0/3421814954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 msgr2=0x2064cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2064cd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f90b8009b50 tx=0x7f90b8017000).stop 2023-08-17T00:06:27.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 -- 172.21.15.153:0/3421814954 shutdown_connections 2023-08-17T00:06:27.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2020b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x201bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3421814954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2064cd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 -- 172.21.15.153:0/3421814954 >> 172.21.15.153:0/3421814954 conn(0x1e00ad0 msgr2=0x2021660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 -- 172.21.15.153:0/3421814954 shutdown_connections 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 -- 172.21.15.153:0/3421814954 wait complete. 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 -- start start 2023-08-17T00:06:27.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.864+0000 7f90cdd92740 1 Processor -- start 2023-08-17T00:06:27.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x2060ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 0x20461d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20648f0 0x20466c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x201ba50 con 0x20205e0 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x205fbd0 con 0x20648f0 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2047a00 con 0x201db10 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 10 client.0 ll_register_callbacks cb 0x1fd8950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 0x20461d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 0x20461d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35472/0 (socket says 172.21.15.153:35472) 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 -- 172.21.15.153:0/3167265584 learned_addr learned my addr 172.21.15.153:0/3167265584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x2060ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20648f0 0x20466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 -- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 msgr2=0x2060ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x2060ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 -- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20648f0 msgr2=0x20466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20648f0 0x20466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 -- 172.21.15.153:0/3167265584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b8015410 con 0x20205e0 2023-08-17T00:06:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20648f0 0x20466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 0x20461d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f90ac04c940 tx=0x7f90ac075040).ready entity=mon.0 client_cookie=babde92fa93bc49e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f909b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f909b7fe700 1 -- 172.21.15.153:0/3167265584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ac04b0b0 con 0x20205e0 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f909b7fe700 1 -- 172.21.15.153:0/3167265584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f90ac052250 con 0x20205e0 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f97f40 con 0x20205e0 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f909b7fe700 1 -- 172.21.15.153:0/3167265584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90ac04c130 con 0x20205e0 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 10 client.5883 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x1f96700 con 0x20205e0 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f909b7fe700 1 -- 172.21.15.153:0/3167265584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f97f40 con 0x20205e0 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.868+0000 7f909b7fe700 1 -- 172.21.15.153:0/3167265584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f90ac0750b0 con 0x20205e0 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 10 client.5883 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 10 client.5883 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 20 client.5883 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2048530 0x2048940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 4 client.5883 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:27.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f8e490 con 0x2048530 2023-08-17T00:06:27.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2048530 0x2048940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f909b7fe700 10 client.5883 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2048530 0x2048940 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c5fc7b206e009478 server_cookie=ba3b2dec1d9e1815 in_seq=0 out_seq=0 2023-08-17T00:06:27.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f909b7fe700 1 -- 172.21.15.153:0/3167265584 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1f8e490 con 0x2048530 2023-08-17T00:06:27.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f909b7fe700 10 client.5883 handle_command_reply: tid=0 2023-08-17T00:06:27.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 client.5883 shutdown 2023-08-17T00:06:27.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 msgr2=0x20461d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 0x20461d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f90ac04c940 tx=0x7f90ac075040).stop 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 shutdown_connections 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2048530 0x2048940 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20648f0 0x20466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f909b7fe700 0 client.5883 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20205e0 0x20461d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3167265584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x2060ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 >> 172.21.15.153:0/3167265584 conn(0x1e00ad0 msgr2=0x2066f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 shutdown_connections 2023-08-17T00:06:27.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.872+0000 7f90cdd92740 1 -- 172.21.15.153:0/3167265584 wait complete. 2023-08-17T00:06:27.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.876+0000 7f90cdd92740 20 client.5883 trim_cache size 0 max 16384 2023-08-17T00:06:27.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 Processor -- start 2023-08-17T00:06:27.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 -- start start 2023-08-17T00:06:27.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x20686f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2017170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2060480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f97f40 con 0x20648f0 2023-08-17T00:06:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x204b530 con 0x201db10 2023-08-17T00:06:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2068be0 con 0x20205e0 2023-08-17T00:06:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90c1fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2060480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.892+0000 7f90c1fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2060480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35480/0 (socket says 172.21.15.153:35480) 2023-08-17T00:06:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3884248408 learned_addr learned my addr 172.21.15.153:0/3884248408 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x20686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2017170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 msgr2=0x2017170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2017170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 msgr2=0x20686f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x20686f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3884248408 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc0ab570 con 0x20648f0 2023-08-17T00:06:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x20686f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:27.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2060480 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f90b40073f0 tx=0x7f90b4009040).ready entity=mon.0 client_cookie=f9eee1827c76c9ba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90a6ffd700 1 -- 172.21.15.153:0/3884248408 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4016430 con 0x20648f0 2023-08-17T00:06:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90a6ffd700 1 -- 172.21.15.153:0/3884248408 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4016590 con 0x20648f0 2023-08-17T00:06:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90a6ffd700 1 -- 172.21.15.153:0/3884248408 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4016910 con 0x20648f0 2023-08-17T00:06:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 -- 172.21.15.153:0/3884248408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 msgr2=0x2060480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2060480 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f90b40073f0 tx=0x7f90b4009040).stop 2023-08-17T00:06:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 -- 172.21.15.153:0/3884248408 shutdown_connections 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x2060480 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20205e0 0x2017170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3884248408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x201db10 0x20686f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 -- 172.21.15.153:0/3884248408 >> 172.21.15.153:0/3884248408 conn(0x1e00ad0 msgr2=0x2067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 -- 172.21.15.153:0/3884248408 shutdown_connections 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 -- 172.21.15.153:0/3884248408 wait complete. 2023-08-17T00:06:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.896+0000 7f90cdd92740 1 -- start start 2023-08-17T00:06:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 Processor -- start 2023-08-17T00:06:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x20452c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20205e0 0x20457b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x20c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2045ca0 con 0x20648f0 2023-08-17T00:06:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20cad30 con 0x20205e0 2023-08-17T00:06:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2062a90 con 0x201db10 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 10 client.0 ll_register_callbacks cb 0x7f90ac00df00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x20c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x20c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35488/0 (socket says 172.21.15.153:35488) 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3222785276 learned_addr learned my addr 172.21.15.153:0/3222785276 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x20452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c0fb6700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20205e0 0x20457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 msgr2=0x20452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x20452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20205e0 msgr2=0x20457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20205e0 0x20457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 -- 172.21.15.153:0/3222785276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1f9b260 con 0x20648f0 2023-08-17T00:06:27.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90c1fb8700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x20c9ee0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x1f98080 tx=0x7f90b401a000).ready entity=mon.0 client_cookie=394545598083966a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:27.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f909b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:27.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f909b7fe700 1 -- 172.21.15.153:0/3222785276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4005030 con 0x20648f0 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90b800f040 con 0x20648f0 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.900+0000 7f909b7fe700 1 -- 172.21.15.153:0/3222785276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f90b4005190 con 0x20648f0 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 1 -- 172.21.15.153:0/3222785276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90b4005560 con 0x20648f0 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 10 client.5889 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7f90b400f040 con 0x20648f0 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 1 -- 172.21.15.153:0/3222785276 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b800f040 con 0x20648f0 2023-08-17T00:06:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 1 -- 172.21.15.153:0/3222785276 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f90b40046b0 con 0x20648f0 2023-08-17T00:06:27.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 10 client.5889 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:27.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 10 client.5889 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:27.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 20 client.5889 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:27.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x20732c0 0x20ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:27.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 4 client.5889 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2023-08-17T00:06:27.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x1e57a60 con 0x20732c0 2023-08-17T00:06:27.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x20732c0 0x20ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:27.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 10 client.5889 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90c17b7700 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x20732c0 0x20ca3d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=aee0879a724e02bb server_cookie=32aaa56777f87db0 in_seq=0 out_seq=0 2023-08-17T00:06:27.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 1 -- 172.21.15.153:0/3222785276 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1e57a60 con 0x20732c0 2023-08-17T00:06:27.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 10 client.5889 handle_command_reply: tid=0 2023-08-17T00:06:27.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 client.5889 shutdown 2023-08-17T00:06:27.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 msgr2=0x20c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x20c9ee0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x1f98080 tx=0x7f90b401a000).stop 2023-08-17T00:06:27.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 shutdown_connections 2023-08-17T00:06:27.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x20732c0 0x20ca3d0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20648f0 0x20c9ee0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f909b7fe700 0 client.5889 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20205e0 0x20457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 --2- 172.21.15.153:0/3222785276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x201db10 0x20452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 >> 172.21.15.153:0/3222785276 conn(0x1e00ad0 msgr2=0x201f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 shutdown_connections 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.904+0000 7f90cdd92740 1 -- 172.21.15.153:0/3222785276 wait complete. 2023-08-17T00:06:27.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90cdd92740 20 client.5889 trim_cache size 0 max 16384 2023-08-17T00:06:27.916 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:27.916 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:27.916 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "62fe0316-9cba-48fa-af05-341b4583fdb2", 2023-08-17T00:06:27.916 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:27.916 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f90a005a150 msgr2=0x7f90a005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f90a005a150 0x7f90a005c610 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f90b8009fd0 tx=0x7f90b800b040).stop 2023-08-17T00:06:27.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 msgr2=0x7f90bc0afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 0x7f90bc0afec0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f90ac009d50 tx=0x7f90ac016000).stop 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 shutdown_connections 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f90a005a150 0x7f90a005c610 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90bc157600 0x7f90bc0b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90bc153f50 0x7f90bc0afec0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 --2- 172.21.15.153:0/683304029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90bc0c57a0 0x7f90bc14c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 >> 172.21.15.153:0/683304029 conn(0x7f90bc062a70 msgr2=0x7f90bc159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:27.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 shutdown_connections 2023-08-17T00:06:27.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:27.908+0000 7f90c27b9700 1 -- 172.21.15.153:0/683304029 wait complete. 2023-08-17T00:06:27.932 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '62fe0316-9cba-48fa-af05-341b4583fdb2', 'mode': 'asynchronous'}' 2023-08-17T00:06:27.933 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2023-08-17T00:06:27.933 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2023-08-17T00:06:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.088+0000 7f8a37fff700 1 Processor -- start 2023-08-17T00:06:28.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.088+0000 7f8a37fff700 1 -- start start 2023-08-17T00:06:28.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a380acf30 0x7f8a380c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8a38063bc0 0x7f8a380bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a38154e90 con 0x7f8a380c5ea0 2023-08-17T00:06:28.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38153fc0 con 0x7f8a380acf30 2023-08-17T00:06:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38154280 con 0x7f8a38063bc0 2023-08-17T00:06:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a36ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a380acf30 0x7f8a380c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a367fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8a380c5ea0 0x7f8a380634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40962/0 (socket says 172.21.15.153:40962) 2023-08-17T00:06:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a367fc700 1 -- 172.21.15.153:0/2707250364 learned_addr learned my addr 172.21.15.153:0/2707250364 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a377fe700 1 --2- 172.21.15.153:0/2707250364 >> v2:172.21.15.178:3300/0 conn(0x7f8a38063bc0 0x7f8a380bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a35ffb700 1 -- 172.21.15.153:0/2707250364 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206763384 0 0) 0x7f8a38154e90 con 0x7f8a380c5ea0 2023-08-17T00:06:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a35ffb700 1 -- 172.21.15.153:0/2707250364 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a200033f0 con 0x7f8a380c5ea0 2023-08-17T00:06:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a36ffd700 1 -- 172.21.15.153:0/2707250364 >> v2:172.21.15.178:3300/0 conn(0x7f8a38063bc0 msgr2=0x7f8a380bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/2707250364 >> v2:172.21.15.178:3300/0 conn(0x7f8a38063bc0 0x7f8a380bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a36ffd700 1 -- 172.21.15.153:0/2707250364 >> v1:172.21.15.153:6789/0 conn(0x7f8a380c5ea0 legacy=0x7f8a380634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a36ffd700 1 -- 172.21.15.153:0/2707250364 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a38154560 con 0x7f8a380acf30 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a377fe700 1 --2- 172.21.15.153:0/2707250364 >> v2:172.21.15.178:3300/0 conn(0x7f8a38063bc0 0x7f8a380bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/2707250364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a380c1020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f8a3806bf10 tx=0x7f8a28009060).ready entity=mon.0 client_cookie=c2e3929ac9d0c88e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a35ffb700 1 -- 172.21.15.153:0/2707250364 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2800f510 con 0x7f8a380acf30 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a35ffb700 1 -- 172.21.15.153:0/2707250364 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2800f670 con 0x7f8a380acf30 2023-08-17T00:06:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a35ffb700 1 -- 172.21.15.153:0/2707250364 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2800f9f0 con 0x7f8a380acf30 2023-08-17T00:06:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- 172.21.15.153:0/2707250364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 msgr2=0x7f8a380c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 --2- 172.21.15.153:0/2707250364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a380c1020 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f8a3806bf10 tx=0x7f8a28009060).stop 2023-08-17T00:06:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- 172.21.15.153:0/2707250364 shutdown_connections 2023-08-17T00:06:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 --2- 172.21.15.153:0/2707250364 >> v2:172.21.15.178:3300/0 conn(0x7f8a38063bc0 0x7f8a380bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 --2- 172.21.15.153:0/2707250364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a380c1020 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- 172.21.15.153:0/2707250364 >> 172.21.15.153:0/2707250364 conn(0x7f8a380cb330 msgr2=0x7f8a380c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- 172.21.15.153:0/2707250364 shutdown_connections 2023-08-17T00:06:28.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.092+0000 7f8a37fff700 1 -- 172.21.15.153:0/2707250364 wait complete. 2023-08-17T00:06:28.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 Processor -- start 2023-08-17T00:06:28.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 -- start start 2023-08-17T00:06:28.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a38063bc0 0x7f8a380b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a381579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a38157ed0 0x7f8a380c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38158c60 con 0x7f8a380acf30 2023-08-17T00:06:28.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a380c2ee0 con 0x7f8a38063bc0 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a37fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a381583c0 con 0x7f8a38157ed0 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a367fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a381579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a367fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a381579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35504/0 (socket says 172.21.15.153:35504) 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a367fc700 1 -- 172.21.15.153:0/179738309 learned_addr learned my addr 172.21.15.153:0/179738309 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a38063bc0 0x7f8a380b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.096+0000 7f8a377fe700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a38157ed0 0x7f8a380c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a367fc700 1 -- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a38157ed0 msgr2=0x7f8a380c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a367fc700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a38157ed0 0x7f8a380c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a367fc700 1 -- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a38063bc0 msgr2=0x7f8a380b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a367fc700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a38063bc0 0x7f8a380b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a367fc700 1 -- 172.21.15.153:0/179738309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a280092a0 con 0x7f8a380acf30 2023-08-17T00:06:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a367fc700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a381579e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f8a2c00c450 tx=0x7f8a2c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a1effd700 1 -- 172.21.15.153:0/179738309 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0070d0 con 0x7f8a380acf30 2023-08-17T00:06:28.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a1effd700 1 -- 172.21.15.153:0/179738309 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c007230 con 0x7f8a380acf30 2023-08-17T00:06:28.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a1effd700 1 -- 172.21.15.153:0/179738309 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0075b0 con 0x7f8a380acf30 2023-08-17T00:06:28.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a381586a0 con 0x7f8a380acf30 2023-08-17T00:06:28.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a380ad840 con 0x7f8a380acf30 2023-08-17T00:06:28.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.100+0000 7f8a1effd700 1 -- 172.21.15.153:0/179738309 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8a2c010070 con 0x7f8a380acf30 2023-08-17T00:06:28.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.104+0000 7f8a1effd700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2405a150 0x7f8a2405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.104+0000 7f8a1effd700 1 -- 172.21.15.153:0/179738309 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8a2c073730 con 0x7f8a380acf30 2023-08-17T00:06:28.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.104+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2405a150 0x7f8a2405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.104+0000 7f8a47c03740 1 Processor -- start 2023-08-17T00:06:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.104+0000 7f8a47c03740 1 -- start start 2023-08-17T00:06:28.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.104+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2405a150 0x7f8a2405c610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f8a28003080 tx=0x7f8a28017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x183d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 0x1858e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x17641b0 con 0x183db30 2023-08-17T00:06:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x17864a0 con 0x185bcf0 2023-08-17T00:06:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x185c150 con 0x185b420 2023-08-17T00:06:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 0x1858e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 0x1858e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35508/0 (socket says 172.21.15.153:35508) 2023-08-17T00:06:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 -- 172.21.15.153:0/1453893265 learned_addr learned my addr 172.21.15.153:0/1453893265 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a367fc700 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x183d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 -- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 msgr2=0x185b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 -- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 msgr2=0x183d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x183d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 -- 172.21.15.153:0/1453893265 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1792020 con 0x183db30 2023-08-17T00:06:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:28.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a377fe700 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 0x1858e70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f8a30007640 tx=0x7f8a300099b0).ready entity=mon.0 client_cookie=698611559ba177b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a1cff9700 1 -- 172.21.15.153:0/1453893265 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30015440 con 0x183db30 2023-08-17T00:06:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a1cff9700 1 -- 172.21.15.153:0/1453893265 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000f040 con 0x183db30 2023-08-17T00:06:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a1cff9700 1 -- 172.21.15.153:0/1453893265 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300157b0 con 0x183db30 2023-08-17T00:06:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- 172.21.15.153:0/1453893265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 msgr2=0x1858e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 0x1858e70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f8a30007640 tx=0x7f8a300099b0).stop 2023-08-17T00:06:28.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- 172.21.15.153:0/1453893265 shutdown_connections 2023-08-17T00:06:28.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x183db30 0x1858e70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x183d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1453893265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- 172.21.15.153:0/1453893265 >> 172.21.15.153:0/1453893265 conn(0x15f7690 msgr2=0x1818280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- 172.21.15.153:0/1453893265 shutdown_connections 2023-08-17T00:06:28.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.108+0000 7f8a47c03740 1 -- 172.21.15.153:0/1453893265 wait complete. 2023-08-17T00:06:28.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 -- start start 2023-08-17T00:06:28.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 Processor -- start 2023-08-17T00:06:28.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x183db30 0x1873690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x1836720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1873b80 con 0x185bcf0 2023-08-17T00:06:28.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x185d190 con 0x183db30 2023-08-17T00:06:28.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1873d80 con 0x185b420 2023-08-17T00:06:28.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 10 client.0 ll_register_callbacks cb 0x17cf490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:28.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x1836720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x1836720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35522/0 (socket says 172.21.15.153:35522) 2023-08-17T00:06:28.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 -- 172.21.15.153:0/1392163343 learned_addr learned my addr 172.21.15.153:0/1392163343 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x183db30 0x1873690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a367fc700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 -- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 msgr2=0x185cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 -- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x183db30 msgr2=0x1873690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x183db30 0x1873690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 -- 172.21.15.153:0/1392163343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a30007340 con 0x185bcf0 2023-08-17T00:06:28.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a377fe700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x1836720 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f8a30014000 tx=0x7f8a3001a000).ready entity=mon.0 client_cookie=7aad772dba22c361 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a157fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:28.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a157fa700 1 -- 172.21.15.153:0/1392163343 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3001f620 con 0x185bcf0 2023-08-17T00:06:28.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x178ed00 con 0x185bcf0 2023-08-17T00:06:28.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a157fa700 1 -- 172.21.15.153:0/1392163343 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8a3001f780 con 0x185bcf0 2023-08-17T00:06:28.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.112+0000 7f8a157fa700 1 -- 172.21.15.153:0/1392163343 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3001fb90 con 0x185bcf0 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 10 client.5904 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x178d4c0 con 0x185bcf0 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a157fa700 1 -- 172.21.15.153:0/1392163343 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x178ed00 con 0x185bcf0 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a157fa700 1 -- 172.21.15.153:0/1392163343 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a3001fcf0 con 0x185bcf0 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 10 client.5904 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 20 client.5904 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x187d290 0x187f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 4 client.5904 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1785250 con 0x187d290 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x187d290 0x187f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x187d290 0x187f680 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5fee369d20cfcb07 server_cookie=edc49bff56ac9c62 in_seq=0 out_seq=0 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a157fa700 10 client.5904 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a157fa700 1 -- 172.21.15.153:0/1392163343 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1785250 con 0x187d290 2023-08-17T00:06:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a157fa700 10 client.5904 handle_command_reply: tid=0 2023-08-17T00:06:28.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 client.5904 shutdown 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 msgr2=0x1836720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x1836720 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f8a30014000 tx=0x7f8a3001a000).stop 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 shutdown_connections 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x187d290 0x187f680 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x1836720 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x185b420 0x185cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a157fa700 0 client.5904 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:28.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 --2- 172.21.15.153:0/1392163343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x183db30 0x1873690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 >> 172.21.15.153:0/1392163343 conn(0x15f7690 msgr2=0x185e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 shutdown_connections 2023-08-17T00:06:28.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 1 -- 172.21.15.153:0/1392163343 wait complete. 2023-08-17T00:06:28.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.116+0000 7f8a47c03740 20 client.5904 trim_cache size 0 max 16384 2023-08-17T00:06:28.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 Processor -- start 2023-08-17T00:06:28.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 -- start start 2023-08-17T00:06:28.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x183cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 0x183d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x185e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x185b020 con 0x185bcf0 2023-08-17T00:06:28.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x17534f0 con 0x185b420 2023-08-17T00:06:28.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x17db2d0 con 0x183db30 2023-08-17T00:06:28.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 0x183d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 0x183d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:48106/0 (socket says 172.21.15.153:48106) 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a36ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x183cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 -- 172.21.15.153:0/3029470272 learned_addr learned my addr 172.21.15.153:0/3029470272 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a377fe700 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x185e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 -- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 msgr2=0x183cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x183cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 -- 172.21.15.153:0/3029470272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 msgr2=0x185e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x185e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 -- 172.21.15.153:0/3029470272 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380c9bf0 con 0x185b420 2023-08-17T00:06:28.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x183cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:28.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.136+0000 7f8a367fc700 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 0x183d440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8a2c04add0 tx=0x7f8a2c00f000).ready entity=mon.1 client_cookie=f143f431839db46c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a1d7fa700 1 -- 172.21.15.153:0/3029470272 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c055070 con 0x185b420 2023-08-17T00:06:28.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a1d7fa700 1 -- 172.21.15.153:0/3029470272 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c04d040 con 0x185b420 2023-08-17T00:06:28.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a1d7fa700 1 -- 172.21.15.153:0/3029470272 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0475b0 con 0x185b420 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 -- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 msgr2=0x183d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 0x183d440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f8a2c04add0 tx=0x7f8a2c00f000).stop 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 -- 172.21.15.153:0/3029470272 shutdown_connections 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185bcf0 0x185e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185b420 0x183d440 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3029470272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x183cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 -- 172.21.15.153:0/3029470272 >> 172.21.15.153:0/3029470272 conn(0x15f7690 msgr2=0x1813860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 -- 172.21.15.153:0/3029470272 shutdown_connections 2023-08-17T00:06:28.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.140+0000 7f8a47c03740 1 -- 172.21.15.153:0/3029470272 wait complete. 2023-08-17T00:06:28.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 -- start start 2023-08-17T00:06:28.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 Processor -- start 2023-08-17T00:06:28.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x18724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 0x18c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x185e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1879760 con 0x185b420 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1872990 con 0x185bcf0 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x187f7b0 con 0x183db30 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a47c03740 10 client.0 ll_register_callbacks cb 0x7f8a30007a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a367fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 0x18c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a367fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 0x18c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35538/0 (socket says 172.21.15.153:35538) 2023-08-17T00:06:28.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a367fc700 1 -- 172.21.15.153:0/3480545107 learned_addr learned my addr 172.21.15.153:0/3480545107 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a377fe700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x185e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x18724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a367fc700 1 -- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 msgr2=0x18724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a367fc700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x18724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.144+0000 7f8a367fc700 1 -- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 msgr2=0x185e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a367fc700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x185e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a367fc700 1 -- 172.21.15.153:0/3480545107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a38154560 con 0x185b420 2023-08-17T00:06:28.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a367fc700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 0x18c7fe0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f8a2c00ca40 tx=0x7f8a2c00f000).ready entity=mon.0 client_cookie=97fe9c0bb975a6ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:28.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 1 -- 172.21.15.153:0/3480545107 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c04a5a0 con 0x185b420 2023-08-17T00:06:28.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 1 -- 172.21.15.153:0/3480545107 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8a2c050260 con 0x185b420 2023-08-17T00:06:28.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a3000f040 con 0x185b420 2023-08-17T00:06:28.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 1 -- 172.21.15.153:0/3480545107 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a2c046c90 con 0x185b420 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 10 client.5910 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7f8a380ad840 con 0x185b420 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 1 -- 172.21.15.153:0/3480545107 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000f040 con 0x185b420 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 1 -- 172.21.15.153:0/3480545107 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8a2c046df0 con 0x185b420 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 10 client.5910 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 10 client.5910 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:28.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 20 client.5910 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:28.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x18780d0 0x185e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 4 client.5910 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/"}] 2023-08-17T00:06:28.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x164e620 con 0x18780d0 2023-08-17T00:06:28.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x18780d0 0x185e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 10 client.5910 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:28.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a36ffd700 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x18780d0 0x185e850 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=43de42e95a7dde90 server_cookie=79009a8e49455d0e in_seq=0 out_seq=0 2023-08-17T00:06:28.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 1 -- 172.21.15.153:0/3480545107 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x164e620 con 0x18780d0 2023-08-17T00:06:28.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a157fa700 10 client.5910 handle_command_reply: tid=0 2023-08-17T00:06:28.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 client.5910 shutdown 2023-08-17T00:06:28.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 msgr2=0x18c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.148+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 0x18c7fe0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f8a2c00ca40 tx=0x7f8a2c00f000).stop 2023-08-17T00:06:28.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 shutdown_connections 2023-08-17T00:06:28.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x18780d0 0x185e850 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x185bcf0 0x185e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x185b420 0x18c7fe0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 --2- 172.21.15.153:0/3480545107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x183db30 0x18724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 >> 172.21.15.153:0/3480545107 conn(0x15f7690 msgr2=0x18133b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a157fa700 0 client.5910 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 shutdown_connections 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 1 -- 172.21.15.153:0/3480545107 wait complete. 2023-08-17T00:06:28.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a47c03740 20 client.5910 trim_cache size 0 max 16384 2023-08-17T00:06:28.163 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:28.163 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:28.163 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "4e3fe037-f319-4035-bbaf-9e100f029da0", 2023-08-17T00:06:28.163 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:28.163 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:28.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2405a150 msgr2=0x7f8a2405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2405a150 0x7f8a2405c610 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f8a28003080 tx=0x7f8a28017000).stop 2023-08-17T00:06:28.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 msgr2=0x7f8a381579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a381579e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f8a2c00c450 tx=0x7f8a2c007c80).stop 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 shutdown_connections 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2405a150 0x7f8a2405c610 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a38157ed0 0x7f8a380c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a380acf30 0x7f8a381579e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 --2- 172.21.15.153:0/179738309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a38063bc0 0x7f8a380b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 >> 172.21.15.153:0/179738309 conn(0x7f8a380cb330 msgr2=0x7f8a381531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 shutdown_connections 2023-08-17T00:06:28.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.152+0000 7f8a37fff700 1 -- 172.21.15.153:0/179738309 wait complete. 2023-08-17T00:06:28.178 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '4e3fe037-f319-4035-bbaf-9e100f029da0', 'mode': 'asynchronous'}' 2023-08-17T00:06:28.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:28.179 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2023-08-17T00:06:28.205 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2023-08-17T00:06:28.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:28.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.404+0000 7fab1f59e700 1 Processor -- start 2023-08-17T00:06:28.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.404+0000 7fab1f59e700 1 -- start start 2023-08-17T00:06:28.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab200a8df0 0x7fab200c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab20068820 0x7fab20068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab20061fa0 0x7fab20062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab201585a0 con 0x7fab20068820 2023-08-17T00:06:28.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab20066400 con 0x7fab200a8df0 2023-08-17T00:06:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20069170 con 0x7fab20061fa0 2023-08-17T00:06:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab20068820 0x7fab20068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab20068820 0x7fab20068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35550/0 (socket says 172.21.15.153:35550) 2023-08-17T00:06:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 -- 172.21.15.153:0/254375450 learned_addr learned my addr 172.21.15.153:0/254375450 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1e59c700 1 --2- 172.21.15.153:0/254375450 >> v2:172.21.15.178:3300/0 conn(0x7fab200a8df0 0x7fab200c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1ed9d700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab20061fa0 0x7fab20062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 -- 172.21.15.153:0/254375450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab20061fa0 msgr2=0x7fab20062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab20061fa0 0x7fab20062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 -- 172.21.15.153:0/254375450 >> v2:172.21.15.178:3300/0 conn(0x7fab200a8df0 msgr2=0x7fab200c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 --2- 172.21.15.153:0/254375450 >> v2:172.21.15.178:3300/0 conn(0x7fab200a8df0 0x7fab200c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 -- 172.21.15.153:0/254375450 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200b9d30 con 0x7fab20068820 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1e59c700 1 --2- 172.21.15.153:0/254375450 >> v2:172.21.15.178:3300/0 conn(0x7fab200a8df0 0x7fab200c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1ed9d700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab20061fa0 0x7fab20062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab17fff700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20068820 0x7fab20068c80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fab200c3f30 tx=0x7fab080090f0).ready entity=mon.0 client_cookie=bc5f4ff5b97acd86 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1dd9b700 1 -- 172.21.15.153:0/254375450 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800b600 con 0x7fab20068820 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1dd9b700 1 -- 172.21.15.153:0/254375450 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0800b760 con 0x7fab20068820 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1dd9b700 1 -- 172.21.15.153:0/254375450 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0800bae0 con 0x7fab20068820 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 -- 172.21.15.153:0/254375450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20068820 msgr2=0x7fab20068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.408+0000 7fab1f59e700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20068820 0x7fab20068c80 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fab200c3f30 tx=0x7fab080090f0).stop 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 -- 172.21.15.153:0/254375450 shutdown_connections 2023-08-17T00:06:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab20061fa0 0x7fab20062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 --2- 172.21.15.153:0/254375450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20068820 0x7fab20068c80 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 --2- 172.21.15.153:0/254375450 >> v2:172.21.15.178:3300/0 conn(0x7fab200a8df0 0x7fab200c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 -- 172.21.15.153:0/254375450 >> 172.21.15.153:0/254375450 conn(0x7fab200c6620 msgr2=0x7fab200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 -- 172.21.15.153:0/254375450 shutdown_connections 2023-08-17T00:06:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 -- 172.21.15.153:0/254375450 wait complete. 2023-08-17T00:06:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 Processor -- start 2023-08-17T00:06:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.412+0000 7fab1f59e700 1 -- start start 2023-08-17T00:06:28.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 0x7fab2015f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab20068820 0x7fab200bbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab200a8df0 0x7fab2015cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2015fc70 con 0x7fab20061fa0 2023-08-17T00:06:28.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab201442d0 con 0x7fab20068820 2023-08-17T00:06:28.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab200bd260 con 0x7fab200a8df0 2023-08-17T00:06:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 0x7fab2015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 0x7fab2015f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35560/0 (socket says 172.21.15.153:35560) 2023-08-17T00:06:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 -- 172.21.15.153:0/2362556810 learned_addr learned my addr 172.21.15.153:0/2362556810 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab17fff700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab20068820 0x7fab200bbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1ed9d700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab200a8df0 0x7fab2015cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 -- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab200a8df0 msgr2=0x7fab2015cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab200a8df0 0x7fab2015cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 -- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab20068820 msgr2=0x7fab200bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab20068820 0x7fab200bbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 -- 172.21.15.153:0/2362556810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab08009370 con 0x7fab20061fa0 2023-08-17T00:06:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1e59c700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 0x7fab2015f780 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fab1000c880 tx=0x7fab10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10010580 con 0x7fab20061fa0 2023-08-17T00:06:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab100106e0 con 0x7fab20061fa0 2023-08-17T00:06:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab10010a60 con 0x7fab20061fa0 2023-08-17T00:06:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab200bc650 con 0x7fab20061fa0 2023-08-17T00:06:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.416+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab200bcc10 con 0x7fab20061fa0 2023-08-17T00:06:28.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.420+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab200c6c10 con 0x7fab20061fa0 2023-08-17T00:06:28.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.420+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fab1001a410 con 0x7fab20061fa0 2023-08-17T00:06:28.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.420+0000 7fab167fc700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab0005a150 0x7fab0005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:28.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.420+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fab10073b70 con 0x7fab20061fa0 2023-08-17T00:06:28.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.420+0000 7fab17fff700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab0005a150 0x7fab0005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:28.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.424+0000 7fab17fff700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab0005a150 0x7fab0005c610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fab08009130 tx=0x7fab08017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:28.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.428+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab200c6c10 con 0x7fab20061fa0 2023-08-17T00:06:28.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.620+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab200c6c10 con 0x7fab20061fa0 2023-08-17T00:06:28.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.624+0000 7fab167fc700 1 -- 172.21.15.153:0/2362556810 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fab200c6c10 con 0x7fab20061fa0 2023-08-17T00:06:28.628 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:28.629 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:28.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab0005a150 msgr2=0x7fab0005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab0005a150 0x7fab0005c610 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7fab08009130 tx=0x7fab08017000).stop 2023-08-17T00:06:28.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 msgr2=0x7fab2015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:28.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 0x7fab2015f780 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fab1000c880 tx=0x7fab10008040).stop 2023-08-17T00:06:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 shutdown_connections 2023-08-17T00:06:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab0005a150 0x7fab0005c610 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab200a8df0 0x7fab2015cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab20068820 0x7fab200bbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 --2- 172.21.15.153:0/2362556810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab20061fa0 0x7fab2015f780 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 >> 172.21.15.153:0/2362556810 conn(0x7fab200c6620 msgr2=0x7fab20157aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 shutdown_connections 2023-08-17T00:06:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:28.628+0000 7fab1f59e700 1 -- 172.21.15.153:0/2362556810 wait complete. 2023-08-17T00:06:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:28.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2023-08-17T00:06:28.818 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:28.818 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:28.818 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:28.835 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:28.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:28.836 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2023-08-17T00:06:28.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:06:28.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:06:28.897 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0389035 s, 27.0 MB/s 2023-08-17T00:06:28.898 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2023-08-17T00:06:28.899 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:29.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.056+0000 7f9e2fe9b700 1 Processor -- start 2023-08-17T00:06:29.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.056+0000 7f9e2fe9b700 1 -- start start 2023-08-17T00:06:29.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2fe9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e28153e90 0x7f9e280c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2fe9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c7980 0x7f9e280ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2fe9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e280aa750 con 0x7f9e28153ab0 2023-08-17T00:06:29.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2fe9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280c9dd0 con 0x7f9e28153e90 2023-08-17T00:06:29.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2fe9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280aacf0 con 0x7f9e280c7980 2023-08-17T00:06:29.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2dc37700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9e28153ab0 0x7f9e280c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40964/0 (socket says 172.21.15.153:40964) 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2dc37700 1 -- 172.21.15.153:0/3948699664 learned_addr learned my addr 172.21.15.153:0/3948699664 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2d436700 1 --2- 172.21.15.153:0/3948699664 >> v2:172.21.15.153:3300/0 conn(0x7f9e28153e90 0x7f9e280c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2e438700 1 --2- 172.21.15.153:0/3948699664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c7980 0x7f9e280ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2d436700 1 -- 172.21.15.153:0/3948699664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c7980 msgr2=0x7f9e280ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2d436700 1 --2- 172.21.15.153:0/3948699664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c7980 0x7f9e280ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2d436700 1 -- 172.21.15.153:0/3948699664 >> v1:172.21.15.153:6789/0 conn(0x7f9e28153ab0 legacy=0x7f9e280c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2d436700 1 -- 172.21.15.153:0/3948699664 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e281542f0 con 0x7f9e28153e90 2023-08-17T00:06:29.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2d436700 1 --2- 172.21.15.153:0/3948699664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153e90 0x7f9e280c7490 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9e18009760 tx=0x7f9e18009060).ready entity=mon.0 client_cookie=fef56a794870cb48 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2cc35700 1 -- 172.21.15.153:0/3948699664 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e180090d0 con 0x7f9e28153e90 2023-08-17T00:06:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2cc35700 1 -- 172.21.15.153:0/3948699664 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800f510 con 0x7f9e28153e90 2023-08-17T00:06:29.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.060+0000 7f9e2cc35700 1 -- 172.21.15.153:0/3948699664 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800f890 con 0x7f9e28153e90 2023-08-17T00:06:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/3948699664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153e90 msgr2=0x7f9e280c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/3948699664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153e90 0x7f9e280c7490 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9e18009760 tx=0x7f9e18009060).stop 2023-08-17T00:06:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/3948699664 shutdown_connections 2023-08-17T00:06:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/3948699664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c7980 0x7f9e280ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/3948699664 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153e90 0x7f9e280c7490 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/3948699664 >> 172.21.15.153:0/3948699664 conn(0x7f9e28061fa0 msgr2=0x7f9e280623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:29.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/3948699664 shutdown_connections 2023-08-17T00:06:29.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/3948699664 wait complete. 2023-08-17T00:06:29.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 Processor -- start 2023-08-17T00:06:29.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.064+0000 7f9e2fe9b700 1 -- start start 2023-08-17T00:06:29.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280c7980 0x7f9e280adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 0x7f9e280ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e28153e90 0x7f9e28063590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e280aef40 con 0x7f9e28153ab0 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28150d40 con 0x7f9e280c7980 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28157c60 con 0x7f9e28153e90 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 0x7f9e280ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 0x7f9e280ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35574/0 (socket says 172.21.15.153:35574) 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 -- 172.21.15.153:0/670200079 learned_addr learned my addr 172.21.15.153:0/670200079 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:29.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2e438700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e28153e90 0x7f9e28063590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2dc37700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280c7980 0x7f9e280adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 -- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e28153e90 msgr2=0x7f9e28063590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e28153e90 0x7f9e28063590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 -- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280c7980 msgr2=0x7f9e280adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280c7980 0x7f9e280adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 -- 172.21.15.153:0/670200079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180092a0 con 0x7f9e28153ab0 2023-08-17T00:06:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2d436700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 0x7f9e280ae0d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f9e18009170 tx=0x7f9e18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:29.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800fea0 con 0x7f9e28153ab0 2023-08-17T00:06:29.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800f680 con 0x7f9e28153ab0 2023-08-17T00:06:29.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1801c420 con 0x7f9e28153ab0 2023-08-17T00:06:29.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e28157930 con 0x7f9e28153ab0 2023-08-17T00:06:29.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.068+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e280ae980 con 0x7f9e28153ab0 2023-08-17T00:06:29.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.072+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e280c7710 con 0x7f9e28153ab0 2023-08-17T00:06:29.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.072+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9e1802b070 con 0x7f9e28153ab0 2023-08-17T00:06:29.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.072+0000 7f9e1dffb700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0c05a150 0x7f9e0c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.072+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e18075860 con 0x7f9e28153ab0 2023-08-17T00:06:29.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.076+0000 7f9e2dc37700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0c05a150 0x7f9e0c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.076+0000 7f9e2dc37700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0c05a150 0x7f9e0c05c610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9e24007fd0 tx=0x7f9e24009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:29.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.080+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e18049200 con 0x7f9e28153ab0 2023-08-17T00:06:29.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.280+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e2806b530 con 0x7f9e28153ab0 2023-08-17T00:06:29.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.280+0000 7f9e1dffb700 1 -- 172.21.15.153:0/670200079 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f9e18029090 con 0x7f9e28153ab0 2023-08-17T00:06:29.285 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:29.285 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:29.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0c05a150 msgr2=0x7f9e0c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0c05a150 0x7f9e0c05c610 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f9e24007fd0 tx=0x7f9e24009040).stop 2023-08-17T00:06:29.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 msgr2=0x7f9e280ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 0x7f9e280ae0d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f9e18009170 tx=0x7f9e18017000).stop 2023-08-17T00:06:29.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 shutdown_connections 2023-08-17T00:06:29.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0c05a150 0x7f9e0c05c610 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e28153e90 0x7f9e28063590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e28153ab0 0x7f9e280ae0d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 --2- 172.21.15.153:0/670200079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280c7980 0x7f9e280adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 >> 172.21.15.153:0/670200079 conn(0x7f9e28061fa0 msgr2=0x7f9e28062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:29.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 shutdown_connections 2023-08-17T00:06:29.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.284+0000 7f9e2fe9b700 1 -- 172.21.15.153:0/670200079 wait complete. 2023-08-17T00:06:29.292 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:29.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2023-08-17T00:06:29.473 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:29.474 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:29.474 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:29.491 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:29.491 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:06:29.492 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:06:29.492 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:06:29.492 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:06:29.493 DEBUG:teuthology.orchestra.run.smithi153:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2023-08-17T00:06:29.493 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:06:29.587 INFO:teuthology.orchestra.run.smithi153.stdout:1099511630189 2023-08-17T00:06:29.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-08-17T00:06:29.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.980+0000 7fead9bb9700 1 Processor -- start 2023-08-17T00:06:29.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.980+0000 7fead9bb9700 1 -- start start 2023-08-17T00:06:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead9bb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fead4063bc0 0x7fead415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead9bb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead4154e90 con 0x7fead40c5ea0 2023-08-17T00:06:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead9bb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead4153fc0 con 0x7fead40acf30 2023-08-17T00:06:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead9bb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead40c1730 con 0x7fead4063bc0 2023-08-17T00:06:29.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead93b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fead4063bc0 0x7fead415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:29.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fead40c5ea0 0x7fead40634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40974/0 (socket says 172.21.15.153:40974) 2023-08-17T00:06:29.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead3fff700 1 -- 172.21.15.153:0/3381776975 learned_addr learned my addr 172.21.15.153:0/3381776975 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:29.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead93b8700 1 -- 172.21.15.153:0/3381776975 >> v1:172.21.15.178:6789/0 conn(0x7fead40acf30 legacy=0x7fead40c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead93b8700 1 -- 172.21.15.153:0/3381776975 >> v1:172.21.15.153:6789/0 conn(0x7fead40c5ea0 legacy=0x7fead40634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead93b8700 1 -- 172.21.15.153:0/3381776975 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead4154280 con 0x7fead4063bc0 2023-08-17T00:06:29.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead93b8700 1 --2- 172.21.15.153:0/3381776975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead4063bc0 0x7fead415e660 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7feacc009760 tx=0x7feacc009060).ready entity=mon.0 client_cookie=52377f7e2a49af5a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead37fe700 1 -- 172.21.15.153:0/3381776975 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00b580 con 0x7fead4063bc0 2023-08-17T00:06:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead37fe700 1 -- 172.21.15.153:0/3381776975 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc00b6e0 con 0x7fead4063bc0 2023-08-17T00:06:29.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.984+0000 7fead37fe700 1 -- 172.21.15.153:0/3381776975 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc00ba60 con 0x7fead4063bc0 2023-08-17T00:06:29.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 -- 172.21.15.153:0/3381776975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead4063bc0 msgr2=0x7fead415e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:29.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3381776975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead4063bc0 0x7fead415e660 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7feacc009760 tx=0x7feacc009060).stop 2023-08-17T00:06:29.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 -- 172.21.15.153:0/3381776975 shutdown_connections 2023-08-17T00:06:29.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3381776975 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead4063bc0 0x7fead415e660 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:29.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 -- 172.21.15.153:0/3381776975 >> 172.21.15.153:0/3381776975 conn(0x7fead40cb330 msgr2=0x7fead40c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:29.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 -- 172.21.15.153:0/3381776975 shutdown_connections 2023-08-17T00:06:29.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.988+0000 7fead9bb9700 1 -- 172.21.15.153:0/3381776975 wait complete. 2023-08-17T00:06:29.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 Processor -- start 2023-08-17T00:06:29.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 -- start start 2023-08-17T00:06:29.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead4063bc0 0x7fead40c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 0x7fead4149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead4149e80 0x7fead40bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:29.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c2ec0 con 0x7fead40acf30 2023-08-17T00:06:29.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c4330 con 0x7fead4063bc0 2023-08-17T00:06:29.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead9bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead40c45d0 con 0x7fead4149e80 2023-08-17T00:06:30.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 0x7fead4149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 0x7fead4149990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35600/0 (socket says 172.21.15.153:35600) 2023-08-17T00:06:30.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead3fff700 1 -- 172.21.15.153:0/3788587513 learned_addr learned my addr 172.21.15.153:0/3788587513 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead8bb7700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead4063bc0 0x7fead40c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.992+0000 7fead93b8700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead4149e80 0x7fead40bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead3fff700 1 -- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead4149e80 msgr2=0x7fead40bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead3fff700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead4149e80 0x7fead40bfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead3fff700 1 -- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead4063bc0 msgr2=0x7fead40c5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead3fff700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead4063bc0 0x7fead40c5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead3fff700 1 -- 172.21.15.153:0/3788587513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feacc0092a0 con 0x7fead40acf30 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead3fff700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 0x7fead4149990 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7feac0001eb0 tx=0x7feac0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead0ff9700 1 -- 172.21.15.153:0/3788587513 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00070d0 con 0x7fead40acf30 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead0ff9700 1 -- 172.21.15.153:0/3788587513 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac0007230 con 0x7fead40acf30 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead40c48b0 con 0x7fead40acf30 2023-08-17T00:06:30.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead0ff9700 1 -- 172.21.15.153:0/3788587513 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00075d0 con 0x7fead40acf30 2023-08-17T00:06:30.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:29.996+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead40c4e70 con 0x7fead40acf30 2023-08-17T00:06:30.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.000+0000 7fead0ff9700 1 -- 172.21.15.153:0/3788587513 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7feac0010070 con 0x7fead40acf30 2023-08-17T00:06:30.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.000+0000 7fead0ff9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feab805a150 0x7feab805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.000+0000 7fead0ff9700 1 -- 172.21.15.153:0/3788587513 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feac00736c0 con 0x7fead40acf30 2023-08-17T00:06:30.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.000+0000 7fead8bb7700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feab805a150 0x7feab805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.000+0000 7feae51a1740 1 Processor -- start 2023-08-17T00:06:30.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- start start 2023-08-17T00:06:30.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead8bb7700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feab805a150 0x7feab805c610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7feac8004290 tx=0x7feac8001560).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x286ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x2840f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2887310 0x28428f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27921a0 con 0x288d480 2023-08-17T00:06:30.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2846060 con 0x2887310 2023-08-17T00:06:30.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2845d80 con 0x2886f30 2023-08-17T00:06:30.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x2840f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x2840f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35616/0 (socket says 172.21.15.153:35616) 2023-08-17T00:06:30.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 -- 172.21.15.153:0/323563510 learned_addr learned my addr 172.21.15.153:0/323563510 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead8bb7700 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x286ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead93b8700 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2887310 0x28428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 -- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 msgr2=0x286ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x286ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 -- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2887310 msgr2=0x28428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2887310 0x28428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 -- 172.21.15.153:0/323563510 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27d1e30 con 0x288d480 2023-08-17T00:06:30.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7fead3fff700 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x2840f30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7feac00472d0 tx=0x7feac000f000).ready entity=mon.0 client_cookie=8fc4f9255a70945b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feabdffb700 1 -- 172.21.15.153:0/323563510 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0054030 con 0x288d480 2023-08-17T00:06:30.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feabdffb700 1 -- 172.21.15.153:0/323563510 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac00474e0 con 0x288d480 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feabdffb700 1 -- 172.21.15.153:0/323563510 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac004a4d0 con 0x288d480 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- 172.21.15.153:0/323563510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 msgr2=0x2840f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x2840f30 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7feac00472d0 tx=0x7feac000f000).stop 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- 172.21.15.153:0/323563510 shutdown_connections 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2887310 0x28428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x2840f30 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 --2- 172.21.15.153:0/323563510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x286ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- 172.21.15.153:0/323563510 >> 172.21.15.153:0/323563510 conn(0x2625680 msgr2=0x288c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- 172.21.15.153:0/323563510 shutdown_connections 2023-08-17T00:06:30.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.004+0000 7feae51a1740 1 -- 172.21.15.153:0/323563510 wait complete. 2023-08-17T00:06:30.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 -- start start 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 Processor -- start 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 0x2868f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x28701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x286da70 con 0x2886f30 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28707a0 con 0x288d480 2023-08-17T00:06:30.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x286dce0 con 0x2887310 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 10 client.0 ll_register_callbacks cb 0x2788b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 0x2868f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 0x2868f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35624/0 (socket says 172.21.15.153:35624) 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 -- 172.21.15.153:0/909798534 learned_addr learned my addr 172.21.15.153:0/909798534 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead93b8700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x28701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead3fff700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 -- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 msgr2=0x286fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 -- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 msgr2=0x28701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x28701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 -- 172.21.15.153:0/909798534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead40c4e70 con 0x2886f30 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead93b8700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x28701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7fead8bb7700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 0x2868f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7feac8014400 tx=0x7feac8012000).ready entity=mon.0 client_cookie=c098229d05b3ae6d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feab2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feab2ffd700 1 -- 172.21.15.153:0/909798534 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac80133e0 con 0x2886f30 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27bccf0 con 0x2886f30 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feab2ffd700 1 -- 172.21.15.153:0/909798534 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feac8013540 con 0x2886f30 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feab2ffd700 1 -- 172.21.15.153:0/909798534 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac8013910 con 0x2886f30 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 10 client.5940 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x27c0010 con 0x2886f30 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feab2ffd700 1 -- 172.21.15.153:0/909798534 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27bccf0 con 0x2886f30 2023-08-17T00:06:30.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feab2ffd700 1 -- 172.21.15.153:0/909798534 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7feac801f070 con 0x2886f30 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 10 client.5940 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.008+0000 7feae51a1740 20 client.5940 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x289beb0 0x289c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 4 client.5940 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27b3240 con 0x289beb0 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7fead3fff700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x289beb0 0x289c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feab2ffd700 10 client.5940 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7fead3fff700 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x289beb0 0x289c290 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9e4fc85c1699ae2c server_cookie=b27187142cf30c02 in_seq=0 out_seq=0 2023-08-17T00:06:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feab2ffd700 1 -- 172.21.15.153:0/909798534 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x27b3240 con 0x289beb0 2023-08-17T00:06:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feab2ffd700 10 client.5940 handle_command_reply: tid=0 2023-08-17T00:06:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 client.5940 shutdown 2023-08-17T00:06:30.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 msgr2=0x2868f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 0x2868f20 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7feac8014400 tx=0x7feac8012000).stop 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 shutdown_connections 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x289beb0 0x289c290 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x28701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 --2- 172.21.15.153:0/909798534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2886f30 0x2868f20 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feab2ffd700 0 client.5940 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 >> 172.21.15.153:0/909798534 conn(0x2625680 msgr2=0x28448c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 shutdown_connections 2023-08-17T00:06:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 1 -- 172.21.15.153:0/909798534 wait complete. 2023-08-17T00:06:30.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.012+0000 7feae51a1740 20 client.5940 trim_cache size 0 max 16384 2023-08-17T00:06:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 Processor -- start 2023-08-17T00:06:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 -- start start 2023-08-17T00:06:30.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2886f30 0x286f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x286e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x278c0b0 con 0x288d480 2023-08-17T00:06:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2872a90 con 0x2886f30 2023-08-17T00:06:30.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x273e070 con 0x2887310 2023-08-17T00:06:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead93b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x286e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead93b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x286e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35630/0 (socket says 172.21.15.153:35630) 2023-08-17T00:06:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead93b8700 1 -- 172.21.15.153:0/1942244886 learned_addr learned my addr 172.21.15.153:0/1942244886 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead8bb7700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2886f30 0x286f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead3fff700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead8bb7700 1 -- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 msgr2=0x286fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead8bb7700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead8bb7700 1 -- 172.21.15.153:0/1942244886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 msgr2=0x286e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead8bb7700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x286e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead8bb7700 1 -- 172.21.15.153:0/1942244886 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40c0330 con 0x2886f30 2023-08-17T00:06:30.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead3fff700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.028+0000 7fead93b8700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x286e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:30.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7fead8bb7700 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2886f30 0x286f8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7feac8014400 tx=0x7feac8016000).ready entity=mon.1 client_cookie=99d2e533e242465c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feabe7fc700 1 -- 172.21.15.153:0/1942244886 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac802f030 con 0x2886f30 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feabe7fc700 1 -- 172.21.15.153:0/1942244886 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac801c040 con 0x2886f30 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feabe7fc700 1 -- 172.21.15.153:0/1942244886 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8001060 con 0x2886f30 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 -- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2886f30 msgr2=0x286f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2886f30 0x286f8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7feac8014400 tx=0x7feac8016000).stop 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 -- 172.21.15.153:0/1942244886 shutdown_connections 2023-08-17T00:06:30.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288d480 0x286e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2887310 0x286fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 --2- 172.21.15.153:0/1942244886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2886f30 0x286f8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 -- 172.21.15.153:0/1942244886 >> 172.21.15.153:0/1942244886 conn(0x2625680 msgr2=0x2886580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 -- 172.21.15.153:0/1942244886 shutdown_connections 2023-08-17T00:06:30.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.032+0000 7feae51a1740 1 -- 172.21.15.153:0/1942244886 wait complete. 2023-08-17T00:06:30.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 -- start start 2023-08-17T00:06:30.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 Processor -- start 2023-08-17T00:06:30.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x28eea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 0x286f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x286fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28701d0 con 0x2887310 2023-08-17T00:06:30.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x288c050 con 0x288d480 2023-08-17T00:06:30.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x286e310 con 0x2886f30 2023-08-17T00:06:30.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7feae51a1740 10 client.0 ll_register_callbacks cb 0x7feac800ebd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 0x286f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 0x286f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35640/0 (socket says 172.21.15.153:35640) 2023-08-17T00:06:30.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 -- 172.21.15.153:0/2768559703 learned_addr learned my addr 172.21.15.153:0/2768559703 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead93b8700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x286fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead8bb7700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x28eea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 -- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 msgr2=0x28eea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x28eea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 -- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 msgr2=0x286fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x286fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.036+0000 7fead3fff700 1 -- 172.21.15.153:0/2768559703 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead4154280 con 0x2887310 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7fead3fff700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 0x286f7f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7feac0001130 tx=0x7feac0063280).ready entity=mon.0 client_cookie=b3e039243c10f7c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 1 -- 172.21.15.153:0/2768559703 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0054040 con 0x2887310 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feac00474e0 con 0x2887310 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 1 -- 172.21.15.153:0/2768559703 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feac0055070 con 0x2887310 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 1 -- 172.21.15.153:0/2768559703 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac004ab40 con 0x2887310 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 10 client.5946 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7feac8019040 con 0x2887310 2023-08-17T00:06:30.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 1 -- 172.21.15.153:0/2768559703 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac00474e0 con 0x2887310 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 1 -- 172.21.15.153:0/2768559703 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7feac004a2c0 con 0x2887310 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 10 client.5946 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 10 client.5946 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 20 client.5946 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2871290 0x288ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 4 client.5946 mds_command: new command op to 5427 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:06:30.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x267c610 con 0x2871290 2023-08-17T00:06:30.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7fead8bb7700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2871290 0x288ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 10 client.5946 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7fead8bb7700 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2871290 0x288ad10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=56efb54bcb11abbe server_cookie=9fe261398f333850 in_seq=0 out_seq=0 2023-08-17T00:06:30.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 1 -- 172.21.15.153:0/2768559703 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x267c610 con 0x2871290 2023-08-17T00:06:30.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 10 client.5946 handle_command_reply: tid=0 2023-08-17T00:06:30.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 client.5946 shutdown 2023-08-17T00:06:30.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 msgr2=0x286f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 0x286f7f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7feac0001130 tx=0x7feac0063280).stop 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 shutdown_connections 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2871290 0x288ad10 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288d480 0x286fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feab2ffd700 0 client.5946 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2887310 0x286f7f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 --2- 172.21.15.153:0/2768559703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2886f30 0x28eea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 >> 172.21.15.153:0/2768559703 conn(0x2625680 msgr2=0x2897b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 shutdown_connections 2023-08-17T00:06:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.040+0000 7feae51a1740 1 -- 172.21.15.153:0/2768559703 wait complete. 2023-08-17T00:06:30.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7feae51a1740 20 client.5946 trim_cache size 0 max 16384 2023-08-17T00:06:30.052 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feab805a150 msgr2=0x7feab805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feab805a150 0x7feab805c610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7feac8004290 tx=0x7feac8001560).stop 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 msgr2=0x7fead4149990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 0x7fead4149990 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7feac0001eb0 tx=0x7feac0007e50).stop 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 shutdown_connections 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feab805a150 0x7feab805c610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead4149e80 0x7fead40bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fead40acf30 0x7fead4149990 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 --2- 172.21.15.153:0/3788587513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead4063bc0 0x7fead40c5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 >> 172.21.15.153:0/3788587513 conn(0x7fead40cb330 msgr2=0x7fead40c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 shutdown_connections 2023-08-17T00:06:30.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.044+0000 7fead9bb9700 1 -- 172.21.15.153:0/3788587513 wait complete. 2023-08-17T00:06:30.069 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 1000000096d.00000000 parent 2023-08-17T00:06:30.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.124+0000 7fe635b33d00 1 Processor -- start 2023-08-17T00:06:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.124+0000 7fe635b33d00 1 -- start start 2023-08-17T00:06:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe635b33d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30eb78c70 0x55f30ec254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe635b33d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 0x55f30eb7a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe635b33d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe635b33d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30eabfce0 con 0x55f30ec1fb50 2023-08-17T00:06:30.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe635b33d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30ec1b950 con 0x55f30eb78c70 2023-08-17T00:06:30.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe635b33d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f30eb7b3d0 con 0x55f30ec24600 2023-08-17T00:06:30.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 0x55f30eb7a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 0x55f30eb7a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35660/0 (socket says 172.21.15.153:35660) 2023-08-17T00:06:30.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 -- 172.21.15.153:0/3762834293 learned_addr learned my addr 172.21.15.153:0/3762834293 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe62a045700 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30eb78c70 0x55f30ec254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe62a846700 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 -- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 msgr2=0x55f30eb7c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb7c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 -- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30eb78c70 msgr2=0x55f30ec254c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30eb78c70 0x55f30ec254c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 -- 172.21.15.153:0/3762834293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c00a180 con 0x55f30ec1fb50 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe621844700 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 0x55f30eb7a470 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fe614009980 tx=0x7fe61400c040).ready entity=mon.0 client_cookie=37457757862701c9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe629043700 1 -- 172.21.15.153:0/3762834293 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61400f040 con 0x55f30ec1fb50 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe629043700 1 -- 172.21.15.153:0/3762834293 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe614009e70 con 0x55f30ec1fb50 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.128+0000 7fe629043700 1 -- 172.21.15.153:0/3762834293 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe614008cd0 con 0x55f30ec1fb50 2023-08-17T00:06:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 -- 172.21.15.153:0/3762834293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 msgr2=0x55f30eb7a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 0x55f30eb7a470 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7fe614009980 tx=0x7fe61400c040).stop 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 -- 172.21.15.153:0/3762834293 shutdown_connections 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb7c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30ec1fb50 0x55f30eb7a470 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 --2- 172.21.15.153:0/3762834293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30eb78c70 0x55f30ec254c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 -- 172.21.15.153:0/3762834293 >> 172.21.15.153:0/3762834293 conn(0x55f30eb97770 msgr2=0x55f30eb79d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 -- 172.21.15.153:0/3762834293 shutdown_connections 2023-08-17T00:06:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 -- 172.21.15.153:0/3762834293 wait complete. 2023-08-17T00:06:30.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 Processor -- start 2023-08-17T00:06:30.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.132+0000 7fe635b33d00 1 -- start start 2023-08-17T00:06:30.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30eb78c70 0x55f30ec15a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30ec1fb50 0x55f30eb47930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb47e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30eb48310 con 0x55f30eb78c70 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f30ec1eef0 con 0x55f30ec1fb50 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f30eb8efc0 con 0x55f30ec24600 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30eb78c70 0x55f30ec15a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30eb78c70 0x55f30ec15a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35670/0 (socket says 172.21.15.153:35670) 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 -- 172.21.15.153:0/1423012004 learned_addr learned my addr 172.21.15.153:0/1423012004 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe621844700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30ec1fb50 0x55f30eb47930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a846700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb47e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 -- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 msgr2=0x55f30eb47e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb47e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 -- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30ec1fb50 msgr2=0x55f30eb47930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f30ec1fb50 0x55f30eb47930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 -- 172.21.15.153:0/1423012004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe614009580 con 0x55f30eb78c70 2023-08-17T00:06:30.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a846700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f30ec24600 0x55f30eb47e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe62a045700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30eb78c70 0x55f30ec15a50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x55f30eae5150 tx=0x7fe61c014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe6237fe700 1 -- 172.21.15.153:0/1423012004 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c00ccf0 con 0x55f30eb78c70 2023-08-17T00:06:30.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe6237fe700 1 -- 172.21.15.153:0/1423012004 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c00ce50 con 0x55f30eb78c70 2023-08-17T00:06:30.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe6237fe700 1 -- 172.21.15.153:0/1423012004 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c01e470 con 0x55f30eb78c70 2023-08-17T00:06:30.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f30eae9230 con 0x55f30eb78c70 2023-08-17T00:06:30.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.136+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f30eab8a70 con 0x55f30eb78c70 2023-08-17T00:06:30.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.140+0000 7fe6237fe700 1 -- 172.21.15.153:0/1423012004 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe61c00e030 con 0x55f30eb78c70 2023-08-17T00:06:30.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.140+0000 7fe6237fe700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60c058c80 0x7fe60c05b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.140+0000 7fe6237fe700 1 -- 172.21.15.153:0/1423012004 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe61c075300 con 0x55f30eb78c70 2023-08-17T00:06:30.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.140+0000 7fe635b33d00 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x55f30ec15f40 0x55f30ec20ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.140+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 --> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] -- osd_op(unknown.0.0:1 8.21 8:844f785e:::1000000096d.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected e50) v8 -- 0x55f30eb93d20 con 0x55f30ec15f40 2023-08-17T00:06:30.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.144+0000 7fe621844700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60c058c80 0x7fe60c05b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.144+0000 7fe62a846700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x55f30ec15f40 0x55f30ec20ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.144+0000 7fe621844700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60c058c80 0x7fe60c05b140 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x55f30ec23440 tx=0x7fe614018000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.144+0000 7fe62a846700 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x55f30ec15f40 0x55f30ec20ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe62a846700 1 -- 172.21.15.153:0/1423012004 <== osd.4 v2:172.21.15.178:6800/33066 1 ==== osd_op_reply(1 1000000096d.00000000 [rmxattr] v50'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe6240014d0 con 0x55f30ec15f40 2023-08-17T00:06:30.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x55f30ec15f40 msgr2=0x55f30ec20ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x55f30ec15f40 0x55f30ec20ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60c058c80 msgr2=0x7fe60c05b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60c058c80 0x7fe60c05b140 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x55f30ec23440 tx=0x7fe614018000).stop 2023-08-17T00:06:30.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30eb78c70 msgr2=0x55f30ec15a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 --2- 172.21.15.153:0/1423012004 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x55f30eb78c70 0x55f30ec15a50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x55f30eae5150 tx=0x7fe61c014000).stop 2023-08-17T00:06:30.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe62a846700 1 -- 172.21.15.153:0/1423012004 reap_dead start 2023-08-17T00:06:30.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 shutdown_connections 2023-08-17T00:06:30.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 >> 172.21.15.153:0/1423012004 conn(0x55f30eb97770 msgr2=0x55f30eb95230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 shutdown_connections 2023-08-17T00:06:30.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.148+0000 7fe635b33d00 1 -- 172.21.15.153:0/1423012004 wait complete. 2023-08-17T00:06:30.157 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2023-08-17T00:06:30.157 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2023-08-17T00:06:30.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.316+0000 7f965f4db700 1 Processor -- start 2023-08-17T00:06:30.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965f4db700 1 -- start start 2023-08-17T00:06:30.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965f4db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153bb0 0x7f9658066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965f4db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9658063fd0 0x7f9658066e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965f4db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96580c6150 con 0x7f9658153f90 2023-08-17T00:06:30.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965f4db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96580c3330 con 0x7f9658063fd0 2023-08-17T00:06:30.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965f4db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9658064d40 con 0x7f9658153bb0 2023-08-17T00:06:30.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9658063fd0 0x7f9658066e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9658063fd0 0x7f9658066e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35672/0 (socket says 172.21.15.153:35672) 2023-08-17T00:06:30.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 -- 172.21.15.153:0/2963806727 learned_addr learned my addr 172.21.15.153:0/2963806727 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965d277700 1 --2- 172.21.15.153:0/2963806727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153bb0 0x7f9658066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 -- 172.21.15.153:0/2963806727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153bb0 msgr2=0x7f9658066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 --2- 172.21.15.153:0/2963806727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153bb0 0x7f9658066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 -- 172.21.15.153:0/2963806727 >> v1:172.21.15.178:6789/0 conn(0x7f9658153f90 legacy=0x7f96580bd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 -- 172.21.15.153:0/2963806727 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580644a0 con 0x7f9658063fd0 2023-08-17T00:06:30.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.320+0000 7f965ca76700 1 --2- 172.21.15.153:0/2963806727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f9658066e80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f9648006fd0 tx=0x7f96480090f0).ready entity=mon.0 client_cookie=784d4555d0d2d081 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f964ffff700 1 -- 172.21.15.153:0/2963806727 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800b600 con 0x7f9658063fd0 2023-08-17T00:06:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f964ffff700 1 -- 172.21.15.153:0/2963806727 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964800b760 con 0x7f9658063fd0 2023-08-17T00:06:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f964ffff700 1 -- 172.21.15.153:0/2963806727 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964800bae0 con 0x7f9658063fd0 2023-08-17T00:06:30.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 -- 172.21.15.153:0/2963806727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 msgr2=0x7f9658066e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 --2- 172.21.15.153:0/2963806727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f9658066e80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f9648006fd0 tx=0x7f96480090f0).stop 2023-08-17T00:06:30.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 -- 172.21.15.153:0/2963806727 shutdown_connections 2023-08-17T00:06:30.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 --2- 172.21.15.153:0/2963806727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f9658066e80 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 --2- 172.21.15.153:0/2963806727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153bb0 0x7f9658066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 -- 172.21.15.153:0/2963806727 >> 172.21.15.153:0/2963806727 conn(0x7f96580c92e0 msgr2=0x7f96580c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 -- 172.21.15.153:0/2963806727 shutdown_connections 2023-08-17T00:06:30.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.324+0000 7f965f4db700 1 -- 172.21.15.153:0/2963806727 wait complete. 2023-08-17T00:06:30.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 Processor -- start 2023-08-17T00:06:30.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 -- start start 2023-08-17T00:06:30.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f96580a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9658153bb0 0x7f96580a8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153f90 0x7f96580aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96580a8c50 con 0x7f9658063fd0 2023-08-17T00:06:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96580acdc0 con 0x7f9658153bb0 2023-08-17T00:06:30.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965f4db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96580ac1b0 con 0x7f9658153f90 2023-08-17T00:06:30.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965d277700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f96580a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965d277700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f96580a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35684/0 (socket says 172.21.15.153:35684) 2023-08-17T00:06:30.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.328+0000 7f965d277700 1 -- 172.21.15.153:0/1222114691 learned_addr learned my addr 172.21.15.153:0/1222114691 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965da78700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153f90 0x7f96580aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965ca76700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9658153bb0 0x7f96580a8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965d277700 1 -- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153f90 msgr2=0x7f96580aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965d277700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153f90 0x7f96580aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965d277700 1 -- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9658153bb0 msgr2=0x7f96580a8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965d277700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9658153bb0 0x7f96580a8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965d277700 1 -- 172.21.15.153:0/1222114691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648009370 con 0x7f9658063fd0 2023-08-17T00:06:30.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965d277700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f96580a8270 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f965400d890 tx=0x7f9654008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f964d7fa700 1 -- 172.21.15.153:0/1222114691 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96540125f0 con 0x7f9658063fd0 2023-08-17T00:06:30.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f964d7fa700 1 -- 172.21.15.153:0/1222114691 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9654012750 con 0x7f9658063fd0 2023-08-17T00:06:30.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96580ac490 con 0x7f9658063fd0 2023-08-17T00:06:30.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f964d7fa700 1 -- 172.21.15.153:0/1222114691 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9654012ad0 con 0x7f9658063fd0 2023-08-17T00:06:30.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.332+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96580aca50 con 0x7f9658063fd0 2023-08-17T00:06:30.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.336+0000 7f964d7fa700 1 -- 172.21.15.153:0/1222114691 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9654013480 con 0x7f9658063fd0 2023-08-17T00:06:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.336+0000 7f964d7fa700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f963c05a180 0x7f963c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.336+0000 7f964d7fa700 1 -- 172.21.15.153:0/1222114691 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9654074110 con 0x7f9658063fd0 2023-08-17T00:06:30.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.336+0000 7f965ca76700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f963c05a180 0x7f963c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965ca76700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f963c05a180 0x7f963c05c640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f9648006fd0 tx=0x7f9648017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 Processor -- start 2023-08-17T00:06:30.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 -- start start 2023-08-17T00:06:30.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14f9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14ddef0 0x14fbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x14032d0 con 0x14fbfc0 2023-08-17T00:06:30.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1432240 con 0x14ddef0 2023-08-17T00:06:30.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14fb640 con 0x14f9580 2023-08-17T00:06:30.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35694/0 (socket says 172.21.15.153:35694) 2023-08-17T00:06:30.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 -- 172.21.15.153:0/4180209558 learned_addr learned my addr 172.21.15.153:0/4180209558 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965ca76700 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14ddef0 0x14fbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965d277700 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 -- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 msgr2=0x14f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 -- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14ddef0 msgr2=0x14fbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14ddef0 0x14fbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 -- 172.21.15.153:0/4180209558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14439d0 con 0x14fbfc0 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965ca76700 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14ddef0 0x14fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.340+0000 7f965da78700 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14b49d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f9650003b70 tx=0x7f9650009040).ready entity=mon.0 client_cookie=ad24663c2cd90022 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f96427fc700 1 -- 172.21.15.153:0/4180209558 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650006a20 con 0x14fbfc0 2023-08-17T00:06:30.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f96427fc700 1 -- 172.21.15.153:0/4180209558 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650006b80 con 0x14fbfc0 2023-08-17T00:06:30.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f96427fc700 1 -- 172.21.15.153:0/4180209558 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965000e600 con 0x14fbfc0 2023-08-17T00:06:30.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 -- 172.21.15.153:0/4180209558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 msgr2=0x14b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14b49d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f9650003b70 tx=0x7f9650009040).stop 2023-08-17T00:06:30.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 -- 172.21.15.153:0/4180209558 shutdown_connections 2023-08-17T00:06:30.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14b49d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14ddef0 0x14fbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 --2- 172.21.15.153:0/4180209558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 -- 172.21.15.153:0/4180209558 >> 172.21.15.153:0/4180209558 conn(0x1296980 msgr2=0x14b8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 -- 172.21.15.153:0/4180209558 shutdown_connections 2023-08-17T00:06:30.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 -- 172.21.15.153:0/4180209558 wait complete. 2023-08-17T00:06:30.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 -- start start 2023-08-17T00:06:30.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.344+0000 7f9669864740 1 Processor -- start 2023-08-17T00:06:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14ff550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 0x14dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14deb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x14b6fe0 con 0x14f9580 2023-08-17T00:06:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14ffa40 con 0x14fbfc0 2023-08-17T00:06:30.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14dfb80 con 0x14ddef0 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 10 client.0 ll_register_callbacks cb 0x146fa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 0x14dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 0x14dafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35702/0 (socket says 172.21.15.153:35702) 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 -- 172.21.15.153:0/1287465466 learned_addr learned my addr 172.21.15.153:0/1287465466 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965d277700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965da78700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14deb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 -- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 msgr2=0x14ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 -- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 msgr2=0x14deb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14deb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 -- 172.21.15.153:0/1287465466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965000f040 con 0x14f9580 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f965ca76700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 0x14dafc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f9648011000 tx=0x7f964801f070).ready entity=mon.0 client_cookie=b1d5e288dac25a35 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f96377fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f96377fe700 1 -- 172.21.15.153:0/1287465466 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9648027400 con 0x14f9580 2023-08-17T00:06:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f96377fe700 1 -- 172.21.15.153:0/1287465466 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9648027560 con 0x14f9580 2023-08-17T00:06:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x13f6cc0 con 0x14f9580 2023-08-17T00:06:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f96377fe700 1 -- 172.21.15.153:0/1287465466 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9648027720 con 0x14f9580 2023-08-17T00:06:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 10 client.5967 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x1431140 con 0x14f9580 2023-08-17T00:06:30.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f96377fe700 1 -- 172.21.15.153:0/1287465466 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x13f6cc0 con 0x14f9580 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f96377fe700 1 -- 172.21.15.153:0/1287465466 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9648027880 con 0x14f9580 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 10 client.5967 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 20 client.5967 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f7fa0 0x14f8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 4 client.5967 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:30.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.348+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x142de20 con 0x14f7fa0 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f965d277700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f7fa0 0x14f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f96377fe700 10 client.5967 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f965d277700 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f7fa0 0x14f8380 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=879fc1c174565d18 server_cookie=2bff759d71084875 in_seq=0 out_seq=0 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f96377fe700 1 -- 172.21.15.153:0/1287465466 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x142de20 con 0x14f7fa0 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f96377fe700 10 client.5967 handle_command_reply: tid=0 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 client.5967 shutdown 2023-08-17T00:06:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 msgr2=0x14dafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 0x14dafc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f9648011000 tx=0x7f964801f070).stop 2023-08-17T00:06:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 shutdown_connections 2023-08-17T00:06:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f7fa0 0x14f8380 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14f9580 0x14dafc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 --2- 172.21.15.153:0/1287465466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f96377fe700 0 client.5967 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 >> 172.21.15.153:0/1287465466 conn(0x1296980 msgr2=0x14dcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 shutdown_connections 2023-08-17T00:06:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 1 -- 172.21.15.153:0/1287465466 wait complete. 2023-08-17T00:06:30.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.352+0000 7f9669864740 20 client.5967 trim_cache size 0 max 16384 2023-08-17T00:06:30.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 Processor -- start 2023-08-17T00:06:30.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 -- start start 2023-08-17T00:06:30.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14fed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x14feb50 con 0x14fbfc0 2023-08-17T00:06:30.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14b7f90 con 0x14f9580 2023-08-17T00:06:30.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1410fd0 con 0x14ddef0 2023-08-17T00:06:30.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.372+0000 7f965da78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35710/0 (socket says 172.21.15.153:35710) 2023-08-17T00:06:30.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 -- 172.21.15.153:0/3116988127 learned_addr learned my addr 172.21.15.153:0/3116988127 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965d277700 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965ca76700 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 -- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 msgr2=0x14d9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 -- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14f9580 msgr2=0x14da1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 -- 172.21.15.153:0/3116988127 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580c5640 con 0x14fbfc0 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965ca76700 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f965da78700 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14fed30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f9650004210 tx=0x7f9650009040).ready entity=mon.0 client_cookie=363935cdf312b277 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9642ffd700 1 -- 172.21.15.153:0/3116988127 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9650000f40 con 0x14fbfc0 2023-08-17T00:06:30.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9642ffd700 1 -- 172.21.15.153:0/3116988127 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965000e9f0 con 0x14fbfc0 2023-08-17T00:06:30.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9642ffd700 1 -- 172.21.15.153:0/3116988127 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965000eba0 con 0x14fbfc0 2023-08-17T00:06:30.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 -- 172.21.15.153:0/3116988127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 msgr2=0x14fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14fed30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f9650004210 tx=0x7f9650009040).stop 2023-08-17T00:06:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 -- 172.21.15.153:0/3116988127 shutdown_connections 2023-08-17T00:06:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fbfc0 0x14fed30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 --2- 172.21.15.153:0/3116988127 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 -- 172.21.15.153:0/3116988127 >> 172.21.15.153:0/3116988127 conn(0x1296980 msgr2=0x14b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 -- 172.21.15.153:0/3116988127 shutdown_connections 2023-08-17T00:06:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 -- 172.21.15.153:0/3116988127 wait complete. 2023-08-17T00:06:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.376+0000 7f9669864740 1 -- start start 2023-08-17T00:06:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 Processor -- start 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1517c30 con 0x14ddef0 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14da6b0 con 0x14fbfc0 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14b45e0 con 0x14f9580 2023-08-17T00:06:30.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 10 client.0 ll_register_callbacks cb 0x7f964800bea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35720/0 (socket says 172.21.15.153:35720) 2023-08-17T00:06:30.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 -- 172.21.15.153:0/1911782279 learned_addr learned my addr 172.21.15.153:0/1911782279 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965da78700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965ca76700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 -- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 msgr2=0x14da1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 -- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 msgr2=0x14f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 -- 172.21.15.153:0/1911782279 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1431140 con 0x14ddef0 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f965d277700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 0x14d9cd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f9654047bc0 tx=0x7f965404d040).ready entity=mon.0 client_cookie=8e41bbe9422ae9d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f96377fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f96377fe700 1 -- 172.21.15.153:0/1911782279 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965404ac00 con 0x14ddef0 2023-08-17T00:06:30.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f96377fe700 1 -- 172.21.15.153:0/1911782279 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9654055040 con 0x14ddef0 2023-08-17T00:06:30.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9650006b80 con 0x14ddef0 2023-08-17T00:06:30.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f96377fe700 1 -- 172.21.15.153:0/1911782279 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f965400fba0 con 0x14ddef0 2023-08-17T00:06:30.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 10 client.5973 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x14439d0 con 0x14ddef0 2023-08-17T00:06:30.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.380+0000 7f96377fe700 1 -- 172.21.15.153:0/1911782279 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9650006b80 con 0x14ddef0 2023-08-17T00:06:30.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f96377fe700 1 -- 172.21.15.153:0/1911782279 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f965400fd00 con 0x14ddef0 2023-08-17T00:06:30.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 10 client.5973 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 10 client.5973 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 20 client.5973 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f5a30 0x155fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 4 client.5973 mds_command: new command op to 5427 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2023-08-17T00:06:30.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) v1 -- 0x1424370 con 0x14f5a30 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f965ca76700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f5a30 0x155fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f965ca76700 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f5a30 0x155fc80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b4435fae9572ba09 server_cookie=141d6c34dee0bc9b in_seq=0 out_seq=0 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f96377fe700 10 client.5973 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f96377fe700 1 -- 172.21.15.153:0/1911782279 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1424370 con 0x14f5a30 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f96377fe700 10 client.5973 handle_command_reply: tid=0 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 client.5973 shutdown 2023-08-17T00:06:30.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 msgr2=0x14d9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 0x14d9cd0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7f9654047bc0 tx=0x7f965404d040).stop 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 shutdown_connections 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x14f5a30 0x155fc80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fbfc0 0x14f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14f9580 0x14da1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 --2- 172.21.15.153:0/1911782279 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14ddef0 0x14d9cd0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 >> 172.21.15.153:0/1911782279 conn(0x1296980 msgr2=0x14b3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.395 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:06:30.384+0000 7fea9398a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000096d [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v728 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5057=0-4194304@1} caps={5057=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5057 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55e18d1d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1000000096d:[<0x10000000001/new_file_1 v728>,<0x10000000000/ceph-qa-suite v76>,<0x1/scrub_test_path v30>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-08-17T00:06:30.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f96377fe700 0 client.5973 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 shutdown_connections 2023-08-17T00:06:30.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 1 -- 172.21.15.153:0/1911782279 wait complete. 2023-08-17T00:06:30.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.384+0000 7f9669864740 20 client.5973 trim_cache size 0 max 16384 2023-08-17T00:06:30.396 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:30.397 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:06:30.397 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "c6311c56-f6c7-4fbb-b929-75becada6963", 2023-08-17T00:06:30.397 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:06:30.397 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:30.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f963c05a180 msgr2=0x7f963c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f963c05a180 0x7f963c05c640 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f9648006fd0 tx=0x7f9648017000).stop 2023-08-17T00:06:30.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 msgr2=0x7f96580a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f96580a8270 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f965400d890 tx=0x7f9654008040).stop 2023-08-17T00:06:30.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 shutdown_connections 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f963c05a180 0x7f963c05c640 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9658153f90 0x7f96580aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9658153bb0 0x7f96580a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 --2- 172.21.15.153:0/1222114691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9658063fd0 0x7f96580a8270 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 >> 172.21.15.153:0/1222114691 conn(0x7f96580c92e0 msgr2=0x7f965815a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 shutdown_connections 2023-08-17T00:06:30.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.388+0000 7f965f4db700 1 -- 172.21.15.153:0/1222114691 wait complete. 2023-08-17T00:06:30.411 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': 'c6311c56-f6c7-4fbb-b929-75becada6963', 'mode': 'asynchronous'}' 2023-08-17T00:06:30.412 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-08-17T00:06:30.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.572+0000 7fea1dc8f700 1 Processor -- start 2023-08-17T00:06:30.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.572+0000 7fea1dc8f700 1 -- start start 2023-08-17T00:06:30.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1dc8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18153f50 0x7fea18154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1dc8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fea180c01a0 0x7fea180c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1dc8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180bfd10 con 0x7fea180c57a0 2023-08-17T00:06:30.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1dc8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea18154860 con 0x7fea180c01a0 2023-08-17T00:06:30.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1dc8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18154af0 con 0x7fea18153f50 2023-08-17T00:06:30.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1cc8d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fea180c57a0 0x7fea180c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40976/0 (socket says 172.21.15.153:40976) 2023-08-17T00:06:30.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1cc8d700 1 -- 172.21.15.153:0/1061385147 learned_addr learned my addr 172.21.15.153:0/1061385147 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:30.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea1d48e700 1 --2- 172.21.15.153:0/1061385147 >> v2:172.21.15.178:3300/0 conn(0x7fea180c01a0 0x7fea180c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea17fff700 1 --2- 172.21.15.153:0/1061385147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18153f50 0x7fea18154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea177fe700 1 -- 172.21.15.153:0/1061385147 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530045753 0 0) 0x7fea180bfd10 con 0x7fea180c57a0 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea177fe700 1 -- 172.21.15.153:0/1061385147 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea000033f0 con 0x7fea180c57a0 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea17fff700 1 -- 172.21.15.153:0/1061385147 >> v2:172.21.15.178:3300/0 conn(0x7fea180c01a0 msgr2=0x7fea180c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea17fff700 1 --2- 172.21.15.153:0/1061385147 >> v2:172.21.15.178:3300/0 conn(0x7fea180c01a0 0x7fea180c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea17fff700 1 -- 172.21.15.153:0/1061385147 >> v1:172.21.15.153:6789/0 conn(0x7fea180c57a0 legacy=0x7fea180c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea17fff700 1 -- 172.21.15.153:0/1061385147 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea18154dd0 con 0x7fea18153f50 2023-08-17T00:06:30.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea17fff700 1 --2- 172.21.15.153:0/1061385147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18153f50 0x7fea18154370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fea08009760 tx=0x7fea08009060).ready entity=mon.2 client_cookie=affd70730fd01bf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea177fe700 1 -- 172.21.15.153:0/1061385147 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800d4a0 con 0x7fea18153f50 2023-08-17T00:06:30.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea177fe700 1 -- 172.21.15.153:0/1061385147 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800d600 con 0x7fea18153f50 2023-08-17T00:06:30.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.576+0000 7fea177fe700 1 -- 172.21.15.153:0/1061385147 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800d980 con 0x7fea18153f50 2023-08-17T00:06:30.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 -- 172.21.15.153:0/1061385147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18153f50 msgr2=0x7fea18154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/1061385147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18153f50 0x7fea18154370 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fea08009760 tx=0x7fea08009060).stop 2023-08-17T00:06:30.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 -- 172.21.15.153:0/1061385147 shutdown_connections 2023-08-17T00:06:30.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/1061385147 >> v2:172.21.15.178:3300/0 conn(0x7fea180c01a0 0x7fea180c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/1061385147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18153f50 0x7fea18154370 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 -- 172.21.15.153:0/1061385147 >> 172.21.15.153:0/1061385147 conn(0x7fea18062a70 msgr2=0x7fea180ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 -- 172.21.15.153:0/1061385147 shutdown_connections 2023-08-17T00:06:30.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 -- 172.21.15.153:0/1061385147 wait complete. 2023-08-17T00:06:30.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.580+0000 7fea1dc8f700 1 Processor -- start 2023-08-17T00:06:30.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 -- start start 2023-08-17T00:06:30.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea180c01a0 0x7fea18152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 0x7fea180afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18153f50 0x7fea180b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18164500 con 0x7fea180c57a0 2023-08-17T00:06:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea180b0890 con 0x7fea18153f50 2023-08-17T00:06:30.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1dc8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1815adf0 con 0x7fea180c01a0 2023-08-17T00:06:30.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 0x7fea180afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1cc8d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea180c01a0 0x7fea18152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 0x7fea180afeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35736/0 (socket says 172.21.15.153:35736) 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 -- 172.21.15.153:0/3040631737 learned_addr learned my addr 172.21.15.153:0/3040631737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea1d48e700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18153f50 0x7fea180b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 -- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea180c01a0 msgr2=0x7fea18152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea180c01a0 0x7fea18152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 -- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18153f50 msgr2=0x7fea180b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18153f50 0x7fea180b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 -- 172.21.15.153:0/3040631737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080092a0 con 0x7fea180c57a0 2023-08-17T00:06:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea17fff700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 0x7fea180afeb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fea0800d260 tx=0x7fea08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.584+0000 7fea14ff9700 1 -- 172.21.15.153:0/3040631737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800dd30 con 0x7fea180c57a0 2023-08-17T00:06:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.588+0000 7fea14ff9700 1 -- 172.21.15.153:0/3040631737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0800de90 con 0x7fea180c57a0 2023-08-17T00:06:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.588+0000 7fea14ff9700 1 -- 172.21.15.153:0/3040631737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800d9a0 con 0x7fea180c57a0 2023-08-17T00:06:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.588+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea181568e0 con 0x7fea180c57a0 2023-08-17T00:06:30.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.588+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18156290 con 0x7fea180c57a0 2023-08-17T00:06:30.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.588+0000 7fea14ff9700 1 -- 172.21.15.153:0/3040631737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fea0800f070 con 0x7fea180c57a0 2023-08-17T00:06:30.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea14ff9700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea0405a120 0x7fea0405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea14ff9700 1 -- 172.21.15.153:0/3040631737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea080758b0 con 0x7fea180c57a0 2023-08-17T00:06:30.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea0405a120 0x7fea0405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 Processor -- start 2023-08-17T00:06:30.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea0405a120 0x7fea0405c5e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fea0c007fd0 tx=0x7fea0c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 -- start start 2023-08-17T00:06:30.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15ee050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15c35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15141a0 con 0x16099f0 2023-08-17T00:06:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x160a9b0 con 0x15c8330 2023-08-17T00:06:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.592+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15ee960 con 0x1609dd0 2023-08-17T00:06:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15ee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15ee050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35750/0 (socket says 172.21.15.153:35750) 2023-08-17T00:06:30.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2137502906 learned_addr learned my addr 172.21.15.153:0/2137502906 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1d48e700 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea17fff700 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15c35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 msgr2=0x15c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 msgr2=0x15c35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15c35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2137502906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1542010 con 0x16099f0 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15ee050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fea0c00f770 tx=0x7fea0c013000).ready entity=mon.0 client_cookie=de3bc850d4cdd58 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fe9fdffb700 1 -- 172.21.15.153:0/2137502906 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c00fe60 con 0x16099f0 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fe9fdffb700 1 -- 172.21.15.153:0/2137502906 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c013600 con 0x16099f0 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fe9fdffb700 1 -- 172.21.15.153:0/2137502906 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c013980 con 0x16099f0 2023-08-17T00:06:30.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 -- 172.21.15.153:0/2137502906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 msgr2=0x15ee050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15ee050 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fea0c00f770 tx=0x7fea0c013000).stop 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 -- 172.21.15.153:0/2137502906 shutdown_connections 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15c35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 --2- 172.21.15.153:0/2137502906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15ee050 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 -- 172.21.15.153:0/2137502906 >> 172.21.15.153:0/2137502906 conn(0x13a7680 msgr2=0x160ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 -- 172.21.15.153:0/2137502906 shutdown_connections 2023-08-17T00:06:30.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 -- 172.21.15.153:0/2137502906 wait complete. 2023-08-17T00:06:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.596+0000 7fea292c4740 1 -- start start 2023-08-17T00:06:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 Processor -- start 2023-08-17T00:06:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c8330 0x161b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15f4fd0 con 0x16099f0 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c5de0 con 0x1609dd0 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15f2d80 con 0x15c8330 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 10 client.0 ll_register_callbacks cb 0x157f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35766/0 (socket says 172.21.15.153:35766) 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 -- 172.21.15.153:0/2133525449 learned_addr learned my addr 172.21.15.153:0/2133525449 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c8330 0x161b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea1d48e700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 -- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c8330 msgr2=0x161b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c8330 0x161b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 -- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 msgr2=0x15f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 -- 172.21.15.153:0/2133525449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea000033f0 con 0x16099f0 2023-08-17T00:06:30.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c8330 0x161b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea17fff700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15f45f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fea0804ce40 tx=0x7fea08075040).ready entity=mon.0 client_cookie=497bebd2277ff2ad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fe9f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2133525449 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08049620 con 0x16099f0 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2133525449 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea08049780 con 0x16099f0 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1510200 con 0x16099f0 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2133525449 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea08032ea0 con 0x16099f0 2023-08-17T00:06:30.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 10 client.5985 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.600+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x153d4b0 con 0x16099f0 2023-08-17T00:06:30.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2133525449 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1510200 con 0x16099f0 2023-08-17T00:06:30.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2133525449 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea080523c0 con 0x16099f0 2023-08-17T00:06:30.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 10 client.5985 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 10 client.5985 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 20 client.5985 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x15f3ff0 0x15c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 4 client.5985 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:30.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x153ecf0 con 0x15f3ff0 2023-08-17T00:06:30.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x15f3ff0 0x15c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x15f3ff0 0x15c53b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a6a1bae16d6421cc server_cookie=cb1619b5838eafc5 in_seq=0 out_seq=0 2023-08-17T00:06:30.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fe9f6ffd700 10 client.5985 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2133525449 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x153ecf0 con 0x15f3ff0 2023-08-17T00:06:30.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fe9f6ffd700 10 client.5985 handle_command_reply: tid=0 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 client.5985 shutdown 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 msgr2=0x15f45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15f45f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fea0804ce40 tx=0x7fea08075040).stop 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 shutdown_connections 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x15f3ff0 0x15c53b0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15f45f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fe9f6ffd700 0 client.5985 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 --2- 172.21.15.153:0/2133525449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c8330 0x161b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 >> 172.21.15.153:0/2133525449 conn(0x13a7680 msgr2=0x160c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 shutdown_connections 2023-08-17T00:06:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 1 -- 172.21.15.153:0/2133525449 wait complete. 2023-08-17T00:06:30.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.604+0000 7fea292c4740 20 client.5985 trim_cache size 0 max 16384 2023-08-17T00:06:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 Processor -- start 2023-08-17T00:06:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 -- start start 2023-08-17T00:06:30.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15eca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15936a0 con 0x16099f0 2023-08-17T00:06:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x152b710 con 0x15c8330 2023-08-17T00:06:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15f4450 con 0x1609dd0 2023-08-17T00:06:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea17fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35778/0 (socket says 172.21.15.153:35778) 2023-08-17T00:06:30.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.624+0000 7fea17fff700 1 -- 172.21.15.153:0/29443466 learned_addr learned my addr 172.21.15.153:0/29443466 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea1d48e700 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea17fff700 1 -- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 msgr2=0x15c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea17fff700 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea17fff700 1 -- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 msgr2=0x15eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea17fff700 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea17fff700 1 -- 172.21.15.153:0/29443466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180c7540 con 0x16099f0 2023-08-17T00:06:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea17fff700 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15c5f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fea0804b260 tx=0x7fea0802f000).ready entity=mon.0 client_cookie=36b1d09dcd27e313 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fe9fe7fc700 1 -- 172.21.15.153:0/29443466 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea08032ea0 con 0x16099f0 2023-08-17T00:06:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fe9fe7fc700 1 -- 172.21.15.153:0/29443466 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0804e040 con 0x16099f0 2023-08-17T00:06:30.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fe9fe7fc700 1 -- 172.21.15.153:0/29443466 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0800d4a0 con 0x16099f0 2023-08-17T00:06:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 -- 172.21.15.153:0/29443466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 msgr2=0x15c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15c5f20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fea0804b260 tx=0x7fea0802f000).stop 2023-08-17T00:06:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 -- 172.21.15.153:0/29443466 shutdown_connections 2023-08-17T00:06:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 --2- 172.21.15.153:0/29443466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15c8330 0x15eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 -- 172.21.15.153:0/29443466 >> 172.21.15.153:0/29443466 conn(0x13a7680 msgr2=0x161b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 -- 172.21.15.153:0/29443466 shutdown_connections 2023-08-17T00:06:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 -- 172.21.15.153:0/29443466 wait complete. 2023-08-17T00:06:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.628+0000 7fea292c4740 1 -- start start 2023-08-17T00:06:30.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 Processor -- start 2023-08-17T00:06:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 0x166e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c6900 con 0x15c8330 2023-08-17T00:06:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15ec690 con 0x1609dd0 2023-08-17T00:06:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1672500 con 0x16099f0 2023-08-17T00:06:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea292c4740 10 client.0 ll_register_callbacks cb 0x7fea08000dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea1cc8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 0x166e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea1cc8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 0x166e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35790/0 (socket says 172.21.15.153:35790) 2023-08-17T00:06:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2393767911 learned_addr learned my addr 172.21.15.153:0/2393767911 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea17fff700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.632+0000 7fea1d48e700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16099f0 msgr2=0x15c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 msgr2=0x15c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1cc8d700 1 -- 172.21.15.153:0/2393767911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x153d4b0 con 0x15c8330 2023-08-17T00:06:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1d48e700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea1cc8d700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 0x166e940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fea0c017000 tx=0x7fea0c016070).ready entity=mon.0 client_cookie=475ebf909d6ba113 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2393767911 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0c027040 con 0x15c8330 2023-08-17T00:06:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2393767911 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fea0c006080 con 0x15c8330 2023-08-17T00:06:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea0c013600 con 0x15c8330 2023-08-17T00:06:30.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2393767911 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea0c006450 con 0x15c8330 2023-08-17T00:06:30.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 10 client.5991 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x153d200 con 0x15c8330 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2393767911 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0c013600 con 0x15c8330 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2393767911 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fea0c0046b0 con 0x15c8330 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 10 client.5991 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 10 client.5991 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 20 client.5991 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x160aaf0 0x15efef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 4 client.5991 mds_command: new command op to 5427 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1535240 con 0x160aaf0 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea17fff700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x160aaf0 0x15efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea17fff700 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x160aaf0 0x15efef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fa4635a545c30532 server_cookie=d08281780dfd3b0e in_seq=0 out_seq=0 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 10 client.5991 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 1 -- 172.21.15.153:0/2393767911 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1535240 con 0x160aaf0 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fe9f6ffd700 10 client.5991 handle_command_reply: tid=0 2023-08-17T00:06:30.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.636+0000 7fea292c4740 1 client.5991 shutdown 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 msgr2=0x166e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 0x166e940 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fea0c017000 tx=0x7fea0c016070).stop 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 shutdown_connections 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x160aaf0 0x15efef0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1609dd0 0x15c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16099f0 0x15c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 --2- 172.21.15.153:0/2393767911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c8330 0x166e940 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fe9f6ffd700 0 client.5991 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 >> 172.21.15.153:0/2393767911 conn(0x13a7680 msgr2=0x161b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 shutdown_connections 2023-08-17T00:06:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 1 -- 172.21.15.153:0/2393767911 wait complete. 2023-08-17T00:06:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea292c4740 20 client.5991 trim_cache size 0 max 16384 2023-08-17T00:06:30.649 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:06:30.649 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:06:30.649 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea0405a120 msgr2=0x7fea0405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea0405a120 0x7fea0405c5e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fea0c007fd0 tx=0x7fea0c009040).stop 2023-08-17T00:06:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 msgr2=0x7fea180afeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 0x7fea180afeb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7fea0800d260 tx=0x7fea08016000).stop 2023-08-17T00:06:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 shutdown_connections 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea0405a120 0x7fea0405c5e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18153f50 0x7fea180b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea180c57a0 0x7fea180afeb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 --2- 172.21.15.153:0/3040631737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea180c01a0 0x7fea18152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 >> 172.21.15.153:0/3040631737 conn(0x7fea18062a70 msgr2=0x7fea180aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 shutdown_connections 2023-08-17T00:06:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.640+0000 7fea1dc8f700 1 -- 172.21.15.153:0/3040631737 wait complete. 2023-08-17T00:06:30.665 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:06:30.666 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-08-17T00:06:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.824+0000 7f44a5307700 1 Processor -- start 2023-08-17T00:06:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.824+0000 7f44a5307700 1 -- start start 2023-08-17T00:06:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44a0153a60 0x7f44a00c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00a8280 con 0x7f44a00bed50 2023-08-17T00:06:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00c4690 con 0x7f44a0153680 2023-08-17T00:06:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a0153ef0 con 0x7f44a0153a60 2023-08-17T00:06:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f44a00bed50 0x7f44a0095430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40988/0 (socket says 172.21.15.153:40988) 2023-08-17T00:06:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449f7fe700 1 -- 172.21.15.153:0/1974521228 learned_addr learned my addr 172.21.15.153:0/1974521228 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a4b06700 1 --2- 172.21.15.153:0/1974521228 >> v2:172.21.15.153:3300/0 conn(0x7f44a0153a60 0x7f44a00c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623738761 0 0) 0x7f44a00a8280 con 0x7f44a00bed50 2023-08-17T00:06:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44880033f0 con 0x7f44a00bed50 2023-08-17T00:06:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676089554 0 0) 0x7f44a00c4690 con 0x7f44a0153680 2023-08-17T00:06:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a00a8280 con 0x7f44a0153680 2023-08-17T00:06:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a4b06700 1 -- 172.21.15.153:0/1974521228 >> v1:172.21.15.178:6789/0 conn(0x7f44a0153680 legacy=0x7f44a00be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a4b06700 1 -- 172.21.15.153:0/1974521228 >> v1:172.21.15.153:6789/0 conn(0x7f44a00bed50 legacy=0x7f44a0095430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a4b06700 1 -- 172.21.15.153:0/1974521228 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00c4970 con 0x7f44a0153a60 2023-08-17T00:06:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a4b06700 1 --2- 172.21.15.153:0/1974521228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a0153a60 0x7f44a00c3f90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f4498009e60 tx=0x7f4498009780).ready entity=mon.0 client_cookie=629c7409109bd2ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449800e070 con 0x7f44a0153a60 2023-08-17T00:06:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449800bab0 con 0x7f44a0153a60 2023-08-17T00:06:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f449effd700 1 -- 172.21.15.153:0/1974521228 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449800be30 con 0x7f44a0153a60 2023-08-17T00:06:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- 172.21.15.153:0/1974521228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a0153a60 msgr2=0x7f44a00c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 --2- 172.21.15.153:0/1974521228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a0153a60 0x7f44a00c3f90 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f4498009e60 tx=0x7f4498009780).stop 2023-08-17T00:06:30.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- 172.21.15.153:0/1974521228 shutdown_connections 2023-08-17T00:06:30.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 --2- 172.21.15.153:0/1974521228 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a0153a60 0x7f44a00c3f90 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- 172.21.15.153:0/1974521228 >> 172.21.15.153:0/1974521228 conn(0x7f44a00c5170 msgr2=0x7f44a00c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- 172.21.15.153:0/1974521228 shutdown_connections 2023-08-17T00:06:30.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.828+0000 7f44a5307700 1 -- 172.21.15.153:0/1974521228 wait complete. 2023-08-17T00:06:30.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 Processor -- start 2023-08-17T00:06:30.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 -- start start 2023-08-17T00:06:30.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 0x7f44a0145270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a0153680 0x7f44a01549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a0153a60 0x7f44a0154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a01565a0 con 0x7f44a00bed50 2023-08-17T00:06:30.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0145760 con 0x7f44a0153680 2023-08-17T00:06:30.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f44a5307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0156110 con 0x7f44a0153a60 2023-08-17T00:06:30.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f449ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 0x7f44a0145270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f449ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 0x7f44a0145270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35804/0 (socket says 172.21.15.153:35804) 2023-08-17T00:06:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.832+0000 7f449ffff700 1 -- 172.21.15.153:0/756374076 learned_addr learned my addr 172.21.15.153:0/756374076 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449f7fe700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a0153680 0x7f44a01549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f44a4b06700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a0153a60 0x7f44a0154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449ffff700 1 -- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a0153a60 msgr2=0x7f44a0154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449ffff700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a0153a60 0x7f44a0154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449ffff700 1 -- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a0153680 msgr2=0x7f44a01549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449ffff700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a0153680 0x7f44a01549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449ffff700 1 -- 172.21.15.153:0/756374076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009a20 con 0x7f44a00bed50 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f449ffff700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 0x7f44a0145270 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f449000c4f0 tx=0x7f4490007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f4487fff700 1 -- 172.21.15.153:0/756374076 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000f470 con 0x7f44a00bed50 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f4487fff700 1 -- 172.21.15.153:0/756374076 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f449000f5d0 con 0x7f44a00bed50 2023-08-17T00:06:30.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0155500 con 0x7f44a00bed50 2023-08-17T00:06:30.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f4487fff700 1 -- 172.21.15.153:0/756374076 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000f990 con 0x7f44a00bed50 2023-08-17T00:06:30.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.836+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0155ac0 con 0x7f44a00bed50 2023-08-17T00:06:30.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f4487fff700 1 -- 172.21.15.153:0/756374076 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4490019030 con 0x7f44a00bed50 2023-08-17T00:06:30.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f4487fff700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a180 0x7f448c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f4487fff700 1 -- 172.21.15.153:0/756374076 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f44900735f0 con 0x7f44a00bed50 2023-08-17T00:06:30.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f449f7fe700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a180 0x7f448c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f449f7fe700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a180 0x7f448c05c640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f44a0151ec0 tx=0x7f4494009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f44b0911740 1 Processor -- start 2023-08-17T00:06:30.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.840+0000 7f44b0911740 1 -- start start 2023-08-17T00:06:30.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2948a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44b0911740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2922ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x291fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44b0911740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x286f1a0 con 0x2923270 2023-08-17T00:06:30.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x291da00 con 0x291de90 2023-08-17T00:06:30.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x291d3f0 con 0x29228c0 2023-08-17T00:06:30.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2922ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2922ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35808/0 (socket says 172.21.15.153:35808) 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 -- 172.21.15.153:0/2133239885 learned_addr learned my addr 172.21.15.153:0/2133239885 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44a4b06700 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x291fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449ffff700 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2948a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 -- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 msgr2=0x2948a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2948a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 -- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 msgr2=0x291fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x291fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 -- 172.21.15.153:0/2133239885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28aee30 con 0x2923270 2023-08-17T00:06:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44a4b06700 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x291fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f449f7fe700 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2922ca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4494007320 tx=0x7f4494007000).ready entity=mon.0 client_cookie=8be576365bd46a4c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44857fa700 1 -- 172.21.15.153:0/2133239885 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494015410 con 0x2923270 2023-08-17T00:06:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44857fa700 1 -- 172.21.15.153:0/2133239885 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4494015570 con 0x2923270 2023-08-17T00:06:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.844+0000 7f44857fa700 1 -- 172.21.15.153:0/2133239885 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494015910 con 0x2923270 2023-08-17T00:06:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- 172.21.15.153:0/2133239885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 msgr2=0x2922ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2922ca0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f4494007320 tx=0x7f4494007000).stop 2023-08-17T00:06:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- 172.21.15.153:0/2133239885 shutdown_connections 2023-08-17T00:06:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x291fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2922ca0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- 172.21.15.153:0/2133239885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2948a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- 172.21.15.153:0/2133239885 >> 172.21.15.153:0/2133239885 conn(0x2702680 msgr2=0x2969960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- 172.21.15.153:0/2133239885 shutdown_connections 2023-08-17T00:06:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- 172.21.15.153:0/2133239885 wait complete. 2023-08-17T00:06:30.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- start start 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 Processor -- start 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x29602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 0x294d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2923270 0x294dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x294af00 con 0x29228c0 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2976530 con 0x291de90 2023-08-17T00:06:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x294ad60 con 0x2923270 2023-08-17T00:06:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f44b0911740 10 client.0 ll_register_callbacks cb 0x2865b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f449f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 0x294d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f449f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 0x294d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35810/0 (socket says 172.21.15.153:35810) 2023-08-17T00:06:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.848+0000 7f449f7fe700 1 -- 172.21.15.153:0/2246796437 learned_addr learned my addr 172.21.15.153:0/2246796437 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449ffff700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x29602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44a4b06700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2923270 0x294dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449f7fe700 1 -- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2923270 msgr2=0x294dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449f7fe700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2923270 0x294dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449f7fe700 1 -- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 msgr2=0x29602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449f7fe700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x29602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449f7fe700 1 -- 172.21.15.153:0/2246796437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449400f040 con 0x29228c0 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449f7fe700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 0x294d770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4494007790 tx=0x7f4494012000).ready entity=mon.0 client_cookie=3badd66b34f9be17 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 1 -- 172.21.15.153:0/2246796437 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940156e0 con 0x29228c0 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 1 -- 172.21.15.153:0/2246796437 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4494015840 con 0x29228c0 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2899cf0 con 0x29228c0 2023-08-17T00:06:30.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 1 -- 172.21.15.153:0/2246796437 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4494013630 con 0x29228c0 2023-08-17T00:06:30.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 10 client.6006 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x289d010 con 0x29228c0 2023-08-17T00:06:30.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 1 -- 172.21.15.153:0/2246796437 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2899cf0 con 0x29228c0 2023-08-17T00:06:30.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 1 -- 172.21.15.153:0/2246796437 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4494013790 con 0x29228c0 2023-08-17T00:06:30.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 10 client.6006 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 10 client.6006 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 20 client.6006 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x294cbb0 0x294cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 4 client.6006 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2890240 con 0x294cbb0 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449ffff700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x294cbb0 0x294cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f449ffff700 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x294cbb0 0x294cfc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=edc38647c83f2d30 server_cookie=3b87d43836dd0232 in_seq=0 out_seq=0 2023-08-17T00:06:30.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.852+0000 7f447e7fc700 10 client.6006 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f447e7fc700 1 -- 172.21.15.153:0/2246796437 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2890240 con 0x294cbb0 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f447e7fc700 10 client.6006 handle_command_reply: tid=0 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 client.6006 shutdown 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 msgr2=0x294d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 0x294d770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4494007790 tx=0x7f4494012000).stop 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 shutdown_connections 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x294cbb0 0x294cfc0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2923270 0x294dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29228c0 0x294d770 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 --2- 172.21.15.153:0/2246796437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x291de90 0x29602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 >> 172.21.15.153:0/2246796437 conn(0x2702680 msgr2=0x2947c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f447e7fc700 0 client.6006 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 shutdown_connections 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 1 -- 172.21.15.153:0/2246796437 wait complete. 2023-08-17T00:06:30.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.856+0000 7f44b0911740 20 client.6006 trim_cache size 0 max 16384 2023-08-17T00:06:30.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 Processor -- start 2023-08-17T00:06:30.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 -- start start 2023-08-17T00:06:30.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 0x2939420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2939910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2923270 0x295f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2948840 con 0x291de90 2023-08-17T00:06:30.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e5de0 con 0x2923270 2023-08-17T00:06:30.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28fee10 con 0x29228c0 2023-08-17T00:06:30.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 0x2939420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 0x2939420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35816/0 (socket says 172.21.15.153:35816) 2023-08-17T00:06:30.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 -- 172.21.15.153:0/2230428588 learned_addr learned my addr 172.21.15.153:0/2230428588 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 -- 172.21.15.153:0/2230428588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 msgr2=0x2939910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2939910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 -- 172.21.15.153:0/2230428588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2923270 msgr2=0x295f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2923270 0x295f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 -- 172.21.15.153:0/2230428588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00bdf40 con 0x291de90 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f449ffff700 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 0x2939420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f44900470a0 tx=0x7f4490052040).ready entity=mon.0 client_cookie=c6fbff1178610c28 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f4485ffb700 1 -- 172.21.15.153:0/2230428588 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449004f040 con 0x291de90 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f4485ffb700 1 -- 172.21.15.153:0/2230428588 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4490048df0 con 0x291de90 2023-08-17T00:06:30.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.872+0000 7f4485ffb700 1 -- 172.21.15.153:0/2230428588 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490048f90 con 0x291de90 2023-08-17T00:06:30.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 -- 172.21.15.153:0/2230428588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 msgr2=0x2939420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 0x2939420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f44900470a0 tx=0x7f4490052040).stop 2023-08-17T00:06:30.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 -- 172.21.15.153:0/2230428588 shutdown_connections 2023-08-17T00:06:30.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2923270 0x295f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:30.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29228c0 0x2939910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:30.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 --2- 172.21.15.153:0/2230428588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x291de90 0x2939420 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 -- 172.21.15.153:0/2230428588 >> 172.21.15.153:0/2230428588 conn(0x2702680 msgr2=0x291ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 -- 172.21.15.153:0/2230428588 shutdown_connections 2023-08-17T00:06:30.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 -- 172.21.15.153:0/2230428588 wait complete. 2023-08-17T00:06:30.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 -- start start 2023-08-17T00:06:30.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.876+0000 7f44b0911740 1 Processor -- start 2023-08-17T00:06:30.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x291de90 0x29cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29228c0 0x2960920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2947010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2921f10 con 0x2923270 2023-08-17T00:06:30.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29613d0 con 0x29228c0 2023-08-17T00:06:30.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2935fc0 con 0x291de90 2023-08-17T00:06:30.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 10 client.0 ll_register_callbacks cb 0x7f44940076e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:30.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2947010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2947010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35824/0 (socket says 172.21.15.153:35824) 2023-08-17T00:06:30.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 -- 172.21.15.153:0/3749963862 learned_addr learned my addr 172.21.15.153:0/3749963862 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f449ffff700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x291de90 0x29cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f449f7fe700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29228c0 0x2960920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 -- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x291de90 msgr2=0x29cae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x291de90 0x29cae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 -- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29228c0 msgr2=0x2960920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29228c0 0x2960920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 -- 172.21.15.153:0/3749963862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0155ac0 con 0x2923270 2023-08-17T00:06:30.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f449f7fe700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29228c0 0x2960920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:30.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44a4b06700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2947010 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f44a006bc30 tx=0x7f4498009780).ready entity=mon.0 client_cookie=94e8f53bc0d6fba2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:30.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f447e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:30.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f447e7fc700 1 -- 172.21.15.153:0/3749963862 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498012de0 con 0x2923270 2023-08-17T00:06:30.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2759610 con 0x2923270 2023-08-17T00:06:30.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.880+0000 7f447e7fc700 1 -- 172.21.15.153:0/3749963862 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f449801d3f0 con 0x2923270 2023-08-17T00:06:30.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 1 -- 172.21.15.153:0/3749963862 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f449801d7c0 con 0x2923270 2023-08-17T00:06:30.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 10 client.6012 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x28984b0 con 0x2923270 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 1 -- 172.21.15.153:0/3749963862 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2759610 con 0x2923270 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 1 -- 172.21.15.153:0/3749963862 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f449801d920 con 0x2923270 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 10 client.6012 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 10 client.6012 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 20 client.6012 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:30.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2974f10 0x29752f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:30.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 4 client.6012 mds_command: new command op to 5427 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:06:30.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x270f390 con 0x2974f10 2023-08-17T00:06:30.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f449ffff700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2974f10 0x29752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:30.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 10 client.6012 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f449ffff700 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2974f10 0x29752f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e8313a464f106a8a server_cookie=6acf527a77243cb7 in_seq=0 out_seq=0 2023-08-17T00:06:30.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 1 -- 172.21.15.153:0/3749963862 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x270f390 con 0x2974f10 2023-08-17T00:06:30.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 10 client.6012 handle_command_reply: tid=0 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 client.6012 shutdown 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 msgr2=0x2947010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2947010 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f44a006bc30 tx=0x7f4498009780).stop 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 shutdown_connections 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x2974f10 0x29752f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2923270 0x2947010 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29228c0 0x2960920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 --2- 172.21.15.153:0/3749963862 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x291de90 0x29cae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f447e7fc700 0 client.6012 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:30.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 >> 172.21.15.153:0/3749963862 conn(0x2702680 msgr2=0x29496f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 shutdown_connections 2023-08-17T00:06:30.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 1 -- 172.21.15.153:0/3749963862 wait complete. 2023-08-17T00:06:30.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.884+0000 7f44b0911740 20 client.6012 trim_cache size 0 max 16384 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "damage_type": "backtrace", 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 2754853346, 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 1099511630189, 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2023-08-17T00:06:30.895 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:30.896 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:06:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a180 msgr2=0x7f448c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a180 0x7f448c05c640 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f44a0151ec0 tx=0x7f4494009040).stop 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 msgr2=0x7f44a0145270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 0x7f44a0145270 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f449000c4f0 tx=0x7f4490007c80).stop 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 shutdown_connections 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a180 0x7f448c05c640 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a0153a60 0x7f44a0154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a0153680 0x7f44a01549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 --2- 172.21.15.153:0/756374076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a00bed50 0x7f44a0145270 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:30.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 >> 172.21.15.153:0/756374076 conn(0x7f44a00c5170 msgr2=0x7f44a01500e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:30.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 shutdown_connections 2023-08-17T00:06:30.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:30.888+0000 7f44a5307700 1 -- 172.21.15.153:0/756374076 wait complete. 2023-08-17T00:06:30.910 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:31.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.056+0000 7f75e0f07700 1 Processor -- start 2023-08-17T00:06:31.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.056+0000 7f75e0f07700 1 -- start start 2023-08-17T00:06:31.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75e0f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75e0f07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75dc068820 0x7f75dc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75e0f07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc1585a0 con 0x7f75dc061fa0 2023-08-17T00:06:31.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75e0f07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc066400 con 0x7f75dc068820 2023-08-17T00:06:31.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75e0f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc069170 con 0x7f75dc0a8df0 2023-08-17T00:06:31.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75dbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f75dc061fa0 0x7f75dc062420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41002/0 (socket says 172.21.15.153:41002) 2023-08-17T00:06:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75dbfff700 1 -- 172.21.15.153:0/3006461508 learned_addr learned my addr 172.21.15.153:0/3006461508 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75daffd700 1 --2- 172.21.15.153:0/3006461508 >> v2:172.21.15.178:3300/0 conn(0x7f75dc068820 0x7f75dc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75db7fe700 1 --2- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75da7fc700 1 -- 172.21.15.153:0/3006461508 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1508431465 0 0) 0x7f75dc1585a0 con 0x7f75dc061fa0 2023-08-17T00:06:31.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75da7fc700 1 -- 172.21.15.153:0/3006461508 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c40033f0 con 0x7f75dc061fa0 2023-08-17T00:06:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75daffd700 1 -- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 msgr2=0x7f75dc0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75daffd700 1 --2- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75daffd700 1 -- 172.21.15.153:0/3006461508 >> v1:172.21.15.153:6789/0 conn(0x7f75dc061fa0 legacy=0x7f75dc062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75daffd700 1 -- 172.21.15.153:0/3006461508 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0b9d30 con 0x7f75dc068820 2023-08-17T00:06:31.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75daffd700 1 --2- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc068c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f75d0009760 tx=0x7f75d0009060).ready entity=mon.1 client_cookie=f95b562c51838047 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75da7fc700 1 -- 172.21.15.153:0/3006461508 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000d4a0 con 0x7f75dc068820 2023-08-17T00:06:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75da7fc700 1 -- 172.21.15.153:0/3006461508 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000d600 con 0x7f75dc068820 2023-08-17T00:06:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.060+0000 7f75da7fc700 1 -- 172.21.15.153:0/3006461508 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000d980 con 0x7f75dc068820 2023-08-17T00:06:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 -- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 msgr2=0x7f75dc068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 --2- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc068c80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f75d0009760 tx=0x7f75d0009060).stop 2023-08-17T00:06:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 -- 172.21.15.153:0/3006461508 shutdown_connections 2023-08-17T00:06:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 --2- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc068c80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 --2- 172.21.15.153:0/3006461508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 -- 172.21.15.153:0/3006461508 >> 172.21.15.153:0/3006461508 conn(0x7f75dc0c6620 msgr2=0x7f75dc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 -- 172.21.15.153:0/3006461508 shutdown_connections 2023-08-17T00:06:31.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 -- 172.21.15.153:0/3006461508 wait complete. 2023-08-17T00:06:31.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 Processor -- start 2023-08-17T00:06:31.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.064+0000 7f75e0f07700 1 -- start start 2023-08-17T00:06:31.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 0x7f75dc156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc0ba8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0badd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0bb2c0 con 0x7f75dc061fa0 2023-08-17T00:06:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0bf1a0 con 0x7f75dc068820 2023-08-17T00:06:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0ba270 con 0x7f75dc0a8df0 2023-08-17T00:06:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 0x7f75dc156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 0x7f75dc156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35832/0 (socket says 172.21.15.153:35832) 2023-08-17T00:06:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 -- 172.21.15.153:0/4001303731 learned_addr learned my addr 172.21.15.153:0/4001303731 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75daffd700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc0ba8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75dbfff700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0badd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 -- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 msgr2=0x7f75dc0badd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0badd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 -- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 msgr2=0x7f75dc0ba8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc0ba8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 -- 172.21.15.153:0/4001303731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d00092a0 con 0x7f75dc061fa0 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75dbfff700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75db7fe700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 0x7f75dc156e10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f75cc00e900 tx=0x7f75cc006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00ee40 con 0x7f75dc061fa0 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75cc00c850 con 0x7f75dc061fa0 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc0bb4c0 con 0x7f75dc061fa0 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75cc00cbd0 con 0x7f75dc061fa0 2023-08-17T00:06:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.068+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc0be920 con 0x7f75dc061fa0 2023-08-17T00:06:31.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.072+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc0bef50 con 0x7f75dc061fa0 2023-08-17T00:06:31.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.072+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f75cc022070 con 0x7f75dc061fa0 2023-08-17T00:06:31.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.072+0000 7f75c37fe700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75c805a180 0x7f75c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.072+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f75cc074510 con 0x7f75dc061fa0 2023-08-17T00:06:31.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.072+0000 7f75daffd700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75c805a180 0x7f75c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.076+0000 7f75daffd700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75c805a180 0x7f75c805c640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f75d0009760 tx=0x7f75d0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.080+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75cc047eb0 con 0x7f75dc061fa0 2023-08-17T00:06:31.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.276+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75dc06b4c0 con 0x7f75dc061fa0 2023-08-17T00:06:31.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75c37fe700 1 -- 172.21.15.153:0/4001303731 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f75cc016020 con 0x7f75dc061fa0 2023-08-17T00:06:31.284 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:31.284 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:31.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75c805a180 msgr2=0x7f75c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75c805a180 0x7f75c805c640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f75d0009760 tx=0x7f75d0016000).stop 2023-08-17T00:06:31.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 msgr2=0x7f75dc156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 0x7f75dc156e10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f75cc00e900 tx=0x7f75cc006f40).stop 2023-08-17T00:06:31.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 shutdown_connections 2023-08-17T00:06:31.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75c805a180 0x7f75c805c640 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75dc0a8df0 0x7f75dc0badd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75dc068820 0x7f75dc0ba8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 --2- 172.21.15.153:0/4001303731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75dc061fa0 0x7f75dc156e10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 >> 172.21.15.153:0/4001303731 conn(0x7f75dc0c6620 msgr2=0x7f75dc0645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 shutdown_connections 2023-08-17T00:06:31.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.280+0000 7f75e0f07700 1 -- 172.21.15.153:0/4001303731 wait complete. 2023-08-17T00:06:31.289 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:31.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 2754853346 2023-08-17T00:06:31.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.460+0000 7faaa52f1700 1 Processor -- start 2023-08-17T00:06:31.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.460+0000 7faaa52f1700 1 -- start start 2023-08-17T00:06:31.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faaa52f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faaa0151630 0x7faaa00bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faaa52f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faaa0066130 0x7faaa01553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faaa52f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa0062c90 con 0x7faaa0151a10 2023-08-17T00:06:31.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faaa52f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa00657d0 con 0x7faaa0066130 2023-08-17T00:06:31.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faaa52f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa00665e0 con 0x7faaa0151630 2023-08-17T00:06:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faa9f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faaa0066130 0x7faaa01553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faa9f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faaa0066130 0x7faaa01553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35846/0 (socket says 172.21.15.153:35846) 2023-08-17T00:06:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faa9e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7faaa0151a10 0x7faaa0063120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41016/0 (socket says 172.21.15.153:41016) 2023-08-17T00:06:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2773803911 learned_addr learned my addr 172.21.15.153:0/2773803911 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.464+0000 7faa9effd700 1 --2- 172.21.15.153:0/2773803911 >> v2:172.21.15.178:3300/0 conn(0x7faaa0151630 0x7faaa00bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2773803911 >> v2:172.21.15.178:3300/0 conn(0x7faaa0151630 msgr2=0x7faaa00bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/2773803911 >> v2:172.21.15.178:3300/0 conn(0x7faaa0151630 0x7faaa00bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2773803911 >> v1:172.21.15.153:6789/0 conn(0x7faaa0151a10 legacy=0x7faaa0063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2773803911 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa0062980 con 0x7faaa0066130 2023-08-17T00:06:31.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9dffb700 1 -- 172.21.15.153:0/2773803911 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158536173 0 0) 0x7faaa0062c90 con 0x7faaa0151a10 2023-08-17T00:06:31.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/2773803911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0066130 0x7faaa01553f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7faaa0063b80 tx=0x7faa98009840).ready entity=mon.0 client_cookie=52a43b6aede2494c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9dffb700 1 -- 172.21.15.153:0/2773803911 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800e070 con 0x7faaa0066130 2023-08-17T00:06:31.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9dffb700 1 -- 172.21.15.153:0/2773803911 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9800ba20 con 0x7faaa0066130 2023-08-17T00:06:31.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faa9dffb700 1 -- 172.21.15.153:0/2773803911 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9800bda0 con 0x7faaa0066130 2023-08-17T00:06:31.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 -- 172.21.15.153:0/2773803911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0066130 msgr2=0x7faaa01553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2773803911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0066130 0x7faaa01553f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7faaa0063b80 tx=0x7faa98009840).stop 2023-08-17T00:06:31.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 -- 172.21.15.153:0/2773803911 shutdown_connections 2023-08-17T00:06:31.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2773803911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0066130 0x7faaa01553f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2773803911 >> v2:172.21.15.178:3300/0 conn(0x7faaa0151630 0x7faaa00bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 -- 172.21.15.153:0/2773803911 >> 172.21.15.153:0/2773803911 conn(0x7faaa00c2fb0 msgr2=0x7faaa00c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 -- 172.21.15.153:0/2773803911 shutdown_connections 2023-08-17T00:06:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.468+0000 7faaa52f1700 1 -- 172.21.15.153:0/2773803911 wait complete. 2023-08-17T00:06:31.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 Processor -- start 2023-08-17T00:06:31.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 -- start start 2023-08-17T00:06:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa0066130 0x7faaa013fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faaa0151630 0x7faaa014f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 0x7faaa014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0150220 con 0x7faaa0151a10 2023-08-17T00:06:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa014ff40 con 0x7faaa0066130 2023-08-17T00:06:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faaa52f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa01672f0 con 0x7faaa0151630 2023-08-17T00:06:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 0x7faaa014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 0x7faaa014f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35856/0 (socket says 172.21.15.153:35856) 2023-08-17T00:06:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2836707897 learned_addr learned my addr 172.21.15.153:0/2836707897 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9effd700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa0066130 0x7faaa013fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faaa0151630 0x7faaa014f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faaa0151630 msgr2=0x7faaa014f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faaa0151630 0x7faaa014f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa0066130 msgr2=0x7faaa013fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa0066130 0x7faaa013fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.472+0000 7faa9f7fe700 1 -- 172.21.15.153:0/2836707897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98009ae0 con 0x7faaa0151a10 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 0x7faaa014f890 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7faa9800b6c0 tx=0x7faa98009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa86ffd700 1 -- 172.21.15.153:0/2836707897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa98007080 con 0x7faaa0151a10 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa86ffd700 1 -- 172.21.15.153:0/2836707897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa980092e0 con 0x7faaa0151a10 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa86ffd700 1 -- 172.21.15.153:0/2836707897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9801e680 con 0x7faaa0151a10 2023-08-17T00:06:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa01675d0 con 0x7faaa0151a10 2023-08-17T00:06:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa014c570 con 0x7faaa0151a10 2023-08-17T00:06:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa86ffd700 1 -- 172.21.15.153:0/2836707897 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7faa98025030 con 0x7faaa0151a10 2023-08-17T00:06:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa86ffd700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa8c05a150 0x7faa8c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.476+0000 7faa86ffd700 1 -- 172.21.15.153:0/2836707897 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa98075650 con 0x7faaa0151a10 2023-08-17T00:06:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faa9effd700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa8c05a150 0x7faa8c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faa9effd700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa8c05a150 0x7faa8c05c610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7faa90009bc0 tx=0x7faa90008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faaaf6b7740 1 Processor -- start 2023-08-17T00:06:31.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faaaf6b7740 1 -- start start 2023-08-17T00:06:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26942b0 0x2678ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 0x269efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.480+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x269f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x259f230 con 0x2694690 2023-08-17T00:06:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25c00c0 con 0x26942b0 2023-08-17T00:06:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25bf730 con 0x269f4b0 2023-08-17T00:06:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 0x269efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 0x269efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35864/0 (socket says 172.21.15.153:35864) 2023-08-17T00:06:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1002705138 learned_addr learned my addr 172.21.15.153:0/1002705138 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9effd700 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26942b0 0x2678ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x269f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 msgr2=0x269f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x269f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26942b0 msgr2=0x2678ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26942b0 0x2678ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1002705138 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25cd0a0 con 0x2694690 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 0x269efc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7faa94007650 tx=0x7faa94007f90).ready entity=mon.0 client_cookie=3953810c4d2d7137 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa84ff9700 1 -- 172.21.15.153:0/1002705138 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94010520 con 0x2694690 2023-08-17T00:06:31.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa84ff9700 1 -- 172.21.15.153:0/1002705138 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94010680 con 0x2694690 2023-08-17T00:06:31.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faa84ff9700 1 -- 172.21.15.153:0/1002705138 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94010a20 con 0x2694690 2023-08-17T00:06:31.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1002705138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 msgr2=0x269efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 0x269efc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7faa94007650 tx=0x7faa94007f90).stop 2023-08-17T00:06:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1002705138 shutdown_connections 2023-08-17T00:06:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x269f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2694690 0x269efc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1002705138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26942b0 0x2678ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1002705138 >> 172.21.15.153:0/1002705138 conn(0x2432710 msgr2=0x2653610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1002705138 shutdown_connections 2023-08-17T00:06:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1002705138 wait complete. 2023-08-17T00:06:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 -- start start 2023-08-17T00:06:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.484+0000 7faaaf6b7740 1 Processor -- start 2023-08-17T00:06:31.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x267f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2694690 0x2696210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x269f4b0 0x2696700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2697960 con 0x26942b0 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x26990f0 con 0x269f4b0 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x267f900 con 0x2694690 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 10 client.0 ll_register_callbacks cb 0x260ab10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:31.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x267f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x267f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35870/0 (socket says 172.21.15.153:35870) 2023-08-17T00:06:31.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 -- 172.21.15.153:0/1236667114 learned_addr learned my addr 172.21.15.153:0/1236667114 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2694690 0x2696210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x269f4b0 0x2696700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 -- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2694690 msgr2=0x2696210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2694690 0x2696210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 -- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x269f4b0 msgr2=0x2696700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x269f4b0 0x2696700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 -- 172.21.15.153:0/1236667114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9400f040 con 0x26942b0 2023-08-17T00:06:31.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa9effd700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x267f410 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7faa90015830 tx=0x7faa90018040).ready entity=mon.0 client_cookie=c25fc5d731ef8d04 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:31.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa7dffb700 1 -- 172.21.15.153:0/1236667114 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa900145f0 con 0x26942b0 2023-08-17T00:06:31.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faa7dffb700 1 -- 172.21.15.153:0/1236667114 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa90014750 con 0x26942b0 2023-08-17T00:06:31.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.488+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25c9d80 con 0x26942b0 2023-08-17T00:06:31.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 1 -- 172.21.15.153:0/1236667114 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa90014b60 con 0x26942b0 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 10 client.6033 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x25c8540 con 0x26942b0 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 1 -- 172.21.15.153:0/1236667114 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25c9d80 con 0x26942b0 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 1 -- 172.21.15.153:0/1236667114 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa90014cc0 con 0x26942b0 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 10 client.6033 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 10 client.6033 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:06:31.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 20 client.6033 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26a9340 0x26a9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 4 client.6033 mds_command: new command op to 5427 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25c02d0 con 0x26a9340 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26a9340 0x26a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26a9340 0x26a9720 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3161b3774514bcff server_cookie=7d38aa73319c2894 in_seq=0 out_seq=0 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 10 client.6033 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 1 -- 172.21.15.153:0/1236667114 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25c02d0 con 0x26a9340 2023-08-17T00:06:31.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 10 client.6033 handle_command_reply: tid=0 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 client.6033 shutdown 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 msgr2=0x267f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x267f410 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7faa90015830 tx=0x7faa90018040).stop 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 shutdown_connections 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26a9340 0x26a9720 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x269f4b0 0x2696700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2694690 0x2696210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1236667114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x267f410 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faa7dffb700 0 client.6033 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 >> 172.21.15.153:0/1236667114 conn(0x2432710 msgr2=0x2652570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 shutdown_connections 2023-08-17T00:06:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.492+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1236667114 wait complete. 2023-08-17T00:06:31.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.496+0000 7faaaf6b7740 20 client.6033 trim_cache size 0 max 16384 2023-08-17T00:06:31.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 Processor -- start 2023-08-17T00:06:31.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 -- start start 2023-08-17T00:06:31.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x26f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x2696070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x2696560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x268e2a0 con 0x26942b0 2023-08-17T00:06:31.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25bc630 con 0x2694690 2023-08-17T00:06:31.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2679250 con 0x269f4b0 2023-08-17T00:06:31.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x26f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x26f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35886/0 (socket says 172.21.15.153:35886) 2023-08-17T00:06:31.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 -- 172.21.15.153:0/3459083430 learned_addr learned my addr 172.21.15.153:0/3459083430 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x2696560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x2696070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 -- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 msgr2=0x2696560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x2696560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 -- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 msgr2=0x2696070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x2696070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 -- 172.21.15.153:0/3459083430 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x267f770 con 0x26942b0 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x2696070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa9effd700 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x26f5ce0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7faa90008010 tx=0x7faa90019000).ready entity=mon.0 client_cookie=870747dc41e2afa4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa857fa700 1 -- 172.21.15.153:0/3459083430 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90022480 con 0x26942b0 2023-08-17T00:06:31.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa857fa700 1 -- 172.21.15.153:0/3459083430 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa900145f0 con 0x26942b0 2023-08-17T00:06:31.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.512+0000 7faa857fa700 1 -- 172.21.15.153:0/3459083430 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90014d70 con 0x26942b0 2023-08-17T00:06:31.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 -- 172.21.15.153:0/3459083430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 msgr2=0x26f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x26f5ce0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7faa90008010 tx=0x7faa90019000).stop 2023-08-17T00:06:31.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 -- 172.21.15.153:0/3459083430 shutdown_connections 2023-08-17T00:06:31.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x269f4b0 0x2696560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x2696070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/3459083430 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26942b0 0x26f5ce0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 -- 172.21.15.153:0/3459083430 >> 172.21.15.153:0/3459083430 conn(0x2432710 msgr2=0x26535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 -- 172.21.15.153:0/3459083430 shutdown_connections 2023-08-17T00:06:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 -- 172.21.15.153:0/3459083430 wait complete. 2023-08-17T00:06:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 -- start start 2023-08-17T00:06:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.516+0000 7faaaf6b7740 1 Processor -- start 2023-08-17T00:06:31.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x26f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 0x2696070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2672800 0x2696560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2694df0 con 0x269f4b0 2023-08-17T00:06:31.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2696a50 con 0x2694690 2023-08-17T00:06:31.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26fe1e0 con 0x2672800 2023-08-17T00:06:31.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 10 client.0 ll_register_callbacks cb 0x7faa90011d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:06:31.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 0x2696070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 0x2696070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35900/0 (socket says 172.21.15.153:35900) 2023-08-17T00:06:31.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1293277750 learned_addr learned my addr 172.21.15.153:0/1293277750 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9effd700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x26f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9f7fe700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2672800 0x2696560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2672800 msgr2=0x2696560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2672800 0x2696560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 msgr2=0x26f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x26f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 -- 172.21.15.153:0/1293277750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x25c8540 con 0x269f4b0 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9effd700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x26f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa9e7fc700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 0x2696070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7faa9400a000 tx=0x7faa94015000).ready entity=mon.0 client_cookie=a48523742fa3517a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa7dffb700 1 -- 172.21.15.153:0/1293277750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94029030 con 0x269f4b0 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa94010680 con 0x269f4b0 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa7dffb700 1 -- 172.21.15.153:0/1293277750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa9402a070 con 0x269f4b0 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa7dffb700 1 -- 172.21.15.153:0/1293277750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa94010a00 con 0x269f4b0 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 10 client.6039 fetch_fsmap learned FSMap version 40 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x7faaa0068b00 con 0x269f4b0 2023-08-17T00:06:31.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa7dffb700 1 -- 172.21.15.153:0/1293277750 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94010680 con 0x269f4b0 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faa7dffb700 1 -- 172.21.15.153:0/1293277750 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa94025890 con 0x269f4b0 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 10 client.6039 fetch_fsmap finished waiting for FSMap version 40 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 10 client.6039 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 20 client.6039 populate_metadata read hostname 'smithi153' 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26fdbb0 0x26753e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 4 client.6039 mds_command: new command op to 5427 tid=0[{"prefix": "damage rm", "damage_id": 2754853346}] 2023-08-17T00:06:31.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.520+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 --> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] -- command(tid 0: {"prefix": "damage rm", "damage_id": 2754853346}) v1 -- 0x24896a0 con 0x26fdbb0 2023-08-17T00:06:31.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faa9effd700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26fdbb0 0x26753e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faa9effd700 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26fdbb0 0x26753e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b041cf162000e058 server_cookie=f087f5f41a2cbd64 in_seq=0 out_seq=0 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faa7dffb700 10 client.6039 ms_handle_connect on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faa7dffb700 1 -- 172.21.15.153:0/1293277750 <== mds.0 v2:172.21.15.153:6833/1057651106 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x24896a0 con 0x26fdbb0 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faa7dffb700 10 client.6039 handle_command_reply: tid=0 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 client.6039 shutdown 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 msgr2=0x2696070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 0x2696070 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7faa9400a000 tx=0x7faa94015000).stop 2023-08-17T00:06:31.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 shutdown_connections 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:6833/1057651106,v1:172.21.15.153:6835/1057651106] conn(0x26fdbb0 0x26753e0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2672800 0x2696560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x269f4b0 0x2696070 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 --2- 172.21.15.153:0/1293277750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2694690 0x26f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 >> 172.21.15.153:0/1293277750 conn(0x2432710 msgr2=0x268d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faa7dffb700 0 client.6039 ms_handle_reset on v2:172.21.15.153:6833/1057651106 2023-08-17T00:06:31.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 shutdown_connections 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 1 -- 172.21.15.153:0/1293277750 wait complete. 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaaf6b7740 20 client.6039 trim_cache size 0 max 16384 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa8c05a150 msgr2=0x7faa8c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa8c05a150 0x7faa8c05c610 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7faa90009bc0 tx=0x7faa90008040).stop 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 msgr2=0x7faaa014f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 0x7faaa014f890 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7faa9800b6c0 tx=0x7faa98009840).stop 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 shutdown_connections 2023-08-17T00:06:31.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa8c05a150 0x7faa8c05c610 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faaa0151a10 0x7faaa014f890 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faaa0151630 0x7faaa014f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 --2- 172.21.15.153:0/2836707897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faaa0066130 0x7faaa013fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 >> 172.21.15.153:0/2836707897 conn(0x7faaa00c2fb0 msgr2=0x7faaa00c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 shutdown_connections 2023-08-17T00:06:31.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.524+0000 7faaa52f1700 1 -- 172.21.15.153:0/2836707897 wait complete. 2023-08-17T00:06:31.551 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2023-08-17T00:06:31.552 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:31.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.704+0000 7f43c149b700 1 Processor -- start 2023-08-17T00:06:31.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.704+0000 7f43c149b700 1 -- start start 2023-08-17T00:06:31.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43c149b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153e90 0x7f43bc0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43c149b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43bc0c7980 0x7f43bc0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43c149b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc0aa750 con 0x7f43bc153ab0 2023-08-17T00:06:31.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43c149b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0c9dd0 con 0x7f43bc0c7980 2023-08-17T00:06:31.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43c149b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0aacf0 con 0x7f43bc153e90 2023-08-17T00:06:31.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43baffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f43bc153ab0 0x7f43bc0c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41032/0 (socket says 172.21.15.153:41032) 2023-08-17T00:06:31.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43baffd700 1 -- 172.21.15.153:0/2785930379 learned_addr learned my addr 172.21.15.153:0/2785930379 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:31.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43bb7fe700 1 --2- 172.21.15.153:0/2785930379 >> v2:172.21.15.153:3300/0 conn(0x7f43bc0c7980 0x7f43bc0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43b3fff700 1 --2- 172.21.15.153:0/2785930379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153e90 0x7f43bc0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43ba7fc700 1 -- 172.21.15.153:0/2785930379 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610157661 0 0) 0x7f43bc0aa750 con 0x7f43bc153ab0 2023-08-17T00:06:31.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43ba7fc700 1 -- 172.21.15.153:0/2785930379 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a80033f0 con 0x7f43bc153ab0 2023-08-17T00:06:31.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43b3fff700 1 -- 172.21.15.153:0/2785930379 >> v2:172.21.15.153:3300/0 conn(0x7f43bc0c7980 msgr2=0x7f43bc0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:31.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43b3fff700 1 --2- 172.21.15.153:0/2785930379 >> v2:172.21.15.153:3300/0 conn(0x7f43bc0c7980 0x7f43bc0ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43b3fff700 1 -- 172.21.15.153:0/2785930379 >> v1:172.21.15.153:6789/0 conn(0x7f43bc153ab0 legacy=0x7f43bc0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43b3fff700 1 -- 172.21.15.153:0/2785930379 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc1542f0 con 0x7f43bc153e90 2023-08-17T00:06:31.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43bb7fe700 1 --2- 172.21.15.153:0/2785930379 >> v2:172.21.15.153:3300/0 conn(0x7f43bc0c7980 0x7f43bc0ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:31.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.708+0000 7f43b3fff700 1 --2- 172.21.15.153:0/2785930379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153e90 0x7f43bc0c7490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f43a4009760 tx=0x7f43a4009060).ready entity=mon.2 client_cookie=3bfca8a7a1577965 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43ba7fc700 1 -- 172.21.15.153:0/2785930379 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a40090d0 con 0x7f43bc153e90 2023-08-17T00:06:31.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43ba7fc700 1 -- 172.21.15.153:0/2785930379 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400d4a0 con 0x7f43bc153e90 2023-08-17T00:06:31.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43ba7fc700 1 -- 172.21.15.153:0/2785930379 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400d820 con 0x7f43bc153e90 2023-08-17T00:06:31.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 -- 172.21.15.153:0/2785930379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153e90 msgr2=0x7f43bc0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 --2- 172.21.15.153:0/2785930379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153e90 0x7f43bc0c7490 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f43a4009760 tx=0x7f43a4009060).stop 2023-08-17T00:06:31.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 -- 172.21.15.153:0/2785930379 shutdown_connections 2023-08-17T00:06:31.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 --2- 172.21.15.153:0/2785930379 >> v2:172.21.15.153:3300/0 conn(0x7f43bc0c7980 0x7f43bc0ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 --2- 172.21.15.153:0/2785930379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153e90 0x7f43bc0c7490 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 -- 172.21.15.153:0/2785930379 >> 172.21.15.153:0/2785930379 conn(0x7f43bc061fa0 msgr2=0x7f43bc0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 -- 172.21.15.153:0/2785930379 shutdown_connections 2023-08-17T00:06:31.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 -- 172.21.15.153:0/2785930379 wait complete. 2023-08-17T00:06:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 Processor -- start 2023-08-17T00:06:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.712+0000 7f43c149b700 1 -- start start 2023-08-17T00:06:31.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc0c7980 0x7f43bc0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153ab0 0x7f43bc1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 0x7f43bc1516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1550f0 con 0x7f43bc153e90 2023-08-17T00:06:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc151b90 con 0x7f43bc0c7980 2023-08-17T00:06:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0ada10 con 0x7f43bc153ab0 2023-08-17T00:06:31.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 0x7f43bc1516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 0x7f43bc1516a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35920/0 (socket says 172.21.15.153:35920) 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 -- 172.21.15.153:0/1918712880 learned_addr learned my addr 172.21.15.153:0/1918712880 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43baffd700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc0c7980 0x7f43bc0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43b3fff700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153ab0 0x7f43bc1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 -- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153ab0 msgr2=0x7f43bc1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153ab0 0x7f43bc1511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 -- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc0c7980 msgr2=0x7f43bc0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc0c7980 0x7f43bc0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 -- 172.21.15.153:0/1918712880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b4009a20 con 0x7f43bc153e90 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43bb7fe700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 0x7f43bc1516a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f43b4009f20 tx=0x7f43b400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400cc80 con 0x7f43bc153e90 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b400f040 con 0x7f43bc153e90 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a40092a0 con 0x7f43bc153e90 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4013400 con 0x7f43bc153e90 2023-08-17T00:06:31.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.716+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc167e50 con 0x7f43bc153e90 2023-08-17T00:06:31.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.720+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0adba0 con 0x7f43bc153e90 2023-08-17T00:06:31.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.720+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f43b40137b0 con 0x7f43bc153e90 2023-08-17T00:06:31.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.720+0000 7f43b2ffd700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439c05a150 0x7f439c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:31.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.724+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f43b4074c00 con 0x7f43bc153e90 2023-08-17T00:06:31.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.724+0000 7f43baffd700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439c05a150 0x7f439c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:31.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.724+0000 7f43baffd700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439c05a150 0x7f439c05c610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f43ac005750 tx=0x7f43ac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:31.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.728+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f43bc0adba0 con 0x7f43bc153e90 2023-08-17T00:06:31.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.920+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43bc0adb50 con 0x7f43bc153e90 2023-08-17T00:06:31.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.920+0000 7f43b2ffd700 1 -- 172.21.15.153:0/1918712880 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f43b407a020 con 0x7f43bc153e90 2023-08-17T00:06:31.926 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:31.927 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439c05a150 msgr2=0x7f439c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439c05a150 0x7f439c05c610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f43ac005750 tx=0x7f43ac009040).stop 2023-08-17T00:06:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 msgr2=0x7f43bc1516a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 0x7f43bc1516a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f43b4009f20 tx=0x7f43b400b040).stop 2023-08-17T00:06:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 shutdown_connections 2023-08-17T00:06:31.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f439c05a150 0x7f439c05c610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43bc153e90 0x7f43bc1516a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc153ab0 0x7f43bc1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 --2- 172.21.15.153:0/1918712880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc0c7980 0x7f43bc0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:31.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 >> 172.21.15.153:0/1918712880 conn(0x7f43bc061fa0 msgr2=0x7f43bc1506d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:31.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 shutdown_connections 2023-08-17T00:06:31.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:31.924+0000 7f43c149b700 1 -- 172.21.15.153:0/1918712880 wait complete. 2023-08-17T00:06:31.931 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:31.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2023-08-17T00:06:32.104 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:32.104 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:06:32.104 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:32.121 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2023-08-17T00:06:32.121 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:06:32.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:06:32.163 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:06:32.206 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:06:32.207 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:06:32.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:06:32.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:06:33.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:06:33.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:06:33.480 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:06:33.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:33.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6829439700 1 Processor -- start 2023-08-17T00:06:33.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6829439700 1 -- start start 2023-08-17T00:06:33.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6829439700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6824068c80 0x7f68240a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:33.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6829439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68241585a0 con 0x7f6824068820 2023-08-17T00:06:33.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6829439700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6824066400 con 0x7f68240a8df0 2023-08-17T00:06:33.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6829439700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68240c1ba0 con 0x7f6824068c80 2023-08-17T00:06:33.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f681bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6824068820 0x7f68240a96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41040/0 (socket says 172.21.15.153:41040) 2023-08-17T00:06:33.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f681bfff700 1 -- 172.21.15.153:0/1371848097 learned_addr learned my addr 172.21.15.153:0/1371848097 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:33.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.688+0000 7f6828c38700 1 --2- 172.21.15.153:0/1371848097 >> v2:172.21.15.178:3300/0 conn(0x7f6824068c80 0x7f68240a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:33.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f68237fe700 1 -- 172.21.15.153:0/1371848097 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752588071 0 0) 0x7f68241585a0 con 0x7f6824068820 2023-08-17T00:06:33.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f68237fe700 1 -- 172.21.15.153:0/1371848097 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68100033f0 con 0x7f6824068820 2023-08-17T00:06:33.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6828c38700 1 -- 172.21.15.153:0/1371848097 >> v1:172.21.15.178:6789/0 conn(0x7f68240a8df0 legacy=0x7f68240c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6828c38700 1 -- 172.21.15.153:0/1371848097 >> v1:172.21.15.153:6789/0 conn(0x7f6824068820 legacy=0x7f68240a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6828c38700 1 -- 172.21.15.153:0/1371848097 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68240b9d30 con 0x7f6824068c80 2023-08-17T00:06:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6828c38700 1 --2- 172.21.15.153:0/1371848097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824068c80 0x7f68240a9de0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f681c009e60 tx=0x7f681c009780).ready entity=mon.1 client_cookie=a4074a6725337cc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f68237fe700 1 -- 172.21.15.153:0/1371848097 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c00e070 con 0x7f6824068c80 2023-08-17T00:06:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f68237fe700 1 -- 172.21.15.153:0/1371848097 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00bb60 con 0x7f6824068c80 2023-08-17T00:06:33.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f68237fe700 1 -- 172.21.15.153:0/1371848097 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681c012410 con 0x7f6824068c80 2023-08-17T00:06:33.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 -- 172.21.15.153:0/1371848097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824068c80 msgr2=0x7f68240a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 --2- 172.21.15.153:0/1371848097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824068c80 0x7f68240a9de0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f681c009e60 tx=0x7f681c009780).stop 2023-08-17T00:06:33.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 -- 172.21.15.153:0/1371848097 shutdown_connections 2023-08-17T00:06:33.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 --2- 172.21.15.153:0/1371848097 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6824068c80 0x7f68240a9de0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 -- 172.21.15.153:0/1371848097 >> 172.21.15.153:0/1371848097 conn(0x7f68240c6620 msgr2=0x7f68240c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:33.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 -- 172.21.15.153:0/1371848097 shutdown_connections 2023-08-17T00:06:33.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.692+0000 7f6829439700 1 -- 172.21.15.153:0/1371848097 wait complete. 2023-08-17T00:06:33.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 Processor -- start 2023-08-17T00:06:33.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 -- start start 2023-08-17T00:06:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 0x7f68240bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6824068c80 0x7f68241682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68240a8df0 0x7f68241687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824168cb0 con 0x7f6824068820 2023-08-17T00:06:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6824159a50 con 0x7f68240a8df0 2023-08-17T00:06:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6829439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6824168f20 con 0x7f6824068c80 2023-08-17T00:06:33.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 0x7f68240bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 0x7f68240bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35934/0 (socket says 172.21.15.153:35934) 2023-08-17T00:06:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 -- 172.21.15.153:0/1627478405 learned_addr learned my addr 172.21.15.153:0/1627478405 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6828c38700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68240a8df0 0x7f68241687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f681bfff700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6824068c80 0x7f68241682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 -- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6824068c80 msgr2=0x7f68241682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6824068c80 0x7f68241682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 -- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68240a8df0 msgr2=0x7f68241687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68240a8df0 0x7f68241687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6823fff700 1 -- 172.21.15.153:0/1627478405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009a20 con 0x7f6824068820 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.696+0000 7f6828c38700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68240a8df0 0x7f68241687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6823fff700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 0x7f68240bcc70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f681400c4c0 tx=0x7f6814007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814007020 con 0x7f6824068820 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814007180 con 0x7f6824068820 2023-08-17T00:06:33.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6814007520 con 0x7f6824068820 2023-08-17T00:06:33.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6824159cf0 con 0x7f6824068820 2023-08-17T00:06:33.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6824169200 con 0x7f6824068820 2023-08-17T00:06:33.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f682406b4c0 con 0x7f6824068820 2023-08-17T00:06:33.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.700+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6814010070 con 0x7f6824068820 2023-08-17T00:06:33.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.704+0000 7f6820ff9700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680405a150 0x7f680405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:33.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.704+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6814073ba0 con 0x7f6824068820 2023-08-17T00:06:33.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.704+0000 7f681bfff700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680405a150 0x7f680405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:33.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.704+0000 7f681bfff700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680405a150 0x7f680405c610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f68240a8c20 tx=0x7f680c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:33.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.712+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6814047540 con 0x7f6824068820 2023-08-17T00:06:33.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.900+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f682405e300 con 0x7f6824068820 2023-08-17T00:06:33.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6820ff9700 1 -- 172.21.15.153:0/1627478405 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f681404ab60 con 0x7f6824068820 2023-08-17T00:06:33.908 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:33.908 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:33.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680405a150 msgr2=0x7f680405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680405a150 0x7f680405c610 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f68240a8c20 tx=0x7f680c009040).stop 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 msgr2=0x7f68240bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 0x7f68240bcc70 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f681400c4c0 tx=0x7f6814007df0).stop 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 shutdown_connections 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680405a150 0x7f680405c610 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68240a8df0 0x7f68241687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6824068c80 0x7f68241682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 --2- 172.21.15.153:0/1627478405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6824068820 0x7f68240bcc70 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:33.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 >> 172.21.15.153:0/1627478405 conn(0x7f68240c6620 msgr2=0x7f68240ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:33.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 shutdown_connections 2023-08-17T00:06:33.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:33.904+0000 7f6829439700 1 -- 172.21.15.153:0/1627478405 wait complete. 2023-08-17T00:06:33.913 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:33.931 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:34.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.084+0000 7f0b78d47700 1 Processor -- start 2023-08-17T00:06:34.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.084+0000 7f0b78d47700 1 -- start start 2023-08-17T00:06:34.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b78d47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b74150880 0x7f0b740a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b78d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b740a8e60 0x7f0b74068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b78d47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b740aa8c0 0x7f0b74068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b78d47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b74069200 con 0x7f0b740aa8c0 2023-08-17T00:06:34.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b78d47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b740ab9b0 con 0x7f0b74150880 2023-08-17T00:06:34.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b78d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740aada0 con 0x7f0b740a8e60 2023-08-17T00:06:34.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b740aa8c0 0x7f0b74068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b737fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b74150880 0x7f0b740a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b740aa8c0 0x7f0b74068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35946/0 (socket says 172.21.15.153:35946) 2023-08-17T00:06:34.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b72ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b740a8e60 0x7f0b74068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 -- 172.21.15.153:0/2170031189 learned_addr learned my addr 172.21.15.153:0/2170031189 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:34.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 -- 172.21.15.153:0/2170031189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b740a8e60 msgr2=0x7f0b74068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:34.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 --2- 172.21.15.153:0/2170031189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b740a8e60 0x7f0b74068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 -- 172.21.15.153:0/2170031189 >> v2:172.21.15.178:3300/0 conn(0x7f0b74150880 msgr2=0x7f0b740a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 --2- 172.21.15.153:0/2170031189 >> v2:172.21.15.178:3300/0 conn(0x7f0b74150880 0x7f0b740a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 -- 172.21.15.153:0/2170031189 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740ab080 con 0x7f0b740aa8c0 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b737fe700 1 --2- 172.21.15.153:0/2170031189 >> v2:172.21.15.178:3300/0 conn(0x7f0b74150880 0x7f0b740a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.088+0000 7f0b73fff700 1 --2- 172.21.15.153:0/2170031189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b74068d10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f0b74066830 tx=0x7f0b6c009840).ready entity=mon.0 client_cookie=9e40e151f2108593 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b727fc700 1 -- 172.21.15.153:0/2170031189 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00e070 con 0x7f0b740aa8c0 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b727fc700 1 -- 172.21.15.153:0/2170031189 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00b970 con 0x7f0b740aa8c0 2023-08-17T00:06:34.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b727fc700 1 -- 172.21.15.153:0/2170031189 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c00bcf0 con 0x7f0b740aa8c0 2023-08-17T00:06:34.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 -- 172.21.15.153:0/2170031189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 msgr2=0x7f0b74068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2170031189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b74068d10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f0b74066830 tx=0x7f0b6c009840).stop 2023-08-17T00:06:34.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 -- 172.21.15.153:0/2170031189 shutdown_connections 2023-08-17T00:06:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2170031189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b740a8e60 0x7f0b74068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2170031189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b74068d10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2170031189 >> v2:172.21.15.178:3300/0 conn(0x7f0b74150880 0x7f0b740a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 -- 172.21.15.153:0/2170031189 >> 172.21.15.153:0/2170031189 conn(0x7f0b740c6620 msgr2=0x7f0b740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 -- 172.21.15.153:0/2170031189 shutdown_connections 2023-08-17T00:06:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.092+0000 7f0b78d47700 1 -- 172.21.15.153:0/2170031189 wait complete. 2023-08-17T00:06:34.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 Processor -- start 2023-08-17T00:06:34.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 -- start start 2023-08-17T00:06:34.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b740a8e60 0x7f0b740bc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b7414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b74150880 0x7f0b7414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7414d810 con 0x7f0b740aa8c0 2023-08-17T00:06:34.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7414d5b0 con 0x7f0b740a8e60 2023-08-17T00:06:34.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b74151c00 con 0x7f0b74150880 2023-08-17T00:06:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b7414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b7414cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35948/0 (socket says 172.21.15.153:35948) 2023-08-17T00:06:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 -- 172.21.15.153:0/2633685546 learned_addr learned my addr 172.21.15.153:0/2633685546 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b737fe700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b740a8e60 0x7f0b740bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b73fff700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b74150880 0x7f0b7414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 -- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b74150880 msgr2=0x7f0b7414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b74150880 0x7f0b7414d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 -- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b740a8e60 msgr2=0x7f0b740bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b740a8e60 0x7f0b740bc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 -- 172.21.15.153:0/2633685546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b64009250 con 0x7f0b740aa8c0 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b73fff700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b74150880 0x7f0b7414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:34.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b737fe700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b740a8e60 0x7f0b740bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:34.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b72ffd700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b7414cbd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f0b6800e980 tx=0x7f0b68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800c850 con 0x7f0b740aa8c0 2023-08-17T00:06:34.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800c9b0 con 0x7f0b740aa8c0 2023-08-17T00:06:34.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c009ae0 con 0x7f0b740aa8c0 2023-08-17T00:06:34.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800cd30 con 0x7f0b740aa8c0 2023-08-17T00:06:34.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.096+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b741521c0 con 0x7f0b740aa8c0 2023-08-17T00:06:34.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.100+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7406b4c0 con 0x7f0b740aa8c0 2023-08-17T00:06:34.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.100+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0b68022070 con 0x7f0b740aa8c0 2023-08-17T00:06:34.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.100+0000 7f0b5b7fe700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b6005a150 0x7f0b6005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.100+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b680746c0 con 0x7f0b740aa8c0 2023-08-17T00:06:34.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.104+0000 7f0b737fe700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b6005a150 0x7f0b6005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.104+0000 7f0b737fe700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b6005a150 0x7f0b6005c610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0b64006fd0 tx=0x7f0b64008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.108+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b68048060 con 0x7f0b740aa8c0 2023-08-17T00:06:34.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.268+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b74064010 con 0x7f0b740aa8c0 2023-08-17T00:06:34.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b5b7fe700 1 -- 172.21.15.153:0/2633685546 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f0b68016090 con 0x7f0b740aa8c0 2023-08-17T00:06:34.276 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:34.276 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":50,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:01.866515+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:05:58.859718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T00:05:59.885036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:34.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b6005a150 msgr2=0x7f0b6005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b6005a150 0x7f0b6005c610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f0b64006fd0 tx=0x7f0b64008040).stop 2023-08-17T00:06:34.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 msgr2=0x7f0b7414cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b7414cbd0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f0b6800e980 tx=0x7f0b68009060).stop 2023-08-17T00:06:34.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 shutdown_connections 2023-08-17T00:06:34.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b6005a150 0x7f0b6005c610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b74150880 0x7f0b7414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b740aa8c0 0x7f0b7414cbd0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 --2- 172.21.15.153:0/2633685546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b740a8e60 0x7f0b740bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 >> 172.21.15.153:0/2633685546 conn(0x7f0b740c6620 msgr2=0x7f0b740c2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:34.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 shutdown_connections 2023-08-17T00:06:34.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.272+0000 7f0b78d47700 1 -- 172.21.15.153:0/2633685546 wait complete. 2023-08-17T00:06:34.299 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:05:58.859718+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:05:59.885036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:06:34.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:06:34.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.456+0000 7fdb85d07700 1 Processor -- start 2023-08-17T00:06:34.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.456+0000 7fdb85d07700 1 -- start start 2023-08-17T00:06:34.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.456+0000 7fdb85d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800abf10 0x7fdb80068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb800c1190 0x7fdb80068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb801545e0 con 0x7fdb800ac2f0 2023-08-17T00:06:34.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb80069200 con 0x7fdb800c1190 2023-08-17T00:06:34.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb800c1c50 con 0x7fdb800abf10 2023-08-17T00:06:34.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb800c1190 0x7fdb80068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb800c1190 0x7fdb80068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35954/0 (socket says 172.21.15.153:35954) 2023-08-17T00:06:34.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 -- 172.21.15.153:0/1931502097 learned_addr learned my addr 172.21.15.153:0/1931502097 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:34.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb84d05700 1 --2- 172.21.15.153:0/1931502097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800abf10 0x7fdb80068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 -- 172.21.15.153:0/1931502097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800abf10 msgr2=0x7fdb80068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:34.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 --2- 172.21.15.153:0/1931502097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800abf10 0x7fdb80068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 -- 172.21.15.153:0/1931502097 >> v1:172.21.15.178:6789/0 conn(0x7fdb800ac2f0 legacy=0x7fdb800c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 -- 172.21.15.153:0/1931502097 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb800a96d0 con 0x7fdb800c1190 2023-08-17T00:06:34.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85506700 1 --2- 172.21.15.153:0/1931502097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb80068d10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fdb78009f20 tx=0x7fdb78009840).ready entity=mon.0 client_cookie=5b9d6d9b8a99a605 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb777fe700 1 -- 172.21.15.153:0/1931502097 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800e070 con 0x7fdb800c1190 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb777fe700 1 -- 172.21.15.153:0/1931502097 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7800b9d0 con 0x7fdb800c1190 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb777fe700 1 -- 172.21.15.153:0/1931502097 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800bd50 con 0x7fdb800c1190 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- 172.21.15.153:0/1931502097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 msgr2=0x7fdb80068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 --2- 172.21.15.153:0/1931502097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb80068d10 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7fdb78009f20 tx=0x7fdb78009840).stop 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- 172.21.15.153:0/1931502097 shutdown_connections 2023-08-17T00:06:34.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 --2- 172.21.15.153:0/1931502097 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb80068d10 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 --2- 172.21.15.153:0/1931502097 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800abf10 0x7fdb80068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- 172.21.15.153:0/1931502097 >> 172.21.15.153:0/1931502097 conn(0x7fdb800c6620 msgr2=0x7fdb800c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:34.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.460+0000 7fdb85d07700 1 -- 172.21.15.153:0/1931502097 shutdown_connections 2023-08-17T00:06:34.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.464+0000 7fdb85d07700 1 -- 172.21.15.153:0/1931502097 wait complete. 2023-08-17T00:06:34.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.464+0000 7fdb85d07700 1 Processor -- start 2023-08-17T00:06:34.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.464+0000 7fdb85d07700 1 -- start start 2023-08-17T00:06:34.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb800abf10 0x7fdb800bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800ac2f0 0x7fdb8014e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb8014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014c780 con 0x7fdb800c1190 2023-08-17T00:06:34.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8014f2e0 con 0x7fdb800abf10 2023-08-17T00:06:34.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb80150b10 con 0x7fdb800ac2f0 2023-08-17T00:06:34.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb8014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb8014edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35960/0 (socket says 172.21.15.153:35960) 2023-08-17T00:06:34.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 -- 172.21.15.153:0/607723145 learned_addr learned my addr 172.21.15.153:0/607723145 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:34.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb84d05700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb800abf10 0x7fdb800bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb77fff700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800ac2f0 0x7fdb8014e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 -- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800ac2f0 msgr2=0x7fdb8014e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800ac2f0 0x7fdb8014e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 -- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb800abf10 msgr2=0x7fdb800bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb800abf10 0x7fdb800bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 -- 172.21.15.153:0/607723145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78009ae0 con 0x7fdb800c1190 2023-08-17T00:06:34.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85506700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb8014edf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdb7800b610 tx=0x7fdb80064af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78007080 con 0x7fdb800c1190 2023-08-17T00:06:34.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb780092e0 con 0x7fdb800c1190 2023-08-17T00:06:34.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb800c02a0 con 0x7fdb800c1190 2023-08-17T00:06:34.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7801e6a0 con 0x7fdb800c1190 2023-08-17T00:06:34.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.468+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb801504c0 con 0x7fdb800c1190 2023-08-17T00:06:34.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.472+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb80150c80 con 0x7fdb800c1190 2023-08-17T00:06:34.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.472+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdb78025030 con 0x7fdb800c1190 2023-08-17T00:06:34.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.476+0000 7fdb74ff9700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb6c05a150 0x7fdb6c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.476+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb78075640 con 0x7fdb800c1190 2023-08-17T00:06:34.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.476+0000 7fdb84d05700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb6c05a150 0x7fdb6c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.476+0000 7fdb84d05700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb6c05a150 0x7fdb6c05c610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fdb7c006fd0 tx=0x7fdb7c006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.480+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb78049090 con 0x7fdb800c1190 2023-08-17T00:06:34.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.640+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fdb8006b4c0 con 0x7fdb800c1190 2023-08-17T00:06:34.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.640+0000 7fdb74ff9700 1 -- 172.21.15.153:0/607723145 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v50) v1 ==== 110+0+10 (secure 0 0 0) 0x7fdb78023070 con 0x7fdb800c1190 2023-08-17T00:06:34.647 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:06:34.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb6c05a150 msgr2=0x7fdb6c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb6c05a150 0x7fdb6c05c610 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fdb7c006fd0 tx=0x7fdb7c006f40).stop 2023-08-17T00:06:34.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 msgr2=0x7fdb8014edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb8014edf0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7fdb7800b610 tx=0x7fdb80064af0).stop 2023-08-17T00:06:34.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 shutdown_connections 2023-08-17T00:06:34.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdb6c05a150 0x7fdb6c05c610 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb800c1190 0x7fdb8014edf0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb800ac2f0 0x7fdb8014e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 --2- 172.21.15.153:0/607723145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb800abf10 0x7fdb800bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 >> 172.21.15.153:0/607723145 conn(0x7fdb800c6620 msgr2=0x7fdb800c5aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:34.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 shutdown_connections 2023-08-17T00:06:34.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.644+0000 7fdb85d07700 1 -- 172.21.15.153:0/607723145 wait complete. 2023-08-17T00:06:34.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:06:34.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.820+0000 7f3d157a9700 1 Processor -- start 2023-08-17T00:06:34.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.820+0000 7f3d157a9700 1 -- start start 2023-08-17T00:06:34.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d157a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100aa920 0x7f3d100be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d157a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d100c3520 0x7f3d10068e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d157a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d100aad00 0x7f3d10068020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d157a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100c4050 con 0x7f3d100aad00 2023-08-17T00:06:34.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d157a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d100bdcb0 con 0x7f3d100c3520 2023-08-17T00:06:34.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d157a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10152310 con 0x7f3d100aa920 2023-08-17T00:06:34.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d100aad00 0x7f3d10068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3d100aad00 0x7f3d10068020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35972/0 (socket says 172.21.15.153:35972) 2023-08-17T00:06:34.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 -- 172.21.15.153:0/3561793545 learned_addr learned my addr 172.21.15.153:0/3561793545 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:34.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0effd700 1 --2- 172.21.15.153:0/3561793545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100aa920 0x7f3d100be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0e7fc700 1 --2- 172.21.15.153:0/3561793545 >> v2:172.21.15.178:3300/0 conn(0x7f3d100c3520 0x7f3d10068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 -- 172.21.15.153:0/3561793545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100aa920 msgr2=0x7f3d100be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:34.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 --2- 172.21.15.153:0/3561793545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100aa920 0x7f3d100be140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 -- 172.21.15.153:0/3561793545 >> v2:172.21.15.178:3300/0 conn(0x7f3d100c3520 msgr2=0x7f3d10068e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:34.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 --2- 172.21.15.153:0/3561793545 >> v2:172.21.15.178:3300/0 conn(0x7f3d100c3520 0x7f3d10068e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 -- 172.21.15.153:0/3561793545 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d100c3a90 con 0x7f3d100aad00 2023-08-17T00:06:34.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.824+0000 7f3d0f7fe700 1 --2- 172.21.15.153:0/3561793545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d10068020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f3d1005eb30 tx=0x7f3d08009840).ready entity=mon.0 client_cookie=4645db888f899da3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d0dffb700 1 -- 172.21.15.153:0/3561793545 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800e070 con 0x7f3d100aad00 2023-08-17T00:06:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d0dffb700 1 -- 172.21.15.153:0/3561793545 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0800ba20 con 0x7f3d100aad00 2023-08-17T00:06:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d0dffb700 1 -- 172.21.15.153:0/3561793545 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0800bda0 con 0x7f3d100aad00 2023-08-17T00:06:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 -- 172.21.15.153:0/3561793545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 msgr2=0x7f3d10068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 --2- 172.21.15.153:0/3561793545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d10068020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f3d1005eb30 tx=0x7f3d08009840).stop 2023-08-17T00:06:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 -- 172.21.15.153:0/3561793545 shutdown_connections 2023-08-17T00:06:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 --2- 172.21.15.153:0/3561793545 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d10068020 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 --2- 172.21.15.153:0/3561793545 >> v2:172.21.15.178:3300/0 conn(0x7f3d100c3520 0x7f3d10068e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 --2- 172.21.15.153:0/3561793545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100aa920 0x7f3d100be140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 -- 172.21.15.153:0/3561793545 >> 172.21.15.153:0/3561793545 conn(0x7f3d100c5e10 msgr2=0x7f3d100652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 -- 172.21.15.153:0/3561793545 shutdown_connections 2023-08-17T00:06:34.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 -- 172.21.15.153:0/3561793545 wait complete. 2023-08-17T00:06:34.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.828+0000 7f3d157a9700 1 Processor -- start 2023-08-17T00:06:34.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 -- start start 2023-08-17T00:06:34.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d100aa920 0x7f3d10167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d100c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100c3520 0x7f3d100bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100c0890 con 0x7f3d100aad00 2023-08-17T00:06:34.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d10167a60 con 0x7f3d100aa920 2023-08-17T00:06:34.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d100c05b0 con 0x7f3d100c3520 2023-08-17T00:06:34.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d100c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d100c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35974/0 (socket says 172.21.15.153:35974) 2023-08-17T00:06:34.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 -- 172.21.15.153:0/2302595158 learned_addr learned my addr 172.21.15.153:0/2302595158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:34.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0f7fe700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100c3520 0x7f3d100bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0effd700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d100aa920 0x7f3d10167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 -- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100c3520 msgr2=0x7f3d100bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100c3520 0x7f3d100bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 -- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d100aa920 msgr2=0x7f3d10167ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d100aa920 0x7f3d10167ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 -- 172.21.15.153:0/2302595158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08009ae0 con 0x7f3d100aad00 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d0e7fc700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d100c24a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f3d0400d8c0 tx=0x7f3d04008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400f520 con 0x7f3d100aad00 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400f680 con 0x7f3d100aad00 2023-08-17T00:06:34.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d10167410 con 0x7f3d100aad00 2023-08-17T00:06:34.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.832+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0400fa00 con 0x7f3d100aad00 2023-08-17T00:06:34.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.836+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d100c2990 con 0x7f3d100aad00 2023-08-17T00:06:34.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.836+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1006b530 con 0x7f3d100aad00 2023-08-17T00:06:34.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.836+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3d0401a030 con 0x7f3d100aad00 2023-08-17T00:06:34.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.840+0000 7f3cf6ffd700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3cfc05a150 0x7f3cfc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:34.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.840+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d04073b70 con 0x7f3d100aad00 2023-08-17T00:06:34.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.840+0000 7f3d0effd700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3cfc05a150 0x7f3cfc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:34.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.840+0000 7f3d0effd700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3cfc05a150 0x7f3cfc05c610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f3d00009b90 tx=0x7f3d00009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:34.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:34.848+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d04047510 con 0x7f3d100aad00 2023-08-17T00:06:35.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.008+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d10067980 con 0x7f3d100aad00 2023-08-17T00:06:35.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.012+0000 7f3cf6ffd700 1 -- 172.21.15.153:0/2302595158 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v50) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d0404ab30 con 0x7f3d100aad00 2023-08-17T00:06:35.016 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:06:35.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3cfc05a150 msgr2=0x7f3cfc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3cfc05a150 0x7f3cfc05c610 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f3d00009b90 tx=0x7f3d00009060).stop 2023-08-17T00:06:35.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 msgr2=0x7f3d100c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d100c24a0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f3d0400d8c0 tx=0x7f3d04008040).stop 2023-08-17T00:06:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 shutdown_connections 2023-08-17T00:06:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3cfc05a150 0x7f3cfc05c610 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d100c3520 0x7f3d100bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d100aad00 0x7f3d100c24a0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 --2- 172.21.15.153:0/2302595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d100aa920 0x7f3d10167ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 >> 172.21.15.153:0/2302595158 conn(0x7f3d100c5e10 msgr2=0x7f3d100633c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:35.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 shutdown_connections 2023-08-17T00:06:35.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.016+0000 7f3d157a9700 1 -- 172.21.15.153:0/2302595158 wait complete. 2023-08-17T00:06:35.040 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:06:35.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.200+0000 7f5ed7ef1700 1 Processor -- start 2023-08-17T00:06:35.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.200+0000 7f5ed7ef1700 1 -- start start 2023-08-17T00:06:35.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed7ef1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5ed00632e0 0x7f5ed00a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed7ef1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00629b0 0x7f5ed00bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed7ef1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ed0065240 con 0x7f5ed00a8b70 2023-08-17T00:06:35.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed7ef1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ed0062e40 con 0x7f5ed00632e0 2023-08-17T00:06:35.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed7ef1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00638a0 con 0x7f5ed00629b0 2023-08-17T00:06:35.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed5c8d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5ed00a8b70 0x7f5ed00656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41178/0 (socket says 172.21.15.153:41178) 2023-08-17T00:06:35.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed5c8d700 1 -- 172.21.15.153:0/2698554715 learned_addr learned my addr 172.21.15.153:0/2698554715 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:35.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed548c700 1 --2- 172.21.15.153:0/2698554715 >> v2:172.21.15.178:3300/0 conn(0x7f5ed00632e0 0x7f5ed00a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed648e700 1 --2- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00629b0 0x7f5ed00bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed4c8b700 1 -- 172.21.15.153:0/2698554715 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121789969 0 0) 0x7f5ed0065240 con 0x7f5ed00a8b70 2023-08-17T00:06:35.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed4c8b700 1 -- 172.21.15.153:0/2698554715 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ebc0033f0 con 0x7f5ed00a8b70 2023-08-17T00:06:35.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed548c700 1 -- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00629b0 msgr2=0x7f5ed00bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:35.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed548c700 1 --2- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00629b0 0x7f5ed00bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed548c700 1 -- 172.21.15.153:0/2698554715 >> v1:172.21.15.153:6789/0 conn(0x7f5ed00a8b70 legacy=0x7f5ed00656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.204+0000 7f5ed548c700 1 -- 172.21.15.153:0/2698554715 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed0065de0 con 0x7f5ed00632e0 2023-08-17T00:06:35.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed548c700 1 --2- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed00a8f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f5ec0009760 tx=0x7f5ec0009060).ready entity=mon.1 client_cookie=466dd4958f89428e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed4c8b700 1 -- 172.21.15.153:0/2698554715 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000d4a0 con 0x7f5ed00632e0 2023-08-17T00:06:35.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed4c8b700 1 -- 172.21.15.153:0/2698554715 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ec000d600 con 0x7f5ed00632e0 2023-08-17T00:06:35.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed4c8b700 1 -- 172.21.15.153:0/2698554715 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec000d980 con 0x7f5ed00632e0 2023-08-17T00:06:35.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 msgr2=0x7f5ed00a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed00a8f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f5ec0009760 tx=0x7f5ec0009060).stop 2023-08-17T00:06:35.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/2698554715 shutdown_connections 2023-08-17T00:06:35.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00629b0 0x7f5ed00bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/2698554715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed00a8f50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/2698554715 >> 172.21.15.153:0/2698554715 conn(0x7f5ed00c7150 msgr2=0x7f5ed00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:35.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/2698554715 shutdown_connections 2023-08-17T00:06:35.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.208+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/2698554715 wait complete. 2023-08-17T00:06:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.212+0000 7f5ed7ef1700 1 Processor -- start 2023-08-17T00:06:35.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.212+0000 7f5ed7ef1700 1 -- start start 2023-08-17T00:06:35.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 0x7f5ed00aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed0168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00a8b70 0x7f5ed00bea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00bd720 con 0x7f5ed00629b0 2023-08-17T00:06:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00be580 con 0x7f5ed00632e0 2023-08-17T00:06:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00bd970 con 0x7f5ed00a8b70 2023-08-17T00:06:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 0x7f5ed00aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 0x7f5ed00aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58530/0 (socket says 172.21.15.153:58530) 2023-08-17T00:06:35.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 -- 172.21.15.153:0/3338094187 learned_addr learned my addr 172.21.15.153:0/3338094187 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:35.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed648e700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00a8b70 0x7f5ed00bea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 -- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00a8b70 msgr2=0x7f5ed00bea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00a8b70 0x7f5ed00bea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 -- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 msgr2=0x7f5ed0168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed548c700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed0168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed0168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 -- 172.21.15.153:0/3338094187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00092a0 con 0x7f5ed00629b0 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed548c700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed0168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed5c8d700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 0x7f5ed00aa060 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f5ecc00c450 tx=0x7f5ecc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0072e0 con 0x7f5ed00629b0 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ecc007440 con 0x7f5ed00629b0 2023-08-17T00:06:35.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed00bdc50 con 0x7f5ed00629b0 2023-08-17T00:06:35.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ecc0057a0 con 0x7f5ed00629b0 2023-08-17T00:06:35.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.216+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed00be210 con 0x7f5ed00629b0 2023-08-17T00:06:35.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.220+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed006b530 con 0x7f5ed00629b0 2023-08-17T00:06:35.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.220+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5ecc01a060 con 0x7f5ed00629b0 2023-08-17T00:06:35.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.220+0000 7f5ec5ffb700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5eb405a180 0x7f5eb405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.220+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5ecc073490 con 0x7f5ed00629b0 2023-08-17T00:06:35.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.224+0000 7f5ed548c700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5eb405a180 0x7f5eb405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.224+0000 7f5ed548c700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5eb405a180 0x7f5eb405c640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5ed00c0720 tx=0x7f5ec0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.228+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5ecc046f40 con 0x7f5ed00629b0 2023-08-17T00:06:35.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.388+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ed0064910 con 0x7f5ed00629b0 2023-08-17T00:06:35.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ec5ffb700 1 -- 172.21.15.153:0/3338094187 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5ecc018020 con 0x7f5ed00629b0 2023-08-17T00:06:35.396 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:06:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5eb405a180 msgr2=0x7f5eb405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5eb405a180 0x7f5eb405c640 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f5ed00c0720 tx=0x7f5ec0016000).stop 2023-08-17T00:06:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 msgr2=0x7f5ed00aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 0x7f5ed00aa060 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f5ecc00c450 tx=0x7f5ecc007c80).stop 2023-08-17T00:06:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 shutdown_connections 2023-08-17T00:06:35.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5eb405a180 0x7f5eb405c640 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ed00a8b70 0x7f5ed00bea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ed00632e0 0x7f5ed0168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 --2- 172.21.15.153:0/3338094187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5ed00629b0 0x7f5ed00aa060 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 >> 172.21.15.153:0/3338094187 conn(0x7f5ed00c7150 msgr2=0x7f5ed01576c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.392+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 shutdown_connections 2023-08-17T00:06:35.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.396+0000 7f5ed7ef1700 1 -- 172.21.15.153:0/3338094187 wait complete. 2023-08-17T00:06:35.418 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:06:35.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.596+0000 7f09ea0f1700 1 Processor -- start 2023-08-17T00:06:35.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.596+0000 7f09ea0f1700 1 -- start start 2023-08-17T00:06:35.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09e40be150 0x7f09e40636e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09e40c59e0 0x7f09e40be530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e4064940 con 0x7f09e4157830 2023-08-17T00:06:35.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e4064dd0 con 0x7f09e40c59e0 2023-08-17T00:06:35.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e4063d30 con 0x7f09e40be150 2023-08-17T00:06:35.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f09e4157830 0x7f09e40c52d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41190/0 (socket says 172.21.15.153:41190) 2023-08-17T00:06:35.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e2ffd700 1 -- 172.21.15.153:0/4248204813 learned_addr learned my addr 172.21.15.153:0/4248204813 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:35.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e3fff700 1 --2- 172.21.15.153:0/4248204813 >> v2:172.21.15.153:3300/0 conn(0x7f09e40c59e0 0x7f09e40be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e37fe700 1 --2- 172.21.15.153:0/4248204813 >> v2:172.21.15.178:3300/0 conn(0x7f09e40be150 0x7f09e40636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e37fe700 1 -- 172.21.15.153:0/4248204813 >> v2:172.21.15.153:3300/0 conn(0x7f09e40c59e0 msgr2=0x7f09e40be530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:35.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e37fe700 1 --2- 172.21.15.153:0/4248204813 >> v2:172.21.15.153:3300/0 conn(0x7f09e40c59e0 0x7f09e40be530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e37fe700 1 -- 172.21.15.153:0/4248204813 >> v1:172.21.15.153:6789/0 conn(0x7f09e4157830 legacy=0x7f09e40c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e37fe700 1 -- 172.21.15.153:0/4248204813 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e4064010 con 0x7f09e40be150 2023-08-17T00:06:35.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e3fff700 1 --2- 172.21.15.153:0/4248204813 >> v2:172.21.15.153:3300/0 conn(0x7f09e40c59e0 0x7f09e40be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:35.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e27fc700 1 -- 172.21.15.153:0/4248204813 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208298732 0 0) 0x7f09e4064940 con 0x7f09e4157830 2023-08-17T00:06:35.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e37fe700 1 --2- 172.21.15.153:0/4248204813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40be150 0x7f09e40636e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f09e406a520 tx=0x7f09d4009060).ready entity=mon.1 client_cookie=78cba0871e0381d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e27fc700 1 -- 172.21.15.153:0/4248204813 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d40090d0 con 0x7f09e40be150 2023-08-17T00:06:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e27fc700 1 -- 172.21.15.153:0/4248204813 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400f510 con 0x7f09e40be150 2023-08-17T00:06:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09e27fc700 1 -- 172.21.15.153:0/4248204813 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400f890 con 0x7f09e40be150 2023-08-17T00:06:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- 172.21.15.153:0/4248204813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40be150 msgr2=0x7f09e40636e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/4248204813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40be150 0x7f09e40636e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f09e406a520 tx=0x7f09d4009060).stop 2023-08-17T00:06:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- 172.21.15.153:0/4248204813 shutdown_connections 2023-08-17T00:06:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/4248204813 >> v2:172.21.15.153:3300/0 conn(0x7f09e40c59e0 0x7f09e40be530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/4248204813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40be150 0x7f09e40636e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- 172.21.15.153:0/4248204813 >> 172.21.15.153:0/4248204813 conn(0x7f09e4065aa0 msgr2=0x7f09e4065eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- 172.21.15.153:0/4248204813 shutdown_connections 2023-08-17T00:06:35.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.600+0000 7f09ea0f1700 1 -- 172.21.15.153:0/4248204813 wait complete. 2023-08-17T00:06:35.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 Processor -- start 2023-08-17T00:06:35.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 -- start start 2023-08-17T00:06:35.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 0x7f09e4157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40c59e0 0x7f09e40ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09e4157830 0x7f09e4153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c13d0 con 0x7f09e40be150 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4153a90 con 0x7f09e40c59e0 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09ea0f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e40c2370 con 0x7f09e4157830 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09e37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 0x7f09e4157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09e37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 0x7f09e4157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58548/0 (socket says 172.21.15.153:58548) 2023-08-17T00:06:35.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09e37fe700 1 -- 172.21.15.153:0/832516556 learned_addr learned my addr 172.21.15.153:0/832516556 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.604+0000 7f09e2ffd700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40c59e0 0x7f09e40ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e3fff700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09e4157830 0x7f09e4153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e37fe700 1 -- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09e4157830 msgr2=0x7f09e4153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e37fe700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09e4157830 0x7f09e4153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e37fe700 1 -- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40c59e0 msgr2=0x7f09e40ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e37fe700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40c59e0 0x7f09e40ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e37fe700 1 -- 172.21.15.153:0/832516556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc009a20 con 0x7f09e40be150 2023-08-17T00:06:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09e37fe700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 0x7f09e4157ef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f09d4009110 tx=0x7f09d4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d400f890 con 0x7f09e40be150 2023-08-17T00:06:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d400fc50 con 0x7f09e40be150 2023-08-17T00:06:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d40092a0 con 0x7f09e40be150 2023-08-17T00:06:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d401b440 con 0x7f09e40be150 2023-08-17T00:06:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e40c1890 con 0x7f09e40be150 2023-08-17T00:06:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.608+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e406b530 con 0x7f09e40be150 2023-08-17T00:06:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.612+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f09d402a070 con 0x7f09e40be150 2023-08-17T00:06:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.612+0000 7f09cb7fe700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09d005a150 0x7f09d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.612+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f09d4075460 con 0x7f09e40be150 2023-08-17T00:06:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.612+0000 7f09e2ffd700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09d005a150 0x7f09d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.612+0000 7f09e2ffd700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09d005a150 0x7f09d005c610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f09e40c2610 tx=0x7f09d8007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.616+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09d4048f10 con 0x7f09e40be150 2023-08-17T00:06:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.772+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09e40642f0 con 0x7f09e40be150 2023-08-17T00:06:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.776+0000 7f09cb7fe700 1 -- 172.21.15.153:0/832516556 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09d40280a0 con 0x7f09e40be150 2023-08-17T00:06:35.780 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:06:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09d005a150 msgr2=0x7f09d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09d005a150 0x7f09d005c610 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f09e40c2610 tx=0x7f09d8007bb0).stop 2023-08-17T00:06:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 msgr2=0x7f09e4157ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 0x7f09e4157ef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f09d4009110 tx=0x7f09d4017000).stop 2023-08-17T00:06:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 shutdown_connections 2023-08-17T00:06:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09d005a150 0x7f09d005c610 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09e4157830 0x7f09e4153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09e40c59e0 0x7f09e40ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 --2- 172.21.15.153:0/832516556 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09e40be150 0x7f09e4157ef0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 >> 172.21.15.153:0/832516556 conn(0x7f09e4065aa0 msgr2=0x7f09e4067950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 shutdown_connections 2023-08-17T00:06:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.780+0000 7f09ea0f1700 1 -- 172.21.15.153:0/832516556 wait complete. 2023-08-17T00:06:35.804 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:35.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.956+0000 7fcbc25a9700 1 Processor -- start 2023-08-17T00:06:35.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.956+0000 7fcbc25a9700 1 -- start start 2023-08-17T00:06:35.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc25a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbbc151b90 0x7fcbbc151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc25a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbbc064870 0x7fcbbc064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc25a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc061fa0 con 0x7fcbbc063290 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc25a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc0c3fb0 con 0x7fcbbc151b90 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc25a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc152460 con 0x7fcbbc064870 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbbc151b90 0x7fcbbc151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbbc151b90 0x7fcbbc151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58562/0 (socket says 172.21.15.153:58562) 2023-08-17T00:06:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 -- 172.21.15.153:0/2352373040 learned_addr learned my addr 172.21.15.153:0/2352373040 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc0b46700 1 --2- 172.21.15.153:0/2352373040 >> v2:172.21.15.178:3300/0 conn(0x7fcbbc064870 0x7fcbbc064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 -- 172.21.15.153:0/2352373040 >> v2:172.21.15.178:3300/0 conn(0x7fcbbc064870 msgr2=0x7fcbbc064cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 --2- 172.21.15.153:0/2352373040 >> v2:172.21.15.178:3300/0 conn(0x7fcbbc064870 0x7fcbbc064cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 -- 172.21.15.153:0/2352373040 >> v1:172.21.15.178:6789/0 conn(0x7fcbbc063290 legacy=0x7fcbbc065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbbbfff700 1 -- 172.21.15.153:0/2352373040 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc0651b0 con 0x7fcbbc151b90 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.960+0000 7fcbc0b46700 1 --2- 172.21.15.153:0/2352373040 >> v2:172.21.15.178:3300/0 conn(0x7fcbbc064870 0x7fcbbc064cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbbbfff700 1 --2- 172.21.15.153:0/2352373040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc151b90 0x7fcbbc151f70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fcbbc0bd6b0 tx=0x7fcbac0090f0).ready entity=mon.0 client_cookie=a488f31ca40091b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbbb7fe700 1 -- 172.21.15.153:0/2352373040 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00b600 con 0x7fcbbc151b90 2023-08-17T00:06:35.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbbb7fe700 1 -- 172.21.15.153:0/2352373040 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac00b760 con 0x7fcbbc151b90 2023-08-17T00:06:35.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbbb7fe700 1 -- 172.21.15.153:0/2352373040 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00bae0 con 0x7fcbbc151b90 2023-08-17T00:06:35.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 -- 172.21.15.153:0/2352373040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc151b90 msgr2=0x7fcbbc151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/2352373040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc151b90 0x7fcbbc151f70 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7fcbbc0bd6b0 tx=0x7fcbac0090f0).stop 2023-08-17T00:06:35.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 -- 172.21.15.153:0/2352373040 shutdown_connections 2023-08-17T00:06:35.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/2352373040 >> v2:172.21.15.178:3300/0 conn(0x7fcbbc064870 0x7fcbbc064cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/2352373040 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc151b90 0x7fcbbc151f70 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 -- 172.21.15.153:0/2352373040 >> 172.21.15.153:0/2352373040 conn(0x7fcbbc0c7150 msgr2=0x7fcbbc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:35.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 -- 172.21.15.153:0/2352373040 shutdown_connections 2023-08-17T00:06:35.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.964+0000 7fcbc25a9700 1 -- 172.21.15.153:0/2352373040 wait complete. 2023-08-17T00:06:35.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.968+0000 7fcbc25a9700 1 Processor -- start 2023-08-17T00:06:35.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.968+0000 7fcbc25a9700 1 -- start start 2023-08-17T00:06:35.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 0x7fcbbc141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbbc064870 0x7fcbbc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbbc151b90 0x7fcbbc154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc154f90 con 0x7fcbbc063290 2023-08-17T00:06:35.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc165430 con 0x7fcbbc064870 2023-08-17T00:06:35.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc141870 con 0x7fcbbc151b90 2023-08-17T00:06:35.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 0x7fcbbc141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 0x7fcbbc141380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58568/0 (socket says 172.21.15.153:58568) 2023-08-17T00:06:35.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 -- 172.21.15.153:0/3843326791 learned_addr learned my addr 172.21.15.153:0/3843326791 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:35.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbb37fe700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbbc064870 0x7fcbbc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc0b46700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbbc151b90 0x7fcbbc154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 -- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbbc151b90 msgr2=0x7fcbbc154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbbc151b90 0x7fcbbc154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 -- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbbc064870 msgr2=0x7fcbbc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbbc064870 0x7fcbbc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 -- 172.21.15.153:0/3843326791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009370 con 0x7fcbbc063290 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbbbfff700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 0x7fcbbc141380 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fcbbc05e420 tx=0x7fcbac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00bae0 con 0x7fcbbc063290 2023-08-17T00:06:35.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac000c90 con 0x7fcbbc063290 2023-08-17T00:06:35.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc164b00 con 0x7fcbbc063290 2023-08-17T00:06:35.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac01b640 con 0x7fcbbc063290 2023-08-17T00:06:35.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.972+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc1650c0 con 0x7fcbbc063290 2023-08-17T00:06:35.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.976+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc06b530 con 0x7fcbbc063290 2023-08-17T00:06:35.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.976+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcbac02b070 con 0x7fcbbc063290 2023-08-17T00:06:35.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.976+0000 7fcbb8ff9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb9c05a180 0x7fcb9c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:35.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.976+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcbac075a90 con 0x7fcbbc063290 2023-08-17T00:06:35.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.976+0000 7fcbb37fe700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb9c05a180 0x7fcb9c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:35.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.980+0000 7fcbb37fe700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb9c05a180 0x7fcb9c05c640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fcbbc1519b0 tx=0x7fcba4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:35.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:35.984+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbac0494e0 con 0x7fcbbc063290 2023-08-17T00:06:36.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.176+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbbc0621f0 con 0x7fcbbc063290 2023-08-17T00:06:36.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.176+0000 7fcbb8ff9700 1 -- 172.21.15.153:0/3843326791 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fcbac029020 con 0x7fcbbc063290 2023-08-17T00:06:36.183 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:36.183 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:36.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb9c05a180 msgr2=0x7fcb9c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb9c05a180 0x7fcb9c05c640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fcbbc1519b0 tx=0x7fcba4009040).stop 2023-08-17T00:06:36.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 msgr2=0x7fcbbc141380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 0x7fcbbc141380 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7fcbbc05e420 tx=0x7fcbac017000).stop 2023-08-17T00:06:36.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 shutdown_connections 2023-08-17T00:06:36.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb9c05a180 0x7fcb9c05c640 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbbc151b90 0x7fcbbc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbbc064870 0x7fcbbc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 --2- 172.21.15.153:0/3843326791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbbc063290 0x7fcbbc141380 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 >> 172.21.15.153:0/3843326791 conn(0x7fcbbc0c7150 msgr2=0x7fcbbc151040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:36.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 shutdown_connections 2023-08-17T00:06:36.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.180+0000 7fcbc25a9700 1 -- 172.21.15.153:0/3843326791 wait complete. 2023-08-17T00:06:36.188 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:36.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:36.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.360+0000 7fdd4d3db700 1 Processor -- start 2023-08-17T00:06:36.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.360+0000 7fdd4d3db700 1 -- start start 2023-08-17T00:06:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd4d3db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdd480632e0 0x7fdd480bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd4d3db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48065240 con 0x7fdd48154130 2023-08-17T00:06:36.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd4d3db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd48065de0 con 0x7fdd48153d50 2023-08-17T00:06:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd4d3db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd48063880 con 0x7fdd480632e0 2023-08-17T00:06:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd3e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdd48154130 0x7fdd480656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41206/0 (socket says 172.21.15.153:41206) 2023-08-17T00:06:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd3e7fc700 1 -- 172.21.15.153:0/1873583817 learned_addr learned my addr 172.21.15.153:0/1873583817 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd477fe700 1 --2- 172.21.15.153:0/1873583817 >> v2:172.21.15.153:3300/0 conn(0x7fdd480632e0 0x7fdd480bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202539800 0 0) 0x7fdd48065240 con 0x7fdd48154130 2023-08-17T00:06:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd280033f0 con 0x7fdd48154130 2023-08-17T00:06:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338513485 0 0) 0x7fdd48065de0 con 0x7fdd48153d50 2023-08-17T00:06:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd48065240 con 0x7fdd48153d50 2023-08-17T00:06:36.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd477fe700 1 -- 172.21.15.153:0/1873583817 >> v1:172.21.15.178:6789/0 conn(0x7fdd48153d50 legacy=0x7fdd480629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd477fe700 1 -- 172.21.15.153:0/1873583817 >> v1:172.21.15.153:6789/0 conn(0x7fdd48154130 legacy=0x7fdd480656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd477fe700 1 -- 172.21.15.153:0/1873583817 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48064910 con 0x7fdd480632e0 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.364+0000 7fdd477fe700 1 --2- 172.21.15.153:0/1873583817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480bbdc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fdd40009e60 tx=0x7fdd40009780).ready entity=mon.0 client_cookie=78eab40b8dfbb219 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000e070 con 0x7fdd480632e0 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4000ba70 con 0x7fdd480632e0 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd467fc700 1 -- 172.21.15.153:0/1873583817 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000bdf0 con 0x7fdd480632e0 2023-08-17T00:06:36.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 -- 172.21.15.153:0/1873583817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 msgr2=0x7fdd480bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/1873583817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480bbdc0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fdd40009e60 tx=0x7fdd40009780).stop 2023-08-17T00:06:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 -- 172.21.15.153:0/1873583817 shutdown_connections 2023-08-17T00:06:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/1873583817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480bbdc0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 -- 172.21.15.153:0/1873583817 >> 172.21.15.153:0/1873583817 conn(0x7fdd480c7150 msgr2=0x7fdd480c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:36.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 -- 172.21.15.153:0/1873583817 shutdown_connections 2023-08-17T00:06:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 -- 172.21.15.153:0/1873583817 wait complete. 2023-08-17T00:06:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.368+0000 7fdd4d3db700 1 Processor -- start 2023-08-17T00:06:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 -- start start 2023-08-17T00:06:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd48153d50 0x7fdd480aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd48154130 0x7fdd480bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480a9690 con 0x7fdd480632e0 2023-08-17T00:06:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480a9970 con 0x7fdd48154130 2023-08-17T00:06:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd480a9c50 con 0x7fdd48153d50 2023-08-17T00:06:36.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58590/0 (socket says 172.21.15.153:58590) 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 -- 172.21.15.153:0/841870786 learned_addr learned my addr 172.21.15.153:0/841870786 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd477fe700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd48154130 0x7fdd480bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd3e7fc700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd48153d50 0x7fdd480aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 -- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd48153d50 msgr2=0x7fdd480aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd48153d50 0x7fdd480aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 -- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd48154130 msgr2=0x7fdd480bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd48154130 0x7fdd480bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 -- 172.21.15.153:0/841870786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd40009a20 con 0x7fdd480632e0 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd46ffd700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480aa710 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fdd38001eb0 tx=0x7fdd38007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800ce60 con 0x7fdd480632e0 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800f470 con 0x7fdd480632e0 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800f810 con 0x7fdd480632e0 2023-08-17T00:06:36.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.372+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd480a9f30 con 0x7fdd480632e0 2023-08-17T00:06:36.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.376+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd480aac00 con 0x7fdd480632e0 2023-08-17T00:06:36.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.376+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4806b530 con 0x7fdd480632e0 2023-08-17T00:06:36.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.376+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdd38019030 con 0x7fdd480632e0 2023-08-17T00:06:36.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.376+0000 7fdd3f7fe700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdd2c05a150 0x7fdd2c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.376+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdd38073610 con 0x7fdd480632e0 2023-08-17T00:06:36.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.376+0000 7fdd3e7fc700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdd2c05a150 0x7fdd2c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.380+0000 7fdd3e7fc700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdd2c05a150 0x7fdd2c05c610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fdd480c6330 tx=0x7fdd30009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:36.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.388+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdd38046fb0 con 0x7fdd480632e0 2023-08-17T00:06:36.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.544+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd480aae80 con 0x7fdd480632e0 2023-08-17T00:06:36.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.548+0000 7fdd3f7fe700 1 -- 172.21.15.153:0/841870786 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16976 (secure 0 0 0) 0x7fdd3804a5d0 con 0x7fdd480632e0 2023-08-17T00:06:36.554 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:36.554 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":50,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:01.866515+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:05:58.859718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T00:05:59.885036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:36.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdd2c05a150 msgr2=0x7fdd2c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdd2c05a150 0x7fdd2c05c610 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fdd480c6330 tx=0x7fdd30009040).stop 2023-08-17T00:06:36.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 msgr2=0x7fdd480aa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480aa710 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7fdd38001eb0 tx=0x7fdd38007c70).stop 2023-08-17T00:06:36.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 shutdown_connections 2023-08-17T00:06:36.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdd2c05a150 0x7fdd2c05c610 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd48154130 0x7fdd480bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd48153d50 0x7fdd480aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 --2- 172.21.15.153:0/841870786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdd480632e0 0x7fdd480aa710 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 >> 172.21.15.153:0/841870786 conn(0x7fdd480c7150 msgr2=0x7fdd48158020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 shutdown_connections 2023-08-17T00:06:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.552+0000 7fdd4d3db700 1 -- 172.21.15.153:0/841870786 wait complete. 2023-08-17T00:06:36.577 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:06:36.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.736+0000 7f321f59e700 1 Processor -- start 2023-08-17T00:06:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.736+0000 7f321f59e700 1 -- start start 2023-08-17T00:06:36.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32200a8df0 0x7f32200c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200aa6e0 0x7f3220068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32201585a0 con 0x7f3220068820 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3220066400 con 0x7f32200a8df0 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3220069170 con 0x7f32200aa6e0 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32200a8df0 0x7f32200c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f32200a8df0 0x7f32200c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58598/0 (socket says 172.21.15.153:58598) 2023-08-17T00:06:36.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 -- 172.21.15.153:0/3935876071 learned_addr learned my addr 172.21.15.153:0/3935876071 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321ed9d700 1 --2- 172.21.15.153:0/3935876071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200aa6e0 0x7f3220068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 -- 172.21.15.153:0/3935876071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200aa6e0 msgr2=0x7f3220068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 --2- 172.21.15.153:0/3935876071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200aa6e0 0x7f3220068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 -- 172.21.15.153:0/3935876071 >> v1:172.21.15.153:6789/0 conn(0x7f3220068820 legacy=0x7f3220061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 -- 172.21.15.153:0/3935876071 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200b9d30 con 0x7f32200a8df0 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.740+0000 7f321e59c700 1 --2- 172.21.15.153:0/3935876071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32200a8df0 0x7f32200c1490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f3210009810 tx=0x7f3210009060).ready entity=mon.0 client_cookie=27507c4f8ce1491b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321dd9b700 1 -- 172.21.15.153:0/3935876071 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210005880 con 0x7f32200a8df0 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321dd9b700 1 -- 172.21.15.153:0/3935876071 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32100059e0 con 0x7f32200a8df0 2023-08-17T00:06:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321dd9b700 1 -- 172.21.15.153:0/3935876071 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3210005d60 con 0x7f32200a8df0 2023-08-17T00:06:36.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 -- 172.21.15.153:0/3935876071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32200a8df0 msgr2=0x7f32200c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 --2- 172.21.15.153:0/3935876071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32200a8df0 0x7f32200c1490 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7f3210009810 tx=0x7f3210009060).stop 2023-08-17T00:06:36.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 -- 172.21.15.153:0/3935876071 shutdown_connections 2023-08-17T00:06:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 --2- 172.21.15.153:0/3935876071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200aa6e0 0x7f3220068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 --2- 172.21.15.153:0/3935876071 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f32200a8df0 0x7f32200c1490 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 -- 172.21.15.153:0/3935876071 >> 172.21.15.153:0/3935876071 conn(0x7f32200c6620 msgr2=0x7f32200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 -- 172.21.15.153:0/3935876071 shutdown_connections 2023-08-17T00:06:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.744+0000 7f321f59e700 1 -- 172.21.15.153:0/3935876071 wait complete. 2023-08-17T00:06:36.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 Processor -- start 2023-08-17T00:06:36.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 -- start start 2023-08-17T00:06:36.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 0x7f322015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200a8df0 0x7f322016c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32200aa6e0 0x7f32200c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3220168ce0 con 0x7f3220068820 2023-08-17T00:06:36.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3220168fc0 con 0x7f32200aa6e0 2023-08-17T00:06:36.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32201692a0 con 0x7f32200a8df0 2023-08-17T00:06:36.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 0x7f322015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 0x7f322015ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58608/0 (socket says 172.21.15.153:58608) 2023-08-17T00:06:36.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 -- 172.21.15.153:0/3035675674 learned_addr learned my addr 172.21.15.153:0/3035675674 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:36.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f3215d9b700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200a8df0 0x7f322016c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321ed9d700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32200aa6e0 0x7f32200c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 -- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200a8df0 msgr2=0x7f322016c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200a8df0 0x7f322016c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 -- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32200aa6e0 msgr2=0x7f32200c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32200aa6e0 0x7f32200c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 -- 172.21.15.153:0/3035675674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3210009300 con 0x7f3220068820 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.748+0000 7f321e59c700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 0x7f322015ac10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f3210009eb0 tx=0x7f3210016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:36.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321000b790 con 0x7f3220068820 2023-08-17T00:06:36.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321000b8f0 con 0x7f3220068820 2023-08-17T00:06:36.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3220169580 con 0x7f3220068820 2023-08-17T00:06:36.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321000bc70 con 0x7f3220068820 2023-08-17T00:06:36.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3220169860 con 0x7f3220068820 2023-08-17T00:06:36.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322006b4c0 con 0x7f3220068820 2023-08-17T00:06:36.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.752+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f321000f070 con 0x7f3220068820 2023-08-17T00:06:36.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.756+0000 7f3216ffd700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f320005a180 0x7f320005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:36.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.756+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f32100751a0 con 0x7f3220068820 2023-08-17T00:06:36.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.756+0000 7f3215d9b700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f320005a180 0x7f320005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:36.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.756+0000 7f3215d9b700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f320005a180 0x7f320005c640 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f322016be50 tx=0x7f3208009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:36.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.760+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3210048c50 con 0x7f3220068820 2023-08-17T00:06:36.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.968+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3220064010 con 0x7f3220068820 2023-08-17T00:06:36.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f3216ffd700 1 -- 172.21.15.153:0/3035675674 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f321004c270 con 0x7f3220068820 2023-08-17T00:06:36.976 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:36.976 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:36.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f320005a180 msgr2=0x7f320005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f320005a180 0x7f320005c640 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f322016be50 tx=0x7f3208009040).stop 2023-08-17T00:06:36.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 msgr2=0x7f322015ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:36.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 0x7f322015ac10 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f3210009eb0 tx=0x7f3210016000).stop 2023-08-17T00:06:36.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 shutdown_connections 2023-08-17T00:06:36.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f320005a180 0x7f320005c640 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32200aa6e0 0x7f32200c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32200a8df0 0x7f322016c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 --2- 172.21.15.153:0/3035675674 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3220068820 0x7f322015ac10 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 >> 172.21.15.153:0/3035675674 conn(0x7f32200c6620 msgr2=0x7f32200694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 shutdown_connections 2023-08-17T00:06:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:36.972+0000 7f321f59e700 1 -- 172.21.15.153:0/3035675674 wait complete. 2023-08-17T00:06:36.980 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:36.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:37.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.148+0000 7f7ab6b07700 1 Processor -- start 2023-08-17T00:06:37.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.148+0000 7f7ab6b07700 1 -- start start 2023-08-17T00:06:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6b07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ab0068c80 0x7f7ab00a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6b07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab01585a0 con 0x7f7ab00a8df0 2023-08-17T00:06:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6b07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab0066400 con 0x7f7ab0068820 2023-08-17T00:06:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6b07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00c1ba0 con 0x7f7ab0068c80 2023-08-17T00:06:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab5b05700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ab00a8df0 0x7f7ab00c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41230/0 (socket says 172.21.15.153:41230) 2023-08-17T00:06:37.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab5b05700 1 -- 172.21.15.153:0/3087089149 learned_addr learned my addr 172.21.15.153:0/3087089149 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:37.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6306700 1 --2- 172.21.15.153:0/3087089149 >> v2:172.21.15.153:3300/0 conn(0x7f7ab0068c80 0x7f7ab00a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab4b03700 1 -- 172.21.15.153:0/3087089149 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264980878 0 0) 0x7f7ab01585a0 con 0x7f7ab00a8df0 2023-08-17T00:06:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab4b03700 1 -- 172.21.15.153:0/3087089149 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c0033f0 con 0x7f7ab00a8df0 2023-08-17T00:06:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6306700 1 -- 172.21.15.153:0/3087089149 >> v1:172.21.15.178:6789/0 conn(0x7f7ab0068820 legacy=0x7f7ab00a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6306700 1 -- 172.21.15.153:0/3087089149 >> v1:172.21.15.153:6789/0 conn(0x7f7ab00a8df0 legacy=0x7f7ab00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6306700 1 -- 172.21.15.153:0/3087089149 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00b9d30 con 0x7f7ab0068c80 2023-08-17T00:06:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab6306700 1 --2- 172.21.15.153:0/3087089149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068c80 0x7f7ab00a9de0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f7aa8009e60 tx=0x7f7aa8009780).ready entity=mon.0 client_cookie=30e7ceafc1c68457 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab4b03700 1 -- 172.21.15.153:0/3087089149 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa800e070 con 0x7f7ab0068c80 2023-08-17T00:06:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab4b03700 1 -- 172.21.15.153:0/3087089149 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa800bb60 con 0x7f7ab0068c80 2023-08-17T00:06:37.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.152+0000 7f7ab4b03700 1 -- 172.21.15.153:0/3087089149 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8012410 con 0x7f7ab0068c80 2023-08-17T00:06:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 -- 172.21.15.153:0/3087089149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068c80 msgr2=0x7f7ab00a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/3087089149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068c80 0x7f7ab00a9de0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f7aa8009e60 tx=0x7f7aa8009780).stop 2023-08-17T00:06:37.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 -- 172.21.15.153:0/3087089149 shutdown_connections 2023-08-17T00:06:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/3087089149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068c80 0x7f7ab00a9de0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 -- 172.21.15.153:0/3087089149 >> 172.21.15.153:0/3087089149 conn(0x7f7ab00c6620 msgr2=0x7f7ab00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 -- 172.21.15.153:0/3087089149 shutdown_connections 2023-08-17T00:06:37.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 -- 172.21.15.153:0/3087089149 wait complete. 2023-08-17T00:06:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 Processor -- start 2023-08-17T00:06:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 -- start start 2023-08-17T00:06:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.156+0000 7f7ab6b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab00be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab0068c80 0x7f7ab0144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 0x7f7ab00b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00bae40 con 0x7f7ab00a8df0 2023-08-17T00:06:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00bd3e0 con 0x7f7ab0068c80 2023-08-17T00:06:37.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00bff10 con 0x7f7ab0068820 2023-08-17T00:06:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 0x7f7ab00b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 0x7f7ab00b9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58630/0 (socket says 172.21.15.153:58630) 2023-08-17T00:06:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 -- 172.21.15.153:0/2641709987 learned_addr learned my addr 172.21.15.153:0/2641709987 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab5b05700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab00be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab5304700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab0068c80 0x7f7ab0144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 -- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 msgr2=0x7f7ab00be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab00be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 -- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab0068c80 msgr2=0x7f7ab0144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab0068c80 0x7f7ab0144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 -- 172.21.15.153:0/2641709987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8009a20 con 0x7f7ab00a8df0 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab5b05700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab00be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab5304700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab0068c80 0x7f7ab0144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6306700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 0x7f7ab00b9f30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f7ab0066a70 tx=0x7f7aa8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa8021070 con 0x7f7ab00a8df0 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa801c660 con 0x7f7ab00a8df0 2023-08-17T00:06:37.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ab00bee70 con 0x7f7ab00a8df0 2023-08-17T00:06:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa801ca00 con 0x7f7ab00a8df0 2023-08-17T00:06:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab00bf430 con 0x7f7ab00a8df0 2023-08-17T00:06:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.160+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab006b4c0 con 0x7f7ab00a8df0 2023-08-17T00:06:37.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.164+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7aa801d420 con 0x7f7ab00a8df0 2023-08-17T00:06:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.164+0000 7f7aa5ffb700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.164+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7aa80764e0 con 0x7f7ab00a8df0 2023-08-17T00:06:37.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.164+0000 7f7ab5b05700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.164+0000 7f7ab5b05700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7aac001360 tx=0x7f7aac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.168+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7aa8049f10 con 0x7f7ab00a8df0 2023-08-17T00:06:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.364+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ab0064010 con 0x7f7ab00a8df0 2023-08-17T00:06:37.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.368+0000 7f7aa5ffb700 1 -- 172.21.15.153:0/2641709987 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f7aa801cdb0 con 0x7f7ab00a8df0 2023-08-17T00:06:37.372 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:37.372 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:00.861959+0000","modified":"2023-08-17T00:06:21.364685+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5427},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5427":{"gid":5427,"name":"c","rank":0,"incarnation":34,"state":"up:active","state_seq":8,"addr":"172.21.15.153:6835/1057651106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1057651106},{"type":"v1","addr":"172.21.15.153:6835","nonce":1057651106}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-08-17T00:06:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 msgr2=0x7f7a9405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f7aac001360 tx=0x7f7aac009040).stop 2023-08-17T00:06:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 msgr2=0x7f7ab00b9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 0x7f7ab00b9f30 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f7ab0066a70 tx=0x7f7aa8009780).stop 2023-08-17T00:06:37.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 shutdown_connections 2023-08-17T00:06:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab00a8df0 0x7f7ab00b9f30 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab0068c80 0x7f7ab0144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 --2- 172.21.15.153:0/2641709987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab00be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 >> 172.21.15.153:0/2641709987 conn(0x7f7ab00c6620 msgr2=0x7f7ab00a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 shutdown_connections 2023-08-17T00:06:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.372+0000 7f7ab6b07700 1 -- 172.21.15.153:0/2641709987 wait complete. 2023-08-17T00:06:37.379 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 40 2023-08-17T00:06:37.395 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:37.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.540+0000 7f99ff59e700 1 Processor -- start 2023-08-17T00:06:37.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.540+0000 7f99ff59e700 1 -- start start 2023-08-17T00:06:37.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99ff59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9a000abf10 0x7f9a00068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99ff59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a000ac2f0 0x7f9a00068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99ff59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a001545e0 con 0x7f9a000c0a80 2023-08-17T00:06:37.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99ff59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a00069200 con 0x7f9a000abf10 2023-08-17T00:06:37.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99ff59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a000c1c50 con 0x7f9a000ac2f0 2023-08-17T00:06:37.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fe59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9a000abf10 0x7f9a00068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9a000c0a80 0x7f9a000c0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41244/0 (socket says 172.21.15.153:41244) 2023-08-17T00:06:37.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fed9d700 1 -- 172.21.15.153:0/1187050377 learned_addr learned my addr 172.21.15.153:0/1187050377 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:37.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fdd9b700 1 --2- 172.21.15.153:0/1187050377 >> v2:172.21.15.178:3300/0 conn(0x7f9a000ac2f0 0x7f9a00068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fe59c700 1 -- 172.21.15.153:0/1187050377 >> v2:172.21.15.178:3300/0 conn(0x7f9a000ac2f0 msgr2=0x7f9a00068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:37.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fe59c700 1 --2- 172.21.15.153:0/1187050377 >> v2:172.21.15.178:3300/0 conn(0x7f9a000ac2f0 0x7f9a00068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fe59c700 1 -- 172.21.15.153:0/1187050377 >> v1:172.21.15.153:6789/0 conn(0x7f9a000c0a80 legacy=0x7f9a000c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fd59a700 1 -- 172.21.15.153:0/1187050377 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671321917 0 0) 0x7f9a001545e0 con 0x7f9a000c0a80 2023-08-17T00:06:37.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fe59c700 1 -- 172.21.15.153:0/1187050377 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000a96d0 con 0x7f9a000abf10 2023-08-17T00:06:37.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.544+0000 7f99fe59c700 1 --2- 172.21.15.153:0/1187050377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00068820 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f9a000693d0 tx=0x7f99f0006f40).ready entity=mon.0 client_cookie=1bfa1ef814267baf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99fd59a700 1 -- 172.21.15.153:0/1187050377 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0005880 con 0x7f9a000abf10 2023-08-17T00:06:37.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99fd59a700 1 -- 172.21.15.153:0/1187050377 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00059e0 con 0x7f9a000abf10 2023-08-17T00:06:37.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99fd59a700 1 -- 172.21.15.153:0/1187050377 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0005d60 con 0x7f9a000abf10 2023-08-17T00:06:37.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 -- 172.21.15.153:0/1187050377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 msgr2=0x7f9a00068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 --2- 172.21.15.153:0/1187050377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00068820 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f9a000693d0 tx=0x7f99f0006f40).stop 2023-08-17T00:06:37.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 -- 172.21.15.153:0/1187050377 shutdown_connections 2023-08-17T00:06:37.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 --2- 172.21.15.153:0/1187050377 >> v2:172.21.15.178:3300/0 conn(0x7f9a000ac2f0 0x7f9a00068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 --2- 172.21.15.153:0/1187050377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00068820 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 -- 172.21.15.153:0/1187050377 >> 172.21.15.153:0/1187050377 conn(0x7f9a000c6620 msgr2=0x7f9a000c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:37.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 -- 172.21.15.153:0/1187050377 shutdown_connections 2023-08-17T00:06:37.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 -- 172.21.15.153:0/1187050377 wait complete. 2023-08-17T00:06:37.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 Processor -- start 2023-08-17T00:06:37.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.548+0000 7f99ff59e700 1 -- start start 2023-08-17T00:06:37.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a000ac2f0 0x7f9a0014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a000c0a80 0x7f9a0014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0014e900 con 0x7f9a000abf10 2023-08-17T00:06:37.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000bbe70 con 0x7f9a000c0a80 2023-08-17T00:06:37.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000bc150 con 0x7f9a000ac2f0 2023-08-17T00:06:37.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58650/0 (socket says 172.21.15.153:58650) 2023-08-17T00:06:37.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 -- 172.21.15.153:0/2139637064 learned_addr learned my addr 172.21.15.153:0/2139637064 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:37.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fed9d700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a000c0a80 0x7f9a0014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fdd9b700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a000ac2f0 0x7f9a0014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 -- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a000ac2f0 msgr2=0x7f9a0014d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a000ac2f0 0x7f9a0014d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 -- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a000c0a80 msgr2=0x7f9a0014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a000c0a80 0x7f9a0014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 -- 172.21.15.153:0/2139637064 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009250 con 0x7f9a000abf10 2023-08-17T00:06:37.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fdd9b700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a000ac2f0 0x7f9a0014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:37.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99fe59c700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00150c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f99f0006fd0 tx=0x7f99f0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000f720 con 0x7f9a000abf10 2023-08-17T00:06:37.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000f880 con 0x7f9a000abf10 2023-08-17T00:06:37.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f000fc00 con 0x7f9a000abf10 2023-08-17T00:06:37.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0014eba0 con 0x7f9a000abf10 2023-08-17T00:06:37.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.552+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0014e0e0 con 0x7f9a000abf10 2023-08-17T00:06:37.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.556+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a00151c30 con 0x7f9a000abf10 2023-08-17T00:06:37.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.556+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f99f000f070 con 0x7f9a000abf10 2023-08-17T00:06:37.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.556+0000 7f99ee7fc700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99e005a150 0x7f99e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.556+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f99f0075980 con 0x7f9a000abf10 2023-08-17T00:06:37.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.556+0000 7f99fdd9b700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99e005a150 0x7f99e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.560+0000 7f99fdd9b700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99e005a150 0x7f99e005c610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f99f4006d80 tx=0x7f99f4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.560+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99f0049360 con 0x7f9a000abf10 2023-08-17T00:06:37.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.724+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a000bc310 con 0x7f9a000abf10 2023-08-17T00:06:37.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.724+0000 7f99ee7fc700 1 -- 172.21.15.153:0/2139637064 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16976 (secure 0 0 0) 0x7f99f004c940 con 0x7f9a000abf10 2023-08-17T00:06:37.731 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:37.731 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":50,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:01.866515+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:05:58.859718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-08-17T00:05:59.885036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99e005a150 msgr2=0x7f99e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99e005a150 0x7f99e005c610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f99f4006d80 tx=0x7f99f4008040).stop 2023-08-17T00:06:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 msgr2=0x7f9a00150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00150c90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f99f0006fd0 tx=0x7f99f0015000).stop 2023-08-17T00:06:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 shutdown_connections 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f99e005a150 0x7f99e005c610 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a000c0a80 0x7f9a0014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a000ac2f0 0x7f9a0014d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 --2- 172.21.15.153:0/2139637064 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a000abf10 0x7f9a00150c90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 >> 172.21.15.153:0/2139637064 conn(0x7f9a000c6620 msgr2=0x7f9a000c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 shutdown_connections 2023-08-17T00:06:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.728+0000 7f99ff59e700 1 -- 172.21.15.153:0/2139637064 wait complete. 2023-08-17T00:06:37.754 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:06:37.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 Processor -- start 2023-08-17T00:06:37.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 -- start start 2023-08-17T00:06:37.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64c40a8df0 0x7f64c40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f64c4068820 0x7f64c4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c41585a0 con 0x7f64c40a8df0 2023-08-17T00:06:37.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64c4066400 con 0x7f64c4068820 2023-08-17T00:06:37.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.900+0000 7f64ca507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c4069170 con 0x7f64c4061fa0 2023-08-17T00:06:37.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64c40a8df0 0x7f64c40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f64c40a8df0 0x7f64c40c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58660/0 (socket says 172.21.15.153:58660) 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 -- 172.21.15.153:0/3562838306 learned_addr learned my addr 172.21.15.153:0/3562838306 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9d06700 1 --2- 172.21.15.153:0/3562838306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c8d04700 1 --2- 172.21.15.153:0/3562838306 >> v2:172.21.15.178:3300/0 conn(0x7f64c4068820 0x7f64c4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 -- 172.21.15.153:0/3562838306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 msgr2=0x7f64c4062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 --2- 172.21.15.153:0/3562838306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 -- 172.21.15.153:0/3562838306 >> v2:172.21.15.178:3300/0 conn(0x7f64c4068820 msgr2=0x7f64c4068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:37.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 --2- 172.21.15.153:0/3562838306 >> v2:172.21.15.178:3300/0 conn(0x7f64c4068820 0x7f64c4068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 -- 172.21.15.153:0/3562838306 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c40b9d30 con 0x7f64c40a8df0 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64c9505700 1 --2- 172.21.15.153:0/3562838306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c40a8df0 0x7f64c40c1490 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f64c40c2ef0 tx=0x7f64c0009060).ready entity=mon.0 client_cookie=e992241eccbdce09 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64bbfff700 1 -- 172.21.15.153:0/3562838306 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0005880 con 0x7f64c40a8df0 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64bbfff700 1 -- 172.21.15.153:0/3562838306 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c00059e0 con 0x7f64c40a8df0 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64bbfff700 1 -- 172.21.15.153:0/3562838306 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c0005d60 con 0x7f64c40a8df0 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 -- 172.21.15.153:0/3562838306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c40a8df0 msgr2=0x7f64c40c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 --2- 172.21.15.153:0/3562838306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c40a8df0 0x7f64c40c1490 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f64c40c2ef0 tx=0x7f64c0009060).stop 2023-08-17T00:06:37.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 -- 172.21.15.153:0/3562838306 shutdown_connections 2023-08-17T00:06:37.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 --2- 172.21.15.153:0/3562838306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 --2- 172.21.15.153:0/3562838306 >> v2:172.21.15.178:3300/0 conn(0x7f64c4068820 0x7f64c4068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 --2- 172.21.15.153:0/3562838306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c40a8df0 0x7f64c40c1490 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.904+0000 7f64ca507700 1 -- 172.21.15.153:0/3562838306 >> 172.21.15.153:0/3562838306 conn(0x7f64c40c6620 msgr2=0x7f64c40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:37.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.908+0000 7f64ca507700 1 -- 172.21.15.153:0/3562838306 shutdown_connections 2023-08-17T00:06:37.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.908+0000 7f64ca507700 1 -- 172.21.15.153:0/3562838306 wait complete. 2023-08-17T00:06:37.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.908+0000 7f64ca507700 1 Processor -- start 2023-08-17T00:06:37.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.908+0000 7f64ca507700 1 -- start start 2023-08-17T00:06:37.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 0x7f64c40bef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c40a8df0 0x7f64c415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40b9f60 con 0x7f64c4068820 2023-08-17T00:06:37.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40ba800 con 0x7f64c40a8df0 2023-08-17T00:06:37.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64c40bf8d0 con 0x7f64c4061fa0 2023-08-17T00:06:37.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 0x7f64c40bef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 0x7f64c40bef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58674/0 (socket says 172.21.15.153:58674) 2023-08-17T00:06:37.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 -- 172.21.15.153:0/1813977582 learned_addr learned my addr 172.21.15.153:0/1813977582 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:37.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c9505700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c9d06700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c40a8df0 0x7f64c415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 -- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 msgr2=0x7f64c4156e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4156e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 -- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c40a8df0 msgr2=0x7f64c415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c40a8df0 0x7f64c415a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 -- 172.21.15.153:0/1813977582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c0009300 con 0x7f64c4068820 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c9505700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:37.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c9d06700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c40a8df0 0x7f64c415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:37.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64c8d04700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 0x7f64c40bef30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f64b400e960 tx=0x7f64b4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400c850 con 0x7f64c4068820 2023-08-17T00:06:37.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64b400c9b0 con 0x7f64c4068820 2023-08-17T00:06:37.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c40ba1b0 con 0x7f64c4068820 2023-08-17T00:06:37.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64b400cd30 con 0x7f64c4068820 2023-08-17T00:06:37.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c416ce00 con 0x7f64c4068820 2023-08-17T00:06:37.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.912+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c406b4c0 con 0x7f64c4068820 2023-08-17T00:06:37.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.916+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f64b4022070 con 0x7f64c4068820 2023-08-17T00:06:37.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.916+0000 7f64b97fa700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64a805a150 0x7f64a805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:37.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.916+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f64b4074540 con 0x7f64c4068820 2023-08-17T00:06:37.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.916+0000 7f64c9505700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64a805a150 0x7f64a805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:37.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.916+0000 7f64c9505700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64a805a150 0x7f64a805c610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f64c40c2ef0 tx=0x7f64c0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:37.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:37.924+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f64b4047ff0 con 0x7f64c4068820 2023-08-17T00:06:38.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.116+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64c40a9660 con 0x7f64c4068820 2023-08-17T00:06:38.393 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:06:38.388+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:06:38.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.404+0000 7f64b97fa700 1 -- 172.21.15.153:0/1813977582 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7f64b404b610 con 0x7f64c4068820 2023-08-17T00:06:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64a805a150 msgr2=0x7f64a805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64a805a150 0x7f64a805c610 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f64c40c2ef0 tx=0x7f64c0016000).stop 2023-08-17T00:06:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 msgr2=0x7f64c40bef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:38.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 0x7f64c40bef30 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f64b400e960 tx=0x7f64b4009060).stop 2023-08-17T00:06:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 shutdown_connections 2023-08-17T00:06:38.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64a805a150 0x7f64a805c610 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f64c40a8df0 0x7f64c415a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f64c4068820 0x7f64c40bef30 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 --2- 172.21.15.153:0/1813977582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f64c4061fa0 0x7f64c4156e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 >> 172.21.15.153:0/1813977582 conn(0x7f64c40c6620 msgr2=0x7f64c40aa120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:38.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 shutdown_connections 2023-08-17T00:06:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.408+0000 7f64ca507700 1 -- 172.21.15.153:0/1813977582 wait complete. 2023-08-17T00:06:38.417 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:06:38.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:06:38.479 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:06:38.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.588+0000 7fa2f6adb700 1 Processor -- start 2023-08-17T00:06:38.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.588+0000 7fa2f6adb700 1 -- start start 2023-08-17T00:06:38.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f6adb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f0153ab0 0x7fa2f0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f6adb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2f00c8d50 0x7fa2f00c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f6adb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa2f00c7490 0x7fa2f00c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f6adb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f00aa750 con 0x7fa2f00c7490 2023-08-17T00:06:38.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f6adb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f00c7e30 con 0x7fa2f00c8d50 2023-08-17T00:06:38.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f6adb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00c9dd0 con 0x7fa2f0153ab0 2023-08-17T00:06:38.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa2f00c7490 0x7fa2f00c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa2f00c7490 0x7fa2f00c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58706/0 (socket says 172.21.15.153:58706) 2023-08-17T00:06:38.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 -- 172.21.15.153:0/2670480343 learned_addr learned my addr 172.21.15.153:0/2670480343 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:38.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2effff700 1 --2- 172.21.15.153:0/2670480343 >> v2:172.21.15.178:3300/0 conn(0x7fa2f00c8d50 0x7fa2f00c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f4877700 1 --2- 172.21.15.153:0/2670480343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f0153ab0 0x7fa2f0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 -- 172.21.15.153:0/2670480343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f0153ab0 msgr2=0x7fa2f0153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:38.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 --2- 172.21.15.153:0/2670480343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f0153ab0 0x7fa2f0153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 -- 172.21.15.153:0/2670480343 >> v2:172.21.15.178:3300/0 conn(0x7fa2f00c8d50 msgr2=0x7fa2f00c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:38.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 --2- 172.21.15.153:0/2670480343 >> v2:172.21.15.178:3300/0 conn(0x7fa2f00c8d50 0x7fa2f00c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 -- 172.21.15.153:0/2670480343 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00aacf0 con 0x7fa2f00c7490 2023-08-17T00:06:38.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2f5078700 1 --2- 172.21.15.153:0/2670480343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c7490 0x7fa2f00c7940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa2f005e680 tx=0x7fa2e8009840).ready entity=mon.0 client_cookie=a29ab9dc2dd801a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:38.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2ef7fe700 1 -- 172.21.15.153:0/2670480343 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800e070 con 0x7fa2f00c7490 2023-08-17T00:06:38.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2ef7fe700 1 -- 172.21.15.153:0/2670480343 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e800b970 con 0x7fa2f00c7490 2023-08-17T00:06:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.592+0000 7fa2ef7fe700 1 -- 172.21.15.153:0/2670480343 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e800bcf0 con 0x7fa2f00c7490 2023-08-17T00:06:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 -- 172.21.15.153:0/2670480343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c7490 msgr2=0x7fa2f00c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/2670480343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c7490 0x7fa2f00c7940 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fa2f005e680 tx=0x7fa2e8009840).stop 2023-08-17T00:06:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 -- 172.21.15.153:0/2670480343 shutdown_connections 2023-08-17T00:06:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/2670480343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c7490 0x7fa2f00c7940 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/2670480343 >> v2:172.21.15.178:3300/0 conn(0x7fa2f00c8d50 0x7fa2f00c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/2670480343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f0153ab0 0x7fa2f0153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 -- 172.21.15.153:0/2670480343 >> 172.21.15.153:0/2670480343 conn(0x7fa2f0061fa0 msgr2=0x7fa2f00623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 -- 172.21.15.153:0/2670480343 shutdown_connections 2023-08-17T00:06:38.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.596+0000 7fa2f6adb700 1 -- 172.21.15.153:0/2670480343 wait complete. 2023-08-17T00:06:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 Processor -- start 2023-08-17T00:06:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 -- start start 2023-08-17T00:06:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00c7490 0x7fa2f0147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 0x7fa2f00c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f0153ab0 0x7fa2f0167040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0167fe0 con 0x7fa2f00c8d50 2023-08-17T00:06:38.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f0167530 con 0x7fa2f0153ab0 2023-08-17T00:06:38.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f6adb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00c3250 con 0x7fa2f00c7490 2023-08-17T00:06:38.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 0x7fa2f00c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 0x7fa2f00c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58716/0 (socket says 172.21.15.153:58716) 2023-08-17T00:06:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 -- 172.21.15.153:0/1452470554 learned_addr learned my addr 172.21.15.153:0/1452470554 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f4877700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00c7490 0x7fa2f0147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2f5078700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f0153ab0 0x7fa2f0167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 -- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00c7490 msgr2=0x7fa2f0147090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00c7490 0x7fa2f0147090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 -- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f0153ab0 msgr2=0x7fa2f0167040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f0153ab0 0x7fa2f0167040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 -- 172.21.15.153:0/1452470554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8009ae0 con 0x7fa2f00c8d50 2023-08-17T00:06:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2effff700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 0x7fa2f00c4810 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa2e000e8d0 tx=0x7fa2e0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.600+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0009390 con 0x7fa2f00c8d50 2023-08-17T00:06:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.604+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0012600 con 0x7fa2f00c8d50 2023-08-17T00:06:38.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.604+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f0167740 con 0x7fa2f00c8d50 2023-08-17T00:06:38.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.604+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0012980 con 0x7fa2f00c8d50 2023-08-17T00:06:38.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.604+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f0167d00 con 0x7fa2f00c8d50 2023-08-17T00:06:38.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.604+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f00c3020 con 0x7fa2f00c8d50 2023-08-17T00:06:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.604+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa2e0022070 con 0x7fa2f00c8d50 2023-08-17T00:06:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.608+0000 7fa2ecff9700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2dc05a150 0x7fa2dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.608+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fa2e00742a0 con 0x7fa2f00c8d50 2023-08-17T00:06:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.608+0000 7fa2f4877700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2dc05a150 0x7fa2dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.608+0000 7fa2f4877700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2dc05a150 0x7fa2dc05c610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fa2e4009c30 tx=0x7fa2e4009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.612+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2f00c3020 con 0x7fa2f00c8d50 2023-08-17T00:06:38.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:38.808+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2f00c3020 con 0x7fa2f00c8d50 2023-08-17T00:06:39.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.408+0000 7fa2ecff9700 1 -- 172.21.15.153:0/1452470554 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2f00c3020 con 0x7fa2f00c8d50 2023-08-17T00:06:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2dc05a150 msgr2=0x7fa2dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2dc05a150 0x7fa2dc05c610 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fa2e4009c30 tx=0x7fa2e4009060).stop 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 msgr2=0x7fa2f00c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 0x7fa2f00c4810 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fa2e000e8d0 tx=0x7fa2e0009060).stop 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 shutdown_connections 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2dc05a150 0x7fa2dc05c610 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f0153ab0 0x7fa2f0167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2f00c8d50 0x7fa2f00c4810 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 --2- 172.21.15.153:0/1452470554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f00c7490 0x7fa2f0147090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 >> 172.21.15.153:0/1452470554 conn(0x7fa2f0061fa0 msgr2=0x7fa2f0151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 shutdown_connections 2023-08-17T00:06:39.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.412+0000 7fa2f6adb700 1 -- 172.21.15.153:0/1452470554 wait complete. 2023-08-17T00:06:39.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:06:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.648+0000 7f37aedb9700 1 Processor -- start 2023-08-17T00:06:39.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.652+0000 7f37aedb9700 1 -- start start 2023-08-17T00:06:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.652+0000 7f37aedb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a80651d0 0x7f37a80bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.652+0000 7f37aedb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a80bc570 con 0x7f37a8064df0 2023-08-17T00:06:39.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a80bc850 con 0x7f37a814b6b0 2023-08-17T00:06:39.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a8152d00 con 0x7f37a80651d0 2023-08-17T00:06:39.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37addb7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f37a8064df0 0x7f37a80bb820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41258/0 (socket says 172.21.15.153:41258) 2023-08-17T00:06:39.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37addb7700 1 -- 172.21.15.153:0/988192909 learned_addr learned my addr 172.21.15.153:0/988192909 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:39.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37ad5b6700 1 --2- 172.21.15.153:0/988192909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a80651d0 0x7f37a80bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:39.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37acdb5700 1 -- 172.21.15.153:0/988192909 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201547072 0 0) 0x7f37a80bc570 con 0x7f37a8064df0 2023-08-17T00:06:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37ad5b6700 1 -- 172.21.15.153:0/988192909 >> v1:172.21.15.178:6789/0 conn(0x7f37a814b6b0 legacy=0x7f37a814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37ad5b6700 1 -- 172.21.15.153:0/988192909 >> v1:172.21.15.153:6789/0 conn(0x7f37a8064df0 legacy=0x7f37a80bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37ad5b6700 1 -- 172.21.15.153:0/988192909 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a80bcb30 con 0x7f37a80651d0 2023-08-17T00:06:39.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37ad5b6700 1 --2- 172.21.15.153:0/988192909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a80651d0 0x7f37a80bbf30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3798009790 tx=0x7f3798009060).ready entity=mon.2 client_cookie=c2920a8f79a1d40d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:39.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37acdb5700 1 -- 172.21.15.153:0/988192909 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800b5a0 con 0x7f37a80651d0 2023-08-17T00:06:39.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37acdb5700 1 -- 172.21.15.153:0/988192909 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379800b700 con 0x7f37a80651d0 2023-08-17T00:06:39.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37acdb5700 1 -- 172.21.15.153:0/988192909 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800ba80 con 0x7f37a80651d0 2023-08-17T00:06:39.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- 172.21.15.153:0/988192909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a80651d0 msgr2=0x7f37a80bbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 --2- 172.21.15.153:0/988192909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a80651d0 0x7f37a80bbf30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f3798009790 tx=0x7f3798009060).stop 2023-08-17T00:06:39.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- 172.21.15.153:0/988192909 shutdown_connections 2023-08-17T00:06:39.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 --2- 172.21.15.153:0/988192909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a80651d0 0x7f37a80bbf30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- 172.21.15.153:0/988192909 >> 172.21.15.153:0/988192909 conn(0x7f37a80c6ee0 msgr2=0x7f37a80c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:39.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- 172.21.15.153:0/988192909 shutdown_connections 2023-08-17T00:06:39.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.656+0000 7f37aedb9700 1 -- 172.21.15.153:0/988192909 wait complete. 2023-08-17T00:06:39.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 Processor -- start 2023-08-17T00:06:39.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 -- start start 2023-08-17T00:06:39.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 0x7f37a81628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:39.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a814b6b0 0x7f37a8148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:39.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a80a93c0 0x7f37a80ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:39.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a814eb80 con 0x7f37a8064df0 2023-08-17T00:06:39.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a8148600 con 0x7f37a80a93c0 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37aedb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a80aac90 con 0x7f37a814b6b0 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37addb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 0x7f37a81628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37addb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 0x7f37a81628d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58724/0 (socket says 172.21.15.153:58724) 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37addb7700 1 -- 172.21.15.153:0/2376308552 learned_addr learned my addr 172.21.15.153:0/2376308552 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37ad5b6700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a814b6b0 0x7f37a8148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.660+0000 7f37ae5b8700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a80a93c0 0x7f37a80ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:39.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37addb7700 1 -- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a814b6b0 msgr2=0x7f37a8148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37addb7700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a814b6b0 0x7f37a8148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37addb7700 1 -- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a80a93c0 msgr2=0x7f37a80ab640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:39.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37addb7700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a80a93c0 0x7f37a80ab640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:39.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37addb7700 1 -- 172.21.15.153:0/2376308552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980092a0 con 0x7f37a8064df0 2023-08-17T00:06:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37addb7700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 0x7f37a81628d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f37a400c4c0 tx=0x7f37a4007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40070d0 con 0x7f37a8064df0 2023-08-17T00:06:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a4007230 con 0x7f37a8064df0 2023-08-17T00:06:39.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a40075b0 con 0x7f37a8064df0 2023-08-17T00:06:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a80a9bf0 con 0x7f37a8064df0 2023-08-17T00:06:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a80aa1b0 con 0x7f37a8064df0 2023-08-17T00:06:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.664+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37a8046dd0 con 0x7f37a8064df0 2023-08-17T00:06:39.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.668+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f37a4010070 con 0x7f37a8064df0 2023-08-17T00:06:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.668+0000 7f379dffb700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378c05a150 0x7f378c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.668+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f37a4073860 con 0x7f37a8064df0 2023-08-17T00:06:39.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.672+0000 7f37ad5b6700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378c05a150 0x7f378c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:39.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.672+0000 7f37ad5b6700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378c05a150 0x7f378c05c610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f37a80c4150 tx=0x7f3798015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:39.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.676+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37a4047190 con 0x7f37a8064df0 2023-08-17T00:06:39.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:39.836+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f37a80bb440 con 0x7f37a8064df0 2023-08-17T00:06:40.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.136+0000 7f379dffb700 1 -- 172.21.15.153:0/2376308552 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7f37a404a7b0 con 0x7f37a8064df0 2023-08-17T00:06:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378c05a150 msgr2=0x7f378c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378c05a150 0x7f378c05c610 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f37a80c4150 tx=0x7f3798015000).stop 2023-08-17T00:06:40.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 msgr2=0x7f37a81628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 0x7f37a81628d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f37a400c4c0 tx=0x7f37a4007c10).stop 2023-08-17T00:06:40.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 shutdown_connections 2023-08-17T00:06:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f378c05a150 0x7f378c05c610 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37a80a93c0 0x7f37a80ab640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37a814b6b0 0x7f37a8148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 --2- 172.21.15.153:0/2376308552 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37a8064df0 0x7f37a81628d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.152+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 >> 172.21.15.153:0/2376308552 conn(0x7f37a80c6ee0 msgr2=0x7f37a814f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.168+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 shutdown_connections 2023-08-17T00:06:40.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.168+0000 7f37aedb9700 1 -- 172.21.15.153:0/2376308552 wait complete. 2023-08-17T00:06:40.178 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:06:40.198 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:06:40.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.348+0000 7f5dfed07700 1 Processor -- start 2023-08-17T00:06:40.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.348+0000 7f5dfed07700 1 -- start start 2023-08-17T00:06:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.348+0000 7f5dfed07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df8153d90 0x7f5df80a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:40.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.348+0000 7f5dfed07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80c00d0 con 0x7f5df80cb450 2023-08-17T00:06:40.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.348+0000 7f5dfed07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df80bf810 con 0x7f5df81539b0 2023-08-17T00:06:40.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.348+0000 7f5dfed07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df80639c0 con 0x7f5df8153d90 2023-08-17T00:06:40.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfdd05700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f5df81539b0 0x7f5df80632b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:32912/0 (socket says 172.21.15.153:32912) 2023-08-17T00:06:40.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfd504700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df8153d90 0x7f5df80a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfdd05700 1 -- 172.21.15.153:0/246150855 learned_addr learned my addr 172.21.15.153:0/246150855 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfe506700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5df80cb450 0x7f5df80c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41260/0 (socket says 172.21.15.153:41260) 2023-08-17T00:06:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfd504700 1 -- 172.21.15.153:0/246150855 >> v1:172.21.15.178:6789/0 conn(0x7f5df81539b0 legacy=0x7f5df80632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfd504700 1 -- 172.21.15.153:0/246150855 >> v1:172.21.15.153:6789/0 conn(0x7f5df80cb450 legacy=0x7f5df80c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfd504700 1 -- 172.21.15.153:0/246150855 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df80aa910 con 0x7f5df8153d90 2023-08-17T00:06:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfcd03700 1 -- 172.21.15.153:0/246150855 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028043546 0 0) 0x7f5df80c00d0 con 0x7f5df80cb450 2023-08-17T00:06:40.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfd504700 1 --2- 172.21.15.153:0/246150855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df8153d90 0x7f5df80a97a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5de8009790 tx=0x7f5de8009060).ready entity=mon.2 client_cookie=d224ffd0ad9d0bd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfcd03700 1 -- 172.21.15.153:0/246150855 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800b5a0 con 0x7f5df8153d90 2023-08-17T00:06:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfcd03700 1 -- 172.21.15.153:0/246150855 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800b700 con 0x7f5df8153d90 2023-08-17T00:06:40.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfcd03700 1 -- 172.21.15.153:0/246150855 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800ba80 con 0x7f5df8153d90 2023-08-17T00:06:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 -- 172.21.15.153:0/246150855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df8153d90 msgr2=0x7f5df80a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 --2- 172.21.15.153:0/246150855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df8153d90 0x7f5df80a97a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f5de8009790 tx=0x7f5de8009060).stop 2023-08-17T00:06:40.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 -- 172.21.15.153:0/246150855 shutdown_connections 2023-08-17T00:06:40.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 --2- 172.21.15.153:0/246150855 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df8153d90 0x7f5df80a97a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 -- 172.21.15.153:0/246150855 >> 172.21.15.153:0/246150855 conn(0x7f5df8062a10 msgr2=0x7f5df80ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:40.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 -- 172.21.15.153:0/246150855 shutdown_connections 2023-08-17T00:06:40.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.352+0000 7f5dfed07700 1 -- 172.21.15.153:0/246150855 wait complete. 2023-08-17T00:06:40.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.356+0000 7f5dfed07700 1 Processor -- start 2023-08-17T00:06:40.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.356+0000 7f5dfed07700 1 -- start start 2023-08-17T00:06:40.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df80cb450 0x7f5df8146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 0x7f5df81455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df8153d90 0x7f5df8167c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df81485f0 con 0x7f5df81539b0 2023-08-17T00:06:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8145ab0 con 0x7f5df8153d90 2023-08-17T00:06:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df8145d50 con 0x7f5df80cb450 2023-08-17T00:06:40.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 0x7f5df81455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:40.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 0x7f5df81455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58726/0 (socket says 172.21.15.153:58726) 2023-08-17T00:06:40.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 -- 172.21.15.153:0/881012463 learned_addr learned my addr 172.21.15.153:0/881012463 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:40.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfdd05700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df80cb450 0x7f5df8146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:40.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfe506700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df8153d90 0x7f5df8167c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:40.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 -- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df80cb450 msgr2=0x7f5df8146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df80cb450 0x7f5df8146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 -- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df8153d90 msgr2=0x7f5df8167c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:40.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df8153d90 0x7f5df8167c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:40.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 -- 172.21.15.153:0/881012463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80092a0 con 0x7f5df81539b0 2023-08-17T00:06:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfd504700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 0x7f5df81455c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f5df8083490 tx=0x7f5de8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de800b870 con 0x7f5df81539b0 2023-08-17T00:06:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de800b9d0 con 0x7f5df81539b0 2023-08-17T00:06:40.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de801b660 con 0x7f5df81539b0 2023-08-17T00:06:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df8146030 con 0x7f5df81539b0 2023-08-17T00:06:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.360+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df8157a40 con 0x7f5df81539b0 2023-08-17T00:06:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.364+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df81483a0 con 0x7f5df81539b0 2023-08-17T00:06:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.364+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5de802b070 con 0x7f5df81539b0 2023-08-17T00:06:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.368+0000 7f5dedffb700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ddc05a150 0x7f5ddc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.368+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5827+0+0 (secure 0 0 0) 0x7f5de8075790 con 0x7f5df81539b0 2023-08-17T00:06:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.368+0000 7f5dfdd05700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ddc05a150 0x7f5ddc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.368+0000 7f5dfdd05700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ddc05a150 0x7f5ddc05c610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f5df40077a0 tx=0x7f5df4007cd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.372+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5de8049250 con 0x7f5df81539b0 2023-08-17T00:06:40.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:40.540+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5df8148730 con 0x7f5df81539b0 2023-08-17T00:06:41.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.416+0000 7f5dedffb700 1 -- 172.21.15.153:0/881012463 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5de80290d0 con 0x7f5df81539b0 2023-08-17T00:06:41.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ddc05a150 msgr2=0x7f5ddc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ddc05a150 0x7f5ddc05c610 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f5df40077a0 tx=0x7f5df4007cd0).stop 2023-08-17T00:06:41.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 msgr2=0x7f5df81455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 0x7f5df81455c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f5df8083490 tx=0x7f5de8015000).stop 2023-08-17T00:06:41.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 shutdown_connections 2023-08-17T00:06:41.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ddc05a150 0x7f5ddc05c610 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df8153d90 0x7f5df8167c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5df81539b0 0x7f5df81455c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 --2- 172.21.15.153:0/881012463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df80cb450 0x7f5df8146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 >> 172.21.15.153:0/881012463 conn(0x7f5df8062a10 msgr2=0x7f5df80b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:41.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 shutdown_connections 2023-08-17T00:06:41.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.424+0000 7f5dfed07700 1 -- 172.21.15.153:0/881012463 wait complete. 2023-08-17T00:06:41.432 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:06:41.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:06:41.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.608+0000 7f3b56639700 1 Processor -- start 2023-08-17T00:06:41.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.608+0000 7f3b56639700 1 -- start start 2023-08-17T00:06:41.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b56639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b50068c80 0x7f3b500a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:41.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b56639700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b501585a0 con 0x7f3b50068820 2023-08-17T00:06:41.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b56639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b50066400 con 0x7f3b500a8df0 2023-08-17T00:06:41.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b56639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500c1ba0 con 0x7f3b50068c80 2023-08-17T00:06:41.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b54e36700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3b50068820 0x7f3b500a96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41276/0 (socket says 172.21.15.153:41276) 2023-08-17T00:06:41.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b54e36700 1 -- 172.21.15.153:0/2401047837 learned_addr learned my addr 172.21.15.153:0/2401047837 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:41.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b55e38700 1 --2- 172.21.15.153:0/2401047837 >> v2:172.21.15.153:3300/0 conn(0x7f3b50068c80 0x7f3b500a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b47fff700 1 -- 172.21.15.153:0/2401047837 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634350806 0 0) 0x7f3b501585a0 con 0x7f3b50068820 2023-08-17T00:06:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b47fff700 1 -- 172.21.15.153:0/2401047837 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b3c0033f0 con 0x7f3b50068820 2023-08-17T00:06:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b55e38700 1 -- 172.21.15.153:0/2401047837 >> v1:172.21.15.178:6789/0 conn(0x7f3b500a8df0 legacy=0x7f3b500c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b55e38700 1 -- 172.21.15.153:0/2401047837 >> v1:172.21.15.153:6789/0 conn(0x7f3b50068820 legacy=0x7f3b500a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.612+0000 7f3b55e38700 1 -- 172.21.15.153:0/2401047837 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500b9d30 con 0x7f3b50068c80 2023-08-17T00:06:41.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b55e38700 1 --2- 172.21.15.153:0/2401047837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068c80 0x7f3b500a9de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f3b48009e60 tx=0x7f3b48009780).ready entity=mon.0 client_cookie=9548bb045ebbc179 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:41.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b47fff700 1 -- 172.21.15.153:0/2401047837 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800e070 con 0x7f3b50068c80 2023-08-17T00:06:41.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b47fff700 1 -- 172.21.15.153:0/2401047837 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800bb60 con 0x7f3b50068c80 2023-08-17T00:06:41.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b47fff700 1 -- 172.21.15.153:0/2401047837 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b48012410 con 0x7f3b50068c80 2023-08-17T00:06:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 -- 172.21.15.153:0/2401047837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068c80 msgr2=0x7f3b500a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 --2- 172.21.15.153:0/2401047837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068c80 0x7f3b500a9de0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f3b48009e60 tx=0x7f3b48009780).stop 2023-08-17T00:06:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 -- 172.21.15.153:0/2401047837 shutdown_connections 2023-08-17T00:06:41.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 --2- 172.21.15.153:0/2401047837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068c80 0x7f3b500a9de0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 -- 172.21.15.153:0/2401047837 >> 172.21.15.153:0/2401047837 conn(0x7f3b500c6620 msgr2=0x7f3b500c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 -- 172.21.15.153:0/2401047837 shutdown_connections 2023-08-17T00:06:41.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.616+0000 7f3b56639700 1 -- 172.21.15.153:0/2401047837 wait complete. 2023-08-17T00:06:41.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.620+0000 7f3b56639700 1 Processor -- start 2023-08-17T00:06:41.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.620+0000 7f3b56639700 1 -- start start 2023-08-17T00:06:41.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.620+0000 7f3b56639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 0x7f3b500bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:41.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b50068c80 0x7f3b501682d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:41.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b500a8df0 0x7f3b501687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50168cb0 con 0x7f3b50068820 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50159a50 con 0x7f3b500a8df0 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50168f20 con 0x7f3b50068c80 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 0x7f3b500bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 0x7f3b500bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58748/0 (socket says 172.21.15.153:58748) 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 -- 172.21.15.153:0/1988611522 learned_addr learned my addr 172.21.15.153:0/1988611522 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:41.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b54e36700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b50068c80 0x7f3b501682d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:41.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55e38700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b500a8df0 0x7f3b501687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:41.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 -- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b50068c80 msgr2=0x7f3b501682d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b50068c80 0x7f3b501682d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 -- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b500a8df0 msgr2=0x7f3b501687c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b500a8df0 0x7f3b501687c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 -- 172.21.15.153:0/1988611522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009a20 con 0x7f3b50068820 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b54e36700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b50068c80 0x7f3b501682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55e38700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b500a8df0 0x7f3b501687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b55637700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 0x7f3b500bcc70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f3b4c00c4c0 tx=0x7f3b4c007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c007020 con 0x7f3b50068820 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4c007180 con 0x7f3b50068820 2023-08-17T00:06:41.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50159cf0 con 0x7f3b50068820 2023-08-17T00:06:41.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c007520 con 0x7f3b50068820 2023-08-17T00:06:41.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b50169200 con 0x7f3b50068820 2023-08-17T00:06:41.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.624+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5006b4c0 con 0x7f3b50068820 2023-08-17T00:06:41.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.628+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3b4c010070 con 0x7f3b50068820 2023-08-17T00:06:41.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.628+0000 7f3b457fa700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b3405a150 0x7f3b3405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:41.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.628+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3b4c073870 con 0x7f3b50068820 2023-08-17T00:06:41.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.628+0000 7f3b54e36700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b3405a150 0x7f3b3405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:41.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.632+0000 7f3b54e36700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b3405a150 0x7f3b3405c610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3b40007fd0 tx=0x7f3b40009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.636+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b4c047510 con 0x7f3b50068820 2023-08-17T00:06:41.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.796+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3b5005e300 con 0x7f3b50068820 2023-08-17T00:06:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.804+0000 7f3b457fa700 1 -- 172.21.15.153:0/1988611522 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b4c04ab30 con 0x7f3b50068820 2023-08-17T00:06:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b3405a150 msgr2=0x7f3b3405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b3405a150 0x7f3b3405c610 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f3b40007fd0 tx=0x7f3b40009040).stop 2023-08-17T00:06:41.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 msgr2=0x7f3b500bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 0x7f3b500bcc70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f3b4c00c4c0 tx=0x7f3b4c007df0).stop 2023-08-17T00:06:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 shutdown_connections 2023-08-17T00:06:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b3405a150 0x7f3b3405c610 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b500a8df0 0x7f3b501687c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b50068c80 0x7f3b501682d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 --2- 172.21.15.153:0/1988611522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b50068820 0x7f3b500bcc70 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 >> 172.21.15.153:0/1988611522 conn(0x7f3b500c6620 msgr2=0x7f3b500ab140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 shutdown_connections 2023-08-17T00:06:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.808+0000 7f3b56639700 1 -- 172.21.15.153:0/1988611522 wait complete. 2023-08-17T00:06:41.838 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2023-08-17T00:06:42.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.996+0000 7f504161b700 1 Processor -- start 2023-08-17T00:06:42.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:41.996+0000 7f504161b700 1 -- start start 2023-08-17T00:06:42.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f504161b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c0cb240 0x7f503c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f504161b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f503c062490 0x7f503c0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f504161b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503c0c11d0 con 0x7f503c153aa0 2023-08-17T00:06:42.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f504161b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503c0c5e80 con 0x7f503c062490 2023-08-17T00:06:42.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f504161b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0628f0 con 0x7f503c0cb240 2023-08-17T00:06:42.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f503c062490 0x7f503c0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f503c062490 0x7f503c0aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40022/0 (socket says 172.21.15.153:40022) 2023-08-17T00:06:42.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503a7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c0cb240 0x7f503c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 -- 172.21.15.153:0/4274592346 learned_addr learned my addr 172.21.15.153:0/4274592346 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 -- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c0cb240 msgr2=0x7f503c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 --2- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c0cb240 0x7f503c061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 -- 172.21.15.153:0/4274592346 >> v1:172.21.15.178:6789/0 conn(0x7f503c153aa0 legacy=0x7f503c0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 -- 172.21.15.153:0/4274592346 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503c0c1660 con 0x7f503c062490 2023-08-17T00:06:42.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f503b7fe700 1 --2- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c062490 0x7f503c0aa900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5034009f20 tx=0x7f5034009840).ready entity=mon.1 client_cookie=78a3c686adf3918 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:42.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f5039ffb700 1 -- 172.21.15.153:0/4274592346 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400e070 con 0x7f503c062490 2023-08-17T00:06:42.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f5039ffb700 1 -- 172.21.15.153:0/4274592346 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400b9d0 con 0x7f503c062490 2023-08-17T00:06:42.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.000+0000 7f5039ffb700 1 -- 172.21.15.153:0/4274592346 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400bd50 con 0x7f503c062490 2023-08-17T00:06:42.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 -- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c062490 msgr2=0x7f503c0aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 --2- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c062490 0x7f503c0aa900 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f5034009f20 tx=0x7f5034009840).stop 2023-08-17T00:06:42.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 -- 172.21.15.153:0/4274592346 shutdown_connections 2023-08-17T00:06:42.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 --2- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c062490 0x7f503c0aa900 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 --2- 172.21.15.153:0/4274592346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c0cb240 0x7f503c061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 -- 172.21.15.153:0/4274592346 >> 172.21.15.153:0/4274592346 conn(0x7f503c0640b0 msgr2=0x7f503c0ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:42.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 -- 172.21.15.153:0/4274592346 shutdown_connections 2023-08-17T00:06:42.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 -- 172.21.15.153:0/4274592346 wait complete. 2023-08-17T00:06:42.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 Processor -- start 2023-08-17T00:06:42.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.004+0000 7f504161b700 1 -- start start 2023-08-17T00:06:42.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 0x7f503c066550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c0cb240 0x7f503c068e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c153aa0 0x7f503c0c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c0689b0 con 0x7f503c062490 2023-08-17T00:06:42.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503c068080 con 0x7f503c0cb240 2023-08-17T00:06:42.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f503c068360 con 0x7f503c153aa0 2023-08-17T00:06:42.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 0x7f503c066550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 0x7f503c066550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58764/0 (socket says 172.21.15.153:58764) 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 -- 172.21.15.153:0/1636528137 learned_addr learned my addr 172.21.15.153:0/1636528137 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503a7fc700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c0cb240 0x7f503c068e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503b7fe700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c153aa0 0x7f503c0c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 -- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c153aa0 msgr2=0x7f503c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c153aa0 0x7f503c0c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 -- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c0cb240 msgr2=0x7f503c068e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c0cb240 0x7f503c068e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 -- 172.21.15.153:0/1636528137 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034009ae0 con 0x7f503c062490 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f503affd700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 0x7f503c066550 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f502c00c4c0 tx=0x7f502c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c00ce70 con 0x7f503c062490 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f502c001e90 con 0x7f503c062490 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503c068640 con 0x7f503c062490 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502c007270 con 0x7f503c062490 2023-08-17T00:06:42.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.008+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c067d30 con 0x7f503c062490 2023-08-17T00:06:42.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.012+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f503c06b4c0 con 0x7f503c062490 2023-08-17T00:06:42.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.012+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f502c010070 con 0x7f503c062490 2023-08-17T00:06:42.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.012+0000 7f5032ffd700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f501c05a150 0x7f501c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.016+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f502c073440 con 0x7f503c062490 2023-08-17T00:06:42.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.016+0000 7f503a7fc700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f501c05a150 0x7f501c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.016+0000 7f503a7fc700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f501c05a150 0x7f501c05c610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f503c067930 tx=0x7f5024009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.020+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f502c0471f0 con 0x7f503c062490 2023-08-17T00:06:42.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.232+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f503c06a210 con 0x7f503c062490 2023-08-17T00:06:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.420+0000 7f5032ffd700 1 -- 172.21.15.153:0/1636528137 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v201) v1 ==== 143+0+0 (secure 0 0 0) 0x7f502c04a810 con 0x7f503c062490 2023-08-17T00:06:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f501c05a150 msgr2=0x7f501c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f501c05a150 0x7f501c05c610 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f503c067930 tx=0x7f5024009060).stop 2023-08-17T00:06:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 msgr2=0x7f503c066550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 0x7f503c066550 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f502c00c4c0 tx=0x7f502c007e00).stop 2023-08-17T00:06:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 shutdown_connections 2023-08-17T00:06:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f501c05a150 0x7f501c05c610 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f503c153aa0 0x7f503c0c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f503c0cb240 0x7f503c068e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 --2- 172.21.15.153:0/1636528137 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f503c062490 0x7f503c066550 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 >> 172.21.15.153:0/1636528137 conn(0x7f503c0640b0 msgr2=0x7f503c151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:42.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 shutdown_connections 2023-08-17T00:06:42.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.428+0000 7f504161b700 1 -- 172.21.15.153:0/1636528137 wait complete. 2023-08-17T00:06:42.455 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2023-08-17T00:06:42.456 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-08-17T00:06:42.456 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2023-08-17T00:06:42.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.608+0000 7f6b59a39700 1 Processor -- start 2023-08-17T00:06:42.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.608+0000 7f6b59a39700 1 -- start start 2023-08-17T00:06:42.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.608+0000 7f6b59a39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b540a8df0 0x7f6b540c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.608+0000 7f6b59a39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b541585a0 con 0x7f6b54068820 2023-08-17T00:06:42.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.608+0000 7f6b59a39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b54066400 con 0x7f6b540aa6e0 2023-08-17T00:06:42.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.608+0000 7f6b59a39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b54062dc0 con 0x7f6b540a8df0 2023-08-17T00:06:42.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b53fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6b54068820 0x7f6b54061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41278/0 (socket says 172.21.15.153:41278) 2023-08-17T00:06:42.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b53fff700 1 -- 172.21.15.153:0/3891315233 learned_addr learned my addr 172.21.15.153:0/3891315233 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:42.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b58a37700 1 --2- 172.21.15.153:0/3891315233 >> v2:172.21.15.178:3300/0 conn(0x7f6b540a8df0 0x7f6b540c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b537fe700 1 -- 172.21.15.153:0/3891315233 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577465023 0 0) 0x7f6b541585a0 con 0x7f6b54068820 2023-08-17T00:06:42.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b537fe700 1 -- 172.21.15.153:0/3891315233 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b440033f0 con 0x7f6b54068820 2023-08-17T00:06:42.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b537fe700 1 -- 172.21.15.153:0/3891315233 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2431055728 0 0) 0x7f6b440033f0 con 0x7f6b54068820 2023-08-17T00:06:42.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b58a37700 1 -- 172.21.15.153:0/3891315233 >> v1:172.21.15.178:6789/0 conn(0x7f6b540aa6e0 legacy=0x7f6b540626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b58a37700 1 -- 172.21.15.153:0/3891315233 >> v1:172.21.15.153:6789/0 conn(0x7f6b54068820 legacy=0x7f6b54061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b58a37700 1 -- 172.21.15.153:0/3891315233 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b540b9d30 con 0x7f6b540a8df0 2023-08-17T00:06:42.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b58a37700 1 --2- 172.21.15.153:0/3891315233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540a8df0 0x7f6b540c1490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f6b48006fd0 tx=0x7f6b48006f40).ready entity=mon.1 client_cookie=69ef5f8f1d19813e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:42.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b537fe700 1 -- 172.21.15.153:0/3891315233 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40001470 con 0x7f6b540a8df0 2023-08-17T00:06:42.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b537fe700 1 -- 172.21.15.153:0/3891315233 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48005880 con 0x7f6b540a8df0 2023-08-17T00:06:42.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b537fe700 1 -- 172.21.15.153:0/3891315233 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48005c00 con 0x7f6b540a8df0 2023-08-17T00:06:42.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b59a39700 1 -- 172.21.15.153:0/3891315233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540a8df0 msgr2=0x7f6b540c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b59a39700 1 --2- 172.21.15.153:0/3891315233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540a8df0 0x7f6b540c1490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f6b48006fd0 tx=0x7f6b48006f40).stop 2023-08-17T00:06:42.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b59a39700 1 -- 172.21.15.153:0/3891315233 shutdown_connections 2023-08-17T00:06:42.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b59a39700 1 --2- 172.21.15.153:0/3891315233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540a8df0 0x7f6b540c1490 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.612+0000 7f6b59a39700 1 -- 172.21.15.153:0/3891315233 >> 172.21.15.153:0/3891315233 conn(0x7f6b540c6620 msgr2=0x7f6b540c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:42.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.616+0000 7f6b59a39700 1 -- 172.21.15.153:0/3891315233 shutdown_connections 2023-08-17T00:06:42.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.616+0000 7f6b59a39700 1 -- 172.21.15.153:0/3891315233 wait complete. 2023-08-17T00:06:42.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.616+0000 7f6b59a39700 1 Processor -- start 2023-08-17T00:06:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.616+0000 7f6b59a39700 1 -- start start 2023-08-17T00:06:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 0x7f6b540b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b540a8df0 0x7f6b5416be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540aa6e0 0x7f6b54159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540bcae0 con 0x7f6b54068820 2023-08-17T00:06:42.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540ba4a0 con 0x7f6b540aa6e0 2023-08-17T00:06:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b540bc4a0 con 0x7f6b540a8df0 2023-08-17T00:06:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 0x7f6b540b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 0x7f6b540b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58780/0 (socket says 172.21.15.153:58780) 2023-08-17T00:06:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 -- 172.21.15.153:0/175550896 learned_addr learned my addr 172.21.15.153:0/175550896 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:42.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b53fff700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b540a8df0 0x7f6b5416be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59238700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540aa6e0 0x7f6b54159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 -- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b540a8df0 msgr2=0x7f6b5416be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b540a8df0 0x7f6b5416be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 -- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540aa6e0 msgr2=0x7f6b54159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540aa6e0 0x7f6b54159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 -- 172.21.15.153:0/175550896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b48009250 con 0x7f6b54068820 2023-08-17T00:06:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59238700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540aa6e0 0x7f6b54159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:42.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b58a37700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 0x7f6b540b9fb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f6b48009dd0 tx=0x7f6b48015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:42.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48011600 con 0x7f6b54068820 2023-08-17T00:06:42.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48011760 con 0x7f6b54068820 2023-08-17T00:06:42.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48011b20 con 0x7f6b54068820 2023-08-17T00:06:42.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b540bf800 con 0x7f6b54068820 2023-08-17T00:06:42.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.620+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b540bfdc0 con 0x7f6b54068820 2023-08-17T00:06:42.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.624+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5406b4c0 con 0x7f6b54068820 2023-08-17T00:06:42.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.624+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6b48025030 con 0x7f6b54068820 2023-08-17T00:06:42.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.624+0000 7f6b50ff9700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b3805a180 0x7f6b3805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:42.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.624+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f6b48075080 con 0x7f6b54068820 2023-08-17T00:06:42.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.624+0000 7f6b53fff700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b3805a180 0x7f6b3805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:42.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.628+0000 7f6b53fff700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b3805a180 0x7f6b3805c640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6b540c0e50 tx=0x7f6b40000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:42.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.628+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b480a38f0 con 0x7f6b54068820 2023-08-17T00:06:42.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:42.852+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f6b540c1200 con 0x7f6b54068820 2023-08-17T00:06:43.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.432+0000 7f6b50ff9700 1 -- 172.21.15.153:0/175550896 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v202) v1 ==== 146+0+0 (secure 0 0 0) 0x7f6b48023020 con 0x7f6b54068820 2023-08-17T00:06:43.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b3805a180 msgr2=0x7f6b3805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b3805a180 0x7f6b3805c640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f6b540c0e50 tx=0x7f6b40000bc0).stop 2023-08-17T00:06:43.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 msgr2=0x7f6b540b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 0x7f6b540b9fb0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f6b48009dd0 tx=0x7f6b48015000).stop 2023-08-17T00:06:43.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 shutdown_connections 2023-08-17T00:06:43.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b3805a180 0x7f6b3805c640 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b540aa6e0 0x7f6b54159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b540a8df0 0x7f6b5416be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 --2- 172.21.15.153:0/175550896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b54068820 0x7f6b540b9fb0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 >> 172.21.15.153:0/175550896 conn(0x7f6b540c6620 msgr2=0x7f6b540c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:43.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 shutdown_connections 2023-08-17T00:06:43.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.436+0000 7f6b59a39700 1 -- 172.21.15.153:0/175550896 wait complete. 2023-08-17T00:06:43.464 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:06:43.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.628+0000 7f18db547700 1 Processor -- start 2023-08-17T00:06:43.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.628+0000 7f18db547700 1 -- start start 2023-08-17T00:06:43.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.632+0000 7f18db547700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18d40a8df0 0x7f18d40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:43.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.632+0000 7f18db547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:43.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.632+0000 7f18db547700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d41585a0 con 0x7f18d4068820 2023-08-17T00:06:43.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.632+0000 7f18db547700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d4066400 con 0x7f18d40a8df0 2023-08-17T00:06:43.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.632+0000 7f18db547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4069170 con 0x7f18d40aa6e0 2023-08-17T00:06:43.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18d40a8df0 0x7f18d40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:43.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18d9d44700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f18d4068820 0x7f18d4061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41292/0 (socket says 172.21.15.153:41292) 2023-08-17T00:06:43.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f18d40a8df0 0x7f18d40c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58794/0 (socket says 172.21.15.153:58794) 2023-08-17T00:06:43.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18d9d44700 1 -- 172.21.15.153:0/1188250101 learned_addr learned my addr 172.21.15.153:0/1188250101 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:43.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18dad46700 1 --2- 172.21.15.153:0/1188250101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:43.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 -- 172.21.15.153:0/1188250101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 msgr2=0x7f18d4068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:43.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 --2- 172.21.15.153:0/1188250101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d4068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 -- 172.21.15.153:0/1188250101 >> v1:172.21.15.153:6789/0 conn(0x7f18d4068820 legacy=0x7f18d4061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 -- 172.21.15.153:0/1188250101 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40b9d30 con 0x7f18d40a8df0 2023-08-17T00:06:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18da545700 1 --2- 172.21.15.153:0/1188250101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40c1490 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f18d0006fd0 tx=0x7f18d0006f40).ready entity=mon.0 client_cookie=30453ccae220287e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18d9543700 1 -- 172.21.15.153:0/1188250101 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0005880 con 0x7f18d40a8df0 2023-08-17T00:06:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18d9543700 1 -- 172.21.15.153:0/1188250101 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d00059e0 con 0x7f18d40a8df0 2023-08-17T00:06:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18d9543700 1 -- 172.21.15.153:0/1188250101 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0005d60 con 0x7f18d40a8df0 2023-08-17T00:06:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 -- 172.21.15.153:0/1188250101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 msgr2=0x7f18d40c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 --2- 172.21.15.153:0/1188250101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40c1490 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f18d0006fd0 tx=0x7f18d0006f40).stop 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 -- 172.21.15.153:0/1188250101 shutdown_connections 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 --2- 172.21.15.153:0/1188250101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d4068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 --2- 172.21.15.153:0/1188250101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40c1490 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 -- 172.21.15.153:0/1188250101 >> 172.21.15.153:0/1188250101 conn(0x7f18d40c6620 msgr2=0x7f18d40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 -- 172.21.15.153:0/1188250101 shutdown_connections 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.636+0000 7f18db547700 1 -- 172.21.15.153:0/1188250101 wait complete. 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 Processor -- start 2023-08-17T00:06:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 -- start start 2023-08-17T00:06:43.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18d4068820 0x7f18d4169570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d40bfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4157600 con 0x7f18d40a8df0 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40bd000 con 0x7f18d4068820 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18db547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4168a90 con 0x7f18d40aa6e0 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18d9d44700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:43.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18d9d44700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58808/0 (socket says 172.21.15.153:58808) 2023-08-17T00:06:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18d9d44700 1 -- 172.21.15.153:0/1843255125 learned_addr learned my addr 172.21.15.153:0/1843255125 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18dad46700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d40bfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.640+0000 7f18da545700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18d4068820 0x7f18d4169570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18d9d44700 1 -- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 msgr2=0x7f18d40bfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18d9d44700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d40bfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18d9d44700 1 -- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18d4068820 msgr2=0x7f18d4169570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18d9d44700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18d4068820 0x7f18d4169570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18d9d44700 1 -- 172.21.15.153:0/1843255125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009250 con 0x7f18d40a8df0 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18dad46700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d40bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18d9d44700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40b9fb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f18c4001eb0 tx=0x7f18c4007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40072e0 con 0x7f18d40a8df0 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4007440 con 0x7f18d40a8df0 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d4168d70 con 0x7f18d40a8df0 2023-08-17T00:06:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40057a0 con 0x7f18d40a8df0 2023-08-17T00:06:43.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d40bd2e0 con 0x7f18d40a8df0 2023-08-17T00:06:43.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d406b4c0 con 0x7f18d40a8df0 2023-08-17T00:06:43.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.644+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f18c4010070 con 0x7f18d40a8df0 2023-08-17T00:06:43.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.648+0000 7f18ca7fc700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18b805a150 0x7f18b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:43.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.648+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f18c40735b0 con 0x7f18d40a8df0 2023-08-17T00:06:43.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.648+0000 7f18da545700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18b805a150 0x7f18b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:43.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.648+0000 7f18da545700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18b805a150 0x7f18b805c610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f18d0006f80 tx=0x7f18d0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:43.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.656+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18c4047250 con 0x7f18d40a8df0 2023-08-17T00:06:43.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.816+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f18d4064010 con 0x7f18d40a8df0 2023-08-17T00:06:43.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.824+0000 7f18ca7fc700 1 -- 172.21.15.153:0/1843255125 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18c404a870 con 0x7f18d40a8df0 2023-08-17T00:06:43.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18b805a150 msgr2=0x7f18b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18b805a150 0x7f18b805c610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f18d0006f80 tx=0x7f18d0016000).stop 2023-08-17T00:06:43.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 msgr2=0x7f18d40b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:43.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40b9fb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f18c4001eb0 tx=0x7f18c4007e50).stop 2023-08-17T00:06:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 shutdown_connections 2023-08-17T00:06:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18b805a150 0x7f18b805c610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18d40aa6e0 0x7f18d40bfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18d40a8df0 0x7f18d40b9fb0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 --2- 172.21.15.153:0/1843255125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18d4068820 0x7f18d4169570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.828+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 >> 172.21.15.153:0/1843255125 conn(0x7f18d40c6620 msgr2=0x7f18d40694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.832+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 shutdown_connections 2023-08-17T00:06:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:43.832+0000 7f18db547700 1 -- 172.21.15.153:0/1843255125 wait complete. 2023-08-17T00:06:43.856 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:06:43.857 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:06:43.898 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:06:43.940 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:06:43.941 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:06:43.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:44.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.088+0000 7ff6b909b700 1 Processor -- start 2023-08-17T00:06:44.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.088+0000 7ff6b909b700 1 -- start start 2023-08-17T00:06:44.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b909b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6b4153d50 0x7ff6b40632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b909b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4154130 0x7ff6b40629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b909b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6b40656d0 0x7ff6b40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b909b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4065240 con 0x7ff6b40656d0 2023-08-17T00:06:44.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b909b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b4062ea0 con 0x7ff6b4153d50 2023-08-17T00:06:44.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b909b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4063880 con 0x7ff6b4154130 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6b40656d0 0x7ff6b40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b2d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6b4153d50 0x7ff6b40632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6aa59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4154130 0x7ff6b40629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6b40656d0 0x7ff6b40bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58820/0 (socket says 172.21.15.153:58820) 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 -- 172.21.15.153:0/516002013 learned_addr learned my addr 172.21.15.153:0/516002013 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 -- 172.21.15.153:0/516002013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4154130 msgr2=0x7ff6b40629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:44.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 --2- 172.21.15.153:0/516002013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4154130 0x7ff6b40629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 -- 172.21.15.153:0/516002013 >> v2:172.21.15.178:3300/0 conn(0x7ff6b4153d50 msgr2=0x7ff6b40632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 --2- 172.21.15.153:0/516002013 >> v2:172.21.15.178:3300/0 conn(0x7ff6b4153d50 0x7ff6b40632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 -- 172.21.15.153:0/516002013 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4064910 con 0x7ff6b40656d0 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b359e700 1 --2- 172.21.15.153:0/516002013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b40bbdc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7ff6b4064280 tx=0x7ff6ac009840).ready entity=mon.0 client_cookie=ae84d7e2ece250d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b259c700 1 -- 172.21.15.153:0/516002013 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00e070 con 0x7ff6b40656d0 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b259c700 1 -- 172.21.15.153:0/516002013 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ac00b970 con 0x7ff6b40656d0 2023-08-17T00:06:44.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.092+0000 7ff6b259c700 1 -- 172.21.15.153:0/516002013 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00bcf0 con 0x7ff6b40656d0 2023-08-17T00:06:44.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 -- 172.21.15.153:0/516002013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 msgr2=0x7ff6b40bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 --2- 172.21.15.153:0/516002013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b40bbdc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7ff6b4064280 tx=0x7ff6ac009840).stop 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 -- 172.21.15.153:0/516002013 shutdown_connections 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 --2- 172.21.15.153:0/516002013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4154130 0x7ff6b40629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 --2- 172.21.15.153:0/516002013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b40bbdc0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 --2- 172.21.15.153:0/516002013 >> v2:172.21.15.178:3300/0 conn(0x7ff6b4153d50 0x7ff6b40632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 -- 172.21.15.153:0/516002013 >> 172.21.15.153:0/516002013 conn(0x7ff6b40c7150 msgr2=0x7ff6b40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 -- 172.21.15.153:0/516002013 shutdown_connections 2023-08-17T00:06:44.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.096+0000 7ff6b909b700 1 -- 172.21.15.153:0/516002013 wait complete. 2023-08-17T00:06:44.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 Processor -- start 2023-08-17T00:06:44.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 -- start start 2023-08-17T00:06:44.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b4165010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4153d50 0x7ff6b40a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b4154130 0x7ff6b40ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40a9b20 con 0x7ff6b40656d0 2023-08-17T00:06:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40aa6a0 con 0x7ff6b4154130 2023-08-17T00:06:44.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b909b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b40a9d70 con 0x7ff6b4153d50 2023-08-17T00:06:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b4165010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b4165010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58828/0 (socket says 172.21.15.153:58828) 2023-08-17T00:06:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 -- 172.21.15.153:0/3142373170 learned_addr learned my addr 172.21.15.153:0/3142373170 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6aa59c700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4153d50 0x7ff6b40a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b359e700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b4154130 0x7ff6b40ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 -- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4153d50 msgr2=0x7ff6b40a8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4153d50 0x7ff6b40a8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 -- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b4154130 msgr2=0x7ff6b40ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b4154130 0x7ff6b40ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 -- 172.21.15.153:0/3142373170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009ae0 con 0x7ff6b40656d0 2023-08-17T00:06:44.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.100+0000 7ff6b2d9d700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b4165010 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff6a400e930 tx=0x7ff6a4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4012600 con 0x7ff6b40656d0 2023-08-17T00:06:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a4012760 con 0x7ff6b40656d0 2023-08-17T00:06:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b40aa050 con 0x7ff6b40656d0 2023-08-17T00:06:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4012ae0 con 0x7ff6b40656d0 2023-08-17T00:06:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b40a8650 con 0x7ff6b40656d0 2023-08-17T00:06:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b406b530 con 0x7ff6b40656d0 2023-08-17T00:06:44.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.104+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff6a4022070 con 0x7ff6b40656d0 2023-08-17T00:06:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.108+0000 7ff6ab7fe700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff69405a150 0x7ff69405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.108+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff6a4073fe0 con 0x7ff6b40656d0 2023-08-17T00:06:44.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.108+0000 7ff6aa59c700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff69405a150 0x7ff69405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.108+0000 7ff6aa59c700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff69405a150 0x7ff69405c610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff6b40ab5a0 tx=0x7ff69c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.112+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff6a4047d10 con 0x7ff6b40656d0 2023-08-17T00:06:44.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:06:44.297 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:06:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.308+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6b4157540 con 0x7ff6b40656d0 2023-08-17T00:06:44.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.308+0000 7ff6ab7fe700 1 -- 172.21.15.153:0/3142373170 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3538 (secure 0 0 0) 0x7ff6a404b330 con 0x7ff6b40656d0 2023-08-17T00:06:44.313 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:44.313 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4949,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/1994708014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1994708014},{"type":"v1","addr":"172.21.15.178:6835","nonce":1994708014}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":4952,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3272599803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3272599803},{"type":"v1","addr":"172.21.15.178:6837","nonce":3272599803}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5424,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3249036230","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3249036230},{"type":"v1","addr":"172.21.15.153:6834","nonce":3249036230}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":6144,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/498493890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":498493890},{"type":"v1","addr":"172.21.15.153:6835","nonce":498493890}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-08-17T00:06:44.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff69405a150 msgr2=0x7ff69405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff69405a150 0x7ff69405c610 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7ff6b40ab5a0 tx=0x7ff69c009060).stop 2023-08-17T00:06:44.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 msgr2=0x7ff6b4165010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b4165010 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7ff6a400e930 tx=0x7ff6a4009060).stop 2023-08-17T00:06:44.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 shutdown_connections 2023-08-17T00:06:44.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff69405a150 0x7ff69405c610 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6b4154130 0x7ff6b40ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6b4153d50 0x7ff6b40a8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 --2- 172.21.15.153:0/3142373170 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6b40656d0 0x7ff6b4165010 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 >> 172.21.15.153:0/3142373170 conn(0x7ff6b40c7150 msgr2=0x7ff6b40c20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:44.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 shutdown_connections 2023-08-17T00:06:44.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.312+0000 7ff6b909b700 1 -- 172.21.15.153:0/3142373170 wait complete. 2023-08-17T00:06:44.318 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 43 2023-08-17T00:06:44.336 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:06:44.336 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:06:44.336 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:06:44.337 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:06:44.337 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:06:44.337 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:06:44.337 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:06:44.338 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:06:44.338 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:06:44.338 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:06:44.338 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:06:44.338 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:06:44.339 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:06:44.339 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:06:44.339 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:06:44.339 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:06:44.367 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:06:44.368 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:06:44.371 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:06:44.371 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:06:44.378 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:06:44.378 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:06:44.381 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:06:44.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:06:44.422 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:06:44.423 DEBUG:teuthology.parallel:result is None 2023-08-17T00:06:44.427 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:06:44.428 DEBUG:teuthology.parallel:result is None 2023-08-17T00:06:44.432 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:06:44.432 DEBUG:teuthology.parallel:result is None 2023-08-17T00:06:44.438 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:06:44.439 DEBUG:teuthology.parallel:result is None 2023-08-17T00:06:44.439 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:06:44.527 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:06:44.528 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:06:44.538 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:06:44.539 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:06:44.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.600+0000 7eff5965b700 1 Processor -- start 2023-08-17T00:06:44.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.600+0000 7eff5965b700 1 -- start start 2023-08-17T00:06:44.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff5965b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff54153ab0 0x7eff54153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff5965b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff540641f0 0x7eff54061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff5965b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff540c0330 con 0x7eff540c59e0 2023-08-17T00:06:44.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff5965b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540c0ed0 con 0x7eff540641f0 2023-08-17T00:06:44.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff5965b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540c5e40 con 0x7eff54153ab0 2023-08-17T00:06:44.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff527fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7eff540c59e0 0x7eff540c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41298/0 (socket says 172.21.15.153:41298) 2023-08-17T00:06:44.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff527fc700 1 -- 172.21.15.153:0/1084225107 learned_addr learned my addr 172.21.15.153:0/1084225107 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff537fe700 1 --2- 172.21.15.153:0/1084225107 >> v2:172.21.15.153:3300/0 conn(0x7eff540641f0 0x7eff54061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff52ffd700 1 --2- 172.21.15.153:0/1084225107 >> v2:172.21.15.178:3300/0 conn(0x7eff54153ab0 0x7eff54153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff51ffb700 1 -- 172.21.15.153:0/1084225107 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951169774 0 0) 0x7eff540c0330 con 0x7eff540c59e0 2023-08-17T00:06:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff51ffb700 1 -- 172.21.15.153:0/1084225107 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff3c0033f0 con 0x7eff540c59e0 2023-08-17T00:06:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff537fe700 1 -- 172.21.15.153:0/1084225107 >> v2:172.21.15.178:3300/0 conn(0x7eff54153ab0 msgr2=0x7eff54153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff537fe700 1 --2- 172.21.15.153:0/1084225107 >> v2:172.21.15.178:3300/0 conn(0x7eff54153ab0 0x7eff54153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff537fe700 1 -- 172.21.15.153:0/1084225107 >> v1:172.21.15.153:6789/0 conn(0x7eff540c59e0 legacy=0x7eff540c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff537fe700 1 -- 172.21.15.153:0/1084225107 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff54064660 con 0x7eff540641f0 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff537fe700 1 --2- 172.21.15.153:0/1084225107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540641f0 0x7eff54061fa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7eff5405eb60 tx=0x7eff4c009780).ready entity=mon.0 client_cookie=49552b19c7add3b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff51ffb700 1 -- 172.21.15.153:0/1084225107 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00e070 con 0x7eff540641f0 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff51ffb700 1 -- 172.21.15.153:0/1084225107 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c00bab0 con 0x7eff540641f0 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.604+0000 7eff51ffb700 1 -- 172.21.15.153:0/1084225107 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00be30 con 0x7eff540641f0 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 -- 172.21.15.153:0/1084225107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540641f0 msgr2=0x7eff54061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 --2- 172.21.15.153:0/1084225107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540641f0 0x7eff54061fa0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7eff5405eb60 tx=0x7eff4c009780).stop 2023-08-17T00:06:44.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 -- 172.21.15.153:0/1084225107 shutdown_connections 2023-08-17T00:06:44.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 --2- 172.21.15.153:0/1084225107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff540641f0 0x7eff54061fa0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 --2- 172.21.15.153:0/1084225107 >> v2:172.21.15.178:3300/0 conn(0x7eff54153ab0 0x7eff54153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 -- 172.21.15.153:0/1084225107 >> 172.21.15.153:0/1084225107 conn(0x7eff540caaa0 msgr2=0x7eff540caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:44.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 -- 172.21.15.153:0/1084225107 shutdown_connections 2023-08-17T00:06:44.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 -- 172.21.15.153:0/1084225107 wait complete. 2023-08-17T00:06:44.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 Processor -- start 2023-08-17T00:06:44.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.608+0000 7eff5965b700 1 -- start start 2023-08-17T00:06:44.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff540641f0 0x7eff541643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff540c59e0 0x7eff540afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 0x7eff540b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54152110 con 0x7eff54153ab0 2023-08-17T00:06:44.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b0590 con 0x7eff540c59e0 2023-08-17T00:06:44.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540aedd0 con 0x7eff540641f0 2023-08-17T00:06:44.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 0x7eff540b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 0x7eff540b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58882/0 (socket says 172.21.15.153:58882) 2023-08-17T00:06:44.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 -- 172.21.15.153:0/3127887981 learned_addr learned my addr 172.21.15.153:0/3127887981 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:44.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff52ffd700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff540641f0 0x7eff541643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff527fc700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff540c59e0 0x7eff540afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 -- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff540641f0 msgr2=0x7eff541643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff540641f0 0x7eff541643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 -- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff540c59e0 msgr2=0x7eff540afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff540c59e0 0x7eff540afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 -- 172.21.15.153:0/3127887981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff4c009a20 con 0x7eff54153ab0 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff527fc700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff540c59e0 0x7eff540afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:44.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff537fe700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 0x7eff540b00a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7eff4c00b610 tx=0x7eff540c1010).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:44.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00b640 con 0x7eff54153ab0 2023-08-17T00:06:44.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c01d630 con 0x7eff54153ab0 2023-08-17T00:06:44.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff540ae940 con 0x7eff54153ab0 2023-08-17T00:06:44.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c01d9b0 con 0x7eff54153ab0 2023-08-17T00:06:44.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.612+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540add30 con 0x7eff54153ab0 2023-08-17T00:06:44.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.616+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff540aead0 con 0x7eff54153ab0 2023-08-17T00:06:44.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.616+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7eff4c027460 con 0x7eff54153ab0 2023-08-17T00:06:44.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.620+0000 7eff3affd700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff4005a150 0x7eff4005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:44.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.620+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5355+0+0 (secure 0 0 0) 0x7eff4c076080 con 0x7eff54153ab0 2023-08-17T00:06:44.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.620+0000 7eff52ffd700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff4005a150 0x7eff4005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:44.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.620+0000 7eff52ffd700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff4005a150 0x7eff4005c610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7eff540b0c70 tx=0x7eff44009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:44.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.624+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff4c0a48f0 con 0x7eff54153ab0 2023-08-17T00:06:44.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:44.796+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7eff5406b530 con 0x7eff54153ab0 2023-08-17T00:06:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.572+0000 7eff3affd700 1 -- 172.21.15.153:0/3127887981 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7eff4c049d00 con 0x7eff54153ab0 2023-08-17T00:06:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff4005a150 msgr2=0x7eff4005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff4005a150 0x7eff4005c610 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7eff540b0c70 tx=0x7eff44009060).stop 2023-08-17T00:06:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 msgr2=0x7eff540b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 0x7eff540b00a0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7eff4c00b610 tx=0x7eff540c1010).stop 2023-08-17T00:06:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 shutdown_connections 2023-08-17T00:06:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff4005a150 0x7eff4005c610 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff54153ab0 0x7eff540b00a0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff540c59e0 0x7eff540afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 --2- 172.21.15.153:0/3127887981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff540641f0 0x7eff541643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 >> 172.21.15.153:0/3127887981 conn(0x7eff540caaa0 msgr2=0x7eff54063630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 shutdown_connections 2023-08-17T00:06:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.576+0000 7eff5965b700 1 -- 172.21.15.153:0/3127887981 wait complete. 2023-08-17T00:06:45.585 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:06:45.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:06:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.760+0000 7f0d06cdb700 1 Processor -- start 2023-08-17T00:06:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.760+0000 7f0d06cdb700 1 -- start start 2023-08-17T00:06:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d06cdb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d000bc4d0 0x7f0d000a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d06cdb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d00065240 con 0x7f0d000632e0 2023-08-17T00:06:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d06cdb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d000638a0 con 0x7f0d000a8b70 2023-08-17T00:06:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d06cdb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d00065de0 con 0x7f0d000bc4d0 2023-08-17T00:06:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0cfffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0d000632e0 0x7f0d000bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46508/0 (socket says 172.21.15.153:46508) 2023-08-17T00:06:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0cfffff700 1 -- 172.21.15.153:0/4274420794 learned_addr learned my addr 172.21.15.153:0/4274420794 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d05278700 1 --2- 172.21.15.153:0/4274420794 >> v2:172.21.15.178:3300/0 conn(0x7f0d000bc4d0 0x7f0d000a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490113310 0 0) 0x7f0d00065240 con 0x7f0d000632e0 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cf00033f0 con 0x7f0d000632e0 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555895898 0 0) 0x7f0d000638a0 con 0x7f0d000a8b70 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d00065240 con 0x7f0d000a8b70 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d05278700 1 -- 172.21.15.153:0/4274420794 >> v1:172.21.15.178:6789/0 conn(0x7f0d000a8b70 legacy=0x7f0d000656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d05278700 1 -- 172.21.15.153:0/4274420794 >> v1:172.21.15.153:6789/0 conn(0x7f0d000632e0 legacy=0x7f0d000bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.764+0000 7f0d05278700 1 -- 172.21.15.153:0/4274420794 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00064910 con 0x7f0d000bc4d0 2023-08-17T00:06:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d05278700 1 --2- 172.21.15.153:0/4274420794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d000a8f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0cf8009e60 tx=0x7f0cf8009780).ready entity=mon.1 client_cookie=fbf95edf71a59fb4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800e070 con 0x7f0d000bc4d0 2023-08-17T00:06:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800bab0 con 0x7f0d000bc4d0 2023-08-17T00:06:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0cff7fe700 1 -- 172.21.15.153:0/4274420794 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800be30 con 0x7f0d000bc4d0 2023-08-17T00:06:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4274420794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 msgr2=0x7f0d000a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4274420794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d000a8f50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f0cf8009e60 tx=0x7f0cf8009780).stop 2023-08-17T00:06:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4274420794 shutdown_connections 2023-08-17T00:06:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4274420794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d000a8f50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4274420794 >> 172.21.15.153:0/4274420794 conn(0x7f0d000c7150 msgr2=0x7f0d000c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4274420794 shutdown_connections 2023-08-17T00:06:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4274420794 wait complete. 2023-08-17T00:06:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.768+0000 7f0d06cdb700 1 Processor -- start 2023-08-17T00:06:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 -- start start 2023-08-17T00:06:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 0x7f0d000c01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000a8b70 0x7f0d001528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d00068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000bf7e0 con 0x7f0d000632e0 2023-08-17T00:06:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0016c420 con 0x7f0d000bc4d0 2023-08-17T00:06:45.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0016c8b0 con 0x7f0d000a8b70 2023-08-17T00:06:45.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 0x7f0d000c01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 0x7f0d000c01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33330/0 (socket says 172.21.15.153:33330) 2023-08-17T00:06:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d05278700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d00068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 -- 172.21.15.153:0/4205379640 learned_addr learned my addr 172.21.15.153:0/4205379640 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0cfffff700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000a8b70 0x7f0d001528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 -- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000a8b70 msgr2=0x7f0d001528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000a8b70 0x7f0d001528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 -- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 msgr2=0x7f0d00068790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d00068790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 -- 172.21.15.153:0/4205379640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009a20 con 0x7f0d000632e0 2023-08-17T00:06:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d05278700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d00068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d04a77700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 0x7f0d000c01f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f0cf400c4c0 tx=0x7f0cf4007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400ce30 con 0x7f0d000632e0 2023-08-17T00:06:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf400f470 con 0x7f0d000632e0 2023-08-17T00:06:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf400f810 con 0x7f0d000632e0 2023-08-17T00:06:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d0016baf0 con 0x7f0d000632e0 2023-08-17T00:06:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.772+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d0016c0b0 con 0x7f0d000632e0 2023-08-17T00:06:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.776+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d000bd210 con 0x7f0d000632e0 2023-08-17T00:06:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.776+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0cf4019030 con 0x7f0d000632e0 2023-08-17T00:06:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.780+0000 7f0cfcff9700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ce405a120 0x7f0ce405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.780+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0cf4073240 con 0x7f0d000632e0 2023-08-17T00:06:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.780+0000 7f0cfffff700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ce405a120 0x7f0ce405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.780+0000 7f0cfffff700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ce405a120 0x7f0ce405c5e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f0d000bfdd0 tx=0x7f0cec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.784+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d000bd210 con 0x7f0d000632e0 2023-08-17T00:06:46.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:45.996+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0d000bd210 con 0x7f0d000632e0 2023-08-17T00:06:46.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.000+0000 7f0cfcff9700 1 -- 172.21.15.153:0/4205379640 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0cf4046f30 con 0x7f0d000632e0 2023-08-17T00:06:46.004 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.005 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:06:46.006 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:06:46.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.009 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.010 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.011 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.013 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.014 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:06:46.015 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.016 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.017 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.018 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.019 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:06:46.020 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.021 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:06:46.023 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.024 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.025 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:06:46.027 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:06:46.028 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:06:46.029 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:06:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ce405a120 msgr2=0x7f0ce405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ce405a120 0x7f0ce405c5e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f0d000bfdd0 tx=0x7f0cec009040).stop 2023-08-17T00:06:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 msgr2=0x7f0d000c01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 0x7f0d000c01f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f0cf400c4c0 tx=0x7f0cf4007c90).stop 2023-08-17T00:06:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 shutdown_connections 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ce405a120 0x7f0ce405c5e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d000bc4d0 0x7f0d00068790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d000a8b70 0x7f0d001528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 --2- 172.21.15.153:0/4205379640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d000632e0 0x7f0d000c01f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 >> 172.21.15.153:0/4205379640 conn(0x7f0d000c7150 msgr2=0x7f0d000bbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 shutdown_connections 2023-08-17T00:06:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.004+0000 7f0d06cdb700 1 -- 172.21.15.153:0/4205379640 wait complete. 2023-08-17T00:06:46.033 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:46.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.184+0000 7fb4ddae4700 1 Processor -- start 2023-08-17T00:06:46.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.184+0000 7fb4ddae4700 1 -- start start 2023-08-17T00:06:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4d80a8df0 0x7fb4d80c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d81585a0 con 0x7fb4d80aa6e0 2023-08-17T00:06:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d8066400 con 0x7fb4d8068820 2023-08-17T00:06:46.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d8062dc0 con 0x7fb4d80a8df0 2023-08-17T00:06:46.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4d80a8df0 0x7fb4d80c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4d80a8df0 0x7fb4d80c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33342/0 (socket says 172.21.15.153:33342) 2023-08-17T00:06:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 -- 172.21.15.153:0/2935869993 learned_addr learned my addr 172.21.15.153:0/2935869993 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 -- 172.21.15.153:0/2935869993 >> v1:172.21.15.178:6789/0 conn(0x7fb4d8068820 legacy=0x7fb4d8061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 -- 172.21.15.153:0/2935869993 >> v1:172.21.15.153:6789/0 conn(0x7fb4d80aa6e0 legacy=0x7fb4d80626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 -- 172.21.15.153:0/2935869993 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d80b9d30 con 0x7fb4d80a8df0 2023-08-17T00:06:46.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4cf7fe700 1 -- 172.21.15.153:0/2935869993 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051424791 0 0) 0x7fb4d81585a0 con 0x7fb4d80aa6e0 2023-08-17T00:06:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4dcae2700 1 --2- 172.21.15.153:0/2935869993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d80a8df0 0x7fb4d80c1490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fb4d4009810 tx=0x7fb4d4009060).ready entity=mon.0 client_cookie=819758d668378054 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4cf7fe700 1 -- 172.21.15.153:0/2935869993 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4005880 con 0x7fb4d80a8df0 2023-08-17T00:06:46.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4cf7fe700 1 -- 172.21.15.153:0/2935869993 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d40059e0 con 0x7fb4d80a8df0 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4cf7fe700 1 -- 172.21.15.153:0/2935869993 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d4005d60 con 0x7fb4d80a8df0 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- 172.21.15.153:0/2935869993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d80a8df0 msgr2=0x7fb4d80c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/2935869993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d80a8df0 0x7fb4d80c1490 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7fb4d4009810 tx=0x7fb4d4009060).stop 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- 172.21.15.153:0/2935869993 shutdown_connections 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/2935869993 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d80a8df0 0x7fb4d80c1490 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- 172.21.15.153:0/2935869993 >> 172.21.15.153:0/2935869993 conn(0x7fb4d80c6620 msgr2=0x7fb4d80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:46.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- 172.21.15.153:0/2935869993 shutdown_connections 2023-08-17T00:06:46.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.188+0000 7fb4ddae4700 1 -- 172.21.15.153:0/2935869993 wait complete. 2023-08-17T00:06:46.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 Processor -- start 2023-08-17T00:06:46.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 -- start start 2023-08-17T00:06:46.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 0x7fb4d8155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4d80a8df0 0x7fb4d80bd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4d80aa6e0 0x7fb4d8061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80ba280 con 0x7fb4d8068820 2023-08-17T00:06:46.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80be140 con 0x7fb4d80aa6e0 2023-08-17T00:06:46.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.192+0000 7fb4ddae4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d80be370 con 0x7fb4d80a8df0 2023-08-17T00:06:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 0x7fb4d8155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 0x7fb4d8155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33350/0 (socket says 172.21.15.153:33350) 2023-08-17T00:06:46.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 -- 172.21.15.153:0/3638390691 learned_addr learned my addr 172.21.15.153:0/3638390691 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dd2e3700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4d80aa6e0 0x7fb4d8061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4cffff700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4d80a8df0 0x7fb4d80bd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 -- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4d80a8df0 msgr2=0x7fb4d80bd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4d80a8df0 0x7fb4d80bd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 -- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4d80aa6e0 msgr2=0x7fb4d8061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4d80aa6e0 0x7fb4d8061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 -- 172.21.15.153:0/3638390691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d4009300 con 0x7fb4d8068820 2023-08-17T00:06:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4dcae2700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 0x7fb4d8155e70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb4d4009fd0 tx=0x7fb4d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d400b850 con 0x7fb4d8068820 2023-08-17T00:06:46.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d400b9b0 con 0x7fb4d8068820 2023-08-17T00:06:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d400bd30 con 0x7fb4d8068820 2023-08-17T00:06:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d80be650 con 0x7fb4d8068820 2023-08-17T00:06:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d80bec10 con 0x7fb4d8068820 2023-08-17T00:06:46.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.196+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d806b4c0 con 0x7fb4d8068820 2023-08-17T00:06:46.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.200+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb4d400f070 con 0x7fb4d8068820 2023-08-17T00:06:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.200+0000 7fb4ccff9700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c405a150 0x7fb4c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.200+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb4d4074ed0 con 0x7fb4d8068820 2023-08-17T00:06:46.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.200+0000 7fb4cffff700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c405a150 0x7fb4c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.200+0000 7fb4cffff700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c405a150 0x7fb4c405c610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fb4d80b9820 tx=0x7fb4c8007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.208+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4d4048bc0 con 0x7fb4d8068820 2023-08-17T00:06:46.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.368+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d8064010 con 0x7fb4d8068820 2023-08-17T00:06:46.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.368+0000 7fb4ccff9700 1 -- 172.21.15.153:0/3638390691 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+13760 (secure 0 0 0) 0x7fb4d404c1e0 con 0x7fb4d8068820 2023-08-17T00:06:46.374 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:46.375 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":59,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:45.566306+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c405a150 msgr2=0x7fb4c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c405a150 0x7fb4c405c610 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fb4d80b9820 tx=0x7fb4c8007d40).stop 2023-08-17T00:06:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 msgr2=0x7fb4d8155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 0x7fb4d8155e70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7fb4d4009fd0 tx=0x7fb4d4016000).stop 2023-08-17T00:06:46.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 shutdown_connections 2023-08-17T00:06:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c405a150 0x7fb4c405c610 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4d80aa6e0 0x7fb4d8061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4d80a8df0 0x7fb4d80bd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 --2- 172.21.15.153:0/3638390691 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4d8068820 0x7fb4d8155e70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 >> 172.21.15.153:0/3638390691 conn(0x7fb4d80c6620 msgr2=0x7fb4d80c59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 shutdown_connections 2023-08-17T00:06:46.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.372+0000 7fb4ddae4700 1 -- 172.21.15.153:0/3638390691 wait complete. 2023-08-17T00:06:46.397 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:06:46.398 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:06:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.552+0000 7f607889a700 1 Processor -- start 2023-08-17T00:06:46.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.552+0000 7f607889a700 1 -- start start 2023-08-17T00:06:46.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607889a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f6074068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607889a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6074151530 0x7f60741519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607889a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6074065da0 con 0x7f60741560f0 2023-08-17T00:06:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607889a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6074155c60 con 0x7f6074151530 2023-08-17T00:06:46.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607889a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074156550 con 0x7f60740689c0 2023-08-17T00:06:46.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6074151530 0x7f60741519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f60741560f0 0x7f60740c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46532/0 (socket says 172.21.15.153:46532) 2023-08-17T00:06:46.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607259c700 1 -- 172.21.15.153:0/4103385520 learned_addr learned my addr 172.21.15.153:0/4103385520 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:46.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f6072d9d700 1 --2- 172.21.15.153:0/4103385520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f6074068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607359e700 1 -- 172.21.15.153:0/4103385520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 msgr2=0x7f6074068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607359e700 1 --2- 172.21.15.153:0/4103385520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f6074068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607359e700 1 -- 172.21.15.153:0/4103385520 >> v1:172.21.15.153:6789/0 conn(0x7f60741560f0 legacy=0x7f60740c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f6071d9b700 1 -- 172.21.15.153:0/4103385520 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937497180 0 0) 0x7f6074065da0 con 0x7f60741560f0 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607359e700 1 -- 172.21.15.153:0/4103385520 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074065ff0 con 0x7f6074151530 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.556+0000 7f607359e700 1 --2- 172.21.15.153:0/4103385520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60741519e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f606c009e90 tx=0x7f606c009780).ready entity=mon.0 client_cookie=74c49a71dbdebaf9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f6071d9b700 1 -- 172.21.15.153:0/4103385520 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c00e070 con 0x7f6074151530 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f6071d9b700 1 -- 172.21.15.153:0/4103385520 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606c00bbf0 con 0x7f6074151530 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f6071d9b700 1 -- 172.21.15.153:0/4103385520 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606c012410 con 0x7f6074151530 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 -- 172.21.15.153:0/4103385520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 msgr2=0x7f60741519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 --2- 172.21.15.153:0/4103385520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60741519e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f606c009e90 tx=0x7f606c009780).stop 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 -- 172.21.15.153:0/4103385520 shutdown_connections 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 --2- 172.21.15.153:0/4103385520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60741519e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 --2- 172.21.15.153:0/4103385520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f6074068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 -- 172.21.15.153:0/4103385520 >> 172.21.15.153:0/4103385520 conn(0x7f60740c6620 msgr2=0x7f60740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 -- 172.21.15.153:0/4103385520 shutdown_connections 2023-08-17T00:06:46.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 -- 172.21.15.153:0/4103385520 wait complete. 2023-08-17T00:06:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 Processor -- start 2023-08-17T00:06:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.560+0000 7f607889a700 1 -- start start 2023-08-17T00:06:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f60740a80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60740bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60741560f0 0x7f6074153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740a85a0 con 0x7f6074151530 2023-08-17T00:06:46.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60740bc860 con 0x7f60741560f0 2023-08-17T00:06:46.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60741519b0 con 0x7f60740689c0 2023-08-17T00:06:46.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60740bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60740bbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33370/0 (socket says 172.21.15.153:33370) 2023-08-17T00:06:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 -- 172.21.15.153:0/1804635324 learned_addr learned my addr 172.21.15.153:0/1804635324 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607359e700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60741560f0 0x7f6074153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f6072d9d700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f60740a80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 -- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 msgr2=0x7f60740a80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f60740a80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 -- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60741560f0 msgr2=0x7f6074153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60741560f0 0x7f6074153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 -- 172.21.15.153:0/1804635324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606c009a20 con 0x7f6074151530 2023-08-17T00:06:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607359e700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60741560f0 0x7f6074153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:46.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f6072d9d700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f60740a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607259c700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60740bbe80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f606800c4a0 tx=0x7f6068007c30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680072e0 con 0x7f6074151530 2023-08-17T00:06:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6068007440 con 0x7f6074151530 2023-08-17T00:06:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074151c90 con 0x7f6074151530 2023-08-17T00:06:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680057a0 con 0x7f6074151530 2023-08-17T00:06:46.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.564+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6074152250 con 0x7f6074151530 2023-08-17T00:06:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.568+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6074152470 con 0x7f6074151530 2023-08-17T00:06:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.568+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6068010070 con 0x7f6074151530 2023-08-17T00:06:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.568+0000 7f605affd700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f606005a150 0x7f606005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.568+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f6068073560 con 0x7f6074151530 2023-08-17T00:06:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.568+0000 7f6072d9d700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f606005a150 0x7f606005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.572+0000 7f6072d9d700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f606005a150 0x7f606005c610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f606400baa0 tx=0x7f6064008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.572+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6068047250 con 0x7f6074151530 2023-08-17T00:06:46.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.728+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f607406b4c0 con 0x7f6074151530 2023-08-17T00:06:46.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.728+0000 7f605affd700 1 -- 172.21.15.153:0/1804635324 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v59) v1 ==== 110+0+10 (secure 0 0 0) 0x7f606804a870 con 0x7f6074151530 2023-08-17T00:06:46.735 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:06:46.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f606005a150 msgr2=0x7f606005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f606005a150 0x7f606005c610 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f606400baa0 tx=0x7f6064008040).stop 2023-08-17T00:06:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 msgr2=0x7f60740bbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60740bbe80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f606800c4a0 tx=0x7f6068007c30).stop 2023-08-17T00:06:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 shutdown_connections 2023-08-17T00:06:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f606005a150 0x7f606005c610 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f60741560f0 0x7f6074153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6074151530 0x7f60740bbe80 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 --2- 172.21.15.153:0/1804635324 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f60740689c0 0x7f60740a80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 >> 172.21.15.153:0/1804635324 conn(0x7f60740c6620 msgr2=0x7f60740c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:46.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 shutdown_connections 2023-08-17T00:06:46.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.736+0000 7f607889a700 1 -- 172.21.15.153:0/1804635324 wait complete. 2023-08-17T00:06:46.760 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:06:46.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.916+0000 7f523759e700 1 Processor -- start 2023-08-17T00:06:46.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.916+0000 7f523759e700 1 -- start start 2023-08-17T00:06:46.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52380acf30 0x7f52380c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52380c5ea0 0x7f52380634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380639a0 0x7f5238157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5238154e90 con 0x7f52380acf30 2023-08-17T00:06:46.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5238063df0 con 0x7f52380c5ea0 2023-08-17T00:06:46.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5238153fc0 con 0x7f52380639a0 2023-08-17T00:06:46.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52380acf30 0x7f52380c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f52380acf30 0x7f52380c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33378/0 (socket says 172.21.15.153:33378) 2023-08-17T00:06:46.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 -- 172.21.15.153:0/4061938053 learned_addr learned my addr 172.21.15.153:0/4061938053 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:46.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f5235d9b700 1 --2- 172.21.15.153:0/4061938053 >> v2:172.21.15.178:3300/0 conn(0x7f52380c5ea0 0x7f52380634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f5236d9d700 1 --2- 172.21.15.153:0/4061938053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380639a0 0x7f5238157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 -- 172.21.15.153:0/4061938053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380639a0 msgr2=0x7f5238157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:46.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 --2- 172.21.15.153:0/4061938053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380639a0 0x7f5238157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 -- 172.21.15.153:0/4061938053 >> v2:172.21.15.178:3300/0 conn(0x7f52380c5ea0 msgr2=0x7f52380634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:46.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 --2- 172.21.15.153:0/4061938053 >> v2:172.21.15.178:3300/0 conn(0x7f52380c5ea0 0x7f52380634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 -- 172.21.15.153:0/4061938053 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238154280 con 0x7f52380acf30 2023-08-17T00:06:46.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.920+0000 7f523659c700 1 --2- 172.21.15.153:0/4061938053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380acf30 0x7f52380c1020 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f52380b0a60 tx=0x7f52280090f0).ready entity=mon.0 client_cookie=b2b29fec0f7ac2b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523559a700 1 -- 172.21.15.153:0/4061938053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800f510 con 0x7f52380acf30 2023-08-17T00:06:46.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523559a700 1 -- 172.21.15.153:0/4061938053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800f670 con 0x7f52380acf30 2023-08-17T00:06:46.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523559a700 1 -- 172.21.15.153:0/4061938053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522800fa10 con 0x7f52380acf30 2023-08-17T00:06:46.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 -- 172.21.15.153:0/4061938053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380acf30 msgr2=0x7f52380c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 --2- 172.21.15.153:0/4061938053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380acf30 0x7f52380c1020 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f52380b0a60 tx=0x7f52280090f0).stop 2023-08-17T00:06:46.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 -- 172.21.15.153:0/4061938053 shutdown_connections 2023-08-17T00:06:46.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 --2- 172.21.15.153:0/4061938053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380639a0 0x7f5238157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 --2- 172.21.15.153:0/4061938053 >> v2:172.21.15.178:3300/0 conn(0x7f52380c5ea0 0x7f52380634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 --2- 172.21.15.153:0/4061938053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380acf30 0x7f52380c1020 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 -- 172.21.15.153:0/4061938053 >> 172.21.15.153:0/4061938053 conn(0x7f52380cb330 msgr2=0x7f52380c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:46.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 -- 172.21.15.153:0/4061938053 shutdown_connections 2023-08-17T00:06:46.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.924+0000 7f523759e700 1 -- 172.21.15.153:0/4061938053 wait complete. 2023-08-17T00:06:46.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 Processor -- start 2023-08-17T00:06:46.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 -- start start 2023-08-17T00:06:46.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 0x7f52380c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380acf30 0x7f52380c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380c9a50 0x7f52380aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238150ce0 con 0x7f52380639a0 2023-08-17T00:06:46.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380c95c0 con 0x7f52380acf30 2023-08-17T00:06:46.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380c89b0 con 0x7f52380c9a50 2023-08-17T00:06:46.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 0x7f52380c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 0x7f52380c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33388/0 (socket says 172.21.15.153:33388) 2023-08-17T00:06:46.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 -- 172.21.15.153:0/1636640903 learned_addr learned my addr 172.21.15.153:0/1636640903 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:46.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f5236d9d700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380c9a50 0x7f52380aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f5235d9b700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380acf30 0x7f52380c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 -- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380c9a50 msgr2=0x7f52380aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380c9a50 0x7f52380aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 -- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380acf30 msgr2=0x7f52380c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380acf30 0x7f52380c22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 -- 172.21.15.153:0/1636640903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5228009370 con 0x7f52380639a0 2023-08-17T00:06:46.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523659c700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 0x7f52380c83d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5238083e70 tx=0x7f5228016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228006d90 con 0x7f52380639a0 2023-08-17T00:06:46.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522800fe50 con 0x7f52380639a0 2023-08-17T00:06:46.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.928+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52380c8c90 con 0x7f52380639a0 2023-08-17T00:06:46.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.932+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5228011d50 con 0x7f52380639a0 2023-08-17T00:06:46.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.932+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52380c9250 con 0x7f52380639a0 2023-08-17T00:06:46.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.932+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380c0950 con 0x7f52380639a0 2023-08-17T00:06:46.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.932+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5228017040 con 0x7f52380639a0 2023-08-17T00:06:46.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.936+0000 7f52267fc700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f521805a150 0x7f521805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:46.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.936+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f52280754c0 con 0x7f52380639a0 2023-08-17T00:06:46.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.936+0000 7f5235d9b700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f521805a150 0x7f521805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:46.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.936+0000 7f5235d9b700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f521805a150 0x7f521805c610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f52380ae030 tx=0x7f522c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:46.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:46.940+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52280491f0 con 0x7f52380639a0 2023-08-17T00:06:47.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.096+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f523806b4c0 con 0x7f52380639a0 2023-08-17T00:06:47.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.096+0000 7f52267fc700 1 -- 172.21.15.153:0/1636640903 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v59) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5228015020 con 0x7f52380639a0 2023-08-17T00:06:47.102 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:06:47.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f521805a150 msgr2=0x7f521805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f521805a150 0x7f521805c610 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f52380ae030 tx=0x7f522c009060).stop 2023-08-17T00:06:47.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 msgr2=0x7f52380c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 0x7f52380c83d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f5238083e70 tx=0x7f5228016000).stop 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 shutdown_connections 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f521805a150 0x7f521805c610 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380c9a50 0x7f52380aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380acf30 0x7f52380c22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 --2- 172.21.15.153:0/1636640903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52380639a0 0x7f52380c83d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 >> 172.21.15.153:0/1636640903 conn(0x7f52380cb330 msgr2=0x7f52380ab0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 shutdown_connections 2023-08-17T00:06:47.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.100+0000 7f523759e700 1 -- 172.21.15.153:0/1636640903 wait complete. 2023-08-17T00:06:47.123 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:06:47.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.272+0000 7f2a38c9b700 1 Processor -- start 2023-08-17T00:06:47.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a38c9b700 1 -- start start 2023-08-17T00:06:47.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a38c9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a34151f70 0x7f2a34065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a38c9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a34065b50 0x7f2a34064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a38c9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a34061fa0 con 0x7f2a34151b90 2023-08-17T00:06:47.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a38c9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a340c3fb0 con 0x7f2a34065b50 2023-08-17T00:06:47.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a38c9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a341523d0 con 0x7f2a34151f70 2023-08-17T00:06:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a32d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2a34065b50 0x7f2a34064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a3259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2a34151b90 0x7f2a34063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46548/0 (socket says 172.21.15.153:46548) 2023-08-17T00:06:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a3259c700 1 -- 172.21.15.153:0/467372321 learned_addr learned my addr 172.21.15.153:0/467372321 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a31d9b700 1 --2- 172.21.15.153:0/467372321 >> v2:172.21.15.178:3300/0 conn(0x7f2a34151f70 0x7f2a34065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a32d9d700 1 -- 172.21.15.153:0/467372321 >> v2:172.21.15.178:3300/0 conn(0x7f2a34151f70 msgr2=0x7f2a34065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:47.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a32d9d700 1 --2- 172.21.15.153:0/467372321 >> v2:172.21.15.178:3300/0 conn(0x7f2a34151f70 0x7f2a34065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a32d9d700 1 -- 172.21.15.153:0/467372321 >> v1:172.21.15.153:6789/0 conn(0x7f2a34151b90 legacy=0x7f2a34063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a32d9d700 1 -- 172.21.15.153:0/467372321 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a340621f0 con 0x7f2a34065b50 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.276+0000 7f2a31d9b700 1 --2- 172.21.15.153:0/467372321 >> v2:172.21.15.178:3300/0 conn(0x7f2a34151f70 0x7f2a34065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a32d9d700 1 --2- 172.21.15.153:0/467372321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a34064870 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f2a3405ebc0 tx=0x7f2a2c009780).ready entity=mon.0 client_cookie=8adecd36a76c8f3e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a3159a700 1 -- 172.21.15.153:0/467372321 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c00e070 con 0x7f2a34065b50 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a3159a700 1 -- 172.21.15.153:0/467372321 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c00bc30 con 0x7f2a34065b50 2023-08-17T00:06:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a3159a700 1 -- 172.21.15.153:0/467372321 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c012410 con 0x7f2a34065b50 2023-08-17T00:06:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 -- 172.21.15.153:0/467372321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 msgr2=0x7f2a34064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/467372321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a34064870 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f2a3405ebc0 tx=0x7f2a2c009780).stop 2023-08-17T00:06:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 -- 172.21.15.153:0/467372321 shutdown_connections 2023-08-17T00:06:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/467372321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a34064870 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/467372321 >> v2:172.21.15.178:3300/0 conn(0x7f2a34151f70 0x7f2a34065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 -- 172.21.15.153:0/467372321 >> 172.21.15.153:0/467372321 conn(0x7f2a340c7150 msgr2=0x7f2a340c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 -- 172.21.15.153:0/467372321 shutdown_connections 2023-08-17T00:06:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.280+0000 7f2a38c9b700 1 -- 172.21.15.153:0/467372321 wait complete. 2023-08-17T00:06:47.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 Processor -- start 2023-08-17T00:06:47.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 -- start start 2023-08-17T00:06:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a3414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a34151b90 0x7f2a34152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a34151f70 0x7f2a3414f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340bd8f0 con 0x7f2a34065b50 2023-08-17T00:06:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341661d0 con 0x7f2a34151b90 2023-08-17T00:06:47.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a38c9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341655c0 con 0x7f2a34151f70 2023-08-17T00:06:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.284+0000 7f2a3259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a3414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a3414b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33408/0 (socket says 172.21.15.153:33408) 2023-08-17T00:06:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 -- 172.21.15.153:0/3566140472 learned_addr learned my addr 172.21.15.153:0/3566140472 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:47.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a31d9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a34151b90 0x7f2a34152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a32d9d700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a34151f70 0x7f2a3414f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 -- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a34151f70 msgr2=0x7f2a3414f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a34151f70 0x7f2a3414f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 -- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a34151b90 msgr2=0x7f2a34152570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a34151b90 0x7f2a34152570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 -- 172.21.15.153:0/3566140472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c009a20 con 0x7f2a34065b50 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a3259c700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a3414b120 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f2a24007fd0 tx=0x7f2a24007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2400ce10 con 0x7f2a34065b50 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a240072e0 con 0x7f2a34065b50 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a341658a0 con 0x7f2a34065b50 2023-08-17T00:06:47.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24007660 con 0x7f2a34065b50 2023-08-17T00:06:47.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a34165e60 con 0x7f2a34065b50 2023-08-17T00:06:47.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.288+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a3406b530 con 0x7f2a34065b50 2023-08-17T00:06:47.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.292+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2a24010070 con 0x7f2a34065b50 2023-08-17T00:06:47.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.292+0000 7f2a227fc700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a1405a150 0x7f2a1405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.292+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2a24073430 con 0x7f2a34065b50 2023-08-17T00:06:47.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.292+0000 7f2a31d9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a1405a150 0x7f2a1405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.296+0000 7f2a31d9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a1405a150 0x7f2a1405c610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f2a3414c600 tx=0x7f2a28008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:47.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.296+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2a240470c0 con 0x7f2a34065b50 2023-08-17T00:06:47.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.460+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2a340624d0 con 0x7f2a34065b50 2023-08-17T00:06:47.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.460+0000 7f2a227fc700 1 -- 172.21.15.153:0/3566140472 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2a24071e60 con 0x7f2a34065b50 2023-08-17T00:06:47.464 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:06:47.465 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:06:47.466 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:06:47.466 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:06:47.466 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:06:47.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a1405a150 msgr2=0x7f2a1405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a1405a150 0x7f2a1405c610 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f2a3414c600 tx=0x7f2a28008040).stop 2023-08-17T00:06:47.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 msgr2=0x7f2a3414b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a3414b120 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f2a24007fd0 tx=0x7f2a24007df0).stop 2023-08-17T00:06:47.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 shutdown_connections 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2a1405a150 0x7f2a1405c610 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a34151f70 0x7f2a3414f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a34151b90 0x7f2a34152570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 --2- 172.21.15.153:0/3566140472 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2a34065b50 0x7f2a3414b120 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 >> 172.21.15.153:0/3566140472 conn(0x7f2a340c7150 msgr2=0x7f2a34063190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 shutdown_connections 2023-08-17T00:06:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.464+0000 7f2a38c9b700 1 -- 172.21.15.153:0/3566140472 wait complete. 2023-08-17T00:06:47.487 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:06:47.488 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:06:47.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5143fff700 1 Processor -- start 2023-08-17T00:06:47.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5143fff700 1 -- start start 2023-08-17T00:06:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5143fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51441539b0 0x7f51440632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5143fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440c00d0 con 0x7f51440a9eb0 2023-08-17T00:06:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5143fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440bf810 con 0x7f5144153d90 2023-08-17T00:06:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5143fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51440aa910 con 0x7f51441539b0 2023-08-17T00:06:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f51437fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f51440a9eb0 0x7f51440c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46556/0 (socket says 172.21.15.153:46556) 2023-08-17T00:06:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f51437fe700 1 -- 172.21.15.153:0/3426902335 learned_addr learned my addr 172.21.15.153:0/3426902335 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3426902335 >> v2:172.21.15.178:3300/0 conn(0x7f51441539b0 0x7f51440632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231505232 0 0) 0x7f51440c00d0 con 0x7f51440a9eb0 2023-08-17T00:06:47.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.648+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f512c0033f0 con 0x7f51440a9eb0 2023-08-17T00:06:47.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944575086 0 0) 0x7f512c0033f0 con 0x7f51440a9eb0 2023-08-17T00:06:47.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 >> v2:172.21.15.178:3300/0 conn(0x7f51441539b0 msgr2=0x7f51440632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:47.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 --2- 172.21.15.153:0/3426902335 >> v2:172.21.15.178:3300/0 conn(0x7f51441539b0 0x7f51440632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 >> v1:172.21.15.178:6789/0 conn(0x7f5144153d90 legacy=0x7f51440a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440bfa80 con 0x7f51440a9eb0 2023-08-17T00:06:47.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f513c0017f0 con 0x7f51440a9eb0 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 >> v1:172.21.15.153:6789/0 conn(0x7f51440a9eb0 legacy=0x7f51440c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f512c0038e0 0x7f512c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c004690 0x7f512c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c005000 0x7f512c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440aa910 con 0x7f512c0038e0 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512c00bf60 con 0x7f512c004690 2023-08-17T00:06:47.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512c00c0f0 con 0x7f512c005000 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f512c0038e0 0x7f512c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f51427fc700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c004690 0x7f512c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f51437fe700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c005000 0x7f512c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 -- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c005000 msgr2=0x7f512c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c005000 0x7f512c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 -- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c004690 msgr2=0x7f512c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:47.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c004690 0x7f512c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 -- 172.21.15.153:0/3426902335 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512c0033f0 con 0x7f512c0038e0 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f51437fe700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c005000 0x7f512c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f51427fc700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f512c004690 0x7f512c004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f51437fe700 1 -- 172.21.15.153:0/3426902335 reap_dead start 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f512c0038e0 0x7f512c003d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f5134006fd0 tx=0x7f5134006f40).ready entity=mon.0 client_cookie=be2727130052d4bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134009430 con 0x7f512c0038e0 2023-08-17T00:06:47.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513400e640 con 0x7f512c0038e0 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5141ffb700 1 -- 172.21.15.153:0/3426902335 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513400e9c0 con 0x7f512c0038e0 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 -- 172.21.15.153:0/3426902335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f512c0038e0 msgr2=0x7f512c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f512c0038e0 0x7f512c003d00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f5134006fd0 tx=0x7f5134006f40).stop 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 -- 172.21.15.153:0/3426902335 shutdown_connections 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 --2- 172.21.15.153:0/3426902335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f512c0038e0 0x7f512c003d00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 -- 172.21.15.153:0/3426902335 >> 172.21.15.153:0/3426902335 conn(0x7f5144062a10 msgr2=0x7f51440ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 -- 172.21.15.153:0/3426902335 shutdown_connections 2023-08-17T00:06:47.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.652+0000 7f5143fff700 1 -- 172.21.15.153:0/3426902335 wait complete. 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 Processor -- start 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 -- start start 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0038e0 0x7f5144168560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 0x7f5144142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51440afac0 0x7f51440aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51440b0430 con 0x7f51441645e0 2023-08-17T00:06:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144168a50 con 0x7f51440afac0 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5143fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5144156580 con 0x7f512c0038e0 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f51427fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 0x7f5144142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f51427fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 0x7f5144142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33420/0 (socket says 172.21.15.153:33420) 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f51427fc700 1 -- 172.21.15.153:0/3606375456 learned_addr learned my addr 172.21.15.153:0/3606375456 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0038e0 0x7f5144168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.656+0000 7f51437fe700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51440afac0 0x7f51440aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f51427fc700 1 -- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0038e0 msgr2=0x7f5144168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f51427fc700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0038e0 0x7f5144168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f51427fc700 1 -- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51440afac0 msgr2=0x7f51440aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:47.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f51427fc700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51440afac0 0x7f51440aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:47.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f51427fc700 1 -- 172.21.15.153:0/3606375456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144156860 con 0x7f51441645e0 2023-08-17T00:06:47.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f51427fc700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 0x7f5144142200 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f5138000c00 tx=0x7f5138009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:47.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138014430 con 0x7f51441645e0 2023-08-17T00:06:47.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138014590 con 0x7f51441645e0 2023-08-17T00:06:47.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138014910 con 0x7f51441645e0 2023-08-17T00:06:47.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5144156b40 con 0x7f51441645e0 2023-08-17T00:06:47.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5144154240 con 0x7f51441645e0 2023-08-17T00:06:47.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5144046dd0 con 0x7f51441645e0 2023-08-17T00:06:47.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.660+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5138014c80 con 0x7f51441645e0 2023-08-17T00:06:47.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.664+0000 7f512affd700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f513005a180 0x7f513005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:47.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.664+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5138073e80 con 0x7f51441645e0 2023-08-17T00:06:47.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.664+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f513005a180 0x7f513005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:47.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.664+0000 7f5142ffd700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f513005a180 0x7f513005c640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5134006fa0 tx=0x7f513401a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:47.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.668+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5138047b70 con 0x7f51441645e0 2023-08-17T00:06:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:47.832+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f51440bfd60 con 0x7f51441645e0 2023-08-17T00:06:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.472+0000 7f512affd700 1 -- 172.21.15.153:0/3606375456 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 152+0+0 (secure 0 0 0) 0x7f513804b190 con 0x7f51441645e0 2023-08-17T00:06:48.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f513005a180 msgr2=0x7f513005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f513005a180 0x7f513005c640 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f5134006fa0 tx=0x7f513401a000).stop 2023-08-17T00:06:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 msgr2=0x7f5144142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 0x7f5144142200 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f5138000c00 tx=0x7f5138009040).stop 2023-08-17T00:06:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 shutdown_connections 2023-08-17T00:06:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f513005a180 0x7f513005c640 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:48.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51440afac0 0x7f51440aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:48.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51441645e0 0x7f5144142200 secure :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0x7f5138000c00 tx=0x7f5138009040).stop 2023-08-17T00:06:48.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 --2- 172.21.15.153:0/3606375456 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f512c0038e0 0x7f5144168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:48.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.480+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 >> 172.21.15.153:0/3606375456 conn(0x7f5144062a10 msgr2=0x7f51440c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:48.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.484+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 shutdown_connections 2023-08-17T00:06:48.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.484+0000 7f5143fff700 1 -- 172.21.15.153:0/3606375456 wait complete. 2023-08-17T00:06:48.490 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:06:48.508 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:06:48.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.676+0000 7f18e1369700 1 Processor -- start 2023-08-17T00:06:48.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.676+0000 7f18e1369700 1 -- start start 2023-08-17T00:06:48.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18e1369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18dc153e90 0x7f18dc0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18e1369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0c0330 con 0x7f18dc0641f0 2023-08-17T00:06:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18e1369700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18dc0c0ed0 con 0x7f18dc153ab0 2023-08-17T00:06:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18e1369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18dc1542f0 con 0x7f18dc153e90 2023-08-17T00:06:48.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18db7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f18dc0641f0 0x7f18dc061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46562/0 (socket says 172.21.15.153:46562) 2023-08-17T00:06:48.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18db7fe700 1 -- 172.21.15.153:0/4281489668 learned_addr learned my addr 172.21.15.153:0/4281489668 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:48.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18da7fc700 1 --2- 172.21.15.153:0/4281489668 >> v2:172.21.15.178:3300/0 conn(0x7f18dc153e90 0x7f18dc0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:48.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18d9ffb700 1 -- 172.21.15.153:0/4281489668 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676351001 0 0) 0x7f18dc0c0330 con 0x7f18dc0641f0 2023-08-17T00:06:48.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18d9ffb700 1 -- 172.21.15.153:0/4281489668 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c40033f0 con 0x7f18dc0641f0 2023-08-17T00:06:48.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18d9ffb700 1 -- 172.21.15.153:0/4281489668 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2015538516 0 0) 0x7f18c40033f0 con 0x7f18dc0641f0 2023-08-17T00:06:48.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18da7fc700 1 -- 172.21.15.153:0/4281489668 >> v1:172.21.15.178:6789/0 conn(0x7f18dc153ab0 legacy=0x7f18dc0c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18da7fc700 1 -- 172.21.15.153:0/4281489668 >> v1:172.21.15.153:6789/0 conn(0x7f18dc0641f0 legacy=0x7f18dc061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18da7fc700 1 -- 172.21.15.153:0/4281489668 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18dc064660 con 0x7f18dc153e90 2023-08-17T00:06:48.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18da7fc700 1 --2- 172.21.15.153:0/4281489668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153e90 0x7f18dc0c59e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f18d0009760 tx=0x7f18d0009060).ready entity=mon.1 client_cookie=1ed81a748001a477 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:48.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18d9ffb700 1 -- 172.21.15.153:0/4281489668 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40017f0 con 0x7f18dc153e90 2023-08-17T00:06:48.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18d9ffb700 1 -- 172.21.15.153:0/4281489668 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0009130 con 0x7f18dc153e90 2023-08-17T00:06:48.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.680+0000 7f18d9ffb700 1 -- 172.21.15.153:0/4281489668 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0011610 con 0x7f18dc153e90 2023-08-17T00:06:48.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 -- 172.21.15.153:0/4281489668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153e90 msgr2=0x7f18dc0c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 --2- 172.21.15.153:0/4281489668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153e90 0x7f18dc0c59e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f18d0009760 tx=0x7f18d0009060).stop 2023-08-17T00:06:48.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 -- 172.21.15.153:0/4281489668 shutdown_connections 2023-08-17T00:06:48.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 --2- 172.21.15.153:0/4281489668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153e90 0x7f18dc0c59e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:48.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 -- 172.21.15.153:0/4281489668 >> 172.21.15.153:0/4281489668 conn(0x7f18dc0caaa0 msgr2=0x7f18dc0caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:48.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 -- 172.21.15.153:0/4281489668 shutdown_connections 2023-08-17T00:06:48.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 -- 172.21.15.153:0/4281489668 wait complete. 2023-08-17T00:06:48.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 Processor -- start 2023-08-17T00:06:48.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.684+0000 7f18e1369700 1 -- start start 2023-08-17T00:06:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc0641f0 0x7f18dc1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153ab0 0x7f18dc157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 0x7f18dc0c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc156b40 con 0x7f18dc153e90 2023-08-17T00:06:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc156e20 con 0x7f18dc153ab0 2023-08-17T00:06:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18dc157100 con 0x7f18dc0641f0 2023-08-17T00:06:48.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 0x7f18dc0c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 0x7f18dc0c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33432/0 (socket says 172.21.15.153:33432) 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 -- 172.21.15.153:0/1502669290 learned_addr learned my addr 172.21.15.153:0/1502669290 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18da7fc700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153ab0 0x7f18dc157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18daffd700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc0641f0 0x7f18dc1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 -- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc0641f0 msgr2=0x7f18dc1564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc0641f0 0x7f18dc1564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:48.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 -- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153ab0 msgr2=0x7f18dc157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:48.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153ab0 0x7f18dc157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:48.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 -- 172.21.15.153:0/1502669290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00092a0 con 0x7f18dc153e90 2023-08-17T00:06:48.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18db7fe700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 0x7f18dc0c2f80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f18d400cb60 tx=0x7f18d4001d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:48.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d40020e0 con 0x7f18dc153e90 2023-08-17T00:06:48.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d4004c40 con 0x7f18dc153e90 2023-08-17T00:06:48.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4007170 con 0x7f18dc153e90 2023-08-17T00:06:48.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18dc1573e0 con 0x7f18dc153e90 2023-08-17T00:06:48.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.688+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18dc0c3470 con 0x7f18dc153e90 2023-08-17T00:06:48.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.692+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18dc1578e0 con 0x7f18dc153e90 2023-08-17T00:06:48.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.692+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f18d4010070 con 0x7f18dc153e90 2023-08-17T00:06:48.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.696+0000 7f18c2ffd700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18c805a150 0x7f18c805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:48.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.696+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f18d4073ad0 con 0x7f18dc153e90 2023-08-17T00:06:48.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.696+0000 7f18daffd700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18c805a150 0x7f18c805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:48.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.696+0000 7f18daffd700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18c805a150 0x7f18c805c610 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f18cc003900 tx=0x7f18cc007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.700+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f18d4047760 con 0x7f18dc153e90 2023-08-17T00:06:48.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:48.860+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f18dc154da0 con 0x7f18dc153e90 2023-08-17T00:06:49.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.484+0000 7f18c2ffd700 1 -- 172.21.15.153:0/1502669290 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f18d404ad80 con 0x7f18dc153e90 2023-08-17T00:06:49.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.496+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18c805a150 msgr2=0x7f18c805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.496+0000 7f18e1369700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18c805a150 0x7f18c805c610 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f18cc003900 tx=0x7f18cc007d40).stop 2023-08-17T00:06:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.496+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 msgr2=0x7f18dc0c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.496+0000 7f18e1369700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 0x7f18dc0c2f80 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f18d400cb60 tx=0x7f18d4001d90).stop 2023-08-17T00:06:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.500+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 shutdown_connections 2023-08-17T00:06:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.500+0000 7f18e1369700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f18c805a150 0x7f18c805c610 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.500+0000 7f18e1369700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18dc153e90 0x7f18dc0c2f80 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.500+0000 7f18e1369700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18dc153ab0 0x7f18dc157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.500+0000 7f18e1369700 1 --2- 172.21.15.153:0/1502669290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18dc0641f0 0x7f18dc1564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.500+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 >> 172.21.15.153:0/1502669290 conn(0x7f18dc0caaa0 msgr2=0x7f18dc152b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:49.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.512+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 shutdown_connections 2023-08-17T00:06:49.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.512+0000 7f18e1369700 1 -- 172.21.15.153:0/1502669290 wait complete. 2023-08-17T00:06:49.521 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:06:49.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:06:49.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.696+0000 7f9261e8f700 1 Processor -- start 2023-08-17T00:06:49.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.696+0000 7f9261e8f700 1 -- start start 2023-08-17T00:06:49.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f925c0acf30 0x7f925c0c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:49.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f925c063bc0 0x7f925c0bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:49.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c154e90 con 0x7f925c0c5ea0 2023-08-17T00:06:49.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c153fc0 con 0x7f925c063bc0 2023-08-17T00:06:49.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c154280 con 0x7f925c0acf30 2023-08-17T00:06:49.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f925c063bc0 0x7f925c0bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:49.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f925c063bc0 0x7f925c0bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33446/0 (socket says 172.21.15.153:33446) 2023-08-17T00:06:49.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 -- 172.21.15.153:0/1022513486 learned_addr learned my addr 172.21.15.153:0/1022513486 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:49.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 -- 172.21.15.153:0/1022513486 >> v2:172.21.15.178:3300/0 conn(0x7f925c0acf30 msgr2=0x7f925c0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:49.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 --2- 172.21.15.153:0/1022513486 >> v2:172.21.15.178:3300/0 conn(0x7f925c0acf30 0x7f925c0c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:49.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 -- 172.21.15.153:0/1022513486 >> v1:172.21.15.178:6789/0 conn(0x7f925c0c5ea0 legacy=0x7f925c0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:49.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 -- 172.21.15.153:0/1022513486 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c154560 con 0x7f925c063bc0 2023-08-17T00:06:49.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f926168e700 1 --2- 172.21.15.153:0/1022513486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c063bc0 0x7f925c0bfad0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f925c05f3f0 tx=0x7f9254009840).ready entity=mon.0 client_cookie=bcdf8dbffe2b086d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:49.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f925b7fe700 1 -- 172.21.15.153:0/1022513486 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400e070 con 0x7f925c063bc0 2023-08-17T00:06:49.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f925b7fe700 1 -- 172.21.15.153:0/1022513486 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925400ba10 con 0x7f925c063bc0 2023-08-17T00:06:49.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f925b7fe700 1 -- 172.21.15.153:0/1022513486 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400bd90 con 0x7f925c063bc0 2023-08-17T00:06:49.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 -- 172.21.15.153:0/1022513486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c063bc0 msgr2=0x7f925c0bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.700+0000 7f9261e8f700 1 --2- 172.21.15.153:0/1022513486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c063bc0 0x7f925c0bfad0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7f925c05f3f0 tx=0x7f9254009840).stop 2023-08-17T00:06:49.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 -- 172.21.15.153:0/1022513486 shutdown_connections 2023-08-17T00:06:49.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 --2- 172.21.15.153:0/1022513486 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c063bc0 0x7f925c0bfad0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 --2- 172.21.15.153:0/1022513486 >> v2:172.21.15.178:3300/0 conn(0x7f925c0acf30 0x7f925c0c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:06:49.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 -- 172.21.15.153:0/1022513486 >> 172.21.15.153:0/1022513486 conn(0x7f925c0cb330 msgr2=0x7f925c0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:49.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 -- 172.21.15.153:0/1022513486 shutdown_connections 2023-08-17T00:06:49.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 -- 172.21.15.153:0/1022513486 wait complete. 2023-08-17T00:06:49.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 Processor -- start 2023-08-17T00:06:49.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.704+0000 7f9261e8f700 1 -- start start 2023-08-17T00:06:49.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9261e8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f925c063bc0 0x7f925c14f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:49.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9261e8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f925c0acf30 0x7f925c0ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:49.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9261e8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 0x7f925c0aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:49.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9261e8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0c87d0 con 0x7f925c0adec0 2023-08-17T00:06:49.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9261e8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0c8ab0 con 0x7f925c0acf30 2023-08-17T00:06:49.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9261e8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0ae340 con 0x7f925c063bc0 2023-08-17T00:06:49.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 0x7f925c0aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 0x7f925c0aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33454/0 (socket says 172.21.15.153:33454) 2023-08-17T00:06:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 -- 172.21.15.153:0/2260355768 learned_addr learned my addr 172.21.15.153:0/2260355768 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f9260e8d700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f925c063bc0 0x7f925c14f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f925bfff700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f925c0acf30 0x7f925c0ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 -- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f925c063bc0 msgr2=0x7f925c14f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f925c063bc0 0x7f925c14f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 -- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f925c0acf30 msgr2=0x7f925c0ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f925c0acf30 0x7f925c0ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 -- 172.21.15.153:0/2260355768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254009ae0 con 0x7f925c0adec0 2023-08-17T00:06:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.708+0000 7f926168e700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 0x7f925c0aed20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f9254010000 tx=0x7f9254009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.712+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540092e0 con 0x7f925c0adec0 2023-08-17T00:06:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.712+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254013e40 con 0x7f925c0adec0 2023-08-17T00:06:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.712+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925401d640 con 0x7f925c0adec0 2023-08-17T00:06:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.712+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c0ae620 con 0x7f925c0adec0 2023-08-17T00:06:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.712+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c14f910 con 0x7f925c0adec0 2023-08-17T00:06:49.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.712+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c0acb60 con 0x7f925c0adec0 2023-08-17T00:06:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.716+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f925401b040 con 0x7f925c0adec0 2023-08-17T00:06:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.716+0000 7f9258ff9700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f924805a150 0x7f924805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.716+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f9254075b00 con 0x7f925c0adec0 2023-08-17T00:06:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.716+0000 7f9260e8d700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f924805a150 0x7f924805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.716+0000 7f9260e8d700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f924805a150 0x7f924805c610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f925c151ce0 tx=0x7f9250009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:49.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.724+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f925c0acb60 con 0x7f925c0adec0 2023-08-17T00:06:49.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.920+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f925c0acb60 con 0x7f925c0adec0 2023-08-17T00:06:49.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.928+0000 7f9258ff9700 1 -- 172.21.15.153:0/2260355768 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v45) v1 ==== 173+0+0 (secure 0 0 0) 0x7f925c0acb60 con 0x7f925c0adec0 2023-08-17T00:06:49.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.932+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f924805a150 msgr2=0x7f924805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.932+0000 7f9261e8f700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f924805a150 0x7f924805c610 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f925c151ce0 tx=0x7f9250009060).stop 2023-08-17T00:06:49.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 msgr2=0x7f925c0aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:49.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 0x7f925c0aed20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f9254010000 tx=0x7f9254009840).stop 2023-08-17T00:06:49.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 shutdown_connections 2023-08-17T00:06:49.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f924805a150 0x7f924805c610 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f925c0adec0 0x7f925c0aed20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f925c0acf30 0x7f925c0ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 --2- 172.21.15.153:0/2260355768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f925c063bc0 0x7f925c14f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:49.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 >> 172.21.15.153:0/2260355768 conn(0x7f925c0cb330 msgr2=0x7f925c0abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:49.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.936+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 shutdown_connections 2023-08-17T00:06:49.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:49.940+0000 7f9261e8f700 1 -- 172.21.15.153:0/2260355768 wait complete. 2023-08-17T00:06:49.951 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 9 and data pool 10 2023-08-17T00:06:49.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:50.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.116+0000 7fcaeb59e700 1 Processor -- start 2023-08-17T00:06:50.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.116+0000 7fcaeb59e700 1 -- start start 2023-08-17T00:06:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 0x7fcaec1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaeb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec065da0 con 0x7fcaec068da0 2023-08-17T00:06:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaeb59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaec155c60 con 0x7fcaec0689c0 2023-08-17T00:06:50.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec069200 con 0x7fcaec151c40 2023-08-17T00:06:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcaec068da0 0x7fcaec151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46568/0 (socket says 172.21.15.153:46568) 2023-08-17T00:06:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 -- 172.21.15.153:0/1809545671 learned_addr learned my addr 172.21.15.153:0/1809545671 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaead9d700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 0x7fcaec1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118688214 0 0) 0x7fcaec065da0 con 0x7fcaec068da0 2023-08-17T00:06:50.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad80033f0 con 0x7fcaec068da0 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2136112673 0 0) 0x7fcad80033f0 con 0x7fcaec068da0 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 msgr2=0x7fcaec1560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 0x7fcaec1560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 >> v1:172.21.15.178:6789/0 conn(0x7fcaec0689c0 legacy=0x7fcaec0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec065ff0 con 0x7fcaec068da0 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fcad4001470 con 0x7fcaec068da0 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 >> v1:172.21.15.153:6789/0 conn(0x7fcaec068da0 legacy=0x7fcaec151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 0x7fcad8003910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad8003e00 0x7fcad8004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcad8004b80 0x7fcad8005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec069200 con 0x7fcad8003e00 2023-08-17T00:06:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad800b990 con 0x7fcad8004b80 2023-08-17T00:06:50.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad800ff60 con 0x7fcaec151c40 2023-08-17T00:06:50.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad8003e00 0x7fcad8004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaea59c700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 0x7fcad8003910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcaead9d700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcad8004b80 0x7fcad8005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 -- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 msgr2=0x7fcad8003910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaec151c40 0x7fcad8003910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 -- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcad8004b80 msgr2=0x7fcad8005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:50.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcad8004b80 0x7fcad8005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 -- 172.21.15.153:0/1809545671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad80033f0 con 0x7fcad8003e00 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae1d9b700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad8003e00 0x7fcad8004690 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fcad400c110 tx=0x7fcad4001df0).ready entity=mon.0 client_cookie=8528681e2af7c6cd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad400ca40 con 0x7fcad8003e00 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad400cba0 con 0x7fcad8003e00 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.120+0000 7fcae9d9b700 1 -- 172.21.15.153:0/1809545671 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad40070d0 con 0x7fcad8003e00 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 -- 172.21.15.153:0/1809545671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad8003e00 msgr2=0x7fcad8004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/1809545671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcad8003e00 0x7fcad8004690 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fcad400c110 tx=0x7fcad4001df0).stop 2023-08-17T00:06:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaead9d700 1 -- 172.21.15.153:0/1809545671 reap_dead start 2023-08-17T00:06:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 -- 172.21.15.153:0/1809545671 shutdown_connections 2023-08-17T00:06:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 -- 172.21.15.153:0/1809545671 >> 172.21.15.153:0/1809545671 conn(0x7fcaec0c6620 msgr2=0x7fcaec0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 -- 172.21.15.153:0/1809545671 shutdown_connections 2023-08-17T00:06:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 -- 172.21.15.153:0/1809545671 wait complete. 2023-08-17T00:06:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 Processor -- start 2023-08-17T00:06:50.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.124+0000 7fcaeb59e700 1 -- start start 2023-08-17T00:06:50.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcad8003e00 0x7fcaec160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaec162fd0 0x7fcaec0bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 0x7fcaec161200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec1514a0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec162b40 con 0x7fcaec162fd0 2023-08-17T00:06:50.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaec0c0060 con 0x7fcad8003e00 2023-08-17T00:06:50.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 0x7fcaec161200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 0x7fcaec161200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33476/0 (socket says 172.21.15.153:33476) 2023-08-17T00:06:50.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 -- 172.21.15.153:0/14983578 learned_addr learned my addr 172.21.15.153:0/14983578 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:50.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaea59c700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcad8003e00 0x7fcaec160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcae1d9b700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaec162fd0 0x7fcaec0bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 -- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcad8003e00 msgr2=0x7fcaec160a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcad8003e00 0x7fcaec160a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 -- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaec162fd0 msgr2=0x7fcaec0bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaec162fd0 0x7fcaec0bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 -- 172.21.15.153:0/14983578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaec161f30 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaead9d700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 0x7fcaec161200 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fcaec066a30 tx=0x7fcae400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae400e030 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4007eb0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae4011d50 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.128+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaec162210 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.132+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaec1627d0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.132+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaec162cf0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.132+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcae4015600 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.136+0000 7fcae2ffd700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcacc05a150 0x7fcacc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.136+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcae400f070 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.136+0000 7fcaea59c700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcacc05a150 0x7fcacc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.136+0000 7fcaea59c700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcacc05a150 0x7fcacc05c610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fcadc007fd0 tx=0x7fcadc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.140+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcaec162cf0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.300+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaec162cf0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.304+0000 7fcae2ffd700 1 -- 172.21.15.153:0/14983578 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16991 (secure 0 0 0) 0x7fcaec162cf0 con 0x7fcaec0bfbe0 2023-08-17T00:06:50.309 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:50.309 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":62,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:49.925447+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:06:47.903453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T00:06:48.933074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcacc05a150 msgr2=0x7fcacc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcacc05a150 0x7fcacc05c610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fcadc007fd0 tx=0x7fcadc009040).stop 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 msgr2=0x7fcaec161200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 0x7fcaec161200 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fcaec066a30 tx=0x7fcae400b040).stop 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 shutdown_connections 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcacc05a150 0x7fcacc05c610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcaec0bfbe0 0x7fcaec161200 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaec162fd0 0x7fcaec0bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 --2- 172.21.15.153:0/14983578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcad8003e00 0x7fcaec160a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 >> 172.21.15.153:0/14983578 conn(0x7fcaec0c6620 msgr2=0x7fcaec0c15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:50.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 shutdown_connections 2023-08-17T00:06:50.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.308+0000 7fcaeb59e700 1 -- 172.21.15.153:0/14983578 wait complete. 2023-08-17T00:06:50.333 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.480+0000 7f2137347700 1 Processor -- start 2023-08-17T00:06:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.480+0000 7f2137347700 1 -- start start 2023-08-17T00:06:50.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2137347700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21300689c0 0x7f2130068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2137347700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2130065da0 con 0x7f21301560f0 2023-08-17T00:06:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2137347700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2130155c60 con 0x7f2130151530 2023-08-17T00:06:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2137347700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2130156550 con 0x7f21300689c0 2023-08-17T00:06:50.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2135b44700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f21301560f0 0x7f21300c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46574/0 (socket says 172.21.15.153:46574) 2023-08-17T00:06:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2135b44700 1 -- 172.21.15.153:0/984400687 learned_addr learned my addr 172.21.15.153:0/984400687 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.484+0000 7f2136345700 1 --2- 172.21.15.153:0/984400687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21300689c0 0x7f2130068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.488+0000 7f2136345700 1 -- 172.21.15.153:0/984400687 >> v1:172.21.15.178:6789/0 conn(0x7f2130151530 legacy=0x7f21301519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.488+0000 7f2136345700 1 -- 172.21.15.153:0/984400687 >> v1:172.21.15.153:6789/0 conn(0x7f21301560f0 legacy=0x7f21300c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.488+0000 7f2136345700 1 -- 172.21.15.153:0/984400687 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130065ff0 con 0x7f21300689c0 2023-08-17T00:06:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.488+0000 7f2136345700 1 --2- 172.21.15.153:0/984400687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21300689c0 0x7f2130068da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f212c009790 tx=0x7f212c006f40).ready entity=mon.2 client_cookie=d87c66873c706838 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2135343700 1 -- 172.21.15.153:0/984400687 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c005880 con 0x7f21300689c0 2023-08-17T00:06:50.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2135343700 1 -- 172.21.15.153:0/984400687 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212c0059e0 con 0x7f21300689c0 2023-08-17T00:06:50.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2135343700 1 -- 172.21.15.153:0/984400687 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212c005d60 con 0x7f21300689c0 2023-08-17T00:06:50.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 -- 172.21.15.153:0/984400687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21300689c0 msgr2=0x7f2130068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 --2- 172.21.15.153:0/984400687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21300689c0 0x7f2130068da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f212c009790 tx=0x7f212c006f40).stop 2023-08-17T00:06:50.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 -- 172.21.15.153:0/984400687 shutdown_connections 2023-08-17T00:06:50.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 --2- 172.21.15.153:0/984400687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21300689c0 0x7f2130068da0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 -- 172.21.15.153:0/984400687 >> 172.21.15.153:0/984400687 conn(0x7f21300c6620 msgr2=0x7f21300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:50.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 -- 172.21.15.153:0/984400687 shutdown_connections 2023-08-17T00:06:50.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.492+0000 7f2137347700 1 -- 172.21.15.153:0/984400687 wait complete. 2023-08-17T00:06:50.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 Processor -- start 2023-08-17T00:06:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 -- start start 2023-08-17T00:06:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21300689c0 0x7f21301687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 0x7f21300bb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21301560f0 0x7f2130164800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130152790 con 0x7f2130151530 2023-08-17T00:06:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130168c90 con 0x7f21300689c0 2023-08-17T00:06:50.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2137347700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2130151b80 con 0x7f21301560f0 2023-08-17T00:06:50.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 0x7f21300bb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 0x7f21300bb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33482/0 (socket says 172.21.15.153:33482) 2023-08-17T00:06:50.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 -- 172.21.15.153:0/693697475 learned_addr learned my addr 172.21.15.153:0/693697475 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:50.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2136b46700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21301560f0 0x7f2130164800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2136345700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21300689c0 0x7f21301687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 -- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21301560f0 msgr2=0x7f2130164800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21301560f0 0x7f2130164800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 -- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21300689c0 msgr2=0x7f21301687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21300689c0 0x7f21301687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 -- 172.21.15.153:0/693697475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c009250 con 0x7f2130151530 2023-08-17T00:06:50.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.496+0000 7f2135b44700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 0x7f21300bb920 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f212000c4c0 tx=0x7f2120007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200072e0 con 0x7f2130151530 2023-08-17T00:06:50.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120007440 con 0x7f2130151530 2023-08-17T00:06:50.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2130151e60 con 0x7f2130151530 2023-08-17T00:06:50.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200057a0 con 0x7f2130151530 2023-08-17T00:06:50.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2130152420 con 0x7f2130151530 2023-08-17T00:06:50.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f213006b4c0 con 0x7f2130151530 2023-08-17T00:06:50.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.500+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2120010070 con 0x7f2130151530 2023-08-17T00:06:50.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.504+0000 7f21267fc700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f211405a150 0x7f211405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.504+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2120073750 con 0x7f2130151530 2023-08-17T00:06:50.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.504+0000 7f2136345700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f211405a150 0x7f211405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.504+0000 7f2136345700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f211405a150 0x7f211405c610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f212c009fd0 tx=0x7f212c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.508+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2120047090 con 0x7f2130151530 2023-08-17T00:06:50.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.672+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21300662d0 con 0x7f2130151530 2023-08-17T00:06:50.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.672+0000 7f21267fc700 1 -- 172.21.15.153:0/693697475 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f212004a6b0 con 0x7f2130151530 2023-08-17T00:06:50.679 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:50.680 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":62,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:49.925447+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:06:47.903453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T00:06:48.933074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:50.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f211405a150 msgr2=0x7f211405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f211405a150 0x7f211405c610 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7f212c009fd0 tx=0x7f212c015000).stop 2023-08-17T00:06:50.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 msgr2=0x7f21300bb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 0x7f21300bb920 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f212000c4c0 tx=0x7f2120007dc0).stop 2023-08-17T00:06:50.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 shutdown_connections 2023-08-17T00:06:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f211405a150 0x7f211405c610 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21301560f0 0x7f2130164800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2130151530 0x7f21300bb920 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 --2- 172.21.15.153:0/693697475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21300689c0 0x7f21301687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 >> 172.21.15.153:0/693697475 conn(0x7f21300c6620 msgr2=0x7f21300645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 shutdown_connections 2023-08-17T00:06:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.676+0000 7f2137347700 1 -- 172.21.15.153:0/693697475 wait complete. 2023-08-17T00:06:50.705 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:06:50.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 Processor -- start 2023-08-17T00:06:50.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 -- start start 2023-08-17T00:06:50.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f900acf30 0x7f2f900c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f90063bc0 0x7f2f900bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f90154e90 con 0x7f2f900c5ea0 2023-08-17T00:06:50.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f90153fc0 con 0x7f2f90063bc0 2023-08-17T00:06:50.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.860+0000 7f2f8f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90154280 con 0x7f2f900acf30 2023-08-17T00:06:50.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f90063bc0 0x7f2f900bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2f90063bc0 0x7f2f900bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33484/0 (socket says 172.21.15.153:33484) 2023-08-17T00:06:50.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8dd9b700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2f900c5ea0 0x7f2f900634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:36030/0 (socket says 172.21.15.153:36030) 2023-08-17T00:06:50.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 -- 172.21.15.153:0/1648972094 learned_addr learned my addr 172.21.15.153:0/1648972094 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:50.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8e59c700 1 --2- 172.21.15.153:0/1648972094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f900acf30 0x7f2f900c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 -- 172.21.15.153:0/1648972094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f900acf30 msgr2=0x7f2f900c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:50.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 --2- 172.21.15.153:0/1648972094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f900acf30 0x7f2f900c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 -- 172.21.15.153:0/1648972094 >> v1:172.21.15.178:6789/0 conn(0x7f2f900c5ea0 legacy=0x7f2f900634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 -- 172.21.15.153:0/1648972094 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90154560 con 0x7f2f90063bc0 2023-08-17T00:06:50.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8ed9d700 1 --2- 172.21.15.153:0/1648972094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f90063bc0 0x7f2f900bfad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f2f88009f20 tx=0x7f2f88009840).ready entity=mon.0 client_cookie=2bfe026cb2aae949 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8d59a700 1 -- 172.21.15.153:0/1648972094 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800e070 con 0x7f2f90063bc0 2023-08-17T00:06:50.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8d59a700 1 -- 172.21.15.153:0/1648972094 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8800b9d0 con 0x7f2f90063bc0 2023-08-17T00:06:50.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8d59a700 1 -- 172.21.15.153:0/1648972094 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800bd50 con 0x7f2f90063bc0 2023-08-17T00:06:50.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1648972094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f90063bc0 msgr2=0x7f2f900bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1648972094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f90063bc0 0x7f2f900bfad0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f2f88009f20 tx=0x7f2f88009840).stop 2023-08-17T00:06:50.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1648972094 shutdown_connections 2023-08-17T00:06:50.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1648972094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f90063bc0 0x7f2f900bfad0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1648972094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f900acf30 0x7f2f900c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1648972094 >> 172.21.15.153:0/1648972094 conn(0x7f2f900cb330 msgr2=0x7f2f900c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:50.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1648972094 shutdown_connections 2023-08-17T00:06:50.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.864+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1648972094 wait complete. 2023-08-17T00:06:50.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 Processor -- start 2023-08-17T00:06:50.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 -- start start 2023-08-17T00:06:50.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f90063bc0 0x7f2f90163f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 0x7f2f900aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f90164400 0x7f2f900ab380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f900ab870 con 0x7f2f900acf30 2023-08-17T00:06:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9014c7e0 con 0x7f2f90063bc0 2023-08-17T00:06:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f90164e40 con 0x7f2f90164400 2023-08-17T00:06:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 0x7f2f900aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 0x7f2f900aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33488/0 (socket says 172.21.15.153:33488) 2023-08-17T00:06:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 -- 172.21.15.153:0/1764019093 learned_addr learned my addr 172.21.15.153:0/1764019093 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8e59c700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f90063bc0 0x7f2f90163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 -- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f90164400 msgr2=0x7f2f900ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8ed9d700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f90164400 0x7f2f900ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f90164400 0x7f2f900ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 -- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f90063bc0 msgr2=0x7f2f90163f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f90063bc0 0x7f2f90163f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:50.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 -- 172.21.15.153:0/1764019093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f88009ae0 con 0x7f2f900acf30 2023-08-17T00:06:50.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8e59c700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f90063bc0 0x7f2f90163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:50.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8ed9d700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f90164400 0x7f2f900ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:06:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8dd9b700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 0x7f2f900aae90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f2f8400c470 tx=0x7f2f84007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840072e0 con 0x7f2f900acf30 2023-08-17T00:06:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84007440 con 0x7f2f900acf30 2023-08-17T00:06:50.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840058f0 con 0x7f2f900acf30 2023-08-17T00:06:50.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.868+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f90164880 con 0x7f2f900acf30 2023-08-17T00:06:50.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.872+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f9014ca70 con 0x7f2f900acf30 2023-08-17T00:06:50.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.872+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f9006b4c0 con 0x7f2f900acf30 2023-08-17T00:06:50.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.872+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2f84010070 con 0x7f2f900acf30 2023-08-17T00:06:50.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.876+0000 7f2f7e7fc700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f7005a150 0x7f2f7005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:50.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.876+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2f84073730 con 0x7f2f900acf30 2023-08-17T00:06:50.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.876+0000 7f2f8e59c700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f7005a150 0x7f2f7005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.876+0000 7f2f8e59c700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f7005a150 0x7f2f7005c610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2f80006d80 tx=0x7f2f80008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:50.880+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f840470d0 con 0x7f2f900acf30 2023-08-17T00:06:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.076+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2f90154840 con 0x7f2f900acf30 2023-08-17T00:06:51.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.948+0000 7f2f7e7fc700 1 -- 172.21.15.153:0/1764019093 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2f8404a6f0 con 0x7f2f900acf30 2023-08-17T00:06:51.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f7005a150 msgr2=0x7f2f7005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:51.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f7005a150 0x7f2f7005c610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f2f80006d80 tx=0x7f2f80008040).stop 2023-08-17T00:06:51.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 msgr2=0x7f2f900aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:51.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 0x7f2f900aae90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7f2f8400c470 tx=0x7f2f84007d60).stop 2023-08-17T00:06:51.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 shutdown_connections 2023-08-17T00:06:51.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f7005a150 0x7f2f7005c610 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:51.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f90164400 0x7f2f900ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:51.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f900acf30 0x7f2f900aae90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:51.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 --2- 172.21.15.153:0/1764019093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f90063bc0 0x7f2f90163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:51.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 >> 172.21.15.153:0/1764019093 conn(0x7f2f900cb330 msgr2=0x7f2f900aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:51.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 shutdown_connections 2023-08-17T00:06:51.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:51.952+0000 7f2f8f59e700 1 -- 172.21.15.153:0/1764019093 wait complete. 2023-08-17T00:06:51.979 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:06:51.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:06:52.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.140+0000 7f89e9d07700 1 Processor -- start 2023-08-17T00:06:52.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.140+0000 7f89e9d07700 1 -- start start 2023-08-17T00:06:52.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e9d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 0x7f89e40a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:52.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e9d07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40ab9b0 con 0x7f89e4068f30 2023-08-17T00:06:52.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e9d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40aada0 con 0x7f89e40a8e60 2023-08-17T00:06:52.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e9d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40ab080 con 0x7f89e4150880 2023-08-17T00:06:52.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 0x7f89e40a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:52.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 0x7f89e40a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:39284/0 (socket says 172.21.15.153:39284) 2023-08-17T00:06:52.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 -- 172.21.15.153:0/2654084567 learned_addr learned my addr 172.21.15.153:0/2654084567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:52.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e9506700 1 --1- 172.21.15.153:0/2654084567 >> v1:172.21.15.153:6789/0 conn(0x7f89e4068f30 0x7f89e4064670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46584/0 (socket says 172.21.15.153:46584) 2023-08-17T00:06:52.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 -- 172.21.15.153:0/2654084567 >> v1:172.21.15.178:6789/0 conn(0x7f89e40a8e60 legacy=0x7f89e4068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:52.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 -- 172.21.15.153:0/2654084567 >> v1:172.21.15.153:6789/0 conn(0x7f89e4068f30 legacy=0x7f89e4064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:52.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 -- 172.21.15.153:0/2654084567 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40ab360 con 0x7f89e4150880 2023-08-17T00:06:52.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.144+0000 7f89e8d05700 1 --2- 172.21.15.153:0/2654084567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 0x7f89e40a8970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f89d8009fa0 tx=0x7f89d8009840).ready entity=mon.2 client_cookie=93aca5d808c7db75 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:52.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e37fe700 1 -- 172.21.15.153:0/2654084567 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800e070 con 0x7f89e4150880 2023-08-17T00:06:52.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e37fe700 1 -- 172.21.15.153:0/2654084567 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800bb00 con 0x7f89e4150880 2023-08-17T00:06:52.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e37fe700 1 -- 172.21.15.153:0/2654084567 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800be80 con 0x7f89e4150880 2023-08-17T00:06:52.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 -- 172.21.15.153:0/2654084567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 msgr2=0x7f89e40a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:52.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 --2- 172.21.15.153:0/2654084567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 0x7f89e40a8970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f89d8009fa0 tx=0x7f89d8009840).stop 2023-08-17T00:06:52.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 -- 172.21.15.153:0/2654084567 shutdown_connections 2023-08-17T00:06:52.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 --2- 172.21.15.153:0/2654084567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4150880 0x7f89e40a8970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:52.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 -- 172.21.15.153:0/2654084567 >> 172.21.15.153:0/2654084567 conn(0x7f89e40c6620 msgr2=0x7f89e40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:52.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 -- 172.21.15.153:0/2654084567 shutdown_connections 2023-08-17T00:06:52.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 -- 172.21.15.153:0/2654084567 wait complete. 2023-08-17T00:06:52.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.148+0000 7f89e9d07700 1 Processor -- start 2023-08-17T00:06:52.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 -- start start 2023-08-17T00:06:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068f30 0x7f89e4165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:52.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 0x7f89e40c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:52.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e4150880 0x7f89e41697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:52.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4152f70 con 0x7f89e40a8e60 2023-08-17T00:06:52.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4166000 con 0x7f89e4150880 2023-08-17T00:06:52.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e416c990 con 0x7f89e4068f30 2023-08-17T00:06:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 0x7f89e40c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 0x7f89e40c55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33504/0 (socket says 172.21.15.153:33504) 2023-08-17T00:06:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 -- 172.21.15.153:0/3918829166 learned_addr learned my addr 172.21.15.153:0/3918829166 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e8d05700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068f30 0x7f89e4165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9506700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e4150880 0x7f89e41697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 -- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068f30 msgr2=0x7f89e4165b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068f30 0x7f89e4165b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 -- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e4150880 msgr2=0x7f89e41697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e4150880 0x7f89e41697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 -- 172.21.15.153:0/3918829166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009ae0 con 0x7f89e40a8e60 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9506700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e4150880 0x7f89e41697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e3fff700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 0x7f89e40c55c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f89d000c410 tx=0x7f89d0007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:52.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00123f0 con 0x7f89e40a8e60 2023-08-17T00:06:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d0012550 con 0x7f89e40a8e60 2023-08-17T00:06:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e4150c60 con 0x7f89e40a8e60 2023-08-17T00:06:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00128f0 con 0x7f89e40a8e60 2023-08-17T00:06:52.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e4151220 con 0x7f89e40a8e60 2023-08-17T00:06:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.156+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e4151410 con 0x7f89e40a8e60 2023-08-17T00:06:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.156+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f89d0010070 con 0x7f89e40a8e60 2023-08-17T00:06:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.156+0000 7f89e0ff9700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c805a180 0x7f89c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.156+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f89d0073370 con 0x7f89e40a8e60 2023-08-17T00:06:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.156+0000 7f89e8d05700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c805a180 0x7f89c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.160+0000 7f89e8d05700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c805a180 0x7f89c805c640 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f89e4065a20 tx=0x7f89d8009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:52.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.160+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89d0046e20 con 0x7f89e40a8e60 2023-08-17T00:06:52.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:52.356+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f89e406b4c0 con 0x7f89e40a8e60 2023-08-17T00:06:53.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.148+0000 7f89e0ff9700 1 -- 172.21.15.153:0/3918829166 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f89d004a440 con 0x7f89e40a8e60 2023-08-17T00:06:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c805a180 msgr2=0x7f89c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c805a180 0x7f89c805c640 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f89e4065a20 tx=0x7f89d8009840).stop 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 msgr2=0x7f89e40c55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 0x7f89e40c55c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7f89d000c410 tx=0x7f89d0007d00).stop 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 shutdown_connections 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c805a180 0x7f89c805c640 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e4150880 0x7f89e41697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8e60 0x7f89e40c55c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 --2- 172.21.15.153:0/3918829166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068f30 0x7f89e4165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 >> 172.21.15.153:0/3918829166 conn(0x7f89e40c6620 msgr2=0x7f89e4061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:53.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 shutdown_connections 2023-08-17T00:06:53.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.152+0000 7f89e9d07700 1 -- 172.21.15.153:0/3918829166 wait complete. 2023-08-17T00:06:53.182 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:06:53.183 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:06:53.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 Processor -- start 2023-08-17T00:06:53.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 -- start start 2023-08-17T00:06:53.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb0a81560f0 0x7fb0a80c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a8065da0 con 0x7fb0a8151530 2023-08-17T00:06:53.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a8155c60 con 0x7fb0a81560f0 2023-08-17T00:06:53.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0ac8da700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8156550 con 0x7fb0a80689c0 2023-08-17T00:06:53.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a759e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb0a8151530 0x7fb0a81519e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46588/0 (socket says 172.21.15.153:46588) 2023-08-17T00:06:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a759e700 1 -- 172.21.15.153:0/3264813153 learned_addr learned my addr 172.21.15.153:0/3264813153 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a6d9d700 1 --2- 172.21.15.153:0/3264813153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a659c700 1 --2- 172.21.15.153:0/3264813153 >> v2:172.21.15.178:3300/0 conn(0x7fb0a81560f0 0x7fb0a80c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a5d9b700 1 -- 172.21.15.153:0/3264813153 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666927376 0 0) 0x7fb0a8065da0 con 0x7fb0a8151530 2023-08-17T00:06:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a5d9b700 1 -- 172.21.15.153:0/3264813153 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0900033f0 con 0x7fb0a8151530 2023-08-17T00:06:53.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a6d9d700 1 -- 172.21.15.153:0/3264813153 >> v2:172.21.15.178:3300/0 conn(0x7fb0a81560f0 msgr2=0x7fb0a80c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:53.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a6d9d700 1 --2- 172.21.15.153:0/3264813153 >> v2:172.21.15.178:3300/0 conn(0x7fb0a81560f0 0x7fb0a80c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a6d9d700 1 -- 172.21.15.153:0/3264813153 >> v1:172.21.15.153:6789/0 conn(0x7fb0a8151530 legacy=0x7fb0a81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.348+0000 7fb0a6d9d700 1 -- 172.21.15.153:0/3264813153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8065ff0 con 0x7fb0a80689c0 2023-08-17T00:06:53.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0a6d9d700 1 --2- 172.21.15.153:0/3264813153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8068da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb098009760 tx=0x7fb098006f40).ready entity=mon.2 client_cookie=ee8c6ad0cf439a3e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:53.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0a5d9b700 1 -- 172.21.15.153:0/3264813153 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098005880 con 0x7fb0a80689c0 2023-08-17T00:06:53.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0a5d9b700 1 -- 172.21.15.153:0/3264813153 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0980059e0 con 0x7fb0a80689c0 2023-08-17T00:06:53.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0a5d9b700 1 -- 172.21.15.153:0/3264813153 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098005d60 con 0x7fb0a80689c0 2023-08-17T00:06:53.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 -- 172.21.15.153:0/3264813153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 msgr2=0x7fb0a8068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/3264813153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8068da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fb098009760 tx=0x7fb098006f40).stop 2023-08-17T00:06:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 -- 172.21.15.153:0/3264813153 shutdown_connections 2023-08-17T00:06:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/3264813153 >> v2:172.21.15.178:3300/0 conn(0x7fb0a81560f0 0x7fb0a80c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/3264813153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8068da0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 -- 172.21.15.153:0/3264813153 >> 172.21.15.153:0/3264813153 conn(0x7fb0a80c6620 msgr2=0x7fb0a80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 -- 172.21.15.153:0/3264813153 shutdown_connections 2023-08-17T00:06:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.352+0000 7fb0ac8da700 1 -- 172.21.15.153:0/3264813153 wait complete. 2023-08-17T00:06:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 Processor -- start 2023-08-17T00:06:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 -- start start 2023-08-17T00:06:53.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a8151530 0x7fb0a8145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 0x7fb0a80a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a81423d0 con 0x7fb0a81560f0 2023-08-17T00:06:53.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8143f90 con 0x7fb0a8151530 2023-08-17T00:06:53.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0ac8da700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8144270 con 0x7fb0a80689c0 2023-08-17T00:06:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 0x7fb0a80a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 0x7fb0a80a8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33520/0 (socket says 172.21.15.153:33520) 2023-08-17T00:06:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 -- 172.21.15.153:0/669764607 learned_addr learned my addr 172.21.15.153:0/669764607 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a659c700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a8151530 0x7fb0a8145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a6d9d700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 -- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 msgr2=0x7fb0a8145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8145030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 -- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a8151530 msgr2=0x7fb0a8145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a8151530 0x7fb0a8145520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.356+0000 7fb0a759e700 1 -- 172.21.15.153:0/669764607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009250 con 0x7fb0a81560f0 2023-08-17T00:06:53.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb0a759e700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 0x7fb0a80a8590 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb0a0005ad0 tx=0x7fb0a0001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0005d30 con 0x7fb0a81560f0 2023-08-17T00:06:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0005e90 con 0x7fb0a81560f0 2023-08-17T00:06:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a8144550 con 0x7fb0a81560f0 2023-08-17T00:06:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0007320 con 0x7fb0a81560f0 2023-08-17T00:06:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a8144b10 con 0x7fb0a81560f0 2023-08-17T00:06:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a8144d00 con 0x7fb0a81560f0 2023-08-17T00:06:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.360+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb0a0010030 con 0x7fb0a81560f0 2023-08-17T00:06:53.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.364+0000 7fb08effd700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.364+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb0a0073f90 con 0x7fb0a81560f0 2023-08-17T00:06:53.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.364+0000 7fb0a6d9d700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.364+0000 7fb0a6d9d700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb098006fa0 tx=0x7fb098015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:53.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.368+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb0a00479c0 con 0x7fb0a81560f0 2023-08-17T00:06:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.564+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0a80662d0 con 0x7fb0a81560f0 2023-08-17T00:06:53.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.564+0000 7fb08effd700 1 -- 172.21.15.153:0/669764607 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fb0a004afe0 con 0x7fb0a81560f0 2023-08-17T00:06:53.570 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:53.571 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":49,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5504,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4267159718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4267159718},{"type":"v1","addr":"172.21.15.178:6835","nonce":4267159718}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3471728406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3471728406},{"type":"v1","addr":"172.21.15.178:6837","nonce":3471728406}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5513,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3615703685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3615703685},{"type":"v1","addr":"172.21.15.153:6835","nonce":3615703685}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:06:53.146605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6219":{"gid":6219,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6834/1621445932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1621445932},{"type":"v1","addr":"172.21.15.153:6834","nonce":1621445932}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:06:53.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 msgr2=0x7fb09405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7fb098006fa0 tx=0x7fb098015000).stop 2023-08-17T00:06:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 msgr2=0x7fb0a80a8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 0x7fb0a80a8590 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb0a0005ad0 tx=0x7fb0a0001650).stop 2023-08-17T00:06:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 shutdown_connections 2023-08-17T00:06:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a81560f0 0x7fb0a80a8590 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a8151530 0x7fb0a8145520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 --2- 172.21.15.153:0/669764607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80689c0 0x7fb0a8145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 >> 172.21.15.153:0/669764607 conn(0x7fb0a80c6620 msgr2=0x7fb0a8150cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 shutdown_connections 2023-08-17T00:06:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.568+0000 7fb0ac8da700 1 -- 172.21.15.153:0/669764607 wait complete. 2023-08-17T00:06:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 49 2023-08-17T00:06:53.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:06:53.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 Processor -- start 2023-08-17T00:06:53.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 -- start start 2023-08-17T00:06:53.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa981560f0 0x7ffa980c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa98151530 0x7ffa981519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98065da0 con 0x7ffa981560f0 2023-08-17T00:06:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98155c60 con 0x7ffa98151530 2023-08-17T00:06:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa9759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98156550 con 0x7ffa980689c0 2023-08-17T00:06:53.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.748+0000 7ffa8ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa981560f0 0x7ffa980c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa981560f0 0x7ffa980c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33532/0 (socket says 172.21.15.153:33532) 2023-08-17T00:06:53.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa96d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa98151530 0x7ffa981519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 -- 172.21.15.153:0/453371066 learned_addr learned my addr 172.21.15.153:0/453371066 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:53.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9659c700 1 --2- 172.21.15.153:0/453371066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 -- 172.21.15.153:0/453371066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 msgr2=0x7ffa98068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 --2- 172.21.15.153:0/453371066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 -- 172.21.15.153:0/453371066 >> v2:172.21.15.178:3300/0 conn(0x7ffa98151530 msgr2=0x7ffa981519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 --2- 172.21.15.153:0/453371066 >> v2:172.21.15.178:3300/0 conn(0x7ffa98151530 0x7ffa981519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 -- 172.21.15.153:0/453371066 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98065ff0 con 0x7ffa981560f0 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa96d9d700 1 --2- 172.21.15.153:0/453371066 >> v2:172.21.15.178:3300/0 conn(0x7ffa98151530 0x7ffa981519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:53.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa8ffff700 1 --2- 172.21.15.153:0/453371066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa980c0270 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ffa80006fd0 tx=0x7ffa800090f0).ready entity=mon.0 client_cookie=b92eddc5830af6bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa95d9b700 1 -- 172.21.15.153:0/453371066 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000f510 con 0x7ffa981560f0 2023-08-17T00:06:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa95d9b700 1 -- 172.21.15.153:0/453371066 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000f670 con 0x7ffa981560f0 2023-08-17T00:06:53.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa95d9b700 1 -- 172.21.15.153:0/453371066 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000f9f0 con 0x7ffa981560f0 2023-08-17T00:06:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 -- 172.21.15.153:0/453371066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 msgr2=0x7ffa980c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 --2- 172.21.15.153:0/453371066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa980c0270 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 rx=0x7ffa80006fd0 tx=0x7ffa800090f0).stop 2023-08-17T00:06:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 -- 172.21.15.153:0/453371066 shutdown_connections 2023-08-17T00:06:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 --2- 172.21.15.153:0/453371066 >> v2:172.21.15.178:3300/0 conn(0x7ffa98151530 0x7ffa981519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 --2- 172.21.15.153:0/453371066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa980c0270 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 --2- 172.21.15.153:0/453371066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 -- 172.21.15.153:0/453371066 >> 172.21.15.153:0/453371066 conn(0x7ffa980c6620 msgr2=0x7ffa980c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 -- 172.21.15.153:0/453371066 shutdown_connections 2023-08-17T00:06:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.752+0000 7ffa9759e700 1 -- 172.21.15.153:0/453371066 wait complete. 2023-08-17T00:06:53.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 Processor -- start 2023-08-17T00:06:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 -- start start 2023-08-17T00:06:53.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98151530 0x7ffa98150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa98150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980bb970 con 0x7ffa981560f0 2023-08-17T00:06:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa98151160 con 0x7ffa98151530 2023-08-17T00:06:53.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.756+0000 7ffa9759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980bbbc0 con 0x7ffa980689c0 2023-08-17T00:06:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa98150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa98150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33534/0 (socket says 172.21.15.153:33534) 2023-08-17T00:06:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 -- 172.21.15.153:0/1485186935 learned_addr learned my addr 172.21.15.153:0/1485186935 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa9659c700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa8ffff700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98151530 0x7ffa98150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 -- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 msgr2=0x7ffa98152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 -- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98151530 msgr2=0x7ffa98150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98151530 0x7ffa98150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 -- 172.21.15.153:0/1485186935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa90009a20 con 0x7ffa981560f0 2023-08-17T00:06:53.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa96d9d700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa98150320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7ffa90009fc0 tx=0x7ffa9000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000cc80 con 0x7ffa981560f0 2023-08-17T00:06:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000f040 con 0x7ffa981560f0 2023-08-17T00:06:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80009370 con 0x7ffa981560f0 2023-08-17T00:06:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90013400 con 0x7ffa981560f0 2023-08-17T00:06:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa980bc180 con 0x7ffa981560f0 2023-08-17T00:06:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.760+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa980bc980 con 0x7ffa981560f0 2023-08-17T00:06:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.764+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ffa900137f0 con 0x7ffa981560f0 2023-08-17T00:06:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.764+0000 7ffa8e7fc700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa7805a150 0x7ffa7805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.764+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa90074bd0 con 0x7ffa981560f0 2023-08-17T00:06:53.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.764+0000 7ffa9659c700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa7805a150 0x7ffa7805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:53.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.764+0000 7ffa9659c700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa7805a150 0x7ffa7805c610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ffa88006fd0 tx=0x7ffa88006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:53.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.772+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa90048680 con 0x7ffa981560f0 2023-08-17T00:06:53.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.932+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa9806b520 con 0x7ffa981560f0 2023-08-17T00:06:53.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa8e7fc700 1 -- 172.21.15.153:0/1485186935 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16978 (secure 0 0 0) 0x7ffa9004bca0 con 0x7ffa981560f0 2023-08-17T00:06:53.940 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:53.940 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":63,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:06:50.930160+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:06:47.903453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T00:06:48.933074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:06:53.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa7805a150 msgr2=0x7ffa7805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa7805a150 0x7ffa7805c610 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7ffa88006fd0 tx=0x7ffa88006f40).stop 2023-08-17T00:06:53.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 msgr2=0x7ffa98150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:53.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa98150320 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7ffa90009fc0 tx=0x7ffa9000b040).stop 2023-08-17T00:06:53.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 shutdown_connections 2023-08-17T00:06:53.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa7805a150 0x7ffa7805c610 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa981560f0 0x7ffa98150320 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa98151530 0x7ffa98150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 --2- 172.21.15.153:0/1485186935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa980689c0 0x7ffa98152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:53.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 >> 172.21.15.153:0/1485186935 conn(0x7ffa980c6620 msgr2=0x7ffa980bdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:53.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 shutdown_connections 2023-08-17T00:06:53.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:53.936+0000 7ffa9759e700 1 -- 172.21.15.153:0/1485186935 wait complete. 2023-08-17T00:06:53.962 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:06:53.962 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:54.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.112+0000 7feeb9c79700 1 Processor -- start 2023-08-17T00:06:54.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.112+0000 7feeb9c79700 1 -- start start 2023-08-17T00:06:54.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.112+0000 7feeb9c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4068da0 0x7feeb41560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.112+0000 7feeb9c79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb4065da0 con 0x7feeb40689c0 2023-08-17T00:06:54.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.112+0000 7feeb9c79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb4155c60 con 0x7feeb4151530 2023-08-17T00:06:54.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.112+0000 7feeb9c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4069200 con 0x7feeb4068da0 2023-08-17T00:06:54.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeb8c77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feeb40689c0 0x7feeb40c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46600/0 (socket says 172.21.15.153:46600) 2023-08-17T00:06:54.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeb8c77700 1 -- 172.21.15.153:0/719847344 learned_addr learned my addr 172.21.15.153:0/719847344 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:54.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeabfff700 1 --2- 172.21.15.153:0/719847344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4068da0 0x7feeb41560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968835988 0 0) 0x7feeb4065da0 con 0x7feeb40689c0 2023-08-17T00:06:54.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c0033f0 con 0x7feeb40689c0 2023-08-17T00:06:54.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420016740 0 0) 0x7feeb4155c60 con 0x7feeb4151530 2023-08-17T00:06:54.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb4065da0 con 0x7feeb4151530 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeabfff700 1 -- 172.21.15.153:0/719847344 >> v1:172.21.15.178:6789/0 conn(0x7feeb4151530 legacy=0x7feeb41519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeabfff700 1 -- 172.21.15.153:0/719847344 >> v1:172.21.15.153:6789/0 conn(0x7feeb40689c0 legacy=0x7feeb40c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeabfff700 1 -- 172.21.15.153:0/719847344 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4065ff0 con 0x7feeb4068da0 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeabfff700 1 --2- 172.21.15.153:0/719847344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4068da0 0x7feeb41560f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7feea4009790 tx=0x7feea4009060).ready entity=mon.2 client_cookie=9d3daad1023ec03f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea40090d0 con 0x7feeb4068da0 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400f510 con 0x7feeb4068da0 2023-08-17T00:06:54.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeab7fe700 1 -- 172.21.15.153:0/719847344 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400f890 con 0x7feeb4068da0 2023-08-17T00:06:54.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeb9c79700 1 -- 172.21.15.153:0/719847344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4068da0 msgr2=0x7feeb41560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.116+0000 7feeb9c79700 1 --2- 172.21.15.153:0/719847344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4068da0 0x7feeb41560f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7feea4009790 tx=0x7feea4009060).stop 2023-08-17T00:06:54.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.120+0000 7feeb9c79700 1 -- 172.21.15.153:0/719847344 shutdown_connections 2023-08-17T00:06:54.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.120+0000 7feeb9c79700 1 --2- 172.21.15.153:0/719847344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4068da0 0x7feeb41560f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.120+0000 7feeb9c79700 1 -- 172.21.15.153:0/719847344 >> 172.21.15.153:0/719847344 conn(0x7feeb40c6620 msgr2=0x7feeb40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:54.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.120+0000 7feeb9c79700 1 -- 172.21.15.153:0/719847344 shutdown_connections 2023-08-17T00:06:54.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.120+0000 7feeb9c79700 1 -- 172.21.15.153:0/719847344 wait complete. 2023-08-17T00:06:54.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.120+0000 7feeb9c79700 1 Processor -- start 2023-08-17T00:06:54.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 -- start start 2023-08-17T00:06:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 0x7feeb4154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeb4068da0 0x7feeb4154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4151530 0x7feeb4162320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4154c40 con 0x7feeb40689c0 2023-08-17T00:06:54.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb4163460 con 0x7feeb4068da0 2023-08-17T00:06:54.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb40bcab0 con 0x7feeb4151530 2023-08-17T00:06:54.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 0x7feeb4154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 0x7feeb4154260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33542/0 (socket says 172.21.15.153:33542) 2023-08-17T00:06:54.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 -- 172.21.15.153:0/3684833718 learned_addr learned my addr 172.21.15.153:0/3684833718 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:54.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeabfff700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeb4068da0 0x7feeb4154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb9478700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4151530 0x7feeb4162320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 -- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4151530 msgr2=0x7feeb4162320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4151530 0x7feeb4162320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 -- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeb4068da0 msgr2=0x7feeb4154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeb4068da0 0x7feeb4154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeb8c77700 1 -- 172.21.15.153:0/3684833718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea40092a0 con 0x7feeb40689c0 2023-08-17T00:06:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.124+0000 7feeabfff700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeb4068da0 0x7feeb4154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:06:54.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feeb8c77700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 0x7feeb4154260 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7feeb000c790 tx=0x7feeb0007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00070d0 con 0x7feeb40689c0 2023-08-17T00:06:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0007230 con 0x7feeb40689c0 2023-08-17T00:06:54.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb40bcd50 con 0x7feeb40689c0 2023-08-17T00:06:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb0005670 con 0x7feeb40689c0 2023-08-17T00:06:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb40a03c0 con 0x7feeb40689c0 2023-08-17T00:06:54.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.128+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb4156500 con 0x7feeb40689c0 2023-08-17T00:06:54.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.132+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7feeb0010070 con 0x7feeb40689c0 2023-08-17T00:06:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.132+0000 7feea8ff9700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea005a150 0x7feea005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.132+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7feeb0073880 con 0x7feeb40689c0 2023-08-17T00:06:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.132+0000 7feeabfff700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea005a150 0x7feea005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.132+0000 7feeabfff700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea005a150 0x7feea005c610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7feea4009fd0 tx=0x7feea4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.136+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feeb0047220 con 0x7feeb40689c0 2023-08-17T00:06:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.296+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feeb4063750 con 0x7feea005a150 2023-08-17T00:06:54.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.316+0000 7feea8ff9700 1 -- 172.21.15.153:0/3684833718 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+351770 (secure 0 0 0) 0x7feeb4063750 con 0x7feea005a150 2023-08-17T00:06:54.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea005a150 msgr2=0x7feea005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea005a150 0x7feea005c610 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7feea4009fd0 tx=0x7feea4017000).stop 2023-08-17T00:06:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 msgr2=0x7feeb4154260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 0x7feeb4154260 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7feeb000c790 tx=0x7feeb0007b60).stop 2023-08-17T00:06:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 shutdown_connections 2023-08-17T00:06:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feea005a150 0x7feea005c610 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feeb4151530 0x7feeb4162320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feeb4068da0 0x7feeb4154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 --2- 172.21.15.153:0/3684833718 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feeb40689c0 0x7feeb4154260 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 >> 172.21.15.153:0/3684833718 conn(0x7feeb40c6620 msgr2=0x7feeb40a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 shutdown_connections 2023-08-17T00:06:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.324+0000 7feeb9c79700 1 -- 172.21.15.153:0/3684833718 wait complete. 2023-08-17T00:06:54.330 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:54.349 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-08-17T00:06:53.259537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460228,"kb_used_data":5636,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752514492,"statfs":{"total":773094113280,"available":770574839808,"internally_reserved":0,"allocated":5771264,"data_stored":2556186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17888889,"num_objects":-2145,"num_object_clones":0,"num_object_copies":-4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2145,"num_whiteouts":0,"num_read":-138,"num_read_kb":-7408,"num_write":-7341,"num_write_kb":-24447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.161246"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478146+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479011+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484049+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478989+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.476896+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478406+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479908+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474638+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485607+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477685+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934218+0000","last_change":"2023-08-17T00:06:49.516163+0000","last_active":"2023-08-17T00:06:49.934218+0000","last_peered":"2023-08-17T00:06:49.934218+0000","last_clean":"2023-08-17T00:06:49.934218+0000","last_became_active":"2023-08-17T00:06:49.515816+0000","last_became_peered":"2023-08-17T00:06:49.515816+0000","last_unstale":"2023-08-17T00:06:49.934218+0000","last_undegraded":"2023-08-17T00:06:49.934218+0000","last_fullsized":"2023-08-17T00:06:49.934218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485017+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.482822+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483679+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481068+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.476867+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959636+0000","last_change":"2023-08-17T00:06:49.947233+0000","last_active":"2023-08-17T00:06:49.959636+0000","last_peered":"2023-08-17T00:06:49.959636+0000","last_clean":"2023-08-17T00:06:49.959636+0000","last_became_active":"2023-08-17T00:06:49.946953+0000","last_became_peered":"2023-08-17T00:06:49.946953+0000","last_unstale":"2023-08-17T00:06:49.959636+0000","last_undegraded":"2023-08-17T00:06:49.959636+0000","last_fullsized":"2023-08-17T00:06:49.959636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477614+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485758+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481553+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961118+0000","last_change":"2023-08-17T00:06:49.953511+0000","last_active":"2023-08-17T00:06:49.961118+0000","last_peered":"2023-08-17T00:06:49.961118+0000","last_clean":"2023-08-17T00:06:49.961118+0000","last_became_active":"2023-08-17T00:06:49.953191+0000","last_became_peered":"2023-08-17T00:06:49.953191+0000","last_unstale":"2023-08-17T00:06:49.961118+0000","last_undegraded":"2023-08-17T00:06:49.961118+0000","last_fullsized":"2023-08-17T00:06:49.961118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934363+0000","last_change":"2023-08-17T00:06:49.509940+0000","last_active":"2023-08-17T00:06:49.934363+0000","last_peered":"2023-08-17T00:06:49.934363+0000","last_clean":"2023-08-17T00:06:49.934363+0000","last_became_active":"2023-08-17T00:06:49.508703+0000","last_became_peered":"2023-08-17T00:06:49.508703+0000","last_unstale":"2023-08-17T00:06:49.934363+0000","last_undegraded":"2023-08-17T00:06:49.934363+0000","last_fullsized":"2023-08-17T00:06:49.934363+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.482151+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934282+0000","last_change":"2023-08-17T00:06:49.508382+0000","last_active":"2023-08-17T00:06:49.934282+0000","last_peered":"2023-08-17T00:06:49.934282+0000","last_clean":"2023-08-17T00:06:49.934282+0000","last_became_active":"2023-08-17T00:06:49.508065+0000","last_became_peered":"2023-08-17T00:06:49.508065+0000","last_unstale":"2023-08-17T00:06:49.934282+0000","last_undegraded":"2023-08-17T00:06:49.934282+0000","last_fullsized":"2023-08-17T00:06:49.934282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479129+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485931+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479546+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481801+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480119+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473315+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474842+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478825+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480178+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933686+0000","last_change":"2023-08-17T00:06:49.508705+0000","last_active":"2023-08-17T00:06:49.933686+0000","last_peered":"2023-08-17T00:06:49.933686+0000","last_clean":"2023-08-17T00:06:49.933686+0000","last_became_active":"2023-08-17T00:06:49.508086+0000","last_became_peered":"2023-08-17T00:06:49.508086+0000","last_unstale":"2023-08-17T00:06:49.933686+0000","last_undegraded":"2023-08-17T00:06:49.933686+0000","last_fullsized":"2023-08-17T00:06:49.933686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477036+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477210+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478599+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474764+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959333+0000","last_change":"2023-08-17T00:06:49.946510+0000","last_active":"2023-08-17T00:06:49.959333+0000","last_peered":"2023-08-17T00:06:49.959333+0000","last_clean":"2023-08-17T00:06:49.959333+0000","last_became_active":"2023-08-17T00:06:49.946225+0000","last_became_peered":"2023-08-17T00:06:49.946225+0000","last_unstale":"2023-08-17T00:06:49.959333+0000","last_undegraded":"2023-08-17T00:06:49.959333+0000","last_fullsized":"2023-08-17T00:06:49.959333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935353+0000","last_change":"2023-08-17T00:06:49.508617+0000","last_active":"2023-08-17T00:06:49.935353+0000","last_peered":"2023-08-17T00:06:49.935353+0000","last_clean":"2023-08-17T00:06:49.935353+0000","last_became_active":"2023-08-17T00:06:49.508330+0000","last_became_peered":"2023-08-17T00:06:49.508330+0000","last_unstale":"2023-08-17T00:06:49.935353+0000","last_undegraded":"2023-08-17T00:06:49.935353+0000","last_fullsized":"2023-08-17T00:06:49.935353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473269+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477017+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961151+0000","last_change":"2023-08-17T00:06:49.953751+0000","last_active":"2023-08-17T00:06:49.961151+0000","last_peered":"2023-08-17T00:06:49.961151+0000","last_clean":"2023-08-17T00:06:49.961151+0000","last_became_active":"2023-08-17T00:06:49.953400+0000","last_became_peered":"2023-08-17T00:06:49.953400+0000","last_unstale":"2023-08-17T00:06:49.961151+0000","last_undegraded":"2023-08-17T00:06:49.961151+0000","last_fullsized":"2023-08-17T00:06:49.961151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483031+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484729+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959677+0000","last_change":"2023-08-17T00:06:49.948293+0000","last_active":"2023-08-17T00:06:49.959677+0000","last_peered":"2023-08-17T00:06:49.959677+0000","last_clean":"2023-08-17T00:06:49.959677+0000","last_became_active":"2023-08-17T00:06:49.947961+0000","last_became_peered":"2023-08-17T00:06:49.947961+0000","last_unstale":"2023-08-17T00:06:49.959677+0000","last_undegraded":"2023-08-17T00:06:49.959677+0000","last_fullsized":"2023-08-17T00:06:49.959677+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481104+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478735+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474178+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483295+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.486629+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477829+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485517+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959773+0000","last_change":"2023-08-17T00:06:49.948378+0000","last_active":"2023-08-17T00:06:49.959773+0000","last_peered":"2023-08-17T00:06:49.959773+0000","last_clean":"2023-08-17T00:06:49.959773+0000","last_became_active":"2023-08-17T00:06:49.948039+0000","last_became_peered":"2023-08-17T00:06:49.948039+0000","last_unstale":"2023-08-17T00:06:49.959773+0000","last_undegraded":"2023-08-17T00:06:49.959773+0000","last_fullsized":"2023-08-17T00:06:49.959773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483805+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959770+0000","last_change":"2023-08-17T00:06:49.951952+0000","last_active":"2023-08-17T00:06:49.959770+0000","last_peered":"2023-08-17T00:06:49.959770+0000","last_clean":"2023-08-17T00:06:49.959770+0000","last_became_active":"2023-08-17T00:06:49.951497+0000","last_became_peered":"2023-08-17T00:06:49.951497+0000","last_unstale":"2023-08-17T00:06:49.959770+0000","last_undegraded":"2023-08-17T00:06:49.959770+0000","last_fullsized":"2023-08-17T00:06:49.959770+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484895+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474102+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479868+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481324+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477868+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479705+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961175+0000","last_change":"2023-08-17T00:06:49.954094+0000","last_active":"2023-08-17T00:06:49.961175+0000","last_peered":"2023-08-17T00:06:49.961175+0000","last_clean":"2023-08-17T00:06:49.961175+0000","last_became_active":"2023-08-17T00:06:49.953043+0000","last_became_peered":"2023-08-17T00:06:49.953043+0000","last_unstale":"2023-08-17T00:06:49.961175+0000","last_undegraded":"2023-08-17T00:06:49.961175+0000","last_fullsized":"2023-08-17T00:06:49.961175+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473970+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480341+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731742+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:06:45.731742+0000","last_peered":"2023-08-17T00:06:45.731742+0000","last_clean":"2023-08-17T00:06:45.731742+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:06:45.731742+0000","last_undegraded":"2023-08-17T00:06:45.731742+0000","last_fullsized":"2023-08-17T00:06:45.731742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477840+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933933+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:49.933933+0000","last_peered":"2023-08-17T00:06:49.933933+0000","last_clean":"2023-08-17T00:06:49.933933+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:49.933933+0000","last_undegraded":"2023-08-17T00:06:49.933933+0000","last_fullsized":"2023-08-17T00:06:49.933933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485323+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731830+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:06:45.731830+0000","last_peered":"2023-08-17T00:06:45.731830+0000","last_clean":"2023-08-17T00:06:45.731830+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:06:45.731830+0000","last_undegraded":"2023-08-17T00:06:45.731830+0000","last_fullsized":"2023-08-17T00:06:45.731830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484251+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.577564+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:06:45.577564+0000","last_peered":"2023-08-17T00:06:45.577564+0000","last_clean":"2023-08-17T00:06:45.577564+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:06:45.577564+0000","last_undegraded":"2023-08-17T00:06:45.577564+0000","last_fullsized":"2023-08-17T00:06:45.577564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473518+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731796+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:06:45.731796+0000","last_peered":"2023-08-17T00:06:45.731796+0000","last_clean":"2023-08-17T00:06:45.731796+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:06:45.731796+0000","last_undegraded":"2023-08-17T00:06:45.731796+0000","last_fullsized":"2023-08-17T00:06:45.731796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.486226+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.730617+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:06:45.730617+0000","last_peered":"2023-08-17T00:06:45.730617+0000","last_clean":"2023-08-17T00:06:45.730617+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:06:45.730617+0000","last_undegraded":"2023-08-17T00:06:45.730617+0000","last_fullsized":"2023-08-17T00:06:45.730617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474365+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731683+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:06:45.731683+0000","last_peered":"2023-08-17T00:06:45.731683+0000","last_clean":"2023-08-17T00:06:45.731683+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:06:45.731683+0000","last_undegraded":"2023-08-17T00:06:45.731683+0000","last_fullsized":"2023-08-17T00:06:45.731683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473191+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731679+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:06:45.731679+0000","last_peered":"2023-08-17T00:06:45.731679+0000","last_clean":"2023-08-17T00:06:45.731679+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:06:45.731679+0000","last_undegraded":"2023-08-17T00:06:45.731679+0000","last_fullsized":"2023-08-17T00:06:45.731679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.733020+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:06:45.733020+0000","last_peered":"2023-08-17T00:06:45.733020+0000","last_clean":"2023-08-17T00:06:45.733020+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:06:45.733020+0000","last_undegraded":"2023-08-17T00:06:45.733020+0000","last_fullsized":"2023-08-17T00:06:45.733020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.306,"15min":1.4350000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.909,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.337,"15min":1.4890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4710000000000001,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":1.1619999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.353,"15min":1.5009999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":0.747},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.345,"15min":1.4890000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4299999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.2529999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.236,"15min":1.3460000000000001},"min":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3400000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":0.876},{"interface":"front","average":{"1min":1.147,"5min":1.395,"15min":1.5149999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8120000000000001,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2849999999999999,"15min":1.373},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.357,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.6220000000000001,"15min":1.788},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.958,"5min":13.074999999999999,"15min":13.074999999999999},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.5720000000000001,"15min":1.778},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6419999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.4870000000000001,"15min":1.6259999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4470000000000001,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.716,"15min":1.9199999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.012,"5min":14.435,"15min":14.435},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.6699999999999999,"15min":1.8520000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6779999999999999,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.363}]},{"osd":6,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.6890000000000001,"15min":1.8540000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.7649999999999999,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.6140000000000001,"15min":1.754},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.706,"5min":11.365,"15min":11.365},"last":1.0649999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314180,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057660,"statfs":{"total":96636764160,"available":96315043840,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0389999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.6509999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.026},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.089,"15min":1.077},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.99399999999999999,"15min":0.97199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.2559999999999998,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":1.115},{"interface":"front","average":{"1min":1.284,"5min":1.2290000000000001,"15min":1.244},"min":{"1min":0.873,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.151}]},{"osd":3,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.145,"15min":1.137},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.304,"15min":1.276},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.4409999999999998,"5min":5.29,"15min":5.29},"last":1.175}]},{"osd":4,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2410000000000001,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2989999999999999,"15min":1.27},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.3599999999999999,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":1.248},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.228}]},{"osd":7,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3009999999999999,"15min":1.2989999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":4.6429999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4570000000000001,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.8999999999999999,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.552}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.468,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2410000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.6379999999999999,"15min":1.9119999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4670000000000001,"5min":16.838999999999999,"15min":16.838999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2110000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.494,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.4159999999999999,"15min":1.5760000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.462,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":1.014}]},{"osd":2,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.6619999999999999,"15min":1.9179999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4179999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.516,"15min":1.7},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.367,"5min":11.949,"15min":11.949},"last":1.109}]},{"osd":3,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.5649999999999999,"15min":1.754},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.575,"5min":13.125,"15min":13.125},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.4630000000000001,"15min":1.6060000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.177}]},{"osd":4,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.734,"15min":1.98},"min":{"1min":0.877,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.591,"5min":17.510000000000002,"15min":17.510000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.8819999999999999,"15min":2.1680000000000001},"min":{"1min":0.92500000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.8280000000000001,"15min":2.0899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.7350000000000001,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.825,"15min":2.0840000000000001},"min":{"1min":0.79400000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":17.050000000000001,"15min":17.050000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.966,"15min":2.2250000000000001},"min":{"1min":1.0089999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.2599999999999998,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.861,"15min":2.0710000000000002},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8120000000000001,"5min":14.818,"15min":14.818},"last":1.0489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":1.163},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.304},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.282}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.464},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.5960000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.373}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5660000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310084,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061756,"statfs":{"total":96636764160,"available":96319238144,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.91600000000000004},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1439999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.827,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2549999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0840000000000001,"15min":1.149},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9159999999999999,"5min":3.911,"15min":3.911},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.3080000000000001},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9530000000000001,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.03,"15min":1.0800000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.2530000000000001,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.7290000000000001,"15min":2.04},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6739999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.5509999999999999,"15min":1.7330000000000001},"min":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.0649999999999999,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.159}]},{"osd":5,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.681,"15min":1.889},"min":{"1min":0.748,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1440000000000001,"5min":12.914,"15min":12.914},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4910000000000001,"15min":1.645},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.4199999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.6419999999999999,"15min":1.861},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7689999999999999,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.373},{"interface":"front","average":{"1min":1.276,"5min":1.6830000000000001,"15min":1.899},"min":{"1min":0.86199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.2210000000000001,"5min":12.698,"15min":12.698},"last":1.212}]},{"osd":7,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.6479999999999999,"15min":1.8240000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.72,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.651,"15min":1.8340000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.956,"5min":11.417,"15min":11.417},"last":1.456}]}]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.496,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2110000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":1},{"interface":"front","average":{"1min":0.878,"5min":0.97599999999999998,"15min":0.92200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4359999999999999,"5min":13.093,"15min":13.093},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.91500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1639999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.353,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.054,"15min":1.0289999999999999},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.234,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2969999999999999,"15min":1.2},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.222,"5min":20.548999999999999,"15min":20.548999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.272,"15min":1.258},"min":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.492,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.087}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.4239999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.4810000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.294},{"interface":"front","average":{"1min":1.194,"5min":1.294,"15min":1.3069999999999999},"min":{"1min":0.82599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.446,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.288}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3400000000000001,"15min":1.302},"min":{"1min":0.84599999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.4830000000000001,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.24,"15min":1.2350000000000001},"min":{"1min":0.77900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4490000000000001,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5580000000000001,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.4359999999999999,"15min":1.4199999999999999},"min":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.492,"5min":13.131,"15min":13.131},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":1.3759999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.089},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.4099999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.446},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.294},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":753664,"data_stored":337515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.27},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.036}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.129},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":0.995},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.214}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.355},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.341}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.242},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:54.358 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 Processor -- start 2023-08-17T00:06:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 -- start start 2023-08-17T00:06:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0151b90 0x7fbfb0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbfb0063290 0x7fbfb0065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbfb0065b50 0x7fbfb0064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb00c3fb0 con 0x7fbfb0063290 2023-08-17T00:06:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb0152460 con 0x7fbfb0065b50 2023-08-17T00:06:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb729b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0061fa0 con 0x7fbfb0151b90 2023-08-17T00:06:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb4836700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbfb0063290 0x7fbfb0065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb4836700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbfb0063290 0x7fbfb0065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33556/0 (socket says 172.21.15.153:33556) 2023-08-17T00:06:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb4836700 1 -- 172.21.15.153:0/787000915 learned_addr learned my addr 172.21.15.153:0/787000915 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb5037700 1 --2- 172.21.15.153:0/787000915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0151b90 0x7fbfb0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb5838700 1 --2- 172.21.15.153:0/787000915 >> v2:172.21.15.178:3300/0 conn(0x7fbfb0065b50 0x7fbfb0064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.552+0000 7fbfb4836700 1 -- 172.21.15.153:0/787000915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0151b90 msgr2=0x7fbfb0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb4836700 1 --2- 172.21.15.153:0/787000915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0151b90 0x7fbfb0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb4836700 1 -- 172.21.15.153:0/787000915 >> v2:172.21.15.178:3300/0 conn(0x7fbfb0065b50 msgr2=0x7fbfb0064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb4836700 1 --2- 172.21.15.153:0/787000915 >> v2:172.21.15.178:3300/0 conn(0x7fbfb0065b50 0x7fbfb0064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb4836700 1 -- 172.21.15.153:0/787000915 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00621f0 con 0x7fbfb0063290 2023-08-17T00:06:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb5838700 1 --2- 172.21.15.153:0/787000915 >> v2:172.21.15.178:3300/0 conn(0x7fbfb0065b50 0x7fbfb0064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb4836700 1 --2- 172.21.15.153:0/787000915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0065660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fbfb00a9df0 tx=0x7fbfa00090f0).ready entity=mon.0 client_cookie=f7bed6d0c51adbad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfa7fff700 1 -- 172.21.15.153:0/787000915 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000b520 con 0x7fbfb0063290 2023-08-17T00:06:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfa7fff700 1 -- 172.21.15.153:0/787000915 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa000b680 con 0x7fbfb0063290 2023-08-17T00:06:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfa7fff700 1 -- 172.21.15.153:0/787000915 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa000ba00 con 0x7fbfb0063290 2023-08-17T00:06:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 -- 172.21.15.153:0/787000915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 msgr2=0x7fbfb0065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 --2- 172.21.15.153:0/787000915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0065660 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7fbfb00a9df0 tx=0x7fbfa00090f0).stop 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 -- 172.21.15.153:0/787000915 shutdown_connections 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 --2- 172.21.15.153:0/787000915 >> v2:172.21.15.178:3300/0 conn(0x7fbfb0065b50 0x7fbfb0064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 --2- 172.21.15.153:0/787000915 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0065660 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 --2- 172.21.15.153:0/787000915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0151b90 0x7fbfb0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 -- 172.21.15.153:0/787000915 >> 172.21.15.153:0/787000915 conn(0x7fbfb00c7150 msgr2=0x7fbfb00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 -- 172.21.15.153:0/787000915 shutdown_connections 2023-08-17T00:06:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.556+0000 7fbfb729b700 1 -- 172.21.15.153:0/787000915 wait complete. 2023-08-17T00:06:54.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 Processor -- start 2023-08-17T00:06:54.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 -- start start 2023-08-17T00:06:54.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0065b50 0x7fbfb0153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfb0151b90 0x7fbfb01479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01545e0 con 0x7fbfb0063290 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0147ea0 con 0x7fbfb0151b90 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01539d0 con 0x7fbfb0065b50 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33570/0 (socket says 172.21.15.153:33570) 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 -- 172.21.15.153:0/313345912 learned_addr learned my addr 172.21.15.153:0/313345912 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb4836700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0065b50 0x7fbfb0153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5838700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfb0151b90 0x7fbfb01479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 -- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0065b50 msgr2=0x7fbfb0153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0065b50 0x7fbfb0153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 -- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfb0151b90 msgr2=0x7fbfb01479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfb0151b90 0x7fbfb01479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 -- 172.21.15.153:0/313345912 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa0009370 con 0x7fbfb0063290 2023-08-17T00:06:54.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5838700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfb0151b90 0x7fbfb01479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:54.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb5037700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0149220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fbfac00e900 tx=0x7fbfac009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac012600 con 0x7fbfb0063290 2023-08-17T00:06:54.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac012760 con 0x7fbfb0063290 2023-08-17T00:06:54.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac012ae0 con 0x7fbfb0063290 2023-08-17T00:06:54.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb0153cb0 con 0x7fbfb0063290 2023-08-17T00:06:54.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.560+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb0154270 con 0x7fbfb0063290 2023-08-17T00:06:54.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.564+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb006b530 con 0x7fbfb0063290 2023-08-17T00:06:54.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.564+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbfac022070 con 0x7fbfb0063290 2023-08-17T00:06:54.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.564+0000 7fbfa57fa700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf9405a150 0x7fbf9405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.568+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbfac0744e0 con 0x7fbfb0063290 2023-08-17T00:06:54.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.568+0000 7fbfb4836700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf9405a150 0x7fbf9405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.568+0000 7fbfb4836700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf9405a150 0x7fbf9405c610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fbfb00a9df0 tx=0x7fbfa0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.572+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbfac047e80 con 0x7fbfb0063290 2023-08-17T00:06:54.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.728+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbfb0154720 con 0x7fbf9405a150 2023-08-17T00:06:54.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.748+0000 7fbfa57fa700 1 -- 172.21.15.153:0/313345912 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+351770 (secure 0 0 0) 0x7fbfa0006b50 con 0x7fbf9405a150 2023-08-17T00:06:54.754 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:54.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf9405a150 msgr2=0x7fbf9405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf9405a150 0x7fbf9405c610 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7fbfb00a9df0 tx=0x7fbfa0017000).stop 2023-08-17T00:06:54.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 msgr2=0x7fbfb0149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0149220 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fbfac00e900 tx=0x7fbfac009060).stop 2023-08-17T00:06:54.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 shutdown_connections 2023-08-17T00:06:54.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf9405a150 0x7fbf9405c610 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbfb0151b90 0x7fbfb01479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbfb0065b50 0x7fbfb0153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 --2- 172.21.15.153:0/313345912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbfb0063290 0x7fbfb0149220 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 >> 172.21.15.153:0/313345912 conn(0x7fbfb00c7150 msgr2=0x7fbfb014a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:54.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 shutdown_connections 2023-08-17T00:06:54.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.756+0000 7fbfb729b700 1 -- 172.21.15.153:0/313345912 wait complete. 2023-08-17T00:06:54.764 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:54.783 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-08-17T00:06:53.259537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460228,"kb_used_data":5636,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752514492,"statfs":{"total":773094113280,"available":770574839808,"internally_reserved":0,"allocated":5771264,"data_stored":2556186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17888889,"num_objects":-2145,"num_object_clones":0,"num_object_copies":-4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2145,"num_whiteouts":0,"num_read":-138,"num_read_kb":-7408,"num_write":-7341,"num_write_kb":-24447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.161246"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478146+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479011+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484049+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478989+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.476896+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478406+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479908+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474638+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485607+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477685+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934218+0000","last_change":"2023-08-17T00:06:49.516163+0000","last_active":"2023-08-17T00:06:49.934218+0000","last_peered":"2023-08-17T00:06:49.934218+0000","last_clean":"2023-08-17T00:06:49.934218+0000","last_became_active":"2023-08-17T00:06:49.515816+0000","last_became_peered":"2023-08-17T00:06:49.515816+0000","last_unstale":"2023-08-17T00:06:49.934218+0000","last_undegraded":"2023-08-17T00:06:49.934218+0000","last_fullsized":"2023-08-17T00:06:49.934218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485017+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.482822+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483679+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481068+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.476867+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959636+0000","last_change":"2023-08-17T00:06:49.947233+0000","last_active":"2023-08-17T00:06:49.959636+0000","last_peered":"2023-08-17T00:06:49.959636+0000","last_clean":"2023-08-17T00:06:49.959636+0000","last_became_active":"2023-08-17T00:06:49.946953+0000","last_became_peered":"2023-08-17T00:06:49.946953+0000","last_unstale":"2023-08-17T00:06:49.959636+0000","last_undegraded":"2023-08-17T00:06:49.959636+0000","last_fullsized":"2023-08-17T00:06:49.959636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477614+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485758+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481553+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961118+0000","last_change":"2023-08-17T00:06:49.953511+0000","last_active":"2023-08-17T00:06:49.961118+0000","last_peered":"2023-08-17T00:06:49.961118+0000","last_clean":"2023-08-17T00:06:49.961118+0000","last_became_active":"2023-08-17T00:06:49.953191+0000","last_became_peered":"2023-08-17T00:06:49.953191+0000","last_unstale":"2023-08-17T00:06:49.961118+0000","last_undegraded":"2023-08-17T00:06:49.961118+0000","last_fullsized":"2023-08-17T00:06:49.961118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934363+0000","last_change":"2023-08-17T00:06:49.509940+0000","last_active":"2023-08-17T00:06:49.934363+0000","last_peered":"2023-08-17T00:06:49.934363+0000","last_clean":"2023-08-17T00:06:49.934363+0000","last_became_active":"2023-08-17T00:06:49.508703+0000","last_became_peered":"2023-08-17T00:06:49.508703+0000","last_unstale":"2023-08-17T00:06:49.934363+0000","last_undegraded":"2023-08-17T00:06:49.934363+0000","last_fullsized":"2023-08-17T00:06:49.934363+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.482151+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934282+0000","last_change":"2023-08-17T00:06:49.508382+0000","last_active":"2023-08-17T00:06:49.934282+0000","last_peered":"2023-08-17T00:06:49.934282+0000","last_clean":"2023-08-17T00:06:49.934282+0000","last_became_active":"2023-08-17T00:06:49.508065+0000","last_became_peered":"2023-08-17T00:06:49.508065+0000","last_unstale":"2023-08-17T00:06:49.934282+0000","last_undegraded":"2023-08-17T00:06:49.934282+0000","last_fullsized":"2023-08-17T00:06:49.934282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479129+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485931+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479546+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481801+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480119+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473315+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474842+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478825+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480178+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933686+0000","last_change":"2023-08-17T00:06:49.508705+0000","last_active":"2023-08-17T00:06:49.933686+0000","last_peered":"2023-08-17T00:06:49.933686+0000","last_clean":"2023-08-17T00:06:49.933686+0000","last_became_active":"2023-08-17T00:06:49.508086+0000","last_became_peered":"2023-08-17T00:06:49.508086+0000","last_unstale":"2023-08-17T00:06:49.933686+0000","last_undegraded":"2023-08-17T00:06:49.933686+0000","last_fullsized":"2023-08-17T00:06:49.933686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477036+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477210+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478599+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474764+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959333+0000","last_change":"2023-08-17T00:06:49.946510+0000","last_active":"2023-08-17T00:06:49.959333+0000","last_peered":"2023-08-17T00:06:49.959333+0000","last_clean":"2023-08-17T00:06:49.959333+0000","last_became_active":"2023-08-17T00:06:49.946225+0000","last_became_peered":"2023-08-17T00:06:49.946225+0000","last_unstale":"2023-08-17T00:06:49.959333+0000","last_undegraded":"2023-08-17T00:06:49.959333+0000","last_fullsized":"2023-08-17T00:06:49.959333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935353+0000","last_change":"2023-08-17T00:06:49.508617+0000","last_active":"2023-08-17T00:06:49.935353+0000","last_peered":"2023-08-17T00:06:49.935353+0000","last_clean":"2023-08-17T00:06:49.935353+0000","last_became_active":"2023-08-17T00:06:49.508330+0000","last_became_peered":"2023-08-17T00:06:49.508330+0000","last_unstale":"2023-08-17T00:06:49.935353+0000","last_undegraded":"2023-08-17T00:06:49.935353+0000","last_fullsized":"2023-08-17T00:06:49.935353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473269+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477017+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961151+0000","last_change":"2023-08-17T00:06:49.953751+0000","last_active":"2023-08-17T00:06:49.961151+0000","last_peered":"2023-08-17T00:06:49.961151+0000","last_clean":"2023-08-17T00:06:49.961151+0000","last_became_active":"2023-08-17T00:06:49.953400+0000","last_became_peered":"2023-08-17T00:06:49.953400+0000","last_unstale":"2023-08-17T00:06:49.961151+0000","last_undegraded":"2023-08-17T00:06:49.961151+0000","last_fullsized":"2023-08-17T00:06:49.961151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483031+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484729+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959677+0000","last_change":"2023-08-17T00:06:49.948293+0000","last_active":"2023-08-17T00:06:49.959677+0000","last_peered":"2023-08-17T00:06:49.959677+0000","last_clean":"2023-08-17T00:06:49.959677+0000","last_became_active":"2023-08-17T00:06:49.947961+0000","last_became_peered":"2023-08-17T00:06:49.947961+0000","last_unstale":"2023-08-17T00:06:49.959677+0000","last_undegraded":"2023-08-17T00:06:49.959677+0000","last_fullsized":"2023-08-17T00:06:49.959677+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481104+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478735+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474178+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483295+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.486629+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477829+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485517+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959773+0000","last_change":"2023-08-17T00:06:49.948378+0000","last_active":"2023-08-17T00:06:49.959773+0000","last_peered":"2023-08-17T00:06:49.959773+0000","last_clean":"2023-08-17T00:06:49.959773+0000","last_became_active":"2023-08-17T00:06:49.948039+0000","last_became_peered":"2023-08-17T00:06:49.948039+0000","last_unstale":"2023-08-17T00:06:49.959773+0000","last_undegraded":"2023-08-17T00:06:49.959773+0000","last_fullsized":"2023-08-17T00:06:49.959773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483805+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959770+0000","last_change":"2023-08-17T00:06:49.951952+0000","last_active":"2023-08-17T00:06:49.959770+0000","last_peered":"2023-08-17T00:06:49.959770+0000","last_clean":"2023-08-17T00:06:49.959770+0000","last_became_active":"2023-08-17T00:06:49.951497+0000","last_became_peered":"2023-08-17T00:06:49.951497+0000","last_unstale":"2023-08-17T00:06:49.959770+0000","last_undegraded":"2023-08-17T00:06:49.959770+0000","last_fullsized":"2023-08-17T00:06:49.959770+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484895+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474102+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479868+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481324+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477868+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479705+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961175+0000","last_change":"2023-08-17T00:06:49.954094+0000","last_active":"2023-08-17T00:06:49.961175+0000","last_peered":"2023-08-17T00:06:49.961175+0000","last_clean":"2023-08-17T00:06:49.961175+0000","last_became_active":"2023-08-17T00:06:49.953043+0000","last_became_peered":"2023-08-17T00:06:49.953043+0000","last_unstale":"2023-08-17T00:06:49.961175+0000","last_undegraded":"2023-08-17T00:06:49.961175+0000","last_fullsized":"2023-08-17T00:06:49.961175+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473970+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480341+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731742+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:06:45.731742+0000","last_peered":"2023-08-17T00:06:45.731742+0000","last_clean":"2023-08-17T00:06:45.731742+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:06:45.731742+0000","last_undegraded":"2023-08-17T00:06:45.731742+0000","last_fullsized":"2023-08-17T00:06:45.731742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477840+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933933+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:49.933933+0000","last_peered":"2023-08-17T00:06:49.933933+0000","last_clean":"2023-08-17T00:06:49.933933+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:49.933933+0000","last_undegraded":"2023-08-17T00:06:49.933933+0000","last_fullsized":"2023-08-17T00:06:49.933933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485323+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731830+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:06:45.731830+0000","last_peered":"2023-08-17T00:06:45.731830+0000","last_clean":"2023-08-17T00:06:45.731830+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:06:45.731830+0000","last_undegraded":"2023-08-17T00:06:45.731830+0000","last_fullsized":"2023-08-17T00:06:45.731830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484251+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.577564+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:06:45.577564+0000","last_peered":"2023-08-17T00:06:45.577564+0000","last_clean":"2023-08-17T00:06:45.577564+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:06:45.577564+0000","last_undegraded":"2023-08-17T00:06:45.577564+0000","last_fullsized":"2023-08-17T00:06:45.577564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473518+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731796+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:06:45.731796+0000","last_peered":"2023-08-17T00:06:45.731796+0000","last_clean":"2023-08-17T00:06:45.731796+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:06:45.731796+0000","last_undegraded":"2023-08-17T00:06:45.731796+0000","last_fullsized":"2023-08-17T00:06:45.731796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.486226+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.730617+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:06:45.730617+0000","last_peered":"2023-08-17T00:06:45.730617+0000","last_clean":"2023-08-17T00:06:45.730617+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:06:45.730617+0000","last_undegraded":"2023-08-17T00:06:45.730617+0000","last_fullsized":"2023-08-17T00:06:45.730617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474365+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731683+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:06:45.731683+0000","last_peered":"2023-08-17T00:06:45.731683+0000","last_clean":"2023-08-17T00:06:45.731683+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:06:45.731683+0000","last_undegraded":"2023-08-17T00:06:45.731683+0000","last_fullsized":"2023-08-17T00:06:45.731683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473191+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731679+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:06:45.731679+0000","last_peered":"2023-08-17T00:06:45.731679+0000","last_clean":"2023-08-17T00:06:45.731679+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:06:45.731679+0000","last_undegraded":"2023-08-17T00:06:45.731679+0000","last_fullsized":"2023-08-17T00:06:45.731679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.733020+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:06:45.733020+0000","last_peered":"2023-08-17T00:06:45.733020+0000","last_clean":"2023-08-17T00:06:45.733020+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:06:45.733020+0000","last_undegraded":"2023-08-17T00:06:45.733020+0000","last_fullsized":"2023-08-17T00:06:45.733020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.306,"15min":1.4350000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.909,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.337,"15min":1.4890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4710000000000001,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":1.1619999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.353,"15min":1.5009999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":0.747},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.345,"15min":1.4890000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4299999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.2529999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.236,"15min":1.3460000000000001},"min":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3400000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":0.876},{"interface":"front","average":{"1min":1.147,"5min":1.395,"15min":1.5149999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8120000000000001,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2849999999999999,"15min":1.373},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.357,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.6220000000000001,"15min":1.788},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.958,"5min":13.074999999999999,"15min":13.074999999999999},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.5720000000000001,"15min":1.778},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6419999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.4870000000000001,"15min":1.6259999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4470000000000001,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.716,"15min":1.9199999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.012,"5min":14.435,"15min":14.435},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.6699999999999999,"15min":1.8520000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6779999999999999,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.363}]},{"osd":6,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.6890000000000001,"15min":1.8540000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.7649999999999999,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.6140000000000001,"15min":1.754},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.706,"5min":11.365,"15min":11.365},"last":1.0649999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314180,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057660,"statfs":{"total":96636764160,"available":96315043840,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0389999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.6509999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.026},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.089,"15min":1.077},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.99399999999999999,"15min":0.97199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.2559999999999998,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":1.115},{"interface":"front","average":{"1min":1.284,"5min":1.2290000000000001,"15min":1.244},"min":{"1min":0.873,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.151}]},{"osd":3,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.145,"15min":1.137},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.304,"15min":1.276},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.4409999999999998,"5min":5.29,"15min":5.29},"last":1.175}]},{"osd":4,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2410000000000001,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2989999999999999,"15min":1.27},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.3599999999999999,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":1.248},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.228}]},{"osd":7,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3009999999999999,"15min":1.2989999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":4.6429999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4570000000000001,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.8999999999999999,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.552}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.468,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2410000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.6379999999999999,"15min":1.9119999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4670000000000001,"5min":16.838999999999999,"15min":16.838999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2110000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.494,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.4159999999999999,"15min":1.5760000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.462,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":1.014}]},{"osd":2,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.6619999999999999,"15min":1.9179999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4179999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.516,"15min":1.7},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.367,"5min":11.949,"15min":11.949},"last":1.109}]},{"osd":3,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.5649999999999999,"15min":1.754},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.575,"5min":13.125,"15min":13.125},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.4630000000000001,"15min":1.6060000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.177}]},{"osd":4,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.734,"15min":1.98},"min":{"1min":0.877,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.591,"5min":17.510000000000002,"15min":17.510000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.8819999999999999,"15min":2.1680000000000001},"min":{"1min":0.92500000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.8280000000000001,"15min":2.0899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.7350000000000001,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.825,"15min":2.0840000000000001},"min":{"1min":0.79400000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":17.050000000000001,"15min":17.050000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.966,"15min":2.2250000000000001},"min":{"1min":1.0089999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.2599999999999998,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.861,"15min":2.0710000000000002},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8120000000000001,"5min":14.818,"15min":14.818},"last":1.0489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":1.163},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.304},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.282}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.464},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.5960000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.373}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5660000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310084,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061756,"statfs":{"total":96636764160,"available":96319238144,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.91600000000000004},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1439999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.827,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2549999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0840000000000001,"15min":1.149},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9159999999999999,"5min":3.911,"15min":3.911},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.3080000000000001},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9530000000000001,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.03,"15min":1.0800000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.2530000000000001,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.7290000000000001,"15min":2.04},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6739999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.5509999999999999,"15min":1.7330000000000001},"min":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.0649999999999999,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.159}]},{"osd":5,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.681,"15min":1.889},"min":{"1min":0.748,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1440000000000001,"5min":12.914,"15min":12.914},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4910000000000001,"15min":1.645},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.4199999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.6419999999999999,"15min":1.861},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7689999999999999,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.373},{"interface":"front","average":{"1min":1.276,"5min":1.6830000000000001,"15min":1.899},"min":{"1min":0.86199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.2210000000000001,"5min":12.698,"15min":12.698},"last":1.212}]},{"osd":7,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.6479999999999999,"15min":1.8240000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.72,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.651,"15min":1.8340000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.956,"5min":11.417,"15min":11.417},"last":1.456}]}]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.496,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2110000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":1},{"interface":"front","average":{"1min":0.878,"5min":0.97599999999999998,"15min":0.92200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4359999999999999,"5min":13.093,"15min":13.093},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.91500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1639999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.353,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.054,"15min":1.0289999999999999},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.234,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2969999999999999,"15min":1.2},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.222,"5min":20.548999999999999,"15min":20.548999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.272,"15min":1.258},"min":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.492,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.087}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.4239999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.4810000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.294},{"interface":"front","average":{"1min":1.194,"5min":1.294,"15min":1.3069999999999999},"min":{"1min":0.82599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.446,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.288}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3400000000000001,"15min":1.302},"min":{"1min":0.84599999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.4830000000000001,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.24,"15min":1.2350000000000001},"min":{"1min":0.77900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4490000000000001,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5580000000000001,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.4359999999999999,"15min":1.4199999999999999},"min":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.492,"5min":13.131,"15min":13.131},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":1.3759999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.089},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.4099999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.446},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.294},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":753664,"data_stored":337515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.27},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.036}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.129},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":0.995},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.214}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.355},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.341}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.242},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:54.791 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.984+0000 7fb70e569700 1 Processor -- start 2023-08-17T00:06:54.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.984+0000 7fb70e569700 1 -- start start 2023-08-17T00:06:54.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb70e569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7080bc4d0 0x7fb7080a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb70e569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb708065240 con 0x7fb7080a8b70 2023-08-17T00:06:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb70e569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7080638a0 con 0x7fb7080632e0 2023-08-17T00:06:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb70e569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb708065de0 con 0x7fb7080bc4d0 2023-08-17T00:06:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb707fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb7080a8b70 0x7fb7080656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42344/0 (socket says 172.21.15.153:42344) 2023-08-17T00:06:54.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb707fff700 1 -- 172.21.15.153:0/2739352567 learned_addr learned my addr 172.21.15.153:0/2739352567 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.988+0000 7fb70cb06700 1 --2- 172.21.15.153:0/2739352567 >> v2:172.21.15.178:3300/0 conn(0x7fb7080bc4d0 0x7fb7080a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70cb06700 1 -- 172.21.15.153:0/2739352567 >> v1:172.21.15.178:6789/0 conn(0x7fb7080632e0 legacy=0x7fb7080bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70cb06700 1 -- 172.21.15.153:0/2739352567 >> v1:172.21.15.153:6789/0 conn(0x7fb7080a8b70 legacy=0x7fb7080656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70cb06700 1 -- 172.21.15.153:0/2739352567 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708064910 con 0x7fb7080bc4d0 2023-08-17T00:06:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb7077fe700 1 -- 172.21.15.153:0/2739352567 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379288486 0 0) 0x7fb708065240 con 0x7fb7080a8b70 2023-08-17T00:06:54.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70cb06700 1 --2- 172.21.15.153:0/2739352567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080bc4d0 0x7fb7080a8f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb700009760 tx=0x7fb700009060).ready entity=mon.1 client_cookie=887e8d8c3705e605 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:54.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb7077fe700 1 -- 172.21.15.153:0/2739352567 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000b580 con 0x7fb7080bc4d0 2023-08-17T00:06:54.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb7077fe700 1 -- 172.21.15.153:0/2739352567 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70000b6e0 con 0x7fb7080bc4d0 2023-08-17T00:06:54.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb7077fe700 1 -- 172.21.15.153:0/2739352567 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70000ba60 con 0x7fb7080bc4d0 2023-08-17T00:06:54.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 -- 172.21.15.153:0/2739352567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080bc4d0 msgr2=0x7fb7080a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:54.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 --2- 172.21.15.153:0/2739352567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080bc4d0 0x7fb7080a8f50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fb700009760 tx=0x7fb700009060).stop 2023-08-17T00:06:54.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 -- 172.21.15.153:0/2739352567 shutdown_connections 2023-08-17T00:06:54.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 --2- 172.21.15.153:0/2739352567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080bc4d0 0x7fb7080a8f50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:54.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 -- 172.21.15.153:0/2739352567 >> 172.21.15.153:0/2739352567 conn(0x7fb7080c7150 msgr2=0x7fb7080c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:54.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 -- 172.21.15.153:0/2739352567 shutdown_connections 2023-08-17T00:06:54.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 -- 172.21.15.153:0/2739352567 wait complete. 2023-08-17T00:06:54.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.992+0000 7fb70e569700 1 Processor -- start 2023-08-17T00:06:54.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 -- start start 2023-08-17T00:06:55.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080632e0 0x7fb708168c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 0x7fb7080aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080bc4d0 0x7fb7080bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb708169b30 con 0x7fb7080a8b70 2023-08-17T00:06:55.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70816c670 con 0x7fb7080632e0 2023-08-17T00:06:55.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb708169570 con 0x7fb7080bc4d0 2023-08-17T00:06:55.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 0x7fb7080aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 0x7fb7080aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51076/0 (socket says 172.21.15.153:51076) 2023-08-17T00:06:55.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 -- 172.21.15.153:0/4208601668 learned_addr learned my addr 172.21.15.153:0/4208601668 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:55.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb707fff700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080632e0 0x7fb708168c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70cb06700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080bc4d0 0x7fb7080bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 -- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080bc4d0 msgr2=0x7fb7080bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080bc4d0 0x7fb7080bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 -- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080632e0 msgr2=0x7fb708168c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080632e0 0x7fb708168c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 -- 172.21.15.153:0/4208601668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7000092a0 con 0x7fb7080a8b70 2023-08-17T00:06:55.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb6ff7fe700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 0x7fb7080aa960 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fb6f000c870 tx=0x7fb6f0001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0006a20 con 0x7fb7080a8b70 2023-08-17T00:06:55.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f0006b80 con 0x7fb7080a8b70 2023-08-17T00:06:55.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb708169850 con 0x7fb7080a8b70 2023-08-17T00:06:55.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:54.996+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0007020 con 0x7fb7080a8b70 2023-08-17T00:06:55.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.000+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7081690f0 con 0x7fb7080a8b70 2023-08-17T00:06:55.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.000+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb708169310 con 0x7fb7080a8b70 2023-08-17T00:06:55.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.000+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb6f0010070 con 0x7fb7080a8b70 2023-08-17T00:06:55.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.004+0000 7fb704ff9700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6e805a150 0x7fb6e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.004+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb6f00737e0 con 0x7fb7080a8b70 2023-08-17T00:06:55.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.004+0000 7fb707fff700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6e805a150 0x7fb6e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.004+0000 7fb707fff700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6e805a150 0x7fb6e805c610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fb6f80011e0 tx=0x7fb6f8007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.008+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6f0047290 con 0x7fb7080a8b70 2023-08-17T00:06:55.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.168+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb70806b530 con 0x7fb6e805a150 2023-08-17T00:06:55.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.180+0000 7fb704ff9700 1 -- 172.21.15.153:0/4208601668 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+351770 (secure 0 0 0) 0x7fb70806b530 con 0x7fb6e805a150 2023-08-17T00:06:55.189 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:55.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.188+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6e805a150 msgr2=0x7fb6e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.188+0000 7fb70e569700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6e805a150 0x7fb6e805c610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fb6f80011e0 tx=0x7fb6f8007b90).stop 2023-08-17T00:06:55.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.188+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 msgr2=0x7fb7080aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.188+0000 7fb70e569700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 0x7fb7080aa960 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7fb6f000c870 tx=0x7fb6f0001660).stop 2023-08-17T00:06:55.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 shutdown_connections 2023-08-17T00:06:55.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6e805a150 0x7fb6e805c610 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7080bc4d0 0x7fb7080bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb7080a8b70 0x7fb7080aa960 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 --2- 172.21.15.153:0/4208601668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7080632e0 0x7fb708168c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 >> 172.21.15.153:0/4208601668 conn(0x7fb7080c7150 msgr2=0x7fb7080c2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 shutdown_connections 2023-08-17T00:06:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.192+0000 7fb70e569700 1 -- 172.21.15.153:0/4208601668 wait complete. 2023-08-17T00:06:55.197 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:55.215 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2023-08-17T00:06:53.259537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460228,"kb_used_data":5636,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752514492,"statfs":{"total":773094113280,"available":770574839808,"internally_reserved":0,"allocated":5771264,"data_stored":2556186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17888889,"num_objects":-2145,"num_object_clones":0,"num_object_copies":-4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2145,"num_whiteouts":0,"num_read":-138,"num_read_kb":-7408,"num_write":-7341,"num_write_kb":-24447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.161246"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478146+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479011+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484049+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478989+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.476896+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478406+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479908+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474638+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485607+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477685+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934218+0000","last_change":"2023-08-17T00:06:49.516163+0000","last_active":"2023-08-17T00:06:49.934218+0000","last_peered":"2023-08-17T00:06:49.934218+0000","last_clean":"2023-08-17T00:06:49.934218+0000","last_became_active":"2023-08-17T00:06:49.515816+0000","last_became_peered":"2023-08-17T00:06:49.515816+0000","last_unstale":"2023-08-17T00:06:49.934218+0000","last_undegraded":"2023-08-17T00:06:49.934218+0000","last_fullsized":"2023-08-17T00:06:49.934218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485017+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.482822+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483679+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481068+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.476867+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959636+0000","last_change":"2023-08-17T00:06:49.947233+0000","last_active":"2023-08-17T00:06:49.959636+0000","last_peered":"2023-08-17T00:06:49.959636+0000","last_clean":"2023-08-17T00:06:49.959636+0000","last_became_active":"2023-08-17T00:06:49.946953+0000","last_became_peered":"2023-08-17T00:06:49.946953+0000","last_unstale":"2023-08-17T00:06:49.959636+0000","last_undegraded":"2023-08-17T00:06:49.959636+0000","last_fullsized":"2023-08-17T00:06:49.959636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477614+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485758+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481553+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961118+0000","last_change":"2023-08-17T00:06:49.953511+0000","last_active":"2023-08-17T00:06:49.961118+0000","last_peered":"2023-08-17T00:06:49.961118+0000","last_clean":"2023-08-17T00:06:49.961118+0000","last_became_active":"2023-08-17T00:06:49.953191+0000","last_became_peered":"2023-08-17T00:06:49.953191+0000","last_unstale":"2023-08-17T00:06:49.961118+0000","last_undegraded":"2023-08-17T00:06:49.961118+0000","last_fullsized":"2023-08-17T00:06:49.961118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934363+0000","last_change":"2023-08-17T00:06:49.509940+0000","last_active":"2023-08-17T00:06:49.934363+0000","last_peered":"2023-08-17T00:06:49.934363+0000","last_clean":"2023-08-17T00:06:49.934363+0000","last_became_active":"2023-08-17T00:06:49.508703+0000","last_became_peered":"2023-08-17T00:06:49.508703+0000","last_unstale":"2023-08-17T00:06:49.934363+0000","last_undegraded":"2023-08-17T00:06:49.934363+0000","last_fullsized":"2023-08-17T00:06:49.934363+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.482151+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934282+0000","last_change":"2023-08-17T00:06:49.508382+0000","last_active":"2023-08-17T00:06:49.934282+0000","last_peered":"2023-08-17T00:06:49.934282+0000","last_clean":"2023-08-17T00:06:49.934282+0000","last_became_active":"2023-08-17T00:06:49.508065+0000","last_became_peered":"2023-08-17T00:06:49.508065+0000","last_unstale":"2023-08-17T00:06:49.934282+0000","last_undegraded":"2023-08-17T00:06:49.934282+0000","last_fullsized":"2023-08-17T00:06:49.934282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479129+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485931+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479546+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481801+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480119+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473315+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474842+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478825+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480178+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933686+0000","last_change":"2023-08-17T00:06:49.508705+0000","last_active":"2023-08-17T00:06:49.933686+0000","last_peered":"2023-08-17T00:06:49.933686+0000","last_clean":"2023-08-17T00:06:49.933686+0000","last_became_active":"2023-08-17T00:06:49.508086+0000","last_became_peered":"2023-08-17T00:06:49.508086+0000","last_unstale":"2023-08-17T00:06:49.933686+0000","last_undegraded":"2023-08-17T00:06:49.933686+0000","last_fullsized":"2023-08-17T00:06:49.933686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477036+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477210+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478599+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474764+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959333+0000","last_change":"2023-08-17T00:06:49.946510+0000","last_active":"2023-08-17T00:06:49.959333+0000","last_peered":"2023-08-17T00:06:49.959333+0000","last_clean":"2023-08-17T00:06:49.959333+0000","last_became_active":"2023-08-17T00:06:49.946225+0000","last_became_peered":"2023-08-17T00:06:49.946225+0000","last_unstale":"2023-08-17T00:06:49.959333+0000","last_undegraded":"2023-08-17T00:06:49.959333+0000","last_fullsized":"2023-08-17T00:06:49.959333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935353+0000","last_change":"2023-08-17T00:06:49.508617+0000","last_active":"2023-08-17T00:06:49.935353+0000","last_peered":"2023-08-17T00:06:49.935353+0000","last_clean":"2023-08-17T00:06:49.935353+0000","last_became_active":"2023-08-17T00:06:49.508330+0000","last_became_peered":"2023-08-17T00:06:49.508330+0000","last_unstale":"2023-08-17T00:06:49.935353+0000","last_undegraded":"2023-08-17T00:06:49.935353+0000","last_fullsized":"2023-08-17T00:06:49.935353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473269+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477017+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961151+0000","last_change":"2023-08-17T00:06:49.953751+0000","last_active":"2023-08-17T00:06:49.961151+0000","last_peered":"2023-08-17T00:06:49.961151+0000","last_clean":"2023-08-17T00:06:49.961151+0000","last_became_active":"2023-08-17T00:06:49.953400+0000","last_became_peered":"2023-08-17T00:06:49.953400+0000","last_unstale":"2023-08-17T00:06:49.961151+0000","last_undegraded":"2023-08-17T00:06:49.961151+0000","last_fullsized":"2023-08-17T00:06:49.961151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483031+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484729+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959677+0000","last_change":"2023-08-17T00:06:49.948293+0000","last_active":"2023-08-17T00:06:49.959677+0000","last_peered":"2023-08-17T00:06:49.959677+0000","last_clean":"2023-08-17T00:06:49.959677+0000","last_became_active":"2023-08-17T00:06:49.947961+0000","last_became_peered":"2023-08-17T00:06:49.947961+0000","last_unstale":"2023-08-17T00:06:49.959677+0000","last_undegraded":"2023-08-17T00:06:49.959677+0000","last_fullsized":"2023-08-17T00:06:49.959677+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481104+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.478735+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474178+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483295+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.486629+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477829+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485517+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959773+0000","last_change":"2023-08-17T00:06:49.948378+0000","last_active":"2023-08-17T00:06:49.959773+0000","last_peered":"2023-08-17T00:06:49.959773+0000","last_clean":"2023-08-17T00:06:49.959773+0000","last_became_active":"2023-08-17T00:06:49.948039+0000","last_became_peered":"2023-08-17T00:06:49.948039+0000","last_unstale":"2023-08-17T00:06:49.959773+0000","last_undegraded":"2023-08-17T00:06:49.959773+0000","last_fullsized":"2023-08-17T00:06:49.959773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.483805+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959770+0000","last_change":"2023-08-17T00:06:49.951952+0000","last_active":"2023-08-17T00:06:49.959770+0000","last_peered":"2023-08-17T00:06:49.959770+0000","last_clean":"2023-08-17T00:06:49.959770+0000","last_became_active":"2023-08-17T00:06:49.951497+0000","last_became_peered":"2023-08-17T00:06:49.951497+0000","last_unstale":"2023-08-17T00:06:49.959770+0000","last_undegraded":"2023-08-17T00:06:49.959770+0000","last_fullsized":"2023-08-17T00:06:49.959770+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484895+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474102+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479868+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.481324+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477868+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.479705+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961175+0000","last_change":"2023-08-17T00:06:49.954094+0000","last_active":"2023-08-17T00:06:49.961175+0000","last_peered":"2023-08-17T00:06:49.961175+0000","last_clean":"2023-08-17T00:06:49.961175+0000","last_became_active":"2023-08-17T00:06:49.953043+0000","last_became_peered":"2023-08-17T00:06:49.953043+0000","last_unstale":"2023-08-17T00:06:49.961175+0000","last_undegraded":"2023-08-17T00:06:49.961175+0000","last_fullsized":"2023-08-17T00:06:49.961175+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473970+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.480341+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731742+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:06:45.731742+0000","last_peered":"2023-08-17T00:06:45.731742+0000","last_clean":"2023-08-17T00:06:45.731742+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:06:45.731742+0000","last_undegraded":"2023-08-17T00:06:45.731742+0000","last_fullsized":"2023-08-17T00:06:45.731742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.477840+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933933+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:49.933933+0000","last_peered":"2023-08-17T00:06:49.933933+0000","last_clean":"2023-08-17T00:06:49.933933+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:49.933933+0000","last_undegraded":"2023-08-17T00:06:49.933933+0000","last_fullsized":"2023-08-17T00:06:49.933933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.485323+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731830+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:06:45.731830+0000","last_peered":"2023-08-17T00:06:45.731830+0000","last_clean":"2023-08-17T00:06:45.731830+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:06:45.731830+0000","last_undegraded":"2023-08-17T00:06:45.731830+0000","last_fullsized":"2023-08-17T00:06:45.731830+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.484251+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.577564+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:06:45.577564+0000","last_peered":"2023-08-17T00:06:45.577564+0000","last_clean":"2023-08-17T00:06:45.577564+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:06:45.577564+0000","last_undegraded":"2023-08-17T00:06:45.577564+0000","last_fullsized":"2023-08-17T00:06:45.577564+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473518+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731796+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:06:45.731796+0000","last_peered":"2023-08-17T00:06:45.731796+0000","last_clean":"2023-08-17T00:06:45.731796+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:06:45.731796+0000","last_undegraded":"2023-08-17T00:06:45.731796+0000","last_fullsized":"2023-08-17T00:06:45.731796+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.486226+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.730617+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:06:45.730617+0000","last_peered":"2023-08-17T00:06:45.730617+0000","last_clean":"2023-08-17T00:06:45.730617+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:06:45.730617+0000","last_undegraded":"2023-08-17T00:06:45.730617+0000","last_fullsized":"2023-08-17T00:06:45.730617+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.474365+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731683+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:06:45.731683+0000","last_peered":"2023-08-17T00:06:45.731683+0000","last_clean":"2023-08-17T00:06:45.731683+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:06:45.731683+0000","last_undegraded":"2023-08-17T00:06:45.731683+0000","last_fullsized":"2023-08-17T00:06:45.731683+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:06:49.472219+0000","last_change":"2023-08-17T00:06:49.472219+0000","last_active":"2023-08-17T00:06:49.472219+0000","last_peered":"2023-08-17T00:06:49.472219+0000","last_clean":"2023-08-17T00:06:49.472219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:49.472219+0000","last_undegraded":"2023-08-17T00:06:49.472219+0000","last_fullsized":"2023-08-17T00:06:49.472219+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:06:48.460019+0000","last_change":"2023-08-17T00:06:48.473191+0000","last_active":"2023-08-17T00:06:48.460019+0000","last_peered":"2023-08-17T00:06:48.460019+0000","last_clean":"2023-08-17T00:06:48.460019+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:06:48.460019+0000","last_undegraded":"2023-08-17T00:06:48.460019+0000","last_fullsized":"2023-08-17T00:06:48.460019+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":44,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.731679+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:06:45.731679+0000","last_peered":"2023-08-17T00:06:45.731679+0000","last_clean":"2023-08-17T00:06:45.731679+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:06:45.731679+0000","last_undegraded":"2023-08-17T00:06:45.731679+0000","last_fullsized":"2023-08-17T00:06:45.731679+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-08-17T00:06:45.733020+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:06:45.733020+0000","last_peered":"2023-08-17T00:06:45.733020+0000","last_clean":"2023-08-17T00:06:45.733020+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:06:45.733020+0000","last_undegraded":"2023-08-17T00:06:45.733020+0000","last_fullsized":"2023-08-17T00:06:45.733020+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":1},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.306,"15min":1.4350000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.909,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.337,"15min":1.4890000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.4710000000000001,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":1.1619999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.353,"15min":1.5009999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":0.747},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.345,"15min":1.4890000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.4299999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.2529999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.236,"15min":1.3460000000000001},"min":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3400000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":0.876},{"interface":"front","average":{"1min":1.147,"5min":1.395,"15min":1.5149999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8120000000000001,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.0109999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.2849999999999999,"15min":1.373},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.357,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.6220000000000001,"15min":1.788},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.958,"5min":13.074999999999999,"15min":13.074999999999999},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.5720000000000001,"15min":1.778},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6419999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.153,"5min":1.4870000000000001,"15min":1.6259999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.4470000000000001,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.716,"15min":1.9199999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":2.012,"5min":14.435,"15min":14.435},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.6699999999999999,"15min":1.8520000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.6779999999999999,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.363}]},{"osd":6,"last update":"Thu Aug 17 00:05:47 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.6890000000000001,"15min":1.8540000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.7649999999999999,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.6140000000000001,"15min":1.754},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.706,"5min":11.365,"15min":11.365},"last":1.0649999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542195,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314180,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057660,"statfs":{"total":96636764160,"available":96315043840,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0669999999999999,"15min":1.0389999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.6509999999999998,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.026},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0940000000000001,"15min":1.125},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.93600000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.089,"15min":1.077},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.1519999999999999,"5min":0.99399999999999999,"15min":0.97199999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":4.1059999999999999,"5min":4.1059999999999999,"15min":4.1059999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1950000000000001,"15min":1.175},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":3.2559999999999998,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":1.115},{"interface":"front","average":{"1min":1.284,"5min":1.2290000000000001,"15min":1.244},"min":{"1min":0.873,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.151}]},{"osd":3,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.145,"15min":1.137},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.304,"15min":1.276},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.4409999999999998,"5min":5.29,"15min":5.29},"last":1.175}]},{"osd":4,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.2410000000000001,"15min":1.234},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.6989999999999998,"5min":2.6989999999999998,"15min":2.6989999999999998},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.2030000000000001,"15min":1.1990000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":4.1929999999999996,"5min":4.1929999999999996,"15min":4.1929999999999996},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2989999999999999,"15min":1.27},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":3.3599999999999999,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":1.248},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.3240000000000001,"15min":1.3100000000000001},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":1.228}]},{"osd":7,"last update":"Thu Aug 17 00:05:48 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.3009999999999999,"15min":1.2989999999999999},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":4.6429999999999998,"5min":4.6429999999999998,"15min":4.6429999999999998},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.4570000000000001,"15min":1.4399999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.8999999999999999,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.552}]}]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.468,"15min":1.704},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2410000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.083,"5min":1.6379999999999999,"15min":1.9119999999999999},"min":{"1min":0.626,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.4670000000000001,"5min":16.838999999999999,"15min":16.838999999999999},"last":0.84099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2110000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.494,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.079,"5min":1.4159999999999999,"15min":1.5760000000000001},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.462,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":1.014}]},{"osd":2,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.6619999999999999,"15min":1.9179999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4179999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.516,"15min":1.7},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.367,"5min":11.949,"15min":11.949},"last":1.109}]},{"osd":3,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.5649999999999999,"15min":1.754},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.575,"5min":13.125,"15min":13.125},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.4630000000000001,"15min":1.6060000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6379999999999999,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.177}]},{"osd":4,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.734,"15min":1.98},"min":{"1min":0.877,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.591,"5min":17.510000000000002,"15min":17.510000000000002},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.8819999999999999,"15min":2.1680000000000001},"min":{"1min":0.92500000000000004,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.74,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.8280000000000001,"15min":2.0899999999999999},"min":{"1min":0.68799999999999994,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.7350000000000001,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.825,"15min":2.0840000000000001},"min":{"1min":0.79400000000000004,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.821,"5min":17.050000000000001,"15min":17.050000000000001},"last":0.96099999999999997}]},{"osd":7,"last update":"Thu Aug 17 00:05:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.966,"15min":2.2250000000000001},"min":{"1min":1.0089999999999999,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.2599999999999998,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.861,"15min":2.0710000000000002},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.8120000000000001,"5min":14.818,"15min":14.818},"last":1.0489999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542195,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":1.163},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.304},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.282}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.464},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.5960000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.373}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.5660000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310084,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061756,"statfs":{"total":96636764160,"available":96319238144,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.91600000000000004},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1439999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.827,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.78400000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2549999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.749},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0840000000000001,"15min":1.149},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9159999999999999,"5min":3.911,"15min":3.911},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.3080000000000001},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9530000000000001,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.032,"5min":1.03,"15min":1.0800000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.2530000000000001,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.7290000000000001,"15min":2.04},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6739999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.23,"5min":1.5509999999999999,"15min":1.7330000000000001},"min":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.0649999999999999,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.159}]},{"osd":5,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.681,"15min":1.889},"min":{"1min":0.748,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1440000000000001,"5min":12.914,"15min":12.914},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4910000000000001,"15min":1.645},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.4199999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.6419999999999999,"15min":1.861},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7689999999999999,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.373},{"interface":"front","average":{"1min":1.276,"5min":1.6830000000000001,"15min":1.899},"min":{"1min":0.86199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.2210000000000001,"5min":12.698,"15min":12.698},"last":1.212}]},{"osd":7,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.6479999999999999,"15min":1.8240000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.72,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.651,"15min":1.8340000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.956,"5min":11.417,"15min":11.417},"last":1.456}]}]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301892,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069948,"statfs":{"total":96636764160,"available":96327626752,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.83799999999999997,"15min":0.81699999999999995},"min":{"1min":0.496,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2110000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":1},{"interface":"front","average":{"1min":0.878,"5min":0.97599999999999998,"15min":0.92200000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.4359999999999999,"5min":13.093,"15min":13.093},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.82999999999999996,"15min":0.84099999999999997},"min":{"1min":0.44,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.002,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.93200000000000005,"15min":0.91500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1639999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":0.92300000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0720000000000001,"15min":1.0529999999999999},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.353,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":1.054,"15min":1.0289999999999999},"min":{"1min":0.49099999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.234,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.72699999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.2969999999999999,"15min":1.2},"min":{"1min":0.73599999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.222,"5min":20.548999999999999,"15min":20.548999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.272,"15min":1.258},"min":{"1min":0.84899999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.492,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.087}]},{"osd":5,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.4239999999999999,"15min":1.399},"min":{"1min":0.95999999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.4810000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.294},{"interface":"front","average":{"1min":1.194,"5min":1.294,"15min":1.3069999999999999},"min":{"1min":0.82599999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.446,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.288}]},{"osd":6,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.3400000000000001,"15min":1.302},"min":{"1min":0.84599999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.4830000000000001,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.24,"15min":1.2350000000000001},"min":{"1min":0.77900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4490000000000001,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:05:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3620000000000001,"15min":1.363},"min":{"1min":0.93999999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.5580000000000001,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.4359999999999999,"15min":1.4199999999999999},"min":{"1min":0.875,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.492,"5min":13.131,"15min":13.131},"last":1.0309999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305988,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065852,"statfs":{"total":96636764160,"available":96323432448,"internally_reserved":0,"allocated":716800,"data_stored":316953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":1.3759999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.089},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.93799999999999994}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.3320000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.4099999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.446},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.0669999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.294},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.276}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":753664,"data_stored":337515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.27},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.036}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.129},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":0.995},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.214}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.355},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.341}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.242},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:55.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-08-17T00:06:55.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-08-17T00:06:55.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.478146+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-08-17T00:06:55.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-08-17T00:06:55.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.479011+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-08-17T00:06:55.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-08-17T00:06:55.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.484049+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-08-17T00:06:55.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-08-17T00:06:55.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.478989+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-08-17T00:06:55.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-08-17T00:06:55.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.476896+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-08-17T00:06:55.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-08-17T00:06:55.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.478406+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-08-17T00:06:55.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-08-17T00:06:55.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.479908+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-08-17T00:06:55.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-08-17T00:06:55.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.474638+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-08-17T00:06:55.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-08-17T00:06:55.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.485607+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:06:55.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-08-17T00:06:55.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-08-17T00:06:55.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477685+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-08-17T00:06:55.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-08-17T00:06:55.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-08-17T00:06:55.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.485017+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:06:55.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-08-17T00:06:55.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-08-17T00:06:55.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.482822+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:06:55.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-08-17T00:06:55.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-08-17T00:06:55.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.483679+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-08-17T00:06:55.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-08-17T00:06:55.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.481068+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:06:55.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-08-17T00:06:55.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-08-17T00:06:55.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.476867+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-08-17T00:06:55.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477614+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-08-17T00:06:55.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-08-17T00:06:55.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.485758+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-08-17T00:06:55.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-08-17T00:06:55.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.481553+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.246 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-08-17T00:06:55.246 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-08-17T00:06:55.247 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.482151+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:06:55.247 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-08-17T00:06:55.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.248 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-08-17T00:06:55.248 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-08-17T00:06:55.249 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.479129+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.249 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-08-17T00:06:55.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.250 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-08-17T00:06:55.250 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.485931+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:06:55.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-08-17T00:06:55.251 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.251 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-08-17T00:06:55.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.479546+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.252 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-08-17T00:06:55.252 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-08-17T00:06:55.253 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.481801+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:06:55.253 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-08-17T00:06:55.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.254 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-08-17T00:06:55.254 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.480119+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-08-17T00:06:55.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.255 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-08-17T00:06:55.255 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.473315+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-08-17T00:06:55.256 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.256 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-08-17T00:06:55.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.474842+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.257 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-08-17T00:06:55.257 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-08-17T00:06:55.258 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.478825+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.258 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-08-17T00:06:55.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.259 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-08-17T00:06:55.259 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.480178+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-08-17T00:06:55.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.260 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-08-17T00:06:55.260 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.261 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-08-17T00:06:55.261 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477036+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-08-17T00:06:55.262 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.262 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-08-17T00:06:55.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477210+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-08-17T00:06:55.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-08-17T00:06:55.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.478599+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-08-17T00:06:55.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-08-17T00:06:55.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.474764+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-08-17T00:06:55.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-08-17T00:06:55.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.473269+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-08-17T00:06:55.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-08-17T00:06:55.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477017+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-08-17T00:06:55.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.483031+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-08-17T00:06:55.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-08-17T00:06:55.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.484729+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-08-17T00:06:55.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.481104+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:06:55.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-08-17T00:06:55.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-08-17T00:06:55.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.478735+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.272 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-08-17T00:06:55.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-08-17T00:06:55.273 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.474178+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.273 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-08-17T00:06:55.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.274 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-08-17T00:06:55.274 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.483295+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.275 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-08-17T00:06:55.275 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-08-17T00:06:55.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.486629+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:06:55.276 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-08-17T00:06:55.276 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.277 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-08-17T00:06:55.277 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477829+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-08-17T00:06:55.278 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.278 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-08-17T00:06:55.279 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.485517+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:06:55.279 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-08-17T00:06:55.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.483805+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.280 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-08-17T00:06:55.280 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.484895+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.281 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-08-17T00:06:55.281 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-08-17T00:06:55.282 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.474102+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.282 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-08-17T00:06:55.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.283 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-08-17T00:06:55.283 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.479868+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-08-17T00:06:55.284 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.284 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-08-17T00:06:55.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.481324+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:06:55.285 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-08-17T00:06:55.285 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-08-17T00:06:55.286 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477868+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:06:55.286 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-08-17T00:06:55.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.287 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-08-17T00:06:55.287 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.479705+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-08-17T00:06:55.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.473970+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.288 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-08-17T00:06:55.288 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.289 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-08-17T00:06:55.289 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.480341+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:06:55.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-08-17T00:06:55.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.290 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-08-17T00:06:55.290 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.477840+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:06:55.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-08-17T00:06:55.291 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.291 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-08-17T00:06:55.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.485323+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.292 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-08-17T00:06:55.292 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.293 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-08-17T00:06:55.293 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.484251+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:06:55.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-08-17T00:06:55.294 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.294 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-08-17T00:06:55.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.473518+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.295 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-08-17T00:06:55.295 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-08-17T00:06:55.296 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.486226+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:06:55.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-08-17T00:06:55.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-08-17T00:06:55.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.474365+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-08-17T00:06:55.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:06:49.472219+0000', 'last_change': '2023-08-17T00:06:49.472219+0000', 'last_active': '2023-08-17T00:06:49.472219+0000', 'last_peered': '2023-08-17T00:06:49.472219+0000', 'last_clean': '2023-08-17T00:06:49.472219+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:49.472219+0000', 'last_undegraded': '2023-08-17T00:06:49.472219+0000', 'last_fullsized': '2023-08-17T00:06:49.472219+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:49.472219+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:06:55.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-08-17T00:06:55.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:06:48.460019+0000', 'last_change': '2023-08-17T00:06:48.473191+0000', 'last_active': '2023-08-17T00:06:48.460019+0000', 'last_peered': '2023-08-17T00:06:48.460019+0000', 'last_clean': '2023-08-17T00:06:48.460019+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:06:48.460019+0000', 'last_undegraded': '2023-08-17T00:06:48.460019+0000', 'last_fullsized': '2023-08-17T00:06:48.460019+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'last_clean_scrub_stamp': '2023-08-17T00:06:48.460019+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:06:55.300 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:06:55.461 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:06:55.456+0000 7f22fddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:06:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.456+0000 7f0eace5b700 1 Processor -- start 2023-08-17T00:06:55.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.456+0000 7f0eace5b700 1 -- start start 2023-08-17T00:06:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0eace5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 0x7f0ea8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0eace5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80aa750 con 0x7f0ea80c8d50 2023-08-17T00:06:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0eace5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea80c9dd0 con 0x7f0ea80c7ba0 2023-08-17T00:06:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0eace5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80aacf0 con 0x7f0ea8153ab0 2023-08-17T00:06:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0e9ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0ea80c8d50 0x7f0ea80c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42350/0 (socket says 172.21.15.153:42350) 2023-08-17T00:06:55.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0e9ffff700 1 -- 172.21.15.153:0/1985945555 learned_addr learned my addr 172.21.15.153:0/1985945555 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea659c700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 0x7f0ea8153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000415566 0 0) 0x7f0ea80aa750 con 0x7f0ea80c8d50 2023-08-17T00:06:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e940033f0 con 0x7f0ea80c8d50 2023-08-17T00:06:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266492896 0 0) 0x7f0ea80c9dd0 con 0x7f0ea80c7ba0 2023-08-17T00:06:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea80aa750 con 0x7f0ea80c7ba0 2023-08-17T00:06:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4039509366 0 0) 0x7f0e940033f0 con 0x7f0ea80c8d50 2023-08-17T00:06:55.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 msgr2=0x7f0ea8153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 0x7f0ea8153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 >> v1:172.21.15.178:6789/0 conn(0x7f0ea80c7ba0 legacy=0x7f0ea80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80c5ca0 con 0x7f0ea80c8d50 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f0e90001470 con 0x7f0ea80c8d50 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 >> v1:172.21.15.153:6789/0 conn(0x7f0ea80c8d50 legacy=0x7f0ea80c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.460+0000 7f0ea5d9b700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94003aa0 0x7f0e94003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e94004690 0x7f0e94004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 0x7f0e94005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea80aacf0 con 0x7f0e94004690 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400b990 con 0x7f0e94003aa0 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9400bb50 con 0x7f0ea8153ab0 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e94004690 0x7f0e94004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea659c700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94003aa0 0x7f0e94003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea6d9d700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 0x7f0e94005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 -- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 msgr2=0x7f0e94005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8153ab0 0x7f0e94005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 -- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94003aa0 msgr2=0x7f0e94003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94003aa0 0x7f0e94003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 -- 172.21.15.153:0/1985945555 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940033f0 con 0x7f0e94004690 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0e9ffff700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e94004690 0x7f0e94004b10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f0e9000c160 tx=0x7f0ea80aae30).ready entity=mon.0 client_cookie=efbd91e34e775e50 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000c9d0 con 0x7f0e94004690 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000cb30 con 0x7f0e94004690 2023-08-17T00:06:55.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea5d9b700 1 -- 172.21.15.153:0/1985945555 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900070d0 con 0x7f0e94004690 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0eace5b700 1 -- 172.21.15.153:0/1985945555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e94004690 msgr2=0x7f0e94004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0eace5b700 1 --2- 172.21.15.153:0/1985945555 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e94004690 0x7f0e94004b10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f0e9000c160 tx=0x7f0ea80aae30).stop 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0ea6d9d700 1 -- 172.21.15.153:0/1985945555 reap_dead start 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0eace5b700 1 -- 172.21.15.153:0/1985945555 shutdown_connections 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0eace5b700 1 -- 172.21.15.153:0/1985945555 >> 172.21.15.153:0/1985945555 conn(0x7f0ea8061fa0 msgr2=0x7f0ea80623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0eace5b700 1 -- 172.21.15.153:0/1985945555 shutdown_connections 2023-08-17T00:06:55.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.464+0000 7f0eace5b700 1 -- 172.21.15.153:0/1985945555 wait complete. 2023-08-17T00:06:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 Processor -- start 2023-08-17T00:06:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 -- start start 2023-08-17T00:06:55.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94004690 0x7f0ea8167f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8150950 0x7f0ea81552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 0x7f0ea8157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8154e10 con 0x7f0ea8155790 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8168400 con 0x7f0e94004690 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0eace5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8154200 con 0x7f0ea8150950 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 0x7f0ea8157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 0x7f0ea8157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51104/0 (socket says 172.21.15.153:51104) 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 -- 172.21.15.153:0/3513091140 learned_addr learned my addr 172.21.15.153:0/3513091140 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0e9ffff700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8150950 0x7f0ea81552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea659c700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94004690 0x7f0ea8167f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 -- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8150950 msgr2=0x7f0ea81552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8150950 0x7f0ea81552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 -- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94004690 msgr2=0x7f0ea8167f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94004690 0x7f0ea8167f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.468+0000 7f0ea6d9d700 1 -- 172.21.15.153:0/3513091140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea81544e0 con 0x7f0ea8155790 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0ea6d9d700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 0x7f0ea8157080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f0ea0001350 tx=0x7f0ea0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0006c30 con 0x7f0ea8155790 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea0006d90 con 0x7f0ea8155790 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea00032e0 con 0x7f0ea8155790 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea81547c0 con 0x7f0ea8155790 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea8153e90 con 0x7f0ea8155790 2023-08-17T00:06:55.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea8154c40 con 0x7f0ea8155790 2023-08-17T00:06:55.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.472+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0ea001e070 con 0x7f0ea8155790 2023-08-17T00:06:55.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.476+0000 7f0e9e7fc700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e8805a180 0x7f0e8805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.476+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ea00735b0 con 0x7f0ea8155790 2023-08-17T00:06:55.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.476+0000 7f0ea659c700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e8805a180 0x7f0e8805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.476+0000 7f0ea659c700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e8805a180 0x7f0e8805c640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0e98006c40 tx=0x7f0e98008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.480+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ea0046f50 con 0x7f0ea8155790 2023-08-17T00:06:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.696+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0ea806b530 con 0x7f0ea8155790 2023-08-17T00:06:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.696+0000 7f0e9e7fc700 1 -- 172.21.15.153:0/3513091140 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1528 (secure 0 0 0) 0x7f0ea001c080 con 0x7f0ea8155790 2023-08-17T00:06:55.701 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:55.701 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":263,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":59},{"state_name":"unknown","count":56},{"state_name":"active+clean","count":22}],"num_pgs":137,"num_pools":4,"num_objects":0,"data_bytes":0,"bytes_used":2519273472,"bytes_avail":770574839808,"bytes_total":773094113280,"unknown_pgs_ratio":0.40875911712646484,"inactive_pgs_ratio":0.43065693974494934},"fsmap":{"epoch":49,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":6219}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-08-17T00:06:39.255296+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:06:55.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e8805a180 msgr2=0x7f0e8805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e8805a180 0x7f0e8805c640 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f0e98006c40 tx=0x7f0e98008040).stop 2023-08-17T00:06:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 msgr2=0x7f0ea8157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 0x7f0ea8157080 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7f0ea0001350 tx=0x7f0ea0009040).stop 2023-08-17T00:06:55.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 shutdown_connections 2023-08-17T00:06:55.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e8805a180 0x7f0e8805c640 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ea8155790 0x7f0ea8157080 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ea8150950 0x7f0ea81552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 --2- 172.21.15.153:0/3513091140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e94004690 0x7f0ea8167f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 >> 172.21.15.153:0/3513091140 conn(0x7f0ea8061fa0 msgr2=0x7f0ea8151b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 shutdown_connections 2023-08-17T00:06:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.700+0000 7f0eace5b700 1 -- 172.21.15.153:0/3513091140 wait complete. 2023-08-17T00:06:55.726 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T00:06:55.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:55.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 Processor -- start 2023-08-17T00:06:55.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 -- start start 2023-08-17T00:06:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740a8df0 0x7fc1740c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1740aa6e0 0x7fc174068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1741585a0 con 0x7fc174068820 2023-08-17T00:06:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc174066400 con 0x7fc1740aa6e0 2023-08-17T00:06:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc17a707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174069170 con 0x7fc1740a8df0 2023-08-17T00:06:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1740aa6e0 0x7fc174068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc1740aa6e0 0x7fc174068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51110/0 (socket says 172.21.15.153:51110) 2023-08-17T00:06:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 -- 172.21.15.153:0/453934531 learned_addr learned my addr 172.21.15.153:0/453934531 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179705700 1 --2- 172.21.15.153:0/453934531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740a8df0 0x7fc1740c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 -- 172.21.15.153:0/453934531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740a8df0 msgr2=0x7fc1740c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 --2- 172.21.15.153:0/453934531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740a8df0 0x7fc1740c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 -- 172.21.15.153:0/453934531 >> v1:172.21.15.178:6789/0 conn(0x7fc174068820 legacy=0x7fc174061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 -- 172.21.15.153:0/453934531 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740b9d30 con 0x7fc1740aa6e0 2023-08-17T00:06:55.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.876+0000 7fc179f06700 1 --2- 172.21.15.153:0/453934531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc174068c80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fc16c006fd0 tx=0x7fc16c0090f0).ready entity=mon.0 client_cookie=710ba2e821bb8b43 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc16bfff700 1 -- 172.21.15.153:0/453934531 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00b580 con 0x7fc1740aa6e0 2023-08-17T00:06:55.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc16bfff700 1 -- 172.21.15.153:0/453934531 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00b6e0 con 0x7fc1740aa6e0 2023-08-17T00:06:55.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc16bfff700 1 -- 172.21.15.153:0/453934531 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00ba60 con 0x7fc1740aa6e0 2023-08-17T00:06:55.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 -- 172.21.15.153:0/453934531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 msgr2=0x7fc174068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 --2- 172.21.15.153:0/453934531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc174068c80 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7fc16c006fd0 tx=0x7fc16c0090f0).stop 2023-08-17T00:06:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 -- 172.21.15.153:0/453934531 shutdown_connections 2023-08-17T00:06:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 --2- 172.21.15.153:0/453934531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc174068c80 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 --2- 172.21.15.153:0/453934531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740a8df0 0x7fc1740c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 -- 172.21.15.153:0/453934531 >> 172.21.15.153:0/453934531 conn(0x7fc1740c6620 msgr2=0x7fc1740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 -- 172.21.15.153:0/453934531 shutdown_connections 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.880+0000 7fc17a707700 1 -- 172.21.15.153:0/453934531 wait complete. 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 Processor -- start 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 -- start start 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc174068820 0x7fc174149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740a8df0 0x7fc1740beed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc1740bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740bf8b0 con 0x7fc1740aa6e0 2023-08-17T00:06:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174158e20 con 0x7fc1740a8df0 2023-08-17T00:06:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17414a070 con 0x7fc174068820 2023-08-17T00:06:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc1740bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc1740bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51118/0 (socket says 172.21.15.153:51118) 2023-08-17T00:06:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 -- 172.21.15.153:0/3857097490 learned_addr learned my addr 172.21.15.153:0/3857097490 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179705700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc174068820 0x7fc174149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc178f04700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740a8df0 0x7fc1740beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 -- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc174068820 msgr2=0x7fc174149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc174068820 0x7fc174149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 -- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740a8df0 msgr2=0x7fc1740beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740a8df0 0x7fc1740beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 -- 172.21.15.153:0/3857097490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc16c009370 con 0x7fc1740aa6e0 2023-08-17T00:06:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc178f04700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740a8df0 0x7fc1740beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc179f06700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc1740bf3c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fc16c009130 tx=0x7fc16c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c00b850 con 0x7fc1740aa6e0 2023-08-17T00:06:55.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00b9b0 con 0x7fc1740aa6e0 2023-08-17T00:06:55.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.884+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740be220 con 0x7fc1740aa6e0 2023-08-17T00:06:55.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.888+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c01c670 con 0x7fc1740aa6e0 2023-08-17T00:06:55.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.888+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1741587d0 con 0x7fc1740aa6e0 2023-08-17T00:06:55.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.888+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17406b4c0 con 0x7fc1740aa6e0 2023-08-17T00:06:55.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.888+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc16c022020 con 0x7fc1740aa6e0 2023-08-17T00:06:55.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.892+0000 7fc1697fa700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc15805a150 0x7fc15805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:55.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.892+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc16c075b80 con 0x7fc1740aa6e0 2023-08-17T00:06:55.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.892+0000 7fc179705700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc15805a150 0x7fc15805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:55.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.892+0000 7fc179705700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc15805a150 0x7fc15805c610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fc17000f510 tx=0x7fc17000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:55.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:55.896+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc16c04cf50 con 0x7fc1740aa6e0 2023-08-17T00:06:56.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.056+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc17405e300 con 0x7fc15805a150 2023-08-17T00:06:56.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.076+0000 7fc1697fa700 1 -- 172.21.15.153:0/3857097490 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359315 (secure 0 0 0) 0x7fc17405e300 con 0x7fc15805a150 2023-08-17T00:06:56.084 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:56.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc15805a150 msgr2=0x7fc15805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:56.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc15805a150 0x7fc15805c610 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fc17000f510 tx=0x7fc17000b040).stop 2023-08-17T00:06:56.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 msgr2=0x7fc1740bf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:56.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc1740bf3c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fc16c009130 tx=0x7fc16c017000).stop 2023-08-17T00:06:56.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 shutdown_connections 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc15805a150 0x7fc15805c610 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc1740aa6e0 0x7fc1740bf3c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740a8df0 0x7fc1740beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 --2- 172.21.15.153:0/3857097490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc174068820 0x7fc174149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 >> 172.21.15.153:0/3857097490 conn(0x7fc1740c6620 msgr2=0x7fc174157be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 shutdown_connections 2023-08-17T00:06:56.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:56.084+0000 7fc17a707700 1 -- 172.21.15.153:0/3857097490 wait complete. 2023-08-17T00:06:56.092 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:56.110 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2023-08-17T00:06:55.260223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":254,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460520,"kb_used_data":5928,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752514200,"statfs":{"total":773094113280,"available":770574540800,"internally_reserved":0,"allocated":6070272,"data_stored":2691324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17888889,"num_objects":-2145,"num_object_clones":0,"num_object_copies":-4290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2145,"num_whiteouts":0,"num_read":-138,"num_read_kb":-7408,"num_write":-7341,"num_write_kb":-24447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-708,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.161246"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977501+0000","last_change":"2023-08-17T00:06:49.971729+0000","last_active":"2023-08-17T00:06:49.977501+0000","last_peered":"2023-08-17T00:06:49.977501+0000","last_clean":"2023-08-17T00:06:49.977501+0000","last_became_active":"2023-08-17T00:06:49.965750+0000","last_became_peered":"2023-08-17T00:06:49.965750+0000","last_unstale":"2023-08-17T00:06:49.977501+0000","last_undegraded":"2023-08-17T00:06:49.977501+0000","last_fullsized":"2023-08-17T00:06:49.977501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3f","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961815+0000","last_change":"2023-08-17T00:06:49.511646+0000","last_active":"2023-08-17T00:06:49.961815+0000","last_peered":"2023-08-17T00:06:49.961815+0000","last_clean":"2023-08-17T00:06:49.961815+0000","last_became_active":"2023-08-17T00:06:49.511348+0000","last_became_peered":"2023-08-17T00:06:49.511348+0000","last_unstale":"2023-08-17T00:06:49.961815+0000","last_undegraded":"2023-08-17T00:06:49.961815+0000","last_fullsized":"2023-08-17T00:06:49.961815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969391+0000","last_change":"2023-08-17T00:06:49.967889+0000","last_active":"2023-08-17T00:06:49.969391+0000","last_peered":"2023-08-17T00:06:49.969391+0000","last_clean":"2023-08-17T00:06:49.969391+0000","last_became_active":"2023-08-17T00:06:49.967558+0000","last_became_peered":"2023-08-17T00:06:49.967558+0000","last_unstale":"2023-08-17T00:06:49.969391+0000","last_undegraded":"2023-08-17T00:06:49.969391+0000","last_fullsized":"2023-08-17T00:06:49.969391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942432+0000","last_change":"2023-08-17T00:06:49.520311+0000","last_active":"2023-08-17T00:06:49.942432+0000","last_peered":"2023-08-17T00:06:49.942432+0000","last_clean":"2023-08-17T00:06:49.942432+0000","last_became_active":"2023-08-17T00:06:49.519735+0000","last_became_peered":"2023-08-17T00:06:49.519735+0000","last_unstale":"2023-08-17T00:06:49.942432+0000","last_undegraded":"2023-08-17T00:06:49.942432+0000","last_fullsized":"2023-08-17T00:06:49.942432+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952248+0000","last_change":"2023-08-17T00:06:49.947732+0000","last_active":"2023-08-17T00:06:49.952248+0000","last_peered":"2023-08-17T00:06:49.952248+0000","last_clean":"2023-08-17T00:06:49.952248+0000","last_became_active":"2023-08-17T00:06:49.947242+0000","last_became_peered":"2023-08-17T00:06:49.947242+0000","last_unstale":"2023-08-17T00:06:49.952248+0000","last_undegraded":"2023-08-17T00:06:49.952248+0000","last_fullsized":"2023-08-17T00:06:49.952248+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940152+0000","last_change":"2023-08-17T00:06:49.510766+0000","last_active":"2023-08-17T00:06:49.940152+0000","last_peered":"2023-08-17T00:06:49.940152+0000","last_clean":"2023-08-17T00:06:49.940152+0000","last_became_active":"2023-08-17T00:06:49.509451+0000","last_became_peered":"2023-08-17T00:06:49.509451+0000","last_unstale":"2023-08-17T00:06:49.940152+0000","last_undegraded":"2023-08-17T00:06:49.940152+0000","last_fullsized":"2023-08-17T00:06:49.940152+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962605+0000","last_change":"2023-08-17T00:06:49.956423+0000","last_active":"2023-08-17T00:06:49.962605+0000","last_peered":"2023-08-17T00:06:49.962605+0000","last_clean":"2023-08-17T00:06:49.962605+0000","last_became_active":"2023-08-17T00:06:49.956141+0000","last_became_peered":"2023-08-17T00:06:49.956141+0000","last_unstale":"2023-08-17T00:06:49.962605+0000","last_undegraded":"2023-08-17T00:06:49.962605+0000","last_fullsized":"2023-08-17T00:06:49.962605+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969102+0000","last_change":"2023-08-17T00:06:49.522925+0000","last_active":"2023-08-17T00:06:49.969102+0000","last_peered":"2023-08-17T00:06:49.969102+0000","last_clean":"2023-08-17T00:06:49.969102+0000","last_became_active":"2023-08-17T00:06:49.522597+0000","last_became_peered":"2023-08-17T00:06:49.522597+0000","last_unstale":"2023-08-17T00:06:49.969102+0000","last_undegraded":"2023-08-17T00:06:49.969102+0000","last_fullsized":"2023-08-17T00:06:49.969102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968927+0000","last_change":"2023-08-17T00:06:49.957297+0000","last_active":"2023-08-17T00:06:49.968927+0000","last_peered":"2023-08-17T00:06:49.968927+0000","last_clean":"2023-08-17T00:06:49.968927+0000","last_became_active":"2023-08-17T00:06:49.956775+0000","last_became_peered":"2023-08-17T00:06:49.956775+0000","last_unstale":"2023-08-17T00:06:49.968927+0000","last_undegraded":"2023-08-17T00:06:49.968927+0000","last_fullsized":"2023-08-17T00:06:49.968927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966605+0000","last_change":"2023-08-17T00:06:49.514109+0000","last_active":"2023-08-17T00:06:49.966605+0000","last_peered":"2023-08-17T00:06:49.966605+0000","last_clean":"2023-08-17T00:06:49.966605+0000","last_became_active":"2023-08-17T00:06:49.513827+0000","last_became_peered":"2023-08-17T00:06:49.513827+0000","last_unstale":"2023-08-17T00:06:49.966605+0000","last_undegraded":"2023-08-17T00:06:49.966605+0000","last_fullsized":"2023-08-17T00:06:49.966605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963285+0000","last_change":"2023-08-17T00:06:49.960546+0000","last_active":"2023-08-17T00:06:49.963285+0000","last_peered":"2023-08-17T00:06:49.963285+0000","last_clean":"2023-08-17T00:06:49.963285+0000","last_became_active":"2023-08-17T00:06:49.960128+0000","last_became_peered":"2023-08-17T00:06:49.960128+0000","last_unstale":"2023-08-17T00:06:49.963285+0000","last_undegraded":"2023-08-17T00:06:49.963285+0000","last_fullsized":"2023-08-17T00:06:49.963285+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963269+0000","last_change":"2023-08-17T00:06:49.519213+0000","last_active":"2023-08-17T00:06:49.963269+0000","last_peered":"2023-08-17T00:06:49.963269+0000","last_clean":"2023-08-17T00:06:49.963269+0000","last_became_active":"2023-08-17T00:06:49.518862+0000","last_became_peered":"2023-08-17T00:06:49.518862+0000","last_unstale":"2023-08-17T00:06:49.963269+0000","last_undegraded":"2023-08-17T00:06:49.963269+0000","last_fullsized":"2023-08-17T00:06:49.963269+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.956374+0000","last_change":"2023-08-17T00:06:49.951463+0000","last_active":"2023-08-17T00:06:49.956374+0000","last_peered":"2023-08-17T00:06:49.956374+0000","last_clean":"2023-08-17T00:06:49.956374+0000","last_became_active":"2023-08-17T00:06:49.950180+0000","last_became_peered":"2023-08-17T00:06:49.950180+0000","last_unstale":"2023-08-17T00:06:49.956374+0000","last_undegraded":"2023-08-17T00:06:49.956374+0000","last_fullsized":"2023-08-17T00:06:49.956374+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.945443+0000","last_change":"2023-08-17T00:06:49.522080+0000","last_active":"2023-08-17T00:06:49.945443+0000","last_peered":"2023-08-17T00:06:49.945443+0000","last_clean":"2023-08-17T00:06:49.945443+0000","last_became_active":"2023-08-17T00:06:49.521800+0000","last_became_peered":"2023-08-17T00:06:49.521800+0000","last_unstale":"2023-08-17T00:06:49.945443+0000","last_undegraded":"2023-08-17T00:06:49.945443+0000","last_fullsized":"2023-08-17T00:06:49.945443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966417+0000","last_change":"2023-08-17T00:06:49.953013+0000","last_active":"2023-08-17T00:06:49.966417+0000","last_peered":"2023-08-17T00:06:49.966417+0000","last_clean":"2023-08-17T00:06:49.966417+0000","last_became_active":"2023-08-17T00:06:49.952756+0000","last_became_peered":"2023-08-17T00:06:49.952756+0000","last_unstale":"2023-08-17T00:06:49.966417+0000","last_undegraded":"2023-08-17T00:06:49.966417+0000","last_fullsized":"2023-08-17T00:06:49.966417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934788+0000","last_change":"2023-08-17T00:06:49.510037+0000","last_active":"2023-08-17T00:06:49.934788+0000","last_peered":"2023-08-17T00:06:49.934788+0000","last_clean":"2023-08-17T00:06:49.934788+0000","last_became_active":"2023-08-17T00:06:49.509668+0000","last_became_peered":"2023-08-17T00:06:49.509668+0000","last_unstale":"2023-08-17T00:06:49.934788+0000","last_undegraded":"2023-08-17T00:06:49.934788+0000","last_fullsized":"2023-08-17T00:06:49.934788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977425+0000","last_change":"2023-08-17T00:06:49.965707+0000","last_active":"2023-08-17T00:06:49.977425+0000","last_peered":"2023-08-17T00:06:49.977425+0000","last_clean":"2023-08-17T00:06:49.977425+0000","last_became_active":"2023-08-17T00:06:49.964974+0000","last_became_peered":"2023-08-17T00:06:49.964974+0000","last_unstale":"2023-08-17T00:06:49.977425+0000","last_undegraded":"2023-08-17T00:06:49.977425+0000","last_fullsized":"2023-08-17T00:06:49.977425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935431+0000","last_change":"2023-08-17T00:06:49.519473+0000","last_active":"2023-08-17T00:06:49.935431+0000","last_peered":"2023-08-17T00:06:49.935431+0000","last_clean":"2023-08-17T00:06:49.935431+0000","last_became_active":"2023-08-17T00:06:49.519142+0000","last_became_peered":"2023-08-17T00:06:49.519142+0000","last_unstale":"2023-08-17T00:06:49.935431+0000","last_undegraded":"2023-08-17T00:06:49.935431+0000","last_fullsized":"2023-08-17T00:06:49.935431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977410+0000","last_change":"2023-08-17T00:06:49.965481+0000","last_active":"2023-08-17T00:06:49.977410+0000","last_peered":"2023-08-17T00:06:49.977410+0000","last_clean":"2023-08-17T00:06:49.977410+0000","last_became_active":"2023-08-17T00:06:49.962823+0000","last_became_peered":"2023-08-17T00:06:49.962823+0000","last_unstale":"2023-08-17T00:06:49.977410+0000","last_undegraded":"2023-08-17T00:06:49.977410+0000","last_fullsized":"2023-08-17T00:06:49.977410+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940215+0000","last_change":"2023-08-17T00:06:49.512212+0000","last_active":"2023-08-17T00:06:49.940215+0000","last_peered":"2023-08-17T00:06:49.940215+0000","last_clean":"2023-08-17T00:06:49.940215+0000","last_became_active":"2023-08-17T00:06:49.511958+0000","last_became_peered":"2023-08-17T00:06:49.511958+0000","last_unstale":"2023-08-17T00:06:49.940215+0000","last_undegraded":"2023-08-17T00:06:49.940215+0000","last_fullsized":"2023-08-17T00:06:49.940215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965161+0000","last_change":"2023-08-17T00:06:49.959860+0000","last_active":"2023-08-17T00:06:49.965161+0000","last_peered":"2023-08-17T00:06:49.965161+0000","last_clean":"2023-08-17T00:06:49.965161+0000","last_became_active":"2023-08-17T00:06:49.959580+0000","last_became_peered":"2023-08-17T00:06:49.959580+0000","last_unstale":"2023-08-17T00:06:49.965161+0000","last_undegraded":"2023-08-17T00:06:49.965161+0000","last_fullsized":"2023-08-17T00:06:49.965161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934218+0000","last_change":"2023-08-17T00:06:49.516163+0000","last_active":"2023-08-17T00:06:49.934218+0000","last_peered":"2023-08-17T00:06:49.934218+0000","last_clean":"2023-08-17T00:06:49.934218+0000","last_became_active":"2023-08-17T00:06:49.515816+0000","last_became_peered":"2023-08-17T00:06:49.515816+0000","last_unstale":"2023-08-17T00:06:49.934218+0000","last_undegraded":"2023-08-17T00:06:49.934218+0000","last_fullsized":"2023-08-17T00:06:49.934218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977137+0000","last_change":"2023-08-17T00:06:49.961837+0000","last_active":"2023-08-17T00:06:49.977137+0000","last_peered":"2023-08-17T00:06:49.977137+0000","last_clean":"2023-08-17T00:06:49.977137+0000","last_became_active":"2023-08-17T00:06:49.961513+0000","last_became_peered":"2023-08-17T00:06:49.961513+0000","last_unstale":"2023-08-17T00:06:49.977137+0000","last_undegraded":"2023-08-17T00:06:49.977137+0000","last_fullsized":"2023-08-17T00:06:49.977137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.973433+0000","last_change":"2023-08-17T00:06:49.512669+0000","last_active":"2023-08-17T00:06:49.973433+0000","last_peered":"2023-08-17T00:06:49.973433+0000","last_clean":"2023-08-17T00:06:49.973433+0000","last_became_active":"2023-08-17T00:06:49.512338+0000","last_became_peered":"2023-08-17T00:06:49.512338+0000","last_unstale":"2023-08-17T00:06:49.973433+0000","last_undegraded":"2023-08-17T00:06:49.973433+0000","last_fullsized":"2023-08-17T00:06:49.973433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957475+0000","last_change":"2023-08-17T00:06:49.953066+0000","last_active":"2023-08-17T00:06:49.957475+0000","last_peered":"2023-08-17T00:06:49.957475+0000","last_clean":"2023-08-17T00:06:49.957475+0000","last_became_active":"2023-08-17T00:06:49.952722+0000","last_became_peered":"2023-08-17T00:06:49.952722+0000","last_unstale":"2023-08-17T00:06:49.957475+0000","last_undegraded":"2023-08-17T00:06:49.957475+0000","last_fullsized":"2023-08-17T00:06:49.957475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.971034+0000","last_change":"2023-08-17T00:06:49.513478+0000","last_active":"2023-08-17T00:06:49.971034+0000","last_peered":"2023-08-17T00:06:49.971034+0000","last_clean":"2023-08-17T00:06:49.971034+0000","last_became_active":"2023-08-17T00:06:49.512118+0000","last_became_peered":"2023-08-17T00:06:49.512118+0000","last_unstale":"2023-08-17T00:06:49.971034+0000","last_undegraded":"2023-08-17T00:06:49.971034+0000","last_fullsized":"2023-08-17T00:06:49.971034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964766+0000","last_change":"2023-08-17T00:06:49.960216+0000","last_active":"2023-08-17T00:06:49.964766+0000","last_peered":"2023-08-17T00:06:49.964766+0000","last_clean":"2023-08-17T00:06:49.964766+0000","last_became_active":"2023-08-17T00:06:49.959948+0000","last_became_peered":"2023-08-17T00:06:49.959948+0000","last_unstale":"2023-08-17T00:06:49.964766+0000","last_undegraded":"2023-08-17T00:06:49.964766+0000","last_fullsized":"2023-08-17T00:06:49.964766+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936941+0000","last_change":"2023-08-17T00:06:49.508817+0000","last_active":"2023-08-17T00:06:49.936941+0000","last_peered":"2023-08-17T00:06:49.936941+0000","last_clean":"2023-08-17T00:06:49.936941+0000","last_became_active":"2023-08-17T00:06:49.508385+0000","last_became_peered":"2023-08-17T00:06:49.508385+0000","last_unstale":"2023-08-17T00:06:49.936941+0000","last_undegraded":"2023-08-17T00:06:49.936941+0000","last_fullsized":"2023-08-17T00:06:49.936941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.956326+0000","last_change":"2023-08-17T00:06:49.948717+0000","last_active":"2023-08-17T00:06:49.956326+0000","last_peered":"2023-08-17T00:06:49.956326+0000","last_clean":"2023-08-17T00:06:49.956326+0000","last_became_active":"2023-08-17T00:06:49.948444+0000","last_became_peered":"2023-08-17T00:06:49.948444+0000","last_unstale":"2023-08-17T00:06:49.956326+0000","last_undegraded":"2023-08-17T00:06:49.956326+0000","last_fullsized":"2023-08-17T00:06:49.956326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.938409+0000","last_change":"2023-08-17T00:06:49.518131+0000","last_active":"2023-08-17T00:06:49.938409+0000","last_peered":"2023-08-17T00:06:49.938409+0000","last_clean":"2023-08-17T00:06:49.938409+0000","last_became_active":"2023-08-17T00:06:49.517797+0000","last_became_peered":"2023-08-17T00:06:49.517797+0000","last_unstale":"2023-08-17T00:06:49.938409+0000","last_undegraded":"2023-08-17T00:06:49.938409+0000","last_fullsized":"2023-08-17T00:06:49.938409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957879+0000","last_change":"2023-08-17T00:06:49.953217+0000","last_active":"2023-08-17T00:06:49.957879+0000","last_peered":"2023-08-17T00:06:49.957879+0000","last_clean":"2023-08-17T00:06:49.957879+0000","last_became_active":"2023-08-17T00:06:49.952957+0000","last_became_peered":"2023-08-17T00:06:49.952957+0000","last_unstale":"2023-08-17T00:06:49.957879+0000","last_undegraded":"2023-08-17T00:06:49.957879+0000","last_fullsized":"2023-08-17T00:06:49.957879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966589+0000","last_change":"2023-08-17T00:06:49.511162+0000","last_active":"2023-08-17T00:06:49.966589+0000","last_peered":"2023-08-17T00:06:49.966589+0000","last_clean":"2023-08-17T00:06:49.966589+0000","last_became_active":"2023-08-17T00:06:49.510809+0000","last_became_peered":"2023-08-17T00:06:49.510809+0000","last_unstale":"2023-08-17T00:06:49.966589+0000","last_undegraded":"2023-08-17T00:06:49.966589+0000","last_fullsized":"2023-08-17T00:06:49.966589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959636+0000","last_change":"2023-08-17T00:06:49.947233+0000","last_active":"2023-08-17T00:06:49.959636+0000","last_peered":"2023-08-17T00:06:49.959636+0000","last_clean":"2023-08-17T00:06:49.959636+0000","last_became_active":"2023-08-17T00:06:49.946953+0000","last_became_peered":"2023-08-17T00:06:49.946953+0000","last_unstale":"2023-08-17T00:06:49.959636+0000","last_undegraded":"2023-08-17T00:06:49.959636+0000","last_fullsized":"2023-08-17T00:06:49.959636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942950+0000","last_change":"2023-08-17T00:06:49.522752+0000","last_active":"2023-08-17T00:06:49.942950+0000","last_peered":"2023-08-17T00:06:49.942950+0000","last_clean":"2023-08-17T00:06:49.942950+0000","last_became_active":"2023-08-17T00:06:49.522422+0000","last_became_peered":"2023-08-17T00:06:49.522422+0000","last_unstale":"2023-08-17T00:06:49.942950+0000","last_undegraded":"2023-08-17T00:06:49.942950+0000","last_fullsized":"2023-08-17T00:06:49.942950+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977311+0000","last_change":"2023-08-17T00:06:49.964632+0000","last_active":"2023-08-17T00:06:49.977311+0000","last_peered":"2023-08-17T00:06:49.977311+0000","last_clean":"2023-08-17T00:06:49.977311+0000","last_became_active":"2023-08-17T00:06:49.962478+0000","last_became_peered":"2023-08-17T00:06:49.962478+0000","last_unstale":"2023-08-17T00:06:49.977311+0000","last_undegraded":"2023-08-17T00:06:49.977311+0000","last_fullsized":"2023-08-17T00:06:49.977311+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943627+0000","last_change":"2023-08-17T00:06:49.514421+0000","last_active":"2023-08-17T00:06:49.943627+0000","last_peered":"2023-08-17T00:06:49.943627+0000","last_clean":"2023-08-17T00:06:49.943627+0000","last_became_active":"2023-08-17T00:06:49.514127+0000","last_became_peered":"2023-08-17T00:06:49.514127+0000","last_unstale":"2023-08-17T00:06:49.943627+0000","last_undegraded":"2023-08-17T00:06:49.943627+0000","last_fullsized":"2023-08-17T00:06:49.943627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.974674+0000","last_change":"2023-08-17T00:06:49.953101+0000","last_active":"2023-08-17T00:06:49.974674+0000","last_peered":"2023-08-17T00:06:49.974674+0000","last_clean":"2023-08-17T00:06:49.974674+0000","last_became_active":"2023-08-17T00:06:49.952826+0000","last_became_peered":"2023-08-17T00:06:49.952826+0000","last_unstale":"2023-08-17T00:06:49.974674+0000","last_undegraded":"2023-08-17T00:06:49.974674+0000","last_fullsized":"2023-08-17T00:06:49.974674+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957791+0000","last_change":"2023-08-17T00:06:49.510504+0000","last_active":"2023-08-17T00:06:49.957791+0000","last_peered":"2023-08-17T00:06:49.957791+0000","last_clean":"2023-08-17T00:06:49.957791+0000","last_became_active":"2023-08-17T00:06:49.510228+0000","last_became_peered":"2023-08-17T00:06:49.510228+0000","last_unstale":"2023-08-17T00:06:49.957791+0000","last_undegraded":"2023-08-17T00:06:49.957791+0000","last_fullsized":"2023-08-17T00:06:49.957791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961118+0000","last_change":"2023-08-17T00:06:49.953511+0000","last_active":"2023-08-17T00:06:49.961118+0000","last_peered":"2023-08-17T00:06:49.961118+0000","last_clean":"2023-08-17T00:06:49.961118+0000","last_became_active":"2023-08-17T00:06:49.953191+0000","last_became_peered":"2023-08-17T00:06:49.953191+0000","last_unstale":"2023-08-17T00:06:49.961118+0000","last_undegraded":"2023-08-17T00:06:49.961118+0000","last_fullsized":"2023-08-17T00:06:49.961118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934363+0000","last_change":"2023-08-17T00:06:49.509940+0000","last_active":"2023-08-17T00:06:49.934363+0000","last_peered":"2023-08-17T00:06:49.934363+0000","last_clean":"2023-08-17T00:06:49.934363+0000","last_became_active":"2023-08-17T00:06:49.508703+0000","last_became_peered":"2023-08-17T00:06:49.508703+0000","last_unstale":"2023-08-17T00:06:49.934363+0000","last_undegraded":"2023-08-17T00:06:49.934363+0000","last_fullsized":"2023-08-17T00:06:49.934363+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968948+0000","last_change":"2023-08-17T00:06:49.957470+0000","last_active":"2023-08-17T00:06:49.968948+0000","last_peered":"2023-08-17T00:06:49.968948+0000","last_clean":"2023-08-17T00:06:49.968948+0000","last_became_active":"2023-08-17T00:06:49.957040+0000","last_became_peered":"2023-08-17T00:06:49.957040+0000","last_unstale":"2023-08-17T00:06:49.968948+0000","last_undegraded":"2023-08-17T00:06:49.968948+0000","last_fullsized":"2023-08-17T00:06:49.968948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977876+0000","last_change":"2023-08-17T00:06:49.512115+0000","last_active":"2023-08-17T00:06:49.977876+0000","last_peered":"2023-08-17T00:06:49.977876+0000","last_clean":"2023-08-17T00:06:49.977876+0000","last_became_active":"2023-08-17T00:06:49.511825+0000","last_became_peered":"2023-08-17T00:06:49.511825+0000","last_unstale":"2023-08-17T00:06:49.977876+0000","last_undegraded":"2023-08-17T00:06:49.977876+0000","last_fullsized":"2023-08-17T00:06:49.977876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.958010+0000","last_change":"2023-08-17T00:06:49.951845+0000","last_active":"2023-08-17T00:06:49.958010+0000","last_peered":"2023-08-17T00:06:49.958010+0000","last_clean":"2023-08-17T00:06:49.958010+0000","last_became_active":"2023-08-17T00:06:49.951523+0000","last_became_peered":"2023-08-17T00:06:49.951523+0000","last_unstale":"2023-08-17T00:06:49.958010+0000","last_undegraded":"2023-08-17T00:06:49.958010+0000","last_fullsized":"2023-08-17T00:06:49.958010+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934282+0000","last_change":"2023-08-17T00:06:49.508382+0000","last_active":"2023-08-17T00:06:49.934282+0000","last_peered":"2023-08-17T00:06:49.934282+0000","last_clean":"2023-08-17T00:06:49.934282+0000","last_became_active":"2023-08-17T00:06:49.508065+0000","last_became_peered":"2023-08-17T00:06:49.508065+0000","last_unstale":"2023-08-17T00:06:49.934282+0000","last_undegraded":"2023-08-17T00:06:49.934282+0000","last_fullsized":"2023-08-17T00:06:49.934282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952068+0000","last_change":"2023-08-17T00:06:49.946688+0000","last_active":"2023-08-17T00:06:49.952068+0000","last_peered":"2023-08-17T00:06:49.952068+0000","last_clean":"2023-08-17T00:06:49.952068+0000","last_became_active":"2023-08-17T00:06:49.946264+0000","last_became_peered":"2023-08-17T00:06:49.946264+0000","last_unstale":"2023-08-17T00:06:49.952068+0000","last_undegraded":"2023-08-17T00:06:49.952068+0000","last_fullsized":"2023-08-17T00:06:49.952068+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.945541+0000","last_change":"2023-08-17T00:06:49.512548+0000","last_active":"2023-08-17T00:06:49.945541+0000","last_peered":"2023-08-17T00:06:49.945541+0000","last_clean":"2023-08-17T00:06:49.945541+0000","last_became_active":"2023-08-17T00:06:49.512119+0000","last_became_peered":"2023-08-17T00:06:49.512119+0000","last_unstale":"2023-08-17T00:06:49.945541+0000","last_undegraded":"2023-08-17T00:06:49.945541+0000","last_fullsized":"2023-08-17T00:06:49.945541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965839+0000","last_change":"2023-08-17T00:06:49.962843+0000","last_active":"2023-08-17T00:06:49.965839+0000","last_peered":"2023-08-17T00:06:49.965839+0000","last_clean":"2023-08-17T00:06:49.965839+0000","last_became_active":"2023-08-17T00:06:49.962577+0000","last_became_peered":"2023-08-17T00:06:49.962577+0000","last_unstale":"2023-08-17T00:06:49.965839+0000","last_undegraded":"2023-08-17T00:06:49.965839+0000","last_fullsized":"2023-08-17T00:06:49.965839+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935138+0000","last_change":"2023-08-17T00:06:49.513071+0000","last_active":"2023-08-17T00:06:49.935138+0000","last_peered":"2023-08-17T00:06:49.935138+0000","last_clean":"2023-08-17T00:06:49.935138+0000","last_became_active":"2023-08-17T00:06:49.511203+0000","last_became_peered":"2023-08-17T00:06:49.511203+0000","last_unstale":"2023-08-17T00:06:49.935138+0000","last_undegraded":"2023-08-17T00:06:49.935138+0000","last_fullsized":"2023-08-17T00:06:49.935138+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963322+0000","last_change":"2023-08-17T00:06:49.959273+0000","last_active":"2023-08-17T00:06:49.963322+0000","last_peered":"2023-08-17T00:06:49.963322+0000","last_clean":"2023-08-17T00:06:49.963322+0000","last_became_active":"2023-08-17T00:06:49.958497+0000","last_became_peered":"2023-08-17T00:06:49.958497+0000","last_unstale":"2023-08-17T00:06:49.963322+0000","last_undegraded":"2023-08-17T00:06:49.963322+0000","last_fullsized":"2023-08-17T00:06:49.963322+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942332+0000","last_change":"2023-08-17T00:06:49.520022+0000","last_active":"2023-08-17T00:06:49.942332+0000","last_peered":"2023-08-17T00:06:49.942332+0000","last_clean":"2023-08-17T00:06:49.942332+0000","last_became_active":"2023-08-17T00:06:49.519642+0000","last_became_peered":"2023-08-17T00:06:49.519642+0000","last_unstale":"2023-08-17T00:06:49.942332+0000","last_undegraded":"2023-08-17T00:06:49.942332+0000","last_fullsized":"2023-08-17T00:06:49.942332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963691+0000","last_change":"2023-08-17T00:06:49.955802+0000","last_active":"2023-08-17T00:06:49.963691+0000","last_peered":"2023-08-17T00:06:49.963691+0000","last_clean":"2023-08-17T00:06:49.963691+0000","last_became_active":"2023-08-17T00:06:49.955515+0000","last_became_peered":"2023-08-17T00:06:49.955515+0000","last_unstale":"2023-08-17T00:06:49.963691+0000","last_undegraded":"2023-08-17T00:06:49.963691+0000","last_fullsized":"2023-08-17T00:06:49.963691+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.939448+0000","last_change":"2023-08-17T00:06:49.511804+0000","last_active":"2023-08-17T00:06:49.939448+0000","last_peered":"2023-08-17T00:06:49.939448+0000","last_clean":"2023-08-17T00:06:49.939448+0000","last_became_active":"2023-08-17T00:06:49.511483+0000","last_became_peered":"2023-08-17T00:06:49.511483+0000","last_unstale":"2023-08-17T00:06:49.939448+0000","last_undegraded":"2023-08-17T00:06:49.939448+0000","last_fullsized":"2023-08-17T00:06:49.939448+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969434+0000","last_change":"2023-08-17T00:06:49.964492+0000","last_active":"2023-08-17T00:06:49.969434+0000","last_peered":"2023-08-17T00:06:49.969434+0000","last_clean":"2023-08-17T00:06:49.969434+0000","last_became_active":"2023-08-17T00:06:49.963481+0000","last_became_peered":"2023-08-17T00:06:49.963481+0000","last_unstale":"2023-08-17T00:06:49.969434+0000","last_undegraded":"2023-08-17T00:06:49.969434+0000","last_fullsized":"2023-08-17T00:06:49.969434+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941482+0000","last_change":"2023-08-17T00:06:49.520245+0000","last_active":"2023-08-17T00:06:49.941482+0000","last_peered":"2023-08-17T00:06:49.941482+0000","last_clean":"2023-08-17T00:06:49.941482+0000","last_became_active":"2023-08-17T00:06:49.519956+0000","last_became_peered":"2023-08-17T00:06:49.519956+0000","last_unstale":"2023-08-17T00:06:49.941482+0000","last_undegraded":"2023-08-17T00:06:49.941482+0000","last_fullsized":"2023-08-17T00:06:49.941482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965849+0000","last_change":"2023-08-17T00:06:49.963038+0000","last_active":"2023-08-17T00:06:49.965849+0000","last_peered":"2023-08-17T00:06:49.965849+0000","last_clean":"2023-08-17T00:06:49.965849+0000","last_became_active":"2023-08-17T00:06:49.962735+0000","last_became_peered":"2023-08-17T00:06:49.962735+0000","last_unstale":"2023-08-17T00:06:49.965849+0000","last_undegraded":"2023-08-17T00:06:49.965849+0000","last_fullsized":"2023-08-17T00:06:49.965849+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936020+0000","last_change":"2023-08-17T00:06:49.512550+0000","last_active":"2023-08-17T00:06:49.936020+0000","last_peered":"2023-08-17T00:06:49.936020+0000","last_clean":"2023-08-17T00:06:49.936020+0000","last_became_active":"2023-08-17T00:06:49.512217+0000","last_became_peered":"2023-08-17T00:06:49.512217+0000","last_unstale":"2023-08-17T00:06:49.936020+0000","last_undegraded":"2023-08-17T00:06:49.936020+0000","last_fullsized":"2023-08-17T00:06:49.936020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962119+0000","last_change":"2023-08-17T00:06:49.955062+0000","last_active":"2023-08-17T00:06:49.962119+0000","last_peered":"2023-08-17T00:06:49.962119+0000","last_clean":"2023-08-17T00:06:49.962119+0000","last_became_active":"2023-08-17T00:06:49.954790+0000","last_became_peered":"2023-08-17T00:06:49.954790+0000","last_unstale":"2023-08-17T00:06:49.962119+0000","last_undegraded":"2023-08-17T00:06:49.962119+0000","last_fullsized":"2023-08-17T00:06:49.962119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.937220+0000","last_change":"2023-08-17T00:06:49.509008+0000","last_active":"2023-08-17T00:06:49.937220+0000","last_peered":"2023-08-17T00:06:49.937220+0000","last_clean":"2023-08-17T00:06:49.937220+0000","last_became_active":"2023-08-17T00:06:49.508734+0000","last_became_peered":"2023-08-17T00:06:49.508734+0000","last_unstale":"2023-08-17T00:06:49.937220+0000","last_undegraded":"2023-08-17T00:06:49.937220+0000","last_fullsized":"2023-08-17T00:06:49.937220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968603+0000","last_change":"2023-08-17T00:06:49.956469+0000","last_active":"2023-08-17T00:06:49.968603+0000","last_peered":"2023-08-17T00:06:49.968603+0000","last_clean":"2023-08-17T00:06:49.968603+0000","last_became_active":"2023-08-17T00:06:49.956185+0000","last_became_peered":"2023-08-17T00:06:49.956185+0000","last_unstale":"2023-08-17T00:06:49.968603+0000","last_undegraded":"2023-08-17T00:06:49.968603+0000","last_fullsized":"2023-08-17T00:06:49.968603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943394+0000","last_change":"2023-08-17T00:06:49.516425+0000","last_active":"2023-08-17T00:06:49.943394+0000","last_peered":"2023-08-17T00:06:49.943394+0000","last_clean":"2023-08-17T00:06:49.943394+0000","last_became_active":"2023-08-17T00:06:49.516082+0000","last_became_peered":"2023-08-17T00:06:49.516082+0000","last_unstale":"2023-08-17T00:06:49.943394+0000","last_undegraded":"2023-08-17T00:06:49.943394+0000","last_fullsized":"2023-08-17T00:06:49.943394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977289+0000","last_change":"2023-08-17T00:06:49.962282+0000","last_active":"2023-08-17T00:06:49.977289+0000","last_peered":"2023-08-17T00:06:49.977289+0000","last_clean":"2023-08-17T00:06:49.977289+0000","last_became_active":"2023-08-17T00:06:49.961488+0000","last_became_peered":"2023-08-17T00:06:49.961488+0000","last_unstale":"2023-08-17T00:06:49.977289+0000","last_undegraded":"2023-08-17T00:06:49.977289+0000","last_fullsized":"2023-08-17T00:06:49.977289+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941570+0000","last_change":"2023-08-17T00:06:49.511438+0000","last_active":"2023-08-17T00:06:49.941570+0000","last_peered":"2023-08-17T00:06:49.941570+0000","last_clean":"2023-08-17T00:06:49.941570+0000","last_became_active":"2023-08-17T00:06:49.511191+0000","last_became_peered":"2023-08-17T00:06:49.511191+0000","last_unstale":"2023-08-17T00:06:49.941570+0000","last_undegraded":"2023-08-17T00:06:49.941570+0000","last_fullsized":"2023-08-17T00:06:49.941570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977271+0000","last_change":"2023-08-17T00:06:49.962278+0000","last_active":"2023-08-17T00:06:49.977271+0000","last_peered":"2023-08-17T00:06:49.977271+0000","last_clean":"2023-08-17T00:06:49.977271+0000","last_became_active":"2023-08-17T00:06:49.961796+0000","last_became_peered":"2023-08-17T00:06:49.961796+0000","last_unstale":"2023-08-17T00:06:49.977271+0000","last_undegraded":"2023-08-17T00:06:49.977271+0000","last_fullsized":"2023-08-17T00:06:49.977271+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933686+0000","last_change":"2023-08-17T00:06:49.508705+0000","last_active":"2023-08-17T00:06:49.933686+0000","last_peered":"2023-08-17T00:06:49.933686+0000","last_clean":"2023-08-17T00:06:49.933686+0000","last_became_active":"2023-08-17T00:06:49.508086+0000","last_became_peered":"2023-08-17T00:06:49.508086+0000","last_unstale":"2023-08-17T00:06:49.933686+0000","last_undegraded":"2023-08-17T00:06:49.933686+0000","last_fullsized":"2023-08-17T00:06:49.933686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977485+0000","last_change":"2023-08-17T00:06:49.971656+0000","last_active":"2023-08-17T00:06:49.977485+0000","last_peered":"2023-08-17T00:06:49.977485+0000","last_clean":"2023-08-17T00:06:49.977485+0000","last_became_active":"2023-08-17T00:06:49.965426+0000","last_became_peered":"2023-08-17T00:06:49.965426+0000","last_unstale":"2023-08-17T00:06:49.977485+0000","last_undegraded":"2023-08-17T00:06:49.977485+0000","last_fullsized":"2023-08-17T00:06:49.977485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962627+0000","last_change":"2023-08-17T00:06:49.516787+0000","last_active":"2023-08-17T00:06:49.962627+0000","last_peered":"2023-08-17T00:06:49.962627+0000","last_clean":"2023-08-17T00:06:49.962627+0000","last_became_active":"2023-08-17T00:06:49.516500+0000","last_became_peered":"2023-08-17T00:06:49.516500+0000","last_unstale":"2023-08-17T00:06:49.962627+0000","last_undegraded":"2023-08-17T00:06:49.962627+0000","last_fullsized":"2023-08-17T00:06:49.962627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968714+0000","last_change":"2023-08-17T00:06:49.956716+0000","last_active":"2023-08-17T00:06:49.968714+0000","last_peered":"2023-08-17T00:06:49.968714+0000","last_clean":"2023-08-17T00:06:49.968714+0000","last_became_active":"2023-08-17T00:06:49.956448+0000","last_became_peered":"2023-08-17T00:06:49.956448+0000","last_unstale":"2023-08-17T00:06:49.968714+0000","last_undegraded":"2023-08-17T00:06:49.968714+0000","last_fullsized":"2023-08-17T00:06:49.968714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963250+0000","last_change":"2023-08-17T00:06:49.513500+0000","last_active":"2023-08-17T00:06:49.963250+0000","last_peered":"2023-08-17T00:06:49.963250+0000","last_clean":"2023-08-17T00:06:49.963250+0000","last_became_active":"2023-08-17T00:06:49.513228+0000","last_became_peered":"2023-08-17T00:06:49.513228+0000","last_unstale":"2023-08-17T00:06:49.963250+0000","last_undegraded":"2023-08-17T00:06:49.963250+0000","last_fullsized":"2023-08-17T00:06:49.963250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952230+0000","last_change":"2023-08-17T00:06:49.947526+0000","last_active":"2023-08-17T00:06:49.952230+0000","last_peered":"2023-08-17T00:06:49.952230+0000","last_clean":"2023-08-17T00:06:49.952230+0000","last_became_active":"2023-08-17T00:06:49.946937+0000","last_became_peered":"2023-08-17T00:06:49.946937+0000","last_unstale":"2023-08-17T00:06:49.952230+0000","last_undegraded":"2023-08-17T00:06:49.952230+0000","last_fullsized":"2023-08-17T00:06:49.952230+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962524+0000","last_change":"2023-08-17T00:06:49.514747+0000","last_active":"2023-08-17T00:06:49.962524+0000","last_peered":"2023-08-17T00:06:49.962524+0000","last_clean":"2023-08-17T00:06:49.962524+0000","last_became_active":"2023-08-17T00:06:49.514389+0000","last_became_peered":"2023-08-17T00:06:49.514389+0000","last_unstale":"2023-08-17T00:06:49.962524+0000","last_undegraded":"2023-08-17T00:06:49.962524+0000","last_fullsized":"2023-08-17T00:06:49.962524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977430+0000","last_change":"2023-08-17T00:06:49.965044+0000","last_active":"2023-08-17T00:06:49.977430+0000","last_peered":"2023-08-17T00:06:49.977430+0000","last_clean":"2023-08-17T00:06:49.977430+0000","last_became_active":"2023-08-17T00:06:49.964720+0000","last_became_peered":"2023-08-17T00:06:49.964720+0000","last_unstale":"2023-08-17T00:06:49.977430+0000","last_undegraded":"2023-08-17T00:06:49.977430+0000","last_fullsized":"2023-08-17T00:06:49.977430+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935902+0000","last_change":"2023-08-17T00:06:49.516022+0000","last_active":"2023-08-17T00:06:49.935902+0000","last_peered":"2023-08-17T00:06:49.935902+0000","last_clean":"2023-08-17T00:06:49.935902+0000","last_became_active":"2023-08-17T00:06:49.515718+0000","last_became_peered":"2023-08-17T00:06:49.515718+0000","last_unstale":"2023-08-17T00:06:49.935902+0000","last_undegraded":"2023-08-17T00:06:49.935902+0000","last_fullsized":"2023-08-17T00:06:49.935902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959333+0000","last_change":"2023-08-17T00:06:49.946510+0000","last_active":"2023-08-17T00:06:49.959333+0000","last_peered":"2023-08-17T00:06:49.959333+0000","last_clean":"2023-08-17T00:06:49.959333+0000","last_became_active":"2023-08-17T00:06:49.946225+0000","last_became_peered":"2023-08-17T00:06:49.946225+0000","last_unstale":"2023-08-17T00:06:49.959333+0000","last_undegraded":"2023-08-17T00:06:49.959333+0000","last_fullsized":"2023-08-17T00:06:49.959333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935353+0000","last_change":"2023-08-17T00:06:49.508617+0000","last_active":"2023-08-17T00:06:49.935353+0000","last_peered":"2023-08-17T00:06:49.935353+0000","last_clean":"2023-08-17T00:06:49.935353+0000","last_became_active":"2023-08-17T00:06:49.508330+0000","last_became_peered":"2023-08-17T00:06:49.508330+0000","last_unstale":"2023-08-17T00:06:49.935353+0000","last_undegraded":"2023-08-17T00:06:49.935353+0000","last_fullsized":"2023-08-17T00:06:49.935353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.958632+0000","last_change":"2023-08-17T00:06:49.951641+0000","last_active":"2023-08-17T00:06:49.958632+0000","last_peered":"2023-08-17T00:06:49.958632+0000","last_clean":"2023-08-17T00:06:49.958632+0000","last_became_active":"2023-08-17T00:06:49.951372+0000","last_became_peered":"2023-08-17T00:06:49.951372+0000","last_unstale":"2023-08-17T00:06:49.958632+0000","last_undegraded":"2023-08-17T00:06:49.958632+0000","last_fullsized":"2023-08-17T00:06:49.958632+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.937549+0000","last_change":"2023-08-17T00:06:49.509117+0000","last_active":"2023-08-17T00:06:49.937549+0000","last_peered":"2023-08-17T00:06:49.937549+0000","last_clean":"2023-08-17T00:06:49.937549+0000","last_became_active":"2023-08-17T00:06:49.508812+0000","last_became_peered":"2023-08-17T00:06:49.508812+0000","last_unstale":"2023-08-17T00:06:49.937549+0000","last_undegraded":"2023-08-17T00:06:49.937549+0000","last_fullsized":"2023-08-17T00:06:49.937549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959324+0000","last_change":"2023-08-17T00:06:49.954701+0000","last_active":"2023-08-17T00:06:49.959324+0000","last_peered":"2023-08-17T00:06:49.959324+0000","last_clean":"2023-08-17T00:06:49.959324+0000","last_became_active":"2023-08-17T00:06:49.954403+0000","last_became_peered":"2023-08-17T00:06:49.954403+0000","last_unstale":"2023-08-17T00:06:49.959324+0000","last_undegraded":"2023-08-17T00:06:49.959324+0000","last_fullsized":"2023-08-17T00:06:49.959324+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941380+0000","last_change":"2023-08-17T00:06:49.513803+0000","last_active":"2023-08-17T00:06:49.941380+0000","last_peered":"2023-08-17T00:06:49.941380+0000","last_clean":"2023-08-17T00:06:49.941380+0000","last_became_active":"2023-08-17T00:06:49.513517+0000","last_became_peered":"2023-08-17T00:06:49.513517+0000","last_unstale":"2023-08-17T00:06:49.941380+0000","last_undegraded":"2023-08-17T00:06:49.941380+0000","last_fullsized":"2023-08-17T00:06:49.941380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961151+0000","last_change":"2023-08-17T00:06:49.953751+0000","last_active":"2023-08-17T00:06:49.961151+0000","last_peered":"2023-08-17T00:06:49.961151+0000","last_clean":"2023-08-17T00:06:49.961151+0000","last_became_active":"2023-08-17T00:06:49.953400+0000","last_became_peered":"2023-08-17T00:06:49.953400+0000","last_unstale":"2023-08-17T00:06:49.961151+0000","last_undegraded":"2023-08-17T00:06:49.961151+0000","last_fullsized":"2023-08-17T00:06:49.961151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.937610+0000","last_change":"2023-08-17T00:06:49.505444+0000","last_active":"2023-08-17T00:06:49.937610+0000","last_peered":"2023-08-17T00:06:49.937610+0000","last_clean":"2023-08-17T00:06:49.937610+0000","last_became_active":"2023-08-17T00:06:49.505114+0000","last_became_peered":"2023-08-17T00:06:49.505114+0000","last_unstale":"2023-08-17T00:06:49.937610+0000","last_undegraded":"2023-08-17T00:06:49.937610+0000","last_fullsized":"2023-08-17T00:06:49.937610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961731+0000","last_change":"2023-08-17T00:06:49.952802+0000","last_active":"2023-08-17T00:06:49.961731+0000","last_peered":"2023-08-17T00:06:49.961731+0000","last_clean":"2023-08-17T00:06:49.961731+0000","last_became_active":"2023-08-17T00:06:49.952394+0000","last_became_peered":"2023-08-17T00:06:49.952394+0000","last_unstale":"2023-08-17T00:06:49.961731+0000","last_undegraded":"2023-08-17T00:06:49.961731+0000","last_fullsized":"2023-08-17T00:06:49.961731+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941676+0000","last_change":"2023-08-17T00:06:49.513023+0000","last_active":"2023-08-17T00:06:49.941676+0000","last_peered":"2023-08-17T00:06:49.941676+0000","last_clean":"2023-08-17T00:06:49.941676+0000","last_became_active":"2023-08-17T00:06:49.512394+0000","last_became_peered":"2023-08-17T00:06:49.512394+0000","last_unstale":"2023-08-17T00:06:49.941676+0000","last_undegraded":"2023-08-17T00:06:49.941676+0000","last_fullsized":"2023-08-17T00:06:49.941676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959677+0000","last_change":"2023-08-17T00:06:49.948293+0000","last_active":"2023-08-17T00:06:49.959677+0000","last_peered":"2023-08-17T00:06:49.959677+0000","last_clean":"2023-08-17T00:06:49.959677+0000","last_became_active":"2023-08-17T00:06:49.947961+0000","last_became_peered":"2023-08-17T00:06:49.947961+0000","last_unstale":"2023-08-17T00:06:49.959677+0000","last_undegraded":"2023-08-17T00:06:49.959677+0000","last_fullsized":"2023-08-17T00:06:49.959677+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.939563+0000","last_change":"2023-08-17T00:06:49.522143+0000","last_active":"2023-08-17T00:06:49.939563+0000","last_peered":"2023-08-17T00:06:49.939563+0000","last_clean":"2023-08-17T00:06:49.939563+0000","last_became_active":"2023-08-17T00:06:49.521820+0000","last_became_peered":"2023-08-17T00:06:49.521820+0000","last_unstale":"2023-08-17T00:06:49.939563+0000","last_undegraded":"2023-08-17T00:06:49.939563+0000","last_fullsized":"2023-08-17T00:06:49.939563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957241+0000","last_change":"2023-08-17T00:06:49.952018+0000","last_active":"2023-08-17T00:06:49.957241+0000","last_peered":"2023-08-17T00:06:49.957241+0000","last_clean":"2023-08-17T00:06:49.957241+0000","last_became_active":"2023-08-17T00:06:49.949326+0000","last_became_peered":"2023-08-17T00:06:49.949326+0000","last_unstale":"2023-08-17T00:06:49.957241+0000","last_undegraded":"2023-08-17T00:06:49.957241+0000","last_fullsized":"2023-08-17T00:06:49.957241+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968671+0000","last_change":"2023-08-17T00:06:49.516309+0000","last_active":"2023-08-17T00:06:49.968671+0000","last_peered":"2023-08-17T00:06:49.968671+0000","last_clean":"2023-08-17T00:06:49.968671+0000","last_became_active":"2023-08-17T00:06:49.516012+0000","last_became_peered":"2023-08-17T00:06:49.516012+0000","last_unstale":"2023-08-17T00:06:49.968671+0000","last_undegraded":"2023-08-17T00:06:49.968671+0000","last_fullsized":"2023-08-17T00:06:49.968671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969818+0000","last_change":"2023-08-17T00:06:49.960851+0000","last_active":"2023-08-17T00:06:49.969818+0000","last_peered":"2023-08-17T00:06:49.969818+0000","last_clean":"2023-08-17T00:06:49.969818+0000","last_became_active":"2023-08-17T00:06:49.960557+0000","last_became_peered":"2023-08-17T00:06:49.960557+0000","last_unstale":"2023-08-17T00:06:49.969818+0000","last_undegraded":"2023-08-17T00:06:49.969818+0000","last_fullsized":"2023-08-17T00:06:49.969818+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.960120+0000","last_change":"2023-08-17T00:06:49.508182+0000","last_active":"2023-08-17T00:06:49.960120+0000","last_peered":"2023-08-17T00:06:49.960120+0000","last_clean":"2023-08-17T00:06:49.960120+0000","last_became_active":"2023-08-17T00:06:49.507644+0000","last_became_peered":"2023-08-17T00:06:49.507644+0000","last_unstale":"2023-08-17T00:06:49.960120+0000","last_undegraded":"2023-08-17T00:06:49.960120+0000","last_fullsized":"2023-08-17T00:06:49.960120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.958031+0000","last_change":"2023-08-17T00:06:49.950966+0000","last_active":"2023-08-17T00:06:49.958031+0000","last_peered":"2023-08-17T00:06:49.958031+0000","last_clean":"2023-08-17T00:06:49.958031+0000","last_became_active":"2023-08-17T00:06:49.950694+0000","last_became_peered":"2023-08-17T00:06:49.950694+0000","last_unstale":"2023-08-17T00:06:49.958031+0000","last_undegraded":"2023-08-17T00:06:49.958031+0000","last_fullsized":"2023-08-17T00:06:49.958031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977591+0000","last_change":"2023-08-17T00:06:49.514617+0000","last_active":"2023-08-17T00:06:49.977591+0000","last_peered":"2023-08-17T00:06:49.977591+0000","last_clean":"2023-08-17T00:06:49.977591+0000","last_became_active":"2023-08-17T00:06:49.514221+0000","last_became_peered":"2023-08-17T00:06:49.514221+0000","last_unstale":"2023-08-17T00:06:49.977591+0000","last_undegraded":"2023-08-17T00:06:49.977591+0000","last_fullsized":"2023-08-17T00:06:49.977591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964749+0000","last_change":"2023-08-17T00:06:49.960051+0000","last_active":"2023-08-17T00:06:49.964749+0000","last_peered":"2023-08-17T00:06:49.964749+0000","last_clean":"2023-08-17T00:06:49.964749+0000","last_became_active":"2023-08-17T00:06:49.959615+0000","last_became_peered":"2023-08-17T00:06:49.959615+0000","last_unstale":"2023-08-17T00:06:49.964749+0000","last_undegraded":"2023-08-17T00:06:49.964749+0000","last_fullsized":"2023-08-17T00:06:49.964749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942227+0000","last_change":"2023-08-17T00:06:49.511576+0000","last_active":"2023-08-17T00:06:49.942227+0000","last_peered":"2023-08-17T00:06:49.942227+0000","last_clean":"2023-08-17T00:06:49.942227+0000","last_became_active":"2023-08-17T00:06:49.511318+0000","last_became_peered":"2023-08-17T00:06:49.511318+0000","last_unstale":"2023-08-17T00:06:49.942227+0000","last_undegraded":"2023-08-17T00:06:49.942227+0000","last_fullsized":"2023-08-17T00:06:49.942227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961596+0000","last_change":"2023-08-17T00:06:49.955884+0000","last_active":"2023-08-17T00:06:49.961596+0000","last_peered":"2023-08-17T00:06:49.961596+0000","last_clean":"2023-08-17T00:06:49.961596+0000","last_became_active":"2023-08-17T00:06:49.955620+0000","last_became_peered":"2023-08-17T00:06:49.955620+0000","last_unstale":"2023-08-17T00:06:49.961596+0000","last_undegraded":"2023-08-17T00:06:49.961596+0000","last_fullsized":"2023-08-17T00:06:49.961596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.945631+0000","last_change":"2023-08-17T00:06:49.512366+0000","last_active":"2023-08-17T00:06:49.945631+0000","last_peered":"2023-08-17T00:06:49.945631+0000","last_clean":"2023-08-17T00:06:49.945631+0000","last_became_active":"2023-08-17T00:06:49.511783+0000","last_became_peered":"2023-08-17T00:06:49.511783+0000","last_unstale":"2023-08-17T00:06:49.945631+0000","last_undegraded":"2023-08-17T00:06:49.945631+0000","last_fullsized":"2023-08-17T00:06:49.945631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965208+0000","last_change":"2023-08-17T00:06:49.964265+0000","last_active":"2023-08-17T00:06:49.965208+0000","last_peered":"2023-08-17T00:06:49.965208+0000","last_clean":"2023-08-17T00:06:49.965208+0000","last_became_active":"2023-08-17T00:06:49.964004+0000","last_became_peered":"2023-08-17T00:06:49.964004+0000","last_unstale":"2023-08-17T00:06:49.965208+0000","last_undegraded":"2023-08-17T00:06:49.965208+0000","last_fullsized":"2023-08-17T00:06:49.965208+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964305+0000","last_change":"2023-08-17T00:06:49.512678+0000","last_active":"2023-08-17T00:06:49.964305+0000","last_peered":"2023-08-17T00:06:49.964305+0000","last_clean":"2023-08-17T00:06:49.964305+0000","last_became_active":"2023-08-17T00:06:49.512417+0000","last_became_peered":"2023-08-17T00:06:49.512417+0000","last_unstale":"2023-08-17T00:06:49.964305+0000","last_undegraded":"2023-08-17T00:06:49.964305+0000","last_fullsized":"2023-08-17T00:06:49.964305+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959773+0000","last_change":"2023-08-17T00:06:49.948378+0000","last_active":"2023-08-17T00:06:49.959773+0000","last_peered":"2023-08-17T00:06:49.959773+0000","last_clean":"2023-08-17T00:06:49.959773+0000","last_became_active":"2023-08-17T00:06:49.948039+0000","last_became_peered":"2023-08-17T00:06:49.948039+0000","last_unstale":"2023-08-17T00:06:49.959773+0000","last_undegraded":"2023-08-17T00:06:49.959773+0000","last_fullsized":"2023-08-17T00:06:49.959773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977625+0000","last_change":"2023-08-17T00:06:49.512646+0000","last_active":"2023-08-17T00:06:49.977625+0000","last_peered":"2023-08-17T00:06:49.977625+0000","last_clean":"2023-08-17T00:06:49.977625+0000","last_became_active":"2023-08-17T00:06:49.511754+0000","last_became_peered":"2023-08-17T00:06:49.511754+0000","last_unstale":"2023-08-17T00:06:49.977625+0000","last_undegraded":"2023-08-17T00:06:49.977625+0000","last_fullsized":"2023-08-17T00:06:49.977625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959770+0000","last_change":"2023-08-17T00:06:49.951952+0000","last_active":"2023-08-17T00:06:49.959770+0000","last_peered":"2023-08-17T00:06:49.959770+0000","last_clean":"2023-08-17T00:06:49.959770+0000","last_became_active":"2023-08-17T00:06:49.951497+0000","last_became_peered":"2023-08-17T00:06:49.951497+0000","last_unstale":"2023-08-17T00:06:49.959770+0000","last_undegraded":"2023-08-17T00:06:49.959770+0000","last_fullsized":"2023-08-17T00:06:49.959770+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943806+0000","last_change":"2023-08-17T00:06:49.520646+0000","last_active":"2023-08-17T00:06:49.943806+0000","last_peered":"2023-08-17T00:06:49.943806+0000","last_clean":"2023-08-17T00:06:49.943806+0000","last_became_active":"2023-08-17T00:06:49.513607+0000","last_became_peered":"2023-08-17T00:06:49.513607+0000","last_unstale":"2023-08-17T00:06:49.943806+0000","last_undegraded":"2023-08-17T00:06:49.943806+0000","last_fullsized":"2023-08-17T00:06:49.943806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968675+0000","last_change":"2023-08-17T00:06:49.956493+0000","last_active":"2023-08-17T00:06:49.968675+0000","last_peered":"2023-08-17T00:06:49.968675+0000","last_clean":"2023-08-17T00:06:49.968675+0000","last_became_active":"2023-08-17T00:06:49.956175+0000","last_became_peered":"2023-08-17T00:06:49.956175+0000","last_unstale":"2023-08-17T00:06:49.968675+0000","last_undegraded":"2023-08-17T00:06:49.968675+0000","last_fullsized":"2023-08-17T00:06:49.968675+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936396+0000","last_change":"2023-08-17T00:06:49.510750+0000","last_active":"2023-08-17T00:06:49.936396+0000","last_peered":"2023-08-17T00:06:49.936396+0000","last_clean":"2023-08-17T00:06:49.936396+0000","last_became_active":"2023-08-17T00:06:49.510500+0000","last_became_peered":"2023-08-17T00:06:49.510500+0000","last_unstale":"2023-08-17T00:06:49.936396+0000","last_undegraded":"2023-08-17T00:06:49.936396+0000","last_fullsized":"2023-08-17T00:06:49.936396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969854+0000","last_change":"2023-08-17T00:06:49.964221+0000","last_active":"2023-08-17T00:06:49.969854+0000","last_peered":"2023-08-17T00:06:49.969854+0000","last_clean":"2023-08-17T00:06:49.969854+0000","last_became_active":"2023-08-17T00:06:49.963851+0000","last_became_peered":"2023-08-17T00:06:49.963851+0000","last_unstale":"2023-08-17T00:06:49.969854+0000","last_undegraded":"2023-08-17T00:06:49.969854+0000","last_fullsized":"2023-08-17T00:06:49.969854+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941445+0000","last_change":"2023-08-17T00:06:49.514391+0000","last_active":"2023-08-17T00:06:49.941445+0000","last_peered":"2023-08-17T00:06:49.941445+0000","last_clean":"2023-08-17T00:06:49.941445+0000","last_became_active":"2023-08-17T00:06:49.514083+0000","last_became_peered":"2023-08-17T00:06:49.514083+0000","last_unstale":"2023-08-17T00:06:49.941445+0000","last_undegraded":"2023-08-17T00:06:49.941445+0000","last_fullsized":"2023-08-17T00:06:49.941445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.974778+0000","last_change":"2023-08-17T00:06:49.953480+0000","last_active":"2023-08-17T00:06:49.974778+0000","last_peered":"2023-08-17T00:06:49.974778+0000","last_clean":"2023-08-17T00:06:49.974778+0000","last_became_active":"2023-08-17T00:06:49.953163+0000","last_became_peered":"2023-08-17T00:06:49.953163+0000","last_unstale":"2023-08-17T00:06:49.974778+0000","last_undegraded":"2023-08-17T00:06:49.974778+0000","last_fullsized":"2023-08-17T00:06:49.974778+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940007+0000","last_change":"2023-08-17T00:06:49.513905+0000","last_active":"2023-08-17T00:06:49.940007+0000","last_peered":"2023-08-17T00:06:49.940007+0000","last_clean":"2023-08-17T00:06:49.940007+0000","last_became_active":"2023-08-17T00:06:49.513180+0000","last_became_peered":"2023-08-17T00:06:49.513180+0000","last_unstale":"2023-08-17T00:06:49.940007+0000","last_undegraded":"2023-08-17T00:06:49.940007+0000","last_fullsized":"2023-08-17T00:06:49.940007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963654+0000","last_change":"2023-08-17T00:06:49.956020+0000","last_active":"2023-08-17T00:06:49.963654+0000","last_peered":"2023-08-17T00:06:49.963654+0000","last_clean":"2023-08-17T00:06:49.963654+0000","last_became_active":"2023-08-17T00:06:49.955731+0000","last_became_peered":"2023-08-17T00:06:49.955731+0000","last_unstale":"2023-08-17T00:06:49.963654+0000","last_undegraded":"2023-08-17T00:06:49.963654+0000","last_fullsized":"2023-08-17T00:06:49.963654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940569+0000","last_change":"2023-08-17T00:06:49.516633+0000","last_active":"2023-08-17T00:06:49.940569+0000","last_peered":"2023-08-17T00:06:49.940569+0000","last_clean":"2023-08-17T00:06:49.940569+0000","last_became_active":"2023-08-17T00:06:49.516356+0000","last_became_peered":"2023-08-17T00:06:49.516356+0000","last_unstale":"2023-08-17T00:06:49.940569+0000","last_undegraded":"2023-08-17T00:06:49.940569+0000","last_fullsized":"2023-08-17T00:06:49.940569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.956573+0000","last_change":"2023-08-17T00:06:49.952327+0000","last_active":"2023-08-17T00:06:49.956573+0000","last_peered":"2023-08-17T00:06:49.956573+0000","last_clean":"2023-08-17T00:06:49.956573+0000","last_became_active":"2023-08-17T00:06:49.951999+0000","last_became_peered":"2023-08-17T00:06:49.951999+0000","last_unstale":"2023-08-17T00:06:49.956573+0000","last_undegraded":"2023-08-17T00:06:49.956573+0000","last_fullsized":"2023-08-17T00:06:49.956573+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941544+0000","last_change":"2023-08-17T00:06:49.516661+0000","last_active":"2023-08-17T00:06:49.941544+0000","last_peered":"2023-08-17T00:06:49.941544+0000","last_clean":"2023-08-17T00:06:49.941544+0000","last_became_active":"2023-08-17T00:06:49.516378+0000","last_became_peered":"2023-08-17T00:06:49.516378+0000","last_unstale":"2023-08-17T00:06:49.941544+0000","last_undegraded":"2023-08-17T00:06:49.941544+0000","last_fullsized":"2023-08-17T00:06:49.941544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961175+0000","last_change":"2023-08-17T00:06:49.954094+0000","last_active":"2023-08-17T00:06:49.961175+0000","last_peered":"2023-08-17T00:06:49.961175+0000","last_clean":"2023-08-17T00:06:49.961175+0000","last_became_active":"2023-08-17T00:06:49.953043+0000","last_became_peered":"2023-08-17T00:06:49.953043+0000","last_unstale":"2023-08-17T00:06:49.961175+0000","last_undegraded":"2023-08-17T00:06:49.961175+0000","last_fullsized":"2023-08-17T00:06:49.961175+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936291+0000","last_change":"2023-08-17T00:06:49.505982+0000","last_active":"2023-08-17T00:06:49.936291+0000","last_peered":"2023-08-17T00:06:49.936291+0000","last_clean":"2023-08-17T00:06:49.936291+0000","last_became_active":"2023-08-17T00:06:49.505667+0000","last_became_peered":"2023-08-17T00:06:49.505667+0000","last_unstale":"2023-08-17T00:06:49.936291+0000","last_undegraded":"2023-08-17T00:06:49.936291+0000","last_fullsized":"2023-08-17T00:06:49.936291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969838+0000","last_change":"2023-08-17T00:06:49.964156+0000","last_active":"2023-08-17T00:06:49.969838+0000","last_peered":"2023-08-17T00:06:49.969838+0000","last_clean":"2023-08-17T00:06:49.969838+0000","last_became_active":"2023-08-17T00:06:49.963499+0000","last_became_peered":"2023-08-17T00:06:49.963499+0000","last_unstale":"2023-08-17T00:06:49.969838+0000","last_undegraded":"2023-08-17T00:06:49.969838+0000","last_fullsized":"2023-08-17T00:06:49.969838+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941566+0000","last_change":"2023-08-17T00:06:49.512245+0000","last_active":"2023-08-17T00:06:49.941566+0000","last_peered":"2023-08-17T00:06:49.941566+0000","last_clean":"2023-08-17T00:06:49.941566+0000","last_became_active":"2023-08-17T00:06:49.511971+0000","last_became_peered":"2023-08-17T00:06:49.511971+0000","last_unstale":"2023-08-17T00:06:49.941566+0000","last_undegraded":"2023-08-17T00:06:49.941566+0000","last_fullsized":"2023-08-17T00:06:49.941566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.947791+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:06:49.947791+0000","last_peered":"2023-08-17T00:06:49.947791+0000","last_clean":"2023-08-17T00:06:49.947791+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:06:49.947791+0000","last_undegraded":"2023-08-17T00:06:49.947791+0000","last_fullsized":"2023-08-17T00:06:49.947791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957258+0000","last_change":"2023-08-17T00:06:49.952028+0000","last_active":"2023-08-17T00:06:49.957258+0000","last_peered":"2023-08-17T00:06:49.957258+0000","last_clean":"2023-08-17T00:06:49.957258+0000","last_became_active":"2023-08-17T00:06:49.949293+0000","last_became_peered":"2023-08-17T00:06:49.949293+0000","last_unstale":"2023-08-17T00:06:49.957258+0000","last_undegraded":"2023-08-17T00:06:49.957258+0000","last_fullsized":"2023-08-17T00:06:49.957258+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.946223+0000","last_change":"2023-08-17T00:06:49.520458+0000","last_active":"2023-08-17T00:06:49.946223+0000","last_peered":"2023-08-17T00:06:49.946223+0000","last_clean":"2023-08-17T00:06:49.946223+0000","last_became_active":"2023-08-17T00:06:49.519512+0000","last_became_peered":"2023-08-17T00:06:49.519512+0000","last_unstale":"2023-08-17T00:06:49.946223+0000","last_undegraded":"2023-08-17T00:06:49.946223+0000","last_fullsized":"2023-08-17T00:06:49.946223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933933+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:49.933933+0000","last_peered":"2023-08-17T00:06:49.933933+0000","last_clean":"2023-08-17T00:06:49.933933+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:49.933933+0000","last_undegraded":"2023-08-17T00:06:49.933933+0000","last_fullsized":"2023-08-17T00:06:49.933933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963711+0000","last_change":"2023-08-17T00:06:49.956976+0000","last_active":"2023-08-17T00:06:49.963711+0000","last_peered":"2023-08-17T00:06:49.963711+0000","last_clean":"2023-08-17T00:06:49.963711+0000","last_became_active":"2023-08-17T00:06:49.956720+0000","last_became_peered":"2023-08-17T00:06:49.956720+0000","last_unstale":"2023-08-17T00:06:49.963711+0000","last_undegraded":"2023-08-17T00:06:49.963711+0000","last_fullsized":"2023-08-17T00:06:49.963711+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977651+0000","last_change":"2023-08-17T00:06:49.506774+0000","last_active":"2023-08-17T00:06:49.977651+0000","last_peered":"2023-08-17T00:06:49.977651+0000","last_clean":"2023-08-17T00:06:49.977651+0000","last_became_active":"2023-08-17T00:06:49.506507+0000","last_became_peered":"2023-08-17T00:06:49.506507+0000","last_unstale":"2023-08-17T00:06:49.977651+0000","last_undegraded":"2023-08-17T00:06:49.977651+0000","last_fullsized":"2023-08-17T00:06:49.977651+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.946297+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:06:49.946297+0000","last_peered":"2023-08-17T00:06:49.946297+0000","last_clean":"2023-08-17T00:06:49.946297+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:06:49.946297+0000","last_undegraded":"2023-08-17T00:06:49.946297+0000","last_fullsized":"2023-08-17T00:06:49.946297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977467+0000","last_change":"2023-08-17T00:06:49.971505+0000","last_active":"2023-08-17T00:06:49.977467+0000","last_peered":"2023-08-17T00:06:49.977467+0000","last_clean":"2023-08-17T00:06:49.977467+0000","last_became_active":"2023-08-17T00:06:49.965317+0000","last_became_peered":"2023-08-17T00:06:49.965317+0000","last_unstale":"2023-08-17T00:06:49.977467+0000","last_undegraded":"2023-08-17T00:06:49.977467+0000","last_fullsized":"2023-08-17T00:06:49.977467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977667+0000","last_change":"2023-08-17T00:06:49.512846+0000","last_active":"2023-08-17T00:06:49.977667+0000","last_peered":"2023-08-17T00:06:49.977667+0000","last_clean":"2023-08-17T00:06:49.977667+0000","last_became_active":"2023-08-17T00:06:49.512076+0000","last_became_peered":"2023-08-17T00:06:49.512076+0000","last_unstale":"2023-08-17T00:06:49.977667+0000","last_undegraded":"2023-08-17T00:06:49.977667+0000","last_fullsized":"2023-08-17T00:06:49.977667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936120+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:06:49.936120+0000","last_peered":"2023-08-17T00:06:49.936120+0000","last_clean":"2023-08-17T00:06:49.936120+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:06:49.936120+0000","last_undegraded":"2023-08-17T00:06:49.936120+0000","last_fullsized":"2023-08-17T00:06:49.936120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977366+0000","last_change":"2023-08-17T00:06:49.965098+0000","last_active":"2023-08-17T00:06:49.977366+0000","last_peered":"2023-08-17T00:06:49.977366+0000","last_clean":"2023-08-17T00:06:49.977366+0000","last_became_active":"2023-08-17T00:06:49.964754+0000","last_became_peered":"2023-08-17T00:06:49.964754+0000","last_unstale":"2023-08-17T00:06:49.977366+0000","last_undegraded":"2023-08-17T00:06:49.977366+0000","last_fullsized":"2023-08-17T00:06:49.977366+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934830+0000","last_change":"2023-08-17T00:06:49.508435+0000","last_active":"2023-08-17T00:06:49.934830+0000","last_peered":"2023-08-17T00:06:49.934830+0000","last_clean":"2023-08-17T00:06:49.934830+0000","last_became_active":"2023-08-17T00:06:49.507937+0000","last_became_peered":"2023-08-17T00:06:49.507937+0000","last_unstale":"2023-08-17T00:06:49.934830+0000","last_undegraded":"2023-08-17T00:06:49.934830+0000","last_fullsized":"2023-08-17T00:06:49.934830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943478+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:06:49.943478+0000","last_peered":"2023-08-17T00:06:49.943478+0000","last_clean":"2023-08-17T00:06:49.943478+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:06:49.943478+0000","last_undegraded":"2023-08-17T00:06:49.943478+0000","last_fullsized":"2023-08-17T00:06:49.943478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965819+0000","last_change":"2023-08-17T00:06:49.963219+0000","last_active":"2023-08-17T00:06:49.965819+0000","last_peered":"2023-08-17T00:06:49.965819+0000","last_clean":"2023-08-17T00:06:49.965819+0000","last_became_active":"2023-08-17T00:06:49.962338+0000","last_became_peered":"2023-08-17T00:06:49.962338+0000","last_unstale":"2023-08-17T00:06:49.965819+0000","last_undegraded":"2023-08-17T00:06:49.965819+0000","last_fullsized":"2023-08-17T00:06:49.965819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942262+0000","last_change":"2023-08-17T00:06:49.519532+0000","last_active":"2023-08-17T00:06:49.942262+0000","last_peered":"2023-08-17T00:06:49.942262+0000","last_clean":"2023-08-17T00:06:49.942262+0000","last_became_active":"2023-08-17T00:06:49.519136+0000","last_became_peered":"2023-08-17T00:06:49.519136+0000","last_unstale":"2023-08-17T00:06:49.942262+0000","last_undegraded":"2023-08-17T00:06:49.942262+0000","last_fullsized":"2023-08-17T00:06:49.942262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941646+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:06:49.941646+0000","last_peered":"2023-08-17T00:06:49.941646+0000","last_clean":"2023-08-17T00:06:49.941646+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:06:49.941646+0000","last_undegraded":"2023-08-17T00:06:49.941646+0000","last_fullsized":"2023-08-17T00:06:49.941646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952056+0000","last_change":"2023-08-17T00:06:49.947221+0000","last_active":"2023-08-17T00:06:49.952056+0000","last_peered":"2023-08-17T00:06:49.952056+0000","last_clean":"2023-08-17T00:06:49.952056+0000","last_became_active":"2023-08-17T00:06:49.946842+0000","last_became_peered":"2023-08-17T00:06:49.946842+0000","last_unstale":"2023-08-17T00:06:49.952056+0000","last_undegraded":"2023-08-17T00:06:49.952056+0000","last_fullsized":"2023-08-17T00:06:49.952056+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966544+0000","last_change":"2023-08-17T00:06:49.508411+0000","last_active":"2023-08-17T00:06:49.966544+0000","last_peered":"2023-08-17T00:06:49.966544+0000","last_clean":"2023-08-17T00:06:49.966544+0000","last_became_active":"2023-08-17T00:06:49.507447+0000","last_became_peered":"2023-08-17T00:06:49.507447+0000","last_unstale":"2023-08-17T00:06:49.966544+0000","last_undegraded":"2023-08-17T00:06:49.966544+0000","last_fullsized":"2023-08-17T00:06:49.966544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.944864+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:06:49.944864+0000","last_peered":"2023-08-17T00:06:49.944864+0000","last_clean":"2023-08-17T00:06:49.944864+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:06:49.944864+0000","last_undegraded":"2023-08-17T00:06:49.944864+0000","last_fullsized":"2023-08-17T00:06:49.944864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964492+0000","last_change":"2023-08-17T00:06:49.960428+0000","last_active":"2023-08-17T00:06:49.964492+0000","last_peered":"2023-08-17T00:06:49.964492+0000","last_clean":"2023-08-17T00:06:49.964492+0000","last_became_active":"2023-08-17T00:06:49.960144+0000","last_became_peered":"2023-08-17T00:06:49.960144+0000","last_unstale":"2023-08-17T00:06:49.964492+0000","last_undegraded":"2023-08-17T00:06:49.964492+0000","last_fullsized":"2023-08-17T00:06:49.964492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936491+0000","last_change":"2023-08-17T00:06:49.510208+0000","last_active":"2023-08-17T00:06:49.936491+0000","last_peered":"2023-08-17T00:06:49.936491+0000","last_clean":"2023-08-17T00:06:49.936491+0000","last_became_active":"2023-08-17T00:06:49.509891+0000","last_became_peered":"2023-08-17T00:06:49.509891+0000","last_unstale":"2023-08-17T00:06:49.936491+0000","last_undegraded":"2023-08-17T00:06:49.936491+0000","last_fullsized":"2023-08-17T00:06:49.936491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.944544+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:06:49.944544+0000","last_peered":"2023-08-17T00:06:49.944544+0000","last_clean":"2023-08-17T00:06:49.944544+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:06:49.944544+0000","last_undegraded":"2023-08-17T00:06:49.944544+0000","last_fullsized":"2023-08-17T00:06:49.944544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935354+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:06:49.935354+0000","last_peered":"2023-08-17T00:06:49.935354+0000","last_clean":"2023-08-17T00:06:49.935354+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:06:49.935354+0000","last_undegraded":"2023-08-17T00:06:49.935354+0000","last_fullsized":"2023-08-17T00:06:49.935354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542196,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065812,"statfs":{"total":96636764160,"available":96323391488,"internally_reserved":0,"allocated":757760,"data_stored":337585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.236,"15min":1.4119999999999999},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5529999999999999,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.143,"5min":1.2529999999999999,"15min":1.4610000000000001},"min":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.472,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":0.88700000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2729999999999999,"15min":1.474},"min":{"1min":0.747,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.629,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.2589999999999999,"15min":1.46},"min":{"1min":0.72199999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.3959999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":0.98199999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1819999999999999,"15min":1.3280000000000001},"min":{"1min":0.81699999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4450000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":1.054},{"interface":"front","average":{"1min":1.248,"5min":1.3300000000000001,"15min":1.4930000000000001},"min":{"1min":0.92600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.681,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2350000000000001,"15min":1.3560000000000001},"min":{"1min":0.92100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.454,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.5069999999999999,"15min":1.7490000000000001},"min":{"1min":0.875,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7370000000000001,"5min":13.074999999999999,"15min":13.074999999999999},"last":1.0880000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.4299999999999999,"15min":1.7310000000000001},"min":{"1min":0.90200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.107},{"interface":"front","average":{"1min":1.206,"5min":1.389,"15min":1.593},"min":{"1min":0.63600000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5369999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.3919999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.5620000000000001,"15min":1.8680000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.6120000000000001,"5min":14.435,"15min":14.435},"last":1.25},{"interface":"front","average":{"1min":1.292,"5min":1.54,"15min":1.8089999999999999},"min":{"1min":0.81799999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.569,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.1839999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5669999999999999,"15min":1.8129999999999999},"min":{"1min":0.86899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.546,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.5069999999999999,"15min":1.718},"min":{"1min":1.03,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.522,"5min":11.365,"15min":11.365},"last":1.2969999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314228,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057612,"statfs":{"total":96636764160,"available":96314994688,"internally_reserved":0,"allocated":765952,"data_stored":338713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1000000000000001,"15min":1.05},"min":{"1min":0.67200000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.6120000000000001,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.1559999999999999,"15min":1.1459999999999999},"min":{"1min":0.70799999999999996,"5min":0.502,"15min":0.502},"max":{"1min":8.1750000000000007,"5min":8.1750000000000007,"15min":8.1750000000000007},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.1950000000000001,"15min":1.1120000000000001},"min":{"1min":0.70899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":10.355,"5min":10.355,"15min":10.355},"last":1.103},{"interface":"front","average":{"1min":1.619,"5min":1.1259999999999999,"15min":1.016},"min":{"1min":0.69199999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.091}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1910000000000001,"15min":1.1739999999999999},"min":{"1min":0.72799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.6970000000000001,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.645,"5min":1.3069999999999999,"15min":1.27},"min":{"1min":0.89800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":1.2789999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":1.2629999999999999,"15min":1.177},"min":{"1min":0.73899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":11.475,"5min":11.475,"15min":11.475},"last":1.232},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.29,"15min":1.2709999999999999},"min":{"1min":0.75600000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.734,"5min":5.29,"15min":5.29},"last":1.1499999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.80600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":8.2230000000000008},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.3120000000000001,"15min":1.2350000000000001},"min":{"1min":0.69299999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":11.438000000000001,"5min":11.438000000000001,"15min":11.438000000000001},"last":1.008}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.79100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4630000000000001,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":1.04},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.403,"15min":1.337},"min":{"1min":0.93899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":1.347}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.4019999999999999,"15min":1.333},"min":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":11.51,"5min":11.51,"15min":11.51},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.4239999999999999,"15min":1.429},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.552,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.4419999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306036,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065804,"statfs":{"total":96636764160,"available":96323383296,"internally_reserved":0,"allocated":765952,"data_stored":332191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.651},"min":{"1min":0.71799999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3300000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.421,"15min":1.8400000000000001},"min":{"1min":0.68200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.742,"5min":16.838999999999999,"15min":16.838999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.67300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.4490000000000001,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.143,"5min":1.3140000000000001,"15min":1.542},"min":{"1min":0.80200000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.83399999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.472,"15min":1.8540000000000001},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4199999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.377,"15min":1.6539999999999999},"min":{"1min":0.752,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.425,"5min":11.949,"15min":11.949},"last":1.208}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.4299999999999999,"15min":1.7090000000000001},"min":{"1min":0.83399999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.988,"5min":13.125,"15min":13.125},"last":1.131},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.3620000000000001,"15min":1.5720000000000001},"min":{"1min":0.79700000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6000000000000001,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.2789999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.5489999999999999,"15min":1.919},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.4650000000000001,"5min":17.510000000000002,"15min":17.510000000000002},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.157,"5min":1.651,"15min":2.0910000000000002},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5700000000000001,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.423}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.627,"15min":2.0230000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.714,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.631,"15min":2.0190000000000001},"min":{"1min":0.96099999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.669,"5min":17.050000000000001,"15min":17.050000000000001},"last":1.244}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.7549999999999999,"15min":2.1549999999999998},"min":{"1min":1.097,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.589,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.339,"5min":1.694,"15min":2.016},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.774,"5min":14.818,"15min":14.818},"last":1.389}]}]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065812,"statfs":{"total":96636764160,"available":96323391488,"internally_reserved":0,"allocated":757760,"data_stored":337605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.103}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.472}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.452},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.4339999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3140000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.397},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.276}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.214},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.2929999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":761856,"data_stored":337571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.84799999999999998,"15min":0.91600000000000004},"min":{"1min":0.39900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.1439999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.091},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.827,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":1.032}]},{"osd":1,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.91400000000000003,"15min":0.96999999999999997},"min":{"1min":0.51100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2549999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0840000000000001,"15min":1.149},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.9159999999999999,"5min":3.911,"15min":3.911},"last":0.83599999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.2,"15min":1.3080000000000001},"min":{"1min":0.56799999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.9530000000000001,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.032,"5min":1.03,"15min":1.0800000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.2530000000000001,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":1.0740000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.7290000000000001,"15min":2.04},"min":{"1min":0.80600000000000005,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.6739999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":1.119},{"interface":"front","average":{"1min":1.23,"5min":1.5509999999999999,"15min":1.7330000000000001},"min":{"1min":0.82999999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":2.0649999999999999,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.1830000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.681,"15min":1.889},"min":{"1min":0.748,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.1440000000000001,"5min":12.914,"15min":12.914},"last":1.4419999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.4910000000000001,"15min":1.645},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.228}]},{"osd":6,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.6419999999999999,"15min":1.861},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.7689999999999999,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.6830000000000001,"15min":1.899},"min":{"1min":0.86199999999999999,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.2210000000000001,"5min":12.698,"15min":12.698},"last":1.329}]},{"osd":7,"last update":"Thu Aug 17 00:05:54 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.6479999999999999,"15min":1.8240000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.72,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.48},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.651,"15min":1.8340000000000001},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.956,"5min":11.417,"15min":11.417},"last":1.3600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542196,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301924,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069916,"statfs":{"total":96636764160,"available":96327593984,"internally_reserved":0,"allocated":749568,"data_stored":331737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85699999999999998,"15min":0.82299999999999995},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4810000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.97799999999999998,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6379999999999999,"5min":13.093,"15min":13.093},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.53500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.452,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.93500000000000005,"15min":0.91600000000000004},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3779999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":0.94799999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0629999999999999,"15min":1.05},"min":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2909999999999999,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":1.036},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0329999999999999,"15min":1.022},"min":{"1min":0.56799999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.327,"5min":12.981999999999999,"15min":12.981999999999999},"last":1.0209999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.2849999999999999,"15min":1.196},"min":{"1min":0.75900000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.363,"5min":20.548999999999999,"15min":20.548999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":0.90900000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.49,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.234}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.401,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8540000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.2789999999999999,"15min":1.302},"min":{"1min":0.86299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6850000000000001,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.266}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3240000000000001,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.722,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.54,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.349}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.96199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.615,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.296},{"interface":"front","average":{"1min":1.22,"5min":1.397,"15min":1.407},"min":{"1min":0.877,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.77,"5min":13.131,"15min":13.131},"last":1.486}]}]},{"osd":0,"up_from":14,"seq":60129542197,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065812,"statfs":{"total":96636764160,"available":96323391488,"internally_reserved":0,"allocated":757760,"data_stored":338407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":0.66100000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.83899999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.6599999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.359}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.385}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.2190000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":753664,"data_stored":337515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":1.27},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":1.036}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.129},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.1499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":0.995},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.95699999999999996},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.214}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.355},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.341}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.242},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:59.119 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:06:59.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 Processor -- start 2023-08-17T00:06:59.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 -- start start 2023-08-17T00:06:59.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b100689c0 0x7f5b10068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5b10151530 0x7f5b101519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b10065da0 con 0x7f5b101560f0 2023-08-17T00:06:59.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b10155c60 con 0x7f5b100689c0 2023-08-17T00:06:59.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15d47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b10156550 con 0x7f5b10151530 2023-08-17T00:06:59.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b14d45700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5b100689c0 0x7f5b10068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b07fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5b101560f0 0x7f5b100c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42352/0 (socket says 172.21.15.153:42352) 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b07fff700 1 -- 172.21.15.153:0/1755980034 learned_addr learned my addr 172.21.15.153:0/1755980034 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.280+0000 7f5b15546700 1 --2- 172.21.15.153:0/1755980034 >> v2:172.21.15.178:3300/0 conn(0x7f5b10151530 0x7f5b101519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b077fe700 1 -- 172.21.15.153:0/1755980034 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762774069 0 0) 0x7f5b10065da0 con 0x7f5b101560f0 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b077fe700 1 -- 172.21.15.153:0/1755980034 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af80033f0 con 0x7f5b101560f0 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b14d45700 1 -- 172.21.15.153:0/1755980034 >> v2:172.21.15.178:3300/0 conn(0x7f5b10151530 msgr2=0x7f5b101519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b14d45700 1 --2- 172.21.15.153:0/1755980034 >> v2:172.21.15.178:3300/0 conn(0x7f5b10151530 0x7f5b101519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b14d45700 1 -- 172.21.15.153:0/1755980034 >> v1:172.21.15.153:6789/0 conn(0x7f5b101560f0 legacy=0x7f5b100c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b14d45700 1 -- 172.21.15.153:0/1755980034 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10065ff0 con 0x7f5b100689c0 2023-08-17T00:06:59.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b14d45700 1 --2- 172.21.15.153:0/1755980034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b100689c0 0x7f5b10068da0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f5b10063b00 tx=0x7f5b0c009780).ready entity=mon.0 client_cookie=2a0c1127544498b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:59.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b077fe700 1 -- 172.21.15.153:0/1755980034 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00e070 con 0x7f5b100689c0 2023-08-17T00:06:59.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b077fe700 1 -- 172.21.15.153:0/1755980034 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0097f0 con 0x7f5b100689c0 2023-08-17T00:06:59.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b077fe700 1 -- 172.21.15.153:0/1755980034 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c00bcc0 con 0x7f5b100689c0 2023-08-17T00:06:59.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 -- 172.21.15.153:0/1755980034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b100689c0 msgr2=0x7f5b10068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 --2- 172.21.15.153:0/1755980034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b100689c0 0x7f5b10068da0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f5b10063b00 tx=0x7f5b0c009780).stop 2023-08-17T00:06:59.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 -- 172.21.15.153:0/1755980034 shutdown_connections 2023-08-17T00:06:59.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 --2- 172.21.15.153:0/1755980034 >> v2:172.21.15.178:3300/0 conn(0x7f5b10151530 0x7f5b101519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 --2- 172.21.15.153:0/1755980034 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b100689c0 0x7f5b10068da0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 -- 172.21.15.153:0/1755980034 >> 172.21.15.153:0/1755980034 conn(0x7f5b100c6620 msgr2=0x7f5b100c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:59.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 -- 172.21.15.153:0/1755980034 shutdown_connections 2023-08-17T00:06:59.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.284+0000 7f5b15d47700 1 -- 172.21.15.153:0/1755980034 wait complete. 2023-08-17T00:06:59.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 Processor -- start 2023-08-17T00:06:59.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 -- start start 2023-08-17T00:06:59.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b100689c0 0x7f5b101549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 0x7f5b10153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b101560f0 0x7f5b10154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b101544f0 con 0x7f5b10151530 2023-08-17T00:06:59.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100a1af0 con 0x7f5b100689c0 2023-08-17T00:06:59.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b100a2630 con 0x7f5b101560f0 2023-08-17T00:06:59.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 0x7f5b10153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 0x7f5b10153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51138/0 (socket says 172.21.15.153:51138) 2023-08-17T00:06:59.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 -- 172.21.15.153:0/3435055803 learned_addr learned my addr 172.21.15.153:0/3435055803 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:59.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b14d45700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b100689c0 0x7f5b101549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15546700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b101560f0 0x7f5b10154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 -- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b101560f0 msgr2=0x7f5b10154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b101560f0 0x7f5b10154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 -- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b100689c0 msgr2=0x7f5b101549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b100689c0 0x7f5b101549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b07fff700 1 -- 172.21.15.153:0/3435055803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0099c0 con 0x7f5b10151530 2023-08-17T00:06:59.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.288+0000 7f5b15546700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b101560f0 0x7f5b10154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:59.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b07fff700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 0x7f5b10153b10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f5b0000c420 tx=0x7f5b00007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0000ce80 con 0x7f5b10151530 2023-08-17T00:06:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b000072e0 con 0x7f5b10151530 2023-08-17T00:06:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b10163070 con 0x7f5b10151530 2023-08-17T00:06:59.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00007660 con 0x7f5b10151530 2023-08-17T00:06:59.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b100a2060 con 0x7f5b10151530 2023-08-17T00:06:59.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1006b4c0 con 0x7f5b10151530 2023-08-17T00:06:59.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.292+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5b00010070 con 0x7f5b10151530 2023-08-17T00:06:59.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.296+0000 7f5b04ff9700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a150 0x7f5afc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.296+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5b00073820 con 0x7f5b10151530 2023-08-17T00:06:59.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.296+0000 7f5b14d45700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a150 0x7f5afc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.296+0000 7f5b14d45700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a150 0x7f5afc05c610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f5b100a82e0 tx=0x7f5b0c009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:59.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.300+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5b000471c0 con 0x7f5b10151530 2023-08-17T00:06:59.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.460+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b10063750 con 0x7f5afc05a150 2023-08-17T00:06:59.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.476+0000 7f5b04ff9700 1 -- 172.21.15.153:0/3435055803 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359221 (secure 0 0 0) 0x7f5b10063750 con 0x7f5afc05a150 2023-08-17T00:06:59.485 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:06:59.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a150 msgr2=0x7f5afc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a150 0x7f5afc05c610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f5b100a82e0 tx=0x7f5b0c009780).stop 2023-08-17T00:06:59.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 msgr2=0x7f5b10153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 0x7f5b10153b10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f5b0000c420 tx=0x7f5b00007c80).stop 2023-08-17T00:06:59.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 shutdown_connections 2023-08-17T00:06:59.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5afc05a150 0x7f5afc05c610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b101560f0 0x7f5b10154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5b10151530 0x7f5b10153b10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 --2- 172.21.15.153:0/3435055803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b100689c0 0x7f5b101549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.484+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 >> 172.21.15.153:0/3435055803 conn(0x7f5b100c6620 msgr2=0x7f5b100c4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:59.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.488+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 shutdown_connections 2023-08-17T00:06:59.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.488+0000 7f5b15d47700 1 -- 172.21.15.153:0/3435055803 wait complete. 2023-08-17T00:06:59.494 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:06:59.513 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2023-08-17T00:06:59.261870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2460544,"kb_used_data":5952,"kb_used_omap":0,"kb_used_meta":2454528,"kb_avail":752514176,"statfs":{"total":773094113280,"available":770574516224,"internally_reserved":0,"allocated":6094848,"data_stored":2704732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2513436672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-17888889,"num_objects":-2144,"num_object_clones":0,"num_object_copies":-4288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2144,"num_whiteouts":0,"num_read":-178,"num_read_kb":-7408,"num_write":-7420,"num_write_kb":-24573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-707,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.288656"},"pg_stats":[{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977501+0000","last_change":"2023-08-17T00:06:49.971729+0000","last_active":"2023-08-17T00:06:49.977501+0000","last_peered":"2023-08-17T00:06:49.977501+0000","last_clean":"2023-08-17T00:06:49.977501+0000","last_became_active":"2023-08-17T00:06:49.965750+0000","last_became_peered":"2023-08-17T00:06:49.965750+0000","last_unstale":"2023-08-17T00:06:49.977501+0000","last_undegraded":"2023-08-17T00:06:49.977501+0000","last_fullsized":"2023-08-17T00:06:49.977501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3f","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961815+0000","last_change":"2023-08-17T00:06:49.511646+0000","last_active":"2023-08-17T00:06:49.961815+0000","last_peered":"2023-08-17T00:06:49.961815+0000","last_clean":"2023-08-17T00:06:49.961815+0000","last_became_active":"2023-08-17T00:06:49.511348+0000","last_became_peered":"2023-08-17T00:06:49.511348+0000","last_unstale":"2023-08-17T00:06:49.961815+0000","last_undegraded":"2023-08-17T00:06:49.961815+0000","last_fullsized":"2023-08-17T00:06:49.961815+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969391+0000","last_change":"2023-08-17T00:06:49.967889+0000","last_active":"2023-08-17T00:06:49.969391+0000","last_peered":"2023-08-17T00:06:49.969391+0000","last_clean":"2023-08-17T00:06:49.969391+0000","last_became_active":"2023-08-17T00:06:49.967558+0000","last_became_peered":"2023-08-17T00:06:49.967558+0000","last_unstale":"2023-08-17T00:06:49.969391+0000","last_undegraded":"2023-08-17T00:06:49.969391+0000","last_fullsized":"2023-08-17T00:06:49.969391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942432+0000","last_change":"2023-08-17T00:06:49.520311+0000","last_active":"2023-08-17T00:06:49.942432+0000","last_peered":"2023-08-17T00:06:49.942432+0000","last_clean":"2023-08-17T00:06:49.942432+0000","last_became_active":"2023-08-17T00:06:49.519735+0000","last_became_peered":"2023-08-17T00:06:49.519735+0000","last_unstale":"2023-08-17T00:06:49.942432+0000","last_undegraded":"2023-08-17T00:06:49.942432+0000","last_fullsized":"2023-08-17T00:06:49.942432+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952248+0000","last_change":"2023-08-17T00:06:49.947732+0000","last_active":"2023-08-17T00:06:49.952248+0000","last_peered":"2023-08-17T00:06:49.952248+0000","last_clean":"2023-08-17T00:06:49.952248+0000","last_became_active":"2023-08-17T00:06:49.947242+0000","last_became_peered":"2023-08-17T00:06:49.947242+0000","last_unstale":"2023-08-17T00:06:49.952248+0000","last_undegraded":"2023-08-17T00:06:49.952248+0000","last_fullsized":"2023-08-17T00:06:49.952248+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940152+0000","last_change":"2023-08-17T00:06:49.510766+0000","last_active":"2023-08-17T00:06:49.940152+0000","last_peered":"2023-08-17T00:06:49.940152+0000","last_clean":"2023-08-17T00:06:49.940152+0000","last_became_active":"2023-08-17T00:06:49.509451+0000","last_became_peered":"2023-08-17T00:06:49.509451+0000","last_unstale":"2023-08-17T00:06:49.940152+0000","last_undegraded":"2023-08-17T00:06:49.940152+0000","last_fullsized":"2023-08-17T00:06:49.940152+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962605+0000","last_change":"2023-08-17T00:06:49.956423+0000","last_active":"2023-08-17T00:06:49.962605+0000","last_peered":"2023-08-17T00:06:49.962605+0000","last_clean":"2023-08-17T00:06:49.962605+0000","last_became_active":"2023-08-17T00:06:49.956141+0000","last_became_peered":"2023-08-17T00:06:49.956141+0000","last_unstale":"2023-08-17T00:06:49.962605+0000","last_undegraded":"2023-08-17T00:06:49.962605+0000","last_fullsized":"2023-08-17T00:06:49.962605+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969102+0000","last_change":"2023-08-17T00:06:49.522925+0000","last_active":"2023-08-17T00:06:49.969102+0000","last_peered":"2023-08-17T00:06:49.969102+0000","last_clean":"2023-08-17T00:06:49.969102+0000","last_became_active":"2023-08-17T00:06:49.522597+0000","last_became_peered":"2023-08-17T00:06:49.522597+0000","last_unstale":"2023-08-17T00:06:49.969102+0000","last_undegraded":"2023-08-17T00:06:49.969102+0000","last_fullsized":"2023-08-17T00:06:49.969102+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968927+0000","last_change":"2023-08-17T00:06:49.957297+0000","last_active":"2023-08-17T00:06:49.968927+0000","last_peered":"2023-08-17T00:06:49.968927+0000","last_clean":"2023-08-17T00:06:49.968927+0000","last_became_active":"2023-08-17T00:06:49.956775+0000","last_became_peered":"2023-08-17T00:06:49.956775+0000","last_unstale":"2023-08-17T00:06:49.968927+0000","last_undegraded":"2023-08-17T00:06:49.968927+0000","last_fullsized":"2023-08-17T00:06:49.968927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966605+0000","last_change":"2023-08-17T00:06:49.514109+0000","last_active":"2023-08-17T00:06:49.966605+0000","last_peered":"2023-08-17T00:06:49.966605+0000","last_clean":"2023-08-17T00:06:49.966605+0000","last_became_active":"2023-08-17T00:06:49.513827+0000","last_became_peered":"2023-08-17T00:06:49.513827+0000","last_unstale":"2023-08-17T00:06:49.966605+0000","last_undegraded":"2023-08-17T00:06:49.966605+0000","last_fullsized":"2023-08-17T00:06:49.966605+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963285+0000","last_change":"2023-08-17T00:06:49.960546+0000","last_active":"2023-08-17T00:06:49.963285+0000","last_peered":"2023-08-17T00:06:49.963285+0000","last_clean":"2023-08-17T00:06:49.963285+0000","last_became_active":"2023-08-17T00:06:49.960128+0000","last_became_peered":"2023-08-17T00:06:49.960128+0000","last_unstale":"2023-08-17T00:06:49.963285+0000","last_undegraded":"2023-08-17T00:06:49.963285+0000","last_fullsized":"2023-08-17T00:06:49.963285+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963269+0000","last_change":"2023-08-17T00:06:49.519213+0000","last_active":"2023-08-17T00:06:49.963269+0000","last_peered":"2023-08-17T00:06:49.963269+0000","last_clean":"2023-08-17T00:06:49.963269+0000","last_became_active":"2023-08-17T00:06:49.518862+0000","last_became_peered":"2023-08-17T00:06:49.518862+0000","last_unstale":"2023-08-17T00:06:49.963269+0000","last_undegraded":"2023-08-17T00:06:49.963269+0000","last_fullsized":"2023-08-17T00:06:49.963269+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.956374+0000","last_change":"2023-08-17T00:06:49.951463+0000","last_active":"2023-08-17T00:06:49.956374+0000","last_peered":"2023-08-17T00:06:49.956374+0000","last_clean":"2023-08-17T00:06:49.956374+0000","last_became_active":"2023-08-17T00:06:49.950180+0000","last_became_peered":"2023-08-17T00:06:49.950180+0000","last_unstale":"2023-08-17T00:06:49.956374+0000","last_undegraded":"2023-08-17T00:06:49.956374+0000","last_fullsized":"2023-08-17T00:06:49.956374+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.945443+0000","last_change":"2023-08-17T00:06:49.522080+0000","last_active":"2023-08-17T00:06:49.945443+0000","last_peered":"2023-08-17T00:06:49.945443+0000","last_clean":"2023-08-17T00:06:49.945443+0000","last_became_active":"2023-08-17T00:06:49.521800+0000","last_became_peered":"2023-08-17T00:06:49.521800+0000","last_unstale":"2023-08-17T00:06:49.945443+0000","last_undegraded":"2023-08-17T00:06:49.945443+0000","last_fullsized":"2023-08-17T00:06:49.945443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966417+0000","last_change":"2023-08-17T00:06:49.953013+0000","last_active":"2023-08-17T00:06:49.966417+0000","last_peered":"2023-08-17T00:06:49.966417+0000","last_clean":"2023-08-17T00:06:49.966417+0000","last_became_active":"2023-08-17T00:06:49.952756+0000","last_became_peered":"2023-08-17T00:06:49.952756+0000","last_unstale":"2023-08-17T00:06:49.966417+0000","last_undegraded":"2023-08-17T00:06:49.966417+0000","last_fullsized":"2023-08-17T00:06:49.966417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934788+0000","last_change":"2023-08-17T00:06:49.510037+0000","last_active":"2023-08-17T00:06:49.934788+0000","last_peered":"2023-08-17T00:06:49.934788+0000","last_clean":"2023-08-17T00:06:49.934788+0000","last_became_active":"2023-08-17T00:06:49.509668+0000","last_became_peered":"2023-08-17T00:06:49.509668+0000","last_unstale":"2023-08-17T00:06:49.934788+0000","last_undegraded":"2023-08-17T00:06:49.934788+0000","last_fullsized":"2023-08-17T00:06:49.934788+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977425+0000","last_change":"2023-08-17T00:06:49.965707+0000","last_active":"2023-08-17T00:06:49.977425+0000","last_peered":"2023-08-17T00:06:49.977425+0000","last_clean":"2023-08-17T00:06:49.977425+0000","last_became_active":"2023-08-17T00:06:49.964974+0000","last_became_peered":"2023-08-17T00:06:49.964974+0000","last_unstale":"2023-08-17T00:06:49.977425+0000","last_undegraded":"2023-08-17T00:06:49.977425+0000","last_fullsized":"2023-08-17T00:06:49.977425+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935431+0000","last_change":"2023-08-17T00:06:49.519473+0000","last_active":"2023-08-17T00:06:49.935431+0000","last_peered":"2023-08-17T00:06:49.935431+0000","last_clean":"2023-08-17T00:06:49.935431+0000","last_became_active":"2023-08-17T00:06:49.519142+0000","last_became_peered":"2023-08-17T00:06:49.519142+0000","last_unstale":"2023-08-17T00:06:49.935431+0000","last_undegraded":"2023-08-17T00:06:49.935431+0000","last_fullsized":"2023-08-17T00:06:49.935431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977410+0000","last_change":"2023-08-17T00:06:49.965481+0000","last_active":"2023-08-17T00:06:49.977410+0000","last_peered":"2023-08-17T00:06:49.977410+0000","last_clean":"2023-08-17T00:06:49.977410+0000","last_became_active":"2023-08-17T00:06:49.962823+0000","last_became_peered":"2023-08-17T00:06:49.962823+0000","last_unstale":"2023-08-17T00:06:49.977410+0000","last_undegraded":"2023-08-17T00:06:49.977410+0000","last_fullsized":"2023-08-17T00:06:49.977410+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940215+0000","last_change":"2023-08-17T00:06:49.512212+0000","last_active":"2023-08-17T00:06:49.940215+0000","last_peered":"2023-08-17T00:06:49.940215+0000","last_clean":"2023-08-17T00:06:49.940215+0000","last_became_active":"2023-08-17T00:06:49.511958+0000","last_became_peered":"2023-08-17T00:06:49.511958+0000","last_unstale":"2023-08-17T00:06:49.940215+0000","last_undegraded":"2023-08-17T00:06:49.940215+0000","last_fullsized":"2023-08-17T00:06:49.940215+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965161+0000","last_change":"2023-08-17T00:06:49.959860+0000","last_active":"2023-08-17T00:06:49.965161+0000","last_peered":"2023-08-17T00:06:49.965161+0000","last_clean":"2023-08-17T00:06:49.965161+0000","last_became_active":"2023-08-17T00:06:49.959580+0000","last_became_peered":"2023-08-17T00:06:49.959580+0000","last_unstale":"2023-08-17T00:06:49.965161+0000","last_undegraded":"2023-08-17T00:06:49.965161+0000","last_fullsized":"2023-08-17T00:06:49.965161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934218+0000","last_change":"2023-08-17T00:06:49.516163+0000","last_active":"2023-08-17T00:06:49.934218+0000","last_peered":"2023-08-17T00:06:49.934218+0000","last_clean":"2023-08-17T00:06:49.934218+0000","last_became_active":"2023-08-17T00:06:49.515816+0000","last_became_peered":"2023-08-17T00:06:49.515816+0000","last_unstale":"2023-08-17T00:06:49.934218+0000","last_undegraded":"2023-08-17T00:06:49.934218+0000","last_fullsized":"2023-08-17T00:06:49.934218+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977137+0000","last_change":"2023-08-17T00:06:49.961837+0000","last_active":"2023-08-17T00:06:49.977137+0000","last_peered":"2023-08-17T00:06:49.977137+0000","last_clean":"2023-08-17T00:06:49.977137+0000","last_became_active":"2023-08-17T00:06:49.961513+0000","last_became_peered":"2023-08-17T00:06:49.961513+0000","last_unstale":"2023-08-17T00:06:49.977137+0000","last_undegraded":"2023-08-17T00:06:49.977137+0000","last_fullsized":"2023-08-17T00:06:49.977137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.34","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.973433+0000","last_change":"2023-08-17T00:06:49.512669+0000","last_active":"2023-08-17T00:06:49.973433+0000","last_peered":"2023-08-17T00:06:49.973433+0000","last_clean":"2023-08-17T00:06:49.973433+0000","last_became_active":"2023-08-17T00:06:49.512338+0000","last_became_peered":"2023-08-17T00:06:49.512338+0000","last_unstale":"2023-08-17T00:06:49.973433+0000","last_undegraded":"2023-08-17T00:06:49.973433+0000","last_fullsized":"2023-08-17T00:06:49.973433+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957475+0000","last_change":"2023-08-17T00:06:49.953066+0000","last_active":"2023-08-17T00:06:49.957475+0000","last_peered":"2023-08-17T00:06:49.957475+0000","last_clean":"2023-08-17T00:06:49.957475+0000","last_became_active":"2023-08-17T00:06:49.952722+0000","last_became_peered":"2023-08-17T00:06:49.952722+0000","last_unstale":"2023-08-17T00:06:49.957475+0000","last_undegraded":"2023-08-17T00:06:49.957475+0000","last_fullsized":"2023-08-17T00:06:49.957475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.33","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.971034+0000","last_change":"2023-08-17T00:06:49.513478+0000","last_active":"2023-08-17T00:06:49.971034+0000","last_peered":"2023-08-17T00:06:49.971034+0000","last_clean":"2023-08-17T00:06:49.971034+0000","last_became_active":"2023-08-17T00:06:49.512118+0000","last_became_peered":"2023-08-17T00:06:49.512118+0000","last_unstale":"2023-08-17T00:06:49.971034+0000","last_undegraded":"2023-08-17T00:06:49.971034+0000","last_fullsized":"2023-08-17T00:06:49.971034+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964766+0000","last_change":"2023-08-17T00:06:49.960216+0000","last_active":"2023-08-17T00:06:49.964766+0000","last_peered":"2023-08-17T00:06:49.964766+0000","last_clean":"2023-08-17T00:06:49.964766+0000","last_became_active":"2023-08-17T00:06:49.959948+0000","last_became_peered":"2023-08-17T00:06:49.959948+0000","last_unstale":"2023-08-17T00:06:49.964766+0000","last_undegraded":"2023-08-17T00:06:49.964766+0000","last_fullsized":"2023-08-17T00:06:49.964766+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936941+0000","last_change":"2023-08-17T00:06:49.508817+0000","last_active":"2023-08-17T00:06:49.936941+0000","last_peered":"2023-08-17T00:06:49.936941+0000","last_clean":"2023-08-17T00:06:49.936941+0000","last_became_active":"2023-08-17T00:06:49.508385+0000","last_became_peered":"2023-08-17T00:06:49.508385+0000","last_unstale":"2023-08-17T00:06:49.936941+0000","last_undegraded":"2023-08-17T00:06:49.936941+0000","last_fullsized":"2023-08-17T00:06:49.936941+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.956326+0000","last_change":"2023-08-17T00:06:49.948717+0000","last_active":"2023-08-17T00:06:49.956326+0000","last_peered":"2023-08-17T00:06:49.956326+0000","last_clean":"2023-08-17T00:06:49.956326+0000","last_became_active":"2023-08-17T00:06:49.948444+0000","last_became_peered":"2023-08-17T00:06:49.948444+0000","last_unstale":"2023-08-17T00:06:49.956326+0000","last_undegraded":"2023-08-17T00:06:49.956326+0000","last_fullsized":"2023-08-17T00:06:49.956326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.938409+0000","last_change":"2023-08-17T00:06:49.518131+0000","last_active":"2023-08-17T00:06:49.938409+0000","last_peered":"2023-08-17T00:06:49.938409+0000","last_clean":"2023-08-17T00:06:49.938409+0000","last_became_active":"2023-08-17T00:06:49.517797+0000","last_became_peered":"2023-08-17T00:06:49.517797+0000","last_unstale":"2023-08-17T00:06:49.938409+0000","last_undegraded":"2023-08-17T00:06:49.938409+0000","last_fullsized":"2023-08-17T00:06:49.938409+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957879+0000","last_change":"2023-08-17T00:06:49.953217+0000","last_active":"2023-08-17T00:06:49.957879+0000","last_peered":"2023-08-17T00:06:49.957879+0000","last_clean":"2023-08-17T00:06:49.957879+0000","last_became_active":"2023-08-17T00:06:49.952957+0000","last_became_peered":"2023-08-17T00:06:49.952957+0000","last_unstale":"2023-08-17T00:06:49.957879+0000","last_undegraded":"2023-08-17T00:06:49.957879+0000","last_fullsized":"2023-08-17T00:06:49.957879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966589+0000","last_change":"2023-08-17T00:06:49.511162+0000","last_active":"2023-08-17T00:06:49.966589+0000","last_peered":"2023-08-17T00:06:49.966589+0000","last_clean":"2023-08-17T00:06:49.966589+0000","last_became_active":"2023-08-17T00:06:49.510809+0000","last_became_peered":"2023-08-17T00:06:49.510809+0000","last_unstale":"2023-08-17T00:06:49.966589+0000","last_undegraded":"2023-08-17T00:06:49.966589+0000","last_fullsized":"2023-08-17T00:06:49.966589+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959636+0000","last_change":"2023-08-17T00:06:49.947233+0000","last_active":"2023-08-17T00:06:49.959636+0000","last_peered":"2023-08-17T00:06:49.959636+0000","last_clean":"2023-08-17T00:06:49.959636+0000","last_became_active":"2023-08-17T00:06:49.946953+0000","last_became_peered":"2023-08-17T00:06:49.946953+0000","last_unstale":"2023-08-17T00:06:49.959636+0000","last_undegraded":"2023-08-17T00:06:49.959636+0000","last_fullsized":"2023-08-17T00:06:49.959636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942950+0000","last_change":"2023-08-17T00:06:49.522752+0000","last_active":"2023-08-17T00:06:49.942950+0000","last_peered":"2023-08-17T00:06:49.942950+0000","last_clean":"2023-08-17T00:06:49.942950+0000","last_became_active":"2023-08-17T00:06:49.522422+0000","last_became_peered":"2023-08-17T00:06:49.522422+0000","last_unstale":"2023-08-17T00:06:49.942950+0000","last_undegraded":"2023-08-17T00:06:49.942950+0000","last_fullsized":"2023-08-17T00:06:49.942950+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977311+0000","last_change":"2023-08-17T00:06:49.964632+0000","last_active":"2023-08-17T00:06:49.977311+0000","last_peered":"2023-08-17T00:06:49.977311+0000","last_clean":"2023-08-17T00:06:49.977311+0000","last_became_active":"2023-08-17T00:06:49.962478+0000","last_became_peered":"2023-08-17T00:06:49.962478+0000","last_unstale":"2023-08-17T00:06:49.977311+0000","last_undegraded":"2023-08-17T00:06:49.977311+0000","last_fullsized":"2023-08-17T00:06:49.977311+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943627+0000","last_change":"2023-08-17T00:06:49.514421+0000","last_active":"2023-08-17T00:06:49.943627+0000","last_peered":"2023-08-17T00:06:49.943627+0000","last_clean":"2023-08-17T00:06:49.943627+0000","last_became_active":"2023-08-17T00:06:49.514127+0000","last_became_peered":"2023-08-17T00:06:49.514127+0000","last_unstale":"2023-08-17T00:06:49.943627+0000","last_undegraded":"2023-08-17T00:06:49.943627+0000","last_fullsized":"2023-08-17T00:06:49.943627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.974674+0000","last_change":"2023-08-17T00:06:49.953101+0000","last_active":"2023-08-17T00:06:49.974674+0000","last_peered":"2023-08-17T00:06:49.974674+0000","last_clean":"2023-08-17T00:06:49.974674+0000","last_became_active":"2023-08-17T00:06:49.952826+0000","last_became_peered":"2023-08-17T00:06:49.952826+0000","last_unstale":"2023-08-17T00:06:49.974674+0000","last_undegraded":"2023-08-17T00:06:49.974674+0000","last_fullsized":"2023-08-17T00:06:49.974674+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957791+0000","last_change":"2023-08-17T00:06:49.510504+0000","last_active":"2023-08-17T00:06:49.957791+0000","last_peered":"2023-08-17T00:06:49.957791+0000","last_clean":"2023-08-17T00:06:49.957791+0000","last_became_active":"2023-08-17T00:06:49.510228+0000","last_became_peered":"2023-08-17T00:06:49.510228+0000","last_unstale":"2023-08-17T00:06:49.957791+0000","last_undegraded":"2023-08-17T00:06:49.957791+0000","last_fullsized":"2023-08-17T00:06:49.957791+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961118+0000","last_change":"2023-08-17T00:06:49.953511+0000","last_active":"2023-08-17T00:06:49.961118+0000","last_peered":"2023-08-17T00:06:49.961118+0000","last_clean":"2023-08-17T00:06:49.961118+0000","last_became_active":"2023-08-17T00:06:49.953191+0000","last_became_peered":"2023-08-17T00:06:49.953191+0000","last_unstale":"2023-08-17T00:06:49.961118+0000","last_undegraded":"2023-08-17T00:06:49.961118+0000","last_fullsized":"2023-08-17T00:06:49.961118+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934363+0000","last_change":"2023-08-17T00:06:49.509940+0000","last_active":"2023-08-17T00:06:49.934363+0000","last_peered":"2023-08-17T00:06:49.934363+0000","last_clean":"2023-08-17T00:06:49.934363+0000","last_became_active":"2023-08-17T00:06:49.508703+0000","last_became_peered":"2023-08-17T00:06:49.508703+0000","last_unstale":"2023-08-17T00:06:49.934363+0000","last_undegraded":"2023-08-17T00:06:49.934363+0000","last_fullsized":"2023-08-17T00:06:49.934363+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968948+0000","last_change":"2023-08-17T00:06:49.957470+0000","last_active":"2023-08-17T00:06:49.968948+0000","last_peered":"2023-08-17T00:06:49.968948+0000","last_clean":"2023-08-17T00:06:49.968948+0000","last_became_active":"2023-08-17T00:06:49.957040+0000","last_became_peered":"2023-08-17T00:06:49.957040+0000","last_unstale":"2023-08-17T00:06:49.968948+0000","last_undegraded":"2023-08-17T00:06:49.968948+0000","last_fullsized":"2023-08-17T00:06:49.968948+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977876+0000","last_change":"2023-08-17T00:06:49.512115+0000","last_active":"2023-08-17T00:06:49.977876+0000","last_peered":"2023-08-17T00:06:49.977876+0000","last_clean":"2023-08-17T00:06:49.977876+0000","last_became_active":"2023-08-17T00:06:49.511825+0000","last_became_peered":"2023-08-17T00:06:49.511825+0000","last_unstale":"2023-08-17T00:06:49.977876+0000","last_undegraded":"2023-08-17T00:06:49.977876+0000","last_fullsized":"2023-08-17T00:06:49.977876+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.958010+0000","last_change":"2023-08-17T00:06:49.951845+0000","last_active":"2023-08-17T00:06:49.958010+0000","last_peered":"2023-08-17T00:06:49.958010+0000","last_clean":"2023-08-17T00:06:49.958010+0000","last_became_active":"2023-08-17T00:06:49.951523+0000","last_became_peered":"2023-08-17T00:06:49.951523+0000","last_unstale":"2023-08-17T00:06:49.958010+0000","last_undegraded":"2023-08-17T00:06:49.958010+0000","last_fullsized":"2023-08-17T00:06:49.958010+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934282+0000","last_change":"2023-08-17T00:06:49.508382+0000","last_active":"2023-08-17T00:06:49.934282+0000","last_peered":"2023-08-17T00:06:49.934282+0000","last_clean":"2023-08-17T00:06:49.934282+0000","last_became_active":"2023-08-17T00:06:49.508065+0000","last_became_peered":"2023-08-17T00:06:49.508065+0000","last_unstale":"2023-08-17T00:06:49.934282+0000","last_undegraded":"2023-08-17T00:06:49.934282+0000","last_fullsized":"2023-08-17T00:06:49.934282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952068+0000","last_change":"2023-08-17T00:06:49.946688+0000","last_active":"2023-08-17T00:06:49.952068+0000","last_peered":"2023-08-17T00:06:49.952068+0000","last_clean":"2023-08-17T00:06:49.952068+0000","last_became_active":"2023-08-17T00:06:49.946264+0000","last_became_peered":"2023-08-17T00:06:49.946264+0000","last_unstale":"2023-08-17T00:06:49.952068+0000","last_undegraded":"2023-08-17T00:06:49.952068+0000","last_fullsized":"2023-08-17T00:06:49.952068+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.945541+0000","last_change":"2023-08-17T00:06:49.512548+0000","last_active":"2023-08-17T00:06:49.945541+0000","last_peered":"2023-08-17T00:06:49.945541+0000","last_clean":"2023-08-17T00:06:49.945541+0000","last_became_active":"2023-08-17T00:06:49.512119+0000","last_became_peered":"2023-08-17T00:06:49.512119+0000","last_unstale":"2023-08-17T00:06:49.945541+0000","last_undegraded":"2023-08-17T00:06:49.945541+0000","last_fullsized":"2023-08-17T00:06:49.945541+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965839+0000","last_change":"2023-08-17T00:06:49.962843+0000","last_active":"2023-08-17T00:06:49.965839+0000","last_peered":"2023-08-17T00:06:49.965839+0000","last_clean":"2023-08-17T00:06:49.965839+0000","last_became_active":"2023-08-17T00:06:49.962577+0000","last_became_peered":"2023-08-17T00:06:49.962577+0000","last_unstale":"2023-08-17T00:06:49.965839+0000","last_undegraded":"2023-08-17T00:06:49.965839+0000","last_fullsized":"2023-08-17T00:06:49.965839+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935138+0000","last_change":"2023-08-17T00:06:49.513071+0000","last_active":"2023-08-17T00:06:49.935138+0000","last_peered":"2023-08-17T00:06:49.935138+0000","last_clean":"2023-08-17T00:06:49.935138+0000","last_became_active":"2023-08-17T00:06:49.511203+0000","last_became_peered":"2023-08-17T00:06:49.511203+0000","last_unstale":"2023-08-17T00:06:49.935138+0000","last_undegraded":"2023-08-17T00:06:49.935138+0000","last_fullsized":"2023-08-17T00:06:49.935138+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963322+0000","last_change":"2023-08-17T00:06:49.959273+0000","last_active":"2023-08-17T00:06:49.963322+0000","last_peered":"2023-08-17T00:06:49.963322+0000","last_clean":"2023-08-17T00:06:49.963322+0000","last_became_active":"2023-08-17T00:06:49.958497+0000","last_became_peered":"2023-08-17T00:06:49.958497+0000","last_unstale":"2023-08-17T00:06:49.963322+0000","last_undegraded":"2023-08-17T00:06:49.963322+0000","last_fullsized":"2023-08-17T00:06:49.963322+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942332+0000","last_change":"2023-08-17T00:06:49.520022+0000","last_active":"2023-08-17T00:06:49.942332+0000","last_peered":"2023-08-17T00:06:49.942332+0000","last_clean":"2023-08-17T00:06:49.942332+0000","last_became_active":"2023-08-17T00:06:49.519642+0000","last_became_peered":"2023-08-17T00:06:49.519642+0000","last_unstale":"2023-08-17T00:06:49.942332+0000","last_undegraded":"2023-08-17T00:06:49.942332+0000","last_fullsized":"2023-08-17T00:06:49.942332+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963691+0000","last_change":"2023-08-17T00:06:49.955802+0000","last_active":"2023-08-17T00:06:49.963691+0000","last_peered":"2023-08-17T00:06:49.963691+0000","last_clean":"2023-08-17T00:06:49.963691+0000","last_became_active":"2023-08-17T00:06:49.955515+0000","last_became_peered":"2023-08-17T00:06:49.955515+0000","last_unstale":"2023-08-17T00:06:49.963691+0000","last_undegraded":"2023-08-17T00:06:49.963691+0000","last_fullsized":"2023-08-17T00:06:49.963691+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.26","version":"63'1","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-08-17T00:06:51.160737+0000","last_change":"2023-08-17T00:06:49.511804+0000","last_active":"2023-08-17T00:06:51.160737+0000","last_peered":"2023-08-17T00:06:51.160737+0000","last_clean":"2023-08-17T00:06:51.160737+0000","last_became_active":"2023-08-17T00:06:49.511483+0000","last_became_peered":"2023-08-17T00:06:49.511483+0000","last_unstale":"2023-08-17T00:06:51.160737+0000","last_undegraded":"2023-08-17T00:06:51.160737+0000","last_fullsized":"2023-08-17T00:06:51.160737+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969434+0000","last_change":"2023-08-17T00:06:49.964492+0000","last_active":"2023-08-17T00:06:49.969434+0000","last_peered":"2023-08-17T00:06:49.969434+0000","last_clean":"2023-08-17T00:06:49.969434+0000","last_became_active":"2023-08-17T00:06:49.963481+0000","last_became_peered":"2023-08-17T00:06:49.963481+0000","last_unstale":"2023-08-17T00:06:49.969434+0000","last_undegraded":"2023-08-17T00:06:49.969434+0000","last_fullsized":"2023-08-17T00:06:49.969434+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941482+0000","last_change":"2023-08-17T00:06:49.520245+0000","last_active":"2023-08-17T00:06:49.941482+0000","last_peered":"2023-08-17T00:06:49.941482+0000","last_clean":"2023-08-17T00:06:49.941482+0000","last_became_active":"2023-08-17T00:06:49.519956+0000","last_became_peered":"2023-08-17T00:06:49.519956+0000","last_unstale":"2023-08-17T00:06:49.941482+0000","last_undegraded":"2023-08-17T00:06:49.941482+0000","last_fullsized":"2023-08-17T00:06:49.941482+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965849+0000","last_change":"2023-08-17T00:06:49.963038+0000","last_active":"2023-08-17T00:06:49.965849+0000","last_peered":"2023-08-17T00:06:49.965849+0000","last_clean":"2023-08-17T00:06:49.965849+0000","last_became_active":"2023-08-17T00:06:49.962735+0000","last_became_peered":"2023-08-17T00:06:49.962735+0000","last_unstale":"2023-08-17T00:06:49.965849+0000","last_undegraded":"2023-08-17T00:06:49.965849+0000","last_fullsized":"2023-08-17T00:06:49.965849+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936020+0000","last_change":"2023-08-17T00:06:49.512550+0000","last_active":"2023-08-17T00:06:49.936020+0000","last_peered":"2023-08-17T00:06:49.936020+0000","last_clean":"2023-08-17T00:06:49.936020+0000","last_became_active":"2023-08-17T00:06:49.512217+0000","last_became_peered":"2023-08-17T00:06:49.512217+0000","last_unstale":"2023-08-17T00:06:49.936020+0000","last_undegraded":"2023-08-17T00:06:49.936020+0000","last_fullsized":"2023-08-17T00:06:49.936020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962119+0000","last_change":"2023-08-17T00:06:49.955062+0000","last_active":"2023-08-17T00:06:49.962119+0000","last_peered":"2023-08-17T00:06:49.962119+0000","last_clean":"2023-08-17T00:06:49.962119+0000","last_became_active":"2023-08-17T00:06:49.954790+0000","last_became_peered":"2023-08-17T00:06:49.954790+0000","last_unstale":"2023-08-17T00:06:49.962119+0000","last_undegraded":"2023-08-17T00:06:49.962119+0000","last_fullsized":"2023-08-17T00:06:49.962119+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.937220+0000","last_change":"2023-08-17T00:06:49.509008+0000","last_active":"2023-08-17T00:06:49.937220+0000","last_peered":"2023-08-17T00:06:49.937220+0000","last_clean":"2023-08-17T00:06:49.937220+0000","last_became_active":"2023-08-17T00:06:49.508734+0000","last_became_peered":"2023-08-17T00:06:49.508734+0000","last_unstale":"2023-08-17T00:06:49.937220+0000","last_undegraded":"2023-08-17T00:06:49.937220+0000","last_fullsized":"2023-08-17T00:06:49.937220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968603+0000","last_change":"2023-08-17T00:06:49.956469+0000","last_active":"2023-08-17T00:06:49.968603+0000","last_peered":"2023-08-17T00:06:49.968603+0000","last_clean":"2023-08-17T00:06:49.968603+0000","last_became_active":"2023-08-17T00:06:49.956185+0000","last_became_peered":"2023-08-17T00:06:49.956185+0000","last_unstale":"2023-08-17T00:06:49.968603+0000","last_undegraded":"2023-08-17T00:06:49.968603+0000","last_fullsized":"2023-08-17T00:06:49.968603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943394+0000","last_change":"2023-08-17T00:06:49.516425+0000","last_active":"2023-08-17T00:06:49.943394+0000","last_peered":"2023-08-17T00:06:49.943394+0000","last_clean":"2023-08-17T00:06:49.943394+0000","last_became_active":"2023-08-17T00:06:49.516082+0000","last_became_peered":"2023-08-17T00:06:49.516082+0000","last_unstale":"2023-08-17T00:06:49.943394+0000","last_undegraded":"2023-08-17T00:06:49.943394+0000","last_fullsized":"2023-08-17T00:06:49.943394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977289+0000","last_change":"2023-08-17T00:06:49.962282+0000","last_active":"2023-08-17T00:06:49.977289+0000","last_peered":"2023-08-17T00:06:49.977289+0000","last_clean":"2023-08-17T00:06:49.977289+0000","last_became_active":"2023-08-17T00:06:49.961488+0000","last_became_peered":"2023-08-17T00:06:49.961488+0000","last_unstale":"2023-08-17T00:06:49.977289+0000","last_undegraded":"2023-08-17T00:06:49.977289+0000","last_fullsized":"2023-08-17T00:06:49.977289+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941570+0000","last_change":"2023-08-17T00:06:49.511438+0000","last_active":"2023-08-17T00:06:49.941570+0000","last_peered":"2023-08-17T00:06:49.941570+0000","last_clean":"2023-08-17T00:06:49.941570+0000","last_became_active":"2023-08-17T00:06:49.511191+0000","last_became_peered":"2023-08-17T00:06:49.511191+0000","last_unstale":"2023-08-17T00:06:49.941570+0000","last_undegraded":"2023-08-17T00:06:49.941570+0000","last_fullsized":"2023-08-17T00:06:49.941570+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977271+0000","last_change":"2023-08-17T00:06:49.962278+0000","last_active":"2023-08-17T00:06:49.977271+0000","last_peered":"2023-08-17T00:06:49.977271+0000","last_clean":"2023-08-17T00:06:49.977271+0000","last_became_active":"2023-08-17T00:06:49.961796+0000","last_became_peered":"2023-08-17T00:06:49.961796+0000","last_unstale":"2023-08-17T00:06:49.977271+0000","last_undegraded":"2023-08-17T00:06:49.977271+0000","last_fullsized":"2023-08-17T00:06:49.977271+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933686+0000","last_change":"2023-08-17T00:06:49.508705+0000","last_active":"2023-08-17T00:06:49.933686+0000","last_peered":"2023-08-17T00:06:49.933686+0000","last_clean":"2023-08-17T00:06:49.933686+0000","last_became_active":"2023-08-17T00:06:49.508086+0000","last_became_peered":"2023-08-17T00:06:49.508086+0000","last_unstale":"2023-08-17T00:06:49.933686+0000","last_undegraded":"2023-08-17T00:06:49.933686+0000","last_fullsized":"2023-08-17T00:06:49.933686+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977485+0000","last_change":"2023-08-17T00:06:49.971656+0000","last_active":"2023-08-17T00:06:49.977485+0000","last_peered":"2023-08-17T00:06:49.977485+0000","last_clean":"2023-08-17T00:06:49.977485+0000","last_became_active":"2023-08-17T00:06:49.965426+0000","last_became_peered":"2023-08-17T00:06:49.965426+0000","last_unstale":"2023-08-17T00:06:49.977485+0000","last_undegraded":"2023-08-17T00:06:49.977485+0000","last_fullsized":"2023-08-17T00:06:49.977485+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962627+0000","last_change":"2023-08-17T00:06:49.516787+0000","last_active":"2023-08-17T00:06:49.962627+0000","last_peered":"2023-08-17T00:06:49.962627+0000","last_clean":"2023-08-17T00:06:49.962627+0000","last_became_active":"2023-08-17T00:06:49.516500+0000","last_became_peered":"2023-08-17T00:06:49.516500+0000","last_unstale":"2023-08-17T00:06:49.962627+0000","last_undegraded":"2023-08-17T00:06:49.962627+0000","last_fullsized":"2023-08-17T00:06:49.962627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968714+0000","last_change":"2023-08-17T00:06:49.956716+0000","last_active":"2023-08-17T00:06:49.968714+0000","last_peered":"2023-08-17T00:06:49.968714+0000","last_clean":"2023-08-17T00:06:49.968714+0000","last_became_active":"2023-08-17T00:06:49.956448+0000","last_became_peered":"2023-08-17T00:06:49.956448+0000","last_unstale":"2023-08-17T00:06:49.968714+0000","last_undegraded":"2023-08-17T00:06:49.968714+0000","last_fullsized":"2023-08-17T00:06:49.968714+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963250+0000","last_change":"2023-08-17T00:06:49.513500+0000","last_active":"2023-08-17T00:06:49.963250+0000","last_peered":"2023-08-17T00:06:49.963250+0000","last_clean":"2023-08-17T00:06:49.963250+0000","last_became_active":"2023-08-17T00:06:49.513228+0000","last_became_peered":"2023-08-17T00:06:49.513228+0000","last_unstale":"2023-08-17T00:06:49.963250+0000","last_undegraded":"2023-08-17T00:06:49.963250+0000","last_fullsized":"2023-08-17T00:06:49.963250+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952230+0000","last_change":"2023-08-17T00:06:49.947526+0000","last_active":"2023-08-17T00:06:49.952230+0000","last_peered":"2023-08-17T00:06:49.952230+0000","last_clean":"2023-08-17T00:06:49.952230+0000","last_became_active":"2023-08-17T00:06:49.946937+0000","last_became_peered":"2023-08-17T00:06:49.946937+0000","last_unstale":"2023-08-17T00:06:49.952230+0000","last_undegraded":"2023-08-17T00:06:49.952230+0000","last_fullsized":"2023-08-17T00:06:49.952230+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.962524+0000","last_change":"2023-08-17T00:06:49.514747+0000","last_active":"2023-08-17T00:06:49.962524+0000","last_peered":"2023-08-17T00:06:49.962524+0000","last_clean":"2023-08-17T00:06:49.962524+0000","last_became_active":"2023-08-17T00:06:49.514389+0000","last_became_peered":"2023-08-17T00:06:49.514389+0000","last_unstale":"2023-08-17T00:06:49.962524+0000","last_undegraded":"2023-08-17T00:06:49.962524+0000","last_fullsized":"2023-08-17T00:06:49.962524+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977430+0000","last_change":"2023-08-17T00:06:49.965044+0000","last_active":"2023-08-17T00:06:49.977430+0000","last_peered":"2023-08-17T00:06:49.977430+0000","last_clean":"2023-08-17T00:06:49.977430+0000","last_became_active":"2023-08-17T00:06:49.964720+0000","last_became_peered":"2023-08-17T00:06:49.964720+0000","last_unstale":"2023-08-17T00:06:49.977430+0000","last_undegraded":"2023-08-17T00:06:49.977430+0000","last_fullsized":"2023-08-17T00:06:49.977430+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935902+0000","last_change":"2023-08-17T00:06:49.516022+0000","last_active":"2023-08-17T00:06:49.935902+0000","last_peered":"2023-08-17T00:06:49.935902+0000","last_clean":"2023-08-17T00:06:49.935902+0000","last_became_active":"2023-08-17T00:06:49.515718+0000","last_became_peered":"2023-08-17T00:06:49.515718+0000","last_unstale":"2023-08-17T00:06:49.935902+0000","last_undegraded":"2023-08-17T00:06:49.935902+0000","last_fullsized":"2023-08-17T00:06:49.935902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959333+0000","last_change":"2023-08-17T00:06:49.946510+0000","last_active":"2023-08-17T00:06:49.959333+0000","last_peered":"2023-08-17T00:06:49.959333+0000","last_clean":"2023-08-17T00:06:49.959333+0000","last_became_active":"2023-08-17T00:06:49.946225+0000","last_became_peered":"2023-08-17T00:06:49.946225+0000","last_unstale":"2023-08-17T00:06:49.959333+0000","last_undegraded":"2023-08-17T00:06:49.959333+0000","last_fullsized":"2023-08-17T00:06:49.959333+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935353+0000","last_change":"2023-08-17T00:06:49.508617+0000","last_active":"2023-08-17T00:06:49.935353+0000","last_peered":"2023-08-17T00:06:49.935353+0000","last_clean":"2023-08-17T00:06:49.935353+0000","last_became_active":"2023-08-17T00:06:49.508330+0000","last_became_peered":"2023-08-17T00:06:49.508330+0000","last_unstale":"2023-08-17T00:06:49.935353+0000","last_undegraded":"2023-08-17T00:06:49.935353+0000","last_fullsized":"2023-08-17T00:06:49.935353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.958632+0000","last_change":"2023-08-17T00:06:49.951641+0000","last_active":"2023-08-17T00:06:49.958632+0000","last_peered":"2023-08-17T00:06:49.958632+0000","last_clean":"2023-08-17T00:06:49.958632+0000","last_became_active":"2023-08-17T00:06:49.951372+0000","last_became_peered":"2023-08-17T00:06:49.951372+0000","last_unstale":"2023-08-17T00:06:49.958632+0000","last_undegraded":"2023-08-17T00:06:49.958632+0000","last_fullsized":"2023-08-17T00:06:49.958632+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.937549+0000","last_change":"2023-08-17T00:06:49.509117+0000","last_active":"2023-08-17T00:06:49.937549+0000","last_peered":"2023-08-17T00:06:49.937549+0000","last_clean":"2023-08-17T00:06:49.937549+0000","last_became_active":"2023-08-17T00:06:49.508812+0000","last_became_peered":"2023-08-17T00:06:49.508812+0000","last_unstale":"2023-08-17T00:06:49.937549+0000","last_undegraded":"2023-08-17T00:06:49.937549+0000","last_fullsized":"2023-08-17T00:06:49.937549+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959324+0000","last_change":"2023-08-17T00:06:49.954701+0000","last_active":"2023-08-17T00:06:49.959324+0000","last_peered":"2023-08-17T00:06:49.959324+0000","last_clean":"2023-08-17T00:06:49.959324+0000","last_became_active":"2023-08-17T00:06:49.954403+0000","last_became_peered":"2023-08-17T00:06:49.954403+0000","last_unstale":"2023-08-17T00:06:49.959324+0000","last_undegraded":"2023-08-17T00:06:49.959324+0000","last_fullsized":"2023-08-17T00:06:49.959324+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941380+0000","last_change":"2023-08-17T00:06:49.513803+0000","last_active":"2023-08-17T00:06:49.941380+0000","last_peered":"2023-08-17T00:06:49.941380+0000","last_clean":"2023-08-17T00:06:49.941380+0000","last_became_active":"2023-08-17T00:06:49.513517+0000","last_became_peered":"2023-08-17T00:06:49.513517+0000","last_unstale":"2023-08-17T00:06:49.941380+0000","last_undegraded":"2023-08-17T00:06:49.941380+0000","last_fullsized":"2023-08-17T00:06:49.941380+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961151+0000","last_change":"2023-08-17T00:06:49.953751+0000","last_active":"2023-08-17T00:06:49.961151+0000","last_peered":"2023-08-17T00:06:49.961151+0000","last_clean":"2023-08-17T00:06:49.961151+0000","last_became_active":"2023-08-17T00:06:49.953400+0000","last_became_peered":"2023-08-17T00:06:49.953400+0000","last_unstale":"2023-08-17T00:06:49.961151+0000","last_undegraded":"2023-08-17T00:06:49.961151+0000","last_fullsized":"2023-08-17T00:06:49.961151+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.937610+0000","last_change":"2023-08-17T00:06:49.505444+0000","last_active":"2023-08-17T00:06:49.937610+0000","last_peered":"2023-08-17T00:06:49.937610+0000","last_clean":"2023-08-17T00:06:49.937610+0000","last_became_active":"2023-08-17T00:06:49.505114+0000","last_became_peered":"2023-08-17T00:06:49.505114+0000","last_unstale":"2023-08-17T00:06:49.937610+0000","last_undegraded":"2023-08-17T00:06:49.937610+0000","last_fullsized":"2023-08-17T00:06:49.937610+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961731+0000","last_change":"2023-08-17T00:06:49.952802+0000","last_active":"2023-08-17T00:06:49.961731+0000","last_peered":"2023-08-17T00:06:49.961731+0000","last_clean":"2023-08-17T00:06:49.961731+0000","last_became_active":"2023-08-17T00:06:49.952394+0000","last_became_peered":"2023-08-17T00:06:49.952394+0000","last_unstale":"2023-08-17T00:06:49.961731+0000","last_undegraded":"2023-08-17T00:06:49.961731+0000","last_fullsized":"2023-08-17T00:06:49.961731+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941676+0000","last_change":"2023-08-17T00:06:49.513023+0000","last_active":"2023-08-17T00:06:49.941676+0000","last_peered":"2023-08-17T00:06:49.941676+0000","last_clean":"2023-08-17T00:06:49.941676+0000","last_became_active":"2023-08-17T00:06:49.512394+0000","last_became_peered":"2023-08-17T00:06:49.512394+0000","last_unstale":"2023-08-17T00:06:49.941676+0000","last_undegraded":"2023-08-17T00:06:49.941676+0000","last_fullsized":"2023-08-17T00:06:49.941676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959677+0000","last_change":"2023-08-17T00:06:49.948293+0000","last_active":"2023-08-17T00:06:49.959677+0000","last_peered":"2023-08-17T00:06:49.959677+0000","last_clean":"2023-08-17T00:06:49.959677+0000","last_became_active":"2023-08-17T00:06:49.947961+0000","last_became_peered":"2023-08-17T00:06:49.947961+0000","last_unstale":"2023-08-17T00:06:49.959677+0000","last_undegraded":"2023-08-17T00:06:49.959677+0000","last_fullsized":"2023-08-17T00:06:49.959677+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.939563+0000","last_change":"2023-08-17T00:06:49.522143+0000","last_active":"2023-08-17T00:06:49.939563+0000","last_peered":"2023-08-17T00:06:49.939563+0000","last_clean":"2023-08-17T00:06:49.939563+0000","last_became_active":"2023-08-17T00:06:49.521820+0000","last_became_peered":"2023-08-17T00:06:49.521820+0000","last_unstale":"2023-08-17T00:06:49.939563+0000","last_undegraded":"2023-08-17T00:06:49.939563+0000","last_fullsized":"2023-08-17T00:06:49.939563+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957241+0000","last_change":"2023-08-17T00:06:49.952018+0000","last_active":"2023-08-17T00:06:49.957241+0000","last_peered":"2023-08-17T00:06:49.957241+0000","last_clean":"2023-08-17T00:06:49.957241+0000","last_became_active":"2023-08-17T00:06:49.949326+0000","last_became_peered":"2023-08-17T00:06:49.949326+0000","last_unstale":"2023-08-17T00:06:49.957241+0000","last_undegraded":"2023-08-17T00:06:49.957241+0000","last_fullsized":"2023-08-17T00:06:49.957241+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968671+0000","last_change":"2023-08-17T00:06:49.516309+0000","last_active":"2023-08-17T00:06:49.968671+0000","last_peered":"2023-08-17T00:06:49.968671+0000","last_clean":"2023-08-17T00:06:49.968671+0000","last_became_active":"2023-08-17T00:06:49.516012+0000","last_became_peered":"2023-08-17T00:06:49.516012+0000","last_unstale":"2023-08-17T00:06:49.968671+0000","last_undegraded":"2023-08-17T00:06:49.968671+0000","last_fullsized":"2023-08-17T00:06:49.968671+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969818+0000","last_change":"2023-08-17T00:06:49.960851+0000","last_active":"2023-08-17T00:06:49.969818+0000","last_peered":"2023-08-17T00:06:49.969818+0000","last_clean":"2023-08-17T00:06:49.969818+0000","last_became_active":"2023-08-17T00:06:49.960557+0000","last_became_peered":"2023-08-17T00:06:49.960557+0000","last_unstale":"2023-08-17T00:06:49.969818+0000","last_undegraded":"2023-08-17T00:06:49.969818+0000","last_fullsized":"2023-08-17T00:06:49.969818+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.960120+0000","last_change":"2023-08-17T00:06:49.508182+0000","last_active":"2023-08-17T00:06:49.960120+0000","last_peered":"2023-08-17T00:06:49.960120+0000","last_clean":"2023-08-17T00:06:49.960120+0000","last_became_active":"2023-08-17T00:06:49.507644+0000","last_became_peered":"2023-08-17T00:06:49.507644+0000","last_unstale":"2023-08-17T00:06:49.960120+0000","last_undegraded":"2023-08-17T00:06:49.960120+0000","last_fullsized":"2023-08-17T00:06:49.960120+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.958031+0000","last_change":"2023-08-17T00:06:49.950966+0000","last_active":"2023-08-17T00:06:49.958031+0000","last_peered":"2023-08-17T00:06:49.958031+0000","last_clean":"2023-08-17T00:06:49.958031+0000","last_became_active":"2023-08-17T00:06:49.950694+0000","last_became_peered":"2023-08-17T00:06:49.950694+0000","last_unstale":"2023-08-17T00:06:49.958031+0000","last_undegraded":"2023-08-17T00:06:49.958031+0000","last_fullsized":"2023-08-17T00:06:49.958031+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.13","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977591+0000","last_change":"2023-08-17T00:06:49.514617+0000","last_active":"2023-08-17T00:06:49.977591+0000","last_peered":"2023-08-17T00:06:49.977591+0000","last_clean":"2023-08-17T00:06:49.977591+0000","last_became_active":"2023-08-17T00:06:49.514221+0000","last_became_peered":"2023-08-17T00:06:49.514221+0000","last_unstale":"2023-08-17T00:06:49.977591+0000","last_undegraded":"2023-08-17T00:06:49.977591+0000","last_fullsized":"2023-08-17T00:06:49.977591+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964749+0000","last_change":"2023-08-17T00:06:49.960051+0000","last_active":"2023-08-17T00:06:49.964749+0000","last_peered":"2023-08-17T00:06:49.964749+0000","last_clean":"2023-08-17T00:06:49.964749+0000","last_became_active":"2023-08-17T00:06:49.959615+0000","last_became_peered":"2023-08-17T00:06:49.959615+0000","last_unstale":"2023-08-17T00:06:49.964749+0000","last_undegraded":"2023-08-17T00:06:49.964749+0000","last_fullsized":"2023-08-17T00:06:49.964749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942227+0000","last_change":"2023-08-17T00:06:49.511576+0000","last_active":"2023-08-17T00:06:49.942227+0000","last_peered":"2023-08-17T00:06:49.942227+0000","last_clean":"2023-08-17T00:06:49.942227+0000","last_became_active":"2023-08-17T00:06:49.511318+0000","last_became_peered":"2023-08-17T00:06:49.511318+0000","last_unstale":"2023-08-17T00:06:49.942227+0000","last_undegraded":"2023-08-17T00:06:49.942227+0000","last_fullsized":"2023-08-17T00:06:49.942227+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961596+0000","last_change":"2023-08-17T00:06:49.955884+0000","last_active":"2023-08-17T00:06:49.961596+0000","last_peered":"2023-08-17T00:06:49.961596+0000","last_clean":"2023-08-17T00:06:49.961596+0000","last_became_active":"2023-08-17T00:06:49.955620+0000","last_became_peered":"2023-08-17T00:06:49.955620+0000","last_unstale":"2023-08-17T00:06:49.961596+0000","last_undegraded":"2023-08-17T00:06:49.961596+0000","last_fullsized":"2023-08-17T00:06:49.961596+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.945631+0000","last_change":"2023-08-17T00:06:49.512366+0000","last_active":"2023-08-17T00:06:49.945631+0000","last_peered":"2023-08-17T00:06:49.945631+0000","last_clean":"2023-08-17T00:06:49.945631+0000","last_became_active":"2023-08-17T00:06:49.511783+0000","last_became_peered":"2023-08-17T00:06:49.511783+0000","last_unstale":"2023-08-17T00:06:49.945631+0000","last_undegraded":"2023-08-17T00:06:49.945631+0000","last_fullsized":"2023-08-17T00:06:49.945631+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965208+0000","last_change":"2023-08-17T00:06:49.964265+0000","last_active":"2023-08-17T00:06:49.965208+0000","last_peered":"2023-08-17T00:06:49.965208+0000","last_clean":"2023-08-17T00:06:49.965208+0000","last_became_active":"2023-08-17T00:06:49.964004+0000","last_became_peered":"2023-08-17T00:06:49.964004+0000","last_unstale":"2023-08-17T00:06:49.965208+0000","last_undegraded":"2023-08-17T00:06:49.965208+0000","last_fullsized":"2023-08-17T00:06:49.965208+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964305+0000","last_change":"2023-08-17T00:06:49.512678+0000","last_active":"2023-08-17T00:06:49.964305+0000","last_peered":"2023-08-17T00:06:49.964305+0000","last_clean":"2023-08-17T00:06:49.964305+0000","last_became_active":"2023-08-17T00:06:49.512417+0000","last_became_peered":"2023-08-17T00:06:49.512417+0000","last_unstale":"2023-08-17T00:06:49.964305+0000","last_undegraded":"2023-08-17T00:06:49.964305+0000","last_fullsized":"2023-08-17T00:06:49.964305+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959773+0000","last_change":"2023-08-17T00:06:49.948378+0000","last_active":"2023-08-17T00:06:49.959773+0000","last_peered":"2023-08-17T00:06:49.959773+0000","last_clean":"2023-08-17T00:06:49.959773+0000","last_became_active":"2023-08-17T00:06:49.948039+0000","last_became_peered":"2023-08-17T00:06:49.948039+0000","last_unstale":"2023-08-17T00:06:49.959773+0000","last_undegraded":"2023-08-17T00:06:49.959773+0000","last_fullsized":"2023-08-17T00:06:49.959773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977625+0000","last_change":"2023-08-17T00:06:49.512646+0000","last_active":"2023-08-17T00:06:49.977625+0000","last_peered":"2023-08-17T00:06:49.977625+0000","last_clean":"2023-08-17T00:06:49.977625+0000","last_became_active":"2023-08-17T00:06:49.511754+0000","last_became_peered":"2023-08-17T00:06:49.511754+0000","last_unstale":"2023-08-17T00:06:49.977625+0000","last_undegraded":"2023-08-17T00:06:49.977625+0000","last_fullsized":"2023-08-17T00:06:49.977625+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.959770+0000","last_change":"2023-08-17T00:06:49.951952+0000","last_active":"2023-08-17T00:06:49.959770+0000","last_peered":"2023-08-17T00:06:49.959770+0000","last_clean":"2023-08-17T00:06:49.959770+0000","last_became_active":"2023-08-17T00:06:49.951497+0000","last_became_peered":"2023-08-17T00:06:49.951497+0000","last_unstale":"2023-08-17T00:06:49.959770+0000","last_undegraded":"2023-08-17T00:06:49.959770+0000","last_fullsized":"2023-08-17T00:06:49.959770+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943806+0000","last_change":"2023-08-17T00:06:49.520646+0000","last_active":"2023-08-17T00:06:49.943806+0000","last_peered":"2023-08-17T00:06:49.943806+0000","last_clean":"2023-08-17T00:06:49.943806+0000","last_became_active":"2023-08-17T00:06:49.513607+0000","last_became_peered":"2023-08-17T00:06:49.513607+0000","last_unstale":"2023-08-17T00:06:49.943806+0000","last_undegraded":"2023-08-17T00:06:49.943806+0000","last_fullsized":"2023-08-17T00:06:49.943806+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.968675+0000","last_change":"2023-08-17T00:06:49.956493+0000","last_active":"2023-08-17T00:06:49.968675+0000","last_peered":"2023-08-17T00:06:49.968675+0000","last_clean":"2023-08-17T00:06:49.968675+0000","last_became_active":"2023-08-17T00:06:49.956175+0000","last_became_peered":"2023-08-17T00:06:49.956175+0000","last_unstale":"2023-08-17T00:06:49.968675+0000","last_undegraded":"2023-08-17T00:06:49.968675+0000","last_fullsized":"2023-08-17T00:06:49.968675+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936396+0000","last_change":"2023-08-17T00:06:49.510750+0000","last_active":"2023-08-17T00:06:49.936396+0000","last_peered":"2023-08-17T00:06:49.936396+0000","last_clean":"2023-08-17T00:06:49.936396+0000","last_became_active":"2023-08-17T00:06:49.510500+0000","last_became_peered":"2023-08-17T00:06:49.510500+0000","last_unstale":"2023-08-17T00:06:49.936396+0000","last_undegraded":"2023-08-17T00:06:49.936396+0000","last_fullsized":"2023-08-17T00:06:49.936396+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969854+0000","last_change":"2023-08-17T00:06:49.964221+0000","last_active":"2023-08-17T00:06:49.969854+0000","last_peered":"2023-08-17T00:06:49.969854+0000","last_clean":"2023-08-17T00:06:49.969854+0000","last_became_active":"2023-08-17T00:06:49.963851+0000","last_became_peered":"2023-08-17T00:06:49.963851+0000","last_unstale":"2023-08-17T00:06:49.969854+0000","last_undegraded":"2023-08-17T00:06:49.969854+0000","last_fullsized":"2023-08-17T00:06:49.969854+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941445+0000","last_change":"2023-08-17T00:06:49.514391+0000","last_active":"2023-08-17T00:06:49.941445+0000","last_peered":"2023-08-17T00:06:49.941445+0000","last_clean":"2023-08-17T00:06:49.941445+0000","last_became_active":"2023-08-17T00:06:49.514083+0000","last_became_peered":"2023-08-17T00:06:49.514083+0000","last_unstale":"2023-08-17T00:06:49.941445+0000","last_undegraded":"2023-08-17T00:06:49.941445+0000","last_fullsized":"2023-08-17T00:06:49.941445+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.974778+0000","last_change":"2023-08-17T00:06:49.953480+0000","last_active":"2023-08-17T00:06:49.974778+0000","last_peered":"2023-08-17T00:06:49.974778+0000","last_clean":"2023-08-17T00:06:49.974778+0000","last_became_active":"2023-08-17T00:06:49.953163+0000","last_became_peered":"2023-08-17T00:06:49.953163+0000","last_unstale":"2023-08-17T00:06:49.974778+0000","last_undegraded":"2023-08-17T00:06:49.974778+0000","last_fullsized":"2023-08-17T00:06:49.974778+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940007+0000","last_change":"2023-08-17T00:06:49.513905+0000","last_active":"2023-08-17T00:06:49.940007+0000","last_peered":"2023-08-17T00:06:49.940007+0000","last_clean":"2023-08-17T00:06:49.940007+0000","last_became_active":"2023-08-17T00:06:49.513180+0000","last_became_peered":"2023-08-17T00:06:49.513180+0000","last_unstale":"2023-08-17T00:06:49.940007+0000","last_undegraded":"2023-08-17T00:06:49.940007+0000","last_fullsized":"2023-08-17T00:06:49.940007+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963654+0000","last_change":"2023-08-17T00:06:49.956020+0000","last_active":"2023-08-17T00:06:49.963654+0000","last_peered":"2023-08-17T00:06:49.963654+0000","last_clean":"2023-08-17T00:06:49.963654+0000","last_became_active":"2023-08-17T00:06:49.955731+0000","last_became_peered":"2023-08-17T00:06:49.955731+0000","last_unstale":"2023-08-17T00:06:49.963654+0000","last_undegraded":"2023-08-17T00:06:49.963654+0000","last_fullsized":"2023-08-17T00:06:49.963654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.940569+0000","last_change":"2023-08-17T00:06:49.516633+0000","last_active":"2023-08-17T00:06:49.940569+0000","last_peered":"2023-08-17T00:06:49.940569+0000","last_clean":"2023-08-17T00:06:49.940569+0000","last_became_active":"2023-08-17T00:06:49.516356+0000","last_became_peered":"2023-08-17T00:06:49.516356+0000","last_unstale":"2023-08-17T00:06:49.940569+0000","last_undegraded":"2023-08-17T00:06:49.940569+0000","last_fullsized":"2023-08-17T00:06:49.940569+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.956573+0000","last_change":"2023-08-17T00:06:49.952327+0000","last_active":"2023-08-17T00:06:49.956573+0000","last_peered":"2023-08-17T00:06:49.956573+0000","last_clean":"2023-08-17T00:06:49.956573+0000","last_became_active":"2023-08-17T00:06:49.951999+0000","last_became_peered":"2023-08-17T00:06:49.951999+0000","last_unstale":"2023-08-17T00:06:49.956573+0000","last_undegraded":"2023-08-17T00:06:49.956573+0000","last_fullsized":"2023-08-17T00:06:49.956573+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941544+0000","last_change":"2023-08-17T00:06:49.516661+0000","last_active":"2023-08-17T00:06:49.941544+0000","last_peered":"2023-08-17T00:06:49.941544+0000","last_clean":"2023-08-17T00:06:49.941544+0000","last_became_active":"2023-08-17T00:06:49.516378+0000","last_became_peered":"2023-08-17T00:06:49.516378+0000","last_unstale":"2023-08-17T00:06:49.941544+0000","last_undegraded":"2023-08-17T00:06:49.941544+0000","last_fullsized":"2023-08-17T00:06:49.941544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.961175+0000","last_change":"2023-08-17T00:06:49.954094+0000","last_active":"2023-08-17T00:06:49.961175+0000","last_peered":"2023-08-17T00:06:49.961175+0000","last_clean":"2023-08-17T00:06:49.961175+0000","last_became_active":"2023-08-17T00:06:49.953043+0000","last_became_peered":"2023-08-17T00:06:49.953043+0000","last_unstale":"2023-08-17T00:06:49.961175+0000","last_undegraded":"2023-08-17T00:06:49.961175+0000","last_fullsized":"2023-08-17T00:06:49.961175+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936291+0000","last_change":"2023-08-17T00:06:49.505982+0000","last_active":"2023-08-17T00:06:49.936291+0000","last_peered":"2023-08-17T00:06:49.936291+0000","last_clean":"2023-08-17T00:06:49.936291+0000","last_became_active":"2023-08-17T00:06:49.505667+0000","last_became_peered":"2023-08-17T00:06:49.505667+0000","last_unstale":"2023-08-17T00:06:49.936291+0000","last_undegraded":"2023-08-17T00:06:49.936291+0000","last_fullsized":"2023-08-17T00:06:49.936291+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.969838+0000","last_change":"2023-08-17T00:06:49.964156+0000","last_active":"2023-08-17T00:06:49.969838+0000","last_peered":"2023-08-17T00:06:49.969838+0000","last_clean":"2023-08-17T00:06:49.969838+0000","last_became_active":"2023-08-17T00:06:49.963499+0000","last_became_peered":"2023-08-17T00:06:49.963499+0000","last_unstale":"2023-08-17T00:06:49.969838+0000","last_undegraded":"2023-08-17T00:06:49.969838+0000","last_fullsized":"2023-08-17T00:06:49.969838+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941566+0000","last_change":"2023-08-17T00:06:49.512245+0000","last_active":"2023-08-17T00:06:49.941566+0000","last_peered":"2023-08-17T00:06:49.941566+0000","last_clean":"2023-08-17T00:06:49.941566+0000","last_became_active":"2023-08-17T00:06:49.511971+0000","last_became_peered":"2023-08-17T00:06:49.511971+0000","last_unstale":"2023-08-17T00:06:49.941566+0000","last_undegraded":"2023-08-17T00:06:49.941566+0000","last_fullsized":"2023-08-17T00:06:49.941566+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.947791+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:06:49.947791+0000","last_peered":"2023-08-17T00:06:49.947791+0000","last_clean":"2023-08-17T00:06:49.947791+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:06:49.947791+0000","last_undegraded":"2023-08-17T00:06:49.947791+0000","last_fullsized":"2023-08-17T00:06:49.947791+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.957258+0000","last_change":"2023-08-17T00:06:49.952028+0000","last_active":"2023-08-17T00:06:49.957258+0000","last_peered":"2023-08-17T00:06:49.957258+0000","last_clean":"2023-08-17T00:06:49.957258+0000","last_became_active":"2023-08-17T00:06:49.949293+0000","last_became_peered":"2023-08-17T00:06:49.949293+0000","last_unstale":"2023-08-17T00:06:49.957258+0000","last_undegraded":"2023-08-17T00:06:49.957258+0000","last_fullsized":"2023-08-17T00:06:49.957258+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.946223+0000","last_change":"2023-08-17T00:06:49.520458+0000","last_active":"2023-08-17T00:06:49.946223+0000","last_peered":"2023-08-17T00:06:49.946223+0000","last_clean":"2023-08-17T00:06:49.946223+0000","last_became_active":"2023-08-17T00:06:49.519512+0000","last_became_peered":"2023-08-17T00:06:49.519512+0000","last_unstale":"2023-08-17T00:06:49.946223+0000","last_undegraded":"2023-08-17T00:06:49.946223+0000","last_fullsized":"2023-08-17T00:06:49.946223+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.933933+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:06:49.933933+0000","last_peered":"2023-08-17T00:06:49.933933+0000","last_clean":"2023-08-17T00:06:49.933933+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:06:49.933933+0000","last_undegraded":"2023-08-17T00:06:49.933933+0000","last_fullsized":"2023-08-17T00:06:49.933933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.963711+0000","last_change":"2023-08-17T00:06:49.956976+0000","last_active":"2023-08-17T00:06:49.963711+0000","last_peered":"2023-08-17T00:06:49.963711+0000","last_clean":"2023-08-17T00:06:49.963711+0000","last_became_active":"2023-08-17T00:06:49.956720+0000","last_became_peered":"2023-08-17T00:06:49.956720+0000","last_unstale":"2023-08-17T00:06:49.963711+0000","last_undegraded":"2023-08-17T00:06:49.963711+0000","last_fullsized":"2023-08-17T00:06:49.963711+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977651+0000","last_change":"2023-08-17T00:06:49.506774+0000","last_active":"2023-08-17T00:06:49.977651+0000","last_peered":"2023-08-17T00:06:49.977651+0000","last_clean":"2023-08-17T00:06:49.977651+0000","last_became_active":"2023-08-17T00:06:49.506507+0000","last_became_peered":"2023-08-17T00:06:49.506507+0000","last_unstale":"2023-08-17T00:06:49.977651+0000","last_undegraded":"2023-08-17T00:06:49.977651+0000","last_fullsized":"2023-08-17T00:06:49.977651+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.946297+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:06:49.946297+0000","last_peered":"2023-08-17T00:06:49.946297+0000","last_clean":"2023-08-17T00:06:49.946297+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:06:49.946297+0000","last_undegraded":"2023-08-17T00:06:49.946297+0000","last_fullsized":"2023-08-17T00:06:49.946297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977467+0000","last_change":"2023-08-17T00:06:49.971505+0000","last_active":"2023-08-17T00:06:49.977467+0000","last_peered":"2023-08-17T00:06:49.977467+0000","last_clean":"2023-08-17T00:06:49.977467+0000","last_became_active":"2023-08-17T00:06:49.965317+0000","last_became_peered":"2023-08-17T00:06:49.965317+0000","last_unstale":"2023-08-17T00:06:49.977467+0000","last_undegraded":"2023-08-17T00:06:49.977467+0000","last_fullsized":"2023-08-17T00:06:49.977467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977667+0000","last_change":"2023-08-17T00:06:49.512846+0000","last_active":"2023-08-17T00:06:49.977667+0000","last_peered":"2023-08-17T00:06:49.977667+0000","last_clean":"2023-08-17T00:06:49.977667+0000","last_became_active":"2023-08-17T00:06:49.512076+0000","last_became_peered":"2023-08-17T00:06:49.512076+0000","last_unstale":"2023-08-17T00:06:49.977667+0000","last_undegraded":"2023-08-17T00:06:49.977667+0000","last_fullsized":"2023-08-17T00:06:49.977667+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936120+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:06:49.936120+0000","last_peered":"2023-08-17T00:06:49.936120+0000","last_clean":"2023-08-17T00:06:49.936120+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:06:49.936120+0000","last_undegraded":"2023-08-17T00:06:49.936120+0000","last_fullsized":"2023-08-17T00:06:49.936120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.977366+0000","last_change":"2023-08-17T00:06:49.965098+0000","last_active":"2023-08-17T00:06:49.977366+0000","last_peered":"2023-08-17T00:06:49.977366+0000","last_clean":"2023-08-17T00:06:49.977366+0000","last_became_active":"2023-08-17T00:06:49.964754+0000","last_became_peered":"2023-08-17T00:06:49.964754+0000","last_unstale":"2023-08-17T00:06:49.977366+0000","last_undegraded":"2023-08-17T00:06:49.977366+0000","last_fullsized":"2023-08-17T00:06:49.977366+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.934830+0000","last_change":"2023-08-17T00:06:49.508435+0000","last_active":"2023-08-17T00:06:49.934830+0000","last_peered":"2023-08-17T00:06:49.934830+0000","last_clean":"2023-08-17T00:06:49.934830+0000","last_became_active":"2023-08-17T00:06:49.507937+0000","last_became_peered":"2023-08-17T00:06:49.507937+0000","last_unstale":"2023-08-17T00:06:49.934830+0000","last_undegraded":"2023-08-17T00:06:49.934830+0000","last_fullsized":"2023-08-17T00:06:49.934830+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.943478+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:06:49.943478+0000","last_peered":"2023-08-17T00:06:49.943478+0000","last_clean":"2023-08-17T00:06:49.943478+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:06:49.943478+0000","last_undegraded":"2023-08-17T00:06:49.943478+0000","last_fullsized":"2023-08-17T00:06:49.943478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.965819+0000","last_change":"2023-08-17T00:06:49.963219+0000","last_active":"2023-08-17T00:06:49.965819+0000","last_peered":"2023-08-17T00:06:49.965819+0000","last_clean":"2023-08-17T00:06:49.965819+0000","last_became_active":"2023-08-17T00:06:49.962338+0000","last_became_peered":"2023-08-17T00:06:49.962338+0000","last_unstale":"2023-08-17T00:06:49.965819+0000","last_undegraded":"2023-08-17T00:06:49.965819+0000","last_fullsized":"2023-08-17T00:06:49.965819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.942262+0000","last_change":"2023-08-17T00:06:49.519532+0000","last_active":"2023-08-17T00:06:49.942262+0000","last_peered":"2023-08-17T00:06:49.942262+0000","last_clean":"2023-08-17T00:06:49.942262+0000","last_became_active":"2023-08-17T00:06:49.519136+0000","last_became_peered":"2023-08-17T00:06:49.519136+0000","last_unstale":"2023-08-17T00:06:49.942262+0000","last_undegraded":"2023-08-17T00:06:49.942262+0000","last_fullsized":"2023-08-17T00:06:49.942262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.941646+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:06:49.941646+0000","last_peered":"2023-08-17T00:06:49.941646+0000","last_clean":"2023-08-17T00:06:49.941646+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:06:49.941646+0000","last_undegraded":"2023-08-17T00:06:49.941646+0000","last_fullsized":"2023-08-17T00:06:49.941646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.952056+0000","last_change":"2023-08-17T00:06:49.947221+0000","last_active":"2023-08-17T00:06:49.952056+0000","last_peered":"2023-08-17T00:06:49.952056+0000","last_clean":"2023-08-17T00:06:49.952056+0000","last_became_active":"2023-08-17T00:06:49.946842+0000","last_became_peered":"2023-08-17T00:06:49.946842+0000","last_unstale":"2023-08-17T00:06:49.952056+0000","last_undegraded":"2023-08-17T00:06:49.952056+0000","last_fullsized":"2023-08-17T00:06:49.952056+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.966544+0000","last_change":"2023-08-17T00:06:49.508411+0000","last_active":"2023-08-17T00:06:49.966544+0000","last_peered":"2023-08-17T00:06:49.966544+0000","last_clean":"2023-08-17T00:06:49.966544+0000","last_became_active":"2023-08-17T00:06:49.507447+0000","last_became_peered":"2023-08-17T00:06:49.507447+0000","last_unstale":"2023-08-17T00:06:49.966544+0000","last_undegraded":"2023-08-17T00:06:49.966544+0000","last_fullsized":"2023-08-17T00:06:49.966544+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.944864+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:06:49.944864+0000","last_peered":"2023-08-17T00:06:49.944864+0000","last_clean":"2023-08-17T00:06:49.944864+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:06:49.944864+0000","last_undegraded":"2023-08-17T00:06:49.944864+0000","last_fullsized":"2023-08-17T00:06:49.944864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.964492+0000","last_change":"2023-08-17T00:06:49.960428+0000","last_active":"2023-08-17T00:06:49.964492+0000","last_peered":"2023-08-17T00:06:49.964492+0000","last_clean":"2023-08-17T00:06:49.964492+0000","last_became_active":"2023-08-17T00:06:49.960144+0000","last_became_peered":"2023-08-17T00:06:49.960144+0000","last_unstale":"2023-08-17T00:06:49.964492+0000","last_undegraded":"2023-08-17T00:06:49.964492+0000","last_fullsized":"2023-08-17T00:06:49.964492+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:49.472219+0000","last_clean_scrub_stamp":"2023-08-17T00:06:49.472219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.936491+0000","last_change":"2023-08-17T00:06:49.510208+0000","last_active":"2023-08-17T00:06:49.936491+0000","last_peered":"2023-08-17T00:06:49.936491+0000","last_clean":"2023-08-17T00:06:49.936491+0000","last_became_active":"2023-08-17T00:06:49.509891+0000","last_became_peered":"2023-08-17T00:06:49.509891+0000","last_unstale":"2023-08-17T00:06:49.936491+0000","last_undegraded":"2023-08-17T00:06:49.936491+0000","last_fullsized":"2023-08-17T00:06:49.936491+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:06:48.460019+0000","last_clean_scrub_stamp":"2023-08-17T00:06:48.460019+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.944544+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:06:49.944544+0000","last_peered":"2023-08-17T00:06:49.944544+0000","last_clean":"2023-08-17T00:06:49.944544+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:06:49.944544+0000","last_undegraded":"2023-08-17T00:06:49.944544+0000","last_fullsized":"2023-08-17T00:06:49.944544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":46,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-08-17T00:06:49.935354+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:06:49.935354+0000","last_peered":"2023-08-17T00:06:49.935354+0000","last_clean":"2023-08-17T00:06:49.935354+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:06:49.935354+0000","last_undegraded":"2023-08-17T00:06:49.935354+0000","last_fullsized":"2023-08-17T00:06:49.935354+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542197,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065812,"statfs":{"total":96636764160,"available":96323391488,"internally_reserved":0,"allocated":757760,"data_stored":337585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.236,"15min":1.4119999999999999},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5529999999999999,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.871},{"interface":"front","average":{"1min":1.143,"5min":1.2529999999999999,"15min":1.4610000000000001},"min":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.472,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":1.298}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2729999999999999,"15min":1.474},"min":{"1min":0.747,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.629,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.2589999999999999,"15min":1.46},"min":{"1min":0.72199999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.3959999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1819999999999999,"15min":1.3280000000000001},"min":{"1min":0.81699999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4450000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":1.194},{"interface":"front","average":{"1min":1.248,"5min":1.3300000000000001,"15min":1.4930000000000001},"min":{"1min":0.92600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.681,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2350000000000001,"15min":1.3560000000000001},"min":{"1min":0.92100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.454,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.5069999999999999,"15min":1.7490000000000001},"min":{"1min":0.875,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7370000000000001,"5min":13.074999999999999,"15min":13.074999999999999},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.4299999999999999,"15min":1.7310000000000001},"min":{"1min":0.90200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.389,"15min":1.593},"min":{"1min":0.63600000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5369999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.341}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.5620000000000001,"15min":1.8680000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.6120000000000001,"5min":14.435,"15min":14.435},"last":1.159},{"interface":"front","average":{"1min":1.292,"5min":1.54,"15min":1.8089999999999999},"min":{"1min":0.81799999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.569,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.228}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5669999999999999,"15min":1.8129999999999999},"min":{"1min":0.86899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.546,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.353},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.5069999999999999,"15min":1.718},"min":{"1min":1.03,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.522,"5min":11.365,"15min":11.365},"last":1.3919999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542197,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314228,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057612,"statfs":{"total":96636764160,"available":96314994688,"internally_reserved":0,"allocated":765952,"data_stored":338713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1000000000000001,"15min":1.05},"min":{"1min":0.67200000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.6120000000000001,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.1559999999999999,"15min":1.1459999999999999},"min":{"1min":0.70799999999999996,"5min":0.502,"15min":0.502},"max":{"1min":8.1750000000000007,"5min":8.1750000000000007,"15min":8.1750000000000007},"last":1.159}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.1950000000000001,"15min":1.1120000000000001},"min":{"1min":0.70899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":10.355,"5min":10.355,"15min":10.355},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.619,"5min":1.1259999999999999,"15min":1.016},"min":{"1min":0.69199999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1910000000000001,"15min":1.1739999999999999},"min":{"1min":0.72799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.6970000000000001,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.645,"5min":1.3069999999999999,"15min":1.27},"min":{"1min":0.89800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":1.371}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":1.2629999999999999,"15min":1.177},"min":{"1min":0.73899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":11.475,"5min":11.475,"15min":11.475},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.29,"15min":1.2709999999999999},"min":{"1min":0.75600000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.734,"5min":5.29,"15min":5.29},"last":1.0469999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.80600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":8.2230000000000008},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.3120000000000001,"15min":1.2350000000000001},"min":{"1min":0.69299999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":11.438000000000001,"5min":11.438000000000001,"15min":11.438000000000001},"last":1.242}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.79100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4630000000000001,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":1.591},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.403,"15min":1.337},"min":{"1min":0.93899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":1.53}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.4019999999999999,"15min":1.333},"min":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":11.51,"5min":11.51,"15min":11.51},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.4239999999999999,"15min":1.429},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.552,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":1.2210000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542198,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306048,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065792,"statfs":{"total":96636764160,"available":96323371008,"internally_reserved":0,"allocated":778240,"data_stored":338895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.651},"min":{"1min":0.71799999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3300000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":1.042},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.421,"15min":1.8400000000000001},"min":{"1min":0.68200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.742,"5min":16.838999999999999,"15min":16.838999999999999},"last":1.1120000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.67300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.4490000000000001,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":1.077},{"interface":"front","average":{"1min":1.143,"5min":1.3140000000000001,"15min":1.542},"min":{"1min":0.80200000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.95499999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.472,"15min":1.8540000000000001},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4199999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":1.018},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.377,"15min":1.6539999999999999},"min":{"1min":0.752,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.425,"5min":11.949,"15min":11.949},"last":1.3640000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.4299999999999999,"15min":1.7090000000000001},"min":{"1min":0.83399999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.988,"5min":13.125,"15min":13.125},"last":1.214},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.3620000000000001,"15min":1.5720000000000001},"min":{"1min":0.79700000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6000000000000001,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.484}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.5489999999999999,"15min":1.919},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.4650000000000001,"5min":17.510000000000002,"15min":17.510000000000002},"last":1.444},{"interface":"front","average":{"1min":1.157,"5min":1.651,"15min":2.0910000000000002},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5700000000000001,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.429}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.627,"15min":2.0230000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.714,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.631,"15min":2.0190000000000001},"min":{"1min":0.96099999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.669,"5min":17.050000000000001,"15min":17.050000000000001},"last":1.53}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.7549999999999999,"15min":2.1549999999999998},"min":{"1min":1.097,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.589,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.694,"15min":2.016},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.774,"5min":14.818,"15min":14.818},"last":1.552}]}]},{"osd":3,"up_from":14,"seq":60129542197,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065812,"statfs":{"total":96636764160,"available":96323391488,"internally_reserved":0,"allocated":757760,"data_stored":337605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":1.284},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.252}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.375},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.413},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.462},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.2170000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":761856,"data_stored":337571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.89800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0669999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.91700000000000004,"15min":1.069},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.52,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.89100000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86699999999999999,"15min":0.95399999999999996},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2929999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.042,"15min":1.135},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":3.911,"15min":3.911},"last":1.1459999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1180000000000001,"15min":1.2809999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.712,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.97499999999999998,"15min":1.0620000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5369999999999999,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":1.204}]},{"osd":4,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.488,"15min":1.96},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4039999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.4319999999999999,"15min":1.6930000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5449999999999999,"15min":1.843},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.909,"5min":12.914,"15min":12.914},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.383,"15min":1.609},"min":{"1min":0.76700000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.635,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":1.4339999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.472,"15min":1.804},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.873,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.542,"15min":1.8520000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.9830000000000001,"5min":12.698,"15min":12.698},"last":1.3080000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.5149999999999999,"15min":1.7789999999999999},"min":{"1min":0.74199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2909999999999999,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.548},{"interface":"front","average":{"1min":1.22,"5min":1.51,"15min":1.7869999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7450000000000001,"5min":11.417,"15min":11.417},"last":1.5640000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542197,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301936,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301184,"kb_avail":94069904,"statfs":{"total":96636764160,"available":96327581696,"internally_reserved":0,"allocated":761856,"data_stored":338441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308412416},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85699999999999998,"15min":0.82299999999999995},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4810000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.97799999999999998,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6379999999999999,"5min":13.093,"15min":13.093},"last":1.0629999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.53500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.452,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.93500000000000005,"15min":0.91600000000000004},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3779999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":0.85899999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0629999999999999,"15min":1.05},"min":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2909999999999999,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0329999999999999,"15min":1.022},"min":{"1min":0.56799999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.327,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.96799999999999997}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.2849999999999999,"15min":1.196},"min":{"1min":0.75900000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.363,"5min":20.548999999999999,"15min":20.548999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":0.90900000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.49,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.125}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.401,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8540000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.236},{"interface":"front","average":{"1min":1.238,"5min":1.2789999999999999,"15min":1.302},"min":{"1min":0.86299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6850000000000001,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3240000000000001,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.722,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.54,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.113}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.96199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.615,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.157},{"interface":"front","average":{"1min":1.22,"5min":1.397,"15min":1.407},"min":{"1min":0.877,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.77,"5min":13.131,"15min":13.131},"last":1.425}]}]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306028,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065812,"statfs":{"total":96636764160,"available":96323391488,"internally_reserved":0,"allocated":757760,"data_stored":338407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":0.84399999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":1.125}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":1.2390000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.999}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.337},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2090000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.282},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.373}]}]},{"osd":4,"up_from":13,"seq":55834574902,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":736,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":753664,"data_stored":337515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.871},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.70799999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.345},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.1000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":1.1619999999999999},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":1.2549999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.0489999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.397}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.371}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.226}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:06:59.522 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:06:59.523 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:06:59.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 Processor -- start 2023-08-17T00:06:59.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 -- start start 2023-08-17T00:06:59.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f840a8b70 0x7f0f840632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f840629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f84065240 con 0x7f0f840656d0 2023-08-17T00:06:59.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f84062ea0 con 0x7f0f840a8b70 2023-08-17T00:06:59.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.724+0000 7f0f8c41b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f840638a0 con 0x7f0f840a8f50 2023-08-17T00:06:59.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f840a8b70 0x7f0f840632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f840a8b70 0x7f0f840632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51154/0 (socket says 172.21.15.153:51154) 2023-08-17T00:06:59.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 -- 172.21.15.153:0/3328247109 learned_addr learned my addr 172.21.15.153:0/3328247109 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:59.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f899b6700 1 --2- 172.21.15.153:0/3328247109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f840629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 -- 172.21.15.153:0/3328247109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 msgr2=0x7f0f840629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 --2- 172.21.15.153:0/3328247109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f840629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 -- 172.21.15.153:0/3328247109 >> v1:172.21.15.153:6789/0 conn(0x7f0f840656d0 legacy=0x7f0f840bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 -- 172.21.15.153:0/3328247109 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84064910 con 0x7f0f840a8b70 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8a1b7700 1 --2- 172.21.15.153:0/3328247109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f840632e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f0f80006fd0 tx=0x7f0f800090f0).ready entity=mon.0 client_cookie=54b9909672a22c82 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f891b5700 1 -- 172.21.15.153:0/3328247109 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000b600 con 0x7f0f840a8b70 2023-08-17T00:06:59.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f891b5700 1 -- 172.21.15.153:0/3328247109 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000b760 con 0x7f0f840a8b70 2023-08-17T00:06:59.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f891b5700 1 -- 172.21.15.153:0/3328247109 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000bae0 con 0x7f0f840a8b70 2023-08-17T00:06:59.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3328247109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 msgr2=0x7f0f840632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3328247109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f840632e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f0f80006fd0 tx=0x7f0f800090f0).stop 2023-08-17T00:06:59.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3328247109 shutdown_connections 2023-08-17T00:06:59.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3328247109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f840629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3328247109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f840632e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3328247109 >> 172.21.15.153:0/3328247109 conn(0x7f0f840c7150 msgr2=0x7f0f840c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:59.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3328247109 shutdown_connections 2023-08-17T00:06:59.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.728+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3328247109 wait complete. 2023-08-17T00:06:59.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 Processor -- start 2023-08-17T00:06:59.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 -- start start 2023-08-17T00:06:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f840656d0 0x7f0f8414bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f841699d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f8416c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f84168f90 con 0x7f0f840a8b70 2023-08-17T00:06:59.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8416d000 con 0x7f0f840656d0 2023-08-17T00:06:59.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8c41b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8416d2e0 con 0x7f0f840a8f50 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f841699d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f841699d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51166/0 (socket says 172.21.15.153:51166) 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 -- 172.21.15.153:0/3899376634 learned_addr learned my addr 172.21.15.153:0/3899376634 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8a1b7700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f840656d0 0x7f0f8414bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8a9b8700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f8416c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 -- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 msgr2=0x7f0f8416c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f8416c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 -- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f840656d0 msgr2=0x7f0f8414bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f840656d0 0x7f0f8414bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f899b6700 1 -- 172.21.15.153:0/3899376634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80009370 con 0x7f0f840a8b70 2023-08-17T00:06:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.732+0000 7f0f8a9b8700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f8416c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:06:59.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f899b6700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f841699d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f0f7400d860 tx=0x7f0f74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74011590 con 0x7f0f840a8b70 2023-08-17T00:06:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f740116f0 con 0x7f0f840a8b70 2023-08-17T00:06:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f841691d0 con 0x7f0f840a8b70 2023-08-17T00:06:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74011a70 con 0x7f0f840a8b70 2023-08-17T00:06:59.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f84169ec0 con 0x7f0f840a8b70 2023-08-17T00:06:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8406b530 con 0x7f0f840a8b70 2023-08-17T00:06:59.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.736+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0f74012420 con 0x7f0f840a8b70 2023-08-17T00:06:59.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.740+0000 7f0f7a7fc700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f6805a150 0x7f0f6805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:06:59.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.740+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0f74073c10 con 0x7f0f840a8b70 2023-08-17T00:06:59.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.740+0000 7f0f8a1b7700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f6805a150 0x7f0f6805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:06:59.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.740+0000 7f0f8a1b7700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f6805a150 0x7f0f6805c610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f0f80009130 tx=0x7f0f80017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:06:59.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.744+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f74047660 con 0x7f0f840a8b70 2023-08-17T00:06:59.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.960+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0f840c0530 con 0x7f0f840a8b70 2023-08-17T00:06:59.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.968+0000 7f0f7a7fc700 1 -- 172.21.15.153:0/3899376634 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0f74011e60 con 0x7f0f840a8b70 2023-08-17T00:06:59.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f6805a150 msgr2=0x7f0f6805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f6805a150 0x7f0f6805c610 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f0f80009130 tx=0x7f0f80017000).stop 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 msgr2=0x7f0f841699d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f841699d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f0f7400d860 tx=0x7f0f74008040).stop 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 shutdown_connections 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f6805a150 0x7f0f6805c610 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f840a8f50 0x7f0f8416c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f840a8b70 0x7f0f841699d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 --2- 172.21.15.153:0/3899376634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f840656d0 0x7f0f8414bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:06:59.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 >> 172.21.15.153:0/3899376634 conn(0x7f0f840c7150 msgr2=0x7f0f840c20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:06:59.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 shutdown_connections 2023-08-17T00:06:59.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:06:59.972+0000 7f0f8c41b700 1 -- 172.21.15.153:0/3899376634 wait complete. 2023-08-17T00:06:59.978 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:06:59.996 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:00.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.148+0000 7fe3d14f1700 1 Processor -- start 2023-08-17T00:07:00.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.148+0000 7fe3d14f1700 1 -- start start 2023-08-17T00:07:00.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3d14f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3cc0a89c0 0x7fe3cc0a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3d14f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc0bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3d14f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3cc1505d0 0x7fe3cc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3d14f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0bd590 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3d14f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0bc0b0 con 0x7fe3cc1505d0 2023-08-17T00:07:00.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3d14f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0bb780 con 0x7fe3cc0c0c80 2023-08-17T00:07:00.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3cc0a89c0 0x7fe3cc0a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe3cc0a89c0 0x7fe3cc0a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51168/0 (socket says 172.21.15.153:51168) 2023-08-17T00:07:00.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 -- 172.21.15.153:0/924500829 learned_addr learned my addr 172.21.15.153:0/924500829 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:00.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/924500829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc0bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3cb7fe700 1 --2- 172.21.15.153:0/924500829 >> v2:172.21.15.178:3300/0 conn(0x7fe3cc1505d0 0x7fe3cc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 -- 172.21.15.153:0/924500829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 msgr2=0x7fe3cc0bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 --2- 172.21.15.153:0/924500829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc0bcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 -- 172.21.15.153:0/924500829 >> v2:172.21.15.178:3300/0 conn(0x7fe3cc1505d0 msgr2=0x7fe3cc150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 --2- 172.21.15.153:0/924500829 >> v2:172.21.15.178:3300/0 conn(0x7fe3cc1505d0 0x7fe3cc150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 -- 172.21.15.153:0/924500829 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc0bba60 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3cb7fe700 1 --2- 172.21.15.153:0/924500829 >> v2:172.21.15.178:3300/0 conn(0x7fe3cc1505d0 0x7fe3cc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3caffd700 1 --2- 172.21.15.153:0/924500829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc0a8da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fe3cc0c0c10 tx=0x7fe3bc0090f0).ready entity=mon.0 client_cookie=e66db1cebdb5cfb0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3c9ffb700 1 -- 172.21.15.153:0/924500829 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00b600 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3c9ffb700 1 -- 172.21.15.153:0/924500829 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc00b760 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.152+0000 7fe3c9ffb700 1 -- 172.21.15.153:0/924500829 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00bb00 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 -- 172.21.15.153:0/924500829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 msgr2=0x7fe3cc0a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/924500829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc0a8da0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7fe3cc0c0c10 tx=0x7fe3bc0090f0).stop 2023-08-17T00:07:00.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 -- 172.21.15.153:0/924500829 shutdown_connections 2023-08-17T00:07:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/924500829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc0bcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/924500829 >> v2:172.21.15.178:3300/0 conn(0x7fe3cc1505d0 0x7fe3cc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/924500829 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc0a8da0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 -- 172.21.15.153:0/924500829 >> 172.21.15.153:0/924500829 conn(0x7fe3cc0c7150 msgr2=0x7fe3cc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 -- 172.21.15.153:0/924500829 shutdown_connections 2023-08-17T00:07:00.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.156+0000 7fe3d14f1700 1 -- 172.21.15.153:0/924500829 wait complete. 2023-08-17T00:07:00.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 Processor -- start 2023-08-17T00:07:00.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 -- start start 2023-08-17T00:07:00.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc14db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc1505d0 0x7fe3cc13cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc14ef60 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc162260 con 0x7fe3cc1505d0 2023-08-17T00:07:00.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3d14f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc14e350 con 0x7fe3cc0c0c80 2023-08-17T00:07:00.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc153310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51170/0 (socket says 172.21.15.153:51170) 2023-08-17T00:07:00.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 -- 172.21.15.153:0/2646748667 learned_addr learned my addr 172.21.15.153:0/2646748667 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc14db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3cb7fe700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc1505d0 0x7fe3cc13cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 -- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 msgr2=0x7fe3cc14db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc14db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 -- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc1505d0 msgr2=0x7fe3cc13cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc1505d0 0x7fe3cc13cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 -- 172.21.15.153:0/2646748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3bc009370 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3caffd700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc153310 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fe3cc05e420 tx=0x7fe3bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.160+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00bec0 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3bc002f30 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc14e630 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3bc00bb00 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc14ebf0 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc06b530 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe3bc00f070 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3b2ffd700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a120 0x7fe3b805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.164+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe3bc0762d0 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.168+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a120 0x7fe3b805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.168+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a120 0x7fe3b805c5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe3cc0a87c0 tx=0x7fe3c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.172+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3bc049e00 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.368+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3cc0bbd40 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.368+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/2646748667 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4502 (secure 0 0 0) 0x7fe3bc04d420 con 0x7fe3cc0a89c0 2023-08-17T00:07:00.373 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:00.373 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":49,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5504,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4267159718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4267159718},{"type":"v1","addr":"172.21.15.178:6835","nonce":4267159718}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3471728406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3471728406},{"type":"v1","addr":"172.21.15.178:6837","nonce":3471728406}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5513,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3615703685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3615703685},{"type":"v1","addr":"172.21.15.153:6835","nonce":3615703685}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:06:53.146605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6219":{"gid":6219,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6834/1621445932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1621445932},{"type":"v1","addr":"172.21.15.153:6834","nonce":1621445932}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:00.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a120 msgr2=0x7fe3b805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a120 0x7fe3b805c5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe3cc0a87c0 tx=0x7fe3c0008040).stop 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 msgr2=0x7fe3cc153310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc153310 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fe3cc05e420 tx=0x7fe3bc017000).stop 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 shutdown_connections 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a120 0x7fe3b805c5e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc1505d0 0x7fe3cc13cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0c0c80 0x7fe3cc14db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 --2- 172.21.15.153:0/2646748667 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a89c0 0x7fe3cc153310 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 >> 172.21.15.153:0/2646748667 conn(0x7fe3cc0c7150 msgr2=0x7fe3cc0c4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:00.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 shutdown_connections 2023-08-17T00:07:00.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.372+0000 7fe3d14f1700 1 -- 172.21.15.153:0/2646748667 wait complete. 2023-08-17T00:07:00.381 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 49 2023-08-17T00:07:00.801 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:06:49.925811+0000', 'modified': '2023-08-17T00:06:53.146605+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6219}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6219': {'gid': 6219, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6834/1621445932', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1621445932}, {'type': 'v1', 'addr': '172.21.15.153:6834', 'nonce': 1621445932}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:07:00.802 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:07:00.802 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:07:00.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.952+0000 7efd36079700 1 Processor -- start 2023-08-17T00:07:00.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.952+0000 7efd36079700 1 -- start start 2023-08-17T00:07:00.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd36079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd300a8df0 0x7efd300c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd36079700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efd30068820 0x7efd30068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd36079700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd30061fa0 0x7efd30062420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd36079700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd301585a0 con 0x7efd30061fa0 2023-08-17T00:07:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd36079700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd30066400 con 0x7efd30068820 2023-08-17T00:07:00.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd36079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd30069170 con 0x7efd300a8df0 2023-08-17T00:07:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd30061fa0 0x7efd30062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efd30061fa0 0x7efd30062420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51182/0 (socket says 172.21.15.153:51182) 2023-08-17T00:07:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 -- 172.21.15.153:0/3897167522 learned_addr learned my addr 172.21.15.153:0/3897167522 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35077700 1 --2- 172.21.15.153:0/3897167522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd300a8df0 0x7efd300c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd34876700 1 --2- 172.21.15.153:0/3897167522 >> v2:172.21.15.178:3300/0 conn(0x7efd30068820 0x7efd30068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 -- 172.21.15.153:0/3897167522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd300a8df0 msgr2=0x7efd300c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 --2- 172.21.15.153:0/3897167522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd300a8df0 0x7efd300c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 -- 172.21.15.153:0/3897167522 >> v2:172.21.15.178:3300/0 conn(0x7efd30068820 msgr2=0x7efd30068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 --2- 172.21.15.153:0/3897167522 >> v2:172.21.15.178:3300/0 conn(0x7efd30068820 0x7efd30068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 -- 172.21.15.153:0/3897167522 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300b9d30 con 0x7efd30061fa0 2023-08-17T00:07:00.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd35878700 1 --2- 172.21.15.153:0/3897167522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd30061fa0 0x7efd30062420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7efd30066830 tx=0x7efd28009840).ready entity=mon.0 client_cookie=b80515cd4ba33fda server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.956+0000 7efd27fff700 1 -- 172.21.15.153:0/3897167522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800e070 con 0x7efd30061fa0 2023-08-17T00:07:00.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd27fff700 1 -- 172.21.15.153:0/3897167522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2800b970 con 0x7efd30061fa0 2023-08-17T00:07:00.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd27fff700 1 -- 172.21.15.153:0/3897167522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800bcf0 con 0x7efd30061fa0 2023-08-17T00:07:00.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 -- 172.21.15.153:0/3897167522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd30061fa0 msgr2=0x7efd30062420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 --2- 172.21.15.153:0/3897167522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd30061fa0 0x7efd30062420 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7efd30066830 tx=0x7efd28009840).stop 2023-08-17T00:07:00.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 -- 172.21.15.153:0/3897167522 shutdown_connections 2023-08-17T00:07:00.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 --2- 172.21.15.153:0/3897167522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd30061fa0 0x7efd30062420 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 --2- 172.21.15.153:0/3897167522 >> v2:172.21.15.178:3300/0 conn(0x7efd30068820 0x7efd30068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 --2- 172.21.15.153:0/3897167522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd300a8df0 0x7efd300c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 -- 172.21.15.153:0/3897167522 >> 172.21.15.153:0/3897167522 conn(0x7efd300c6620 msgr2=0x7efd300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 -- 172.21.15.153:0/3897167522 shutdown_connections 2023-08-17T00:07:00.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.960+0000 7efd36079700 1 -- 172.21.15.153:0/3897167522 wait complete. 2023-08-17T00:07:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 Processor -- start 2023-08-17T00:07:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 -- start start 2023-08-17T00:07:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd30061fa0 0x7efd3016cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd30068820 0x7efd300bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 0x7efd30156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300be690 con 0x7efd300a8df0 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd300bec20 con 0x7efd30061fa0 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd36079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd300bddf0 con 0x7efd30068820 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 0x7efd30156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 0x7efd30156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51196/0 (socket says 172.21.15.153:51196) 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 -- 172.21.15.153:0/1283376177 learned_addr learned my addr 172.21.15.153:0/1283376177 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:00.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd34876700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd30068820 0x7efd300bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35077700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd30061fa0 0x7efd3016cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 -- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd30068820 msgr2=0x7efd300bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd30068820 0x7efd300bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 -- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd30061fa0 msgr2=0x7efd3016cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd30061fa0 0x7efd3016cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35878700 1 -- 172.21.15.153:0/1283376177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd28009ae0 con 0x7efd300a8df0 2023-08-17T00:07:00.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.964+0000 7efd35077700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd30061fa0 0x7efd3016cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:00.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.968+0000 7efd35878700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 0x7efd30156df0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7efd2800b610 tx=0x7efd28009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.968+0000 7efd257fa700 1 -- 172.21.15.153:0/1283376177 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800bee0 con 0x7efd300a8df0 2023-08-17T00:07:00.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.968+0000 7efd257fa700 1 -- 172.21.15.153:0/1283376177 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2800bcf0 con 0x7efd300a8df0 2023-08-17T00:07:00.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.968+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd300be0d0 con 0x7efd300a8df0 2023-08-17T00:07:00.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.968+0000 7efd257fa700 1 -- 172.21.15.153:0/1283376177 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2801d6b0 con 0x7efd300a8df0 2023-08-17T00:07:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.968+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300bda90 con 0x7efd300a8df0 2023-08-17T00:07:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd257fa700 1 -- 172.21.15.153:0/1283376177 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efd28024030 con 0x7efd300a8df0 2023-08-17T00:07:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd257fa700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efd1405a150 0x7efd1405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd257fa700 1 -- 172.21.15.153:0/1283376177 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd28075360 con 0x7efd300a8df0 2023-08-17T00:07:00.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd35077700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efd1405a150 0x7efd1405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd41667740 1 Processor -- start 2023-08-17T00:07:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd41667740 1 -- start start 2023-08-17T00:07:00.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.972+0000 7efd35077700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efd1405a150 0x7efd1405c610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7efd2c009200 tx=0x7efd2c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2754b60 0x2754f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2710380 0x270e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x275f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x267e5c0 con 0x270ed90 2023-08-17T00:07:00.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2693e90 con 0x2754b60 2023-08-17T00:07:00.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x265a220 con 0x2710380 2023-08-17T00:07:00.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x275f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x275f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51212/0 (socket says 172.21.15.153:51212) 2023-08-17T00:07:00.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 -- 172.21.15.153:0/3559177145 learned_addr learned my addr 172.21.15.153:0/3559177145 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:00.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd34876700 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2710380 0x270e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35077700 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2754b60 0x2754f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 -- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2710380 msgr2=0x270e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2710380 0x270e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 -- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2754b60 msgr2=0x2754f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2754b60 0x2754f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 -- 172.21.15.153:0/3559177145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x269f500 con 0x270ed90 2023-08-17T00:07:00.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35077700 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2754b60 0x2754f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd35878700 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x275f760 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7efd2804c5c0 tx=0x7efd2800e000).ready entity=mon.0 client_cookie=ac33b492bc5be7ac server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd1a7fc700 1 -- 172.21.15.153:0/3559177145 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28052180 con 0x270ed90 2023-08-17T00:07:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd1a7fc700 1 -- 172.21.15.153:0/3559177145 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2804af20 con 0x270ed90 2023-08-17T00:07:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd1a7fc700 1 -- 172.21.15.153:0/3559177145 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28049290 con 0x270ed90 2023-08-17T00:07:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- 172.21.15.153:0/3559177145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 msgr2=0x275f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x275f760 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7efd2804c5c0 tx=0x7efd2800e000).stop 2023-08-17T00:07:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- 172.21.15.153:0/3559177145 shutdown_connections 2023-08-17T00:07:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x275f760 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2710380 0x270e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 --2- 172.21.15.153:0/3559177145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2754b60 0x2754f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- 172.21.15.153:0/3559177145 >> 172.21.15.153:0/3559177145 conn(0x24f2550 msgr2=0x2713e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:00.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- 172.21.15.153:0/3559177145 shutdown_connections 2023-08-17T00:07:00.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.976+0000 7efd41667740 1 -- 172.21.15.153:0/3559177145 wait complete. 2023-08-17T00:07:00.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 -- start start 2023-08-17T00:07:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 Processor -- start 2023-08-17T00:07:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x270ed90 0x2738990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2737eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 0x27383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x265f110 con 0x2754b60 2023-08-17T00:07:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2738e80 con 0x2710380 2023-08-17T00:07:00.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27574d0 con 0x270ed90 2023-08-17T00:07:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd41667740 10 client.0 ll_register_callbacks cb 0x26cb3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 0x27383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 0x27383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51214/0 (socket says 172.21.15.153:51214) 2023-08-17T00:07:00.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 -- 172.21.15.153:0/134955737 learned_addr learned my addr 172.21.15.153:0/134955737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:00.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 -- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x270ed90 msgr2=0x2738990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd34876700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2737eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35077700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x270ed90 0x2738990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x270ed90 0x2738990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 -- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 msgr2=0x2737eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:00.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2737eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 -- 172.21.15.153:0/134955737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd300bda90 con 0x2754b60 2023-08-17T00:07:00.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd34876700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2737eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:00.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35077700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x270ed90 0x2738990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:00.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd35878700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 0x27383a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7efd2804c5c0 tx=0x7efd2802c000).ready entity=mon.0 client_cookie=6768c6d3820965f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:00.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd0f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:07:00.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.980+0000 7efd0f7fe700 1 -- 172.21.15.153:0/134955737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28037070 con 0x2754b60 2023-08-17T00:07:00.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 1 -- 172.21.15.153:0/134955737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd2804cb20 con 0x2754b60 2023-08-17T00:07:00.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2689c60 con 0x2754b60 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 1 -- 172.21.15.153:0/134955737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd2800e040 con 0x2754b60 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 10 client.6381 fetch_fsmap learned FSMap version 49 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x268cf80 con 0x2754b60 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 1 -- 172.21.15.153:0/134955737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2689c60 con 0x2754b60 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 1 -- 172.21.15.153:0/134955737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efd28073b00 con 0x2754b60 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 10 client.6381 fetch_fsmap finished waiting for FSMap version 49 2023-08-17T00:07:00.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 10 client.6381 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:07:00.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 20 client.6381 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:00.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x27589d0 0x2758db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:00.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 4 client.6381 mds_command: new command op to 6219 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:07:00.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 --> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x26801b0 con 0x27589d0 2023-08-17T00:07:00.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd35077700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x27589d0 0x2758db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:00.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd35077700 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x27589d0 0x2758db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=26c95218bb34efaa server_cookie=a9c14510f838653b in_seq=0 out_seq=0 2023-08-17T00:07:00.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 10 client.6381 ms_handle_connect on v2:172.21.15.153:6832/1621445932 2023-08-17T00:07:00.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 1 -- 172.21.15.153:0/134955737 <== mds.0 v2:172.21.15.153:6832/1621445932 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x26801b0 con 0x27589d0 2023-08-17T00:07:00.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd0f7fe700 10 client.6381 handle_command_reply: tid=0 2023-08-17T00:07:00.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 client.6381 shutdown 2023-08-17T00:07:00.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 msgr2=0x27383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:00.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.984+0000 7efd41667740 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 0x27383a0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7efd2804c5c0 tx=0x7efd2802c000).stop 2023-08-17T00:07:00.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 shutdown_connections 2023-08-17T00:07:00.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x27589d0 0x2758db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2754b60 0x27383a0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2737eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 --2- 172.21.15.153:0/134955737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x270ed90 0x2738990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:00.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd0f7fe700 0 client.6381 ms_handle_reset on v2:172.21.15.153:6832/1621445932 2023-08-17T00:07:01.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 >> 172.21.15.153:0/134955737 conn(0x24f2550 msgr2=0x2759a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:01.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 shutdown_connections 2023-08-17T00:07:01.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 1 -- 172.21.15.153:0/134955737 wait complete. 2023-08-17T00:07:01.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:00.988+0000 7efd41667740 20 client.6381 trim_cache size 0 max 16384 2023-08-17T00:07:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.004+0000 7efd41667740 1 Processor -- start 2023-08-17T00:07:01.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.004+0000 7efd41667740 1 -- start start 2023-08-17T00:07:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x2753250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2710760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x2764e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2756500 con 0x270ed90 2023-08-17T00:07:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27580e0 con 0x2710380 2023-08-17T00:07:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26d8350 con 0x2754b60 2023-08-17T00:07:01.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x2753250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x2753250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51230/0 (socket says 172.21.15.153:51230) 2023-08-17T00:07:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35077700 1 -- 172.21.15.153:0/821085758 learned_addr learned my addr 172.21.15.153:0/821085758 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd34876700 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2710760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x2764e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 -- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 msgr2=0x2710760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:01.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2710760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 -- 172.21.15.153:0/821085758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 msgr2=0x2753250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x2753250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 -- 172.21.15.153:0/821085758 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd300aa220 con 0x2754b60 2023-08-17T00:07:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd35878700 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x2764e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efd2804c830 tx=0x7efd28032000).ready entity=mon.2 client_cookie=10943d72264b6b9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd1affd700 1 -- 172.21.15.153:0/821085758 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd28037070 con 0x2754b60 2023-08-17T00:07:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd1affd700 1 -- 172.21.15.153:0/821085758 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2804c330 con 0x2754b60 2023-08-17T00:07:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd1affd700 1 -- 172.21.15.153:0/821085758 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2800e040 con 0x2754b60 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 msgr2=0x2764e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x2764e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7efd2804c830 tx=0x7efd28032000).stop 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- 172.21.15.153:0/821085758 shutdown_connections 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x2764e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2710380 0x2710760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 --2- 172.21.15.153:0/821085758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x270ed90 0x2753250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- 172.21.15.153:0/821085758 >> 172.21.15.153:0/821085758 conn(0x24f2550 msgr2=0x273ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:01.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.008+0000 7efd41667740 1 -- 172.21.15.153:0/821085758 shutdown_connections 2023-08-17T00:07:01.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 -- 172.21.15.153:0/821085758 wait complete. 2023-08-17T00:07:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 -- start start 2023-08-17T00:07:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 Processor -- start 2023-08-17T00:07:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x270ed90 0x27be070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 0x2753d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x27541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x276ef10 con 0x2710380 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27be560 con 0x270ed90 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27546e0 con 0x2754b60 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd41667740 10 client.0 ll_register_callbacks cb 0x7efd200095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 0x2753d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 0x2753d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51232/0 (socket says 172.21.15.153:51232) 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 -- 172.21.15.153:0/2458586537 learned_addr learned my addr 172.21.15.153:0/2458586537 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd35878700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x27541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd35077700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x270ed90 0x27be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 -- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 msgr2=0x27541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x27541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 -- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x270ed90 msgr2=0x27be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x270ed90 0x27be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd34876700 1 -- 172.21.15.153:0/2458586537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x268cf80 con 0x2710380 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd35077700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x270ed90 0x27be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.012+0000 7efd35878700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x27541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd34876700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 0x2753d00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7efd30069cc0 tx=0x7efd20008040).ready entity=mon.0 client_cookie=36c456ca4d2b7183 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 1 -- 172.21.15.153:0/2458586537 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2001c070 con 0x2710380 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 1 -- 172.21.15.153:0/2458586537 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efd20016850 con 0x2710380 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efd2804af20 con 0x2710380 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 1 -- 172.21.15.153:0/2458586537 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd20016c20 con 0x2710380 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 10 client.6387 fetch_fsmap learned FSMap version 49 2023-08-17T00:07:01.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x2688420 con 0x2710380 2023-08-17T00:07:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 1 -- 172.21.15.153:0/2458586537 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd2804af20 con 0x2710380 2023-08-17T00:07:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 1 -- 172.21.15.153:0/2458586537 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7efd20014430 con 0x2710380 2023-08-17T00:07:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 10 client.6387 fetch_fsmap finished waiting for FSMap version 49 2023-08-17T00:07:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 10 client.6387 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:07:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 20 client.6387 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x270d690 0x270da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 4 client.6387 mds_command: new command op to 6219 tid=0[{"prefix": "status"}] 2023-08-17T00:07:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 --> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] -- command(tid 0: {"prefix": "status"}) v1 -- 0x25494e0 con 0x270d690 2023-08-17T00:07:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd35077700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x270d690 0x270da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 10 client.6387 ms_handle_connect on v2:172.21.15.153:6832/1621445932 2023-08-17T00:07:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd35077700 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x270d690 0x270da70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fc48f895445030a2 server_cookie=43fcb3b67703a297 in_seq=0 out_seq=0 2023-08-17T00:07:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 1 -- 172.21.15.153:0/2458586537 <== mds.0 v2:172.21.15.153:6832/1621445932 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x25494e0 con 0x270d690 2023-08-17T00:07:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd0f7fe700 10 client.6387 handle_command_reply: tid=0 2023-08-17T00:07:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 client.6387 shutdown 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 msgr2=0x2753d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.016+0000 7efd41667740 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 0x2753d00 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7efd30069cc0 tx=0x7efd20008040).stop 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 shutdown_connections 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2754b60 0x27541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:6832/1621445932,v1:172.21.15.153:6834/1621445932] conn(0x270d690 0x270da70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2710380 0x2753d00 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 --2- 172.21.15.153:0/2458586537 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x270ed90 0x27be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd0f7fe700 0 client.6387 ms_handle_reset on v2:172.21.15.153:6832/1621445932 2023-08-17T00:07:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 >> 172.21.15.153:0/2458586537 conn(0x24f2550 msgr2=0x2710f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 shutdown_connections 2023-08-17T00:07:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 1 -- 172.21.15.153:0/2458586537 wait complete. 2023-08-17T00:07:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd41667740 20 client.6387 trim_cache size 0 max 16384 2023-08-17T00:07:01.028 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:07:01.029 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:07:01.029 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:07:01.029 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6219, 2023-08-17T00:07:01.029 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:07:01.029 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:07:01.029 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:07:01.030 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 11.092357935000001, 2023-08-17T00:07:01.030 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 49, 2023-08-17T00:07:01.030 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 63, 2023-08-17T00:07:01.030 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 63, 2023-08-17T00:07:01.030 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 16.478889427999999 2023-08-17T00:07:01.030 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:07:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efd1405a150 msgr2=0x7efd1405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efd1405a150 0x7efd1405c610 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7efd2c009200 tx=0x7efd2c008040).stop 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 msgr2=0x7efd30156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 0x7efd30156df0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7efd2800b610 tx=0x7efd28009840).stop 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 shutdown_connections 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efd1405a150 0x7efd1405c610 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efd300a8df0 0x7efd30156df0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efd30068820 0x7efd300bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 --2- 172.21.15.153:0/1283376177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efd30061fa0 0x7efd3016cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 >> 172.21.15.153:0/1283376177 conn(0x7efd300c6620 msgr2=0x7efd300c58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 shutdown_connections 2023-08-17T00:07:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.020+0000 7efd36079700 1 -- 172.21.15.153:0/1283376177 wait complete. 2023-08-17T00:07:01.045 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:07:01.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e9f69700 1 Processor -- start 2023-08-17T00:07:01.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e9f69700 1 -- start start 2023-08-17T00:07:01.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e9f69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73e40c6d90 0x7f73e4151c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e9f69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e4066c50 con 0x7f73e4066830 2023-08-17T00:07:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e9f69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e4062550 con 0x7f73e40c69b0 2023-08-17T00:07:01.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e9f69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e40c7200 con 0x7f73e40c6d90 2023-08-17T00:07:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73e3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f73e40c6d90 0x7f73e4151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73dbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f73e4066830 0x7f73e4065530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42374/0 (socket says 172.21.15.153:42374) 2023-08-17T00:07:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.176+0000 7f73dbfff700 1 -- 172.21.15.153:0/4233793414 learned_addr learned my addr 172.21.15.153:0/4233793414 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e2ffd700 1 -- 172.21.15.153:0/4233793414 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1953616459 0 0) 0x7f73e4066c50 con 0x7f73e4066830 2023-08-17T00:07:01.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e3fff700 1 -- 172.21.15.153:0/4233793414 >> v1:172.21.15.178:6789/0 conn(0x7f73e40c69b0 legacy=0x7f73e4151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e3fff700 1 -- 172.21.15.153:0/4233793414 >> v1:172.21.15.153:6789/0 conn(0x7f73e4066830 legacy=0x7f73e4065530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e3fff700 1 -- 172.21.15.153:0/4233793414 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40629e0 con 0x7f73e40c6d90 2023-08-17T00:07:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e3fff700 1 --2- 172.21.15.153:0/4233793414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4151c60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f73dc009de0 tx=0x7f73dc009780).ready entity=mon.0 client_cookie=d9ad0660f64aeacf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e2ffd700 1 -- 172.21.15.153:0/4233793414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00e070 con 0x7f73e40c6d90 2023-08-17T00:07:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e2ffd700 1 -- 172.21.15.153:0/4233793414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00bae0 con 0x7f73e40c6d90 2023-08-17T00:07:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e2ffd700 1 -- 172.21.15.153:0/4233793414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00be60 con 0x7f73e40c6d90 2023-08-17T00:07:01.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 -- 172.21.15.153:0/4233793414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 msgr2=0x7f73e4151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 --2- 172.21.15.153:0/4233793414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4151c60 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f73dc009de0 tx=0x7f73dc009780).stop 2023-08-17T00:07:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 -- 172.21.15.153:0/4233793414 shutdown_connections 2023-08-17T00:07:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 --2- 172.21.15.153:0/4233793414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4151c60 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 -- 172.21.15.153:0/4233793414 >> 172.21.15.153:0/4233793414 conn(0x7f73e405dca0 msgr2=0x7f73e405e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 -- 172.21.15.153:0/4233793414 shutdown_connections 2023-08-17T00:07:01.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 -- 172.21.15.153:0/4233793414 wait complete. 2023-08-17T00:07:01.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.180+0000 7f73e9f69700 1 Processor -- start 2023-08-17T00:07:01.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 -- start start 2023-08-17T00:07:01.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73e4066830 0x7f73e40be240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40c69b0 0x7f73e4153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40bddb0 con 0x7f73e40c6d90 2023-08-17T00:07:01.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40bf680 con 0x7f73e40c69b0 2023-08-17T00:07:01.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4164e40 con 0x7f73e4066830 2023-08-17T00:07:01.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4164260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51258/0 (socket says 172.21.15.153:51258) 2023-08-17T00:07:01.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 -- 172.21.15.153:0/770087354 learned_addr learned my addr 172.21.15.153:0/770087354 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:01.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73dbfff700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40c69b0 0x7f73e4153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e37fe700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73e4066830 0x7f73e40be240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 -- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73e4066830 msgr2=0x7f73e40be240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73e4066830 0x7f73e40be240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 -- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40c69b0 msgr2=0x7f73e4153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40c69b0 0x7f73e4153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 -- 172.21.15.153:0/770087354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc009a20 con 0x7f73e40c6d90 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e3fff700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4164260 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f73dc00b6c0 tx=0x7f73dc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc01c660 con 0x7f73e40c6d90 2023-08-17T00:07:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc01c7c0 con 0x7f73e40c6d90 2023-08-17T00:07:01.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e4165120 con 0x7f73e40c6d90 2023-08-17T00:07:01.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc01cb60 con 0x7f73e40c6d90 2023-08-17T00:07:01.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.184+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e40bda40 con 0x7f73e40c6d90 2023-08-17T00:07:01.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.188+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e40bdf20 con 0x7f73e40c6d90 2023-08-17T00:07:01.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.188+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f73dc01d420 con 0x7f73e40c6d90 2023-08-17T00:07:01.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.188+0000 7f73db7fe700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73c405a180 0x7f73c405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:01.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.188+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f73dc0762b0 con 0x7f73e40c6d90 2023-08-17T00:07:01.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.188+0000 7f73e37fe700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73c405a180 0x7f73c405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:01.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.192+0000 7f73e37fe700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73c405a180 0x7f73c405c640 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f73e40bee20 tx=0x7f73d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:01.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.196+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73dc049bf0 con 0x7f73e40c6d90 2023-08-17T00:07:01.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.392+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f73e40688e0 con 0x7f73e40c6d90 2023-08-17T00:07:01.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.392+0000 7f73db7fe700 1 -- 172.21.15.153:0/770087354 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f73dc04d210 con 0x7f73e40c6d90 2023-08-17T00:07:01.399 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:07:01.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73c405a180 msgr2=0x7f73c405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73c405a180 0x7f73c405c640 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f73e40bee20 tx=0x7f73d4009040).stop 2023-08-17T00:07:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 msgr2=0x7f73e4164260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4164260 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f73dc00b6c0 tx=0x7f73dc009780).stop 2023-08-17T00:07:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 shutdown_connections 2023-08-17T00:07:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73c405a180 0x7f73c405c640 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e40c6d90 0x7f73e4164260 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40c69b0 0x7f73e4153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 --2- 172.21.15.153:0/770087354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73e4066830 0x7f73e40be240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 >> 172.21.15.153:0/770087354 conn(0x7f73e405dca0 msgr2=0x7f73e4150a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 shutdown_connections 2023-08-17T00:07:01.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:01.396+0000 7f73e9f69700 1 -- 172.21.15.153:0/770087354 wait complete. 2023-08-17T00:07:01.418 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:07:01.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:07:01.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:07:01.419 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:07:01.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:01.419 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:07:01.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:07:01.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:07:01.421 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:07:01.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.422 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:07:01.440 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:07:01.441 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:07:01.441 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:07:01.441 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.441 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:07:01.441 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:01.442 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42192sec preferred_lft 42192sec 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.443 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:07:01.444 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:07:01.445 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:07:01.446 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:07:01.446 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:01.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.447 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:07:01.531 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:07:01.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.534 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:07:01.594 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:07:01.595 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:07:01.595 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:07:01.595 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:07:01.595 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:07:01.595 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:07:01.595 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:07:01.596 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:07:01.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.597 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:07:01.597 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:07:01.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:07:01.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:07:01.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:07:01.598 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:07:01.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.731 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:07:01.748 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:07:01.749 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:07:01.749 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:07:01.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.750 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:07:01.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:01.826 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:01.885 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:07:01.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:02.003 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:02.003 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:07:02.023 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:02.023 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:07:02.028 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:07:02.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:02.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:02.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:02.058 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2023-08-17T00:07:02.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:02.129 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2023-08-17T00:07:02.196 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:07:02.197 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:07:02.197 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:07:02.197 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:07:02.198 DEBUG:teuthology.orchestra.run.smithi153:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2023-08-17T00:07:02.198 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:07:02.333 INFO:teuthology.orchestra.run.smithi153.stdout:1099511627776 2023-08-17T00:07:02.523 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:07:02.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:02.524 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:02.678 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:07:02.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:02.679 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:07:02.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:02.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 Processor -- start 2023-08-17T00:07:02.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 -- start start 2023-08-17T00:07:02.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d700a8b70 0x7f1d700632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:02.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d700a8f50 0x7f1d700629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:02.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d70065240 con 0x7f1d700656d0 2023-08-17T00:07:02.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d70062ea0 con 0x7f1d700a8b70 2023-08-17T00:07:02.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.892+0000 7f1d7871b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d700638a0 con 0x7f1d700a8f50 2023-08-17T00:07:02.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d700a8b70 0x7f1d700632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:02.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d700a8b70 0x7f1d700632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51264/0 (socket says 172.21.15.153:51264) 2023-08-17T00:07:02.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 -- 172.21.15.153:0/3404729144 learned_addr learned my addr 172.21.15.153:0/3404729144 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:02.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d75cb6700 1 --2- 172.21.15.153:0/3404729144 >> v2:172.21.15.178:3300/0 conn(0x7f1d700a8f50 0x7f1d700629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:02.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 -- 172.21.15.153:0/3404729144 >> v2:172.21.15.178:3300/0 conn(0x7f1d700a8f50 msgr2=0x7f1d700629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:02.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 --2- 172.21.15.153:0/3404729144 >> v2:172.21.15.178:3300/0 conn(0x7f1d700a8f50 0x7f1d700629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:02.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 -- 172.21.15.153:0/3404729144 >> v1:172.21.15.178:6789/0 conn(0x7f1d700656d0 legacy=0x7f1d700bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:02.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 -- 172.21.15.153:0/3404729144 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d70064910 con 0x7f1d700a8b70 2023-08-17T00:07:02.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d764b7700 1 --2- 172.21.15.153:0/3404729144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8b70 0x7f1d700632e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f1d70069d30 tx=0x7f1d6c0090f0).ready entity=mon.0 client_cookie=416958ae50d5f5fd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:02.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d754b5700 1 -- 172.21.15.153:0/3404729144 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00b600 con 0x7f1d700a8b70 2023-08-17T00:07:02.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d754b5700 1 -- 172.21.15.153:0/3404729144 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00b760 con 0x7f1d700a8b70 2023-08-17T00:07:02.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d754b5700 1 -- 172.21.15.153:0/3404729144 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00bae0 con 0x7f1d700a8b70 2023-08-17T00:07:02.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 -- 172.21.15.153:0/3404729144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8b70 msgr2=0x7f1d700632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 --2- 172.21.15.153:0/3404729144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8b70 0x7f1d700632e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f1d70069d30 tx=0x7f1d6c0090f0).stop 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 -- 172.21.15.153:0/3404729144 shutdown_connections 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 --2- 172.21.15.153:0/3404729144 >> v2:172.21.15.178:3300/0 conn(0x7f1d700a8f50 0x7f1d700629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 --2- 172.21.15.153:0/3404729144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8b70 0x7f1d700632e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 -- 172.21.15.153:0/3404729144 >> 172.21.15.153:0/3404729144 conn(0x7f1d700c7150 msgr2=0x7f1d700c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 -- 172.21.15.153:0/3404729144 shutdown_connections 2023-08-17T00:07:02.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.896+0000 7f1d7871b700 1 -- 172.21.15.153:0/3404729144 wait complete. 2023-08-17T00:07:02.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 Processor -- start 2023-08-17T00:07:02.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 -- start start 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700656d0 0x7f1d7015b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700a8b70 0x7f1d701550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 0x7f1d700aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d70155590 con 0x7f1d700a8f50 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700ab450 con 0x7f1d700656d0 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d7871b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d700aa840 con 0x7f1d700a8b70 2023-08-17T00:07:02.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 0x7f1d700aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:02.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 0x7f1d700aa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51276/0 (socket says 172.21.15.153:51276) 2023-08-17T00:07:02.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 -- 172.21.15.153:0/1132327620 learned_addr learned my addr 172.21.15.153:0/1132327620 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:02.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d764b7700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700656d0 0x7f1d7015b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:02.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d75cb6700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700a8b70 0x7f1d701550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:02.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 -- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700a8b70 msgr2=0x7f1d701550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:02.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700a8b70 0x7f1d701550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:02.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 -- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700656d0 msgr2=0x7f1d7015b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:02.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700656d0 0x7f1d7015b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:02.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 -- 172.21.15.153:0/1132327620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009370 con 0x7f1d700a8f50 2023-08-17T00:07:02.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.900+0000 7f1d76cb8700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 0x7f1d700aa060 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f1d68002230 tx=0x7f1d680015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:02.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d68010510 con 0x7f1d700a8f50 2023-08-17T00:07:02.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d68010670 con 0x7f1d700a8f50 2023-08-17T00:07:02.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d700aab20 con 0x7f1d700a8f50 2023-08-17T00:07:02.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d680109f0 con 0x7f1d700a8f50 2023-08-17T00:07:02.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d700ab0e0 con 0x7f1d700a8f50 2023-08-17T00:07:02.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d700ab5e0 con 0x7f1d700a8f50 2023-08-17T00:07:02.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.904+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1d68010070 con 0x7f1d700a8f50 2023-08-17T00:07:02.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.908+0000 7f1d667fc700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d5405a150 0x7f1d5405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:02.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.908+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1d68073eb0 con 0x7f1d700a8f50 2023-08-17T00:07:02.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.908+0000 7f1d764b7700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d5405a150 0x7f1d5405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:02.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.908+0000 7f1d764b7700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d5405a150 0x7f1d5405c610 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f1d6c009130 tx=0x7f1d6c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:02.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:02.912+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d68047850 con 0x7f1d700a8f50 2023-08-17T00:07:03.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.112+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d7006b530 con 0x7f1d700a8f50 2023-08-17T00:07:03.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.112+0000 7f1d667fc700 1 -- 172.21.15.153:0/1132327620 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4502 (secure 0 0 0) 0x7f1d6804ae70 con 0x7f1d700a8f50 2023-08-17T00:07:03.118 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:03.118 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":49,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5504,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4267159718","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4267159718},{"type":"v1","addr":"172.21.15.178:6835","nonce":4267159718}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5507,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3471728406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3471728406},{"type":"v1","addr":"172.21.15.178:6837","nonce":3471728406}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5513,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3615703685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3615703685},{"type":"v1","addr":"172.21.15.153:6835","nonce":3615703685}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:06:53.146605+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6219},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6219":{"gid":6219,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6834/1621445932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1621445932},{"type":"v1","addr":"172.21.15.153:6834","nonce":1621445932}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:03.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d5405a150 msgr2=0x7f1d5405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d5405a150 0x7f1d5405c610 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f1d6c009130 tx=0x7f1d6c017000).stop 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 msgr2=0x7f1d700aa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 0x7f1d700aa060 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x7f1d68002230 tx=0x7f1d680015e0).stop 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 shutdown_connections 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d5405a150 0x7f1d5405c610 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d700a8f50 0x7f1d700aa060 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d700a8b70 0x7f1d701550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 --2- 172.21.15.153:0/1132327620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d700656d0 0x7f1d7015b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 >> 172.21.15.153:0/1132327620 conn(0x7f1d700c7150 msgr2=0x7f1d700c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 shutdown_connections 2023-08-17T00:07:03.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.116+0000 7f1d7871b700 1 -- 172.21.15.153:0/1132327620 wait complete. 2023-08-17T00:07:03.123 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 49 2023-08-17T00:07:03.142 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2023-08-17T00:07:03.334 INFO:teuthology.orchestra.run.smithi153.stdout:{"message":"","return_code":0} 2023-08-17T00:07:03.335 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-08-17T00:07:03.335 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:07:03.336 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:03.336 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:07:03.336 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:03.337 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:07:03.337 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:03.337 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:07:03.337 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:03.356 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:07:03.357 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:03.357 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:07:03.357 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:03.359 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:07:03.359 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:03.375 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:07:03.375 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:03.376 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2023-08-17T00:07:03.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 Processor -- start 2023-08-17T00:07:03.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 -- start start 2023-08-17T00:07:03.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558878230c70 0x55887822eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7b50 0x558878243c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588782d7f30 0x558878244130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558878177ce0 con 0x558878230c70 2023-08-17T00:07:03.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55887824e020 con 0x5588782d7b50 2023-08-17T00:07:03.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c9180d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5588782d3b20 con 0x5588782d7f30 2023-08-17T00:07:03.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c6ab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558878230c70 0x55887822eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7b50 0x558878243c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c6ab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558878230c70 0x55887822eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51284/0 (socket says 172.21.15.153:51284) 2023-08-17T00:07:03.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c6ab7700 1 -- 172.21.15.153:0/1800646352 learned_addr learned my addr 172.21.15.153:0/1800646352 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c72b8700 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588782d7f30 0x558878244130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 -- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588782d7f30 msgr2=0x558878244130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:03.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588782d7f30 0x558878244130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 -- 172.21.15.153:0/1800646352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558878230c70 msgr2=0x55887822eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:03.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558878230c70 0x55887822eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 -- 172.21.15.153:0/1800646352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c000a180 con 0x5588782d7b50 2023-08-17T00:07:03.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7be2b6700 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7b50 0x558878243c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff7b0001d70 tx=0x7ff7b0001840).ready entity=mon.1 client_cookie=29cb034ff761934b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c5ab5700 1 -- 172.21.15.153:0/1800646352 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000ba30 con 0x5588782d7b50 2023-08-17T00:07:03.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c5ab5700 1 -- 172.21.15.153:0/1800646352 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b0008070 con 0x5588782d7b50 2023-08-17T00:07:03.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.452+0000 7ff7c5ab5700 1 -- 172.21.15.153:0/1800646352 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b000bb90 con 0x5588782d7b50 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 -- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7b50 msgr2=0x558878243c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7b50 0x558878243c40 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7ff7b0001d70 tx=0x7ff7b0001840).stop 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 -- 172.21.15.153:0/1800646352 shutdown_connections 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5588782d7f30 0x558878244130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7b50 0x558878243c40 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/1800646352 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558878230c70 0x55887822eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 -- 172.21.15.153:0/1800646352 >> 172.21.15.153:0/1800646352 conn(0x55887824f770 msgr2=0x55887822e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 -- 172.21.15.153:0/1800646352 shutdown_connections 2023-08-17T00:07:03.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 -- 172.21.15.153:0/1800646352 wait complete. 2023-08-17T00:07:03.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 Processor -- start 2023-08-17T00:07:03.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 -- start start 2023-08-17T00:07:03.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558878230c70 0x5588782ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588782d7b50 0x5588782d9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.456+0000 7ff7c9180d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7f30 0x5588782d40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c9180d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588782cd080 con 0x5588782d7b50 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c9180d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588782d62b0 con 0x5588782d7f30 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c9180d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55887822eaa0 con 0x558878230c70 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588782d7b50 0x5588782d9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588782d7b50 0x5588782d9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51286/0 (socket says 172.21.15.153:51286) 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 -- 172.21.15.153:0/347512925 learned_addr learned my addr 172.21.15.153:0/347512925 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c6ab7700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558878230c70 0x5588782ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c72b8700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7f30 0x5588782d40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 -- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558878230c70 msgr2=0x5588782ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558878230c70 0x5588782ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 -- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7f30 msgr2=0x5588782d40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5588782d7f30 0x5588782d40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 -- 172.21.15.153:0/347512925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b000a040 con 0x5588782d7b50 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7be2b6700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588782d7b50 0x5588782d9310 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7ff7b000b7a0 tx=0x7ff7b0001840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7bffff700 1 -- 172.21.15.153:0/347512925 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b0000d00 con 0x5588782d7b50 2023-08-17T00:07:03.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7bffff700 1 -- 172.21.15.153:0/347512925 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b001b3f0 con 0x5588782d7b50 2023-08-17T00:07:03.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7bffff700 1 -- 172.21.15.153:0/347512925 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b001b790 con 0x5588782d7b50 2023-08-17T00:07:03.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5588781a1230 con 0x5588782d7b50 2023-08-17T00:07:03.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.460+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558878170a70 con 0x5588782d7b50 2023-08-17T00:07:03.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7bffff700 1 -- 172.21.15.153:0/347512925 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff7b001bb80 con 0x5588782d7b50 2023-08-17T00:07:03.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7bffff700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff7a8058c30 0x7ff7a805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7bffff700 1 -- 172.21.15.153:0/347512925 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff7b0074160 con 0x5588782d7b50 2023-08-17T00:07:03.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x5588782cdcd0 0x5588782d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 --> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] -- osd_op(unknown.0.0:1 9.30 9:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected e63) v8 -- 0x558878245680 con 0x5588782cdcd0 2023-08-17T00:07:03.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7c6ab7700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff7a8058c30 0x7ff7a805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7c72b8700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x5588782cdcd0 0x5588782d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.464+0000 7ff7c6ab7700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff7a8058c30 0x7ff7a805b0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ff7b8005e80 tx=0x7ff7b800c040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c72b8700 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x5588782cdcd0 0x5588782d6c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c72b8700 1 -- 172.21.15.153:0/347512925 <== osd.6 v2:172.21.15.178:6808/33068 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v63'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ff7c000cd30 con 0x5588782cdcd0 2023-08-17T00:07:03.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x5588782cdcd0 msgr2=0x5588782d6c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x5588782cdcd0 0x5588782d6c60 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff7a8058c30 msgr2=0x7ff7a805b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff7a8058c30 0x7ff7a805b0f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7ff7b8005e80 tx=0x7ff7b800c040).stop 2023-08-17T00:07:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588782d7b50 msgr2=0x5588782d9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 --2- 172.21.15.153:0/347512925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x5588782d7b50 0x5588782d9310 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7ff7b000b7a0 tx=0x7ff7b0001840).stop 2023-08-17T00:07:03.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c72b8700 1 -- 172.21.15.153:0/347512925 reap_dead start 2023-08-17T00:07:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 shutdown_connections 2023-08-17T00:07:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 >> 172.21.15.153:0/347512925 conn(0x55887824f770 msgr2=0x55887822faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 shutdown_connections 2023-08-17T00:07:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.468+0000 7ff7c9180d00 1 -- 172.21.15.153:0/347512925 wait complete. 2023-08-17T00:07:03.480 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-08-17T00:07:03.480 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-08-17T00:07:03.481 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2023-08-17T00:07:03.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-08-17T00:07:03.482 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2023-08-17T00:07:03.482 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-08-17T00:07:03.482 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2023-08-17T00:07:03.483 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-08-17T00:07:03.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.624+0000 7f650b59e700 1 Processor -- start 2023-08-17T00:07:03.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.624+0000 7f7c31f07700 1 Processor -- start 2023-08-17T00:07:03.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.624+0000 7f650b59e700 1 -- start start 2023-08-17T00:07:03.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.624+0000 7f7c31f07700 1 -- start start 2023-08-17T00:07:03.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f650c153f50 0x7f650c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c01a0 0x7f650c0c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31f07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c2c0c57a0 0x7f7c2c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31f07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7c2c153f50 0x7f7c2c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f650c0bfd10 con 0x7f650c0c57a0 2023-08-17T00:07:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f650c154860 con 0x7f650c153f50 2023-08-17T00:07:03.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c154af0 con 0x7f650c0c01a0 2023-08-17T00:07:03.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c157600 0x7f7c2c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31f07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c0bfd10 con 0x7f7c2c0c57a0 2023-08-17T00:07:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31f07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c154860 con 0x7f7c2c153f50 2023-08-17T00:07:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c154af0 con 0x7f7c2c157600 2023-08-17T00:07:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c2c0c57a0 0x7f7c2c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c2c0c57a0 0x7f7c2c0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51302/0 (socket says 172.21.15.153:51302) 2023-08-17T00:07:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 -- 172.21.15.153:0/630160214 learned_addr learned my addr 172.21.15.153:0/630160214 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650a59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f650c0c57a0 0x7f650c0c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42378/0 (socket says 172.21.15.153:42378) 2023-08-17T00:07:03.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650a59c700 1 -- 172.21.15.153:0/1293966015 learned_addr learned my addr 172.21.15.153:0/1293966015 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:03.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31706700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c157600 0x7f7c2c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f6509d9b700 1 --2- 172.21.15.153:0/1293966015 >> v2:172.21.15.178:3300/0 conn(0x7f650c153f50 0x7f650c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650ad9d700 1 --2- 172.21.15.153:0/1293966015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c01a0 0x7f650c0c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c23fff700 1 --2- 172.21.15.153:0/630160214 >> v2:172.21.15.178:3300/0 conn(0x7f7c2c153f50 0x7f7c2c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 -- 172.21.15.153:0/630160214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c157600 msgr2=0x7f7c2c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c157600 0x7f7c2c157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 -- 172.21.15.153:0/630160214 >> v2:172.21.15.178:3300/0 conn(0x7f7c2c153f50 msgr2=0x7f7c2c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 --2- 172.21.15.153:0/630160214 >> v2:172.21.15.178:3300/0 conn(0x7f7c2c153f50 0x7f7c2c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 -- 172.21.15.153:0/630160214 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c154dd0 con 0x7f7c2c0c57a0 2023-08-17T00:07:03.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c31706700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c157600 0x7f7c2c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:03.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650959a700 1 -- 172.21.15.153:0/1293966015 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951217292 0 0) 0x7f650c0bfd10 con 0x7f650c0c57a0 2023-08-17T00:07:03.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f650959a700 1 -- 172.21.15.153:0/1293966015 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f80033f0 con 0x7f650c0c57a0 2023-08-17T00:07:03.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.628+0000 7f7c30f05700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c0c57a0 0x7f7c2c0c5b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f7c2c0c86a0 tx=0x7f7c280090f0).ready entity=mon.0 client_cookie=1aa1f03f10c00c2e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650ad9d700 1 -- 172.21.15.153:0/1293966015 >> v2:172.21.15.178:3300/0 conn(0x7f650c153f50 msgr2=0x7f650c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650ad9d700 1 --2- 172.21.15.153:0/1293966015 >> v2:172.21.15.178:3300/0 conn(0x7f650c153f50 0x7f650c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650ad9d700 1 -- 172.21.15.153:0/1293966015 >> v1:172.21.15.153:6789/0 conn(0x7f650c0c57a0 legacy=0x7f650c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650ad9d700 1 -- 172.21.15.153:0/1293966015 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650c154dd0 con 0x7f650c0c01a0 2023-08-17T00:07:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c237fe700 1 -- 172.21.15.153:0/630160214 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800b600 con 0x7f7c2c0c57a0 2023-08-17T00:07:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c237fe700 1 -- 172.21.15.153:0/630160214 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2800b760 con 0x7f7c2c0c57a0 2023-08-17T00:07:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c237fe700 1 -- 172.21.15.153:0/630160214 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2800bae0 con 0x7f7c2c0c57a0 2023-08-17T00:07:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650ad9d700 1 --2- 172.21.15.153:0/1293966015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c01a0 0x7f650c0c0630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f64fc009e60 tx=0x7f64fc009780).ready entity=mon.2 client_cookie=f567cd488e113e51 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650959a700 1 -- 172.21.15.153:0/1293966015 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00e070 con 0x7f650c0c01a0 2023-08-17T00:07:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650959a700 1 -- 172.21.15.153:0/1293966015 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc00ba70 con 0x7f650c0c01a0 2023-08-17T00:07:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650959a700 1 -- 172.21.15.153:0/1293966015 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc00bdf0 con 0x7f650c0c01a0 2023-08-17T00:07:03.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 -- 172.21.15.153:0/630160214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c0c57a0 msgr2=0x7f7c2c0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c0c57a0 0x7f7c2c0c5b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f7c2c0c86a0 tx=0x7f7c280090f0).stop 2023-08-17T00:07:03.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 -- 172.21.15.153:0/630160214 shutdown_connections 2023-08-17T00:07:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c157600 0x7f7c2c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 --2- 172.21.15.153:0/630160214 >> v2:172.21.15.178:3300/0 conn(0x7f7c2c153f50 0x7f7c2c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 --2- 172.21.15.153:0/630160214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c0c57a0 0x7f7c2c0c5b80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 -- 172.21.15.153:0/630160214 >> 172.21.15.153:0/630160214 conn(0x7f7c2c062a70 msgr2=0x7f7c2c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 -- 172.21.15.153:0/630160214 shutdown_connections 2023-08-17T00:07:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 -- 172.21.15.153:0/630160214 wait complete. 2023-08-17T00:07:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 -- 172.21.15.153:0/1293966015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c01a0 msgr2=0x7f650c0c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 --2- 172.21.15.153:0/1293966015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c01a0 0x7f650c0c0630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f64fc009e60 tx=0x7f64fc009780).stop 2023-08-17T00:07:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 -- 172.21.15.153:0/1293966015 shutdown_connections 2023-08-17T00:07:03.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 --2- 172.21.15.153:0/1293966015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c01a0 0x7f650c0c0630 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 --2- 172.21.15.153:0/1293966015 >> v2:172.21.15.178:3300/0 conn(0x7f650c153f50 0x7f650c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 -- 172.21.15.153:0/1293966015 >> 172.21.15.153:0/1293966015 conn(0x7f650c062a70 msgr2=0x7f650c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 -- 172.21.15.153:0/1293966015 shutdown_connections 2023-08-17T00:07:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f650b59e700 1 -- 172.21.15.153:0/1293966015 wait complete. 2023-08-17T00:07:03.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 Processor -- start 2023-08-17T00:07:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.632+0000 7f7c31f07700 1 -- start start 2023-08-17T00:07:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9179679700 1 Processor -- start 2023-08-17T00:07:03.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9179679700 1 -- start start 2023-08-17T00:07:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c0c57a0 0x7f7c2c142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 0x7f7c2c0adc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c157600 0x7f7c2c0c3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0abfb0 con 0x7f7c2c153f50 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0ae7c0 con 0x7f7c2c157600 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0ab710 con 0x7f7c2c0c57a0 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 0x7f7c2c0adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 0x7f7c2c0adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51314/0 (socket says 172.21.15.153:51314) 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 -- 172.21.15.153:0/3739927927 learned_addr learned my addr 172.21.15.153:0/3739927927 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31706700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c157600 0x7f7c2c0c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c30f05700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c0c57a0 0x7f7c2c142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f650b59e700 1 Processor -- start 2023-08-17T00:07:03.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 -- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c0c57a0 msgr2=0x7f7c2c142200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c0c57a0 0x7f7c2c142200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 -- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c157600 msgr2=0x7f7c2c0c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c157600 0x7f7c2c0c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 -- 172.21.15.153:0/3739927927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009370 con 0x7f7c2c153f50 2023-08-17T00:07:03.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f650b59e700 1 -- start start 2023-08-17T00:07:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c23fff700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 0x7f7c2c0adc70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f7c1c00d8c0 tx=0x7f7c1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0095b0 con 0x7f7c2c153f50 2023-08-17T00:07:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c009710 con 0x7f7c2c153f50 2023-08-17T00:07:03.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c009a90 con 0x7f7c2c153f50 2023-08-17T00:07:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c0ab9f0 con 0x7f7c2c153f50 2023-08-17T00:07:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9179679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91740660e0 0x7f917415e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9179679700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740bd610 con 0x7f91740c3bc0 2023-08-17T00:07:03.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9179679700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740c4210 con 0x7f9174153a60 2023-08-17T00:07:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9179679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740c44f0 con 0x7f91740660e0 2023-08-17T00:07:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c0b0700 con 0x7f7c2c153f50 2023-08-17T00:07:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9173fff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9174153a60 0x7f9174063c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:37076/0 (socket says 172.21.15.153:37076) 2023-08-17T00:07:03.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9173fff700 1 -- 172.21.15.153:0/557486732 learned_addr learned my addr 172.21.15.153:0/557486732 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:03.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f9178e78700 1 --2- 172.21.15.153:0/557486732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91740660e0 0x7f917415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.636+0000 7f650b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 0x7f650c0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128205181 0 0) 0x7f91740bd610 con 0x7f91740c3bc0 2023-08-17T00:07:03.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91600033f0 con 0x7f91740c3bc0 2023-08-17T00:07:03.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847280071 0 0) 0x7f91740c4210 con 0x7f9174153a60 2023-08-17T00:07:03.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91740bd610 con 0x7f9174153a60 2023-08-17T00:07:03.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c57a0 0x7f650c1675b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f9178e78700 1 -- 172.21.15.153:0/557486732 >> v1:172.21.15.178:6789/0 conn(0x7f9174153a60 legacy=0x7f9174063c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f9178e78700 1 -- 172.21.15.153:0/557486732 >> v1:172.21.15.153:6789/0 conn(0x7f91740c3bc0 legacy=0x7f91740659d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c0ae950 con 0x7f7c2c153f50 2023-08-17T00:07:03.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f9178e78700 1 -- 172.21.15.153:0/557486732 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740bd860 con 0x7f91740660e0 2023-08-17T00:07:03.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c153f50 0x7f650c14a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c167d90 con 0x7f650c0c01a0 2023-08-17T00:07:03.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650c168070 con 0x7f650c153f50 2023-08-17T00:07:03.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 0x7f650c0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f650c168350 con 0x7f650c0c57a0 2023-08-17T00:07:03.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 0x7f650c0c3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51330/0 (socket says 172.21.15.153:51330) 2023-08-17T00:07:03.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 -- 172.21.15.153:0/204061819 learned_addr learned my addr 172.21.15.153:0/204061819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f9178e78700 1 --2- 172.21.15.153:0/557486732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91740660e0 0x7f917415e650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f916c009e90 tx=0x7f916c009780).ready entity=mon.2 client_cookie=91ae5c25d59075f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650ad9d700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c153f50 0x7f650c14a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f6509d9b700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c57a0 0x7f650c1675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00e070 con 0x7f91740660e0 2023-08-17T00:07:03.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 -- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c57a0 msgr2=0x7f650c1675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c57a0 0x7f650c1675b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 -- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c153f50 msgr2=0x7f650c14a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c153f50 0x7f650c14a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 -- 172.21.15.153:0/204061819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc009a20 con 0x7f650c0c01a0 2023-08-17T00:07:03.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f6509d9b700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c57a0 0x7f650c1675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:03.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00bab0 con 0x7f91740660e0 2023-08-17T00:07:03.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f91737fe700 1 -- 172.21.15.153:0/557486732 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00be30 con 0x7f91740660e0 2023-08-17T00:07:03.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650a59c700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 0x7f650c0c3960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f650400c4e0 tx=0x7f6504007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7c1c013480 con 0x7f7c2c153f50 2023-08-17T00:07:03.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040072e0 con 0x7f650c0c01a0 2023-08-17T00:07:03.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504007440 con 0x7f650c0c01a0 2023-08-17T00:07:03.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65040057a0 con 0x7f650c0c01a0 2023-08-17T00:07:03.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f650c164310 con 0x7f650c0c01a0 2023-08-17T00:07:03.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f9179679700 1 -- 172.21.15.153:0/557486732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91740660e0 msgr2=0x7f917415e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f9179679700 1 --2- 172.21.15.153:0/557486732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91740660e0 0x7f917415e650 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f916c009e90 tx=0x7f916c009780).stop 2023-08-17T00:07:03.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c163fe0 con 0x7f650c0c01a0 2023-08-17T00:07:03.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f7c20ff9700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7c1805a150 0x7f7c1805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c1c074140 con 0x7f7c2c153f50 2023-08-17T00:07:03.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.640+0000 7f7c30f05700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7c1805a150 0x7f7c1805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f650c0c4cf0 con 0x7f650c0c01a0 2023-08-17T00:07:03.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- 172.21.15.153:0/557486732 shutdown_connections 2023-08-17T00:07:03.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 --2- 172.21.15.153:0/557486732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91740660e0 0x7f917415e650 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- 172.21.15.153:0/557486732 >> 172.21.15.153:0/557486732 conn(0x7f91740c5c20 msgr2=0x7f91740652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f7c30f05700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7c1805a150 0x7f7c1805c610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f7c28009130 tx=0x7f7c28017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- 172.21.15.153:0/557486732 shutdown_connections 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- 172.21.15.153:0/557486732 wait complete. 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 Processor -- start 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- start start 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 0x7f917414bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740c3bc0 0x7f91740abae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153a60 0x7f91740abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917414c290 con 0x7f91740660e0 2023-08-17T00:07:03.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91741510f0 con 0x7f91740c3bc0 2023-08-17T00:07:03.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9179679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917414f080 con 0x7f9174153a60 2023-08-17T00:07:03.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7c1c047b00 con 0x7f7c2c153f50 2023-08-17T00:07:03.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9173fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 0x7f917414bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9173fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 0x7f917414bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51334/0 (socket says 172.21.15.153:51334) 2023-08-17T00:07:03.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f9173fff700 1 -- 172.21.15.153:0/373322060 learned_addr learned my addr 172.21.15.153:0/373322060 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9178e78700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153a60 0x7f91740abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.644+0000 7f916bfff700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740c3bc0 0x7f91740abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9173fff700 1 -- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153a60 msgr2=0x7f91740abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9173fff700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153a60 0x7f91740abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9173fff700 1 -- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740c3bc0 msgr2=0x7f91740abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9173fff700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740c3bc0 0x7f91740abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9173fff700 1 -- 172.21.15.153:0/373322060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009a20 con 0x7f91740660e0 2023-08-17T00:07:03.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f9173fff700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 0x7f917414bda0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f916400c420 tx=0x7f9164007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6504010070 con 0x7f650c0c01a0 2023-08-17T00:07:03.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f65027fc700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64ec05a150 0x7f64ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6504074050 con 0x7f650c0c01a0 2023-08-17T00:07:03.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f6509d9b700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64ec05a150 0x7f64ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7f6509d9b700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64ec05a150 0x7f64ec05c610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f64f4006d80 tx=0x7f64f4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7fd731907700 1 Processor -- start 2023-08-17T00:07:03.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.648+0000 7fd731907700 1 -- start start 2023-08-17T00:07:03.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640070d0 con 0x7f91740660e0 2023-08-17T00:07:03.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9164007230 con 0x7f91740660e0 2023-08-17T00:07:03.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640075b0 con 0x7f91740660e0 2023-08-17T00:07:03.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9174150aa0 con 0x7f91740660e0 2023-08-17T00:07:03.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91741506e0 con 0x7f91740660e0 2023-08-17T00:07:03.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6504047a70 con 0x7f650c0c01a0 2023-08-17T00:07:03.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd731907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 0x7fd72c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd731907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd72c153f50 0x7fd72c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9174150900 con 0x7f91740660e0 2023-08-17T00:07:03.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd730905700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 0x7fd72c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd730905700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 0x7fd72c0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:34944/0 (socket says 172.21.15.153:34944) 2023-08-17T00:07:03.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd72bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd72c153f50 0x7fd72c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd72bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd72c153f50 0x7fd72c154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51350/0 (socket says 172.21.15.153:51350) 2023-08-17T00:07:03.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd730905700 1 -- 172.21.15.153:0/188920309 learned_addr learned my addr 172.21.15.153:0/188920309 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72c0bfd10 con 0x7fd72c157600 2023-08-17T00:07:03.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72c154860 con 0x7fd72c153f50 2023-08-17T00:07:03.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c154af0 con 0x7fd72c0c57a0 2023-08-17T00:07:03.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.652+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f916401a060 con 0x7f91740660e0 2023-08-17T00:07:03.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd730905700 1 -- 172.21.15.153:0/188920309 >> v2:172.21.15.153:3300/0 conn(0x7fd72c153f50 msgr2=0x7fd72c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:03.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd730905700 1 --2- 172.21.15.153:0/188920309 >> v2:172.21.15.153:3300/0 conn(0x7fd72c153f50 0x7fd72c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd730905700 1 -- 172.21.15.153:0/188920309 >> v1:172.21.15.178:6789/0 conn(0x7fd72c157600 legacy=0x7fd72c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd730905700 1 -- 172.21.15.153:0/188920309 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c154dd0 con 0x7fd72c0c57a0 2023-08-17T00:07:03.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd730905700 1 --2- 172.21.15.153:0/188920309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 0x7fd72c0c5b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd720006fd0 tx=0x7fd7200090f0).ready entity=mon.2 client_cookie=6ba0b847dac3d375 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7f9170ff9700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915405a1a0 0x7f915405c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9164073780 con 0x7f91740660e0 2023-08-17T00:07:03.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd72b7fe700 1 -- 172.21.15.153:0/188920309 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000b580 con 0x7fd72c0c57a0 2023-08-17T00:07:03.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd72b7fe700 1 -- 172.21.15.153:0/188920309 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000b6e0 con 0x7fd72c0c57a0 2023-08-17T00:07:03.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd72b7fe700 1 -- 172.21.15.153:0/188920309 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000ba60 con 0x7fd72c0c57a0 2023-08-17T00:07:03.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7f916bfff700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915405a1a0 0x7f915405c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7f916bfff700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915405a1a0 0x7f915405c660 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f91740aba10 tx=0x7f915c007c60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 msgr2=0x7fd72c0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 --2- 172.21.15.153:0/188920309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 0x7fd72c0c5b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fd720006fd0 tx=0x7fd7200090f0).stop 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 shutdown_connections 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 --2- 172.21.15.153:0/188920309 >> v2:172.21.15.153:3300/0 conn(0x7fd72c153f50 0x7fd72c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 --2- 172.21.15.153:0/188920309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c0c57a0 0x7fd72c0c5b80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 >> 172.21.15.153:0/188920309 conn(0x7fd72c062a70 msgr2=0x7fd72c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 shutdown_connections 2023-08-17T00:07:03.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.656+0000 7fd731907700 1 -- 172.21.15.153:0/188920309 wait complete. 2023-08-17T00:07:03.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9174150900 con 0x7f91740660e0 2023-08-17T00:07:03.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 Processor -- start 2023-08-17T00:07:03.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 -- start start 2023-08-17T00:07:03.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 0x7fd72c14f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd72c153f50 0x7fd72c0c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd730905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 0x7fd72c14f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd730905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 0x7fd72c14f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51354/0 (socket says 172.21.15.153:51354) 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c157600 0x7fd72c0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd730905700 1 -- 172.21.15.153:0/944720134 learned_addr learned my addr 172.21.15.153:0/944720134 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0ae800 con 0x7fd72c0c57a0 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0af0a0 con 0x7fd72c153f50 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.660+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72c0c1ef0 con 0x7fd72c157600 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd72bfff700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd72c153f50 0x7fd72c0c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd731106700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c157600 0x7fd72c0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd730905700 1 -- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c157600 msgr2=0x7fd72c0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd730905700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c157600 0x7fd72c0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd730905700 1 -- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd72c153f50 msgr2=0x7fd72c0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd730905700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd72c153f50 0x7fd72c0c4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd730905700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd720009370 con 0x7fd72c0c57a0 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd72bfff700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd72c153f50 0x7fd72c0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:03.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd731106700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c157600 0x7fd72c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:03.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd730905700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 0x7fd72c14f6a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fd72c154c30 tx=0x7fd720017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72000bea0 con 0x7fd72c0c57a0 2023-08-17T00:07:03.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72000b850 con 0x7fd72c0c57a0 2023-08-17T00:07:03.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72001b660 con 0x7fd72c0c57a0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72c0aea50 con 0x7fd72c0c57a0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.664+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd72c0c4a80 con 0x7fd72c0c57a0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.668+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd72c06b4c0 con 0x7fd72c0c57a0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.668+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd720021030 con 0x7fd72c0c57a0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.668+0000 7fd728ff9700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd71005a1d0 0x7fd71005c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.668+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd720075c90 con 0x7fd72c0c57a0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.668+0000 7fd72bfff700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd71005a1d0 0x7fd71005c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:03.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.672+0000 7fd72bfff700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd71005a1d0 0x7fd71005c690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fd72c0c3780 tx=0x7fd718008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:03.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.672+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7200496b0 con 0x7fd72c0c57a0 2023-08-17T00:07:03.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.868+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f7c2c06b4c0 con 0x7f7c2c153f50 2023-08-17T00:07:03.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:03.872+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7f9174150900 con 0x7f91740660e0 2023-08-17T00:07:04.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.056+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f650c06b4c0 con 0x7f650c0c01a0 2023-08-17T00:07:04.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.076+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7fd72c06a210 con 0x7fd72c0c57a0 2023-08-17T00:07:04.354 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:07:04.348+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.364+0000 7f7c20ff9700 1 -- 172.21.15.153:0/3739927927 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 5504 v50) v1 ==== 95+0+0 (secure 0 0 0) 0x7f7c1c04b120 con 0x7f7c2c153f50 2023-08-17T00:07:04.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.364+0000 7f9170ff9700 1 -- 172.21.15.153:0/373322060 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 5513 v50) v1 ==== 95+0+0 (secure 0 0 0) 0x7f9174150900 con 0x7f91740660e0 2023-08-17T00:07:04.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.364+0000 7f65027fc700 1 -- 172.21.15.153:0/204061819 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6219 v50) v1 ==== 95+0+0 (secure 0 0 0) 0x7f650404b090 con 0x7f650c0c01a0 2023-08-17T00:07:04.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.364+0000 7fd728ff9700 1 -- 172.21.15.153:0/944720134 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5507 v50) v1 ==== 95+0+0 (secure 0 0 0) 0x7fd72c06a210 con 0x7fd72c0c57a0 2023-08-17T00:07:04.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64ec05a150 msgr2=0x7f64ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64ec05a150 0x7f64ec05c610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f64f4006d80 tx=0x7f64f4008040).stop 2023-08-17T00:07:04.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 msgr2=0x7f650c0c3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 0x7f650c0c3960 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7f650400c4e0 tx=0x7f6504007c70).stop 2023-08-17T00:07:04.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7c1805a150 msgr2=0x7f7c1805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7c1805a150 0x7f7c1805c610 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f7c28009130 tx=0x7f7c28017000).stop 2023-08-17T00:07:04.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 msgr2=0x7f7c2c0adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 0x7f7c2c0adc70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f7c1c00d8c0 tx=0x7f7c1c008040).stop 2023-08-17T00:07:04.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915405a1a0 msgr2=0x7f915405c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915405a1a0 0x7f915405c660 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f91740aba10 tx=0x7f915c007c60).stop 2023-08-17T00:07:04.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 msgr2=0x7f917414bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 0x7f917414bda0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f916400c420 tx=0x7f9164007c80).stop 2023-08-17T00:07:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 shutdown_connections 2023-08-17T00:07:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915405a1a0 0x7f915405c660 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153a60 0x7f91740abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740c3bc0 0x7f91740abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 --2- 172.21.15.153:0/373322060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f91740660e0 0x7f917414bda0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 >> 172.21.15.153:0/373322060 conn(0x7f91740c5c20 msgr2=0x7f917414e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 shutdown_connections 2023-08-17T00:07:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7c1805a150 0x7f7c1805c610 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c157600 0x7f7c2c0c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c2c153f50 0x7f7c2c0adc70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 --2- 172.21.15.153:0/3739927927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c0c57a0 0x7f7c2c142200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 >> 172.21.15.153:0/3739927927 conn(0x7f7c2c062a70 msgr2=0x7f7c2c0c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:04.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd71005a1d0 msgr2=0x7fd71005c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd71005a1d0 0x7fd71005c690 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7fd72c0c3780 tx=0x7fd718008040).stop 2023-08-17T00:07:04.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 msgr2=0x7fd72c14f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 0x7fd72c14f6a0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7fd72c154c30 tx=0x7fd720017000).stop 2023-08-17T00:07:04.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 shutdown_connections 2023-08-17T00:07:04.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f64ec05a150 0x7f64ec05c610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f650c153f50 0x7f650c14a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f650c0c57a0 0x7f650c1675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 --2- 172.21.15.153:0/204061819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f650c0c01a0 0x7f650c0c3960 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 >> 172.21.15.153:0/204061819 conn(0x7f650c062a70 msgr2=0x7f650c14c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:04.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 shutdown_connections 2023-08-17T00:07:04.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 shutdown_connections 2023-08-17T00:07:04.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f9179679700 1 -- 172.21.15.153:0/373322060 wait complete. 2023-08-17T00:07:04.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd71005a1d0 0x7fd71005c690 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd72c157600 0x7fd72c0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd72c153f50 0x7fd72c0c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 --2- 172.21.15.153:0/944720134 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd72c0c57a0 0x7fd72c14f6a0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 >> 172.21.15.153:0/944720134 conn(0x7fd72c062a70 msgr2=0x7fd72c063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:04.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 shutdown_connections 2023-08-17T00:07:04.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f650b59e700 1 -- 172.21.15.153:0/204061819 wait complete. 2023-08-17T00:07:04.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 shutdown_connections 2023-08-17T00:07:04.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7f7c31f07700 1 -- 172.21.15.153:0/3739927927 wait complete. 2023-08-17T00:07:04.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 shutdown_connections 2023-08-17T00:07:04.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.368+0000 7fd731907700 1 -- 172.21.15.153:0/944720134 wait complete. 2023-08-17T00:07:04.383 INFO:teuthology.orchestra.run.smithi153.stderr:failed mds gid 6219 2023-08-17T00:07:04.383 INFO:teuthology.orchestra.run.smithi153.stderr:failed mds gid 5513 2023-08-17T00:07:04.384 INFO:teuthology.orchestra.run.smithi153.stderr:failed mds gid 5504 2023-08-17T00:07:04.384 INFO:teuthology.orchestra.run.smithi153.stderr:failed mds gid 5507 2023-08-17T00:07:04.395 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:07:04.396 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:07:04.397 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:07:04.397 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:07:04.401 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:07:04.401 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:04.402 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:07:04.402 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:07:04.403 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:07:04.403 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:07:04.404 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:07:04.405 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:04.409 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:07:04.410 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:04.449 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:07:04.449 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:04.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:04.510 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:07:04.511 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:07:04.519 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:07:04.548 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:07:04.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 Processor -- start 2023-08-17T00:07:04.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 -- start start 2023-08-17T00:07:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65dc068da0 0x7f65dc1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65dc065da0 con 0x7f65dc0689c0 2023-08-17T00:07:04.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65dc069200 con 0x7f65dc068da0 2023-08-17T00:07:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e1fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc155c60 con 0x7f65dc151530 2023-08-17T00:07:04.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e0fb7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f65dc0689c0 0x7f65dc0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:42396/0 (socket says 172.21.15.153:42396) 2023-08-17T00:07:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.584+0000 7f65e0fb7700 1 -- 172.21.15.153:0/817673032 learned_addr learned my addr 172.21.15.153:0/817673032 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d3fff700 1 --2- 172.21.15.153:0/817673032 >> v2:172.21.15.178:3300/0 conn(0x7f65dc068da0 0x7f65dc1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e17b8700 1 --2- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d37fe700 1 -- 172.21.15.153:0/817673032 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1216846143 0 0) 0x7f65dc065da0 con 0x7f65dc0689c0 2023-08-17T00:07:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d37fe700 1 -- 172.21.15.153:0/817673032 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c40033f0 con 0x7f65dc0689c0 2023-08-17T00:07:04.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d3fff700 1 -- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 msgr2=0x7f65dc1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d3fff700 1 --2- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d3fff700 1 -- 172.21.15.153:0/817673032 >> v1:172.21.15.153:6789/0 conn(0x7f65dc0689c0 legacy=0x7f65dc0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d3fff700 1 -- 172.21.15.153:0/817673032 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc065ff0 con 0x7f65dc068da0 2023-08-17T00:07:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d3fff700 1 --2- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1560f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f65cc009760 tx=0x7f65cc009060).ready entity=mon.1 client_cookie=12f52119eacc349d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d37fe700 1 -- 172.21.15.153:0/817673032 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0090d0 con 0x7f65dc068da0 2023-08-17T00:07:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d37fe700 1 -- 172.21.15.153:0/817673032 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc00d4a0 con 0x7f65dc068da0 2023-08-17T00:07:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65d37fe700 1 -- 172.21.15.153:0/817673032 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc00d820 con 0x7f65dc068da0 2023-08-17T00:07:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 -- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 msgr2=0x7f65dc1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1560f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f65cc009760 tx=0x7f65cc009060).stop 2023-08-17T00:07:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 -- 172.21.15.153:0/817673032 shutdown_connections 2023-08-17T00:07:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/817673032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1560f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 -- 172.21.15.153:0/817673032 >> 172.21.15.153:0/817673032 conn(0x7f65dc0c6620 msgr2=0x7f65dc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 -- 172.21.15.153:0/817673032 shutdown_connections 2023-08-17T00:07:04.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.588+0000 7f65e1fb9700 1 -- 172.21.15.153:0/817673032 wait complete. 2023-08-17T00:07:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 Processor -- start 2023-08-17T00:07:04.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 -- start start 2023-08-17T00:07:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 0x7f65dc1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc163e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc1539a0 con 0x7f65dc0689c0 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc153c80 con 0x7f65dc068da0 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e1fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65dc153f60 con 0x7f65dc151530 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 0x7f65dc1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 0x7f65dc1533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51406/0 (socket says 172.21.15.153:51406) 2023-08-17T00:07:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 -- 172.21.15.153:0/1085150251 learned_addr learned my addr 172.21.15.153:0/1085150251 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65d3fff700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e17b8700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc163e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 -- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 msgr2=0x7f65dc163e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc163e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 -- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 msgr2=0x7f65dc1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 -- 172.21.15.153:0/1085150251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc0092a0 con 0x7f65dc0689c0 2023-08-17T00:07:04.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65e0fb7700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 0x7f65dc1533e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f65d800c410 tx=0x7f65d8007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:04.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.592+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d80070d0 con 0x7f65dc0689c0 2023-08-17T00:07:04.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.596+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8007230 con 0x7f65dc0689c0 2023-08-17T00:07:04.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.596+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65dc154240 con 0x7f65dc0689c0 2023-08-17T00:07:04.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.596+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8005670 con 0x7f65dc0689c0 2023-08-17T00:07:04.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.596+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65dc164310 con 0x7f65dc0689c0 2023-08-17T00:07:04.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.596+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65dc06b4c0 con 0x7f65dc0689c0 2023-08-17T00:07:04.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.596+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f65d801a060 con 0x7f65dc0689c0 2023-08-17T00:07:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.600+0000 7f65d0ff9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f65c805a150 0x7f65c805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.600+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f65d8073850 con 0x7f65dc0689c0 2023-08-17T00:07:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.600+0000 7f65d3fff700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f65c805a150 0x7f65c805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.600+0000 7f65d3fff700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f65c805a150 0x7f65c805c610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f65dc0a7ab0 tx=0x7f65cc016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:04.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.604+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f65d80471a0 con 0x7f65dc0689c0 2023-08-17T00:07:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.796+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65dc064010 con 0x7f65dc0689c0 2023-08-17T00:07:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.800+0000 7f65d0ff9700 1 -- 172.21.15.153:0/1085150251 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+1455 (secure 0 0 0) 0x7f65d804a7c0 con 0x7f65dc0689c0 2023-08-17T00:07:04.804 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:04.804 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":50,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:04.354442+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f65c805a150 msgr2=0x7f65c805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f65c805a150 0x7f65c805c610 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f65dc0a7ab0 tx=0x7f65cc016000).stop 2023-08-17T00:07:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 msgr2=0x7f65dc1533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 0x7f65dc1533e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f65d800c410 tx=0x7f65d8007b00).stop 2023-08-17T00:07:04.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 shutdown_connections 2023-08-17T00:07:04.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f65c805a150 0x7f65c805c610 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65dc151530 0x7f65dc163e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65dc068da0 0x7f65dc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 --2- 172.21.15.153:0/1085150251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65dc0689c0 0x7f65dc1533e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 >> 172.21.15.153:0/1085150251 conn(0x7f65dc0c6620 msgr2=0x7f65dc061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 shutdown_connections 2023-08-17T00:07:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:04.804+0000 7f65e1fb9700 1 -- 172.21.15.153:0/1085150251 wait complete. 2023-08-17T00:07:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 50 2023-08-17T00:07:05.232 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:06:49.925811+0000', 'modified': '2023-08-17T00:07:04.354442+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 66, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {}, 'failed': [0], 'damaged': [], 'stopped': [], 'info': {}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:07:05.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 0/1 2023-08-17T00:07:06.234 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.392+0000 7f99ab6db700 1 Processor -- start 2023-08-17T00:07:06.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.392+0000 7f99ab6db700 1 -- start start 2023-08-17T00:07:06.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99ab6db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f99a4153ab0 0x7f99a4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:06.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99ab6db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f99a40c7ba0 0x7f99a40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:06.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99ab6db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a40aa750 con 0x7f99a40c8d50 2023-08-17T00:07:06.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99ab6db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a40c9dd0 con 0x7f99a4153ab0 2023-08-17T00:07:06.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99ab6db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a40aacf0 con 0x7f99a40c7ba0 2023-08-17T00:07:06.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a8c76700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f99a40c8d50 0x7f99a40c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54108/0 (socket says 172.21.15.153:54108) 2023-08-17T00:07:06.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a8c76700 1 -- 172.21.15.153:0/1060312358 learned_addr learned my addr 172.21.15.153:0/1060312358 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:06.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9c78700 1 --2- 172.21.15.153:0/1060312358 >> v2:172.21.15.178:3300/0 conn(0x7f99a40c7ba0 0x7f99a40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:06.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9477700 1 --2- 172.21.15.153:0/1060312358 >> v2:172.21.15.153:3300/0 conn(0x7f99a4153ab0 0x7f99a4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:06.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f999bfff700 1 -- 172.21.15.153:0/1060312358 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125694136 0 0) 0x7f99a40aa750 con 0x7f99a40c8d50 2023-08-17T00:07:06.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9c78700 1 -- 172.21.15.153:0/1060312358 >> v2:172.21.15.153:3300/0 conn(0x7f99a4153ab0 msgr2=0x7f99a4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:06.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9c78700 1 --2- 172.21.15.153:0/1060312358 >> v2:172.21.15.153:3300/0 conn(0x7f99a4153ab0 0x7f99a4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9c78700 1 -- 172.21.15.153:0/1060312358 >> v1:172.21.15.153:6789/0 conn(0x7f99a40c8d50 legacy=0x7f99a40c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:06.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9c78700 1 -- 172.21.15.153:0/1060312358 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a40c5ca0 con 0x7f99a40c7ba0 2023-08-17T00:07:06.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f99a9c78700 1 --2- 172.21.15.153:0/1060312358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40c7ba0 0x7f99a40c91b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f99a405ea10 tx=0x7f999c009780).ready entity=mon.1 client_cookie=d1fc963af3e705f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:06.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.396+0000 7f999bfff700 1 -- 172.21.15.153:0/1060312358 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00e070 con 0x7f99a40c7ba0 2023-08-17T00:07:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f999bfff700 1 -- 172.21.15.153:0/1060312358 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c00bb60 con 0x7f99a40c7ba0 2023-08-17T00:07:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f999bfff700 1 -- 172.21.15.153:0/1060312358 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c012410 con 0x7f99a40c7ba0 2023-08-17T00:07:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 -- 172.21.15.153:0/1060312358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40c7ba0 msgr2=0x7f99a40c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 --2- 172.21.15.153:0/1060312358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40c7ba0 0x7f99a40c91b0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f99a405ea10 tx=0x7f999c009780).stop 2023-08-17T00:07:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 -- 172.21.15.153:0/1060312358 shutdown_connections 2023-08-17T00:07:06.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 --2- 172.21.15.153:0/1060312358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a40c7ba0 0x7f99a40c91b0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 --2- 172.21.15.153:0/1060312358 >> v2:172.21.15.153:3300/0 conn(0x7f99a4153ab0 0x7f99a4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 -- 172.21.15.153:0/1060312358 >> 172.21.15.153:0/1060312358 conn(0x7f99a4061fa0 msgr2=0x7f99a40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:06.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 -- 172.21.15.153:0/1060312358 shutdown_connections 2023-08-17T00:07:06.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.400+0000 7f99ab6db700 1 -- 172.21.15.153:0/1060312358 wait complete. 2023-08-17T00:07:06.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 Processor -- start 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 -- start start 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 0x7f99a4143670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40c8d50 0x7f99a40c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a4153ab0 0x7f99a40c0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40c1470 con 0x7f99a40c7ba0 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40af870 con 0x7f99a4153ab0 2023-08-17T00:07:06.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99ab6db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a40afb50 con 0x7f99a40c8d50 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 0x7f99a4143670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 0x7f99a4143670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52930/0 (socket says 172.21.15.153:52930) 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 -- 172.21.15.153:0/677511567 learned_addr learned my addr 172.21.15.153:0/677511567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9c78700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a4153ab0 0x7f99a40c0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a8c76700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40c8d50 0x7f99a40c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 -- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40c8d50 msgr2=0x7f99a40c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:06.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40c8d50 0x7f99a40c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 -- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a4153ab0 msgr2=0x7f99a40c0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a4153ab0 0x7f99a40c0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 -- 172.21.15.153:0/677511567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c009a20 con 0x7f99a40c7ba0 2023-08-17T00:07:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.404+0000 7f99a9477700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 0x7f99a4143670 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f99a000e900 tx=0x7f99a0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.408+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0012600 con 0x7f99a40c7ba0 2023-08-17T00:07:06.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.408+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a0012760 con 0x7f99a40c7ba0 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.408+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a40afe30 con 0x7f99a40c7ba0 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.408+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0012ae0 con 0x7f99a40c7ba0 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.408+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a40b03f0 con 0x7f99a40c7ba0 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.408+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a40b09d0 con 0x7f99a40c7ba0 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.412+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f99a0022070 con 0x7f99a40c7ba0 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.412+0000 7f99997fa700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f998805a180 0x7f998805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:06.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.412+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f99a0074390 con 0x7f99a40c7ba0 2023-08-17T00:07:06.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.412+0000 7f99a8c76700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f998805a180 0x7f998805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:06.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.412+0000 7f99a8c76700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f998805a180 0x7f998805c640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f99a4155e60 tx=0x7f9994007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:06.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.420+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f99a0047ce0 con 0x7f99a40c7ba0 2023-08-17T00:07:06.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.624+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a406b530 con 0x7f99a40c7ba0 2023-08-17T00:07:06.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.624+0000 7f99997fa700 1 -- 172.21.15.153:0/677511567 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f99a004b300 con 0x7f99a40c7ba0 2023-08-17T00:07:06.631 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:06.631 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":53,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:06.375535+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6459},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6459":{"gid":6459,"name":"a","rank":0,"incarnation":52,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.153:6835/287073699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":287073699},{"type":"v1","addr":"172.21.15.153:6835","nonce":287073699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:06.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f998805a180 msgr2=0x7f998805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:06.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f998805a180 0x7f998805c640 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7f99a4155e60 tx=0x7f9994007bb0).stop 2023-08-17T00:07:06.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 msgr2=0x7f99a4143670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:06.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 0x7f99a4143670 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7f99a000e900 tx=0x7f99a0009060).stop 2023-08-17T00:07:06.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 shutdown_connections 2023-08-17T00:07:06.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f998805a180 0x7f998805c640 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99a4153ab0 0x7f99a40c0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99a40c8d50 0x7f99a40c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 --2- 172.21.15.153:0/677511567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f99a40c7ba0 0x7f99a4143670 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:06.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 >> 172.21.15.153:0/677511567 conn(0x7f99a4061fa0 msgr2=0x7f99a4151340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:06.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 shutdown_connections 2023-08-17T00:07:06.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:06.628+0000 7f99ab6db700 1 -- 172.21.15.153:0/677511567 wait complete. 2023-08-17T00:07:06.637 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 53 2023-08-17T00:07:07.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:06:49.925811+0000', 'modified': '2023-08-17T00:07:06.375535+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 66, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6459}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6459': {'gid': 6459, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.153:6835/287073699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 287073699}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 287073699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:07:07.056 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6459:up:reconnect 2023-08-17T00:07:08.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:08.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.212+0000 7fbacc6db700 1 Processor -- start 2023-08-17T00:07:08.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.212+0000 7fbacc6db700 1 -- start start 2023-08-17T00:07:08.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbacc6db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:08.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbacc6db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbac40c7ba0 0x7fbac40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:08.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbacc6db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac40aa750 con 0x7fbac40c8d50 2023-08-17T00:07:08.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbacc6db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac40c9dd0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbacc6db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40aacf0 con 0x7fbac4153ab0 2023-08-17T00:07:08.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbac9c76700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fbac40c8d50 0x7fbac40c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:53234/0 (socket says 172.21.15.153:53234) 2023-08-17T00:07:08.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbac9c76700 1 -- 172.21.15.153:0/365361084 learned_addr learned my addr 172.21.15.153:0/365361084 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:08.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbaca477700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:08.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbacac78700 1 --2- 172.21.15.153:0/365361084 >> v2:172.21.15.178:3300/0 conn(0x7fbac40c7ba0 0x7fbac40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:08.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbac9475700 1 -- 172.21.15.153:0/365361084 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636256248 0 0) 0x7fbac40aa750 con 0x7fbac40c8d50 2023-08-17T00:07:08.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.216+0000 7fbac9475700 1 -- 172.21.15.153:0/365361084 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbab00033f0 con 0x7fbac40c8d50 2023-08-17T00:07:08.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacac78700 1 -- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 msgr2=0x7fbac4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:08.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacac78700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacac78700 1 -- 172.21.15.153:0/365361084 >> v1:172.21.15.178:6789/0 conn(0x7fbac40c8d50 legacy=0x7fbac40c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:08.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacac78700 1 -- 172.21.15.153:0/365361084 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac40c5ca0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbaca477700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:08.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacac78700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c7ba0 0x7fbac40c91b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fbabc009760 tx=0x7fbabc009060).ready entity=mon.1 client_cookie=bca6dd6aeb8c90a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:08.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbac9475700 1 -- 172.21.15.153:0/365361084 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc0090d0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbac9475700 1 -- 172.21.15.153:0/365361084 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00d4a0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbac9475700 1 -- 172.21.15.153:0/365361084 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00d820 con 0x7fbac40c7ba0 2023-08-17T00:07:08.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 -- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c7ba0 msgr2=0x7fbac40c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:08.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c7ba0 0x7fbac40c91b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fbabc009760 tx=0x7fbabc009060).stop 2023-08-17T00:07:08.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 -- 172.21.15.153:0/365361084 shutdown_connections 2023-08-17T00:07:08.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c7ba0 0x7fbac40c91b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 --2- 172.21.15.153:0/365361084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 -- 172.21.15.153:0/365361084 >> 172.21.15.153:0/365361084 conn(0x7fbac4061fa0 msgr2=0x7fbac40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:08.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 -- 172.21.15.153:0/365361084 shutdown_connections 2023-08-17T00:07:08.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 -- 172.21.15.153:0/365361084 wait complete. 2023-08-17T00:07:08.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.220+0000 7fbacc6db700 1 Processor -- start 2023-08-17T00:07:08.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 -- start start 2023-08-17T00:07:08.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 0x7fbac414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c8d50 0x7fbac40c3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac40c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40af3e0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40c2ad0 con 0x7fbac40c8d50 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac40c3650 con 0x7fbac4153ab0 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 0x7fbac414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 0x7fbac414e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52940/0 (socket says 172.21.15.153:52940) 2023-08-17T00:07:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 -- 172.21.15.153:0/3802071295 learned_addr learned my addr 172.21.15.153:0/3802071295 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:08.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacac78700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac40c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbac9c76700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c8d50 0x7fbac40c3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 -- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 msgr2=0x7fbac40c3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac40c3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 -- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c8d50 msgr2=0x7fbac40c3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c8d50 0x7fbac40c3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 -- 172.21.15.153:0/3802071295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0009a20 con 0x7fbac40c7ba0 2023-08-17T00:07:08.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacac78700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac40c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:08.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaca477700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 0x7fbac414e7d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fbac000c0c0 tx=0x7fbac000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:08.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000ccb0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac000f040 con 0x7fbac40c7ba0 2023-08-17T00:07:08.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc0092a0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0013400 con 0x7fbac40c7ba0 2023-08-17T00:07:08.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.224+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac40c3000 con 0x7fbac40c7ba0 2023-08-17T00:07:08.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.228+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac40ca6f0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.228+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbac00137b0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.232+0000 7fbaba7fc700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaa805a150 0x7fbaa805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:08.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.232+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fbac0074d00 con 0x7fbac40c7ba0 2023-08-17T00:07:08.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.232+0000 7fbac9c76700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaa805a150 0x7fbaa805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:08.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.232+0000 7fbac9c76700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaa805a150 0x7fbaa805c610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fbac4159430 tx=0x7fbab4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:08.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.236+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbac40ca6f0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.432+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbac40ca6f0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.432+0000 7fbaba7fc700 1 -- 172.21.15.153:0/3802071295 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fbac40ca6f0 con 0x7fbac40c7ba0 2023-08-17T00:07:08.438 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:08.438 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:08.392134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6459},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6459":{"gid":6459,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/287073699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":287073699},{"type":"v1","addr":"172.21.15.153:6835","nonce":287073699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:08.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaa805a150 msgr2=0x7fbaa805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:08.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaa805a150 0x7fbaa805c610 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fbac4159430 tx=0x7fbab4009040).stop 2023-08-17T00:07:08.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 msgr2=0x7fbac414e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:08.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 0x7fbac414e7d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7fbac000c0c0 tx=0x7fbac000b040).stop 2023-08-17T00:07:08.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 shutdown_connections 2023-08-17T00:07:08.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaa805a150 0x7fbaa805c610 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbac4153ab0 0x7fbac40c3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbac40c8d50 0x7fbac40c3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 --2- 172.21.15.153:0/3802071295 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbac40c7ba0 0x7fbac414e7d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:08.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 >> 172.21.15.153:0/3802071295 conn(0x7fbac4061fa0 msgr2=0x7fbac4151270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:08.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 shutdown_connections 2023-08-17T00:07:08.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:08.436+0000 7fbacc6db700 1 -- 172.21.15.153:0/3802071295 wait complete. 2023-08-17T00:07:08.443 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 55 2023-08-17T00:07:08.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:06:49.925811+0000', 'modified': '2023-08-17T00:07:08.392134+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 66, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6459}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6459': {'gid': 6459, 'name': 'a', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.153:6835/287073699', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 287073699}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 287073699}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:07:08.861 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:07:08.862 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:07:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.020+0000 7f9380e39700 1 Processor -- start 2023-08-17T00:07:09.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f9380e39700 1 -- start start 2023-08-17T00:07:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f9380e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f937c0c57a0 0x7f937c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f9380e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c153f50 0x7f937c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f9380e39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937c0bfd10 con 0x7f937c157600 2023-08-17T00:07:09.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f9380e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937c154860 con 0x7f937c0c57a0 2023-08-17T00:07:09.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f9380e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c154af0 con 0x7f937c153f50 2023-08-17T00:07:09.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f937bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f937c157600 0x7f937c157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54112/0 (socket says 172.21.15.153:54112) 2023-08-17T00:07:09.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f937bfff700 1 -- 172.21.15.153:0/1204857559 learned_addr learned my addr 172.21.15.153:0/1204857559 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:09.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f937affd700 1 --2- 172.21.15.153:0/1204857559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c153f50 0x7f937c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f937b7fe700 1 --2- 172.21.15.153:0/1204857559 >> v2:172.21.15.178:3300/0 conn(0x7f937c0c57a0 0x7f937c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.024+0000 7f937a7fc700 1 -- 172.21.15.153:0/1204857559 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667281000 0 0) 0x7f937c0bfd10 con 0x7f937c157600 2023-08-17T00:07:09.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937a7fc700 1 -- 172.21.15.153:0/1204857559 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93640033f0 con 0x7f937c157600 2023-08-17T00:07:09.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937affd700 1 -- 172.21.15.153:0/1204857559 >> v2:172.21.15.178:3300/0 conn(0x7f937c0c57a0 msgr2=0x7f937c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937affd700 1 --2- 172.21.15.153:0/1204857559 >> v2:172.21.15.178:3300/0 conn(0x7f937c0c57a0 0x7f937c0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937affd700 1 -- 172.21.15.153:0/1204857559 >> v1:172.21.15.153:6789/0 conn(0x7f937c157600 legacy=0x7f937c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937affd700 1 -- 172.21.15.153:0/1204857559 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c154dd0 con 0x7f937c153f50 2023-08-17T00:07:09.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937affd700 1 --2- 172.21.15.153:0/1204857559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c153f50 0x7f937c154370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9370009760 tx=0x7f9370009060).ready entity=mon.2 client_cookie=a52f69270288a17 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937a7fc700 1 -- 172.21.15.153:0/1204857559 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000d4a0 con 0x7f937c153f50 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937a7fc700 1 -- 172.21.15.153:0/1204857559 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937000d600 con 0x7f937c153f50 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f937a7fc700 1 -- 172.21.15.153:0/1204857559 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000d980 con 0x7f937c153f50 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 -- 172.21.15.153:0/1204857559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c153f50 msgr2=0x7f937c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 --2- 172.21.15.153:0/1204857559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c153f50 0x7f937c154370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9370009760 tx=0x7f9370009060).stop 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 -- 172.21.15.153:0/1204857559 shutdown_connections 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 --2- 172.21.15.153:0/1204857559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c153f50 0x7f937c154370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 --2- 172.21.15.153:0/1204857559 >> v2:172.21.15.178:3300/0 conn(0x7f937c0c57a0 0x7f937c0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 -- 172.21.15.153:0/1204857559 >> 172.21.15.153:0/1204857559 conn(0x7f937c062a70 msgr2=0x7f937c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 -- 172.21.15.153:0/1204857559 shutdown_connections 2023-08-17T00:07:09.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.028+0000 7f9380e39700 1 -- 172.21.15.153:0/1204857559 wait complete. 2023-08-17T00:07:09.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 Processor -- start 2023-08-17T00:07:09.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 -- start start 2023-08-17T00:07:09.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 0x7f937c0c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f937c153f50 0x7f937c13ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c157600 0x7f937c0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0c2360 con 0x7f937c0c57a0 2023-08-17T00:07:09.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0c2640 con 0x7f937c153f50 2023-08-17T00:07:09.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f9380e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937c0c2920 con 0x7f937c157600 2023-08-17T00:07:09.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 0x7f937c0c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 0x7f937c0c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52956/0 (socket says 172.21.15.153:52956) 2023-08-17T00:07:09.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 -- 172.21.15.153:0/3722096883 learned_addr learned my addr 172.21.15.153:0/3722096883 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:09.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937affd700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f937c153f50 0x7f937c13ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937bfff700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c157600 0x7f937c0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 -- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c157600 msgr2=0x7f937c0c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c157600 0x7f937c0c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 -- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f937c153f50 msgr2=0x7f937c13ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f937c153f50 0x7f937c13ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.032+0000 7f937b7fe700 1 -- 172.21.15.153:0/3722096883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93700092a0 con 0x7f937c0c57a0 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.036+0000 7f937b7fe700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 0x7f937c0c9e10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f936c00e900 tx=0x7f936c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.036+0000 7f93637fe700 1 -- 172.21.15.153:0/3722096883 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c012600 con 0x7f937c0c57a0 2023-08-17T00:07:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.036+0000 7f93637fe700 1 -- 172.21.15.153:0/3722096883 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c012760 con 0x7f937c0c57a0 2023-08-17T00:07:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.036+0000 7f93637fe700 1 -- 172.21.15.153:0/3722096883 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c012ae0 con 0x7f937c0c57a0 2023-08-17T00:07:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.036+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f937c0c2c00 con 0x7f937c0c57a0 2023-08-17T00:07:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.036+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c0c2010 con 0x7f937c0c57a0 2023-08-17T00:07:09.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.040+0000 7f93637fe700 1 -- 172.21.15.153:0/3722096883 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f936c022070 con 0x7f937c0c57a0 2023-08-17T00:07:09.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.040+0000 7f93637fe700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936805a150 0x7f936805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.040+0000 7f93637fe700 1 -- 172.21.15.153:0/3722096883 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f936c074350 con 0x7f937c0c57a0 2023-08-17T00:07:09.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.040+0000 7f937affd700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936805a150 0x7f936805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.040+0000 7f937affd700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936805a150 0x7f936805c610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f937c0639b0 tx=0x7f9370016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.040+0000 7f938c423740 1 Processor -- start 2023-08-17T00:07:09.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 -- start start 2023-08-17T00:07:09.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x15e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x159dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x159e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15095c0 con 0x15c46f0 2023-08-17T00:07:09.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x151ee90 con 0x1599f80 2023-08-17T00:07:09.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14e5220 con 0x159b380 2023-08-17T00:07:09.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x15e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x15e1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52970/0 (socket says 172.21.15.153:52970) 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 -- 172.21.15.153:0/374906901 learned_addr learned my addr 172.21.15.153:0/374906901 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937bfff700 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x159e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937affd700 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x159dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 -- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 msgr2=0x159e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x159e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 -- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 msgr2=0x159dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x159dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 -- 172.21.15.153:0/374906901 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x152a500 con 0x15c46f0 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937affd700 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x159dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f937b7fe700 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x15e1a10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f936c04b7b0 tx=0x7f936c011000).ready entity=mon.0 client_cookie=f5314cbe1a893690 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f9360ff9700 1 -- 172.21.15.153:0/374906901 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c074110 con 0x15c46f0 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f9360ff9700 1 -- 172.21.15.153:0/374906901 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936c04b900 con 0x15c46f0 2023-08-17T00:07:09.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.044+0000 7f9360ff9700 1 -- 172.21.15.153:0/374906901 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c072470 con 0x15c46f0 2023-08-17T00:07:09.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- 172.21.15.153:0/374906901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 msgr2=0x15e1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x15e1a10 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f936c04b7b0 tx=0x7f936c011000).stop 2023-08-17T00:07:09.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- 172.21.15.153:0/374906901 shutdown_connections 2023-08-17T00:07:09.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x159e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x159dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- 172.21.15.153:0/374906901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x15e1a10 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- 172.21.15.153:0/374906901 >> 172.21.15.153:0/374906901 conn(0x137d550 msgr2=0x159ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- 172.21.15.153:0/374906901 shutdown_connections 2023-08-17T00:07:09.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- 172.21.15.153:0/374906901 wait complete. 2023-08-17T00:07:09.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- start start 2023-08-17T00:07:09.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 Processor -- start 2023-08-17T00:07:09.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x159c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x14ea110 con 0x159b380 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15c6820 con 0x1599f80 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15ddc80 con 0x15c46f0 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f938c423740 10 client.0 ll_register_callbacks cb 0x15563c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:09.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.048+0000 7f937affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52986/0 (socket says 172.21.15.153:52986) 2023-08-17T00:07:09.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 -- 172.21.15.153:0/14073624 learned_addr learned my addr 172.21.15.153:0/14073624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:09.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937b7fe700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937bfff700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x159c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 -- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 msgr2=0x159c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x159c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 -- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 msgr2=0x15c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 -- 172.21.15.153:0/14073624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f937c0c2010 con 0x159b380 2023-08-17T00:07:09.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937affd700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15cb000 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f9370009d50 tx=0x7f9370020070).ready entity=mon.0 client_cookie=a587e06ee122226c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 1 -- 172.21.15.153:0/14073624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937001ee30 con 0x159b380 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1514c60 con 0x159b380 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 1 -- 172.21.15.153:0/14073624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f9370029410 con 0x159b380 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 1 -- 172.21.15.153:0/14073624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93700295d0 con 0x159b380 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 10 client.6489 fetch_fsmap learned FSMap version 55 2023-08-17T00:07:09.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x1517f80 con 0x159b380 2023-08-17T00:07:09.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 1 -- 172.21.15.153:0/14073624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1514c60 con 0x159b380 2023-08-17T00:07:09.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 1 -- 172.21.15.153:0/14073624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9370029730 con 0x159b380 2023-08-17T00:07:09.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 10 client.6489 fetch_fsmap finished waiting for FSMap version 55 2023-08-17T00:07:09.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 10 client.6489 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 20 client.6489 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x15dcfe0 0x15c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 4 client.6489 mds_command: new command op to 6459 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 --> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x150b1b0 con 0x15dcfe0 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937b7fe700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x15dcfe0 0x15c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f9359ffb700 10 client.6489 ms_handle_connect on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:09.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.052+0000 7f937b7fe700 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x15dcfe0 0x15c54e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ae275de87c71de89 server_cookie=17f7f0394d99375c in_seq=0 out_seq=0 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f9359ffb700 1 -- 172.21.15.153:0/14073624 <== mds.0 v2:172.21.15.153:6834/287073699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x150b1b0 con 0x15dcfe0 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f9359ffb700 10 client.6489 handle_command_reply: tid=0 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 client.6489 shutdown 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 msgr2=0x15cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15cb000 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f9370009d50 tx=0x7f9370020070).stop 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 shutdown_connections 2023-08-17T00:07:09.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x15dcfe0 0x15c54e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x159c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15cb000 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f9359ffb700 0 client.6489 ms_handle_reset on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 --2- 172.21.15.153:0/14073624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 >> 172.21.15.153:0/14073624 conn(0x137d550 msgr2=0x159ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 shutdown_connections 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 1 -- 172.21.15.153:0/14073624 wait complete. 2023-08-17T00:07:09.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.056+0000 7f938c423740 20 client.6489 trim_cache size 0 max 16384 2023-08-17T00:07:09.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 Processor -- start 2023-08-17T00:07:09.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 -- start start 2023-08-17T00:07:09.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15dfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x15e0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1561db0 con 0x159b380 2023-08-17T00:07:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15e0750 con 0x1599f80 2023-08-17T00:07:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x14e89c0 con 0x15c46f0 2023-08-17T00:07:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15dfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15dfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52988/0 (socket says 172.21.15.153:52988) 2023-08-17T00:07:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 -- 172.21.15.153:0/2950862796 learned_addr learned my addr 172.21.15.153:0/2950862796 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937b7fe700 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937bfff700 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x15e0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 -- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 msgr2=0x15e0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x15e0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 -- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 msgr2=0x15ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 -- 172.21.15.153:0/2950862796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937c0c9620 con 0x159b380 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937bfff700 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x15e0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f937affd700 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15dfd70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f9370009760 tx=0x7f937002b070).ready entity=mon.0 client_cookie=e12915601bd406d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f93617fa700 1 -- 172.21.15.153:0/2950862796 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937000db50 con 0x159b380 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f93617fa700 1 -- 172.21.15.153:0/2950862796 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937002d070 con 0x159b380 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.076+0000 7f93617fa700 1 -- 172.21.15.153:0/2950862796 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9370029410 con 0x159b380 2023-08-17T00:07:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- 172.21.15.153:0/2950862796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 msgr2=0x15dfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15dfd70 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 rx=0x7f9370009760 tx=0x7f937002b070).stop 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- 172.21.15.153:0/2950862796 shutdown_connections 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15c46f0 0x15e0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x159b380 0x15dfd70 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- 172.21.15.153:0/2950862796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x15ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- 172.21.15.153:0/2950862796 >> 172.21.15.153:0/2950862796 conn(0x137d550 msgr2=0x15caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- 172.21.15.153:0/2950862796 shutdown_connections 2023-08-17T00:07:09.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- 172.21.15.153:0/2950862796 wait complete. 2023-08-17T00:07:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- start start 2023-08-17T00:07:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 Processor -- start 2023-08-17T00:07:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x164ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x15c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x16097c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x159ee90 con 0x15c46f0 2023-08-17T00:07:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x160a5a0 con 0x1599f80 2023-08-17T00:07:09.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15e2b40 con 0x159b380 2023-08-17T00:07:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f938c423740 10 client.0 ll_register_callbacks cb 0x7f937000d4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f937bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x16097c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f937bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x16097c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:52994/0 (socket says 172.21.15.153:52994) 2023-08-17T00:07:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f937bfff700 1 -- 172.21.15.153:0/887464941 learned_addr learned my addr 172.21.15.153:0/887464941 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f937b7fe700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x164ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.080+0000 7f937affd700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x15c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937b7fe700 1 -- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 msgr2=0x15c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937b7fe700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x15c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937b7fe700 1 -- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 msgr2=0x16097c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937b7fe700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x16097c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937b7fe700 1 -- 172.21.15.153:0/887464941 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1517f80 con 0x1599f80 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937b7fe700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x164ed40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f936c04f000 tx=0x7f936c057040).ready entity=mon.1 client_cookie=db25144252195400 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:07:09.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 1 -- 172.21.15.153:0/887464941 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936c05a040 con 0x1599f80 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x159cdb0 con 0x1599f80 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 1 -- 172.21.15.153:0/887464941 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f936c012c40 con 0x1599f80 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 1 -- 172.21.15.153:0/887464941 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f936c012e00 con 0x1599f80 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 10 client.6238 fetch_fsmap learned FSMap version 55 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x1513420 con 0x1599f80 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 1 -- 172.21.15.153:0/887464941 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x159cdb0 con 0x1599f80 2023-08-17T00:07:09.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 1 -- 172.21.15.153:0/887464941 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f936c04ae50 con 0x1599f80 2023-08-17T00:07:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 10 client.6238 fetch_fsmap finished waiting for FSMap version 55 2023-08-17T00:07:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 10 client.6238 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:07:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 20 client.6238 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1609e40 0x1602aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 4 client.6238 mds_command: new command op to 6459 tid=0[{"prefix": "status"}] 2023-08-17T00:07:09.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 --> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f936c04b900 con 0x1609e40 2023-08-17T00:07:09.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937affd700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1609e40 0x1602aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f937affd700 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1609e40 0x1602aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bbe3bddad9fec039 server_cookie=f223f2256350f9da in_seq=0 out_seq=0 2023-08-17T00:07:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 10 client.6238 ms_handle_connect on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 1 -- 172.21.15.153:0/887464941 <== mds.0 v2:172.21.15.153:6834/287073699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7f936c04b900 con 0x1609e40 2023-08-17T00:07:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 10 client.6238 handle_command_reply: tid=0 2023-08-17T00:07:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 client.6238 shutdown 2023-08-17T00:07:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 msgr2=0x164ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x164ed40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f936c04f000 tx=0x7f936c057040).stop 2023-08-17T00:07:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 shutdown_connections 2023-08-17T00:07:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1609e40 0x1602aa0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15c46f0 0x16097c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x159b380 0x15c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f938c423740 1 --2- 172.21.15.153:0/887464941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1599f80 0x164ed40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.084+0000 7f9359ffb700 0 client.6238 ms_handle_reset on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:09.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 >> 172.21.15.153:0/887464941 conn(0x137d550 msgr2=0x15cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 shutdown_connections 2023-08-17T00:07:09.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f938c423740 1 -- 172.21.15.153:0/887464941 wait complete. 2023-08-17T00:07:09.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f938c423740 20 client.6238 trim_cache size 0 max 16384 2023-08-17T00:07:09.099 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:07:09.099 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:07:09.099 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:07:09.099 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6459, 2023-08-17T00:07:09.099 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:07:09.099 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 3.7091020160000001, 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 55, 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 67, 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 67, 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 4.5368727780000002 2023-08-17T00:07:09.100 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:07:09.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936805a150 msgr2=0x7f936805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936805a150 0x7f936805c610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f937c0639b0 tx=0x7f9370016000).stop 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 msgr2=0x7f937c0c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 0x7f937c0c9e10 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f936c00e900 tx=0x7f936c009060).stop 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 shutdown_connections 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936805a150 0x7f936805c610 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f937c157600 0x7f937c0c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f937c153f50 0x7f937c13ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 --2- 172.21.15.153:0/3722096883 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f937c0c57a0 0x7f937c0c9e10 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 >> 172.21.15.153:0/3722096883 conn(0x7f937c062a70 msgr2=0x7f937c153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 shutdown_connections 2023-08-17T00:07:09.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.088+0000 7f9380e39700 1 -- 172.21.15.153:0/3722096883 wait complete. 2023-08-17T00:07:09.112 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:07:09.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 Processor -- start 2023-08-17T00:07:09.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 -- start start 2023-08-17T00:07:09.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40c0153ac0 0x7f40c00bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c00a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c00a38e0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c00c4fb0 con 0x7f40c0153ac0 2023-08-17T00:07:09.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40c5d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00c5290 con 0x7f40c0062610 2023-08-17T00:07:09.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40bffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f40c00bbaf0 0x7f40c0061f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:54126/0 (socket says 172.21.15.153:54126) 2023-08-17T00:07:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.244+0000 7f40bffff700 1 -- 172.21.15.153:0/768211787 learned_addr learned my addr 172.21.15.153:0/768211787 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5546700 1 --2- 172.21.15.153:0/768211787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c00a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c4d45700 1 --2- 172.21.15.153:0/768211787 >> v2:172.21.15.153:3300/0 conn(0x7f40c0153ac0 0x7f40c00bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40bf7fe700 1 -- 172.21.15.153:0/768211787 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907401330 0 0) 0x7f40c00a38e0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40bf7fe700 1 -- 172.21.15.153:0/768211787 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b00033f0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5546700 1 -- 172.21.15.153:0/768211787 >> v2:172.21.15.153:3300/0 conn(0x7f40c0153ac0 msgr2=0x7f40c00bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:09.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5546700 1 --2- 172.21.15.153:0/768211787 >> v2:172.21.15.153:3300/0 conn(0x7f40c0153ac0 0x7f40c00bb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5546700 1 -- 172.21.15.153:0/768211787 >> v1:172.21.15.153:6789/0 conn(0x7f40c00bbaf0 legacy=0x7f40c0061f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5546700 1 -- 172.21.15.153:0/768211787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00c5570 con 0x7f40c0062610 2023-08-17T00:07:09.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c4d45700 1 --2- 172.21.15.153:0/768211787 >> v2:172.21.15.153:3300/0 conn(0x7f40c0153ac0 0x7f40c00bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:09.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5546700 1 --2- 172.21.15.153:0/768211787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c00a3d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f40b8009e60 tx=0x7f40b8009780).ready entity=mon.2 client_cookie=b88270f395840b56 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40bf7fe700 1 -- 172.21.15.153:0/768211787 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800e070 con 0x7f40c0062610 2023-08-17T00:07:09.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40bf7fe700 1 -- 172.21.15.153:0/768211787 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800bb60 con 0x7f40c0062610 2023-08-17T00:07:09.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40bf7fe700 1 -- 172.21.15.153:0/768211787 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8012410 con 0x7f40c0062610 2023-08-17T00:07:09.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 -- 172.21.15.153:0/768211787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 msgr2=0x7f40c00a3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 --2- 172.21.15.153:0/768211787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c00a3d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f40b8009e60 tx=0x7f40b8009780).stop 2023-08-17T00:07:09.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 -- 172.21.15.153:0/768211787 shutdown_connections 2023-08-17T00:07:09.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 --2- 172.21.15.153:0/768211787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c00a3d70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 --2- 172.21.15.153:0/768211787 >> v2:172.21.15.153:3300/0 conn(0x7f40c0153ac0 0x7f40c00bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 -- 172.21.15.153:0/768211787 >> 172.21.15.153:0/768211787 conn(0x7f40c005dca0 msgr2=0x7f40c005e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 -- 172.21.15.153:0/768211787 shutdown_connections 2023-08-17T00:07:09.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.248+0000 7f40c5d47700 1 -- 172.21.15.153:0/768211787 wait complete. 2023-08-17T00:07:09.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.252+0000 7f40c5d47700 1 Processor -- start 2023-08-17T00:07:09.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.252+0000 7f40c5d47700 1 -- start start 2023-08-17T00:07:09.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.252+0000 7f40c5d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.252+0000 7f40c5d47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 0x7f40c00bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.252+0000 7f40c5d47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c0153ac0 0x7f40c00c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5d47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00be170 con 0x7f40c00bbaf0 2023-08-17T00:07:09.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5d47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00be450 con 0x7f40c0153ac0 2023-08-17T00:07:09.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c00be730 con 0x7f40c0062610 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 0x7f40c00bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 0x7f40c00bd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53008/0 (socket says 172.21.15.153:53008) 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 -- 172.21.15.153:0/588633903 learned_addr learned my addr 172.21.15.153:0/588633903 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c4d45700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5546700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c0153ac0 0x7f40c00c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 -- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 msgr2=0x7f40c014c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c014c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 -- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c0153ac0 msgr2=0x7f40c00c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c0153ac0 0x7f40c00c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 -- 172.21.15.153:0/588633903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b8009a20 con 0x7f40c00bbaf0 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bffff700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 0x7f40c00bd720 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f40ac00c590 tx=0x7f40ac007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0072e0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac007440 con 0x7f40c00bbaf0 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c00bea10 con 0x7f40c00bbaf0 2023-08-17T00:07:09.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac0057a0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c00a8fe0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.256+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c0159790 con 0x7f40c00bbaf0 2023-08-17T00:07:09.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.260+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f40ac01a060 con 0x7f40c00bbaf0 2023-08-17T00:07:09.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.260+0000 7f40bcff9700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a405a150 0x7f40a405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:09.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.260+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f40ac0735e0 con 0x7f40c00bbaf0 2023-08-17T00:07:09.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.260+0000 7f40c4d45700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a405a150 0x7f40a405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:09.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.264+0000 7f40c4d45700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a405a150 0x7f40a405c610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f40b4006fd0 tx=0x7f40b4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:09.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.268+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40c0159790 con 0x7f40c00bbaf0 2023-08-17T00:07:09.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40c0159790 con 0x7f40c00bbaf0 2023-08-17T00:07:09.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40bcff9700 1 -- 172.21.15.153:0/588633903 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f40c0159790 con 0x7f40c00bbaf0 2023-08-17T00:07:09.468 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:07:09.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a405a150 msgr2=0x7f40a405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a405a150 0x7f40a405c610 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f40b4006fd0 tx=0x7f40b4008040).stop 2023-08-17T00:07:09.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 msgr2=0x7f40c00bd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:09.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 0x7f40c00bd720 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f40ac00c590 tx=0x7f40ac007c80).stop 2023-08-17T00:07:09.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 shutdown_connections 2023-08-17T00:07:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a405a150 0x7f40a405c610 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c0153ac0 0x7f40c00c2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c00bbaf0 0x7f40c00bd720 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 --2- 172.21.15.153:0/588633903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c0062610 0x7f40c014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.464+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 >> 172.21.15.153:0/588633903 conn(0x7f40c005dca0 msgr2=0x7f40c00a3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:09.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.468+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 shutdown_connections 2023-08-17T00:07:09.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:09.468+0000 7f40c5d47700 1 -- 172.21.15.153:0/588633903 wait complete. 2023-08-17T00:07:09.489 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:07:09.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:07:09.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:07:09.490 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:07:09.490 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:09.490 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:07:09.490 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:07:09.491 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:07:09.491 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:07:09.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.492 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:07:09.510 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:07:09.510 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:07:09.510 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:07:09.510 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.510 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:09.511 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42184sec preferred_lft 42184sec 2023-08-17T00:07:09.512 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:07:09.513 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:07:09.514 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:07:09.515 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.515 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:07:09.515 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:07:09.515 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:07:09.515 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:09.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.517 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:07:09.592 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:07:09.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.595 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:07:09.657 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:07:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:07:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:07:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:07:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:07:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:07:09.658 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:07:09.659 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:07:09.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.659 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:07:09.660 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:07:09.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:07:09.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:07:09.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:07:09.661 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:07:09.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.794 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:07:09.812 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:07:09.812 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:07:09.812 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:07:09.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.813 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:07:09.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:09.892 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:09.952 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:07:09.952 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:10.068 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:10.068 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:07:10.088 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:10.089 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:07:10.094 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:07:10.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:10.095 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:10.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:10.125 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2023-08-17T00:07:10.188 INFO:teuthology.orchestra.run.smithi153.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2023-08-17T00:07:10.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:07:10.190 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2023-08-17T00:07:10.190 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /scrub_repair_path repair 2023-08-17T00:07:10.383 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:07:10.380+0000 7f84f61a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:07:10.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 Processor -- start 2023-08-17T00:07:10.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 -- start start 2023-08-17T00:07:10.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0eac0a9cd0 0x7f0eac153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0eac1543b0 0x7f0eac0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0bfc80 con 0x7f0eac0c5c40 2023-08-17T00:07:10.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0c6be0 con 0x7f0eac1543b0 2023-08-17T00:07:10.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eb0a79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eac0c60d0 con 0x7f0eac0a9cd0 2023-08-17T00:07:10.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eaaffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0eac1543b0 0x7f0eac0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eaaffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0eac1543b0 0x7f0eac0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53016/0 (socket says 172.21.15.153:53016) 2023-08-17T00:07:10.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3445619429 learned_addr learned my addr 172.21.15.153:0/3445619429 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:10.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/3445619429 >> v2:172.21.15.178:3300/0 conn(0x7f0eac0a9cd0 0x7f0eac153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3445619429 >> v2:172.21.15.178:3300/0 conn(0x7f0eac0a9cd0 msgr2=0x7f0eac153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/3445619429 >> v2:172.21.15.178:3300/0 conn(0x7f0eac0a9cd0 0x7f0eac153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.400+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3445619429 >> v1:172.21.15.178:6789/0 conn(0x7f0eac0c5c40 legacy=0x7f0eac1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3445619429 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0aa0b0 con 0x7f0eac1543b0 2023-08-17T00:07:10.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/3445619429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0c5750 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f0eac046c80 tx=0x7f0ea00090f0).ready entity=mon.0 client_cookie=15906faca4e5e522 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eaa7fc700 1 -- 172.21.15.153:0/3445619429 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000b600 con 0x7f0eac1543b0 2023-08-17T00:07:10.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eaa7fc700 1 -- 172.21.15.153:0/3445619429 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000b760 con 0x7f0eac1543b0 2023-08-17T00:07:10.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eaa7fc700 1 -- 172.21.15.153:0/3445619429 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000bae0 con 0x7f0eac1543b0 2023-08-17T00:07:10.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 -- 172.21.15.153:0/3445619429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 msgr2=0x7f0eac0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/3445619429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0c5750 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 rx=0x7f0eac046c80 tx=0x7f0ea00090f0).stop 2023-08-17T00:07:10.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 -- 172.21.15.153:0/3445619429 shutdown_connections 2023-08-17T00:07:10.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/3445619429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0c5750 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/3445619429 >> v2:172.21.15.178:3300/0 conn(0x7f0eac0a9cd0 0x7f0eac153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 -- 172.21.15.153:0/3445619429 >> 172.21.15.153:0/3445619429 conn(0x7f0eac062a70 msgr2=0x7f0eac0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:10.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 -- 172.21.15.153:0/3445619429 shutdown_connections 2023-08-17T00:07:10.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.404+0000 7f0eb0a79700 1 -- 172.21.15.153:0/3445619429 wait complete. 2023-08-17T00:07:10.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 Processor -- start 2023-08-17T00:07:10.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 -- start start 2023-08-17T00:07:10.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eac0a9cd0 0x7f0eac1492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eac0c5c40 0x7f0eac0aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c1df0 con 0x7f0eac1543b0 2023-08-17T00:07:10.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0ae1a0 con 0x7f0eac0c5c40 2023-08-17T00:07:10.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0ae480 con 0x7f0eac0a9cd0 2023-08-17T00:07:10.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eab7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eac0a9cd0 0x7f0eac1492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53030/0 (socket says 172.21.15.153:53030) 2023-08-17T00:07:10.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 -- 172.21.15.153:0/1168650832 learned_addr learned my addr 172.21.15.153:0/1168650832 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:10.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eac0c5c40 0x7f0eac0aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 -- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eac0a9cd0 msgr2=0x7f0eac1492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eac0a9cd0 0x7f0eac1492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 -- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eac0c5c40 msgr2=0x7f0eac0aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eac0c5c40 0x7f0eac0aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 -- 172.21.15.153:0/1168650832 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009370 con 0x7f0eac1543b0 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eabfff700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0ad7c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f0ea400c7c0 tx=0x7f0ea4001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0e937fe700 1 -- 172.21.15.153:0/1168650832 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea400e4a0 con 0x7f0eac1543b0 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0e937fe700 1 -- 172.21.15.153:0/1168650832 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea400e600 con 0x7f0eac1543b0 2023-08-17T00:07:10.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac0c2090 con 0x7f0eac1543b0 2023-08-17T00:07:10.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0e937fe700 1 -- 172.21.15.153:0/1168650832 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea400e980 con 0x7f0eac1543b0 2023-08-17T00:07:10.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.408+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0c46e0 con 0x7f0eac1543b0 2023-08-17T00:07:10.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.412+0000 7f0e937fe700 1 -- 172.21.15.153:0/1168650832 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0ea4010070 con 0x7f0eac1543b0 2023-08-17T00:07:10.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.416+0000 7f0e937fe700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e9805a120 0x7f0e9805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.416+0000 7f0e937fe700 1 -- 172.21.15.153:0/1168650832 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0ea4073910 con 0x7f0eac1543b0 2023-08-17T00:07:10.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.416+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e9805a120 0x7f0e9805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.416+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e9805a120 0x7f0e9805c5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0e9c00bb10 tx=0x7f0e9c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.416+0000 7f0ebc065740 1 Processor -- start 2023-08-17T00:07:10.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.416+0000 7f0ebc065740 1 -- start start 2023-08-17T00:07:10.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15dbb70 0x15dbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x162eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1608ce0 0x162f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x152f2d0 con 0x15dd070 2023-08-17T00:07:10.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15dc840 con 0x1608ce0 2023-08-17T00:07:10.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1626950 con 0x15dbb70 2023-08-17T00:07:10.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x162eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x162eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53038/0 (socket says 172.21.15.153:53038) 2023-08-17T00:07:10.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3580528622 learned_addr learned my addr 172.21.15.153:0/3580528622 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:10.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15dbb70 0x15dbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eabfff700 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1608ce0 0x162f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15dbb70 msgr2=0x15dbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15dbb70 0x15dbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1608ce0 msgr2=0x162f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1608ce0 0x162f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 -- 172.21.15.153:0/3580528622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x155d140 con 0x15dd070 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x162eb70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0eac083770 tx=0x7f0ea0017000).ready entity=mon.0 client_cookie=e341fffc7719039 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0e90ff9700 1 -- 172.21.15.153:0/3580528622 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0000bc0 con 0x15dd070 2023-08-17T00:07:10.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0e90ff9700 1 -- 172.21.15.153:0/3580528622 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000b8d0 con 0x15dd070 2023-08-17T00:07:10.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0e90ff9700 1 -- 172.21.15.153:0/3580528622 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0000d20 con 0x15dd070 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 -- 172.21.15.153:0/3580528622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 msgr2=0x162eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.420+0000 7f0ebc065740 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x162eb70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f0eac083770 tx=0x7f0ea0017000).stop 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- 172.21.15.153:0/3580528622 shutdown_connections 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1608ce0 0x162f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x162eb70 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 --2- 172.21.15.153:0/3580528622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x15dbb70 0x15dbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- 172.21.15.153:0/3580528622 >> 172.21.15.153:0/3580528622 conn(0x13c2870 msgr2=0x15e1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:10.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- 172.21.15.153:0/3580528622 shutdown_connections 2023-08-17T00:07:10.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- 172.21.15.153:0/3580528622 wait complete. 2023-08-17T00:07:10.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- start start 2023-08-17T00:07:10.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 Processor -- start 2023-08-17T00:07:10.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dbb70 0x1627770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x1609ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x1607bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x162cb10 con 0x15dd070 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1627c60 con 0x15dbb70 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x160af50 con 0x1608ce0 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0ebc065740 10 client.0 ll_register_callbacks cb 0x1525c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x1609ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x1609ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:53048/0 (socket says 172.21.15.153:53048) 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0eaaffd700 1 -- 172.21.15.153:0/2072672158 learned_addr learned my addr 172.21.15.153:0/2072672158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dbb70 0x1627770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.424+0000 7f0eabfff700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x1607bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eaaffd700 1 -- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 msgr2=0x1607bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x1607bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eaaffd700 1 -- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dbb70 msgr2=0x1627770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dbb70 0x1627770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eaaffd700 1 -- 172.21.15.153:0/2072672158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0aa0b0 con 0x15dd070 2023-08-17T00:07:10.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x1609ba0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f0ea0009fd0 tx=0x7f0ea001e040).ready entity=mon.0 client_cookie=1eeb4dc358d1f3a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:07:10.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 1 -- 172.21.15.153:0/2072672158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea002a070 con 0x15dd070 2023-08-17T00:07:10.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1559e20 con 0x15dd070 2023-08-17T00:07:10.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 1 -- 172.21.15.153:0/2072672158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0ea00090f0 con 0x15dd070 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 1 -- 172.21.15.153:0/2072672158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea000ba40 con 0x15dd070 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 10 client.6516 fetch_fsmap learned FSMap version 55 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x15585e0 con 0x15dd070 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 1 -- 172.21.15.153:0/2072672158 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1559e20 con 0x15dd070 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 1 -- 172.21.15.153:0/2072672158 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0ea00098e0 con 0x15dd070 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 10 client.6516 fetch_fsmap finished waiting for FSMap version 55 2023-08-17T00:07:10.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 10 client.6516 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 20 client.6516 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x160a090 0x162bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 4 client.6516 mds_command: new command op to 6459 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 --> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1550370 con 0x160a090 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x160a090 0x162bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x160a090 0x162bb50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a7b2351baab325a7 server_cookie=39bc743f9ff71906 in_seq=0 out_seq=0 2023-08-17T00:07:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.428+0000 7f0e89ffb700 10 client.6516 ms_handle_connect on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:10.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0e89ffb700 1 -- 172.21.15.153:0/2072672158 <== mds.0 v2:172.21.15.153:6834/287073699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1550370 con 0x160a090 2023-08-17T00:07:10.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0e89ffb700 10 client.6516 handle_command_reply: tid=0 2023-08-17T00:07:10.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 client.6516 shutdown 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 msgr2=0x1609ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x1609ba0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f0ea0009fd0 tx=0x7f0ea001e040).stop 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 shutdown_connections 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x160a090 0x162bb50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x1607bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dd070 0x1609ba0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 --2- 172.21.15.153:0/2072672158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dbb70 0x1627770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 >> 172.21.15.153:0/2072672158 conn(0x13c2870 msgr2=0x15e0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:10.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0e89ffb700 0 client.6516 ms_handle_reset on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:10.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 shutdown_connections 2023-08-17T00:07:10.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 1 -- 172.21.15.153:0/2072672158 wait complete. 2023-08-17T00:07:10.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.432+0000 7f0ebc065740 20 client.6516 trim_cache size 0 max 16384 2023-08-17T00:07:10.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.448+0000 7f0ebc065740 1 Processor -- start 2023-08-17T00:07:10.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.448+0000 7f0ebc065740 1 -- start start 2023-08-17T00:07:10.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x16258d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x1625dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x14db1c0 con 0x15dbb70 2023-08-17T00:07:10.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15e27c0 con 0x15dd070 2023-08-17T00:07:10.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15d8600 con 0x1608ce0 2023-08-17T00:07:10.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x16258d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x1625dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x1625dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:33804/0 (socket says 172.21.15.153:33804) 2023-08-17T00:07:10.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 -- 172.21.15.153:0/753995991 learned_addr learned my addr 172.21.15.153:0/753995991 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eabfff700 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 -- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 msgr2=0x15e0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 -- 172.21.15.153:0/753995991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 msgr2=0x16258d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x16258d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 -- 172.21.15.153:0/753995991 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1627ad0 con 0x15dd070 2023-08-17T00:07:10.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x1625dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f0ea000b730 tx=0x7f0ea002a000).ready entity=mon.1 client_cookie=6418634f69dfd0c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0e917fa700 1 -- 172.21.15.153:0/753995991 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea001b620 con 0x15dd070 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0e917fa700 1 -- 172.21.15.153:0/753995991 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea001f070 con 0x15dd070 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0e917fa700 1 -- 172.21.15.153:0/753995991 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea00098e0 con 0x15dd070 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 msgr2=0x1625dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x1625dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f0ea000b730 tx=0x7f0ea002a000).stop 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- 172.21.15.153:0/753995991 shutdown_connections 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x1625dc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 --2- 172.21.15.153:0/753995991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x16258d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- 172.21.15.153:0/753995991 >> 172.21.15.153:0/753995991 conn(0x13c2870 msgr2=0x162c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:10.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- 172.21.15.153:0/753995991 shutdown_connections 2023-08-17T00:07:10.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.452+0000 7f0ebc065740 1 -- 172.21.15.153:0/753995991 wait complete. 2023-08-17T00:07:10.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 -- start start 2023-08-17T00:07:10.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 Processor -- start 2023-08-17T00:07:10.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x1628f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x15e0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15e1490 con 0x15dbb70 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16296f0 con 0x15dd070 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15dc440 con 0x1608ce0 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0ebc065740 10 client.0 ll_register_callbacks cb 0x7f0ea001bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x15e0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eab7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x1628f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x15e0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:33808/0 (socket says 172.21.15.153:33808) 2023-08-17T00:07:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 -- 172.21.15.153:0/1960374420 learned_addr learned my addr 172.21.15.153:0/1960374420 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:10.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eabfff700 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 -- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 msgr2=0x15e0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 -- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 msgr2=0x1628f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:10.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x1628f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 -- 172.21.15.153:0/1960374420 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x15585e0 con 0x15dd070 2023-08-17T00:07:10.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0eaaffd700 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x15e0ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f0ea00095f0 tx=0x7f0ea0036000).ready entity=mon.1 client_cookie=8b74b09c061d3baf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:10.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.456+0000 7f0e89ffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:07:10.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 1 -- 172.21.15.153:0/1960374420 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea002a040 con 0x15dd070 2023-08-17T00:07:10.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 1 -- 172.21.15.153:0/1960374420 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0ea001b620 con 0x15dd070 2023-08-17T00:07:10.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ea000b8d0 con 0x15dd070 2023-08-17T00:07:10.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 1 -- 172.21.15.153:0/1960374420 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea000bb10 con 0x15dd070 2023-08-17T00:07:10.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 10 client.6259 fetch_fsmap learned FSMap version 55 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x7f0eac155810 con 0x15dd070 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 1 -- 172.21.15.153:0/1960374420 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea000b8d0 con 0x15dd070 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 1 -- 172.21.15.153:0/1960374420 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 55) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0ea00098e0 con 0x15dd070 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 10 client.6259 fetch_fsmap finished waiting for FSMap version 55 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 10 client.6259 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 20 client.6259 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1691190 0x1696fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 4 client.6259 mds_command: new command op to 6459 tid=0[{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 --> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) v1 -- 0x1419800 con 0x1691190 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1691190 0x1696fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 10 client.6259 ms_handle_connect on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0eab7fe700 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1691190 0x1696fa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=39df1194e07b12bb server_cookie=74f167abd5d6bbeb in_seq=0 out_seq=0 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 1 -- 172.21.15.153:0/1960374420 <== mds.0 v2:172.21.15.153:6834/287073699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1419800 con 0x1691190 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 10 client.6259 handle_command_reply: tid=0 2023-08-17T00:07:10.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 client.6259 shutdown 2023-08-17T00:07:10.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 msgr2=0x15e0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x15e0ab0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f0ea00095f0 tx=0x7f0ea0036000).stop 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 shutdown_connections 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:6834/287073699,v1:172.21.15.153:6835/287073699] conn(0x1691190 0x1696fa0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1608ce0 0x15e0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x15dd070 0x15e0ab0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 --2- 172.21.15.153:0/1960374420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x15dbb70 0x1628f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0e89ffb700 0 client.6259 ms_handle_reset on v2:172.21.15.153:6834/287073699 2023-08-17T00:07:10.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 >> 172.21.15.153:0/1960374420 conn(0x13c2870 msgr2=0x162c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:10.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 shutdown_connections 2023-08-17T00:07:10.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 1 -- 172.21.15.153:0/1960374420 wait complete. 2023-08-17T00:07:10.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.460+0000 7f0ebc065740 20 client.6259 trim_cache size 0 max 16384 2023-08-17T00:07:10.471 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:07:10.471 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:07:10.471 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "67d26cc8-ba29-4a66-837c-4c81c21cb922", 2023-08-17T00:07:10.472 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:07:10.472 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:07:10.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e9805a120 msgr2=0x7f0e9805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e9805a120 0x7f0e9805c5e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0e9c00bb10 tx=0x7f0e9c008040).stop 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 msgr2=0x7f0eac0ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0ad7c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f0ea400c7c0 tx=0x7f0ea4001510).stop 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 shutdown_connections 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e9805a120 0x7f0e9805c5e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0eac1543b0 0x7f0eac0ad7c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eac0c5c40 0x7f0eac0aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 --2- 172.21.15.153:0/1168650832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eac0a9cd0 0x7f0eac1492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:10.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 >> 172.21.15.153:0/1168650832 conn(0x7f0eac062a70 msgr2=0x7f0eac156920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:10.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 shutdown_connections 2023-08-17T00:07:10.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:10.464+0000 7f0eb0a79700 1 -- 172.21.15.153:0/1168650832 wait complete. 2023-08-17T00:07:10.487 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '67d26cc8-ba29-4a66-837c-4c81c21cb922', 'mode': 'asynchronous'}' 2023-08-17T00:07:14.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:07:14.369 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:07:20.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:20.490 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2023-08-17T00:07:20.517 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:07:20.517 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:07:20.602 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:07:20.645 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:07:20.646 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:07:20.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:20.647 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:20.733 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:07:20.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:20.734 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:07:20.751 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:20.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f7970c79700 1 Processor -- start 2023-08-17T00:07:20.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f7970c79700 1 -- start start 2023-08-17T00:07:20.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f7970c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c151c40 0x7f796c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:20.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f7970c79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c065da0 con 0x7f796c068da0 2023-08-17T00:07:20.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f7970c79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c155c60 con 0x7f796c0689c0 2023-08-17T00:07:20.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f7970c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c069200 con 0x7f796c151c40 2023-08-17T00:07:20.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f796affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f796c068da0 0x7f796c151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43980/0 (socket says 172.21.15.153:43980) 2023-08-17T00:07:20.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f796affd700 1 -- 172.21.15.153:0/3241198450 learned_addr learned my addr 172.21.15.153:0/3241198450 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:20.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.947+0000 7f796bfff700 1 --2- 172.21.15.153:0/3241198450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c151c40 0x7f796c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:20.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796bfff700 1 -- 172.21.15.153:0/3241198450 >> v1:172.21.15.178:6789/0 conn(0x7f796c0689c0 legacy=0x7f796c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:20.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796bfff700 1 -- 172.21.15.153:0/3241198450 >> v1:172.21.15.153:6789/0 conn(0x7f796c068da0 legacy=0x7f796c151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:20.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796bfff700 1 -- 172.21.15.153:0/3241198450 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c065ff0 con 0x7f796c151c40 2023-08-17T00:07:20.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796a7fc700 1 -- 172.21.15.153:0/3241198450 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434897149 0 0) 0x7f796c065da0 con 0x7f796c068da0 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796bfff700 1 --2- 172.21.15.153:0/3241198450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c151c40 0x7f796c1560f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7964009e90 tx=0x7f7964009780).ready entity=mon.2 client_cookie=fedc8b570711e55b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796a7fc700 1 -- 172.21.15.153:0/3241198450 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400e070 con 0x7f796c151c40 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796a7fc700 1 -- 172.21.15.153:0/3241198450 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400bc30 con 0x7f796c151c40 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f796a7fc700 1 -- 172.21.15.153:0/3241198450 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964012410 con 0x7f796c151c40 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 -- 172.21.15.153:0/3241198450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c151c40 msgr2=0x7f796c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 --2- 172.21.15.153:0/3241198450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c151c40 0x7f796c1560f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f7964009e90 tx=0x7f7964009780).stop 2023-08-17T00:07:20.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 -- 172.21.15.153:0/3241198450 shutdown_connections 2023-08-17T00:07:20.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 --2- 172.21.15.153:0/3241198450 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c151c40 0x7f796c1560f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:20.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 -- 172.21.15.153:0/3241198450 >> 172.21.15.153:0/3241198450 conn(0x7f796c0c6620 msgr2=0x7f796c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:20.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 -- 172.21.15.153:0/3241198450 shutdown_connections 2023-08-17T00:07:20.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.951+0000 7f7970c79700 1 -- 172.21.15.153:0/3241198450 wait complete. 2023-08-17T00:07:20.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 Processor -- start 2023-08-17T00:07:20.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 -- start start 2023-08-17T00:07:20.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c0689c0 0x7f796c0a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:20.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c068da0 0x7f796c153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:20.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 0x7f796c14f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c14b5d0 con 0x7f796c151c40 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0a8430 con 0x7f796c0689c0 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f7970c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c153d30 con 0x7f796c068da0 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 0x7f796c14f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 0x7f796c14f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45452/0 (socket says 172.21.15.153:45452) 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 -- 172.21.15.153:0/140552208 learned_addr learned my addr 172.21.15.153:0/140552208 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:20.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796affd700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c068da0 0x7f796c153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796b7fe700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c0689c0 0x7f796c0a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 -- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c068da0 msgr2=0x7f796c153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c068da0 0x7f796c153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 -- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c0689c0 msgr2=0x7f796c0a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c0689c0 0x7f796c0a7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 -- 172.21.15.153:0/140552208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009a20 con 0x7f796c151c40 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f796bfff700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 0x7f796c14f1b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f796400b6c0 tx=0x7f7964009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:20.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.955+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796401c660 con 0x7f796c151c40 2023-08-17T00:07:20.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.959+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796401c7c0 con 0x7f796c151c40 2023-08-17T00:07:20.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.959+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796401cb60 con 0x7f796c151c40 2023-08-17T00:07:20.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.959+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c154010 con 0x7f796c151c40 2023-08-17T00:07:20.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.959+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c14b850 con 0x7f796c151c40 2023-08-17T00:07:20.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.959+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c1544f0 con 0x7f796c151c40 2023-08-17T00:07:20.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.959+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7964027460 con 0x7f796c151c40 2023-08-17T00:07:20.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.963+0000 7f79537fe700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a150 0x7f795805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:20.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.963+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7964076690 con 0x7f796c151c40 2023-08-17T00:07:20.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.963+0000 7f796b7fe700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a150 0x7f795805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:20.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.963+0000 7f796b7fe700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a150 0x7f795805c610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f795c007fd0 tx=0x7f795c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:20.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:20.967+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7964049f80 con 0x7f796c151c40 2023-08-17T00:07:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.163+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f796c06b4c0 con 0x7f796c151c40 2023-08-17T00:07:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.163+0000 7f79537fe700 1 -- 172.21.15.153:0/140552208 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f796404d5a0 con 0x7f796c151c40 2023-08-17T00:07:21.170 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:21.170 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:08.392134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6459},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6459":{"gid":6459,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/287073699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":287073699},{"type":"v1","addr":"172.21.15.153:6835","nonce":287073699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a150 msgr2=0x7f795805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a150 0x7f795805c610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f795c007fd0 tx=0x7f795c009040).stop 2023-08-17T00:07:21.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 msgr2=0x7f796c14f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 0x7f796c14f1b0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f796400b6c0 tx=0x7f7964009780).stop 2023-08-17T00:07:21.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 shutdown_connections 2023-08-17T00:07:21.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a150 0x7f795805c610 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f796c151c40 0x7f796c14f1b0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c068da0 0x7f796c153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 --2- 172.21.15.153:0/140552208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c0689c0 0x7f796c0a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 >> 172.21.15.153:0/140552208 conn(0x7f796c0c6620 msgr2=0x7f796c150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:21.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 shutdown_connections 2023-08-17T00:07:21.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.167+0000 7f7970c79700 1 -- 172.21.15.153:0/140552208 wait complete. 2023-08-17T00:07:21.175 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 55 2023-08-17T00:07:21.189 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.339+0000 7f45c1b47700 1 Processor -- start 2023-08-17T00:07:21.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.339+0000 7f45c1b47700 1 -- start start 2023-08-17T00:07:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1b47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45bc0c57a0 0x7f45bc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1b47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45bc0c11b0 0x7f45bc154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1b47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45bc0bfd10 con 0x7f45bc153f50 2023-08-17T00:07:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1b47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc154860 con 0x7f45bc0c11b0 2023-08-17T00:07:21.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1b47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45bc154af0 con 0x7f45bc0c57a0 2023-08-17T00:07:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45bc0c11b0 0x7f45bc154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f45bc0c11b0 0x7f45bc154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45456/0 (socket says 172.21.15.153:45456) 2023-08-17T00:07:21.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c0b45700 1 --2- 172.21.15.153:0/3458781622 >> v2:172.21.15.178:3300/0 conn(0x7f45bc0c57a0 0x7f45bc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 -- 172.21.15.153:0/3458781622 learned_addr learned my addr 172.21.15.153:0/3458781622 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 -- 172.21.15.153:0/3458781622 >> v2:172.21.15.178:3300/0 conn(0x7f45bc0c57a0 msgr2=0x7f45bc0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 --2- 172.21.15.153:0/3458781622 >> v2:172.21.15.178:3300/0 conn(0x7f45bc0c57a0 0x7f45bc0c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 -- 172.21.15.153:0/3458781622 >> v1:172.21.15.178:6789/0 conn(0x7f45bc153f50 legacy=0x7f45bc157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 -- 172.21.15.153:0/3458781622 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45bc154dd0 con 0x7f45bc0c11b0 2023-08-17T00:07:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45c1346700 1 --2- 172.21.15.153:0/3458781622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c11b0 0x7f45bc154370 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f45bc0c54c0 tx=0x7f45b4009840).ready entity=mon.0 client_cookie=aebcaf61104c1577 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45bb7fe700 1 -- 172.21.15.153:0/3458781622 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400e070 con 0x7f45bc0c11b0 2023-08-17T00:07:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45bb7fe700 1 -- 172.21.15.153:0/3458781622 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b400ba20 con 0x7f45bc0c11b0 2023-08-17T00:07:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.343+0000 7f45bb7fe700 1 -- 172.21.15.153:0/3458781622 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b400bda0 con 0x7f45bc0c11b0 2023-08-17T00:07:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 -- 172.21.15.153:0/3458781622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c11b0 msgr2=0x7f45bc154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 --2- 172.21.15.153:0/3458781622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c11b0 0x7f45bc154370 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f45bc0c54c0 tx=0x7f45b4009840).stop 2023-08-17T00:07:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 -- 172.21.15.153:0/3458781622 shutdown_connections 2023-08-17T00:07:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 --2- 172.21.15.153:0/3458781622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c11b0 0x7f45bc154370 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 --2- 172.21.15.153:0/3458781622 >> v2:172.21.15.178:3300/0 conn(0x7f45bc0c57a0 0x7f45bc0c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 -- 172.21.15.153:0/3458781622 >> 172.21.15.153:0/3458781622 conn(0x7f45bc062a70 msgr2=0x7f45bc0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 -- 172.21.15.153:0/3458781622 shutdown_connections 2023-08-17T00:07:21.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 -- 172.21.15.153:0/3458781622 wait complete. 2023-08-17T00:07:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 Processor -- start 2023-08-17T00:07:21.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.347+0000 7f45c1b47700 1 -- start start 2023-08-17T00:07:21.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 0x7f45bc164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c57a0 0x7f45bc0ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc153f50 0x7f45bc1658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc14ed60 con 0x7f45bc0c57a0 2023-08-17T00:07:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc165dc0 con 0x7f45bc153f50 2023-08-17T00:07:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45bc164ca0 con 0x7f45bc0c11b0 2023-08-17T00:07:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45bbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c57a0 0x7f45bc0ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 0x7f45bc164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1346700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc153f50 0x7f45bc1658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 0x7f45bc164700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:44186/0 (socket says 172.21.15.153:44186) 2023-08-17T00:07:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 -- 172.21.15.153:0/1726328770 learned_addr learned my addr 172.21.15.153:0/1726328770 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 -- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc153f50 msgr2=0x7f45bc1658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc153f50 0x7f45bc1658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 -- 172.21.15.153:0/1726328770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c57a0 msgr2=0x7f45bc0ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c57a0 0x7f45bc0ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 -- 172.21.15.153:0/1726328770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b4009ae0 con 0x7f45bc0c11b0 2023-08-17T00:07:21.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45bbfff700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c57a0 0x7f45bc0ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c0b45700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 0x7f45bc164700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f45b000e930 tx=0x7f45b0009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0012600 con 0x7f45bc0c11b0 2023-08-17T00:07:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45b0012760 con 0x7f45bc0c11b0 2023-08-17T00:07:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45bc164f80 con 0x7f45bc0c11b0 2023-08-17T00:07:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45b0012ae0 con 0x7f45bc0c11b0 2023-08-17T00:07:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.351+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45bc165540 con 0x7f45bc0c11b0 2023-08-17T00:07:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.355+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45bc0c4cc0 con 0x7f45bc0c11b0 2023-08-17T00:07:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.355+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f45b0022070 con 0x7f45bc0c11b0 2023-08-17T00:07:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.355+0000 7f45b8ff9700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f45a005a150 0x7f45a005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.355+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f45b0074510 con 0x7f45bc0c11b0 2023-08-17T00:07:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.355+0000 7f45bbfff700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f45a005a150 0x7f45a005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.359+0000 7f45bbfff700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f45a005a150 0x7f45a005c610 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f45bc0b0980 tx=0x7f45a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:21.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.367+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f45b0047e60 con 0x7f45bc0c11b0 2023-08-17T00:07:21.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.539+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45bc0abb40 con 0x7f45bc0c11b0 2023-08-17T00:07:21.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.539+0000 7f45b8ff9700 1 -- 172.21.15.153:0/1726328770 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17109 (secure 0 0 0) 0x7f45b004b480 con 0x7f45bc0c11b0 2023-08-17T00:07:21.547 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:21.547 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":67,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:04.081764+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:06:47.903453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T00:06:48.933074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6834/1621445932":"2023-08-18T00:07:04.061533+0000","172.21.15.153:6832/1621445932":"2023-08-18T00:07:04.061533+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f45a005a150 msgr2=0x7f45a005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f45a005a150 0x7f45a005c610 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f45bc0b0980 tx=0x7f45a8009040).stop 2023-08-17T00:07:21.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 msgr2=0x7f45bc164700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 0x7f45bc164700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f45b000e930 tx=0x7f45b0009060).stop 2023-08-17T00:07:21.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 shutdown_connections 2023-08-17T00:07:21.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f45a005a150 0x7f45a005c610 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45bc153f50 0x7f45bc1658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f45bc0c57a0 0x7f45bc0ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 --2- 172.21.15.153:0/1726328770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45bc0c11b0 0x7f45bc164700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 >> 172.21.15.153:0/1726328770 conn(0x7f45bc062a70 msgr2=0x7f45bc0c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:21.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 shutdown_connections 2023-08-17T00:07:21.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.543+0000 7f45c1b47700 1 -- 172.21.15.153:0/1726328770 wait complete. 2023-08-17T00:07:21.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:06:47.903453+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:06:48.933074+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:07:21.572 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:07:21.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 Processor -- start 2023-08-17T00:07:21.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 -- start start 2023-08-17T00:07:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f836c153ab0 0x7f836c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f836c0c7ba0 0x7f836c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0aa750 con 0x7f836c0c8d50 2023-08-17T00:07:21.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0c9dd0 con 0x7f836c153ab0 2023-08-17T00:07:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f8372746700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c0aacf0 con 0x7f836c0c7ba0 2023-08-17T00:07:21.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f836bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f836c153ab0 0x7f836c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f836bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f836c153ab0 0x7f836c153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45474/0 (socket says 172.21.15.153:45474) 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.727+0000 7f836bfff700 1 -- 172.21.15.153:0/1438689958 learned_addr learned my addr 172.21.15.153:0/1438689958 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8370ce3700 1 --2- 172.21.15.153:0/1438689958 >> v2:172.21.15.178:3300/0 conn(0x7f836c0c7ba0 0x7f836c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836bfff700 1 -- 172.21.15.153:0/1438689958 >> v2:172.21.15.178:3300/0 conn(0x7f836c0c7ba0 msgr2=0x7f836c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836bfff700 1 --2- 172.21.15.153:0/1438689958 >> v2:172.21.15.178:3300/0 conn(0x7f836c0c7ba0 0x7f836c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836bfff700 1 -- 172.21.15.153:0/1438689958 >> v1:172.21.15.178:6789/0 conn(0x7f836c0c8d50 legacy=0x7f836c0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836bfff700 1 -- 172.21.15.153:0/1438689958 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0c5ca0 con 0x7f836c153ab0 2023-08-17T00:07:21.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836bfff700 1 --2- 172.21.15.153:0/1438689958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c153ab0 0x7f836c153e90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f836c05ea10 tx=0x7f835c0090f0).ready entity=mon.0 client_cookie=10fa37c272dcf8ca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:21.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836affd700 1 -- 172.21.15.153:0/1438689958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00b600 con 0x7f836c153ab0 2023-08-17T00:07:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836affd700 1 -- 172.21.15.153:0/1438689958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c00b760 con 0x7f836c153ab0 2023-08-17T00:07:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f836affd700 1 -- 172.21.15.153:0/1438689958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00bb00 con 0x7f836c153ab0 2023-08-17T00:07:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 -- 172.21.15.153:0/1438689958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c153ab0 msgr2=0x7f836c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 --2- 172.21.15.153:0/1438689958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c153ab0 0x7f836c153e90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f836c05ea10 tx=0x7f835c0090f0).stop 2023-08-17T00:07:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 -- 172.21.15.153:0/1438689958 shutdown_connections 2023-08-17T00:07:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 --2- 172.21.15.153:0/1438689958 >> v2:172.21.15.178:3300/0 conn(0x7f836c0c7ba0 0x7f836c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 --2- 172.21.15.153:0/1438689958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c153ab0 0x7f836c153e90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 -- 172.21.15.153:0/1438689958 >> 172.21.15.153:0/1438689958 conn(0x7f836c061fa0 msgr2=0x7f836c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 -- 172.21.15.153:0/1438689958 shutdown_connections 2023-08-17T00:07:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.731+0000 7f8372746700 1 -- 172.21.15.153:0/1438689958 wait complete. 2023-08-17T00:07:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 Processor -- start 2023-08-17T00:07:21.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 -- start start 2023-08-17T00:07:21.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c0c7ba0 0x7f836c0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 0x7f836c0ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c153ab0 0x7f836c0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0acb30 con 0x7f836c0c8d50 2023-08-17T00:07:21.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c165120 con 0x7f836c0c7ba0 2023-08-17T00:07:21.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c0adf00 con 0x7f836c153ab0 2023-08-17T00:07:21.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 0x7f836c0ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 0x7f836c0ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45484/0 (socket says 172.21.15.153:45484) 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 -- 172.21.15.153:0/3168230327 learned_addr learned my addr 172.21.15.153:0/3168230327 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836bfff700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c0c7ba0 0x7f836c0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8370ce3700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c153ab0 0x7f836c0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 -- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c153ab0 msgr2=0x7f836c0ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c153ab0 0x7f836c0ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 -- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c0c7ba0 msgr2=0x7f836c0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c0c7ba0 0x7f836c0ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 -- 172.21.15.153:0/3168230327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c009370 con 0x7f836c0c8d50 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f836b7fe700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 0x7f836c0ac150 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f836000c440 tx=0x7f8360007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360012400 con 0x7f836c0c8d50 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8360012560 con 0x7f836c0c8d50 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c164df0 con 0x7f836c0c8d50 2023-08-17T00:07:21.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.735+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8360012900 con 0x7f836c0c8d50 2023-08-17T00:07:21.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.739+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c0ae7a0 con 0x7f836c0c8d50 2023-08-17T00:07:21.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.739+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c1652b0 con 0x7f836c0c8d50 2023-08-17T00:07:21.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.739+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8360019030 con 0x7f836c0c8d50 2023-08-17T00:07:21.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.743+0000 7f8353fff700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f835805a180 0x7f835805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:21.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.743+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f83600732d0 con 0x7f836c0c8d50 2023-08-17T00:07:21.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.743+0000 7f836bfff700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f835805a180 0x7f835805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:21.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.743+0000 7f836bfff700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f835805a180 0x7f835805c640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f835c00b3c0 tx=0x7f835c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:21.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.747+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8360046de0 con 0x7f836c0c8d50 2023-08-17T00:07:21.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.907+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f836c06b530 con 0x7f836c0c8d50 2023-08-17T00:07:21.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.911+0000 7f8353fff700 1 -- 172.21.15.153:0/3168230327 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v67) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8360017070 con 0x7f836c0c8d50 2023-08-17T00:07:21.916 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:07:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f835805a180 msgr2=0x7f835805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f835805a180 0x7f835805c640 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f835c00b3c0 tx=0x7f835c017000).stop 2023-08-17T00:07:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 msgr2=0x7f836c0ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 0x7f836c0ac150 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7f836000c440 tx=0x7f8360007dc0).stop 2023-08-17T00:07:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 shutdown_connections 2023-08-17T00:07:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f835805a180 0x7f835805c640 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f836c153ab0 0x7f836c0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f836c0c8d50 0x7f836c0ac150 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 --2- 172.21.15.153:0/3168230327 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f836c0c7ba0 0x7f836c0ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:21.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 >> 172.21.15.153:0/3168230327 conn(0x7f836c061fa0 msgr2=0x7f836c0bfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:21.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 shutdown_connections 2023-08-17T00:07:21.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:21.915+0000 7f8372746700 1 -- 172.21.15.153:0/3168230327 wait complete. 2023-08-17T00:07:21.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:07:22.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.099+0000 7fbca4546700 1 Processor -- start 2023-08-17T00:07:22.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.099+0000 7fbca4546700 1 -- start start 2023-08-17T00:07:22.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca4546700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc9c14de30 0x7fbc9c14e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca4546700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c1540a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca4546700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc9c154c10 con 0x7fbc9c0675f0 2023-08-17T00:07:22.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca4546700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc9c1550a0 con 0x7fbc9c14de30 2023-08-17T00:07:22.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca1ae1700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbc9c0c6a40 0x7fbc9c066ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43996/0 (socket says 172.21.15.153:43996) 2023-08-17T00:07:22.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca1ae1700 1 -- 172.21.15.153:0/150041794 learned_addr learned my addr 172.21.15.153:0/150041794 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:22.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca22e2700 1 --2- 172.21.15.153:0/150041794 >> v2:172.21.15.178:3300/0 conn(0x7fbc9c14de30 0x7fbc9c14e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677844291 0 0) 0x7fbc8c001110 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc880033f0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293987851 0 0) 0x7fbc9c154c10 con 0x7fbc9c0675f0 2023-08-17T00:07:22.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc8c001110 con 0x7fbc9c0675f0 2023-08-17T00:07:22.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca22e2700 1 -- 172.21.15.153:0/150041794 >> v1:172.21.15.178:6789/0 conn(0x7fbc9c0675f0 legacy=0x7fbc9c1576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca22e2700 1 -- 172.21.15.153:0/150041794 >> v1:172.21.15.153:6789/0 conn(0x7fbc9c0c6a40 legacy=0x7fbc9c066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.103+0000 7fbca22e2700 1 -- 172.21.15.153:0/150041794 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c1542e0 con 0x7fbc9c14de30 2023-08-17T00:07:22.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca22e2700 1 --2- 172.21.15.153:0/150041794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c14de30 0x7fbc9c14e210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fbc98009760 tx=0x7fbc98009060).ready entity=mon.1 client_cookie=4872fdcdc91ed6d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98009120 con 0x7fbc9c14de30 2023-08-17T00:07:22.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9800d4a0 con 0x7fbc9c14de30 2023-08-17T00:07:22.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca12e0700 1 -- 172.21.15.153:0/150041794 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9800d820 con 0x7fbc9c14de30 2023-08-17T00:07:22.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 -- 172.21.15.153:0/150041794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c14de30 msgr2=0x7fbc9c14e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 --2- 172.21.15.153:0/150041794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c14de30 0x7fbc9c14e210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fbc98009760 tx=0x7fbc98009060).stop 2023-08-17T00:07:22.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 -- 172.21.15.153:0/150041794 shutdown_connections 2023-08-17T00:07:22.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 --2- 172.21.15.153:0/150041794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c14de30 0x7fbc9c14e210 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 -- 172.21.15.153:0/150041794 >> 172.21.15.153:0/150041794 conn(0x7fbc9c0c4250 msgr2=0x7fbc9c0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:22.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 -- 172.21.15.153:0/150041794 shutdown_connections 2023-08-17T00:07:22.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.107+0000 7fbca4546700 1 -- 172.21.15.153:0/150041794 wait complete. 2023-08-17T00:07:22.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 Processor -- start 2023-08-17T00:07:22.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 -- start start 2023-08-17T00:07:22.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c0675f0 0x7fbc9c0acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 0x7fbc9c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc9c14de30 0x7fbc9c1678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1552f0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1555d0 con 0x7fbc9c0675f0 2023-08-17T00:07:22.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca4546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c1558b0 con 0x7fbc9c14de30 2023-08-17T00:07:22.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca1ae1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 0x7fbc9c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca1ae1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 0x7fbc9c157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45486/0 (socket says 172.21.15.153:45486) 2023-08-17T00:07:22.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca1ae1700 1 -- 172.21.15.153:0/2738517571 learned_addr learned my addr 172.21.15.153:0/2738517571 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:22.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.111+0000 7fbca22e2700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c0675f0 0x7fbc9c0acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca2ae3700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc9c14de30 0x7fbc9c1678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca1ae1700 1 -- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc9c14de30 msgr2=0x7fbc9c1678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca1ae1700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc9c14de30 0x7fbc9c1678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca1ae1700 1 -- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c0675f0 msgr2=0x7fbc9c0acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca1ae1700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c0675f0 0x7fbc9c0acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca1ae1700 1 -- 172.21.15.153:0/2738517571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980092a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca1ae1700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 0x7fbc9c157970 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fbc8c00c790 tx=0x7fbc8c007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0072e0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc8c007440 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c155b90 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c0057a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c1685a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.115+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c06b530 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.119+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbc8c010070 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.119+0000 7fbc927fc700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc8005a180 0x7fbc8005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.119+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fbc8c0737a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.119+0000 7fbca22e2700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc8005a180 0x7fbc8005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.123+0000 7fbca22e2700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc8005a180 0x7fbc8005c640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fbc98006d60 tx=0x7fbc98016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.127+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc8c047200 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.283+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbc9c1540a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.283+0000 7fbc927fc700 1 -- 172.21.15.153:0/2738517571 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v67) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbc9c1540a0 con 0x7fbc9c0c6a40 2023-08-17T00:07:22.290 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:07:22.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc8005a180 msgr2=0x7fbc8005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc8005a180 0x7fbc8005c640 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7fbc98006d60 tx=0x7fbc98016000).stop 2023-08-17T00:07:22.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 msgr2=0x7fbc9c157970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 0x7fbc9c157970 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fbc8c00c790 tx=0x7fbc8c007d20).stop 2023-08-17T00:07:22.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 shutdown_connections 2023-08-17T00:07:22.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc8005a180 0x7fbc8005c640 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc9c14de30 0x7fbc9c1678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc9c0c6a40 0x7fbc9c157970 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 --2- 172.21.15.153:0/2738517571 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc9c0675f0 0x7fbc9c0acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 >> 172.21.15.153:0/2738517571 conn(0x7fbc9c0c4250 msgr2=0x7fbc9c0bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:22.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 shutdown_connections 2023-08-17T00:07:22.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.287+0000 7fbca4546700 1 -- 172.21.15.153:0/2738517571 wait complete. 2023-08-17T00:07:22.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.467+0000 7f249cc8f700 1 Processor -- start 2023-08-17T00:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.467+0000 7f249cc8f700 1 -- start start 2023-08-17T00:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f249cc8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24980c5ea0 0x7f24980634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f249cc8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f24980639a0 0x7f24980bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f249cc8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2498154e90 con 0x7f24980acf30 2023-08-17T00:07:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f249cc8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24980c1730 con 0x7f24980639a0 2023-08-17T00:07:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f249cc8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2498153fc0 con 0x7f24980c5ea0 2023-08-17T00:07:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f24980639a0 0x7f24980bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f24980639a0 0x7f24980bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45502/0 (socket says 172.21.15.153:45502) 2023-08-17T00:07:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 -- 172.21.15.153:0/4083572744 learned_addr learned my addr 172.21.15.153:0/4083572744 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2496ffd700 1 --2- 172.21.15.153:0/4083572744 >> v2:172.21.15.178:3300/0 conn(0x7f24980c5ea0 0x7f24980634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 -- 172.21.15.153:0/4083572744 >> v2:172.21.15.178:3300/0 conn(0x7f24980c5ea0 msgr2=0x7f24980634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 --2- 172.21.15.153:0/4083572744 >> v2:172.21.15.178:3300/0 conn(0x7f24980c5ea0 0x7f24980634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 -- 172.21.15.153:0/4083572744 >> v1:172.21.15.178:6789/0 conn(0x7f24980acf30 legacy=0x7f24980c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 -- 172.21.15.153:0/4083572744 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498154280 con 0x7f24980639a0 2023-08-17T00:07:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.471+0000 7f2497fff700 1 --2- 172.21.15.153:0/4083572744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980bfad0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f24980b0a60 tx=0x7f2490009840).ready entity=mon.0 client_cookie=1915a6f4d4b1fd34 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f24967fc700 1 -- 172.21.15.153:0/4083572744 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000e070 con 0x7f24980639a0 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f24967fc700 1 -- 172.21.15.153:0/4083572744 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249000ba20 con 0x7f24980639a0 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f24967fc700 1 -- 172.21.15.153:0/4083572744 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249000bda0 con 0x7f24980639a0 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 -- 172.21.15.153:0/4083572744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 msgr2=0x7f24980bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 --2- 172.21.15.153:0/4083572744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980bfad0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f24980b0a60 tx=0x7f2490009840).stop 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 -- 172.21.15.153:0/4083572744 shutdown_connections 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 --2- 172.21.15.153:0/4083572744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980bfad0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 --2- 172.21.15.153:0/4083572744 >> v2:172.21.15.178:3300/0 conn(0x7f24980c5ea0 0x7f24980634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 -- 172.21.15.153:0/4083572744 >> 172.21.15.153:0/4083572744 conn(0x7f24980cb330 msgr2=0x7f24980c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 -- 172.21.15.153:0/4083572744 shutdown_connections 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.475+0000 7f249cc8f700 1 -- 172.21.15.153:0/4083572744 wait complete. 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 Processor -- start 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 -- start start 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24980acf30 0x7f24980ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24980b0120 0x7f24980a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980ade50 con 0x7f24980639a0 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c30d0 con 0x7f24980b0120 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24980c3c50 con 0x7f24980acf30 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45510/0 (socket says 172.21.15.153:45510) 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 -- 172.21.15.153:0/3442193181 learned_addr learned my addr 172.21.15.153:0/3442193181 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f2496ffd700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24980acf30 0x7f24980ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f2497fff700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24980b0120 0x7f24980a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 -- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24980acf30 msgr2=0x7f24980ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24980acf30 0x7f24980ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 -- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24980b0120 msgr2=0x7f24980a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24980b0120 0x7f24980a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 -- 172.21.15.153:0/3442193181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490009ae0 con 0x7f24980639a0 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f2496ffd700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24980acf30 0x7f24980ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f24977fe700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980c40e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f248800c4c0 tx=0x7f2488007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488007020 con 0x7f24980639a0 2023-08-17T00:07:22.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488001e90 con 0x7f24980639a0 2023-08-17T00:07:22.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24980c3320 con 0x7f24980639a0 2023-08-17T00:07:22.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880073b0 con 0x7f24980639a0 2023-08-17T00:07:22.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.479+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24980c38e0 con 0x7f24980639a0 2023-08-17T00:07:22.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.483+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249806b4c0 con 0x7f24980639a0 2023-08-17T00:07:22.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.483+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2488010070 con 0x7f24980639a0 2023-08-17T00:07:22.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.487+0000 7f247f7fe700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f248405a1a0 0x7f248405c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.487+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f2488073a90 con 0x7f24980639a0 2023-08-17T00:07:22.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.487+0000 7f2496ffd700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f248405a1a0 0x7f248405c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.487+0000 7f2496ffd700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f248405a1a0 0x7f248405c660 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f24980c3080 tx=0x7f248c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.491+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2488047460 con 0x7f24980639a0 2023-08-17T00:07:22.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.651+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2498154560 con 0x7f24980639a0 2023-08-17T00:07:22.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.651+0000 7f247f7fe700 1 -- 172.21.15.153:0/3442193181 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) v1 ==== 104+0+11 (secure 0 0 0) 0x7f248804aa80 con 0x7f24980639a0 2023-08-17T00:07:22.658 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:07:22.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f248405a1a0 msgr2=0x7f248405c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f248405a1a0 0x7f248405c660 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f24980c3080 tx=0x7f248c008040).stop 2023-08-17T00:07:22.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 msgr2=0x7f24980c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980c40e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f248800c4c0 tx=0x7f2488007e00).stop 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 shutdown_connections 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f248405a1a0 0x7f248405c660 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24980b0120 0x7f24980a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24980acf30 0x7f24980ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 --2- 172.21.15.153:0/3442193181 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24980639a0 0x7f24980c40e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 >> 172.21.15.153:0/3442193181 conn(0x7f24980cb330 msgr2=0x7f2498153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 shutdown_connections 2023-08-17T00:07:22.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.655+0000 7f249cc8f700 1 -- 172.21.15.153:0/3442193181 wait complete. 2023-08-17T00:07:22.681 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:07:22.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.839+0000 7f53ae25b700 1 Processor -- start 2023-08-17T00:07:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.839+0000 7f53ae25b700 1 -- start start 2023-08-17T00:07:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53ae25b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53ae25b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a8061fa0 con 0x7f53a8064870 2023-08-17T00:07:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53ae25b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80621f0 con 0x7f53a8063290 2023-08-17T00:07:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53ae25b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c3fb0 con 0x7f53a8151b90 2023-08-17T00:07:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f53a8064870 0x7f53a80a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44006/0 (socket says 172.21.15.153:44006) 2023-08-17T00:07:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a7fff700 1 -- 172.21.15.153:0/3261906196 learned_addr learned my addr 172.21.15.153:0/3261906196 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a77fe700 1 --2- 172.21.15.153:0/3261906196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710574394 0 0) 0x7f53a8061fa0 con 0x7f53a8064870 2023-08-17T00:07:22.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53900033f0 con 0x7f53a8064870 2023-08-17T00:07:22.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2130058134 0 0) 0x7f53a80621f0 con 0x7f53a8063290 2023-08-17T00:07:22.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.843+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a8061fa0 con 0x7f53a8063290 2023-08-17T00:07:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a77fe700 1 -- 172.21.15.153:0/3261906196 >> v1:172.21.15.178:6789/0 conn(0x7f53a8063290 legacy=0x7f53a8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a77fe700 1 -- 172.21.15.153:0/3261906196 >> v1:172.21.15.153:6789/0 conn(0x7f53a8064870 legacy=0x7f53a80a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a77fe700 1 -- 172.21.15.153:0/3261906196 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80624d0 con 0x7f53a8151b90 2023-08-17T00:07:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a77fe700 1 --2- 172.21.15.153:0/3261906196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a8151f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5398009790 tx=0x7f5398009060).ready entity=mon.2 client_cookie=cca3a12562c627bd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539800f510 con 0x7f53a8151b90 2023-08-17T00:07:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539800f670 con 0x7f53a8151b90 2023-08-17T00:07:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53a67fc700 1 -- 172.21.15.153:0/3261906196 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539800f9f0 con 0x7f53a8151b90 2023-08-17T00:07:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 -- 172.21.15.153:0/3261906196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 msgr2=0x7f53a8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 --2- 172.21.15.153:0/3261906196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a8151f70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f5398009790 tx=0x7f5398009060).stop 2023-08-17T00:07:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 -- 172.21.15.153:0/3261906196 shutdown_connections 2023-08-17T00:07:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 --2- 172.21.15.153:0/3261906196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a8151f70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 -- 172.21.15.153:0/3261906196 >> 172.21.15.153:0/3261906196 conn(0x7f53a80c7150 msgr2=0x7f53a80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 -- 172.21.15.153:0/3261906196 shutdown_connections 2023-08-17T00:07:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.847+0000 7f53ae25b700 1 -- 172.21.15.153:0/3261906196 wait complete. 2023-08-17T00:07:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 Processor -- start 2023-08-17T00:07:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 -- start start 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 0x7f53a81532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53a8064870 0x7f53a81432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a80c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a8150a00 con 0x7f53a8063290 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a814fdf0 con 0x7f53a8064870 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53ae25b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a81500d0 con 0x7f53a8151b90 2023-08-17T00:07:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 0x7f53a81532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 0x7f53a81532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45516/0 (socket says 172.21.15.153:45516) 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 -- 172.21.15.153:0/1952745427 learned_addr learned my addr 172.21.15.153:0/1952745427 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a7fff700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a80c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a6ffd700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53a8064870 0x7f53a81432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 -- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 msgr2=0x7f53a80c1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a80c1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 -- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53a8064870 msgr2=0x7f53a81432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53a8064870 0x7f53a81432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.851+0000 7f53a77fe700 1 -- 172.21.15.153:0/1952745427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53980092a0 con 0x7f53a8063290 2023-08-17T00:07:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f53a77fe700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 0x7f53a81532c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f53a805e420 tx=0x7f5398017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539800f7e0 con 0x7f53a8063290 2023-08-17T00:07:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f539800f940 con 0x7f53a8063290 2023-08-17T00:07:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a81503b0 con 0x7f53a8063290 2023-08-17T00:07:22.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539801b660 con 0x7f53a8063290 2023-08-17T00:07:22.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a81437c0 con 0x7f53a8063290 2023-08-17T00:07:22.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a806b530 con 0x7f53a8063290 2023-08-17T00:07:22.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.855+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f539802b070 con 0x7f53a8063290 2023-08-17T00:07:22.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.859+0000 7f538f7fe700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f539405a150 0x7f539405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:22.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.859+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f5398075960 con 0x7f53a8063290 2023-08-17T00:07:22.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.859+0000 7f53a6ffd700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f539405a150 0x7f539405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:22.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.859+0000 7f53a6ffd700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f539405a150 0x7f539405c610 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f53a80c0ca0 tx=0x7f539c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:22.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:22.863+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f53980492b0 con 0x7f53a8063290 2023-08-17T00:07:23.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.019+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f53a80ac050 con 0x7f53a8063290 2023-08-17T00:07:23.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.019+0000 7f538f7fe700 1 -- 172.21.15.153:0/1952745427 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5398029020 con 0x7f53a8063290 2023-08-17T00:07:23.027 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:07:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f539405a150 msgr2=0x7f539405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f539405a150 0x7f539405c610 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f53a80c0ca0 tx=0x7f539c009040).stop 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 msgr2=0x7f53a81532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 0x7f53a81532c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f53a805e420 tx=0x7f5398017000).stop 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 shutdown_connections 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f539405a150 0x7f539405c610 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53a8151b90 0x7f53a80c1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53a8064870 0x7f53a81432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 --2- 172.21.15.153:0/1952745427 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53a8063290 0x7f53a81532c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 >> 172.21.15.153:0/1952745427 conn(0x7f53a80c7150 msgr2=0x7f53a814ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 shutdown_connections 2023-08-17T00:07:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.023+0000 7f53ae25b700 1 -- 172.21.15.153:0/1952745427 wait complete. 2023-08-17T00:07:23.049 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:23.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 Processor -- start 2023-08-17T00:07:23.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 -- start start 2023-08-17T00:07:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab0068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ab00a96d0 0x7f7ab00a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab01585a0 con 0x7f7ab00a8df0 2023-08-17T00:07:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00c1ba0 con 0x7f7ab00a96d0 2023-08-17T00:07:23.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab6439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0066400 con 0x7f7ab0068820 2023-08-17T00:07:23.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab5c38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7ab00a96d0 0x7f7ab00a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab5437700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7ab00a8df0 0x7f7ab00c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:53382/0 (socket says 172.21.15.153:53382) 2023-08-17T00:07:23.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab5437700 1 -- 172.21.15.153:0/3909643714 learned_addr learned my addr 172.21.15.153:0/3909643714 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:23.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.203+0000 7f7ab4c36700 1 --2- 172.21.15.153:0/3909643714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab0068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7aa7fff700 1 -- 172.21.15.153:0/3909643714 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862705560 0 0) 0x7f7ab01585a0 con 0x7f7ab00a8df0 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7aa7fff700 1 -- 172.21.15.153:0/3909643714 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a9c0033f0 con 0x7f7ab00a8df0 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab4c36700 1 -- 172.21.15.153:0/3909643714 >> v2:172.21.15.153:3300/0 conn(0x7f7ab00a96d0 msgr2=0x7f7ab00a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab4c36700 1 --2- 172.21.15.153:0/3909643714 >> v2:172.21.15.153:3300/0 conn(0x7f7ab00a96d0 0x7f7ab00a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab4c36700 1 -- 172.21.15.153:0/3909643714 >> v1:172.21.15.178:6789/0 conn(0x7f7ab00a8df0 legacy=0x7f7ab00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab4c36700 1 -- 172.21.15.153:0/3909643714 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab0069170 con 0x7f7ab0068820 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab5c38700 1 --2- 172.21.15.153:0/3909643714 >> v2:172.21.15.153:3300/0 conn(0x7f7ab00a96d0 0x7f7ab00a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab4c36700 1 --2- 172.21.15.153:0/3909643714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab0068c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7aa0009760 tx=0x7f7aa0009060).ready entity=mon.2 client_cookie=f320f5522513ab3a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7aa7fff700 1 -- 172.21.15.153:0/3909643714 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000d4a0 con 0x7f7ab0068820 2023-08-17T00:07:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7aa7fff700 1 -- 172.21.15.153:0/3909643714 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa000d600 con 0x7f7ab0068820 2023-08-17T00:07:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7aa7fff700 1 -- 172.21.15.153:0/3909643714 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000d980 con 0x7f7ab0068820 2023-08-17T00:07:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 -- 172.21.15.153:0/3909643714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 msgr2=0x7f7ab0068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 --2- 172.21.15.153:0/3909643714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab0068c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f7aa0009760 tx=0x7f7aa0009060).stop 2023-08-17T00:07:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 -- 172.21.15.153:0/3909643714 shutdown_connections 2023-08-17T00:07:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 --2- 172.21.15.153:0/3909643714 >> v2:172.21.15.153:3300/0 conn(0x7f7ab00a96d0 0x7f7ab00a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 --2- 172.21.15.153:0/3909643714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab0068820 0x7f7ab0068c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 -- 172.21.15.153:0/3909643714 >> 172.21.15.153:0/3909643714 conn(0x7f7ab00c6620 msgr2=0x7f7ab00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 -- 172.21.15.153:0/3909643714 shutdown_connections 2023-08-17T00:07:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.207+0000 7f7ab6439700 1 -- 172.21.15.153:0/3909643714 wait complete. 2023-08-17T00:07:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 Processor -- start 2023-08-17T00:07:23.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 -- start start 2023-08-17T00:07:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 0x7f7ab00bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab00a8df0 0x7f7ab00bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab00a96d0 0x7f7ab00aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00bc7f0 con 0x7f7ab0068820 2023-08-17T00:07:23.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00bcad0 con 0x7f7ab00a96d0 2023-08-17T00:07:23.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab6439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00bcdb0 con 0x7f7ab00a8df0 2023-08-17T00:07:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab5437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 0x7f7ab00bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab5437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 0x7f7ab00bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45540/0 (socket says 172.21.15.153:45540) 2023-08-17T00:07:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab5437700 1 -- 172.21.15.153:0/1874963238 learned_addr learned my addr 172.21.15.153:0/1874963238 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab4c36700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab00a8df0 0x7f7ab00bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.211+0000 7f7ab5c38700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab00a96d0 0x7f7ab00aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5437700 1 -- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab00a8df0 msgr2=0x7f7ab00bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5437700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab00a8df0 0x7f7ab00bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5437700 1 -- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab00a96d0 msgr2=0x7f7ab00aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5437700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab00a96d0 0x7f7ab00aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5437700 1 -- 172.21.15.153:0/1874963238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8009a20 con 0x7f7ab0068820 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5c38700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab00a96d0 0x7f7ab00aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab5437700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 0x7f7ab00bfe20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f7aac001f20 tx=0x7f7aac007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0072e0 con 0x7f7ab0068820 2023-08-17T00:07:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac007440 con 0x7f7ab0068820 2023-08-17T00:07:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0057f0 con 0x7f7ab0068820 2023-08-17T00:07:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa00092a0 con 0x7f7ab0068820 2023-08-17T00:07:23.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab00c0310 con 0x7f7ab0068820 2023-08-17T00:07:23.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.215+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab006b4c0 con 0x7f7ab0068820 2023-08-17T00:07:23.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.219+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7aac010070 con 0x7f7ab0068820 2023-08-17T00:07:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.219+0000 7f7aa57fa700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.219+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7aac0738a0 con 0x7f7ab0068820 2023-08-17T00:07:23.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.219+0000 7f7ab4c36700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.219+0000 7f7ab4c36700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f7ab00b99c0 tx=0x7f7aa0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.223+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7aac0471f0 con 0x7f7ab0068820 2023-08-17T00:07:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.423+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ab00be1a0 con 0x7f7ab0068820 2023-08-17T00:07:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.423+0000 7f7aa57fa700 1 -- 172.21.15.153:0/1874963238 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f7aac04a810 con 0x7f7ab0068820 2023-08-17T00:07:23.431 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:23.431 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:08.392134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6459},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6459":{"gid":6459,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/287073699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":287073699},{"type":"v1","addr":"172.21.15.153:6835","nonce":287073699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 msgr2=0x7f7a9405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f7ab00b99c0 tx=0x7f7aa0016000).stop 2023-08-17T00:07:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 msgr2=0x7f7ab00bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 0x7f7ab00bfe20 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f7aac001f20 tx=0x7f7aac007c80).stop 2023-08-17T00:07:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 shutdown_connections 2023-08-17T00:07:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a9405a150 0x7f7a9405c610 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ab00a96d0 0x7f7ab00aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ab00a8df0 0x7f7ab00bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 --2- 172.21.15.153:0/1874963238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ab0068820 0x7f7ab00bfe20 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.427+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 >> 172.21.15.153:0/1874963238 conn(0x7f7ab00c6620 msgr2=0x7f7ab0157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:23.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.431+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 shutdown_connections 2023-08-17T00:07:23.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.431+0000 7f7ab6439700 1 -- 172.21.15.153:0/1874963238 wait complete. 2023-08-17T00:07:23.437 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 55 2023-08-17T00:07:23.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:23.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.607+0000 7fd049569700 1 Processor -- start 2023-08-17T00:07:23.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 -- start start 2023-08-17T00:07:23.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd044151630 0x7fd0440bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd044151a10 0x7fd044066130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd0440635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd044066620 con 0x7fd044151630 2023-08-17T00:07:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd044062c90 con 0x7fd044151a10 2023-08-17T00:07:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd049569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd044062980 con 0x7fd044063120 2023-08-17T00:07:23.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd042ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd044151630 0x7fd0440bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd042ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd044151630 0x7fd0440bbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45550/0 (socket says 172.21.15.153:45550) 2023-08-17T00:07:23.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd042ffd700 1 -- 172.21.15.153:0/3524525641 learned_addr learned my addr 172.21.15.153:0/3524525641 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:23.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd03bfff700 1 --2- 172.21.15.153:0/3524525641 >> v2:172.21.15.178:3300/0 conn(0x7fd044151a10 0x7fd044066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd0437fe700 1 --2- 172.21.15.153:0/3524525641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd0440635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.611+0000 7fd042ffd700 1 -- 172.21.15.153:0/3524525641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 msgr2=0x7fd0440635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:23.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd042ffd700 1 --2- 172.21.15.153:0/3524525641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd0440635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd042ffd700 1 -- 172.21.15.153:0/3524525641 >> v2:172.21.15.178:3300/0 conn(0x7fd044151a10 msgr2=0x7fd044066130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:23.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd042ffd700 1 --2- 172.21.15.153:0/3524525641 >> v2:172.21.15.178:3300/0 conn(0x7fd044151a10 0x7fd044066130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd042ffd700 1 -- 172.21.15.153:0/3524525641 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd044065a20 con 0x7fd044151630 2023-08-17T00:07:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd042ffd700 1 --2- 172.21.15.153:0/3524525641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151630 0x7fd0440bbd50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fd044068750 tx=0x7fd0340090f0).ready entity=mon.0 client_cookie=f460bb7d23eaf5f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd0427fc700 1 -- 172.21.15.153:0/3524525641 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400f510 con 0x7fd044151630 2023-08-17T00:07:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd0427fc700 1 -- 172.21.15.153:0/3524525641 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400f670 con 0x7fd044151630 2023-08-17T00:07:23.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd0427fc700 1 -- 172.21.15.153:0/3524525641 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400fa10 con 0x7fd044151630 2023-08-17T00:07:23.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 -- 172.21.15.153:0/3524525641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151630 msgr2=0x7fd0440bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 --2- 172.21.15.153:0/3524525641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151630 0x7fd0440bbd50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7fd044068750 tx=0x7fd0340090f0).stop 2023-08-17T00:07:23.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 -- 172.21.15.153:0/3524525641 shutdown_connections 2023-08-17T00:07:23.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 --2- 172.21.15.153:0/3524525641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd0440635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 --2- 172.21.15.153:0/3524525641 >> v2:172.21.15.178:3300/0 conn(0x7fd044151a10 0x7fd044066130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 --2- 172.21.15.153:0/3524525641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151630 0x7fd0440bbd50 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 -- 172.21.15.153:0/3524525641 >> 172.21.15.153:0/3524525641 conn(0x7fd0440c2fb0 msgr2=0x7fd0440c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 -- 172.21.15.153:0/3524525641 shutdown_connections 2023-08-17T00:07:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.615+0000 7fd049569700 1 -- 172.21.15.153:0/3524525641 wait complete. 2023-08-17T00:07:23.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 Processor -- start 2023-08-17T00:07:23.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 -- start start 2023-08-17T00:07:23.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd044157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd044151630 0x7fd04414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 0x7fd0440646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440abe30 con 0x7fd044151a10 2023-08-17T00:07:23.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440ab220 con 0x7fd044151630 2023-08-17T00:07:23.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd049569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0440ab500 con 0x7fd044063120 2023-08-17T00:07:23.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 0x7fd0440646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd03bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd044151630 0x7fd04414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd042ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd044157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 0x7fd0440646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45564/0 (socket says 172.21.15.153:45564) 2023-08-17T00:07:23.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 -- 172.21.15.153:0/1604860665 learned_addr learned my addr 172.21.15.153:0/1604860665 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:23.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 -- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 msgr2=0x7fd044157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd044157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 -- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd044151630 msgr2=0x7fd04414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd044151630 0x7fd04414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 -- 172.21.15.153:0/1604860665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009370 con 0x7fd044151a10 2023-08-17T00:07:23.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd03bfff700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd044151630 0x7fd04414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:23.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.619+0000 7fd0437fe700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 0x7fd0440646d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fd03c009d70 tx=0x7fd03c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00caa0 con 0x7fd044151a10 2023-08-17T00:07:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03c00f040 con 0x7fd044151a10 2023-08-17T00:07:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0440ab7e0 con 0x7fd044151a10 2023-08-17T00:07:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03c00ce10 con 0x7fd044151a10 2023-08-17T00:07:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04414cdd0 con 0x7fd044151a10 2023-08-17T00:07:23.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04406b4c0 con 0x7fd044151a10 2023-08-17T00:07:23.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.623+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd03c013610 con 0x7fd044151a10 2023-08-17T00:07:23.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.627+0000 7fd03affd700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd02405a150 0x7fd02405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.627+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fd03c074930 con 0x7fd044151a10 2023-08-17T00:07:23.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.627+0000 7fd042ffd700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd02405a150 0x7fd02405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.627+0000 7fd042ffd700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd02405a150 0x7fd02405c610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fd0441567f0 tx=0x7fd034016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.631+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd03c048390 con 0x7fd044151a10 2023-08-17T00:07:23.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.799+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd044065d00 con 0x7fd044151a10 2023-08-17T00:07:23.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.799+0000 7fd03affd700 1 -- 172.21.15.153:0/1604860665 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17109 (secure 0 0 0) 0x7fd03c04b9b0 con 0x7fd044151a10 2023-08-17T00:07:23.807 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:23.807 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":67,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:04.081764+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:06:47.903453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T00:06:48.933074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6834/1621445932":"2023-08-18T00:07:04.061533+0000","172.21.15.153:6832/1621445932":"2023-08-18T00:07:04.061533+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd02405a150 msgr2=0x7fd02405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd02405a150 0x7fd02405c610 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fd0441567f0 tx=0x7fd034016000).stop 2023-08-17T00:07:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 msgr2=0x7fd0440646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 0x7fd0440646d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fd03c009d70 tx=0x7fd03c00b040).stop 2023-08-17T00:07:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 shutdown_connections 2023-08-17T00:07:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd02405a150 0x7fd02405c610 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd044151a10 0x7fd0440646d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd044151630 0x7fd04414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 --2- 172.21.15.153:0/1604860665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd044063120 0x7fd044157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 >> 172.21.15.153:0/1604860665 conn(0x7fd0440c2fb0 msgr2=0x7fd0440a8600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 shutdown_connections 2023-08-17T00:07:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.807+0000 7fd049569700 1 -- 172.21.15.153:0/1604860665 wait complete. 2023-08-17T00:07:23.834 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:07:23.835 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:23.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.979+0000 7fb09301b700 1 Processor -- start 2023-08-17T00:07:23.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.979+0000 7fb09301b700 1 -- start start 2023-08-17T00:07:23.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb09301b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb08c0a8b70 0x7fb08c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:23.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb09301b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c065240 con 0x7fb08c0629b0 2023-08-17T00:07:23.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb09301b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08c062e40 con 0x7fb08c0a8f50 2023-08-17T00:07:23.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb09301b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb08c0638a0 con 0x7fb08c0a8b70 2023-08-17T00:07:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb0915b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb08c0629b0 0x7fb08c0bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44022/0 (socket says 172.21.15.153:44022) 2023-08-17T00:07:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb0915b8700 1 -- 172.21.15.153:0/3478055768 learned_addr learned my addr 172.21.15.153:0/3478055768 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb090db7700 1 --2- 172.21.15.153:0/3478055768 >> v2:172.21.15.153:3300/0 conn(0x7fb08c0a8b70 0x7fb08c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb08b7fe700 1 -- 172.21.15.153:0/3478055768 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912827440 0 0) 0x7fb08c065240 con 0x7fb08c0629b0 2023-08-17T00:07:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb08b7fe700 1 -- 172.21.15.153:0/3478055768 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c0033f0 con 0x7fb08c0629b0 2023-08-17T00:07:23.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb08b7fe700 1 -- 172.21.15.153:0/3478055768 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848936855 0 0) 0x7fb08c062e40 con 0x7fb08c0a8f50 2023-08-17T00:07:23.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb090db7700 1 -- 172.21.15.153:0/3478055768 >> v1:172.21.15.178:6789/0 conn(0x7fb08c0a8f50 legacy=0x7fb08c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb090db7700 1 -- 172.21.15.153:0/3478055768 >> v1:172.21.15.153:6789/0 conn(0x7fb08c0629b0 legacy=0x7fb08c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.983+0000 7fb090db7700 1 -- 172.21.15.153:0/3478055768 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c065de0 con 0x7fb08c0a8b70 2023-08-17T00:07:23.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb090db7700 1 --2- 172.21.15.153:0/3478055768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c0632e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fb080009760 tx=0x7fb080009060).ready entity=mon.0 client_cookie=8b98f0db9d784caf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:23.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb08b7fe700 1 -- 172.21.15.153:0/3478055768 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000f510 con 0x7fb08c0a8b70 2023-08-17T00:07:23.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb08b7fe700 1 -- 172.21.15.153:0/3478055768 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08000f670 con 0x7fb08c0a8b70 2023-08-17T00:07:23.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb08b7fe700 1 -- 172.21.15.153:0/3478055768 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000f9f0 con 0x7fb08c0a8b70 2023-08-17T00:07:23.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 -- 172.21.15.153:0/3478055768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 msgr2=0x7fb08c0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:23.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 --2- 172.21.15.153:0/3478055768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c0632e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7fb080009760 tx=0x7fb080009060).stop 2023-08-17T00:07:23.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 -- 172.21.15.153:0/3478055768 shutdown_connections 2023-08-17T00:07:23.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 --2- 172.21.15.153:0/3478055768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c0632e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:23.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 -- 172.21.15.153:0/3478055768 >> 172.21.15.153:0/3478055768 conn(0x7fb08c0c7150 msgr2=0x7fb08c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:23.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 -- 172.21.15.153:0/3478055768 shutdown_connections 2023-08-17T00:07:23.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.987+0000 7fb09301b700 1 -- 172.21.15.153:0/3478055768 wait complete. 2023-08-17T00:07:24.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 Processor -- start 2023-08-17T00:07:24.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 -- start start 2023-08-17T00:07:24.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb08c0629b0 0x7fb08c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb08c0a8f50 0x7fb08c0c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0ab700 con 0x7fb08c0a8b70 2023-08-17T00:07:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c155480 con 0x7fb08c0a8f50 2023-08-17T00:07:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb09301b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb08c0aa380 con 0x7fb08c0629b0 2023-08-17T00:07:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c159bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45576/0 (socket says 172.21.15.153:45576) 2023-08-17T00:07:24.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 -- 172.21.15.153:0/2625043080 learned_addr learned my addr 172.21.15.153:0/2625043080 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb090db7700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb08c0629b0 0x7fb08c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb0915b8700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb08c0a8f50 0x7fb08c0c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 -- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb08c0629b0 msgr2=0x7fb08c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb08c0629b0 0x7fb08c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 -- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb08c0a8f50 msgr2=0x7fb08c0c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb08c0a8f50 0x7fb08c0c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.991+0000 7fb08bfff700 1 -- 172.21.15.153:0/2625043080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800092a0 con 0x7fb08c0a8b70 2023-08-17T00:07:24.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb08bfff700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c159bd0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fb07800c490 tx=0x7fb078007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078001ea0 con 0x7fb08c0a8b70 2023-08-17T00:07:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800ce90 con 0x7fb08c0a8b70 2023-08-17T00:07:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb08c0aa660 con 0x7fb08c0a8b70 2023-08-17T00:07:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078007250 con 0x7fb08c0a8b70 2023-08-17T00:07:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08c0ab390 con 0x7fb08c0a8b70 2023-08-17T00:07:24.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb08c06b530 con 0x7fb08c0a8b70 2023-08-17T00:07:24.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.995+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb078010070 con 0x7fb08c0a8b70 2023-08-17T00:07:24.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.999+0000 7fb088ff9700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb07005a150 0x7fb07005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.999+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fb078073a10 con 0x7fb08c0a8b70 2023-08-17T00:07:24.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.999+0000 7fb090db7700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb07005a150 0x7fb07005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:23.999+0000 7fb090db7700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb07005a150 0x7fb07005c610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fb080009760 tx=0x7fb080017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.007+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb078047360 con 0x7fb08c0a8b70 2023-08-17T00:07:24.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.199+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb08c064910 con 0x7fb08c0a8b70 2023-08-17T00:07:24.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.199+0000 7fb088ff9700 1 -- 172.21.15.153:0/2625043080 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4497 (secure 0 0 0) 0x7fb07804a980 con 0x7fb08c0a8b70 2023-08-17T00:07:24.207 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:24.207 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:08.392134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6459},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6459":{"gid":6459,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/287073699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":287073699},{"type":"v1","addr":"172.21.15.153:6835","nonce":287073699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:24.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb07005a150 msgr2=0x7fb07005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb07005a150 0x7fb07005c610 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fb080009760 tx=0x7fb080017000).stop 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 msgr2=0x7fb08c159bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c159bd0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7fb07800c490 tx=0x7fb078007dd0).stop 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 shutdown_connections 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb07005a150 0x7fb07005c610 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb08c0a8f50 0x7fb08c0c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb08c0a8b70 0x7fb08c159bd0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 --2- 172.21.15.153:0/2625043080 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb08c0629b0 0x7fb08c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 >> 172.21.15.153:0/2625043080 conn(0x7fb08c0c7150 msgr2=0x7fb08c0c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:24.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 shutdown_connections 2023-08-17T00:07:24.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.203+0000 7fb09301b700 1 -- 172.21.15.153:0/2625043080 wait complete. 2023-08-17T00:07:24.214 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 55 2023-08-17T00:07:24.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.375+0000 7f683b4db700 1 Processor -- start 2023-08-17T00:07:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.375+0000 7f683b4db700 1 -- start start 2023-08-17T00:07:24.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f683b4db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f683b4db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68340629b0 0x7f68340bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f683b4db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6834065240 con 0x7f68340a8b70 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f683b4db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6834062e40 con 0x7f68340629b0 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f683b4db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340638a0 con 0x7f68340632e0 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68340629b0 0x7f68340bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68340629b0 0x7f68340bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45580/0 (socket says 172.21.15.153:45580) 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 -- 172.21.15.153:0/3869344122 learned_addr learned my addr 172.21.15.153:0/3869344122 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839277700 1 --1- 172.21.15.153:0/3869344122 >> v1:172.21.15.153:6789/0 conn(0x7f68340a8b70 0x7f68340656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44028/0 (socket says 172.21.15.153:44028) 2023-08-17T00:07:24.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6838a76700 1 --2- 172.21.15.153:0/3869344122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 -- 172.21.15.153:0/3869344122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 msgr2=0x7f68340a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:24.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 --2- 172.21.15.153:0/3869344122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 -- 172.21.15.153:0/3869344122 >> v1:172.21.15.153:6789/0 conn(0x7f68340a8b70 legacy=0x7f68340656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 -- 172.21.15.153:0/3869344122 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834065de0 con 0x7f68340629b0 2023-08-17T00:07:24.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f6839a78700 1 --2- 172.21.15.153:0/3869344122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340629b0 0x7f68340bbdc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f682c009f20 tx=0x7f682c009840).ready entity=mon.0 client_cookie=169325a0d2ca9c59 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f682bfff700 1 -- 172.21.15.153:0/3869344122 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00e070 con 0x7f68340629b0 2023-08-17T00:07:24.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f682bfff700 1 -- 172.21.15.153:0/3869344122 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00ba80 con 0x7f68340629b0 2023-08-17T00:07:24.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.379+0000 7f682bfff700 1 -- 172.21.15.153:0/3869344122 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c00be00 con 0x7f68340629b0 2023-08-17T00:07:24.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 -- 172.21.15.153:0/3869344122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340629b0 msgr2=0x7f68340bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 --2- 172.21.15.153:0/3869344122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340629b0 0x7f68340bbdc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f682c009f20 tx=0x7f682c009840).stop 2023-08-17T00:07:24.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 -- 172.21.15.153:0/3869344122 shutdown_connections 2023-08-17T00:07:24.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 --2- 172.21.15.153:0/3869344122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340629b0 0x7f68340bbdc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 --2- 172.21.15.153:0/3869344122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 -- 172.21.15.153:0/3869344122 >> 172.21.15.153:0/3869344122 conn(0x7f68340c7150 msgr2=0x7f68340c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 -- 172.21.15.153:0/3869344122 shutdown_connections 2023-08-17T00:07:24.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 -- 172.21.15.153:0/3869344122 wait complete. 2023-08-17T00:07:24.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 Processor -- start 2023-08-17T00:07:24.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.383+0000 7f683b4db700 1 -- start start 2023-08-17T00:07:24.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68340629b0 0x7f6834169010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 0x7f6834157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f683414fe00 con 0x7f68340a8b70 2023-08-17T00:07:24.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6834168b80 con 0x7f68340629b0 2023-08-17T00:07:24.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68340bfc00 con 0x7f68340632e0 2023-08-17T00:07:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 0x7f6834157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 0x7f6834157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45584/0 (socket says 172.21.15.153:45584) 2023-08-17T00:07:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 -- 172.21.15.153:0/4123177391 learned_addr learned my addr 172.21.15.153:0/4123177391 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839277700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68340629b0 0x7f6834169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6838a76700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 -- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 msgr2=0x7f68340be000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340be000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 -- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68340629b0 msgr2=0x7f6834169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68340629b0 0x7f6834169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 -- 172.21.15.153:0/4123177391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c009ae0 con 0x7f68340a8b70 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839277700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68340629b0 0x7f6834169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6838a76700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:24.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f6839a78700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 0x7f6834157620 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f683405e420 tx=0x7f682c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c007170 con 0x7f68340a8b70 2023-08-17T00:07:24.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c0092e0 con 0x7f68340a8b70 2023-08-17T00:07:24.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682c01d640 con 0x7f68340a8b70 2023-08-17T00:07:24.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68340bfe60 con 0x7f68340a8b70 2023-08-17T00:07:24.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6834168810 con 0x7f68340a8b70 2023-08-17T00:07:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.387+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6834168d10 con 0x7f68340a8b70 2023-08-17T00:07:24.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.391+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f682c01b040 con 0x7f68340a8b70 2023-08-17T00:07:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.391+0000 7f68297fa700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f681805a150 0x7f681805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.391+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f682c075de0 con 0x7f68340a8b70 2023-08-17T00:07:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.391+0000 7f6839277700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f681805a150 0x7f681805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.391+0000 7f6839277700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f681805a150 0x7f681805c610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f6830001610 tx=0x7f6830009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.395+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f682c049770 con 0x7f68340a8b70 2023-08-17T00:07:24.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.591+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6834064910 con 0x7f68340a8b70 2023-08-17T00:07:24.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.591+0000 7f68297fa700 1 -- 172.21.15.153:0/4123177391 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4497 (secure 0 0 0) 0x7f682c01c370 con 0x7f68340a8b70 2023-08-17T00:07:24.598 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:24.599 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:06:49.925811+0000","modified":"2023-08-17T00:07:08.392134+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6459},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6459":{"gid":6459,"name":"a","rank":0,"incarnation":52,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/287073699","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":287073699},{"type":"v1","addr":"172.21.15.153:6835","nonce":287073699}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-08-17T00:07:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f681805a150 msgr2=0x7f681805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f681805a150 0x7f681805c610 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f6830001610 tx=0x7f6830009040).stop 2023-08-17T00:07:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 msgr2=0x7f6834157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 0x7f6834157620 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f683405e420 tx=0x7f682c009840).stop 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 shutdown_connections 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f681805a150 0x7f681805c610 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68340a8b70 0x7f6834157620 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68340632e0 0x7f68340be000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 --2- 172.21.15.153:0/4123177391 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68340629b0 0x7f6834169010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 >> 172.21.15.153:0/4123177391 conn(0x7f68340c7150 msgr2=0x7f6834155200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:24.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 shutdown_connections 2023-08-17T00:07:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.595+0000 7f683b4db700 1 -- 172.21.15.153:0/4123177391 wait complete. 2023-08-17T00:07:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 55 2023-08-17T00:07:24.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:24.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.771+0000 7fab4dfb9700 1 Processor -- start 2023-08-17T00:07:24.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.771+0000 7fab4dfb9700 1 -- start start 2023-08-17T00:07:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.771+0000 7fab4dfb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab4815e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.771+0000 7fab4dfb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab48154e90 con 0x7fab480acf30 2023-08-17T00:07:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4dfb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab48153fc0 con 0x7fab480c5ea0 2023-08-17T00:07:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4dfb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c1730 con 0x7fab48063bc0 2023-08-17T00:07:24.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3ffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fab480c5ea0 0x7fab480634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:53406/0 (socket says 172.21.15.153:53406) 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3ffff700 1 -- 172.21.15.153:0/4155936189 learned_addr learned my addr 172.21.15.153:0/4155936189 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4cfb7700 1 --1- 172.21.15.153:0/4155936189 >> v1:172.21.15.153:6789/0 conn(0x7fab480acf30 0x7fab480c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44032/0 (socket says 172.21.15.153:44032) 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4d7b8700 1 --2- 172.21.15.153:0/4155936189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab4815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424484943 0 0) 0x7fab48153fc0 con 0x7fab480c5ea0 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab300033f0 con 0x7fab480c5ea0 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957284515 0 0) 0x7fab48154e90 con 0x7fab480acf30 2023-08-17T00:07:24.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab48153fc0 con 0x7fab480acf30 2023-08-17T00:07:24.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4d7b8700 1 -- 172.21.15.153:0/4155936189 >> v1:172.21.15.178:6789/0 conn(0x7fab480c5ea0 legacy=0x7fab480634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4d7b8700 1 -- 172.21.15.153:0/4155936189 >> v1:172.21.15.153:6789/0 conn(0x7fab480acf30 legacy=0x7fab480c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4d7b8700 1 -- 172.21.15.153:0/4155936189 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab48154280 con 0x7fab48063bc0 2023-08-17T00:07:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab4d7b8700 1 --2- 172.21.15.153:0/4155936189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab4815e660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fab40009e90 tx=0x7fab40009780).ready entity=mon.2 client_cookie=b05c4138b00d85ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000e070 con 0x7fab48063bc0 2023-08-17T00:07:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000bab0 con 0x7fab48063bc0 2023-08-17T00:07:24.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.775+0000 7fab3f7fe700 1 -- 172.21.15.153:0/4155936189 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000be30 con 0x7fab48063bc0 2023-08-17T00:07:24.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 -- 172.21.15.153:0/4155936189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 msgr2=0x7fab4815e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/4155936189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab4815e660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fab40009e90 tx=0x7fab40009780).stop 2023-08-17T00:07:24.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 -- 172.21.15.153:0/4155936189 shutdown_connections 2023-08-17T00:07:24.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/4155936189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab4815e660 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 -- 172.21.15.153:0/4155936189 >> 172.21.15.153:0/4155936189 conn(0x7fab480cb330 msgr2=0x7fab480c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:24.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 -- 172.21.15.153:0/4155936189 shutdown_connections 2023-08-17T00:07:24.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 -- 172.21.15.153:0/4155936189 wait complete. 2023-08-17T00:07:24.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.779+0000 7fab4dfb9700 1 Processor -- start 2023-08-17T00:07:24.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 -- start start 2023-08-17T00:07:24.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab480c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab480acf30 0x7fab48167dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 0x7fab480af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab481682c0 con 0x7fab48166a50 2023-08-17T00:07:24.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c1f10 con 0x7fab480acf30 2023-08-17T00:07:24.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c21f0 con 0x7fab48063bc0 2023-08-17T00:07:24.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 0x7fab480af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 0x7fab480af990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45594/0 (socket says 172.21.15.153:45594) 2023-08-17T00:07:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 -- 172.21.15.153:0/167901762 learned_addr learned my addr 172.21.15.153:0/167901762 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab3ffff700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab480acf30 0x7fab48167dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4cfb7700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab480c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 -- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 msgr2=0x7fab480c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab480c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 -- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab480acf30 msgr2=0x7fab48167dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab480acf30 0x7fab48167dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 -- 172.21.15.153:0/167901762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009a20 con 0x7fab48166a50 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4d7b8700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 0x7fab480af990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fab40011000 tx=0x7fab40009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40013e80 con 0x7fab48166a50 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4001d630 con 0x7fab48166a50 2023-08-17T00:07:24.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4001d9d0 con 0x7fab48166a50 2023-08-17T00:07:24.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.783+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab480c24d0 con 0x7fab48166a50 2023-08-17T00:07:24.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.787+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab48166eb0 con 0x7fab48166a50 2023-08-17T00:07:24.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.787+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4806b4c0 con 0x7fab48166a50 2023-08-17T00:07:24.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.787+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fab40026410 con 0x7fab48166a50 2023-08-17T00:07:24.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.791+0000 7fab3cff9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab3405a180 0x7fab3405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:24.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.791+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fab40076210 con 0x7fab48166a50 2023-08-17T00:07:24.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.791+0000 7fab4cfb7700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab3405a180 0x7fab3405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:24.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.791+0000 7fab4cfb7700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab3405a180 0x7fab3405c640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fab44007640 tx=0x7fab44007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:24.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.795+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab40049c50 con 0x7fab48166a50 2023-08-17T00:07:24.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.959+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab48154560 con 0x7fab48166a50 2023-08-17T00:07:24.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.959+0000 7fab3cff9700 1 -- 172.21.15.153:0/167901762 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+17109 (secure 0 0 0) 0x7fab4004d230 con 0x7fab48166a50 2023-08-17T00:07:24.967 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:24.968 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":67,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:04.081764+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:06:47.903453+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-08-17T00:06:48.933074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6834/1621445932":"2023-08-18T00:07:04.061533+0000","172.21.15.153:6832/1621445932":"2023-08-18T00:07:04.061533+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab3405a180 msgr2=0x7fab3405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab3405a180 0x7fab3405c640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7fab44007640 tx=0x7fab44007bc0).stop 2023-08-17T00:07:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 msgr2=0x7fab480af990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:24.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 0x7fab480af990 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7fab40011000 tx=0x7fab40009780).stop 2023-08-17T00:07:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 shutdown_connections 2023-08-17T00:07:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab3405a180 0x7fab3405c640 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab48166a50 0x7fab480af990 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab480acf30 0x7fab48167dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 --2- 172.21.15.153:0/167901762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab48063bc0 0x7fab480c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 >> 172.21.15.153:0/167901762 conn(0x7fab480cb330 msgr2=0x7fab480aa770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 shutdown_connections 2023-08-17T00:07:24.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:24.963+0000 7fab4dfb9700 1 -- 172.21.15.153:0/167901762 wait complete. 2023-08-17T00:07:24.989 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:07:25.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.139+0000 7f3f82969700 1 Processor -- start 2023-08-17T00:07:25.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.139+0000 7f3f82969700 1 -- start start 2023-08-17T00:07:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f82969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f7c151b90 0x7f3f7c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f82969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c061fa0 con 0x7f3f7c064870 2023-08-17T00:07:25.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f82969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c0621f0 con 0x7f3f7c063290 2023-08-17T00:07:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f82969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c0c3fb0 con 0x7f3f7c151b90 2023-08-17T00:07:25.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f7bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f7c151b90 0x7f3f7c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f7bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f7c151b90 0x7f3f7c151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40724/0 (socket says 172.21.15.153:40724) 2023-08-17T00:07:25.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f7bfff700 1 -- 172.21.15.153:0/1455905351 learned_addr learned my addr 172.21.15.153:0/1455905351 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:25.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f80f06700 1 --1- 172.21.15.153:0/1455905351 >> v1:172.21.15.153:6789/0 conn(0x7f3f7c064870 0x7f3f7c0a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:40992/0 (socket says 172.21.15.153:40992) 2023-08-17T00:07:25.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f7bfff700 1 -- 172.21.15.153:0/1455905351 >> v1:172.21.15.178:6789/0 conn(0x7f3f7c063290 legacy=0x7f3f7c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f7bfff700 1 -- 172.21.15.153:0/1455905351 >> v1:172.21.15.153:6789/0 conn(0x7f3f7c064870 legacy=0x7f3f7c0a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.143+0000 7f3f7bfff700 1 -- 172.21.15.153:0/1455905351 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c0624d0 con 0x7f3f7c151b90 2023-08-17T00:07:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f7bfff700 1 --2- 172.21.15.153:0/1455905351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c151f70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f3f6c006fd0 tx=0x7f3f6c0090f0).ready entity=mon.0 client_cookie=75318d743bb741a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f7b7fe700 1 -- 172.21.15.153:0/1455905351 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00b600 con 0x7f3f7c151b90 2023-08-17T00:07:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f7b7fe700 1 -- 172.21.15.153:0/1455905351 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00b760 con 0x7f3f7c151b90 2023-08-17T00:07:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f7b7fe700 1 -- 172.21.15.153:0/1455905351 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00bae0 con 0x7f3f7c151b90 2023-08-17T00:07:25.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 -- 172.21.15.153:0/1455905351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 msgr2=0x7f3f7c151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 --2- 172.21.15.153:0/1455905351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c151f70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7f3f6c006fd0 tx=0x7f3f6c0090f0).stop 2023-08-17T00:07:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 -- 172.21.15.153:0/1455905351 shutdown_connections 2023-08-17T00:07:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 --2- 172.21.15.153:0/1455905351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c151f70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 -- 172.21.15.153:0/1455905351 >> 172.21.15.153:0/1455905351 conn(0x7f3f7c0c7150 msgr2=0x7f3f7c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 -- 172.21.15.153:0/1455905351 shutdown_connections 2023-08-17T00:07:25.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.147+0000 7f3f82969700 1 -- 172.21.15.153:0/1455905351 wait complete. 2023-08-17T00:07:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 Processor -- start 2023-08-17T00:07:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 -- start start 2023-08-17T00:07:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f7c063290 0x7f3f7c146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f7c064870 0x7f3f7c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c1489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c148ea0 con 0x7f3f7c151b90 2023-08-17T00:07:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0bf3b0 con 0x7f3f7c064870 2023-08-17T00:07:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f82969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0bf840 con 0x7f3f7c063290 2023-08-17T00:07:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c1489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c1489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40734/0 (socket says 172.21.15.153:40734) 2023-08-17T00:07:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 -- 172.21.15.153:0/2827414129 learned_addr learned my addr 172.21.15.153:0/2827414129 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f737fe700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f7c064870 0x7f3f7c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f7bfff700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f7c063290 0x7f3f7c146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 -- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f7c063290 msgr2=0x7f3f7c146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f7c063290 0x7f3f7c146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 -- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f7c064870 msgr2=0x7f3f7c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f7c064870 0x7f3f7c1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.151+0000 7f3f80f06700 1 -- 172.21.15.153:0/2827414129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009370 con 0x7f3f7c151b90 2023-08-17T00:07:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f80f06700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c1489b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f3f7400c790 tx=0x7f3f740015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74005c70 con 0x7f3f7c151b90 2023-08-17T00:07:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f74005dd0 con 0x7f3f7c151b90 2023-08-17T00:07:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c0be7a0 con 0x7f3f7c151b90 2023-08-17T00:07:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74007320 con 0x7f3f7c151b90 2023-08-17T00:07:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c0bf040 con 0x7f3f7c151b90 2023-08-17T00:07:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c0bf520 con 0x7f3f7c151b90 2023-08-17T00:07:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.155+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3f74010030 con 0x7f3f7c151b90 2023-08-17T00:07:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.159+0000 7f3f78ff9700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.159+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f3f74073f50 con 0x7f3f7c151b90 2023-08-17T00:07:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.159+0000 7f3f7bfff700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.159+0000 7f3f7bfff700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f3f6c009130 tx=0x7f3f6c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:25.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.163+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f740a28f0 con 0x7f3f7c151b90 2023-08-17T00:07:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.359+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3f7c06b530 con 0x7f3f7c151b90 2023-08-17T00:07:25.418 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:07:25.411+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:07:25.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.419+0000 7f3f78ff9700 1 -- 172.21.15.153:0/2827414129 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3f740479b0 con 0x7f3f7c151b90 2023-08-17T00:07:25.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 msgr2=0x7f3f6005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f3f6c009130 tx=0x7f3f6c017000).stop 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 msgr2=0x7f3f7c1489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c1489b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7f3f7400c790 tx=0x7f3f740015e0).stop 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 shutdown_connections 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f7c151b90 0x7f3f7c1489b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f7c064870 0x7f3f7c1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 --2- 172.21.15.153:0/2827414129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f7c063290 0x7f3f7c146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 >> 172.21.15.153:0/2827414129 conn(0x7f3f7c0c7150 msgr2=0x7f3f7c150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:25.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 shutdown_connections 2023-08-17T00:07:25.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.423+0000 7f3f82969700 1 -- 172.21.15.153:0/2827414129 wait complete. 2023-08-17T00:07:25.431 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:07:25.434 INFO:tasks.ceph.mds.a.smithi153.stderr: -1681> 2023-08-17T00:07:10.380+0000 7f84f61a2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:07:25.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:07:25.478 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:07:25.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.595+0000 7f37ea307700 1 Processor -- start 2023-08-17T00:07:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37ea307700 1 -- start start 2023-08-17T00:07:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37ea307700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37e40c57a0 0x7f37e40c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37ea307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37e40c11b0 0x7f37e4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37ea307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e40bfd10 con 0x7f37e4153f50 2023-08-17T00:07:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37ea307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e4154860 con 0x7f37e40c11b0 2023-08-17T00:07:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37ea307700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e4154af0 con 0x7f37e40c57a0 2023-08-17T00:07:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37e9b06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37e40c11b0 0x7f37e4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37e9b06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37e40c11b0 0x7f37e4154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40748/0 (socket says 172.21.15.153:40748) 2023-08-17T00:07:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37e9b06700 1 -- 172.21.15.153:0/3996806684 learned_addr learned my addr 172.21.15.153:0/3996806684 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.599+0000 7f37e9305700 1 --2- 172.21.15.153:0/3996806684 >> v2:172.21.15.178:3300/0 conn(0x7f37e40c57a0 0x7f37e40c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37e9b06700 1 -- 172.21.15.153:0/3996806684 >> v2:172.21.15.178:3300/0 conn(0x7f37e40c57a0 msgr2=0x7f37e40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37e9b06700 1 --2- 172.21.15.153:0/3996806684 >> v2:172.21.15.178:3300/0 conn(0x7f37e40c57a0 0x7f37e40c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37e9b06700 1 -- 172.21.15.153:0/3996806684 >> v1:172.21.15.153:6789/0 conn(0x7f37e4153f50 legacy=0x7f37e4157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37e9b06700 1 -- 172.21.15.153:0/3996806684 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4154dd0 con 0x7f37e40c11b0 2023-08-17T00:07:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37e9b06700 1 --2- 172.21.15.153:0/3996806684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40c11b0 0x7f37e4154370 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f37e40c54c0 tx=0x7f37dc009840).ready entity=mon.0 client_cookie=4959e21532ad6ae8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:25.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37dbfff700 1 -- 172.21.15.153:0/3996806684 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00e070 con 0x7f37e40c11b0 2023-08-17T00:07:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37dbfff700 1 -- 172.21.15.153:0/3996806684 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc00ba20 con 0x7f37e40c11b0 2023-08-17T00:07:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37dbfff700 1 -- 172.21.15.153:0/3996806684 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00bda0 con 0x7f37e40c11b0 2023-08-17T00:07:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 -- 172.21.15.153:0/3996806684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40c11b0 msgr2=0x7f37e4154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 --2- 172.21.15.153:0/3996806684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40c11b0 0x7f37e4154370 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f37e40c54c0 tx=0x7f37dc009840).stop 2023-08-17T00:07:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 -- 172.21.15.153:0/3996806684 shutdown_connections 2023-08-17T00:07:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 --2- 172.21.15.153:0/3996806684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e40c11b0 0x7f37e4154370 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 --2- 172.21.15.153:0/3996806684 >> v2:172.21.15.178:3300/0 conn(0x7f37e40c57a0 0x7f37e40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 -- 172.21.15.153:0/3996806684 >> 172.21.15.153:0/3996806684 conn(0x7f37e4062a70 msgr2=0x7f37e40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 -- 172.21.15.153:0/3996806684 shutdown_connections 2023-08-17T00:07:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.603+0000 7f37ea307700 1 -- 172.21.15.153:0/3996806684 wait complete. 2023-08-17T00:07:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 Processor -- start 2023-08-17T00:07:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 -- start start 2023-08-17T00:07:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e40c11b0 0x7f37e4164700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e40c57a0 0x7f37e40ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 0x7f37e41658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e414ed60 con 0x7f37e4153f50 2023-08-17T00:07:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4165dc0 con 0x7f37e40c57a0 2023-08-17T00:07:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37ea307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e4164ca0 con 0x7f37e40c11b0 2023-08-17T00:07:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 0x7f37e41658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 0x7f37e41658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40764/0 (socket says 172.21.15.153:40764) 2023-08-17T00:07:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 -- 172.21.15.153:0/1891938513 learned_addr learned my addr 172.21.15.153:0/1891938513 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9305700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e40c11b0 0x7f37e4164700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e8b04700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e40c57a0 0x7f37e40ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 -- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e40c11b0 msgr2=0x7f37e4164700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e40c11b0 0x7f37e4164700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 -- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e40c57a0 msgr2=0x7f37e40ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e40c57a0 0x7f37e40ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.607+0000 7f37e9b06700 1 -- 172.21.15.153:0/1891938513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc009ae0 con 0x7f37e4153f50 2023-08-17T00:07:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37e9b06700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 0x7f37e41658d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f37dc00b6c0 tx=0x7f37dc009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc00bda0 con 0x7f37e4153f50 2023-08-17T00:07:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37dc0092e0 con 0x7f37e4153f50 2023-08-17T00:07:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37dc01d6b0 con 0x7f37e4153f50 2023-08-17T00:07:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e4164f80 con 0x7f37e4153f50 2023-08-17T00:07:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e4165540 con 0x7f37e4153f50 2023-08-17T00:07:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e40c4cc0 con 0x7f37e4153f50 2023-08-17T00:07:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.611+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f37dc024030 con 0x7f37e4153f50 2023-08-17T00:07:25.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.615+0000 7f37d97fa700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37c805a150 0x7f37c805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:25.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.615+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f37dc0755f0 con 0x7f37e4153f50 2023-08-17T00:07:25.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.615+0000 7f37e9305700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37c805a150 0x7f37c805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:25.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.615+0000 7f37e9305700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37c805a150 0x7f37c805c610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f37e4167c30 tx=0x7f37e0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.623+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37dc0490a0 con 0x7f37e4153f50 2023-08-17T00:07:25.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:25.819+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37e406b4c0 con 0x7f37e4153f50 2023-08-17T00:07:26.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.423+0000 7f37d97fa700 1 -- 172.21.15.153:0/1891938513 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7f37dc022020 con 0x7f37e4153f50 2023-08-17T00:07:26.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37c805a150 msgr2=0x7f37c805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37c805a150 0x7f37c805c610 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f37e4167c30 tx=0x7f37e0008040).stop 2023-08-17T00:07:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 msgr2=0x7f37e41658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 0x7f37e41658d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7f37dc00b6c0 tx=0x7f37dc009840).stop 2023-08-17T00:07:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 shutdown_connections 2023-08-17T00:07:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f37c805a150 0x7f37c805c610 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37e4153f50 0x7f37e41658d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e40c57a0 0x7f37e40ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 --2- 172.21.15.153:0/1891938513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e40c11b0 0x7f37e4164700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 >> 172.21.15.153:0/1891938513 conn(0x7f37e4062a70 msgr2=0x7f37e40c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 shutdown_connections 2023-08-17T00:07:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.427+0000 7f37ea307700 1 -- 172.21.15.153:0/1891938513 wait complete. 2023-08-17T00:07:26.455 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:07:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.663+0000 7f8766bf9700 1 Processor -- start 2023-08-17T00:07:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.663+0000 7f8766bf9700 1 -- start start 2023-08-17T00:07:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8766bf9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f87601539b0 0x7f87600632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8766bf9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600c00d0 con 0x7f8760153d90 2023-08-17T00:07:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8766bf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600bf810 con 0x7f87600a9eb0 2023-08-17T00:07:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8766bf9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600aa910 con 0x7f87601539b0 2023-08-17T00:07:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f87653f6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8760153d90 0x7f87600a97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41010/0 (socket says 172.21.15.153:41010) 2023-08-17T00:07:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f87653f6700 1 -- 172.21.15.153:0/2930621108 learned_addr learned my addr 172.21.15.153:0/2930621108 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2930621108 >> v2:172.21.15.178:3300/0 conn(0x7f87601539b0 0x7f87600632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777175072 0 0) 0x7f87600c00d0 con 0x7f8760153d90 2023-08-17T00:07:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f874c0033f0 con 0x7f8760153d90 2023-08-17T00:07:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193066059 0 0) 0x7f87600bf810 con 0x7f87600a9eb0 2023-08-17T00:07:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87600c00d0 con 0x7f87600a9eb0 2023-08-17T00:07:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2560014604 0 0) 0x7f874c0033f0 con 0x7f8760153d90 2023-08-17T00:07:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 >> v2:172.21.15.178:3300/0 conn(0x7f87601539b0 msgr2=0x7f87600632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 --2- 172.21.15.153:0/2930621108 >> v2:172.21.15.178:3300/0 conn(0x7f87601539b0 0x7f87600632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 >> v1:172.21.15.178:6789/0 conn(0x7f87600a9eb0 legacy=0x7f87600c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600bfa80 con 0x7f8760153d90 2023-08-17T00:07:26.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f8750001470 con 0x7f8760153d90 2023-08-17T00:07:26.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.667+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 >> v1:172.21.15.153:6789/0 conn(0x7f8760153d90 legacy=0x7f87600a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f874c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c004690 0x7f874c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c005000 0x7f874c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600aa910 con 0x7f874c003ac0 2023-08-17T00:07:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874c00bf60 con 0x7f874c004690 2023-08-17T00:07:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874c00c120 con 0x7f874c005000 2023-08-17T00:07:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f874c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f87653f6700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c004690 0x7f874c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f87663f8700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c005000 0x7f874c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 -- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c005000 msgr2=0x7f874c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f874c005000 0x7f874c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 -- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c004690 msgr2=0x7f874c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f874c004690 0x7f874c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 -- 172.21.15.153:0/2930621108 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874c0033f0 con 0x7f874c003ac0 2023-08-17T00:07:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f87663f8700 1 -- 172.21.15.153:0/2930621108 reap_dead start 2023-08-17T00:07:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f874c003ec0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f875c006fd0 tx=0x7f875c006f40).ready entity=mon.0 client_cookie=5ea30cf2cac37eea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c009430 con 0x7f874c003ac0 2023-08-17T00:07:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00e640 con 0x7f874c003ac0 2023-08-17T00:07:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8764bf5700 1 -- 172.21.15.153:0/2930621108 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c00e9c0 con 0x7f874c003ac0 2023-08-17T00:07:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 -- 172.21.15.153:0/2930621108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 msgr2=0x7f874c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f874c003ec0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f875c006fd0 tx=0x7f875c006f40).stop 2023-08-17T00:07:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 -- 172.21.15.153:0/2930621108 shutdown_connections 2023-08-17T00:07:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2930621108 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f874c003ec0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 -- 172.21.15.153:0/2930621108 >> 172.21.15.153:0/2930621108 conn(0x7f8760062a10 msgr2=0x7f87600ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 -- 172.21.15.153:0/2930621108 shutdown_connections 2023-08-17T00:07:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.671+0000 7f8766bf9700 1 -- 172.21.15.153:0/2930621108 wait complete. 2023-08-17T00:07:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 Processor -- start 2023-08-17T00:07:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 -- start start 2023-08-17T00:07:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f8760155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8760155850 0x7f8760156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8760156d30 0x7f8760151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760154550 con 0x7f874c003ac0 2023-08-17T00:07:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87601504d0 con 0x7f8760156d30 2023-08-17T00:07:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8766bf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8760150770 con 0x7f8760155850 2023-08-17T00:07:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f8760155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f8760155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40792/0 (socket says 172.21.15.153:40792) 2023-08-17T00:07:26.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 -- 172.21.15.153:0/2117101155 learned_addr learned my addr 172.21.15.153:0/2117101155 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:26.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f87663f8700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8760156d30 0x7f8760151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f87653f6700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8760155850 0x7f8760156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 -- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8760155850 msgr2=0x7f8760156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8760155850 0x7f8760156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 -- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8760156d30 msgr2=0x7f8760151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8760156d30 0x7f8760151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 -- 172.21.15.153:0/2117101155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760150a50 con 0x7f874c003ac0 2023-08-17T00:07:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f87663f8700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8760156d30 0x7f8760151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.675+0000 7f8765bf7700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f8760155360 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f875c00e4b0 tx=0x7f875c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c000c90 con 0x7f874c003ac0 2023-08-17T00:07:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875c00e7b0 con 0x7f874c003ac0 2023-08-17T00:07:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c01b6a0 con 0x7f874c003ac0 2023-08-17T00:07:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8760150d30 con 0x7f874c003ac0 2023-08-17T00:07:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87601512f0 con 0x7f874c003ac0 2023-08-17T00:07:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87601514e0 con 0x7f874c003ac0 2023-08-17T00:07:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.679+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f875c01ba10 con 0x7f874c003ac0 2023-08-17T00:07:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.683+0000 7f8755ffb700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f874405a180 0x7f874405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:26.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.683+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6293+0+0 (secure 0 0 0) 0x7f875c076040 con 0x7f874c003ac0 2023-08-17T00:07:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.683+0000 7f87653f6700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f874405a180 0x7f874405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.683+0000 7f87653f6700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f874405a180 0x7f874405c640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f8750000e10 tx=0x7f8750009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.687+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f875c0a48f0 con 0x7f874c003ac0 2023-08-17T00:07:26.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:26.851+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8760046dd0 con 0x7f874c003ac0 2023-08-17T00:07:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.431+0000 7f8755ffb700 1 -- 172.21.15.153:0/2117101155 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v69) v1 ==== 181+0+0 (secure 0 0 0) 0x7f875c016030 con 0x7f874c003ac0 2023-08-17T00:07:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f874405a180 msgr2=0x7f874405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f874405a180 0x7f874405c640 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f8750000e10 tx=0x7f8750009040).stop 2023-08-17T00:07:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 msgr2=0x7f8760155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:27.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f8760155360 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f875c00e4b0 tx=0x7f875c01a000).stop 2023-08-17T00:07:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 shutdown_connections 2023-08-17T00:07:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f874405a180 0x7f874405c640 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8760156d30 0x7f8760151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8760155850 0x7f8760156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 --2- 172.21.15.153:0/2117101155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f874c003ac0 0x7f8760155360 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 >> 172.21.15.153:0/2117101155 conn(0x7f8760062a10 msgr2=0x7f87600a97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 shutdown_connections 2023-08-17T00:07:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.435+0000 7f8766bf9700 1 -- 172.21.15.153:0/2117101155 wait complete. 2023-08-17T00:07:27.444 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:07:27.463 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:07:27.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.623+0000 7f29cb61b700 1 Processor -- start 2023-08-17T00:07:27.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.623+0000 7f29cb61b700 1 -- start start 2023-08-17T00:07:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29cb61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c41506d0 0x7f29c40c0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29cb61b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29c40c10b0 0x7f29c40630b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29cb61b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29c40c5f10 con 0x7f29c4150ab0 2023-08-17T00:07:27.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29cb61b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29c40c4250 con 0x7f29c40c10b0 2023-08-17T00:07:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29cb61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40669f0 con 0x7f29c41506d0 2023-08-17T00:07:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c8bb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f29c4150ab0 0x7f29c40c2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41020/0 (socket says 172.21.15.153:41020) 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c8bb6700 1 -- 172.21.15.153:0/429973040 learned_addr learned my addr 172.21.15.153:0/429973040 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c9bb8700 1 --2- 172.21.15.153:0/429973040 >> v2:172.21.15.178:3300/0 conn(0x7f29c40c10b0 0x7f29c40630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c93b7700 1 --2- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c41506d0 0x7f29c40c0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29bbfff700 1 -- 172.21.15.153:0/429973040 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652126007 0 0) 0x7f29c40c5f10 con 0x7f29c4150ab0 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29bbfff700 1 -- 172.21.15.153:0/429973040 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b00033f0 con 0x7f29c4150ab0 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c9bb8700 1 -- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c41506d0 msgr2=0x7f29c40c0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c9bb8700 1 --2- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c41506d0 0x7f29c40c0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c9bb8700 1 -- 172.21.15.153:0/429973040 >> v1:172.21.15.153:6789/0 conn(0x7f29c4150ab0 legacy=0x7f29c40c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:27.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.627+0000 7f29c9bb8700 1 -- 172.21.15.153:0/429973040 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4066150 con 0x7f29c40c10b0 2023-08-17T00:07:27.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29c9bb8700 1 --2- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c40c10b0 0x7f29c40630b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f29bc009e60 tx=0x7f29bc009780).ready entity=mon.1 client_cookie=d67dc8be5e18ef12 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29bbfff700 1 -- 172.21.15.153:0/429973040 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00e070 con 0x7f29c40c10b0 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29bbfff700 1 -- 172.21.15.153:0/429973040 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc00bab0 con 0x7f29c40c10b0 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29bbfff700 1 -- 172.21.15.153:0/429973040 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc00be30 con 0x7f29c40c10b0 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 -- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c40c10b0 msgr2=0x7f29c40630b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 --2- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c40c10b0 0x7f29c40630b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f29bc009e60 tx=0x7f29bc009780).stop 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 -- 172.21.15.153:0/429973040 shutdown_connections 2023-08-17T00:07:27.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 --2- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c40c10b0 0x7f29c40630b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 --2- 172.21.15.153:0/429973040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c41506d0 0x7f29c40c0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 -- 172.21.15.153:0/429973040 >> 172.21.15.153:0/429973040 conn(0x7f29c40c7090 msgr2=0x7f29c40c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 -- 172.21.15.153:0/429973040 shutdown_connections 2023-08-17T00:07:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 -- 172.21.15.153:0/429973040 wait complete. 2023-08-17T00:07:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 Processor -- start 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.631+0000 7f29cb61b700 1 -- start start 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c40c10b0 0x7f29c414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 0x7f29c414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c4150ab0 0x7f29c4152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c414b7d0 con 0x7f29c41506d0 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29c40ab8f0 con 0x7f29c4150ab0 2023-08-17T00:07:27.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c414ad40 con 0x7f29c40c10b0 2023-08-17T00:07:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 0x7f29c414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 0x7f29c414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40794/0 (socket says 172.21.15.153:40794) 2023-08-17T00:07:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 -- 172.21.15.153:0/1961011784 learned_addr learned my addr 172.21.15.153:0/1961011784 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c9bb8700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c4150ab0 0x7f29c4152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:27.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c93b7700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c40c10b0 0x7f29c414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 -- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c40c10b0 msgr2=0x7f29c414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c40c10b0 0x7f29c414aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 -- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c4150ab0 msgr2=0x7f29c4152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c4150ab0 0x7f29c4152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 -- 172.21.15.153:0/1961011784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc009a20 con 0x7f29c41506d0 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c93b7700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c40c10b0 0x7f29c414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29c8bb6700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 0x7f29c414a850 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f29b400c410 tx=0x7f29b4007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400ce30 con 0x7f29c41506d0 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b40072e0 con 0x7f29c41506d0 2023-08-17T00:07:27.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c40aa850 con 0x7f29c41506d0 2023-08-17T00:07:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b40057a0 con 0x7f29c41506d0 2023-08-17T00:07:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.635+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29c40aae10 con 0x7f29c41506d0 2023-08-17T00:07:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.639+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29c406b530 con 0x7f29c41506d0 2023-08-17T00:07:27.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.639+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f29b4010070 con 0x7f29c41506d0 2023-08-17T00:07:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.639+0000 7f29b97fa700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29a805a120 0x7f29a805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:27.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.639+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5855+0+0 (secure 0 0 0) 0x7f29b4073730 con 0x7f29c41506d0 2023-08-17T00:07:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.639+0000 7f29c93b7700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29a805a120 0x7f29a805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:27.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.643+0000 7f29c93b7700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29a805a120 0x7f29a805c5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f29c0009c00 tx=0x7f29c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:27.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.647+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29b4047260 con 0x7f29c41506d0 2023-08-17T00:07:27.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:27.807+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f29c4066430 con 0x7f29c41506d0 2023-08-17T00:07:28.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.427+0000 7f29b97fa700 1 -- 172.21.15.153:0/1961011784 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v70) v1 ==== 169+0+0 (secure 0 0 0) 0x7f29b404a880 con 0x7f29c41506d0 2023-08-17T00:07:28.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.431+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29a805a120 msgr2=0x7f29a805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.431+0000 7f29cb61b700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29a805a120 0x7f29a805c5e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f29c0009c00 tx=0x7f29c0008040).stop 2023-08-17T00:07:28.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.431+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 msgr2=0x7f29c414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.431+0000 7f29cb61b700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 0x7f29c414a850 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f29b400c410 tx=0x7f29b4007bd0).stop 2023-08-17T00:07:28.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 shutdown_connections 2023-08-17T00:07:28.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29a805a120 0x7f29a805c5e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c4150ab0 0x7f29c4152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29c41506d0 0x7f29c414a850 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 --2- 172.21.15.153:0/1961011784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29c40c10b0 0x7f29c414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 >> 172.21.15.153:0/1961011784 conn(0x7f29c40c7090 msgr2=0x7f29c40bb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:28.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 shutdown_connections 2023-08-17T00:07:28.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.435+0000 7f29cb61b700 1 -- 172.21.15.153:0/1961011784 wait complete. 2023-08-17T00:07:28.443 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:07:28.462 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:07:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898b59e700 1 Processor -- start 2023-08-17T00:07:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898b59e700 1 -- start start 2023-08-17T00:07:28.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f898c154370 0x7f898c0c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c0bfd10 con 0x7f898c153f50 2023-08-17T00:07:28.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c154af0 con 0x7f898c0c57a0 2023-08-17T00:07:28.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c154dd0 con 0x7f898c154370 2023-08-17T00:07:28.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f8989d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f898c153f50 0x7f898c0c01a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41034/0 (socket says 172.21.15.153:41034) 2023-08-17T00:07:28.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f8989d9b700 1 -- 172.21.15.153:0/498242409 learned_addr learned my addr 172.21.15.153:0/498242409 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:28.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.615+0000 7f898ad9d700 1 --2- 172.21.15.153:0/498242409 >> v2:172.21.15.178:3300/0 conn(0x7f898c154370 0x7f898c0c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489182561 0 0) 0x7f898c0bfd10 con 0x7f898c153f50 2023-08-17T00:07:28.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89740033f0 con 0x7f898c153f50 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268544004 0 0) 0x7f898c154af0 con 0x7f898c0c57a0 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898c0bfd10 con 0x7f898c0c57a0 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2388612952 0 0) 0x7f89740033f0 con 0x7f898c153f50 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 >> v2:172.21.15.178:3300/0 conn(0x7f898c154370 msgr2=0x7f898c0c08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 --2- 172.21.15.153:0/498242409 >> v2:172.21.15.178:3300/0 conn(0x7f898c154370 0x7f898c0c08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 >> v1:172.21.15.178:6789/0 conn(0x7f898c0c57a0 legacy=0x7f898c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0bf9a0 con 0x7f898c153f50 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f8980001470 con 0x7f898c153f50 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898ad9d700 1 --2- 172.21.15.153:0/498242409 >> v2:172.21.15.178:3300/0 conn(0x7f898c154370 0x7f898c0c08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 >> v1:172.21.15.153:6789/0 conn(0x7f898c153f50 legacy=0x7f898c0c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8974003a70 0x7f8974003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f8974004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8974005000 0x7f897400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c154dd0 con 0x7f8974005000 2023-08-17T00:07:28.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f897400bf60 con 0x7f8974004690 2023-08-17T00:07:28.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f897400c0d0 con 0x7f8974003a70 2023-08-17T00:07:28.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898ad9d700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8974005000 0x7f897400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f8974004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898a59c700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8974003a70 0x7f8974003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 -- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8974003a70 msgr2=0x7f8974003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:28.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8974003a70 0x7f8974003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 -- 172.21.15.153:0/498242409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8974005000 msgr2=0x7f897400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8974005000 0x7f897400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 -- 172.21.15.153:0/498242409 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89740033f0 con 0x7f8974004690 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898ad9d700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8974005000 0x7f897400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898ad9d700 1 -- 172.21.15.153:0/498242409 reap_dead start 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f8989d9b700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f8974004b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f898000c110 tx=0x7f8980001e10).ready entity=mon.1 client_cookie=d61a23f4c3f82fed server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:28.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898000ca00 con 0x7f8974004690 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898000cb60 con 0x7f8974004690 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.619+0000 7f898959a700 1 -- 172.21.15.153:0/498242409 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89800070d0 con 0x7f8974004690 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 -- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 msgr2=0x7f8974004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f8974004b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f898000c110 tx=0x7f8980001e10).stop 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 -- 172.21.15.153:0/498242409 shutdown_connections 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 --2- 172.21.15.153:0/498242409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f8974004b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 -- 172.21.15.153:0/498242409 >> 172.21.15.153:0/498242409 conn(0x7f898c062a70 msgr2=0x7f898c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:28.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 -- 172.21.15.153:0/498242409 shutdown_connections 2023-08-17T00:07:28.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 -- 172.21.15.153:0/498242409 wait complete. 2023-08-17T00:07:28.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.623+0000 7f898b59e700 1 Processor -- start 2023-08-17T00:07:28.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 -- start start 2023-08-17T00:07:28.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f898c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f898c0ca0c0 0x7f898c0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 0x7f898c0c3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0caa30 con 0x7f898c0c2cf0 2023-08-17T00:07:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0c3a60 con 0x7f8974004690 2023-08-17T00:07:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0c3d40 con 0x7f898c0ca0c0 2023-08-17T00:07:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 0x7f898c0c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 0x7f898c0c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40800/0 (socket says 172.21.15.153:40800) 2023-08-17T00:07:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 -- 172.21.15.153:0/1443143339 learned_addr learned my addr 172.21.15.153:0/1443143339 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:28.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898a59c700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f898c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f8989d9b700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f898c0ca0c0 0x7f898c0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 -- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f898c0ca0c0 msgr2=0x7f898c0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f898c0ca0c0 0x7f898c0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 -- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 msgr2=0x7f898c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f898c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 -- 172.21.15.153:0/1443143339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0c4020 con 0x7f898c0c2cf0 2023-08-17T00:07:28.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898ad9d700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 0x7f898c0c3150 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f898c06a3b0 tx=0x7f898400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:28.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898400e040 con 0x7f898c0c2cf0 2023-08-17T00:07:28.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898400f040 con 0x7f898c0c2cf0 2023-08-17T00:07:28.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c0c4300 con 0x7f898c0c2cf0 2023-08-17T00:07:28.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8984015450 con 0x7f898c0c2cf0 2023-08-17T00:07:28.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.627+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c1521d0 con 0x7f898c0c2cf0 2023-08-17T00:07:28.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.631+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c06b4c0 con 0x7f898c0c2cf0 2023-08-17T00:07:28.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.631+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8984015800 con 0x7f898c0c2cf0 2023-08-17T00:07:28.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.635+0000 7f897a7fc700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f896c05a180 0x7f896c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:28.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.635+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f8984074b60 con 0x7f898c0c2cf0 2023-08-17T00:07:28.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.635+0000 7f898a59c700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f896c05a180 0x7f896c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:28.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.635+0000 7f898a59c700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f896c05a180 0x7f896c05c640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f898c0a9630 tx=0x7f897c007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:28.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.639+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8984048850 con 0x7f898c0c2cf0 2023-08-17T00:07:28.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.803+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f898c1547e0 con 0x7f898c0c2cf0 2023-08-17T00:07:28.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.811+0000 7f897a7fc700 1 -- 172.21.15.153:0/1443143339 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f898404be70 con 0x7f898c0c2cf0 2023-08-17T00:07:28.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f896c05a180 msgr2=0x7f896c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f896c05a180 0x7f896c05c640 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f898c0a9630 tx=0x7f897c007bb0).stop 2023-08-17T00:07:28.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 msgr2=0x7f898c0c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 0x7f898c0c3150 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f898c06a3b0 tx=0x7f898400b040).stop 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 shutdown_connections 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f896c05a180 0x7f896c05c640 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f898c0c2cf0 0x7f898c0c3150 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f898c0ca0c0 0x7f898c0ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 --2- 172.21.15.153:0/1443143339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8974004690 0x7f898c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 >> 172.21.15.153:0/1443143339 conn(0x7f898c062a70 msgr2=0x7f898c0aba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 shutdown_connections 2023-08-17T00:07:28.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.815+0000 7f898b59e700 1 -- 172.21.15.153:0/1443143339 wait complete. 2023-08-17T00:07:28.841 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2023-08-17T00:07:28.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 Processor -- start 2023-08-17T00:07:28.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 -- start start 2023-08-17T00:07:28.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f700689c0 0x7f7f70068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f70151530 0x7f7f701519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f70065da0 con 0x7f7f701560f0 2023-08-17T00:07:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f70155c60 con 0x7f7f70151530 2023-08-17T00:07:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.991+0000 7f7f74e79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70156550 con 0x7f7f700689c0 2023-08-17T00:07:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f70151530 0x7f7f701519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f70151530 0x7f7f701519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40802/0 (socket says 172.21.15.153:40802) 2023-08-17T00:07:29.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 -- 172.21.15.153:0/987079922 learned_addr learned my addr 172.21.15.153:0/987079922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:29.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6f7fe700 1 --2- 172.21.15.153:0/987079922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f700689c0 0x7f7f70068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 -- 172.21.15.153:0/987079922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f700689c0 msgr2=0x7f7f70068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:29.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 --2- 172.21.15.153:0/987079922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f700689c0 0x7f7f70068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 -- 172.21.15.153:0/987079922 >> v1:172.21.15.178:6789/0 conn(0x7f7f701560f0 legacy=0x7f7f700c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 -- 172.21.15.153:0/987079922 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70065ff0 con 0x7f7f70151530 2023-08-17T00:07:29.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6ffff700 1 --2- 172.21.15.153:0/987079922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f701519e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f7f68009f50 tx=0x7f7f68009840).ready entity=mon.0 client_cookie=7f0df8e560692d69 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:29.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6effd700 1 -- 172.21.15.153:0/987079922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800e070 con 0x7f7f70151530 2023-08-17T00:07:29.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6effd700 1 -- 172.21.15.153:0/987079922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6800b9c0 con 0x7f7f70151530 2023-08-17T00:07:29.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f6effd700 1 -- 172.21.15.153:0/987079922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6800bd40 con 0x7f7f70151530 2023-08-17T00:07:29.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 -- 172.21.15.153:0/987079922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 msgr2=0x7f7f701519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 --2- 172.21.15.153:0/987079922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f701519e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7f7f68009f50 tx=0x7f7f68009840).stop 2023-08-17T00:07:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 -- 172.21.15.153:0/987079922 shutdown_connections 2023-08-17T00:07:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 --2- 172.21.15.153:0/987079922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f701519e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 --2- 172.21.15.153:0/987079922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f700689c0 0x7f7f70068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 -- 172.21.15.153:0/987079922 >> 172.21.15.153:0/987079922 conn(0x7f7f700c6620 msgr2=0x7f7f700c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 -- 172.21.15.153:0/987079922 shutdown_connections 2023-08-17T00:07:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.995+0000 7f7f74e79700 1 -- 172.21.15.153:0/987079922 wait complete. 2023-08-17T00:07:29.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 Processor -- start 2023-08-17T00:07:29.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 -- start start 2023-08-17T00:07:29.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f700689c0 0x7f7f70141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f7009f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f701560f0 0x7f7f7009f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7009fe40 con 0x7f7f70151530 2023-08-17T00:07:29.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70153540 con 0x7f7f700689c0 2023-08-17T00:07:29.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:28.999+0000 7f7f74e79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f70142100 con 0x7f7f701560f0 2023-08-17T00:07:29.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f7009f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f7009f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40810/0 (socket says 172.21.15.153:40810) 2023-08-17T00:07:29.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 -- 172.21.15.153:0/345698559 learned_addr learned my addr 172.21.15.153:0/345698559 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f6f7fe700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f700689c0 0x7f7f70141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f6ffff700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f701560f0 0x7f7f7009f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 -- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f701560f0 msgr2=0x7f7f7009f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f701560f0 0x7f7f7009f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 -- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f700689c0 msgr2=0x7f7f70141c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f700689c0 0x7f7f70141c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 -- 172.21.15.153:0/345698559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68009ae0 con 0x7f7f70151530 2023-08-17T00:07:29.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f67fff700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f7009f460 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f7f5800c4c0 tx=0x7f7f58007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:29.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5800ce10 con 0x7f7f70151530 2023-08-17T00:07:29.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f58007020 con 0x7f7f70151530 2023-08-17T00:07:29.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f70152930 con 0x7f7f70151530 2023-08-17T00:07:29.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f580073c0 con 0x7f7f70151530 2023-08-17T00:07:29.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f70152ef0 con 0x7f7f70151530 2023-08-17T00:07:29.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.003+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f701536b0 con 0x7f7f70151530 2023-08-17T00:07:29.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.007+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7f58010070 con 0x7f7f70151530 2023-08-17T00:07:29.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.007+0000 7f7f677fe700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f5005a150 0x7f7f5005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.007+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f7f58073080 con 0x7f7f70151530 2023-08-17T00:07:29.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.007+0000 7f7f6f7fe700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f5005a150 0x7f7f5005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.011+0000 7f7f6f7fe700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f5005a150 0x7f7f5005c610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7f700c6f00 tx=0x7f7f60006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:29.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.015+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f580a18f0 con 0x7f7f70151530 2023-08-17T00:07:29.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.227+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f7f700662d0 con 0x7f7f70151530 2023-08-17T00:07:29.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.435+0000 7f7f677fe700 1 -- 172.21.15.153:0/345698559 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v241) v1 ==== 143+0+0 (secure 0 0 0) 0x7f7f58046cc0 con 0x7f7f70151530 2023-08-17T00:07:29.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f5005a150 msgr2=0x7f7f5005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f5005a150 0x7f7f5005c610 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f7f700c6f00 tx=0x7f7f60006f40).stop 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 msgr2=0x7f7f7009f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f7009f460 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7f7f5800c4c0 tx=0x7f7f58007dd0).stop 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 shutdown_connections 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f5005a150 0x7f7f5005c610 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f701560f0 0x7f7f7009f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f70151530 0x7f7f7009f460 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 --2- 172.21.15.153:0/345698559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f700689c0 0x7f7f70141c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 >> 172.21.15.153:0/345698559 conn(0x7f7f700c6620 msgr2=0x7f7f70061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:29.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 shutdown_connections 2023-08-17T00:07:29.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.439+0000 7f7f74e79700 1 -- 172.21.15.153:0/345698559 wait complete. 2023-08-17T00:07:29.468 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2023-08-17T00:07:29.469 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-08-17T00:07:29.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2023-08-17T00:07:29.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.627+0000 7f06ae49b700 1 Processor -- start 2023-08-17T00:07:29.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.627+0000 7f06ae49b700 1 -- start start 2023-08-17T00:07:29.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06ae49b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8151f70 0x7f06a8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06ae49b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a8061fa0 con 0x7f06a8065b50 2023-08-17T00:07:29.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06ae49b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a81523d0 con 0x7f06a8151b90 2023-08-17T00:07:29.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06ae49b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a80c3fb0 con 0x7f06a8151f70 2023-08-17T00:07:29.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06aca38700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f06a8065b50 0x7f06a8064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41048/0 (socket says 172.21.15.153:41048) 2023-08-17T00:07:29.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06aca38700 1 -- 172.21.15.153:0/2142426391 learned_addr learned my addr 172.21.15.153:0/2142426391 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:29.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f069f7fe700 1 --2- 172.21.15.153:0/2142426391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8151f70 0x7f06a8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818973073 0 0) 0x7f06a81523d0 con 0x7f06a8151b90 2023-08-17T00:07:29.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06940033f0 con 0x7f06a8151b90 2023-08-17T00:07:29.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124234578 0 0) 0x7f06a8061fa0 con 0x7f06a8065b50 2023-08-17T00:07:29.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06a81523d0 con 0x7f06a8065b50 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f069f7fe700 1 -- 172.21.15.153:0/2142426391 >> v1:172.21.15.178:6789/0 conn(0x7f06a8151b90 legacy=0x7f06a8063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f069f7fe700 1 -- 172.21.15.153:0/2142426391 >> v1:172.21.15.153:6789/0 conn(0x7f06a8065b50 legacy=0x7f06a8064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.631+0000 7f069f7fe700 1 -- 172.21.15.153:0/2142426391 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a80621f0 con 0x7f06a8151f70 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f069f7fe700 1 --2- 172.21.15.153:0/2142426391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8151f70 0x7f06a8065660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0690009790 tx=0x7f0690009060).ready entity=mon.2 client_cookie=c4dbfc5279b881c4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06900090d0 con 0x7f06a8151f70 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000f510 con 0x7f06a8151f70 2023-08-17T00:07:29.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06a77fe700 1 -- 172.21.15.153:0/2142426391 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000f890 con 0x7f06a8151f70 2023-08-17T00:07:29.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 -- 172.21.15.153:0/2142426391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8151f70 msgr2=0x7f06a8065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 --2- 172.21.15.153:0/2142426391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8151f70 0x7f06a8065660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f0690009790 tx=0x7f0690009060).stop 2023-08-17T00:07:29.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 -- 172.21.15.153:0/2142426391 shutdown_connections 2023-08-17T00:07:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 --2- 172.21.15.153:0/2142426391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8151f70 0x7f06a8065660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 -- 172.21.15.153:0/2142426391 >> 172.21.15.153:0/2142426391 conn(0x7f06a80c7150 msgr2=0x7f06a80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 -- 172.21.15.153:0/2142426391 shutdown_connections 2023-08-17T00:07:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 -- 172.21.15.153:0/2142426391 wait complete. 2023-08-17T00:07:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.635+0000 7f06ae49b700 1 Processor -- start 2023-08-17T00:07:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 -- start start 2023-08-17T00:07:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8065b50 0x7f06a814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 0x7f06a8169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8151f70 0x7f06a80aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a816a9a0 con 0x7f06a8151b90 2023-08-17T00:07:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a814fc50 con 0x7f06a8151f70 2023-08-17T00:07:29.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a8169850 con 0x7f06a8065b50 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 0x7f06a8169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 0x7f06a8169360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40814/0 (socket says 172.21.15.153:40814) 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 -- 172.21.15.153:0/1969382753 learned_addr learned my addr 172.21.15.153:0/1969382753 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06aca38700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8151f70 0x7f06a80aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06a7fff700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8065b50 0x7f06a814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 -- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8065b50 msgr2=0x7f06a814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8065b50 0x7f06a814f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 -- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8151f70 msgr2=0x7f06a80aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8151f70 0x7f06a80aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 -- 172.21.15.153:0/1969382753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900092a0 con 0x7f06a8151b90 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f069f7fe700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 0x7f06a8169360 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f06a805e420 tx=0x7f0690017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069000f890 con 0x7f06a8151b90 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000fc50 con 0x7f06a8151b90 2023-08-17T00:07:29.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069001b410 con 0x7f06a8151b90 2023-08-17T00:07:29.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a8169ab0 con 0x7f06a8151b90 2023-08-17T00:07:29.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.639+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a816a070 con 0x7f06a8151b90 2023-08-17T00:07:29.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.643+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a816ab10 con 0x7f06a8151b90 2023-08-17T00:07:29.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.643+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f069002b070 con 0x7f06a8151b90 2023-08-17T00:07:29.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.647+0000 7f06a4ff9700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f068805a150 0x7f068805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:29.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.647+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f06900754f0 con 0x7f06a8151b90 2023-08-17T00:07:29.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.647+0000 7f06a7fff700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f068805a150 0x7f068805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:29.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.647+0000 7f06a7fff700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f068805a150 0x7f068805c610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f06a80ab8b0 tx=0x7f0698009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:29.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.651+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0690049170 con 0x7f06a8151b90 2023-08-17T00:07:29.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:29.883+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f06a806b530 con 0x7f06a8151b90 2023-08-17T00:07:30.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.439+0000 7f06a4ff9700 1 -- 172.21.15.153:0/1969382753 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v242) v1 ==== 161+0+0 (secure 0 0 0) 0x7f06900290e0 con 0x7f06a8151b90 2023-08-17T00:07:30.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f068805a150 msgr2=0x7f068805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f068805a150 0x7f068805c610 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f06a80ab8b0 tx=0x7f0698009040).stop 2023-08-17T00:07:30.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 msgr2=0x7f06a8169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 0x7f06a8169360 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7f06a805e420 tx=0x7f0690017000).stop 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 shutdown_connections 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f068805a150 0x7f068805c610 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a8151f70 0x7f06a80aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06a8151b90 0x7f06a8169360 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 --2- 172.21.15.153:0/1969382753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a8065b50 0x7f06a814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 >> 172.21.15.153:0/1969382753 conn(0x7f06a80c7150 msgr2=0x7f06a8151480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 shutdown_connections 2023-08-17T00:07:30.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.443+0000 7f06ae49b700 1 -- 172.21.15.153:0/1969382753 wait complete. 2023-08-17T00:07:30.473 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:07:30.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97fa839700 1 Processor -- start 2023-08-17T00:07:30.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97fa839700 1 -- start start 2023-08-17T00:07:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97fa839700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 0x7f97f40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97fa839700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f41585a0 con 0x7f97f4068820 2023-08-17T00:07:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97fa839700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f4066400 con 0x7f97f40aa6e0 2023-08-17T00:07:30.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97fa839700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4062dc0 con 0x7f97f40a8df0 2023-08-17T00:07:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97f9036700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f97f4068820 0x7f97f4061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41054/0 (socket says 172.21.15.153:41054) 2023-08-17T00:07:30.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.631+0000 7f97f9036700 1 -- 172.21.15.153:0/155246990 learned_addr learned my addr 172.21.15.153:0/155246990 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f9837700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 0x7f97f40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130993643 0 0) 0x7f97f41585a0 con 0x7f97f4068820 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e00033f0 con 0x7f97f4068820 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477008153 0 0) 0x7f97e00033f0 con 0x7f97f4068820 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 msgr2=0x7f97f40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 0x7f97f40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 >> v1:172.21.15.178:6789/0 conn(0x7f97f40aa6e0 legacy=0x7f97f40626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40b9d30 con 0x7f97f4068820 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f97e4001470 con 0x7f97f4068820 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 >> v1:172.21.15.153:6789/0 conn(0x7f97f4068820 legacy=0x7f97f4061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e0003910 0x7f97e0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 0x7f97e0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e0004b80 0x7f97e0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f4062dc0 con 0x7f97e0004b80 2023-08-17T00:07:30.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e000b910 con 0x7f97e0003910 2023-08-17T00:07:30.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e000bad0 con 0x7f97f40a8df0 2023-08-17T00:07:30.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e0004b80 0x7f97e0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f9837700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e0003910 0x7f97e0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f9036700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 0x7f97e0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 -- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 msgr2=0x7f97e0004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f40a8df0 0x7f97e0004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 -- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e0003910 msgr2=0x7f97e0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e0003910 0x7f97e0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 -- 172.21.15.153:0/155246990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e00033f0 con 0x7f97e0004b80 2023-08-17T00:07:30.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97fa038700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e0004b80 0x7f97e0005000 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f97ec001e30 tx=0x7f97ec007f30).ready entity=mon.0 client_cookie=5ff9e1ad1cb86db3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec006a20 con 0x7f97e0004b80 2023-08-17T00:07:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec006b80 con 0x7f97e0004b80 2023-08-17T00:07:30.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.635+0000 7f97f8835700 1 -- 172.21.15.153:0/155246990 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00c5d0 con 0x7f97e0004b80 2023-08-17T00:07:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 -- 172.21.15.153:0/155246990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e0004b80 msgr2=0x7f97e0005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 --2- 172.21.15.153:0/155246990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97e0004b80 0x7f97e0005000 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7f97ec001e30 tx=0x7f97ec007f30).stop 2023-08-17T00:07:30.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa038700 1 -- 172.21.15.153:0/155246990 reap_dead start 2023-08-17T00:07:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 -- 172.21.15.153:0/155246990 shutdown_connections 2023-08-17T00:07:30.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 -- 172.21.15.153:0/155246990 >> 172.21.15.153:0/155246990 conn(0x7f97f40c6620 msgr2=0x7f97f40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:30.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 -- 172.21.15.153:0/155246990 shutdown_connections 2023-08-17T00:07:30.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 -- 172.21.15.153:0/155246990 wait complete. 2023-08-17T00:07:30.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 Processor -- start 2023-08-17T00:07:30.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.639+0000 7f97fa839700 1 -- start start 2023-08-17T00:07:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 0x7f97f40bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f415b020 0x7f97f40b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f416ba70 0x7f97f416beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40bf950 con 0x7f97f415ac40 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f40ba3b0 con 0x7f97f415b020 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f415b480 con 0x7f97f416ba70 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 0x7f97f40bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 0x7f97f40bcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40828/0 (socket says 172.21.15.153:40828) 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 -- 172.21.15.153:0/3824102448 learned_addr learned my addr 172.21.15.153:0/3824102448 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:30.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa038700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f416ba70 0x7f97f416beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9036700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f415b020 0x7f97f40b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 -- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f416ba70 msgr2=0x7f97f416beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f416ba70 0x7f97f416beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 -- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f415b020 msgr2=0x7f97f40b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f415b020 0x7f97f40b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 -- 172.21.15.153:0/3824102448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f416c3a0 con 0x7f97f415ac40 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa038700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f416ba70 0x7f97f416beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9036700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f415b020 0x7f97f40b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97f9837700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 0x7f97f40bcf50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f97f00119f0 tx=0x7f97f0006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000f940 con 0x7f97f415ac40 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f000faa0 con 0x7f97f415ac40 2023-08-17T00:07:30.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f40ba630 con 0x7f97f415ac40 2023-08-17T00:07:30.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f000fe20 con 0x7f97f415ac40 2023-08-17T00:07:30.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.643+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f40bf300 con 0x7f97f415ac40 2023-08-17T00:07:30.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.647+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f406b4c0 con 0x7f97f415ac40 2023-08-17T00:07:30.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.647+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f97f0024070 con 0x7f97f415ac40 2023-08-17T00:07:30.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.651+0000 7f97e9ffb700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97d805a150 0x7f97d805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:30.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.651+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f97f00747e0 con 0x7f97f415ac40 2023-08-17T00:07:30.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.651+0000 7f97f9036700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97d805a150 0x7f97d805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:30.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.651+0000 7f97f9036700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97d805a150 0x7f97d805c610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f97e40010e0 tx=0x7f97e4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:30.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.655+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f97f00483c0 con 0x7f97f415ac40 2023-08-17T00:07:30.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.823+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f97f4064010 con 0x7f97f415ac40 2023-08-17T00:07:30.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.831+0000 7f97e9ffb700 1 -- 172.21.15.153:0/3824102448 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97f0022070 con 0x7f97f415ac40 2023-08-17T00:07:30.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97d805a150 msgr2=0x7f97d805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97d805a150 0x7f97d805c610 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f97e40010e0 tx=0x7f97e4009040).stop 2023-08-17T00:07:30.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 msgr2=0x7f97f40bcf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 0x7f97f40bcf50 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7f97f00119f0 tx=0x7f97f0006f40).stop 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 shutdown_connections 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97d805a150 0x7f97d805c610 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f416ba70 0x7f97f416beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f415b020 0x7f97f40b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 --2- 172.21.15.153:0/3824102448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97f415ac40 0x7f97f40bcf50 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:30.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 >> 172.21.15.153:0/3824102448 conn(0x7f97f40c6620 msgr2=0x7f97f4157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:30.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 shutdown_connections 2023-08-17T00:07:30.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:30.835+0000 7f97fa839700 1 -- 172.21.15.153:0/3824102448 wait complete. 2023-08-17T00:07:30.858 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:07:30.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:07:30.901 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:07:30.947 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:07:30.947 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:07:30.948 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:31.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.103+0000 7f3202347700 1 Processor -- start 2023-08-17T00:07:31.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.103+0000 7f3202347700 1 -- start start 2023-08-17T00:07:31.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31fc0abf10 0x7f31fc068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0ac2f0 0x7f31fc068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc0c0a80 0x7f31fc0c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc069200 con 0x7f31fc0c0a80 2023-08-17T00:07:31.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31fc1545e0 con 0x7f31fc0abf10 2023-08-17T00:07:31.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0a96d0 con 0x7f31fc0ac2f0 2023-08-17T00:07:31.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc0c0a80 0x7f31fc0c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31fc0c0a80 0x7f31fc0c0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40830/0 (socket says 172.21.15.153:40830) 2023-08-17T00:07:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 -- 172.21.15.153:0/1941821412 learned_addr learned my addr 172.21.15.153:0/1941821412 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201345700 1 --2- 172.21.15.153:0/1941821412 >> v2:172.21.15.178:3300/0 conn(0x7f31fc0abf10 0x7f31fc068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3200b44700 1 --2- 172.21.15.153:0/1941821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0ac2f0 0x7f31fc068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 -- 172.21.15.153:0/1941821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0ac2f0 msgr2=0x7f31fc068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:31.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 --2- 172.21.15.153:0/1941821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0ac2f0 0x7f31fc068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 -- 172.21.15.153:0/1941821412 >> v2:172.21.15.178:3300/0 conn(0x7f31fc0abf10 msgr2=0x7f31fc068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:31.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 --2- 172.21.15.153:0/1941821412 >> v2:172.21.15.178:3300/0 conn(0x7f31fc0abf10 0x7f31fc068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 -- 172.21.15.153:0/1941821412 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31fc0c1c50 con 0x7f31fc0c0a80 2023-08-17T00:07:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3201b46700 1 --2- 172.21.15.153:0/1941821412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc0c0ed0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f31fc0c3f30 tx=0x7f31f4009840).ready entity=mon.0 client_cookie=1aeda134e22f1598 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f31f3fff700 1 -- 172.21.15.153:0/1941821412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400e070 con 0x7f31fc0c0a80 2023-08-17T00:07:31.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f31f3fff700 1 -- 172.21.15.153:0/1941821412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400ba50 con 0x7f31fc0c0a80 2023-08-17T00:07:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f31f3fff700 1 -- 172.21.15.153:0/1941821412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400bdd0 con 0x7f31fc0c0a80 2023-08-17T00:07:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- 172.21.15.153:0/1941821412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 msgr2=0x7f31fc0c0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- 172.21.15.153:0/1941821412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc0c0ed0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f31fc0c3f30 tx=0x7f31f4009840).stop 2023-08-17T00:07:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- 172.21.15.153:0/1941821412 shutdown_connections 2023-08-17T00:07:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- 172.21.15.153:0/1941821412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0ac2f0 0x7f31fc068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- 172.21.15.153:0/1941821412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc0c0ed0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 --2- 172.21.15.153:0/1941821412 >> v2:172.21.15.178:3300/0 conn(0x7f31fc0abf10 0x7f31fc068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- 172.21.15.153:0/1941821412 >> 172.21.15.153:0/1941821412 conn(0x7f31fc0c6620 msgr2=0x7f31fc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:31.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.107+0000 7f3202347700 1 -- 172.21.15.153:0/1941821412 shutdown_connections 2023-08-17T00:07:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 -- 172.21.15.153:0/1941821412 wait complete. 2023-08-17T00:07:31.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 Processor -- start 2023-08-17T00:07:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 -- start start 2023-08-17T00:07:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0abf10 0x7f31fc153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31fc0ac2f0 0x7f31fc0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc14b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0bda10 con 0x7f31fc0c0a80 2023-08-17T00:07:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0bdcf0 con 0x7f31fc0ac2f0 2023-08-17T00:07:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.111+0000 7f3202347700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31fc0bdfd0 con 0x7f31fc0abf10 2023-08-17T00:07:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc14b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc14b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40844/0 (socket says 172.21.15.153:40844) 2023-08-17T00:07:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 -- 172.21.15.153:0/2846263085 learned_addr learned my addr 172.21.15.153:0/2846263085 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201345700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0abf10 0x7f31fc153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3200b44700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31fc0ac2f0 0x7f31fc0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 -- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0abf10 msgr2=0x7f31fc153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0abf10 0x7f31fc153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 -- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31fc0ac2f0 msgr2=0x7f31fc0a9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31fc0ac2f0 0x7f31fc0a9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 -- 172.21.15.153:0/2846263085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4009ae0 con 0x7f31fc0c0a80 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3201b46700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc14b930 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f31f4009fd0 tx=0x7f31fc0661d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40092e0 con 0x7f31fc0c0a80 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f401e470 con 0x7f31fc0c0a80 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31fc0be2b0 con 0x7f31fc0c0a80 2023-08-17T00:07:31.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f401e810 con 0x7f31fc0c0a80 2023-08-17T00:07:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31fc0bd5a0 con 0x7f31fc0c0a80 2023-08-17T00:07:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.115+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31fc06b4c0 con 0x7f31fc0c0a80 2023-08-17T00:07:31.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.119+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f31f4025030 con 0x7f31fc0c0a80 2023-08-17T00:07:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.119+0000 7f31f17fa700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31e005a150 0x7f31e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.119+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f31f4075190 con 0x7f31fc0c0a80 2023-08-17T00:07:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.119+0000 7f3201345700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31e005a150 0x7f31e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.119+0000 7f3201345700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31e005a150 0x7f31e005c610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f31f8006090 tx=0x7f31f8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:31.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.127+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31f4048f90 con 0x7f31fc0c0a80 2023-08-17T00:07:31.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.315+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31fc064010 con 0x7f31fc0c0a80 2023-08-17T00:07:31.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.319+0000 7f31f17fa700 1 -- 172.21.15.153:0/2846263085 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f31f4023070 con 0x7f31fc0c0a80 2023-08-17T00:07:31.324 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:31.324 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5669,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/3357155064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3357155064},{"type":"v1","addr":"172.21.15.153:6833","nonce":3357155064}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6190,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/4034012155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4034012155},{"type":"v1","addr":"172.21.15.178:6835","nonce":4034012155}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/862897524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":862897524},{"type":"v1","addr":"172.21.15.178:6837","nonce":862897524}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":6609,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2694900534","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2694900534},{"type":"v1","addr":"172.21.15.153:6835","nonce":2694900534}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[]} 2023-08-17T00:07:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.319+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31e005a150 msgr2=0x7f31e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.319+0000 7f3202347700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31e005a150 0x7f31e005c610 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f31f8006090 tx=0x7f31f8008040).stop 2023-08-17T00:07:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.319+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 msgr2=0x7f31fc14b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.319+0000 7f3202347700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc14b930 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f31f4009fd0 tx=0x7f31fc0661d0).stop 2023-08-17T00:07:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 shutdown_connections 2023-08-17T00:07:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31e005a150 0x7f31e005c610 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31fc0c0a80 0x7f31fc14b930 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31fc0ac2f0 0x7f31fc0a9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 --2- 172.21.15.153:0/2846263085 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31fc0abf10 0x7f31fc153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 >> 172.21.15.153:0/2846263085 conn(0x7f31fc0c6620 msgr2=0x7f31fc14daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 shutdown_connections 2023-08-17T00:07:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.323+0000 7f3202347700 1 -- 172.21.15.153:0/2846263085 wait complete. 2023-08-17T00:07:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 57 2023-08-17T00:07:31.349 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:07:31.349 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:07:31.349 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:07:31.349 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:31.350 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:07:31.350 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:07:31.350 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:07:31.351 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:31.351 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:07:31.351 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:07:31.351 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:07:31.351 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:31.352 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:07:31.352 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:07:31.352 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:07:31.352 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:07:31.371 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:07:31.371 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:07:31.372 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:07:31.373 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:07:31.374 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:07:31.374 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:07:31.375 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:07:31.376 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:07:31.423 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:07:31.424 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:31.425 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:07:31.425 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:31.428 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:07:31.428 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:31.429 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:07:31.429 DEBUG:teuthology.parallel:result is None 2023-08-17T00:07:31.430 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:07:31.530 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:07:31.534 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:07:31.534 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:07:31.535 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:07:31.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.575+0000 7f7b53479700 1 Processor -- start 2023-08-17T00:07:31.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b53479700 1 -- start start 2023-08-17T00:07:31.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b53479700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b4c0acb90 0x7f7b4c0acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b53479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c061fa0 0x7f7b4c062450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b53479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c062940 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b53479700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c0c7e00 con 0x7f7b4c0acb90 2023-08-17T00:07:31.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b53479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c153fa0 con 0x7f7b4c061fa0 2023-08-17T00:07:31.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b4c0acb90 0x7f7b4c0acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b4c0acb90 0x7f7b4c0acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40880/0 (socket says 172.21.15.153:40880) 2023-08-17T00:07:31.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 -- 172.21.15.153:0/847712647 learned_addr learned my addr 172.21.15.153:0/847712647 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:31.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52c78700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c061fa0 0x7f7b4c062450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b51475700 1 -- 172.21.15.153:0/847712647 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208180741 0 0) 0x7f7b3c001110 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b51475700 1 -- 172.21.15.153:0/847712647 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b380033f0 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 -- 172.21.15.153:0/847712647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c061fa0 msgr2=0x7f7b4c062450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c061fa0 0x7f7b4c062450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 -- 172.21.15.153:0/847712647 >> v1:172.21.15.178:6789/0 conn(0x7f7b4c0c8f30 legacy=0x7f7b4c0ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 -- 172.21.15.153:0/847712647 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c0c9ab0 con 0x7f7b4c0acb90 2023-08-17T00:07:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52c78700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c061fa0 0x7f7b4c062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:31.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b52477700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0acb90 0x7f7b4c0acf70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f7b48006fd0 tx=0x7f7b480090f0).ready entity=mon.0 client_cookie=e12a029e957f966a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:31.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.579+0000 7f7b51475700 1 -- 172.21.15.153:0/847712647 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800f510 con 0x7f7b4c0acb90 2023-08-17T00:07:31.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b51475700 1 -- 172.21.15.153:0/847712647 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800f670 con 0x7f7b4c0acb90 2023-08-17T00:07:31.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b51475700 1 -- 172.21.15.153:0/847712647 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800f9f0 con 0x7f7b4c0acb90 2023-08-17T00:07:31.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 -- 172.21.15.153:0/847712647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0acb90 msgr2=0x7f7b4c0acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0acb90 0x7f7b4c0acf70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f7b48006fd0 tx=0x7f7b480090f0).stop 2023-08-17T00:07:31.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 -- 172.21.15.153:0/847712647 shutdown_connections 2023-08-17T00:07:31.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c061fa0 0x7f7b4c062450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/847712647 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0acb90 0x7f7b4c0acf70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 -- 172.21.15.153:0/847712647 >> 172.21.15.153:0/847712647 conn(0x7f7b4c0cb380 msgr2=0x7f7b4c0c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 -- 172.21.15.153:0/847712647 shutdown_connections 2023-08-17T00:07:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.583+0000 7f7b53479700 1 -- 172.21.15.153:0/847712647 wait complete. 2023-08-17T00:07:31.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 Processor -- start 2023-08-17T00:07:31.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 -- start start 2023-08-17T00:07:31.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4c061fa0 0x7f7b4c0c4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c0acb90 0x7f7b4c0bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0c8f30 0x7f7b4c0bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0c03e0 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0c4020 con 0x7f7b4c061fa0 2023-08-17T00:07:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b53479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0c3410 con 0x7f7b4c0acb90 2023-08-17T00:07:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0c8f30 0x7f7b4c0bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52477700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4c061fa0 0x7f7b4c0c4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52477700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4c061fa0 0x7f7b4c0c4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:53304/0 (socket says 172.21.15.153:53304) 2023-08-17T00:07:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52477700 1 -- 172.21.15.153:0/449224043 learned_addr learned my addr 172.21.15.153:0/449224043 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b51c76700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c0acb90 0x7f7b4c0bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52c78700 1 -- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c0acb90 msgr2=0x7f7b4c0bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52c78700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c0acb90 0x7f7b4c0bfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52c78700 1 -- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4c061fa0 msgr2=0x7f7b4c0c4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52c78700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4c061fa0 0x7f7b4c0c4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.587+0000 7f7b52c78700 1 -- 172.21.15.153:0/449224043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009a20 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b52c78700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0c8f30 0x7f7b4c0bfef0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f7b44009f10 tx=0x7f7b4400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400cb70 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4400f040 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44013400 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b48009370 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c0c39d0 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c0c41b0 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.591+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7b440137b0 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.595+0000 7f7b427fc700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3005a150 0x7f7b3005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.595+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f7b440747d0 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.595+0000 7f7b52477700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3005a150 0x7f7b3005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:31.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.595+0000 7f7b52477700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3005a150 0x7f7b3005c610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7b4c0ad620 tx=0x7f7b48017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:31.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.599+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b44048520 con 0x7f7b4c0c8f30 2023-08-17T00:07:31.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:31.771+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7b4c06b4c0 con 0x7f7b4c0c8f30 2023-08-17T00:07:32.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.579+0000 7f7b427fc700 1 -- 172.21.15.153:0/449224043 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v75) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b4404bb40 con 0x7f7b4c0c8f30 2023-08-17T00:07:32.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3005a150 msgr2=0x7f7b3005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3005a150 0x7f7b3005c610 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7b4c0ad620 tx=0x7f7b48017000).stop 2023-08-17T00:07:32.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0c8f30 msgr2=0x7f7b4c0bfef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0c8f30 0x7f7b4c0bfef0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f7b44009f10 tx=0x7f7b4400b040).stop 2023-08-17T00:07:32.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 shutdown_connections 2023-08-17T00:07:32.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3005a150 0x7f7b3005c610 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b4c0c8f30 0x7f7b4c0bfef0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b4c0acb90 0x7f7b4c0bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 --2- 172.21.15.153:0/449224043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4c061fa0 0x7f7b4c0c4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.583+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 >> 172.21.15.153:0/449224043 conn(0x7f7b4c0cb380 msgr2=0x7f7b4c0af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:32.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.587+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 shutdown_connections 2023-08-17T00:07:32.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.587+0000 7f7b53479700 1 -- 172.21.15.153:0/449224043 wait complete. 2023-08-17T00:07:32.595 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:07:32.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:07:32.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.771+0000 7f33ed6ff700 1 Processor -- start 2023-08-17T00:07:32.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.771+0000 7f33ed6ff700 1 -- start start 2023-08-17T00:07:32.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33ed6ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 0x7f33e80ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33ed6ff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80bdd30 con 0x7f33e80c39a0 2023-08-17T00:07:32.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33ed6ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e8065b80 con 0x7f33e8067600 2023-08-17T00:07:32.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33ed6ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8066140 con 0x7f33e8153c80 2023-08-17T00:07:32.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f33e80c39a0 0x7f33e80c3e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41068/0 (socket says 172.21.15.153:41068) 2023-08-17T00:07:32.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e7fff700 1 -- 172.21.15.153:0/3278717239 learned_addr learned my addr 172.21.15.153:0/3278717239 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:32.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 0x7f33e80ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706040984 0 0) 0x7f33e80bdd30 con 0x7f33e80c39a0 2023-08-17T00:07:32.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d40033f0 con 0x7f33e80c39a0 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803633319 0 0) 0x7f33e8065b80 con 0x7f33e8067600 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e80bdd30 con 0x7f33e8067600 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567260318 0 0) 0x7f33d40033f0 con 0x7f33e80c39a0 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 msgr2=0x7f33e80ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 0x7f33e80ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 >> v1:172.21.15.178:6789/0 conn(0x7f33e8067600 legacy=0x7f33e80be1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e8065e60 con 0x7f33e80c39a0 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f33e00017f0 con 0x7f33e80c39a0 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 >> v1:172.21.15.153:6789/0 conn(0x7f33e80c39a0 legacy=0x7f33e80c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33d4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4004690 0x7f33d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 0x7f33d4005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8066140 con 0x7f33d4003aa0 2023-08-17T00:07:32.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d400b990 con 0x7f33d4004690 2023-08-17T00:07:32.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d400bb20 con 0x7f33e8153c80 2023-08-17T00:07:32.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33d4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 -- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 msgr2=0x7f33d4005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e8153c80 0x7f33d4005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:07:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 -- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4004690 msgr2=0x7f33d4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33dffff700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4004690 0x7f33d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4004690 0x7f33d4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33e6ffd700 1 -- 172.21.15.153:0/3278717239 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40033f0 con 0x7f33d4003aa0 2023-08-17T00:07:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.775+0000 7f33dffff700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4004690 0x7f33d4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33d4003ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f33d8009ab0 tx=0x7f33d8009060).ready entity=mon.0 client_cookie=5b88f17a09289fc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8009430 con 0x7f33d4003aa0 2023-08-17T00:07:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800e640 con 0x7f33d4003aa0 2023-08-17T00:07:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33e67fc700 1 -- 172.21.15.153:0/3278717239 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800e9c0 con 0x7f33d4003aa0 2023-08-17T00:07:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33ed6ff700 1 -- 172.21.15.153:0/3278717239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 msgr2=0x7f33d4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/3278717239 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33d4003ea0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7f33d8009ab0 tx=0x7f33d8009060).stop 2023-08-17T00:07:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33e7fff700 1 -- 172.21.15.153:0/3278717239 reap_dead start 2023-08-17T00:07:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33ed6ff700 1 -- 172.21.15.153:0/3278717239 shutdown_connections 2023-08-17T00:07:32.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33ed6ff700 1 -- 172.21.15.153:0/3278717239 >> 172.21.15.153:0/3278717239 conn(0x7f33e80c4950 msgr2=0x7f33e80c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:32.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33ed6ff700 1 -- 172.21.15.153:0/3278717239 shutdown_connections 2023-08-17T00:07:32.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.779+0000 7f33ed6ff700 1 -- 172.21.15.153:0/3278717239 wait complete. 2023-08-17T00:07:32.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 Processor -- start 2023-08-17T00:07:32.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 -- start start 2023-08-17T00:07:32.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33e8141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e80c2d80 0x7f33e80c1260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e80a99d0 0x7f33e80a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80c2170 con 0x7f33d4003aa0 2023-08-17T00:07:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80634c0 con 0x7f33e80a99d0 2023-08-17T00:07:32.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33ed6ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80aa340 con 0x7f33e80c2d80 2023-08-17T00:07:32.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33e8141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33e8141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40902/0 (socket says 172.21.15.153:40902) 2023-08-17T00:07:32.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 -- 172.21.15.153:0/892380558 learned_addr learned my addr 172.21.15.153:0/892380558 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:32.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33dffff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e80c2d80 0x7f33e80c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e7fff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e80a99d0 0x7f33e80a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 -- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e80c2d80 msgr2=0x7f33e80c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e80c2d80 0x7f33e80c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 -- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e80a99d0 msgr2=0x7f33e80a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e80a99d0 0x7f33e80a9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.783+0000 7f33e6ffd700 1 -- 172.21.15.153:0/892380558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80c1bb0 con 0x7f33d4003aa0 2023-08-17T00:07:32.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33e6ffd700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33e8141680 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f33d800e4b0 tx=0x7f33d801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800ed30 con 0x7f33d4003aa0 2023-08-17T00:07:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800ee90 con 0x7f33d4003aa0 2023-08-17T00:07:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8026440 con 0x7f33d4003aa0 2023-08-17T00:07:32.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e80c1e90 con 0x7f33d4003aa0 2023-08-17T00:07:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e8141b70 con 0x7f33d4003aa0 2023-08-17T00:07:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e80632f0 con 0x7f33d4003aa0 2023-08-17T00:07:32.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.787+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f33d802c020 con 0x7f33d4003aa0 2023-08-17T00:07:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.791+0000 7f33deffd700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33c805a180 0x7f33c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.791+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f33d8075a30 con 0x7f33d4003aa0 2023-08-17T00:07:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.791+0000 7f33dffff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33c805a180 0x7f33c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:32.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.791+0000 7f33dffff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33c805a180 0x7f33c805c640 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f33e81522f0 tx=0x7f33d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:32.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:32.795+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f33d80496c0 con 0x7f33d4003aa0 2023-08-17T00:07:33.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.007+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f33e806b530 con 0x7f33d4003aa0 2023-08-17T00:07:33.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.011+0000 7f33deffd700 1 -- 172.21.15.153:0/892380558 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f33d8016070 con 0x7f33d4003aa0 2023-08-17T00:07:33.016 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:33.017 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:07:33.017 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:07:33.017 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.018 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:07:33.018 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:07:33.019 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.019 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.019 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:07:33.019 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:07:33.020 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.020 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:07:33.021 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.022 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:07:33.023 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.024 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.025 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.026 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.026 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.026 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.026 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:07:33.026 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.027 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.028 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:07:33.028 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:07:33.028 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.028 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.028 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.028 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.029 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.029 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.029 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:07:33.030 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:07:33.030 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.030 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.030 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.030 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.031 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.031 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.031 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.031 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:07:33.031 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:07:33.032 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.032 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.032 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.032 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.032 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.033 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.034 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.035 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:07:33.036 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:07:33.036 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.036 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.036 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.036 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:07:33.038 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:07:33.039 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:07:33.040 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.040 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.040 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:07:33.040 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:07:33.040 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:07:33.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.041 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.041 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:07:33.041 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:07:33.041 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.042 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.043 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:07:33.044 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:07:33.045 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:07:33.046 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:07:33.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:33.046 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:07:33.046 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:07:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33c805a180 msgr2=0x7f33c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33c805a180 0x7f33c805c640 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f33e81522f0 tx=0x7f33d0009040).stop 2023-08-17T00:07:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 msgr2=0x7f33e8141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33e8141680 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f33d800e4b0 tx=0x7f33d801a000).stop 2023-08-17T00:07:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 shutdown_connections 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33c805a180 0x7f33c805c640 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33e80a99d0 0x7f33e80a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33e80c2d80 0x7f33e80c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 --2- 172.21.15.153:0/892380558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33d4003aa0 0x7f33e8141680 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 >> 172.21.15.153:0/892380558 conn(0x7f33e80c4950 msgr2=0x7f33e8153180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 shutdown_connections 2023-08-17T00:07:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.015+0000 7f33ed6ff700 1 -- 172.21.15.153:0/892380558 wait complete. 2023-08-17T00:07:33.050 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.211+0000 7f5801369700 1 Processor -- start 2023-08-17T00:07:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.211+0000 7f5801369700 1 -- start start 2023-08-17T00:07:33.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f5801369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57fc14def0 0x7f57fc0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f5801369700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57fc0c7450 0x7f57fc0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f5801369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc0aa680 con 0x7f57fc14e2d0 2023-08-17T00:07:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f5801369700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc158850 con 0x7f57fc0c7450 2023-08-17T00:07:33.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f5801369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc0c5eb0 con 0x7f57fc14def0 2023-08-17T00:07:33.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57fc0c7450 0x7f57fc0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f57fc0c7450 0x7f57fc0c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40906/0 (socket says 172.21.15.153:40906) 2023-08-17T00:07:33.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fa7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f57fc14e2d0 0x7f57fc154c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41070/0 (socket says 172.21.15.153:41070) 2023-08-17T00:07:33.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 -- 172.21.15.153:0/1425948406 learned_addr learned my addr 172.21.15.153:0/1425948406 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:33.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57faffd700 1 --2- 172.21.15.153:0/1425948406 >> v2:172.21.15.178:3300/0 conn(0x7f57fc14def0 0x7f57fc0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 -- 172.21.15.153:0/1425948406 >> v2:172.21.15.178:3300/0 conn(0x7f57fc14def0 msgr2=0x7f57fc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:33.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 --2- 172.21.15.153:0/1425948406 >> v2:172.21.15.178:3300/0 conn(0x7f57fc14def0 0x7f57fc0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 -- 172.21.15.153:0/1425948406 >> v1:172.21.15.153:6789/0 conn(0x7f57fc14e2d0 legacy=0x7f57fc154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.215+0000 7f57fb7fe700 1 -- 172.21.15.153:0/1425948406 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc0c6110 con 0x7f57fc0c7450 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f57fb7fe700 1 --2- 172.21.15.153:0/1425948406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0c7450 0x7f57fc0c7870 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f57fc05e650 tx=0x7f57f4009840).ready entity=mon.0 client_cookie=fe6a05814b7ab309 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f57f9ffb700 1 -- 172.21.15.153:0/1425948406 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400e070 con 0x7f57fc0c7450 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f57f9ffb700 1 -- 172.21.15.153:0/1425948406 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f400ba20 con 0x7f57fc0c7450 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f57f9ffb700 1 -- 172.21.15.153:0/1425948406 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f400bda0 con 0x7f57fc0c7450 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 -- 172.21.15.153:0/1425948406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0c7450 msgr2=0x7f57fc0c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 --2- 172.21.15.153:0/1425948406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0c7450 0x7f57fc0c7870 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f57fc05e650 tx=0x7f57f4009840).stop 2023-08-17T00:07:33.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 -- 172.21.15.153:0/1425948406 shutdown_connections 2023-08-17T00:07:33.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 --2- 172.21.15.153:0/1425948406 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc0c7450 0x7f57fc0c7870 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 --2- 172.21.15.153:0/1425948406 >> v2:172.21.15.178:3300/0 conn(0x7f57fc14def0 0x7f57fc0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 -- 172.21.15.153:0/1425948406 >> 172.21.15.153:0/1425948406 conn(0x7f57fc061fa0 msgr2=0x7f57fc0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:33.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 -- 172.21.15.153:0/1425948406 shutdown_connections 2023-08-17T00:07:33.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.219+0000 7f5801369700 1 -- 172.21.15.153:0/1425948406 wait complete. 2023-08-17T00:07:33.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 Processor -- start 2023-08-17T00:07:33.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 -- start start 2023-08-17T00:07:33.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57fc0c7450 0x7f57fc14d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 0x7f57fc0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57fc14e2d0 0x7f57fc156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc163920 con 0x7f57fc14def0 2023-08-17T00:07:33.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0c4340 con 0x7f57fc0c7450 2023-08-17T00:07:33.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f5801369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0af160 con 0x7f57fc14e2d0 2023-08-17T00:07:33.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 0x7f57fc0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 0x7f57fc0c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40912/0 (socket says 172.21.15.153:40912) 2023-08-17T00:07:33.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 -- 172.21.15.153:0/2610249458 learned_addr learned my addr 172.21.15.153:0/2610249458 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:33.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57faffd700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57fc0c7450 0x7f57fc14d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fb7fe700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57fc14e2d0 0x7f57fc156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 -- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57fc14e2d0 msgr2=0x7f57fc156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57fc14e2d0 0x7f57fc156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 -- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57fc0c7450 msgr2=0x7f57fc14d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57fc0c7450 0x7f57fc14d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.223+0000 7f57fa7fc700 1 -- 172.21.15.153:0/2610249458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4009ae0 con 0x7f57fc14def0 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f57fa7fc700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 0x7f57fc0c3680 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f57f0001eb0 tx=0x7f57f0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00070d0 con 0x7f57fc14def0 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f0007230 con 0x7f57fc14def0 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc0c4060 con 0x7f57fc14def0 2023-08-17T00:07:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f00075b0 con 0x7f57fc14def0 2023-08-17T00:07:33.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc0aedf0 con 0x7f57fc14def0 2023-08-17T00:07:33.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc06b530 con 0x7f57fc14def0 2023-08-17T00:07:33.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.227+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f57f0010070 con 0x7f57fc14def0 2023-08-17T00:07:33.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.231+0000 7f57e2ffd700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57e805a150 0x7f57e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.231+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f57f00731a0 con 0x7f57fc14def0 2023-08-17T00:07:33.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.231+0000 7f57faffd700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57e805a150 0x7f57e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.231+0000 7f57faffd700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57e805a150 0x7f57e805c610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f57ec009c30 tx=0x7f57ec009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.235+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f57f0046fa0 con 0x7f57fc14def0 2023-08-17T00:07:33.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.399+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57fc0c87e0 con 0x7f57fc14def0 2023-08-17T00:07:33.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.403+0000 7f57e2ffd700 1 -- 172.21.15.153:0/2610249458 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+13761 (secure 0 0 0) 0x7f57f004a5c0 con 0x7f57fc14def0 2023-08-17T00:07:33.409 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:33.410 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":75,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:32.576536+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:33.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57e805a150 msgr2=0x7f57e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57e805a150 0x7f57e805c610 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f57ec009c30 tx=0x7f57ec009060).stop 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 msgr2=0x7f57fc0c3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 0x7f57fc0c3680 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7f57f0001eb0 tx=0x7f57f0007df0).stop 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 shutdown_connections 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57e805a150 0x7f57e805c610 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57fc14e2d0 0x7f57fc156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57fc14def0 0x7f57fc0c3680 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 --2- 172.21.15.153:0/2610249458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57fc0c7450 0x7f57fc14d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 >> 172.21.15.153:0/2610249458 conn(0x7f57fc061fa0 msgr2=0x7f57fc14d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:33.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 shutdown_connections 2023-08-17T00:07:33.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.407+0000 7f5801369700 1 -- 172.21.15.153:0/2610249458 wait complete. 2023-08-17T00:07:33.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:07:33.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:07:33.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.583+0000 7f9a65107700 1 Processor -- start 2023-08-17T00:07:33.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.583+0000 7f9a65107700 1 -- start start 2023-08-17T00:07:33.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a65107700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a60153f50 0x7f9a60154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a65107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a600c01a0 0x7f9a600c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a65107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a600bfd10 con 0x7f9a600c57a0 2023-08-17T00:07:33.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a65107700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a60154860 con 0x7f9a60153f50 2023-08-17T00:07:33.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a65107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a60154af0 con 0x7f9a600c01a0 2023-08-17T00:07:33.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a64906700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a600c01a0 0x7f9a600c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a60153f50 0x7f9a60154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a60153f50 0x7f9a60154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:53340/0 (socket says 172.21.15.153:53340) 2023-08-17T00:07:33.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 -- 172.21.15.153:0/2177269965 learned_addr learned my addr 172.21.15.153:0/2177269965 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5ffff700 1 --1- 172.21.15.153:0/2177269965 >> v1:172.21.15.178:6789/0 conn(0x7f9a600c57a0 0x7f9a600c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:59978/0 (socket says 172.21.15.153:59978) 2023-08-17T00:07:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 -- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a600c01a0 msgr2=0x7f9a600c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 --2- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a600c01a0 0x7f9a600c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 -- 172.21.15.153:0/2177269965 >> v1:172.21.15.178:6789/0 conn(0x7f9a600c57a0 legacy=0x7f9a600c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 -- 172.21.15.153:0/2177269965 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60154dd0 con 0x7f9a60153f50 2023-08-17T00:07:33.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5f7fe700 1 --2- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a60153f50 0x7f9a60154370 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f9a54006fd0 tx=0x7f9a540090f0).ready entity=mon.1 client_cookie=94360c8f800f738d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5effd700 1 -- 172.21.15.153:0/2177269965 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400b580 con 0x7f9a60153f50 2023-08-17T00:07:33.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5effd700 1 -- 172.21.15.153:0/2177269965 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a5400b6e0 con 0x7f9a60153f50 2023-08-17T00:07:33.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.587+0000 7f9a5effd700 1 -- 172.21.15.153:0/2177269965 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400ba60 con 0x7f9a60153f50 2023-08-17T00:07:33.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 -- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a60153f50 msgr2=0x7f9a60154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 --2- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a60153f50 0x7f9a60154370 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f9a54006fd0 tx=0x7f9a540090f0).stop 2023-08-17T00:07:33.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 -- 172.21.15.153:0/2177269965 shutdown_connections 2023-08-17T00:07:33.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 --2- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a600c01a0 0x7f9a600c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 --2- 172.21.15.153:0/2177269965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a60153f50 0x7f9a60154370 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 -- 172.21.15.153:0/2177269965 >> 172.21.15.153:0/2177269965 conn(0x7f9a60062a70 msgr2=0x7f9a600ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:33.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 -- 172.21.15.153:0/2177269965 shutdown_connections 2023-08-17T00:07:33.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.591+0000 7f9a65107700 1 -- 172.21.15.153:0/2177269965 wait complete. 2023-08-17T00:07:33.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 Processor -- start 2023-08-17T00:07:33.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 -- start start 2023-08-17T00:07:33.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 0x7f9a600c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a600c57a0 0x7f9a6014e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a60153f50 0x7f9a600c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600c2f00 con 0x7f9a600c01a0 2023-08-17T00:07:33.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600c22f0 con 0x7f9a600c57a0 2023-08-17T00:07:33.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a65107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a600c25d0 con 0x7f9a60153f50 2023-08-17T00:07:33.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 0x7f9a600c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 0x7f9a600c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40928/0 (socket says 172.21.15.153:40928) 2023-08-17T00:07:33.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 -- 172.21.15.153:0/2203034759 learned_addr learned my addr 172.21.15.153:0/2203034759 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:33.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a64906700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a60153f50 0x7f9a600c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5f7fe700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a600c57a0 0x7f9a6014e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 -- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a60153f50 msgr2=0x7f9a600c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a60153f50 0x7f9a600c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 -- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a600c57a0 msgr2=0x7f9a6014e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a600c57a0 0x7f9a6014e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 -- 172.21.15.153:0/2203034759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a54009370 con 0x7f9a600c01a0 2023-08-17T00:07:33.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a5ffff700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 0x7f9a600c7f40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f9a50007fd0 tx=0x7f9a50007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.595+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500072e0 con 0x7f9a600c01a0 2023-08-17T00:07:33.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.599+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a50007440 con 0x7f9a600c01a0 2023-08-17T00:07:33.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.599+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a600c28b0 con 0x7f9a600c01a0 2023-08-17T00:07:33.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.599+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a500058f0 con 0x7f9a600c01a0 2023-08-17T00:07:33.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.599+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a6014eab0 con 0x7f9a600c01a0 2023-08-17T00:07:33.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.599+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a600c4cc0 con 0x7f9a600c01a0 2023-08-17T00:07:33.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.599+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9a50010070 con 0x7f9a600c01a0 2023-08-17T00:07:33.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.603+0000 7f9a47fff700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9a4c05a150 0x7f9a4c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.603+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9a50073520 con 0x7f9a600c01a0 2023-08-17T00:07:33.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.603+0000 7f9a5f7fe700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9a4c05a150 0x7f9a4c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.603+0000 7f9a5f7fe700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9a4c05a150 0x7f9a4c05c610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f9a54009130 tx=0x7f9a54017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.611+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9a50047210 con 0x7f9a600c01a0 2023-08-17T00:07:33.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.767+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9a6006b4c0 con 0x7f9a600c01a0 2023-08-17T00:07:33.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.767+0000 7f9a47fff700 1 -- 172.21.15.153:0/2203034759 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v75) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9a5004a830 con 0x7f9a600c01a0 2023-08-17T00:07:33.775 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:07:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9a4c05a150 msgr2=0x7f9a4c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9a4c05a150 0x7f9a4c05c610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f9a54009130 tx=0x7f9a54017000).stop 2023-08-17T00:07:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 msgr2=0x7f9a600c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 0x7f9a600c7f40 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f9a50007fd0 tx=0x7f9a50007df0).stop 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 shutdown_connections 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9a4c05a150 0x7f9a4c05c610 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a60153f50 0x7f9a600c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a600c57a0 0x7f9a6014e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 --2- 172.21.15.153:0/2203034759 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9a600c01a0 0x7f9a600c7f40 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 >> 172.21.15.153:0/2203034759 conn(0x7f9a60062a70 msgr2=0x7f9a60063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:33.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 shutdown_connections 2023-08-17T00:07:33.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.771+0000 7f9a65107700 1 -- 172.21.15.153:0/2203034759 wait complete. 2023-08-17T00:07:33.797 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:07:33.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.951+0000 7f54f08da700 1 Processor -- start 2023-08-17T00:07:33.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.951+0000 7f54f08da700 1 -- start start 2023-08-17T00:07:33.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54f08da700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec068820 0x7f54ec068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54f08da700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec1585a0 con 0x7f54ec0a8df0 2023-08-17T00:07:33.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54f08da700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ec066400 con 0x7f54ec0a96d0 2023-08-17T00:07:33.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54f08da700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0c1ba0 con 0x7f54ec068820 2023-08-17T00:07:33.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ead9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f54ec0a8df0 0x7f54ec0c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41086/0 (socket says 172.21.15.153:41086) 2023-08-17T00:07:33.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ead9d700 1 -- 172.21.15.153:0/1468244770 learned_addr learned my addr 172.21.15.153:0/1468244770 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54e259c700 1 --2- 172.21.15.153:0/1468244770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec068820 0x7f54ec068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736708255 0 0) 0x7f54ec1585a0 con 0x7f54ec0a8df0 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d80033f0 con 0x7f54ec0a8df0 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409362032 0 0) 0x7f54ec066400 con 0x7f54ec0a96d0 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54ec1585a0 con 0x7f54ec0a96d0 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205669821 0 0) 0x7f54d80033f0 con 0x7f54ec0a8df0 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54e259c700 1 -- 172.21.15.153:0/1468244770 >> v1:172.21.15.178:6789/0 conn(0x7f54ec0a96d0 legacy=0x7f54ec0a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54e259c700 1 -- 172.21.15.153:0/1468244770 >> v1:172.21.15.153:6789/0 conn(0x7f54ec0a8df0 legacy=0x7f54ec0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.955+0000 7f54e259c700 1 -- 172.21.15.153:0/1468244770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec069170 con 0x7f54ec068820 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54e259c700 1 --2- 172.21.15.153:0/1468244770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec068820 0x7f54ec068c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f54d4009790 tx=0x7f54d4009060).ready entity=mon.2 client_cookie=307a683b26b90714 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0015f0 con 0x7f54ec068820 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d4011400 con 0x7f54ec068820 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54ea59c700 1 -- 172.21.15.153:0/1468244770 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d4011780 con 0x7f54ec068820 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 -- 172.21.15.153:0/1468244770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec068820 msgr2=0x7f54ec068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 --2- 172.21.15.153:0/1468244770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec068820 0x7f54ec068c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f54d4009790 tx=0x7f54d4009060).stop 2023-08-17T00:07:33.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 -- 172.21.15.153:0/1468244770 shutdown_connections 2023-08-17T00:07:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 --2- 172.21.15.153:0/1468244770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec068820 0x7f54ec068c80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 -- 172.21.15.153:0/1468244770 >> 172.21.15.153:0/1468244770 conn(0x7f54ec0c6620 msgr2=0x7f54ec0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 -- 172.21.15.153:0/1468244770 shutdown_connections 2023-08-17T00:07:33.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.959+0000 7f54f08da700 1 -- 172.21.15.153:0/1468244770 wait complete. 2023-08-17T00:07:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 Processor -- start 2023-08-17T00:07:33.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 -- start start 2023-08-17T00:07:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 0x7f54ec155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec0a8df0 0x7f54ec0bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec0a96d0 0x7f54ec0bf910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0bc690 con 0x7f54ec068820 2023-08-17T00:07:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0bb7e0 con 0x7f54ec0a96d0 2023-08-17T00:07:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.963+0000 7f54f08da700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ec0bba80 con 0x7f54ec0a8df0 2023-08-17T00:07:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 0x7f54ec155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 0x7f54ec155fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40930/0 (socket says 172.21.15.153:40930) 2023-08-17T00:07:33.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 -- 172.21.15.153:0/2117014754 learned_addr learned my addr 172.21.15.153:0/2117014754 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:33.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54eb59e700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec0a96d0 0x7f54ec0bf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54e259c700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec0a8df0 0x7f54ec0bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 -- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec0a8df0 msgr2=0x7f54ec0bcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec0a8df0 0x7f54ec0bcb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 -- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec0a96d0 msgr2=0x7f54ec0bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:33.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec0a96d0 0x7f54ec0bf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:33.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 -- 172.21.15.153:0/2117014754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d40092a0 con 0x7f54ec068820 2023-08-17T00:07:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54eb59e700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec0a96d0 0x7f54ec0bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54ead9d700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 0x7f54ec155fa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f54dc00c7c0 tx=0x7f54dc002bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc007320 con 0x7f54ec068820 2023-08-17T00:07:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54dc007480 con 0x7f54ec068820 2023-08-17T00:07:33.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ec0bbd60 con 0x7f54ec068820 2023-08-17T00:07:33.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54dc0058c0 con 0x7f54ec068820 2023-08-17T00:07:33.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ec0bc320 con 0x7f54ec068820 2023-08-17T00:07:33.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.967+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ec06b4c0 con 0x7f54ec068820 2023-08-17T00:07:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.971+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f54dc010030 con 0x7f54ec068820 2023-08-17T00:07:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.971+0000 7f54e37fe700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54cc05a180 0x7f54cc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.971+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f54dc073da0 con 0x7f54ec068820 2023-08-17T00:07:33.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.971+0000 7f54e259c700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54cc05a180 0x7f54cc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:33.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.975+0000 7f54e259c700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54cc05a180 0x7f54cc05c640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f54d400a010 tx=0x7f54d4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:33.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:33.975+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54dc047a90 con 0x7f54ec068820 2023-08-17T00:07:34.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.131+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54ec064010 con 0x7f54ec068820 2023-08-17T00:07:34.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.135+0000 7f54e37fe700 1 -- 172.21.15.153:0/2117014754 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v75) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54dc04b0b0 con 0x7f54ec068820 2023-08-17T00:07:34.140 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:07:34.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54cc05a180 msgr2=0x7f54cc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54cc05a180 0x7f54cc05c640 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f54d400a010 tx=0x7f54d4016000).stop 2023-08-17T00:07:34.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 msgr2=0x7f54ec155fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 0x7f54ec155fa0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f54dc00c7c0 tx=0x7f54dc002bb0).stop 2023-08-17T00:07:34.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 shutdown_connections 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54cc05a180 0x7f54cc05c640 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54ec0a96d0 0x7f54ec0bf910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54ec0a8df0 0x7f54ec0bcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 --2- 172.21.15.153:0/2117014754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54ec068820 0x7f54ec155fa0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 >> 172.21.15.153:0/2117014754 conn(0x7f54ec0c6620 msgr2=0x7f54ec0c5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 shutdown_connections 2023-08-17T00:07:34.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.139+0000 7f54f08da700 1 -- 172.21.15.153:0/2117014754 wait complete. 2023-08-17T00:07:34.166 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:07:34.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb988e4700 1 Processor -- start 2023-08-17T00:07:34.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb988e4700 1 -- start start 2023-08-17T00:07:34.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb988e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068c80 0x7fcb940a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb988e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb941585a0 con 0x7fcb940a8df0 2023-08-17T00:07:34.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb988e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb94066400 con 0x7fcb94068820 2023-08-17T00:07:34.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb988e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c1ba0 con 0x7fcb94068c80 2023-08-17T00:07:34.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb937fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcb940a8df0 0x7fcb940c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41096/0 (socket says 172.21.15.153:41096) 2023-08-17T00:07:34.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb937fe700 1 -- 172.21.15.153:0/2800019134 learned_addr learned my addr 172.21.15.153:0/2800019134 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:34.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb92ffd700 1 --1- 172.21.15.153:0/2800019134 >> v1:172.21.15.178:6789/0 conn(0x7fcb94068820 0x7fcb940a96d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:60000/0 (socket says 172.21.15.153:60000) 2023-08-17T00:07:34.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.319+0000 7fcb93fff700 1 --2- 172.21.15.153:0/2800019134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068c80 0x7fcb940a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933079983 0 0) 0x7fcb941585a0 con 0x7fcb940a8df0 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7c0033f0 con 0x7fcb940a8df0 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169747754 0 0) 0x7fcb94066400 con 0x7fcb94068820 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb941585a0 con 0x7fcb94068820 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb93fff700 1 -- 172.21.15.153:0/2800019134 >> v1:172.21.15.178:6789/0 conn(0x7fcb94068820 legacy=0x7fcb940a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb93fff700 1 -- 172.21.15.153:0/2800019134 >> v1:172.21.15.153:6789/0 conn(0x7fcb940a8df0 legacy=0x7fcb940c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb93fff700 1 -- 172.21.15.153:0/2800019134 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940b9d30 con 0x7fcb94068c80 2023-08-17T00:07:34.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb93fff700 1 --2- 172.21.15.153:0/2800019134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068c80 0x7fcb940a9de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fcb8c009e90 tx=0x7fcb8c009780).ready entity=mon.2 client_cookie=cf57cf8dde9b0e38 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:34.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00e070 con 0x7fcb94068c80 2023-08-17T00:07:34.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00bab0 con 0x7fcb94068c80 2023-08-17T00:07:34.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb927fc700 1 -- 172.21.15.153:0/2800019134 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00be30 con 0x7fcb94068c80 2023-08-17T00:07:34.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 -- 172.21.15.153:0/2800019134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068c80 msgr2=0x7fcb940a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 --2- 172.21.15.153:0/2800019134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068c80 0x7fcb940a9de0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fcb8c009e90 tx=0x7fcb8c009780).stop 2023-08-17T00:07:34.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 -- 172.21.15.153:0/2800019134 shutdown_connections 2023-08-17T00:07:34.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 --2- 172.21.15.153:0/2800019134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068c80 0x7fcb940a9de0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 -- 172.21.15.153:0/2800019134 >> 172.21.15.153:0/2800019134 conn(0x7fcb940c6620 msgr2=0x7fcb940c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:34.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 -- 172.21.15.153:0/2800019134 shutdown_connections 2023-08-17T00:07:34.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.323+0000 7fcb988e4700 1 -- 172.21.15.153:0/2800019134 wait complete. 2023-08-17T00:07:34.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.327+0000 7fcb988e4700 1 Processor -- start 2023-08-17T00:07:34.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.327+0000 7fcb988e4700 1 -- start start 2023-08-17T00:07:34.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068820 0x7fcb940bfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb94068c80 0x7fcb9416af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 0x7fcb940bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940bf660 con 0x7fcb940a8df0 2023-08-17T00:07:34.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940bea50 con 0x7fcb94068c80 2023-08-17T00:07:34.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940bed30 con 0x7fcb94068820 2023-08-17T00:07:34.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 0x7fcb940bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 0x7fcb940bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40934/0 (socket says 172.21.15.153:40934) 2023-08-17T00:07:34.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 -- 172.21.15.153:0/1211713542 learned_addr learned my addr 172.21.15.153:0/1211713542 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:34.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb937fe700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068820 0x7fcb940bfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb92ffd700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb94068c80 0x7fcb9416af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 -- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068820 msgr2=0x7fcb940bfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068820 0x7fcb940bfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 -- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb94068c80 msgr2=0x7fcb9416af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb94068c80 0x7fcb9416af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 -- 172.21.15.153:0/1211713542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c009a20 con 0x7fcb940a8df0 2023-08-17T00:07:34.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb93fff700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 0x7fcb940bcc70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fcb8c00b610 tx=0x7fcb8c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:34.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c01d630 con 0x7fcb940a8df0 2023-08-17T00:07:34.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c01d790 con 0x7fcb940a8df0 2023-08-17T00:07:34.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb940bf010 con 0x7fcb940a8df0 2023-08-17T00:07:34.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c01db50 con 0x7fcb940a8df0 2023-08-17T00:07:34.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9416b400 con 0x7fcb940a8df0 2023-08-17T00:07:34.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.331+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb940bf7d0 con 0x7fcb940a8df0 2023-08-17T00:07:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.335+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcb8c026410 con 0x7fcb940a8df0 2023-08-17T00:07:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.335+0000 7fcb7b7fe700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8005a180 0x7fcb8005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.335+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fcb8c075ff0 con 0x7fcb940a8df0 2023-08-17T00:07:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.335+0000 7fcb937fe700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8005a180 0x7fcb8005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.339+0000 7fcb937fe700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8005a180 0x7fcb8005c640 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fcb84007fd0 tx=0x7fcb84009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:34.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.343+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcb8c04d840 con 0x7fcb940a8df0 2023-08-17T00:07:34.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.507+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcb9406b4c0 con 0x7fcb940a8df0 2023-08-17T00:07:34.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.507+0000 7fcb7b7fe700 1 -- 172.21.15.153:0/1211713542 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) v1 ==== 84+0+143 (secure 0 0 0) 0x7fcb8c04d430 con 0x7fcb940a8df0 2023-08-17T00:07:34.512 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:34.513 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:07:34.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:34.513 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:07:34.513 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:07:34.513 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:07:34.513 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:07:34.514 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:07:34.514 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:07:34.514 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:07:34.514 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:07:34.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8005a180 msgr2=0x7fcb8005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8005a180 0x7fcb8005c640 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fcb84007fd0 tx=0x7fcb84009040).stop 2023-08-17T00:07:34.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 msgr2=0x7fcb940bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 0x7fcb940bcc70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7fcb8c00b610 tx=0x7fcb8c009780).stop 2023-08-17T00:07:34.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 shutdown_connections 2023-08-17T00:07:34.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8005a180 0x7fcb8005c640 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcb940a8df0 0x7fcb940bcc70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb94068c80 0x7fcb9416af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 --2- 172.21.15.153:0/1211713542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb94068820 0x7fcb940bfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 >> 172.21.15.153:0/1211713542 conn(0x7fcb940c6620 msgr2=0x7fcb940c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 shutdown_connections 2023-08-17T00:07:34.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.511+0000 7fcb988e4700 1 -- 172.21.15.153:0/1211713542 wait complete. 2023-08-17T00:07:34.537 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:07:34.538 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:07:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.699+0000 7fede4769700 1 Processor -- start 2023-08-17T00:07:34.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.699+0000 7fede4769700 1 -- start start 2023-08-17T00:07:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede4769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc154e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede4769700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feddc14e690 0x7feddc063980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede4769700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc155380 con 0x7feddc066da0 2023-08-17T00:07:34.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede4769700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0c1d10 con 0x7feddc14e690 2023-08-17T00:07:34.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede4769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc063e70 con 0x7feddc14e2b0 2023-08-17T00:07:34.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1d04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7feddc14e690 0x7feddc063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede2d06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feddc066da0 0x7feddc157990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41112/0 (socket says 172.21.15.153:41112) 2023-08-17T00:07:34.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede2d06700 1 -- 172.21.15.153:0/2853499874 learned_addr learned my addr 172.21.15.153:0/2853499874 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:34.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede2505700 1 --2- 172.21.15.153:0/2853499874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1d04700 1 -- 172.21.15.153:0/2853499874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 msgr2=0x7feddc154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:34.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1d04700 1 --2- 172.21.15.153:0/2853499874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1d04700 1 -- 172.21.15.153:0/2853499874 >> v1:172.21.15.153:6789/0 conn(0x7feddc066da0 legacy=0x7feddc157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1d04700 1 -- 172.21.15.153:0/2853499874 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0640c0 con 0x7feddc14e690 2023-08-17T00:07:34.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1d04700 1 --2- 172.21.15.153:0/2853499874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc063980 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fedcc009760 tx=0x7fedcc009060).ready entity=mon.0 client_cookie=e7f653ca1a185676 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1503700 1 -- 172.21.15.153:0/2853499874 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0090d0 con 0x7feddc14e690 2023-08-17T00:07:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1503700 1 -- 172.21.15.153:0/2853499874 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00f510 con 0x7feddc14e690 2023-08-17T00:07:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.703+0000 7fede1503700 1 -- 172.21.15.153:0/2853499874 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00f890 con 0x7feddc14e690 2023-08-17T00:07:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 -- 172.21.15.153:0/2853499874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 msgr2=0x7feddc063980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 --2- 172.21.15.153:0/2853499874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc063980 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7fedcc009760 tx=0x7fedcc009060).stop 2023-08-17T00:07:34.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 -- 172.21.15.153:0/2853499874 shutdown_connections 2023-08-17T00:07:34.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 --2- 172.21.15.153:0/2853499874 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc063980 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 --2- 172.21.15.153:0/2853499874 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 -- 172.21.15.153:0/2853499874 >> 172.21.15.153:0/2853499874 conn(0x7feddc0c41b0 msgr2=0x7feddc0c45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:34.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 -- 172.21.15.153:0/2853499874 shutdown_connections 2023-08-17T00:07:34.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 -- 172.21.15.153:0/2853499874 wait complete. 2023-08-17T00:07:34.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 Processor -- start 2023-08-17T00:07:34.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.707+0000 7fede4769700 1 -- start start 2023-08-17T00:07:34.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feddc066da0 0x7feddc0c0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc0bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc0bd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0bd920 con 0x7feddc14e690 2023-08-17T00:07:34.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c1810 con 0x7feddc066da0 2023-08-17T00:07:34.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c0980 con 0x7feddc14e2b0 2023-08-17T00:07:34.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc0bd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc0bd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40958/0 (socket says 172.21.15.153:40958) 2023-08-17T00:07:34.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 -- 172.21.15.153:0/212133182 learned_addr learned my addr 172.21.15.153:0/212133182 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:34.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2505700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feddc066da0 0x7feddc0c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede1d04700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc0bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 -- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 msgr2=0x7feddc0bcf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc0bcf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 -- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feddc066da0 msgr2=0x7feddc0c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feddc066da0 0x7feddc0c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 -- 172.21.15.153:0/212133182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0092a0 con 0x7feddc14e690 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2505700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feddc066da0 0x7feddc0c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede2d06700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc0bd430 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fedd400c790 tx=0x7fedd40015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4005d30 con 0x7feddc14e690 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd4005e90 con 0x7feddc14e690 2023-08-17T00:07:34.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd4007320 con 0x7feddc14e690 2023-08-17T00:07:34.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc0c0c00 con 0x7feddc14e690 2023-08-17T00:07:34.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.711+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc0c11c0 con 0x7feddc14e690 2023-08-17T00:07:34.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.715+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc155090 con 0x7feddc14e690 2023-08-17T00:07:34.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.715+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fedd4010030 con 0x7feddc14e690 2023-08-17T00:07:34.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.715+0000 7fedd27fc700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedc005a150 0x7fedc005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:34.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.715+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fedd4073c70 con 0x7feddc14e690 2023-08-17T00:07:34.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.715+0000 7fede2505700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedc005a150 0x7fedc005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:34.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.719+0000 7fede2505700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedc005a150 0x7fedc005c610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7feddc14dc70 tx=0x7fedd8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:34.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.723+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feddc155090 con 0x7feddc14e690 2023-08-17T00:07:34.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:34.887+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7feddc06b530 con 0x7feddc14e690 2023-08-17T00:07:35.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.595+0000 7fedd27fc700 1 -- 172.21.15.153:0/212133182 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) v1 ==== 152+0+0 (secure 0 0 0) 0x7fedd4047960 con 0x7feddc14e690 2023-08-17T00:07:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedc005a150 msgr2=0x7fedc005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedc005a150 0x7fedc005c610 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7feddc14dc70 tx=0x7fedd8008040).stop 2023-08-17T00:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 msgr2=0x7feddc0bd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc0bd430 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7fedd400c790 tx=0x7fedd40015e0).stop 2023-08-17T00:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 shutdown_connections 2023-08-17T00:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fedc005a150 0x7fedc005c610 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feddc14e690 0x7feddc0bd430 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feddc14e2b0 0x7feddc0bcf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 --2- 172.21.15.153:0/212133182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feddc066da0 0x7feddc0c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.607+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 >> 172.21.15.153:0/212133182 conn(0x7feddc0c41b0 msgr2=0x7feddc155da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.611+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 shutdown_connections 2023-08-17T00:07:35.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.611+0000 7fede4769700 1 -- 172.21.15.153:0/212133182 wait complete. 2023-08-17T00:07:35.620 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:07:35.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:07:35.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.795+0000 7f987b3b9700 1 Processor -- start 2023-08-17T00:07:35.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.795+0000 7f987b3b9700 1 -- start start 2023-08-17T00:07:35.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987b3b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874151c40 0x7f98741560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:35.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987b3b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9874065da0 con 0x7f9874068da0 2023-08-17T00:07:35.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987b3b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9874155c60 con 0x7f98740689c0 2023-08-17T00:07:35.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987b3b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9874069200 con 0x7f9874151c40 2023-08-17T00:07:35.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f9879bb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9874068da0 0x7f9874151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41448/0 (socket says 172.21.15.153:41448) 2023-08-17T00:07:35.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f9879bb6700 1 -- 172.21.15.153:0/2069932335 learned_addr learned my addr 172.21.15.153:0/2069932335 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:35.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987abb8700 1 --2- 172.21.15.153:0/2069932335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874151c40 0x7f98741560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f98793b5700 1 -- 172.21.15.153:0/2069932335 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7913570 0 0) 0x7f9874065da0 con 0x7f9874068da0 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f98793b5700 1 -- 172.21.15.153:0/2069932335 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98600033f0 con 0x7f9874068da0 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987abb8700 1 -- 172.21.15.153:0/2069932335 >> v1:172.21.15.178:6789/0 conn(0x7f98740689c0 legacy=0x7f98740c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987abb8700 1 -- 172.21.15.153:0/2069932335 >> v1:172.21.15.153:6789/0 conn(0x7f9874068da0 legacy=0x7f9874151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987abb8700 1 -- 172.21.15.153:0/2069932335 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874065ff0 con 0x7f9874151c40 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987abb8700 1 --2- 172.21.15.153:0/2069932335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874151c40 0x7f98741560f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f986c009e90 tx=0x7f986c009780).ready entity=mon.2 client_cookie=9d1a9e9008d7f251 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:35.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f98793b5700 1 -- 172.21.15.153:0/2069932335 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c00e070 con 0x7f9874151c40 2023-08-17T00:07:35.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f98793b5700 1 -- 172.21.15.153:0/2069932335 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986c00bb60 con 0x7f9874151c40 2023-08-17T00:07:35.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f98793b5700 1 -- 172.21.15.153:0/2069932335 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986c012410 con 0x7f9874151c40 2023-08-17T00:07:35.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987b3b9700 1 -- 172.21.15.153:0/2069932335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874151c40 msgr2=0x7f98741560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.799+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2069932335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874151c40 0x7f98741560f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f986c009e90 tx=0x7f986c009780).stop 2023-08-17T00:07:35.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.803+0000 7f987b3b9700 1 -- 172.21.15.153:0/2069932335 shutdown_connections 2023-08-17T00:07:35.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.803+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2069932335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9874151c40 0x7f98741560f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.803+0000 7f987b3b9700 1 -- 172.21.15.153:0/2069932335 >> 172.21.15.153:0/2069932335 conn(0x7f98740c6620 msgr2=0x7f98740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:35.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.803+0000 7f987b3b9700 1 -- 172.21.15.153:0/2069932335 shutdown_connections 2023-08-17T00:07:35.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.803+0000 7f987b3b9700 1 -- 172.21.15.153:0/2069932335 wait complete. 2023-08-17T00:07:35.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.803+0000 7f987b3b9700 1 Processor -- start 2023-08-17T00:07:35.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 -- start start 2023-08-17T00:07:35.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98740689c0 0x7f9874151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:35.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 0x7f98740a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9874151c40 0x7f98740a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741647e0 con 0x7f9874068da0 2023-08-17T00:07:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741652e0 con 0x7f9874151c40 2023-08-17T00:07:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987b3b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9874165770 con 0x7f98740689c0 2023-08-17T00:07:35.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 0x7f98740a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:35.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 0x7f98740a5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60446/0 (socket says 172.21.15.153:60446) 2023-08-17T00:07:35.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 -- 172.21.15.153:0/2187641878 learned_addr learned my addr 172.21.15.153:0/2187641878 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:35.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987abb8700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9874151c40 0x7f98740a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:35.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f987a3b7700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98740689c0 0x7f9874151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:35.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 -- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98740689c0 msgr2=0x7f9874151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98740689c0 0x7f9874151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 -- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9874151c40 msgr2=0x7f98740a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9874151c40 0x7f98740a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 -- 172.21.15.153:0/2187641878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c009a20 con 0x7f9874068da0 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.807+0000 7f9879bb6700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 0x7f98740a5ae0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f986400c420 tx=0x7f9864007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640070d0 con 0x7f9874068da0 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9864007230 con 0x7f9874068da0 2023-08-17T00:07:35.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98741649f0 con 0x7f9874068da0 2023-08-17T00:07:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640075b0 con 0x7f9874068da0 2023-08-17T00:07:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9874164c90 con 0x7f9874068da0 2023-08-17T00:07:35.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987406b4c0 con 0x7f9874068da0 2023-08-17T00:07:35.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.811+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9864010070 con 0x7f9874068da0 2023-08-17T00:07:35.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.815+0000 7f986a7fc700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f985805a180 0x7f985805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.815+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f9864073470 con 0x7f9874068da0 2023-08-17T00:07:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.815+0000 7f987a3b7700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f985805a180 0x7f985805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.815+0000 7f987a3b7700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f985805a180 0x7f985805c640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f9870007fd0 tx=0x7f9870009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:35.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.823+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9864047180 con 0x7f9874068da0 2023-08-17T00:07:35.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:35.987+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9874064010 con 0x7f9874068da0 2023-08-17T00:07:36.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.611+0000 7f986a7fc700 1 -- 172.21.15.153:0/2187641878 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) v1 ==== 170+0+0 (secure 0 0 0) 0x7f986404a7a0 con 0x7f9874068da0 2023-08-17T00:07:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f985805a180 msgr2=0x7f985805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f985805a180 0x7f985805c640 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f9870007fd0 tx=0x7f9870009040).stop 2023-08-17T00:07:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 msgr2=0x7f98740a5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 0x7f98740a5ae0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7f986400c420 tx=0x7f9864007c80).stop 2023-08-17T00:07:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 shutdown_connections 2023-08-17T00:07:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f985805a180 0x7f985805c640 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9874151c40 0x7f98740a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9874068da0 0x7f98740a5ae0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 --2- 172.21.15.153:0/2187641878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98740689c0 0x7f9874151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.619+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 >> 172.21.15.153:0/2187641878 conn(0x7f98740c6620 msgr2=0x7f98740c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:36.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.639+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 shutdown_connections 2023-08-17T00:07:36.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.639+0000 7f987b3b9700 1 -- 172.21.15.153:0/2187641878 wait complete. 2023-08-17T00:07:36.650 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:07:36.665 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:07:36.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.819+0000 7f0980df9700 1 Processor -- start 2023-08-17T00:07:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.819+0000 7f0980df9700 1 -- start start 2023-08-17T00:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f0980df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0acf30 0x7f097c0c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f0980df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c154e90 con 0x7f097c063bc0 2023-08-17T00:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f0980df9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c153fc0 con 0x7f097c0c5ea0 2023-08-17T00:07:36.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f0980df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c154280 con 0x7f097c0acf30 2023-08-17T00:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f097c063bc0 0x7f097c0bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41452/0 (socket says 172.21.15.153:41452) 2023-08-17T00:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097bfff700 1 -- 172.21.15.153:0/2945977690 learned_addr learned my addr 172.21.15.153:0/2945977690 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:36.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097b7fe700 1 --2- 172.21.15.153:0/2945977690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0acf30 0x7f097c0c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338817293 0 0) 0x7f097c154e90 con 0x7f097c063bc0 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09640033f0 con 0x7f097c063bc0 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97631070 0 0) 0x7f097c153fc0 con 0x7f097c0c5ea0 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f097c154e90 con 0x7f097c0c5ea0 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097b7fe700 1 -- 172.21.15.153:0/2945977690 >> v1:172.21.15.178:6789/0 conn(0x7f097c0c5ea0 legacy=0x7f097c0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097b7fe700 1 -- 172.21.15.153:0/2945977690 >> v1:172.21.15.153:6789/0 conn(0x7f097c063bc0 legacy=0x7f097c0bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097b7fe700 1 -- 172.21.15.153:0/2945977690 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c154560 con 0x7f097c0acf30 2023-08-17T00:07:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097b7fe700 1 --2- 172.21.15.153:0/2945977690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0acf30 0x7f097c0c1020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f096c009790 tx=0x7f096c009060).ready entity=mon.2 client_cookie=7a5fd8376b5aac50 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c0090d0 con 0x7f097c0acf30 2023-08-17T00:07:36.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c00f510 con 0x7f097c0acf30 2023-08-17T00:07:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.823+0000 7f097a7fc700 1 -- 172.21.15.153:0/2945977690 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00f890 con 0x7f097c0acf30 2023-08-17T00:07:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 -- 172.21.15.153:0/2945977690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0acf30 msgr2=0x7f097c0c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 --2- 172.21.15.153:0/2945977690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0acf30 0x7f097c0c1020 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f096c009790 tx=0x7f096c009060).stop 2023-08-17T00:07:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 -- 172.21.15.153:0/2945977690 shutdown_connections 2023-08-17T00:07:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 --2- 172.21.15.153:0/2945977690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0acf30 0x7f097c0c1020 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 -- 172.21.15.153:0/2945977690 >> 172.21.15.153:0/2945977690 conn(0x7f097c0cb330 msgr2=0x7f097c0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 -- 172.21.15.153:0/2945977690 shutdown_connections 2023-08-17T00:07:36.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.827+0000 7f0980df9700 1 -- 172.21.15.153:0/2945977690 wait complete. 2023-08-17T00:07:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 Processor -- start 2023-08-17T00:07:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 -- start start 2023-08-17T00:07:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 0x7f097c0c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f097c0acf30 0x7f097c0c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:36.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0c93e0 0x7f097c0c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c83d0 con 0x7f097c063bc0 2023-08-17T00:07:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c8f50 con 0x7f097c0acf30 2023-08-17T00:07:36.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f0980df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c9d50 con 0x7f097c0c93e0 2023-08-17T00:07:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 0x7f097c0c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 0x7f097c0c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60454/0 (socket says 172.21.15.153:60454) 2023-08-17T00:07:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 -- 172.21.15.153:0/210878135 learned_addr learned my addr 172.21.15.153:0/210878135 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097bfff700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0c93e0 0x7f097c0c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:36.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097affd700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f097c0acf30 0x7f097c0c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 -- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0c93e0 msgr2=0x7f097c0c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0c93e0 0x7f097c0c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 -- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f097c0acf30 msgr2=0x7f097c0c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f097c0acf30 0x7f097c0c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097b7fe700 1 -- 172.21.15.153:0/210878135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096c0092a0 con 0x7f097c063bc0 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.831+0000 7f097affd700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f097c0acf30 0x7f097c0c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:36.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f097b7fe700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 0x7f097c0c2de0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f096c009d80 tx=0x7f096c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00f890 con 0x7f097c063bc0 2023-08-17T00:07:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096c000cc0 con 0x7f097c063bc0 2023-08-17T00:07:36.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c150a00 con 0x7f097c063bc0 2023-08-17T00:07:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096c00fea0 con 0x7f097c063bc0 2023-08-17T00:07:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c0c8900 con 0x7f097c063bc0 2023-08-17T00:07:36.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.835+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c06b4c0 con 0x7f097c063bc0 2023-08-17T00:07:36.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.839+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f096c02c070 con 0x7f097c063bc0 2023-08-17T00:07:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.839+0000 7f09637fe700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f096805a150 0x7f096805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:36.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.839+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f096c0759c0 con 0x7f097c063bc0 2023-08-17T00:07:36.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.839+0000 7f097affd700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f096805a150 0x7f096805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:36.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.839+0000 7f097affd700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f096805a150 0x7f096805c610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f097c0a9b90 tx=0x7f0970009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:36.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:36.847+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f096c0494d0 con 0x7f097c063bc0 2023-08-17T00:07:37.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.043+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f097c154840 con 0x7f097c063bc0 2023-08-17T00:07:37.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.055+0000 7f09637fe700 1 -- 172.21.15.153:0/210878135 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f096c02a020 con 0x7f097c063bc0 2023-08-17T00:07:37.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.067+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f096805a150 msgr2=0x7f096805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.067+0000 7f0980df9700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f096805a150 0x7f096805c610 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f097c0a9b90 tx=0x7f0970009040).stop 2023-08-17T00:07:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 msgr2=0x7f097c0c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 0x7f097c0c2de0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f096c009d80 tx=0x7f096c017000).stop 2023-08-17T00:07:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 shutdown_connections 2023-08-17T00:07:37.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f096805a150 0x7f096805c610 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f097c0c93e0 0x7f097c0c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f097c0acf30 0x7f097c0c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 --2- 172.21.15.153:0/210878135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f097c063bc0 0x7f097c0c2de0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.071+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 >> 172.21.15.153:0/210878135 conn(0x7f097c0cb330 msgr2=0x7f097c1522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.083+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 shutdown_connections 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.083+0000 7f0980df9700 1 -- 172.21.15.153:0/210878135 wait complete. 2023-08-17T00:07:37.255 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 11 and data pool 12 2023-08-17T00:07:37.256 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:37.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.411+0000 7f2ea001b700 1 Processor -- start 2023-08-17T00:07:37.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2ea001b700 1 -- start start 2023-08-17T00:07:37.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2ea001b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151f70 0x7f2e98065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2ea001b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e98065b50 0x7f2e98064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2ea001b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e98061fa0 con 0x7f2e98151b90 2023-08-17T00:07:37.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2ea001b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e980c3fb0 con 0x7f2e98065b50 2023-08-17T00:07:37.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2ea001b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e981523d0 con 0x7f2e98151f70 2023-08-17T00:07:37.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2e9ddb7700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2e98151b90 0x7f2e98063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:53844/0 (socket says 172.21.15.153:53844) 2023-08-17T00:07:37.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2e9ddb7700 1 -- 172.21.15.153:0/3691359652 learned_addr learned my addr 172.21.15.153:0/3691359652 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:37.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2e9d5b6700 1 --2- 172.21.15.153:0/3691359652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151f70 0x7f2e98065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.415+0000 7f2e9e5b8700 1 --2- 172.21.15.153:0/3691359652 >> v2:172.21.15.178:3300/0 conn(0x7f2e98065b50 0x7f2e98064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9cdb5700 1 -- 172.21.15.153:0/3691359652 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748812486 0 0) 0x7f2e98061fa0 con 0x7f2e98151b90 2023-08-17T00:07:37.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9cdb5700 1 -- 172.21.15.153:0/3691359652 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e840033f0 con 0x7f2e98151b90 2023-08-17T00:07:37.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9d5b6700 1 -- 172.21.15.153:0/3691359652 >> v2:172.21.15.178:3300/0 conn(0x7f2e98065b50 msgr2=0x7f2e98064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:37.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9d5b6700 1 --2- 172.21.15.153:0/3691359652 >> v2:172.21.15.178:3300/0 conn(0x7f2e98065b50 0x7f2e98064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9d5b6700 1 -- 172.21.15.153:0/3691359652 >> v1:172.21.15.178:6789/0 conn(0x7f2e98151b90 legacy=0x7f2e98063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9d5b6700 1 -- 172.21.15.153:0/3691359652 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e980621f0 con 0x7f2e98151f70 2023-08-17T00:07:37.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9d5b6700 1 --2- 172.21.15.153:0/3691359652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151f70 0x7f2e98065660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2e88009760 tx=0x7f2e88009060).ready entity=mon.2 client_cookie=a70c27e981f2be89 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:37.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9cdb5700 1 -- 172.21.15.153:0/3691359652 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e880090d0 con 0x7f2e98151f70 2023-08-17T00:07:37.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9cdb5700 1 -- 172.21.15.153:0/3691359652 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800d4a0 con 0x7f2e98151f70 2023-08-17T00:07:37.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2e9cdb5700 1 -- 172.21.15.153:0/3691359652 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800d820 con 0x7f2e98151f70 2023-08-17T00:07:37.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 -- 172.21.15.153:0/3691359652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151f70 msgr2=0x7f2e98065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 --2- 172.21.15.153:0/3691359652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151f70 0x7f2e98065660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f2e88009760 tx=0x7f2e88009060).stop 2023-08-17T00:07:37.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 -- 172.21.15.153:0/3691359652 shutdown_connections 2023-08-17T00:07:37.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 --2- 172.21.15.153:0/3691359652 >> v2:172.21.15.178:3300/0 conn(0x7f2e98065b50 0x7f2e98064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 --2- 172.21.15.153:0/3691359652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151f70 0x7f2e98065660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 -- 172.21.15.153:0/3691359652 >> 172.21.15.153:0/3691359652 conn(0x7f2e980c7150 msgr2=0x7f2e980c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:37.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 -- 172.21.15.153:0/3691359652 shutdown_connections 2023-08-17T00:07:37.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.419+0000 7f2ea001b700 1 -- 172.21.15.153:0/3691359652 wait complete. 2023-08-17T00:07:37.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 Processor -- start 2023-08-17T00:07:37.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 -- start start 2023-08-17T00:07:37.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 0x7f2e9814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151b90 0x7f2e98144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e98151f70 0x7f2e980aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9814e6c0 con 0x7f2e98065b50 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e980be680 con 0x7f2e98151f70 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.423+0000 7f2ea001b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e98153030 con 0x7f2e98151b90 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 0x7f2e9814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 0x7f2e9814e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60468/0 (socket says 172.21.15.153:60468) 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 -- 172.21.15.153:0/4075856273 learned_addr learned my addr 172.21.15.153:0/4075856273 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:37.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9e5b8700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e98151f70 0x7f2e980aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9d5b6700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151b90 0x7f2e98144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 -- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151b90 msgr2=0x7f2e98144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151b90 0x7f2e98144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 -- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e98151f70 msgr2=0x7f2e980aae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e98151f70 0x7f2e980aae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 -- 172.21.15.153:0/4075856273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880092a0 con 0x7f2e98065b50 2023-08-17T00:07:37.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e9ddb7700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 0x7f2e9814e1d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f2e9400c590 tx=0x7f2e94007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:37.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940072e0 con 0x7f2e98065b50 2023-08-17T00:07:37.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e94007440 con 0x7f2e98065b50 2023-08-17T00:07:37.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e981456e0 con 0x7f2e98065b50 2023-08-17T00:07:37.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e940057a0 con 0x7f2e98065b50 2023-08-17T00:07:37.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.427+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e981529e0 con 0x7f2e98065b50 2023-08-17T00:07:37.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.431+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9806b530 con 0x7f2e98065b50 2023-08-17T00:07:37.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.431+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2e9401a060 con 0x7f2e98065b50 2023-08-17T00:07:37.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.431+0000 7f2e8dffb700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e7c05a180 0x7f2e7c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.431+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2e940737c0 con 0x7f2e98065b50 2023-08-17T00:07:37.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.431+0000 7f2e9d5b6700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e7c05a180 0x7f2e7c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.435+0000 7f2e9d5b6700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e7c05a180 0x7f2e7c05c640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f2e980bd0a0 tx=0x7f2e88016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:37.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.439+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2e94047160 con 0x7f2e98065b50 2023-08-17T00:07:37.465 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:07:37.459+0000 7febe8ecc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:07:37.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.599+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e980624d0 con 0x7f2e98065b50 2023-08-17T00:07:37.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.603+0000 7f2e8dffb700 1 -- 172.21.15.153:0/4075856273 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f2e9404a780 con 0x7f2e98065b50 2023-08-17T00:07:37.610 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:37.610 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":78,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:37.048159+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:07:34.961847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T00:07:36.061106+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e7c05a180 msgr2=0x7f2e7c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e7c05a180 0x7f2e7c05c640 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f2e980bd0a0 tx=0x7f2e88016000).stop 2023-08-17T00:07:37.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 msgr2=0x7f2e9814e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 0x7f2e9814e1d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f2e9400c590 tx=0x7f2e94007c80).stop 2023-08-17T00:07:37.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 shutdown_connections 2023-08-17T00:07:37.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e7c05a180 0x7f2e7c05c640 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e98151f70 0x7f2e980aae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e98151b90 0x7f2e98144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 --2- 172.21.15.153:0/4075856273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e98065b50 0x7f2e9814e1d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 >> 172.21.15.153:0/4075856273 conn(0x7f2e980c7150 msgr2=0x7f2e98155810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:37.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 shutdown_connections 2023-08-17T00:07:37.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.607+0000 7f2ea001b700 1 -- 172.21.15.153:0/4075856273 wait complete. 2023-08-17T00:07:37.631 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.783+0000 7f40ced07700 1 Processor -- start 2023-08-17T00:07:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.783+0000 7f40ced07700 1 -- start start 2023-08-17T00:07:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ced07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c8068820 0x7f40c8068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ced07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40c80a96d0 0x7f40c80a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ced07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c81585a0 con 0x7f40c80a8df0 2023-08-17T00:07:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ced07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c80c1ba0 con 0x7f40c80a96d0 2023-08-17T00:07:37.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ced07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8066400 con 0x7f40c8068820 2023-08-17T00:07:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cdd05700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f40c80a8df0 0x7f40c80c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41458/0 (socket says 172.21.15.153:41458) 2023-08-17T00:07:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cdd05700 1 -- 172.21.15.153:0/2716668443 learned_addr learned my addr 172.21.15.153:0/2716668443 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ce506700 1 --2- 172.21.15.153:0/2716668443 >> v2:172.21.15.153:3300/0 conn(0x7f40c80a96d0 0x7f40c80a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cd504700 1 --2- 172.21.15.153:0/2716668443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c8068820 0x7f40c8068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ccd03700 1 -- 172.21.15.153:0/2716668443 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1160909325 0 0) 0x7f40c81585a0 con 0x7f40c80a8df0 2023-08-17T00:07:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ccd03700 1 -- 172.21.15.153:0/2716668443 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40b40033f0 con 0x7f40c80a8df0 2023-08-17T00:07:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cd504700 1 -- 172.21.15.153:0/2716668443 >> v2:172.21.15.153:3300/0 conn(0x7f40c80a96d0 msgr2=0x7f40c80a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cd504700 1 --2- 172.21.15.153:0/2716668443 >> v2:172.21.15.153:3300/0 conn(0x7f40c80a96d0 0x7f40c80a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cd504700 1 -- 172.21.15.153:0/2716668443 >> v1:172.21.15.153:6789/0 conn(0x7f40c80a8df0 legacy=0x7f40c80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cd504700 1 -- 172.21.15.153:0/2716668443 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c8069170 con 0x7f40c8068820 2023-08-17T00:07:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ce506700 1 --2- 172.21.15.153:0/2716668443 >> v2:172.21.15.153:3300/0 conn(0x7f40c80a96d0 0x7f40c80a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40cd504700 1 --2- 172.21.15.153:0/2716668443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c8068820 0x7f40c8068c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f40b8009760 tx=0x7f40b8009060).ready entity=mon.2 client_cookie=6f2372c7c3fd400f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ccd03700 1 -- 172.21.15.153:0/2716668443 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800d4a0 con 0x7f40c8068820 2023-08-17T00:07:37.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ccd03700 1 -- 172.21.15.153:0/2716668443 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800d600 con 0x7f40c8068820 2023-08-17T00:07:37.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.787+0000 7f40ccd03700 1 -- 172.21.15.153:0/2716668443 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800d980 con 0x7f40c8068820 2023-08-17T00:07:37.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 -- 172.21.15.153:0/2716668443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c8068820 msgr2=0x7f40c8068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 --2- 172.21.15.153:0/2716668443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c8068820 0x7f40c8068c80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f40b8009760 tx=0x7f40b8009060).stop 2023-08-17T00:07:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 -- 172.21.15.153:0/2716668443 shutdown_connections 2023-08-17T00:07:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 --2- 172.21.15.153:0/2716668443 >> v2:172.21.15.153:3300/0 conn(0x7f40c80a96d0 0x7f40c80a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 --2- 172.21.15.153:0/2716668443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c8068820 0x7f40c8068c80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 -- 172.21.15.153:0/2716668443 >> 172.21.15.153:0/2716668443 conn(0x7f40c80c6620 msgr2=0x7f40c80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 -- 172.21.15.153:0/2716668443 shutdown_connections 2023-08-17T00:07:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 -- 172.21.15.153:0/2716668443 wait complete. 2023-08-17T00:07:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.791+0000 7f40ced07700 1 Processor -- start 2023-08-17T00:07:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 -- start start 2023-08-17T00:07:37.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 0x7f40c80bfe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c80a8df0 0x7f40c80bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c80a96d0 0x7f40c80aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80bc7f0 con 0x7f40c8068820 2023-08-17T00:07:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80bcad0 con 0x7f40c80a96d0 2023-08-17T00:07:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80bcdb0 con 0x7f40c80a8df0 2023-08-17T00:07:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 0x7f40c80bfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 0x7f40c80bfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60484/0 (socket says 172.21.15.153:60484) 2023-08-17T00:07:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 -- 172.21.15.153:0/1939775369 learned_addr learned my addr 172.21.15.153:0/1939775369 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cd504700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c80a8df0 0x7f40c80bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 -- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c80a8df0 msgr2=0x7f40c80bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ce506700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c80a96d0 0x7f40c80aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c80a8df0 0x7f40c80bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 -- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c80a96d0 msgr2=0x7f40c80aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c80a96d0 0x7f40c80aade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 -- 172.21.15.153:0/1939775369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c00092a0 con 0x7f40c8068820 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cd504700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c80a8df0 0x7f40c80bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40cdd05700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 0x7f40c80bfe20 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f40c400c810 tx=0x7f40c4007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4005c00 con 0x7f40c8068820 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c4005d60 con 0x7f40c8068820 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b80092a0 con 0x7f40c8068820 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.795+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c4007320 con 0x7f40c8068820 2023-08-17T00:07:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.799+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c80c0310 con 0x7f40c8068820 2023-08-17T00:07:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.799+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c806b4c0 con 0x7f40c8068820 2023-08-17T00:07:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.799+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f40c4010030 con 0x7f40c8068820 2023-08-17T00:07:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.803+0000 7f40bdffb700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40ac05a150 0x7f40ac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.803+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f40c40741c0 con 0x7f40c8068820 2023-08-17T00:07:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.803+0000 7f40cd504700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40ac05a150 0x7f40ac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.803+0000 7f40cd504700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40ac05a150 0x7f40ac05c610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f40c80b99c0 tx=0x7f40b8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:37.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.807+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40c4047b00 con 0x7f40c8068820 2023-08-17T00:07:37.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.971+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40c80be1a0 con 0x7f40c8068820 2023-08-17T00:07:37.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.971+0000 7f40bdffb700 1 -- 172.21.15.153:0/1939775369 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f40c404b120 con 0x7f40c8068820 2023-08-17T00:07:37.978 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:37.978 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":78,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:37.048159+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:07:34.961847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T00:07:36.061106+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40ac05a150 msgr2=0x7f40ac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40ac05a150 0x7f40ac05c610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f40c80b99c0 tx=0x7f40b8016000).stop 2023-08-17T00:07:37.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 msgr2=0x7f40c80bfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:37.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 0x7f40c80bfe20 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f40c400c810 tx=0x7f40c4007e80).stop 2023-08-17T00:07:37.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 shutdown_connections 2023-08-17T00:07:37.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40ac05a150 0x7f40ac05c610 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40c80a96d0 0x7f40c80aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40c80a8df0 0x7f40c80bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 --2- 172.21.15.153:0/1939775369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40c8068820 0x7f40c80bfe20 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:37.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 >> 172.21.15.153:0/1939775369 conn(0x7f40c80c6620 msgr2=0x7f40c8157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:37.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 shutdown_connections 2023-08-17T00:07:37.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:37.975+0000 7f40ced07700 1 -- 172.21.15.153:0/1939775369 wait complete. 2023-08-17T00:07:38.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:07:38.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.155+0000 7f1e90e39700 1 Processor -- start 2023-08-17T00:07:38.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.155+0000 7f1e90e39700 1 -- start start 2023-08-17T00:07:38.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e90e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:38.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e90e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e8c0a8e60 0x7f1e8c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:38.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e90e39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e8c0ab9b0 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e90e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e8c0aada0 con 0x7f1e8c0a8e60 2023-08-17T00:07:38.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e90e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c0ab080 con 0x7f1e8c150880 2023-08-17T00:07:38.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e8bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e8c0aa8c0 0x7f1e8c0c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41468/0 (socket says 172.21.15.153:41468) 2023-08-17T00:07:38.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e82ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e8c0a8e60 0x7f1e8c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:38.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e8bfff700 1 -- 172.21.15.153:0/3833760916 learned_addr learned my addr 172.21.15.153:0/3833760916 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:38.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e8b7fe700 1 --2- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:38.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e82ffd700 1 -- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 msgr2=0x7f1e8c0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:38.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e82ffd700 1 --2- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c0a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:38.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e82ffd700 1 -- 172.21.15.153:0/3833760916 >> v1:172.21.15.153:6789/0 conn(0x7f1e8c0aa8c0 legacy=0x7f1e8c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:38.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e82ffd700 1 -- 172.21.15.153:0/3833760916 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c0ab360 con 0x7f1e8c0a8e60 2023-08-17T00:07:38.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.159+0000 7f1e82ffd700 1 --2- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c068820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f1e7400ba00 tx=0x7f1e7400b300).ready entity=mon.1 client_cookie=f119e79e7306d8c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:38.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e8affd700 1 -- 172.21.15.153:0/3833760916 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400b370 con 0x7f1e8c0a8e60 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e8affd700 1 -- 172.21.15.153:0/3833760916 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7400da70 con 0x7f1e8c0a8e60 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e8affd700 1 -- 172.21.15.153:0/3833760916 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7400ddf0 con 0x7f1e8c0a8e60 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 -- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 msgr2=0x7f1e8c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 --2- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c068820 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f1e7400ba00 tx=0x7f1e7400b300).stop 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 -- 172.21.15.153:0/3833760916 shutdown_connections 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 --2- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c068820 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:38.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 --2- 172.21.15.153:0/3833760916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c0a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 -- 172.21.15.153:0/3833760916 >> 172.21.15.153:0/3833760916 conn(0x7f1e8c0c6620 msgr2=0x7f1e8c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 -- 172.21.15.153:0/3833760916 shutdown_connections 2023-08-17T00:07:38.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.163+0000 7f1e90e39700 1 -- 172.21.15.153:0/3833760916 wait complete. 2023-08-17T00:07:38.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 Processor -- start 2023-08-17T00:07:38.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 -- start start 2023-08-17T00:07:38.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 0x7f1e8c1613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c150c60 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c151770 con 0x7f1e8c0a8e60 2023-08-17T00:07:38.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e90e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8c150e40 con 0x7f1e8c150880 2023-08-17T00:07:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e82ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 0x7f1e8c1613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e82ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 0x7f1e8c1613c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60492/0 (socket says 172.21.15.153:60492) 2023-08-17T00:07:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e82ffd700 1 -- 172.21.15.153:0/1233581626 learned_addr learned my addr 172.21.15.153:0/1233581626 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e8bfff700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:38.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.167+0000 7f1e8b7fe700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e82ffd700 1 -- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 msgr2=0x7f1e8c153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e82ffd700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e82ffd700 1 -- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 msgr2=0x7f1e8c1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e82ffd700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c1609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:38.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e82ffd700 1 -- 172.21.15.153:0/1233581626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7400b540 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e82ffd700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 0x7f1e8c1613c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f1e8c0669d0 tx=0x7f1e7400b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74020070 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74010e10 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74019680 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e8c151120 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.171+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e8c160ea0 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.175+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e8c063080 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.175+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1e7402c070 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.175+0000 7f1e83fff700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6c05a150 0x7f1e6c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.175+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1e740776d0 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.179+0000 7f1e8b7fe700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6c05a150 0x7f1e6c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:38.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.179+0000 7f1e8b7fe700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6c05a150 0x7f1e6c05c610 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f1e8c15de10 tx=0x7f1e7c006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.183+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e8c063080 con 0x7f1e8c0aa8c0 2023-08-17T00:07:38.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:38.379+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1e8c063080 con 0x7f1e8c0aa8c0 2023-08-17T00:07:39.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.179+0000 7f1e83fff700 1 -- 172.21.15.153:0/1233581626 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1e8c063080 con 0x7f1e8c0aa8c0 2023-08-17T00:07:39.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6c05a150 msgr2=0x7f1e6c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6c05a150 0x7f1e6c05c610 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f1e8c15de10 tx=0x7f1e7c006f40).stop 2023-08-17T00:07:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 msgr2=0x7f1e8c1613c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 0x7f1e8c1613c0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 rx=0x7f1e8c0669d0 tx=0x7f1e7400b300).stop 2023-08-17T00:07:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 shutdown_connections 2023-08-17T00:07:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6c05a150 0x7f1e6c05c610 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e8c150880 0x7f1e8c153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e8c0aa8c0 0x7f1e8c1613c0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 --2- 172.21.15.153:0/1233581626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e8c0a8e60 0x7f1e8c1609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 >> 172.21.15.153:0/1233581626 conn(0x7f1e8c0c6620 msgr2=0x7f1e8c14f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 shutdown_connections 2023-08-17T00:07:39.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.183+0000 7f1e90e39700 1 -- 172.21.15.153:0/1233581626 wait complete. 2023-08-17T00:07:39.209 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:07:39.210 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:07:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.367+0000 7f41d9a5b700 1 Processor -- start 2023-08-17T00:07:39.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.367+0000 7f41d9a5b700 1 -- start start 2023-08-17T00:07:39.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d9a5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41d40bc4d0 0x7f41d40a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d9a5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d4065240 con 0x7f41d40a8b70 2023-08-17T00:07:39.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d9a5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d40638a0 con 0x7f41d40632e0 2023-08-17T00:07:39.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d2ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f41d40a8b70 0x7f41d40656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41474/0 (socket says 172.21.15.153:41474) 2023-08-17T00:07:39.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d2ffd700 1 -- 172.21.15.153:0/1725123356 learned_addr learned my addr 172.21.15.153:0/1725123356 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:39.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1725123356 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d4065de0 con 0x7f41d40bc4d0 2023-08-17T00:07:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d37fe700 1 --2- 172.21.15.153:0/1725123356 >> v2:172.21.15.178:3300/0 conn(0x7f41d40bc4d0 0x7f41d40a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663925870 0 0) 0x7f41d4065240 con 0x7f41d40a8b70 2023-08-17T00:07:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c00033f0 con 0x7f41d40a8b70 2023-08-17T00:07:39.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162073533 0 0) 0x7f41d40638a0 con 0x7f41d40632e0 2023-08-17T00:07:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41d4065240 con 0x7f41d40632e0 2023-08-17T00:07:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1478404523 0 0) 0x7f41c00033f0 con 0x7f41d40a8b70 2023-08-17T00:07:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 >> v2:172.21.15.178:3300/0 conn(0x7f41d40bc4d0 msgr2=0x7f41d40a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 --2- 172.21.15.153:0/1725123356 >> v2:172.21.15.178:3300/0 conn(0x7f41d40bc4d0 0x7f41d40a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.371+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 >> v1:172.21.15.178:6789/0 conn(0x7f41d40632e0 legacy=0x7f41d40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d4064910 con 0x7f41d40a8b70 2023-08-17T00:07:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f41c40013f0 con 0x7f41d40a8b70 2023-08-17T00:07:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 >> v1:172.21.15.153:6789/0 conn(0x7f41d40a8b70 legacy=0x7f41d40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0003ac0 0x7f41c0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0004690 0x7f41c0004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41c0005000 0x7f41c000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d4065de0 con 0x7f41c0003ac0 2023-08-17T00:07:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c000bf60 con 0x7f41c0005000 2023-08-17T00:07:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c000c120 con 0x7f41c0004690 2023-08-17T00:07:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0003ac0 0x7f41c0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d37fe700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41c0005000 0x7f41c000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41ca7fc700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0004690 0x7f41c0004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 -- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0004690 msgr2=0x7f41c0004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0004690 0x7f41c0004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 -- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41c0005000 msgr2=0x7f41c000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41c0005000 0x7f41c000b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 -- 172.21.15.153:0/1725123356 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00033f0 con 0x7f41c0003ac0 2023-08-17T00:07:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d37fe700 1 -- 172.21.15.153:0/1725123356 reap_dead start 2023-08-17T00:07:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0003ac0 0x7f41c0003ec0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f41c4007f10 tx=0x7f41c4001cc0).ready entity=mon.0 client_cookie=9ac0fe577df2b613 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c40078a0 con 0x7f41c0003ac0 2023-08-17T00:07:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400c980 con 0x7f41c0003ac0 2023-08-17T00:07:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d27fc700 1 -- 172.21.15.153:0/1725123356 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400cd40 con 0x7f41c0003ac0 2023-08-17T00:07:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1725123356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0003ac0 msgr2=0x7f41c0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0003ac0 0x7f41c0003ec0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f41c4007f10 tx=0x7f41c4001cc0).stop 2023-08-17T00:07:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1725123356 shutdown_connections 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1725123356 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41c0003ac0 0x7f41c0003ec0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1725123356 >> 172.21.15.153:0/1725123356 conn(0x7f41d40c7150 msgr2=0x7f41d40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1725123356 shutdown_connections 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.375+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1725123356 wait complete. 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 Processor -- start 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 -- start start 2023-08-17T00:07:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0003ac0 0x7f41d414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d40aa060 0x7f41d40be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 0x7f41d40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40bd720 con 0x7f41d40beec0 2023-08-17T00:07:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40be540 con 0x7f41d40aa060 2023-08-17T00:07:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.379+0000 7f41d9a5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40bd930 con 0x7f41c0003ac0 2023-08-17T00:07:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 0x7f41d40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 0x7f41d40aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60502/0 (socket says 172.21.15.153:60502) 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 -- 172.21.15.153:0/1413221411 learned_addr learned my addr 172.21.15.153:0/1413221411 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d2ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0003ac0 0x7f41d414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41ca7fc700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d40aa060 0x7f41d40be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 -- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0003ac0 msgr2=0x7f41d414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0003ac0 0x7f41d414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 -- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d40aa060 msgr2=0x7f41d40be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d40aa060 0x7f41d40be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 -- 172.21.15.153:0/1413221411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40bdc10 con 0x7f41d40beec0 2023-08-17T00:07:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0003ac0 0x7f41d414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:07:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d37fe700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 0x7f41d40aaf40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f41d405e3f0 tx=0x7f41cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00e070 con 0x7f41d40beec0 2023-08-17T00:07:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc011b80 con 0x7f41d40beec0 2023-08-17T00:07:39.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d40bdef0 con 0x7f41d40beec0 2023-08-17T00:07:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc016450 con 0x7f41d40beec0 2023-08-17T00:07:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.383+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d40aa4c0 con 0x7f41d40beec0 2023-08-17T00:07:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.387+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d4068400 con 0x7f41d40beec0 2023-08-17T00:07:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.387+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f41cc01d030 con 0x7f41d40beec0 2023-08-17T00:07:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.387+0000 7f41cb7fe700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b405a150 0x7f41b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:39.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.387+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f41cc074530 con 0x7f41d40beec0 2023-08-17T00:07:39.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.387+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b405a150 0x7f41b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:39.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.391+0000 7f41d2ffd700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b405a150 0x7f41b405c610 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f41c4008fd0 tx=0x7f41c4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:39.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.395+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41d4068400 con 0x7f41d40beec0 2023-08-17T00:07:39.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:39.583+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f41d4068400 con 0x7f41d40beec0 2023-08-17T00:07:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.179+0000 7f41cb7fe700 1 -- 172.21.15.153:0/1413221411 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41d4068400 con 0x7f41d40beec0 2023-08-17T00:07:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b405a150 msgr2=0x7f41b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b405a150 0x7f41b405c610 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f41c4008fd0 tx=0x7f41c4015000).stop 2023-08-17T00:07:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 msgr2=0x7f41d40aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 0x7f41d40aaf40 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f41d405e3f0 tx=0x7f41cc00b040).stop 2023-08-17T00:07:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 shutdown_connections 2023-08-17T00:07:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41b405a150 0x7f41b405c610 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f41d40beec0 0x7f41d40aaf40 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41d40aa060 0x7f41d40be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 --2- 172.21.15.153:0/1413221411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41c0003ac0 0x7f41d414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 >> 172.21.15.153:0/1413221411 conn(0x7f41d40c7150 msgr2=0x7f41d40c2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 shutdown_connections 2023-08-17T00:07:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.187+0000 7f41d9a5b700 1 -- 172.21.15.153:0/1413221411 wait complete. 2023-08-17T00:07:40.213 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:07:40.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.363+0000 7f69563b9700 1 Processor -- start 2023-08-17T00:07:40.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f69563b9700 1 -- start start 2023-08-17T00:07:40.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f69563b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6950151c40 0x7f69501560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f69563b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6950065da0 con 0x7f6950068da0 2023-08-17T00:07:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f69563b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6950155c60 con 0x7f69500689c0 2023-08-17T00:07:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f69563b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6950069200 con 0x7f6950151c40 2023-08-17T00:07:40.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6954bb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6950068da0 0x7f6950151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41484/0 (socket says 172.21.15.153:41484) 2023-08-17T00:07:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6954bb6700 1 -- 172.21.15.153:0/940667207 learned_addr learned my addr 172.21.15.153:0/940667207 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:40.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6955bb8700 1 --2- 172.21.15.153:0/940667207 >> v2:172.21.15.153:3300/0 conn(0x7f6950151c40 0x7f69501560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6947fff700 1 -- 172.21.15.153:0/940667207 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537579476 0 0) 0x7f6950155c60 con 0x7f69500689c0 2023-08-17T00:07:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6947fff700 1 -- 172.21.15.153:0/940667207 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f693c0033f0 con 0x7f69500689c0 2023-08-17T00:07:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6955bb8700 1 -- 172.21.15.153:0/940667207 >> v1:172.21.15.178:6789/0 conn(0x7f69500689c0 legacy=0x7f69500c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6955bb8700 1 -- 172.21.15.153:0/940667207 >> v1:172.21.15.153:6789/0 conn(0x7f6950068da0 legacy=0x7f6950151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6947fff700 1 -- 172.21.15.153:0/940667207 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884338217 0 0) 0x7f6950065da0 con 0x7f6950068da0 2023-08-17T00:07:40.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.367+0000 7f6955bb8700 1 -- 172.21.15.153:0/940667207 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950065ff0 con 0x7f6950151c40 2023-08-17T00:07:40.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f6955bb8700 1 --2- 172.21.15.153:0/940667207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950151c40 0x7f69501560f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f6948009e60 tx=0x7f6948009780).ready entity=mon.0 client_cookie=50657dcc2cb71a08 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:40.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f6947fff700 1 -- 172.21.15.153:0/940667207 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800e070 con 0x7f6950151c40 2023-08-17T00:07:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f6947fff700 1 -- 172.21.15.153:0/940667207 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694800bb60 con 0x7f6950151c40 2023-08-17T00:07:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f6947fff700 1 -- 172.21.15.153:0/940667207 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694800bee0 con 0x7f6950151c40 2023-08-17T00:07:40.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 -- 172.21.15.153:0/940667207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950151c40 msgr2=0x7f69501560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 --2- 172.21.15.153:0/940667207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950151c40 0x7f69501560f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f6948009e60 tx=0x7f6948009780).stop 2023-08-17T00:07:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 -- 172.21.15.153:0/940667207 shutdown_connections 2023-08-17T00:07:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 --2- 172.21.15.153:0/940667207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950151c40 0x7f69501560f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 -- 172.21.15.153:0/940667207 >> 172.21.15.153:0/940667207 conn(0x7f69500c6620 msgr2=0x7f69500c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:40.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 -- 172.21.15.153:0/940667207 shutdown_connections 2023-08-17T00:07:40.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.371+0000 7f69563b9700 1 -- 172.21.15.153:0/940667207 wait complete. 2023-08-17T00:07:40.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 Processor -- start 2023-08-17T00:07:40.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 -- start start 2023-08-17T00:07:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69500689c0 0x7f69500a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 0x7f69500a3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6950151c40 0x7f69500a8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500a4760 con 0x7f6950068da0 2023-08-17T00:07:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500a5560 con 0x7f69500689c0 2023-08-17T00:07:40.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69563b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500a4060 con 0x7f6950151c40 2023-08-17T00:07:40.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f6954bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 0x7f69500a3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f69553b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69500689c0 0x7f69500a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f6954bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 0x7f69500a3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60510/0 (socket says 172.21.15.153:60510) 2023-08-17T00:07:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f6954bb6700 1 -- 172.21.15.153:0/1052063158 learned_addr learned my addr 172.21.15.153:0/1052063158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.375+0000 7f6955bb8700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6950151c40 0x7f69500a8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f6954bb6700 1 -- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6950151c40 msgr2=0x7f69500a8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f6954bb6700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6950151c40 0x7f69500a8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f6954bb6700 1 -- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69500689c0 msgr2=0x7f69500a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f6954bb6700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69500689c0 0x7f69500a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f6954bb6700 1 -- 172.21.15.153:0/1052063158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948009a20 con 0x7f6950068da0 2023-08-17T00:07:40.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f6954bb6700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 0x7f69500a3b70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f6940001eb0 tx=0x7f6940007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:40.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400070d0 con 0x7f6950068da0 2023-08-17T00:07:40.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6940007230 con 0x7f6950068da0 2023-08-17T00:07:40.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69500a59f0 con 0x7f6950068da0 2023-08-17T00:07:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400075d0 con 0x7f6950068da0 2023-08-17T00:07:40.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500a4c30 con 0x7f6950068da0 2023-08-17T00:07:40.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.379+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695006b4c0 con 0x7f6950068da0 2023-08-17T00:07:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.383+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6940010070 con 0x7f6950068da0 2023-08-17T00:07:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.383+0000 7f69457fa700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f693405a150 0x7f693405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.383+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6940073770 con 0x7f6950068da0 2023-08-17T00:07:40.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.383+0000 7f69553b7700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f693405a150 0x7f693405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.387+0000 7f69553b7700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f693405a150 0x7f693405c610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f694c000c00 tx=0x7f694c007ba0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:40.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.387+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6940047110 con 0x7f6950068da0 2023-08-17T00:07:40.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.583+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6950064010 con 0x7f6950068da0 2023-08-17T00:07:40.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.583+0000 7f69457fa700 1 -- 172.21.15.153:0/1052063158 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4500 (secure 0 0 0) 0x7f694004a730 con 0x7f6950068da0 2023-08-17T00:07:40.590 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:40.590 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":62,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:07:37.048946+0000","modified":"2023-08-17T00:07:40.179113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2081650727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2081650727},{"type":"v1","addr":"172.21.15.153:6835","nonce":2081650727}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T00:07:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f693405a150 msgr2=0x7f693405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f693405a150 0x7f693405c610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f694c000c00 tx=0x7f694c007ba0).stop 2023-08-17T00:07:40.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 msgr2=0x7f69500a3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 0x7f69500a3b70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f6940001eb0 tx=0x7f6940007e90).stop 2023-08-17T00:07:40.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 shutdown_connections 2023-08-17T00:07:40.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f693405a150 0x7f693405c610 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6950151c40 0x7f69500a8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6950068da0 0x7f69500a3b70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 --2- 172.21.15.153:0/1052063158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69500689c0 0x7f69500a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 >> 172.21.15.153:0/1052063158 conn(0x7f69500c6620 msgr2=0x7f69500c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:40.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 shutdown_connections 2023-08-17T00:07:40.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.587+0000 7f69563b9700 1 -- 172.21.15.153:0/1052063158 wait complete. 2023-08-17T00:07:40.595 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 62 2023-08-17T00:07:40.614 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:07:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.763+0000 7ff2d92f1700 1 Processor -- start 2023-08-17T00:07:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.763+0000 7ff2d92f1700 1 -- start start 2023-08-17T00:07:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d92f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2d40a6f60 0x7ff2d40ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d92f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40bce10 0x7ff2d41555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d92f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d4065b30 con 0x7ff2d40a7340 2023-08-17T00:07:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d92f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d40ac1c0 con 0x7ff2d40a6f60 2023-08-17T00:07:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d92f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40ada60 con 0x7ff2d40bce10 2023-08-17T00:07:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d27fc700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff2d40a7340 0x7ff2d40aaf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:53886/0 (socket says 172.21.15.153:53886) 2023-08-17T00:07:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d27fc700 1 -- 172.21.15.153:0/2667938618 learned_addr learned my addr 172.21.15.153:0/2667938618 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d3fff700 1 --2- 172.21.15.153:0/2667938618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40bce10 0x7ff2d41555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d2ffd700 1 --2- 172.21.15.153:0/2667938618 >> v2:172.21.15.178:3300/0 conn(0x7ff2d40a6f60 0x7ff2d40ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d1ffb700 1 -- 172.21.15.153:0/2667938618 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442899535 0 0) 0x7ff2d4065b30 con 0x7ff2d40a7340 2023-08-17T00:07:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d1ffb700 1 -- 172.21.15.153:0/2667938618 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2bc0033f0 con 0x7ff2d40a7340 2023-08-17T00:07:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d3fff700 1 -- 172.21.15.153:0/2667938618 >> v2:172.21.15.178:3300/0 conn(0x7ff2d40a6f60 msgr2=0x7ff2d40ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d3fff700 1 --2- 172.21.15.153:0/2667938618 >> v2:172.21.15.178:3300/0 conn(0x7ff2d40a6f60 0x7ff2d40ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d3fff700 1 -- 172.21.15.153:0/2667938618 >> v1:172.21.15.178:6789/0 conn(0x7ff2d40a7340 legacy=0x7ff2d40aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d3fff700 1 -- 172.21.15.153:0/2667938618 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d4067b80 con 0x7ff2d40bce10 2023-08-17T00:07:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.767+0000 7ff2d3fff700 1 --2- 172.21.15.153:0/2667938618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40bce10 0x7ff2d41555e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff2cc009e60 tx=0x7ff2cc009780).ready entity=mon.2 client_cookie=6afcc5c6c64774dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d1ffb700 1 -- 172.21.15.153:0/2667938618 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00e070 con 0x7ff2d40bce10 2023-08-17T00:07:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d1ffb700 1 -- 172.21.15.153:0/2667938618 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00bab0 con 0x7ff2d40bce10 2023-08-17T00:07:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d1ffb700 1 -- 172.21.15.153:0/2667938618 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00be30 con 0x7ff2d40bce10 2023-08-17T00:07:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 -- 172.21.15.153:0/2667938618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40bce10 msgr2=0x7ff2d41555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/2667938618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40bce10 0x7ff2d41555e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7ff2cc009e60 tx=0x7ff2cc009780).stop 2023-08-17T00:07:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 -- 172.21.15.153:0/2667938618 shutdown_connections 2023-08-17T00:07:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/2667938618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40bce10 0x7ff2d41555e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/2667938618 >> v2:172.21.15.178:3300/0 conn(0x7ff2d40a6f60 0x7ff2d40ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 -- 172.21.15.153:0/2667938618 >> 172.21.15.153:0/2667938618 conn(0x7ff2d40c4950 msgr2=0x7ff2d40c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 -- 172.21.15.153:0/2667938618 shutdown_connections 2023-08-17T00:07:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 -- 172.21.15.153:0/2667938618 wait complete. 2023-08-17T00:07:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.771+0000 7ff2d92f1700 1 Processor -- start 2023-08-17T00:07:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 -- start start 2023-08-17T00:07:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 0x7ff2d40a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40a7340 0x7ff2d4149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40bce10 0x7ff2d40a8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40a7fd0 con 0x7ff2d40a6f60 2023-08-17T00:07:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4149640 con 0x7ff2d40bce10 2023-08-17T00:07:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4063180 con 0x7ff2d40a7340 2023-08-17T00:07:40.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 0x7ff2d40a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 0x7ff2d40a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60518/0 (socket says 172.21.15.153:60518) 2023-08-17T00:07:40.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 -- 172.21.15.153:0/1109883424 learned_addr learned my addr 172.21.15.153:0/1109883424 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:40.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d27fc700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40a7340 0x7ff2d4149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d3fff700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40bce10 0x7ff2d40a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 -- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40a7340 msgr2=0x7ff2d4149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40a7340 0x7ff2d4149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 -- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40bce10 msgr2=0x7ff2d40a8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40bce10 0x7ff2d40a8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 -- 172.21.15.153:0/1109883424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc009a20 con 0x7ff2d40a6f60 2023-08-17T00:07:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d2ffd700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 0x7ff2d40a7ae0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7ff2c400e960 tx=0x7ff2c4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4012600 con 0x7ff2d40a6f60 2023-08-17T00:07:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c4012760 con 0x7ff2d40a6f60 2023-08-17T00:07:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d414ed60 con 0x7ff2d40a6f60 2023-08-17T00:07:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4012ae0 con 0x7ff2d40a6f60 2023-08-17T00:07:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.775+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d414f320 con 0x7ff2d40a6f60 2023-08-17T00:07:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.779+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff2c4022070 con 0x7ff2d40a6f60 2023-08-17T00:07:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.779+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d414f510 con 0x7ff2d40a6f60 2023-08-17T00:07:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.779+0000 7ff2baffd700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff2c005a150 0x7ff2c005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:40.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.779+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff2c40744a0 con 0x7ff2d40a6f60 2023-08-17T00:07:40.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.783+0000 7ff2d27fc700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff2c005a150 0x7ff2c005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:40.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.783+0000 7ff2d27fc700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff2c005a150 0x7ff2c005c610 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff2d4091310 tx=0x7ff2c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:40.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.787+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff2c4047e40 con 0x7ff2d40a6f60 2023-08-17T00:07:40.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.943+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2d406b530 con 0x7ff2d40a6f60 2023-08-17T00:07:40.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.943+0000 7ff2baffd700 1 -- 172.21.15.153:0/1109883424 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16979 (secure 0 0 0) 0x7ff2c404b460 con 0x7ff2d40a6f60 2023-08-17T00:07:40.951 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:40.952 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":79,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:07:38.053474+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:07:34.961847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T00:07:36.061106+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:07:40.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff2c005a150 msgr2=0x7ff2c005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff2c005a150 0x7ff2c005c610 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7ff2d4091310 tx=0x7ff2c8009040).stop 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 msgr2=0x7ff2d40a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 0x7ff2d40a7ae0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7ff2c400e960 tx=0x7ff2c4009060).stop 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 shutdown_connections 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff2c005a150 0x7ff2c005c610 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d40bce10 0x7ff2d40a8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d40a7340 0x7ff2d4149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 --2- 172.21.15.153:0/1109883424 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2d40a6f60 0x7ff2d40a7ae0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:40.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 >> 172.21.15.153:0/1109883424 conn(0x7ff2d40c4950 msgr2=0x7ff2d40a4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:40.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 shutdown_connections 2023-08-17T00:07:40.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:40.947+0000 7ff2d92f1700 1 -- 172.21.15.153:0/1109883424 wait complete. 2023-08-17T00:07:40.973 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:07:40.973 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:07:41.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 Processor -- start 2023-08-17T00:07:41.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 -- start start 2023-08-17T00:07:41.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3080689c0 0x7fb308068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb308151530 0x7fb3081519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb308065da0 con 0x7fb3081560f0 2023-08-17T00:07:41.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb308155c60 con 0x7fb308151530 2023-08-17T00:07:41.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30d039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb308156550 con 0x7fb3080689c0 2023-08-17T00:07:41.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb307fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3080689c0 0x7fb308068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb307fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3080689c0 0x7fb308068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:35540/0 (socket says 172.21.15.153:35540) 2023-08-17T00:07:41.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb307fff700 1 -- 172.21.15.153:0/629691614 learned_addr learned my addr 172.21.15.153:0/629691614 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:41.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb30c838700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb308151530 0x7fb3081519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.127+0000 7fb2fffff700 1 --1- 172.21.15.153:0/629691614 >> v1:172.21.15.178:6789/0 conn(0x7fb3081560f0 0x7fb3080c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:53892/0 (socket says 172.21.15.153:53892) 2023-08-17T00:07:41.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb3077fe700 1 -- 172.21.15.153:0/629691614 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452849159 0 0) 0x7fb308065da0 con 0x7fb3081560f0 2023-08-17T00:07:41.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb3077fe700 1 -- 172.21.15.153:0/629691614 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f40033f0 con 0x7fb3081560f0 2023-08-17T00:07:41.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30c838700 1 -- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3080689c0 msgr2=0x7fb308068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:41.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30c838700 1 --2- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3080689c0 0x7fb308068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30c838700 1 -- 172.21.15.153:0/629691614 >> v1:172.21.15.178:6789/0 conn(0x7fb3081560f0 legacy=0x7fb3080c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30c838700 1 -- 172.21.15.153:0/629691614 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308065ff0 con 0x7fb308151530 2023-08-17T00:07:41.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30c838700 1 --2- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb308151530 0x7fb3081519e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb300009e90 tx=0x7fb300009780).ready entity=mon.1 client_cookie=b2a5e29e871d57 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb3077fe700 1 -- 172.21.15.153:0/629691614 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000e070 con 0x7fb308151530 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb3077fe700 1 -- 172.21.15.153:0/629691614 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000ba70 con 0x7fb308151530 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb3077fe700 1 -- 172.21.15.153:0/629691614 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000bdf0 con 0x7fb308151530 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 -- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb308151530 msgr2=0x7fb3081519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 --2- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb308151530 0x7fb3081519e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fb300009e90 tx=0x7fb300009780).stop 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 -- 172.21.15.153:0/629691614 shutdown_connections 2023-08-17T00:07:41.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 --2- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb308151530 0x7fb3081519e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 --2- 172.21.15.153:0/629691614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3080689c0 0x7fb308068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 -- 172.21.15.153:0/629691614 >> 172.21.15.153:0/629691614 conn(0x7fb3080c6620 msgr2=0x7fb3080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:41.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 -- 172.21.15.153:0/629691614 shutdown_connections 2023-08-17T00:07:41.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.131+0000 7fb30d039700 1 -- 172.21.15.153:0/629691614 wait complete. 2023-08-17T00:07:41.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.135+0000 7fb30d039700 1 Processor -- start 2023-08-17T00:07:41.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.135+0000 7fb30d039700 1 -- start start 2023-08-17T00:07:41.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.135+0000 7fb30d039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3080689c0 0x7fb308144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.135+0000 7fb30d039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb308151530 0x7fb308153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30d039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 0x7fb3080bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30d039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080c0a80 con 0x7fb3081560f0 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30d039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080c1600 con 0x7fb3080689c0 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30d039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb308145020 con 0x7fb308151530 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 0x7fb3080bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 0x7fb3080bc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60526/0 (socket says 172.21.15.153:60526) 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 -- 172.21.15.153:0/2939410884 learned_addr learned my addr 172.21.15.153:0/2939410884 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb307fff700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3080689c0 0x7fb308144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb2fffff700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb308151530 0x7fb308153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 -- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb308151530 msgr2=0x7fb308153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb308151530 0x7fb308153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 -- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3080689c0 msgr2=0x7fb308144b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3080689c0 0x7fb308144b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 -- 172.21.15.153:0/2939410884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300009a20 con 0x7fb3081560f0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30c838700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 0x7fb3080bc0e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fb300013ce0 tx=0x7fb300009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30001d630 con 0x7fb3081560f0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30001d790 con 0x7fb3081560f0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3080c1a90 con 0x7fb3081560f0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30001db50 con 0x7fb3081560f0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.139+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3080c0fb0 con 0x7fb3081560f0 2023-08-17T00:07:41.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.143+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3080c07e0 con 0x7fb3081560f0 2023-08-17T00:07:41.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.143+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb300027460 con 0x7fb3081560f0 2023-08-17T00:07:41.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.143+0000 7fb304ff9700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2e805a150 0x7fb2e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.143+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb300076480 con 0x7fb3081560f0 2023-08-17T00:07:41.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.143+0000 7fb307fff700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2e805a150 0x7fb2e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.147+0000 7fb307fff700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2e805a150 0x7fb2e805c610 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fb2f8009b80 tx=0x7fb2f8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:41.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.151+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3080c07e0 con 0x7fb3081560f0 2023-08-17T00:07:41.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.307+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3080c07e0 con 0x7fb2e805a150 2023-08-17T00:07:41.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.323+0000 7fb304ff9700 1 -- 172.21.15.153:0/2939410884 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359550 (secure 0 0 0) 0x7fb3080c07e0 con 0x7fb2e805a150 2023-08-17T00:07:41.334 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:41.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2e805a150 msgr2=0x7fb2e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2e805a150 0x7fb2e805c610 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fb2f8009b80 tx=0x7fb2f8009060).stop 2023-08-17T00:07:41.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 msgr2=0x7fb3080bc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 0x7fb3080bc0e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fb300013ce0 tx=0x7fb300009780).stop 2023-08-17T00:07:41.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 shutdown_connections 2023-08-17T00:07:41.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb2e805a150 0x7fb2e805c610 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3081560f0 0x7fb3080bc0e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb308151530 0x7fb308153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 --2- 172.21.15.153:0/2939410884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3080689c0 0x7fb308144b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.331+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 >> 172.21.15.153:0/2939410884 conn(0x7fb3080c6620 msgr2=0x7fb3080a8990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:41.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.335+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 shutdown_connections 2023-08-17T00:07:41.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.335+0000 7fb30d039700 1 -- 172.21.15.153:0/2939410884 wait complete. 2023-08-17T00:07:41.341 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:07:41.360 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-08-17T00:07:41.277875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470276,"kb_used_data":7492,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752504444,"statfs":{"total":773094113280,"available":770564550656,"internally_reserved":0,"allocated":7671808,"data_stored":3467572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15872,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-54,"num_read_kb":-56,"num_write":-77,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.159238"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086283+0000","last_change":"2023-08-17T00:07:37.072975+0000","last_active":"2023-08-17T00:07:37.086283+0000","last_peered":"2023-08-17T00:07:37.086283+0000","last_clean":"2023-08-17T00:07:37.086283+0000","last_became_active":"2023-08-17T00:07:37.072700+0000","last_became_peered":"2023-08-17T00:07:37.072700+0000","last_unstale":"2023-08-17T00:07:37.086283+0000","last_undegraded":"2023-08-17T00:07:37.086283+0000","last_fullsized":"2023-08-17T00:07:37.086283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3f","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.094511+0000","last_change":"2023-08-17T00:07:36.632509+0000","last_active":"2023-08-17T00:07:37.094511+0000","last_peered":"2023-08-17T00:07:37.094511+0000","last_clean":"2023-08-17T00:07:37.094511+0000","last_became_active":"2023-08-17T00:07:36.632231+0000","last_became_peered":"2023-08-17T00:07:36.632231+0000","last_unstale":"2023-08-17T00:07:37.094511+0000","last_undegraded":"2023-08-17T00:07:37.094511+0000","last_fullsized":"2023-08-17T00:07:37.094511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095431+0000","last_change":"2023-08-17T00:07:37.091098+0000","last_active":"2023-08-17T00:07:37.095431+0000","last_peered":"2023-08-17T00:07:37.095431+0000","last_clean":"2023-08-17T00:07:37.095431+0000","last_became_active":"2023-08-17T00:07:37.090545+0000","last_became_peered":"2023-08-17T00:07:37.090545+0000","last_unstale":"2023-08-17T00:07:37.095431+0000","last_undegraded":"2023-08-17T00:07:37.095431+0000","last_fullsized":"2023-08-17T00:07:37.095431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.073022+0000","last_change":"2023-08-17T00:07:36.649374+0000","last_active":"2023-08-17T00:07:37.073022+0000","last_peered":"2023-08-17T00:07:37.073022+0000","last_clean":"2023-08-17T00:07:37.073022+0000","last_became_active":"2023-08-17T00:07:36.649100+0000","last_became_peered":"2023-08-17T00:07:36.649100+0000","last_unstale":"2023-08-17T00:07:37.073022+0000","last_undegraded":"2023-08-17T00:07:37.073022+0000","last_fullsized":"2023-08-17T00:07:37.073022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088839+0000","last_change":"2023-08-17T00:07:37.082284+0000","last_active":"2023-08-17T00:07:37.088839+0000","last_peered":"2023-08-17T00:07:37.088839+0000","last_clean":"2023-08-17T00:07:37.088839+0000","last_became_active":"2023-08-17T00:07:37.081124+0000","last_became_peered":"2023-08-17T00:07:37.081124+0000","last_unstale":"2023-08-17T00:07:37.088839+0000","last_undegraded":"2023-08-17T00:07:37.088839+0000","last_fullsized":"2023-08-17T00:07:37.088839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.066221+0000","last_change":"2023-08-17T00:07:36.646540+0000","last_active":"2023-08-17T00:07:37.066221+0000","last_peered":"2023-08-17T00:07:37.066221+0000","last_clean":"2023-08-17T00:07:37.066221+0000","last_became_active":"2023-08-17T00:07:36.646218+0000","last_became_peered":"2023-08-17T00:07:36.646218+0000","last_unstale":"2023-08-17T00:07:37.066221+0000","last_undegraded":"2023-08-17T00:07:37.066221+0000","last_fullsized":"2023-08-17T00:07:37.066221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090945+0000","last_change":"2023-08-17T00:07:37.083315+0000","last_active":"2023-08-17T00:07:37.090945+0000","last_peered":"2023-08-17T00:07:37.090945+0000","last_clean":"2023-08-17T00:07:37.090945+0000","last_became_active":"2023-08-17T00:07:37.081759+0000","last_became_peered":"2023-08-17T00:07:37.081759+0000","last_unstale":"2023-08-17T00:07:37.090945+0000","last_undegraded":"2023-08-17T00:07:37.090945+0000","last_fullsized":"2023-08-17T00:07:37.090945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088212+0000","last_change":"2023-08-17T00:07:36.646534+0000","last_active":"2023-08-17T00:07:37.088212+0000","last_peered":"2023-08-17T00:07:37.088212+0000","last_clean":"2023-08-17T00:07:37.088212+0000","last_became_active":"2023-08-17T00:07:36.646276+0000","last_became_peered":"2023-08-17T00:07:36.646276+0000","last_unstale":"2023-08-17T00:07:37.088212+0000","last_undegraded":"2023-08-17T00:07:37.088212+0000","last_fullsized":"2023-08-17T00:07:37.088212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095446+0000","last_change":"2023-08-17T00:07:37.090971+0000","last_active":"2023-08-17T00:07:37.095446+0000","last_peered":"2023-08-17T00:07:37.095446+0000","last_clean":"2023-08-17T00:07:37.095446+0000","last_became_active":"2023-08-17T00:07:37.090679+0000","last_became_peered":"2023-08-17T00:07:37.090679+0000","last_unstale":"2023-08-17T00:07:37.095446+0000","last_undegraded":"2023-08-17T00:07:37.095446+0000","last_fullsized":"2023-08-17T00:07:37.095446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082630+0000","last_change":"2023-08-17T00:07:36.640222+0000","last_active":"2023-08-17T00:07:37.082630+0000","last_peered":"2023-08-17T00:07:37.082630+0000","last_clean":"2023-08-17T00:07:37.082630+0000","last_became_active":"2023-08-17T00:07:36.639917+0000","last_became_peered":"2023-08-17T00:07:36.639917+0000","last_unstale":"2023-08-17T00:07:37.082630+0000","last_undegraded":"2023-08-17T00:07:37.082630+0000","last_fullsized":"2023-08-17T00:07:37.082630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087892+0000","last_change":"2023-08-17T00:07:37.074954+0000","last_active":"2023-08-17T00:07:37.087892+0000","last_peered":"2023-08-17T00:07:37.087892+0000","last_clean":"2023-08-17T00:07:37.087892+0000","last_became_active":"2023-08-17T00:07:37.071632+0000","last_became_peered":"2023-08-17T00:07:37.071632+0000","last_unstale":"2023-08-17T00:07:37.087892+0000","last_undegraded":"2023-08-17T00:07:37.087892+0000","last_fullsized":"2023-08-17T00:07:37.087892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082219+0000","last_change":"2023-08-17T00:07:36.641729+0000","last_active":"2023-08-17T00:07:37.082219+0000","last_peered":"2023-08-17T00:07:37.082219+0000","last_clean":"2023-08-17T00:07:37.082219+0000","last_became_active":"2023-08-17T00:07:36.641444+0000","last_became_peered":"2023-08-17T00:07:36.641444+0000","last_unstale":"2023-08-17T00:07:37.082219+0000","last_undegraded":"2023-08-17T00:07:37.082219+0000","last_fullsized":"2023-08-17T00:07:37.082219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088112+0000","last_change":"2023-08-17T00:07:37.081273+0000","last_active":"2023-08-17T00:07:37.088112+0000","last_peered":"2023-08-17T00:07:37.088112+0000","last_clean":"2023-08-17T00:07:37.088112+0000","last_became_active":"2023-08-17T00:07:37.080986+0000","last_became_peered":"2023-08-17T00:07:37.080986+0000","last_unstale":"2023-08-17T00:07:37.088112+0000","last_undegraded":"2023-08-17T00:07:37.088112+0000","last_fullsized":"2023-08-17T00:07:37.088112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.077753+0000","last_change":"2023-08-17T00:07:36.632382+0000","last_active":"2023-08-17T00:07:37.077753+0000","last_peered":"2023-08-17T00:07:37.077753+0000","last_clean":"2023-08-17T00:07:37.077753+0000","last_became_active":"2023-08-17T00:07:36.632120+0000","last_became_peered":"2023-08-17T00:07:36.632120+0000","last_unstale":"2023-08-17T00:07:37.077753+0000","last_undegraded":"2023-08-17T00:07:37.077753+0000","last_fullsized":"2023-08-17T00:07:37.077753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088235+0000","last_change":"2023-08-17T00:07:37.085333+0000","last_active":"2023-08-17T00:07:37.088235+0000","last_peered":"2023-08-17T00:07:37.088235+0000","last_clean":"2023-08-17T00:07:37.088235+0000","last_became_active":"2023-08-17T00:07:37.084685+0000","last_became_peered":"2023-08-17T00:07:37.084685+0000","last_unstale":"2023-08-17T00:07:37.088235+0000","last_undegraded":"2023-08-17T00:07:37.088235+0000","last_fullsized":"2023-08-17T00:07:37.088235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069079+0000","last_change":"2023-08-17T00:07:36.632436+0000","last_active":"2023-08-17T00:07:37.069079+0000","last_peered":"2023-08-17T00:07:37.069079+0000","last_clean":"2023-08-17T00:07:37.069079+0000","last_became_active":"2023-08-17T00:07:36.632123+0000","last_became_peered":"2023-08-17T00:07:36.632123+0000","last_unstale":"2023-08-17T00:07:37.069079+0000","last_undegraded":"2023-08-17T00:07:37.069079+0000","last_fullsized":"2023-08-17T00:07:37.069079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.097576+0000","last_change":"2023-08-17T00:07:37.094337+0000","last_active":"2023-08-17T00:07:37.097576+0000","last_peered":"2023-08-17T00:07:37.097576+0000","last_clean":"2023-08-17T00:07:37.097576+0000","last_became_active":"2023-08-17T00:07:37.094067+0000","last_became_peered":"2023-08-17T00:07:37.094067+0000","last_unstale":"2023-08-17T00:07:37.097576+0000","last_undegraded":"2023-08-17T00:07:37.097576+0000","last_fullsized":"2023-08-17T00:07:37.097576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065981+0000","last_change":"2023-08-17T00:07:36.635216+0000","last_active":"2023-08-17T00:07:37.065981+0000","last_peered":"2023-08-17T00:07:37.065981+0000","last_clean":"2023-08-17T00:07:37.065981+0000","last_became_active":"2023-08-17T00:07:36.634929+0000","last_became_peered":"2023-08-17T00:07:36.634929+0000","last_unstale":"2023-08-17T00:07:37.065981+0000","last_undegraded":"2023-08-17T00:07:37.065981+0000","last_fullsized":"2023-08-17T00:07:37.065981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088275+0000","last_change":"2023-08-17T00:07:37.077038+0000","last_active":"2023-08-17T00:07:37.088275+0000","last_peered":"2023-08-17T00:07:37.088275+0000","last_clean":"2023-08-17T00:07:37.088275+0000","last_became_active":"2023-08-17T00:07:37.076753+0000","last_became_peered":"2023-08-17T00:07:37.076753+0000","last_unstale":"2023-08-17T00:07:37.088275+0000","last_undegraded":"2023-08-17T00:07:37.088275+0000","last_fullsized":"2023-08-17T00:07:37.088275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068498+0000","last_change":"2023-08-17T00:07:36.633366+0000","last_active":"2023-08-17T00:07:37.068498+0000","last_peered":"2023-08-17T00:07:37.068498+0000","last_clean":"2023-08-17T00:07:37.068498+0000","last_became_active":"2023-08-17T00:07:36.633078+0000","last_became_peered":"2023-08-17T00:07:36.633078+0000","last_unstale":"2023-08-17T00:07:37.068498+0000","last_undegraded":"2023-08-17T00:07:37.068498+0000","last_fullsized":"2023-08-17T00:07:37.068498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090138+0000","last_change":"2023-08-17T00:07:37.081653+0000","last_active":"2023-08-17T00:07:37.090138+0000","last_peered":"2023-08-17T00:07:37.090138+0000","last_clean":"2023-08-17T00:07:37.090138+0000","last_became_active":"2023-08-17T00:07:37.080990+0000","last_became_peered":"2023-08-17T00:07:37.080990+0000","last_unstale":"2023-08-17T00:07:37.090138+0000","last_undegraded":"2023-08-17T00:07:37.090138+0000","last_fullsized":"2023-08-17T00:07:37.090138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069951+0000","last_change":"2023-08-17T00:07:36.633459+0000","last_active":"2023-08-17T00:07:37.069951+0000","last_peered":"2023-08-17T00:07:37.069951+0000","last_clean":"2023-08-17T00:07:37.069951+0000","last_became_active":"2023-08-17T00:07:36.633172+0000","last_became_peered":"2023-08-17T00:07:36.633172+0000","last_unstale":"2023-08-17T00:07:37.069951+0000","last_undegraded":"2023-08-17T00:07:37.069951+0000","last_fullsized":"2023-08-17T00:07:37.069951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087775+0000","last_change":"2023-08-17T00:07:37.076565+0000","last_active":"2023-08-17T00:07:37.087775+0000","last_peered":"2023-08-17T00:07:37.087775+0000","last_clean":"2023-08-17T00:07:37.087775+0000","last_became_active":"2023-08-17T00:07:37.076267+0000","last_became_peered":"2023-08-17T00:07:37.076267+0000","last_unstale":"2023-08-17T00:07:37.087775+0000","last_undegraded":"2023-08-17T00:07:37.087775+0000","last_fullsized":"2023-08-17T00:07:37.087775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.34","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090064+0000","last_change":"2023-08-17T00:07:36.627426+0000","last_active":"2023-08-17T00:07:37.090064+0000","last_peered":"2023-08-17T00:07:37.090064+0000","last_clean":"2023-08-17T00:07:37.090064+0000","last_became_active":"2023-08-17T00:07:36.627120+0000","last_became_peered":"2023-08-17T00:07:36.627120+0000","last_unstale":"2023-08-17T00:07:37.090064+0000","last_undegraded":"2023-08-17T00:07:37.090064+0000","last_fullsized":"2023-08-17T00:07:37.090064+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.074255+0000","last_change":"2023-08-17T00:07:37.067977+0000","last_active":"2023-08-17T00:07:37.074255+0000","last_peered":"2023-08-17T00:07:37.074255+0000","last_clean":"2023-08-17T00:07:37.074255+0000","last_became_active":"2023-08-17T00:07:37.067719+0000","last_became_peered":"2023-08-17T00:07:37.067719+0000","last_unstale":"2023-08-17T00:07:37.074255+0000","last_undegraded":"2023-08-17T00:07:37.074255+0000","last_fullsized":"2023-08-17T00:07:37.074255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.33","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086987+0000","last_change":"2023-08-17T00:07:36.646360+0000","last_active":"2023-08-17T00:07:37.086987+0000","last_peered":"2023-08-17T00:07:37.086987+0000","last_clean":"2023-08-17T00:07:37.086987+0000","last_became_active":"2023-08-17T00:07:36.646076+0000","last_became_peered":"2023-08-17T00:07:36.646076+0000","last_unstale":"2023-08-17T00:07:37.086987+0000","last_undegraded":"2023-08-17T00:07:37.086987+0000","last_fullsized":"2023-08-17T00:07:37.086987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.075971+0000","last_change":"2023-08-17T00:07:37.069959+0000","last_active":"2023-08-17T00:07:37.075971+0000","last_peered":"2023-08-17T00:07:37.075971+0000","last_clean":"2023-08-17T00:07:37.075971+0000","last_became_active":"2023-08-17T00:07:37.069595+0000","last_became_peered":"2023-08-17T00:07:37.069595+0000","last_unstale":"2023-08-17T00:07:37.075971+0000","last_undegraded":"2023-08-17T00:07:37.075971+0000","last_fullsized":"2023-08-17T00:07:37.075971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.061803+0000","last_change":"2023-08-17T00:07:36.624042+0000","last_active":"2023-08-17T00:07:37.061803+0000","last_peered":"2023-08-17T00:07:37.061803+0000","last_clean":"2023-08-17T00:07:37.061803+0000","last_became_active":"2023-08-17T00:07:36.623570+0000","last_became_peered":"2023-08-17T00:07:36.623570+0000","last_unstale":"2023-08-17T00:07:37.061803+0000","last_undegraded":"2023-08-17T00:07:37.061803+0000","last_fullsized":"2023-08-17T00:07:37.061803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086308+0000","last_change":"2023-08-17T00:07:37.080055+0000","last_active":"2023-08-17T00:07:37.086308+0000","last_peered":"2023-08-17T00:07:37.086308+0000","last_clean":"2023-08-17T00:07:37.086308+0000","last_became_active":"2023-08-17T00:07:37.079792+0000","last_became_peered":"2023-08-17T00:07:37.079792+0000","last_unstale":"2023-08-17T00:07:37.086308+0000","last_undegraded":"2023-08-17T00:07:37.086308+0000","last_fullsized":"2023-08-17T00:07:37.086308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060986+0000","last_change":"2023-08-17T00:07:36.625885+0000","last_active":"2023-08-17T00:07:37.060986+0000","last_peered":"2023-08-17T00:07:37.060986+0000","last_clean":"2023-08-17T00:07:37.060986+0000","last_became_active":"2023-08-17T00:07:36.625604+0000","last_became_peered":"2023-08-17T00:07:36.625604+0000","last_unstale":"2023-08-17T00:07:37.060986+0000","last_undegraded":"2023-08-17T00:07:37.060986+0000","last_fullsized":"2023-08-17T00:07:37.060986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090440+0000","last_change":"2023-08-17T00:07:37.087060+0000","last_active":"2023-08-17T00:07:37.090440+0000","last_peered":"2023-08-17T00:07:37.090440+0000","last_clean":"2023-08-17T00:07:37.090440+0000","last_became_active":"2023-08-17T00:07:37.086799+0000","last_became_peered":"2023-08-17T00:07:37.086799+0000","last_unstale":"2023-08-17T00:07:37.090440+0000","last_undegraded":"2023-08-17T00:07:37.090440+0000","last_fullsized":"2023-08-17T00:07:37.090440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.085186+0000","last_change":"2023-08-17T00:07:36.637036+0000","last_active":"2023-08-17T00:07:37.085186+0000","last_peered":"2023-08-17T00:07:37.085186+0000","last_clean":"2023-08-17T00:07:37.085186+0000","last_became_active":"2023-08-17T00:07:36.636652+0000","last_became_peered":"2023-08-17T00:07:36.636652+0000","last_unstale":"2023-08-17T00:07:37.085186+0000","last_undegraded":"2023-08-17T00:07:37.085186+0000","last_fullsized":"2023-08-17T00:07:37.085186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087817+0000","last_change":"2023-08-17T00:07:37.077514+0000","last_active":"2023-08-17T00:07:37.087817+0000","last_peered":"2023-08-17T00:07:37.087817+0000","last_clean":"2023-08-17T00:07:37.087817+0000","last_became_active":"2023-08-17T00:07:37.077075+0000","last_became_peered":"2023-08-17T00:07:37.077075+0000","last_unstale":"2023-08-17T00:07:37.087817+0000","last_undegraded":"2023-08-17T00:07:37.087817+0000","last_fullsized":"2023-08-17T00:07:37.087817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069017+0000","last_change":"2023-08-17T00:07:36.637381+0000","last_active":"2023-08-17T00:07:37.069017+0000","last_peered":"2023-08-17T00:07:37.069017+0000","last_clean":"2023-08-17T00:07:37.069017+0000","last_became_active":"2023-08-17T00:07:36.637042+0000","last_became_peered":"2023-08-17T00:07:36.637042+0000","last_unstale":"2023-08-17T00:07:37.069017+0000","last_undegraded":"2023-08-17T00:07:37.069017+0000","last_fullsized":"2023-08-17T00:07:37.069017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095699+0000","last_change":"2023-08-17T00:07:37.089584+0000","last_active":"2023-08-17T00:07:37.095699+0000","last_peered":"2023-08-17T00:07:37.095699+0000","last_clean":"2023-08-17T00:07:37.095699+0000","last_became_active":"2023-08-17T00:07:37.089331+0000","last_became_peered":"2023-08-17T00:07:37.089331+0000","last_unstale":"2023-08-17T00:07:37.095699+0000","last_undegraded":"2023-08-17T00:07:37.095699+0000","last_fullsized":"2023-08-17T00:07:37.095699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068531+0000","last_change":"2023-08-17T00:07:36.637101+0000","last_active":"2023-08-17T00:07:37.068531+0000","last_peered":"2023-08-17T00:07:37.068531+0000","last_clean":"2023-08-17T00:07:37.068531+0000","last_became_active":"2023-08-17T00:07:36.636733+0000","last_became_peered":"2023-08-17T00:07:36.636733+0000","last_unstale":"2023-08-17T00:07:37.068531+0000","last_undegraded":"2023-08-17T00:07:37.068531+0000","last_fullsized":"2023-08-17T00:07:37.068531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087737+0000","last_change":"2023-08-17T00:07:37.074447+0000","last_active":"2023-08-17T00:07:37.087737+0000","last_peered":"2023-08-17T00:07:37.087737+0000","last_clean":"2023-08-17T00:07:37.087737+0000","last_became_active":"2023-08-17T00:07:37.073472+0000","last_became_peered":"2023-08-17T00:07:37.073472+0000","last_unstale":"2023-08-17T00:07:37.087737+0000","last_undegraded":"2023-08-17T00:07:37.087737+0000","last_fullsized":"2023-08-17T00:07:37.087737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089422+0000","last_change":"2023-08-17T00:07:36.640022+0000","last_active":"2023-08-17T00:07:37.089422+0000","last_peered":"2023-08-17T00:07:37.089422+0000","last_clean":"2023-08-17T00:07:37.089422+0000","last_became_active":"2023-08-17T00:07:36.638535+0000","last_became_peered":"2023-08-17T00:07:36.638535+0000","last_unstale":"2023-08-17T00:07:37.089422+0000","last_undegraded":"2023-08-17T00:07:37.089422+0000","last_fullsized":"2023-08-17T00:07:37.089422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082185+0000","last_change":"2023-08-17T00:07:37.075096+0000","last_active":"2023-08-17T00:07:37.082185+0000","last_peered":"2023-08-17T00:07:37.082185+0000","last_clean":"2023-08-17T00:07:37.082185+0000","last_became_active":"2023-08-17T00:07:37.074794+0000","last_became_peered":"2023-08-17T00:07:37.074794+0000","last_unstale":"2023-08-17T00:07:37.082185+0000","last_undegraded":"2023-08-17T00:07:37.082185+0000","last_fullsized":"2023-08-17T00:07:37.082185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068403+0000","last_change":"2023-08-17T00:07:36.632492+0000","last_active":"2023-08-17T00:07:37.068403+0000","last_peered":"2023-08-17T00:07:37.068403+0000","last_clean":"2023-08-17T00:07:37.068403+0000","last_became_active":"2023-08-17T00:07:36.632205+0000","last_became_peered":"2023-08-17T00:07:36.632205+0000","last_unstale":"2023-08-17T00:07:37.068403+0000","last_undegraded":"2023-08-17T00:07:37.068403+0000","last_fullsized":"2023-08-17T00:07:37.068403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091751+0000","last_change":"2023-08-17T00:07:37.090713+0000","last_active":"2023-08-17T00:07:37.091751+0000","last_peered":"2023-08-17T00:07:37.091751+0000","last_clean":"2023-08-17T00:07:37.091751+0000","last_became_active":"2023-08-17T00:07:37.090437+0000","last_became_peered":"2023-08-17T00:07:37.090437+0000","last_unstale":"2023-08-17T00:07:37.091751+0000","last_undegraded":"2023-08-17T00:07:37.091751+0000","last_fullsized":"2023-08-17T00:07:37.091751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.092881+0000","last_change":"2023-08-17T00:07:36.644864+0000","last_active":"2023-08-17T00:07:37.092881+0000","last_peered":"2023-08-17T00:07:37.092881+0000","last_clean":"2023-08-17T00:07:37.092881+0000","last_became_active":"2023-08-17T00:07:36.644472+0000","last_became_peered":"2023-08-17T00:07:36.644472+0000","last_unstale":"2023-08-17T00:07:37.092881+0000","last_undegraded":"2023-08-17T00:07:37.092881+0000","last_fullsized":"2023-08-17T00:07:37.092881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086492+0000","last_change":"2023-08-17T00:07:37.076479+0000","last_active":"2023-08-17T00:07:37.086492+0000","last_peered":"2023-08-17T00:07:37.086492+0000","last_clean":"2023-08-17T00:07:37.086492+0000","last_became_active":"2023-08-17T00:07:37.076193+0000","last_became_peered":"2023-08-17T00:07:37.076193+0000","last_unstale":"2023-08-17T00:07:37.086492+0000","last_undegraded":"2023-08-17T00:07:37.086492+0000","last_fullsized":"2023-08-17T00:07:37.086492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.059948+0000","last_change":"2023-08-17T00:07:36.635523+0000","last_active":"2023-08-17T00:07:37.059948+0000","last_peered":"2023-08-17T00:07:37.059948+0000","last_clean":"2023-08-17T00:07:37.059948+0000","last_became_active":"2023-08-17T00:07:36.635201+0000","last_became_peered":"2023-08-17T00:07:36.635201+0000","last_unstale":"2023-08-17T00:07:37.059948+0000","last_undegraded":"2023-08-17T00:07:37.059948+0000","last_fullsized":"2023-08-17T00:07:37.059948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088129+0000","last_change":"2023-08-17T00:07:37.082994+0000","last_active":"2023-08-17T00:07:37.088129+0000","last_peered":"2023-08-17T00:07:37.088129+0000","last_clean":"2023-08-17T00:07:37.088129+0000","last_became_active":"2023-08-17T00:07:37.082738+0000","last_became_peered":"2023-08-17T00:07:37.082738+0000","last_unstale":"2023-08-17T00:07:37.088129+0000","last_undegraded":"2023-08-17T00:07:37.088129+0000","last_fullsized":"2023-08-17T00:07:37.088129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.077841+0000","last_change":"2023-08-17T00:07:36.639916+0000","last_active":"2023-08-17T00:07:37.077841+0000","last_peered":"2023-08-17T00:07:37.077841+0000","last_clean":"2023-08-17T00:07:37.077841+0000","last_became_active":"2023-08-17T00:07:36.639649+0000","last_became_peered":"2023-08-17T00:07:36.639649+0000","last_unstale":"2023-08-17T00:07:37.077841+0000","last_undegraded":"2023-08-17T00:07:37.077841+0000","last_fullsized":"2023-08-17T00:07:37.077841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090105+0000","last_change":"2023-08-17T00:07:37.085882+0000","last_active":"2023-08-17T00:07:37.090105+0000","last_peered":"2023-08-17T00:07:37.090105+0000","last_clean":"2023-08-17T00:07:37.090105+0000","last_became_active":"2023-08-17T00:07:37.085614+0000","last_became_peered":"2023-08-17T00:07:37.085614+0000","last_unstale":"2023-08-17T00:07:37.090105+0000","last_undegraded":"2023-08-17T00:07:37.090105+0000","last_fullsized":"2023-08-17T00:07:37.090105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069287+0000","last_change":"2023-08-17T00:07:36.640897+0000","last_active":"2023-08-17T00:07:37.069287+0000","last_peered":"2023-08-17T00:07:37.069287+0000","last_clean":"2023-08-17T00:07:37.069287+0000","last_became_active":"2023-08-17T00:07:36.640612+0000","last_became_peered":"2023-08-17T00:07:36.640612+0000","last_unstale":"2023-08-17T00:07:37.069287+0000","last_undegraded":"2023-08-17T00:07:37.069287+0000","last_fullsized":"2023-08-17T00:07:37.069287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090970+0000","last_change":"2023-08-17T00:07:37.088001+0000","last_active":"2023-08-17T00:07:37.090970+0000","last_peered":"2023-08-17T00:07:37.090970+0000","last_clean":"2023-08-17T00:07:37.090970+0000","last_became_active":"2023-08-17T00:07:37.087672+0000","last_became_peered":"2023-08-17T00:07:37.087672+0000","last_unstale":"2023-08-17T00:07:37.090970+0000","last_undegraded":"2023-08-17T00:07:37.090970+0000","last_fullsized":"2023-08-17T00:07:37.090970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068744+0000","last_change":"2023-08-17T00:07:36.640315+0000","last_active":"2023-08-17T00:07:37.068744+0000","last_peered":"2023-08-17T00:07:37.068744+0000","last_clean":"2023-08-17T00:07:37.068744+0000","last_became_active":"2023-08-17T00:07:36.640050+0000","last_became_peered":"2023-08-17T00:07:36.640050+0000","last_unstale":"2023-08-17T00:07:37.068744+0000","last_undegraded":"2023-08-17T00:07:37.068744+0000","last_fullsized":"2023-08-17T00:07:37.068744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088022+0000","last_change":"2023-08-17T00:07:37.083151+0000","last_active":"2023-08-17T00:07:37.088022+0000","last_peered":"2023-08-17T00:07:37.088022+0000","last_clean":"2023-08-17T00:07:37.088022+0000","last_became_active":"2023-08-17T00:07:37.082868+0000","last_became_peered":"2023-08-17T00:07:37.082868+0000","last_unstale":"2023-08-17T00:07:37.088022+0000","last_undegraded":"2023-08-17T00:07:37.088022+0000","last_fullsized":"2023-08-17T00:07:37.088022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071242+0000","last_change":"2023-08-17T00:07:36.639932+0000","last_active":"2023-08-17T00:07:37.071242+0000","last_peered":"2023-08-17T00:07:37.071242+0000","last_clean":"2023-08-17T00:07:37.071242+0000","last_became_active":"2023-08-17T00:07:36.638889+0000","last_became_peered":"2023-08-17T00:07:36.638889+0000","last_unstale":"2023-08-17T00:07:37.071242+0000","last_undegraded":"2023-08-17T00:07:37.071242+0000","last_fullsized":"2023-08-17T00:07:37.071242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086083+0000","last_change":"2023-08-17T00:07:37.076529+0000","last_active":"2023-08-17T00:07:37.086083+0000","last_peered":"2023-08-17T00:07:37.086083+0000","last_clean":"2023-08-17T00:07:37.086083+0000","last_became_active":"2023-08-17T00:07:37.076223+0000","last_became_peered":"2023-08-17T00:07:37.076223+0000","last_unstale":"2023-08-17T00:07:37.086083+0000","last_undegraded":"2023-08-17T00:07:37.086083+0000","last_fullsized":"2023-08-17T00:07:37.086083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068614+0000","last_change":"2023-08-17T00:07:36.634560+0000","last_active":"2023-08-17T00:07:37.068614+0000","last_peered":"2023-08-17T00:07:37.068614+0000","last_clean":"2023-08-17T00:07:37.068614+0000","last_became_active":"2023-08-17T00:07:36.634299+0000","last_became_peered":"2023-08-17T00:07:36.634299+0000","last_unstale":"2023-08-17T00:07:37.068614+0000","last_undegraded":"2023-08-17T00:07:37.068614+0000","last_fullsized":"2023-08-17T00:07:37.068614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082607+0000","last_change":"2023-08-17T00:07:37.073372+0000","last_active":"2023-08-17T00:07:37.082607+0000","last_peered":"2023-08-17T00:07:37.082607+0000","last_clean":"2023-08-17T00:07:37.082607+0000","last_became_active":"2023-08-17T00:07:37.073077+0000","last_became_peered":"2023-08-17T00:07:37.073077+0000","last_unstale":"2023-08-17T00:07:37.082607+0000","last_undegraded":"2023-08-17T00:07:37.082607+0000","last_fullsized":"2023-08-17T00:07:37.082607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.072549+0000","last_change":"2023-08-17T00:07:36.638159+0000","last_active":"2023-08-17T00:07:37.072549+0000","last_peered":"2023-08-17T00:07:37.072549+0000","last_clean":"2023-08-17T00:07:37.072549+0000","last_became_active":"2023-08-17T00:07:36.637886+0000","last_became_peered":"2023-08-17T00:07:36.637886+0000","last_unstale":"2023-08-17T00:07:37.072549+0000","last_undegraded":"2023-08-17T00:07:37.072549+0000","last_fullsized":"2023-08-17T00:07:37.072549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088269+0000","last_change":"2023-08-17T00:07:37.076787+0000","last_active":"2023-08-17T00:07:37.088269+0000","last_peered":"2023-08-17T00:07:37.088269+0000","last_clean":"2023-08-17T00:07:37.088269+0000","last_became_active":"2023-08-17T00:07:37.076262+0000","last_became_peered":"2023-08-17T00:07:37.076262+0000","last_unstale":"2023-08-17T00:07:37.088269+0000","last_undegraded":"2023-08-17T00:07:37.088269+0000","last_fullsized":"2023-08-17T00:07:37.088269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068098+0000","last_change":"2023-08-17T00:07:36.639617+0000","last_active":"2023-08-17T00:07:37.068098+0000","last_peered":"2023-08-17T00:07:37.068098+0000","last_clean":"2023-08-17T00:07:37.068098+0000","last_became_active":"2023-08-17T00:07:36.639317+0000","last_became_peered":"2023-08-17T00:07:36.639317+0000","last_unstale":"2023-08-17T00:07:37.068098+0000","last_undegraded":"2023-08-17T00:07:37.068098+0000","last_fullsized":"2023-08-17T00:07:37.068098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090723+0000","last_change":"2023-08-17T00:07:37.088078+0000","last_active":"2023-08-17T00:07:37.090723+0000","last_peered":"2023-08-17T00:07:37.090723+0000","last_clean":"2023-08-17T00:07:37.090723+0000","last_became_active":"2023-08-17T00:07:37.087797+0000","last_became_peered":"2023-08-17T00:07:37.087797+0000","last_unstale":"2023-08-17T00:07:37.090723+0000","last_undegraded":"2023-08-17T00:07:37.090723+0000","last_fullsized":"2023-08-17T00:07:37.090723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068912+0000","last_change":"2023-08-17T00:07:36.634494+0000","last_active":"2023-08-17T00:07:37.068912+0000","last_peered":"2023-08-17T00:07:37.068912+0000","last_clean":"2023-08-17T00:07:37.068912+0000","last_became_active":"2023-08-17T00:07:36.633674+0000","last_became_peered":"2023-08-17T00:07:36.633674+0000","last_unstale":"2023-08-17T00:07:37.068912+0000","last_undegraded":"2023-08-17T00:07:37.068912+0000","last_fullsized":"2023-08-17T00:07:37.068912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095474+0000","last_change":"2023-08-17T00:07:37.091656+0000","last_active":"2023-08-17T00:07:37.095474+0000","last_peered":"2023-08-17T00:07:37.095474+0000","last_clean":"2023-08-17T00:07:37.095474+0000","last_became_active":"2023-08-17T00:07:37.091464+0000","last_became_peered":"2023-08-17T00:07:37.091464+0000","last_unstale":"2023-08-17T00:07:37.095474+0000","last_undegraded":"2023-08-17T00:07:37.095474+0000","last_fullsized":"2023-08-17T00:07:37.095474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065798+0000","last_change":"2023-08-17T00:07:36.638053+0000","last_active":"2023-08-17T00:07:37.065798+0000","last_peered":"2023-08-17T00:07:37.065798+0000","last_clean":"2023-08-17T00:07:37.065798+0000","last_became_active":"2023-08-17T00:07:36.637770+0000","last_became_peered":"2023-08-17T00:07:36.637770+0000","last_unstale":"2023-08-17T00:07:37.065798+0000","last_undegraded":"2023-08-17T00:07:37.065798+0000","last_fullsized":"2023-08-17T00:07:37.065798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087544+0000","last_change":"2023-08-17T00:07:37.078684+0000","last_active":"2023-08-17T00:07:37.087544+0000","last_peered":"2023-08-17T00:07:37.087544+0000","last_clean":"2023-08-17T00:07:37.087544+0000","last_became_active":"2023-08-17T00:07:37.078321+0000","last_became_peered":"2023-08-17T00:07:37.078321+0000","last_unstale":"2023-08-17T00:07:37.087544+0000","last_undegraded":"2023-08-17T00:07:37.087544+0000","last_fullsized":"2023-08-17T00:07:37.087544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071641+0000","last_change":"2023-08-17T00:07:36.643988+0000","last_active":"2023-08-17T00:07:37.071641+0000","last_peered":"2023-08-17T00:07:37.071641+0000","last_clean":"2023-08-17T00:07:37.071641+0000","last_became_active":"2023-08-17T00:07:36.643683+0000","last_became_peered":"2023-08-17T00:07:36.643683+0000","last_unstale":"2023-08-17T00:07:37.071641+0000","last_undegraded":"2023-08-17T00:07:37.071641+0000","last_fullsized":"2023-08-17T00:07:37.071641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088334+0000","last_change":"2023-08-17T00:07:37.077179+0000","last_active":"2023-08-17T00:07:37.088334+0000","last_peered":"2023-08-17T00:07:37.088334+0000","last_clean":"2023-08-17T00:07:37.088334+0000","last_became_active":"2023-08-17T00:07:37.076221+0000","last_became_peered":"2023-08-17T00:07:37.076221+0000","last_unstale":"2023-08-17T00:07:37.088334+0000","last_undegraded":"2023-08-17T00:07:37.088334+0000","last_fullsized":"2023-08-17T00:07:37.088334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.083878+0000","last_change":"2023-08-17T00:07:36.637629+0000","last_active":"2023-08-17T00:07:37.083878+0000","last_peered":"2023-08-17T00:07:37.083878+0000","last_clean":"2023-08-17T00:07:37.083878+0000","last_became_active":"2023-08-17T00:07:36.637113+0000","last_became_peered":"2023-08-17T00:07:36.637113+0000","last_unstale":"2023-08-17T00:07:37.083878+0000","last_undegraded":"2023-08-17T00:07:37.083878+0000","last_fullsized":"2023-08-17T00:07:37.083878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088500+0000","last_change":"2023-08-17T00:07:37.079400+0000","last_active":"2023-08-17T00:07:37.088500+0000","last_peered":"2023-08-17T00:07:37.088500+0000","last_clean":"2023-08-17T00:07:37.088500+0000","last_became_active":"2023-08-17T00:07:37.079124+0000","last_became_peered":"2023-08-17T00:07:37.079124+0000","last_unstale":"2023-08-17T00:07:37.088500+0000","last_undegraded":"2023-08-17T00:07:37.088500+0000","last_fullsized":"2023-08-17T00:07:37.088500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087178+0000","last_change":"2023-08-17T00:07:36.637020+0000","last_active":"2023-08-17T00:07:37.087178+0000","last_peered":"2023-08-17T00:07:37.087178+0000","last_clean":"2023-08-17T00:07:37.087178+0000","last_became_active":"2023-08-17T00:07:36.636488+0000","last_became_peered":"2023-08-17T00:07:36.636488+0000","last_unstale":"2023-08-17T00:07:37.087178+0000","last_undegraded":"2023-08-17T00:07:37.087178+0000","last_fullsized":"2023-08-17T00:07:37.087178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086485+0000","last_change":"2023-08-17T00:07:37.081525+0000","last_active":"2023-08-17T00:07:37.086485+0000","last_peered":"2023-08-17T00:07:37.086485+0000","last_clean":"2023-08-17T00:07:37.086485+0000","last_became_active":"2023-08-17T00:07:37.080967+0000","last_became_peered":"2023-08-17T00:07:37.080967+0000","last_unstale":"2023-08-17T00:07:37.086485+0000","last_undegraded":"2023-08-17T00:07:37.086485+0000","last_fullsized":"2023-08-17T00:07:37.086485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091424+0000","last_change":"2023-08-17T00:07:36.630900+0000","last_active":"2023-08-17T00:07:37.091424+0000","last_peered":"2023-08-17T00:07:37.091424+0000","last_clean":"2023-08-17T00:07:37.091424+0000","last_became_active":"2023-08-17T00:07:36.626930+0000","last_became_peered":"2023-08-17T00:07:36.626930+0000","last_unstale":"2023-08-17T00:07:37.091424+0000","last_undegraded":"2023-08-17T00:07:37.091424+0000","last_fullsized":"2023-08-17T00:07:37.091424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095411+0000","last_change":"2023-08-17T00:07:37.090815+0000","last_active":"2023-08-17T00:07:37.095411+0000","last_peered":"2023-08-17T00:07:37.095411+0000","last_clean":"2023-08-17T00:07:37.095411+0000","last_became_active":"2023-08-17T00:07:37.090518+0000","last_became_peered":"2023-08-17T00:07:37.090518+0000","last_unstale":"2023-08-17T00:07:37.095411+0000","last_undegraded":"2023-08-17T00:07:37.095411+0000","last_fullsized":"2023-08-17T00:07:37.095411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060125+0000","last_change":"2023-08-17T00:07:36.641933+0000","last_active":"2023-08-17T00:07:37.060125+0000","last_peered":"2023-08-17T00:07:37.060125+0000","last_clean":"2023-08-17T00:07:37.060125+0000","last_became_active":"2023-08-17T00:07:36.641615+0000","last_became_peered":"2023-08-17T00:07:36.641615+0000","last_unstale":"2023-08-17T00:07:37.060125+0000","last_undegraded":"2023-08-17T00:07:37.060125+0000","last_fullsized":"2023-08-17T00:07:37.060125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091763+0000","last_change":"2023-08-17T00:07:37.090812+0000","last_active":"2023-08-17T00:07:37.091763+0000","last_peered":"2023-08-17T00:07:37.091763+0000","last_clean":"2023-08-17T00:07:37.091763+0000","last_became_active":"2023-08-17T00:07:37.090463+0000","last_became_peered":"2023-08-17T00:07:37.090463+0000","last_unstale":"2023-08-17T00:07:37.091763+0000","last_undegraded":"2023-08-17T00:07:37.091763+0000","last_fullsized":"2023-08-17T00:07:37.091763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.058907+0000","last_change":"2023-08-17T00:07:36.641954+0000","last_active":"2023-08-17T00:07:37.058907+0000","last_peered":"2023-08-17T00:07:37.058907+0000","last_clean":"2023-08-17T00:07:37.058907+0000","last_became_active":"2023-08-17T00:07:36.641534+0000","last_became_peered":"2023-08-17T00:07:36.641534+0000","last_unstale":"2023-08-17T00:07:37.058907+0000","last_undegraded":"2023-08-17T00:07:37.058907+0000","last_fullsized":"2023-08-17T00:07:37.058907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089130+0000","last_change":"2023-08-17T00:07:37.083462+0000","last_active":"2023-08-17T00:07:37.089130+0000","last_peered":"2023-08-17T00:07:37.089130+0000","last_clean":"2023-08-17T00:07:37.089130+0000","last_became_active":"2023-08-17T00:07:37.083169+0000","last_became_peered":"2023-08-17T00:07:37.083169+0000","last_unstale":"2023-08-17T00:07:37.089130+0000","last_undegraded":"2023-08-17T00:07:37.089130+0000","last_fullsized":"2023-08-17T00:07:37.089130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068987+0000","last_change":"2023-08-17T00:07:36.631813+0000","last_active":"2023-08-17T00:07:37.068987+0000","last_peered":"2023-08-17T00:07:37.068987+0000","last_clean":"2023-08-17T00:07:37.068987+0000","last_became_active":"2023-08-17T00:07:36.631519+0000","last_became_peered":"2023-08-17T00:07:36.631519+0000","last_unstale":"2023-08-17T00:07:37.068987+0000","last_undegraded":"2023-08-17T00:07:37.068987+0000","last_fullsized":"2023-08-17T00:07:37.068987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086540+0000","last_change":"2023-08-17T00:07:37.082081+0000","last_active":"2023-08-17T00:07:37.086540+0000","last_peered":"2023-08-17T00:07:37.086540+0000","last_clean":"2023-08-17T00:07:37.086540+0000","last_became_active":"2023-08-17T00:07:37.081773+0000","last_became_peered":"2023-08-17T00:07:37.081773+0000","last_unstale":"2023-08-17T00:07:37.086540+0000","last_undegraded":"2023-08-17T00:07:37.086540+0000","last_fullsized":"2023-08-17T00:07:37.086540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060895+0000","last_change":"2023-08-17T00:07:36.636165+0000","last_active":"2023-08-17T00:07:37.060895+0000","last_peered":"2023-08-17T00:07:37.060895+0000","last_clean":"2023-08-17T00:07:37.060895+0000","last_became_active":"2023-08-17T00:07:36.635532+0000","last_became_peered":"2023-08-17T00:07:36.635532+0000","last_unstale":"2023-08-17T00:07:37.060895+0000","last_undegraded":"2023-08-17T00:07:37.060895+0000","last_fullsized":"2023-08-17T00:07:37.060895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.079609+0000","last_change":"2023-08-17T00:07:37.077791+0000","last_active":"2023-08-17T00:07:37.079609+0000","last_peered":"2023-08-17T00:07:37.079609+0000","last_clean":"2023-08-17T00:07:37.079609+0000","last_became_active":"2023-08-17T00:07:37.077507+0000","last_became_peered":"2023-08-17T00:07:37.077507+0000","last_unstale":"2023-08-17T00:07:37.079609+0000","last_undegraded":"2023-08-17T00:07:37.079609+0000","last_fullsized":"2023-08-17T00:07:37.079609+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060078+0000","last_change":"2023-08-17T00:07:36.641931+0000","last_active":"2023-08-17T00:07:37.060078+0000","last_peered":"2023-08-17T00:07:37.060078+0000","last_clean":"2023-08-17T00:07:37.060078+0000","last_became_active":"2023-08-17T00:07:36.641605+0000","last_became_peered":"2023-08-17T00:07:36.641605+0000","last_unstale":"2023-08-17T00:07:37.060078+0000","last_undegraded":"2023-08-17T00:07:37.060078+0000","last_fullsized":"2023-08-17T00:07:37.060078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.074188+0000","last_change":"2023-08-17T00:07:37.070799+0000","last_active":"2023-08-17T00:07:37.074188+0000","last_peered":"2023-08-17T00:07:37.074188+0000","last_clean":"2023-08-17T00:07:37.074188+0000","last_became_active":"2023-08-17T00:07:37.070491+0000","last_became_peered":"2023-08-17T00:07:37.070491+0000","last_unstale":"2023-08-17T00:07:37.074188+0000","last_undegraded":"2023-08-17T00:07:37.074188+0000","last_fullsized":"2023-08-17T00:07:37.074188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.066398+0000","last_change":"2023-08-17T00:07:36.648335+0000","last_active":"2023-08-17T00:07:37.066398+0000","last_peered":"2023-08-17T00:07:37.066398+0000","last_clean":"2023-08-17T00:07:37.066398+0000","last_became_active":"2023-08-17T00:07:36.648039+0000","last_became_peered":"2023-08-17T00:07:36.648039+0000","last_unstale":"2023-08-17T00:07:37.066398+0000","last_undegraded":"2023-08-17T00:07:37.066398+0000","last_fullsized":"2023-08-17T00:07:37.066398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.081968+0000","last_change":"2023-08-17T00:07:37.074229+0000","last_active":"2023-08-17T00:07:37.081968+0000","last_peered":"2023-08-17T00:07:37.081968+0000","last_clean":"2023-08-17T00:07:37.081968+0000","last_became_active":"2023-08-17T00:07:37.073914+0000","last_became_peered":"2023-08-17T00:07:37.073914+0000","last_unstale":"2023-08-17T00:07:37.081968+0000","last_undegraded":"2023-08-17T00:07:37.081968+0000","last_fullsized":"2023-08-17T00:07:37.081968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068598+0000","last_change":"2023-08-17T00:07:36.639631+0000","last_active":"2023-08-17T00:07:37.068598+0000","last_peered":"2023-08-17T00:07:37.068598+0000","last_clean":"2023-08-17T00:07:37.068598+0000","last_became_active":"2023-08-17T00:07:36.639154+0000","last_became_peered":"2023-08-17T00:07:36.639154+0000","last_unstale":"2023-08-17T00:07:37.068598+0000","last_undegraded":"2023-08-17T00:07:37.068598+0000","last_fullsized":"2023-08-17T00:07:37.068598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090181+0000","last_change":"2023-08-17T00:07:37.081835+0000","last_active":"2023-08-17T00:07:37.090181+0000","last_peered":"2023-08-17T00:07:37.090181+0000","last_clean":"2023-08-17T00:07:37.090181+0000","last_became_active":"2023-08-17T00:07:37.081349+0000","last_became_peered":"2023-08-17T00:07:37.081349+0000","last_unstale":"2023-08-17T00:07:37.090181+0000","last_undegraded":"2023-08-17T00:07:37.090181+0000","last_fullsized":"2023-08-17T00:07:37.090181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089209+0000","last_change":"2023-08-17T00:07:36.636712+0000","last_active":"2023-08-17T00:07:37.089209+0000","last_peered":"2023-08-17T00:07:37.089209+0000","last_clean":"2023-08-17T00:07:37.089209+0000","last_became_active":"2023-08-17T00:07:36.634744+0000","last_became_peered":"2023-08-17T00:07:36.634744+0000","last_unstale":"2023-08-17T00:07:37.089209+0000","last_undegraded":"2023-08-17T00:07:37.089209+0000","last_fullsized":"2023-08-17T00:07:37.089209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089268+0000","last_change":"2023-08-17T00:07:37.082468+0000","last_active":"2023-08-17T00:07:37.089268+0000","last_peered":"2023-08-17T00:07:37.089268+0000","last_clean":"2023-08-17T00:07:37.089268+0000","last_became_active":"2023-08-17T00:07:37.082190+0000","last_became_peered":"2023-08-17T00:07:37.082190+0000","last_unstale":"2023-08-17T00:07:37.089268+0000","last_undegraded":"2023-08-17T00:07:37.089268+0000","last_fullsized":"2023-08-17T00:07:37.089268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090976+0000","last_change":"2023-08-17T00:07:36.645359+0000","last_active":"2023-08-17T00:07:37.090976+0000","last_peered":"2023-08-17T00:07:37.090976+0000","last_clean":"2023-08-17T00:07:37.090976+0000","last_became_active":"2023-08-17T00:07:36.645089+0000","last_became_peered":"2023-08-17T00:07:36.645089+0000","last_unstale":"2023-08-17T00:07:37.090976+0000","last_undegraded":"2023-08-17T00:07:37.090976+0000","last_fullsized":"2023-08-17T00:07:37.090976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095528+0000","last_change":"2023-08-17T00:07:37.092375+0000","last_active":"2023-08-17T00:07:37.095528+0000","last_peered":"2023-08-17T00:07:37.095528+0000","last_clean":"2023-08-17T00:07:37.095528+0000","last_became_active":"2023-08-17T00:07:37.091891+0000","last_became_peered":"2023-08-17T00:07:37.091891+0000","last_unstale":"2023-08-17T00:07:37.095528+0000","last_undegraded":"2023-08-17T00:07:37.095528+0000","last_fullsized":"2023-08-17T00:07:37.095528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.085542+0000","last_change":"2023-08-17T00:07:36.631813+0000","last_active":"2023-08-17T00:07:37.085542+0000","last_peered":"2023-08-17T00:07:37.085542+0000","last_clean":"2023-08-17T00:07:37.085542+0000","last_became_active":"2023-08-17T00:07:36.631512+0000","last_became_peered":"2023-08-17T00:07:36.631512+0000","last_unstale":"2023-08-17T00:07:37.085542+0000","last_undegraded":"2023-08-17T00:07:37.085542+0000","last_fullsized":"2023-08-17T00:07:37.085542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095825+0000","last_change":"2023-08-17T00:07:37.092784+0000","last_active":"2023-08-17T00:07:37.095825+0000","last_peered":"2023-08-17T00:07:37.095825+0000","last_clean":"2023-08-17T00:07:37.095825+0000","last_became_active":"2023-08-17T00:07:37.092430+0000","last_became_peered":"2023-08-17T00:07:37.092430+0000","last_unstale":"2023-08-17T00:07:37.095825+0000","last_undegraded":"2023-08-17T00:07:37.095825+0000","last_fullsized":"2023-08-17T00:07:37.095825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060091+0000","last_change":"2023-08-17T00:07:36.629898+0000","last_active":"2023-08-17T00:07:37.060091+0000","last_peered":"2023-08-17T00:07:37.060091+0000","last_clean":"2023-08-17T00:07:37.060091+0000","last_became_active":"2023-08-17T00:07:36.627745+0000","last_became_peered":"2023-08-17T00:07:36.627745+0000","last_unstale":"2023-08-17T00:07:37.060091+0000","last_undegraded":"2023-08-17T00:07:37.060091+0000","last_fullsized":"2023-08-17T00:07:37.060091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088411+0000","last_change":"2023-08-17T00:07:37.083143+0000","last_active":"2023-08-17T00:07:37.088411+0000","last_peered":"2023-08-17T00:07:37.088411+0000","last_clean":"2023-08-17T00:07:37.088411+0000","last_became_active":"2023-08-17T00:07:37.082878+0000","last_became_peered":"2023-08-17T00:07:37.082878+0000","last_unstale":"2023-08-17T00:07:37.088411+0000","last_undegraded":"2023-08-17T00:07:37.088411+0000","last_fullsized":"2023-08-17T00:07:37.088411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065322+0000","last_change":"2023-08-17T00:07:36.641664+0000","last_active":"2023-08-17T00:07:37.065322+0000","last_peered":"2023-08-17T00:07:37.065322+0000","last_clean":"2023-08-17T00:07:37.065322+0000","last_became_active":"2023-08-17T00:07:36.641401+0000","last_became_peered":"2023-08-17T00:07:36.641401+0000","last_unstale":"2023-08-17T00:07:37.065322+0000","last_undegraded":"2023-08-17T00:07:37.065322+0000","last_fullsized":"2023-08-17T00:07:37.065322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088220+0000","last_change":"2023-08-17T00:07:37.085321+0000","last_active":"2023-08-17T00:07:37.088220+0000","last_peered":"2023-08-17T00:07:37.088220+0000","last_clean":"2023-08-17T00:07:37.088220+0000","last_became_active":"2023-08-17T00:07:37.084675+0000","last_became_peered":"2023-08-17T00:07:37.084675+0000","last_unstale":"2023-08-17T00:07:37.088220+0000","last_undegraded":"2023-08-17T00:07:37.088220+0000","last_fullsized":"2023-08-17T00:07:37.088220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087383+0000","last_change":"2023-08-17T00:07:36.625808+0000","last_active":"2023-08-17T00:07:37.087383+0000","last_peered":"2023-08-17T00:07:37.087383+0000","last_clean":"2023-08-17T00:07:37.087383+0000","last_became_active":"2023-08-17T00:07:36.625528+0000","last_became_peered":"2023-08-17T00:07:36.625528+0000","last_unstale":"2023-08-17T00:07:37.087383+0000","last_undegraded":"2023-08-17T00:07:37.087383+0000","last_fullsized":"2023-08-17T00:07:37.087383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095401+0000","last_change":"2023-08-17T00:07:37.090777+0000","last_active":"2023-08-17T00:07:37.095401+0000","last_peered":"2023-08-17T00:07:37.095401+0000","last_clean":"2023-08-17T00:07:37.095401+0000","last_became_active":"2023-08-17T00:07:37.090486+0000","last_became_peered":"2023-08-17T00:07:37.090486+0000","last_unstale":"2023-08-17T00:07:37.095401+0000","last_undegraded":"2023-08-17T00:07:37.095401+0000","last_fullsized":"2023-08-17T00:07:37.095401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.092655+0000","last_change":"2023-08-17T00:07:36.635259+0000","last_active":"2023-08-17T00:07:37.092655+0000","last_peered":"2023-08-17T00:07:37.092655+0000","last_clean":"2023-08-17T00:07:37.092655+0000","last_became_active":"2023-08-17T00:07:36.634846+0000","last_became_peered":"2023-08-17T00:07:36.634846+0000","last_unstale":"2023-08-17T00:07:37.092655+0000","last_undegraded":"2023-08-17T00:07:37.092655+0000","last_fullsized":"2023-08-17T00:07:37.092655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095846+0000","last_change":"2023-08-17T00:07:37.092784+0000","last_active":"2023-08-17T00:07:37.095846+0000","last_peered":"2023-08-17T00:07:37.095846+0000","last_clean":"2023-08-17T00:07:37.095846+0000","last_became_active":"2023-08-17T00:07:37.092410+0000","last_became_peered":"2023-08-17T00:07:37.092410+0000","last_unstale":"2023-08-17T00:07:37.095846+0000","last_undegraded":"2023-08-17T00:07:37.095846+0000","last_fullsized":"2023-08-17T00:07:37.095846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068912+0000","last_change":"2023-08-17T00:07:36.634709+0000","last_active":"2023-08-17T00:07:37.068912+0000","last_peered":"2023-08-17T00:07:37.068912+0000","last_clean":"2023-08-17T00:07:37.068912+0000","last_became_active":"2023-08-17T00:07:36.633820+0000","last_became_peered":"2023-08-17T00:07:36.633820+0000","last_unstale":"2023-08-17T00:07:37.068912+0000","last_undegraded":"2023-08-17T00:07:37.068912+0000","last_fullsized":"2023-08-17T00:07:37.068912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086502+0000","last_change":"2023-08-17T00:07:37.081733+0000","last_active":"2023-08-17T00:07:37.086502+0000","last_peered":"2023-08-17T00:07:37.086502+0000","last_clean":"2023-08-17T00:07:37.086502+0000","last_became_active":"2023-08-17T00:07:37.081295+0000","last_became_peered":"2023-08-17T00:07:37.081295+0000","last_unstale":"2023-08-17T00:07:37.086502+0000","last_undegraded":"2023-08-17T00:07:37.086502+0000","last_fullsized":"2023-08-17T00:07:37.086502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071107+0000","last_change":"2023-08-17T00:07:36.639747+0000","last_active":"2023-08-17T00:07:37.071107+0000","last_peered":"2023-08-17T00:07:37.071107+0000","last_clean":"2023-08-17T00:07:37.071107+0000","last_became_active":"2023-08-17T00:07:36.639442+0000","last_became_peered":"2023-08-17T00:07:36.639442+0000","last_unstale":"2023-08-17T00:07:37.071107+0000","last_undegraded":"2023-08-17T00:07:37.071107+0000","last_fullsized":"2023-08-17T00:07:37.071107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086405+0000","last_change":"2023-08-17T00:07:37.074896+0000","last_active":"2023-08-17T00:07:37.086405+0000","last_peered":"2023-08-17T00:07:37.086405+0000","last_clean":"2023-08-17T00:07:37.086405+0000","last_became_active":"2023-08-17T00:07:37.074439+0000","last_became_peered":"2023-08-17T00:07:37.074439+0000","last_unstale":"2023-08-17T00:07:37.086405+0000","last_undegraded":"2023-08-17T00:07:37.086405+0000","last_fullsized":"2023-08-17T00:07:37.086405+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.072645+0000","last_change":"2023-08-17T00:07:36.646370+0000","last_active":"2023-08-17T00:07:37.072645+0000","last_peered":"2023-08-17T00:07:37.072645+0000","last_clean":"2023-08-17T00:07:37.072645+0000","last_became_active":"2023-08-17T00:07:36.646099+0000","last_became_peered":"2023-08-17T00:07:36.646099+0000","last_unstale":"2023-08-17T00:07:37.072645+0000","last_undegraded":"2023-08-17T00:07:37.072645+0000","last_fullsized":"2023-08-17T00:07:37.072645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086570+0000","last_change":"2023-08-17T00:07:37.082157+0000","last_active":"2023-08-17T00:07:37.086570+0000","last_peered":"2023-08-17T00:07:37.086570+0000","last_clean":"2023-08-17T00:07:37.086570+0000","last_became_active":"2023-08-17T00:07:37.081669+0000","last_became_peered":"2023-08-17T00:07:37.081669+0000","last_unstale":"2023-08-17T00:07:37.086570+0000","last_undegraded":"2023-08-17T00:07:37.086570+0000","last_fullsized":"2023-08-17T00:07:37.086570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069545+0000","last_change":"2023-08-17T00:07:36.637633+0000","last_active":"2023-08-17T00:07:37.069545+0000","last_peered":"2023-08-17T00:07:37.069545+0000","last_clean":"2023-08-17T00:07:37.069545+0000","last_became_active":"2023-08-17T00:07:36.636848+0000","last_became_peered":"2023-08-17T00:07:36.636848+0000","last_unstale":"2023-08-17T00:07:37.069545+0000","last_undegraded":"2023-08-17T00:07:37.069545+0000","last_fullsized":"2023-08-17T00:07:37.069545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087366+0000","last_change":"2023-08-17T00:07:37.083542+0000","last_active":"2023-08-17T00:07:37.087366+0000","last_peered":"2023-08-17T00:07:37.087366+0000","last_clean":"2023-08-17T00:07:37.087366+0000","last_became_active":"2023-08-17T00:07:37.083251+0000","last_became_peered":"2023-08-17T00:07:37.083251+0000","last_unstale":"2023-08-17T00:07:37.087366+0000","last_undegraded":"2023-08-17T00:07:37.087366+0000","last_fullsized":"2023-08-17T00:07:37.087366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068404+0000","last_change":"2023-08-17T00:07:36.637100+0000","last_active":"2023-08-17T00:07:37.068404+0000","last_peered":"2023-08-17T00:07:37.068404+0000","last_clean":"2023-08-17T00:07:37.068404+0000","last_became_active":"2023-08-17T00:07:36.636810+0000","last_became_peered":"2023-08-17T00:07:36.636810+0000","last_unstale":"2023-08-17T00:07:37.068404+0000","last_undegraded":"2023-08-17T00:07:37.068404+0000","last_fullsized":"2023-08-17T00:07:37.068404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.083494+0000","last_change":"2023-08-17T00:07:37.071633+0000","last_active":"2023-08-17T00:07:37.083494+0000","last_peered":"2023-08-17T00:07:37.083494+0000","last_clean":"2023-08-17T00:07:37.083494+0000","last_became_active":"2023-08-17T00:07:37.071164+0000","last_became_peered":"2023-08-17T00:07:37.071164+0000","last_unstale":"2023-08-17T00:07:37.083494+0000","last_undegraded":"2023-08-17T00:07:37.083494+0000","last_fullsized":"2023-08-17T00:07:37.083494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065899+0000","last_change":"2023-08-17T00:07:36.648930+0000","last_active":"2023-08-17T00:07:37.065899+0000","last_peered":"2023-08-17T00:07:37.065899+0000","last_clean":"2023-08-17T00:07:37.065899+0000","last_became_active":"2023-08-17T00:07:36.648659+0000","last_became_peered":"2023-08-17T00:07:36.648659+0000","last_unstale":"2023-08-17T00:07:37.065899+0000","last_undegraded":"2023-08-17T00:07:37.065899+0000","last_fullsized":"2023-08-17T00:07:37.065899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088391+0000","last_change":"2023-08-17T00:07:37.077259+0000","last_active":"2023-08-17T00:07:37.088391+0000","last_peered":"2023-08-17T00:07:37.088391+0000","last_clean":"2023-08-17T00:07:37.088391+0000","last_became_active":"2023-08-17T00:07:37.076292+0000","last_became_peered":"2023-08-17T00:07:37.076292+0000","last_unstale":"2023-08-17T00:07:37.088391+0000","last_undegraded":"2023-08-17T00:07:37.088391+0000","last_fullsized":"2023-08-17T00:07:37.088391+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060282+0000","last_change":"2023-08-17T00:07:36.634571+0000","last_active":"2023-08-17T00:07:37.060282+0000","last_peered":"2023-08-17T00:07:37.060282+0000","last_clean":"2023-08-17T00:07:37.060282+0000","last_became_active":"2023-08-17T00:07:36.634193+0000","last_became_peered":"2023-08-17T00:07:36.634193+0000","last_unstale":"2023-08-17T00:07:37.060282+0000","last_undegraded":"2023-08-17T00:07:37.060282+0000","last_fullsized":"2023-08-17T00:07:37.060282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.083529+0000","last_change":"2023-08-17T00:07:37.071669+0000","last_active":"2023-08-17T00:07:37.083529+0000","last_peered":"2023-08-17T00:07:37.083529+0000","last_clean":"2023-08-17T00:07:37.083529+0000","last_became_active":"2023-08-17T00:07:37.071367+0000","last_became_peered":"2023-08-17T00:07:37.071367+0000","last_unstale":"2023-08-17T00:07:37.083529+0000","last_undegraded":"2023-08-17T00:07:37.083529+0000","last_fullsized":"2023-08-17T00:07:37.083529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091957+0000","last_change":"2023-08-17T00:07:36.646370+0000","last_active":"2023-08-17T00:07:37.091957+0000","last_peered":"2023-08-17T00:07:37.091957+0000","last_clean":"2023-08-17T00:07:37.091957+0000","last_became_active":"2023-08-17T00:07:36.646025+0000","last_became_peered":"2023-08-17T00:07:36.646025+0000","last_unstale":"2023-08-17T00:07:37.091957+0000","last_undegraded":"2023-08-17T00:07:37.091957+0000","last_fullsized":"2023-08-17T00:07:37.091957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.070518+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:07:37.070518+0000","last_peered":"2023-08-17T00:07:37.070518+0000","last_clean":"2023-08-17T00:07:37.070518+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:07:37.070518+0000","last_undegraded":"2023-08-17T00:07:37.070518+0000","last_fullsized":"2023-08-17T00:07:37.070518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088315+0000","last_change":"2023-08-17T00:07:37.076997+0000","last_active":"2023-08-17T00:07:37.088315+0000","last_peered":"2023-08-17T00:07:37.088315+0000","last_clean":"2023-08-17T00:07:37.088315+0000","last_became_active":"2023-08-17T00:07:37.076560+0000","last_became_peered":"2023-08-17T00:07:37.076560+0000","last_unstale":"2023-08-17T00:07:37.088315+0000","last_undegraded":"2023-08-17T00:07:37.088315+0000","last_fullsized":"2023-08-17T00:07:37.088315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095046+0000","last_change":"2023-08-17T00:07:36.647129+0000","last_active":"2023-08-17T00:07:37.095046+0000","last_peered":"2023-08-17T00:07:37.095046+0000","last_clean":"2023-08-17T00:07:37.095046+0000","last_became_active":"2023-08-17T00:07:36.646834+0000","last_became_peered":"2023-08-17T00:07:36.646834+0000","last_unstale":"2023-08-17T00:07:37.095046+0000","last_undegraded":"2023-08-17T00:07:37.095046+0000","last_fullsized":"2023-08-17T00:07:37.095046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.058644+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:07:37.058644+0000","last_peered":"2023-08-17T00:07:37.058644+0000","last_clean":"2023-08-17T00:07:37.058644+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:07:37.058644+0000","last_undegraded":"2023-08-17T00:07:37.058644+0000","last_fullsized":"2023-08-17T00:07:37.058644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090965+0000","last_change":"2023-08-17T00:07:37.086820+0000","last_active":"2023-08-17T00:07:37.090965+0000","last_peered":"2023-08-17T00:07:37.090965+0000","last_clean":"2023-08-17T00:07:37.090965+0000","last_became_active":"2023-08-17T00:07:37.086557+0000","last_became_peered":"2023-08-17T00:07:37.086557+0000","last_unstale":"2023-08-17T00:07:37.090965+0000","last_undegraded":"2023-08-17T00:07:37.090965+0000","last_fullsized":"2023-08-17T00:07:37.090965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.067246+0000","last_change":"2023-08-17T00:07:36.639369+0000","last_active":"2023-08-17T00:07:37.067246+0000","last_peered":"2023-08-17T00:07:37.067246+0000","last_clean":"2023-08-17T00:07:37.067246+0000","last_became_active":"2023-08-17T00:07:36.639100+0000","last_became_peered":"2023-08-17T00:07:36.639100+0000","last_unstale":"2023-08-17T00:07:37.067246+0000","last_undegraded":"2023-08-17T00:07:37.067246+0000","last_fullsized":"2023-08-17T00:07:37.067246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.070272+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:07:37.070272+0000","last_peered":"2023-08-17T00:07:37.070272+0000","last_clean":"2023-08-17T00:07:37.070272+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:07:37.070272+0000","last_undegraded":"2023-08-17T00:07:37.070272+0000","last_fullsized":"2023-08-17T00:07:37.070272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090199+0000","last_change":"2023-08-17T00:07:37.084922+0000","last_active":"2023-08-17T00:07:37.090199+0000","last_peered":"2023-08-17T00:07:37.090199+0000","last_clean":"2023-08-17T00:07:37.090199+0000","last_became_active":"2023-08-17T00:07:37.084631+0000","last_became_peered":"2023-08-17T00:07:37.084631+0000","last_unstale":"2023-08-17T00:07:37.090199+0000","last_undegraded":"2023-08-17T00:07:37.090199+0000","last_fullsized":"2023-08-17T00:07:37.090199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.066325+0000","last_change":"2023-08-17T00:07:36.643970+0000","last_active":"2023-08-17T00:07:37.066325+0000","last_peered":"2023-08-17T00:07:37.066325+0000","last_clean":"2023-08-17T00:07:37.066325+0000","last_became_active":"2023-08-17T00:07:36.643616+0000","last_became_peered":"2023-08-17T00:07:36.643616+0000","last_unstale":"2023-08-17T00:07:37.066325+0000","last_undegraded":"2023-08-17T00:07:37.066325+0000","last_fullsized":"2023-08-17T00:07:37.066325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068498+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:07:37.068498+0000","last_peered":"2023-08-17T00:07:37.068498+0000","last_clean":"2023-08-17T00:07:37.068498+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:07:37.068498+0000","last_undegraded":"2023-08-17T00:07:37.068498+0000","last_fullsized":"2023-08-17T00:07:37.068498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090958+0000","last_change":"2023-08-17T00:07:37.085118+0000","last_active":"2023-08-17T00:07:37.090958+0000","last_peered":"2023-08-17T00:07:37.090958+0000","last_clean":"2023-08-17T00:07:37.090958+0000","last_became_active":"2023-08-17T00:07:37.084851+0000","last_became_peered":"2023-08-17T00:07:37.084851+0000","last_unstale":"2023-08-17T00:07:37.090958+0000","last_undegraded":"2023-08-17T00:07:37.090958+0000","last_fullsized":"2023-08-17T00:07:37.090958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082256+0000","last_change":"2023-08-17T00:07:36.635837+0000","last_active":"2023-08-17T00:07:37.082256+0000","last_peered":"2023-08-17T00:07:37.082256+0000","last_clean":"2023-08-17T00:07:37.082256+0000","last_became_active":"2023-08-17T00:07:36.635529+0000","last_became_peered":"2023-08-17T00:07:36.635529+0000","last_unstale":"2023-08-17T00:07:37.082256+0000","last_undegraded":"2023-08-17T00:07:37.082256+0000","last_fullsized":"2023-08-17T00:07:37.082256+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068992+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:07:37.068992+0000","last_peered":"2023-08-17T00:07:37.068992+0000","last_clean":"2023-08-17T00:07:37.068992+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:07:37.068992+0000","last_undegraded":"2023-08-17T00:07:37.068992+0000","last_fullsized":"2023-08-17T00:07:37.068992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.093471+0000","last_change":"2023-08-17T00:07:37.088021+0000","last_active":"2023-08-17T00:07:37.093471+0000","last_peered":"2023-08-17T00:07:37.093471+0000","last_clean":"2023-08-17T00:07:37.093471+0000","last_became_active":"2023-08-17T00:07:37.087681+0000","last_became_peered":"2023-08-17T00:07:37.087681+0000","last_unstale":"2023-08-17T00:07:37.093471+0000","last_undegraded":"2023-08-17T00:07:37.093471+0000","last_fullsized":"2023-08-17T00:07:37.093471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060180+0000","last_change":"2023-08-17T00:07:36.634264+0000","last_active":"2023-08-17T00:07:37.060180+0000","last_peered":"2023-08-17T00:07:37.060180+0000","last_clean":"2023-08-17T00:07:37.060180+0000","last_became_active":"2023-08-17T00:07:36.633771+0000","last_became_peered":"2023-08-17T00:07:36.633771+0000","last_unstale":"2023-08-17T00:07:37.060180+0000","last_undegraded":"2023-08-17T00:07:37.060180+0000","last_fullsized":"2023-08-17T00:07:37.060180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065342+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:07:37.065342+0000","last_peered":"2023-08-17T00:07:37.065342+0000","last_clean":"2023-08-17T00:07:37.065342+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:07:37.065342+0000","last_undegraded":"2023-08-17T00:07:37.065342+0000","last_fullsized":"2023-08-17T00:07:37.065342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088775+0000","last_change":"2023-08-17T00:07:37.079171+0000","last_active":"2023-08-17T00:07:37.088775+0000","last_peered":"2023-08-17T00:07:37.088775+0000","last_clean":"2023-08-17T00:07:37.088775+0000","last_became_active":"2023-08-17T00:07:37.078877+0000","last_became_peered":"2023-08-17T00:07:37.078877+0000","last_unstale":"2023-08-17T00:07:37.088775+0000","last_undegraded":"2023-08-17T00:07:37.088775+0000","last_fullsized":"2023-08-17T00:07:37.088775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.061035+0000","last_change":"2023-08-17T00:07:36.638362+0000","last_active":"2023-08-17T00:07:37.061035+0000","last_peered":"2023-08-17T00:07:37.061035+0000","last_clean":"2023-08-17T00:07:37.061035+0000","last_became_active":"2023-08-17T00:07:36.638075+0000","last_became_peered":"2023-08-17T00:07:36.638075+0000","last_unstale":"2023-08-17T00:07:37.061035+0000","last_undegraded":"2023-08-17T00:07:37.061035+0000","last_fullsized":"2023-08-17T00:07:37.061035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069372+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:07:37.069372+0000","last_peered":"2023-08-17T00:07:37.069372+0000","last_clean":"2023-08-17T00:07:37.069372+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:07:37.069372+0000","last_undegraded":"2023-08-17T00:07:37.069372+0000","last_fullsized":"2023-08-17T00:07:37.069372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.093316+0000","last_change":"2023-08-17T00:07:37.086300+0000","last_active":"2023-08-17T00:07:37.093316+0000","last_peered":"2023-08-17T00:07:37.093316+0000","last_clean":"2023-08-17T00:07:37.093316+0000","last_became_active":"2023-08-17T00:07:37.085851+0000","last_became_peered":"2023-08-17T00:07:37.085851+0000","last_unstale":"2023-08-17T00:07:37.093316+0000","last_undegraded":"2023-08-17T00:07:37.093316+0000","last_fullsized":"2023-08-17T00:07:37.093316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068305+0000","last_change":"2023-08-17T00:07:36.632338+0000","last_active":"2023-08-17T00:07:37.068305+0000","last_peered":"2023-08-17T00:07:37.068305+0000","last_clean":"2023-08-17T00:07:37.068305+0000","last_became_active":"2023-08-17T00:07:36.631893+0000","last_became_peered":"2023-08-17T00:07:36.631893+0000","last_unstale":"2023-08-17T00:07:37.068305+0000","last_undegraded":"2023-08-17T00:07:37.068305+0000","last_fullsized":"2023-08-17T00:07:37.068305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071386+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:07:37.071386+0000","last_peered":"2023-08-17T00:07:37.071386+0000","last_clean":"2023-08-17T00:07:37.071386+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:07:37.071386+0000","last_undegraded":"2023-08-17T00:07:37.071386+0000","last_fullsized":"2023-08-17T00:07:37.071386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.067707+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:07:37.067707+0000","last_peered":"2023-08-17T00:07:37.067707+0000","last_clean":"2023-08-17T00:07:37.067707+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:07:37.067707+0000","last_undegraded":"2023-08-17T00:07:37.067707+0000","last_fullsized":"2023-08-17T00:07:37.067707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061532,"statfs":{"total":96636764160,"available":96319008768,"internally_reserved":0,"allocated":946176,"data_stored":430356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.236,"15min":1.4119999999999999},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5529999999999999,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.2529999999999999,"15min":1.4610000000000001},"min":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.472,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2729999999999999,"15min":1.474},"min":{"1min":0.747,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.629,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.2589999999999999,"15min":1.46},"min":{"1min":0.72199999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.3959999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.3779999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1819999999999999,"15min":1.3280000000000001},"min":{"1min":0.81699999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4450000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":1.149},{"interface":"front","average":{"1min":1.248,"5min":1.3300000000000001,"15min":1.4930000000000001},"min":{"1min":0.92600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.681,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.135}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2350000000000001,"15min":1.3560000000000001},"min":{"1min":0.92100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.454,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.5069999999999999,"15min":1.7490000000000001},"min":{"1min":0.875,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7370000000000001,"5min":13.074999999999999,"15min":13.074999999999999},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.4299999999999999,"15min":1.7310000000000001},"min":{"1min":0.90200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.389,"15min":1.593},"min":{"1min":0.63600000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5369999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.071}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.5620000000000001,"15min":1.8680000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.6120000000000001,"5min":14.435,"15min":14.435},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.54,"15min":1.8089999999999999},"min":{"1min":0.81799999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.569,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.4410000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5669999999999999,"15min":1.8129999999999999},"min":{"1min":0.86899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.546,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.5069999999999999,"15min":1.718},"min":{"1min":1.03,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.522,"5min":11.365,"15min":11.365},"last":1.2450000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314416,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057424,"statfs":{"total":96636764160,"available":96314802176,"internally_reserved":0,"allocated":958464,"data_stored":431408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1000000000000001,"15min":1.05},"min":{"1min":0.67200000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.6120000000000001,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.1559999999999999,"15min":1.1459999999999999},"min":{"1min":0.70799999999999996,"5min":0.502,"15min":0.502},"max":{"1min":8.1750000000000007,"5min":8.1750000000000007,"15min":8.1750000000000007},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.1950000000000001,"15min":1.1120000000000001},"min":{"1min":0.70899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":10.355,"5min":10.355,"15min":10.355},"last":0.749},{"interface":"front","average":{"1min":1.619,"5min":1.1259999999999999,"15min":1.016},"min":{"1min":0.69199999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1910000000000001,"15min":1.1739999999999999},"min":{"1min":0.72799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.6970000000000001,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":0.63},{"interface":"front","average":{"1min":1.645,"5min":1.3069999999999999,"15min":1.27},"min":{"1min":0.89800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":1.2629999999999999,"15min":1.177},"min":{"1min":0.73899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":11.475,"5min":11.475,"15min":11.475},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.29,"15min":1.2709999999999999},"min":{"1min":0.75600000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.734,"5min":5.29,"15min":5.29},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.80600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":8.2230000000000008},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.3120000000000001,"15min":1.2350000000000001},"min":{"1min":0.69299999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":11.438000000000001,"5min":11.438000000000001,"15min":11.438000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.79100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4630000000000001,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.403,"15min":1.337},"min":{"1min":0.93899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.4019999999999999,"15min":1.333},"min":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":11.51,"5min":11.51,"15min":11.51},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.4239999999999999,"15min":1.429},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.552,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":0.83799999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542206,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":966656,"data_stored":437704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.651},"min":{"1min":0.71799999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3300000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.421,"15min":1.8400000000000001},"min":{"1min":0.68200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.742,"5min":16.838999999999999,"15min":16.838999999999999},"last":1.012}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.67300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.4490000000000001,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.3140000000000001,"15min":1.542},"min":{"1min":0.80200000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.472,"15min":1.8540000000000001},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4199999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":1.196},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.377,"15min":1.6539999999999999},"min":{"1min":0.752,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.425,"5min":11.949,"15min":11.949},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.4299999999999999,"15min":1.7090000000000001},"min":{"1min":0.83399999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.988,"5min":13.125,"15min":13.125},"last":1.121},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.3620000000000001,"15min":1.5720000000000001},"min":{"1min":0.79700000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6000000000000001,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":0.996}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.5489999999999999,"15min":1.919},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.4650000000000001,"5min":17.510000000000002,"15min":17.510000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.157,"5min":1.651,"15min":2.0910000000000002},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5700000000000001,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.26}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.627,"15min":2.0230000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.714,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.631,"15min":2.0190000000000001},"min":{"1min":0.96099999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.669,"5min":17.050000000000001,"15min":17.050000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.7549999999999999,"15min":2.1549999999999998},"min":{"1min":1.097,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.589,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.694,"15min":2.016},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.774,"5min":14.818,"15min":14.818},"last":0.89200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542205,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":966656,"data_stored":431658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":1.139},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.2589999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.296},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.21}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.228}]}]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061532,"statfs":{"total":96636764160,"available":96319008768,"internally_reserved":0,"allocated":946176,"data_stored":430356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.89800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0669999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.91700000000000004,"15min":1.069},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.52,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.93500000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86699999999999999,"15min":0.95399999999999996},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2929999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.042,"15min":1.135},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":3.911,"15min":3.911},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1180000000000001,"15min":1.2809999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.712,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.97499999999999998,"15min":1.0620000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5369999999999999,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.488,"15min":1.96},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4039999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.4319999999999999,"15min":1.6930000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.169}]},{"osd":5,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5449999999999999,"15min":1.843},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.909,"5min":12.914,"15min":12.914},"last":1.212},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.383,"15min":1.609},"min":{"1min":0.76700000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.635,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.472,"15min":1.804},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.873,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.363},{"interface":"front","average":{"1min":1.3,"5min":1.542,"15min":1.8520000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.9830000000000001,"5min":12.698,"15min":12.698},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.5149999999999999,"15min":1.7789999999999999},"min":{"1min":0.74199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2909999999999999,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.51,"15min":1.7869999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7450000000000001,"5min":11.417,"15min":11.417},"last":1.4159999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":970752,"data_stored":437738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85699999999999998,"15min":0.82299999999999995},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4810000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":1.042},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.97799999999999998,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6379999999999999,"5min":13.093,"15min":13.093},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.53500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.452,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.93500000000000005,"15min":0.91600000000000004},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3779999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":1.147}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0629999999999999,"15min":1.05},"min":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2909999999999999,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":1.5920000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0329999999999999,"15min":1.022},"min":{"1min":0.56799999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.327,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.2849999999999999,"15min":1.196},"min":{"1min":0.75900000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.363,"5min":20.548999999999999,"15min":20.548999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":0.90900000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.49,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.327}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.401,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8540000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.536},{"interface":"front","average":{"1min":1.238,"5min":1.2789999999999999,"15min":1.302},"min":{"1min":0.86299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6850000000000001,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.9990000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3240000000000001,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.722,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.379},{"interface":"front","average":{"1min":1.194,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.54,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.7829999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.96199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.615,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.397,"15min":1.407},"min":{"1min":0.877,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.77,"5min":13.131,"15min":13.131},"last":1.6200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542206,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":437082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.998}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.4610000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.49},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.639}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310316,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061524,"statfs":{"total":96636764160,"available":96319000576,"internally_reserved":0,"allocated":954368,"data_stored":431270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.091}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":0.84699999999999998},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":0.997}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.123}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.248}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.1539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:07:41.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:07:41.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 Processor -- start 2023-08-17T00:07:41.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 -- start start 2023-08-17T00:07:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f39d00c57a0 0x7f39d00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39d0153f50 0x7f39d0154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00bfd10 con 0x7f39d0157600 2023-08-17T00:07:41.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d0154860 con 0x7f39d0153f50 2023-08-17T00:07:41.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39d4e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d0154af0 con 0x7f39d00c57a0 2023-08-17T00:07:41.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39ceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39d0153f50 0x7f39d0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39ceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39d0153f50 0x7f39d0154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60530/0 (socket says 172.21.15.153:60530) 2023-08-17T00:07:41.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39ceffd700 1 -- 172.21.15.153:0/2324605049 learned_addr learned my addr 172.21.15.153:0/2324605049 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:41.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39cf7fe700 1 --2- 172.21.15.153:0/2324605049 >> v2:172.21.15.178:3300/0 conn(0x7f39d00c57a0 0x7f39d00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39ceffd700 1 -- 172.21.15.153:0/2324605049 >> v2:172.21.15.178:3300/0 conn(0x7f39d00c57a0 msgr2=0x7f39d00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39ceffd700 1 --2- 172.21.15.153:0/2324605049 >> v2:172.21.15.178:3300/0 conn(0x7f39d00c57a0 0x7f39d00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.563+0000 7f39ceffd700 1 -- 172.21.15.153:0/2324605049 >> v1:172.21.15.153:6789/0 conn(0x7f39d0157600 legacy=0x7f39d0157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39ceffd700 1 -- 172.21.15.153:0/2324605049 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0154dd0 con 0x7f39d0153f50 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39ceffd700 1 --2- 172.21.15.153:0/2324605049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0153f50 0x7f39d0154370 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f39d00c54c0 tx=0x7f39c40090f0).ready entity=mon.0 client_cookie=1fe5957bb3dc0c37 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39ce7fc700 1 -- 172.21.15.153:0/2324605049 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400b600 con 0x7f39d0153f50 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39ce7fc700 1 -- 172.21.15.153:0/2324605049 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c400b760 con 0x7f39d0153f50 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39ce7fc700 1 -- 172.21.15.153:0/2324605049 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c400bae0 con 0x7f39d0153f50 2023-08-17T00:07:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 -- 172.21.15.153:0/2324605049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0153f50 msgr2=0x7f39d0154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2324605049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0153f50 0x7f39d0154370 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7f39d00c54c0 tx=0x7f39c40090f0).stop 2023-08-17T00:07:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 -- 172.21.15.153:0/2324605049 shutdown_connections 2023-08-17T00:07:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2324605049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0153f50 0x7f39d0154370 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2324605049 >> v2:172.21.15.178:3300/0 conn(0x7f39d00c57a0 0x7f39d00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 -- 172.21.15.153:0/2324605049 >> 172.21.15.153:0/2324605049 conn(0x7f39d0062a70 msgr2=0x7f39d00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 -- 172.21.15.153:0/2324605049 shutdown_connections 2023-08-17T00:07:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 -- 172.21.15.153:0/2324605049 wait complete. 2023-08-17T00:07:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 Processor -- start 2023-08-17T00:07:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.567+0000 7f39d4e39700 1 -- start start 2023-08-17T00:07:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39d00c57a0 0x7f39d00c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d0153f50 0x7f39d0149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 0x7f39d0167b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c9ad0 con 0x7f39d0157600 2023-08-17T00:07:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d014aa60 con 0x7f39d0153f50 2023-08-17T00:07:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00ade90 con 0x7f39d00c57a0 2023-08-17T00:07:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 0x7f39d0167b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 0x7f39d0167b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60540/0 (socket says 172.21.15.153:60540) 2023-08-17T00:07:41.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 -- 172.21.15.153:0/2010390118 learned_addr learned my addr 172.21.15.153:0/2010390118 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:41.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39ceffd700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d0153f50 0x7f39d0149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cf7fe700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39d00c57a0 0x7f39d00c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 -- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39d00c57a0 msgr2=0x7f39d00c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39d00c57a0 0x7f39d00c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 -- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d0153f50 msgr2=0x7f39d0149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d0153f50 0x7f39d0149eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 -- 172.21.15.153:0/2010390118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4009370 con 0x7f39d0157600 2023-08-17T00:07:41.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39cffff700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 0x7f39d0167b00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f39c8002230 tx=0x7f39c80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8010510 con 0x7f39d0157600 2023-08-17T00:07:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c8010670 con 0x7f39d0157600 2023-08-17T00:07:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d00c76f0 con 0x7f39d0157600 2023-08-17T00:07:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80109f0 con 0x7f39d0157600 2023-08-17T00:07:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.571+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d00c7380 con 0x7f39d0157600 2023-08-17T00:07:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.575+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d00c7880 con 0x7f39d0157600 2023-08-17T00:07:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.575+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f39c8010070 con 0x7f39d0157600 2023-08-17T00:07:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.575+0000 7f39b77fe700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39bc05a180 0x7f39bc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.575+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f39c8073ee0 con 0x7f39d0157600 2023-08-17T00:07:41.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.575+0000 7f39cf7fe700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39bc05a180 0x7f39bc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:41.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.579+0000 7f39cf7fe700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39bc05a180 0x7f39bc05c640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f39c0006fd0 tx=0x7f39c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:41.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.583+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39c8047880 con 0x7f39d0157600 2023-08-17T00:07:41.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.743+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39d006b4c0 con 0x7f39bc05a180 2023-08-17T00:07:41.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.763+0000 7f39b77fe700 1 -- 172.21.15.153:0/2010390118 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359550 (secure 0 0 0) 0x7f39d006b4c0 con 0x7f39bc05a180 2023-08-17T00:07:41.777 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:41.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39bc05a180 msgr2=0x7f39bc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39bc05a180 0x7f39bc05c640 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f39c0006fd0 tx=0x7f39c0008040).stop 2023-08-17T00:07:41.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 msgr2=0x7f39d0167b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:41.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 0x7f39d0167b00 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 rx=0x7f39c8002230 tx=0x7f39c80015e0).stop 2023-08-17T00:07:41.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 shutdown_connections 2023-08-17T00:07:41.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39bc05a180 0x7f39bc05c640 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d0157600 0x7f39d0167b00 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d0153f50 0x7f39d0149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 --2- 172.21.15.153:0/2010390118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39d00c57a0 0x7f39d00c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 >> 172.21.15.153:0/2010390118 conn(0x7f39d0062a70 msgr2=0x7f39d0157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 shutdown_connections 2023-08-17T00:07:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:41.771+0000 7f39d4e39700 1 -- 172.21.15.153:0/2010390118 wait complete. 2023-08-17T00:07:41.783 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:07:41.800 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-08-17T00:07:41.277875+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":212,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2470276,"kb_used_data":7492,"kb_used_omap":0,"kb_used_meta":2462720,"kb_avail":752504444,"statfs":{"total":773094113280,"available":770564550656,"internally_reserved":0,"allocated":7671808,"data_stored":3467572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2521825280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-15872,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-54,"num_read_kb":-56,"num_write":-77,"num_write_kb":-39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.159238"},"pg_stats":[{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086283+0000","last_change":"2023-08-17T00:07:37.072975+0000","last_active":"2023-08-17T00:07:37.086283+0000","last_peered":"2023-08-17T00:07:37.086283+0000","last_clean":"2023-08-17T00:07:37.086283+0000","last_became_active":"2023-08-17T00:07:37.072700+0000","last_became_peered":"2023-08-17T00:07:37.072700+0000","last_unstale":"2023-08-17T00:07:37.086283+0000","last_undegraded":"2023-08-17T00:07:37.086283+0000","last_fullsized":"2023-08-17T00:07:37.086283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3f","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.094511+0000","last_change":"2023-08-17T00:07:36.632509+0000","last_active":"2023-08-17T00:07:37.094511+0000","last_peered":"2023-08-17T00:07:37.094511+0000","last_clean":"2023-08-17T00:07:37.094511+0000","last_became_active":"2023-08-17T00:07:36.632231+0000","last_became_peered":"2023-08-17T00:07:36.632231+0000","last_unstale":"2023-08-17T00:07:37.094511+0000","last_undegraded":"2023-08-17T00:07:37.094511+0000","last_fullsized":"2023-08-17T00:07:37.094511+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095431+0000","last_change":"2023-08-17T00:07:37.091098+0000","last_active":"2023-08-17T00:07:37.095431+0000","last_peered":"2023-08-17T00:07:37.095431+0000","last_clean":"2023-08-17T00:07:37.095431+0000","last_became_active":"2023-08-17T00:07:37.090545+0000","last_became_peered":"2023-08-17T00:07:37.090545+0000","last_unstale":"2023-08-17T00:07:37.095431+0000","last_undegraded":"2023-08-17T00:07:37.095431+0000","last_fullsized":"2023-08-17T00:07:37.095431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.073022+0000","last_change":"2023-08-17T00:07:36.649374+0000","last_active":"2023-08-17T00:07:37.073022+0000","last_peered":"2023-08-17T00:07:37.073022+0000","last_clean":"2023-08-17T00:07:37.073022+0000","last_became_active":"2023-08-17T00:07:36.649100+0000","last_became_peered":"2023-08-17T00:07:36.649100+0000","last_unstale":"2023-08-17T00:07:37.073022+0000","last_undegraded":"2023-08-17T00:07:37.073022+0000","last_fullsized":"2023-08-17T00:07:37.073022+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088839+0000","last_change":"2023-08-17T00:07:37.082284+0000","last_active":"2023-08-17T00:07:37.088839+0000","last_peered":"2023-08-17T00:07:37.088839+0000","last_clean":"2023-08-17T00:07:37.088839+0000","last_became_active":"2023-08-17T00:07:37.081124+0000","last_became_peered":"2023-08-17T00:07:37.081124+0000","last_unstale":"2023-08-17T00:07:37.088839+0000","last_undegraded":"2023-08-17T00:07:37.088839+0000","last_fullsized":"2023-08-17T00:07:37.088839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.066221+0000","last_change":"2023-08-17T00:07:36.646540+0000","last_active":"2023-08-17T00:07:37.066221+0000","last_peered":"2023-08-17T00:07:37.066221+0000","last_clean":"2023-08-17T00:07:37.066221+0000","last_became_active":"2023-08-17T00:07:36.646218+0000","last_became_peered":"2023-08-17T00:07:36.646218+0000","last_unstale":"2023-08-17T00:07:37.066221+0000","last_undegraded":"2023-08-17T00:07:37.066221+0000","last_fullsized":"2023-08-17T00:07:37.066221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090945+0000","last_change":"2023-08-17T00:07:37.083315+0000","last_active":"2023-08-17T00:07:37.090945+0000","last_peered":"2023-08-17T00:07:37.090945+0000","last_clean":"2023-08-17T00:07:37.090945+0000","last_became_active":"2023-08-17T00:07:37.081759+0000","last_became_peered":"2023-08-17T00:07:37.081759+0000","last_unstale":"2023-08-17T00:07:37.090945+0000","last_undegraded":"2023-08-17T00:07:37.090945+0000","last_fullsized":"2023-08-17T00:07:37.090945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088212+0000","last_change":"2023-08-17T00:07:36.646534+0000","last_active":"2023-08-17T00:07:37.088212+0000","last_peered":"2023-08-17T00:07:37.088212+0000","last_clean":"2023-08-17T00:07:37.088212+0000","last_became_active":"2023-08-17T00:07:36.646276+0000","last_became_peered":"2023-08-17T00:07:36.646276+0000","last_unstale":"2023-08-17T00:07:37.088212+0000","last_undegraded":"2023-08-17T00:07:37.088212+0000","last_fullsized":"2023-08-17T00:07:37.088212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095446+0000","last_change":"2023-08-17T00:07:37.090971+0000","last_active":"2023-08-17T00:07:37.095446+0000","last_peered":"2023-08-17T00:07:37.095446+0000","last_clean":"2023-08-17T00:07:37.095446+0000","last_became_active":"2023-08-17T00:07:37.090679+0000","last_became_peered":"2023-08-17T00:07:37.090679+0000","last_unstale":"2023-08-17T00:07:37.095446+0000","last_undegraded":"2023-08-17T00:07:37.095446+0000","last_fullsized":"2023-08-17T00:07:37.095446+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082630+0000","last_change":"2023-08-17T00:07:36.640222+0000","last_active":"2023-08-17T00:07:37.082630+0000","last_peered":"2023-08-17T00:07:37.082630+0000","last_clean":"2023-08-17T00:07:37.082630+0000","last_became_active":"2023-08-17T00:07:36.639917+0000","last_became_peered":"2023-08-17T00:07:36.639917+0000","last_unstale":"2023-08-17T00:07:37.082630+0000","last_undegraded":"2023-08-17T00:07:37.082630+0000","last_fullsized":"2023-08-17T00:07:37.082630+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087892+0000","last_change":"2023-08-17T00:07:37.074954+0000","last_active":"2023-08-17T00:07:37.087892+0000","last_peered":"2023-08-17T00:07:37.087892+0000","last_clean":"2023-08-17T00:07:37.087892+0000","last_became_active":"2023-08-17T00:07:37.071632+0000","last_became_peered":"2023-08-17T00:07:37.071632+0000","last_unstale":"2023-08-17T00:07:37.087892+0000","last_undegraded":"2023-08-17T00:07:37.087892+0000","last_fullsized":"2023-08-17T00:07:37.087892+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3a","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082219+0000","last_change":"2023-08-17T00:07:36.641729+0000","last_active":"2023-08-17T00:07:37.082219+0000","last_peered":"2023-08-17T00:07:37.082219+0000","last_clean":"2023-08-17T00:07:37.082219+0000","last_became_active":"2023-08-17T00:07:36.641444+0000","last_became_peered":"2023-08-17T00:07:36.641444+0000","last_unstale":"2023-08-17T00:07:37.082219+0000","last_undegraded":"2023-08-17T00:07:37.082219+0000","last_fullsized":"2023-08-17T00:07:37.082219+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088112+0000","last_change":"2023-08-17T00:07:37.081273+0000","last_active":"2023-08-17T00:07:37.088112+0000","last_peered":"2023-08-17T00:07:37.088112+0000","last_clean":"2023-08-17T00:07:37.088112+0000","last_became_active":"2023-08-17T00:07:37.080986+0000","last_became_peered":"2023-08-17T00:07:37.080986+0000","last_unstale":"2023-08-17T00:07:37.088112+0000","last_undegraded":"2023-08-17T00:07:37.088112+0000","last_fullsized":"2023-08-17T00:07:37.088112+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.077753+0000","last_change":"2023-08-17T00:07:36.632382+0000","last_active":"2023-08-17T00:07:37.077753+0000","last_peered":"2023-08-17T00:07:37.077753+0000","last_clean":"2023-08-17T00:07:37.077753+0000","last_became_active":"2023-08-17T00:07:36.632120+0000","last_became_peered":"2023-08-17T00:07:36.632120+0000","last_unstale":"2023-08-17T00:07:37.077753+0000","last_undegraded":"2023-08-17T00:07:37.077753+0000","last_fullsized":"2023-08-17T00:07:37.077753+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088235+0000","last_change":"2023-08-17T00:07:37.085333+0000","last_active":"2023-08-17T00:07:37.088235+0000","last_peered":"2023-08-17T00:07:37.088235+0000","last_clean":"2023-08-17T00:07:37.088235+0000","last_became_active":"2023-08-17T00:07:37.084685+0000","last_became_peered":"2023-08-17T00:07:37.084685+0000","last_unstale":"2023-08-17T00:07:37.088235+0000","last_undegraded":"2023-08-17T00:07:37.088235+0000","last_fullsized":"2023-08-17T00:07:37.088235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069079+0000","last_change":"2023-08-17T00:07:36.632436+0000","last_active":"2023-08-17T00:07:37.069079+0000","last_peered":"2023-08-17T00:07:37.069079+0000","last_clean":"2023-08-17T00:07:37.069079+0000","last_became_active":"2023-08-17T00:07:36.632123+0000","last_became_peered":"2023-08-17T00:07:36.632123+0000","last_unstale":"2023-08-17T00:07:37.069079+0000","last_undegraded":"2023-08-17T00:07:37.069079+0000","last_fullsized":"2023-08-17T00:07:37.069079+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.097576+0000","last_change":"2023-08-17T00:07:37.094337+0000","last_active":"2023-08-17T00:07:37.097576+0000","last_peered":"2023-08-17T00:07:37.097576+0000","last_clean":"2023-08-17T00:07:37.097576+0000","last_became_active":"2023-08-17T00:07:37.094067+0000","last_became_peered":"2023-08-17T00:07:37.094067+0000","last_unstale":"2023-08-17T00:07:37.097576+0000","last_undegraded":"2023-08-17T00:07:37.097576+0000","last_fullsized":"2023-08-17T00:07:37.097576+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065981+0000","last_change":"2023-08-17T00:07:36.635216+0000","last_active":"2023-08-17T00:07:37.065981+0000","last_peered":"2023-08-17T00:07:37.065981+0000","last_clean":"2023-08-17T00:07:37.065981+0000","last_became_active":"2023-08-17T00:07:36.634929+0000","last_became_peered":"2023-08-17T00:07:36.634929+0000","last_unstale":"2023-08-17T00:07:37.065981+0000","last_undegraded":"2023-08-17T00:07:37.065981+0000","last_fullsized":"2023-08-17T00:07:37.065981+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088275+0000","last_change":"2023-08-17T00:07:37.077038+0000","last_active":"2023-08-17T00:07:37.088275+0000","last_peered":"2023-08-17T00:07:37.088275+0000","last_clean":"2023-08-17T00:07:37.088275+0000","last_became_active":"2023-08-17T00:07:37.076753+0000","last_became_peered":"2023-08-17T00:07:37.076753+0000","last_unstale":"2023-08-17T00:07:37.088275+0000","last_undegraded":"2023-08-17T00:07:37.088275+0000","last_fullsized":"2023-08-17T00:07:37.088275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068498+0000","last_change":"2023-08-17T00:07:36.633366+0000","last_active":"2023-08-17T00:07:37.068498+0000","last_peered":"2023-08-17T00:07:37.068498+0000","last_clean":"2023-08-17T00:07:37.068498+0000","last_became_active":"2023-08-17T00:07:36.633078+0000","last_became_peered":"2023-08-17T00:07:36.633078+0000","last_unstale":"2023-08-17T00:07:37.068498+0000","last_undegraded":"2023-08-17T00:07:37.068498+0000","last_fullsized":"2023-08-17T00:07:37.068498+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090138+0000","last_change":"2023-08-17T00:07:37.081653+0000","last_active":"2023-08-17T00:07:37.090138+0000","last_peered":"2023-08-17T00:07:37.090138+0000","last_clean":"2023-08-17T00:07:37.090138+0000","last_became_active":"2023-08-17T00:07:37.080990+0000","last_became_peered":"2023-08-17T00:07:37.080990+0000","last_unstale":"2023-08-17T00:07:37.090138+0000","last_undegraded":"2023-08-17T00:07:37.090138+0000","last_fullsized":"2023-08-17T00:07:37.090138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069951+0000","last_change":"2023-08-17T00:07:36.633459+0000","last_active":"2023-08-17T00:07:37.069951+0000","last_peered":"2023-08-17T00:07:37.069951+0000","last_clean":"2023-08-17T00:07:37.069951+0000","last_became_active":"2023-08-17T00:07:36.633172+0000","last_became_peered":"2023-08-17T00:07:36.633172+0000","last_unstale":"2023-08-17T00:07:37.069951+0000","last_undegraded":"2023-08-17T00:07:37.069951+0000","last_fullsized":"2023-08-17T00:07:37.069951+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087775+0000","last_change":"2023-08-17T00:07:37.076565+0000","last_active":"2023-08-17T00:07:37.087775+0000","last_peered":"2023-08-17T00:07:37.087775+0000","last_clean":"2023-08-17T00:07:37.087775+0000","last_became_active":"2023-08-17T00:07:37.076267+0000","last_became_peered":"2023-08-17T00:07:37.076267+0000","last_unstale":"2023-08-17T00:07:37.087775+0000","last_undegraded":"2023-08-17T00:07:37.087775+0000","last_fullsized":"2023-08-17T00:07:37.087775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.34","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090064+0000","last_change":"2023-08-17T00:07:36.627426+0000","last_active":"2023-08-17T00:07:37.090064+0000","last_peered":"2023-08-17T00:07:37.090064+0000","last_clean":"2023-08-17T00:07:37.090064+0000","last_became_active":"2023-08-17T00:07:36.627120+0000","last_became_peered":"2023-08-17T00:07:36.627120+0000","last_unstale":"2023-08-17T00:07:37.090064+0000","last_undegraded":"2023-08-17T00:07:37.090064+0000","last_fullsized":"2023-08-17T00:07:37.090064+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.074255+0000","last_change":"2023-08-17T00:07:37.067977+0000","last_active":"2023-08-17T00:07:37.074255+0000","last_peered":"2023-08-17T00:07:37.074255+0000","last_clean":"2023-08-17T00:07:37.074255+0000","last_became_active":"2023-08-17T00:07:37.067719+0000","last_became_peered":"2023-08-17T00:07:37.067719+0000","last_unstale":"2023-08-17T00:07:37.074255+0000","last_undegraded":"2023-08-17T00:07:37.074255+0000","last_fullsized":"2023-08-17T00:07:37.074255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.33","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086987+0000","last_change":"2023-08-17T00:07:36.646360+0000","last_active":"2023-08-17T00:07:37.086987+0000","last_peered":"2023-08-17T00:07:37.086987+0000","last_clean":"2023-08-17T00:07:37.086987+0000","last_became_active":"2023-08-17T00:07:36.646076+0000","last_became_peered":"2023-08-17T00:07:36.646076+0000","last_unstale":"2023-08-17T00:07:37.086987+0000","last_undegraded":"2023-08-17T00:07:37.086987+0000","last_fullsized":"2023-08-17T00:07:37.086987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.075971+0000","last_change":"2023-08-17T00:07:37.069959+0000","last_active":"2023-08-17T00:07:37.075971+0000","last_peered":"2023-08-17T00:07:37.075971+0000","last_clean":"2023-08-17T00:07:37.075971+0000","last_became_active":"2023-08-17T00:07:37.069595+0000","last_became_peered":"2023-08-17T00:07:37.069595+0000","last_unstale":"2023-08-17T00:07:37.075971+0000","last_undegraded":"2023-08-17T00:07:37.075971+0000","last_fullsized":"2023-08-17T00:07:37.075971+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.061803+0000","last_change":"2023-08-17T00:07:36.624042+0000","last_active":"2023-08-17T00:07:37.061803+0000","last_peered":"2023-08-17T00:07:37.061803+0000","last_clean":"2023-08-17T00:07:37.061803+0000","last_became_active":"2023-08-17T00:07:36.623570+0000","last_became_peered":"2023-08-17T00:07:36.623570+0000","last_unstale":"2023-08-17T00:07:37.061803+0000","last_undegraded":"2023-08-17T00:07:37.061803+0000","last_fullsized":"2023-08-17T00:07:37.061803+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086308+0000","last_change":"2023-08-17T00:07:37.080055+0000","last_active":"2023-08-17T00:07:37.086308+0000","last_peered":"2023-08-17T00:07:37.086308+0000","last_clean":"2023-08-17T00:07:37.086308+0000","last_became_active":"2023-08-17T00:07:37.079792+0000","last_became_peered":"2023-08-17T00:07:37.079792+0000","last_unstale":"2023-08-17T00:07:37.086308+0000","last_undegraded":"2023-08-17T00:07:37.086308+0000","last_fullsized":"2023-08-17T00:07:37.086308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060986+0000","last_change":"2023-08-17T00:07:36.625885+0000","last_active":"2023-08-17T00:07:37.060986+0000","last_peered":"2023-08-17T00:07:37.060986+0000","last_clean":"2023-08-17T00:07:37.060986+0000","last_became_active":"2023-08-17T00:07:36.625604+0000","last_became_peered":"2023-08-17T00:07:36.625604+0000","last_unstale":"2023-08-17T00:07:37.060986+0000","last_undegraded":"2023-08-17T00:07:37.060986+0000","last_fullsized":"2023-08-17T00:07:37.060986+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090440+0000","last_change":"2023-08-17T00:07:37.087060+0000","last_active":"2023-08-17T00:07:37.090440+0000","last_peered":"2023-08-17T00:07:37.090440+0000","last_clean":"2023-08-17T00:07:37.090440+0000","last_became_active":"2023-08-17T00:07:37.086799+0000","last_became_peered":"2023-08-17T00:07:37.086799+0000","last_unstale":"2023-08-17T00:07:37.090440+0000","last_undegraded":"2023-08-17T00:07:37.090440+0000","last_fullsized":"2023-08-17T00:07:37.090440+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.085186+0000","last_change":"2023-08-17T00:07:36.637036+0000","last_active":"2023-08-17T00:07:37.085186+0000","last_peered":"2023-08-17T00:07:37.085186+0000","last_clean":"2023-08-17T00:07:37.085186+0000","last_became_active":"2023-08-17T00:07:36.636652+0000","last_became_peered":"2023-08-17T00:07:36.636652+0000","last_unstale":"2023-08-17T00:07:37.085186+0000","last_undegraded":"2023-08-17T00:07:37.085186+0000","last_fullsized":"2023-08-17T00:07:37.085186+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087817+0000","last_change":"2023-08-17T00:07:37.077514+0000","last_active":"2023-08-17T00:07:37.087817+0000","last_peered":"2023-08-17T00:07:37.087817+0000","last_clean":"2023-08-17T00:07:37.087817+0000","last_became_active":"2023-08-17T00:07:37.077075+0000","last_became_peered":"2023-08-17T00:07:37.077075+0000","last_unstale":"2023-08-17T00:07:37.087817+0000","last_undegraded":"2023-08-17T00:07:37.087817+0000","last_fullsized":"2023-08-17T00:07:37.087817+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069017+0000","last_change":"2023-08-17T00:07:36.637381+0000","last_active":"2023-08-17T00:07:37.069017+0000","last_peered":"2023-08-17T00:07:37.069017+0000","last_clean":"2023-08-17T00:07:37.069017+0000","last_became_active":"2023-08-17T00:07:36.637042+0000","last_became_peered":"2023-08-17T00:07:36.637042+0000","last_unstale":"2023-08-17T00:07:37.069017+0000","last_undegraded":"2023-08-17T00:07:37.069017+0000","last_fullsized":"2023-08-17T00:07:37.069017+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095699+0000","last_change":"2023-08-17T00:07:37.089584+0000","last_active":"2023-08-17T00:07:37.095699+0000","last_peered":"2023-08-17T00:07:37.095699+0000","last_clean":"2023-08-17T00:07:37.095699+0000","last_became_active":"2023-08-17T00:07:37.089331+0000","last_became_peered":"2023-08-17T00:07:37.089331+0000","last_unstale":"2023-08-17T00:07:37.095699+0000","last_undegraded":"2023-08-17T00:07:37.095699+0000","last_fullsized":"2023-08-17T00:07:37.095699+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068531+0000","last_change":"2023-08-17T00:07:36.637101+0000","last_active":"2023-08-17T00:07:37.068531+0000","last_peered":"2023-08-17T00:07:37.068531+0000","last_clean":"2023-08-17T00:07:37.068531+0000","last_became_active":"2023-08-17T00:07:36.636733+0000","last_became_peered":"2023-08-17T00:07:36.636733+0000","last_unstale":"2023-08-17T00:07:37.068531+0000","last_undegraded":"2023-08-17T00:07:37.068531+0000","last_fullsized":"2023-08-17T00:07:37.068531+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087737+0000","last_change":"2023-08-17T00:07:37.074447+0000","last_active":"2023-08-17T00:07:37.087737+0000","last_peered":"2023-08-17T00:07:37.087737+0000","last_clean":"2023-08-17T00:07:37.087737+0000","last_became_active":"2023-08-17T00:07:37.073472+0000","last_became_peered":"2023-08-17T00:07:37.073472+0000","last_unstale":"2023-08-17T00:07:37.087737+0000","last_undegraded":"2023-08-17T00:07:37.087737+0000","last_fullsized":"2023-08-17T00:07:37.087737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2d","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089422+0000","last_change":"2023-08-17T00:07:36.640022+0000","last_active":"2023-08-17T00:07:37.089422+0000","last_peered":"2023-08-17T00:07:37.089422+0000","last_clean":"2023-08-17T00:07:37.089422+0000","last_became_active":"2023-08-17T00:07:36.638535+0000","last_became_peered":"2023-08-17T00:07:36.638535+0000","last_unstale":"2023-08-17T00:07:37.089422+0000","last_undegraded":"2023-08-17T00:07:37.089422+0000","last_fullsized":"2023-08-17T00:07:37.089422+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082185+0000","last_change":"2023-08-17T00:07:37.075096+0000","last_active":"2023-08-17T00:07:37.082185+0000","last_peered":"2023-08-17T00:07:37.082185+0000","last_clean":"2023-08-17T00:07:37.082185+0000","last_became_active":"2023-08-17T00:07:37.074794+0000","last_became_peered":"2023-08-17T00:07:37.074794+0000","last_unstale":"2023-08-17T00:07:37.082185+0000","last_undegraded":"2023-08-17T00:07:37.082185+0000","last_fullsized":"2023-08-17T00:07:37.082185+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068403+0000","last_change":"2023-08-17T00:07:36.632492+0000","last_active":"2023-08-17T00:07:37.068403+0000","last_peered":"2023-08-17T00:07:37.068403+0000","last_clean":"2023-08-17T00:07:37.068403+0000","last_became_active":"2023-08-17T00:07:36.632205+0000","last_became_peered":"2023-08-17T00:07:36.632205+0000","last_unstale":"2023-08-17T00:07:37.068403+0000","last_undegraded":"2023-08-17T00:07:37.068403+0000","last_fullsized":"2023-08-17T00:07:37.068403+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091751+0000","last_change":"2023-08-17T00:07:37.090713+0000","last_active":"2023-08-17T00:07:37.091751+0000","last_peered":"2023-08-17T00:07:37.091751+0000","last_clean":"2023-08-17T00:07:37.091751+0000","last_became_active":"2023-08-17T00:07:37.090437+0000","last_became_peered":"2023-08-17T00:07:37.090437+0000","last_unstale":"2023-08-17T00:07:37.091751+0000","last_undegraded":"2023-08-17T00:07:37.091751+0000","last_fullsized":"2023-08-17T00:07:37.091751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.092881+0000","last_change":"2023-08-17T00:07:36.644864+0000","last_active":"2023-08-17T00:07:37.092881+0000","last_peered":"2023-08-17T00:07:37.092881+0000","last_clean":"2023-08-17T00:07:37.092881+0000","last_became_active":"2023-08-17T00:07:36.644472+0000","last_became_peered":"2023-08-17T00:07:36.644472+0000","last_unstale":"2023-08-17T00:07:37.092881+0000","last_undegraded":"2023-08-17T00:07:37.092881+0000","last_fullsized":"2023-08-17T00:07:37.092881+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086492+0000","last_change":"2023-08-17T00:07:37.076479+0000","last_active":"2023-08-17T00:07:37.086492+0000","last_peered":"2023-08-17T00:07:37.086492+0000","last_clean":"2023-08-17T00:07:37.086492+0000","last_became_active":"2023-08-17T00:07:37.076193+0000","last_became_peered":"2023-08-17T00:07:37.076193+0000","last_unstale":"2023-08-17T00:07:37.086492+0000","last_undegraded":"2023-08-17T00:07:37.086492+0000","last_fullsized":"2023-08-17T00:07:37.086492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.059948+0000","last_change":"2023-08-17T00:07:36.635523+0000","last_active":"2023-08-17T00:07:37.059948+0000","last_peered":"2023-08-17T00:07:37.059948+0000","last_clean":"2023-08-17T00:07:37.059948+0000","last_became_active":"2023-08-17T00:07:36.635201+0000","last_became_peered":"2023-08-17T00:07:36.635201+0000","last_unstale":"2023-08-17T00:07:37.059948+0000","last_undegraded":"2023-08-17T00:07:37.059948+0000","last_fullsized":"2023-08-17T00:07:37.059948+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088129+0000","last_change":"2023-08-17T00:07:37.082994+0000","last_active":"2023-08-17T00:07:37.088129+0000","last_peered":"2023-08-17T00:07:37.088129+0000","last_clean":"2023-08-17T00:07:37.088129+0000","last_became_active":"2023-08-17T00:07:37.082738+0000","last_became_peered":"2023-08-17T00:07:37.082738+0000","last_unstale":"2023-08-17T00:07:37.088129+0000","last_undegraded":"2023-08-17T00:07:37.088129+0000","last_fullsized":"2023-08-17T00:07:37.088129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.077841+0000","last_change":"2023-08-17T00:07:36.639916+0000","last_active":"2023-08-17T00:07:37.077841+0000","last_peered":"2023-08-17T00:07:37.077841+0000","last_clean":"2023-08-17T00:07:37.077841+0000","last_became_active":"2023-08-17T00:07:36.639649+0000","last_became_peered":"2023-08-17T00:07:36.639649+0000","last_unstale":"2023-08-17T00:07:37.077841+0000","last_undegraded":"2023-08-17T00:07:37.077841+0000","last_fullsized":"2023-08-17T00:07:37.077841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090105+0000","last_change":"2023-08-17T00:07:37.085882+0000","last_active":"2023-08-17T00:07:37.090105+0000","last_peered":"2023-08-17T00:07:37.090105+0000","last_clean":"2023-08-17T00:07:37.090105+0000","last_became_active":"2023-08-17T00:07:37.085614+0000","last_became_peered":"2023-08-17T00:07:37.085614+0000","last_unstale":"2023-08-17T00:07:37.090105+0000","last_undegraded":"2023-08-17T00:07:37.090105+0000","last_fullsized":"2023-08-17T00:07:37.090105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069287+0000","last_change":"2023-08-17T00:07:36.640897+0000","last_active":"2023-08-17T00:07:37.069287+0000","last_peered":"2023-08-17T00:07:37.069287+0000","last_clean":"2023-08-17T00:07:37.069287+0000","last_became_active":"2023-08-17T00:07:36.640612+0000","last_became_peered":"2023-08-17T00:07:36.640612+0000","last_unstale":"2023-08-17T00:07:37.069287+0000","last_undegraded":"2023-08-17T00:07:37.069287+0000","last_fullsized":"2023-08-17T00:07:37.069287+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090970+0000","last_change":"2023-08-17T00:07:37.088001+0000","last_active":"2023-08-17T00:07:37.090970+0000","last_peered":"2023-08-17T00:07:37.090970+0000","last_clean":"2023-08-17T00:07:37.090970+0000","last_became_active":"2023-08-17T00:07:37.087672+0000","last_became_peered":"2023-08-17T00:07:37.087672+0000","last_unstale":"2023-08-17T00:07:37.090970+0000","last_undegraded":"2023-08-17T00:07:37.090970+0000","last_fullsized":"2023-08-17T00:07:37.090970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068744+0000","last_change":"2023-08-17T00:07:36.640315+0000","last_active":"2023-08-17T00:07:37.068744+0000","last_peered":"2023-08-17T00:07:37.068744+0000","last_clean":"2023-08-17T00:07:37.068744+0000","last_became_active":"2023-08-17T00:07:36.640050+0000","last_became_peered":"2023-08-17T00:07:36.640050+0000","last_unstale":"2023-08-17T00:07:37.068744+0000","last_undegraded":"2023-08-17T00:07:37.068744+0000","last_fullsized":"2023-08-17T00:07:37.068744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088022+0000","last_change":"2023-08-17T00:07:37.083151+0000","last_active":"2023-08-17T00:07:37.088022+0000","last_peered":"2023-08-17T00:07:37.088022+0000","last_clean":"2023-08-17T00:07:37.088022+0000","last_became_active":"2023-08-17T00:07:37.082868+0000","last_became_peered":"2023-08-17T00:07:37.082868+0000","last_unstale":"2023-08-17T00:07:37.088022+0000","last_undegraded":"2023-08-17T00:07:37.088022+0000","last_fullsized":"2023-08-17T00:07:37.088022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071242+0000","last_change":"2023-08-17T00:07:36.639932+0000","last_active":"2023-08-17T00:07:37.071242+0000","last_peered":"2023-08-17T00:07:37.071242+0000","last_clean":"2023-08-17T00:07:37.071242+0000","last_became_active":"2023-08-17T00:07:36.638889+0000","last_became_peered":"2023-08-17T00:07:36.638889+0000","last_unstale":"2023-08-17T00:07:37.071242+0000","last_undegraded":"2023-08-17T00:07:37.071242+0000","last_fullsized":"2023-08-17T00:07:37.071242+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086083+0000","last_change":"2023-08-17T00:07:37.076529+0000","last_active":"2023-08-17T00:07:37.086083+0000","last_peered":"2023-08-17T00:07:37.086083+0000","last_clean":"2023-08-17T00:07:37.086083+0000","last_became_active":"2023-08-17T00:07:37.076223+0000","last_became_peered":"2023-08-17T00:07:37.076223+0000","last_unstale":"2023-08-17T00:07:37.086083+0000","last_undegraded":"2023-08-17T00:07:37.086083+0000","last_fullsized":"2023-08-17T00:07:37.086083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068614+0000","last_change":"2023-08-17T00:07:36.634560+0000","last_active":"2023-08-17T00:07:37.068614+0000","last_peered":"2023-08-17T00:07:37.068614+0000","last_clean":"2023-08-17T00:07:37.068614+0000","last_became_active":"2023-08-17T00:07:36.634299+0000","last_became_peered":"2023-08-17T00:07:36.634299+0000","last_unstale":"2023-08-17T00:07:37.068614+0000","last_undegraded":"2023-08-17T00:07:37.068614+0000","last_fullsized":"2023-08-17T00:07:37.068614+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082607+0000","last_change":"2023-08-17T00:07:37.073372+0000","last_active":"2023-08-17T00:07:37.082607+0000","last_peered":"2023-08-17T00:07:37.082607+0000","last_clean":"2023-08-17T00:07:37.082607+0000","last_became_active":"2023-08-17T00:07:37.073077+0000","last_became_peered":"2023-08-17T00:07:37.073077+0000","last_unstale":"2023-08-17T00:07:37.082607+0000","last_undegraded":"2023-08-17T00:07:37.082607+0000","last_fullsized":"2023-08-17T00:07:37.082607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.072549+0000","last_change":"2023-08-17T00:07:36.638159+0000","last_active":"2023-08-17T00:07:37.072549+0000","last_peered":"2023-08-17T00:07:37.072549+0000","last_clean":"2023-08-17T00:07:37.072549+0000","last_became_active":"2023-08-17T00:07:36.637886+0000","last_became_peered":"2023-08-17T00:07:36.637886+0000","last_unstale":"2023-08-17T00:07:37.072549+0000","last_undegraded":"2023-08-17T00:07:37.072549+0000","last_fullsized":"2023-08-17T00:07:37.072549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088269+0000","last_change":"2023-08-17T00:07:37.076787+0000","last_active":"2023-08-17T00:07:37.088269+0000","last_peered":"2023-08-17T00:07:37.088269+0000","last_clean":"2023-08-17T00:07:37.088269+0000","last_became_active":"2023-08-17T00:07:37.076262+0000","last_became_peered":"2023-08-17T00:07:37.076262+0000","last_unstale":"2023-08-17T00:07:37.088269+0000","last_undegraded":"2023-08-17T00:07:37.088269+0000","last_fullsized":"2023-08-17T00:07:37.088269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068098+0000","last_change":"2023-08-17T00:07:36.639617+0000","last_active":"2023-08-17T00:07:37.068098+0000","last_peered":"2023-08-17T00:07:37.068098+0000","last_clean":"2023-08-17T00:07:37.068098+0000","last_became_active":"2023-08-17T00:07:36.639317+0000","last_became_peered":"2023-08-17T00:07:36.639317+0000","last_unstale":"2023-08-17T00:07:37.068098+0000","last_undegraded":"2023-08-17T00:07:37.068098+0000","last_fullsized":"2023-08-17T00:07:37.068098+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090723+0000","last_change":"2023-08-17T00:07:37.088078+0000","last_active":"2023-08-17T00:07:37.090723+0000","last_peered":"2023-08-17T00:07:37.090723+0000","last_clean":"2023-08-17T00:07:37.090723+0000","last_became_active":"2023-08-17T00:07:37.087797+0000","last_became_peered":"2023-08-17T00:07:37.087797+0000","last_unstale":"2023-08-17T00:07:37.090723+0000","last_undegraded":"2023-08-17T00:07:37.090723+0000","last_fullsized":"2023-08-17T00:07:37.090723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068912+0000","last_change":"2023-08-17T00:07:36.634494+0000","last_active":"2023-08-17T00:07:37.068912+0000","last_peered":"2023-08-17T00:07:37.068912+0000","last_clean":"2023-08-17T00:07:37.068912+0000","last_became_active":"2023-08-17T00:07:36.633674+0000","last_became_peered":"2023-08-17T00:07:36.633674+0000","last_unstale":"2023-08-17T00:07:37.068912+0000","last_undegraded":"2023-08-17T00:07:37.068912+0000","last_fullsized":"2023-08-17T00:07:37.068912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095474+0000","last_change":"2023-08-17T00:07:37.091656+0000","last_active":"2023-08-17T00:07:37.095474+0000","last_peered":"2023-08-17T00:07:37.095474+0000","last_clean":"2023-08-17T00:07:37.095474+0000","last_became_active":"2023-08-17T00:07:37.091464+0000","last_became_peered":"2023-08-17T00:07:37.091464+0000","last_unstale":"2023-08-17T00:07:37.095474+0000","last_undegraded":"2023-08-17T00:07:37.095474+0000","last_fullsized":"2023-08-17T00:07:37.095474+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065798+0000","last_change":"2023-08-17T00:07:36.638053+0000","last_active":"2023-08-17T00:07:37.065798+0000","last_peered":"2023-08-17T00:07:37.065798+0000","last_clean":"2023-08-17T00:07:37.065798+0000","last_became_active":"2023-08-17T00:07:36.637770+0000","last_became_peered":"2023-08-17T00:07:36.637770+0000","last_unstale":"2023-08-17T00:07:37.065798+0000","last_undegraded":"2023-08-17T00:07:37.065798+0000","last_fullsized":"2023-08-17T00:07:37.065798+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087544+0000","last_change":"2023-08-17T00:07:37.078684+0000","last_active":"2023-08-17T00:07:37.087544+0000","last_peered":"2023-08-17T00:07:37.087544+0000","last_clean":"2023-08-17T00:07:37.087544+0000","last_became_active":"2023-08-17T00:07:37.078321+0000","last_became_peered":"2023-08-17T00:07:37.078321+0000","last_unstale":"2023-08-17T00:07:37.087544+0000","last_undegraded":"2023-08-17T00:07:37.087544+0000","last_fullsized":"2023-08-17T00:07:37.087544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071641+0000","last_change":"2023-08-17T00:07:36.643988+0000","last_active":"2023-08-17T00:07:37.071641+0000","last_peered":"2023-08-17T00:07:37.071641+0000","last_clean":"2023-08-17T00:07:37.071641+0000","last_became_active":"2023-08-17T00:07:36.643683+0000","last_became_peered":"2023-08-17T00:07:36.643683+0000","last_unstale":"2023-08-17T00:07:37.071641+0000","last_undegraded":"2023-08-17T00:07:37.071641+0000","last_fullsized":"2023-08-17T00:07:37.071641+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088334+0000","last_change":"2023-08-17T00:07:37.077179+0000","last_active":"2023-08-17T00:07:37.088334+0000","last_peered":"2023-08-17T00:07:37.088334+0000","last_clean":"2023-08-17T00:07:37.088334+0000","last_became_active":"2023-08-17T00:07:37.076221+0000","last_became_peered":"2023-08-17T00:07:37.076221+0000","last_unstale":"2023-08-17T00:07:37.088334+0000","last_undegraded":"2023-08-17T00:07:37.088334+0000","last_fullsized":"2023-08-17T00:07:37.088334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.083878+0000","last_change":"2023-08-17T00:07:36.637629+0000","last_active":"2023-08-17T00:07:37.083878+0000","last_peered":"2023-08-17T00:07:37.083878+0000","last_clean":"2023-08-17T00:07:37.083878+0000","last_became_active":"2023-08-17T00:07:36.637113+0000","last_became_peered":"2023-08-17T00:07:36.637113+0000","last_unstale":"2023-08-17T00:07:37.083878+0000","last_undegraded":"2023-08-17T00:07:37.083878+0000","last_fullsized":"2023-08-17T00:07:37.083878+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088500+0000","last_change":"2023-08-17T00:07:37.079400+0000","last_active":"2023-08-17T00:07:37.088500+0000","last_peered":"2023-08-17T00:07:37.088500+0000","last_clean":"2023-08-17T00:07:37.088500+0000","last_became_active":"2023-08-17T00:07:37.079124+0000","last_became_peered":"2023-08-17T00:07:37.079124+0000","last_unstale":"2023-08-17T00:07:37.088500+0000","last_undegraded":"2023-08-17T00:07:37.088500+0000","last_fullsized":"2023-08-17T00:07:37.088500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087178+0000","last_change":"2023-08-17T00:07:36.637020+0000","last_active":"2023-08-17T00:07:37.087178+0000","last_peered":"2023-08-17T00:07:37.087178+0000","last_clean":"2023-08-17T00:07:37.087178+0000","last_became_active":"2023-08-17T00:07:36.636488+0000","last_became_peered":"2023-08-17T00:07:36.636488+0000","last_unstale":"2023-08-17T00:07:37.087178+0000","last_undegraded":"2023-08-17T00:07:37.087178+0000","last_fullsized":"2023-08-17T00:07:37.087178+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086485+0000","last_change":"2023-08-17T00:07:37.081525+0000","last_active":"2023-08-17T00:07:37.086485+0000","last_peered":"2023-08-17T00:07:37.086485+0000","last_clean":"2023-08-17T00:07:37.086485+0000","last_became_active":"2023-08-17T00:07:37.080967+0000","last_became_peered":"2023-08-17T00:07:37.080967+0000","last_unstale":"2023-08-17T00:07:37.086485+0000","last_undegraded":"2023-08-17T00:07:37.086485+0000","last_fullsized":"2023-08-17T00:07:37.086485+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091424+0000","last_change":"2023-08-17T00:07:36.630900+0000","last_active":"2023-08-17T00:07:37.091424+0000","last_peered":"2023-08-17T00:07:37.091424+0000","last_clean":"2023-08-17T00:07:37.091424+0000","last_became_active":"2023-08-17T00:07:36.626930+0000","last_became_peered":"2023-08-17T00:07:36.626930+0000","last_unstale":"2023-08-17T00:07:37.091424+0000","last_undegraded":"2023-08-17T00:07:37.091424+0000","last_fullsized":"2023-08-17T00:07:37.091424+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095411+0000","last_change":"2023-08-17T00:07:37.090815+0000","last_active":"2023-08-17T00:07:37.095411+0000","last_peered":"2023-08-17T00:07:37.095411+0000","last_clean":"2023-08-17T00:07:37.095411+0000","last_became_active":"2023-08-17T00:07:37.090518+0000","last_became_peered":"2023-08-17T00:07:37.090518+0000","last_unstale":"2023-08-17T00:07:37.095411+0000","last_undegraded":"2023-08-17T00:07:37.095411+0000","last_fullsized":"2023-08-17T00:07:37.095411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060125+0000","last_change":"2023-08-17T00:07:36.641933+0000","last_active":"2023-08-17T00:07:37.060125+0000","last_peered":"2023-08-17T00:07:37.060125+0000","last_clean":"2023-08-17T00:07:37.060125+0000","last_became_active":"2023-08-17T00:07:36.641615+0000","last_became_peered":"2023-08-17T00:07:36.641615+0000","last_unstale":"2023-08-17T00:07:37.060125+0000","last_undegraded":"2023-08-17T00:07:37.060125+0000","last_fullsized":"2023-08-17T00:07:37.060125+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091763+0000","last_change":"2023-08-17T00:07:37.090812+0000","last_active":"2023-08-17T00:07:37.091763+0000","last_peered":"2023-08-17T00:07:37.091763+0000","last_clean":"2023-08-17T00:07:37.091763+0000","last_became_active":"2023-08-17T00:07:37.090463+0000","last_became_peered":"2023-08-17T00:07:37.090463+0000","last_unstale":"2023-08-17T00:07:37.091763+0000","last_undegraded":"2023-08-17T00:07:37.091763+0000","last_fullsized":"2023-08-17T00:07:37.091763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.058907+0000","last_change":"2023-08-17T00:07:36.641954+0000","last_active":"2023-08-17T00:07:37.058907+0000","last_peered":"2023-08-17T00:07:37.058907+0000","last_clean":"2023-08-17T00:07:37.058907+0000","last_became_active":"2023-08-17T00:07:36.641534+0000","last_became_peered":"2023-08-17T00:07:36.641534+0000","last_unstale":"2023-08-17T00:07:37.058907+0000","last_undegraded":"2023-08-17T00:07:37.058907+0000","last_fullsized":"2023-08-17T00:07:37.058907+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089130+0000","last_change":"2023-08-17T00:07:37.083462+0000","last_active":"2023-08-17T00:07:37.089130+0000","last_peered":"2023-08-17T00:07:37.089130+0000","last_clean":"2023-08-17T00:07:37.089130+0000","last_became_active":"2023-08-17T00:07:37.083169+0000","last_became_peered":"2023-08-17T00:07:37.083169+0000","last_unstale":"2023-08-17T00:07:37.089130+0000","last_undegraded":"2023-08-17T00:07:37.089130+0000","last_fullsized":"2023-08-17T00:07:37.089130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068987+0000","last_change":"2023-08-17T00:07:36.631813+0000","last_active":"2023-08-17T00:07:37.068987+0000","last_peered":"2023-08-17T00:07:37.068987+0000","last_clean":"2023-08-17T00:07:37.068987+0000","last_became_active":"2023-08-17T00:07:36.631519+0000","last_became_peered":"2023-08-17T00:07:36.631519+0000","last_unstale":"2023-08-17T00:07:37.068987+0000","last_undegraded":"2023-08-17T00:07:37.068987+0000","last_fullsized":"2023-08-17T00:07:37.068987+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086540+0000","last_change":"2023-08-17T00:07:37.082081+0000","last_active":"2023-08-17T00:07:37.086540+0000","last_peered":"2023-08-17T00:07:37.086540+0000","last_clean":"2023-08-17T00:07:37.086540+0000","last_became_active":"2023-08-17T00:07:37.081773+0000","last_became_peered":"2023-08-17T00:07:37.081773+0000","last_unstale":"2023-08-17T00:07:37.086540+0000","last_undegraded":"2023-08-17T00:07:37.086540+0000","last_fullsized":"2023-08-17T00:07:37.086540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060895+0000","last_change":"2023-08-17T00:07:36.636165+0000","last_active":"2023-08-17T00:07:37.060895+0000","last_peered":"2023-08-17T00:07:37.060895+0000","last_clean":"2023-08-17T00:07:37.060895+0000","last_became_active":"2023-08-17T00:07:36.635532+0000","last_became_peered":"2023-08-17T00:07:36.635532+0000","last_unstale":"2023-08-17T00:07:37.060895+0000","last_undegraded":"2023-08-17T00:07:37.060895+0000","last_fullsized":"2023-08-17T00:07:37.060895+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.079609+0000","last_change":"2023-08-17T00:07:37.077791+0000","last_active":"2023-08-17T00:07:37.079609+0000","last_peered":"2023-08-17T00:07:37.079609+0000","last_clean":"2023-08-17T00:07:37.079609+0000","last_became_active":"2023-08-17T00:07:37.077507+0000","last_became_peered":"2023-08-17T00:07:37.077507+0000","last_unstale":"2023-08-17T00:07:37.079609+0000","last_undegraded":"2023-08-17T00:07:37.079609+0000","last_fullsized":"2023-08-17T00:07:37.079609+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060078+0000","last_change":"2023-08-17T00:07:36.641931+0000","last_active":"2023-08-17T00:07:37.060078+0000","last_peered":"2023-08-17T00:07:37.060078+0000","last_clean":"2023-08-17T00:07:37.060078+0000","last_became_active":"2023-08-17T00:07:36.641605+0000","last_became_peered":"2023-08-17T00:07:36.641605+0000","last_unstale":"2023-08-17T00:07:37.060078+0000","last_undegraded":"2023-08-17T00:07:37.060078+0000","last_fullsized":"2023-08-17T00:07:37.060078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.074188+0000","last_change":"2023-08-17T00:07:37.070799+0000","last_active":"2023-08-17T00:07:37.074188+0000","last_peered":"2023-08-17T00:07:37.074188+0000","last_clean":"2023-08-17T00:07:37.074188+0000","last_became_active":"2023-08-17T00:07:37.070491+0000","last_became_peered":"2023-08-17T00:07:37.070491+0000","last_unstale":"2023-08-17T00:07:37.074188+0000","last_undegraded":"2023-08-17T00:07:37.074188+0000","last_fullsized":"2023-08-17T00:07:37.074188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.066398+0000","last_change":"2023-08-17T00:07:36.648335+0000","last_active":"2023-08-17T00:07:37.066398+0000","last_peered":"2023-08-17T00:07:37.066398+0000","last_clean":"2023-08-17T00:07:37.066398+0000","last_became_active":"2023-08-17T00:07:36.648039+0000","last_became_peered":"2023-08-17T00:07:36.648039+0000","last_unstale":"2023-08-17T00:07:37.066398+0000","last_undegraded":"2023-08-17T00:07:37.066398+0000","last_fullsized":"2023-08-17T00:07:37.066398+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.081968+0000","last_change":"2023-08-17T00:07:37.074229+0000","last_active":"2023-08-17T00:07:37.081968+0000","last_peered":"2023-08-17T00:07:37.081968+0000","last_clean":"2023-08-17T00:07:37.081968+0000","last_became_active":"2023-08-17T00:07:37.073914+0000","last_became_peered":"2023-08-17T00:07:37.073914+0000","last_unstale":"2023-08-17T00:07:37.081968+0000","last_undegraded":"2023-08-17T00:07:37.081968+0000","last_fullsized":"2023-08-17T00:07:37.081968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068598+0000","last_change":"2023-08-17T00:07:36.639631+0000","last_active":"2023-08-17T00:07:37.068598+0000","last_peered":"2023-08-17T00:07:37.068598+0000","last_clean":"2023-08-17T00:07:37.068598+0000","last_became_active":"2023-08-17T00:07:36.639154+0000","last_became_peered":"2023-08-17T00:07:36.639154+0000","last_unstale":"2023-08-17T00:07:37.068598+0000","last_undegraded":"2023-08-17T00:07:37.068598+0000","last_fullsized":"2023-08-17T00:07:37.068598+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090181+0000","last_change":"2023-08-17T00:07:37.081835+0000","last_active":"2023-08-17T00:07:37.090181+0000","last_peered":"2023-08-17T00:07:37.090181+0000","last_clean":"2023-08-17T00:07:37.090181+0000","last_became_active":"2023-08-17T00:07:37.081349+0000","last_became_peered":"2023-08-17T00:07:37.081349+0000","last_unstale":"2023-08-17T00:07:37.090181+0000","last_undegraded":"2023-08-17T00:07:37.090181+0000","last_fullsized":"2023-08-17T00:07:37.090181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"78'3","reported_seq":13,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089209+0000","last_change":"2023-08-17T00:07:36.636712+0000","last_active":"2023-08-17T00:07:37.089209+0000","last_peered":"2023-08-17T00:07:37.089209+0000","last_clean":"2023-08-17T00:07:37.089209+0000","last_became_active":"2023-08-17T00:07:36.634744+0000","last_became_peered":"2023-08-17T00:07:36.634744+0000","last_unstale":"2023-08-17T00:07:37.089209+0000","last_undegraded":"2023-08-17T00:07:37.089209+0000","last_fullsized":"2023-08-17T00:07:37.089209+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.089268+0000","last_change":"2023-08-17T00:07:37.082468+0000","last_active":"2023-08-17T00:07:37.089268+0000","last_peered":"2023-08-17T00:07:37.089268+0000","last_clean":"2023-08-17T00:07:37.089268+0000","last_became_active":"2023-08-17T00:07:37.082190+0000","last_became_peered":"2023-08-17T00:07:37.082190+0000","last_unstale":"2023-08-17T00:07:37.089268+0000","last_undegraded":"2023-08-17T00:07:37.089268+0000","last_fullsized":"2023-08-17T00:07:37.089268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090976+0000","last_change":"2023-08-17T00:07:36.645359+0000","last_active":"2023-08-17T00:07:37.090976+0000","last_peered":"2023-08-17T00:07:37.090976+0000","last_clean":"2023-08-17T00:07:37.090976+0000","last_became_active":"2023-08-17T00:07:36.645089+0000","last_became_peered":"2023-08-17T00:07:36.645089+0000","last_unstale":"2023-08-17T00:07:37.090976+0000","last_undegraded":"2023-08-17T00:07:37.090976+0000","last_fullsized":"2023-08-17T00:07:37.090976+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095528+0000","last_change":"2023-08-17T00:07:37.092375+0000","last_active":"2023-08-17T00:07:37.095528+0000","last_peered":"2023-08-17T00:07:37.095528+0000","last_clean":"2023-08-17T00:07:37.095528+0000","last_became_active":"2023-08-17T00:07:37.091891+0000","last_became_peered":"2023-08-17T00:07:37.091891+0000","last_unstale":"2023-08-17T00:07:37.095528+0000","last_undegraded":"2023-08-17T00:07:37.095528+0000","last_fullsized":"2023-08-17T00:07:37.095528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.13","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.085542+0000","last_change":"2023-08-17T00:07:36.631813+0000","last_active":"2023-08-17T00:07:37.085542+0000","last_peered":"2023-08-17T00:07:37.085542+0000","last_clean":"2023-08-17T00:07:37.085542+0000","last_became_active":"2023-08-17T00:07:36.631512+0000","last_became_peered":"2023-08-17T00:07:36.631512+0000","last_unstale":"2023-08-17T00:07:37.085542+0000","last_undegraded":"2023-08-17T00:07:37.085542+0000","last_fullsized":"2023-08-17T00:07:37.085542+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095825+0000","last_change":"2023-08-17T00:07:37.092784+0000","last_active":"2023-08-17T00:07:37.095825+0000","last_peered":"2023-08-17T00:07:37.095825+0000","last_clean":"2023-08-17T00:07:37.095825+0000","last_became_active":"2023-08-17T00:07:37.092430+0000","last_became_peered":"2023-08-17T00:07:37.092430+0000","last_unstale":"2023-08-17T00:07:37.095825+0000","last_undegraded":"2023-08-17T00:07:37.095825+0000","last_fullsized":"2023-08-17T00:07:37.095825+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060091+0000","last_change":"2023-08-17T00:07:36.629898+0000","last_active":"2023-08-17T00:07:37.060091+0000","last_peered":"2023-08-17T00:07:37.060091+0000","last_clean":"2023-08-17T00:07:37.060091+0000","last_became_active":"2023-08-17T00:07:36.627745+0000","last_became_peered":"2023-08-17T00:07:36.627745+0000","last_unstale":"2023-08-17T00:07:37.060091+0000","last_undegraded":"2023-08-17T00:07:37.060091+0000","last_fullsized":"2023-08-17T00:07:37.060091+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088411+0000","last_change":"2023-08-17T00:07:37.083143+0000","last_active":"2023-08-17T00:07:37.088411+0000","last_peered":"2023-08-17T00:07:37.088411+0000","last_clean":"2023-08-17T00:07:37.088411+0000","last_became_active":"2023-08-17T00:07:37.082878+0000","last_became_peered":"2023-08-17T00:07:37.082878+0000","last_unstale":"2023-08-17T00:07:37.088411+0000","last_undegraded":"2023-08-17T00:07:37.088411+0000","last_fullsized":"2023-08-17T00:07:37.088411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065322+0000","last_change":"2023-08-17T00:07:36.641664+0000","last_active":"2023-08-17T00:07:37.065322+0000","last_peered":"2023-08-17T00:07:37.065322+0000","last_clean":"2023-08-17T00:07:37.065322+0000","last_became_active":"2023-08-17T00:07:36.641401+0000","last_became_peered":"2023-08-17T00:07:36.641401+0000","last_unstale":"2023-08-17T00:07:37.065322+0000","last_undegraded":"2023-08-17T00:07:37.065322+0000","last_fullsized":"2023-08-17T00:07:37.065322+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088220+0000","last_change":"2023-08-17T00:07:37.085321+0000","last_active":"2023-08-17T00:07:37.088220+0000","last_peered":"2023-08-17T00:07:37.088220+0000","last_clean":"2023-08-17T00:07:37.088220+0000","last_became_active":"2023-08-17T00:07:37.084675+0000","last_became_peered":"2023-08-17T00:07:37.084675+0000","last_unstale":"2023-08-17T00:07:37.088220+0000","last_undegraded":"2023-08-17T00:07:37.088220+0000","last_fullsized":"2023-08-17T00:07:37.088220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"78'4","reported_seq":14,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087383+0000","last_change":"2023-08-17T00:07:36.625808+0000","last_active":"2023-08-17T00:07:37.087383+0000","last_peered":"2023-08-17T00:07:37.087383+0000","last_clean":"2023-08-17T00:07:37.087383+0000","last_became_active":"2023-08-17T00:07:36.625528+0000","last_became_peered":"2023-08-17T00:07:36.625528+0000","last_unstale":"2023-08-17T00:07:37.087383+0000","last_undegraded":"2023-08-17T00:07:37.087383+0000","last_fullsized":"2023-08-17T00:07:37.087383+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095401+0000","last_change":"2023-08-17T00:07:37.090777+0000","last_active":"2023-08-17T00:07:37.095401+0000","last_peered":"2023-08-17T00:07:37.095401+0000","last_clean":"2023-08-17T00:07:37.095401+0000","last_became_active":"2023-08-17T00:07:37.090486+0000","last_became_peered":"2023-08-17T00:07:37.090486+0000","last_unstale":"2023-08-17T00:07:37.095401+0000","last_undegraded":"2023-08-17T00:07:37.095401+0000","last_fullsized":"2023-08-17T00:07:37.095401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.7","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.092655+0000","last_change":"2023-08-17T00:07:36.635259+0000","last_active":"2023-08-17T00:07:37.092655+0000","last_peered":"2023-08-17T00:07:37.092655+0000","last_clean":"2023-08-17T00:07:37.092655+0000","last_became_active":"2023-08-17T00:07:36.634846+0000","last_became_peered":"2023-08-17T00:07:36.634846+0000","last_unstale":"2023-08-17T00:07:37.092655+0000","last_undegraded":"2023-08-17T00:07:37.092655+0000","last_fullsized":"2023-08-17T00:07:37.092655+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095846+0000","last_change":"2023-08-17T00:07:37.092784+0000","last_active":"2023-08-17T00:07:37.095846+0000","last_peered":"2023-08-17T00:07:37.095846+0000","last_clean":"2023-08-17T00:07:37.095846+0000","last_became_active":"2023-08-17T00:07:37.092410+0000","last_became_peered":"2023-08-17T00:07:37.092410+0000","last_unstale":"2023-08-17T00:07:37.095846+0000","last_undegraded":"2023-08-17T00:07:37.095846+0000","last_fullsized":"2023-08-17T00:07:37.095846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068912+0000","last_change":"2023-08-17T00:07:36.634709+0000","last_active":"2023-08-17T00:07:37.068912+0000","last_peered":"2023-08-17T00:07:37.068912+0000","last_clean":"2023-08-17T00:07:37.068912+0000","last_became_active":"2023-08-17T00:07:36.633820+0000","last_became_peered":"2023-08-17T00:07:36.633820+0000","last_unstale":"2023-08-17T00:07:37.068912+0000","last_undegraded":"2023-08-17T00:07:37.068912+0000","last_fullsized":"2023-08-17T00:07:37.068912+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086502+0000","last_change":"2023-08-17T00:07:37.081733+0000","last_active":"2023-08-17T00:07:37.086502+0000","last_peered":"2023-08-17T00:07:37.086502+0000","last_clean":"2023-08-17T00:07:37.086502+0000","last_became_active":"2023-08-17T00:07:37.081295+0000","last_became_peered":"2023-08-17T00:07:37.081295+0000","last_unstale":"2023-08-17T00:07:37.086502+0000","last_undegraded":"2023-08-17T00:07:37.086502+0000","last_fullsized":"2023-08-17T00:07:37.086502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071107+0000","last_change":"2023-08-17T00:07:36.639747+0000","last_active":"2023-08-17T00:07:37.071107+0000","last_peered":"2023-08-17T00:07:37.071107+0000","last_clean":"2023-08-17T00:07:37.071107+0000","last_became_active":"2023-08-17T00:07:36.639442+0000","last_became_peered":"2023-08-17T00:07:36.639442+0000","last_unstale":"2023-08-17T00:07:37.071107+0000","last_undegraded":"2023-08-17T00:07:37.071107+0000","last_fullsized":"2023-08-17T00:07:37.071107+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086405+0000","last_change":"2023-08-17T00:07:37.074896+0000","last_active":"2023-08-17T00:07:37.086405+0000","last_peered":"2023-08-17T00:07:37.086405+0000","last_clean":"2023-08-17T00:07:37.086405+0000","last_became_active":"2023-08-17T00:07:37.074439+0000","last_became_peered":"2023-08-17T00:07:37.074439+0000","last_unstale":"2023-08-17T00:07:37.086405+0000","last_undegraded":"2023-08-17T00:07:37.086405+0000","last_fullsized":"2023-08-17T00:07:37.086405+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.072645+0000","last_change":"2023-08-17T00:07:36.646370+0000","last_active":"2023-08-17T00:07:37.072645+0000","last_peered":"2023-08-17T00:07:37.072645+0000","last_clean":"2023-08-17T00:07:37.072645+0000","last_became_active":"2023-08-17T00:07:36.646099+0000","last_became_peered":"2023-08-17T00:07:36.646099+0000","last_unstale":"2023-08-17T00:07:37.072645+0000","last_undegraded":"2023-08-17T00:07:37.072645+0000","last_fullsized":"2023-08-17T00:07:37.072645+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.086570+0000","last_change":"2023-08-17T00:07:37.082157+0000","last_active":"2023-08-17T00:07:37.086570+0000","last_peered":"2023-08-17T00:07:37.086570+0000","last_clean":"2023-08-17T00:07:37.086570+0000","last_became_active":"2023-08-17T00:07:37.081669+0000","last_became_peered":"2023-08-17T00:07:37.081669+0000","last_unstale":"2023-08-17T00:07:37.086570+0000","last_undegraded":"2023-08-17T00:07:37.086570+0000","last_fullsized":"2023-08-17T00:07:37.086570+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069545+0000","last_change":"2023-08-17T00:07:36.637633+0000","last_active":"2023-08-17T00:07:37.069545+0000","last_peered":"2023-08-17T00:07:37.069545+0000","last_clean":"2023-08-17T00:07:37.069545+0000","last_became_active":"2023-08-17T00:07:36.636848+0000","last_became_peered":"2023-08-17T00:07:36.636848+0000","last_unstale":"2023-08-17T00:07:37.069545+0000","last_undegraded":"2023-08-17T00:07:37.069545+0000","last_fullsized":"2023-08-17T00:07:37.069545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.087366+0000","last_change":"2023-08-17T00:07:37.083542+0000","last_active":"2023-08-17T00:07:37.087366+0000","last_peered":"2023-08-17T00:07:37.087366+0000","last_clean":"2023-08-17T00:07:37.087366+0000","last_became_active":"2023-08-17T00:07:37.083251+0000","last_became_peered":"2023-08-17T00:07:37.083251+0000","last_unstale":"2023-08-17T00:07:37.087366+0000","last_undegraded":"2023-08-17T00:07:37.087366+0000","last_fullsized":"2023-08-17T00:07:37.087366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068404+0000","last_change":"2023-08-17T00:07:36.637100+0000","last_active":"2023-08-17T00:07:37.068404+0000","last_peered":"2023-08-17T00:07:37.068404+0000","last_clean":"2023-08-17T00:07:37.068404+0000","last_became_active":"2023-08-17T00:07:36.636810+0000","last_became_peered":"2023-08-17T00:07:36.636810+0000","last_unstale":"2023-08-17T00:07:37.068404+0000","last_undegraded":"2023-08-17T00:07:37.068404+0000","last_fullsized":"2023-08-17T00:07:37.068404+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.083494+0000","last_change":"2023-08-17T00:07:37.071633+0000","last_active":"2023-08-17T00:07:37.083494+0000","last_peered":"2023-08-17T00:07:37.083494+0000","last_clean":"2023-08-17T00:07:37.083494+0000","last_became_active":"2023-08-17T00:07:37.071164+0000","last_became_peered":"2023-08-17T00:07:37.071164+0000","last_unstale":"2023-08-17T00:07:37.083494+0000","last_undegraded":"2023-08-17T00:07:37.083494+0000","last_fullsized":"2023-08-17T00:07:37.083494+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065899+0000","last_change":"2023-08-17T00:07:36.648930+0000","last_active":"2023-08-17T00:07:37.065899+0000","last_peered":"2023-08-17T00:07:37.065899+0000","last_clean":"2023-08-17T00:07:37.065899+0000","last_became_active":"2023-08-17T00:07:36.648659+0000","last_became_peered":"2023-08-17T00:07:36.648659+0000","last_unstale":"2023-08-17T00:07:37.065899+0000","last_undegraded":"2023-08-17T00:07:37.065899+0000","last_fullsized":"2023-08-17T00:07:37.065899+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088391+0000","last_change":"2023-08-17T00:07:37.077259+0000","last_active":"2023-08-17T00:07:37.088391+0000","last_peered":"2023-08-17T00:07:37.088391+0000","last_clean":"2023-08-17T00:07:37.088391+0000","last_became_active":"2023-08-17T00:07:37.076292+0000","last_became_peered":"2023-08-17T00:07:37.076292+0000","last_unstale":"2023-08-17T00:07:37.088391+0000","last_undegraded":"2023-08-17T00:07:37.088391+0000","last_fullsized":"2023-08-17T00:07:37.088391+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060282+0000","last_change":"2023-08-17T00:07:36.634571+0000","last_active":"2023-08-17T00:07:37.060282+0000","last_peered":"2023-08-17T00:07:37.060282+0000","last_clean":"2023-08-17T00:07:37.060282+0000","last_became_active":"2023-08-17T00:07:36.634193+0000","last_became_peered":"2023-08-17T00:07:36.634193+0000","last_unstale":"2023-08-17T00:07:37.060282+0000","last_undegraded":"2023-08-17T00:07:37.060282+0000","last_fullsized":"2023-08-17T00:07:37.060282+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.083529+0000","last_change":"2023-08-17T00:07:37.071669+0000","last_active":"2023-08-17T00:07:37.083529+0000","last_peered":"2023-08-17T00:07:37.083529+0000","last_clean":"2023-08-17T00:07:37.083529+0000","last_became_active":"2023-08-17T00:07:37.071367+0000","last_became_peered":"2023-08-17T00:07:37.071367+0000","last_unstale":"2023-08-17T00:07:37.083529+0000","last_undegraded":"2023-08-17T00:07:37.083529+0000","last_fullsized":"2023-08-17T00:07:37.083529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"78'2","reported_seq":12,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.091957+0000","last_change":"2023-08-17T00:07:36.646370+0000","last_active":"2023-08-17T00:07:37.091957+0000","last_peered":"2023-08-17T00:07:37.091957+0000","last_clean":"2023-08-17T00:07:37.091957+0000","last_became_active":"2023-08-17T00:07:36.646025+0000","last_became_peered":"2023-08-17T00:07:36.646025+0000","last_unstale":"2023-08-17T00:07:37.091957+0000","last_undegraded":"2023-08-17T00:07:37.091957+0000","last_fullsized":"2023-08-17T00:07:37.091957+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.070518+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:07:37.070518+0000","last_peered":"2023-08-17T00:07:37.070518+0000","last_clean":"2023-08-17T00:07:37.070518+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:07:37.070518+0000","last_undegraded":"2023-08-17T00:07:37.070518+0000","last_fullsized":"2023-08-17T00:07:37.070518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088315+0000","last_change":"2023-08-17T00:07:37.076997+0000","last_active":"2023-08-17T00:07:37.088315+0000","last_peered":"2023-08-17T00:07:37.088315+0000","last_clean":"2023-08-17T00:07:37.088315+0000","last_became_active":"2023-08-17T00:07:37.076560+0000","last_became_peered":"2023-08-17T00:07:37.076560+0000","last_unstale":"2023-08-17T00:07:37.088315+0000","last_undegraded":"2023-08-17T00:07:37.088315+0000","last_fullsized":"2023-08-17T00:07:37.088315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.f","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.095046+0000","last_change":"2023-08-17T00:07:36.647129+0000","last_active":"2023-08-17T00:07:37.095046+0000","last_peered":"2023-08-17T00:07:37.095046+0000","last_clean":"2023-08-17T00:07:37.095046+0000","last_became_active":"2023-08-17T00:07:36.646834+0000","last_became_peered":"2023-08-17T00:07:36.646834+0000","last_unstale":"2023-08-17T00:07:37.095046+0000","last_undegraded":"2023-08-17T00:07:37.095046+0000","last_fullsized":"2023-08-17T00:07:37.095046+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.058644+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:07:37.058644+0000","last_peered":"2023-08-17T00:07:37.058644+0000","last_clean":"2023-08-17T00:07:37.058644+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:07:37.058644+0000","last_undegraded":"2023-08-17T00:07:37.058644+0000","last_fullsized":"2023-08-17T00:07:37.058644+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090965+0000","last_change":"2023-08-17T00:07:37.086820+0000","last_active":"2023-08-17T00:07:37.090965+0000","last_peered":"2023-08-17T00:07:37.090965+0000","last_clean":"2023-08-17T00:07:37.090965+0000","last_became_active":"2023-08-17T00:07:37.086557+0000","last_became_peered":"2023-08-17T00:07:37.086557+0000","last_unstale":"2023-08-17T00:07:37.090965+0000","last_undegraded":"2023-08-17T00:07:37.090965+0000","last_fullsized":"2023-08-17T00:07:37.090965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.067246+0000","last_change":"2023-08-17T00:07:36.639369+0000","last_active":"2023-08-17T00:07:37.067246+0000","last_peered":"2023-08-17T00:07:37.067246+0000","last_clean":"2023-08-17T00:07:37.067246+0000","last_became_active":"2023-08-17T00:07:36.639100+0000","last_became_peered":"2023-08-17T00:07:36.639100+0000","last_unstale":"2023-08-17T00:07:37.067246+0000","last_undegraded":"2023-08-17T00:07:37.067246+0000","last_fullsized":"2023-08-17T00:07:37.067246+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.070272+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:07:37.070272+0000","last_peered":"2023-08-17T00:07:37.070272+0000","last_clean":"2023-08-17T00:07:37.070272+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:07:37.070272+0000","last_undegraded":"2023-08-17T00:07:37.070272+0000","last_fullsized":"2023-08-17T00:07:37.070272+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090199+0000","last_change":"2023-08-17T00:07:37.084922+0000","last_active":"2023-08-17T00:07:37.090199+0000","last_peered":"2023-08-17T00:07:37.090199+0000","last_clean":"2023-08-17T00:07:37.090199+0000","last_became_active":"2023-08-17T00:07:37.084631+0000","last_became_peered":"2023-08-17T00:07:37.084631+0000","last_unstale":"2023-08-17T00:07:37.090199+0000","last_undegraded":"2023-08-17T00:07:37.090199+0000","last_fullsized":"2023-08-17T00:07:37.090199+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.066325+0000","last_change":"2023-08-17T00:07:36.643970+0000","last_active":"2023-08-17T00:07:37.066325+0000","last_peered":"2023-08-17T00:07:37.066325+0000","last_clean":"2023-08-17T00:07:37.066325+0000","last_became_active":"2023-08-17T00:07:36.643616+0000","last_became_peered":"2023-08-17T00:07:36.643616+0000","last_unstale":"2023-08-17T00:07:37.066325+0000","last_undegraded":"2023-08-17T00:07:37.066325+0000","last_fullsized":"2023-08-17T00:07:37.066325+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068498+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:07:37.068498+0000","last_peered":"2023-08-17T00:07:37.068498+0000","last_clean":"2023-08-17T00:07:37.068498+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:07:37.068498+0000","last_undegraded":"2023-08-17T00:07:37.068498+0000","last_fullsized":"2023-08-17T00:07:37.068498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.090958+0000","last_change":"2023-08-17T00:07:37.085118+0000","last_active":"2023-08-17T00:07:37.090958+0000","last_peered":"2023-08-17T00:07:37.090958+0000","last_clean":"2023-08-17T00:07:37.090958+0000","last_became_active":"2023-08-17T00:07:37.084851+0000","last_became_peered":"2023-08-17T00:07:37.084851+0000","last_unstale":"2023-08-17T00:07:37.090958+0000","last_undegraded":"2023-08-17T00:07:37.090958+0000","last_fullsized":"2023-08-17T00:07:37.090958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"78'1","reported_seq":11,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.082256+0000","last_change":"2023-08-17T00:07:36.635837+0000","last_active":"2023-08-17T00:07:37.082256+0000","last_peered":"2023-08-17T00:07:37.082256+0000","last_clean":"2023-08-17T00:07:37.082256+0000","last_became_active":"2023-08-17T00:07:36.635529+0000","last_became_peered":"2023-08-17T00:07:36.635529+0000","last_unstale":"2023-08-17T00:07:37.082256+0000","last_undegraded":"2023-08-17T00:07:37.082256+0000","last_fullsized":"2023-08-17T00:07:37.082256+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068992+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:07:37.068992+0000","last_peered":"2023-08-17T00:07:37.068992+0000","last_clean":"2023-08-17T00:07:37.068992+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:07:37.068992+0000","last_undegraded":"2023-08-17T00:07:37.068992+0000","last_fullsized":"2023-08-17T00:07:37.068992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.093471+0000","last_change":"2023-08-17T00:07:37.088021+0000","last_active":"2023-08-17T00:07:37.093471+0000","last_peered":"2023-08-17T00:07:37.093471+0000","last_clean":"2023-08-17T00:07:37.093471+0000","last_became_active":"2023-08-17T00:07:37.087681+0000","last_became_peered":"2023-08-17T00:07:37.087681+0000","last_unstale":"2023-08-17T00:07:37.093471+0000","last_undegraded":"2023-08-17T00:07:37.093471+0000","last_fullsized":"2023-08-17T00:07:37.093471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.060180+0000","last_change":"2023-08-17T00:07:36.634264+0000","last_active":"2023-08-17T00:07:37.060180+0000","last_peered":"2023-08-17T00:07:37.060180+0000","last_clean":"2023-08-17T00:07:37.060180+0000","last_became_active":"2023-08-17T00:07:36.633771+0000","last_became_peered":"2023-08-17T00:07:36.633771+0000","last_unstale":"2023-08-17T00:07:37.060180+0000","last_undegraded":"2023-08-17T00:07:37.060180+0000","last_fullsized":"2023-08-17T00:07:37.060180+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.065342+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:07:37.065342+0000","last_peered":"2023-08-17T00:07:37.065342+0000","last_clean":"2023-08-17T00:07:37.065342+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:07:37.065342+0000","last_undegraded":"2023-08-17T00:07:37.065342+0000","last_fullsized":"2023-08-17T00:07:37.065342+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.088775+0000","last_change":"2023-08-17T00:07:37.079171+0000","last_active":"2023-08-17T00:07:37.088775+0000","last_peered":"2023-08-17T00:07:37.088775+0000","last_clean":"2023-08-17T00:07:37.088775+0000","last_became_active":"2023-08-17T00:07:37.078877+0000","last_became_peered":"2023-08-17T00:07:37.078877+0000","last_unstale":"2023-08-17T00:07:37.088775+0000","last_undegraded":"2023-08-17T00:07:37.088775+0000","last_fullsized":"2023-08-17T00:07:37.088775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.061035+0000","last_change":"2023-08-17T00:07:36.638362+0000","last_active":"2023-08-17T00:07:37.061035+0000","last_peered":"2023-08-17T00:07:37.061035+0000","last_clean":"2023-08-17T00:07:37.061035+0000","last_became_active":"2023-08-17T00:07:36.638075+0000","last_became_peered":"2023-08-17T00:07:36.638075+0000","last_unstale":"2023-08-17T00:07:37.061035+0000","last_undegraded":"2023-08-17T00:07:37.061035+0000","last_fullsized":"2023-08-17T00:07:37.061035+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.069372+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:07:37.069372+0000","last_peered":"2023-08-17T00:07:37.069372+0000","last_clean":"2023-08-17T00:07:37.069372+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:07:37.069372+0000","last_undegraded":"2023-08-17T00:07:37.069372+0000","last_fullsized":"2023-08-17T00:07:37.069372+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.093316+0000","last_change":"2023-08-17T00:07:37.086300+0000","last_active":"2023-08-17T00:07:37.093316+0000","last_peered":"2023-08-17T00:07:37.093316+0000","last_clean":"2023-08-17T00:07:37.093316+0000","last_became_active":"2023-08-17T00:07:37.085851+0000","last_became_peered":"2023-08-17T00:07:37.085851+0000","last_unstale":"2023-08-17T00:07:37.093316+0000","last_undegraded":"2023-08-17T00:07:37.093316+0000","last_fullsized":"2023-08-17T00:07:37.093316+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:36.600321+0000","last_clean_scrub_stamp":"2023-08-17T00:07:36.600321+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.068305+0000","last_change":"2023-08-17T00:07:36.632338+0000","last_active":"2023-08-17T00:07:37.068305+0000","last_peered":"2023-08-17T00:07:37.068305+0000","last_clean":"2023-08-17T00:07:37.068305+0000","last_became_active":"2023-08-17T00:07:36.631893+0000","last_became_peered":"2023-08-17T00:07:36.631893+0000","last_unstale":"2023-08-17T00:07:37.068305+0000","last_undegraded":"2023-08-17T00:07:37.068305+0000","last_fullsized":"2023-08-17T00:07:37.068305+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:07:35.589413+0000","last_clean_scrub_stamp":"2023-08-17T00:07:35.589413+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.071386+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:07:37.071386+0000","last_peered":"2023-08-17T00:07:37.071386+0000","last_clean":"2023-08-17T00:07:37.071386+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:07:37.071386+0000","last_undegraded":"2023-08-17T00:07:37.071386+0000","last_fullsized":"2023-08-17T00:07:37.071386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":59,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-08-17T00:07:37.067707+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:07:37.067707+0000","last_peered":"2023-08-17T00:07:37.067707+0000","last_clean":"2023-08-17T00:07:37.067707+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:07:37.067707+0000","last_undegraded":"2023-08-17T00:07:37.067707+0000","last_fullsized":"2023-08-17T00:07:37.067707+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542205,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061532,"statfs":{"total":96636764160,"available":96319008768,"internally_reserved":0,"allocated":946176,"data_stored":430356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.236,"15min":1.4119999999999999},"min":{"1min":0.63600000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.5529999999999999,"5min":8.7769999999999992,"15min":8.7769999999999992},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.143,"5min":1.2529999999999999,"15min":1.4610000000000001},"min":{"1min":0.66500000000000004,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.472,"5min":9.6530000000000005,"15min":9.6530000000000005},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.2729999999999999,"15min":1.474},"min":{"1min":0.747,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.629,"5min":9.8800000000000008,"15min":9.8800000000000008},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.2589999999999999,"15min":1.46},"min":{"1min":0.72199999999999998,"5min":0.62,"15min":0.62},"max":{"1min":1.3959999999999999,"5min":8.8399999999999999,"15min":8.8399999999999999},"last":1.3779999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1319999999999999,"5min":1.1819999999999999,"15min":1.3280000000000001},"min":{"1min":0.81699999999999995,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4450000000000001,"5min":7.0190000000000001,"15min":7.0190000000000001},"last":1.149},{"interface":"front","average":{"1min":1.248,"5min":1.3300000000000001,"15min":1.4930000000000001},"min":{"1min":0.92600000000000005,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.681,"5min":9.4239999999999995,"15min":9.4239999999999995},"last":1.135}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.2350000000000001,"15min":1.3560000000000001},"min":{"1min":0.92100000000000004,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.454,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.298,"5min":1.5069999999999999,"15min":1.7490000000000001},"min":{"1min":0.875,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7370000000000001,"5min":13.074999999999999,"15min":13.074999999999999},"last":1.2110000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.4299999999999999,"15min":1.7310000000000001},"min":{"1min":0.90200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":13.784000000000001,"15min":13.784000000000001},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.389,"15min":1.593},"min":{"1min":0.63600000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5369999999999999,"5min":10.045999999999999,"15min":10.045999999999999},"last":1.071}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.5620000000000001,"15min":1.8680000000000001},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.6120000000000001,"5min":14.435,"15min":14.435},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.54,"15min":1.8089999999999999},"min":{"1min":0.81799999999999995,"5min":0.746,"15min":0.746},"max":{"1min":1.569,"5min":12.617000000000001,"15min":12.617000000000001},"last":1.4410000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5669999999999999,"15min":1.8129999999999999},"min":{"1min":0.86899999999999999,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.546,"5min":11.279999999999999,"15min":11.279999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.5069999999999999,"15min":1.718},"min":{"1min":1.03,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.522,"5min":11.365,"15min":11.365},"last":1.2450000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542205,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314416,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":313472,"kb_avail":94057424,"statfs":{"total":96636764160,"available":96314802176,"internally_reserved":0,"allocated":958464,"data_stored":431408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":320995328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1000000000000001,"15min":1.05},"min":{"1min":0.67200000000000004,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.6120000000000001,"5min":5.0890000000000004,"15min":5.0890000000000004},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.1559999999999999,"15min":1.1459999999999999},"min":{"1min":0.70799999999999996,"5min":0.502,"15min":0.502},"max":{"1min":8.1750000000000007,"5min":8.1750000000000007,"15min":8.1750000000000007},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.1950000000000001,"15min":1.1120000000000001},"min":{"1min":0.70899999999999996,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":10.355,"5min":10.355,"15min":10.355},"last":0.749},{"interface":"front","average":{"1min":1.619,"5min":1.1259999999999999,"15min":1.016},"min":{"1min":0.69199999999999995,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":11.391999999999999,"5min":11.391999999999999,"15min":11.391999999999999},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1910000000000001,"15min":1.1739999999999999},"min":{"1min":0.72799999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.6970000000000001,"5min":5.2329999999999997,"15min":5.2329999999999997},"last":0.63},{"interface":"front","average":{"1min":1.645,"5min":1.3069999999999999,"15min":1.27},"min":{"1min":0.89800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":8.3030000000000008,"5min":8.3030000000000008,"15min":8.3030000000000008},"last":0.81499999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":1.2629999999999999,"15min":1.177},"min":{"1min":0.73899999999999999,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":11.475,"5min":11.475,"15min":11.475},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.29,"15min":1.2709999999999999},"min":{"1min":0.75600000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.734,"5min":5.29,"15min":5.29},"last":0.94099999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.3089999999999999,"15min":1.2569999999999999},"min":{"1min":0.80600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":8.2230000000000008,"5min":8.2230000000000008,"15min":8.2230000000000008},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.7390000000000001,"5min":1.3120000000000001,"15min":1.2350000000000001},"min":{"1min":0.69299999999999995,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":11.438000000000001,"5min":11.438000000000001,"15min":11.438000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.2669999999999999,"15min":1.2589999999999999},"min":{"1min":0.79100000000000004,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.4630000000000001,"5min":5.2640000000000002,"15min":5.2640000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.7010000000000001,"5min":1.403,"15min":1.337},"min":{"1min":0.93899999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":8.3379999999999992,"5min":8.3379999999999992,"15min":8.3379999999999992},"last":0.90000000000000002}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.8069999999999999,"5min":1.4019999999999999,"15min":1.333},"min":{"1min":0.77600000000000002,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":11.51,"5min":11.51,"15min":11.51},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.4239999999999999,"15min":1.429},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.552,"5min":5.4009999999999998,"15min":5.4009999999999998},"last":0.83799999999999997}]}]},{"osd":5,"up_from":14,"seq":60129542206,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":966656,"data_stored":437704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.3089999999999999,"15min":1.651},"min":{"1min":0.71799999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3300000000000001,"5min":15.007999999999999,"15min":15.007999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":1.421,"15min":1.8400000000000001},"min":{"1min":0.68200000000000005,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.742,"5min":16.838999999999999,"15min":16.838999999999999},"last":1.012}]},{"osd":1,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.133,"15min":1.1990000000000001},"min":{"1min":0.67300000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.4490000000000001,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.77900000000000003},{"interface":"front","average":{"1min":1.143,"5min":1.3140000000000001,"15min":1.542},"min":{"1min":0.80200000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5,"5min":9.6579999999999995,"15min":9.6579999999999995},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.472,"15min":1.8540000000000001},"min":{"1min":0.73599999999999999,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.4199999999999999,"5min":16.675000000000001,"15min":16.675000000000001},"last":1.196},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.377,"15min":1.6539999999999999},"min":{"1min":0.752,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.425,"5min":11.949,"15min":11.949},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.4299999999999999,"15min":1.7090000000000001},"min":{"1min":0.83399999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.988,"5min":13.125,"15min":13.125},"last":1.121},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.3620000000000001,"15min":1.5720000000000001},"min":{"1min":0.79700000000000004,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6000000000000001,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":0.996}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.5489999999999999,"15min":1.919},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.4650000000000001,"5min":17.510000000000002,"15min":17.510000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.157,"5min":1.651,"15min":2.0910000000000002},"min":{"1min":0.77700000000000002,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.5700000000000001,"5min":19.591000000000001,"15min":19.591000000000001},"last":1.26}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.627,"15min":2.0230000000000001},"min":{"1min":0.85999999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.714,"5min":17.158000000000001,"15min":17.158000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.631,"15min":2.0190000000000001},"min":{"1min":0.96099999999999997,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.669,"5min":17.050000000000001,"15min":17.050000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.7549999999999999,"15min":2.1549999999999998},"min":{"1min":1.097,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":1.589,"5min":18.158000000000001,"15min":18.158000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.694,"15min":2.016},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.774,"5min":14.818,"15min":14.818},"last":0.89200000000000002}]}]},{"osd":3,"up_from":14,"seq":60129542205,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065608,"statfs":{"total":96636764160,"available":96323182592,"internally_reserved":0,"allocated":966656,"data_stored":431658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.80300000000000005,"15min":0.78800000000000003},"min":{"1min":0.58399999999999996,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.218,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.83299999999999996,"15min":0.85799999999999998},"min":{"1min":0.59999999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.81499999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.46800000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.163,"5min":1.357,"15min":1.357},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.91700000000000004,"15min":0.95599999999999996},"min":{"1min":0.504,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.288,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.353,"5min":1.756,"15min":1.756},"last":1.139},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.05,"15min":1.0640000000000001},"min":{"1min":0.72499999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.589,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.2589999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.206,"15min":1.236},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.736,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.22,"15min":1.248},"min":{"1min":0.73099999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.1459999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.222,"15min":1.268},"min":{"1min":0.76900000000000002,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.556,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.296},{"interface":"front","average":{"1min":1.256,"5min":1.2749999999999999,"15min":1.3100000000000001},"min":{"1min":0.96999999999999997,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6319999999999999,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.262,"15min":1.306},"min":{"1min":0.86599999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.518,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2,"15min":1.2410000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.627,"5min":3.585,"15min":3.585},"last":1.21}]},{"osd":7,"last update":"Thu Aug 17 00:06:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.23,"15min":1.288},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.24,"15min":1.2849999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":1.228}]}]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061532,"statfs":{"total":96636764160,"available":96319008768,"internally_reserved":0,"allocated":946176,"data_stored":430356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.79300000000000004,"15min":0.89800000000000002},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0669999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.91700000000000004,"15min":1.069},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.52,"5min":6.4859999999999998,"15min":6.4859999999999998},"last":0.93500000000000005}]},{"osd":1,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.86699999999999999,"15min":0.95399999999999996},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2929999999999999,"5min":3.7589999999999999,"15min":3.7589999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.042,"15min":1.135},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":3.911,"15min":3.911},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":1.1180000000000001,"15min":1.2809999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.712,"5min":5.4059999999999997,"15min":5.4059999999999997},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.97499999999999998,"15min":1.0620000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.5369999999999999,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":1.488,"15min":1.96},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.4039999999999999,"5min":16.521000000000001,"15min":16.521000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.4319999999999999,"15min":1.6930000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8420000000000001,"5min":8.4399999999999995,"15min":8.4399999999999995},"last":1.169}]},{"osd":5,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.5449999999999999,"15min":1.843},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.909,"5min":12.914,"15min":12.914},"last":1.212},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.383,"15min":1.609},"min":{"1min":0.76700000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.635,"5min":9.5519999999999996,"15min":9.5519999999999996},"last":0.97499999999999998}]},{"osd":6,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.472,"15min":1.804},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.873,"5min":13.864000000000001,"15min":13.864000000000001},"last":1.363},{"interface":"front","average":{"1min":1.3,"5min":1.542,"15min":1.8520000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.9830000000000001,"5min":12.698,"15min":12.698},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.5149999999999999,"15min":1.7789999999999999},"min":{"1min":0.74199999999999999,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.2909999999999999,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.51,"15min":1.7869999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.7450000000000001,"5min":11.417,"15min":11.417},"last":1.4159999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542205,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":970752,"data_stored":437738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.85699999999999998,"15min":0.82299999999999995},"min":{"1min":0.47099999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.4810000000000001,"5min":6.4329999999999998,"15min":6.4329999999999998},"last":1.042},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.97799999999999998,"15min":0.92300000000000004},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.6379999999999999,"5min":13.093,"15min":13.093},"last":1.2350000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.53500000000000003,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.452,"5min":5.4989999999999997,"15min":5.4989999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.93500000000000005,"15min":0.91600000000000004},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3779999999999999,"5min":7.0620000000000003,"15min":7.0620000000000003},"last":1.147}]},{"osd":3,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.0629999999999999,"15min":1.05},"min":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.2909999999999999,"5min":8.8279999999999994,"15min":8.8279999999999994},"last":1.5920000000000001},{"interface":"front","average":{"1min":0.91000000000000003,"5min":1.0329999999999999,"15min":1.022},"min":{"1min":0.56799999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.327,"5min":12.981999999999999,"15min":12.981999999999999},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.2849999999999999,"15min":1.196},"min":{"1min":0.75900000000000001,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.363,"5min":20.548999999999999,"15min":20.548999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.27,"15min":1.2569999999999999},"min":{"1min":0.90900000000000003,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.49,"5min":8.8670000000000009,"15min":8.8670000000000009},"last":1.327}]},{"osd":5,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.401,"15min":1.391},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.8540000000000001,"5min":13.170999999999999,"15min":13.170999999999999},"last":1.536},{"interface":"front","average":{"1min":1.238,"5min":1.2789999999999999,"15min":1.302},"min":{"1min":0.86299999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.6850000000000001,"5min":5.4240000000000004,"15min":5.4240000000000004},"last":1.9990000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.3240000000000001,"15min":1.2969999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.722,"5min":13.050000000000001,"15min":13.050000000000001},"last":1.379},{"interface":"front","average":{"1min":1.194,"5min":1.2330000000000001,"15min":1.2330000000000001},"min":{"1min":0.79800000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.54,"5min":5.5359999999999996,"15min":5.5359999999999996},"last":1.7829999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:50 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.347,"15min":1.3580000000000001},"min":{"1min":0.96199999999999997,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.615,"5min":6.9779999999999998,"15min":6.9779999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.397,"15min":1.407},"min":{"1min":0.877,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.77,"5min":13.131,"15min":13.131},"last":1.6200000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542206,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306228,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":305280,"kb_avail":94065612,"statfs":{"total":96636764160,"available":96323186688,"internally_reserved":0,"allocated":962560,"data_stored":437082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312606720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.75700000000000001,"15min":0.79100000000000004},"min":{"1min":0.36199999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.80100000000000005},"min":{"1min":0.45200000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3759999999999999,"5min":1.423,"15min":1.423},"last":0.65600000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.53400000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":0.90100000000000002,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.49399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":2.133,"5min":2.133,"15min":2.133},"last":0.81299999999999994}]},{"osd":3,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.83199999999999996,"15min":0.86799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.131,"5min":1.349,"15min":1.349},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98999999999999999,"15min":1.0429999999999999},"min":{"1min":0.54500000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.72,"5min":1.72,"15min":1.72},"last":0.998}]},{"osd":4,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0840000000000001,"15min":1.1279999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1910000000000001,"15min":1.2110000000000001},"min":{"1min":0.71799999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.4610000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.2050000000000001,"15min":1.2889999999999999},"min":{"1min":0.79000000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.4970000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.49},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.232,"15min":1.3109999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6180000000000001,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.639}]},{"osd":6,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.2549999999999999,"15min":1.3129999999999999},"min":{"1min":0.80300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.2070000000000001,"15min":1.2809999999999999},"min":{"1min":0.83599999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.444,"5min":1.72,"15min":1.72},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:06:48 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.2190000000000001,"15min":1.2869999999999999},"min":{"1min":0.71399999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4550000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.149,"5min":1.206,"15min":1.28},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.677,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.232}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310316,"kb_used_data":932,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061524,"statfs":{"total":96636764160,"available":96319000576,"internally_reserved":0,"allocated":954368,"data_stored":431270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.0389999999999999,"15min":1.0960000000000001},"min":{"1min":0.82199999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.113,"5min":1.014,"15min":1.0720000000000001},"min":{"1min":0.71799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.532,"5min":1.2270000000000001,"15min":1.22},"min":{"1min":0.81200000000000006,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":8.3800000000000008,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1990000000000001,"15min":1.266},"min":{"1min":0.56799999999999995,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.6140000000000001,"5min":3.0110000000000001,"15min":3.0110000000000001},"last":1.091}]},{"osd":2,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.2470000000000001,"15min":1.2050000000000001},"min":{"1min":0.77900000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":15.48,"5min":15.48,"15min":15.48},"last":0.84699999999999998},{"interface":"front","average":{"1min":2.21,"5min":1.325,"15min":1.2589999999999999},"min":{"1min":0.76000000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":24.768000000000001,"5min":24.768000000000001,"15min":24.768000000000001},"last":0.997}]},{"osd":3,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0940000000000001,"15min":1.1619999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.0529999999999999},{"interface":"front","average":{"1min":2.8559999999999999,"5min":1.5289999999999999,"15min":1.377},"min":{"1min":0.90900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":36.530000000000001,"5min":36.530000000000001,"15min":36.530000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2110000000000001,"15min":1.236},"min":{"1min":0.86499999999999999,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.24,"15min":1.2929999999999999},"min":{"1min":0.874,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":1.123}]},{"osd":6,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.3540000000000001,"15min":1.3899999999999999},"min":{"1min":0.88,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4190000000000005,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.365,"15min":1.4610000000000001},"min":{"1min":0.90100000000000002,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"last":1.248}]},{"osd":7,"last update":"Thu Aug 17 00:06:49 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2709999999999999,"15min":1.343},"min":{"1min":0.98099999999999998,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8620000000000001,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.417,"15min":1.4630000000000001},"min":{"1min":0.84099999999999997,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":8.327,"5min":8.327,"15min":8.327},"last":1.1539999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:07:41.809 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:07:41.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:07:42.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.015+0000 7f4be59db700 1 Processor -- start 2023-08-17T00:07:42.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.015+0000 7f4be59db700 1 -- start start 2023-08-17T00:07:42.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4be59db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4be0153aa0 0x7f4be00c5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4be59db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be00aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4be59db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be00c11d0 con 0x7f4be00c5c60 2023-08-17T00:07:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4be59db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be00c1660 con 0x7f4be0153aa0 2023-08-17T00:07:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4be59db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00c60e0 con 0x7f4be00626b0 2023-08-17T00:07:42.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bde7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4be00c5c60 0x7f4be0061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41500/0 (socket says 172.21.15.153:41500) 2023-08-17T00:07:42.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bde7fc700 1 -- 172.21.15.153:0/2533823064 learned_addr learned my addr 172.21.15.153:0/2533823064 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:42.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/2533823064 >> v2:172.21.15.178:3300/0 conn(0x7f4be0153aa0 0x7f4be00c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdf7fe700 1 --2- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be00aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bddffb700 1 -- 172.21.15.153:0/2533823064 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859351969 0 0) 0x7f4be00c11d0 con 0x7f4be00c5c60 2023-08-17T00:07:42.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bddffb700 1 -- 172.21.15.153:0/2533823064 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bc80033f0 con 0x7f4be00c5c60 2023-08-17T00:07:42.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdeffd700 1 -- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 msgr2=0x7f4be00aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:42.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be00aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdeffd700 1 -- 172.21.15.153:0/2533823064 >> v1:172.21.15.153:6789/0 conn(0x7f4be00c5c60 legacy=0x7f4be0061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdeffd700 1 -- 172.21.15.153:0/2533823064 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be00c08a0 con 0x7f4be0153aa0 2023-08-17T00:07:42.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.019+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be0153aa0 0x7f4be00c5770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f4bd0009760 tx=0x7f4bd0009060).ready entity=mon.1 client_cookie=4336af486984e23 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4bddffb700 1 -- 172.21.15.153:0/2533823064 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000d4a0 con 0x7f4be0153aa0 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4bddffb700 1 -- 172.21.15.153:0/2533823064 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd000d600 con 0x7f4be0153aa0 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4bddffb700 1 -- 172.21.15.153:0/2533823064 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd000d980 con 0x7f4be0153aa0 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 -- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be0153aa0 msgr2=0x7f4be00c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 --2- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be0153aa0 0x7f4be00c5770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f4bd0009760 tx=0x7f4bd0009060).stop 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 -- 172.21.15.153:0/2533823064 shutdown_connections 2023-08-17T00:07:42.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 --2- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be00aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 --2- 172.21.15.153:0/2533823064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be0153aa0 0x7f4be00c5770 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 -- 172.21.15.153:0/2533823064 >> 172.21.15.153:0/2533823064 conn(0x7f4be00640b0 msgr2=0x7f4be00ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:42.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 -- 172.21.15.153:0/2533823064 shutdown_connections 2023-08-17T00:07:42.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.023+0000 7f4be59db700 1 -- 172.21.15.153:0/2533823064 wait complete. 2023-08-17T00:07:42.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 Processor -- start 2023-08-17T00:07:42.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 -- start start 2023-08-17T00:07:42.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be01503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be00c5c60 0x7f4be00ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 0x7f4be00acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be0150890 con 0x7f4be0153aa0 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be00ad160 con 0x7f4be00c5c60 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be01638b0 con 0x7f4be00626b0 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 0x7f4be00acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 0x7f4be00acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60556/0 (socket says 172.21.15.153:60556) 2023-08-17T00:07:42.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 -- 172.21.15.153:0/697602475 learned_addr learned my addr 172.21.15.153:0/697602475 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:42.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be01503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bde7fc700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be00c5c60 0x7f4be00ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 -- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 msgr2=0x7f4be01503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be01503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 -- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be00c5c60 msgr2=0x7f4be00ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be00c5c60 0x7f4be00ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 -- 172.21.15.153:0/697602475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00092a0 con 0x7f4be0153aa0 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bde7fc700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be00c5c60 0x7f4be00ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be01503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bdf7fe700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 0x7f4be00acc70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f4bd8009ef0 tx=0x7f4bd800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd800cc50 con 0x7f4be0153aa0 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd800f040 con 0x7f4be0153aa0 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.027+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be0163ac0 con 0x7f4be0153aa0 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.031+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8013400 con 0x7f4be0153aa0 2023-08-17T00:07:42.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.031+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be0164040 con 0x7f4be0153aa0 2023-08-17T00:07:42.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.031+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be0164800 con 0x7f4be0153aa0 2023-08-17T00:07:42.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.031+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4bd8013770 con 0x7f4be0153aa0 2023-08-17T00:07:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.031+0000 7f4bc6ffd700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4bcc05a180 0x7f4bcc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.031+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4bd8074ca0 con 0x7f4be0153aa0 2023-08-17T00:07:42.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.035+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4bcc05a180 0x7f4bcc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.035+0000 7f4bdeffd700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4bcc05a180 0x7f4bcc05c640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f4be0152620 tx=0x7f4bd0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:42.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.039+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4bd8048640 con 0x7f4be0153aa0 2023-08-17T00:07:42.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.255+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4be006b4c0 con 0x7f4be0153aa0 2023-08-17T00:07:42.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.263+0000 7f4bc6ffd700 1 -- 172.21.15.153:0/697602475 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4bd804bc60 con 0x7f4be0153aa0 2023-08-17T00:07:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4bcc05a180 msgr2=0x7f4bcc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4bcc05a180 0x7f4bcc05c640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f4be0152620 tx=0x7f4bd0016000).stop 2023-08-17T00:07:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 msgr2=0x7f4be00acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 0x7f4be00acc70 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 rx=0x7f4bd8009ef0 tx=0x7f4bd800b040).stop 2023-08-17T00:07:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 shutdown_connections 2023-08-17T00:07:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4bcc05a180 0x7f4bcc05c640 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4be0153aa0 0x7f4be00acc70 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4be00c5c60 0x7f4be00ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 --2- 172.21.15.153:0/697602475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4be00626b0 0x7f4be01503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 >> 172.21.15.153:0/697602475 conn(0x7f4be00640b0 msgr2=0x7f4be00a9dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 shutdown_connections 2023-08-17T00:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.267+0000 7f4be59db700 1 -- 172.21.15.153:0/697602475 wait complete. 2023-08-17T00:07:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:07:42.296 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:07:42.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.451+0000 7fba00b47700 1 Processor -- start 2023-08-17T00:07:42.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.451+0000 7fba00b47700 1 -- start start 2023-08-17T00:07:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fba00b47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9fc0689c0 0x7fb9fc068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fba00b47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb9fc1560f0 0x7fb9fc0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fba00b47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc065da0 con 0x7fb9fc151530 2023-08-17T00:07:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fba00b47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc155c60 con 0x7fb9fc1560f0 2023-08-17T00:07:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fba00b47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc156550 con 0x7fb9fc0689c0 2023-08-17T00:07:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9fbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb9fc151530 0x7fb9fc1519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41512/0 (socket says 172.21.15.153:41512) 2023-08-17T00:07:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9fbfff700 1 -- 172.21.15.153:0/3235207103 learned_addr learned my addr 172.21.15.153:0/3235207103 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9fb7fe700 1 --2- 172.21.15.153:0/3235207103 >> v2:172.21.15.178:3300/0 conn(0x7fb9fc0689c0 0x7fb9fc068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9f3fff700 1 --2- 172.21.15.153:0/3235207103 >> v2:172.21.15.153:3300/0 conn(0x7fb9fc1560f0 0x7fb9fc0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9faffd700 1 -- 172.21.15.153:0/3235207103 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574896506 0 0) 0x7fb9fc065da0 con 0x7fb9fc151530 2023-08-17T00:07:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9faffd700 1 -- 172.21.15.153:0/3235207103 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e80033f0 con 0x7fb9fc151530 2023-08-17T00:07:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9f3fff700 1 -- 172.21.15.153:0/3235207103 >> v2:172.21.15.178:3300/0 conn(0x7fb9fc0689c0 msgr2=0x7fb9fc068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9f3fff700 1 --2- 172.21.15.153:0/3235207103 >> v2:172.21.15.178:3300/0 conn(0x7fb9fc0689c0 0x7fb9fc068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9f3fff700 1 -- 172.21.15.153:0/3235207103 >> v1:172.21.15.153:6789/0 conn(0x7fb9fc151530 legacy=0x7fb9fc1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9f3fff700 1 -- 172.21.15.153:0/3235207103 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc065ff0 con 0x7fb9fc1560f0 2023-08-17T00:07:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9f3fff700 1 --2- 172.21.15.153:0/3235207103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc1560f0 0x7fb9fc0c0270 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb9fc0c2d60 tx=0x7fb9e4009060).ready entity=mon.0 client_cookie=4dcc70c41ace3b0e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9faffd700 1 -- 172.21.15.153:0/3235207103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e40090d0 con 0x7fb9fc1560f0 2023-08-17T00:07:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.455+0000 7fb9faffd700 1 -- 172.21.15.153:0/3235207103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e400d4a0 con 0x7fb9fc1560f0 2023-08-17T00:07:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fb9faffd700 1 -- 172.21.15.153:0/3235207103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400d820 con 0x7fb9fc1560f0 2023-08-17T00:07:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 -- 172.21.15.153:0/3235207103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc1560f0 msgr2=0x7fb9fc0c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 --2- 172.21.15.153:0/3235207103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc1560f0 0x7fb9fc0c0270 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 rx=0x7fb9fc0c2d60 tx=0x7fb9e4009060).stop 2023-08-17T00:07:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 -- 172.21.15.153:0/3235207103 shutdown_connections 2023-08-17T00:07:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 --2- 172.21.15.153:0/3235207103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc1560f0 0x7fb9fc0c0270 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 --2- 172.21.15.153:0/3235207103 >> v2:172.21.15.178:3300/0 conn(0x7fb9fc0689c0 0x7fb9fc068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 -- 172.21.15.153:0/3235207103 >> 172.21.15.153:0/3235207103 conn(0x7fb9fc0c6620 msgr2=0x7fb9fc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 -- 172.21.15.153:0/3235207103 shutdown_connections 2023-08-17T00:07:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.459+0000 7fba00b47700 1 -- 172.21.15.153:0/3235207103 wait complete. 2023-08-17T00:07:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 Processor -- start 2023-08-17T00:07:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 -- start start 2023-08-17T00:07:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 0x7fb9fc150570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9fc151530 0x7fb9fc0bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9fc1560f0 0x7fb9fc0bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0bcac0 con 0x7fb9fc0689c0 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0c0a80 con 0x7fb9fc151530 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc1527a0 con 0x7fb9fc1560f0 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 0x7fb9fc150570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 0x7fb9fc150570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60584/0 (socket says 172.21.15.153:60584) 2023-08-17T00:07:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 -- 172.21.15.153:0/2238608083 learned_addr learned my addr 172.21.15.153:0/2238608083 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9f3fff700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9fc151530 0x7fb9fc0bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fbfff700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9fc1560f0 0x7fb9fc0bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 -- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9fc1560f0 msgr2=0x7fb9fc0bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9fc1560f0 0x7fb9fc0bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 -- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9fc151530 msgr2=0x7fb9fc0bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9fc151530 0x7fb9fc0bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 -- 172.21.15.153:0/2238608083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40092a0 con 0x7fb9fc0689c0 2023-08-17T00:07:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fbfff700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9fc1560f0 0x7fb9fc0bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9fb7fe700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 0x7fb9fc150570 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fb9ec00e8d0 tx=0x7fb9ec006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec009450 con 0x7fb9fc0689c0 2023-08-17T00:07:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec012600 con 0x7fb9fc0689c0 2023-08-17T00:07:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec012980 con 0x7fb9fc0689c0 2023-08-17T00:07:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.463+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc152a80 con 0x7fb9fc0689c0 2023-08-17T00:07:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.467+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0c0cd0 con 0x7fb9fc0689c0 2023-08-17T00:07:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.467+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc06b4c0 con 0x7fb9fc0689c0 2023-08-17T00:07:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.467+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb9ec022070 con 0x7fb9fc0689c0 2023-08-17T00:07:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.467+0000 7fb9f37fe700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb9dc05a150 0x7fb9dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.467+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb9ec0743d0 con 0x7fb9fc0689c0 2023-08-17T00:07:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.471+0000 7fb9f3fff700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb9dc05a150 0x7fb9dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.471+0000 7fb9f3fff700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb9dc05a150 0x7fb9dc05c610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fb9e4009fd0 tx=0x7fb9e4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.475+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9ec047e80 con 0x7fb9fc0689c0 2023-08-17T00:07:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.671+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9fc0662d0 con 0x7fb9fc0689c0 2023-08-17T00:07:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.671+0000 7fb9f37fe700 1 -- 172.21.15.153:0/2238608083 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4500 (secure 0 0 0) 0x7fb9ec016020 con 0x7fb9fc0689c0 2023-08-17T00:07:42.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:07:42.927 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":62,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:07:37.048946+0000","modified":"2023-08-17T00:07:40.179113+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/2081650727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2081650727},{"type":"v1","addr":"172.21.15.153:6835","nonce":2081650727}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T00:07:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb9dc05a150 msgr2=0x7fb9dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb9dc05a150 0x7fb9dc05c610 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7fb9e4009fd0 tx=0x7fb9e4016000).stop 2023-08-17T00:07:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 msgr2=0x7fb9fc150570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 0x7fb9fc150570 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fb9ec00e8d0 tx=0x7fb9ec006f40).stop 2023-08-17T00:07:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 shutdown_connections 2023-08-17T00:07:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb9dc05a150 0x7fb9dc05c610 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9fc1560f0 0x7fb9fc0bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9fc151530 0x7fb9fc0bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 --2- 172.21.15.153:0/2238608083 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9fc0689c0 0x7fb9fc150570 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 >> 172.21.15.153:0/2238608083 conn(0x7fb9fc0c6620 msgr2=0x7fb9fc0c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:42.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 shutdown_connections 2023-08-17T00:07:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:42.675+0000 7fba00b47700 1 -- 172.21.15.153:0/2238608083 wait complete. 2023-08-17T00:07:42.933 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 62 2023-08-17T00:07:43.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:07:37.048946+0000', 'modified': '2023-08-17T00:07:40.179113+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6681}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6681': {'gid': 6681, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/2081650727', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 2081650727}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 2081650727}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:07:43.338 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:07:43.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:07:43.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bbaedb700 1 Processor -- start 2023-08-17T00:07:43.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bbaedb700 1 -- start start 2023-08-17T00:07:43.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bbaedb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bbaedb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb4061fa0 con 0x7f6bb4151b90 2023-08-17T00:07:43.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bbaedb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb41523d0 con 0x7f6bb4065b50 2023-08-17T00:07:43.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bbaedb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40c3fb0 con 0x7f6bb4151f70 2023-08-17T00:07:43.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bb8c77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6bb4151b90 0x7f6bb4063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41522/0 (socket says 172.21.15.153:41522) 2023-08-17T00:07:43.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bb8c77700 1 -- 172.21.15.153:0/3404702828 learned_addr learned my addr 172.21.15.153:0/3404702828 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:43.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/3404702828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.499+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551244317 0 0) 0x7f6bb4061fa0 con 0x7f6bb4151b90 2023-08-17T00:07:43.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba40033f0 con 0x7f6bb4151b90 2023-08-17T00:07:43.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501772460 0 0) 0x7f6bb41523d0 con 0x7f6bb4065b50 2023-08-17T00:07:43.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb4061fa0 con 0x7f6bb4065b50 2023-08-17T00:07:43.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb3fff700 1 -- 172.21.15.153:0/3404702828 >> v1:172.21.15.178:6789/0 conn(0x7f6bb4065b50 legacy=0x7f6bb4064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb3fff700 1 -- 172.21.15.153:0/3404702828 >> v1:172.21.15.153:6789/0 conn(0x7f6bb4151b90 legacy=0x7f6bb4063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb3fff700 1 -- 172.21.15.153:0/3404702828 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40621f0 con 0x7f6bb4151f70 2023-08-17T00:07:43.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/3404702828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4065660 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6ba0009790 tx=0x7f6ba0009060).ready entity=mon.2 client_cookie=67ad27bc9364a494 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00090d0 con 0x7f6bb4151f70 2023-08-17T00:07:43.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000f510 con 0x7f6bb4151f70 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bb37fe700 1 -- 172.21.15.153:0/3404702828 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000f890 con 0x7f6bb4151f70 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 -- 172.21.15.153:0/3404702828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 msgr2=0x7f6bb4065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/3404702828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4065660 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f6ba0009790 tx=0x7f6ba0009060).stop 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 -- 172.21.15.153:0/3404702828 shutdown_connections 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/3404702828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4065660 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 -- 172.21.15.153:0/3404702828 >> 172.21.15.153:0/3404702828 conn(0x7f6bb40c7150 msgr2=0x7f6bb40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 -- 172.21.15.153:0/3404702828 shutdown_connections 2023-08-17T00:07:43.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.503+0000 7f6bbaedb700 1 -- 172.21.15.153:0/3404702828 wait complete. 2023-08-17T00:07:43.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 Processor -- start 2023-08-17T00:07:43.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 -- start start 2023-08-17T00:07:43.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 0x7f6bb4165810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bb4151b90 0x7f6bb414cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40be7a0 con 0x7f6bb4065b50 2023-08-17T00:07:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4166060 con 0x7f6bb4151b90 2023-08-17T00:07:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bbaedb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb4166340 con 0x7f6bb4151f70 2023-08-17T00:07:43.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 0x7f6bb4165810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 0x7f6bb4165810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60590/0 (socket says 172.21.15.153:60590) 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 -- 172.21.15.153:0/658975779 learned_addr learned my addr 172.21.15.153:0/658975779 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bb4151b90 0x7f6bb414cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb9478700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 -- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 msgr2=0x7f6bb4155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 -- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bb4151b90 msgr2=0x7f6bb414cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bb4151b90 0x7f6bb414cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 -- 172.21.15.153:0/658975779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba00092a0 con 0x7f6bb4065b50 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.507+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 0x7f6bb4165810 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f6ba800c560 tx=0x7f6ba8007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.511+0000 7f6bb0ff9700 1 -- 172.21.15.153:0/658975779 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80072e0 con 0x7f6bb4065b50 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.511+0000 7f6bb0ff9700 1 -- 172.21.15.153:0/658975779 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8007440 con 0x7f6bb4065b50 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.511+0000 7f6bb0ff9700 1 -- 172.21.15.153:0/658975779 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80057a0 con 0x7f6bb4065b50 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.511+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb4166620 con 0x7f6bb4065b50 2023-08-17T00:07:43.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.511+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4165d00 con 0x7f6bb4065b50 2023-08-17T00:07:43.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb0ff9700 1 -- 172.21.15.153:0/658975779 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6ba8010070 con 0x7f6bb4065b50 2023-08-17T00:07:43.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 Processor -- start 2023-08-17T00:07:43.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 -- start start 2023-08-17T00:07:43.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb0ff9700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b9805a150 0x7f6b9805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb0ff9700 1 -- 172.21.15.153:0/658975779 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ba8073740 con 0x7f6bb4065b50 2023-08-17T00:07:43.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb9478700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b9805a150 0x7f6b9805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2685df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x26880e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x26417d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25af5c0 con 0x2685a10 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25c4e90 con 0x26447b0 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x258b220 con 0x2641350 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb9478700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b9805a150 0x7f6b9805c610 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f6bac0012e0 tx=0x7f6bac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2685df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2685df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60592/0 (socket says 172.21.15.153:60592) 2023-08-17T00:07:43.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 -- 172.21.15.153:0/351415407 learned_addr learned my addr 172.21.15.153:0/351415407 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:43.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb9478700 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x26417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x26880e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 -- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 msgr2=0x26417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x26417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 -- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 msgr2=0x26880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x26880e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.515+0000 7f6bb8c77700 1 -- 172.21.15.153:0/351415407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25d0500 con 0x2685a10 2023-08-17T00:07:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2685df0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f6ba804ac80 tx=0x7f6ba800f000).ready entity=mon.0 client_cookie=6b47c6b33d6ebf07 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6b9dffb700 1 -- 172.21.15.153:0/351415407 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba804ad40 con 0x2685a10 2023-08-17T00:07:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6b9dffb700 1 -- 172.21.15.153:0/351415407 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8049140 con 0x2685a10 2023-08-17T00:07:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6b9dffb700 1 -- 172.21.15.153:0/351415407 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba804a290 con 0x2685a10 2023-08-17T00:07:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 -- 172.21.15.153:0/351415407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 msgr2=0x2685df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2685df0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f6ba804ac80 tx=0x7f6ba800f000).stop 2023-08-17T00:07:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 -- 172.21.15.153:0/351415407 shutdown_connections 2023-08-17T00:07:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x26417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x26880e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 --2- 172.21.15.153:0/351415407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2685df0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 -- 172.21.15.153:0/351415407 >> 172.21.15.153:0/351415407 conn(0x2423550 msgr2=0x2644e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 -- 172.21.15.153:0/351415407 shutdown_connections 2023-08-17T00:07:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 -- 172.21.15.153:0/351415407 wait complete. 2023-08-17T00:07:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 -- start start 2023-08-17T00:07:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.519+0000 7f6bc5252740 1 Processor -- start 2023-08-17T00:07:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 0x269e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x269eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2685a10 0x26701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2590110 con 0x2641350 2023-08-17T00:07:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x269f000 con 0x2685a10 2023-08-17T00:07:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2698f40 con 0x26447b0 2023-08-17T00:07:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 10 client.0 ll_register_callbacks cb 0x25fc3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 0x269e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 0x269e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60598/0 (socket says 172.21.15.153:60598) 2023-08-17T00:07:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 -- 172.21.15.153:0/2308391195 learned_addr learned my addr 172.21.15.153:0/2308391195 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb9478700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2685a10 0x26701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x269eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 -- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 msgr2=0x269eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x269eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 -- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2685a10 msgr2=0x26701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2685a10 0x26701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 -- 172.21.15.153:0/2308391195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb4165d00 con 0x2641350 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x269eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 0x269e620 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f6ba8007fd0 tx=0x7f6ba8051000).ready entity=mon.0 client_cookie=9083efed49ebbfb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2308391195 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba804a290 con 0x2641350 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2308391195 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6ba804ad40 con 0x2641350 2023-08-17T00:07:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x25bac60 con 0x2641350 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2308391195 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ba8049d00 con 0x2641350 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 10 client.6816 fetch_fsmap learned FSMap version 62 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x25bdf80 con 0x2641350 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2308391195 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x25bac60 con 0x2641350 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2308391195 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6ba8063070 con 0x2641350 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 10 client.6816 fetch_fsmap finished waiting for FSMap version 62 2023-08-17T00:07:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 10 client.6816 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:07:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 20 client.6816 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x269e0f0 0x269b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 4 client.6816 mds_command: new command op to 6681 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:07:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25b11b0 con 0x269e0f0 2023-08-17T00:07:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x269e0f0 0x269b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6b92ffd700 10 client.6816 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:07:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.523+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x269e0f0 0x269b260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3f9597f96e035f24 server_cookie=91993bdb7fef00d7 in_seq=0 out_seq=0 2023-08-17T00:07:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2308391195 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25b11b0 con 0x269e0f0 2023-08-17T00:07:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6b92ffd700 10 client.6816 handle_command_reply: tid=0 2023-08-17T00:07:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 client.6816 shutdown 2023-08-17T00:07:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 msgr2=0x269e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 0x269e620 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f6ba8007fd0 tx=0x7f6ba8051000).stop 2023-08-17T00:07:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 shutdown_connections 2023-08-17T00:07:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x269e0f0 0x269b260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2685a10 0x26701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x269eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6b92ffd700 0 client.6816 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:07:43.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2308391195 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2641350 0x269e620 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 >> 172.21.15.153:0/2308391195 conn(0x2423550 msgr2=0x2669520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 shutdown_connections 2023-08-17T00:07:43.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 1 -- 172.21.15.153:0/2308391195 wait complete. 2023-08-17T00:07:43.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.527+0000 7f6bc5252740 20 client.6816 trim_cache size 0 max 16384 2023-08-17T00:07:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 Processor -- start 2023-08-17T00:07:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 -- start start 2023-08-17T00:07:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2641350 0x2699910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x2685000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2607db0 con 0x2685a10 2023-08-17T00:07:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x269dbf0 con 0x2641350 2023-08-17T00:07:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x258e9c0 con 0x26447b0 2023-08-17T00:07:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb9478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb9478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60606/0 (socket says 172.21.15.153:60606) 2023-08-17T00:07:43.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb9478700 1 -- 172.21.15.153:0/775060176 learned_addr learned my addr 172.21.15.153:0/775060176 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:43.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2641350 0x2699910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x2685000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb9478700 1 -- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 msgr2=0x2685000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.547+0000 7f6bb9478700 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x2685000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bb9478700 1 -- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2641350 msgr2=0x2699910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bb9478700 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2641350 0x2699910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bb9478700 1 -- 172.21.15.153:0/775060176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4156060 con 0x2685a10 2023-08-17T00:07:43.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bb9478700 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687770 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f6bac00e440 tx=0x7f6bac019040).ready entity=mon.0 client_cookie=d71f35c2278b7ee0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6b9e7fc700 1 -- 172.21.15.153:0/775060176 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac01c070 con 0x2685a10 2023-08-17T00:07:43.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6b9e7fc700 1 -- 172.21.15.153:0/775060176 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac01d040 con 0x2685a10 2023-08-17T00:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6b9e7fc700 1 -- 172.21.15.153:0/775060176 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac006e40 con 0x2685a10 2023-08-17T00:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 -- 172.21.15.153:0/775060176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 msgr2=0x2687770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687770 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f6bac00e440 tx=0x7f6bac019040).stop 2023-08-17T00:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 -- 172.21.15.153:0/775060176 shutdown_connections 2023-08-17T00:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687770 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26447b0 0x2685000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 --2- 172.21.15.153:0/775060176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2641350 0x2699910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 -- 172.21.15.153:0/775060176 >> 172.21.15.153:0/775060176 conn(0x2423550 msgr2=0x269e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 -- 172.21.15.153:0/775060176 shutdown_connections 2023-08-17T00:07:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 -- 172.21.15.153:0/775060176 wait complete. 2023-08-17T00:07:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 -- start start 2023-08-17T00:07:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.551+0000 7f6bc5252740 1 Processor -- start 2023-08-17T00:07:43.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x266a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x2687770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2684300 con 0x2685a10 2023-08-17T00:07:43.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2688150 con 0x26447b0 2023-08-17T00:07:43.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26426c0 con 0x2641350 2023-08-17T00:07:43.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 10 client.0 ll_register_callbacks cb 0x7f6ba80470e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:07:43.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60610/0 (socket says 172.21.15.153:60610) 2023-08-17T00:07:43.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 -- 172.21.15.153:0/2712148207 learned_addr learned my addr 172.21.15.153:0/2712148207 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:43.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x266a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb3fff700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x2687770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 -- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 msgr2=0x266a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x266a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 -- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 msgr2=0x2687770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:43.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x2687770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 -- 172.21.15.153:0/2712148207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac00f040 con 0x2685a10 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb9478700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687c60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x2640ee0 tx=0x7f6bac012000).ready entity=mon.0 client_cookie=27f53fc68c87af2a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6b92ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2712148207 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac001930 con 0x2685a10 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2712148207 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bac001a90 con 0x2685a10 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ba8049140 con 0x2685a10 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2712148207 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bac001e60 con 0x2685a10 2023-08-17T00:07:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 10 client.6822 fetch_fsmap learned FSMap version 62 2023-08-17T00:07:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x25b9420 con 0x2685a10 2023-08-17T00:07:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2712148207 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba8049140 con 0x2685a10 2023-08-17T00:07:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2712148207 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 62) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6bac007030 con 0x2685a10 2023-08-17T00:07:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 10 client.6822 fetch_fsmap finished waiting for FSMap version 62 2023-08-17T00:07:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 10 client.6822 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:07:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 20 client.6822 populate_metadata read hostname 'smithi153' 2023-08-17T00:07:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2641730 0x2641b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 4 client.6822 mds_command: new command op to 6681 tid=0[{"prefix": "status"}] 2023-08-17T00:07:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "status"}) v1 -- 0x247a4e0 con 0x2641730 2023-08-17T00:07:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.555+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2641730 0x2641b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bb8c77700 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2641730 0x2641b10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=caa22bc40f4952ff server_cookie=798a6e9bf89f9202 in_seq=0 out_seq=0 2023-08-17T00:07:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6b92ffd700 10 client.6822 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:07:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6b92ffd700 1 -- 172.21.15.153:0/2712148207 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x247a4e0 con 0x2641730 2023-08-17T00:07:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6b92ffd700 10 client.6822 handle_command_reply: tid=0 2023-08-17T00:07:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 client.6822 shutdown 2023-08-17T00:07:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 msgr2=0x2687c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687c60 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x2640ee0 tx=0x7f6bac012000).stop 2023-08-17T00:07:43.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 shutdown_connections 2023-08-17T00:07:43.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2641730 0x2641b10 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2685a10 0x2687c60 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26447b0 0x2687770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 --2- 172.21.15.153:0/2712148207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2641350 0x266a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6b92ffd700 0 client.6822 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:07:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 >> 172.21.15.153:0/2712148207 conn(0x2423550 msgr2=0x269e760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 shutdown_connections 2023-08-17T00:07:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 1 -- 172.21.15.153:0/2712148207 wait complete. 2023-08-17T00:07:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bc5252740 20 client.6822 trim_cache size 0 max 16384 2023-08-17T00:07:43.576 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:07:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:07:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:07:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 6681, 2023-08-17T00:07:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:07:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:07:43.577 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:07:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.5091211009999999, 2023-08-17T00:07:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 62, 2023-08-17T00:07:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 79, 2023-08-17T00:07:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 79, 2023-08-17T00:07:43.578 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 12.024344463 2023-08-17T00:07:43.579 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:07:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b9805a150 msgr2=0x7f6b9805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b9805a150 0x7f6b9805c610 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f6bac0012e0 tx=0x7f6bac009040).stop 2023-08-17T00:07:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 msgr2=0x7f6bb4165810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 0x7f6bb4165810 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f6ba800c560 tx=0x7f6ba8007d20).stop 2023-08-17T00:07:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 shutdown_connections 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b9805a150 0x7f6b9805c610 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bb4151f70 0x7f6bb4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bb4151b90 0x7f6bb414cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 --2- 172.21.15.153:0/658975779 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6bb4065b50 0x7f6bb4165810 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 >> 172.21.15.153:0/658975779 conn(0x7f6bb40c7150 msgr2=0x7f6bb40c5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 shutdown_connections 2023-08-17T00:07:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.559+0000 7f6bbaedb700 1 -- 172.21.15.153:0/658975779 wait complete. 2023-08-17T00:07:43.586 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:07:43.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.715+0000 7f2aeca5b700 1 Processor -- start 2023-08-17T00:07:43.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.715+0000 7f2aeca5b700 1 -- start start 2023-08-17T00:07:43.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2aeca5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ae8147a40 0x7f2ae8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2aeca5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae8154650 con 0x7f2ae80bcf30 2023-08-17T00:07:43.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2aeca5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae8147e20 con 0x7f2ae8154ae0 2023-08-17T00:07:43.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2aeca5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae8151580 con 0x7f2ae8147a40 2023-08-17T00:07:43.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae5d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2ae80bcf30 0x7f2ae80c0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41538/0 (socket says 172.21.15.153:41538) 2023-08-17T00:07:43.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae5d9b700 1 -- 172.21.15.153:0/2323824207 learned_addr learned my addr 172.21.15.153:0/2323824207 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:07:43.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae659c700 1 --2- 172.21.15.153:0/2323824207 >> v2:172.21.15.178:3300/0 conn(0x7f2ae8147a40 0x7f2ae8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370668891 0 0) 0x7f2ae8154650 con 0x7f2ae80bcf30 2023-08-17T00:07:43.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad00033f0 con 0x7f2ae80bcf30 2023-08-17T00:07:43.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907006001 0 0) 0x7f2ae8147e20 con 0x7f2ae8154ae0 2023-08-17T00:07:43.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ae8154650 con 0x7f2ae8154ae0 2023-08-17T00:07:43.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.719+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643610168 0 0) 0x7f2ad00033f0 con 0x7f2ae80bcf30 2023-08-17T00:07:43.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae659c700 1 -- 172.21.15.153:0/2323824207 >> v1:172.21.15.178:6789/0 conn(0x7f2ae8154ae0 legacy=0x7f2ae80c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae659c700 1 -- 172.21.15.153:0/2323824207 >> v1:172.21.15.153:6789/0 conn(0x7f2ae80bcf30 legacy=0x7f2ae80c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae659c700 1 -- 172.21.15.153:0/2323824207 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae8151860 con 0x7f2ae8147a40 2023-08-17T00:07:43.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae659c700 1 --2- 172.21.15.153:0/2323824207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae8150f10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f2ad8009760 tx=0x7f2ad8009060).ready entity=mon.1 client_cookie=af2003a60121c0cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc001470 con 0x7f2ae8147a40 2023-08-17T00:07:43.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8011400 con 0x7f2ae8147a40 2023-08-17T00:07:43.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2ae559a700 1 -- 172.21.15.153:0/2323824207 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8011780 con 0x7f2ae8147a40 2023-08-17T00:07:43.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 -- 172.21.15.153:0/2323824207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 msgr2=0x7f2ae8150f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/2323824207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae8150f10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f2ad8009760 tx=0x7f2ad8009060).stop 2023-08-17T00:07:43.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 -- 172.21.15.153:0/2323824207 shutdown_connections 2023-08-17T00:07:43.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/2323824207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae8150f10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 -- 172.21.15.153:0/2323824207 >> 172.21.15.153:0/2323824207 conn(0x7f2ae805dca0 msgr2=0x7f2ae805e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 -- 172.21.15.153:0/2323824207 shutdown_connections 2023-08-17T00:07:43.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.723+0000 7f2aeca5b700 1 -- 172.21.15.153:0/2323824207 wait complete. 2023-08-17T00:07:43.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 Processor -- start 2023-08-17T00:07:43.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 -- start start 2023-08-17T00:07:43.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ae80bcf30 0x7f2ae80bf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae80bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 0x7f2ae80c0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8168690 con 0x7f2ae8154ae0 2023-08-17T00:07:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8167a80 con 0x7f2ae8147a40 2023-08-17T00:07:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae8167d60 con 0x7f2ae80bcf30 2023-08-17T00:07:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 0x7f2ae80c0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 0x7f2ae80c0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60622/0 (socket says 172.21.15.153:60622) 2023-08-17T00:07:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 -- 172.21.15.153:0/785152956 learned_addr learned my addr 172.21.15.153:0/785152956 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae659c700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ae80bcf30 0x7f2ae80bf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae5d9b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae80bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 -- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ae80bcf30 msgr2=0x7f2ae80bf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ae80bcf30 0x7f2ae80bf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 -- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 msgr2=0x7f2ae80bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae80bfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 -- 172.21.15.153:0/785152956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80092a0 con 0x7f2ae8154ae0 2023-08-17T00:07:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae5d9b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae80bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:07:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ae6d9d700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 0x7f2ae80c0190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f2ae000c710 tx=0x7f2ae000cad0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0010510 con 0x7f2ae8154ae0 2023-08-17T00:07:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0010670 con 0x7f2ae8154ae0 2023-08-17T00:07:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae8168040 con 0x7f2ae8154ae0 2023-08-17T00:07:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00109f0 con 0x7f2ae8154ae0 2023-08-17T00:07:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.727+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae8165370 con 0x7f2ae8154ae0 2023-08-17T00:07:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.731+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae8168840 con 0x7f2ae8154ae0 2023-08-17T00:07:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.731+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2ae0010070 con 0x7f2ae8154ae0 2023-08-17T00:07:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.731+0000 7f2ad67fc700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ac805a180 0x7f2ac805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.731+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2ae0073e00 con 0x7f2ae8154ae0 2023-08-17T00:07:43.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.735+0000 7f2ae659c700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ac805a180 0x7f2ac805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:43.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.735+0000 7f2ae659c700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ac805a180 0x7f2ac805c640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2ad8009630 tx=0x7f2ad8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:43.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.739+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ae8168840 con 0x7f2ae8154ae0 2023-08-17T00:07:43.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.931+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2ae81687d0 con 0x7f2ae8154ae0 2023-08-17T00:07:43.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.931+0000 7f2ad67fc700 1 -- 172.21.15.153:0/785152956 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ae0047850 con 0x7f2ae8154ae0 2023-08-17T00:07:43.939 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:07:43.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.935+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ac805a180 msgr2=0x7f2ac805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.935+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ac805a180 0x7f2ac805c640 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f2ad8009630 tx=0x7f2ad8016000).stop 2023-08-17T00:07:43.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.935+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 msgr2=0x7f2ae80c0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:43.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.935+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 0x7f2ae80c0190 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f2ae000c710 tx=0x7f2ae000cad0).stop 2023-08-17T00:07:43.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 shutdown_connections 2023-08-17T00:07:43.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ac805a180 0x7f2ac805c640 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ae8154ae0 0x7f2ae80c0190 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ae8147a40 0x7f2ae80bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 --2- 172.21.15.153:0/785152956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ae80bcf30 0x7f2ae80bf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:43.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 >> 172.21.15.153:0/785152956 conn(0x7f2ae805dca0 msgr2=0x7f2ae8062890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:43.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 shutdown_connections 2023-08-17T00:07:43.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:43.939+0000 7f2aeca5b700 1 -- 172.21.15.153:0/785152956 wait complete. 2023-08-17T00:07:43.961 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:07:43.961 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:07:43.962 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:07:43.962 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:07:43.962 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:43.963 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:07:43.963 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:07:43.963 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:07:43.964 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:07:43.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:43.964 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:07:43.979 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:07:43.979 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:07:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:07:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:07:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.980 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:43.980 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:07:43.981 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:07:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42149sec preferred_lft 42149sec 2023-08-17T00:07:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:07:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.982 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:07:43.982 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:07:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.983 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:07:43.983 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:07:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:07:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:07:43.984 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.985 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:07:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:07:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:07:43.985 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.986 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:07:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:07:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:07:43.986 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:07:43.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:43.988 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:07:44.071 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:07:44.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:44.075 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:07:44.138 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:07:44.138 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:07:44.138 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:07:44.138 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:07:44.139 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:07:44.139 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:07:44.139 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:07:44.139 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:07:44.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:44.140 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:07:44.140 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:07:44.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:07:44.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:07:44.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:07:44.141 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:07:44.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:44.273 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:07:44.289 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:07:44.289 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:07:44.291 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:07:44.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:44.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:07:44.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:44.368 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:44.428 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:07:44.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:44.441 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:07:44.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:07:44.539 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:44.540 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:07:44.564 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:07:44.564 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:07:44.570 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:07:44.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:07:44.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:07:44.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-08-17T00:07:44.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.851+0000 7fc10e639700 1 Processor -- start 2023-08-17T00:07:44.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.851+0000 7fc10e639700 1 -- start start 2023-08-17T00:07:44.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10e639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc108157b50 0x7fc108064a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:44.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10e639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc108157f30 0x7fc1080c0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:44.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10e639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc108062650 con 0x7fc10815b8d0 2023-08-17T00:07:44.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10e639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1080c0fa0 con 0x7fc108157f30 2023-08-17T00:07:44.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10e639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108062040 con 0x7fc108157b50 2023-08-17T00:07:44.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc108157f30 0x7fc1080c0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc108157f30 0x7fc1080c0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60626/0 (socket says 172.21.15.153:60626) 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 -- 172.21.15.153:0/1651015088 learned_addr learned my addr 172.21.15.153:0/1651015088 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10d637700 1 --2- 172.21.15.153:0/1651015088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc108157b50 0x7fc108064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 -- 172.21.15.153:0/1651015088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc108157b50 msgr2=0x7fc108064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 --2- 172.21.15.153:0/1651015088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc108157b50 0x7fc108064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 -- 172.21.15.153:0/1651015088 >> v1:172.21.15.178:6789/0 conn(0x7fc10815b8d0 legacy=0x7fc108062ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:44.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 -- 172.21.15.153:0/1651015088 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080bcfd0 con 0x7fc108157f30 2023-08-17T00:07:44.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc10ce36700 1 --2- 172.21.15.153:0/1651015088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080c0ab0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fc0f8006fd0 tx=0x7fc0f80090f0).ready entity=mon.0 client_cookie=1e0189adf5e636ba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:44.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.855+0000 7fc0fffff700 1 -- 172.21.15.153:0/1651015088 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800b600 con 0x7fc108157f30 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc0fffff700 1 -- 172.21.15.153:0/1651015088 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f800b760 con 0x7fc108157f30 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc0fffff700 1 -- 172.21.15.153:0/1651015088 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800bae0 con 0x7fc108157f30 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 -- 172.21.15.153:0/1651015088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 msgr2=0x7fc1080c0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 --2- 172.21.15.153:0/1651015088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080c0ab0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7fc0f8006fd0 tx=0x7fc0f80090f0).stop 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 -- 172.21.15.153:0/1651015088 shutdown_connections 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 --2- 172.21.15.153:0/1651015088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080c0ab0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:44.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 --2- 172.21.15.153:0/1651015088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc108157b50 0x7fc108064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:44.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 -- 172.21.15.153:0/1651015088 >> 172.21.15.153:0/1651015088 conn(0x7fc1080c6ee0 msgr2=0x7fc1080c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:44.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 -- 172.21.15.153:0/1651015088 shutdown_connections 2023-08-17T00:07:44.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.859+0000 7fc10e639700 1 -- 172.21.15.153:0/1651015088 wait complete. 2023-08-17T00:07:44.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 Processor -- start 2023-08-17T00:07:44.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 -- start start 2023-08-17T00:07:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc108157b50 0x7fc108149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:44.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc10815b8d0 0x7fc1080a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080a86a0 con 0x7fc108157f30 2023-08-17T00:07:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080a6b40 con 0x7fc108157b50 2023-08-17T00:07:44.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10e639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1080a6e20 con 0x7fc10815b8d0 2023-08-17T00:07:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10ce36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10ce36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080a7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60628/0 (socket says 172.21.15.153:60628) 2023-08-17T00:07:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10ce36700 1 -- 172.21.15.153:0/489333973 learned_addr learned my addr 172.21.15.153:0/489333973 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:07:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10d637700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc108157b50 0x7fc108149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.863+0000 7fc10de38700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc10815b8d0 0x7fc1080a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:44.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10ce36700 1 -- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc10815b8d0 msgr2=0x7fc1080a81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10ce36700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc10815b8d0 0x7fc1080a81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10ce36700 1 -- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc108157b50 msgr2=0x7fc108149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10ce36700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc108157b50 0x7fc108149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10ce36700 1 -- 172.21.15.153:0/489333973 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f8009370 con 0x7fc108157f30 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10ce36700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080a7cc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fc0f8009130 tx=0x7fc0f8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800be50 con 0x7fc108157f30 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f800b8d0 con 0x7fc108157f30 2023-08-17T00:07:44.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f801c670 con 0x7fc108157f30 2023-08-17T00:07:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1080a7100 con 0x7fc108157f30 2023-08-17T00:07:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1080a76c0 con 0x7fc108157f30 2023-08-17T00:07:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.867+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108046dd0 con 0x7fc108157f30 2023-08-17T00:07:44.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.871+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc0f802c070 con 0x7fc108157f30 2023-08-17T00:07:44.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.871+0000 7fc0fd7fa700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0ec05a150 0x7fc0ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:07:44.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.871+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc0f8075d20 con 0x7fc108157f30 2023-08-17T00:07:44.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.871+0000 7fc10d637700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0ec05a150 0x7fc0ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:07:44.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.871+0000 7fc10d637700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0ec05a150 0x7fc0ec05c610 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fc10400bbc0 tx=0x7fc104008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:07:44.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:44.879+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0f80497d0 con 0x7fc108157f30 2023-08-17T00:07:45.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.083+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc1080622e0 con 0x7fc108157f30 2023-08-17T00:07:45.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.227+0000 7fc0fd7fa700 1 -- 172.21.15.153:0/489333973 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v63) v1 ==== 167+0+0 (secure 0 0 0) 0x7fc0f8020070 con 0x7fc108157f30 2023-08-17T00:07:45.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0ec05a150 msgr2=0x7fc0ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:45.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0ec05a150 0x7fc0ec05c610 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7fc10400bbc0 tx=0x7fc104008040).stop 2023-08-17T00:07:45.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 msgr2=0x7fc1080a7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:07:45.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080a7cc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7fc0f8009130 tx=0x7fc0f8017000).stop 2023-08-17T00:07:45.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 shutdown_connections 2023-08-17T00:07:45.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc0ec05a150 0x7fc0ec05c610 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:45.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc10815b8d0 0x7fc1080a81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc108157f30 0x7fc1080a7cc0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 --2- 172.21.15.153:0/489333973 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc108157b50 0x7fc108149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:07:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 >> 172.21.15.153:0/489333973 conn(0x7fc1080c6ee0 msgr2=0x7fc1080ab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:07:45.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 shutdown_connections 2023-08-17T00:07:45.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:07:45.231+0000 7fc10e639700 1 -- 172.21.15.153:0/489333973 wait complete. 2023-08-17T00:07:45.242 INFO:teuthology.orchestra.run.smithi153.stderr:enabled new snapshots 2023-08-17T00:07:45.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:07:45.258 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2023-08-17T00:07:45.286 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:07:45.286 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:07:45.286 DEBUG:teuthology.orchestra.run.smithi153:> import uuid 2023-08-17T00:07:45.287 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:07:45.287 DEBUG:teuthology.orchestra.run.smithi153:> n = 2000 2023-08-17T00:07:45.287 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = False 2023-08-17T00:07:45.288 DEBUG:teuthology.orchestra.run.smithi153:> if 3 > 0: 2023-08-17T00:07:45.288 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = True 2023-08-17T00:07:45.288 DEBUG:teuthology.orchestra.run.smithi153:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2023-08-17T00:07:45.288 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:07:45.289 DEBUG:teuthology.orchestra.run.smithi153:> dpath = os.path.dirname(path) 2023-08-17T00:07:45.289 DEBUG:teuthology.orchestra.run.smithi153:> fnameprefix = os.path.basename(path) 2023-08-17T00:07:45.289 DEBUG:teuthology.orchestra.run.smithi153:> os.makedirs(dpath, exist_ok=True) 2023-08-17T00:07:45.290 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:07:45.290 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:07:45.290 DEBUG:teuthology.orchestra.run.smithi153:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-08-17T00:07:45.291 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:07:45.291 DEBUG:teuthology.orchestra.run.smithi153:> for i in range(n): 2023-08-17T00:07:45.291 DEBUG:teuthology.orchestra.run.smithi153:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-08-17T00:07:45.292 DEBUG:teuthology.orchestra.run.smithi153:> with open(fpath, '"'"'w'"'"') as f: 2023-08-17T00:07:45.292 DEBUG:teuthology.orchestra.run.smithi153:> f.write(f"{i}") 2023-08-17T00:07:45.292 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:07:45.293 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2023-08-17T00:07:45.293 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(f.fileno()) 2023-08-17T00:07:45.293 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:07:45.294 DEBUG:teuthology.orchestra.run.smithi153:> os.unlink(fpath) 2023-08-17T00:07:45.294 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:07:45.294 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2023-08-17T00:07:45.294 DEBUG:teuthology.orchestra.run.smithi153:> if create_hard_links: 2023-08-17T00:07:45.295 DEBUG:teuthology.orchestra.run.smithi153:> for j in range(3): 2023-08-17T00:07:45.295 DEBUG:teuthology.orchestra.run.smithi153:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-08-17T00:07:45.295 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:07:45.296 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2023-08-17T00:07:45.296 DEBUG:teuthology.orchestra.run.smithi153:> finally: 2023-08-17T00:07:45.296 DEBUG:teuthology.orchestra.run.smithi153:> os.close(dirfd) 2023-08-17T00:07:45.297 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:08:14.554 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:08:14.559 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:08:27.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:08:27.272 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-08-17T00:08:27.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:08:27.318 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2023-08-17T00:08:44.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:08:44.630 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:09:06.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:09:06.541 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-08-17T00:09:06.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2023-08-17T00:09:06.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d51d79700 1 Processor -- start 2023-08-17T00:09:06.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d51d79700 1 -- start start 2023-08-17T00:09:06.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d51d79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5d4c151c40 0x7f5d4c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d51d79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c065da0 con 0x7f5d4c0689c0 2023-08-17T00:09:06.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d51d79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c155c60 con 0x7f5d4c068da0 2023-08-17T00:09:06.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d51d79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d4c069200 con 0x7f5d4c151c40 2023-08-17T00:09:06.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d50d77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5d4c0689c0 0x7f5d4c0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44916/0 (socket says 172.21.15.153:44916) 2023-08-17T00:09:06.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.849+0000 7f5d50d77700 1 -- 172.21.15.153:0/1939205304 learned_addr learned my addr 172.21.15.153:0/1939205304 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:06.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d51578700 1 --2- 172.21.15.153:0/1939205304 >> v2:172.21.15.178:3300/0 conn(0x7f5d4c151c40 0x7f5d4c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469395926 0 0) 0x7f5d4c065da0 con 0x7f5d4c0689c0 2023-08-17T00:09:06.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d340033f0 con 0x7f5d4c0689c0 2023-08-17T00:09:06.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178599014 0 0) 0x7f5d4c155c60 con 0x7f5d4c068da0 2023-08-17T00:09:06.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4c065da0 con 0x7f5d4c068da0 2023-08-17T00:09:06.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3080464784 0 0) 0x7f5d340033f0 con 0x7f5d4c0689c0 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 >> v2:172.21.15.178:3300/0 conn(0x7f5d4c151c40 msgr2=0x7f5d4c1560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 --2- 172.21.15.153:0/1939205304 >> v2:172.21.15.178:3300/0 conn(0x7f5d4c151c40 0x7f5d4c1560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 >> v1:172.21.15.178:6789/0 conn(0x7f5d4c068da0 legacy=0x7f5d4c151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c065ff0 con 0x7f5d4c0689c0 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f5d48001970 con 0x7f5d4c0689c0 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 >> v1:172.21.15.153:6789/0 conn(0x7f5d4c0689c0 legacy=0x7f5d4c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d34004690 0x7f5d34004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d34005050 0x7f5d3400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c069200 con 0x7f5d34003a70 2023-08-17T00:09:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3400bfc0 con 0x7f5d34004690 2023-08-17T00:09:06.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34010590 con 0x7f5d34005050 2023-08-17T00:09:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d51578700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d34005050 0x7f5d3400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d43fff700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d34004690 0x7f5d34004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 -- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d34005050 msgr2=0x7f5d3400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d34005050 0x7f5d3400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 -- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d34004690 msgr2=0x7f5d34004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d34004690 0x7f5d34004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 -- 172.21.15.153:0/1939205304 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d340033f0 con 0x7f5d34003a70 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d51578700 1 -- 172.21.15.153:0/1939205304 reap_dead start 2023-08-17T00:09:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d34003e70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f5d4800c5f0 tx=0x7f5d48007aa0).ready entity=mon.0 client_cookie=9300a36bd1d2254 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48007cb0 con 0x7f5d34003a70 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800cdf0 con 0x7f5d34003a70 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.853+0000 7f5d437fe700 1 -- 172.21.15.153:0/1939205304 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48005c20 con 0x7f5d34003a70 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- 172.21.15.153:0/1939205304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 msgr2=0x7f5d34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d34003e70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7f5d4800c5f0 tx=0x7f5d48007aa0).stop 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- 172.21.15.153:0/1939205304 shutdown_connections 2023-08-17T00:09:06.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 --2- 172.21.15.153:0/1939205304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d34003e70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- 172.21.15.153:0/1939205304 >> 172.21.15.153:0/1939205304 conn(0x7f5d4c0c6620 msgr2=0x7f5d4c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:06.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- 172.21.15.153:0/1939205304 shutdown_connections 2023-08-17T00:09:06.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- 172.21.15.153:0/1939205304 wait complete. 2023-08-17T00:09:06.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 Processor -- start 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- start start 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d4c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d4c0bcaa0 0x7f5d4c0bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d4c15fe90 0x7f5d4c160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c154a10 con 0x7f5d34003a70 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c153970 con 0x7f5d4c15fe90 2023-08-17T00:09:06.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d51d79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c153c50 con 0x7f5d4c0bcaa0 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.857+0000 7f5d50d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d4c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d4c153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57884/0 (socket says 172.21.15.153:57884) 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 -- 172.21.15.153:0/2094191996 learned_addr learned my addr 172.21.15.153:0/2094191996 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d4c0bcaa0 0x7f5d4c0bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d51578700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d4c15fe90 0x7f5d4c160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 -- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d4c0bcaa0 msgr2=0x7f5d4c0bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d4c0bcaa0 0x7f5d4c0bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 -- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d4c15fe90 msgr2=0x7f5d4c160310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d4c15fe90 0x7f5d4c160310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 -- 172.21.15.153:0/2094191996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c153f30 con 0x7f5d34003a70 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d4c0bcaa0 0x7f5d4c0bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d51578700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d4c15fe90 0x7f5d4c160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d50d77700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d4c153070 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f5d4800cbe0 tx=0x7f5d48015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d40ff9700 1 -- 172.21.15.153:0/2094191996 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48005bc0 con 0x7f5d34003a70 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d40ff9700 1 -- 172.21.15.153:0/2094191996 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d480072e0 con 0x7f5d34003a70 2023-08-17T00:09:06.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c154210 con 0x7f5d34003a70 2023-08-17T00:09:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d40ff9700 1 -- 172.21.15.153:0/2094191996 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48007660 con 0x7f5d34003a70 2023-08-17T00:09:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c153560 con 0x7f5d34003a70 2023-08-17T00:09:06.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.861+0000 7f5d40ff9700 1 -- 172.21.15.153:0/2094191996 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5d48026070 con 0x7f5d34003a70 2023-08-17T00:09:06.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.865+0000 7f5d40ff9700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d3805a180 0x7f5d3805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.865+0000 7f5d40ff9700 1 -- 172.21.15.153:0/2094191996 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f5d48074a00 con 0x7f5d34003a70 2023-08-17T00:09:06.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.865+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d3805a180 0x7f5d3805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.865+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d3805a180 0x7f5d3805c640 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f5d3c000c00 tx=0x7f5d3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.865+0000 7f5d5d36e740 1 Processor -- start 2023-08-17T00:09:06.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.865+0000 7f5d5d36e740 1 -- start start 2023-08-17T00:09:06.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c4a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c032c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b53160 con 0x1c067a0 2023-08-17T00:09:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b73ff0 con 0x1c06c20 2023-08-17T00:09:06.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c48c60 con 0x1c4a2f0 2023-08-17T00:09:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c032c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c032c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57888/0 (socket says 172.21.15.153:57888) 2023-08-17T00:09:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 -- 172.21.15.153:0/2845378878 learned_addr learned my addr 172.21.15.153:0/2845378878 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d51578700 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d50d77700 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c4a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 -- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 msgr2=0x1c4a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c4a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 -- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 msgr2=0x1c037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 -- 172.21.15.153:0/2845378878 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b80fd0 con 0x1c067a0 2023-08-17T00:09:06.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d51578700 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d43fff700 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c032c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f5d3c002990 tx=0x7f5d3c014000).ready entity=mon.0 client_cookie=5cebbde7fe5402f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d31ffb700 1 -- 172.21.15.153:0/2845378878 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c015660 con 0x1c067a0 2023-08-17T00:09:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d31ffb700 1 -- 172.21.15.153:0/2845378878 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0157c0 con 0x1c067a0 2023-08-17T00:09:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d31ffb700 1 -- 172.21.15.153:0/2845378878 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c015b40 con 0x1c067a0 2023-08-17T00:09:06.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- 172.21.15.153:0/2845378878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 msgr2=0x1c032c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c032c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f5d3c002990 tx=0x7f5d3c014000).stop 2023-08-17T00:09:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- 172.21.15.153:0/2845378878 shutdown_connections 2023-08-17T00:09:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c037b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c032c0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/2845378878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c4a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- 172.21.15.153:0/2845378878 >> 172.21.15.153:0/2845378878 conn(0x19e6640 msgr2=0x1c07200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- 172.21.15.153:0/2845378878 shutdown_connections 2023-08-17T00:09:06.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.869+0000 7f5d5d36e740 1 -- 172.21.15.153:0/2845378878 wait complete. 2023-08-17T00:09:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 -- start start 2023-08-17T00:09:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 Processor -- start 2023-08-17T00:09:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c5c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c04290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c591a0 con 0x1c067a0 2023-08-17T00:09:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c5b7b0 con 0x1c06c20 2023-08-17T00:09:06.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c33830 con 0x1c4a2f0 2023-08-17T00:09:06.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 10 client.0 ll_register_callbacks cb 0x1bbe440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:06.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c5c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c5c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57890/0 (socket says 172.21.15.153:57890) 2023-08-17T00:09:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 -- 172.21.15.153:0/1264642139 learned_addr learned my addr 172.21.15.153:0/1264642139 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d43fff700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d51578700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c04290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 -- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 msgr2=0x1c04290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c04290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 -- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 msgr2=0x1c2da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 -- 172.21.15.153:0/1264642139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d440096f0 con 0x1c067a0 2023-08-17T00:09:06.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d51578700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c04290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d50d77700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c5c110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f5d480016c0 tx=0x7f5d4800c390).ready entity=mon.0 client_cookie=b4c1f860822df3ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d2affd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d2affd700 1 -- 172.21.15.153:0/1264642139 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4804bec0 con 0x1c067a0 2023-08-17T00:09:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d2affd700 1 -- 172.21.15.153:0/1264642139 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f5d4804b850 con 0x1c067a0 2023-08-17T00:09:06.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.873+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b7dcb0 con 0x1c067a0 2023-08-17T00:09:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 1 -- 172.21.15.153:0/1264642139 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d48048150 con 0x1c067a0 2023-08-17T00:09:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 10 client.6846 fetch_fsmap learned FSMap version 73 2023-08-17T00:09:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x7f5d3c00f040 con 0x1c067a0 2023-08-17T00:09:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 1 -- 172.21.15.153:0/1264642139 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b7dcb0 con 0x1c067a0 2023-08-17T00:09:06.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 1 -- 172.21.15.153:0/1264642139 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d4804b0b0 con 0x1c067a0 2023-08-17T00:09:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 10 client.6846 fetch_fsmap finished waiting for FSMap version 73 2023-08-17T00:09:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 10 client.6846 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 20 client.6846 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:06.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1c5c670 0x1c5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 4 client.6846 mds_command: new command op to 6681 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:09:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b74200 con 0x1c5c670 2023-08-17T00:09:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d43fff700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1c5c670 0x1c5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d43fff700 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1c5c670 0x1c5ca50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f7ba2e33617985a1 server_cookie=4a88ac817bc974fc in_seq=0 out_seq=0 2023-08-17T00:09:06.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 10 client.6846 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 1 -- 172.21.15.153:0/1264642139 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1b74200 con 0x1c5c670 2023-08-17T00:09:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 10 client.6846 handle_command_reply: tid=0 2023-08-17T00:09:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 client.6846 shutdown 2023-08-17T00:09:06.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 msgr2=0x1c5c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c5c110 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f5d480016c0 tx=0x7f5d4800c390).stop 2023-08-17T00:09:06.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 shutdown_connections 2023-08-17T00:09:06.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1c5c670 0x1c5ca50 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c4a2f0 0x1c04290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d2affd700 0 client.6846 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:06.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/1264642139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c067a0 0x1c5c110 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.877+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 >> 172.21.15.153:0/1264642139 conn(0x19e6640 msgr2=0x1c2bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:06.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.881+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 shutdown_connections 2023-08-17T00:09:06.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.881+0000 7f5d5d36e740 1 -- 172.21.15.153:0/1264642139 wait complete. 2023-08-17T00:09:06.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.881+0000 7f5d5d36e740 20 client.6846 trim_cache size 0 max 16384 2023-08-17T00:09:06.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 Processor -- start 2023-08-17T00:09:06.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 -- start start 2023-08-17T00:09:06.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c067a0 0x1c05840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c06c20 0x1bffaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c2edf0 con 0x1c4a2f0 2023-08-17T00:09:06.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c59db0 con 0x1c067a0 2023-08-17T00:09:06.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c58ec0 con 0x1c06c20 2023-08-17T00:09:06.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c5ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57892/0 (socket says 172.21.15.153:57892) 2023-08-17T00:09:06.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 -- 172.21.15.153:0/836016153 learned_addr learned my addr 172.21.15.153:0/836016153 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:06.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d43fff700 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c06c20 0x1bffaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d50d77700 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c067a0 0x1c05840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 -- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c06c20 msgr2=0x1bffaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c06c20 0x1bffaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 -- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c067a0 msgr2=0x1c05840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c067a0 0x1c05840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 -- 172.21.15.153:0/836016153 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c160b60 con 0x1c4a2f0 2023-08-17T00:09:06.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.897+0000 7f5d51578700 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c5ca50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f5d4c066a30 tx=0x7f5d44008040).ready entity=mon.0 client_cookie=a88ab73e33e06bfe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d327fc700 1 -- 172.21.15.153:0/836016153 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44018d80 con 0x1c4a2f0 2023-08-17T00:09:06.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d327fc700 1 -- 172.21.15.153:0/836016153 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44016460 con 0x1c4a2f0 2023-08-17T00:09:06.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d327fc700 1 -- 172.21.15.153:0/836016153 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d440167e0 con 0x1c4a2f0 2023-08-17T00:09:06.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 -- 172.21.15.153:0/836016153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 msgr2=0x1c5ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c5ca50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7f5d4c066a30 tx=0x7f5d44008040).stop 2023-08-17T00:09:06.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 -- 172.21.15.153:0/836016153 shutdown_connections 2023-08-17T00:09:06.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c5ca50 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c06c20 0x1bffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/836016153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c067a0 0x1c05840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 -- 172.21.15.153:0/836016153 >> 172.21.15.153:0/836016153 conn(0x19e6640 msgr2=0x1c01a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 -- 172.21.15.153:0/836016153 shutdown_connections 2023-08-17T00:09:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 -- 172.21.15.153:0/836016153 wait complete. 2023-08-17T00:09:06.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 -- start start 2023-08-17T00:09:06.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.901+0000 7f5d5d36e740 1 Processor -- start 2023-08-17T00:09:06.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c067a0 0x1c05380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c2a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c2ac90 con 0x1c4a2f0 2023-08-17T00:09:06.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c45a90 con 0x1c06c20 2023-08-17T00:09:06.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bfff90 con 0x1c067a0 2023-08-17T00:09:06.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 10 client.0 ll_register_callbacks cb 0x7f5d4804bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:06.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c2a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c2a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57902/0 (socket says 172.21.15.153:57902) 2023-08-17T00:09:06.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 -- 172.21.15.153:0/673745856 learned_addr learned my addr 172.21.15.153:0/673745856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:06.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d43fff700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d50d77700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c067a0 0x1c05380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 -- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c067a0 msgr2=0x1c05380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c067a0 0x1c05380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 -- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 msgr2=0x1c2a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:06.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 -- 172.21.15.153:0/673745856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d44009bf0 con 0x1c4a2f0 2023-08-17T00:09:06.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d51578700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c2a7a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f5d44006d80 tx=0x7f5d4401f000).ready entity=mon.0 client_cookie=58856d385d76dd3b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:06.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d2affd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:06.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d2affd700 1 -- 172.21.15.153:0/673745856 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44016de0 con 0x1c4a2f0 2023-08-17T00:09:06.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d2affd700 1 -- 172.21.15.153:0/673745856 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f5d44021430 con 0x1c4a2f0 2023-08-17T00:09:06.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.905+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d3c0157c0 con 0x1c4a2f0 2023-08-17T00:09:06.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d2affd700 1 -- 172.21.15.153:0/673745856 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d44021800 con 0x1c4a2f0 2023-08-17T00:09:06.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 10 client.6852 fetch_fsmap learned FSMap version 73 2023-08-17T00:09:06.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x1b7c470 con 0x1c4a2f0 2023-08-17T00:09:06.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d2affd700 1 -- 172.21.15.153:0/673745856 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c0157c0 con 0x1c4a2f0 2023-08-17T00:09:06.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d2affd700 1 -- 172.21.15.153:0/673745856 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d44011030 con 0x1c4a2f0 2023-08-17T00:09:06.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 10 client.6852 fetch_fsmap finished waiting for FSMap version 73 2023-08-17T00:09:06.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 10 client.6852 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:06.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 20 client.6852 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:06.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1caf160 0x1c00420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:06.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 4 client.6852 mds_command: new command op to 6681 tid=0[{"prefix": "perf dump"}] 2023-08-17T00:09:06.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x1a3d5d0 con 0x1caf160 2023-08-17T00:09:06.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d50d77700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1caf160 0x1c00420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:06.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d2affd700 10 client.6852 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:06.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.909+0000 7f5d50d77700 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1caf160 0x1c00420 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b08db3a80be7a8da server_cookie=5c148ae42104789a in_seq=0 out_seq=0 2023-08-17T00:09:06.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.957+0000 7f5d2affd700 1 -- 172.21.15.153:0/673745856 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17063 (crc 0 0 0) 0x1a3d5d0 con 0x1caf160 2023-08-17T00:09:06.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.957+0000 7f5d2affd700 10 client.6852 handle_command_reply: tid=0 2023-08-17T00:09:06.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.957+0000 7f5d5d36e740 1 client.6852 shutdown 2023-08-17T00:09:06.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.957+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 msgr2=0x1c2a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.957+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c2a7a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f5d44006d80 tx=0x7f5d4401f000).stop 2023-08-17T00:09:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 shutdown_connections 2023-08-17T00:09:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1caf160 0x1c00420 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1c4a2f0 0x1c2a7a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d2affd700 0 client.6852 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1c06c20 0x1c2a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 --2- 172.21.15.153:0/673745856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1c067a0 0x1c05380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 >> 172.21.15.153:0/673745856 conn(0x19e6640 msgr2=0x1c4dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 shutdown_connections 2023-08-17T00:09:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 1 -- 172.21.15.153:0/673745856 wait complete. 2023-08-17T00:09:06.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d5d36e740 20 client.6852 trim_cache size 0 max 16384 2023-08-17T00:09:06.966 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 3881, 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 3880, 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1122983, 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 35685763, 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 9, 2023-08-17T00:09:06.967 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 3, 2023-08-17T00:09:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.745409248, 2023-08-17T00:09:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.363149880, 2023-08-17T00:09:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.090499191, 2023-08-17T00:09:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.253031687, 2023-08-17T00:09:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:09:06.968 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3879, 2023-08-17T00:09:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.319673224, 2023-08-17T00:09:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001629201 2023-08-17T00:09:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:09:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2, 2023-08-17T00:09:06.969 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000458, 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000229 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 3965, 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 3986, 2023-08-17T00:09:06.970 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1343799, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 22954653, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.514582049, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.236853440, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.094545450, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.136722030, 2023-08-17T00:09:06.971 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3985, 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.694513279, 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000425222 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:06.972 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 32335, 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 55037, 2023-08-17T00:09:06.973 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 10939760, 2023-08-17T00:09:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 58156292, 2023-08-17T00:09:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 7, 2023-08-17T00:09:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:09:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 10.247477333, 2023-08-17T00:09:06.974 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 8.405436357, 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 1.940527517, 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.227210540, 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 55036, 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.141796268, 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000075256 2023-08-17T00:09:06.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 49749, 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.015118072, 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000303 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-08-17T00:09:06.976 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4508, 2023-08-17T00:09:06.977 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 20.098479672, 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.004458402 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 2, 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:09:06.978 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1930, 2023-08-17T00:09:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.638852860, 2023-08-17T00:09:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000849146 2023-08-17T00:09:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:06.979 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-08-17T00:09:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 27947, 2023-08-17T00:09:06.980 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 27947, 2023-08-17T00:09:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-08-17T00:09:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 27947, 2023-08-17T00:09:06.981 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1146.445712736, 2023-08-17T00:09:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.041022138 2023-08-17T00:09:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.982 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-08-17T00:09:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2023-08-17T00:09:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch": 0, 2023-08-17T00:09:06.983 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 50, 2023-08-17T00:09:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2023-08-17T00:09:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-08-17T00:09:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 10011, 2023-08-17T00:09:06.984 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 5714, 2023-08-17T00:09:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 4297, 2023-08-17T00:09:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2023-08-17T00:09:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 1804, 2023-08-17T00:09:06.985 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 7916, 2023-08-17T00:09:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 124, 2023-08-17T00:09:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 124, 2023-08-17T00:09:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 2, 2023-08-17T00:09:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 161652, 2023-08-17T00:09:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 158296, 2023-08-17T00:09:06.987 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 2164, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 499696, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2023-08-17T00:09:06.988 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2023-08-17T00:09:06.989 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 0, 2023-08-17T00:09:06.990 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 0, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 0, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 2185, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 5831, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-17T00:09:06.991 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 5155, 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 2000, 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 66, 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 13870 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 1999, 2023-08-17T00:09:06.992 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 616, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 4270, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 1717, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 4597, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-08-17T00:09:06.993 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-08-17T00:09:06.994 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 24326, 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 22652, 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 21451, 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 2875, 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-08-17T00:09:06.995 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 1201, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 30, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 27, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 24, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 6, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 3, 2023-08-17T00:09:06.996 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 75166528, 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 85289903, 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4578, 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 151.976039698, 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.033197037 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.997 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 2014, 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 2014, 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 0, 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 13, 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 13, 2023-08-17T00:09:06.998 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 0, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 11394, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 20071, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 8677, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 124, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 8913, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 8789, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 105468, 2023-08-17T00:09:06.999 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 340196 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 87124, 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 27947, 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 5, 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2023-08-17T00:09:07.000 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2000, 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.285384039, 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001142692 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:09:07.001 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.002112958, 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000264119 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.002 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6000, 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 11.427397805, 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001904566 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 7329, 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.972667074, 2023-08-17T00:09:07.003 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000542047 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-08-17T00:09:07.004 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.005 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-08-17T00:09:07.006 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000215360, 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000215360 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.005927281, 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005927281 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.008 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.014443203, 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014443203 2023-08-17T00:09:07.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-08-17T00:09:07.010 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.118658083, 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014832260 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4597, 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1098.236914536, 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.238902961 2023-08-17T00:09:07.011 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.012 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.140610367, 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.140610367 2023-08-17T00:09:07.013 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:07.014 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000411426, 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000411426 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.015 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.016 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.017 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8000, 2023-08-17T00:09:07.018 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 30.240970604, 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003780121 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.019 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2023-08-17T00:09:07.020 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 16609, 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 16609, 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 82 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 19539, 2023-08-17T00:09:07.021 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 19539, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-17T00:09:07.022 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_bytes": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_items": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_bytes": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_items": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_bytes": 0, 2023-08-17T00:09:07.023 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_items": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_bytes": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_items": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-08-17T00:09:07.024 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-08-17T00:09:07.025 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 9566951, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 2497, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2023-08-17T00:09:07.026 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 6200, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 80, 2023-08-17T00:09:07.027 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 14500056, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 527891, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-08-17T00:09:07.028 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 1, 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 11421, 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 92674628, 2023-08-17T00:09:07.029 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 37, 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 11420, 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 11421, 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 21141 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 11421, 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 70, 2023-08-17T00:09:07.030 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 11351, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 37, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 4792, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 70, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 4650, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 61, 2023-08-17T00:09:07.031 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 1716, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 47, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-08-17T00:09:07.032 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 9584, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-08-17T00:09:07.033 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-08-17T00:09:07.034 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-08-17T00:09:07.035 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 84, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 6, 2023-08-17T00:09:07.036 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 8, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 8, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 147, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 37 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.037 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2023-08-17T00:09:07.038 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 32, 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 32, 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 1716, 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-17T00:09:07.039 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 40177, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 10243191, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 40177, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:09:07.040 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 40177, 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 10243191, 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.041 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 58277, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:07.042 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 11421, 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 92861773, 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 11420, 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 92803496, 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.043 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 1, 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:07.044 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 11421, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 11421, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 11420, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 11420, 2023-08-17T00:09:07.045 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:07.046 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 2333, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 249361, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 2333, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:09:07.047 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 72, 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 249361, 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.048 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x556f3a561cc0": { 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 683, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 24326, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 81095599, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:07.049 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 24326, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4578, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 81094916, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:07.050 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:07.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.051 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.051 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:09:07.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d3805a180 msgr2=0x7f5d3805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d3805a180 0x7f5d3805c640 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f5d3c000c00 tx=0x7f5d3c009040).stop 2023-08-17T00:09:07.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 msgr2=0x7f5d4c153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d4c153070 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7f5d4800cbe0 tx=0x7f5d48015000).stop 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 shutdown_connections 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d3805a180 0x7f5d3805c640 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d4c15fe90 0x7f5d4c160310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d4c0bcaa0 0x7f5d4c0bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 --2- 172.21.15.153:0/2094191996 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d34003a70 0x7f5d4c153070 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 >> 172.21.15.153:0/2094191996 conn(0x7f5d4c0c6620 msgr2=0x7f5d4c1524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 shutdown_connections 2023-08-17T00:09:07.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:06.961+0000 7f5d51d79700 1 -- 172.21.15.153:0/2094191996 wait complete. 2023-08-17T00:09:07.054 INFO:tasks.cephfs.test_scrub_checks:num of strays: 1999 2023-08-17T00:09:07.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start '~mdsdir' recursive 2023-08-17T00:09:07.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.221+0000 7fbb3f0b9700 1 Processor -- start 2023-08-17T00:09:07.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.221+0000 7fbb3f0b9700 1 -- start start 2023-08-17T00:09:07.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb38063400 0x7fbb380bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb380bc570 con 0x7fbb380651d0 2023-08-17T00:09:07.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb380bc850 con 0x7fbb38064df0 2023-08-17T00:09:07.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb38152d00 con 0x7fbb38063400 2023-08-17T00:09:07.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3d8b6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbb380651d0 0x7fbb3814b6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44932/0 (socket says 172.21.15.153:44932) 2023-08-17T00:09:07.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3d8b6700 1 -- 172.21.15.153:0/457713487 learned_addr learned my addr 172.21.15.153:0/457713487 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:07.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/457713487 >> v2:172.21.15.153:3300/0 conn(0x7fbb38063400 0x7fbb380bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/457713487 >> v1:172.21.15.178:6789/0 conn(0x7fbb38064df0 legacy=0x7fbb380bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/457713487 >> v1:172.21.15.153:6789/0 conn(0x7fbb380651d0 legacy=0x7fbb3814b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/457713487 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb380bcb30 con 0x7fbb38063400 2023-08-17T00:09:07.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/457713487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb38063400 0x7fbb380bbf30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fbb30009e60 tx=0x7fbb30009780).ready entity=mon.0 client_cookie=9a92c3e648adfe3a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3d0b5700 1 -- 172.21.15.153:0/457713487 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000e070 con 0x7fbb38063400 2023-08-17T00:09:07.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3d0b5700 1 -- 172.21.15.153:0/457713487 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3000bc30 con 0x7fbb38063400 2023-08-17T00:09:07.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3d0b5700 1 -- 172.21.15.153:0/457713487 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30012410 con 0x7fbb38063400 2023-08-17T00:09:07.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/457713487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb38063400 msgr2=0x7fbb380bbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/457713487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb38063400 0x7fbb380bbf30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7fbb30009e60 tx=0x7fbb30009780).stop 2023-08-17T00:09:07.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.225+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/457713487 shutdown_connections 2023-08-17T00:09:07.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.229+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/457713487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb38063400 0x7fbb380bbf30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.229+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/457713487 >> 172.21.15.153:0/457713487 conn(0x7fbb380c6ee0 msgr2=0x7fbb380c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.229+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/457713487 shutdown_connections 2023-08-17T00:09:07.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.229+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/457713487 wait complete. 2023-08-17T00:09:07.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.229+0000 7fbb3f0b9700 1 Processor -- start 2023-08-17T00:09:07.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.229+0000 7fbb3f0b9700 1 -- start start 2023-08-17T00:09:07.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb38063400 0x7fbb38141dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb38064df0 0x7fbb380bdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 0x7fbb381548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380a9e70 con 0x7fbb380651d0 2023-08-17T00:09:07.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380a9540 con 0x7fbb38063400 2023-08-17T00:09:07.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb380a9820 con 0x7fbb38064df0 2023-08-17T00:09:07.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 0x7fbb381548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 0x7fbb381548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57922/0 (socket says 172.21.15.153:57922) 2023-08-17T00:09:07.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/2757401688 learned_addr learned my addr 172.21.15.153:0/2757401688 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb38064df0 0x7fbb380bdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb38063400 0x7fbb38141dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb38064df0 msgr2=0x7fbb380bdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb38064df0 0x7fbb380bdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb38063400 msgr2=0x7fbb38141dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb38063400 0x7fbb38141dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/2757401688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009a20 con 0x7fbb380651d0 2023-08-17T00:09:07.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb38063400 0x7fbb38141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:07.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 0x7fbb381548d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fbb380c4180 tx=0x7fbb30009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb2e7fc700 1 -- 172.21.15.153:0/2757401688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb300117d0 con 0x7fbb380651d0 2023-08-17T00:09:07.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb2e7fc700 1 -- 172.21.15.153:0/2757401688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb30011930 con 0x7fbb380651d0 2023-08-17T00:09:07.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb380a9b00 con 0x7fbb380651d0 2023-08-17T00:09:07.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb2e7fc700 1 -- 172.21.15.153:0/2757401688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30011cf0 con 0x7fbb380651d0 2023-08-17T00:09:07.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.233+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb380be250 con 0x7fbb380651d0 2023-08-17T00:09:07.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.237+0000 7fbb2e7fc700 1 -- 172.21.15.153:0/2757401688 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbb3001d630 con 0x7fbb380651d0 2023-08-17T00:09:07.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.237+0000 7fbb2e7fc700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb1c05a150 0x7fbb1c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.237+0000 7fbb2e7fc700 1 -- 172.21.15.153:0/2757401688 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fbb30076540 con 0x7fbb380651d0 2023-08-17T00:09:07.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.237+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb1c05a150 0x7fbb1c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.237+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb1c05a150 0x7fbb1c05c610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbb34001710 tx=0x7fbb34009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 Processor -- start 2023-08-17T00:09:07.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 -- start start 2023-08-17T00:09:07.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1ed2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1efb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f19120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e222c0 con 0x1f132c0 2023-08-17T00:09:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1efc060 con 0x1efbc00 2023-08-17T00:09:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f19d70 con 0x1efb330 2023-08-17T00:09:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb3d8b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1efb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb3d8b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1efb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57926/0 (socket says 172.21.15.153:57926) 2023-08-17T00:09:07.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.241+0000 7fbb3d8b6700 1 -- 172.21.15.153:0/3241055686 learned_addr learned my addr 172.21.15.153:0/3241055686 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1ed2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f19120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3d8b6700 1 -- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 msgr2=0x1ed2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1ed2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3d8b6700 1 -- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 msgr2=0x1f19120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f19120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3d8b6700 1 -- 172.21.15.153:0/3241055686 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e50130 con 0x1f132c0 2023-08-17T00:09:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1efb710 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fbb28001400 tx=0x7fbb28009040).ready entity=mon.0 client_cookie=9a68c11abd1b0cbc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb1b7fe700 1 -- 172.21.15.153:0/3241055686 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb280070d0 con 0x1f132c0 2023-08-17T00:09:07.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb1b7fe700 1 -- 172.21.15.153:0/3241055686 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28007230 con 0x1f132c0 2023-08-17T00:09:07.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb1b7fe700 1 -- 172.21.15.153:0/3241055686 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb280075b0 con 0x1f132c0 2023-08-17T00:09:07.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 -- 172.21.15.153:0/3241055686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 msgr2=0x1efb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1efb710 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7fbb28001400 tx=0x7fbb28009040).stop 2023-08-17T00:09:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 -- 172.21.15.153:0/3241055686 shutdown_connections 2023-08-17T00:09:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f19120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1efb710 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 --2- 172.21.15.153:0/3241055686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1ed2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 -- 172.21.15.153:0/3241055686 >> 172.21.15.153:0/3241055686 conn(0x1cb57c0 msgr2=0x1ed61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 -- 172.21.15.153:0/3241055686 shutdown_connections 2023-08-17T00:09:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 -- 172.21.15.153:0/3241055686 wait complete. 2023-08-17T00:09:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.245+0000 7fbb4a696740 1 -- start start 2023-08-17T00:09:07.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 Processor -- start 2023-08-17T00:09:07.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ef8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f00680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1efa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ef8650 con 0x1efb330 2023-08-17T00:09:07.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2daa0 con 0x1efbc00 2023-08-17T00:09:07.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f2cb90 con 0x1f132c0 2023-08-17T00:09:07.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb4a696740 10 client.0 ll_register_callbacks cb 0x1e8d3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:07.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb3e0b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ef8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb3e0b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ef8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57928/0 (socket says 172.21.15.153:57928) 2023-08-17T00:09:07.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb3e0b7700 1 -- 172.21.15.153:0/369321686 learned_addr learned my addr 172.21.15.153:0/369321686 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1efa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.249+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f00680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 msgr2=0x1f00680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f00680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 msgr2=0x1ef8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ef8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/369321686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2800f040 con 0x1f132c0 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ef8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1efa090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbb3000b6c0 tx=0x7fbb30076040).ready entity=mon.2 client_cookie=86dabb6ae92443cd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 1 -- 172.21.15.153:0/369321686 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30009420 con 0x1f132c0 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 1 -- 172.21.15.153:0/369321686 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fbb300532f0 con 0x1f132c0 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e4ce10 con 0x1f132c0 2023-08-17T00:09:07.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 1 -- 172.21.15.153:0/369321686 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb3004d390 con 0x1f132c0 2023-08-17T00:09:07.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 10 client.5990 fetch_fsmap learned FSMap version 73 2023-08-17T00:09:07.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x1e4b5d0 con 0x1f132c0 2023-08-17T00:09:07.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 1 -- 172.21.15.153:0/369321686 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e4ce10 con 0x1f132c0 2023-08-17T00:09:07.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 1 -- 172.21.15.153:0/369321686 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbb300760b0 con 0x1f132c0 2023-08-17T00:09:07.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 10 client.5990 fetch_fsmap finished waiting for FSMap version 73 2023-08-17T00:09:07.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 10 client.5990 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 20 client.5990 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1f30480 0x1f30890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 4 client.5990 mds_command: new command op to 6681 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:09:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e43360 con 0x1f30480 2023-08-17T00:09:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1f30480 0x1f30890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1f30480 0x1f30890 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f2b1559366110237 server_cookie=db15a53f67d4b412 in_seq=0 out_seq=0 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.253+0000 7fbb18ff9700 10 client.5990 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb18ff9700 1 -- 172.21.15.153:0/369321686 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1e43360 con 0x1f30480 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb18ff9700 10 client.5990 handle_command_reply: tid=0 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 client.5990 shutdown 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 msgr2=0x1efa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1efa090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fbb3000b6c0 tx=0x7fbb30076040).stop 2023-08-17T00:09:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 shutdown_connections 2023-08-17T00:09:07.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1f30480 0x1f30890 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1efa090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1f00680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb18ff9700 0 client.5990 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 --2- 172.21.15.153:0/369321686 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ef8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 >> 172.21.15.153:0/369321686 conn(0x1cb57c0 msgr2=0x1ecf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 shutdown_connections 2023-08-17T00:09:07.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 1 -- 172.21.15.153:0/369321686 wait complete. 2023-08-17T00:09:07.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.257+0000 7fbb4a696740 20 client.5990 trim_cache size 0 max 16384 2023-08-17T00:09:07.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 Processor -- start 2023-08-17T00:09:07.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 -- start start 2023-08-17T00:09:07.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ed6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ef70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1f1c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e4ce10 con 0x1efb330 2023-08-17T00:09:07.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e99230 con 0x1efbc00 2023-08-17T00:09:07.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ed67f0 con 0x1f132c0 2023-08-17T00:09:07.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb3e0b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ed6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb3e0b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ed6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57944/0 (socket says 172.21.15.153:57944) 2023-08-17T00:09:07.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb3e0b7700 1 -- 172.21.15.153:0/69647736 learned_addr learned my addr 172.21.15.153:0/69647736 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1f1c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.273+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ef70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb3e0b7700 1 -- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 msgr2=0x1f1c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1f1c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb3e0b7700 1 -- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 msgr2=0x1ef70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ef70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb3e0b7700 1 -- 172.21.15.153:0/69647736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1efba70 con 0x1efb330 2023-08-17T00:09:07.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ed6240 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fbb34012570 tx=0x7fbb34014040).ready entity=mon.0 client_cookie=1028f362a0621433 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb1bfff700 1 -- 172.21.15.153:0/69647736 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34012aa0 con 0x1efb330 2023-08-17T00:09:07.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb1bfff700 1 -- 172.21.15.153:0/69647736 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb34023a70 con 0x1efb330 2023-08-17T00:09:07.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb1bfff700 1 -- 172.21.15.153:0/69647736 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34023df0 con 0x1efb330 2023-08-17T00:09:07.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 -- 172.21.15.153:0/69647736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 msgr2=0x1ed6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ed6240 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 rx=0x7fbb34012570 tx=0x7fbb34014040).stop 2023-08-17T00:09:07.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 -- 172.21.15.153:0/69647736 shutdown_connections 2023-08-17T00:09:07.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f132c0 0x1f1c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ef70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 --2- 172.21.15.153:0/69647736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1efb330 0x1ed6240 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 -- 172.21.15.153:0/69647736 >> 172.21.15.153:0/69647736 conn(0x1cb57c0 msgr2=0x1ed56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 -- 172.21.15.153:0/69647736 shutdown_connections 2023-08-17T00:09:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.277+0000 7fbb4a696740 1 -- 172.21.15.153:0/69647736 wait complete. 2023-08-17T00:09:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 -- start start 2023-08-17T00:09:07.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 Processor -- start 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1f19590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ecfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1f792c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f83df0 con 0x1f132c0 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ed25f0 con 0x1efbc00 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ed28d0 con 0x1efb330 2023-08-17T00:09:07.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb4a696740 10 client.0 ll_register_callbacks cb 0x7fbb3004da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:07.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1f792c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1f792c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57958/0 (socket says 172.21.15.153:57958) 2023-08-17T00:09:07.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/906152437 learned_addr learned my addr 172.21.15.153:0/906152437 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1f19590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ecfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 msgr2=0x1f19590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1f19590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 msgr2=0x1ecfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ecfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3e8b8700 1 -- 172.21.15.153:0/906152437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3401a040 con 0x1f132c0 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.281+0000 7fbb3d8b6700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ecfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb3e8b8700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1f792c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fbb300767a0 tx=0x7fbb30051000).ready entity=mon.0 client_cookie=9827026071807902 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 1 -- 172.21.15.153:0/906152437 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb30042070 con 0x1f132c0 2023-08-17T00:09:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb28007230 con 0x1f132c0 2023-08-17T00:09:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 1 -- 172.21.15.153:0/906152437 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fbb30076040 con 0x1f132c0 2023-08-17T00:09:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 1 -- 172.21.15.153:0/906152437 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb30009420 con 0x1f132c0 2023-08-17T00:09:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 10 client.6873 fetch_fsmap learned FSMap version 73 2023-08-17T00:09:07.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x7fbb38155120 con 0x1f132c0 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 1 -- 172.21.15.153:0/906152437 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb28007230 con 0x1f132c0 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 1 -- 172.21.15.153:0/906152437 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbb30049c90 con 0x1f132c0 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 10 client.6873 fetch_fsmap finished waiting for FSMap version 73 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 10 client.6873 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 20 client.6873 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1ecffb0 0x1f797b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 4 client.6873 mds_command: new command op to 6681 tid=0[{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2023-08-17T00:09:07.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x1d0c750 con 0x1ecffb0 2023-08-17T00:09:07.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1ecffb0 0x1f797b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb3e0b7700 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1ecffb0 0x1f797b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9e37b9cec03310ac server_cookie=f9e539c888d81fec in_seq=0 out_seq=0 2023-08-17T00:09:07.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.285+0000 7fbb18ff9700 10 client.6873 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb18ff9700 1 -- 172.21.15.153:0/906152437 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1d0c750 con 0x1ecffb0 2023-08-17T00:09:07.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb18ff9700 10 client.6873 handle_command_reply: tid=0 2023-08-17T00:09:07.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 client.6873 shutdown 2023-08-17T00:09:07.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 msgr2=0x1f792c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1f792c0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7fbb300767a0 tx=0x7fbb30051000).stop 2023-08-17T00:09:07.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 shutdown_connections 2023-08-17T00:09:07.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1ecffb0 0x1f797b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f132c0 0x1f792c0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1efbc00 0x1ecfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb18ff9700 0 client.6873 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 --2- 172.21.15.153:0/906152437 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1efb330 0x1f19590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.293+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 >> 172.21.15.153:0/906152437 conn(0x1cb57c0 msgr2=0x1f176c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 shutdown_connections 2023-08-17T00:09:07.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb4a696740 1 -- 172.21.15.153:0/906152437 wait complete. 2023-08-17T00:09:07.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb4a696740 20 client.6873 trim_cache size 0 max 16384 2023-08-17T00:09:07.303 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:09:07.303 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:09:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "96d64253-2d8f-4e88-a154-ea46c5729b78", 2023-08-17T00:09:07.304 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:09:07.304 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:09:07.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb1c05a150 msgr2=0x7fbb1c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb1c05a150 0x7fbb1c05c610 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fbb34001710 tx=0x7fbb34009040).stop 2023-08-17T00:09:07.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 msgr2=0x7fbb381548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 0x7fbb381548d0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7fbb380c4180 tx=0x7fbb30009780).stop 2023-08-17T00:09:07.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 shutdown_connections 2023-08-17T00:09:07.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb1c05a150 0x7fbb1c05c610 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb380651d0 0x7fbb381548d0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb38064df0 0x7fbb380bdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 --2- 172.21.15.153:0/2757401688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb38063400 0x7fbb38141dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 >> 172.21.15.153:0/2757401688 conn(0x7fbb380c6ee0 msgr2=0x7fbb3814fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 shutdown_connections 2023-08-17T00:09:07.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.297+0000 7fbb3f0b9700 1 -- 172.21.15.153:0/2757401688 wait complete. 2023-08-17T00:09:07.322 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-08-17T00:09:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6572c79700 1 Processor -- start 2023-08-17T00:09:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6572c79700 1 -- start start 2023-08-17T00:09:07.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6572c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6572c79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0ab9b0 con 0x7f656c0a8e60 2023-08-17T00:09:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6572c79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f656c0aada0 con 0x7f656c068f30 2023-08-17T00:09:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6572c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0ab080 con 0x7f656c150880 2023-08-17T00:09:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6571c77700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6571c77700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:34412/0 (socket says 172.21.15.153:34412) 2023-08-17T00:09:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.497+0000 7f6571c77700 1 -- 172.21.15.153:0/3967522155 learned_addr learned my addr 172.21.15.153:0/3967522155 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6571c77700 1 -- 172.21.15.153:0/3967522155 >> v1:172.21.15.178:6789/0 conn(0x7f656c068f30 legacy=0x7f656c064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6571c77700 1 -- 172.21.15.153:0/3967522155 >> v1:172.21.15.153:6789/0 conn(0x7f656c0a8e60 legacy=0x7f656c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6571c77700 1 -- 172.21.15.153:0/3967522155 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c0ab360 con 0x7f656c150880 2023-08-17T00:09:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6570c75700 1 -- 172.21.15.153:0/3967522155 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920175091 0 0) 0x7f656c0ab9b0 con 0x7f656c0a8e60 2023-08-17T00:09:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6571c77700 1 --2- 172.21.15.153:0/3967522155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0a8970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f656800bae0 tx=0x7f656800b300).ready entity=mon.2 client_cookie=cdf8cb665a03a2e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6570c75700 1 -- 172.21.15.153:0/3967522155 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656800db40 con 0x7f656c150880 2023-08-17T00:09:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6570c75700 1 -- 172.21.15.153:0/3967522155 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656800dca0 con 0x7f656c150880 2023-08-17T00:09:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6570c75700 1 -- 172.21.15.153:0/3967522155 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568005a90 con 0x7f656c150880 2023-08-17T00:09:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 -- 172.21.15.153:0/3967522155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 msgr2=0x7f656c0a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 --2- 172.21.15.153:0/3967522155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0a8970 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f656800bae0 tx=0x7f656800b300).stop 2023-08-17T00:09:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 -- 172.21.15.153:0/3967522155 shutdown_connections 2023-08-17T00:09:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 --2- 172.21.15.153:0/3967522155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0a8970 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 -- 172.21.15.153:0/3967522155 >> 172.21.15.153:0/3967522155 conn(0x7f656c0c6620 msgr2=0x7f656c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 -- 172.21.15.153:0/3967522155 shutdown_connections 2023-08-17T00:09:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.501+0000 7f6572c79700 1 -- 172.21.15.153:0/3967522155 wait complete. 2023-08-17T00:09:07.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 Processor -- start 2023-08-17T00:09:07.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 -- start start 2023-08-17T00:09:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 0x7f656c147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f656c0a8e60 0x7f656c0bbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0bc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c0bc920 con 0x7f656c068f30 2023-08-17T00:09:07.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656c1647d0 con 0x7f656c0a8e60 2023-08-17T00:09:07.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f656c152480 con 0x7f656c150880 2023-08-17T00:09:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6571c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 0x7f656c147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6571c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 0x7f656c147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57970/0 (socket says 172.21.15.153:57970) 2023-08-17T00:09:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6571c77700 1 -- 172.21.15.153:0/2051856857 learned_addr learned my addr 172.21.15.153:0/2051856857 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.505+0000 7f6572478700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0bc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571476700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f656c0a8e60 0x7f656c0bbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571c77700 1 -- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 msgr2=0x7f656c0bc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571c77700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0bc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571c77700 1 -- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f656c0a8e60 msgr2=0x7f656c0bbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571c77700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f656c0a8e60 0x7f656c0bbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571c77700 1 -- 172.21.15.153:0/2051856857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656800b5a0 con 0x7f656c068f30 2023-08-17T00:09:07.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6572478700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:07.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6571c77700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 0x7f656c147a90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f656c0669d0 tx=0x7f656800b300).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6561ffb700 1 -- 172.21.15.153:0/2051856857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656801d070 con 0x7f656c068f30 2023-08-17T00:09:07.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6561ffb700 1 -- 172.21.15.153:0/2051856857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568005880 con 0x7f656c068f30 2023-08-17T00:09:07.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6561ffb700 1 -- 172.21.15.153:0/2051856857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680106c0 con 0x7f656c068f30 2023-08-17T00:09:07.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656c152760 con 0x7f656c068f30 2023-08-17T00:09:07.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.509+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c152d20 con 0x7f656c068f30 2023-08-17T00:09:07.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f6561ffb700 1 -- 172.21.15.153:0/2051856857 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6568029070 con 0x7f656c068f30 2023-08-17T00:09:07.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f6561ffb700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f655005a180 0x7f655005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f6561ffb700 1 -- 172.21.15.153:0/2051856857 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f6568075460 con 0x7f656c068f30 2023-08-17T00:09:07.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f6571476700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f655005a180 0x7f655005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f657e25f740 1 Processor -- start 2023-08-17T00:09:07.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f6571476700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f655005a180 0x7f655005c640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f655c001110 tx=0x7f655c007ca0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.513+0000 7f657e25f740 1 -- start start 2023-08-17T00:09:07.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2a6b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f657e25f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2a6b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f657e25f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x29bc1a0 con 0x2a96090 2023-08-17T00:09:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a6ac80 con 0x2ab1c20 2023-08-17T00:09:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a6fe60 con 0x2a6f960 2023-08-17T00:09:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:42948/0 (socket says 172.21.15.153:42948) 2023-08-17T00:09:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 -- 172.21.15.153:0/1975650163 learned_addr learned my addr 172.21.15.153:0/1975650163 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6572478700 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2a6b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571476700 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2a6b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 -- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 msgr2=0x2a6b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2a6b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 -- 172.21.15.153:0/1975650163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 msgr2=0x2a6b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2a6b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 -- 172.21.15.153:0/1975650163 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29ea010 con 0x2ab1c20 2023-08-17T00:09:07.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571476700 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2a6b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:07.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f6571c77700 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab2000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f656804c8c0 tx=0x7f6568008040).ready entity=mon.1 client_cookie=a23b35fdb1c10760 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f654effd700 1 -- 172.21.15.153:0/1975650163 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656804ca40 con 0x2ab1c20 2023-08-17T00:09:07.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f654effd700 1 -- 172.21.15.153:0/1975650163 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680059f0 con 0x2ab1c20 2023-08-17T00:09:07.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.517+0000 7f654effd700 1 -- 172.21.15.153:0/1975650163 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65680491b0 con 0x2ab1c20 2023-08-17T00:09:07.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 -- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 msgr2=0x2ab2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab2000 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f656804c8c0 tx=0x7f6568008040).stop 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 -- 172.21.15.153:0/1975650163 shutdown_connections 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2a6b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2a6b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 --2- 172.21.15.153:0/1975650163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab2000 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 -- 172.21.15.153:0/1975650163 >> 172.21.15.153:0/1975650163 conn(0x284f680 msgr2=0x2a70a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 -- 172.21.15.153:0/1975650163 shutdown_connections 2023-08-17T00:09:07.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 -- 172.21.15.153:0/1975650163 wait complete. 2023-08-17T00:09:07.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 -- start start 2023-08-17T00:09:07.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.521+0000 7f657e25f740 1 Processor -- start 2023-08-17T00:09:07.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2ab0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2ac3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a93c70 con 0x2a96090 2023-08-17T00:09:07.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac3900 con 0x2ab1c20 2023-08-17T00:09:07.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aafba0 con 0x2a6f960 2023-08-17T00:09:07.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 10 client.0 ll_register_callbacks cb 0x2a27400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:07.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2ab0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2ab0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:34440/0 (socket says 172.21.15.153:34440) 2023-08-17T00:09:07.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 -- 172.21.15.153:0/3011269634 learned_addr learned my addr 172.21.15.153:0/3011269634 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571476700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2ac3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6572478700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 -- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 msgr2=0x2ab7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 -- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 msgr2=0x2ac3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2ac3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 -- 172.21.15.153:0/3011269634 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656c152d20 con 0x2a6f960 2023-08-17T00:09:07.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6571c77700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2ab0960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f656800b450 tx=0x7f656804f000).ready entity=mon.2 client_cookie=de4f4625d3d32d82 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6547fff700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2023-08-17T00:09:07.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6547fff700 1 -- 172.21.15.153:0/3011269634 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568031070 con 0x2a6f960 2023-08-17T00:09:07.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6547fff700 1 -- 172.21.15.153:0/3011269634 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f656804c1a0 con 0x2a6f960 2023-08-17T00:09:07.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29b8200 con 0x2a6f960 2023-08-17T00:09:07.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6547fff700 1 -- 172.21.15.153:0/3011269634 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f656804af10 con 0x2a6f960 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 10 client.6008 fetch_fsmap learned FSMap version 73 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x29e54b0 con 0x2a6f960 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6547fff700 1 -- 172.21.15.153:0/3011269634 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6568073d30 con 0x2a6f960 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f6547fff700 1 -- 172.21.15.153:0/3011269634 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6568048890 con 0x2a6f960 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 10 client.6008 fetch_fsmap finished waiting for FSMap version 73 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 10 client.6008 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:07.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 20 client.6008 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:07.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2ac4090 0x2ac4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 4 client.6008 mds_command: new command op to 6681 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:09:07.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.525+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x29b8200 con 0x2ac4090 2023-08-17T00:09:07.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f6571476700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2ac4090 0x2ac4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f6547fff700 10 client.6008 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f6571476700 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2ac4090 0x2ac4470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=444a2bf431efdd2d server_cookie=2538ea256245472c in_seq=0 out_seq=0 2023-08-17T00:09:07.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f6547fff700 1 -- 172.21.15.153:0/3011269634 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x29b8200 con 0x2ac4090 2023-08-17T00:09:07.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f6547fff700 10 client.6008 handle_command_reply: tid=0 2023-08-17T00:09:07.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 client.6008 shutdown 2023-08-17T00:09:07.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 msgr2=0x2ab0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2ab0960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f656800b450 tx=0x7f656804f000).stop 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 shutdown_connections 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2ac4090 0x2ac4470 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2ab7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a96090 0x2ac3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f6547fff700 0 client.6008 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 --2- 172.21.15.153:0/3011269634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a6f960 0x2ab0960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 >> 172.21.15.153:0/3011269634 conn(0x284f680 msgr2=0x2ab39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 shutdown_connections 2023-08-17T00:09:07.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 1 -- 172.21.15.153:0/3011269634 wait complete. 2023-08-17T00:09:07.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.529+0000 7f657e25f740 20 client.6008 trim_cache size 0 max 16384 2023-08-17T00:09:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 Processor -- start 2023-08-17T00:09:07.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 -- start start 2023-08-17T00:09:07.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 0x2a97f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab18f0 con 0x2a6f960 2023-08-17T00:09:07.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a6ee30 con 0x2ab1c20 2023-08-17T00:09:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a6f700 con 0x2a96090 2023-08-17T00:09:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 0x2a97f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 0x2a97f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:57992/0 (socket says 172.21.15.153:57992) 2023-08-17T00:09:07.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 -- 172.21.15.153:0/4230214675 learned_addr learned my addr 172.21.15.153:0/4230214675 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571476700 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6572478700 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 -- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 msgr2=0x2a941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 -- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 msgr2=0x2a94690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571c77700 1 -- 172.21.15.153:0/4230214675 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f656c062300 con 0x2a6f960 2023-08-17T00:09:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.557+0000 7f6571476700 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f6571c77700 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 0x2a97f50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f6568048fa0 tx=0x7f6568031000).ready entity=mon.0 client_cookie=9b475731e4403546 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f654f7fe700 1 -- 172.21.15.153:0/4230214675 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6568006b70 con 0x2a6f960 2023-08-17T00:09:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f654f7fe700 1 -- 172.21.15.153:0/4230214675 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656804ca40 con 0x2a6f960 2023-08-17T00:09:07.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f654f7fe700 1 -- 172.21.15.153:0/4230214675 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f656804abe0 con 0x2a6f960 2023-08-17T00:09:07.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- 172.21.15.153:0/4230214675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 msgr2=0x2a97f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 0x2a97f50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f6568048fa0 tx=0x7f6568031000).stop 2023-08-17T00:09:07.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- 172.21.15.153:0/4230214675 shutdown_connections 2023-08-17T00:09:07.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- 172.21.15.153:0/4230214675 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2a6f960 0x2a97f50 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- 172.21.15.153:0/4230214675 >> 172.21.15.153:0/4230214675 conn(0x284f680 msgr2=0x2a9c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- 172.21.15.153:0/4230214675 shutdown_connections 2023-08-17T00:09:07.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- 172.21.15.153:0/4230214675 wait complete. 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- start start 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 Processor -- start 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a6f960 0x2b13570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ac82c0 con 0x2ab1c20 2023-08-17T00:09:07.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab3250 con 0x2a6f960 2023-08-17T00:09:07.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a94b80 con 0x2a96090 2023-08-17T00:09:07.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f657e25f740 10 client.0 ll_register_callbacks cb 0x7f6568073930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:07.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f6572478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.561+0000 7f6572478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58008/0 (socket says 172.21.15.153:58008) 2023-08-17T00:09:07.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 -- 172.21.15.153:0/2412596812 learned_addr learned my addr 172.21.15.153:0/2412596812 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:07.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6571c77700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a6f960 0x2b13570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6571476700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 -- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 msgr2=0x2a941a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 -- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a6f960 msgr2=0x2b13570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:07.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a6f960 0x2b13570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 -- 172.21.15.153:0/2412596812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x29e54b0 con 0x2ab1c20 2023-08-17T00:09:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6571c77700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a6f960 0x2b13570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6572478700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 0x2a94690 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f6564017e90 tx=0x7f6564009040).ready entity=mon.0 client_cookie=c64cbe9a97bb840e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 1 -- 172.21.15.153:0/2412596812 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6564004030 con 0x2ab1c20 2023-08-17T00:09:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65680059f0 con 0x2ab1c20 2023-08-17T00:09:07.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 1 -- 172.21.15.153:0/2412596812 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f6564015e40 con 0x2ab1c20 2023-08-17T00:09:07.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 1 -- 172.21.15.153:0/2412596812 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6564003320 con 0x2ab1c20 2023-08-17T00:09:07.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 10 client.6891 fetch_fsmap learned FSMap version 73 2023-08-17T00:09:07.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x29e5200 con 0x2ab1c20 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 1 -- 172.21.15.153:0/2412596812 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65680059f0 con 0x2ab1c20 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 1 -- 172.21.15.153:0/2412596812 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 73) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6564012030 con 0x2ab1c20 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 10 client.6891 fetch_fsmap finished waiting for FSMap version 73 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 10 client.6891 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 20 client.6891 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2aca2d0 0x2aca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:07.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 4 client.6891 mds_command: new command op to 6681 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:09:07.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x29e6cf0 con 0x2aca2d0 2023-08-17T00:09:07.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6571c77700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2aca2d0 0x2aca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:07.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 10 client.6891 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6571c77700 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2aca2d0 0x2aca6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=57409c9d48d33e20 server_cookie=47da1b726118d6e6 in_seq=0 out_seq=0 2023-08-17T00:09:07.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 1 -- 172.21.15.153:0/2412596812 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+257 (crc 0 0 0) 0x29e6cf0 con 0x2aca2d0 2023-08-17T00:09:07.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 10 client.6891 handle_command_reply: tid=0 2023-08-17T00:09:07.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 client.6891 shutdown 2023-08-17T00:09:07.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 msgr2=0x2a94690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 0x2a94690 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f6564017e90 tx=0x7f6564009040).stop 2023-08-17T00:09:07.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 shutdown_connections 2023-08-17T00:09:07.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x2aca2d0 0x2aca6e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ab1c20 0x2a94690 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f6547fff700 0 client.6891 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:07.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a96090 0x2a941a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 --2- 172.21.15.153:0/2412596812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a6f960 0x2b13570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 >> 172.21.15.153:0/2412596812 conn(0x284f680 msgr2=0x2a9c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 shutdown_connections 2023-08-17T00:09:07.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.565+0000 7f657e25f740 1 -- 172.21.15.153:0/2412596812 wait complete. 2023-08-17T00:09:07.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f657e25f740 20 client.6891 trim_cache size 0 max 16384 2023-08-17T00:09:07.585 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:09:07.585 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:09:07.585 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:09:07.586 INFO:teuthology.orchestra.run.smithi153.stdout: "96d64253-2d8f-4e88-a154-ea46c5729b78": { 2023-08-17T00:09:07.586 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "~mds0", 2023-08-17T00:09:07.586 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "96d64253-2d8f-4e88-a154-ea46c5729b78", 2023-08-17T00:09:07.587 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive" 2023-08-17T00:09:07.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.587 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:07.587 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:09:07.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f655005a180 msgr2=0x7f655005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f655005a180 0x7f655005c640 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f655c001110 tx=0x7f655c007ca0).stop 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 msgr2=0x7f656c147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 0x7f656c147a90 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f656c0669d0 tx=0x7f656800b300).stop 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 shutdown_connections 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f655005a180 0x7f655005c640 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f656c150880 0x7f656c0bc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f656c0a8e60 0x7f656c0bbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 --2- 172.21.15.153:0/2051856857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f656c068f30 0x7f656c147a90 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:07.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 >> 172.21.15.153:0/2051856857 conn(0x7f656c0c6620 msgr2=0x7f656c14f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:07.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 shutdown_connections 2023-08-17T00:09:07.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:07.569+0000 7f6572c79700 1 -- 172.21.15.153:0/2051856857 wait complete. 2023-08-17T00:09:07.591 INFO:tasks.cephfs.filesystem:scrub status for tag:96d64253-2d8f-4e88-a154-ea46c5729b78 - {'path': '~mds0', 'tag': '96d64253-2d8f-4e88-a154-ea46c5729b78', 'options': 'recursive'} 2023-08-17T00:09:15.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:09:15.737 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:09:37.592 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-08-17T00:09:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.764+0000 7f33a5d47700 1 Processor -- start 2023-08-17T00:09:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.764+0000 7f33a5d47700 1 -- start start 2023-08-17T00:09:37.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5d47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33a00626b0 0x7f33a00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5d47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a00c7e00 con 0x7f33a00acb90 2023-08-17T00:09:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5d47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33a0153fa0 con 0x7f33a00acf70 2023-08-17T00:09:37.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5d47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a00c9420 con 0x7f33a00626b0 2023-08-17T00:09:37.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a4d45700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f33a00acb90 0x7f33a00ca0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37380/0 (socket says 172.21.15.153:37380) 2023-08-17T00:09:37.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a4d45700 1 -- 172.21.15.153:0/4252466208 learned_addr learned my addr 172.21.15.153:0/4252466208 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:37.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5546700 1 --2- 172.21.15.153:0/4252466208 >> v2:172.21.15.178:3300/0 conn(0x7f33a00626b0 0x7f33a00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207024473 0 0) 0x7f33a00c7e00 con 0x7f33a00acb90 2023-08-17T00:09:37.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33900033f0 con 0x7f33a00acb90 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440735741 0 0) 0x7f33a0153fa0 con 0x7f33a00acf70 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a00c7e00 con 0x7f33a00acf70 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5546700 1 -- 172.21.15.153:0/4252466208 >> v1:172.21.15.178:6789/0 conn(0x7f33a00acf70 legacy=0x7f33a0061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3920597287 0 0) 0x7f33900033f0 con 0x7f33a00acb90 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5546700 1 -- 172.21.15.153:0/4252466208 >> v1:172.21.15.153:6789/0 conn(0x7f33a00acb90 legacy=0x7f33a00ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.768+0000 7f33a5546700 1 -- 172.21.15.153:0/4252466208 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a00c9ab0 con 0x7f33a00626b0 2023-08-17T00:09:37.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5546700 1 --2- 172.21.15.153:0/4252466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00626b0 0x7f33a00c8f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f33a00c95c0 tx=0x7f3398009780).ready entity=mon.1 client_cookie=e61fcb434a37c88d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339800e070 con 0x7f33a00626b0 2023-08-17T00:09:37.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339800b7a0 con 0x7f33a00626b0 2023-08-17T00:09:37.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f339f7fe700 1 -- 172.21.15.153:0/4252466208 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394001470 con 0x7f33a00626b0 2023-08-17T00:09:37.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 -- 172.21.15.153:0/4252466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00626b0 msgr2=0x7f33a00c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 --2- 172.21.15.153:0/4252466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00626b0 0x7f33a00c8f30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f33a00c95c0 tx=0x7f3398009780).stop 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 -- 172.21.15.153:0/4252466208 shutdown_connections 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 --2- 172.21.15.153:0/4252466208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00626b0 0x7f33a00c8f30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 -- 172.21.15.153:0/4252466208 >> 172.21.15.153:0/4252466208 conn(0x7f33a00cb380 msgr2=0x7f33a00c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 -- 172.21.15.153:0/4252466208 shutdown_connections 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.772+0000 7f33a5d47700 1 -- 172.21.15.153:0/4252466208 wait complete. 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 Processor -- start 2023-08-17T00:09:37.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 -- start start 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 0x7f33a01472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00acb90 0x7f33a00c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00acf70 0x7f33a00c0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a00c1360 con 0x7f33a00626b0 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0163cb0 con 0x7f33a00acf70 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a0163f90 con 0x7f33a00acb90 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 0x7f33a01472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 0x7f33a01472a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37536/0 (socket says 172.21.15.153:37536) 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a4d45700 1 -- 172.21.15.153:0/2570344441 learned_addr learned my addr 172.21.15.153:0/2570344441 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f33a5546700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00acf70 0x7f33a00c0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.776+0000 7f339ffff700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00acb90 0x7f33a00c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a4d45700 1 -- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00acb90 msgr2=0x7f33a00c0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a4d45700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00acb90 0x7f33a00c0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a4d45700 1 -- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00acf70 msgr2=0x7f33a00c0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a4d45700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00acf70 0x7f33a00c0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a4d45700 1 -- 172.21.15.153:0/2570344441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398009a20 con 0x7f33a00626b0 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a4d45700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 0x7f33a01472a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f339400c800 tx=0x7f3394001b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f339cff9700 1 -- 172.21.15.153:0/2570344441 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394007170 con 0x7f33a00626b0 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f339cff9700 1 -- 172.21.15.153:0/2570344441 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33940072d0 con 0x7f33a00626b0 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a0164270 con 0x7f33a00626b0 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f339cff9700 1 -- 172.21.15.153:0/2570344441 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33940048c0 con 0x7f33a00626b0 2023-08-17T00:09:37.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.780+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a0164830 con 0x7f33a00626b0 2023-08-17T00:09:37.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.784+0000 7f339cff9700 1 -- 172.21.15.153:0/2570344441 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f339401b070 con 0x7f33a00626b0 2023-08-17T00:09:37.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f339cff9700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f338405a150 0x7f338405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f339cff9700 1 -- 172.21.15.153:0/2570344441 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f3394073a70 con 0x7f33a00626b0 2023-08-17T00:09:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 Processor -- start 2023-08-17T00:09:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 -- start start 2023-08-17T00:09:37.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f339ffff700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f338405a150 0x7f338405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0x1037000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf411a0 con 0x1036c20 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfefc80 con 0x101b090 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xff4e60 con 0xff4960 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f339ffff700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f338405a150 0x7f338405c610 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f33a00a9640 tx=0x7f338c007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0x1037000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0x1037000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37540/0 (socket says 172.21.15.153:37540) 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 -- 172.21.15.153:0/3553476309 learned_addr learned my addr 172.21.15.153:0/3553476309 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f339ffff700 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a5546700 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 -- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 msgr2=0xff0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 -- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 msgr2=0xff0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 -- 172.21.15.153:0/3553476309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf6f010 con 0x1036c20 2023-08-17T00:09:37.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f33a4d45700 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0x1037000 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f339404afc0 tx=0x7f3394001e90).ready entity=mon.0 client_cookie=2a5106cd31e78cf6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f3389ffb700 1 -- 172.21.15.153:0/3553476309 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394055070 con 0x1036c20 2023-08-17T00:09:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f3389ffb700 1 -- 172.21.15.153:0/3553476309 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33940477a0 con 0x1036c20 2023-08-17T00:09:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.788+0000 7f3389ffb700 1 -- 172.21.15.153:0/3553476309 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394004e40 con 0x1036c20 2023-08-17T00:09:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- 172.21.15.153:0/3553476309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 msgr2=0x1037000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0x1037000 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f339404afc0 tx=0x7f3394001e90).stop 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- 172.21.15.153:0/3553476309 shutdown_connections 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- 172.21.15.153:0/3553476309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0x1037000 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- 172.21.15.153:0/3553476309 >> 172.21.15.153:0/3553476309 conn(0xdd4680 msgr2=0xff5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- 172.21.15.153:0/3553476309 shutdown_connections 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- 172.21.15.153:0/3553476309 wait complete. 2023-08-17T00:09:37.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- start start 2023-08-17T00:09:37.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 Processor -- start 2023-08-17T00:09:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 0x101a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0x104c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1036c20 0x101dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1034330 con 0xff4960 2023-08-17T00:09:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x101bb10 con 0x101b090 2023-08-17T00:09:37.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x101bd50 con 0x1036c20 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.792+0000 7f33b1361740 10 client.0 ll_register_callbacks cb 0xfac400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 0x101a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 0x101a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37550/0 (socket says 172.21.15.153:37550) 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 -- 172.21.15.153:0/611339837 learned_addr learned my addr 172.21.15.153:0/611339837 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f339ffff700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0x104c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a5546700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1036c20 0x101dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 -- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1036c20 msgr2=0x101dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1036c20 0x101dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 -- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 msgr2=0x104c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0x104c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 -- 172.21.15.153:0/611339837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a0164830 con 0xff4960 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33a4d45700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 0x101a6b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f339404ab60 tx=0x7f3394057000).ready entity=mon.0 client_cookie=930ba8d178c5ed6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:37.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 1 -- 172.21.15.153:0/611339837 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394047090 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 1 -- 172.21.15.153:0/611339837 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f3394015cb0 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf3d200 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 1 -- 172.21.15.153:0/611339837 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3394015e70 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 10 client.6903 fetch_fsmap learned FSMap version 77 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xf6a4b0 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 1 -- 172.21.15.153:0/611339837 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf3d200 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 1 -- 172.21.15.153:0/611339837 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3394065030 con 0xff4960 2023-08-17T00:09:37.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 10 client.6903 fetch_fsmap finished waiting for FSMap version 77 2023-08-17T00:09:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 10 client.6903 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 20 client.6903 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x10485c0 0x10489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 4 client.6903 mds_command: new command op to 6681 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:09:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf6bcf0 con 0x10485c0 2023-08-17T00:09:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f339ffff700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x10485c0 0x10489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f339ffff700 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x10485c0 0x10489d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1e22cf470621a016 server_cookie=78e5bb2f0132ecd7 in_seq=0 out_seq=0 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.796+0000 7f337effd700 10 client.6903 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f337effd700 1 -- 172.21.15.153:0/611339837 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xf6bcf0 con 0x10485c0 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f337effd700 10 client.6903 handle_command_reply: tid=0 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 client.6903 shutdown 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 msgr2=0x101a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 0x101a6b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f339404ab60 tx=0x7f3394057000).stop 2023-08-17T00:09:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 shutdown_connections 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x10485c0 0x10489d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1036c20 0x101dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f337effd700 0 client.6903 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0x104c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 --2- 172.21.15.153:0/611339837 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xff4960 0x101a6b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 >> 172.21.15.153:0/611339837 conn(0xdd4680 msgr2=0xff02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 shutdown_connections 2023-08-17T00:09:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 1 -- 172.21.15.153:0/611339837 wait complete. 2023-08-17T00:09:37.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.800+0000 7f33b1361740 20 client.6903 trim_cache size 0 max 16384 2023-08-17T00:09:37.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 Processor -- start 2023-08-17T00:09:37.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 -- start start 2023-08-17T00:09:37.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xff3600 con 0x1036c20 2023-08-17T00:09:37.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbb540 con 0x101b090 2023-08-17T00:09:37.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.816+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xfb8240 con 0xff4960 2023-08-17T00:09:37.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a5546700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a5546700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37558/0 (socket says 172.21.15.153:37558) 2023-08-17T00:09:37.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a5546700 1 -- 172.21.15.153:0/1613702483 learned_addr learned my addr 172.21.15.153:0/1613702483 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:37.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f339ffff700 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 -- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 msgr2=0xff02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 -- 172.21.15.153:0/1613702483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 msgr2=0xfeea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 -- 172.21.15.153:0/1613702483 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf6a200 con 0xff4960 2023-08-17T00:09:37.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33a4d45700 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff3110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f339404aa10 tx=0x7f339405e000).ready entity=mon.2 client_cookie=153726b55ac06861 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f338a7fc700 1 -- 172.21.15.153:0/1613702483 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394047090 con 0xff4960 2023-08-17T00:09:37.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f338a7fc700 1 -- 172.21.15.153:0/1613702483 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3394049430 con 0xff4960 2023-08-17T00:09:37.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f338a7fc700 1 -- 172.21.15.153:0/1613702483 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394004a20 con 0xff4960 2023-08-17T00:09:37.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 -- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 msgr2=0xff3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff3110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f339404aa10 tx=0x7f339405e000).stop 2023-08-17T00:09:37.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 -- 172.21.15.153:0/1613702483 shutdown_connections 2023-08-17T00:09:37.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101b090 0xff02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 --2- 172.21.15.153:0/1613702483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0xff3110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 -- 172.21.15.153:0/1613702483 >> 172.21.15.153:0/1613702483 conn(0xdd4680 msgr2=0xff4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:37.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 -- 172.21.15.153:0/1613702483 shutdown_connections 2023-08-17T00:09:37.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 -- 172.21.15.153:0/1613702483 wait complete. 2023-08-17T00:09:37.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 -- start start 2023-08-17T00:09:37.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.820+0000 7f33b1361740 1 Processor -- start 2023-08-17T00:09:37.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0x1099250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 0x1084a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x109fae0 con 0x101b090 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x103c6f0 con 0x1036c20 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1084f00 con 0xff4960 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 10 client.0 ll_register_callbacks cb 0x7f3394053020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 0x1084a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33a4d45700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0x1099250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 0x1084a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37572/0 (socket says 172.21.15.153:37572) 2023-08-17T00:09:37.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 -- 172.21.15.153:0/129940371 learned_addr learned my addr 172.21.15.153:0/129940371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33a5546700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 -- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 msgr2=0x1099250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0x1099250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 -- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1036c20 msgr2=0xfeea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 -- 172.21.15.153:0/129940371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf6a4b0 con 0x101b090 2023-08-17T00:09:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33a4d45700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0x1099250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f339ffff700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 0x1084a10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f338c007fd0 tx=0x7f338c00c000).ready entity=mon.0 client_cookie=a18184abf656ceed server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f337effd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f337effd700 1 -- 172.21.15.153:0/129940371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c029070 con 0x101b090 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f337effd700 1 -- 172.21.15.153:0/129940371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f338c016660 con 0x101b090 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33940477a0 con 0x101b090 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f337effd700 1 -- 172.21.15.153:0/129940371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f338c016a30 con 0x101b090 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 10 client.6909 fetch_fsmap learned FSMap version 77 2023-08-17T00:09:37.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xe72980 con 0x101b090 2023-08-17T00:09:37.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.824+0000 7f337effd700 1 -- 172.21.15.153:0/129940371 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33940477a0 con 0x101b090 2023-08-17T00:09:37.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f337effd700 1 -- 172.21.15.153:0/129940371 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f338c016b90 con 0x101b090 2023-08-17T00:09:37.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 10 client.6909 fetch_fsmap finished waiting for FSMap version 77 2023-08-17T00:09:37.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 10 client.6909 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 20 client.6909 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1019780 0xfeef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 4 client.6909 mds_command: new command op to 6681 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xf62240 con 0x1019780 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a4d45700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1019780 0xfeef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a4d45700 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1019780 0xfeef80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b89df215b08c06ec server_cookie=985bf256179876af in_seq=0 out_seq=0 2023-08-17T00:09:37.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f337effd700 10 client.6909 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f337effd700 1 -- 172.21.15.153:0/129940371 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xf62240 con 0x1019780 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f337effd700 10 client.6909 handle_command_reply: tid=0 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 client.6909 shutdown 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 msgr2=0x1084a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 0x1084a10 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f338c007fd0 tx=0x7f338c00c000).stop 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 shutdown_connections 2023-08-17T00:09:37.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0x1019780 0xfeef80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1036c20 0xfeea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101b090 0x1084a10 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 --2- 172.21.15.153:0/129940371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xff4960 0x1099250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f337effd700 0 client.6909 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 >> 172.21.15.153:0/129940371 conn(0xdd4680 msgr2=0x1038cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 shutdown_connections 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 1 -- 172.21.15.153:0/129940371 wait complete. 2023-08-17T00:09:37.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33b1361740 20 client.6909 trim_cache size 0 max 16384 2023-08-17T00:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:09:37.840 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:09:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f338405a150 msgr2=0x7f338405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f338405a150 0x7f338405c610 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f33a00a9640 tx=0x7f338c007bd0).stop 2023-08-17T00:09:37.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 msgr2=0x7f33a01472a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 0x7f33a01472a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7f339400c800 tx=0x7f3394001b50).stop 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 shutdown_connections 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f338405a150 0x7f338405c610 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33a00acf70 0x7f33a00c0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33a00acb90 0x7f33a00c0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 --2- 172.21.15.153:0/2570344441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33a00626b0 0x7f33a01472a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:37.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 >> 172.21.15.153:0/2570344441 conn(0x7f33a00cb380 msgr2=0x7f33a0061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 shutdown_connections 2023-08-17T00:09:37.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:37.828+0000 7f33a5d47700 1 -- 172.21.15.153:0/2570344441 wait complete. 2023-08-17T00:09:37.855 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:09:37.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2023-08-17T00:09:38.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.020+0000 7ff136079700 1 Processor -- start 2023-08-17T00:09:38.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.020+0000 7ff136079700 1 -- start start 2023-08-17T00:09:38.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff136079700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1300acf30 0x7ff1300c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff136079700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff130154e90 con 0x7ff130063bc0 2023-08-17T00:09:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff136079700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff130153fc0 con 0x7ff1300c5ea0 2023-08-17T00:09:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff136079700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff130154280 con 0x7ff1300acf30 2023-08-17T00:09:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff135878700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff130063bc0 0x7ff1300bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37388/0 (socket says 172.21.15.153:37388) 2023-08-17T00:09:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff135878700 1 -- 172.21.15.153:0/1311045075 learned_addr learned my addr 172.21.15.153:0/1311045075 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff135077700 1 --2- 172.21.15.153:0/1311045075 >> v2:172.21.15.178:3300/0 conn(0x7ff1300acf30 0x7ff1300c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1327084392 0 0) 0x7ff130154e90 con 0x7ff130063bc0 2023-08-17T00:09:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff11c0033f0 con 0x7ff130063bc0 2023-08-17T00:09:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1595877163 0 0) 0x7ff11c0033f0 con 0x7ff130063bc0 2023-08-17T00:09:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 >> v2:172.21.15.178:3300/0 conn(0x7ff1300acf30 msgr2=0x7ff1300c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 --2- 172.21.15.153:0/1311045075 >> v2:172.21.15.178:3300/0 conn(0x7ff1300acf30 0x7ff1300c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 >> v1:172.21.15.178:6789/0 conn(0x7ff1300c5ea0 legacy=0x7ff1300634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff130154560 con 0x7ff130063bc0 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7ff1280017f0 con 0x7ff130063bc0 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 >> v1:172.21.15.153:6789/0 conn(0x7ff130063bc0 legacy=0x7ff1300bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c0038e0 0x7ff11c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff11c004690 0x7ff11c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff11c005050 0x7ff11c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff130154280 con 0x7ff11c005050 2023-08-17T00:09:38.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c00bfe0 con 0x7ff11c004690 2023-08-17T00:09:38.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff11c00c1a0 con 0x7ff11c0038e0 2023-08-17T00:09:38.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff135077700 1 --2- 172.21.15.153:0/1311045075 >> v2:172.21.15.178:3300/0 conn(0x7ff1300acf30 0x7ff1300c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:38.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff135878700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff11c005050 0x7ff11c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff135077700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c0038e0 0x7ff11c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.024+0000 7ff134876700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff11c004690 0x7ff11c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 -- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c0038e0 msgr2=0x7ff11c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c0038e0 0x7ff11c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 -- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff11c004690 msgr2=0x7ff11c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff11c004690 0x7ff11c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 -- 172.21.15.153:0/1311045075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0033f0 con 0x7ff11c005050 2023-08-17T00:09:38.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 -- 172.21.15.153:0/1311045075 reap_dead start 2023-08-17T00:09:38.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff135878700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff11c005050 0x7ff11c00b8e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7ff12800c450 tx=0x7ff12800c760).ready entity=mon.0 client_cookie=1d750a0ae7f8e80c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128002030 con 0x7ff11c005050 2023-08-17T00:09:38.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800cdf0 con 0x7ff11c005050 2023-08-17T00:09:38.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff127fff700 1 -- 172.21.15.153:0/1311045075 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128005d30 con 0x7ff11c005050 2023-08-17T00:09:38.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 -- 172.21.15.153:0/1311045075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff11c005050 msgr2=0x7ff11c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff11c005050 0x7ff11c00b8e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7ff12800c450 tx=0x7ff12800c760).stop 2023-08-17T00:09:38.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 -- 172.21.15.153:0/1311045075 shutdown_connections 2023-08-17T00:09:38.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 --2- 172.21.15.153:0/1311045075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff11c005050 0x7ff11c00b8e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 -- 172.21.15.153:0/1311045075 >> 172.21.15.153:0/1311045075 conn(0x7ff1300cb330 msgr2=0x7ff1300c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 -- 172.21.15.153:0/1311045075 shutdown_connections 2023-08-17T00:09:38.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.028+0000 7ff136079700 1 -- 172.21.15.153:0/1311045075 wait complete. 2023-08-17T00:09:38.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 Processor -- start 2023-08-17T00:09:38.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 -- start start 2023-08-17T00:09:38.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c005050 0x7ff1300c4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 0x7ff130151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1300ad9a0 0x7ff1300ade20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c4a50 con 0x7ff1300a9330 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c1930 con 0x7ff1300ad9a0 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff136079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1300c24b0 con 0x7ff11c005050 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 0x7ff130151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 0x7ff130151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37588/0 (socket says 172.21.15.153:37588) 2023-08-17T00:09:38.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 -- 172.21.15.153:0/1662054783 learned_addr learned my addr 172.21.15.153:0/1662054783 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff135878700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1300ad9a0 0x7ff1300ade20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff135077700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c005050 0x7ff1300c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 -- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c005050 msgr2=0x7ff1300c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c005050 0x7ff1300c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 -- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1300ad9a0 msgr2=0x7ff1300ade20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1300ad9a0 0x7ff1300ade20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 -- 172.21.15.153:0/1662054783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300c1b80 con 0x7ff1300a9330 2023-08-17T00:09:38.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff134876700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 0x7ff130151790 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7ff1200028f0 tx=0x7ff120007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.032+0000 7ff1257fa700 1 -- 172.21.15.153:0/1662054783 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120003280 con 0x7ff1300a9330 2023-08-17T00:09:38.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.036+0000 7ff1257fa700 1 -- 172.21.15.153:0/1662054783 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff120011590 con 0x7ff1300a9330 2023-08-17T00:09:38.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.036+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1300c1e60 con 0x7ff1300a9330 2023-08-17T00:09:38.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.036+0000 7ff1257fa700 1 -- 172.21.15.153:0/1662054783 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120011910 con 0x7ff1300a9330 2023-08-17T00:09:38.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.036+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1300a97b0 con 0x7ff1300a9330 2023-08-17T00:09:38.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.036+0000 7ff1257fa700 1 -- 172.21.15.153:0/1662054783 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff12001a030 con 0x7ff1300a9330 2023-08-17T00:09:38.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.040+0000 7ff1257fa700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff11405a150 0x7ff11405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.040+0000 7ff1257fa700 1 -- 172.21.15.153:0/1662054783 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff120073960 con 0x7ff1300a9330 2023-08-17T00:09:38.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.040+0000 7ff135077700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff11405a150 0x7ff11405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.040+0000 7ff135077700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff11405a150 0x7ff11405c610 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7ff12c00b0b0 tx=0x7ff12c00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.040+0000 7ff141666740 1 Processor -- start 2023-08-17T00:09:38.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.040+0000 7ff141666740 1 -- start start 2023-08-17T00:09:38.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2d7a0 0xf2a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf2a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xe7a160 con 0xf712f0 2023-08-17T00:09:38.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe9aff0 con 0xf2d7a0 2023-08-17T00:09:38.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf6fc60 con 0xf2dc20 2023-08-17T00:09:38.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37604/0 (socket says 172.21.15.153:37604) 2023-08-17T00:09:38.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 -- 172.21.15.153:0/673445168 learned_addr learned my addr 172.21.15.153:0/673445168 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:38.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff134876700 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2d7a0 0xf2a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135878700 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf2a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 -- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 msgr2=0xf2a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf2a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 -- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2d7a0 msgr2=0xf2a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2d7a0 0xf2a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 -- 172.21.15.153:0/673445168 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xea7fd0 con 0xf712f0 2023-08-17T00:09:38.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff134876700 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2d7a0 0xf2a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:38.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff135077700 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf716d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff12c013a90 tx=0x7ff12c018000).ready entity=mon.0 client_cookie=b8c9efa94005ce3c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff11a7fc700 1 -- 172.21.15.153:0/673445168 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c024070 con 0xf712f0 2023-08-17T00:09:38.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff11a7fc700 1 -- 172.21.15.153:0/673445168 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c015ac0 con 0xf712f0 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff11a7fc700 1 -- 172.21.15.153:0/673445168 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c015e40 con 0xf712f0 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- 172.21.15.153:0/673445168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 msgr2=0xf716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf716d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff12c013a90 tx=0x7ff12c018000).stop 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- 172.21.15.153:0/673445168 shutdown_connections 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf2a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2d7a0 0xf2a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 --2- 172.21.15.153:0/673445168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf716d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- 172.21.15.153:0/673445168 >> 172.21.15.153:0/673445168 conn(0xd0d640 msgr2=0xf2e200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- 172.21.15.153:0/673445168 shutdown_connections 2023-08-17T00:09:38.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.044+0000 7ff141666740 1 -- 172.21.15.153:0/673445168 wait complete. 2023-08-17T00:09:38.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 -- start start 2023-08-17T00:09:38.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 Processor -- start 2023-08-17T00:09:38.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf2ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf50c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf712f0 0xf58c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf59a00 con 0xf2d7a0 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf59ce0 con 0xf2dc20 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf80660 con 0xf712f0 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff141666740 10 client.0 ll_register_callbacks cb 0xee5440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:38.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff135077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf2ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff135077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf2ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37620/0 (socket says 172.21.15.153:37620) 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff135077700 1 -- 172.21.15.153:0/696770608 learned_addr learned my addr 172.21.15.153:0/696770608 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff134876700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf50c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.048+0000 7ff135878700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf712f0 0xf58c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135077700 1 -- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf712f0 msgr2=0xf58c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135077700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf712f0 0xf58c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135077700 1 -- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 msgr2=0xf50c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135077700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf50c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135077700 1 -- 172.21.15.153:0/696770608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12c00e040 con 0xf2d7a0 2023-08-17T00:09:38.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135878700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf712f0 0xf58c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:38.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff135077700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf2ad00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7ff12c006e00 tx=0x7ff12c022000).ready entity=mon.0 client_cookie=146410499942a850 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 1 -- 172.21.15.153:0/696770608 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c024070 con 0xf2d7a0 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 1 -- 172.21.15.153:0/696770608 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff12c020b60 con 0xf2d7a0 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xea4cb0 con 0xf2d7a0 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 1 -- 172.21.15.153:0/696770608 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff12c020d20 con 0xf2d7a0 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 10 client.6921 fetch_fsmap learned FSMap version 77 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xea3470 con 0xf2d7a0 2023-08-17T00:09:38.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 1 -- 172.21.15.153:0/696770608 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xea4cb0 con 0xf2d7a0 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 1 -- 172.21.15.153:0/696770608 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff12c01d030 con 0xf2d7a0 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 10 client.6921 fetch_fsmap finished waiting for FSMap version 77 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 10 client.6921 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 20 client.6921 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xf54780 0xf54b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 4 client.6921 mds_command: new command op to 6681 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe9b200 con 0xf54780 2023-08-17T00:09:38.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff134876700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xf54780 0xf54b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff134876700 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xf54780 0xf54b60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cef21d2fb6ef22fe server_cookie=2ddea6d2b1baa2b2 in_seq=0 out_seq=0 2023-08-17T00:09:38.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.052+0000 7ff10f7fe700 10 client.6921 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff10f7fe700 1 -- 172.21.15.153:0/696770608 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xe9b200 con 0xf54780 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff10f7fe700 10 client.6921 handle_command_reply: tid=0 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 client.6921 shutdown 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 msgr2=0xf2ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf2ad00 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7ff12c006e00 tx=0x7ff12c022000).stop 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 shutdown_connections 2023-08-17T00:09:38.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xf54780 0xf54b60 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf712f0 0xf58c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf50c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 --2- 172.21.15.153:0/696770608 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf2ad00 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 >> 172.21.15.153:0/696770608 conn(0xd0d640 msgr2=0xf26940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff10f7fe700 0 client.6921 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 shutdown_connections 2023-08-17T00:09:38.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 1 -- 172.21.15.153:0/696770608 wait complete. 2023-08-17T00:09:38.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.056+0000 7ff141666740 20 client.6921 trim_cache size 0 max 16384 2023-08-17T00:09:38.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.072+0000 7ff141666740 1 Processor -- start 2023-08-17T00:09:38.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.072+0000 7ff141666740 1 -- start start 2023-08-17T00:09:38.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff141666740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf52b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf57f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf712f0 0xf26af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff141666740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf29530 con 0xf2d7a0 2023-08-17T00:09:38.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe83e80 con 0xf712f0 2023-08-17T00:09:38.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf7daf0 con 0xf2dc20 2023-08-17T00:09:38.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf52b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf52b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37622/0 (socket says 172.21.15.153:37622) 2023-08-17T00:09:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 -- 172.21.15.153:0/2524140877 learned_addr learned my addr 172.21.15.153:0/2524140877 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff134876700 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf57f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135878700 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf712f0 0xf26af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 -- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 msgr2=0xf57f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf57f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 -- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf712f0 msgr2=0xf26af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf712f0 0xf26af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 -- 172.21.15.153:0/2524140877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1300abee0 con 0xf2d7a0 2023-08-17T00:09:38.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135878700 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf712f0 0xf26af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:38.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff135077700 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf52b30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7ff12c015700 tx=0x7ff12c02e070).ready entity=mon.0 client_cookie=3be47af8baf9b7b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff11affd700 1 -- 172.21.15.153:0/2524140877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c024070 con 0xf2d7a0 2023-08-17T00:09:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff11affd700 1 -- 172.21.15.153:0/2524140877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c030070 con 0xf2d7a0 2023-08-17T00:09:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.076+0000 7ff11affd700 1 -- 172.21.15.153:0/2524140877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c020b60 con 0xf2d7a0 2023-08-17T00:09:38.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 -- 172.21.15.153:0/2524140877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 msgr2=0xf52b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf52b30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7ff12c015700 tx=0x7ff12c02e070).stop 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 -- 172.21.15.153:0/2524140877 shutdown_connections 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf712f0 0xf26af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2dc20 0xf57f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 --2- 172.21.15.153:0/2524140877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf2d7a0 0xf52b30 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 -- 172.21.15.153:0/2524140877 >> 172.21.15.153:0/2524140877 conn(0xd0d640 msgr2=0xf2e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 -- 172.21.15.153:0/2524140877 shutdown_connections 2023-08-17T00:09:38.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 -- 172.21.15.153:0/2524140877 wait complete. 2023-08-17T00:09:38.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 -- start start 2023-08-17T00:09:38.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.080+0000 7ff141666740 1 Processor -- start 2023-08-17T00:09:38.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2d7a0 0xfd2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf57a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf58430 con 0xf712f0 2023-08-17T00:09:38.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfdfc10 con 0xf2dc20 2023-08-17T00:09:38.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xfd53c0 con 0xf2d7a0 2023-08-17T00:09:38.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 10 client.0 ll_register_callbacks cb 0x7ff12c006f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:09:38.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135077700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2d7a0 0xfd2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135077700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2d7a0 0xfd2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:40664/0 (socket says 172.21.15.153:40664) 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff134876700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf57a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135077700 1 -- 172.21.15.153:0/2833776889 learned_addr learned my addr 172.21.15.153:0/2833776889 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 -- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2d7a0 msgr2=0xfd2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2d7a0 0xfd2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 -- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 msgr2=0xf57a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf57a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 -- 172.21.15.153:0/2833776889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff11c0033f0 con 0xf712f0 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff134876700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf57a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff135878700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf57f40 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7ff130063400 tx=0x7ff128015000).ready entity=mon.0 client_cookie=5a15f840c86468cb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff10f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff10f7fe700 1 -- 172.21.15.153:0/2833776889 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280074f0 con 0xf712f0 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff10f7fe700 1 -- 172.21.15.153:0/2833776889 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff128024cf0 con 0xf712f0 2023-08-17T00:09:38.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff12c015ac0 con 0xf712f0 2023-08-17T00:09:38.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff10f7fe700 1 -- 172.21.15.153:0/2833776889 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff128024eb0 con 0xf712f0 2023-08-17T00:09:38.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 10 client.6927 fetch_fsmap learned FSMap version 77 2023-08-17T00:09:38.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.084+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0xea3470 con 0xf712f0 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff10f7fe700 1 -- 172.21.15.153:0/2833776889 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c015ac0 con 0xf712f0 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff10f7fe700 1 -- 172.21.15.153:0/2833776889 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff128007860 con 0xf712f0 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 10 client.6927 fetch_fsmap finished waiting for FSMap version 77 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 10 client.6927 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 20 client.6927 populate_metadata read hostname 'smithi153' 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xfc4780 0xf74640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 4 client.6927 mds_command: new command op to 6681 tid=0[{"prefix": "perf dump"}] 2023-08-17T00:09:38.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 --> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0xd645d0 con 0xfc4780 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff135077700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xfc4780 0xf74640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff135077700 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xfc4780 0xf74640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=623227480c9adfc8 server_cookie=6daad2a69d2dd05d in_seq=0 out_seq=0 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff10f7fe700 10 client.6927 ms_handle_connect on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff10f7fe700 1 -- 172.21.15.153:0/2833776889 <== mds.0 v2:172.21.15.153:6834/2081650727 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17059 (crc 0 0 0) 0xd645d0 con 0xfc4780 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff10f7fe700 10 client.6927 handle_command_reply: tid=0 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 client.6927 shutdown 2023-08-17T00:09:38.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 msgr2=0xf57f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf57f40 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7ff130063400 tx=0x7ff128015000).stop 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 shutdown_connections 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:6834/2081650727,v1:172.21.15.153:6835/2081650727] conn(0xfc4780 0xf74640 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf712f0 0xf57f40 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf2dc20 0xf57a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 --2- 172.21.15.153:0/2833776889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf2d7a0 0xfd2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff10f7fe700 0 client.6927 ms_handle_reset on v2:172.21.15.153:6834/2081650727 2023-08-17T00:09:38.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 >> 172.21.15.153:0/2833776889 conn(0xd0d640 msgr2=0xf52820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 shutdown_connections 2023-08-17T00:09:38.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 1 -- 172.21.15.153:0/2833776889 wait complete. 2023-08-17T00:09:38.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.088+0000 7ff141666740 20 client.6927 trim_cache size 0 max 16384 2023-08-17T00:09:38.099 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:09:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-0": { 2023-08-17T00:09:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 5131, 2023-08-17T00:09:38.099 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 5130, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1498297, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 36270230, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 17, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 6, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.907696280, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.435099092, 2023-08-17T00:09:38.100 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.122624891, 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.284567949, 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5129, 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 6.465981050, 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001260670 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:09:38.101 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 10, 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000001970, 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000197 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-1": { 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 5343, 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 5371, 2023-08-17T00:09:38.102 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 1958166, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 25069300, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 6, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 0.687834464, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 0.325057823, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 0.129335495, 2023-08-17T00:09:38.103 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.175212558, 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5370, 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.886621940, 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000351326 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.104 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "AsyncMessenger::Worker-2": { 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_messages": 33210, 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages": 55876, 2023-08-17T00:09:38.105 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_recv_bytes": 11209952, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_bytes": 58435473, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_created_connections": 7, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_active_connections": 4, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_total_time": 10.349214154, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_send_time": 8.437265901, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_recv_time": 1.961810178, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_running_fast_dispatch_time": 0.248396292, 2023-08-17T00:09:38.106 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_send_messages_queue_lat": { 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 55875, 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 4.219928022, 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000075524 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "msgr_handle_ack_lat": { 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 49751, 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.015120139, 2023-08-17T00:09:38.107 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000303 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: "cct": { 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: "total_workers": 1, 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: "unhealthy_workers": 0 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.108 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-MDSRank": { 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 5581, 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 20.437149527, 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003661915 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.109 INFO:teuthology.orchestra.run.smithi153.stdout: "finisher-PurgeQueue": { 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: "queue_len": 0, 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: "complete_latency": { 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 3421, 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1.963485327, 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000573950 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.110 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": { 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: "request": 27947, 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: "reply": 27947, 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: "reply_latency": { 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 27947, 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1146.445712736, 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.041022138 2023-08-17T00:09:38.111 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "slow_reply": 0, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "forward": 0, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_fetch": 0, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_commit": 64, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_split": 0, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "dir_merge": 0, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes": 7998, 2023-08-17T00:09:38.112 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_top": 5590, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_bottom": 2408, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pin_tail": 0, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_pinned": 11, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_expired": 8001, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "inodes_with_caps": 2, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": 2, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "subtrees": 2, 2023-08-17T00:09:38.113 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse": 161653, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_hit": 158297, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_forward": 0, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_discover": 0, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_dir_fetch": 0, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_remote_ino": 0, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "traverse_lock": 2164, 2023-08-17T00:09:38.114 INFO:teuthology.orchestra.run.smithi153.stdout: "load_cent": 33391, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "q": 0, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "exported": 0, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "exported_inodes": 0, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "imported": 0, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "imported_inodes": 0, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_dir_fetch": 0, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_backtrace_fetch": 1394, 2023-08-17T00:09:38.115 INFO:teuthology.orchestra.run.smithi153.stdout: "openino_peer_discover": 0, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rfiles": 0, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rbytes": 0, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "root_rsnaps": 0, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_fetch": 1394, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_set_tag": 0, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_backtrace_repaired": 0, 2023-08-17T00:09:38.116 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_inotable_repaired": 0, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_inodes": 11, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dir_base_inodes": 1, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_dirfrag_rstats": 10, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_file_inodes": 1383, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_inode_file_caps": 0, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_revoke": 2185, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_grant": 5831, 2023-08-17T00:09:38.117 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_trunc": 0, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "ceph_cap_op_flush_ack": 0, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps": 5155, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_caps_dirty": 2000, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_cap_release": 67, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "process_request_cap_release": 13870 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.118 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_cache": { 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays": 0, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_delayed": 0, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "num_strays_enqueuing": 0, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_created": 4270, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_enqueued": 3716, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_reintegrated": 4597, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "strays_migrated": 0, 2023-08-17T00:09:38.119 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_processing": 0, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_enqueued": 0, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "num_recovering_prioritized": 0, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_started": 0, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "recovery_completed": 0, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_enqueue_scrub": 1, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_exportdir": 0, 2023-08-17T00:09:38.120 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_flush": 0, 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragmentdir": 0, 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_fragstats": 0, 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "ireq_inodestats": 0 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_log": { 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "evadd": 26332, 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "evex": 25954, 2023-08-17T00:09:38.121 INFO:teuthology.orchestra.run.smithi153.stdout: "evtrm": 25954, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "ev": 2426, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "evexg": 0, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "evexd": 2048, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "segadd": 32, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "segex": 31, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "segtrm": 31, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "seg": 3, 2023-08-17T00:09:38.122 INFO:teuthology.orchestra.run.smithi153.stdout: "segexg": 0, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "segexd": 2, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "expos": 86275473, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "wrpos": 86504701, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "rdpos": 0, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "jlat": { 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4582, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 152.020499387, 2023-08-17T00:09:38.123 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.033177760 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: "replayed": 0 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_mem": { 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 14, 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: "ino+": 2015, 2023-08-17T00:09:38.124 INFO:teuthology.orchestra.run.smithi153.stdout: "ino-": 2001, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "dir": 13, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "dir+": 13, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "dir-": 0, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "dn": 8215, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "dn+": 20071, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "dn-": 11856, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "cap": 2, 2023-08-17T00:09:38.125 INFO:teuthology.orchestra.run.smithi153.stdout: "cap+": 8913, 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "cap-": 8911, 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "rss": 85104, 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "heap": 340196 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_server": { 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_client_request": 87124, 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "dispatch_server_request": 0, 2023-08-17T00:09:38.126 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_request": 27947, 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_client_session": 7, 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "handle_peer_request": 0, 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "req_create_latency": { 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 2000, 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 2.285384039, 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001142692 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.127 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getattr_latency": { 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.002112958, 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000264119 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getfilelock_latency": { 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.128 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: "req_link_latency": { 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 6000, 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 11.427397805, 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.001904566 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.129 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookup_latency": { 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 7329, 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 3.972667074, 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000542047 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookuphash_latency": { 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.130 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupino_latency": { 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.131 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupname_latency": { 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupparent_latency": { 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.132 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lookupsnap_latency": { 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000215360, 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000215360 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "req_lssnap_latency": { 2023-08-17T00:09:38.133 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mkdir_latency": { 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.005927281, 2023-08-17T00:09:38.134 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.005927281 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mknod_latency": { 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "req_mksnap_latency": { 2023-08-17T00:09:38.135 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.014443203, 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014443203 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "req_open_latency": { 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.136 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "req_readdir_latency": { 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8, 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.118658083, 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.014832260 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rename_latency": { 2023-08-17T00:09:38.137 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 4597, 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 1098.236914536, 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.238902961 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "req_renamesnap_latency": { 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.138 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmdir_latency": { 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmsnap_latency": { 2023-08-17T00:09:38.139 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.140610367, 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.140610367 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "req_rmxattr_latency": { 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.140 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setattr_latency": { 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 1, 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000411426, 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000411426 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setdirlayout_latency": { 2023-08-17T00:09:38.141 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setfilelock_latency": { 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.142 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setlayout_latency": { 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "req_setxattr_latency": { 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.143 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "req_symlink_latency": { 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.144 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "req_unlink_latency": { 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 8000, 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 30.240970604, 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.003780121 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_revoke_eviction": 0, 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "cap_acquisition_throttle": 0, 2023-08-17T00:09:38.145 INFO:teuthology.orchestra.run.smithi153.stdout: "req_getvxattr_latency": { 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_sessions": { 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "session_count": 1, 2023-08-17T00:09:38.146 INFO:teuthology.orchestra.run.smithi153.stdout: "session_add": 1, 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "session_remove": 0, 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_open": 1, 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "sessions_stale": 0, 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "total_load": 16609, 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "average_load": 16609, 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: "avg_session_uptime": 112 2023-08-17T00:09:38.147 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "mempool": { 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_bytes": 19539, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bloom_filter_items": 19539, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_bytes": 0, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_alloc_items": 0, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_bytes": 0, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_data_items": 0, 2023-08-17T00:09:38.148 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_bytes": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_onode_items": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_bytes": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_meta_items": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_bytes": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_cache_other_items": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_bytes": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Buffer_items": 0, 2023-08-17T00:09:38.149 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_bytes": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Extent_items": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_bytes": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_Blob_items": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_bytes": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_SharedBlob_items": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_bytes": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_inline_bl_items": 0, 2023-08-17T00:09:38.150 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_bytes": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_fsck_items": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_bytes": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_txc_items": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_bytes": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_deferred_items": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_bytes": 0, 2023-08-17T00:09:38.151 INFO:teuthology.orchestra.run.smithi153.stdout: "bluestore_writing_items": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_bytes": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_items": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_bytes": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_reader_items": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_bytes": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "bluefs_file_writer_items": 0, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_bytes": 175593, 2023-08-17T00:09:38.152 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_anon_items": 94, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_bytes": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "buffer_meta_items": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_bytes": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_items": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_bytes": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_mapbl_items": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_bytes": 0, 2023-08-17T00:09:38.153 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_pglog_items": 0, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_bytes": 6304, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_items": 82, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_bytes": 0, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_mapping_items": 0, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_bytes": 0, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "pgmap_items": 0, 2023-08-17T00:09:38.154 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_bytes": 6118406, 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "mds_co_items": 312700, 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_bytes": 0, 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_1_items": 0, 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_bytes": 0, 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "unittest_2_items": 0 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "objecter": { 2023-08-17T00:09:38.155 INFO:teuthology.orchestra.run.smithi153.stdout: "op_active": 0, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "op_laggy": 0, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send": 14863, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "op_send_bytes": 94389952, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "op_resend": 37, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "op_reply": 14863, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "oplen_avg": { 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 14863, 2023-08-17T00:09:38.156 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 24615 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "op": 14863, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "op_r": 1474, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "op_w": 13389, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "op_rmw": 0, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "op_pg": 0, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_stat": 51, 2023-08-17T00:09:38.157 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_create": 4792, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_read": 79, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_write": 4660, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writefull": 70, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_writesame": 0, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_append": 0, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_zero": 1716, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_truncate": 0, 2023-08-17T00:09:38.158 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_delete": 2050, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_mapext": 0, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_sparse_read": 0, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_clonerange": 0, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_getxattr": 1395, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_setxattr": 9584, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_cmpxattr": 0, 2023-08-17T00:09:38.159 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_rmxattr": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_resetxattrs": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_call": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_watch": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_notify": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_src_cmpxattr": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_pgls_filter": 0, 2023-08-17T00:09:38.160 INFO:teuthology.orchestra.run.smithi153.stdout: "osdop_other": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_active": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_send": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_resend": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "linger_ping": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_active": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_send": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "poolop_resend": 0, 2023-08-17T00:09:38.161 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_active": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_send": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "poolstat_resend": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_active": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_send": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "statfs_resend": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "command_active": 0, 2023-08-17T00:09:38.162 INFO:teuthology.orchestra.run.smithi153.stdout: "command_send": 0, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "command_resend": 0, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "map_epoch": 86, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "map_full": 0, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "map_inc": 8, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_sessions": 8, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_open": 8, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_session_close": 0, 2023-08-17T00:09:38.163 INFO:teuthology.orchestra.run.smithi153.stdout: "osd_laggy": 0, 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_wr": 168, 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_rd": 0, 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_del": 50 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "oft": { 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_objs": 1, 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_kv_pairs": 0, 2023-08-17T00:09:38.164 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_updates": 0, 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "omap_total_removes": 0 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "purge_queue": { 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops": 0, 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_ops_high_water": 32, 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing": 0, 2023-08-17T00:09:38.165 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executing_high_water": 32, 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_executed": 3716, 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "pq_item_in_journal": 0 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:38.166 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 43680, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 11187465, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 43680, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 43680, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 11187465, 2023-08-17T00:09:38.167 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_bytes": { 2023-08-17T00:09:38.168 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 104857600, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 14863, 2023-08-17T00:09:38.169 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 94778996, 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 14863, 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 94778996, 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.170 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-objecter_ops": { 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 1024, 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 0, 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 0, 2023-08-17T00:09:38.171 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 0, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 14863, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 14863, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 14863, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 14863, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.172 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle": { 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:09:38.173 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 3716, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 389044, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 3716, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 78, 2023-08-17T00:09:38.174 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 389044, 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:38.175 INFO:teuthology.orchestra.run.smithi153.stdout: "throttle-write_buf_throttle-0x556f3a561cc0": { 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "val": 0, 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "max": 3758096384, 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "get_started": 0, 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "get": 26332, 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "get_sum": 82310397, 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_fail": 0, 2023-08-17T00:09:38.176 INFO:teuthology.orchestra.run.smithi153.stdout: "get_or_fail_success": 26332, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "take": 0, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "take_sum": 0, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "put": 4582, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "put_sum": 82310397, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "wait": { 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "avgcount": 0, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "sum": 0.000000000, 2023-08-17T00:09:38.177 INFO:teuthology.orchestra.run.smithi153.stdout: "avgtime": 0.000000000 2023-08-17T00:09:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.178 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:38.178 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:09:38.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff11405a150 msgr2=0x7ff11405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff11405a150 0x7ff11405c610 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7ff12c00b0b0 tx=0x7ff12c00b040).stop 2023-08-17T00:09:38.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 msgr2=0x7ff130151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 0x7ff130151790 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7ff1200028f0 tx=0x7ff120007bb0).stop 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 shutdown_connections 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff11405a150 0x7ff11405c610 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1300ad9a0 0x7ff1300ade20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1300a9330 0x7ff130151790 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 --2- 172.21.15.153:0/1662054783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff11c005050 0x7ff1300c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 >> 172.21.15.153:0/1662054783 conn(0x7ff1300cb330 msgr2=0x7ff1301520a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 shutdown_connections 2023-08-17T00:09:38.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.092+0000 7ff136079700 1 -- 172.21.15.153:0/1662054783 wait complete. 2023-08-17T00:09:38.181 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:09:38.182 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:09:38.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:09:38.264 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:09:38.265 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:09:38.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:09:38.265 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:09:38.368 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:09:38.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:09:38.369 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:09:38.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:09:38.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.596+0000 7f30ce61b700 1 Processor -- start 2023-08-17T00:09:38.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.596+0000 7f30ce61b700 1 -- start start 2023-08-17T00:09:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30c814fff0 0x7f30c8062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c81503d0 0x7f30c80c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80a9170 con 0x7f30c8153da0 2023-08-17T00:09:38.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80c1b90 con 0x7f30c814fff0 2023-08-17T00:09:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c8154280 con 0x7f30c81503d0 2023-08-17T00:09:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30c814fff0 0x7f30c8062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30bf7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f30c8153da0 0x7f30c80c2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37390/0 (socket says 172.21.15.153:37390) 2023-08-17T00:09:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f30c814fff0 0x7f30c8062970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37630/0 (socket says 172.21.15.153:37630) 2023-08-17T00:09:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30bf7fe700 1 -- 172.21.15.153:0/1614347522 learned_addr learned my addr 172.21.15.153:0/1614347522 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:38.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ccbb8700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c81503d0 0x7f30c80c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 -- 172.21.15.153:0/1614347522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c81503d0 msgr2=0x7f30c80c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c81503d0 0x7f30c80c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 -- 172.21.15.153:0/1614347522 >> v1:172.21.15.153:6789/0 conn(0x7f30c8153da0 legacy=0x7f30c80c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 -- 172.21.15.153:0/1614347522 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c8154560 con 0x7f30c814fff0 2023-08-17T00:09:38.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ccbb8700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c81503d0 0x7f30c80c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:38.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c7fff700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c814fff0 0x7f30c8062970 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f30b8009760 tx=0x7f30b8009060).ready entity=mon.0 client_cookie=ac091019dddeb32c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c77fe700 1 -- 172.21.15.153:0/1614347522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80090d0 con 0x7f30c814fff0 2023-08-17T00:09:38.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c77fe700 1 -- 172.21.15.153:0/1614347522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b800b580 con 0x7f30c814fff0 2023-08-17T00:09:38.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30c77fe700 1 -- 172.21.15.153:0/1614347522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b800b900 con 0x7f30c814fff0 2023-08-17T00:09:38.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 -- 172.21.15.153:0/1614347522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c814fff0 msgr2=0x7f30c8062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.600+0000 7f30ce61b700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c814fff0 0x7f30c8062970 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f30b8009760 tx=0x7f30b8009060).stop 2023-08-17T00:09:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 -- 172.21.15.153:0/1614347522 shutdown_connections 2023-08-17T00:09:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c81503d0 0x7f30c80c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 --2- 172.21.15.153:0/1614347522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c814fff0 0x7f30c8062970 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 -- 172.21.15.153:0/1614347522 >> 172.21.15.153:0/1614347522 conn(0x7f30c80c7150 msgr2=0x7f30c80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 -- 172.21.15.153:0/1614347522 shutdown_connections 2023-08-17T00:09:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 -- 172.21.15.153:0/1614347522 wait complete. 2023-08-17T00:09:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 Processor -- start 2023-08-17T00:09:38.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.604+0000 7f30ce61b700 1 -- start start 2023-08-17T00:09:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30c814fff0 0x7f30c80aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 0x7f30c80bd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c8153da0 0x7f30c814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80bdc80 con 0x7f30c81503d0 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80aa730 con 0x7f30c814fff0 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80aaa10 con 0x7f30c8153da0 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 0x7f30c80bd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 0x7f30c80bd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37644/0 (socket says 172.21.15.153:37644) 2023-08-17T00:09:38.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 -- 172.21.15.153:0/2113881643 learned_addr learned my addr 172.21.15.153:0/2113881643 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30c7fff700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30c814fff0 0x7f30c80aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ccbb8700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c8153da0 0x7f30c814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 -- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c8153da0 msgr2=0x7f30c814b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c8153da0 0x7f30c814b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 -- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30c814fff0 msgr2=0x7f30c80aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30c814fff0 0x7f30c80aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 -- 172.21.15.153:0/2113881643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30b80092a0 con 0x7f30c81503d0 2023-08-17T00:09:38.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ccbb8700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c8153da0 0x7f30c814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:38.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30bf7fe700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 0x7f30c80bd790 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f30b0007fd0 tx=0x7f30b0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00072e0 con 0x7f30c81503d0 2023-08-17T00:09:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0007440 con 0x7f30c81503d0 2023-08-17T00:09:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c80aacf0 con 0x7f30c81503d0 2023-08-17T00:09:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b00057a0 con 0x7f30c81503d0 2023-08-17T00:09:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.608+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c8151b60 con 0x7f30c81503d0 2023-08-17T00:09:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.612+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c806b530 con 0x7f30c81503d0 2023-08-17T00:09:38.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.612+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f30b0010070 con 0x7f30c81503d0 2023-08-17T00:09:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.612+0000 7f30c4ff9700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f30a805a150 0x7f30a805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.612+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f30b0073900 con 0x7f30c81503d0 2023-08-17T00:09:38.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.612+0000 7f30c7fff700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f30a805a150 0x7f30a805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:38.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.612+0000 7f30c7fff700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f30a805a150 0x7f30a805c610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f30b800b340 tx=0x7f30b8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:38.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.616+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30b0047260 con 0x7f30c81503d0 2023-08-17T00:09:38.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.812+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30c80c0c10 con 0x7f30c81503d0 2023-08-17T00:09:38.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.812+0000 7f30c4ff9700 1 -- 172.21.15.153:0/2113881643 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f30b004a880 con 0x7f30c81503d0 2023-08-17T00:09:38.818 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:38.818 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:07:37.048946+0000","modified":"2023-08-17T00:09:25.398889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/2081650727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2081650727},{"type":"v1","addr":"172.21.15.153:6835","nonce":2081650727}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T00:09:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f30a805a150 msgr2=0x7f30a805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f30a805a150 0x7f30a805c610 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f30b800b340 tx=0x7f30b8017000).stop 2023-08-17T00:09:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 msgr2=0x7f30c80bd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:38.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 0x7f30c80bd790 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f30b0007fd0 tx=0x7f30b0007df0).stop 2023-08-17T00:09:38.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 shutdown_connections 2023-08-17T00:09:38.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f30a805a150 0x7f30a805c610 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f30c8153da0 0x7f30c814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f30c81503d0 0x7f30c80bd790 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 --2- 172.21.15.153:0/2113881643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f30c814fff0 0x7f30c80aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:38.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 >> 172.21.15.153:0/2113881643 conn(0x7f30c80c7150 msgr2=0x7f30c80ab970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:38.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 shutdown_connections 2023-08-17T00:09:38.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.816+0000 7f30ce61b700 1 -- 172.21.15.153:0/2113881643 wait complete. 2023-08-17T00:09:38.823 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 77 2023-08-17T00:09:38.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:38.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.992+0000 7ff5c4d47700 1 Processor -- start 2023-08-17T00:09:38.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.992+0000 7ff5c4d47700 1 -- start start 2023-08-17T00:09:39.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5c4d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c0153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5c4d47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c00a7600 con 0x7ff5c0153910 2023-08-17T00:09:39.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5c4d47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c0095110 con 0x7ff5c00a8280 2023-08-17T00:09:39.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5c4d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0094e70 con 0x7ff5c00a5400 2023-08-17T00:09:39.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5bf7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff5c0153910 0x7ff5c00a6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37400/0 (socket says 172.21.15.153:37400) 2023-08-17T00:09:39.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5bf7fe700 1 -- 172.21.15.153:0/3955713261 learned_addr learned my addr 172.21.15.153:0/3955713261 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:39.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5beffd700 1 --2- 172.21.15.153:0/3955713261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c0153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5be7fc700 1 -- 172.21.15.153:0/3955713261 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936352127 0 0) 0x7ff5b0001290 con 0x7ff5c0153910 2023-08-17T00:09:39.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5be7fc700 1 -- 172.21.15.153:0/3955713261 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5a80033f0 con 0x7ff5c0153910 2023-08-17T00:09:39.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5beffd700 1 -- 172.21.15.153:0/3955713261 >> v1:172.21.15.178:6789/0 conn(0x7ff5c00a8280 legacy=0x7ff5c00955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5beffd700 1 -- 172.21.15.153:0/3955713261 >> v1:172.21.15.153:6789/0 conn(0x7ff5c0153910 legacy=0x7ff5c00a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:38.996+0000 7ff5beffd700 1 -- 172.21.15.153:0/3955713261 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00a7840 con 0x7ff5c00a5400 2023-08-17T00:09:39.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5beffd700 1 --2- 172.21.15.153:0/3955713261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c0153cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff5b4009790 tx=0x7ff5b4009060).ready entity=mon.2 client_cookie=c75c2795c8e84eb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5be7fc700 1 -- 172.21.15.153:0/3955713261 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40090d0 con 0x7ff5c00a5400 2023-08-17T00:09:39.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5be7fc700 1 -- 172.21.15.153:0/3955713261 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b400f510 con 0x7ff5c00a5400 2023-08-17T00:09:39.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5be7fc700 1 -- 172.21.15.153:0/3955713261 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b400f890 con 0x7ff5c00a5400 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 -- 172.21.15.153:0/3955713261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 msgr2=0x7ff5c0153cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/3955713261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c0153cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ff5b4009790 tx=0x7ff5b4009060).stop 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 -- 172.21.15.153:0/3955713261 shutdown_connections 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/3955713261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c0153cf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 -- 172.21.15.153:0/3955713261 >> 172.21.15.153:0/3955713261 conn(0x7ff5c00c5170 msgr2=0x7ff5c00c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 -- 172.21.15.153:0/3955713261 shutdown_connections 2023-08-17T00:09:39.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 -- 172.21.15.153:0/3955713261 wait complete. 2023-08-17T00:09:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.000+0000 7ff5c4d47700 1 Processor -- start 2023-08-17T00:09:39.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 -- start start 2023-08-17T00:09:39.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c00c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c00a8280 0x7ff5c00a9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 0x7ff5c00a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00aa450 con 0x7ff5c0153910 2023-08-17T00:09:39.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0164d10 con 0x7ff5c00a8280 2023-08-17T00:09:39.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0164f80 con 0x7ff5c00a5400 2023-08-17T00:09:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 0x7ff5c00a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 0x7ff5c00a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37652/0 (socket says 172.21.15.153:37652) 2023-08-17T00:09:39.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 -- 172.21.15.153:0/143128245 learned_addr learned my addr 172.21.15.153:0/143128245 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bf7fe700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c00c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5beffd700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c00a8280 0x7ff5c00a9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 -- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 msgr2=0x7ff5c00c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c00c1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 -- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c00a8280 msgr2=0x7ff5c00a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c00a8280 0x7ff5c00a9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 -- 172.21.15.153:0/143128245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b40092a0 con 0x7ff5c0153910 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bf7fe700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c00c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5bffff700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 0x7ff5c00a9f60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7ff5b8002230 tx=0x7ff5b80015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8010510 con 0x7ff5c0153910 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b8010670 con 0x7ff5c0153910 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c0164100 con 0x7ff5c0153910 2023-08-17T00:09:39.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b80109f0 con 0x7ff5c0153910 2023-08-17T00:09:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.004+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c01646c0 con 0x7ff5c0153910 2023-08-17T00:09:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.008+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c006b4c0 con 0x7ff5c0153910 2023-08-17T00:09:39.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.008+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff5b8010070 con 0x7ff5c0153910 2023-08-17T00:09:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.008+0000 7ff5a77fe700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5ac05a150 0x7ff5ac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.008+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff5b8073e80 con 0x7ff5c0153910 2023-08-17T00:09:39.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.012+0000 7ff5bf7fe700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5ac05a150 0x7ff5ac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.012+0000 7ff5bf7fe700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5ac05a150 0x7ff5ac05c610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff5b00013f0 tx=0x7ff5b0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.016+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5b80477e0 con 0x7ff5c0153910 2023-08-17T00:09:39.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.176+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5c00a7b20 con 0x7ff5c0153910 2023-08-17T00:09:39.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.176+0000 7ff5a77fe700 1 -- 172.21.15.153:0/143128245 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17095 (secure 0 0 0) 0x7ff5b804ae00 con 0x7ff5c0153910 2023-08-17T00:09:39.183 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:39.183 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":86,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:17.199625+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:07:34.961847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T00:07:36.061106+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5ac05a150 msgr2=0x7ff5ac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5ac05a150 0x7ff5ac05c610 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7ff5b00013f0 tx=0x7ff5b0009040).stop 2023-08-17T00:09:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 msgr2=0x7ff5c00a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 0x7ff5c00a9f60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7ff5b8002230 tx=0x7ff5b80015e0).stop 2023-08-17T00:09:39.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 shutdown_connections 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5ac05a150 0x7ff5ac05c610 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5c0153910 0x7ff5c00a9f60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5c00a8280 0x7ff5c00a9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 --2- 172.21.15.153:0/143128245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5c00a5400 0x7ff5c00c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 >> 172.21.15.153:0/143128245 conn(0x7ff5c00c5170 msgr2=0x7ff5c0150670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 shutdown_connections 2023-08-17T00:09:39.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.180+0000 7ff5c4d47700 1 -- 172.21.15.153:0/143128245 wait complete. 2023-08-17T00:09:39.206 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:07:34.961847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '78', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:07:36.061106+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 85, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:09:39.207 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:09:39.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.360+0000 7f7996579700 1 Processor -- start 2023-08-17T00:09:39.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.360+0000 7f7996579700 1 -- start start 2023-08-17T00:09:39.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7990063bc0 0x7f799015e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7990154e90 con 0x7f79900c5ea0 2023-08-17T00:09:39.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7990153fc0 con 0x7f79900acf30 2023-08-17T00:09:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79900c1730 con 0x7f7990063bc0 2023-08-17T00:09:39.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7994d76700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f79900c5ea0 0x7f79900634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37416/0 (socket says 172.21.15.153:37416) 2023-08-17T00:09:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7994d76700 1 -- 172.21.15.153:0/3449360853 learned_addr learned my addr 172.21.15.153:0/3449360853 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7995d78700 1 --2- 172.21.15.153:0/3449360853 >> v2:172.21.15.178:3300/0 conn(0x7f7990063bc0 0x7f799015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7987fff700 1 -- 172.21.15.153:0/3449360853 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409414389 0 0) 0x7f7990154e90 con 0x7f79900c5ea0 2023-08-17T00:09:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7987fff700 1 -- 172.21.15.153:0/3449360853 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f797c0033f0 con 0x7f79900c5ea0 2023-08-17T00:09:39.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7995d78700 1 -- 172.21.15.153:0/3449360853 >> v1:172.21.15.178:6789/0 conn(0x7f79900acf30 legacy=0x7f79900c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7995d78700 1 -- 172.21.15.153:0/3449360853 >> v1:172.21.15.153:6789/0 conn(0x7f79900c5ea0 legacy=0x7f79900634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7995d78700 1 -- 172.21.15.153:0/3449360853 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990154280 con 0x7f7990063bc0 2023-08-17T00:09:39.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7995d78700 1 --2- 172.21.15.153:0/3449360853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990063bc0 0x7f799015e660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f7988009760 tx=0x7f7988009060).ready entity=mon.1 client_cookie=9c49e4d87d795bf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7987fff700 1 -- 172.21.15.153:0/3449360853 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800f510 con 0x7f7990063bc0 2023-08-17T00:09:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7987fff700 1 -- 172.21.15.153:0/3449360853 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798800f670 con 0x7f7990063bc0 2023-08-17T00:09:39.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7987fff700 1 -- 172.21.15.153:0/3449360853 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800f9f0 con 0x7f7990063bc0 2023-08-17T00:09:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 -- 172.21.15.153:0/3449360853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990063bc0 msgr2=0x7f799015e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 --2- 172.21.15.153:0/3449360853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990063bc0 0x7f799015e660 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f7988009760 tx=0x7f7988009060).stop 2023-08-17T00:09:39.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 -- 172.21.15.153:0/3449360853 shutdown_connections 2023-08-17T00:09:39.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 --2- 172.21.15.153:0/3449360853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990063bc0 0x7f799015e660 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.364+0000 7f7996579700 1 -- 172.21.15.153:0/3449360853 >> 172.21.15.153:0/3449360853 conn(0x7f79900cb330 msgr2=0x7f79900c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:39.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 -- 172.21.15.153:0/3449360853 shutdown_connections 2023-08-17T00:09:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 -- 172.21.15.153:0/3449360853 wait complete. 2023-08-17T00:09:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 Processor -- start 2023-08-17T00:09:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 -- start start 2023-08-17T00:09:39.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 0x7f799014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79900acf30 0x7f799014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990158bd0 0x7f799014eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7990158740 con 0x7f7990063bc0 2023-08-17T00:09:39.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79900ae950 con 0x7f7990158bd0 2023-08-17T00:09:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7996579700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79900ae0b0 con 0x7f79900acf30 2023-08-17T00:09:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.368+0000 7f7995577700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 0x7f799014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 0x7f799014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37662/0 (socket says 172.21.15.153:37662) 2023-08-17T00:09:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7994d76700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79900acf30 0x7f799014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 -- 172.21.15.153:0/2500460630 learned_addr learned my addr 172.21.15.153:0/2500460630 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:39.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995d78700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990158bd0 0x7f799014eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 -- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79900acf30 msgr2=0x7f799014e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79900acf30 0x7f799014e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 -- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990158bd0 msgr2=0x7f799014eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990158bd0 0x7f799014eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 -- 172.21.15.153:0/2500460630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79880092a0 con 0x7f7990063bc0 2023-08-17T00:09:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7995577700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 0x7f799014fa90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f798c00c870 tx=0x7f798c001660).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c006a20 con 0x7f7990063bc0 2023-08-17T00:09:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c006b80 con 0x7f7990063bc0 2023-08-17T00:09:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79900ae390 con 0x7f7990063bc0 2023-08-17T00:09:39.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c007020 con 0x7f7990063bc0 2023-08-17T00:09:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7990147530 con 0x7f7990063bc0 2023-08-17T00:09:39.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.372+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799006b4c0 con 0x7f7990063bc0 2023-08-17T00:09:39.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.376+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f798c010070 con 0x7f7990063bc0 2023-08-17T00:09:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.376+0000 7f79857fa700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f797405a150 0x7f797405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.376+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f798c073930 con 0x7f7990063bc0 2023-08-17T00:09:39.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.380+0000 7f7994d76700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f797405a150 0x7f797405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.380+0000 7f7994d76700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f797405a150 0x7f797405c610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f7980007fd0 tx=0x7f7980009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.384+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f798c047290 con 0x7f7990063bc0 2023-08-17T00:09:39.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.544+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7990154560 con 0x7f7990063bc0 2023-08-17T00:09:39.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.544+0000 7f79857fa700 1 -- 172.21.15.153:0/2500460630 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v86) v1 ==== 110+0+10 (secure 0 0 0) 0x7f798c04a8b0 con 0x7f7990063bc0 2023-08-17T00:09:39.549 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:09:39.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f797405a150 msgr2=0x7f797405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f797405a150 0x7f797405c610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f7980007fd0 tx=0x7f7980009040).stop 2023-08-17T00:09:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 msgr2=0x7f799014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 0x7f799014fa90 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f798c00c870 tx=0x7f798c001660).stop 2023-08-17T00:09:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 shutdown_connections 2023-08-17T00:09:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f797405a150 0x7f797405c610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7990158bd0 0x7f799014eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79900acf30 0x7f799014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 --2- 172.21.15.153:0/2500460630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7990063bc0 0x7f799014fa90 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 >> 172.21.15.153:0/2500460630 conn(0x7f79900cb330 msgr2=0x7f79900aab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 shutdown_connections 2023-08-17T00:09:39.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.548+0000 7f7996579700 1 -- 172.21.15.153:0/2500460630 wait complete. 2023-08-17T00:09:39.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:09:39.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.736+0000 7fed1105b700 1 Processor -- start 2023-08-17T00:09:39.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.736+0000 7fed1105b700 1 -- start start 2023-08-17T00:09:39.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c153ab0 0x7fed0c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed0c0c8d50 0x7fed0c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed0c0c7490 0x7fed0c0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0aa750 con 0x7fed0c0c7490 2023-08-17T00:09:39.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0c7e30 con 0x7fed0c0c8d50 2023-08-17T00:09:39.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0c9dd0 con 0x7fed0c153ab0 2023-08-17T00:09:39.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed0c0c7490 0x7fed0c0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fed0c0c7490 0x7fed0c0c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37666/0 (socket says 172.21.15.153:37666) 2023-08-17T00:09:39.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 -- 172.21.15.153:0/187430517 learned_addr learned my addr 172.21.15.153:0/187430517 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:39.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0ad9d700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c153ab0 0x7fed0c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0a59c700 1 --2- 172.21.15.153:0/187430517 >> v2:172.21.15.178:3300/0 conn(0x7fed0c0c8d50 0x7fed0c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 -- 172.21.15.153:0/187430517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c153ab0 msgr2=0x7fed0c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:39.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c153ab0 0x7fed0c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 -- 172.21.15.153:0/187430517 >> v2:172.21.15.178:3300/0 conn(0x7fed0c0c8d50 msgr2=0x7fed0c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 --2- 172.21.15.153:0/187430517 >> v2:172.21.15.178:3300/0 conn(0x7fed0c0c8d50 0x7fed0c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 -- 172.21.15.153:0/187430517 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0aacf0 con 0x7fed0c0c7490 2023-08-17T00:09:39.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0ad9d700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c153ab0 0x7fed0c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0a59c700 1 --2- 172.21.15.153:0/187430517 >> v2:172.21.15.178:3300/0 conn(0x7fed0c0c8d50 0x7fed0c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed0b59e700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c0c7490 0x7fed0c0c7940 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fed0c05e680 tx=0x7fed04009840).ready entity=mon.0 client_cookie=83c4dadbd2e7e8a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed09d9b700 1 -- 172.21.15.153:0/187430517 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0400e070 con 0x7fed0c0c7490 2023-08-17T00:09:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed09d9b700 1 -- 172.21.15.153:0/187430517 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed0400b970 con 0x7fed0c0c7490 2023-08-17T00:09:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed09d9b700 1 -- 172.21.15.153:0/187430517 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0400bcf0 con 0x7fed0c0c7490 2023-08-17T00:09:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 -- 172.21.15.153:0/187430517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c0c7490 msgr2=0x7fed0c0c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.740+0000 7fed1105b700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c0c7490 0x7fed0c0c7940 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fed0c05e680 tx=0x7fed04009840).stop 2023-08-17T00:09:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- 172.21.15.153:0/187430517 shutdown_connections 2023-08-17T00:09:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c0c7490 0x7fed0c0c7940 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 --2- 172.21.15.153:0/187430517 >> v2:172.21.15.178:3300/0 conn(0x7fed0c0c8d50 0x7fed0c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 --2- 172.21.15.153:0/187430517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c153ab0 0x7fed0c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- 172.21.15.153:0/187430517 >> 172.21.15.153:0/187430517 conn(0x7fed0c061fa0 msgr2=0x7fed0c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:39.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- 172.21.15.153:0/187430517 shutdown_connections 2023-08-17T00:09:39.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- 172.21.15.153:0/187430517 wait complete. 2023-08-17T00:09:39.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 Processor -- start 2023-08-17T00:09:39.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- start start 2023-08-17T00:09:39.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c0c7490 0x7fed0c0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed0c0c8d50 0x7fed0c14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 0x7fed0c14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c14b9e0 con 0x7fed0c153ab0 2023-08-17T00:09:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c14add0 con 0x7fed0c0c8d50 2023-08-17T00:09:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.744+0000 7fed1105b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c14b0b0 con 0x7fed0c0c7490 2023-08-17T00:09:39.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 0x7fed0c14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 0x7fed0c14a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37682/0 (socket says 172.21.15.153:37682) 2023-08-17T00:09:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 -- 172.21.15.153:0/2320405682 learned_addr learned my addr 172.21.15.153:0/2320405682 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0ad9d700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c0c7490 0x7fed0c0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0a59c700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed0c0c8d50 0x7fed0c14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 -- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c0c7490 msgr2=0x7fed0c0b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c0c7490 0x7fed0c0b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 -- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed0c0c8d50 msgr2=0x7fed0c14a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed0c0c8d50 0x7fed0c14a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 -- 172.21.15.153:0/2320405682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000092a0 con 0x7fed0c153ab0 2023-08-17T00:09:39.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed0b59e700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 0x7fed0c14a820 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fed0400b610 tx=0x7fed0c0aac60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0400bee0 con 0x7fed0c153ab0 2023-08-17T00:09:39.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed040092e0 con 0x7fed0c153ab0 2023-08-17T00:09:39.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecfc0092a0 con 0x7fed0c153ab0 2023-08-17T00:09:39.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed0401d6b0 con 0x7fed0c153ab0 2023-08-17T00:09:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed04009ae0 con 0x7fed0c153ab0 2023-08-17T00:09:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.748+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0c14bb90 con 0x7fed0c153ab0 2023-08-17T00:09:39.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.752+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fed04024030 con 0x7fed0c153ab0 2023-08-17T00:09:39.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.752+0000 7fecf2ffd700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fecf805a180 0x7fecf805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:39.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.752+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fed04075540 con 0x7fed0c153ab0 2023-08-17T00:09:39.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.752+0000 7fed0ad9d700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fecf805a180 0x7fecf805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:39.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.756+0000 7fed0ad9d700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fecf805a180 0x7fecf805c640 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fecfc009dc0 tx=0x7fecfc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:39.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.760+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed0c14bb90 con 0x7fed0c153ab0 2023-08-17T00:09:39.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.920+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed0c06b530 con 0x7fed0c153ab0 2023-08-17T00:09:39.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.920+0000 7fecf2ffd700 1 -- 172.21.15.153:0/2320405682 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed04022070 con 0x7fed0c153ab0 2023-08-17T00:09:39.925 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:09:39.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.920+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fecf805a180 msgr2=0x7fecf805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.920+0000 7fed1105b700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fecf805a180 0x7fecf805c640 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fecfc009dc0 tx=0x7fecfc009060).stop 2023-08-17T00:09:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.920+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 msgr2=0x7fed0c14a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.920+0000 7fed1105b700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 0x7fed0c14a820 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fed0400b610 tx=0x7fed0c0aac60).stop 2023-08-17T00:09:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 shutdown_connections 2023-08-17T00:09:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fecf805a180 0x7fecf805c640 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed0c153ab0 0x7fed0c14a820 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed0c0c8d50 0x7fed0c14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 --2- 172.21.15.153:0/2320405682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed0c0c7490 0x7fed0c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:39.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 >> 172.21.15.153:0/2320405682 conn(0x7fed0c061fa0 msgr2=0x7fed0c063590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:39.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 shutdown_connections 2023-08-17T00:09:39.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:39.924+0000 7fed1105b700 1 -- 172.21.15.153:0/2320405682 wait complete. 2023-08-17T00:09:39.946 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:09:40.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.100+0000 7f0b6f59e700 1 Processor -- start 2023-08-17T00:09:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.100+0000 7f0b6f59e700 1 -- start start 2023-08-17T00:09:40.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b700acf20 0x7f0b700c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b700bf790 con 0x7f0b701545f0 2023-08-17T00:09:40.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6f59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b700bfd50 con 0x7f0b700c7520 2023-08-17T00:09:40.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b70063f90 con 0x7f0b700acf20 2023-08-17T00:09:40.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0b701545f0 0x7f0b700c01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37418/0 (socket says 172.21.15.153:37418) 2023-08-17T00:09:40.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6ed9d700 1 -- 172.21.15.153:0/1943823047 learned_addr learned my addr 172.21.15.153:0/1943823047 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:40.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6e59c700 1 --2- 172.21.15.153:0/1943823047 >> v2:172.21.15.178:3300/0 conn(0x7f0b700acf20 0x7f0b700c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 609789802 0 0) 0x7f0b700bf790 con 0x7f0b701545f0 2023-08-17T00:09:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b5c0033f0 con 0x7f0b701545f0 2023-08-17T00:09:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302912975 0 0) 0x7f0b700bfd50 con 0x7f0b700c7520 2023-08-17T00:09:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b700bf790 con 0x7f0b700c7520 2023-08-17T00:09:40.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457285422 0 0) 0x7f0b5c0033f0 con 0x7f0b701545f0 2023-08-17T00:09:40.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 >> v2:172.21.15.178:3300/0 conn(0x7f0b700acf20 msgr2=0x7f0b700c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:40.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 --2- 172.21.15.153:0/1943823047 >> v2:172.21.15.178:3300/0 conn(0x7f0b700acf20 0x7f0b700c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 >> v1:172.21.15.178:6789/0 conn(0x7f0b700c7520 legacy=0x7f0b70153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700ad300 con 0x7f0b701545f0 2023-08-17T00:09:40.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f0b680017f0 con 0x7f0b701545f0 2023-08-17T00:09:40.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 >> v1:172.21.15.153:6789/0 conn(0x7f0b701545f0 legacy=0x7f0b700c01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c003a70 0x7f0b5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b5c004690 0x7f0b5c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c005050 0x7f0b5c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70063f90 con 0x7f0b5c005050 2023-08-17T00:09:40.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c00bfc0 con 0x7f0b5c004690 2023-08-17T00:09:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c00c180 con 0x7f0b5c003a70 2023-08-17T00:09:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6ed9d700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c005050 0x7f0b5c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b6e59c700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c003a70 0x7f0b5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.104+0000 7f0b67fff700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b5c004690 0x7f0b5c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 -- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c003a70 msgr2=0x7f0b5c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c003a70 0x7f0b5c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 -- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b5c004690 msgr2=0x7f0b5c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:40.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b5c004690 0x7f0b5c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 -- 172.21.15.153:0/1943823047 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0033f0 con 0x7f0b5c005050 2023-08-17T00:09:40.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 -- 172.21.15.153:0/1943823047 reap_dead start 2023-08-17T00:09:40.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6ed9d700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c005050 0x7f0b5c00b8e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f0b6800c5f0 tx=0x7f0b700bfcc0).ready entity=mon.0 client_cookie=c10cabf849acf432 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800cdf0 con 0x7f0b5c005050 2023-08-17T00:09:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b68005b20 con 0x7f0b5c005050 2023-08-17T00:09:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6dd9b700 1 -- 172.21.15.153:0/1943823047 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680070d0 con 0x7f0b5c005050 2023-08-17T00:09:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 -- 172.21.15.153:0/1943823047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c005050 msgr2=0x7f0b5c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c005050 0x7f0b5c00b8e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7f0b6800c5f0 tx=0x7f0b700bfcc0).stop 2023-08-17T00:09:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 -- 172.21.15.153:0/1943823047 shutdown_connections 2023-08-17T00:09:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/1943823047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b5c005050 0x7f0b5c00b8e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 -- 172.21.15.153:0/1943823047 >> 172.21.15.153:0/1943823047 conn(0x7f0b70062a20 msgr2=0x7f0b70063580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 -- 172.21.15.153:0/1943823047 shutdown_connections 2023-08-17T00:09:40.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.108+0000 7f0b6f59e700 1 -- 172.21.15.153:0/1943823047 wait complete. 2023-08-17T00:09:40.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 Processor -- start 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 -- start start 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c005050 0x7f0b70151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b700c2230 0x7f0b700c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b70152100 0x7f0b70152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70163d20 con 0x7f0b70152100 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b700c1af0 con 0x7f0b700c2230 2023-08-17T00:09:40.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b70152a70 con 0x7f0b5c005050 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6e59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c005050 0x7f0b70151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b700c2230 0x7f0b700c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6e59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c005050 0x7f0b70151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:40736/0 (socket says 172.21.15.153:40736) 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b70152100 0x7f0b70152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6e59c700 1 -- 172.21.15.153:0/2512541822 learned_addr learned my addr 172.21.15.153:0/2512541822 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 -- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c005050 msgr2=0x7f0b70151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c005050 0x7f0b70151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 -- 172.21.15.153:0/2512541822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b70152100 msgr2=0x7f0b70152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b70152100 0x7f0b70152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 -- 172.21.15.153:0/2512541822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70163f30 con 0x7f0b700c2230 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b6ed9d700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b70152100 0x7f0b70152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.112+0000 7f0b67fff700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b700c2230 0x7f0b700c4910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0b5800e480 tx=0x7f0b58009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58015400 con 0x7f0b700c2230 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58010040 con 0x7f0b700c2230 2023-08-17T00:09:40.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70164210 con 0x7f0b700c2230 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58015790 con 0x7f0b700c2230 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b701647d0 con 0x7f0b700c2230 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b70046dd0 con 0x7f0b700c2230 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.116+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0b58015b00 con 0x7f0b700c2230 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.120+0000 7f0b667fc700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5005a180 0x7f0b5005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.120+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f0b58074150 con 0x7f0b700c2230 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.120+0000 7f0b6e59c700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5005a180 0x7f0b5005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.120+0000 7f0b6e59c700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5005a180 0x7f0b5005c640 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f0b700b0520 tx=0x7f0b60008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.128+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b58047ab0 con 0x7f0b700c2230 2023-08-17T00:09:40.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.292+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b700c7cc0 con 0x7f0b700c2230 2023-08-17T00:09:40.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.292+0000 7f0b667fc700 1 -- 172.21.15.153:0/2512541822 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b5804b0d0 con 0x7f0b700c2230 2023-08-17T00:09:40.297 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5005a180 msgr2=0x7f0b5005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5005a180 0x7f0b5005c640 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f0b700b0520 tx=0x7f0b60008040).stop 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b700c2230 msgr2=0x7f0b700c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b700c2230 0x7f0b700c4910 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0b5800e480 tx=0x7f0b58009040).stop 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 shutdown_connections 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5005a180 0x7f0b5005c640 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b70152100 0x7f0b70152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b700c2230 0x7f0b700c4910 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 --2- 172.21.15.153:0/2512541822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b5c005050 0x7f0b70151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 >> 172.21.15.153:0/2512541822 conn(0x7f0b70062a20 msgr2=0x7f0b70153260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 shutdown_connections 2023-08-17T00:09:40.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.296+0000 7f0b6f59e700 1 -- 172.21.15.153:0/2512541822 wait complete. 2023-08-17T00:09:40.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:09:40.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.484+0000 7f285b6f1700 1 Processor -- start 2023-08-17T00:09:40.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.484+0000 7f285b6f1700 1 -- start start 2023-08-17T00:09:40.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.484+0000 7f285b6f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2854153ab0 0x7f2854153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.484+0000 7f285b6f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540aa750 con 0x7f28540c7ba0 2023-08-17T00:09:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.484+0000 7f285b6f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540c9dd0 con 0x7f28540c8d50 2023-08-17T00:09:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.484+0000 7f285b6f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540aacf0 con 0x7f2854153ab0 2023-08-17T00:09:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285948d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2854153ab0 0x7f2854153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f2859c8e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f28540c7ba0 0x7f28540ab180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37422/0 (socket says 172.21.15.153:37422) 2023-08-17T00:09:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f2859c8e700 1 -- 172.21.15.153:0/3978012943 learned_addr learned my addr 172.21.15.153:0/3978012943 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285948d700 1 -- 172.21.15.153:0/3978012943 >> v1:172.21.15.178:6789/0 conn(0x7f28540c8d50 legacy=0x7f28540c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f284bfff700 1 -- 172.21.15.153:0/3978012943 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825832033 0 0) 0x7f28540c9dd0 con 0x7f28540c8d50 2023-08-17T00:09:40.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285948d700 1 -- 172.21.15.153:0/3978012943 >> v1:172.21.15.153:6789/0 conn(0x7f28540c7ba0 legacy=0x7f28540ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285948d700 1 -- 172.21.15.153:0/3978012943 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540c5ca0 con 0x7f2854153ab0 2023-08-17T00:09:40.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285948d700 1 --2- 172.21.15.153:0/3978012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f2854153e90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f2850009760 tx=0x7f2850009060).ready entity=mon.0 client_cookie=f236c36109d2e7a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f284bfff700 1 -- 172.21.15.153:0/3978012943 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850009120 con 0x7f2854153ab0 2023-08-17T00:09:40.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f284bfff700 1 -- 172.21.15.153:0/3978012943 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285000b580 con 0x7f2854153ab0 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f284bfff700 1 -- 172.21.15.153:0/3978012943 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285000b900 con 0x7f2854153ab0 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 -- 172.21.15.153:0/3978012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 msgr2=0x7f2854153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3978012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f2854153e90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 rx=0x7f2850009760 tx=0x7f2850009060).stop 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 -- 172.21.15.153:0/3978012943 shutdown_connections 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3978012943 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f2854153e90 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 -- 172.21.15.153:0/3978012943 >> 172.21.15.153:0/3978012943 conn(0x7f2854061fa0 msgr2=0x7f28540623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:40.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 -- 172.21.15.153:0/3978012943 shutdown_connections 2023-08-17T00:09:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.488+0000 7f285b6f1700 1 -- 172.21.15.153:0/3978012943 wait complete. 2023-08-17T00:09:40.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.492+0000 7f285b6f1700 1 Processor -- start 2023-08-17T00:09:40.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.492+0000 7f285b6f1700 1 -- start start 2023-08-17T00:09:40.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28540c7ba0 0x7f285414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28540c8d50 0x7f285414d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f28540c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285414e240 con 0x7f2854153ab0 2023-08-17T00:09:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285414e520 con 0x7f28540c7ba0 2023-08-17T00:09:40.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285414e800 con 0x7f28540c8d50 2023-08-17T00:09:40.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f28540c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f28540c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37706/0 (socket says 172.21.15.153:37706) 2023-08-17T00:09:40.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 -- 172.21.15.153:0/3010433196 learned_addr learned my addr 172.21.15.153:0/3010433196 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285948d700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28540c7ba0 0x7f285414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2858c8c700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28540c8d50 0x7f285414d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 -- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28540c8d50 msgr2=0x7f285414d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28540c8d50 0x7f285414d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 -- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28540c7ba0 msgr2=0x7f285414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28540c7ba0 0x7f285414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 -- 172.21.15.153:0/3010433196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500092a0 con 0x7f2854153ab0 2023-08-17T00:09:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f2859c8e700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f28540c3f20 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f284c00c7c0 tx=0x7f284c001560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c005d30 con 0x7f2854153ab0 2023-08-17T00:09:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c005e90 con 0x7f2854153ab0 2023-08-17T00:09:40.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285414eae0 con 0x7f2854153ab0 2023-08-17T00:09:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c007320 con 0x7f2854153ab0 2023-08-17T00:09:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.496+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285414d4f0 con 0x7f2854153ab0 2023-08-17T00:09:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.500+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28540adc30 con 0x7f2854153ab0 2023-08-17T00:09:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.500+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f284c010030 con 0x7f2854153ab0 2023-08-17T00:09:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.500+0000 7f28497fa700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f283805a150 0x7f283805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.500+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f284c0740c0 con 0x7f2854153ab0 2023-08-17T00:09:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.500+0000 7f285948d700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f283805a150 0x7f283805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.504+0000 7f285948d700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f283805a150 0x7f283805c610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f285000b340 tx=0x7f2850017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.508+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f284c04b560 con 0x7f2854153ab0 2023-08-17T00:09:40.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.668+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f285406b530 con 0x7f2854153ab0 2023-08-17T00:09:40.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.668+0000 7f28497fa700 1 -- 172.21.15.153:0/3010433196 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f284c04b150 con 0x7f2854153ab0 2023-08-17T00:09:40.674 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:09:40.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f283805a150 msgr2=0x7f283805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f283805a150 0x7f283805c610 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f285000b340 tx=0x7f2850017000).stop 2023-08-17T00:09:40.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 msgr2=0x7f28540c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f28540c3f20 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f284c00c7c0 tx=0x7f284c001560).stop 2023-08-17T00:09:40.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 shutdown_connections 2023-08-17T00:09:40.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f283805a150 0x7f283805c610 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2854153ab0 0x7f28540c3f20 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28540c8d50 0x7f285414d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 --2- 172.21.15.153:0/3010433196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28540c7ba0 0x7f285414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 >> 172.21.15.153:0/3010433196 conn(0x7f2854061fa0 msgr2=0x7f28540ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:40.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 shutdown_connections 2023-08-17T00:09:40.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.672+0000 7f285b6f1700 1 -- 172.21.15.153:0/3010433196 wait complete. 2023-08-17T00:09:40.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:09:40.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.852+0000 7f1c830db700 1 Processor -- start 2023-08-17T00:09:40.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.852+0000 7f1c830db700 1 -- start start 2023-08-17T00:09:40.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c7c065b50 0x7f1c7c064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7c061fa0 con 0x7f1c7c151b90 2023-08-17T00:09:40.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7c0c3fb0 con 0x7f1c7c065b50 2023-08-17T00:09:40.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1523d0 con 0x7f1c7c151f70 2023-08-17T00:09:40.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c7c065b50 0x7f1c7c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1c7c065b50 0x7f1c7c064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37716/0 (socket says 172.21.15.153:37716) 2023-08-17T00:09:40.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 -- 172.21.15.153:0/2221136451 learned_addr learned my addr 172.21.15.153:0/2221136451 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:40.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c7bfff700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 -- 172.21.15.153:0/2221136451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 msgr2=0x7f1c7c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:40.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 -- 172.21.15.153:0/2221136451 >> v1:172.21.15.178:6789/0 conn(0x7f1c7c151b90 legacy=0x7f1c7c063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:40.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 -- 172.21.15.153:0/2221136451 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7c0621f0 con 0x7f1c7c065b50 2023-08-17T00:09:40.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c7bfff700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:40.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c81678700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c064870 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f1c74009f20 tx=0x7f1c74009840).ready entity=mon.0 client_cookie=34f18fd66a6f111c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c7b7fe700 1 -- 172.21.15.153:0/2221136451 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400e070 con 0x7f1c7c065b50 2023-08-17T00:09:40.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c7b7fe700 1 -- 172.21.15.153:0/2221136451 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7400ba80 con 0x7f1c7c065b50 2023-08-17T00:09:40.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c7b7fe700 1 -- 172.21.15.153:0/2221136451 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7400be00 con 0x7f1c7c065b50 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 -- 172.21.15.153:0/2221136451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 msgr2=0x7f1c7c064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.856+0000 7f1c830db700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c064870 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f1c74009f20 tx=0x7f1c74009840).stop 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- 172.21.15.153:0/2221136451 shutdown_connections 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c064870 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 --2- 172.21.15.153:0/2221136451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- 172.21.15.153:0/2221136451 >> 172.21.15.153:0/2221136451 conn(0x7f1c7c0c7150 msgr2=0x7f1c7c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- 172.21.15.153:0/2221136451 shutdown_connections 2023-08-17T00:09:40.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- 172.21.15.153:0/2221136451 wait complete. 2023-08-17T00:09:40.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 Processor -- start 2023-08-17T00:09:40.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- start start 2023-08-17T00:09:40.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c1646c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c151b90 0x7f1c7c168520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1656b0 con 0x7f1c7c065b50 2023-08-17T00:09:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c164bb0 con 0x7f1c7c151b90 2023-08-17T00:09:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.860+0000 7f1c830db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c164e10 con 0x7f1c7c151f70 2023-08-17T00:09:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c1646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c1646c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37722/0 (socket says 172.21.15.153:37722) 2023-08-17T00:09:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 -- 172.21.15.153:0/3023120927 learned_addr learned my addr 172.21.15.153:0/3023120927 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:40.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c81678700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c7bfff700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c151b90 0x7f1c7c168520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 -- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 msgr2=0x7f1c7c154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 -- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c151b90 msgr2=0x7f1c7c168520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:40.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c151b90 0x7f1c7c168520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:40.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 -- 172.21.15.153:0/3023120927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74009ae0 con 0x7f1c7c065b50 2023-08-17T00:09:40.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c81678700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:40.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c80e77700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c1646c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f1c7000c4c0 tx=0x7f1c70007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70007020 con 0x7f1c7c065b50 2023-08-17T00:09:40.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70001e90 con 0x7f1c7c065b50 2023-08-17T00:09:40.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c1650f0 con 0x7f1c7c065b50 2023-08-17T00:09:40.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700073b0 con 0x7f1c7c065b50 2023-08-17T00:09:40.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c14d800 con 0x7f1c7c065b50 2023-08-17T00:09:40.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.864+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c14da20 con 0x7f1c7c065b50 2023-08-17T00:09:40.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.868+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1c70010070 con 0x7f1c7c065b50 2023-08-17T00:09:40.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.868+0000 7f1c78ff9700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1c6005a150 0x7f1c6005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:40.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.868+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f1c70073b40 con 0x7f1c7c065b50 2023-08-17T00:09:40.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.868+0000 7f1c7bfff700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1c6005a150 0x7f1c6005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:40.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.868+0000 7f1c7bfff700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1c6005a150 0x7f1c6005c610 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1c7c0a8060 tx=0x7f1c68008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:40.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:40.872+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1c700474a0 con 0x7f1c7c065b50 2023-08-17T00:09:41.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.068+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c7c06b530 con 0x7f1c7c065b50 2023-08-17T00:09:41.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.068+0000 7f1c78ff9700 1 -- 172.21.15.153:0/3023120927 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4501 (secure 0 0 0) 0x7f1c7004aac0 con 0x7f1c7c065b50 2023-08-17T00:09:41.073 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:41.074 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:07:37.048946+0000","modified":"2023-08-17T00:09:25.398889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/2081650727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2081650727},{"type":"v1","addr":"172.21.15.153:6835","nonce":2081650727}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1c6005a150 msgr2=0x7f1c6005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1c6005a150 0x7f1c6005c610 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7f1c7c0a8060 tx=0x7f1c68008040).stop 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 msgr2=0x7f1c7c1646c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c1646c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f1c7000c4c0 tx=0x7f1c70007e00).stop 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 shutdown_connections 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1c6005a150 0x7f1c6005c610 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c7c151f70 0x7f1c7c154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7c151b90 0x7f1c7c168520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 --2- 172.21.15.153:0/3023120927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1c7c065b50 0x7f1c7c1646c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 >> 172.21.15.153:0/3023120927 conn(0x7f1c7c0c7150 msgr2=0x7f1c7c0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:41.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 shutdown_connections 2023-08-17T00:09:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.072+0000 7f1c830db700 1 -- 172.21.15.153:0/3023120927 wait complete. 2023-08-17T00:09:41.078 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 77 2023-08-17T00:09:41.097 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.256+0000 7f0979bf9700 1 Processor -- start 2023-08-17T00:09:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.256+0000 7f0979bf9700 1 -- start start 2023-08-17T00:09:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0979bf9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0974153f50 0x7f0974154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0979bf9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09740bfd10 con 0x7f09740c57a0 2023-08-17T00:09:41.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0979bf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0974154860 con 0x7f09740c01a0 2023-08-17T00:09:41.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0979bf9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0974154af0 con 0x7f0974153f50 2023-08-17T00:09:41.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0974153f50 0x7f0974154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0974153f50 0x7f0974154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37728/0 (socket says 172.21.15.153:37728) 2023-08-17T00:09:41.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 -- 172.21.15.153:0/3282132820 learned_addr learned my addr 172.21.15.153:0/3282132820 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:41.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 -- 172.21.15.153:0/3282132820 >> v1:172.21.15.178:6789/0 conn(0x7f09740c01a0 legacy=0x7f09740c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:41.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 -- 172.21.15.153:0/3282132820 >> v1:172.21.15.153:6789/0 conn(0x7f09740c57a0 legacy=0x7f09740c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 -- 172.21.15.153:0/3282132820 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0974154dd0 con 0x7f0974153f50 2023-08-17T00:09:41.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0973fff700 1 --2- 172.21.15.153:0/3282132820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0974153f50 0x7f0974154370 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f0960006fd0 tx=0x7f09600090f0).ready entity=mon.0 client_cookie=74f2ec391d1b33ae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:41.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f09737fe700 1 -- 172.21.15.153:0/3282132820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000b600 con 0x7f0974153f50 2023-08-17T00:09:41.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f09737fe700 1 -- 172.21.15.153:0/3282132820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096000b760 con 0x7f0974153f50 2023-08-17T00:09:41.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f09737fe700 1 -- 172.21.15.153:0/3282132820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000bae0 con 0x7f0974153f50 2023-08-17T00:09:41.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0979bf9700 1 -- 172.21.15.153:0/3282132820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0974153f50 msgr2=0x7f0974154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.260+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3282132820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0974153f50 0x7f0974154370 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 rx=0x7f0960006fd0 tx=0x7f09600090f0).stop 2023-08-17T00:09:41.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- 172.21.15.153:0/3282132820 shutdown_connections 2023-08-17T00:09:41.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3282132820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0974153f50 0x7f0974154370 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- 172.21.15.153:0/3282132820 >> 172.21.15.153:0/3282132820 conn(0x7f0974062a70 msgr2=0x7f09740ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:41.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- 172.21.15.153:0/3282132820 shutdown_connections 2023-08-17T00:09:41.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- 172.21.15.153:0/3282132820 wait complete. 2023-08-17T00:09:41.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 Processor -- start 2023-08-17T00:09:41.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- start start 2023-08-17T00:09:41.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09740c01a0 0x7f09741645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 0x7f097414a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0974153f50 0x7f09740c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0974164ab0 con 0x7f09740c57a0 2023-08-17T00:09:41.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097414ab60 con 0x7f0974153f50 2023-08-17T00:09:41.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.264+0000 7f0979bf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097414f370 con 0x7f09740c01a0 2023-08-17T00:09:41.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 0x7f097414a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 0x7f097414a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37740/0 (socket says 172.21.15.153:37740) 2023-08-17T00:09:41.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 -- 172.21.15.153:0/3074729189 learned_addr learned my addr 172.21.15.153:0/3074729189 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:41.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0978bf7700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09740c01a0 0x7f09741645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f09793f8700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0974153f50 0x7f09740c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 -- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09740c01a0 msgr2=0x7f09741645c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09740c01a0 0x7f09741645c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 -- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0974153f50 msgr2=0x7f09740c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0974153f50 0x7f09740c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 -- 172.21.15.153:0/3074729189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960009370 con 0x7f09740c57a0 2023-08-17T00:09:41.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0973fff700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 0x7f097414a670 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f0974083860 tx=0x7f0960017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:41.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000bae0 con 0x7f09740c57a0 2023-08-17T00:09:41.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960000c90 con 0x7f09740c57a0 2023-08-17T00:09:41.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096001c670 con 0x7f09740c57a0 2023-08-17T00:09:41.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09740c7eb0 con 0x7f09740c57a0 2023-08-17T00:09:41.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097414f000 con 0x7f09740c57a0 2023-08-17T00:09:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.268+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097406b4c0 con 0x7f09740c57a0 2023-08-17T00:09:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.272+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0960022020 con 0x7f09740c57a0 2023-08-17T00:09:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.272+0000 7f0970ff9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f095805a180 0x7f095805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.272+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f0960075e00 con 0x7f09740c57a0 2023-08-17T00:09:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.272+0000 7f0978bf7700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f095805a180 0x7f095805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.272+0000 7f0978bf7700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f095805a180 0x7f095805c640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f0968003630 tx=0x7f0968009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:41.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.276+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0960049850 con 0x7f09740c57a0 2023-08-17T00:09:41.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.444+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f097406b4c0 con 0x7f09740c57a0 2023-08-17T00:09:41.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.444+0000 7f0970ff9700 1 -- 172.21.15.153:0/3074729189 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17095 (secure 0 0 0) 0x7f096004ce30 con 0x7f09740c57a0 2023-08-17T00:09:41.450 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:41.450 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":86,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:17.199625+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:07:34.961847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T00:07:36.061106+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:41.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f095805a180 msgr2=0x7f095805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f095805a180 0x7f095805c640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f0968003630 tx=0x7f0968009040).stop 2023-08-17T00:09:41.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 msgr2=0x7f097414a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 0x7f097414a670 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f0974083860 tx=0x7f0960017000).stop 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 shutdown_connections 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f095805a180 0x7f095805c640 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0974153f50 0x7f09740c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09740c57a0 0x7f097414a670 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 --2- 172.21.15.153:0/3074729189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09740c01a0 0x7f09741645c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 >> 172.21.15.153:0/3074729189 conn(0x7f0974062a70 msgr2=0x7f09740abc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 shutdown_connections 2023-08-17T00:09:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.448+0000 7f0979bf9700 1 -- 172.21.15.153:0/3074729189 wait complete. 2023-08-17T00:09:41.476 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:09:41.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:09:41.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.628+0000 7fc0a5edb700 1 Processor -- start 2023-08-17T00:09:41.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.628+0000 7fc0a5edb700 1 -- start start 2023-08-17T00:09:41.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc0a5edb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0a00a89c0 0x7fc0a00a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc0a5edb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0a00c0c80 0x7fc0a00bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc0a5edb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a00bc0b0 con 0x7fc0a01505d0 2023-08-17T00:09:41.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc0a5edb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00bd590 con 0x7fc0a00c0c80 2023-08-17T00:09:41.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc0a5edb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a0062fb0 con 0x7fc0a00a89c0 2023-08-17T00:09:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc097fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc0a00c0c80 0x7fc0a00bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc09ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc0a01505d0 0x7fc0a0150a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37438/0 (socket says 172.21.15.153:37438) 2023-08-17T00:09:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc09ffff700 1 -- 172.21.15.153:0/3401131301 learned_addr learned my addr 172.21.15.153:0/3401131301 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc09f7fe700 1 --2- 172.21.15.153:0/3401131301 >> v2:172.21.15.178:3300/0 conn(0x7fc0a00a89c0 0x7fc0a00a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc097fff700 1 -- 172.21.15.153:0/3401131301 >> v2:172.21.15.178:3300/0 conn(0x7fc0a00a89c0 msgr2=0x7fc0a00a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc097fff700 1 --2- 172.21.15.153:0/3401131301 >> v2:172.21.15.178:3300/0 conn(0x7fc0a00a89c0 0x7fc0a00a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc097fff700 1 -- 172.21.15.153:0/3401131301 >> v1:172.21.15.153:6789/0 conn(0x7fc0a01505d0 legacy=0x7fc0a0150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc097fff700 1 -- 172.21.15.153:0/3401131301 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a00bb780 con 0x7fc0a00c0c80 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc09f7fe700 1 --2- 172.21.15.153:0/3401131301 >> v2:172.21.15.178:3300/0 conn(0x7fc0a00a89c0 0x7fc0a00a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc097fff700 1 --2- 172.21.15.153:0/3401131301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00c0c80 0x7fc0a00bcdb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fc0a0067fc0 tx=0x7fc088009060).ready entity=mon.0 client_cookie=e898e3d9f8ce2bbd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:41.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc09effd700 1 -- 172.21.15.153:0/3401131301 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08800b580 con 0x7fc0a00c0c80 2023-08-17T00:09:41.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.632+0000 7fc09effd700 1 -- 172.21.15.153:0/3401131301 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08800b6e0 con 0x7fc0a00c0c80 2023-08-17T00:09:41.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc09effd700 1 -- 172.21.15.153:0/3401131301 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08800ba60 con 0x7fc0a00c0c80 2023-08-17T00:09:41.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 -- 172.21.15.153:0/3401131301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00c0c80 msgr2=0x7fc0a00bcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/3401131301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00c0c80 0x7fc0a00bcdb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7fc0a0067fc0 tx=0x7fc088009060).stop 2023-08-17T00:09:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 -- 172.21.15.153:0/3401131301 shutdown_connections 2023-08-17T00:09:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/3401131301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00c0c80 0x7fc0a00bcdb0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/3401131301 >> v2:172.21.15.178:3300/0 conn(0x7fc0a00a89c0 0x7fc0a00a8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 -- 172.21.15.153:0/3401131301 >> 172.21.15.153:0/3401131301 conn(0x7fc0a00c7150 msgr2=0x7fc0a00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 -- 172.21.15.153:0/3401131301 shutdown_connections 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.636+0000 7fc0a5edb700 1 -- 172.21.15.153:0/3401131301 wait complete. 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 Processor -- start 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 -- start start 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 0x7fc0a01492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0a00c0c80 0x7fc0a00a7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a01505d0 0x7fc0a00c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0164200 con 0x7fc0a00a89c0 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00a82a0 con 0x7fc0a01505d0 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc0a5edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a00a84b0 con 0x7fc0a00c0c80 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 0x7fc0a01492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 0x7fc0a01492c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37756/0 (socket says 172.21.15.153:37756) 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 -- 172.21.15.153:0/543101990 learned_addr learned my addr 172.21.15.153:0/543101990 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09ffff700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a01505d0 0x7fc0a00c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc097fff700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0a00c0c80 0x7fc0a00a7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 -- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0a00c0c80 msgr2=0x7fc0a00a7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0a00c0c80 0x7fc0a00a7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 -- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a01505d0 msgr2=0x7fc0a00c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a01505d0 0x7fc0a00c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 -- 172.21.15.153:0/543101990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880092a0 con 0x7fc0a00a89c0 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc097fff700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0a00c0c80 0x7fc0a00a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09ffff700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a01505d0 0x7fc0a00c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.640+0000 7fc09f7fe700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 0x7fc0a01492c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc09000d860 tx=0x7fc090008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090011590 con 0x7fc0a00a89c0 2023-08-17T00:09:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0900116f0 con 0x7fc0a00a89c0 2023-08-17T00:09:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a0164d40 con 0x7fc0a00a89c0 2023-08-17T00:09:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc090011a70 con 0x7fc0a00a89c0 2023-08-17T00:09:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0164410 con 0x7fc0a00a89c0 2023-08-17T00:09:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a0152000 con 0x7fc0a00a89c0 2023-08-17T00:09:41.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.644+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc090012420 con 0x7fc0a00a89c0 2023-08-17T00:09:41.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.648+0000 7fc0977fe700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc08405a150 0x7fc08405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:41.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.648+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc090073ee0 con 0x7fc0a00a89c0 2023-08-17T00:09:41.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.648+0000 7fc097fff700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc08405a150 0x7fc08405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:41.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.648+0000 7fc097fff700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc08405a150 0x7fc08405c610 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fc088006d30 tx=0x7fc088017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:41.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.652+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc0900477e0 con 0x7fc0a00a89c0 2023-08-17T00:09:41.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.856+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0a00bba60 con 0x7fc0a00a89c0 2023-08-17T00:09:41.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.856+0000 7fc0977fe700 1 -- 172.21.15.153:0/543101990 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fc09004ae00 con 0x7fc0a00a89c0 2023-08-17T00:09:41.861 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:41.861 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:07:37.048946+0000","modified":"2023-08-17T00:09:25.398889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/2081650727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2081650727},{"type":"v1","addr":"172.21.15.153:6835","nonce":2081650727}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T00:09:41.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc08405a150 msgr2=0x7fc08405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc08405a150 0x7fc08405c610 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7fc088006d30 tx=0x7fc088017000).stop 2023-08-17T00:09:41.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 msgr2=0x7fc0a01492c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:41.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 0x7fc0a01492c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7fc09000d860 tx=0x7fc090008040).stop 2023-08-17T00:09:41.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 shutdown_connections 2023-08-17T00:09:41.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc08405a150 0x7fc08405c610 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0a01505d0 0x7fc0a00c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0a00c0c80 0x7fc0a00a7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 --2- 172.21.15.153:0/543101990 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc0a00a89c0 0x7fc0a01492c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:41.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 >> 172.21.15.153:0/543101990 conn(0x7fc0a00c7150 msgr2=0x7fc0a014a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:41.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 shutdown_connections 2023-08-17T00:09:41.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:41.860+0000 7fc0a5edb700 1 -- 172.21.15.153:0/543101990 wait complete. 2023-08-17T00:09:41.868 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 77 2023-08-17T00:09:41.885 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:09:42.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 Processor -- start 2023-08-17T00:09:42.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 -- start start 2023-08-17T00:09:42.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 0x7fc450153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4500c59e0 0x7fc4500641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4500c0330 con 0x7fc4500c07c0 2023-08-17T00:09:42.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4500646e0 con 0x7fc4500c59e0 2023-08-17T00:09:42.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc455746700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500c5e40 con 0x7fc450153ab0 2023-08-17T00:09:42.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc44effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 0x7fc450153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc44e7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4500c59e0 0x7fc4500641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc44effd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 0x7fc450153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:40798/0 (socket says 172.21.15.153:40798) 2023-08-17T00:09:42.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.040+0000 7fc44effd700 1 -- 172.21.15.153:0/981868568 learned_addr learned my addr 172.21.15.153:0/981868568 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:42.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44effd700 1 -- 172.21.15.153:0/981868568 >> v2:172.21.15.178:3300/0 conn(0x7fc4500c59e0 msgr2=0x7fc4500641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44effd700 1 --2- 172.21.15.153:0/981868568 >> v2:172.21.15.178:3300/0 conn(0x7fc4500c59e0 0x7fc4500641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44effd700 1 -- 172.21.15.153:0/981868568 >> v1:172.21.15.178:6789/0 conn(0x7fc4500c07c0 legacy=0x7fc450061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44effd700 1 -- 172.21.15.153:0/981868568 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4500c60a0 con 0x7fc450153ab0 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44effd700 1 --2- 172.21.15.153:0/981868568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 0x7fc450153e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc440006fd0 tx=0x7fc4400090f0).ready entity=mon.2 client_cookie=f592bbb09279608d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44dffb700 1 -- 172.21.15.153:0/981868568 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000b580 con 0x7fc450153ab0 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44dffb700 1 -- 172.21.15.153:0/981868568 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000b6e0 con 0x7fc450153ab0 2023-08-17T00:09:42.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc44dffb700 1 -- 172.21.15.153:0/981868568 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000ba80 con 0x7fc450153ab0 2023-08-17T00:09:42.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 -- 172.21.15.153:0/981868568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 msgr2=0x7fc450153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 --2- 172.21.15.153:0/981868568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 0x7fc450153e90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7fc440006fd0 tx=0x7fc4400090f0).stop 2023-08-17T00:09:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 -- 172.21.15.153:0/981868568 shutdown_connections 2023-08-17T00:09:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 --2- 172.21.15.153:0/981868568 >> v2:172.21.15.178:3300/0 conn(0x7fc4500c59e0 0x7fc4500641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 --2- 172.21.15.153:0/981868568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc450153ab0 0x7fc450153e90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 -- 172.21.15.153:0/981868568 >> 172.21.15.153:0/981868568 conn(0x7fc4500caaa0 msgr2=0x7fc4500caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 -- 172.21.15.153:0/981868568 shutdown_connections 2023-08-17T00:09:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.044+0000 7fc455746700 1 -- 172.21.15.153:0/981868568 wait complete. 2023-08-17T00:09:42.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.048+0000 7fc455746700 1 Processor -- start 2023-08-17T00:09:42.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.048+0000 7fc455746700 1 -- start start 2023-08-17T00:09:42.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 0x7fc4500c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4500c59e0 0x7fc450157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc450153ab0 0x7fc450063630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500c1b40 con 0x7fc4500c07c0 2023-08-17T00:09:42.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500c2960 con 0x7fc450153ab0 2023-08-17T00:09:42.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500c1d50 con 0x7fc4500c59e0 2023-08-17T00:09:42.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 0x7fc4500c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 0x7fc4500c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37770/0 (socket says 172.21.15.153:37770) 2023-08-17T00:09:42.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 -- 172.21.15.153:0/2182834011 learned_addr learned my addr 172.21.15.153:0/2182834011 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:42.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44e7fc700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4500c59e0 0x7fc450157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44f7fe700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc450153ab0 0x7fc450063630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 -- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4500c59e0 msgr2=0x7fc450157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4500c59e0 0x7fc450157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 -- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc450153ab0 msgr2=0x7fc450063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc450153ab0 0x7fc450063630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 -- 172.21.15.153:0/2182834011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc440009370 con 0x7fc4500c07c0 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc44effd700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 0x7fc4500c4640 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fc4500c5f80 tx=0x7fc440017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44000b850 con 0x7fc4500c07c0 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44000b9b0 con 0x7fc4500c07c0 2023-08-17T00:09:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4500c2030 con 0x7fc4500c07c0 2023-08-17T00:09:42.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44001d660 con 0x7fc4500c07c0 2023-08-17T00:09:42.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.052+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500c25f0 con 0x7fc4500c07c0 2023-08-17T00:09:42.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.056+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45006b530 con 0x7fc4500c07c0 2023-08-17T00:09:42.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.056+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc44000f070 con 0x7fc4500c07c0 2023-08-17T00:09:42.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.060+0000 7fc436ffd700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc43c05a180 0x7fc43c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.060+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7fc440075cb0 con 0x7fc4500c07c0 2023-08-17T00:09:42.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.060+0000 7fc44e7fc700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc43c05a180 0x7fc43c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.060+0000 7fc44e7fc700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc43c05a180 0x7fc43c05c640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fc450153420 tx=0x7fc444008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.064+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc440049610 con 0x7fc4500c07c0 2023-08-17T00:09:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.260+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4500bfa00 con 0x7fc4500c07c0 2023-08-17T00:09:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.260+0000 7fc436ffd700 1 -- 172.21.15.153:0/2182834011 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4501 (secure 0 0 0) 0x7fc440021070 con 0x7fc4500c07c0 2023-08-17T00:09:42.266 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:42.267 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-08-17T00:07:37.048946+0000","modified":"2023-08-17T00:09:25.398889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6681},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6681":{"gid":6681,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":30,"addr":"172.21.15.153:6835/2081650727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":2081650727},{"type":"v1","addr":"172.21.15.153:6835","nonce":2081650727}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-08-17T00:09:42.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc43c05a180 msgr2=0x7fc43c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc43c05a180 0x7fc43c05c640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fc450153420 tx=0x7fc444008040).stop 2023-08-17T00:09:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 msgr2=0x7fc4500c4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 0x7fc4500c4640 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7fc4500c5f80 tx=0x7fc440017000).stop 2023-08-17T00:09:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 shutdown_connections 2023-08-17T00:09:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc43c05a180 0x7fc43c05c640 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc450153ab0 0x7fc450063630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4500c59e0 0x7fc450157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 --2- 172.21.15.153:0/2182834011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4500c07c0 0x7fc4500c4640 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 >> 172.21.15.153:0/2182834011 conn(0x7fc4500caaa0 msgr2=0x7fc4500ab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:42.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 shutdown_connections 2023-08-17T00:09:42.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.264+0000 7fc455746700 1 -- 172.21.15.153:0/2182834011 wait complete. 2023-08-17T00:09:42.271 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 77 2023-08-17T00:09:42.287 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:42.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.440+0000 7f28d8d69700 1 Processor -- start 2023-08-17T00:09:42.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.444+0000 7f28d8d69700 1 -- start start 2023-08-17T00:09:42.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.444+0000 7f28d8d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 0x7f28d40a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.444+0000 7f28d8d69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28d41505d0 0x7f28d4150a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.444+0000 7f28d8d69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d40bc0b0 con 0x7f28d40c0c80 2023-08-17T00:09:42.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.444+0000 7f28d8d69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d40bd590 con 0x7f28d41505d0 2023-08-17T00:09:42.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.444+0000 7f28d8d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4062fb0 con 0x7f28d40a89c0 2023-08-17T00:09:42.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d2d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28d41505d0 0x7f28d4150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 0x7f28d40a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d2d9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28d41505d0 0x7f28d4150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:36882/0 (socket says 172.21.15.153:36882) 2023-08-17T00:09:42.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d1d9b700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f28d40c0c80 0x7f28d40bcdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:38924/0 (socket says 172.21.15.153:38924) 2023-08-17T00:09:42.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d1d9b700 1 -- 172.21.15.153:0/185645857 learned_addr learned my addr 172.21.15.153:0/185645857 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:42.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 0x7f28d40a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:40808/0 (socket says 172.21.15.153:40808) 2023-08-17T00:09:42.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d159a700 1 -- 172.21.15.153:0/185645857 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 895341961 0 0) 0x7f28d40bc0b0 con 0x7f28d40c0c80 2023-08-17T00:09:42.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d159a700 1 -- 172.21.15.153:0/185645857 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28bc0033f0 con 0x7f28d40c0c80 2023-08-17T00:09:42.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 -- 172.21.15.153:0/185645857 >> v2:172.21.15.178:3300/0 conn(0x7f28d41505d0 msgr2=0x7f28d4150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:42.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 --2- 172.21.15.153:0/185645857 >> v2:172.21.15.178:3300/0 conn(0x7f28d41505d0 0x7f28d4150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 -- 172.21.15.153:0/185645857 >> v1:172.21.15.178:6789/0 conn(0x7f28d40c0c80 legacy=0x7f28d40bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 -- 172.21.15.153:0/185645857 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40bb780 con 0x7f28d40a89c0 2023-08-17T00:09:42.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d259c700 1 --2- 172.21.15.153:0/185645857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 0x7f28d40a8da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f28c4009790 tx=0x7f28c4009060).ready entity=mon.2 client_cookie=b7b29670fc9e1948 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d159a700 1 -- 172.21.15.153:0/185645857 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40090d0 con 0x7f28d40a89c0 2023-08-17T00:09:42.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d159a700 1 -- 172.21.15.153:0/185645857 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c400d4a0 con 0x7f28d40a89c0 2023-08-17T00:09:42.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d159a700 1 -- 172.21.15.153:0/185645857 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c400d820 con 0x7f28d40a89c0 2023-08-17T00:09:42.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 -- 172.21.15.153:0/185645857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 msgr2=0x7f28d40a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 --2- 172.21.15.153:0/185645857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 0x7f28d40a8da0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f28c4009790 tx=0x7f28c4009060).stop 2023-08-17T00:09:42.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 -- 172.21.15.153:0/185645857 shutdown_connections 2023-08-17T00:09:42.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 --2- 172.21.15.153:0/185645857 >> v2:172.21.15.178:3300/0 conn(0x7f28d41505d0 0x7f28d4150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 --2- 172.21.15.153:0/185645857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d40a89c0 0x7f28d40a8da0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 -- 172.21.15.153:0/185645857 >> 172.21.15.153:0/185645857 conn(0x7f28d40c7150 msgr2=0x7f28d40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:42.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 -- 172.21.15.153:0/185645857 shutdown_connections 2023-08-17T00:09:42.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.448+0000 7f28d8d69700 1 -- 172.21.15.153:0/185645857 wait complete. 2023-08-17T00:09:42.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 Processor -- start 2023-08-17T00:09:42.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 -- start start 2023-08-17T00:09:42.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 0x7f28d4143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28d40c0c80 0x7f28d4147db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d41505d0 0x7f28d413f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d40c00f0 con 0x7f28d40a89c0 2023-08-17T00:09:42.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41482a0 con 0x7f28d40c0c80 2023-08-17T00:09:42.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d8d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41451a0 con 0x7f28d41505d0 2023-08-17T00:09:42.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 0x7f28d4143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 0x7f28d4143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37786/0 (socket says 172.21.15.153:37786) 2023-08-17T00:09:42.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d259c700 1 -- 172.21.15.153:0/2521792623 learned_addr learned my addr 172.21.15.153:0/2521792623 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:42.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d1d9b700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28d40c0c80 0x7f28d4147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.452+0000 7f28d2d9d700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d41505d0 0x7f28d413f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d259c700 1 -- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d41505d0 msgr2=0x7f28d413f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d259c700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d41505d0 0x7f28d413f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d259c700 1 -- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28d40c0c80 msgr2=0x7f28d4147db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d259c700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28d40c0c80 0x7f28d4147db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d259c700 1 -- 172.21.15.153:0/2521792623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40092a0 con 0x7f28d40a89c0 2023-08-17T00:09:42.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d259c700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 0x7f28d4143f00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f28c400d940 tx=0x7f28c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c40128a0 con 0x7f28d40a89c0 2023-08-17T00:09:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4012a00 con 0x7f28d40a89c0 2023-08-17T00:09:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d4144590 con 0x7f28d40a89c0 2023-08-17T00:09:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4012dc0 con 0x7f28d40a89c0 2023-08-17T00:09:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4144b50 con 0x7f28d40a89c0 2023-08-17T00:09:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.456+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d406b530 con 0x7f28d40a89c0 2023-08-17T00:09:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.460+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f28c400f070 con 0x7f28d40a89c0 2023-08-17T00:09:42.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.460+0000 7f28c27fc700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28b405a150 0x7f28b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.460+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7f28c4075440 con 0x7f28d40a89c0 2023-08-17T00:09:42.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.460+0000 7f28d1d9b700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28b405a150 0x7f28b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.460+0000 7f28d1d9b700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28b405a150 0x7f28b405c610 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f28d4143eb0 tx=0x7f28c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.468+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f28c4048e30 con 0x7f28d40a89c0 2023-08-17T00:09:42.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.628+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28d40bba60 con 0x7f28d40a89c0 2023-08-17T00:09:42.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.628+0000 7f28c27fc700 1 -- 172.21.15.153:0/2521792623 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+17095 (secure 0 0 0) 0x7f28c404c450 con 0x7f28d40a89c0 2023-08-17T00:09:42.635 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:42.635 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":86,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:17.199625+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:07:34.961847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"78","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-08-17T00:07:36.061106+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":85,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.33","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:42.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28b405a150 msgr2=0x7f28b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28b405a150 0x7f28b405c610 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f28d4143eb0 tx=0x7f28c8009040).stop 2023-08-17T00:09:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 msgr2=0x7f28d4143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 0x7f28d4143f00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 rx=0x7f28c400d940 tx=0x7f28c4016000).stop 2023-08-17T00:09:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 shutdown_connections 2023-08-17T00:09:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f28b405a150 0x7f28b405c610 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28d41505d0 0x7f28d413f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28d40c0c80 0x7f28d4147db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 --2- 172.21.15.153:0/2521792623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f28d40a89c0 0x7f28d4143f00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 >> 172.21.15.153:0/2521792623 conn(0x7f28d40c7150 msgr2=0x7f28d4068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:42.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 shutdown_connections 2023-08-17T00:09:42.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.632+0000 7f28d8d69700 1 -- 172.21.15.153:0/2521792623 wait complete. 2023-08-17T00:09:42.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:09:42.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.808+0000 7ff217e5b700 1 Processor -- start 2023-08-17T00:09:42.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.808+0000 7ff217e5b700 1 -- start start 2023-08-17T00:09:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff217e5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff210153ab0 0x7ff210153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff217e5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100aa750 con 0x7ff2100c7ba0 2023-08-17T00:09:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff217e5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100c9dd0 con 0x7ff2100c8d50 2023-08-17T00:09:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff217e5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100aacf0 con 0x7ff210153ab0 2023-08-17T00:09:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff215bf7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff210153ab0 0x7ff210153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff2163f8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff2100c7ba0 0x7ff2100ab180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37446/0 (socket says 172.21.15.153:37446) 2023-08-17T00:09:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff2163f8700 1 -- 172.21.15.153:0/1677928744 learned_addr learned my addr 172.21.15.153:0/1677928744 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff215bf7700 1 -- 172.21.15.153:0/1677928744 >> v1:172.21.15.178:6789/0 conn(0x7ff2100c8d50 legacy=0x7ff2100c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff215bf7700 1 -- 172.21.15.153:0/1677928744 >> v1:172.21.15.153:6789/0 conn(0x7ff2100c7ba0 legacy=0x7ff2100ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff215bf7700 1 -- 172.21.15.153:0/1677928744 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100c5ca0 con 0x7ff210153ab0 2023-08-17T00:09:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff214bf5700 1 -- 172.21.15.153:0/1677928744 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3348827350 0 0) 0x7ff2100aa750 con 0x7ff2100c7ba0 2023-08-17T00:09:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.812+0000 7ff215bf7700 1 --2- 172.21.15.153:0/1677928744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210153e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7ff20c009760 tx=0x7ff20c009060).ready entity=mon.1 client_cookie=ae2cac25b503b330 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff214bf5700 1 -- 172.21.15.153:0/1677928744 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c009120 con 0x7ff210153ab0 2023-08-17T00:09:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff214bf5700 1 -- 172.21.15.153:0/1677928744 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00b580 con 0x7ff210153ab0 2023-08-17T00:09:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff214bf5700 1 -- 172.21.15.153:0/1677928744 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00b900 con 0x7ff210153ab0 2023-08-17T00:09:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 -- 172.21.15.153:0/1677928744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 msgr2=0x7ff210153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 --2- 172.21.15.153:0/1677928744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210153e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7ff20c009760 tx=0x7ff20c009060).stop 2023-08-17T00:09:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 -- 172.21.15.153:0/1677928744 shutdown_connections 2023-08-17T00:09:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 --2- 172.21.15.153:0/1677928744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210153e90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 -- 172.21.15.153:0/1677928744 >> 172.21.15.153:0/1677928744 conn(0x7ff210061fa0 msgr2=0x7ff2100623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 -- 172.21.15.153:0/1677928744 shutdown_connections 2023-08-17T00:09:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.816+0000 7ff217e5b700 1 -- 172.21.15.153:0/1677928744 wait complete. 2023-08-17T00:09:42.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 Processor -- start 2023-08-17T00:09:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 -- start start 2023-08-17T00:09:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 0x7ff2100c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c8d50 0x7ff2100afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210158280 con 0x7ff2100c7ba0 2023-08-17T00:09:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210157670 con 0x7ff210153ab0 2023-08-17T00:09:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210157950 con 0x7ff2100c8d50 2023-08-17T00:09:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 0x7ff2100c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 0x7ff2100c42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37792/0 (socket says 172.21.15.153:37792) 2023-08-17T00:09:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 -- 172.21.15.153:0/684505025 learned_addr learned my addr 172.21.15.153:0/684505025 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff2163f8700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff2153f6700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c8d50 0x7ff2100afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 -- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c8d50 msgr2=0x7ff2100afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c8d50 0x7ff2100afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 -- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 msgr2=0x7ff210150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 -- 172.21.15.153:0/684505025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff20c0092a0 con 0x7ff2100c7ba0 2023-08-17T00:09:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff2153f6700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c8d50 0x7ff2100afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff2163f8700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:42.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff215bf7700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 0x7ff2100c42e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7ff20c00b340 tx=0x7ff20c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c00bec0 con 0x7ff2100c7ba0 2023-08-17T00:09:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00b6f0 con 0x7ff2100c7ba0 2023-08-17T00:09:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff210157c30 con 0x7ff2100c7ba0 2023-08-17T00:09:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.820+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c01b440 con 0x7ff2100c7ba0 2023-08-17T00:09:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.824+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff210158710 con 0x7ff2100c7ba0 2023-08-17T00:09:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.824+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21006b530 con 0x7ff2100c7ba0 2023-08-17T00:09:42.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.828+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff20c02a070 con 0x7ff2100c7ba0 2023-08-17T00:09:42.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.828+0000 7ff205ffb700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1f405a150 0x7ff1f405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:42.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.828+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6178+0+0 (secure 0 0 0) 0x7ff20c0757d0 con 0x7ff2100c7ba0 2023-08-17T00:09:42.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.828+0000 7ff2153f6700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1f405a150 0x7ff1f405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:42.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.828+0000 7ff2153f6700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1f405a150 0x7ff1f405c610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff2100c0040 tx=0x7ff200009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:42.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:42.832+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff20c049130 con 0x7ff2100c7ba0 2023-08-17T00:09:43.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.028+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff2100c9810 con 0x7ff2100c7ba0 2023-08-17T00:09:43.252 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:09:43.248+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:09:43.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.256+0000 7ff205ffb700 1 -- 172.21.15.153:0/684505025 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff20c028090 con 0x7ff2100c7ba0 2023-08-17T00:09:43.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1f405a150 msgr2=0x7ff1f405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1f405a150 0x7ff1f405c610 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7ff2100c0040 tx=0x7ff200009040).stop 2023-08-17T00:09:43.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 msgr2=0x7ff2100c42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 0x7ff2100c42e0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7ff20c00b340 tx=0x7ff20c017000).stop 2023-08-17T00:09:43.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 shutdown_connections 2023-08-17T00:09:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1f405a150 0x7ff1f405c610 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff210153ab0 0x7ff210150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2100c8d50 0x7ff2100afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 --2- 172.21.15.153:0/684505025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff2100c7ba0 0x7ff2100c42e0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 >> 172.21.15.153:0/684505025 conn(0x7ff210061fa0 msgr2=0x7ff2100ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:43.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 shutdown_connections 2023-08-17T00:09:43.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.264+0000 7ff217e5b700 1 -- 172.21.15.153:0/684505025 wait complete. 2023-08-17T00:09:43.275 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:09:43.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:09:43.340 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:09:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.452+0000 7fea1f569700 1 Processor -- start 2023-08-17T00:09:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.452+0000 7fea1f569700 1 -- start start 2023-08-17T00:09:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.452+0000 7fea1f569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fea18151b90 0x7fea18151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.452+0000 7fea1f569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea18061fa0 con 0x7fea18064870 2023-08-17T00:09:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.452+0000 7fea1f569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea180621f0 con 0x7fea18063290 2023-08-17T00:09:43.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.452+0000 7fea1f569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea180c3fb0 con 0x7fea18151b90 2023-08-17T00:09:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1db06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fea18064870 0x7fea180a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37456/0 (socket says 172.21.15.153:37456) 2023-08-17T00:09:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1db06700 1 -- 172.21.15.153:0/2033344907 learned_addr learned my addr 172.21.15.153:0/2033344907 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1d305700 1 --2- 172.21.15.153:0/2033344907 >> v2:172.21.15.178:3300/0 conn(0x7fea18151b90 0x7fea18151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337989741 0 0) 0x7fea18061fa0 con 0x7fea18064870 2023-08-17T00:09:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea040033f0 con 0x7fea18064870 2023-08-17T00:09:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580659056 0 0) 0x7fea180621f0 con 0x7fea18063290 2023-08-17T00:09:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea18061fa0 con 0x7fea18063290 2023-08-17T00:09:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1d305700 1 -- 172.21.15.153:0/2033344907 >> v1:172.21.15.178:6789/0 conn(0x7fea18063290 legacy=0x7fea18065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1d305700 1 -- 172.21.15.153:0/2033344907 >> v1:172.21.15.153:6789/0 conn(0x7fea18064870 legacy=0x7fea180a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1d305700 1 -- 172.21.15.153:0/2033344907 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea180624d0 con 0x7fea18151b90 2023-08-17T00:09:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea1d305700 1 --2- 172.21.15.153:0/2033344907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18151b90 0x7fea18151f70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fea14009760 tx=0x7fea14009060).ready entity=mon.1 client_cookie=3567c15a87efedbd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400d4a0 con 0x7fea18151b90 2023-08-17T00:09:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1400d600 con 0x7fea18151b90 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.456+0000 7fea0ffff700 1 -- 172.21.15.153:0/2033344907 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1400d980 con 0x7fea18151b90 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 -- 172.21.15.153:0/2033344907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18151b90 msgr2=0x7fea18151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 --2- 172.21.15.153:0/2033344907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18151b90 0x7fea18151f70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fea14009760 tx=0x7fea14009060).stop 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 -- 172.21.15.153:0/2033344907 shutdown_connections 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 --2- 172.21.15.153:0/2033344907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18151b90 0x7fea18151f70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 -- 172.21.15.153:0/2033344907 >> 172.21.15.153:0/2033344907 conn(0x7fea180c7150 msgr2=0x7fea180c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 -- 172.21.15.153:0/2033344907 shutdown_connections 2023-08-17T00:09:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 -- 172.21.15.153:0/2033344907 wait complete. 2023-08-17T00:09:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 Processor -- start 2023-08-17T00:09:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.460+0000 7fea1f569700 1 -- start start 2023-08-17T00:09:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18063290 0x7fea18165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18064870 0x7fea18146470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 0x7fea18146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18168900 con 0x7fea18151b90 2023-08-17T00:09:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea18164bc0 con 0x7fea18063290 2023-08-17T00:09:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea18168620 con 0x7fea18064870 2023-08-17T00:09:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 0x7fea18146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 0x7fea18146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37808/0 (socket says 172.21.15.153:37808) 2023-08-17T00:09:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 -- 172.21.15.153:0/2214724909 learned_addr learned my addr 172.21.15.153:0/2214724909 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1d305700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18063290 0x7fea18165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1cb04700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18064870 0x7fea18146470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 -- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18064870 msgr2=0x7fea18146470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18064870 0x7fea18146470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 -- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18063290 msgr2=0x7fea18165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18063290 0x7fea18165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 -- 172.21.15.153:0/2214724909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140092a0 con 0x7fea18151b90 2023-08-17T00:09:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1d305700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18063290 0x7fea18165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1db06700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 0x7fea18146e80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fea1000c7d0 tx=0x7fea10001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10005d30 con 0x7fea18151b90 2023-08-17T00:09:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea18164570 con 0x7fea18151b90 2023-08-17T00:09:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea10005e90 con 0x7fea18151b90 2023-08-17T00:09:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea10007320 con 0x7fea18151b90 2023-08-17T00:09:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea18147370 con 0x7fea18151b90 2023-08-17T00:09:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.464+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea181643d0 con 0x7fea18151b90 2023-08-17T00:09:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.468+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fea10010030 con 0x7fea18151b90 2023-08-17T00:09:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.468+0000 7fea0d7fa700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe9fc05a150 0x7fe9fc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:43.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.468+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6236+0+0 (secure 0 0 0) 0x7fea10074260 con 0x7fea18151b90 2023-08-17T00:09:43.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.468+0000 7fea1d305700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe9fc05a150 0x7fe9fc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:43.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.468+0000 7fea1d305700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe9fc05a150 0x7fe9fc05c610 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fea14006d60 tx=0x7fea14016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:43.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.476+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea181643d0 con 0x7fea18151b90 2023-08-17T00:09:43.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:43.676+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fea181643d0 con 0x7fea18151b90 2023-08-17T00:09:44.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.276+0000 7fea0d7fa700 1 -- 172.21.15.153:0/2214724909 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7fea181643d0 con 0x7fea18151b90 2023-08-17T00:09:44.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe9fc05a150 msgr2=0x7fe9fc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:44.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe9fc05a150 0x7fe9fc05c610 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fea14006d60 tx=0x7fea14016000).stop 2023-08-17T00:09:44.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 msgr2=0x7fea18146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:44.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 0x7fea18146e80 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 rx=0x7fea1000c7d0 tx=0x7fea10001650).stop 2023-08-17T00:09:44.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 shutdown_connections 2023-08-17T00:09:44.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe9fc05a150 0x7fe9fc05c610 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea18151b90 0x7fea18146e80 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea18064870 0x7fea18146470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 --2- 172.21.15.153:0/2214724909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea18063290 0x7fea18165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 >> 172.21.15.153:0/2214724909 conn(0x7fea180c7150 msgr2=0x7fea180abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:44.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 shutdown_connections 2023-08-17T00:09:44.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.280+0000 7fea1f569700 1 -- 172.21.15.153:0/2214724909 wait complete. 2023-08-17T00:09:44.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:09:44.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.512+0000 7febf1707700 1 Processor -- start 2023-08-17T00:09:44.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.512+0000 7febf1707700 1 -- start start 2023-08-17T00:09:44.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf1707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec153d90 0x7febec0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf1707700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febec0cb450 0x7febec0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf1707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0c00d0 con 0x7febec1539b0 2023-08-17T00:09:44.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf1707700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febec0639c0 con 0x7febec0cb450 2023-08-17T00:09:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf1707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0aa180 con 0x7febec153d90 2023-08-17T00:09:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febec0cb450 0x7febec0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:44.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7febec0cb450 0x7febec0a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37816/0 (socket says 172.21.15.153:37816) 2023-08-17T00:09:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 -- 172.21.15.153:0/2019207329 learned_addr learned my addr 172.21.15.153:0/2019207329 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:44.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febeb7fe700 1 --2- 172.21.15.153:0/2019207329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec153d90 0x7febec0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:44.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 -- 172.21.15.153:0/2019207329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec153d90 msgr2=0x7febec0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:44.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 --2- 172.21.15.153:0/2019207329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec153d90 0x7febec0a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 -- 172.21.15.153:0/2019207329 >> v1:172.21.15.178:6789/0 conn(0x7febec1539b0 legacy=0x7febec0632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:44.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 -- 172.21.15.153:0/2019207329 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0bf810 con 0x7febec0cb450 2023-08-17T00:09:44.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febf0f06700 1 --2- 172.21.15.153:0/2019207329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec0cb450 0x7febec0a9c90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7febe4009f20 tx=0x7febe4009840).ready entity=mon.0 client_cookie=86a77bad20b59cac server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:44.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febeaffd700 1 -- 172.21.15.153:0/2019207329 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400e070 con 0x7febec0cb450 2023-08-17T00:09:44.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febeaffd700 1 -- 172.21.15.153:0/2019207329 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400b9d0 con 0x7febec0cb450 2023-08-17T00:09:44.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.516+0000 7febeaffd700 1 -- 172.21.15.153:0/2019207329 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400bd50 con 0x7febec0cb450 2023-08-17T00:09:44.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 -- 172.21.15.153:0/2019207329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec0cb450 msgr2=0x7febec0a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:44.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 --2- 172.21.15.153:0/2019207329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec0cb450 0x7febec0a9c90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7febe4009f20 tx=0x7febe4009840).stop 2023-08-17T00:09:44.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 -- 172.21.15.153:0/2019207329 shutdown_connections 2023-08-17T00:09:44.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 --2- 172.21.15.153:0/2019207329 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec0cb450 0x7febec0a9c90 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 --2- 172.21.15.153:0/2019207329 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec153d90 0x7febec0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 -- 172.21.15.153:0/2019207329 >> 172.21.15.153:0/2019207329 conn(0x7febec062a10 msgr2=0x7febec0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:44.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 -- 172.21.15.153:0/2019207329 shutdown_connections 2023-08-17T00:09:44.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.520+0000 7febf1707700 1 -- 172.21.15.153:0/2019207329 wait complete. 2023-08-17T00:09:44.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 Processor -- start 2023-08-17T00:09:44.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 -- start start 2023-08-17T00:09:44.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec0cb450 0x7febec14a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 0x7febec167e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec153d90 0x7febec168300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1687f0 con 0x7febec1539b0 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec164d40 con 0x7febec153d90 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf1707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec165020 con 0x7febec0cb450 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 0x7febec167e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:44.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 0x7febec167e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37832/0 (socket says 172.21.15.153:37832) 2023-08-17T00:09:44.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 -- 172.21.15.153:0/4024353281 learned_addr learned my addr 172.21.15.153:0/4024353281 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:44.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf0f06700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec153d90 0x7febec168300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:44.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 -- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec0cb450 msgr2=0x7febec14a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:44.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec0cb450 0x7febec14a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:44.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 -- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec153d90 msgr2=0x7febec168300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:44.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec153d90 0x7febec168300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:44.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febeb7fe700 1 -- 172.21.15.153:0/4024353281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe4009ae0 con 0x7febec1539b0 2023-08-17T00:09:44.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.524+0000 7febf0f06700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec153d90 0x7febec168300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:44.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febeb7fe700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 0x7febec167e10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7febe000e900 tx=0x7febe0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:44.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000eea0 con 0x7febec1539b0 2023-08-17T00:09:44.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe000c850 con 0x7febec1539b0 2023-08-17T00:09:44.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec165300 con 0x7febec1539b0 2023-08-17T00:09:44.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe000cbd0 con 0x7febec1539b0 2023-08-17T00:09:44.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec168be0 con 0x7febec1539b0 2023-08-17T00:09:44.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.528+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febec046dd0 con 0x7febec1539b0 2023-08-17T00:09:44.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.532+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7febe0022070 con 0x7febec1539b0 2023-08-17T00:09:44.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.532+0000 7febd3fff700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7febd805a120 0x7febd805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:44.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.532+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6236+0+0 (secure 0 0 0) 0x7febe00746f0 con 0x7febec1539b0 2023-08-17T00:09:44.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.532+0000 7febebfff700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7febd805a120 0x7febd805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:44.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.532+0000 7febebfff700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7febd805a120 0x7febd805c5e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7febdc001560 tx=0x7febdc0079b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:44.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.540+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7febe0048020 con 0x7febec1539b0 2023-08-17T00:09:44.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:44.712+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7febec081f80 con 0x7febec1539b0 2023-08-17T00:09:45.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.292+0000 7febd3fff700 1 -- 172.21.15.153:0/4024353281 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v88) v1 ==== 181+0+0 (secure 0 0 0) 0x7febe0016070 con 0x7febec1539b0 2023-08-17T00:09:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7febd805a120 msgr2=0x7febd805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7febd805a120 0x7febd805c5e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7febdc001560 tx=0x7febdc0079b0).stop 2023-08-17T00:09:45.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 msgr2=0x7febec167e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 0x7febec167e10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7febe000e900 tx=0x7febe0009060).stop 2023-08-17T00:09:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 shutdown_connections 2023-08-17T00:09:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7febd805a120 0x7febd805c5e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7febec153d90 0x7febec168300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7febec1539b0 0x7febec167e10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 --2- 172.21.15.153:0/4024353281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7febec0cb450 0x7febec14a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:45.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 >> 172.21.15.153:0/4024353281 conn(0x7febec062a10 msgr2=0x7febec0c57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:45.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 shutdown_connections 2023-08-17T00:09:45.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.300+0000 7febf1707700 1 -- 172.21.15.153:0/4024353281 wait complete. 2023-08-17T00:09:45.307 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:09:45.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:09:45.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.488+0000 7f3bd0769700 1 Processor -- start 2023-08-17T00:09:45.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.488+0000 7f3bd0769700 1 -- start start 2023-08-17T00:09:45.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.492+0000 7f3bd0769700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3bc8096100 0x7f3bc8153f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.492+0000 7f3bd0769700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80642b0 con 0x7f3bc80a55b0 2023-08-17T00:09:45.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.492+0000 7f3bd0769700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc8095840 con 0x7f3bc8153b60 2023-08-17T00:09:45.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.492+0000 7f3bd0769700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc8095b20 con 0x7f3bc8096100 2023-08-17T00:09:45.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.492+0000 7f3bced06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3bc80a55b0 0x7f3bc80a77e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34206/0 (socket says 172.21.15.153:34206) 2023-08-17T00:09:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.492+0000 7f3bced06700 1 -- 172.21.15.153:0/2732499671 learned_addr learned my addr 172.21.15.153:0/2732499671 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315477428 0 0) 0x7f3bc80642b0 con 0x7f3bc80a55b0 2023-08-17T00:09:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb40033f0 con 0x7f3bc80a55b0 2023-08-17T00:09:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 --2- 172.21.15.153:0/2732499671 >> v2:172.21.15.178:3300/0 conn(0x7f3bc8096100 0x7f3bc8153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610747047 0 0) 0x7f3bc8095840 con 0x7f3bc8153b60 2023-08-17T00:09:45.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc80642b0 con 0x7f3bc8153b60 2023-08-17T00:09:45.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1230041969 0 0) 0x7f3bb40033f0 con 0x7f3bc80a55b0 2023-08-17T00:09:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 >> v2:172.21.15.178:3300/0 conn(0x7f3bc8096100 msgr2=0x7f3bc8153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 --2- 172.21.15.153:0/2732499671 >> v2:172.21.15.178:3300/0 conn(0x7f3bc8096100 0x7f3bc8153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 >> v1:172.21.15.178:6789/0 conn(0x7f3bc8153b60 legacy=0x7f3bc8095060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8063f40 con 0x7f3bc80a55b0 2023-08-17T00:09:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f3bc00017f0 con 0x7f3bc80a55b0 2023-08-17T00:09:45.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 >> v1:172.21.15.153:6789/0 conn(0x7f3bc80a55b0 legacy=0x7f3bc80a77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4003a70 0x7f3bb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bb4004690 0x7f3bb4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4005050 0x7f3bb400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8095b20 con 0x7f3bb4004690 2023-08-17T00:09:45.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb400bfc0 con 0x7f3bb4005050 2023-08-17T00:09:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb400c180 con 0x7f3bb4003a70 2023-08-17T00:09:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bced06700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4005050 0x7f3bb400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bce505700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4003a70 0x7f3bb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bb4004690 0x7f3bb4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 -- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4003a70 msgr2=0x7f3bb4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:45.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4003a70 0x7f3bb4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 -- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4005050 msgr2=0x7f3bb400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:45.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bb4005050 0x7f3bb400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 -- 172.21.15.153:0/2732499671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40033f0 con 0x7f3bb4004690 2023-08-17T00:09:45.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bced06700 1 -- 172.21.15.153:0/2732499671 reap_dead start 2023-08-17T00:09:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcdd04700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bb4004690 0x7f3bb4004b10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f3bb8009a80 tx=0x7f3bb8009060).ready entity=mon.0 client_cookie=532b5db03b7bc26e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8009430 con 0x7f3bb4004690 2023-08-17T00:09:45.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb800e640 con 0x7f3bb4004690 2023-08-17T00:09:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.496+0000 7f3bcd503700 1 -- 172.21.15.153:0/2732499671 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb800e9c0 con 0x7f3bb4004690 2023-08-17T00:09:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 -- 172.21.15.153:0/2732499671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bb4004690 msgr2=0x7f3bb4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bb4004690 0x7f3bb4004b10 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7f3bb8009a80 tx=0x7f3bb8009060).stop 2023-08-17T00:09:45.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 -- 172.21.15.153:0/2732499671 shutdown_connections 2023-08-17T00:09:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 --2- 172.21.15.153:0/2732499671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bb4004690 0x7f3bb4004b10 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 -- 172.21.15.153:0/2732499671 >> 172.21.15.153:0/2732499671 conn(0x7f3bc80c52e0 msgr2=0x7f3bc80c56c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 -- 172.21.15.153:0/2732499671 shutdown_connections 2023-08-17T00:09:45.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.500+0000 7f3bd0769700 1 -- 172.21.15.153:0/2732499671 wait complete. 2023-08-17T00:09:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 Processor -- start 2023-08-17T00:09:45.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 -- start start 2023-08-17T00:09:45.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4004690 0x7f3bc8152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc80ac650 0x7f3bc81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 0x7f3bc8168970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80c2870 con 0x7f3bc8156ad0 2023-08-17T00:09:45.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8169700 con 0x7f3bc80ac650 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bd0769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc8156f30 con 0x7f3bb4004690 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 0x7f3bc8168970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 0x7f3bc8168970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35050/0 (socket says 172.21.15.153:35050) 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 -- 172.21.15.153:0/4229893088 learned_addr learned my addr 172.21.15.153:0/4229893088 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bce505700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4004690 0x7f3bc8152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bcdd04700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc80ac650 0x7f3bc81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 -- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4004690 msgr2=0x7f3bc8152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4004690 0x7f3bc8152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 -- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc80ac650 msgr2=0x7f3bc81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc80ac650 0x7f3bc81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 -- 172.21.15.153:0/4229893088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80ab890 con 0x7f3bc8156ad0 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.504+0000 7f3bced06700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 0x7f3bc8168970 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f3bc805e800 tx=0x7f3bc0007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc00017f0 con 0x7f3bc8156ad0 2023-08-17T00:09:45.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc0007940 con 0x7f3bc8156ad0 2023-08-17T00:09:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80abb70 con 0x7f3bc8156ad0 2023-08-17T00:09:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000fab0 con 0x7f3bc8156ad0 2023-08-17T00:09:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc80ac130 con 0x7f3bc8156ad0 2023-08-17T00:09:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc80ac350 con 0x7f3bc8156ad0 2023-08-17T00:09:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3bc001b030 con 0x7f3bc8156ad0 2023-08-17T00:09:45.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.508+0000 7f3bbe7fc700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3bac05a150 0x7f3bac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:45.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.512+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f3bc0073860 con 0x7f3bc8156ad0 2023-08-17T00:09:45.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.512+0000 7f3bce505700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3bac05a150 0x7f3bac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:45.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.512+0000 7f3bce505700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3bac05a150 0x7f3bac05c610 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f3bc4001150 tx=0x7f3bc4007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:45.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.516+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3bc004ade0 con 0x7f3bc8156ad0 2023-08-17T00:09:45.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:45.692+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3bc806b530 con 0x7f3bc8156ad0 2023-08-17T00:09:45.817 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:09:45.824 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:09:46.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.300+0000 7f3bbe7fc700 1 -- 172.21.15.153:0/4229893088 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v89) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3bc0019030 con 0x7f3bc8156ad0 2023-08-17T00:09:46.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3bac05a150 msgr2=0x7f3bac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3bac05a150 0x7f3bac05c610 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f3bc4001150 tx=0x7f3bc4007b90).stop 2023-08-17T00:09:46.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 msgr2=0x7f3bc8168970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 0x7f3bc8168970 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7f3bc805e800 tx=0x7f3bc0007f40).stop 2023-08-17T00:09:46.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 shutdown_connections 2023-08-17T00:09:46.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3bac05a150 0x7f3bac05c610 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3bc8156ad0 0x7f3bc8168970 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3bc80ac650 0x7f3bc81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 --2- 172.21.15.153:0/4229893088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3bb4004690 0x7f3bc8152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 >> 172.21.15.153:0/4229893088 conn(0x7f3bc80c52e0 msgr2=0x7f3bc80c3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 shutdown_connections 2023-08-17T00:09:46.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.304+0000 7f3bd0769700 1 -- 172.21.15.153:0/4229893088 wait complete. 2023-08-17T00:09:46.314 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:09:46.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:09:46.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.484+0000 7f10fb59e700 1 Processor -- start 2023-08-17T00:09:46.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.488+0000 7f10fb59e700 1 -- start start 2023-08-17T00:09:46.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.488+0000 7f10fb59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f10fc0acf30 0x7f10fc0c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.488+0000 7f10fb59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f10fc063bc0 0x7f10fc0bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.488+0000 7f10fb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10fc154e90 con 0x7f10fc0c5ea0 2023-08-17T00:09:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.488+0000 7f10fb59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc153fc0 con 0x7f10fc063bc0 2023-08-17T00:09:46.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.488+0000 7f10fb59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10fc154280 con 0x7f10fc0acf30 2023-08-17T00:09:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10f9d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f10fc0c5ea0 0x7f10fc0634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34214/0 (socket says 172.21.15.153:34214) 2023-08-17T00:09:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10f9d9b700 1 -- 172.21.15.153:0/1069934465 learned_addr learned my addr 172.21.15.153:0/1069934465 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fad9d700 1 --2- 172.21.15.153:0/1069934465 >> v2:172.21.15.153:3300/0 conn(0x7f10fc063bc0 0x7f10fc0bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fa59c700 1 --2- 172.21.15.153:0/1069934465 >> v2:172.21.15.178:3300/0 conn(0x7f10fc0acf30 0x7f10fc0c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fad9d700 1 -- 172.21.15.153:0/1069934465 >> v2:172.21.15.178:3300/0 conn(0x7f10fc0acf30 msgr2=0x7f10fc0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10f959a700 1 -- 172.21.15.153:0/1069934465 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855019525 0 0) 0x7f10fc154e90 con 0x7f10fc0c5ea0 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fad9d700 1 --2- 172.21.15.153:0/1069934465 >> v2:172.21.15.178:3300/0 conn(0x7f10fc0acf30 0x7f10fc0c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fad9d700 1 -- 172.21.15.153:0/1069934465 >> v1:172.21.15.153:6789/0 conn(0x7f10fc0c5ea0 legacy=0x7f10fc0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fad9d700 1 -- 172.21.15.153:0/1069934465 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10fc154560 con 0x7f10fc063bc0 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fad9d700 1 --2- 172.21.15.153:0/1069934465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc063bc0 0x7f10fc0bfad0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f10fc05f3f0 tx=0x7f10f4009780).ready entity=mon.0 client_cookie=fbb963052146446f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10f959a700 1 -- 172.21.15.153:0/1069934465 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400e070 con 0x7f10fc063bc0 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10f959a700 1 -- 172.21.15.153:0/1069934465 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400bc30 con 0x7f10fc063bc0 2023-08-17T00:09:46.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10f959a700 1 -- 172.21.15.153:0/1069934465 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4012410 con 0x7f10fc063bc0 2023-08-17T00:09:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 -- 172.21.15.153:0/1069934465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc063bc0 msgr2=0x7f10fc0bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 --2- 172.21.15.153:0/1069934465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc063bc0 0x7f10fc0bfad0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7f10fc05f3f0 tx=0x7f10f4009780).stop 2023-08-17T00:09:46.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 -- 172.21.15.153:0/1069934465 shutdown_connections 2023-08-17T00:09:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 --2- 172.21.15.153:0/1069934465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc063bc0 0x7f10fc0bfad0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 --2- 172.21.15.153:0/1069934465 >> v2:172.21.15.178:3300/0 conn(0x7f10fc0acf30 0x7f10fc0c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 -- 172.21.15.153:0/1069934465 >> 172.21.15.153:0/1069934465 conn(0x7f10fc0cb330 msgr2=0x7f10fc0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 -- 172.21.15.153:0/1069934465 shutdown_connections 2023-08-17T00:09:46.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.492+0000 7f10fb59e700 1 -- 172.21.15.153:0/1069934465 wait complete. 2023-08-17T00:09:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 Processor -- start 2023-08-17T00:09:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 -- start start 2023-08-17T00:09:46.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10fc063bc0 0x7f10fc167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 0x7f10fc146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10fc163d90 0x7f10fc0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc146920 con 0x7f10fc0acf30 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0c2400 con 0x7f10fc163d90 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc0c1ad0 con 0x7f10fc063bc0 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 0x7f10fc146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 0x7f10fc146430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35062/0 (socket says 172.21.15.153:35062) 2023-08-17T00:09:46.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 -- 172.21.15.153:0/3479489520 learned_addr learned my addr 172.21.15.153:0/3479489520 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fad9d700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10fc163d90 0x7f10fc0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fa59c700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10fc063bc0 0x7f10fc167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 -- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10fc063bc0 msgr2=0x7f10fc167e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10fc063bc0 0x7f10fc167e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 -- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10fc163d90 msgr2=0x7f10fc0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10fc163d90 0x7f10fc0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 -- 172.21.15.153:0/3479489520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f4009a20 con 0x7f10fc0acf30 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10f9d9b700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 0x7f10fc146430 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f10f0001eb0 tx=0x7f10f0007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f00070d0 con 0x7f10fc0acf30 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f0007230 con 0x7f10fc0acf30 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc0c1db0 con 0x7f10fc0acf30 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f00075d0 con 0x7f10fc0acf30 2023-08-17T00:09:46.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.496+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc0afde0 con 0x7f10fc0acf30 2023-08-17T00:09:46.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.500+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc0c25b0 con 0x7f10fc0acf30 2023-08-17T00:09:46.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.500+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f10f0010070 con 0x7f10fc0acf30 2023-08-17T00:09:46.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.500+0000 7f10ea7fc700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10dc05a150 0x7f10dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.500+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f10f00735d0 con 0x7f10fc0acf30 2023-08-17T00:09:46.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.504+0000 7f10fa59c700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10dc05a150 0x7f10dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.504+0000 7f10fa59c700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10dc05a150 0x7f10dc05c610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f10ec00bbc0 tx=0x7f10ec008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.508+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f10fc0c25b0 con 0x7f10fc0acf30 2023-08-17T00:09:46.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.676+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f10fc0c2570 con 0x7f10fc0acf30 2023-08-17T00:09:46.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.684+0000 7f10ea7fc700 1 -- 172.21.15.153:0/3479489520 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f10f0047270 con 0x7f10fc0acf30 2023-08-17T00:09:46.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10dc05a150 msgr2=0x7f10dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10dc05a150 0x7f10dc05c610 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f10ec00bbc0 tx=0x7f10ec008040).stop 2023-08-17T00:09:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 msgr2=0x7f10fc146430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 0x7f10fc146430 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7f10f0001eb0 tx=0x7f10f0007e90).stop 2023-08-17T00:09:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 shutdown_connections 2023-08-17T00:09:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f10dc05a150 0x7f10dc05c610 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10fc163d90 0x7f10fc0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10fc0acf30 0x7f10fc146430 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 --2- 172.21.15.153:0/3479489520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10fc063bc0 0x7f10fc167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 >> 172.21.15.153:0/3479489520 conn(0x7f10fc0cb330 msgr2=0x7f10fc0ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:46.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 shutdown_connections 2023-08-17T00:09:46.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.688+0000 7f10fb59e700 1 -- 172.21.15.153:0/3479489520 wait complete. 2023-08-17T00:09:46.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2023-08-17T00:09:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.868+0000 7f592b65b700 1 Processor -- start 2023-08-17T00:09:46.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f592b65b700 1 -- start start 2023-08-17T00:09:46.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f592b65b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f59240a69b0 0x7f59240a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f592b65b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59240c3320 0x7f59240c3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f592b65b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5924154380 con 0x7f5924066ee0 2023-08-17T00:09:46.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f592b65b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59240c3c70 con 0x7f59240a69b0 2023-08-17T00:09:46.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f592b65b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59240c3ee0 con 0x7f59240c3320 2023-08-17T00:09:46.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f59293f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f59240a69b0 0x7f59240a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f5929bf8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5924066ee0 0x7f59240630b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34222/0 (socket says 172.21.15.153:34222) 2023-08-17T00:09:46.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f5929bf8700 1 -- 172.21.15.153:0/558894654 learned_addr learned my addr 172.21.15.153:0/558894654 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:46.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.872+0000 7f5928bf6700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59240c3320 0x7f59240c3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f59293f7700 1 -- 172.21.15.153:0/558894654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59240c3320 msgr2=0x7f59240c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f59293f7700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59240c3320 0x7f59240c3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f59293f7700 1 -- 172.21.15.153:0/558894654 >> v1:172.21.15.153:6789/0 conn(0x7f5924066ee0 legacy=0x7f59240630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f59293f7700 1 -- 172.21.15.153:0/558894654 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59241545d0 con 0x7f59240a69b0 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f5928bf6700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59240c3320 0x7f59240c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f59293f7700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a6d90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f5920009760 tx=0x7f5920009060).ready entity=mon.0 client_cookie=521211e278616dc1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f591bfff700 1 -- 172.21.15.153:0/558894654 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200090d0 con 0x7f59240a69b0 2023-08-17T00:09:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f591bfff700 1 -- 172.21.15.153:0/558894654 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000d4a0 con 0x7f59240a69b0 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f591bfff700 1 -- 172.21.15.153:0/558894654 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000d820 con 0x7f59240a69b0 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 -- 172.21.15.153:0/558894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 msgr2=0x7f59240a6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a6d90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f5920009760 tx=0x7f5920009060).stop 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 -- 172.21.15.153:0/558894654 shutdown_connections 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59240c3320 0x7f59240c3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 --2- 172.21.15.153:0/558894654 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a6d90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 -- 172.21.15.153:0/558894654 >> 172.21.15.153:0/558894654 conn(0x7f59240c4250 msgr2=0x7f59240c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 -- 172.21.15.153:0/558894654 shutdown_connections 2023-08-17T00:09:46.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.876+0000 7f592b65b700 1 -- 172.21.15.153:0/558894654 wait complete. 2023-08-17T00:09:46.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 Processor -- start 2023-08-17T00:09:46.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 -- start start 2023-08-17T00:09:46.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5924066ee0 0x7f5924164230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59240c3320 0x7f592414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5924167860 con 0x7f59240a69b0 2023-08-17T00:09:46.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5924164ae0 con 0x7f59240c3320 2023-08-17T00:09:46.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5924164dc0 con 0x7f5924066ee0 2023-08-17T00:09:46.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35086/0 (socket says 172.21.15.153:35086) 2023-08-17T00:09:46.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 -- 172.21.15.153:0/1235060120 learned_addr learned my addr 172.21.15.153:0/1235060120 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f59293f7700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5924066ee0 0x7f5924164230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5929bf8700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59240c3320 0x7f592414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 -- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5924066ee0 msgr2=0x7f5924164230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5924066ee0 0x7f5924164230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 -- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59240c3320 msgr2=0x7f592414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59240c3320 0x7f592414fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 -- 172.21.15.153:0/1235060120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140092a0 con 0x7f59240a69b0 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f59293f7700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5924066ee0 0x7f5924164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f5928bf6700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a5ec0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f591400e980 tx=0x7f5914009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400c850 con 0x7f59240a69b0 2023-08-17T00:09:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591400c9b0 con 0x7f59240a69b0 2023-08-17T00:09:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200092a0 con 0x7f59240a69b0 2023-08-17T00:09:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.880+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591400cd30 con 0x7f59240a69b0 2023-08-17T00:09:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.884+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5924167b20 con 0x7f59240a69b0 2023-08-17T00:09:46.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.884+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592406b530 con 0x7f59240a69b0 2023-08-17T00:09:46.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.884+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5914022070 con 0x7f59240a69b0 2023-08-17T00:09:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.888+0000 7f59197fa700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f590805a150 0x7f590805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.888+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5914074330 con 0x7f59240a69b0 2023-08-17T00:09:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.888+0000 7f59293f7700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f590805a150 0x7f590805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.888+0000 7f59293f7700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f590805a150 0x7f590805c610 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f5920006f70 tx=0x7f5920014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:46.892+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5914048060 con 0x7f59240a69b0 2023-08-17T00:09:47.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.112+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f59241548b0 con 0x7f59240a69b0 2023-08-17T00:09:47.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.304+0000 7f59197fa700 1 -- 172.21.15.153:0/1235060120 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v332) v1 ==== 158+0+0 (secure 0 0 0) 0x7f591404b680 con 0x7f59240a69b0 2023-08-17T00:09:47.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f590805a150 msgr2=0x7f590805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f590805a150 0x7f590805c610 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f5920006f70 tx=0x7f5920014000).stop 2023-08-17T00:09:47.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 msgr2=0x7f59240a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a5ec0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f591400e980 tx=0x7f5914009060).stop 2023-08-17T00:09:47.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 shutdown_connections 2023-08-17T00:09:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f590805a150 0x7f590805c610 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59240c3320 0x7f592414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59240a69b0 0x7f59240a5ec0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 --2- 172.21.15.153:0/1235060120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5924066ee0 0x7f5924164230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 >> 172.21.15.153:0/1235060120 conn(0x7f59240c4250 msgr2=0x7f59240a9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:47.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 shutdown_connections 2023-08-17T00:09:47.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.312+0000 7f592b65b700 1 -- 172.21.15.153:0/1235060120 wait complete. 2023-08-17T00:09:47.337 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2023-08-17T00:09:47.338 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-08-17T00:09:47.338 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2023-08-17T00:09:47.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.496+0000 7f946eb07700 1 Processor -- start 2023-08-17T00:09:47.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.496+0000 7f946eb07700 1 -- start start 2023-08-17T00:09:47.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946eb07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94680acf30 0x7f94680c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:47.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946eb07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9468154e90 con 0x7f9468063bc0 2023-08-17T00:09:47.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946eb07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9468153fc0 con 0x7f94680c5ea0 2023-08-17T00:09:47.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946eb07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9468154280 con 0x7f94680acf30 2023-08-17T00:09:47.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946db05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94680acf30 0x7f94680c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:47.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946e306700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9468063bc0 0x7f94680bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34238/0 (socket says 172.21.15.153:34238) 2023-08-17T00:09:47.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946db05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94680acf30 0x7f94680c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35096/0 (socket says 172.21.15.153:35096) 2023-08-17T00:09:47.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946e306700 1 -- 172.21.15.153:0/2176272830 learned_addr learned my addr 172.21.15.153:0/2176272830 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:47.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946db05700 1 -- 172.21.15.153:0/2176272830 >> v1:172.21.15.178:6789/0 conn(0x7f94680c5ea0 legacy=0x7f94680634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946db05700 1 -- 172.21.15.153:0/2176272830 >> v1:172.21.15.153:6789/0 conn(0x7f9468063bc0 legacy=0x7f94680bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946db05700 1 -- 172.21.15.153:0/2176272830 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468154560 con 0x7f94680acf30 2023-08-17T00:09:47.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946db05700 1 --2- 172.21.15.153:0/2176272830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94680acf30 0x7f94680c1020 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f9464009760 tx=0x7f9464009060).ready entity=mon.0 client_cookie=d44bb2da1a6aab44 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:47.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946cb03700 1 -- 172.21.15.153:0/2176272830 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400b580 con 0x7f94680acf30 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946cb03700 1 -- 172.21.15.153:0/2176272830 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946400b6e0 con 0x7f94680acf30 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946cb03700 1 -- 172.21.15.153:0/2176272830 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400ba60 con 0x7f94680acf30 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946eb07700 1 -- 172.21.15.153:0/2176272830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94680acf30 msgr2=0x7f94680c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.500+0000 7f946eb07700 1 --2- 172.21.15.153:0/2176272830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94680acf30 0x7f94680c1020 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f9464009760 tx=0x7f9464009060).stop 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 -- 172.21.15.153:0/2176272830 shutdown_connections 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 --2- 172.21.15.153:0/2176272830 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94680acf30 0x7f94680c1020 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:47.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 -- 172.21.15.153:0/2176272830 >> 172.21.15.153:0/2176272830 conn(0x7f94680cb330 msgr2=0x7f94680c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:47.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 -- 172.21.15.153:0/2176272830 shutdown_connections 2023-08-17T00:09:47.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 -- 172.21.15.153:0/2176272830 wait complete. 2023-08-17T00:09:47.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 Processor -- start 2023-08-17T00:09:47.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.504+0000 7f946eb07700 1 -- start start 2023-08-17T00:09:47.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 0x7f9468158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680acf30 0x7f94680c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680c4e20 0x7f9468152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c4990 con 0x7f9468063bc0 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c3d80 con 0x7f94680c4e20 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c4060 con 0x7f94680acf30 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 0x7f9468158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:47.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 0x7f9468158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35106/0 (socket says 172.21.15.153:35106) 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 -- 172.21.15.153:0/2974771949 learned_addr learned my addr 172.21.15.153:0/2974771949 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 -- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680acf30 msgr2=0x7f94680c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680acf30 0x7f94680c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 -- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680c4e20 msgr2=0x7f9468152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680c4e20 0x7f9468152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 -- 172.21.15.153:0/2974771949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640092a0 con 0x7f9468063bc0 2023-08-17T00:09:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946db05700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 0x7f9468158270 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f9464009eb0 tx=0x7f9464017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:47.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400ba60 con 0x7f9468063bc0 2023-08-17T00:09:47.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464000c90 con 0x7f9468063bc0 2023-08-17T00:09:47.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680c4340 con 0x7f9468063bc0 2023-08-17T00:09:47.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946401b620 con 0x7f9468063bc0 2023-08-17T00:09:47.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.508+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94680c3980 con 0x7f9468063bc0 2023-08-17T00:09:47.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.512+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946806b4c0 con 0x7f9468063bc0 2023-08-17T00:09:47.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.512+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f946400f070 con 0x7f9468063bc0 2023-08-17T00:09:47.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.512+0000 7f945dffb700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f944c05a150 0x7f944c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:47.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.512+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f9464075ae0 con 0x7f9468063bc0 2023-08-17T00:09:47.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.512+0000 7f946d304700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f944c05a150 0x7f944c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:47.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.516+0000 7f946d304700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f944c05a150 0x7f944c05c610 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f9468150cf0 tx=0x7f94580079c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:47.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.516+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9464049720 con 0x7f9468063bc0 2023-08-17T00:09:47.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:47.732+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f9468154840 con 0x7f9468063bc0 2023-08-17T00:09:48.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.316+0000 7f945dffb700 1 -- 172.21.15.153:0/2974771949 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v333) v1 ==== 147+0+0 (secure 0 0 0) 0x7f946404cd40 con 0x7f9468063bc0 2023-08-17T00:09:48.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f944c05a150 msgr2=0x7f944c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f944c05a150 0x7f944c05c610 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f9468150cf0 tx=0x7f94580079c0).stop 2023-08-17T00:09:48.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 msgr2=0x7f9468158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 0x7f9468158270 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 rx=0x7f9464009eb0 tx=0x7f9464017000).stop 2023-08-17T00:09:48.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 shutdown_connections 2023-08-17T00:09:48.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f944c05a150 0x7f944c05c610 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94680c4e20 0x7f9468152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:48.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94680acf30 0x7f94680c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:48.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 --2- 172.21.15.153:0/2974771949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9468063bc0 0x7f9468158270 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 >> 172.21.15.153:0/2974771949 conn(0x7f94680cb330 msgr2=0x7f94681525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:48.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 shutdown_connections 2023-08-17T00:09:48.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.324+0000 7f946eb07700 1 -- 172.21.15.153:0/2974771949 wait complete. 2023-08-17T00:09:48.350 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:09:48.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 Processor -- start 2023-08-17T00:09:48.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 -- start start 2023-08-17T00:09:48.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74140a8df0 0x7f74140c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7414068820 0x7f7414068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74141585a0 con 0x7f7414061fa0 2023-08-17T00:09:48.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7414066400 con 0x7f7414068820 2023-08-17T00:09:48.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741b039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7414069170 con 0x7f74140a8df0 2023-08-17T00:09:48.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741a838700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7414061fa0 0x7f7414062420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34240/0 (socket says 172.21.15.153:34240) 2023-08-17T00:09:48.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.508+0000 7f741a838700 1 -- 172.21.15.153:0/1416577655 learned_addr learned my addr 172.21.15.153:0/1416577655 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:48.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419836700 1 --2- 172.21.15.153:0/1416577655 >> v2:172.21.15.178:3300/0 conn(0x7f7414068820 0x7f7414068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741a037700 1 --2- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74140a8df0 0x7f74140c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419035700 1 -- 172.21.15.153:0/1416577655 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141113450 0 0) 0x7f74141585a0 con 0x7f7414061fa0 2023-08-17T00:09:48.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419035700 1 -- 172.21.15.153:0/1416577655 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74000033f0 con 0x7f7414061fa0 2023-08-17T00:09:48.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419836700 1 -- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74140a8df0 msgr2=0x7f74140c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:48.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419836700 1 --2- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74140a8df0 0x7f74140c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419836700 1 -- 172.21.15.153:0/1416577655 >> v1:172.21.15.153:6789/0 conn(0x7f7414061fa0 legacy=0x7f7414062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419836700 1 -- 172.21.15.153:0/1416577655 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74140b9d30 con 0x7f7414068820 2023-08-17T00:09:48.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419836700 1 --2- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7414068820 0x7f7414068c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f7404009760 tx=0x7f7404009060).ready entity=mon.1 client_cookie=92eac98d9d040da5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:48.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419035700 1 -- 172.21.15.153:0/1416577655 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400d4a0 con 0x7f7414068820 2023-08-17T00:09:48.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419035700 1 -- 172.21.15.153:0/1416577655 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400d600 con 0x7f7414068820 2023-08-17T00:09:48.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f7419035700 1 -- 172.21.15.153:0/1416577655 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400d980 con 0x7f7414068820 2023-08-17T00:09:48.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 -- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7414068820 msgr2=0x7f7414068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 --2- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7414068820 0x7f7414068c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f7404009760 tx=0x7f7404009060).stop 2023-08-17T00:09:48.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 -- 172.21.15.153:0/1416577655 shutdown_connections 2023-08-17T00:09:48.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 --2- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7414068820 0x7f7414068c80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 --2- 172.21.15.153:0/1416577655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74140a8df0 0x7f74140c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 -- 172.21.15.153:0/1416577655 >> 172.21.15.153:0/1416577655 conn(0x7f74140c6620 msgr2=0x7f74140c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:48.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 -- 172.21.15.153:0/1416577655 shutdown_connections 2023-08-17T00:09:48.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.512+0000 7f741b039700 1 -- 172.21.15.153:0/1416577655 wait complete. 2023-08-17T00:09:48.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 Processor -- start 2023-08-17T00:09:48.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 -- start start 2023-08-17T00:09:48.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7414061fa0 0x7f7414159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 0x7f741415a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74140a8df0 0x7f7414168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741415af50 con 0x7f7414068820 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741415ac70 con 0x7f74140a8df0 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.516+0000 7f741b039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74141699a0 con 0x7f7414061fa0 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 0x7f741415a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 0x7f741415a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35122/0 (socket says 172.21.15.153:35122) 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 -- 172.21.15.153:0/2381346932 learned_addr learned my addr 172.21.15.153:0/2381346932 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f741a838700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74140a8df0 0x7f7414168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f741a037700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7414061fa0 0x7f7414159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 -- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7414061fa0 msgr2=0x7f7414159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7414061fa0 0x7f7414159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 -- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74140a8df0 msgr2=0x7f7414168630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74140a8df0 0x7f7414168630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 -- 172.21.15.153:0/2381346932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040092a0 con 0x7f7414068820 2023-08-17T00:09:48.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f741a838700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74140a8df0 0x7f7414168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:48.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f7419836700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 0x7f741415a200 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f7404010000 tx=0x7f7404016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:48.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400dd30 con 0x7f7414068820 2023-08-17T00:09:48.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740400de90 con 0x7f7414068820 2023-08-17T00:09:48.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7414169c80 con 0x7f7414068820 2023-08-17T00:09:48.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740400d980 con 0x7f7414068820 2023-08-17T00:09:48.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741415a6f0 con 0x7f7414068820 2023-08-17T00:09:48.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.520+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7414169800 con 0x7f7414068820 2023-08-17T00:09:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.524+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f740400f070 con 0x7f7414068820 2023-08-17T00:09:48.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.524+0000 7f740a7fc700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73f805a180 0x7f73f805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.524+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f7404075210 con 0x7f7414068820 2023-08-17T00:09:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.524+0000 7f741a037700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73f805a180 0x7f73f805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.528+0000 7f741a037700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73f805a180 0x7f73f805c640 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f7410006fd0 tx=0x7f7410006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:48.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.528+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7414169800 con 0x7f7414068820 2023-08-17T00:09:48.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.688+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7414169800 con 0x7f7414068820 2023-08-17T00:09:48.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.696+0000 7f740a7fc700 1 -- 172.21.15.153:0/2381346932 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7414169800 con 0x7f7414068820 2023-08-17T00:09:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73f805a180 msgr2=0x7f73f805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73f805a180 0x7f73f805c640 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f7410006fd0 tx=0x7f7410006f40).stop 2023-08-17T00:09:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 msgr2=0x7f741415a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 0x7f741415a200 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 rx=0x7f7404010000 tx=0x7f7404016000).stop 2023-08-17T00:09:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 shutdown_connections 2023-08-17T00:09:48.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73f805a180 0x7f73f805c640 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f74140a8df0 0x7f7414168630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7414068820 0x7f741415a200 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 --2- 172.21.15.153:0/2381346932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7414061fa0 0x7f7414159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 >> 172.21.15.153:0/2381346932 conn(0x7f74140c6620 msgr2=0x7f7414062420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:48.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 shutdown_connections 2023-08-17T00:09:48.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.700+0000 7f741b039700 1 -- 172.21.15.153:0/2381346932 wait complete. 2023-08-17T00:09:48.726 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:09:48.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:09:48.761 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:09:48.805 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:09:48.805 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:09:48.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:09:48.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.964+0000 7f6f5031b700 1 Processor -- start 2023-08-17T00:09:48.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.964+0000 7f6f5031b700 1 -- start start 2023-08-17T00:09:48.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f5031b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48151780 0x7f6f480a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f5031b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6f48061fa0 0x7f6f48062db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f5031b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480c2050 con 0x7f6f48151b60 2023-08-17T00:09:48.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f5031b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f480c1db0 con 0x7f6f48061fa0 2023-08-17T00:09:48.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f5031b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c3d50 con 0x7f6f48151780 2023-08-17T00:09:48.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f4e0b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48151780 0x7f6f480a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f4d8b6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6f48061fa0 0x7f6f48062db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f4e0b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48151780 0x7f6f480a75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:56166/0 (socket says 172.21.15.153:56166) 2023-08-17T00:09:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f4e0b7700 1 -- 172.21.15.153:0/1432034191 learned_addr learned my addr 172.21.15.153:0/1432034191 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.968+0000 7f6f4e8b8700 1 --1- 172.21.15.153:0/1432034191 >> v1:172.21.15.178:6789/0 conn(0x7f6f48151b60 0x7f6f480632a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55326/0 (socket says 172.21.15.153:55326) 2023-08-17T00:09:48.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48151780 msgr2=0x7f6f480a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d8b6700 1 --2- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48151780 0x7f6f480a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/1432034191 >> v1:172.21.15.178:6789/0 conn(0x7f6f48151b60 legacy=0x7f6f480632a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/1432034191 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48062510 con 0x7f6f48061fa0 2023-08-17T00:09:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d8b6700 1 --2- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48061fa0 0x7f6f48062db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f6f38009760 tx=0x7f6f38009060).ready entity=mon.1 client_cookie=9f2013266914ab65 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d0b5700 1 -- 172.21.15.153:0/1432034191 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f380090d0 con 0x7f6f48061fa0 2023-08-17T00:09:48.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d0b5700 1 -- 172.21.15.153:0/1432034191 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3800f510 con 0x7f6f48061fa0 2023-08-17T00:09:48.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f4d0b5700 1 -- 172.21.15.153:0/1432034191 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800f890 con 0x7f6f48061fa0 2023-08-17T00:09:48.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 -- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48061fa0 msgr2=0x7f6f48062db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 --2- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48061fa0 0x7f6f48062db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f6f38009760 tx=0x7f6f38009060).stop 2023-08-17T00:09:48.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 -- 172.21.15.153:0/1432034191 shutdown_connections 2023-08-17T00:09:48.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 --2- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48061fa0 0x7f6f48062db0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 --2- 172.21.15.153:0/1432034191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48151780 0x7f6f480a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 -- 172.21.15.153:0/1432034191 >> 172.21.15.153:0/1432034191 conn(0x7f6f480c4250 msgr2=0x7f6f480c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:48.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 -- 172.21.15.153:0/1432034191 shutdown_connections 2023-08-17T00:09:48.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.972+0000 7f6f5031b700 1 -- 172.21.15.153:0/1432034191 wait complete. 2023-08-17T00:09:48.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.976+0000 7f6f5031b700 1 Processor -- start 2023-08-17T00:09:48.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.976+0000 7f6f5031b700 1 -- start start 2023-08-17T00:09:48.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48061fa0 0x7f6f480ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 0x7f6f480c1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48151b60 0x7f6f48062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481582d0 con 0x7f6f48151780 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f481585b0 con 0x7f6f48151b60 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480ac750 con 0x7f6f48061fa0 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 0x7f6f480c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 0x7f6f480c1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35126/0 (socket says 172.21.15.153:35126) 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/3664432263 learned_addr learned my addr 172.21.15.153:0/3664432263 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:48.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4e0b7700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48061fa0 0x7f6f480ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4e8b8700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48151b60 0x7f6f48062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48061fa0 msgr2=0x7f6f480ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48061fa0 0x7f6f480ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48151b60 msgr2=0x7f6f48062d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48151b60 0x7f6f48062d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 -- 172.21.15.153:0/3664432263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f380092a0 con 0x7f6f48151780 2023-08-17T00:09:48.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f4d8b6700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 0x7f6f480c1300 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f6f480695d0 tx=0x7f6f38017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:48.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800fea0 con 0x7f6f48151780 2023-08-17T00:09:48.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38000d10 con 0x7f6f48151780 2023-08-17T00:09:48.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f480aca30 con 0x7f6f48151780 2023-08-17T00:09:48.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800f8d0 con 0x7f6f48151780 2023-08-17T00:09:48.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.980+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f480ad720 con 0x7f6f48151780 2023-08-17T00:09:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.984+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4806b530 con 0x7f6f48151780 2023-08-17T00:09:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.984+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6f3802a070 con 0x7f6f48151780 2023-08-17T00:09:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.984+0000 7f6f3e7fc700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f2c05a150 0x7f6f2c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.984+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f6f380751f0 con 0x7f6f48151780 2023-08-17T00:09:48.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.984+0000 7f6f4e0b7700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f2c05a150 0x7f6f2c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:48.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:48.988+0000 7f6f4e0b7700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f2c05a150 0x7f6f2c05c610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f6f44009fd0 tx=0x7f6f4400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:49.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.000+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6f38048fa0 con 0x7f6f48151780 2023-08-17T00:09:49.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.224+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f480627f0 con 0x7f6f48151780 2023-08-17T00:09:49.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.224+0000 7f6f3e7fc700 1 -- 172.21.15.153:0/3664432263 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f6f38028090 con 0x7f6f48151780 2023-08-17T00:09:49.230 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:49.230 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1375491062","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1375491062},{"type":"v1","addr":"172.21.15.178:6837","nonce":1375491062}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6418,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/4190704238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":4190704238},{"type":"v1","addr":"172.21.15.178:6836","nonce":4190704238}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":6675,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/789107655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":789107655},{"type":"v1","addr":"172.21.15.153:6833","nonce":789107655}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7011,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/856278530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":856278530},{"type":"v1","addr":"172.21.15.153:6835","nonce":856278530}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[]} 2023-08-17T00:09:49.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f2c05a150 msgr2=0x7f6f2c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f2c05a150 0x7f6f2c05c610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f6f44009fd0 tx=0x7f6f4400b040).stop 2023-08-17T00:09:49.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 msgr2=0x7f6f480c1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 0x7f6f480c1300 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 rx=0x7f6f480695d0 tx=0x7f6f38017000).stop 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 shutdown_connections 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6f2c05a150 0x7f6f2c05c610 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f48151b60 0x7f6f48062d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6f48151780 0x7f6f480c1300 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 --2- 172.21.15.153:0/3664432263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f48061fa0 0x7f6f480ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 >> 172.21.15.153:0/3664432263 conn(0x7f6f480c4250 msgr2=0x7f6f481508b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:49.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 shutdown_connections 2023-08-17T00:09:49.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.228+0000 7f6f5031b700 1 -- 172.21.15.153:0/3664432263 wait complete. 2023-08-17T00:09:49.236 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 79 2023-08-17T00:09:49.255 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:09:49.255 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:09:49.255 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:09:49.256 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:09:49.256 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:09:49.256 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:09:49.256 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:09:49.257 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:09:49.257 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:09:49.257 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:09:49.258 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:09:49.258 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:09:49.258 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:09:49.258 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:09:49.259 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:09:49.259 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:09:49.273 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:09:49.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:09:49.278 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:09:49.279 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:09:49.281 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:09:49.281 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:09:49.282 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:09:49.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:09:49.325 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:09:49.325 DEBUG:teuthology.parallel:result is None 2023-08-17T00:09:49.328 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:09:49.329 DEBUG:teuthology.parallel:result is None 2023-08-17T00:09:49.331 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:09:49.331 DEBUG:teuthology.parallel:result is None 2023-08-17T00:09:49.334 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:09:49.334 DEBUG:teuthology.parallel:result is None 2023-08-17T00:09:49.335 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:09:49.423 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:09:49.425 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:09:49.443 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:09:49.449 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:09:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7f1b9700 1 Processor -- start 2023-08-17T00:09:49.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7f1b9700 1 -- start start 2023-08-17T00:09:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7f1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc78068da0 0x7efc781560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7f1b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc78065da0 con 0x7efc78151530 2023-08-17T00:09:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7f1b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc78155c60 con 0x7efc780689c0 2023-08-17T00:09:49.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7f1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc78069200 con 0x7efc78068da0 2023-08-17T00:09:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7e9b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efc78151530 0x7efc781519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34270/0 (socket says 172.21.15.153:34270) 2023-08-17T00:09:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7e9b8700 1 -- 172.21.15.153:0/2322149216 learned_addr learned my addr 172.21.15.153:0/2322149216 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:49.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7d9b6700 1 --2- 172.21.15.153:0/2322149216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc78068da0 0x7efc781560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:49.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.492+0000 7efc7d1b5700 1 -- 172.21.15.153:0/2322149216 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471124031 0 0) 0x7efc78155c60 con 0x7efc780689c0 2023-08-17T00:09:49.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d1b5700 1 -- 172.21.15.153:0/2322149216 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc640033f0 con 0x7efc780689c0 2023-08-17T00:09:49.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d1b5700 1 -- 172.21.15.153:0/2322149216 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 362044057 0 0) 0x7efc78065da0 con 0x7efc78151530 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d9b6700 1 -- 172.21.15.153:0/2322149216 >> v1:172.21.15.178:6789/0 conn(0x7efc780689c0 legacy=0x7efc780c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d9b6700 1 -- 172.21.15.153:0/2322149216 >> v1:172.21.15.153:6789/0 conn(0x7efc78151530 legacy=0x7efc781519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d9b6700 1 -- 172.21.15.153:0/2322149216 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc78065ff0 con 0x7efc78068da0 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d9b6700 1 --2- 172.21.15.153:0/2322149216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc78068da0 0x7efc781560f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7efc68009790 tx=0x7efc68009060).ready entity=mon.2 client_cookie=eca0bf38a854f4b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d1b5700 1 -- 172.21.15.153:0/2322149216 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680090d0 con 0x7efc78068da0 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d1b5700 1 -- 172.21.15.153:0/2322149216 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6800f510 con 0x7efc78068da0 2023-08-17T00:09:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7d1b5700 1 -- 172.21.15.153:0/2322149216 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800f890 con 0x7efc78068da0 2023-08-17T00:09:49.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 -- 172.21.15.153:0/2322149216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc78068da0 msgr2=0x7efc781560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/2322149216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc78068da0 0x7efc781560f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7efc68009790 tx=0x7efc68009060).stop 2023-08-17T00:09:49.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 -- 172.21.15.153:0/2322149216 shutdown_connections 2023-08-17T00:09:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/2322149216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc78068da0 0x7efc781560f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 -- 172.21.15.153:0/2322149216 >> 172.21.15.153:0/2322149216 conn(0x7efc780c6620 msgr2=0x7efc780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 -- 172.21.15.153:0/2322149216 shutdown_connections 2023-08-17T00:09:49.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.496+0000 7efc7f1b9700 1 -- 172.21.15.153:0/2322149216 wait complete. 2023-08-17T00:09:49.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 Processor -- start 2023-08-17T00:09:49.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 -- start start 2023-08-17T00:09:49.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc780689c0 0x7efc780a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:49.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc78068da0 0x7efc780bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:49.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 0x7efc780bc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:49.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc780bb2a0 con 0x7efc78151530 2023-08-17T00:09:49.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc780bc860 con 0x7efc78068da0 2023-08-17T00:09:49.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc781525d0 con 0x7efc780689c0 2023-08-17T00:09:49.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 0x7efc780bc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:49.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 0x7efc780bc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35158/0 (socket says 172.21.15.153:35158) 2023-08-17T00:09:49.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 -- 172.21.15.153:0/729032584 learned_addr learned my addr 172.21.15.153:0/729032584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:49.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7d9b6700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc78068da0 0x7efc780bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:49.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e1b7700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc780689c0 0x7efc780a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:49.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 -- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc780689c0 msgr2=0x7efc780a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc780689c0 0x7efc780a7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 -- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc78068da0 msgr2=0x7efc780bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:49.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc78068da0 0x7efc780bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:49.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 -- 172.21.15.153:0/729032584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc680092a0 con 0x7efc78151530 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7e9b8700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 0x7efc780bc370 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7efc7000c7e0 tx=0x7efc70007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70005d30 con 0x7efc78151530 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70005e90 con 0x7efc78151530 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc780a8420 con 0x7efc78151530 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.500+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70007320 con 0x7efc78151530 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.504+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc78151ca0 con 0x7efc78151530 2023-08-17T00:09:49.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.504+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc78152740 con 0x7efc78151530 2023-08-17T00:09:49.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.504+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efc70010030 con 0x7efc78151530 2023-08-17T00:09:49.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.508+0000 7efc6e7fc700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc5c05a180 0x7efc5c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:49.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.508+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5355+0+0 (secure 0 0 0) 0x7efc70073d00 con 0x7efc78151530 2023-08-17T00:09:49.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.508+0000 7efc7e1b7700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc5c05a180 0x7efc5c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:49.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.508+0000 7efc7e1b7700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc5c05a180 0x7efc5c05c640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7efc740038c0 tx=0x7efc74007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:49.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.512+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc700479a0 con 0x7efc78151530 2023-08-17T00:09:49.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:49.684+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efc78063750 con 0x7efc78151530 2023-08-17T00:09:50.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.484+0000 7efc6e7fc700 1 -- 172.21.15.153:0/729032584 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v94) v1 ==== 97+0+0 (secure 0 0 0) 0x7efc7004afc0 con 0x7efc78151530 2023-08-17T00:09:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc5c05a180 msgr2=0x7efc5c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc5c05a180 0x7efc5c05c640 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7efc740038c0 tx=0x7efc74007bc0).stop 2023-08-17T00:09:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 msgr2=0x7efc780bc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 0x7efc780bc370 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7efc7000c7e0 tx=0x7efc70007f90).stop 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 shutdown_connections 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc5c05a180 0x7efc5c05c640 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc78151530 0x7efc780bc370 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc78068da0 0x7efc780bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 --2- 172.21.15.153:0/729032584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc780689c0 0x7efc780a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 >> 172.21.15.153:0/729032584 conn(0x7efc780c6620 msgr2=0x7efc780c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:50.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 shutdown_connections 2023-08-17T00:09:50.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.488+0000 7efc7f1b9700 1 -- 172.21.15.153:0/729032584 wait complete. 2023-08-17T00:09:50.496 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:09:50.517 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:09:50.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.668+0000 7f6702c9b700 1 Processor -- start 2023-08-17T00:09:50.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.668+0000 7f6702c9b700 1 -- start start 2023-08-17T00:09:50.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f66fc153ab0 0x7f66fc153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:50.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66fc0c7ba0 0x7f66fc0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:50.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66fc0aa750 con 0x7f66fc0c8d50 2023-08-17T00:09:50.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0c9dd0 con 0x7f66fc0c7ba0 2023-08-17T00:09:50.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66fc0aacf0 con 0x7f66fc153ab0 2023-08-17T00:09:50.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f66fbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f66fc0c8d50 0x7f66fc0c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34280/0 (socket says 172.21.15.153:34280) 2023-08-17T00:09:50.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f66fbfff700 1 -- 172.21.15.153:0/4023891448 learned_addr learned my addr 172.21.15.153:0/4023891448 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:50.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6701238700 1 --2- 172.21.15.153:0/4023891448 >> v2:172.21.15.153:3300/0 conn(0x7f66fc0c7ba0 0x7f66fc0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:50.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6700a37700 1 --2- 172.21.15.153:0/4023891448 >> v2:172.21.15.178:3300/0 conn(0x7f66fc153ab0 0x7f66fc153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:50.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6701238700 1 -- 172.21.15.153:0/4023891448 >> v2:172.21.15.178:3300/0 conn(0x7f66fc153ab0 msgr2=0x7f66fc153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:50.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6701238700 1 --2- 172.21.15.153:0/4023891448 >> v2:172.21.15.178:3300/0 conn(0x7f66fc153ab0 0x7f66fc153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6701238700 1 -- 172.21.15.153:0/4023891448 >> v1:172.21.15.153:6789/0 conn(0x7f66fc0c8d50 legacy=0x7f66fc0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6701238700 1 -- 172.21.15.153:0/4023891448 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66fc0c5ca0 con 0x7f66fc0c7ba0 2023-08-17T00:09:50.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6701238700 1 --2- 172.21.15.153:0/4023891448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0c7ba0 0x7f66fc0c91b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f66fc0cba90 tx=0x7f66f4009780).ready entity=mon.0 client_cookie=5d8af1cda3e7b619 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:50.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f66fb7fe700 1 -- 172.21.15.153:0/4023891448 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f400e070 con 0x7f66fc0c7ba0 2023-08-17T00:09:50.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f66fb7fe700 1 -- 172.21.15.153:0/4023891448 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f400bc30 con 0x7f66fc0c7ba0 2023-08-17T00:09:50.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f66fb7fe700 1 -- 172.21.15.153:0/4023891448 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4012410 con 0x7f66fc0c7ba0 2023-08-17T00:09:50.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 -- 172.21.15.153:0/4023891448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0c7ba0 msgr2=0x7f66fc0c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 --2- 172.21.15.153:0/4023891448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0c7ba0 0x7f66fc0c91b0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f66fc0cba90 tx=0x7f66f4009780).stop 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 -- 172.21.15.153:0/4023891448 shutdown_connections 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 --2- 172.21.15.153:0/4023891448 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc0c7ba0 0x7f66fc0c91b0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.672+0000 7f6702c9b700 1 --2- 172.21.15.153:0/4023891448 >> v2:172.21.15.178:3300/0 conn(0x7f66fc153ab0 0x7f66fc153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.676+0000 7f6702c9b700 1 -- 172.21.15.153:0/4023891448 >> 172.21.15.153:0/4023891448 conn(0x7f66fc061fa0 msgr2=0x7f66fc0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.676+0000 7f6702c9b700 1 -- 172.21.15.153:0/4023891448 shutdown_connections 2023-08-17T00:09:50.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.676+0000 7f6702c9b700 1 -- 172.21.15.153:0/4023891448 wait complete. 2023-08-17T00:09:50.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.676+0000 7f6702c9b700 1 Processor -- start 2023-08-17T00:09:50.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.676+0000 7f6702c9b700 1 -- start start 2023-08-17T00:09:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66fc0c7ba0 0x7f66fc0ae930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66fc0c8d50 0x7f66fc0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 0x7f66fc14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0af630 con 0x7f66fc153ab0 2023-08-17T00:09:50.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0b0910 con 0x7f66fc0c8d50 2023-08-17T00:09:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66fc0b0480 con 0x7f66fc0c7ba0 2023-08-17T00:09:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 0x7f66fc14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:50.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 0x7f66fc14c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35178/0 (socket says 172.21.15.153:35178) 2023-08-17T00:09:50.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 -- 172.21.15.153:0/3768064011 learned_addr learned my addr 172.21.15.153:0/3768064011 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:50.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f66fbfff700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66fc0c8d50 0x7f66fc0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:50.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6700a37700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66fc0c7ba0 0x7f66fc0ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:50.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 -- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66fc0c7ba0 msgr2=0x7f66fc0ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66fc0c7ba0 0x7f66fc0ae930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 -- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66fc0c8d50 msgr2=0x7f66fc0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66fc0c8d50 0x7f66fc0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 -- 172.21.15.153:0/3768064011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009a20 con 0x7f66fc153ab0 2023-08-17T00:09:50.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6701238700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 0x7f66fc14c7d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f66fc0c1a50 tx=0x7f66fc0c9f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:50.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f401d630 con 0x7f66fc153ab0 2023-08-17T00:09:50.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f401d790 con 0x7f66fc153ab0 2023-08-17T00:09:50.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66fc0af870 con 0x7f66fc153ab0 2023-08-17T00:09:50.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f401db50 con 0x7f66fc153ab0 2023-08-17T00:09:50.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.680+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66fc0afe30 con 0x7f66fc153ab0 2023-08-17T00:09:50.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.684+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66fc0b05f0 con 0x7f66fc153ab0 2023-08-17T00:09:50.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.684+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f66f4027460 con 0x7f66fc153ab0 2023-08-17T00:09:50.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.684+0000 7f66f8ff9700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66e005a150 0x7f66e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:50.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.684+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f66f40761f0 con 0x7f66fc153ab0 2023-08-17T00:09:50.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.688+0000 7f6700a37700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66e005a150 0x7f66e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:50.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.688+0000 7f6700a37700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66e005a150 0x7f66e005c610 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f66f0006fd0 tx=0x7f66f0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.692+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66f4049e80 con 0x7f66fc153ab0 2023-08-17T00:09:50.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.908+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f66fc06b530 con 0x7f66fc153ab0 2023-08-17T00:09:50.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.908+0000 7f66f8ff9700 1 -- 172.21.15.153:0/3768064011 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f66f404d4a0 con 0x7f66fc153ab0 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:09:50.915 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.916 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.917 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:09:50.918 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:09:50.919 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.920 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.921 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.922 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.923 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.924 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:09:50.925 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:09:50.926 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.927 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.929 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:09:50.930 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:09:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:09:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:09:50.931 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:09:50.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:09:50.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.936 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:50.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:50.939 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:09:50.939 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:09:50.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66e005a150 msgr2=0x7f66e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66e005a150 0x7f66e005c610 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7f66f0006fd0 tx=0x7f66f0008040).stop 2023-08-17T00:09:50.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 msgr2=0x7f66fc14c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:50.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 0x7f66fc14c7d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7f66fc0c1a50 tx=0x7f66fc0c9f10).stop 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 shutdown_connections 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66e005a150 0x7f66e005c610 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66fc153ab0 0x7f66fc14c7d0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66fc0c8d50 0x7f66fc0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 --2- 172.21.15.153:0/3768064011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66fc0c7ba0 0x7f66fc0ae930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 >> 172.21.15.153:0/3768064011 conn(0x7f66fc061fa0 msgr2=0x7f66fc151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:50.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 shutdown_connections 2023-08-17T00:09:50.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:50.912+0000 7f6702c9b700 1 -- 172.21.15.153:0/3768064011 wait complete. 2023-08-17T00:09:50.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:51.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 Processor -- start 2023-08-17T00:09:51.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 -- start start 2023-08-17T00:09:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa400151530 0x7fa4001519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa400065da0 con 0x7fa4000689c0 2023-08-17T00:09:51.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa400069200 con 0x7fa400151530 2023-08-17T00:09:51.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.092+0000 7fa4053f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa400155c60 con 0x7fa400068da0 2023-08-17T00:09:51.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa404bf8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa400151530 0x7fa4001519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:56236/0 (socket says 172.21.15.153:56236) 2023-08-17T00:09:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 -- 172.21.15.153:0/1609848443 learned_addr learned my addr 172.21.15.153:0/1609848443 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:51.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 -- 172.21.15.153:0/1609848443 >> v2:172.21.15.178:3300/0 conn(0x7fa400151530 msgr2=0x7fa4001519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 --2- 172.21.15.153:0/1609848443 >> v2:172.21.15.178:3300/0 conn(0x7fa400151530 0x7fa4001519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 -- 172.21.15.153:0/1609848443 >> v1:172.21.15.178:6789/0 conn(0x7fa4000689c0 legacy=0x7fa4000c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 -- 172.21.15.153:0/1609848443 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400065ff0 con 0x7fa400068da0 2023-08-17T00:09:51.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3ff7fe700 1 --2- 172.21.15.153:0/1609848443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001560f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa3f4006fd0 tx=0x7fa3f40090f0).ready entity=mon.2 client_cookie=52ed2fcbd80690a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3feffd700 1 -- 172.21.15.153:0/1609848443 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400b580 con 0x7fa400068da0 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3feffd700 1 -- 172.21.15.153:0/1609848443 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f400b6e0 con 0x7fa400068da0 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa3feffd700 1 -- 172.21.15.153:0/1609848443 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f400ba80 con 0x7fa400068da0 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 -- 172.21.15.153:0/1609848443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 msgr2=0x7fa4001560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 --2- 172.21.15.153:0/1609848443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001560f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fa3f4006fd0 tx=0x7fa3f40090f0).stop 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 -- 172.21.15.153:0/1609848443 shutdown_connections 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 --2- 172.21.15.153:0/1609848443 >> v2:172.21.15.178:3300/0 conn(0x7fa400151530 0x7fa4001519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 --2- 172.21.15.153:0/1609848443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001560f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 -- 172.21.15.153:0/1609848443 >> 172.21.15.153:0/1609848443 conn(0x7fa4000c6620 msgr2=0x7fa4000c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:51.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 -- 172.21.15.153:0/1609848443 shutdown_connections 2023-08-17T00:09:51.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.096+0000 7fa4053f9700 1 -- 172.21.15.153:0/1609848443 wait complete. 2023-08-17T00:09:51.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 Processor -- start 2023-08-17T00:09:51.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 -- start start 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 0x7fa400152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa400151530 0x7fa400154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400152920 con 0x7fa4000689c0 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa400151d10 con 0x7fa400151530 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa400151ff0 con 0x7fa400068da0 2023-08-17T00:09:51.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 0x7fa400152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 0x7fa400152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35192/0 (socket says 172.21.15.153:35192) 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 -- 172.21.15.153:0/3939530484 learned_addr learned my addr 172.21.15.153:0/3939530484 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa404bf8700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa400151530 0x7fa400154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3ff7fe700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 -- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 msgr2=0x7fa4001532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 -- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa400151530 msgr2=0x7fa400154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa400151530 0x7fa400154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 -- 172.21.15.153:0/3939530484 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f4009370 con 0x7fa4000689c0 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa404bf8700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa400151530 0x7fa400154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3fffff700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 0x7fa400152db0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fa3f000c440 tx=0x7fa3f0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0007020 con 0x7fa4000689c0 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f0007180 con 0x7fa4000689c0 2023-08-17T00:09:51.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.100+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4001522d0 con 0x7fa4000689c0 2023-08-17T00:09:51.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.104+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f0007520 con 0x7fa4000689c0 2023-08-17T00:09:51.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.104+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4001519a0 con 0x7fa4000689c0 2023-08-17T00:09:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.104+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa40006b4c0 con 0x7fa4000689c0 2023-08-17T00:09:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.104+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa3f0010070 con 0x7fa4000689c0 2023-08-17T00:09:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.108+0000 7fa3e7fff700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa3ec05a150 0x7fa3ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.108+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fa3f0073130 con 0x7fa4000689c0 2023-08-17T00:09:51.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.108+0000 7fa3ff7fe700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa3ec05a150 0x7fa3ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.108+0000 7fa3ff7fe700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa3ec05a150 0x7fa3ec05c610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fa3f4009fd0 tx=0x7fa3f4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.112+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa3f0046e20 con 0x7fa4000689c0 2023-08-17T00:09:51.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.272+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa400063750 con 0x7fa4000689c0 2023-08-17T00:09:51.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.272+0000 7fa3e7fff700 1 -- 172.21.15.153:0/3939530484 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+13761 (secure 0 0 0) 0x7fa3f004a440 con 0x7fa4000689c0 2023-08-17T00:09:51.279 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:51.279 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":94,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:50.477661+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa3ec05a150 msgr2=0x7fa3ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa3ec05a150 0x7fa3ec05c610 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fa3f4009fd0 tx=0x7fa3f4017000).stop 2023-08-17T00:09:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 msgr2=0x7fa400152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 0x7fa400152db0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 rx=0x7fa3f000c440 tx=0x7fa3f0007e50).stop 2023-08-17T00:09:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 shutdown_connections 2023-08-17T00:09:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa3ec05a150 0x7fa3ec05c610 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa400151530 0x7fa400154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa400068da0 0x7fa4001532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 --2- 172.21.15.153:0/3939530484 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4000689c0 0x7fa400152db0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 >> 172.21.15.153:0/3939530484 conn(0x7fa4000c6620 msgr2=0x7fa4000645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 shutdown_connections 2023-08-17T00:09:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.276+0000 7fa4053f9700 1 -- 172.21.15.153:0/3939530484 wait complete. 2023-08-17T00:09:51.304 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:09:51.305 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:09:51.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.456+0000 7faf0b59e700 1 Processor -- start 2023-08-17T00:09:51.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.460+0000 7faf0b59e700 1 -- start start 2023-08-17T00:09:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.460+0000 7faf0b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.460+0000 7faf0b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf0c0c01a0 0x7faf0c0c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0bfd10 con 0x7faf0c0c57a0 2023-08-17T00:09:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c154860 con 0x7faf0c0c01a0 2023-08-17T00:09:51.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c154af0 con 0x7faf0c153f50 2023-08-17T00:09:51.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf0c0c01a0 0x7faf0c0c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0ad9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faf0c0c01a0 0x7faf0c0c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35198/0 (socket says 172.21.15.153:35198) 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf09d9b700 1 --2- 172.21.15.153:0/3321502873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0a59c700 1 --1- 172.21.15.153:0/3321502873 >> v1:172.21.15.178:6789/0 conn(0x7faf0c0c57a0 0x7faf0c0c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55364/0 (socket says 172.21.15.153:55364) 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0ad9d700 1 -- 172.21.15.153:0/3321502873 learned_addr learned my addr 172.21.15.153:0/3321502873 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf09d9b700 1 -- 172.21.15.153:0/3321502873 >> v2:172.21.15.153:3300/0 conn(0x7faf0c0c01a0 msgr2=0x7faf0c0c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf09d9b700 1 --2- 172.21.15.153:0/3321502873 >> v2:172.21.15.153:3300/0 conn(0x7faf0c0c01a0 0x7faf0c0c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf09d9b700 1 -- 172.21.15.153:0/3321502873 >> v1:172.21.15.178:6789/0 conn(0x7faf0c0c57a0 legacy=0x7faf0c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf09d9b700 1 -- 172.21.15.153:0/3321502873 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c154dd0 con 0x7faf0c153f50 2023-08-17T00:09:51.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0959a700 1 -- 172.21.15.153:0/3321502873 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573658809 0 0) 0x7faf0c0bfd10 con 0x7faf0c0c57a0 2023-08-17T00:09:51.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf09d9b700 1 --2- 172.21.15.153:0/3321502873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c154370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7faf00009760 tx=0x7faf00009060).ready entity=mon.2 client_cookie=781ea011e4c53ea9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0959a700 1 -- 172.21.15.153:0/3321502873 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000f510 con 0x7faf0c153f50 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0959a700 1 -- 172.21.15.153:0/3321502873 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0000f670 con 0x7faf0c153f50 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0959a700 1 -- 172.21.15.153:0/3321502873 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0000f9f0 con 0x7faf0c153f50 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- 172.21.15.153:0/3321502873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 msgr2=0x7faf0c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 --2- 172.21.15.153:0/3321502873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c154370 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7faf00009760 tx=0x7faf00009060).stop 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- 172.21.15.153:0/3321502873 shutdown_connections 2023-08-17T00:09:51.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 --2- 172.21.15.153:0/3321502873 >> v2:172.21.15.153:3300/0 conn(0x7faf0c0c01a0 0x7faf0c0c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 --2- 172.21.15.153:0/3321502873 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c154370 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- 172.21.15.153:0/3321502873 >> 172.21.15.153:0/3321502873 conn(0x7faf0c062a70 msgr2=0x7faf0c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:51.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.464+0000 7faf0b59e700 1 -- 172.21.15.153:0/3321502873 shutdown_connections 2023-08-17T00:09:51.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.468+0000 7faf0b59e700 1 -- 172.21.15.153:0/3321502873 wait complete. 2023-08-17T00:09:51.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.468+0000 7faf0b59e700 1 Processor -- start 2023-08-17T00:09:51.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.468+0000 7faf0b59e700 1 -- start start 2023-08-17T00:09:51.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 0x7faf0c0ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf0c0c57a0 0x7faf0c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c157190 con 0x7faf0c0c01a0 2023-08-17T00:09:51.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1562d0 con 0x7faf0c0c57a0 2023-08-17T00:09:51.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c156580 con 0x7faf0c153f50 2023-08-17T00:09:51.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 0x7faf0c0ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 0x7faf0c0ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35204/0 (socket says 172.21.15.153:35204) 2023-08-17T00:09:51.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 -- 172.21.15.153:0/982752225 learned_addr learned my addr 172.21.15.153:0/982752225 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:51.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 -- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 msgr2=0x7faf0c152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0ad9d700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf09d9b700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf0c0c57a0 0x7faf0c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 -- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf0c0c57a0 msgr2=0x7faf0c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf0c0c57a0 0x7faf0c155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 -- 172.21.15.153:0/982752225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000092a0 con 0x7faf0c0c01a0 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0ad9d700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:51.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf09d9b700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf0c0c57a0 0x7faf0c155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:51.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0a59c700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 0x7faf0c0ae5c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7faefc00c490 tx=0x7faefc007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc0072e0 con 0x7faf0c0c01a0 2023-08-17T00:09:51.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc007440 con 0x7faf0c0c01a0 2023-08-17T00:09:51.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c156860 con 0x7faf0c0c01a0 2023-08-17T00:09:51.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc005930 con 0x7faf0c0c01a0 2023-08-17T00:09:51.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.472+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c156e20 con 0x7faf0c0c01a0 2023-08-17T00:09:51.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.476+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c06b4c0 con 0x7faf0c0c01a0 2023-08-17T00:09:51.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.476+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7faefc01a060 con 0x7faf0c0c01a0 2023-08-17T00:09:51.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.480+0000 7faefa7fc700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faeec05a150 0x7faeec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.480+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5269+0+0 (secure 0 0 0) 0x7faefc073490 con 0x7faf0c0c01a0 2023-08-17T00:09:51.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.480+0000 7faf09d9b700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faeec05a150 0x7faeec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.480+0000 7faf09d9b700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faeec05a150 0x7faeec05c610 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7faf00009fd0 tx=0x7faf00017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.488+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faefc047290 con 0x7faf0c0c01a0 2023-08-17T00:09:51.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.644+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7faf0c0bf9a0 con 0x7faf0c0c01a0 2023-08-17T00:09:51.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.644+0000 7faefa7fc700 1 -- 172.21.15.153:0/982752225 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v94) v1 ==== 110+0+10 (secure 0 0 0) 0x7faefc04a8b0 con 0x7faf0c0c01a0 2023-08-17T00:09:51.651 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:09:51.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faeec05a150 msgr2=0x7faeec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faeec05a150 0x7faeec05c610 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7faf00009fd0 tx=0x7faf00017000).stop 2023-08-17T00:09:51.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 msgr2=0x7faf0c0ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 0x7faf0c0ae5c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 rx=0x7faefc00c490 tx=0x7faefc007de0).stop 2023-08-17T00:09:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 shutdown_connections 2023-08-17T00:09:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faeec05a150 0x7faeec05c610 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf0c153f50 0x7faf0c152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf0c0c57a0 0x7faf0c155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 --2- 172.21.15.153:0/982752225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faf0c0c01a0 0x7faf0c0ae5c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 >> 172.21.15.153:0/982752225 conn(0x7faf0c062a70 msgr2=0x7faf0c1550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 shutdown_connections 2023-08-17T00:09:51.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.648+0000 7faf0b59e700 1 -- 172.21.15.153:0/982752225 wait complete. 2023-08-17T00:09:51.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:09:51.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 Processor -- start 2023-08-17T00:09:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 -- start start 2023-08-17T00:09:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5300689c0 0x7fd530068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd530151530 0x7fd5301519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd530065da0 con 0x7fd5301560f0 2023-08-17T00:09:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd530155c60 con 0x7fd5300689c0 2023-08-17T00:09:51.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5367b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd530156550 con 0x7fd530151530 2023-08-17T00:09:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd534fb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd5301560f0 0x7fd5300c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34296/0 (socket says 172.21.15.153:34296) 2023-08-17T00:09:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd534fb6700 1 -- 172.21.15.153:0/3975106788 learned_addr learned my addr 172.21.15.153:0/3975106788 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd535fb8700 1 --2- 172.21.15.153:0/3975106788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd530151530 0x7fd5301519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.832+0000 7fd5357b7700 1 --2- 172.21.15.153:0/3975106788 >> v2:172.21.15.178:3300/0 conn(0x7fd5300689c0 0x7fd530068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd527fff700 1 -- 172.21.15.153:0/3975106788 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 950519108 0 0) 0x7fd530065da0 con 0x7fd5301560f0 2023-08-17T00:09:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd527fff700 1 -- 172.21.15.153:0/3975106788 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd51c0033f0 con 0x7fd5301560f0 2023-08-17T00:09:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd527fff700 1 -- 172.21.15.153:0/3975106788 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568969458 0 0) 0x7fd51c0033f0 con 0x7fd5301560f0 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd535fb8700 1 -- 172.21.15.153:0/3975106788 >> v2:172.21.15.178:3300/0 conn(0x7fd5300689c0 msgr2=0x7fd530068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd535fb8700 1 --2- 172.21.15.153:0/3975106788 >> v2:172.21.15.178:3300/0 conn(0x7fd5300689c0 0x7fd530068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd535fb8700 1 -- 172.21.15.153:0/3975106788 >> v1:172.21.15.153:6789/0 conn(0x7fd5301560f0 legacy=0x7fd5300c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd535fb8700 1 -- 172.21.15.153:0/3975106788 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530065ff0 con 0x7fd530151530 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd535fb8700 1 --2- 172.21.15.153:0/3975106788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd530151530 0x7fd5301519c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd528009e60 tx=0x7fd528009780).ready entity=mon.2 client_cookie=45879922fc907b09 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd527fff700 1 -- 172.21.15.153:0/3975106788 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52800e070 con 0x7fd530151530 2023-08-17T00:09:51.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd527fff700 1 -- 172.21.15.153:0/3975106788 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52800b7a0 con 0x7fd530151530 2023-08-17T00:09:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd527fff700 1 -- 172.21.15.153:0/3975106788 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520001470 con 0x7fd530151530 2023-08-17T00:09:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 -- 172.21.15.153:0/3975106788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd530151530 msgr2=0x7fd5301519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 --2- 172.21.15.153:0/3975106788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd530151530 0x7fd5301519c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fd528009e60 tx=0x7fd528009780).stop 2023-08-17T00:09:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 -- 172.21.15.153:0/3975106788 shutdown_connections 2023-08-17T00:09:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 --2- 172.21.15.153:0/3975106788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd530151530 0x7fd5301519c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 --2- 172.21.15.153:0/3975106788 >> v2:172.21.15.178:3300/0 conn(0x7fd5300689c0 0x7fd530068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 -- 172.21.15.153:0/3975106788 >> 172.21.15.153:0/3975106788 conn(0x7fd5300c6620 msgr2=0x7fd5300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 -- 172.21.15.153:0/3975106788 shutdown_connections 2023-08-17T00:09:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.836+0000 7fd5367b9700 1 -- 172.21.15.153:0/3975106788 wait complete. 2023-08-17T00:09:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.840+0000 7fd5367b9700 1 Processor -- start 2023-08-17T00:09:51.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.840+0000 7fd5367b9700 1 -- start start 2023-08-17T00:09:51.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.840+0000 7fd5367b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5300689c0 0x7fd530164dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.840+0000 7fd5367b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd530151530 0x7fd530162830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5367b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 0x7fd530162fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5367b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300a3190 con 0x7fd5301560f0 2023-08-17T00:09:51.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5367b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd530162d20 con 0x7fd530151530 2023-08-17T00:09:51.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5367b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300a0b40 con 0x7fd5300689c0 2023-08-17T00:09:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 0x7fd530162fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 0x7fd530162fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35216/0 (socket says 172.21.15.153:35216) 2023-08-17T00:09:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 -- 172.21.15.153:0/2661032414 learned_addr learned my addr 172.21.15.153:0/2661032414 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd534fb6700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd530151530 0x7fd530162830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5357b7700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5300689c0 0x7fd530164dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 -- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5300689c0 msgr2=0x7fd530164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5300689c0 0x7fd530164dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 -- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd530151530 msgr2=0x7fd530162830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd530151530 0x7fd530162830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 -- 172.21.15.153:0/2661032414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009a20 con 0x7fd5301560f0 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd535fb8700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 0x7fd530162fc0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fd52800b610 tx=0x7fd528009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52801d420 con 0x7fd5301560f0 2023-08-17T00:09:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52801d580 con 0x7fd5301560f0 2023-08-17T00:09:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52801d940 con 0x7fd5301560f0 2023-08-17T00:09:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5300a0e20 con 0x7fd5301560f0 2023-08-17T00:09:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.844+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5300a13e0 con 0x7fd5301560f0 2023-08-17T00:09:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.848+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53006b4c0 con 0x7fd5301560f0 2023-08-17T00:09:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.848+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd52801dcb0 con 0x7fd5301560f0 2023-08-17T00:09:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.848+0000 7fd5257fa700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd51405e560 0x7fd514060a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.848+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fd528075d10 con 0x7fd5301560f0 2023-08-17T00:09:51.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.852+0000 7fd5357b7700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd51405e560 0x7fd514060a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:51.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.852+0000 7fd5357b7700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd51405e560 0x7fd514060a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fd52c009200 tx=0x7fd52c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:51.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:51.856+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd52807b020 con 0x7fd5301560f0 2023-08-17T00:09:52.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.016+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd530063750 con 0x7fd5301560f0 2023-08-17T00:09:52.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.016+0000 7fd5257fa700 1 -- 172.21.15.153:0/2661032414 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v94) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd528049a00 con 0x7fd5301560f0 2023-08-17T00:09:52.022 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:09:52.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd51405e560 msgr2=0x7fd514060a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd51405e560 0x7fd514060a20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fd52c009200 tx=0x7fd52c008040).stop 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 msgr2=0x7fd530162fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 0x7fd530162fc0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7fd52800b610 tx=0x7fd528009780).stop 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 shutdown_connections 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd51405e560 0x7fd514060a20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5301560f0 0x7fd530162fc0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd530151530 0x7fd530162830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 --2- 172.21.15.153:0/2661032414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5300689c0 0x7fd530164dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 >> 172.21.15.153:0/2661032414 conn(0x7fd5300c6620 msgr2=0x7fd5300bffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:52.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 shutdown_connections 2023-08-17T00:09:52.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.020+0000 7fd5367b9700 1 -- 172.21.15.153:0/2661032414 wait complete. 2023-08-17T00:09:52.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:09:52.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 Processor -- start 2023-08-17T00:09:52.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 -- start start 2023-08-17T00:09:52.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c151b90 0x7f281c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f281c064870 0x7f281c064d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c065210 con 0x7f281c063290 2023-08-17T00:09:52.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f281c0c3fb0 con 0x7f281c064870 2023-08-17T00:09:52.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f28246db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c152460 con 0x7f281c151b90 2023-08-17T00:09:52.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f2822c78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f281c064870 0x7f281c064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f2821c76700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f281c063290 0x7f281c065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34304/0 (socket says 172.21.15.153:34304) 2023-08-17T00:09:52.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.196+0000 7f2821c76700 1 -- 172.21.15.153:0/2458957735 learned_addr learned my addr 172.21.15.153:0/2458957735 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:52.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2822c78700 1 -- 172.21.15.153:0/2458957735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c151b90 msgr2=0x7f281c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2822c78700 1 --2- 172.21.15.153:0/2458957735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c151b90 0x7f281c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2822c78700 1 -- 172.21.15.153:0/2458957735 >> v1:172.21.15.153:6789/0 conn(0x7f281c063290 legacy=0x7f281c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2822c78700 1 -- 172.21.15.153:0/2458957735 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c061fa0 con 0x7f281c064870 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2822c78700 1 --2- 172.21.15.153:0/2458957735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c064d20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f2814009e60 tx=0x7f2814009780).ready entity=mon.0 client_cookie=3b43785da819a543 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2821475700 1 -- 172.21.15.153:0/2458957735 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f281400e070 con 0x7f281c064870 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2821475700 1 -- 172.21.15.153:0/2458957735 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f281400bc30 con 0x7f281c064870 2023-08-17T00:09:52.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f2821475700 1 -- 172.21.15.153:0/2458957735 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814012410 con 0x7f281c064870 2023-08-17T00:09:52.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 -- 172.21.15.153:0/2458957735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 msgr2=0x7f281c064d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 --2- 172.21.15.153:0/2458957735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c064d20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f2814009e60 tx=0x7f2814009780).stop 2023-08-17T00:09:52.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 -- 172.21.15.153:0/2458957735 shutdown_connections 2023-08-17T00:09:52.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 --2- 172.21.15.153:0/2458957735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c064d20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 --2- 172.21.15.153:0/2458957735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c151b90 0x7f281c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:09:52.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 -- 172.21.15.153:0/2458957735 >> 172.21.15.153:0/2458957735 conn(0x7f281c0c7150 msgr2=0x7f281c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:52.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 -- 172.21.15.153:0/2458957735 shutdown_connections 2023-08-17T00:09:52.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 -- 172.21.15.153:0/2458957735 wait complete. 2023-08-17T00:09:52.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.200+0000 7f28246db700 1 Processor -- start 2023-08-17T00:09:52.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 -- start start 2023-08-17T00:09:52.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c063290 0x7f281c14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f281c151b90 0x7f281c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c165470 con 0x7f281c064870 2023-08-17T00:09:52.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c164860 con 0x7f281c151b90 2023-08-17T00:09:52.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c164b40 con 0x7f281c063290 2023-08-17T00:09:52.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35242/0 (socket says 172.21.15.153:35242) 2023-08-17T00:09:52.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 -- 172.21.15.153:0/2281896611 learned_addr learned my addr 172.21.15.153:0/2281896611 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2822477700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c063290 0x7f281c14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2822c78700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f281c151b90 0x7f281c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 -- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c063290 msgr2=0x7f281c14ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c063290 0x7f281c14ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 -- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f281c151b90 msgr2=0x7f281c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f281c151b90 0x7f281c1589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 -- 172.21.15.153:0/2281896611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009a20 con 0x7f281c064870 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2822c78700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f281c151b90 0x7f281c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f2821c76700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c1584c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f280c00c410 tx=0x7f280c007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0072e0 con 0x7f281c064870 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c007440 con 0x7f281c064870 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c164e20 con 0x7f281c064870 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c0057a0 con 0x7f281c064870 2023-08-17T00:09:52.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.204+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c1644d0 con 0x7f281c064870 2023-08-17T00:09:52.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.208+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c1525d0 con 0x7f281c064870 2023-08-17T00:09:52.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.208+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f280c01a060 con 0x7f281c064870 2023-08-17T00:09:52.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.208+0000 7f28127fc700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f280005a150 0x7f280005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.212+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f280c073410 con 0x7f281c064870 2023-08-17T00:09:52.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.212+0000 7f2822477700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f280005a150 0x7f280005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.212+0000 7f2822477700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f280005a150 0x7f280005c610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f281800b870 tx=0x7f2818008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:52.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.216+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f281c1525d0 con 0x7f281c064870 2023-08-17T00:09:52.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.376+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f281c065210 con 0x7f281c064870 2023-08-17T00:09:52.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28127fc700 1 -- 172.21.15.153:0/2281896611 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v94) v1 ==== 84+0+143 (secure 0 0 0) 0x7f281c065210 con 0x7f281c064870 2023-08-17T00:09:52.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:09:52.385 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:09:52.386 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:09:52.386 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:09:52.386 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:09:52.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f280005a150 msgr2=0x7f280005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f280005a150 0x7f280005c610 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f281800b870 tx=0x7f2818008040).stop 2023-08-17T00:09:52.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 msgr2=0x7f281c1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c1584c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f280c00c410 tx=0x7f280c007d80).stop 2023-08-17T00:09:52.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 shutdown_connections 2023-08-17T00:09:52.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f280005a150 0x7f280005c610 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f281c151b90 0x7f281c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f281c064870 0x7f281c1584c0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 --2- 172.21.15.153:0/2281896611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f281c063290 0x7f281c14ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.380+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 >> 172.21.15.153:0/2281896611 conn(0x7f281c0c7150 msgr2=0x7f281c0c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:52.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.384+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 shutdown_connections 2023-08-17T00:09:52.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.384+0000 7f28246db700 1 -- 172.21.15.153:0/2281896611 wait complete. 2023-08-17T00:09:52.405 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:09:52.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:09:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.568+0000 7fb982e1b700 1 Processor -- start 2023-08-17T00:09:52.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.572+0000 7fb982e1b700 1 -- start start 2023-08-17T00:09:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.572+0000 7fb982e1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb97c0a9be0 0x7fb97c0a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.572+0000 7fb982e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.572+0000 7fb982e1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97c154620 con 0x7fb97c158190 2023-08-17T00:09:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.572+0000 7fb982e1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97c154900 con 0x7fb97c0a9be0 2023-08-17T00:09:52.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.572+0000 7fb982e1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c154be0 con 0x7fb97c0c7ad0 2023-08-17T00:09:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb97c158190 0x7fb97c0c73c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34314/0 (socket says 172.21.15.153:34314) 2023-08-17T00:09:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97bfff700 1 -- 172.21.15.153:0/2004150039 learned_addr learned my addr 172.21.15.153:0/2004150039 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb980bb7700 1 --2- 172.21.15.153:0/2004150039 >> v2:172.21.15.153:3300/0 conn(0x7fb97c0a9be0 0x7fb97c0a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb9813b8700 1 --2- 172.21.15.153:0/2004150039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97b7fe700 1 -- 172.21.15.153:0/2004150039 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 780291427 0 0) 0x7fb97c154620 con 0x7fb97c158190 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97b7fe700 1 -- 172.21.15.153:0/2004150039 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb96c0033f0 con 0x7fb97c158190 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb980bb7700 1 -- 172.21.15.153:0/2004150039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 msgr2=0x7fb97c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb980bb7700 1 --2- 172.21.15.153:0/2004150039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb980bb7700 1 -- 172.21.15.153:0/2004150039 >> v1:172.21.15.153:6789/0 conn(0x7fb97c158190 legacy=0x7fb97c0c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb980bb7700 1 -- 172.21.15.153:0/2004150039 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c154ec0 con 0x7fb97c0a9be0 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb980bb7700 1 --2- 172.21.15.153:0/2004150039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9fc0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fb970009760 tx=0x7fb970009060).ready entity=mon.0 client_cookie=dcfe8f91251067bc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:52.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97b7fe700 1 -- 172.21.15.153:0/2004150039 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9700090d0 con 0x7fb97c0a9be0 2023-08-17T00:09:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97b7fe700 1 -- 172.21.15.153:0/2004150039 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97000d4a0 con 0x7fb97c0a9be0 2023-08-17T00:09:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb97b7fe700 1 -- 172.21.15.153:0/2004150039 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97000d820 con 0x7fb97c0a9be0 2023-08-17T00:09:52.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 -- 172.21.15.153:0/2004150039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c0a9be0 msgr2=0x7fb97c0a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 --2- 172.21.15.153:0/2004150039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9fc0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7fb970009760 tx=0x7fb970009060).stop 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 -- 172.21.15.153:0/2004150039 shutdown_connections 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 --2- 172.21.15.153:0/2004150039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 --2- 172.21.15.153:0/2004150039 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9fc0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 -- 172.21.15.153:0/2004150039 >> 172.21.15.153:0/2004150039 conn(0x7fb97c061fa0 msgr2=0x7fb97c062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 -- 172.21.15.153:0/2004150039 shutdown_connections 2023-08-17T00:09:52.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.576+0000 7fb982e1b700 1 -- 172.21.15.153:0/2004150039 wait complete. 2023-08-17T00:09:52.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 Processor -- start 2023-08-17T00:09:52.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 -- start start 2023-08-17T00:09:52.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c063840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 0x7fb97c152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c063d30 con 0x7fb97c158190 2023-08-17T00:09:52.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c063f90 con 0x7fb97c0a9be0 2023-08-17T00:09:52.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb982e1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97c164010 con 0x7fb97c0c7ad0 2023-08-17T00:09:52.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 0x7fb97c152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 0x7fb97c152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35260/0 (socket says 172.21.15.153:35260) 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 -- 172.21.15.153:0/788789852 learned_addr learned my addr 172.21.15.153:0/788789852 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb97bfff700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c063840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb980bb7700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 -- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 msgr2=0x7fb97c063840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c063840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 -- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb97c0a9be0 msgr2=0x7fb97c0a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:52.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 -- 172.21.15.153:0/788789852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9700092a0 con 0x7fb97c158190 2023-08-17T00:09:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb980bb7700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:52.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.580+0000 7fb9813b8700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 0x7fb97c152430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fb974009ec0 tx=0x7fb97400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:52.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97400cc20 con 0x7fb97c158190 2023-08-17T00:09:52.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97400f040 con 0x7fb97c158190 2023-08-17T00:09:52.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97c1642f0 con 0x7fb97c158190 2023-08-17T00:09:52.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb974013400 con 0x7fb97c158190 2023-08-17T00:09:52.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97c1648b0 con 0x7fb97c158190 2023-08-17T00:09:52.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97c06b530 con 0x7fb97c158190 2023-08-17T00:09:52.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.584+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb974013770 con 0x7fb97c158190 2023-08-17T00:09:52.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.588+0000 7fb978ff9700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb96005a150 0x7fb96005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:52.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.588+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb9740748d0 con 0x7fb97c158190 2023-08-17T00:09:52.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.588+0000 7fb980bb7700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb96005a150 0x7fb96005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:52.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.588+0000 7fb980bb7700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb96005a150 0x7fb96005c610 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fb97000d260 tx=0x7fb970016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:52.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.592+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb9740485c0 con 0x7fb97c158190 2023-08-17T00:09:52.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:52.756+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7fb97c1585d0 con 0x7fb97c158190 2023-08-17T00:09:53.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.356+0000 7fb978ff9700 1 -- 172.21.15.153:0/788789852 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v95) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb97404bbe0 con 0x7fb97c158190 2023-08-17T00:09:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb96005a150 msgr2=0x7fb96005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb96005a150 0x7fb96005c610 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7fb97000d260 tx=0x7fb970016000).stop 2023-08-17T00:09:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 msgr2=0x7fb97c152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 0x7fb97c152430 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7fb974009ec0 tx=0x7fb97400b040).stop 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 shutdown_connections 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb96005a150 0x7fb96005c610 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb97c158190 0x7fb97c152430 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb97c0c7ad0 0x7fb97c063840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 --2- 172.21.15.153:0/788789852 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb97c0a9be0 0x7fb97c0a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 >> 172.21.15.153:0/788789852 conn(0x7fb97c061fa0 msgr2=0x7fb97c0acfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:53.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 shutdown_connections 2023-08-17T00:09:53.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.360+0000 7fb982e1b700 1 -- 172.21.15.153:0/788789852 wait complete. 2023-08-17T00:09:53.375 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:09:53.392 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:09:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 Processor -- start 2023-08-17T00:09:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 -- start start 2023-08-17T00:09:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3fa80c5ea0 0x7f3fa80634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fa80639a0 0x7f3fa80bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa8154e90 con 0x7f3fa80acf30 2023-08-17T00:09:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa80c1730 con 0x7f3fa80639a0 2023-08-17T00:09:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.556+0000 7f3fa759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa8153fc0 con 0x7f3fa80c5ea0 2023-08-17T00:09:53.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fa80639a0 0x7f3fa80bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fa80639a0 0x7f3fa80bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35266/0 (socket says 172.21.15.153:35266) 2023-08-17T00:09:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 -- 172.21.15.153:0/382362634 learned_addr learned my addr 172.21.15.153:0/382362634 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa5d9b700 1 --2- 172.21.15.153:0/382362634 >> v2:172.21.15.178:3300/0 conn(0x7f3fa80c5ea0 0x7f3fa80634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:53.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 -- 172.21.15.153:0/382362634 >> v2:172.21.15.178:3300/0 conn(0x7f3fa80c5ea0 msgr2=0x7f3fa80634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 --2- 172.21.15.153:0/382362634 >> v2:172.21.15.178:3300/0 conn(0x7f3fa80c5ea0 0x7f3fa80634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 -- 172.21.15.153:0/382362634 >> v1:172.21.15.178:6789/0 conn(0x7f3fa80acf30 legacy=0x7f3fa80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:53.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 -- 172.21.15.153:0/382362634 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8154280 con 0x7f3fa80639a0 2023-08-17T00:09:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa6d9d700 1 --2- 172.21.15.153:0/382362634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80639a0 0x7f3fa80bfad0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f3fa80b0a60 tx=0x7f3fa0009840).ready entity=mon.0 client_cookie=1cfca42da90c23b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa559a700 1 -- 172.21.15.153:0/382362634 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000e070 con 0x7f3fa80639a0 2023-08-17T00:09:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa559a700 1 -- 172.21.15.153:0/382362634 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa000ba20 con 0x7f3fa80639a0 2023-08-17T00:09:53.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa559a700 1 -- 172.21.15.153:0/382362634 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa000bda0 con 0x7f3fa80639a0 2023-08-17T00:09:53.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa759e700 1 -- 172.21.15.153:0/382362634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80639a0 msgr2=0x7f3fa80bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:53.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.560+0000 7f3fa759e700 1 --2- 172.21.15.153:0/382362634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80639a0 0x7f3fa80bfad0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 rx=0x7f3fa80b0a60 tx=0x7f3fa0009840).stop 2023-08-17T00:09:53.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 -- 172.21.15.153:0/382362634 shutdown_connections 2023-08-17T00:09:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 --2- 172.21.15.153:0/382362634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80639a0 0x7f3fa80bfad0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 --2- 172.21.15.153:0/382362634 >> v2:172.21.15.178:3300/0 conn(0x7f3fa80c5ea0 0x7f3fa80634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 -- 172.21.15.153:0/382362634 >> 172.21.15.153:0/382362634 conn(0x7f3fa80cb330 msgr2=0x7f3fa80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 -- 172.21.15.153:0/382362634 shutdown_connections 2023-08-17T00:09:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 -- 172.21.15.153:0/382362634 wait complete. 2023-08-17T00:09:53.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 Processor -- start 2023-08-17T00:09:53.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.564+0000 7f3fa759e700 1 -- start start 2023-08-17T00:09:53.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fa80639a0 0x7f3fa80c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 0x7f3fa80ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fa80b0120 0x7f3fa80a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa80ade50 con 0x7f3fa80acf30 2023-08-17T00:09:53.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa80c30d0 con 0x7f3fa80639a0 2023-08-17T00:09:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa80c3c50 con 0x7f3fa80b0120 2023-08-17T00:09:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 0x7f3fa80ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:53.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 0x7f3fa80ad960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35282/0 (socket says 172.21.15.153:35282) 2023-08-17T00:09:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 -- 172.21.15.153:0/3180176231 learned_addr learned my addr 172.21.15.153:0/3180176231 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa659c700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fa80639a0 0x7f3fa80c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa6d9d700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fa80b0120 0x7f3fa80a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:53.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 -- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fa80b0120 msgr2=0x7f3fa80a8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fa80b0120 0x7f3fa80a8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 -- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fa80639a0 msgr2=0x7f3fa80c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fa80639a0 0x7f3fa80c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:53.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 -- 172.21.15.153:0/3180176231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa0009ae0 con 0x7f3fa80acf30 2023-08-17T00:09:53.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa5d9b700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 0x7f3fa80ad960 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f3f9c00e900 tx=0x7f3f9c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:53.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00c640 con 0x7f3fa80acf30 2023-08-17T00:09:53.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00c7a0 con 0x7f3fa80acf30 2023-08-17T00:09:53.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00cb20 con 0x7f3fa80acf30 2023-08-17T00:09:53.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa80c3320 con 0x7f3fa80acf30 2023-08-17T00:09:53.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.568+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa80c38e0 con 0x7f3fa80acf30 2023-08-17T00:09:53.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.572+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa80c3e00 con 0x7f3fa80acf30 2023-08-17T00:09:53.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.572+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3f9c022070 con 0x7f3fa80acf30 2023-08-17T00:09:53.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.572+0000 7f3f967fc700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f8805a150 0x7f3f8805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:53.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.572+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f3f9c074330 con 0x7f3fa80acf30 2023-08-17T00:09:53.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.572+0000 7f3fa659c700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f8805a150 0x7f3f8805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:53.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.576+0000 7f3fa659c700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f8805a150 0x7f3f8805c610 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f3f980036d0 tx=0x7f3f98009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:53.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.580+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fa80c3e00 con 0x7f3fa80acf30 2023-08-17T00:09:53.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:53.744+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3fa80c3dc0 con 0x7f3fa80acf30 2023-08-17T00:09:54.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.368+0000 7f3f967fc700 1 -- 172.21.15.153:0/3180176231 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v96) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3f9c016070 con 0x7f3fa80acf30 2023-08-17T00:09:54.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.376+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f8805a150 msgr2=0x7f3f8805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.376+0000 7f3fa759e700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f8805a150 0x7f3f8805c610 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7f3f980036d0 tx=0x7f3f98009040).stop 2023-08-17T00:09:54.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.376+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 msgr2=0x7f3fa80ad960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.376+0000 7f3fa759e700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 0x7f3fa80ad960 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7f3f9c00e900 tx=0x7f3f9c009060).stop 2023-08-17T00:09:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.384+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 shutdown_connections 2023-08-17T00:09:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.384+0000 7f3fa759e700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f8805a150 0x7f3f8805c610 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.384+0000 7f3fa759e700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fa80b0120 0x7f3fa80a8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.384+0000 7f3fa759e700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fa80acf30 0x7f3fa80ad960 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.384+0000 7f3fa759e700 1 --2- 172.21.15.153:0/3180176231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fa80639a0 0x7f3fa80c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.384+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 >> 172.21.15.153:0/3180176231 conn(0x7f3fa80cb330 msgr2=0x7f3fa8153830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:54.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.388+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 shutdown_connections 2023-08-17T00:09:54.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.392+0000 7f3fa759e700 1 -- 172.21.15.153:0/3180176231 wait complete. 2023-08-17T00:09:54.406 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:09:54.422 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:09:54.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.580+0000 7fd47ffff700 1 Processor -- start 2023-08-17T00:09:54.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.580+0000 7fd47ffff700 1 -- start start 2023-08-17T00:09:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:54.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd480063bc0 0x7fd4800bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd480154e90 con 0x7fd4800c5ea0 2023-08-17T00:09:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47ffff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd480153fc0 con 0x7fd480063bc0 2023-08-17T00:09:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480154280 con 0x7fd4800acf30 2023-08-17T00:09:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd4800c5ea0 0x7fd4800634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:34316/0 (socket says 172.21.15.153:34316) 2023-08-17T00:09:54.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47e7fc700 1 -- 172.21.15.153:0/665644535 learned_addr learned my addr 172.21.15.153:0/665644535 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47effd700 1 --2- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:54.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.584+0000 7fd47f7fe700 1 --2- 172.21.15.153:0/665644535 >> v2:172.21.15.178:3300/0 conn(0x7fd480063bc0 0x7fd4800bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47dffb700 1 -- 172.21.15.153:0/665644535 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159746370 0 0) 0x7fd480154e90 con 0x7fd4800c5ea0 2023-08-17T00:09:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47dffb700 1 -- 172.21.15.153:0/665644535 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4680033f0 con 0x7fd4800c5ea0 2023-08-17T00:09:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47f7fe700 1 -- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 msgr2=0x7fd4800c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47f7fe700 1 --2- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47f7fe700 1 -- 172.21.15.153:0/665644535 >> v1:172.21.15.153:6789/0 conn(0x7fd4800c5ea0 legacy=0x7fd4800634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47f7fe700 1 -- 172.21.15.153:0/665644535 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd480154560 con 0x7fd480063bc0 2023-08-17T00:09:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47f7fe700 1 --2- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd4800bfad0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fd478009e60 tx=0x7fd478009780).ready entity=mon.1 client_cookie=cc5faa0887ace215 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47dffb700 1 -- 172.21.15.153:0/665644535 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800e070 con 0x7fd480063bc0 2023-08-17T00:09:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47dffb700 1 -- 172.21.15.153:0/665644535 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47800bab0 con 0x7fd480063bc0 2023-08-17T00:09:54.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47dffb700 1 -- 172.21.15.153:0/665644535 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47800be30 con 0x7fd480063bc0 2023-08-17T00:09:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 -- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 msgr2=0x7fd4800bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 --2- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd4800bfad0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7fd478009e60 tx=0x7fd478009780).stop 2023-08-17T00:09:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 -- 172.21.15.153:0/665644535 shutdown_connections 2023-08-17T00:09:54.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 --2- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd4800bfad0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 --2- 172.21.15.153:0/665644535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 -- 172.21.15.153:0/665644535 >> 172.21.15.153:0/665644535 conn(0x7fd4800cb330 msgr2=0x7fd4800c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:54.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 -- 172.21.15.153:0/665644535 shutdown_connections 2023-08-17T00:09:54.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.588+0000 7fd47ffff700 1 -- 172.21.15.153:0/665644535 wait complete. 2023-08-17T00:09:54.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 Processor -- start 2023-08-17T00:09:54.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 -- start start 2023-08-17T00:09:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd480146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 0x7fd4800c3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480159dd0 con 0x7fd480146650 2023-08-17T00:09:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4800c3cf0 con 0x7fd480063bc0 2023-08-17T00:09:54.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480158d60 con 0x7fd4800acf30 2023-08-17T00:09:54.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 0x7fd4800c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.592+0000 7fd47f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 0x7fd4800c3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35288/0 (socket says 172.21.15.153:35288) 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 -- 172.21.15.153:0/1675004716 learned_addr learned my addr 172.21.15.153:0/1675004716 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47effd700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd480146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47e7fc700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 -- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 msgr2=0x7fd4800c3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 -- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 msgr2=0x7fd480146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd480146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 -- 172.21.15.153:0/1675004716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd478009a20 con 0x7fd480146650 2023-08-17T00:09:54.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47e7fc700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:54.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47f7fe700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 0x7fd4800c3800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fd480083e70 tx=0x7fd478009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47801d630 con 0x7fd480146650 2023-08-17T00:09:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47801d790 con 0x7fd480146650 2023-08-17T00:09:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd480158150 con 0x7fd480146650 2023-08-17T00:09:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47801db30 con 0x7fd480146650 2023-08-17T00:09:54.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480158710 con 0x7fd480146650 2023-08-17T00:09:54.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.596+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4800c8210 con 0x7fd480146650 2023-08-17T00:09:54.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.600+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd478027460 con 0x7fd480146650 2023-08-17T00:09:54.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.600+0000 7fd466ffd700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd46c05a150 0x7fd46c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:54.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.604+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fd478076d20 con 0x7fd480146650 2023-08-17T00:09:54.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.604+0000 7fd47effd700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd46c05a150 0x7fd46c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:54.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.604+0000 7fd47effd700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd46c05a150 0x7fd46c05c610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fd470009c30 tx=0x7fd470009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:54.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.608+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd47804a740 con 0x7fd480146650 2023-08-17T00:09:54.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.804+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd48006b4c0 con 0x7fd480146650 2023-08-17T00:09:54.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.816+0000 7fd466ffd700 1 -- 172.21.15.153:0/1675004716 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd47804dd60 con 0x7fd480146650 2023-08-17T00:09:54.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.828+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd46c05a150 msgr2=0x7fd46c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.828+0000 7fd47ffff700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd46c05a150 0x7fd46c05c610 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fd470009c30 tx=0x7fd470009060).stop 2023-08-17T00:09:54.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.828+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 msgr2=0x7fd4800c3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:54.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.828+0000 7fd47ffff700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 0x7fd4800c3800 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 rx=0x7fd480083e70 tx=0x7fd478009780).stop 2023-08-17T00:09:54.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.832+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 shutdown_connections 2023-08-17T00:09:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.832+0000 7fd47ffff700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd46c05a150 0x7fd46c05c610 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.832+0000 7fd47ffff700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd480146650 0x7fd4800c3800 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.832+0000 7fd47ffff700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4800acf30 0x7fd4800c3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.832+0000 7fd47ffff700 1 --2- 172.21.15.153:0/1675004716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd480063bc0 0x7fd480146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:54.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.832+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 >> 172.21.15.153:0/1675004716 conn(0x7fd4800cb330 msgr2=0x7fd4800c1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:54.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.840+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 shutdown_connections 2023-08-17T00:09:54.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:54.840+0000 7fd47ffff700 1 -- 172.21.15.153:0/1675004716 wait complete. 2023-08-17T00:09:54.850 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 13 and data pool 14 2023-08-17T00:09:54.867 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:55.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 Processor -- start 2023-08-17T00:09:55.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 -- start start 2023-08-17T00:09:55.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8fb40689c0 0x7f8fb4068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb41560f0 0x7f8fb40c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb4065da0 con 0x7f8fb4151530 2023-08-17T00:09:55.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb4155c60 con 0x7f8fb40689c0 2023-08-17T00:09:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.020+0000 7f8fb92b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4156550 con 0x7f8fb41560f0 2023-08-17T00:09:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb8ab8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8fb4151530 0x7f8fb41519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41292/0 (socket says 172.21.15.153:41292) 2023-08-17T00:09:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb8ab8700 1 -- 172.21.15.153:0/1448401658 learned_addr learned my addr 172.21.15.153:0/1448401658 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb3fff700 1 --2- 172.21.15.153:0/1448401658 >> v2:172.21.15.178:3300/0 conn(0x7f8fb40689c0 0x7f8fb4068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fab7fe700 1 --2- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb41560f0 0x7f8fb40c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb37fe700 1 -- 172.21.15.153:0/1448401658 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686919524 0 0) 0x7f8fb4065da0 con 0x7f8fb4151530 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb37fe700 1 -- 172.21.15.153:0/1448401658 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa00033f0 con 0x7f8fb4151530 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb3fff700 1 -- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb41560f0 msgr2=0x7f8fb40c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb3fff700 1 --2- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb41560f0 0x7f8fb40c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb3fff700 1 -- 172.21.15.153:0/1448401658 >> v1:172.21.15.153:6789/0 conn(0x7f8fb4151530 legacy=0x7f8fb41519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb3fff700 1 -- 172.21.15.153:0/1448401658 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4065ff0 con 0x7f8fb40689c0 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb3fff700 1 --2- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4068da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8fa4006fd0 tx=0x7f8fa4006f40).ready entity=mon.1 client_cookie=f19abec0065c75c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb37fe700 1 -- 172.21.15.153:0/1448401658 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4005880 con 0x7f8fb40689c0 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb37fe700 1 -- 172.21.15.153:0/1448401658 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa40059e0 con 0x7f8fb40689c0 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb37fe700 1 -- 172.21.15.153:0/1448401658 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4005d60 con 0x7f8fb40689c0 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 msgr2=0x7f8fb4068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4068da0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f8fa4006fd0 tx=0x7f8fa4006f40).stop 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1448401658 shutdown_connections 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb41560f0 0x7f8fb40c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1448401658 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4068da0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1448401658 >> 172.21.15.153:0/1448401658 conn(0x7f8fb40c6620 msgr2=0x7f8fb40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1448401658 shutdown_connections 2023-08-17T00:09:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.024+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1448401658 wait complete. 2023-08-17T00:09:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.028+0000 7f8fb92b9700 1 Processor -- start 2023-08-17T00:09:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.028+0000 7f8fb92b9700 1 -- start start 2023-08-17T00:09:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.028+0000 7f8fb92b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.028+0000 7f8fb92b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb4151530 0x7f8fb4152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 0x7f8fb40bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4153af0 con 0x7f8fb41560f0 2023-08-17T00:09:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40ba510 con 0x7f8fb40689c0 2023-08-17T00:09:55.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4153530 con 0x7f8fb4151530 2023-08-17T00:09:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 0x7f8fb40bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 0x7f8fb40bc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60172/0 (socket says 172.21.15.153:60172) 2023-08-17T00:09:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 -- 172.21.15.153:0/1991315194 learned_addr learned my addr 172.21.15.153:0/1991315194 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fab7fe700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb4151530 0x7f8fb4152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb3fff700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 -- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb4151530 msgr2=0x7f8fb4152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb4151530 0x7f8fb4152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 -- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 msgr2=0x7f8fb4147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 -- 172.21.15.153:0/1991315194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009250 con 0x7f8fb41560f0 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb8ab8700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 0x7f8fb40bc2a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f8fac005ad0 tx=0x7f8fac001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac005d30 con 0x7f8fb41560f0 2023-08-17T00:09:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac005e90 con 0x7f8fb41560f0 2023-08-17T00:09:55.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb4153810 con 0x7f8fb41560f0 2023-08-17T00:09:55.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac007320 con 0x7f8fb41560f0 2023-08-17T00:09:55.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4148090 con 0x7f8fb41560f0 2023-08-17T00:09:55.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.032+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb40b9f90 con 0x7f8fb41560f0 2023-08-17T00:09:55.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.036+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8fac010030 con 0x7f8fb41560f0 2023-08-17T00:09:55.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.036+0000 7f8fb0ff9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f9405a150 0x7f8f9405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.036+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8fac073fe0 con 0x7f8fb41560f0 2023-08-17T00:09:55.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.036+0000 7f8fb3fff700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f9405a150 0x7f8f9405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.040+0000 7f8fb3fff700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f9405a150 0x7f8f9405c610 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f8fa4009fd0 tx=0x7f8fa4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.044+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fb40b9f90 con 0x7f8fb41560f0 2023-08-17T00:09:55.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.204+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8fb40ba650 con 0x7f8fb41560f0 2023-08-17T00:09:55.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.208+0000 7f8fb0ff9700 1 -- 172.21.15.153:0/1991315194 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f8fb40ba650 con 0x7f8fb41560f0 2023-08-17T00:09:55.213 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:55.213 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":97,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:54.807889+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:09:52.827329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T00:09:53.817978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f9405a150 msgr2=0x7f8f9405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f9405a150 0x7f8f9405c610 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f8fa4009fd0 tx=0x7f8fa4015000).stop 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 msgr2=0x7f8fb40bc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 0x7f8fb40bc2a0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 rx=0x7f8fac005ad0 tx=0x7f8fac001650).stop 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 shutdown_connections 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8f9405a150 0x7f8f9405c610 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fb41560f0 0x7f8fb40bc2a0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fb4151530 0x7f8fb4152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 --2- 172.21.15.153:0/1991315194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fb40689c0 0x7f8fb4147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 >> 172.21.15.153:0/1991315194 conn(0x7f8fb40c6620 msgr2=0x7f8fb40c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:55.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 shutdown_connections 2023-08-17T00:09:55.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.212+0000 7f8fb92b9700 1 -- 172.21.15.153:0/1991315194 wait complete. 2023-08-17T00:09:55.238 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:55.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.388+0000 7f23c5707700 1 Processor -- start 2023-08-17T00:09:55.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.388+0000 7f23c5707700 1 -- start start 2023-08-17T00:09:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23c5707700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f23c00689c0 0x7f23c0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23c5707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c00c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23c5707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c0065da0 con 0x7f23c0151530 2023-08-17T00:09:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23c5707700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c0155c60 con 0x7f23c00689c0 2023-08-17T00:09:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23c5707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c0156550 con 0x7f23c01560f0 2023-08-17T00:09:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f23c00689c0 0x7f23c0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f23c00689c0 0x7f23c0068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:44958/0 (socket says 172.21.15.153:44958) 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 -- 172.21.15.153:0/1610296164 learned_addr learned my addr 172.21.15.153:0/1610296164 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23b77fe700 1 --2- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c00c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 -- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 msgr2=0x7f23c00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 --2- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c00c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 -- 172.21.15.153:0/1610296164 >> v1:172.21.15.178:6789/0 conn(0x7f23c0151530 legacy=0x7f23c01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bffff700 1 -- 172.21.15.153:0/1610296164 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0065ff0 con 0x7f23c00689c0 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.392+0000 7f23bf7fe700 1 -- 172.21.15.153:0/1610296164 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371827454 0 0) 0x7f23c0065da0 con 0x7f23c0151530 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23bffff700 1 --2- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c00689c0 0x7f23c0068da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f23b0009810 tx=0x7f23b0009060).ready entity=mon.1 client_cookie=918e87d602b826b5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23bf7fe700 1 -- 172.21.15.153:0/1610296164 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0005880 con 0x7f23c00689c0 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23bf7fe700 1 -- 172.21.15.153:0/1610296164 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b00059e0 con 0x7f23c00689c0 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23bf7fe700 1 -- 172.21.15.153:0/1610296164 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0005d60 con 0x7f23c00689c0 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 -- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c00689c0 msgr2=0x7f23c0068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 --2- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c00689c0 0x7f23c0068da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f23b0009810 tx=0x7f23b0009060).stop 2023-08-17T00:09:55.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 -- 172.21.15.153:0/1610296164 shutdown_connections 2023-08-17T00:09:55.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 --2- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c00c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 --2- 172.21.15.153:0/1610296164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c00689c0 0x7f23c0068da0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 -- 172.21.15.153:0/1610296164 >> 172.21.15.153:0/1610296164 conn(0x7f23c00c6620 msgr2=0x7f23c00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:55.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 -- 172.21.15.153:0/1610296164 shutdown_connections 2023-08-17T00:09:55.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 -- 172.21.15.153:0/1610296164 wait complete. 2023-08-17T00:09:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 Processor -- start 2023-08-17T00:09:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.396+0000 7f23c5707700 1 -- start start 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 0x7f23c00bb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0151530 0x7f23c00bbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c01647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00bc050 con 0x7f23c00689c0 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00bb110 con 0x7f23c0151530 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00ba500 con 0x7f23c01560f0 2023-08-17T00:09:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 0x7f23c00bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 0x7f23c00bb670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60178/0 (socket says 172.21.15.153:60178) 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 -- 172.21.15.153:0/681687386 learned_addr learned my addr 172.21.15.153:0/681687386 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23b77fe700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0151530 0x7f23c00bbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c4f06700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c01647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 -- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 msgr2=0x7f23c01647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c01647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 -- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0151530 msgr2=0x7f23c00bbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0151530 0x7f23c00bbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 -- 172.21.15.153:0/681687386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b0009300 con 0x7f23c00689c0 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c4f06700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c01647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bffff700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 0x7f23c00bb670 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f23c00667d0 tx=0x7f23b0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b0005880 con 0x7f23c00689c0 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000b580 con 0x7f23c00689c0 2023-08-17T00:09:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000b940 con 0x7f23c00689c0 2023-08-17T00:09:55.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c00ba7e0 con 0x7f23c00689c0 2023-08-17T00:09:55.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.400+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c00bada0 con 0x7f23c00689c0 2023-08-17T00:09:55.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.404+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c006b4c0 con 0x7f23c00689c0 2023-08-17T00:09:55.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.404+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f23b000f070 con 0x7f23c00689c0 2023-08-17T00:09:55.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.404+0000 7f23bcff9700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f23a005a150 0x7f23a005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.404+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f23b0074f60 con 0x7f23c00689c0 2023-08-17T00:09:55.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.404+0000 7f23b77fe700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f23a005a150 0x7f23a005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.408+0000 7f23b77fe700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f23a005a150 0x7f23a005c610 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f23a8009fd0 tx=0x7f23a800b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.412+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f23b00a38f0 con 0x7f23c00689c0 2023-08-17T00:09:55.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.576+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23c0063750 con 0x7f23c00689c0 2023-08-17T00:09:55.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23bcff9700 1 -- 172.21.15.153:0/681687386 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16992 (secure 0 0 0) 0x7f23b0048a10 con 0x7f23c00689c0 2023-08-17T00:09:55.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:55.585 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":97,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:54.807889+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:09:52.827329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T00:09:53.817978+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:55.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f23a005a150 msgr2=0x7f23a005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f23a005a150 0x7f23a005c610 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f23a8009fd0 tx=0x7f23a800b040).stop 2023-08-17T00:09:55.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 msgr2=0x7f23c00bb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 0x7f23c00bb670 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f23c00667d0 tx=0x7f23b0016000).stop 2023-08-17T00:09:55.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 shutdown_connections 2023-08-17T00:09:55.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f23a005a150 0x7f23a005c610 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23c01560f0 0x7f23c01647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23c0151530 0x7f23c00bbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 --2- 172.21.15.153:0/681687386 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f23c00689c0 0x7f23c00bb670 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 >> 172.21.15.153:0/681687386 conn(0x7f23c00c6620 msgr2=0x7f23c00c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:55.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.580+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 shutdown_connections 2023-08-17T00:09:55.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.584+0000 7f23c5707700 1 -- 172.21.15.153:0/681687386 wait complete. 2023-08-17T00:09:55.606 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:09:55.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.764+0000 7f46ae1b9700 1 Processor -- start 2023-08-17T00:09:55.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.764+0000 7f46ae1b9700 1 -- start start 2023-08-17T00:09:55.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46a81560f0 0x7f46a80c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a8065da0 con 0x7f46a8151530 2023-08-17T00:09:55.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a8155c60 con 0x7f46a81560f0 2023-08-17T00:09:55.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a8156550 con 0x7f46a80689c0 2023-08-17T00:09:55.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46a81560f0 0x7f46a80c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f46a81560f0 0x7f46a80c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60184/0 (socket says 172.21.15.153:60184) 2023-08-17T00:09:55.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 -- 172.21.15.153:0/3579994819 learned_addr learned my addr 172.21.15.153:0/3579994819 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:55.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ad1b7700 1 --2- 172.21.15.153:0/3579994819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a8068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 -- 172.21.15.153:0/3579994819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 msgr2=0x7f46a8068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:55.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 --2- 172.21.15.153:0/3579994819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a8068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 -- 172.21.15.153:0/3579994819 >> v1:172.21.15.178:6789/0 conn(0x7f46a8151530 legacy=0x7f46a81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 -- 172.21.15.153:0/3579994819 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a8065ff0 con 0x7f46a81560f0 2023-08-17T00:09:55.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ac9b6700 1 --2- 172.21.15.153:0/3579994819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a80c0270 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f4698009830 tx=0x7f46980090f0).ready entity=mon.0 client_cookie=49fd4d2201b20452 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f469ffff700 1 -- 172.21.15.153:0/3579994819 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800b600 con 0x7f46a81560f0 2023-08-17T00:09:55.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f469ffff700 1 -- 172.21.15.153:0/3579994819 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469800b760 con 0x7f46a81560f0 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f469ffff700 1 -- 172.21.15.153:0/3579994819 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469800bb00 con 0x7f46a81560f0 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 -- 172.21.15.153:0/3579994819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 msgr2=0x7f46a80c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.768+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/3579994819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a80c0270 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f4698009830 tx=0x7f46980090f0).stop 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 -- 172.21.15.153:0/3579994819 shutdown_connections 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/3579994819 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a80c0270 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/3579994819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a8068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 -- 172.21.15.153:0/3579994819 >> 172.21.15.153:0/3579994819 conn(0x7f46a80c6620 msgr2=0x7f46a80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:55.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 -- 172.21.15.153:0/3579994819 shutdown_connections 2023-08-17T00:09:55.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 -- 172.21.15.153:0/3579994819 wait complete. 2023-08-17T00:09:55.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 Processor -- start 2023-08-17T00:09:55.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.772+0000 7f46ae1b9700 1 -- start start 2023-08-17T00:09:55.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a80bb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a8151530 0x7f46a8153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a81544f0 con 0x7f46a81560f0 2023-08-17T00:09:55.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80bbc20 con 0x7f46a8151530 2023-08-17T00:09:55.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a80c0a80 con 0x7f46a80689c0 2023-08-17T00:09:55.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a8154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60198/0 (socket says 172.21.15.153:60198) 2023-08-17T00:09:55.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 -- 172.21.15.153:0/2433985313 learned_addr learned my addr 172.21.15.153:0/2433985313 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:55.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad1b7700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a80bb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ac9b6700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a8151530 0x7f46a8153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 -- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 msgr2=0x7f46a80bb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a80bb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 -- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a8151530 msgr2=0x7f46a8153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a8151530 0x7f46a8153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 -- 172.21.15.153:0/2433985313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4698009370 con 0x7f46a81560f0 2023-08-17T00:09:55.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ad9b8700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a8154000 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f46a0002230 tx=0x7f46a00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a0010510 con 0x7f46a81560f0 2023-08-17T00:09:55.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a0010670 con 0x7f46a81560f0 2023-08-17T00:09:55.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a80c0d60 con 0x7f46a81560f0 2023-08-17T00:09:55.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a00109f0 con 0x7f46a81560f0 2023-08-17T00:09:55.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.776+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a80c1320 con 0x7f46a81560f0 2023-08-17T00:09:55.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.780+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a80c1510 con 0x7f46a81560f0 2023-08-17T00:09:55.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.780+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f46a0010070 con 0x7f46a81560f0 2023-08-17T00:09:55.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.784+0000 7f469d7fa700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468c05a150 0x7f468c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:55.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.784+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f46a0073e00 con 0x7f46a81560f0 2023-08-17T00:09:55.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.784+0000 7f46ad1b7700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468c05a150 0x7f468c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:55.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.784+0000 7f46ad1b7700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468c05a150 0x7f468c05c610 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f46a4006090 tx=0x7f46a4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.792+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46a00477e0 con 0x7f46a81560f0 2023-08-17T00:09:55.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:55.992+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46a806b4c0 con 0x7f46a81560f0 2023-08-17T00:09:56.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.828+0000 7f469d7fa700 1 -- 172.21.15.153:0/2433985313 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7f46a004ae00 con 0x7f46a81560f0 2023-08-17T00:09:56.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468c05a150 msgr2=0x7f468c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:56.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468c05a150 0x7f468c05c610 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f46a4006090 tx=0x7f46a4008040).stop 2023-08-17T00:09:56.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 msgr2=0x7f46a8154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:56.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a8154000 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 rx=0x7f46a0002230 tx=0x7f46a00015e0).stop 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 shutdown_connections 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468c05a150 0x7f468c05c610 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46a81560f0 0x7f46a8154000 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a8151530 0x7f46a8153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 --2- 172.21.15.153:0/2433985313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a80689c0 0x7f46a80bb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 >> 172.21.15.153:0/2433985313 conn(0x7f46a80c6620 msgr2=0x7f46a80a8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:56.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 shutdown_connections 2023-08-17T00:09:56.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:56.832+0000 7f46ae1b9700 1 -- 172.21.15.153:0/2433985313 wait complete. 2023-08-17T00:09:56.859 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:09:56.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:09:57.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 Processor -- start 2023-08-17T00:09:57.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 -- start start 2023-08-17T00:09:57.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f4704065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:57.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4704065b50 0x7f4704064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:57.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4704061fa0 con 0x7f4704151b90 2023-08-17T00:09:57.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47040c3fb0 con 0x7f4704065b50 2023-08-17T00:09:57.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.016+0000 7f470b3a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47041523d0 con 0x7f4704151f70 2023-08-17T00:09:57.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4709145700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4704151b90 0x7f4704063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41298/0 (socket says 172.21.15.153:41298) 2023-08-17T00:09:57.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4709145700 1 -- 172.21.15.153:0/368972067 learned_addr learned my addr 172.21.15.153:0/368972067 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:57.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4708944700 1 --2- 172.21.15.153:0/368972067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f4704065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:57.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4709946700 1 --2- 172.21.15.153:0/368972067 >> v2:172.21.15.178:3300/0 conn(0x7f4704065b50 0x7f4704064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:57.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f46fbfff700 1 -- 172.21.15.153:0/368972067 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841232833 0 0) 0x7f4704061fa0 con 0x7f4704151b90 2023-08-17T00:09:57.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f46fbfff700 1 -- 172.21.15.153:0/368972067 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46f00033f0 con 0x7f4704151b90 2023-08-17T00:09:57.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4708944700 1 -- 172.21.15.153:0/368972067 >> v2:172.21.15.178:3300/0 conn(0x7f4704065b50 msgr2=0x7f4704064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:57.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4708944700 1 --2- 172.21.15.153:0/368972067 >> v2:172.21.15.178:3300/0 conn(0x7f4704065b50 0x7f4704064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:57.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4708944700 1 -- 172.21.15.153:0/368972067 >> v1:172.21.15.153:6789/0 conn(0x7f4704151b90 legacy=0x7f4704063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:57.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4708944700 1 -- 172.21.15.153:0/368972067 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47040621f0 con 0x7f4704151f70 2023-08-17T00:09:57.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4709946700 1 --2- 172.21.15.153:0/368972067 >> v2:172.21.15.178:3300/0 conn(0x7f4704065b50 0x7f4704064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:57.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f4708944700 1 --2- 172.21.15.153:0/368972067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f4704065660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f46f4009760 tx=0x7f46f4009060).ready entity=mon.2 client_cookie=dfaccf2095f53877 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:57.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f46fbfff700 1 -- 172.21.15.153:0/368972067 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f40090d0 con 0x7f4704151f70 2023-08-17T00:09:57.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f46fbfff700 1 -- 172.21.15.153:0/368972067 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f400d4a0 con 0x7f4704151f70 2023-08-17T00:09:57.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f46fbfff700 1 -- 172.21.15.153:0/368972067 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f400d820 con 0x7f4704151f70 2023-08-17T00:09:57.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 -- 172.21.15.153:0/368972067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 msgr2=0x7f4704065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:57.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 --2- 172.21.15.153:0/368972067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f4704065660 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f46f4009760 tx=0x7f46f4009060).stop 2023-08-17T00:09:57.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 -- 172.21.15.153:0/368972067 shutdown_connections 2023-08-17T00:09:57.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 --2- 172.21.15.153:0/368972067 >> v2:172.21.15.178:3300/0 conn(0x7f4704065b50 0x7f4704064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:57.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 --2- 172.21.15.153:0/368972067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f4704065660 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:57.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 -- 172.21.15.153:0/368972067 >> 172.21.15.153:0/368972067 conn(0x7f47040c7150 msgr2=0x7f47040c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:57.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 -- 172.21.15.153:0/368972067 shutdown_connections 2023-08-17T00:09:57.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.020+0000 7f470b3a9700 1 -- 172.21.15.153:0/368972067 wait complete. 2023-08-17T00:09:57.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 Processor -- start 2023-08-17T00:09:57.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 -- start start 2023-08-17T00:09:57.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4704065b50 0x7f470416be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:57.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 0x7f4704150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:57.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f47041548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:57.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040be3d0 con 0x7f4704151b90 2023-08-17T00:09:57.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47040bd7c0 con 0x7f4704065b50 2023-08-17T00:09:57.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f470b3a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47040bdaa0 con 0x7f4704151f70 2023-08-17T00:09:57.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f4708944700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 0x7f4704150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:57.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f4708944700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 0x7f4704150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60206/0 (socket says 172.21.15.153:60206) 2023-08-17T00:09:57.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f4708944700 1 -- 172.21.15.153:0/4203502104 learned_addr learned my addr 172.21.15.153:0/4203502104 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f4709145700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4704065b50 0x7f470416be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.024+0000 7f4709946700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f47041548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4708944700 1 -- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 msgr2=0x7f47041548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4708944700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f47041548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4708944700 1 -- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4704065b50 msgr2=0x7f470416be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4708944700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4704065b50 0x7f470416be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4708944700 1 -- 172.21.15.153:0/4203502104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46fc009a20 con 0x7f4704151b90 2023-08-17T00:09:57.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4709145700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4704065b50 0x7f470416be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:57.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f4708944700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 0x7f4704150300 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f4704152510 tx=0x7f46f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:57.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4006910 con 0x7f4704151b90 2023-08-17T00:09:57.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46f4012920 con 0x7f4704151b90 2023-08-17T00:09:57.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46f40092a0 con 0x7f4704151b90 2023-08-17T00:09:57.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46f4012cc0 con 0x7f4704151b90 2023-08-17T00:09:57.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47040be060 con 0x7f4704151b90 2023-08-17T00:09:57.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.028+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4704159be0 con 0x7f4704151b90 2023-08-17T00:09:57.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.032+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f46f400f070 con 0x7f4704151b90 2023-08-17T00:09:57.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.032+0000 7f46f97fa700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46e805a120 0x7f46e805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:57.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.032+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f46f4075440 con 0x7f4704151b90 2023-08-17T00:09:57.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.032+0000 7f4709145700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46e805a120 0x7f46e805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:57.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.032+0000 7f4709145700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46e805a120 0x7f46e805c5e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4700007fd0 tx=0x7f4700009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:57.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.036+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46f4048e70 con 0x7f4704151b90 2023-08-17T00:09:57.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:57.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f470406b530 con 0x7f4704151b90 2023-08-17T00:09:58.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.224+0000 7f46f97fa700 1 -- 172.21.15.153:0/4203502104 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7f46f404c490 con 0x7f4704151b90 2023-08-17T00:09:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46e805a120 msgr2=0x7f46e805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46e805a120 0x7f46e805c5e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f4700007fd0 tx=0x7f4700009040).stop 2023-08-17T00:09:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 msgr2=0x7f4704150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 0x7f4704150300 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f4704152510 tx=0x7f46f4016000).stop 2023-08-17T00:09:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 shutdown_connections 2023-08-17T00:09:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f46e805a120 0x7f46e805c5e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4704151f70 0x7f47041548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4704151b90 0x7f4704150300 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 --2- 172.21.15.153:0/4203502104 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4704065b50 0x7f470416be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 >> 172.21.15.153:0/4203502104 conn(0x7f47040c7150 msgr2=0x7f4704151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 shutdown_connections 2023-08-17T00:09:58.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.232+0000 7f470b3a9700 1 -- 172.21.15.153:0/4203502104 wait complete. 2023-08-17T00:09:58.258 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:09:58.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:09:58.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.408+0000 7f8acc09b700 1 Processor -- start 2023-08-17T00:09:58.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.408+0000 7f8acc09b700 1 -- start start 2023-08-17T00:09:58.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8acc09b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8acc09b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ac40c8d50 0x7f8ac40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8acc09b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40aa750 con 0x7f8ac40c7490 2023-08-17T00:09:58.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8acc09b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac40c9dd0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8acc09b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40aacf0 con 0x7f8ac4153ab0 2023-08-17T00:09:58.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ac40c8d50 0x7f8ac40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8ac40c8d50 0x7f8ac40c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60210/0 (socket says 172.21.15.153:60210) 2023-08-17T00:09:58.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 -- 172.21.15.153:0/437200942 learned_addr learned my addr 172.21.15.153:0/437200942 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:58.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9e37700 1 --2- 172.21.15.153:0/437200942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 -- 172.21.15.153:0/437200942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 msgr2=0x7f8ac4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:58.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 --2- 172.21.15.153:0/437200942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 -- 172.21.15.153:0/437200942 >> v1:172.21.15.178:6789/0 conn(0x7f8ac40c7490 legacy=0x7f8ac4063660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.412+0000 7f8ac9636700 1 -- 172.21.15.153:0/437200942 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40c5ca0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8ac9636700 1 --2- 172.21.15.153:0/437200942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40c91b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f8ab4006fd0 tx=0x7f8ab40090f0).ready entity=mon.0 client_cookie=94b5533045fe419a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:58.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8ac8e35700 1 -- 172.21.15.153:0/437200942 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400b600 con 0x7f8ac40c8d50 2023-08-17T00:09:58.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8ac8e35700 1 -- 172.21.15.153:0/437200942 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400b760 con 0x7f8ac40c8d50 2023-08-17T00:09:58.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8ac8e35700 1 -- 172.21.15.153:0/437200942 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400bb00 con 0x7f8ac40c8d50 2023-08-17T00:09:58.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 -- 172.21.15.153:0/437200942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 msgr2=0x7f8ac40c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 --2- 172.21.15.153:0/437200942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40c91b0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 rx=0x7f8ab4006fd0 tx=0x7f8ab40090f0).stop 2023-08-17T00:09:58.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 -- 172.21.15.153:0/437200942 shutdown_connections 2023-08-17T00:09:58.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 --2- 172.21.15.153:0/437200942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40c91b0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 --2- 172.21.15.153:0/437200942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 -- 172.21.15.153:0/437200942 >> 172.21.15.153:0/437200942 conn(0x7f8ac4061fa0 msgr2=0x7f8ac40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:58.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 -- 172.21.15.153:0/437200942 shutdown_connections 2023-08-17T00:09:58.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.416+0000 7f8acc09b700 1 -- 172.21.15.153:0/437200942 wait complete. 2023-08-17T00:09:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 Processor -- start 2023-08-17T00:09:58.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 -- start start 2023-08-17T00:09:58.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac40c7490 0x7f8ac4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4165610 con 0x7f8ac40c8d50 2023-08-17T00:09:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40ade20 con 0x7f8ac40c7490 2023-08-17T00:09:58.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8acc09b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac41586d0 con 0x7f8ac4153ab0 2023-08-17T00:09:58.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60220/0 (socket says 172.21.15.153:60220) 2023-08-17T00:09:58.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 -- 172.21.15.153:0/2287945245 learned_addr learned my addr 172.21.15.153:0/2287945245 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:58.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9e37700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac40c7490 0x7f8ac4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8aca638700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 -- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 msgr2=0x7f8ac4156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 -- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac40c7490 msgr2=0x7f8ac4150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac40c7490 0x7f8ac4150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 -- 172.21.15.153:0/2287945245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab4009370 con 0x7f8ac40c8d50 2023-08-17T00:09:58.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9e37700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac40c7490 0x7f8ac4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:58.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.420+0000 7f8ac9636700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40b03a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f8ab4011000 tx=0x7f8ab4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:58.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400bec0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4006930 con 0x7f8ac40c8d50 2023-08-17T00:09:58.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac41589b0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400bb00 con 0x7f8ac40c8d50 2023-08-17T00:09:58.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac40adab0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac406b530 con 0x7f8ac40c8d50 2023-08-17T00:09:58.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.424+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8ab400f070 con 0x7f8ac40c8d50 2023-08-17T00:09:58.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.428+0000 7f8ab9ffb700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8aa805a150 0x7f8aa805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.428+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8ab4075d20 con 0x7f8ac40c8d50 2023-08-17T00:09:58.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.428+0000 7f8ac9e37700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8aa805a150 0x7f8aa805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.428+0000 7f8ac9e37700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8aa805a150 0x7f8aa805c610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f8ac000bb60 tx=0x7f8ac0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:58.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.436+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ab40496c0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.628+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ac40c9810 con 0x7f8ac40c8d50 2023-08-17T00:09:58.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.632+0000 7f8ab9ffb700 1 -- 172.21.15.153:0/2287945245 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f8ab404cce0 con 0x7f8ac40c8d50 2023-08-17T00:09:58.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:58.637 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:09:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.632+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8aa805a150 msgr2=0x7f8aa805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.632+0000 7f8acc09b700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8aa805a150 0x7f8aa805c610 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f8ac000bb60 tx=0x7f8ac0008040).stop 2023-08-17T00:09:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.632+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 msgr2=0x7f8ac40b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.632+0000 7f8acc09b700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40b03a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f8ab4011000 tx=0x7f8ab4017000).stop 2023-08-17T00:09:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.632+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 shutdown_connections 2023-08-17T00:09:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8aa805a150 0x7f8aa805c610 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ac4153ab0 0x7f8ac4156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ac40c8d50 0x7f8ac40b03a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 --2- 172.21.15.153:0/2287945245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ac40c7490 0x7f8ac4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 >> 172.21.15.153:0/2287945245 conn(0x7f8ac4061fa0 msgr2=0x7f8ac4155d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:58.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 shutdown_connections 2023-08-17T00:09:58.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.636+0000 7f8acc09b700 1 -- 172.21.15.153:0/2287945245 wait complete. 2023-08-17T00:09:58.642 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:09:58.664 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:09:58.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.816+0000 7ffa8dd07700 1 Processor -- start 2023-08-17T00:09:58.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.816+0000 7ffa8dd07700 1 -- start start 2023-08-17T00:09:58.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8dd07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa88150880 0x7ffa880a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8dd07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa880a8e60 0x7ffa88068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8dd07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa88068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8dd07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa88069200 con 0x7ffa880a8e60 2023-08-17T00:09:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8dd07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa880ab9b0 con 0x7ffa88150880 2023-08-17T00:09:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8dd07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa880aada0 con 0x7ffa880aa8c0 2023-08-17T00:09:58.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa880a8e60 0x7ffa88068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa880a8e60 0x7ffa88068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60234/0 (socket says 172.21.15.153:60234) 2023-08-17T00:09:58.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8d506700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa88068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa8cd05700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa88150880 0x7ffa880a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 -- 172.21.15.153:0/3342701310 learned_addr learned my addr 172.21.15.153:0/3342701310 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:58.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 -- 172.21.15.153:0/3342701310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 msgr2=0x7ffa88068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:58.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 --2- 172.21.15.153:0/3342701310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa88068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 -- 172.21.15.153:0/3342701310 >> v2:172.21.15.178:3300/0 conn(0x7ffa88150880 msgr2=0x7ffa880a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:58.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 --2- 172.21.15.153:0/3342701310 >> v2:172.21.15.178:3300/0 conn(0x7ffa88150880 0x7ffa880a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.820+0000 7ffa87fff700 1 -- 172.21.15.153:0/3342701310 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880ab080 con 0x7ffa880a8e60 2023-08-17T00:09:58.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa87fff700 1 --2- 172.21.15.153:0/3342701310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa880a8e60 0x7ffa88068820 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7ffa88066830 tx=0x7ffa740090f0).ready entity=mon.0 client_cookie=1fc0a16c40499116 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:58.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa877fe700 1 -- 172.21.15.153:0/3342701310 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400f510 con 0x7ffa880a8e60 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa877fe700 1 -- 172.21.15.153:0/3342701310 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7400f670 con 0x7ffa880a8e60 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa877fe700 1 -- 172.21.15.153:0/3342701310 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400fa10 con 0x7ffa880a8e60 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 -- 172.21.15.153:0/3342701310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa880a8e60 msgr2=0x7ffa88068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/3342701310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa880a8e60 0x7ffa88068820 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 rx=0x7ffa88066830 tx=0x7ffa740090f0).stop 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 -- 172.21.15.153:0/3342701310 shutdown_connections 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/3342701310 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa88068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/3342701310 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa880a8e60 0x7ffa88068820 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/3342701310 >> v2:172.21.15.178:3300/0 conn(0x7ffa88150880 0x7ffa880a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 -- 172.21.15.153:0/3342701310 >> 172.21.15.153:0/3342701310 conn(0x7ffa880c6620 msgr2=0x7ffa880c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 -- 172.21.15.153:0/3342701310 shutdown_connections 2023-08-17T00:09:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 -- 172.21.15.153:0/3342701310 wait complete. 2023-08-17T00:09:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.824+0000 7ffa8dd07700 1 Processor -- start 2023-08-17T00:09:58.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 -- start start 2023-08-17T00:09:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880a8e60 0x7ffa88155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa8814dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 0x7ffa8809fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88154dc0 con 0x7ffa88150880 2023-08-17T00:09:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa881550a0 con 0x7ffa880a8e60 2023-08-17T00:09:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa88155380 con 0x7ffa880aa8c0 2023-08-17T00:09:58.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 0x7ffa8809fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 0x7ffa8809fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60248/0 (socket says 172.21.15.153:60248) 2023-08-17T00:09:58.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 -- 172.21.15.153:0/70117708 learned_addr learned my addr 172.21.15.153:0/70117708 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:58.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8cd05700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880a8e60 0x7ffa88155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa87fff700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa8814dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 -- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 msgr2=0x7ffa8814dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa8814dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 -- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880a8e60 msgr2=0x7ffa88155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880a8e60 0x7ffa88155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 -- 172.21.15.153:0/70117708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa74009370 con 0x7ffa88150880 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa87fff700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa8814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8d506700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 0x7ffa8809fb00 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7ffa80009ec0 tx=0x7ffa8000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8000cc20 con 0x7ffa88150880 2023-08-17T00:09:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8000f040 con 0x7ffa88150880 2023-08-17T00:09:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80013400 con 0x7ffa88150880 2023-08-17T00:09:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa88155660 con 0x7ffa88150880 2023-08-17T00:09:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.828+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa88156350 con 0x7ffa88150880 2023-08-17T00:09:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.832+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa88153ea0 con 0x7ffa88150880 2023-08-17T00:09:58.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.832+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ffa80013770 con 0x7ffa88150880 2023-08-17T00:09:58.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.832+0000 7ffa84ff9700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6c05a180 0x7ffa6c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:58.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.836+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ffa80074c00 con 0x7ffa88150880 2023-08-17T00:09:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.836+0000 7ffa8cd05700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6c05a180 0x7ffa6c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.836+0000 7ffa8cd05700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6c05a180 0x7ffa6c05c640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ffa7c006fd0 tx=0x7ffa7c006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:58.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:58.840+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa88153ea0 con 0x7ffa88150880 2023-08-17T00:09:59.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.000+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa88064750 con 0x7ffa88150880 2023-08-17T00:09:59.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.000+0000 7ffa84ff9700 1 -- 172.21.15.153:0/70117708 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16979 (secure 0 0 0) 0x7ffa88064750 con 0x7ffa88150880 2023-08-17T00:09:59.007 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:59.007 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":98,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:09:55.813631+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:09:52.827329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T00:09:53.817978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:09:59.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6c05a180 msgr2=0x7ffa6c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6c05a180 0x7ffa6c05c640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7ffa7c006fd0 tx=0x7ffa7c006f40).stop 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 msgr2=0x7ffa8809fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 0x7ffa8809fb00 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 rx=0x7ffa80009ec0 tx=0x7ffa8000b040).stop 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 shutdown_connections 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6c05a180 0x7ffa6c05c640 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa88150880 0x7ffa8809fb00 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa880aa8c0 0x7ffa8814dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 --2- 172.21.15.153:0/70117708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa880a8e60 0x7ffa88155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 >> 172.21.15.153:0/70117708 conn(0x7ffa880c6620 msgr2=0x7ffa88062f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:59.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 shutdown_connections 2023-08-17T00:09:59.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.004+0000 7ffa8dd07700 1 -- 172.21.15.153:0/70117708 wait complete. 2023-08-17T00:09:59.030 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:09:59.030 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:09:59.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.184+0000 7fef70947700 1 Processor -- start 2023-08-17T00:09:59.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.184+0000 7fef70947700 1 -- start start 2023-08-17T00:09:59.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef70947700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef6c0689c0 0x7fef6c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef70947700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c1560f0 0x7fef6c0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef70947700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef6c065da0 con 0x7fef6c151530 2023-08-17T00:09:59.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef70947700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef6c155c60 con 0x7fef6c0689c0 2023-08-17T00:09:59.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef70947700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c156550 con 0x7fef6c1560f0 2023-08-17T00:09:59.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fef6c151530 0x7fef6c1519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41314/0 (socket says 172.21.15.153:41314) 2023-08-17T00:09:59.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef6c0689c0 0x7fef6c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6bfff700 1 -- 172.21.15.153:0/3141104058 learned_addr learned my addr 172.21.15.153:0/3141104058 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:59.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6affd700 1 --2- 172.21.15.153:0/3141104058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c1560f0 0x7fef6c0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6b7fe700 1 -- 172.21.15.153:0/3141104058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c1560f0 msgr2=0x7fef6c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:59.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6b7fe700 1 --2- 172.21.15.153:0/3141104058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c1560f0 0x7fef6c0c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6b7fe700 1 -- 172.21.15.153:0/3141104058 >> v1:172.21.15.153:6789/0 conn(0x7fef6c151530 legacy=0x7fef6c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.188+0000 7fef6b7fe700 1 -- 172.21.15.153:0/3141104058 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c065ff0 con 0x7fef6c0689c0 2023-08-17T00:09:59.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef6b7fe700 1 --2- 172.21.15.153:0/3141104058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c0689c0 0x7fef6c068da0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fef5c006fd0 tx=0x7fef5c006f40).ready entity=mon.0 client_cookie=3368e96d8bc73a2f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:59.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef6a7fc700 1 -- 172.21.15.153:0/3141104058 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005880 con 0x7fef6c0689c0 2023-08-17T00:09:59.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef6a7fc700 1 -- 172.21.15.153:0/3141104058 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c0059e0 con 0x7fef6c0689c0 2023-08-17T00:09:59.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef6a7fc700 1 -- 172.21.15.153:0/3141104058 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005d60 con 0x7fef6c0689c0 2023-08-17T00:09:59.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 -- 172.21.15.153:0/3141104058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c0689c0 msgr2=0x7fef6c068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 --2- 172.21.15.153:0/3141104058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c0689c0 0x7fef6c068da0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fef5c006fd0 tx=0x7fef5c006f40).stop 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 -- 172.21.15.153:0/3141104058 shutdown_connections 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 --2- 172.21.15.153:0/3141104058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c1560f0 0x7fef6c0c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 --2- 172.21.15.153:0/3141104058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c0689c0 0x7fef6c068da0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 -- 172.21.15.153:0/3141104058 >> 172.21.15.153:0/3141104058 conn(0x7fef6c0c6620 msgr2=0x7fef6c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 -- 172.21.15.153:0/3141104058 shutdown_connections 2023-08-17T00:09:59.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.192+0000 7fef70947700 1 -- 172.21.15.153:0/3141104058 wait complete. 2023-08-17T00:09:59.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 Processor -- start 2023-08-17T00:09:59.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 -- start start 2023-08-17T00:09:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c0689c0 0x7fef6c152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6c151530 0x7fef6c14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 0x7fef6c167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0c0a80 con 0x7fef6c1560f0 2023-08-17T00:09:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c0ba350 con 0x7fef6c151530 2023-08-17T00:09:59.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c1549a0 con 0x7fef6c0689c0 2023-08-17T00:09:59.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 0x7fef6c167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 0x7fef6c167f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60264/0 (socket says 172.21.15.153:60264) 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c0689c0 0x7fef6c152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6bfff700 1 -- 172.21.15.153:0/3802753425 learned_addr learned my addr 172.21.15.153:0/3802753425 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6affd700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6c151530 0x7fef6c14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 -- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6c151530 msgr2=0x7fef6c14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6c151530 0x7fef6c14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 -- 172.21.15.153:0/3802753425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 msgr2=0x7fef6c167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 0x7fef6c167f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 -- 172.21.15.153:0/3802753425 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef5c009250 con 0x7fef6c0689c0 2023-08-17T00:09:59.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6bfff700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 0x7fef6c167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:09:59.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef6b7fe700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c0689c0 0x7fef6c152110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fef5c012000 tx=0x7fef5c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:59.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c006950 con 0x7fef6c0689c0 2023-08-17T00:09:59.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c154c80 con 0x7fef6c0689c0 2023-08-17T00:09:59.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c14e3b0 con 0x7fef6c0689c0 2023-08-17T00:09:59.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef5c005d60 con 0x7fef6c0689c0 2023-08-17T00:09:59.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.196+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c00b790 con 0x7fef6c0689c0 2023-08-17T00:09:59.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.200+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef6c0ba120 con 0x7fef6c0689c0 2023-08-17T00:09:59.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.200+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fef5c017030 con 0x7fef6c0689c0 2023-08-17T00:09:59.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.200+0000 7fef537fe700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef5805a180 0x7fef5805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.200+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fef5c074b80 con 0x7fef6c0689c0 2023-08-17T00:09:59.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.200+0000 7fef6affd700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef5805a180 0x7fef5805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.204+0000 7fef6affd700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef5805a180 0x7fef5805c640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fef6c0ba0b0 tx=0x7fef60008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:59.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.208+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef6c0ba120 con 0x7fef6c0689c0 2023-08-17T00:09:59.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.372+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef6c0ba120 con 0x7fef5805a180 2023-08-17T00:09:59.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.388+0000 7fef537fe700 1 -- 172.21.15.153:0/3802753425 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359062 (secure 0 0 0) 0x7fef6c0ba120 con 0x7fef5805a180 2023-08-17T00:09:59.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:59.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef5805a180 msgr2=0x7fef5805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef5805a180 0x7fef5805c640 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7fef6c0ba0b0 tx=0x7fef60008040).stop 2023-08-17T00:09:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c0689c0 msgr2=0x7fef6c152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c0689c0 0x7fef6c152110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fef5c012000 tx=0x7fef5c015000).stop 2023-08-17T00:09:59.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 shutdown_connections 2023-08-17T00:09:59.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef5805a180 0x7fef5805c640 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef6c1560f0 0x7fef6c167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef6c151530 0x7fef6c14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 --2- 172.21.15.153:0/3802753425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef6c0689c0 0x7fef6c152110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 >> 172.21.15.153:0/3802753425 conn(0x7fef6c0c6620 msgr2=0x7fef6c0651f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:59.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 shutdown_connections 2023-08-17T00:09:59.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.400+0000 7fef70947700 1 -- 172.21.15.153:0/3802753425 wait complete. 2023-08-17T00:09:59.409 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:09:59.426 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-08-17T00:09:59.332702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428064,"kb_used_data":9440,"kb_used_omap":0,"kb_used_meta":2418560,"kb_avail":752546656,"statfs":{"total":773094113280,"available":770607775744,"internally_reserved":0,"allocated":9666560,"data_stored":4449020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476605440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3009352,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1524,"num_read_kb":-1828,"num_write":-20269,"num_write_kb":-95111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-4194304,"num_keys_recovered":-10,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.974794"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852137+0000","last_change":"2023-08-17T00:09:54.847195+0000","last_active":"2023-08-17T00:09:54.852137+0000","last_peered":"2023-08-17T00:09:54.852137+0000","last_clean":"2023-08-17T00:09:54.852137+0000","last_became_active":"2023-08-17T00:09:54.846919+0000","last_became_peered":"2023-08-17T00:09:54.846919+0000","last_unstale":"2023-08-17T00:09:54.852137+0000","last_undegraded":"2023-08-17T00:09:54.852137+0000","last_fullsized":"2023-08-17T00:09:54.852137+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847357+0000","last_change":"2023-08-17T00:09:54.402917+0000","last_active":"2023-08-17T00:09:54.847357+0000","last_peered":"2023-08-17T00:09:54.847357+0000","last_clean":"2023-08-17T00:09:54.847357+0000","last_became_active":"2023-08-17T00:09:54.402650+0000","last_became_peered":"2023-08-17T00:09:54.402650+0000","last_unstale":"2023-08-17T00:09:54.847357+0000","last_undegraded":"2023-08-17T00:09:54.847357+0000","last_fullsized":"2023-08-17T00:09:54.847357+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848984+0000","last_change":"2023-08-17T00:09:54.841848+0000","last_active":"2023-08-17T00:09:54.848984+0000","last_peered":"2023-08-17T00:09:54.848984+0000","last_clean":"2023-08-17T00:09:54.848984+0000","last_became_active":"2023-08-17T00:09:54.841582+0000","last_became_peered":"2023-08-17T00:09:54.841582+0000","last_unstale":"2023-08-17T00:09:54.848984+0000","last_undegraded":"2023-08-17T00:09:54.848984+0000","last_fullsized":"2023-08-17T00:09:54.848984+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817888+0000","last_change":"2023-08-17T00:09:54.390612+0000","last_active":"2023-08-17T00:09:54.817888+0000","last_peered":"2023-08-17T00:09:54.817888+0000","last_clean":"2023-08-17T00:09:54.817888+0000","last_became_active":"2023-08-17T00:09:54.390320+0000","last_became_peered":"2023-08-17T00:09:54.390320+0000","last_unstale":"2023-08-17T00:09:54.817888+0000","last_undegraded":"2023-08-17T00:09:54.817888+0000","last_fullsized":"2023-08-17T00:09:54.817888+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847685+0000","last_change":"2023-08-17T00:09:54.845239+0000","last_active":"2023-08-17T00:09:54.847685+0000","last_peered":"2023-08-17T00:09:54.847685+0000","last_clean":"2023-08-17T00:09:54.847685+0000","last_became_active":"2023-08-17T00:09:54.844895+0000","last_became_peered":"2023-08-17T00:09:54.844895+0000","last_unstale":"2023-08-17T00:09:54.847685+0000","last_undegraded":"2023-08-17T00:09:54.847685+0000","last_fullsized":"2023-08-17T00:09:54.847685+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829383+0000","last_change":"2023-08-17T00:09:54.407465+0000","last_active":"2023-08-17T00:09:54.829383+0000","last_peered":"2023-08-17T00:09:54.829383+0000","last_clean":"2023-08-17T00:09:54.829383+0000","last_became_active":"2023-08-17T00:09:54.407184+0000","last_became_peered":"2023-08-17T00:09:54.407184+0000","last_unstale":"2023-08-17T00:09:54.829383+0000","last_undegraded":"2023-08-17T00:09:54.829383+0000","last_fullsized":"2023-08-17T00:09:54.829383+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842148+0000","last_change":"2023-08-17T00:09:54.839541+0000","last_active":"2023-08-17T00:09:54.842148+0000","last_peered":"2023-08-17T00:09:54.842148+0000","last_clean":"2023-08-17T00:09:54.842148+0000","last_became_active":"2023-08-17T00:09:54.839264+0000","last_became_peered":"2023-08-17T00:09:54.839264+0000","last_unstale":"2023-08-17T00:09:54.842148+0000","last_undegraded":"2023-08-17T00:09:54.842148+0000","last_fullsized":"2023-08-17T00:09:54.842148+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3c","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.851368+0000","last_change":"2023-08-17T00:09:54.380974+0000","last_active":"2023-08-17T00:09:54.851368+0000","last_peered":"2023-08-17T00:09:54.851368+0000","last_clean":"2023-08-17T00:09:54.851368+0000","last_became_active":"2023-08-17T00:09:54.380496+0000","last_became_peered":"2023-08-17T00:09:54.380496+0000","last_unstale":"2023-08-17T00:09:54.851368+0000","last_undegraded":"2023-08-17T00:09:54.851368+0000","last_fullsized":"2023-08-17T00:09:54.851368+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839969+0000","last_change":"2023-08-17T00:09:54.828775+0000","last_active":"2023-08-17T00:09:54.839969+0000","last_peered":"2023-08-17T00:09:54.839969+0000","last_clean":"2023-08-17T00:09:54.839969+0000","last_became_active":"2023-08-17T00:09:54.828456+0000","last_became_peered":"2023-08-17T00:09:54.828456+0000","last_unstale":"2023-08-17T00:09:54.839969+0000","last_undegraded":"2023-08-17T00:09:54.839969+0000","last_fullsized":"2023-08-17T00:09:54.839969+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.853140+0000","last_change":"2023-08-17T00:09:54.401163+0000","last_active":"2023-08-17T00:09:54.853140+0000","last_peered":"2023-08-17T00:09:54.853140+0000","last_clean":"2023-08-17T00:09:54.853140+0000","last_became_active":"2023-08-17T00:09:54.400838+0000","last_became_peered":"2023-08-17T00:09:54.400838+0000","last_unstale":"2023-08-17T00:09:54.853140+0000","last_undegraded":"2023-08-17T00:09:54.853140+0000","last_fullsized":"2023-08-17T00:09:54.853140+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849576+0000","last_change":"2023-08-17T00:09:54.843142+0000","last_active":"2023-08-17T00:09:54.849576+0000","last_peered":"2023-08-17T00:09:54.849576+0000","last_clean":"2023-08-17T00:09:54.849576+0000","last_became_active":"2023-08-17T00:09:54.841781+0000","last_became_peered":"2023-08-17T00:09:54.841781+0000","last_unstale":"2023-08-17T00:09:54.849576+0000","last_undegraded":"2023-08-17T00:09:54.849576+0000","last_fullsized":"2023-08-17T00:09:54.849576+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.854022+0000","last_change":"2023-08-17T00:09:54.399349+0000","last_active":"2023-08-17T00:09:54.854022+0000","last_peered":"2023-08-17T00:09:54.854022+0000","last_clean":"2023-08-17T00:09:54.854022+0000","last_became_active":"2023-08-17T00:09:54.399045+0000","last_became_peered":"2023-08-17T00:09:54.399045+0000","last_unstale":"2023-08-17T00:09:54.854022+0000","last_undegraded":"2023-08-17T00:09:54.854022+0000","last_fullsized":"2023-08-17T00:09:54.854022+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840841+0000","last_change":"2023-08-17T00:09:54.829874+0000","last_active":"2023-08-17T00:09:54.840841+0000","last_peered":"2023-08-17T00:09:54.840841+0000","last_clean":"2023-08-17T00:09:54.840841+0000","last_became_active":"2023-08-17T00:09:54.829577+0000","last_became_peered":"2023-08-17T00:09:54.829577+0000","last_unstale":"2023-08-17T00:09:54.840841+0000","last_undegraded":"2023-08-17T00:09:54.840841+0000","last_fullsized":"2023-08-17T00:09:54.840841+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817444+0000","last_change":"2023-08-17T00:09:54.387051+0000","last_active":"2023-08-17T00:09:54.817444+0000","last_peered":"2023-08-17T00:09:54.817444+0000","last_clean":"2023-08-17T00:09:54.817444+0000","last_became_active":"2023-08-17T00:09:54.386794+0000","last_became_peered":"2023-08-17T00:09:54.386794+0000","last_unstale":"2023-08-17T00:09:54.817444+0000","last_undegraded":"2023-08-17T00:09:54.817444+0000","last_fullsized":"2023-08-17T00:09:54.817444+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846005+0000","last_change":"2023-08-17T00:09:54.832246+0000","last_active":"2023-08-17T00:09:54.846005+0000","last_peered":"2023-08-17T00:09:54.846005+0000","last_clean":"2023-08-17T00:09:54.846005+0000","last_became_active":"2023-08-17T00:09:54.831745+0000","last_became_peered":"2023-08-17T00:09:54.831745+0000","last_unstale":"2023-08-17T00:09:54.846005+0000","last_undegraded":"2023-08-17T00:09:54.846005+0000","last_fullsized":"2023-08-17T00:09:54.846005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816479+0000","last_change":"2023-08-17T00:09:54.389457+0000","last_active":"2023-08-17T00:09:54.816479+0000","last_peered":"2023-08-17T00:09:54.816479+0000","last_clean":"2023-08-17T00:09:54.816479+0000","last_became_active":"2023-08-17T00:09:54.389165+0000","last_became_peered":"2023-08-17T00:09:54.389165+0000","last_unstale":"2023-08-17T00:09:54.816479+0000","last_undegraded":"2023-08-17T00:09:54.816479+0000","last_fullsized":"2023-08-17T00:09:54.816479+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.853170+0000","last_change":"2023-08-17T00:09:54.852000+0000","last_active":"2023-08-17T00:09:54.853170+0000","last_peered":"2023-08-17T00:09:54.853170+0000","last_clean":"2023-08-17T00:09:54.853170+0000","last_became_active":"2023-08-17T00:09:54.851686+0000","last_became_peered":"2023-08-17T00:09:54.851686+0000","last_unstale":"2023-08-17T00:09:54.853170+0000","last_undegraded":"2023-08-17T00:09:54.853170+0000","last_fullsized":"2023-08-17T00:09:54.853170+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825890+0000","last_change":"2023-08-17T00:09:54.398500+0000","last_active":"2023-08-17T00:09:54.825890+0000","last_peered":"2023-08-17T00:09:54.825890+0000","last_clean":"2023-08-17T00:09:54.825890+0000","last_became_active":"2023-08-17T00:09:54.398185+0000","last_became_peered":"2023-08-17T00:09:54.398185+0000","last_unstale":"2023-08-17T00:09:54.825890+0000","last_undegraded":"2023-08-17T00:09:54.825890+0000","last_fullsized":"2023-08-17T00:09:54.825890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.835348+0000","last_change":"2023-08-17T00:09:54.833030+0000","last_active":"2023-08-17T00:09:54.835348+0000","last_peered":"2023-08-17T00:09:54.835348+0000","last_clean":"2023-08-17T00:09:54.835348+0000","last_became_active":"2023-08-17T00:09:54.832776+0000","last_became_peered":"2023-08-17T00:09:54.832776+0000","last_unstale":"2023-08-17T00:09:54.835348+0000","last_undegraded":"2023-08-17T00:09:54.835348+0000","last_fullsized":"2023-08-17T00:09:54.835348+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828982+0000","last_change":"2023-08-17T00:09:54.394408+0000","last_active":"2023-08-17T00:09:54.828982+0000","last_peered":"2023-08-17T00:09:54.828982+0000","last_clean":"2023-08-17T00:09:54.828982+0000","last_became_active":"2023-08-17T00:09:54.394112+0000","last_became_peered":"2023-08-17T00:09:54.394112+0000","last_unstale":"2023-08-17T00:09:54.828982+0000","last_undegraded":"2023-08-17T00:09:54.828982+0000","last_fullsized":"2023-08-17T00:09:54.828982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852732+0000","last_change":"2023-08-17T00:09:54.850018+0000","last_active":"2023-08-17T00:09:54.852732+0000","last_peered":"2023-08-17T00:09:54.852732+0000","last_clean":"2023-08-17T00:09:54.852732+0000","last_became_active":"2023-08-17T00:09:54.849735+0000","last_became_peered":"2023-08-17T00:09:54.849735+0000","last_unstale":"2023-08-17T00:09:54.852732+0000","last_undegraded":"2023-08-17T00:09:54.852732+0000","last_fullsized":"2023-08-17T00:09:54.852732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831477+0000","last_change":"2023-08-17T00:09:54.389242+0000","last_active":"2023-08-17T00:09:54.831477+0000","last_peered":"2023-08-17T00:09:54.831477+0000","last_clean":"2023-08-17T00:09:54.831477+0000","last_became_active":"2023-08-17T00:09:54.388944+0000","last_became_peered":"2023-08-17T00:09:54.388944+0000","last_unstale":"2023-08-17T00:09:54.831477+0000","last_undegraded":"2023-08-17T00:09:54.831477+0000","last_fullsized":"2023-08-17T00:09:54.831477+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.837266+0000","last_change":"2023-08-17T00:09:54.832851+0000","last_active":"2023-08-17T00:09:54.837266+0000","last_peered":"2023-08-17T00:09:54.837266+0000","last_clean":"2023-08-17T00:09:54.837266+0000","last_became_active":"2023-08-17T00:09:54.832402+0000","last_became_peered":"2023-08-17T00:09:54.832402+0000","last_unstale":"2023-08-17T00:09:54.837266+0000","last_undegraded":"2023-08-17T00:09:54.837266+0000","last_fullsized":"2023-08-17T00:09:54.837266+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.34","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.856400+0000","last_change":"2023-08-17T00:09:54.399040+0000","last_active":"2023-08-17T00:09:54.856400+0000","last_peered":"2023-08-17T00:09:54.856400+0000","last_clean":"2023-08-17T00:09:54.856400+0000","last_became_active":"2023-08-17T00:09:54.398761+0000","last_became_peered":"2023-08-17T00:09:54.398761+0000","last_unstale":"2023-08-17T00:09:54.856400+0000","last_undegraded":"2023-08-17T00:09:54.856400+0000","last_fullsized":"2023-08-17T00:09:54.856400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846414+0000","last_change":"2023-08-17T00:09:54.840169+0000","last_active":"2023-08-17T00:09:54.846414+0000","last_peered":"2023-08-17T00:09:54.846414+0000","last_clean":"2023-08-17T00:09:54.846414+0000","last_became_active":"2023-08-17T00:09:54.839770+0000","last_became_peered":"2023-08-17T00:09:54.839770+0000","last_unstale":"2023-08-17T00:09:54.846414+0000","last_undegraded":"2023-08-17T00:09:54.846414+0000","last_fullsized":"2023-08-17T00:09:54.846414+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846792+0000","last_change":"2023-08-17T00:09:54.390923+0000","last_active":"2023-08-17T00:09:54.846792+0000","last_peered":"2023-08-17T00:09:54.846792+0000","last_clean":"2023-08-17T00:09:54.846792+0000","last_became_active":"2023-08-17T00:09:54.390646+0000","last_became_peered":"2023-08-17T00:09:54.390646+0000","last_unstale":"2023-08-17T00:09:54.846792+0000","last_undegraded":"2023-08-17T00:09:54.846792+0000","last_fullsized":"2023-08-17T00:09:54.846792+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852047+0000","last_change":"2023-08-17T00:09:54.848475+0000","last_active":"2023-08-17T00:09:54.852047+0000","last_peered":"2023-08-17T00:09:54.852047+0000","last_clean":"2023-08-17T00:09:54.852047+0000","last_became_active":"2023-08-17T00:09:54.848195+0000","last_became_peered":"2023-08-17T00:09:54.848195+0000","last_unstale":"2023-08-17T00:09:54.852047+0000","last_undegraded":"2023-08-17T00:09:54.852047+0000","last_fullsized":"2023-08-17T00:09:54.852047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.834877+0000","last_change":"2023-08-17T00:09:54.401227+0000","last_active":"2023-08-17T00:09:54.834877+0000","last_peered":"2023-08-17T00:09:54.834877+0000","last_clean":"2023-08-17T00:09:54.834877+0000","last_became_active":"2023-08-17T00:09:54.400888+0000","last_became_peered":"2023-08-17T00:09:54.400888+0000","last_unstale":"2023-08-17T00:09:54.834877+0000","last_undegraded":"2023-08-17T00:09:54.834877+0000","last_fullsized":"2023-08-17T00:09:54.834877+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845609+0000","last_change":"2023-08-17T00:09:54.842647+0000","last_active":"2023-08-17T00:09:54.845609+0000","last_peered":"2023-08-17T00:09:54.845609+0000","last_clean":"2023-08-17T00:09:54.845609+0000","last_became_active":"2023-08-17T00:09:54.842336+0000","last_became_peered":"2023-08-17T00:09:54.842336+0000","last_unstale":"2023-08-17T00:09:54.845609+0000","last_undegraded":"2023-08-17T00:09:54.845609+0000","last_fullsized":"2023-08-17T00:09:54.845609+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817609+0000","last_change":"2023-08-17T00:09:54.392146+0000","last_active":"2023-08-17T00:09:54.817609+0000","last_peered":"2023-08-17T00:09:54.817609+0000","last_clean":"2023-08-17T00:09:54.817609+0000","last_became_active":"2023-08-17T00:09:54.391791+0000","last_became_peered":"2023-08-17T00:09:54.391791+0000","last_unstale":"2023-08-17T00:09:54.817609+0000","last_undegraded":"2023-08-17T00:09:54.817609+0000","last_fullsized":"2023-08-17T00:09:54.817609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843693+0000","last_change":"2023-08-17T00:09:54.833012+0000","last_active":"2023-08-17T00:09:54.843693+0000","last_peered":"2023-08-17T00:09:54.843693+0000","last_clean":"2023-08-17T00:09:54.843693+0000","last_became_active":"2023-08-17T00:09:54.832507+0000","last_became_peered":"2023-08-17T00:09:54.832507+0000","last_unstale":"2023-08-17T00:09:54.843693+0000","last_undegraded":"2023-08-17T00:09:54.843693+0000","last_fullsized":"2023-08-17T00:09:54.843693+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.30","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850424+0000","last_change":"2023-08-17T00:09:54.397699+0000","last_active":"2023-08-17T00:09:54.850424+0000","last_peered":"2023-08-17T00:09:54.850424+0000","last_clean":"2023-08-17T00:09:54.850424+0000","last_became_active":"2023-08-17T00:09:54.397337+0000","last_became_peered":"2023-08-17T00:09:54.397337+0000","last_unstale":"2023-08-17T00:09:54.850424+0000","last_undegraded":"2023-08-17T00:09:54.850424+0000","last_fullsized":"2023-08-17T00:09:54.850424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847493+0000","last_change":"2023-08-17T00:09:54.843674+0000","last_active":"2023-08-17T00:09:54.847493+0000","last_peered":"2023-08-17T00:09:54.847493+0000","last_clean":"2023-08-17T00:09:54.847493+0000","last_became_active":"2023-08-17T00:09:54.843379+0000","last_became_peered":"2023-08-17T00:09:54.843379+0000","last_unstale":"2023-08-17T00:09:54.847493+0000","last_undegraded":"2023-08-17T00:09:54.847493+0000","last_fullsized":"2023-08-17T00:09:54.847493+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817334+0000","last_change":"2023-08-17T00:09:54.396230+0000","last_active":"2023-08-17T00:09:54.817334+0000","last_peered":"2023-08-17T00:09:54.817334+0000","last_clean":"2023-08-17T00:09:54.817334+0000","last_became_active":"2023-08-17T00:09:54.395950+0000","last_became_peered":"2023-08-17T00:09:54.395950+0000","last_unstale":"2023-08-17T00:09:54.817334+0000","last_undegraded":"2023-08-17T00:09:54.817334+0000","last_fullsized":"2023-08-17T00:09:54.817334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847425+0000","last_change":"2023-08-17T00:09:54.843921+0000","last_active":"2023-08-17T00:09:54.847425+0000","last_peered":"2023-08-17T00:09:54.847425+0000","last_clean":"2023-08-17T00:09:54.847425+0000","last_became_active":"2023-08-17T00:09:54.843655+0000","last_became_peered":"2023-08-17T00:09:54.843655+0000","last_unstale":"2023-08-17T00:09:54.847425+0000","last_undegraded":"2023-08-17T00:09:54.847425+0000","last_fullsized":"2023-08-17T00:09:54.847425+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831662+0000","last_change":"2023-08-17T00:09:54.389595+0000","last_active":"2023-08-17T00:09:54.831662+0000","last_peered":"2023-08-17T00:09:54.831662+0000","last_clean":"2023-08-17T00:09:54.831662+0000","last_became_active":"2023-08-17T00:09:54.389337+0000","last_became_peered":"2023-08-17T00:09:54.389337+0000","last_unstale":"2023-08-17T00:09:54.831662+0000","last_undegraded":"2023-08-17T00:09:54.831662+0000","last_fullsized":"2023-08-17T00:09:54.831662+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.851816+0000","last_change":"2023-08-17T00:09:54.845411+0000","last_active":"2023-08-17T00:09:54.851816+0000","last_peered":"2023-08-17T00:09:54.851816+0000","last_clean":"2023-08-17T00:09:54.851816+0000","last_became_active":"2023-08-17T00:09:54.845139+0000","last_became_peered":"2023-08-17T00:09:54.845139+0000","last_unstale":"2023-08-17T00:09:54.851816+0000","last_undegraded":"2023-08-17T00:09:54.851816+0000","last_fullsized":"2023-08-17T00:09:54.851816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2d","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.851368+0000","last_change":"2023-08-17T00:09:54.401195+0000","last_active":"2023-08-17T00:09:54.851368+0000","last_peered":"2023-08-17T00:09:54.851368+0000","last_clean":"2023-08-17T00:09:54.851368+0000","last_became_active":"2023-08-17T00:09:54.400906+0000","last_became_peered":"2023-08-17T00:09:54.400906+0000","last_unstale":"2023-08-17T00:09:54.851368+0000","last_undegraded":"2023-08-17T00:09:54.851368+0000","last_fullsized":"2023-08-17T00:09:54.851368+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839960+0000","last_change":"2023-08-17T00:09:54.833365+0000","last_active":"2023-08-17T00:09:54.839960+0000","last_peered":"2023-08-17T00:09:54.839960+0000","last_clean":"2023-08-17T00:09:54.839960+0000","last_became_active":"2023-08-17T00:09:54.832995+0000","last_became_peered":"2023-08-17T00:09:54.832995+0000","last_unstale":"2023-08-17T00:09:54.839960+0000","last_undegraded":"2023-08-17T00:09:54.839960+0000","last_fullsized":"2023-08-17T00:09:54.839960+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829792+0000","last_change":"2023-08-17T00:09:54.400761+0000","last_active":"2023-08-17T00:09:54.829792+0000","last_peered":"2023-08-17T00:09:54.829792+0000","last_clean":"2023-08-17T00:09:54.829792+0000","last_became_active":"2023-08-17T00:09:54.400425+0000","last_became_peered":"2023-08-17T00:09:54.400425+0000","last_unstale":"2023-08-17T00:09:54.829792+0000","last_undegraded":"2023-08-17T00:09:54.829792+0000","last_fullsized":"2023-08-17T00:09:54.829792+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845462+0000","last_change":"2023-08-17T00:09:54.842779+0000","last_active":"2023-08-17T00:09:54.845462+0000","last_peered":"2023-08-17T00:09:54.845462+0000","last_clean":"2023-08-17T00:09:54.845462+0000","last_became_active":"2023-08-17T00:09:54.842441+0000","last_became_peered":"2023-08-17T00:09:54.842441+0000","last_unstale":"2023-08-17T00:09:54.845462+0000","last_undegraded":"2023-08-17T00:09:54.845462+0000","last_fullsized":"2023-08-17T00:09:54.845462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850643+0000","last_change":"2023-08-17T00:09:54.387181+0000","last_active":"2023-08-17T00:09:54.850643+0000","last_peered":"2023-08-17T00:09:54.850643+0000","last_clean":"2023-08-17T00:09:54.850643+0000","last_became_active":"2023-08-17T00:09:54.386748+0000","last_became_peered":"2023-08-17T00:09:54.386748+0000","last_unstale":"2023-08-17T00:09:54.850643+0000","last_undegraded":"2023-08-17T00:09:54.850643+0000","last_fullsized":"2023-08-17T00:09:54.850643+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847172+0000","last_change":"2023-08-17T00:09:54.841866+0000","last_active":"2023-08-17T00:09:54.847172+0000","last_peered":"2023-08-17T00:09:54.847172+0000","last_clean":"2023-08-17T00:09:54.847172+0000","last_became_active":"2023-08-17T00:09:54.841612+0000","last_became_peered":"2023-08-17T00:09:54.841612+0000","last_unstale":"2023-08-17T00:09:54.847172+0000","last_undegraded":"2023-08-17T00:09:54.847172+0000","last_fullsized":"2023-08-17T00:09:54.847172+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.834974+0000","last_change":"2023-08-17T00:09:54.397711+0000","last_active":"2023-08-17T00:09:54.834974+0000","last_peered":"2023-08-17T00:09:54.834974+0000","last_clean":"2023-08-17T00:09:54.834974+0000","last_became_active":"2023-08-17T00:09:54.397432+0000","last_became_peered":"2023-08-17T00:09:54.397432+0000","last_unstale":"2023-08-17T00:09:54.834974+0000","last_undegraded":"2023-08-17T00:09:54.834974+0000","last_fullsized":"2023-08-17T00:09:54.834974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846397+0000","last_change":"2023-08-17T00:09:54.843227+0000","last_active":"2023-08-17T00:09:54.846397+0000","last_peered":"2023-08-17T00:09:54.846397+0000","last_clean":"2023-08-17T00:09:54.846397+0000","last_became_active":"2023-08-17T00:09:54.842923+0000","last_became_peered":"2023-08-17T00:09:54.842923+0000","last_unstale":"2023-08-17T00:09:54.846397+0000","last_undegraded":"2023-08-17T00:09:54.846397+0000","last_fullsized":"2023-08-17T00:09:54.846397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816741+0000","last_change":"2023-08-17T00:09:54.396904+0000","last_active":"2023-08-17T00:09:54.816741+0000","last_peered":"2023-08-17T00:09:54.816741+0000","last_clean":"2023-08-17T00:09:54.816741+0000","last_became_active":"2023-08-17T00:09:54.396644+0000","last_became_peered":"2023-08-17T00:09:54.396644+0000","last_unstale":"2023-08-17T00:09:54.816741+0000","last_undegraded":"2023-08-17T00:09:54.816741+0000","last_fullsized":"2023-08-17T00:09:54.816741+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845987+0000","last_change":"2023-08-17T00:09:54.832073+0000","last_active":"2023-08-17T00:09:54.845987+0000","last_peered":"2023-08-17T00:09:54.845987+0000","last_clean":"2023-08-17T00:09:54.845987+0000","last_became_active":"2023-08-17T00:09:54.831404+0000","last_became_peered":"2023-08-17T00:09:54.831404+0000","last_unstale":"2023-08-17T00:09:54.845987+0000","last_undegraded":"2023-08-17T00:09:54.845987+0000","last_fullsized":"2023-08-17T00:09:54.845987+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829745+0000","last_change":"2023-08-17T00:09:54.394618+0000","last_active":"2023-08-17T00:09:54.829745+0000","last_peered":"2023-08-17T00:09:54.829745+0000","last_clean":"2023-08-17T00:09:54.829745+0000","last_became_active":"2023-08-17T00:09:54.394358+0000","last_became_peered":"2023-08-17T00:09:54.394358+0000","last_unstale":"2023-08-17T00:09:54.829745+0000","last_undegraded":"2023-08-17T00:09:54.829745+0000","last_fullsized":"2023-08-17T00:09:54.829745+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.844739+0000","last_change":"2023-08-17T00:09:54.834612+0000","last_active":"2023-08-17T00:09:54.844739+0000","last_peered":"2023-08-17T00:09:54.844739+0000","last_clean":"2023-08-17T00:09:54.844739+0000","last_became_active":"2023-08-17T00:09:54.834049+0000","last_became_peered":"2023-08-17T00:09:54.834049+0000","last_unstale":"2023-08-17T00:09:54.844739+0000","last_undegraded":"2023-08-17T00:09:54.844739+0000","last_fullsized":"2023-08-17T00:09:54.844739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831822+0000","last_change":"2023-08-17T00:09:54.403610+0000","last_active":"2023-08-17T00:09:54.831822+0000","last_peered":"2023-08-17T00:09:54.831822+0000","last_clean":"2023-08-17T00:09:54.831822+0000","last_became_active":"2023-08-17T00:09:54.403210+0000","last_became_peered":"2023-08-17T00:09:54.403210+0000","last_unstale":"2023-08-17T00:09:54.831822+0000","last_undegraded":"2023-08-17T00:09:54.831822+0000","last_fullsized":"2023-08-17T00:09:54.831822+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848966+0000","last_change":"2023-08-17T00:09:54.840117+0000","last_active":"2023-08-17T00:09:54.848966+0000","last_peered":"2023-08-17T00:09:54.848966+0000","last_clean":"2023-08-17T00:09:54.848966+0000","last_became_active":"2023-08-17T00:09:54.839837+0000","last_became_peered":"2023-08-17T00:09:54.839837+0000","last_unstale":"2023-08-17T00:09:54.848966+0000","last_undegraded":"2023-08-17T00:09:54.848966+0000","last_fullsized":"2023-08-17T00:09:54.848966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826605+0000","last_change":"2023-08-17T00:09:54.397242+0000","last_active":"2023-08-17T00:09:54.826605+0000","last_peered":"2023-08-17T00:09:54.826605+0000","last_clean":"2023-08-17T00:09:54.826605+0000","last_became_active":"2023-08-17T00:09:54.396977+0000","last_became_peered":"2023-08-17T00:09:54.396977+0000","last_unstale":"2023-08-17T00:09:54.826605+0000","last_undegraded":"2023-08-17T00:09:54.826605+0000","last_fullsized":"2023-08-17T00:09:54.826605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847667+0000","last_change":"2023-08-17T00:09:54.845150+0000","last_active":"2023-08-17T00:09:54.847667+0000","last_peered":"2023-08-17T00:09:54.847667+0000","last_clean":"2023-08-17T00:09:54.847667+0000","last_became_active":"2023-08-17T00:09:54.844269+0000","last_became_peered":"2023-08-17T00:09:54.844269+0000","last_unstale":"2023-08-17T00:09:54.847667+0000","last_undegraded":"2023-08-17T00:09:54.847667+0000","last_fullsized":"2023-08-17T00:09:54.847667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.827099+0000","last_change":"2023-08-17T00:09:54.400336+0000","last_active":"2023-08-17T00:09:54.827099+0000","last_peered":"2023-08-17T00:09:54.827099+0000","last_clean":"2023-08-17T00:09:54.827099+0000","last_became_active":"2023-08-17T00:09:54.400065+0000","last_became_peered":"2023-08-17T00:09:54.400065+0000","last_unstale":"2023-08-17T00:09:54.827099+0000","last_undegraded":"2023-08-17T00:09:54.827099+0000","last_fullsized":"2023-08-17T00:09:54.827099+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842277+0000","last_change":"2023-08-17T00:09:54.834324+0000","last_active":"2023-08-17T00:09:54.842277+0000","last_peered":"2023-08-17T00:09:54.842277+0000","last_clean":"2023-08-17T00:09:54.842277+0000","last_became_active":"2023-08-17T00:09:54.834070+0000","last_became_peered":"2023-08-17T00:09:54.834070+0000","last_unstale":"2023-08-17T00:09:54.842277+0000","last_undegraded":"2023-08-17T00:09:54.842277+0000","last_fullsized":"2023-08-17T00:09:54.842277+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825246+0000","last_change":"2023-08-17T00:09:54.406664+0000","last_active":"2023-08-17T00:09:54.825246+0000","last_peered":"2023-08-17T00:09:54.825246+0000","last_clean":"2023-08-17T00:09:54.825246+0000","last_became_active":"2023-08-17T00:09:54.406382+0000","last_became_peered":"2023-08-17T00:09:54.406382+0000","last_unstale":"2023-08-17T00:09:54.825246+0000","last_undegraded":"2023-08-17T00:09:54.825246+0000","last_fullsized":"2023-08-17T00:09:54.825246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839989+0000","last_change":"2023-08-17T00:09:54.829214+0000","last_active":"2023-08-17T00:09:54.839989+0000","last_peered":"2023-08-17T00:09:54.839989+0000","last_clean":"2023-08-17T00:09:54.839989+0000","last_became_active":"2023-08-17T00:09:54.828889+0000","last_became_peered":"2023-08-17T00:09:54.828889+0000","last_unstale":"2023-08-17T00:09:54.839989+0000","last_undegraded":"2023-08-17T00:09:54.839989+0000","last_fullsized":"2023-08-17T00:09:54.839989+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.821198+0000","last_change":"2023-08-17T00:09:54.387005+0000","last_active":"2023-08-17T00:09:54.821198+0000","last_peered":"2023-08-17T00:09:54.821198+0000","last_clean":"2023-08-17T00:09:54.821198+0000","last_became_active":"2023-08-17T00:09:54.386410+0000","last_became_peered":"2023-08-17T00:09:54.386410+0000","last_unstale":"2023-08-17T00:09:54.821198+0000","last_undegraded":"2023-08-17T00:09:54.821198+0000","last_fullsized":"2023-08-17T00:09:54.821198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846291+0000","last_change":"2023-08-17T00:09:54.840225+0000","last_active":"2023-08-17T00:09:54.846291+0000","last_peered":"2023-08-17T00:09:54.846291+0000","last_clean":"2023-08-17T00:09:54.846291+0000","last_became_active":"2023-08-17T00:09:54.839976+0000","last_became_peered":"2023-08-17T00:09:54.839976+0000","last_unstale":"2023-08-17T00:09:54.846291+0000","last_undegraded":"2023-08-17T00:09:54.846291+0000","last_fullsized":"2023-08-17T00:09:54.846291+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.835087+0000","last_change":"2023-08-17T00:09:54.403433+0000","last_active":"2023-08-17T00:09:54.835087+0000","last_peered":"2023-08-17T00:09:54.835087+0000","last_clean":"2023-08-17T00:09:54.835087+0000","last_became_active":"2023-08-17T00:09:54.403167+0000","last_became_peered":"2023-08-17T00:09:54.403167+0000","last_unstale":"2023-08-17T00:09:54.835087+0000","last_undegraded":"2023-08-17T00:09:54.835087+0000","last_fullsized":"2023-08-17T00:09:54.835087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842466+0000","last_change":"2023-08-17T00:09:54.832130+0000","last_active":"2023-08-17T00:09:54.842466+0000","last_peered":"2023-08-17T00:09:54.842466+0000","last_clean":"2023-08-17T00:09:54.842466+0000","last_became_active":"2023-08-17T00:09:54.831839+0000","last_became_peered":"2023-08-17T00:09:54.831839+0000","last_unstale":"2023-08-17T00:09:54.842466+0000","last_undegraded":"2023-08-17T00:09:54.842466+0000","last_fullsized":"2023-08-17T00:09:54.842466+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828750+0000","last_change":"2023-08-17T00:09:54.404071+0000","last_active":"2023-08-17T00:09:54.828750+0000","last_peered":"2023-08-17T00:09:54.828750+0000","last_clean":"2023-08-17T00:09:54.828750+0000","last_became_active":"2023-08-17T00:09:54.403722+0000","last_became_peered":"2023-08-17T00:09:54.403722+0000","last_unstale":"2023-08-17T00:09:54.828750+0000","last_undegraded":"2023-08-17T00:09:54.828750+0000","last_fullsized":"2023-08-17T00:09:54.828750+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847262+0000","last_change":"2023-08-17T00:09:54.842406+0000","last_active":"2023-08-17T00:09:54.847262+0000","last_peered":"2023-08-17T00:09:54.847262+0000","last_clean":"2023-08-17T00:09:54.847262+0000","last_became_active":"2023-08-17T00:09:54.840748+0000","last_became_peered":"2023-08-17T00:09:54.840748+0000","last_unstale":"2023-08-17T00:09:54.847262+0000","last_undegraded":"2023-08-17T00:09:54.847262+0000","last_fullsized":"2023-08-17T00:09:54.847262+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828603+0000","last_change":"2023-08-17T00:09:54.401825+0000","last_active":"2023-08-17T00:09:54.828603+0000","last_peered":"2023-08-17T00:09:54.828603+0000","last_clean":"2023-08-17T00:09:54.828603+0000","last_became_active":"2023-08-17T00:09:54.401536+0000","last_became_peered":"2023-08-17T00:09:54.401536+0000","last_unstale":"2023-08-17T00:09:54.828603+0000","last_undegraded":"2023-08-17T00:09:54.828603+0000","last_fullsized":"2023-08-17T00:09:54.828603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848334+0000","last_change":"2023-08-17T00:09:54.845314+0000","last_active":"2023-08-17T00:09:54.848334+0000","last_peered":"2023-08-17T00:09:54.848334+0000","last_clean":"2023-08-17T00:09:54.848334+0000","last_became_active":"2023-08-17T00:09:54.844902+0000","last_became_peered":"2023-08-17T00:09:54.844902+0000","last_unstale":"2023-08-17T00:09:54.848334+0000","last_undegraded":"2023-08-17T00:09:54.848334+0000","last_fullsized":"2023-08-17T00:09:54.848334+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847376+0000","last_change":"2023-08-17T00:09:54.403576+0000","last_active":"2023-08-17T00:09:54.847376+0000","last_peered":"2023-08-17T00:09:54.847376+0000","last_clean":"2023-08-17T00:09:54.847376+0000","last_became_active":"2023-08-17T00:09:54.403239+0000","last_became_peered":"2023-08-17T00:09:54.403239+0000","last_unstale":"2023-08-17T00:09:54.847376+0000","last_undegraded":"2023-08-17T00:09:54.847376+0000","last_fullsized":"2023-08-17T00:09:54.847376+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847461+0000","last_change":"2023-08-17T00:09:54.843796+0000","last_active":"2023-08-17T00:09:54.847461+0000","last_peered":"2023-08-17T00:09:54.847461+0000","last_clean":"2023-08-17T00:09:54.847461+0000","last_became_active":"2023-08-17T00:09:54.842035+0000","last_became_peered":"2023-08-17T00:09:54.842035+0000","last_unstale":"2023-08-17T00:09:54.847461+0000","last_undegraded":"2023-08-17T00:09:54.847461+0000","last_fullsized":"2023-08-17T00:09:54.847461+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849671+0000","last_change":"2023-08-17T00:09:54.406659+0000","last_active":"2023-08-17T00:09:54.849671+0000","last_peered":"2023-08-17T00:09:54.849671+0000","last_clean":"2023-08-17T00:09:54.849671+0000","last_became_active":"2023-08-17T00:09:54.406373+0000","last_became_peered":"2023-08-17T00:09:54.406373+0000","last_unstale":"2023-08-17T00:09:54.849671+0000","last_undegraded":"2023-08-17T00:09:54.849671+0000","last_fullsized":"2023-08-17T00:09:54.849671+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.855646+0000","last_change":"2023-08-17T00:09:54.851705+0000","last_active":"2023-08-17T00:09:54.855646+0000","last_peered":"2023-08-17T00:09:54.855646+0000","last_clean":"2023-08-17T00:09:54.855646+0000","last_became_active":"2023-08-17T00:09:54.851397+0000","last_became_peered":"2023-08-17T00:09:54.851397+0000","last_unstale":"2023-08-17T00:09:54.855646+0000","last_undegraded":"2023-08-17T00:09:54.855646+0000","last_fullsized":"2023-08-17T00:09:54.855646+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845324+0000","last_change":"2023-08-17T00:09:54.400260+0000","last_active":"2023-08-17T00:09:54.845324+0000","last_peered":"2023-08-17T00:09:54.845324+0000","last_clean":"2023-08-17T00:09:54.845324+0000","last_became_active":"2023-08-17T00:09:54.399972+0000","last_became_peered":"2023-08-17T00:09:54.399972+0000","last_unstale":"2023-08-17T00:09:54.845324+0000","last_undegraded":"2023-08-17T00:09:54.845324+0000","last_fullsized":"2023-08-17T00:09:54.845324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852742+0000","last_change":"2023-08-17T00:09:54.850283+0000","last_active":"2023-08-17T00:09:54.852742+0000","last_peered":"2023-08-17T00:09:54.852742+0000","last_clean":"2023-08-17T00:09:54.852742+0000","last_became_active":"2023-08-17T00:09:54.849396+0000","last_became_peered":"2023-08-17T00:09:54.849396+0000","last_unstale":"2023-08-17T00:09:54.852742+0000","last_undegraded":"2023-08-17T00:09:54.852742+0000","last_fullsized":"2023-08-17T00:09:54.852742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816803+0000","last_change":"2023-08-17T00:09:54.385193+0000","last_active":"2023-08-17T00:09:54.816803+0000","last_peered":"2023-08-17T00:09:54.816803+0000","last_clean":"2023-08-17T00:09:54.816803+0000","last_became_active":"2023-08-17T00:09:54.384900+0000","last_became_peered":"2023-08-17T00:09:54.384900+0000","last_unstale":"2023-08-17T00:09:54.816803+0000","last_undegraded":"2023-08-17T00:09:54.816803+0000","last_fullsized":"2023-08-17T00:09:54.816803+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.844666+0000","last_change":"2023-08-17T00:09:54.836166+0000","last_active":"2023-08-17T00:09:54.844666+0000","last_peered":"2023-08-17T00:09:54.844666+0000","last_clean":"2023-08-17T00:09:54.844666+0000","last_became_active":"2023-08-17T00:09:54.835819+0000","last_became_peered":"2023-08-17T00:09:54.835819+0000","last_unstale":"2023-08-17T00:09:54.844666+0000","last_undegraded":"2023-08-17T00:09:54.844666+0000","last_fullsized":"2023-08-17T00:09:54.844666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828517+0000","last_change":"2023-08-17T00:09:54.394329+0000","last_active":"2023-08-17T00:09:54.828517+0000","last_peered":"2023-08-17T00:09:54.828517+0000","last_clean":"2023-08-17T00:09:54.828517+0000","last_became_active":"2023-08-17T00:09:54.394039+0000","last_became_peered":"2023-08-17T00:09:54.394039+0000","last_unstale":"2023-08-17T00:09:54.828517+0000","last_undegraded":"2023-08-17T00:09:54.828517+0000","last_fullsized":"2023-08-17T00:09:54.828517+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849556+0000","last_change":"2023-08-17T00:09:54.841790+0000","last_active":"2023-08-17T00:09:54.849556+0000","last_peered":"2023-08-17T00:09:54.849556+0000","last_clean":"2023-08-17T00:09:54.849556+0000","last_became_active":"2023-08-17T00:09:54.841483+0000","last_became_peered":"2023-08-17T00:09:54.841483+0000","last_unstale":"2023-08-17T00:09:54.849556+0000","last_undegraded":"2023-08-17T00:09:54.849556+0000","last_fullsized":"2023-08-17T00:09:54.849556+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.821349+0000","last_change":"2023-08-17T00:09:54.382984+0000","last_active":"2023-08-17T00:09:54.821349+0000","last_peered":"2023-08-17T00:09:54.821349+0000","last_clean":"2023-08-17T00:09:54.821349+0000","last_became_active":"2023-08-17T00:09:54.382161+0000","last_became_peered":"2023-08-17T00:09:54.382161+0000","last_unstale":"2023-08-17T00:09:54.821349+0000","last_undegraded":"2023-08-17T00:09:54.821349+0000","last_fullsized":"2023-08-17T00:09:54.821349+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850415+0000","last_change":"2023-08-17T00:09:54.847567+0000","last_active":"2023-08-17T00:09:54.850415+0000","last_peered":"2023-08-17T00:09:54.850415+0000","last_clean":"2023-08-17T00:09:54.850415+0000","last_became_active":"2023-08-17T00:09:54.847247+0000","last_became_peered":"2023-08-17T00:09:54.847247+0000","last_unstale":"2023-08-17T00:09:54.850415+0000","last_undegraded":"2023-08-17T00:09:54.850415+0000","last_fullsized":"2023-08-17T00:09:54.850415+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830655+0000","last_change":"2023-08-17T00:09:54.402776+0000","last_active":"2023-08-17T00:09:54.830655+0000","last_peered":"2023-08-17T00:09:54.830655+0000","last_clean":"2023-08-17T00:09:54.830655+0000","last_became_active":"2023-08-17T00:09:54.402474+0000","last_became_peered":"2023-08-17T00:09:54.402474+0000","last_unstale":"2023-08-17T00:09:54.830655+0000","last_undegraded":"2023-08-17T00:09:54.830655+0000","last_fullsized":"2023-08-17T00:09:54.830655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.841489+0000","last_change":"2023-08-17T00:09:54.834475+0000","last_active":"2023-08-17T00:09:54.841489+0000","last_peered":"2023-08-17T00:09:54.841489+0000","last_clean":"2023-08-17T00:09:54.841489+0000","last_became_active":"2023-08-17T00:09:54.834194+0000","last_became_peered":"2023-08-17T00:09:54.834194+0000","last_unstale":"2023-08-17T00:09:54.841489+0000","last_undegraded":"2023-08-17T00:09:54.841489+0000","last_fullsized":"2023-08-17T00:09:54.841489+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825103+0000","last_change":"2023-08-17T00:09:54.392720+0000","last_active":"2023-08-17T00:09:54.825103+0000","last_peered":"2023-08-17T00:09:54.825103+0000","last_clean":"2023-08-17T00:09:54.825103+0000","last_became_active":"2023-08-17T00:09:54.392224+0000","last_became_peered":"2023-08-17T00:09:54.392224+0000","last_unstale":"2023-08-17T00:09:54.825103+0000","last_undegraded":"2023-08-17T00:09:54.825103+0000","last_fullsized":"2023-08-17T00:09:54.825103+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846468+0000","last_change":"2023-08-17T00:09:54.841313+0000","last_active":"2023-08-17T00:09:54.846468+0000","last_peered":"2023-08-17T00:09:54.846468+0000","last_clean":"2023-08-17T00:09:54.846468+0000","last_became_active":"2023-08-17T00:09:54.841026+0000","last_became_peered":"2023-08-17T00:09:54.841026+0000","last_unstale":"2023-08-17T00:09:54.846468+0000","last_undegraded":"2023-08-17T00:09:54.846468+0000","last_fullsized":"2023-08-17T00:09:54.846468+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825987+0000","last_change":"2023-08-17T00:09:54.400129+0000","last_active":"2023-08-17T00:09:54.825987+0000","last_peered":"2023-08-17T00:09:54.825987+0000","last_clean":"2023-08-17T00:09:54.825987+0000","last_became_active":"2023-08-17T00:09:54.399857+0000","last_became_peered":"2023-08-17T00:09:54.399857+0000","last_unstale":"2023-08-17T00:09:54.825987+0000","last_undegraded":"2023-08-17T00:09:54.825987+0000","last_fullsized":"2023-08-17T00:09:54.825987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.835332+0000","last_change":"2023-08-17T00:09:54.831609+0000","last_active":"2023-08-17T00:09:54.835332+0000","last_peered":"2023-08-17T00:09:54.835332+0000","last_clean":"2023-08-17T00:09:54.835332+0000","last_became_active":"2023-08-17T00:09:54.831328+0000","last_became_peered":"2023-08-17T00:09:54.831328+0000","last_unstale":"2023-08-17T00:09:54.835332+0000","last_undegraded":"2023-08-17T00:09:54.835332+0000","last_fullsized":"2023-08-17T00:09:54.835332+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.832198+0000","last_change":"2023-08-17T00:09:54.394654+0000","last_active":"2023-08-17T00:09:54.832198+0000","last_peered":"2023-08-17T00:09:54.832198+0000","last_clean":"2023-08-17T00:09:54.832198+0000","last_became_active":"2023-08-17T00:09:54.394262+0000","last_became_peered":"2023-08-17T00:09:54.394262+0000","last_unstale":"2023-08-17T00:09:54.832198+0000","last_undegraded":"2023-08-17T00:09:54.832198+0000","last_fullsized":"2023-08-17T00:09:54.832198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845389+0000","last_change":"2023-08-17T00:09:54.843031+0000","last_active":"2023-08-17T00:09:54.845389+0000","last_peered":"2023-08-17T00:09:54.845389+0000","last_clean":"2023-08-17T00:09:54.845389+0000","last_became_active":"2023-08-17T00:09:54.842779+0000","last_became_peered":"2023-08-17T00:09:54.842779+0000","last_unstale":"2023-08-17T00:09:54.845389+0000","last_undegraded":"2023-08-17T00:09:54.845389+0000","last_fullsized":"2023-08-17T00:09:54.845389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849324+0000","last_change":"2023-08-17T00:09:54.391919+0000","last_active":"2023-08-17T00:09:54.849324+0000","last_peered":"2023-08-17T00:09:54.849324+0000","last_clean":"2023-08-17T00:09:54.849324+0000","last_became_active":"2023-08-17T00:09:54.391662+0000","last_became_peered":"2023-08-17T00:09:54.391662+0000","last_unstale":"2023-08-17T00:09:54.849324+0000","last_undegraded":"2023-08-17T00:09:54.849324+0000","last_fullsized":"2023-08-17T00:09:54.849324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839936+0000","last_change":"2023-08-17T00:09:54.828545+0000","last_active":"2023-08-17T00:09:54.839936+0000","last_peered":"2023-08-17T00:09:54.839936+0000","last_clean":"2023-08-17T00:09:54.839936+0000","last_became_active":"2023-08-17T00:09:54.828203+0000","last_became_peered":"2023-08-17T00:09:54.828203+0000","last_unstale":"2023-08-17T00:09:54.839936+0000","last_undegraded":"2023-08-17T00:09:54.839936+0000","last_fullsized":"2023-08-17T00:09:54.839936+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846786+0000","last_change":"2023-08-17T00:09:54.393612+0000","last_active":"2023-08-17T00:09:54.846786+0000","last_peered":"2023-08-17T00:09:54.846786+0000","last_clean":"2023-08-17T00:09:54.846786+0000","last_became_active":"2023-08-17T00:09:54.393123+0000","last_became_peered":"2023-08-17T00:09:54.393123+0000","last_unstale":"2023-08-17T00:09:54.846786+0000","last_undegraded":"2023-08-17T00:09:54.846786+0000","last_fullsized":"2023-08-17T00:09:54.846786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842628+0000","last_change":"2023-08-17T00:09:54.837422+0000","last_active":"2023-08-17T00:09:54.842628+0000","last_peered":"2023-08-17T00:09:54.842628+0000","last_clean":"2023-08-17T00:09:54.842628+0000","last_became_active":"2023-08-17T00:09:54.837002+0000","last_became_peered":"2023-08-17T00:09:54.837002+0000","last_unstale":"2023-08-17T00:09:54.842628+0000","last_undegraded":"2023-08-17T00:09:54.842628+0000","last_fullsized":"2023-08-17T00:09:54.842628+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849322+0000","last_change":"2023-08-17T00:09:54.400579+0000","last_active":"2023-08-17T00:09:54.849322+0000","last_peered":"2023-08-17T00:09:54.849322+0000","last_clean":"2023-08-17T00:09:54.849322+0000","last_became_active":"2023-08-17T00:09:54.400288+0000","last_became_peered":"2023-08-17T00:09:54.400288+0000","last_unstale":"2023-08-17T00:09:54.849322+0000","last_undegraded":"2023-08-17T00:09:54.849322+0000","last_fullsized":"2023-08-17T00:09:54.849322+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.841100+0000","last_change":"2023-08-17T00:09:54.831637+0000","last_active":"2023-08-17T00:09:54.841100+0000","last_peered":"2023-08-17T00:09:54.841100+0000","last_clean":"2023-08-17T00:09:54.841100+0000","last_became_active":"2023-08-17T00:09:54.831372+0000","last_became_peered":"2023-08-17T00:09:54.831372+0000","last_unstale":"2023-08-17T00:09:54.841100+0000","last_undegraded":"2023-08-17T00:09:54.841100+0000","last_fullsized":"2023-08-17T00:09:54.841100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830632+0000","last_change":"2023-08-17T00:09:54.391422+0000","last_active":"2023-08-17T00:09:54.830632+0000","last_peered":"2023-08-17T00:09:54.830632+0000","last_clean":"2023-08-17T00:09:54.830632+0000","last_became_active":"2023-08-17T00:09:54.390383+0000","last_became_peered":"2023-08-17T00:09:54.390383+0000","last_unstale":"2023-08-17T00:09:54.830632+0000","last_undegraded":"2023-08-17T00:09:54.830632+0000","last_fullsized":"2023-08-17T00:09:54.830632+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846688+0000","last_change":"2023-08-17T00:09:54.844404+0000","last_active":"2023-08-17T00:09:54.846688+0000","last_peered":"2023-08-17T00:09:54.846688+0000","last_clean":"2023-08-17T00:09:54.846688+0000","last_became_active":"2023-08-17T00:09:54.844136+0000","last_became_peered":"2023-08-17T00:09:54.844136+0000","last_unstale":"2023-08-17T00:09:54.846688+0000","last_undegraded":"2023-08-17T00:09:54.846688+0000","last_fullsized":"2023-08-17T00:09:54.846688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829481+0000","last_change":"2023-08-17T00:09:54.393638+0000","last_active":"2023-08-17T00:09:54.829481+0000","last_peered":"2023-08-17T00:09:54.829481+0000","last_clean":"2023-08-17T00:09:54.829481+0000","last_became_active":"2023-08-17T00:09:54.393356+0000","last_became_peered":"2023-08-17T00:09:54.393356+0000","last_unstale":"2023-08-17T00:09:54.829481+0000","last_undegraded":"2023-08-17T00:09:54.829481+0000","last_fullsized":"2023-08-17T00:09:54.829481+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843674+0000","last_change":"2023-08-17T00:09:54.832807+0000","last_active":"2023-08-17T00:09:54.843674+0000","last_peered":"2023-08-17T00:09:54.843674+0000","last_clean":"2023-08-17T00:09:54.843674+0000","last_became_active":"2023-08-17T00:09:54.832187+0000","last_became_peered":"2023-08-17T00:09:54.832187+0000","last_unstale":"2023-08-17T00:09:54.843674+0000","last_undegraded":"2023-08-17T00:09:54.843674+0000","last_fullsized":"2023-08-17T00:09:54.843674+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849036+0000","last_change":"2023-08-17T00:09:54.396118+0000","last_active":"2023-08-17T00:09:54.849036+0000","last_peered":"2023-08-17T00:09:54.849036+0000","last_clean":"2023-08-17T00:09:54.849036+0000","last_became_active":"2023-08-17T00:09:54.395842+0000","last_became_peered":"2023-08-17T00:09:54.395842+0000","last_unstale":"2023-08-17T00:09:54.849036+0000","last_undegraded":"2023-08-17T00:09:54.849036+0000","last_fullsized":"2023-08-17T00:09:54.849036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846937+0000","last_change":"2023-08-17T00:09:54.843595+0000","last_active":"2023-08-17T00:09:54.846937+0000","last_peered":"2023-08-17T00:09:54.846937+0000","last_clean":"2023-08-17T00:09:54.846937+0000","last_became_active":"2023-08-17T00:09:54.842912+0000","last_became_peered":"2023-08-17T00:09:54.842912+0000","last_unstale":"2023-08-17T00:09:54.846937+0000","last_undegraded":"2023-08-17T00:09:54.846937+0000","last_fullsized":"2023-08-17T00:09:54.846937+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849264+0000","last_change":"2023-08-17T00:09:54.396595+0000","last_active":"2023-08-17T00:09:54.849264+0000","last_peered":"2023-08-17T00:09:54.849264+0000","last_clean":"2023-08-17T00:09:54.849264+0000","last_became_active":"2023-08-17T00:09:54.396324+0000","last_became_peered":"2023-08-17T00:09:54.396324+0000","last_unstale":"2023-08-17T00:09:54.849264+0000","last_undegraded":"2023-08-17T00:09:54.849264+0000","last_fullsized":"2023-08-17T00:09:54.849264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843547+0000","last_change":"2023-08-17T00:09:54.832372+0000","last_active":"2023-08-17T00:09:54.843547+0000","last_peered":"2023-08-17T00:09:54.843547+0000","last_clean":"2023-08-17T00:09:54.843547+0000","last_became_active":"2023-08-17T00:09:54.832035+0000","last_became_peered":"2023-08-17T00:09:54.832035+0000","last_unstale":"2023-08-17T00:09:54.843547+0000","last_undegraded":"2023-08-17T00:09:54.843547+0000","last_fullsized":"2023-08-17T00:09:54.843547+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826689+0000","last_change":"2023-08-17T00:09:54.398038+0000","last_active":"2023-08-17T00:09:54.826689+0000","last_peered":"2023-08-17T00:09:54.826689+0000","last_clean":"2023-08-17T00:09:54.826689+0000","last_became_active":"2023-08-17T00:09:54.397782+0000","last_became_peered":"2023-08-17T00:09:54.397782+0000","last_unstale":"2023-08-17T00:09:54.826689+0000","last_undegraded":"2023-08-17T00:09:54.826689+0000","last_fullsized":"2023-08-17T00:09:54.826689+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843647+0000","last_change":"2023-08-17T00:09:54.835699+0000","last_active":"2023-08-17T00:09:54.843647+0000","last_peered":"2023-08-17T00:09:54.843647+0000","last_clean":"2023-08-17T00:09:54.843647+0000","last_became_active":"2023-08-17T00:09:54.835348+0000","last_became_peered":"2023-08-17T00:09:54.835348+0000","last_unstale":"2023-08-17T00:09:54.843647+0000","last_undegraded":"2023-08-17T00:09:54.843647+0000","last_fullsized":"2023-08-17T00:09:54.843647+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829469+0000","last_change":"2023-08-17T00:09:54.397060+0000","last_active":"2023-08-17T00:09:54.829469+0000","last_peered":"2023-08-17T00:09:54.829469+0000","last_clean":"2023-08-17T00:09:54.829469+0000","last_became_active":"2023-08-17T00:09:54.396786+0000","last_became_peered":"2023-08-17T00:09:54.396786+0000","last_unstale":"2023-08-17T00:09:54.829469+0000","last_undegraded":"2023-08-17T00:09:54.829469+0000","last_fullsized":"2023-08-17T00:09:54.829469+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842247+0000","last_change":"2023-08-17T00:09:54.831715+0000","last_active":"2023-08-17T00:09:54.842247+0000","last_peered":"2023-08-17T00:09:54.842247+0000","last_clean":"2023-08-17T00:09:54.842247+0000","last_became_active":"2023-08-17T00:09:54.831465+0000","last_became_peered":"2023-08-17T00:09:54.831465+0000","last_unstale":"2023-08-17T00:09:54.842247+0000","last_undegraded":"2023-08-17T00:09:54.842247+0000","last_fullsized":"2023-08-17T00:09:54.842247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826413+0000","last_change":"2023-08-17T00:09:54.395823+0000","last_active":"2023-08-17T00:09:54.826413+0000","last_peered":"2023-08-17T00:09:54.826413+0000","last_clean":"2023-08-17T00:09:54.826413+0000","last_became_active":"2023-08-17T00:09:54.395493+0000","last_became_peered":"2023-08-17T00:09:54.395493+0000","last_unstale":"2023-08-17T00:09:54.826413+0000","last_undegraded":"2023-08-17T00:09:54.826413+0000","last_fullsized":"2023-08-17T00:09:54.826413+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840048+0000","last_change":"2023-08-17T00:09:54.834321+0000","last_active":"2023-08-17T00:09:54.840048+0000","last_peered":"2023-08-17T00:09:54.840048+0000","last_clean":"2023-08-17T00:09:54.840048+0000","last_became_active":"2023-08-17T00:09:54.834027+0000","last_became_peered":"2023-08-17T00:09:54.834027+0000","last_unstale":"2023-08-17T00:09:54.840048+0000","last_undegraded":"2023-08-17T00:09:54.840048+0000","last_fullsized":"2023-08-17T00:09:54.840048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830684+0000","last_change":"2023-08-17T00:09:54.388390+0000","last_active":"2023-08-17T00:09:54.830684+0000","last_peered":"2023-08-17T00:09:54.830684+0000","last_clean":"2023-08-17T00:09:54.830684+0000","last_became_active":"2023-08-17T00:09:54.387941+0000","last_became_peered":"2023-08-17T00:09:54.387941+0000","last_unstale":"2023-08-17T00:09:54.830684+0000","last_undegraded":"2023-08-17T00:09:54.830684+0000","last_fullsized":"2023-08-17T00:09:54.830684+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848903+0000","last_change":"2023-08-17T00:09:54.840538+0000","last_active":"2023-08-17T00:09:54.848903+0000","last_peered":"2023-08-17T00:09:54.848903+0000","last_clean":"2023-08-17T00:09:54.848903+0000","last_became_active":"2023-08-17T00:09:54.840277+0000","last_became_peered":"2023-08-17T00:09:54.840277+0000","last_unstale":"2023-08-17T00:09:54.848903+0000","last_undegraded":"2023-08-17T00:09:54.848903+0000","last_fullsized":"2023-08-17T00:09:54.848903+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825373+0000","last_change":"2023-08-17T00:09:54.403012+0000","last_active":"2023-08-17T00:09:54.825373+0000","last_peered":"2023-08-17T00:09:54.825373+0000","last_clean":"2023-08-17T00:09:54.825373+0000","last_became_active":"2023-08-17T00:09:54.402711+0000","last_became_peered":"2023-08-17T00:09:54.402711+0000","last_unstale":"2023-08-17T00:09:54.825373+0000","last_undegraded":"2023-08-17T00:09:54.825373+0000","last_fullsized":"2023-08-17T00:09:54.825373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852984+0000","last_change":"2023-08-17T00:09:54.850952+0000","last_active":"2023-08-17T00:09:54.852984+0000","last_peered":"2023-08-17T00:09:54.852984+0000","last_clean":"2023-08-17T00:09:54.852984+0000","last_became_active":"2023-08-17T00:09:54.850656+0000","last_became_peered":"2023-08-17T00:09:54.850656+0000","last_unstale":"2023-08-17T00:09:54.852984+0000","last_undegraded":"2023-08-17T00:09:54.852984+0000","last_fullsized":"2023-08-17T00:09:54.852984+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825509+0000","last_change":"2023-08-17T00:09:54.397962+0000","last_active":"2023-08-17T00:09:54.825509+0000","last_peered":"2023-08-17T00:09:54.825509+0000","last_clean":"2023-08-17T00:09:54.825509+0000","last_became_active":"2023-08-17T00:09:54.397744+0000","last_became_peered":"2023-08-17T00:09:54.397744+0000","last_unstale":"2023-08-17T00:09:54.825509+0000","last_undegraded":"2023-08-17T00:09:54.825509+0000","last_fullsized":"2023-08-17T00:09:54.825509+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847305+0000","last_change":"2023-08-17T00:09:54.843420+0000","last_active":"2023-08-17T00:09:54.847305+0000","last_peered":"2023-08-17T00:09:54.847305+0000","last_clean":"2023-08-17T00:09:54.847305+0000","last_became_active":"2023-08-17T00:09:54.843141+0000","last_became_peered":"2023-08-17T00:09:54.843141+0000","last_unstale":"2023-08-17T00:09:54.847305+0000","last_undegraded":"2023-08-17T00:09:54.847305+0000","last_fullsized":"2023-08-17T00:09:54.847305+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825206+0000","last_change":"2023-08-17T00:09:54.392526+0000","last_active":"2023-08-17T00:09:54.825206+0000","last_peered":"2023-08-17T00:09:54.825206+0000","last_clean":"2023-08-17T00:09:54.825206+0000","last_became_active":"2023-08-17T00:09:54.391904+0000","last_became_peered":"2023-08-17T00:09:54.391904+0000","last_unstale":"2023-08-17T00:09:54.825206+0000","last_undegraded":"2023-08-17T00:09:54.825206+0000","last_fullsized":"2023-08-17T00:09:54.825206+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845457+0000","last_change":"2023-08-17T00:09:54.842153+0000","last_active":"2023-08-17T00:09:54.845457+0000","last_peered":"2023-08-17T00:09:54.845457+0000","last_clean":"2023-08-17T00:09:54.845457+0000","last_became_active":"2023-08-17T00:09:54.841807+0000","last_became_peered":"2023-08-17T00:09:54.841807+0000","last_unstale":"2023-08-17T00:09:54.845457+0000","last_undegraded":"2023-08-17T00:09:54.845457+0000","last_fullsized":"2023-08-17T00:09:54.845457+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.821085+0000","last_change":"2023-08-17T00:09:54.376692+0000","last_active":"2023-08-17T00:09:54.821085+0000","last_peered":"2023-08-17T00:09:54.821085+0000","last_clean":"2023-08-17T00:09:54.821085+0000","last_became_active":"2023-08-17T00:09:54.376306+0000","last_became_peered":"2023-08-17T00:09:54.376306+0000","last_unstale":"2023-08-17T00:09:54.821085+0000","last_undegraded":"2023-08-17T00:09:54.821085+0000","last_fullsized":"2023-08-17T00:09:54.821085+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829533+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:09:54.829533+0000","last_peered":"2023-08-17T00:09:54.829533+0000","last_clean":"2023-08-17T00:09:54.829533+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:09:54.829533+0000","last_undegraded":"2023-08-17T00:09:54.829533+0000","last_fullsized":"2023-08-17T00:09:54.829533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849482+0000","last_change":"2023-08-17T00:09:54.847322+0000","last_active":"2023-08-17T00:09:54.849482+0000","last_peered":"2023-08-17T00:09:54.849482+0000","last_clean":"2023-08-17T00:09:54.849482+0000","last_became_active":"2023-08-17T00:09:54.847031+0000","last_became_peered":"2023-08-17T00:09:54.847031+0000","last_unstale":"2023-08-17T00:09:54.849482+0000","last_undegraded":"2023-08-17T00:09:54.849482+0000","last_fullsized":"2023-08-17T00:09:54.849482+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816472+0000","last_change":"2023-08-17T00:09:54.384661+0000","last_active":"2023-08-17T00:09:54.816472+0000","last_peered":"2023-08-17T00:09:54.816472+0000","last_clean":"2023-08-17T00:09:54.816472+0000","last_became_active":"2023-08-17T00:09:54.384360+0000","last_became_peered":"2023-08-17T00:09:54.384360+0000","last_unstale":"2023-08-17T00:09:54.816472+0000","last_undegraded":"2023-08-17T00:09:54.816472+0000","last_fullsized":"2023-08-17T00:09:54.816472+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817727+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:09:54.817727+0000","last_peered":"2023-08-17T00:09:54.817727+0000","last_clean":"2023-08-17T00:09:54.817727+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:09:54.817727+0000","last_undegraded":"2023-08-17T00:09:54.817727+0000","last_fullsized":"2023-08-17T00:09:54.817727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845560+0000","last_change":"2023-08-17T00:09:54.842135+0000","last_active":"2023-08-17T00:09:54.845560+0000","last_peered":"2023-08-17T00:09:54.845560+0000","last_clean":"2023-08-17T00:09:54.845560+0000","last_became_active":"2023-08-17T00:09:54.841923+0000","last_became_peered":"2023-08-17T00:09:54.841923+0000","last_unstale":"2023-08-17T00:09:54.845560+0000","last_undegraded":"2023-08-17T00:09:54.845560+0000","last_fullsized":"2023-08-17T00:09:54.845560+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817722+0000","last_change":"2023-08-17T00:09:54.385316+0000","last_active":"2023-08-17T00:09:54.817722+0000","last_peered":"2023-08-17T00:09:54.817722+0000","last_clean":"2023-08-17T00:09:54.817722+0000","last_became_active":"2023-08-17T00:09:54.384716+0000","last_became_peered":"2023-08-17T00:09:54.384716+0000","last_unstale":"2023-08-17T00:09:54.817722+0000","last_undegraded":"2023-08-17T00:09:54.817722+0000","last_fullsized":"2023-08-17T00:09:54.817722+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.827187+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:09:54.827187+0000","last_peered":"2023-08-17T00:09:54.827187+0000","last_clean":"2023-08-17T00:09:54.827187+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:09:54.827187+0000","last_undegraded":"2023-08-17T00:09:54.827187+0000","last_fullsized":"2023-08-17T00:09:54.827187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840066+0000","last_change":"2023-08-17T00:09:54.835472+0000","last_active":"2023-08-17T00:09:54.840066+0000","last_peered":"2023-08-17T00:09:54.840066+0000","last_clean":"2023-08-17T00:09:54.840066+0000","last_became_active":"2023-08-17T00:09:54.835159+0000","last_became_peered":"2023-08-17T00:09:54.835159+0000","last_unstale":"2023-08-17T00:09:54.840066+0000","last_undegraded":"2023-08-17T00:09:54.840066+0000","last_fullsized":"2023-08-17T00:09:54.840066+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845830+0000","last_change":"2023-08-17T00:09:54.391547+0000","last_active":"2023-08-17T00:09:54.845830+0000","last_peered":"2023-08-17T00:09:54.845830+0000","last_clean":"2023-08-17T00:09:54.845830+0000","last_became_active":"2023-08-17T00:09:54.390991+0000","last_became_peered":"2023-08-17T00:09:54.390991+0000","last_unstale":"2023-08-17T00:09:54.845830+0000","last_undegraded":"2023-08-17T00:09:54.845830+0000","last_fullsized":"2023-08-17T00:09:54.845830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.822544+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:09:54.822544+0000","last_peered":"2023-08-17T00:09:54.822544+0000","last_clean":"2023-08-17T00:09:54.822544+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:09:54.822544+0000","last_undegraded":"2023-08-17T00:09:54.822544+0000","last_fullsized":"2023-08-17T00:09:54.822544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.855479+0000","last_change":"2023-08-17T00:09:54.851117+0000","last_active":"2023-08-17T00:09:54.855479+0000","last_peered":"2023-08-17T00:09:54.855479+0000","last_clean":"2023-08-17T00:09:54.855479+0000","last_became_active":"2023-08-17T00:09:54.850766+0000","last_became_peered":"2023-08-17T00:09:54.850766+0000","last_unstale":"2023-08-17T00:09:54.855479+0000","last_undegraded":"2023-08-17T00:09:54.855479+0000","last_fullsized":"2023-08-17T00:09:54.855479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816861+0000","last_change":"2023-08-17T00:09:54.394102+0000","last_active":"2023-08-17T00:09:54.816861+0000","last_peered":"2023-08-17T00:09:54.816861+0000","last_clean":"2023-08-17T00:09:54.816861+0000","last_became_active":"2023-08-17T00:09:54.393821+0000","last_became_peered":"2023-08-17T00:09:54.393821+0000","last_unstale":"2023-08-17T00:09:54.816861+0000","last_undegraded":"2023-08-17T00:09:54.816861+0000","last_fullsized":"2023-08-17T00:09:54.816861+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825739+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:09:54.825739+0000","last_peered":"2023-08-17T00:09:54.825739+0000","last_clean":"2023-08-17T00:09:54.825739+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:09:54.825739+0000","last_undegraded":"2023-08-17T00:09:54.825739+0000","last_fullsized":"2023-08-17T00:09:54.825739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840314+0000","last_change":"2023-08-17T00:09:54.833976+0000","last_active":"2023-08-17T00:09:54.840314+0000","last_peered":"2023-08-17T00:09:54.840314+0000","last_clean":"2023-08-17T00:09:54.840314+0000","last_became_active":"2023-08-17T00:09:54.833731+0000","last_became_peered":"2023-08-17T00:09:54.833731+0000","last_unstale":"2023-08-17T00:09:54.840314+0000","last_undegraded":"2023-08-17T00:09:54.840314+0000","last_fullsized":"2023-08-17T00:09:54.840314+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848207+0000","last_change":"2023-08-17T00:09:54.395898+0000","last_active":"2023-08-17T00:09:54.848207+0000","last_peered":"2023-08-17T00:09:54.848207+0000","last_clean":"2023-08-17T00:09:54.848207+0000","last_became_active":"2023-08-17T00:09:54.395585+0000","last_became_peered":"2023-08-17T00:09:54.395585+0000","last_unstale":"2023-08-17T00:09:54.848207+0000","last_undegraded":"2023-08-17T00:09:54.848207+0000","last_fullsized":"2023-08-17T00:09:54.848207+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830757+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:09:54.830757+0000","last_peered":"2023-08-17T00:09:54.830757+0000","last_clean":"2023-08-17T00:09:54.830757+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:09:54.830757+0000","last_undegraded":"2023-08-17T00:09:54.830757+0000","last_fullsized":"2023-08-17T00:09:54.830757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.844720+0000","last_change":"2023-08-17T00:09:54.834413+0000","last_active":"2023-08-17T00:09:54.844720+0000","last_peered":"2023-08-17T00:09:54.844720+0000","last_clean":"2023-08-17T00:09:54.844720+0000","last_became_active":"2023-08-17T00:09:54.833665+0000","last_became_peered":"2023-08-17T00:09:54.833665+0000","last_unstale":"2023-08-17T00:09:54.844720+0000","last_undegraded":"2023-08-17T00:09:54.844720+0000","last_fullsized":"2023-08-17T00:09:54.844720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850410+0000","last_change":"2023-08-17T00:09:54.405929+0000","last_active":"2023-08-17T00:09:54.850410+0000","last_peered":"2023-08-17T00:09:54.850410+0000","last_clean":"2023-08-17T00:09:54.850410+0000","last_became_active":"2023-08-17T00:09:54.405668+0000","last_became_peered":"2023-08-17T00:09:54.405668+0000","last_unstale":"2023-08-17T00:09:54.850410+0000","last_undegraded":"2023-08-17T00:09:54.850410+0000","last_fullsized":"2023-08-17T00:09:54.850410+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.822128+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:09:54.822128+0000","last_peered":"2023-08-17T00:09:54.822128+0000","last_clean":"2023-08-17T00:09:54.822128+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:09:54.822128+0000","last_undegraded":"2023-08-17T00:09:54.822128+0000","last_fullsized":"2023-08-17T00:09:54.822128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.855486+0000","last_change":"2023-08-17T00:09:54.851463+0000","last_active":"2023-08-17T00:09:54.855486+0000","last_peered":"2023-08-17T00:09:54.855486+0000","last_clean":"2023-08-17T00:09:54.855486+0000","last_became_active":"2023-08-17T00:09:54.850766+0000","last_became_peered":"2023-08-17T00:09:54.850766+0000","last_unstale":"2023-08-17T00:09:54.855486+0000","last_undegraded":"2023-08-17T00:09:54.855486+0000","last_fullsized":"2023-08-17T00:09:54.855486+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831116+0000","last_change":"2023-08-17T00:09:54.393401+0000","last_active":"2023-08-17T00:09:54.831116+0000","last_peered":"2023-08-17T00:09:54.831116+0000","last_clean":"2023-08-17T00:09:54.831116+0000","last_became_active":"2023-08-17T00:09:54.392773+0000","last_became_peered":"2023-08-17T00:09:54.392773+0000","last_unstale":"2023-08-17T00:09:54.831116+0000","last_undegraded":"2023-08-17T00:09:54.831116+0000","last_fullsized":"2023-08-17T00:09:54.831116+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826107+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:09:54.826107+0000","last_peered":"2023-08-17T00:09:54.826107+0000","last_clean":"2023-08-17T00:09:54.826107+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:09:54.826107+0000","last_undegraded":"2023-08-17T00:09:54.826107+0000","last_fullsized":"2023-08-17T00:09:54.826107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825280+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:09:54.825280+0000","last_peered":"2023-08-17T00:09:54.825280+0000","last_clean":"2023-08-17T00:09:54.825280+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:09:54.825280+0000","last_undegraded":"2023-08-17T00:09:54.825280+0000","last_fullsized":"2023-08-17T00:09:54.825280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1208320,"data_stored":556513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.032,"15min":1.3089999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.532,"5min":1.909,"15min":8.7769999999999992},"last":1.093},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0600000000000001,"15min":1.357},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":9.6530000000000005},"last":1.29}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.109,"15min":1.3799999999999999},"min":{"1min":0.71899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5029999999999999,"5min":1.629,"15min":9.8800000000000008},"last":1.343},{"interface":"front","average":{"1min":1.129,"5min":1.0800000000000001,"15min":1.3620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.782,"5min":1.782,"15min":8.8399999999999999},"last":1.631}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.2529999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.359,"5min":1.4450000000000001,"15min":7.0190000000000001},"last":1.177},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1919999999999999,"15min":1.4159999999999999},"min":{"1min":0.86699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8009999999999999,"5min":1.8120000000000001,"15min":9.4239999999999995},"last":1.4119999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.101,"15min":1.2909999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3720000000000001,"5min":1.454,"15min":7.7080000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.258,"15min":1.625},"min":{"1min":1.02,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7110000000000001,"5min":1.958,"15min":13.074999999999999},"last":1.518}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1459999999999999,"15min":1.5860000000000001},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":13.784000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1699999999999999,"15min":1.4870000000000001},"min":{"1min":0.60599999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5860000000000001,"5min":1.764,"15min":10.045999999999999},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2689999999999999,"15min":1.72},"min":{"1min":0.92200000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.907,"5min":2.012,"15min":14.435},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.673},"min":{"1min":0.754,"5min":0.746,"15min":0.746},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":12.617000000000001},"last":1.044}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.321,"15min":1.6879999999999999},"min":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.833,"5min":1.833,"15min":11.279999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2689999999999999,"15min":1.6040000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5369999999999999,"5min":1.8200000000000001,"15min":11.365},"last":1.258}]}]},{"osd":6,"up_from":14,"seq":60129542233,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306604,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065236,"statfs":{"total":96636764160,"available":96322801664,"internally_reserved":0,"allocated":1216512,"data_stored":556319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.121,"15min":1.0720000000000001},"min":{"1min":0.76900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0909999999999993,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.998},{"interface":"front","average":{"1min":1.661,"5min":1.2330000000000001,"15min":1.1619999999999999},"min":{"1min":0.75,"5min":0.502,"15min":0.502},"max":{"1min":10.519,"5min":10.519,"15min":10.519},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.3,"15min":1.1459999999999999},"min":{"1min":0.61699999999999999,"5min":0.443,"15min":0.443},"max":{"1min":10.704000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1759999999999999,"15min":1.0309999999999999},"min":{"1min":0.58499999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.4460000000000002,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.177}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.177,"15min":1.177},"min":{"1min":0.64900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.4239999999999999,"15min":1.2989999999999999},"min":{"1min":0.872,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":10.669,"5min":10.669,"15min":10.669},"last":1.6379999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.258,"15min":1.1679999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.512,"5min":11.475,"15min":11.475},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.474,"5min":1.2529999999999999,"15min":1.268},"min":{"1min":0.93300000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":5.3330000000000002,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.371}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.4239999999999999,"15min":1.292},"min":{"1min":0.79700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":10.632,"5min":10.632,"15min":10.632},"last":1.54},{"interface":"front","average":{"1min":1.48,"5min":1.3819999999999999,"15min":1.2509999999999999},"min":{"1min":0.94199999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":5.8280000000000003,"5min":11.438000000000001,"15min":11.438000000000001},"last":1.458}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.2609999999999999,"15min":1.2709999999999999},"min":{"1min":0.90700000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.0759999999999996,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.494},{"interface":"front","average":{"1min":1.873,"5min":1.53,"15min":1.3759999999999999},"min":{"1min":0.88900000000000001,"5min":0.628,"15min":0.628},"max":{"1min":10.592000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.754}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.444,"15min":1.3420000000000001},"min":{"1min":1.0940000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.3450000000000002,"5min":11.51,"15min":11.51},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.3879999999999999,"15min":1.4259999999999999},"min":{"1min":1.075,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":5.4100000000000001,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.5900000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542234,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298400,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073440,"statfs":{"total":96636764160,"available":96331202560,"internally_reserved":0,"allocated":1204224,"data_stored":555621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98799999999999999,"15min":1.486},"min":{"1min":0.68999999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3919999999999999,"5min":1.516,"15min":15.007999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1,"15min":1.627},"min":{"1min":0.629,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.742,"15min":16.838999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0429999999999999,"15min":1.155},"min":{"1min":0.73899999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.413,"5min":1.494,"15min":4.2270000000000003},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.0780000000000001,"15min":1.4219999999999999},"min":{"1min":0.70599999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.476,"5min":1.5,"15min":9.6579999999999995},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.123,"15min":1.6719999999999999},"min":{"1min":0.85099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":16.675000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.1240000000000001,"15min":1.5209999999999999},"min":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4930000000000001,"5min":1.5129999999999999,"15min":11.949},"last":1.24}]},{"osd":3,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.5669999999999999},"min":{"1min":0.93700000000000006,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.3480000000000001,"5min":1.988,"15min":13.125},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.163,"15min":1.4670000000000001},"min":{"1min":0.77900000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.631,"5min":1.6559999999999999,"15min":8.4809999999999999},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1399999999999999,"15min":1.718},"min":{"1min":0.78100000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.319,"5min":1.77,"15min":17.510000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2190000000000001,"15min":1.871},"min":{"1min":0.83499999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.444,"5min":1.74,"15min":19.591000000000001},"last":1.2829999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.23,"15min":1.821},"min":{"1min":0.70299999999999996,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.901,"5min":1.901,"15min":17.158000000000001},"last":1.137},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.228,"15min":1.8169999999999999},"min":{"1min":0.79500000000000004,"5min":0.65800000000000003,"15min":0.64400000000000002},"max":{"1min":1.569,"5min":1.821,"15min":17.050000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.331,"15min":1.9430000000000001},"min":{"1min":0.88300000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.9610000000000001,"5min":2.2599999999999998,"15min":18.158000000000001},"last":1.226},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.361,"15min":1.8480000000000001},"min":{"1min":1.044,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":14.818},"last":1.3600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542233,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1216512,"data_stored":556307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3580000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.83699999999999997,"15min":0.81999999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0640000000000001,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.871},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84899999999999998,"15min":0.92000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.6299999999999999,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.7929999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.0489999999999999},"min":{"1min":0.51500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6890000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1879999999999999,"15min":1.2170000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.274,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.2250000000000001},"min":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.649,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.135}]},{"osd":5,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1719999999999999,"15min":1.2390000000000001},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.744,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.236},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2170000000000001,"15min":1.282},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.306}]},{"osd":6,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.179,"15min":1.2669999999999999},"min":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7589999999999999,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.379},{"interface":"front","average":{"1min":1.214,"5min":1.1699999999999999,"15min":1.2150000000000001},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0979999999999999,"5min":3.585,"15min":3.585},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.194,"15min":1.26},"min":{"1min":0.68300000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.165,"15min":1.2509999999999999},"min":{"1min":0.72899999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1919999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542233,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1208320,"data_stored":556127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.69399999999999995,"15min":0.86499999999999999},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":1.3029999999999999,"15min":3.1099999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.74099999999999999,"15min":1.01},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0529999999999999,"5min":1.827,"15min":6.4859999999999998},"last":1.075}]},{"osd":1,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77300000000000002,"15min":0.92300000000000004},"min":{"1min":0.45400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":1.7989999999999999,"15min":3.7589999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.91300000000000003,"15min":1.0920000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89400000000000002,"5min":1.9159999999999999,"15min":3.911},"last":1.254}]},{"osd":3,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.91000000000000003,"15min":1.212},"min":{"1min":0.56799999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.008,"5min":1.9530000000000001,"15min":5.4059999999999997},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.85899999999999999,"15min":1.0229999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97699999999999998,"5min":3.2530000000000001,"15min":3.3410000000000002},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.8120000000000001},"min":{"1min":0.73499999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.337,"5min":4.2770000000000001,"15min":16.521000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.026,"5min":1.147,"15min":1.5980000000000001},"min":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.423,"5min":2.0649999999999999,"15min":8.4399999999999995},"last":1.456}]},{"osd":5,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.236,"15min":1.74},"min":{"1min":0.68799999999999994,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":2.1440000000000001,"15min":12.914},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1679999999999999,"15min":1.5369999999999999},"min":{"1min":0.79200000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.456,"5min":1.6719999999999999,"15min":9.5519999999999996},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1699999999999999,"15min":1.704},"min":{"1min":0.69899999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5580000000000001,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.22,"15min":1.744},"min":{"1min":0.86399999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.377,"5min":2.2210000000000001,"15min":12.698},"last":1.6879999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2490000000000001,"15min":1.6910000000000001},"min":{"1min":0.748,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4039999999999999,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.417},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2589999999999999,"15min":1.7030000000000001},"min":{"1min":0.86799999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.367}]}]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310564,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061276,"statfs":{"total":96636764160,"available":96318746624,"internally_reserved":0,"allocated":1208320,"data_stored":556139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1619999999999999,"5min":1.4810000000000001,"15min":6.4329999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85599999999999998,"15min":0.91000000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.367,"5min":1.6379999999999999,"15min":13.093},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76000000000000001,"15min":0.81899999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.167,"5min":1.452,"15min":5.4989999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.89900000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":7.0620000000000003},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.61199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.4319999999999999,"5min":1.5920000000000001,"15min":8.8279999999999994},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84899999999999998,"15min":0.98599999999999999},"min":{"1min":0.54600000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1379999999999999,"5min":1.327,"15min":12.981999999999999},"last":0.876}]},{"osd":4,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0629999999999999,"15min":1.1759999999999999},"min":{"1min":0.82699999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.375,"5min":1.4570000000000001,"15min":20.548999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1459999999999999,"15min":1.23},"min":{"1min":0.77000000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3759999999999999,"5min":1.6020000000000001,"15min":8.8670000000000009},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.198,"15min":1.347},"min":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4710000000000001,"5min":1.8540000000000001,"15min":13.170999999999999},"last":1.236},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2030000000000001,"15min":1.278},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.76400000000000001},"max":{"1min":1.4530000000000001,"5min":1.9990000000000001,"15min":5.4240000000000004},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.157,"15min":1.268},"min":{"1min":0.748,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.472,"5min":1.722,"15min":13.050000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1659999999999999,"15min":1.216},"min":{"1min":0.78500000000000003,"5min":0.77900000000000003,"15min":0.77800000000000002},"max":{"1min":1.5760000000000001,"5min":1.7829999999999999,"15min":5.5359999999999996},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.23,"15min":1.3240000000000001},"min":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5009999999999999,"5min":1.615,"15min":6.9779999999999998},"last":1.071},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.214,"15min":1.3660000000000001},"min":{"1min":0.876,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.619,"5min":1.77,"15min":13.131},"last":1.127}]}]},{"osd":0,"up_from":14,"seq":60129542234,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1204224,"data_stored":556443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.438,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1479999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.501,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.244,"5min":1.4159999999999999,"15min":1.423},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.242,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.63600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2050000000000001,"5min":2.133,"15min":2.133},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.85999999999999999},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4350000000000001,"5min":1.613,"15min":1.613},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.94799999999999995,"15min":1.016},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2669999999999999,"5min":1.72,"15min":1.72},"last":1.0549999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.73099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.431,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.331},{"interface":"front","average":{"1min":1.27,"5min":1.1739999999999999,"15min":1.2010000000000001},"min":{"1min":0.96599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5329999999999999,"5min":1.982,"15min":1.982},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1890000000000001,"15min":1.266},"min":{"1min":0.80400000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7809999999999999,"5min":1.849,"15min":1.849},"last":1.393},{"interface":"front","average":{"1min":1.272,"5min":1.1899999999999999,"15min":1.2789999999999999},"min":{"1min":0.88,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.7629999999999999},"last":1.5660000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.196,"15min":1.278},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.593,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.179,"15min":1.2549999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.72},"last":1.2}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.1970000000000001,"15min":1.268},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.585,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.179,"15min":1.2529999999999999},"min":{"1min":0.90600000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5600000000000001,"5min":1.804,"15min":2.0750000000000002},"last":1.5049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1200128,"data_stored":555551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.145,"15min":1.1120000000000001},"min":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.38300000000000001},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.26},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.1020000000000001,"15min":1.0860000000000001},"min":{"1min":0.81000000000000005,"5min":0.41999999999999998,"15min":0.40100000000000002},"max":{"1min":7.7380000000000004,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.381,"15min":1.256},"min":{"1min":0.65100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7.0469999999999997,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.292,"15min":1.2789999999999999},"min":{"1min":0.86399999999999999,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":6.9000000000000004,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.212}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.458,"15min":1.2589999999999999},"min":{"1min":0.71399999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.6500000000000004,"5min":18.431000000000001,"15min":18.431000000000001},"last":0.995},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.6950000000000001,"15min":1.365},"min":{"1min":0.88500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.738,"5min":36.531999999999996,"15min":36.531999999999996},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.115,"15min":1.1539999999999999},"min":{"1min":0.84499999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.512,"5min":2.722,"15min":2.722},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.7450000000000001,"15min":1.4339999999999999},"min":{"1min":0.75700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.6920000000000002,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3300000000000001,"15min":1.2689999999999999},"min":{"1min":0.81999999999999995,"5min":0.433,"15min":0.433},"max":{"1min":5.2720000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.379,"15min":1.323},"min":{"1min":0.88800000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":5.4569999999999999,"5min":9.4120000000000008,"15min":9.4120000000000008},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.4059999999999999,"15min":1.389},"min":{"1min":0.80800000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.9320000000000004,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.107},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.377,"15min":1.4490000000000001},"min":{"1min":1.0009999999999999,"5min":0.82099999999999995,"15min":0.57799999999999996},"max":{"1min":2.5619999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.228,"15min":1.3129999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.175},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.458,"15min":1.46},"min":{"1min":0.85499999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":6.7430000000000003,"5min":8.327,"15min":8.327},"last":1.494}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:09:59.436 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:09:59.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.620+0000 7f9adc3a9700 1 Processor -- start 2023-08-17T00:09:59.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9adc3a9700 1 -- start start 2023-08-17T00:09:59.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9adc3a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ad40a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9adc3a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad4065240 con 0x7f9ad40a8b70 2023-08-17T00:09:59.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9adc3a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad4062e40 con 0x7f9ad40629b0 2023-08-17T00:09:59.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9adc3a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40638a0 con 0x7f9ad40632e0 2023-08-17T00:09:59.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9ada145700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9ad40a8b70 0x7f9ad40656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41324/0 (socket says 172.21.15.153:41324) 2023-08-17T00:09:59.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9ada145700 1 -- 172.21.15.153:0/4022791453 learned_addr learned my addr 172.21.15.153:0/4022791453 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:09:59.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9ad9944700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ad40a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431475481 0 0) 0x7f9ad4065240 con 0x7f9ad40a8b70 2023-08-17T00:09:59.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.624+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac00033f0 con 0x7f9ad40a8b70 2023-08-17T00:09:59.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2315683800 0 0) 0x7f9ac00033f0 con 0x7f9ad40a8b70 2023-08-17T00:09:59.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 msgr2=0x7f9ad40a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ad40a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 >> v1:172.21.15.178:6789/0 conn(0x7f9ad40629b0 legacy=0x7f9ad40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4065de0 con 0x7f9ad40a8b70 2023-08-17T00:09:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f9ad0001470 con 0x7f9ad40a8b70 2023-08-17T00:09:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 >> v1:172.21.15.153:6789/0 conn(0x7f9ad40a8b70 legacy=0x7f9ad40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac0003910 0x7f9ac0003d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ac0004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0004b80 0x7f9ac0005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40638a0 con 0x7f9ac0004b80 2023-08-17T00:09:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac000b910 con 0x7f9ac0003910 2023-08-17T00:09:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac000bad0 con 0x7f9ad40632e0 2023-08-17T00:09:59.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ac0004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ada946700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0004b80 0x7f9ac0005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ada145700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac0003910 0x7f9ac0003d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 -- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac0003910 msgr2=0x7f9ac0003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac0003910 0x7f9ac0003d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 -- 172.21.15.153:0/4022791453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0004b80 msgr2=0x7f9ac0005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0004b80 0x7f9ac0005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 -- 172.21.15.153:0/4022791453 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac00033f0 con 0x7f9ad40632e0 2023-08-17T00:09:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ada145700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac0003910 0x7f9ac0003d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:09:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ada946700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0004b80 0x7f9ac0005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:09:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9944700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ac0004690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9ac4009a80 tx=0x7f9ac4009060).ready entity=mon.2 client_cookie=996889bad6b4e9f5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac4009430 con 0x7f9ad40632e0 2023-08-17T00:09:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400e640 con 0x7f9ad40632e0 2023-08-17T00:09:59.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ad9143700 1 -- 172.21.15.153:0/4022791453 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400e9c0 con 0x7f9ad40632e0 2023-08-17T00:09:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9adc3a9700 1 -- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 msgr2=0x7f9ac0004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/4022791453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad40632e0 0x7f9ac0004690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f9ac4009a80 tx=0x7f9ac4009060).stop 2023-08-17T00:09:59.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9ada946700 1 -- 172.21.15.153:0/4022791453 reap_dead start 2023-08-17T00:09:59.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9adc3a9700 1 -- 172.21.15.153:0/4022791453 shutdown_connections 2023-08-17T00:09:59.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9adc3a9700 1 -- 172.21.15.153:0/4022791453 >> 172.21.15.153:0/4022791453 conn(0x7f9ad40c7150 msgr2=0x7f9ad40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:59.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9adc3a9700 1 -- 172.21.15.153:0/4022791453 shutdown_connections 2023-08-17T00:09:59.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.628+0000 7f9adc3a9700 1 -- 172.21.15.153:0/4022791453 wait complete. 2023-08-17T00:09:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.632+0000 7f9adc3a9700 1 Processor -- start 2023-08-17T00:09:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.632+0000 7f9adc3a9700 1 -- start start 2023-08-17T00:09:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40632e0 0x7f9ad40a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad4159580 0x7f9ad4159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 0x7f9ad40c5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41691c0 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40c5730 con 0x7f9ad40632e0 2023-08-17T00:09:59.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad415a040 con 0x7f9ad4159580 2023-08-17T00:09:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 0x7f9ad40c5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 0x7f9ad40c5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60284/0 (socket says 172.21.15.153:60284) 2023-08-17T00:09:59.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 -- 172.21.15.153:0/1885073409 learned_addr learned my addr 172.21.15.153:0/1885073409 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ad9944700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad4159580 0x7f9ad4159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada145700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40632e0 0x7f9ad40a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 -- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad4159580 msgr2=0x7f9ad4159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad4159580 0x7f9ad4159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 -- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40632e0 msgr2=0x7f9ad40a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40632e0 0x7f9ad40a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 -- 172.21.15.153:0/1885073409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4168890 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9ada946700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 0x7f9ad40c5240 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f9ad406bc20 tx=0x7f9acc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc00eee0 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc002490 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4168b70 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc002870 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.636+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad415b930 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.640+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad4169370 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.640+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9acc002ca0 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.640+0000 7f9aca7fc700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:09:59.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.640+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9acc073e80 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.644+0000 7f9ada145700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:09:59.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.644+0000 7f9ada145700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f9ad0000e10 tx=0x7f9ad0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:09:59.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.648+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ad4169370 con 0x7f9ad40c4dc0 2023-08-17T00:09:59.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.808+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ad4169370 con 0x7f9ab805a180 2023-08-17T00:09:59.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.824+0000 7f9aca7fc700 1 -- 172.21.15.153:0/1885073409 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359062 (secure 0 0 0) 0x7f9ad4169370 con 0x7f9ab805a180 2023-08-17T00:09:59.837 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:09:59.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 msgr2=0x7f9ab805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f9ad0000e10 tx=0x7f9ad0009040).stop 2023-08-17T00:09:59.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 msgr2=0x7f9ad40c5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:09:59.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 0x7f9ad40c5240 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f9ad406bc20 tx=0x7f9acc009040).stop 2023-08-17T00:09:59.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 shutdown_connections 2023-08-17T00:09:59.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ab805a180 0x7f9ab805c640 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ad40c4dc0 0x7f9ad40c5240 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad4159580 0x7f9ad4159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 --2- 172.21.15.153:0/1885073409 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad40632e0 0x7f9ad40a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:09:59.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 >> 172.21.15.153:0/1885073409 conn(0x7f9ad40c7150 msgr2=0x7f9ad4062250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:09:59.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 shutdown_connections 2023-08-17T00:09:59.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:09:59.836+0000 7f9adc3a9700 1 -- 172.21.15.153:0/1885073409 wait complete. 2023-08-17T00:09:59.843 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:09:59.861 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2023-08-17T00:09:59.332702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428064,"kb_used_data":9440,"kb_used_omap":0,"kb_used_meta":2418560,"kb_avail":752546656,"statfs":{"total":773094113280,"available":770607775744,"internally_reserved":0,"allocated":9666560,"data_stored":4449020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476605440},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3009352,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-1524,"num_read_kb":-1828,"num_write":-20269,"num_write_kb":-95111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-2,"num_bytes_recovered":-4194304,"num_keys_recovered":-10,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.974794"},"pg_stats":[{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852137+0000","last_change":"2023-08-17T00:09:54.847195+0000","last_active":"2023-08-17T00:09:54.852137+0000","last_peered":"2023-08-17T00:09:54.852137+0000","last_clean":"2023-08-17T00:09:54.852137+0000","last_became_active":"2023-08-17T00:09:54.846919+0000","last_became_peered":"2023-08-17T00:09:54.846919+0000","last_unstale":"2023-08-17T00:09:54.852137+0000","last_undegraded":"2023-08-17T00:09:54.852137+0000","last_fullsized":"2023-08-17T00:09:54.852137+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3f","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847357+0000","last_change":"2023-08-17T00:09:54.402917+0000","last_active":"2023-08-17T00:09:54.847357+0000","last_peered":"2023-08-17T00:09:54.847357+0000","last_clean":"2023-08-17T00:09:54.847357+0000","last_became_active":"2023-08-17T00:09:54.402650+0000","last_became_peered":"2023-08-17T00:09:54.402650+0000","last_unstale":"2023-08-17T00:09:54.847357+0000","last_undegraded":"2023-08-17T00:09:54.847357+0000","last_fullsized":"2023-08-17T00:09:54.847357+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848984+0000","last_change":"2023-08-17T00:09:54.841848+0000","last_active":"2023-08-17T00:09:54.848984+0000","last_peered":"2023-08-17T00:09:54.848984+0000","last_clean":"2023-08-17T00:09:54.848984+0000","last_became_active":"2023-08-17T00:09:54.841582+0000","last_became_peered":"2023-08-17T00:09:54.841582+0000","last_unstale":"2023-08-17T00:09:54.848984+0000","last_undegraded":"2023-08-17T00:09:54.848984+0000","last_fullsized":"2023-08-17T00:09:54.848984+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817888+0000","last_change":"2023-08-17T00:09:54.390612+0000","last_active":"2023-08-17T00:09:54.817888+0000","last_peered":"2023-08-17T00:09:54.817888+0000","last_clean":"2023-08-17T00:09:54.817888+0000","last_became_active":"2023-08-17T00:09:54.390320+0000","last_became_peered":"2023-08-17T00:09:54.390320+0000","last_unstale":"2023-08-17T00:09:54.817888+0000","last_undegraded":"2023-08-17T00:09:54.817888+0000","last_fullsized":"2023-08-17T00:09:54.817888+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847685+0000","last_change":"2023-08-17T00:09:54.845239+0000","last_active":"2023-08-17T00:09:54.847685+0000","last_peered":"2023-08-17T00:09:54.847685+0000","last_clean":"2023-08-17T00:09:54.847685+0000","last_became_active":"2023-08-17T00:09:54.844895+0000","last_became_peered":"2023-08-17T00:09:54.844895+0000","last_unstale":"2023-08-17T00:09:54.847685+0000","last_undegraded":"2023-08-17T00:09:54.847685+0000","last_fullsized":"2023-08-17T00:09:54.847685+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829383+0000","last_change":"2023-08-17T00:09:54.407465+0000","last_active":"2023-08-17T00:09:54.829383+0000","last_peered":"2023-08-17T00:09:54.829383+0000","last_clean":"2023-08-17T00:09:54.829383+0000","last_became_active":"2023-08-17T00:09:54.407184+0000","last_became_peered":"2023-08-17T00:09:54.407184+0000","last_unstale":"2023-08-17T00:09:54.829383+0000","last_undegraded":"2023-08-17T00:09:54.829383+0000","last_fullsized":"2023-08-17T00:09:54.829383+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842148+0000","last_change":"2023-08-17T00:09:54.839541+0000","last_active":"2023-08-17T00:09:54.842148+0000","last_peered":"2023-08-17T00:09:54.842148+0000","last_clean":"2023-08-17T00:09:54.842148+0000","last_became_active":"2023-08-17T00:09:54.839264+0000","last_became_peered":"2023-08-17T00:09:54.839264+0000","last_unstale":"2023-08-17T00:09:54.842148+0000","last_undegraded":"2023-08-17T00:09:54.842148+0000","last_fullsized":"2023-08-17T00:09:54.842148+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3c","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.851368+0000","last_change":"2023-08-17T00:09:54.380974+0000","last_active":"2023-08-17T00:09:54.851368+0000","last_peered":"2023-08-17T00:09:54.851368+0000","last_clean":"2023-08-17T00:09:54.851368+0000","last_became_active":"2023-08-17T00:09:54.380496+0000","last_became_peered":"2023-08-17T00:09:54.380496+0000","last_unstale":"2023-08-17T00:09:54.851368+0000","last_undegraded":"2023-08-17T00:09:54.851368+0000","last_fullsized":"2023-08-17T00:09:54.851368+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839969+0000","last_change":"2023-08-17T00:09:54.828775+0000","last_active":"2023-08-17T00:09:54.839969+0000","last_peered":"2023-08-17T00:09:54.839969+0000","last_clean":"2023-08-17T00:09:54.839969+0000","last_became_active":"2023-08-17T00:09:54.828456+0000","last_became_peered":"2023-08-17T00:09:54.828456+0000","last_unstale":"2023-08-17T00:09:54.839969+0000","last_undegraded":"2023-08-17T00:09:54.839969+0000","last_fullsized":"2023-08-17T00:09:54.839969+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.853140+0000","last_change":"2023-08-17T00:09:54.401163+0000","last_active":"2023-08-17T00:09:54.853140+0000","last_peered":"2023-08-17T00:09:54.853140+0000","last_clean":"2023-08-17T00:09:54.853140+0000","last_became_active":"2023-08-17T00:09:54.400838+0000","last_became_peered":"2023-08-17T00:09:54.400838+0000","last_unstale":"2023-08-17T00:09:54.853140+0000","last_undegraded":"2023-08-17T00:09:54.853140+0000","last_fullsized":"2023-08-17T00:09:54.853140+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849576+0000","last_change":"2023-08-17T00:09:54.843142+0000","last_active":"2023-08-17T00:09:54.849576+0000","last_peered":"2023-08-17T00:09:54.849576+0000","last_clean":"2023-08-17T00:09:54.849576+0000","last_became_active":"2023-08-17T00:09:54.841781+0000","last_became_peered":"2023-08-17T00:09:54.841781+0000","last_unstale":"2023-08-17T00:09:54.849576+0000","last_undegraded":"2023-08-17T00:09:54.849576+0000","last_fullsized":"2023-08-17T00:09:54.849576+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.854022+0000","last_change":"2023-08-17T00:09:54.399349+0000","last_active":"2023-08-17T00:09:54.854022+0000","last_peered":"2023-08-17T00:09:54.854022+0000","last_clean":"2023-08-17T00:09:54.854022+0000","last_became_active":"2023-08-17T00:09:54.399045+0000","last_became_peered":"2023-08-17T00:09:54.399045+0000","last_unstale":"2023-08-17T00:09:54.854022+0000","last_undegraded":"2023-08-17T00:09:54.854022+0000","last_fullsized":"2023-08-17T00:09:54.854022+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840841+0000","last_change":"2023-08-17T00:09:54.829874+0000","last_active":"2023-08-17T00:09:54.840841+0000","last_peered":"2023-08-17T00:09:54.840841+0000","last_clean":"2023-08-17T00:09:54.840841+0000","last_became_active":"2023-08-17T00:09:54.829577+0000","last_became_peered":"2023-08-17T00:09:54.829577+0000","last_unstale":"2023-08-17T00:09:54.840841+0000","last_undegraded":"2023-08-17T00:09:54.840841+0000","last_fullsized":"2023-08-17T00:09:54.840841+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817444+0000","last_change":"2023-08-17T00:09:54.387051+0000","last_active":"2023-08-17T00:09:54.817444+0000","last_peered":"2023-08-17T00:09:54.817444+0000","last_clean":"2023-08-17T00:09:54.817444+0000","last_became_active":"2023-08-17T00:09:54.386794+0000","last_became_peered":"2023-08-17T00:09:54.386794+0000","last_unstale":"2023-08-17T00:09:54.817444+0000","last_undegraded":"2023-08-17T00:09:54.817444+0000","last_fullsized":"2023-08-17T00:09:54.817444+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846005+0000","last_change":"2023-08-17T00:09:54.832246+0000","last_active":"2023-08-17T00:09:54.846005+0000","last_peered":"2023-08-17T00:09:54.846005+0000","last_clean":"2023-08-17T00:09:54.846005+0000","last_became_active":"2023-08-17T00:09:54.831745+0000","last_became_peered":"2023-08-17T00:09:54.831745+0000","last_unstale":"2023-08-17T00:09:54.846005+0000","last_undegraded":"2023-08-17T00:09:54.846005+0000","last_fullsized":"2023-08-17T00:09:54.846005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816479+0000","last_change":"2023-08-17T00:09:54.389457+0000","last_active":"2023-08-17T00:09:54.816479+0000","last_peered":"2023-08-17T00:09:54.816479+0000","last_clean":"2023-08-17T00:09:54.816479+0000","last_became_active":"2023-08-17T00:09:54.389165+0000","last_became_peered":"2023-08-17T00:09:54.389165+0000","last_unstale":"2023-08-17T00:09:54.816479+0000","last_undegraded":"2023-08-17T00:09:54.816479+0000","last_fullsized":"2023-08-17T00:09:54.816479+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.853170+0000","last_change":"2023-08-17T00:09:54.852000+0000","last_active":"2023-08-17T00:09:54.853170+0000","last_peered":"2023-08-17T00:09:54.853170+0000","last_clean":"2023-08-17T00:09:54.853170+0000","last_became_active":"2023-08-17T00:09:54.851686+0000","last_became_peered":"2023-08-17T00:09:54.851686+0000","last_unstale":"2023-08-17T00:09:54.853170+0000","last_undegraded":"2023-08-17T00:09:54.853170+0000","last_fullsized":"2023-08-17T00:09:54.853170+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825890+0000","last_change":"2023-08-17T00:09:54.398500+0000","last_active":"2023-08-17T00:09:54.825890+0000","last_peered":"2023-08-17T00:09:54.825890+0000","last_clean":"2023-08-17T00:09:54.825890+0000","last_became_active":"2023-08-17T00:09:54.398185+0000","last_became_peered":"2023-08-17T00:09:54.398185+0000","last_unstale":"2023-08-17T00:09:54.825890+0000","last_undegraded":"2023-08-17T00:09:54.825890+0000","last_fullsized":"2023-08-17T00:09:54.825890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.835348+0000","last_change":"2023-08-17T00:09:54.833030+0000","last_active":"2023-08-17T00:09:54.835348+0000","last_peered":"2023-08-17T00:09:54.835348+0000","last_clean":"2023-08-17T00:09:54.835348+0000","last_became_active":"2023-08-17T00:09:54.832776+0000","last_became_peered":"2023-08-17T00:09:54.832776+0000","last_unstale":"2023-08-17T00:09:54.835348+0000","last_undegraded":"2023-08-17T00:09:54.835348+0000","last_fullsized":"2023-08-17T00:09:54.835348+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828982+0000","last_change":"2023-08-17T00:09:54.394408+0000","last_active":"2023-08-17T00:09:54.828982+0000","last_peered":"2023-08-17T00:09:54.828982+0000","last_clean":"2023-08-17T00:09:54.828982+0000","last_became_active":"2023-08-17T00:09:54.394112+0000","last_became_peered":"2023-08-17T00:09:54.394112+0000","last_unstale":"2023-08-17T00:09:54.828982+0000","last_undegraded":"2023-08-17T00:09:54.828982+0000","last_fullsized":"2023-08-17T00:09:54.828982+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852732+0000","last_change":"2023-08-17T00:09:54.850018+0000","last_active":"2023-08-17T00:09:54.852732+0000","last_peered":"2023-08-17T00:09:54.852732+0000","last_clean":"2023-08-17T00:09:54.852732+0000","last_became_active":"2023-08-17T00:09:54.849735+0000","last_became_peered":"2023-08-17T00:09:54.849735+0000","last_unstale":"2023-08-17T00:09:54.852732+0000","last_undegraded":"2023-08-17T00:09:54.852732+0000","last_fullsized":"2023-08-17T00:09:54.852732+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831477+0000","last_change":"2023-08-17T00:09:54.389242+0000","last_active":"2023-08-17T00:09:54.831477+0000","last_peered":"2023-08-17T00:09:54.831477+0000","last_clean":"2023-08-17T00:09:54.831477+0000","last_became_active":"2023-08-17T00:09:54.388944+0000","last_became_peered":"2023-08-17T00:09:54.388944+0000","last_unstale":"2023-08-17T00:09:54.831477+0000","last_undegraded":"2023-08-17T00:09:54.831477+0000","last_fullsized":"2023-08-17T00:09:54.831477+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.837266+0000","last_change":"2023-08-17T00:09:54.832851+0000","last_active":"2023-08-17T00:09:54.837266+0000","last_peered":"2023-08-17T00:09:54.837266+0000","last_clean":"2023-08-17T00:09:54.837266+0000","last_became_active":"2023-08-17T00:09:54.832402+0000","last_became_peered":"2023-08-17T00:09:54.832402+0000","last_unstale":"2023-08-17T00:09:54.837266+0000","last_undegraded":"2023-08-17T00:09:54.837266+0000","last_fullsized":"2023-08-17T00:09:54.837266+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.34","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.856400+0000","last_change":"2023-08-17T00:09:54.399040+0000","last_active":"2023-08-17T00:09:54.856400+0000","last_peered":"2023-08-17T00:09:54.856400+0000","last_clean":"2023-08-17T00:09:54.856400+0000","last_became_active":"2023-08-17T00:09:54.398761+0000","last_became_peered":"2023-08-17T00:09:54.398761+0000","last_unstale":"2023-08-17T00:09:54.856400+0000","last_undegraded":"2023-08-17T00:09:54.856400+0000","last_fullsized":"2023-08-17T00:09:54.856400+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846414+0000","last_change":"2023-08-17T00:09:54.840169+0000","last_active":"2023-08-17T00:09:54.846414+0000","last_peered":"2023-08-17T00:09:54.846414+0000","last_clean":"2023-08-17T00:09:54.846414+0000","last_became_active":"2023-08-17T00:09:54.839770+0000","last_became_peered":"2023-08-17T00:09:54.839770+0000","last_unstale":"2023-08-17T00:09:54.846414+0000","last_undegraded":"2023-08-17T00:09:54.846414+0000","last_fullsized":"2023-08-17T00:09:54.846414+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.33","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846792+0000","last_change":"2023-08-17T00:09:54.390923+0000","last_active":"2023-08-17T00:09:54.846792+0000","last_peered":"2023-08-17T00:09:54.846792+0000","last_clean":"2023-08-17T00:09:54.846792+0000","last_became_active":"2023-08-17T00:09:54.390646+0000","last_became_peered":"2023-08-17T00:09:54.390646+0000","last_unstale":"2023-08-17T00:09:54.846792+0000","last_undegraded":"2023-08-17T00:09:54.846792+0000","last_fullsized":"2023-08-17T00:09:54.846792+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852047+0000","last_change":"2023-08-17T00:09:54.848475+0000","last_active":"2023-08-17T00:09:54.852047+0000","last_peered":"2023-08-17T00:09:54.852047+0000","last_clean":"2023-08-17T00:09:54.852047+0000","last_became_active":"2023-08-17T00:09:54.848195+0000","last_became_peered":"2023-08-17T00:09:54.848195+0000","last_unstale":"2023-08-17T00:09:54.852047+0000","last_undegraded":"2023-08-17T00:09:54.852047+0000","last_fullsized":"2023-08-17T00:09:54.852047+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.834877+0000","last_change":"2023-08-17T00:09:54.401227+0000","last_active":"2023-08-17T00:09:54.834877+0000","last_peered":"2023-08-17T00:09:54.834877+0000","last_clean":"2023-08-17T00:09:54.834877+0000","last_became_active":"2023-08-17T00:09:54.400888+0000","last_became_peered":"2023-08-17T00:09:54.400888+0000","last_unstale":"2023-08-17T00:09:54.834877+0000","last_undegraded":"2023-08-17T00:09:54.834877+0000","last_fullsized":"2023-08-17T00:09:54.834877+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845609+0000","last_change":"2023-08-17T00:09:54.842647+0000","last_active":"2023-08-17T00:09:54.845609+0000","last_peered":"2023-08-17T00:09:54.845609+0000","last_clean":"2023-08-17T00:09:54.845609+0000","last_became_active":"2023-08-17T00:09:54.842336+0000","last_became_peered":"2023-08-17T00:09:54.842336+0000","last_unstale":"2023-08-17T00:09:54.845609+0000","last_undegraded":"2023-08-17T00:09:54.845609+0000","last_fullsized":"2023-08-17T00:09:54.845609+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817609+0000","last_change":"2023-08-17T00:09:54.392146+0000","last_active":"2023-08-17T00:09:54.817609+0000","last_peered":"2023-08-17T00:09:54.817609+0000","last_clean":"2023-08-17T00:09:54.817609+0000","last_became_active":"2023-08-17T00:09:54.391791+0000","last_became_peered":"2023-08-17T00:09:54.391791+0000","last_unstale":"2023-08-17T00:09:54.817609+0000","last_undegraded":"2023-08-17T00:09:54.817609+0000","last_fullsized":"2023-08-17T00:09:54.817609+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843693+0000","last_change":"2023-08-17T00:09:54.833012+0000","last_active":"2023-08-17T00:09:54.843693+0000","last_peered":"2023-08-17T00:09:54.843693+0000","last_clean":"2023-08-17T00:09:54.843693+0000","last_became_active":"2023-08-17T00:09:54.832507+0000","last_became_peered":"2023-08-17T00:09:54.832507+0000","last_unstale":"2023-08-17T00:09:54.843693+0000","last_undegraded":"2023-08-17T00:09:54.843693+0000","last_fullsized":"2023-08-17T00:09:54.843693+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.30","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850424+0000","last_change":"2023-08-17T00:09:54.397699+0000","last_active":"2023-08-17T00:09:54.850424+0000","last_peered":"2023-08-17T00:09:54.850424+0000","last_clean":"2023-08-17T00:09:54.850424+0000","last_became_active":"2023-08-17T00:09:54.397337+0000","last_became_peered":"2023-08-17T00:09:54.397337+0000","last_unstale":"2023-08-17T00:09:54.850424+0000","last_undegraded":"2023-08-17T00:09:54.850424+0000","last_fullsized":"2023-08-17T00:09:54.850424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847493+0000","last_change":"2023-08-17T00:09:54.843674+0000","last_active":"2023-08-17T00:09:54.847493+0000","last_peered":"2023-08-17T00:09:54.847493+0000","last_clean":"2023-08-17T00:09:54.847493+0000","last_became_active":"2023-08-17T00:09:54.843379+0000","last_became_peered":"2023-08-17T00:09:54.843379+0000","last_unstale":"2023-08-17T00:09:54.847493+0000","last_undegraded":"2023-08-17T00:09:54.847493+0000","last_fullsized":"2023-08-17T00:09:54.847493+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817334+0000","last_change":"2023-08-17T00:09:54.396230+0000","last_active":"2023-08-17T00:09:54.817334+0000","last_peered":"2023-08-17T00:09:54.817334+0000","last_clean":"2023-08-17T00:09:54.817334+0000","last_became_active":"2023-08-17T00:09:54.395950+0000","last_became_peered":"2023-08-17T00:09:54.395950+0000","last_unstale":"2023-08-17T00:09:54.817334+0000","last_undegraded":"2023-08-17T00:09:54.817334+0000","last_fullsized":"2023-08-17T00:09:54.817334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847425+0000","last_change":"2023-08-17T00:09:54.843921+0000","last_active":"2023-08-17T00:09:54.847425+0000","last_peered":"2023-08-17T00:09:54.847425+0000","last_clean":"2023-08-17T00:09:54.847425+0000","last_became_active":"2023-08-17T00:09:54.843655+0000","last_became_peered":"2023-08-17T00:09:54.843655+0000","last_unstale":"2023-08-17T00:09:54.847425+0000","last_undegraded":"2023-08-17T00:09:54.847425+0000","last_fullsized":"2023-08-17T00:09:54.847425+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831662+0000","last_change":"2023-08-17T00:09:54.389595+0000","last_active":"2023-08-17T00:09:54.831662+0000","last_peered":"2023-08-17T00:09:54.831662+0000","last_clean":"2023-08-17T00:09:54.831662+0000","last_became_active":"2023-08-17T00:09:54.389337+0000","last_became_peered":"2023-08-17T00:09:54.389337+0000","last_unstale":"2023-08-17T00:09:54.831662+0000","last_undegraded":"2023-08-17T00:09:54.831662+0000","last_fullsized":"2023-08-17T00:09:54.831662+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.851816+0000","last_change":"2023-08-17T00:09:54.845411+0000","last_active":"2023-08-17T00:09:54.851816+0000","last_peered":"2023-08-17T00:09:54.851816+0000","last_clean":"2023-08-17T00:09:54.851816+0000","last_became_active":"2023-08-17T00:09:54.845139+0000","last_became_peered":"2023-08-17T00:09:54.845139+0000","last_unstale":"2023-08-17T00:09:54.851816+0000","last_undegraded":"2023-08-17T00:09:54.851816+0000","last_fullsized":"2023-08-17T00:09:54.851816+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2d","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.851368+0000","last_change":"2023-08-17T00:09:54.401195+0000","last_active":"2023-08-17T00:09:54.851368+0000","last_peered":"2023-08-17T00:09:54.851368+0000","last_clean":"2023-08-17T00:09:54.851368+0000","last_became_active":"2023-08-17T00:09:54.400906+0000","last_became_peered":"2023-08-17T00:09:54.400906+0000","last_unstale":"2023-08-17T00:09:54.851368+0000","last_undegraded":"2023-08-17T00:09:54.851368+0000","last_fullsized":"2023-08-17T00:09:54.851368+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839960+0000","last_change":"2023-08-17T00:09:54.833365+0000","last_active":"2023-08-17T00:09:54.839960+0000","last_peered":"2023-08-17T00:09:54.839960+0000","last_clean":"2023-08-17T00:09:54.839960+0000","last_became_active":"2023-08-17T00:09:54.832995+0000","last_became_peered":"2023-08-17T00:09:54.832995+0000","last_unstale":"2023-08-17T00:09:54.839960+0000","last_undegraded":"2023-08-17T00:09:54.839960+0000","last_fullsized":"2023-08-17T00:09:54.839960+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829792+0000","last_change":"2023-08-17T00:09:54.400761+0000","last_active":"2023-08-17T00:09:54.829792+0000","last_peered":"2023-08-17T00:09:54.829792+0000","last_clean":"2023-08-17T00:09:54.829792+0000","last_became_active":"2023-08-17T00:09:54.400425+0000","last_became_peered":"2023-08-17T00:09:54.400425+0000","last_unstale":"2023-08-17T00:09:54.829792+0000","last_undegraded":"2023-08-17T00:09:54.829792+0000","last_fullsized":"2023-08-17T00:09:54.829792+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845462+0000","last_change":"2023-08-17T00:09:54.842779+0000","last_active":"2023-08-17T00:09:54.845462+0000","last_peered":"2023-08-17T00:09:54.845462+0000","last_clean":"2023-08-17T00:09:54.845462+0000","last_became_active":"2023-08-17T00:09:54.842441+0000","last_became_peered":"2023-08-17T00:09:54.842441+0000","last_unstale":"2023-08-17T00:09:54.845462+0000","last_undegraded":"2023-08-17T00:09:54.845462+0000","last_fullsized":"2023-08-17T00:09:54.845462+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850643+0000","last_change":"2023-08-17T00:09:54.387181+0000","last_active":"2023-08-17T00:09:54.850643+0000","last_peered":"2023-08-17T00:09:54.850643+0000","last_clean":"2023-08-17T00:09:54.850643+0000","last_became_active":"2023-08-17T00:09:54.386748+0000","last_became_peered":"2023-08-17T00:09:54.386748+0000","last_unstale":"2023-08-17T00:09:54.850643+0000","last_undegraded":"2023-08-17T00:09:54.850643+0000","last_fullsized":"2023-08-17T00:09:54.850643+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847172+0000","last_change":"2023-08-17T00:09:54.841866+0000","last_active":"2023-08-17T00:09:54.847172+0000","last_peered":"2023-08-17T00:09:54.847172+0000","last_clean":"2023-08-17T00:09:54.847172+0000","last_became_active":"2023-08-17T00:09:54.841612+0000","last_became_peered":"2023-08-17T00:09:54.841612+0000","last_unstale":"2023-08-17T00:09:54.847172+0000","last_undegraded":"2023-08-17T00:09:54.847172+0000","last_fullsized":"2023-08-17T00:09:54.847172+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.834974+0000","last_change":"2023-08-17T00:09:54.397711+0000","last_active":"2023-08-17T00:09:54.834974+0000","last_peered":"2023-08-17T00:09:54.834974+0000","last_clean":"2023-08-17T00:09:54.834974+0000","last_became_active":"2023-08-17T00:09:54.397432+0000","last_became_peered":"2023-08-17T00:09:54.397432+0000","last_unstale":"2023-08-17T00:09:54.834974+0000","last_undegraded":"2023-08-17T00:09:54.834974+0000","last_fullsized":"2023-08-17T00:09:54.834974+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846397+0000","last_change":"2023-08-17T00:09:54.843227+0000","last_active":"2023-08-17T00:09:54.846397+0000","last_peered":"2023-08-17T00:09:54.846397+0000","last_clean":"2023-08-17T00:09:54.846397+0000","last_became_active":"2023-08-17T00:09:54.842923+0000","last_became_peered":"2023-08-17T00:09:54.842923+0000","last_unstale":"2023-08-17T00:09:54.846397+0000","last_undegraded":"2023-08-17T00:09:54.846397+0000","last_fullsized":"2023-08-17T00:09:54.846397+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816741+0000","last_change":"2023-08-17T00:09:54.396904+0000","last_active":"2023-08-17T00:09:54.816741+0000","last_peered":"2023-08-17T00:09:54.816741+0000","last_clean":"2023-08-17T00:09:54.816741+0000","last_became_active":"2023-08-17T00:09:54.396644+0000","last_became_peered":"2023-08-17T00:09:54.396644+0000","last_unstale":"2023-08-17T00:09:54.816741+0000","last_undegraded":"2023-08-17T00:09:54.816741+0000","last_fullsized":"2023-08-17T00:09:54.816741+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845987+0000","last_change":"2023-08-17T00:09:54.832073+0000","last_active":"2023-08-17T00:09:54.845987+0000","last_peered":"2023-08-17T00:09:54.845987+0000","last_clean":"2023-08-17T00:09:54.845987+0000","last_became_active":"2023-08-17T00:09:54.831404+0000","last_became_peered":"2023-08-17T00:09:54.831404+0000","last_unstale":"2023-08-17T00:09:54.845987+0000","last_undegraded":"2023-08-17T00:09:54.845987+0000","last_fullsized":"2023-08-17T00:09:54.845987+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829745+0000","last_change":"2023-08-17T00:09:54.394618+0000","last_active":"2023-08-17T00:09:54.829745+0000","last_peered":"2023-08-17T00:09:54.829745+0000","last_clean":"2023-08-17T00:09:54.829745+0000","last_became_active":"2023-08-17T00:09:54.394358+0000","last_became_peered":"2023-08-17T00:09:54.394358+0000","last_unstale":"2023-08-17T00:09:54.829745+0000","last_undegraded":"2023-08-17T00:09:54.829745+0000","last_fullsized":"2023-08-17T00:09:54.829745+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.844739+0000","last_change":"2023-08-17T00:09:54.834612+0000","last_active":"2023-08-17T00:09:54.844739+0000","last_peered":"2023-08-17T00:09:54.844739+0000","last_clean":"2023-08-17T00:09:54.844739+0000","last_became_active":"2023-08-17T00:09:54.834049+0000","last_became_peered":"2023-08-17T00:09:54.834049+0000","last_unstale":"2023-08-17T00:09:54.844739+0000","last_undegraded":"2023-08-17T00:09:54.844739+0000","last_fullsized":"2023-08-17T00:09:54.844739+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831822+0000","last_change":"2023-08-17T00:09:54.403610+0000","last_active":"2023-08-17T00:09:54.831822+0000","last_peered":"2023-08-17T00:09:54.831822+0000","last_clean":"2023-08-17T00:09:54.831822+0000","last_became_active":"2023-08-17T00:09:54.403210+0000","last_became_peered":"2023-08-17T00:09:54.403210+0000","last_unstale":"2023-08-17T00:09:54.831822+0000","last_undegraded":"2023-08-17T00:09:54.831822+0000","last_fullsized":"2023-08-17T00:09:54.831822+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848966+0000","last_change":"2023-08-17T00:09:54.840117+0000","last_active":"2023-08-17T00:09:54.848966+0000","last_peered":"2023-08-17T00:09:54.848966+0000","last_clean":"2023-08-17T00:09:54.848966+0000","last_became_active":"2023-08-17T00:09:54.839837+0000","last_became_peered":"2023-08-17T00:09:54.839837+0000","last_unstale":"2023-08-17T00:09:54.848966+0000","last_undegraded":"2023-08-17T00:09:54.848966+0000","last_fullsized":"2023-08-17T00:09:54.848966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826605+0000","last_change":"2023-08-17T00:09:54.397242+0000","last_active":"2023-08-17T00:09:54.826605+0000","last_peered":"2023-08-17T00:09:54.826605+0000","last_clean":"2023-08-17T00:09:54.826605+0000","last_became_active":"2023-08-17T00:09:54.396977+0000","last_became_peered":"2023-08-17T00:09:54.396977+0000","last_unstale":"2023-08-17T00:09:54.826605+0000","last_undegraded":"2023-08-17T00:09:54.826605+0000","last_fullsized":"2023-08-17T00:09:54.826605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847667+0000","last_change":"2023-08-17T00:09:54.845150+0000","last_active":"2023-08-17T00:09:54.847667+0000","last_peered":"2023-08-17T00:09:54.847667+0000","last_clean":"2023-08-17T00:09:54.847667+0000","last_became_active":"2023-08-17T00:09:54.844269+0000","last_became_peered":"2023-08-17T00:09:54.844269+0000","last_unstale":"2023-08-17T00:09:54.847667+0000","last_undegraded":"2023-08-17T00:09:54.847667+0000","last_fullsized":"2023-08-17T00:09:54.847667+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.827099+0000","last_change":"2023-08-17T00:09:54.400336+0000","last_active":"2023-08-17T00:09:54.827099+0000","last_peered":"2023-08-17T00:09:54.827099+0000","last_clean":"2023-08-17T00:09:54.827099+0000","last_became_active":"2023-08-17T00:09:54.400065+0000","last_became_peered":"2023-08-17T00:09:54.400065+0000","last_unstale":"2023-08-17T00:09:54.827099+0000","last_undegraded":"2023-08-17T00:09:54.827099+0000","last_fullsized":"2023-08-17T00:09:54.827099+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842277+0000","last_change":"2023-08-17T00:09:54.834324+0000","last_active":"2023-08-17T00:09:54.842277+0000","last_peered":"2023-08-17T00:09:54.842277+0000","last_clean":"2023-08-17T00:09:54.842277+0000","last_became_active":"2023-08-17T00:09:54.834070+0000","last_became_peered":"2023-08-17T00:09:54.834070+0000","last_unstale":"2023-08-17T00:09:54.842277+0000","last_undegraded":"2023-08-17T00:09:54.842277+0000","last_fullsized":"2023-08-17T00:09:54.842277+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825246+0000","last_change":"2023-08-17T00:09:54.406664+0000","last_active":"2023-08-17T00:09:54.825246+0000","last_peered":"2023-08-17T00:09:54.825246+0000","last_clean":"2023-08-17T00:09:54.825246+0000","last_became_active":"2023-08-17T00:09:54.406382+0000","last_became_peered":"2023-08-17T00:09:54.406382+0000","last_unstale":"2023-08-17T00:09:54.825246+0000","last_undegraded":"2023-08-17T00:09:54.825246+0000","last_fullsized":"2023-08-17T00:09:54.825246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839989+0000","last_change":"2023-08-17T00:09:54.829214+0000","last_active":"2023-08-17T00:09:54.839989+0000","last_peered":"2023-08-17T00:09:54.839989+0000","last_clean":"2023-08-17T00:09:54.839989+0000","last_became_active":"2023-08-17T00:09:54.828889+0000","last_became_peered":"2023-08-17T00:09:54.828889+0000","last_unstale":"2023-08-17T00:09:54.839989+0000","last_undegraded":"2023-08-17T00:09:54.839989+0000","last_fullsized":"2023-08-17T00:09:54.839989+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.821198+0000","last_change":"2023-08-17T00:09:54.387005+0000","last_active":"2023-08-17T00:09:54.821198+0000","last_peered":"2023-08-17T00:09:54.821198+0000","last_clean":"2023-08-17T00:09:54.821198+0000","last_became_active":"2023-08-17T00:09:54.386410+0000","last_became_peered":"2023-08-17T00:09:54.386410+0000","last_unstale":"2023-08-17T00:09:54.821198+0000","last_undegraded":"2023-08-17T00:09:54.821198+0000","last_fullsized":"2023-08-17T00:09:54.821198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846291+0000","last_change":"2023-08-17T00:09:54.840225+0000","last_active":"2023-08-17T00:09:54.846291+0000","last_peered":"2023-08-17T00:09:54.846291+0000","last_clean":"2023-08-17T00:09:54.846291+0000","last_became_active":"2023-08-17T00:09:54.839976+0000","last_became_peered":"2023-08-17T00:09:54.839976+0000","last_unstale":"2023-08-17T00:09:54.846291+0000","last_undegraded":"2023-08-17T00:09:54.846291+0000","last_fullsized":"2023-08-17T00:09:54.846291+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.835087+0000","last_change":"2023-08-17T00:09:54.403433+0000","last_active":"2023-08-17T00:09:54.835087+0000","last_peered":"2023-08-17T00:09:54.835087+0000","last_clean":"2023-08-17T00:09:54.835087+0000","last_became_active":"2023-08-17T00:09:54.403167+0000","last_became_peered":"2023-08-17T00:09:54.403167+0000","last_unstale":"2023-08-17T00:09:54.835087+0000","last_undegraded":"2023-08-17T00:09:54.835087+0000","last_fullsized":"2023-08-17T00:09:54.835087+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842466+0000","last_change":"2023-08-17T00:09:54.832130+0000","last_active":"2023-08-17T00:09:54.842466+0000","last_peered":"2023-08-17T00:09:54.842466+0000","last_clean":"2023-08-17T00:09:54.842466+0000","last_became_active":"2023-08-17T00:09:54.831839+0000","last_became_peered":"2023-08-17T00:09:54.831839+0000","last_unstale":"2023-08-17T00:09:54.842466+0000","last_undegraded":"2023-08-17T00:09:54.842466+0000","last_fullsized":"2023-08-17T00:09:54.842466+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828750+0000","last_change":"2023-08-17T00:09:54.404071+0000","last_active":"2023-08-17T00:09:54.828750+0000","last_peered":"2023-08-17T00:09:54.828750+0000","last_clean":"2023-08-17T00:09:54.828750+0000","last_became_active":"2023-08-17T00:09:54.403722+0000","last_became_peered":"2023-08-17T00:09:54.403722+0000","last_unstale":"2023-08-17T00:09:54.828750+0000","last_undegraded":"2023-08-17T00:09:54.828750+0000","last_fullsized":"2023-08-17T00:09:54.828750+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847262+0000","last_change":"2023-08-17T00:09:54.842406+0000","last_active":"2023-08-17T00:09:54.847262+0000","last_peered":"2023-08-17T00:09:54.847262+0000","last_clean":"2023-08-17T00:09:54.847262+0000","last_became_active":"2023-08-17T00:09:54.840748+0000","last_became_peered":"2023-08-17T00:09:54.840748+0000","last_unstale":"2023-08-17T00:09:54.847262+0000","last_undegraded":"2023-08-17T00:09:54.847262+0000","last_fullsized":"2023-08-17T00:09:54.847262+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828603+0000","last_change":"2023-08-17T00:09:54.401825+0000","last_active":"2023-08-17T00:09:54.828603+0000","last_peered":"2023-08-17T00:09:54.828603+0000","last_clean":"2023-08-17T00:09:54.828603+0000","last_became_active":"2023-08-17T00:09:54.401536+0000","last_became_peered":"2023-08-17T00:09:54.401536+0000","last_unstale":"2023-08-17T00:09:54.828603+0000","last_undegraded":"2023-08-17T00:09:54.828603+0000","last_fullsized":"2023-08-17T00:09:54.828603+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848334+0000","last_change":"2023-08-17T00:09:54.845314+0000","last_active":"2023-08-17T00:09:54.848334+0000","last_peered":"2023-08-17T00:09:54.848334+0000","last_clean":"2023-08-17T00:09:54.848334+0000","last_became_active":"2023-08-17T00:09:54.844902+0000","last_became_peered":"2023-08-17T00:09:54.844902+0000","last_unstale":"2023-08-17T00:09:54.848334+0000","last_undegraded":"2023-08-17T00:09:54.848334+0000","last_fullsized":"2023-08-17T00:09:54.848334+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847376+0000","last_change":"2023-08-17T00:09:54.403576+0000","last_active":"2023-08-17T00:09:54.847376+0000","last_peered":"2023-08-17T00:09:54.847376+0000","last_clean":"2023-08-17T00:09:54.847376+0000","last_became_active":"2023-08-17T00:09:54.403239+0000","last_became_peered":"2023-08-17T00:09:54.403239+0000","last_unstale":"2023-08-17T00:09:54.847376+0000","last_undegraded":"2023-08-17T00:09:54.847376+0000","last_fullsized":"2023-08-17T00:09:54.847376+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847461+0000","last_change":"2023-08-17T00:09:54.843796+0000","last_active":"2023-08-17T00:09:54.847461+0000","last_peered":"2023-08-17T00:09:54.847461+0000","last_clean":"2023-08-17T00:09:54.847461+0000","last_became_active":"2023-08-17T00:09:54.842035+0000","last_became_peered":"2023-08-17T00:09:54.842035+0000","last_unstale":"2023-08-17T00:09:54.847461+0000","last_undegraded":"2023-08-17T00:09:54.847461+0000","last_fullsized":"2023-08-17T00:09:54.847461+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849671+0000","last_change":"2023-08-17T00:09:54.406659+0000","last_active":"2023-08-17T00:09:54.849671+0000","last_peered":"2023-08-17T00:09:54.849671+0000","last_clean":"2023-08-17T00:09:54.849671+0000","last_became_active":"2023-08-17T00:09:54.406373+0000","last_became_peered":"2023-08-17T00:09:54.406373+0000","last_unstale":"2023-08-17T00:09:54.849671+0000","last_undegraded":"2023-08-17T00:09:54.849671+0000","last_fullsized":"2023-08-17T00:09:54.849671+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.855646+0000","last_change":"2023-08-17T00:09:54.851705+0000","last_active":"2023-08-17T00:09:54.855646+0000","last_peered":"2023-08-17T00:09:54.855646+0000","last_clean":"2023-08-17T00:09:54.855646+0000","last_became_active":"2023-08-17T00:09:54.851397+0000","last_became_peered":"2023-08-17T00:09:54.851397+0000","last_unstale":"2023-08-17T00:09:54.855646+0000","last_undegraded":"2023-08-17T00:09:54.855646+0000","last_fullsized":"2023-08-17T00:09:54.855646+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1d","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845324+0000","last_change":"2023-08-17T00:09:54.400260+0000","last_active":"2023-08-17T00:09:54.845324+0000","last_peered":"2023-08-17T00:09:54.845324+0000","last_clean":"2023-08-17T00:09:54.845324+0000","last_became_active":"2023-08-17T00:09:54.399972+0000","last_became_peered":"2023-08-17T00:09:54.399972+0000","last_unstale":"2023-08-17T00:09:54.845324+0000","last_undegraded":"2023-08-17T00:09:54.845324+0000","last_fullsized":"2023-08-17T00:09:54.845324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852742+0000","last_change":"2023-08-17T00:09:54.850283+0000","last_active":"2023-08-17T00:09:54.852742+0000","last_peered":"2023-08-17T00:09:54.852742+0000","last_clean":"2023-08-17T00:09:54.852742+0000","last_became_active":"2023-08-17T00:09:54.849396+0000","last_became_peered":"2023-08-17T00:09:54.849396+0000","last_unstale":"2023-08-17T00:09:54.852742+0000","last_undegraded":"2023-08-17T00:09:54.852742+0000","last_fullsized":"2023-08-17T00:09:54.852742+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816803+0000","last_change":"2023-08-17T00:09:54.385193+0000","last_active":"2023-08-17T00:09:54.816803+0000","last_peered":"2023-08-17T00:09:54.816803+0000","last_clean":"2023-08-17T00:09:54.816803+0000","last_became_active":"2023-08-17T00:09:54.384900+0000","last_became_peered":"2023-08-17T00:09:54.384900+0000","last_unstale":"2023-08-17T00:09:54.816803+0000","last_undegraded":"2023-08-17T00:09:54.816803+0000","last_fullsized":"2023-08-17T00:09:54.816803+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.844666+0000","last_change":"2023-08-17T00:09:54.836166+0000","last_active":"2023-08-17T00:09:54.844666+0000","last_peered":"2023-08-17T00:09:54.844666+0000","last_clean":"2023-08-17T00:09:54.844666+0000","last_became_active":"2023-08-17T00:09:54.835819+0000","last_became_peered":"2023-08-17T00:09:54.835819+0000","last_unstale":"2023-08-17T00:09:54.844666+0000","last_undegraded":"2023-08-17T00:09:54.844666+0000","last_fullsized":"2023-08-17T00:09:54.844666+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.828517+0000","last_change":"2023-08-17T00:09:54.394329+0000","last_active":"2023-08-17T00:09:54.828517+0000","last_peered":"2023-08-17T00:09:54.828517+0000","last_clean":"2023-08-17T00:09:54.828517+0000","last_became_active":"2023-08-17T00:09:54.394039+0000","last_became_peered":"2023-08-17T00:09:54.394039+0000","last_unstale":"2023-08-17T00:09:54.828517+0000","last_undegraded":"2023-08-17T00:09:54.828517+0000","last_fullsized":"2023-08-17T00:09:54.828517+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849556+0000","last_change":"2023-08-17T00:09:54.841790+0000","last_active":"2023-08-17T00:09:54.849556+0000","last_peered":"2023-08-17T00:09:54.849556+0000","last_clean":"2023-08-17T00:09:54.849556+0000","last_became_active":"2023-08-17T00:09:54.841483+0000","last_became_peered":"2023-08-17T00:09:54.841483+0000","last_unstale":"2023-08-17T00:09:54.849556+0000","last_undegraded":"2023-08-17T00:09:54.849556+0000","last_fullsized":"2023-08-17T00:09:54.849556+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.821349+0000","last_change":"2023-08-17T00:09:54.382984+0000","last_active":"2023-08-17T00:09:54.821349+0000","last_peered":"2023-08-17T00:09:54.821349+0000","last_clean":"2023-08-17T00:09:54.821349+0000","last_became_active":"2023-08-17T00:09:54.382161+0000","last_became_peered":"2023-08-17T00:09:54.382161+0000","last_unstale":"2023-08-17T00:09:54.821349+0000","last_undegraded":"2023-08-17T00:09:54.821349+0000","last_fullsized":"2023-08-17T00:09:54.821349+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850415+0000","last_change":"2023-08-17T00:09:54.847567+0000","last_active":"2023-08-17T00:09:54.850415+0000","last_peered":"2023-08-17T00:09:54.850415+0000","last_clean":"2023-08-17T00:09:54.850415+0000","last_became_active":"2023-08-17T00:09:54.847247+0000","last_became_peered":"2023-08-17T00:09:54.847247+0000","last_unstale":"2023-08-17T00:09:54.850415+0000","last_undegraded":"2023-08-17T00:09:54.850415+0000","last_fullsized":"2023-08-17T00:09:54.850415+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830655+0000","last_change":"2023-08-17T00:09:54.402776+0000","last_active":"2023-08-17T00:09:54.830655+0000","last_peered":"2023-08-17T00:09:54.830655+0000","last_clean":"2023-08-17T00:09:54.830655+0000","last_became_active":"2023-08-17T00:09:54.402474+0000","last_became_peered":"2023-08-17T00:09:54.402474+0000","last_unstale":"2023-08-17T00:09:54.830655+0000","last_undegraded":"2023-08-17T00:09:54.830655+0000","last_fullsized":"2023-08-17T00:09:54.830655+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.841489+0000","last_change":"2023-08-17T00:09:54.834475+0000","last_active":"2023-08-17T00:09:54.841489+0000","last_peered":"2023-08-17T00:09:54.841489+0000","last_clean":"2023-08-17T00:09:54.841489+0000","last_became_active":"2023-08-17T00:09:54.834194+0000","last_became_peered":"2023-08-17T00:09:54.834194+0000","last_unstale":"2023-08-17T00:09:54.841489+0000","last_undegraded":"2023-08-17T00:09:54.841489+0000","last_fullsized":"2023-08-17T00:09:54.841489+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825103+0000","last_change":"2023-08-17T00:09:54.392720+0000","last_active":"2023-08-17T00:09:54.825103+0000","last_peered":"2023-08-17T00:09:54.825103+0000","last_clean":"2023-08-17T00:09:54.825103+0000","last_became_active":"2023-08-17T00:09:54.392224+0000","last_became_peered":"2023-08-17T00:09:54.392224+0000","last_unstale":"2023-08-17T00:09:54.825103+0000","last_undegraded":"2023-08-17T00:09:54.825103+0000","last_fullsized":"2023-08-17T00:09:54.825103+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846468+0000","last_change":"2023-08-17T00:09:54.841313+0000","last_active":"2023-08-17T00:09:54.846468+0000","last_peered":"2023-08-17T00:09:54.846468+0000","last_clean":"2023-08-17T00:09:54.846468+0000","last_became_active":"2023-08-17T00:09:54.841026+0000","last_became_peered":"2023-08-17T00:09:54.841026+0000","last_unstale":"2023-08-17T00:09:54.846468+0000","last_undegraded":"2023-08-17T00:09:54.846468+0000","last_fullsized":"2023-08-17T00:09:54.846468+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825987+0000","last_change":"2023-08-17T00:09:54.400129+0000","last_active":"2023-08-17T00:09:54.825987+0000","last_peered":"2023-08-17T00:09:54.825987+0000","last_clean":"2023-08-17T00:09:54.825987+0000","last_became_active":"2023-08-17T00:09:54.399857+0000","last_became_peered":"2023-08-17T00:09:54.399857+0000","last_unstale":"2023-08-17T00:09:54.825987+0000","last_undegraded":"2023-08-17T00:09:54.825987+0000","last_fullsized":"2023-08-17T00:09:54.825987+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.835332+0000","last_change":"2023-08-17T00:09:54.831609+0000","last_active":"2023-08-17T00:09:54.835332+0000","last_peered":"2023-08-17T00:09:54.835332+0000","last_clean":"2023-08-17T00:09:54.835332+0000","last_became_active":"2023-08-17T00:09:54.831328+0000","last_became_peered":"2023-08-17T00:09:54.831328+0000","last_unstale":"2023-08-17T00:09:54.835332+0000","last_undegraded":"2023-08-17T00:09:54.835332+0000","last_fullsized":"2023-08-17T00:09:54.835332+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.832198+0000","last_change":"2023-08-17T00:09:54.394654+0000","last_active":"2023-08-17T00:09:54.832198+0000","last_peered":"2023-08-17T00:09:54.832198+0000","last_clean":"2023-08-17T00:09:54.832198+0000","last_became_active":"2023-08-17T00:09:54.394262+0000","last_became_peered":"2023-08-17T00:09:54.394262+0000","last_unstale":"2023-08-17T00:09:54.832198+0000","last_undegraded":"2023-08-17T00:09:54.832198+0000","last_fullsized":"2023-08-17T00:09:54.832198+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845389+0000","last_change":"2023-08-17T00:09:54.843031+0000","last_active":"2023-08-17T00:09:54.845389+0000","last_peered":"2023-08-17T00:09:54.845389+0000","last_clean":"2023-08-17T00:09:54.845389+0000","last_became_active":"2023-08-17T00:09:54.842779+0000","last_became_peered":"2023-08-17T00:09:54.842779+0000","last_unstale":"2023-08-17T00:09:54.845389+0000","last_undegraded":"2023-08-17T00:09:54.845389+0000","last_fullsized":"2023-08-17T00:09:54.845389+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"97'3","reported_seq":13,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849324+0000","last_change":"2023-08-17T00:09:54.391919+0000","last_active":"2023-08-17T00:09:54.849324+0000","last_peered":"2023-08-17T00:09:54.849324+0000","last_clean":"2023-08-17T00:09:54.849324+0000","last_became_active":"2023-08-17T00:09:54.391662+0000","last_became_peered":"2023-08-17T00:09:54.391662+0000","last_unstale":"2023-08-17T00:09:54.849324+0000","last_undegraded":"2023-08-17T00:09:54.849324+0000","last_fullsized":"2023-08-17T00:09:54.849324+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.839936+0000","last_change":"2023-08-17T00:09:54.828545+0000","last_active":"2023-08-17T00:09:54.839936+0000","last_peered":"2023-08-17T00:09:54.839936+0000","last_clean":"2023-08-17T00:09:54.839936+0000","last_became_active":"2023-08-17T00:09:54.828203+0000","last_became_peered":"2023-08-17T00:09:54.828203+0000","last_unstale":"2023-08-17T00:09:54.839936+0000","last_undegraded":"2023-08-17T00:09:54.839936+0000","last_fullsized":"2023-08-17T00:09:54.839936+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.14","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846786+0000","last_change":"2023-08-17T00:09:54.393612+0000","last_active":"2023-08-17T00:09:54.846786+0000","last_peered":"2023-08-17T00:09:54.846786+0000","last_clean":"2023-08-17T00:09:54.846786+0000","last_became_active":"2023-08-17T00:09:54.393123+0000","last_became_peered":"2023-08-17T00:09:54.393123+0000","last_unstale":"2023-08-17T00:09:54.846786+0000","last_undegraded":"2023-08-17T00:09:54.846786+0000","last_fullsized":"2023-08-17T00:09:54.846786+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842628+0000","last_change":"2023-08-17T00:09:54.837422+0000","last_active":"2023-08-17T00:09:54.842628+0000","last_peered":"2023-08-17T00:09:54.842628+0000","last_clean":"2023-08-17T00:09:54.842628+0000","last_became_active":"2023-08-17T00:09:54.837002+0000","last_became_peered":"2023-08-17T00:09:54.837002+0000","last_unstale":"2023-08-17T00:09:54.842628+0000","last_undegraded":"2023-08-17T00:09:54.842628+0000","last_fullsized":"2023-08-17T00:09:54.842628+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.13","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849322+0000","last_change":"2023-08-17T00:09:54.400579+0000","last_active":"2023-08-17T00:09:54.849322+0000","last_peered":"2023-08-17T00:09:54.849322+0000","last_clean":"2023-08-17T00:09:54.849322+0000","last_became_active":"2023-08-17T00:09:54.400288+0000","last_became_peered":"2023-08-17T00:09:54.400288+0000","last_unstale":"2023-08-17T00:09:54.849322+0000","last_undegraded":"2023-08-17T00:09:54.849322+0000","last_fullsized":"2023-08-17T00:09:54.849322+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.841100+0000","last_change":"2023-08-17T00:09:54.831637+0000","last_active":"2023-08-17T00:09:54.841100+0000","last_peered":"2023-08-17T00:09:54.841100+0000","last_clean":"2023-08-17T00:09:54.841100+0000","last_became_active":"2023-08-17T00:09:54.831372+0000","last_became_peered":"2023-08-17T00:09:54.831372+0000","last_unstale":"2023-08-17T00:09:54.841100+0000","last_undegraded":"2023-08-17T00:09:54.841100+0000","last_fullsized":"2023-08-17T00:09:54.841100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830632+0000","last_change":"2023-08-17T00:09:54.391422+0000","last_active":"2023-08-17T00:09:54.830632+0000","last_peered":"2023-08-17T00:09:54.830632+0000","last_clean":"2023-08-17T00:09:54.830632+0000","last_became_active":"2023-08-17T00:09:54.390383+0000","last_became_peered":"2023-08-17T00:09:54.390383+0000","last_unstale":"2023-08-17T00:09:54.830632+0000","last_undegraded":"2023-08-17T00:09:54.830632+0000","last_fullsized":"2023-08-17T00:09:54.830632+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846688+0000","last_change":"2023-08-17T00:09:54.844404+0000","last_active":"2023-08-17T00:09:54.846688+0000","last_peered":"2023-08-17T00:09:54.846688+0000","last_clean":"2023-08-17T00:09:54.846688+0000","last_became_active":"2023-08-17T00:09:54.844136+0000","last_became_peered":"2023-08-17T00:09:54.844136+0000","last_unstale":"2023-08-17T00:09:54.846688+0000","last_undegraded":"2023-08-17T00:09:54.846688+0000","last_fullsized":"2023-08-17T00:09:54.846688+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829481+0000","last_change":"2023-08-17T00:09:54.393638+0000","last_active":"2023-08-17T00:09:54.829481+0000","last_peered":"2023-08-17T00:09:54.829481+0000","last_clean":"2023-08-17T00:09:54.829481+0000","last_became_active":"2023-08-17T00:09:54.393356+0000","last_became_peered":"2023-08-17T00:09:54.393356+0000","last_unstale":"2023-08-17T00:09:54.829481+0000","last_undegraded":"2023-08-17T00:09:54.829481+0000","last_fullsized":"2023-08-17T00:09:54.829481+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843674+0000","last_change":"2023-08-17T00:09:54.832807+0000","last_active":"2023-08-17T00:09:54.843674+0000","last_peered":"2023-08-17T00:09:54.843674+0000","last_clean":"2023-08-17T00:09:54.843674+0000","last_became_active":"2023-08-17T00:09:54.832187+0000","last_became_peered":"2023-08-17T00:09:54.832187+0000","last_unstale":"2023-08-17T00:09:54.843674+0000","last_undegraded":"2023-08-17T00:09:54.843674+0000","last_fullsized":"2023-08-17T00:09:54.843674+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"97'4","reported_seq":14,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849036+0000","last_change":"2023-08-17T00:09:54.396118+0000","last_active":"2023-08-17T00:09:54.849036+0000","last_peered":"2023-08-17T00:09:54.849036+0000","last_clean":"2023-08-17T00:09:54.849036+0000","last_became_active":"2023-08-17T00:09:54.395842+0000","last_became_peered":"2023-08-17T00:09:54.395842+0000","last_unstale":"2023-08-17T00:09:54.849036+0000","last_undegraded":"2023-08-17T00:09:54.849036+0000","last_fullsized":"2023-08-17T00:09:54.849036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.846937+0000","last_change":"2023-08-17T00:09:54.843595+0000","last_active":"2023-08-17T00:09:54.846937+0000","last_peered":"2023-08-17T00:09:54.846937+0000","last_clean":"2023-08-17T00:09:54.846937+0000","last_became_active":"2023-08-17T00:09:54.842912+0000","last_became_peered":"2023-08-17T00:09:54.842912+0000","last_unstale":"2023-08-17T00:09:54.846937+0000","last_undegraded":"2023-08-17T00:09:54.846937+0000","last_fullsized":"2023-08-17T00:09:54.846937+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.7","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849264+0000","last_change":"2023-08-17T00:09:54.396595+0000","last_active":"2023-08-17T00:09:54.849264+0000","last_peered":"2023-08-17T00:09:54.849264+0000","last_clean":"2023-08-17T00:09:54.849264+0000","last_became_active":"2023-08-17T00:09:54.396324+0000","last_became_peered":"2023-08-17T00:09:54.396324+0000","last_unstale":"2023-08-17T00:09:54.849264+0000","last_undegraded":"2023-08-17T00:09:54.849264+0000","last_fullsized":"2023-08-17T00:09:54.849264+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843547+0000","last_change":"2023-08-17T00:09:54.832372+0000","last_active":"2023-08-17T00:09:54.843547+0000","last_peered":"2023-08-17T00:09:54.843547+0000","last_clean":"2023-08-17T00:09:54.843547+0000","last_became_active":"2023-08-17T00:09:54.832035+0000","last_became_peered":"2023-08-17T00:09:54.832035+0000","last_unstale":"2023-08-17T00:09:54.843547+0000","last_undegraded":"2023-08-17T00:09:54.843547+0000","last_fullsized":"2023-08-17T00:09:54.843547+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826689+0000","last_change":"2023-08-17T00:09:54.398038+0000","last_active":"2023-08-17T00:09:54.826689+0000","last_peered":"2023-08-17T00:09:54.826689+0000","last_clean":"2023-08-17T00:09:54.826689+0000","last_became_active":"2023-08-17T00:09:54.397782+0000","last_became_peered":"2023-08-17T00:09:54.397782+0000","last_unstale":"2023-08-17T00:09:54.826689+0000","last_undegraded":"2023-08-17T00:09:54.826689+0000","last_fullsized":"2023-08-17T00:09:54.826689+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.843647+0000","last_change":"2023-08-17T00:09:54.835699+0000","last_active":"2023-08-17T00:09:54.843647+0000","last_peered":"2023-08-17T00:09:54.843647+0000","last_clean":"2023-08-17T00:09:54.843647+0000","last_became_active":"2023-08-17T00:09:54.835348+0000","last_became_peered":"2023-08-17T00:09:54.835348+0000","last_unstale":"2023-08-17T00:09:54.843647+0000","last_undegraded":"2023-08-17T00:09:54.843647+0000","last_fullsized":"2023-08-17T00:09:54.843647+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829469+0000","last_change":"2023-08-17T00:09:54.397060+0000","last_active":"2023-08-17T00:09:54.829469+0000","last_peered":"2023-08-17T00:09:54.829469+0000","last_clean":"2023-08-17T00:09:54.829469+0000","last_became_active":"2023-08-17T00:09:54.396786+0000","last_became_peered":"2023-08-17T00:09:54.396786+0000","last_unstale":"2023-08-17T00:09:54.829469+0000","last_undegraded":"2023-08-17T00:09:54.829469+0000","last_fullsized":"2023-08-17T00:09:54.829469+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.842247+0000","last_change":"2023-08-17T00:09:54.831715+0000","last_active":"2023-08-17T00:09:54.842247+0000","last_peered":"2023-08-17T00:09:54.842247+0000","last_clean":"2023-08-17T00:09:54.842247+0000","last_became_active":"2023-08-17T00:09:54.831465+0000","last_became_peered":"2023-08-17T00:09:54.831465+0000","last_unstale":"2023-08-17T00:09:54.842247+0000","last_undegraded":"2023-08-17T00:09:54.842247+0000","last_fullsized":"2023-08-17T00:09:54.842247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826413+0000","last_change":"2023-08-17T00:09:54.395823+0000","last_active":"2023-08-17T00:09:54.826413+0000","last_peered":"2023-08-17T00:09:54.826413+0000","last_clean":"2023-08-17T00:09:54.826413+0000","last_became_active":"2023-08-17T00:09:54.395493+0000","last_became_peered":"2023-08-17T00:09:54.395493+0000","last_unstale":"2023-08-17T00:09:54.826413+0000","last_undegraded":"2023-08-17T00:09:54.826413+0000","last_fullsized":"2023-08-17T00:09:54.826413+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840048+0000","last_change":"2023-08-17T00:09:54.834321+0000","last_active":"2023-08-17T00:09:54.840048+0000","last_peered":"2023-08-17T00:09:54.840048+0000","last_clean":"2023-08-17T00:09:54.840048+0000","last_became_active":"2023-08-17T00:09:54.834027+0000","last_became_peered":"2023-08-17T00:09:54.834027+0000","last_unstale":"2023-08-17T00:09:54.840048+0000","last_undegraded":"2023-08-17T00:09:54.840048+0000","last_fullsized":"2023-08-17T00:09:54.840048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830684+0000","last_change":"2023-08-17T00:09:54.388390+0000","last_active":"2023-08-17T00:09:54.830684+0000","last_peered":"2023-08-17T00:09:54.830684+0000","last_clean":"2023-08-17T00:09:54.830684+0000","last_became_active":"2023-08-17T00:09:54.387941+0000","last_became_peered":"2023-08-17T00:09:54.387941+0000","last_unstale":"2023-08-17T00:09:54.830684+0000","last_undegraded":"2023-08-17T00:09:54.830684+0000","last_fullsized":"2023-08-17T00:09:54.830684+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848903+0000","last_change":"2023-08-17T00:09:54.840538+0000","last_active":"2023-08-17T00:09:54.848903+0000","last_peered":"2023-08-17T00:09:54.848903+0000","last_clean":"2023-08-17T00:09:54.848903+0000","last_became_active":"2023-08-17T00:09:54.840277+0000","last_became_peered":"2023-08-17T00:09:54.840277+0000","last_unstale":"2023-08-17T00:09:54.848903+0000","last_undegraded":"2023-08-17T00:09:54.848903+0000","last_fullsized":"2023-08-17T00:09:54.848903+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825373+0000","last_change":"2023-08-17T00:09:54.403012+0000","last_active":"2023-08-17T00:09:54.825373+0000","last_peered":"2023-08-17T00:09:54.825373+0000","last_clean":"2023-08-17T00:09:54.825373+0000","last_became_active":"2023-08-17T00:09:54.402711+0000","last_became_peered":"2023-08-17T00:09:54.402711+0000","last_unstale":"2023-08-17T00:09:54.825373+0000","last_undegraded":"2023-08-17T00:09:54.825373+0000","last_fullsized":"2023-08-17T00:09:54.825373+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.852984+0000","last_change":"2023-08-17T00:09:54.850952+0000","last_active":"2023-08-17T00:09:54.852984+0000","last_peered":"2023-08-17T00:09:54.852984+0000","last_clean":"2023-08-17T00:09:54.852984+0000","last_became_active":"2023-08-17T00:09:54.850656+0000","last_became_peered":"2023-08-17T00:09:54.850656+0000","last_unstale":"2023-08-17T00:09:54.852984+0000","last_undegraded":"2023-08-17T00:09:54.852984+0000","last_fullsized":"2023-08-17T00:09:54.852984+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825509+0000","last_change":"2023-08-17T00:09:54.397962+0000","last_active":"2023-08-17T00:09:54.825509+0000","last_peered":"2023-08-17T00:09:54.825509+0000","last_clean":"2023-08-17T00:09:54.825509+0000","last_became_active":"2023-08-17T00:09:54.397744+0000","last_became_peered":"2023-08-17T00:09:54.397744+0000","last_unstale":"2023-08-17T00:09:54.825509+0000","last_undegraded":"2023-08-17T00:09:54.825509+0000","last_fullsized":"2023-08-17T00:09:54.825509+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.847305+0000","last_change":"2023-08-17T00:09:54.843420+0000","last_active":"2023-08-17T00:09:54.847305+0000","last_peered":"2023-08-17T00:09:54.847305+0000","last_clean":"2023-08-17T00:09:54.847305+0000","last_became_active":"2023-08-17T00:09:54.843141+0000","last_became_peered":"2023-08-17T00:09:54.843141+0000","last_unstale":"2023-08-17T00:09:54.847305+0000","last_undegraded":"2023-08-17T00:09:54.847305+0000","last_fullsized":"2023-08-17T00:09:54.847305+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825206+0000","last_change":"2023-08-17T00:09:54.392526+0000","last_active":"2023-08-17T00:09:54.825206+0000","last_peered":"2023-08-17T00:09:54.825206+0000","last_clean":"2023-08-17T00:09:54.825206+0000","last_became_active":"2023-08-17T00:09:54.391904+0000","last_became_peered":"2023-08-17T00:09:54.391904+0000","last_unstale":"2023-08-17T00:09:54.825206+0000","last_undegraded":"2023-08-17T00:09:54.825206+0000","last_fullsized":"2023-08-17T00:09:54.825206+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845457+0000","last_change":"2023-08-17T00:09:54.842153+0000","last_active":"2023-08-17T00:09:54.845457+0000","last_peered":"2023-08-17T00:09:54.845457+0000","last_clean":"2023-08-17T00:09:54.845457+0000","last_became_active":"2023-08-17T00:09:54.841807+0000","last_became_peered":"2023-08-17T00:09:54.841807+0000","last_unstale":"2023-08-17T00:09:54.845457+0000","last_undegraded":"2023-08-17T00:09:54.845457+0000","last_fullsized":"2023-08-17T00:09:54.845457+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.821085+0000","last_change":"2023-08-17T00:09:54.376692+0000","last_active":"2023-08-17T00:09:54.821085+0000","last_peered":"2023-08-17T00:09:54.821085+0000","last_clean":"2023-08-17T00:09:54.821085+0000","last_became_active":"2023-08-17T00:09:54.376306+0000","last_became_peered":"2023-08-17T00:09:54.376306+0000","last_unstale":"2023-08-17T00:09:54.821085+0000","last_undegraded":"2023-08-17T00:09:54.821085+0000","last_fullsized":"2023-08-17T00:09:54.821085+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.829533+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:09:54.829533+0000","last_peered":"2023-08-17T00:09:54.829533+0000","last_clean":"2023-08-17T00:09:54.829533+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:09:54.829533+0000","last_undegraded":"2023-08-17T00:09:54.829533+0000","last_fullsized":"2023-08-17T00:09:54.829533+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.849482+0000","last_change":"2023-08-17T00:09:54.847322+0000","last_active":"2023-08-17T00:09:54.849482+0000","last_peered":"2023-08-17T00:09:54.849482+0000","last_clean":"2023-08-17T00:09:54.849482+0000","last_became_active":"2023-08-17T00:09:54.847031+0000","last_became_peered":"2023-08-17T00:09:54.847031+0000","last_unstale":"2023-08-17T00:09:54.849482+0000","last_undegraded":"2023-08-17T00:09:54.849482+0000","last_fullsized":"2023-08-17T00:09:54.849482+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816472+0000","last_change":"2023-08-17T00:09:54.384661+0000","last_active":"2023-08-17T00:09:54.816472+0000","last_peered":"2023-08-17T00:09:54.816472+0000","last_clean":"2023-08-17T00:09:54.816472+0000","last_became_active":"2023-08-17T00:09:54.384360+0000","last_became_peered":"2023-08-17T00:09:54.384360+0000","last_unstale":"2023-08-17T00:09:54.816472+0000","last_undegraded":"2023-08-17T00:09:54.816472+0000","last_fullsized":"2023-08-17T00:09:54.816472+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":89,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817727+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:09:54.817727+0000","last_peered":"2023-08-17T00:09:54.817727+0000","last_clean":"2023-08-17T00:09:54.817727+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:09:54.817727+0000","last_undegraded":"2023-08-17T00:09:54.817727+0000","last_fullsized":"2023-08-17T00:09:54.817727+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845560+0000","last_change":"2023-08-17T00:09:54.842135+0000","last_active":"2023-08-17T00:09:54.845560+0000","last_peered":"2023-08-17T00:09:54.845560+0000","last_clean":"2023-08-17T00:09:54.845560+0000","last_became_active":"2023-08-17T00:09:54.841923+0000","last_became_peered":"2023-08-17T00:09:54.841923+0000","last_unstale":"2023-08-17T00:09:54.845560+0000","last_undegraded":"2023-08-17T00:09:54.845560+0000","last_fullsized":"2023-08-17T00:09:54.845560+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.817722+0000","last_change":"2023-08-17T00:09:54.385316+0000","last_active":"2023-08-17T00:09:54.817722+0000","last_peered":"2023-08-17T00:09:54.817722+0000","last_clean":"2023-08-17T00:09:54.817722+0000","last_became_active":"2023-08-17T00:09:54.384716+0000","last_became_peered":"2023-08-17T00:09:54.384716+0000","last_unstale":"2023-08-17T00:09:54.817722+0000","last_undegraded":"2023-08-17T00:09:54.817722+0000","last_fullsized":"2023-08-17T00:09:54.817722+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.827187+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:09:54.827187+0000","last_peered":"2023-08-17T00:09:54.827187+0000","last_clean":"2023-08-17T00:09:54.827187+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:09:54.827187+0000","last_undegraded":"2023-08-17T00:09:54.827187+0000","last_fullsized":"2023-08-17T00:09:54.827187+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840066+0000","last_change":"2023-08-17T00:09:54.835472+0000","last_active":"2023-08-17T00:09:54.840066+0000","last_peered":"2023-08-17T00:09:54.840066+0000","last_clean":"2023-08-17T00:09:54.840066+0000","last_became_active":"2023-08-17T00:09:54.835159+0000","last_became_peered":"2023-08-17T00:09:54.835159+0000","last_unstale":"2023-08-17T00:09:54.840066+0000","last_undegraded":"2023-08-17T00:09:54.840066+0000","last_fullsized":"2023-08-17T00:09:54.840066+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.b","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.845830+0000","last_change":"2023-08-17T00:09:54.391547+0000","last_active":"2023-08-17T00:09:54.845830+0000","last_peered":"2023-08-17T00:09:54.845830+0000","last_clean":"2023-08-17T00:09:54.845830+0000","last_became_active":"2023-08-17T00:09:54.390991+0000","last_became_peered":"2023-08-17T00:09:54.390991+0000","last_unstale":"2023-08-17T00:09:54.845830+0000","last_undegraded":"2023-08-17T00:09:54.845830+0000","last_fullsized":"2023-08-17T00:09:54.845830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":85,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.822544+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:09:54.822544+0000","last_peered":"2023-08-17T00:09:54.822544+0000","last_clean":"2023-08-17T00:09:54.822544+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:09:54.822544+0000","last_undegraded":"2023-08-17T00:09:54.822544+0000","last_fullsized":"2023-08-17T00:09:54.822544+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.855479+0000","last_change":"2023-08-17T00:09:54.851117+0000","last_active":"2023-08-17T00:09:54.855479+0000","last_peered":"2023-08-17T00:09:54.855479+0000","last_clean":"2023-08-17T00:09:54.855479+0000","last_became_active":"2023-08-17T00:09:54.850766+0000","last_became_peered":"2023-08-17T00:09:54.850766+0000","last_unstale":"2023-08-17T00:09:54.855479+0000","last_undegraded":"2023-08-17T00:09:54.855479+0000","last_fullsized":"2023-08-17T00:09:54.855479+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.816861+0000","last_change":"2023-08-17T00:09:54.394102+0000","last_active":"2023-08-17T00:09:54.816861+0000","last_peered":"2023-08-17T00:09:54.816861+0000","last_clean":"2023-08-17T00:09:54.816861+0000","last_became_active":"2023-08-17T00:09:54.393821+0000","last_became_peered":"2023-08-17T00:09:54.393821+0000","last_unstale":"2023-08-17T00:09:54.816861+0000","last_undegraded":"2023-08-17T00:09:54.816861+0000","last_fullsized":"2023-08-17T00:09:54.816861+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825739+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:09:54.825739+0000","last_peered":"2023-08-17T00:09:54.825739+0000","last_clean":"2023-08-17T00:09:54.825739+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:09:54.825739+0000","last_undegraded":"2023-08-17T00:09:54.825739+0000","last_fullsized":"2023-08-17T00:09:54.825739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.840314+0000","last_change":"2023-08-17T00:09:54.833976+0000","last_active":"2023-08-17T00:09:54.840314+0000","last_peered":"2023-08-17T00:09:54.840314+0000","last_clean":"2023-08-17T00:09:54.840314+0000","last_became_active":"2023-08-17T00:09:54.833731+0000","last_became_peered":"2023-08-17T00:09:54.833731+0000","last_unstale":"2023-08-17T00:09:54.840314+0000","last_undegraded":"2023-08-17T00:09:54.840314+0000","last_fullsized":"2023-08-17T00:09:54.840314+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.e","version":"97'2","reported_seq":12,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.848207+0000","last_change":"2023-08-17T00:09:54.395898+0000","last_active":"2023-08-17T00:09:54.848207+0000","last_peered":"2023-08-17T00:09:54.848207+0000","last_clean":"2023-08-17T00:09:54.848207+0000","last_became_active":"2023-08-17T00:09:54.395585+0000","last_became_peered":"2023-08-17T00:09:54.395585+0000","last_unstale":"2023-08-17T00:09:54.848207+0000","last_undegraded":"2023-08-17T00:09:54.848207+0000","last_fullsized":"2023-08-17T00:09:54.848207+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.830757+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:09:54.830757+0000","last_peered":"2023-08-17T00:09:54.830757+0000","last_clean":"2023-08-17T00:09:54.830757+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:09:54.830757+0000","last_undegraded":"2023-08-17T00:09:54.830757+0000","last_fullsized":"2023-08-17T00:09:54.830757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.844720+0000","last_change":"2023-08-17T00:09:54.834413+0000","last_active":"2023-08-17T00:09:54.844720+0000","last_peered":"2023-08-17T00:09:54.844720+0000","last_clean":"2023-08-17T00:09:54.844720+0000","last_became_active":"2023-08-17T00:09:54.833665+0000","last_became_peered":"2023-08-17T00:09:54.833665+0000","last_unstale":"2023-08-17T00:09:54.844720+0000","last_undegraded":"2023-08-17T00:09:54.844720+0000","last_fullsized":"2023-08-17T00:09:54.844720+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.f","version":"97'1","reported_seq":11,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.850410+0000","last_change":"2023-08-17T00:09:54.405929+0000","last_active":"2023-08-17T00:09:54.850410+0000","last_peered":"2023-08-17T00:09:54.850410+0000","last_clean":"2023-08-17T00:09:54.850410+0000","last_became_active":"2023-08-17T00:09:54.405668+0000","last_became_peered":"2023-08-17T00:09:54.405668+0000","last_unstale":"2023-08-17T00:09:54.850410+0000","last_undegraded":"2023-08-17T00:09:54.850410+0000","last_fullsized":"2023-08-17T00:09:54.850410+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.822128+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:09:54.822128+0000","last_peered":"2023-08-17T00:09:54.822128+0000","last_clean":"2023-08-17T00:09:54.822128+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:09:54.822128+0000","last_undegraded":"2023-08-17T00:09:54.822128+0000","last_fullsized":"2023-08-17T00:09:54.822128+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.855486+0000","last_change":"2023-08-17T00:09:54.851463+0000","last_active":"2023-08-17T00:09:54.855486+0000","last_peered":"2023-08-17T00:09:54.855486+0000","last_clean":"2023-08-17T00:09:54.855486+0000","last_became_active":"2023-08-17T00:09:54.850766+0000","last_became_peered":"2023-08-17T00:09:54.850766+0000","last_unstale":"2023-08-17T00:09:54.855486+0000","last_undegraded":"2023-08-17T00:09:54.855486+0000","last_fullsized":"2023-08-17T00:09:54.855486+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:54.356993+0000","last_clean_scrub_stamp":"2023-08-17T00:09:54.356993+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.831116+0000","last_change":"2023-08-17T00:09:54.393401+0000","last_active":"2023-08-17T00:09:54.831116+0000","last_peered":"2023-08-17T00:09:54.831116+0000","last_clean":"2023-08-17T00:09:54.831116+0000","last_became_active":"2023-08-17T00:09:54.392773+0000","last_became_peered":"2023-08-17T00:09:54.392773+0000","last_unstale":"2023-08-17T00:09:54.831116+0000","last_undegraded":"2023-08-17T00:09:54.831116+0000","last_fullsized":"2023-08-17T00:09:54.831116+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":95,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:09:53.343108+0000","last_clean_scrub_stamp":"2023-08-17T00:09:53.343108+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":75,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.826107+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:09:54.826107+0000","last_peered":"2023-08-17T00:09:54.826107+0000","last_clean":"2023-08-17T00:09:54.826107+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:09:54.826107+0000","last_undegraded":"2023-08-17T00:09:54.826107+0000","last_fullsized":"2023-08-17T00:09:54.826107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":76,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-08-17T00:09:54.825280+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:09:54.825280+0000","last_peered":"2023-08-17T00:09:54.825280+0000","last_clean":"2023-08-17T00:09:54.825280+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:09:54.825280+0000","last_undegraded":"2023-08-17T00:09:54.825280+0000","last_fullsized":"2023-08-17T00:09:54.825280+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306596,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065244,"statfs":{"total":96636764160,"available":96322809856,"internally_reserved":0,"allocated":1208320,"data_stored":556513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.032,"15min":1.3089999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.532,"5min":1.909,"15min":8.7769999999999992},"last":1.093},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0600000000000001,"15min":1.357},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":9.6530000000000005},"last":1.29}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.109,"15min":1.3799999999999999},"min":{"1min":0.71899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5029999999999999,"5min":1.629,"15min":9.8800000000000008},"last":1.343},{"interface":"front","average":{"1min":1.129,"5min":1.0800000000000001,"15min":1.3620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.782,"5min":1.782,"15min":8.8399999999999999},"last":1.631}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.2529999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.359,"5min":1.4450000000000001,"15min":7.0190000000000001},"last":1.177},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1919999999999999,"15min":1.4159999999999999},"min":{"1min":0.86699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8009999999999999,"5min":1.8120000000000001,"15min":9.4239999999999995},"last":1.4119999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.101,"15min":1.2909999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3720000000000001,"5min":1.454,"15min":7.7080000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.298,"5min":1.258,"15min":1.625},"min":{"1min":1.02,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7110000000000001,"5min":1.958,"15min":13.074999999999999},"last":1.518}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1459999999999999,"15min":1.5860000000000001},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":13.784000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1699999999999999,"15min":1.4870000000000001},"min":{"1min":0.60599999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5860000000000001,"5min":1.764,"15min":10.045999999999999},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2689999999999999,"15min":1.72},"min":{"1min":0.92200000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.907,"5min":2.012,"15min":14.435},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.673},"min":{"1min":0.754,"5min":0.746,"15min":0.746},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":12.617000000000001},"last":1.044}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.321,"15min":1.6879999999999999},"min":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.833,"5min":1.833,"15min":11.279999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2689999999999999,"15min":1.6040000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5369999999999999,"5min":1.8200000000000001,"15min":11.365},"last":1.258}]}]},{"osd":6,"up_from":14,"seq":60129542233,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306604,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065236,"statfs":{"total":96636764160,"available":96322801664,"internally_reserved":0,"allocated":1216512,"data_stored":556319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.121,"15min":1.0720000000000001},"min":{"1min":0.76900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":8.0909999999999993,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.998},{"interface":"front","average":{"1min":1.661,"5min":1.2330000000000001,"15min":1.1619999999999999},"min":{"1min":0.75,"5min":0.502,"15min":0.502},"max":{"1min":10.519,"5min":10.519,"15min":10.519},"last":1.7050000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.3,"15min":1.1459999999999999},"min":{"1min":0.61699999999999999,"5min":0.443,"15min":0.443},"max":{"1min":10.704000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1759999999999999,"15min":1.0309999999999999},"min":{"1min":0.58499999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":3.4460000000000002,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.177}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.177,"15min":1.177},"min":{"1min":0.64900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":5.3799999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.8240000000000001,"5min":1.4239999999999999,"15min":1.2989999999999999},"min":{"1min":0.872,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":10.669,"5min":10.669,"15min":10.669},"last":1.6379999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.258,"15min":1.1679999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.512,"5min":11.475,"15min":11.475},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.474,"5min":1.2529999999999999,"15min":1.268},"min":{"1min":0.93300000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":5.3330000000000002,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.371}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.7729999999999999,"5min":1.4239999999999999,"15min":1.292},"min":{"1min":0.79700000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":10.632,"5min":10.632,"15min":10.632},"last":1.54},{"interface":"front","average":{"1min":1.48,"5min":1.3819999999999999,"15min":1.2509999999999999},"min":{"1min":0.94199999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":5.8280000000000003,"5min":11.438000000000001,"15min":11.438000000000001},"last":1.458}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.472,"5min":1.2609999999999999,"15min":1.2709999999999999},"min":{"1min":0.90700000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":5.0759999999999996,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.494},{"interface":"front","average":{"1min":1.873,"5min":1.53,"15min":1.3759999999999999},"min":{"1min":0.88900000000000001,"5min":0.628,"15min":0.628},"max":{"1min":10.592000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.754}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.444,"15min":1.3420000000000001},"min":{"1min":1.0940000000000001,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":3.3450000000000002,"5min":11.51,"15min":11.51},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.627,"5min":1.3879999999999999,"15min":1.4259999999999999},"min":{"1min":1.075,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":5.4100000000000001,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.5900000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542234,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298400,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073440,"statfs":{"total":96636764160,"available":96331202560,"internally_reserved":0,"allocated":1204224,"data_stored":555621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.98799999999999999,"15min":1.486},"min":{"1min":0.68999999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3919999999999999,"5min":1.516,"15min":15.007999999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":1,"15min":1.627},"min":{"1min":0.629,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.284,"5min":1.742,"15min":16.838999999999999},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.0429999999999999,"15min":1.155},"min":{"1min":0.73899999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.413,"5min":1.494,"15min":4.2270000000000003},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.0780000000000001,"15min":1.4219999999999999},"min":{"1min":0.70599999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.476,"5min":1.5,"15min":9.6579999999999995},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.123,"15min":1.6719999999999999},"min":{"1min":0.85099999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":16.675000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.1240000000000001,"15min":1.5209999999999999},"min":{"1min":0.74199999999999999,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.4930000000000001,"5min":1.5129999999999999,"15min":11.949},"last":1.24}]},{"osd":3,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.1459999999999999,"15min":1.5669999999999999},"min":{"1min":0.93700000000000006,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.3480000000000001,"5min":1.988,"15min":13.125},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.163,"15min":1.4670000000000001},"min":{"1min":0.77900000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.631,"5min":1.6559999999999999,"15min":8.4809999999999999},"last":1.0229999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1399999999999999,"15min":1.718},"min":{"1min":0.78100000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.319,"5min":1.77,"15min":17.510000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.24,"5min":1.2190000000000001,"15min":1.871},"min":{"1min":0.83499999999999996,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.444,"5min":1.74,"15min":19.591000000000001},"last":1.2829999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.23,"15min":1.821},"min":{"1min":0.70299999999999996,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.901,"5min":1.901,"15min":17.158000000000001},"last":1.137},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.228,"15min":1.8169999999999999},"min":{"1min":0.79500000000000004,"5min":0.65800000000000003,"15min":0.64400000000000002},"max":{"1min":1.569,"5min":1.821,"15min":17.050000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:09:55 2023","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.331,"15min":1.9430000000000001},"min":{"1min":0.88300000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.9610000000000001,"5min":2.2599999999999998,"15min":18.158000000000001},"last":1.226},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.361,"15min":1.8480000000000001},"min":{"1min":1.044,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":14.818},"last":1.3600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542233,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302508,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069332,"statfs":{"total":96636764160,"available":96326995968,"internally_reserved":0,"allocated":1216512,"data_stored":556307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3580000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.83699999999999997,"15min":0.81999999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0640000000000001,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.871},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84899999999999998,"15min":0.92000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.6299999999999999,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.7929999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.0489999999999999},"min":{"1min":0.51500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6890000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.83299999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1879999999999999,"15min":1.2170000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.274,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.2250000000000001},"min":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.649,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":1.135}]},{"osd":5,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1719999999999999,"15min":1.2390000000000001},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.744,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.236},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2170000000000001,"15min":1.282},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.306}]},{"osd":6,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.179,"15min":1.2669999999999999},"min":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7589999999999999,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.379},{"interface":"front","average":{"1min":1.214,"5min":1.1699999999999999,"15min":1.2150000000000001},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0979999999999999,"5min":3.585,"15min":3.585},"last":1.0109999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.194,"15min":1.26},"min":{"1min":0.68300000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.165,"15min":1.2509999999999999},"min":{"1min":0.72899999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1919999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542233,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302500,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069340,"statfs":{"total":96636764160,"available":96327004160,"internally_reserved":0,"allocated":1208320,"data_stored":556127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.69399999999999995,"15min":0.86499999999999999},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81000000000000005,"5min":1.3029999999999999,"15min":3.1099999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.74099999999999999,"15min":1.01},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.0529999999999999,"5min":1.827,"15min":6.4859999999999998},"last":1.075}]},{"osd":1,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.77300000000000002,"15min":0.92300000000000004},"min":{"1min":0.45400000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92200000000000004,"5min":1.7989999999999999,"15min":3.7589999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.91300000000000003,"15min":1.0920000000000001},"min":{"1min":0.53800000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.89400000000000002,"5min":1.9159999999999999,"15min":3.911},"last":1.254}]},{"osd":3,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.91000000000000003,"15min":1.212},"min":{"1min":0.56799999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.008,"5min":1.9530000000000001,"15min":5.4059999999999997},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.85899999999999999,"15min":1.0229999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97699999999999998,"5min":3.2530000000000001,"15min":3.3410000000000002},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.044,"15min":1.8120000000000001},"min":{"1min":0.73499999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.337,"5min":4.2770000000000001,"15min":16.521000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.026,"5min":1.147,"15min":1.5980000000000001},"min":{"1min":0.61499999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.423,"5min":2.0649999999999999,"15min":8.4399999999999995},"last":1.456}]},{"osd":5,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.236,"15min":1.74},"min":{"1min":0.68799999999999994,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.4670000000000001,"5min":2.1440000000000001,"15min":12.914},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.121,"5min":1.1679999999999999,"15min":1.5369999999999999},"min":{"1min":0.79200000000000004,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.456,"5min":1.6719999999999999,"15min":9.5519999999999996},"last":1.0649999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.1699999999999999,"15min":1.704},"min":{"1min":0.69899999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5580000000000001,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.22,"15min":1.744},"min":{"1min":0.86399999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.377,"5min":2.2210000000000001,"15min":12.698},"last":1.6879999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:02 2023","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.2490000000000001,"15min":1.6910000000000001},"min":{"1min":0.748,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4039999999999999,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.417},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2589999999999999,"15min":1.7030000000000001},"min":{"1min":0.86799999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.6359999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.367}]}]},{"osd":1,"up_from":14,"seq":60129542233,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310564,"kb_used_data":1180,"kb_used_omap":0,"kb_used_meta":309376,"kb_avail":94061276,"statfs":{"total":96636764160,"available":96318746624,"internally_reserved":0,"allocated":1208320,"data_stored":556139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316801024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.1619999999999999,"5min":1.4810000000000001,"15min":6.4329999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85599999999999998,"15min":0.91000000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.367,"5min":1.6379999999999999,"15min":13.093},"last":0.92500000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76000000000000001,"15min":0.81899999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.167,"5min":1.452,"15min":5.4989999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.89900000000000002},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":7.0620000000000003},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.61199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.4319999999999999,"5min":1.5920000000000001,"15min":8.8279999999999994},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84899999999999998,"15min":0.98599999999999999},"min":{"1min":0.54600000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1379999999999999,"5min":1.327,"15min":12.981999999999999},"last":0.876}]},{"osd":4,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.0629999999999999,"15min":1.1759999999999999},"min":{"1min":0.82699999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.375,"5min":1.4570000000000001,"15min":20.548999999999999},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1459999999999999,"15min":1.23},"min":{"1min":0.77000000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.3759999999999999,"5min":1.6020000000000001,"15min":8.8670000000000009},"last":0.98399999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.198,"15min":1.347},"min":{"1min":0.67500000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.4710000000000001,"5min":1.8540000000000001,"15min":13.170999999999999},"last":1.236},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2030000000000001,"15min":1.278},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.76400000000000001},"max":{"1min":1.4530000000000001,"5min":1.9990000000000001,"15min":5.4240000000000004},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.157,"15min":1.268},"min":{"1min":0.748,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.472,"5min":1.722,"15min":13.050000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1659999999999999,"15min":1.216},"min":{"1min":0.78500000000000003,"5min":0.77900000000000003,"15min":0.77800000000000002},"max":{"1min":1.5760000000000001,"5min":1.7829999999999999,"15min":5.5359999999999996},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.23,"15min":1.3240000000000001},"min":{"1min":0.80500000000000005,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.5009999999999999,"5min":1.615,"15min":6.9779999999999998},"last":1.071},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.214,"15min":1.3660000000000001},"min":{"1min":0.876,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.619,"5min":1.77,"15min":13.131},"last":1.127}]}]},{"osd":0,"up_from":14,"seq":60129542234,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302496,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069344,"statfs":{"total":96636764160,"available":96327008256,"internally_reserved":0,"allocated":1204224,"data_stored":556443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.438,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1479999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.501,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.244,"5min":1.4159999999999999,"15min":1.423},"last":0.83899999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.242,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.63600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2050000000000001,"5min":2.133,"15min":2.133},"last":0.95199999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.85999999999999999},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4350000000000001,"5min":1.613,"15min":1.613},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.94799999999999995,"15min":1.016},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2669999999999999,"5min":1.72,"15min":1.72},"last":1.0549999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.73099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.431,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.331},{"interface":"front","average":{"1min":1.27,"5min":1.1739999999999999,"15min":1.2010000000000001},"min":{"1min":0.96599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5329999999999999,"5min":1.982,"15min":1.982},"last":1.3540000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1890000000000001,"15min":1.266},"min":{"1min":0.80400000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7809999999999999,"5min":1.849,"15min":1.849},"last":1.393},{"interface":"front","average":{"1min":1.272,"5min":1.1899999999999999,"15min":1.2789999999999999},"min":{"1min":0.88,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.7629999999999999},"last":1.5660000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.196,"15min":1.278},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.593,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.179,"15min":1.2549999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.72},"last":1.2}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.1970000000000001,"15min":1.268},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.585,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.179,"15min":1.2529999999999999},"min":{"1min":0.90600000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5600000000000001,"5min":1.804,"15min":2.0750000000000002},"last":1.5049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298396,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073444,"statfs":{"total":96636764160,"available":96331206656,"internally_reserved":0,"allocated":1200128,"data_stored":555551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.145,"15min":1.1120000000000001},"min":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.38300000000000001},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.26},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.1020000000000001,"15min":1.0860000000000001},"min":{"1min":0.81000000000000005,"5min":0.41999999999999998,"15min":0.40100000000000002},"max":{"1min":7.7380000000000004,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.96799999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.381,"15min":1.256},"min":{"1min":0.65100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7.0469999999999997,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.292,"15min":1.2789999999999999},"min":{"1min":0.86399999999999999,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":6.9000000000000004,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.212}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.458,"15min":1.2589999999999999},"min":{"1min":0.71399999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.6500000000000004,"5min":18.431000000000001,"15min":18.431000000000001},"last":0.995},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.6950000000000001,"15min":1.365},"min":{"1min":0.88500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.738,"5min":36.531999999999996,"15min":36.531999999999996},"last":1.1359999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.115,"15min":1.1539999999999999},"min":{"1min":0.84499999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.512,"5min":2.722,"15min":2.722},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.7450000000000001,"15min":1.4339999999999999},"min":{"1min":0.75700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.6920000000000002,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3300000000000001,"15min":1.2689999999999999},"min":{"1min":0.81999999999999995,"5min":0.433,"15min":0.433},"max":{"1min":5.2720000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.379,"15min":1.323},"min":{"1min":0.88800000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":5.4569999999999999,"5min":9.4120000000000008,"15min":9.4120000000000008},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.4059999999999999,"15min":1.389},"min":{"1min":0.80800000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.9320000000000004,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.107},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.377,"15min":1.4490000000000001},"min":{"1min":1.0009999999999999,"5min":0.82099999999999995,"15min":0.57799999999999996},"max":{"1min":2.5619999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.228,"15min":1.3129999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.175},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.458,"15min":1.46},"min":{"1min":0.85499999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":6.7430000000000003,"5min":8.327,"15min":8.327},"last":1.494}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:09:59.870 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:09:59.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:10:00.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.060+0000 7ff66c9f9700 1 Processor -- start 2023-08-17T00:10:00.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.060+0000 7ff66c9f9700 1 -- start start 2023-08-17T00:10:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff66c9f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff6680c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff66c9f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680bfd10 con 0x7ff6680c57a0 2023-08-17T00:10:00.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff66c9f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff668154af0 con 0x7ff668153f50 2023-08-17T00:10:00.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff66c9f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff668154dd0 con 0x7ff668154370 2023-08-17T00:10:00.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff6677fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff6680c57a0 0x7ff6680c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41340/0 (socket says 172.21.15.153:41340) 2023-08-17T00:10:00.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff6677fe700 1 -- 172.21.15.153:0/2012774988 learned_addr learned my addr 172.21.15.153:0/2012774988 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:00.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff667fff700 1 --2- 172.21.15.153:0/2012774988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff6680c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293854219 0 0) 0x7ff6680bfd10 con 0x7ff6680c57a0 2023-08-17T00:10:00.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6500033f0 con 0x7ff6680c57a0 2023-08-17T00:10:00.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076654704 0 0) 0x7ff668154af0 con 0x7ff668153f50 2023-08-17T00:10:00.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6680bfd10 con 0x7ff668153f50 2023-08-17T00:10:00.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff667fff700 1 -- 172.21.15.153:0/2012774988 >> v1:172.21.15.178:6789/0 conn(0x7ff668153f50 legacy=0x7ff6680c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff667fff700 1 -- 172.21.15.153:0/2012774988 >> v1:172.21.15.153:6789/0 conn(0x7ff6680c57a0 legacy=0x7ff6680c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.064+0000 7ff667fff700 1 -- 172.21.15.153:0/2012774988 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6680bf9a0 con 0x7ff668154370 2023-08-17T00:10:00.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff667fff700 1 --2- 172.21.15.153:0/2012774988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff6680c08b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff660009e90 tx=0x7ff660009780).ready entity=mon.2 client_cookie=896173b39462a4d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:00.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66000e070 con 0x7ff668154370 2023-08-17T00:10:00.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66000bab0 con 0x7ff668154370 2023-08-17T00:10:00.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff6667fc700 1 -- 172.21.15.153:0/2012774988 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66000be30 con 0x7ff668154370 2023-08-17T00:10:00.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 -- 172.21.15.153:0/2012774988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 msgr2=0x7ff6680c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/2012774988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff6680c08b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7ff660009e90 tx=0x7ff660009780).stop 2023-08-17T00:10:00.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 -- 172.21.15.153:0/2012774988 shutdown_connections 2023-08-17T00:10:00.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/2012774988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff6680c08b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 -- 172.21.15.153:0/2012774988 >> 172.21.15.153:0/2012774988 conn(0x7ff668062a70 msgr2=0x7ff6680ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:00.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 -- 172.21.15.153:0/2012774988 shutdown_connections 2023-08-17T00:10:00.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.068+0000 7ff66c9f9700 1 -- 172.21.15.153:0/2012774988 wait complete. 2023-08-17T00:10:00.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 Processor -- start 2023-08-17T00:10:00.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 -- start start 2023-08-17T00:10:00.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6680c57a0 0x7ff668151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668153f50 0x7ff668167210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff668149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668151910 con 0x7ff6680c57a0 2023-08-17T00:10:00.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff668167700 con 0x7ff668153f50 2023-08-17T00:10:00.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.072+0000 7ff66c9f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680aed70 con 0x7ff668154370 2023-08-17T00:10:00.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff6677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6680c57a0 0x7ff668151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff668149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff668149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:46502/0 (socket says 172.21.15.153:46502) 2023-08-17T00:10:00.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 -- 172.21.15.153:0/4074986577 learned_addr learned my addr 172.21.15.153:0/4074986577 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:00.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff666ffd700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668153f50 0x7ff668167210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 -- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668153f50 msgr2=0x7ff668167210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668153f50 0x7ff668167210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 -- 172.21.15.153:0/4074986577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6680c57a0 msgr2=0x7ff668151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6680c57a0 0x7ff668151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 -- 172.21.15.153:0/4074986577 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660009a20 con 0x7ff668154370 2023-08-17T00:10:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff667fff700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff668149eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff66000b610 tx=0x7ff660009780).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:00.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff660021070 con 0x7ff668154370 2023-08-17T00:10:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff660013e90 con 0x7ff668154370 2023-08-17T00:10:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6681679a0 con 0x7ff668154370 2023-08-17T00:10:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66001d880 con 0x7ff668154370 2023-08-17T00:10:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6680aefc0 con 0x7ff668154370 2023-08-17T00:10:00.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.076+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6680af1e0 con 0x7ff668154370 2023-08-17T00:10:00.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.080+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff66001dbf0 con 0x7ff668154370 2023-08-17T00:10:00.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.080+0000 7ff64f7fe700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff65405a150 0x7ff65405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.080+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff660076530 con 0x7ff668154370 2023-08-17T00:10:00.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.080+0000 7ff6677fe700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff65405a150 0x7ff65405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.080+0000 7ff6677fe700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff65405a150 0x7ff65405c610 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7ff658005750 tx=0x7ff658009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:00.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.084+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff66004d980 con 0x7ff668154370 2023-08-17T00:10:00.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.304+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff66806b4c0 con 0x7ff668154370 2023-08-17T00:10:00.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.316+0000 7ff64f7fe700 1 -- 172.21.15.153:0/4074986577 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff66004d570 con 0x7ff668154370 2023-08-17T00:10:00.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.316+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff65405a150 msgr2=0x7ff65405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.316+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff65405a150 0x7ff65405c610 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7ff658005750 tx=0x7ff658009040).stop 2023-08-17T00:10:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.316+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 msgr2=0x7ff668149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.316+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff668149eb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7ff66000b610 tx=0x7ff660009780).stop 2023-08-17T00:10:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 shutdown_connections 2023-08-17T00:10:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff65405a150 0x7ff65405c610 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff668154370 0x7ff668149eb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff668153f50 0x7ff668167210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 --2- 172.21.15.153:0/4074986577 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6680c57a0 0x7ff668151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 >> 172.21.15.153:0/4074986577 conn(0x7ff668062a70 msgr2=0x7ff6680ac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 shutdown_connections 2023-08-17T00:10:00.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.320+0000 7ff66c9f9700 1 -- 172.21.15.153:0/4074986577 wait complete. 2023-08-17T00:10:00.326 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:10:00.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:00.351 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:10:00.340+0000 7fa46f5af700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:10:00.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.500+0000 7f5a0cb69700 1 Processor -- start 2023-08-17T00:10:00.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.500+0000 7f5a0cb69700 1 -- start start 2023-08-17T00:10:00.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5a080a8b70 0x7f5a080632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a080629b0 0x7f5a080bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a08065240 con 0x7f5a080a8f50 2023-08-17T00:10:00.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a08062e40 con 0x7f5a080a8b70 2023-08-17T00:10:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080638a0 con 0x7f5a080629b0 2023-08-17T00:10:00.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f59fdd9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5a080a8f50 0x7f5a080656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41342/0 (socket says 172.21.15.153:41342) 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f59fdd9b700 1 -- 172.21.15.153:0/913699351 learned_addr learned my addr 172.21.15.153:0/913699351 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0659c700 1 --2- 172.21.15.153:0/913699351 >> v2:172.21.15.153:3300/0 conn(0x7f5a080a8b70 0x7f5a080632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a06d9d700 1 --2- 172.21.15.153:0/913699351 >> v2:172.21.15.178:3300/0 conn(0x7f5a080629b0 0x7f5a080bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a05d9b700 1 -- 172.21.15.153:0/913699351 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069507672 0 0) 0x7f5a08065240 con 0x7f5a080a8f50 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a05d9b700 1 -- 172.21.15.153:0/913699351 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f40033f0 con 0x7f5a080a8f50 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0659c700 1 -- 172.21.15.153:0/913699351 >> v2:172.21.15.178:3300/0 conn(0x7f5a080629b0 msgr2=0x7f5a080bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:00.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0659c700 1 --2- 172.21.15.153:0/913699351 >> v2:172.21.15.178:3300/0 conn(0x7f5a080629b0 0x7f5a080bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0659c700 1 -- 172.21.15.153:0/913699351 >> v1:172.21.15.153:6789/0 conn(0x7f5a080a8f50 legacy=0x7f5a080656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0659c700 1 -- 172.21.15.153:0/913699351 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08065de0 con 0x7f5a080a8b70 2023-08-17T00:10:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0659c700 1 --2- 172.21.15.153:0/913699351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8b70 0x7f5a080632e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f5a08069b10 tx=0x7f59f8009060).ready entity=mon.0 client_cookie=63595f287388e95c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a05d9b700 1 -- 172.21.15.153:0/913699351 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800d4a0 con 0x7f5a080a8b70 2023-08-17T00:10:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a05d9b700 1 -- 172.21.15.153:0/913699351 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f800d600 con 0x7f5a080a8b70 2023-08-17T00:10:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a05d9b700 1 -- 172.21.15.153:0/913699351 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59f800d980 con 0x7f5a080a8b70 2023-08-17T00:10:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- 172.21.15.153:0/913699351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8b70 msgr2=0x7f5a080632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/913699351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8b70 0x7f5a080632e0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 rx=0x7f5a08069b10 tx=0x7f59f8009060).stop 2023-08-17T00:10:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- 172.21.15.153:0/913699351 shutdown_connections 2023-08-17T00:10:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/913699351 >> v2:172.21.15.178:3300/0 conn(0x7f5a080629b0 0x7f5a080bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/913699351 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8b70 0x7f5a080632e0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- 172.21.15.153:0/913699351 >> 172.21.15.153:0/913699351 conn(0x7f5a080c7150 msgr2=0x7f5a080c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.504+0000 7f5a0cb69700 1 -- 172.21.15.153:0/913699351 shutdown_connections 2023-08-17T00:10:00.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 -- 172.21.15.153:0/913699351 wait complete. 2023-08-17T00:10:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 Processor -- start 2023-08-17T00:10:00.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 -- start start 2023-08-17T00:10:00.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a080629b0 0x7f5a08158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a080a8b70 0x7f5a080a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 0x7f5a08149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080aaef0 con 0x7f5a080a8f50 2023-08-17T00:10:00.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080a9e70 con 0x7f5a080629b0 2023-08-17T00:10:00.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.508+0000 7f5a0cb69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080aa150 con 0x7f5a080a8b70 2023-08-17T00:10:00.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 0x7f5a08149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 0x7f5a08149bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60312/0 (socket says 172.21.15.153:60312) 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 -- 172.21.15.153:0/2130362758 learned_addr learned my addr 172.21.15.153:0/2130362758 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f59fdd9b700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a080a8b70 0x7f5a080a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a0659c700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a080629b0 0x7f5a08158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 -- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a080a8b70 msgr2=0x7f5a080a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a080a8b70 0x7f5a080a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 -- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a080629b0 msgr2=0x7f5a08158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a080629b0 0x7f5a08158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 -- 172.21.15.153:0/2130362758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80092a0 con 0x7f5a080a8f50 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a0659c700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a080629b0 0x7f5a08158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a06d9d700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 0x7f5a08149bb0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f5a00009e90 tx=0x7f5a0000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000cc20 con 0x7f5a080a8f50 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000f040 con 0x7f5a080a8f50 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a080aa430 con 0x7f5a080a8f50 2023-08-17T00:10:00.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00013400 con 0x7f5a080a8f50 2023-08-17T00:10:00.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0814a0a0 con 0x7f5a080a8f50 2023-08-17T00:10:00.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.512+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080aa670 con 0x7f5a080a8f50 2023-08-17T00:10:00.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.516+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5a000137b0 con 0x7f5a080a8f50 2023-08-17T00:10:00.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.516+0000 7f59feffd700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59e805a150 0x7f59e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:00.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.516+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5a00074b30 con 0x7f5a080a8f50 2023-08-17T00:10:00.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.516+0000 7f5a0659c700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59e805a150 0x7f59e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:00.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.516+0000 7f5a0659c700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59e805a150 0x7f59e805c610 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f59f8009fd0 tx=0x7f59f8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:00.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.520+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5a080aa670 con 0x7f5a080a8f50 2023-08-17T00:10:00.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.716+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a080aa670 con 0x7f5a080a8f50 2023-08-17T00:10:00.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.716+0000 7f59feffd700 1 -- 172.21.15.153:0/2130362758 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f5a080aa670 con 0x7f5a080a8f50 2023-08-17T00:10:00.723 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:00.724 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:10:00.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59e805a150 msgr2=0x7f59e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59e805a150 0x7f59e805c610 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f59f8009fd0 tx=0x7f59f8016000).stop 2023-08-17T00:10:00.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 msgr2=0x7f5a08149bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:00.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 0x7f5a08149bb0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f5a00009e90 tx=0x7f5a0000b040).stop 2023-08-17T00:10:00.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 shutdown_connections 2023-08-17T00:10:00.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f59e805a150 0x7f59e805c610 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5a080a8f50 0x7f5a08149bb0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a080a8b70 0x7f5a080a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 --2- 172.21.15.153:0/2130362758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a080629b0 0x7f5a08158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:00.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 >> 172.21.15.153:0/2130362758 conn(0x7f5a080c7150 msgr2=0x7f5a08155a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:00.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 shutdown_connections 2023-08-17T00:10:00.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:00.720+0000 7f5a0cb69700 1 -- 172.21.15.153:0/2130362758 wait complete. 2023-08-17T00:10:00.729 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:10:01.148 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:09:54.808513+0000', 'modified': '2023-08-17T00:09:58.219712+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7080}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7080': {'gid': 7080, 'name': 'a', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/1634760764', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6832', 'nonce': 1634760764}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 1634760764}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:10:01.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:10:01.149 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:10:01.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 Processor -- start 2023-08-17T00:10:01.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 -- start start 2023-08-17T00:10:01.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89640c57a0 0x7f89640c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964153f50 0x7f8964154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640bfd10 con 0x7f8964157600 2023-08-17T00:10:01.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8964154860 con 0x7f89640c57a0 2023-08-17T00:10:01.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.308+0000 7f8968fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8964154af0 con 0x7f8964153f50 2023-08-17T00:10:01.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f89637fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89640c57a0 0x7f89640c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f895bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964153f50 0x7f8964154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f89637fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89640c57a0 0x7f89640c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:45098/0 (socket says 172.21.15.153:45098) 2023-08-17T00:10:01.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f89637fe700 1 -- 172.21.15.153:0/1977174439 learned_addr learned my addr 172.21.15.153:0/1977174439 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f895bfff700 1 -- 172.21.15.153:0/1977174439 >> v2:172.21.15.178:3300/0 conn(0x7f89640c57a0 msgr2=0x7f89640c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f895bfff700 1 --2- 172.21.15.153:0/1977174439 >> v2:172.21.15.178:3300/0 conn(0x7f89640c57a0 0x7f89640c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f895bfff700 1 -- 172.21.15.153:0/1977174439 >> v1:172.21.15.178:6789/0 conn(0x7f8964157600 legacy=0x7f8964157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f895bfff700 1 -- 172.21.15.153:0/1977174439 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8964154dd0 con 0x7f8964153f50 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f895bfff700 1 --2- 172.21.15.153:0/1977174439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964153f50 0x7f8964154370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f894c009760 tx=0x7f894c009060).ready entity=mon.2 client_cookie=d79cd1ea12c2d94b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8962ffd700 1 -- 172.21.15.153:0/1977174439 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c00f510 con 0x7f8964153f50 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8962ffd700 1 -- 172.21.15.153:0/1977174439 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c00f670 con 0x7f8964153f50 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8962ffd700 1 -- 172.21.15.153:0/1977174439 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c00f9f0 con 0x7f8964153f50 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 -- 172.21.15.153:0/1977174439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964153f50 msgr2=0x7f8964154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 --2- 172.21.15.153:0/1977174439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964153f50 0x7f8964154370 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f894c009760 tx=0x7f894c009060).stop 2023-08-17T00:10:01.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 -- 172.21.15.153:0/1977174439 shutdown_connections 2023-08-17T00:10:01.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 --2- 172.21.15.153:0/1977174439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964153f50 0x7f8964154370 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 --2- 172.21.15.153:0/1977174439 >> v2:172.21.15.178:3300/0 conn(0x7f89640c57a0 0x7f89640c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 -- 172.21.15.153:0/1977174439 >> 172.21.15.153:0/1977174439 conn(0x7f8964062a70 msgr2=0x7f89640ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 -- 172.21.15.153:0/1977174439 shutdown_connections 2023-08-17T00:10:01.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.312+0000 7f8968fb9700 1 -- 172.21.15.153:0/1977174439 wait complete. 2023-08-17T00:10:01.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.316+0000 7f8968fb9700 1 Processor -- start 2023-08-17T00:10:01.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.316+0000 7f8968fb9700 1 -- start start 2023-08-17T00:10:01.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640c57a0 0x7f89640c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 0x7f8964144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964157600 0x7f89640c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c25f0 con 0x7f8964153f50 2023-08-17T00:10:01.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c19e0 con 0x7f89640c57a0 2023-08-17T00:10:01.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c1cc0 con 0x7f8964157600 2023-08-17T00:10:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 0x7f8964144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 0x7f8964144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60324/0 (socket says 172.21.15.153:60324) 2023-08-17T00:10:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 -- 172.21.15.153:0/2187458689 learned_addr learned my addr 172.21.15.153:0/2187458689 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8963fff700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964157600 0x7f89640c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f89637fe700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640c57a0 0x7f89640c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 -- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964157600 msgr2=0x7f89640c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964157600 0x7f89640c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 -- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640c57a0 msgr2=0x7f89640c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640c57a0 0x7f89640c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 -- 172.21.15.153:0/2187458689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0092a0 con 0x7f8964153f50 2023-08-17T00:10:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895bfff700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 0x7f8964144290 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f8964154c30 tx=0x7f894c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895b7fe700 1 -- 172.21.15.153:0/2187458689 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c00f7e0 con 0x7f8964153f50 2023-08-17T00:10:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895b7fe700 1 -- 172.21.15.153:0/2187458689 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c00f940 con 0x7f8964153f50 2023-08-17T00:10:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f895b7fe700 1 -- 172.21.15.153:0/2187458689 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c022660 con 0x7f8964153f50 2023-08-17T00:10:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89640c1fa0 con 0x7f8964153f50 2023-08-17T00:10:01.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.320+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89640c3fb0 con 0x7f8964153f50 2023-08-17T00:10:01.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.324+0000 7f895b7fe700 1 -- 172.21.15.153:0/2187458689 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f894c02b070 con 0x7f8964153f50 2023-08-17T00:10:01.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.324+0000 7f895b7fe700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f894405a150 0x7f894405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.324+0000 7f895b7fe700 1 -- 172.21.15.153:0/2187458689 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f894c075670 con 0x7f8964153f50 2023-08-17T00:10:01.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f89637fe700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f894405a150 0x7f894405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f89637fe700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f894405a150 0x7f894405c610 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f8954006fd0 tx=0x7f8954008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 Processor -- start 2023-08-17T00:10:01.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 -- start start 2023-08-17T00:10:01.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26d0b60 0x26d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 0x268a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x268ad90 0x26db760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25fa5c0 con 0x268c380 2023-08-17T00:10:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x260fe90 con 0x26d0b60 2023-08-17T00:10:01.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25d6220 con 0x268ad90 2023-08-17T00:10:01.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f895bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 0x268a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f895bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 0x268a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60336/0 (socket says 172.21.15.153:60336) 2023-08-17T00:10:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f895bfff700 1 -- 172.21.15.153:0/223104307 learned_addr learned my addr 172.21.15.153:0/223104307 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.328+0000 7f89637fe700 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26d0b60 0x26d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8963fff700 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x268ad90 0x26db760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f895bfff700 1 -- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x268ad90 msgr2=0x26db760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f895bfff700 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x268ad90 0x26db760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f895bfff700 1 -- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26d0b60 msgr2=0x26d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f895bfff700 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26d0b60 0x26d0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f895bfff700 1 -- 172.21.15.153:0/223104307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x261b500 con 0x268c380 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f895bfff700 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 0x268a8a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f894c04ca40 tx=0x7f894c00e000).ready entity=mon.0 client_cookie=fdfca63cb41d1b4c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8958ff9700 1 -- 172.21.15.153:0/223104307 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c020310 con 0x268c380 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8958ff9700 1 -- 172.21.15.153:0/223104307 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c04cc70 con 0x268c380 2023-08-17T00:10:01.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8958ff9700 1 -- 172.21.15.153:0/223104307 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894c0522a0 con 0x268c380 2023-08-17T00:10:01.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 -- 172.21.15.153:0/223104307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 msgr2=0x268a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 0x268a8a0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 rx=0x7f894c04ca40 tx=0x7f894c00e000).stop 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 -- 172.21.15.153:0/223104307 shutdown_connections 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x268ad90 0x26db760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268c380 0x268a8a0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 --2- 172.21.15.153:0/223104307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x26d0b60 0x26d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 -- 172.21.15.153:0/223104307 >> 172.21.15.153:0/223104307 conn(0x246e550 msgr2=0x268fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 -- 172.21.15.153:0/223104307 shutdown_connections 2023-08-17T00:10:01.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 -- 172.21.15.153:0/223104307 wait complete. 2023-08-17T00:10:01.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 -- start start 2023-08-17T00:10:01.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.332+0000 7f8974584740 1 Processor -- start 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26e2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25db110 con 0x268ad90 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x26ba1b0 con 0x268c380 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26e30f0 con 0x26d0b60 2023-08-17T00:10:01.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 10 client.0 ll_register_callbacks cb 0x26473c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60342/0 (socket says 172.21.15.153:60342) 2023-08-17T00:10:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 -- 172.21.15.153:0/1074260130 learned_addr learned my addr 172.21.15.153:0/1074260130 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8963fff700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26e2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f895bfff700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 -- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 msgr2=0x26e2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26e2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 -- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 msgr2=0x26b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 -- 172.21.15.153:0/1074260130 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89640c3fb0 con 0x268ad90 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f895bfff700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:01.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f89637fe700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d4db0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f8954015580 tx=0x7f8954018040).ready entity=mon.0 client_cookie=de86f7cfe3d686df server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8941ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8941ffb700 1 -- 172.21.15.153:0/1074260130 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954015ea0 con 0x268ad90 2023-08-17T00:10:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8941ffb700 1 -- 172.21.15.153:0/1074260130 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f89540145f0 con 0x268ad90 2023-08-17T00:10:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.336+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2605c60 con 0x268ad90 2023-08-17T00:10:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 1 -- 172.21.15.153:0/1074260130 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89540149c0 con 0x268ad90 2023-08-17T00:10:01.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 10 client.7221 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x2608f80 con 0x268ad90 2023-08-17T00:10:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 1 -- 172.21.15.153:0/1074260130 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2605c60 con 0x268ad90 2023-08-17T00:10:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 1 -- 172.21.15.153:0/1074260130 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8954014b20 con 0x268ad90 2023-08-17T00:10:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 10 client.7221 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 10 client.7221 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:10:01.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 20 client.7221 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:01.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26bbd70 0x26d2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 4 client.7221 mds_command: new command op to 7080 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:10:01.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25fc1b0 con 0x26bbd70 2023-08-17T00:10:01.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f895bfff700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26bbd70 0x26d2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 10 client.7221 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:01.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f895bfff700 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26bbd70 0x26d2990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=94510f3cda3d0250 server_cookie=2be49d1a2c7a67d6 in_seq=0 out_seq=0 2023-08-17T00:10:01.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 1 -- 172.21.15.153:0/1074260130 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x25fc1b0 con 0x26bbd70 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 10 client.7221 handle_command_reply: tid=0 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 client.7221 shutdown 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 msgr2=0x26d4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d4db0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 rx=0x7f8954015580 tx=0x7f8954018040).stop 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 shutdown_connections 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26bbd70 0x26d2990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26e2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8941ffb700 0 client.7221 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 --2- 172.21.15.153:0/1074260130 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d4db0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 >> 172.21.15.153:0/1074260130 conn(0x246e550 msgr2=0x268f150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 shutdown_connections 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.340+0000 7f8974584740 1 -- 172.21.15.153:0/1074260130 wait complete. 2023-08-17T00:10:01.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.344+0000 7f8974584740 20 client.7221 trim_cache size 0 max 16384 2023-08-17T00:10:01.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.360+0000 7f8974584740 1 Processor -- start 2023-08-17T00:10:01.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.360+0000 7f8974584740 1 -- start start 2023-08-17T00:10:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26ba2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26ba7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2685b00 con 0x268ad90 2023-08-17T00:10:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25dc0e0 con 0x268c380 2023-08-17T00:10:01.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2652db0 con 0x26d0b60 2023-08-17T00:10:01.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60352/0 (socket says 172.21.15.153:60352) 2023-08-17T00:10:01.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 -- 172.21.15.153:0/201595158 learned_addr learned my addr 172.21.15.153:0/201595158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f895bfff700 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26ba2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8963fff700 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26ba7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 -- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 msgr2=0x26ba7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26ba7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 -- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 msgr2=0x26ba2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26ba2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 -- 172.21.15.153:0/201595158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640c9e30 con 0x268ad90 2023-08-17T00:10:01.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89637fe700 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d5610 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f8954008010 tx=0x7f8954019000).ready entity=mon.0 client_cookie=e1ea7ddb4c332c2c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89597fa700 1 -- 172.21.15.153:0/201595158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954015ea0 con 0x268ad90 2023-08-17T00:10:01.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89597fa700 1 -- 172.21.15.153:0/201595158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954015c20 con 0x268ad90 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f89597fa700 1 -- 172.21.15.153:0/201595158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954014bf0 con 0x268ad90 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 -- 172.21.15.153:0/201595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 msgr2=0x26d5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d5610 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 rx=0x7f8954008010 tx=0x7f8954019000).stop 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 -- 172.21.15.153:0/201595158 shutdown_connections 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x26ba7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26ba2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 --2- 172.21.15.153:0/201595158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x268ad90 0x26d5610 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.364+0000 7f8974584740 1 -- 172.21.15.153:0/201595158 >> 172.21.15.153:0/201595158 conn(0x246e550 msgr2=0x268fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.368+0000 7f8974584740 1 -- 172.21.15.153:0/201595158 shutdown_connections 2023-08-17T00:10:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.368+0000 7f8974584740 1 -- 172.21.15.153:0/201595158 wait complete. 2023-08-17T00:10:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.368+0000 7f8974584740 1 -- start start 2023-08-17T00:10:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.368+0000 7f8974584740 1 Processor -- start 2023-08-17T00:10:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26df440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x27403e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 0x26ebbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x26e3460 con 0x26eb7b0 2023-08-17T00:10:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x26dfcd0 con 0x268c380 2023-08-17T00:10:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x26ec550 con 0x26d0b60 2023-08-17T00:10:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 10 client.0 ll_register_callbacks cb 0x7f8954011cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:01.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 0x26ebbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 0x26ebbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60362/0 (socket says 172.21.15.153:60362) 2023-08-17T00:10:01.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 -- 172.21.15.153:0/3822342007 learned_addr learned my addr 172.21.15.153:0/3822342007 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f89637fe700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26df440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f895bfff700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x27403e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 -- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 msgr2=0x27403e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x27403e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 -- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 msgr2=0x26df440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26df440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 -- 172.21.15.153:0/3822342007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2608f80 con 0x26eb7b0 2023-08-17T00:10:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f89637fe700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26df440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8963fff700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 0x26ebbb0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f895c007fd0 tx=0x7f895c001530).ready entity=mon.0 client_cookie=9b92bbe28e91a218 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 1 -- 172.21.15.153:0/3822342007 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c016e90 con 0x26eb7b0 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f894c04cc70 con 0x26eb7b0 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 1 -- 172.21.15.153:0/3822342007 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f895c014a10 con 0x26eb7b0 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 1 -- 172.21.15.153:0/3822342007 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f895c014bd0 con 0x26eb7b0 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 10 client.7227 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:01.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x2604420 con 0x26eb7b0 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 1 -- 172.21.15.153:0/3822342007 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894c04cc70 con 0x26eb7b0 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 1 -- 172.21.15.153:0/3822342007 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f895c014d30 con 0x26eb7b0 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 10 client.7227 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 10 client.7227 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 20 client.7227 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26d2e30 0x26b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 4 client.7227 mds_command: new command op to 7080 tid=0[{"prefix": "status"}] 2023-08-17T00:10:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "status"}) v1 -- 0x24c54e0 con 0x26d2e30 2023-08-17T00:10:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f89637fe700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26d2e30 0x26b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f8941ffb700 10 client.7227 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.372+0000 7f89637fe700 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26d2e30 0x26b2f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e28716011b5299c9 server_cookie=ddcec1ceeaf466d8 in_seq=0 out_seq=0 2023-08-17T00:10:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8941ffb700 1 -- 172.21.15.153:0/3822342007 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x24c54e0 con 0x26d2e30 2023-08-17T00:10:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8941ffb700 10 client.7227 handle_command_reply: tid=0 2023-08-17T00:10:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 client.7227 shutdown 2023-08-17T00:10:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 msgr2=0x26ebbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 0x26ebbb0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 rx=0x7f895c007fd0 tx=0x7f895c001530).stop 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 shutdown_connections 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x26d2e30 0x26b2f70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x26eb7b0 0x26ebbb0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x26d0b60 0x27403e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 --2- 172.21.15.153:0/3822342007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x268c380 0x26df440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8941ffb700 0 client.7227 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 >> 172.21.15.153:0/3822342007 conn(0x246e550 msgr2=0x268fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 shutdown_connections 2023-08-17T00:10:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 1 -- 172.21.15.153:0/3822342007 wait complete. 2023-08-17T00:10:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8974584740 20 client.7227 trim_cache size 0 max 16384 2023-08-17T00:10:01.386 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:10:01.386 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:10:01.386 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 7080, 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.5650078140000003, 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 85, 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 98, 2023-08-17T00:10:01.387 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 98, 2023-08-17T00:10:01.388 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.950544997 2023-08-17T00:10:01.388 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:10:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f894405a150 msgr2=0x7f894405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f894405a150 0x7f894405c610 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f8954006fd0 tx=0x7f8954008040).stop 2023-08-17T00:10:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 msgr2=0x7f8964144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 0x7f8964144290 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f8964154c30 tx=0x7f894c017000).stop 2023-08-17T00:10:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 shutdown_connections 2023-08-17T00:10:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f894405a150 0x7f894405c610 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964157600 0x7f89640c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8964153f50 0x7f8964144290 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 --2- 172.21.15.153:0/2187458689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640c57a0 0x7f89640c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 >> 172.21.15.153:0/2187458689 conn(0x7f8964062a70 msgr2=0x7f896405dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 shutdown_connections 2023-08-17T00:10:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.376+0000 7f8968fb9700 1 -- 172.21.15.153:0/2187458689 wait complete. 2023-08-17T00:10:01.404 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:10:01.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.528+0000 7f0bb5107700 1 Processor -- start 2023-08-17T00:10:01.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.528+0000 7f0bb5107700 1 -- start start 2023-08-17T00:10:01.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.528+0000 7f0bb5107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0061f00 0x7f0bb0062360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb00a38e0 con 0x7f0bb00a3d70 2023-08-17T00:10:01.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bb0062850 con 0x7f0bb0153ac0 2023-08-17T00:10:01.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00c4fb0 con 0x7f0bb0061f00 2023-08-17T00:10:01.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb4906700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0bb00a3d70 0x7f0bb00a4200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:41356/0 (socket says 172.21.15.153:41356) 2023-08-17T00:10:01.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb4906700 1 -- 172.21.15.153:0/43647375 learned_addr learned my addr 172.21.15.153:0/43647375 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:01.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0ba77fe700 1 --2- 172.21.15.153:0/43647375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0061f00 0x7f0bb0062360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0baf7fe700 1 -- 172.21.15.153:0/43647375 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84135592 0 0) 0x7f0bb00a38e0 con 0x7f0bb00a3d70 2023-08-17T00:10:01.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0baf7fe700 1 -- 172.21.15.153:0/43647375 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b9c0033f0 con 0x7f0bb00a3d70 2023-08-17T00:10:01.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0ba77fe700 1 -- 172.21.15.153:0/43647375 >> v1:172.21.15.178:6789/0 conn(0x7f0bb0153ac0 legacy=0x7f0bb00bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0ba77fe700 1 -- 172.21.15.153:0/43647375 >> v1:172.21.15.153:6789/0 conn(0x7f0bb00a3d70 legacy=0x7f0bb00a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0ba77fe700 1 -- 172.21.15.153:0/43647375 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00c5290 con 0x7f0bb0061f00 2023-08-17T00:10:01.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0ba77fe700 1 --2- 172.21.15.153:0/43647375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0061f00 0x7f0bb0062360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0b98009790 tx=0x7f0b98009060).ready entity=mon.2 client_cookie=63f6729581e14e7f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0baf7fe700 1 -- 172.21.15.153:0/43647375 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800f510 con 0x7f0bb0061f00 2023-08-17T00:10:01.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0baf7fe700 1 -- 172.21.15.153:0/43647375 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9800f670 con 0x7f0bb0061f00 2023-08-17T00:10:01.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0baf7fe700 1 -- 172.21.15.153:0/43647375 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9800f9f0 con 0x7f0bb0061f00 2023-08-17T00:10:01.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- 172.21.15.153:0/43647375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0061f00 msgr2=0x7f0bb0062360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 --2- 172.21.15.153:0/43647375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0061f00 0x7f0bb0062360 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f0b98009790 tx=0x7f0b98009060).stop 2023-08-17T00:10:01.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- 172.21.15.153:0/43647375 shutdown_connections 2023-08-17T00:10:01.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 --2- 172.21.15.153:0/43647375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb0061f00 0x7f0bb0062360 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- 172.21.15.153:0/43647375 >> 172.21.15.153:0/43647375 conn(0x7f0bb005dca0 msgr2=0x7f0bb005e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- 172.21.15.153:0/43647375 shutdown_connections 2023-08-17T00:10:01.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.532+0000 7f0bb5107700 1 -- 172.21.15.153:0/43647375 wait complete. 2023-08-17T00:10:01.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 Processor -- start 2023-08-17T00:10:01.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 -- start start 2023-08-17T00:10:01.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 0x7f0bb0149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb00a3d70 0x7f0bb0159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0153ac0 0x7f0bb015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb015a500 con 0x7f0bb0061f00 2023-08-17T00:10:01.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb0149680 con 0x7f0bb0153ac0 2023-08-17T00:10:01.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.536+0000 7f0bb5107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb00bd850 con 0x7f0bb00a3d70 2023-08-17T00:10:01.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 0x7f0bb0149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0ba77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb00a3d70 0x7f0bb0159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 0x7f0bb0149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60370/0 (socket says 172.21.15.153:60370) 2023-08-17T00:10:01.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 -- 172.21.15.153:0/679056896 learned_addr learned my addr 172.21.15.153:0/679056896 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:01.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0bb4906700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0153ac0 0x7f0bb015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 -- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb00a3d70 msgr2=0x7f0bb0159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb00a3d70 0x7f0bb0159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 -- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0153ac0 msgr2=0x7f0bb015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0153ac0 0x7f0bb015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 -- 172.21.15.153:0/679056896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b980092a0 con 0x7f0bb0061f00 2023-08-17T00:10:01.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0baffff700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 0x7f0bb0149190 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f0ba000c470 tx=0x7f0ba0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0007020 con 0x7f0bb0061f00 2023-08-17T00:10:01.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba0007180 con 0x7f0bb0061f00 2023-08-17T00:10:01.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb00bfac0 con 0x7f0bb0061f00 2023-08-17T00:10:01.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba0007520 con 0x7f0bb0061f00 2023-08-17T00:10:01.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.540+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb00c0080 con 0x7f0bb0061f00 2023-08-17T00:10:01.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.544+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb005ec30 con 0x7f0bb0061f00 2023-08-17T00:10:01.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.544+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0ba0010070 con 0x7f0bb0061f00 2023-08-17T00:10:01.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.544+0000 7f0bacff9700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9005a180 0x7f0b9005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:01.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.544+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ba0073150 con 0x7f0bb0061f00 2023-08-17T00:10:01.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.544+0000 7f0ba77fe700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9005a180 0x7f0b9005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:01.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.548+0000 7f0ba77fe700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9005a180 0x7f0b9005c640 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0b980096e0 tx=0x7f0b98017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:01.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.552+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ba0046c00 con 0x7f0bb0061f00 2023-08-17T00:10:01.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.744+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0bb00c7480 con 0x7f0bb0061f00 2023-08-17T00:10:01.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.744+0000 7f0bacff9700 1 -- 172.21.15.153:0/679056896 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0ba004a220 con 0x7f0bb0061f00 2023-08-17T00:10:01.751 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:10:01.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9005a180 msgr2=0x7f0b9005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9005a180 0x7f0b9005c640 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f0b980096e0 tx=0x7f0b98017000).stop 2023-08-17T00:10:01.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 msgr2=0x7f0bb0149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:01.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 0x7f0bb0149190 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 rx=0x7f0ba000c470 tx=0x7f0ba0007e00).stop 2023-08-17T00:10:01.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 shutdown_connections 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b9005a180 0x7f0b9005c640 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bb0153ac0 0x7f0bb015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bb00a3d70 0x7f0bb0159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 --2- 172.21.15.153:0/679056896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0bb0061f00 0x7f0bb0149190 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 >> 172.21.15.153:0/679056896 conn(0x7f0bb005dca0 msgr2=0x7f0bb0066dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 shutdown_connections 2023-08-17T00:10:01.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:01.748+0000 7f0bb5107700 1 -- 172.21.15.153:0/679056896 wait complete. 2023-08-17T00:10:01.771 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:10:01.771 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:10:01.771 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:10:01.772 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:10:01.772 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:10:01.772 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:10:01.773 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:10:01.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:10:01.773 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:10:01.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:01.774 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:10:01.792 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:10:01.793 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:10:01.794 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 42011sec preferred_lft 42011sec 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:10:01.795 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:10:01.796 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:10:01.797 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:10:01.798 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:10:01.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:01.799 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:10:01.874 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:10:01.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:01.877 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:10:01.939 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:10:01.939 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:10:01.939 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:10:01.940 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:10:01.940 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:10:01.940 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:10:01.940 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:10:01.941 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:10:01.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:01.942 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:10:01.942 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:01.942 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:10:01.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:10:01.943 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:10:01.943 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:02.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:02.080 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:10:02.097 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:10:02.097 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:10:02.099 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:10:02.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:02.100 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:10:02.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:02.176 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:10:02.235 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:10:02.235 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:10:02.355 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:10:02.355 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:10:02.376 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:10:02.376 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:10:02.381 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:10:02.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:02.381 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:10:02.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:02.413 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:02.413 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:02.413 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.0 2023-08-17T00:10:02.413 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:02.414 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:02.414 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:02.414 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:02.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.541 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345037 s, 30.4 MB/s 2023-08-17T00:10:02.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.575 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029742 s, 35.3 MB/s 2023-08-17T00:10:02.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0415426 s, 25.2 MB/s 2023-08-17T00:10:02.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.655 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306805 s, 34.2 MB/s 2023-08-17T00:10:02.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.693 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335063 s, 31.3 MB/s 2023-08-17T00:10:02.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.729 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321179 s, 32.6 MB/s 2023-08-17T00:10:02.766 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.767 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.767 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032842 s, 31.9 MB/s 2023-08-17T00:10:02.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.805 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343001 s, 30.6 MB/s 2023-08-17T00:10:02.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.836 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264687 s, 39.6 MB/s 2023-08-17T00:10:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340315 s, 30.8 MB/s 2023-08-17T00:10:02.901 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.902 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.902 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246093 s, 42.6 MB/s 2023-08-17T00:10:02.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.940 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353524 s, 29.7 MB/s 2023-08-17T00:10:02.975 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:02.975 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:02.975 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032581 s, 32.2 MB/s 2023-08-17T00:10:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.010 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311897 s, 33.6 MB/s 2023-08-17T00:10:03.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.035 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205166 s, 51.1 MB/s 2023-08-17T00:10:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262137 s, 40.0 MB/s 2023-08-17T00:10:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.092 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233633 s, 44.9 MB/s 2023-08-17T00:10:03.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.118 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212711 s, 49.3 MB/s 2023-08-17T00:10:03.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.145 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241248 s, 43.5 MB/s 2023-08-17T00:10:03.174 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.175 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259134 s, 40.5 MB/s 2023-08-17T00:10:03.211 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.212 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326034 s, 32.2 MB/s 2023-08-17T00:10:03.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.242 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275902 s, 38.0 MB/s 2023-08-17T00:10:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247124 s, 42.4 MB/s 2023-08-17T00:10:03.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.299 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245442 s, 42.7 MB/s 2023-08-17T00:10:03.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291403 s, 36.0 MB/s 2023-08-17T00:10:03.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.362 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.362 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243179 s, 43.1 MB/s 2023-08-17T00:10:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.391 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252172 s, 41.6 MB/s 2023-08-17T00:10:03.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.427 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314233 s, 33.4 MB/s 2023-08-17T00:10:03.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.450 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200043 s, 52.4 MB/s 2023-08-17T00:10:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.476 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.477 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233806 s, 44.8 MB/s 2023-08-17T00:10:03.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.504 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226544 s, 46.3 MB/s 2023-08-17T00:10:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023897 s, 43.9 MB/s 2023-08-17T00:10:03.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:03.533 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:03.533 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:03.534 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.1 2023-08-17T00:10:03.534 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:03.534 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:03.535 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:03.535 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:03.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025953 s, 40.4 MB/s 2023-08-17T00:10:03.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281345 s, 37.3 MB/s 2023-08-17T00:10:03.652 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.653 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.653 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237932 s, 44.1 MB/s 2023-08-17T00:10:03.684 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.684 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.684 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265172 s, 39.5 MB/s 2023-08-17T00:10:03.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.715 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261778 s, 40.1 MB/s 2023-08-17T00:10:03.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.753 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.753 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333612 s, 31.4 MB/s 2023-08-17T00:10:03.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.783 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263315 s, 39.8 MB/s 2023-08-17T00:10:03.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235741 s, 44.5 MB/s 2023-08-17T00:10:03.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273318 s, 38.4 MB/s 2023-08-17T00:10:03.874 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.875 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287197 s, 36.5 MB/s 2023-08-17T00:10:03.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255314 s, 41.1 MB/s 2023-08-17T00:10:03.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279771 s, 37.5 MB/s 2023-08-17T00:10:03.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022825 s, 45.9 MB/s 2023-08-17T00:10:03.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267304 s, 39.2 MB/s 2023-08-17T00:10:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298813 s, 35.1 MB/s 2023-08-17T00:10:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204879 s, 51.2 MB/s 2023-08-17T00:10:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.085 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269171 s, 39.0 MB/s 2023-08-17T00:10:04.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.123 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330405 s, 31.7 MB/s 2023-08-17T00:10:04.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.152 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240231 s, 43.6 MB/s 2023-08-17T00:10:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.182 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263303 s, 39.8 MB/s 2023-08-17T00:10:04.208 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228657 s, 45.9 MB/s 2023-08-17T00:10:04.235 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.236 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.236 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229558 s, 45.7 MB/s 2023-08-17T00:10:04.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.278 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0373243 s, 28.1 MB/s 2023-08-17T00:10:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.306 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.307 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024673 s, 42.5 MB/s 2023-08-17T00:10:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.334 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.334 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238682 s, 43.9 MB/s 2023-08-17T00:10:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.362 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.363 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252203 s, 41.6 MB/s 2023-08-17T00:10:04.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.401 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0353374 s, 29.7 MB/s 2023-08-17T00:10:04.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.423 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186384 s, 56.3 MB/s 2023-08-17T00:10:04.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.446 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202191 s, 51.9 MB/s 2023-08-17T00:10:04.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.467 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189492 s, 55.3 MB/s 2023-08-17T00:10:04.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.492 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228262 s, 45.9 MB/s 2023-08-17T00:10:04.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.519 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239736 s, 43.7 MB/s 2023-08-17T00:10:04.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:04.521 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:04.521 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:04.521 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.2 2023-08-17T00:10:04.522 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:04.522 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:04.522 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:04.522 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:04.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.581 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286016 s, 36.7 MB/s 2023-08-17T00:10:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247549 s, 42.4 MB/s 2023-08-17T00:10:04.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.640 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025131 s, 41.7 MB/s 2023-08-17T00:10:04.677 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.678 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336783 s, 31.1 MB/s 2023-08-17T00:10:04.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.702 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019894 s, 52.7 MB/s 2023-08-17T00:10:04.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.733 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281212 s, 37.3 MB/s 2023-08-17T00:10:04.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.761 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228844 s, 45.8 MB/s 2023-08-17T00:10:04.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.790 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259629 s, 40.4 MB/s 2023-08-17T00:10:04.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026516 s, 39.5 MB/s 2023-08-17T00:10:04.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.850 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242656 s, 43.2 MB/s 2023-08-17T00:10:04.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.880 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266048 s, 39.4 MB/s 2023-08-17T00:10:04.908 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.908 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.909 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239009 s, 43.9 MB/s 2023-08-17T00:10:04.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.940 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269541 s, 38.9 MB/s 2023-08-17T00:10:04.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.968 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248809 s, 42.1 MB/s 2023-08-17T00:10:04.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:04.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:04.997 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249168 s, 42.1 MB/s 2023-08-17T00:10:05.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.029 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272206 s, 38.5 MB/s 2023-08-17T00:10:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.056 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247802 s, 42.3 MB/s 2023-08-17T00:10:05.087 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.087 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.087 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026289 s, 39.9 MB/s 2023-08-17T00:10:05.115 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.115 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.115 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238322 s, 44.0 MB/s 2023-08-17T00:10:05.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.146 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258108 s, 40.6 MB/s 2023-08-17T00:10:05.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.173 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023642 s, 44.4 MB/s 2023-08-17T00:10:05.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.202 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249631 s, 42.0 MB/s 2023-08-17T00:10:05.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230479 s, 45.5 MB/s 2023-08-17T00:10:05.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.258 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.258 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250988 s, 41.8 MB/s 2023-08-17T00:10:05.284 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.285 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235338 s, 44.6 MB/s 2023-08-17T00:10:05.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296831 s, 35.3 MB/s 2023-08-17T00:10:05.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.347 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.347 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243587 s, 43.0 MB/s 2023-08-17T00:10:05.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.372 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204067 s, 51.4 MB/s 2023-08-17T00:10:05.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.404 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275923 s, 38.0 MB/s 2023-08-17T00:10:05.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030816 s, 34.0 MB/s 2023-08-17T00:10:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235876 s, 44.5 MB/s 2023-08-17T00:10:05.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231047 s, 45.4 MB/s 2023-08-17T00:10:05.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:05.496 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:05.496 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:05.496 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.3 2023-08-17T00:10:05.497 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:05.497 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:05.498 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:05.498 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:05.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.553 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.553 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240134 s, 43.7 MB/s 2023-08-17T00:10:05.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.586 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293304 s, 35.8 MB/s 2023-08-17T00:10:05.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.617 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258218 s, 40.6 MB/s 2023-08-17T00:10:05.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250796 s, 41.8 MB/s 2023-08-17T00:10:05.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.675 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023405 s, 44.8 MB/s 2023-08-17T00:10:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.706 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277353 s, 37.8 MB/s 2023-08-17T00:10:05.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.735 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256238 s, 40.9 MB/s 2023-08-17T00:10:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249791 s, 42.0 MB/s 2023-08-17T00:10:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237547 s, 44.1 MB/s 2023-08-17T00:10:05.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.819 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233936 s, 44.8 MB/s 2023-08-17T00:10:05.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.847 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241756 s, 43.4 MB/s 2023-08-17T00:10:05.874 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.875 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023709 s, 44.2 MB/s 2023-08-17T00:10:05.899 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.900 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204177 s, 51.4 MB/s 2023-08-17T00:10:05.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.930 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256449 s, 40.9 MB/s 2023-08-17T00:10:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.958 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234201 s, 44.8 MB/s 2023-08-17T00:10:05.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:05.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:05.984 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225044 s, 46.6 MB/s 2023-08-17T00:10:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238896 s, 43.9 MB/s 2023-08-17T00:10:06.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.036 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.036 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209335 s, 50.1 MB/s 2023-08-17T00:10:06.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224547 s, 46.7 MB/s 2023-08-17T00:10:06.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243479 s, 43.1 MB/s 2023-08-17T00:10:06.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.120 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025804 s, 40.6 MB/s 2023-08-17T00:10:06.143 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.143 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.143 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196433 s, 53.4 MB/s 2023-08-17T00:10:06.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230849 s, 45.4 MB/s 2023-08-17T00:10:06.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.197 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238681 s, 43.9 MB/s 2023-08-17T00:10:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.227 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250701 s, 41.8 MB/s 2023-08-17T00:10:06.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.261 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293679 s, 35.7 MB/s 2023-08-17T00:10:06.290 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.291 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253776 s, 41.3 MB/s 2023-08-17T00:10:06.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234751 s, 44.7 MB/s 2023-08-17T00:10:06.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260799 s, 40.2 MB/s 2023-08-17T00:10:06.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252802 s, 41.5 MB/s 2023-08-17T00:10:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024738 s, 42.4 MB/s 2023-08-17T00:10:06.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.433 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228919 s, 45.8 MB/s 2023-08-17T00:10:06.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:06.435 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:06.435 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:06.436 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.4 2023-08-17T00:10:06.436 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:06.436 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:06.437 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:06.437 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:06.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225783 s, 46.4 MB/s 2023-08-17T00:10:06.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.521 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231443 s, 45.3 MB/s 2023-08-17T00:10:06.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.545 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.545 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220831 s, 47.5 MB/s 2023-08-17T00:10:06.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210697 s, 49.8 MB/s 2023-08-17T00:10:06.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.597 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232115 s, 45.2 MB/s 2023-08-17T00:10:06.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.625 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247582 s, 42.4 MB/s 2023-08-17T00:10:06.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213955 s, 49.0 MB/s 2023-08-17T00:10:06.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231832 s, 45.2 MB/s 2023-08-17T00:10:06.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.718 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342618 s, 30.6 MB/s 2023-08-17T00:10:06.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.747 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247212 s, 42.4 MB/s 2023-08-17T00:10:06.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.775 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023352 s, 44.9 MB/s 2023-08-17T00:10:06.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.807 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284355 s, 36.9 MB/s 2023-08-17T00:10:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.831 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215878 s, 48.6 MB/s 2023-08-17T00:10:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.861 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249159 s, 42.1 MB/s 2023-08-17T00:10:06.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.896 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.896 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308819 s, 34.0 MB/s 2023-08-17T00:10:06.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.935 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343254 s, 30.5 MB/s 2023-08-17T00:10:06.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.965 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026603 s, 39.4 MB/s 2023-08-17T00:10:06.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:06.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:06.995 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258953 s, 40.5 MB/s 2023-08-17T00:10:07.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.026 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274601 s, 38.2 MB/s 2023-08-17T00:10:07.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.057 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261872 s, 40.0 MB/s 2023-08-17T00:10:07.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.080 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206109 s, 50.9 MB/s 2023-08-17T00:10:07.108 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.109 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241687 s, 43.4 MB/s 2023-08-17T00:10:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027924 s, 37.6 MB/s 2023-08-17T00:10:07.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.171 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025683 s, 40.8 MB/s 2023-08-17T00:10:07.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.197 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022615 s, 46.4 MB/s 2023-08-17T00:10:07.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.230 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287351 s, 36.5 MB/s 2023-08-17T00:10:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240142 s, 43.7 MB/s 2023-08-17T00:10:07.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.281 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190355 s, 55.1 MB/s 2023-08-17T00:10:07.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.309 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248014 s, 42.3 MB/s 2023-08-17T00:10:07.339 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.339 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.339 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248898 s, 42.1 MB/s 2023-08-17T00:10:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.369 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264052 s, 39.7 MB/s 2023-08-17T00:10:07.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.398 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242933 s, 43.2 MB/s 2023-08-17T00:10:07.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:07.400 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:07.400 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:07.400 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.5 2023-08-17T00:10:07.401 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:07.401 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:07.401 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:07.402 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:07.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.461 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253252 s, 41.4 MB/s 2023-08-17T00:10:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024662 s, 42.5 MB/s 2023-08-17T00:10:07.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.522 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027055 s, 38.8 MB/s 2023-08-17T00:10:07.549 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.550 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237938 s, 44.1 MB/s 2023-08-17T00:10:07.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.578 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253582 s, 41.4 MB/s 2023-08-17T00:10:07.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.602 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209858 s, 50.0 MB/s 2023-08-17T00:10:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.629 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236856 s, 44.3 MB/s 2023-08-17T00:10:07.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197215 s, 53.2 MB/s 2023-08-17T00:10:07.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.678 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240128 s, 43.7 MB/s 2023-08-17T00:10:07.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.709 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261731 s, 40.1 MB/s 2023-08-17T00:10:07.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.735 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212993 s, 49.2 MB/s 2023-08-17T00:10:07.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257775 s, 40.7 MB/s 2023-08-17T00:10:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.798 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293467 s, 35.7 MB/s 2023-08-17T00:10:07.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.833 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309929 s, 33.8 MB/s 2023-08-17T00:10:07.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.860 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228235 s, 45.9 MB/s 2023-08-17T00:10:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200736 s, 52.2 MB/s 2023-08-17T00:10:07.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.907 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218997 s, 47.9 MB/s 2023-08-17T00:10:07.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.930 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196073 s, 53.5 MB/s 2023-08-17T00:10:07.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.961 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273006 s, 38.4 MB/s 2023-08-17T00:10:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:07.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:07.993 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270446 s, 38.8 MB/s 2023-08-17T00:10:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.020 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221298 s, 47.4 MB/s 2023-08-17T00:10:08.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.045 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213455 s, 49.1 MB/s 2023-08-17T00:10:08.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.077 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271012 s, 38.7 MB/s 2023-08-17T00:10:08.109 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.109 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.109 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274286 s, 38.2 MB/s 2023-08-17T00:10:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.136 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225563 s, 46.5 MB/s 2023-08-17T00:10:08.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241875 s, 43.4 MB/s 2023-08-17T00:10:08.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221506 s, 47.3 MB/s 2023-08-17T00:10:08.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023079 s, 45.4 MB/s 2023-08-17T00:10:08.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.239 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186863 s, 56.1 MB/s 2023-08-17T00:10:08.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.266 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239257 s, 43.8 MB/s 2023-08-17T00:10:08.292 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.292 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224917 s, 46.6 MB/s 2023-08-17T00:10:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.326 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296466 s, 35.4 MB/s 2023-08-17T00:10:08.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:08.328 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:08.329 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:08.329 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.6 2023-08-17T00:10:08.329 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:08.330 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:08.330 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:08.330 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:08.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.393 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279997 s, 37.4 MB/s 2023-08-17T00:10:08.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248804 s, 42.1 MB/s 2023-08-17T00:10:08.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.449 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233256 s, 45.0 MB/s 2023-08-17T00:10:08.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.482 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283198 s, 37.0 MB/s 2023-08-17T00:10:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026287 s, 39.9 MB/s 2023-08-17T00:10:08.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.541 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236845 s, 44.3 MB/s 2023-08-17T00:10:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265585 s, 39.5 MB/s 2023-08-17T00:10:08.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.597 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224098 s, 46.8 MB/s 2023-08-17T00:10:08.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.627 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255252 s, 41.1 MB/s 2023-08-17T00:10:08.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.654 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228974 s, 45.8 MB/s 2023-08-17T00:10:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265308 s, 39.5 MB/s 2023-08-17T00:10:08.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.717 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02771 s, 37.8 MB/s 2023-08-17T00:10:08.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.752 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305834 s, 34.3 MB/s 2023-08-17T00:10:08.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.779 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213736 s, 49.1 MB/s 2023-08-17T00:10:08.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251171 s, 41.7 MB/s 2023-08-17T00:10:08.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242968 s, 43.2 MB/s 2023-08-17T00:10:08.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247426 s, 42.4 MB/s 2023-08-17T00:10:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304401 s, 34.4 MB/s 2023-08-17T00:10:08.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.929 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244322 s, 42.9 MB/s 2023-08-17T00:10:08.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:08.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:08.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326138 s, 32.2 MB/s 2023-08-17T00:10:09.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.000 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320979 s, 32.7 MB/s 2023-08-17T00:10:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.028 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023337 s, 44.9 MB/s 2023-08-17T00:10:09.050 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.051 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194706 s, 53.9 MB/s 2023-08-17T00:10:09.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.073 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192737 s, 54.4 MB/s 2023-08-17T00:10:09.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.103 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268651 s, 39.0 MB/s 2023-08-17T00:10:09.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287316 s, 36.5 MB/s 2023-08-17T00:10:09.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237609 s, 44.1 MB/s 2023-08-17T00:10:09.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.197 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280128 s, 37.4 MB/s 2023-08-17T00:10:09.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.224 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220141 s, 47.6 MB/s 2023-08-17T00:10:09.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.253 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249954 s, 42.0 MB/s 2023-08-17T00:10:09.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.284 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.284 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267012 s, 39.3 MB/s 2023-08-17T00:10:09.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256826 s, 40.8 MB/s 2023-08-17T00:10:09.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:09.316 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:09.316 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:09.317 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.7 2023-08-17T00:10:09.317 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:09.317 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:09.318 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:09.322 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:09.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225849 s, 46.4 MB/s 2023-08-17T00:10:09.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259891 s, 40.3 MB/s 2023-08-17T00:10:09.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.437 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293533 s, 35.7 MB/s 2023-08-17T00:10:09.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213786 s, 49.0 MB/s 2023-08-17T00:10:09.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.496 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315879 s, 33.2 MB/s 2023-08-17T00:10:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.521 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022319 s, 47.0 MB/s 2023-08-17T00:10:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.547 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.548 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218425 s, 48.0 MB/s 2023-08-17T00:10:09.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267452 s, 39.2 MB/s 2023-08-17T00:10:09.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.605 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230731 s, 45.4 MB/s 2023-08-17T00:10:09.642 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.643 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336037 s, 31.2 MB/s 2023-08-17T00:10:09.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.674 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270297 s, 38.8 MB/s 2023-08-17T00:10:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.703 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243941 s, 43.0 MB/s 2023-08-17T00:10:09.730 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.730 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.730 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240594 s, 43.6 MB/s 2023-08-17T00:10:09.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300691 s, 34.9 MB/s 2023-08-17T00:10:09.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.791 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229511 s, 45.7 MB/s 2023-08-17T00:10:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227415 s, 46.1 MB/s 2023-08-17T00:10:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264354 s, 39.7 MB/s 2023-08-17T00:10:09.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.875 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024204 s, 43.3 MB/s 2023-08-17T00:10:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250587 s, 41.8 MB/s 2023-08-17T00:10:09.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.935 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269992 s, 38.8 MB/s 2023-08-17T00:10:09.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025204 s, 41.6 MB/s 2023-08-17T00:10:09.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:09.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:09.989 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211122 s, 49.7 MB/s 2023-08-17T00:10:10.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.025 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323442 s, 32.4 MB/s 2023-08-17T00:10:10.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.055 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252621 s, 41.5 MB/s 2023-08-17T00:10:10.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203267 s, 51.6 MB/s 2023-08-17T00:10:10.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.106 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220353 s, 47.6 MB/s 2023-08-17T00:10:10.135 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.135 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.136 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253379 s, 41.4 MB/s 2023-08-17T00:10:10.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221078 s, 47.4 MB/s 2023-08-17T00:10:10.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253634 s, 41.3 MB/s 2023-08-17T00:10:10.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.224 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298972 s, 35.1 MB/s 2023-08-17T00:10:10.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.253 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241736 s, 43.4 MB/s 2023-08-17T00:10:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.280 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235293 s, 44.6 MB/s 2023-08-17T00:10:10.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:10.282 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:10.282 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:10.283 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.8 2023-08-17T00:10:10.283 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:10.284 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:10.284 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:10.285 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:10.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233976 s, 44.8 MB/s 2023-08-17T00:10:10.372 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.373 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259897 s, 40.3 MB/s 2023-08-17T00:10:10.399 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.399 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.399 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219085 s, 47.9 MB/s 2023-08-17T00:10:10.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.434 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312347 s, 33.6 MB/s 2023-08-17T00:10:10.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.463 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02503 s, 41.9 MB/s 2023-08-17T00:10:10.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242116 s, 43.3 MB/s 2023-08-17T00:10:10.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.523 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286528 s, 36.6 MB/s 2023-08-17T00:10:10.553 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.554 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257971 s, 40.6 MB/s 2023-08-17T00:10:10.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.581 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230965 s, 45.4 MB/s 2023-08-17T00:10:10.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257879 s, 40.7 MB/s 2023-08-17T00:10:10.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.640 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248313 s, 42.2 MB/s 2023-08-17T00:10:10.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.670 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251136 s, 41.8 MB/s 2023-08-17T00:10:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267457 s, 39.2 MB/s 2023-08-17T00:10:10.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.731 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261264 s, 40.1 MB/s 2023-08-17T00:10:10.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.761 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254447 s, 41.2 MB/s 2023-08-17T00:10:10.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.792 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266751 s, 39.3 MB/s 2023-08-17T00:10:10.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.821 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244433 s, 42.9 MB/s 2023-08-17T00:10:10.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246001 s, 42.6 MB/s 2023-08-17T00:10:10.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.875 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228285 s, 45.9 MB/s 2023-08-17T00:10:10.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:10.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:10.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276138 s, 38.0 MB/s 2023-08-17T00:10:10.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226066 s, 46.4 MB/s 2023-08-17T00:10:11.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.061 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235401 s, 44.5 MB/s 2023-08-17T00:10:11.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.061 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187085 s, 56.0 MB/s 2023-08-17T00:10:11.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025176 s, 41.6 MB/s 2023-08-17T00:10:11.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241615 s, 43.4 MB/s 2023-08-17T00:10:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314092 s, 33.4 MB/s 2023-08-17T00:10:11.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.101 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233512 s, 44.9 MB/s 2023-08-17T00:10:11.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.129 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.129 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237328 s, 44.2 MB/s 2023-08-17T00:10:11.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.159 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258019 s, 40.6 MB/s 2023-08-17T00:10:11.186 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.186 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.187 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239081 s, 43.9 MB/s 2023-08-17T00:10:11.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264009 s, 39.7 MB/s 2023-08-17T00:10:11.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.247 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263662 s, 39.8 MB/s 2023-08-17T00:10:11.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:11.250 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:11.250 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:11.250 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.9 2023-08-17T00:10:11.251 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:11.251 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:11.251 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:11.251 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:11.307 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.308 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.308 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247831 s, 42.3 MB/s 2023-08-17T00:10:11.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.337 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246504 s, 42.5 MB/s 2023-08-17T00:10:11.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.370 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293286 s, 35.8 MB/s 2023-08-17T00:10:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027026 s, 38.8 MB/s 2023-08-17T00:10:11.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218087 s, 48.1 MB/s 2023-08-17T00:10:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020773 s, 50.5 MB/s 2023-08-17T00:10:11.479 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.480 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230837 s, 45.4 MB/s 2023-08-17T00:10:11.505 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.505 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.506 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212691 s, 49.3 MB/s 2023-08-17T00:10:11.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.530 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215497 s, 48.7 MB/s 2023-08-17T00:10:11.557 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.558 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235877 s, 44.5 MB/s 2023-08-17T00:10:11.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.586 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238426 s, 44.0 MB/s 2023-08-17T00:10:11.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276441 s, 37.9 MB/s 2023-08-17T00:10:11.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.644 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229846 s, 45.6 MB/s 2023-08-17T00:10:11.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.674 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253285 s, 41.4 MB/s 2023-08-17T00:10:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.706 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281112 s, 37.3 MB/s 2023-08-17T00:10:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.733 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223885 s, 46.8 MB/s 2023-08-17T00:10:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.762 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244167 s, 42.9 MB/s 2023-08-17T00:10:11.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.796 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300969 s, 34.8 MB/s 2023-08-17T00:10:11.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.819 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198233 s, 52.9 MB/s 2023-08-17T00:10:11.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.841 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199947 s, 52.4 MB/s 2023-08-17T00:10:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207212 s, 50.6 MB/s 2023-08-17T00:10:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.895 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255445 s, 41.0 MB/s 2023-08-17T00:10:11.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223831 s, 46.8 MB/s 2023-08-17T00:10:11.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.946 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210981 s, 49.7 MB/s 2023-08-17T00:10:11.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:11.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:11.977 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271081 s, 38.7 MB/s 2023-08-17T00:10:12.004 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.005 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242757 s, 43.2 MB/s 2023-08-17T00:10:12.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.031 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229003 s, 45.8 MB/s 2023-08-17T00:10:12.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229477 s, 45.7 MB/s 2023-08-17T00:10:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.088 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282165 s, 37.2 MB/s 2023-08-17T00:10:12.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.126 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032169 s, 32.6 MB/s 2023-08-17T00:10:12.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.158 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288869 s, 36.3 MB/s 2023-08-17T00:10:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.189 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265986 s, 39.4 MB/s 2023-08-17T00:10:12.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:12.192 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:12.192 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:12.192 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.10 2023-08-17T00:10:12.193 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:12.193 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:12.193 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:12.194 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:12.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250329 s, 41.9 MB/s 2023-08-17T00:10:12.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.287 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027638 s, 37.9 MB/s 2023-08-17T00:10:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.318 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271826 s, 38.6 MB/s 2023-08-17T00:10:12.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.351 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027686 s, 37.9 MB/s 2023-08-17T00:10:12.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.384 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286262 s, 36.6 MB/s 2023-08-17T00:10:12.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.412 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234884 s, 44.6 MB/s 2023-08-17T00:10:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.443 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263865 s, 39.7 MB/s 2023-08-17T00:10:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.468 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212471 s, 49.4 MB/s 2023-08-17T00:10:12.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214362 s, 48.9 MB/s 2023-08-17T00:10:12.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.515 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195609 s, 53.6 MB/s 2023-08-17T00:10:12.556 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.556 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.556 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0359302 s, 29.2 MB/s 2023-08-17T00:10:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.584 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.585 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244741 s, 42.8 MB/s 2023-08-17T00:10:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.610 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225104 s, 46.6 MB/s 2023-08-17T00:10:12.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241417 s, 43.4 MB/s 2023-08-17T00:10:12.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.668 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244682 s, 42.9 MB/s 2023-08-17T00:10:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224569 s, 46.7 MB/s 2023-08-17T00:10:12.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.723 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242794 s, 43.2 MB/s 2023-08-17T00:10:12.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.751 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248093 s, 42.3 MB/s 2023-08-17T00:10:12.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.780 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024701 s, 42.5 MB/s 2023-08-17T00:10:12.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232641 s, 45.1 MB/s 2023-08-17T00:10:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.836 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023434 s, 44.7 MB/s 2023-08-17T00:10:12.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255962 s, 41.0 MB/s 2023-08-17T00:10:12.892 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.893 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224977 s, 46.6 MB/s 2023-08-17T00:10:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.920 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232697 s, 45.1 MB/s 2023-08-17T00:10:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.948 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025354 s, 41.4 MB/s 2023-08-17T00:10:12.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:12.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:12.978 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260618 s, 40.2 MB/s 2023-08-17T00:10:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.011 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285224 s, 36.8 MB/s 2023-08-17T00:10:13.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.040 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259725 s, 40.4 MB/s 2023-08-17T00:10:13.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.073 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289002 s, 36.3 MB/s 2023-08-17T00:10:13.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.105 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271587 s, 38.6 MB/s 2023-08-17T00:10:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274862 s, 38.1 MB/s 2023-08-17T00:10:13.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233685 s, 44.9 MB/s 2023-08-17T00:10:13.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:13.167 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:13.167 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:13.168 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.11 2023-08-17T00:10:13.168 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:13.168 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:13.168 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:13.169 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:13.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.225 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256486 s, 40.9 MB/s 2023-08-17T00:10:13.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.249 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206096 s, 50.9 MB/s 2023-08-17T00:10:13.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.274 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022569 s, 46.5 MB/s 2023-08-17T00:10:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237833 s, 44.1 MB/s 2023-08-17T00:10:13.325 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.326 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205198 s, 51.1 MB/s 2023-08-17T00:10:13.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.353 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228185 s, 46.0 MB/s 2023-08-17T00:10:13.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.382 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248341 s, 42.2 MB/s 2023-08-17T00:10:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.410 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240573 s, 43.6 MB/s 2023-08-17T00:10:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.439 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250954 s, 41.8 MB/s 2023-08-17T00:10:13.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236 s, 44.4 MB/s 2023-08-17T00:10:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231754 s, 45.2 MB/s 2023-08-17T00:10:13.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.520 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231308 s, 45.3 MB/s 2023-08-17T00:10:13.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.550 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258982 s, 40.5 MB/s 2023-08-17T00:10:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227551 s, 46.1 MB/s 2023-08-17T00:10:13.604 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.604 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.604 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226228 s, 46.4 MB/s 2023-08-17T00:10:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.631 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234893 s, 44.6 MB/s 2023-08-17T00:10:13.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168 s, 62.4 MB/s 2023-08-17T00:10:13.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.680 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252098 s, 41.6 MB/s 2023-08-17T00:10:13.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256311 s, 40.9 MB/s 2023-08-17T00:10:13.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.738 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236302 s, 44.4 MB/s 2023-08-17T00:10:13.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227466 s, 46.1 MB/s 2023-08-17T00:10:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239897 s, 43.7 MB/s 2023-08-17T00:10:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023251 s, 45.1 MB/s 2023-08-17T00:10:13.839 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173233 s, 60.5 MB/s 2023-08-17T00:10:13.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.874 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297322 s, 35.3 MB/s 2023-08-17T00:10:13.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.901 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229859 s, 45.6 MB/s 2023-08-17T00:10:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253728 s, 41.3 MB/s 2023-08-17T00:10:13.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:13.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029097 s, 36.0 MB/s 2023-08-17T00:10:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310157 s, 33.8 MB/s 2023-08-17T00:10:14.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.036 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310526 s, 33.8 MB/s 2023-08-17T00:10:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240444 s, 43.6 MB/s 2023-08-17T00:10:14.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.089 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215319 s, 48.7 MB/s 2023-08-17T00:10:14.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:14.091 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:14.092 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:14.092 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.12 2023-08-17T00:10:14.092 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:14.092 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:14.093 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:14.093 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:14.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.147 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231212 s, 45.4 MB/s 2023-08-17T00:10:14.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.179 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279811 s, 37.5 MB/s 2023-08-17T00:10:14.211 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.212 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294315 s, 35.6 MB/s 2023-08-17T00:10:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.238 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222371 s, 47.2 MB/s 2023-08-17T00:10:14.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.263 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211502 s, 49.6 MB/s 2023-08-17T00:10:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225742 s, 46.5 MB/s 2023-08-17T00:10:14.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242896 s, 43.2 MB/s 2023-08-17T00:10:14.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.345 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222295 s, 47.2 MB/s 2023-08-17T00:10:14.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.369 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211775 s, 49.5 MB/s 2023-08-17T00:10:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.391 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196842 s, 53.3 MB/s 2023-08-17T00:10:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.417 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.418 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218235 s, 48.0 MB/s 2023-08-17T00:10:14.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.452 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249586 s, 42.0 MB/s 2023-08-17T00:10:14.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.474 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243006 s, 43.2 MB/s 2023-08-17T00:10:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177871 s, 59.0 MB/s 2023-08-17T00:10:14.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.521 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248184 s, 42.2 MB/s 2023-08-17T00:10:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.548 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.549 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236482 s, 44.3 MB/s 2023-08-17T00:10:14.573 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.574 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225679 s, 46.5 MB/s 2023-08-17T00:10:14.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.599 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218576 s, 48.0 MB/s 2023-08-17T00:10:14.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.627 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239857 s, 43.7 MB/s 2023-08-17T00:10:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.656 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246539 s, 42.5 MB/s 2023-08-17T00:10:14.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244704 s, 42.9 MB/s 2023-08-17T00:10:14.711 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.711 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.711 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225928 s, 46.4 MB/s 2023-08-17T00:10:14.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.741 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259879 s, 40.3 MB/s 2023-08-17T00:10:14.770 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.771 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249129 s, 42.1 MB/s 2023-08-17T00:10:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.801 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267857 s, 39.1 MB/s 2023-08-17T00:10:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220448 s, 47.6 MB/s 2023-08-17T00:10:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195521 s, 53.6 MB/s 2023-08-17T00:10:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200608 s, 52.3 MB/s 2023-08-17T00:10:14.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.904 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271439 s, 38.6 MB/s 2023-08-17T00:10:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.928 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217559 s, 48.2 MB/s 2023-08-17T00:10:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.958 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259138 s, 40.5 MB/s 2023-08-17T00:10:14.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:14.996 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:14.996 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336614 s, 31.2 MB/s 2023-08-17T00:10:14.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:14.998 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:14.998 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:14.999 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.13 2023-08-17T00:10:14.999 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:14.999 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:15.000 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:15.000 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:15.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026879 s, 39.0 MB/s 2023-08-17T00:10:15.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.086 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.086 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231064 s, 45.4 MB/s 2023-08-17T00:10:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231766 s, 45.2 MB/s 2023-08-17T00:10:15.140 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.141 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240064 s, 43.7 MB/s 2023-08-17T00:10:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230932 s, 45.4 MB/s 2023-08-17T00:10:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.195 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223464 s, 46.9 MB/s 2023-08-17T00:10:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.221 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234586 s, 44.7 MB/s 2023-08-17T00:10:15.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.250 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241108 s, 43.5 MB/s 2023-08-17T00:10:15.278 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.278 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.278 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255935 s, 41.0 MB/s 2023-08-17T00:10:15.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.309 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266977 s, 39.3 MB/s 2023-08-17T00:10:15.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.345 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302624 s, 34.6 MB/s 2023-08-17T00:10:15.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298516 s, 35.1 MB/s 2023-08-17T00:10:15.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.406 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231314 s, 45.3 MB/s 2023-08-17T00:10:15.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.438 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279509 s, 37.5 MB/s 2023-08-17T00:10:15.465 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.465 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226926 s, 46.2 MB/s 2023-08-17T00:10:15.499 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.499 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.499 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300735 s, 34.9 MB/s 2023-08-17T00:10:15.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.534 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317849 s, 33.0 MB/s 2023-08-17T00:10:15.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218381 s, 48.0 MB/s 2023-08-17T00:10:15.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.588 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.588 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248526 s, 42.2 MB/s 2023-08-17T00:10:15.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.618 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272045 s, 38.5 MB/s 2023-08-17T00:10:15.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251275 s, 41.7 MB/s 2023-08-17T00:10:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.683 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032222 s, 32.5 MB/s 2023-08-17T00:10:15.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276387 s, 37.9 MB/s 2023-08-17T00:10:15.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.737 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205715 s, 51.0 MB/s 2023-08-17T00:10:15.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231492 s, 45.3 MB/s 2023-08-17T00:10:15.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.794 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252244 s, 41.6 MB/s 2023-08-17T00:10:15.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.820 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213577 s, 49.1 MB/s 2023-08-17T00:10:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218816 s, 47.9 MB/s 2023-08-17T00:10:15.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248008 s, 42.3 MB/s 2023-08-17T00:10:15.897 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:10:15.905 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:10:15.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.907 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268828 s, 39.0 MB/s 2023-08-17T00:10:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.928 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210594 s, 49.8 MB/s 2023-08-17T00:10:15.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:15.953 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205746 s, 51.0 MB/s 2023-08-17T00:10:15.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:15.954 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:15.955 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:15.955 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.14 2023-08-17T00:10:15.955 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:15.955 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:15.956 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:15.956 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.077 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255396 s, 41.1 MB/s 2023-08-17T00:10:16.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.103 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217872 s, 48.1 MB/s 2023-08-17T00:10:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.126 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202129 s, 51.9 MB/s 2023-08-17T00:10:16.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.162 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316014 s, 33.2 MB/s 2023-08-17T00:10:16.186 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.186 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.187 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205642 s, 51.0 MB/s 2023-08-17T00:10:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239553 s, 43.8 MB/s 2023-08-17T00:10:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.243 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245282 s, 42.7 MB/s 2023-08-17T00:10:16.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.269 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.269 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022336 s, 46.9 MB/s 2023-08-17T00:10:16.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.300 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273012 s, 38.4 MB/s 2023-08-17T00:10:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.327 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238064 s, 44.0 MB/s 2023-08-17T00:10:16.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.351 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204674 s, 51.2 MB/s 2023-08-17T00:10:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232076 s, 45.2 MB/s 2023-08-17T00:10:16.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.407 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240206 s, 43.7 MB/s 2023-08-17T00:10:16.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.434 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227191 s, 46.2 MB/s 2023-08-17T00:10:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.460 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217704 s, 48.2 MB/s 2023-08-17T00:10:16.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.483 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198061 s, 52.9 MB/s 2023-08-17T00:10:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.509 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222537 s, 47.1 MB/s 2023-08-17T00:10:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.536 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228999 s, 45.8 MB/s 2023-08-17T00:10:16.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264203 s, 39.7 MB/s 2023-08-17T00:10:16.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.594 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234775 s, 44.7 MB/s 2023-08-17T00:10:16.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.621 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229604 s, 45.7 MB/s 2023-08-17T00:10:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245871 s, 42.6 MB/s 2023-08-17T00:10:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255575 s, 41.0 MB/s 2023-08-17T00:10:16.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265732 s, 39.5 MB/s 2023-08-17T00:10:16.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.734 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195539 s, 53.6 MB/s 2023-08-17T00:10:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303268 s, 34.6 MB/s 2023-08-17T00:10:16.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.798 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252339 s, 41.6 MB/s 2023-08-17T00:10:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.826 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233473 s, 44.9 MB/s 2023-08-17T00:10:16.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.861 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316933 s, 33.1 MB/s 2023-08-17T00:10:16.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.890 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241716 s, 43.4 MB/s 2023-08-17T00:10:16.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279503 s, 37.5 MB/s 2023-08-17T00:10:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:16.953 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282415 s, 37.1 MB/s 2023-08-17T00:10:16.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:16.955 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:16.956 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:16.956 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.15 2023-08-17T00:10:16.956 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:16.956 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:16.957 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:16.957 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:17.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297469 s, 35.2 MB/s 2023-08-17T00:10:17.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.054 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030065 s, 34.9 MB/s 2023-08-17T00:10:17.083 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.084 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251252 s, 41.7 MB/s 2023-08-17T00:10:17.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.115 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261077 s, 40.2 MB/s 2023-08-17T00:10:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023143 s, 45.3 MB/s 2023-08-17T00:10:17.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.178 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307109 s, 34.1 MB/s 2023-08-17T00:10:17.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242926 s, 43.2 MB/s 2023-08-17T00:10:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.231 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201251 s, 52.1 MB/s 2023-08-17T00:10:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.257 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230174 s, 45.6 MB/s 2023-08-17T00:10:17.284 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.285 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235877 s, 44.5 MB/s 2023-08-17T00:10:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.315 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266959 s, 39.3 MB/s 2023-08-17T00:10:17.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299918 s, 35.0 MB/s 2023-08-17T00:10:17.382 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.382 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.382 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029077 s, 36.1 MB/s 2023-08-17T00:10:17.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.414 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273808 s, 38.3 MB/s 2023-08-17T00:10:17.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.443 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242726 s, 43.2 MB/s 2023-08-17T00:10:17.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.470 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235007 s, 44.6 MB/s 2023-08-17T00:10:17.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.498 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244903 s, 42.8 MB/s 2023-08-17T00:10:17.526 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.527 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237759 s, 44.1 MB/s 2023-08-17T00:10:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.552 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222704 s, 47.1 MB/s 2023-08-17T00:10:17.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.582 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249276 s, 42.1 MB/s 2023-08-17T00:10:17.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251189 s, 41.7 MB/s 2023-08-17T00:10:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.638 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228084 s, 46.0 MB/s 2023-08-17T00:10:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.667 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253211 s, 41.4 MB/s 2023-08-17T00:10:17.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.695 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.695 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232668 s, 45.1 MB/s 2023-08-17T00:10:17.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.722 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231044 s, 45.4 MB/s 2023-08-17T00:10:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235609 s, 44.5 MB/s 2023-08-17T00:10:17.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242997 s, 43.2 MB/s 2023-08-17T00:10:17.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254704 s, 41.2 MB/s 2023-08-17T00:10:17.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.835 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244158 s, 42.9 MB/s 2023-08-17T00:10:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028963 s, 36.2 MB/s 2023-08-17T00:10:17.892 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.893 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213917 s, 49.0 MB/s 2023-08-17T00:10:17.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.922 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245821 s, 42.7 MB/s 2023-08-17T00:10:17.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:17.924 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:17.925 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:17.925 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.16 2023-08-17T00:10:17.926 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:17.926 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:17.927 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:17.927 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:17.987 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257328 s, 40.7 MB/s 2023-08-17T00:10:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298892 s, 35.1 MB/s 2023-08-17T00:10:18.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.052 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262334 s, 40.0 MB/s 2023-08-17T00:10:18.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.077 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213107 s, 49.2 MB/s 2023-08-17T00:10:18.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261655 s, 40.1 MB/s 2023-08-17T00:10:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.132 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203964 s, 51.4 MB/s 2023-08-17T00:10:18.159 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.159 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.159 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237192 s, 44.2 MB/s 2023-08-17T00:10:18.187 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.187 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.187 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247604 s, 42.3 MB/s 2023-08-17T00:10:18.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.216 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236255 s, 44.4 MB/s 2023-08-17T00:10:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267115 s, 39.3 MB/s 2023-08-17T00:10:18.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.274 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239703 s, 43.7 MB/s 2023-08-17T00:10:18.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241608 s, 43.4 MB/s 2023-08-17T00:10:18.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265537 s, 39.5 MB/s 2023-08-17T00:10:18.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.366 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.366 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029081 s, 36.1 MB/s 2023-08-17T00:10:18.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.396 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250596 s, 41.8 MB/s 2023-08-17T00:10:18.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.423 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229395 s, 45.7 MB/s 2023-08-17T00:10:18.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.448 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215938 s, 48.6 MB/s 2023-08-17T00:10:18.486 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.486 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.486 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334647 s, 31.3 MB/s 2023-08-17T00:10:18.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.522 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309018 s, 33.9 MB/s 2023-08-17T00:10:18.545 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.545 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.546 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202141 s, 51.9 MB/s 2023-08-17T00:10:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.570 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204914 s, 51.2 MB/s 2023-08-17T00:10:18.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020087 s, 52.2 MB/s 2023-08-17T00:10:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233753 s, 44.9 MB/s 2023-08-17T00:10:18.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.648 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232283 s, 45.1 MB/s 2023-08-17T00:10:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229761 s, 45.6 MB/s 2023-08-17T00:10:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.702 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237004 s, 44.2 MB/s 2023-08-17T00:10:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255199 s, 41.1 MB/s 2023-08-17T00:10:18.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.756 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216143 s, 48.5 MB/s 2023-08-17T00:10:18.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.785 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246827 s, 42.5 MB/s 2023-08-17T00:10:18.811 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235836 s, 44.5 MB/s 2023-08-17T00:10:18.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.833 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193215 s, 54.3 MB/s 2023-08-17T00:10:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226496 s, 46.3 MB/s 2023-08-17T00:10:18.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:18.862 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:18.863 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:18.863 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.17 2023-08-17T00:10:18.863 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:18.864 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:18.864 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:18.864 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027124 s, 38.7 MB/s 2023-08-17T00:10:18.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.956 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.956 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257604 s, 40.7 MB/s 2023-08-17T00:10:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:18.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:18.988 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272028 s, 38.5 MB/s 2023-08-17T00:10:19.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.020 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273978 s, 38.3 MB/s 2023-08-17T00:10:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.053 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288053 s, 36.4 MB/s 2023-08-17T00:10:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228466 s, 45.9 MB/s 2023-08-17T00:10:19.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.111 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.111 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024838 s, 42.2 MB/s 2023-08-17T00:10:19.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271698 s, 38.6 MB/s 2023-08-17T00:10:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.170 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236774 s, 44.3 MB/s 2023-08-17T00:10:19.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.201 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271052 s, 38.7 MB/s 2023-08-17T00:10:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.225 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020943 s, 50.1 MB/s 2023-08-17T00:10:19.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.254 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023817 s, 44.0 MB/s 2023-08-17T00:10:19.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.281 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022621 s, 46.4 MB/s 2023-08-17T00:10:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248851 s, 42.1 MB/s 2023-08-17T00:10:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.337 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234627 s, 44.7 MB/s 2023-08-17T00:10:19.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.364 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220721 s, 47.5 MB/s 2023-08-17T00:10:19.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.390 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231025 s, 45.4 MB/s 2023-08-17T00:10:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259585 s, 40.4 MB/s 2023-08-17T00:10:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334452 s, 31.4 MB/s 2023-08-17T00:10:19.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.498 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361491 s, 29.0 MB/s 2023-08-17T00:10:19.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236591 s, 44.3 MB/s 2023-08-17T00:10:19.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.552 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242132 s, 43.3 MB/s 2023-08-17T00:10:19.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.584 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.584 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280616 s, 37.4 MB/s 2023-08-17T00:10:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.610 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216684 s, 48.4 MB/s 2023-08-17T00:10:19.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.634 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204543 s, 51.3 MB/s 2023-08-17T00:10:19.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283612 s, 37.0 MB/s 2023-08-17T00:10:19.697 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.698 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270157 s, 38.8 MB/s 2023-08-17T00:10:19.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.729 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283464 s, 37.0 MB/s 2023-08-17T00:10:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298619 s, 35.1 MB/s 2023-08-17T00:10:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.785 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191124 s, 54.9 MB/s 2023-08-17T00:10:19.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.813 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234232 s, 44.8 MB/s 2023-08-17T00:10:19.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245292 s, 42.7 MB/s 2023-08-17T00:10:19.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:19.844 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:19.844 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:19.845 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.18 2023-08-17T00:10:19.845 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:19.845 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:19.845 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:19.846 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:19.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.903 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246616 s, 42.5 MB/s 2023-08-17T00:10:19.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.935 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278686 s, 37.6 MB/s 2023-08-17T00:10:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:19.971 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318741 s, 32.9 MB/s 2023-08-17T00:10:20.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273379 s, 38.4 MB/s 2023-08-17T00:10:20.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.031 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254493 s, 41.2 MB/s 2023-08-17T00:10:20.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279526 s, 37.5 MB/s 2023-08-17T00:10:20.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.090 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231911 s, 45.2 MB/s 2023-08-17T00:10:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.117 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023222 s, 45.2 MB/s 2023-08-17T00:10:20.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.145 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238132 s, 44.0 MB/s 2023-08-17T00:10:20.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.173 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236524 s, 44.3 MB/s 2023-08-17T00:10:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023509 s, 44.6 MB/s 2023-08-17T00:10:20.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244718 s, 42.8 MB/s 2023-08-17T00:10:20.258 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.259 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260345 s, 40.3 MB/s 2023-08-17T00:10:20.279 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.280 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182606 s, 57.4 MB/s 2023-08-17T00:10:20.303 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.304 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020739 s, 50.6 MB/s 2023-08-17T00:10:20.328 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.329 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.329 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213428 s, 49.1 MB/s 2023-08-17T00:10:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.361 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290214 s, 36.1 MB/s 2023-08-17T00:10:20.386 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.386 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.386 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202885 s, 51.7 MB/s 2023-08-17T00:10:20.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.415 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243783 s, 43.0 MB/s 2023-08-17T00:10:20.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.443 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238897 s, 43.9 MB/s 2023-08-17T00:10:20.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.477 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302363 s, 34.7 MB/s 2023-08-17T00:10:20.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.504 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231321 s, 45.3 MB/s 2023-08-17T00:10:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.533 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024785 s, 42.3 MB/s 2023-08-17T00:10:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.570 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326798 s, 32.1 MB/s 2023-08-17T00:10:20.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.598 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236308 s, 44.4 MB/s 2023-08-17T00:10:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.627 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260823 s, 40.2 MB/s 2023-08-17T00:10:20.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.655 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236836 s, 44.3 MB/s 2023-08-17T00:10:20.680 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215132 s, 48.7 MB/s 2023-08-17T00:10:20.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.708 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227328 s, 46.1 MB/s 2023-08-17T00:10:20.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.738 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257651 s, 40.7 MB/s 2023-08-17T00:10:20.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229937 s, 45.6 MB/s 2023-08-17T00:10:20.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.795 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262602 s, 39.9 MB/s 2023-08-17T00:10:20.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:20.798 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:20.798 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:20.798 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.19 2023-08-17T00:10:20.799 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:20.799 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:20.799 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:20.800 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:20.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315494 s, 33.2 MB/s 2023-08-17T00:10:20.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.895 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250301 s, 41.9 MB/s 2023-08-17T00:10:20.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.920 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214064 s, 49.0 MB/s 2023-08-17T00:10:20.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.958 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331637 s, 31.6 MB/s 2023-08-17T00:10:20.983 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:20.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:20.984 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225922 s, 46.4 MB/s 2023-08-17T00:10:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243059 s, 43.1 MB/s 2023-08-17T00:10:21.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.053 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0362354 s, 28.9 MB/s 2023-08-17T00:10:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.083 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.084 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258332 s, 40.6 MB/s 2023-08-17T00:10:21.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.110 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227195 s, 46.2 MB/s 2023-08-17T00:10:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234918 s, 44.6 MB/s 2023-08-17T00:10:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229697 s, 45.7 MB/s 2023-08-17T00:10:21.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023611 s, 44.4 MB/s 2023-08-17T00:10:21.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.225 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278717 s, 37.6 MB/s 2023-08-17T00:10:21.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252004 s, 41.6 MB/s 2023-08-17T00:10:21.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266837 s, 39.3 MB/s 2023-08-17T00:10:21.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232794 s, 45.0 MB/s 2023-08-17T00:10:21.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.344 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260527 s, 40.2 MB/s 2023-08-17T00:10:21.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301644 s, 34.8 MB/s 2023-08-17T00:10:21.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.407 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025709 s, 40.8 MB/s 2023-08-17T00:10:21.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.432 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212782 s, 49.3 MB/s 2023-08-17T00:10:21.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229979 s, 45.6 MB/s 2023-08-17T00:10:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.484 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.485 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224293 s, 46.8 MB/s 2023-08-17T00:10:21.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022876 s, 45.8 MB/s 2023-08-17T00:10:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.540 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247151 s, 42.4 MB/s 2023-08-17T00:10:21.572 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.572 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.572 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027562 s, 38.0 MB/s 2023-08-17T00:10:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.608 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315836 s, 33.2 MB/s 2023-08-17T00:10:21.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.637 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248386 s, 42.2 MB/s 2023-08-17T00:10:21.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231908 s, 45.2 MB/s 2023-08-17T00:10:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.696 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275106 s, 38.1 MB/s 2023-08-17T00:10:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.726 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250061 s, 41.9 MB/s 2023-08-17T00:10:21.753 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.753 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.754 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233612 s, 44.9 MB/s 2023-08-17T00:10:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242538 s, 43.2 MB/s 2023-08-17T00:10:21.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:21.784 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:21.785 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:21.785 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.20 2023-08-17T00:10:21.785 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:21.786 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:21.786 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:21.786 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:21.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252202 s, 41.6 MB/s 2023-08-17T00:10:21.871 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.871 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.871 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226753 s, 46.2 MB/s 2023-08-17T00:10:21.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.899 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251901 s, 41.6 MB/s 2023-08-17T00:10:21.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190612 s, 55.0 MB/s 2023-08-17T00:10:21.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.952 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262738 s, 39.9 MB/s 2023-08-17T00:10:21.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:21.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:21.985 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290029 s, 36.2 MB/s 2023-08-17T00:10:22.016 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.017 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270978 s, 38.7 MB/s 2023-08-17T00:10:22.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.047 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262978 s, 39.9 MB/s 2023-08-17T00:10:22.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.075 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234859 s, 44.6 MB/s 2023-08-17T00:10:22.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.102 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236171 s, 44.4 MB/s 2023-08-17T00:10:22.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.127 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.127 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212917 s, 49.2 MB/s 2023-08-17T00:10:22.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.156 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253276 s, 41.4 MB/s 2023-08-17T00:10:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.184 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235206 s, 44.6 MB/s 2023-08-17T00:10:22.209 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.210 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217354 s, 48.2 MB/s 2023-08-17T00:10:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.241 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259049 s, 40.5 MB/s 2023-08-17T00:10:22.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.266 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021268 s, 49.3 MB/s 2023-08-17T00:10:22.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.292 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020292 s, 51.7 MB/s 2023-08-17T00:10:22.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.320 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236596 s, 44.3 MB/s 2023-08-17T00:10:22.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213683 s, 49.1 MB/s 2023-08-17T00:10:22.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276659 s, 37.9 MB/s 2023-08-17T00:10:22.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.404 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239094 s, 43.9 MB/s 2023-08-17T00:10:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231014 s, 45.4 MB/s 2023-08-17T00:10:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025623 s, 40.9 MB/s 2023-08-17T00:10:22.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.496 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292745 s, 35.8 MB/s 2023-08-17T00:10:22.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239625 s, 43.8 MB/s 2023-08-17T00:10:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.558 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307018 s, 34.2 MB/s 2023-08-17T00:10:22.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.585 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221541 s, 47.3 MB/s 2023-08-17T00:10:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272119 s, 38.5 MB/s 2023-08-17T00:10:22.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.649 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287345 s, 36.5 MB/s 2023-08-17T00:10:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275909 s, 38.0 MB/s 2023-08-17T00:10:22.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.709 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229375 s, 45.7 MB/s 2023-08-17T00:10:22.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.735 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219189 s, 47.8 MB/s 2023-08-17T00:10:22.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:22.737 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:22.737 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:22.738 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.21 2023-08-17T00:10:22.738 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:22.738 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:22.739 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:22.739 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.795 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244386 s, 42.9 MB/s 2023-08-17T00:10:22.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228893 s, 45.8 MB/s 2023-08-17T00:10:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.856 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293865 s, 35.7 MB/s 2023-08-17T00:10:22.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.882 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233874 s, 44.8 MB/s 2023-08-17T00:10:22.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.913 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265992 s, 39.4 MB/s 2023-08-17T00:10:22.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.942 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232604 s, 45.1 MB/s 2023-08-17T00:10:22.973 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:22.973 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:22.973 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283539 s, 37.0 MB/s 2023-08-17T00:10:23.006 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.007 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.007 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292022 s, 35.9 MB/s 2023-08-17T00:10:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243285 s, 43.1 MB/s 2023-08-17T00:10:23.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222576 s, 47.1 MB/s 2023-08-17T00:10:23.097 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.097 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.097 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312764 s, 33.5 MB/s 2023-08-17T00:10:23.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.126 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256642 s, 40.9 MB/s 2023-08-17T00:10:23.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307955 s, 34.0 MB/s 2023-08-17T00:10:23.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.189 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237381 s, 44.2 MB/s 2023-08-17T00:10:23.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.224 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302115 s, 34.7 MB/s 2023-08-17T00:10:23.248 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.248 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.249 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207346 s, 50.6 MB/s 2023-08-17T00:10:23.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.278 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.278 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251832 s, 41.6 MB/s 2023-08-17T00:10:23.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.317 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303157 s, 34.6 MB/s 2023-08-17T00:10:23.338 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.339 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.339 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211467 s, 49.6 MB/s 2023-08-17T00:10:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.372 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294389 s, 35.6 MB/s 2023-08-17T00:10:23.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.404 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266115 s, 39.4 MB/s 2023-08-17T00:10:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271204 s, 38.7 MB/s 2023-08-17T00:10:23.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023329 s, 44.9 MB/s 2023-08-17T00:10:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248331 s, 42.2 MB/s 2023-08-17T00:10:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.520 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243538 s, 43.1 MB/s 2023-08-17T00:10:23.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.553 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.553 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281221 s, 37.3 MB/s 2023-08-17T00:10:23.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.581 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246275 s, 42.6 MB/s 2023-08-17T00:10:23.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.606 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214145 s, 49.0 MB/s 2023-08-17T00:10:23.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.635 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246014 s, 42.6 MB/s 2023-08-17T00:10:23.670 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.671 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312949 s, 33.5 MB/s 2023-08-17T00:10:23.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.701 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260072 s, 40.3 MB/s 2023-08-17T00:10:23.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.731 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254476 s, 41.2 MB/s 2023-08-17T00:10:23.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:23.733 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:23.734 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:23.734 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.22 2023-08-17T00:10:23.734 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:23.734 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:23.735 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:23.735 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:23.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.789 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224025 s, 46.8 MB/s 2023-08-17T00:10:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301985 s, 34.7 MB/s 2023-08-17T00:10:23.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.852 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.852 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249749 s, 42.0 MB/s 2023-08-17T00:10:23.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.883 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02677 s, 39.2 MB/s 2023-08-17T00:10:23.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.918 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308046 s, 34.0 MB/s 2023-08-17T00:10:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.948 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250289 s, 41.9 MB/s 2023-08-17T00:10:23.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:23.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:23.978 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252996 s, 41.4 MB/s 2023-08-17T00:10:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023493 s, 44.6 MB/s 2023-08-17T00:10:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.027 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196332 s, 53.4 MB/s 2023-08-17T00:10:24.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.056 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251125 s, 41.8 MB/s 2023-08-17T00:10:24.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.084 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233454 s, 44.9 MB/s 2023-08-17T00:10:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.110 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225198 s, 46.6 MB/s 2023-08-17T00:10:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241413 s, 43.4 MB/s 2023-08-17T00:10:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.168 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253642 s, 41.3 MB/s 2023-08-17T00:10:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213758 s, 49.1 MB/s 2023-08-17T00:10:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.220 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022841 s, 45.9 MB/s 2023-08-17T00:10:24.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.245 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020806 s, 50.4 MB/s 2023-08-17T00:10:24.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259971 s, 40.3 MB/s 2023-08-17T00:10:24.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222281 s, 47.2 MB/s 2023-08-17T00:10:24.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272725 s, 38.4 MB/s 2023-08-17T00:10:24.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.365 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277679 s, 37.8 MB/s 2023-08-17T00:10:24.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.395 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266734 s, 39.3 MB/s 2023-08-17T00:10:24.426 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271202 s, 38.7 MB/s 2023-08-17T00:10:24.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278532 s, 37.6 MB/s 2023-08-17T00:10:24.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.484 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.484 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023454 s, 44.7 MB/s 2023-08-17T00:10:24.516 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.517 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288922 s, 36.3 MB/s 2023-08-17T00:10:24.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.545 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237029 s, 44.2 MB/s 2023-08-17T00:10:24.575 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.575 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.575 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269305 s, 38.9 MB/s 2023-08-17T00:10:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.603 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234342 s, 44.7 MB/s 2023-08-17T00:10:24.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021267 s, 49.3 MB/s 2023-08-17T00:10:24.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.662 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298103 s, 35.2 MB/s 2023-08-17T00:10:24.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.690 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231351 s, 45.3 MB/s 2023-08-17T00:10:24.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:24.692 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:24.692 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:24.692 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.23 2023-08-17T00:10:24.693 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:24.693 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:24.694 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:24.694 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:24.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.747 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212503 s, 49.3 MB/s 2023-08-17T00:10:24.773 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.774 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228104 s, 46.0 MB/s 2023-08-17T00:10:24.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.798 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206121 s, 50.9 MB/s 2023-08-17T00:10:24.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.830 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281525 s, 37.2 MB/s 2023-08-17T00:10:24.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.860 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268955 s, 39.0 MB/s 2023-08-17T00:10:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249968 s, 41.9 MB/s 2023-08-17T00:10:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.917 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233183 s, 45.0 MB/s 2023-08-17T00:10:24.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.952 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304842 s, 34.4 MB/s 2023-08-17T00:10:24.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:24.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:24.990 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337699 s, 31.1 MB/s 2023-08-17T00:10:25.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.021 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275548 s, 38.1 MB/s 2023-08-17T00:10:25.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.052 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276118 s, 38.0 MB/s 2023-08-17T00:10:25.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246688 s, 42.5 MB/s 2023-08-17T00:10:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258288 s, 40.6 MB/s 2023-08-17T00:10:25.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303079 s, 34.6 MB/s 2023-08-17T00:10:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243578 s, 43.0 MB/s 2023-08-17T00:10:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.202 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246869 s, 42.5 MB/s 2023-08-17T00:10:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230801 s, 45.4 MB/s 2023-08-17T00:10:25.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.262 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306069 s, 34.3 MB/s 2023-08-17T00:10:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233561 s, 44.9 MB/s 2023-08-17T00:10:25.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.316 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225325 s, 46.5 MB/s 2023-08-17T00:10:25.340 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.341 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.341 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203404 s, 51.6 MB/s 2023-08-17T00:10:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278027 s, 37.7 MB/s 2023-08-17T00:10:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235662 s, 44.5 MB/s 2023-08-17T00:10:25.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.432 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281986 s, 37.2 MB/s 2023-08-17T00:10:25.465 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300696 s, 34.9 MB/s 2023-08-17T00:10:25.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239481 s, 43.8 MB/s 2023-08-17T00:10:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.523 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242385 s, 43.3 MB/s 2023-08-17T00:10:25.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235834 s, 44.5 MB/s 2023-08-17T00:10:25.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.584 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.584 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282458 s, 37.1 MB/s 2023-08-17T00:10:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.610 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219227 s, 47.8 MB/s 2023-08-17T00:10:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229573 s, 45.7 MB/s 2023-08-17T00:10:25.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231208 s, 45.4 MB/s 2023-08-17T00:10:25.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:25.666 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:25.666 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:25.666 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.24 2023-08-17T00:10:25.667 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:25.667 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:25.667 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:25.668 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.723 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250646 s, 41.8 MB/s 2023-08-17T00:10:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.753 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250007 s, 41.9 MB/s 2023-08-17T00:10:25.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214694 s, 48.8 MB/s 2023-08-17T00:10:25.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.807 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247668 s, 42.3 MB/s 2023-08-17T00:10:25.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.834 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023575 s, 44.5 MB/s 2023-08-17T00:10:25.862 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.863 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249492 s, 42.0 MB/s 2023-08-17T00:10:25.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.894 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271946 s, 38.6 MB/s 2023-08-17T00:10:25.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.917 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205316 s, 51.1 MB/s 2023-08-17T00:10:25.944 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.945 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240252 s, 43.6 MB/s 2023-08-17T00:10:25.972 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.972 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.973 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024613 s, 42.6 MB/s 2023-08-17T00:10:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:25.995 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198388 s, 52.9 MB/s 2023-08-17T00:10:26.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.023 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249602 s, 42.0 MB/s 2023-08-17T00:10:26.050 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.050 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.051 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240738 s, 43.6 MB/s 2023-08-17T00:10:26.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.078 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234821 s, 44.7 MB/s 2023-08-17T00:10:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231195 s, 45.4 MB/s 2023-08-17T00:10:26.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287609 s, 36.5 MB/s 2023-08-17T00:10:26.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023606 s, 44.4 MB/s 2023-08-17T00:10:26.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.196 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271149 s, 38.7 MB/s 2023-08-17T00:10:26.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.222 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022732 s, 46.1 MB/s 2023-08-17T00:10:26.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.252 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247064 s, 42.4 MB/s 2023-08-17T00:10:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260181 s, 40.3 MB/s 2023-08-17T00:10:26.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.315 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281664 s, 37.2 MB/s 2023-08-17T00:10:26.341 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.341 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.341 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216231 s, 48.5 MB/s 2023-08-17T00:10:26.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.371 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256433 s, 40.9 MB/s 2023-08-17T00:10:26.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298668 s, 35.1 MB/s 2023-08-17T00:10:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.435 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262027 s, 40.0 MB/s 2023-08-17T00:10:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243828 s, 43.0 MB/s 2023-08-17T00:10:26.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.489 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231657 s, 45.3 MB/s 2023-08-17T00:10:26.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.513 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200255 s, 52.4 MB/s 2023-08-17T00:10:26.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.542 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245023 s, 42.8 MB/s 2023-08-17T00:10:26.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328063 s, 32.0 MB/s 2023-08-17T00:10:26.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.606 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022988 s, 45.6 MB/s 2023-08-17T00:10:26.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:26.608 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:26.609 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:26.609 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.25 2023-08-17T00:10:26.609 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:26.610 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:26.610 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:26.610 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:26.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.668 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024543 s, 42.7 MB/s 2023-08-17T00:10:26.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217223 s, 48.3 MB/s 2023-08-17T00:10:26.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.725 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263368 s, 39.8 MB/s 2023-08-17T00:10:26.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.752 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246159 s, 42.6 MB/s 2023-08-17T00:10:26.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286933 s, 36.5 MB/s 2023-08-17T00:10:26.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.815 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263361 s, 39.8 MB/s 2023-08-17T00:10:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219618 s, 47.7 MB/s 2023-08-17T00:10:26.862 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.862 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.863 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198656 s, 52.8 MB/s 2023-08-17T00:10:26.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.889 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225747 s, 46.4 MB/s 2023-08-17T00:10:26.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.915 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224295 s, 46.7 MB/s 2023-08-17T00:10:26.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.941 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237642 s, 44.1 MB/s 2023-08-17T00:10:26.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:26.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:26.977 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311734 s, 33.6 MB/s 2023-08-17T00:10:27.006 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.006 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.007 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255171 s, 41.1 MB/s 2023-08-17T00:10:27.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.036 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246409 s, 42.6 MB/s 2023-08-17T00:10:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227341 s, 46.1 MB/s 2023-08-17T00:10:27.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.085 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200039 s, 52.4 MB/s 2023-08-17T00:10:27.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.113 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023267 s, 45.1 MB/s 2023-08-17T00:10:27.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268146 s, 39.1 MB/s 2023-08-17T00:10:27.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237103 s, 44.2 MB/s 2023-08-17T00:10:27.199 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.199 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.199 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271157 s, 38.7 MB/s 2023-08-17T00:10:27.235 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.235 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.235 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310603 s, 33.8 MB/s 2023-08-17T00:10:27.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.262 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229852 s, 45.6 MB/s 2023-08-17T00:10:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.287 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211284 s, 49.6 MB/s 2023-08-17T00:10:27.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.311 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213086 s, 49.2 MB/s 2023-08-17T00:10:27.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.345 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287795 s, 36.4 MB/s 2023-08-17T00:10:27.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.374 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249679 s, 42.0 MB/s 2023-08-17T00:10:27.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.398 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222164 s, 47.2 MB/s 2023-08-17T00:10:27.426 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.426 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.426 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024223 s, 43.3 MB/s 2023-08-17T00:10:27.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.463 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324469 s, 32.3 MB/s 2023-08-17T00:10:27.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.490 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233905 s, 44.8 MB/s 2023-08-17T00:10:27.516 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.517 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232546 s, 45.1 MB/s 2023-08-17T00:10:27.549 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.549 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.549 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271843 s, 38.6 MB/s 2023-08-17T00:10:27.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:27.551 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:27.551 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:27.551 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.26 2023-08-17T00:10:27.552 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:27.552 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:27.552 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:27.553 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:27.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.605 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227246 s, 46.1 MB/s 2023-08-17T00:10:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.635 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244038 s, 43.0 MB/s 2023-08-17T00:10:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.666 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270059 s, 38.8 MB/s 2023-08-17T00:10:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280195 s, 37.4 MB/s 2023-08-17T00:10:27.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.729 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026416 s, 39.7 MB/s 2023-08-17T00:10:27.757 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.758 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023896 s, 43.9 MB/s 2023-08-17T00:10:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216137 s, 48.5 MB/s 2023-08-17T00:10:27.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226963 s, 46.2 MB/s 2023-08-17T00:10:27.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243837 s, 43.0 MB/s 2023-08-17T00:10:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285905 s, 36.7 MB/s 2023-08-17T00:10:27.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240301 s, 43.6 MB/s 2023-08-17T00:10:27.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.932 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301843 s, 34.7 MB/s 2023-08-17T00:10:27.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.959 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217331 s, 48.2 MB/s 2023-08-17T00:10:27.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238786 s, 43.9 MB/s 2023-08-17T00:10:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253188 s, 41.4 MB/s 2023-08-17T00:10:28.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.044 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025234 s, 41.6 MB/s 2023-08-17T00:10:28.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.074 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246074 s, 42.6 MB/s 2023-08-17T00:10:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.100 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219607 s, 47.7 MB/s 2023-08-17T00:10:28.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.126 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224452 s, 46.7 MB/s 2023-08-17T00:10:28.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.154 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.154 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02428 s, 43.2 MB/s 2023-08-17T00:10:28.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.182 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.182 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238628 s, 43.9 MB/s 2023-08-17T00:10:28.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222876 s, 47.0 MB/s 2023-08-17T00:10:28.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022935 s, 45.7 MB/s 2023-08-17T00:10:28.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.264 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268247 s, 39.1 MB/s 2023-08-17T00:10:28.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.295 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276803 s, 37.9 MB/s 2023-08-17T00:10:28.325 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.325 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.325 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254755 s, 41.2 MB/s 2023-08-17T00:10:28.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.356 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026127 s, 40.1 MB/s 2023-08-17T00:10:28.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.388 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276927 s, 37.9 MB/s 2023-08-17T00:10:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229829 s, 45.6 MB/s 2023-08-17T00:10:28.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.443 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243879 s, 43.0 MB/s 2023-08-17T00:10:28.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203465 s, 51.5 MB/s 2023-08-17T00:10:28.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.497 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265258 s, 39.5 MB/s 2023-08-17T00:10:28.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:28.499 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:28.500 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:28.500 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.27 2023-08-17T00:10:28.501 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:28.502 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:28.503 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:28.503 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:28.559 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.559 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.559 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229725 s, 45.6 MB/s 2023-08-17T00:10:28.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.590 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272813 s, 38.4 MB/s 2023-08-17T00:10:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260288 s, 40.3 MB/s 2023-08-17T00:10:28.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.649 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245429 s, 42.7 MB/s 2023-08-17T00:10:28.675 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.675 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.675 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228455 s, 45.9 MB/s 2023-08-17T00:10:28.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.703 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224108 s, 46.8 MB/s 2023-08-17T00:10:28.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.726 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020818 s, 50.4 MB/s 2023-08-17T00:10:28.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.759 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281909 s, 37.2 MB/s 2023-08-17T00:10:28.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.785 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222881 s, 47.0 MB/s 2023-08-17T00:10:28.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032973 s, 31.8 MB/s 2023-08-17T00:10:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233772 s, 44.9 MB/s 2023-08-17T00:10:28.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.880 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259628 s, 40.4 MB/s 2023-08-17T00:10:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026095 s, 40.2 MB/s 2023-08-17T00:10:28.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223267 s, 47.0 MB/s 2023-08-17T00:10:28.966 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.968 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257919 s, 40.7 MB/s 2023-08-17T00:10:28.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:28.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:28.994 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238069 s, 44.0 MB/s 2023-08-17T00:10:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028346 s, 37.0 MB/s 2023-08-17T00:10:29.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.053 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222664 s, 47.1 MB/s 2023-08-17T00:10:29.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.079 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219845 s, 47.7 MB/s 2023-08-17T00:10:29.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.105 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233266 s, 45.0 MB/s 2023-08-17T00:10:29.135 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.136 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268608 s, 39.0 MB/s 2023-08-17T00:10:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219658 s, 47.7 MB/s 2023-08-17T00:10:29.187 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.188 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.188 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217658 s, 48.2 MB/s 2023-08-17T00:10:29.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.218 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260855 s, 40.2 MB/s 2023-08-17T00:10:29.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.248 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.248 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260085 s, 40.3 MB/s 2023-08-17T00:10:29.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227276 s, 46.1 MB/s 2023-08-17T00:10:29.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.306 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.306 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274142 s, 38.2 MB/s 2023-08-17T00:10:29.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.334 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023229 s, 45.1 MB/s 2023-08-17T00:10:29.367 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.367 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.368 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295675 s, 35.5 MB/s 2023-08-17T00:10:29.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.401 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291554 s, 36.0 MB/s 2023-08-17T00:10:29.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.428 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022667 s, 46.3 MB/s 2023-08-17T00:10:29.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.465 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.465 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318228 s, 33.0 MB/s 2023-08-17T00:10:29.467 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:29.468 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:29.468 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:29.468 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.28 2023-08-17T00:10:29.469 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:29.469 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:29.469 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:29.470 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:29.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304971 s, 34.4 MB/s 2023-08-17T00:10:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254135 s, 41.3 MB/s 2023-08-17T00:10:29.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206368 s, 50.8 MB/s 2023-08-17T00:10:29.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247789 s, 42.3 MB/s 2023-08-17T00:10:29.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.636 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233292 s, 44.9 MB/s 2023-08-17T00:10:29.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246017 s, 42.6 MB/s 2023-08-17T00:10:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316648 s, 33.1 MB/s 2023-08-17T00:10:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.730 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248764 s, 42.2 MB/s 2023-08-17T00:10:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304024 s, 34.5 MB/s 2023-08-17T00:10:29.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.791 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217447 s, 48.2 MB/s 2023-08-17T00:10:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.817 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225787 s, 46.4 MB/s 2023-08-17T00:10:29.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.845 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235942 s, 44.4 MB/s 2023-08-17T00:10:29.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.878 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298876 s, 35.1 MB/s 2023-08-17T00:10:29.902 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.902 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.902 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212107 s, 49.4 MB/s 2023-08-17T00:10:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252937 s, 41.5 MB/s 2023-08-17T00:10:29.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.961 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249039 s, 42.1 MB/s 2023-08-17T00:10:29.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:29.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:29.989 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235004 s, 44.6 MB/s 2023-08-17T00:10:30.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.017 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244568 s, 42.9 MB/s 2023-08-17T00:10:30.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.046 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242947 s, 43.2 MB/s 2023-08-17T00:10:30.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.075 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258322 s, 40.6 MB/s 2023-08-17T00:10:30.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232628 s, 45.1 MB/s 2023-08-17T00:10:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255661 s, 41.0 MB/s 2023-08-17T00:10:30.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.162 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252259 s, 41.6 MB/s 2023-08-17T00:10:30.188 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.188 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.188 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227226 s, 46.1 MB/s 2023-08-17T00:10:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224226 s, 46.8 MB/s 2023-08-17T00:10:30.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.241 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224384 s, 46.7 MB/s 2023-08-17T00:10:30.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245645 s, 42.7 MB/s 2023-08-17T00:10:30.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.295 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233081 s, 45.0 MB/s 2023-08-17T00:10:30.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.322 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234238 s, 44.8 MB/s 2023-08-17T00:10:30.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.346 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212669 s, 49.3 MB/s 2023-08-17T00:10:30.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290124 s, 36.1 MB/s 2023-08-17T00:10:30.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.410 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263781 s, 39.8 MB/s 2023-08-17T00:10:30.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:30.413 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:30.413 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:30.414 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.29 2023-08-17T00:10:30.415 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:30.415 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:30.416 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:30.417 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:30.478 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.479 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.479 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277866 s, 37.7 MB/s 2023-08-17T00:10:30.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312201 s, 33.6 MB/s 2023-08-17T00:10:30.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.543 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243359 s, 43.1 MB/s 2023-08-17T00:10:30.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202392 s, 51.8 MB/s 2023-08-17T00:10:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.602 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296373 s, 35.4 MB/s 2023-08-17T00:10:30.629 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.630 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022441 s, 46.7 MB/s 2023-08-17T00:10:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256655 s, 40.9 MB/s 2023-08-17T00:10:30.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.686 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231711 s, 45.3 MB/s 2023-08-17T00:10:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240355 s, 43.6 MB/s 2023-08-17T00:10:30.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.747 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265356 s, 39.5 MB/s 2023-08-17T00:10:30.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.770 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.770 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223008 s, 47.0 MB/s 2023-08-17T00:10:30.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.802 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.802 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276936 s, 37.9 MB/s 2023-08-17T00:10:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229309 s, 45.7 MB/s 2023-08-17T00:10:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.857 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235087 s, 44.6 MB/s 2023-08-17T00:10:30.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248385 s, 42.2 MB/s 2023-08-17T00:10:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271437 s, 38.6 MB/s 2023-08-17T00:10:30.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.951 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029458 s, 35.6 MB/s 2023-08-17T00:10:30.981 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:30.981 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:30.981 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255151 s, 41.1 MB/s 2023-08-17T00:10:31.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274964 s, 38.1 MB/s 2023-08-17T00:10:31.037 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.038 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.038 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224404 s, 46.7 MB/s 2023-08-17T00:10:31.069 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.070 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269211 s, 38.9 MB/s 2023-08-17T00:10:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.097 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223878 s, 46.8 MB/s 2023-08-17T00:10:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.122 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211641 s, 49.5 MB/s 2023-08-17T00:10:31.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.150 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230141 s, 45.6 MB/s 2023-08-17T00:10:31.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.179 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025449 s, 41.2 MB/s 2023-08-17T00:10:31.209 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.209 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264263 s, 39.7 MB/s 2023-08-17T00:10:31.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.237 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242879 s, 43.2 MB/s 2023-08-17T00:10:31.269 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.270 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236999 s, 44.2 MB/s 2023-08-17T00:10:31.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280745 s, 37.3 MB/s 2023-08-17T00:10:31.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.336 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337657 s, 31.1 MB/s 2023-08-17T00:10:31.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.364 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024493 s, 42.8 MB/s 2023-08-17T00:10:31.393 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.393 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.394 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248132 s, 42.3 MB/s 2023-08-17T00:10:31.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:31.396 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:31.396 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:31.396 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.30 2023-08-17T00:10:31.397 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:31.398 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:31.398 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:31.398 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:31.450 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.451 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210251 s, 49.9 MB/s 2023-08-17T00:10:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263296 s, 39.8 MB/s 2023-08-17T00:10:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.504 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195983 s, 53.5 MB/s 2023-08-17T00:10:31.532 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.533 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243193 s, 43.1 MB/s 2023-08-17T00:10:31.562 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.562 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.562 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250021 s, 41.9 MB/s 2023-08-17T00:10:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.596 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295343 s, 35.5 MB/s 2023-08-17T00:10:31.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.625 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243919 s, 43.0 MB/s 2023-08-17T00:10:31.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.657 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272314 s, 38.5 MB/s 2023-08-17T00:10:31.684 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240405 s, 43.6 MB/s 2023-08-17T00:10:31.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.711 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022768 s, 46.1 MB/s 2023-08-17T00:10:31.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.739 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024298 s, 43.2 MB/s 2023-08-17T00:10:31.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264729 s, 39.6 MB/s 2023-08-17T00:10:31.800 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.800 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.800 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267844 s, 39.1 MB/s 2023-08-17T00:10:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233778 s, 44.9 MB/s 2023-08-17T00:10:31.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.859 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264464 s, 39.6 MB/s 2023-08-17T00:10:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239369 s, 43.8 MB/s 2023-08-17T00:10:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292745 s, 35.8 MB/s 2023-08-17T00:10:31.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.947 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237539 s, 44.1 MB/s 2023-08-17T00:10:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:31.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:31.972 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220486 s, 47.6 MB/s 2023-08-17T00:10:32.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.001 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240484 s, 43.6 MB/s 2023-08-17T00:10:32.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.027 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219928 s, 47.7 MB/s 2023-08-17T00:10:32.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.055 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024731 s, 42.4 MB/s 2023-08-17T00:10:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.090 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315099 s, 33.3 MB/s 2023-08-17T00:10:32.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.117 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221169 s, 47.4 MB/s 2023-08-17T00:10:32.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.143 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.143 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225394 s, 46.5 MB/s 2023-08-17T00:10:32.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220086 s, 47.6 MB/s 2023-08-17T00:10:32.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.196 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240799 s, 43.5 MB/s 2023-08-17T00:10:32.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.221 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.221 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020736 s, 50.6 MB/s 2023-08-17T00:10:32.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282561 s, 37.1 MB/s 2023-08-17T00:10:32.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293703 s, 35.7 MB/s 2023-08-17T00:10:32.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.317 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02687 s, 39.0 MB/s 2023-08-17T00:10:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.345 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237807 s, 44.1 MB/s 2023-08-17T00:10:32.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:32.347 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:10:32.348 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:10:32.348 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.31 2023-08-17T00:10:32.348 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:10:32.349 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:10:32.349 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:10:32.349 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:10:32.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231354 s, 45.3 MB/s 2023-08-17T00:10:32.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.429 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.429 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209888 s, 50.0 MB/s 2023-08-17T00:10:32.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.455 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215482 s, 48.7 MB/s 2023-08-17T00:10:32.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.482 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235096 s, 44.6 MB/s 2023-08-17T00:10:32.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.509 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233449 s, 44.9 MB/s 2023-08-17T00:10:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.540 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273033 s, 38.4 MB/s 2023-08-17T00:10:32.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.571 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274123 s, 38.3 MB/s 2023-08-17T00:10:32.602 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.603 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.603 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289027 s, 36.3 MB/s 2023-08-17T00:10:32.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.632 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250527 s, 41.9 MB/s 2023-08-17T00:10:32.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.664 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282441 s, 37.1 MB/s 2023-08-17T00:10:32.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.694 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251628 s, 41.7 MB/s 2023-08-17T00:10:32.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.726 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222144 s, 47.2 MB/s 2023-08-17T00:10:32.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.748 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.748 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222118 s, 47.2 MB/s 2023-08-17T00:10:32.776 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241921 s, 43.3 MB/s 2023-08-17T00:10:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277875 s, 37.7 MB/s 2023-08-17T00:10:32.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313954 s, 33.4 MB/s 2023-08-17T00:10:32.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.879 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.879 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300441 s, 34.9 MB/s 2023-08-17T00:10:32.908 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.908 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.908 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250773 s, 41.8 MB/s 2023-08-17T00:10:32.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219163 s, 47.8 MB/s 2023-08-17T00:10:32.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.960 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213659 s, 49.1 MB/s 2023-08-17T00:10:32.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:32.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:32.987 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234778 s, 44.7 MB/s 2023-08-17T00:10:33.014 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.014 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.014 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234223 s, 44.8 MB/s 2023-08-17T00:10:33.043 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253861 s, 41.3 MB/s 2023-08-17T00:10:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.073 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260229 s, 40.3 MB/s 2023-08-17T00:10:33.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282782 s, 37.1 MB/s 2023-08-17T00:10:33.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280383 s, 37.4 MB/s 2023-08-17T00:10:33.166 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.166 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.166 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024309 s, 43.1 MB/s 2023-08-17T00:10:33.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020846 s, 50.3 MB/s 2023-08-17T00:10:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238558 s, 44.0 MB/s 2023-08-17T00:10:33.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250283 s, 41.9 MB/s 2023-08-17T00:10:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241224 s, 43.5 MB/s 2023-08-17T00:10:33.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:10:33.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:10:33.304 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025712 s, 40.8 MB/s 2023-08-17T00:10:33.306 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /scrub_control_test_path recursive 2023-08-17T00:10:33.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7ecd69700 1 Processor -- start 2023-08-17T00:10:33.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7ecd69700 1 -- start start 2023-08-17T00:10:33.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7ecd69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7e8063290 0x7fa7e814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7ecd69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80c2d50 con 0x7fa7e80c1c70 2023-08-17T00:10:33.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7ecd69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e81521f0 con 0x7fa7e80652f0 2023-08-17T00:10:33.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7ecd69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e8152e10 con 0x7fa7e8063290 2023-08-17T00:10:33.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e5d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa7e80c1c70 0x7fa7e814b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52660/0 (socket says 172.21.15.153:52660) 2023-08-17T00:10:33.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e6d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7e8063290 0x7fa7e814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/3527125501 learned_addr learned my addr 172.21.15.153:0/3527125501 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:33.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787011828 0 0) 0x7fa7e80c2d50 con 0x7fa7e80c1c70 2023-08-17T00:10:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7d00033f0 con 0x7fa7e80c1c70 2023-08-17T00:10:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512079023 0 0) 0x7fa7e81521f0 con 0x7fa7e80652f0 2023-08-17T00:10:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7e80c2d50 con 0x7fa7e80652f0 2023-08-17T00:10:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e6d9d700 1 -- 172.21.15.153:0/3527125501 >> v1:172.21.15.178:6789/0 conn(0x7fa7e80652f0 legacy=0x7fa7e80c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.475+0000 7fa7e6d9d700 1 -- 172.21.15.153:0/3527125501 >> v1:172.21.15.153:6789/0 conn(0x7fa7e80c1c70 legacy=0x7fa7e814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7e6d9d700 1 -- 172.21.15.153:0/3527125501 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80c2140 con 0x7fa7e8063290 2023-08-17T00:10:33.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7e6d9d700 1 --2- 172.21.15.153:0/3527125501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814bf70 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fa7e0009e60 tx=0x7fa7e0009780).ready entity=mon.0 client_cookie=fb651f1e6a2b6e52 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000e070 con 0x7fa7e8063290 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e000bab0 con 0x7fa7e8063290 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7e559a700 1 -- 172.21.15.153:0/3527125501 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000be30 con 0x7fa7e8063290 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 -- 172.21.15.153:0/3527125501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 msgr2=0x7fa7e814bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/3527125501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814bf70 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 rx=0x7fa7e0009e60 tx=0x7fa7e0009780).stop 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 -- 172.21.15.153:0/3527125501 shutdown_connections 2023-08-17T00:10:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/3527125501 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814bf70 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 -- 172.21.15.153:0/3527125501 >> 172.21.15.153:0/3527125501 conn(0x7fa7e80c7090 msgr2=0x7fa7e80c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 -- 172.21.15.153:0/3527125501 shutdown_connections 2023-08-17T00:10:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 -- 172.21.15.153:0/3527125501 wait complete. 2023-08-17T00:10:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.479+0000 7fa7ecd69700 1 Processor -- start 2023-08-17T00:10:33.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 -- start start 2023-08-17T00:10:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7e80652f0 0x7fa7e814af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7e80c1c70 0x7fa7e814fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80be500 con 0x7fa7e8063290 2023-08-17T00:10:33.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80be7a0 con 0x7fa7e80652f0 2023-08-17T00:10:33.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e814e610 con 0x7fa7e80c1c70 2023-08-17T00:10:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48810/0 (socket says 172.21.15.153:48810) 2023-08-17T00:10:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 -- 172.21.15.153:0/679003706 learned_addr learned my addr 172.21.15.153:0/679003706 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7e80652f0 0x7fa7e814af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e6d9d700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7e80c1c70 0x7fa7e814fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 -- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7e80c1c70 msgr2=0x7fa7e814fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7e80c1c70 0x7fa7e814fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 -- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7e80652f0 msgr2=0x7fa7e814af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7e80652f0 0x7fa7e814af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 -- 172.21.15.153:0/679003706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e0009a20 con 0x7fa7e8063290 2023-08-17T00:10:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7e659c700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814ddc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fa7d800c490 tx=0x7fa7d8007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7d67fc700 1 -- 172.21.15.153:0/679003706 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800f470 con 0x7fa7e8063290 2023-08-17T00:10:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7d67fc700 1 -- 172.21.15.153:0/679003706 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d800f5d0 con 0x7fa7e8063290 2023-08-17T00:10:33.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e814e8f0 con 0x7fa7e8063290 2023-08-17T00:10:33.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.483+0000 7fa7d67fc700 1 -- 172.21.15.153:0/679003706 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800f970 con 0x7fa7e8063290 2023-08-17T00:10:33.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.487+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e814eeb0 con 0x7fa7e8063290 2023-08-17T00:10:33.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.487+0000 7fa7d67fc700 1 -- 172.21.15.153:0/679003706 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa7d8019030 con 0x7fa7e8063290 2023-08-17T00:10:33.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7d67fc700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7c805a150 0x7fa7c805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7d67fc700 1 -- 172.21.15.153:0/679003706 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa7d8073570 con 0x7fa7e8063290 2023-08-17T00:10:33.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7c805a150 0x7fa7c805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7f710d740 1 Processor -- start 2023-08-17T00:10:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7c805a150 0x7fa7c805c610 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa7dc007fd0 tx=0x7fa7dc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7f710d740 1 -- start start 2023-08-17T00:10:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x1545570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.491+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x14fd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x14fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1484cc0 con 0x14fd7e0 2023-08-17T00:10:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x14fe920 con 0x1545a60 2023-08-17T00:10:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1541260 con 0x1545190 2023-08-17T00:10:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x14fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e5d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x14fd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x1545570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x1545570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:42568/0 (socket says 172.21.15.153:42568) 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 -- 172.21.15.153:0/44446977 learned_addr learned my addr 172.21.15.153:0/44446977 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x14fdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48818/0 (socket says 172.21.15.153:48818) 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 -- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 msgr2=0x14fd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x14fd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 -- 172.21.15.153:0/44446977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 msgr2=0x14fdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x14fdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 -- 172.21.15.153:0/44446977 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x147dc00 con 0x1545190 2023-08-17T00:10:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e6d9d700 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x14fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7e659c700 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x1545570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fa7d804a980 tx=0x7fa7d800f000).ready entity=mon.2 client_cookie=ea03b7c48c206e7a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7c77fe700 1 -- 172.21.15.153:0/44446977 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8049080 con 0x1545190 2023-08-17T00:10:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7c77fe700 1 -- 172.21.15.153:0/44446977 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80502c0 con 0x1545190 2023-08-17T00:10:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7c77fe700 1 -- 172.21.15.153:0/44446977 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80473f0 con 0x1545190 2023-08-17T00:10:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 msgr2=0x1545570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x1545570 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fa7d804a980 tx=0x7fa7d800f000).stop 2023-08-17T00:10:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- 172.21.15.153:0/44446977 shutdown_connections 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x14fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x14fd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 --2- 172.21.15.153:0/44446977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x1545570 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- 172.21.15.153:0/44446977 >> 172.21.15.153:0/44446977 conn(0x12e3920 msgr2=0x15043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- 172.21.15.153:0/44446977 shutdown_connections 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.495+0000 7fa7f710d740 1 -- 172.21.15.153:0/44446977 wait complete. 2023-08-17T00:10:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 -- start start 2023-08-17T00:10:33.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 Processor -- start 2023-08-17T00:10:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x1525f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x15302e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x1548930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1558bc0 con 0x14fd7e0 2023-08-17T00:10:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1530ae0 con 0x1545a60 2023-08-17T00:10:33.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15573f0 con 0x1545190 2023-08-17T00:10:33.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7f710d740 10 client.0 ll_register_callbacks cb 0x147acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:33.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x1525f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x1525f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48828/0 (socket says 172.21.15.153:48828) 2023-08-17T00:10:33.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 -- 172.21.15.153:0/1333748222 learned_addr learned my addr 172.21.15.153:0/1333748222 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e6d9d700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x1548930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x15302e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 -- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 msgr2=0x15302e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x15302e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 -- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 msgr2=0x1548930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x1548930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 -- 172.21.15.153:0/1333748222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80c2140 con 0x14fd7e0 2023-08-17T00:10:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7e659c700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x1525f00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fa7d80471e0 tx=0x7fa7d801e000).ready entity=mon.0 client_cookie=5762f22a64872005 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/1333748222 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8055070 con 0x14fd7e0 2023-08-17T00:10:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.499+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/1333748222 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa7d8049080 con 0x14fd7e0 2023-08-17T00:10:33.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x147a8e0 con 0x14fd7e0 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/1333748222 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7d80730a0 con 0x14fd7e0 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 10 client.7248 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x7fa7e814eeb0 con 0x14fd7e0 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/1333748222 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x147a8e0 con 0x14fd7e0 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/1333748222 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa7d8046ad0 con 0x14fd7e0 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 10 client.7248 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 10 client.7248 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:33.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 20 client.7248 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15476d0 0x1547ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 4 client.7248 mds_command: new command op to 7080 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1470e30 con 0x15476d0 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15476d0 0x1547ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15476d0 0x1547ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=eb12c7970f93b9e9 server_cookie=1b5bf5b67751c7f8 in_seq=0 out_seq=0 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 10 client.7248 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/1333748222 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1470e30 con 0x15476d0 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 10 client.7248 handle_command_reply: tid=0 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 client.7248 shutdown 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 msgr2=0x1525f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x1525f00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7fa7d80471e0 tx=0x7fa7d801e000).stop 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 shutdown_connections 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15476d0 0x1547ab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1545a60 0x1548930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545190 0x15302e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 --2- 172.21.15.153:0/1333748222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x14fd7e0 0x1525f00 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7c4ff9700 0 client.7248 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 >> 172.21.15.153:0/1333748222 conn(0x12e3920 msgr2=0x1504260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 shutdown_connections 2023-08-17T00:10:33.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.503+0000 7fa7f710d740 1 -- 172.21.15.153:0/1333748222 wait complete. 2023-08-17T00:10:33.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.507+0000 7fa7f710d740 20 client.7248 trim_cache size 0 max 16384 2023-08-17T00:10:33.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 Processor -- start 2023-08-17T00:10:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 -- start start 2023-08-17T00:10:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fd7e0 0x15559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 0x14fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545a60 0x15547b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1547040 con 0x1545190 2023-08-17T00:10:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1459a80 con 0x14fd7e0 2023-08-17T00:10:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1544de0 con 0x1545a60 2023-08-17T00:10:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7e5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 0x14fdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7e5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 0x14fdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48836/0 (socket says 172.21.15.153:48836) 2023-08-17T00:10:33.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/3650086892 learned_addr learned my addr 172.21.15.153:0/3650086892 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.523+0000 7fa7e6d9d700 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545a60 0x15547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545a60 msgr2=0x15547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545a60 0x15547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e659c700 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fd7e0 0x15559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fd7e0 msgr2=0x15559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fd7e0 0x15559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/3650086892 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8150260 con 0x1545190 2023-08-17T00:10:33.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e659c700 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fd7e0 0x15559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:33.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 0x14fdd70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fa7e8150630 tx=0x7fa7dc00a000).ready entity=mon.0 client_cookie=63cae9982e31fc8b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7c7fff700 1 -- 172.21.15.153:0/3650086892 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc00fbd0 con 0x1545190 2023-08-17T00:10:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7c7fff700 1 -- 172.21.15.153:0/3650086892 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc00fd30 con 0x1545190 2023-08-17T00:10:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7c7fff700 1 -- 172.21.15.153:0/3650086892 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc026860 con 0x1545190 2023-08-17T00:10:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 -- 172.21.15.153:0/3650086892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 msgr2=0x14fdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 0x14fdd70 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7fa7e8150630 tx=0x7fa7dc00a000).stop 2023-08-17T00:10:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 -- 172.21.15.153:0/3650086892 shutdown_connections 2023-08-17T00:10:33.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1545a60 0x15547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545190 0x14fdd70 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 --2- 172.21.15.153:0/3650086892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x14fd7e0 0x15559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 -- 172.21.15.153:0/3650086892 >> 172.21.15.153:0/3650086892 conn(0x12e3920 msgr2=0x15302c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 -- 172.21.15.153:0/3650086892 shutdown_connections 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 -- 172.21.15.153:0/3650086892 wait complete. 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 -- start start 2023-08-17T00:10:33.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.527+0000 7fa7f710d740 1 Processor -- start 2023-08-17T00:10:33.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14fd7e0 0x1596270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 0x15278a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1549470 0x15498f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15b12e0 con 0x1545a60 2023-08-17T00:10:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x152d400 con 0x1549470 2023-08-17T00:10:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1528080 con 0x14fd7e0 2023-08-17T00:10:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7f710d740 10 client.0 ll_register_callbacks cb 0x7fa7d0003710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 0x15278a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 0x15278a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48850/0 (socket says 172.21.15.153:48850) 2023-08-17T00:10:33.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/2248643360 learned_addr learned my addr 172.21.15.153:0/2248643360 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e6d9d700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1549470 0x15498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e659c700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14fd7e0 0x1596270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14fd7e0 msgr2=0x1596270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14fd7e0 0x1596270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1549470 msgr2=0x15498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1549470 0x15498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e5d9b700 1 -- 172.21.15.153:0/2248643360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00033f0 con 0x1545a60 2023-08-17T00:10:33.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.531+0000 7fa7e659c700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14fd7e0 0x1596270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7e5d9b700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 0x15278a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fa7e814f9e0 tx=0x7fa7dc016030).ready entity=mon.0 client_cookie=f6ecccdb0d4b17b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/2248643360 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc026860 con 0x1545a60 2023-08-17T00:10:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/2248643360 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa7dc030c60 con 0x1545a60 2023-08-17T00:10:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7d80502c0 con 0x1545a60 2023-08-17T00:10:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/2248643360 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7dc030e20 con 0x1545a60 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 10 client.7254 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x14790a0 con 0x1545a60 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/2248643360 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80502c0 con 0x1545a60 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/2248643360 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa7dc039470 con 0x1545a60 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 10 client.7254 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 10 client.7254 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 20 client.7254 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15284f0 0x1528900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 4 client.7254 mds_command: new command op to 7080 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-08-17T00:10:33.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x133a8b0 con 0x15284f0 2023-08-17T00:10:33.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7e659c700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15284f0 0x1528900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7e659c700 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15284f0 0x1528900 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f66fcbe271a9a5e4 server_cookie=d48776ccc0f6a8c0 in_seq=0 out_seq=0 2023-08-17T00:10:33.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.535+0000 7fa7c4ff9700 10 client.7254 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7c4ff9700 1 -- 172.21.15.153:0/2248643360 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x133a8b0 con 0x15284f0 2023-08-17T00:10:33.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7c4ff9700 10 client.7254 handle_command_reply: tid=0 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 client.7254 shutdown 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 msgr2=0x15278a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 0x15278a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7fa7e814f9e0 tx=0x7fa7dc016030).stop 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 shutdown_connections 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x15284f0 0x1528900 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1549470 0x15498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1545a60 0x15278a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 --2- 172.21.15.153:0/2248643360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x14fd7e0 0x1596270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 >> 172.21.15.153:0/2248643360 conn(0x12e3920 msgr2=0x15559d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7c4ff9700 0 client.7254 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 shutdown_connections 2023-08-17T00:10:33.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 1 -- 172.21.15.153:0/2248643360 wait complete. 2023-08-17T00:10:33.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.539+0000 7fa7f710d740 20 client.7254 trim_cache size 0 max 16384 2023-08-17T00:10:33.549 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:10:33.549 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:10:33.550 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "c607c2d5-d2dd-449a-991a-a8e01b3ea889", 2023-08-17T00:10:33.550 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:10:33.550 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7c805a150 msgr2=0x7fa7c805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7c805a150 0x7fa7c805c610 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa7dc007fd0 tx=0x7fa7dc009040).stop 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 msgr2=0x7fa7e814ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814ddc0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7fa7d800c490 tx=0x7fa7d8007c90).stop 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 shutdown_connections 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7c805a150 0x7fa7c805c610 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7e80c1c70 0x7fa7e814fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7e80652f0 0x7fa7e814af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 --2- 172.21.15.153:0/679003706 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7e8063290 0x7fa7e814ddc0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 >> 172.21.15.153:0/679003706 conn(0x7fa7e80c7090 msgr2=0x7fa7e80a5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 shutdown_connections 2023-08-17T00:10:33.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.543+0000 7fa7ecd69700 1 -- 172.21.15.153:0/679003706 wait complete. 2023-08-17T00:10:33.571 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub abort 2023-08-17T00:10:33.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.743+0000 7f7c0f59e700 1 Processor -- start 2023-08-17T00:10:33.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.743+0000 7f7c0f59e700 1 -- start start 2023-08-17T00:10:33.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7c10153680 0x7f7c10153a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7c100c3f90 0x7f7c100a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100a8280 con 0x7f7c100be640 2023-08-17T00:10:33.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100a7fd0 con 0x7f7c10153680 2023-08-17T00:10:33.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100c43f0 con 0x7f7c100c3f90 2023-08-17T00:10:33.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7c100be640 0x7f7c100c2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:52674/0 (socket says 172.21.15.153:52674) 2023-08-17T00:10:33.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/991330334 learned_addr learned my addr 172.21.15.153:0/991330334 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:33.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/991330334 >> v2:172.21.15.153:3300/0 conn(0x7f7c10153680 0x7f7c10153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c07fff700 1 --2- 172.21.15.153:0/991330334 >> v2:172.21.15.178:3300/0 conn(0x7f7c100c3f90 0x7f7c100a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0e59c700 1 -- 172.21.15.153:0/991330334 >> v2:172.21.15.178:3300/0 conn(0x7f7c100c3f90 msgr2=0x7f7c100a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/991330334 >> v2:172.21.15.178:3300/0 conn(0x7f7c100c3f90 0x7f7c100a7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0e59c700 1 -- 172.21.15.153:0/991330334 >> v1:172.21.15.153:6789/0 conn(0x7f7c100be640 legacy=0x7f7c100c2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0e59c700 1 -- 172.21.15.153:0/991330334 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100c4690 con 0x7f7c10153680 2023-08-17T00:10:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/991330334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c10153a60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f7c100bf6a0 tx=0x7f7c00006f40).ready entity=mon.0 client_cookie=df61f5ab330b3bb3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0dd9b700 1 -- 172.21.15.153:0/991330334 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00005880 con 0x7f7c10153680 2023-08-17T00:10:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0dd9b700 1 -- 172.21.15.153:0/991330334 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c000059e0 con 0x7f7c10153680 2023-08-17T00:10:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0dd9b700 1 -- 172.21.15.153:0/991330334 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00005d60 con 0x7f7c10153680 2023-08-17T00:10:33.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 -- 172.21.15.153:0/991330334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 msgr2=0x7f7c10153a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/991330334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c10153a60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f7c100bf6a0 tx=0x7f7c00006f40).stop 2023-08-17T00:10:33.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 -- 172.21.15.153:0/991330334 shutdown_connections 2023-08-17T00:10:33.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/991330334 >> v2:172.21.15.178:3300/0 conn(0x7f7c100c3f90 0x7f7c100a7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/991330334 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c10153a60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.747+0000 7f7c0f59e700 1 -- 172.21.15.153:0/991330334 >> 172.21.15.153:0/991330334 conn(0x7f7c100c5170 msgr2=0x7f7c100c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 -- 172.21.15.153:0/991330334 shutdown_connections 2023-08-17T00:10:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 -- 172.21.15.153:0/991330334 wait complete. 2023-08-17T00:10:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 Processor -- start 2023-08-17T00:10:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 -- start start 2023-08-17T00:10:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c100be640 0x7f7c10163fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c100c3f90 0x7f7c100bf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c100c2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100a8410 con 0x7f7c10153680 2023-08-17T00:10:33.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c101645a0 con 0x7f7c100be640 2023-08-17T00:10:33.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10164880 con 0x7f7c100c3f90 2023-08-17T00:10:33.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c100c2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c100c2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48866/0 (socket says 172.21.15.153:48866) 2023-08-17T00:10:33.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.751+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/1815279511 learned_addr learned my addr 172.21.15.153:0/1815279511 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c07fff700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c100c3f90 0x7f7c100bf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c100be640 0x7f7c10163fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c100c3f90 msgr2=0x7f7c100bf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c100c3f90 0x7f7c100bf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c100be640 msgr2=0x7f7c10163fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c100be640 0x7f7c10163fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/1815279511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00009250 con 0x7f7c10153680 2023-08-17T00:10:33.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c100c2f00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f7c0800c790 tx=0x7f7c080015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c067fc700 1 -- 172.21.15.153:0/1815279511 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08005d30 con 0x7f7c10153680 2023-08-17T00:10:33.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c067fc700 1 -- 172.21.15.153:0/1815279511 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08005e90 con 0x7f7c10153680 2023-08-17T00:10:33.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c067fc700 1 -- 172.21.15.153:0/1815279511 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08007320 con 0x7f7c10153680 2023-08-17T00:10:33.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c10164b60 con 0x7f7c10153680 2023-08-17T00:10:33.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.755+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100bfc60 con 0x7f7c10153680 2023-08-17T00:10:33.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.759+0000 7f7c067fc700 1 -- 172.21.15.153:0/1815279511 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7c08010030 con 0x7f7c10153680 2023-08-17T00:10:33.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.759+0000 7f7c067fc700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7bf005a1a0 0x7f7bf005c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.759+0000 7f7c067fc700 1 -- 172.21.15.153:0/1815279511 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c080740c0 con 0x7f7c10153680 2023-08-17T00:10:33.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.759+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7bf005a1a0 0x7f7bf005c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7bf005a1a0 0x7f7bf005c660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7c00009fd0 tx=0x7f7c00016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 Processor -- start 2023-08-17T00:10:33.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 -- start start 2023-08-17T00:10:33.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x10b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1004160 con 0x10b77a0 2023-08-17T00:10:33.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1024ff0 con 0x10fb2f0 2023-08-17T00:10:33.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10f9c60 con 0x10b7c20 2023-08-17T00:10:33.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x10b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x10b42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48876/0 (socket says 172.21.15.153:48876) 2023-08-17T00:10:33.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 -- 172.21.15.153:0/2349257444 learned_addr learned my addr 172.21.15.153:0/2349257444 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 -- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 msgr2=0x10b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 -- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 msgr2=0x10fb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10fb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 -- 172.21.15.153:0/2349257444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1031fd0 con 0x10b77a0 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7c07fff700 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x10b42c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f7bf8009a60 tx=0x7f7bf8008040).ready entity=mon.0 client_cookie=a849c646e5cc5f56 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7bef7fe700 1 -- 172.21.15.153:0/2349257444 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8009ea0 con 0x10b77a0 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7bef7fe700 1 -- 172.21.15.153:0/2349257444 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8009520 con 0x10b77a0 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.763+0000 7f7bef7fe700 1 -- 172.21.15.153:0/2349257444 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8011960 con 0x10b77a0 2023-08-17T00:10:33.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2349257444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 msgr2=0x10b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x10b42c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f7bf8009a60 tx=0x7f7bf8008040).stop 2023-08-17T00:10:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2349257444 shutdown_connections 2023-08-17T00:10:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x10b42c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2349257444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10fb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2349257444 >> 172.21.15.153:0/2349257444 conn(0xe97640 msgr2=0x10b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2349257444 shutdown_connections 2023-08-17T00:10:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2349257444 wait complete. 2023-08-17T00:10:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 -- start start 2023-08-17T00:10:33.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.767+0000 7f7c1ebb0740 1 Processor -- start 2023-08-17T00:10:33.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b77a0 0x10dc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 0x10e0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10e0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e3ad0 con 0x10b7c20 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e0db0 con 0x10fb2f0 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10decc0 con 0x10b77a0 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 10 client.0 ll_register_callbacks cb 0x106f440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 0x10e0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 0x10e0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48878/0 (socket says 172.21.15.153:48878) 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 -- 172.21.15.153:0/1199628179 learned_addr learned my addr 172.21.15.153:0/1199628179 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b77a0 0x10dc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10e0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 -- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b77a0 msgr2=0x10dc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b77a0 0x10dc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 -- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 msgr2=0x10e0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10e0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 -- 172.21.15.153:0/1199628179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf8009710 con 0x10b7c20 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c07fff700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 0x10e0290 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x10fb050 tx=0x7f7bf801c000).ready entity=mon.0 client_cookie=cb19ef0bfad59e4a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7becff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7becff9700 1 -- 172.21.15.153:0/1199628179 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8015760 con 0x10b7c20 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x102ecb0 con 0x10b7c20 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7becff9700 1 -- 172.21.15.153:0/1199628179 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7bf80158c0 con 0x10b7c20 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7becff9700 1 -- 172.21.15.153:0/1199628179 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bf8015c90 con 0x10b7c20 2023-08-17T00:10:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 10 client.7269 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x102d470 con 0x10b7c20 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7becff9700 1 -- 172.21.15.153:0/1199628179 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x102ecb0 con 0x10b7c20 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7becff9700 1 -- 172.21.15.153:0/1199628179 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7bf801e3f0 con 0x10b7c20 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 10 client.7269 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 10 client.7269 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 20 client.7269 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10ce7e0 0x10cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 4 client.7269 mds_command: new command op to 7080 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:10:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1025200 con 0x10ce7e0 2023-08-17T00:10:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.771+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10ce7e0 0x10cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7becff9700 10 client.7269 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10ce7e0 0x10cebc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5c96d285715490a9 server_cookie=4485072ae1201eaa in_seq=0 out_seq=0 2023-08-17T00:10:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7becff9700 1 -- 172.21.15.153:0/1199628179 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1025200 con 0x10ce7e0 2023-08-17T00:10:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7becff9700 10 client.7269 handle_command_reply: tid=0 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 client.7269 shutdown 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 msgr2=0x10e0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 0x10e0290 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x10fb050 tx=0x7f7bf801c000).stop 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 shutdown_connections 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10ce7e0 0x10cebc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10e0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b7c20 0x10e0290 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7becff9700 0 client.7269 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/1199628179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b77a0 0x10dc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 >> 172.21.15.153:0/1199628179 conn(0xe97640 msgr2=0x10dcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 shutdown_connections 2023-08-17T00:10:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/1199628179 wait complete. 2023-08-17T00:10:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.775+0000 7f7c1ebb0740 20 client.7269 trim_cache size 0 max 16384 2023-08-17T00:10:33.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 Processor -- start 2023-08-17T00:10:33.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 -- start start 2023-08-17T00:10:33.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b77a0 0x10f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 0x10b2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x100de80 con 0x10fb2f0 2023-08-17T00:10:33.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b6be0 con 0x10b77a0 2023-08-17T00:10:33.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10dddc0 con 0x10b7c20 2023-08-17T00:10:33.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 0x10b2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 0x10b2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48880/0 (socket says 172.21.15.153:48880) 2023-08-17T00:10:33.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/2982596911 learned_addr learned my addr 172.21.15.153:0/2982596911 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b77a0 0x10f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c07fff700 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 msgr2=0x10b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b77a0 msgr2=0x10f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b77a0 0x10f89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 -- 172.21.15.153:0/2982596911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100a7790 con 0x10fb2f0 2023-08-17T00:10:33.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.795+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 0x10b2e90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f7c08047ca0 tx=0x7f7c0800f000).ready entity=mon.0 client_cookie=d6200299c698faa5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7beffff700 1 -- 172.21.15.153:0/2982596911 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c080722b0 con 0x10fb2f0 2023-08-17T00:10:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7beffff700 1 -- 172.21.15.153:0/2982596911 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c08072410 con 0x10fb2f0 2023-08-17T00:10:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7beffff700 1 -- 172.21.15.153:0/2982596911 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800a310 con 0x10fb2f0 2023-08-17T00:10:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2982596911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 msgr2=0x10b2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 0x10b2e90 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7f7c08047ca0 tx=0x7f7c0800f000).stop 2023-08-17T00:10:33.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2982596911 shutdown_connections 2023-08-17T00:10:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10fb2f0 0x10b2e90 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x10b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/2982596911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b77a0 0x10f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2982596911 >> 172.21.15.153:0/2982596911 conn(0xe97640 msgr2=0x10b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2982596911 shutdown_connections 2023-08-17T00:10:33.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/2982596911 wait complete. 2023-08-17T00:10:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 -- start start 2023-08-17T00:10:33.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.799+0000 7f7c1ebb0740 1 Processor -- start 2023-08-17T00:10:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x110c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x110c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10dcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x110cb40 con 0x10b77a0 2023-08-17T00:10:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x11693e0 con 0x10fb2f0 2023-08-17T00:10:33.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x110cd90 con 0x10b7c20 2023-08-17T00:10:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 10 client.0 ll_register_callbacks cb 0x7f7c00014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x110c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x110c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48890/0 (socket says 172.21.15.153:48890) 2023-08-17T00:10:33.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 -- 172.21.15.153:0/3392994123 learned_addr learned my addr 172.21.15.153:0/3392994123 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0ed9d700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10dcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c07fff700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x110c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 -- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 msgr2=0x110c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x110c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 -- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 msgr2=0x10dcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10dcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 -- 172.21.15.153:0/3392994123 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c100bfc60 con 0x10b77a0 2023-08-17T00:10:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c0e59c700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x110c020 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f7c00006000 tx=0x7f7c00030280).ready entity=mon.0 client_cookie=6a3b7ed3271b9f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7becff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:33.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7becff9700 1 -- 172.21.15.153:0/3392994123 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0000fb80 con 0x10b77a0 2023-08-17T00:10:33.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.803+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10df4e0 con 0x10b77a0 2023-08-17T00:10:33.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 1 -- 172.21.15.153:0/3392994123 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7c0000fce0 con 0x10b77a0 2023-08-17T00:10:33.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 1 -- 172.21.15.153:0/3392994123 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c0000fea0 con 0x10b77a0 2023-08-17T00:10:33.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 10 client.7275 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:33.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x10dc3a0 con 0x10b77a0 2023-08-17T00:10:33.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 1 -- 172.21.15.153:0/3392994123 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10df4e0 con 0x10b77a0 2023-08-17T00:10:33.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 1 -- 172.21.15.153:0/3392994123 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7c00025070 con 0x10b77a0 2023-08-17T00:10:33.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 10 client.7275 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:33.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 10 client.7275 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:33.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 20 client.7275 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:33.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10dd230 0x10b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:33.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 4 client.7275 mds_command: new command op to 7080 tid=0[{"prefix": "scrub abort"}] 2023-08-17T00:10:33.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x7f7bf8009520 con 0x10dd230 2023-08-17T00:10:33.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c07fff700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10dd230 0x10b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:33.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c07fff700 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10dd230 0x10b0940 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a4b5cbeba3e92ab7 server_cookie=39b43d0fe959951d in_seq=0 out_seq=0 2023-08-17T00:10:33.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 10 client.7275 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 1 -- 172.21.15.153:0/3392994123 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x7f7bf8009520 con 0x10dd230 2023-08-17T00:10:33.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 10 client.7275 handle_command_reply: tid=0 2023-08-17T00:10:33.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 client.7275 shutdown 2023-08-17T00:10:33.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 msgr2=0x110c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x110c020 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7f7c00006000 tx=0x7f7c00030280).stop 2023-08-17T00:10:33.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 shutdown_connections 2023-08-17T00:10:33.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10dd230 0x10b0940 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10fb2f0 0x10dcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b7c20 0x110c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7becff9700 0 client.7275 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:33.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 --2- 172.21.15.153:0/3392994123 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b77a0 0x110c020 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 >> 172.21.15.153:0/3392994123 conn(0xe97640 msgr2=0x10dc530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 shutdown_connections 2023-08-17T00:10:33.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 1 -- 172.21.15.153:0/3392994123 wait complete. 2023-08-17T00:10:33.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.807+0000 7f7c1ebb0740 20 client.7275 trim_cache size 0 max 16384 2023-08-17T00:10:33.826 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:10:33.826 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:10:33.826 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:10:33.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7bf005a1a0 msgr2=0x7f7bf005c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7bf005a1a0 0x7f7bf005c660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f7c00009fd0 tx=0x7f7c00016000).stop 2023-08-17T00:10:33.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 msgr2=0x7f7c100c2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:33.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c100c2f00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 rx=0x7f7c0800c790 tx=0x7f7c080015e0).stop 2023-08-17T00:10:33.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 shutdown_connections 2023-08-17T00:10:33.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7bf005a1a0 0x7f7bf005c660 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7c10153680 0x7f7c100c2f00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c100c3f90 0x7f7c100bf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 --2- 172.21.15.153:0/1815279511 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c100be640 0x7f7c10163fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:33.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 >> 172.21.15.153:0/1815279511 conn(0x7f7c100c5170 msgr2=0x7f7c1014ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:33.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 shutdown_connections 2023-08-17T00:10:33.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.811+0000 7f7c0f59e700 1 -- 172.21.15.153:0/1815279511 wait complete. 2023-08-17T00:10:33.836 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-08-17T00:10:33.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.991+0000 7fa14f746700 1 Processor -- start 2023-08-17T00:10:33.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.991+0000 7fa14f746700 1 -- start start 2023-08-17T00:10:34.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa148061fa0 0x7fa1480c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148062380 0x7fa1480c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa148063700 0x7fa148063b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480c1930 con 0x7fa148061fa0 2023-08-17T00:10:34.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480c1370 con 0x7fa148063700 2023-08-17T00:10:34.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c1650 con 0x7fa148062380 2023-08-17T00:10:34.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa148061fa0 0x7fa1480c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa148061fa0 0x7fa1480c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48892/0 (socket says 172.21.15.153:48892) 2023-08-17T00:10:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 -- 172.21.15.153:0/4131177610 learned_addr learned my addr 172.21.15.153:0/4131177610 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14cce1700 1 --2- 172.21.15.153:0/4131177610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148062380 0x7fa1480c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14dce3700 1 --2- 172.21.15.153:0/4131177610 >> v2:172.21.15.178:3300/0 conn(0x7fa148063700 0x7fa148063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 -- 172.21.15.153:0/4131177610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148062380 msgr2=0x7fa1480c0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/4131177610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148062380 0x7fa1480c0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 -- 172.21.15.153:0/4131177610 >> v2:172.21.15.178:3300/0 conn(0x7fa148063700 msgr2=0x7fa148063b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/4131177610 >> v2:172.21.15.178:3300/0 conn(0x7fa148063700 0x7fa148063b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 -- 172.21.15.153:0/4131177610 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480aaaa0 con 0x7fa148061fa0 2023-08-17T00:10:34.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14dce3700 1 --2- 172.21.15.153:0/4131177610 >> v2:172.21.15.178:3300/0 conn(0x7fa148063700 0x7fa148063b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/4131177610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148061fa0 0x7fa1480c5f50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fa1480c5d90 tx=0x7fa1440090f0).ready entity=mon.0 client_cookie=214fe525835b12cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa13ffff700 1 -- 172.21.15.153:0/4131177610 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400b600 con 0x7fa148061fa0 2023-08-17T00:10:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa13ffff700 1 -- 172.21.15.153:0/4131177610 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14400b760 con 0x7fa148061fa0 2023-08-17T00:10:34.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa13ffff700 1 -- 172.21.15.153:0/4131177610 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14400bb00 con 0x7fa148061fa0 2023-08-17T00:10:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 -- 172.21.15.153:0/4131177610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148061fa0 msgr2=0x7fa1480c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.995+0000 7fa14f746700 1 --2- 172.21.15.153:0/4131177610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148061fa0 0x7fa1480c5f50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7fa1480c5d90 tx=0x7fa1440090f0).stop 2023-08-17T00:10:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 -- 172.21.15.153:0/4131177610 shutdown_connections 2023-08-17T00:10:34.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 --2- 172.21.15.153:0/4131177610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148062380 0x7fa1480c0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 --2- 172.21.15.153:0/4131177610 >> v2:172.21.15.178:3300/0 conn(0x7fa148063700 0x7fa148063b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 --2- 172.21.15.153:0/4131177610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148061fa0 0x7fa1480c5f50 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 -- 172.21.15.153:0/4131177610 >> 172.21.15.153:0/4131177610 conn(0x7fa1480cab00 msgr2=0x7fa1480caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:34.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 -- 172.21.15.153:0/4131177610 shutdown_connections 2023-08-17T00:10:34.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 -- 172.21.15.153:0/4131177610 wait complete. 2023-08-17T00:10:34.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:33.999+0000 7fa14f746700 1 Processor -- start 2023-08-17T00:10:34.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 -- start start 2023-08-17T00:10:34.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148061fa0 0x7fa148147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 0x7fa148156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148063700 0x7fa148150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148157770 con 0x7fa148062380 2023-08-17T00:10:34.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480af320 con 0x7fa148063700 2023-08-17T00:10:34.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14f746700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa148157490 con 0x7fa148061fa0 2023-08-17T00:10:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14cce1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 0x7fa148156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14cce1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 0x7fa148156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48896/0 (socket says 172.21.15.153:48896) 2023-08-17T00:10:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14cce1700 1 -- 172.21.15.153:0/2060021304 learned_addr learned my addr 172.21.15.153:0/2060021304 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148061fa0 0x7fa148147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.003+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148063700 0x7fa148150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14cce1700 1 -- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148061fa0 msgr2=0x7fa148147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148061fa0 0x7fa148147fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14cce1700 1 -- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148063700 msgr2=0x7fa148150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148063700 0x7fa148150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14cce1700 1 -- 172.21.15.153:0/2060021304 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144009370 con 0x7fa148062380 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148061fa0 0x7fa148147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148063700 0x7fa148150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 0x7fa148156b20 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fa13800d890 tx=0x7fa138008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa13d7fa700 1 -- 172.21.15.153:0/2060021304 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138011590 con 0x7fa148062380 2023-08-17T00:10:34.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa13d7fa700 1 -- 172.21.15.153:0/2060021304 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1380116f0 con 0x7fa148062380 2023-08-17T00:10:34.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1480aecd0 con 0x7fa148062380 2023-08-17T00:10:34.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa13d7fa700 1 -- 172.21.15.153:0/2060021304 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138011a70 con 0x7fa148062380 2023-08-17T00:10:34.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.007+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa148157010 con 0x7fa148062380 2023-08-17T00:10:34.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa13d7fa700 1 -- 172.21.15.153:0/2060021304 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa13801c460 con 0x7fa148062380 2023-08-17T00:10:34.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa13d7fa700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa12c05a150 0x7fa12c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa13d7fa700 1 -- 172.21.15.153:0/2060021304 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa138074220 con 0x7fa148062380 2023-08-17T00:10:34.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 Processor -- start 2023-08-17T00:10:34.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa12c05a150 0x7fa12c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 -- start start 2023-08-17T00:10:34.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8b860 0x1fb2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8bce0 0x1fb2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eb21a0 con 0x1fa7d20 2023-08-17T00:10:34.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f66300 con 0x1f8bce0 2023-08-17T00:10:34.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f65730 con 0x1f8b860 2023-08-17T00:10:34.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa12c05a150 0x7fa12c05c610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fa14400b3c0 tx=0x7fa144017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.011+0000 7fa14d4e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48912/0 (socket says 172.21.15.153:48912) 2023-08-17T00:10:34.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 -- 172.21.15.153:0/3846640112 learned_addr learned my addr 172.21.15.153:0/3846640112 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:34.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14cce1700 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8b860 0x1fb2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14dce3700 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8bce0 0x1fb2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 -- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8b860 msgr2=0x1fb2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8b860 0x1fb2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 -- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8bce0 msgr2=0x1fb2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8bce0 0x1fb2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 -- 172.21.15.153:0/3846640112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ee0010 con 0x1fa7d20 2023-08-17T00:10:34.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14cce1700 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8b860 0x1fb2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:34.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa8100 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fa144006cc0 tx=0x7fa144020000).ready entity=mon.0 client_cookie=ac27827dfb34f033 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa1327fc700 1 -- 172.21.15.153:0/3846640112 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144020070 con 0x1fa7d20 2023-08-17T00:10:34.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa1327fc700 1 -- 172.21.15.153:0/3846640112 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144011910 con 0x1fa7d20 2023-08-17T00:10:34.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa1327fc700 1 -- 172.21.15.153:0/3846640112 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144011c90 con 0x1fa7d20 2023-08-17T00:10:34.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 -- 172.21.15.153:0/3846640112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 msgr2=0x1fa8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa8100 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7fa144006cc0 tx=0x7fa144020000).stop 2023-08-17T00:10:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 -- 172.21.15.153:0/3846640112 shutdown_connections 2023-08-17T00:10:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8bce0 0x1fb2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8b860 0x1fb2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 --2- 172.21.15.153:0/3846640112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa8100 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 -- 172.21.15.153:0/3846640112 >> 172.21.15.153:0/3846640112 conn(0x1d45680 msgr2=0x1f667d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:34.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 -- 172.21.15.153:0/3846640112 shutdown_connections 2023-08-17T00:10:34.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 -- 172.21.15.153:0/3846640112 wait complete. 2023-08-17T00:10:34.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 -- start start 2023-08-17T00:10:34.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.015+0000 7fa159ac6740 1 Processor -- start 2023-08-17T00:10:34.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f89110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1fb88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa4d30 con 0x1fa7d20 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f89600 con 0x1f8b860 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fb92e0 con 0x1f8bce0 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 10 client.0 ll_register_callbacks cb 0x1f1d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48920/0 (socket says 172.21.15.153:48920) 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 -- 172.21.15.153:0/2520453061 learned_addr learned my addr 172.21.15.153:0/2520453061 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:34.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1fb88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f89110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 -- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 msgr2=0x1fb88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1fb88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 -- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 msgr2=0x1f89110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f89110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 -- 172.21.15.153:0/2520453061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa148157010 con 0x1fa7d20 2023-08-17T00:10:34.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1fb88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa6850 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fa14000ff10 tx=0x7fa1400079b0).ready entity=mon.0 client_cookie=53f89319f922303f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa1277fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa1277fe700 1 -- 172.21.15.153:0/2520453061 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa140014070 con 0x1fa7d20 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa1277fe700 1 -- 172.21.15.153:0/2520453061 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa14000edd0 con 0x1fa7d20 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1eae200 con 0x1fa7d20 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa1277fe700 1 -- 172.21.15.153:0/2520453061 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa140007d20 con 0x1fa7d20 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 10 client.7287 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:34.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.019+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x7fa1480aaaa0 con 0x1fa7d20 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa1277fe700 1 -- 172.21.15.153:0/2520453061 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1eae200 con 0x1fa7d20 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa1277fe700 1 -- 172.21.15.153:0/2520453061 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa14000a590 con 0x1fa7d20 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 10 client.7287 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 10 client.7287 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 20 client.7287 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1fa5820 0x1fad280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 4 client.7287 mds_command: new command op to 7080 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:10:34.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1edccf0 con 0x1fa5820 2023-08-17T00:10:34.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1fa5820 0x1fad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1fa5820 0x1fad280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=10be863655c10215 server_cookie=35902acfc1958a5e in_seq=0 out_seq=0 2023-08-17T00:10:34.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa1277fe700 10 client.7287 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:34.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa1277fe700 1 -- 172.21.15.153:0/2520453061 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1edccf0 con 0x1fa5820 2023-08-17T00:10:34.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa1277fe700 10 client.7287 handle_command_reply: tid=0 2023-08-17T00:10:34.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 client.7287 shutdown 2023-08-17T00:10:34.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 msgr2=0x1fa6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa6850 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fa14000ff10 tx=0x7fa1400079b0).stop 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 shutdown_connections 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1fa5820 0x1fad280 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fa6850 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1fb88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2520453061 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f89110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 >> 172.21.15.153:0/2520453061 conn(0x1d45680 msgr2=0x1f61480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa1277fe700 0 client.7287 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:34.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 shutdown_connections 2023-08-17T00:10:34.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 1 -- 172.21.15.153:0/2520453061 wait complete. 2023-08-17T00:10:34.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.023+0000 7fa159ac6740 20 client.7287 trim_cache size 0 max 16384 2023-08-17T00:10:34.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 Processor -- start 2023-08-17T00:10:34.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 -- start start 2023-08-17T00:10:34.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 0x1f602c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fa7d20 0x1f607b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f60ca0 con 0x1f8bce0 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f2a7e0 con 0x1f8b860 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1edccf0 con 0x1fa7d20 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa14cce1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 0x1f602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa14cce1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 0x1f602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48924/0 (socket says 172.21.15.153:48924) 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa14cce1700 1 -- 172.21.15.153:0/2458176390 learned_addr learned my addr 172.21.15.153:0/2458176390 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fa7d20 0x1f607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.043+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14cce1700 1 -- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fa7d20 msgr2=0x1f607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fa7d20 0x1f607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14cce1700 1 -- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 msgr2=0x1f8a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f8a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14cce1700 1 -- 172.21.15.153:0/2458176390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f89470 con 0x1f8bce0 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14dce3700 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fa7d20 0x1f607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:34.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa14cce1700 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 0x1f602c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fa138047d20 tx=0x7fa13804e040).ready entity=mon.0 client_cookie=435cd475f98f17ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa132ffd700 1 -- 172.21.15.153:0/2458176390 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138019dc0 con 0x1f8bce0 2023-08-17T00:10:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa132ffd700 1 -- 172.21.15.153:0/2458176390 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138049bc0 con 0x1f8bce0 2023-08-17T00:10:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa132ffd700 1 -- 172.21.15.153:0/2458176390 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13804ad10 con 0x1f8bce0 2023-08-17T00:10:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 -- 172.21.15.153:0/2458176390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 msgr2=0x1f602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 0x1f602c0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fa138047d20 tx=0x7fa13804e040).stop 2023-08-17T00:10:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 -- 172.21.15.153:0/2458176390 shutdown_connections 2023-08-17T00:10:34.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1fa7d20 0x1f607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f8bce0 0x1f602c0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 --2- 172.21.15.153:0/2458176390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f8a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 -- 172.21.15.153:0/2458176390 >> 172.21.15.153:0/2458176390 conn(0x1d45680 msgr2=0x1f8aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:34.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 -- 172.21.15.153:0/2458176390 shutdown_connections 2023-08-17T00:10:34.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 -- 172.21.15.153:0/2458176390 wait complete. 2023-08-17T00:10:34.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.047+0000 7fa159ac6740 1 -- start start 2023-08-17T00:10:34.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 Processor -- start 2023-08-17T00:10:34.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f61030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1f61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fa6540 con 0x1fa7d20 2023-08-17T00:10:34.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f61a10 con 0x1f8b860 2023-08-17T00:10:34.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20100c0 con 0x1f8bce0 2023-08-17T00:10:34.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa159ac6740 10 client.0 ll_register_callbacks cb 0x7fa14000fab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:34.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fab470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48928/0 (socket says 172.21.15.153:48928) 2023-08-17T00:10:34.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 -- 172.21.15.153:0/1957125737 learned_addr learned my addr 172.21.15.153:0/1957125737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:34.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14cce1700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1f61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f61030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 -- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 msgr2=0x1f61520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1f61520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 -- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 msgr2=0x1f61030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f61030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.051+0000 7fa14dce3700 1 -- 172.21.15.153:0/1957125737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1480aecd0 con 0x1fa7d20 2023-08-17T00:10:34.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa14dce3700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fab470 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x1fa5420 tx=0x7fa140021000).ready entity=mon.0 client_cookie=9c83a5369b9b52fd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:34.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:34.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 1 -- 172.21.15.153:0/1957125737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002b070 con 0x1fa7d20 2023-08-17T00:10:34.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 1 -- 172.21.15.153:0/1957125737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa140007d20 con 0x1fa7d20 2023-08-17T00:10:34.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa144011910 con 0x1fa7d20 2023-08-17T00:10:34.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 1 -- 172.21.15.153:0/1957125737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa14000e9b0 con 0x1fa7d20 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 10 client.7293 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x7fa148151600 con 0x1fa7d20 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 1 -- 172.21.15.153:0/1957125737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144011910 con 0x1fa7d20 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 1 -- 172.21.15.153:0/1957125737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa14000ac60 con 0x1fa7d20 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 10 client.7293 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 10 client.7293 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:34.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 20 client.7293 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1f60700 0x1fab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 4 client.7293 mds_command: new command op to 7080 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1ed3240 con 0x1f60700 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1f60700 0x1fab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 10 client.7293 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa14d4e2700 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1f60700 0x1fab960 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=88160b6f1e3b7238 server_cookie=145b89db3a01827c in_seq=0 out_seq=0 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 1 -- 172.21.15.153:0/1957125737 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x1ed3240 con 0x1f60700 2023-08-17T00:10:34.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa1277fe700 10 client.7293 handle_command_reply: tid=0 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 client.7293 shutdown 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 msgr2=0x1fab470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.055+0000 7fa159ac6740 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fab470 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x1fa5420 tx=0x7fa140021000).stop 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 shutdown_connections 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1f60700 0x1fab960 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1fa7d20 0x1fab470 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f8bce0 0x1f61520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 --2- 172.21.15.153:0/1957125737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f8b860 0x1f61030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 >> 172.21.15.153:0/1957125737 conn(0x1d45680 msgr2=0x1fbb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:34.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa1277fe700 0 client.7293 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:34.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 shutdown_connections 2023-08-17T00:10:34.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 1 -- 172.21.15.153:0/1957125737 wait complete. 2023-08-17T00:10:34.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa159ac6740 20 client.7293 trim_cache size 0 max 16384 2023-08-17T00:10:34.068 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:10:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:10:34.068 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "c607c2d5-d2dd-449a-991a-a8e01b3ea889": { 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_control_test_path", 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "c607c2d5-d2dd-449a-991a-a8e01b3ea889", 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive" 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:34.069 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:10:34.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa12c05a150 msgr2=0x7fa12c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa12c05a150 0x7fa12c05c610 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fa14400b3c0 tx=0x7fa144017000).stop 2023-08-17T00:10:34.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 msgr2=0x7fa148156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 0x7fa148156b20 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7fa13800d890 tx=0x7fa138008040).stop 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 shutdown_connections 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa12c05a150 0x7fa12c05c610 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa148063700 0x7fa148150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa148062380 0x7fa148156b20 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 --2- 172.21.15.153:0/2060021304 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa148061fa0 0x7fa148147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 >> 172.21.15.153:0/2060021304 conn(0x7fa1480cab00 msgr2=0x7fa1481538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:34.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 shutdown_connections 2023-08-17T00:10:34.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:34.059+0000 7fa14f746700 1 -- 172.21.15.153:0/2060021304 wait complete. 2023-08-17T00:10:39.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-08-17T00:10:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 Processor -- start 2023-08-17T00:10:39.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 -- start start 2023-08-17T00:10:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f74151b90 0x7f3f74151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3f74063290 0x7f3f74065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 0x7f3f74064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740c3fb0 con 0x7f3f74151b90 2023-08-17T00:10:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f74152460 con 0x7f3f74063290 2023-08-17T00:10:39.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.243+0000 7f3f7b21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74061fa0 con 0x7f3f74065b50 2023-08-17T00:10:39.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f78fb7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f74151b90 0x7f3f74151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 0x7f3f74064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 0x7f3f74064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:52504/0 (socket says 172.21.15.153:52504) 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 -- 172.21.15.153:0/1781152929 learned_addr learned my addr 172.21.15.153:0/1781152929 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/1781152929 >> v2:172.21.15.178:3300/0 conn(0x7f3f74063290 0x7f3f74065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 -- 172.21.15.153:0/1781152929 >> v2:172.21.15.178:3300/0 conn(0x7f3f74063290 msgr2=0x7f3f74065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 --2- 172.21.15.153:0/1781152929 >> v2:172.21.15.178:3300/0 conn(0x7f3f74063290 0x7f3f74065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 -- 172.21.15.153:0/1781152929 >> v2:172.21.15.153:3300/0 conn(0x7f3f74151b90 msgr2=0x7f3f74151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 --2- 172.21.15.153:0/1781152929 >> v2:172.21.15.153:3300/0 conn(0x7f3f74151b90 0x7f3f74151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 -- 172.21.15.153:0/1781152929 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740621f0 con 0x7f3f74065b50 2023-08-17T00:10:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f797b8700 1 --2- 172.21.15.153:0/1781152929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 0x7f3f74064870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3f7405ebc0 tx=0x7f3f6c009840).ready entity=mon.2 client_cookie=27666133c7561f19 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f6b7fe700 1 -- 172.21.15.153:0/1781152929 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00e070 con 0x7f3f74065b50 2023-08-17T00:10:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f6b7fe700 1 -- 172.21.15.153:0/1781152929 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00b970 con 0x7f3f74065b50 2023-08-17T00:10:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f6b7fe700 1 -- 172.21.15.153:0/1781152929 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00bcf0 con 0x7f3f74065b50 2023-08-17T00:10:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 -- 172.21.15.153:0/1781152929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 msgr2=0x7f3f74064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/1781152929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 0x7f3f74064870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f3f7405ebc0 tx=0x7f3f6c009840).stop 2023-08-17T00:10:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 -- 172.21.15.153:0/1781152929 shutdown_connections 2023-08-17T00:10:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/1781152929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74065b50 0x7f3f74064870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/1781152929 >> v2:172.21.15.178:3300/0 conn(0x7f3f74063290 0x7f3f74065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/1781152929 >> v2:172.21.15.153:3300/0 conn(0x7f3f74151b90 0x7f3f74151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 -- 172.21.15.153:0/1781152929 >> 172.21.15.153:0/1781152929 conn(0x7f3f740c7150 msgr2=0x7f3f740c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 -- 172.21.15.153:0/1781152929 shutdown_connections 2023-08-17T00:10:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.247+0000 7f3f7b21b700 1 -- 172.21.15.153:0/1781152929 wait complete. 2023-08-17T00:10:39.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.251+0000 7f3f7b21b700 1 Processor -- start 2023-08-17T00:10:39.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 -- start start 2023-08-17T00:10:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 0x7f3f74158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f74065b50 0x7f3f741444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74151b90 0x7f3f740a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740a3f50 con 0x7f3f74063290 2023-08-17T00:10:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74158a80 con 0x7f3f74065b50 2023-08-17T00:10:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f741449d0 con 0x7f3f74151b90 2023-08-17T00:10:39.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 0x7f3f74158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 0x7f3f74158590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55786/0 (socket says 172.21.15.153:55786) 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 -- 172.21.15.153:0/2710210717 learned_addr learned my addr 172.21.15.153:0/2710210717 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f74065b50 0x7f3f741444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f797b8700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74151b90 0x7f3f740a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 -- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74151b90 msgr2=0x7f3f740a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74151b90 0x7f3f740a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 -- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f74065b50 msgr2=0x7f3f741444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f74065b50 0x7f3f741444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 -- 172.21.15.153:0/2710210717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c009ae0 con 0x7f3f74063290 2023-08-17T00:10:39.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 0x7f3f74158590 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f3f7000e930 tx=0x7f3f70009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f68ff9700 1 -- 172.21.15.153:0/2710210717 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000eed0 con 0x7f3f74063290 2023-08-17T00:10:39.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f741590a0 con 0x7f3f74063290 2023-08-17T00:10:39.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f68ff9700 1 -- 172.21.15.153:0/2710210717 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7000c850 con 0x7f3f74063290 2023-08-17T00:10:39.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f68ff9700 1 -- 172.21.15.153:0/2710210717 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7000cbd0 con 0x7f3f74063290 2023-08-17T00:10:39.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.255+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f740a3be0 con 0x7f3f74063290 2023-08-17T00:10:39.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.259+0000 7f3f68ff9700 1 -- 172.21.15.153:0/2710210717 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3f70022070 con 0x7f3f74063290 2023-08-17T00:10:39.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f68ff9700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f68ff9700 1 -- 172.21.15.153:0/2710210717 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3f700746c0 con 0x7f3f74063290 2023-08-17T00:10:39.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f855b5740 1 Processor -- start 2023-08-17T00:10:39.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f855b5740 1 -- start start 2023-08-17T00:10:39.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f3f740692a0 tx=0x7f3f64008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.263+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 0x10b7100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x109a860 0x10c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xfc11a0 con 0x109a860 2023-08-17T00:10:39.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1075300 con 0x109ace0 2023-08-17T00:10:39.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1074730 con 0x10b6d20 2023-08-17T00:10:39.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 0x10b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 0x10b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:52534/0 (socket says 172.21.15.153:52534) 2023-08-17T00:10:39.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 -- 172.21.15.153:0/1404590751 learned_addr learned my addr 172.21.15.153:0/1404590751 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f797b8700 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 -- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 msgr2=0x10c1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 -- 172.21.15.153:0/1404590751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x109a860 msgr2=0x10c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x109a860 0x10c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:10:39.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 -- 172.21.15.153:0/1404590751 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfef010 con 0x10b6d20 2023-08-17T00:10:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 0x10b7100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3f7004b9b0 tx=0x7f3f70011000).ready entity=mon.2 client_cookie=a2f126b78087cbdf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f59ffb700 1 -- 172.21.15.153:0/1404590751 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700512f0 con 0x10b6d20 2023-08-17T00:10:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f59ffb700 1 -- 172.21.15.153:0/1404590751 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70051450 con 0x10b6d20 2023-08-17T00:10:39.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f59ffb700 1 -- 172.21.15.153:0/1404590751 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70048430 con 0x10b6d20 2023-08-17T00:10:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 -- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 msgr2=0x10b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.267+0000 7f3f855b5740 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 0x10b7100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3f7004b9b0 tx=0x7f3f70011000).stop 2023-08-17T00:10:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 -- 172.21.15.153:0/1404590751 shutdown_connections 2023-08-17T00:10:39.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x109a860 0x10c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:10:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 --2- 172.21.15.153:0/1404590751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10b6d20 0x10b7100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 -- 172.21.15.153:0/1404590751 >> 172.21.15.153:0/1404590751 conn(0xe54680 msgr2=0x10757d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 -- 172.21.15.153:0/1404590751 shutdown_connections 2023-08-17T00:10:39.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 -- 172.21.15.153:0/1404590751 wait complete. 2023-08-17T00:10:39.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 -- start start 2023-08-17T00:10:39.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.271+0000 7f3f855b5740 1 Processor -- start 2023-08-17T00:10:39.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x109d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x1099e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x109da30 con 0x10b6d20 2023-08-17T00:10:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x109c760 con 0x109ace0 2023-08-17T00:10:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x109def0 con 0x109a860 2023-08-17T00:10:39.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f855b5740 10 client.0 ll_register_callbacks cb 0x102c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x1099e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x1099e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55812/0 (socket says 172.21.15.153:55812) 2023-08-17T00:10:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 -- 172.21.15.153:0/2445231193 learned_addr learned my addr 172.21.15.153:0/2445231193 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x109d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 -- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 msgr2=0x10b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 -- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 msgr2=0x109d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x109d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 -- 172.21.15.153:0/2445231193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f740a3be0 con 0x10b6d20 2023-08-17T00:10:39.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f797b8700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x1099e20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f3f6c010000 tx=0x7f3f6c009840).ready entity=mon.0 client_cookie=449e2769c3e3adfa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.275+0000 7f3f52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:10:39.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 1 -- 172.21.15.153:0/2445231193 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c013780 con 0x10b6d20 2023-08-17T00:10:39.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 1 -- 172.21.15.153:0/2445231193 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f3f6c0138e0 con 0x10b6d20 2023-08-17T00:10:39.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xfbd200 con 0x10b6d20 2023-08-17T00:10:39.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 1 -- 172.21.15.153:0/2445231193 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f6c013cb0 con 0x10b6d20 2023-08-17T00:10:39.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 10 client.7302 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:39.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0xfea4b0 con 0x10b6d20 2023-08-17T00:10:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 1 -- 172.21.15.153:0/2445231193 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xfbd200 con 0x10b6d20 2023-08-17T00:10:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 1 -- 172.21.15.153:0/2445231193 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f6c027350 con 0x10b6d20 2023-08-17T00:10:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 10 client.7302 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 10 client.7302 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:39.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 20 client.7302 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10d2320 0x10d4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 4 client.7302 mds_command: new command op to 7080 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:10:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfebcf0 con 0x10d2320 2023-08-17T00:10:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10d2320 0x10d4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10d2320 0x10d4740 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f6f81bafd9e6e057 server_cookie=dddd8936ff4442f7 in_seq=0 out_seq=0 2023-08-17T00:10:39.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 10 client.7302 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 1 -- 172.21.15.153:0/2445231193 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xfebcf0 con 0x10d2320 2023-08-17T00:10:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f52ffd700 10 client.7302 handle_command_reply: tid=0 2023-08-17T00:10:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 client.7302 shutdown 2023-08-17T00:10:39.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 msgr2=0x1099e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.279+0000 7f3f855b5740 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x1099e20 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7f3f6c010000 tx=0x7f3f6c009840).stop 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 shutdown_connections 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x10d2320 0x10d4740 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x1099e20 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x109d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 --2- 172.21.15.153:0/2445231193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f52ffd700 0 client.7302 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 >> 172.21.15.153:0/2445231193 conn(0xe54680 msgr2=0x10bbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 shutdown_connections 2023-08-17T00:10:39.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 1 -- 172.21.15.153:0/2445231193 wait complete. 2023-08-17T00:10:39.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.283+0000 7f3f855b5740 20 client.7302 trim_cache size 0 max 16384 2023-08-17T00:10:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.295+0000 7f3f855b5740 1 Processor -- start 2023-08-17T00:10:39.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.295+0000 7f3f855b5740 1 -- start start 2023-08-17T00:10:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x106f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xfcaf60 con 0x10b6d20 2023-08-17T00:10:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b7470 con 0x109ace0 2023-08-17T00:10:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xfebcf0 con 0x109a860 2023-08-17T00:10:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10c73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55824/0 (socket says 172.21.15.153:55824) 2023-08-17T00:10:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 -- 172.21.15.153:0/250078622 learned_addr learned my addr 172.21.15.153:0/250078622 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x106f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 -- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 msgr2=0x106f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x106f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 -- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 msgr2=0x10c6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 -- 172.21.15.153:0/250078622 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740a7510 con 0x10b6d20 2023-08-17T00:10:39.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x106f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:39.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f797b8700 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10c73a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f3f6c003370 tx=0x7f3f6c01f000).ready entity=mon.0 client_cookie=86ab9c49be971f6d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f5a7fc700 1 -- 172.21.15.153:0/250078622 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0090d0 con 0x10b6d20 2023-08-17T00:10:39.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f5a7fc700 1 -- 172.21.15.153:0/250078622 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00bdf0 con 0x10b6d20 2023-08-17T00:10:39.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f5a7fc700 1 -- 172.21.15.153:0/250078622 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c027350 con 0x10b6d20 2023-08-17T00:10:39.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- 172.21.15.153:0/250078622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 msgr2=0x10c73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10c73a0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 rx=0x7f3f6c003370 tx=0x7f3f6c01f000).stop 2023-08-17T00:10:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- 172.21.15.153:0/250078622 shutdown_connections 2023-08-17T00:10:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10c73a0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x10c6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 --2- 172.21.15.153:0/250078622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x106f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- 172.21.15.153:0/250078622 >> 172.21.15.153:0/250078622 conn(0xe54680 msgr2=0x10b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.299+0000 7f3f855b5740 1 -- 172.21.15.153:0/250078622 shutdown_connections 2023-08-17T00:10:39.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 -- 172.21.15.153:0/250078622 wait complete. 2023-08-17T00:10:39.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 -- start start 2023-08-17T00:10:39.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 Processor -- start 2023-08-17T00:10:39.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x110cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10d06d0 con 0x10b6d20 2023-08-17T00:10:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1121740 con 0x109ace0 2023-08-17T00:10:39.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10d0250 con 0x109a860 2023-08-17T00:10:39.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f855b5740 10 client.0 ll_register_callbacks cb 0x7f3f70006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:10:39.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55834/0 (socket says 172.21.15.153:55834) 2023-08-17T00:10:39.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x110cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.303+0000 7f3f797b8700 1 -- 172.21.15.153:0/4283788800 learned_addr learned my addr 172.21.15.153:0/4283788800 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f78fb7700 1 -- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 msgr2=0x110cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x110cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f78fb7700 1 -- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 msgr2=0x10cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f78fb7700 1 -- 172.21.15.153:0/4283788800 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0xfea4b0 con 0x109a860 2023-08-17T00:10:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f797b8700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:39.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f78fb7700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10cfd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x10748c0 tx=0x7f3f7004f000).ready entity=mon.2 client_cookie=6fc2b49a70b4ff0b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2023-08-17T00:10:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 1 -- 172.21.15.153:0/4283788800 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7005d0d0 con 0x109a860 2023-08-17T00:10:39.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 1 -- 172.21.15.153:0/4283788800 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f3f7000c560 con 0x109a860 2023-08-17T00:10:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f70051450 con 0x109a860 2023-08-17T00:10:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 1 -- 172.21.15.153:0/4283788800 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f70048430 con 0x109a860 2023-08-17T00:10:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 10 client.6332 fetch_fsmap learned FSMap version 85 2023-08-17T00:10:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0xfea200 con 0x109a860 2023-08-17T00:10:39.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 1 -- 172.21.15.153:0/4283788800 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70051450 con 0x109a860 2023-08-17T00:10:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 1 -- 172.21.15.153:0/4283788800 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f70047d20 con 0x109a860 2023-08-17T00:10:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 10 client.6332 fetch_fsmap finished waiting for FSMap version 85 2023-08-17T00:10:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 10 client.6332 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2023-08-17T00:10:39.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 20 client.6332 populate_metadata read hostname 'smithi153' 2023-08-17T00:10:39.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1071170 0x10cb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 4 client.6332 mds_command: new command op to 7080 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:10:39.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 --> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xfe2240 con 0x1071170 2023-08-17T00:10:39.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1071170 0x10cb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 10 client.6332 ms_handle_connect on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:39.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f6bfff700 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1071170 0x10cb780 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=853e27c9d255f0f6 server_cookie=aa862918f1d26855 in_seq=0 out_seq=0 2023-08-17T00:10:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 1 -- 172.21.15.153:0/4283788800 <== mds.0 v2:172.21.15.153:6832/1634760764 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xfe2240 con 0x1071170 2023-08-17T00:10:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f52ffd700 10 client.6332 handle_command_reply: tid=0 2023-08-17T00:10:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.307+0000 7f3f855b5740 1 client.6332 shutdown 2023-08-17T00:10:39.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 msgr2=0x10cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10cfd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x10748c0 tx=0x7f3f7004f000).stop 2023-08-17T00:10:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 shutdown_connections 2023-08-17T00:10:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:6832/1634760764,v1:172.21.15.153:6835/1634760764] conn(0x1071170 0x10cb780 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b6d20 0x10cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x109ace0 0x110cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 --2- 172.21.15.153:0/4283788800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x109a860 0x10cfd60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 >> 172.21.15.153:0/4283788800 conn(0xe54680 msgr2=0x10a18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f52ffd700 0 client.6332 ms_handle_reset on v2:172.21.15.153:6832/1634760764 2023-08-17T00:10:39.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 shutdown_connections 2023-08-17T00:10:39.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 1 -- 172.21.15.153:0/4283788800 wait complete. 2023-08-17T00:10:39.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f855b5740 20 client.6332 trim_cache size 0 max 16384 2023-08-17T00:10:39.334 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:10:39.334 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:10:39.334 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:10:39.335 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:10:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 msgr2=0x7f3f6005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7f3f740692a0 tx=0x7f3f64008040).stop 2023-08-17T00:10:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 msgr2=0x7f3f74158590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 0x7f3f74158590 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7f3f7000e930 tx=0x7f3f70009060).stop 2023-08-17T00:10:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 shutdown_connections 2023-08-17T00:10:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f6005a150 0x7f3f6005c610 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f74151b90 0x7f3f740a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f74065b50 0x7f3f741444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 --2- 172.21.15.153:0/2710210717 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f74063290 0x7f3f74158590 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 >> 172.21.15.153:0/2710210717 conn(0x7f3f740c7150 msgr2=0x7f3f74151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 shutdown_connections 2023-08-17T00:10:39.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.311+0000 7f3f7b21b700 1 -- 172.21.15.153:0/2710210717 wait complete. 2023-08-17T00:10:39.340 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:10:39.341 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:39.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 Processor -- start 2023-08-17T00:10:39.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 -- start start 2023-08-17T00:10:39.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6dcc0a8df0 0x7f6dcc0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc068820 0x7f6dcc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dcc1585a0 con 0x7f6dcc061fa0 2023-08-17T00:10:39.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dcc066400 con 0x7f6dcc0a8df0 2023-08-17T00:10:39.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd26e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc069170 con 0x7f6dcc068820 2023-08-17T00:10:39.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.515+0000 7f6dd0ee1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc068820 0x7f6dcc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd0ee1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc068820 0x7f6dcc068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:52572/0 (socket says 172.21.15.153:52572) 2023-08-17T00:10:39.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd0ee1700 1 -- 172.21.15.153:0/2688018042 learned_addr learned my addr 172.21.15.153:0/2688018042 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd16e2700 1 --2- 172.21.15.153:0/2688018042 >> v2:172.21.15.178:3300/0 conn(0x7f6dcc0a8df0 0x7f6dcc0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd16e2700 1 -- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc068820 msgr2=0x7f6dcc068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd16e2700 1 --2- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc068820 0x7f6dcc068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd16e2700 1 -- 172.21.15.153:0/2688018042 >> v1:172.21.15.178:6789/0 conn(0x7f6dcc061fa0 legacy=0x7f6dcc062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd16e2700 1 -- 172.21.15.153:0/2688018042 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc0b9d30 con 0x7f6dcc0a8df0 2023-08-17T00:10:39.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dd16e2700 1 --2- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc0a8df0 0x7f6dcc0c1490 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f6dc8006fd0 tx=0x7f6dc8006f40).ready entity=mon.1 client_cookie=d4359b664607c94b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dc3fff700 1 -- 172.21.15.153:0/2688018042 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8005880 con 0x7f6dcc0a8df0 2023-08-17T00:10:39.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dc3fff700 1 -- 172.21.15.153:0/2688018042 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80059e0 con 0x7f6dcc0a8df0 2023-08-17T00:10:39.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.519+0000 7f6dc3fff700 1 -- 172.21.15.153:0/2688018042 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8005d60 con 0x7f6dcc0a8df0 2023-08-17T00:10:39.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 -- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc0a8df0 msgr2=0x7f6dcc0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc0a8df0 0x7f6dcc0c1490 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f6dc8006fd0 tx=0x7f6dc8006f40).stop 2023-08-17T00:10:39.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 -- 172.21.15.153:0/2688018042 shutdown_connections 2023-08-17T00:10:39.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc068820 0x7f6dcc068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/2688018042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc0a8df0 0x7f6dcc0c1490 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 -- 172.21.15.153:0/2688018042 >> 172.21.15.153:0/2688018042 conn(0x7f6dcc0c6620 msgr2=0x7f6dcc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.523+0000 7f6dd26e4700 1 -- 172.21.15.153:0/2688018042 shutdown_connections 2023-08-17T00:10:39.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.527+0000 7f6dd26e4700 1 -- 172.21.15.153:0/2688018042 wait complete. 2023-08-17T00:10:39.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.527+0000 7f6dd26e4700 1 Processor -- start 2023-08-17T00:10:39.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.527+0000 7f6dd26e4700 1 -- start start 2023-08-17T00:10:39.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd26e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 0x7f6dcc0babd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd26e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc068820 0x7f6dcc1479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd26e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc0a8df0 0x7f6dcc0bb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd26e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc14c210 con 0x7f6dcc061fa0 2023-08-17T00:10:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd26e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc144310 con 0x7f6dcc068820 2023-08-17T00:10:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd26e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dcc1445b0 con 0x7f6dcc0a8df0 2023-08-17T00:10:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 0x7f6dcc0babd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 0x7f6dcc0babd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55838/0 (socket says 172.21.15.153:55838) 2023-08-17T00:10:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 -- 172.21.15.153:0/863793307 learned_addr learned my addr 172.21.15.153:0/863793307 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd0ee1700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc068820 0x7f6dcc1479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 -- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc0a8df0 msgr2=0x7f6dcc0bb210 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-17T00:10:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc0a8df0 0x7f6dcc0bb210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:10:39.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 -- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc068820 msgr2=0x7f6dcc1479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc068820 0x7f6dcc1479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 -- 172.21.15.153:0/863793307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc8009250 con 0x7f6dcc061fa0 2023-08-17T00:10:39.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd0ee1700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc068820 0x7f6dcc1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.531+0000 7f6dd16e2700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 0x7f6dcc0babd0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f6dcc0668e0 tx=0x7f6dc8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.535+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800f720 con 0x7f6dcc061fa0 2023-08-17T00:10:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.535+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc800f8a0 con 0x7f6dcc061fa0 2023-08-17T00:10:39.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.535+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc800fc60 con 0x7f6dcc061fa0 2023-08-17T00:10:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.535+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dcc0bf070 con 0x7f6dcc061fa0 2023-08-17T00:10:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.535+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dcc0bf5a0 con 0x7f6dcc061fa0 2023-08-17T00:10:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.535+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dcc06b4c0 con 0x7f6dcc061fa0 2023-08-17T00:10:39.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.539+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6dc800f070 con 0x7f6dcc061fa0 2023-08-17T00:10:39.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.539+0000 7f6dc17fa700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6db005a1d0 0x7f6db005c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.539+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f6dc8076120 con 0x7f6dcc061fa0 2023-08-17T00:10:39.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.543+0000 7f6dd0ee1700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6db005a1d0 0x7f6db005c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.543+0000 7f6dd0ee1700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6db005a1d0 0x7f6db005c690 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6dcc0bff00 tx=0x7f6dc400b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.551+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6dc8049ad0 con 0x7f6dcc061fa0 2023-08-17T00:10:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.775+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dcc064010 con 0x7f6dcc061fa0 2023-08-17T00:10:39.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.775+0000 7f6dc17fa700 1 -- 172.21.15.153:0/863793307 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f6dc804d0b0 con 0x7f6dcc061fa0 2023-08-17T00:10:39.781 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:39.781 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:10:39.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.775+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6db005a1d0 msgr2=0x7f6db005c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.775+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6db005a1d0 0x7f6db005c690 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7f6dcc0bff00 tx=0x7f6dc400b040).stop 2023-08-17T00:10:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.775+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 msgr2=0x7f6dcc0babd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.775+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 0x7f6dcc0babd0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7f6dcc0668e0 tx=0x7f6dc8016000).stop 2023-08-17T00:10:39.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 shutdown_connections 2023-08-17T00:10:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6db005a1d0 0x7f6db005c690 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6dcc0a8df0 0x7f6dcc0bb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:10:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6dcc068820 0x7f6dcc1479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 --2- 172.21.15.153:0/863793307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6dcc061fa0 0x7f6dcc0babd0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 >> 172.21.15.153:0/863793307 conn(0x7f6dcc0c6620 msgr2=0x7f6dcc0c4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 shutdown_connections 2023-08-17T00:10:39.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.779+0000 7f6dd26e4700 1 -- 172.21.15.153:0/863793307 wait complete. 2023-08-17T00:10:39.786 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:10:39.805 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:10:39.805 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:10:39.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.959+0000 7f31d69b9700 1 Processor -- start 2023-08-17T00:10:39.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.959+0000 7f31d69b9700 1 -- start start 2023-08-17T00:10:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31d0068820 0x7f31d0068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d01585a0 con 0x7f31d0061fa0 2023-08-17T00:10:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d0066400 con 0x7f31d0068820 2023-08-17T00:10:39.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0069170 con 0x7f31d00a8df0 2023-08-17T00:10:39.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d61b8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f31d0061fa0 0x7f31d0062420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44956/0 (socket says 172.21.15.153:44956) 2023-08-17T00:10:39.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d61b8700 1 -- 172.21.15.153:0/3707158912 learned_addr learned my addr 172.21.15.153:0/3707158912 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d51b6700 1 --2- 172.21.15.153:0/3707158912 >> v2:172.21.15.153:3300/0 conn(0x7f31d0068820 0x7f31d0068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d59b7700 1 --2- 172.21.15.153:0/3707158912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d49b5700 1 -- 172.21.15.153:0/3707158912 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522293732 0 0) 0x7f31d01585a0 con 0x7f31d0061fa0 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d49b5700 1 -- 172.21.15.153:0/3707158912 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31bc0033f0 con 0x7f31d0061fa0 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d51b6700 1 -- 172.21.15.153:0/3707158912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 msgr2=0x7f31d00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d51b6700 1 --2- 172.21.15.153:0/3707158912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d51b6700 1 -- 172.21.15.153:0/3707158912 >> v1:172.21.15.153:6789/0 conn(0x7f31d0061fa0 legacy=0x7f31d0062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d51b6700 1 -- 172.21.15.153:0/3707158912 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d00b9d30 con 0x7f31d0068820 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d51b6700 1 --2- 172.21.15.153:0/3707158912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0068820 0x7f31d0068c80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f31c0009760 tx=0x7f31c0009060).ready entity=mon.0 client_cookie=558b60548c967445 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d49b5700 1 -- 172.21.15.153:0/3707158912 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000d4a0 con 0x7f31d0068820 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d49b5700 1 -- 172.21.15.153:0/3707158912 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c000d600 con 0x7f31d0068820 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d49b5700 1 -- 172.21.15.153:0/3707158912 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c000d980 con 0x7f31d0068820 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- 172.21.15.153:0/3707158912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0068820 msgr2=0x7f31d0068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 --2- 172.21.15.153:0/3707158912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0068820 0x7f31d0068c80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f31c0009760 tx=0x7f31c0009060).stop 2023-08-17T00:10:39.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- 172.21.15.153:0/3707158912 shutdown_connections 2023-08-17T00:10:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 --2- 172.21.15.153:0/3707158912 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0068820 0x7f31d0068c80 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 --2- 172.21.15.153:0/3707158912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- 172.21.15.153:0/3707158912 >> 172.21.15.153:0/3707158912 conn(0x7f31d00c6620 msgr2=0x7f31d00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- 172.21.15.153:0/3707158912 shutdown_connections 2023-08-17T00:10:39.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.963+0000 7f31d69b9700 1 -- 172.21.15.153:0/3707158912 wait complete. 2023-08-17T00:10:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 Processor -- start 2023-08-17T00:10:39.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 -- start start 2023-08-17T00:10:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 0x7f31d015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d0068820 0x7f31d00ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d00ab9f0 con 0x7f31d0061fa0 2023-08-17T00:10:39.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0169720 con 0x7f31d0068820 2023-08-17T00:10:39.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d69b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d0168740 con 0x7f31d00a8df0 2023-08-17T00:10:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d59b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 0x7f31d015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d59b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 0x7f31d015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55856/0 (socket says 172.21.15.153:55856) 2023-08-17T00:10:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.967+0000 7f31d59b7700 1 -- 172.21.15.153:0/1280580796 learned_addr learned my addr 172.21.15.153:0/1280580796 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d61b8700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d51b6700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d0068820 0x7f31d00ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d59b7700 1 -- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 msgr2=0x7f31d00ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d59b7700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d59b7700 1 -- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d0068820 msgr2=0x7f31d00ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d59b7700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d0068820 0x7f31d00ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d59b7700 1 -- 172.21.15.153:0/1280580796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c00092a0 con 0x7f31d0061fa0 2023-08-17T00:10:39.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d59b7700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 0x7f31d015ae00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f31cc00e900 tx=0x7f31cc006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc012600 con 0x7f31d0061fa0 2023-08-17T00:10:39.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc012760 con 0x7f31d0061fa0 2023-08-17T00:10:39.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc012ae0 con 0x7f31d0061fa0 2023-08-17T00:10:39.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d0168960 con 0x7f31d0061fa0 2023-08-17T00:10:39.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d0168f20 con 0x7f31d0061fa0 2023-08-17T00:10:39.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.971+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d006b4c0 con 0x7f31d0061fa0 2023-08-17T00:10:39.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.975+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f31cc022070 con 0x7f31d0061fa0 2023-08-17T00:10:39.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.975+0000 7f31c5ffb700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:39.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.975+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f31cc074490 con 0x7f31d0061fa0 2023-08-17T00:10:39.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.975+0000 7f31d51b6700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:39.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.975+0000 7f31d51b6700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f31c0009760 tx=0x7f31c0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:39.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:39.983+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31cc047e90 con 0x7f31d0061fa0 2023-08-17T00:10:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.195+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f31d005e300 con 0x7f31d0061fa0 2023-08-17T00:10:40.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.195+0000 7f31c5ffb700 1 -- 172.21.15.153:0/1280580796 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1030 (secure 0 0 0) 0x7f31cc016080 con 0x7f31d0061fa0 2023-08-17T00:10:40.201 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:40.202 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":487,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075576385,"bytes_used":4641677312,"bytes_avail":768452435968,"bytes_total":773094113280,"write_bytes_sec":26874582,"read_op_per_sec":0,"write_op_per_sec":26},"fsmap":{"epoch":85,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7080}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-08-17T00:09:43.328281+0000","services":{}},"progress_events":{}} 2023-08-17T00:10:40.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 msgr2=0x7f31b405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7f31c0009760 tx=0x7f31c0016000).stop 2023-08-17T00:10:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 msgr2=0x7f31d015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:40.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 0x7f31d015ae00 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f31cc00e900 tx=0x7f31cc006f40).stop 2023-08-17T00:10:40.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 shutdown_connections 2023-08-17T00:10:40.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31d00a8df0 0x7f31d00ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31d0068820 0x7f31d00ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 --2- 172.21.15.153:0/1280580796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31d0061fa0 0x7f31d015ae00 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 >> 172.21.15.153:0/1280580796 conn(0x7f31d00c6620 msgr2=0x7f31d00694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 shutdown_connections 2023-08-17T00:10:40.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:40.199+0000 7f31d69b9700 1 -- 172.21.15.153:0/1280580796 wait complete. 2023-08-17T00:10:40.223 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:10:40.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:10:40.266 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:10:40.311 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:10:40.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:10:40.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:10:40.313 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:10:41.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:10:41.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:10:41.342 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:10:41.361 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:41.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.559+0000 7f263df47700 1 Processor -- start 2023-08-17T00:10:41.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.559+0000 7f263df47700 1 -- start start 2023-08-17T00:10:41.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263df47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2638068da0 0x7f26381560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263df47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2638151530 0x7f26381519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263df47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2638065da0 con 0x7f26380689c0 2023-08-17T00:10:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263df47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2638069200 con 0x7f2638151530 2023-08-17T00:10:41.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263df47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2638155c60 con 0x7f2638068da0 2023-08-17T00:10:41.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263d746700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2638151530 0x7f26381519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263cf45700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f26380689c0 0x7f26380c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44966/0 (socket says 172.21.15.153:44966) 2023-08-17T00:10:41.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263cf45700 1 -- 172.21.15.153:0/1629430558 learned_addr learned my addr 172.21.15.153:0/1629430558 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:41.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f2637fff700 1 --2- 172.21.15.153:0/1629430558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2638068da0 0x7f26381560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f26377fe700 1 -- 172.21.15.153:0/1629430558 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839791951 0 0) 0x7f2638065da0 con 0x7f26380689c0 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f26377fe700 1 -- 172.21.15.153:0/1629430558 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26280033f0 con 0x7f26380689c0 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263d746700 1 -- 172.21.15.153:0/1629430558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2638068da0 msgr2=0x7f26381560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263d746700 1 --2- 172.21.15.153:0/1629430558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2638068da0 0x7f26381560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263d746700 1 -- 172.21.15.153:0/1629430558 >> v1:172.21.15.153:6789/0 conn(0x7f26380689c0 legacy=0x7f26380c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263d746700 1 -- 172.21.15.153:0/1629430558 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2638065ff0 con 0x7f2638151530 2023-08-17T00:10:41.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f263d746700 1 --2- 172.21.15.153:0/1629430558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381519c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f2630009e60 tx=0x7f2630009780).ready entity=mon.0 client_cookie=8563f29a340b42e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.563+0000 7f26377fe700 1 -- 172.21.15.153:0/1629430558 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000e070 con 0x7f2638151530 2023-08-17T00:10:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f26377fe700 1 -- 172.21.15.153:0/1629430558 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263000bab0 con 0x7f2638151530 2023-08-17T00:10:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f26377fe700 1 -- 172.21.15.153:0/1629430558 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263000be30 con 0x7f2638151530 2023-08-17T00:10:41.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 -- 172.21.15.153:0/1629430558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 msgr2=0x7f26381519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 --2- 172.21.15.153:0/1629430558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381519c0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f2630009e60 tx=0x7f2630009780).stop 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 -- 172.21.15.153:0/1629430558 shutdown_connections 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 --2- 172.21.15.153:0/1629430558 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381519c0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 --2- 172.21.15.153:0/1629430558 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2638068da0 0x7f26381560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 -- 172.21.15.153:0/1629430558 >> 172.21.15.153:0/1629430558 conn(0x7f26380c6620 msgr2=0x7f26380c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 -- 172.21.15.153:0/1629430558 shutdown_connections 2023-08-17T00:10:41.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 -- 172.21.15.153:0/1629430558 wait complete. 2023-08-17T00:10:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.567+0000 7f263df47700 1 Processor -- start 2023-08-17T00:10:41.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 -- start start 2023-08-17T00:10:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26380689c0 0x7f2638167130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2638068da0 0x7f26380bdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26380be8e0 con 0x7f2638151530 2023-08-17T00:10:41.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26380bebc0 con 0x7f2638068da0 2023-08-17T00:10:41.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26380beea0 con 0x7f26380689c0 2023-08-17T00:10:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55878/0 (socket says 172.21.15.153:55878) 2023-08-17T00:10:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 -- 172.21.15.153:0/4026735634 learned_addr learned my addr 172.21.15.153:0/4026735634 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263cf45700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26380689c0 0x7f2638167130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f2637fff700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2638068da0 0x7f26380bdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 -- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26380689c0 msgr2=0x7f2638167130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26380689c0 0x7f2638167130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 -- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2638068da0 msgr2=0x7f26380bdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2638068da0 0x7f26380bdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 -- 172.21.15.153:0/4026735634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2630009a20 con 0x7f2638151530 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263cf45700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26380689c0 0x7f2638167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263d746700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381678d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f26380667d0 tx=0x7f2630009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630007080 con 0x7f2638151530 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263001d630 con 0x7f2638151530 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26380bf180 con 0x7f2638151530 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263001d9d0 con 0x7f2638151530 2023-08-17T00:10:41.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.571+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26380bf4f0 con 0x7f2638151530 2023-08-17T00:10:41.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.575+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f263806b4c0 con 0x7f2638151530 2023-08-17T00:10:41.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.575+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f263001dd40 con 0x7f2638151530 2023-08-17T00:10:41.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.575+0000 7f2634ff9700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f261c05a180 0x7f261c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.575+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f2630076280 con 0x7f2638151530 2023-08-17T00:10:41.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.575+0000 7f263cf45700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f261c05a180 0x7f261c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.579+0000 7f263cf45700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f261c05a180 0x7f261c05c640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f262c001360 tx=0x7f262c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:41.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.583+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f263004d6b0 con 0x7f2638151530 2023-08-17T00:10:41.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.779+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2638063750 con 0x7f2638151530 2023-08-17T00:10:41.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.779+0000 7f2634ff9700 1 -- 172.21.15.153:0/4026735634 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f263004d2a0 con 0x7f2638151530 2023-08-17T00:10:41.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:41.788 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:10:41.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f261c05a180 msgr2=0x7f261c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f261c05a180 0x7f261c05c640 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f262c001360 tx=0x7f262c009040).stop 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 msgr2=0x7f26381678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381678d0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f26380667d0 tx=0x7f2630009780).stop 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 shutdown_connections 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f261c05a180 0x7f261c05c640 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2638151530 0x7f26381678d0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2638068da0 0x7f26380bdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 --2- 172.21.15.153:0/4026735634 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26380689c0 0x7f2638167130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 >> 172.21.15.153:0/4026735634 conn(0x7f26380c6620 msgr2=0x7f26380c5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:41.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 shutdown_connections 2023-08-17T00:10:41.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.783+0000 7f263df47700 1 -- 172.21.15.153:0/4026735634 wait complete. 2023-08-17T00:10:41.793 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:10:41.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:10:41.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.955+0000 7f2559c1b700 1 Processor -- start 2023-08-17T00:10:41.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2559c1b700 1 -- start start 2023-08-17T00:10:41.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2559c1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25540632e0 0x7f25540a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2559c1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f25540629b0 0x7f25540bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2559c1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2554065240 con 0x7f25540a8b70 2023-08-17T00:10:41.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2559c1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25540638a0 con 0x7f25540632e0 2023-08-17T00:10:41.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2559c1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2554065de0 con 0x7f25540629b0 2023-08-17T00:10:41.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25540632e0 0x7f25540a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f25540632e0 0x7f25540a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55890/0 (socket says 172.21.15.153:55890) 2023-08-17T00:10:41.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 -- 172.21.15.153:0/1240042589 learned_addr learned my addr 172.21.15.153:0/1240042589 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f2553fff700 1 --2- 172.21.15.153:0/1240042589 >> v2:172.21.15.178:3300/0 conn(0x7f25540629b0 0x7f25540bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 -- 172.21.15.153:0/1240042589 >> v2:172.21.15.178:3300/0 conn(0x7f25540629b0 msgr2=0x7f25540bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 --2- 172.21.15.153:0/1240042589 >> v2:172.21.15.178:3300/0 conn(0x7f25540629b0 0x7f25540bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 -- 172.21.15.153:0/1240042589 >> v1:172.21.15.178:6789/0 conn(0x7f25540a8b70 legacy=0x7f25540656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 -- 172.21.15.153:0/1240042589 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554062e20 con 0x7f25540632e0 2023-08-17T00:10:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.959+0000 7f254bfff700 1 --2- 172.21.15.153:0/1240042589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540632e0 0x7f25540a8f50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f2554069b10 tx=0x7f253c0090f0).ready entity=mon.0 client_cookie=c02539b5974de48c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:41.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2552ffd700 1 -- 172.21.15.153:0/1240042589 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c00b600 con 0x7f25540632e0 2023-08-17T00:10:41.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2552ffd700 1 -- 172.21.15.153:0/1240042589 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253c00b760 con 0x7f25540632e0 2023-08-17T00:10:41.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2552ffd700 1 -- 172.21.15.153:0/1240042589 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253c00bae0 con 0x7f25540632e0 2023-08-17T00:10:41.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 -- 172.21.15.153:0/1240042589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540632e0 msgr2=0x7f25540a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 --2- 172.21.15.153:0/1240042589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540632e0 0x7f25540a8f50 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f2554069b10 tx=0x7f253c0090f0).stop 2023-08-17T00:10:41.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 -- 172.21.15.153:0/1240042589 shutdown_connections 2023-08-17T00:10:41.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 --2- 172.21.15.153:0/1240042589 >> v2:172.21.15.178:3300/0 conn(0x7f25540629b0 0x7f25540bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 --2- 172.21.15.153:0/1240042589 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540632e0 0x7f25540a8f50 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 -- 172.21.15.153:0/1240042589 >> 172.21.15.153:0/1240042589 conn(0x7f25540c7150 msgr2=0x7f25540c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:41.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 -- 172.21.15.153:0/1240042589 shutdown_connections 2023-08-17T00:10:41.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 -- 172.21.15.153:0/1240042589 wait complete. 2023-08-17T00:10:41.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 Processor -- start 2023-08-17T00:10:41.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.963+0000 7f2559c1b700 1 -- start start 2023-08-17T00:10:41.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 0x7f2554154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25540632e0 0x7f255415a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25540a8b70 0x7f25540c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255415b200 con 0x7f25540629b0 2023-08-17T00:10:41.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25540a9d80 con 0x7f25540632e0 2023-08-17T00:10:41.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25541596a0 con 0x7f25540a8b70 2023-08-17T00:10:41.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 0x7f2554154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 0x7f2554154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55892/0 (socket says 172.21.15.153:55892) 2023-08-17T00:10:41.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 -- 172.21.15.153:0/3190511140 learned_addr learned my addr 172.21.15.153:0/3190511140 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:41.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2553fff700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25540a8b70 0x7f25540c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f254bfff700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25540632e0 0x7f255415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 -- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25540a8b70 msgr2=0x7f25540c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25540a8b70 0x7f25540c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 -- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25540632e0 msgr2=0x7f255415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:41.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25540632e0 0x7f255415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:41.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 -- 172.21.15.153:0/3190511140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c009370 con 0x7f25540629b0 2023-08-17T00:10:41.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f25537fe700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 0x7f2554154e00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f254400c440 tx=0x7f2544007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:41.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544007020 con 0x7f25540629b0 2023-08-17T00:10:41.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2544007180 con 0x7f25540629b0 2023-08-17T00:10:41.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544007520 con 0x7f25540629b0 2023-08-17T00:10:41.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2554159980 con 0x7f25540629b0 2023-08-17T00:10:41.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.967+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25540a9a10 con 0x7f25540629b0 2023-08-17T00:10:41.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.971+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255406b530 con 0x7f25540629b0 2023-08-17T00:10:41.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.971+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2544010070 con 0x7f25540629b0 2023-08-17T00:10:41.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.971+0000 7f254b7fe700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f253405a150 0x7f253405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:41.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.971+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f25440734d0 con 0x7f25540629b0 2023-08-17T00:10:41.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.971+0000 7f254bfff700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f253405a150 0x7f253405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:41.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.975+0000 7f254bfff700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f253405a150 0x7f253405c610 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f253c009130 tx=0x7f253c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:41.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:41.979+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2544046dc0 con 0x7f25540629b0 2023-08-17T00:10:42.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.139+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2554064910 con 0x7f25540629b0 2023-08-17T00:10:42.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.143+0000 7f254b7fe700 1 -- 172.21.15.153:0/3190511140 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+17269 (secure 0 0 0) 0x7f254404a3e0 con 0x7f25540629b0 2023-08-17T00:10:42.149 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:42.149 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":100,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:40.266605+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:09:52.827329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T00:09:53.817978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":7,"to":0}]},{"pgid":"14.12","mappings":[{"from":7,"to":3}]},{"pgid":"14.19","mappings":[{"from":7,"to":0}]},{"pgid":"14.22","mappings":[{"from":1,"to":0}]},{"pgid":"14.33","mappings":[{"from":1,"to":3}]},{"pgid":"14.35","mappings":[{"from":7,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:10:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f253405a150 msgr2=0x7f253405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f253405a150 0x7f253405c610 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f253c009130 tx=0x7f253c017000).stop 2023-08-17T00:10:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 msgr2=0x7f2554154e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 0x7f2554154e00 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f254400c440 tx=0x7f2544007e00).stop 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 shutdown_connections 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f253405a150 0x7f253405c610 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25540a8b70 0x7f25540c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f25540632e0 0x7f255415a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 --2- 172.21.15.153:0/3190511140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f25540629b0 0x7f2554154e00 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 >> 172.21.15.153:0/3190511140 conn(0x7f25540c7150 msgr2=0x7f25540c5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 shutdown_connections 2023-08-17T00:10:42.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.147+0000 7f2559c1b700 1 -- 172.21.15.153:0/3190511140 wait complete. 2023-08-17T00:10:42.175 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:09:52.827329+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:09:53.817978+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:10:42.176 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:10:42.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.335+0000 7efdecdf9700 1 Processor -- start 2023-08-17T00:10:42.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.335+0000 7efdecdf9700 1 -- start start 2023-08-17T00:10:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efdecdf9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efde80abf10 0x7efde8068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efdecdf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80c1190 0x7efde8068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efdecdf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde81545e0 con 0x7efde80ac2f0 2023-08-17T00:10:42.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efdecdf9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde8069200 con 0x7efde80abf10 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efdecdf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde80c1c50 con 0x7efde80c1190 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efde80abf10 0x7efde8068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde7fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80c1190 0x7efde8068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efde80abf10 0x7efde8068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:48584/0 (socket says 172.21.15.153:48584) 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde77fe700 1 -- 172.21.15.153:0/3474002146 learned_addr learned my addr 172.21.15.153:0/3474002146 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde7fff700 1 -- 172.21.15.153:0/3474002146 >> v2:172.21.15.178:3300/0 conn(0x7efde80abf10 msgr2=0x7efde8068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:42.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde7fff700 1 --2- 172.21.15.153:0/3474002146 >> v2:172.21.15.178:3300/0 conn(0x7efde80abf10 0x7efde8068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde7fff700 1 -- 172.21.15.153:0/3474002146 >> v1:172.21.15.178:6789/0 conn(0x7efde80ac2f0 legacy=0x7efde80c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde7fff700 1 -- 172.21.15.153:0/3474002146 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80a96d0 con 0x7efde80c1190 2023-08-17T00:10:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde7fff700 1 --2- 172.21.15.153:0/3474002146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80c1190 0x7efde8068d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7efde0009e60 tx=0x7efde0009780).ready entity=mon.2 client_cookie=965d30c3a6e6ca70 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:42.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde67fc700 1 -- 172.21.15.153:0/3474002146 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000e070 con 0x7efde80c1190 2023-08-17T00:10:42.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde67fc700 1 -- 172.21.15.153:0/3474002146 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000bb60 con 0x7efde80c1190 2023-08-17T00:10:42.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.339+0000 7efde67fc700 1 -- 172.21.15.153:0/3474002146 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0012410 con 0x7efde80c1190 2023-08-17T00:10:42.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 -- 172.21.15.153:0/3474002146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80c1190 msgr2=0x7efde8068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3474002146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80c1190 0x7efde8068d10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7efde0009e60 tx=0x7efde0009780).stop 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 -- 172.21.15.153:0/3474002146 shutdown_connections 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3474002146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80c1190 0x7efde8068d10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3474002146 >> v2:172.21.15.178:3300/0 conn(0x7efde80abf10 0x7efde8068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 -- 172.21.15.153:0/3474002146 >> 172.21.15.153:0/3474002146 conn(0x7efde80c6620 msgr2=0x7efde80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 -- 172.21.15.153:0/3474002146 shutdown_connections 2023-08-17T00:10:42.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 -- 172.21.15.153:0/3474002146 wait complete. 2023-08-17T00:10:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 Processor -- start 2023-08-17T00:10:42.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.343+0000 7efdecdf9700 1 -- start start 2023-08-17T00:10:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80abf10 0x7efde80c0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 0x7efde80bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde80c1190 0x7efde816baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde81698e0 con 0x7efde80ac2f0 2023-08-17T00:10:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde81695e0 con 0x7efde80c1190 2023-08-17T00:10:42.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde80be790 con 0x7efde80abf10 2023-08-17T00:10:42.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 0x7efde80bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 0x7efde80bdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55900/0 (socket says 172.21.15.153:55900) 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80abf10 0x7efde80c0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 -- 172.21.15.153:0/3270420710 learned_addr learned my addr 172.21.15.153:0/3270420710 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde7fff700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde80c1190 0x7efde816baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 -- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80abf10 msgr2=0x7efde80c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80abf10 0x7efde80c0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 -- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde80c1190 msgr2=0x7efde816baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde80c1190 0x7efde816baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 -- 172.21.15.153:0/3270420710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009a20 con 0x7efde80ac2f0 2023-08-17T00:10:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde7fff700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde80c1190 0x7efde816baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efde6ffd700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 0x7efde80bdfb0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7efddc00c4f0 tx=0x7efddc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc007020 con 0x7efde80ac2f0 2023-08-17T00:10:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc001e90 con 0x7efde80ac2f0 2023-08-17T00:10:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde80bea70 con 0x7efde80ac2f0 2023-08-17T00:10:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0073b0 con 0x7efde80ac2f0 2023-08-17T00:10:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.347+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde80be4a0 con 0x7efde80ac2f0 2023-08-17T00:10:42.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.351+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8169a90 con 0x7efde80ac2f0 2023-08-17T00:10:42.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.351+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efddc010070 con 0x7efde80ac2f0 2023-08-17T00:10:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.355+0000 7efdcf7fe700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efdd405a120 0x7efdd405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.355+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7efddc073a60 con 0x7efde80ac2f0 2023-08-17T00:10:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.355+0000 7efde77fe700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efdd405a120 0x7efdd405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.355+0000 7efde77fe700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efdd405a120 0x7efdd405c5e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efdd8009c20 tx=0x7efdd8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:42.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.359+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efde8169a90 con 0x7efde80ac2f0 2023-08-17T00:10:42.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.527+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7efde8169a90 con 0x7efde80ac2f0 2023-08-17T00:10:42.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.527+0000 7efdcf7fe700 1 -- 172.21.15.153:0/3270420710 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v100) v1 ==== 110+0+10 (secure 0 0 0) 0x7efde8169a90 con 0x7efde80ac2f0 2023-08-17T00:10:42.533 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:10:42.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.527+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efdd405a120 msgr2=0x7efdd405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.527+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efdd405a120 0x7efdd405c5e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7efdd8009c20 tx=0x7efdd8009060).stop 2023-08-17T00:10:42.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.527+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 msgr2=0x7efde80bdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.527+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 0x7efde80bdfb0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7efddc00c4f0 tx=0x7efddc007e00).stop 2023-08-17T00:10:42.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 shutdown_connections 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efdd405a120 0x7efdd405c5e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efde80c1190 0x7efde816baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efde80ac2f0 0x7efde80bdfb0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 --2- 172.21.15.153:0/3270420710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efde80abf10 0x7efde80c0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 >> 172.21.15.153:0/3270420710 conn(0x7efde80c6620 msgr2=0x7efde80c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 shutdown_connections 2023-08-17T00:10:42.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.531+0000 7efdecdf9700 1 -- 172.21.15.153:0/3270420710 wait complete. 2023-08-17T00:10:42.558 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:10:42.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 Processor -- start 2023-08-17T00:10:42.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 -- start start 2023-08-17T00:10:42.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d200abf10 0x7f1d20068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d200ac2f0 0x7f1d20068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200c0a80 0x7f1d200c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d20069200 con 0x7f1d200abf10 2023-08-17T00:10:42.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d201545e0 con 0x7f1d200ac2f0 2023-08-17T00:10:42.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d25039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200a96d0 con 0x7f1d200c0a80 2023-08-17T00:10:42.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d1ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d200abf10 0x7f1d20068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d1ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1d200abf10 0x7f1d20068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55912/0 (socket says 172.21.15.153:55912) 2023-08-17T00:10:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.715+0000 7f1d1ffff700 1 -- 172.21.15.153:0/544956569 learned_addr learned my addr 172.21.15.153:0/544956569 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d24838700 1 --2- 172.21.15.153:0/544956569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200c0a80 0x7f1d200c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1f7fe700 1 --2- 172.21.15.153:0/544956569 >> v2:172.21.15.178:3300/0 conn(0x7f1d200ac2f0 0x7f1d20068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1ffff700 1 -- 172.21.15.153:0/544956569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200c0a80 msgr2=0x7f1d200c0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1ffff700 1 --2- 172.21.15.153:0/544956569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200c0a80 0x7f1d200c0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1ffff700 1 -- 172.21.15.153:0/544956569 >> v2:172.21.15.178:3300/0 conn(0x7f1d200ac2f0 msgr2=0x7f1d20068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:42.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1ffff700 1 --2- 172.21.15.153:0/544956569 >> v2:172.21.15.178:3300/0 conn(0x7f1d200ac2f0 0x7f1d20068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1ffff700 1 -- 172.21.15.153:0/544956569 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200c1c50 con 0x7f1d200abf10 2023-08-17T00:10:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1ffff700 1 --2- 172.21.15.153:0/544956569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d20068820 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f1d200693d0 tx=0x7f1d100090f0).ready entity=mon.0 client_cookie=1242600cbe56bf24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1effd700 1 -- 172.21.15.153:0/544956569 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10009160 con 0x7f1d200abf10 2023-08-17T00:10:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1effd700 1 -- 172.21.15.153:0/544956569 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000b600 con 0x7f1d200abf10 2023-08-17T00:10:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d1effd700 1 -- 172.21.15.153:0/544956569 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000b9a0 con 0x7f1d200abf10 2023-08-17T00:10:42.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 -- 172.21.15.153:0/544956569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 msgr2=0x7f1d20068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 --2- 172.21.15.153:0/544956569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d20068820 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f1d200693d0 tx=0x7f1d100090f0).stop 2023-08-17T00:10:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 -- 172.21.15.153:0/544956569 shutdown_connections 2023-08-17T00:10:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 --2- 172.21.15.153:0/544956569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200c0a80 0x7f1d200c0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 --2- 172.21.15.153:0/544956569 >> v2:172.21.15.178:3300/0 conn(0x7f1d200ac2f0 0x7f1d20068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 --2- 172.21.15.153:0/544956569 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d20068820 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 -- 172.21.15.153:0/544956569 >> 172.21.15.153:0/544956569 conn(0x7f1d200c6620 msgr2=0x7f1d200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:42.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 -- 172.21.15.153:0/544956569 shutdown_connections 2023-08-17T00:10:42.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.719+0000 7f1d25039700 1 -- 172.21.15.153:0/544956569 wait complete. 2023-08-17T00:10:42.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.723+0000 7f1d25039700 1 Processor -- start 2023-08-17T00:10:42.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.723+0000 7f1d25039700 1 -- start start 2023-08-17T00:10:42.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d2014e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200ac2f0 0x7f1d20159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d200c0a80 0x7f1d2015a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2014f090 con 0x7f1d200abf10 2023-08-17T00:10:42.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2015a500 con 0x7f1d200c0a80 2023-08-17T00:10:42.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20164ce0 con 0x7f1d200ac2f0 2023-08-17T00:10:42.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d2014e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d2014e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55926/0 (socket says 172.21.15.153:55926) 2023-08-17T00:10:42.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 -- 172.21.15.153:0/4253819458 learned_addr learned my addr 172.21.15.153:0/4253819458 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:42.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1f7fe700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200ac2f0 0x7f1d20159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d24838700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d200c0a80 0x7f1d2015a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 -- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200ac2f0 msgr2=0x7f1d20159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200ac2f0 0x7f1d20159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 -- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d200c0a80 msgr2=0x7f1d2015a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d200c0a80 0x7f1d2015a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 -- 172.21.15.153:0/4253819458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10009310 con 0x7f1d200abf10 2023-08-17T00:10:42.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d24838700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d200c0a80 0x7f1d2015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:42.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d1ffff700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d2014e8a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f1d10006fd0 tx=0x7f1d10017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:42.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10000c90 con 0x7f1d200abf10 2023-08-17T00:10:42.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000b770 con 0x7f1d200abf10 2023-08-17T00:10:42.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10024470 con 0x7f1d200abf10 2023-08-17T00:10:42.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d201640d0 con 0x7f1d200abf10 2023-08-17T00:10:42.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.727+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d20164690 con 0x7f1d200abf10 2023-08-17T00:10:42.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.731+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2006b4c0 con 0x7f1d200abf10 2023-08-17T00:10:42.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.731+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1d1000f070 con 0x7f1d200abf10 2023-08-17T00:10:42.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.731+0000 7f1d07fff700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d0c05a150 0x7f1d0c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:42.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.731+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f1d10075bf0 con 0x7f1d200abf10 2023-08-17T00:10:42.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.731+0000 7f1d1f7fe700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d0c05a150 0x7f1d0c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:42.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.731+0000 7f1d1f7fe700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d0c05a150 0x7f1d0c05c610 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1d14006fd0 tx=0x7f1d14008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:42.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.739+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1d100495f0 con 0x7f1d200abf10 2023-08-17T00:10:42.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.903+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1d200c1c50 con 0x7f1d200abf10 2023-08-17T00:10:42.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.903+0000 7f1d07fff700 1 -- 172.21.15.153:0/4253819458 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1d200c1c50 con 0x7f1d200abf10 2023-08-17T00:10:42.910 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:10:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d0c05a150 msgr2=0x7f1d0c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d0c05a150 0x7f1d0c05c610 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f1d14006fd0 tx=0x7f1d14008040).stop 2023-08-17T00:10:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 msgr2=0x7f1d2014e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d2014e8a0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 rx=0x7f1d10006fd0 tx=0x7f1d10017000).stop 2023-08-17T00:10:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 shutdown_connections 2023-08-17T00:10:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1d0c05a150 0x7f1d0c05c610 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d200c0a80 0x7f1d2015a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d200ac2f0 0x7f1d20159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 --2- 172.21.15.153:0/4253819458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1d200abf10 0x7f1d2014e8a0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 >> 172.21.15.153:0/4253819458 conn(0x7f1d200c6620 msgr2=0x7f1d2014dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 shutdown_connections 2023-08-17T00:10:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:42.907+0000 7f1d25039700 1 -- 172.21.15.153:0/4253819458 wait complete. 2023-08-17T00:10:42.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:10:43.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe042af1700 1 Processor -- start 2023-08-17T00:10:43.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe042af1700 1 -- start start 2023-08-17T00:10:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe042af1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe03c064870 0x7fe03c064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe042af1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c061fa0 con 0x7fe03c151f70 2023-08-17T00:10:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe042af1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c1523d0 con 0x7fe03c151b90 2023-08-17T00:10:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe042af1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c0c3fb0 con 0x7fe03c064870 2023-08-17T00:10:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe033fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe03c151f70 0x7fe03c065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44972/0 (socket says 172.21.15.153:44972) 2023-08-17T00:10:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe033fff700 1 -- 172.21.15.153:0/319217370 learned_addr learned my addr 172.21.15.153:0/319217370 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.091+0000 7fe04108e700 1 --2- 172.21.15.153:0/319217370 >> v2:172.21.15.178:3300/0 conn(0x7fe03c064870 0x7fe03c064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe0337fe700 1 -- 172.21.15.153:0/319217370 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163955435 0 0) 0x7fe03c061fa0 con 0x7fe03c151f70 2023-08-17T00:10:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe0337fe700 1 -- 172.21.15.153:0/319217370 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0240033f0 con 0x7fe03c151f70 2023-08-17T00:10:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe04108e700 1 -- 172.21.15.153:0/319217370 >> v1:172.21.15.178:6789/0 conn(0x7fe03c151b90 legacy=0x7fe03c063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe04108e700 1 -- 172.21.15.153:0/319217370 >> v1:172.21.15.153:6789/0 conn(0x7fe03c151f70 legacy=0x7fe03c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe04108e700 1 -- 172.21.15.153:0/319217370 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0651b0 con 0x7fe03c064870 2023-08-17T00:10:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe04108e700 1 --2- 172.21.15.153:0/319217370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c064cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fe034009760 tx=0x7fe034009060).ready entity=mon.1 client_cookie=fb6cef5aebfc9557 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe0337fe700 1 -- 172.21.15.153:0/319217370 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400f510 con 0x7fe03c064870 2023-08-17T00:10:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe0337fe700 1 -- 172.21.15.153:0/319217370 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03400f670 con 0x7fe03c064870 2023-08-17T00:10:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe0337fe700 1 -- 172.21.15.153:0/319217370 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03400f9f0 con 0x7fe03c064870 2023-08-17T00:10:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 -- 172.21.15.153:0/319217370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 msgr2=0x7fe03c064cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 --2- 172.21.15.153:0/319217370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c064cc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fe034009760 tx=0x7fe034009060).stop 2023-08-17T00:10:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 -- 172.21.15.153:0/319217370 shutdown_connections 2023-08-17T00:10:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 --2- 172.21.15.153:0/319217370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c064cc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 -- 172.21.15.153:0/319217370 >> 172.21.15.153:0/319217370 conn(0x7fe03c0c7150 msgr2=0x7fe03c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 -- 172.21.15.153:0/319217370 shutdown_connections 2023-08-17T00:10:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.095+0000 7fe042af1700 1 -- 172.21.15.153:0/319217370 wait complete. 2023-08-17T00:10:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 Processor -- start 2023-08-17T00:10:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 -- start start 2023-08-17T00:10:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c14c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 0x7fe03c1431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe03c151f70 0x7fe03c0aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0ab5f0 con 0x7fe03c151b90 2023-08-17T00:10:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0aa9e0 con 0x7fe03c064870 2023-08-17T00:10:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe042af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c0aacc0 con 0x7fe03c151f70 2023-08-17T00:10:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 0x7fe03c1431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 0x7fe03c1431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55936/0 (socket says 172.21.15.153:55936) 2023-08-17T00:10:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 -- 172.21.15.153:0/2428002198 learned_addr learned my addr 172.21.15.153:0/2428002198 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe04088d700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c14c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe04108e700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe03c151f70 0x7fe03c0aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 -- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe03c151f70 msgr2=0x7fe03c0aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe03c151f70 0x7fe03c0aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 -- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 msgr2=0x7fe03c14c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c14c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 -- 172.21.15.153:0/2428002198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0340092a0 con 0x7fe03c151b90 2023-08-17T00:10:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.099+0000 7fe033fff700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 0x7fe03c1431d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fe02c00c420 tx=0x7fe02c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0072e0 con 0x7fe03c151b90 2023-08-17T00:10:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c007440 con 0x7fe03c151b90 2023-08-17T00:10:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c0aafa0 con 0x7fe03c151b90 2023-08-17T00:10:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c0057a0 con 0x7fe03c151b90 2023-08-17T00:10:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c14cbd0 con 0x7fe03c151b90 2023-08-17T00:10:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c0ab7a0 con 0x7fe03c151b90 2023-08-17T00:10:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.103+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe02c01a060 con 0x7fe03c151b90 2023-08-17T00:10:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.107+0000 7fe030ff9700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe02805a180 0x7fe02805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.107+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7fe02c073660 con 0x7fe03c151b90 2023-08-17T00:10:43.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.107+0000 7fe04088d700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe02805a180 0x7fe02805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.107+0000 7fe04088d700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe02805a180 0x7fe02805c640 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fe038003e70 tx=0x7fe038009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.111+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe03c0ab7a0 con 0x7fe03c151b90 2023-08-17T00:10:43.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.267+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe03c0ab730 con 0x7fe03c151b90 2023-08-17T00:10:43.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.267+0000 7fe030ff9700 1 -- 172.21.15.153:0/2428002198 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe02c018020 con 0x7fe03c151b90 2023-08-17T00:10:43.276 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:10:43.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe02805a180 msgr2=0x7fe02805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe02805a180 0x7fe02805c640 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7fe038003e70 tx=0x7fe038009040).stop 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 msgr2=0x7fe03c1431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 0x7fe03c1431d0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fe02c00c420 tx=0x7fe02c007c80).stop 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 shutdown_connections 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe02805a180 0x7fe02805c640 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe03c151f70 0x7fe03c0aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe03c151b90 0x7fe03c1431d0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 --2- 172.21.15.153:0/2428002198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe03c064870 0x7fe03c14c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 >> 172.21.15.153:0/2428002198 conn(0x7fe03c0c7150 msgr2=0x7fe03c0a7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:43.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 shutdown_connections 2023-08-17T00:10:43.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.271+0000 7fe042af1700 1 -- 172.21.15.153:0/2428002198 wait complete. 2023-08-17T00:10:43.297 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:10:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 Processor -- start 2023-08-17T00:10:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 -- start start 2023-08-17T00:10:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14fc153a30 0x7f14fc061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc069630 0x7f14fc0c1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14fc0626a0 con 0x7f14fc0c4c60 2023-08-17T00:10:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14fc062490 con 0x7f14fc153a30 2023-08-17T00:10:43.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.451+0000 7f15045a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc062980 con 0x7f14fc069630 2023-08-17T00:10:43.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501b44700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f14fc0c4c60 0x7f14fc068f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44976/0 (socket says 172.21.15.153:44976) 2023-08-17T00:10:43.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501b44700 1 -- 172.21.15.153:0/2190962387 learned_addr learned my addr 172.21.15.153:0/2190962387 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:43.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502345700 1 --2- 172.21.15.153:0/2190962387 >> v2:172.21.15.178:3300/0 conn(0x7f14fc153a30 0x7f14fc061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502b46700 1 --2- 172.21.15.153:0/2190962387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc069630 0x7f14fc0c1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501343700 1 -- 172.21.15.153:0/2190962387 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771092449 0 0) 0x7f14fc0626a0 con 0x7f14fc0c4c60 2023-08-17T00:10:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501343700 1 -- 172.21.15.153:0/2190962387 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e80033f0 con 0x7f14fc0c4c60 2023-08-17T00:10:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502b46700 1 -- 172.21.15.153:0/2190962387 >> v2:172.21.15.178:3300/0 conn(0x7f14fc153a30 msgr2=0x7f14fc061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502b46700 1 --2- 172.21.15.153:0/2190962387 >> v2:172.21.15.178:3300/0 conn(0x7f14fc153a30 0x7f14fc061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502b46700 1 -- 172.21.15.153:0/2190962387 >> v1:172.21.15.153:6789/0 conn(0x7f14fc0c4c60 legacy=0x7f14fc068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502b46700 1 -- 172.21.15.153:0/2190962387 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc062c60 con 0x7f14fc069630 2023-08-17T00:10:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1502b46700 1 --2- 172.21.15.153:0/2190962387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc069630 0x7f14fc0c1a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f14f4009e60 tx=0x7f14f4009780).ready entity=mon.2 client_cookie=4fe80b8856fb8785 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501343700 1 -- 172.21.15.153:0/2190962387 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400e070 con 0x7f14fc069630 2023-08-17T00:10:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501343700 1 -- 172.21.15.153:0/2190962387 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f400bab0 con 0x7f14fc069630 2023-08-17T00:10:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f1501343700 1 -- 172.21.15.153:0/2190962387 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f400be30 con 0x7f14fc069630 2023-08-17T00:10:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f15045a9700 1 -- 172.21.15.153:0/2190962387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc069630 msgr2=0x7f14fc0c1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f15045a9700 1 --2- 172.21.15.153:0/2190962387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc069630 0x7f14fc0c1a40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f14f4009e60 tx=0x7f14f4009780).stop 2023-08-17T00:10:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f15045a9700 1 -- 172.21.15.153:0/2190962387 shutdown_connections 2023-08-17T00:10:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f15045a9700 1 --2- 172.21.15.153:0/2190962387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc069630 0x7f14fc0c1a40 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f15045a9700 1 --2- 172.21.15.153:0/2190962387 >> v2:172.21.15.178:3300/0 conn(0x7f14fc153a30 0x7f14fc061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.455+0000 7f15045a9700 1 -- 172.21.15.153:0/2190962387 >> 172.21.15.153:0/2190962387 conn(0x7f14fc0c79c0 msgr2=0x7f14fc0c3990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.459+0000 7f15045a9700 1 -- 172.21.15.153:0/2190962387 shutdown_connections 2023-08-17T00:10:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.459+0000 7f15045a9700 1 -- 172.21.15.153:0/2190962387 wait complete. 2023-08-17T00:10:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.459+0000 7f15045a9700 1 Processor -- start 2023-08-17T00:10:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.459+0000 7f15045a9700 1 -- start start 2023-08-17T00:10:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 0x7f14fc1431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc0c4c60 0x7f14fc0bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14fc153a30 0x7f14fc0bc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0bc830 con 0x7f14fc069630 2023-08-17T00:10:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0bef80 con 0x7f14fc153a30 2023-08-17T00:10:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0be370 con 0x7f14fc0c4c60 2023-08-17T00:10:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 0x7f14fc1431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 0x7f14fc1431d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55944/0 (socket says 172.21.15.153:55944) 2023-08-17T00:10:43.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 -- 172.21.15.153:0/1745264573 learned_addr learned my addr 172.21.15.153:0/1745264573 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502b46700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14fc153a30 0x7f14fc0bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1501b44700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc0c4c60 0x7f14fc0bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 -- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc0c4c60 msgr2=0x7f14fc0bbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc0c4c60 0x7f14fc0bbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 -- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14fc153a30 msgr2=0x7f14fc0bc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14fc153a30 0x7f14fc0bc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 -- 172.21.15.153:0/1745264573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f4009a20 con 0x7f14fc069630 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1501b44700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc0c4c60 0x7f14fc0bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f1502345700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 0x7f14fc1431d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f14f800e900 tx=0x7f14f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8012600 con 0x7f14fc069630 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f8012760 con 0x7f14fc069630 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc0be650 con 0x7f14fc069630 2023-08-17T00:10:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8012ae0 con 0x7f14fc069630 2023-08-17T00:10:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.463+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc0bec10 con 0x7f14fc069630 2023-08-17T00:10:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.467+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc06b530 con 0x7f14fc069630 2023-08-17T00:10:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.467+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f14f8022070 con 0x7f14fc069630 2023-08-17T00:10:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.467+0000 7f14f27fc700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f14e005a150 0x7f14e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.467+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f14f80743d0 con 0x7f14fc069630 2023-08-17T00:10:43.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.467+0000 7f1501b44700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f14e005a150 0x7f14e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.471+0000 7f1501b44700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f14e005a150 0x7f14e005c610 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f14ec007fd0 tx=0x7f14ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.471+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f14f8047d50 con 0x7f14fc069630 2023-08-17T00:10:43.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.631+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14fc062f40 con 0x7f14fc069630 2023-08-17T00:10:43.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.631+0000 7f14f27fc700 1 -- 172.21.15.153:0/1745264573 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14f804b370 con 0x7f14fc069630 2023-08-17T00:10:43.640 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:10:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f14e005a150 msgr2=0x7f14e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f14e005a150 0x7f14e005c610 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f14ec007fd0 tx=0x7f14ec009040).stop 2023-08-17T00:10:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 msgr2=0x7f14fc1431d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 0x7f14fc1431d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 rx=0x7f14f800e900 tx=0x7f14f8009060).stop 2023-08-17T00:10:43.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 shutdown_connections 2023-08-17T00:10:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f14e005a150 0x7f14e005c610 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14fc153a30 0x7f14fc0bc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14fc0c4c60 0x7f14fc0bbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 --2- 172.21.15.153:0/1745264573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14fc069630 0x7f14fc1431d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 >> 172.21.15.153:0/1745264573 conn(0x7f14fc0c79c0 msgr2=0x7f14fc156300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:43.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 shutdown_connections 2023-08-17T00:10:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.635+0000 7f15045a9700 1 -- 172.21.15.153:0/1745264573 wait complete. 2023-08-17T00:10:43.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:43.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.807+0000 7ff36e039700 1 Processor -- start 2023-08-17T00:10:43.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.807+0000 7ff36e039700 1 -- start start 2023-08-17T00:10:43.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.807+0000 7ff36e039700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff368063bc0 0x7ff36815e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.807+0000 7ff36e039700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368154e90 con 0x7ff3680acf30 2023-08-17T00:10:43.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff368153fc0 con 0x7ff3680c5ea0 2023-08-17T00:10:43.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3680c1730 con 0x7ff368063bc0 2023-08-17T00:10:43.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d037700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff3680acf30 0x7ff3680c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44982/0 (socket says 172.21.15.153:44982) 2023-08-17T00:10:43.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d037700 1 -- 172.21.15.153:0/2638493014 learned_addr learned my addr 172.21.15.153:0/2638493014 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:43.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d838700 1 --2- 172.21.15.153:0/2638493014 >> v2:172.21.15.153:3300/0 conn(0x7ff368063bc0 0x7ff36815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff35ffff700 1 -- 172.21.15.153:0/2638493014 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980626391 0 0) 0x7ff368154e90 con 0x7ff3680acf30 2023-08-17T00:10:43.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d838700 1 -- 172.21.15.153:0/2638493014 >> v1:172.21.15.178:6789/0 conn(0x7ff3680c5ea0 legacy=0x7ff3680634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d838700 1 -- 172.21.15.153:0/2638493014 >> v1:172.21.15.153:6789/0 conn(0x7ff3680acf30 legacy=0x7ff3680c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d838700 1 -- 172.21.15.153:0/2638493014 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff368154280 con 0x7ff368063bc0 2023-08-17T00:10:43.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36d838700 1 --2- 172.21.15.153:0/2638493014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff368063bc0 0x7ff36815e660 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7ff360009e60 tx=0x7ff360009780).ready entity=mon.0 client_cookie=6870cd6be9bb5898 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff35ffff700 1 -- 172.21.15.153:0/2638493014 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000e070 con 0x7ff368063bc0 2023-08-17T00:10:43.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff35ffff700 1 -- 172.21.15.153:0/2638493014 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000bc30 con 0x7ff368063bc0 2023-08-17T00:10:43.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff35ffff700 1 -- 172.21.15.153:0/2638493014 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff360012410 con 0x7ff368063bc0 2023-08-17T00:10:43.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- 172.21.15.153:0/2638493014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff368063bc0 msgr2=0x7ff36815e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 --2- 172.21.15.153:0/2638493014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff368063bc0 0x7ff36815e660 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7ff360009e60 tx=0x7ff360009780).stop 2023-08-17T00:10:43.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- 172.21.15.153:0/2638493014 shutdown_connections 2023-08-17T00:10:43.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 --2- 172.21.15.153:0/2638493014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff368063bc0 0x7ff36815e660 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- 172.21.15.153:0/2638493014 >> 172.21.15.153:0/2638493014 conn(0x7ff3680cb330 msgr2=0x7ff3680c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:43.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- 172.21.15.153:0/2638493014 shutdown_connections 2023-08-17T00:10:43.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.811+0000 7ff36e039700 1 -- 172.21.15.153:0/2638493014 wait complete. 2023-08-17T00:10:43.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 Processor -- start 2023-08-17T00:10:43.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 -- start start 2023-08-17T00:10:43.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff368063bc0 0x7ff3680aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 0x7ff368163e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff368164350 0x7ff3681647b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680aebc0 con 0x7ff3680acf30 2023-08-17T00:10:43.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680ae730 con 0x7ff368063bc0 2023-08-17T00:10:43.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36e039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3680ad840 con 0x7ff368164350 2023-08-17T00:10:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36c836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 0x7ff368163e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36c836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 0x7ff368163e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55972/0 (socket says 172.21.15.153:55972) 2023-08-17T00:10:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36c836700 1 -- 172.21.15.153:0/4001039411 learned_addr learned my addr 172.21.15.153:0/4001039411 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36d037700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff368063bc0 0x7ff3680aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.815+0000 7ff36d838700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff368164350 0x7ff3681647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36c836700 1 -- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff368164350 msgr2=0x7ff3681647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36c836700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff368164350 0x7ff3681647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36c836700 1 -- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff368063bc0 msgr2=0x7ff3680aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36c836700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff368063bc0 0x7ff3680aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36c836700 1 -- 172.21.15.153:0/4001039411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff360009a20 con 0x7ff3680acf30 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36d037700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff368063bc0 0x7ff3680aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36c836700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 0x7ff368163e60 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7ff35800c440 tx=0x7ff358007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358007020 con 0x7ff3680acf30 2023-08-17T00:10:43.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff358007180 con 0x7ff3680acf30 2023-08-17T00:10:43.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3680adb20 con 0x7ff3680acf30 2023-08-17T00:10:43.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff358007520 con 0x7ff3680acf30 2023-08-17T00:10:43.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3680ae0e0 con 0x7ff3680acf30 2023-08-17T00:10:43.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3680ae8c0 con 0x7ff3680acf30 2023-08-17T00:10:43.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.819+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff358010070 con 0x7ff3680acf30 2023-08-17T00:10:43.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.823+0000 7ff35d7fa700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff34c05a150 0x7ff34c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:43.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.823+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7ff3580734e0 con 0x7ff3680acf30 2023-08-17T00:10:43.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.823+0000 7ff36d037700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff34c05a150 0x7ff34c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:43.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.823+0000 7ff36d037700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff34c05a150 0x7ff34c05c610 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7ff364000c00 tx=0x7ff364009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:43.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:43.827+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff358046dd0 con 0x7ff3680acf30 2023-08-17T00:10:44.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.019+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff36806b4c0 con 0x7ff3680acf30 2023-08-17T00:10:44.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff35d7fa700 1 -- 172.21.15.153:0/4001039411 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7ff35804a3f0 con 0x7ff3680acf30 2023-08-17T00:10:44.028 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:44.029 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:10:44.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff34c05a150 msgr2=0x7ff34c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff34c05a150 0x7ff34c05c610 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7ff364000c00 tx=0x7ff364009040).stop 2023-08-17T00:10:44.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 msgr2=0x7ff368163e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 0x7ff368163e60 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7ff35800c440 tx=0x7ff358007e00).stop 2023-08-17T00:10:44.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 shutdown_connections 2023-08-17T00:10:44.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff34c05a150 0x7ff34c05c610 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff368164350 0x7ff3681647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3680acf30 0x7ff368163e60 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 --2- 172.21.15.153:0/4001039411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff368063bc0 0x7ff3680aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 >> 172.21.15.153:0/4001039411 conn(0x7ff3680cb330 msgr2=0x7ff3680c0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:44.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 shutdown_connections 2023-08-17T00:10:44.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.023+0000 7ff36e039700 1 -- 172.21.15.153:0/4001039411 wait complete. 2023-08-17T00:10:44.033 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:10:44.049 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:10:44.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 Processor -- start 2023-08-17T00:10:44.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 -- start start 2023-08-17T00:10:44.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d7c151f70 0x7f2d7c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c065b50 0x7f2d7c064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d7c061fa0 con 0x7f2d7c151b90 2023-08-17T00:10:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d7c0c3fb0 con 0x7f2d7c151f70 2023-08-17T00:10:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d81e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c1523d0 con 0x7f2d7c065b50 2023-08-17T00:10:44.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d7affd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d7c151f70 0x7f2d7c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d7affd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d7c151f70 0x7f2d7c065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:48664/0 (socket says 172.21.15.153:48664) 2023-08-17T00:10:44.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d7affd700 1 -- 172.21.15.153:0/246416445 learned_addr learned my addr 172.21.15.153:0/246416445 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:44.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.199+0000 7f2d7bfff700 1 --2- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c065b50 0x7f2d7c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7affd700 1 -- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c065b50 msgr2=0x7f2d7c064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:44.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7affd700 1 --2- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c065b50 0x7f2d7c064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7affd700 1 -- 172.21.15.153:0/246416445 >> v1:172.21.15.178:6789/0 conn(0x7f2d7c151b90 legacy=0x7f2d7c063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7affd700 1 -- 172.21.15.153:0/246416445 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c0621f0 con 0x7f2d7c151f70 2023-08-17T00:10:44.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7affd700 1 --2- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c151f70 0x7f2d7c065660 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f2d70006fd0 tx=0x7f2d700090f0).ready entity=mon.1 client_cookie=ddc616e7f8fecb09 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:44.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7a7fc700 1 -- 172.21.15.153:0/246416445 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7000b580 con 0x7f2d7c151f70 2023-08-17T00:10:44.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7a7fc700 1 -- 172.21.15.153:0/246416445 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7000b6e0 con 0x7f2d7c151f70 2023-08-17T00:10:44.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d7a7fc700 1 -- 172.21.15.153:0/246416445 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7000ba80 con 0x7f2d7c151f70 2023-08-17T00:10:44.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 -- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c151f70 msgr2=0x7f2d7c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c151f70 0x7f2d7c065660 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7f2d70006fd0 tx=0x7f2d700090f0).stop 2023-08-17T00:10:44.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 -- 172.21.15.153:0/246416445 shutdown_connections 2023-08-17T00:10:44.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c065b50 0x7f2d7c064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/246416445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c151f70 0x7f2d7c065660 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 -- 172.21.15.153:0/246416445 >> 172.21.15.153:0/246416445 conn(0x7f2d7c0c7150 msgr2=0x7f2d7c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:44.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 -- 172.21.15.153:0/246416445 shutdown_connections 2023-08-17T00:10:44.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.203+0000 7f2d81e5b700 1 -- 172.21.15.153:0/246416445 wait complete. 2023-08-17T00:10:44.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 Processor -- start 2023-08-17T00:10:44.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 -- start start 2023-08-17T00:10:44.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c065b50 0x7f2d7c0a7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c151b90 0x7f2d7c0a7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 0x7f2d7c0c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0c2170 con 0x7f2d7c151f70 2023-08-17T00:10:44.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.207+0000 7f2d81e5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0c13d0 con 0x7f2d7c065b50 2023-08-17T00:10:44.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d81e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7c0c23c0 con 0x7f2d7c151b90 2023-08-17T00:10:44.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 0x7f2d7c0c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 0x7f2d7c0c0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55978/0 (socket says 172.21.15.153:55978) 2023-08-17T00:10:44.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 -- 172.21.15.153:0/3784567274 learned_addr learned my addr 172.21.15.153:0/3784567274 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:44.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7affd700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c151b90 0x7f2d7c0a7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7b7fe700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c065b50 0x7f2d7c0a7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 -- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c151b90 msgr2=0x7f2d7c0a7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c151b90 0x7f2d7c0a7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 -- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c065b50 msgr2=0x7f2d7c0a7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c065b50 0x7f2d7c0a7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 -- 172.21.15.153:0/3784567274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d70009370 con 0x7f2d7c151f70 2023-08-17T00:10:44.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d7bfff700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 0x7f2d7c0c0ee0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f2d74009df0 tx=0x7f2d7400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:44.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d74009b50 con 0x7f2d7c151f70 2023-08-17T00:10:44.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7400f040 con 0x7f2d7c151f70 2023-08-17T00:10:44.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7400ccb0 con 0x7f2d7c151f70 2023-08-17T00:10:44.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c0c26a0 con 0x7f2d7c151f70 2023-08-17T00:10:44.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7c152dc0 con 0x7f2d7c151f70 2023-08-17T00:10:44.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.211+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d7c0be780 con 0x7f2d7c151f70 2023-08-17T00:10:44.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.215+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2d74013610 con 0x7f2d7c151f70 2023-08-17T00:10:44.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.215+0000 7f2d637fe700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2d6805a150 0x7f2d6805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.215+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f2d74074a80 con 0x7f2d7c151f70 2023-08-17T00:10:44.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.215+0000 7f2d7b7fe700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2d6805a150 0x7f2d6805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.219+0000 7f2d7b7fe700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2d6805a150 0x7f2d6805c610 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f2d6c003920 tx=0x7f2d6c000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:44.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.223+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2d7c0be780 con 0x7f2d7c151f70 2023-08-17T00:10:44.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.383+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d7c06b530 con 0x7f2d7c151f70 2023-08-17T00:10:44.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d637fe700 1 -- 172.21.15.153:0/3784567274 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+17269 (secure 0 0 0) 0x7f2d74048370 con 0x7f2d7c151f70 2023-08-17T00:10:44.394 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:44.394 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":100,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:40.266605+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:09:52.827329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T00:09:53.817978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":7,"to":0}]},{"pgid":"14.12","mappings":[{"from":7,"to":3}]},{"pgid":"14.19","mappings":[{"from":7,"to":0}]},{"pgid":"14.22","mappings":[{"from":1,"to":0}]},{"pgid":"14.33","mappings":[{"from":1,"to":3}]},{"pgid":"14.35","mappings":[{"from":7,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:10:44.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2d6805a150 msgr2=0x7f2d6805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2d6805a150 0x7f2d6805c610 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f2d6c003920 tx=0x7f2d6c000bc0).stop 2023-08-17T00:10:44.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 msgr2=0x7f2d7c0c0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 0x7f2d7c0c0ee0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f2d74009df0 tx=0x7f2d7400b040).stop 2023-08-17T00:10:44.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 shutdown_connections 2023-08-17T00:10:44.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2d6805a150 0x7f2d6805c610 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2d7c151f70 0x7f2d7c0c0ee0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d7c151b90 0x7f2d7c0a7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 --2- 172.21.15.153:0/3784567274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d7c065b50 0x7f2d7c0a7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 >> 172.21.15.153:0/3784567274 conn(0x7f2d7c0c7150 msgr2=0x7f2d7c0c5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:44.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.387+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 shutdown_connections 2023-08-17T00:10:44.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.391+0000 7f2d81e5b700 1 -- 172.21.15.153:0/3784567274 wait complete. 2023-08-17T00:10:44.419 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:10:44.420 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:44.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.579+0000 7f3759907700 1 Processor -- start 2023-08-17T00:10:44.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.579+0000 7f3759907700 1 -- start start 2023-08-17T00:10:44.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37540689c0 0x7f3754068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37541560f0 0x7f37540c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3754151530 0x7f37541519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3754065da0 con 0x7f37540689c0 2023-08-17T00:10:44.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3754155c60 con 0x7f37541560f0 2023-08-17T00:10:44.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754156550 con 0x7f3754151530 2023-08-17T00:10:44.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37540689c0 0x7f3754068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f37540689c0 0x7f3754068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55986/0 (socket says 172.21.15.153:55986) 2023-08-17T00:10:44.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 -- 172.21.15.153:0/3262228103 learned_addr learned my addr 172.21.15.153:0/3262228103 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:44.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3753fff700 1 --2- 172.21.15.153:0/3262228103 >> v2:172.21.15.178:3300/0 conn(0x7f37541560f0 0x7f37540c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3759106700 1 --2- 172.21.15.153:0/3262228103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3754151530 0x7f37541519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 -- 172.21.15.153:0/3262228103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3754151530 msgr2=0x7f37541519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:44.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 --2- 172.21.15.153:0/3262228103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3754151530 0x7f37541519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 -- 172.21.15.153:0/3262228103 >> v2:172.21.15.178:3300/0 conn(0x7f37541560f0 msgr2=0x7f37540c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 --2- 172.21.15.153:0/3262228103 >> v2:172.21.15.178:3300/0 conn(0x7f37541560f0 0x7f37540c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 -- 172.21.15.153:0/3262228103 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3754065ff0 con 0x7f37540689c0 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3753fff700 1 --2- 172.21.15.153:0/3262228103 >> v2:172.21.15.178:3300/0 conn(0x7f37541560f0 0x7f37540c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f3758905700 1 --2- 172.21.15.153:0/3262228103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540689c0 0x7f3754068da0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f37540bff90 tx=0x7f3748009060).ready entity=mon.0 client_cookie=b9267d83375d5d9f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f37537fe700 1 -- 172.21.15.153:0/3262228103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748005880 con 0x7f37540689c0 2023-08-17T00:10:44.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f37537fe700 1 -- 172.21.15.153:0/3262228103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37480059e0 con 0x7f37540689c0 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.583+0000 7f37537fe700 1 -- 172.21.15.153:0/3262228103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3748005d60 con 0x7f37540689c0 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 -- 172.21.15.153:0/3262228103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540689c0 msgr2=0x7f3754068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 --2- 172.21.15.153:0/3262228103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540689c0 0x7f3754068da0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 rx=0x7f37540bff90 tx=0x7f3748009060).stop 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 -- 172.21.15.153:0/3262228103 shutdown_connections 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 --2- 172.21.15.153:0/3262228103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3754151530 0x7f37541519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 --2- 172.21.15.153:0/3262228103 >> v2:172.21.15.178:3300/0 conn(0x7f37541560f0 0x7f37540c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 --2- 172.21.15.153:0/3262228103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f37540689c0 0x7f3754068da0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 -- 172.21.15.153:0/3262228103 >> 172.21.15.153:0/3262228103 conn(0x7f37540c6620 msgr2=0x7f37540c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:44.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 -- 172.21.15.153:0/3262228103 shutdown_connections 2023-08-17T00:10:44.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 -- 172.21.15.153:0/3262228103 wait complete. 2023-08-17T00:10:44.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 Processor -- start 2023-08-17T00:10:44.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.587+0000 7f3759907700 1 -- start start 2023-08-17T00:10:44.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37540689c0 0x7f375414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 0x7f3754151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541560f0 0x7f37540bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540bba30 con 0x7f3754151530 2023-08-17T00:10:44.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3754151350 con 0x7f37541560f0 2023-08-17T00:10:44.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540bb100 con 0x7f37540689c0 2023-08-17T00:10:44.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 0x7f3754151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 0x7f3754151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55988/0 (socket says 172.21.15.153:55988) 2023-08-17T00:10:44.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 -- 172.21.15.153:0/1136767250 learned_addr learned my addr 172.21.15.153:0/1136767250 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:44.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759106700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541560f0 0x7f37540bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3758905700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37540689c0 0x7f375414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 -- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37540689c0 msgr2=0x7f375414e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37540689c0 0x7f375414e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 -- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541560f0 msgr2=0x7f37540bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541560f0 0x7f37540bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 -- 172.21.15.153:0/1136767250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748009300 con 0x7f3754151530 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3753fff700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 0x7f3754151b60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f374400d890 tx=0x7f3744008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744011590 con 0x7f3754151530 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37440116f0 con 0x7f3754151530 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744011a70 con 0x7f3754151530 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37540bb3e0 con 0x7f3754151530 2023-08-17T00:10:44.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.591+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3754150b80 con 0x7f3754151530 2023-08-17T00:10:44.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.595+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37540bbbe0 con 0x7f3754151530 2023-08-17T00:10:44.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.595+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f374401c460 con 0x7f3754151530 2023-08-17T00:10:44.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.595+0000 7f3750ff9700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f374005a150 0x7f374005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.595+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f37440743a0 con 0x7f3754151530 2023-08-17T00:10:44.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.599+0000 7f3758905700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f374005a150 0x7f374005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.599+0000 7f3758905700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f374005a150 0x7f374005c610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f37540a87f0 tx=0x7f3748016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:44.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.603+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f37540bbbe0 con 0x7f3754151530 2023-08-17T00:10:44.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.799+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37540bbbe0 con 0x7f3754151530 2023-08-17T00:10:44.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.799+0000 7f3750ff9700 1 -- 172.21.15.153:0/1136767250 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f37540bbbe0 con 0x7f3754151530 2023-08-17T00:10:44.806 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:44.806 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:10:44.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f374005a150 msgr2=0x7f374005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f374005a150 0x7f374005c610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f37540a87f0 tx=0x7f3748016000).stop 2023-08-17T00:10:44.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 msgr2=0x7f3754151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 0x7f3754151b60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f374400d890 tx=0x7f3744008040).stop 2023-08-17T00:10:44.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 shutdown_connections 2023-08-17T00:10:44.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f374005a150 0x7f374005c610 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37541560f0 0x7f37540bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3754151530 0x7f3754151b60 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 --2- 172.21.15.153:0/1136767250 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37540689c0 0x7f375414e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 >> 172.21.15.153:0/1136767250 conn(0x7f37540c6620 msgr2=0x7f37540a8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:44.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 shutdown_connections 2023-08-17T00:10:44.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.803+0000 7f3759907700 1 -- 172.21.15.153:0/1136767250 wait complete. 2023-08-17T00:10:44.811 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:10:44.828 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:44.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.983+0000 7f3eec3a9700 1 Processor -- start 2023-08-17T00:10:44.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.983+0000 7f3eec3a9700 1 -- start start 2023-08-17T00:10:44.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.983+0000 7f3eec3a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ee4153ab0 0x7f3ee4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.983+0000 7f3eec3a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ee40c8d50 0x7f3ee40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:44.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40aa750 con 0x7f3ee40c7490 2023-08-17T00:10:44.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40c9dd0 con 0x7f3ee4153ab0 2023-08-17T00:10:44.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40aacf0 con 0x7f3ee40c8d50 2023-08-17T00:10:44.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ee4153ab0 0x7f3ee4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ee4153ab0 0x7f3ee4153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54582/0 (socket says 172.21.15.153:54582) 2023-08-17T00:10:44.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 -- 172.21.15.153:0/607570276 learned_addr learned my addr 172.21.15.153:0/607570276 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:44.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3ee9944700 1 --2- 172.21.15.153:0/607570276 >> v2:172.21.15.178:3300/0 conn(0x7f3ee40c8d50 0x7f3ee40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:44.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 -- 172.21.15.153:0/607570276 >> v2:172.21.15.178:3300/0 conn(0x7f3ee40c8d50 msgr2=0x7f3ee40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:44.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 --2- 172.21.15.153:0/607570276 >> v2:172.21.15.178:3300/0 conn(0x7f3ee40c8d50 0x7f3ee40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:44.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 -- 172.21.15.153:0/607570276 >> v1:172.21.15.153:6789/0 conn(0x7f3ee40c7490 legacy=0x7f3ee40c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:44.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 -- 172.21.15.153:0/607570276 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40c5ca0 con 0x7f3ee4153ab0 2023-08-17T00:10:45.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3ee9944700 1 --2- 172.21.15.153:0/607570276 >> v2:172.21.15.178:3300/0 conn(0x7f3ee40c8d50 0x7f3ee40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:45.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eea145700 1 --2- 172.21.15.153:0/607570276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee4153ab0 0x7f3ee4153e90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f3ee4083da0 tx=0x7f3ee00090f0).ready entity=mon.0 client_cookie=d3528deed481bd57 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3ee9143700 1 -- 172.21.15.153:0/607570276 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000b600 con 0x7f3ee4153ab0 2023-08-17T00:10:45.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3ee9143700 1 -- 172.21.15.153:0/607570276 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee000b760 con 0x7f3ee4153ab0 2023-08-17T00:10:45.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3ee9143700 1 -- 172.21.15.153:0/607570276 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee000bae0 con 0x7f3ee4153ab0 2023-08-17T00:10:45.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- 172.21.15.153:0/607570276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee4153ab0 msgr2=0x7f3ee4153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/607570276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee4153ab0 0x7f3ee4153e90 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f3ee4083da0 tx=0x7f3ee00090f0).stop 2023-08-17T00:10:45.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- 172.21.15.153:0/607570276 shutdown_connections 2023-08-17T00:10:45.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/607570276 >> v2:172.21.15.178:3300/0 conn(0x7f3ee40c8d50 0x7f3ee40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/607570276 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee4153ab0 0x7f3ee4153e90 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- 172.21.15.153:0/607570276 >> 172.21.15.153:0/607570276 conn(0x7f3ee4061fa0 msgr2=0x7f3ee40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:45.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- 172.21.15.153:0/607570276 shutdown_connections 2023-08-17T00:10:45.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.987+0000 7f3eec3a9700 1 -- 172.21.15.153:0/607570276 wait complete. 2023-08-17T00:10:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 Processor -- start 2023-08-17T00:10:45.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 -- start start 2023-08-17T00:10:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ee40c7490 0x7f3ee4149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 0x7f3ee40c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ee4153ab0 0x7f3ee40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c2d20 con 0x7f3ee40c8d50 2023-08-17T00:10:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c1b00 con 0x7f3ee4153ab0 2023-08-17T00:10:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.991+0000 7f3eec3a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c23a0 con 0x7f3ee40c7490 2023-08-17T00:10:45.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 0x7f3ee40c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 0x7f3ee40c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54590/0 (socket says 172.21.15.153:54590) 2023-08-17T00:10:45.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 -- 172.21.15.153:0/3525941857 learned_addr learned my addr 172.21.15.153:0/3525941857 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:45.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eea145700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ee40c7490 0x7f3ee4149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eea946700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ee4153ab0 0x7f3ee40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 -- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ee40c7490 msgr2=0x7f3ee4149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ee40c7490 0x7f3ee4149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 -- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ee4153ab0 msgr2=0x7f3ee40caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ee4153ab0 0x7f3ee40caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 -- 172.21.15.153:0/3525941857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee0009370 con 0x7f3ee40c8d50 2023-08-17T00:10:45.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3ee9944700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 0x7f3ee40c2830 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f3ed400c8b0 tx=0x7f3ed4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4010580 con 0x7f3ee40c8d50 2023-08-17T00:10:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40106e0 con 0x7f3ee40c8d50 2023-08-17T00:10:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee4168150 con 0x7f3ee40c8d50 2023-08-17T00:10:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4010a60 con 0x7f3ee40c8d50 2023-08-17T00:10:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40c2030 con 0x7f3ee40c8d50 2023-08-17T00:10:45.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.995+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40c4c70 con 0x7f3ee40c8d50 2023-08-17T00:10:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.999+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3ed401b460 con 0x7f3ee40c8d50 2023-08-17T00:10:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.999+0000 7f3eda7fc700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ec805a180 0x7f3ec805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:44.999+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7f3ed40742e0 con 0x7f3ee40c8d50 2023-08-17T00:10:45.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.003+0000 7f3eea145700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ec805a180 0x7f3ec805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.003+0000 7f3eea145700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ec805a180 0x7f3ec805c640 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f3ee40c0280 tx=0x7f3ee0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.007+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ed4047c80 con 0x7f3ee40c8d50 2023-08-17T00:10:45.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.203+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ee406b530 con 0x7f3ee40c8d50 2023-08-17T00:10:45.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eda7fc700 1 -- 172.21.15.153:0/3525941857 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4503 (secure 0 0 0) 0x7f3ed404b2a0 con 0x7f3ee40c8d50 2023-08-17T00:10:45.212 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:45.213 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:09:54.808513+0000","modified":"2023-08-17T00:09:58.219712+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7080":{"gid":7080,"name":"a","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/1634760764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1634760764},{"type":"v1","addr":"172.21.15.153:6835","nonce":1634760764}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-08-17T00:10:45.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ec805a180 msgr2=0x7f3ec805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ec805a180 0x7f3ec805c640 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f3ee40c0280 tx=0x7f3ee0017000).stop 2023-08-17T00:10:45.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 msgr2=0x7f3ee40c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 0x7f3ee40c2830 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f3ed400c8b0 tx=0x7f3ed4008040).stop 2023-08-17T00:10:45.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 shutdown_connections 2023-08-17T00:10:45.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ec805a180 0x7f3ec805c640 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ee4153ab0 0x7f3ee40caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ee40c8d50 0x7f3ee40c2830 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 --2- 172.21.15.153:0/3525941857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ee40c7490 0x7f3ee4149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 >> 172.21.15.153:0/3525941857 conn(0x7f3ee4061fa0 msgr2=0x7f3ee40a9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:45.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 shutdown_connections 2023-08-17T00:10:45.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.207+0000 7f3eec3a9700 1 -- 172.21.15.153:0/3525941857 wait complete. 2023-08-17T00:10:45.219 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 85 2023-08-17T00:10:45.236 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:10:45.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.391+0000 7fb5c6adb700 1 Processor -- start 2023-08-17T00:10:45.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.391+0000 7fb5c6adb700 1 -- start start 2023-08-17T00:10:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.391+0000 7fb5c6adb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5c00c0c80 0x7fb5c00a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.391+0000 7fb5c6adb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5c01505d0 0x7fb5c0150a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c00bc0b0 con 0x7fb5c00a89c0 2023-08-17T00:10:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c00bd590 con 0x7fb5c00c0c80 2023-08-17T00:10:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c0062fb0 con 0x7fb5c01505d0 2023-08-17T00:10:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5c00c0c80 0x7fb5c00a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb5c00c0c80 0x7fb5c00a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54602/0 (socket says 172.21.15.153:54602) 2023-08-17T00:10:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 -- 172.21.15.153:0/3221817719 learned_addr learned my addr 172.21.15.153:0/3221817719 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c5078700 1 --2- 172.21.15.153:0/3221817719 >> v2:172.21.15.178:3300/0 conn(0x7fb5c01505d0 0x7fb5c0150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 -- 172.21.15.153:0/3221817719 >> v2:172.21.15.178:3300/0 conn(0x7fb5c01505d0 msgr2=0x7fb5c0150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 --2- 172.21.15.153:0/3221817719 >> v2:172.21.15.178:3300/0 conn(0x7fb5c01505d0 0x7fb5c0150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 -- 172.21.15.153:0/3221817719 >> v1:172.21.15.153:6789/0 conn(0x7fb5c00a89c0 legacy=0x7fb5c00bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 -- 172.21.15.153:0/3221817719 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c00bb780 con 0x7fb5c00c0c80 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c5078700 1 --2- 172.21.15.153:0/3221817719 >> v2:172.21.15.178:3300/0 conn(0x7fb5c01505d0 0x7fb5c0150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b7fff700 1 --2- 172.21.15.153:0/3221817719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c00c0c80 0x7fb5c00a8da0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fb5c00c3030 tx=0x7fb5b000b3b0).ready entity=mon.0 client_cookie=e2f73b421ecda206 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b77fe700 1 -- 172.21.15.153:0/3221817719 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b000db10 con 0x7fb5c00c0c80 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b77fe700 1 -- 172.21.15.153:0/3221817719 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b000dc70 con 0x7fb5c00c0c80 2023-08-17T00:10:45.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5b77fe700 1 -- 172.21.15.153:0/3221817719 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0010470 con 0x7fb5c00c0c80 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- 172.21.15.153:0/3221817719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c00c0c80 msgr2=0x7fb5c00a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/3221817719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c00c0c80 0x7fb5c00a8da0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7fb5c00c3030 tx=0x7fb5b000b3b0).stop 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- 172.21.15.153:0/3221817719 shutdown_connections 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/3221817719 >> v2:172.21.15.178:3300/0 conn(0x7fb5c01505d0 0x7fb5c0150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/3221817719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c00c0c80 0x7fb5c00a8da0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- 172.21.15.153:0/3221817719 >> 172.21.15.153:0/3221817719 conn(0x7fb5c00c7150 msgr2=0x7fb5c00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- 172.21.15.153:0/3221817719 shutdown_connections 2023-08-17T00:10:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.395+0000 7fb5c6adb700 1 -- 172.21.15.153:0/3221817719 wait complete. 2023-08-17T00:10:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 Processor -- start 2023-08-17T00:10:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 -- start start 2023-08-17T00:10:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c00a89c0 0x7fb5c014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5c00c0c80 0x7fb5c014fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 0x7fb5c0168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0167d90 con 0x7fb5c01505d0 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0167a50 con 0x7fb5c00a89c0 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c6adb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c0151380 con 0x7fb5c00c0c80 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 0x7fb5c0168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 0x7fb5c0168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54604/0 (socket says 172.21.15.153:54604) 2023-08-17T00:10:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 -- 172.21.15.153:0/2903067319 learned_addr learned my addr 172.21.15.153:0/2903067319 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:45.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c4877700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c00a89c0 0x7fb5c014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5b7fff700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5c00c0c80 0x7fb5c014fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 -- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5c00c0c80 msgr2=0x7fb5c014fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5c00c0c80 0x7fb5c014fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 -- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c00a89c0 msgr2=0x7fb5c014de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c00a89c0 0x7fb5c014de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 -- 172.21.15.153:0/2903067319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b000b610 con 0x7fb5c01505d0 2023-08-17T00:10:45.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c4877700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c00a89c0 0x7fb5c014de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:45.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.399+0000 7fb5c5078700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 0x7fb5c0168220 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fb5b800c650 tx=0x7fb5b8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8010580 con 0x7fb5c01505d0 2023-08-17T00:10:45.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b80106e0 con 0x7fb5c01505d0 2023-08-17T00:10:45.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b8010a60 con 0x7fb5c01505d0 2023-08-17T00:10:45.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c0151660 con 0x7fb5c01505d0 2023-08-17T00:10:45.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c014e330 con 0x7fb5c01505d0 2023-08-17T00:10:45.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0167f00 con 0x7fb5c01505d0 2023-08-17T00:10:45.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.403+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb5b801b460 con 0x7fb5c01505d0 2023-08-17T00:10:45.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.407+0000 7fb5b4ff9700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb5ac05a150 0x7fb5ac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.407+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7fb5b8074270 con 0x7fb5c01505d0 2023-08-17T00:10:45.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.407+0000 7fb5c4877700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb5ac05a150 0x7fb5ac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.407+0000 7fb5c4877700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb5ac05a150 0x7fb5ac05c610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fb5bc007fd0 tx=0x7fb5bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.411+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb5b8047c10 con 0x7fb5c01505d0 2023-08-17T00:10:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.575+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5c006b530 con 0x7fb5c01505d0 2023-08-17T00:10:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.579+0000 7fb5b4ff9700 1 -- 172.21.15.153:0/2903067319 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+17269 (secure 0 0 0) 0x7fb5b804b230 con 0x7fb5c01505d0 2023-08-17T00:10:45.585 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:45.585 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":100,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:40.266605+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:09:52.827329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-08-17T00:09:53.817978+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.a","mappings":[{"from":7,"to":0}]},{"pgid":"14.12","mappings":[{"from":7,"to":3}]},{"pgid":"14.19","mappings":[{"from":7,"to":0}]},{"pgid":"14.22","mappings":[{"from":1,"to":0}]},{"pgid":"14.33","mappings":[{"from":1,"to":3}]},{"pgid":"14.35","mappings":[{"from":7,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:10:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.579+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb5ac05a150 msgr2=0x7fb5ac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.579+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb5ac05a150 0x7fb5ac05c610 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fb5bc007fd0 tx=0x7fb5bc009040).stop 2023-08-17T00:10:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.579+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 msgr2=0x7fb5c0168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.579+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 0x7fb5c0168220 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7fb5b800c650 tx=0x7fb5b8008040).stop 2023-08-17T00:10:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.579+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 shutdown_connections 2023-08-17T00:10:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb5ac05a150 0x7fb5ac05c610 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5c01505d0 0x7fb5c0168220 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5c00c0c80 0x7fb5c014fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 --2- 172.21.15.153:0/2903067319 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5c00a89c0 0x7fb5c014de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 >> 172.21.15.153:0/2903067319 conn(0x7fb5c00c7150 msgr2=0x7fb5c00c47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 shutdown_connections 2023-08-17T00:10:45.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.583+0000 7fb5c6adb700 1 -- 172.21.15.153:0/2903067319 wait complete. 2023-08-17T00:10:45.607 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:10:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 Processor -- start 2023-08-17T00:10:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 -- start start 2023-08-17T00:10:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd274153d50 0x7fd2740632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd274154130 0x7fd2740629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd274065240 con 0x7fd2740656d0 2023-08-17T00:10:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd274062ea0 con 0x7fd274154130 2023-08-17T00:10:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd27b21b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd274063880 con 0x7fd274153d50 2023-08-17T00:10:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd274154130 0x7fd2740629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd274154130 0x7fd2740629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54618/0 (socket says 172.21.15.153:54618) 2023-08-17T00:10:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 -- 172.21.15.153:0/971525579 learned_addr learned my addr 172.21.15.153:0/971525579 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 -- 172.21.15.153:0/971525579 >> v2:172.21.15.178:3300/0 conn(0x7fd274153d50 msgr2=0x7fd2740632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 --2- 172.21.15.153:0/971525579 >> v2:172.21.15.178:3300/0 conn(0x7fd274153d50 0x7fd2740632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:10:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 -- 172.21.15.153:0/971525579 >> v1:172.21.15.153:6789/0 conn(0x7fd2740656d0 legacy=0x7fd2740bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.759+0000 7fd273fff700 1 -- 172.21.15.153:0/971525579 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd274064910 con 0x7fd274154130 2023-08-17T00:10:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd273fff700 1 --2- 172.21.15.153:0/971525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740629b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fd274064280 tx=0x7fd2600090f0).ready entity=mon.0 client_cookie=7210d78217278ed3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd2737fe700 1 -- 172.21.15.153:0/971525579 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000b5a0 con 0x7fd274154130 2023-08-17T00:10:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd2737fe700 1 -- 172.21.15.153:0/971525579 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000b700 con 0x7fd274154130 2023-08-17T00:10:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd2737fe700 1 -- 172.21.15.153:0/971525579 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000baa0 con 0x7fd274154130 2023-08-17T00:10:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 -- 172.21.15.153:0/971525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 msgr2=0x7fd2740629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 --2- 172.21.15.153:0/971525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740629b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fd274064280 tx=0x7fd2600090f0).stop 2023-08-17T00:10:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 -- 172.21.15.153:0/971525579 shutdown_connections 2023-08-17T00:10:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 --2- 172.21.15.153:0/971525579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740629b0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 --2- 172.21.15.153:0/971525579 >> v2:172.21.15.178:3300/0 conn(0x7fd274153d50 0x7fd2740632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:10:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 -- 172.21.15.153:0/971525579 >> 172.21.15.153:0/971525579 conn(0x7fd2740c7150 msgr2=0x7fd2740c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 -- 172.21.15.153:0/971525579 shutdown_connections 2023-08-17T00:10:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.763+0000 7fd27b21b700 1 -- 172.21.15.153:0/971525579 wait complete. 2023-08-17T00:10:45.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 Processor -- start 2023-08-17T00:10:45.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 -- start start 2023-08-17T00:10:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2740656d0 0x7fd274154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd274153d50 0x7fd274147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740bd7c0 con 0x7fd274154130 2023-08-17T00:10:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740bdaa0 con 0x7fd2740656d0 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd27b21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2740bdd80 con 0x7fd274153d50 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd2797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd2797b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54630/0 (socket says 172.21.15.153:54630) 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.767+0000 7fd2797b8700 1 -- 172.21.15.153:0/1575294557 learned_addr learned my addr 172.21.15.153:0/1575294557 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd278fb7700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2740656d0 0x7fd274154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd273fff700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd274153d50 0x7fd274147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd2797b8700 1 -- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd274153d50 msgr2=0x7fd274147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd2797b8700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd274153d50 0x7fd274147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd2797b8700 1 -- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2740656d0 msgr2=0x7fd274154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd2797b8700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2740656d0 0x7fd274154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd2797b8700 1 -- 172.21.15.153:0/1575294557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009370 con 0x7fd274154130 2023-08-17T00:10:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd2797b8700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740aa440 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fd26c00b810 tx=0x7fd26c009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00d4a0 con 0x7fd274154130 2023-08-17T00:10:45.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00d600 con 0x7fd274154130 2023-08-17T00:10:45.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00d9c0 con 0x7fd274154130 2023-08-17T00:10:45.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2740be060 con 0x7fd274154130 2023-08-17T00:10:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2741553d0 con 0x7fd274154130 2023-08-17T00:10:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27406b530 con 0x7fd274154130 2023-08-17T00:10:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.771+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd26c018030 con 0x7fd274154130 2023-08-17T00:10:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.775+0000 7fd270ff9700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25805a150 0x7fd25805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.775+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6295+0+0 (secure 0 0 0) 0x7fd26c073940 con 0x7fd274154130 2023-08-17T00:10:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.775+0000 7fd278fb7700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25805a150 0x7fd25805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.775+0000 7fd278fb7700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25805a150 0x7fd25805c610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fd268006fd0 tx=0x7fd268009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:45.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.779+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd26c0472e0 con 0x7fd274154130 2023-08-17T00:10:45.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:45.979+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd2740c3ab0 con 0x7fd274154130 2023-08-17T00:10:45.993 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:10:46.000 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:10:46.321 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:10:46.315+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:10:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.327+0000 7fd270ff9700 1 -- 172.21.15.153:0/1575294557 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd26c04a900 con 0x7fd274154130 2023-08-17T00:10:46.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25805a150 msgr2=0x7fd25805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25805a150 0x7fd25805c610 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fd268006fd0 tx=0x7fd268009060).stop 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 msgr2=0x7fd2740aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740aa440 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7fd26c00b810 tx=0x7fd26c009290).stop 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 shutdown_connections 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25805a150 0x7fd25805c610 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd274154130 0x7fd2740aa440 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd274153d50 0x7fd274147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 --2- 172.21.15.153:0/1575294557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2740656d0 0x7fd274154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.331+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 >> 172.21.15.153:0/1575294557 conn(0x7fd2740c7150 msgr2=0x7fd274068850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:46.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.335+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 shutdown_connections 2023-08-17T00:10:46.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.335+0000 7fd27b21b700 1 -- 172.21.15.153:0/1575294557 wait complete. 2023-08-17T00:10:46.342 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:10:46.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:10:46.410 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:10:46.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.523+0000 7f1402969700 1 Processor -- start 2023-08-17T00:10:46.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f1402969700 1 -- start start 2023-08-17T00:10:46.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f1402969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0a8b70 0x7f13fc0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f1402969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13fc0a8f50 0x7f13fc0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f1402969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13fc065240 con 0x7f13fc0656d0 2023-08-17T00:10:46.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f1402969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13fc062ea0 con 0x7f13fc0a8f50 2023-08-17T00:10:46.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f1402969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc0638a0 con 0x7f13fc0a8b70 2023-08-17T00:10:46.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f13f37fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13fc0a8f50 0x7f13fc0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:46.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f13f37fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13fc0a8f50 0x7f13fc0629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:56796/0 (socket says 172.21.15.153:56796) 2023-08-17T00:10:46.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f13f37fe700 1 -- 172.21.15.153:0/3168941122 learned_addr learned my addr 172.21.15.153:0/3168941122 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:46.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.527+0000 7f13fbfff700 1 --2- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0a8b70 0x7f13fc0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:46.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13f37fe700 1 -- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0a8b70 msgr2=0x7f13fc0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:46.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13f37fe700 1 --2- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0a8b70 0x7f13fc0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13f37fe700 1 -- 172.21.15.153:0/3168941122 >> v1:172.21.15.178:6789/0 conn(0x7f13fc0656d0 legacy=0x7f13fc0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13f37fe700 1 -- 172.21.15.153:0/3168941122 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc064910 con 0x7f13fc0a8f50 2023-08-17T00:10:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13f37fe700 1 --2- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc0629b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f13e4006fd0 tx=0x7f13e40090f0).ready entity=mon.1 client_cookie=4694c32906dfb3d9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13fb7fe700 1 -- 172.21.15.153:0/3168941122 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400b580 con 0x7f13fc0a8f50 2023-08-17T00:10:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13fb7fe700 1 -- 172.21.15.153:0/3168941122 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e400b6e0 con 0x7f13fc0a8f50 2023-08-17T00:10:46.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f13fb7fe700 1 -- 172.21.15.153:0/3168941122 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400ba60 con 0x7f13fc0a8f50 2023-08-17T00:10:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 -- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 msgr2=0x7f13fc0629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 --2- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc0629b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f13e4006fd0 tx=0x7f13e40090f0).stop 2023-08-17T00:10:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 -- 172.21.15.153:0/3168941122 shutdown_connections 2023-08-17T00:10:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 --2- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc0629b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 --2- 172.21.15.153:0/3168941122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0a8b70 0x7f13fc0632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 -- 172.21.15.153:0/3168941122 >> 172.21.15.153:0/3168941122 conn(0x7f13fc0c7150 msgr2=0x7f13fc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 -- 172.21.15.153:0/3168941122 shutdown_connections 2023-08-17T00:10:46.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.531+0000 7f1402969700 1 -- 172.21.15.153:0/3168941122 wait complete. 2023-08-17T00:10:46.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.535+0000 7f1402969700 1 Processor -- start 2023-08-17T00:10:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.535+0000 7f1402969700 1 -- start start 2023-08-17T00:10:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0656d0 0x7f13fc168b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 0x7f13fc0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc169080 con 0x7f13fc0a8b70 2023-08-17T00:10:46.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc1588f0 con 0x7f13fc0a8f50 2023-08-17T00:10:46.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13fc158bd0 con 0x7f13fc0656d0 2023-08-17T00:10:46.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 0x7f13fc0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:46.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 0x7f13fc0abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54650/0 (socket says 172.21.15.153:54650) 2023-08-17T00:10:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 -- 172.21.15.153:0/368981223 learned_addr learned my addr 172.21.15.153:0/368981223 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13fbfff700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0656d0 0x7f13fc168b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1400f06700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:46.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 -- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0656d0 msgr2=0x7f13fc168b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0656d0 0x7f13fc168b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 -- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 msgr2=0x7f13fc159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 -- 172.21.15.153:0/368981223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e4009370 con 0x7f13fc0a8b70 2023-08-17T00:10:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f37fe700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 0x7f13fc0abe50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f13e4009130 tx=0x7f13e4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e400bea0 con 0x7f13fc0a8b70 2023-08-17T00:10:46.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e400b850 con 0x7f13fc0a8b70 2023-08-17T00:10:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13fc158eb0 con 0x7f13fc0a8b70 2023-08-17T00:10:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e401b660 con 0x7f13fc0a8b70 2023-08-17T00:10:46.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.539+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13fc159470 con 0x7f13fc0a8b70 2023-08-17T00:10:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.543+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13fc06b530 con 0x7f13fc0a8b70 2023-08-17T00:10:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.543+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f13e400f070 con 0x7f13fc0a8b70 2023-08-17T00:10:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.543+0000 7f13f8ff9700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13dc05a150 0x7f13dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:46.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.543+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f13e40755c0 con 0x7f13fc0a8b70 2023-08-17T00:10:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.543+0000 7f13fbfff700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13dc05a150 0x7f13dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:46.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.547+0000 7f13fbfff700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13dc05a150 0x7f13dc05c610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f13ec00f570 tx=0x7f13ec00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:46.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.551+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13e4048f70 con 0x7f13fc0a8b70 2023-08-17T00:10:46.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:46.747+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f13fc063380 con 0x7f13fc0a8b70 2023-08-17T00:10:47.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.331+0000 7f13f8ff9700 1 -- 172.21.15.153:0/368981223 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7f13e401f0a0 con 0x7f13fc0a8b70 2023-08-17T00:10:47.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13dc05a150 msgr2=0x7f13dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:47.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13dc05a150 0x7f13dc05c610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f13ec00f570 tx=0x7f13ec00b040).stop 2023-08-17T00:10:47.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 msgr2=0x7f13fc0abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:47.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 0x7f13fc0abe50 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f13e4009130 tx=0x7f13e4017000).stop 2023-08-17T00:10:47.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 shutdown_connections 2023-08-17T00:10:47.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13dc05a150 0x7f13dc05c610 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13fc0a8f50 0x7f13fc159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f13fc0a8b70 0x7f13fc0abe50 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 --2- 172.21.15.153:0/368981223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13fc0656d0 0x7f13fc168b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.335+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 >> 172.21.15.153:0/368981223 conn(0x7f13fc0c7150 msgr2=0x7f13fc068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:47.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.339+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 shutdown_connections 2023-08-17T00:10:47.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.339+0000 7f1402969700 1 -- 172.21.15.153:0/368981223 wait complete. 2023-08-17T00:10:47.364 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:10:47.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.575+0000 7f903e479700 1 Processor -- start 2023-08-17T00:10:47.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.575+0000 7f903e479700 1 -- start start 2023-08-17T00:10:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903e479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380a9cd0 0x7f9038153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:47.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903e479700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90381543b0 0x7f90380c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903e479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90380c60f0 con 0x7f90380c5c40 2023-08-17T00:10:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903e479700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380c6be0 con 0x7f90381543b0 2023-08-17T00:10:47.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903e479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380bfc80 con 0x7f90380a9cd0 2023-08-17T00:10:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903cc76700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90381543b0 0x7f90380c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903d477700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380a9cd0 0x7f9038153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903dc78700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f90380c5c40 0x7f90381574f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:52056/0 (socket says 172.21.15.153:52056) 2023-08-17T00:10:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903cc76700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90381543b0 0x7f90380c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:56820/0 (socket says 172.21.15.153:56820) 2023-08-17T00:10:47.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903dc78700 1 -- 172.21.15.153:0/1638747702 learned_addr learned my addr 172.21.15.153:0/1638747702 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903cc76700 1 -- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380a9cd0 msgr2=0x7f9038153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903cc76700 1 --2- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380a9cd0 0x7f9038153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903cc76700 1 -- 172.21.15.153:0/1638747702 >> v1:172.21.15.178:6789/0 conn(0x7f90380c5c40 legacy=0x7f90381574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.579+0000 7f903cc76700 1 -- 172.21.15.153:0/1638747702 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90380aa0b0 con 0x7f90381543b0 2023-08-17T00:10:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903cc76700 1 --2- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f90380c5750 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f9028009760 tx=0x7f9028009060).ready entity=mon.1 client_cookie=7bfa96cb919bc263 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f902ffff700 1 -- 172.21.15.153:0/1638747702 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800f510 con 0x7f90381543b0 2023-08-17T00:10:47.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f902ffff700 1 -- 172.21.15.153:0/1638747702 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902800f670 con 0x7f90381543b0 2023-08-17T00:10:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f902ffff700 1 -- 172.21.15.153:0/1638747702 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902800f9f0 con 0x7f90381543b0 2023-08-17T00:10:47.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 -- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 msgr2=0x7f90380c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 --2- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f90380c5750 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7f9028009760 tx=0x7f9028009060).stop 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 -- 172.21.15.153:0/1638747702 shutdown_connections 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 --2- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f90380c5750 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 --2- 172.21.15.153:0/1638747702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380a9cd0 0x7f9038153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 -- 172.21.15.153:0/1638747702 >> 172.21.15.153:0/1638747702 conn(0x7f9038062a70 msgr2=0x7f90380ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 -- 172.21.15.153:0/1638747702 shutdown_connections 2023-08-17T00:10:47.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.583+0000 7f903e479700 1 -- 172.21.15.153:0/1638747702 wait complete. 2023-08-17T00:10:47.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.587+0000 7f903e479700 1 Processor -- start 2023-08-17T00:10:47.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.587+0000 7f903e479700 1 -- start start 2023-08-17T00:10:47.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 0x7f90380c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:47.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380c5c40 0x7f90380c22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:47.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f9038167b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:47.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c3ef0 con 0x7f90380a9cd0 2023-08-17T00:10:47.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90380c27b0 con 0x7f90381543b0 2023-08-17T00:10:47.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90380ad830 con 0x7f90380c5c40 2023-08-17T00:10:47.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 0x7f90380c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:47.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 0x7f90380c3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54666/0 (socket says 172.21.15.153:54666) 2023-08-17T00:10:47.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 -- 172.21.15.153:0/3887003551 learned_addr learned my addr 172.21.15.153:0/3887003551 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:47.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903cc76700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380c5c40 0x7f90380c22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903dc78700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f9038167b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 -- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380c5c40 msgr2=0x7f90380c22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380c5c40 0x7f90380c22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 -- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 msgr2=0x7f9038167b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f9038167b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 -- 172.21.15.153:0/3887003551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280092a0 con 0x7f90380a9cd0 2023-08-17T00:10:47.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903d477700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 0x7f90380c3a00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f903400e900 tx=0x7f9034009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:47.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034012600 con 0x7f90380a9cd0 2023-08-17T00:10:47.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9034012760 con 0x7f90380a9cd0 2023-08-17T00:10:47.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90380c29c0 con 0x7f90380a9cd0 2023-08-17T00:10:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9034012ae0 con 0x7f90380a9cd0 2023-08-17T00:10:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.591+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90380c3260 con 0x7f90380a9cd0 2023-08-17T00:10:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.595+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90380c63b0 con 0x7f90380a9cd0 2023-08-17T00:10:47.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.595+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9034022070 con 0x7f90380a9cd0 2023-08-17T00:10:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.599+0000 7f902d7fa700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f901c05a150 0x7f901c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:47.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.599+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6381+0+0 (secure 0 0 0) 0x7f90340743d0 con 0x7f90380a9cd0 2023-08-17T00:10:47.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.599+0000 7f903cc76700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f901c05a150 0x7f901c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:47.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.599+0000 7f903cc76700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f901c05a150 0x7f901c05c610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f9028009760 tx=0x7f9028017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:47.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.607+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f90380c63b0 con 0x7f90380a9cd0 2023-08-17T00:10:47.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:47.771+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f90380c63b0 con 0x7f90380a9cd0 2023-08-17T00:10:48.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.351+0000 7f902d7fa700 1 -- 172.21.15.153:0/3887003551 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7f90380c63b0 con 0x7f90380a9cd0 2023-08-17T00:10:48.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f901c05a150 msgr2=0x7f901c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f901c05a150 0x7f901c05c610 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f9028009760 tx=0x7f9028017000).stop 2023-08-17T00:10:48.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 msgr2=0x7f90380c3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 0x7f90380c3a00 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7f903400e900 tx=0x7f9034009060).stop 2023-08-17T00:10:48.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 shutdown_connections 2023-08-17T00:10:48.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f901c05a150 0x7f901c05c610 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90381543b0 0x7f9038167b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90380c5c40 0x7f90380c22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 --2- 172.21.15.153:0/3887003551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90380a9cd0 0x7f90380c3a00 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 >> 172.21.15.153:0/3887003551 conn(0x7f9038062a70 msgr2=0x7f9038153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:48.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 shutdown_connections 2023-08-17T00:10:48.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.355+0000 7f903e479700 1 -- 172.21.15.153:0/3887003551 wait complete. 2023-08-17T00:10:48.366 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:10:48.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:10:48.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.551+0000 7fb42a3b9700 1 Processor -- start 2023-08-17T00:10:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.551+0000 7fb42a3b9700 1 -- start start 2023-08-17T00:10:48.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb42a3b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb4240c0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb42a3b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240bfc80 con 0x7fb4240c5750 2023-08-17T00:10:48.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb42a3b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240aa0b0 con 0x7fb4240a9cd0 2023-08-17T00:10:48.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb42a3b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240c6be0 con 0x7fb4240c5bb0 2023-08-17T00:10:48.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb4240c5750 0x7fb4240c0110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50050/0 (socket says 172.21.15.153:50050) 2023-08-17T00:10:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 -- 172.21.15.153:0/3723933144 learned_addr learned my addr 172.21.15.153:0/3723933144 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb429bb8700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb4240c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106089725 0 0) 0x7fb4240bfc80 con 0x7fb4240c5750 2023-08-17T00:10:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4100033f0 con 0x7fb4240c5750 2023-08-17T00:10:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2168893180 0 0) 0x7fb4240aa0b0 con 0x7fb4240a9cd0 2023-08-17T00:10:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4240bfc80 con 0x7fb4240a9cd0 2023-08-17T00:10:48.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2961398782 0 0) 0x7fb4100033f0 con 0x7fb4240c5750 2023-08-17T00:10:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 msgr2=0x7fb4240c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb4240c0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 >> v1:172.21.15.178:6789/0 conn(0x7fb4240a9cd0 legacy=0x7fb424153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4241549e0 con 0x7fb4240c5750 2023-08-17T00:10:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb429bb8700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb4240c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fb414001470 con 0x7fb4240c5750 2023-08-17T00:10:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 >> v1:172.21.15.153:6789/0 conn(0x7fb4240c5750 legacy=0x7fb4240c0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb410003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb410003f90 0x7fb410004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410004b80 0x7fb410005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240c6be0 con 0x7fb410003f90 2023-08-17T00:10:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41000b940 con 0x7fb410004b80 2023-08-17T00:10:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41000bb00 con 0x7fb4240c5bb0 2023-08-17T00:10:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb410003f90 0x7fb410004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb4293b7700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb410003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb429bb8700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410004b80 0x7fb410005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 -- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 msgr2=0x7fb410003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb410003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 -- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410004b80 msgr2=0x7fb410005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410004b80 0x7fb410005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb428bb6700 1 -- 172.21.15.153:0/3723933144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c009a20 con 0x7fb410003f90 2023-08-17T00:10:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.555+0000 7fb4293b7700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4240c5bb0 0x7fb410003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb428bb6700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb410003f90 0x7fb410004690 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7fb41400c190 tx=0x7fb414001e10).ready entity=mon.0 client_cookie=9f46596b8a1a8c24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41400ca00 con 0x7fb410003f90 2023-08-17T00:10:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41400cb60 con 0x7fb410003f90 2023-08-17T00:10:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb41bfff700 1 -- 172.21.15.153:0/3723933144 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140070d0 con 0x7fb410003f90 2023-08-17T00:10:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb42a3b9700 1 -- 172.21.15.153:0/3723933144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb410003f90 msgr2=0x7fb410004690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/3723933144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb410003f90 0x7fb410004690 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7fb41400c190 tx=0x7fb414001e10).stop 2023-08-17T00:10:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb429bb8700 1 -- 172.21.15.153:0/3723933144 reap_dead start 2023-08-17T00:10:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb42a3b9700 1 -- 172.21.15.153:0/3723933144 shutdown_connections 2023-08-17T00:10:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb42a3b9700 1 -- 172.21.15.153:0/3723933144 >> 172.21.15.153:0/3723933144 conn(0x7fb424062a70 msgr2=0x7fb4240ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb42a3b9700 1 -- 172.21.15.153:0/3723933144 shutdown_connections 2023-08-17T00:10:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.559+0000 7fb42a3b9700 1 -- 172.21.15.153:0/3723933144 wait complete. 2023-08-17T00:10:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 Processor -- start 2023-08-17T00:10:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 -- start start 2023-08-17T00:10:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410003f90 0x7fb4241677b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 0x7fb4240ac220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4241516c0 0x7fb4240c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4240c2b20 con 0x7fb4240ad830 2023-08-17T00:10:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424167d90 con 0x7fb410003f90 2023-08-17T00:10:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb424168070 con 0x7fb4241516c0 2023-08-17T00:10:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 0x7fb4240ac220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 0x7fb4240ac220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54678/0 (socket says 172.21.15.153:54678) 2023-08-17T00:10:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 -- 172.21.15.153:0/2180120925 learned_addr learned my addr 172.21.15.153:0/2180120925 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb4293b7700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410003f90 0x7fb4241677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb429bb8700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4241516c0 0x7fb4240c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 -- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4241516c0 msgr2=0x7fb4240c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4241516c0 0x7fb4240c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 -- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410003f90 msgr2=0x7fb4241677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410003f90 0x7fb4241677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 -- 172.21.15.153:0/2180120925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb424168350 con 0x7fb4240ad830 2023-08-17T00:10:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb428bb6700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 0x7fb4240ac220 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fb41000b910 tx=0x7fb414015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414000d00 con 0x7fb4240ad830 2023-08-17T00:10:48.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414001580 con 0x7fb4240ad830 2023-08-17T00:10:48.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb424168630 con 0x7fb4240ad830 2023-08-17T00:10:48.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.563+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140048c0 con 0x7fb4240ad830 2023-08-17T00:10:48.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.567+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb424151b40 con 0x7fb4240ad830 2023-08-17T00:10:48.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.567+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4240c2cb0 con 0x7fb4240ad830 2023-08-17T00:10:48.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.567+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb41401d070 con 0x7fb4240ad830 2023-08-17T00:10:48.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.571+0000 7fb4197fa700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb40805a150 0x7fb40805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:48.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.571+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5943+0+0 (secure 0 0 0) 0x7fb414074c60 con 0x7fb4240ad830 2023-08-17T00:10:48.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.571+0000 7fb4293b7700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb40805a150 0x7fb40805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:48.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.571+0000 7fb4293b7700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb40805a150 0x7fb40805c610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb4200010e0 tx=0x7fb420009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:48.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.575+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4140486b0 con 0x7fb4240ad830 2023-08-17T00:10:48.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:48.739+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb424046dd0 con 0x7fb4240ad830 2023-08-17T00:10:49.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.363+0000 7fb4197fa700 1 -- 172.21.15.153:0/2180120925 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb41401a020 con 0x7fb4240ad830 2023-08-17T00:10:49.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb40805a150 msgr2=0x7fb40805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb40805a150 0x7fb40805c610 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7fb4200010e0 tx=0x7fb420009040).stop 2023-08-17T00:10:49.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 msgr2=0x7fb4240ac220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 0x7fb4240ac220 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7fb41000b910 tx=0x7fb414015000).stop 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 shutdown_connections 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb40805a150 0x7fb40805c610 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4241516c0 0x7fb4240c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4240ad830 0x7fb4240ac220 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 --2- 172.21.15.153:0/2180120925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb410003f90 0x7fb4241677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 >> 172.21.15.153:0/2180120925 conn(0x7fb424062a70 msgr2=0x7fb424152000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:49.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 shutdown_connections 2023-08-17T00:10:49.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.371+0000 7fb42a3b9700 1 -- 172.21.15.153:0/2180120925 wait complete. 2023-08-17T00:10:49.380 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:10:49.406 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:10:49.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.551+0000 7fce3961b700 1 Processor -- start 2023-08-17T00:10:49.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.551+0000 7fce3961b700 1 -- start start 2023-08-17T00:10:49.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.551+0000 7fce3961b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fce340bde20 0x7fce340be290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.551+0000 7fce3961b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340be780 con 0x7fce340ad300 2023-08-17T00:10:49.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.551+0000 7fce3961b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce340ad8e0 con 0x7fce34158110 2023-08-17T00:10:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.551+0000 7fce3961b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce340abb90 con 0x7fce340bde20 2023-08-17T00:10:49.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce32ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fce34158110 0x7fce340ac670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:52068/0 (socket says 172.21.15.153:52068) 2023-08-17T00:10:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce32ffd700 1 -- 172.21.15.153:0/601782088 learned_addr learned my addr 172.21.15.153:0/601782088 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce33fff700 1 --2- 172.21.15.153:0/601782088 >> v2:172.21.15.153:3300/0 conn(0x7fce340bde20 0x7fce340be290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648874999 0 0) 0x7fce340ad8e0 con 0x7fce34158110 2023-08-17T00:10:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce1c0033f0 con 0x7fce34158110 2023-08-17T00:10:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337722350 0 0) 0x7fce340be780 con 0x7fce340ad300 2023-08-17T00:10:49.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce340ad8e0 con 0x7fce340ad300 2023-08-17T00:10:49.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce33fff700 1 -- 172.21.15.153:0/601782088 >> v1:172.21.15.178:6789/0 conn(0x7fce34158110 legacy=0x7fce340ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce33fff700 1 -- 172.21.15.153:0/601782088 >> v1:172.21.15.153:6789/0 conn(0x7fce340ad300 legacy=0x7fce34065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce33fff700 1 -- 172.21.15.153:0/601782088 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340abe70 con 0x7fce340bde20 2023-08-17T00:10:49.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce33fff700 1 --2- 172.21.15.153:0/601782088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340be290 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fce2c009760 tx=0x7fce2c009060).ready entity=mon.0 client_cookie=cfc2bb8f3447c9ef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:49.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c009120 con 0x7fce340bde20 2023-08-17T00:10:49.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c00d4a0 con 0x7fce340bde20 2023-08-17T00:10:49.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce31ffb700 1 -- 172.21.15.153:0/601782088 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00d820 con 0x7fce340bde20 2023-08-17T00:10:49.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 -- 172.21.15.153:0/601782088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 msgr2=0x7fce340be290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 --2- 172.21.15.153:0/601782088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340be290 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 rx=0x7fce2c009760 tx=0x7fce2c009060).stop 2023-08-17T00:10:49.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 -- 172.21.15.153:0/601782088 shutdown_connections 2023-08-17T00:10:49.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 --2- 172.21.15.153:0/601782088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340be290 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 -- 172.21.15.153:0/601782088 >> 172.21.15.153:0/601782088 conn(0x7fce340c4950 msgr2=0x7fce340c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:49.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 -- 172.21.15.153:0/601782088 shutdown_connections 2023-08-17T00:10:49.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.555+0000 7fce3961b700 1 -- 172.21.15.153:0/601782088 wait complete. 2023-08-17T00:10:49.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 Processor -- start 2023-08-17T00:10:49.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 -- start start 2023-08-17T00:10:49.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce340ad300 0x7fce340a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce34158110 0x7fce340a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340a6100 con 0x7fce340bde20 2023-08-17T00:10:49.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340aa750 con 0x7fce34158110 2023-08-17T00:10:49.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce3961b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340a9bd0 con 0x7fce340ad300 2023-08-17T00:10:49.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce327fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce32ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce340ad300 0x7fce340a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce327fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340a5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54700/0 (socket says 172.21.15.153:54700) 2023-08-17T00:10:49.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce327fc700 1 -- 172.21.15.153:0/1442186991 learned_addr learned my addr 172.21.15.153:0/1442186991 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:49.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.559+0000 7fce33fff700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce34158110 0x7fce340a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce327fc700 1 -- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce340ad300 msgr2=0x7fce340a91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce327fc700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce340ad300 0x7fce340a91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce327fc700 1 -- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce34158110 msgr2=0x7fce340a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce327fc700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce34158110 0x7fce340a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce327fc700 1 -- 172.21.15.153:0/1442186991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce2c0092a0 con 0x7fce340bde20 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce327fc700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340a5720 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fce2800c3a0 tx=0x7fce28007c40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce280123f0 con 0x7fce340bde20 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce28012550 con 0x7fce340bde20 2023-08-17T00:10:49.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce340a9eb0 con 0x7fce340bde20 2023-08-17T00:10:49.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce28012700 con 0x7fce340bde20 2023-08-17T00:10:49.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce340aa470 con 0x7fce340bde20 2023-08-17T00:10:49.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3406b530 con 0x7fce340bde20 2023-08-17T00:10:49.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.563+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fce28010070 con 0x7fce340bde20 2023-08-17T00:10:49.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.567+0000 7fce1affd700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce2005a150 0x7fce2005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.567+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fce28073080 con 0x7fce340bde20 2023-08-17T00:10:49.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.567+0000 7fce32ffd700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce2005a150 0x7fce2005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.567+0000 7fce32ffd700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce2005a150 0x7fce2005c610 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fce24005ad0 tx=0x7fce24009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:49.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.571+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fce280a18f0 con 0x7fce340bde20 2023-08-17T00:10:49.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.771+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fce3406ba70 con 0x7fce340bde20 2023-08-17T00:10:49.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.779+0000 7fce1affd700 1 -- 172.21.15.153:0/1442186991 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fce28046d20 con 0x7fce340bde20 2023-08-17T00:10:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce2005a150 msgr2=0x7fce2005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce2005a150 0x7fce2005c610 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fce24005ad0 tx=0x7fce24009040).stop 2023-08-17T00:10:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 msgr2=0x7fce340a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340a5720 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fce2800c3a0 tx=0x7fce28007c40).stop 2023-08-17T00:10:49.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 shutdown_connections 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce2005a150 0x7fce2005c610 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce34158110 0x7fce340a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fce340bde20 0x7fce340a5720 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 --2- 172.21.15.153:0/1442186991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce340ad300 0x7fce340a91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 >> 172.21.15.153:0/1442186991 conn(0x7fce340c4950 msgr2=0x7fce34157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 shutdown_connections 2023-08-17T00:10:49.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.783+0000 7fce3961b700 1 -- 172.21.15.153:0/1442186991 wait complete. 2023-08-17T00:10:49.810 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2023-08-17T00:10:49.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.959+0000 7f4d1cfa9700 1 Processor -- start 2023-08-17T00:10:49.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1cfa9700 1 -- start start 2023-08-17T00:10:49.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1cfa9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d18151f70 0x7f4d18065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1cfa9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d18061fa0 con 0x7f4d18065b50 2023-08-17T00:10:49.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1cfa9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d181523d0 con 0x7f4d18151b90 2023-08-17T00:10:49.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1cfa9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180c3fb0 con 0x7f4d18151f70 2023-08-17T00:10:49.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d16d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4d18065b50 0x7f4d18064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50062/0 (socket says 172.21.15.153:50062) 2023-08-17T00:10:49.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d16d9d700 1 -- 172.21.15.153:0/1622996313 learned_addr learned my addr 172.21.15.153:0/1622996313 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:49.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d15d9b700 1 --2- 172.21.15.153:0/1622996313 >> v2:172.21.15.153:3300/0 conn(0x7f4d18151f70 0x7f4d18065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405370040 0 0) 0x7f4d18061fa0 con 0x7f4d18065b50 2023-08-17T00:10:49.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d000033f0 con 0x7f4d18065b50 2023-08-17T00:10:49.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.963+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838221167 0 0) 0x7f4d181523d0 con 0x7f4d18151b90 2023-08-17T00:10:49.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d18061fa0 con 0x7f4d18151b90 2023-08-17T00:10:49.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2069118223 0 0) 0x7f4d000033f0 con 0x7f4d18065b50 2023-08-17T00:10:49.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d15d9b700 1 -- 172.21.15.153:0/1622996313 >> v1:172.21.15.178:6789/0 conn(0x7f4d18151b90 legacy=0x7f4d18063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d15d9b700 1 -- 172.21.15.153:0/1622996313 >> v1:172.21.15.153:6789/0 conn(0x7f4d18065b50 legacy=0x7f4d18064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d15d9b700 1 -- 172.21.15.153:0/1622996313 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180621f0 con 0x7f4d18151f70 2023-08-17T00:10:49.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d15d9b700 1 --2- 172.21.15.153:0/1622996313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18151f70 0x7f4d18065660 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f4d0c009760 tx=0x7f4d0c009060).ready entity=mon.0 client_cookie=fb40d41ecd4d01d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:49.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d100017f0 con 0x7f4d18151f70 2023-08-17T00:10:49.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c011400 con 0x7f4d18151f70 2023-08-17T00:10:49.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1559a700 1 -- 172.21.15.153:0/1622996313 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c011780 con 0x7f4d18151f70 2023-08-17T00:10:49.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/1622996313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18151f70 msgr2=0x7f4d18065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/1622996313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18151f70 0x7f4d18065660 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7f4d0c009760 tx=0x7f4d0c009060).stop 2023-08-17T00:10:49.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/1622996313 shutdown_connections 2023-08-17T00:10:49.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/1622996313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18151f70 0x7f4d18065660 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/1622996313 >> 172.21.15.153:0/1622996313 conn(0x7f4d180c7150 msgr2=0x7f4d180c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:49.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/1622996313 shutdown_connections 2023-08-17T00:10:49.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/1622996313 wait complete. 2023-08-17T00:10:49.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.967+0000 7f4d1cfa9700 1 Processor -- start 2023-08-17T00:10:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 -- start start 2023-08-17T00:10:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 0x7f4d180abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d18151b90 0x7f4d18145350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d18151f70 0x7f4d180aade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18152b50 con 0x7f4d18065b50 2023-08-17T00:10:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18152590 con 0x7f4d18151f70 2023-08-17T00:10:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180a82d0 con 0x7f4d18151b90 2023-08-17T00:10:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 0x7f4d180abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 0x7f4d180abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54718/0 (socket says 172.21.15.153:54718) 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 -- 172.21.15.153:0/3113127109 learned_addr learned my addr 172.21.15.153:0/3113127109 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d16d9d700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d18151f70 0x7f4d180aade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d15d9b700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d18151b90 0x7f4d18145350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 -- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d18151b90 msgr2=0x7f4d18145350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d18151b90 0x7f4d18145350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 -- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d18151f70 msgr2=0x7f4d180aade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:49.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d18151f70 0x7f4d180aade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:49.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 -- 172.21.15.153:0/3113127109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0092a0 con 0x7f4d18065b50 2023-08-17T00:10:49.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d15d9b700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d18151b90 0x7f4d18145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1659c700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 0x7f4d180abdf0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f4d0800c490 tx=0x7f4d08007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800f470 con 0x7f4d18065b50 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0800f5d0 con 0x7f4d18065b50 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d180c0180 con 0x7f4d18065b50 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800f970 con 0x7f4d18065b50 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.971+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d181527e0 con 0x7f4d18065b50 2023-08-17T00:10:49.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.975+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1806b530 con 0x7f4d18065b50 2023-08-17T00:10:49.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.975+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d08019030 con 0x7f4d18065b50 2023-08-17T00:10:49.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.975+0000 7f4d067fc700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf805a120 0x7f4cf805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:49.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.975+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4d08073450 con 0x7f4d18065b50 2023-08-17T00:10:49.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.979+0000 7f4d15d9b700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf805a120 0x7f4cf805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:49.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.979+0000 7f4d15d9b700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf805a120 0x7f4cf805c5e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f4d180a8530 tx=0x7f4d0c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:49.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:49.983+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d080470f0 con 0x7f4d18065b50 2023-08-17T00:10:50.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.199+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f4d180c3ab0 con 0x7f4d18065b50 2023-08-17T00:10:50.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.371+0000 7f4d067fc700 1 -- 172.21.15.153:0/3113127109 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v377) v1 ==== 144+0+0 (secure 0 0 0) 0x7f4d0804a710 con 0x7f4d18065b50 2023-08-17T00:10:50.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf805a120 msgr2=0x7f4cf805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:50.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf805a120 0x7f4cf805c5e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7f4d180a8530 tx=0x7f4d0c016000).stop 2023-08-17T00:10:50.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 msgr2=0x7f4d180abdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:50.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 0x7f4d180abdf0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7f4d0800c490 tx=0x7f4d08007c90).stop 2023-08-17T00:10:50.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 shutdown_connections 2023-08-17T00:10:50.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf805a120 0x7f4cf805c5e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d18151f70 0x7f4d180aade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d18151b90 0x7f4d18145350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 --2- 172.21.15.153:0/3113127109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d18065b50 0x7f4d180abdf0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 >> 172.21.15.153:0/3113127109 conn(0x7f4d180c7150 msgr2=0x7f4d18150520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 shutdown_connections 2023-08-17T00:10:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.375+0000 7f4d1cfa9700 1 -- 172.21.15.153:0/3113127109 wait complete. 2023-08-17T00:10:50.404 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-08-17T00:10:50.404 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-08-17T00:10:50.405 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2023-08-17T00:10:50.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.559+0000 7f5c9305b700 1 Processor -- start 2023-08-17T00:10:50.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.559+0000 7f5c9305b700 1 -- start start 2023-08-17T00:10:50.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c9305b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 0x7f5c8c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:50.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c9305b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c8c0641f0 0x7f5c8c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:50.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c9305b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8c0c0330 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c9305b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c8c0c0ed0 con 0x7f5c8c0641f0 2023-08-17T00:10:50.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c9305b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0c5e40 con 0x7f5c8c153ab0 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 0x7f5c8c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 0x7f5c8c153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:37338/0 (socket says 172.21.15.153:37338) 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 -- 172.21.15.153:0/143507780 learned_addr learned my addr 172.21.15.153:0/143507780 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c915f8700 1 --2- 172.21.15.153:0/143507780 >> v2:172.21.15.178:3300/0 conn(0x7f5c8c0641f0 0x7f5c8c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 -- 172.21.15.153:0/143507780 >> v2:172.21.15.178:3300/0 conn(0x7f5c8c0641f0 msgr2=0x7f5c8c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 --2- 172.21.15.153:0/143507780 >> v2:172.21.15.178:3300/0 conn(0x7f5c8c0641f0 0x7f5c8c061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 -- 172.21.15.153:0/143507780 >> v1:172.21.15.178:6789/0 conn(0x7f5c8c0c59e0 legacy=0x7f5c8c0c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:50.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 -- 172.21.15.153:0/143507780 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c0646a0 con 0x7f5c8c153ab0 2023-08-17T00:10:50.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c90df7700 1 --2- 172.21.15.153:0/143507780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 0x7f5c8c153e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5c80006fd0 tx=0x7f5c800090f0).ready entity=mon.2 client_cookie=f68fc6415806a27b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:50.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c8b7fe700 1 -- 172.21.15.153:0/143507780 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000b580 con 0x7f5c8c153ab0 2023-08-17T00:10:50.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c8b7fe700 1 -- 172.21.15.153:0/143507780 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8000b6e0 con 0x7f5c8c153ab0 2023-08-17T00:10:50.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.563+0000 7f5c8b7fe700 1 -- 172.21.15.153:0/143507780 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000ba80 con 0x7f5c8c153ab0 2023-08-17T00:10:50.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 -- 172.21.15.153:0/143507780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 msgr2=0x7f5c8c153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:50.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 --2- 172.21.15.153:0/143507780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 0x7f5c8c153e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5c80006fd0 tx=0x7f5c800090f0).stop 2023-08-17T00:10:50.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 -- 172.21.15.153:0/143507780 shutdown_connections 2023-08-17T00:10:50.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 --2- 172.21.15.153:0/143507780 >> v2:172.21.15.178:3300/0 conn(0x7f5c8c0641f0 0x7f5c8c061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 --2- 172.21.15.153:0/143507780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c153ab0 0x7f5c8c153e90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 -- 172.21.15.153:0/143507780 >> 172.21.15.153:0/143507780 conn(0x7f5c8c0caaa0 msgr2=0x7f5c8c0caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:50.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 -- 172.21.15.153:0/143507780 shutdown_connections 2023-08-17T00:10:50.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 -- 172.21.15.153:0/143507780 wait complete. 2023-08-17T00:10:50.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.567+0000 7f5c9305b700 1 Processor -- start 2023-08-17T00:10:50.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 -- start start 2023-08-17T00:10:50.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c8c0641f0 0x7f5c8c152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:50.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 0x7f5c8c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:50.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c8c153ab0 0x7f5c8c1553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:50.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0c27f0 con 0x7f5c8c0641f0 2023-08-17T00:10:50.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0c1be0 con 0x7f5c8c153ab0 2023-08-17T00:10:50.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c9305b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c0c1ec0 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c90df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c8c0641f0 0x7f5c8c152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:50.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c915f8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c8c153ab0 0x7f5c8c1553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:50.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c8bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 0x7f5c8c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:50.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c8bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 0x7f5c8c154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:37350/0 (socket says 172.21.15.153:37350) 2023-08-17T00:10:50.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c915f8700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c8c153ab0 0x7f5c8c1553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:56874/0 (socket says 172.21.15.153:56874) 2023-08-17T00:10:50.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c90df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c8c0641f0 0x7f5c8c152af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54720/0 (socket says 172.21.15.153:54720) 2023-08-17T00:10:50.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.571+0000 7f5c8bfff700 1 -- 172.21.15.153:0/3315598901 learned_addr learned my addr 172.21.15.153:0/3315598901 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:50.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c8bfff700 1 -- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c8c153ab0 msgr2=0x7f5c8c1553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:50.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c8bfff700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c8c153ab0 0x7f5c8c1553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c8bfff700 1 -- 172.21.15.153:0/3315598901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c8c0641f0 msgr2=0x7f5c8c152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:50.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c8bfff700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c8c0641f0 0x7f5c8c152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:50.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c8bfff700 1 -- 172.21.15.153:0/3315598901 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80009370 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c8bfff700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 0x7f5c8c154ee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5c7c00c4c0 tx=0x7f5c7c007dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:50.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c00ce10 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c007020 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8c0c21a0 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c7c0073c0 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8c152fe0 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.575+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c8c0c67b0 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.579+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5c7c010070 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.579+0000 7f5c88ff9700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c7805a150 0x7f5c7805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:50.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.579+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f5c7c073020 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.579+0000 7f5c90df7700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c7805a150 0x7f5c7805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:50.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.579+0000 7f5c90df7700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c7805a150 0x7f5c7805c610 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f5c8000b340 tx=0x7f5c80017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:50.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.587+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5c8c0c67b0 con 0x7f5c8c0c59e0 2023-08-17T00:10:50.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:50.815+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f5c8c0cb9c0 con 0x7f5c8c0c59e0 2023-08-17T00:10:51.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.379+0000 7f5c88ff9700 1 -- 172.21.15.153:0/3315598901 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v378) v1 ==== 158+0+0 (secure 0 0 0) 0x7f5c8c0cb9c0 con 0x7f5c8c0c59e0 2023-08-17T00:10:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c7805a150 msgr2=0x7f5c7805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c7805a150 0x7f5c7805c610 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f5c8000b340 tx=0x7f5c80017000).stop 2023-08-17T00:10:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 msgr2=0x7f5c8c154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 0x7f5c8c154ee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5c7c00c4c0 tx=0x7f5c7c007dd0).stop 2023-08-17T00:10:51.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 shutdown_connections 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c7805a150 0x7f5c7805c610 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c8c153ab0 0x7f5c8c1553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c8c0c59e0 0x7f5c8c154ee0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 --2- 172.21.15.153:0/3315598901 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c8c0641f0 0x7f5c8c152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.383+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 >> 172.21.15.153:0/3315598901 conn(0x7f5c8c0caaa0 msgr2=0x7f5c8c0aaff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.387+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 shutdown_connections 2023-08-17T00:10:51.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.387+0000 7f5c9305b700 1 -- 172.21.15.153:0/3315598901 wait complete. 2023-08-17T00:10:51.413 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:10:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d91969700 1 Processor -- start 2023-08-17T00:10:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d91969700 1 -- start start 2023-08-17T00:10:51.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d91969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:51.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d91969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c062c90 con 0x7f4d8c151a10 2023-08-17T00:10:51.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d91969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0657d0 con 0x7f4d8c151630 2023-08-17T00:10:51.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d91969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c062980 con 0x7f4d8c155b00 2023-08-17T00:10:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d8a7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4d8c151a10 0x7f4d8c1553f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50070/0 (socket says 172.21.15.153:50070) 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d8a7fc700 1 -- 172.21.15.153:0/470186506 learned_addr learned my addr 172.21.15.153:0/470186506 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.579+0000 7f4d8b7fe700 1 --2- 172.21.15.153:0/470186506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692873553 0 0) 0x7f4d8c062c90 con 0x7f4d8c151a10 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d740033f0 con 0x7f4d8c151a10 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972208928 0 0) 0x7f4d8c0657d0 con 0x7f4d8c151630 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d8c062c90 con 0x7f4d8c151630 2023-08-17T00:10:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d8b7fe700 1 -- 172.21.15.153:0/470186506 >> v1:172.21.15.178:6789/0 conn(0x7f4d8c151630 legacy=0x7f4d8c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d8b7fe700 1 -- 172.21.15.153:0/470186506 >> v1:172.21.15.153:6789/0 conn(0x7f4d8c151a10 legacy=0x7f4d8c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d8b7fe700 1 -- 172.21.15.153:0/470186506 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c065a20 con 0x7f4d8c155b00 2023-08-17T00:10:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d8b7fe700 1 --2- 172.21.15.153:0/470186506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0bbd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4d84009e90 tx=0x7f4d84009780).ready entity=mon.2 client_cookie=98f1cd2d71e60014 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400e070 con 0x7f4d8c155b00 2023-08-17T00:10:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8400bab0 con 0x7f4d8c155b00 2023-08-17T00:10:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d89ffb700 1 -- 172.21.15.153:0/470186506 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400be30 con 0x7f4d8c155b00 2023-08-17T00:10:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 -- 172.21.15.153:0/470186506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 msgr2=0x7f4d8c0bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 --2- 172.21.15.153:0/470186506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0bbd50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f4d84009e90 tx=0x7f4d84009780).stop 2023-08-17T00:10:51.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 -- 172.21.15.153:0/470186506 shutdown_connections 2023-08-17T00:10:51.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 --2- 172.21.15.153:0/470186506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0bbd50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 -- 172.21.15.153:0/470186506 >> 172.21.15.153:0/470186506 conn(0x7f4d8c0c2fb0 msgr2=0x7f4d8c0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:51.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 -- 172.21.15.153:0/470186506 shutdown_connections 2023-08-17T00:10:51.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.583+0000 7f4d91969700 1 -- 172.21.15.153:0/470186506 wait complete. 2023-08-17T00:10:51.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 Processor -- start 2023-08-17T00:10:51.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 -- start start 2023-08-17T00:10:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d8c151630 0x7f4d8c14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 0x7f4d8c0a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0a4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0a5210 con 0x7f4d8c151a10 2023-08-17T00:10:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c167d20 con 0x7f4d8c151630 2023-08-17T00:10:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d91969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c167150 con 0x7f4d8c155b00 2023-08-17T00:10:51.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d8a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 0x7f4d8c0a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:51.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d8a7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 0x7f4d8c0a4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54722/0 (socket says 172.21.15.153:54722) 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d8a7fc700 1 -- 172.21.15.153:0/3296425495 learned_addr learned my addr 172.21.15.153:0/3296425495 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d8affd700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d8c151630 0x7f4d8c14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.587+0000 7f4d8b7fe700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0a4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d8a7fc700 1 -- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 msgr2=0x7f4d8c0a4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d8a7fc700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0a4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d8a7fc700 1 -- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d8c151630 msgr2=0x7f4d8c14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d8a7fc700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d8c151630 0x7f4d8c14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d8a7fc700 1 -- 172.21.15.153:0/3296425495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009a20 con 0x7f4d8c151a10 2023-08-17T00:10:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d8a7fc700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 0x7f4d8c0a4830 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f4d8000c560 tx=0x7f4d80007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8000ce70 con 0x7f4d8c151a10 2023-08-17T00:10:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d800072e0 con 0x7f4d8c151a10 2023-08-17T00:10:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c1673f0 con 0x7f4d8c151a10 2023-08-17T00:10:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d80007660 con 0x7f4d8c151a10 2023-08-17T00:10:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c1679b0 con 0x7f4d8c151a10 2023-08-17T00:10:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.591+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c167ed0 con 0x7f4d8c151a10 2023-08-17T00:10:51.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.595+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d80010070 con 0x7f4d8c151a10 2023-08-17T00:10:51.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.595+0000 7f4d72ffd700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d7805a180 0x7f4d7805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.595+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f4d80073320 con 0x7f4d8c151a10 2023-08-17T00:10:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.595+0000 7f4d8affd700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d7805a180 0x7f4d7805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:51.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.595+0000 7f4d8affd700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d7805a180 0x7f4d7805c640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f4d7c003930 tx=0x7f4d7c007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:51.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.599+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d8c167ed0 con 0x7f4d8c151a10 2023-08-17T00:10:51.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.763+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4d8c06b4c0 con 0x7f4d8c151a10 2023-08-17T00:10:51.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.771+0000 7f4d72ffd700 1 -- 172.21.15.153:0/3296425495 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4d80046fc0 con 0x7f4d8c151a10 2023-08-17T00:10:51.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.771+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d7805a180 msgr2=0x7f4d7805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.771+0000 7f4d91969700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d7805a180 0x7f4d7805c640 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f4d7c003930 tx=0x7f4d7c007bd0).stop 2023-08-17T00:10:51.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.771+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 msgr2=0x7f4d8c0a4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:51.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.771+0000 7f4d91969700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 0x7f4d8c0a4830 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7f4d8000c560 tx=0x7f4d80007d00).stop 2023-08-17T00:10:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 shutdown_connections 2023-08-17T00:10:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d7805a180 0x7f4d7805c640 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d8c155b00 0x7f4d8c0a4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d8c151a10 0x7f4d8c0a4830 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 --2- 172.21.15.153:0/3296425495 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d8c151630 0x7f4d8c14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:51.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 >> 172.21.15.153:0/3296425495 conn(0x7f4d8c0c2fb0 msgr2=0x7f4d8c0646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:51.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 shutdown_connections 2023-08-17T00:10:51.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:51.775+0000 7f4d91969700 1 -- 172.21.15.153:0/3296425495 wait complete. 2023-08-17T00:10:51.803 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:10:51.804 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:10:51.845 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:10:51.893 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:10:51.894 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:10:51.895 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:10:52.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.051+0000 7f9c92107700 1 Processor -- start 2023-08-17T00:10:52.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.051+0000 7f9c92107700 1 -- start start 2023-08-17T00:10:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c92107700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c8c063bc0 0x7f9c8c15e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c92107700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c154e90 con 0x7f9c8c0c5ea0 2023-08-17T00:10:52.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c92107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8c153fc0 con 0x7f9c8c0acf30 2023-08-17T00:10:52.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c92107700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c0c1730 con 0x7f9c8c063bc0 2023-08-17T00:10:52.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c90904700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c8c0c5ea0 0x7f9c8c0634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50074/0 (socket says 172.21.15.153:50074) 2023-08-17T00:10:52.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c90904700 1 -- 172.21.15.153:0/451605298 learned_addr learned my addr 172.21.15.153:0/451605298 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c91906700 1 --2- 172.21.15.153:0/451605298 >> v2:172.21.15.178:3300/0 conn(0x7f9c8c063bc0 0x7f9c8c15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177758362 0 0) 0x7f9c8c154e90 con 0x7f9c8c0c5ea0 2023-08-17T00:10:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c780033f0 con 0x7f9c8c0c5ea0 2023-08-17T00:10:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273693186 0 0) 0x7f9c8c153fc0 con 0x7f9c8c0acf30 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c8c154e90 con 0x7f9c8c0acf30 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3439424530 0 0) 0x7f9c780033f0 con 0x7f9c8c0c5ea0 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 >> v2:172.21.15.178:3300/0 conn(0x7f9c8c063bc0 msgr2=0x7f9c8c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 --2- 172.21.15.153:0/451605298 >> v2:172.21.15.178:3300/0 conn(0x7f9c8c063bc0 0x7f9c8c15e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 >> v1:172.21.15.178:6789/0 conn(0x7f9c8c0acf30 legacy=0x7f9c8c0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c154280 con 0x7f9c8c0c5ea0 2023-08-17T00:10:52.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f9c7c001470 con 0x7f9c8c0c5ea0 2023-08-17T00:10:52.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 >> v1:172.21.15.153:6789/0 conn(0x7f9c8c0c5ea0 legacy=0x7f9c8c0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c78003a70 0x7f9c78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c78004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c78005000 0x7f9c7800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.055+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0c1730 con 0x7f9c78004690 2023-08-17T00:10:52.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7800bf60 con 0x7f9c78005000 2023-08-17T00:10:52.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7800c0d0 con 0x7f9c78003a70 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c78004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c91105700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c78003a70 0x7f9c78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c91906700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c78005000 0x7f9c7800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 -- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c78003a70 msgr2=0x7f9c78003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c78003a70 0x7f9c78003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 -- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c78005000 msgr2=0x7f9c7800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:52.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c78005000 0x7f9c7800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 -- 172.21.15.153:0/451605298 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780033f0 con 0x7f9c78004690 2023-08-17T00:10:52.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c91906700 1 -- 172.21.15.153:0/451605298 reap_dead start 2023-08-17T00:10:52.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c90904700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c78004b10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f9c7c00c190 tx=0x7f9c7c001e10).ready entity=mon.0 client_cookie=fd0810c444f04fd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:52.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00ca00 con 0x7f9c78004690 2023-08-17T00:10:52.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00cb60 con 0x7f9c78004690 2023-08-17T00:10:52.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c83fff700 1 -- 172.21.15.153:0/451605298 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0070d0 con 0x7f9c78004690 2023-08-17T00:10:52.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 -- 172.21.15.153:0/451605298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 msgr2=0x7f9c78004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c78004b10 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 rx=0x7f9c7c00c190 tx=0x7f9c7c001e10).stop 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 -- 172.21.15.153:0/451605298 shutdown_connections 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 --2- 172.21.15.153:0/451605298 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c78004b10 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 -- 172.21.15.153:0/451605298 >> 172.21.15.153:0/451605298 conn(0x7f9c8c0cb330 msgr2=0x7f9c8c0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 -- 172.21.15.153:0/451605298 shutdown_connections 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.059+0000 7f9c92107700 1 -- 172.21.15.153:0/451605298 wait complete. 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 Processor -- start 2023-08-17T00:10:52.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 -- start start 2023-08-17T00:10:52.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c8c0ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c8c0ada50 0x7f9c8c149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c8c1550f0 0x7f9c8c155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0aed60 con 0x7f9c78004690 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c155a60 con 0x7f9c8c1550f0 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c92107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0aded0 con 0x7f9c8c0ada50 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c91105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c8c0ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c91105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c8c0ca250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54748/0 (socket says 172.21.15.153:54748) 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c91105700 1 -- 172.21.15.153:0/1980511177 learned_addr learned my addr 172.21.15.153:0/1980511177 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c91906700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c8c1550f0 0x7f9c8c155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c90904700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c8c0ada50 0x7f9c8c149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.063+0000 7f9c91105700 1 -- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c8c0ada50 msgr2=0x7f9c8c149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c91105700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c8c0ada50 0x7f9c8c149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c91105700 1 -- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c8c1550f0 msgr2=0x7f9c8c155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c91105700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c8c1550f0 0x7f9c8c155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c91105700 1 -- 172.21.15.153:0/1980511177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c0af1f0 con 0x7f9c78004690 2023-08-17T00:10:52.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c91906700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c8c1550f0 0x7f9c8c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:52.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c91105700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c8c0ca250 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f9c88002a50 tx=0x7f9c88007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800f6c0 con 0x7f9c78004690 2023-08-17T00:10:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8800f820 con 0x7f9c78004690 2023-08-17T00:10:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c0ae150 con 0x7f9c78004690 2023-08-17T00:10:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8800fbc0 con 0x7f9c78004690 2023-08-17T00:10:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c0ae710 con 0x7f9c78004690 2023-08-17T00:10:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c06b4c0 con 0x7f9c78004690 2023-08-17T00:10:52.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.067+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9c8801b030 con 0x7f9c78004690 2023-08-17T00:10:52.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.071+0000 7f9c817fa700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7005a120 0x7f9c7005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.071+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f9c88073cc0 con 0x7f9c78004690 2023-08-17T00:10:52.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.071+0000 7f9c90904700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7005a120 0x7f9c7005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.071+0000 7f9c90904700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7005a120 0x7f9c7005c5e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f9c7c001e70 tx=0x7f9c7c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:52.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.075+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c8807a080 con 0x7f9c78004690 2023-08-17T00:10:52.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.271+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c8c154560 con 0x7f9c78004690 2023-08-17T00:10:52.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.271+0000 7f9c817fa700 1 -- 172.21.15.153:0/1980511177 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f9c88047960 con 0x7f9c78004690 2023-08-17T00:10:52.279 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:52.279 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6143,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2113786568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2113786568},{"type":"v1","addr":"172.21.15.178:6835","nonce":2113786568}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":6146,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1863292429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1863292429},{"type":"v1","addr":"172.21.15.178:6837","nonce":1863292429}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3350590055","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3350590055},{"type":"v1","addr":"172.21.15.153:6834","nonce":3350590055}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7404,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3004499709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3004499709},{"type":"v1","addr":"172.21.15.153:6835","nonce":3004499709}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-08-17T00:10:52.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7005a120 msgr2=0x7f9c7005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7005a120 0x7f9c7005c5e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f9c7c001e70 tx=0x7f9c7c015000).stop 2023-08-17T00:10:52.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 msgr2=0x7f9c8c0ca250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c8c0ca250 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7f9c88002a50 tx=0x7f9c88007bb0).stop 2023-08-17T00:10:52.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 shutdown_connections 2023-08-17T00:10:52.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7005a120 0x7f9c7005c5e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c8c1550f0 0x7f9c8c155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c8c0ada50 0x7f9c8c149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 --2- 172.21.15.153:0/1980511177 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c78004690 0x7f9c8c0ca250 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 >> 172.21.15.153:0/1980511177 conn(0x7f9c8c0cb330 msgr2=0x7f9c8c0aa8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:52.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 shutdown_connections 2023-08-17T00:10:52.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.275+0000 7f9c92107700 1 -- 172.21.15.153:0/1980511177 wait complete. 2023-08-17T00:10:52.283 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 87 2023-08-17T00:10:52.303 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:10:52.304 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:10:52.304 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:10:52.304 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:10:52.305 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:10:52.305 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:10:52.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:10:52.305 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:10:52.305 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:10:52.306 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:10:52.306 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:10:52.306 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:10:52.306 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:10:52.306 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:10:52.307 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:10:52.307 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:10:52.324 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:10:52.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:10:52.325 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:10:52.325 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:10:52.326 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:10:52.327 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:10:52.328 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:10:52.328 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:10:52.377 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:10:52.377 DEBUG:teuthology.parallel:result is None 2023-08-17T00:10:52.380 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:10:52.381 DEBUG:teuthology.parallel:result is None 2023-08-17T00:10:52.381 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:10:52.382 DEBUG:teuthology.parallel:result is None 2023-08-17T00:10:52.386 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:10:52.386 DEBUG:teuthology.parallel:result is None 2023-08-17T00:10:52.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:10:52.482 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:10:52.483 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:10:52.493 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:10:52.494 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:10:52.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.531+0000 7fe98b507700 1 Processor -- start 2023-08-17T00:10:52.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.531+0000 7fe98b507700 1 -- start start 2023-08-17T00:10:52.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe98b507700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9840c57a0 0x7fe9840c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe98b507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe984153f50 0x7fe984154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe98b507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9840bfd10 con 0x7fe984157600 2023-08-17T00:10:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe98b507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984154860 con 0x7fe984153f50 2023-08-17T00:10:52.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe98b507700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe984154af0 con 0x7fe9840c57a0 2023-08-17T00:10:52.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe989d04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe984153f50 0x7fe984154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe989d04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe984153f50 0x7fe984154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54772/0 (socket says 172.21.15.153:54772) 2023-08-17T00:10:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe989d04700 1 -- 172.21.15.153:0/3873509363 learned_addr learned my addr 172.21.15.153:0/3873509363 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.535+0000 7fe98a505700 1 --2- 172.21.15.153:0/3873509363 >> v2:172.21.15.178:3300/0 conn(0x7fe9840c57a0 0x7fe9840c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989d04700 1 -- 172.21.15.153:0/3873509363 >> v2:172.21.15.178:3300/0 conn(0x7fe9840c57a0 msgr2=0x7fe9840c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:52.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989d04700 1 --2- 172.21.15.153:0/3873509363 >> v2:172.21.15.178:3300/0 conn(0x7fe9840c57a0 0x7fe9840c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989d04700 1 -- 172.21.15.153:0/3873509363 >> v1:172.21.15.178:6789/0 conn(0x7fe984157600 legacy=0x7fe984157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989d04700 1 -- 172.21.15.153:0/3873509363 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe984154dd0 con 0x7fe984153f50 2023-08-17T00:10:52.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989d04700 1 --2- 172.21.15.153:0/3873509363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984153f50 0x7fe984154370 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fe9840c54c0 tx=0x7fe9740090f0).ready entity=mon.0 client_cookie=886ee2802df7507d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989503700 1 -- 172.21.15.153:0/3873509363 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400b600 con 0x7fe984153f50 2023-08-17T00:10:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989503700 1 -- 172.21.15.153:0/3873509363 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400b760 con 0x7fe984153f50 2023-08-17T00:10:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe989503700 1 -- 172.21.15.153:0/3873509363 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400bae0 con 0x7fe984153f50 2023-08-17T00:10:52.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 -- 172.21.15.153:0/3873509363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984153f50 msgr2=0x7fe984154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 --2- 172.21.15.153:0/3873509363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984153f50 0x7fe984154370 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7fe9840c54c0 tx=0x7fe9740090f0).stop 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 -- 172.21.15.153:0/3873509363 shutdown_connections 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 --2- 172.21.15.153:0/3873509363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984153f50 0x7fe984154370 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 --2- 172.21.15.153:0/3873509363 >> v2:172.21.15.178:3300/0 conn(0x7fe9840c57a0 0x7fe9840c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 -- 172.21.15.153:0/3873509363 >> 172.21.15.153:0/3873509363 conn(0x7fe984062a70 msgr2=0x7fe9840ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 -- 172.21.15.153:0/3873509363 shutdown_connections 2023-08-17T00:10:52.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.539+0000 7fe98b507700 1 -- 172.21.15.153:0/3873509363 wait complete. 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 Processor -- start 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 -- start start 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9840c57a0 0x7fe98414ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe984153f50 0x7fe98414fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 0x7fe984155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe984167a60 con 0x7fe984157600 2023-08-17T00:10:52.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9841688c0 con 0x7fe984153f50 2023-08-17T00:10:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98b507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe984167cb0 con 0x7fe9840c57a0 2023-08-17T00:10:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 0x7fe984155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 0x7fe984155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54780/0 (socket says 172.21.15.153:54780) 2023-08-17T00:10:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 -- 172.21.15.153:0/1977860544 learned_addr learned my addr 172.21.15.153:0/1977860544 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98a505700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9840c57a0 0x7fe98414ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe989d04700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe984153f50 0x7fe98414fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 -- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9840c57a0 msgr2=0x7fe98414ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9840c57a0 0x7fe98414ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 -- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe984153f50 msgr2=0x7fe98414fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:52.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe984153f50 0x7fe98414fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:52.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.543+0000 7fe98ad06700 1 -- 172.21.15.153:0/1977860544 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974009370 con 0x7fe984157600 2023-08-17T00:10:52.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe98ad06700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 0x7fe984155fe0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fe97c00c790 tx=0x7fe97c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:52.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00e4a0 con 0x7fe984157600 2023-08-17T00:10:52.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97c00e600 con 0x7fe984157600 2023-08-17T00:10:52.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe984167f90 con 0x7fe984157600 2023-08-17T00:10:52.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97c00e980 con 0x7fe984157600 2023-08-17T00:10:52.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe984168550 con 0x7fe984157600 2023-08-17T00:10:52.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.547+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe984168a00 con 0x7fe984157600 2023-08-17T00:10:52.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.551+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe97c019030 con 0x7fe984157600 2023-08-17T00:10:52.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.551+0000 7fe97a7fc700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe96805a150 0x7fe96805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:52.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.551+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe97c073400 con 0x7fe984157600 2023-08-17T00:10:52.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.551+0000 7fe98a505700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe96805a150 0x7fe96805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:52.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.551+0000 7fe98a505700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe96805a150 0x7fe96805c610 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fe98000bb10 tx=0x7fe980008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:52.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.559+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe984168a00 con 0x7fe984157600 2023-08-17T00:10:52.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:52.731+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe984168a00 con 0x7fe984157600 2023-08-17T00:10:53.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.531+0000 7fe97a7fc700 1 -- 172.21.15.153:0/1977860544 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe984168a00 con 0x7fe984157600 2023-08-17T00:10:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe96805a150 msgr2=0x7fe96805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe96805a150 0x7fe96805c610 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fe98000bb10 tx=0x7fe980008040).stop 2023-08-17T00:10:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 msgr2=0x7fe984155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 0x7fe984155fe0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 rx=0x7fe97c00c790 tx=0x7fe97c0015e0).stop 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 shutdown_connections 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe96805a150 0x7fe96805c610 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe984157600 0x7fe984155fe0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe984153f50 0x7fe98414fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 --2- 172.21.15.153:0/1977860544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe9840c57a0 0x7fe98414ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 >> 172.21.15.153:0/1977860544 conn(0x7fe984062a70 msgr2=0x7fe9840ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 shutdown_connections 2023-08-17T00:10:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.535+0000 7fe98b507700 1 -- 172.21.15.153:0/1977860544 wait complete. 2023-08-17T00:10:53.545 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:10:53.565 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:10:53.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.719+0000 7fc4b3379700 1 Processor -- start 2023-08-17T00:10:53.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.719+0000 7fc4b3379700 1 -- start start 2023-08-17T00:10:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b3379700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4ac069250 0x7fc4ac069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b3379700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4ac0c1190 0x7fc4ac153db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b3379700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac154ae0 con 0x7fc4ac065d90 2023-08-17T00:10:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b3379700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac064fd0 con 0x7fc4ac069250 2023-08-17T00:10:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b3379700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac0652b0 con 0x7fc4ac0c1190 2023-08-17T00:10:53.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4ac069250 0x7fc4ac069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:53.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4ac069250 0x7fc4ac069630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54788/0 (socket says 172.21.15.153:54788) 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 -- 172.21.15.153:0/3443113860 learned_addr learned my addr 172.21.15.153:0/3443113860 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b1b76700 1 --1- 172.21.15.153:0/3443113860 >> v1:172.21.15.153:6789/0 conn(0x7fc4ac065d90 0x7fc4ac0c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50094/0 (socket says 172.21.15.153:50094) 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2b78700 1 --2- 172.21.15.153:0/3443113860 >> v2:172.21.15.178:3300/0 conn(0x7fc4ac0c1190 0x7fc4ac153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 -- 172.21.15.153:0/3443113860 >> v2:172.21.15.178:3300/0 conn(0x7fc4ac0c1190 msgr2=0x7fc4ac153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 --2- 172.21.15.153:0/3443113860 >> v2:172.21.15.178:3300/0 conn(0x7fc4ac0c1190 0x7fc4ac153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 -- 172.21.15.153:0/3443113860 >> v1:172.21.15.153:6789/0 conn(0x7fc4ac065d90 legacy=0x7fc4ac0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:53.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 -- 172.21.15.153:0/3443113860 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac065590 con 0x7fc4ac069250 2023-08-17T00:10:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.723+0000 7fc4b2377700 1 --2- 172.21.15.153:0/3443113860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac069250 0x7fc4ac069630 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fc4ac0b9f80 tx=0x7fc4a8009060).ready entity=mon.0 client_cookie=7cfa1c8b9ce9ace9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b1375700 1 -- 172.21.15.153:0/3443113860 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8005880 con 0x7fc4ac069250 2023-08-17T00:10:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b1375700 1 -- 172.21.15.153:0/3443113860 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a80059e0 con 0x7fc4ac069250 2023-08-17T00:10:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b1375700 1 -- 172.21.15.153:0/3443113860 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8005d60 con 0x7fc4ac069250 2023-08-17T00:10:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 -- 172.21.15.153:0/3443113860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac069250 msgr2=0x7fc4ac069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 --2- 172.21.15.153:0/3443113860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac069250 0x7fc4ac069630 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fc4ac0b9f80 tx=0x7fc4a8009060).stop 2023-08-17T00:10:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 -- 172.21.15.153:0/3443113860 shutdown_connections 2023-08-17T00:10:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 --2- 172.21.15.153:0/3443113860 >> v2:172.21.15.178:3300/0 conn(0x7fc4ac0c1190 0x7fc4ac153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 --2- 172.21.15.153:0/3443113860 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac069250 0x7fc4ac069630 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 -- 172.21.15.153:0/3443113860 >> 172.21.15.153:0/3443113860 conn(0x7fc4ac0c6620 msgr2=0x7fc4ac0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 -- 172.21.15.153:0/3443113860 shutdown_connections 2023-08-17T00:10:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.727+0000 7fc4b3379700 1 -- 172.21.15.153:0/3443113860 wait complete. 2023-08-17T00:10:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 Processor -- start 2023-08-17T00:10:53.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 -- start start 2023-08-17T00:10:53.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4ac065d90 0x7fc4ac14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:53.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4ac069250 0x7fc4ac14cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:53.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 0x7fc4ac0bd730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:53.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac14d010 con 0x7fc4ac0c1190 2023-08-17T00:10:53.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac14d9c0 con 0x7fc4ac065d90 2023-08-17T00:10:53.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac14dc80 con 0x7fc4ac069250 2023-08-17T00:10:53.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 0x7fc4ac0bd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:53.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 0x7fc4ac0bd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54802/0 (socket says 172.21.15.153:54802) 2023-08-17T00:10:53.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 -- 172.21.15.153:0/69554164 learned_addr learned my addr 172.21.15.153:0/69554164 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2377700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4ac065d90 0x7fc4ac14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b1b76700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4ac069250 0x7fc4ac14cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 -- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4ac069250 msgr2=0x7fc4ac14cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4ac069250 0x7fc4ac14cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 -- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4ac065d90 msgr2=0x7fc4ac14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4ac065d90 0x7fc4ac14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:53.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 -- 172.21.15.153:0/69554164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a8009300 con 0x7fc4ac0c1190 2023-08-17T00:10:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b2b78700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 0x7fc4ac0bd730 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fc4a4009fa0 tx=0x7fc4a4009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400ed20 con 0x7fc4ac0c1190 2023-08-17T00:10:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400ee80 con 0x7fc4ac0c1190 2023-08-17T00:10:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac14df60 con 0x7fc4ac0c1190 2023-08-17T00:10:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.731+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4014610 con 0x7fc4ac0c1190 2023-08-17T00:10:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.735+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac14e520 con 0x7fc4ac0c1190 2023-08-17T00:10:53.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.735+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac14e740 con 0x7fc4ac0c1190 2023-08-17T00:10:53.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.735+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc4a401b030 con 0x7fc4ac0c1190 2023-08-17T00:10:53.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.739+0000 7fc4a27fc700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc49005a150 0x7fc49005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:53.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.739+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc4a4074380 con 0x7fc4ac0c1190 2023-08-17T00:10:53.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.739+0000 7fc4b2377700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc49005a150 0x7fc49005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:53.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.739+0000 7fc4b2377700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc49005a150 0x7fc49005c610 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fc4a8005fd0 tx=0x7fc4a8018000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:53.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.743+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4a4048010 con 0x7fc4ac0c1190 2023-08-17T00:10:53.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.963+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc4ac064d10 con 0x7fc4ac0c1190 2023-08-17T00:10:53.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.963+0000 7fc4a27fc700 1 -- 172.21.15.153:0/69554164 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc4a404b630 con 0x7fc4ac0c1190 2023-08-17T00:10:53.970 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:53.970 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:10:53.970 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:10:53.971 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.971 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:10:53.971 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:10:53.971 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.972 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:53.972 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:10:53.972 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:10:53.972 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.973 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.973 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.973 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.973 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:10:53.974 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:10:53.974 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.974 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:53.974 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:10:53.975 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:10:53.975 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.975 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.975 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.976 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.977 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:10:53.977 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:10:53.977 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.977 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:53.978 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:10:53.978 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:10:53.978 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.978 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.978 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.979 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.979 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:10:53.979 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:10:53.979 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.979 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:53.980 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:10:53.980 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:10:53.980 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.981 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.981 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.982 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.982 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:10:53.983 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:10:53.983 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.983 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.983 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.984 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.984 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.984 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.985 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.985 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:10:53.985 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:10:53.985 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.986 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.986 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.986 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.986 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.987 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.987 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.987 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:10:53.987 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:10:53.988 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.988 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.988 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.988 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.989 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.989 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.989 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.989 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:10:53.989 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:10:53.990 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.990 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.990 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.990 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.991 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.991 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.991 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.991 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:10:53.992 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:10:53.992 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.992 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.993 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.993 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.993 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.993 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.994 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.994 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:10:53.994 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:10:53.995 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.995 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.995 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.995 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.996 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.996 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.996 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.997 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:10:53.997 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:10:53.997 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:53.997 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:53.998 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:53.998 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:53.998 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:53.999 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:53.999 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:53.999 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:10:53.999 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:10:54.000 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.000 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:10:54.000 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:10:54.001 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:54.001 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.001 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.001 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.001 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.002 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:10:54.003 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:10:54.004 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.004 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.004 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.004 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:10:54.004 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.005 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.006 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.006 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:10:54.006 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:10:54.006 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.006 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:10:54.006 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:10:54.007 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:10:54.007 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:10:54.007 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.007 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.007 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.007 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:10:54.008 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:10:54.008 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:10:54.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:10:54.008 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:10:54.008 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:54.009 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.009 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.009 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.009 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:10:54.009 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:10:54.009 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:10:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:10:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:54.010 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:10:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:10:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:10:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:10:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:10:54.011 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:10:54.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.012 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:54.012 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:10:54.012 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:10:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.963+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc49005a150 msgr2=0x7fc49005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.963+0000 7fc4b3379700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc49005a150 0x7fc49005c610 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fc4a8005fd0 tx=0x7fc4a8018000).stop 2023-08-17T00:10:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.963+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 msgr2=0x7fc4ac0bd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.963+0000 7fc4b3379700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 0x7fc4ac0bd730 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 rx=0x7fc4a4009fa0 tx=0x7fc4a4009900).stop 2023-08-17T00:10:54.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 shutdown_connections 2023-08-17T00:10:54.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc49005a150 0x7fc49005c610 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4ac0c1190 0x7fc4ac0bd730 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4ac069250 0x7fc4ac14cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 --2- 172.21.15.153:0/69554164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4ac065d90 0x7fc4ac14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 >> 172.21.15.153:0/69554164 conn(0x7fc4ac0c6620 msgr2=0x7fc4ac0c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:54.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 shutdown_connections 2023-08-17T00:10:54.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:53.967+0000 7fc4b3379700 1 -- 172.21.15.153:0/69554164 wait complete. 2023-08-17T00:10:54.017 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:10:54.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.167+0000 7f945a9b9700 1 Processor -- start 2023-08-17T00:10:54.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.167+0000 7f945a9b9700 1 -- start start 2023-08-17T00:10:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a9b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9454068820 0x7f9454068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a9b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94540a96d0 0x7f94540a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a9b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94541585a0 con 0x7f94540a8df0 2023-08-17T00:10:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a9b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94540c1ba0 con 0x7f94540a96d0 2023-08-17T00:10:54.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a9b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9454066400 con 0x7f9454068820 2023-08-17T00:10:54.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a1b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94540a96d0 0x7f94540a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f94591b6700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9454068820 0x7f9454068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f94599b7700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f94540a8df0 0x7f94540c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:52116/0 (socket says 172.21.15.153:52116) 2023-08-17T00:10:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f945a1b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f94540a96d0 0x7f94540a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54806/0 (socket says 172.21.15.153:54806) 2023-08-17T00:10:54.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f94599b7700 1 -- 172.21.15.153:0/615224044 learned_addr learned my addr 172.21.15.153:0/615224044 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.171+0000 7f94589b5700 1 -- 172.21.15.153:0/615224044 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581546181 0 0) 0x7f94541585a0 con 0x7f94540a8df0 2023-08-17T00:10:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a1b8700 1 -- 172.21.15.153:0/615224044 >> v2:172.21.15.178:3300/0 conn(0x7f9454068820 msgr2=0x7f9454068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a1b8700 1 --2- 172.21.15.153:0/615224044 >> v2:172.21.15.178:3300/0 conn(0x7f9454068820 0x7f9454068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a1b8700 1 -- 172.21.15.153:0/615224044 >> v1:172.21.15.178:6789/0 conn(0x7f94540a8df0 legacy=0x7f94540c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a1b8700 1 -- 172.21.15.153:0/615224044 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9454069170 con 0x7f94540a96d0 2023-08-17T00:10:54.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a1b8700 1 --2- 172.21.15.153:0/615224044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f94540a9b60 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f94540c2ef0 tx=0x7f944c009780).ready entity=mon.0 client_cookie=66c70b711065d355 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f94589b5700 1 -- 172.21.15.153:0/615224044 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c00e070 con 0x7f94540a96d0 2023-08-17T00:10:54.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f94589b5700 1 -- 172.21.15.153:0/615224044 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c00bb60 con 0x7f94540a96d0 2023-08-17T00:10:54.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f94589b5700 1 -- 172.21.15.153:0/615224044 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c012410 con 0x7f94540a96d0 2023-08-17T00:10:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 -- 172.21.15.153:0/615224044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 msgr2=0x7f94540a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 --2- 172.21.15.153:0/615224044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f94540a9b60 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 rx=0x7f94540c2ef0 tx=0x7f944c009780).stop 2023-08-17T00:10:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 -- 172.21.15.153:0/615224044 shutdown_connections 2023-08-17T00:10:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 --2- 172.21.15.153:0/615224044 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f94540a9b60 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 --2- 172.21.15.153:0/615224044 >> v2:172.21.15.178:3300/0 conn(0x7f9454068820 0x7f9454068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 -- 172.21.15.153:0/615224044 >> 172.21.15.153:0/615224044 conn(0x7f94540c6620 msgr2=0x7f94540c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 -- 172.21.15.153:0/615224044 shutdown_connections 2023-08-17T00:10:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.175+0000 7f945a9b9700 1 -- 172.21.15.153:0/615224044 wait complete. 2023-08-17T00:10:54.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 Processor -- start 2023-08-17T00:10:54.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 -- start start 2023-08-17T00:10:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9454068820 0x7f94540ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94540a8df0 0x7f9454167e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f945414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540ab640 con 0x7f94540a96d0 2023-08-17T00:10:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94540ba1c0 con 0x7f94540a8df0 2023-08-17T00:10:54.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a9b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9454168380 con 0x7f9454068820 2023-08-17T00:10:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f945414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f945414ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54814/0 (socket says 172.21.15.153:54814) 2023-08-17T00:10:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 -- 172.21.15.153:0/3649678624 learned_addr learned my addr 172.21.15.153:0/3649678624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f94599b7700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9454068820 0x7f94540ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f94591b6700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94540a8df0 0x7f9454167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 -- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9454068820 msgr2=0x7f94540ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9454068820 0x7f94540ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 -- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94540a8df0 msgr2=0x7f9454167e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94540a8df0 0x7f9454167e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f945a1b8700 1 -- 172.21.15.153:0/3649678624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f944c009a20 con 0x7f94540a96d0 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.179+0000 7f94591b6700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94540a8df0 0x7f9454167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:54.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f945a1b8700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f945414ca50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f944c00b6c0 tx=0x7f944c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c01d630 con 0x7f94540a96d0 2023-08-17T00:10:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944c01d790 con 0x7f94540a96d0 2023-08-17T00:10:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9454168630 con 0x7f94540a96d0 2023-08-17T00:10:54.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944c01db10 con 0x7f94540a96d0 2023-08-17T00:10:54.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9454168bf0 con 0x7f94540a96d0 2023-08-17T00:10:54.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9454168e10 con 0x7f94540a96d0 2023-08-17T00:10:54.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.183+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f944c026410 con 0x7f94540a96d0 2023-08-17T00:10:54.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.187+0000 7f9449ffb700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f943805a150 0x7f943805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.187+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f944c075f70 con 0x7f94540a96d0 2023-08-17T00:10:54.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.187+0000 7f94599b7700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f943805a150 0x7f943805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.187+0000 7f94599b7700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f943805a150 0x7f943805c610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f945000c770 tx=0x7f9450009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.191+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f944c049c80 con 0x7f94540a96d0 2023-08-17T00:10:54.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.351+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f945406b4c0 con 0x7f94540a96d0 2023-08-17T00:10:54.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.351+0000 7f9449ffb700 1 -- 172.21.15.153:0/3649678624 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+13762 (secure 0 0 0) 0x7f944c04d2a0 con 0x7f94540a96d0 2023-08-17T00:10:54.360 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:54.360 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":108,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:53.525844+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:10:54.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f943805a150 msgr2=0x7f943805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f943805a150 0x7f943805c610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f945000c770 tx=0x7f9450009040).stop 2023-08-17T00:10:54.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 msgr2=0x7f945414ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f945414ca50 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 rx=0x7f944c00b6c0 tx=0x7f944c009780).stop 2023-08-17T00:10:54.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 shutdown_connections 2023-08-17T00:10:54.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f943805a150 0x7f943805c610 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f94540a96d0 0x7f945414ca50 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94540a8df0 0x7f9454167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 --2- 172.21.15.153:0/3649678624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9454068820 0x7f94540ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 >> 172.21.15.153:0/3649678624 conn(0x7f94540c6620 msgr2=0x7f9454157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:54.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 shutdown_connections 2023-08-17T00:10:54.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.355+0000 7f945a9b9700 1 -- 172.21.15.153:0/3649678624 wait complete. 2023-08-17T00:10:54.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:10:54.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:10:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.535+0000 7fc40759e700 1 Processor -- start 2023-08-17T00:10:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.535+0000 7fc40759e700 1 -- start start 2023-08-17T00:10:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc408068da0 0x7fc4081560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc408065da0 con 0x7fc408151530 2023-08-17T00:10:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc408155c60 con 0x7fc4080689c0 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc408069200 con 0x7fc408068da0 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc406d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc408151530 0x7fc4081519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50104/0 (socket says 172.21.15.153:50104) 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc406d9d700 1 -- 172.21.15.153:0/3380753267 learned_addr learned my addr 172.21.15.153:0/3380753267 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc3fdd9b700 1 --2- 172.21.15.153:0/3380753267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc408068da0 0x7fc4081560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc405d9b700 1 -- 172.21.15.153:0/3380753267 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304875163 0 0) 0x7fc408065da0 con 0x7fc408151530 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc405d9b700 1 -- 172.21.15.153:0/3380753267 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3f40033f0 con 0x7fc408151530 2023-08-17T00:10:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/3380753267 >> v1:172.21.15.178:6789/0 conn(0x7fc4080689c0 legacy=0x7fc4080c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc405d9b700 1 -- 172.21.15.153:0/3380753267 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003934395 0 0) 0x7fc408155c60 con 0x7fc4080689c0 2023-08-17T00:10:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/3380753267 >> v1:172.21.15.153:6789/0 conn(0x7fc408151530 legacy=0x7fc4081519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/3380753267 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc408065ff0 con 0x7fc408068da0 2023-08-17T00:10:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc3fdd9b700 1 --2- 172.21.15.153:0/3380753267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc408068da0 0x7fc4081560f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc3f0009e90 tx=0x7fc3f0009780).ready entity=mon.2 client_cookie=8e5edbcbb1e708e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc405d9b700 1 -- 172.21.15.153:0/3380753267 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000e070 con 0x7fc408068da0 2023-08-17T00:10:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc405d9b700 1 -- 172.21.15.153:0/3380753267 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f000bb60 con 0x7fc408068da0 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc405d9b700 1 -- 172.21.15.153:0/3380753267 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000bee0 con 0x7fc408068da0 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- 172.21.15.153:0/3380753267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc408068da0 msgr2=0x7fc4081560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 --2- 172.21.15.153:0/3380753267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc408068da0 0x7fc4081560f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7fc3f0009e90 tx=0x7fc3f0009780).stop 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- 172.21.15.153:0/3380753267 shutdown_connections 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 --2- 172.21.15.153:0/3380753267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc408068da0 0x7fc4081560f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- 172.21.15.153:0/3380753267 >> 172.21.15.153:0/3380753267 conn(0x7fc4080c6620 msgr2=0x7fc4080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.539+0000 7fc40759e700 1 -- 172.21.15.153:0/3380753267 shutdown_connections 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 -- 172.21.15.153:0/3380753267 wait complete. 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 Processor -- start 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 -- start start 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4080689c0 0x7fc4081534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 0x7fc4080bb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc408151530 0x7fc408150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080bbe20 con 0x7fc408068da0 2023-08-17T00:10:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080bc0e0 con 0x7fc408151530 2023-08-17T00:10:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080bc3c0 con 0x7fc4080689c0 2023-08-17T00:10:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc3fdd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 0x7fc4080bb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc3fdd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 0x7fc4080bb930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54824/0 (socket says 172.21.15.153:54824) 2023-08-17T00:10:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/37351128 learned_addr learned my addr 172.21.15.153:0/37351128 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc40659c700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4080689c0 0x7fc4081534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4080689c0 msgr2=0x7fc4081534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc3fdd9b700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4080689c0 0x7fc4081534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.543+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc408151530 msgr2=0x7fc408150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc406d9d700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc408151530 0x7fc408150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3fdd9b700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc408151530 0x7fc408150b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3fdd9b700 1 -- 172.21.15.153:0/37351128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0009a20 con 0x7fc408068da0 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc40659c700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4080689c0 0x7fc4081534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc406d9d700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc408151530 0x7fc408150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3fdd9b700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 0x7fc4080bb930 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fc3f000b6c0 tx=0x7fc3f0009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f000bea0 con 0x7fc408068da0 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f001d630 con 0x7fc408068da0 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4080bc6a0 con 0x7fc408068da0 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f001d9d0 con 0x7fc408068da0 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc408151010 con 0x7fc408068da0 2023-08-17T00:10:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4080bc8b0 con 0x7fc408068da0 2023-08-17T00:10:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.547+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc3f001dd40 con 0x7fc408068da0 2023-08-17T00:10:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.551+0000 7fc3feffd700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3e805a150 0x7fc3e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.551+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc3f0075eb0 con 0x7fc408068da0 2023-08-17T00:10:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.551+0000 7fc40659c700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3e805a150 0x7fc3e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.551+0000 7fc40659c700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3e805a150 0x7fc3e805c610 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fc3f80016e0 tx=0x7fc3f8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.555+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3f0049cb0 con 0x7fc408068da0 2023-08-17T00:10:54.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.715+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc40806b4c0 con 0x7fc408068da0 2023-08-17T00:10:54.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc3feffd700 1 -- 172.21.15.153:0/37351128 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v108) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc3f004d2d0 con 0x7fc408068da0 2023-08-17T00:10:54.724 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:10:54.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3e805a150 msgr2=0x7fc3e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3e805a150 0x7fc3e805c610 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fc3f80016e0 tx=0x7fc3f8009040).stop 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 msgr2=0x7fc4080bb930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 0x7fc4080bb930 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7fc3f000b6c0 tx=0x7fc3f0009780).stop 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 shutdown_connections 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3e805a150 0x7fc3e805c610 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc408151530 0x7fc408150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc408068da0 0x7fc4080bb930 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 --2- 172.21.15.153:0/37351128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4080689c0 0x7fc4081534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 >> 172.21.15.153:0/37351128 conn(0x7fc4080c6620 msgr2=0x7fc4080c4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:54.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 shutdown_connections 2023-08-17T00:10:54.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.719+0000 7fc40759e700 1 -- 172.21.15.153:0/37351128 wait complete. 2023-08-17T00:10:54.746 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:10:54.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f37fff700 1 Processor -- start 2023-08-17T00:10:54.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f37fff700 1 -- start start 2023-08-17T00:10:54.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f380c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f37fff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f380bfd10 con 0x7f2f380c57a0 2023-08-17T00:10:54.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f37fff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f38154af0 con 0x7f2f38153f50 2023-08-17T00:10:54.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f37fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38154dd0 con 0x7f2f38154370 2023-08-17T00:10:54.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.899+0000 7f2f36ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2f380c57a0 0x7f2f380c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50114/0 (socket says 172.21.15.153:50114) 2023-08-17T00:10:54.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f36ffd700 1 -- 172.21.15.153:0/13321177 learned_addr learned my addr 172.21.15.153:0/13321177 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:54.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f377fe700 1 --2- 172.21.15.153:0/13321177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f380c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168485599 0 0) 0x7f2f380bfd10 con 0x7f2f380c57a0 2023-08-17T00:10:54.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f200033f0 con 0x7f2f380c57a0 2023-08-17T00:10:54.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887182724 0 0) 0x7f2f38154af0 con 0x7f2f38153f50 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f380bfd10 con 0x7f2f38153f50 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f377fe700 1 -- 172.21.15.153:0/13321177 >> v1:172.21.15.178:6789/0 conn(0x7f2f38153f50 legacy=0x7f2f380c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f377fe700 1 -- 172.21.15.153:0/13321177 >> v1:172.21.15.153:6789/0 conn(0x7f2f380c57a0 legacy=0x7f2f380c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f377fe700 1 -- 172.21.15.153:0/13321177 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380bf9a0 con 0x7f2f38154370 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f377fe700 1 --2- 172.21.15.153:0/13321177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f380c08b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2f30009e90 tx=0x7f2f30009780).ready entity=mon.2 client_cookie=c9d0c481aaea716f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000e070 con 0x7f2f38154370 2023-08-17T00:10:54.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3000ba70 con 0x7f2f38154370 2023-08-17T00:10:54.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f35ffb700 1 -- 172.21.15.153:0/13321177 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000bdf0 con 0x7f2f38154370 2023-08-17T00:10:54.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 -- 172.21.15.153:0/13321177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 msgr2=0x7f2f380c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 --2- 172.21.15.153:0/13321177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f380c08b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f2f30009e90 tx=0x7f2f30009780).stop 2023-08-17T00:10:54.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 -- 172.21.15.153:0/13321177 shutdown_connections 2023-08-17T00:10:54.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 --2- 172.21.15.153:0/13321177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f380c08b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 -- 172.21.15.153:0/13321177 >> 172.21.15.153:0/13321177 conn(0x7f2f38062a70 msgr2=0x7f2f380ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:54.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 -- 172.21.15.153:0/13321177 shutdown_connections 2023-08-17T00:10:54.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.903+0000 7f2f37fff700 1 -- 172.21.15.153:0/13321177 wait complete. 2023-08-17T00:10:54.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 Processor -- start 2023-08-17T00:10:54.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 -- start start 2023-08-17T00:10:54.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f380c57a0 0x7f2f380c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 0x7f2f3813e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f3813ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380c2910 con 0x7f2f38153f50 2023-08-17T00:10:54.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3813f1c0 con 0x7f2f380c57a0 2023-08-17T00:10:54.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f37fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380c2e90 con 0x7f2f38154370 2023-08-17T00:10:54.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 0x7f2f3813e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 0x7f2f3813e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54840/0 (socket says 172.21.15.153:54840) 2023-08-17T00:10:54.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 -- 172.21.15.153:0/3743911060 learned_addr learned my addr 172.21.15.153:0/3743911060 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:54.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f377fe700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f3813ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f36ffd700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f380c57a0 0x7f2f380c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 -- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 msgr2=0x7f2f3813ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f3813ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 -- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f380c57a0 msgr2=0x7f2f380c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f380c57a0 0x7f2f380c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 -- 172.21.15.153:0/3743911060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30009a20 con 0x7f2f38153f50 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f36ffd700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f380c57a0 0x7f2f380c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.907+0000 7f2f367fc700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 0x7f2f3813e7e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f2f2c00c4e0 tx=0x7f2f2c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c00f470 con 0x7f2f38153f50 2023-08-17T00:10:54.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c00f5f0 con 0x7f2f38153f50 2023-08-17T00:10:54.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c00f9b0 con 0x7f2f38153f50 2023-08-17T00:10:54.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380ca140 con 0x7f2f38153f50 2023-08-17T00:10:54.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f380c2b20 con 0x7f2f38153f50 2023-08-17T00:10:54.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380c3000 con 0x7f2f38153f50 2023-08-17T00:10:54.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2f2c019030 con 0x7f2f38153f50 2023-08-17T00:10:54.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f1effd700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f2405a150 0x7f2f2405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:54.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.911+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2f2c0732e0 con 0x7f2f38153f50 2023-08-17T00:10:54.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.915+0000 7f2f36ffd700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f2405a150 0x7f2f2405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:54.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.915+0000 7f2f36ffd700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f2405a150 0x7f2f2405c610 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f2f28007fd0 tx=0x7f2f28009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:54.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:54.919+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2f2c0470e0 con 0x7f2f38153f50 2023-08-17T00:10:55.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.079+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f3806b4c0 con 0x7f2f38153f50 2023-08-17T00:10:55.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.079+0000 7f2f1effd700 1 -- 172.21.15.153:0/3743911060 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v108) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f2c04a700 con 0x7f2f38153f50 2023-08-17T00:10:55.086 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:10:55.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f2405a150 msgr2=0x7f2f2405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f2405a150 0x7f2f2405c610 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f2f28007fd0 tx=0x7f2f28009040).stop 2023-08-17T00:10:55.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 msgr2=0x7f2f3813e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 0x7f2f3813e7e0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f2f2c00c4e0 tx=0x7f2f2c007c70).stop 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 shutdown_connections 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2f2405a150 0x7f2f2405c610 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38154370 0x7f2f3813ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2f38153f50 0x7f2f3813e7e0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 --2- 172.21.15.153:0/3743911060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f380c57a0 0x7f2f380c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 >> 172.21.15.153:0/3743911060 conn(0x7f2f38062a70 msgr2=0x7f2f380ab570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:55.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 shutdown_connections 2023-08-17T00:10:55.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.083+0000 7f2f37fff700 1 -- 172.21.15.153:0/3743911060 wait complete. 2023-08-17T00:10:55.111 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:10:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.259+0000 7fb694c5b700 1 Processor -- start 2023-08-17T00:10:55.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.259+0000 7fb694c5b700 1 -- start start 2023-08-17T00:10:55.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb694c5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb690153e90 0x7fb6900c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb694c5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb6900641f0 0x7fb690061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb694c5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900c0330 con 0x7fb690153ab0 2023-08-17T00:10:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb694c5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6901542f0 con 0x7fb690153e90 2023-08-17T00:10:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb694c5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900c0ed0 con 0x7fb6900641f0 2023-08-17T00:10:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb68dd9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb690153e90 0x7fb6900c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb68dd9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb690153e90 0x7fb6900c59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39458/0 (socket says 172.21.15.153:39458) 2023-08-17T00:10:55.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.263+0000 7fb68dd9b700 1 -- 172.21.15.153:0/990373371 learned_addr learned my addr 172.21.15.153:0/990373371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:55.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68ed9d700 1 --2- 172.21.15.153:0/990373371 >> v2:172.21.15.178:3300/0 conn(0x7fb6900641f0 0x7fb690061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68dd9b700 1 -- 172.21.15.153:0/990373371 >> v2:172.21.15.178:3300/0 conn(0x7fb6900641f0 msgr2=0x7fb690061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:55.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68dd9b700 1 --2- 172.21.15.153:0/990373371 >> v2:172.21.15.178:3300/0 conn(0x7fb6900641f0 0x7fb690061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68dd9b700 1 -- 172.21.15.153:0/990373371 >> v1:172.21.15.178:6789/0 conn(0x7fb690153ab0 legacy=0x7fb6900c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68dd9b700 1 -- 172.21.15.153:0/990373371 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690064660 con 0x7fb690153e90 2023-08-17T00:10:55.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68dd9b700 1 --2- 172.21.15.153:0/990373371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153e90 0x7fb6900c59e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fb69006c0c0 tx=0x7fb6840090f0).ready entity=mon.0 client_cookie=cb641997840b4d69 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:55.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68d59a700 1 -- 172.21.15.153:0/990373371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400b600 con 0x7fb690153e90 2023-08-17T00:10:55.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68d59a700 1 -- 172.21.15.153:0/990373371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400b760 con 0x7fb690153e90 2023-08-17T00:10:55.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb68d59a700 1 -- 172.21.15.153:0/990373371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400bb00 con 0x7fb690153e90 2023-08-17T00:10:55.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 -- 172.21.15.153:0/990373371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153e90 msgr2=0x7fb6900c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 --2- 172.21.15.153:0/990373371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153e90 0x7fb6900c59e0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fb69006c0c0 tx=0x7fb6840090f0).stop 2023-08-17T00:10:55.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 -- 172.21.15.153:0/990373371 shutdown_connections 2023-08-17T00:10:55.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 --2- 172.21.15.153:0/990373371 >> v2:172.21.15.178:3300/0 conn(0x7fb6900641f0 0x7fb690061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 --2- 172.21.15.153:0/990373371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153e90 0x7fb6900c59e0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 -- 172.21.15.153:0/990373371 >> 172.21.15.153:0/990373371 conn(0x7fb6900caaa0 msgr2=0x7fb6900caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:55.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 -- 172.21.15.153:0/990373371 shutdown_connections 2023-08-17T00:10:55.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.267+0000 7fb694c5b700 1 -- 172.21.15.153:0/990373371 wait complete. 2023-08-17T00:10:55.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 Processor -- start 2023-08-17T00:10:55.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 -- start start 2023-08-17T00:10:55.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6900641f0 0x7fb690155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 0x7fb69014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb690153e90 0x7fb6900c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900c2cc0 con 0x7fb690153ab0 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb690152660 con 0x7fb690153e90 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb694c5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900c2f10 con 0x7fb6900641f0 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 0x7fb69014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 0x7fb69014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39472/0 (socket says 172.21.15.153:39472) 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 -- 172.21.15.153:0/2036401331 learned_addr learned my addr 172.21.15.153:0/2036401331 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68e59c700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6900641f0 0x7fb690155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68ed9d700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb690153e90 0x7fb6900c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 -- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6900641f0 msgr2=0x7fb690155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6900641f0 0x7fb690155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 -- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb690153e90 msgr2=0x7fb6900c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb690153e90 0x7fb6900c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.271+0000 7fb68dd9b700 1 -- 172.21.15.153:0/2036401331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684009370 con 0x7fb690153ab0 2023-08-17T00:10:55.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb68dd9b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 0x7fb69014e6d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fb69006a1f0 tx=0x7fb684017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:55.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684006d90 con 0x7fb690153ab0 2023-08-17T00:10:55.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68400bec0 con 0x7fb690153ab0 2023-08-17T00:10:55.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6900c31f0 con 0x7fb690153ab0 2023-08-17T00:10:55.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68400b8d0 con 0x7fb690153ab0 2023-08-17T00:10:55.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb690156070 con 0x7fb690153ab0 2023-08-17T00:10:55.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.275+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69006b530 con 0x7fb690153ab0 2023-08-17T00:10:55.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.279+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb68402c070 con 0x7fb690153ab0 2023-08-17T00:10:55.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.279+0000 7fb67e7fc700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb67005a180 0x7fb67005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.279+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb684075550 con 0x7fb690153ab0 2023-08-17T00:10:55.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.279+0000 7fb68e59c700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb67005a180 0x7fb67005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.279+0000 7fb68e59c700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb67005a180 0x7fb67005c640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fb680003900 tx=0x7fb680007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:55.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.287+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb684049350 con 0x7fb690153ab0 2023-08-17T00:10:55.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.455+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb6900b0a80 con 0x7fb690153ab0 2023-08-17T00:10:55.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.455+0000 7fb67e7fc700 1 -- 172.21.15.153:0/2036401331 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb68402a030 con 0x7fb690153ab0 2023-08-17T00:10:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:55.462 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:10:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:55.462 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:10:55.463 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:10:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb67005a180 msgr2=0x7fb67005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb67005a180 0x7fb67005c640 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7fb680003900 tx=0x7fb680007d40).stop 2023-08-17T00:10:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 msgr2=0x7fb69014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 0x7fb69014e6d0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7fb69006a1f0 tx=0x7fb684017000).stop 2023-08-17T00:10:55.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 shutdown_connections 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb67005a180 0x7fb67005c640 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb690153e90 0x7fb6900c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb690153ab0 0x7fb69014e6d0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 --2- 172.21.15.153:0/2036401331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6900641f0 0x7fb690155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 >> 172.21.15.153:0/2036401331 conn(0x7fb6900caaa0 msgr2=0x7fb690152a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 shutdown_connections 2023-08-17T00:10:55.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.459+0000 7fb694c5b700 1 -- 172.21.15.153:0/2036401331 wait complete. 2023-08-17T00:10:55.484 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:10:55.484 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:10:55.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.639+0000 7f3dfe546700 1 Processor -- start 2023-08-17T00:10:55.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.643+0000 7f3dfe546700 1 -- start start 2023-08-17T00:10:55.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.643+0000 7f3dfe546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df8063290 0x7f3df814bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.643+0000 7f3dfe546700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df80c2d50 con 0x7f3df80652f0 2023-08-17T00:10:55.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.643+0000 7f3dfe546700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df81521f0 con 0x7f3df80c1c70 2023-08-17T00:10:55.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.643+0000 7f3dfe546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8152e10 con 0x7f3df8063290 2023-08-17T00:10:55.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3df80652f0 0x7f3df80c1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46846/0 (socket says 172.21.15.153:46846) 2023-08-17T00:10:55.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df7fff700 1 -- 172.21.15.153:0/2392671174 learned_addr learned my addr 172.21.15.153:0/2392671174 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:55.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfcae3700 1 --2- 172.21.15.153:0/2392671174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df8063290 0x7f3df814bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965311083 0 0) 0x7f3df80c2d50 con 0x7f3df80652f0 2023-08-17T00:10:55.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de40033f0 con 0x7f3df80652f0 2023-08-17T00:10:55.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346361701 0 0) 0x7f3df81521f0 con 0x7f3df80c1c70 2023-08-17T00:10:55.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df80c2d50 con 0x7f3df80c1c70 2023-08-17T00:10:55.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfcae3700 1 -- 172.21.15.153:0/2392671174 >> v1:172.21.15.178:6789/0 conn(0x7f3df80c1c70 legacy=0x7f3df814b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfcae3700 1 -- 172.21.15.153:0/2392671174 >> v1:172.21.15.153:6789/0 conn(0x7f3df80652f0 legacy=0x7f3df80c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfcae3700 1 -- 172.21.15.153:0/2392671174 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df80c2140 con 0x7f3df8063290 2023-08-17T00:10:55.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfcae3700 1 --2- 172.21.15.153:0/2392671174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df8063290 0x7f3df814bf70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3df0009790 tx=0x7f3df0009060).ready entity=mon.2 client_cookie=bf83412c064d6e00 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:55.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00090d0 con 0x7f3df8063290 2023-08-17T00:10:55.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000f510 con 0x7f3df8063290 2023-08-17T00:10:55.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3df77fe700 1 -- 172.21.15.153:0/2392671174 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000f890 con 0x7f3df8063290 2023-08-17T00:10:55.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 -- 172.21.15.153:0/2392671174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df8063290 msgr2=0x7f3df814bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 --2- 172.21.15.153:0/2392671174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df8063290 0x7f3df814bf70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f3df0009790 tx=0x7f3df0009060).stop 2023-08-17T00:10:55.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 -- 172.21.15.153:0/2392671174 shutdown_connections 2023-08-17T00:10:55.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 --2- 172.21.15.153:0/2392671174 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df8063290 0x7f3df814bf70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 -- 172.21.15.153:0/2392671174 >> 172.21.15.153:0/2392671174 conn(0x7f3df80c7090 msgr2=0x7f3df80c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:55.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 -- 172.21.15.153:0/2392671174 shutdown_connections 2023-08-17T00:10:55.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.647+0000 7f3dfe546700 1 -- 172.21.15.153:0/2392671174 wait complete. 2023-08-17T00:10:55.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.651+0000 7f3dfe546700 1 Processor -- start 2023-08-17T00:10:55.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.651+0000 7f3dfe546700 1 -- start start 2023-08-17T00:10:55.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3df8063290 0x7f3df80abdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df80652f0 0x7f3df81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 0x7f3df81517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8166d20 con 0x7f3df80c1c70 2023-08-17T00:10:55.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8166f70 con 0x7f3df8063290 2023-08-17T00:10:55.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df8167250 con 0x7f3df80652f0 2023-08-17T00:10:55.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 0x7f3df81517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 0x7f3df81517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39480/0 (socket says 172.21.15.153:39480) 2023-08-17T00:10:55.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 -- 172.21.15.153:0/3885678269 learned_addr learned my addr 172.21.15.153:0/3885678269 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:55.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3df7fff700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3df8063290 0x7f3df80abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3def7fe700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df80652f0 0x7f3df81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 -- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df80652f0 msgr2=0x7f3df81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df80652f0 0x7f3df81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 -- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3df8063290 msgr2=0x7f3df80abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:55.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3df8063290 0x7f3df80abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:55.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 -- 172.21.15.153:0/3885678269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00092a0 con 0x7f3df80c1c70 2023-08-17T00:10:55.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfcae3700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 0x7f3df81517e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f3df0011000 tx=0x7f3df0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:55.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000fc50 con 0x7f3df80c1c70 2023-08-17T00:10:55.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000fdb0 con 0x7f3df80c1c70 2023-08-17T00:10:55.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df8167530 con 0x7f3df80c1c70 2023-08-17T00:10:55.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df001b660 con 0x7f3df80c1c70 2023-08-17T00:10:55.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.655+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df8167af0 con 0x7f3df80c1c70 2023-08-17T00:10:55.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.659+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df806b530 con 0x7f3df80c1c70 2023-08-17T00:10:55.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.659+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3df000f070 con 0x7f3df80c1c70 2023-08-17T00:10:55.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.663+0000 7f3df4ff9700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3dd805a150 0x7f3dd805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:55.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.663+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3df0075720 con 0x7f3df80c1c70 2023-08-17T00:10:55.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.663+0000 7f3df7fff700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3dd805a150 0x7f3dd805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:55.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.663+0000 7f3df7fff700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3dd805a150 0x7f3dd805c610 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f3de8005750 tx=0x7f3de8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:55.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.667+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3df00494c0 con 0x7f3df80c1c70 2023-08-17T00:10:55.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:55.827+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f3df80c2420 con 0x7f3df80c1c70 2023-08-17T00:10:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.423+0000 7f3df4ff9700 1 -- 172.21.15.153:0/3885678269 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v109) v1 ==== 152+0+0 (secure 0 0 0) 0x7f3df004cae0 con 0x7f3df80c1c70 2023-08-17T00:10:56.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3dd805a150 msgr2=0x7f3dd805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3dd805a150 0x7f3dd805c610 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f3de8005750 tx=0x7f3de8009040).stop 2023-08-17T00:10:56.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 msgr2=0x7f3df81517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 0x7f3df81517e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 rx=0x7f3df0011000 tx=0x7f3df0017000).stop 2023-08-17T00:10:56.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 shutdown_connections 2023-08-17T00:10:56.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3dd805a150 0x7f3dd805c610 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3df80c1c70 0x7f3df81517e0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3df80652f0 0x7f3df81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 --2- 172.21.15.153:0/3885678269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3df8063290 0x7f3df80abdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 >> 172.21.15.153:0/3885678269 conn(0x7f3df80c7090 msgr2=0x7f3df8150490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:56.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 shutdown_connections 2023-08-17T00:10:56.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.431+0000 7f3dfe546700 1 -- 172.21.15.153:0/3885678269 wait complete. 2023-08-17T00:10:56.441 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:10:56.459 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:10:56.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.615+0000 7f4fd705b700 1 Processor -- start 2023-08-17T00:10:56.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.615+0000 7f4fd705b700 1 -- start start 2023-08-17T00:10:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fd705b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4fd00c7ba0 0x7f4fd015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fd705b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd00aa750 con 0x7f4fd0153e90 2023-08-17T00:10:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fd705b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd01542f0 con 0x7f4fd0153ab0 2023-08-17T00:10:56.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fd705b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd00c9dd0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fcffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4fd0153e90 0x7f4fd00c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46862/0 (socket says 172.21.15.153:46862) 2023-08-17T00:10:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fcffff700 1 -- 172.21.15.153:0/3056523958 learned_addr learned my addr 172.21.15.153:0/3056523958 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:10:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.619+0000 7f4fd55f8700 1 --2- 172.21.15.153:0/3056523958 >> v2:172.21.15.153:3300/0 conn(0x7f4fd00c7ba0 0x7f4fd015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd55f8700 1 -- 172.21.15.153:0/3056523958 >> v1:172.21.15.178:6789/0 conn(0x7f4fd0153ab0 legacy=0x7f4fd00c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd55f8700 1 -- 172.21.15.153:0/3056523958 >> v1:172.21.15.153:6789/0 conn(0x7f4fd0153e90 legacy=0x7f4fd00c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd55f8700 1 -- 172.21.15.153:0/3056523958 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd00aacf0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd55f8700 1 --2- 172.21.15.153:0/3056523958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd015e9a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f4fc8009de0 tx=0x7f4fc8009780).ready entity=mon.0 client_cookie=11a3dfa8f4d27599 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:56.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fcf7fe700 1 -- 172.21.15.153:0/3056523958 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800e070 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fcf7fe700 1 -- 172.21.15.153:0/3056523958 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc800bae0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fcf7fe700 1 -- 172.21.15.153:0/3056523958 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc800be60 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 -- 172.21.15.153:0/3056523958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 msgr2=0x7f4fd015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 --2- 172.21.15.153:0/3056523958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd015e9a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 rx=0x7f4fc8009de0 tx=0x7f4fc8009780).stop 2023-08-17T00:10:56.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 -- 172.21.15.153:0/3056523958 shutdown_connections 2023-08-17T00:10:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 --2- 172.21.15.153:0/3056523958 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd015e9a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 -- 172.21.15.153:0/3056523958 >> 172.21.15.153:0/3056523958 conn(0x7f4fd0061fa0 msgr2=0x7f4fd00623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 -- 172.21.15.153:0/3056523958 shutdown_connections 2023-08-17T00:10:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 -- 172.21.15.153:0/3056523958 wait complete. 2023-08-17T00:10:56.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.623+0000 7f4fd705b700 1 Processor -- start 2023-08-17T00:10:56.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 -- start start 2023-08-17T00:10:56.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd0149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:56.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd0153ab0 0x7f4fd014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:56.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd0153e90 0x7f4fd0148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:56.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd014a7c0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd014bef0 con 0x7f4fd0153ab0 2023-08-17T00:10:56.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd705b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd014c1d0 con 0x7f4fd0153e90 2023-08-17T00:10:56.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd0149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fcffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd0153ab0 0x7f4fd014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd55f8700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd0153e90 0x7f4fd0148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:56.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd0149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39494/0 (socket says 172.21.15.153:39494) 2023-08-17T00:10:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 -- 172.21.15.153:0/1080084853 learned_addr learned my addr 172.21.15.153:0/1080084853 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 -- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd0153e90 msgr2=0x7f4fd0148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd0153e90 0x7f4fd0148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 -- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd0153ab0 msgr2=0x7f4fd014ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:56.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd0153ab0 0x7f4fd014ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 -- 172.21.15.153:0/1080084853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc8009a20 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd55f8700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd0153e90 0x7f4fd0148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fcffff700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd0153ab0 0x7f4fd014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:56.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fd4df7700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd0149fe0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f4fc400c810 tx=0x7f4fc4007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f470 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.627+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400f5f0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.631+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd014c4b0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.631+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400f9b0 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.631+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd014c840 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.631+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd006b530 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.631+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4fc4010070 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.635+0000 7f4fccff9700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4fb405a180 0x7f4fb405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.635+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f4fc4073650 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.635+0000 7f4fcffff700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4fb405a180 0x7f4fb405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:56.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.635+0000 7f4fcffff700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4fb405a180 0x7f4fb405c640 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f4fd0151be0 tx=0x7f4fbc007d90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:56.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.639+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4fc4047250 con 0x7f4fd00c7ba0 2023-08-17T00:10:56.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:56.803+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4fd00ad4a0 con 0x7f4fd00c7ba0 2023-08-17T00:10:57.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.435+0000 7f4fccff9700 1 -- 172.21.15.153:0/1080084853 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v110) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4fc404a870 con 0x7f4fd00c7ba0 2023-08-17T00:10:57.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.455+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4fb405a180 msgr2=0x7f4fb405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.455+0000 7f4fd705b700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4fb405a180 0x7f4fb405c640 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f4fd0151be0 tx=0x7f4fbc007d90).stop 2023-08-17T00:10:57.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.455+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 msgr2=0x7f4fd0149fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.455+0000 7f4fd705b700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd0149fe0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 rx=0x7f4fc400c810 tx=0x7f4fc4007db0).stop 2023-08-17T00:10:57.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.463+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 shutdown_connections 2023-08-17T00:10:57.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.463+0000 7f4fd705b700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4fb405a180 0x7f4fb405c640 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.463+0000 7f4fd705b700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fd0153e90 0x7f4fd0148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.463+0000 7f4fd705b700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fd0153ab0 0x7f4fd014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.463+0000 7f4fd705b700 1 --2- 172.21.15.153:0/1080084853 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fd00c7ba0 0x7f4fd0149fe0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.463+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 >> 172.21.15.153:0/1080084853 conn(0x7f4fd0061fa0 msgr2=0x7f4fd00a9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:57.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.467+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 shutdown_connections 2023-08-17T00:10:57.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.467+0000 7f4fd705b700 1 -- 172.21.15.153:0/1080084853 wait complete. 2023-08-17T00:10:57.478 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:10:57.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:10:57.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.647+0000 7fc3e9707700 1 Processor -- start 2023-08-17T00:10:57.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.647+0000 7fc3e9707700 1 -- start start 2023-08-17T00:10:57.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e9707700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc3e40c57a0 0x7fc3e40c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e9707700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3e4153f50 0x7fc3e4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e9707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e4157600 0x7fc3e4157a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e9707700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e40bfd10 con 0x7fc3e4153f50 2023-08-17T00:10:57.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e9707700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e4154860 con 0x7fc3e40c57a0 2023-08-17T00:10:57.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e9707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e4154af0 con 0x7fc3e4157600 2023-08-17T00:10:57.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3e4153f50 0x7fc3e4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3e4153f50 0x7fc3e4154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39506/0 (socket says 172.21.15.153:39506) 2023-08-17T00:10:57.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 -- 172.21.15.153:0/543765160 learned_addr learned my addr 172.21.15.153:0/543765160 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:57.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e8f06700 1 --2- 172.21.15.153:0/543765160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e4157600 0x7fc3e4157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e3fff700 1 --2- 172.21.15.153:0/543765160 >> v2:172.21.15.178:3300/0 conn(0x7fc3e40c57a0 0x7fc3e40c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 -- 172.21.15.153:0/543765160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e4157600 msgr2=0x7fc3e4157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:57.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 --2- 172.21.15.153:0/543765160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e4157600 0x7fc3e4157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 -- 172.21.15.153:0/543765160 >> v2:172.21.15.178:3300/0 conn(0x7fc3e40c57a0 msgr2=0x7fc3e40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:57.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 --2- 172.21.15.153:0/543765160 >> v2:172.21.15.178:3300/0 conn(0x7fc3e40c57a0 0x7fc3e40c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 -- 172.21.15.153:0/543765160 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4154dd0 con 0x7fc3e4153f50 2023-08-17T00:10:57.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3e3fff700 1 --2- 172.21.15.153:0/543765160 >> v2:172.21.15.178:3300/0 conn(0x7fc3e40c57a0 0x7fc3e40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:57.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.651+0000 7fc3db7fe700 1 --2- 172.21.15.153:0/543765160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4153f50 0x7fc3e4154370 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fc3e40c54c0 tx=0x7fc3cc0090f0).ready entity=mon.0 client_cookie=428edb22577115f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:57.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e37fe700 1 -- 172.21.15.153:0/543765160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00b520 con 0x7fc3e4153f50 2023-08-17T00:10:57.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e37fe700 1 -- 172.21.15.153:0/543765160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3cc00b680 con 0x7fc3e4153f50 2023-08-17T00:10:57.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e37fe700 1 -- 172.21.15.153:0/543765160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3cc00ba00 con 0x7fc3e4153f50 2023-08-17T00:10:57.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 -- 172.21.15.153:0/543765160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4153f50 msgr2=0x7fc3e4154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 --2- 172.21.15.153:0/543765160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4153f50 0x7fc3e4154370 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7fc3e40c54c0 tx=0x7fc3cc0090f0).stop 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 -- 172.21.15.153:0/543765160 shutdown_connections 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 --2- 172.21.15.153:0/543765160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e4157600 0x7fc3e4157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 --2- 172.21.15.153:0/543765160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4153f50 0x7fc3e4154370 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 --2- 172.21.15.153:0/543765160 >> v2:172.21.15.178:3300/0 conn(0x7fc3e40c57a0 0x7fc3e40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 -- 172.21.15.153:0/543765160 >> 172.21.15.153:0/543765160 conn(0x7fc3e4062a70 msgr2=0x7fc3e40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 -- 172.21.15.153:0/543765160 shutdown_connections 2023-08-17T00:10:57.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 -- 172.21.15.153:0/543765160 wait complete. 2023-08-17T00:10:57.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.655+0000 7fc3e9707700 1 Processor -- start 2023-08-17T00:10:57.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 -- start start 2023-08-17T00:10:57.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e40c57a0 0x7fc3e41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4153f50 0x7fc3e40c3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 0x7fc3e40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c1940 con 0x7fc3e4157600 2023-08-17T00:10:57.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c24c0 con 0x7fc3e4153f50 2023-08-17T00:10:57.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e40c1b90 con 0x7fc3e40c57a0 2023-08-17T00:10:57.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 0x7fc3e40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 0x7fc3e40c86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39514/0 (socket says 172.21.15.153:39514) 2023-08-17T00:10:57.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 -- 172.21.15.153:0/2356572551 learned_addr learned my addr 172.21.15.153:0/2356572551 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:57.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3db7fe700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4153f50 0x7fc3e40c3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e3fff700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e40c57a0 0x7fc3e41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 -- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e40c57a0 msgr2=0x7fc3e41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e40c57a0 0x7fc3e41526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 -- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4153f50 msgr2=0x7fc3e40c3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4153f50 0x7fc3e40c3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 -- 172.21.15.153:0/2356572551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3cc009370 con 0x7fc3e4157600 2023-08-17T00:10:57.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e8f06700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 0x7fc3e40c86d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fc3dc00e930 tx=0x7fc3dc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:57.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00c640 con 0x7fc3e4157600 2023-08-17T00:10:57.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc00c7a0 con 0x7fc3e4157600 2023-08-17T00:10:57.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e40c1e70 con 0x7fc3e4157600 2023-08-17T00:10:57.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc00cb20 con 0x7fc3e4157600 2023-08-17T00:10:57.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.659+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e4152bc0 con 0x7fc3e4157600 2023-08-17T00:10:57.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.663+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e40c2650 con 0x7fc3e4157600 2023-08-17T00:10:57.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.663+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc3dc022070 con 0x7fc3e4157600 2023-08-17T00:10:57.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.667+0000 7fc3e0ff9700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3c405a150 0x7fc3c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:57.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.667+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fc3dc074440 con 0x7fc3e4157600 2023-08-17T00:10:57.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.667+0000 7fc3e3fff700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3c405a150 0x7fc3c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:57.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.667+0000 7fc3e3fff700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3c405a150 0x7fc3c405c610 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fc3e4162290 tx=0x7fc3d4009850).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:57.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.671+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3dc047e40 con 0x7fc3e4157600 2023-08-17T00:10:57.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.871+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc3e406b4c0 con 0x7fc3e4157600 2023-08-17T00:10:57.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.883+0000 7fc3e0ff9700 1 -- 172.21.15.153:0/2356572551 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc3dc0160c0 con 0x7fc3e4157600 2023-08-17T00:10:57.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3c405a150 msgr2=0x7fc3c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3c405a150 0x7fc3c405c610 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fc3e4162290 tx=0x7fc3d4009850).stop 2023-08-17T00:10:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 msgr2=0x7fc3e40c86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 0x7fc3e40c86d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 rx=0x7fc3dc00e930 tx=0x7fc3dc009060).stop 2023-08-17T00:10:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 shutdown_connections 2023-08-17T00:10:57.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3c405a150 0x7fc3c405c610 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3e4157600 0x7fc3e40c86d0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3e4153f50 0x7fc3e40c3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 --2- 172.21.15.153:0/2356572551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3e40c57a0 0x7fc3e41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:57.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.895+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 >> 172.21.15.153:0/2356572551 conn(0x7fc3e4062a70 msgr2=0x7fc3e4153400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.903+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 shutdown_connections 2023-08-17T00:10:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:57.903+0000 7fc3e9707700 1 -- 172.21.15.153:0/2356572551 wait complete. 2023-08-17T00:10:57.915 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 15 and data pool 16 2023-08-17T00:10:57.933 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:10:58.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 Processor -- start 2023-08-17T00:10:58.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 -- start start 2023-08-17T00:10:58.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1b8151b90 0x7fd1b8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8064870 0x7fd1b8064d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b8061fa0 con 0x7fd1b8063290 2023-08-17T00:10:58.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b80c3fb0 con 0x7fd1b8151b90 2023-08-17T00:10:58.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1bdb69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b8152460 con 0x7fd1b8064870 2023-08-17T00:10:58.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1b8151b90 0x7fd1b8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd1b8151b90 0x7fd1b8151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39528/0 (socket says 172.21.15.153:39528) 2023-08-17T00:10:58.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 -- 172.21.15.153:0/1916260139 learned_addr learned my addr 172.21.15.153:0/1916260139 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:58.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b7fff700 1 --2- 172.21.15.153:0/1916260139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8064870 0x7fd1b8064d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 -- 172.21.15.153:0/1916260139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8064870 msgr2=0x7fd1b8064d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:58.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 --2- 172.21.15.153:0/1916260139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8064870 0x7fd1b8064d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 -- 172.21.15.153:0/1916260139 >> v1:172.21.15.178:6789/0 conn(0x7fd1b8063290 legacy=0x7fd1b8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b67fc700 1 -- 172.21.15.153:0/1916260139 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2724397115 0 0) 0x7fd1b8061fa0 con 0x7fd1b8063290 2023-08-17T00:10:58.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.083+0000 7fd1b77fe700 1 -- 172.21.15.153:0/1916260139 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b80651f0 con 0x7fd1b8151b90 2023-08-17T00:10:58.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1b77fe700 1 --2- 172.21.15.153:0/1916260139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8151b90 0x7fd1b8151f70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fd1a8006fd0 tx=0x7fd1a80090f0).ready entity=mon.0 client_cookie=d808f86489b6a8a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1b67fc700 1 -- 172.21.15.153:0/1916260139 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800b580 con 0x7fd1b8151b90 2023-08-17T00:10:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1b67fc700 1 -- 172.21.15.153:0/1916260139 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a800b6e0 con 0x7fd1b8151b90 2023-08-17T00:10:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1b67fc700 1 -- 172.21.15.153:0/1916260139 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800ba80 con 0x7fd1b8151b90 2023-08-17T00:10:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 -- 172.21.15.153:0/1916260139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8151b90 msgr2=0x7fd1b8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/1916260139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8151b90 0x7fd1b8151f70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7fd1a8006fd0 tx=0x7fd1a80090f0).stop 2023-08-17T00:10:58.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 -- 172.21.15.153:0/1916260139 shutdown_connections 2023-08-17T00:10:58.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/1916260139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8064870 0x7fd1b8064d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/1916260139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8151b90 0x7fd1b8151f70 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 -- 172.21.15.153:0/1916260139 >> 172.21.15.153:0/1916260139 conn(0x7fd1b80c7150 msgr2=0x7fd1b80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:58.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 -- 172.21.15.153:0/1916260139 shutdown_connections 2023-08-17T00:10:58.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.087+0000 7fd1bdb69700 1 -- 172.21.15.153:0/1916260139 wait complete. 2023-08-17T00:10:58.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 Processor -- start 2023-08-17T00:10:58.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 -- start start 2023-08-17T00:10:58.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b8063290 0x7fd1b80a7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 0x7fd1b814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8151b90 0x7fd1b80a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80a6ed0 con 0x7fd1b8064870 2023-08-17T00:10:58.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80a71b0 con 0x7fd1b8063290 2023-08-17T00:10:58.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b80a7490 con 0x7fd1b8151b90 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 0x7fd1b814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 0x7fd1b814cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39544/0 (socket says 172.21.15.153:39544) 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 -- 172.21.15.153:0/4113988049 learned_addr learned my addr 172.21.15.153:0/4113988049 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b77fe700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b8063290 0x7fd1b80a7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b7fff700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8151b90 0x7fd1b80a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 -- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8151b90 msgr2=0x7fd1b80a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8151b90 0x7fd1b80a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 -- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b8063290 msgr2=0x7fd1b80a7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b8063290 0x7fd1b80a7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 -- 172.21.15.153:0/4113988049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8009370 con 0x7fd1b8064870 2023-08-17T00:10:58.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1b6ffd700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 0x7fd1b814cb90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fd1ac001eb0 tx=0x7fd1ac007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00ce60 con 0x7fd1b8064870 2023-08-17T00:10:58.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1ac00f470 con 0x7fd1b8064870 2023-08-17T00:10:58.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b80a7770 con 0x7fd1b8064870 2023-08-17T00:10:58.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1ac00f810 con 0x7fd1b8064870 2023-08-17T00:10:58.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.091+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b80a6bb0 con 0x7fd1b8064870 2023-08-17T00:10:58.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.095+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b806b530 con 0x7fd1b8064870 2023-08-17T00:10:58.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.095+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd1ac019030 con 0x7fd1b8064870 2023-08-17T00:10:58.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.095+0000 7fd19f7fe700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1a405a150 0x7fd1a405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.099+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd1ac073610 con 0x7fd1b8064870 2023-08-17T00:10:58.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.099+0000 7fd1b77fe700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1a405a150 0x7fd1a405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.099+0000 7fd1b77fe700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1a405a150 0x7fd1a405c610 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd1a8009fd0 tx=0x7fd1a8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.103+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd1ac046fb0 con 0x7fd1b8064870 2023-08-17T00:10:58.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.267+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b80621f0 con 0x7fd1b8064870 2023-08-17T00:10:58.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.267+0000 7fd19f7fe700 1 -- 172.21.15.153:0/4113988049 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fd1ac04a5d0 con 0x7fd1b8064870 2023-08-17T00:10:58.275 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:58.275 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":111,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:57.876267+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:10:55.905753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T00:10:56.871921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:10:58.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1a405a150 msgr2=0x7fd1a405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1a405a150 0x7fd1a405c610 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7fd1a8009fd0 tx=0x7fd1a8017000).stop 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 msgr2=0x7fd1b814cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 0x7fd1b814cb90 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7fd1ac001eb0 tx=0x7fd1ac007c70).stop 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 shutdown_connections 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1a405a150 0x7fd1a405c610 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1b8151b90 0x7fd1b80a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd1b8064870 0x7fd1b814cb90 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 --2- 172.21.15.153:0/4113988049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd1b8063290 0x7fd1b80a7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 >> 172.21.15.153:0/4113988049 conn(0x7fd1b80c7150 msgr2=0x7fd1b80653b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:58.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 shutdown_connections 2023-08-17T00:10:58.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.271+0000 7fd1bdb69700 1 -- 172.21.15.153:0/4113988049 wait complete. 2023-08-17T00:10:58.299 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:10:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.455+0000 7f5d33c9b700 1 Processor -- start 2023-08-17T00:10:58.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.455+0000 7f5d33c9b700 1 -- start start 2023-08-17T00:10:58.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5d2c153e90 0x7f5d2c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 0x7f5d2c0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c0aa750 con 0x7f5d2c153ab0 2023-08-17T00:10:58.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c9dd0 con 0x7f5d2c153e90 2023-08-17T00:10:58.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0aacf0 con 0x7f5d2c0c7980 2023-08-17T00:10:58.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d32238700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 0x7f5d2c0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d32238700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 0x7f5d2c0ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:34030/0 (socket says 172.21.15.153:34030) 2023-08-17T00:10:58.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d32238700 1 -- 172.21.15.153:0/2728020419 learned_addr learned my addr 172.21.15.153:0/2728020419 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:58.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31a37700 1 --1- 172.21.15.153:0/2728020419 >> v1:172.21.15.178:6789/0 conn(0x7f5d2c153ab0 0x7f5d2c0c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:44416/0 (socket says 172.21.15.153:44416) 2023-08-17T00:10:58.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31236700 1 --2- 172.21.15.153:0/2728020419 >> v2:172.21.15.178:3300/0 conn(0x7f5d2c153e90 0x7f5d2c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31236700 1 -- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 msgr2=0x7f5d2c0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31236700 1 --2- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 0x7f5d2c0ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31236700 1 -- 172.21.15.153:0/2728020419 >> v1:172.21.15.178:6789/0 conn(0x7f5d2c153ab0 legacy=0x7f5d2c0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31236700 1 -- 172.21.15.153:0/2728020419 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c1542f0 con 0x7f5d2c153e90 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d32238700 1 --2- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 0x7f5d2c0ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d30a35700 1 -- 172.21.15.153:0/2728020419 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786673731 0 0) 0x7f5d2c0aa750 con 0x7f5d2c153ab0 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d31236700 1 --2- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153e90 0x7f5d2c0c7490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5d1c009760 tx=0x7f5d1c009060).ready entity=mon.1 client_cookie=766ab249d415291a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d30a35700 1 -- 172.21.15.153:0/2728020419 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0090d0 con 0x7f5d2c153e90 2023-08-17T00:10:58.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d30a35700 1 -- 172.21.15.153:0/2728020419 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c00f510 con 0x7f5d2c153e90 2023-08-17T00:10:58.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d30a35700 1 -- 172.21.15.153:0/2728020419 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c00f890 con 0x7f5d2c153e90 2023-08-17T00:10:58.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153e90 msgr2=0x7f5d2c0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153e90 0x7f5d2c0c7490 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5d1c009760 tx=0x7f5d1c009060).stop 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- 172.21.15.153:0/2728020419 shutdown_connections 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c0c7980 0x7f5d2c0ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/2728020419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153e90 0x7f5d2c0c7490 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- 172.21.15.153:0/2728020419 >> 172.21.15.153:0/2728020419 conn(0x7f5d2c061fa0 msgr2=0x7f5d2c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- 172.21.15.153:0/2728020419 shutdown_connections 2023-08-17T00:10:58.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.459+0000 7f5d33c9b700 1 -- 172.21.15.153:0/2728020419 wait complete. 2023-08-17T00:10:58.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 Processor -- start 2023-08-17T00:10:58.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- start start 2023-08-17T00:10:58.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 0x7f5d2c0a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153ab0 0x7f5d2c0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c153e90 0x7f5d2c0c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c2200 con 0x7f5d2c0c7980 2023-08-17T00:10:58.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0c1f20 con 0x7f5d2c153ab0 2023-08-17T00:10:58.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c157d00 con 0x7f5d2c153e90 2023-08-17T00:10:58.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 0x7f5d2c0a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 0x7f5d2c0a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39546/0 (socket says 172.21.15.153:39546) 2023-08-17T00:10:58.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 -- 172.21.15.153:0/829591367 learned_addr learned my addr 172.21.15.153:0/829591367 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:58.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31236700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153ab0 0x7f5d2c0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d32238700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c153e90 0x7f5d2c0c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 -- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c153e90 msgr2=0x7f5d2c0c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c153e90 0x7f5d2c0c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 -- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153ab0 msgr2=0x7f5d2c0ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153ab0 0x7f5d2c0ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 -- 172.21.15.153:0/829591367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d24009ae0 con 0x7f5d2c0c7980 2023-08-17T00:10:58.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31236700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153ab0 0x7f5d2c0ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:10:58.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d31a37700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 0x7f5d2c0a9ed0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f5d2800c490 tx=0x7f5d28007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280072e0 con 0x7f5d2c0c7980 2023-08-17T00:10:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28007440 con 0x7f5d2c0c7980 2023-08-17T00:10:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28005930 con 0x7f5d2c0c7980 2023-08-17T00:10:58.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c0092a0 con 0x7f5d2c0c7980 2023-08-17T00:10:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c1582c0 con 0x7f5d2c0c7980 2023-08-17T00:10:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2c1584e0 con 0x7f5d2c0c7980 2023-08-17T00:10:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.467+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5d28010070 con 0x7f5d2c0c7980 2023-08-17T00:10:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.471+0000 7f5d21ffb700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d1005a150 0x7f5d1005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.471+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5d28073890 con 0x7f5d2c0c7980 2023-08-17T00:10:58.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.471+0000 7f5d31236700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d1005a150 0x7f5d1005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.471+0000 7f5d31236700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d1005a150 0x7f5d1005c610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5d1c009fd0 tx=0x7f5d1c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.479+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d28047230 con 0x7f5d2c0c7980 2023-08-17T00:10:58.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.643+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d2c06b530 con 0x7f5d2c0c7980 2023-08-17T00:10:58.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.643+0000 7f5d21ffb700 1 -- 172.21.15.153:0/829591367 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f5d28007d80 con 0x7f5d2c0c7980 2023-08-17T00:10:58.647 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:10:58.647 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":111,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:57.876267+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:10:55.905753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T00:10:56.871921+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:10:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d1005a150 msgr2=0x7f5d1005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d1005a150 0x7f5d1005c610 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f5d1c009fd0 tx=0x7f5d1c017000).stop 2023-08-17T00:10:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 msgr2=0x7f5d2c0a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 0x7f5d2c0a9ed0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f5d2800c490 tx=0x7f5d28007c60).stop 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 shutdown_connections 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d1005a150 0x7f5d1005c610 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d2c153e90 0x7f5d2c0c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d2c153ab0 0x7f5d2c0ada10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 --2- 172.21.15.153:0/829591367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d2c0c7980 0x7f5d2c0a9ed0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 >> 172.21.15.153:0/829591367 conn(0x7f5d2c061fa0 msgr2=0x7f5d2c062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 shutdown_connections 2023-08-17T00:10:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.647+0000 7f5d33c9b700 1 -- 172.21.15.153:0/829591367 wait complete. 2023-08-17T00:10:58.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:10:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.823+0000 7f7bb4bf9700 1 Processor -- start 2023-08-17T00:10:58.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.823+0000 7f7bb4bf9700 1 -- start start 2023-08-17T00:10:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7bb4bf9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7bb00abf10 0x7f7bb0068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7bb4bf9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7bb00ac2f0 0x7f7bb0068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7bb4bf9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb01545e0 con 0x7f7bb00c0a80 2023-08-17T00:10:58.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7bb4bf9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb0069200 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7bb4bf9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bb00c1c50 con 0x7f7bb00abf10 2023-08-17T00:10:58.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7bb00ac2f0 0x7f7bb0068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7bb00ac2f0 0x7f7bb0068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39560/0 (socket says 172.21.15.153:39560) 2023-08-17T00:10:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3656919431 learned_addr learned my addr 172.21.15.153:0/3656919431 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7baf7fe700 1 --2- 172.21.15.153:0/3656919431 >> v2:172.21.15.178:3300/0 conn(0x7f7bb00abf10 0x7f7bb0068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3656919431 >> v2:172.21.15.178:3300/0 conn(0x7f7bb00abf10 msgr2=0x7f7bb0068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:58.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 --2- 172.21.15.153:0/3656919431 >> v2:172.21.15.178:3300/0 conn(0x7f7bb00abf10 0x7f7bb0068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3656919431 >> v1:172.21.15.153:6789/0 conn(0x7f7bb00c0a80 legacy=0x7f7bb00c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:10:58.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3656919431 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00a96d0 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7ba6ffd700 1 --2- 172.21.15.153:0/3656919431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb0068d10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f7bb00c3f30 tx=0x7f7b980090f0).ready entity=mon.0 client_cookie=cb12b45dc5b75c51 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7baeffd700 1 -- 172.21.15.153:0/3656919431 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800b600 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7baeffd700 1 -- 172.21.15.153:0/3656919431 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9800b760 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.827+0000 7f7baeffd700 1 -- 172.21.15.153:0/3656919431 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800bb00 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3656919431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 msgr2=0x7f7bb0068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3656919431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb0068d10 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 rx=0x7f7bb00c3f30 tx=0x7f7b980090f0).stop 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3656919431 shutdown_connections 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3656919431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb0068d10 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3656919431 >> v2:172.21.15.178:3300/0 conn(0x7f7bb00abf10 0x7f7bb0068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3656919431 >> 172.21.15.153:0/3656919431 conn(0x7f7bb00c6620 msgr2=0x7f7bb00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3656919431 shutdown_connections 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3656919431 wait complete. 2023-08-17T00:10:58.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 Processor -- start 2023-08-17T00:10:58.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.831+0000 7f7bb4bf9700 1 -- start start 2023-08-17T00:10:58.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb00abf10 0x7f7bb014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb00bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb00c0a80 0x7f7bb00bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0165440 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0164830 con 0x7f7bb00c0a80 2023-08-17T00:10:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb0164b10 con 0x7f7bb00abf10 2023-08-17T00:10:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb00bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb00bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39576/0 (socket says 172.21.15.153:39576) 2023-08-17T00:10:58.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3415302247 learned_addr learned my addr 172.21.15.153:0/3415302247 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7baffff700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb00c0a80 0x7f7bb00bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7baf7fe700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb00abf10 0x7f7bb014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb00abf10 msgr2=0x7f7bb014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb00abf10 0x7f7bb014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb00c0a80 msgr2=0x7f7bb00bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb00c0a80 0x7f7bb00bf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:58.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 -- 172.21.15.153:0/3415302247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b98009370 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba6ffd700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb00bf4c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f7bb00668e0 tx=0x7f7b98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9800bec0 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9800b8d0 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb0164df0 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98024470 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.835+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb0164530 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.839+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb006b4c0 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.839+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7b9800f070 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.839+0000 7f7ba7fff700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b9405a150 0x7f7b9405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:10:58.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.839+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7b98075db0 con 0x7f7bb00ac2f0 2023-08-17T00:10:58.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.839+0000 7f7baf7fe700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b9405a150 0x7f7b9405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:10:58.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.843+0000 7f7baf7fe700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b9405a150 0x7f7b9405c610 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f7ba0006920 tx=0x7f7ba0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:10:58.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:58.847+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b9807a070 con 0x7f7bb00ac2f0 2023-08-17T00:10:59.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.043+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7bb0064010 con 0x7f7bb00ac2f0 2023-08-17T00:10:59.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.907+0000 7f7ba7fff700 1 -- 172.21.15.153:0/3415302247 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b98029070 con 0x7f7bb00ac2f0 2023-08-17T00:10:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b9405a150 msgr2=0x7f7b9405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b9405a150 0x7f7b9405c610 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f7ba0006920 tx=0x7f7ba0008040).stop 2023-08-17T00:10:59.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 msgr2=0x7f7bb00bf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:10:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb00bf4c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f7bb00668e0 tx=0x7f7b98017000).stop 2023-08-17T00:10:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 shutdown_connections 2023-08-17T00:10:59.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b9405a150 0x7f7b9405c610 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7bb00c0a80 0x7f7bb00bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7bb00ac2f0 0x7f7bb00bf4c0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 --2- 172.21.15.153:0/3415302247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7bb00abf10 0x7f7bb014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:10:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 >> 172.21.15.153:0/3415302247 conn(0x7f7bb00c6620 msgr2=0x7f7bb0159900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:10:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 shutdown_connections 2023-08-17T00:10:59.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:10:59.911+0000 7f7bb4bf9700 1 -- 172.21.15.153:0/3415302247 wait complete. 2023-08-17T00:10:59.935 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:10:59.936 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:11:00.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 Processor -- start 2023-08-17T00:11:00.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 -- start start 2023-08-17T00:11:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa6c0c57a0 0x7faa6c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c0c11b0 0x7faa6c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6c0bfd10 con 0x7faa6c153f50 2023-08-17T00:11:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6c154860 con 0x7faa6c0c57a0 2023-08-17T00:11:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa70c39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c154af0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7faa6c0c57a0 0x7faa6c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7faa6c153f50 0x7faa6c157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46882/0 (socket says 172.21.15.153:46882) 2023-08-17T00:11:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6affd700 1 -- 172.21.15.153:0/2810152197 learned_addr learned my addr 172.21.15.153:0/2810152197 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:00.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6bfff700 1 --2- 172.21.15.153:0/2810152197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c0c11b0 0x7faa6c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:00.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6b7fe700 1 -- 172.21.15.153:0/2810152197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c0c11b0 msgr2=0x7faa6c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:00.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6a7fc700 1 -- 172.21.15.153:0/2810152197 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289242253 0 0) 0x7faa6c0bfd10 con 0x7faa6c153f50 2023-08-17T00:11:00.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6b7fe700 1 --2- 172.21.15.153:0/2810152197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c0c11b0 0x7faa6c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6b7fe700 1 -- 172.21.15.153:0/2810152197 >> v1:172.21.15.153:6789/0 conn(0x7faa6c153f50 legacy=0x7faa6c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:00.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.103+0000 7faa6b7fe700 1 -- 172.21.15.153:0/2810152197 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c154dd0 con 0x7faa6c0c57a0 2023-08-17T00:11:00.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa6b7fe700 1 --2- 172.21.15.153:0/2810152197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0c5b80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7faa5c009760 tx=0x7faa5c009060).ready entity=mon.0 client_cookie=1c754bf43fc67105 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:00.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa6a7fc700 1 -- 172.21.15.153:0/2810152197 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00b580 con 0x7faa6c0c57a0 2023-08-17T00:11:00.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa6a7fc700 1 -- 172.21.15.153:0/2810152197 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00b6e0 con 0x7faa6c0c57a0 2023-08-17T00:11:00.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa6a7fc700 1 -- 172.21.15.153:0/2810152197 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ba60 con 0x7faa6c0c57a0 2023-08-17T00:11:00.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 -- 172.21.15.153:0/2810152197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c57a0 msgr2=0x7faa6c0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:00.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 --2- 172.21.15.153:0/2810152197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0c5b80 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7faa5c009760 tx=0x7faa5c009060).stop 2023-08-17T00:11:00.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 -- 172.21.15.153:0/2810152197 shutdown_connections 2023-08-17T00:11:00.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 --2- 172.21.15.153:0/2810152197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c0c11b0 0x7faa6c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 --2- 172.21.15.153:0/2810152197 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0c5b80 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 -- 172.21.15.153:0/2810152197 >> 172.21.15.153:0/2810152197 conn(0x7faa6c062a70 msgr2=0x7faa6c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:00.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 -- 172.21.15.153:0/2810152197 shutdown_connections 2023-08-17T00:11:00.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.107+0000 7faa70c39700 1 -- 172.21.15.153:0/2810152197 wait complete. 2023-08-17T00:11:00.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 Processor -- start 2023-08-17T00:11:00.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 -- start start 2023-08-17T00:11:00.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 0x7faa6c0a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c153f50 0x7faa6c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c1510c0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0c2ea0 con 0x7faa6c0c57a0 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa70c39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c0ac7b0 con 0x7faa6c153f50 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 0x7faa6c0a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:00.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 0x7faa6c0a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39586/0 (socket says 172.21.15.153:39586) 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 -- 172.21.15.153:0/352190809 learned_addr learned my addr 172.21.15.153:0/352190809 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6affd700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6bfff700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c153f50 0x7faa6c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 -- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c153f50 msgr2=0x7faa6c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c153f50 0x7faa6c0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 -- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6c0c57a0 msgr2=0x7faa6c0ae210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0ae210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 -- 172.21.15.153:0/352190809 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c0092a0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6bfff700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c153f50 0x7faa6c0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6affd700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa6b7fe700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 0x7faa6c0a8ea0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7faa6c083860 tx=0x7faa5c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00b850 con 0x7faa6c0c11b0 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00b9b0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.111+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c01b660 con 0x7faa6c0c11b0 2023-08-17T00:11:00.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.115+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c0aca90 con 0x7faa6c0c11b0 2023-08-17T00:11:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.115+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c0ad050 con 0x7faa6c0c11b0 2023-08-17T00:11:00.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.115+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c06b4c0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.115+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7faa5c02b070 con 0x7faa6c0c11b0 2023-08-17T00:11:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.119+0000 7faa537fe700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa5805a150 0x7faa5805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.119+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7faa5c075c00 con 0x7faa6c0c11b0 2023-08-17T00:11:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.119+0000 7faa6affd700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa5805a150 0x7faa5805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:00.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.119+0000 7faa6affd700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa5805a150 0x7faa5805c610 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7faa60007fd0 tx=0x7faa60009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:00.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.123+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7faa5c0495a0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.315+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faa6c0bf9a0 con 0x7faa6c0c11b0 2023-08-17T00:11:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.919+0000 7faa537fe700 1 -- 172.21.15.153:0/352190809 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7faa5c029020 con 0x7faa6c0c11b0 2023-08-17T00:11:00.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa5805a150 msgr2=0x7faa5805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa5805a150 0x7faa5805c610 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7faa60007fd0 tx=0x7faa60009040).stop 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 msgr2=0x7faa6c0a8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 0x7faa6c0a8ea0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7faa6c083860 tx=0x7faa5c017000).stop 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 shutdown_connections 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7faa5805a150 0x7faa5805c610 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa6c153f50 0x7faa6c0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6c0c57a0 0x7faa6c0ae210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 --2- 172.21.15.153:0/352190809 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7faa6c0c11b0 0x7faa6c0a8ea0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 >> 172.21.15.153:0/352190809 conn(0x7faa6c062a70 msgr2=0x7faa6c1531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 shutdown_connections 2023-08-17T00:11:00.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:00.923+0000 7faa70c39700 1 -- 172.21.15.153:0/352190809 wait complete. 2023-08-17T00:11:00.948 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:11:00.949 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:01.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.103+0000 7ff05e69b700 1 Processor -- start 2023-08-17T00:11:01.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.103+0000 7ff05e69b700 1 -- start start 2023-08-17T00:11:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff058063290 0x7ff058065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff058061fa0 con 0x7ff058065b50 2023-08-17T00:11:01.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0580c3fb0 con 0x7ff058063290 2023-08-17T00:11:01.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff058152460 con 0x7ff058151b90 2023-08-17T00:11:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff058063290 0x7ff058065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff058063290 0x7ff058065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39594/0 (socket says 172.21.15.153:39594) 2023-08-17T00:11:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 -- 172.21.15.153:0/3452048933 learned_addr learned my addr 172.21.15.153:0/3452048933 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff057fff700 1 --2- 172.21.15.153:0/3452048933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 -- 172.21.15.153:0/3452048933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 msgr2=0x7ff058151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:01.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 --2- 172.21.15.153:0/3452048933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 -- 172.21.15.153:0/3452048933 >> v1:172.21.15.178:6789/0 conn(0x7ff058065b50 legacy=0x7ff058064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 -- 172.21.15.153:0/3452048933 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580621f0 con 0x7ff058063290 2023-08-17T00:11:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff04ffff700 1 --2- 172.21.15.153:0/3452048933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058063290 0x7ff058065660 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7ff040006fd0 tx=0x7ff0400090f0).ready entity=mon.0 client_cookie=ddf03f2597c62721 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff0577fe700 1 -- 172.21.15.153:0/3452048933 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000b600 con 0x7ff058063290 2023-08-17T00:11:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff0577fe700 1 -- 172.21.15.153:0/3452048933 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000b760 con 0x7ff058063290 2023-08-17T00:11:01.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff0577fe700 1 -- 172.21.15.153:0/3452048933 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000bae0 con 0x7ff058063290 2023-08-17T00:11:01.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- 172.21.15.153:0/3452048933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058063290 msgr2=0x7ff058065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 --2- 172.21.15.153:0/3452048933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058063290 0x7ff058065660 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7ff040006fd0 tx=0x7ff0400090f0).stop 2023-08-17T00:11:01.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- 172.21.15.153:0/3452048933 shutdown_connections 2023-08-17T00:11:01.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 --2- 172.21.15.153:0/3452048933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058063290 0x7ff058065660 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 --2- 172.21.15.153:0/3452048933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- 172.21.15.153:0/3452048933 >> 172.21.15.153:0/3452048933 conn(0x7ff0580c7150 msgr2=0x7ff0580c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:01.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- 172.21.15.153:0/3452048933 shutdown_connections 2023-08-17T00:11:01.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.107+0000 7ff05e69b700 1 -- 172.21.15.153:0/3452048933 wait complete. 2023-08-17T00:11:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 Processor -- start 2023-08-17T00:11:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 -- start start 2023-08-17T00:11:01.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff058063290 0x7ff058154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 0x7ff0581433c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058162bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05814e560 con 0x7ff058065b50 2023-08-17T00:11:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff058154700 con 0x7ff058063290 2023-08-17T00:11:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05e69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0581438b0 con 0x7ff058151b90 2023-08-17T00:11:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff04ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 0x7ff0581433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff057fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff058063290 0x7ff058154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff04ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 0x7ff0581433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39610/0 (socket says 172.21.15.153:39610) 2023-08-17T00:11:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff04ffff700 1 -- 172.21.15.153:0/2545244452 learned_addr learned my addr 172.21.15.153:0/2545244452 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff05cc38700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058162bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff04ffff700 1 -- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 msgr2=0x7ff058162bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.111+0000 7ff04ffff700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058162bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff04ffff700 1 -- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff058063290 msgr2=0x7ff058154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff04ffff700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff058063290 0x7ff058154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff04ffff700 1 -- 172.21.15.153:0/2545244452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff040009370 con 0x7ff058065b50 2023-08-17T00:11:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff04ffff700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 0x7ff0581433c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7ff040011000 tx=0x7ff040017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000bea0 con 0x7ff058065b50 2023-08-17T00:11:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000b8d0 con 0x7ff058065b50 2023-08-17T00:11:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04001c670 con 0x7ff058065b50 2023-08-17T00:11:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff058153af0 con 0x7ff058065b50 2023-08-17T00:11:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0581540b0 con 0x7ff058065b50 2023-08-17T00:11:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff058154890 con 0x7ff058065b50 2023-08-17T00:11:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.115+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff04002c070 con 0x7ff058065b50 2023-08-17T00:11:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.119+0000 7ff054ff9700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff03c05a150 0x7ff03c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.119+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff040075c30 con 0x7ff058065b50 2023-08-17T00:11:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.119+0000 7ff057fff700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff03c05a150 0x7ff03c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.119+0000 7ff057fff700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff03c05a150 0x7ff03c05c610 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7ff04800bb10 tx=0x7ff048008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.123+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff0400496e0 con 0x7ff058065b50 2023-08-17T00:11:01.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.319+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0580624d0 con 0x7ff058065b50 2023-08-17T00:11:01.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.319+0000 7ff054ff9700 1 -- 172.21.15.153:0/2545244452 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7ff04002a070 con 0x7ff058065b50 2023-08-17T00:11:01.323 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:01.324 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:01.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff03c05a150 msgr2=0x7ff03c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff03c05a150 0x7ff03c05c610 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7ff04800bb10 tx=0x7ff048008040).stop 2023-08-17T00:11:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 msgr2=0x7ff0581433c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 0x7ff0581433c0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7ff040011000 tx=0x7ff040017000).stop 2023-08-17T00:11:01.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 shutdown_connections 2023-08-17T00:11:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff03c05a150 0x7ff03c05c610 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff058151b90 0x7ff058162bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff058065b50 0x7ff0581433c0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 --2- 172.21.15.153:0/2545244452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff058063290 0x7ff058154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 >> 172.21.15.153:0/2545244452 conn(0x7ff0580c7150 msgr2=0x7ff05814fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:01.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 shutdown_connections 2023-08-17T00:11:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.323+0000 7ff05e69b700 1 -- 172.21.15.153:0/2545244452 wait complete. 2023-08-17T00:11:01.328 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:01.346 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:11:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.507+0000 7fb6e141b700 1 Processor -- start 2023-08-17T00:11:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.507+0000 7fb6e141b700 1 -- start start 2023-08-17T00:11:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6e141b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb6dc153af0 0x7fb6dc063d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6e141b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc0be120 0x7fb6dc0bcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6e141b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc062d00 con 0x7fb6dc066cf0 2023-08-17T00:11:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6e141b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc0c3920 con 0x7fb6dc153af0 2023-08-17T00:11:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6e141b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc062f80 con 0x7fb6dc0be120 2023-08-17T00:11:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc0be120 0x7fb6dc0bcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6daffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb6dc153af0 0x7fb6dc063d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6db7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb6dc066cf0 0x7fb6dc0c1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:44432/0 (socket says 172.21.15.153:44432) 2023-08-17T00:11:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6db7fe700 1 -- 172.21.15.153:0/335500147 learned_addr learned my addr 172.21.15.153:0/335500147 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:01.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6d3fff700 1 -- 172.21.15.153:0/335500147 >> v2:172.21.15.178:3300/0 conn(0x7fb6dc153af0 msgr2=0x7fb6dc063d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6d3fff700 1 --2- 172.21.15.153:0/335500147 >> v2:172.21.15.178:3300/0 conn(0x7fb6dc153af0 0x7fb6dc063d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6da7fc700 1 -- 172.21.15.153:0/335500147 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135706790 0 0) 0x7fb6dc062d00 con 0x7fb6dc066cf0 2023-08-17T00:11:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6d3fff700 1 -- 172.21.15.153:0/335500147 >> v1:172.21.15.178:6789/0 conn(0x7fb6dc066cf0 legacy=0x7fb6dc0c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6d3fff700 1 -- 172.21.15.153:0/335500147 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc063260 con 0x7fb6dc0be120 2023-08-17T00:11:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6daffd700 1 --2- 172.21.15.153:0/335500147 >> v2:172.21.15.178:3300/0 conn(0x7fb6dc153af0 0x7fb6dc063d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:01.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6d3fff700 1 --2- 172.21.15.153:0/335500147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc0be120 0x7fb6dc0bcf40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb6c4009760 tx=0x7fb6c4009060).ready entity=mon.2 client_cookie=e4af27843bddb4dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6da7fc700 1 -- 172.21.15.153:0/335500147 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40090d0 con 0x7fb6dc0be120 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6da7fc700 1 -- 172.21.15.153:0/335500147 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400f510 con 0x7fb6dc0be120 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.511+0000 7fb6da7fc700 1 -- 172.21.15.153:0/335500147 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400f890 con 0x7fb6dc0be120 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 -- 172.21.15.153:0/335500147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc0be120 msgr2=0x7fb6dc0bcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 --2- 172.21.15.153:0/335500147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc0be120 0x7fb6dc0bcf40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fb6c4009760 tx=0x7fb6c4009060).stop 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 -- 172.21.15.153:0/335500147 shutdown_connections 2023-08-17T00:11:01.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 --2- 172.21.15.153:0/335500147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc0be120 0x7fb6dc0bcf40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 --2- 172.21.15.153:0/335500147 >> v2:172.21.15.178:3300/0 conn(0x7fb6dc153af0 0x7fb6dc063d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 -- 172.21.15.153:0/335500147 >> 172.21.15.153:0/335500147 conn(0x7fb6dc069750 msgr2=0x7fb6dc069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:01.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 -- 172.21.15.153:0/335500147 shutdown_connections 2023-08-17T00:11:01.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 -- 172.21.15.153:0/335500147 wait complete. 2023-08-17T00:11:01.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 Processor -- start 2023-08-17T00:11:01.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.515+0000 7fb6e141b700 1 -- start start 2023-08-17T00:11:01.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6dc066cf0 0x7fb6dc13e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 0x7fb6dc0a6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc153af0 0x7fb6dc0a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc153fe0 con 0x7fb6dc0be120 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0a7c10 con 0x7fb6dc066cf0 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0a7000 con 0x7fb6dc153af0 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 0x7fb6dc0a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 0x7fb6dc0a6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39612/0 (socket says 172.21.15.153:39612) 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 -- 172.21.15.153:0/1868242293 learned_addr learned my addr 172.21.15.153:0/1868242293 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:01.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6daffd700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6dc066cf0 0x7fb6dc13e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6db7fe700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc153af0 0x7fb6dc0a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 -- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc153af0 msgr2=0x7fb6dc0a6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc153af0 0x7fb6dc0a6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 -- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6dc066cf0 msgr2=0x7fb6dc13e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6dc066cf0 0x7fb6dc13e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 -- 172.21.15.153:0/1868242293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc0092a0 con 0x7fb6dc0be120 2023-08-17T00:11:01.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6db7fe700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc153af0 0x7fb6dc0a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:01.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d3fff700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 0x7fb6dc0a6460 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fb6c4009e00 tx=0x7fb6c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c400f890 con 0x7fb6dc0be120 2023-08-17T00:11:01.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c400fc50 con 0x7fb6dc0be120 2023-08-17T00:11:01.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c401b410 con 0x7fb6dc0be120 2023-08-17T00:11:01.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c40092a0 con 0x7fb6dc0be120 2023-08-17T00:11:01.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.519+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc0a75c0 con 0x7fb6dc0be120 2023-08-17T00:11:01.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.523+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc0a7da0 con 0x7fb6dc0be120 2023-08-17T00:11:01.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.523+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb6c400f070 con 0x7fb6dc0be120 2023-08-17T00:11:01.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.527+0000 7fb6d2ffd700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6c005a150 0x7fb6c005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.527+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb6c4075b60 con 0x7fb6dc0be120 2023-08-17T00:11:01.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.527+0000 7fb6daffd700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6c005a150 0x7fb6c005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.527+0000 7fb6daffd700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6c005a150 0x7fb6c005c610 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb6cc009dc0 tx=0x7fb6cc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.531+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb6c40494a0 con 0x7fb6dc0be120 2023-08-17T00:11:01.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.687+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6dc06b4c0 con 0x7fb6dc0be120 2023-08-17T00:11:01.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6d2ffd700 1 -- 172.21.15.153:0/1868242293 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16990 (secure 0 0 0) 0x7fb6c404cac0 con 0x7fb6dc0be120 2023-08-17T00:11:01.692 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:01.693 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":112,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:10:58.882982+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:10:55.905753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T00:10:56.871921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:11:01.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6c005a150 msgr2=0x7fb6c005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6c005a150 0x7fb6c005c610 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fb6cc009dc0 tx=0x7fb6cc009060).stop 2023-08-17T00:11:01.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 msgr2=0x7fb6dc0a6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 0x7fb6dc0a6460 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fb6c4009e00 tx=0x7fb6c4017000).stop 2023-08-17T00:11:01.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 shutdown_connections 2023-08-17T00:11:01.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb6c005a150 0x7fb6c005c610 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6dc153af0 0x7fb6dc0a6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb6dc0be120 0x7fb6dc0a6460 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 --2- 172.21.15.153:0/1868242293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6dc066cf0 0x7fb6dc13e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 >> 172.21.15.153:0/1868242293 conn(0x7fb6dc069750 msgr2=0x7fb6dc0c1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:01.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 shutdown_connections 2023-08-17T00:11:01.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.691+0000 7fb6e141b700 1 -- 172.21.15.153:0/1868242293 wait complete. 2023-08-17T00:11:01.716 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:11:01.717 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:11:01.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.871+0000 7f3f4a707700 1 Processor -- start 2023-08-17T00:11:01.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.871+0000 7f3f4a707700 1 -- start start 2023-08-17T00:11:01.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f4a707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f440a8df0 0x7f3f440c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f4a707700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3f44068820 0x7f3f44068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f4a707700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f44061fa0 0x7f3f44062420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f4a707700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f441585a0 con 0x7f3f44061fa0 2023-08-17T00:11:01.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f4a707700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f44066400 con 0x7f3f44068820 2023-08-17T00:11:01.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f4a707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f44069170 con 0x7f3f440a8df0 2023-08-17T00:11:01.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f44061fa0 0x7f3f44062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f44061fa0 0x7f3f44062420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39614/0 (socket says 172.21.15.153:39614) 2023-08-17T00:11:01.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 -- 172.21.15.153:0/666179821 learned_addr learned my addr 172.21.15.153:0/666179821 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:01.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49705700 1 --2- 172.21.15.153:0/666179821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f440a8df0 0x7f3f440c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f48f04700 1 --2- 172.21.15.153:0/666179821 >> v2:172.21.15.178:3300/0 conn(0x7f3f44068820 0x7f3f44068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 -- 172.21.15.153:0/666179821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f440a8df0 msgr2=0x7f3f440c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:01.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 --2- 172.21.15.153:0/666179821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f440a8df0 0x7f3f440c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 -- 172.21.15.153:0/666179821 >> v2:172.21.15.178:3300/0 conn(0x7f3f44068820 msgr2=0x7f3f44068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:01.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 --2- 172.21.15.153:0/666179821 >> v2:172.21.15.178:3300/0 conn(0x7f3f44068820 0x7f3f44068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 -- 172.21.15.153:0/666179821 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440b9d30 con 0x7f3f44061fa0 2023-08-17T00:11:01.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.875+0000 7f3f49f06700 1 --2- 172.21.15.153:0/666179821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f44061fa0 0x7f3f44062420 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f3f44066830 tx=0x7f3f3c009840).ready entity=mon.0 client_cookie=ffb40a360b48afae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f3bfff700 1 -- 172.21.15.153:0/666179821 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00e070 con 0x7f3f44061fa0 2023-08-17T00:11:01.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f3bfff700 1 -- 172.21.15.153:0/666179821 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00b970 con 0x7f3f44061fa0 2023-08-17T00:11:01.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f3bfff700 1 -- 172.21.15.153:0/666179821 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00bcf0 con 0x7f3f44061fa0 2023-08-17T00:11:01.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 -- 172.21.15.153:0/666179821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f44061fa0 msgr2=0x7f3f44062420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 --2- 172.21.15.153:0/666179821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f44061fa0 0x7f3f44062420 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f3f44066830 tx=0x7f3f3c009840).stop 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 -- 172.21.15.153:0/666179821 shutdown_connections 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 --2- 172.21.15.153:0/666179821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f44061fa0 0x7f3f44062420 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 --2- 172.21.15.153:0/666179821 >> v2:172.21.15.178:3300/0 conn(0x7f3f44068820 0x7f3f44068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 --2- 172.21.15.153:0/666179821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f440a8df0 0x7f3f440c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 -- 172.21.15.153:0/666179821 >> 172.21.15.153:0/666179821 conn(0x7f3f440c6620 msgr2=0x7f3f440c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:01.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 -- 172.21.15.153:0/666179821 shutdown_connections 2023-08-17T00:11:01.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 -- 172.21.15.153:0/666179821 wait complete. 2023-08-17T00:11:01.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 Processor -- start 2023-08-17T00:11:01.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.879+0000 7f3f4a707700 1 -- start start 2023-08-17T00:11:01.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f44061fa0 0x7f3f441567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f44068820 0x7f3f440b90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 0x7f3f44168460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4416b9c0 con 0x7f3f440a8df0 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440ba920 con 0x7f3f44061fa0 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f440bac00 con 0x7f3f44068820 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 0x7f3f44168460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 0x7f3f44168460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39630/0 (socket says 172.21.15.153:39630) 2023-08-17T00:11:01.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 -- 172.21.15.153:0/1851978808 learned_addr learned my addr 172.21.15.153:0/1851978808 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:01.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49705700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f44061fa0 0x7f3f441567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f48f04700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f44068820 0x7f3f440b90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 -- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f44068820 msgr2=0x7f3f440b90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f44068820 0x7f3f440b90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 -- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f44061fa0 msgr2=0x7f3f441567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:01.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f44061fa0 0x7f3f441567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:01.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 -- 172.21.15.153:0/1851978808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f3c009ae0 con 0x7f3f440a8df0 2023-08-17T00:11:01.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f49f06700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 0x7f3f44168460 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f3f3c00b610 tx=0x7f3f3c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c00bee0 con 0x7f3f440a8df0 2023-08-17T00:11:01.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f3c00bcf0 con 0x7f3f440a8df0 2023-08-17T00:11:01.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f440baee0 con 0x7f3f440a8df0 2023-08-17T00:11:01.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c01d6b0 con 0x7f3f440a8df0 2023-08-17T00:11:01.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.883+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f44156c90 con 0x7f3f440a8df0 2023-08-17T00:11:01.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.887+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f440c24f0 con 0x7f3f440a8df0 2023-08-17T00:11:01.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.887+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3f3c024030 con 0x7f3f440a8df0 2023-08-17T00:11:01.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.887+0000 7f3f397fa700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f2805a150 0x7f3f2805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:01.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.887+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3f3c0753c0 con 0x7f3f440a8df0 2023-08-17T00:11:01.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.891+0000 7f3f49705700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f2805a150 0x7f3f2805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:01.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.891+0000 7f3f49705700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f2805a150 0x7f3f2805c610 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f3f440be020 tx=0x7f3f40006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:01.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:01.895+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f440c24f0 con 0x7f3f440a8df0 2023-08-17T00:11:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.055+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f4416bb00 con 0x7f3f2805a150 2023-08-17T00:11:02.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.075+0000 7f3f397fa700 1 -- 172.21.15.153:0/1851978808 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359712 (secure 0 0 0) 0x7f3f400098b0 con 0x7f3f2805a150 2023-08-17T00:11:02.083 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:02.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f2805a150 msgr2=0x7f3f2805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f2805a150 0x7f3f2805c610 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f3f440be020 tx=0x7f3f40006f40).stop 2023-08-17T00:11:02.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 msgr2=0x7f3f44168460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 0x7f3f44168460 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 rx=0x7f3f3c00b610 tx=0x7f3f3c009840).stop 2023-08-17T00:11:02.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 shutdown_connections 2023-08-17T00:11:02.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3f2805a150 0x7f3f2805c610 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f440a8df0 0x7f3f44168460 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f44068820 0x7f3f440b90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 --2- 172.21.15.153:0/1851978808 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f44061fa0 0x7f3f441567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 >> 172.21.15.153:0/1851978808 conn(0x7f3f440c6620 msgr2=0x7f3f440c5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:02.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 shutdown_connections 2023-08-17T00:11:02.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.083+0000 7f3f4a707700 1 -- 172.21.15.153:0/1851978808 wait complete. 2023-08-17T00:11:02.090 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:11:02.105 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-08-17T00:11:01.356760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429512,"kb_used_data":10760,"kb_used_omap":0,"kb_used_meta":2418688,"kb_avail":752545208,"statfs":{"total":773094113280,"available":770606292992,"internally_reserved":0,"allocated":11018240,"data_stored":5097591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476736512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077797034,"num_objects":-1059,"num_object_clones":0,"num_object_copies":-2118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3160,"num_write_kb":-1053257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-102,"num_bytes_recovered":-106954752,"num_keys_recovered":0,"num_objects_omap":-34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.841754"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919332+0000","last_change":"2023-08-17T00:10:57.908971+0000","last_active":"2023-08-17T00:10:57.919332+0000","last_peered":"2023-08-17T00:10:57.919332+0000","last_clean":"2023-08-17T00:10:57.919332+0000","last_became_active":"2023-08-17T00:10:57.908704+0000","last_became_peered":"2023-08-17T00:10:57.908704+0000","last_unstale":"2023-08-17T00:10:57.919332+0000","last_undegraded":"2023-08-17T00:10:57.919332+0000","last_fullsized":"2023-08-17T00:10:57.919332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3f","version":"111'3","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920390+0000","last_change":"2023-08-17T00:10:57.469650+0000","last_active":"2023-08-17T00:10:57.920390+0000","last_peered":"2023-08-17T00:10:57.920390+0000","last_clean":"2023-08-17T00:10:57.920390+0000","last_became_active":"2023-08-17T00:10:57.469360+0000","last_became_peered":"2023-08-17T00:10:57.469360+0000","last_unstale":"2023-08-17T00:10:57.920390+0000","last_undegraded":"2023-08-17T00:10:57.920390+0000","last_fullsized":"2023-08-17T00:10:57.920390+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921447+0000","last_change":"2023-08-17T00:10:57.915544+0000","last_active":"2023-08-17T00:10:57.921447+0000","last_peered":"2023-08-17T00:10:57.921447+0000","last_clean":"2023-08-17T00:10:57.921447+0000","last_became_active":"2023-08-17T00:10:57.915149+0000","last_became_peered":"2023-08-17T00:10:57.915149+0000","last_unstale":"2023-08-17T00:10:57.921447+0000","last_undegraded":"2023-08-17T00:10:57.921447+0000","last_fullsized":"2023-08-17T00:10:57.921447+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911241+0000","last_change":"2023-08-17T00:10:57.468347+0000","last_active":"2023-08-17T00:10:57.911241+0000","last_peered":"2023-08-17T00:10:57.911241+0000","last_clean":"2023-08-17T00:10:57.911241+0000","last_became_active":"2023-08-17T00:10:57.467921+0000","last_became_peered":"2023-08-17T00:10:57.467921+0000","last_unstale":"2023-08-17T00:10:57.911241+0000","last_undegraded":"2023-08-17T00:10:57.911241+0000","last_fullsized":"2023-08-17T00:10:57.911241+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.902498+0000","last_change":"2023-08-17T00:10:57.897499+0000","last_active":"2023-08-17T00:10:57.902498+0000","last_peered":"2023-08-17T00:10:57.902498+0000","last_clean":"2023-08-17T00:10:57.902498+0000","last_became_active":"2023-08-17T00:10:57.897249+0000","last_became_peered":"2023-08-17T00:10:57.897249+0000","last_unstale":"2023-08-17T00:10:57.902498+0000","last_undegraded":"2023-08-17T00:10:57.902498+0000","last_fullsized":"2023-08-17T00:10:57.902498+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.475849+0000","last_change":"2023-08-17T00:10:57.467490+0000","last_active":"2023-08-17T00:10:57.475849+0000","last_peered":"2023-08-17T00:10:57.475849+0000","last_clean":"2023-08-17T00:10:57.475849+0000","last_became_active":"2023-08-17T00:10:57.467091+0000","last_became_peered":"2023-08-17T00:10:57.467091+0000","last_unstale":"2023-08-17T00:10:57.475849+0000","last_undegraded":"2023-08-17T00:10:57.475849+0000","last_fullsized":"2023-08-17T00:10:57.475849+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922471+0000","last_change":"2023-08-17T00:10:57.919261+0000","last_active":"2023-08-17T00:10:57.922471+0000","last_peered":"2023-08-17T00:10:57.922471+0000","last_clean":"2023-08-17T00:10:57.922471+0000","last_became_active":"2023-08-17T00:10:57.919014+0000","last_became_peered":"2023-08-17T00:10:57.919014+0000","last_unstale":"2023-08-17T00:10:57.922471+0000","last_undegraded":"2023-08-17T00:10:57.922471+0000","last_fullsized":"2023-08-17T00:10:57.922471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922722+0000","last_change":"2023-08-17T00:10:57.469809+0000","last_active":"2023-08-17T00:10:57.922722+0000","last_peered":"2023-08-17T00:10:57.922722+0000","last_clean":"2023-08-17T00:10:57.922722+0000","last_became_active":"2023-08-17T00:10:57.466444+0000","last_became_peered":"2023-08-17T00:10:57.466444+0000","last_unstale":"2023-08-17T00:10:57.922722+0000","last_undegraded":"2023-08-17T00:10:57.922722+0000","last_fullsized":"2023-08-17T00:10:57.922722+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920840+0000","last_change":"2023-08-17T00:10:57.913387+0000","last_active":"2023-08-17T00:10:57.920840+0000","last_peered":"2023-08-17T00:10:57.920840+0000","last_clean":"2023-08-17T00:10:57.920840+0000","last_became_active":"2023-08-17T00:10:57.913100+0000","last_became_peered":"2023-08-17T00:10:57.913100+0000","last_unstale":"2023-08-17T00:10:57.920840+0000","last_undegraded":"2023-08-17T00:10:57.920840+0000","last_fullsized":"2023-08-17T00:10:57.920840+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3b","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918591+0000","last_change":"2023-08-17T00:10:57.461666+0000","last_active":"2023-08-17T00:10:57.918591+0000","last_peered":"2023-08-17T00:10:57.918591+0000","last_clean":"2023-08-17T00:10:57.918591+0000","last_became_active":"2023-08-17T00:10:57.461315+0000","last_became_peered":"2023-08-17T00:10:57.461315+0000","last_unstale":"2023-08-17T00:10:57.918591+0000","last_undegraded":"2023-08-17T00:10:57.918591+0000","last_fullsized":"2023-08-17T00:10:57.918591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918340+0000","last_change":"2023-08-17T00:10:57.911821+0000","last_active":"2023-08-17T00:10:57.918340+0000","last_peered":"2023-08-17T00:10:57.918340+0000","last_clean":"2023-08-17T00:10:57.918340+0000","last_became_active":"2023-08-17T00:10:57.911547+0000","last_became_peered":"2023-08-17T00:10:57.911547+0000","last_unstale":"2023-08-17T00:10:57.918340+0000","last_undegraded":"2023-08-17T00:10:57.918340+0000","last_fullsized":"2023-08-17T00:10:57.918340+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.912153+0000","last_change":"2023-08-17T00:10:57.463890+0000","last_active":"2023-08-17T00:10:57.912153+0000","last_peered":"2023-08-17T00:10:57.912153+0000","last_clean":"2023-08-17T00:10:57.912153+0000","last_became_active":"2023-08-17T00:10:57.463443+0000","last_became_peered":"2023-08-17T00:10:57.463443+0000","last_unstale":"2023-08-17T00:10:57.912153+0000","last_undegraded":"2023-08-17T00:10:57.912153+0000","last_fullsized":"2023-08-17T00:10:57.912153+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918328+0000","last_change":"2023-08-17T00:10:57.911969+0000","last_active":"2023-08-17T00:10:57.918328+0000","last_peered":"2023-08-17T00:10:57.918328+0000","last_clean":"2023-08-17T00:10:57.918328+0000","last_became_active":"2023-08-17T00:10:57.911652+0000","last_became_peered":"2023-08-17T00:10:57.911652+0000","last_unstale":"2023-08-17T00:10:57.918328+0000","last_undegraded":"2023-08-17T00:10:57.918328+0000","last_fullsized":"2023-08-17T00:10:57.918328+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888283+0000","last_change":"2023-08-17T00:10:57.466720+0000","last_active":"2023-08-17T00:10:57.888283+0000","last_peered":"2023-08-17T00:10:57.888283+0000","last_clean":"2023-08-17T00:10:57.888283+0000","last_became_active":"2023-08-17T00:10:57.466398+0000","last_became_peered":"2023-08-17T00:10:57.466398+0000","last_unstale":"2023-08-17T00:10:57.888283+0000","last_undegraded":"2023-08-17T00:10:57.888283+0000","last_fullsized":"2023-08-17T00:10:57.888283+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918311+0000","last_change":"2023-08-17T00:10:57.911488+0000","last_active":"2023-08-17T00:10:57.918311+0000","last_peered":"2023-08-17T00:10:57.918311+0000","last_clean":"2023-08-17T00:10:57.918311+0000","last_became_active":"2023-08-17T00:10:57.911212+0000","last_became_peered":"2023-08-17T00:10:57.911212+0000","last_unstale":"2023-08-17T00:10:57.918311+0000","last_undegraded":"2023-08-17T00:10:57.918311+0000","last_fullsized":"2023-08-17T00:10:57.918311+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.476047+0000","last_change":"2023-08-17T00:10:57.467449+0000","last_active":"2023-08-17T00:10:57.476047+0000","last_peered":"2023-08-17T00:10:57.476047+0000","last_clean":"2023-08-17T00:10:57.476047+0000","last_became_active":"2023-08-17T00:10:57.467111+0000","last_became_peered":"2023-08-17T00:10:57.467111+0000","last_unstale":"2023-08-17T00:10:57.476047+0000","last_undegraded":"2023-08-17T00:10:57.476047+0000","last_fullsized":"2023-08-17T00:10:57.476047+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922300+0000","last_change":"2023-08-17T00:10:57.917539+0000","last_active":"2023-08-17T00:10:57.922300+0000","last_peered":"2023-08-17T00:10:57.922300+0000","last_clean":"2023-08-17T00:10:57.922300+0000","last_became_active":"2023-08-17T00:10:57.917254+0000","last_became_peered":"2023-08-17T00:10:57.917254+0000","last_unstale":"2023-08-17T00:10:57.922300+0000","last_undegraded":"2023-08-17T00:10:57.922300+0000","last_fullsized":"2023-08-17T00:10:57.922300+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888597+0000","last_change":"2023-08-17T00:10:57.478955+0000","last_active":"2023-08-17T00:10:57.888597+0000","last_peered":"2023-08-17T00:10:57.888597+0000","last_clean":"2023-08-17T00:10:57.888597+0000","last_became_active":"2023-08-17T00:10:57.478599+0000","last_became_peered":"2023-08-17T00:10:57.478599+0000","last_unstale":"2023-08-17T00:10:57.888597+0000","last_undegraded":"2023-08-17T00:10:57.888597+0000","last_fullsized":"2023-08-17T00:10:57.888597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922347+0000","last_change":"2023-08-17T00:10:57.917827+0000","last_active":"2023-08-17T00:10:57.922347+0000","last_peered":"2023-08-17T00:10:57.922347+0000","last_clean":"2023-08-17T00:10:57.922347+0000","last_became_active":"2023-08-17T00:10:57.917576+0000","last_became_peered":"2023-08-17T00:10:57.917576+0000","last_unstale":"2023-08-17T00:10:57.922347+0000","last_undegraded":"2023-08-17T00:10:57.922347+0000","last_fullsized":"2023-08-17T00:10:57.922347+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892912+0000","last_change":"2023-08-17T00:10:57.464559+0000","last_active":"2023-08-17T00:10:57.892912+0000","last_peered":"2023-08-17T00:10:57.892912+0000","last_clean":"2023-08-17T00:10:57.892912+0000","last_became_active":"2023-08-17T00:10:57.464161+0000","last_became_peered":"2023-08-17T00:10:57.464161+0000","last_unstale":"2023-08-17T00:10:57.892912+0000","last_undegraded":"2023-08-17T00:10:57.892912+0000","last_fullsized":"2023-08-17T00:10:57.892912+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919008+0000","last_change":"2023-08-17T00:10:57.908440+0000","last_active":"2023-08-17T00:10:57.919008+0000","last_peered":"2023-08-17T00:10:57.919008+0000","last_clean":"2023-08-17T00:10:57.919008+0000","last_became_active":"2023-08-17T00:10:57.908157+0000","last_became_peered":"2023-08-17T00:10:57.908157+0000","last_unstale":"2023-08-17T00:10:57.919008+0000","last_undegraded":"2023-08-17T00:10:57.919008+0000","last_fullsized":"2023-08-17T00:10:57.919008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887408+0000","last_change":"2023-08-17T00:10:57.463614+0000","last_active":"2023-08-17T00:10:57.887408+0000","last_peered":"2023-08-17T00:10:57.887408+0000","last_clean":"2023-08-17T00:10:57.887408+0000","last_became_active":"2023-08-17T00:10:57.463307+0000","last_became_peered":"2023-08-17T00:10:57.463307+0000","last_unstale":"2023-08-17T00:10:57.887408+0000","last_undegraded":"2023-08-17T00:10:57.887408+0000","last_fullsized":"2023-08-17T00:10:57.887408+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.905635+0000","last_change":"2023-08-17T00:10:57.898744+0000","last_active":"2023-08-17T00:10:57.905635+0000","last_peered":"2023-08-17T00:10:57.905635+0000","last_clean":"2023-08-17T00:10:57.905635+0000","last_became_active":"2023-08-17T00:10:57.898459+0000","last_became_peered":"2023-08-17T00:10:57.898459+0000","last_unstale":"2023-08-17T00:10:57.905635+0000","last_undegraded":"2023-08-17T00:10:57.905635+0000","last_fullsized":"2023-08-17T00:10:57.905635+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.925546+0000","last_change":"2023-08-17T00:10:57.475813+0000","last_active":"2023-08-17T00:10:57.925546+0000","last_peered":"2023-08-17T00:10:57.925546+0000","last_clean":"2023-08-17T00:10:57.925546+0000","last_became_active":"2023-08-17T00:10:57.475356+0000","last_became_peered":"2023-08-17T00:10:57.475356+0000","last_unstale":"2023-08-17T00:10:57.925546+0000","last_undegraded":"2023-08-17T00:10:57.925546+0000","last_fullsized":"2023-08-17T00:10:57.925546+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918234+0000","last_change":"2023-08-17T00:10:57.911247+0000","last_active":"2023-08-17T00:10:57.918234+0000","last_peered":"2023-08-17T00:10:57.918234+0000","last_clean":"2023-08-17T00:10:57.918234+0000","last_became_active":"2023-08-17T00:10:57.910953+0000","last_became_peered":"2023-08-17T00:10:57.910953+0000","last_unstale":"2023-08-17T00:10:57.918234+0000","last_undegraded":"2023-08-17T00:10:57.918234+0000","last_fullsized":"2023-08-17T00:10:57.918234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910102+0000","last_change":"2023-08-17T00:10:57.466313+0000","last_active":"2023-08-17T00:10:57.910102+0000","last_peered":"2023-08-17T00:10:57.910102+0000","last_clean":"2023-08-17T00:10:57.910102+0000","last_became_active":"2023-08-17T00:10:57.465936+0000","last_became_peered":"2023-08-17T00:10:57.465936+0000","last_unstale":"2023-08-17T00:10:57.910102+0000","last_undegraded":"2023-08-17T00:10:57.910102+0000","last_fullsized":"2023-08-17T00:10:57.910102+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.903884+0000","last_change":"2023-08-17T00:10:57.903884+0000","last_active":"2023-08-17T00:10:57.903884+0000","last_peered":"2023-08-17T00:10:57.903884+0000","last_clean":"2023-08-17T00:10:57.903884+0000","last_became_active":"2023-08-17T00:10:57.903580+0000","last_became_peered":"2023-08-17T00:10:57.903580+0000","last_unstale":"2023-08-17T00:10:57.903884+0000","last_undegraded":"2023-08-17T00:10:57.903884+0000","last_fullsized":"2023-08-17T00:10:57.903884+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.903930+0000","last_change":"2023-08-17T00:10:57.466424+0000","last_active":"2023-08-17T00:10:57.903930+0000","last_peered":"2023-08-17T00:10:57.903930+0000","last_clean":"2023-08-17T00:10:57.903930+0000","last_became_active":"2023-08-17T00:10:57.466122+0000","last_became_peered":"2023-08-17T00:10:57.466122+0000","last_unstale":"2023-08-17T00:10:57.903930+0000","last_undegraded":"2023-08-17T00:10:57.903930+0000","last_fullsized":"2023-08-17T00:10:57.903930+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918615+0000","last_change":"2023-08-17T00:10:57.913848+0000","last_active":"2023-08-17T00:10:57.918615+0000","last_peered":"2023-08-17T00:10:57.918615+0000","last_clean":"2023-08-17T00:10:57.918615+0000","last_became_active":"2023-08-17T00:10:57.912597+0000","last_became_peered":"2023-08-17T00:10:57.912597+0000","last_unstale":"2023-08-17T00:10:57.918615+0000","last_undegraded":"2023-08-17T00:10:57.918615+0000","last_fullsized":"2023-08-17T00:10:57.918615+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904438+0000","last_change":"2023-08-17T00:10:57.476080+0000","last_active":"2023-08-17T00:10:57.904438+0000","last_peered":"2023-08-17T00:10:57.904438+0000","last_clean":"2023-08-17T00:10:57.904438+0000","last_became_active":"2023-08-17T00:10:57.475798+0000","last_became_peered":"2023-08-17T00:10:57.475798+0000","last_unstale":"2023-08-17T00:10:57.904438+0000","last_undegraded":"2023-08-17T00:10:57.904438+0000","last_fullsized":"2023-08-17T00:10:57.904438+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921230+0000","last_change":"2023-08-17T00:10:57.905860+0000","last_active":"2023-08-17T00:10:57.921230+0000","last_peered":"2023-08-17T00:10:57.921230+0000","last_clean":"2023-08-17T00:10:57.921230+0000","last_became_active":"2023-08-17T00:10:57.905412+0000","last_became_peered":"2023-08-17T00:10:57.905412+0000","last_unstale":"2023-08-17T00:10:57.921230+0000","last_undegraded":"2023-08-17T00:10:57.921230+0000","last_fullsized":"2023-08-17T00:10:57.921230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.30","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.924798+0000","last_change":"2023-08-17T00:10:57.460360+0000","last_active":"2023-08-17T00:10:57.924798+0000","last_peered":"2023-08-17T00:10:57.924798+0000","last_clean":"2023-08-17T00:10:57.924798+0000","last_became_active":"2023-08-17T00:10:57.460051+0000","last_became_peered":"2023-08-17T00:10:57.460051+0000","last_unstale":"2023-08-17T00:10:57.924798+0000","last_undegraded":"2023-08-17T00:10:57.924798+0000","last_fullsized":"2023-08-17T00:10:57.924798+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918704+0000","last_change":"2023-08-17T00:10:57.914425+0000","last_active":"2023-08-17T00:10:57.918704+0000","last_peered":"2023-08-17T00:10:57.918704+0000","last_clean":"2023-08-17T00:10:57.918704+0000","last_became_active":"2023-08-17T00:10:57.914154+0000","last_became_peered":"2023-08-17T00:10:57.914154+0000","last_unstale":"2023-08-17T00:10:57.918704+0000","last_undegraded":"2023-08-17T00:10:57.918704+0000","last_fullsized":"2023-08-17T00:10:57.918704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891600+0000","last_change":"2023-08-17T00:10:57.454615+0000","last_active":"2023-08-17T00:10:57.891600+0000","last_peered":"2023-08-17T00:10:57.891600+0000","last_clean":"2023-08-17T00:10:57.891600+0000","last_became_active":"2023-08-17T00:10:57.454316+0000","last_became_peered":"2023-08-17T00:10:57.454316+0000","last_unstale":"2023-08-17T00:10:57.891600+0000","last_undegraded":"2023-08-17T00:10:57.891600+0000","last_fullsized":"2023-08-17T00:10:57.891600+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918721+0000","last_change":"2023-08-17T00:10:57.913802+0000","last_active":"2023-08-17T00:10:57.918721+0000","last_peered":"2023-08-17T00:10:57.918721+0000","last_clean":"2023-08-17T00:10:57.918721+0000","last_became_active":"2023-08-17T00:10:57.912847+0000","last_became_peered":"2023-08-17T00:10:57.912847+0000","last_unstale":"2023-08-17T00:10:57.918721+0000","last_undegraded":"2023-08-17T00:10:57.918721+0000","last_fullsized":"2023-08-17T00:10:57.918721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911339+0000","last_change":"2023-08-17T00:10:57.476186+0000","last_active":"2023-08-17T00:10:57.911339+0000","last_peered":"2023-08-17T00:10:57.911339+0000","last_clean":"2023-08-17T00:10:57.911339+0000","last_became_active":"2023-08-17T00:10:57.475889+0000","last_became_peered":"2023-08-17T00:10:57.475889+0000","last_unstale":"2023-08-17T00:10:57.911339+0000","last_undegraded":"2023-08-17T00:10:57.911339+0000","last_fullsized":"2023-08-17T00:10:57.911339+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921443+0000","last_change":"2023-08-17T00:10:57.915326+0000","last_active":"2023-08-17T00:10:57.921443+0000","last_peered":"2023-08-17T00:10:57.921443+0000","last_clean":"2023-08-17T00:10:57.921443+0000","last_became_active":"2023-08-17T00:10:57.914922+0000","last_became_peered":"2023-08-17T00:10:57.914922+0000","last_unstale":"2023-08-17T00:10:57.921443+0000","last_undegraded":"2023-08-17T00:10:57.921443+0000","last_fullsized":"2023-08-17T00:10:57.921443+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921340+0000","last_change":"2023-08-17T00:10:57.458187+0000","last_active":"2023-08-17T00:10:57.921340+0000","last_peered":"2023-08-17T00:10:57.921340+0000","last_clean":"2023-08-17T00:10:57.921340+0000","last_became_active":"2023-08-17T00:10:57.457896+0000","last_became_peered":"2023-08-17T00:10:57.457896+0000","last_unstale":"2023-08-17T00:10:57.921340+0000","last_undegraded":"2023-08-17T00:10:57.921340+0000","last_fullsized":"2023-08-17T00:10:57.921340+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911789+0000","last_change":"2023-08-17T00:10:57.911789+0000","last_active":"2023-08-17T00:10:57.911789+0000","last_peered":"2023-08-17T00:10:57.911789+0000","last_clean":"2023-08-17T00:10:57.911789+0000","last_became_active":"2023-08-17T00:10:57.911461+0000","last_became_peered":"2023-08-17T00:10:57.911461+0000","last_unstale":"2023-08-17T00:10:57.911789+0000","last_undegraded":"2023-08-17T00:10:57.911789+0000","last_fullsized":"2023-08-17T00:10:57.911789+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891787+0000","last_change":"2023-08-17T00:10:57.462621+0000","last_active":"2023-08-17T00:10:57.891787+0000","last_peered":"2023-08-17T00:10:57.891787+0000","last_clean":"2023-08-17T00:10:57.891787+0000","last_became_active":"2023-08-17T00:10:57.462316+0000","last_became_peered":"2023-08-17T00:10:57.462316+0000","last_unstale":"2023-08-17T00:10:57.891787+0000","last_undegraded":"2023-08-17T00:10:57.891787+0000","last_fullsized":"2023-08-17T00:10:57.891787+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921978+0000","last_change":"2023-08-17T00:10:57.915835+0000","last_active":"2023-08-17T00:10:57.921978+0000","last_peered":"2023-08-17T00:10:57.921978+0000","last_clean":"2023-08-17T00:10:57.921978+0000","last_became_active":"2023-08-17T00:10:57.914419+0000","last_became_peered":"2023-08-17T00:10:57.914419+0000","last_unstale":"2023-08-17T00:10:57.921978+0000","last_undegraded":"2023-08-17T00:10:57.921978+0000","last_fullsized":"2023-08-17T00:10:57.921978+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2b","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892122+0000","last_change":"2023-08-17T00:10:57.468674+0000","last_active":"2023-08-17T00:10:57.892122+0000","last_peered":"2023-08-17T00:10:57.892122+0000","last_clean":"2023-08-17T00:10:57.892122+0000","last_became_active":"2023-08-17T00:10:57.468242+0000","last_became_peered":"2023-08-17T00:10:57.468242+0000","last_unstale":"2023-08-17T00:10:57.892122+0000","last_undegraded":"2023-08-17T00:10:57.892122+0000","last_fullsized":"2023-08-17T00:10:57.892122+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.902205+0000","last_change":"2023-08-17T00:10:57.897430+0000","last_active":"2023-08-17T00:10:57.902205+0000","last_peered":"2023-08-17T00:10:57.902205+0000","last_clean":"2023-08-17T00:10:57.902205+0000","last_became_active":"2023-08-17T00:10:57.897142+0000","last_became_peered":"2023-08-17T00:10:57.897142+0000","last_unstale":"2023-08-17T00:10:57.902205+0000","last_undegraded":"2023-08-17T00:10:57.902205+0000","last_fullsized":"2023-08-17T00:10:57.902205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.475821+0000","last_change":"2023-08-17T00:10:57.467523+0000","last_active":"2023-08-17T00:10:57.475821+0000","last_peered":"2023-08-17T00:10:57.475821+0000","last_clean":"2023-08-17T00:10:57.475821+0000","last_became_active":"2023-08-17T00:10:57.467203+0000","last_became_peered":"2023-08-17T00:10:57.467203+0000","last_unstale":"2023-08-17T00:10:57.475821+0000","last_undegraded":"2023-08-17T00:10:57.475821+0000","last_fullsized":"2023-08-17T00:10:57.475821+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922563+0000","last_change":"2023-08-17T00:10:57.919953+0000","last_active":"2023-08-17T00:10:57.922563+0000","last_peered":"2023-08-17T00:10:57.922563+0000","last_clean":"2023-08-17T00:10:57.922563+0000","last_became_active":"2023-08-17T00:10:57.919638+0000","last_became_peered":"2023-08-17T00:10:57.919638+0000","last_unstale":"2023-08-17T00:10:57.922563+0000","last_undegraded":"2023-08-17T00:10:57.922563+0000","last_fullsized":"2023-08-17T00:10:57.922563+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904567+0000","last_change":"2023-08-17T00:10:57.456658+0000","last_active":"2023-08-17T00:10:57.904567+0000","last_peered":"2023-08-17T00:10:57.904567+0000","last_clean":"2023-08-17T00:10:57.904567+0000","last_became_active":"2023-08-17T00:10:57.456222+0000","last_became_peered":"2023-08-17T00:10:57.456222+0000","last_unstale":"2023-08-17T00:10:57.904567+0000","last_undegraded":"2023-08-17T00:10:57.904567+0000","last_fullsized":"2023-08-17T00:10:57.904567+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918541+0000","last_change":"2023-08-17T00:10:57.913441+0000","last_active":"2023-08-17T00:10:57.918541+0000","last_peered":"2023-08-17T00:10:57.918541+0000","last_clean":"2023-08-17T00:10:57.918541+0000","last_became_active":"2023-08-17T00:10:57.913125+0000","last_became_peered":"2023-08-17T00:10:57.913125+0000","last_unstale":"2023-08-17T00:10:57.918541+0000","last_undegraded":"2023-08-17T00:10:57.918541+0000","last_fullsized":"2023-08-17T00:10:57.918541+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.893229+0000","last_change":"2023-08-17T00:10:57.465387+0000","last_active":"2023-08-17T00:10:57.893229+0000","last_peered":"2023-08-17T00:10:57.893229+0000","last_clean":"2023-08-17T00:10:57.893229+0000","last_became_active":"2023-08-17T00:10:57.465117+0000","last_became_peered":"2023-08-17T00:10:57.465117+0000","last_unstale":"2023-08-17T00:10:57.893229+0000","last_undegraded":"2023-08-17T00:10:57.893229+0000","last_fullsized":"2023-08-17T00:10:57.893229+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922607+0000","last_change":"2023-08-17T00:10:57.920047+0000","last_active":"2023-08-17T00:10:57.922607+0000","last_peered":"2023-08-17T00:10:57.922607+0000","last_clean":"2023-08-17T00:10:57.922607+0000","last_became_active":"2023-08-17T00:10:57.919772+0000","last_became_peered":"2023-08-17T00:10:57.919772+0000","last_unstale":"2023-08-17T00:10:57.922607+0000","last_undegraded":"2023-08-17T00:10:57.922607+0000","last_fullsized":"2023-08-17T00:10:57.922607+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.895343+0000","last_change":"2023-08-17T00:10:57.465141+0000","last_active":"2023-08-17T00:10:57.895343+0000","last_peered":"2023-08-17T00:10:57.895343+0000","last_clean":"2023-08-17T00:10:57.895343+0000","last_became_active":"2023-08-17T00:10:57.464883+0000","last_became_peered":"2023-08-17T00:10:57.464883+0000","last_unstale":"2023-08-17T00:10:57.895343+0000","last_undegraded":"2023-08-17T00:10:57.895343+0000","last_fullsized":"2023-08-17T00:10:57.895343+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920785+0000","last_change":"2023-08-17T00:10:57.912707+0000","last_active":"2023-08-17T00:10:57.920785+0000","last_peered":"2023-08-17T00:10:57.920785+0000","last_clean":"2023-08-17T00:10:57.920785+0000","last_became_active":"2023-08-17T00:10:57.912287+0000","last_became_peered":"2023-08-17T00:10:57.912287+0000","last_unstale":"2023-08-17T00:10:57.920785+0000","last_undegraded":"2023-08-17T00:10:57.920785+0000","last_fullsized":"2023-08-17T00:10:57.920785+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.897114+0000","last_change":"2023-08-17T00:10:57.471540+0000","last_active":"2023-08-17T00:10:57.897114+0000","last_peered":"2023-08-17T00:10:57.897114+0000","last_clean":"2023-08-17T00:10:57.897114+0000","last_became_active":"2023-08-17T00:10:57.471180+0000","last_became_peered":"2023-08-17T00:10:57.471180+0000","last_unstale":"2023-08-17T00:10:57.897114+0000","last_undegraded":"2023-08-17T00:10:57.897114+0000","last_fullsized":"2023-08-17T00:10:57.897114+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.915137+0000","last_change":"2023-08-17T00:10:57.908803+0000","last_active":"2023-08-17T00:10:57.915137+0000","last_peered":"2023-08-17T00:10:57.915137+0000","last_clean":"2023-08-17T00:10:57.915137+0000","last_became_active":"2023-08-17T00:10:57.908535+0000","last_became_peered":"2023-08-17T00:10:57.908535+0000","last_unstale":"2023-08-17T00:10:57.915137+0000","last_undegraded":"2023-08-17T00:10:57.915137+0000","last_fullsized":"2023-08-17T00:10:57.915137+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894048+0000","last_change":"2023-08-17T00:10:57.457682+0000","last_active":"2023-08-17T00:10:57.894048+0000","last_peered":"2023-08-17T00:10:57.894048+0000","last_clean":"2023-08-17T00:10:57.894048+0000","last_became_active":"2023-08-17T00:10:57.456941+0000","last_became_peered":"2023-08-17T00:10:57.456941+0000","last_unstale":"2023-08-17T00:10:57.894048+0000","last_undegraded":"2023-08-17T00:10:57.894048+0000","last_fullsized":"2023-08-17T00:10:57.894048+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.907111+0000","last_change":"2023-08-17T00:10:57.907111+0000","last_active":"2023-08-17T00:10:57.907111+0000","last_peered":"2023-08-17T00:10:57.907111+0000","last_clean":"2023-08-17T00:10:57.907111+0000","last_became_active":"2023-08-17T00:10:57.906198+0000","last_became_peered":"2023-08-17T00:10:57.906198+0000","last_unstale":"2023-08-17T00:10:57.907111+0000","last_undegraded":"2023-08-17T00:10:57.907111+0000","last_fullsized":"2023-08-17T00:10:57.907111+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894784+0000","last_change":"2023-08-17T00:10:57.478615+0000","last_active":"2023-08-17T00:10:57.894784+0000","last_peered":"2023-08-17T00:10:57.894784+0000","last_clean":"2023-08-17T00:10:57.894784+0000","last_became_active":"2023-08-17T00:10:57.478286+0000","last_became_peered":"2023-08-17T00:10:57.478286+0000","last_unstale":"2023-08-17T00:10:57.894784+0000","last_undegraded":"2023-08-17T00:10:57.894784+0000","last_fullsized":"2023-08-17T00:10:57.894784+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910649+0000","last_change":"2023-08-17T00:10:57.910649+0000","last_active":"2023-08-17T00:10:57.910649+0000","last_peered":"2023-08-17T00:10:57.910649+0000","last_clean":"2023-08-17T00:10:57.910649+0000","last_became_active":"2023-08-17T00:10:57.909585+0000","last_became_peered":"2023-08-17T00:10:57.909585+0000","last_unstale":"2023-08-17T00:10:57.910649+0000","last_undegraded":"2023-08-17T00:10:57.910649+0000","last_fullsized":"2023-08-17T00:10:57.910649+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.896859+0000","last_change":"2023-08-17T00:10:57.466976+0000","last_active":"2023-08-17T00:10:57.896859+0000","last_peered":"2023-08-17T00:10:57.896859+0000","last_clean":"2023-08-17T00:10:57.896859+0000","last_became_active":"2023-08-17T00:10:57.466690+0000","last_became_peered":"2023-08-17T00:10:57.466690+0000","last_unstale":"2023-08-17T00:10:57.896859+0000","last_undegraded":"2023-08-17T00:10:57.896859+0000","last_fullsized":"2023-08-17T00:10:57.896859+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921421+0000","last_change":"2023-08-17T00:10:57.906400+0000","last_active":"2023-08-17T00:10:57.921421+0000","last_peered":"2023-08-17T00:10:57.921421+0000","last_clean":"2023-08-17T00:10:57.921421+0000","last_became_active":"2023-08-17T00:10:57.906144+0000","last_became_peered":"2023-08-17T00:10:57.906144+0000","last_unstale":"2023-08-17T00:10:57.921421+0000","last_undegraded":"2023-08-17T00:10:57.921421+0000","last_fullsized":"2023-08-17T00:10:57.921421+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.895991+0000","last_change":"2023-08-17T00:10:57.463883+0000","last_active":"2023-08-17T00:10:57.895991+0000","last_peered":"2023-08-17T00:10:57.895991+0000","last_clean":"2023-08-17T00:10:57.895991+0000","last_became_active":"2023-08-17T00:10:57.463591+0000","last_became_peered":"2023-08-17T00:10:57.463591+0000","last_unstale":"2023-08-17T00:10:57.895991+0000","last_undegraded":"2023-08-17T00:10:57.895991+0000","last_fullsized":"2023-08-17T00:10:57.895991+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.907982+0000","last_change":"2023-08-17T00:10:57.906316+0000","last_active":"2023-08-17T00:10:57.907982+0000","last_peered":"2023-08-17T00:10:57.907982+0000","last_clean":"2023-08-17T00:10:57.907982+0000","last_became_active":"2023-08-17T00:10:57.906042+0000","last_became_peered":"2023-08-17T00:10:57.906042+0000","last_unstale":"2023-08-17T00:10:57.907982+0000","last_undegraded":"2023-08-17T00:10:57.907982+0000","last_fullsized":"2023-08-17T00:10:57.907982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.477054+0000","last_change":"2023-08-17T00:10:57.471645+0000","last_active":"2023-08-17T00:10:57.477054+0000","last_peered":"2023-08-17T00:10:57.477054+0000","last_clean":"2023-08-17T00:10:57.477054+0000","last_became_active":"2023-08-17T00:10:57.471172+0000","last_became_peered":"2023-08-17T00:10:57.471172+0000","last_unstale":"2023-08-17T00:10:57.477054+0000","last_undegraded":"2023-08-17T00:10:57.477054+0000","last_fullsized":"2023-08-17T00:10:57.477054+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.908518+0000","last_change":"2023-08-17T00:10:57.908518+0000","last_active":"2023-08-17T00:10:57.908518+0000","last_peered":"2023-08-17T00:10:57.908518+0000","last_clean":"2023-08-17T00:10:57.908518+0000","last_became_active":"2023-08-17T00:10:57.908109+0000","last_became_peered":"2023-08-17T00:10:57.908109+0000","last_unstale":"2023-08-17T00:10:57.908518+0000","last_undegraded":"2023-08-17T00:10:57.908518+0000","last_fullsized":"2023-08-17T00:10:57.908518+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.906408+0000","last_change":"2023-08-17T00:10:57.466338+0000","last_active":"2023-08-17T00:10:57.906408+0000","last_peered":"2023-08-17T00:10:57.906408+0000","last_clean":"2023-08-17T00:10:57.906408+0000","last_became_active":"2023-08-17T00:10:57.465864+0000","last_became_peered":"2023-08-17T00:10:57.465864+0000","last_unstale":"2023-08-17T00:10:57.906408+0000","last_undegraded":"2023-08-17T00:10:57.906408+0000","last_fullsized":"2023-08-17T00:10:57.906408+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921448+0000","last_change":"2023-08-17T00:10:57.904810+0000","last_active":"2023-08-17T00:10:57.921448+0000","last_peered":"2023-08-17T00:10:57.921448+0000","last_clean":"2023-08-17T00:10:57.921448+0000","last_became_active":"2023-08-17T00:10:57.904528+0000","last_became_peered":"2023-08-17T00:10:57.904528+0000","last_unstale":"2023-08-17T00:10:57.921448+0000","last_undegraded":"2023-08-17T00:10:57.921448+0000","last_fullsized":"2023-08-17T00:10:57.921448+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.908914+0000","last_change":"2023-08-17T00:10:57.470805+0000","last_active":"2023-08-17T00:10:57.908914+0000","last_peered":"2023-08-17T00:10:57.908914+0000","last_clean":"2023-08-17T00:10:57.908914+0000","last_became_active":"2023-08-17T00:10:57.470351+0000","last_became_peered":"2023-08-17T00:10:57.470351+0000","last_unstale":"2023-08-17T00:10:57.908914+0000","last_undegraded":"2023-08-17T00:10:57.908914+0000","last_fullsized":"2023-08-17T00:10:57.908914+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922335+0000","last_change":"2023-08-17T00:10:57.917770+0000","last_active":"2023-08-17T00:10:57.922335+0000","last_peered":"2023-08-17T00:10:57.922335+0000","last_clean":"2023-08-17T00:10:57.922335+0000","last_became_active":"2023-08-17T00:10:57.917291+0000","last_became_peered":"2023-08-17T00:10:57.917291+0000","last_unstale":"2023-08-17T00:10:57.922335+0000","last_undegraded":"2023-08-17T00:10:57.922335+0000","last_fullsized":"2023-08-17T00:10:57.922335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.914430+0000","last_change":"2023-08-17T00:10:57.460905+0000","last_active":"2023-08-17T00:10:57.914430+0000","last_peered":"2023-08-17T00:10:57.914430+0000","last_clean":"2023-08-17T00:10:57.914430+0000","last_became_active":"2023-08-17T00:10:57.460622+0000","last_became_peered":"2023-08-17T00:10:57.460622+0000","last_unstale":"2023-08-17T00:10:57.914430+0000","last_undegraded":"2023-08-17T00:10:57.914430+0000","last_fullsized":"2023-08-17T00:10:57.914430+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922909+0000","last_change":"2023-08-17T00:10:57.921854+0000","last_active":"2023-08-17T00:10:57.922909+0000","last_peered":"2023-08-17T00:10:57.922909+0000","last_clean":"2023-08-17T00:10:57.922909+0000","last_became_active":"2023-08-17T00:10:57.921443+0000","last_became_peered":"2023-08-17T00:10:57.921443+0000","last_unstale":"2023-08-17T00:10:57.922909+0000","last_undegraded":"2023-08-17T00:10:57.922909+0000","last_fullsized":"2023-08-17T00:10:57.922909+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910636+0000","last_change":"2023-08-17T00:10:57.462876+0000","last_active":"2023-08-17T00:10:57.910636+0000","last_peered":"2023-08-17T00:10:57.910636+0000","last_clean":"2023-08-17T00:10:57.910636+0000","last_became_active":"2023-08-17T00:10:57.462565+0000","last_became_peered":"2023-08-17T00:10:57.462565+0000","last_unstale":"2023-08-17T00:10:57.910636+0000","last_undegraded":"2023-08-17T00:10:57.910636+0000","last_fullsized":"2023-08-17T00:10:57.910636+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910304+0000","last_change":"2023-08-17T00:10:57.905233+0000","last_active":"2023-08-17T00:10:57.910304+0000","last_peered":"2023-08-17T00:10:57.910304+0000","last_clean":"2023-08-17T00:10:57.910304+0000","last_became_active":"2023-08-17T00:10:57.904880+0000","last_became_peered":"2023-08-17T00:10:57.904880+0000","last_unstale":"2023-08-17T00:10:57.910304+0000","last_undegraded":"2023-08-17T00:10:57.910304+0000","last_fullsized":"2023-08-17T00:10:57.910304+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.909269+0000","last_change":"2023-08-17T00:10:57.455851+0000","last_active":"2023-08-17T00:10:57.909269+0000","last_peered":"2023-08-17T00:10:57.909269+0000","last_clean":"2023-08-17T00:10:57.909269+0000","last_became_active":"2023-08-17T00:10:57.455555+0000","last_became_peered":"2023-08-17T00:10:57.455555+0000","last_unstale":"2023-08-17T00:10:57.909269+0000","last_undegraded":"2023-08-17T00:10:57.909269+0000","last_fullsized":"2023-08-17T00:10:57.909269+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910865+0000","last_change":"2023-08-17T00:10:57.910865+0000","last_active":"2023-08-17T00:10:57.910865+0000","last_peered":"2023-08-17T00:10:57.910865+0000","last_clean":"2023-08-17T00:10:57.910865+0000","last_became_active":"2023-08-17T00:10:57.909250+0000","last_became_peered":"2023-08-17T00:10:57.909250+0000","last_unstale":"2023-08-17T00:10:57.910865+0000","last_undegraded":"2023-08-17T00:10:57.910865+0000","last_fullsized":"2023-08-17T00:10:57.910865+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887704+0000","last_change":"2023-08-17T00:10:57.462904+0000","last_active":"2023-08-17T00:10:57.887704+0000","last_peered":"2023-08-17T00:10:57.887704+0000","last_clean":"2023-08-17T00:10:57.887704+0000","last_became_active":"2023-08-17T00:10:57.462631+0000","last_became_peered":"2023-08-17T00:10:57.462631+0000","last_unstale":"2023-08-17T00:10:57.887704+0000","last_undegraded":"2023-08-17T00:10:57.887704+0000","last_fullsized":"2023-08-17T00:10:57.887704+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.912455+0000","last_change":"2023-08-17T00:10:57.912455+0000","last_active":"2023-08-17T00:10:57.912455+0000","last_peered":"2023-08-17T00:10:57.912455+0000","last_clean":"2023-08-17T00:10:57.912455+0000","last_became_active":"2023-08-17T00:10:57.912048+0000","last_became_peered":"2023-08-17T00:10:57.912048+0000","last_unstale":"2023-08-17T00:10:57.912455+0000","last_undegraded":"2023-08-17T00:10:57.912455+0000","last_fullsized":"2023-08-17T00:10:57.912455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.890839+0000","last_change":"2023-08-17T00:10:57.463105+0000","last_active":"2023-08-17T00:10:57.890839+0000","last_peered":"2023-08-17T00:10:57.890839+0000","last_clean":"2023-08-17T00:10:57.890839+0000","last_became_active":"2023-08-17T00:10:57.462749+0000","last_became_peered":"2023-08-17T00:10:57.462749+0000","last_unstale":"2023-08-17T00:10:57.890839+0000","last_undegraded":"2023-08-17T00:10:57.890839+0000","last_fullsized":"2023-08-17T00:10:57.890839+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.903598+0000","last_change":"2023-08-17T00:10:57.900953+0000","last_active":"2023-08-17T00:10:57.903598+0000","last_peered":"2023-08-17T00:10:57.903598+0000","last_clean":"2023-08-17T00:10:57.903598+0000","last_became_active":"2023-08-17T00:10:57.900677+0000","last_became_peered":"2023-08-17T00:10:57.900677+0000","last_unstale":"2023-08-17T00:10:57.903598+0000","last_undegraded":"2023-08-17T00:10:57.903598+0000","last_fullsized":"2023-08-17T00:10:57.903598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.890570+0000","last_change":"2023-08-17T00:10:57.463918+0000","last_active":"2023-08-17T00:10:57.890570+0000","last_peered":"2023-08-17T00:10:57.890570+0000","last_clean":"2023-08-17T00:10:57.890570+0000","last_became_active":"2023-08-17T00:10:57.463394+0000","last_became_peered":"2023-08-17T00:10:57.463394+0000","last_unstale":"2023-08-17T00:10:57.890570+0000","last_undegraded":"2023-08-17T00:10:57.890570+0000","last_fullsized":"2023-08-17T00:10:57.890570+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904710+0000","last_change":"2023-08-17T00:10:57.904710+0000","last_active":"2023-08-17T00:10:57.904710+0000","last_peered":"2023-08-17T00:10:57.904710+0000","last_clean":"2023-08-17T00:10:57.904710+0000","last_became_active":"2023-08-17T00:10:57.904410+0000","last_became_peered":"2023-08-17T00:10:57.904410+0000","last_unstale":"2023-08-17T00:10:57.904710+0000","last_undegraded":"2023-08-17T00:10:57.904710+0000","last_fullsized":"2023-08-17T00:10:57.904710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.896245+0000","last_change":"2023-08-17T00:10:57.477032+0000","last_active":"2023-08-17T00:10:57.896245+0000","last_peered":"2023-08-17T00:10:57.896245+0000","last_clean":"2023-08-17T00:10:57.896245+0000","last_became_active":"2023-08-17T00:10:57.476756+0000","last_became_peered":"2023-08-17T00:10:57.476756+0000","last_unstale":"2023-08-17T00:10:57.896245+0000","last_undegraded":"2023-08-17T00:10:57.896245+0000","last_fullsized":"2023-08-17T00:10:57.896245+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.914101+0000","last_change":"2023-08-17T00:10:57.914101+0000","last_active":"2023-08-17T00:10:57.914101+0000","last_peered":"2023-08-17T00:10:57.914101+0000","last_clean":"2023-08-17T00:10:57.914101+0000","last_became_active":"2023-08-17T00:10:57.913593+0000","last_became_peered":"2023-08-17T00:10:57.913593+0000","last_unstale":"2023-08-17T00:10:57.914101+0000","last_undegraded":"2023-08-17T00:10:57.914101+0000","last_fullsized":"2023-08-17T00:10:57.914101+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.893355+0000","last_change":"2023-08-17T00:10:57.450464+0000","last_active":"2023-08-17T00:10:57.893355+0000","last_peered":"2023-08-17T00:10:57.893355+0000","last_clean":"2023-08-17T00:10:57.893355+0000","last_became_active":"2023-08-17T00:10:57.450149+0000","last_became_peered":"2023-08-17T00:10:57.450149+0000","last_unstale":"2023-08-17T00:10:57.893355+0000","last_undegraded":"2023-08-17T00:10:57.893355+0000","last_fullsized":"2023-08-17T00:10:57.893355+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918716+0000","last_change":"2023-08-17T00:10:57.918716+0000","last_active":"2023-08-17T00:10:57.918716+0000","last_peered":"2023-08-17T00:10:57.918716+0000","last_clean":"2023-08-17T00:10:57.918716+0000","last_became_active":"2023-08-17T00:10:57.918380+0000","last_became_peered":"2023-08-17T00:10:57.918380+0000","last_unstale":"2023-08-17T00:10:57.918716+0000","last_undegraded":"2023-08-17T00:10:57.918716+0000","last_fullsized":"2023-08-17T00:10:57.918716+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911455+0000","last_change":"2023-08-17T00:10:57.465544+0000","last_active":"2023-08-17T00:10:57.911455+0000","last_peered":"2023-08-17T00:10:57.911455+0000","last_clean":"2023-08-17T00:10:57.911455+0000","last_became_active":"2023-08-17T00:10:57.465244+0000","last_became_peered":"2023-08-17T00:10:57.465244+0000","last_unstale":"2023-08-17T00:10:57.911455+0000","last_undegraded":"2023-08-17T00:10:57.911455+0000","last_fullsized":"2023-08-17T00:10:57.911455+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922415+0000","last_change":"2023-08-17T00:10:57.918195+0000","last_active":"2023-08-17T00:10:57.922415+0000","last_peered":"2023-08-17T00:10:57.922415+0000","last_clean":"2023-08-17T00:10:57.922415+0000","last_became_active":"2023-08-17T00:10:57.917774+0000","last_became_peered":"2023-08-17T00:10:57.917774+0000","last_unstale":"2023-08-17T00:10:57.922415+0000","last_undegraded":"2023-08-17T00:10:57.922415+0000","last_fullsized":"2023-08-17T00:10:57.922415+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"111'3","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920081+0000","last_change":"2023-08-17T00:10:57.466316+0000","last_active":"2023-08-17T00:10:57.920081+0000","last_peered":"2023-08-17T00:10:57.920081+0000","last_clean":"2023-08-17T00:10:57.920081+0000","last_became_active":"2023-08-17T00:10:57.466017+0000","last_became_peered":"2023-08-17T00:10:57.466017+0000","last_unstale":"2023-08-17T00:10:57.920081+0000","last_undegraded":"2023-08-17T00:10:57.920081+0000","last_fullsized":"2023-08-17T00:10:57.920081+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919592+0000","last_change":"2023-08-17T00:10:57.914984+0000","last_active":"2023-08-17T00:10:57.919592+0000","last_peered":"2023-08-17T00:10:57.919592+0000","last_clean":"2023-08-17T00:10:57.919592+0000","last_became_active":"2023-08-17T00:10:57.914670+0000","last_became_peered":"2023-08-17T00:10:57.914670+0000","last_unstale":"2023-08-17T00:10:57.919592+0000","last_undegraded":"2023-08-17T00:10:57.919592+0000","last_fullsized":"2023-08-17T00:10:57.919592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.923186+0000","last_change":"2023-08-17T00:10:57.460271+0000","last_active":"2023-08-17T00:10:57.923186+0000","last_peered":"2023-08-17T00:10:57.923186+0000","last_clean":"2023-08-17T00:10:57.923186+0000","last_became_active":"2023-08-17T00:10:57.459946+0000","last_became_peered":"2023-08-17T00:10:57.459946+0000","last_unstale":"2023-08-17T00:10:57.923186+0000","last_undegraded":"2023-08-17T00:10:57.923186+0000","last_fullsized":"2023-08-17T00:10:57.923186+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919293+0000","last_change":"2023-08-17T00:10:57.916236+0000","last_active":"2023-08-17T00:10:57.919293+0000","last_peered":"2023-08-17T00:10:57.919293+0000","last_clean":"2023-08-17T00:10:57.919293+0000","last_became_active":"2023-08-17T00:10:57.915242+0000","last_became_peered":"2023-08-17T00:10:57.915242+0000","last_unstale":"2023-08-17T00:10:57.919293+0000","last_undegraded":"2023-08-17T00:10:57.919293+0000","last_fullsized":"2023-08-17T00:10:57.919293+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892244+0000","last_change":"2023-08-17T00:10:57.468501+0000","last_active":"2023-08-17T00:10:57.892244+0000","last_peered":"2023-08-17T00:10:57.892244+0000","last_clean":"2023-08-17T00:10:57.892244+0000","last_became_active":"2023-08-17T00:10:57.467879+0000","last_became_peered":"2023-08-17T00:10:57.467879+0000","last_unstale":"2023-08-17T00:10:57.892244+0000","last_undegraded":"2023-08-17T00:10:57.892244+0000","last_fullsized":"2023-08-17T00:10:57.892244+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918572+0000","last_change":"2023-08-17T00:10:57.910636+0000","last_active":"2023-08-17T00:10:57.918572+0000","last_peered":"2023-08-17T00:10:57.918572+0000","last_clean":"2023-08-17T00:10:57.918572+0000","last_became_active":"2023-08-17T00:10:57.910258+0000","last_became_peered":"2023-08-17T00:10:57.910258+0000","last_unstale":"2023-08-17T00:10:57.918572+0000","last_undegraded":"2023-08-17T00:10:57.918572+0000","last_fullsized":"2023-08-17T00:10:57.918572+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904021+0000","last_change":"2023-08-17T00:10:57.469333+0000","last_active":"2023-08-17T00:10:57.904021+0000","last_peered":"2023-08-17T00:10:57.904021+0000","last_clean":"2023-08-17T00:10:57.904021+0000","last_became_active":"2023-08-17T00:10:57.466716+0000","last_became_peered":"2023-08-17T00:10:57.466716+0000","last_unstale":"2023-08-17T00:10:57.904021+0000","last_undegraded":"2023-08-17T00:10:57.904021+0000","last_fullsized":"2023-08-17T00:10:57.904021+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.915107+0000","last_change":"2023-08-17T00:10:57.907310+0000","last_active":"2023-08-17T00:10:57.915107+0000","last_peered":"2023-08-17T00:10:57.915107+0000","last_clean":"2023-08-17T00:10:57.915107+0000","last_became_active":"2023-08-17T00:10:57.906995+0000","last_became_peered":"2023-08-17T00:10:57.906995+0000","last_unstale":"2023-08-17T00:10:57.915107+0000","last_undegraded":"2023-08-17T00:10:57.915107+0000","last_fullsized":"2023-08-17T00:10:57.915107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.477037+0000","last_change":"2023-08-17T00:10:57.471469+0000","last_active":"2023-08-17T00:10:57.477037+0000","last_peered":"2023-08-17T00:10:57.477037+0000","last_clean":"2023-08-17T00:10:57.477037+0000","last_became_active":"2023-08-17T00:10:57.470307+0000","last_became_peered":"2023-08-17T00:10:57.470307+0000","last_unstale":"2023-08-17T00:10:57.477037+0000","last_undegraded":"2023-08-17T00:10:57.477037+0000","last_fullsized":"2023-08-17T00:10:57.477037+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921210+0000","last_change":"2023-08-17T00:10:57.905686+0000","last_active":"2023-08-17T00:10:57.921210+0000","last_peered":"2023-08-17T00:10:57.921210+0000","last_clean":"2023-08-17T00:10:57.921210+0000","last_became_active":"2023-08-17T00:10:57.904998+0000","last_became_peered":"2023-08-17T00:10:57.904998+0000","last_unstale":"2023-08-17T00:10:57.921210+0000","last_undegraded":"2023-08-17T00:10:57.921210+0000","last_fullsized":"2023-08-17T00:10:57.921210+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.917335+0000","last_change":"2023-08-17T00:10:57.463649+0000","last_active":"2023-08-17T00:10:57.917335+0000","last_peered":"2023-08-17T00:10:57.917335+0000","last_clean":"2023-08-17T00:10:57.917335+0000","last_became_active":"2023-08-17T00:10:57.463362+0000","last_became_peered":"2023-08-17T00:10:57.463362+0000","last_unstale":"2023-08-17T00:10:57.917335+0000","last_undegraded":"2023-08-17T00:10:57.917335+0000","last_fullsized":"2023-08-17T00:10:57.917335+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919314+0000","last_change":"2023-08-17T00:10:57.908479+0000","last_active":"2023-08-17T00:10:57.919314+0000","last_peered":"2023-08-17T00:10:57.919314+0000","last_clean":"2023-08-17T00:10:57.919314+0000","last_became_active":"2023-08-17T00:10:57.908181+0000","last_became_peered":"2023-08-17T00:10:57.908181+0000","last_unstale":"2023-08-17T00:10:57.919314+0000","last_undegraded":"2023-08-17T00:10:57.919314+0000","last_fullsized":"2023-08-17T00:10:57.919314+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921772+0000","last_change":"2023-08-17T00:10:57.458335+0000","last_active":"2023-08-17T00:10:57.921772+0000","last_peered":"2023-08-17T00:10:57.921772+0000","last_clean":"2023-08-17T00:10:57.921772+0000","last_became_active":"2023-08-17T00:10:57.458038+0000","last_became_peered":"2023-08-17T00:10:57.458038+0000","last_unstale":"2023-08-17T00:10:57.921772+0000","last_undegraded":"2023-08-17T00:10:57.921772+0000","last_fullsized":"2023-08-17T00:10:57.921772+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910295+0000","last_change":"2023-08-17T00:10:57.907531+0000","last_active":"2023-08-17T00:10:57.910295+0000","last_peered":"2023-08-17T00:10:57.910295+0000","last_clean":"2023-08-17T00:10:57.910295+0000","last_became_active":"2023-08-17T00:10:57.907218+0000","last_became_peered":"2023-08-17T00:10:57.907218+0000","last_unstale":"2023-08-17T00:10:57.910295+0000","last_undegraded":"2023-08-17T00:10:57.910295+0000","last_fullsized":"2023-08-17T00:10:57.910295+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891343+0000","last_change":"2023-08-17T00:10:57.465347+0000","last_active":"2023-08-17T00:10:57.891343+0000","last_peered":"2023-08-17T00:10:57.891343+0000","last_clean":"2023-08-17T00:10:57.891343+0000","last_became_active":"2023-08-17T00:10:57.465036+0000","last_became_peered":"2023-08-17T00:10:57.465036+0000","last_unstale":"2023-08-17T00:10:57.891343+0000","last_undegraded":"2023-08-17T00:10:57.891343+0000","last_fullsized":"2023-08-17T00:10:57.891343+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922492+0000","last_change":"2023-08-17T00:10:57.919640+0000","last_active":"2023-08-17T00:10:57.922492+0000","last_peered":"2023-08-17T00:10:57.922492+0000","last_clean":"2023-08-17T00:10:57.922492+0000","last_became_active":"2023-08-17T00:10:57.918736+0000","last_became_peered":"2023-08-17T00:10:57.918736+0000","last_unstale":"2023-08-17T00:10:57.922492+0000","last_undegraded":"2023-08-17T00:10:57.922492+0000","last_fullsized":"2023-08-17T00:10:57.922492+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887546+0000","last_change":"2023-08-17T00:10:57.470379+0000","last_active":"2023-08-17T00:10:57.887546+0000","last_peered":"2023-08-17T00:10:57.887546+0000","last_clean":"2023-08-17T00:10:57.887546+0000","last_became_active":"2023-08-17T00:10:57.470128+0000","last_became_peered":"2023-08-17T00:10:57.470128+0000","last_unstale":"2023-08-17T00:10:57.887546+0000","last_undegraded":"2023-08-17T00:10:57.887546+0000","last_fullsized":"2023-08-17T00:10:57.887546+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918292+0000","last_change":"2023-08-17T00:10:57.911345+0000","last_active":"2023-08-17T00:10:57.918292+0000","last_peered":"2023-08-17T00:10:57.918292+0000","last_clean":"2023-08-17T00:10:57.918292+0000","last_became_active":"2023-08-17T00:10:57.910991+0000","last_became_peered":"2023-08-17T00:10:57.910991+0000","last_unstale":"2023-08-17T00:10:57.918292+0000","last_undegraded":"2023-08-17T00:10:57.918292+0000","last_fullsized":"2023-08-17T00:10:57.918292+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.476000+0000","last_change":"2023-08-17T00:10:57.467593+0000","last_active":"2023-08-17T00:10:57.476000+0000","last_peered":"2023-08-17T00:10:57.476000+0000","last_clean":"2023-08-17T00:10:57.476000+0000","last_became_active":"2023-08-17T00:10:57.467295+0000","last_became_peered":"2023-08-17T00:10:57.467295+0000","last_unstale":"2023-08-17T00:10:57.476000+0000","last_undegraded":"2023-08-17T00:10:57.476000+0000","last_fullsized":"2023-08-17T00:10:57.476000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910852+0000","last_change":"2023-08-17T00:10:57.910852+0000","last_active":"2023-08-17T00:10:57.910852+0000","last_peered":"2023-08-17T00:10:57.910852+0000","last_clean":"2023-08-17T00:10:57.910852+0000","last_became_active":"2023-08-17T00:10:57.910329+0000","last_became_peered":"2023-08-17T00:10:57.910329+0000","last_unstale":"2023-08-17T00:10:57.910852+0000","last_undegraded":"2023-08-17T00:10:57.910852+0000","last_fullsized":"2023-08-17T00:10:57.910852+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887914+0000","last_change":"2023-08-17T00:10:57.479634+0000","last_active":"2023-08-17T00:10:57.887914+0000","last_peered":"2023-08-17T00:10:57.887914+0000","last_clean":"2023-08-17T00:10:57.887914+0000","last_became_active":"2023-08-17T00:10:57.479165+0000","last_became_peered":"2023-08-17T00:10:57.479165+0000","last_unstale":"2023-08-17T00:10:57.887914+0000","last_undegraded":"2023-08-17T00:10:57.887914+0000","last_fullsized":"2023-08-17T00:10:57.887914+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904556+0000","last_change":"2023-08-17T00:10:57.904556+0000","last_active":"2023-08-17T00:10:57.904556+0000","last_peered":"2023-08-17T00:10:57.904556+0000","last_clean":"2023-08-17T00:10:57.904556+0000","last_became_active":"2023-08-17T00:10:57.904173+0000","last_became_peered":"2023-08-17T00:10:57.904173+0000","last_unstale":"2023-08-17T00:10:57.904556+0000","last_undegraded":"2023-08-17T00:10:57.904556+0000","last_fullsized":"2023-08-17T00:10:57.904556+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888692+0000","last_change":"2023-08-17T00:10:57.464523+0000","last_active":"2023-08-17T00:10:57.888692+0000","last_peered":"2023-08-17T00:10:57.888692+0000","last_clean":"2023-08-17T00:10:57.888692+0000","last_became_active":"2023-08-17T00:10:57.464242+0000","last_became_peered":"2023-08-17T00:10:57.464242+0000","last_unstale":"2023-08-17T00:10:57.888692+0000","last_undegraded":"2023-08-17T00:10:57.888692+0000","last_fullsized":"2023-08-17T00:10:57.888692+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920933+0000","last_change":"2023-08-17T00:10:57.914359+0000","last_active":"2023-08-17T00:10:57.920933+0000","last_peered":"2023-08-17T00:10:57.920933+0000","last_clean":"2023-08-17T00:10:57.920933+0000","last_became_active":"2023-08-17T00:10:57.913462+0000","last_became_peered":"2023-08-17T00:10:57.913462+0000","last_unstale":"2023-08-17T00:10:57.920933+0000","last_undegraded":"2023-08-17T00:10:57.920933+0000","last_fullsized":"2023-08-17T00:10:57.920933+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.890640+0000","last_change":"2023-08-17T00:10:57.469357+0000","last_active":"2023-08-17T00:10:57.890640+0000","last_peered":"2023-08-17T00:10:57.890640+0000","last_clean":"2023-08-17T00:10:57.890640+0000","last_became_active":"2023-08-17T00:10:57.469085+0000","last_became_peered":"2023-08-17T00:10:57.469085+0000","last_unstale":"2023-08-17T00:10:57.890640+0000","last_undegraded":"2023-08-17T00:10:57.890640+0000","last_fullsized":"2023-08-17T00:10:57.890640+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.908072+0000","last_change":"2023-08-17T00:10:57.906525+0000","last_active":"2023-08-17T00:10:57.908072+0000","last_peered":"2023-08-17T00:10:57.908072+0000","last_clean":"2023-08-17T00:10:57.908072+0000","last_became_active":"2023-08-17T00:10:57.906246+0000","last_became_peered":"2023-08-17T00:10:57.906246+0000","last_unstale":"2023-08-17T00:10:57.908072+0000","last_undegraded":"2023-08-17T00:10:57.908072+0000","last_fullsized":"2023-08-17T00:10:57.908072+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.889104+0000","last_change":"2023-08-17T00:10:57.459352+0000","last_active":"2023-08-17T00:10:57.889104+0000","last_peered":"2023-08-17T00:10:57.889104+0000","last_clean":"2023-08-17T00:10:57.889104+0000","last_became_active":"2023-08-17T00:10:57.459057+0000","last_became_peered":"2023-08-17T00:10:57.459057+0000","last_unstale":"2023-08-17T00:10:57.889104+0000","last_undegraded":"2023-08-17T00:10:57.889104+0000","last_fullsized":"2023-08-17T00:10:57.889104+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920147+0000","last_change":"2023-08-17T00:10:57.911624+0000","last_active":"2023-08-17T00:10:57.920147+0000","last_peered":"2023-08-17T00:10:57.920147+0000","last_clean":"2023-08-17T00:10:57.920147+0000","last_became_active":"2023-08-17T00:10:57.911312+0000","last_became_peered":"2023-08-17T00:10:57.911312+0000","last_unstale":"2023-08-17T00:10:57.920147+0000","last_undegraded":"2023-08-17T00:10:57.920147+0000","last_fullsized":"2023-08-17T00:10:57.920147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888585+0000","last_change":"2023-08-17T00:10:57.476392+0000","last_active":"2023-08-17T00:10:57.888585+0000","last_peered":"2023-08-17T00:10:57.888585+0000","last_clean":"2023-08-17T00:10:57.888585+0000","last_became_active":"2023-08-17T00:10:57.476086+0000","last_became_peered":"2023-08-17T00:10:57.476086+0000","last_unstale":"2023-08-17T00:10:57.888585+0000","last_undegraded":"2023-08-17T00:10:57.888585+0000","last_fullsized":"2023-08-17T00:10:57.888585+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888643+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:10:57.888643+0000","last_peered":"2023-08-17T00:10:57.888643+0000","last_clean":"2023-08-17T00:10:57.888643+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:10:57.888643+0000","last_undegraded":"2023-08-17T00:10:57.888643+0000","last_fullsized":"2023-08-17T00:10:57.888643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.909895+0000","last_change":"2023-08-17T00:10:57.909895+0000","last_active":"2023-08-17T00:10:57.909895+0000","last_peered":"2023-08-17T00:10:57.909895+0000","last_clean":"2023-08-17T00:10:57.909895+0000","last_became_active":"2023-08-17T00:10:57.908943+0000","last_became_peered":"2023-08-17T00:10:57.908943+0000","last_unstale":"2023-08-17T00:10:57.909895+0000","last_undegraded":"2023-08-17T00:10:57.909895+0000","last_fullsized":"2023-08-17T00:10:57.909895+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.914536+0000","last_change":"2023-08-17T00:10:57.476964+0000","last_active":"2023-08-17T00:10:57.914536+0000","last_peered":"2023-08-17T00:10:57.914536+0000","last_clean":"2023-08-17T00:10:57.914536+0000","last_became_active":"2023-08-17T00:10:57.476558+0000","last_became_peered":"2023-08-17T00:10:57.476558+0000","last_unstale":"2023-08-17T00:10:57.914536+0000","last_undegraded":"2023-08-17T00:10:57.914536+0000","last_fullsized":"2023-08-17T00:10:57.914536+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.446905+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:10:57.446905+0000","last_peered":"2023-08-17T00:10:57.446905+0000","last_clean":"2023-08-17T00:10:57.446905+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:10:57.446905+0000","last_undegraded":"2023-08-17T00:10:57.446905+0000","last_fullsized":"2023-08-17T00:10:57.446905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910569+0000","last_change":"2023-08-17T00:10:57.910569+0000","last_active":"2023-08-17T00:10:57.910569+0000","last_peered":"2023-08-17T00:10:57.910569+0000","last_clean":"2023-08-17T00:10:57.910569+0000","last_became_active":"2023-08-17T00:10:57.910256+0000","last_became_peered":"2023-08-17T00:10:57.910256+0000","last_unstale":"2023-08-17T00:10:57.910569+0000","last_undegraded":"2023-08-17T00:10:57.910569+0000","last_fullsized":"2023-08-17T00:10:57.910569+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.906528+0000","last_change":"2023-08-17T00:10:57.456525+0000","last_active":"2023-08-17T00:10:57.906528+0000","last_peered":"2023-08-17T00:10:57.906528+0000","last_clean":"2023-08-17T00:10:57.906528+0000","last_became_active":"2023-08-17T00:10:57.456009+0000","last_became_peered":"2023-08-17T00:10:57.456009+0000","last_unstale":"2023-08-17T00:10:57.906528+0000","last_undegraded":"2023-08-17T00:10:57.906528+0000","last_fullsized":"2023-08-17T00:10:57.906528+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887650+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:10:57.887650+0000","last_peered":"2023-08-17T00:10:57.887650+0000","last_clean":"2023-08-17T00:10:57.887650+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:10:57.887650+0000","last_undegraded":"2023-08-17T00:10:57.887650+0000","last_fullsized":"2023-08-17T00:10:57.887650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919598+0000","last_change":"2023-08-17T00:10:57.914980+0000","last_active":"2023-08-17T00:10:57.919598+0000","last_peered":"2023-08-17T00:10:57.919598+0000","last_clean":"2023-08-17T00:10:57.919598+0000","last_became_active":"2023-08-17T00:10:57.914699+0000","last_became_peered":"2023-08-17T00:10:57.914699+0000","last_unstale":"2023-08-17T00:10:57.919598+0000","last_undegraded":"2023-08-17T00:10:57.919598+0000","last_fullsized":"2023-08-17T00:10:57.919598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.897079+0000","last_change":"2023-08-17T00:10:57.475702+0000","last_active":"2023-08-17T00:10:57.897079+0000","last_peered":"2023-08-17T00:10:57.897079+0000","last_clean":"2023-08-17T00:10:57.897079+0000","last_became_active":"2023-08-17T00:10:57.475335+0000","last_became_peered":"2023-08-17T00:10:57.475335+0000","last_unstale":"2023-08-17T00:10:57.897079+0000","last_undegraded":"2023-08-17T00:10:57.897079+0000","last_fullsized":"2023-08-17T00:10:57.897079+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888873+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:10:57.888873+0000","last_peered":"2023-08-17T00:10:57.888873+0000","last_clean":"2023-08-17T00:10:57.888873+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:10:57.888873+0000","last_undegraded":"2023-08-17T00:10:57.888873+0000","last_fullsized":"2023-08-17T00:10:57.888873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920305+0000","last_change":"2023-08-17T00:10:57.917004+0000","last_active":"2023-08-17T00:10:57.920305+0000","last_peered":"2023-08-17T00:10:57.920305+0000","last_clean":"2023-08-17T00:10:57.920305+0000","last_became_active":"2023-08-17T00:10:57.916666+0000","last_became_peered":"2023-08-17T00:10:57.916666+0000","last_unstale":"2023-08-17T00:10:57.920305+0000","last_undegraded":"2023-08-17T00:10:57.920305+0000","last_fullsized":"2023-08-17T00:10:57.920305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.913227+0000","last_change":"2023-08-17T00:10:57.466708+0000","last_active":"2023-08-17T00:10:57.913227+0000","last_peered":"2023-08-17T00:10:57.913227+0000","last_clean":"2023-08-17T00:10:57.913227+0000","last_became_active":"2023-08-17T00:10:57.466429+0000","last_became_peered":"2023-08-17T00:10:57.466429+0000","last_unstale":"2023-08-17T00:10:57.913227+0000","last_undegraded":"2023-08-17T00:10:57.913227+0000","last_fullsized":"2023-08-17T00:10:57.913227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888174+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:10:57.888174+0000","last_peered":"2023-08-17T00:10:57.888174+0000","last_clean":"2023-08-17T00:10:57.888174+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:10:57.888174+0000","last_undegraded":"2023-08-17T00:10:57.888174+0000","last_fullsized":"2023-08-17T00:10:57.888174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.915434+0000","last_change":"2023-08-17T00:10:57.908048+0000","last_active":"2023-08-17T00:10:57.915434+0000","last_peered":"2023-08-17T00:10:57.915434+0000","last_clean":"2023-08-17T00:10:57.915434+0000","last_became_active":"2023-08-17T00:10:57.907771+0000","last_became_peered":"2023-08-17T00:10:57.907771+0000","last_unstale":"2023-08-17T00:10:57.915434+0000","last_undegraded":"2023-08-17T00:10:57.915434+0000","last_fullsized":"2023-08-17T00:10:57.915434+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894885+0000","last_change":"2023-08-17T00:10:57.466733+0000","last_active":"2023-08-17T00:10:57.894885+0000","last_peered":"2023-08-17T00:10:57.894885+0000","last_clean":"2023-08-17T00:10:57.894885+0000","last_became_active":"2023-08-17T00:10:57.466462+0000","last_became_peered":"2023-08-17T00:10:57.466462+0000","last_unstale":"2023-08-17T00:10:57.894885+0000","last_undegraded":"2023-08-17T00:10:57.894885+0000","last_fullsized":"2023-08-17T00:10:57.894885+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894387+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:10:57.894387+0000","last_peered":"2023-08-17T00:10:57.894387+0000","last_clean":"2023-08-17T00:10:57.894387+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:10:57.894387+0000","last_undegraded":"2023-08-17T00:10:57.894387+0000","last_fullsized":"2023-08-17T00:10:57.894387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918451+0000","last_change":"2023-08-17T00:10:57.913412+0000","last_active":"2023-08-17T00:10:57.918451+0000","last_peered":"2023-08-17T00:10:57.918451+0000","last_clean":"2023-08-17T00:10:57.918451+0000","last_became_active":"2023-08-17T00:10:57.913170+0000","last_became_peered":"2023-08-17T00:10:57.913170+0000","last_unstale":"2023-08-17T00:10:57.918451+0000","last_undegraded":"2023-08-17T00:10:57.918451+0000","last_fullsized":"2023-08-17T00:10:57.918451+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892476+0000","last_change":"2023-08-17T00:10:57.462445+0000","last_active":"2023-08-17T00:10:57.892476+0000","last_peered":"2023-08-17T00:10:57.892476+0000","last_clean":"2023-08-17T00:10:57.892476+0000","last_became_active":"2023-08-17T00:10:57.462127+0000","last_became_peered":"2023-08-17T00:10:57.462127+0000","last_unstale":"2023-08-17T00:10:57.892476+0000","last_undegraded":"2023-08-17T00:10:57.892476+0000","last_fullsized":"2023-08-17T00:10:57.892476+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.886676+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:10:57.886676+0000","last_peered":"2023-08-17T00:10:57.886676+0000","last_clean":"2023-08-17T00:10:57.886676+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:10:57.886676+0000","last_undegraded":"2023-08-17T00:10:57.886676+0000","last_fullsized":"2023-08-17T00:10:57.886676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920766+0000","last_change":"2023-08-17T00:10:57.912534+0000","last_active":"2023-08-17T00:10:57.920766+0000","last_peered":"2023-08-17T00:10:57.920766+0000","last_clean":"2023-08-17T00:10:57.920766+0000","last_became_active":"2023-08-17T00:10:57.911955+0000","last_became_peered":"2023-08-17T00:10:57.911955+0000","last_unstale":"2023-08-17T00:10:57.920766+0000","last_undegraded":"2023-08-17T00:10:57.920766+0000","last_fullsized":"2023-08-17T00:10:57.920766+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921530+0000","last_change":"2023-08-17T00:10:57.475562+0000","last_active":"2023-08-17T00:10:57.921530+0000","last_peered":"2023-08-17T00:10:57.921530+0000","last_clean":"2023-08-17T00:10:57.921530+0000","last_became_active":"2023-08-17T00:10:57.475125+0000","last_became_peered":"2023-08-17T00:10:57.475125+0000","last_unstale":"2023-08-17T00:10:57.921530+0000","last_undegraded":"2023-08-17T00:10:57.921530+0000","last_fullsized":"2023-08-17T00:10:57.921530+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888067+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:10:57.888067+0000","last_peered":"2023-08-17T00:10:57.888067+0000","last_clean":"2023-08-17T00:10:57.888067+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:10:57.888067+0000","last_undegraded":"2023-08-17T00:10:57.888067+0000","last_fullsized":"2023-08-17T00:10:57.888067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891545+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:10:57.891545+0000","last_peered":"2023-08-17T00:10:57.891545+0000","last_clean":"2023-08-17T00:10:57.891545+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:10:57.891545+0000","last_undegraded":"2023-08-17T00:10:57.891545+0000","last_fullsized":"2023-08-17T00:10:57.891545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542245,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306752,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065088,"statfs":{"total":96636764160,"available":96322650112,"internally_reserved":0,"allocated":1368064,"data_stored":635848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.032,"15min":1.3089999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.532,"5min":1.909,"15min":8.7769999999999992},"last":1.093},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0600000000000001,"15min":1.357},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":9.6530000000000005},"last":1.3380000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.109,"15min":1.3799999999999999},"min":{"1min":0.71899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5029999999999999,"5min":1.629,"15min":9.8800000000000008},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.0800000000000001,"15min":1.3620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.782,"5min":1.782,"15min":8.8399999999999999},"last":1.131}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.2529999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.359,"5min":1.4450000000000001,"15min":7.0190000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1919999999999999,"15min":1.4159999999999999},"min":{"1min":0.86699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8009999999999999,"5min":1.8120000000000001,"15min":9.4239999999999995},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.101,"15min":1.2909999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3720000000000001,"5min":1.454,"15min":7.7080000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.258,"15min":1.625},"min":{"1min":1.02,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7110000000000001,"5min":1.958,"15min":13.074999999999999},"last":1.002}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1459999999999999,"15min":1.5860000000000001},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":13.784000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1699999999999999,"15min":1.4870000000000001},"min":{"1min":0.60599999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5860000000000001,"5min":1.764,"15min":10.045999999999999},"last":1.204}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2689999999999999,"15min":1.72},"min":{"1min":0.92200000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.907,"5min":2.012,"15min":14.435},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.673},"min":{"1min":0.754,"5min":0.746,"15min":0.746},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":12.617000000000001},"last":1.494}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.321,"15min":1.6879999999999999},"min":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.833,"5min":1.833,"15min":11.279999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2689999999999999,"15min":1.6040000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5369999999999999,"5min":1.8200000000000001,"15min":11.365},"last":1.3580000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542245,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310868,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060972,"statfs":{"total":96636764160,"available":96318435328,"internally_reserved":0,"allocated":1388544,"data_stored":638008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.1200000000000001,"15min":1.071},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.32800000000000001},"max":{"1min":1.337,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.22,"15min":1.1519999999999999},"min":{"1min":0.61699999999999999,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":1.4890000000000001,"5min":10.519,"15min":10.519},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2829999999999999,"15min":1.1479999999999999},"min":{"1min":0.83499999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.391,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.107},{"interface":"front","average":{"1min":1.038,"5min":1.153,"15min":1.036},"min":{"1min":0.68000000000000005,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.5760000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.498}]},{"osd":2,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1599999999999999,"15min":1.173},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.8540000000000001,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.421},{"interface":"front","average":{"1min":1.157,"5min":1.399,"15min":1.2929999999999999},"min":{"1min":0.746,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.702,"5min":10.669,"15min":10.669},"last":1.3160000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2390000000000001,"15min":1.1719999999999999},"min":{"1min":0.89000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7170000000000001,"5min":11.475,"15min":11.475},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.232,"15min":1.266},"min":{"1min":0.81599999999999995,"5min":0.70899999999999996,"15min":0.64500000000000002},"max":{"1min":2.0270000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.341}]},{"osd":4,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3939999999999999,"15min":1.2889999999999999},"min":{"1min":0.78100000000000003,"5min":0.629,"15min":0.59199999999999997},"max":{"1min":1.6180000000000001,"5min":10.632,"15min":10.632},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.349,"15min":1.2490000000000001},"min":{"1min":0.72699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8939999999999999,"5min":11.438000000000001,"15min":11.438000000000001},"last":1.2909999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.25,"15min":1.268},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.954,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.494,"15min":1.3740000000000001},"min":{"1min":0.86299999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.7809999999999999,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.206}]},{"osd":7,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.4259999999999999,"15min":1.3420000000000001},"min":{"1min":0.83299999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.8109999999999999,"5min":11.51,"15min":11.51},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.423},"min":{"1min":0.85099999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1059999999999999,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.2569999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542246,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1380352,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.004,"15min":1.431},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.325},{"interface":"front","average":{"1min":1.022,"5min":0.98699999999999999,"15min":1.5580000000000001},"min":{"1min":0.74199999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.355,"5min":1.742,"15min":16.838999999999999},"last":1.02}]},{"osd":1,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0249999999999999,"15min":1.1419999999999999},"min":{"1min":0.60999999999999999,"5min":0.53900000000000003,"15min":0.498},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":4.2270000000000003},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.105,"15min":1.393},"min":{"1min":0.79700000000000004,"5min":0.64500000000000002,"15min":0.58799999999999997},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":9.6579999999999995},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1220000000000001,"15min":1.6100000000000001},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.47,"5min":1.5129999999999999,"15min":16.675000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1100000000000001,"15min":1.4730000000000001},"min":{"1min":0.80300000000000005,"5min":0.64600000000000002,"15min":0.60299999999999998},"max":{"1min":1.796,"5min":1.796,"15min":11.949},"last":1.629}]},{"osd":3,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1519999999999999,"15min":1.522},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":13.125},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1719999999999999,"15min":1.4370000000000001},"min":{"1min":0.83299999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.704,"5min":1.704,"15min":8.4809999999999999},"last":1.349}]},{"osd":4,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.145,"15min":1.661},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.581},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.7989999999999999},"min":{"1min":0.61299999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":19.591000000000001},"last":1.278}]},{"osd":6,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.23,"15min":1.7589999999999999},"min":{"1min":0.93500000000000005,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":17.158000000000001},"last":1.091},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.2569999999999999,"15min":1.7649999999999999},"min":{"1min":0.88500000000000001,"5min":0.65800000000000003,"15min":0.64400000000000002},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.2310000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2969999999999999,"15min":1.8720000000000001},"min":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.881,"5min":1.9610000000000001,"15min":18.158000000000001},"last":1.504},{"interface":"front","average":{"1min":1.427,"5min":1.3560000000000001,"15min":1.798},"min":{"1min":0.98699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":14.818},"last":1.429}]}]},{"osd":3,"up_from":14,"seq":60129542245,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1380352,"data_stored":637046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3580000000000001},"last":1.163},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.83699999999999997,"15min":0.81999999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0640000000000001,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84899999999999998,"15min":0.92000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.6299999999999999,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.7929999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.0489999999999999},"min":{"1min":0.51500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6890000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1879999999999999,"15min":1.2170000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.274,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.206},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.2250000000000001},"min":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.649,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1719999999999999,"15min":1.2390000000000001},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.744,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2170000000000001,"15min":1.282},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.179,"15min":1.2669999999999999},"min":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7589999999999999,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1699999999999999,"15min":1.2150000000000001},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0979999999999999,"5min":3.585,"15min":3.585},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.194,"15min":1.26},"min":{"1min":0.68300000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.165,"15min":1.2509999999999999},"min":{"1min":0.72899999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.28}]}]},{"osd":2,"up_from":14,"seq":60129542245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302676,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069164,"statfs":{"total":96636764160,"available":96326823936,"internally_reserved":0,"allocated":1388544,"data_stored":642664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.73599999999999999,"15min":0.85699999999999998},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.532,"5min":1.532,"15min":3.1099999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.98699999999999999},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1379999999999999,"5min":1.827,"15min":6.4859999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.92000000000000004},"min":{"1min":0.629,"5min":0.42099999999999999,"15min":0.35999999999999999},"max":{"1min":2.097,"5min":2.097,"15min":3.7589999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":1.0760000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3160000000000001,"5min":1.9159999999999999,"15min":3.911},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92400000000000004,"15min":1.1799999999999999},"min":{"1min":0.52000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2230000000000001,"5min":1.9530000000000001,"15min":5.4059999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.875,"15min":1.008},"min":{"1min":0.67500000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0860000000000001,"5min":3.2530000000000001,"15min":3.3410000000000002},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0800000000000001,"15min":1.74},"min":{"1min":0.92100000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.429,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.093},{"interface":"front","average":{"1min":1.117,"5min":1.1599999999999999,"15min":1.5509999999999999},"min":{"1min":0.68000000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.456,"5min":2.0649999999999999,"15min":8.4399999999999995},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.268,"15min":1.6919999999999999},"min":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5209999999999999,"5min":2.1440000000000001,"15min":12.914},"last":1.069},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1859999999999999,"15min":1.502},"min":{"1min":0.80900000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5620000000000001,"5min":1.6719999999999999,"15min":9.5519999999999996},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1890000000000001,"15min":1.653},"min":{"1min":0.69599999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.478,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.2470000000000001,"15min":1.694},"min":{"1min":0.84499999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6879999999999999,"5min":2.2210000000000001,"15min":12.698},"last":1.113}]},{"osd":7,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2649999999999999,"15min":1.649},"min":{"1min":0.82899999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6639999999999999,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2869999999999999,"15min":1.665},"min":{"1min":1.1080000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.546,"5min":4.3220000000000001,"15min":11.417},"last":1.05}]}]},{"osd":1,"up_from":14,"seq":60129542245,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1388544,"data_stored":643466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.49399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.113,"5min":1.4810000000000001,"15min":6.4329999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.169,"5min":1.6379999999999999,"15min":13.093},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76500000000000001,"15min":0.81399999999999995},"min":{"1min":0.47999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.288,"5min":1.452,"15min":5.4989999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82799999999999996,"15min":0.88900000000000001},"min":{"1min":0.54600000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.208,"5min":1.4219999999999999,"15min":7.0620000000000003},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94299999999999995,"15min":1.0189999999999999},"min":{"1min":0.55700000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.1779999999999999,"5min":1.5920000000000001,"15min":8.8279999999999994},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.84099999999999997,"15min":0.97099999999999997},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2749999999999999,"5min":1.327,"15min":12.981999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.04,"15min":1.163},"min":{"1min":0.67700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.629,"5min":1.629,"15min":20.548999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1279999999999999,"15min":1.2170000000000001},"min":{"1min":0.72499999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":8.8670000000000009},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1830000000000001,"15min":1.331},"min":{"1min":0.71599999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":13.170999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.119,"5min":1.1879999999999999,"15min":1.2649999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5880000000000001,"5min":1.9990000000000001,"15min":5.4240000000000004},"last":0.875}]},{"osd":6,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.161,"15min":1.2609999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":13.050000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.163,"5min":1.1619999999999999,"15min":1.212},"min":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":2.472,"5min":2.472,"15min":5.5359999999999996},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.2370000000000001,"15min":1.321},"min":{"1min":0.90600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.093},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.3540000000000001},"min":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":13.131},"last":0.92500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542246,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1368064,"data_stored":635848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.438,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1479999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.873},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.501,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.244,"5min":1.4159999999999999,"15min":1.423},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.242,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.63600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2050000000000001,"5min":2.133,"15min":2.133},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.85999999999999999},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4350000000000001,"5min":1.613,"15min":1.613},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.032,"5min":0.94799999999999995,"15min":1.016},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2669999999999999,"5min":1.72,"15min":1.72},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.73099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.431,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.109},{"interface":"front","average":{"1min":1.27,"5min":1.1739999999999999,"15min":1.2010000000000001},"min":{"1min":0.96599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5329999999999999,"5min":1.982,"15min":1.982},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1890000000000001,"15min":1.266},"min":{"1min":0.80400000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7809999999999999,"5min":1.849,"15min":1.849},"last":1.329},{"interface":"front","average":{"1min":1.272,"5min":1.1899999999999999,"15min":1.2789999999999999},"min":{"1min":0.88,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.7629999999999999},"last":1.226}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.196,"15min":1.278},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.593,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.272},{"interface":"front","average":{"1min":1.244,"5min":1.179,"15min":1.2549999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.72},"last":1.173}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.1970000000000001,"15min":1.268},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.585,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.256},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.179,"15min":1.2529999999999999},"min":{"1min":0.90600000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5600000000000001,"5min":1.804,"15min":2.0750000000000002},"last":1.296}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1355776,"data_stored":628669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.145,"15min":1.1120000000000001},"min":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.38300000000000001},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.133},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.1020000000000001,"15min":1.0860000000000001},"min":{"1min":0.81000000000000005,"5min":0.41999999999999998,"15min":0.40100000000000002},"max":{"1min":7.7380000000000004,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":1.278}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.381,"15min":1.256},"min":{"1min":0.65100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7.0469999999999997,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.292,"15min":1.2789999999999999},"min":{"1min":0.86399999999999999,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":6.9000000000000004,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.331}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.458,"15min":1.2589999999999999},"min":{"1min":0.71399999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.6500000000000004,"5min":18.431000000000001,"15min":18.431000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.6950000000000001,"15min":1.365},"min":{"1min":0.88500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.738,"5min":36.531999999999996,"15min":36.531999999999996},"last":1.423}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.115,"15min":1.1539999999999999},"min":{"1min":0.84499999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.512,"5min":2.722,"15min":2.722},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.7450000000000001,"15min":1.4339999999999999},"min":{"1min":0.75700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.6920000000000002,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.012}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3300000000000001,"15min":1.2689999999999999},"min":{"1min":0.81999999999999995,"5min":0.433,"15min":0.433},"max":{"1min":5.2720000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.379,"15min":1.323},"min":{"1min":0.88800000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":5.4569999999999999,"5min":9.4120000000000008,"15min":9.4120000000000008},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.4059999999999999,"15min":1.389},"min":{"1min":0.80800000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.9320000000000004,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.085},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.377,"15min":1.4490000000000001},"min":{"1min":1.0009999999999999,"5min":0.82099999999999995,"15min":0.57799999999999996},"max":{"1min":2.5619999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.546}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.228,"15min":1.3129999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.375},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.458,"15min":1.46},"min":{"1min":0.85499999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":6.7430000000000003,"5min":8.327,"15min":8.327},"last":1.4019999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:11:02.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:11:02.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.299+0000 7ff4866e4700 1 Processor -- start 2023-08-17T00:11:02.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.299+0000 7ff4866e4700 1 -- start start 2023-08-17T00:11:02.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4866e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff480153ae0 0x7ff4801581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4866e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800bca20 con 0x7ff4800bc520 2023-08-17T00:11:02.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4866e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4800bcd00 con 0x7ff480154ed0 2023-08-17T00:11:02.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4866e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4800bd6a0 con 0x7ff480153ae0 2023-08-17T00:11:02.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff484ee1700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff4800bc520 0x7ff480066ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46898/0 (socket says 172.21.15.153:46898) 2023-08-17T00:11:02.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff484ee1700 1 -- 172.21.15.153:0/4159318813 learned_addr learned my addr 172.21.15.153:0/4159318813 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:02.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4856e2700 1 --2- 172.21.15.153:0/4159318813 >> v2:172.21.15.178:3300/0 conn(0x7ff480153ae0 0x7ff4801581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff477fff700 1 -- 172.21.15.153:0/4159318813 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802808754 0 0) 0x7ff4800bca20 con 0x7ff4800bc520 2023-08-17T00:11:02.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff477fff700 1 -- 172.21.15.153:0/4159318813 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff46c0033f0 con 0x7ff4800bc520 2023-08-17T00:11:02.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4856e2700 1 -- 172.21.15.153:0/4159318813 >> v1:172.21.15.178:6789/0 conn(0x7ff480154ed0 legacy=0x7ff480062f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4856e2700 1 -- 172.21.15.153:0/4159318813 >> v1:172.21.15.153:6789/0 conn(0x7ff4800bc520 legacy=0x7ff480066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4856e2700 1 -- 172.21.15.153:0/4159318813 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4800bcfe0 con 0x7ff480153ae0 2023-08-17T00:11:02.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.303+0000 7ff4856e2700 1 --2- 172.21.15.153:0/4159318813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480153ae0 0x7ff4801581b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7ff47c009760 tx=0x7ff47c009060).ready entity=mon.1 client_cookie=8dd7136e0f229a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:02.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff477fff700 1 -- 172.21.15.153:0/4159318813 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c0090d0 con 0x7ff480153ae0 2023-08-17T00:11:02.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff477fff700 1 -- 172.21.15.153:0/4159318813 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00f510 con 0x7ff480153ae0 2023-08-17T00:11:02.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff477fff700 1 -- 172.21.15.153:0/4159318813 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00f890 con 0x7ff480153ae0 2023-08-17T00:11:02.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 -- 172.21.15.153:0/4159318813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480153ae0 msgr2=0x7ff4801581b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 --2- 172.21.15.153:0/4159318813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480153ae0 0x7ff4801581b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7ff47c009760 tx=0x7ff47c009060).stop 2023-08-17T00:11:02.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 -- 172.21.15.153:0/4159318813 shutdown_connections 2023-08-17T00:11:02.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 --2- 172.21.15.153:0/4159318813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480153ae0 0x7ff4801581b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 -- 172.21.15.153:0/4159318813 >> 172.21.15.153:0/4159318813 conn(0x7ff480069700 msgr2=0x7ff480069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:02.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 -- 172.21.15.153:0/4159318813 shutdown_connections 2023-08-17T00:11:02.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.307+0000 7ff4866e4700 1 -- 172.21.15.153:0/4159318813 wait complete. 2023-08-17T00:11:02.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 Processor -- start 2023-08-17T00:11:02.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 -- start start 2023-08-17T00:11:02.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4800bc520 0x7ff4801616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 0x7ff480150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480151020 0x7ff480167af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff480168820 con 0x7ff480153ae0 2023-08-17T00:11:02.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4800a7080 con 0x7ff480151020 2023-08-17T00:11:02.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4866e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff480164250 con 0x7ff4800bc520 2023-08-17T00:11:02.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 0x7ff480150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 0x7ff480150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39638/0 (socket says 172.21.15.153:39638) 2023-08-17T00:11:02.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 -- 172.21.15.153:0/269006742 learned_addr learned my addr 172.21.15.153:0/269006742 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:02.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff4856e2700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4800bc520 0x7ff4801616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff485ee3700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480151020 0x7ff480167af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 -- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4800bc520 msgr2=0x7ff4801616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4800bc520 0x7ff4801616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 -- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480151020 msgr2=0x7ff480167af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480151020 0x7ff480167af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 -- 172.21.15.153:0/269006742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c0092a0 con 0x7ff480153ae0 2023-08-17T00:11:02.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.311+0000 7ff484ee1700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 0x7ff480150b30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7ff47000c450 tx=0x7ff470007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:02.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4700070d0 con 0x7ff480153ae0 2023-08-17T00:11:02.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470007230 con 0x7ff480153ae0 2023-08-17T00:11:02.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff480164dc0 con 0x7ff480153ae0 2023-08-17T00:11:02.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4700075b0 con 0x7ff480153ae0 2023-08-17T00:11:02.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff480151480 con 0x7ff480153ae0 2023-08-17T00:11:02.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4800ad700 con 0x7ff480153ae0 2023-08-17T00:11:02.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.315+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff470010070 con 0x7ff480153ae0 2023-08-17T00:11:02.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.319+0000 7ff4757fa700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff46405a150 0x7ff46405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.319+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff470073650 con 0x7ff480153ae0 2023-08-17T00:11:02.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.319+0000 7ff4856e2700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff46405a150 0x7ff46405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.319+0000 7ff4856e2700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff46405a150 0x7ff46405c610 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ff47c009760 tx=0x7ff47c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:02.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.323+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4800ad700 con 0x7ff480153ae0 2023-08-17T00:11:02.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.479+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4800ad700 con 0x7ff46405a150 2023-08-17T00:11:02.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.495+0000 7ff4757fa700 1 -- 172.21.15.153:0/269006742 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359712 (secure 0 0 0) 0x7ff4800ad700 con 0x7ff46405a150 2023-08-17T00:11:02.506 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:02.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff46405a150 msgr2=0x7ff46405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff46405a150 0x7ff46405c610 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7ff47c009760 tx=0x7ff47c017000).stop 2023-08-17T00:11:02.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 msgr2=0x7ff480150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 0x7ff480150b30 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7ff47000c450 tx=0x7ff470007c80).stop 2023-08-17T00:11:02.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 shutdown_connections 2023-08-17T00:11:02.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff46405a150 0x7ff46405c610 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff480151020 0x7ff480167af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff480153ae0 0x7ff480150b30 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 --2- 172.21.15.153:0/269006742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4800bc520 0x7ff4801616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 >> 172.21.15.153:0/269006742 conn(0x7ff480069700 msgr2=0x7ff4801553d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:02.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 shutdown_connections 2023-08-17T00:11:02.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.503+0000 7ff4866e4700 1 -- 172.21.15.153:0/269006742 wait complete. 2023-08-17T00:11:02.513 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:11:02.528 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-08-17T00:11:01.356760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":116,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2429512,"kb_used_data":10760,"kb_used_omap":0,"kb_used_meta":2418688,"kb_avail":752545208,"statfs":{"total":773094113280,"available":770606292992,"internally_reserved":0,"allocated":11018240,"data_stored":5097591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2476736512},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077797034,"num_objects":-1059,"num_object_clones":0,"num_object_copies":-2118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1059,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3160,"num_write_kb":-1053257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-102,"num_bytes_recovered":-106954752,"num_keys_recovered":0,"num_objects_omap":-34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.841754"},"pg_stats":[{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919332+0000","last_change":"2023-08-17T00:10:57.908971+0000","last_active":"2023-08-17T00:10:57.919332+0000","last_peered":"2023-08-17T00:10:57.919332+0000","last_clean":"2023-08-17T00:10:57.919332+0000","last_became_active":"2023-08-17T00:10:57.908704+0000","last_became_peered":"2023-08-17T00:10:57.908704+0000","last_unstale":"2023-08-17T00:10:57.919332+0000","last_undegraded":"2023-08-17T00:10:57.919332+0000","last_fullsized":"2023-08-17T00:10:57.919332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3f","version":"111'3","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920390+0000","last_change":"2023-08-17T00:10:57.469650+0000","last_active":"2023-08-17T00:10:57.920390+0000","last_peered":"2023-08-17T00:10:57.920390+0000","last_clean":"2023-08-17T00:10:57.920390+0000","last_became_active":"2023-08-17T00:10:57.469360+0000","last_became_peered":"2023-08-17T00:10:57.469360+0000","last_unstale":"2023-08-17T00:10:57.920390+0000","last_undegraded":"2023-08-17T00:10:57.920390+0000","last_fullsized":"2023-08-17T00:10:57.920390+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921447+0000","last_change":"2023-08-17T00:10:57.915544+0000","last_active":"2023-08-17T00:10:57.921447+0000","last_peered":"2023-08-17T00:10:57.921447+0000","last_clean":"2023-08-17T00:10:57.921447+0000","last_became_active":"2023-08-17T00:10:57.915149+0000","last_became_peered":"2023-08-17T00:10:57.915149+0000","last_unstale":"2023-08-17T00:10:57.921447+0000","last_undegraded":"2023-08-17T00:10:57.921447+0000","last_fullsized":"2023-08-17T00:10:57.921447+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911241+0000","last_change":"2023-08-17T00:10:57.468347+0000","last_active":"2023-08-17T00:10:57.911241+0000","last_peered":"2023-08-17T00:10:57.911241+0000","last_clean":"2023-08-17T00:10:57.911241+0000","last_became_active":"2023-08-17T00:10:57.467921+0000","last_became_peered":"2023-08-17T00:10:57.467921+0000","last_unstale":"2023-08-17T00:10:57.911241+0000","last_undegraded":"2023-08-17T00:10:57.911241+0000","last_fullsized":"2023-08-17T00:10:57.911241+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.902498+0000","last_change":"2023-08-17T00:10:57.897499+0000","last_active":"2023-08-17T00:10:57.902498+0000","last_peered":"2023-08-17T00:10:57.902498+0000","last_clean":"2023-08-17T00:10:57.902498+0000","last_became_active":"2023-08-17T00:10:57.897249+0000","last_became_peered":"2023-08-17T00:10:57.897249+0000","last_unstale":"2023-08-17T00:10:57.902498+0000","last_undegraded":"2023-08-17T00:10:57.902498+0000","last_fullsized":"2023-08-17T00:10:57.902498+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.475849+0000","last_change":"2023-08-17T00:10:57.467490+0000","last_active":"2023-08-17T00:10:57.475849+0000","last_peered":"2023-08-17T00:10:57.475849+0000","last_clean":"2023-08-17T00:10:57.475849+0000","last_became_active":"2023-08-17T00:10:57.467091+0000","last_became_peered":"2023-08-17T00:10:57.467091+0000","last_unstale":"2023-08-17T00:10:57.475849+0000","last_undegraded":"2023-08-17T00:10:57.475849+0000","last_fullsized":"2023-08-17T00:10:57.475849+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922471+0000","last_change":"2023-08-17T00:10:57.919261+0000","last_active":"2023-08-17T00:10:57.922471+0000","last_peered":"2023-08-17T00:10:57.922471+0000","last_clean":"2023-08-17T00:10:57.922471+0000","last_became_active":"2023-08-17T00:10:57.919014+0000","last_became_peered":"2023-08-17T00:10:57.919014+0000","last_unstale":"2023-08-17T00:10:57.922471+0000","last_undegraded":"2023-08-17T00:10:57.922471+0000","last_fullsized":"2023-08-17T00:10:57.922471+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922722+0000","last_change":"2023-08-17T00:10:57.469809+0000","last_active":"2023-08-17T00:10:57.922722+0000","last_peered":"2023-08-17T00:10:57.922722+0000","last_clean":"2023-08-17T00:10:57.922722+0000","last_became_active":"2023-08-17T00:10:57.466444+0000","last_became_peered":"2023-08-17T00:10:57.466444+0000","last_unstale":"2023-08-17T00:10:57.922722+0000","last_undegraded":"2023-08-17T00:10:57.922722+0000","last_fullsized":"2023-08-17T00:10:57.922722+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920840+0000","last_change":"2023-08-17T00:10:57.913387+0000","last_active":"2023-08-17T00:10:57.920840+0000","last_peered":"2023-08-17T00:10:57.920840+0000","last_clean":"2023-08-17T00:10:57.920840+0000","last_became_active":"2023-08-17T00:10:57.913100+0000","last_became_peered":"2023-08-17T00:10:57.913100+0000","last_unstale":"2023-08-17T00:10:57.920840+0000","last_undegraded":"2023-08-17T00:10:57.920840+0000","last_fullsized":"2023-08-17T00:10:57.920840+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3b","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918591+0000","last_change":"2023-08-17T00:10:57.461666+0000","last_active":"2023-08-17T00:10:57.918591+0000","last_peered":"2023-08-17T00:10:57.918591+0000","last_clean":"2023-08-17T00:10:57.918591+0000","last_became_active":"2023-08-17T00:10:57.461315+0000","last_became_peered":"2023-08-17T00:10:57.461315+0000","last_unstale":"2023-08-17T00:10:57.918591+0000","last_undegraded":"2023-08-17T00:10:57.918591+0000","last_fullsized":"2023-08-17T00:10:57.918591+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918340+0000","last_change":"2023-08-17T00:10:57.911821+0000","last_active":"2023-08-17T00:10:57.918340+0000","last_peered":"2023-08-17T00:10:57.918340+0000","last_clean":"2023-08-17T00:10:57.918340+0000","last_became_active":"2023-08-17T00:10:57.911547+0000","last_became_peered":"2023-08-17T00:10:57.911547+0000","last_unstale":"2023-08-17T00:10:57.918340+0000","last_undegraded":"2023-08-17T00:10:57.918340+0000","last_fullsized":"2023-08-17T00:10:57.918340+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3a","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.912153+0000","last_change":"2023-08-17T00:10:57.463890+0000","last_active":"2023-08-17T00:10:57.912153+0000","last_peered":"2023-08-17T00:10:57.912153+0000","last_clean":"2023-08-17T00:10:57.912153+0000","last_became_active":"2023-08-17T00:10:57.463443+0000","last_became_peered":"2023-08-17T00:10:57.463443+0000","last_unstale":"2023-08-17T00:10:57.912153+0000","last_undegraded":"2023-08-17T00:10:57.912153+0000","last_fullsized":"2023-08-17T00:10:57.912153+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918328+0000","last_change":"2023-08-17T00:10:57.911969+0000","last_active":"2023-08-17T00:10:57.918328+0000","last_peered":"2023-08-17T00:10:57.918328+0000","last_clean":"2023-08-17T00:10:57.918328+0000","last_became_active":"2023-08-17T00:10:57.911652+0000","last_became_peered":"2023-08-17T00:10:57.911652+0000","last_unstale":"2023-08-17T00:10:57.918328+0000","last_undegraded":"2023-08-17T00:10:57.918328+0000","last_fullsized":"2023-08-17T00:10:57.918328+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888283+0000","last_change":"2023-08-17T00:10:57.466720+0000","last_active":"2023-08-17T00:10:57.888283+0000","last_peered":"2023-08-17T00:10:57.888283+0000","last_clean":"2023-08-17T00:10:57.888283+0000","last_became_active":"2023-08-17T00:10:57.466398+0000","last_became_peered":"2023-08-17T00:10:57.466398+0000","last_unstale":"2023-08-17T00:10:57.888283+0000","last_undegraded":"2023-08-17T00:10:57.888283+0000","last_fullsized":"2023-08-17T00:10:57.888283+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918311+0000","last_change":"2023-08-17T00:10:57.911488+0000","last_active":"2023-08-17T00:10:57.918311+0000","last_peered":"2023-08-17T00:10:57.918311+0000","last_clean":"2023-08-17T00:10:57.918311+0000","last_became_active":"2023-08-17T00:10:57.911212+0000","last_became_peered":"2023-08-17T00:10:57.911212+0000","last_unstale":"2023-08-17T00:10:57.918311+0000","last_undegraded":"2023-08-17T00:10:57.918311+0000","last_fullsized":"2023-08-17T00:10:57.918311+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.476047+0000","last_change":"2023-08-17T00:10:57.467449+0000","last_active":"2023-08-17T00:10:57.476047+0000","last_peered":"2023-08-17T00:10:57.476047+0000","last_clean":"2023-08-17T00:10:57.476047+0000","last_became_active":"2023-08-17T00:10:57.467111+0000","last_became_peered":"2023-08-17T00:10:57.467111+0000","last_unstale":"2023-08-17T00:10:57.476047+0000","last_undegraded":"2023-08-17T00:10:57.476047+0000","last_fullsized":"2023-08-17T00:10:57.476047+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922300+0000","last_change":"2023-08-17T00:10:57.917539+0000","last_active":"2023-08-17T00:10:57.922300+0000","last_peered":"2023-08-17T00:10:57.922300+0000","last_clean":"2023-08-17T00:10:57.922300+0000","last_became_active":"2023-08-17T00:10:57.917254+0000","last_became_peered":"2023-08-17T00:10:57.917254+0000","last_unstale":"2023-08-17T00:10:57.922300+0000","last_undegraded":"2023-08-17T00:10:57.922300+0000","last_fullsized":"2023-08-17T00:10:57.922300+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888597+0000","last_change":"2023-08-17T00:10:57.478955+0000","last_active":"2023-08-17T00:10:57.888597+0000","last_peered":"2023-08-17T00:10:57.888597+0000","last_clean":"2023-08-17T00:10:57.888597+0000","last_became_active":"2023-08-17T00:10:57.478599+0000","last_became_peered":"2023-08-17T00:10:57.478599+0000","last_unstale":"2023-08-17T00:10:57.888597+0000","last_undegraded":"2023-08-17T00:10:57.888597+0000","last_fullsized":"2023-08-17T00:10:57.888597+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922347+0000","last_change":"2023-08-17T00:10:57.917827+0000","last_active":"2023-08-17T00:10:57.922347+0000","last_peered":"2023-08-17T00:10:57.922347+0000","last_clean":"2023-08-17T00:10:57.922347+0000","last_became_active":"2023-08-17T00:10:57.917576+0000","last_became_peered":"2023-08-17T00:10:57.917576+0000","last_unstale":"2023-08-17T00:10:57.922347+0000","last_undegraded":"2023-08-17T00:10:57.922347+0000","last_fullsized":"2023-08-17T00:10:57.922347+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892912+0000","last_change":"2023-08-17T00:10:57.464559+0000","last_active":"2023-08-17T00:10:57.892912+0000","last_peered":"2023-08-17T00:10:57.892912+0000","last_clean":"2023-08-17T00:10:57.892912+0000","last_became_active":"2023-08-17T00:10:57.464161+0000","last_became_peered":"2023-08-17T00:10:57.464161+0000","last_unstale":"2023-08-17T00:10:57.892912+0000","last_undegraded":"2023-08-17T00:10:57.892912+0000","last_fullsized":"2023-08-17T00:10:57.892912+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919008+0000","last_change":"2023-08-17T00:10:57.908440+0000","last_active":"2023-08-17T00:10:57.919008+0000","last_peered":"2023-08-17T00:10:57.919008+0000","last_clean":"2023-08-17T00:10:57.919008+0000","last_became_active":"2023-08-17T00:10:57.908157+0000","last_became_peered":"2023-08-17T00:10:57.908157+0000","last_unstale":"2023-08-17T00:10:57.919008+0000","last_undegraded":"2023-08-17T00:10:57.919008+0000","last_fullsized":"2023-08-17T00:10:57.919008+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887408+0000","last_change":"2023-08-17T00:10:57.463614+0000","last_active":"2023-08-17T00:10:57.887408+0000","last_peered":"2023-08-17T00:10:57.887408+0000","last_clean":"2023-08-17T00:10:57.887408+0000","last_became_active":"2023-08-17T00:10:57.463307+0000","last_became_peered":"2023-08-17T00:10:57.463307+0000","last_unstale":"2023-08-17T00:10:57.887408+0000","last_undegraded":"2023-08-17T00:10:57.887408+0000","last_fullsized":"2023-08-17T00:10:57.887408+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.905635+0000","last_change":"2023-08-17T00:10:57.898744+0000","last_active":"2023-08-17T00:10:57.905635+0000","last_peered":"2023-08-17T00:10:57.905635+0000","last_clean":"2023-08-17T00:10:57.905635+0000","last_became_active":"2023-08-17T00:10:57.898459+0000","last_became_peered":"2023-08-17T00:10:57.898459+0000","last_unstale":"2023-08-17T00:10:57.905635+0000","last_undegraded":"2023-08-17T00:10:57.905635+0000","last_fullsized":"2023-08-17T00:10:57.905635+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.925546+0000","last_change":"2023-08-17T00:10:57.475813+0000","last_active":"2023-08-17T00:10:57.925546+0000","last_peered":"2023-08-17T00:10:57.925546+0000","last_clean":"2023-08-17T00:10:57.925546+0000","last_became_active":"2023-08-17T00:10:57.475356+0000","last_became_peered":"2023-08-17T00:10:57.475356+0000","last_unstale":"2023-08-17T00:10:57.925546+0000","last_undegraded":"2023-08-17T00:10:57.925546+0000","last_fullsized":"2023-08-17T00:10:57.925546+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918234+0000","last_change":"2023-08-17T00:10:57.911247+0000","last_active":"2023-08-17T00:10:57.918234+0000","last_peered":"2023-08-17T00:10:57.918234+0000","last_clean":"2023-08-17T00:10:57.918234+0000","last_became_active":"2023-08-17T00:10:57.910953+0000","last_became_peered":"2023-08-17T00:10:57.910953+0000","last_unstale":"2023-08-17T00:10:57.918234+0000","last_undegraded":"2023-08-17T00:10:57.918234+0000","last_fullsized":"2023-08-17T00:10:57.918234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910102+0000","last_change":"2023-08-17T00:10:57.466313+0000","last_active":"2023-08-17T00:10:57.910102+0000","last_peered":"2023-08-17T00:10:57.910102+0000","last_clean":"2023-08-17T00:10:57.910102+0000","last_became_active":"2023-08-17T00:10:57.465936+0000","last_became_peered":"2023-08-17T00:10:57.465936+0000","last_unstale":"2023-08-17T00:10:57.910102+0000","last_undegraded":"2023-08-17T00:10:57.910102+0000","last_fullsized":"2023-08-17T00:10:57.910102+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.903884+0000","last_change":"2023-08-17T00:10:57.903884+0000","last_active":"2023-08-17T00:10:57.903884+0000","last_peered":"2023-08-17T00:10:57.903884+0000","last_clean":"2023-08-17T00:10:57.903884+0000","last_became_active":"2023-08-17T00:10:57.903580+0000","last_became_peered":"2023-08-17T00:10:57.903580+0000","last_unstale":"2023-08-17T00:10:57.903884+0000","last_undegraded":"2023-08-17T00:10:57.903884+0000","last_fullsized":"2023-08-17T00:10:57.903884+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.903930+0000","last_change":"2023-08-17T00:10:57.466424+0000","last_active":"2023-08-17T00:10:57.903930+0000","last_peered":"2023-08-17T00:10:57.903930+0000","last_clean":"2023-08-17T00:10:57.903930+0000","last_became_active":"2023-08-17T00:10:57.466122+0000","last_became_peered":"2023-08-17T00:10:57.466122+0000","last_unstale":"2023-08-17T00:10:57.903930+0000","last_undegraded":"2023-08-17T00:10:57.903930+0000","last_fullsized":"2023-08-17T00:10:57.903930+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918615+0000","last_change":"2023-08-17T00:10:57.913848+0000","last_active":"2023-08-17T00:10:57.918615+0000","last_peered":"2023-08-17T00:10:57.918615+0000","last_clean":"2023-08-17T00:10:57.918615+0000","last_became_active":"2023-08-17T00:10:57.912597+0000","last_became_peered":"2023-08-17T00:10:57.912597+0000","last_unstale":"2023-08-17T00:10:57.918615+0000","last_undegraded":"2023-08-17T00:10:57.918615+0000","last_fullsized":"2023-08-17T00:10:57.918615+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904438+0000","last_change":"2023-08-17T00:10:57.476080+0000","last_active":"2023-08-17T00:10:57.904438+0000","last_peered":"2023-08-17T00:10:57.904438+0000","last_clean":"2023-08-17T00:10:57.904438+0000","last_became_active":"2023-08-17T00:10:57.475798+0000","last_became_peered":"2023-08-17T00:10:57.475798+0000","last_unstale":"2023-08-17T00:10:57.904438+0000","last_undegraded":"2023-08-17T00:10:57.904438+0000","last_fullsized":"2023-08-17T00:10:57.904438+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921230+0000","last_change":"2023-08-17T00:10:57.905860+0000","last_active":"2023-08-17T00:10:57.921230+0000","last_peered":"2023-08-17T00:10:57.921230+0000","last_clean":"2023-08-17T00:10:57.921230+0000","last_became_active":"2023-08-17T00:10:57.905412+0000","last_became_peered":"2023-08-17T00:10:57.905412+0000","last_unstale":"2023-08-17T00:10:57.921230+0000","last_undegraded":"2023-08-17T00:10:57.921230+0000","last_fullsized":"2023-08-17T00:10:57.921230+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.30","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.924798+0000","last_change":"2023-08-17T00:10:57.460360+0000","last_active":"2023-08-17T00:10:57.924798+0000","last_peered":"2023-08-17T00:10:57.924798+0000","last_clean":"2023-08-17T00:10:57.924798+0000","last_became_active":"2023-08-17T00:10:57.460051+0000","last_became_peered":"2023-08-17T00:10:57.460051+0000","last_unstale":"2023-08-17T00:10:57.924798+0000","last_undegraded":"2023-08-17T00:10:57.924798+0000","last_fullsized":"2023-08-17T00:10:57.924798+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918704+0000","last_change":"2023-08-17T00:10:57.914425+0000","last_active":"2023-08-17T00:10:57.918704+0000","last_peered":"2023-08-17T00:10:57.918704+0000","last_clean":"2023-08-17T00:10:57.918704+0000","last_became_active":"2023-08-17T00:10:57.914154+0000","last_became_peered":"2023-08-17T00:10:57.914154+0000","last_unstale":"2023-08-17T00:10:57.918704+0000","last_undegraded":"2023-08-17T00:10:57.918704+0000","last_fullsized":"2023-08-17T00:10:57.918704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891600+0000","last_change":"2023-08-17T00:10:57.454615+0000","last_active":"2023-08-17T00:10:57.891600+0000","last_peered":"2023-08-17T00:10:57.891600+0000","last_clean":"2023-08-17T00:10:57.891600+0000","last_became_active":"2023-08-17T00:10:57.454316+0000","last_became_peered":"2023-08-17T00:10:57.454316+0000","last_unstale":"2023-08-17T00:10:57.891600+0000","last_undegraded":"2023-08-17T00:10:57.891600+0000","last_fullsized":"2023-08-17T00:10:57.891600+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918721+0000","last_change":"2023-08-17T00:10:57.913802+0000","last_active":"2023-08-17T00:10:57.918721+0000","last_peered":"2023-08-17T00:10:57.918721+0000","last_clean":"2023-08-17T00:10:57.918721+0000","last_became_active":"2023-08-17T00:10:57.912847+0000","last_became_peered":"2023-08-17T00:10:57.912847+0000","last_unstale":"2023-08-17T00:10:57.918721+0000","last_undegraded":"2023-08-17T00:10:57.918721+0000","last_fullsized":"2023-08-17T00:10:57.918721+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911339+0000","last_change":"2023-08-17T00:10:57.476186+0000","last_active":"2023-08-17T00:10:57.911339+0000","last_peered":"2023-08-17T00:10:57.911339+0000","last_clean":"2023-08-17T00:10:57.911339+0000","last_became_active":"2023-08-17T00:10:57.475889+0000","last_became_peered":"2023-08-17T00:10:57.475889+0000","last_unstale":"2023-08-17T00:10:57.911339+0000","last_undegraded":"2023-08-17T00:10:57.911339+0000","last_fullsized":"2023-08-17T00:10:57.911339+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921443+0000","last_change":"2023-08-17T00:10:57.915326+0000","last_active":"2023-08-17T00:10:57.921443+0000","last_peered":"2023-08-17T00:10:57.921443+0000","last_clean":"2023-08-17T00:10:57.921443+0000","last_became_active":"2023-08-17T00:10:57.914922+0000","last_became_peered":"2023-08-17T00:10:57.914922+0000","last_unstale":"2023-08-17T00:10:57.921443+0000","last_undegraded":"2023-08-17T00:10:57.921443+0000","last_fullsized":"2023-08-17T00:10:57.921443+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2d","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921340+0000","last_change":"2023-08-17T00:10:57.458187+0000","last_active":"2023-08-17T00:10:57.921340+0000","last_peered":"2023-08-17T00:10:57.921340+0000","last_clean":"2023-08-17T00:10:57.921340+0000","last_became_active":"2023-08-17T00:10:57.457896+0000","last_became_peered":"2023-08-17T00:10:57.457896+0000","last_unstale":"2023-08-17T00:10:57.921340+0000","last_undegraded":"2023-08-17T00:10:57.921340+0000","last_fullsized":"2023-08-17T00:10:57.921340+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911789+0000","last_change":"2023-08-17T00:10:57.911789+0000","last_active":"2023-08-17T00:10:57.911789+0000","last_peered":"2023-08-17T00:10:57.911789+0000","last_clean":"2023-08-17T00:10:57.911789+0000","last_became_active":"2023-08-17T00:10:57.911461+0000","last_became_peered":"2023-08-17T00:10:57.911461+0000","last_unstale":"2023-08-17T00:10:57.911789+0000","last_undegraded":"2023-08-17T00:10:57.911789+0000","last_fullsized":"2023-08-17T00:10:57.911789+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891787+0000","last_change":"2023-08-17T00:10:57.462621+0000","last_active":"2023-08-17T00:10:57.891787+0000","last_peered":"2023-08-17T00:10:57.891787+0000","last_clean":"2023-08-17T00:10:57.891787+0000","last_became_active":"2023-08-17T00:10:57.462316+0000","last_became_peered":"2023-08-17T00:10:57.462316+0000","last_unstale":"2023-08-17T00:10:57.891787+0000","last_undegraded":"2023-08-17T00:10:57.891787+0000","last_fullsized":"2023-08-17T00:10:57.891787+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921978+0000","last_change":"2023-08-17T00:10:57.915835+0000","last_active":"2023-08-17T00:10:57.921978+0000","last_peered":"2023-08-17T00:10:57.921978+0000","last_clean":"2023-08-17T00:10:57.921978+0000","last_became_active":"2023-08-17T00:10:57.914419+0000","last_became_peered":"2023-08-17T00:10:57.914419+0000","last_unstale":"2023-08-17T00:10:57.921978+0000","last_undegraded":"2023-08-17T00:10:57.921978+0000","last_fullsized":"2023-08-17T00:10:57.921978+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2b","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892122+0000","last_change":"2023-08-17T00:10:57.468674+0000","last_active":"2023-08-17T00:10:57.892122+0000","last_peered":"2023-08-17T00:10:57.892122+0000","last_clean":"2023-08-17T00:10:57.892122+0000","last_became_active":"2023-08-17T00:10:57.468242+0000","last_became_peered":"2023-08-17T00:10:57.468242+0000","last_unstale":"2023-08-17T00:10:57.892122+0000","last_undegraded":"2023-08-17T00:10:57.892122+0000","last_fullsized":"2023-08-17T00:10:57.892122+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.902205+0000","last_change":"2023-08-17T00:10:57.897430+0000","last_active":"2023-08-17T00:10:57.902205+0000","last_peered":"2023-08-17T00:10:57.902205+0000","last_clean":"2023-08-17T00:10:57.902205+0000","last_became_active":"2023-08-17T00:10:57.897142+0000","last_became_peered":"2023-08-17T00:10:57.897142+0000","last_unstale":"2023-08-17T00:10:57.902205+0000","last_undegraded":"2023-08-17T00:10:57.902205+0000","last_fullsized":"2023-08-17T00:10:57.902205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.475821+0000","last_change":"2023-08-17T00:10:57.467523+0000","last_active":"2023-08-17T00:10:57.475821+0000","last_peered":"2023-08-17T00:10:57.475821+0000","last_clean":"2023-08-17T00:10:57.475821+0000","last_became_active":"2023-08-17T00:10:57.467203+0000","last_became_peered":"2023-08-17T00:10:57.467203+0000","last_unstale":"2023-08-17T00:10:57.475821+0000","last_undegraded":"2023-08-17T00:10:57.475821+0000","last_fullsized":"2023-08-17T00:10:57.475821+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922563+0000","last_change":"2023-08-17T00:10:57.919953+0000","last_active":"2023-08-17T00:10:57.922563+0000","last_peered":"2023-08-17T00:10:57.922563+0000","last_clean":"2023-08-17T00:10:57.922563+0000","last_became_active":"2023-08-17T00:10:57.919638+0000","last_became_peered":"2023-08-17T00:10:57.919638+0000","last_unstale":"2023-08-17T00:10:57.922563+0000","last_undegraded":"2023-08-17T00:10:57.922563+0000","last_fullsized":"2023-08-17T00:10:57.922563+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904567+0000","last_change":"2023-08-17T00:10:57.456658+0000","last_active":"2023-08-17T00:10:57.904567+0000","last_peered":"2023-08-17T00:10:57.904567+0000","last_clean":"2023-08-17T00:10:57.904567+0000","last_became_active":"2023-08-17T00:10:57.456222+0000","last_became_peered":"2023-08-17T00:10:57.456222+0000","last_unstale":"2023-08-17T00:10:57.904567+0000","last_undegraded":"2023-08-17T00:10:57.904567+0000","last_fullsized":"2023-08-17T00:10:57.904567+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918541+0000","last_change":"2023-08-17T00:10:57.913441+0000","last_active":"2023-08-17T00:10:57.918541+0000","last_peered":"2023-08-17T00:10:57.918541+0000","last_clean":"2023-08-17T00:10:57.918541+0000","last_became_active":"2023-08-17T00:10:57.913125+0000","last_became_peered":"2023-08-17T00:10:57.913125+0000","last_unstale":"2023-08-17T00:10:57.918541+0000","last_undegraded":"2023-08-17T00:10:57.918541+0000","last_fullsized":"2023-08-17T00:10:57.918541+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.893229+0000","last_change":"2023-08-17T00:10:57.465387+0000","last_active":"2023-08-17T00:10:57.893229+0000","last_peered":"2023-08-17T00:10:57.893229+0000","last_clean":"2023-08-17T00:10:57.893229+0000","last_became_active":"2023-08-17T00:10:57.465117+0000","last_became_peered":"2023-08-17T00:10:57.465117+0000","last_unstale":"2023-08-17T00:10:57.893229+0000","last_undegraded":"2023-08-17T00:10:57.893229+0000","last_fullsized":"2023-08-17T00:10:57.893229+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922607+0000","last_change":"2023-08-17T00:10:57.920047+0000","last_active":"2023-08-17T00:10:57.922607+0000","last_peered":"2023-08-17T00:10:57.922607+0000","last_clean":"2023-08-17T00:10:57.922607+0000","last_became_active":"2023-08-17T00:10:57.919772+0000","last_became_peered":"2023-08-17T00:10:57.919772+0000","last_unstale":"2023-08-17T00:10:57.922607+0000","last_undegraded":"2023-08-17T00:10:57.922607+0000","last_fullsized":"2023-08-17T00:10:57.922607+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.895343+0000","last_change":"2023-08-17T00:10:57.465141+0000","last_active":"2023-08-17T00:10:57.895343+0000","last_peered":"2023-08-17T00:10:57.895343+0000","last_clean":"2023-08-17T00:10:57.895343+0000","last_became_active":"2023-08-17T00:10:57.464883+0000","last_became_peered":"2023-08-17T00:10:57.464883+0000","last_unstale":"2023-08-17T00:10:57.895343+0000","last_undegraded":"2023-08-17T00:10:57.895343+0000","last_fullsized":"2023-08-17T00:10:57.895343+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920785+0000","last_change":"2023-08-17T00:10:57.912707+0000","last_active":"2023-08-17T00:10:57.920785+0000","last_peered":"2023-08-17T00:10:57.920785+0000","last_clean":"2023-08-17T00:10:57.920785+0000","last_became_active":"2023-08-17T00:10:57.912287+0000","last_became_peered":"2023-08-17T00:10:57.912287+0000","last_unstale":"2023-08-17T00:10:57.920785+0000","last_undegraded":"2023-08-17T00:10:57.920785+0000","last_fullsized":"2023-08-17T00:10:57.920785+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.897114+0000","last_change":"2023-08-17T00:10:57.471540+0000","last_active":"2023-08-17T00:10:57.897114+0000","last_peered":"2023-08-17T00:10:57.897114+0000","last_clean":"2023-08-17T00:10:57.897114+0000","last_became_active":"2023-08-17T00:10:57.471180+0000","last_became_peered":"2023-08-17T00:10:57.471180+0000","last_unstale":"2023-08-17T00:10:57.897114+0000","last_undegraded":"2023-08-17T00:10:57.897114+0000","last_fullsized":"2023-08-17T00:10:57.897114+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.915137+0000","last_change":"2023-08-17T00:10:57.908803+0000","last_active":"2023-08-17T00:10:57.915137+0000","last_peered":"2023-08-17T00:10:57.915137+0000","last_clean":"2023-08-17T00:10:57.915137+0000","last_became_active":"2023-08-17T00:10:57.908535+0000","last_became_peered":"2023-08-17T00:10:57.908535+0000","last_unstale":"2023-08-17T00:10:57.915137+0000","last_undegraded":"2023-08-17T00:10:57.915137+0000","last_fullsized":"2023-08-17T00:10:57.915137+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894048+0000","last_change":"2023-08-17T00:10:57.457682+0000","last_active":"2023-08-17T00:10:57.894048+0000","last_peered":"2023-08-17T00:10:57.894048+0000","last_clean":"2023-08-17T00:10:57.894048+0000","last_became_active":"2023-08-17T00:10:57.456941+0000","last_became_peered":"2023-08-17T00:10:57.456941+0000","last_unstale":"2023-08-17T00:10:57.894048+0000","last_undegraded":"2023-08-17T00:10:57.894048+0000","last_fullsized":"2023-08-17T00:10:57.894048+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.907111+0000","last_change":"2023-08-17T00:10:57.907111+0000","last_active":"2023-08-17T00:10:57.907111+0000","last_peered":"2023-08-17T00:10:57.907111+0000","last_clean":"2023-08-17T00:10:57.907111+0000","last_became_active":"2023-08-17T00:10:57.906198+0000","last_became_peered":"2023-08-17T00:10:57.906198+0000","last_unstale":"2023-08-17T00:10:57.907111+0000","last_undegraded":"2023-08-17T00:10:57.907111+0000","last_fullsized":"2023-08-17T00:10:57.907111+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894784+0000","last_change":"2023-08-17T00:10:57.478615+0000","last_active":"2023-08-17T00:10:57.894784+0000","last_peered":"2023-08-17T00:10:57.894784+0000","last_clean":"2023-08-17T00:10:57.894784+0000","last_became_active":"2023-08-17T00:10:57.478286+0000","last_became_peered":"2023-08-17T00:10:57.478286+0000","last_unstale":"2023-08-17T00:10:57.894784+0000","last_undegraded":"2023-08-17T00:10:57.894784+0000","last_fullsized":"2023-08-17T00:10:57.894784+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910649+0000","last_change":"2023-08-17T00:10:57.910649+0000","last_active":"2023-08-17T00:10:57.910649+0000","last_peered":"2023-08-17T00:10:57.910649+0000","last_clean":"2023-08-17T00:10:57.910649+0000","last_became_active":"2023-08-17T00:10:57.909585+0000","last_became_peered":"2023-08-17T00:10:57.909585+0000","last_unstale":"2023-08-17T00:10:57.910649+0000","last_undegraded":"2023-08-17T00:10:57.910649+0000","last_fullsized":"2023-08-17T00:10:57.910649+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.896859+0000","last_change":"2023-08-17T00:10:57.466976+0000","last_active":"2023-08-17T00:10:57.896859+0000","last_peered":"2023-08-17T00:10:57.896859+0000","last_clean":"2023-08-17T00:10:57.896859+0000","last_became_active":"2023-08-17T00:10:57.466690+0000","last_became_peered":"2023-08-17T00:10:57.466690+0000","last_unstale":"2023-08-17T00:10:57.896859+0000","last_undegraded":"2023-08-17T00:10:57.896859+0000","last_fullsized":"2023-08-17T00:10:57.896859+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921421+0000","last_change":"2023-08-17T00:10:57.906400+0000","last_active":"2023-08-17T00:10:57.921421+0000","last_peered":"2023-08-17T00:10:57.921421+0000","last_clean":"2023-08-17T00:10:57.921421+0000","last_became_active":"2023-08-17T00:10:57.906144+0000","last_became_peered":"2023-08-17T00:10:57.906144+0000","last_unstale":"2023-08-17T00:10:57.921421+0000","last_undegraded":"2023-08-17T00:10:57.921421+0000","last_fullsized":"2023-08-17T00:10:57.921421+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.895991+0000","last_change":"2023-08-17T00:10:57.463883+0000","last_active":"2023-08-17T00:10:57.895991+0000","last_peered":"2023-08-17T00:10:57.895991+0000","last_clean":"2023-08-17T00:10:57.895991+0000","last_became_active":"2023-08-17T00:10:57.463591+0000","last_became_peered":"2023-08-17T00:10:57.463591+0000","last_unstale":"2023-08-17T00:10:57.895991+0000","last_undegraded":"2023-08-17T00:10:57.895991+0000","last_fullsized":"2023-08-17T00:10:57.895991+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.907982+0000","last_change":"2023-08-17T00:10:57.906316+0000","last_active":"2023-08-17T00:10:57.907982+0000","last_peered":"2023-08-17T00:10:57.907982+0000","last_clean":"2023-08-17T00:10:57.907982+0000","last_became_active":"2023-08-17T00:10:57.906042+0000","last_became_peered":"2023-08-17T00:10:57.906042+0000","last_unstale":"2023-08-17T00:10:57.907982+0000","last_undegraded":"2023-08-17T00:10:57.907982+0000","last_fullsized":"2023-08-17T00:10:57.907982+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.477054+0000","last_change":"2023-08-17T00:10:57.471645+0000","last_active":"2023-08-17T00:10:57.477054+0000","last_peered":"2023-08-17T00:10:57.477054+0000","last_clean":"2023-08-17T00:10:57.477054+0000","last_became_active":"2023-08-17T00:10:57.471172+0000","last_became_peered":"2023-08-17T00:10:57.471172+0000","last_unstale":"2023-08-17T00:10:57.477054+0000","last_undegraded":"2023-08-17T00:10:57.477054+0000","last_fullsized":"2023-08-17T00:10:57.477054+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3f","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.908518+0000","last_change":"2023-08-17T00:10:57.908518+0000","last_active":"2023-08-17T00:10:57.908518+0000","last_peered":"2023-08-17T00:10:57.908518+0000","last_clean":"2023-08-17T00:10:57.908518+0000","last_became_active":"2023-08-17T00:10:57.908109+0000","last_became_peered":"2023-08-17T00:10:57.908109+0000","last_unstale":"2023-08-17T00:10:57.908518+0000","last_undegraded":"2023-08-17T00:10:57.908518+0000","last_fullsized":"2023-08-17T00:10:57.908518+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.906408+0000","last_change":"2023-08-17T00:10:57.466338+0000","last_active":"2023-08-17T00:10:57.906408+0000","last_peered":"2023-08-17T00:10:57.906408+0000","last_clean":"2023-08-17T00:10:57.906408+0000","last_became_active":"2023-08-17T00:10:57.465864+0000","last_became_peered":"2023-08-17T00:10:57.465864+0000","last_unstale":"2023-08-17T00:10:57.906408+0000","last_undegraded":"2023-08-17T00:10:57.906408+0000","last_fullsized":"2023-08-17T00:10:57.906408+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921448+0000","last_change":"2023-08-17T00:10:57.904810+0000","last_active":"2023-08-17T00:10:57.921448+0000","last_peered":"2023-08-17T00:10:57.921448+0000","last_clean":"2023-08-17T00:10:57.921448+0000","last_became_active":"2023-08-17T00:10:57.904528+0000","last_became_peered":"2023-08-17T00:10:57.904528+0000","last_unstale":"2023-08-17T00:10:57.921448+0000","last_undegraded":"2023-08-17T00:10:57.921448+0000","last_fullsized":"2023-08-17T00:10:57.921448+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1f","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.908914+0000","last_change":"2023-08-17T00:10:57.470805+0000","last_active":"2023-08-17T00:10:57.908914+0000","last_peered":"2023-08-17T00:10:57.908914+0000","last_clean":"2023-08-17T00:10:57.908914+0000","last_became_active":"2023-08-17T00:10:57.470351+0000","last_became_peered":"2023-08-17T00:10:57.470351+0000","last_unstale":"2023-08-17T00:10:57.908914+0000","last_undegraded":"2023-08-17T00:10:57.908914+0000","last_fullsized":"2023-08-17T00:10:57.908914+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922335+0000","last_change":"2023-08-17T00:10:57.917770+0000","last_active":"2023-08-17T00:10:57.922335+0000","last_peered":"2023-08-17T00:10:57.922335+0000","last_clean":"2023-08-17T00:10:57.922335+0000","last_became_active":"2023-08-17T00:10:57.917291+0000","last_became_peered":"2023-08-17T00:10:57.917291+0000","last_unstale":"2023-08-17T00:10:57.922335+0000","last_undegraded":"2023-08-17T00:10:57.922335+0000","last_fullsized":"2023-08-17T00:10:57.922335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.914430+0000","last_change":"2023-08-17T00:10:57.460905+0000","last_active":"2023-08-17T00:10:57.914430+0000","last_peered":"2023-08-17T00:10:57.914430+0000","last_clean":"2023-08-17T00:10:57.914430+0000","last_became_active":"2023-08-17T00:10:57.460622+0000","last_became_peered":"2023-08-17T00:10:57.460622+0000","last_unstale":"2023-08-17T00:10:57.914430+0000","last_undegraded":"2023-08-17T00:10:57.914430+0000","last_fullsized":"2023-08-17T00:10:57.914430+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922909+0000","last_change":"2023-08-17T00:10:57.921854+0000","last_active":"2023-08-17T00:10:57.922909+0000","last_peered":"2023-08-17T00:10:57.922909+0000","last_clean":"2023-08-17T00:10:57.922909+0000","last_became_active":"2023-08-17T00:10:57.921443+0000","last_became_peered":"2023-08-17T00:10:57.921443+0000","last_unstale":"2023-08-17T00:10:57.922909+0000","last_undegraded":"2023-08-17T00:10:57.922909+0000","last_fullsized":"2023-08-17T00:10:57.922909+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910636+0000","last_change":"2023-08-17T00:10:57.462876+0000","last_active":"2023-08-17T00:10:57.910636+0000","last_peered":"2023-08-17T00:10:57.910636+0000","last_clean":"2023-08-17T00:10:57.910636+0000","last_became_active":"2023-08-17T00:10:57.462565+0000","last_became_peered":"2023-08-17T00:10:57.462565+0000","last_unstale":"2023-08-17T00:10:57.910636+0000","last_undegraded":"2023-08-17T00:10:57.910636+0000","last_fullsized":"2023-08-17T00:10:57.910636+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910304+0000","last_change":"2023-08-17T00:10:57.905233+0000","last_active":"2023-08-17T00:10:57.910304+0000","last_peered":"2023-08-17T00:10:57.910304+0000","last_clean":"2023-08-17T00:10:57.910304+0000","last_became_active":"2023-08-17T00:10:57.904880+0000","last_became_peered":"2023-08-17T00:10:57.904880+0000","last_unstale":"2023-08-17T00:10:57.910304+0000","last_undegraded":"2023-08-17T00:10:57.910304+0000","last_fullsized":"2023-08-17T00:10:57.910304+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.909269+0000","last_change":"2023-08-17T00:10:57.455851+0000","last_active":"2023-08-17T00:10:57.909269+0000","last_peered":"2023-08-17T00:10:57.909269+0000","last_clean":"2023-08-17T00:10:57.909269+0000","last_became_active":"2023-08-17T00:10:57.455555+0000","last_became_peered":"2023-08-17T00:10:57.455555+0000","last_unstale":"2023-08-17T00:10:57.909269+0000","last_undegraded":"2023-08-17T00:10:57.909269+0000","last_fullsized":"2023-08-17T00:10:57.909269+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910865+0000","last_change":"2023-08-17T00:10:57.910865+0000","last_active":"2023-08-17T00:10:57.910865+0000","last_peered":"2023-08-17T00:10:57.910865+0000","last_clean":"2023-08-17T00:10:57.910865+0000","last_became_active":"2023-08-17T00:10:57.909250+0000","last_became_peered":"2023-08-17T00:10:57.909250+0000","last_unstale":"2023-08-17T00:10:57.910865+0000","last_undegraded":"2023-08-17T00:10:57.910865+0000","last_fullsized":"2023-08-17T00:10:57.910865+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887704+0000","last_change":"2023-08-17T00:10:57.462904+0000","last_active":"2023-08-17T00:10:57.887704+0000","last_peered":"2023-08-17T00:10:57.887704+0000","last_clean":"2023-08-17T00:10:57.887704+0000","last_became_active":"2023-08-17T00:10:57.462631+0000","last_became_peered":"2023-08-17T00:10:57.462631+0000","last_unstale":"2023-08-17T00:10:57.887704+0000","last_undegraded":"2023-08-17T00:10:57.887704+0000","last_fullsized":"2023-08-17T00:10:57.887704+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.912455+0000","last_change":"2023-08-17T00:10:57.912455+0000","last_active":"2023-08-17T00:10:57.912455+0000","last_peered":"2023-08-17T00:10:57.912455+0000","last_clean":"2023-08-17T00:10:57.912455+0000","last_became_active":"2023-08-17T00:10:57.912048+0000","last_became_peered":"2023-08-17T00:10:57.912048+0000","last_unstale":"2023-08-17T00:10:57.912455+0000","last_undegraded":"2023-08-17T00:10:57.912455+0000","last_fullsized":"2023-08-17T00:10:57.912455+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.890839+0000","last_change":"2023-08-17T00:10:57.463105+0000","last_active":"2023-08-17T00:10:57.890839+0000","last_peered":"2023-08-17T00:10:57.890839+0000","last_clean":"2023-08-17T00:10:57.890839+0000","last_became_active":"2023-08-17T00:10:57.462749+0000","last_became_peered":"2023-08-17T00:10:57.462749+0000","last_unstale":"2023-08-17T00:10:57.890839+0000","last_undegraded":"2023-08-17T00:10:57.890839+0000","last_fullsized":"2023-08-17T00:10:57.890839+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.903598+0000","last_change":"2023-08-17T00:10:57.900953+0000","last_active":"2023-08-17T00:10:57.903598+0000","last_peered":"2023-08-17T00:10:57.903598+0000","last_clean":"2023-08-17T00:10:57.903598+0000","last_became_active":"2023-08-17T00:10:57.900677+0000","last_became_peered":"2023-08-17T00:10:57.900677+0000","last_unstale":"2023-08-17T00:10:57.903598+0000","last_undegraded":"2023-08-17T00:10:57.903598+0000","last_fullsized":"2023-08-17T00:10:57.903598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.890570+0000","last_change":"2023-08-17T00:10:57.463918+0000","last_active":"2023-08-17T00:10:57.890570+0000","last_peered":"2023-08-17T00:10:57.890570+0000","last_clean":"2023-08-17T00:10:57.890570+0000","last_became_active":"2023-08-17T00:10:57.463394+0000","last_became_peered":"2023-08-17T00:10:57.463394+0000","last_unstale":"2023-08-17T00:10:57.890570+0000","last_undegraded":"2023-08-17T00:10:57.890570+0000","last_fullsized":"2023-08-17T00:10:57.890570+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904710+0000","last_change":"2023-08-17T00:10:57.904710+0000","last_active":"2023-08-17T00:10:57.904710+0000","last_peered":"2023-08-17T00:10:57.904710+0000","last_clean":"2023-08-17T00:10:57.904710+0000","last_became_active":"2023-08-17T00:10:57.904410+0000","last_became_peered":"2023-08-17T00:10:57.904410+0000","last_unstale":"2023-08-17T00:10:57.904710+0000","last_undegraded":"2023-08-17T00:10:57.904710+0000","last_fullsized":"2023-08-17T00:10:57.904710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.896245+0000","last_change":"2023-08-17T00:10:57.477032+0000","last_active":"2023-08-17T00:10:57.896245+0000","last_peered":"2023-08-17T00:10:57.896245+0000","last_clean":"2023-08-17T00:10:57.896245+0000","last_became_active":"2023-08-17T00:10:57.476756+0000","last_became_peered":"2023-08-17T00:10:57.476756+0000","last_unstale":"2023-08-17T00:10:57.896245+0000","last_undegraded":"2023-08-17T00:10:57.896245+0000","last_fullsized":"2023-08-17T00:10:57.896245+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.914101+0000","last_change":"2023-08-17T00:10:57.914101+0000","last_active":"2023-08-17T00:10:57.914101+0000","last_peered":"2023-08-17T00:10:57.914101+0000","last_clean":"2023-08-17T00:10:57.914101+0000","last_became_active":"2023-08-17T00:10:57.913593+0000","last_became_peered":"2023-08-17T00:10:57.913593+0000","last_unstale":"2023-08-17T00:10:57.914101+0000","last_undegraded":"2023-08-17T00:10:57.914101+0000","last_fullsized":"2023-08-17T00:10:57.914101+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.893355+0000","last_change":"2023-08-17T00:10:57.450464+0000","last_active":"2023-08-17T00:10:57.893355+0000","last_peered":"2023-08-17T00:10:57.893355+0000","last_clean":"2023-08-17T00:10:57.893355+0000","last_became_active":"2023-08-17T00:10:57.450149+0000","last_became_peered":"2023-08-17T00:10:57.450149+0000","last_unstale":"2023-08-17T00:10:57.893355+0000","last_undegraded":"2023-08-17T00:10:57.893355+0000","last_fullsized":"2023-08-17T00:10:57.893355+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918716+0000","last_change":"2023-08-17T00:10:57.918716+0000","last_active":"2023-08-17T00:10:57.918716+0000","last_peered":"2023-08-17T00:10:57.918716+0000","last_clean":"2023-08-17T00:10:57.918716+0000","last_became_active":"2023-08-17T00:10:57.918380+0000","last_became_peered":"2023-08-17T00:10:57.918380+0000","last_unstale":"2023-08-17T00:10:57.918716+0000","last_undegraded":"2023-08-17T00:10:57.918716+0000","last_fullsized":"2023-08-17T00:10:57.918716+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.911455+0000","last_change":"2023-08-17T00:10:57.465544+0000","last_active":"2023-08-17T00:10:57.911455+0000","last_peered":"2023-08-17T00:10:57.911455+0000","last_clean":"2023-08-17T00:10:57.911455+0000","last_became_active":"2023-08-17T00:10:57.465244+0000","last_became_peered":"2023-08-17T00:10:57.465244+0000","last_unstale":"2023-08-17T00:10:57.911455+0000","last_undegraded":"2023-08-17T00:10:57.911455+0000","last_fullsized":"2023-08-17T00:10:57.911455+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922415+0000","last_change":"2023-08-17T00:10:57.918195+0000","last_active":"2023-08-17T00:10:57.922415+0000","last_peered":"2023-08-17T00:10:57.922415+0000","last_clean":"2023-08-17T00:10:57.922415+0000","last_became_active":"2023-08-17T00:10:57.917774+0000","last_became_peered":"2023-08-17T00:10:57.917774+0000","last_unstale":"2023-08-17T00:10:57.922415+0000","last_undegraded":"2023-08-17T00:10:57.922415+0000","last_fullsized":"2023-08-17T00:10:57.922415+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"111'3","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920081+0000","last_change":"2023-08-17T00:10:57.466316+0000","last_active":"2023-08-17T00:10:57.920081+0000","last_peered":"2023-08-17T00:10:57.920081+0000","last_clean":"2023-08-17T00:10:57.920081+0000","last_became_active":"2023-08-17T00:10:57.466017+0000","last_became_peered":"2023-08-17T00:10:57.466017+0000","last_unstale":"2023-08-17T00:10:57.920081+0000","last_undegraded":"2023-08-17T00:10:57.920081+0000","last_fullsized":"2023-08-17T00:10:57.920081+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919592+0000","last_change":"2023-08-17T00:10:57.914984+0000","last_active":"2023-08-17T00:10:57.919592+0000","last_peered":"2023-08-17T00:10:57.919592+0000","last_clean":"2023-08-17T00:10:57.919592+0000","last_became_active":"2023-08-17T00:10:57.914670+0000","last_became_peered":"2023-08-17T00:10:57.914670+0000","last_unstale":"2023-08-17T00:10:57.919592+0000","last_undegraded":"2023-08-17T00:10:57.919592+0000","last_fullsized":"2023-08-17T00:10:57.919592+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.14","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.923186+0000","last_change":"2023-08-17T00:10:57.460271+0000","last_active":"2023-08-17T00:10:57.923186+0000","last_peered":"2023-08-17T00:10:57.923186+0000","last_clean":"2023-08-17T00:10:57.923186+0000","last_became_active":"2023-08-17T00:10:57.459946+0000","last_became_peered":"2023-08-17T00:10:57.459946+0000","last_unstale":"2023-08-17T00:10:57.923186+0000","last_undegraded":"2023-08-17T00:10:57.923186+0000","last_fullsized":"2023-08-17T00:10:57.923186+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919293+0000","last_change":"2023-08-17T00:10:57.916236+0000","last_active":"2023-08-17T00:10:57.919293+0000","last_peered":"2023-08-17T00:10:57.919293+0000","last_clean":"2023-08-17T00:10:57.919293+0000","last_became_active":"2023-08-17T00:10:57.915242+0000","last_became_peered":"2023-08-17T00:10:57.915242+0000","last_unstale":"2023-08-17T00:10:57.919293+0000","last_undegraded":"2023-08-17T00:10:57.919293+0000","last_fullsized":"2023-08-17T00:10:57.919293+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.13","version":"111'1","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892244+0000","last_change":"2023-08-17T00:10:57.468501+0000","last_active":"2023-08-17T00:10:57.892244+0000","last_peered":"2023-08-17T00:10:57.892244+0000","last_clean":"2023-08-17T00:10:57.892244+0000","last_became_active":"2023-08-17T00:10:57.467879+0000","last_became_peered":"2023-08-17T00:10:57.467879+0000","last_unstale":"2023-08-17T00:10:57.892244+0000","last_undegraded":"2023-08-17T00:10:57.892244+0000","last_fullsized":"2023-08-17T00:10:57.892244+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918572+0000","last_change":"2023-08-17T00:10:57.910636+0000","last_active":"2023-08-17T00:10:57.918572+0000","last_peered":"2023-08-17T00:10:57.918572+0000","last_clean":"2023-08-17T00:10:57.918572+0000","last_became_active":"2023-08-17T00:10:57.910258+0000","last_became_peered":"2023-08-17T00:10:57.910258+0000","last_unstale":"2023-08-17T00:10:57.918572+0000","last_undegraded":"2023-08-17T00:10:57.918572+0000","last_fullsized":"2023-08-17T00:10:57.918572+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904021+0000","last_change":"2023-08-17T00:10:57.469333+0000","last_active":"2023-08-17T00:10:57.904021+0000","last_peered":"2023-08-17T00:10:57.904021+0000","last_clean":"2023-08-17T00:10:57.904021+0000","last_became_active":"2023-08-17T00:10:57.466716+0000","last_became_peered":"2023-08-17T00:10:57.466716+0000","last_unstale":"2023-08-17T00:10:57.904021+0000","last_undegraded":"2023-08-17T00:10:57.904021+0000","last_fullsized":"2023-08-17T00:10:57.904021+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.915107+0000","last_change":"2023-08-17T00:10:57.907310+0000","last_active":"2023-08-17T00:10:57.915107+0000","last_peered":"2023-08-17T00:10:57.915107+0000","last_clean":"2023-08-17T00:10:57.915107+0000","last_became_active":"2023-08-17T00:10:57.906995+0000","last_became_peered":"2023-08-17T00:10:57.906995+0000","last_unstale":"2023-08-17T00:10:57.915107+0000","last_undegraded":"2023-08-17T00:10:57.915107+0000","last_fullsized":"2023-08-17T00:10:57.915107+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.477037+0000","last_change":"2023-08-17T00:10:57.471469+0000","last_active":"2023-08-17T00:10:57.477037+0000","last_peered":"2023-08-17T00:10:57.477037+0000","last_clean":"2023-08-17T00:10:57.477037+0000","last_became_active":"2023-08-17T00:10:57.470307+0000","last_became_peered":"2023-08-17T00:10:57.470307+0000","last_unstale":"2023-08-17T00:10:57.477037+0000","last_undegraded":"2023-08-17T00:10:57.477037+0000","last_fullsized":"2023-08-17T00:10:57.477037+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921210+0000","last_change":"2023-08-17T00:10:57.905686+0000","last_active":"2023-08-17T00:10:57.921210+0000","last_peered":"2023-08-17T00:10:57.921210+0000","last_clean":"2023-08-17T00:10:57.921210+0000","last_became_active":"2023-08-17T00:10:57.904998+0000","last_became_peered":"2023-08-17T00:10:57.904998+0000","last_unstale":"2023-08-17T00:10:57.921210+0000","last_undegraded":"2023-08-17T00:10:57.921210+0000","last_fullsized":"2023-08-17T00:10:57.921210+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"111'4","reported_seq":14,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.917335+0000","last_change":"2023-08-17T00:10:57.463649+0000","last_active":"2023-08-17T00:10:57.917335+0000","last_peered":"2023-08-17T00:10:57.917335+0000","last_clean":"2023-08-17T00:10:57.917335+0000","last_became_active":"2023-08-17T00:10:57.463362+0000","last_became_peered":"2023-08-17T00:10:57.463362+0000","last_unstale":"2023-08-17T00:10:57.917335+0000","last_undegraded":"2023-08-17T00:10:57.917335+0000","last_fullsized":"2023-08-17T00:10:57.917335+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919314+0000","last_change":"2023-08-17T00:10:57.908479+0000","last_active":"2023-08-17T00:10:57.919314+0000","last_peered":"2023-08-17T00:10:57.919314+0000","last_clean":"2023-08-17T00:10:57.919314+0000","last_became_active":"2023-08-17T00:10:57.908181+0000","last_became_peered":"2023-08-17T00:10:57.908181+0000","last_unstale":"2023-08-17T00:10:57.919314+0000","last_undegraded":"2023-08-17T00:10:57.919314+0000","last_fullsized":"2023-08-17T00:10:57.919314+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.7","version":"111'2","reported_seq":12,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921772+0000","last_change":"2023-08-17T00:10:57.458335+0000","last_active":"2023-08-17T00:10:57.921772+0000","last_peered":"2023-08-17T00:10:57.921772+0000","last_clean":"2023-08-17T00:10:57.921772+0000","last_became_active":"2023-08-17T00:10:57.458038+0000","last_became_peered":"2023-08-17T00:10:57.458038+0000","last_unstale":"2023-08-17T00:10:57.921772+0000","last_undegraded":"2023-08-17T00:10:57.921772+0000","last_fullsized":"2023-08-17T00:10:57.921772+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910295+0000","last_change":"2023-08-17T00:10:57.907531+0000","last_active":"2023-08-17T00:10:57.910295+0000","last_peered":"2023-08-17T00:10:57.910295+0000","last_clean":"2023-08-17T00:10:57.910295+0000","last_became_active":"2023-08-17T00:10:57.907218+0000","last_became_peered":"2023-08-17T00:10:57.907218+0000","last_unstale":"2023-08-17T00:10:57.910295+0000","last_undegraded":"2023-08-17T00:10:57.910295+0000","last_fullsized":"2023-08-17T00:10:57.910295+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891343+0000","last_change":"2023-08-17T00:10:57.465347+0000","last_active":"2023-08-17T00:10:57.891343+0000","last_peered":"2023-08-17T00:10:57.891343+0000","last_clean":"2023-08-17T00:10:57.891343+0000","last_became_active":"2023-08-17T00:10:57.465036+0000","last_became_peered":"2023-08-17T00:10:57.465036+0000","last_unstale":"2023-08-17T00:10:57.891343+0000","last_undegraded":"2023-08-17T00:10:57.891343+0000","last_fullsized":"2023-08-17T00:10:57.891343+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.922492+0000","last_change":"2023-08-17T00:10:57.919640+0000","last_active":"2023-08-17T00:10:57.922492+0000","last_peered":"2023-08-17T00:10:57.922492+0000","last_clean":"2023-08-17T00:10:57.922492+0000","last_became_active":"2023-08-17T00:10:57.918736+0000","last_became_peered":"2023-08-17T00:10:57.918736+0000","last_unstale":"2023-08-17T00:10:57.922492+0000","last_undegraded":"2023-08-17T00:10:57.922492+0000","last_fullsized":"2023-08-17T00:10:57.922492+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887546+0000","last_change":"2023-08-17T00:10:57.470379+0000","last_active":"2023-08-17T00:10:57.887546+0000","last_peered":"2023-08-17T00:10:57.887546+0000","last_clean":"2023-08-17T00:10:57.887546+0000","last_became_active":"2023-08-17T00:10:57.470128+0000","last_became_peered":"2023-08-17T00:10:57.470128+0000","last_unstale":"2023-08-17T00:10:57.887546+0000","last_undegraded":"2023-08-17T00:10:57.887546+0000","last_fullsized":"2023-08-17T00:10:57.887546+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918292+0000","last_change":"2023-08-17T00:10:57.911345+0000","last_active":"2023-08-17T00:10:57.918292+0000","last_peered":"2023-08-17T00:10:57.918292+0000","last_clean":"2023-08-17T00:10:57.918292+0000","last_became_active":"2023-08-17T00:10:57.910991+0000","last_became_peered":"2023-08-17T00:10:57.910991+0000","last_unstale":"2023-08-17T00:10:57.918292+0000","last_undegraded":"2023-08-17T00:10:57.918292+0000","last_fullsized":"2023-08-17T00:10:57.918292+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.476000+0000","last_change":"2023-08-17T00:10:57.467593+0000","last_active":"2023-08-17T00:10:57.476000+0000","last_peered":"2023-08-17T00:10:57.476000+0000","last_clean":"2023-08-17T00:10:57.476000+0000","last_became_active":"2023-08-17T00:10:57.467295+0000","last_became_peered":"2023-08-17T00:10:57.467295+0000","last_unstale":"2023-08-17T00:10:57.476000+0000","last_undegraded":"2023-08-17T00:10:57.476000+0000","last_fullsized":"2023-08-17T00:10:57.476000+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910852+0000","last_change":"2023-08-17T00:10:57.910852+0000","last_active":"2023-08-17T00:10:57.910852+0000","last_peered":"2023-08-17T00:10:57.910852+0000","last_clean":"2023-08-17T00:10:57.910852+0000","last_became_active":"2023-08-17T00:10:57.910329+0000","last_became_peered":"2023-08-17T00:10:57.910329+0000","last_unstale":"2023-08-17T00:10:57.910852+0000","last_undegraded":"2023-08-17T00:10:57.910852+0000","last_fullsized":"2023-08-17T00:10:57.910852+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887914+0000","last_change":"2023-08-17T00:10:57.479634+0000","last_active":"2023-08-17T00:10:57.887914+0000","last_peered":"2023-08-17T00:10:57.887914+0000","last_clean":"2023-08-17T00:10:57.887914+0000","last_became_active":"2023-08-17T00:10:57.479165+0000","last_became_peered":"2023-08-17T00:10:57.479165+0000","last_unstale":"2023-08-17T00:10:57.887914+0000","last_undegraded":"2023-08-17T00:10:57.887914+0000","last_fullsized":"2023-08-17T00:10:57.887914+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.904556+0000","last_change":"2023-08-17T00:10:57.904556+0000","last_active":"2023-08-17T00:10:57.904556+0000","last_peered":"2023-08-17T00:10:57.904556+0000","last_clean":"2023-08-17T00:10:57.904556+0000","last_became_active":"2023-08-17T00:10:57.904173+0000","last_became_peered":"2023-08-17T00:10:57.904173+0000","last_unstale":"2023-08-17T00:10:57.904556+0000","last_undegraded":"2023-08-17T00:10:57.904556+0000","last_fullsized":"2023-08-17T00:10:57.904556+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888692+0000","last_change":"2023-08-17T00:10:57.464523+0000","last_active":"2023-08-17T00:10:57.888692+0000","last_peered":"2023-08-17T00:10:57.888692+0000","last_clean":"2023-08-17T00:10:57.888692+0000","last_became_active":"2023-08-17T00:10:57.464242+0000","last_became_peered":"2023-08-17T00:10:57.464242+0000","last_unstale":"2023-08-17T00:10:57.888692+0000","last_undegraded":"2023-08-17T00:10:57.888692+0000","last_fullsized":"2023-08-17T00:10:57.888692+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920933+0000","last_change":"2023-08-17T00:10:57.914359+0000","last_active":"2023-08-17T00:10:57.920933+0000","last_peered":"2023-08-17T00:10:57.920933+0000","last_clean":"2023-08-17T00:10:57.920933+0000","last_became_active":"2023-08-17T00:10:57.913462+0000","last_became_peered":"2023-08-17T00:10:57.913462+0000","last_unstale":"2023-08-17T00:10:57.920933+0000","last_undegraded":"2023-08-17T00:10:57.920933+0000","last_fullsized":"2023-08-17T00:10:57.920933+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.890640+0000","last_change":"2023-08-17T00:10:57.469357+0000","last_active":"2023-08-17T00:10:57.890640+0000","last_peered":"2023-08-17T00:10:57.890640+0000","last_clean":"2023-08-17T00:10:57.890640+0000","last_became_active":"2023-08-17T00:10:57.469085+0000","last_became_peered":"2023-08-17T00:10:57.469085+0000","last_unstale":"2023-08-17T00:10:57.890640+0000","last_undegraded":"2023-08-17T00:10:57.890640+0000","last_fullsized":"2023-08-17T00:10:57.890640+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.908072+0000","last_change":"2023-08-17T00:10:57.906525+0000","last_active":"2023-08-17T00:10:57.908072+0000","last_peered":"2023-08-17T00:10:57.908072+0000","last_clean":"2023-08-17T00:10:57.908072+0000","last_became_active":"2023-08-17T00:10:57.906246+0000","last_became_peered":"2023-08-17T00:10:57.906246+0000","last_unstale":"2023-08-17T00:10:57.908072+0000","last_undegraded":"2023-08-17T00:10:57.908072+0000","last_fullsized":"2023-08-17T00:10:57.908072+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.889104+0000","last_change":"2023-08-17T00:10:57.459352+0000","last_active":"2023-08-17T00:10:57.889104+0000","last_peered":"2023-08-17T00:10:57.889104+0000","last_clean":"2023-08-17T00:10:57.889104+0000","last_became_active":"2023-08-17T00:10:57.459057+0000","last_became_peered":"2023-08-17T00:10:57.459057+0000","last_unstale":"2023-08-17T00:10:57.889104+0000","last_undegraded":"2023-08-17T00:10:57.889104+0000","last_fullsized":"2023-08-17T00:10:57.889104+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920147+0000","last_change":"2023-08-17T00:10:57.911624+0000","last_active":"2023-08-17T00:10:57.920147+0000","last_peered":"2023-08-17T00:10:57.920147+0000","last_clean":"2023-08-17T00:10:57.920147+0000","last_became_active":"2023-08-17T00:10:57.911312+0000","last_became_peered":"2023-08-17T00:10:57.911312+0000","last_unstale":"2023-08-17T00:10:57.920147+0000","last_undegraded":"2023-08-17T00:10:57.920147+0000","last_fullsized":"2023-08-17T00:10:57.920147+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888585+0000","last_change":"2023-08-17T00:10:57.476392+0000","last_active":"2023-08-17T00:10:57.888585+0000","last_peered":"2023-08-17T00:10:57.888585+0000","last_clean":"2023-08-17T00:10:57.888585+0000","last_became_active":"2023-08-17T00:10:57.476086+0000","last_became_peered":"2023-08-17T00:10:57.476086+0000","last_unstale":"2023-08-17T00:10:57.888585+0000","last_undegraded":"2023-08-17T00:10:57.888585+0000","last_fullsized":"2023-08-17T00:10:57.888585+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888643+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:10:57.888643+0000","last_peered":"2023-08-17T00:10:57.888643+0000","last_clean":"2023-08-17T00:10:57.888643+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:10:57.888643+0000","last_undegraded":"2023-08-17T00:10:57.888643+0000","last_fullsized":"2023-08-17T00:10:57.888643+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.909895+0000","last_change":"2023-08-17T00:10:57.909895+0000","last_active":"2023-08-17T00:10:57.909895+0000","last_peered":"2023-08-17T00:10:57.909895+0000","last_clean":"2023-08-17T00:10:57.909895+0000","last_became_active":"2023-08-17T00:10:57.908943+0000","last_became_peered":"2023-08-17T00:10:57.908943+0000","last_unstale":"2023-08-17T00:10:57.909895+0000","last_undegraded":"2023-08-17T00:10:57.909895+0000","last_fullsized":"2023-08-17T00:10:57.909895+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.b","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.914536+0000","last_change":"2023-08-17T00:10:57.476964+0000","last_active":"2023-08-17T00:10:57.914536+0000","last_peered":"2023-08-17T00:10:57.914536+0000","last_clean":"2023-08-17T00:10:57.914536+0000","last_became_active":"2023-08-17T00:10:57.476558+0000","last_became_peered":"2023-08-17T00:10:57.476558+0000","last_unstale":"2023-08-17T00:10:57.914536+0000","last_undegraded":"2023-08-17T00:10:57.914536+0000","last_fullsized":"2023-08-17T00:10:57.914536+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":110,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.446905+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:10:57.446905+0000","last_peered":"2023-08-17T00:10:57.446905+0000","last_clean":"2023-08-17T00:10:57.446905+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:10:57.446905+0000","last_undegraded":"2023-08-17T00:10:57.446905+0000","last_fullsized":"2023-08-17T00:10:57.446905+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.910569+0000","last_change":"2023-08-17T00:10:57.910569+0000","last_active":"2023-08-17T00:10:57.910569+0000","last_peered":"2023-08-17T00:10:57.910569+0000","last_clean":"2023-08-17T00:10:57.910569+0000","last_became_active":"2023-08-17T00:10:57.910256+0000","last_became_peered":"2023-08-17T00:10:57.910256+0000","last_unstale":"2023-08-17T00:10:57.910569+0000","last_undegraded":"2023-08-17T00:10:57.910569+0000","last_fullsized":"2023-08-17T00:10:57.910569+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.906528+0000","last_change":"2023-08-17T00:10:57.456525+0000","last_active":"2023-08-17T00:10:57.906528+0000","last_peered":"2023-08-17T00:10:57.906528+0000","last_clean":"2023-08-17T00:10:57.906528+0000","last_became_active":"2023-08-17T00:10:57.456009+0000","last_became_peered":"2023-08-17T00:10:57.456009+0000","last_unstale":"2023-08-17T00:10:57.906528+0000","last_undegraded":"2023-08-17T00:10:57.906528+0000","last_fullsized":"2023-08-17T00:10:57.906528+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.887650+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:10:57.887650+0000","last_peered":"2023-08-17T00:10:57.887650+0000","last_clean":"2023-08-17T00:10:57.887650+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:10:57.887650+0000","last_undegraded":"2023-08-17T00:10:57.887650+0000","last_fullsized":"2023-08-17T00:10:57.887650+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.919598+0000","last_change":"2023-08-17T00:10:57.914980+0000","last_active":"2023-08-17T00:10:57.919598+0000","last_peered":"2023-08-17T00:10:57.919598+0000","last_clean":"2023-08-17T00:10:57.919598+0000","last_became_active":"2023-08-17T00:10:57.914699+0000","last_became_peered":"2023-08-17T00:10:57.914699+0000","last_unstale":"2023-08-17T00:10:57.919598+0000","last_undegraded":"2023-08-17T00:10:57.919598+0000","last_fullsized":"2023-08-17T00:10:57.919598+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.897079+0000","last_change":"2023-08-17T00:10:57.475702+0000","last_active":"2023-08-17T00:10:57.897079+0000","last_peered":"2023-08-17T00:10:57.897079+0000","last_clean":"2023-08-17T00:10:57.897079+0000","last_became_active":"2023-08-17T00:10:57.475335+0000","last_became_peered":"2023-08-17T00:10:57.475335+0000","last_unstale":"2023-08-17T00:10:57.897079+0000","last_undegraded":"2023-08-17T00:10:57.897079+0000","last_fullsized":"2023-08-17T00:10:57.897079+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":99,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888873+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:10:57.888873+0000","last_peered":"2023-08-17T00:10:57.888873+0000","last_clean":"2023-08-17T00:10:57.888873+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:10:57.888873+0000","last_undegraded":"2023-08-17T00:10:57.888873+0000","last_fullsized":"2023-08-17T00:10:57.888873+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920305+0000","last_change":"2023-08-17T00:10:57.917004+0000","last_active":"2023-08-17T00:10:57.920305+0000","last_peered":"2023-08-17T00:10:57.920305+0000","last_clean":"2023-08-17T00:10:57.920305+0000","last_became_active":"2023-08-17T00:10:57.916666+0000","last_became_peered":"2023-08-17T00:10:57.916666+0000","last_unstale":"2023-08-17T00:10:57.920305+0000","last_undegraded":"2023-08-17T00:10:57.920305+0000","last_fullsized":"2023-08-17T00:10:57.920305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"111'1","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.913227+0000","last_change":"2023-08-17T00:10:57.466708+0000","last_active":"2023-08-17T00:10:57.913227+0000","last_peered":"2023-08-17T00:10:57.913227+0000","last_clean":"2023-08-17T00:10:57.913227+0000","last_became_active":"2023-08-17T00:10:57.466429+0000","last_became_peered":"2023-08-17T00:10:57.466429+0000","last_unstale":"2023-08-17T00:10:57.913227+0000","last_undegraded":"2023-08-17T00:10:57.913227+0000","last_fullsized":"2023-08-17T00:10:57.913227+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888174+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:10:57.888174+0000","last_peered":"2023-08-17T00:10:57.888174+0000","last_clean":"2023-08-17T00:10:57.888174+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:10:57.888174+0000","last_undegraded":"2023-08-17T00:10:57.888174+0000","last_fullsized":"2023-08-17T00:10:57.888174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.915434+0000","last_change":"2023-08-17T00:10:57.908048+0000","last_active":"2023-08-17T00:10:57.915434+0000","last_peered":"2023-08-17T00:10:57.915434+0000","last_clean":"2023-08-17T00:10:57.915434+0000","last_became_active":"2023-08-17T00:10:57.907771+0000","last_became_peered":"2023-08-17T00:10:57.907771+0000","last_unstale":"2023-08-17T00:10:57.915434+0000","last_undegraded":"2023-08-17T00:10:57.915434+0000","last_fullsized":"2023-08-17T00:10:57.915434+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894885+0000","last_change":"2023-08-17T00:10:57.466733+0000","last_active":"2023-08-17T00:10:57.894885+0000","last_peered":"2023-08-17T00:10:57.894885+0000","last_clean":"2023-08-17T00:10:57.894885+0000","last_became_active":"2023-08-17T00:10:57.466462+0000","last_became_peered":"2023-08-17T00:10:57.466462+0000","last_unstale":"2023-08-17T00:10:57.894885+0000","last_undegraded":"2023-08-17T00:10:57.894885+0000","last_fullsized":"2023-08-17T00:10:57.894885+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.894387+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:10:57.894387+0000","last_peered":"2023-08-17T00:10:57.894387+0000","last_clean":"2023-08-17T00:10:57.894387+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:10:57.894387+0000","last_undegraded":"2023-08-17T00:10:57.894387+0000","last_fullsized":"2023-08-17T00:10:57.894387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.918451+0000","last_change":"2023-08-17T00:10:57.913412+0000","last_active":"2023-08-17T00:10:57.918451+0000","last_peered":"2023-08-17T00:10:57.918451+0000","last_clean":"2023-08-17T00:10:57.918451+0000","last_became_active":"2023-08-17T00:10:57.913170+0000","last_became_peered":"2023-08-17T00:10:57.913170+0000","last_unstale":"2023-08-17T00:10:57.918451+0000","last_undegraded":"2023-08-17T00:10:57.918451+0000","last_fullsized":"2023-08-17T00:10:57.918451+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.892476+0000","last_change":"2023-08-17T00:10:57.462445+0000","last_active":"2023-08-17T00:10:57.892476+0000","last_peered":"2023-08-17T00:10:57.892476+0000","last_clean":"2023-08-17T00:10:57.892476+0000","last_became_active":"2023-08-17T00:10:57.462127+0000","last_became_peered":"2023-08-17T00:10:57.462127+0000","last_unstale":"2023-08-17T00:10:57.892476+0000","last_undegraded":"2023-08-17T00:10:57.892476+0000","last_fullsized":"2023-08-17T00:10:57.892476+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.886676+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:10:57.886676+0000","last_peered":"2023-08-17T00:10:57.886676+0000","last_clean":"2023-08-17T00:10:57.886676+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:10:57.886676+0000","last_undegraded":"2023-08-17T00:10:57.886676+0000","last_fullsized":"2023-08-17T00:10:57.886676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.920766+0000","last_change":"2023-08-17T00:10:57.912534+0000","last_active":"2023-08-17T00:10:57.920766+0000","last_peered":"2023-08-17T00:10:57.920766+0000","last_clean":"2023-08-17T00:10:57.920766+0000","last_became_active":"2023-08-17T00:10:57.911955+0000","last_became_peered":"2023-08-17T00:10:57.911955+0000","last_unstale":"2023-08-17T00:10:57.920766+0000","last_undegraded":"2023-08-17T00:10:57.920766+0000","last_fullsized":"2023-08-17T00:10:57.920766+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:57.428307+0000","last_clean_scrub_stamp":"2023-08-17T00:10:57.428307+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"111'2","reported_seq":11,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.921530+0000","last_change":"2023-08-17T00:10:57.475562+0000","last_active":"2023-08-17T00:10:57.921530+0000","last_peered":"2023-08-17T00:10:57.921530+0000","last_clean":"2023-08-17T00:10:57.921530+0000","last_became_active":"2023-08-17T00:10:57.475125+0000","last_became_peered":"2023-08-17T00:10:57.475125+0000","last_unstale":"2023-08-17T00:10:57.921530+0000","last_undegraded":"2023-08-17T00:10:57.921530+0000","last_fullsized":"2023-08-17T00:10:57.921530+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:10:56.415865+0000","last_clean_scrub_stamp":"2023-08-17T00:10:56.415865+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.888067+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:10:57.888067+0000","last_peered":"2023-08-17T00:10:57.888067+0000","last_clean":"2023-08-17T00:10:57.888067+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:10:57.888067+0000","last_undegraded":"2023-08-17T00:10:57.888067+0000","last_fullsized":"2023-08-17T00:10:57.888067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-08-17T00:10:57.891545+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:10:57.891545+0000","last_peered":"2023-08-17T00:10:57.891545+0000","last_clean":"2023-08-17T00:10:57.891545+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:10:57.891545+0000","last_undegraded":"2023-08-17T00:10:57.891545+0000","last_fullsized":"2023-08-17T00:10:57.891545+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542245,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306752,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94065088,"statfs":{"total":96636764160,"available":96322650112,"internally_reserved":0,"allocated":1368064,"data_stored":635848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.032,"15min":1.3089999999999999},"min":{"1min":0.61799999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.532,"5min":1.909,"15min":8.7769999999999992},"last":1.093},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.0600000000000001,"15min":1.357},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.704,"5min":1.704,"15min":9.6530000000000005},"last":1.3380000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.109,"15min":1.3799999999999999},"min":{"1min":0.71899999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.5029999999999999,"5min":1.629,"15min":9.8800000000000008},"last":0.89600000000000002},{"interface":"front","average":{"1min":1.129,"5min":1.0800000000000001,"15min":1.3620000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.782,"5min":1.782,"15min":8.8399999999999999},"last":1.131}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.046,"15min":1.2529999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.359,"5min":1.4450000000000001,"15min":7.0190000000000001},"last":1.3},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.1919999999999999,"15min":1.4159999999999999},"min":{"1min":0.86699999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.8009999999999999,"5min":1.8120000000000001,"15min":9.4239999999999995},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.101,"15min":1.2909999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3720000000000001,"5min":1.454,"15min":7.7080000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.298,"5min":1.258,"15min":1.625},"min":{"1min":1.02,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.7110000000000001,"5min":1.958,"15min":13.074999999999999},"last":1.002}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.1459999999999999,"15min":1.5860000000000001},"min":{"1min":0.66400000000000003,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":13.784000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1699999999999999,"15min":1.4870000000000001},"min":{"1min":0.60599999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.5860000000000001,"5min":1.764,"15min":10.045999999999999},"last":1.204}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2689999999999999,"15min":1.72},"min":{"1min":0.92200000000000004,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.907,"5min":2.012,"15min":14.435},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2669999999999999,"15min":1.673},"min":{"1min":0.754,"5min":0.746,"15min":0.746},"max":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":12.617000000000001},"last":1.494}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.321,"15min":1.6879999999999999},"min":{"1min":0.81299999999999994,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.833,"5min":1.833,"15min":11.279999999999999},"last":1.411},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2689999999999999,"15min":1.6040000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5369999999999999,"5min":1.8200000000000001,"15min":11.365},"last":1.3580000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542245,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310868,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060972,"statfs":{"total":96636764160,"available":96318435328,"internally_reserved":0,"allocated":1388544,"data_stored":638008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.1200000000000001,"15min":1.071},"min":{"1min":0.58799999999999997,"5min":0.52300000000000002,"15min":0.32800000000000001},"max":{"1min":1.337,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.22,"15min":1.1519999999999999},"min":{"1min":0.61699999999999999,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":1.4890000000000001,"5min":10.519,"15min":10.519},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.2829999999999999,"15min":1.1479999999999999},"min":{"1min":0.83499999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.391,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.107},{"interface":"front","average":{"1min":1.038,"5min":1.153,"15min":1.036},"min":{"1min":0.68000000000000005,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.5760000000000001,"5min":11.391999999999999,"15min":11.391999999999999},"last":1.498}]},{"osd":2,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1599999999999999,"15min":1.173},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.8540000000000001,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.421},{"interface":"front","average":{"1min":1.157,"5min":1.399,"15min":1.2929999999999999},"min":{"1min":0.746,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.702,"5min":10.669,"15min":10.669},"last":1.3160000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2390000000000001,"15min":1.1719999999999999},"min":{"1min":0.89000000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.7170000000000001,"5min":11.475,"15min":11.475},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.236,"5min":1.232,"15min":1.266},"min":{"1min":0.81599999999999995,"5min":0.70899999999999996,"15min":0.64500000000000002},"max":{"1min":2.0270000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.341}]},{"osd":4,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.3939999999999999,"15min":1.2889999999999999},"min":{"1min":0.78100000000000003,"5min":0.629,"15min":0.59199999999999997},"max":{"1min":1.6180000000000001,"5min":10.632,"15min":10.632},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.349,"15min":1.2490000000000001},"min":{"1min":0.72699999999999998,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8939999999999999,"5min":11.438000000000001,"15min":11.438000000000001},"last":1.2909999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.25,"15min":1.268},"min":{"1min":0.74299999999999999,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.954,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.494,"15min":1.3740000000000001},"min":{"1min":0.86299999999999999,"5min":0.628,"15min":0.628},"max":{"1min":1.7809999999999999,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.206}]},{"osd":7,"last update":"Thu Aug 17 00:10:58 2023","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.4259999999999999,"15min":1.3420000000000001},"min":{"1min":0.83299999999999996,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.8109999999999999,"5min":11.51,"15min":11.51},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.383,"5min":1.379,"15min":1.423},"min":{"1min":0.85099999999999998,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":2.1059999999999999,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.2569999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542246,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1380352,"data_stored":636042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.004,"15min":1.431},"min":{"1min":0.51400000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.325},{"interface":"front","average":{"1min":1.022,"5min":0.98699999999999999,"15min":1.5580000000000001},"min":{"1min":0.74199999999999999,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.355,"5min":1.742,"15min":16.838999999999999},"last":1.02}]},{"osd":1,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0249999999999999,"15min":1.1419999999999999},"min":{"1min":0.60999999999999999,"5min":0.53900000000000003,"15min":0.498},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":4.2270000000000003},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.216,"5min":1.105,"15min":1.393},"min":{"1min":0.79700000000000004,"5min":0.64500000000000002,"15min":0.58799999999999997},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":9.6579999999999995},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1220000000000001,"15min":1.6100000000000001},"min":{"1min":0.874,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.47,"5min":1.5129999999999999,"15min":16.675000000000001},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.1100000000000001,"15min":1.4730000000000001},"min":{"1min":0.80300000000000005,"5min":0.64600000000000002,"15min":0.60299999999999998},"max":{"1min":1.796,"5min":1.796,"15min":11.949},"last":1.629}]},{"osd":3,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1519999999999999,"15min":1.522},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.1349999999999998,"5min":2.1349999999999998,"15min":13.125},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.1719999999999999,"15min":1.4370000000000001},"min":{"1min":0.83299999999999996,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.704,"5min":1.704,"15min":8.4809999999999999},"last":1.349}]},{"osd":4,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.145,"15min":1.661},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.2789999999999999,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.581},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.204,"15min":1.7989999999999999},"min":{"1min":0.61299999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":19.591000000000001},"last":1.278}]},{"osd":6,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.23,"15min":1.7589999999999999},"min":{"1min":0.93500000000000005,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.9350000000000001,"5min":1.9350000000000001,"15min":17.158000000000001},"last":1.091},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.2569999999999999,"15min":1.7649999999999999},"min":{"1min":0.88500000000000001,"5min":0.65800000000000003,"15min":0.64400000000000002},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.2310000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:10:57 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.2969999999999999,"15min":1.8720000000000001},"min":{"1min":0.66400000000000003,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.881,"5min":1.9610000000000001,"15min":18.158000000000001},"last":1.504},{"interface":"front","average":{"1min":1.427,"5min":1.3560000000000001,"15min":1.798},"min":{"1min":0.98699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":14.818},"last":1.429}]}]},{"osd":3,"up_from":14,"seq":60129542245,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":1380352,"data_stored":637046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.79100000000000004,"15min":0.78400000000000003},"min":{"1min":0.47099999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3580000000000001},"last":1.163},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.84399999999999997,"15min":0.85099999999999998},"min":{"1min":0.42199999999999999,"5min":0.41199999999999998,"15min":0.38100000000000001},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.90900000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.83699999999999997,"15min":0.81999999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0640000000000001,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.84899999999999998,"15min":0.92000000000000004},"min":{"1min":0.40699999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.6299999999999999,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.0900000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.92100000000000004,"15min":0.92600000000000005},"min":{"1min":0.46200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.7929999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.042,"15min":1.0489999999999999},"min":{"1min":0.51500000000000001,"5min":0.433,"15min":0.433},"max":{"1min":1.6890000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.79200000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1879999999999999,"15min":1.2170000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.274,"5min":3.9449999999999998,"15min":3.9449999999999998},"last":1.206},{"interface":"front","average":{"1min":1.141,"5min":1.1739999999999999,"15min":1.2250000000000001},"min":{"1min":0.60399999999999998,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.649,"5min":3.9790000000000001,"15min":3.9790000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1719999999999999,"15min":1.2390000000000001},"min":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.744,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2170000000000001,"15min":1.282},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.669,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.179,"15min":1.2669999999999999},"min":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7589999999999999,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1699999999999999,"15min":1.2150000000000001},"min":{"1min":0.625,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.0979999999999999,"5min":3.585,"15min":3.585},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:09:54 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.194,"15min":1.26},"min":{"1min":0.68300000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.165,"15min":1.2509999999999999},"min":{"1min":0.72899999999999998,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.28}]}]},{"osd":2,"up_from":14,"seq":60129542245,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302676,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069164,"statfs":{"total":96636764160,"available":96326823936,"internally_reserved":0,"allocated":1388544,"data_stored":642664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.73599999999999999,"15min":0.85699999999999998},"min":{"1min":0.38600000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.532,"5min":1.532,"15min":3.1099999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.76700000000000002,"15min":0.98699999999999999},"min":{"1min":0.317,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.1379999999999999,"5min":1.827,"15min":6.4859999999999998},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.81699999999999995,"15min":0.92000000000000004},"min":{"1min":0.629,"5min":0.42099999999999999,"15min":0.35999999999999999},"max":{"1min":2.097,"5min":2.097,"15min":3.7589999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.92900000000000005,"15min":1.0760000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.3160000000000001,"5min":1.9159999999999999,"15min":3.911},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.92400000000000004,"15min":1.1799999999999999},"min":{"1min":0.52000000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2230000000000001,"5min":1.9530000000000001,"15min":5.4059999999999997},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.875,"15min":1.008},"min":{"1min":0.67500000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.0860000000000001,"5min":3.2530000000000001,"15min":3.3410000000000002},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.0800000000000001,"15min":1.74},"min":{"1min":0.92100000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.429,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.093},{"interface":"front","average":{"1min":1.117,"5min":1.1599999999999999,"15min":1.5509999999999999},"min":{"1min":0.68000000000000005,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.456,"5min":2.0649999999999999,"15min":8.4399999999999995},"last":0.90300000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.268,"15min":1.6919999999999999},"min":{"1min":0.63200000000000001,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5209999999999999,"5min":2.1440000000000001,"15min":12.914},"last":1.069},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.1859999999999999,"15min":1.502},"min":{"1min":0.80900000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.5620000000000001,"5min":1.6719999999999999,"15min":9.5519999999999996},"last":1.3280000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.1890000000000001,"15min":1.653},"min":{"1min":0.69599999999999995,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.478,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.2470000000000001,"15min":1.694},"min":{"1min":0.84499999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6879999999999999,"5min":2.2210000000000001,"15min":12.698},"last":1.113}]},{"osd":7,"last update":"Thu Aug 17 00:10:05 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2649999999999999,"15min":1.649},"min":{"1min":0.82899999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6639999999999999,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.2869999999999999,"15min":1.665},"min":{"1min":1.1080000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.546,"5min":4.3220000000000001,"15min":11.417},"last":1.05}]}]},{"osd":1,"up_from":14,"seq":60129542245,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1388544,"data_stored":643466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.79500000000000004,"15min":0.81299999999999994},"min":{"1min":0.49399999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.113,"5min":1.4810000000000001,"15min":6.4329999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.84499999999999997,"15min":0.90600000000000003},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.169,"5min":1.6379999999999999,"15min":13.093},"last":0.60099999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76500000000000001,"15min":0.81399999999999995},"min":{"1min":0.47999999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.288,"5min":1.452,"15min":5.4989999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82799999999999996,"15min":0.88900000000000001},"min":{"1min":0.54600000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.208,"5min":1.4219999999999999,"15min":7.0620000000000003},"last":0.89400000000000002}]},{"osd":3,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.94299999999999995,"15min":1.0189999999999999},"min":{"1min":0.55700000000000005,"5min":0.437,"15min":0.437},"max":{"1min":1.1779999999999999,"5min":1.5920000000000001,"15min":8.8279999999999994},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.84099999999999997,"15min":0.97099999999999997},"min":{"1min":0.505,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2749999999999999,"5min":1.327,"15min":12.981999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.04,"15min":1.163},"min":{"1min":0.67700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.629,"5min":1.629,"15min":20.548999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.1279999999999999,"15min":1.2170000000000001},"min":{"1min":0.72499999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.2909999999999999,"5min":2.2909999999999999,"15min":8.8670000000000009},"last":0.98999999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1830000000000001,"15min":1.331},"min":{"1min":0.71599999999999997,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.5670000000000002,"5min":2.5670000000000002,"15min":13.170999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.119,"5min":1.1879999999999999,"15min":1.2649999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5880000000000001,"5min":1.9990000000000001,"15min":5.4240000000000004},"last":0.875}]},{"osd":6,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.161,"15min":1.2609999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":2.6760000000000002,"5min":2.6760000000000002,"15min":13.050000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.163,"5min":1.1619999999999999,"15min":1.212},"min":{"1min":0.79200000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":2.472,"5min":2.472,"15min":5.5359999999999996},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Aug 17 00:10:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.2370000000000001,"15min":1.321},"min":{"1min":0.90600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.6289999999999996,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.093},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2150000000000001,"15min":1.3540000000000001},"min":{"1min":0.84499999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":2.6219999999999999,"5min":2.6219999999999999,"15min":13.131},"last":0.92500000000000004}]}]},{"osd":0,"up_from":14,"seq":60129542246,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302656,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069184,"statfs":{"total":96636764160,"available":96326844416,"internally_reserved":0,"allocated":1368064,"data_stored":635848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.77600000000000002},"min":{"1min":0.438,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1479999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.873},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79600000000000004,"15min":0.79800000000000004},"min":{"1min":0.501,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.244,"5min":1.4159999999999999,"15min":1.423},"last":1.0600000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.876,"15min":0.88400000000000001},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.242,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.88700000000000001,"15min":0.88900000000000001},"min":{"1min":0.63600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.2050000000000001,"5min":2.133,"15min":2.133},"last":0.92400000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.83999999999999997,"15min":0.85999999999999999},"min":{"1min":0.41699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4350000000000001,"5min":1.613,"15min":1.613},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.032,"5min":0.94799999999999995,"15min":1.016},"min":{"1min":0.56999999999999995,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.2669999999999999,"5min":1.72,"15min":1.72},"last":1.0289999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.081,"15min":1.1160000000000001},"min":{"1min":0.73099999999999998,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.431,"5min":1.7609999999999999,"15min":1.7609999999999999},"last":1.109},{"interface":"front","average":{"1min":1.27,"5min":1.1739999999999999,"15min":1.2010000000000001},"min":{"1min":0.96599999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5329999999999999,"5min":1.982,"15min":1.982},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.1890000000000001,"15min":1.266},"min":{"1min":0.80400000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7809999999999999,"5min":1.849,"15min":1.849},"last":1.329},{"interface":"front","average":{"1min":1.272,"5min":1.1899999999999999,"15min":1.2789999999999999},"min":{"1min":0.88,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.7629999999999999},"last":1.226}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.196,"15min":1.278},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.593,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.272},{"interface":"front","average":{"1min":1.244,"5min":1.179,"15min":1.2549999999999999},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.72},"last":1.173}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.1970000000000001,"15min":1.268},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.585,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.256},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.179,"15min":1.2529999999999999},"min":{"1min":0.90600000000000003,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.5600000000000001,"5min":1.804,"15min":2.0750000000000002},"last":1.296}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302644,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94069196,"statfs":{"total":96636764160,"available":96326856704,"internally_reserved":0,"allocated":1355776,"data_stored":628669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.145,"15min":1.1120000000000001},"min":{"1min":0.52200000000000002,"5min":0.47199999999999998,"15min":0.38300000000000001},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.133},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.1020000000000001,"15min":1.0860000000000001},"min":{"1min":0.81000000000000005,"5min":0.41999999999999998,"15min":0.40100000000000002},"max":{"1min":7.7380000000000004,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":1.278}]},{"osd":1,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.8620000000000001,"5min":1.381,"15min":1.256},"min":{"1min":0.65100000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":7.0469999999999997,"5min":8.3800000000000008,"15min":8.3800000000000008},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.292,"15min":1.2789999999999999},"min":{"1min":0.86399999999999999,"5min":0.51700000000000002,"15min":0.48099999999999998},"max":{"1min":6.9000000000000004,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.331}]},{"osd":2,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.45,"5min":1.458,"15min":1.2589999999999999},"min":{"1min":0.71399999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.6500000000000004,"5min":18.431000000000001,"15min":18.431000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.6950000000000001,"15min":1.365},"min":{"1min":0.88500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.738,"5min":36.531999999999996,"15min":36.531999999999996},"last":1.423}]},{"osd":3,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.115,"15min":1.1539999999999999},"min":{"1min":0.84499999999999997,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":2.512,"5min":2.722,"15min":2.722},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.7450000000000001,"15min":1.4339999999999999},"min":{"1min":0.75700000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":6.6920000000000002,"5min":36.530000000000001,"15min":36.530000000000001},"last":1.012}]},{"osd":5,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.3300000000000001,"15min":1.2689999999999999},"min":{"1min":0.81999999999999995,"5min":0.433,"15min":0.433},"max":{"1min":5.2720000000000002,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":1.4890000000000001},{"interface":"front","average":{"1min":1.464,"5min":1.379,"15min":1.323},"min":{"1min":0.88800000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":5.4569999999999999,"5min":9.4120000000000008,"15min":9.4120000000000008},"last":1.1879999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.4059999999999999,"15min":1.389},"min":{"1min":0.80800000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.9320000000000004,"5min":8.4190000000000005,"15min":8.4190000000000005},"last":1.085},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.377,"15min":1.4490000000000001},"min":{"1min":1.0009999999999999,"5min":0.82099999999999995,"15min":0.57799999999999996},"max":{"1min":2.5619999999999998,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.546}]},{"osd":7,"last update":"Thu Aug 17 00:09:57 2023","interfaces":[{"interface":"back","average":{"1min":1.109,"5min":1.228,"15min":1.3129999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.56100000000000005},"max":{"1min":1.411,"5min":2.8620000000000001,"15min":2.8620000000000001},"last":1.375},{"interface":"front","average":{"1min":1.5449999999999999,"5min":1.458,"15min":1.46},"min":{"1min":0.85499999999999998,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":6.7430000000000003,"5min":8.327,"15min":8.327},"last":1.4019999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:11:02.536 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:11:02.537 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:11:02.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.739+0000 7ff75f59e700 1 Processor -- start 2023-08-17T00:11:02.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.739+0000 7ff75f59e700 1 -- start start 2023-08-17T00:11:02.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff7600c5ea0 0x7ff7600634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff760154e90 con 0x7ff7600acf30 2023-08-17T00:11:02.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75f59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff760153fc0 con 0x7ff7600639a0 2023-08-17T00:11:02.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7600c1730 con 0x7ff7600c5ea0 2023-08-17T00:11:02.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75e59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff7600acf30 0x7ff7600c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46912/0 (socket says 172.21.15.153:46912) 2023-08-17T00:11:02.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75e59c700 1 -- 172.21.15.153:0/638526848 learned_addr learned my addr 172.21.15.153:0/638526848 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:02.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75dd9b700 1 --2- 172.21.15.153:0/638526848 >> v2:172.21.15.153:3300/0 conn(0x7ff7600c5ea0 0x7ff7600634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75d59a700 1 -- 172.21.15.153:0/638526848 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90363819 0 0) 0x7ff760154e90 con 0x7ff7600acf30 2023-08-17T00:11:02.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75dd9b700 1 -- 172.21.15.153:0/638526848 >> v1:172.21.15.178:6789/0 conn(0x7ff7600639a0 legacy=0x7ff7600bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75dd9b700 1 -- 172.21.15.153:0/638526848 >> v1:172.21.15.153:6789/0 conn(0x7ff7600acf30 legacy=0x7ff7600c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75dd9b700 1 -- 172.21.15.153:0/638526848 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760154280 con 0x7ff7600c5ea0 2023-08-17T00:11:02.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75dd9b700 1 --2- 172.21.15.153:0/638526848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600c5ea0 0x7ff7600634b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7ff754009760 tx=0x7ff754009060).ready entity=mon.0 client_cookie=cf12da6d813c910c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:02.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75d59a700 1 -- 172.21.15.153:0/638526848 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400b580 con 0x7ff7600c5ea0 2023-08-17T00:11:02.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75d59a700 1 -- 172.21.15.153:0/638526848 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff75400b6e0 con 0x7ff7600c5ea0 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.743+0000 7ff75d59a700 1 -- 172.21.15.153:0/638526848 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400ba60 con 0x7ff7600c5ea0 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 -- 172.21.15.153:0/638526848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600c5ea0 msgr2=0x7ff7600634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 --2- 172.21.15.153:0/638526848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600c5ea0 0x7ff7600634b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7ff754009760 tx=0x7ff754009060).stop 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 -- 172.21.15.153:0/638526848 shutdown_connections 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 --2- 172.21.15.153:0/638526848 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600c5ea0 0x7ff7600634b0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 -- 172.21.15.153:0/638526848 >> 172.21.15.153:0/638526848 conn(0x7ff7600cb330 msgr2=0x7ff7600c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:02.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 -- 172.21.15.153:0/638526848 shutdown_connections 2023-08-17T00:11:02.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 -- 172.21.15.153:0/638526848 wait complete. 2023-08-17T00:11:02.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 Processor -- start 2023-08-17T00:11:02.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.747+0000 7ff75f59e700 1 -- start start 2023-08-17T00:11:02.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 0x7ff7601504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7600acf30 0x7ff7600c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7601509c0 0x7ff7600c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600afe00 con 0x7ff7600639a0 2023-08-17T00:11:02.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600b0290 con 0x7ff7601509c0 2023-08-17T00:11:02.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7600af1f0 con 0x7ff7600acf30 2023-08-17T00:11:02.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 0x7ff7601504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 0x7ff7601504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39656/0 (socket says 172.21.15.153:39656) 2023-08-17T00:11:02.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 -- 172.21.15.153:0/2533143964 learned_addr learned my addr 172.21.15.153:0/2533143964 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:02.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75ed9d700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7601509c0 0x7ff7600c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75dd9b700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7600acf30 0x7ff7600c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 -- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7600acf30 msgr2=0x7ff7600c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7600acf30 0x7ff7600c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 -- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7601509c0 msgr2=0x7ff7600c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7601509c0 0x7ff7600c44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 -- 172.21.15.153:0/2533143964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7540092a0 con 0x7ff7600639a0 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75e59c700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 0x7ff7601504d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7ff75000c4c0 tx=0x7ff750007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500072e0 con 0x7ff7600639a0 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff750007440 con 0x7ff7600639a0 2023-08-17T00:11:02.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7600af4d0 con 0x7ff7600639a0 2023-08-17T00:11:02.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7500057a0 con 0x7ff7600639a0 2023-08-17T00:11:02.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.751+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600afa90 con 0x7ff7600639a0 2023-08-17T00:11:02.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.755+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76006b4c0 con 0x7ff7600639a0 2023-08-17T00:11:02.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.755+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff750010070 con 0x7ff7600639a0 2023-08-17T00:11:02.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.755+0000 7ff74e7fc700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff74005a180 0x7ff74005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:02.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.755+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff750073830 con 0x7ff7600639a0 2023-08-17T00:11:02.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.759+0000 7ff75dd9b700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff74005a180 0x7ff74005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:02.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.759+0000 7ff75dd9b700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff74005a180 0x7ff74005c640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7ff7600a9e80 tx=0x7ff754017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:02.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.763+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff750047260 con 0x7ff7600639a0 2023-08-17T00:11:02.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.979+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff760154560 con 0x7ff7600639a0 2023-08-17T00:11:02.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.991+0000 7ff74e7fc700 1 -- 172.21.15.153:0/2533143964 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff75004a880 con 0x7ff7600639a0 2023-08-17T00:11:02.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff74005a180 msgr2=0x7ff74005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff74005a180 0x7ff74005c640 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7ff7600a9e80 tx=0x7ff754017000).stop 2023-08-17T00:11:02.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 msgr2=0x7ff7601504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:02.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 0x7ff7601504d0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 rx=0x7ff75000c4c0 tx=0x7ff750007c10).stop 2023-08-17T00:11:02.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 shutdown_connections 2023-08-17T00:11:02.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff74005a180 0x7ff74005c640 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff7601509c0 0x7ff7600c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff7600acf30 0x7ff7600c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 --2- 172.21.15.153:0/2533143964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff7600639a0 0x7ff7601504d0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:02.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 >> 172.21.15.153:0/2533143964 conn(0x7ff7600cb330 msgr2=0x7ff7601569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:03.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 shutdown_connections 2023-08-17T00:11:03.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:02.995+0000 7ff75f59e700 1 -- 172.21.15.153:0/2533143964 wait complete. 2023-08-17T00:11:03.000 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:11:03.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:03.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.167+0000 7f6875947700 1 Processor -- start 2023-08-17T00:11:03.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.167+0000 7f6875947700 1 -- start start 2023-08-17T00:11:03.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875947700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6870068820 0x7f6870068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875947700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f68700a96d0 0x7f68700a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875947700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68701585a0 con 0x7f68700a8df0 2023-08-17T00:11:03.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875947700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700c1ba0 con 0x7f6870068820 2023-08-17T00:11:03.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875947700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6870066400 con 0x7f68700a96d0 2023-08-17T00:11:03.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6870068820 0x7f6870068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6870068820 0x7f6870068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39660/0 (socket says 172.21.15.153:39660) 2023-08-17T00:11:03.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 -- 172.21.15.153:0/573326383 learned_addr learned my addr 172.21.15.153:0/573326383 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:03.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875146700 1 --2- 172.21.15.153:0/573326383 >> v2:172.21.15.178:3300/0 conn(0x7f68700a96d0 0x7f68700a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 -- 172.21.15.153:0/573326383 >> v2:172.21.15.178:3300/0 conn(0x7f68700a96d0 msgr2=0x7f68700a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:03.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 --2- 172.21.15.153:0/573326383 >> v2:172.21.15.178:3300/0 conn(0x7f68700a96d0 0x7f68700a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 -- 172.21.15.153:0/573326383 >> v1:172.21.15.178:6789/0 conn(0x7f68700a8df0 legacy=0x7f68700c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:03.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 -- 172.21.15.153:0/573326383 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870069170 con 0x7f6870068820 2023-08-17T00:11:03.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f6875146700 1 --2- 172.21.15.153:0/573326383 >> v2:172.21.15.178:3300/0 conn(0x7f68700a96d0 0x7f68700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:03.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686ffff700 1 --2- 172.21.15.153:0/573326383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6870068820 0x7f6870068c80 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f6870066a40 tx=0x7f68600090f0).ready entity=mon.0 client_cookie=694edb80cb1fe8e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:03.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686f7fe700 1 -- 172.21.15.153:0/573326383 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000b600 con 0x7f6870068820 2023-08-17T00:11:03.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686f7fe700 1 -- 172.21.15.153:0/573326383 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686000b760 con 0x7f6870068820 2023-08-17T00:11:03.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.171+0000 7f686f7fe700 1 -- 172.21.15.153:0/573326383 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686000bae0 con 0x7f6870068820 2023-08-17T00:11:03.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 -- 172.21.15.153:0/573326383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6870068820 msgr2=0x7f6870068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 --2- 172.21.15.153:0/573326383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6870068820 0x7f6870068c80 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f6870066a40 tx=0x7f68600090f0).stop 2023-08-17T00:11:03.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 -- 172.21.15.153:0/573326383 shutdown_connections 2023-08-17T00:11:03.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 --2- 172.21.15.153:0/573326383 >> v2:172.21.15.178:3300/0 conn(0x7f68700a96d0 0x7f68700a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 --2- 172.21.15.153:0/573326383 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6870068820 0x7f6870068c80 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 -- 172.21.15.153:0/573326383 >> 172.21.15.153:0/573326383 conn(0x7f68700c6620 msgr2=0x7f68700c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:03.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 -- 172.21.15.153:0/573326383 shutdown_connections 2023-08-17T00:11:03.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 -- 172.21.15.153:0/573326383 wait complete. 2023-08-17T00:11:03.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 Processor -- start 2023-08-17T00:11:03.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.175+0000 7f6875947700 1 -- start start 2023-08-17T00:11:03.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6870068820 0x7f68700c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68700a8df0 0x7f6870155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 0x7f68700bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687015ca20 con 0x7f68700a96d0 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687015cd00 con 0x7f6870068820 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687015cfe0 con 0x7f68700a8df0 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 0x7f68700bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 0x7f68700bf560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39666/0 (socket says 172.21.15.153:39666) 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 -- 172.21.15.153:0/3278689629 learned_addr learned my addr 172.21.15.153:0/3278689629 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f686ffff700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68700a8df0 0x7f6870155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6874945700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6870068820 0x7f68700c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 -- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68700a8df0 msgr2=0x7f6870155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68700a8df0 0x7f6870155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 -- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6870068820 msgr2=0x7f68700c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6870068820 0x7f68700c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 -- 172.21.15.153:0/3278689629 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860009370 con 0x7f68700a96d0 2023-08-17T00:11:03.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875146700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 0x7f68700bf560 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f686800a380 tx=0x7f6868007900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:03.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868016470 con 0x7f68700a96d0 2023-08-17T00:11:03.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680165d0 con 0x7f68700a96d0 2023-08-17T00:11:03.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868016950 con 0x7f68700a96d0 2023-08-17T00:11:03.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687015d2c0 con 0x7f68700a96d0 2023-08-17T00:11:03.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.179+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68701561d0 con 0x7f68700a96d0 2023-08-17T00:11:03.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.183+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687015d500 con 0x7f68700a96d0 2023-08-17T00:11:03.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.183+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f686800d440 con 0x7f68700a96d0 2023-08-17T00:11:03.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.183+0000 7f686cff9700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f685c05a150 0x7f685c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.183+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6868075250 con 0x7f68700a96d0 2023-08-17T00:11:03.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.187+0000 7f6874945700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f685c05a150 0x7f685c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.187+0000 7f6874945700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f685c05a150 0x7f685c05c610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f6864007fd0 tx=0x7f6864009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:03.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.191+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f687015d500 con 0x7f68700a96d0 2023-08-17T00:11:03.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.387+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f687015d500 con 0x7f68700a96d0 2023-08-17T00:11:03.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.387+0000 7f686cff9700 1 -- 172.21.15.153:0/3278689629 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f687015d500 con 0x7f68700a96d0 2023-08-17T00:11:03.390 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:03.390 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:03.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f685c05a150 msgr2=0x7f685c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f685c05a150 0x7f685c05c610 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f6864007fd0 tx=0x7f6864009040).stop 2023-08-17T00:11:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 msgr2=0x7f68700bf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 0x7f68700bf560 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f686800a380 tx=0x7f6868007900).stop 2023-08-17T00:11:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 shutdown_connections 2023-08-17T00:11:03.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f685c05a150 0x7f685c05c610 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68700a96d0 0x7f68700bf560 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68700a8df0 0x7f6870155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 --2- 172.21.15.153:0/3278689629 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6870068820 0x7f68700c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 >> 172.21.15.153:0/3278689629 conn(0x7f68700c6620 msgr2=0x7f6870157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:03.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 shutdown_connections 2023-08-17T00:11:03.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.391+0000 7f6875947700 1 -- 172.21.15.153:0/3278689629 wait complete. 2023-08-17T00:11:03.396 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:03.411 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-08-17T00:11:03.403+0000 7fb99f3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:11:03.817 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:10:57.877069+0000', 'modified': '2023-08-17T00:11:00.907373+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7470': {'gid': 7470, 'name': 'b', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6836/23042802', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 23042802}, {'type': 'v1', 'addr': '172.21.15.178:6836', 'nonce': 23042802}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:11:03.818 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:11:03.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-17T00:11:03.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 Processor -- start 2023-08-17T00:11:03.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 -- start start 2023-08-17T00:11:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300abf10 0x7f1430068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14300c1190 0x7f1430068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14301545e0 con 0x7f14300ac2f0 2023-08-17T00:11:03.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1430069200 con 0x7f14300c1190 2023-08-17T00:11:03.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300c1c50 con 0x7f14300abf10 2023-08-17T00:11:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142dd9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f14300ac2f0 0x7f14300c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46928/0 (socket says 172.21.15.153:46928) 2023-08-17T00:11:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142ed9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f14300c1190 0x7f1430068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142dd9b700 1 -- 172.21.15.153:0/4060256124 learned_addr learned my addr 172.21.15.153:0/4060256124 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142e59c700 1 --2- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300abf10 0x7f1430068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142ed9d700 1 -- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300abf10 msgr2=0x7f1430068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142ed9d700 1 --2- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300abf10 0x7f1430068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142ed9d700 1 -- 172.21.15.153:0/4060256124 >> v1:172.21.15.153:6789/0 conn(0x7f14300ac2f0 legacy=0x7f14300c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142d59a700 1 -- 172.21.15.153:0/4060256124 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699829027 0 0) 0x7f14301545e0 con 0x7f14300ac2f0 2023-08-17T00:11:03.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.979+0000 7f142ed9d700 1 -- 172.21.15.153:0/4060256124 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300a96d0 con 0x7f14300c1190 2023-08-17T00:11:03.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142ed9d700 1 --2- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300c1190 0x7f1430068d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f1428009e60 tx=0x7f1428009780).ready entity=mon.1 client_cookie=e664c647aa9ba5a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:03.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142d59a700 1 -- 172.21.15.153:0/4060256124 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800e070 con 0x7f14300c1190 2023-08-17T00:11:03.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142d59a700 1 -- 172.21.15.153:0/4060256124 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800bb60 con 0x7f14300c1190 2023-08-17T00:11:03.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142d59a700 1 -- 172.21.15.153:0/4060256124 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428012410 con 0x7f14300c1190 2023-08-17T00:11:03.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 -- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300c1190 msgr2=0x7f1430068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 --2- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300c1190 0x7f1430068d10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f1428009e60 tx=0x7f1428009780).stop 2023-08-17T00:11:03.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 -- 172.21.15.153:0/4060256124 shutdown_connections 2023-08-17T00:11:03.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 --2- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300c1190 0x7f1430068d10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 --2- 172.21.15.153:0/4060256124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300abf10 0x7f1430068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 -- 172.21.15.153:0/4060256124 >> 172.21.15.153:0/4060256124 conn(0x7f14300c6620 msgr2=0x7f14300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:03.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 -- 172.21.15.153:0/4060256124 shutdown_connections 2023-08-17T00:11:03.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 -- 172.21.15.153:0/4060256124 wait complete. 2023-08-17T00:11:03.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 Processor -- start 2023-08-17T00:11:03.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.983+0000 7f142f59e700 1 -- start start 2023-08-17T00:11:03.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 0x7f1430149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300ac2f0 0x7f14300bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300c1190 0x7f1430065010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300bf900 con 0x7f14300abf10 2023-08-17T00:11:03.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430149630 con 0x7f14300ac2f0 2023-08-17T00:11:03.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300becf0 con 0x7f14300c1190 2023-08-17T00:11:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 0x7f1430149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 0x7f1430149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39672/0 (socket says 172.21.15.153:39672) 2023-08-17T00:11:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 -- 172.21.15.153:0/2096191306 learned_addr learned my addr 172.21.15.153:0/2096191306 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300ac2f0 0x7f14300bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142ed9d700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300c1190 0x7f1430065010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 -- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300c1190 msgr2=0x7f1430065010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300c1190 0x7f1430065010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 -- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300ac2f0 msgr2=0x7f14300bfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300ac2f0 0x7f14300bfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 -- 172.21.15.153:0/2096191306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009a20 con 0x7f14300abf10 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142e59c700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 0x7f1430149140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f142000e930 tx=0x7f1420006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f141e7fc700 1 -- 172.21.15.153:0/2096191306 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000ee70 con 0x7f14300abf10 2023-08-17T00:11:03.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f141e7fc700 1 -- 172.21.15.153:0/2096191306 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1420009410 con 0x7f14300abf10 2023-08-17T00:11:03.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14300befd0 con 0x7f14300abf10 2023-08-17T00:11:03.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f141e7fc700 1 -- 172.21.15.153:0/2096191306 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000ca60 con 0x7f14300abf10 2023-08-17T00:11:03.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.987+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300bf590 con 0x7f14300abf10 2023-08-17T00:11:03.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.991+0000 7f141e7fc700 1 -- 172.21.15.153:0/2096191306 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1420022070 con 0x7f14300abf10 2023-08-17T00:11:03.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.991+0000 7f141e7fc700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f141005a180 0x7f141005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:03.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.991+0000 7f141e7fc700 1 -- 172.21.15.153:0/2096191306 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1420074480 con 0x7f14300abf10 2023-08-17T00:11:03.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.991+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f141005a180 0x7f141005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:03.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f141005a180 0x7f141005c640 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f14300c6010 tx=0x7f1424009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:03.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 Processor -- start 2023-08-17T00:11:03.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 -- start start 2023-08-17T00:11:04.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d75620 0x1d58450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d73a80 0x1d75a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1d31ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c9d5c0 con 0x1d2f730 2023-08-17T00:11:04.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cb2e90 con 0x1d73a80 2023-08-17T00:11:04.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c79220 con 0x1d75620 2023-08-17T00:11:04.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.995+0000 7f142ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1d31ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1d31ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39674/0 (socket says 172.21.15.153:39674) 2023-08-17T00:11:04.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 -- 172.21.15.153:0/2759692927 learned_addr learned my addr 172.21.15.153:0/2759692927 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:04.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d73a80 0x1d75a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142e59c700 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d75620 0x1d58450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 -- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d75620 msgr2=0x1d58450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d75620 0x1d58450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 -- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d73a80 msgr2=0x1d75a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d73a80 0x1d75a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 -- 172.21.15.153:0/2759692927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1cbe500 con 0x1d2f730 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f142ed9d700 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1d31ef0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f1428009f30 tx=0x7f1430064af0).ready entity=mon.0 client_cookie=d3d8e00737580276 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f140f7fe700 1 -- 172.21.15.153:0/2759692927 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800bcd0 con 0x1d2f730 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f140f7fe700 1 -- 172.21.15.153:0/2759692927 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800be30 con 0x1d2f730 2023-08-17T00:11:04.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f140f7fe700 1 -- 172.21.15.153:0/2759692927 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1428012990 con 0x1d2f730 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 -- 172.21.15.153:0/2759692927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 msgr2=0x1d31ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1d31ef0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 rx=0x7f1428009f30 tx=0x7f1430064af0).stop 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 -- 172.21.15.153:0/2759692927 shutdown_connections 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1d31ef0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d73a80 0x1d75a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 --2- 172.21.15.153:0/2759692927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d75620 0x1d58450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 -- 172.21.15.153:0/2759692927 >> 172.21.15.153:0/2759692927 conn(0x1b11550 msgr2=0x1d32f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 -- 172.21.15.153:0/2759692927 shutdown_connections 2023-08-17T00:11:04.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 -- 172.21.15.153:0/2759692927 wait complete. 2023-08-17T00:11:04.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 -- start start 2023-08-17T00:11:04.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:03.999+0000 7f143f020740 1 Processor -- start 2023-08-17T00:11:04.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d85c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d79570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d55fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c7e110 con 0x1d73a80 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d85460 con 0x1d75620 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d85740 con 0x1d2f730 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 10 client.0 ll_register_callbacks cb 0x1cea3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d79570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142e59c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d85c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d79570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39690/0 (socket says 172.21.15.153:39690) 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 -- 172.21.15.153:0/4147026038 learned_addr learned my addr 172.21.15.153:0/4147026038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142ed9d700 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d55fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 -- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 msgr2=0x1d85c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d85c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 -- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 msgr2=0x1d55fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d55fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 -- 172.21.15.153:0/4147026038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300a96d0 con 0x1d73a80 2023-08-17T00:11:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f142dd9b700 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d79570 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f14300c54a0 tx=0x7f142401a040).ready entity=mon.0 client_cookie=51c3a687c0c715c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f140cff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f140cff9700 1 -- 172.21.15.153:0/4147026038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142401d040 con 0x1d73a80 2023-08-17T00:11:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1ca8c60 con 0x1d73a80 2023-08-17T00:11:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f140cff9700 1 -- 172.21.15.153:0/4147026038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1424013420 con 0x1d73a80 2023-08-17T00:11:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f140cff9700 1 -- 172.21.15.153:0/4147026038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14240137f0 con 0x1d73a80 2023-08-17T00:11:04.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 10 client.7602 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x1cabf80 con 0x1d73a80 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f140cff9700 1 -- 172.21.15.153:0/4147026038 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1ca8c60 con 0x1d73a80 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f140cff9700 1 -- 172.21.15.153:0/4147026038 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1424013950 con 0x1d73a80 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 10 client.7602 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.003+0000 7f143f020740 10 client.7602 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 20 client.7602 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5cd90 0x1d300c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 4 client.7602 mds_command: new command op to 7470 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:11:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1c9f1b0 con 0x1d5cd90 2023-08-17T00:11:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f142e59c700 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5cd90 0x1d300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f142e59c700 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5cd90 0x1d300c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2beeefd177ca376c server_cookie=f34b7dfe754f72c3 in_seq=0 out_seq=0 2023-08-17T00:11:04.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f140cff9700 10 client.7602 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f140cff9700 1 -- 172.21.15.153:0/4147026038 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1c9f1b0 con 0x1d5cd90 2023-08-17T00:11:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f140cff9700 10 client.7602 handle_command_reply: tid=0 2023-08-17T00:11:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 client.7602 shutdown 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 msgr2=0x1d79570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d79570 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f14300c54a0 tx=0x7f142401a040).stop 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 shutdown_connections 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5cd90 0x1d300c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d55fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d79570 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f140cff9700 0 client.7602 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:04.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 --2- 172.21.15.153:0/4147026038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d85c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.007+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 >> 172.21.15.153:0/4147026038 conn(0x1b11550 msgr2=0x1d581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.011+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 shutdown_connections 2023-08-17T00:11:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.011+0000 7f143f020740 1 -- 172.21.15.153:0/4147026038 wait complete. 2023-08-17T00:11:04.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.011+0000 7f143f020740 20 client.7602 trim_cache size 0 max 16384 2023-08-17T00:11:04.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.027+0000 7f143f020740 1 Processor -- start 2023-08-17T00:11:04.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.027+0000 7f143f020740 1 -- start start 2023-08-17T00:11:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d79430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d307a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d84450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d2dd60 con 0x1d73a80 2023-08-17T00:11:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cf5db0 con 0x1d75620 2023-08-17T00:11:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d57d60 con 0x1d2f730 2023-08-17T00:11:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d307a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d307a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39700/0 (socket says 172.21.15.153:39700) 2023-08-17T00:11:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 -- 172.21.15.153:0/748154640 learned_addr learned my addr 172.21.15.153:0/748154640 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142e59c700 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d79430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142ed9d700 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d84450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 -- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 msgr2=0x1d79430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d79430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 -- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 msgr2=0x1d84450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d84450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 -- 172.21.15.153:0/748154640 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430065860 con 0x1d73a80 2023-08-17T00:11:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f142dd9b700 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d307a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f1424007d00 tx=0x7f1424013000).ready entity=mon.0 client_cookie=4dcecd2850c45d9e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f140ffff700 1 -- 172.21.15.153:0/748154640 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142401d040 con 0x1d73a80 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f140ffff700 1 -- 172.21.15.153:0/748154640 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424013420 con 0x1d73a80 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f140ffff700 1 -- 172.21.15.153:0/748154640 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424013a20 con 0x1d73a80 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- 172.21.15.153:0/748154640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 msgr2=0x1d307a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d307a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 rx=0x7f1424007d00 tx=0x7f1424013000).stop 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- 172.21.15.153:0/748154640 shutdown_connections 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d84450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d73a80 0x1d307a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 --2- 172.21.15.153:0/748154640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d2f730 0x1d79430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- 172.21.15.153:0/748154640 >> 172.21.15.153:0/748154640 conn(0x1b11550 msgr2=0x1d581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- 172.21.15.153:0/748154640 shutdown_connections 2023-08-17T00:11:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.031+0000 7f143f020740 1 -- 172.21.15.153:0/748154640 wait complete. 2023-08-17T00:11:04.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 -- start start 2023-08-17T00:11:04.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 Processor -- start 2023-08-17T00:11:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1dde510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d73a80 0x1d56830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d56d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d56440 con 0x1d2f730 2023-08-17T00:11:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1d8e0d0 con 0x1d75620 2023-08-17T00:11:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d8b570 con 0x1d73a80 2023-08-17T00:11:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.035+0000 7f143f020740 10 client.0 ll_register_callbacks cb 0x7f1424005950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:04.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1dde510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1dde510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39714/0 (socket says 172.21.15.153:39714) 2023-08-17T00:11:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 -- 172.21.15.153:0/2117504574 learned_addr learned my addr 172.21.15.153:0/2117504574 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d73a80 0x1d56830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 -- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d73a80 msgr2=0x1d56830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d73a80 0x1d56830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 -- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 msgr2=0x1d56d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142ed9d700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d56d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d56d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 -- 172.21.15.153:0/2117504574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1cabf80 con 0x1d2f730 2023-08-17T00:11:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142ed9d700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d56d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142e59c700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1dde510 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f142004b790 tx=0x7f1420053040).ready entity=mon.0 client_cookie=39723c338fd47f9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:04.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 1 -- 172.21.15.153:0/2117504574 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200725f0 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 1 -- 172.21.15.153:0/2117504574 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1420056070 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f142800be30 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 1 -- 172.21.15.153:0/2117504574 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1420072750 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 10 client.7608 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x1ca7420 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 1 -- 172.21.15.153:0/2117504574 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800be30 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 1 -- 172.21.15.153:0/2117504574 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f14200740b0 con 0x1d2f730 2023-08-17T00:11:04.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 10 client.7608 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 10 client.7608 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 20 client.7608 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5aca0 0x1d5b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 4 client.7608 mds_command: new command op to 7470 tid=0[{"prefix": "status"}] 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1b684e0 con 0x1d5aca0 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5aca0 0x1d5b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f140cff9700 10 client.7608 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.039+0000 7f142dd9b700 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5aca0 0x1d5b080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7a50b79e294cf507 server_cookie=805a3e5c480169cb in_seq=0 out_seq=0 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f140cff9700 1 -- 172.21.15.153:0/2117504574 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x1b684e0 con 0x1d5aca0 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f140cff9700 10 client.7608 handle_command_reply: tid=0 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 client.7608 shutdown 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 msgr2=0x1dde510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1dde510 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f142004b790 tx=0x7f1420053040).stop 2023-08-17T00:11:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 shutdown_connections 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1d5aca0 0x1d5b080 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1d75620 0x1d56d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1d73a80 0x1d56830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 --2- 172.21.15.153:0/2117504574 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1d2f730 0x1dde510 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f140cff9700 0 client.7608 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 >> 172.21.15.153:0/2117504574 conn(0x1b11550 msgr2=0x1d5ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 shutdown_connections 2023-08-17T00:11:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 1 -- 172.21.15.153:0/2117504574 wait complete. 2023-08-17T00:11:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f143f020740 20 client.7608 trim_cache size 0 max 16384 2023-08-17T00:11:04.055 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:11:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:11:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:11:04.055 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 7470, 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.1599233199999999, 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 93, 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 112, 2023-08-17T00:11:04.056 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 112, 2023-08-17T00:11:04.057 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.543694882 2023-08-17T00:11:04.057 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:11:04.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f141005a180 msgr2=0x7f141005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f141005a180 0x7f141005c640 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f14300c6010 tx=0x7f1424009040).stop 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 msgr2=0x7f1430149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 0x7f1430149140 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f142000e930 tx=0x7f1420006f40).stop 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 shutdown_connections 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f141005a180 0x7f141005c640 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14300c1190 0x7f1430065010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14300ac2f0 0x7f14300bfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 --2- 172.21.15.153:0/2096191306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14300abf10 0x7f1430149140 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 >> 172.21.15.153:0/2096191306 conn(0x7f14300c6620 msgr2=0x7f1430061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 shutdown_connections 2023-08-17T00:11:04.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.043+0000 7f142f59e700 1 -- 172.21.15.153:0/2096191306 wait complete. 2023-08-17T00:11:04.067 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:11:04.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.195+0000 7f286d707700 1 Processor -- start 2023-08-17T00:11:04.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286d707700 1 -- start start 2023-08-17T00:11:04.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286d707700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2868153ac0 0x7f28680bb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286d707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286d707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28680a38e0 con 0x7f28680bbaf0 2023-08-17T00:11:04.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286d707700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680c4fb0 con 0x7f2868153ac0 2023-08-17T00:11:04.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286d707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28680c5290 con 0x7f2868062610 2023-08-17T00:11:04.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2868153ac0 0x7f28680bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2868153ac0 0x7f28680bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39726/0 (socket says 172.21.15.153:39726) 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 -- 172.21.15.153:0/1165817010 learned_addr learned my addr 172.21.15.153:0/1165817010 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f286cf06700 1 --2- 172.21.15.153:0/1165817010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 -- 172.21.15.153:0/1165817010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 msgr2=0x7f28680a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 --2- 172.21.15.153:0/1165817010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 -- 172.21.15.153:0/1165817010 >> v1:172.21.15.178:6789/0 conn(0x7f28680bbaf0 legacy=0x7f2868061f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 -- 172.21.15.153:0/1165817010 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28680c5570 con 0x7f2868153ac0 2023-08-17T00:11:04.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f2867fff700 1 --2- 172.21.15.153:0/1165817010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680bb600 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f2858006fd0 tx=0x7f28580090f0).ready entity=mon.0 client_cookie=f33487692e7daaf4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f28677fe700 1 -- 172.21.15.153:0/1165817010 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800b580 con 0x7f2868153ac0 2023-08-17T00:11:04.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f28677fe700 1 -- 172.21.15.153:0/1165817010 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800b6e0 con 0x7f2868153ac0 2023-08-17T00:11:04.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.199+0000 7f28677fe700 1 -- 172.21.15.153:0/1165817010 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800ba60 con 0x7f2868153ac0 2023-08-17T00:11:04.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 -- 172.21.15.153:0/1165817010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 msgr2=0x7f28680bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 --2- 172.21.15.153:0/1165817010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680bb600 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f2858006fd0 tx=0x7f28580090f0).stop 2023-08-17T00:11:04.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 -- 172.21.15.153:0/1165817010 shutdown_connections 2023-08-17T00:11:04.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 --2- 172.21.15.153:0/1165817010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 --2- 172.21.15.153:0/1165817010 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680bb600 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 -- 172.21.15.153:0/1165817010 >> 172.21.15.153:0/1165817010 conn(0x7f286805dca0 msgr2=0x7f286805e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 -- 172.21.15.153:0/1165817010 shutdown_connections 2023-08-17T00:11:04.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 -- 172.21.15.153:0/1165817010 wait complete. 2023-08-17T00:11:04.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 Processor -- start 2023-08-17T00:11:04.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.203+0000 7f286d707700 1 -- start start 2023-08-17T00:11:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28680bbaf0 0x7f28680a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868154b10 con 0x7f2868153ac0 2023-08-17T00:11:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868153f40 con 0x7f28680bbaf0 2023-08-17T00:11:04.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28681541e0 con 0x7f2868062610 2023-08-17T00:11:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680a7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39730/0 (socket says 172.21.15.153:39730) 2023-08-17T00:11:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 -- 172.21.15.153:0/1179423434 learned_addr learned my addr 172.21.15.153:0/1179423434 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f2867fff700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f285f7fe700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28680bbaf0 0x7f28680a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 -- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 msgr2=0x7f28680a7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 -- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28680bbaf0 msgr2=0x7f28680a6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28680bbaf0 0x7f28680a6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 -- 172.21.15.153:0/1179423434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858009370 con 0x7f2868153ac0 2023-08-17T00:11:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f285f7fe700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28680bbaf0 0x7f28680a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:04.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286cf06700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680a7100 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f2860009ec0 tx=0x7f286000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286000cc20 con 0x7f2868153ac0 2023-08-17T00:11:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286000f040 con 0x7f2868153ac0 2023-08-17T00:11:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28681544c0 con 0x7f2868153ac0 2023-08-17T00:11:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860013400 con 0x7f2868153ac0 2023-08-17T00:11:04.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.207+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28680a8200 con 0x7f2868153ac0 2023-08-17T00:11:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.211+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28681546b0 con 0x7f2868153ac0 2023-08-17T00:11:04.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.211+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2860013770 con 0x7f2868153ac0 2023-08-17T00:11:04.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.211+0000 7f2864ff9700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284805a150 0x7f284805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:04.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.211+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2860074a90 con 0x7f2868153ac0 2023-08-17T00:11:04.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.211+0000 7f2867fff700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284805a150 0x7f284805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:04.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.215+0000 7f2867fff700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284805a150 0x7f284805c610 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f2858009130 tx=0x7f2858017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:04.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.219+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2860048540 con 0x7f2868153ac0 2023-08-17T00:11:04.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.419+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28681548b0 con 0x7f2868153ac0 2023-08-17T00:11:04.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.419+0000 7f2864ff9700 1 -- 172.21.15.153:0/1179423434 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7f286004bb60 con 0x7f2868153ac0 2023-08-17T00:11:04.422 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:11:04.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284805a150 msgr2=0x7f284805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284805a150 0x7f284805c610 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f2858009130 tx=0x7f2858017000).stop 2023-08-17T00:11:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 msgr2=0x7f28680a7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680a7100 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f2860009ec0 tx=0x7f286000b040).stop 2023-08-17T00:11:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 shutdown_connections 2023-08-17T00:11:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284805a150 0x7f284805c610 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ac0 0x7f28680a7100 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28680bbaf0 0x7f28680a6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 --2- 172.21.15.153:0/1179423434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2868062610 0x7f28680a7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 >> 172.21.15.153:0/1179423434 conn(0x7f286805dca0 msgr2=0x7f2868061f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:04.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 shutdown_connections 2023-08-17T00:11:04.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:04.423+0000 7f286d707700 1 -- 172.21.15.153:0/1179423434 wait complete. 2023-08-17T00:11:04.443 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:11:04.443 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:11:04.444 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:11:04.444 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:11:04.444 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:11:04.445 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:11:04.445 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:11:04.445 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:11:04.445 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:11:04.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.446 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:11:04.469 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:11:04.469 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:11:04.469 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:11:04.469 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.469 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:11:04.470 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.470 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:11:04.470 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:11:04.470 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:11:04.470 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:11:04.471 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41949sec preferred_lft 41949sec 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.472 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:11:04.473 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:11:04.474 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:11:04.474 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.474 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:11:04.474 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:11:04.474 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:11:04.474 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:11:04.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.475 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:11:04.550 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:11:04.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.557 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:11:04.620 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:11:04.620 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:11:04.620 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:11:04.621 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:11:04.621 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:11:04.621 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:11:04.622 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:11:04.622 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:11:04.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.624 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:11:04.624 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:04.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:11:04.625 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:11:04.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:11:04.626 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:04.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.759 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:11:04.772 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:11:04.772 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:11:04.774 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:11:04.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:11:04.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:04.851 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:11:04.911 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:11:04.912 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:11:05.033 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:11:05.034 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:11:05.057 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:11:05.057 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:11:05.062 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:11:05.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:05.062 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:11:05.093 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2023-08-17T00:11:05.093 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2023-08-17T00:11:05.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:05.094 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:05.094 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:05.094 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.0 2023-08-17T00:11:05.095 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:05.095 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:05.095 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:05.095 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:05.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.213 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256476 s, 40.9 MB/s 2023-08-17T00:11:05.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.245 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269948 s, 38.8 MB/s 2023-08-17T00:11:05.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255949 s, 41.0 MB/s 2023-08-17T00:11:05.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.301 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231974 s, 45.2 MB/s 2023-08-17T00:11:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.329 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242074 s, 43.3 MB/s 2023-08-17T00:11:05.358 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.359 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264802 s, 39.6 MB/s 2023-08-17T00:11:05.399 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.399 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.399 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03672 s, 28.6 MB/s 2023-08-17T00:11:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293892 s, 35.7 MB/s 2023-08-17T00:11:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.463 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259993 s, 40.3 MB/s 2023-08-17T00:11:05.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231017 s, 45.4 MB/s 2023-08-17T00:11:05.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.517 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226092 s, 46.4 MB/s 2023-08-17T00:11:05.548 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.549 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.549 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282798 s, 37.1 MB/s 2023-08-17T00:11:05.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.580 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264214 s, 39.7 MB/s 2023-08-17T00:11:05.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.615 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03198 s, 32.8 MB/s 2023-08-17T00:11:05.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.645 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264235 s, 39.7 MB/s 2023-08-17T00:11:05.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294129 s, 35.7 MB/s 2023-08-17T00:11:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259068 s, 40.5 MB/s 2023-08-17T00:11:05.748 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.748 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.749 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0345857 s, 30.3 MB/s 2023-08-17T00:11:05.773 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.773 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.774 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226536 s, 46.3 MB/s 2023-08-17T00:11:05.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.802 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023698 s, 44.2 MB/s 2023-08-17T00:11:05.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.835 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296848 s, 35.3 MB/s 2023-08-17T00:11:05.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336854 s, 31.1 MB/s 2023-08-17T00:11:05.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239317 s, 43.8 MB/s 2023-08-17T00:11:05.927 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.928 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235878 s, 44.5 MB/s 2023-08-17T00:11:05.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.961 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303188 s, 34.6 MB/s 2023-08-17T00:11:05.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:05.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:05.997 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.032223 s, 32.5 MB/s 2023-08-17T00:11:06.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.026 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024686 s, 42.5 MB/s 2023-08-17T00:11:06.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.055 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257059 s, 40.8 MB/s 2023-08-17T00:11:06.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.082 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230321 s, 45.5 MB/s 2023-08-17T00:11:06.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.113 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265143 s, 39.5 MB/s 2023-08-17T00:11:06.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206373 s, 50.8 MB/s 2023-08-17T00:11:06.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.164 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242039 s, 43.3 MB/s 2023-08-17T00:11:06.166 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:06.166 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:06.167 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:06.167 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.1 2023-08-17T00:11:06.167 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:06.168 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:06.168 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:06.168 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:06.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.224 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251595 s, 41.7 MB/s 2023-08-17T00:11:06.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263432 s, 39.8 MB/s 2023-08-17T00:11:06.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.283 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234709 s, 44.7 MB/s 2023-08-17T00:11:06.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028639 s, 36.6 MB/s 2023-08-17T00:11:06.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.345 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273302 s, 38.4 MB/s 2023-08-17T00:11:06.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.371 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211532 s, 49.6 MB/s 2023-08-17T00:11:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275211 s, 38.1 MB/s 2023-08-17T00:11:06.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.429 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219649 s, 47.7 MB/s 2023-08-17T00:11:06.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246909 s, 42.5 MB/s 2023-08-17T00:11:06.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261824 s, 40.0 MB/s 2023-08-17T00:11:06.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.519 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279443 s, 37.5 MB/s 2023-08-17T00:11:06.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.545 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.545 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219529 s, 47.8 MB/s 2023-08-17T00:11:06.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207687 s, 50.5 MB/s 2023-08-17T00:11:06.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.599 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026147 s, 40.1 MB/s 2023-08-17T00:11:06.629 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.629 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.630 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254782 s, 41.2 MB/s 2023-08-17T00:11:06.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.657 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237866 s, 44.1 MB/s 2023-08-17T00:11:06.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.686 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244617 s, 42.9 MB/s 2023-08-17T00:11:06.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202353 s, 51.8 MB/s 2023-08-17T00:11:06.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220944 s, 47.5 MB/s 2023-08-17T00:11:06.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.762 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228586 s, 45.9 MB/s 2023-08-17T00:11:06.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.796 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302754 s, 34.6 MB/s 2023-08-17T00:11:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.824 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243808 s, 43.0 MB/s 2023-08-17T00:11:06.854 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.854 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.854 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254601 s, 41.2 MB/s 2023-08-17T00:11:06.881 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.882 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238341 s, 44.0 MB/s 2023-08-17T00:11:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.909 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244873 s, 42.8 MB/s 2023-08-17T00:11:06.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.946 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327945 s, 32.0 MB/s 2023-08-17T00:11:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:06.976 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261831 s, 40.0 MB/s 2023-08-17T00:11:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.005 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259355 s, 40.4 MB/s 2023-08-17T00:11:07.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.034 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246585 s, 42.5 MB/s 2023-08-17T00:11:07.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200752 s, 52.2 MB/s 2023-08-17T00:11:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248258 s, 42.2 MB/s 2023-08-17T00:11:07.127 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.128 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.036512 s, 28.7 MB/s 2023-08-17T00:11:07.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:07.131 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:07.131 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:07.131 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.2 2023-08-17T00:11:07.132 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:07.132 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:07.132 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:07.133 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:07.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.192 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264245 s, 39.7 MB/s 2023-08-17T00:11:07.219 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.219 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.220 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243534 s, 43.1 MB/s 2023-08-17T00:11:07.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.247 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221635 s, 47.3 MB/s 2023-08-17T00:11:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.277 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246072 s, 42.6 MB/s 2023-08-17T00:11:07.310 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.311 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294501 s, 35.6 MB/s 2023-08-17T00:11:07.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278361 s, 37.7 MB/s 2023-08-17T00:11:07.367 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.368 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207311 s, 50.6 MB/s 2023-08-17T00:11:07.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.393 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.393 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217446 s, 48.2 MB/s 2023-08-17T00:11:07.418 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.418 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.418 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211189 s, 49.7 MB/s 2023-08-17T00:11:07.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.454 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316521 s, 33.1 MB/s 2023-08-17T00:11:07.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.483 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252065 s, 41.6 MB/s 2023-08-17T00:11:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240405 s, 43.6 MB/s 2023-08-17T00:11:07.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.532 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179198 s, 58.5 MB/s 2023-08-17T00:11:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251935 s, 41.6 MB/s 2023-08-17T00:11:07.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276853 s, 37.9 MB/s 2023-08-17T00:11:07.621 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.622 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.622 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241145 s, 43.5 MB/s 2023-08-17T00:11:07.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291414 s, 36.0 MB/s 2023-08-17T00:11:07.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.680 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.680 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213952 s, 49.0 MB/s 2023-08-17T00:11:07.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.711 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.711 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026067 s, 40.2 MB/s 2023-08-17T00:11:07.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.742 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272395 s, 38.5 MB/s 2023-08-17T00:11:07.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.771 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251328 s, 41.7 MB/s 2023-08-17T00:11:07.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.796 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214109 s, 49.0 MB/s 2023-08-17T00:11:07.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.823 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.823 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220438 s, 47.6 MB/s 2023-08-17T00:11:07.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221499 s, 47.3 MB/s 2023-08-17T00:11:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.883 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030237 s, 34.7 MB/s 2023-08-17T00:11:07.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.913 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264065 s, 39.7 MB/s 2023-08-17T00:11:07.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206597 s, 50.8 MB/s 2023-08-17T00:11:07.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.965 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238987 s, 43.9 MB/s 2023-08-17T00:11:07.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:07.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:07.994 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240989 s, 43.5 MB/s 2023-08-17T00:11:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219976 s, 47.7 MB/s 2023-08-17T00:11:08.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.045 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217792 s, 48.1 MB/s 2023-08-17T00:11:08.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.079 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296399 s, 35.4 MB/s 2023-08-17T00:11:08.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:08.081 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:08.081 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:08.082 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.3 2023-08-17T00:11:08.082 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:08.082 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:08.082 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:08.083 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:08.140 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.140 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.141 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243494 s, 43.1 MB/s 2023-08-17T00:11:08.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215028 s, 48.8 MB/s 2023-08-17T00:11:08.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.194 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245858 s, 42.6 MB/s 2023-08-17T00:11:08.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.219 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.219 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021448 s, 48.9 MB/s 2023-08-17T00:11:08.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.245 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231362 s, 45.3 MB/s 2023-08-17T00:11:08.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258681 s, 40.5 MB/s 2023-08-17T00:11:08.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.300 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205608 s, 51.0 MB/s 2023-08-17T00:11:08.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283472 s, 37.0 MB/s 2023-08-17T00:11:08.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.357 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211808 s, 49.5 MB/s 2023-08-17T00:11:08.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.379 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191826 s, 54.7 MB/s 2023-08-17T00:11:08.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.398 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164396 s, 63.8 MB/s 2023-08-17T00:11:08.425 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.425 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.425 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226906 s, 46.2 MB/s 2023-08-17T00:11:08.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.452 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223101 s, 47.0 MB/s 2023-08-17T00:11:08.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.485 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293529 s, 35.7 MB/s 2023-08-17T00:11:08.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222648 s, 47.1 MB/s 2023-08-17T00:11:08.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.537 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213666 s, 49.1 MB/s 2023-08-17T00:11:08.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.562 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.562 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216113 s, 48.5 MB/s 2023-08-17T00:11:08.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.590 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236804 s, 44.3 MB/s 2023-08-17T00:11:08.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268305 s, 39.1 MB/s 2023-08-17T00:11:08.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228569 s, 45.9 MB/s 2023-08-17T00:11:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.673 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216141 s, 48.5 MB/s 2023-08-17T00:11:08.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.698 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207523 s, 50.5 MB/s 2023-08-17T00:11:08.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.727 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.727 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244267 s, 42.9 MB/s 2023-08-17T00:11:08.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.756 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241998 s, 43.3 MB/s 2023-08-17T00:11:08.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.783 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236906 s, 44.3 MB/s 2023-08-17T00:11:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219663 s, 47.7 MB/s 2023-08-17T00:11:08.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234872 s, 44.6 MB/s 2023-08-17T00:11:08.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.864 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222927 s, 47.0 MB/s 2023-08-17T00:11:08.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237449 s, 44.2 MB/s 2023-08-17T00:11:08.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236265 s, 44.4 MB/s 2023-08-17T00:11:08.944 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.944 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.944 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222037 s, 47.2 MB/s 2023-08-17T00:11:08.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:08.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:08.977 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284553 s, 36.8 MB/s 2023-08-17T00:11:08.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:08.980 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:08.980 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:08.981 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.4 2023-08-17T00:11:08.981 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:08.982 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:08.982 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:08.982 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247088 s, 42.4 MB/s 2023-08-17T00:11:09.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.070 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238893 s, 43.9 MB/s 2023-08-17T00:11:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.097 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230552 s, 45.5 MB/s 2023-08-17T00:11:09.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.126 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255605 s, 41.0 MB/s 2023-08-17T00:11:09.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.154 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247126 s, 42.4 MB/s 2023-08-17T00:11:09.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.180 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022677 s, 46.2 MB/s 2023-08-17T00:11:09.210 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.210 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.211 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263005 s, 39.9 MB/s 2023-08-17T00:11:09.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.238 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.238 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231818 s, 45.2 MB/s 2023-08-17T00:11:09.264 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.265 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225908 s, 46.4 MB/s 2023-08-17T00:11:09.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248984 s, 42.1 MB/s 2023-08-17T00:11:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270757 s, 38.7 MB/s 2023-08-17T00:11:09.354 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.355 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260743 s, 40.2 MB/s 2023-08-17T00:11:09.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212334 s, 49.4 MB/s 2023-08-17T00:11:09.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.406 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234144 s, 44.8 MB/s 2023-08-17T00:11:09.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.437 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267066 s, 39.3 MB/s 2023-08-17T00:11:09.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.463 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223571 s, 46.9 MB/s 2023-08-17T00:11:09.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.487 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205659 s, 51.0 MB/s 2023-08-17T00:11:09.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.519 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269433 s, 38.9 MB/s 2023-08-17T00:11:09.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275736 s, 38.0 MB/s 2023-08-17T00:11:09.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.580 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258293 s, 40.6 MB/s 2023-08-17T00:11:09.607 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.607 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.607 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023136 s, 45.3 MB/s 2023-08-17T00:11:09.632 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.632 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.632 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208822 s, 50.2 MB/s 2023-08-17T00:11:09.659 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.660 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229687 s, 45.7 MB/s 2023-08-17T00:11:09.684 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022346 s, 46.9 MB/s 2023-08-17T00:11:09.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026006 s, 40.3 MB/s 2023-08-17T00:11:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225183 s, 46.6 MB/s 2023-08-17T00:11:09.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242023 s, 43.3 MB/s 2023-08-17T00:11:09.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.797 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247781 s, 42.3 MB/s 2023-08-17T00:11:09.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.826 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242867 s, 43.2 MB/s 2023-08-17T00:11:09.853 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.853 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.854 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230027 s, 45.6 MB/s 2023-08-17T00:11:09.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.889 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316642 s, 33.1 MB/s 2023-08-17T00:11:09.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.914 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219645 s, 47.7 MB/s 2023-08-17T00:11:09.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:09.916 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:09.916 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:09.918 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.5 2023-08-17T00:11:09.918 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:09.919 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:09.919 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:09.920 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:09.975 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:09.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:09.976 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233735 s, 44.9 MB/s 2023-08-17T00:11:10.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.006 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248835 s, 42.1 MB/s 2023-08-17T00:11:10.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.031 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230194 s, 45.6 MB/s 2023-08-17T00:11:10.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.058 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221045 s, 47.4 MB/s 2023-08-17T00:11:10.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.085 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233893 s, 44.8 MB/s 2023-08-17T00:11:10.113 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.113 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.113 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236192 s, 44.4 MB/s 2023-08-17T00:11:10.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.138 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.138 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212489 s, 49.3 MB/s 2023-08-17T00:11:10.163 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.163 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.164 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217582 s, 48.2 MB/s 2023-08-17T00:11:10.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.193 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252582 s, 41.5 MB/s 2023-08-17T00:11:10.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.220 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234127 s, 44.8 MB/s 2023-08-17T00:11:10.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.250 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.250 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250752 s, 41.8 MB/s 2023-08-17T00:11:10.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.276 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233498 s, 44.9 MB/s 2023-08-17T00:11:10.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.298 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193861 s, 54.1 MB/s 2023-08-17T00:11:10.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.323 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208048 s, 50.4 MB/s 2023-08-17T00:11:10.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.348 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207547 s, 50.5 MB/s 2023-08-17T00:11:10.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268421 s, 39.1 MB/s 2023-08-17T00:11:10.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.410 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257681 s, 40.7 MB/s 2023-08-17T00:11:10.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.438 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024234 s, 43.3 MB/s 2023-08-17T00:11:10.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.469 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249564 s, 42.0 MB/s 2023-08-17T00:11:10.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.496 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239347 s, 43.8 MB/s 2023-08-17T00:11:10.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.520 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201617 s, 52.0 MB/s 2023-08-17T00:11:10.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.542 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218624 s, 48.0 MB/s 2023-08-17T00:11:10.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226828 s, 46.2 MB/s 2023-08-17T00:11:10.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.599 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268977 s, 39.0 MB/s 2023-08-17T00:11:10.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.626 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217589 s, 48.2 MB/s 2023-08-17T00:11:10.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289274 s, 36.2 MB/s 2023-08-17T00:11:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.688 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246312 s, 42.6 MB/s 2023-08-17T00:11:10.716 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.717 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252114 s, 41.6 MB/s 2023-08-17T00:11:10.744 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.744 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.744 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226784 s, 46.2 MB/s 2023-08-17T00:11:10.775 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.775 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.775 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259351 s, 40.4 MB/s 2023-08-17T00:11:10.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.807 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269619 s, 38.9 MB/s 2023-08-17T00:11:10.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.840 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250698 s, 41.8 MB/s 2023-08-17T00:11:10.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:10.842 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:10.842 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:10.843 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.6 2023-08-17T00:11:10.843 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:10.843 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:10.843 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:10.844 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:10.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.895 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183342 s, 57.2 MB/s 2023-08-17T00:11:10.924 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.924 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.925 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246549 s, 42.5 MB/s 2023-08-17T00:11:10.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.945 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178321 s, 58.8 MB/s 2023-08-17T00:11:10.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:10.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:10.979 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307019 s, 34.2 MB/s 2023-08-17T00:11:11.007 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.008 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.008 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231488 s, 45.3 MB/s 2023-08-17T00:11:11.036 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.036 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.036 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248618 s, 42.2 MB/s 2023-08-17T00:11:11.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.067 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263066 s, 39.9 MB/s 2023-08-17T00:11:11.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.088 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182824 s, 57.4 MB/s 2023-08-17T00:11:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.118 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256004 s, 41.0 MB/s 2023-08-17T00:11:11.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.148 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.148 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249581 s, 42.0 MB/s 2023-08-17T00:11:11.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.171 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202847 s, 51.7 MB/s 2023-08-17T00:11:11.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250478 s, 41.9 MB/s 2023-08-17T00:11:11.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.226 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216095 s, 48.5 MB/s 2023-08-17T00:11:11.248 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.248 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.249 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191833 s, 54.7 MB/s 2023-08-17T00:11:11.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228688 s, 45.9 MB/s 2023-08-17T00:11:11.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217376 s, 48.2 MB/s 2023-08-17T00:11:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.327 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224487 s, 46.7 MB/s 2023-08-17T00:11:11.358 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.358 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.358 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263672 s, 39.8 MB/s 2023-08-17T00:11:11.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.387 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243356 s, 43.1 MB/s 2023-08-17T00:11:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023086 s, 45.4 MB/s 2023-08-17T00:11:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221465 s, 47.3 MB/s 2023-08-17T00:11:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223552 s, 46.9 MB/s 2023-08-17T00:11:11.500 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.501 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.501 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293987 s, 35.7 MB/s 2023-08-17T00:11:11.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.530 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266653 s, 39.3 MB/s 2023-08-17T00:11:11.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259292 s, 40.4 MB/s 2023-08-17T00:11:11.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.587 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235161 s, 44.6 MB/s 2023-08-17T00:11:11.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.615 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241301 s, 43.5 MB/s 2023-08-17T00:11:11.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.641 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.641 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211299 s, 49.6 MB/s 2023-08-17T00:11:11.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.669 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230791 s, 45.4 MB/s 2023-08-17T00:11:11.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.692 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206722 s, 50.7 MB/s 2023-08-17T00:11:11.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.723 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262749 s, 39.9 MB/s 2023-08-17T00:11:11.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.748 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213304 s, 49.2 MB/s 2023-08-17T00:11:11.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:11.749 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:11.750 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:11.750 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.7 2023-08-17T00:11:11.750 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:11.751 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:11.751 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:11.751 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.814 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282554 s, 37.1 MB/s 2023-08-17T00:11:11.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.842 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241854 s, 43.4 MB/s 2023-08-17T00:11:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.868 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223822 s, 46.8 MB/s 2023-08-17T00:11:11.899 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.900 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278602 s, 37.6 MB/s 2023-08-17T00:11:11.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.932 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027303 s, 38.4 MB/s 2023-08-17T00:11:11.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.956 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202254 s, 51.8 MB/s 2023-08-17T00:11:11.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:11.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:11.988 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292664 s, 35.8 MB/s 2023-08-17T00:11:12.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.020 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270766 s, 38.7 MB/s 2023-08-17T00:11:12.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196006 s, 53.5 MB/s 2023-08-17T00:11:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.073 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262745 s, 39.9 MB/s 2023-08-17T00:11:12.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.102 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238942 s, 43.9 MB/s 2023-08-17T00:11:12.129 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.130 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244211 s, 42.9 MB/s 2023-08-17T00:11:12.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279023 s, 37.6 MB/s 2023-08-17T00:11:12.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.191 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255985 s, 41.0 MB/s 2023-08-17T00:11:12.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221343 s, 47.4 MB/s 2023-08-17T00:11:12.243 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.244 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230369 s, 45.5 MB/s 2023-08-17T00:11:12.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.282 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328036 s, 32.0 MB/s 2023-08-17T00:11:12.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.304 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187186 s, 56.0 MB/s 2023-08-17T00:11:12.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239888 s, 43.7 MB/s 2023-08-17T00:11:12.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.356 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192631 s, 54.4 MB/s 2023-08-17T00:11:12.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.426 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302006 s, 34.7 MB/s 2023-08-17T00:11:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.427 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207089 s, 50.6 MB/s 2023-08-17T00:11:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.439 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217374 s, 48.2 MB/s 2023-08-17T00:11:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.460 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.461 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183449 s, 57.2 MB/s 2023-08-17T00:11:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237519 s, 44.1 MB/s 2023-08-17T00:11:12.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.518 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259709 s, 40.4 MB/s 2023-08-17T00:11:12.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.541 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190423 s, 55.1 MB/s 2023-08-17T00:11:12.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024502 s, 42.8 MB/s 2023-08-17T00:11:12.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.592 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193288 s, 54.2 MB/s 2023-08-17T00:11:12.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.616 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203874 s, 51.4 MB/s 2023-08-17T00:11:12.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265071 s, 39.6 MB/s 2023-08-17T00:11:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.674 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223815 s, 46.9 MB/s 2023-08-17T00:11:12.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:12.676 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:12.676 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:12.677 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.8 2023-08-17T00:11:12.677 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:12.677 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:12.677 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:12.678 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:12.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.742 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289592 s, 36.2 MB/s 2023-08-17T00:11:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.770 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232158 s, 45.2 MB/s 2023-08-17T00:11:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.795 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214693 s, 48.8 MB/s 2023-08-17T00:11:12.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.816 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179294 s, 58.5 MB/s 2023-08-17T00:11:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226283 s, 46.3 MB/s 2023-08-17T00:11:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.876 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283812 s, 36.9 MB/s 2023-08-17T00:11:12.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254256 s, 41.2 MB/s 2023-08-17T00:11:12.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026918 s, 39.0 MB/s 2023-08-17T00:11:12.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.965 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234643 s, 44.7 MB/s 2023-08-17T00:11:12.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:12.989 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211069 s, 49.7 MB/s 2023-08-17T00:11:13.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.015 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227673 s, 46.1 MB/s 2023-08-17T00:11:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237264 s, 44.2 MB/s 2023-08-17T00:11:13.067 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.068 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222423 s, 47.1 MB/s 2023-08-17T00:11:13.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.102 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297885 s, 35.2 MB/s 2023-08-17T00:11:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288898 s, 36.3 MB/s 2023-08-17T00:11:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.167 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.168 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294006 s, 35.7 MB/s 2023-08-17T00:11:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.198 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268707 s, 39.0 MB/s 2023-08-17T00:11:13.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260435 s, 40.3 MB/s 2023-08-17T00:11:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.259 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256604 s, 40.9 MB/s 2023-08-17T00:11:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.285 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022478 s, 46.6 MB/s 2023-08-17T00:11:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.307 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188672 s, 55.6 MB/s 2023-08-17T00:11:13.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217526 s, 48.2 MB/s 2023-08-17T00:11:13.354 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.354 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.355 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177623 s, 59.0 MB/s 2023-08-17T00:11:13.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212936 s, 49.2 MB/s 2023-08-17T00:11:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.409 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258426 s, 40.6 MB/s 2023-08-17T00:11:13.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211482 s, 49.6 MB/s 2023-08-17T00:11:13.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178376 s, 58.8 MB/s 2023-08-17T00:11:13.484 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.484 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.485 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022943 s, 45.7 MB/s 2023-08-17T00:11:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280982 s, 37.3 MB/s 2023-08-17T00:11:13.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.545 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.545 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025071 s, 41.8 MB/s 2023-08-17T00:11:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202317 s, 51.8 MB/s 2023-08-17T00:11:13.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.591 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194378 s, 53.9 MB/s 2023-08-17T00:11:13.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:13.593 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:13.593 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:13.594 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.9 2023-08-17T00:11:13.594 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:13.594 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:13.594 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:13.595 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:13.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.649 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214072 s, 49.0 MB/s 2023-08-17T00:11:13.677 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.677 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.677 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239408 s, 43.8 MB/s 2023-08-17T00:11:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.704 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223108 s, 47.0 MB/s 2023-08-17T00:11:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245024 s, 42.8 MB/s 2023-08-17T00:11:13.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.755 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020125 s, 52.1 MB/s 2023-08-17T00:11:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247465 s, 42.4 MB/s 2023-08-17T00:11:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230483 s, 45.5 MB/s 2023-08-17T00:11:13.840 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.841 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263346 s, 39.8 MB/s 2023-08-17T00:11:13.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237265 s, 44.2 MB/s 2023-08-17T00:11:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250338 s, 41.9 MB/s 2023-08-17T00:11:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223123 s, 47.0 MB/s 2023-08-17T00:11:13.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.953 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272227 s, 38.5 MB/s 2023-08-17T00:11:13.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:13.980 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239092 s, 43.9 MB/s 2023-08-17T00:11:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229006 s, 45.8 MB/s 2023-08-17T00:11:14.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.032 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213355 s, 49.1 MB/s 2023-08-17T00:11:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254262 s, 41.2 MB/s 2023-08-17T00:11:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.092 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252035 s, 41.6 MB/s 2023-08-17T00:11:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.119 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239916 s, 43.7 MB/s 2023-08-17T00:11:14.152 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.153 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292053 s, 35.9 MB/s 2023-08-17T00:11:14.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.185 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.185 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027385 s, 38.3 MB/s 2023-08-17T00:11:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234063 s, 44.8 MB/s 2023-08-17T00:11:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.240 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237994 s, 44.1 MB/s 2023-08-17T00:11:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246468 s, 42.5 MB/s 2023-08-17T00:11:14.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02941 s, 35.7 MB/s 2023-08-17T00:11:14.329 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.330 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023346 s, 44.9 MB/s 2023-08-17T00:11:14.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.351 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.351 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180087 s, 58.2 MB/s 2023-08-17T00:11:14.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.381 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257626 s, 40.7 MB/s 2023-08-17T00:11:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.409 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237333 s, 44.2 MB/s 2023-08-17T00:11:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.434 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216633 s, 48.4 MB/s 2023-08-17T00:11:14.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.460 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234203 s, 44.8 MB/s 2023-08-17T00:11:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299025 s, 35.1 MB/s 2023-08-17T00:11:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253745 s, 41.3 MB/s 2023-08-17T00:11:14.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:14.526 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:14.527 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:14.527 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.10 2023-08-17T00:11:14.527 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:14.528 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:14.529 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:14.529 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:14.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.584 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227331 s, 46.1 MB/s 2023-08-17T00:11:14.614 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.614 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.615 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257553 s, 40.7 MB/s 2023-08-17T00:11:14.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209921 s, 50.0 MB/s 2023-08-17T00:11:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233131 s, 45.0 MB/s 2023-08-17T00:11:14.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.694 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241248 s, 43.5 MB/s 2023-08-17T00:11:14.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.722 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241947 s, 43.3 MB/s 2023-08-17T00:11:14.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.747 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208234 s, 50.4 MB/s 2023-08-17T00:11:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282822 s, 37.1 MB/s 2023-08-17T00:11:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.815 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294845 s, 35.6 MB/s 2023-08-17T00:11:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239249 s, 43.8 MB/s 2023-08-17T00:11:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.869 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224155 s, 46.8 MB/s 2023-08-17T00:11:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.893 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206932 s, 50.7 MB/s 2023-08-17T00:11:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227375 s, 46.1 MB/s 2023-08-17T00:11:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.951 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262938 s, 39.9 MB/s 2023-08-17T00:11:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:14.979 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239006 s, 43.9 MB/s 2023-08-17T00:11:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.005 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218296 s, 48.0 MB/s 2023-08-17T00:11:15.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227357 s, 46.1 MB/s 2023-08-17T00:11:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251767 s, 41.6 MB/s 2023-08-17T00:11:15.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.090 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246704 s, 42.5 MB/s 2023-08-17T00:11:15.119 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.119 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.119 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240542 s, 43.6 MB/s 2023-08-17T00:11:15.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.144 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207537 s, 50.5 MB/s 2023-08-17T00:11:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313177 s, 33.5 MB/s 2023-08-17T00:11:15.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322054 s, 32.6 MB/s 2023-08-17T00:11:15.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.248 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263228 s, 39.8 MB/s 2023-08-17T00:11:15.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.281 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288101 s, 36.4 MB/s 2023-08-17T00:11:15.308 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.308 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.308 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227993 s, 46.0 MB/s 2023-08-17T00:11:15.335 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.335 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.335 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234507 s, 44.7 MB/s 2023-08-17T00:11:15.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.363 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239399 s, 43.8 MB/s 2023-08-17T00:11:15.389 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.390 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021922 s, 47.8 MB/s 2023-08-17T00:11:15.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.416 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.416 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220527 s, 47.5 MB/s 2023-08-17T00:11:15.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.447 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027845 s, 37.7 MB/s 2023-08-17T00:11:15.480 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.480 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.480 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293183 s, 35.8 MB/s 2023-08-17T00:11:15.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:15.482 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:15.482 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:15.482 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.11 2023-08-17T00:11:15.483 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:15.483 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:15.483 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:15.483 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:15.595 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.595 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.595 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307041 s, 34.2 MB/s 2023-08-17T00:11:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224438 s, 46.7 MB/s 2023-08-17T00:11:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.650 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230727 s, 45.4 MB/s 2023-08-17T00:11:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.674 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218684 s, 47.9 MB/s 2023-08-17T00:11:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.699 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021275 s, 49.3 MB/s 2023-08-17T00:11:15.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.724 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211459 s, 49.6 MB/s 2023-08-17T00:11:15.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.759 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298406 s, 35.1 MB/s 2023-08-17T00:11:15.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.791 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273279 s, 38.4 MB/s 2023-08-17T00:11:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.817 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217344 s, 48.2 MB/s 2023-08-17T00:11:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.847 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254473 s, 41.2 MB/s 2023-08-17T00:11:15.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.869 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192635 s, 54.4 MB/s 2023-08-17T00:11:15.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.903 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295049 s, 35.5 MB/s 2023-08-17T00:11:15.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255993 s, 41.0 MB/s 2023-08-17T00:11:15.956 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.957 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194556 s, 53.9 MB/s 2023-08-17T00:11:15.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:15.985 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243686 s, 43.0 MB/s 2023-08-17T00:11:16.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230228 s, 45.5 MB/s 2023-08-17T00:11:16.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.041 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025276 s, 41.5 MB/s 2023-08-17T00:11:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164871 s, 63.6 MB/s 2023-08-17T00:11:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.088 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236198 s, 44.4 MB/s 2023-08-17T00:11:16.090 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:11:16.093 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:11:16.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.113 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.113 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200073 s, 52.4 MB/s 2023-08-17T00:11:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.132 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149086 s, 70.3 MB/s 2023-08-17T00:11:16.152 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.152 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.152 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018331 s, 57.2 MB/s 2023-08-17T00:11:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.179 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228091 s, 46.0 MB/s 2023-08-17T00:11:16.203 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.204 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207823 s, 50.5 MB/s 2023-08-17T00:11:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.230 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226113 s, 46.4 MB/s 2023-08-17T00:11:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.264 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028307 s, 37.0 MB/s 2023-08-17T00:11:16.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.295 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275008 s, 38.1 MB/s 2023-08-17T00:11:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.322 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023471 s, 44.7 MB/s 2023-08-17T00:11:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239266 s, 43.8 MB/s 2023-08-17T00:11:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.379 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244875 s, 42.8 MB/s 2023-08-17T00:11:16.402 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.403 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213529 s, 49.1 MB/s 2023-08-17T00:11:16.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.433 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257969 s, 40.6 MB/s 2023-08-17T00:11:16.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:16.435 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:16.436 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:16.436 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.12 2023-08-17T00:11:16.437 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:16.437 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:16.438 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:16.438 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:16.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.543 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313428 s, 33.5 MB/s 2023-08-17T00:11:16.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212988 s, 49.2 MB/s 2023-08-17T00:11:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.598 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025444 s, 41.2 MB/s 2023-08-17T00:11:16.623 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.623 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.623 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221954 s, 47.2 MB/s 2023-08-17T00:11:16.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.650 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229918 s, 45.6 MB/s 2023-08-17T00:11:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025096 s, 41.8 MB/s 2023-08-17T00:11:16.705 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.705 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.705 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225245 s, 46.6 MB/s 2023-08-17T00:11:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.732 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226202 s, 46.4 MB/s 2023-08-17T00:11:16.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027522 s, 38.1 MB/s 2023-08-17T00:11:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.781 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158448 s, 66.2 MB/s 2023-08-17T00:11:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.815 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301672 s, 34.8 MB/s 2023-08-17T00:11:16.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239376 s, 43.8 MB/s 2023-08-17T00:11:16.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.865 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190625 s, 55.0 MB/s 2023-08-17T00:11:16.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.887 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192815 s, 54.4 MB/s 2023-08-17T00:11:16.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.913 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221618 s, 47.3 MB/s 2023-08-17T00:11:16.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.941 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238099 s, 44.0 MB/s 2023-08-17T00:11:16.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.969 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240416 s, 43.6 MB/s 2023-08-17T00:11:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:16.993 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212551 s, 49.3 MB/s 2023-08-17T00:11:17.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.022 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262202 s, 40.0 MB/s 2023-08-17T00:11:17.051 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.052 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261312 s, 40.1 MB/s 2023-08-17T00:11:17.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.078 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217571 s, 48.2 MB/s 2023-08-17T00:11:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229889 s, 45.6 MB/s 2023-08-17T00:11:17.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.129 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216932 s, 48.3 MB/s 2023-08-17T00:11:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221869 s, 47.3 MB/s 2023-08-17T00:11:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.183 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241571 s, 43.4 MB/s 2023-08-17T00:11:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266261 s, 39.4 MB/s 2023-08-17T00:11:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.242 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235778 s, 44.5 MB/s 2023-08-17T00:11:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256425 s, 40.9 MB/s 2023-08-17T00:11:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277177 s, 37.8 MB/s 2023-08-17T00:11:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.326 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200812 s, 52.2 MB/s 2023-08-17T00:11:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.351 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208806 s, 50.2 MB/s 2023-08-17T00:11:17.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209569 s, 50.0 MB/s 2023-08-17T00:11:17.377 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:17.378 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:17.379 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:17.380 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.13 2023-08-17T00:11:17.380 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:17.381 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:17.382 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:17.382 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:17.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.442 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241168 s, 43.5 MB/s 2023-08-17T00:11:17.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.469 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242615 s, 43.2 MB/s 2023-08-17T00:11:17.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212036 s, 49.5 MB/s 2023-08-17T00:11:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.520 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220273 s, 47.6 MB/s 2023-08-17T00:11:17.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288804 s, 36.3 MB/s 2023-08-17T00:11:17.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.575 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209727 s, 50.0 MB/s 2023-08-17T00:11:17.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.600 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214942 s, 48.8 MB/s 2023-08-17T00:11:17.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.629 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246046 s, 42.6 MB/s 2023-08-17T00:11:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250946 s, 41.8 MB/s 2023-08-17T00:11:17.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.691 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281988 s, 37.2 MB/s 2023-08-17T00:11:17.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.715 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208158 s, 50.4 MB/s 2023-08-17T00:11:17.743 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260115 s, 40.3 MB/s 2023-08-17T00:11:17.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.768 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199567 s, 52.5 MB/s 2023-08-17T00:11:17.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.789 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018901 s, 55.5 MB/s 2023-08-17T00:11:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.816 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238024 s, 44.1 MB/s 2023-08-17T00:11:17.840 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.841 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200482 s, 52.3 MB/s 2023-08-17T00:11:17.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.879 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334676 s, 31.3 MB/s 2023-08-17T00:11:17.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216516 s, 48.4 MB/s 2023-08-17T00:11:17.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.928 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206808 s, 50.7 MB/s 2023-08-17T00:11:17.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.955 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225977 s, 46.4 MB/s 2023-08-17T00:11:17.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:17.986 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262066 s, 40.0 MB/s 2023-08-17T00:11:18.018 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292021 s, 35.9 MB/s 2023-08-17T00:11:18.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.047 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241997 s, 43.3 MB/s 2023-08-17T00:11:18.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.074 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02212 s, 47.4 MB/s 2023-08-17T00:11:18.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261278 s, 40.1 MB/s 2023-08-17T00:11:18.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028801 s, 36.4 MB/s 2023-08-17T00:11:18.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.164 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222573 s, 47.1 MB/s 2023-08-17T00:11:18.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.193 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240257 s, 43.6 MB/s 2023-08-17T00:11:18.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.222 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249416 s, 42.0 MB/s 2023-08-17T00:11:18.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.250 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232514 s, 45.1 MB/s 2023-08-17T00:11:18.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.276 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221083 s, 47.4 MB/s 2023-08-17T00:11:18.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.303 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022506 s, 46.6 MB/s 2023-08-17T00:11:18.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:18.305 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:18.305 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:18.306 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.14 2023-08-17T00:11:18.306 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:18.306 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:18.306 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:18.307 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:18.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.369 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286774 s, 36.6 MB/s 2023-08-17T00:11:18.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.401 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028463 s, 36.8 MB/s 2023-08-17T00:11:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.428 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225012 s, 46.6 MB/s 2023-08-17T00:11:18.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.452 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196321 s, 53.4 MB/s 2023-08-17T00:11:18.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.481 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025271 s, 41.5 MB/s 2023-08-17T00:11:18.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285949 s, 36.7 MB/s 2023-08-17T00:11:18.546 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.547 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.547 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291869 s, 35.9 MB/s 2023-08-17T00:11:18.575 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.576 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248775 s, 42.1 MB/s 2023-08-17T00:11:18.604 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.605 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245146 s, 42.8 MB/s 2023-08-17T00:11:18.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298745 s, 35.1 MB/s 2023-08-17T00:11:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250739 s, 41.8 MB/s 2023-08-17T00:11:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027854 s, 37.6 MB/s 2023-08-17T00:11:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222735 s, 47.1 MB/s 2023-08-17T00:11:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.750 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207933 s, 50.4 MB/s 2023-08-17T00:11:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.778 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240059 s, 43.7 MB/s 2023-08-17T00:11:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.804 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215438 s, 48.7 MB/s 2023-08-17T00:11:18.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.832 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239253 s, 43.8 MB/s 2023-08-17T00:11:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.861 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238528 s, 44.0 MB/s 2023-08-17T00:11:18.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.890 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260188 s, 40.3 MB/s 2023-08-17T00:11:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0350215 s, 29.9 MB/s 2023-08-17T00:11:18.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.960 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267228 s, 39.2 MB/s 2023-08-17T00:11:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022919 s, 45.8 MB/s 2023-08-17T00:11:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284678 s, 36.8 MB/s 2023-08-17T00:11:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.049 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258834 s, 40.5 MB/s 2023-08-17T00:11:19.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.075 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214002 s, 49.0 MB/s 2023-08-17T00:11:19.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.101 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02248 s, 46.6 MB/s 2023-08-17T00:11:19.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250415 s, 41.9 MB/s 2023-08-17T00:11:19.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261961 s, 40.0 MB/s 2023-08-17T00:11:19.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.196 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309419 s, 33.9 MB/s 2023-08-17T00:11:19.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.219 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186511 s, 56.2 MB/s 2023-08-17T00:11:19.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.250 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026571 s, 39.5 MB/s 2023-08-17T00:11:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329083 s, 31.9 MB/s 2023-08-17T00:11:19.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:19.288 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:19.288 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:19.289 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.15 2023-08-17T00:11:19.289 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:19.289 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:19.290 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:19.290 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.346 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254678 s, 41.2 MB/s 2023-08-17T00:11:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.373 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225065 s, 46.6 MB/s 2023-08-17T00:11:19.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296735 s, 35.3 MB/s 2023-08-17T00:11:19.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261886 s, 40.0 MB/s 2023-08-17T00:11:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.460 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019843 s, 52.8 MB/s 2023-08-17T00:11:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.486 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217523 s, 48.2 MB/s 2023-08-17T00:11:19.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02476 s, 42.3 MB/s 2023-08-17T00:11:19.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.542 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238057 s, 44.0 MB/s 2023-08-17T00:11:19.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.570 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246952 s, 42.5 MB/s 2023-08-17T00:11:19.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192911 s, 54.4 MB/s 2023-08-17T00:11:19.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233578 s, 44.9 MB/s 2023-08-17T00:11:19.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026898 s, 39.0 MB/s 2023-08-17T00:11:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231811 s, 45.2 MB/s 2023-08-17T00:11:19.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.707 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023945 s, 43.8 MB/s 2023-08-17T00:11:19.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.734 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234647 s, 44.7 MB/s 2023-08-17T00:11:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.766 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286469 s, 36.6 MB/s 2023-08-17T00:11:19.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.794 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231134 s, 45.4 MB/s 2023-08-17T00:11:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206228 s, 50.8 MB/s 2023-08-17T00:11:19.841 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.842 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213467 s, 49.1 MB/s 2023-08-17T00:11:19.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.870 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239693 s, 43.7 MB/s 2023-08-17T00:11:19.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.898 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238916 s, 43.9 MB/s 2023-08-17T00:11:19.922 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.923 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.923 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216529 s, 48.4 MB/s 2023-08-17T00:11:19.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.950 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231138 s, 45.4 MB/s 2023-08-17T00:11:19.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:19.978 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243277 s, 43.1 MB/s 2023-08-17T00:11:20.008 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.008 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.008 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261728 s, 40.1 MB/s 2023-08-17T00:11:20.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.034 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210305 s, 49.9 MB/s 2023-08-17T00:11:20.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.061 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240271 s, 43.6 MB/s 2023-08-17T00:11:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.093 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266809 s, 39.3 MB/s 2023-08-17T00:11:20.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.120 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237314 s, 44.2 MB/s 2023-08-17T00:11:20.150 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.150 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.151 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256787 s, 40.8 MB/s 2023-08-17T00:11:20.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.175 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214357 s, 48.9 MB/s 2023-08-17T00:11:20.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.203 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224509 s, 46.7 MB/s 2023-08-17T00:11:20.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:20.205 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:20.205 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:20.206 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.16 2023-08-17T00:11:20.206 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:20.207 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:20.207 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:20.208 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:20.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.267 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.267 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226937 s, 46.2 MB/s 2023-08-17T00:11:20.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.295 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248366 s, 42.2 MB/s 2023-08-17T00:11:20.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.316 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191524 s, 54.7 MB/s 2023-08-17T00:11:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318254 s, 32.9 MB/s 2023-08-17T00:11:20.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.376 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189291 s, 55.4 MB/s 2023-08-17T00:11:20.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.406 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250838 s, 41.8 MB/s 2023-08-17T00:11:20.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.432 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221876 s, 47.3 MB/s 2023-08-17T00:11:20.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255931 s, 41.0 MB/s 2023-08-17T00:11:20.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207844 s, 50.5 MB/s 2023-08-17T00:11:20.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.515 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229495 s, 45.7 MB/s 2023-08-17T00:11:20.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.543 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229924 s, 45.6 MB/s 2023-08-17T00:11:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222784 s, 47.1 MB/s 2023-08-17T00:11:20.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.597 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217248 s, 48.3 MB/s 2023-08-17T00:11:20.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.625 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267818 s, 39.2 MB/s 2023-08-17T00:11:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268599 s, 39.0 MB/s 2023-08-17T00:11:20.680 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.681 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210985 s, 49.7 MB/s 2023-08-17T00:11:20.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238111 s, 44.0 MB/s 2023-08-17T00:11:20.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.740 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269488 s, 38.9 MB/s 2023-08-17T00:11:20.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206867 s, 50.7 MB/s 2023-08-17T00:11:20.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.788 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202299 s, 51.8 MB/s 2023-08-17T00:11:20.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.814 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021394 s, 49.0 MB/s 2023-08-17T00:11:20.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259974 s, 40.3 MB/s 2023-08-17T00:11:20.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.870 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224123 s, 46.8 MB/s 2023-08-17T00:11:20.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.894 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198939 s, 52.7 MB/s 2023-08-17T00:11:20.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205592 s, 51.0 MB/s 2023-08-17T00:11:20.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.941 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191208 s, 54.8 MB/s 2023-08-17T00:11:20.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.972 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257562 s, 40.7 MB/s 2023-08-17T00:11:20.998 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:20.998 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:20.998 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238002 s, 44.1 MB/s 2023-08-17T00:11:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.028 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221906 s, 47.3 MB/s 2023-08-17T00:11:21.048 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.049 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205645 s, 51.0 MB/s 2023-08-17T00:11:21.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.079 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254708 s, 41.2 MB/s 2023-08-17T00:11:21.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.105 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222679 s, 47.1 MB/s 2023-08-17T00:11:21.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:21.107 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:21.107 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:21.108 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.17 2023-08-17T00:11:21.108 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:21.108 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:21.109 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:21.109 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204676 s, 51.2 MB/s 2023-08-17T00:11:21.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.180 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178003 s, 58.9 MB/s 2023-08-17T00:11:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220366 s, 47.6 MB/s 2023-08-17T00:11:21.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222517 s, 47.1 MB/s 2023-08-17T00:11:21.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.263 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255316 s, 41.1 MB/s 2023-08-17T00:11:21.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.290 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.290 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223933 s, 46.8 MB/s 2023-08-17T00:11:21.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.317 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225889 s, 46.4 MB/s 2023-08-17T00:11:21.351 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.352 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319361 s, 32.8 MB/s 2023-08-17T00:11:21.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228431 s, 45.9 MB/s 2023-08-17T00:11:21.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.412 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285112 s, 36.8 MB/s 2023-08-17T00:11:21.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.438 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201472 s, 52.0 MB/s 2023-08-17T00:11:21.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.459 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019818 s, 52.9 MB/s 2023-08-17T00:11:21.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.490 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274837 s, 38.2 MB/s 2023-08-17T00:11:21.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.518 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260734 s, 40.2 MB/s 2023-08-17T00:11:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290139 s, 36.1 MB/s 2023-08-17T00:11:21.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.576 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197326 s, 53.1 MB/s 2023-08-17T00:11:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212648 s, 49.3 MB/s 2023-08-17T00:11:21.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.630 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255262 s, 41.1 MB/s 2023-08-17T00:11:21.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.664 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291154 s, 36.0 MB/s 2023-08-17T00:11:21.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.690 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214172 s, 49.0 MB/s 2023-08-17T00:11:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.720 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215562 s, 48.6 MB/s 2023-08-17T00:11:21.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.739 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192802 s, 54.4 MB/s 2023-08-17T00:11:21.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197498 s, 53.1 MB/s 2023-08-17T00:11:21.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.786 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.786 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204504 s, 51.3 MB/s 2023-08-17T00:11:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193887 s, 54.1 MB/s 2023-08-17T00:11:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024157 s, 43.4 MB/s 2023-08-17T00:11:21.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.869 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266244 s, 39.4 MB/s 2023-08-17T00:11:21.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.894 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021739 s, 48.2 MB/s 2023-08-17T00:11:21.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.918 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188837 s, 55.5 MB/s 2023-08-17T00:11:21.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.944 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234495 s, 44.7 MB/s 2023-08-17T00:11:21.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.972 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.972 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023705 s, 44.2 MB/s 2023-08-17T00:11:21.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:21.996 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:21.996 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199302 s, 52.6 MB/s 2023-08-17T00:11:21.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:21.998 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:21.998 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:21.999 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.18 2023-08-17T00:11:21.999 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:21.999 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:21.999 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:22.000 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:22.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.056 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230294 s, 45.5 MB/s 2023-08-17T00:11:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211685 s, 49.5 MB/s 2023-08-17T00:11:22.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.106 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219977 s, 47.7 MB/s 2023-08-17T00:11:22.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219411 s, 47.8 MB/s 2023-08-17T00:11:22.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.156 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020908 s, 50.2 MB/s 2023-08-17T00:11:22.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.178 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018525 s, 56.6 MB/s 2023-08-17T00:11:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236836 s, 44.3 MB/s 2023-08-17T00:11:22.234 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.235 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.235 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238934 s, 43.9 MB/s 2023-08-17T00:11:22.264 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253847 s, 41.3 MB/s 2023-08-17T00:11:22.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.290 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210778 s, 49.7 MB/s 2023-08-17T00:11:22.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.317 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.317 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239021 s, 43.9 MB/s 2023-08-17T00:11:22.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282675 s, 37.1 MB/s 2023-08-17T00:11:22.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255214 s, 41.1 MB/s 2023-08-17T00:11:22.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238543 s, 44.0 MB/s 2023-08-17T00:11:22.430 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.431 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212916 s, 49.2 MB/s 2023-08-17T00:11:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196054 s, 53.5 MB/s 2023-08-17T00:11:22.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.483 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238582 s, 44.0 MB/s 2023-08-17T00:11:22.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.515 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281797 s, 37.2 MB/s 2023-08-17T00:11:22.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.539 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210168 s, 49.9 MB/s 2023-08-17T00:11:22.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252218 s, 41.6 MB/s 2023-08-17T00:11:22.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.594 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211575 s, 49.6 MB/s 2023-08-17T00:11:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262774 s, 39.9 MB/s 2023-08-17T00:11:22.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241839 s, 43.4 MB/s 2023-08-17T00:11:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272081 s, 38.5 MB/s 2023-08-17T00:11:22.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.709 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227818 s, 46.0 MB/s 2023-08-17T00:11:22.730 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.731 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186943 s, 56.1 MB/s 2023-08-17T00:11:22.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.752 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188822 s, 55.5 MB/s 2023-08-17T00:11:22.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.780 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.780 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230143 s, 45.6 MB/s 2023-08-17T00:11:22.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254487 s, 41.2 MB/s 2023-08-17T00:11:22.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.835 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231936 s, 45.2 MB/s 2023-08-17T00:11:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.861 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205223 s, 51.1 MB/s 2023-08-17T00:11:22.883 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.884 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190753 s, 55.0 MB/s 2023-08-17T00:11:22.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:22.886 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:22.886 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:22.887 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.19 2023-08-17T00:11:22.887 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:22.887 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:22.887 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:22.888 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:22.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.946 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026514 s, 39.5 MB/s 2023-08-17T00:11:22.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:22.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:22.978 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283585 s, 37.0 MB/s 2023-08-17T00:11:23.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.001 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194596 s, 53.9 MB/s 2023-08-17T00:11:23.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.027 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224067 s, 46.8 MB/s 2023-08-17T00:11:23.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.053 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229996 s, 45.6 MB/s 2023-08-17T00:11:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02313 s, 45.3 MB/s 2023-08-17T00:11:23.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218321 s, 48.0 MB/s 2023-08-17T00:11:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.132 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216827 s, 48.4 MB/s 2023-08-17T00:11:23.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.159 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.159 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228871 s, 45.8 MB/s 2023-08-17T00:11:23.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.181 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189326 s, 55.4 MB/s 2023-08-17T00:11:23.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0321846 s, 32.6 MB/s 2023-08-17T00:11:23.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.244 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224296 s, 46.7 MB/s 2023-08-17T00:11:23.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235218 s, 44.6 MB/s 2023-08-17T00:11:23.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.303 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.303 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261426 s, 40.1 MB/s 2023-08-17T00:11:23.329 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.330 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226766 s, 46.2 MB/s 2023-08-17T00:11:23.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.357 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223924 s, 46.8 MB/s 2023-08-17T00:11:23.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.384 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022981 s, 45.6 MB/s 2023-08-17T00:11:23.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.415 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282905 s, 37.1 MB/s 2023-08-17T00:11:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.442 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217495 s, 48.2 MB/s 2023-08-17T00:11:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.464 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191531 s, 54.7 MB/s 2023-08-17T00:11:23.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.486 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.486 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195144 s, 53.7 MB/s 2023-08-17T00:11:23.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.513 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239858 s, 43.7 MB/s 2023-08-17T00:11:23.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.540 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227824 s, 46.0 MB/s 2023-08-17T00:11:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.564 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.565 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215675 s, 48.6 MB/s 2023-08-17T00:11:23.588 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.589 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204301 s, 51.3 MB/s 2023-08-17T00:11:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.613 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211731 s, 49.5 MB/s 2023-08-17T00:11:23.641 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.641 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.641 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237701 s, 44.1 MB/s 2023-08-17T00:11:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212696 s, 49.3 MB/s 2023-08-17T00:11:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.698 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028803 s, 36.4 MB/s 2023-08-17T00:11:23.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.732 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296176 s, 35.4 MB/s 2023-08-17T00:11:23.759 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.760 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230517 s, 45.5 MB/s 2023-08-17T00:11:23.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192968 s, 54.3 MB/s 2023-08-17T00:11:23.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:23.786 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:23.786 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:23.787 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.20 2023-08-17T00:11:23.787 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:23.787 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:23.788 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:23.788 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.846 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258081 s, 40.6 MB/s 2023-08-17T00:11:23.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.877 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261564 s, 40.1 MB/s 2023-08-17T00:11:23.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.904 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234313 s, 44.8 MB/s 2023-08-17T00:11:23.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.931 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234817 s, 44.7 MB/s 2023-08-17T00:11:23.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.957 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217108 s, 48.3 MB/s 2023-08-17T00:11:23.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:23.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:23.987 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255153 s, 41.1 MB/s 2023-08-17T00:11:24.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274561 s, 38.2 MB/s 2023-08-17T00:11:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.039 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169991 s, 61.7 MB/s 2023-08-17T00:11:24.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.060 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174628 s, 60.0 MB/s 2023-08-17T00:11:24.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.089 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251346 s, 41.7 MB/s 2023-08-17T00:11:24.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.121 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269048 s, 39.0 MB/s 2023-08-17T00:11:24.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.148 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.148 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023192 s, 45.2 MB/s 2023-08-17T00:11:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236181 s, 44.4 MB/s 2023-08-17T00:11:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201521 s, 52.0 MB/s 2023-08-17T00:11:24.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.227 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253291 s, 41.4 MB/s 2023-08-17T00:11:24.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.252 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212303 s, 49.4 MB/s 2023-08-17T00:11:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202 s, 51.9 MB/s 2023-08-17T00:11:24.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.299 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201014 s, 52.2 MB/s 2023-08-17T00:11:24.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.324 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.324 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198963 s, 52.7 MB/s 2023-08-17T00:11:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.350 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220216 s, 47.6 MB/s 2023-08-17T00:11:24.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.379 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250202 s, 41.9 MB/s 2023-08-17T00:11:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220986 s, 47.4 MB/s 2023-08-17T00:11:24.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.434 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243285 s, 43.1 MB/s 2023-08-17T00:11:24.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.464 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262755 s, 39.9 MB/s 2023-08-17T00:11:24.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226214 s, 46.4 MB/s 2023-08-17T00:11:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287557 s, 36.5 MB/s 2023-08-17T00:11:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238389 s, 44.0 MB/s 2023-08-17T00:11:24.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.578 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225323 s, 46.5 MB/s 2023-08-17T00:11:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.601 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205171 s, 51.1 MB/s 2023-08-17T00:11:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.629 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212375 s, 49.4 MB/s 2023-08-17T00:11:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264867 s, 39.6 MB/s 2023-08-17T00:11:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239276 s, 43.8 MB/s 2023-08-17T00:11:24.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:24.687 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:24.688 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:24.688 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.21 2023-08-17T00:11:24.689 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:24.689 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:24.690 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:24.690 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:24.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.746 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232245 s, 45.1 MB/s 2023-08-17T00:11:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.780 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296571 s, 35.4 MB/s 2023-08-17T00:11:24.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025233 s, 41.6 MB/s 2023-08-17T00:11:24.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289199 s, 36.3 MB/s 2023-08-17T00:11:24.871 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.872 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023716 s, 44.2 MB/s 2023-08-17T00:11:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282445 s, 37.1 MB/s 2023-08-17T00:11:24.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.930 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220727 s, 47.5 MB/s 2023-08-17T00:11:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.955 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216703 s, 48.4 MB/s 2023-08-17T00:11:24.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:24.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:24.988 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277469 s, 37.8 MB/s 2023-08-17T00:11:25.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.016 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022987 s, 45.6 MB/s 2023-08-17T00:11:25.046 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.046 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.046 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271004 s, 38.7 MB/s 2023-08-17T00:11:25.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308605 s, 34.0 MB/s 2023-08-17T00:11:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253471 s, 41.4 MB/s 2023-08-17T00:11:25.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.132 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018272 s, 57.4 MB/s 2023-08-17T00:11:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261441 s, 40.1 MB/s 2023-08-17T00:11:25.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.198 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320686 s, 32.7 MB/s 2023-08-17T00:11:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.226 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234338 s, 44.7 MB/s 2023-08-17T00:11:25.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251114 s, 41.8 MB/s 2023-08-17T00:11:25.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.284 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243548 s, 43.1 MB/s 2023-08-17T00:11:25.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.316 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280966 s, 37.3 MB/s 2023-08-17T00:11:25.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224678 s, 46.7 MB/s 2023-08-17T00:11:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205437 s, 51.0 MB/s 2023-08-17T00:11:25.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.399 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.399 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029457 s, 35.6 MB/s 2023-08-17T00:11:25.423 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.423 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.424 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019711 s, 53.2 MB/s 2023-08-17T00:11:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.454 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269909 s, 38.8 MB/s 2023-08-17T00:11:25.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.484 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.484 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279022 s, 37.6 MB/s 2023-08-17T00:11:25.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.512 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236391 s, 44.4 MB/s 2023-08-17T00:11:25.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.542 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256833 s, 40.8 MB/s 2023-08-17T00:11:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232668 s, 45.1 MB/s 2023-08-17T00:11:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.600 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264022 s, 39.7 MB/s 2023-08-17T00:11:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230007 s, 45.6 MB/s 2023-08-17T00:11:25.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.652 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.652 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233899 s, 44.8 MB/s 2023-08-17T00:11:25.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:25.654 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:25.654 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:25.654 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.22 2023-08-17T00:11:25.655 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:25.655 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:25.655 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:25.656 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:25.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.709 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241135 s, 43.5 MB/s 2023-08-17T00:11:25.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.737 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241878 s, 43.4 MB/s 2023-08-17T00:11:25.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278326 s, 37.7 MB/s 2023-08-17T00:11:25.798 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.798 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.798 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251445 s, 41.7 MB/s 2023-08-17T00:11:25.824 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.825 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230338 s, 45.5 MB/s 2023-08-17T00:11:25.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.851 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225663 s, 46.5 MB/s 2023-08-17T00:11:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023527 s, 44.6 MB/s 2023-08-17T00:11:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.907 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257352 s, 40.7 MB/s 2023-08-17T00:11:25.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234712 s, 44.7 MB/s 2023-08-17T00:11:25.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.965 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272446 s, 38.5 MB/s 2023-08-17T00:11:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:25.994 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243493 s, 43.1 MB/s 2023-08-17T00:11:26.018 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217219 s, 48.3 MB/s 2023-08-17T00:11:26.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.048 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243104 s, 43.1 MB/s 2023-08-17T00:11:26.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.076 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024128 s, 43.5 MB/s 2023-08-17T00:11:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237084 s, 44.2 MB/s 2023-08-17T00:11:26.139 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.139 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.139 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0305575 s, 34.3 MB/s 2023-08-17T00:11:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216027 s, 48.5 MB/s 2023-08-17T00:11:26.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210329 s, 49.9 MB/s 2023-08-17T00:11:26.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023246 s, 45.1 MB/s 2023-08-17T00:11:26.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332807 s, 31.5 MB/s 2023-08-17T00:11:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.288 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283775 s, 37.0 MB/s 2023-08-17T00:11:26.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.311 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019401 s, 54.0 MB/s 2023-08-17T00:11:26.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.338 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.338 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226335 s, 46.3 MB/s 2023-08-17T00:11:26.367 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.368 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264531 s, 39.6 MB/s 2023-08-17T00:11:26.393 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.393 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.393 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224471 s, 46.7 MB/s 2023-08-17T00:11:26.428 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.429 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.429 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0324017 s, 32.4 MB/s 2023-08-17T00:11:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.455 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222341 s, 47.2 MB/s 2023-08-17T00:11:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.479 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.479 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208352 s, 50.3 MB/s 2023-08-17T00:11:26.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.508 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247583 s, 42.4 MB/s 2023-08-17T00:11:26.548 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.548 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.549 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0369646 s, 28.4 MB/s 2023-08-17T00:11:26.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.578 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250311 s, 41.9 MB/s 2023-08-17T00:11:26.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.606 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239314 s, 43.8 MB/s 2023-08-17T00:11:26.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:26.607 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:26.608 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:26.608 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.23 2023-08-17T00:11:26.608 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:26.609 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:26.609 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:26.609 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:26.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.668 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026745 s, 39.2 MB/s 2023-08-17T00:11:26.697 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.698 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258383 s, 40.6 MB/s 2023-08-17T00:11:26.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.726 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235178 s, 44.6 MB/s 2023-08-17T00:11:26.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.759 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.759 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284101 s, 36.9 MB/s 2023-08-17T00:11:26.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.783 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205882 s, 50.9 MB/s 2023-08-17T00:11:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237995 s, 44.1 MB/s 2023-08-17T00:11:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.835 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020911 s, 50.1 MB/s 2023-08-17T00:11:26.861 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.862 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.862 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236167 s, 44.4 MB/s 2023-08-17T00:11:26.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.888 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022697 s, 46.2 MB/s 2023-08-17T00:11:26.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025832 s, 40.6 MB/s 2023-08-17T00:11:26.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.947 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248376 s, 42.2 MB/s 2023-08-17T00:11:26.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.972 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.972 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208553 s, 50.3 MB/s 2023-08-17T00:11:26.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:26.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:26.997 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207671 s, 50.5 MB/s 2023-08-17T00:11:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322961 s, 32.5 MB/s 2023-08-17T00:11:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253176 s, 41.4 MB/s 2023-08-17T00:11:27.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.090 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224205 s, 46.8 MB/s 2023-08-17T00:11:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024037 s, 43.6 MB/s 2023-08-17T00:11:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.145 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233586 s, 44.9 MB/s 2023-08-17T00:11:27.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.176 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254177 s, 41.3 MB/s 2023-08-17T00:11:27.203 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.203 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.204 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248033 s, 42.3 MB/s 2023-08-17T00:11:27.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.230 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235293 s, 44.6 MB/s 2023-08-17T00:11:27.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.257 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227265 s, 46.1 MB/s 2023-08-17T00:11:27.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243691 s, 43.0 MB/s 2023-08-17T00:11:27.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.312 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.312 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225917 s, 46.4 MB/s 2023-08-17T00:11:27.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.338 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.338 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218047 s, 48.1 MB/s 2023-08-17T00:11:27.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.369 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271384 s, 38.6 MB/s 2023-08-17T00:11:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229674 s, 45.7 MB/s 2023-08-17T00:11:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219143 s, 47.8 MB/s 2023-08-17T00:11:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.451 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261675 s, 40.1 MB/s 2023-08-17T00:11:27.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.477 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212495 s, 49.3 MB/s 2023-08-17T00:11:27.506 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.506 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.506 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255006 s, 41.1 MB/s 2023-08-17T00:11:27.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213138 s, 49.2 MB/s 2023-08-17T00:11:27.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:27.534 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:27.534 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:27.534 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.24 2023-08-17T00:11:27.535 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:27.535 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:27.535 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:27.535 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:27.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237408 s, 44.2 MB/s 2023-08-17T00:11:27.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.626 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270244 s, 38.8 MB/s 2023-08-17T00:11:27.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210758 s, 49.8 MB/s 2023-08-17T00:11:27.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262378 s, 40.0 MB/s 2023-08-17T00:11:27.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.708 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220863 s, 47.5 MB/s 2023-08-17T00:11:27.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.741 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283868 s, 36.9 MB/s 2023-08-17T00:11:27.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239832 s, 43.7 MB/s 2023-08-17T00:11:27.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206035 s, 50.9 MB/s 2023-08-17T00:11:27.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.820 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023348 s, 44.9 MB/s 2023-08-17T00:11:27.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.846 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221543 s, 47.3 MB/s 2023-08-17T00:11:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.879 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288076 s, 36.4 MB/s 2023-08-17T00:11:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213666 s, 49.1 MB/s 2023-08-17T00:11:27.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.931 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242244 s, 43.3 MB/s 2023-08-17T00:11:27.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.966 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.966 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308589 s, 34.0 MB/s 2023-08-17T00:11:27.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:27.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:27.992 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225883 s, 46.4 MB/s 2023-08-17T00:11:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240174 s, 43.7 MB/s 2023-08-17T00:11:28.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.052 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270996 s, 38.7 MB/s 2023-08-17T00:11:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.080 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237026 s, 44.2 MB/s 2023-08-17T00:11:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.101 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189039 s, 55.5 MB/s 2023-08-17T00:11:28.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315794 s, 33.2 MB/s 2023-08-17T00:11:28.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199258 s, 52.6 MB/s 2023-08-17T00:11:28.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.195 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308727 s, 34.0 MB/s 2023-08-17T00:11:28.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.234 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.234 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0333451 s, 31.4 MB/s 2023-08-17T00:11:28.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302499 s, 34.7 MB/s 2023-08-17T00:11:28.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.294 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206864 s, 50.7 MB/s 2023-08-17T00:11:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.321 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223398 s, 46.9 MB/s 2023-08-17T00:11:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233009 s, 45.0 MB/s 2023-08-17T00:11:28.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236878 s, 44.3 MB/s 2023-08-17T00:11:28.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.402 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.402 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220795 s, 47.5 MB/s 2023-08-17T00:11:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.425 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.425 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208681 s, 50.2 MB/s 2023-08-17T00:11:28.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.448 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199459 s, 52.6 MB/s 2023-08-17T00:11:28.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.473 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218302 s, 48.0 MB/s 2023-08-17T00:11:28.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:28.476 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:28.477 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:28.477 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.25 2023-08-17T00:11:28.478 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:28.479 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:28.479 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:28.480 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:28.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.544 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277554 s, 37.8 MB/s 2023-08-17T00:11:28.573 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.574 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274063 s, 38.3 MB/s 2023-08-17T00:11:28.603 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.603 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.603 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025159 s, 41.7 MB/s 2023-08-17T00:11:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.633 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257307 s, 40.8 MB/s 2023-08-17T00:11:28.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.661 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225301 s, 46.5 MB/s 2023-08-17T00:11:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.693 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294408 s, 35.6 MB/s 2023-08-17T00:11:28.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.716 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.716 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193663 s, 54.1 MB/s 2023-08-17T00:11:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307891 s, 34.1 MB/s 2023-08-17T00:11:28.775 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.775 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.775 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193266 s, 54.3 MB/s 2023-08-17T00:11:28.800 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214328 s, 48.9 MB/s 2023-08-17T00:11:28.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.829 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237782 s, 44.1 MB/s 2023-08-17T00:11:28.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.864 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300808 s, 34.9 MB/s 2023-08-17T00:11:28.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.894 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272122 s, 38.5 MB/s 2023-08-17T00:11:28.922 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.922 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.923 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245189 s, 42.8 MB/s 2023-08-17T00:11:28.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225267 s, 46.5 MB/s 2023-08-17T00:11:28.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:28.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:28.978 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248884 s, 42.1 MB/s 2023-08-17T00:11:29.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.006 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.006 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226273 s, 46.3 MB/s 2023-08-17T00:11:29.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.030 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220212 s, 47.6 MB/s 2023-08-17T00:11:29.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.056 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.056 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022004 s, 47.7 MB/s 2023-08-17T00:11:29.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.082 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220742 s, 47.5 MB/s 2023-08-17T00:11:29.109 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.109 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.109 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234044 s, 44.8 MB/s 2023-08-17T00:11:29.135 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.136 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226891 s, 46.2 MB/s 2023-08-17T00:11:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.163 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.164 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228515 s, 45.9 MB/s 2023-08-17T00:11:29.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.195 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266382 s, 39.4 MB/s 2023-08-17T00:11:29.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.224 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244913 s, 42.8 MB/s 2023-08-17T00:11:29.250 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.251 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229329 s, 45.7 MB/s 2023-08-17T00:11:29.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.283 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280227 s, 37.4 MB/s 2023-08-17T00:11:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241532 s, 43.4 MB/s 2023-08-17T00:11:29.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.337 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231232 s, 45.3 MB/s 2023-08-17T00:11:29.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.366 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.366 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243282 s, 43.1 MB/s 2023-08-17T00:11:29.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.402 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.402 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0317339 s, 33.0 MB/s 2023-08-17T00:11:29.429 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.429 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.429 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022994 s, 45.6 MB/s 2023-08-17T00:11:29.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:29.431 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:29.432 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:29.432 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.26 2023-08-17T00:11:29.432 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:29.433 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:29.433 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:29.433 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:29.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.489 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257476 s, 40.7 MB/s 2023-08-17T00:11:29.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217605 s, 48.2 MB/s 2023-08-17T00:11:29.536 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.536 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.536 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191277 s, 54.8 MB/s 2023-08-17T00:11:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237055 s, 44.2 MB/s 2023-08-17T00:11:29.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.591 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233375 s, 44.9 MB/s 2023-08-17T00:11:29.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.618 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222345 s, 47.2 MB/s 2023-08-17T00:11:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.643 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225223 s, 46.6 MB/s 2023-08-17T00:11:29.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.669 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218646 s, 48.0 MB/s 2023-08-17T00:11:29.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.690 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170749 s, 61.4 MB/s 2023-08-17T00:11:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.717 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215314 s, 48.7 MB/s 2023-08-17T00:11:29.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.737 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185851 s, 56.4 MB/s 2023-08-17T00:11:29.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284077 s, 36.9 MB/s 2023-08-17T00:11:29.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215758 s, 48.6 MB/s 2023-08-17T00:11:29.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.823 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242543 s, 43.2 MB/s 2023-08-17T00:11:29.854 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288593 s, 36.3 MB/s 2023-08-17T00:11:29.879 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.879 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.879 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216047 s, 48.5 MB/s 2023-08-17T00:11:29.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225298 s, 46.5 MB/s 2023-08-17T00:11:29.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.926 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184061 s, 57.0 MB/s 2023-08-17T00:11:29.953 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.953 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.953 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245048 s, 42.8 MB/s 2023-08-17T00:11:29.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:29.980 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:29.980 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225938 s, 46.4 MB/s 2023-08-17T00:11:30.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.004 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.004 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210964 s, 49.7 MB/s 2023-08-17T00:11:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.032 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024909 s, 42.1 MB/s 2023-08-17T00:11:30.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.057 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219972 s, 47.7 MB/s 2023-08-17T00:11:30.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.085 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234592 s, 44.7 MB/s 2023-08-17T00:11:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195776 s, 53.6 MB/s 2023-08-17T00:11:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.133 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194377 s, 53.9 MB/s 2023-08-17T00:11:30.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.157 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.157 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246819 s, 42.5 MB/s 2023-08-17T00:11:30.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.185 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02333 s, 44.9 MB/s 2023-08-17T00:11:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254133 s, 41.3 MB/s 2023-08-17T00:11:30.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.244 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.244 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247003 s, 42.5 MB/s 2023-08-17T00:11:30.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.271 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220929 s, 47.5 MB/s 2023-08-17T00:11:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235752 s, 44.5 MB/s 2023-08-17T00:11:30.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:30.300 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:30.300 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:30.301 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.27 2023-08-17T00:11:30.301 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:30.301 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:30.302 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:30.302 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.360 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.361 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268032 s, 39.1 MB/s 2023-08-17T00:11:30.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206083 s, 50.9 MB/s 2023-08-17T00:11:30.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.416 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259191 s, 40.5 MB/s 2023-08-17T00:11:30.444 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.445 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024921 s, 42.1 MB/s 2023-08-17T00:11:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.476 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.477 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280136 s, 37.4 MB/s 2023-08-17T00:11:30.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.504 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230672 s, 45.5 MB/s 2023-08-17T00:11:30.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.534 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267151 s, 39.3 MB/s 2023-08-17T00:11:30.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.562 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.562 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218988 s, 47.9 MB/s 2023-08-17T00:11:30.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.587 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233044 s, 45.0 MB/s 2023-08-17T00:11:30.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.617 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255052 s, 41.1 MB/s 2023-08-17T00:11:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.645 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241215 s, 43.5 MB/s 2023-08-17T00:11:30.676 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.676 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.677 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232231 s, 45.2 MB/s 2023-08-17T00:11:30.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.705 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271339 s, 38.6 MB/s 2023-08-17T00:11:30.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.741 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0323282 s, 32.4 MB/s 2023-08-17T00:11:30.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.773 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.773 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278553 s, 37.6 MB/s 2023-08-17T00:11:30.804 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.804 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.804 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274721 s, 38.2 MB/s 2023-08-17T00:11:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247257 s, 42.4 MB/s 2023-08-17T00:11:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.858 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220868 s, 47.5 MB/s 2023-08-17T00:11:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.887 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255394 s, 41.1 MB/s 2023-08-17T00:11:30.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.915 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024365 s, 43.0 MB/s 2023-08-17T00:11:30.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.943 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025156 s, 41.7 MB/s 2023-08-17T00:11:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.968 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199218 s, 52.6 MB/s 2023-08-17T00:11:30.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:30.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:30.992 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198973 s, 52.7 MB/s 2023-08-17T00:11:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022098 s, 47.5 MB/s 2023-08-17T00:11:31.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229277 s, 45.7 MB/s 2023-08-17T00:11:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279105 s, 37.6 MB/s 2023-08-17T00:11:31.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.106 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257928 s, 40.7 MB/s 2023-08-17T00:11:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022601 s, 46.4 MB/s 2023-08-17T00:11:31.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.160 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227624 s, 46.1 MB/s 2023-08-17T00:11:31.186 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.186 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.187 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225318 s, 46.5 MB/s 2023-08-17T00:11:31.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.212 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228326 s, 45.9 MB/s 2023-08-17T00:11:31.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.241 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252446 s, 41.5 MB/s 2023-08-17T00:11:31.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:31.243 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:31.243 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:31.243 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.28 2023-08-17T00:11:31.244 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:31.244 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:31.244 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:31.244 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:31.292 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.292 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.292 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199453 s, 52.6 MB/s 2023-08-17T00:11:31.324 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.324 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.324 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271254 s, 38.7 MB/s 2023-08-17T00:11:31.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.353 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252567 s, 41.5 MB/s 2023-08-17T00:11:31.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.385 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268207 s, 39.1 MB/s 2023-08-17T00:11:31.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.411 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223244 s, 47.0 MB/s 2023-08-17T00:11:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.437 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218131 s, 48.1 MB/s 2023-08-17T00:11:31.465 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247453 s, 42.4 MB/s 2023-08-17T00:11:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023106 s, 45.4 MB/s 2023-08-17T00:11:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271295 s, 38.7 MB/s 2023-08-17T00:11:31.553 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.554 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256949 s, 40.8 MB/s 2023-08-17T00:11:31.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.582 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247549 s, 42.4 MB/s 2023-08-17T00:11:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.616 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314031 s, 33.4 MB/s 2023-08-17T00:11:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.645 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250053 s, 41.9 MB/s 2023-08-17T00:11:31.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.672 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220161 s, 47.6 MB/s 2023-08-17T00:11:31.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.699 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243509 s, 43.1 MB/s 2023-08-17T00:11:31.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.727 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.727 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242694 s, 43.2 MB/s 2023-08-17T00:11:31.753 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.753 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.753 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222927 s, 47.0 MB/s 2023-08-17T00:11:31.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.775 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180409 s, 58.1 MB/s 2023-08-17T00:11:31.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.805 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264196 s, 39.7 MB/s 2023-08-17T00:11:31.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.832 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226334 s, 46.3 MB/s 2023-08-17T00:11:31.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.868 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031619 s, 33.2 MB/s 2023-08-17T00:11:31.892 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.893 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020631 s, 50.8 MB/s 2023-08-17T00:11:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.918 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217223 s, 48.3 MB/s 2023-08-17T00:11:31.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.949 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275768 s, 38.0 MB/s 2023-08-17T00:11:31.981 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:31.982 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:31.982 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291948 s, 35.9 MB/s 2023-08-17T00:11:32.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.011 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246702 s, 42.5 MB/s 2023-08-17T00:11:32.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027115 s, 38.7 MB/s 2023-08-17T00:11:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234312 s, 44.8 MB/s 2023-08-17T00:11:32.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.099 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.099 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252822 s, 41.5 MB/s 2023-08-17T00:11:32.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.125 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215303 s, 48.7 MB/s 2023-08-17T00:11:32.148 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.149 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210183 s, 49.9 MB/s 2023-08-17T00:11:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.177 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251746 s, 41.7 MB/s 2023-08-17T00:11:32.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:32.179 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:32.180 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:32.180 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.29 2023-08-17T00:11:32.181 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:32.181 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:32.182 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:32.182 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:32.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.241 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232005 s, 45.2 MB/s 2023-08-17T00:11:32.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226859 s, 46.2 MB/s 2023-08-17T00:11:32.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.295 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247218 s, 42.4 MB/s 2023-08-17T00:11:32.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.321 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229356 s, 45.7 MB/s 2023-08-17T00:11:32.347 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.348 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227434 s, 46.1 MB/s 2023-08-17T00:11:32.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.376 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236735 s, 44.3 MB/s 2023-08-17T00:11:32.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.402 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.402 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219186 s, 47.8 MB/s 2023-08-17T00:11:32.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.432 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254784 s, 41.2 MB/s 2023-08-17T00:11:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.459 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231001 s, 45.4 MB/s 2023-08-17T00:11:32.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.482 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205846 s, 50.9 MB/s 2023-08-17T00:11:32.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.512 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249029 s, 42.1 MB/s 2023-08-17T00:11:32.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.538 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215752 s, 48.6 MB/s 2023-08-17T00:11:32.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018954 s, 55.3 MB/s 2023-08-17T00:11:32.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.586 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215005 s, 48.8 MB/s 2023-08-17T00:11:32.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.616 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279483 s, 37.5 MB/s 2023-08-17T00:11:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254728 s, 41.2 MB/s 2023-08-17T00:11:32.677 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.678 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280452 s, 37.4 MB/s 2023-08-17T00:11:32.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.704 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220342 s, 47.6 MB/s 2023-08-17T00:11:32.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.733 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247894 s, 42.3 MB/s 2023-08-17T00:11:32.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269219 s, 38.9 MB/s 2023-08-17T00:11:32.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243314 s, 43.1 MB/s 2023-08-17T00:11:32.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.821 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241208 s, 43.5 MB/s 2023-08-17T00:11:32.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245343 s, 42.7 MB/s 2023-08-17T00:11:32.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.877 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235184 s, 44.6 MB/s 2023-08-17T00:11:32.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.909 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286185 s, 36.6 MB/s 2023-08-17T00:11:32.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234923 s, 44.6 MB/s 2023-08-17T00:11:32.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.962 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212476 s, 49.4 MB/s 2023-08-17T00:11:32.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:32.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:32.986 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202697 s, 51.7 MB/s 2023-08-17T00:11:33.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.013 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226004 s, 46.4 MB/s 2023-08-17T00:11:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266835 s, 39.3 MB/s 2023-08-17T00:11:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.072 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242808 s, 43.2 MB/s 2023-08-17T00:11:33.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.092 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017546 s, 59.8 MB/s 2023-08-17T00:11:33.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:33.094 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:33.094 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:33.095 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.30 2023-08-17T00:11:33.095 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:33.095 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:33.095 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:33.096 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:33.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.152 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230726 s, 45.4 MB/s 2023-08-17T00:11:33.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.180 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244037 s, 43.0 MB/s 2023-08-17T00:11:33.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.218 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0334692 s, 31.3 MB/s 2023-08-17T00:11:33.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.248 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025694 s, 40.8 MB/s 2023-08-17T00:11:33.267 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175319 s, 59.8 MB/s 2023-08-17T00:11:33.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.297 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.297 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252354 s, 41.6 MB/s 2023-08-17T00:11:33.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.323 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231448 s, 45.3 MB/s 2023-08-17T00:11:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.350 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227623 s, 46.1 MB/s 2023-08-17T00:11:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.379 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249397 s, 42.0 MB/s 2023-08-17T00:11:33.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.406 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219252 s, 47.8 MB/s 2023-08-17T00:11:33.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.431 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219693 s, 47.7 MB/s 2023-08-17T00:11:33.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223936 s, 46.8 MB/s 2023-08-17T00:11:33.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246459 s, 42.5 MB/s 2023-08-17T00:11:33.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.516 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262857 s, 39.9 MB/s 2023-08-17T00:11:33.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.544 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240185 s, 43.7 MB/s 2023-08-17T00:11:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.571 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229766 s, 45.6 MB/s 2023-08-17T00:11:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.596 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021716 s, 48.3 MB/s 2023-08-17T00:11:33.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.632 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.632 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322389 s, 32.5 MB/s 2023-08-17T00:11:33.659 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.659 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.659 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240174 s, 43.7 MB/s 2023-08-17T00:11:33.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.682 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.682 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202566 s, 51.8 MB/s 2023-08-17T00:11:33.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.707 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196227 s, 53.4 MB/s 2023-08-17T00:11:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.734 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246991 s, 42.5 MB/s 2023-08-17T00:11:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.760 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229471 s, 45.7 MB/s 2023-08-17T00:11:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232994 s, 45.0 MB/s 2023-08-17T00:11:33.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.817 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265176 s, 39.5 MB/s 2023-08-17T00:11:33.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280341 s, 37.4 MB/s 2023-08-17T00:11:33.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201469 s, 52.0 MB/s 2023-08-17T00:11:33.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.904 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271206 s, 38.7 MB/s 2023-08-17T00:11:33.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255201 s, 41.1 MB/s 2023-08-17T00:11:33.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.960 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229907 s, 45.6 MB/s 2023-08-17T00:11:33.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:33.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255979 s, 41.0 MB/s 2023-08-17T00:11:34.014 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.015 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211601 s, 49.6 MB/s 2023-08-17T00:11:34.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:34.017 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:11:34.017 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:11:34.017 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.31 2023-08-17T00:11:34.018 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:11:34.018 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:11:34.018 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:11:34.018 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:11:34.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.077 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244984 s, 42.8 MB/s 2023-08-17T00:11:34.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252613 s, 41.5 MB/s 2023-08-17T00:11:34.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021013 s, 49.9 MB/s 2023-08-17T00:11:34.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025871 s, 40.5 MB/s 2023-08-17T00:11:34.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.191 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261334 s, 40.1 MB/s 2023-08-17T00:11:34.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.223 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292259 s, 35.9 MB/s 2023-08-17T00:11:34.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.252 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226342 s, 46.3 MB/s 2023-08-17T00:11:34.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.276 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221573 s, 47.3 MB/s 2023-08-17T00:11:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.305 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249002 s, 42.1 MB/s 2023-08-17T00:11:34.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241895 s, 43.3 MB/s 2023-08-17T00:11:34.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.361 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249401 s, 42.0 MB/s 2023-08-17T00:11:34.386 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.387 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219807 s, 47.7 MB/s 2023-08-17T00:11:34.417 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.417 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.417 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265822 s, 39.4 MB/s 2023-08-17T00:11:34.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.452 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296772 s, 35.3 MB/s 2023-08-17T00:11:34.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.478 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221545 s, 47.3 MB/s 2023-08-17T00:11:34.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.510 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028874 s, 36.3 MB/s 2023-08-17T00:11:34.536 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.537 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233475 s, 44.9 MB/s 2023-08-17T00:11:34.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.558 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0178255 s, 58.8 MB/s 2023-08-17T00:11:34.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.590 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277782 s, 37.7 MB/s 2023-08-17T00:11:34.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.617 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222381 s, 47.2 MB/s 2023-08-17T00:11:34.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.645 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236254 s, 44.4 MB/s 2023-08-17T00:11:34.672 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.672 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.673 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242906 s, 43.2 MB/s 2023-08-17T00:11:34.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.703 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262101 s, 40.0 MB/s 2023-08-17T00:11:34.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.731 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239495 s, 43.8 MB/s 2023-08-17T00:11:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259251 s, 40.4 MB/s 2023-08-17T00:11:34.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.794 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291595 s, 36.0 MB/s 2023-08-17T00:11:34.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233173 s, 45.0 MB/s 2023-08-17T00:11:34.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.851 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260251 s, 40.3 MB/s 2023-08-17T00:11:34.881 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.882 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268822 s, 39.0 MB/s 2023-08-17T00:11:34.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205486 s, 51.0 MB/s 2023-08-17T00:11:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.933 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240936 s, 43.5 MB/s 2023-08-17T00:11:34.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:11:34.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:11:34.957 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203147 s, 51.6 MB/s 2023-08-17T00:11:34.959 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start /scrub_control_test_path recursive 2023-08-17T00:11:35.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.118+0000 7f3a99969700 1 Processor -- start 2023-08-17T00:11:35.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.118+0000 7f3a99969700 1 -- start start 2023-08-17T00:11:35.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a941537a0 0x7f3a94158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3a94153b80 0x7f3a94157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a94061fa0 con 0x7f3a94064e40 2023-08-17T00:11:35.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a94153ff0 con 0x7f3a941537a0 2023-08-17T00:11:35.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a94062560 con 0x7f3a94153b80 2023-08-17T00:11:35.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a941537a0 0x7f3a94158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a941537a0 0x7f3a94158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43682/0 (socket says 172.21.15.153:43682) 2023-08-17T00:11:35.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 -- 172.21.15.153:0/212517371 learned_addr learned my addr 172.21.15.153:0/212517371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a937fe700 1 --2- 172.21.15.153:0/212517371 >> v2:172.21.15.178:3300/0 conn(0x7f3a94153b80 0x7f3a94157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 -- 172.21.15.153:0/212517371 >> v2:172.21.15.178:3300/0 conn(0x7f3a94153b80 msgr2=0x7f3a94157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/212517371 >> v2:172.21.15.178:3300/0 conn(0x7f3a94153b80 0x7f3a94157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 -- 172.21.15.153:0/212517371 >> v1:172.21.15.178:6789/0 conn(0x7f3a94064e40 legacy=0x7f3a940c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a91ffb700 1 -- 172.21.15.153:0/212517371 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512952627 0 0) 0x7f3a94061fa0 con 0x7f3a94064e40 2023-08-17T00:11:35.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 -- 172.21.15.153:0/212517371 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940c5f90 con 0x7f3a941537a0 2023-08-17T00:11:35.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/212517371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a941537a0 0x7f3a94158240 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f3a94064c10 tx=0x7f3a840090f0).ready entity=mon.0 client_cookie=2a0ef1254db85222 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a91ffb700 1 -- 172.21.15.153:0/212517371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400b520 con 0x7f3a941537a0 2023-08-17T00:11:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a91ffb700 1 -- 172.21.15.153:0/212517371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8400b680 con 0x7f3a941537a0 2023-08-17T00:11:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a91ffb700 1 -- 172.21.15.153:0/212517371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8400ba20 con 0x7f3a941537a0 2023-08-17T00:11:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 -- 172.21.15.153:0/212517371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a941537a0 msgr2=0x7f3a94158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.122+0000 7f3a99969700 1 --2- 172.21.15.153:0/212517371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a941537a0 0x7f3a94158240 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f3a94064c10 tx=0x7f3a840090f0).stop 2023-08-17T00:11:35.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 -- 172.21.15.153:0/212517371 shutdown_connections 2023-08-17T00:11:35.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 --2- 172.21.15.153:0/212517371 >> v2:172.21.15.178:3300/0 conn(0x7f3a94153b80 0x7f3a94157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 --2- 172.21.15.153:0/212517371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a941537a0 0x7f3a94158240 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 -- 172.21.15.153:0/212517371 >> 172.21.15.153:0/212517371 conn(0x7f3a940c7090 msgr2=0x7f3a940c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 -- 172.21.15.153:0/212517371 shutdown_connections 2023-08-17T00:11:35.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 -- 172.21.15.153:0/212517371 wait complete. 2023-08-17T00:11:35.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 Processor -- start 2023-08-17T00:11:35.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.126+0000 7f3a99969700 1 -- start start 2023-08-17T00:11:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a94064e40 0x7f3a940a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a94153b80 0x7f3a9413bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 0x7f3a940a3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9413bbc0 con 0x7f3a9413c2c0 2023-08-17T00:11:35.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9413d4a0 con 0x7f3a94153b80 2023-08-17T00:11:35.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9414d540 con 0x7f3a94064e40 2023-08-17T00:11:35.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 0x7f3a940a3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 0x7f3a940a3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43694/0 (socket says 172.21.15.153:43694) 2023-08-17T00:11:35.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 -- 172.21.15.153:0/3120645120 learned_addr learned my addr 172.21.15.153:0/3120645120 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a94064e40 0x7f3a940a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a927fc700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a94153b80 0x7f3a9413bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 -- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a94064e40 msgr2=0x7f3a940a6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a94064e40 0x7f3a940a6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 -- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a94153b80 msgr2=0x7f3a9413bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a94153b80 0x7f3a9413bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 -- 172.21.15.153:0/3120645120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a84009370 con 0x7f3a9413c2c0 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a927fc700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a94153b80 0x7f3a9413bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a94064e40 0x7f3a940a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:35.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a937fe700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 0x7f3a940a3860 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f3a8c009df0 tx=0x7f3a8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a7affd700 1 -- 172.21.15.153:0/3120645120 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00cb50 con 0x7f3a9413c2c0 2023-08-17T00:11:35.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a7affd700 1 -- 172.21.15.153:0/3120645120 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c00f040 con 0x7f3a9413c2c0 2023-08-17T00:11:35.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9413c890 con 0x7f3a9413c2c0 2023-08-17T00:11:35.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a7affd700 1 -- 172.21.15.153:0/3120645120 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00cec0 con 0x7f3a9413c2c0 2023-08-17T00:11:35.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.130+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9413ce50 con 0x7f3a9413c2c0 2023-08-17T00:11:35.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.134+0000 7f3a7affd700 1 -- 172.21.15.153:0/3120645120 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3a8c013610 con 0x7f3a9413c2c0 2023-08-17T00:11:35.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.134+0000 7f3a7affd700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a8005a150 0x7f3a8005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.134+0000 7f3a7affd700 1 -- 172.21.15.153:0/3120645120 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a8c074b90 con 0x7f3a9413c2c0 2023-08-17T00:11:35.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.134+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a8005a150 0x7f3a8005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a8005a150 0x7f3a8005c610 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f3a94063af0 tx=0x7f3a84017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 Processor -- start 2023-08-17T00:11:35.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 -- start start 2023-08-17T00:11:35.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2b30570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2ae82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2ae8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a6fcc0 con 0x2b30190 2023-08-17T00:11:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ae9920 con 0x2ae87e0 2023-08-17T00:11:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b2c260 con 0x2b30a60 2023-08-17T00:11:35.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2b30570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2b30570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43702/0 (socket says 172.21.15.153:43702) 2023-08-17T00:11:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 -- 172.21.15.153:0/2198004671 learned_addr learned my addr 172.21.15.153:0/2198004671 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a937fe700 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2ae8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a927fc700 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2ae82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 -- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 msgr2=0x2ae82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2ae82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 -- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 msgr2=0x2ae8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2ae8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.138+0000 7f3a92ffd700 1 -- 172.21.15.153:0/2198004671 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a68c00 con 0x2b30190 2023-08-17T00:11:35.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2b30570 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f3a84006fd0 tx=0x7f3a8401f070).ready entity=mon.0 client_cookie=98d8e5b8ac427ace server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3a73fff700 1 -- 172.21.15.153:0/2198004671 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84006990 con 0x2b30190 2023-08-17T00:11:35.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3a73fff700 1 -- 172.21.15.153:0/2198004671 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8401d430 con 0x2b30190 2023-08-17T00:11:35.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3a73fff700 1 -- 172.21.15.153:0/2198004671 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8401d7b0 con 0x2b30190 2023-08-17T00:11:35.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2198004671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 msgr2=0x2b30570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2b30570 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7f3a84006fd0 tx=0x7f3a8401f070).stop 2023-08-17T00:11:35.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2198004671 shutdown_connections 2023-08-17T00:11:35.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2ae8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2ae82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2198004671 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2b30570 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2198004671 >> 172.21.15.153:0/2198004671 conn(0x28ce920 msgr2=0x2aef3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2198004671 shutdown_connections 2023-08-17T00:11:35.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2198004671 wait complete. 2023-08-17T00:11:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 -- start start 2023-08-17T00:11:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.142+0000 7f3aa3d40740 1 Processor -- start 2023-08-17T00:11:35.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 0x2b2efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b1a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b32310 con 0x2ae87e0 2023-08-17T00:11:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b1a8f0 con 0x2b30190 2023-08-17T00:11:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b1b170 con 0x2b30a60 2023-08-17T00:11:35.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 10 client.0 ll_register_callbacks cb 0x2a65cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 0x2b2efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 0x2b2efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43704/0 (socket says 172.21.15.153:43704) 2023-08-17T00:11:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 -- 172.21.15.153:0/704172244 learned_addr learned my addr 172.21.15.153:0/704172244 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a937fe700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a927fc700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b1a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 -- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 msgr2=0x2b2d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 -- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 msgr2=0x2b1a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b1a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 -- 172.21.15.153:0/704172244 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a940c5f90 con 0x2ae87e0 2023-08-17T00:11:35.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a927fc700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b1a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:35.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 0x2b2efd0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f3a84009130 tx=0x7f3a84028000).ready entity=mon.0 client_cookie=3ef8a1eeeebcdffa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a717fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:35.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a717fa700 1 -- 172.21.15.153:0/704172244 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8401de80 con 0x2ae87e0 2023-08-17T00:11:35.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a717fa700 1 -- 172.21.15.153:0/704172244 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a84030450 con 0x2ae87e0 2023-08-17T00:11:35.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a658e0 con 0x2ae87e0 2023-08-17T00:11:35.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a717fa700 1 -- 172.21.15.153:0/704172244 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a84030820 con 0x2ae87e0 2023-08-17T00:11:35.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 10 client.7626 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:35.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x2a640a0 con 0x2ae87e0 2023-08-17T00:11:35.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a717fa700 1 -- 172.21.15.153:0/704172244 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a658e0 con 0x2ae87e0 2023-08-17T00:11:35.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.146+0000 7f3a717fa700 1 -- 172.21.15.153:0/704172244 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3a84030980 con 0x2ae87e0 2023-08-17T00:11:35.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 10 client.7626 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:35.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 10 client.7626 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:35.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 20 client.7626 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:35.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b4bbd0 0x2b4dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 4 client.7626 mds_command: new command op to 7470 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:11:35.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a5be30 con 0x2b4bbd0 2023-08-17T00:11:35.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3a927fc700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b4bbd0 0x2b4dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3a927fc700 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b4bbd0 0x2b4dfc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7837a7d5bafac96b server_cookie=64ee262a0a6035ea in_seq=0 out_seq=0 2023-08-17T00:11:35.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3a717fa700 10 client.7626 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3a717fa700 1 -- 172.21.15.153:0/704172244 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2a5be30 con 0x2b4bbd0 2023-08-17T00:11:35.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3a717fa700 10 client.7626 handle_command_reply: tid=0 2023-08-17T00:11:35.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 client.7626 shutdown 2023-08-17T00:11:35.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 msgr2=0x2b2efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 0x2b2efd0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f3a84009130 tx=0x7f3a84028000).stop 2023-08-17T00:11:35.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 shutdown_connections 2023-08-17T00:11:35.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b4bbd0 0x2b4dfc0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b1a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/704172244 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2ae87e0 0x2b2efd0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3a717fa700 0 client.7626 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.150+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 >> 172.21.15.153:0/704172244 conn(0x28ce920 msgr2=0x2aef260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.154+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 shutdown_connections 2023-08-17T00:11:35.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.154+0000 7f3aa3d40740 1 -- 172.21.15.153:0/704172244 wait complete. 2023-08-17T00:11:35.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.154+0000 7f3aa3d40740 20 client.7626 trim_cache size 0 max 16384 2023-08-17T00:11:35.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 Processor -- start 2023-08-17T00:11:35.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 -- start start 2023-08-17T00:11:35.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2b1a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2aed710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a398e0 con 0x2b30190 2023-08-17T00:11:35.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a51a40 con 0x2ae87e0 2023-08-17T00:11:35.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a5be30 con 0x2b30a60 2023-08-17T00:11:35.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3a927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2aed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.170+0000 7f3a927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2aed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43706/0 (socket says 172.21.15.153:43706) 2023-08-17T00:11:35.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a927fc700 1 -- 172.21.15.153:0/3811327405 learned_addr learned my addr 172.21.15.153:0/3811327405 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2b1a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 -- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 msgr2=0x2b2e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 -- 172.21.15.153:0/3811327405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 msgr2=0x2aed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2aed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 -- 172.21.15.153:0/3811327405 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940a40b0 con 0x2ae87e0 2023-08-17T00:11:35.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2b1a400 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f3a840095f0 tx=0x7f3a84033040).ready entity=mon.1 client_cookie=458ea6339a49b355 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a78ff9700 1 -- 172.21.15.153:0/3811327405 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84000c40 con 0x2ae87e0 2023-08-17T00:11:35.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a78ff9700 1 -- 172.21.15.153:0/3811327405 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a84030820 con 0x2ae87e0 2023-08-17T00:11:35.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3a78ff9700 1 -- 172.21.15.153:0/3811327405 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8403a430 con 0x2ae87e0 2023-08-17T00:11:35.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 -- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 msgr2=0x2b1a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2b1a400 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f3a840095f0 tx=0x7f3a84033040).stop 2023-08-17T00:11:35.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 -- 172.21.15.153:0/3811327405 shutdown_connections 2023-08-17T00:11:35.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2b30a60 0x2b2e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30190 0x2aed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/3811327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2ae87e0 0x2b1a400 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 -- 172.21.15.153:0/3811327405 >> 172.21.15.153:0/3811327405 conn(0x28ce920 msgr2=0x2b14ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 -- 172.21.15.153:0/3811327405 shutdown_connections 2023-08-17T00:11:35.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 -- 172.21.15.153:0/3811327405 wait complete. 2023-08-17T00:11:35.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 -- start start 2023-08-17T00:11:35.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.174+0000 7f3aa3d40740 1 Processor -- start 2023-08-17T00:11:35.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ae87e0 0x2b1dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b975f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 0x2b4a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b19d80 con 0x2b30a60 2023-08-17T00:11:35.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b1e850 con 0x2b30190 2023-08-17T00:11:35.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b19b30 con 0x2ae87e0 2023-08-17T00:11:35.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 10 client.0 ll_register_callbacks cb 0x7f3a8c048530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:35.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 0x2b4a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 0x2b4a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43720/0 (socket says 172.21.15.153:43720) 2023-08-17T00:11:35.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 -- 172.21.15.153:0/2721528335 learned_addr learned my addr 172.21.15.153:0/2721528335 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a927fc700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ae87e0 0x2b1dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 -- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ae87e0 msgr2=0x2b1dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ae87e0 0x2b1dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 -- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 msgr2=0x2b975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 -- 172.21.15.153:0/2721528335 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2a640a0 con 0x2b30a60 2023-08-17T00:11:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a937fe700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 0x2b4a030 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f3a8c009d90 tx=0x7f3a8c04e040).ready entity=mon.0 client_cookie=86ac6fa52afc0a61 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a717fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a717fa700 1 -- 172.21.15.153:0/2721528335 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c056070 con 0x2b30a60 2023-08-17T00:11:35.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a8401d430 con 0x2b30a60 2023-08-17T00:11:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a717fa700 1 -- 172.21.15.153:0/2721528335 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a8c04b8f0 con 0x2b30a60 2023-08-17T00:11:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3a717fa700 1 -- 172.21.15.153:0/2721528335 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a8c051040 con 0x2b30a60 2023-08-17T00:11:35.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 10 client.7632 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.178+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x2a63df0 con 0x2b30a60 2023-08-17T00:11:35.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3a717fa700 1 -- 172.21.15.153:0/2721528335 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8401d430 con 0x2b30a60 2023-08-17T00:11:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3a717fa700 1 -- 172.21.15.153:0/2721528335 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3a8c051b20 con 0x2b30a60 2023-08-17T00:11:35.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3aa3d40740 10 client.7632 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3aa3d40740 10 client.7632 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3aa3d40740 20 client.7632 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b346e0 0x2b35950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3aa3d40740 4 client.7632 mds_command: new command op to 7470 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-08-17T00:11:35.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x29258b0 con 0x2b346e0 2023-08-17T00:11:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b346e0 0x2b35950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3a92ffd700 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b346e0 0x2b35950 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5d7498e1adf13dca server_cookie=97236c27d0982223 in_seq=0 out_seq=0 2023-08-17T00:11:35.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.182+0000 7f3a717fa700 10 client.7632 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3a717fa700 1 -- 172.21.15.153:0/2721528335 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x29258b0 con 0x2b346e0 2023-08-17T00:11:35.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3a717fa700 10 client.7632 handle_command_reply: tid=0 2023-08-17T00:11:35.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 client.7632 shutdown 2023-08-17T00:11:35.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 msgr2=0x2b4a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 0x2b4a030 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 rx=0x7f3a8c009d90 tx=0x7f3a8c04e040).stop 2023-08-17T00:11:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 shutdown_connections 2023-08-17T00:11:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2b346e0 0x2b35950 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2b30a60 0x2b4a030 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2b30190 0x2b975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 --2- 172.21.15.153:0/2721528335 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2ae87e0 0x2b1dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3a717fa700 0 client.7632 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.186+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 >> 172.21.15.153:0/2721528335 conn(0x28ce920 msgr2=0x2aef350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 shutdown_connections 2023-08-17T00:11:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3aa3d40740 1 -- 172.21.15.153:0/2721528335 wait complete. 2023-08-17T00:11:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3aa3d40740 20 client.7632 trim_cache size 0 max 16384 2023-08-17T00:11:35.198 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:11:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:11:35.198 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "66834fa8-49f8-49c6-8887-428808cd04ae", 2023-08-17T00:11:35.199 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:11:35.199 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:11:35.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a8005a150 msgr2=0x7f3a8005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a8005a150 0x7f3a8005c610 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f3a94063af0 tx=0x7f3a84017000).stop 2023-08-17T00:11:35.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 msgr2=0x7f3a940a3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 0x7f3a940a3860 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 rx=0x7f3a8c009df0 tx=0x7f3a8c00b040).stop 2023-08-17T00:11:35.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 shutdown_connections 2023-08-17T00:11:35.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a8005a150 0x7f3a8005c610 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a9413c2c0 0x7f3a940a3860 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a94153b80 0x7f3a9413bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 --2- 172.21.15.153:0/3120645120 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a94064e40 0x7f3a940a6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 >> 172.21.15.153:0/3120645120 conn(0x7f3a940c7090 msgr2=0x7f3a940bb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 shutdown_connections 2023-08-17T00:11:35.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.190+0000 7f3a99969700 1 -- 172.21.15.153:0/3120645120 wait complete. 2023-08-17T00:11:35.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub pause 2023-08-17T00:11:35.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.390+0000 7fa4d8369700 1 Processor -- start 2023-08-17T00:11:35.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.390+0000 7fa4d8369700 1 -- start start 2023-08-17T00:11:35.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0151b90 0x7fa4d0151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4d0063290 0x7fa4d0065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d0061fa0 con 0x7fa4d0065b50 2023-08-17T00:11:35.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d00c3fb0 con 0x7fa4d0063290 2023-08-17T00:11:35.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0152460 con 0x7fa4d0151b90 2023-08-17T00:11:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d6906700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa4d0065b50 0x7fa4d0064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36816/0 (socket says 172.21.15.153:36816) 2023-08-17T00:11:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d6906700 1 -- 172.21.15.153:0/3954665180 learned_addr learned my addr 172.21.15.153:0/3954665180 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5904700 1 --2- 172.21.15.153:0/3954665180 >> v2:172.21.15.178:3300/0 conn(0x7fa4d0063290 0x7fa4d0065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d6105700 1 --2- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0151b90 0x7fa4d0151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5103700 1 -- 172.21.15.153:0/3954665180 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 499357697 0 0) 0x7fa4d0061fa0 con 0x7fa4d0065b50 2023-08-17T00:11:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5103700 1 -- 172.21.15.153:0/3954665180 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc0033f0 con 0x7fa4d0065b50 2023-08-17T00:11:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5904700 1 -- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0151b90 msgr2=0x7fa4d0151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5904700 1 --2- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0151b90 0x7fa4d0151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5904700 1 -- 172.21.15.153:0/3954665180 >> v1:172.21.15.153:6789/0 conn(0x7fa4d0065b50 legacy=0x7fa4d0064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5904700 1 -- 172.21.15.153:0/3954665180 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d00621f0 con 0x7fa4d0063290 2023-08-17T00:11:35.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5904700 1 --2- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d0065660 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa4c0009760 tx=0x7fa4c0009060).ready entity=mon.1 client_cookie=4f818c5c46474064 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5103700 1 -- 172.21.15.153:0/3954665180 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000d4a0 con 0x7fa4d0063290 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5103700 1 -- 172.21.15.153:0/3954665180 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c000d600 con 0x7fa4d0063290 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d5103700 1 -- 172.21.15.153:0/3954665180 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000d980 con 0x7fa4d0063290 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 -- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 msgr2=0x7fa4d0065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.394+0000 7fa4d8369700 1 --2- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d0065660 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa4c0009760 tx=0x7fa4c0009060).stop 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- 172.21.15.153:0/3954665180 shutdown_connections 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 --2- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d0065660 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 --2- 172.21.15.153:0/3954665180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0151b90 0x7fa4d0151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- 172.21.15.153:0/3954665180 >> 172.21.15.153:0/3954665180 conn(0x7fa4d00c7150 msgr2=0x7fa4d00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- 172.21.15.153:0/3954665180 shutdown_connections 2023-08-17T00:11:35.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- 172.21.15.153:0/3954665180 wait complete. 2023-08-17T00:11:35.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 Processor -- start 2023-08-17T00:11:35.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- start start 2023-08-17T00:11:35.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0065b50 0x7fa4d00a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 0x7fa4d0152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c2340 con 0x7fa4d0151b90 2023-08-17T00:11:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c1730 con 0x7fa4d0063290 2023-08-17T00:11:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.398+0000 7fa4d8369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d00c1a10 con 0x7fa4d0065b50 2023-08-17T00:11:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 0x7fa4d0152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d5904700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0065b50 0x7fa4d00a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 0x7fa4d0152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43724/0 (socket says 172.21.15.153:43724) 2023-08-17T00:11:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 -- 172.21.15.153:0/945140222 learned_addr learned my addr 172.21.15.153:0/945140222 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6105700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 -- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0065b50 msgr2=0x7fa4d00a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0065b50 0x7fa4d00a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 -- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 msgr2=0x7fa4d014d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d014d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 -- 172.21.15.153:0/945140222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00092a0 con 0x7fa4d0151b90 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6105700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d6906700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 0x7fa4d0152e10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa4c8005ad0 tx=0x7fa4c8001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4c67fc700 1 -- 172.21.15.153:0/945140222 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8005d30 con 0x7fa4d0151b90 2023-08-17T00:11:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4c67fc700 1 -- 172.21.15.153:0/945140222 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c8005e90 con 0x7fa4d0151b90 2023-08-17T00:11:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d00c1cf0 con 0x7fa4d0151b90 2023-08-17T00:11:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4c67fc700 1 -- 172.21.15.153:0/945140222 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8007320 con 0x7fa4d0151b90 2023-08-17T00:11:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.402+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d00c27d0 con 0x7fa4d0151b90 2023-08-17T00:11:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.406+0000 7fa4c67fc700 1 -- 172.21.15.153:0/945140222 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa4c8010030 con 0x7fa4d0151b90 2023-08-17T00:11:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.406+0000 7fa4c67fc700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa4b405a180 0x7fa4b405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.406+0000 7fa4c67fc700 1 -- 172.21.15.153:0/945140222 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa4c80740b0 con 0x7fa4d0151b90 2023-08-17T00:11:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4d6105700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa4b405a180 0x7fa4b405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4d6105700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa4b405a180 0x7fa4b405c640 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fa4d0152870 tx=0x7fa4cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 Processor -- start 2023-08-17T00:11:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 -- start start 2023-08-17T00:11:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28bd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x28db470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x2894740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27e4160 con 0x28d9130 2023-08-17T00:11:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2804ff0 con 0x28d8d50 2023-08-17T00:11:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2897c90 con 0x28942c0 2023-08-17T00:11:35.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.410+0000 7fa4d5904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x28db470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x28db470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43726/0 (socket says 172.21.15.153:43726) 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 -- 172.21.15.153:0/2647551445 learned_addr learned my addr 172.21.15.153:0/2647551445 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d6906700 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x2894740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d6105700 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28bd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 -- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 msgr2=0x2894740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x2894740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 -- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 msgr2=0x28bd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28bd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 -- 172.21.15.153:0/2647551445 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2811fd0 con 0x28d9130 2023-08-17T00:11:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d6105700 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28bd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x28db470 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fa4c0009d50 tx=0x7fa4c0016000).ready entity=mon.0 client_cookie=656014e178771dea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4b37fe700 1 -- 172.21.15.153:0/2647551445 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0022070 con 0x28d9130 2023-08-17T00:11:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4b37fe700 1 -- 172.21.15.153:0/2647551445 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0000be0 con 0x28d9130 2023-08-17T00:11:35.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4b37fe700 1 -- 172.21.15.153:0/2647551445 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000d770 con 0x28d9130 2023-08-17T00:11:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2647551445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 msgr2=0x28db470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x28db470 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 rx=0x7fa4c0009d50 tx=0x7fa4c0016000).stop 2023-08-17T00:11:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2647551445 shutdown_connections 2023-08-17T00:11:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x2894740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x28db470 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2647551445 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28bd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2647551445 >> 172.21.15.153:0/2647551445 conn(0x2677640 msgr2=0x2897fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2647551445 shutdown_connections 2023-08-17T00:11:35.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.414+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2647551445 wait complete. 2023-08-17T00:11:35.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 -- start start 2023-08-17T00:11:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 Processor -- start 2023-08-17T00:11:35.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x28d5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28edc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d9130 0x28ee130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d8510 con 0x28942c0 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d5c00 con 0x28d8d50 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28eacb0 con 0x28d9130 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4e26fa740 10 client.0 ll_register_callbacks cb 0x284f440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:35.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x28d5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x28d5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43732/0 (socket says 172.21.15.153:43732) 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 -- 172.21.15.153:0/2873147444 learned_addr learned my addr 172.21.15.153:0/2873147444 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6906700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d9130 0x28ee130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 -- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d9130 msgr2=0x28ee130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d9130 0x28ee130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 -- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 msgr2=0x28edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 -- 172.21.15.153:0/2873147444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d00621f0 con 0x28942c0 2023-08-17T00:11:35.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4d6105700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x28d5620 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fa4cc002f40 tx=0x7fa4cc018040).ready entity=mon.0 client_cookie=cf308195b6585aba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.418+0000 7fa4b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:35.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/2873147444 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0145f0 con 0x28942c0 2023-08-17T00:11:35.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x280ecb0 con 0x28942c0 2023-08-17T00:11:35.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/2873147444 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa4cc014750 con 0x28942c0 2023-08-17T00:11:35.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/2873147444 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4cc014b60 con 0x28942c0 2023-08-17T00:11:35.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 10 client.7644 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:35.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x280d470 con 0x28942c0 2023-08-17T00:11:35.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/2873147444 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x280ecb0 con 0x28942c0 2023-08-17T00:11:35.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/2873147444 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa4cc014cc0 con 0x28942c0 2023-08-17T00:11:35.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 10 client.7644 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:35.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 10 client.7644 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:35.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 20 client.7644 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:35.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28ae7e0 0x28aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 4 client.7644 mds_command: new command op to 7470 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:11:35.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2805200 con 0x28ae7e0 2023-08-17T00:11:35.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28ae7e0 0x28aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4b0ff9700 10 client.7644 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.422+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28ae7e0 0x28aebc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=19e1003c1e296330 server_cookie=3effdcbba3eac644 in_seq=0 out_seq=0 2023-08-17T00:11:35.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/2873147444 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2805200 con 0x28ae7e0 2023-08-17T00:11:35.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4b0ff9700 10 client.7644 handle_command_reply: tid=0 2023-08-17T00:11:35.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 client.7644 shutdown 2023-08-17T00:11:35.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 msgr2=0x28d5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x28d5620 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fa4cc002f40 tx=0x7fa4cc018040).stop 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 shutdown_connections 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28ae7e0 0x28aebc0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d9130 0x28ee130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4b0ff9700 0 client.7644 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x28edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2873147444 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x28d5620 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 >> 172.21.15.153:0/2873147444 conn(0x2677640 msgr2=0x28bcac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 shutdown_connections 2023-08-17T00:11:35.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2873147444 wait complete. 2023-08-17T00:11:35.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.426+0000 7fa4e26fa740 20 client.7644 trim_cache size 0 max 16384 2023-08-17T00:11:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 Processor -- start 2023-08-17T00:11:35.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 -- start start 2023-08-17T00:11:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x28c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x2897190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x2892500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x285b280 con 0x28d9130 2023-08-17T00:11:35.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28de3c0 con 0x28d8d50 2023-08-17T00:11:35.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28bade0 con 0x28942c0 2023-08-17T00:11:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x2897190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d6906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x2892500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x2897190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:42814/0 (socket says 172.21.15.153:42814) 2023-08-17T00:11:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 -- 172.21.15.153:0/2903785938 learned_addr learned my addr 172.21.15.153:0/2903785938 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d6105700 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x28c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 -- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 msgr2=0x28c0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x28c0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 -- 172.21.15.153:0/2903785938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 msgr2=0x2892500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x2892500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 -- 172.21.15.153:0/2903785938 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0153660 con 0x28d8d50 2023-08-17T00:11:35.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.446+0000 7fa4d5904700 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x2897190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fa4c0009210 tx=0x7fa4c0014000).ready entity=mon.1 client_cookie=514bc7c9472785a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4b3fff700 1 -- 172.21.15.153:0/2903785938 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0022040 con 0x28d8d50 2023-08-17T00:11:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4b3fff700 1 -- 172.21.15.153:0/2903785938 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0023040 con 0x28d8d50 2023-08-17T00:11:35.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4b3fff700 1 -- 172.21.15.153:0/2903785938 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000d770 con 0x28d8d50 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 msgr2=0x2897190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x2897190 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7fa4c0009210 tx=0x7fa4c0014000).stop 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2903785938 shutdown_connections 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28d9130 0x2892500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d8d50 0x2897190 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/2903785938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28942c0 0x28c0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2903785938 >> 172.21.15.153:0/2903785938 conn(0x2677640 msgr2=0x28dea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2903785938 shutdown_connections 2023-08-17T00:11:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 -- 172.21.15.153:0/2903785938 wait complete. 2023-08-17T00:11:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 -- start start 2023-08-17T00:11:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.450+0000 7fa4e26fa740 1 Processor -- start 2023-08-17T00:11:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x293a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d8d50 0x2892930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d9130 0x28bb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2941610 con 0x28942c0 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28924a0 con 0x28d9130 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2892e20 con 0x28d8d50 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 10 client.0 ll_register_callbacks cb 0x7fa4cc011ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x293a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d5904700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d8d50 0x2892930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x293a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43758/0 (socket says 172.21.15.153:43758) 2023-08-17T00:11:35.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 -- 172.21.15.153:0/3724305402 learned_addr learned my addr 172.21.15.153:0/3724305402 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6906700 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d9130 0x28bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 -- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d8d50 msgr2=0x2892930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d8d50 0x2892930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 -- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d9130 msgr2=0x28bb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d9130 0x28bb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 -- 172.21.15.153:0/3724305402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2811fd0 con 0x28942c0 2023-08-17T00:11:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d6105700 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x293a520 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fa4cc002f40 tx=0x7fa4cc01a000).ready entity=mon.0 client_cookie=dae30293eff3ebcb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:35.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/3724305402 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc0225b0 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4c0000be0 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/3724305402 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa4cc022710 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/3724305402 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4cc022ae0 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 10 client.7650 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x280d1c0 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/3724305402 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0000be0 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/3724305402 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa4cc036020 con 0x28942c0 2023-08-17T00:11:35.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 10 client.7650 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 10 client.7650 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 20 client.7650 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2940990 0x2940d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 4 client.7650 mds_command: new command op to 7470 tid=0[{"prefix": "scrub pause"}] 2023-08-17T00:11:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x26ce5d0 con 0x2940990 2023-08-17T00:11:35.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.454+0000 7fa4d5904700 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2940990 0x2940d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d5904700 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2940990 0x2940d70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f8c08283ea731773 server_cookie=a9e6649e0218ab23 in_seq=0 out_seq=0 2023-08-17T00:11:35.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4b0ff9700 10 client.7650 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4b0ff9700 1 -- 172.21.15.153:0/3724305402 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x26ce5d0 con 0x2940990 2023-08-17T00:11:35.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4b0ff9700 10 client.7650 handle_command_reply: tid=0 2023-08-17T00:11:35.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 client.7650 shutdown 2023-08-17T00:11:35.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 msgr2=0x293a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x293a520 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 rx=0x7fa4cc002f40 tx=0x7fa4cc01a000).stop 2023-08-17T00:11:35.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 shutdown_connections 2023-08-17T00:11:35.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x2940990 0x2940d70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28d9130 0x28bb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28d8d50 0x2892930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 --2- 172.21.15.153:0/3724305402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28942c0 0x293a520 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 >> 172.21.15.153:0/3724305402 conn(0x2677640 msgr2=0x28db190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4b0ff9700 0 client.7650 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 shutdown_connections 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 1 -- 172.21.15.153:0/3724305402 wait complete. 2023-08-17T00:11:35.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4e26fa740 20 client.7650 trim_cache size 0 max 16384 2023-08-17T00:11:35.467 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:11:35.467 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:11:35.467 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:11:35.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa4b405a180 msgr2=0x7fa4b405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa4b405a180 0x7fa4b405c640 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fa4d0152870 tx=0x7fa4cc008040).stop 2023-08-17T00:11:35.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 msgr2=0x7fa4d0152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 0x7fa4d0152e10 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7fa4c8005ad0 tx=0x7fa4c8001650).stop 2023-08-17T00:11:35.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 shutdown_connections 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa4b405a180 0x7fa4b405c640 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa4d0151b90 0x7fa4d0152e10 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4d0065b50 0x7fa4d00a7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 --2- 172.21.15.153:0/945140222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa4d0063290 0x7fa4d014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 >> 172.21.15.153:0/945140222 conn(0x7fa4d00c7150 msgr2=0x7fa4d00c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 shutdown_connections 2023-08-17T00:11:35.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.458+0000 7fa4d8369700 1 -- 172.21.15.153:0/945140222 wait complete. 2023-08-17T00:11:35.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-08-17T00:11:35.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.642+0000 7f7823a9b700 1 Processor -- start 2023-08-17T00:11:35.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.642+0000 7f7823a9b700 1 -- start start 2023-08-17T00:11:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f781c0a8b70 0x7f781c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f781c0629b0 0x7f781c0bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f781c065240 con 0x7f781c0a8f50 2023-08-17T00:11:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c062e40 con 0x7f781c0629b0 2023-08-17T00:11:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f781c0638a0 con 0x7f781c0a8b70 2023-08-17T00:11:35.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7821036700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f781c0a8f50 0x7f781c0656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36830/0 (socket says 172.21.15.153:36830) 2023-08-17T00:11:35.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7821036700 1 -- 172.21.15.153:0/3977723929 learned_addr learned my addr 172.21.15.153:0/3977723929 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:35.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7822038700 1 --2- 172.21.15.153:0/3977723929 >> v2:172.21.15.153:3300/0 conn(0x7f781c0629b0 0x7f781c0bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7821837700 1 --2- 172.21.15.153:0/3977723929 >> v2:172.21.15.178:3300/0 conn(0x7f781c0a8b70 0x7f781c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7820835700 1 -- 172.21.15.153:0/3977723929 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834860423 0 0) 0x7f781c065240 con 0x7f781c0a8f50 2023-08-17T00:11:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7820835700 1 -- 172.21.15.153:0/3977723929 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78080033f0 con 0x7f781c0a8f50 2023-08-17T00:11:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7822038700 1 -- 172.21.15.153:0/3977723929 >> v2:172.21.15.178:3300/0 conn(0x7f781c0a8b70 msgr2=0x7f781c0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7822038700 1 --2- 172.21.15.153:0/3977723929 >> v2:172.21.15.178:3300/0 conn(0x7f781c0a8b70 0x7f781c0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7822038700 1 -- 172.21.15.153:0/3977723929 >> v1:172.21.15.153:6789/0 conn(0x7f781c0a8f50 legacy=0x7f781c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7822038700 1 -- 172.21.15.153:0/3977723929 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c065de0 con 0x7f781c0629b0 2023-08-17T00:11:35.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7822038700 1 --2- 172.21.15.153:0/3977723929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c0bbdc0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f781c069ba0 tx=0x7f7814009780).ready entity=mon.0 client_cookie=d9d6ac0fd21ee68 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7820835700 1 -- 172.21.15.153:0/3977723929 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400e070 con 0x7f781c0629b0 2023-08-17T00:11:35.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7820835700 1 -- 172.21.15.153:0/3977723929 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400bab0 con 0x7f781c0629b0 2023-08-17T00:11:35.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7820835700 1 -- 172.21.15.153:0/3977723929 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400be30 con 0x7f781c0629b0 2023-08-17T00:11:35.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 -- 172.21.15.153:0/3977723929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 msgr2=0x7f781c0bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.646+0000 7f7823a9b700 1 --2- 172.21.15.153:0/3977723929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c0bbdc0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7f781c069ba0 tx=0x7f7814009780).stop 2023-08-17T00:11:35.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- 172.21.15.153:0/3977723929 shutdown_connections 2023-08-17T00:11:35.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 --2- 172.21.15.153:0/3977723929 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c0bbdc0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 --2- 172.21.15.153:0/3977723929 >> v2:172.21.15.178:3300/0 conn(0x7f781c0a8b70 0x7f781c0632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- 172.21.15.153:0/3977723929 >> 172.21.15.153:0/3977723929 conn(0x7f781c0c7150 msgr2=0x7f781c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- 172.21.15.153:0/3977723929 shutdown_connections 2023-08-17T00:11:35.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- 172.21.15.153:0/3977723929 wait complete. 2023-08-17T00:11:35.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 Processor -- start 2023-08-17T00:11:35.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- start start 2023-08-17T00:11:35.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f781c0a8b70 0x7f781c169360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f781c0a8f50 0x7f781c0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c154a60 con 0x7f781c0629b0 2023-08-17T00:11:35.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781c15acf0 con 0x7f781c0a8f50 2023-08-17T00:11:35.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.650+0000 7f7823a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781c1595a0 con 0x7f781c0a8b70 2023-08-17T00:11:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43770/0 (socket says 172.21.15.153:43770) 2023-08-17T00:11:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 -- 172.21.15.153:0/1385140101 learned_addr learned my addr 172.21.15.153:0/1385140101 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7822038700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f781c0a8f50 0x7f781c0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821036700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f781c0a8b70 0x7f781c169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 -- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f781c0a8b70 msgr2=0x7f781c169360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f781c0a8b70 0x7f781c169360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 -- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f781c0a8f50 msgr2=0x7f781c0aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f781c0a8f50 0x7f781c0aba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 -- 172.21.15.153:0/1385140101 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7814009a20 con 0x7f781c0629b0 2023-08-17T00:11:35.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821036700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f781c0a8b70 0x7f781c169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7821837700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c154570 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f781800e930 tx=0x7f7818009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7811ffb700 1 -- 172.21.15.153:0/1385140101 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800eed0 con 0x7f781c0629b0 2023-08-17T00:11:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7811ffb700 1 -- 172.21.15.153:0/1385140101 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800c850 con 0x7f781c0629b0 2023-08-17T00:11:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7811ffb700 1 -- 172.21.15.153:0/1385140101 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800cbd0 con 0x7f781c0629b0 2023-08-17T00:11:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781c169850 con 0x7f781c0629b0 2023-08-17T00:11:35.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.654+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c15a3c0 con 0x7f781c0629b0 2023-08-17T00:11:35.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.658+0000 7f7811ffb700 1 -- 172.21.15.153:0/1385140101 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7818022070 con 0x7f781c0629b0 2023-08-17T00:11:35.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.658+0000 7f7811ffb700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f780005a150 0x7f780005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.658+0000 7f7811ffb700 1 -- 172.21.15.153:0/1385140101 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7818074620 con 0x7f781c0629b0 2023-08-17T00:11:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.658+0000 7f7821036700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f780005a150 0x7f780005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.658+0000 7f782de09740 1 Processor -- start 2023-08-17T00:11:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- start start 2023-08-17T00:11:35.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821036700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f780005a150 0x7f780005c610 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f780c005750 tx=0x7f780c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 0x1a2f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12860 0x1a39140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12ce0 0x1a39630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19391a0 con 0x1a2ed20 2023-08-17T00:11:35.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ed300 con 0x1a12ce0 2023-08-17T00:11:35.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19ec730 con 0x1a12860 2023-08-17T00:11:35.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 0x1a2f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 0x1a2f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43774/0 (socket says 172.21.15.153:43774) 2023-08-17T00:11:35.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 -- 172.21.15.153:0/4011511156 learned_addr learned my addr 172.21.15.153:0/4011511156 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7822038700 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12ce0 0x1a39630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821036700 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12860 0x1a39140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 -- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12860 msgr2=0x1a39140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12860 0x1a39140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 -- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12ce0 msgr2=0x1a39630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12ce0 0x1a39630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 -- 172.21.15.153:0/4011511156 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1967010 con 0x1a2ed20 2023-08-17T00:11:35.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821036700 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12860 0x1a39140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:35.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f7821837700 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 0x1a2f100 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f781804b5e0 tx=0x7f7818011000).ready entity=mon.0 client_cookie=c27abd70866eabff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f77feffd700 1 -- 172.21.15.153:0/4011511156 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180512f0 con 0x1a2ed20 2023-08-17T00:11:35.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f77feffd700 1 -- 172.21.15.153:0/4011511156 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818072790 con 0x1a2ed20 2023-08-17T00:11:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f77feffd700 1 -- 172.21.15.153:0/4011511156 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7818072900 con 0x1a2ed20 2023-08-17T00:11:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- 172.21.15.153:0/4011511156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 msgr2=0x1a2f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 0x1a2f100 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 rx=0x7f781804b5e0 tx=0x7f7818011000).stop 2023-08-17T00:11:35.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- 172.21.15.153:0/4011511156 shutdown_connections 2023-08-17T00:11:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12ce0 0x1a39630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12860 0x1a39140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 --2- 172.21.15.153:0/4011511156 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2ed20 0x1a2f100 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- 172.21.15.153:0/4011511156 >> 172.21.15.153:0/4011511156 conn(0x17cc680 msgr2=0x19ed7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- 172.21.15.153:0/4011511156 shutdown_connections 2023-08-17T00:11:35.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.662+0000 7f782de09740 1 -- 172.21.15.153:0/4011511156 wait complete. 2023-08-17T00:11:35.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 -- start start 2023-08-17T00:11:35.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 Processor -- start 2023-08-17T00:11:35.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 0x1a13ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12ce0 0x1a2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2ed20 0x1a2d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a2db00 con 0x1a12860 2023-08-17T00:11:35.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a199c0 con 0x1a2ed20 2023-08-17T00:11:35.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a14480 con 0x1a12ce0 2023-08-17T00:11:35.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f782de09740 10 client.0 ll_register_callbacks cb 0x19a4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:35.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.666+0000 7f7821837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 0x1a13ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 0x1a13ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43788/0 (socket says 172.21.15.153:43788) 2023-08-17T00:11:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 -- 172.21.15.153:0/968700536 learned_addr learned my addr 172.21.15.153:0/968700536 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7822038700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2ed20 0x1a2d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821036700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12ce0 0x1a2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 -- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12ce0 msgr2=0x1a2d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12ce0 0x1a2d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 -- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2ed20 msgr2=0x1a2d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2ed20 0x1a2d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 -- 172.21.15.153:0/968700536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781c15a3c0 con 0x1a12860 2023-08-17T00:11:35.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821036700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12ce0 0x1a2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821837700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 0x1a13ea0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f781804b980 tx=0x7f7818056000).ready entity=mon.0 client_cookie=fd93121e8eccf034 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 1 -- 172.21.15.153:0/968700536 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78180740d0 con 0x1a12860 2023-08-17T00:11:35.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 1 -- 172.21.15.153:0/968700536 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7818074230 con 0x1a12860 2023-08-17T00:11:35.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1935200 con 0x1a12860 2023-08-17T00:11:35.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 1 -- 172.21.15.153:0/968700536 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78180743f0 con 0x1a12860 2023-08-17T00:11:35.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 10 client.7665 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:35.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x19624b0 con 0x1a12860 2023-08-17T00:11:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 1 -- 172.21.15.153:0/968700536 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818061070 con 0x1a12860 2023-08-17T00:11:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 1 -- 172.21.15.153:0/968700536 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7818047a70 con 0x1a12860 2023-08-17T00:11:35.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 10 client.7665 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:35.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 10 client.7665 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:35.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 20 client.7665 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:35.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a17ae0 0x1a18b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 4 client.7665 mds_command: new command op to 7470 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:11:35.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1963cf0 con 0x1a17ae0 2023-08-17T00:11:35.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821036700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a17ae0 0x1a18b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f77f7fff700 10 client.7665 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.670+0000 7f7821036700 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a17ae0 0x1a18b70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=91dcc48e226b31b server_cookie=5e754b7e538af58e in_seq=0 out_seq=0 2023-08-17T00:11:35.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f77f7fff700 1 -- 172.21.15.153:0/968700536 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1963cf0 con 0x1a17ae0 2023-08-17T00:11:35.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f77f7fff700 10 client.7665 handle_command_reply: tid=0 2023-08-17T00:11:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 client.7665 shutdown 2023-08-17T00:11:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 msgr2=0x1a13ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 0x1a13ea0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 rx=0x7f781804b980 tx=0x7f7818056000).stop 2023-08-17T00:11:35.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 shutdown_connections 2023-08-17T00:11:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a17ae0 0x1a18b70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2ed20 0x1a2d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f77f7fff700 0 client.7665 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a12ce0 0x1a2d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 --2- 172.21.15.153:0/968700536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12860 0x1a13ea0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 >> 172.21.15.153:0/968700536 conn(0x17cc680 msgr2=0x1a33d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 shutdown_connections 2023-08-17T00:11:35.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 1 -- 172.21.15.153:0/968700536 wait complete. 2023-08-17T00:11:35.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.674+0000 7f782de09740 20 client.7665 trim_cache size 0 max 16384 2023-08-17T00:11:35.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 Processor -- start 2023-08-17T00:11:35.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 -- start start 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x19e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 0x1a16ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a16fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a15160 con 0x1a12ce0 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19b3540 con 0x1a12860 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a11c70 con 0x1a2ed20 2023-08-17T00:11:35.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f7821036700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 0x1a16ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f7821036700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 0x1a16ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43798/0 (socket says 172.21.15.153:43798) 2023-08-17T00:11:35.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f7821036700 1 -- 172.21.15.153:0/2225452065 learned_addr learned my addr 172.21.15.153:0/2225452065 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f7821837700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x19e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.694+0000 7f7822038700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a16fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821036700 1 -- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 msgr2=0x1a16fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821036700 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a16fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821036700 1 -- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 msgr2=0x19e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821036700 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x19e82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821036700 1 -- 172.21.15.153:0/2225452065 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a16900 con 0x1a12ce0 2023-08-17T00:11:35.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821837700 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x19e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:35.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f7821036700 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 0x1a16ab0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f780c001470 tx=0x7f780c006000).ready entity=mon.0 client_cookie=1f63e891b2e4520e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f77ff7fe700 1 -- 172.21.15.153:0/2225452065 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c01c040 con 0x1a12ce0 2023-08-17T00:11:35.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f77ff7fe700 1 -- 172.21.15.153:0/2225452065 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c005e70 con 0x1a12ce0 2023-08-17T00:11:35.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f77ff7fe700 1 -- 172.21.15.153:0/2225452065 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c020280 con 0x1a12ce0 2023-08-17T00:11:35.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 -- 172.21.15.153:0/2225452065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 msgr2=0x1a16ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 0x1a16ab0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 rx=0x7f780c001470 tx=0x7f780c006000).stop 2023-08-17T00:11:35.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 -- 172.21.15.153:0/2225452065 shutdown_connections 2023-08-17T00:11:35.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a16fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a12ce0 0x1a16ab0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 --2- 172.21.15.153:0/2225452065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x19e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 -- 172.21.15.153:0/2225452065 >> 172.21.15.153:0/2225452065 conn(0x17cc680 msgr2=0x1a33d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 -- 172.21.15.153:0/2225452065 shutdown_connections 2023-08-17T00:11:35.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 -- 172.21.15.153:0/2225452065 wait complete. 2023-08-17T00:11:35.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 -- start start 2023-08-17T00:11:35.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.698+0000 7f782de09740 1 Processor -- start 2023-08-17T00:11:35.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x1a96760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a93220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 0x19e71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19e7f00 con 0x1a123a0 2023-08-17T00:11:35.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4df80 con 0x1a12860 2023-08-17T00:11:35.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4e1d0 con 0x1a2ed20 2023-08-17T00:11:35.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f782de09740 10 client.0 ll_register_callbacks cb 0x7f7818054070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:35.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 0x19e71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 0x19e71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43812/0 (socket says 172.21.15.153:43812) 2023-08-17T00:11:35.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 -- 172.21.15.153:0/3774361014 learned_addr learned my addr 172.21.15.153:0/3774361014 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7821837700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x1a96760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7821036700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a93220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 -- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 msgr2=0x1a93220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a93220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 -- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 msgr2=0x1a96760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x1a96760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 -- 172.21.15.153:0/3774361014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x19624b0 con 0x1a123a0 2023-08-17T00:11:35.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7821837700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x1a96760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:35.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f7822038700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 0x19e71e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f781c05e420 tx=0x7f7814009780).ready entity=mon.0 client_cookie=56b898bb87857840 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f77f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:35.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.702+0000 7f77f7fff700 1 -- 172.21.15.153:0/3774361014 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814023070 con 0x1a123a0 2023-08-17T00:11:35.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a2df00 con 0x1a123a0 2023-08-17T00:11:35.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 1 -- 172.21.15.153:0/3774361014 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f781401d3f0 con 0x1a123a0 2023-08-17T00:11:35.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 1 -- 172.21.15.153:0/3774361014 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f781401d810 con 0x1a123a0 2023-08-17T00:11:35.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 10 client.7671 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x7f78080033f0 con 0x1a123a0 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 1 -- 172.21.15.153:0/3774361014 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a2df00 con 0x1a123a0 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 1 -- 172.21.15.153:0/3774361014 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f781401d970 con 0x1a123a0 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 10 client.7671 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 10 client.7671 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 20 client.7671 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:35.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x19e76d0 0x1a48e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 4 client.7671 mds_command: new command op to 7470 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:11:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7818072790 con 0x19e76d0 2023-08-17T00:11:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f7821837700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x19e76d0 0x1a48e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f7821837700 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x19e76d0 0x1a48e90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7aba01c828afe397 server_cookie=d06259c69061ed1e in_seq=0 out_seq=0 2023-08-17T00:11:35.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 10 client.7671 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 1 -- 172.21.15.153:0/3774361014 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x7f7818072790 con 0x19e76d0 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 10 client.7671 handle_command_reply: tid=0 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 client.7671 shutdown 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 msgr2=0x19e71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 0x19e71e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 rx=0x7f781c05e420 tx=0x7f7814009780).stop 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 shutdown_connections 2023-08-17T00:11:35.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x19e76d0 0x1a48e90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a123a0 0x19e71e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a2ed20 0x1a93220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 --2- 172.21.15.153:0/3774361014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a12860 0x1a96760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f77f7fff700 0 client.7671 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.706+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 >> 172.21.15.153:0/3774361014 conn(0x17cc680 msgr2=0x1a2d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 shutdown_connections 2023-08-17T00:11:35.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f782de09740 1 -- 172.21.15.153:0/3774361014 wait complete. 2023-08-17T00:11:35.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f782de09740 20 client.7671 trim_cache size 0 max 16384 2023-08-17T00:11:35.718 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:11:35.718 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-08-17T00:11:35.718 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:11:35.718 INFO:teuthology.orchestra.run.smithi153.stdout: "66834fa8-49f8-49c6-8887-428808cd04ae": { 2023-08-17T00:11:35.719 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_control_test_path", 2023-08-17T00:11:35.719 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "66834fa8-49f8-49c6-8887-428808cd04ae", 2023-08-17T00:11:35.719 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive" 2023-08-17T00:11:35.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:11:35.719 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:11:35.720 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:11:35.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f780005a150 msgr2=0x7f780005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f780005a150 0x7f780005c610 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f780c005750 tx=0x7f780c009040).stop 2023-08-17T00:11:35.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 msgr2=0x7f781c154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c154570 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7f781800e930 tx=0x7f7818009060).stop 2023-08-17T00:11:35.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 shutdown_connections 2023-08-17T00:11:35.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f780005a150 0x7f780005c610 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f781c0a8f50 0x7f781c0aba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f781c0a8b70 0x7f781c169360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 --2- 172.21.15.153:0/1385140101 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f781c0629b0 0x7f781c154570 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 >> 172.21.15.153:0/1385140101 conn(0x7f781c0c7150 msgr2=0x7f781c155260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 shutdown_connections 2023-08-17T00:11:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.710+0000 7f7823a9b700 1 -- 172.21.15.153:0/1385140101 wait complete. 2023-08-17T00:11:35.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:35.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.894+0000 7f978561b700 1 Processor -- start 2023-08-17T00:11:35.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.894+0000 7f978561b700 1 -- start start 2023-08-17T00:11:35.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f978561b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9780157140 0x7f97800bbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f978561b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f978561b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9780063380 con 0x7f97800bb590 2023-08-17T00:11:35.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f978561b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97800bcea0 con 0x7f9780157140 2023-08-17T00:11:35.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f978561b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800657d0 con 0x7f97800c15e0 2023-08-17T00:11:35.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:42606/0 (socket says 172.21.15.153:42606) 2023-08-17T00:11:35.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 -- 172.21.15.153:0/2019364662 learned_addr learned my addr 172.21.15.153:0/2019364662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977effd700 1 --2- 172.21.15.153:0/2019364662 >> v2:172.21.15.178:3300/0 conn(0x7f9780157140 0x7f97800bbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977e7fc700 1 --1- 172.21.15.153:0/2019364662 >> v1:172.21.15.178:6789/0 conn(0x7f97800bb590 0x7f97800c0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33252/0 (socket says 172.21.15.153:33252) 2023-08-17T00:11:35.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 -- 172.21.15.153:0/2019364662 >> v2:172.21.15.178:3300/0 conn(0x7f9780157140 msgr2=0x7f97800bbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 --2- 172.21.15.153:0/2019364662 >> v2:172.21.15.178:3300/0 conn(0x7f9780157140 0x7f97800bbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 -- 172.21.15.153:0/2019364662 >> v1:172.21.15.178:6789/0 conn(0x7f97800bb590 legacy=0x7f97800c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 -- 172.21.15.153:0/2019364662 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800bc3e0 con 0x7f97800c15e0 2023-08-17T00:11:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977f7fe700 1 --2- 172.21.15.153:0/2019364662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800c1a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f97800bc5d0 tx=0x7f9778009840).ready entity=mon.2 client_cookie=93589bb1ef4b7a23 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977dffb700 1 -- 172.21.15.153:0/2019364662 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800e070 con 0x7f97800c15e0 2023-08-17T00:11:35.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977dffb700 1 -- 172.21.15.153:0/2019364662 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977800ba20 con 0x7f97800c15e0 2023-08-17T00:11:35.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.898+0000 7f977dffb700 1 -- 172.21.15.153:0/2019364662 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977800bda0 con 0x7f97800c15e0 2023-08-17T00:11:35.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 -- 172.21.15.153:0/2019364662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 msgr2=0x7f97800c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 --2- 172.21.15.153:0/2019364662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800c1a70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f97800bc5d0 tx=0x7f9778009840).stop 2023-08-17T00:11:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 -- 172.21.15.153:0/2019364662 shutdown_connections 2023-08-17T00:11:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 --2- 172.21.15.153:0/2019364662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800c1a70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 --2- 172.21.15.153:0/2019364662 >> v2:172.21.15.178:3300/0 conn(0x7f9780157140 0x7f97800bbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 -- 172.21.15.153:0/2019364662 >> 172.21.15.153:0/2019364662 conn(0x7f97800c2fb0 msgr2=0x7f97800c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:35.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 -- 172.21.15.153:0/2019364662 shutdown_connections 2023-08-17T00:11:35.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 -- 172.21.15.153:0/2019364662 wait complete. 2023-08-17T00:11:35.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.902+0000 7f978561b700 1 Processor -- start 2023-08-17T00:11:35.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 -- start start 2023-08-17T00:11:35.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 0x7f97800bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800a5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780157140 0x7f97801542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97800a4c30 con 0x7f9780157140 2023-08-17T00:11:35.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97800a51b0 con 0x7f97800bb590 2023-08-17T00:11:35.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f978561b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9780154cd0 con 0x7f97800c15e0 2023-08-17T00:11:35.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780157140 0x7f97801542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 0x7f97800bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 0x7f97800bf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:42930/0 (socket says 172.21.15.153:42930) 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 -- 172.21.15.153:0/1129882283 learned_addr learned my addr 172.21.15.153:0/1129882283 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977e7fc700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800a5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 -- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 msgr2=0x7f97800a5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800a5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 -- 172.21.15.153:0/1129882283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780157140 msgr2=0x7f97801542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:35.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780157140 0x7f97801542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:35.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 -- 172.21.15.153:0/1129882283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009ae0 con 0x7f97800bb590 2023-08-17T00:11:35.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977f7fe700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780157140 0x7f97801542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:35.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.906+0000 7f977effd700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 0x7f97800bf210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f977000e930 tx=0x7f9770009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.910+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770012600 con 0x7f97800bb590 2023-08-17T00:11:35.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.910+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770012760 con 0x7f97800bb590 2023-08-17T00:11:35.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.910+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9780154fb0 con 0x7f97800bb590 2023-08-17T00:11:35.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.910+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770012ae0 con 0x7f97800bb590 2023-08-17T00:11:35.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.910+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97800bf700 con 0x7f97800bb590 2023-08-17T00:11:35.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.910+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978006b4c0 con 0x7f97800bb590 2023-08-17T00:11:35.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.914+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9770022070 con 0x7f97800bb590 2023-08-17T00:11:35.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.914+0000 7f9766ffd700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f976c05a150 0x7f976c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:35.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.914+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9770074510 con 0x7f97800bb590 2023-08-17T00:11:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.914+0000 7f977e7fc700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f976c05a150 0x7f976c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:35.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.918+0000 7f977e7fc700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f976c05a150 0x7f976c05c610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f97800a9260 tx=0x7f9774007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:35.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:35.922+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9770047eb0 con 0x7f97800bb590 2023-08-17T00:11:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.118+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9780062a50 con 0x7f97800bb590 2023-08-17T00:11:36.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.118+0000 7f9766ffd700 1 -- 172.21.15.153:0/1129882283 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f977004b4d0 con 0x7f97800bb590 2023-08-17T00:11:36.123 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:36.124 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:36.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f976c05a150 msgr2=0x7f976c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f976c05a150 0x7f976c05c610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f97800a9260 tx=0x7f9774007d30).stop 2023-08-17T00:11:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 msgr2=0x7f97800bf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 0x7f97800bf210 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f977000e930 tx=0x7f9770009060).stop 2023-08-17T00:11:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 shutdown_connections 2023-08-17T00:11:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f976c05a150 0x7f976c05c610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9780157140 0x7f97801542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97800c15e0 0x7f97800a5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 --2- 172.21.15.153:0/1129882283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97800bb590 0x7f97800bf210 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 >> 172.21.15.153:0/1129882283 conn(0x7f97800c2fb0 msgr2=0x7f97800c4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 shutdown_connections 2023-08-17T00:11:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.122+0000 7f978561b700 1 -- 172.21.15.153:0/1129882283 wait complete. 2023-08-17T00:11:36.130 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:36.147 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:36.148 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.290+0000 7fae2759e700 1 Processor -- start 2023-08-17T00:11:36.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.290+0000 7fae2759e700 1 -- start start 2023-08-17T00:11:36.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae28068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae281585a0 con 0x7fae280a96d0 2023-08-17T00:11:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae28066400 con 0x7fae280a8df0 2023-08-17T00:11:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280c1ba0 con 0x7fae28068820 2023-08-17T00:11:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae26d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fae280a96d0 0x7fae280a9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36832/0 (socket says 172.21.15.153:36832) 2023-08-17T00:11:36.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae26d9d700 1 -- 172.21.15.153:0/889327035 learned_addr learned my addr 172.21.15.153:0/889327035 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae25d9b700 1 --2- 172.21.15.153:0/889327035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae28068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293217586 0 0) 0x7fae281585a0 con 0x7fae280a96d0 2023-08-17T00:11:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae100033f0 con 0x7fae280a96d0 2023-08-17T00:11:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980689057 0 0) 0x7fae28066400 con 0x7fae280a8df0 2023-08-17T00:11:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae281585a0 con 0x7fae280a8df0 2023-08-17T00:11:36.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae25d9b700 1 -- 172.21.15.153:0/889327035 >> v1:172.21.15.178:6789/0 conn(0x7fae280a8df0 legacy=0x7fae280c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae25d9b700 1 -- 172.21.15.153:0/889327035 >> v1:172.21.15.153:6789/0 conn(0x7fae280a96d0 legacy=0x7fae280a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae25d9b700 1 -- 172.21.15.153:0/889327035 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28069170 con 0x7fae28068820 2023-08-17T00:11:36.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae25d9b700 1 --2- 172.21.15.153:0/889327035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae28068c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fae1c009790 tx=0x7fae1c009060).ready entity=mon.2 client_cookie=6accf2983f639dbb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.294+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c00f510 con 0x7fae28068820 2023-08-17T00:11:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1c00f670 con 0x7fae28068820 2023-08-17T00:11:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2559a700 1 -- 172.21.15.153:0/889327035 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1c00f9f0 con 0x7fae28068820 2023-08-17T00:11:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 -- 172.21.15.153:0/889327035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 msgr2=0x7fae28068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 --2- 172.21.15.153:0/889327035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae28068c80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fae1c009790 tx=0x7fae1c009060).stop 2023-08-17T00:11:36.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 -- 172.21.15.153:0/889327035 shutdown_connections 2023-08-17T00:11:36.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 --2- 172.21.15.153:0/889327035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae28068c80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 -- 172.21.15.153:0/889327035 >> 172.21.15.153:0/889327035 conn(0x7fae280c6620 msgr2=0x7fae280c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:36.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 -- 172.21.15.153:0/889327035 shutdown_connections 2023-08-17T00:11:36.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 -- 172.21.15.153:0/889327035 wait complete. 2023-08-17T00:11:36.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 Processor -- start 2023-08-17T00:11:36.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.298+0000 7fae2759e700 1 -- start start 2023-08-17T00:11:36.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae2814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:36.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae280a8df0 0x7fae280bc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:36.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 0x7fae280aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae2814a630 con 0x7fae280a96d0 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae280bcfe0 con 0x7fae280a8df0 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae280ba530 con 0x7fae28068820 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 0x7fae280aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 0x7fae280aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43838/0 (socket says 172.21.15.153:43838) 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 -- 172.21.15.153:0/2806155438 learned_addr learned my addr 172.21.15.153:0/2806155438 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:36.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae25d9b700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae280a8df0 0x7fae280bc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:36.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2659c700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae2814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:36.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 -- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 msgr2=0x7fae2814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae2814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 -- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae280a8df0 msgr2=0x7fae280bc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae280a8df0 0x7fae280bc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 -- 172.21.15.153:0/2806155438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0092a0 con 0x7fae280a96d0 2023-08-17T00:11:36.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae26d9d700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 0x7fae280aaa90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fae20001560 tx=0x7fae200015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:36.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20005d30 con 0x7fae280a96d0 2023-08-17T00:11:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae20005e90 con 0x7fae280a96d0 2023-08-17T00:11:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae280ba810 con 0x7fae280a96d0 2023-08-17T00:11:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200072e0 con 0x7fae280a96d0 2023-08-17T00:11:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.302+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae280badd0 con 0x7fae280a96d0 2023-08-17T00:11:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.306+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae2806b4c0 con 0x7fae280a96d0 2023-08-17T00:11:36.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.306+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fae20010070 con 0x7fae280a96d0 2023-08-17T00:11:36.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.306+0000 7fae167fc700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae0805a150 0x7fae0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:36.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.306+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fae20073960 con 0x7fae280a96d0 2023-08-17T00:11:36.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.306+0000 7fae2659c700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae0805a150 0x7fae0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:36.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.310+0000 7fae2659c700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae0805a150 0x7fae0805c610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fae18001a60 tx=0x7fae18006f90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:36.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.314+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae20047410 con 0x7fae280a96d0 2023-08-17T00:11:36.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.526+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fae2805e300 con 0x7fae280a96d0 2023-08-17T00:11:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.526+0000 7fae167fc700 1 -- 172.21.15.153:0/2806155438 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1192 (secure 0 0 0) 0x7fae2004aa30 con 0x7fae280a96d0 2023-08-17T00:11:36.532 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:36.532 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":544,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":112,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1014,"data_bytes":1042114897,"bytes_used":4546969600,"bytes_avail":768547143680,"bytes_total":773094113280,"write_bytes_sec":42194220,"read_op_per_sec":0,"write_op_per_sec":41},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-08-17T00:10:51.353384+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae0805a150 msgr2=0x7fae0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae0805a150 0x7fae0805c610 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fae18001a60 tx=0x7fae18006f90).stop 2023-08-17T00:11:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 msgr2=0x7fae280aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 0x7fae280aaa90 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7fae20001560 tx=0x7fae200015b0).stop 2023-08-17T00:11:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 shutdown_connections 2023-08-17T00:11:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae0805a150 0x7fae0805c610 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae280a96d0 0x7fae280aaa90 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae280a8df0 0x7fae280bc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 --2- 172.21.15.153:0/2806155438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae28068820 0x7fae2814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:36.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 >> 172.21.15.153:0/2806155438 conn(0x7fae280c6620 msgr2=0x7fae28157a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:36.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.530+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 shutdown_connections 2023-08-17T00:11:36.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:36.534+0000 7fae2759e700 1 -- 172.21.15.153:0/2806155438 wait complete. 2023-08-17T00:11:36.556 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:11:37.557 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:37.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.718+0000 7fef5821b700 1 Processor -- start 2023-08-17T00:11:37.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.718+0000 7fef5821b700 1 -- start start 2023-08-17T00:11:37.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef5821b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef50151b90 0x7fef50151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:37.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef5821b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50063290 0x7fef50065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:37.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef5821b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef50061fa0 con 0x7fef50065b50 2023-08-17T00:11:37.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef5821b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef500c3fb0 con 0x7fef50151b90 2023-08-17T00:11:37.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef5821b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef50152460 con 0x7fef50063290 2023-08-17T00:11:37.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef557b6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50063290 0x7fef50065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:37.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef567b8700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fef50065b50 0x7fef50064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33274/0 (socket says 172.21.15.153:33274) 2023-08-17T00:11:37.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef567b8700 1 -- 172.21.15.153:0/1026556238 learned_addr learned my addr 172.21.15.153:0/1026556238 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:37.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef55fb7700 1 --2- 172.21.15.153:0/1026556238 >> v2:172.21.15.178:3300/0 conn(0x7fef50151b90 0x7fef50151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:37.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef54fb5700 1 -- 172.21.15.153:0/1026556238 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835044669 0 0) 0x7fef50061fa0 con 0x7fef50065b50 2023-08-17T00:11:37.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef557b6700 1 -- 172.21.15.153:0/1026556238 >> v2:172.21.15.178:3300/0 conn(0x7fef50151b90 msgr2=0x7fef50151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:37.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef557b6700 1 --2- 172.21.15.153:0/1026556238 >> v2:172.21.15.178:3300/0 conn(0x7fef50151b90 0x7fef50151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef557b6700 1 -- 172.21.15.153:0/1026556238 >> v1:172.21.15.178:6789/0 conn(0x7fef50065b50 legacy=0x7fef50064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:37.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef557b6700 1 -- 172.21.15.153:0/1026556238 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500621f0 con 0x7fef50063290 2023-08-17T00:11:37.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef557b6700 1 --2- 172.21.15.153:0/1026556238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50063290 0x7fef50065660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fef40009760 tx=0x7fef40009060).ready entity=mon.2 client_cookie=f5c3e16646fa695c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:37.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef54fb5700 1 -- 172.21.15.153:0/1026556238 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef400090d0 con 0x7fef50063290 2023-08-17T00:11:37.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef54fb5700 1 -- 172.21.15.153:0/1026556238 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4000f510 con 0x7fef50063290 2023-08-17T00:11:37.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.722+0000 7fef54fb5700 1 -- 172.21.15.153:0/1026556238 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4000f890 con 0x7fef50063290 2023-08-17T00:11:37.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 -- 172.21.15.153:0/1026556238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50063290 msgr2=0x7fef50065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:37.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 --2- 172.21.15.153:0/1026556238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50063290 0x7fef50065660 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fef40009760 tx=0x7fef40009060).stop 2023-08-17T00:11:37.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 -- 172.21.15.153:0/1026556238 shutdown_connections 2023-08-17T00:11:37.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 --2- 172.21.15.153:0/1026556238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50063290 0x7fef50065660 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 --2- 172.21.15.153:0/1026556238 >> v2:172.21.15.178:3300/0 conn(0x7fef50151b90 0x7fef50151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 -- 172.21.15.153:0/1026556238 >> 172.21.15.153:0/1026556238 conn(0x7fef500c7150 msgr2=0x7fef500c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:37.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 -- 172.21.15.153:0/1026556238 shutdown_connections 2023-08-17T00:11:37.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.726+0000 7fef5821b700 1 -- 172.21.15.153:0/1026556238 wait complete. 2023-08-17T00:11:37.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 Processor -- start 2023-08-17T00:11:37.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 -- start start 2023-08-17T00:11:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 0x7fef50167d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef50065b50 0x7fef50157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:37.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50151b90 0x7fef50158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50168cd0 con 0x7fef50063290 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5014ff40 con 0x7fef50065b50 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef50168220 con 0x7fef50151b90 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 0x7fef50167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 0x7fef50167d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43842/0 (socket says 172.21.15.153:43842) 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 -- 172.21.15.153:0/1355559073 learned_addr learned my addr 172.21.15.153:0/1355559073 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef557b6700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef50065b50 0x7fef50157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:37.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef567b8700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50151b90 0x7fef50158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:37.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 -- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50151b90 msgr2=0x7fef50158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:37.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50151b90 0x7fef50158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 -- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef50065b50 msgr2=0x7fef50157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:37.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef50065b50 0x7fef50157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 -- 172.21.15.153:0/1355559073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400092a0 con 0x7fef50063290 2023-08-17T00:11:37.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef567b8700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50151b90 0x7fef50158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef557b6700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef50065b50 0x7fef50157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef55fb7700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 0x7fef50167d30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fef4c00e930 tx=0x7fef4c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00c640 con 0x7fef50063290 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4c00c7a0 con 0x7fef50063290 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4c00cb20 con 0x7fef50063290 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.730+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef50156de0 con 0x7fef50063290 2023-08-17T00:11:37.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.734+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50168710 con 0x7fef50063290 2023-08-17T00:11:37.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.734+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50156bb0 con 0x7fef50063290 2023-08-17T00:11:37.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.734+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fef4c022070 con 0x7fef50063290 2023-08-17T00:11:37.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.738+0000 7fef45ffb700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef3405a150 0x7fef3405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:37.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.738+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fef4c0743d0 con 0x7fef50063290 2023-08-17T00:11:37.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.738+0000 7fef557b6700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef3405a150 0x7fef3405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:37.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.738+0000 7fef557b6700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef3405a150 0x7fef3405c610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fef40009fd0 tx=0x7fef40017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:37.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.746+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fef50156bb0 con 0x7fef50063290 2023-08-17T00:11:37.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.946+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef5006b530 con 0x7fef50063290 2023-08-17T00:11:37.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.946+0000 7fef45ffb700 1 -- 172.21.15.153:0/1355559073 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fef4c016020 con 0x7fef50063290 2023-08-17T00:11:37.952 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:37.952 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:37.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef3405a150 msgr2=0x7fef3405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:37.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef3405a150 0x7fef3405c610 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7fef40009fd0 tx=0x7fef40017000).stop 2023-08-17T00:11:37.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 msgr2=0x7fef50167d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:37.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 0x7fef50167d30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7fef4c00e930 tx=0x7fef4c009060).stop 2023-08-17T00:11:37.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 shutdown_connections 2023-08-17T00:11:37.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef3405a150 0x7fef3405c610 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef50151b90 0x7fef50158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef50065b50 0x7fef50157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 --2- 172.21.15.153:0/1355559073 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef50063290 0x7fef50167d30 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:37.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 >> 172.21.15.153:0/1355559073 conn(0x7fef500c7150 msgr2=0x7fef500c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:37.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 shutdown_connections 2023-08-17T00:11:37.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:37.954+0000 7fef5821b700 1 -- 172.21.15.153:0/1355559073 wait complete. 2023-08-17T00:11:37.958 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:37.975 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:38.029 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 Processor -- start 2023-08-17T00:11:38.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 -- start start 2023-08-17T00:11:38.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0ed80acf30 0x7f0ed80c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:38.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed8063bc0 0x7f0ed80bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:38.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed8154e90 con 0x7f0ed80c5ea0 2023-08-17T00:11:38.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed8153fc0 con 0x7f0ed80acf30 2023-08-17T00:11:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edeb07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8154280 con 0x7f0ed8063bc0 2023-08-17T00:11:38.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edd304700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0ed80c5ea0 0x7f0ed80634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36836/0 (socket says 172.21.15.153:36836) 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0edd304700 1 -- 172.21.15.153:0/2505070038 learned_addr learned my addr 172.21.15.153:0/2505070038 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0ede306700 1 --2- 172.21.15.153:0/2505070038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed8063bc0 0x7f0ed80bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.186+0000 7f0eddb05700 1 --2- 172.21.15.153:0/2505070038 >> v2:172.21.15.178:3300/0 conn(0x7f0ed80acf30 0x7f0ed80c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edcb03700 1 -- 172.21.15.153:0/2505070038 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183686920 0 0) 0x7f0ed8154e90 con 0x7f0ed80c5ea0 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0ede306700 1 -- 172.21.15.153:0/2505070038 >> v2:172.21.15.178:3300/0 conn(0x7f0ed80acf30 msgr2=0x7f0ed80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0ede306700 1 --2- 172.21.15.153:0/2505070038 >> v2:172.21.15.178:3300/0 conn(0x7f0ed80acf30 0x7f0ed80c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0ede306700 1 -- 172.21.15.153:0/2505070038 >> v1:172.21.15.153:6789/0 conn(0x7f0ed80c5ea0 legacy=0x7f0ed80634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0ede306700 1 -- 172.21.15.153:0/2505070038 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8154560 con 0x7f0ed8063bc0 2023-08-17T00:11:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0ede306700 1 --2- 172.21.15.153:0/2505070038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed8063bc0 0x7f0ed80bfad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0ed0009e60 tx=0x7f0ed0009780).ready entity=mon.2 client_cookie=6421d433415f1eb2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edcb03700 1 -- 172.21.15.153:0/2505070038 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed000e070 con 0x7f0ed8063bc0 2023-08-17T00:11:38.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edcb03700 1 -- 172.21.15.153:0/2505070038 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed000bb60 con 0x7f0ed8063bc0 2023-08-17T00:11:38.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edcb03700 1 -- 172.21.15.153:0/2505070038 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0012410 con 0x7f0ed8063bc0 2023-08-17T00:11:38.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 -- 172.21.15.153:0/2505070038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed8063bc0 msgr2=0x7f0ed80bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:38.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 --2- 172.21.15.153:0/2505070038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed8063bc0 0x7f0ed80bfad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f0ed0009e60 tx=0x7f0ed0009780).stop 2023-08-17T00:11:38.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 -- 172.21.15.153:0/2505070038 shutdown_connections 2023-08-17T00:11:38.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 --2- 172.21.15.153:0/2505070038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed8063bc0 0x7f0ed80bfad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 --2- 172.21.15.153:0/2505070038 >> v2:172.21.15.178:3300/0 conn(0x7f0ed80acf30 0x7f0ed80c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 -- 172.21.15.153:0/2505070038 >> 172.21.15.153:0/2505070038 conn(0x7f0ed80cb330 msgr2=0x7f0ed80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:38.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 -- 172.21.15.153:0/2505070038 shutdown_connections 2023-08-17T00:11:38.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.190+0000 7f0edeb07700 1 -- 172.21.15.153:0/2505070038 wait complete. 2023-08-17T00:11:38.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.194+0000 7f0edeb07700 1 Processor -- start 2023-08-17T00:11:38.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.194+0000 7f0edeb07700 1 -- start start 2023-08-17T00:11:38.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 0x7f0ed814a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:38.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ed80acf30 0x7f0ed80aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:38.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed80aef40 0x7f0ed814f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:38.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81584d0 con 0x7f0ed8063bc0 2023-08-17T00:11:38.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed81578c0 con 0x7f0ed80acf30 2023-08-17T00:11:38.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed8157ba0 con 0x7f0ed80aef40 2023-08-17T00:11:38.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 0x7f0ed814a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:38.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 0x7f0ed814a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43856/0 (socket says 172.21.15.153:43856) 2023-08-17T00:11:38.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 -- 172.21.15.153:0/1873584113 learned_addr learned my addr 172.21.15.153:0/1873584113 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:38.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0ede306700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed80aef40 0x7f0ed814f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:38.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edd304700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ed80acf30 0x7f0ed80aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:38.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 -- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed80aef40 msgr2=0x7f0ed814f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:38.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed80aef40 0x7f0ed814f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 -- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ed80acf30 msgr2=0x7f0ed80aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:38.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ed80acf30 0x7f0ed80aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 -- 172.21.15.153:0/1873584113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009a20 con 0x7f0ed8063bc0 2023-08-17T00:11:38.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edd304700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ed80acf30 0x7f0ed80aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:38.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0eddb05700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 0x7f0ed814a470 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f0ed400e930 tx=0x7f0ed4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:38.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400eed0 con 0x7f0ed8063bc0 2023-08-17T00:11:38.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed400c850 con 0x7f0ed8063bc0 2023-08-17T00:11:38.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed8157e80 con 0x7f0ed8063bc0 2023-08-17T00:11:38.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400cbd0 con 0x7f0ed8063bc0 2023-08-17T00:11:38.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.198+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed8157500 con 0x7f0ed8063bc0 2023-08-17T00:11:38.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.202+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed806b4c0 con 0x7f0ed8063bc0 2023-08-17T00:11:38.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.202+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0ed4022070 con 0x7f0ed8063bc0 2023-08-17T00:11:38.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.202+0000 7f0ecdffb700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ebc05a180 0x7f0ebc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:38.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.202+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0ed40745a0 con 0x7f0ed8063bc0 2023-08-17T00:11:38.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.202+0000 7f0edd304700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ebc05a180 0x7f0ebc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:38.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.206+0000 7f0edd304700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ebc05a180 0x7f0ebc05c640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f0ed80a9950 tx=0x7f0ec8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:38.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.210+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ed4048050 con 0x7f0ed8063bc0 2023-08-17T00:11:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.422+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0ed8154840 con 0x7f0ed8063bc0 2023-08-17T00:11:38.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.422+0000 7f0ecdffb700 1 -- 172.21.15.153:0/1873584113 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1192 (secure 0 0 0) 0x7f0ed404b670 con 0x7f0ed8063bc0 2023-08-17T00:11:38.427 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:38.427 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":546,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":112,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1014,"data_bytes":1042114897,"bytes_used":4546969600,"bytes_avail":768547143680,"bytes_total":773094113280,"write_bytes_sec":29932994,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":16,"modified":"2023-08-17T00:10:51.353384+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ebc05a180 msgr2=0x7f0ebc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ebc05a180 0x7f0ebc05c640 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f0ed80a9950 tx=0x7f0ec8009040).stop 2023-08-17T00:11:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 msgr2=0x7f0ed814a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 0x7f0ed814a470 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 rx=0x7f0ed400e930 tx=0x7f0ed4009060).stop 2023-08-17T00:11:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 shutdown_connections 2023-08-17T00:11:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ebc05a180 0x7f0ebc05c640 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ed80aef40 0x7f0ed814f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ed80acf30 0x7f0ed80aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 --2- 172.21.15.153:0/1873584113 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0ed8063bc0 0x7f0ed814a470 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:38.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 >> 172.21.15.153:0/1873584113 conn(0x7f0ed80cb330 msgr2=0x7f0ed80bfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:38.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 shutdown_connections 2023-08-17T00:11:38.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:38.426+0000 7f0edeb07700 1 -- 172.21.15.153:0/1873584113 wait complete. 2023-08-17T00:11:38.448 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:11:39.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:39.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 Processor -- start 2023-08-17T00:11:39.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 -- start start 2023-08-17T00:11:39.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff4740abf10 0x7ff474068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740ac2f0 0x7ff474068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4740c0a80 0x7ff4740c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff474069200 con 0x7ff4740c0a80 2023-08-17T00:11:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4741545e0 con 0x7ff4740abf10 2023-08-17T00:11:39.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff478bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740a96d0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4740c0a80 0x7ff4740c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff4740c0a80 0x7ff4740c0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43862/0 (socket says 172.21.15.153:43862) 2023-08-17T00:11:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff4737fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff4740abf10 0x7ff474068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 -- 172.21.15.153:0/2767231927 learned_addr learned my addr 172.21.15.153:0/2767231927 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:39.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff46bfff700 1 --2- 172.21.15.153:0/2767231927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740ac2f0 0x7ff474068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 -- 172.21.15.153:0/2767231927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740ac2f0 msgr2=0x7ff474068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 --2- 172.21.15.153:0/2767231927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740ac2f0 0x7ff474068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 -- 172.21.15.153:0/2767231927 >> v2:172.21.15.178:3300/0 conn(0x7ff4740abf10 msgr2=0x7ff474068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 --2- 172.21.15.153:0/2767231927 >> v2:172.21.15.178:3300/0 conn(0x7ff4740abf10 0x7ff474068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.606+0000 7ff473fff700 1 -- 172.21.15.153:0/2767231927 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740c1c50 con 0x7ff4740c0a80 2023-08-17T00:11:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff473fff700 1 --2- 172.21.15.153:0/2767231927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740c0a80 0x7ff4740c0ed0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7ff4740c3f30 tx=0x7ff46c009840).ready entity=mon.0 client_cookie=7311cf04e01724b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff472ffd700 1 -- 172.21.15.153:0/2767231927 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00e070 con 0x7ff4740c0a80 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff472ffd700 1 -- 172.21.15.153:0/2767231927 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c00ba20 con 0x7ff4740c0a80 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff472ffd700 1 -- 172.21.15.153:0/2767231927 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c00bda0 con 0x7ff4740c0a80 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 -- 172.21.15.153:0/2767231927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740c0a80 msgr2=0x7ff4740c0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 --2- 172.21.15.153:0/2767231927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740c0a80 0x7ff4740c0ed0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7ff4740c3f30 tx=0x7ff46c009840).stop 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 -- 172.21.15.153:0/2767231927 shutdown_connections 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 --2- 172.21.15.153:0/2767231927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740ac2f0 0x7ff474068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 --2- 172.21.15.153:0/2767231927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740c0a80 0x7ff4740c0ed0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 --2- 172.21.15.153:0/2767231927 >> v2:172.21.15.178:3300/0 conn(0x7ff4740abf10 0x7ff474068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 -- 172.21.15.153:0/2767231927 >> 172.21.15.153:0/2767231927 conn(0x7ff4740c6620 msgr2=0x7ff4740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 -- 172.21.15.153:0/2767231927 shutdown_connections 2023-08-17T00:11:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.610+0000 7ff478bb9700 1 -- 172.21.15.153:0/2767231927 wait complete. 2023-08-17T00:11:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 Processor -- start 2023-08-17T00:11:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 -- start start 2023-08-17T00:11:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740abf10 0x7ff4740c0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 0x7ff4740ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740c0a80 0x7ff4740ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740abbd0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741499a0 con 0x7ff4740c0a80 2023-08-17T00:11:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff478bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47414a100 con 0x7ff4740abf10 2023-08-17T00:11:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 0x7ff4740ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 0x7ff4740ab1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43878/0 (socket says 172.21.15.153:43878) 2023-08-17T00:11:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 -- 172.21.15.153:0/919642292 learned_addr learned my addr 172.21.15.153:0/919642292 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff4737fe700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740abf10 0x7ff4740c0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff473fff700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740c0a80 0x7ff4740ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 -- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740abf10 msgr2=0x7ff4740c0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740abf10 0x7ff4740c0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 -- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740c0a80 msgr2=0x7ff4740ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740c0a80 0x7ff4740ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 -- 172.21.15.153:0/919642292 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c009ae0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.614+0000 7ff46bfff700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 0x7ff4740ab1f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7ff45c00d890 tx=0x7ff45c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0125f0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c012750 con 0x7ff4740ac2f0 2023-08-17T00:11:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c012ad0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4741645e0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff474163f90 con 0x7ff4740ac2f0 2023-08-17T00:11:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474164770 con 0x7ff4740ac2f0 2023-08-17T00:11:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.618+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff45c013480 con 0x7ff4740ac2f0 2023-08-17T00:11:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.622+0000 7ff46b7fe700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff45405a180 0x7ff45405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.622+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6237+0+0 (secure 0 0 0) 0x7ff45c0740e0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.622+0000 7ff4737fe700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff45405a180 0x7ff45405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.622+0000 7ff4737fe700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff45405a180 0x7ff45405c640 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff464009200 tx=0x7ff464008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:39.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.626+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff45c0479b0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.822+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff47406b4c0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff46b7fe700 1 -- 172.21.15.153:0/919642292 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7ff45c04afd0 con 0x7ff4740ac2f0 2023-08-17T00:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:39.829 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff45405a180 msgr2=0x7ff45405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff45405a180 0x7ff45405c640 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7ff464009200 tx=0x7ff464008040).stop 2023-08-17T00:11:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 msgr2=0x7ff4740ab1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 0x7ff4740ab1f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7ff45c00d890 tx=0x7ff45c008040).stop 2023-08-17T00:11:39.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 shutdown_connections 2023-08-17T00:11:39.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff45405a180 0x7ff45405c640 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4740c0a80 0x7ff4740ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4740ac2f0 0x7ff4740ab1f0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 --2- 172.21.15.153:0/919642292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4740abf10 0x7ff4740c0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 >> 172.21.15.153:0/919642292 conn(0x7ff4740c6620 msgr2=0x7ff47414ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 shutdown_connections 2023-08-17T00:11:39.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:39.826+0000 7ff478bb9700 1 -- 172.21.15.153:0/919642292 wait complete. 2023-08-17T00:11:39.834 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:39.850 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:39.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:40.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.002+0000 7f7023e1b700 1 Processor -- start 2023-08-17T00:11:40.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.002+0000 7f7023e1b700 1 -- start start 2023-08-17T00:11:40.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f701c0632e0 0x7f701c0a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f701c0629b0 0x7f701c0bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701c065240 con 0x7f701c0a8b70 2023-08-17T00:11:40.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c0638a0 con 0x7f701c0632e0 2023-08-17T00:11:40.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c065de0 con 0x7f701c0629b0 2023-08-17T00:11:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f701c0632e0 0x7f701c0a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f701c0632e0 0x7f701c0a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43890/0 (socket says 172.21.15.153:43890) 2023-08-17T00:11:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 -- 172.21.15.153:0/2782437345 learned_addr learned my addr 172.21.15.153:0/2782437345 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70223b8700 1 --2- 172.21.15.153:0/2782437345 >> v2:172.21.15.178:3300/0 conn(0x7f701c0629b0 0x7f701c0bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 -- 172.21.15.153:0/2782437345 >> v2:172.21.15.178:3300/0 conn(0x7f701c0629b0 msgr2=0x7f701c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 --2- 172.21.15.153:0/2782437345 >> v2:172.21.15.178:3300/0 conn(0x7f701c0629b0 0x7f701c0bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 -- 172.21.15.153:0/2782437345 >> v1:172.21.15.178:6789/0 conn(0x7f701c0a8b70 legacy=0x7f701c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 -- 172.21.15.153:0/2782437345 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c062e20 con 0x7f701c0632e0 2023-08-17T00:11:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70223b8700 1 --2- 172.21.15.153:0/2782437345 >> v2:172.21.15.178:3300/0 conn(0x7f701c0629b0 0x7f701c0bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:40.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f70213b6700 1 --2- 172.21.15.153:0/2782437345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c0a8f50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f701c069b10 tx=0x7f700c0090f0).ready entity=mon.0 client_cookie=554da0cc61ba7eb6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7020bb5700 1 -- 172.21.15.153:0/2782437345 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00b5a0 con 0x7f701c0632e0 2023-08-17T00:11:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7020bb5700 1 -- 172.21.15.153:0/2782437345 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00b700 con 0x7f701c0632e0 2023-08-17T00:11:40.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7020bb5700 1 -- 172.21.15.153:0/2782437345 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00ba80 con 0x7f701c0632e0 2023-08-17T00:11:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- 172.21.15.153:0/2782437345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 msgr2=0x7f701c0a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 --2- 172.21.15.153:0/2782437345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c0a8f50 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f701c069b10 tx=0x7f700c0090f0).stop 2023-08-17T00:11:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- 172.21.15.153:0/2782437345 shutdown_connections 2023-08-17T00:11:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 --2- 172.21.15.153:0/2782437345 >> v2:172.21.15.178:3300/0 conn(0x7f701c0629b0 0x7f701c0bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 --2- 172.21.15.153:0/2782437345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c0a8f50 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- 172.21.15.153:0/2782437345 >> 172.21.15.153:0/2782437345 conn(0x7f701c0c7150 msgr2=0x7f701c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- 172.21.15.153:0/2782437345 shutdown_connections 2023-08-17T00:11:40.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.006+0000 7f7023e1b700 1 -- 172.21.15.153:0/2782437345 wait complete. 2023-08-17T00:11:40.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.010+0000 7f7023e1b700 1 Processor -- start 2023-08-17T00:11:40.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.010+0000 7f7023e1b700 1 -- start start 2023-08-17T00:11:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c0629b0 0x7f701c0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c0a8b70 0x7f701c0bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0ab260 con 0x7f701c0632e0 2023-08-17T00:11:40.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0ab500 con 0x7f701c0629b0 2023-08-17T00:11:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c0ab7e0 con 0x7f701c0a8b70 2023-08-17T00:11:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43904/0 (socket says 172.21.15.153:43904) 2023-08-17T00:11:40.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 -- 172.21.15.153:0/48502842 learned_addr learned my addr 172.21.15.153:0/48502842 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7021bb7700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c0629b0 0x7f701c0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70223b8700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c0a8b70 0x7f701c0bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 -- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c0a8b70 msgr2=0x7f701c0bbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c0a8b70 0x7f701c0bbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 -- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c0629b0 msgr2=0x7f701c0ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c0629b0 0x7f701c0ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 -- 172.21.15.153:0/48502842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c009370 con 0x7f701c0632e0 2023-08-17T00:11:40.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70223b8700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c0a8b70 0x7f701c0bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f70213b6700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c158aa0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f700c009130 tx=0x7f700c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00b870 con 0x7f701c0632e0 2023-08-17T00:11:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c0abac0 con 0x7f701c0632e0 2023-08-17T00:11:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00b9d0 con 0x7f701c0632e0 2023-08-17T00:11:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c01c670 con 0x7f701c0632e0 2023-08-17T00:11:40.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.014+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c0aad50 con 0x7f701c0632e0 2023-08-17T00:11:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.018+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c06b530 con 0x7f701c0632e0 2023-08-17T00:11:40.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.018+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f700c02c070 con 0x7f701c0632e0 2023-08-17T00:11:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.018+0000 7f7011ffb700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f700005a150 0x7f700005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.018+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f700c075f60 con 0x7f701c0632e0 2023-08-17T00:11:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.018+0000 7f7021bb7700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f700005a150 0x7f700005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.022+0000 7f7021bb7700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f700005a150 0x7f700005c610 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f7018006fd0 tx=0x7f7018009250).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.026+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f700c049890 con 0x7f701c0632e0 2023-08-17T00:11:40.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.238+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f701c064910 con 0x7f701c0632e0 2023-08-17T00:11:40.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.242+0000 7f7011ffb700 1 -- 172.21.15.153:0/48502842 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7f700c02a080 con 0x7f701c0632e0 2023-08-17T00:11:40.244 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:40.245 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":547,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075882526,"bytes_used":4652253184,"bytes_avail":768441860096,"bytes_total":773094113280,"write_bytes_sec":32748353,"read_op_per_sec":0,"write_op_per_sec":32},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-08-17T00:11:39.372587+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f700005a150 msgr2=0x7f700005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f700005a150 0x7f700005c610 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f7018006fd0 tx=0x7f7018009250).stop 2023-08-17T00:11:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 msgr2=0x7f701c158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c158aa0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f700c009130 tx=0x7f700c015000).stop 2023-08-17T00:11:40.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 shutdown_connections 2023-08-17T00:11:40.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f700005a150 0x7f700005c610 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c0a8b70 0x7f701c0bbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f701c0632e0 0x7f701c158aa0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 --2- 172.21.15.153:0/48502842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c0629b0 0x7f701c0ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 >> 172.21.15.153:0/48502842 conn(0x7f701c0c7150 msgr2=0x7f701c0c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 shutdown_connections 2023-08-17T00:11:40.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.246+0000 7f7023e1b700 1 -- 172.21.15.153:0/48502842 wait complete. 2023-08-17T00:11:40.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2023-08-17T00:11:40.268 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub resume 2023-08-17T00:11:40.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.422+0000 7f7230369700 1 Processor -- start 2023-08-17T00:11:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.422+0000 7f7230369700 1 -- start start 2023-08-17T00:11:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f7230369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f7228151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f7230369700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7228063290 0x7f7228065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f7230369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7228061fa0 con 0x7f7228065b50 2023-08-17T00:11:40.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f7230369700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72280c3fb0 con 0x7f7228063290 2023-08-17T00:11:40.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f7230369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7228152460 con 0x7f7228151b90 2023-08-17T00:11:40.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e906700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7228065b50 0x7f7228064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36846/0 (socket says 172.21.15.153:36846) 2023-08-17T00:11:40.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e906700 1 -- 172.21.15.153:0/3763099015 learned_addr learned my addr 172.21.15.153:0/3763099015 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:40.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722d904700 1 --2- 172.21.15.153:0/3763099015 >> v2:172.21.15.153:3300/0 conn(0x7f7228063290 0x7f7228065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e105700 1 --2- 172.21.15.153:0/3763099015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f7228151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722d103700 1 -- 172.21.15.153:0/3763099015 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270103648 0 0) 0x7f7228061fa0 con 0x7f7228065b50 2023-08-17T00:11:40.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722d103700 1 -- 172.21.15.153:0/3763099015 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72140033f0 con 0x7f7228065b50 2023-08-17T00:11:40.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e105700 1 -- 172.21.15.153:0/3763099015 >> v2:172.21.15.153:3300/0 conn(0x7f7228063290 msgr2=0x7f7228065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e105700 1 --2- 172.21.15.153:0/3763099015 >> v2:172.21.15.153:3300/0 conn(0x7f7228063290 0x7f7228065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e105700 1 -- 172.21.15.153:0/3763099015 >> v1:172.21.15.153:6789/0 conn(0x7f7228065b50 legacy=0x7f7228064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e105700 1 -- 172.21.15.153:0/3763099015 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280621f0 con 0x7f7228151b90 2023-08-17T00:11:40.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722e105700 1 --2- 172.21.15.153:0/3763099015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f7228151f70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7224009760 tx=0x7f7224009060).ready entity=mon.2 client_cookie=92fe5768a4422007 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722d103700 1 -- 172.21.15.153:0/3763099015 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400d4a0 con 0x7f7228151b90 2023-08-17T00:11:40.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722d103700 1 -- 172.21.15.153:0/3763099015 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722400d600 con 0x7f7228151b90 2023-08-17T00:11:40.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.426+0000 7f722d103700 1 -- 172.21.15.153:0/3763099015 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400d980 con 0x7f7228151b90 2023-08-17T00:11:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 -- 172.21.15.153:0/3763099015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 msgr2=0x7f7228151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 --2- 172.21.15.153:0/3763099015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f7228151f70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f7224009760 tx=0x7f7224009060).stop 2023-08-17T00:11:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 -- 172.21.15.153:0/3763099015 shutdown_connections 2023-08-17T00:11:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 --2- 172.21.15.153:0/3763099015 >> v2:172.21.15.153:3300/0 conn(0x7f7228063290 0x7f7228065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 --2- 172.21.15.153:0/3763099015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f7228151f70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 -- 172.21.15.153:0/3763099015 >> 172.21.15.153:0/3763099015 conn(0x7f72280c7150 msgr2=0x7f72280c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 -- 172.21.15.153:0/3763099015 shutdown_connections 2023-08-17T00:11:40.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 -- 172.21.15.153:0/3763099015 wait complete. 2023-08-17T00:11:40.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 Processor -- start 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.430+0000 7f7230369700 1 -- start start 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7228063290 0x7f72280a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 0x7f7228154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f72280aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72281525d0 con 0x7f7228065b50 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280a6f70 con 0x7f7228063290 2023-08-17T00:11:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72280a6360 con 0x7f7228151b90 2023-08-17T00:11:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 0x7f7228154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 0x7f7228154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43934/0 (socket says 172.21.15.153:43934) 2023-08-17T00:11:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 -- 172.21.15.153:0/2433961663 learned_addr learned my addr 172.21.15.153:0/2433961663 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722e906700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f72280aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722e105700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7228063290 0x7f72280a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 -- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 msgr2=0x7f72280aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f72280aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 -- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7228063290 msgr2=0x7f72280a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7228063290 0x7f72280a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 -- 172.21.15.153:0/2433961663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72240092a0 con 0x7f7228065b50 2023-08-17T00:11:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722e105700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7228063290 0x7f72280a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f722d904700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 0x7f7228154de0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f721800e900 tx=0x7f7218009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f721e7fc700 1 -- 172.21.15.153:0/2433961663 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800c670 con 0x7f7228065b50 2023-08-17T00:11:40.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f721e7fc700 1 -- 172.21.15.153:0/2433961663 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721800c7d0 con 0x7f7228065b50 2023-08-17T00:11:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f721e7fc700 1 -- 172.21.15.153:0/2433961663 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800cb50 con 0x7f7228065b50 2023-08-17T00:11:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72280a6640 con 0x7f7228065b50 2023-08-17T00:11:40.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.434+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72280a6c00 con 0x7f7228065b50 2023-08-17T00:11:40.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.438+0000 7f721e7fc700 1 -- 172.21.15.153:0/2433961663 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7218022070 con 0x7f7228065b50 2023-08-17T00:11:40.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.438+0000 7f721e7fc700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f720c05a120 0x7f720c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.438+0000 7f721e7fc700 1 -- 172.21.15.153:0/2433961663 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f7218074510 con 0x7f7228065b50 2023-08-17T00:11:40.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.438+0000 7f722e105700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f720c05a120 0x7f720c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722e105700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f720c05a120 0x7f720c05c5e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f722400d260 tx=0x7f7224016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 Processor -- start 2023-08-17T00:11:40.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 -- start start 2023-08-17T00:11:40.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a63d20 0x1a64100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 0x1a6e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47ce0 0x1a6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x196e1a0 con 0x1a47860 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a22300 con 0x1a63d20 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a21730 con 0x1a47ce0 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 0x1a6e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 0x1a6e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43950/0 (socket says 172.21.15.153:43950) 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 -- 172.21.15.153:0/3073057582 learned_addr learned my addr 172.21.15.153:0/3073057582 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722e906700 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47ce0 0x1a6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722e105700 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a63d20 0x1a64100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 -- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47ce0 msgr2=0x1a6e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47ce0 0x1a6e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 -- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a63d20 msgr2=0x1a64100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a63d20 0x1a64100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.442+0000 7f722d904700 1 -- 172.21.15.153:0/3073057582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x199c010 con 0x1a47860 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f722d904700 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 0x1a6e140 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f721804b750 tx=0x7f7218074040).ready entity=mon.0 client_cookie=307d190c07fb1681 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f720b7fe700 1 -- 172.21.15.153:0/3073057582 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72180512d0 con 0x1a47860 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f720b7fe700 1 -- 172.21.15.153:0/3073057582 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218049fb0 con 0x1a47860 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f720b7fe700 1 -- 172.21.15.153:0/3073057582 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218072720 con 0x1a47860 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 -- 172.21.15.153:0/3073057582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 msgr2=0x1a6e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 0x1a6e140 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7f721804b750 tx=0x7f7218074040).stop 2023-08-17T00:11:40.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 -- 172.21.15.153:0/3073057582 shutdown_connections 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47ce0 0x1a6e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47860 0x1a6e140 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 --2- 172.21.15.153:0/3073057582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a63d20 0x1a64100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 -- 172.21.15.153:0/3073057582 >> 172.21.15.153:0/3073057582 conn(0x1801680 msgr2=0x1a227d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 -- 172.21.15.153:0/3073057582 shutdown_connections 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 -- 172.21.15.153:0/3073057582 wait complete. 2023-08-17T00:11:40.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 -- start start 2023-08-17T00:11:40.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.446+0000 7f723a726740 1 Processor -- start 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a49b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a4d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a68d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4a530 con 0x1a47ce0 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4bec0 con 0x1a47860 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4cd20 con 0x1a63d20 2023-08-17T00:11:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 10 client.0 ll_register_callbacks cb 0x19d9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a4d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a4d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43962/0 (socket says 172.21.15.153:43962) 2023-08-17T00:11:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722e105700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a49b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 -- 172.21.15.153:0/79284902 learned_addr learned my addr 172.21.15.153:0/79284902 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722e906700 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a68d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 -- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 msgr2=0x1a68d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a68d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 -- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 msgr2=0x1a49b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a49b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 -- 172.21.15.153:0/79284902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72280a6c00 con 0x1a47ce0 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f722d904700 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a4d1b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f7218006980 tx=0x7f7218050000).ready entity=mon.0 client_cookie=b5fc9a5b5e0438d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f7208ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f7208ff9700 1 -- 172.21.15.153:0/79284902 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721804b310 con 0x1a47ce0 2023-08-17T00:11:40.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f7208ff9700 1 -- 172.21.15.153:0/79284902 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f721804be40 con 0x1a47ce0 2023-08-17T00:11:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x196a200 con 0x1a47ce0 2023-08-17T00:11:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f7208ff9700 1 -- 172.21.15.153:0/79284902 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7218074240 con 0x1a47ce0 2023-08-17T00:11:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 10 client.7716 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.450+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x19974b0 con 0x1a47ce0 2023-08-17T00:11:40.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f7208ff9700 1 -- 172.21.15.153:0/79284902 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x196a200 con 0x1a47ce0 2023-08-17T00:11:40.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f7208ff9700 1 -- 172.21.15.153:0/79284902 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7218047a00 con 0x1a47ce0 2023-08-17T00:11:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 10 client.7716 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 10 client.7716 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 20 client.7716 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a5f750 0x1a60e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 4 client.7716 mds_command: new command op to 7470 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:11:40.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1998cf0 con 0x1a5f750 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f722e105700 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a5f750 0x1a60e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f722e105700 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a5f750 0x1a60e80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d1fbdd1b14f622af server_cookie=55a020d83119a683 in_seq=0 out_seq=0 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f7208ff9700 10 client.7716 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f7208ff9700 1 -- 172.21.15.153:0/79284902 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1998cf0 con 0x1a5f750 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f7208ff9700 10 client.7716 handle_command_reply: tid=0 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 client.7716 shutdown 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 msgr2=0x1a4d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a4d1b0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 rx=0x7f7218006980 tx=0x7f7218050000).stop 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 shutdown_connections 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.454+0000 7f723a726740 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a5f750 0x1a60e80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a68d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f7208ff9700 0 client.7716 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a4d1b0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 1 --2- 172.21.15.153:0/79284902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a49b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 >> 172.21.15.153:0/79284902 conn(0x1801680 msgr2=0x1a46e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 shutdown_connections 2023-08-17T00:11:40.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 1 -- 172.21.15.153:0/79284902 wait complete. 2023-08-17T00:11:40.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.458+0000 7f723a726740 20 client.7716 trim_cache size 0 max 16384 2023-08-17T00:11:40.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 Processor -- start 2023-08-17T00:11:40.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 -- start start 2023-08-17T00:11:40.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a1cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a61ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a623b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1977f60 con 0x1a47ce0 2023-08-17T00:11:40.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a21190 con 0x1a47860 2023-08-17T00:11:40.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.474+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a22090 con 0x1a63d20 2023-08-17T00:11:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722e105700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a1cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a61ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722e105700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a1cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:43068/0 (socket says 172.21.15.153:43068) 2023-08-17T00:11:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722e105700 1 -- 172.21.15.153:0/879826191 learned_addr learned my addr 172.21.15.153:0/879826191 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722e906700 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 -- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 msgr2=0x1a623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 -- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 msgr2=0x1a1cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a1cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 -- 172.21.15.153:0/879826191 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280ab6a0 con 0x1a47ce0 2023-08-17T00:11:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.478+0000 7f722d904700 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a61ec0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f721804bb40 tx=0x7f7218057000).ready entity=mon.0 client_cookie=e3ee46e4d13671 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f720bfff700 1 -- 172.21.15.153:0/879826191 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721800e030 con 0x1a47ce0 2023-08-17T00:11:40.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f720bfff700 1 -- 172.21.15.153:0/879826191 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721804b310 con 0x1a47ce0 2023-08-17T00:11:40.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f720bfff700 1 -- 172.21.15.153:0/879826191 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7218049d50 con 0x1a47ce0 2023-08-17T00:11:40.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 -- 172.21.15.153:0/879826191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 msgr2=0x1a61ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a61ec0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 rx=0x7f721804bb40 tx=0x7f7218057000).stop 2023-08-17T00:11:40.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 -- 172.21.15.153:0/879826191 shutdown_connections 2023-08-17T00:11:40.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a63d20 0x1a623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a47ce0 0x1a61ec0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 --2- 172.21.15.153:0/879826191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47860 0x1a1cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 -- 172.21.15.153:0/879826191 >> 172.21.15.153:0/879826191 conn(0x1801680 msgr2=0x1a427b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 -- 172.21.15.153:0/879826191 shutdown_connections 2023-08-17T00:11:40.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 -- 172.21.15.153:0/879826191 wait complete. 2023-08-17T00:11:40.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 -- start start 2023-08-17T00:11:40.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.482+0000 7f723a726740 1 Processor -- start 2023-08-17T00:11:40.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47860 0x1a67470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47ce0 0x1a1c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 0x1a76660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a47650 con 0x1a63d20 2023-08-17T00:11:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a67ef0 con 0x1a47ce0 2023-08-17T00:11:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a4a840 con 0x1a47860 2023-08-17T00:11:40.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f723a726740 10 client.0 ll_register_callbacks cb 0x7f721804bcb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:40.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 0x1a76660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 0x1a76660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43976/0 (socket says 172.21.15.153:43976) 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e906700 1 -- 172.21.15.153:0/2560023878 learned_addr learned my addr 172.21.15.153:0/2560023878 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47860 0x1a67470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722d904700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47ce0 0x1a1c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 -- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47ce0 msgr2=0x1a1c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47ce0 0x1a1c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 -- 172.21.15.153:0/2560023878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 msgr2=0x1a76660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 0x1a76660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 -- 172.21.15.153:0/2560023878 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x19974b0 con 0x1a47860 2023-08-17T00:11:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e906700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 0x1a76660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f722e105700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47860 0x1a67470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7224009240 tx=0x7f7224030280).ready entity=mon.2 client_cookie=6687e99dafd6d171 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.486+0000 7f7208ff9700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2023-08-17T00:11:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.498+0000 7f7208ff9700 1 -- 172.21.15.153:0/2560023878 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400d770 con 0x1a47860 2023-08-17T00:11:40.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.498+0000 7f7208ff9700 1 -- 172.21.15.153:0/2560023878 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f722402bcc0 con 0x1a47860 2023-08-17T00:11:40.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7218049fb0 con 0x1a47860 2023-08-17T00:11:40.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f7208ff9700 1 -- 172.21.15.153:0/2560023878 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f722402bec0 con 0x1a47860 2023-08-17T00:11:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 10 client.6644 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x1997200 con 0x1a47860 2023-08-17T00:11:40.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f7208ff9700 1 -- 172.21.15.153:0/2560023878 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7218049fb0 con 0x1a47860 2023-08-17T00:11:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f7208ff9700 1 -- 172.21.15.153:0/2560023878 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7224011820 con 0x1a47860 2023-08-17T00:11:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 10 client.6644 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 10 client.6644 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 20 client.6644 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a76b50 0x1acde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.502+0000 7f723a726740 4 client.6644 mds_command: new command op to 7470 tid=0[{"prefix": "scrub resume"}] 2023-08-17T00:11:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f722d904700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a76b50 0x1acde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x198f240 con 0x1a76b50 2023-08-17T00:11:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f722d904700 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a76b50 0x1acde70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a4d685c76c7a36cb server_cookie=57b31e67825720f9 in_seq=0 out_seq=0 2023-08-17T00:11:40.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7208ff9700 10 client.6644 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7208ff9700 1 -- 172.21.15.153:0/2560023878 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x198f240 con 0x1a76b50 2023-08-17T00:11:40.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7208ff9700 10 client.6644 handle_command_reply: tid=0 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 client.6644 shutdown 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47860 msgr2=0x1a67470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47860 0x1a67470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f7224009240 tx=0x7f7224030280).stop 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 shutdown_connections 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x1a76b50 0x1acde70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a63d20 0x1a76660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a47ce0 0x1a1c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 --2- 172.21.15.153:0/2560023878 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a47860 0x1a67470 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 >> 172.21.15.153:0/2560023878 conn(0x1801680 msgr2=0x1a61ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7208ff9700 0 client.6644 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 shutdown_connections 2023-08-17T00:11:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 1 -- 172.21.15.153:0/2560023878 wait complete. 2023-08-17T00:11:40.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f723a726740 20 client.6644 trim_cache size 0 max 16384 2023-08-17T00:11:40.513 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:11:40.513 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:11:40.513 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:11:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f720c05a120 msgr2=0x7f720c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7230369700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f720c05a120 0x7f720c05c5e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f722400d260 tx=0x7f7224016000).stop 2023-08-17T00:11:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 msgr2=0x7f7228154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.506+0000 7f7230369700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 0x7f7228154de0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7f721800e900 tx=0x7f7218009060).stop 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 shutdown_connections 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f720c05a120 0x7f720c05c5e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7228151b90 0x7f72280aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7228065b50 0x7f7228154de0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 --2- 172.21.15.153:0/2433961663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7228063290 0x7f72280a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 >> 172.21.15.153:0/2433961663 conn(0x7f72280c7150 msgr2=0x7f7228150650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 shutdown_connections 2023-08-17T00:11:40.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.510+0000 7f7230369700 1 -- 172.21.15.153:0/2433961663 wait complete. 2023-08-17T00:11:40.535 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-08-17T00:11:40.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.710+0000 7f12cb507700 1 Processor -- start 2023-08-17T00:11:40.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.710+0000 7f12cb507700 1 -- start start 2023-08-17T00:11:40.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cb507700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12c4154b40 0x7f12c4154f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cb507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f12c4068e90 0x7f12c40bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cb507700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c40be9e0 con 0x7f12c40bee70 2023-08-17T00:11:40.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cb507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40692d0 con 0x7f12c4068e90 2023-08-17T00:11:40.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cb507700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c40aae40 con 0x7f12c4154b40 2023-08-17T00:11:40.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12c9d04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f12c4068e90 0x7f12c40bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cad06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f12c40bee70 0x7f12c4067e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36850/0 (socket says 172.21.15.153:36850) 2023-08-17T00:11:40.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12cad06700 1 -- 172.21.15.153:0/188599099 learned_addr learned my addr 172.21.15.153:0/188599099 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:40.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12ca505700 1 --2- 172.21.15.153:0/188599099 >> v2:172.21.15.178:3300/0 conn(0x7f12c4154b40 0x7f12c4154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12c9d04700 1 -- 172.21.15.153:0/188599099 >> v2:172.21.15.178:3300/0 conn(0x7f12c4154b40 msgr2=0x7f12c4154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12c9d04700 1 --2- 172.21.15.153:0/188599099 >> v2:172.21.15.178:3300/0 conn(0x7f12c4154b40 0x7f12c4154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12c9d04700 1 -- 172.21.15.153:0/188599099 >> v1:172.21.15.153:6789/0 conn(0x7f12c40bee70 legacy=0x7f12c4067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12c9d04700 1 -- 172.21.15.153:0/188599099 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40bddd0 con 0x7f12c4068e90 2023-08-17T00:11:40.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.714+0000 7f12c9503700 1 -- 172.21.15.153:0/188599099 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260710892 0 0) 0x7f12c40be9e0 con 0x7f12c40bee70 2023-08-17T00:11:40.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12c9d04700 1 --2- 172.21.15.153:0/188599099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4068e90 0x7f12c40bd5f0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f12c406a160 tx=0x7f12b4009060).ready entity=mon.0 client_cookie=a56ed81f8aa79d6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12c9503700 1 -- 172.21.15.153:0/188599099 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40090d0 con 0x7f12c4068e90 2023-08-17T00:11:40.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12c9503700 1 -- 172.21.15.153:0/188599099 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b400f510 con 0x7f12c4068e90 2023-08-17T00:11:40.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12c9503700 1 -- 172.21.15.153:0/188599099 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b400f890 con 0x7f12c4068e90 2023-08-17T00:11:40.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 -- 172.21.15.153:0/188599099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4068e90 msgr2=0x7f12c40bd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 --2- 172.21.15.153:0/188599099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4068e90 0x7f12c40bd5f0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7f12c406a160 tx=0x7f12b4009060).stop 2023-08-17T00:11:40.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 -- 172.21.15.153:0/188599099 shutdown_connections 2023-08-17T00:11:40.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 --2- 172.21.15.153:0/188599099 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4068e90 0x7f12c40bd5f0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 --2- 172.21.15.153:0/188599099 >> v2:172.21.15.178:3300/0 conn(0x7f12c4154b40 0x7f12c4154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 -- 172.21.15.153:0/188599099 >> 172.21.15.153:0/188599099 conn(0x7f12c40c9160 msgr2=0x7f12c40c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 -- 172.21.15.153:0/188599099 shutdown_connections 2023-08-17T00:11:40.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.718+0000 7f12cb507700 1 -- 172.21.15.153:0/188599099 wait complete. 2023-08-17T00:11:40.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 Processor -- start 2023-08-17T00:11:40.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 -- start start 2023-08-17T00:11:40.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c4068e90 0x7f12c413c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c40bee70 0x7f12c40a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 0x7f12c40a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4164c20 con 0x7f12c4154b40 2023-08-17T00:11:40.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4165bc0 con 0x7f12c40bee70 2023-08-17T00:11:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cb507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4165730 con 0x7f12c4068e90 2023-08-17T00:11:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 0x7f12c40a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 0x7f12c40a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44002/0 (socket says 172.21.15.153:44002) 2023-08-17T00:11:40.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 -- 172.21.15.153:0/306486249 learned_addr learned my addr 172.21.15.153:0/306486249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12ca505700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c4068e90 0x7f12c413c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12c9d04700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c40bee70 0x7f12c40a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 -- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c4068e90 msgr2=0x7f12c413c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c4068e90 0x7f12c413c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 -- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c40bee70 msgr2=0x7f12c40a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c40bee70 0x7f12c40a8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 -- 172.21.15.153:0/306486249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b40092a0 con 0x7f12c4154b40 2023-08-17T00:11:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12c9d04700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c40bee70 0x7f12c40a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.722+0000 7f12cad06700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 0x7f12c40a8f20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f12bc00c810 tx=0x7f12bc007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.726+0000 7f12ba7fc700 1 -- 172.21.15.153:0/306486249 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc005d30 con 0x7f12c4154b40 2023-08-17T00:11:40.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.726+0000 7f12ba7fc700 1 -- 172.21.15.153:0/306486249 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc005e90 con 0x7f12c4154b40 2023-08-17T00:11:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.726+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c414e9a0 con 0x7f12c4154b40 2023-08-17T00:11:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.726+0000 7f12ba7fc700 1 -- 172.21.15.153:0/306486249 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc007320 con 0x7f12c4154b40 2023-08-17T00:11:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.726+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c41650e0 con 0x7f12c4154b40 2023-08-17T00:11:40.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12ba7fc700 1 -- 172.21.15.153:0/306486249 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f12bc010030 con 0x7f12c4154b40 2023-08-17T00:11:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12ba7fc700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f12a805a150 0x7f12a805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12ba7fc700 1 -- 172.21.15.153:0/306486249 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f12bc073fd0 con 0x7f12c4154b40 2023-08-17T00:11:40.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12ca505700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f12a805a150 0x7f12a805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12ca505700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f12a805a150 0x7f12a805c610 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f12c0009b90 tx=0x7f12c0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12d6aeb740 1 Processor -- start 2023-08-17T00:11:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12d6aeb740 1 -- start start 2023-08-17T00:11:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.730+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2844b10 0x2844ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2841f30 0x286af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 0x28889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27911a0 con 0x286b480 2023-08-17T00:11:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x283f7c0 con 0x2841f30 2023-08-17T00:11:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28876a0 con 0x2844b10 2023-08-17T00:11:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 0x28889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 0x28889c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44016/0 (socket says 172.21.15.153:44016) 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 -- 172.21.15.153:0/736464385 learned_addr learned my addr 172.21.15.153:0/736464385 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12ca505700 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2844b10 0x2844ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12c9d04700 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2841f30 0x286af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 -- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2844b10 msgr2=0x2844ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2844b10 0x2844ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 -- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2841f30 msgr2=0x286af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2841f30 0x286af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 -- 172.21.15.153:0/736464385 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27bf010 con 0x286b480 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12cad06700 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 0x28889c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f12bc04b000 tx=0x7f12bc00f000).ready entity=mon.0 client_cookie=5606c88256921c10 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12a77fe700 1 -- 172.21.15.153:0/736464385 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc049a10 con 0x286b480 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12a77fe700 1 -- 172.21.15.153:0/736464385 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0721e0 con 0x286b480 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12a77fe700 1 -- 172.21.15.153:0/736464385 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc072350 con 0x286b480 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- 172.21.15.153:0/736464385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 msgr2=0x28889c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 0x28889c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7f12bc04b000 tx=0x7f12bc00f000).stop 2023-08-17T00:11:40.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- 172.21.15.153:0/736464385 shutdown_connections 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x286b480 0x28889c0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2841f30 0x286af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/736464385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2844b10 0x2844ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- 172.21.15.153:0/736464385 >> 172.21.15.153:0/736464385 conn(0x2624680 msgr2=0x2845a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- 172.21.15.153:0/736464385 shutdown_connections 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- 172.21.15.153:0/736464385 wait complete. 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 -- start start 2023-08-17T00:11:40.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.734+0000 7f12d6aeb740 1 Processor -- start 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x2871ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x289f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28701e0 con 0x2844b10 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x286cd50 con 0x286b480 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2883b40 con 0x2841f30 2023-08-17T00:11:40.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 10 client.0 ll_register_callbacks cb 0x27fc400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12ca505700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x2871ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44024/0 (socket says 172.21.15.153:44024) 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 -- 172.21.15.153:0/1243419160 learned_addr learned my addr 172.21.15.153:0/1243419160 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12cad06700 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x289f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 -- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 msgr2=0x2871ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x2871ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 -- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 msgr2=0x289f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x289f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 -- 172.21.15.153:0/1243419160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c41650e0 con 0x2844b10 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12c9d04700 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286c4a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f12c4069c90 tx=0x7f12b4017000).ready entity=mon.0 client_cookie=bb40ab0db83c6950 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1243419160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4021070 con 0x2844b10 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1243419160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f12b401c630 con 0x2844b10 2023-08-17T00:11:40.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.738+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x278d200 con 0x2844b10 2023-08-17T00:11:40.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1243419160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12b401ca00 con 0x2844b10 2023-08-17T00:11:40.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 10 client.7737 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:40.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x27ba4b0 con 0x2844b10 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1243419160 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x278d200 con 0x2844b10 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1243419160 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f12b4009790 con 0x2844b10 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 10 client.7737 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 10 client.7737 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 20 client.7737 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28844c0 0x28848a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 4 client.7737 mds_command: new command op to 7470 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:11:40.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27bbcf0 con 0x28844c0 2023-08-17T00:11:40.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12ca505700 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28844c0 0x28848a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12a4ff9700 10 client.7737 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12ca505700 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28844c0 0x28848a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4911d5373f441872 server_cookie=5a9d9485548ea2a3 in_seq=0 out_seq=0 2023-08-17T00:11:40.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1243419160 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x27bbcf0 con 0x28844c0 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12a4ff9700 10 client.7737 handle_command_reply: tid=0 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.742+0000 7f12d6aeb740 1 client.7737 shutdown 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 msgr2=0x286c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286c4a0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 rx=0x7f12c4069c90 tx=0x7f12b4017000).stop 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 shutdown_connections 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x28844c0 0x28848a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x289f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286c4a0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1243419160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x2871ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 >> 172.21.15.153:0/1243419160 conn(0x2624680 msgr2=0x28861d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12a4ff9700 0 client.7737 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 shutdown_connections 2023-08-17T00:11:40.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1243419160 wait complete. 2023-08-17T00:11:40.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.746+0000 7f12d6aeb740 20 client.7737 trim_cache size 0 max 16384 2023-08-17T00:11:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.762+0000 7f12d6aeb740 1 Processor -- start 2023-08-17T00:11:40.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 -- start start 2023-08-17T00:11:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x289b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x283ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x2869a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28a01b0 con 0x2844b10 2023-08-17T00:11:40.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x279af60 con 0x286b480 2023-08-17T00:11:40.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2808240 con 0x2841f30 2023-08-17T00:11:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x283ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x283ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44036/0 (socket says 172.21.15.153:44036) 2023-08-17T00:11:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 -- 172.21.15.153:0/2608826856 learned_addr learned my addr 172.21.15.153:0/2608826856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12cad06700 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x2869a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12ca505700 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x289b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 -- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 msgr2=0x289b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x289b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 -- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 msgr2=0x2869a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x2869a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 -- 172.21.15.153:0/2608826856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40c7b20 con 0x2844b10 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12cad06700 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x2869a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12c9d04700 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x283ec00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f12b4009fd0 tx=0x7f12b4021000).ready entity=mon.0 client_cookie=e265e11613a50cb9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12a7fff700 1 -- 172.21.15.153:0/2608826856 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b401ca00 con 0x2844b10 2023-08-17T00:11:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12a7fff700 1 -- 172.21.15.153:0/2608826856 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b400f300 con 0x2844b10 2023-08-17T00:11:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.766+0000 7f12a7fff700 1 -- 172.21.15.153:0/2608826856 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4026410 con 0x2844b10 2023-08-17T00:11:40.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 -- 172.21.15.153:0/2608826856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 msgr2=0x283ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x283ec00 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f12b4009fd0 tx=0x7f12b4021000).stop 2023-08-17T00:11:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 -- 172.21.15.153:0/2608826856 shutdown_connections 2023-08-17T00:11:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x2869a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x283ec00 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/2608826856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x289b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 -- 172.21.15.153:0/2608826856 >> 172.21.15.153:0/2608826856 conn(0x2624680 msgr2=0x289f200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 -- 172.21.15.153:0/2608826856 shutdown_connections 2023-08-17T00:11:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 -- 172.21.15.153:0/2608826856 wait complete. 2023-08-17T00:11:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 -- start start 2023-08-17T00:11:40.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.770+0000 7f12d6aeb740 1 Processor -- start 2023-08-17T00:11:40.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x28f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x286d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x286dcb0 con 0x2844b10 2023-08-17T00:11:40.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2874a40 con 0x286b480 2023-08-17T00:11:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x286bf30 con 0x2841f30 2023-08-17T00:11:40.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 10 client.0 ll_register_callbacks cb 0x7f12b4000ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:11:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44046/0 (socket says 172.21.15.153:44046) 2023-08-17T00:11:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 -- 172.21.15.153:0/1916114906 learned_addr learned my addr 172.21.15.153:0/1916114906 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12ca505700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x28f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12cad06700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x286d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 -- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 msgr2=0x28f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x28f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 -- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 msgr2=0x286d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x286d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 -- 172.21.15.153:0/1916114906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x27ba4b0 con 0x2844b10 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12c9d04700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286d2d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f12b4006ca0 tx=0x7f12b4033040).ready entity=mon.0 client_cookie=a2807597b551382b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:11:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1916114906 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b4021070 con 0x2844b10 2023-08-17T00:11:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12bc0721e0 con 0x2844b10 2023-08-17T00:11:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1916114906 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f12b4026ae0 con 0x2844b10 2023-08-17T00:11:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1916114906 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12b4026410 con 0x2844b10 2023-08-17T00:11:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 10 client.7743 fetch_fsmap learned FSMap version 93 2023-08-17T00:11:40.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x27ba200 con 0x2844b10 2023-08-17T00:11:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1916114906 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc0721e0 con 0x2844b10 2023-08-17T00:11:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1916114906 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f12b4043400 con 0x2844b10 2023-08-17T00:11:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 10 client.7743 fetch_fsmap finished waiting for FSMap version 93 2023-08-17T00:11:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 10 client.7743 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.b 2023-08-17T00:11:40.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 20 client.7743 populate_metadata read hostname 'smithi153' 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.774+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x289e420 0x283ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 4 client.7743 mds_command: new command op to 7470 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 --> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x27b2240 con 0x289e420 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12ca505700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x289e420 0x283ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12ca505700 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x289e420 0x283ffc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=73c84a68f5fafc5c server_cookie=f0b2a7e1ff90f65c in_seq=0 out_seq=0 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12a4ff9700 10 client.7743 ms_handle_connect on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12a4ff9700 1 -- 172.21.15.153:0/1916114906 <== mds.0 v2:172.21.15.178:6834/23042802 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x27b2240 con 0x289e420 2023-08-17T00:11:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12a4ff9700 10 client.7743 handle_command_reply: tid=0 2023-08-17T00:11:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 client.7743 shutdown 2023-08-17T00:11:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 msgr2=0x286d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286d2d0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 rx=0x7f12b4006ca0 tx=0x7f12b4033040).stop 2023-08-17T00:11:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 shutdown_connections 2023-08-17T00:11:40.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:6834/23042802,v1:172.21.15.178:6836/23042802] conn(0x289e420 0x283ffc0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x286b480 0x286d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2844b10 0x286d2d0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12a4ff9700 0 client.7743 ms_handle_reset on v2:172.21.15.178:6834/23042802 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 --2- 172.21.15.153:0/1916114906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2841f30 0x28f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 >> 172.21.15.153:0/1916114906 conn(0x2624680 msgr2=0x2869a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 shutdown_connections 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 1 -- 172.21.15.153:0/1916114906 wait complete. 2023-08-17T00:11:40.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12d6aeb740 20 client.7743 trim_cache size 0 max 16384 2023-08-17T00:11:40.787 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:11:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:11:40.787 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:11:40.787 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:11:40.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f12a805a150 msgr2=0x7f12a805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12cb507700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f12a805a150 0x7f12a805c610 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f12c0009b90 tx=0x7f12c0009060).stop 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 msgr2=0x7f12c40a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.778+0000 7f12cb507700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 0x7f12c40a8f20 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f12bc00c810 tx=0x7f12bc007f90).stop 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 shutdown_connections 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f12a805a150 0x7f12a805c610 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f12c4154b40 0x7f12c40a8f20 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12c40bee70 0x7f12c40a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 --2- 172.21.15.153:0/306486249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12c4068e90 0x7f12c413c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 >> 172.21.15.153:0/306486249 conn(0x7f12c40c9160 msgr2=0x7f12c414f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 shutdown_connections 2023-08-17T00:11:40.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.782+0000 7f12cb507700 1 -- 172.21.15.153:0/306486249 wait complete. 2023-08-17T00:11:40.805 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:40.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.962+0000 7f3fcb6f1700 1 Processor -- start 2023-08-17T00:11:40.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.962+0000 7f3fcb6f1700 1 -- start start 2023-08-17T00:11:40.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fcb6f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fc4154130 0x7f3fc40632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fcb6f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fcb6f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc4065240 con 0x7f3fc4153d50 2023-08-17T00:11:40.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fcb6f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc4063880 con 0x7f3fc4154130 2023-08-17T00:11:40.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fcb6f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4064910 con 0x7f3fc40656d0 2023-08-17T00:11:40.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc8c8c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3fc4154130 0x7f3fc40632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc948d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3fc4153d50 0x7f3fc40629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36852/0 (socket says 172.21.15.153:36852) 2023-08-17T00:11:40.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc948d700 1 -- 172.21.15.153:0/3815567242 learned_addr learned my addr 172.21.15.153:0/3815567242 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:40.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc9c8e700 1 --2- 172.21.15.153:0/3815567242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/3815567242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 msgr2=0x7f3fc40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:40.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc8c8c700 1 --2- 172.21.15.153:0/3815567242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc40bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/3815567242 >> v1:172.21.15.153:6789/0 conn(0x7f3fc4153d50 legacy=0x7f3fc40629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.966+0000 7f3fbbfff700 1 -- 172.21.15.153:0/3815567242 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596936962 0 0) 0x7f3fc4065240 con 0x7f3fc4153d50 2023-08-17T00:11:40.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/3815567242 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4064bf0 con 0x7f3fc4154130 2023-08-17T00:11:40.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fc8c8c700 1 --2- 172.21.15.153:0/3815567242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4154130 0x7f3fc40632e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f3fb4009760 tx=0x7f3fb4009060).ready entity=mon.0 client_cookie=100b2f035c4ab39f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fbbfff700 1 -- 172.21.15.153:0/3815567242 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb40090d0 con 0x7f3fc4154130 2023-08-17T00:11:40.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fbbfff700 1 -- 172.21.15.153:0/3815567242 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400b580 con 0x7f3fc4154130 2023-08-17T00:11:40.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fbbfff700 1 -- 172.21.15.153:0/3815567242 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400b900 con 0x7f3fc4154130 2023-08-17T00:11:40.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/3815567242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4154130 msgr2=0x7f3fc40632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/3815567242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4154130 0x7f3fc40632e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f3fb4009760 tx=0x7f3fb4009060).stop 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/3815567242 shutdown_connections 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/3815567242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc40bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/3815567242 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4154130 0x7f3fc40632e0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/3815567242 >> 172.21.15.153:0/3815567242 conn(0x7f3fc40c7150 msgr2=0x7f3fc40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/3815567242 shutdown_connections 2023-08-17T00:11:40.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.970+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/3815567242 wait complete. 2023-08-17T00:11:40.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 Processor -- start 2023-08-17T00:11:40.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 -- start start 2023-08-17T00:11:40.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc4151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 0x7f3fc40aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc4154130 0x7f3fc40aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc40ab110 con 0x7f3fc4153d50 2023-08-17T00:11:40.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc41648a0 con 0x7f3fc4154130 2023-08-17T00:11:40.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc4156700 con 0x7f3fc40656d0 2023-08-17T00:11:40.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 0x7f3fc40aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 0x7f3fc40aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44074/0 (socket says 172.21.15.153:44074) 2023-08-17T00:11:40.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/4110593981 learned_addr learned my addr 172.21.15.153:0/4110593981 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:40.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc948d700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc4151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc9c8e700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc4154130 0x7f3fc40aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 msgr2=0x7f3fc4151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc4151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc4154130 msgr2=0x7f3fc40aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc4154130 0x7f3fc40aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 -- 172.21.15.153:0/4110593981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40092a0 con 0x7f3fc4153d50 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fc8c8c700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 0x7f3fc40aa730 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f3fb4009eb0 tx=0x7f3fb4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400b900 con 0x7f3fc4153d50 2023-08-17T00:11:40.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb4006990 con 0x7f3fc4153d50 2023-08-17T00:11:40.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.974+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc4156140 con 0x7f3fc4153d50 2023-08-17T00:11:40.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.978+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb401b410 con 0x7f3fc4153d50 2023-08-17T00:11:40.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.978+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc4164530 con 0x7f3fc4153d50 2023-08-17T00:11:40.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.978+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc4164a30 con 0x7f3fc4153d50 2023-08-17T00:11:40.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.978+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3fb402a070 con 0x7f3fc4153d50 2023-08-17T00:11:40.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.982+0000 7f3fb97fa700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fa805a150 0x7f3fa805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:40.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.982+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f3fb4075950 con 0x7f3fc4153d50 2023-08-17T00:11:40.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.982+0000 7f3fc948d700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fa805a150 0x7f3fa805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:40.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.982+0000 7f3fc948d700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fa805a150 0x7f3fa805c610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f3fc000c7d0 tx=0x7f3fc0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:40.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:40.986+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fb4049390 con 0x7f3fc4153d50 2023-08-17T00:11:41.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.178+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fc406b530 con 0x7f3fc4153d50 2023-08-17T00:11:41.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fb97fa700 1 -- 172.21.15.153:0/4110593981 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f3fb4028070 con 0x7f3fc4153d50 2023-08-17T00:11:41.184 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:41.185 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:41.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fa805a150 msgr2=0x7f3fa805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fa805a150 0x7f3fa805c610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f3fc000c7d0 tx=0x7f3fc0009040).stop 2023-08-17T00:11:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 msgr2=0x7f3fc40aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 0x7f3fc40aa730 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 rx=0x7f3fb4009eb0 tx=0x7f3fb4017000).stop 2023-08-17T00:11:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 shutdown_connections 2023-08-17T00:11:41.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fa805a150 0x7f3fa805c610 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fc4154130 0x7f3fc40aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fc4153d50 0x7f3fc40aa730 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 --2- 172.21.15.153:0/4110593981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fc40656d0 0x7f3fc4151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 >> 172.21.15.153:0/4110593981 conn(0x7f3fc40c7150 msgr2=0x7f3fc40c4490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 shutdown_connections 2023-08-17T00:11:41.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.182+0000 7f3fcb6f1700 1 -- 172.21.15.153:0/4110593981 wait complete. 2023-08-17T00:11:41.189 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:41.204 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:41.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:41.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.354+0000 7ff825edb700 1 Processor -- start 2023-08-17T00:11:41.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.354+0000 7ff825edb700 1 -- start start 2023-08-17T00:11:41.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.354+0000 7ff825edb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8200a8b70 0x7ff8200632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:41.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.354+0000 7ff825edb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff820065240 con 0x7ff8200629b0 2023-08-17T00:11:41.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff820062e40 con 0x7ff8200a8f50 2023-08-17T00:11:41.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8200638a0 con 0x7ff8200a8b70 2023-08-17T00:11:41.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff816ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff8200a8f50 0x7ff8200656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33292/0 (socket says 172.21.15.153:33292) 2023-08-17T00:11:41.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8200a8b70 0x7ff8200632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:41.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff816ffd700 1 -- 172.21.15.153:0/2385807995 learned_addr learned my addr 172.21.15.153:0/2385807995 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:41.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81f7fe700 1 -- 172.21.15.153:0/2385807995 >> v1:172.21.15.178:6789/0 conn(0x7ff8200a8f50 legacy=0x7ff8200656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81f7fe700 1 -- 172.21.15.153:0/2385807995 >> v1:172.21.15.153:6789/0 conn(0x7ff8200629b0 legacy=0x7ff8200bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81f7fe700 1 -- 172.21.15.153:0/2385807995 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff820065de0 con 0x7ff8200a8b70 2023-08-17T00:11:41.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81effd700 1 -- 172.21.15.153:0/2385807995 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444074900 0 0) 0x7ff820065240 con 0x7ff8200629b0 2023-08-17T00:11:41.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81f7fe700 1 --2- 172.21.15.153:0/2385807995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200a8b70 0x7ff8200632e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff810009de0 tx=0x7ff810009780).ready entity=mon.1 client_cookie=df0f384bc4389f43 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:41.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81effd700 1 -- 172.21.15.153:0/2385807995 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000e070 con 0x7ff8200a8b70 2023-08-17T00:11:41.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81effd700 1 -- 172.21.15.153:0/2385807995 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff81000bae0 con 0x7ff8200a8b70 2023-08-17T00:11:41.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff81effd700 1 -- 172.21.15.153:0/2385807995 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81000be60 con 0x7ff8200a8b70 2023-08-17T00:11:41.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- 172.21.15.153:0/2385807995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200a8b70 msgr2=0x7ff8200632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 --2- 172.21.15.153:0/2385807995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200a8b70 0x7ff8200632e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff810009de0 tx=0x7ff810009780).stop 2023-08-17T00:11:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- 172.21.15.153:0/2385807995 shutdown_connections 2023-08-17T00:11:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 --2- 172.21.15.153:0/2385807995 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200a8b70 0x7ff8200632e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- 172.21.15.153:0/2385807995 >> 172.21.15.153:0/2385807995 conn(0x7ff8200c7150 msgr2=0x7ff8200c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- 172.21.15.153:0/2385807995 shutdown_connections 2023-08-17T00:11:41.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.358+0000 7ff825edb700 1 -- 172.21.15.153:0/2385807995 wait complete. 2023-08-17T00:11:41.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 Processor -- start 2023-08-17T00:11:41.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 -- start start 2023-08-17T00:11:41.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200629b0 0x7ff820154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:41.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8200a8b70 0x7ff8200a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:41.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 0x7ff8200a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:41.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff820158a20 con 0x7ff8200a8f50 2023-08-17T00:11:41.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8200aa9f0 con 0x7ff8200629b0 2023-08-17T00:11:41.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff825edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82015a7c0 con 0x7ff8200a8b70 2023-08-17T00:11:41.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff81ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 0x7ff8200a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:41.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff81ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 0x7ff8200a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44078/0 (socket says 172.21.15.153:44078) 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff81ffff700 1 -- 172.21.15.153:0/3201136326 learned_addr learned my addr 172.21.15.153:0/3201136326 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff81f7fe700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200629b0 0x7ff820154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.362+0000 7ff816ffd700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8200a8b70 0x7ff8200a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff81ffff700 1 -- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8200a8b70 msgr2=0x7ff8200a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff81ffff700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8200a8b70 0x7ff8200a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff81ffff700 1 -- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200629b0 msgr2=0x7ff820154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff81ffff700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200629b0 0x7ff820154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff81ffff700 1 -- 172.21.15.153:0/3201136326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff810009a20 con 0x7ff8200a8f50 2023-08-17T00:11:41.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff81ffff700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 0x7ff8200a9b80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7ff81800c490 tx=0x7ff818007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:41.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818012400 con 0x7ff8200a8f50 2023-08-17T00:11:41.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff818012580 con 0x7ff8200a8f50 2023-08-17T00:11:41.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff818012940 con 0x7ff8200a8f50 2023-08-17T00:11:41.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8200aa150 con 0x7ff8200a8f50 2023-08-17T00:11:41.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8200aa710 con 0x7ff8200a8f50 2023-08-17T00:11:41.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.366+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff820158b90 con 0x7ff8200a8f50 2023-08-17T00:11:41.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.370+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff818010070 con 0x7ff8200a8f50 2023-08-17T00:11:41.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.370+0000 7ff817fff700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80005a150 0x7ff80005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:41.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.370+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7ff818073580 con 0x7ff8200a8f50 2023-08-17T00:11:41.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.370+0000 7ff81f7fe700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80005a150 0x7ff80005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:41.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.370+0000 7ff81f7fe700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80005a150 0x7ff80005c610 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ff8100099f0 tx=0x7ff810009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:41.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.374+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff818046eb0 con 0x7ff8200a8f50 2023-08-17T00:11:41.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.590+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff82006b530 con 0x7ff8200a8f50 2023-08-17T00:11:41.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.590+0000 7ff817fff700 1 -- 172.21.15.153:0/3201136326 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7ff81804a4d0 con 0x7ff8200a8f50 2023-08-17T00:11:41.595 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:41.595 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":549,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075882526,"bytes_used":4652253184,"bytes_avail":768441860096,"bytes_total":773094113280,"write_bytes_sec":23134076,"read_op_per_sec":0,"write_op_per_sec":23},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-08-17T00:11:39.372587+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:41.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80005a150 msgr2=0x7ff80005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80005a150 0x7ff80005c610 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7ff8100099f0 tx=0x7ff810009780).stop 2023-08-17T00:11:41.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 msgr2=0x7ff8200a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:41.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 0x7ff8200a9b80 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7ff81800c490 tx=0x7ff818007dc0).stop 2023-08-17T00:11:41.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 shutdown_connections 2023-08-17T00:11:41.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff80005a150 0x7ff80005c610 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff8200a8f50 0x7ff8200a9b80 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8200a8b70 0x7ff8200a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.594+0000 7ff825edb700 1 --2- 172.21.15.153:0/3201136326 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8200629b0 0x7ff820154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:41.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.598+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 >> 172.21.15.153:0/3201136326 conn(0x7ff8200c7150 msgr2=0x7ff820156d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:41.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.598+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 shutdown_connections 2023-08-17T00:11:41.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:41.598+0000 7ff825edb700 1 -- 172.21.15.153:0/3201136326 wait complete. 2023-08-17T00:11:41.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2023-08-17T00:11:42.622 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:42.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.806+0000 7f447b8db700 1 Processor -- start 2023-08-17T00:11:42.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 -- start start 2023-08-17T00:11:42.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44740a8b70 0x7f44740632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8f50 0x7f44740629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44740656d0 0x7f44740bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4474065240 con 0x7f44740a8b70 2023-08-17T00:11:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4474062ea0 con 0x7f44740656d0 2023-08-17T00:11:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.810+0000 7f447b8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740638a0 con 0x7f44740a8f50 2023-08-17T00:11:42.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44740a8b70 0x7f44740632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44740a8b70 0x7f44740632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44086/0 (socket says 172.21.15.153:44086) 2023-08-17T00:11:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 -- 172.21.15.153:0/728414705 learned_addr learned my addr 172.21.15.153:0/728414705 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:42.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479e78700 1 --2- 172.21.15.153:0/728414705 >> v2:172.21.15.178:3300/0 conn(0x7f44740656d0 0x7f44740bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4478e76700 1 --2- 172.21.15.153:0/728414705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8f50 0x7f44740629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 -- 172.21.15.153:0/728414705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8f50 msgr2=0x7f44740629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 --2- 172.21.15.153:0/728414705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8f50 0x7f44740629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 -- 172.21.15.153:0/728414705 >> v2:172.21.15.178:3300/0 conn(0x7f44740656d0 msgr2=0x7f44740bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 --2- 172.21.15.153:0/728414705 >> v2:172.21.15.178:3300/0 conn(0x7f44740656d0 0x7f44740bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 -- 172.21.15.153:0/728414705 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4474064910 con 0x7f44740a8b70 2023-08-17T00:11:42.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f4479677700 1 --2- 172.21.15.153:0/728414705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740a8b70 0x7f44740632e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f44740c0980 tx=0x7f44700090f0).ready entity=mon.0 client_cookie=9ffbd36c1bfe129 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f446bfff700 1 -- 172.21.15.153:0/728414705 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000b600 con 0x7f44740a8b70 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f446bfff700 1 -- 172.21.15.153:0/728414705 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000b760 con 0x7f44740a8b70 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f446bfff700 1 -- 172.21.15.153:0/728414705 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000bae0 con 0x7f44740a8b70 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 -- 172.21.15.153:0/728414705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740a8b70 msgr2=0x7f44740632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 --2- 172.21.15.153:0/728414705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740a8b70 0x7f44740632e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 rx=0x7f44740c0980 tx=0x7f44700090f0).stop 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 -- 172.21.15.153:0/728414705 shutdown_connections 2023-08-17T00:11:42.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 --2- 172.21.15.153:0/728414705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8f50 0x7f44740629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 --2- 172.21.15.153:0/728414705 >> v2:172.21.15.178:3300/0 conn(0x7f44740656d0 0x7f44740bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 --2- 172.21.15.153:0/728414705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740a8b70 0x7f44740632e0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 -- 172.21.15.153:0/728414705 >> 172.21.15.153:0/728414705 conn(0x7f44740c7150 msgr2=0x7f44740c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 -- 172.21.15.153:0/728414705 shutdown_connections 2023-08-17T00:11:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.814+0000 7f447b8db700 1 -- 172.21.15.153:0/728414705 wait complete. 2023-08-17T00:11:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 Processor -- start 2023-08-17T00:11:42.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 -- start start 2023-08-17T00:11:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 0x7f447414f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8b70 0x7f44740bf810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44740a8f50 0x7f44740bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740aa660 con 0x7f44740656d0 2023-08-17T00:11:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740aaaf0 con 0x7f44740a8f50 2023-08-17T00:11:42.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f447b8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447414f600 con 0x7f44740a8b70 2023-08-17T00:11:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 0x7f447414f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 0x7f447414f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44094/0 (socket says 172.21.15.153:44094) 2023-08-17T00:11:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 -- 172.21.15.153:0/1882584641 learned_addr learned my addr 172.21.15.153:0/1882584641 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:42.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479e78700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44740a8f50 0x7f44740bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4478e76700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8b70 0x7f44740bf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 -- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8b70 msgr2=0x7f44740bf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8b70 0x7f44740bf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 -- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44740a8f50 msgr2=0x7f44740bfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44740a8f50 0x7f44740bfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 -- 172.21.15.153:0/1882584641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009370 con 0x7f44740656d0 2023-08-17T00:11:42.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.818+0000 7f4479677700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 0x7f447414f110 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f4470009130 tx=0x7f4470017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:42.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447000b8d0 con 0x7f44740656d0 2023-08-17T00:11:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447000ba30 con 0x7f44740656d0 2023-08-17T00:11:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44740a9a50 con 0x7f44740656d0 2023-08-17T00:11:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700246a0 con 0x7f44740656d0 2023-08-17T00:11:42.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44740aa010 con 0x7f44740656d0 2023-08-17T00:11:42.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447406b530 con 0x7f44740656d0 2023-08-17T00:11:42.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.822+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f447000f070 con 0x7f44740656d0 2023-08-17T00:11:42.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.826+0000 7f44697fa700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f445805a180 0x7f445805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:42.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.826+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f4470075a90 con 0x7f44740656d0 2023-08-17T00:11:42.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.826+0000 7f4478e76700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f445805a180 0x7f445805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:42.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.826+0000 7f4478e76700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f445805a180 0x7f445805c640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4464006fd0 tx=0x7f4464008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:42.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:42.830+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4470049450 con 0x7f44740656d0 2023-08-17T00:11:43.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.030+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4474064bf0 con 0x7f44740656d0 2023-08-17T00:11:43.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.030+0000 7f44697fa700 1 -- 172.21.15.153:0/1882584641 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f447004ca70 con 0x7f44740656d0 2023-08-17T00:11:43.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:43.035 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:43.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f445805a180 msgr2=0x7f445805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f445805a180 0x7f445805c640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f4464006fd0 tx=0x7f4464008040).stop 2023-08-17T00:11:43.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 msgr2=0x7f447414f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 0x7f447414f110 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f4470009130 tx=0x7f4470017000).stop 2023-08-17T00:11:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 shutdown_connections 2023-08-17T00:11:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f445805a180 0x7f445805c640 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44740a8f50 0x7f44740bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44740a8b70 0x7f44740bf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 --2- 172.21.15.153:0/1882584641 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44740656d0 0x7f447414f110 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 >> 172.21.15.153:0/1882584641 conn(0x7f44740c7150 msgr2=0x7f447414fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:43.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 shutdown_connections 2023-08-17T00:11:43.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.034+0000 7f447b8db700 1 -- 172.21.15.153:0/1882584641 wait complete. 2023-08-17T00:11:43.040 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:43.057 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:43.058 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:43.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.210+0000 7f68a5569700 1 Processor -- start 2023-08-17T00:11:43.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f68a5569700 1 -- start start 2023-08-17T00:11:43.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f68a5569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68a00a89c0 0x7f68a00a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:43.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f68a5569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a01505d0 0x7f68a0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:43.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f68a5569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a00bc0b0 con 0x7f68a00c0c80 2023-08-17T00:11:43.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f68a5569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68a00bd590 con 0x7f68a00a89c0 2023-08-17T00:11:43.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f68a5569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0062fb0 con 0x7f68a01505d0 2023-08-17T00:11:43.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.214+0000 7f689effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68a00a89c0 0x7f68a00a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:43.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68a00a89c0 0x7f68a00a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44100/0 (socket says 172.21.15.153:44100) 2023-08-17T00:11:43.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 -- 172.21.15.153:0/2809435670 learned_addr learned my addr 172.21.15.153:0/2809435670 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:43.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689f7fe700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a01505d0 0x7f68a0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:43.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 -- 172.21.15.153:0/2809435670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a01505d0 msgr2=0x7f68a0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:43.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a01505d0 0x7f68a0150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 -- 172.21.15.153:0/2809435670 >> v1:172.21.15.178:6789/0 conn(0x7f68a00c0c80 legacy=0x7f68a00bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 -- 172.21.15.153:0/2809435670 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a00bb780 con 0x7f68a00a89c0 2023-08-17T00:11:43.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689f7fe700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a01505d0 0x7f68a0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:43.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689effd700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00a89c0 0x7f68a00a8da0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f6890006fd0 tx=0x7f68900090f0).ready entity=mon.0 client_cookie=65815280849b4b02 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:43.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689e7fc700 1 -- 172.21.15.153:0/2809435670 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000b600 con 0x7f68a00a89c0 2023-08-17T00:11:43.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689e7fc700 1 -- 172.21.15.153:0/2809435670 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689000b760 con 0x7f68a00a89c0 2023-08-17T00:11:43.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f689e7fc700 1 -- 172.21.15.153:0/2809435670 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689000bb00 con 0x7f68a00a89c0 2023-08-17T00:11:43.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 -- 172.21.15.153:0/2809435670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00a89c0 msgr2=0x7f68a00a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00a89c0 0x7f68a00a8da0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f6890006fd0 tx=0x7f68900090f0).stop 2023-08-17T00:11:43.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 -- 172.21.15.153:0/2809435670 shutdown_connections 2023-08-17T00:11:43.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a01505d0 0x7f68a0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 --2- 172.21.15.153:0/2809435670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00a89c0 0x7f68a00a8da0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 -- 172.21.15.153:0/2809435670 >> 172.21.15.153:0/2809435670 conn(0x7f68a00c7150 msgr2=0x7f68a00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:43.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 -- 172.21.15.153:0/2809435670 shutdown_connections 2023-08-17T00:11:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.218+0000 7f68a5569700 1 -- 172.21.15.153:0/2809435670 wait complete. 2023-08-17T00:11:43.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 Processor -- start 2023-08-17T00:11:43.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 -- start start 2023-08-17T00:11:43.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a00a89c0 0x7f68a0168670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:43.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 0x7f68a0145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:43.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a01505d0 0x7f68a00aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:43.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a0168b60 con 0x7f68a00c0c80 2023-08-17T00:11:43.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00a9690 con 0x7f68a01505d0 2023-08-17T00:11:43.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68a5569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a00a9970 con 0x7f68a00a89c0 2023-08-17T00:11:43.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68967fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 0x7f68a0145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:43.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68967fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 0x7f68a0145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44112/0 (socket says 172.21.15.153:44112) 2023-08-17T00:11:43.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f68967fc700 1 -- 172.21.15.153:0/606640965 learned_addr learned my addr 172.21.15.153:0/606640965 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:43.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f689effd700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a00a89c0 0x7f68a0168670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.222+0000 7f689f7fe700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a01505d0 0x7f68a00aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68967fc700 1 -- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a00a89c0 msgr2=0x7f68a0168670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68967fc700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a00a89c0 0x7f68a0168670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68967fc700 1 -- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a01505d0 msgr2=0x7f68a00aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68967fc700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a01505d0 0x7f68a00aab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68967fc700 1 -- 172.21.15.153:0/606640965 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890009370 con 0x7f68a00c0c80 2023-08-17T00:11:43.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68967fc700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 0x7f68a0145ec0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f688800c4c0 tx=0x7f6888007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800ce10 con 0x7f68a00c0c80 2023-08-17T00:11:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6888007020 con 0x7f68a00c0c80 2023-08-17T00:11:43.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a00a9c50 con 0x7f68a00c0c80 2023-08-17T00:11:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68880073c0 con 0x7f68a00c0c80 2023-08-17T00:11:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a00aa210 con 0x7f68a00c0c80 2023-08-17T00:11:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.226+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a016bc40 con 0x7f68a00c0c80 2023-08-17T00:11:43.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.230+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6888010070 con 0x7f68a00c0c80 2023-08-17T00:11:43.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.230+0000 7f68977fe700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f688005a150 0x7f688005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:43.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.230+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f6888073390 con 0x7f68a00c0c80 2023-08-17T00:11:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.230+0000 7f689effd700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f688005a150 0x7f688005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:43.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.230+0000 7f689effd700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f688005a150 0x7f688005c610 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f689000b3c0 tx=0x7f6890017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:43.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.234+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f68a016bc40 con 0x7f68a00c0c80 2023-08-17T00:11:43.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.450+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f68a016bc40 con 0x7f68a00c0c80 2023-08-17T00:11:43.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.450+0000 7f68977fe700 1 -- 172.21.15.153:0/606640965 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7f68a016bc40 con 0x7f68a00c0c80 2023-08-17T00:11:43.453 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:43.454 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":551,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075882526,"bytes_used":4652253184,"bytes_avail":768441860096,"bytes_total":773094113280,"write_bytes_sec":23134076,"read_op_per_sec":0,"write_op_per_sec":23},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-08-17T00:11:39.372587+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.450+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f688005a150 msgr2=0x7f688005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.450+0000 7f68a5569700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f688005a150 0x7f688005c610 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f689000b3c0 tx=0x7f6890017000).stop 2023-08-17T00:11:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.450+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 msgr2=0x7f68a0145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:43.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.450+0000 7f68a5569700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 0x7f68a0145ec0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 rx=0x7f688800c4c0 tx=0x7f6888007dd0).stop 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 shutdown_connections 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f688005a150 0x7f688005c610 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f68a01505d0 0x7f68a00aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68a00c0c80 0x7f68a0145ec0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 --2- 172.21.15.153:0/606640965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68a00a89c0 0x7f68a0168670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 >> 172.21.15.153:0/606640965 conn(0x7f68a00c7150 msgr2=0x7f68a00c2490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 shutdown_connections 2023-08-17T00:11:43.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:43.454+0000 7f68a5569700 1 -- 172.21.15.153:0/606640965 wait complete. 2023-08-17T00:11:43.475 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2023-08-17T00:11:44.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:44.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.630+0000 7fa0a5cb9700 1 Processor -- start 2023-08-17T00:11:44.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.630+0000 7fa0a5cb9700 1 -- start start 2023-08-17T00:11:44.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a5cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a00a8df0 0x7fa0a00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a5cb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0a0068820 0x7fa0a0068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a5cb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa0a0061fa0 0x7fa0a0062420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a5cb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a01585a0 con 0x7fa0a0068820 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a5cb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0a0066400 con 0x7fa0a0061fa0 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a5cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0069170 con 0x7fa0a00a8df0 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa09ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0a0068820 0x7fa0a0068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa09ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa0a0068820 0x7fa0a0068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44114/0 (socket says 172.21.15.153:44114) 2023-08-17T00:11:44.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa09ffff700 1 -- 172.21.15.153:0/4089971977 learned_addr learned my addr 172.21.15.153:0/4089971977 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:44.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.634+0000 7fa0a54b8700 1 --2- 172.21.15.153:0/4089971977 >> v2:172.21.15.178:3300/0 conn(0x7fa0a0061fa0 0x7fa0a0062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a4cb7700 1 --2- 172.21.15.153:0/4089971977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a00a8df0 0x7fa0a00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09ffff700 1 -- 172.21.15.153:0/4089971977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a00a8df0 msgr2=0x7fa0a00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09ffff700 1 --2- 172.21.15.153:0/4089971977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a00a8df0 0x7fa0a00c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09ffff700 1 -- 172.21.15.153:0/4089971977 >> v2:172.21.15.178:3300/0 conn(0x7fa0a0061fa0 msgr2=0x7fa0a0062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09ffff700 1 --2- 172.21.15.153:0/4089971977 >> v2:172.21.15.178:3300/0 conn(0x7fa0a0061fa0 0x7fa0a0062420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09ffff700 1 -- 172.21.15.153:0/4089971977 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a00b9d30 con 0x7fa0a0068820 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09ffff700 1 --2- 172.21.15.153:0/4089971977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0068c80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fa0a00c09b0 tx=0x7fa08c0090f0).ready entity=mon.0 client_cookie=ec2efafed008cf1d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:44.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09f7fe700 1 -- 172.21.15.153:0/4089971977 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00b520 con 0x7fa0a0068820 2023-08-17T00:11:44.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09f7fe700 1 -- 172.21.15.153:0/4089971977 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c00b680 con 0x7fa0a0068820 2023-08-17T00:11:44.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa09f7fe700 1 -- 172.21.15.153:0/4089971977 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00ba00 con 0x7fa0a0068820 2023-08-17T00:11:44.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/4089971977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 msgr2=0x7fa0a0068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:44.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/4089971977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0068c80 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fa0a00c09b0 tx=0x7fa08c0090f0).stop 2023-08-17T00:11:44.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/4089971977 shutdown_connections 2023-08-17T00:11:44.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/4089971977 >> v2:172.21.15.178:3300/0 conn(0x7fa0a0061fa0 0x7fa0a0062420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/4089971977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0068c80 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/4089971977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a00a8df0 0x7fa0a00c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/4089971977 >> 172.21.15.153:0/4089971977 conn(0x7fa0a00c6620 msgr2=0x7fa0a00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:44.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/4089971977 shutdown_connections 2023-08-17T00:11:44.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.638+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/4089971977 wait complete. 2023-08-17T00:11:44.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 Processor -- start 2023-08-17T00:11:44.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 -- start start 2023-08-17T00:11:44.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a0061fa0 0x7fa0a00bc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0a00a8df0 0x7fa0a00bfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00bc560 con 0x7fa0a0068820 2023-08-17T00:11:44.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00bcee0 con 0x7fa0a00a8df0 2023-08-17T00:11:44.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a5cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00bb950 con 0x7fa0a0061fa0 2023-08-17T00:11:44.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44122/0 (socket says 172.21.15.153:44122) 2023-08-17T00:11:44.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 -- 172.21.15.153:0/917664309 learned_addr learned my addr 172.21.15.153:0/917664309 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:44.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a4cb7700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a0061fa0 0x7fa0a00bc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a54b8700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0a00a8df0 0x7fa0a00bfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 -- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a0061fa0 msgr2=0x7fa0a00bc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a0061fa0 0x7fa0a00bc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 -- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0a00a8df0 msgr2=0x7fa0a00bfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0a00a8df0 0x7fa0a00bfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa09ffff700 1 -- 172.21.15.153:0/917664309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c009370 con 0x7fa0a0068820 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.642+0000 7fa0a54b8700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0a00a8df0 0x7fa0a00bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:44.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09ffff700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0156b80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fa08c011000 tx=0x7fa08c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:44.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c00be90 con 0x7fa0a0068820 2023-08-17T00:11:44.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c006a40 con 0x7fa0a0068820 2023-08-17T00:11:44.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08c01b410 con 0x7fa0a0068820 2023-08-17T00:11:44.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a00bbc30 con 0x7fa0a0068820 2023-08-17T00:11:44.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a00bc1f0 con 0x7fa0a0068820 2023-08-17T00:11:44.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a006b4c0 con 0x7fa0a0068820 2023-08-17T00:11:44.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa08c02b070 con 0x7fa0a0068820 2023-08-17T00:11:44.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09cff9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa08405a150 0x7fa08405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:44.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.646+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fa08c075930 con 0x7fa0a0068820 2023-08-17T00:11:44.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.650+0000 7fa0a4cb7700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa08405a150 0x7fa08405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:44.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.650+0000 7fa0a4cb7700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa08405a150 0x7fa08405c610 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa094006fd0 tx=0x7fa094008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:44.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.654+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa08c049370 con 0x7fa0a0068820 2023-08-17T00:11:44.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.850+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0a0064010 con 0x7fa0a0068820 2023-08-17T00:11:44.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.850+0000 7fa09cff9700 1 -- 172.21.15.153:0/917664309 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fa08c029070 con 0x7fa0a0068820 2023-08-17T00:11:44.855 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:44.855 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:44.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa08405a150 msgr2=0x7fa08405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:44.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa08405a150 0x7fa08405c610 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fa094006fd0 tx=0x7fa094008040).stop 2023-08-17T00:11:44.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 msgr2=0x7fa0a0156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:44.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0156b80 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 rx=0x7fa08c011000 tx=0x7fa08c017000).stop 2023-08-17T00:11:44.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 shutdown_connections 2023-08-17T00:11:44.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa08405a150 0x7fa08405c610 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0a00a8df0 0x7fa0a00bfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa0a0068820 0x7fa0a0156b80 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 --2- 172.21.15.153:0/917664309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0a0061fa0 0x7fa0a00bc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:44.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 >> 172.21.15.153:0/917664309 conn(0x7fa0a00c6620 msgr2=0x7fa0a00aa270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:44.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 shutdown_connections 2023-08-17T00:11:44.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:44.854+0000 7fa0a5cb9700 1 -- 172.21.15.153:0/917664309 wait complete. 2023-08-17T00:11:44.862 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:44.883 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:44.884 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:45.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.038+0000 7f2c2e0db700 1 Processor -- start 2023-08-17T00:11:45.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.038+0000 7f2c2e0db700 1 -- start start 2023-08-17T00:11:45.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c2e0db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c280632e0 0x7f2c280a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c2e0db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2c280629b0 0x7f2c280bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c2e0db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c28065240 con 0x7f2c280a8b70 2023-08-17T00:11:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c2e0db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c280638a0 con 0x7f2c280629b0 2023-08-17T00:11:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c2e0db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28065de0 con 0x7f2c280632e0 2023-08-17T00:11:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2c280629b0 0x7f2c280bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2c280629b0 0x7f2c280bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48902/0 (socket says 172.21.15.153:48902) 2023-08-17T00:11:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 -- 172.21.15.153:0/1048060544 learned_addr learned my addr 172.21.15.153:0/1048060544 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c1effd700 1 --2- 172.21.15.153:0/1048060544 >> v2:172.21.15.178:3300/0 conn(0x7f2c280632e0 0x7f2c280a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 -- 172.21.15.153:0/1048060544 >> v2:172.21.15.178:3300/0 conn(0x7f2c280632e0 msgr2=0x7f2c280a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 --2- 172.21.15.153:0/1048060544 >> v2:172.21.15.178:3300/0 conn(0x7f2c280632e0 0x7f2c280a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 -- 172.21.15.153:0/1048060544 >> v1:172.21.15.178:6789/0 conn(0x7f2c280a8b70 legacy=0x7f2c280656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c26ffd700 1 -- 172.21.15.153:0/1048060544 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153961915 0 0) 0x7f2c28065240 con 0x7f2c280a8b70 2023-08-17T00:11:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 -- 172.21.15.153:0/1048060544 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28062e20 con 0x7f2c280629b0 2023-08-17T00:11:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c27fff700 1 --2- 172.21.15.153:0/1048060544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c280bbdc0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f2c28069d30 tx=0x7f2c20009840).ready entity=mon.0 client_cookie=db6f4f3be3bc0ceb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c26ffd700 1 -- 172.21.15.153:0/1048060544 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000e070 con 0x7f2c280629b0 2023-08-17T00:11:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c26ffd700 1 -- 172.21.15.153:0/1048060544 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2000ba20 con 0x7f2c280629b0 2023-08-17T00:11:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.042+0000 7f2c26ffd700 1 -- 172.21.15.153:0/1048060544 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2000bda0 con 0x7f2c280629b0 2023-08-17T00:11:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 -- 172.21.15.153:0/1048060544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 msgr2=0x7f2c280bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/1048060544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c280bbdc0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f2c28069d30 tx=0x7f2c20009840).stop 2023-08-17T00:11:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 -- 172.21.15.153:0/1048060544 shutdown_connections 2023-08-17T00:11:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/1048060544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c280bbdc0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/1048060544 >> v2:172.21.15.178:3300/0 conn(0x7f2c280632e0 0x7f2c280a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 -- 172.21.15.153:0/1048060544 >> 172.21.15.153:0/1048060544 conn(0x7f2c280c7150 msgr2=0x7f2c280c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 -- 172.21.15.153:0/1048060544 shutdown_connections 2023-08-17T00:11:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 -- 172.21.15.153:0/1048060544 wait complete. 2023-08-17T00:11:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 Processor -- start 2023-08-17T00:11:45.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.046+0000 7f2c2e0db700 1 -- start start 2023-08-17T00:11:45.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c2814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c280632e0 0x7f2c280bf280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c280a8b70 0x7f2c280bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280be1e0 con 0x7f2c280629b0 2023-08-17T00:11:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280be4c0 con 0x7f2c280a8b70 2023-08-17T00:11:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280be7a0 con 0x7f2c280632e0 2023-08-17T00:11:45.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c2814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:45.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c2814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48904/0 (socket says 172.21.15.153:48904) 2023-08-17T00:11:45.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 -- 172.21.15.153:0/3259474635 learned_addr learned my addr 172.21.15.153:0/3259474635 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:45.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c1effd700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c280632e0 0x7f2c280bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c27fff700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c280a8b70 0x7f2c280bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 -- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c280632e0 msgr2=0x7f2c280bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c280632e0 0x7f2c280bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 -- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c280a8b70 msgr2=0x7f2c280bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c280a8b70 0x7f2c280bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 -- 172.21.15.153:0/3259474635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20009ae0 con 0x7f2c280629b0 2023-08-17T00:11:45.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c27fff700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c280a8b70 0x7f2c280bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c277fe700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c2814ebe0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f2c1800c410 tx=0x7f2c18007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:45.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800ce70 con 0x7f2c280629b0 2023-08-17T00:11:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c18007020 con 0x7f2c280629b0 2023-08-17T00:11:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c280bea80 con 0x7f2c280629b0 2023-08-17T00:11:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c180073c0 con 0x7f2c280629b0 2023-08-17T00:11:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.050+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2816c830 con 0x7f2c280629b0 2023-08-17T00:11:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.054+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2806b530 con 0x7f2c280629b0 2023-08-17T00:11:45.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.054+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2c18010070 con 0x7f2c280629b0 2023-08-17T00:11:45.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.054+0000 7f2c1ffff700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c0805a150 0x7f2c0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:45.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.054+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f2c180736e0 con 0x7f2c280629b0 2023-08-17T00:11:45.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.054+0000 7f2c1effd700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c0805a150 0x7f2c0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:45.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.058+0000 7f2c1effd700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c0805a150 0x7f2c0805c610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f2c28153940 tx=0x7f2c10009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:45.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.062+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c180470a0 con 0x7f2c280629b0 2023-08-17T00:11:45.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.274+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2c28064910 con 0x7f2c280629b0 2023-08-17T00:11:45.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.274+0000 7f2c1ffff700 1 -- 172.21.15.153:0/3259474635 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1776 (secure 0 0 0) 0x7f2c1804a6c0 con 0x7f2c280629b0 2023-08-17T00:11:45.278 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:45.279 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":552,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1050,"data_bytes":1075882526,"bytes_used":4602994688,"bytes_avail":768491118592,"bytes_total":773094113280,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":2096230,"recovering_keys_per_sec":0,"num_objects_recovered":16,"num_bytes_recovered":16777216,"num_keys_recovered":0,"write_bytes_sec":4230588,"read_op_per_sec":0,"write_op_per_sec":50},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-08-17T00:11:39.372587+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:45.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c0805a150 msgr2=0x7f2c0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c0805a150 0x7f2c0805c610 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f2c28153940 tx=0x7f2c10009060).stop 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 msgr2=0x7f2c2814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c2814ebe0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f2c1800c410 tx=0x7f2c18007e00).stop 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 shutdown_connections 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c0805a150 0x7f2c0805c610 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c280a8b70 0x7f2c280bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c280632e0 0x7f2c280bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 --2- 172.21.15.153:0/3259474635 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c280629b0 0x7f2c2814ebe0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:45.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 >> 172.21.15.153:0/3259474635 conn(0x7f2c280c7150 msgr2=0x7f2c28155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:45.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 shutdown_connections 2023-08-17T00:11:45.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:45.278+0000 7f2c2e0db700 1 -- 172.21.15.153:0/3259474635 wait complete. 2023-08-17T00:11:45.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2023-08-17T00:11:46.262 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:11:46.268 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:11:46.303 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 Processor -- start 2023-08-17T00:11:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 -- start start 2023-08-17T00:11:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3140153f50 0x7f3140154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f31400c01a0 0x7f31400c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31400bfd10 con 0x7f31400c57a0 2023-08-17T00:11:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3140154860 con 0x7f3140153f50 2023-08-17T00:11:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3146679700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3140154af0 con 0x7f31400c01a0 2023-08-17T00:11:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3140153f50 0x7f3140154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3140153f50 0x7f3140154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48910/0 (socket says 172.21.15.153:48910) 2023-08-17T00:11:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 -- 172.21.15.153:0/700875199 learned_addr learned my addr 172.21.15.153:0/700875199 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 -- 172.21.15.153:0/700875199 >> v2:172.21.15.178:3300/0 conn(0x7f31400c01a0 msgr2=0x7f31400c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 --2- 172.21.15.153:0/700875199 >> v2:172.21.15.178:3300/0 conn(0x7f31400c01a0 0x7f31400c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 -- 172.21.15.153:0/700875199 >> v1:172.21.15.178:6789/0 conn(0x7f31400c57a0 legacy=0x7f31400c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 -- 172.21.15.153:0/700875199 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3140154dd0 con 0x7f3140153f50 2023-08-17T00:11:46.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3144e76700 1 --2- 172.21.15.153:0/700875199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3140153f50 0x7f3140154370 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f314006a440 tx=0x7f31300090f0).ready entity=mon.0 client_cookie=733157c08c2c9d8c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:46.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3137fff700 1 -- 172.21.15.153:0/700875199 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000b5a0 con 0x7f3140153f50 2023-08-17T00:11:46.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3137fff700 1 -- 172.21.15.153:0/700875199 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000b700 con 0x7f3140153f50 2023-08-17T00:11:46.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.458+0000 7f3137fff700 1 -- 172.21.15.153:0/700875199 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000ba80 con 0x7f3140153f50 2023-08-17T00:11:46.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- 172.21.15.153:0/700875199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3140153f50 msgr2=0x7f3140154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 --2- 172.21.15.153:0/700875199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3140153f50 0x7f3140154370 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 rx=0x7f314006a440 tx=0x7f31300090f0).stop 2023-08-17T00:11:46.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- 172.21.15.153:0/700875199 shutdown_connections 2023-08-17T00:11:46.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 --2- 172.21.15.153:0/700875199 >> v2:172.21.15.178:3300/0 conn(0x7f31400c01a0 0x7f31400c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:46.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 --2- 172.21.15.153:0/700875199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3140153f50 0x7f3140154370 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- 172.21.15.153:0/700875199 >> 172.21.15.153:0/700875199 conn(0x7f3140062a70 msgr2=0x7f31400ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:46.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- 172.21.15.153:0/700875199 shutdown_connections 2023-08-17T00:11:46.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- 172.21.15.153:0/700875199 wait complete. 2023-08-17T00:11:46.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 Processor -- start 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- start start 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31400c01a0 0x7f3140152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 0x7f31400c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3140153f50 0x7f3140155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3140155310 con 0x7f31400c57a0 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31400c27f0 con 0x7f3140153f50 2023-08-17T00:11:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3146679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31400c1940 con 0x7f31400c01a0 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3144e76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 0x7f31400c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3144e76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 0x7f31400c2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48926/0 (socket says 172.21.15.153:48926) 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.462+0000 7f3144e76700 1 -- 172.21.15.153:0/482804149 learned_addr learned my addr 172.21.15.153:0/482804149 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3144e76700 1 -- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31400c01a0 msgr2=0x7f3140152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3144e76700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31400c01a0 0x7f3140152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3144e76700 1 -- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3140153f50 msgr2=0x7f3140155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3144e76700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3140153f50 0x7f3140155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:46.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3144e76700 1 -- 172.21.15.153:0/482804149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130009370 con 0x7f31400c57a0 2023-08-17T00:11:46.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3144e76700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 0x7f31400c2c80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f3140083860 tx=0x7f3130015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:46.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000b870 con 0x7f31400c57a0 2023-08-17T00:11:46.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130020070 con 0x7f31400c57a0 2023-08-17T00:11:46.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000ba10 con 0x7f31400c57a0 2023-08-17T00:11:46.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31400c1be0 con 0x7f31400c57a0 2023-08-17T00:11:46.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31400c21a0 con 0x7f31400c57a0 2023-08-17T00:11:46.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314006b4c0 con 0x7f31400c57a0 2023-08-17T00:11:46.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.466+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f313002c070 con 0x7f31400c57a0 2023-08-17T00:11:46.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.470+0000 7f31357fa700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312405a150 0x7f312405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.470+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f31300759c0 con 0x7f31400c57a0 2023-08-17T00:11:46.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.470+0000 7f3145677700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312405a150 0x7f312405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.470+0000 7f3145677700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312405a150 0x7f312405c610 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f313c009630 tx=0x7f313c006b50).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:46.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.474+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3130049440 con 0x7f31400c57a0 2023-08-17T00:11:46.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.658+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31400bf9a0 con 0x7f31400c57a0 2023-08-17T00:11:46.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.662+0000 7f31357fa700 1 -- 172.21.15.153:0/482804149 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f313002a030 con 0x7f31400c57a0 2023-08-17T00:11:46.665 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:46.665 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:46.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312405a150 msgr2=0x7f312405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312405a150 0x7f312405c610 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f313c009630 tx=0x7f313c006b50).stop 2023-08-17T00:11:46.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 msgr2=0x7f31400c2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 0x7f31400c2c80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f3140083860 tx=0x7f3130015000).stop 2023-08-17T00:11:46.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 shutdown_connections 2023-08-17T00:11:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312405a150 0x7f312405c610 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3140153f50 0x7f3140155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31400c57a0 0x7f31400c2c80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 --2- 172.21.15.153:0/482804149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31400c01a0 0x7f3140152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:46.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 >> 172.21.15.153:0/482804149 conn(0x7f3140062a70 msgr2=0x7f3140063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:46.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 shutdown_connections 2023-08-17T00:11:46.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.666+0000 7f3146679700 1 -- 172.21.15.153:0/482804149 wait complete. 2023-08-17T00:11:46.674 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:46.690 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:11:46.691 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:11:46.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.842+0000 7fe8d2f69700 1 Processor -- start 2023-08-17T00:11:46.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.842+0000 7fe8d2f69700 1 -- start start 2023-08-17T00:11:46.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8cc0a8b70 0x7fe8cc0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8cc0a8f50 0x7fe8cc0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8cc065240 con 0x7fe8cc0656d0 2023-08-17T00:11:46.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc062ea0 con 0x7fe8cc0a8f50 2023-08-17T00:11:46.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8cc0638a0 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8cc0a8f50 0x7fe8cc0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8cc0a8f50 0x7fe8cc0629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48942/0 (socket says 172.21.15.153:48942) 2023-08-17T00:11:46.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 -- 172.21.15.153:0/2820566922 learned_addr learned my addr 172.21.15.153:0/2820566922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:46.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d0d05700 1 --2- 172.21.15.153:0/2820566922 >> v2:172.21.15.178:3300/0 conn(0x7fe8cc0a8b70 0x7fe8cc0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 -- 172.21.15.153:0/2820566922 >> v2:172.21.15.178:3300/0 conn(0x7fe8cc0a8b70 msgr2=0x7fe8cc0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:46.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 --2- 172.21.15.153:0/2820566922 >> v2:172.21.15.178:3300/0 conn(0x7fe8cc0a8b70 0x7fe8cc0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 -- 172.21.15.153:0/2820566922 >> v1:172.21.15.178:6789/0 conn(0x7fe8cc0656d0 legacy=0x7fe8cc0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 -- 172.21.15.153:0/2820566922 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc064910 con 0x7fe8cc0a8f50 2023-08-17T00:11:46.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c3fff700 1 --2- 172.21.15.153:0/2820566922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8f50 0x7fe8cc0629b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fe8cc069ba0 tx=0x7fe8bc0090f0).ready entity=mon.0 client_cookie=c413be94c83e6e0a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:46.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c37fe700 1 -- 172.21.15.153:0/2820566922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00b520 con 0x7fe8cc0a8f50 2023-08-17T00:11:46.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c37fe700 1 -- 172.21.15.153:0/2820566922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc00b680 con 0x7fe8cc0a8f50 2023-08-17T00:11:46.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8c37fe700 1 -- 172.21.15.153:0/2820566922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc00ba00 con 0x7fe8cc0a8f50 2023-08-17T00:11:46.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 -- 172.21.15.153:0/2820566922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8f50 msgr2=0x7fe8cc0629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/2820566922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8f50 0x7fe8cc0629b0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7fe8cc069ba0 tx=0x7fe8bc0090f0).stop 2023-08-17T00:11:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 -- 172.21.15.153:0/2820566922 shutdown_connections 2023-08-17T00:11:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/2820566922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8f50 0x7fe8cc0629b0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/2820566922 >> v2:172.21.15.178:3300/0 conn(0x7fe8cc0a8b70 0x7fe8cc0632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.846+0000 7fe8d2f69700 1 -- 172.21.15.153:0/2820566922 >> 172.21.15.153:0/2820566922 conn(0x7fe8cc0c7150 msgr2=0x7fe8cc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.850+0000 7fe8d2f69700 1 -- 172.21.15.153:0/2820566922 shutdown_connections 2023-08-17T00:11:46.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.850+0000 7fe8d2f69700 1 -- 172.21.15.153:0/2820566922 wait complete. 2023-08-17T00:11:46.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.850+0000 7fe8d2f69700 1 Processor -- start 2023-08-17T00:11:46.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 -- start start 2023-08-17T00:11:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8cc0656d0 0x7fe8cc154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 0x7fe8cc0c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8cc0a8f50 0x7fe8cc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc0c57f0 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc168910 con 0x7fe8cc0656d0 2023-08-17T00:11:46.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d2f69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc169730 con 0x7fe8cc0a8f50 2023-08-17T00:11:46.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 0x7fe8cc0c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 0x7fe8cc0c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48950/0 (socket says 172.21.15.153:48950) 2023-08-17T00:11:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 -- 172.21.15.153:0/3808523521 learned_addr learned my addr 172.21.15.153:0/3808523521 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:46.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d0d05700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8cc0656d0 0x7fe8cc154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8d1506700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8cc0a8f50 0x7fe8cc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 -- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8cc0a8f50 msgr2=0x7fe8cc0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8cc0a8f50 0x7fe8cc0c5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 -- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8cc0656d0 msgr2=0x7fe8cc154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.854+0000 7fe8c3fff700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8cc0656d0 0x7fe8cc154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:46.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8c3fff700 1 -- 172.21.15.153:0/3808523521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc009370 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8c3fff700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 0x7fe8cc0c4e10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fe8bc009130 tx=0x7fe8bc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc000bc0 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8bc00b7f0 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc168b20 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc000d20 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc1690e0 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.858+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8cc06b530 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.862+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe8bc02b070 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.862+0000 7fe8c0ff9700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8b805a150 0x7fe8b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:46.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.862+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fe8bc075950 con 0x7fe8cc0a8b70 2023-08-17T00:11:46.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.862+0000 7fe8d0d05700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8b805a150 0x7fe8b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:46.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.862+0000 7fe8d0d05700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8b805a150 0x7fe8b805c610 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fe8cc0c2490 tx=0x7fe8c8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:46.870+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8bc049390 con 0x7fe8cc0a8b70 2023-08-17T00:11:47.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.086+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe8cc0c5e50 con 0x7fe8cc0a8b70 2023-08-17T00:11:47.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.086+0000 7fe8c0ff9700 1 -- 172.21.15.153:0/3808523521 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1754 (secure 0 0 0) 0x7fe8bc029020 con 0x7fe8cc0a8b70 2023-08-17T00:11:47.092 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:47.092 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":554,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":114,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1076221752,"bytes_used":4653129728,"bytes_avail":768440983552,"bytes_total":773094113280,"recovering_objects_per_sec":7,"recovering_bytes_per_sec":8254443,"recovering_keys_per_sec":0,"num_objects_recovered":63,"num_bytes_recovered":66060288,"num_keys_recovered":0,"write_bytes_sec":4338726,"read_op_per_sec":0,"write_op_per_sec":265},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"b","status":"up:active","gid":7470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-08-17T00:11:45.374946+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:11:47.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8b805a150 msgr2=0x7fe8b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:47.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8b805a150 0x7fe8b805c610 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7fe8cc0c2490 tx=0x7fe8c8009060).stop 2023-08-17T00:11:47.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 msgr2=0x7fe8cc0c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:47.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 0x7fe8cc0c4e10 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 rx=0x7fe8bc009130 tx=0x7fe8bc017000).stop 2023-08-17T00:11:47.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 shutdown_connections 2023-08-17T00:11:47.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8b805a150 0x7fe8b805c610 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:47.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8cc0a8f50 0x7fe8cc0c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:47.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8cc0a8b70 0x7fe8cc0c4e10 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:47.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 --2- 172.21.15.153:0/3808523521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8cc0656d0 0x7fe8cc154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:47.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 >> 172.21.15.153:0/3808523521 conn(0x7fe8cc0c7150 msgr2=0x7fe8cc0c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:47.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 shutdown_connections 2023-08-17T00:11:47.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:47.090+0000 7fe8d2f69700 1 -- 172.21.15.153:0/3808523521 wait complete. 2023-08-17T00:11:47.117 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:11:47.117 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:11:47.118 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:11:47.161 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:11:47.204 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:11:47.204 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:11:47.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:11:47.205 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:11:47.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:11:47.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:11:47.937 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:11:47.954 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:48.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.158+0000 7fcf94b69700 1 Processor -- start 2023-08-17T00:11:48.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.158+0000 7fcf94b69700 1 -- start start 2023-08-17T00:11:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf94b69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf900a8b70 0x7fcf900632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf94b69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf900a8f50 0x7fcf900629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf94b69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900656d0 0x7fcf900bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf94b69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf90065240 con 0x7fcf900a8f50 2023-08-17T00:11:48.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf94b69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf90062ea0 con 0x7fcf900a8b70 2023-08-17T00:11:48.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf94b69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900638a0 con 0x7fcf900656d0 2023-08-17T00:11:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf900a8f50 0x7fcf900629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcf900a8f50 0x7fcf900629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48958/0 (socket says 172.21.15.153:48958) 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 -- 172.21.15.153:0/1379162591 learned_addr learned my addr 172.21.15.153:0/1379162591 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf8e59c700 1 --2- 172.21.15.153:0/1379162591 >> v2:172.21.15.178:3300/0 conn(0x7fcf900a8b70 0x7fcf900632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf8ed9d700 1 --2- 172.21.15.153:0/1379162591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900656d0 0x7fcf900bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 -- 172.21.15.153:0/1379162591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900656d0 msgr2=0x7fcf900bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 --2- 172.21.15.153:0/1379162591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900656d0 0x7fcf900bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 -- 172.21.15.153:0/1379162591 >> v2:172.21.15.178:3300/0 conn(0x7fcf900a8b70 msgr2=0x7fcf900632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 --2- 172.21.15.153:0/1379162591 >> v2:172.21.15.178:3300/0 conn(0x7fcf900a8b70 0x7fcf900632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 -- 172.21.15.153:0/1379162591 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf90064910 con 0x7fcf900a8f50 2023-08-17T00:11:48.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf87fff700 1 --2- 172.21.15.153:0/1379162591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900a8f50 0x7fcf900629b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fcf90069ba0 tx=0x7fcf780090f0).ready entity=mon.0 client_cookie=d43d285a25572235 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf8dd9b700 1 -- 172.21.15.153:0/1379162591 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800f510 con 0x7fcf900a8f50 2023-08-17T00:11:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf8dd9b700 1 -- 172.21.15.153:0/1379162591 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800f670 con 0x7fcf900a8f50 2023-08-17T00:11:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.162+0000 7fcf8dd9b700 1 -- 172.21.15.153:0/1379162591 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7800fa10 con 0x7fcf900a8f50 2023-08-17T00:11:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 -- 172.21.15.153:0/1379162591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900a8f50 msgr2=0x7fcf900629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 --2- 172.21.15.153:0/1379162591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900a8f50 0x7fcf900629b0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7fcf90069ba0 tx=0x7fcf780090f0).stop 2023-08-17T00:11:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 -- 172.21.15.153:0/1379162591 shutdown_connections 2023-08-17T00:11:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 --2- 172.21.15.153:0/1379162591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900656d0 0x7fcf900bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 --2- 172.21.15.153:0/1379162591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900a8f50 0x7fcf900629b0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 --2- 172.21.15.153:0/1379162591 >> v2:172.21.15.178:3300/0 conn(0x7fcf900a8b70 0x7fcf900632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 -- 172.21.15.153:0/1379162591 >> 172.21.15.153:0/1379162591 conn(0x7fcf900c7150 msgr2=0x7fcf900c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 -- 172.21.15.153:0/1379162591 shutdown_connections 2023-08-17T00:11:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 -- 172.21.15.153:0/1379162591 wait complete. 2023-08-17T00:11:48.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.166+0000 7fcf94b69700 1 Processor -- start 2023-08-17T00:11:48.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 -- start start 2023-08-17T00:11:48.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 0x7fcf900aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900a8b70 0x7fcf901595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf900a8f50 0x7fcf90146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900aa140 con 0x7fcf900656d0 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900aa5d0 con 0x7fcf900a8f50 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf900a9810 con 0x7fcf900a8b70 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 0x7fcf900aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 0x7fcf900aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48962/0 (socket says 172.21.15.153:48962) 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 -- 172.21.15.153:0/2429757347 learned_addr learned my addr 172.21.15.153:0/2429757347 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8ed9d700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf900a8f50 0x7fcf90146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf87fff700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900a8b70 0x7fcf901595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 -- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900a8b70 msgr2=0x7fcf901595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900a8b70 0x7fcf901595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 -- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf900a8f50 msgr2=0x7fcf90146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf900a8f50 0x7fcf90146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 -- 172.21.15.153:0/2429757347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009370 con 0x7fcf900656d0 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8ed9d700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf900a8f50 0x7fcf90146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf87fff700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900a8b70 0x7fcf901595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf8e59c700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 0x7fcf900aaa90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fcf8000e930 tx=0x7fcf80009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000eed0 con 0x7fcf900656d0 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000c850 con 0x7fcf900656d0 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf900a9af0 con 0x7fcf900656d0 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000cbd0 con 0x7fcf900656d0 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.170+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf900aaf80 con 0x7fcf900656d0 2023-08-17T00:11:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.174+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9006b530 con 0x7fcf900656d0 2023-08-17T00:11:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.174+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcf80022070 con 0x7fcf900656d0 2023-08-17T00:11:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.174+0000 7fcf867fc700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcf7005a120 0x7fcf7005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.178+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fcf80074720 con 0x7fcf900656d0 2023-08-17T00:11:48.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.178+0000 7fcf87fff700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcf7005a120 0x7fcf7005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.178+0000 7fcf87fff700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcf7005a120 0x7fcf7005c5e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fcf90069ba0 tx=0x7fcf78017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.182+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcf80048050 con 0x7fcf900656d0 2023-08-17T00:11:48.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.374+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf90064bf0 con 0x7fcf900656d0 2023-08-17T00:11:48.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.378+0000 7fcf867fc700 1 -- 172.21.15.153:0/2429757347 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fcf8004b670 con 0x7fcf900656d0 2023-08-17T00:11:48.380 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:48.381 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:48.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcf7005a120 msgr2=0x7fcf7005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcf7005a120 0x7fcf7005c5e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fcf90069ba0 tx=0x7fcf78017000).stop 2023-08-17T00:11:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 msgr2=0x7fcf900aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 0x7fcf900aaa90 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7fcf8000e930 tx=0x7fcf80009060).stop 2023-08-17T00:11:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 shutdown_connections 2023-08-17T00:11:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcf7005a120 0x7fcf7005c5e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf900a8f50 0x7fcf90146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf900a8b70 0x7fcf901595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 --2- 172.21.15.153:0/2429757347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcf900656d0 0x7fcf900aaa90 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 >> 172.21.15.153:0/2429757347 conn(0x7fcf900c7150 msgr2=0x7fcf900c23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:48.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 shutdown_connections 2023-08-17T00:11:48.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.382+0000 7fcf94b69700 1 -- 172.21.15.153:0/2429757347 wait complete. 2023-08-17T00:11:48.388 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:48.406 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:11:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a4d907700 1 Processor -- start 2023-08-17T00:11:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a4d907700 1 -- start start 2023-08-17T00:11:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a4d907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a480689c0 0x7f0a48068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a4d907700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a48065da0 con 0x7f0a481560f0 2023-08-17T00:11:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a4d907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a48155c60 con 0x7f0a48151530 2023-08-17T00:11:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a4d907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48156550 con 0x7f0a480689c0 2023-08-17T00:11:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a47fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0a481560f0 0x7f0a480c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33388/0 (socket says 172.21.15.153:33388) 2023-08-17T00:11:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.562+0000 7f0a47fff700 1 -- 172.21.15.153:0/3586394260 learned_addr learned my addr 172.21.15.153:0/3586394260 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335149676 0 0) 0x7f0a48065da0 con 0x7f0a481560f0 2023-08-17T00:11:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4c905700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a480689c0 0x7f0a48068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a300033f0 con 0x7f0a481560f0 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163773240 0 0) 0x7f0a300033f0 con 0x7f0a481560f0 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a480689c0 msgr2=0x7f0a48068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a480689c0 0x7f0a48068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 >> v1:172.21.15.178:6789/0 conn(0x7f0a48151530 legacy=0x7f0a481519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a48065ff0 con 0x7f0a481560f0 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f0a38001470 con 0x7f0a481560f0 2023-08-17T00:11:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 >> v1:172.21.15.153:6789/0 conn(0x7f0a481560f0 legacy=0x7f0a480c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30003910 0x7f0a30003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a30004690 0x7f0a30004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a30005070 0x7f0a3000b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48156550 con 0x7f0a30005070 2023-08-17T00:11:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000bfc0 con 0x7f0a30004690 2023-08-17T00:11:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3000c180 con 0x7f0a30003910 2023-08-17T00:11:48.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a30005070 0x7f0a3000b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4c905700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30003910 0x7f0a30003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a47fff700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a30004690 0x7f0a30004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 -- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30003910 msgr2=0x7f0a30003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30003910 0x7f0a30003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 -- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a30004690 msgr2=0x7f0a30004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a30004690 0x7f0a30004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 -- 172.21.15.153:0/3586394260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a300033f0 con 0x7f0a30005070 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a47fff700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a30004690 0x7f0a30004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a4d106700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a30005070 0x7f0a3000b8e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f0a40002d70 tx=0x7f0a40007f30).ready entity=mon.0 client_cookie=e6b6b9e231f4201e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40006a20 con 0x7f0a30005070 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40006ba0 con 0x7f0a30005070 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.566+0000 7f0a477fe700 1 -- 172.21.15.153:0/3586394260 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000c5d0 con 0x7f0a30005070 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 -- 172.21.15.153:0/3586394260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a30005070 msgr2=0x7f0a3000b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 --2- 172.21.15.153:0/3586394260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a30005070 0x7f0a3000b8e0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 rx=0x7f0a40002d70 tx=0x7f0a40007f30).stop 2023-08-17T00:11:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d106700 1 -- 172.21.15.153:0/3586394260 reap_dead start 2023-08-17T00:11:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 -- 172.21.15.153:0/3586394260 shutdown_connections 2023-08-17T00:11:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 -- 172.21.15.153:0/3586394260 >> 172.21.15.153:0/3586394260 conn(0x7f0a480c6620 msgr2=0x7f0a480c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 -- 172.21.15.153:0/3586394260 shutdown_connections 2023-08-17T00:11:48.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 -- 172.21.15.153:0/3586394260 wait complete. 2023-08-17T00:11:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 Processor -- start 2023-08-17T00:11:48.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.570+0000 7f0a4d907700 1 -- start start 2023-08-17T00:11:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30005070 0x7f0a480c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 0x7f0a480bb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a480bece0 0x7f0a480bf140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480c1830 con 0x7f0a4814bad0 2023-08-17T00:11:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480bf630 con 0x7f0a480bece0 2023-08-17T00:11:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a480c0c20 con 0x7f0a30005070 2023-08-17T00:11:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 0x7f0a480bb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 0x7f0a480bb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48990/0 (socket says 172.21.15.153:48990) 2023-08-17T00:11:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 -- 172.21.15.153:0/2793608205 learned_addr learned my addr 172.21.15.153:0/2793608205 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4c905700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30005070 0x7f0a480c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d106700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a480bece0 0x7f0a480bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 -- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30005070 msgr2=0x7f0a480c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30005070 0x7f0a480c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 -- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a480bece0 msgr2=0x7f0a480bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a480bece0 0x7f0a480bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 -- 172.21.15.153:0/2793608205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480c0f00 con 0x7f0a4814bad0 2023-08-17T00:11:48.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d106700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a480bece0 0x7f0a480bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a47fff700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 0x7f0a480bb700 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f0a3800e780 tx=0x7f0a38000cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38010490 con 0x7f0a4814bad0 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38010040 con 0x7f0a4814bad0 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a480c11e0 con 0x7f0a4814bad0 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.574+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38010860 con 0x7f0a4814bad0 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.578+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a480c21b0 con 0x7f0a4814bad0 2023-08-17T00:11:48.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.578+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a480bd380 con 0x7f0a4814bad0 2023-08-17T00:11:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.578+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0a38010bd0 con 0x7f0a4814bad0 2023-08-17T00:11:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.582+0000 7f0a44ff9700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a3405a180 0x7f0a3405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.582+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f0a38073a70 con 0x7f0a4814bad0 2023-08-17T00:11:48.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.582+0000 7f0a4c905700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a3405a180 0x7f0a3405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.582+0000 7f0a4c905700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a3405a180 0x7f0a3405c640 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f0a3c006fd0 tx=0x7f0a3c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.586+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a480bd380 con 0x7f0a4814bad0 2023-08-17T00:11:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.742+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a480bd380 con 0x7f0a4814bad0 2023-08-17T00:11:48.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.746+0000 7f0a44ff9700 1 -- 172.21.15.153:0/2793608205 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17182 (secure 0 0 0) 0x7f0a480bd380 con 0x7f0a4814bad0 2023-08-17T00:11:48.750 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:48.750 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":114,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:11:40.478543+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:10:55.905753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T00:10:56.871921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.7","mappings":[{"from":4,"to":3}]},{"pgid":"16.8","mappings":[{"from":4,"to":3}]},{"pgid":"16.2d","mappings":[{"from":2,"to":3}]},{"pgid":"16.37","mappings":[{"from":4,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:11:48.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a3405a180 msgr2=0x7f0a3405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a3405a180 0x7f0a3405c640 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f0a3c006fd0 tx=0x7f0a3c008040).stop 2023-08-17T00:11:48.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 msgr2=0x7f0a480bb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 0x7f0a480bb700 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7f0a3800e780 tx=0x7f0a38000cc0).stop 2023-08-17T00:11:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 shutdown_connections 2023-08-17T00:11:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a3405a180 0x7f0a3405c640 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a480bece0 0x7f0a480bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a4814bad0 0x7f0a480bb700 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 --2- 172.21.15.153:0/2793608205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a30005070 0x7f0a480c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 >> 172.21.15.153:0/2793608205 conn(0x7f0a480c6620 msgr2=0x7f0a480645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:48.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 shutdown_connections 2023-08-17T00:11:48.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.750+0000 7f0a4d907700 1 -- 172.21.15.153:0/2793608205 wait complete. 2023-08-17T00:11:48.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:10:55.905753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:10:56.871921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:11:48.773 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:11:48.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 Processor -- start 2023-08-17T00:11:48.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 -- start start 2023-08-17T00:11:48.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff94c0ca4f0 0x7ff94c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff94c0c9f00 0x7ff94c062490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c0c9a70 con 0x7ff94c0a9c40 2023-08-17T00:11:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c062980 con 0x7ff94c0c9f00 2023-08-17T00:11:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.930+0000 7ff951e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c0ab690 con 0x7ff94c0ca4f0 2023-08-17T00:11:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951638700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff94c0c9f00 0x7ff94c062490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff950e37700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff94c0a9c40 0x7ff94c0c57d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:55894/0 (socket says 172.21.15.153:55894) 2023-08-17T00:11:48.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff950e37700 1 -- 172.21.15.153:0/559631910 learned_addr learned my addr 172.21.15.153:0/559631910 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:48.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff94bfff700 1 --2- 172.21.15.153:0/559631910 >> v2:172.21.15.178:3300/0 conn(0x7ff94c0ca4f0 0x7ff94c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951638700 1 -- 172.21.15.153:0/559631910 >> v2:172.21.15.178:3300/0 conn(0x7ff94c0ca4f0 msgr2=0x7ff94c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951638700 1 --2- 172.21.15.153:0/559631910 >> v2:172.21.15.178:3300/0 conn(0x7ff94c0ca4f0 0x7ff94c061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff94b7fe700 1 -- 172.21.15.153:0/559631910 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425161770 0 0) 0x7ff94c0c9a70 con 0x7ff94c0a9c40 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951638700 1 -- 172.21.15.153:0/559631910 >> v1:172.21.15.178:6789/0 conn(0x7ff94c0a9c40 legacy=0x7ff94c0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951638700 1 -- 172.21.15.153:0/559631910 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c153fa0 con 0x7ff94c0c9f00 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951638700 1 --2- 172.21.15.153:0/559631910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0c9f00 0x7ff94c062490 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7ff94c046fa0 tx=0x7ff944009780).ready entity=mon.0 client_cookie=852291bd2c942bbd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff94b7fe700 1 -- 172.21.15.153:0/559631910 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94400e070 con 0x7ff94c0c9f00 2023-08-17T00:11:48.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff94b7fe700 1 -- 172.21.15.153:0/559631910 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94400bb60 con 0x7ff94c0c9f00 2023-08-17T00:11:48.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff94b7fe700 1 -- 172.21.15.153:0/559631910 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff944012410 con 0x7ff94c0c9f00 2023-08-17T00:11:48.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 -- 172.21.15.153:0/559631910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0c9f00 msgr2=0x7ff94c062490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 --2- 172.21.15.153:0/559631910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0c9f00 0x7ff94c062490 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7ff94c046fa0 tx=0x7ff944009780).stop 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 -- 172.21.15.153:0/559631910 shutdown_connections 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 --2- 172.21.15.153:0/559631910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0c9f00 0x7ff94c062490 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 --2- 172.21.15.153:0/559631910 >> v2:172.21.15.178:3300/0 conn(0x7ff94c0ca4f0 0x7ff94c061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 -- 172.21.15.153:0/559631910 >> 172.21.15.153:0/559631910 conn(0x7ff94c0cb370 msgr2=0x7ff94c0c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 -- 172.21.15.153:0/559631910 shutdown_connections 2023-08-17T00:11:48.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.934+0000 7ff951e39700 1 -- 172.21.15.153:0/559631910 wait complete. 2023-08-17T00:11:48.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.938+0000 7ff951e39700 1 Processor -- start 2023-08-17T00:11:48.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.938+0000 7ff951e39700 1 -- start start 2023-08-17T00:11:48.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 0x7ff94c156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff94c0c9f00 0x7ff94c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff94c0ca4f0 0x7ff94c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0af670 con 0x7ff94c0a9c40 2023-08-17T00:11:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c156860 con 0x7ff94c0ca4f0 2023-08-17T00:11:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0b0720 con 0x7ff94c0c9f00 2023-08-17T00:11:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 0x7ff94c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 0x7ff94c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49008/0 (socket says 172.21.15.153:49008) 2023-08-17T00:11:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 -- 172.21.15.153:0/2383961581 learned_addr learned my addr 172.21.15.153:0/2383961581 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff94bfff700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff94c0c9f00 0x7ff94c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951638700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff94c0ca4f0 0x7ff94c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 -- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff94c0c9f00 msgr2=0x7ff94c0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff94c0c9f00 0x7ff94c0afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 -- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff94c0ca4f0 msgr2=0x7ff94c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:48.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff94c0ca4f0 0x7ff94c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 -- 172.21.15.153:0/2383961581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009a20 con 0x7ff94c0a9c40 2023-08-17T00:11:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff950e37700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 0x7ff94c156370 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7ff940001eb0 tx=0x7ff940007e90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400070d0 con 0x7ff94c0a9c40 2023-08-17T00:11:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff940007230 con 0x7ff94c0a9c40 2023-08-17T00:11:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9400075d0 con 0x7ff94c0a9c40 2023-08-17T00:11:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c1672f0 con 0x7ff94c0a9c40 2023-08-17T00:11:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.942+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c1678b0 con 0x7ff94c0a9c40 2023-08-17T00:11:48.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.946+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c06b4c0 con 0x7ff94c0a9c40 2023-08-17T00:11:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.946+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff940010070 con 0x7ff94c0a9c40 2023-08-17T00:11:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.946+0000 7ff948ff9700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93005a120 0x7ff93005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.946+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7ff9400739f0 con 0x7ff94c0a9c40 2023-08-17T00:11:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.946+0000 7ff94bfff700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93005a120 0x7ff93005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.950+0000 7ff94bfff700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93005a120 0x7ff93005c5e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7ff94c14bb90 tx=0x7ff938009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:48.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:48.954+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff940047320 con 0x7ff94c0a9c40 2023-08-17T00:11:49.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.110+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff94c0abc90 con 0x7ff94c0a9c40 2023-08-17T00:11:49.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.110+0000 7ff948ff9700 1 -- 172.21.15.153:0/2383961581 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v114) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff94004a940 con 0x7ff94c0a9c40 2023-08-17T00:11:49.114 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:11:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93005a120 msgr2=0x7ff93005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93005a120 0x7ff93005c5e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7ff94c14bb90 tx=0x7ff938009060).stop 2023-08-17T00:11:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 msgr2=0x7ff94c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 0x7ff94c156370 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 rx=0x7ff940001eb0 tx=0x7ff940007e90).stop 2023-08-17T00:11:49.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 shutdown_connections 2023-08-17T00:11:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff93005a120 0x7ff93005c5e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff94c0ca4f0 0x7ff94c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff94c0c9f00 0x7ff94c0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 --2- 172.21.15.153:0/2383961581 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff94c0a9c40 0x7ff94c156370 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 >> 172.21.15.153:0/2383961581 conn(0x7ff94c0cb370 msgr2=0x7ff94c0aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:49.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 shutdown_connections 2023-08-17T00:11:49.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.114+0000 7ff951e39700 1 -- 172.21.15.153:0/2383961581 wait complete. 2023-08-17T00:11:49.135 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:11:49.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 Processor -- start 2023-08-17T00:11:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 -- start start 2023-08-17T00:11:49.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0a0151630 0x7fe0a00bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0a0151a10 0x7fe0a0066130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a0062c90 con 0x7fe0a0063120 2023-08-17T00:11:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a0066620 con 0x7fe0a0151a10 2023-08-17T00:11:49.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe0a56f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00657d0 con 0x7fe0a0151630 2023-08-17T00:11:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0a0151a10 0x7fe0a0066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0a0151a10 0x7fe0a0066130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49012/0 (socket says 172.21.15.153:49012) 2023-08-17T00:11:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 -- 172.21.15.153:0/265442560 learned_addr learned my addr 172.21.15.153:0/265442560 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe09effd700 1 --2- 172.21.15.153:0/265442560 >> v2:172.21.15.178:3300/0 conn(0x7fe0a0151630 0x7fe0a00bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 -- 172.21.15.153:0/265442560 >> v2:172.21.15.178:3300/0 conn(0x7fe0a0151630 msgr2=0x7fe0a00bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 --2- 172.21.15.153:0/265442560 >> v2:172.21.15.178:3300/0 conn(0x7fe0a0151630 0x7fe0a00bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 -- 172.21.15.153:0/265442560 >> v1:172.21.15.178:6789/0 conn(0x7fe0a0063120 legacy=0x7fe0a01553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 -- 172.21.15.153:0/265442560 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0062980 con 0x7fe0a0151a10 2023-08-17T00:11:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe097fff700 1 --2- 172.21.15.153:0/265442560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151a10 0x7fe0a0066130 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fe0a0063b80 tx=0x7fe0880090f0).ready entity=mon.0 client_cookie=72aa79566160145e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe09e7fc700 1 -- 172.21.15.153:0/265442560 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08800b520 con 0x7fe0a0151a10 2023-08-17T00:11:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe09e7fc700 1 -- 172.21.15.153:0/265442560 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08800b680 con 0x7fe0a0151a10 2023-08-17T00:11:49.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.290+0000 7fe09e7fc700 1 -- 172.21.15.153:0/265442560 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08800ba20 con 0x7fe0a0151a10 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 -- 172.21.15.153:0/265442560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151a10 msgr2=0x7fe0a0066130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/265442560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151a10 0x7fe0a0066130 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fe0a0063b80 tx=0x7fe0880090f0).stop 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 -- 172.21.15.153:0/265442560 shutdown_connections 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/265442560 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151a10 0x7fe0a0066130 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/265442560 >> v2:172.21.15.178:3300/0 conn(0x7fe0a0151630 0x7fe0a00bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 -- 172.21.15.153:0/265442560 >> 172.21.15.153:0/265442560 conn(0x7fe0a00c2fb0 msgr2=0x7fe0a00c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:49.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 -- 172.21.15.153:0/265442560 shutdown_connections 2023-08-17T00:11:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 -- 172.21.15.153:0/265442560 wait complete. 2023-08-17T00:11:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 Processor -- start 2023-08-17T00:11:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.294+0000 7fe0a56f1700 1 -- start start 2023-08-17T00:11:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0a0063120 0x7fe0a00c0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 0x7fe0a00a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0a0151a10 0x7fe0a00c1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00ab490 con 0x7fe0a0151630 2023-08-17T00:11:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00aa8c0 con 0x7fe0a0151a10 2023-08-17T00:11:49.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00c25b0 con 0x7fe0a0063120 2023-08-17T00:11:49.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 0x7fe0a00a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 0x7fe0a00a58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49024/0 (socket says 172.21.15.153:49024) 2023-08-17T00:11:49.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 -- 172.21.15.153:0/171633368 learned_addr learned my addr 172.21.15.153:0/171633368 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:49.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe09effd700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0a0063120 0x7fe0a00c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe09f7fe700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0a0151a10 0x7fe0a00c1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 -- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0a0063120 msgr2=0x7fe0a00c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0a0063120 0x7fe0a00c0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 -- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0a0151a10 msgr2=0x7fe0a00c1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0a0151a10 0x7fe0a00c1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 -- 172.21.15.153:0/171633368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088009370 con 0x7fe0a0151630 2023-08-17T00:11:49.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe097fff700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 0x7fe0a00a58e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fe088006fd0 tx=0x7fe088017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088006d90 con 0x7fe0a0151630 2023-08-17T00:11:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe088000bc0 con 0x7fe0a0151630 2023-08-17T00:11:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00c2350 con 0x7fe0a0151630 2023-08-17T00:11:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08801c420 con 0x7fe0a0151630 2023-08-17T00:11:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.298+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a00aadd0 con 0x7fe0a0151630 2023-08-17T00:11:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.302+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a014b610 con 0x7fe0a0151630 2023-08-17T00:11:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.302+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe08802c070 con 0x7fe0a0151630 2023-08-17T00:11:49.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.302+0000 7fe096ffd700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe08005a150 0x7fe08005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.302+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fe088075b00 con 0x7fe0a0151630 2023-08-17T00:11:49.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.306+0000 7fe09effd700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe08005a150 0x7fe08005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.306+0000 7fe09effd700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe08005a150 0x7fe08005c610 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fe090009c30 tx=0x7fe090009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:49.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.310+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe0a014b610 con 0x7fe0a0151630 2023-08-17T00:11:49.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.466+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0a00ab5d0 con 0x7fe0a0151630 2023-08-17T00:11:49.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.466+0000 7fe096ffd700 1 -- 172.21.15.153:0/171633368 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v114) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0a00ab5d0 con 0x7fe0a0151630 2023-08-17T00:11:49.472 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:11:49.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe08005a150 msgr2=0x7fe08005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe08005a150 0x7fe08005c610 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fe090009c30 tx=0x7fe090009060).stop 2023-08-17T00:11:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 msgr2=0x7fe0a00a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 0x7fe0a00a58e0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 rx=0x7fe088006fd0 tx=0x7fe088017000).stop 2023-08-17T00:11:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 shutdown_connections 2023-08-17T00:11:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe08005a150 0x7fe08005c610 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0a0151a10 0x7fe0a00c1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0a0151630 0x7fe0a00a58e0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 --2- 172.21.15.153:0/171633368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0a0063120 0x7fe0a00c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 >> 172.21.15.153:0/171633368 conn(0x7fe0a00c2fb0 msgr2=0x7fe0a014af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:49.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 shutdown_connections 2023-08-17T00:11:49.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.470+0000 7fe0a56f1700 1 -- 172.21.15.153:0/171633368 wait complete. 2023-08-17T00:11:49.497 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:11:49.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 Processor -- start 2023-08-17T00:11:49.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 -- start start 2023-08-17T00:11:49.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2868153e90 0x7f28680c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28680c7980 0x7f28680ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28680aa750 con 0x7f2868153ab0 2023-08-17T00:11:49.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680c9dd0 con 0x7f2868153e90 2023-08-17T00:11:49.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.662+0000 7f286f5db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28680aacf0 con 0x7f28680c7980 2023-08-17T00:11:49.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286cb76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2868153e90 0x7f28680c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286d377700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2868153ab0 0x7f28680c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33402/0 (socket says 172.21.15.153:33402) 2023-08-17T00:11:49.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286d377700 1 -- 172.21.15.153:0/730709898 learned_addr learned my addr 172.21.15.153:0/730709898 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:49.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286db78700 1 --2- 172.21.15.153:0/730709898 >> v2:172.21.15.178:3300/0 conn(0x7f28680c7980 0x7f28680ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286cb76700 1 -- 172.21.15.153:0/730709898 >> v2:172.21.15.178:3300/0 conn(0x7f28680c7980 msgr2=0x7f28680ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:49.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286cb76700 1 --2- 172.21.15.153:0/730709898 >> v2:172.21.15.178:3300/0 conn(0x7f28680c7980 0x7f28680ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286cb76700 1 -- 172.21.15.153:0/730709898 >> v1:172.21.15.153:6789/0 conn(0x7f2868153ab0 legacy=0x7f28680c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286cb76700 1 -- 172.21.15.153:0/730709898 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28681542f0 con 0x7f2868153e90 2023-08-17T00:11:49.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286cb76700 1 --2- 172.21.15.153:0/730709898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153e90 0x7f28680c7490 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f286805ea10 tx=0x7f2858009060).ready entity=mon.0 client_cookie=8d4708942fee933d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:49.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f285ffff700 1 -- 172.21.15.153:0/730709898 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28580090d0 con 0x7f2868153e90 2023-08-17T00:11:49.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f285ffff700 1 -- 172.21.15.153:0/730709898 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800b580 con 0x7f2868153e90 2023-08-17T00:11:49.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f285ffff700 1 -- 172.21.15.153:0/730709898 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800b900 con 0x7f2868153e90 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 -- 172.21.15.153:0/730709898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153e90 msgr2=0x7f28680c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 --2- 172.21.15.153:0/730709898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153e90 0x7f28680c7490 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 rx=0x7f286805ea10 tx=0x7f2858009060).stop 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 -- 172.21.15.153:0/730709898 shutdown_connections 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 --2- 172.21.15.153:0/730709898 >> v2:172.21.15.178:3300/0 conn(0x7f28680c7980 0x7f28680ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 --2- 172.21.15.153:0/730709898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153e90 0x7f28680c7490 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 -- 172.21.15.153:0/730709898 >> 172.21.15.153:0/730709898 conn(0x7f2868061fa0 msgr2=0x7f28680623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 -- 172.21.15.153:0/730709898 shutdown_connections 2023-08-17T00:11:49.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.666+0000 7f286f5db700 1 -- 172.21.15.153:0/730709898 wait complete. 2023-08-17T00:11:49.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.670+0000 7f286f5db700 1 Processor -- start 2023-08-17T00:11:49.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.670+0000 7f286f5db700 1 -- start start 2023-08-17T00:11:49.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28680c7980 0x7f2868150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 0x7f2868164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2868153e90 0x7f2868152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868157ea0 con 0x7f2868153ab0 2023-08-17T00:11:49.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2868158440 con 0x7f2868153e90 2023-08-17T00:11:49.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2868165230 con 0x7f28680c7980 2023-08-17T00:11:49.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 0x7f2868164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 0x7f2868164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49044/0 (socket says 172.21.15.153:49044) 2023-08-17T00:11:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 -- 172.21.15.153:0/2906268322 learned_addr learned my addr 172.21.15.153:0/2906268322 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 -- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28680c7980 msgr2=0x7f2868150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28680c7980 0x7f2868150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 -- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2868153e90 msgr2=0x7f2868152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2868153e90 0x7f2868152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 -- 172.21.15.153:0/2906268322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28580092a0 con 0x7f2868153ab0 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286cb76700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 0x7f2868164290 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f2858009e80 tx=0x7f2858017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285800b6f0 con 0x7f2868153ab0 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285800b850 con 0x7f2868153ab0 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2868164c70 con 0x7f2868153ab0 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285801c670 con 0x7f2868153ab0 2023-08-17T00:11:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28681580d0 con 0x7f2868153ab0 2023-08-17T00:11:49.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.674+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f286806b530 con 0x7f2868153ab0 2023-08-17T00:11:49.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.678+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f285802c070 con 0x7f2868153ab0 2023-08-17T00:11:49.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.678+0000 7f285d7fa700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284c05a180 0x7f284c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:49.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.678+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f2858075e50 con 0x7f2868153ab0 2023-08-17T00:11:49.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.678+0000 7f286d377700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284c05a180 0x7f284c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:49.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.678+0000 7f286d377700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284c05a180 0x7f284c05c640 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2868157c90 tx=0x7f28640079b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:49.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.686+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2858049780 con 0x7f2868153ab0 2023-08-17T00:11:49.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.842+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28681585d0 con 0x7f2868153ab0 2023-08-17T00:11:49.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f285d7fa700 1 -- 172.21.15.153:0/2906268322 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v114) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28580200a0 con 0x7f2868153ab0 2023-08-17T00:11:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:11:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284c05a180 msgr2=0x7f284c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284c05a180 0x7f284c05c640 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f2868157c90 tx=0x7f28640079b0).stop 2023-08-17T00:11:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 msgr2=0x7f2868164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 0x7f2868164290 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7f2858009e80 tx=0x7f2858017000).stop 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 shutdown_connections 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f284c05a180 0x7f284c05c640 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2868153e90 0x7f2868152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2868153ab0 0x7f2868164290 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 --2- 172.21.15.153:0/2906268322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28680c7980 0x7f2868150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 >> 172.21.15.153:0/2906268322 conn(0x7f2868061fa0 msgr2=0x7f2868155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:49.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 shutdown_connections 2023-08-17T00:11:49.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:49.846+0000 7f286f5db700 1 -- 172.21.15.153:0/2906268322 wait complete. 2023-08-17T00:11:49.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:11:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.038+0000 7fb2b4569700 1 Processor -- start 2023-08-17T00:11:50.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.038+0000 7fb2b4569700 1 -- start start 2023-08-17T00:11:50.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b4569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2ac0626b0 0x7fb2ac0c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b4569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac0c0330 con 0x7fb2ac153ab0 2023-08-17T00:11:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b4569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2ac0c0ed0 con 0x7fb2ac153e90 2023-08-17T00:11:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b4569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2ac1542f0 con 0x7fb2ac0626b0 2023-08-17T00:11:50.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b2305700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb2ac153ab0 0x7fb2ac0c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33412/0 (socket says 172.21.15.153:33412) 2023-08-17T00:11:50.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b2305700 1 -- 172.21.15.153:0/542791823 learned_addr learned my addr 172.21.15.153:0/542791823 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:50.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b2b06700 1 --2- 172.21.15.153:0/542791823 >> v2:172.21.15.178:3300/0 conn(0x7fb2ac0626b0 0x7fb2ac0c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4107666897 0 0) 0x7fb2ac0c0330 con 0x7fb2ac153ab0 2023-08-17T00:11:50.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2980033f0 con 0x7fb2ac153ab0 2023-08-17T00:11:50.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933376601 0 0) 0x7fb2980033f0 con 0x7fb2ac153ab0 2023-08-17T00:11:50.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 >> v2:172.21.15.178:3300/0 conn(0x7fb2ac0626b0 msgr2=0x7fb2ac0c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:50.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 --2- 172.21.15.153:0/542791823 >> v2:172.21.15.178:3300/0 conn(0x7fb2ac0626b0 0x7fb2ac0c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 >> v1:172.21.15.178:6789/0 conn(0x7fb2ac153e90 legacy=0x7fb2ac061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac0c60a0 con 0x7fb2ac153ab0 2023-08-17T00:11:50.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fb2a8001470 con 0x7fb2ac153ab0 2023-08-17T00:11:50.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 >> v1:172.21.15.153:6789/0 conn(0x7fb2ac153ab0 legacy=0x7fb2ac0c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2980038e0 0x7fb298003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb298004690 0x7fb298004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb298005050 0x7fb29800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1542f0 con 0x7fb298004690 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29800bfe0 con 0x7fb298005050 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29800c1a0 con 0x7fb2980038e0 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.042+0000 7fb2b1b04700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb298004690 0x7fb298004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b2305700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2980038e0 0x7fb298003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b2b06700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb298005050 0x7fb29800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1b04700 1 -- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2980038e0 msgr2=0x7fb298003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1b04700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2980038e0 0x7fb298003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1b04700 1 -- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb298005050 msgr2=0x7fb29800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1b04700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb298005050 0x7fb29800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1b04700 1 -- 172.21.15.153:0/542791823 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980033f0 con 0x7fb298004690 2023-08-17T00:11:50.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b2b06700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb298005050 0x7fb29800b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:50.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b2b06700 1 -- 172.21.15.153:0/542791823 reap_dead start 2023-08-17T00:11:50.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1b04700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb298004690 0x7fb298004b10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fb29c001700 tx=0x7fb29c007bb0).ready entity=mon.0 client_cookie=33c4b8ac215e1e1e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c007020 con 0x7fb298004690 2023-08-17T00:11:50.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c007180 con 0x7fb298004690 2023-08-17T00:11:50.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b1303700 1 -- 172.21.15.153:0/542791823 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c007540 con 0x7fb298004690 2023-08-17T00:11:50.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 -- 172.21.15.153:0/542791823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb298004690 msgr2=0x7fb298004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb298004690 0x7fb298004b10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7fb29c001700 tx=0x7fb29c007bb0).stop 2023-08-17T00:11:50.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 -- 172.21.15.153:0/542791823 shutdown_connections 2023-08-17T00:11:50.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 --2- 172.21.15.153:0/542791823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb298004690 0x7fb298004b10 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 -- 172.21.15.153:0/542791823 >> 172.21.15.153:0/542791823 conn(0x7fb2ac0caaa0 msgr2=0x7fb2ac0caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:50.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 -- 172.21.15.153:0/542791823 shutdown_connections 2023-08-17T00:11:50.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.046+0000 7fb2b4569700 1 -- 172.21.15.153:0/542791823 wait complete. 2023-08-17T00:11:50.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 Processor -- start 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 -- start start 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb298004690 0x7fb2ac14e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ac0c4660 0x7fb2ac14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 0x7fb2ac063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac063fa0 con 0x7fb2ac063630 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1641e0 con 0x7fb2ac0c4660 2023-08-17T00:11:50.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.050+0000 7fb2b4569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ac1644c0 con 0x7fb298004690 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 0x7fb2ac063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 0x7fb2ac063ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49060/0 (socket says 172.21.15.153:49060) 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 -- 172.21.15.153:0/3847289551 learned_addr learned my addr 172.21.15.153:0/3847289551 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2305700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb298004690 0x7fb2ac14e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b1b04700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ac0c4660 0x7fb2ac14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 -- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb298004690 msgr2=0x7fb2ac14e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb298004690 0x7fb2ac14e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 -- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ac0c4660 msgr2=0x7fb2ac14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ac0c4660 0x7fb2ac14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 -- 172.21.15.153:0/3847289551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ac1647a0 con 0x7fb2ac063630 2023-08-17T00:11:50.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b2b06700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 0x7fb2ac063ab0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fb2ac06a770 tx=0x7fb2a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400e030 con 0x7fb2ac063630 2023-08-17T00:11:50.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400f040 con 0x7fb2ac063630 2023-08-17T00:11:50.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2ac164a80 con 0x7fb2ac063630 2023-08-17T00:11:50.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4010df0 con 0x7fb2ac063630 2023-08-17T00:11:50.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac1504d0 con 0x7fb2ac063630 2023-08-17T00:11:50.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.054+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2ac06b530 con 0x7fb2ac063630 2023-08-17T00:11:50.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.058+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb2a4015690 con 0x7fb2ac063630 2023-08-17T00:11:50.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.058+0000 7fb2a27fc700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb29005a180 0x7fb29005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.058+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fb2a4074c10 con 0x7fb2ac063630 2023-08-17T00:11:50.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.058+0000 7fb2b2305700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb29005a180 0x7fb29005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.058+0000 7fb2b2305700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb29005a180 0x7fb29005c640 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fb2a8000e10 tx=0x7fb2a8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.066+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb2a40485f0 con 0x7fb2ac063630 2023-08-17T00:11:50.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.230+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2ac0bfa00 con 0x7fb2ac063630 2023-08-17T00:11:50.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.230+0000 7fb2a27fc700 1 -- 172.21.15.153:0/3847289551 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v114) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb2a404bc10 con 0x7fb2ac063630 2023-08-17T00:11:50.236 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:11:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb29005a180 msgr2=0x7fb29005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb29005a180 0x7fb29005c640 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fb2a8000e10 tx=0x7fb2a8009040).stop 2023-08-17T00:11:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 msgr2=0x7fb2ac063ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 0x7fb2ac063ab0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7fb2ac06a770 tx=0x7fb2a400b040).stop 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 shutdown_connections 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb29005a180 0x7fb29005c640 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb2ac063630 0x7fb2ac063ab0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2ac0c4660 0x7fb2ac14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 --2- 172.21.15.153:0/3847289551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb298004690 0x7fb2ac14e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 >> 172.21.15.153:0/3847289551 conn(0x7fb2ac0caaa0 msgr2=0x7fb2ac14f470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:50.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 shutdown_connections 2023-08-17T00:11:50.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.234+0000 7fb2b4569700 1 -- 172.21.15.153:0/3847289551 wait complete. 2023-08-17T00:11:50.259 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.406+0000 7fccd8bf9700 1 Processor -- start 2023-08-17T00:11:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.406+0000 7fccd8bf9700 1 -- start start 2023-08-17T00:11:50.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd8bf9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccd4150880 0x7fccd40a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd8bf9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40ab9b0 con 0x7fccd40a8e60 2023-08-17T00:11:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd8bf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd40aada0 con 0x7fccd4068f30 2023-08-17T00:11:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd8bf9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40ab080 con 0x7fccd4150880 2023-08-17T00:11:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccd4150880 0x7fccd40a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fccd4150880 0x7fccd40a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49076/0 (socket says 172.21.15.153:49076) 2023-08-17T00:11:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd37fe700 1 -- 172.21.15.153:0/3174441741 learned_addr learned my addr 172.21.15.153:0/3174441741 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:50.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd37fe700 1 -- 172.21.15.153:0/3174441741 >> v1:172.21.15.178:6789/0 conn(0x7fccd4068f30 legacy=0x7fccd4064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd37fe700 1 -- 172.21.15.153:0/3174441741 >> v1:172.21.15.153:6789/0 conn(0x7fccd40a8e60 legacy=0x7fccd4068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.410+0000 7fccd37fe700 1 -- 172.21.15.153:0/3174441741 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40ab360 con 0x7fccd4150880 2023-08-17T00:11:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd37fe700 1 --2- 172.21.15.153:0/3174441741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd40a8970 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fccc4009f70 tx=0x7fccc4009840).ready entity=mon.0 client_cookie=3b5a32764fe5f9ef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd2ffd700 1 -- 172.21.15.153:0/3174441741 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400e070 con 0x7fccd4150880 2023-08-17T00:11:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd2ffd700 1 -- 172.21.15.153:0/3174441741 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400bad0 con 0x7fccd4150880 2023-08-17T00:11:50.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd2ffd700 1 -- 172.21.15.153:0/3174441741 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400be50 con 0x7fccd4150880 2023-08-17T00:11:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 -- 172.21.15.153:0/3174441741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 msgr2=0x7fccd40a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/3174441741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd40a8970 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7fccc4009f70 tx=0x7fccc4009840).stop 2023-08-17T00:11:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 -- 172.21.15.153:0/3174441741 shutdown_connections 2023-08-17T00:11:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/3174441741 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd40a8970 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 -- 172.21.15.153:0/3174441741 >> 172.21.15.153:0/3174441741 conn(0x7fccd40c6620 msgr2=0x7fccd40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:50.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 -- 172.21.15.153:0/3174441741 shutdown_connections 2023-08-17T00:11:50.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.414+0000 7fccd8bf9700 1 -- 172.21.15.153:0/3174441741 wait complete. 2023-08-17T00:11:50.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 Processor -- start 2023-08-17T00:11:50.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 -- start start 2023-08-17T00:11:50.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccd4068f30 0x7fccd40bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd40a8e60 0x7fccd414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40bd390 con 0x7fccd4150880 2023-08-17T00:11:50.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40be6b0 con 0x7fccd4068f30 2023-08-17T00:11:50.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd8bf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd414f220 con 0x7fccd40a8e60 2023-08-17T00:11:50.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd414ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49084/0 (socket says 172.21.15.153:49084) 2023-08-17T00:11:50.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 -- 172.21.15.153:0/2643232951 learned_addr learned my addr 172.21.15.153:0/2643232951 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:50.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd37fe700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccd4068f30 0x7fccd40bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fcccaffd700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd40a8e60 0x7fccd414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 -- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd40a8e60 msgr2=0x7fccd414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd40a8e60 0x7fccd414e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 -- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccd4068f30 msgr2=0x7fccd40bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccd4068f30 0x7fccd40bcea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.418+0000 7fccd3fff700 1 -- 172.21.15.153:0/2643232951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc4009ae0 con 0x7fccd4150880 2023-08-17T00:11:50.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fccd3fff700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd414ec80 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7fcccc00c440 tx=0x7fcccc007d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0123f0 con 0x7fccd4150880 2023-08-17T00:11:50.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcccc012550 con 0x7fccd4150880 2023-08-17T00:11:50.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd40bdd80 con 0x7fccd4150880 2023-08-17T00:11:50.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0128d0 con 0x7fccd4150880 2023-08-17T00:11:50.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd40be340 con 0x7fccd4150880 2023-08-17T00:11:50.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd406b4c0 con 0x7fccd4150880 2023-08-17T00:11:50.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.422+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcccc010070 con 0x7fccd4150880 2023-08-17T00:11:50.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.426+0000 7fcccbfff700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fccb405a150 0x7fccb405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.426+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7fcccc073410 con 0x7fccd4150880 2023-08-17T00:11:50.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.426+0000 7fccd37fe700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fccb405a150 0x7fccb405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.426+0000 7fccd37fe700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fccb405a150 0x7fccb405c610 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fccc400baa0 tx=0x7fccc4009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.430+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcccc046e50 con 0x7fccd4150880 2023-08-17T00:11:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.622+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccd40be7f0 con 0x7fccd4150880 2023-08-17T00:11:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.622+0000 7fcccbfff700 1 -- 172.21.15.153:0/2643232951 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7fcccc04a470 con 0x7fccd4150880 2023-08-17T00:11:50.627 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:50.628 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:50.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fccb405a150 msgr2=0x7fccb405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fccb405a150 0x7fccb405c610 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fccc400baa0 tx=0x7fccc4009840).stop 2023-08-17T00:11:50.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 msgr2=0x7fccd414ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd414ec80 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7fcccc00c440 tx=0x7fcccc007d40).stop 2023-08-17T00:11:50.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 shutdown_connections 2023-08-17T00:11:50.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fccb405a150 0x7fccb405c610 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fccd4150880 0x7fccd414ec80 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd40a8e60 0x7fccd414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 --2- 172.21.15.153:0/2643232951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccd4068f30 0x7fccd40bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 >> 172.21.15.153:0/2643232951 conn(0x7fccd40c6620 msgr2=0x7fccd414fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 shutdown_connections 2023-08-17T00:11:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.626+0000 7fccd8bf9700 1 -- 172.21.15.153:0/2643232951 wait complete. 2023-08-17T00:11:50.633 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:50.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:11:50.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.806+0000 7f0d2c169700 1 Processor -- start 2023-08-17T00:11:50.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.806+0000 7f0d2c169700 1 -- start start 2023-08-17T00:11:50.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d2c169700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d24151f70 0x7f0d24065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d2c169700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24065b50 0x7f0d24064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d2c169700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d24061fa0 con 0x7f0d24151b90 2023-08-17T00:11:50.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d2c169700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d240c3fb0 con 0x7f0d24151f70 2023-08-17T00:11:50.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d2c169700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d241523d0 con 0x7f0d24065b50 2023-08-17T00:11:50.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d24151f70 0x7f0d24065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d24151f70 0x7f0d24065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:58182/0 (socket says 172.21.15.153:58182) 2023-08-17T00:11:50.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 -- 172.21.15.153:0/2235287784 learned_addr learned my addr 172.21.15.153:0/2235287784 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:50.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d2a706700 1 --2- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24065b50 0x7f0d24064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 -- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24065b50 msgr2=0x7f0d24064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:50.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 --2- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24065b50 0x7f0d24064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 -- 172.21.15.153:0/2235287784 >> v1:172.21.15.178:6789/0 conn(0x7f0d24151b90 legacy=0x7f0d24063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 -- 172.21.15.153:0/2235287784 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d240621f0 con 0x7f0d24151f70 2023-08-17T00:11:50.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d29704700 1 --2- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24151f70 0x7f0d24065660 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f0d14006fd0 tx=0x7f0d140090f0).ready entity=mon.1 client_cookie=f31222338ac208da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.810+0000 7f0d28f03700 1 -- 172.21.15.153:0/2235287784 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400b580 con 0x7f0d24151f70 2023-08-17T00:11:50.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d28f03700 1 -- 172.21.15.153:0/2235287784 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400b6e0 con 0x7f0d24151f70 2023-08-17T00:11:50.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d28f03700 1 -- 172.21.15.153:0/2235287784 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400ba80 con 0x7f0d24151f70 2023-08-17T00:11:50.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 -- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24151f70 msgr2=0x7f0d24065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 --2- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24151f70 0x7f0d24065660 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f0d14006fd0 tx=0x7f0d140090f0).stop 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 -- 172.21.15.153:0/2235287784 shutdown_connections 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 --2- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24065b50 0x7f0d24064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 --2- 172.21.15.153:0/2235287784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24151f70 0x7f0d24065660 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 -- 172.21.15.153:0/2235287784 >> 172.21.15.153:0/2235287784 conn(0x7f0d240c7150 msgr2=0x7f0d240c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 -- 172.21.15.153:0/2235287784 shutdown_connections 2023-08-17T00:11:50.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.814+0000 7f0d2c169700 1 -- 172.21.15.153:0/2235287784 wait complete. 2023-08-17T00:11:50.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 Processor -- start 2023-08-17T00:11:50.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 -- start start 2023-08-17T00:11:50.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24065b50 0x7f0d240be260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 0x7f0d24145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24151f70 0x7f0d240bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240bf470 con 0x7f0d24151b90 2023-08-17T00:11:50.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d24145c10 con 0x7f0d24065b50 2023-08-17T00:11:50.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d2c169700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d240be860 con 0x7f0d24151f70 2023-08-17T00:11:50.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d29704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 0x7f0d24145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d29704700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 0x7f0d24145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49088/0 (socket says 172.21.15.153:49088) 2023-08-17T00:11:50.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.818+0000 7f0d29704700 1 -- 172.21.15.153:0/4163336404 learned_addr learned my addr 172.21.15.153:0/4163336404 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:50.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d2a706700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24151f70 0x7f0d240bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29f05700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24065b50 0x7f0d240be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29704700 1 -- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24151f70 msgr2=0x7f0d240bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29704700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24151f70 0x7f0d240bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29704700 1 -- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24065b50 msgr2=0x7f0d240be260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29704700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24065b50 0x7f0d240be260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:50.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29704700 1 -- 172.21.15.153:0/4163336404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14009370 con 0x7f0d24151b90 2023-08-17T00:11:50.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d29704700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 0x7f0d24145720 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f0d2405e420 tx=0x7f0d14017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d14006d90 con 0x7f0d24151b90 2023-08-17T00:11:50.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d1400be40 con 0x7f0d24151b90 2023-08-17T00:11:50.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d240beb40 con 0x7f0d24151b90 2023-08-17T00:11:50.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d1400ba80 con 0x7f0d24151b90 2023-08-17T00:11:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.822+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d240bf100 con 0x7f0d24151b90 2023-08-17T00:11:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.826+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2406b530 con 0x7f0d24151b90 2023-08-17T00:11:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.826+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0d1402d070 con 0x7f0d24151b90 2023-08-17T00:11:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.826+0000 7f0d19ffb700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d0805a150 0x7f0d0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.826+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f0d14076140 con 0x7f0d24151b90 2023-08-17T00:11:50.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.830+0000 7f0d29f05700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d0805a150 0x7f0d0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:50.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.830+0000 7f0d29f05700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d0805a150 0x7f0d0805c610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f0d20004290 tx=0x7f0d20001560).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:50.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.834+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0d14049a70 con 0x7f0d24151b90 2023-08-17T00:11:50.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.990+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0d240624d0 con 0x7f0d24151b90 2023-08-17T00:11:50.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.990+0000 7f0d19ffb700 1 -- 172.21.15.153:0/4163336404 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17182 (secure 0 0 0) 0x7f0d14021020 con 0x7f0d24151b90 2023-08-17T00:11:50.997 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:50.997 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":114,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:11:40.478543+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:10:55.905753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T00:10:56.871921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.7","mappings":[{"from":4,"to":3}]},{"pgid":"16.8","mappings":[{"from":4,"to":3}]},{"pgid":"16.2d","mappings":[{"from":2,"to":3}]},{"pgid":"16.37","mappings":[{"from":4,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:11:50.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d0805a150 msgr2=0x7f0d0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:50.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d0805a150 0x7f0d0805c610 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f0d20004290 tx=0x7f0d20001560).stop 2023-08-17T00:11:50.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 msgr2=0x7f0d24145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 0x7f0d24145720 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 rx=0x7f0d2405e420 tx=0x7f0d14017000).stop 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 shutdown_connections 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0d0805a150 0x7f0d0805c610 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d24151f70 0x7f0d240bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0d24151b90 0x7f0d24145720 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 --2- 172.21.15.153:0/4163336404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d24065b50 0x7f0d240be260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 >> 172.21.15.153:0/4163336404 conn(0x7f0d240c7150 msgr2=0x7f0d2414f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:51.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 shutdown_connections 2023-08-17T00:11:51.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:50.994+0000 7f0d2c169700 1 -- 172.21.15.153:0/4163336404 wait complete. 2023-08-17T00:11:51.020 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:11:51.020 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:51.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.174+0000 7f6133307700 1 Processor -- start 2023-08-17T00:11:51.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.174+0000 7f6133307700 1 -- start start 2023-08-17T00:11:51.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6133307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0abf10 0x7f612c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6133307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f612c0ac2f0 0x7f612c068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6133307700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f612c0c0a80 0x7f612c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6133307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c069200 con 0x7f612c0ac2f0 2023-08-17T00:11:51.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6133307700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c1545e0 con 0x7f612c0c0a80 2023-08-17T00:11:51.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6133307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0a96d0 con 0x7f612c0abf10 2023-08-17T00:11:51.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f612c0ac2f0 0x7f612c068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f612c0ac2f0 0x7f612c068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49094/0 (socket says 172.21.15.153:49094) 2023-08-17T00:11:51.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 -- 172.21.15.153:0/1189201794 learned_addr learned my addr 172.21.15.153:0/1189201794 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:51.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6132b06700 1 --2- 172.21.15.153:0/1189201794 >> v2:172.21.15.178:3300/0 conn(0x7f612c0c0a80 0x7f612c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6132305700 1 --2- 172.21.15.153:0/1189201794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0abf10 0x7f612c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 -- 172.21.15.153:0/1189201794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0abf10 msgr2=0x7f612c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:51.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 --2- 172.21.15.153:0/1189201794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0abf10 0x7f612c068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 -- 172.21.15.153:0/1189201794 >> v2:172.21.15.178:3300/0 conn(0x7f612c0c0a80 msgr2=0x7f612c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:51.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 --2- 172.21.15.153:0/1189201794 >> v2:172.21.15.178:3300/0 conn(0x7f612c0c0a80 0x7f612c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 -- 172.21.15.153:0/1189201794 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c0c1c50 con 0x7f612c0ac2f0 2023-08-17T00:11:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131b04700 1 --2- 172.21.15.153:0/1189201794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0ac2f0 0x7f612c068d10 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f612c0bd530 tx=0x7f611c0090f0).ready entity=mon.0 client_cookie=7e3bfd2a2fe5b784 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131303700 1 -- 172.21.15.153:0/1189201794 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00f510 con 0x7f612c0ac2f0 2023-08-17T00:11:51.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131303700 1 -- 172.21.15.153:0/1189201794 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00f670 con 0x7f612c0ac2f0 2023-08-17T00:11:51.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.178+0000 7f6131303700 1 -- 172.21.15.153:0/1189201794 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00fa10 con 0x7f612c0ac2f0 2023-08-17T00:11:51.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 -- 172.21.15.153:0/1189201794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0ac2f0 msgr2=0x7f612c068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 --2- 172.21.15.153:0/1189201794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0ac2f0 0x7f612c068d10 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f612c0bd530 tx=0x7f611c0090f0).stop 2023-08-17T00:11:51.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 -- 172.21.15.153:0/1189201794 shutdown_connections 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 --2- 172.21.15.153:0/1189201794 >> v2:172.21.15.178:3300/0 conn(0x7f612c0c0a80 0x7f612c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 --2- 172.21.15.153:0/1189201794 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0ac2f0 0x7f612c068d10 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 --2- 172.21.15.153:0/1189201794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0abf10 0x7f612c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 -- 172.21.15.153:0/1189201794 >> 172.21.15.153:0/1189201794 conn(0x7f612c0c6620 msgr2=0x7f612c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 -- 172.21.15.153:0/1189201794 shutdown_connections 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 -- 172.21.15.153:0/1189201794 wait complete. 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 Processor -- start 2023-08-17T00:11:51.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.182+0000 7f6133307700 1 -- start start 2023-08-17T00:11:51.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c0abf10 0x7f612c0bebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0ac2f0 0x7f612c14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 0x7f612c0aae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c14fac0 con 0x7f612c0c0a80 2023-08-17T00:11:51.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c14fda0 con 0x7f612c0abf10 2023-08-17T00:11:51.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c150080 con 0x7f612c0ac2f0 2023-08-17T00:11:51.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6132b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 0x7f612c0aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0ac2f0 0x7f612c14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6132b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 0x7f612c0aae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49104/0 (socket says 172.21.15.153:49104) 2023-08-17T00:11:51.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6132305700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c0abf10 0x7f612c0bebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6132b06700 1 -- 172.21.15.153:0/379352138 learned_addr learned my addr 172.21.15.153:0/379352138 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 -- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c0abf10 msgr2=0x7f612c0bebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c0abf10 0x7f612c0bebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 -- 172.21.15.153:0/379352138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 msgr2=0x7f612c0aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 0x7f612c0aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 -- 172.21.15.153:0/379352138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c009370 con 0x7f612c0ac2f0 2023-08-17T00:11:51.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6132b06700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 0x7f612c0aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6131b04700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0ac2f0 0x7f612c14f0e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f611c013000 tx=0x7f611c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c006d90 con 0x7f612c0ac2f0 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c000bc0 con 0x7f612c0ac2f0 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c14ad70 con 0x7f612c0ac2f0 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c01b430 con 0x7f612c0ac2f0 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.186+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c147380 con 0x7f612c0ac2f0 2023-08-17T00:11:51.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.190+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c06b4c0 con 0x7f612c0ac2f0 2023-08-17T00:11:51.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.190+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f611c017040 con 0x7f612c0ac2f0 2023-08-17T00:11:51.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.190+0000 7f61227fc700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f611005a150 0x7f611005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.190+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f611c0755e0 con 0x7f612c0ac2f0 2023-08-17T00:11:51.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.190+0000 7f6132305700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f611005a150 0x7f611005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.194+0000 7f6132305700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f611005a150 0x7f611005c610 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f6128006fd0 tx=0x7f6128006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.202+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f611c048f10 con 0x7f612c0ac2f0 2023-08-17T00:11:51.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.398+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f612c0a8a70 con 0x7f612c0ac2f0 2023-08-17T00:11:51.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.398+0000 7f61227fc700 1 -- 172.21.15.153:0/379352138 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f611c015090 con 0x7f612c0ac2f0 2023-08-17T00:11:51.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:51.403 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:51.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f611005a150 msgr2=0x7f611005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f611005a150 0x7f611005c610 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f6128006fd0 tx=0x7f6128006f40).stop 2023-08-17T00:11:51.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0ac2f0 msgr2=0x7f612c14f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0ac2f0 0x7f612c14f0e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f611c013000 tx=0x7f611c016000).stop 2023-08-17T00:11:51.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 shutdown_connections 2023-08-17T00:11:51.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f611005a150 0x7f611005c610 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f612c0c0a80 0x7f612c0aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f612c0ac2f0 0x7f612c14f0e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 --2- 172.21.15.153:0/379352138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f612c0abf10 0x7f612c0bebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 >> 172.21.15.153:0/379352138 conn(0x7f612c0c6620 msgr2=0x7f612c0c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:51.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 shutdown_connections 2023-08-17T00:11:51.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.402+0000 7f6133307700 1 -- 172.21.15.153:0/379352138 wait complete. 2023-08-17T00:11:51.408 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:51.425 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:51.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 Processor -- start 2023-08-17T00:11:51.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 -- start start 2023-08-17T00:11:51.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b90151530 0x7f4b901519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b90065da0 con 0x7f4b901560f0 2023-08-17T00:11:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b90155c60 con 0x7f4b90151530 2023-08-17T00:11:51.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b95439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90156550 con 0x7f4b900689c0 2023-08-17T00:11:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b90151530 0x7f4b901519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b90151530 0x7f4b901519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49114/0 (socket says 172.21.15.153:49114) 2023-08-17T00:11:51.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 -- 172.21.15.153:0/4259629079 learned_addr learned my addr 172.21.15.153:0/4259629079 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b8ffff700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 -- 172.21.15.153:0/4259629079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 msgr2=0x7f4b90068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:51.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 -- 172.21.15.153:0/4259629079 >> v1:172.21.15.153:6789/0 conn(0x7f4b901560f0 legacy=0x7f4b900c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b94c38700 1 -- 172.21.15.153:0/4259629079 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b90065ff0 con 0x7f4b90151530 2023-08-17T00:11:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.578+0000 7f4b8ffff700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:51.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b94c38700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b90151530 0x7f4b901519e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f4b88009f50 tx=0x7f4b88009840).ready entity=mon.0 client_cookie=45dff1c4cb74be92 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b8effd700 1 -- 172.21.15.153:0/4259629079 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800e070 con 0x7f4b90151530 2023-08-17T00:11:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b8effd700 1 -- 172.21.15.153:0/4259629079 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8800ba70 con 0x7f4b90151530 2023-08-17T00:11:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b8effd700 1 -- 172.21.15.153:0/4259629079 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800bdf0 con 0x7f4b90151530 2023-08-17T00:11:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 -- 172.21.15.153:0/4259629079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b90151530 msgr2=0x7f4b901519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b90151530 0x7f4b901519e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f4b88009f50 tx=0x7f4b88009840).stop 2023-08-17T00:11:51.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 -- 172.21.15.153:0/4259629079 shutdown_connections 2023-08-17T00:11:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b90151530 0x7f4b901519e0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 --2- 172.21.15.153:0/4259629079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 -- 172.21.15.153:0/4259629079 >> 172.21.15.153:0/4259629079 conn(0x7f4b900c6620 msgr2=0x7f4b900c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 -- 172.21.15.153:0/4259629079 shutdown_connections 2023-08-17T00:11:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 -- 172.21.15.153:0/4259629079 wait complete. 2023-08-17T00:11:51.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.582+0000 7f4b95439700 1 Processor -- start 2023-08-17T00:11:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 -- start start 2023-08-17T00:11:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b90151530 0x7f4b900bc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 0x7f4b900a8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90161e60 con 0x7f4b901560f0 2023-08-17T00:11:51.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90162c80 con 0x7f4b90151530 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b90150730 con 0x7f4b900689c0 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 0x7f4b900a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 0x7f4b900a8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49124/0 (socket says 172.21.15.153:49124) 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 -- 172.21.15.153:0/3062667903 learned_addr learned my addr 172.21.15.153:0/3062667903 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b8ffff700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b8f7fe700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b90151530 0x7f4b900bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 -- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 msgr2=0x7f4b90150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 -- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b90151530 msgr2=0x7f4b900bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b90151530 0x7f4b900bc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 -- 172.21.15.153:0/3062667903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009ae0 con 0x7f4b901560f0 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b8f7fe700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b90151530 0x7f4b900bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b94c38700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 0x7f4b900a8590 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f4b8800b770 tx=0x7f4b88009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880092e0 con 0x7f4b901560f0 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8801e470 con 0x7f4b901560f0 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8801e830 con 0x7f4b901560f0 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b90162fb0 con 0x7f4b901560f0 2023-08-17T00:11:51.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.586+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b90162350 con 0x7f4b901560f0 2023-08-17T00:11:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.590+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9006b4c0 con 0x7f4b901560f0 2023-08-17T00:11:51.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.590+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4b88025030 con 0x7f4b901560f0 2023-08-17T00:11:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.590+0000 7f4b77fff700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b7c05a150 0x7f4b7c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.594+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f4b88075ae0 con 0x7f4b901560f0 2023-08-17T00:11:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.594+0000 7f4b8ffff700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b7c05a150 0x7f4b7c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.594+0000 7f4b8ffff700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b7c05a150 0x7f4b7c05c610 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4b8000a9c0 tx=0x7f4b80008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.598+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b88049410 con 0x7f4b901560f0 2023-08-17T00:11:51.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.794+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b90063750 con 0x7f4b901560f0 2023-08-17T00:11:51.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.794+0000 7f4b77fff700 1 -- 172.21.15.153:0/3062667903 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4494 (secure 0 0 0) 0x7f4b88023030 con 0x7f4b901560f0 2023-08-17T00:11:51.798 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:51.798 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:10:57.877069+0000","modified":"2023-08-17T00:11:00.907373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7470":{"gid":7470,"name":"b","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/23042802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":23042802},{"type":"v1","addr":"172.21.15.178:6836","nonce":23042802}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-08-17T00:11:51.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.794+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b7c05a150 msgr2=0x7f4b7c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.794+0000 7f4b95439700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b7c05a150 0x7f4b7c05c610 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f4b8000a9c0 tx=0x7f4b80008040).stop 2023-08-17T00:11:51.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.794+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 msgr2=0x7f4b900a8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.794+0000 7f4b95439700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 0x7f4b900a8590 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 rx=0x7f4b8800b770 tx=0x7f4b88009840).stop 2023-08-17T00:11:51.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 shutdown_connections 2023-08-17T00:11:51.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b7c05a150 0x7f4b7c05c610 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b901560f0 0x7f4b900a8590 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b90151530 0x7f4b900bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 --2- 172.21.15.153:0/3062667903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900689c0 0x7f4b90150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 >> 172.21.15.153:0/3062667903 conn(0x7f4b900c6620 msgr2=0x7f4b900c4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:51.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 shutdown_connections 2023-08-17T00:11:51.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.798+0000 7f4b95439700 1 -- 172.21.15.153:0/3062667903 wait complete. 2023-08-17T00:11:51.802 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 93 2023-08-17T00:11:51.819 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:11:51.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.974+0000 7f06578f1700 1 Processor -- start 2023-08-17T00:11:51.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f06578f1700 1 -- start start 2023-08-17T00:11:51.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f06578f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f06500a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f06578f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06500629b0 0x7f06500bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f06578f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0650065240 con 0x7f06500a8b70 2023-08-17T00:11:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f06578f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0650062e40 con 0x7f06500629b0 2023-08-17T00:11:51.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f06578f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500638a0 con 0x7f06500632e0 2023-08-17T00:11:51.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f0654e8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f06500a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f0654e8c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f06500a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:56064/0 (socket says 172.21.15.153:56064) 2023-08-17T00:11:51.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f0654e8c700 1 -- 172.21.15.153:0/3390756811 learned_addr learned my addr 172.21.15.153:0/3390756811 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:51.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.978+0000 7f0655e8e700 1 --2- 172.21.15.153:0/3390756811 >> v2:172.21.15.178:3300/0 conn(0x7f06500629b0 0x7f06500bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0654e8c700 1 -- 172.21.15.153:0/3390756811 >> v2:172.21.15.178:3300/0 conn(0x7f06500629b0 msgr2=0x7f06500bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:51.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0654e8c700 1 --2- 172.21.15.153:0/3390756811 >> v2:172.21.15.178:3300/0 conn(0x7f06500629b0 0x7f06500bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0654e8c700 1 -- 172.21.15.153:0/3390756811 >> v1:172.21.15.178:6789/0 conn(0x7f06500a8b70 legacy=0x7f06500656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0654e8c700 1 -- 172.21.15.153:0/3390756811 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0650065de0 con 0x7f06500632e0 2023-08-17T00:11:51.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0654e8c700 1 --2- 172.21.15.153:0/3390756811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f06500a8f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f0640006fd0 tx=0x7f06400090f0).ready entity=mon.2 client_cookie=8f45ece1326ffa8b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0647fff700 1 -- 172.21.15.153:0/3390756811 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000b580 con 0x7f06500632e0 2023-08-17T00:11:51.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0647fff700 1 -- 172.21.15.153:0/3390756811 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000b6e0 con 0x7f06500632e0 2023-08-17T00:11:51.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f0647fff700 1 -- 172.21.15.153:0/3390756811 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000ba60 con 0x7f06500632e0 2023-08-17T00:11:51.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 -- 172.21.15.153:0/3390756811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 msgr2=0x7f06500a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 --2- 172.21.15.153:0/3390756811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f06500a8f50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f0640006fd0 tx=0x7f06400090f0).stop 2023-08-17T00:11:51.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 -- 172.21.15.153:0/3390756811 shutdown_connections 2023-08-17T00:11:51.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 --2- 172.21.15.153:0/3390756811 >> v2:172.21.15.178:3300/0 conn(0x7f06500629b0 0x7f06500bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 --2- 172.21.15.153:0/3390756811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f06500a8f50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 -- 172.21.15.153:0/3390756811 >> 172.21.15.153:0/3390756811 conn(0x7f06500c7150 msgr2=0x7f06500c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:51.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 -- 172.21.15.153:0/3390756811 shutdown_connections 2023-08-17T00:11:51.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.982+0000 7f06578f1700 1 -- 172.21.15.153:0/3390756811 wait complete. 2023-08-17T00:11:51.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 Processor -- start 2023-08-17T00:11:51.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 -- start start 2023-08-17T00:11:51.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06500629b0 0x7f06500bf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f065014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 0x7f06501564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501698d0 con 0x7f06500a8b70 2023-08-17T00:11:51.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501695f0 con 0x7f06500629b0 2023-08-17T00:11:51.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f06578f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06500be820 con 0x7f06500632e0 2023-08-17T00:11:51.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 0x7f06501564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 0x7f06501564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49138/0 (socket says 172.21.15.153:49138) 2023-08-17T00:11:51.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 -- 172.21.15.153:0/2848805758 learned_addr learned my addr 172.21.15.153:0/2848805758 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:51.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f065568d700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06500629b0 0x7f06500bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0654e8c700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f065014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 -- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 msgr2=0x7f065014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f065014f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 -- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06500629b0 msgr2=0x7f06500bf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:51.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06500629b0 0x7f06500bf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:51.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 -- 172.21.15.153:0/2848805758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0640009370 con 0x7f06500a8b70 2023-08-17T00:11:51.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f065568d700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06500629b0 0x7f06500bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:51.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0654e8c700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f065014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:51.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.986+0000 7f0655e8e700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 0x7f06501564a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f0648009e90 tx=0x7f064800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:51.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800cc20 con 0x7f06500a8b70 2023-08-17T00:11:51.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800f040 con 0x7f06500a8b70 2023-08-17T00:11:51.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06500beb00 con 0x7f06500a8b70 2023-08-17T00:11:51.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648013400 con 0x7f06500a8b70 2023-08-17T00:11:51.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065014f7e0 con 0x7f06500a8b70 2023-08-17T00:11:51.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065014fa00 con 0x7f06500a8b70 2023-08-17T00:11:51.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.990+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f06480137b0 con 0x7f06500a8b70 2023-08-17T00:11:51.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.994+0000 7f06457fa700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f063405a150 0x7f063405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:51.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.994+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f0648074ba0 con 0x7f06500a8b70 2023-08-17T00:11:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.994+0000 7f065568d700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f063405a150 0x7f063405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:51.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.994+0000 7f065568d700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f063405a150 0x7f063405c610 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f0650062980 tx=0x7f064c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:52.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:51.998+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f064804c010 con 0x7f06500a8b70 2023-08-17T00:11:52.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.154+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0650064910 con 0x7f06500a8b70 2023-08-17T00:11:52.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06457fa700 1 -- 172.21.15.153:0/2848805758 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) v1 ==== 74+0+17182 (secure 0 0 0) 0x7f064804bc00 con 0x7f06500a8b70 2023-08-17T00:11:52.161 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:52.161 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":114,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:11:40.478543+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:10:55.905753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-08-17T00:10:56.871921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.7","mappings":[{"from":4,"to":3}]},{"pgid":"16.8","mappings":[{"from":4,"to":3}]},{"pgid":"16.2d","mappings":[{"from":2,"to":3}]},{"pgid":"16.37","mappings":[{"from":4,"to":6}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:11:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f063405a150 msgr2=0x7f063405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f063405a150 0x7f063405c610 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f0650062980 tx=0x7f064c009040).stop 2023-08-17T00:11:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 msgr2=0x7f06501564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:52.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 0x7f06501564a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f0648009e90 tx=0x7f064800b040).stop 2023-08-17T00:11:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 shutdown_connections 2023-08-17T00:11:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f063405a150 0x7f063405c610 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06500a8b70 0x7f06501564a0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06500632e0 0x7f065014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 --2- 172.21.15.153:0/2848805758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06500629b0 0x7f06500bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 >> 172.21.15.153:0/2848805758 conn(0x7f06500c7150 msgr2=0x7f065015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 shutdown_connections 2023-08-17T00:11:52.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.158+0000 7f06578f1700 1 -- 172.21.15.153:0/2848805758 wait complete. 2023-08-17T00:11:52.187 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:11:52.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.342+0000 7f2ef9c79700 1 Processor -- start 2023-08-17T00:11:52.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.342+0000 7f2ef9c79700 1 -- start start 2023-08-17T00:11:52.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4069250 0x7f2ef4069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:52.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 0x7f2ef40c1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef4154ae0 con 0x7f2ef4065d90 2023-08-17T00:11:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef4064fd0 con 0x7f2ef40661f0 2023-08-17T00:11:52.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40652b0 con 0x7f2ef4069250 2023-08-17T00:11:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9478700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 0x7f2ef40c1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef8c77700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4069250 0x7f2ef4069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9478700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 0x7f2ef40c1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49154/0 (socket says 172.21.15.153:49154) 2023-08-17T00:11:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9478700 1 -- 172.21.15.153:0/3183251737 learned_addr learned my addr 172.21.15.153:0/3183251737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:52.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef8c77700 1 -- 172.21.15.153:0/3183251737 >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 msgr2=0x7f2ef40c1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:52.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef8c77700 1 --2- 172.21.15.153:0/3183251737 >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 0x7f2ef40c1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef8c77700 1 -- 172.21.15.153:0/3183251737 >> v1:172.21.15.178:6789/0 conn(0x7f2ef4065d90 legacy=0x7f2ef40c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:52.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef8c77700 1 -- 172.21.15.153:0/3183251737 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4065590 con 0x7f2ef4069250 2023-08-17T00:11:52.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9478700 1 --2- 172.21.15.153:0/3183251737 >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 0x7f2ef40c1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:52.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef8c77700 1 --2- 172.21.15.153:0/3183251737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4069250 0x7f2ef4069630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f2ef0006fd0 tx=0x7f2ef0006f40).ready entity=mon.2 client_cookie=376ca1681bff9c36 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:52.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2eeb7fe700 1 -- 172.21.15.153:0/3183251737 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0005880 con 0x7f2ef4069250 2023-08-17T00:11:52.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2eeb7fe700 1 -- 172.21.15.153:0/3183251737 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef00059e0 con 0x7f2ef4069250 2023-08-17T00:11:52.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2eeb7fe700 1 -- 172.21.15.153:0/3183251737 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0005d60 con 0x7f2ef4069250 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- 172.21.15.153:0/3183251737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4069250 msgr2=0x7f2ef4069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/3183251737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4069250 0x7f2ef4069630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f2ef0006fd0 tx=0x7f2ef0006f40).stop 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- 172.21.15.153:0/3183251737 shutdown_connections 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/3183251737 >> v2:172.21.15.153:3300/0 conn(0x7f2ef40661f0 0x7f2ef40c1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/3183251737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4069250 0x7f2ef4069630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- 172.21.15.153:0/3183251737 >> 172.21.15.153:0/3183251737 conn(0x7f2ef40c6620 msgr2=0x7f2ef40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:52.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- 172.21.15.153:0/3183251737 shutdown_connections 2023-08-17T00:11:52.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.346+0000 7f2ef9c79700 1 -- 172.21.15.153:0/3183251737 wait complete. 2023-08-17T00:11:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 Processor -- start 2023-08-17T00:11:52.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 -- start start 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4065d90 0x7f2ef40a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 0x7f2ef40ba850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef40be070 0x7f2ef40bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40bf160 con 0x7f2ef4069250 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40a74f0 con 0x7f2ef40be070 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9c79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef40be550 con 0x7f2ef4065d90 2023-08-17T00:11:52.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2eebfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 0x7f2ef40ba850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2eebfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 0x7f2ef40ba850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49166/0 (socket says 172.21.15.153:49166) 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2eebfff700 1 -- 172.21.15.153:0/2784256172 learned_addr learned my addr 172.21.15.153:0/2784256172 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef9478700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef40be070 0x7f2ef40bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.350+0000 7f2ef8c77700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4065d90 0x7f2ef40a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2eebfff700 1 -- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4065d90 msgr2=0x7f2ef40a7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2eebfff700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4065d90 0x7f2ef40a7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2eebfff700 1 -- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef40be070 msgr2=0x7f2ef40bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2eebfff700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef40be070 0x7f2ef40bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2eebfff700 1 -- 172.21.15.153:0/2784256172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eec00bcf0 con 0x7f2ef4069250 2023-08-17T00:11:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ef9478700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef40be070 0x7f2ef40bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:52.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2eebfff700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 0x7f2ef40ba850 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f2ee400c410 tx=0x7f2ee4007d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400f470 con 0x7f2ef4069250 2023-08-17T00:11:52.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee400f5d0 con 0x7f2ef4069250 2023-08-17T00:11:52.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee400f970 con 0x7f2ef4069250 2023-08-17T00:11:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef0009250 con 0x7f2ef4069250 2023-08-17T00:11:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef40beb10 con 0x7f2ef4069250 2023-08-17T00:11:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef40bf2d0 con 0x7f2ef4069250 2023-08-17T00:11:52.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.354+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2ee4019030 con 0x7f2ef4069250 2023-08-17T00:11:52.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.358+0000 7f2ee8ff9700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ee005a120 0x7f2ee005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.358+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6237+0+0 (secure 0 0 0) 0x7f2ee4073690 con 0x7f2ef4069250 2023-08-17T00:11:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.358+0000 7f2ef8c77700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ee005a120 0x7f2ee005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.358+0000 7f2ef8c77700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ee005a120 0x7f2ee005c5e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f2ef0006fa0 tx=0x7f2ef0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:52.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.362+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ee4046fc0 con 0x7f2ef4069250 2023-08-17T00:11:52.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:52.570+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2ef4065870 con 0x7f2ef4069250 2023-08-17T00:11:53.311 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:11:53.306+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:11:53.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.318+0000 7f2ee8ff9700 1 -- 172.21.15.153:0/2784256172 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2ee404a5e0 con 0x7f2ef4069250 2023-08-17T00:11:53.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ee005a120 msgr2=0x7f2ee005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:53.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ee005a120 0x7f2ee005c5e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f2ef0006fa0 tx=0x7f2ef0016000).stop 2023-08-17T00:11:53.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 msgr2=0x7f2ef40ba850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:53.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 0x7f2ef40ba850 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f2ee400c410 tx=0x7f2ee4007d60).stop 2023-08-17T00:11:53.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 shutdown_connections 2023-08-17T00:11:53.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ee005a120 0x7f2ee005c5e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ef40be070 0x7f2ef40bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2ef4069250 0x7f2ef40ba850 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 --2- 172.21.15.153:0/2784256172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ef4065d90 0x7f2ef40a7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 >> 172.21.15.153:0/2784256172 conn(0x7f2ef40c6620 msgr2=0x7f2ef40c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:53.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 shutdown_connections 2023-08-17T00:11:53.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.326+0000 7f2ef9c79700 1 -- 172.21.15.153:0/2784256172 wait complete. 2023-08-17T00:11:53.333 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:11:53.350 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:11:53.395 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:11:53.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 Processor -- start 2023-08-17T00:11:53.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 -- start start 2023-08-17T00:11:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d68153ad0 0x7f4d681577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d68153eb0 0x7f4d68062d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680bc920 con 0x7f4d680bdcd0 2023-08-17T00:11:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d681586b0 con 0x7f4d68153ad0 2023-08-17T00:11:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6f479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681580f0 con 0x7f4d68153eb0 2023-08-17T00:11:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6e477700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d68153ad0 0x7f4d681577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.518+0000 7f4d6e477700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d68153ad0 0x7f4d681577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49176/0 (socket says 172.21.15.153:49176) 2023-08-17T00:11:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6e477700 1 -- 172.21.15.153:0/1570180436 learned_addr learned my addr 172.21.15.153:0/1570180436 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:53.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6dc76700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d68153eb0 0x7f4d68062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:53.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6e477700 1 -- 172.21.15.153:0/1570180436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d68153eb0 msgr2=0x7f4d68062d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:53.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6e477700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d68153eb0 0x7f4d68062d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6e477700 1 -- 172.21.15.153:0/1570180436 >> v1:172.21.15.178:6789/0 conn(0x7f4d680bdcd0 legacy=0x7f4d68066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6e477700 1 -- 172.21.15.153:0/1570180436 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d681583d0 con 0x7f4d68153ad0 2023-08-17T00:11:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6dc76700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d68153eb0 0x7f4d68062d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:53.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6e477700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d681577a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f4d64006fd0 tx=0x7f4d640090f0).ready entity=mon.0 client_cookie=a99d2aaf7448e067 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:53.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6d475700 1 -- 172.21.15.153:0/1570180436 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400b600 con 0x7f4d68153ad0 2023-08-17T00:11:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6d475700 1 -- 172.21.15.153:0/1570180436 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6400b760 con 0x7f4d68153ad0 2023-08-17T00:11:53.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6d475700 1 -- 172.21.15.153:0/1570180436 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400bb00 con 0x7f4d68153ad0 2023-08-17T00:11:53.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 -- 172.21.15.153:0/1570180436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 msgr2=0x7f4d681577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d681577a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 rx=0x7f4d64006fd0 tx=0x7f4d640090f0).stop 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 -- 172.21.15.153:0/1570180436 shutdown_connections 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d68153eb0 0x7f4d68062d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1570180436 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d681577a0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 -- 172.21.15.153:0/1570180436 >> 172.21.15.153:0/1570180436 conn(0x7f4d68069760 msgr2=0x7f4d68069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 -- 172.21.15.153:0/1570180436 shutdown_connections 2023-08-17T00:11:53.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.522+0000 7f4d6f479700 1 -- 172.21.15.153:0/1570180436 wait complete. 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 Processor -- start 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 -- start start 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680bdcd0 0x7f4d68145250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d680c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680c3350 0x7f4d68066c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68167570 con 0x7f4d68153ad0 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68167850 con 0x7f4d680c3350 2023-08-17T00:11:53.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6f479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68167b30 con 0x7f4d680bdcd0 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6dc76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d680c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6dc76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d680c2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49184/0 (socket says 172.21.15.153:49184) 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6dc76700 1 -- 172.21.15.153:0/1962881490 learned_addr learned my addr 172.21.15.153:0/1962881490 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6e477700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680bdcd0 0x7f4d68145250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.526+0000 7f4d6ec78700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680c3350 0x7f4d68066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6dc76700 1 -- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680bdcd0 msgr2=0x7f4d68145250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:53.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6dc76700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680bdcd0 0x7f4d68145250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6dc76700 1 -- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680c3350 msgr2=0x7f4d68066c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:53.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6dc76700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680c3350 0x7f4d68066c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:53.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6dc76700 1 -- 172.21.15.153:0/1962881490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009370 con 0x7f4d68153ad0 2023-08-17T00:11:53.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6dc76700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d680c2e60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f4d5800c880 tx=0x7f4d58008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:53.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58010580 con 0x7f4d68153ad0 2023-08-17T00:11:53.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d580106e0 con 0x7f4d68153ad0 2023-08-17T00:11:53.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d68167e10 con 0x7f4d68153ad0 2023-08-17T00:11:53.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58010a60 con 0x7f4d68153ad0 2023-08-17T00:11:53.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d68145740 con 0x7f4d68153ad0 2023-08-17T00:11:53.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.530+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d68145960 con 0x7f4d68153ad0 2023-08-17T00:11:53.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.534+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d5801b460 con 0x7f4d68153ad0 2023-08-17T00:11:53.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.534+0000 7f4d5e7fc700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a180 0x7f4d4c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:53.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.534+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f4d58074120 con 0x7f4d68153ad0 2023-08-17T00:11:53.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.534+0000 7f4d6e477700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a180 0x7f4d4c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:53.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.534+0000 7f4d6e477700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a180 0x7f4d4c05c640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f4d6400b3c0 tx=0x7f4d64017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.538+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d58047aa0 con 0x7f4d68153ad0 2023-08-17T00:11:53.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:53.738+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4d6806b4c0 con 0x7f4d68153ad0 2023-08-17T00:11:54.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.334+0000 7f4d5e7fc700 1 -- 172.21.15.153:0/1962881490 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d5804b0c0 con 0x7f4d68153ad0 2023-08-17T00:11:54.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a180 msgr2=0x7f4d4c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a180 0x7f4d4c05c640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f4d6400b3c0 tx=0x7f4d64017000).stop 2023-08-17T00:11:54.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 msgr2=0x7f4d680c2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d680c2e60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f4d5800c880 tx=0x7f4d58008040).stop 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 shutdown_connections 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a180 0x7f4d4c05c640 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680c3350 0x7f4d68066c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d68153ad0 0x7f4d680c2e60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 --2- 172.21.15.153:0/1962881490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680bdcd0 0x7f4d68145250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 >> 172.21.15.153:0/1962881490 conn(0x7f4d68069760 msgr2=0x7f4d680a9ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 shutdown_connections 2023-08-17T00:11:54.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.338+0000 7f4d6f479700 1 -- 172.21.15.153:0/1962881490 wait complete. 2023-08-17T00:11:54.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:11:54.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.530+0000 7f7009907700 1 Processor -- start 2023-08-17T00:11:54.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.530+0000 7f7009907700 1 -- start start 2023-08-17T00:11:54.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7009907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f70041391b0 0x7f70040a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:54.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7009907700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7004065ef0 con 0x7f7004139590 2023-08-17T00:11:54.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7009907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70040652e0 con 0x7f7004064b40 2023-08-17T00:11:54.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7009907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70040a95d0 con 0x7f70041391b0 2023-08-17T00:11:54.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7003fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7004139590 0x7f70040a9a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33436/0 (socket says 172.21.15.153:33436) 2023-08-17T00:11:54.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7003fff700 1 -- 172.21.15.153:0/457187297 learned_addr learned my addr 172.21.15.153:0/457187297 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:54.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7008905700 1 --2- 172.21.15.153:0/457187297 >> v2:172.21.15.153:3300/0 conn(0x7f70041391b0 0x7f70040a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:54.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55498067 0 0) 0x7f7004065ef0 con 0x7f7004139590 2023-08-17T00:11:54.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fec004500 con 0x7f7004139590 2023-08-17T00:11:54.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978531916 0 0) 0x7f70040652e0 con 0x7f7004064b40 2023-08-17T00:11:54.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7004065ef0 con 0x7f7004064b40 2023-08-17T00:11:54.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7008905700 1 -- 172.21.15.153:0/457187297 >> v1:172.21.15.178:6789/0 conn(0x7f7004064b40 legacy=0x7f7004062fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7008905700 1 -- 172.21.15.153:0/457187297 >> v1:172.21.15.153:6789/0 conn(0x7f7004139590 legacy=0x7f70040a9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.534+0000 7f7008905700 1 -- 172.21.15.153:0/457187297 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70040655c0 con 0x7f70041391b0 2023-08-17T00:11:54.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7008905700 1 --2- 172.21.15.153:0/457187297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70041391b0 0x7f70040a90e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f6ff8009760 tx=0x7f6ff8009060).ready entity=mon.0 client_cookie=1c9565463602b8da server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:54.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800d4a0 con 0x7f70041391b0 2023-08-17T00:11:54.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff800d600 con 0x7f70041391b0 2023-08-17T00:11:54.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f70037fe700 1 -- 172.21.15.153:0/457187297 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800d980 con 0x7f70041391b0 2023-08-17T00:11:54.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 -- 172.21.15.153:0/457187297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70041391b0 msgr2=0x7f70040a90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 --2- 172.21.15.153:0/457187297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70041391b0 0x7f70040a90e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f6ff8009760 tx=0x7f6ff8009060).stop 2023-08-17T00:11:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 -- 172.21.15.153:0/457187297 shutdown_connections 2023-08-17T00:11:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 --2- 172.21.15.153:0/457187297 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f70041391b0 0x7f70040a90e0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 -- 172.21.15.153:0/457187297 >> 172.21.15.153:0/457187297 conn(0x7f70040c72e0 msgr2=0x7f70040688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 -- 172.21.15.153:0/457187297 shutdown_connections 2023-08-17T00:11:54.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.538+0000 7f7009907700 1 -- 172.21.15.153:0/457187297 wait complete. 2023-08-17T00:11:54.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 Processor -- start 2023-08-17T00:11:54.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 -- start start 2023-08-17T00:11:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7004064b40 0x7f700414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70041391b0 0x7f7004153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 0x7f7004153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7004153e20 con 0x7f7004139590 2023-08-17T00:11:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7004137580 con 0x7f70041391b0 2023-08-17T00:11:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7004136c50 con 0x7f7004064b40 2023-08-17T00:11:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 0x7f7004153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 0x7f7004153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49198/0 (socket says 172.21.15.153:49198) 2023-08-17T00:11:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 -- 172.21.15.153:0/2212535579 learned_addr learned my addr 172.21.15.153:0/2212535579 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7003fff700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70041391b0 0x7f7004153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7008905700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7004064b40 0x7f700414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 -- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7004064b40 msgr2=0x7f700414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7004064b40 0x7f700414bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 -- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70041391b0 msgr2=0x7f7004153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70041391b0 0x7f7004153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 -- 172.21.15.153:0/2212535579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80092a0 con 0x7f7004139590 2023-08-17T00:11:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7003fff700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70041391b0 0x7f7004153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.542+0000 7f7009106700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 0x7f7004153880 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f6ffc00c810 tx=0x7f6ffc001500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc010510 con 0x7f7004139590 2023-08-17T00:11:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc010670 con 0x7f7004139590 2023-08-17T00:11:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7004136f30 con 0x7f7004139590 2023-08-17T00:11:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0109f0 con 0x7f7004139590 2023-08-17T00:11:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7004150c20 con 0x7f7004139590 2023-08-17T00:11:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7004137710 con 0x7f7004139590 2023-08-17T00:11:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.546+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6ffc010070 con 0x7f7004139590 2023-08-17T00:11:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.550+0000 7f7000ff9700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ff005a150 0x7f6ff005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.550+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f6ffc073f50 con 0x7f7004139590 2023-08-17T00:11:54.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.550+0000 7f7008905700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ff005a150 0x7f6ff005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.550+0000 7f7008905700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ff005a150 0x7f6ff005c610 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6ff8009760 tx=0x7f6ff8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.554+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6ffc047820 con 0x7f7004139590 2023-08-17T00:11:54.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:54.714+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f70040658a0 con 0x7f7004139590 2023-08-17T00:11:55.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.338+0000 7f7000ff9700 1 -- 172.21.15.153:0/2212535579 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v116) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6ffc04ae40 con 0x7f7004139590 2023-08-17T00:11:55.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ff005a150 msgr2=0x7f6ff005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:55.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ff005a150 0x7f6ff005c610 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f6ff8009760 tx=0x7f6ff8016000).stop 2023-08-17T00:11:55.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 msgr2=0x7f7004153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 0x7f7004153880 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f6ffc00c810 tx=0x7f6ffc001500).stop 2023-08-17T00:11:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 shutdown_connections 2023-08-17T00:11:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ff005a150 0x7f6ff005c610 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7004139590 0x7f7004153880 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f70041391b0 0x7f7004153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 --2- 172.21.15.153:0/2212535579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7004064b40 0x7f700414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 >> 172.21.15.153:0/2212535579 conn(0x7f70040c72e0 msgr2=0x7f70040a7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:55.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 shutdown_connections 2023-08-17T00:11:55.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.342+0000 7f7009907700 1 -- 172.21.15.153:0/2212535579 wait complete. 2023-08-17T00:11:55.350 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:11:55.369 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:11:55.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.534+0000 7f4ab58f1700 1 Processor -- start 2023-08-17T00:11:55.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.534+0000 7f4ab58f1700 1 -- start start 2023-08-17T00:11:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4ab58f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab00a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4ab58f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4ab0158190 0x7f4ab00c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4ab58f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab0158640 con 0x7f4ab00a9be0 2023-08-17T00:11:55.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4ab58f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab0154620 con 0x7f4ab0158190 2023-08-17T00:11:55.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4ab58f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab0154900 con 0x7f4ab00c7ad0 2023-08-17T00:11:55.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aaeffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4ab00a9be0 0x7f4ab00c73c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36472/0 (socket says 172.21.15.153:36472) 2023-08-17T00:11:55.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aaeffd700 1 -- 172.21.15.153:0/2542588067 learned_addr learned my addr 172.21.15.153:0/2542588067 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aae7fc700 1 --2- 172.21.15.153:0/2542588067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab00a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aaf7fe700 1 --2- 172.21.15.153:0/2542588067 >> v2:172.21.15.178:3300/0 conn(0x7f4ab0158190 0x7f4ab00c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aadffb700 1 -- 172.21.15.153:0/2542588067 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197589875 0 0) 0x7f4ab0158640 con 0x7f4ab00a9be0 2023-08-17T00:11:55.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aadffb700 1 -- 172.21.15.153:0/2542588067 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a980033f0 con 0x7f4ab00a9be0 2023-08-17T00:11:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aae7fc700 1 -- 172.21.15.153:0/2542588067 >> v2:172.21.15.178:3300/0 conn(0x7f4ab0158190 msgr2=0x7f4ab00c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aae7fc700 1 --2- 172.21.15.153:0/2542588067 >> v2:172.21.15.178:3300/0 conn(0x7f4ab0158190 0x7f4ab00c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aae7fc700 1 -- 172.21.15.153:0/2542588067 >> v1:172.21.15.153:6789/0 conn(0x7f4ab00a9be0 legacy=0x7f4ab00c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:55.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.538+0000 7f4aae7fc700 1 -- 172.21.15.153:0/2542588067 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0154be0 con 0x7f4ab00c7ad0 2023-08-17T00:11:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4aae7fc700 1 --2- 172.21.15.153:0/2542588067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab00a9fc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4aa4009760 tx=0x7f4aa4009060).ready entity=mon.2 client_cookie=1874a051bfc0a871 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4aadffb700 1 -- 172.21.15.153:0/2542588067 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4009120 con 0x7f4ab00c7ad0 2023-08-17T00:11:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4aadffb700 1 -- 172.21.15.153:0/2542588067 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa400d4a0 con 0x7f4ab00c7ad0 2023-08-17T00:11:55.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4aadffb700 1 -- 172.21.15.153:0/2542588067 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa400d820 con 0x7f4ab00c7ad0 2023-08-17T00:11:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2542588067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 msgr2=0x7f4ab00a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2542588067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab00a9fc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f4aa4009760 tx=0x7f4aa4009060).stop 2023-08-17T00:11:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2542588067 shutdown_connections 2023-08-17T00:11:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2542588067 >> v2:172.21.15.178:3300/0 conn(0x7f4ab0158190 0x7f4ab00c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2542588067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab00a9fc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2542588067 >> 172.21.15.153:0/2542588067 conn(0x7f4ab0061fa0 msgr2=0x7f4ab0062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:55.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2542588067 shutdown_connections 2023-08-17T00:11:55.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.542+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2542588067 wait complete. 2023-08-17T00:11:55.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 Processor -- start 2023-08-17T00:11:55.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 -- start start 2023-08-17T00:11:55.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab00a9be0 0x7f4ab00c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab0152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 0x7f4ab00c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c2f80 con 0x7f4ab0158190 2023-08-17T00:11:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c2370 con 0x7f4ab00a9be0 2023-08-17T00:11:55.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4ab58f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab00c2650 con 0x7f4ab00c7ad0 2023-08-17T00:11:55.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 0x7f4ab00c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 0x7f4ab00c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46248/0 (socket says 172.21.15.153:46248) 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 -- 172.21.15.153:0/2808835100 learned_addr learned my addr 172.21.15.153:0/2808835100 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aae7fc700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab0152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaeffd700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab00a9be0 0x7f4ab00c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 -- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 msgr2=0x7f4ab0152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab0152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 -- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab00a9be0 msgr2=0x7f4ab00c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab00a9be0 0x7f4ab00c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaf7fe700 1 -- 172.21.15.153:0/2808835100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40092a0 con 0x7f4ab0158190 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aaeffd700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab00a9be0 0x7f4ab00c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.546+0000 7f4aae7fc700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4aaf7fe700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 0x7f4ab00c1a70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f4aa8009df0 tx=0x7f4aa800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800cb50 con 0x7f4ab0158190 2023-08-17T00:11:55.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa800f040 con 0x7f4ab0158190 2023-08-17T00:11:55.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab00c2930 con 0x7f4ab0158190 2023-08-17T00:11:55.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800cec0 con 0x7f4ab0158190 2023-08-17T00:11:55.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab0153470 con 0x7f4ab0158190 2023-08-17T00:11:55.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab00c30f0 con 0x7f4ab0158190 2023-08-17T00:11:55.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.550+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4aa8013610 con 0x7f4ab0158190 2023-08-17T00:11:55.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.554+0000 7f4a96ffd700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a9c05a120 0x7f4a9c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:55.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.554+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f4aa8074aa0 con 0x7f4ab0158190 2023-08-17T00:11:55.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.554+0000 7f4aaeffd700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a9c05a120 0x7f4a9c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:55.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.554+0000 7f4aaeffd700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a9c05a120 0x7f4a9c05c5e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f4aa0005750 tx=0x7f4aa0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:55.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.558+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4aa8048530 con 0x7f4ab0158190 2023-08-17T00:11:55.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:55.726+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4ab006b530 con 0x7f4ab0158190 2023-08-17T00:11:56.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.342+0000 7f4a96ffd700 1 -- 172.21.15.153:0/2808835100 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v117) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4aa804bb50 con 0x7f4ab0158190 2023-08-17T00:11:56.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a9c05a120 msgr2=0x7f4a9c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a9c05a120 0x7f4a9c05c5e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f4aa0005750 tx=0x7f4aa0009040).stop 2023-08-17T00:11:56.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 msgr2=0x7f4ab00c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 0x7f4ab00c1a70 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f4aa8009df0 tx=0x7f4aa800b040).stop 2023-08-17T00:11:56.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 shutdown_connections 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a9c05a120 0x7f4a9c05c5e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4ab0158190 0x7f4ab00c1a70 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ab00c7ad0 0x7f4ab0152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 --2- 172.21.15.153:0/2808835100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ab00a9be0 0x7f4ab00c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 >> 172.21.15.153:0/2808835100 conn(0x7f4ab0061fa0 msgr2=0x7f4ab00acd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 shutdown_connections 2023-08-17T00:11:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.350+0000 7f4ab58f1700 1 -- 172.21.15.153:0/2808835100 wait complete. 2023-08-17T00:11:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:11:56.388 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:11:56.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.542+0000 7f6c92d69700 1 Processor -- start 2023-08-17T00:11:56.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.542+0000 7f6c92d69700 1 -- start start 2023-08-17T00:11:56.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c92d69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6c8c0c5bf0 0x7f6c8c0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c92d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c0a9f30 0x7f6c8c14dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c92d69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8c158930 con 0x7f6c8c154dd0 2023-08-17T00:11:56.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c92d69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c8c0aa3a0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c92d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c157d20 con 0x7f6c8c0a9f30 2023-08-17T00:11:56.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c8bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6c8c154dd0 0x7f6c8c0a9820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36478/0 (socket says 172.21.15.153:36478) 2023-08-17T00:11:56.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c8bfff700 1 -- 172.21.15.153:0/156384264 learned_addr learned my addr 172.21.15.153:0/156384264 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:56.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c91306700 1 --2- 172.21.15.153:0/156384264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c0a9f30 0x7f6c8c14dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c90b05700 1 --2- 172.21.15.153:0/156384264 >> v2:172.21.15.178:3300/0 conn(0x7f6c8c0c5bf0 0x7f6c8c0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c8b7fe700 1 -- 172.21.15.153:0/156384264 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757885654 0 0) 0x7f6c8c158930 con 0x7f6c8c154dd0 2023-08-17T00:11:56.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c8b7fe700 1 -- 172.21.15.153:0/156384264 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7c0033f0 con 0x7f6c8c154dd0 2023-08-17T00:11:56.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c91306700 1 -- 172.21.15.153:0/156384264 >> v2:172.21.15.178:3300/0 conn(0x7f6c8c0c5bf0 msgr2=0x7f6c8c0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:56.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c91306700 1 --2- 172.21.15.153:0/156384264 >> v2:172.21.15.178:3300/0 conn(0x7f6c8c0c5bf0 0x7f6c8c0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c91306700 1 -- 172.21.15.153:0/156384264 >> v1:172.21.15.153:6789/0 conn(0x7f6c8c154dd0 legacy=0x7f6c8c0a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c91306700 1 -- 172.21.15.153:0/156384264 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c158000 con 0x7f6c8c0a9f30 2023-08-17T00:11:56.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.546+0000 7f6c91306700 1 --2- 172.21.15.153:0/156384264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c0a9f30 0x7f6c8c14dd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f6c84009e60 tx=0x7f6c84009780).ready entity=mon.2 client_cookie=1fee6b1c3bbaee25 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:56.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c8b7fe700 1 -- 172.21.15.153:0/156384264 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400e070 con 0x7f6c8c0a9f30 2023-08-17T00:11:56.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c8b7fe700 1 -- 172.21.15.153:0/156384264 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8400bab0 con 0x7f6c8c0a9f30 2023-08-17T00:11:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c8b7fe700 1 -- 172.21.15.153:0/156384264 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400be30 con 0x7f6c8c0a9f30 2023-08-17T00:11:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 -- 172.21.15.153:0/156384264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c0a9f30 msgr2=0x7f6c8c14dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 --2- 172.21.15.153:0/156384264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c0a9f30 0x7f6c8c14dd20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f6c84009e60 tx=0x7f6c84009780).stop 2023-08-17T00:11:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 -- 172.21.15.153:0/156384264 shutdown_connections 2023-08-17T00:11:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 --2- 172.21.15.153:0/156384264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c0a9f30 0x7f6c8c14dd20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 --2- 172.21.15.153:0/156384264 >> v2:172.21.15.178:3300/0 conn(0x7f6c8c0c5bf0 0x7f6c8c0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 -- 172.21.15.153:0/156384264 >> 172.21.15.153:0/156384264 conn(0x7f6c8c0caaa0 msgr2=0x7f6c8c0caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:56.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 -- 172.21.15.153:0/156384264 shutdown_connections 2023-08-17T00:11:56.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.550+0000 7f6c92d69700 1 -- 172.21.15.153:0/156384264 wait complete. 2023-08-17T00:11:56.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 Processor -- start 2023-08-17T00:11:56.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 -- start start 2023-08-17T00:11:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c8c0a9f30 0x7f6c8c0ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 0x7f6c8c0c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c154dd0 0x7f6c8c0c04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0b04c0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0aede0 con 0x7f6c8c0a9f30 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c92d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8c0af8b0 con 0x7f6c8c154dd0 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 0x7f6c8c0c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 0x7f6c8c0c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46262/0 (socket says 172.21.15.153:46262) 2023-08-17T00:11:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 -- 172.21.15.153:0/4248459192 learned_addr learned my addr 172.21.15.153:0/4248459192 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c91306700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c154dd0 0x7f6c8c0c04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c90b05700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c8c0a9f30 0x7f6c8c0ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 -- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c154dd0 msgr2=0x7f6c8c0c04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c154dd0 0x7f6c8c0c04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 -- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c8c0a9f30 msgr2=0x7f6c8c0ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c8c0a9f30 0x7f6c8c0ae8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 -- 172.21.15.153:0/4248459192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c84009a20 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c90b05700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c8c0a9f30 0x7f6c8c0ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c8bfff700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 0x7f6c8c0c4820 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f6c7800c490 tx=0x7f6c78007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.554+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780072e0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.558+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c78007440 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.558+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780057a0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.558+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8c0afb90 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.558+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8c0b0150 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.558+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8c06b530 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.558+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6c78010070 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.562+0000 7f6c88ff9700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c7005a150 0x7f6c7005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.562+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f6c78073520 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.562+0000 7f6c90b05700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c7005a150 0x7f6c7005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.562+0000 7f6c90b05700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c7005a150 0x7f6c7005c610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f6c80006d80 tx=0x7f6c80008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:56.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.566+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c780472d0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.726+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6c8c0bfbb0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.730+0000 7f6c88ff9700 1 -- 172.21.15.153:0/4248459192 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c7804a8f0 con 0x7f6c8c0c5bf0 2023-08-17T00:11:56.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c7005a150 msgr2=0x7f6c7005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c7005a150 0x7f6c7005c610 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f6c80006d80 tx=0x7f6c80008040).stop 2023-08-17T00:11:56.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 msgr2=0x7f6c8c0c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 0x7f6c8c0c4820 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f6c7800c490 tx=0x7f6c78007c50).stop 2023-08-17T00:11:56.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 shutdown_connections 2023-08-17T00:11:56.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c7005a150 0x7f6c7005c610 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c8c154dd0 0x7f6c8c0c04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c8c0c5bf0 0x7f6c8c0c4820 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 --2- 172.21.15.153:0/4248459192 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c8c0a9f30 0x7f6c8c0ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 >> 172.21.15.153:0/4248459192 conn(0x7f6c8c0caaa0 msgr2=0x7f6c8c0c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:56.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 shutdown_connections 2023-08-17T00:11:56.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.734+0000 7f6c92d69700 1 -- 172.21.15.153:0/4248459192 wait complete. 2023-08-17T00:11:56.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2023-08-17T00:11:56.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.950+0000 7f27d1479700 1 Processor -- start 2023-08-17T00:11:56.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.950+0000 7f27d1479700 1 -- start start 2023-08-17T00:11:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27d1479700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27cc0689c0 0x7f27cc068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27d1479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 0x7f27cc0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27d1479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27cc065da0 con 0x7f27cc151530 2023-08-17T00:11:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27d1479700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27cc155c60 con 0x7f27cc0689c0 2023-08-17T00:11:56.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27d1479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc156550 con 0x7f27cc1560f0 2023-08-17T00:11:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27cb7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 0x7f27cc0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27cbfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27cc0689c0 0x7f27cc068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27cbfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27cc0689c0 0x7f27cc068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40202/0 (socket says 172.21.15.153:40202) 2023-08-17T00:11:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27cbfff700 1 -- 172.21.15.153:0/2123995836 learned_addr learned my addr 172.21.15.153:0/2123995836 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27cb7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 0x7f27cc0c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:33422/0 (socket says 172.21.15.153:33422) 2023-08-17T00:11:56.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.954+0000 7f27d0c78700 1 --1- 172.21.15.153:0/2123995836 >> v1:172.21.15.178:6789/0 conn(0x7f27cc151530 0x7f27cc1519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42898/0 (socket says 172.21.15.153:42898) 2023-08-17T00:11:56.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27cbfff700 1 -- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 msgr2=0x7f27cc0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:56.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27cbfff700 1 --2- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 0x7f27cc0c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27cbfff700 1 -- 172.21.15.153:0/2123995836 >> v1:172.21.15.178:6789/0 conn(0x7f27cc151530 legacy=0x7f27cc1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27cbfff700 1 -- 172.21.15.153:0/2123995836 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc065ff0 con 0x7f27cc0689c0 2023-08-17T00:11:56.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27cb7fe700 1 --2- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 0x7f27cc0c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:11:56.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27caffd700 1 -- 172.21.15.153:0/2123995836 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468991710 0 0) 0x7f27cc065da0 con 0x7f27cc151530 2023-08-17T00:11:56.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27cbfff700 1 --2- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc0689c0 0x7f27cc068da0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f27bc009810 tx=0x7f27bc009060).ready entity=mon.1 client_cookie=810eeeabf2750fff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27caffd700 1 -- 172.21.15.153:0/2123995836 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005880 con 0x7f27cc0689c0 2023-08-17T00:11:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27caffd700 1 -- 172.21.15.153:0/2123995836 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27bc0059e0 con 0x7f27cc0689c0 2023-08-17T00:11:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27caffd700 1 -- 172.21.15.153:0/2123995836 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27bc005d60 con 0x7f27cc0689c0 2023-08-17T00:11:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 -- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc0689c0 msgr2=0x7f27cc068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 --2- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc0689c0 0x7f27cc068da0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f27bc009810 tx=0x7f27bc009060).stop 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 -- 172.21.15.153:0/2123995836 shutdown_connections 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 --2- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc1560f0 0x7f27cc0c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 --2- 172.21.15.153:0/2123995836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc0689c0 0x7f27cc068da0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 -- 172.21.15.153:0/2123995836 >> 172.21.15.153:0/2123995836 conn(0x7f27cc0c6620 msgr2=0x7f27cc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 -- 172.21.15.153:0/2123995836 shutdown_connections 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.958+0000 7f27d1479700 1 -- 172.21.15.153:0/2123995836 wait complete. 2023-08-17T00:11:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 Processor -- start 2023-08-17T00:11:56.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 -- start start 2023-08-17T00:11:56.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc0689c0 0x7f27cc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc151530 0x7f27cc0be570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 0x7f27cc0bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc0bef50 con 0x7f27cc1560f0 2023-08-17T00:11:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc151210 con 0x7f27cc151530 2023-08-17T00:11:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d1479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27cc164da0 con 0x7f27cc0689c0 2023-08-17T00:11:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d0c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 0x7f27cc0bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d0c78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 0x7f27cc0bea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46274/0 (socket says 172.21.15.153:46274) 2023-08-17T00:11:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27d0c78700 1 -- 172.21.15.153:0/477534067 learned_addr learned my addr 172.21.15.153:0/477534067 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27cbfff700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc0689c0 0x7f27cc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.962+0000 7f27cb7fe700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc151530 0x7f27cc0be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d0c78700 1 -- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc0689c0 msgr2=0x7f27cc150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d0c78700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc0689c0 0x7f27cc150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d0c78700 1 -- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc151530 msgr2=0x7f27cc0be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d0c78700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc151530 0x7f27cc0be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d0c78700 1 -- 172.21.15.153:0/477534067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00092a0 con 0x7f27cc1560f0 2023-08-17T00:11:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27cb7fe700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc151530 0x7f27cc0be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d0c78700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 0x7f27cc0bea60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f27c400c7e0 tx=0x7f27c4007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4005c70 con 0x7f27cc1560f0 2023-08-17T00:11:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4005dd0 con 0x7f27cc1560f0 2023-08-17T00:11:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007320 con 0x7f27cc1560f0 2023-08-17T00:11:56.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27bc009300 con 0x7f27cc1560f0 2023-08-17T00:11:56.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27cc164470 con 0x7f27cc1560f0 2023-08-17T00:11:56.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.966+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27cc06b4c0 con 0x7f27cc1560f0 2023-08-17T00:11:56.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.970+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f27c4010030 con 0x7f27cc1560f0 2023-08-17T00:11:56.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.970+0000 7f27b3fff700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27b805a150 0x7f27b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:56.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.970+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f27c4073e20 con 0x7f27cc1560f0 2023-08-17T00:11:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.970+0000 7f27cbfff700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27b805a150 0x7f27b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.970+0000 7f27cbfff700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27b805a150 0x7f27b805c610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f27bc00b340 tx=0x7f27bc016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:56.974+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27c4047a60 con 0x7f27cc1560f0 2023-08-17T00:11:57.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.182+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f27cc0662d0 con 0x7f27cc1560f0 2023-08-17T00:11:57.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.358+0000 7f27b3fff700 1 -- 172.21.15.153:0/477534067 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v428) v1 ==== 155+0+0 (secure 0 0 0) 0x7f27c404b080 con 0x7f27cc1560f0 2023-08-17T00:11:57.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27b805a150 msgr2=0x7f27b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:57.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27b805a150 0x7f27b805c610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f27bc00b340 tx=0x7f27bc016000).stop 2023-08-17T00:11:57.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 msgr2=0x7f27cc0bea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:57.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 0x7f27cc0bea60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f27c400c7e0 tx=0x7f27c4007f60).stop 2023-08-17T00:11:57.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 shutdown_connections 2023-08-17T00:11:57.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27b805a150 0x7f27b805c610 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27cc1560f0 0x7f27cc0bea60 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27cc151530 0x7f27cc0be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 --2- 172.21.15.153:0/477534067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27cc0689c0 0x7f27cc150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 >> 172.21.15.153:0/477534067 conn(0x7f27cc0c6620 msgr2=0x7f27cc0bf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:57.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 shutdown_connections 2023-08-17T00:11:57.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.362+0000 7f27d1479700 1 -- 172.21.15.153:0/477534067 wait complete. 2023-08-17T00:11:57.393 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-08-17T00:11:57.393 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-08-17T00:11:57.393 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2023-08-17T00:11:57.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.550+0000 7f1e79cdb700 1 Processor -- start 2023-08-17T00:11:57.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.550+0000 7f1e79cdb700 1 -- start start 2023-08-17T00:11:57.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e79cdb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1e740c2b70 0x7f1e741542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:57.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e79cdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e741547b0 0x7f1e74062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:57.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e79cdb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e74155280 con 0x7f1e740634a0 2023-08-17T00:11:57.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e79cdb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e74066140 con 0x7f1e740c2b70 2023-08-17T00:11:57.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e79cdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74063930 con 0x7f1e741547b0 2023-08-17T00:11:57.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e73fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e740634a0 0x7f1e740bbbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36482/0 (socket says 172.21.15.153:36482) 2023-08-17T00:11:57.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e73fff700 1 -- 172.21.15.153:0/3845339049 learned_addr learned my addr 172.21.15.153:0/3845339049 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:57.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e737fe700 1 --2- 172.21.15.153:0/3845339049 >> v2:172.21.15.153:3300/0 conn(0x7f1e740c2b70 0x7f1e741542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:57.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e72ffd700 1 --2- 172.21.15.153:0/3845339049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e741547b0 0x7f1e74062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e727fc700 1 -- 172.21.15.153:0/3845339049 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965393662 0 0) 0x7f1e74155280 con 0x7f1e740634a0 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.554+0000 7f1e727fc700 1 -- 172.21.15.153:0/3845339049 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e5c0033f0 con 0x7f1e740634a0 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e737fe700 1 -- 172.21.15.153:0/3845339049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e741547b0 msgr2=0x7f1e74062fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e737fe700 1 --2- 172.21.15.153:0/3845339049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e741547b0 0x7f1e74062fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e737fe700 1 -- 172.21.15.153:0/3845339049 >> v1:172.21.15.153:6789/0 conn(0x7f1e740634a0 legacy=0x7f1e740bbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e737fe700 1 -- 172.21.15.153:0/3845339049 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e74154cc0 con 0x7f1e740c2b70 2023-08-17T00:11:57.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e737fe700 1 --2- 172.21.15.153:0/3845339049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e741542c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f1e64009760 tx=0x7f1e64009060).ready entity=mon.0 client_cookie=b41b51848a9f23bc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:57.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e727fc700 1 -- 172.21.15.153:0/3845339049 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e640090d0 con 0x7f1e740c2b70 2023-08-17T00:11:57.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e727fc700 1 -- 172.21.15.153:0/3845339049 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6400d4a0 con 0x7f1e740c2b70 2023-08-17T00:11:57.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 -- 172.21.15.153:0/3845339049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 msgr2=0x7f1e741542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:57.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/3845339049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e741542c0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f1e64009760 tx=0x7f1e64009060).stop 2023-08-17T00:11:57.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 -- 172.21.15.153:0/3845339049 shutdown_connections 2023-08-17T00:11:57.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/3845339049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e741547b0 0x7f1e74062fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/3845339049 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e741542c0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 -- 172.21.15.153:0/3845339049 >> 172.21.15.153:0/3845339049 conn(0x7f1e740c41d0 msgr2=0x7f1e74068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:57.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 -- 172.21.15.153:0/3845339049 shutdown_connections 2023-08-17T00:11:57.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 -- 172.21.15.153:0/3845339049 wait complete. 2023-08-17T00:11:57.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.558+0000 7f1e79cdb700 1 Processor -- start 2023-08-17T00:11:57.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 -- start start 2023-08-17T00:11:57.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e740634a0 0x7f1e74165180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:57.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e740bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e741547b0 0x7f1e740a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74165670 con 0x7f1e740c2b70 2023-08-17T00:11:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740a7390 con 0x7f1e741547b0 2023-08-17T00:11:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740a7670 con 0x7f1e740634a0 2023-08-17T00:11:57.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e740bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e740bf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46292/0 (socket says 172.21.15.153:46292) 2023-08-17T00:11:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 -- 172.21.15.153:0/2150755985 learned_addr learned my addr 172.21.15.153:0/2150755985 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e737fe700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e740634a0 0x7f1e74165180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:57.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e73fff700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e741547b0 0x7f1e740a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 -- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e740634a0 msgr2=0x7f1e74165180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e740634a0 0x7f1e74165180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 -- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e741547b0 msgr2=0x7f1e740a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:57.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e741547b0 0x7f1e740a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 -- 172.21.15.153:0/2150755985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e640092a0 con 0x7f1e740c2b70 2023-08-17T00:11:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e73fff700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e741547b0 0x7f1e740a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:11:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e72ffd700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e740bf1e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f1e6800e8d0 tx=0x7f1e68009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68012600 con 0x7f1e740c2b70 2023-08-17T00:11:57.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e68012760 con 0x7f1e740c2b70 2023-08-17T00:11:57.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e740a7950 con 0x7f1e740c2b70 2023-08-17T00:11:57.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68012ae0 con 0x7f1e740c2b70 2023-08-17T00:11:57.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.562+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e740a7f10 con 0x7f1e740c2b70 2023-08-17T00:11:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.566+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74065090 con 0x7f1e740c2b70 2023-08-17T00:11:57.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.566+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1e68022070 con 0x7f1e740c2b70 2023-08-17T00:11:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.570+0000 7f1e5b7fe700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6005a180 0x7f1e6005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.570+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f1e68073fc0 con 0x7f1e740c2b70 2023-08-17T00:11:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.570+0000 7f1e737fe700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6005a180 0x7f1e6005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:57.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.570+0000 7f1e737fe700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6005a180 0x7f1e6005c640 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f1e740a8310 tx=0x7f1e64016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:57.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.574+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e74065090 con 0x7f1e740c2b70 2023-08-17T00:11:57.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:57.790+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f1e7406b530 con 0x7f1e740c2b70 2023-08-17T00:11:58.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.370+0000 7f1e5b7fe700 1 -- 172.21.15.153:0/2150755985 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v429) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e68016070 con 0x7f1e740c2b70 2023-08-17T00:11:58.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6005a180 msgr2=0x7f1e6005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6005a180 0x7f1e6005c640 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f1e740a8310 tx=0x7f1e64016000).stop 2023-08-17T00:11:58.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 msgr2=0x7f1e740bf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e740bf1e0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f1e6800e8d0 tx=0x7f1e68009060).stop 2023-08-17T00:11:58.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 shutdown_connections 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e6005a180 0x7f1e6005c640 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e741547b0 0x7f1e740a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e740c2b70 0x7f1e740bf1e0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 --2- 172.21.15.153:0/2150755985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e740634a0 0x7f1e74165180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 >> 172.21.15.153:0/2150755985 conn(0x7f1e740c41d0 msgr2=0x7f1e740664d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 shutdown_connections 2023-08-17T00:11:58.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.374+0000 7f1e79cdb700 1 -- 172.21.15.153:0/2150755985 wait complete. 2023-08-17T00:11:58.400 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:11:58.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.570+0000 7f26ebe5b700 1 Processor -- start 2023-08-17T00:11:58.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.570+0000 7f26ebe5b700 1 -- start start 2023-08-17T00:11:58.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.570+0000 7f26ebe5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40632e0 0x7f26e40a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:58.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.570+0000 7f26ebe5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e40629b0 0x7f26e40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:58.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.570+0000 7f26ebe5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e4065240 con 0x7f26e40a8b70 2023-08-17T00:11:58.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e4062e40 con 0x7f26e40629b0 2023-08-17T00:11:58.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40638a0 con 0x7f26e40632e0 2023-08-17T00:11:58.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e40629b0 0x7f26e40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:58.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f26e40629b0 0x7f26e40bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46306/0 (socket says 172.21.15.153:46306) 2023-08-17T00:11:58.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 -- 172.21.15.153:0/2849950904 learned_addr learned my addr 172.21.15.153:0/2849950904 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:58.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26e93f6700 1 --2- 172.21.15.153:0/2849950904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40632e0 0x7f26e40a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:58.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 -- 172.21.15.153:0/2849950904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40632e0 msgr2=0x7f26e40a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:11:58.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 --2- 172.21.15.153:0/2849950904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40632e0 0x7f26e40a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 -- 172.21.15.153:0/2849950904 >> v1:172.21.15.178:6789/0 conn(0x7f26e40a8b70 legacy=0x7f26e40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 -- 172.21.15.153:0/2849950904 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4065de0 con 0x7f26e40629b0 2023-08-17T00:11:58.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ea3f8700 1 --2- 172.21.15.153:0/2849950904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40629b0 0x7f26e40bbdc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f26dc009f20 tx=0x7f26dc009840).ready entity=mon.0 client_cookie=9a58cb548db96dca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:58.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26e8bf5700 1 -- 172.21.15.153:0/2849950904 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00e070 con 0x7f26e40629b0 2023-08-17T00:11:58.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26e8bf5700 1 -- 172.21.15.153:0/2849950904 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc00ba80 con 0x7f26e40629b0 2023-08-17T00:11:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26e8bf5700 1 -- 172.21.15.153:0/2849950904 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00be00 con 0x7f26e40629b0 2023-08-17T00:11:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- 172.21.15.153:0/2849950904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40629b0 msgr2=0x7f26e40bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/2849950904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40629b0 0x7f26e40bbdc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 rx=0x7f26dc009f20 tx=0x7f26dc009840).stop 2023-08-17T00:11:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- 172.21.15.153:0/2849950904 shutdown_connections 2023-08-17T00:11:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/2849950904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40629b0 0x7f26e40bbdc0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/2849950904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40632e0 0x7f26e40a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- 172.21.15.153:0/2849950904 >> 172.21.15.153:0/2849950904 conn(0x7f26e40c7150 msgr2=0x7f26e40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:58.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- 172.21.15.153:0/2849950904 shutdown_connections 2023-08-17T00:11:58.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.574+0000 7f26ebe5b700 1 -- 172.21.15.153:0/2849950904 wait complete. 2023-08-17T00:11:58.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 Processor -- start 2023-08-17T00:11:58.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 -- start start 2023-08-17T00:11:58.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40629b0 0x7f26e4150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:58.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 0x7f26e40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:58.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40a8b70 0x7f26e40c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:58.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e40c5570 con 0x7f26e40632e0 2023-08-17T00:11:58.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e415a680 con 0x7f26e40a8b70 2023-08-17T00:11:58.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.578+0000 7f26ebe5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e415a1f0 con 0x7f26e40629b0 2023-08-17T00:11:58.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 0x7f26e40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 0x7f26e40c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46322/0 (socket says 172.21.15.153:46322) 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 -- 172.21.15.153:0/3271292502 learned_addr learned my addr 172.21.15.153:0/3271292502 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26ea3f8700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40a8b70 0x7f26e40c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e9bf7700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40629b0 0x7f26e4150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 -- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40629b0 msgr2=0x7f26e4150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40629b0 0x7f26e4150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 -- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40a8b70 msgr2=0x7f26e40c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40a8b70 0x7f26e40c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 -- 172.21.15.153:0/3271292502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009ae0 con 0x7f26e40632e0 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e9bf7700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40629b0 0x7f26e4150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26e93f6700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 0x7f26e40c4b90 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f26d400d890 tx=0x7f26d4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d40125f0 con 0x7f26e40632e0 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d4012750 con 0x7f26e40632e0 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26e41595e0 con 0x7f26e40632e0 2023-08-17T00:11:58.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4012ad0 con 0x7f26e40632e0 2023-08-17T00:11:58.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e4159ba0 con 0x7f26e40632e0 2023-08-17T00:11:58.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.582+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e406b530 con 0x7f26e40632e0 2023-08-17T00:11:58.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.586+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f26d4013480 con 0x7f26e40632e0 2023-08-17T00:11:58.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.586+0000 7f26d9ffb700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26c805a150 0x7f26c805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:58.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.586+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f26d4073f50 con 0x7f26e40632e0 2023-08-17T00:11:58.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.586+0000 7f26e9bf7700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26c805a150 0x7f26c805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:58.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.586+0000 7f26e9bf7700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26c805a150 0x7f26c805c610 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f26e0001670 tx=0x7f26e0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:58.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.594+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f26d4047b90 con 0x7f26e40632e0 2023-08-17T00:11:58.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.758+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f26e40a8760 con 0x7f26e40632e0 2023-08-17T00:11:58.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.766+0000 7f26d9ffb700 1 -- 172.21.15.153:0/3271292502 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f26d404b1b0 con 0x7f26e40632e0 2023-08-17T00:11:58.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26c805a150 msgr2=0x7f26c805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26c805a150 0x7f26c805c610 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f26e0001670 tx=0x7f26e0009040).stop 2023-08-17T00:11:58.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 msgr2=0x7f26e40c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:58.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 0x7f26e40c4b90 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 rx=0x7f26d400d890 tx=0x7f26d4008040).stop 2023-08-17T00:11:58.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 shutdown_connections 2023-08-17T00:11:58.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f26c805a150 0x7f26c805c610 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26e40a8b70 0x7f26e40c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f26e40632e0 0x7f26e40c4b90 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 --2- 172.21.15.153:0/3271292502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f26e40629b0 0x7f26e4150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:58.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 >> 172.21.15.153:0/3271292502 conn(0x7f26e40c7150 msgr2=0x7f26e4157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:58.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 shutdown_connections 2023-08-17T00:11:58.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:58.770+0000 7f26ebe5b700 1 -- 172.21.15.153:0/3271292502 wait complete. 2023-08-17T00:11:58.795 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:11:58.796 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:11:58.838 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:11:58.882 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:11:58.883 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:11:58.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:11:59.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.033+0000 7f017f59e700 1 Processor -- start 2023-08-17T00:11:59.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.033+0000 7f017f59e700 1 -- start start 2023-08-17T00:11:59.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0180151c40 0x7f01801560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0180065da0 con 0x7f01800689c0 2023-08-17T00:11:59.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017f59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0180155c60 con 0x7f0180068da0 2023-08-17T00:11:59.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0180069200 con 0x7f0180151c40 2023-08-17T00:11:59.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017e59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f01800689c0 0x7f01800c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36488/0 (socket says 172.21.15.153:36488) 2023-08-17T00:11:59.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017e59c700 1 -- 172.21.15.153:0/3658884723 learned_addr learned my addr 172.21.15.153:0/3658884723 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:59.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017ed9d700 1 --2- 172.21.15.153:0/3658884723 >> v2:172.21.15.153:3300/0 conn(0x7f0180151c40 0x7f01801560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017dd9b700 1 -- 172.21.15.153:0/3658884723 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 397792565 0 0) 0x7f0180065da0 con 0x7f01800689c0 2023-08-17T00:11:59.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017dd9b700 1 -- 172.21.15.153:0/3658884723 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01600033f0 con 0x7f01800689c0 2023-08-17T00:11:59.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017dd9b700 1 -- 172.21.15.153:0/3658884723 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910673630 0 0) 0x7f0180155c60 con 0x7f0180068da0 2023-08-17T00:11:59.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017ed9d700 1 -- 172.21.15.153:0/3658884723 >> v1:172.21.15.178:6789/0 conn(0x7f0180068da0 legacy=0x7f0180151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017ed9d700 1 -- 172.21.15.153:0/3658884723 >> v1:172.21.15.153:6789/0 conn(0x7f01800689c0 legacy=0x7f01800c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017ed9d700 1 -- 172.21.15.153:0/3658884723 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0180065ff0 con 0x7f0180151c40 2023-08-17T00:11:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017ed9d700 1 --2- 172.21.15.153:0/3658884723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f01801560f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f0178009e60 tx=0x7f0178009780).ready entity=mon.0 client_cookie=8de076255f59b46a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017dd9b700 1 -- 172.21.15.153:0/3658884723 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800e070 con 0x7f0180151c40 2023-08-17T00:11:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017dd9b700 1 -- 172.21.15.153:0/3658884723 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017800bb60 con 0x7f0180151c40 2023-08-17T00:11:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.037+0000 7f017dd9b700 1 -- 172.21.15.153:0/3658884723 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017800bee0 con 0x7f0180151c40 2023-08-17T00:11:59.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 -- 172.21.15.153:0/3658884723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 msgr2=0x7f01801560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 --2- 172.21.15.153:0/3658884723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f01801560f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 rx=0x7f0178009e60 tx=0x7f0178009780).stop 2023-08-17T00:11:59.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 -- 172.21.15.153:0/3658884723 shutdown_connections 2023-08-17T00:11:59.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 --2- 172.21.15.153:0/3658884723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f01801560f0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 -- 172.21.15.153:0/3658884723 >> 172.21.15.153:0/3658884723 conn(0x7f01800c6620 msgr2=0x7f01800c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:59.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 -- 172.21.15.153:0/3658884723 shutdown_connections 2023-08-17T00:11:59.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 -- 172.21.15.153:0/3658884723 wait complete. 2023-08-17T00:11:59.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 Processor -- start 2023-08-17T00:11:59.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.041+0000 7f017f59e700 1 -- start start 2023-08-17T00:11:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800689c0 0x7f01801501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180068da0 0x7f01801546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f0180154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180155090 con 0x7f0180151c40 2023-08-17T00:11:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800bf320 con 0x7f0180068da0 2023-08-17T00:11:59.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800be750 con 0x7f01800689c0 2023-08-17T00:11:59.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f0180154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f0180154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46352/0 (socket says 172.21.15.153:46352) 2023-08-17T00:11:59.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 -- 172.21.15.153:0/3667177611 learned_addr learned my addr 172.21.15.153:0/3667177611 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:59.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f0177fff700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180068da0 0x7f01801546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017e59c700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800689c0 0x7f01801501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 -- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800689c0 msgr2=0x7f01801501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800689c0 0x7f01801501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 -- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180068da0 msgr2=0x7f01801546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180068da0 0x7f01801546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 -- 172.21.15.153:0/3667177611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178009a20 con 0x7f0180151c40 2023-08-17T00:11:59.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f0177fff700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180068da0 0x7f01801546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017e59c700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800689c0 0x7f01801501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017ed9d700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f0180154ba0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f017800b6c0 tx=0x7f0178009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780070e0 con 0x7f0180151c40 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017801c660 con 0x7f0180151c40 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800be9f0 con 0x7f0180151c40 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017801ca20 con 0x7f0180151c40 2023-08-17T00:11:59.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.045+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800befb0 con 0x7f0180151c40 2023-08-17T00:11:59.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.049+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01800bf490 con 0x7f0180151c40 2023-08-17T00:11:59.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.049+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0178027460 con 0x7f0180151c40 2023-08-17T00:11:59.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.049+0000 7f01767fc700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f016405a150 0x7f016405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.049+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0178076130 con 0x7f0180151c40 2023-08-17T00:11:59.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.049+0000 7f017e59c700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f016405a150 0x7f016405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.053+0000 7f017e59c700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f016405a150 0x7f016405c610 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0170004ad0 tx=0x7f0170009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:59.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.057+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0178049d70 con 0x7f0180151c40 2023-08-17T00:11:59.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.249+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0180063750 con 0x7f0180151c40 2023-08-17T00:11:59.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.253+0000 7f01767fc700 1 -- 172.21.15.153:0/3667177611 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f017804d390 con 0x7f0180151c40 2023-08-17T00:11:59.257 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:11:59.257 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6740,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/1389561033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":1389561033},{"type":"v1","addr":"172.21.15.178:6836","nonce":1389561033}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95},{"gid":7162,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/175555362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":175555362},{"type":"v1","addr":"172.21.15.153:6835","nonce":175555362}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/4181491051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":4181491051},{"type":"v1","addr":"172.21.15.153:6834","nonce":4181491051}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1924976861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1924976861},{"type":"v1","addr":"172.21.15.178:6837","nonce":1924976861}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[]} 2023-08-17T00:11:59.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f016405a150 msgr2=0x7f016405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f016405a150 0x7f016405c610 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f0170004ad0 tx=0x7f0170009040).stop 2023-08-17T00:11:59.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 msgr2=0x7f0180154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f0180154ba0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 rx=0x7f017800b6c0 tx=0x7f0178009780).stop 2023-08-17T00:11:59.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 shutdown_connections 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f016405a150 0x7f016405c610 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0180151c40 0x7f0180154ba0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0180068da0 0x7f01801546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 --2- 172.21.15.153:0/3667177611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01800689c0 0x7f01801501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 >> 172.21.15.153:0/3667177611 conn(0x7f01800c6620 msgr2=0x7f01800c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 shutdown_connections 2023-08-17T00:11:59.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.257+0000 7f017f59e700 1 -- 172.21.15.153:0/3667177611 wait complete. 2023-08-17T00:11:59.263 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 95 2023-08-17T00:11:59.282 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:11:59.282 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:11:59.282 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:11:59.283 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:11:59.283 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:11:59.283 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:11:59.283 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:11:59.283 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:11:59.284 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:11:59.284 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:11:59.284 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:11:59.284 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:11:59.285 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:11:59.285 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:11:59.285 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:11:59.285 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:11:59.303 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:11:59.303 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:11:59.304 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:11:59.304 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:11:59.308 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:11:59.308 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:11:59.311 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:11:59.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:11:59.354 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:11:59.355 DEBUG:teuthology.parallel:result is None 2023-08-17T00:11:59.358 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:11:59.358 DEBUG:teuthology.parallel:result is None 2023-08-17T00:11:59.360 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:11:59.360 DEBUG:teuthology.parallel:result is None 2023-08-17T00:11:59.362 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:11:59.362 DEBUG:teuthology.parallel:result is None 2023-08-17T00:11:59.362 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:11:59.453 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:11:59.463 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:11:59.464 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:11:59.467 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:11:59.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.509+0000 7f839085a700 1 Processor -- start 2023-08-17T00:11:59.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.509+0000 7f839085a700 1 -- start start 2023-08-17T00:11:59.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f839085a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f838c068f30 0x7f838c0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f839085a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c1545e0 con 0x7f838c0ac2f0 2023-08-17T00:11:59.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f839085a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c0a96d0 con 0x7f838c0abf10 2023-08-17T00:11:59.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f839085a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c0c1c50 con 0x7f838c068f30 2023-08-17T00:11:59.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838b59e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f838c0ac2f0 0x7f838c156750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36512/0 (socket says 172.21.15.153:36512) 2023-08-17T00:11:59.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838b59e700 1 -- 172.21.15.153:0/122136245 learned_addr learned my addr 172.21.15.153:0/122136245 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:11:59.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838a59c700 1 --2- 172.21.15.153:0/122136245 >> v2:172.21.15.178:3300/0 conn(0x7f838c068f30 0x7f838c0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f8389d9b700 1 -- 172.21.15.153:0/122136245 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285973022 0 0) 0x7f838c1545e0 con 0x7f838c0ac2f0 2023-08-17T00:11:59.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f8389d9b700 1 -- 172.21.15.153:0/122136245 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83740033f0 con 0x7f838c0ac2f0 2023-08-17T00:11:59.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f8389d9b700 1 -- 172.21.15.153:0/122136245 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844931871 0 0) 0x7f83740033f0 con 0x7f838c0ac2f0 2023-08-17T00:11:59.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838a59c700 1 -- 172.21.15.153:0/122136245 >> v1:172.21.15.178:6789/0 conn(0x7f838c0abf10 legacy=0x7f838c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838a59c700 1 -- 172.21.15.153:0/122136245 >> v1:172.21.15.153:6789/0 conn(0x7f838c0ac2f0 legacy=0x7f838c156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838a59c700 1 -- 172.21.15.153:0/122136245 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c064b80 con 0x7f838c068f30 2023-08-17T00:11:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.513+0000 7f838a59c700 1 --2- 172.21.15.153:0/122136245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c0c0a80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f8380009760 tx=0x7f8380009060).ready entity=mon.1 client_cookie=94d670ee41c914a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f8389d9b700 1 -- 172.21.15.153:0/122136245 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83840017f0 con 0x7f838c068f30 2023-08-17T00:11:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f8389d9b700 1 -- 172.21.15.153:0/122136245 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800090d0 con 0x7f838c068f30 2023-08-17T00:11:59.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f8389d9b700 1 -- 172.21.15.153:0/122136245 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380012620 con 0x7f838c068f30 2023-08-17T00:11:59.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 -- 172.21.15.153:0/122136245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 msgr2=0x7f838c0c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 --2- 172.21.15.153:0/122136245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c0c0a80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f8380009760 tx=0x7f8380009060).stop 2023-08-17T00:11:59.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 -- 172.21.15.153:0/122136245 shutdown_connections 2023-08-17T00:11:59.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 --2- 172.21.15.153:0/122136245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c0c0a80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 -- 172.21.15.153:0/122136245 >> 172.21.15.153:0/122136245 conn(0x7f838c0c6620 msgr2=0x7f838c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:11:59.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 -- 172.21.15.153:0/122136245 shutdown_connections 2023-08-17T00:11:59.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 -- 172.21.15.153:0/122136245 wait complete. 2023-08-17T00:11:59.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 Processor -- start 2023-08-17T00:11:59.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.517+0000 7f839085a700 1 -- start start 2023-08-17T00:11:59.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c164c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 0x7f838c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838c0ac2f0 0x7f838c0bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c14f200 con 0x7f838c0abf10 2023-08-17T00:11:59.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c14bf30 con 0x7f838c068f30 2023-08-17T00:11:59.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0bddf0 con 0x7f838c0ac2f0 2023-08-17T00:11:59.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 0x7f838c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838ad9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 0x7f838c14ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46394/0 (socket says 172.21.15.153:46394) 2023-08-17T00:11:59.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 -- 172.21.15.153:0/4149040053 learned_addr learned my addr 172.21.15.153:0/4149040053 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:11:59.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838b59e700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838c0ac2f0 0x7f838c0bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 -- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838c0ac2f0 msgr2=0x7f838c0bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838c0ac2f0 0x7f838c0bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 -- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 msgr2=0x7f838c164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 -- 172.21.15.153:0/4149040053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83800092a0 con 0x7f838c0abf10 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f838a59c700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 0x7f838c14ba40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f838000f000 tx=0x7f8380015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:59.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380011850 con 0x7f838c0abf10 2023-08-17T00:11:59.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800119b0 con 0x7f838c0abf10 2023-08-17T00:11:59.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c0be0d0 con 0x7f838c0abf10 2023-08-17T00:11:59.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380011d70 con 0x7f838c0abf10 2023-08-17T00:11:59.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.521+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c0bda90 con 0x7f838c0abf10 2023-08-17T00:11:59.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.525+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c14f3b0 con 0x7f838c0abf10 2023-08-17T00:11:59.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.525+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f838001a030 con 0x7f838c0abf10 2023-08-17T00:11:59.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.525+0000 7f8372ffd700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f837805a150 0x7f837805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:11:59.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.525+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f83800755d0 con 0x7f838c0abf10 2023-08-17T00:11:59.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.525+0000 7f838ad9d700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f837805a150 0x7f837805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:11:59.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.525+0000 7f838ad9d700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f837805a150 0x7f837805c610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f837c0039f0 tx=0x7f837c007c60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:11:59.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.533+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f838c14f3b0 con 0x7f838c0abf10 2023-08-17T00:11:59.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:11:59.701+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f838c14efd0 con 0x7f838c0abf10 2023-08-17T00:12:00.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.497+0000 7f8372ffd700 1 -- 172.21.15.153:0/4149040053 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v122) v1 ==== 97+0+0 (secure 0 0 0) 0x7f83800492b0 con 0x7f838c0abf10 2023-08-17T00:12:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f837805a150 msgr2=0x7f837805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f837805a150 0x7f837805c610 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f837c0039f0 tx=0x7f837c007c60).stop 2023-08-17T00:12:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 msgr2=0x7f838c14ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 0x7f838c14ba40 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f838000f000 tx=0x7f8380015000).stop 2023-08-17T00:12:00.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 shutdown_connections 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f837805a150 0x7f837805c610 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f838c0ac2f0 0x7f838c0bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f838c0abf10 0x7f838c14ba40 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 --2- 172.21.15.153:0/4149040053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f838c068f30 0x7f838c164c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 >> 172.21.15.153:0/4149040053 conn(0x7f838c0c6620 msgr2=0x7f838c14dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 shutdown_connections 2023-08-17T00:12:00.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.501+0000 7f839085a700 1 -- 172.21.15.153:0/4149040053 wait complete. 2023-08-17T00:12:00.508 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:12:00.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:12:00.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f5525b69700 1 Processor -- start 2023-08-17T00:12:00.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f5525b69700 1 -- start start 2023-08-17T00:12:00.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f5525b69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f552014def0 0x7f55200c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:00.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f5525b69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55200aa680 con 0x7f552014e2d0 2023-08-17T00:12:00.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f5525b69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55200c5eb0 con 0x7f55200c7450 2023-08-17T00:12:00.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f5525b69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5520158850 con 0x7f552014def0 2023-08-17T00:12:00.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f551f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f552014def0 0x7f55200c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:00.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f551effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f552014e2d0 0x7f5520154c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36518/0 (socket says 172.21.15.153:36518) 2023-08-17T00:12:00.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.685+0000 7f551effd700 1 -- 172.21.15.153:0/692679140 learned_addr learned my addr 172.21.15.153:0/692679140 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:00.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551f7fe700 1 -- 172.21.15.153:0/692679140 >> v1:172.21.15.178:6789/0 conn(0x7f55200c7450 legacy=0x7f55200c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:00.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551f7fe700 1 -- 172.21.15.153:0/692679140 >> v1:172.21.15.153:6789/0 conn(0x7f552014e2d0 legacy=0x7f5520154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551f7fe700 1 -- 172.21.15.153:0/692679140 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55200c6110 con 0x7f552014def0 2023-08-17T00:12:00.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551e7fc700 1 -- 172.21.15.153:0/692679140 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184419841 0 0) 0x7f55200aa680 con 0x7f552014e2d0 2023-08-17T00:12:00.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551f7fe700 1 --2- 172.21.15.153:0/692679140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014def0 0x7f55200c59c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f5510009760 tx=0x7f5510009060).ready entity=mon.0 client_cookie=258e0a788a6b5a27 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:00.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551e7fc700 1 -- 172.21.15.153:0/692679140 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000b520 con 0x7f552014def0 2023-08-17T00:12:00.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551e7fc700 1 -- 172.21.15.153:0/692679140 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551000b680 con 0x7f552014def0 2023-08-17T00:12:00.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f551e7fc700 1 -- 172.21.15.153:0/692679140 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000ba00 con 0x7f552014def0 2023-08-17T00:12:00.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 -- 172.21.15.153:0/692679140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014def0 msgr2=0x7f55200c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 --2- 172.21.15.153:0/692679140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014def0 0x7f55200c59c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f5510009760 tx=0x7f5510009060).stop 2023-08-17T00:12:00.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 -- 172.21.15.153:0/692679140 shutdown_connections 2023-08-17T00:12:00.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 --2- 172.21.15.153:0/692679140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014def0 0x7f55200c59c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 -- 172.21.15.153:0/692679140 >> 172.21.15.153:0/692679140 conn(0x7f5520061fa0 msgr2=0x7f55200623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:00.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 -- 172.21.15.153:0/692679140 shutdown_connections 2023-08-17T00:12:00.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.689+0000 7f5525b69700 1 -- 172.21.15.153:0/692679140 wait complete. 2023-08-17T00:12:00.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 Processor -- start 2023-08-17T00:12:00.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 -- start start 2023-08-17T00:12:00.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55200c7450 0x7f55200abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:00.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f552014def0 0x7f552016cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:00.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 0x7f55200afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:00.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55200add10 con 0x7f552014e2d0 2023-08-17T00:12:00.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552016d160 con 0x7f552014def0 2023-08-17T00:12:00.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f5525b69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5520169020 con 0x7f55200c7450 2023-08-17T00:12:00.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 0x7f55200afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f552014def0 0x7f552016cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 0x7f55200afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46406/0 (socket says 172.21.15.153:46406) 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 -- 172.21.15.153:0/2580041209 learned_addr learned my addr 172.21.15.153:0/2580041209 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551f7fe700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55200c7450 0x7f55200abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 -- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55200c7450 msgr2=0x7f55200abda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55200c7450 0x7f55200abda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 -- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f552014def0 msgr2=0x7f552016cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f552014def0 0x7f552016cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 -- 172.21.15.153:0/2580041209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55100092a0 con 0x7f552014e2d0 2023-08-17T00:12:00.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.693+0000 7f551ffff700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 0x7f55200afbe0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f551800c810 tx=0x7f5518002560).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:00.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518010510 con 0x7f552014e2d0 2023-08-17T00:12:00.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55180106b0 con 0x7f552014e2d0 2023-08-17T00:12:00.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518010a70 con 0x7f552014e2d0 2023-08-17T00:12:00.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5520169300 con 0x7f552014e2d0 2023-08-17T00:12:00.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55201698c0 con 0x7f552014e2d0 2023-08-17T00:12:00.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552006b530 con 0x7f552014e2d0 2023-08-17T00:12:00.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5518019030 con 0x7f552014e2d0 2023-08-17T00:12:00.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.697+0000 7f55077fe700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550c05a150 0x7f550c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:00.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.701+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5518073520 con 0x7f552014e2d0 2023-08-17T00:12:00.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.701+0000 7f551f7fe700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550c05a150 0x7f550c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:00.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.701+0000 7f551f7fe700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550c05a150 0x7f550c05c610 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f551000b2e0 tx=0x7f5510017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:00.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.705+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55180473d0 con 0x7f552014e2d0 2023-08-17T00:12:00.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.917+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f55200694b0 con 0x7f552014e2d0 2023-08-17T00:12:00.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.917+0000 7f55077fe700 1 -- 172.21.15.153:0/2580041209 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5518010e60 con 0x7f552014e2d0 2023-08-17T00:12:00.922 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.923 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.924 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:12:00.924 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:12:00.924 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.924 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.924 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.924 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.925 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.926 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.926 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.926 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.927 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:12:00.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.929 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:12:00.930 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:12:00.931 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.934 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.935 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.936 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:12:00.937 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:12:00.938 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.939 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:12:00.940 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.941 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:12:00.941 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:12:00.941 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.943 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:12:00.943 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:12:00.943 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:12:00.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:12:00.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.944 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.945 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:00.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:00.948 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:12:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:00.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550c05a150 msgr2=0x7f550c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550c05a150 0x7f550c05c610 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f551000b2e0 tx=0x7f5510017000).stop 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 msgr2=0x7f55200afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 0x7f55200afbe0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f551800c810 tx=0x7f5518002560).stop 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 shutdown_connections 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550c05a150 0x7f550c05c610 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f552014e2d0 0x7f55200afbe0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f552014def0 0x7f552016cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 --2- 172.21.15.153:0/2580041209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55200c7450 0x7f55200abda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:00.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 >> 172.21.15.153:0/2580041209 conn(0x7f5520061fa0 msgr2=0x7f5520154c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:00.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 shutdown_connections 2023-08-17T00:12:00.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:00.921+0000 7f5525b69700 1 -- 172.21.15.153:0/2580041209 wait complete. 2023-08-17T00:12:00.951 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:01.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.109+0000 7ff5dd639700 1 Processor -- start 2023-08-17T00:12:01.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.109+0000 7ff5dd639700 1 -- start start 2023-08-17T00:12:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dd639700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff5d8068da0 0x7ff5d81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dd639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff5d8151530 0x7ff5d81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dd639700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d8065da0 con 0x7ff5d80689c0 2023-08-17T00:12:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dd639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8069200 con 0x7ff5d8151530 2023-08-17T00:12:01.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dd639700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d8155c60 con 0x7ff5d8068da0 2023-08-17T00:12:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d7fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff5d80689c0 0x7ff5d80c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36534/0 (socket says 172.21.15.153:36534) 2023-08-17T00:12:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d7fff700 1 -- 172.21.15.153:0/1347397080 learned_addr learned my addr 172.21.15.153:0/1347397080 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dce38700 1 --2- 172.21.15.153:0/1347397080 >> v2:172.21.15.153:3300/0 conn(0x7ff5d8151530 0x7ff5d81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5cffff700 1 --2- 172.21.15.153:0/1347397080 >> v2:172.21.15.178:3300/0 conn(0x7ff5d8068da0 0x7ff5d81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d77fe700 1 -- 172.21.15.153:0/1347397080 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175801483 0 0) 0x7ff5d8065da0 con 0x7ff5d80689c0 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d77fe700 1 -- 172.21.15.153:0/1347397080 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c40033f0 con 0x7ff5d80689c0 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5cffff700 1 -- 172.21.15.153:0/1347397080 >> v2:172.21.15.153:3300/0 conn(0x7ff5d8151530 msgr2=0x7ff5d81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5cffff700 1 --2- 172.21.15.153:0/1347397080 >> v2:172.21.15.153:3300/0 conn(0x7ff5d8151530 0x7ff5d81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5cffff700 1 -- 172.21.15.153:0/1347397080 >> v1:172.21.15.153:6789/0 conn(0x7ff5d80689c0 legacy=0x7ff5d80c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5cffff700 1 -- 172.21.15.153:0/1347397080 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8065ff0 con 0x7ff5d8068da0 2023-08-17T00:12:01.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5dce38700 1 --2- 172.21.15.153:0/1347397080 >> v2:172.21.15.153:3300/0 conn(0x7ff5d8151530 0x7ff5d81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:01.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5cffff700 1 --2- 172.21.15.153:0/1347397080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d8068da0 0x7ff5d81560f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff5d80bff90 tx=0x7ff5c0009060).ready entity=mon.1 client_cookie=e2d795d6e401ce52 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d77fe700 1 -- 172.21.15.153:0/1347397080 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c00090d0 con 0x7ff5d8068da0 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d77fe700 1 -- 172.21.15.153:0/1347397080 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c000d4a0 con 0x7ff5d8068da0 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.113+0000 7ff5d77fe700 1 -- 172.21.15.153:0/1347397080 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000d820 con 0x7ff5d8068da0 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 -- 172.21.15.153:0/1347397080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d8068da0 msgr2=0x7ff5d81560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 --2- 172.21.15.153:0/1347397080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d8068da0 0x7ff5d81560f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7ff5d80bff90 tx=0x7ff5c0009060).stop 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 -- 172.21.15.153:0/1347397080 shutdown_connections 2023-08-17T00:12:01.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 --2- 172.21.15.153:0/1347397080 >> v2:172.21.15.153:3300/0 conn(0x7ff5d8151530 0x7ff5d81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 --2- 172.21.15.153:0/1347397080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d8068da0 0x7ff5d81560f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 -- 172.21.15.153:0/1347397080 >> 172.21.15.153:0/1347397080 conn(0x7ff5d80c6620 msgr2=0x7ff5d80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 -- 172.21.15.153:0/1347397080 shutdown_connections 2023-08-17T00:12:01.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.117+0000 7ff5dd639700 1 -- 172.21.15.153:0/1347397080 wait complete. 2023-08-17T00:12:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 Processor -- start 2023-08-17T00:12:01.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 -- start start 2023-08-17T00:12:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d80689c0 0x7ff5d80bc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 0x7ff5d81544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d8151530 0x7ff5d8153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8155210 con 0x7ff5d8068da0 2023-08-17T00:12:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d8152ea0 con 0x7ff5d80689c0 2023-08-17T00:12:01.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dd639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d81549d0 con 0x7ff5d8151530 2023-08-17T00:12:01.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 0x7ff5d81544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 0x7ff5d81544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46422/0 (socket says 172.21.15.153:46422) 2023-08-17T00:12:01.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 -- 172.21.15.153:0/3610244704 learned_addr learned my addr 172.21.15.153:0/3610244704 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:01.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5d7fff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d80689c0 0x7ff5d80bc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5dce38700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d8151530 0x7ff5d8153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 -- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d8151530 msgr2=0x7ff5d8153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d8151530 0x7ff5d8153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 -- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d80689c0 msgr2=0x7ff5d80bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d80689c0 0x7ff5d80bc490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 -- 172.21.15.153:0/3610244704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009a20 con 0x7ff5d8068da0 2023-08-17T00:12:01.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5d7fff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d80689c0 0x7ff5d80bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5cffff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 0x7ff5d81544e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7ff5c000d260 tx=0x7ff5c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.121+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0012870 con 0x7ff5d8068da0 2023-08-17T00:12:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.125+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c00129d0 con 0x7ff5d8068da0 2023-08-17T00:12:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.125+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c00092a0 con 0x7ff5d8068da0 2023-08-17T00:12:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.125+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0012d70 con 0x7ff5d8068da0 2023-08-17T00:12:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.125+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d8154f30 con 0x7ff5d8068da0 2023-08-17T00:12:01.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.125+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d8153030 con 0x7ff5d8068da0 2023-08-17T00:12:01.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.125+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff5c000f070 con 0x7ff5d8068da0 2023-08-17T00:12:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.129+0000 7ff5d4ff9700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5b805a180 0x7ff5b805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.129+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff5c0075220 con 0x7ff5d8068da0 2023-08-17T00:12:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.129+0000 7ff5d7fff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5b805a180 0x7ff5b805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.129+0000 7ff5d7fff700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5b805a180 0x7ff5b805c640 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7ff5c8000c00 tx=0x7ff5c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.133+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff5c0048f10 con 0x7ff5d8068da0 2023-08-17T00:12:01.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.297+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5d80c6f20 con 0x7ff5d8068da0 2023-08-17T00:12:01.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.301+0000 7ff5d4ff9700 1 -- 172.21.15.153:0/3610244704 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+13770 (secure 0 0 0) 0x7ff5c004c530 con 0x7ff5d8068da0 2023-08-17T00:12:01.305 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:01.305 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:00.491013+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":113,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:01.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.301+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5b805a180 msgr2=0x7ff5b805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.301+0000 7ff5dd639700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5b805a180 0x7ff5b805c640 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7ff5c8000c00 tx=0x7ff5c8009040).stop 2023-08-17T00:12:01.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.301+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 msgr2=0x7ff5d81544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.301+0000 7ff5dd639700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 0x7ff5d81544e0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7ff5c000d260 tx=0x7ff5c0016000).stop 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 shutdown_connections 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff5b805a180 0x7ff5b805c640 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5d8151530 0x7ff5d8153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff5d8068da0 0x7ff5d81544e0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 --2- 172.21.15.153:0/3610244704 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff5d80689c0 0x7ff5d80bc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 >> 172.21.15.153:0/3610244704 conn(0x7ff5d80c6620 msgr2=0x7ff5d80bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:01.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 shutdown_connections 2023-08-17T00:12:01.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.305+0000 7ff5dd639700 1 -- 172.21.15.153:0/3610244704 wait complete. 2023-08-17T00:12:01.328 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:12:01.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:12:01.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.485+0000 7fe1d3fff700 1 Processor -- start 2023-08-17T00:12:01.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.485+0000 7fe1d3fff700 1 -- start start 2023-08-17T00:12:01.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1d4068820 0x7fe1d4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d3fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1d4061fa0 0x7fe1d4062420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d3fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d41585a0 con 0x7fe1d4068820 2023-08-17T00:12:01.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d3fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d4066400 con 0x7fe1d4061fa0 2023-08-17T00:12:01.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d3fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4069170 con 0x7fe1d40a8df0 2023-08-17T00:12:01.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1d4068820 0x7fe1d4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d2ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d2ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d40c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:33534/0 (socket says 172.21.15.153:33534) 2023-08-17T00:12:01.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d2ffd700 1 -- 172.21.15.153:0/2573387303 learned_addr learned my addr 172.21.15.153:0/2573387303 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:01.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe1d4068820 0x7fe1d4068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46432/0 (socket says 172.21.15.153:46432) 2023-08-17T00:12:01.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d37fe700 1 --2- 172.21.15.153:0/2573387303 >> v2:172.21.15.178:3300/0 conn(0x7fe1d4061fa0 0x7fe1d4062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 -- 172.21.15.153:0/2573387303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 msgr2=0x7fe1d40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:01.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 --2- 172.21.15.153:0/2573387303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d40c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 -- 172.21.15.153:0/2573387303 >> v2:172.21.15.178:3300/0 conn(0x7fe1d4061fa0 msgr2=0x7fe1d4062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:01.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 --2- 172.21.15.153:0/2573387303 >> v2:172.21.15.178:3300/0 conn(0x7fe1d4061fa0 0x7fe1d4062420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 -- 172.21.15.153:0/2573387303 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d40b9d30 con 0x7fe1d4068820 2023-08-17T00:12:01.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.489+0000 7fe1d27fc700 1 --2- 172.21.15.153:0/2573387303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4068820 0x7fe1d4068c80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fe1d40c09b0 tx=0x7fe1c8009060).ready entity=mon.0 client_cookie=14ddece3185ef9ac server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d1ffb700 1 -- 172.21.15.153:0/2573387303 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800d4a0 con 0x7fe1d4068820 2023-08-17T00:12:01.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d1ffb700 1 -- 172.21.15.153:0/2573387303 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c800d600 con 0x7fe1d4068820 2023-08-17T00:12:01.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d1ffb700 1 -- 172.21.15.153:0/2573387303 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800d980 con 0x7fe1d4068820 2023-08-17T00:12:01.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 -- 172.21.15.153:0/2573387303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4068820 msgr2=0x7fe1d4068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/2573387303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4068820 0x7fe1d4068c80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7fe1d40c09b0 tx=0x7fe1c8009060).stop 2023-08-17T00:12:01.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 -- 172.21.15.153:0/2573387303 shutdown_connections 2023-08-17T00:12:01.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/2573387303 >> v2:172.21.15.178:3300/0 conn(0x7fe1d4061fa0 0x7fe1d4062420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/2573387303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4068820 0x7fe1d4068c80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/2573387303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d40c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 -- 172.21.15.153:0/2573387303 >> 172.21.15.153:0/2573387303 conn(0x7fe1d40c6620 msgr2=0x7fe1d40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:01.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 -- 172.21.15.153:0/2573387303 shutdown_connections 2023-08-17T00:12:01.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.493+0000 7fe1d3fff700 1 -- 172.21.15.153:0/2573387303 wait complete. 2023-08-17T00:12:01.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 Processor -- start 2023-08-17T00:12:01.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 -- start start 2023-08-17T00:12:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 0x7fe1d40bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1d4068820 0x7fe1d4062420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d4062910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4062e00 con 0x7fe1d4061fa0 2023-08-17T00:12:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d4169350 con 0x7fe1d4068820 2023-08-17T00:12:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d3fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d416cd60 con 0x7fe1d40a8df0 2023-08-17T00:12:01.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 0x7fe1d40bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 0x7fe1d40bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46440/0 (socket says 172.21.15.153:46440) 2023-08-17T00:12:01.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.497+0000 7fe1d2ffd700 1 -- 172.21.15.153:0/1417058694 learned_addr learned my addr 172.21.15.153:0/1417058694 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:01.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d27fc700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1d4068820 0x7fe1d4062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d37fe700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d4062910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d2ffd700 1 -- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 msgr2=0x7fe1d4062910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d2ffd700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d4062910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d2ffd700 1 -- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1d4068820 msgr2=0x7fe1d4062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d2ffd700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1d4068820 0x7fe1d4062420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d2ffd700 1 -- 172.21.15.153:0/1417058694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80092a0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d2ffd700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 0x7fe1d40bffb0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fe1c400e8d0 tx=0x7fe1c4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40094a0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c4012600 con 0x7fe1d4061fa0 2023-08-17T00:12:01.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d4168d00 con 0x7fe1d4061fa0 2023-08-17T00:12:01.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40129a0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d40c04a0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d406b4c0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.501+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe1c4022070 con 0x7fe1d4061fa0 2023-08-17T00:12:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.505+0000 7fe1baffd700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1c005a150 0x7fe1c005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.505+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe1c4073ff0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.505+0000 7fe1d27fc700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1c005a150 0x7fe1c005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.505+0000 7fe1d27fc700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1c005a150 0x7fe1c005c610 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fe1d40c09b0 tx=0x7fe1c8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.509+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1c40a28f0 con 0x7fe1d4061fa0 2023-08-17T00:12:01.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.665+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe1d4064010 con 0x7fe1d4061fa0 2023-08-17T00:12:01.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1baffd700 1 -- 172.21.15.153:0/1417058694 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v122) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe1c4047d20 con 0x7fe1d4061fa0 2023-08-17T00:12:01.673 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:12:01.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1c005a150 msgr2=0x7fe1c005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1c005a150 0x7fe1c005c610 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fe1d40c09b0 tx=0x7fe1c8016000).stop 2023-08-17T00:12:01.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 msgr2=0x7fe1d40bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 0x7fe1d40bffb0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 rx=0x7fe1c400e8d0 tx=0x7fe1c4009060).stop 2023-08-17T00:12:01.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 shutdown_connections 2023-08-17T00:12:01.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1c005a150 0x7fe1c005c610 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1d40a8df0 0x7fe1d4062910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1d4068820 0x7fe1d4062420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 --2- 172.21.15.153:0/1417058694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1d4061fa0 0x7fe1d40bffb0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 >> 172.21.15.153:0/1417058694 conn(0x7fe1d40c6620 msgr2=0x7fe1d4157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:01.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 shutdown_connections 2023-08-17T00:12:01.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.669+0000 7fe1d3fff700 1 -- 172.21.15.153:0/1417058694 wait complete. 2023-08-17T00:12:01.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:12:01.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.857+0000 7f720ffff700 1 Processor -- start 2023-08-17T00:12:01.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.857+0000 7f720ffff700 1 -- start start 2023-08-17T00:12:01.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72100c5ea0 0x7f72100634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72100639a0 0x7f72100bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7210154e90 con 0x7f72100acf30 2023-08-17T00:12:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720ffff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72100c1730 con 0x7f72100c5ea0 2023-08-17T00:12:01.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7210063df0 con 0x7f72100639a0 2023-08-17T00:12:01.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720e7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f72100c5ea0 0x7f72100634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f72100acf30 0x7f72100c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36542/0 (socket says 172.21.15.153:36542) 2023-08-17T00:12:01.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720effd700 1 -- 172.21.15.153:0/2388220521 learned_addr learned my addr 172.21.15.153:0/2388220521 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:01.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720f7fe700 1 --2- 172.21.15.153:0/2388220521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72100639a0 0x7f72100bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720e7fc700 1 -- 172.21.15.153:0/2388220521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72100639a0 msgr2=0x7f72100bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:01.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720e7fc700 1 --2- 172.21.15.153:0/2388220521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72100639a0 0x7f72100bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720e7fc700 1 -- 172.21.15.153:0/2388220521 >> v1:172.21.15.153:6789/0 conn(0x7f72100acf30 legacy=0x7f72100c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720e7fc700 1 -- 172.21.15.153:0/2388220521 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210153fc0 con 0x7f72100c5ea0 2023-08-17T00:12:01.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.861+0000 7f720e7fc700 1 --2- 172.21.15.153:0/2388220521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100c5ea0 0x7f72100634b0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f7204009760 tx=0x7f7204009060).ready entity=mon.0 client_cookie=1b4ea51423359317 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720dffb700 1 -- 172.21.15.153:0/2388220521 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72040090d0 con 0x7f72100c5ea0 2023-08-17T00:12:01.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720dffb700 1 -- 172.21.15.153:0/2388220521 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f720400b580 con 0x7f72100c5ea0 2023-08-17T00:12:01.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720dffb700 1 -- 172.21.15.153:0/2388220521 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720400b900 con 0x7f72100c5ea0 2023-08-17T00:12:01.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 -- 172.21.15.153:0/2388220521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100c5ea0 msgr2=0x7f72100634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 --2- 172.21.15.153:0/2388220521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100c5ea0 0x7f72100634b0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7f7204009760 tx=0x7f7204009060).stop 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 -- 172.21.15.153:0/2388220521 shutdown_connections 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 --2- 172.21.15.153:0/2388220521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72100639a0 0x7f72100bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 --2- 172.21.15.153:0/2388220521 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100c5ea0 0x7f72100634b0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 -- 172.21.15.153:0/2388220521 >> 172.21.15.153:0/2388220521 conn(0x7f72100cb330 msgr2=0x7f72100c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 -- 172.21.15.153:0/2388220521 shutdown_connections 2023-08-17T00:12:01.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 -- 172.21.15.153:0/2388220521 wait complete. 2023-08-17T00:12:01.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 Processor -- start 2023-08-17T00:12:01.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.865+0000 7f720ffff700 1 -- start start 2023-08-17T00:12:01.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 0x7f7210164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72100acf30 0x7f72100ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72101650b0 0x7f72100ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100c3240 con 0x7f72100639a0 2023-08-17T00:12:01.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72100c2230 con 0x7f72100acf30 2023-08-17T00:12:01.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72100c2db0 con 0x7f72101650b0 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 0x7f7210164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 0x7f7210164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46456/0 (socket says 172.21.15.153:46456) 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 -- 172.21.15.153:0/4195663074 learned_addr learned my addr 172.21.15.153:0/4195663074 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720f7fe700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72101650b0 0x7f72100ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720e7fc700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72100acf30 0x7f72100ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 -- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72101650b0 msgr2=0x7f72100ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72101650b0 0x7f72100ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 -- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72100acf30 msgr2=0x7f72100ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:01.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72100acf30 0x7f72100ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:01.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 -- 172.21.15.153:0/4195663074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72040092a0 con 0x7f72100639a0 2023-08-17T00:12:01.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720e7fc700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72100acf30 0x7f72100ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:01.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720effd700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 0x7f7210164bc0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f7200007fd0 tx=0x7f7200007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000072e0 con 0x7f72100639a0 2023-08-17T00:12:01.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7200007440 con 0x7f72100639a0 2023-08-17T00:12:01.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72000057a0 con 0x7f72100639a0 2023-08-17T00:12:01.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72100c2480 con 0x7f72100639a0 2023-08-17T00:12:01.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.869+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72100c2a40 con 0x7f72100639a0 2023-08-17T00:12:01.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.873+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72101594e0 con 0x7f72100639a0 2023-08-17T00:12:01.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.873+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7200010070 con 0x7f72100639a0 2023-08-17T00:12:01.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.873+0000 7f71f6ffd700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f71fc05a150 0x7f71fc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:01.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.873+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f72000732f0 con 0x7f72100639a0 2023-08-17T00:12:01.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.873+0000 7f720e7fc700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f71fc05a150 0x7f71fc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:01.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.877+0000 7f720e7fc700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f71fc05a150 0x7f71fc05c610 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7210167940 tx=0x7f7204017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:01.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:01.881+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f72101594e0 con 0x7f72100639a0 2023-08-17T00:12:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.045+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72100c1510 con 0x7f72100639a0 2023-08-17T00:12:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.045+0000 7f71f6ffd700 1 -- 172.21.15.153:0/4195663074 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v122) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72100c1510 con 0x7f72100639a0 2023-08-17T00:12:02.050 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:12:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f71fc05a150 msgr2=0x7f71fc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f71fc05a150 0x7f71fc05c610 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f7210167940 tx=0x7f7204017000).stop 2023-08-17T00:12:02.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 msgr2=0x7f7210164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 0x7f7210164bc0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 rx=0x7f7200007fd0 tx=0x7f7200007df0).stop 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 shutdown_connections 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f71fc05a150 0x7f71fc05c610 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72101650b0 0x7f72100ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f72100acf30 0x7f72100ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 --2- 172.21.15.153:0/4195663074 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f72100639a0 0x7f7210164bc0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 >> 172.21.15.153:0/4195663074 conn(0x7f72100cb330 msgr2=0x7f7210152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 shutdown_connections 2023-08-17T00:12:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.049+0000 7f720ffff700 1 -- 172.21.15.153:0/4195663074 wait complete. 2023-08-17T00:12:02.072 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:12:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.229+0000 7fbf526db700 1 Processor -- start 2023-08-17T00:12:02.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.229+0000 7fbf526db700 1 -- start start 2023-08-17T00:12:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf526db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbf4c153e90 0x7fbf4c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf526db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf4c0c7980 0x7fbf4c0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf526db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf4c0aa750 con 0x7fbf4c153ab0 2023-08-17T00:12:02.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf526db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c9dd0 con 0x7fbf4c153e90 2023-08-17T00:12:02.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf526db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf4c0aacf0 con 0x7fbf4c0c7980 2023-08-17T00:12:02.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf4bfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fbf4c153ab0 0x7fbf4c0c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42946/0 (socket says 172.21.15.153:42946) 2023-08-17T00:12:02.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf4bfff700 1 -- 172.21.15.153:0/2137606870 learned_addr learned my addr 172.21.15.153:0/2137606870 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:02.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf43fff700 1 --2- 172.21.15.153:0/2137606870 >> v2:172.21.15.153:3300/0 conn(0x7fbf4c153e90 0x7fbf4c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf50c78700 1 --2- 172.21.15.153:0/2137606870 >> v2:172.21.15.178:3300/0 conn(0x7fbf4c0c7980 0x7fbf4c0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf4b7fe700 1 -- 172.21.15.153:0/2137606870 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1028512002 0 0) 0x7fbf4c0aa750 con 0x7fbf4c153ab0 2023-08-17T00:12:02.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf4b7fe700 1 -- 172.21.15.153:0/2137606870 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf380033f0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf43fff700 1 -- 172.21.15.153:0/2137606870 >> v2:172.21.15.178:3300/0 conn(0x7fbf4c0c7980 msgr2=0x7fbf4c0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:02.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf43fff700 1 --2- 172.21.15.153:0/2137606870 >> v2:172.21.15.178:3300/0 conn(0x7fbf4c0c7980 0x7fbf4c0ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf43fff700 1 -- 172.21.15.153:0/2137606870 >> v1:172.21.15.178:6789/0 conn(0x7fbf4c153ab0 legacy=0x7fbf4c0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf43fff700 1 -- 172.21.15.153:0/2137606870 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c1542f0 con 0x7fbf4c153e90 2023-08-17T00:12:02.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.233+0000 7fbf43fff700 1 --2- 172.21.15.153:0/2137606870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153e90 0x7fbf4c0c7490 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fbf4c05ea10 tx=0x7fbf34009060).ready entity=mon.0 client_cookie=7285e96c21297aef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:02.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf4b7fe700 1 -- 172.21.15.153:0/2137606870 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340090d0 con 0x7fbf4c153e90 2023-08-17T00:12:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf4b7fe700 1 -- 172.21.15.153:0/2137606870 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3400d4a0 con 0x7fbf4c153e90 2023-08-17T00:12:02.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf4b7fe700 1 -- 172.21.15.153:0/2137606870 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3400d820 con 0x7fbf4c153e90 2023-08-17T00:12:02.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 -- 172.21.15.153:0/2137606870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153e90 msgr2=0x7fbf4c0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 --2- 172.21.15.153:0/2137606870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153e90 0x7fbf4c0c7490 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fbf4c05ea10 tx=0x7fbf34009060).stop 2023-08-17T00:12:02.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 -- 172.21.15.153:0/2137606870 shutdown_connections 2023-08-17T00:12:02.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 --2- 172.21.15.153:0/2137606870 >> v2:172.21.15.178:3300/0 conn(0x7fbf4c0c7980 0x7fbf4c0ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 --2- 172.21.15.153:0/2137606870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153e90 0x7fbf4c0c7490 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 -- 172.21.15.153:0/2137606870 >> 172.21.15.153:0/2137606870 conn(0x7fbf4c061fa0 msgr2=0x7fbf4c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:02.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 -- 172.21.15.153:0/2137606870 shutdown_connections 2023-08-17T00:12:02.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 -- 172.21.15.153:0/2137606870 wait complete. 2023-08-17T00:12:02.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 Processor -- start 2023-08-17T00:12:02.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.237+0000 7fbf526db700 1 -- start start 2023-08-17T00:12:02.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf4c0c7980 0x7fbf4c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 0x7fbf4c0ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4c153e90 0x7fbf4c0ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c34f0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0aed30 con 0x7fbf4c0c7980 2023-08-17T00:12:02.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4c0c28e0 con 0x7fbf4c153e90 2023-08-17T00:12:02.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 0x7fbf4c0ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 0x7fbf4c0ae350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46464/0 (socket says 172.21.15.153:46464) 2023-08-17T00:12:02.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 -- 172.21.15.153:0/952257078 learned_addr learned my addr 172.21.15.153:0/952257078 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:02.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf4bfff700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf4c0c7980 0x7fbf4c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf50c78700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4c153e90 0x7fbf4c0ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 -- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4c153e90 msgr2=0x7fbf4c0ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4c153e90 0x7fbf4c0ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 -- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf4c0c7980 msgr2=0x7fbf4c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf4c0c7980 0x7fbf4c14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 -- 172.21.15.153:0/952257078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340092a0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf43fff700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 0x7fbf4c0ae350 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fbf4c0c1a50 tx=0x7fbf34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:02.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf340128a0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf34012a00 con 0x7fbf4c153ab0 2023-08-17T00:12:02.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf4c0c2bc0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34012dc0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.241+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf4c0c3180 con 0x7fbf4c153ab0 2023-08-17T00:12:02.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.245+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4c06b530 con 0x7fbf4c153ab0 2023-08-17T00:12:02.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.245+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbf3400f070 con 0x7fbf4c153ab0 2023-08-17T00:12:02.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.245+0000 7fbf48ff9700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf2c05a150 0x7fbf2c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.245+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fbf340752f0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.245+0000 7fbf4bfff700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf2c05a150 0x7fbf2c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.249+0000 7fbf4bfff700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf2c05a150 0x7fbf2c05c610 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fbf3c005750 tx=0x7fbf3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:02.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.253+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbf34048fe0 con 0x7fbf4c153ab0 2023-08-17T00:12:02.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbf4c063010 con 0x7fbf4c153ab0 2023-08-17T00:12:02.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf48ff9700 1 -- 172.21.15.153:0/952257078 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v122) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbf3404c600 con 0x7fbf4c153ab0 2023-08-17T00:12:02.417 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:02.417 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:12:02.418 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:02.419 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:12:02.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf2c05a150 msgr2=0x7fbf2c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf2c05a150 0x7fbf2c05c610 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7fbf3c005750 tx=0x7fbf3c009040).stop 2023-08-17T00:12:02.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 msgr2=0x7fbf4c0ae350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 0x7fbf4c0ae350 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fbf4c0c1a50 tx=0x7fbf34016000).stop 2023-08-17T00:12:02.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 shutdown_connections 2023-08-17T00:12:02.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbf2c05a150 0x7fbf2c05c610 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf4c153e90 0x7fbf4c0ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbf4c153ab0 0x7fbf4c0ae350 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 --2- 172.21.15.153:0/952257078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf4c0c7980 0x7fbf4c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.413+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 >> 172.21.15.153:0/952257078 conn(0x7fbf4c061fa0 msgr2=0x7fbf4c063590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.417+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 shutdown_connections 2023-08-17T00:12:02.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.417+0000 7fbf526db700 1 -- 172.21.15.153:0/952257078 wait complete. 2023-08-17T00:12:02.439 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:12:02.440 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:12:02.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d9f9700 1 Processor -- start 2023-08-17T00:12:02.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d9f9700 1 -- start start 2023-08-17T00:12:02.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d9f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4688150330 0x7f4688063270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d9f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46880c0b40 con 0x7f46880c29c0 2023-08-17T00:12:02.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d9f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4688151210 con 0x7f4688150710 2023-08-17T00:12:02.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d9f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46881514f0 con 0x7f4688150330 2023-08-17T00:12:02.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d1f8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46880c29c0 0x7f46880c0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36550/0 (socket says 172.21.15.153:36550) 2023-08-17T00:12:02.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468d1f8700 1 -- 172.21.15.153:0/4077175630 learned_addr learned my addr 172.21.15.153:0/4077175630 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:02.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.609+0000 7f468c9f7700 1 --2- 172.21.15.153:0/4077175630 >> v2:172.21.15.153:3300/0 conn(0x7f4688150330 0x7f4688063270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f46877fe700 1 -- 172.21.15.153:0/4077175630 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782283666 0 0) 0x7f46880c0b40 con 0x7f46880c29c0 2023-08-17T00:12:02.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f46877fe700 1 -- 172.21.15.153:0/4077175630 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46780033f0 con 0x7f46880c29c0 2023-08-17T00:12:02.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f46877fe700 1 -- 172.21.15.153:0/4077175630 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651918370 0 0) 0x7f4688151210 con 0x7f4688150710 2023-08-17T00:12:02.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468c9f7700 1 -- 172.21.15.153:0/4077175630 >> v1:172.21.15.178:6789/0 conn(0x7f4688150710 legacy=0x7f46880c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468c9f7700 1 -- 172.21.15.153:0/4077175630 >> v1:172.21.15.153:6789/0 conn(0x7f46880c29c0 legacy=0x7f46880c0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468c9f7700 1 -- 172.21.15.153:0/4077175630 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46881517d0 con 0x7f4688150330 2023-08-17T00:12:02.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468c9f7700 1 --2- 172.21.15.153:0/4077175630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688150330 0x7f4688063270 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f467c009760 tx=0x7f467c009060).ready entity=mon.0 client_cookie=cb5444db659b9b01 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:02.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f46877fe700 1 -- 172.21.15.153:0/4077175630 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00f510 con 0x7f4688150330 2023-08-17T00:12:02.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f46877fe700 1 -- 172.21.15.153:0/4077175630 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c00f670 con 0x7f4688150330 2023-08-17T00:12:02.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f46877fe700 1 -- 172.21.15.153:0/4077175630 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00f9f0 con 0x7f4688150330 2023-08-17T00:12:02.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 -- 172.21.15.153:0/4077175630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688150330 msgr2=0x7f4688063270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 --2- 172.21.15.153:0/4077175630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688150330 0x7f4688063270 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f467c009760 tx=0x7f467c009060).stop 2023-08-17T00:12:02.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 -- 172.21.15.153:0/4077175630 shutdown_connections 2023-08-17T00:12:02.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 --2- 172.21.15.153:0/4077175630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4688150330 0x7f4688063270 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:02.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 -- 172.21.15.153:0/4077175630 >> 172.21.15.153:0/4077175630 conn(0x7f46880c6ee0 msgr2=0x7f46880c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:02.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 -- 172.21.15.153:0/4077175630 shutdown_connections 2023-08-17T00:12:02.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.613+0000 7f468d9f9700 1 -- 172.21.15.153:0/4077175630 wait complete. 2023-08-17T00:12:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.617+0000 7f468d9f9700 1 Processor -- start 2023-08-17T00:12:02.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.617+0000 7f468d9f9700 1 -- start start 2023-08-17T00:12:02.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 0x7f468814d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4688150330 0x7f46880a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4688150710 0x7f4688061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a9730 con 0x7f46880c29c0 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a6820 con 0x7f4688150710 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46880a6b00 con 0x7f4688150330 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 0x7f468814d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 0x7f468814d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46478/0 (socket says 172.21.15.153:46478) 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 -- 172.21.15.153:0/2711520937 learned_addr learned my addr 172.21.15.153:0/2711520937 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 -- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4688150330 msgr2=0x7f46880a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4688150330 0x7f46880a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 -- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4688150710 msgr2=0x7f4688061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4688150710 0x7f4688061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 -- 172.21.15.153:0/2711520937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0092a0 con 0x7f46880c29c0 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468c9f7700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 0x7f468814d760 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f467c009e00 tx=0x7f467c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:02.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00f7e0 con 0x7f46880c29c0 2023-08-17T00:12:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c00f940 con 0x7f46880c29c0 2023-08-17T00:12:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c01b620 con 0x7f46880c29c0 2023-08-17T00:12:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46880a6de0 con 0x7f46880c29c0 2023-08-17T00:12:02.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.621+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468814dc50 con 0x7f46880c29c0 2023-08-17T00:12:02.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.625+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4688046dd0 con 0x7f46880c29c0 2023-08-17T00:12:02.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.625+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f467c00f070 con 0x7f46880c29c0 2023-08-17T00:12:02.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.625+0000 7f4684ff9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f466c05e590 0x7f466c060a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:02.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.625+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f467c075860 con 0x7f46880c29c0 2023-08-17T00:12:02.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.625+0000 7f4687fff700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f466c05e590 0x7f466c060a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:02.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.629+0000 7f4687fff700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f466c05e590 0x7f466c060a50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f46880c5110 tx=0x7f46740079a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:02.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.629+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f467c0495e0 con 0x7f46880c29c0 2023-08-17T00:12:02.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:02.789+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f4688151ab0 con 0x7f46880c29c0 2023-08-17T00:12:03.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.409+0000 7f4684ff9700 1 -- 172.21.15.153:0/2711520937 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v123) v1 ==== 152+0+0 (secure 0 0 0) 0x7f467c028070 con 0x7f46880c29c0 2023-08-17T00:12:03.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f466c05e590 msgr2=0x7f466c060a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f466c05e590 0x7f466c060a50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f46880c5110 tx=0x7f46740079a0).stop 2023-08-17T00:12:03.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 msgr2=0x7f468814d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 0x7f468814d760 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f467c009e00 tx=0x7f467c017000).stop 2023-08-17T00:12:03.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 shutdown_connections 2023-08-17T00:12:03.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f466c05e590 0x7f466c060a50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:03.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4688150710 0x7f4688061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:03.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4688150330 0x7f46880a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:03.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 --2- 172.21.15.153:0/2711520937 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f46880c29c0 0x7f468814d760 secure :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0x7f467c009e00 tx=0x7f467c017000).stop 2023-08-17T00:12:03.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.417+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 >> 172.21.15.153:0/2711520937 conn(0x7f46880c6ee0 msgr2=0x7f46880bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.421+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 shutdown_connections 2023-08-17T00:12:03.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.421+0000 7f468d9f9700 1 -- 172.21.15.153:0/2711520937 wait complete. 2023-08-17T00:12:03.428 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:12:03.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:12:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.613+0000 7f6e8541b700 1 Processor -- start 2023-08-17T00:12:03.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.613+0000 7f6e8541b700 1 -- start start 2023-08-17T00:12:03.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.613+0000 7f6e8541b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800675f0 0x7f6e8014e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.613+0000 7f6e8541b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e801540a0 con 0x7f6e800c7150 2023-08-17T00:12:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.613+0000 7f6e8541b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e80154c10 con 0x7f6e8014de30 2023-08-17T00:12:03.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.613+0000 7f6e8541b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e801550a0 con 0x7f6e800675f0 2023-08-17T00:12:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6e800c7150 0x7f6e80066ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36552/0 (socket says 172.21.15.153:36552) 2023-08-17T00:12:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7e7fc700 1 -- 172.21.15.153:0/735616968 learned_addr learned my addr 172.21.15.153:0/735616968 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:03.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7f7fe700 1 --2- 172.21.15.153:0/735616968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800675f0 0x7f6e8014e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7dffb700 1 -- 172.21.15.153:0/735616968 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342682989 0 0) 0x7f6e74001110 con 0x7f6e800c7150 2023-08-17T00:12:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7dffb700 1 -- 172.21.15.153:0/735616968 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e680033f0 con 0x7f6e800c7150 2023-08-17T00:12:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/735616968 >> v1:172.21.15.178:6789/0 conn(0x7f6e8014de30 legacy=0x7f6e800c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7dffb700 1 -- 172.21.15.153:0/735616968 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003810653 0 0) 0x7f6e80154c10 con 0x7f6e8014de30 2023-08-17T00:12:03.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/735616968 >> v1:172.21.15.153:6789/0 conn(0x7f6e800c7150 legacy=0x7f6e80066ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/735616968 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e801542e0 con 0x7f6e800675f0 2023-08-17T00:12:03.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7f7fe700 1 --2- 172.21.15.153:0/735616968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800675f0 0x7f6e8014e210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6e78009e90 tx=0x7f6e78009780).ready entity=mon.2 client_cookie=f0038ddeb2a3a625 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7dffb700 1 -- 172.21.15.153:0/735616968 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800e070 con 0x7f6e800675f0 2023-08-17T00:12:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7dffb700 1 -- 172.21.15.153:0/735616968 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800bb60 con 0x7f6e800675f0 2023-08-17T00:12:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e7dffb700 1 -- 172.21.15.153:0/735616968 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800bee0 con 0x7f6e800675f0 2023-08-17T00:12:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e8541b700 1 -- 172.21.15.153:0/735616968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800675f0 msgr2=0x7f6e8014e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e8541b700 1 --2- 172.21.15.153:0/735616968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800675f0 0x7f6e8014e210 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f6e78009e90 tx=0x7f6e78009780).stop 2023-08-17T00:12:03.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e8541b700 1 -- 172.21.15.153:0/735616968 shutdown_connections 2023-08-17T00:12:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e8541b700 1 --2- 172.21.15.153:0/735616968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800675f0 0x7f6e8014e210 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.617+0000 7f6e8541b700 1 -- 172.21.15.153:0/735616968 >> 172.21.15.153:0/735616968 conn(0x7f6e800c4250 msgr2=0x7f6e800c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.621+0000 7f6e8541b700 1 -- 172.21.15.153:0/735616968 shutdown_connections 2023-08-17T00:12:03.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.621+0000 7f6e8541b700 1 -- 172.21.15.153:0/735616968 wait complete. 2023-08-17T00:12:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.621+0000 7f6e8541b700 1 Processor -- start 2023-08-17T00:12:03.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.621+0000 7f6e8541b700 1 -- start start 2023-08-17T00:12:03.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e800675f0 0x7f6e80167e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:03.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800c7150 0x7f6e8014a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:03.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 0x7f6e800a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:03.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800aa140 con 0x7f6e8014de30 2023-08-17T00:12:03.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800aac30 con 0x7f6e800675f0 2023-08-17T00:12:03.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e800aa900 con 0x7f6e800c7150 2023-08-17T00:12:03.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 0x7f6e800a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:03.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e800675f0 0x7f6e80167e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:03.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 0x7f6e800a9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46484/0 (socket says 172.21.15.153:46484) 2023-08-17T00:12:03.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/3353768651 learned_addr learned my addr 172.21.15.153:0/3353768651 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:03.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7e7fc700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800c7150 0x7f6e8014a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800c7150 msgr2=0x7f6e8014a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800c7150 0x7f6e8014a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e800675f0 msgr2=0x7f6e80167e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e800675f0 0x7f6e80167e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:03.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 -- 172.21.15.153:0/3353768651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78009a20 con 0x7f6e8014de30 2023-08-17T00:12:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e7f7fe700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 0x7f6e800a9360 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f6e80068490 tx=0x7f6e78009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78021070 con 0x7f6e8014de30 2023-08-17T00:12:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7801d630 con 0x7f6e8014de30 2023-08-17T00:12:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7801d9f0 con 0x7f6e8014de30 2023-08-17T00:12:03.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.625+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e800a9b80 con 0x7f6e8014de30 2023-08-17T00:12:03.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.629+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e800a9850 con 0x7f6e8014de30 2023-08-17T00:12:03.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.629+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e800aa760 con 0x7f6e8014de30 2023-08-17T00:12:03.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.629+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6e7801dd60 con 0x7f6e8014de30 2023-08-17T00:12:03.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.633+0000 7f6e66ffd700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e6c05a150 0x7f6e6c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:03.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.633+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f6e78076150 con 0x7f6e8014de30 2023-08-17T00:12:03.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.633+0000 7f6e7effd700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e6c05a150 0x7f6e6c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:03.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.633+0000 7f6e7effd700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e6c05a150 0x7f6e6c05c610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f6e700038c0 tx=0x7f6e70007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.641+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e800aa760 con 0x7f6e8014de30 2023-08-17T00:12:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:03.801+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6e800aa760 con 0x7f6e8014de30 2023-08-17T00:12:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.421+0000 7f6e66ffd700 1 -- 172.21.15.153:0/3353768651 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v124) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6e800aa760 con 0x7f6e8014de30 2023-08-17T00:12:04.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.429+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e6c05a150 msgr2=0x7f6e6c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.429+0000 7f6e8541b700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e6c05a150 0x7f6e6c05c610 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f6e700038c0 tx=0x7f6e70007d40).stop 2023-08-17T00:12:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.429+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 msgr2=0x7f6e800a9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.429+0000 7f6e8541b700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 0x7f6e800a9360 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f6e80068490 tx=0x7f6e78009780).stop 2023-08-17T00:12:04.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.433+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 shutdown_connections 2023-08-17T00:12:04.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.433+0000 7f6e8541b700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e6c05a150 0x7f6e6c05c610 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.433+0000 7f6e8541b700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6e8014de30 0x7f6e800a9360 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.433+0000 7f6e8541b700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e800c7150 0x7f6e8014a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.433+0000 7f6e8541b700 1 --2- 172.21.15.153:0/3353768651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e800675f0 0x7f6e80167e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.433+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 >> 172.21.15.153:0/3353768651 conn(0x7f6e800c4250 msgr2=0x7f6e8014d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:04.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.437+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 shutdown_connections 2023-08-17T00:12:04.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.437+0000 7f6e8541b700 1 -- 172.21.15.153:0/3353768651 wait complete. 2023-08-17T00:12:04.448 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:12:04.471 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:12:04.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.629+0000 7fe729fb9700 1 Processor -- start 2023-08-17T00:12:04.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.629+0000 7fe729fb9700 1 -- start start 2023-08-17T00:12:04.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe729fb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe724153f50 0x7fe724154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:04.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe729fb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7240bfd10 con 0x7fe7240c57a0 2023-08-17T00:12:04.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe729fb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe724154860 con 0x7fe7240c01a0 2023-08-17T00:12:04.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe729fb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe724154af0 con 0x7fe724153f50 2023-08-17T00:12:04.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe728fb7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe7240c57a0 0x7fe7240c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:36566/0 (socket says 172.21.15.153:36566) 2023-08-17T00:12:04.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe728fb7700 1 -- 172.21.15.153:0/1273529352 learned_addr learned my addr 172.21.15.153:0/1273529352 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:04.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe723fff700 1 --2- 172.21.15.153:0/1273529352 >> v2:172.21.15.178:3300/0 conn(0x7fe724153f50 0x7fe724154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:04.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127526881 0 0) 0x7fe7240bfd10 con 0x7fe7240c57a0 2023-08-17T00:12:04.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7140033f0 con 0x7fe7240c57a0 2023-08-17T00:12:04.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891857956 0 0) 0x7fe724154860 con 0x7fe7240c01a0 2023-08-17T00:12:04.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7240bfd10 con 0x7fe7240c01a0 2023-08-17T00:12:04.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe723fff700 1 -- 172.21.15.153:0/1273529352 >> v1:172.21.15.178:6789/0 conn(0x7fe7240c01a0 legacy=0x7fe7240c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe723fff700 1 -- 172.21.15.153:0/1273529352 >> v1:172.21.15.153:6789/0 conn(0x7fe7240c57a0 legacy=0x7fe7240c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.633+0000 7fe723fff700 1 -- 172.21.15.153:0/1273529352 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe724154dd0 con 0x7fe724153f50 2023-08-17T00:12:04.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe723fff700 1 --2- 172.21.15.153:0/1273529352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe724153f50 0x7fe724154370 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe710009760 tx=0x7fe710009060).ready entity=mon.1 client_cookie=25614e7399467187 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:04.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000d4a0 con 0x7fe724153f50 2023-08-17T00:12:04.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71000d600 con 0x7fe724153f50 2023-08-17T00:12:04.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe7237fe700 1 -- 172.21.15.153:0/1273529352 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000d980 con 0x7fe724153f50 2023-08-17T00:12:04.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 -- 172.21.15.153:0/1273529352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe724153f50 msgr2=0x7fe724154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1273529352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe724153f50 0x7fe724154370 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe710009760 tx=0x7fe710009060).stop 2023-08-17T00:12:04.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 -- 172.21.15.153:0/1273529352 shutdown_connections 2023-08-17T00:12:04.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1273529352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe724153f50 0x7fe724154370 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 -- 172.21.15.153:0/1273529352 >> 172.21.15.153:0/1273529352 conn(0x7fe724062a70 msgr2=0x7fe7240ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:04.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 -- 172.21.15.153:0/1273529352 shutdown_connections 2023-08-17T00:12:04.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.637+0000 7fe729fb9700 1 -- 172.21.15.153:0/1273529352 wait complete. 2023-08-17T00:12:04.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 Processor -- start 2023-08-17T00:12:04.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 -- start start 2023-08-17T00:12:04.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 0x7fe7240c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:04.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7240c57a0 0x7fe7240af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:04.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe724153f50 0x7fe7240afe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:04.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240b0360 con 0x7fe7240c01a0 2023-08-17T00:12:04.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240c2cd0 con 0x7fe7240c57a0 2023-08-17T00:12:04.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe729fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240c1e30 con 0x7fe724153f50 2023-08-17T00:12:04.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe728fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 0x7fe7240c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:04.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe728fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 0x7fe7240c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:46490/0 (socket says 172.21.15.153:46490) 2023-08-17T00:12:04.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.641+0000 7fe728fb7700 1 -- 172.21.15.153:0/1212824202 learned_addr learned my addr 172.21.15.153:0/1212824202 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:04.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe723fff700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7240c57a0 0x7fe7240af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:04.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe7297b8700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe724153f50 0x7fe7240afe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:04.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe728fb7700 1 -- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe724153f50 msgr2=0x7fe7240afe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe728fb7700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe724153f50 0x7fe7240afe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe728fb7700 1 -- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7240c57a0 msgr2=0x7fe7240af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe728fb7700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7240c57a0 0x7fe7240af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe728fb7700 1 -- 172.21.15.153:0/1212824202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7100092a0 con 0x7fe7240c01a0 2023-08-17T00:12:04.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe723fff700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7240c57a0 0x7fe7240af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:04.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe7297b8700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe724153f50 0x7fe7240afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:04.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe728fb7700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 0x7fe7240c1940 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fe71800c470 tx=0x7fe718007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:04.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180072e0 con 0x7fe7240c01a0 2023-08-17T00:12:04.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe718007440 con 0x7fe7240c01a0 2023-08-17T00:12:04.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7240c20c0 con 0x7fe7240c01a0 2023-08-17T00:12:04.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7180057a0 con 0x7fe7240c01a0 2023-08-17T00:12:04.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7240c2680 con 0x7fe7240c01a0 2023-08-17T00:12:04.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.645+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe72406b4c0 con 0x7fe7240c01a0 2023-08-17T00:12:04.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.649+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe718010070 con 0x7fe7240c01a0 2023-08-17T00:12:04.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.653+0000 7fe720ff9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe70805a150 0x7fe70805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:04.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.653+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fe718073ba0 con 0x7fe7240c01a0 2023-08-17T00:12:04.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.653+0000 7fe723fff700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe70805a150 0x7fe70805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:04.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.653+0000 7fe723fff700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe70805a150 0x7fe70805c610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fe7240b0540 tx=0x7fe710016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:04.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.657+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe718047730 con 0x7fe7240c01a0 2023-08-17T00:12:04.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.849+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe7240bf9a0 con 0x7fe7240c01a0 2023-08-17T00:12:04.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.861+0000 7fe720ff9700 1 -- 172.21.15.153:0/1212824202 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v97) v1 ==== 174+0+0 (secure 0 0 0) 0x7fe718007e60 con 0x7fe7240c01a0 2023-08-17T00:12:04.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.873+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe70805a150 msgr2=0x7fe70805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.873+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe70805a150 0x7fe70805c610 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fe7240b0540 tx=0x7fe710016000).stop 2023-08-17T00:12:04.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.873+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 msgr2=0x7fe7240c1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:04.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.873+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 0x7fe7240c1940 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 rx=0x7fe71800c470 tx=0x7fe718007d20).stop 2023-08-17T00:12:04.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 shutdown_connections 2023-08-17T00:12:04.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe70805a150 0x7fe70805c610 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe724153f50 0x7fe7240afe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7240c57a0 0x7fe7240af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 --2- 172.21.15.153:0/1212824202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe7240c01a0 0x7fe7240c1940 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:04.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 >> 172.21.15.153:0/1212824202 conn(0x7fe724062a70 msgr2=0x7fe7240c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:04.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.877+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 shutdown_connections 2023-08-17T00:12:04.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:04.881+0000 7fe729fb9700 1 -- 172.21.15.153:0/1212824202 wait complete. 2023-08-17T00:12:04.895 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 17 and data pool 18 2023-08-17T00:12:04.913 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:05.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.061+0000 7fdb1e48f700 1 Processor -- start 2023-08-17T00:12:05.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.061+0000 7fdb1e48f700 1 -- start start 2023-08-17T00:12:05.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1e48f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb18153740 0x7fdb18068f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1e48f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18063d90 0x7fdb18067e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1e48f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb18063900 con 0x7fdb18153b20 2023-08-17T00:12:05.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1e48f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb180c45d0 con 0x7fdb18153740 2023-08-17T00:12:05.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1e48f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180c43e0 con 0x7fdb18063d90 2023-08-17T00:12:05.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb18153740 0x7fdb18068f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdb18153740 0x7fdb18068f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54622/0 (socket says 172.21.15.153:54622) 2023-08-17T00:12:05.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 -- 172.21.15.153:0/733790673 learned_addr learned my addr 172.21.15.153:0/733790673 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:05.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 -- 172.21.15.153:0/733790673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18063d90 msgr2=0x7fdb18067e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:05.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1dc8e700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18063d90 0x7fdb18067e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18063d90 0x7fdb18067e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 -- 172.21.15.153:0/733790673 >> v1:172.21.15.178:6789/0 conn(0x7fdb18153b20 legacy=0x7fdb180c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:05.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 -- 172.21.15.153:0/733790673 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18064220 con 0x7fdb18153740 2023-08-17T00:12:05.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1dc8e700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18063d90 0x7fdb18067e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:05.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb1d48d700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb18068f20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fdb14006fd0 tx=0x7fdb140090f0).ready entity=mon.0 client_cookie=762e0437b577a1a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb0ffff700 1 -- 172.21.15.153:0/733790673 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400b600 con 0x7fdb18153740 2023-08-17T00:12:05.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb0ffff700 1 -- 172.21.15.153:0/733790673 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400b760 con 0x7fdb18153740 2023-08-17T00:12:05.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.065+0000 7fdb0ffff700 1 -- 172.21.15.153:0/733790673 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400bb00 con 0x7fdb18153740 2023-08-17T00:12:05.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 -- 172.21.15.153:0/733790673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 msgr2=0x7fdb18068f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb18068f20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7fdb14006fd0 tx=0x7fdb140090f0).stop 2023-08-17T00:12:05.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 -- 172.21.15.153:0/733790673 shutdown_connections 2023-08-17T00:12:05.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18063d90 0x7fdb18067e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/733790673 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb18068f20 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 -- 172.21.15.153:0/733790673 >> 172.21.15.153:0/733790673 conn(0x7fdb180c9160 msgr2=0x7fdb180c5130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:05.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 -- 172.21.15.153:0/733790673 shutdown_connections 2023-08-17T00:12:05.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 -- 172.21.15.153:0/733790673 wait complete. 2023-08-17T00:12:05.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 Processor -- start 2023-08-17T00:12:05.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.069+0000 7fdb1e48f700 1 -- start start 2023-08-17T00:12:05.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb18063d90 0x7fdb180aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb180adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18153b20 0x7fdb18167870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb181459e0 con 0x7fdb18153740 2023-08-17T00:12:05.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180c0df0 con 0x7fdb18063d90 2023-08-17T00:12:05.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb180c01e0 con 0x7fdb18153b20 2023-08-17T00:12:05.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb180adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1dc8e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18153b20 0x7fdb18167870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb180adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54634/0 (socket says 172.21.15.153:54634) 2023-08-17T00:12:05.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 -- 172.21.15.153:0/204928720 learned_addr learned my addr 172.21.15.153:0/204928720 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:05.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1d48d700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb18063d90 0x7fdb180aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 -- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18153b20 msgr2=0x7fdb18167870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18153b20 0x7fdb18167870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 -- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb18063d90 msgr2=0x7fdb180aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb18063d90 0x7fdb180aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 -- 172.21.15.153:0/204928720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009370 con 0x7fdb18153740 2023-08-17T00:12:05.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1cc8c700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb180adfe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fdb0800c440 tx=0x7fdb08007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08007020 con 0x7fdb18153740 2023-08-17T00:12:05.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08007180 con 0x7fdb18153740 2023-08-17T00:12:05.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb180c04c0 con 0x7fdb18153740 2023-08-17T00:12:05.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08007520 con 0x7fdb18153740 2023-08-17T00:12:05.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.073+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb180c0a80 con 0x7fdb18153740 2023-08-17T00:12:05.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.077+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb180c0fa0 con 0x7fdb18153740 2023-08-17T00:12:05.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.077+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdb08010070 con 0x7fdb18153740 2023-08-17T00:12:05.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.077+0000 7fdb0d7fa700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdafc05a180 0x7fdafc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.077+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdb08073280 con 0x7fdb18153740 2023-08-17T00:12:05.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.077+0000 7fdb1d48d700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdafc05a180 0x7fdafc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.081+0000 7fdb1d48d700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdafc05a180 0x7fdafc05c640 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fdb1400b3c0 tx=0x7fdb14017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.085+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdb180c0fa0 con 0x7fdb18153740 2023-08-17T00:12:05.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.245+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb180c0f60 con 0x7fdb18153740 2023-08-17T00:12:05.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.249+0000 7fdb0d7fa700 1 -- 172.21.15.153:0/204928720 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fdb08046c20 con 0x7fdb18153740 2023-08-17T00:12:05.254 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:05.255 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":125,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:04.854837+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:12:02.859311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T00:12:03.866983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:05.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdafc05a180 msgr2=0x7fdafc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdafc05a180 0x7fdafc05c640 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fdb1400b3c0 tx=0x7fdb14017000).stop 2023-08-17T00:12:05.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 msgr2=0x7fdb180adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb180adfe0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 rx=0x7fdb0800c440 tx=0x7fdb08007e00).stop 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 shutdown_connections 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdafc05a180 0x7fdafc05c640 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb18153b20 0x7fdb18167870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdb18153740 0x7fdb180adfe0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 --2- 172.21.15.153:0/204928720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb18063d90 0x7fdb180aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 >> 172.21.15.153:0/204928720 conn(0x7fdb180c9160 msgr2=0x7fdb18067e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:05.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 shutdown_connections 2023-08-17T00:12:05.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.253+0000 7fdb1e48f700 1 -- 172.21.15.153:0/204928720 wait complete. 2023-08-17T00:12:05.277 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:05.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.425+0000 7f962d8db700 1 Processor -- start 2023-08-17T00:12:05.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.425+0000 7f962d8db700 1 -- start start 2023-08-17T00:12:05.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.425+0000 7f962d8db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9628153d50 0x7f96280632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.425+0000 7f962d8db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9628065240 con 0x7f96280656d0 2023-08-17T00:12:05.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.425+0000 7f962d8db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9628063880 con 0x7f9628154130 2023-08-17T00:12:05.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.425+0000 7f962d8db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9628064910 con 0x7f9628153d50 2023-08-17T00:12:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9628153d50 0x7f96280632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9628153d50 0x7f96280632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54650/0 (socket says 172.21.15.153:54650) 2023-08-17T00:12:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 -- 172.21.15.153:0/1905261151 learned_addr learned my addr 172.21.15.153:0/1905261151 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 -- 172.21.15.153:0/1905261151 >> v1:172.21.15.178:6789/0 conn(0x7f9628154130 legacy=0x7f96280629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 -- 172.21.15.153:0/1905261151 >> v1:172.21.15.153:6789/0 conn(0x7f96280656d0 legacy=0x7f96280bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 -- 172.21.15.153:0/1905261151 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628064bf0 con 0x7f9628153d50 2023-08-17T00:12:05.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f9626ffd700 1 --2- 172.21.15.153:0/1905261151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9628153d50 0x7f96280632e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f9618006fd0 tx=0x7f96180090f0).ready entity=mon.0 client_cookie=30a591dec981fca9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f96267fc700 1 -- 172.21.15.153:0/1905261151 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800b600 con 0x7f9628153d50 2023-08-17T00:12:05.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f96267fc700 1 -- 172.21.15.153:0/1905261151 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f961800b760 con 0x7f9628153d50 2023-08-17T00:12:05.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f96267fc700 1 -- 172.21.15.153:0/1905261151 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f961800bb00 con 0x7f9628153d50 2023-08-17T00:12:05.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 -- 172.21.15.153:0/1905261151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9628153d50 msgr2=0x7f96280632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 --2- 172.21.15.153:0/1905261151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9628153d50 0x7f96280632e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f9618006fd0 tx=0x7f96180090f0).stop 2023-08-17T00:12:05.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 -- 172.21.15.153:0/1905261151 shutdown_connections 2023-08-17T00:12:05.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 --2- 172.21.15.153:0/1905261151 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9628153d50 0x7f96280632e0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 -- 172.21.15.153:0/1905261151 >> 172.21.15.153:0/1905261151 conn(0x7f96280c7150 msgr2=0x7f96280c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:05.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 -- 172.21.15.153:0/1905261151 shutdown_connections 2023-08-17T00:12:05.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.429+0000 7f962d8db700 1 -- 172.21.15.153:0/1905261151 wait complete. 2023-08-17T00:12:05.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 Processor -- start 2023-08-17T00:12:05.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 -- start start 2023-08-17T00:12:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 0x7f96280aa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9628153d50 0x7f96281483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9628154130 0x7f96280a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96281488e0 con 0x7f96280656d0 2023-08-17T00:12:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96281546b0 con 0x7f9628154130 2023-08-17T00:12:05.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f962d8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9628154990 con 0x7f9628153d50 2023-08-17T00:12:05.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f9626ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 0x7f96280aa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f9626ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 0x7f96280aa2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54656/0 (socket says 172.21.15.153:54656) 2023-08-17T00:12:05.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f9626ffd700 1 -- 172.21.15.153:0/2815311630 learned_addr learned my addr 172.21.15.153:0/2815311630 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:05.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f96277fe700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9628154130 0x7f96280a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.433+0000 7f961ffff700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9628153d50 0x7f96281483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f96277fe700 1 -- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9628153d50 msgr2=0x7f96281483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f96277fe700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9628153d50 0x7f96281483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f96277fe700 1 -- 172.21.15.153:0/2815311630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 msgr2=0x7f96280aa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f96277fe700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 0x7f96280aa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f96277fe700 1 -- 172.21.15.153:0/2815311630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618009370 con 0x7f9628154130 2023-08-17T00:12:05.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f9626ffd700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 0x7f96280aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:05.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f96277fe700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9628154130 0x7f96280a8b60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f96200013d0 tx=0x7f9620001530).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000e4a0 con 0x7f9628154130 2023-08-17T00:12:05.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000e600 con 0x7f9628154130 2023-08-17T00:12:05.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9628154c70 con 0x7f9628154130 2023-08-17T00:12:05.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000e980 con 0x7f9628154130 2023-08-17T00:12:05.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9628155230 con 0x7f9628154130 2023-08-17T00:12:05.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96281577c0 con 0x7f9628154130 2023-08-17T00:12:05.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.437+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9620010070 con 0x7f9628154130 2023-08-17T00:12:05.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.441+0000 7f961effd700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960805a150 0x7f960805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.441+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9620073870 con 0x7f9628154130 2023-08-17T00:12:05.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.441+0000 7f9626ffd700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960805a150 0x7f960805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.441+0000 7f9626ffd700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960805a150 0x7f960805c610 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f9618006cc0 tx=0x7f9618017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.449+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9620047210 con 0x7f9628154130 2023-08-17T00:12:05.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.609+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9628064ed0 con 0x7f9628154130 2023-08-17T00:12:05.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f961effd700 1 -- 172.21.15.153:0/2815311630 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f962004a830 con 0x7f9628154130 2023-08-17T00:12:05.617 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:05.617 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":125,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:04.854837+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:12:02.859311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T00:12:03.866983+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:05.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960805a150 msgr2=0x7f960805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960805a150 0x7f960805c610 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f9618006cc0 tx=0x7f9618017000).stop 2023-08-17T00:12:05.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9628154130 msgr2=0x7f96280a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9628154130 0x7f96280a8b60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f96200013d0 tx=0x7f9620001530).stop 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 shutdown_connections 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960805a150 0x7f960805c610 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9628154130 0x7f96280a8b60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9628153d50 0x7f96281483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 --2- 172.21.15.153:0/2815311630 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96280656d0 0x7f96280aa2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 >> 172.21.15.153:0/2815311630 conn(0x7f96280c7150 msgr2=0x7f9628152480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:05.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 shutdown_connections 2023-08-17T00:12:05.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.613+0000 7f962d8db700 1 -- 172.21.15.153:0/2815311630 wait complete. 2023-08-17T00:12:05.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:12:05.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.793+0000 7f3011edb700 1 Processor -- start 2023-08-17T00:12:05.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.793+0000 7f3011edb700 1 -- start start 2023-08-17T00:12:05.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f3011edb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f300c14def0 0x7f300c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f3011edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14e2d0 0x7f300c154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f3011edb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300c0aa680 con 0x7f300c0c7450 2023-08-17T00:12:05.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f3011edb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300c158850 con 0x7f300c14def0 2023-08-17T00:12:05.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f3011edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c0c5eb0 con 0x7f300c14e2d0 2023-08-17T00:12:05.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f300c14def0 0x7f300c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f300c0c7450 0x7f300c0a9820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56500/0 (socket says 172.21.15.153:56500) 2023-08-17T00:12:05.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300affd700 1 --2- 172.21.15.153:0/2218626084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14e2d0 0x7f300c154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300bfff700 1 -- 172.21.15.153:0/2218626084 learned_addr learned my addr 172.21.15.153:0/2218626084 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:05.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300a7fc700 1 -- 172.21.15.153:0/2218626084 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513079592 0 0) 0x7f300c0aa680 con 0x7f300c0c7450 2023-08-17T00:12:05.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300a7fc700 1 -- 172.21.15.153:0/2218626084 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff40033f0 con 0x7f300c0c7450 2023-08-17T00:12:05.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300affd700 1 -- 172.21.15.153:0/2218626084 >> v2:172.21.15.153:3300/0 conn(0x7f300c14def0 msgr2=0x7f300c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:05.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300affd700 1 --2- 172.21.15.153:0/2218626084 >> v2:172.21.15.153:3300/0 conn(0x7f300c14def0 0x7f300c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300affd700 1 -- 172.21.15.153:0/2218626084 >> v1:172.21.15.153:6789/0 conn(0x7f300c0c7450 legacy=0x7f300c0a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.797+0000 7f300affd700 1 -- 172.21.15.153:0/2218626084 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c0c6110 con 0x7f300c14e2d0 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f300affd700 1 --2- 172.21.15.153:0/2218626084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14e2d0 0x7f300c154c90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3000009760 tx=0x7f3000009060).ready entity=mon.2 client_cookie=13ce97a87153662d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f300a7fc700 1 -- 172.21.15.153:0/2218626084 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000d4a0 con 0x7f300c14e2d0 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f300a7fc700 1 -- 172.21.15.153:0/2218626084 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300000d600 con 0x7f300c14e2d0 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f300a7fc700 1 -- 172.21.15.153:0/2218626084 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000d980 con 0x7f300c14e2d0 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 -- 172.21.15.153:0/2218626084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14e2d0 msgr2=0x7f300c154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 --2- 172.21.15.153:0/2218626084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14e2d0 0x7f300c154c90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f3000009760 tx=0x7f3000009060).stop 2023-08-17T00:12:05.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 -- 172.21.15.153:0/2218626084 shutdown_connections 2023-08-17T00:12:05.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 --2- 172.21.15.153:0/2218626084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14e2d0 0x7f300c154c90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 --2- 172.21.15.153:0/2218626084 >> v2:172.21.15.153:3300/0 conn(0x7f300c14def0 0x7f300c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 -- 172.21.15.153:0/2218626084 >> 172.21.15.153:0/2218626084 conn(0x7f300c061fa0 msgr2=0x7f300c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:05.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 -- 172.21.15.153:0/2218626084 shutdown_connections 2023-08-17T00:12:05.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 -- 172.21.15.153:0/2218626084 wait complete. 2023-08-17T00:12:05.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 Processor -- start 2023-08-17T00:12:05.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.801+0000 7f3011edb700 1 -- start start 2023-08-17T00:12:05.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f300c0c7450 0x7f300c149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14def0 0x7f300c0c24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 0x7f300c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c163bd0 con 0x7f300c14e2d0 2023-08-17T00:12:05.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300c0ada10 con 0x7f300c0c7450 2023-08-17T00:12:05.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300c0b0530 con 0x7f300c14def0 2023-08-17T00:12:05.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 0x7f300c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14def0 0x7f300c0c24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 0x7f300c0c3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54684/0 (socket says 172.21.15.153:54684) 2023-08-17T00:12:05.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 -- 172.21.15.153:0/3785626443 learned_addr learned my addr 172.21.15.153:0/3785626443 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:05.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300b7fe700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f300c0c7450 0x7f300c149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 -- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14def0 msgr2=0x7f300c0c24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14def0 0x7f300c0c24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 -- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f300c0c7450 msgr2=0x7f300c149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f300c0c7450 0x7f300c149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 -- 172.21.15.153:0/3785626443 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000092a0 con 0x7f300c14e2d0 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f300bfff700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 0x7f300c0c3850 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f300400c810 tx=0x7f3004007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004005d30 con 0x7f300c14e2d0 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004005e90 con 0x7f300c14e2d0 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004007320 con 0x7f300c14e2d0 2023-08-17T00:12:05.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300c0b0810 con 0x7f300c14e2d0 2023-08-17T00:12:05.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.805+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300c0adf00 con 0x7f300c14e2d0 2023-08-17T00:12:05.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.809+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300c0ae120 con 0x7f300c14e2d0 2023-08-17T00:12:05.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.809+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3004010030 con 0x7f300c14e2d0 2023-08-17T00:12:05.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.809+0000 7f2ff37fe700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ff805a150 0x7f2ff805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:05.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.809+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3004073fe0 con 0x7f300c14e2d0 2023-08-17T00:12:05.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.813+0000 7f300b7fe700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ff805a150 0x7f2ff805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:05.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.813+0000 7f300b7fe700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ff805a150 0x7f2ff805c610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f2ffc009c30 tx=0x7f2ffc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:05.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:05.817+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f30040a28f0 con 0x7f300c14e2d0 2023-08-17T00:12:06.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.017+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f300c06b530 con 0x7f300c14e2d0 2023-08-17T00:12:06.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.873+0000 7f2ff37fe700 1 -- 172.21.15.153:0/3785626443 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v100) v1 ==== 118+0+0 (secure 0 0 0) 0x7f30040479e0 con 0x7f300c14e2d0 2023-08-17T00:12:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ff805a150 msgr2=0x7f2ff805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ff805a150 0x7f2ff805c610 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7f2ffc009c30 tx=0x7f2ffc009060).stop 2023-08-17T00:12:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 msgr2=0x7f300c0c3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:06.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 0x7f300c0c3850 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f300400c810 tx=0x7f3004007f70).stop 2023-08-17T00:12:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 shutdown_connections 2023-08-17T00:12:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2ff805a150 0x7f2ff805c610 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f300c14e2d0 0x7f300c0c3850 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f300c14def0 0x7f300c0c24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 --2- 172.21.15.153:0/3785626443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f300c0c7450 0x7f300c149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:06.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 >> 172.21.15.153:0/3785626443 conn(0x7f300c061fa0 msgr2=0x7f300c14afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 shutdown_connections 2023-08-17T00:12:06.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:06.877+0000 7f3011edb700 1 -- 172.21.15.153:0/3785626443 wait complete. 2023-08-17T00:12:06.905 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:12:06.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:12:07.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.069+0000 7f3a3929b700 1 Processor -- start 2023-08-17T00:12:07.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.069+0000 7f3a3929b700 1 -- start start 2023-08-17T00:12:07.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a3929b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:07.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a3929b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a34065b50 0x7f3a34064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:07.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a3929b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a34061fa0 con 0x7f3a34151b90 2023-08-17T00:12:07.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a3929b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a340c3fb0 con 0x7f3a34065b50 2023-08-17T00:12:07.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a3929b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341523d0 con 0x7f3a34151f70 2023-08-17T00:12:07.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a34065b50 0x7f3a34064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:07.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3a34065b50 0x7f3a34064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54700/0 (socket says 172.21.15.153:54700) 2023-08-17T00:12:07.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 -- 172.21.15.153:0/2426626498 learned_addr learned my addr 172.21.15.153:0/2426626498 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:07.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a327fc700 1 --2- 172.21.15.153:0/2426626498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:07.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 -- 172.21.15.153:0/2426626498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 msgr2=0x7f3a34065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:07.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 --2- 172.21.15.153:0/2426626498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:07.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 -- 172.21.15.153:0/2426626498 >> v1:172.21.15.178:6789/0 conn(0x7f3a34151b90 legacy=0x7f3a34063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:07.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 -- 172.21.15.153:0/2426626498 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340621f0 con 0x7f3a34065b50 2023-08-17T00:12:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a337fe700 1 --2- 172.21.15.153:0/2426626498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34064870 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f3a2c009f20 tx=0x7f3a2c009840).ready entity=mon.0 client_cookie=1a09b58afeb4f78a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.073+0000 7f3a31ffb700 1 -- 172.21.15.153:0/2426626498 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00e070 con 0x7f3a34065b50 2023-08-17T00:12:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a31ffb700 1 -- 172.21.15.153:0/2426626498 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00ba80 con 0x7f3a34065b50 2023-08-17T00:12:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a31ffb700 1 -- 172.21.15.153:0/2426626498 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00be00 con 0x7f3a34065b50 2023-08-17T00:12:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 -- 172.21.15.153:0/2426626498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 msgr2=0x7f3a34064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:07.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2426626498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34064870 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 rx=0x7f3a2c009f20 tx=0x7f3a2c009840).stop 2023-08-17T00:12:07.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 -- 172.21.15.153:0/2426626498 shutdown_connections 2023-08-17T00:12:07.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2426626498 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34064870 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:07.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2426626498 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:07.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 -- 172.21.15.153:0/2426626498 >> 172.21.15.153:0/2426626498 conn(0x7f3a340c7150 msgr2=0x7f3a340c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:07.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 -- 172.21.15.153:0/2426626498 shutdown_connections 2023-08-17T00:12:07.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.077+0000 7f3a3929b700 1 -- 172.21.15.153:0/2426626498 wait complete. 2023-08-17T00:12:07.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 Processor -- start 2023-08-17T00:12:07.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 -- start start 2023-08-17T00:12:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a34151b90 0x7f3a34164aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34164f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341688f0 con 0x7f3a34065b50 2023-08-17T00:12:07.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a34168d80 con 0x7f3a34151b90 2023-08-17T00:12:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a3929b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a341657d0 con 0x7f3a34151f70 2023-08-17T00:12:07.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54702/0 (socket says 172.21.15.153:54702) 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 -- 172.21.15.153:0/2818018095 learned_addr learned my addr 172.21.15.153:0/2818018095 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a337fe700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a327fc700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a34151b90 0x7f3a34164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 -- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 msgr2=0x7f3a34164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:07.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 -- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a34151b90 msgr2=0x7f3a34164aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:07.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a34151b90 0x7f3a34164aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:07.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 -- 172.21.15.153:0/2818018095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c009ae0 con 0x7f3a34065b50 2023-08-17T00:12:07.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a337fe700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:07.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.081+0000 7f3a32ffd700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34150150 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f3a2400c4c0 tx=0x7f3a24007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a24007020 con 0x7f3a34065b50 2023-08-17T00:12:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24001e90 con 0x7f3a34065b50 2023-08-17T00:12:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a34167fc0 con 0x7f3a34065b50 2023-08-17T00:12:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240073b0 con 0x7f3a34065b50 2023-08-17T00:12:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a34168580 con 0x7f3a34065b50 2023-08-17T00:12:07.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3406b530 con 0x7f3a34065b50 2023-08-17T00:12:07.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.085+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3a24010070 con 0x7f3a34065b50 2023-08-17T00:12:07.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.089+0000 7f3a1affd700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a2005a180 0x7f3a2005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:07.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.089+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3a24073a40 con 0x7f3a34065b50 2023-08-17T00:12:07.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.089+0000 7f3a327fc700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a2005a180 0x7f3a2005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:07.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.089+0000 7f3a327fc700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a2005a180 0x7f3a2005c640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3a34150f50 tx=0x7f3a28008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:07.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.093+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3a240473e0 con 0x7f3a34065b50 2023-08-17T00:12:07.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:07.293+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3a340624d0 con 0x7f3a34065b50 2023-08-17T00:12:08.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.297+0000 7f3a1affd700 1 -- 172.21.15.153:0/2818018095 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v101) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3a2404aa00 con 0x7f3a34065b50 2023-08-17T00:12:08.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a2005a180 msgr2=0x7f3a2005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a2005a180 0x7f3a2005c640 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3a34150f50 tx=0x7f3a28008040).stop 2023-08-17T00:12:08.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 msgr2=0x7f3a34150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34150150 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f3a2400c4c0 tx=0x7f3a24007e00).stop 2023-08-17T00:12:08.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 shutdown_connections 2023-08-17T00:12:08.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3a2005a180 0x7f3a2005c640 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a34151f70 0x7f3a34164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a34151b90 0x7f3a34164aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 --2- 172.21.15.153:0/2818018095 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3a34065b50 0x7f3a34150150 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 >> 172.21.15.153:0/2818018095 conn(0x7f3a340c7150 msgr2=0x7f3a340c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:08.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 shutdown_connections 2023-08-17T00:12:08.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.301+0000 7f3a3929b700 1 -- 172.21.15.153:0/2818018095 wait complete. 2023-08-17T00:12:08.326 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:12:08.327 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:08.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.489+0000 7f3ebd347700 1 Processor -- start 2023-08-17T00:12:08.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.489+0000 7f3ebd347700 1 -- start start 2023-08-17T00:12:08.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebd347700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3eb8153f50 0x7f3eb8154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebd347700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb80bfd10 con 0x7f3eb80c01a0 2023-08-17T00:12:08.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebd347700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb8154860 con 0x7f3eb80c57a0 2023-08-17T00:12:08.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebd347700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb8154af0 con 0x7f3eb8153f50 2023-08-17T00:12:08.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebcb46700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3eb80c01a0 0x7f3eb80c0610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56510/0 (socket says 172.21.15.153:56510) 2023-08-17T00:12:08.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebcb46700 1 -- 172.21.15.153:0/3745013743 learned_addr learned my addr 172.21.15.153:0/3745013743 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:08.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eaffff700 1 --2- 172.21.15.153:0/3745013743 >> v2:172.21.15.178:3300/0 conn(0x7f3eb8153f50 0x7f3eb8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925440412 0 0) 0x7f3eb80bfd10 con 0x7f3eb80c01a0 2023-08-17T00:12:08.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea40033f0 con 0x7f3eb80c01a0 2023-08-17T00:12:08.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827078422 0 0) 0x7f3eb8154860 con 0x7f3eb80c57a0 2023-08-17T00:12:08.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb80bfd10 con 0x7f3eb80c57a0 2023-08-17T00:12:08.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112468832 0 0) 0x7f3ea40033f0 con 0x7f3eb80c01a0 2023-08-17T00:12:08.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 >> v2:172.21.15.178:3300/0 conn(0x7f3eb8153f50 msgr2=0x7f3eb8154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:08.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 --2- 172.21.15.153:0/3745013743 >> v2:172.21.15.178:3300/0 conn(0x7f3eb8153f50 0x7f3eb8154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 >> v1:172.21.15.178:6789/0 conn(0x7f3eb80c57a0 legacy=0x7f3eb80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8154dd0 con 0x7f3eb80c01a0 2023-08-17T00:12:08.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f3eb00017f0 con 0x7f3eb80c01a0 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 >> v1:172.21.15.153:6789/0 conn(0x7f3eb80c01a0 legacy=0x7f3eb80c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4003a70 0x7f3ea4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4004690 0x7f3ea4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ea4005000 0x7f3ea400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb8154af0 con 0x7f3ea4003a70 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea400bf60 con 0x7f3ea4004690 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea400c0d0 con 0x7f3ea4005000 2023-08-17T00:12:08.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4003a70 0x7f3ea4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebcb46700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ea4005000 0x7f3ea400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eaffff700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4004690 0x7f3ea4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 -- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ea4005000 msgr2=0x7f3ea400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ea4005000 0x7f3ea400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 -- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4004690 msgr2=0x7f3ea4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:08.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4004690 0x7f3ea4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 -- 172.21.15.153:0/3745013743 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea40033f0 con 0x7f3ea4003a70 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eaffff700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4004690 0x7f3ea4004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3ebcb46700 1 -- 172.21.15.153:0/3745013743 reap_dead start 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.493+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4003a70 0x7f3ea4003e70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f3ea8001890 tx=0x7f3ea8007bb0).ready entity=mon.0 client_cookie=53fea09993ca55a0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8007020 con 0x7f3ea4003a70 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea8007180 con 0x7f3ea4003a70 2023-08-17T00:12:08.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3eb77fe700 1 -- 172.21.15.153:0/3745013743 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8007500 con 0x7f3ea4003a70 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 -- 172.21.15.153:0/3745013743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4003a70 msgr2=0x7f3ea4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4003a70 0x7f3ea4003e70 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7f3ea8001890 tx=0x7f3ea8007bb0).stop 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 -- 172.21.15.153:0/3745013743 shutdown_connections 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3745013743 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ea4003a70 0x7f3ea4003e70 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 -- 172.21.15.153:0/3745013743 >> 172.21.15.153:0/3745013743 conn(0x7f3eb8062a70 msgr2=0x7f3eb80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 -- 172.21.15.153:0/3745013743 shutdown_connections 2023-08-17T00:12:08.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.497+0000 7f3ebd347700 1 -- 172.21.15.153:0/3745013743 wait complete. 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 Processor -- start 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 -- start start 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4003a70 0x7f3eb8164010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 0x7f3eb80c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80c9850 0x7f3eb80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80ae790 con 0x7f3eb80c4320 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80ca1c0 con 0x7f3ea4003a70 2023-08-17T00:12:08.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80adb80 con 0x7f3eb80c9850 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 0x7f3eb80c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 0x7f3eb80c47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54718/0 (socket says 172.21.15.153:54718) 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 -- 172.21.15.153:0/3516561158 learned_addr learned my addr 172.21.15.153:0/3516561158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebcb46700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80c9850 0x7f3eb80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4003a70 0x7f3eb8164010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 -- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80c9850 msgr2=0x7f3eb80c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80c9850 0x7f3eb80c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 -- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4003a70 msgr2=0x7f3eb8164010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4003a70 0x7f3eb8164010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 -- 172.21.15.153:0/3516561158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80ade60 con 0x7f3eb80c4320 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eaffff700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 0x7f3eb80c47a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f3ea0011990 tx=0x7f3ea0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000f6d0 con 0x7f3eb80c4320 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea000f830 con 0x7f3eb80c4320 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000fbb0 con 0x7f3eb80c4320 2023-08-17T00:12:08.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.501+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb80ae140 con 0x7f3eb80c4320 2023-08-17T00:12:08.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.505+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb80ad830 con 0x7f3eb80c4320 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.505+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb80ae5c0 con 0x7f3eb80c4320 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.505+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3ea0025070 con 0x7f3eb80c4320 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.509+0000 7f3eb4ff9700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9805a150 0x7f3e9805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.509+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ea0074a20 con 0x7f3eb80c4320 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.509+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9805a150 0x7f3e9805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.509+0000 7f3eb7fff700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9805a150 0x7f3e9805c610 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f3ea8001670 tx=0x7f3ea8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:08.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.513+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ea00483c0 con 0x7f3eb80c4320 2023-08-17T00:12:08.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.701+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3eb806b4c0 con 0x7f3eb80c4320 2023-08-17T00:12:08.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.701+0000 7f3eb4ff9700 1 -- 172.21.15.153:0/3516561158 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f3ea004b9e0 con 0x7f3eb80c4320 2023-08-17T00:12:08.707 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:08.708 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.705+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9805a150 msgr2=0x7f3e9805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.705+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9805a150 0x7f3e9805c610 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f3ea8001670 tx=0x7f3ea8015000).stop 2023-08-17T00:12:08.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.705+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 msgr2=0x7f3eb80c47a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.705+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 0x7f3eb80c47a0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7f3ea0011990 tx=0x7f3ea0008040).stop 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 shutdown_connections 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9805a150 0x7f3e9805c610 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80c9850 0x7f3eb80c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80c4320 0x7f3eb80c47a0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 --2- 172.21.15.153:0/3516561158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ea4003a70 0x7f3eb8164010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 >> 172.21.15.153:0/3516561158 conn(0x7f3eb8062a70 msgr2=0x7f3eb8063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:08.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 shutdown_connections 2023-08-17T00:12:08.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.709+0000 7f3ebd347700 1 -- 172.21.15.153:0/3516561158 wait complete. 2023-08-17T00:12:08.715 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:08.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:08.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 Processor -- start 2023-08-17T00:12:08.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 -- start start 2023-08-17T00:12:08.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd4000be070 0x7fd4000a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000a7120 con 0x7fd4000a5cb0 2023-08-17T00:12:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000be4d0 con 0x7fd4000be070 2023-08-17T00:12:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.885+0000 7fd405369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000a6510 con 0x7fd400157da0 2023-08-17T00:12:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd4000a5cb0 0x7fd4000c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:56700/0 (socket says 172.21.15.153:56700) 2023-08-17T00:12:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fffff700 1 -- 172.21.15.153:0/3071414749 learned_addr learned my addr 172.21.15.153:0/3071414749 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fe7fc700 1 --2- 172.21.15.153:0/3071414749 >> v2:172.21.15.153:3300/0 conn(0x7fd4000be070 0x7fd4000a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3feffd700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fdffb700 1 -- 172.21.15.153:0/3071414749 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364996937 0 0) 0x7fd4000a7120 con 0x7fd4000a5cb0 2023-08-17T00:12:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fdffb700 1 -- 172.21.15.153:0/3071414749 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e80033f0 con 0x7fd4000a5cb0 2023-08-17T00:12:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3071414749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 msgr2=0x7fd4000bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fe7fc700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3071414749 >> v1:172.21.15.178:6789/0 conn(0x7fd4000a5cb0 legacy=0x7fd4000c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3071414749 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000a67f0 con 0x7fd4000be070 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3feffd700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fe7fc700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd4000a57c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fd3f4009760 tx=0x7fd3f4009060).ready entity=mon.0 client_cookie=80a0c607f3d16426 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fdffb700 1 -- 172.21.15.153:0/3071414749 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40090d0 con 0x7fd4000be070 2023-08-17T00:12:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fdffb700 1 -- 172.21.15.153:0/3071414749 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f400d4a0 con 0x7fd4000be070 2023-08-17T00:12:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd3fdffb700 1 -- 172.21.15.153:0/3071414749 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f400d820 con 0x7fd4000be070 2023-08-17T00:12:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd405369700 1 -- 172.21.15.153:0/3071414749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 msgr2=0x7fd4000a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd405369700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd4000a57c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fd3f4009760 tx=0x7fd3f4009060).stop 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd405369700 1 -- 172.21.15.153:0/3071414749 shutdown_connections 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd405369700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd4000a57c0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd405369700 1 --2- 172.21.15.153:0/3071414749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.889+0000 7fd405369700 1 -- 172.21.15.153:0/3071414749 >> 172.21.15.153:0/3071414749 conn(0x7fd4000c46b0 msgr2=0x7fd4000c4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.893+0000 7fd405369700 1 -- 172.21.15.153:0/3071414749 shutdown_connections 2023-08-17T00:12:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.893+0000 7fd405369700 1 -- 172.21.15.153:0/3071414749 wait complete. 2023-08-17T00:12:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.893+0000 7fd405369700 1 Processor -- start 2023-08-17T00:12:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.893+0000 7fd405369700 1 -- start start 2023-08-17T00:12:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4000a5cb0 0x7fd400155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd40015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000639d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40015b6a0 con 0x7fd4000be070 2023-08-17T00:12:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ab0c0 con 0x7fd4000a5cb0 2023-08-17T00:12:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000ab3a0 con 0x7fd400157da0 2023-08-17T00:12:08.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd40015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd40015d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54734/0 (socket says 172.21.15.153:54734) 2023-08-17T00:12:08.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3701155550 learned_addr learned my addr 172.21.15.153:0/3701155550 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fffff700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000639d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3feffd700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4000a5cb0 0x7fd400155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 msgr2=0x7fd4000639d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000639d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4000a5cb0 msgr2=0x7fd400155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4000a5cb0 0x7fd400155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 -- 172.21.15.153:0/3701155550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00092a0 con 0x7fd4000be070 2023-08-17T00:12:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3fe7fc700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd40015d0b0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd3f4010000 tx=0x7fd3f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4006910 con 0x7fd4000be070 2023-08-17T00:12:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f4012770 con 0x7fd4000be070 2023-08-17T00:12:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4012b10 con 0x7fd4000be070 2023-08-17T00:12:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.897+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f40092a0 con 0x7fd4000be070 2023-08-17T00:12:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.901+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4000ab960 con 0x7fd4000be070 2023-08-17T00:12:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.901+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000c4380 con 0x7fd4000be070 2023-08-17T00:12:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.901+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd3f400f070 con 0x7fd4000be070 2023-08-17T00:12:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.905+0000 7fd3e6ffd700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3ec05a150 0x7fd3ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.905+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd3f40751f0 con 0x7fd4000be070 2023-08-17T00:12:08.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.905+0000 7fd3feffd700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3ec05a150 0x7fd3ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:08.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.905+0000 7fd3feffd700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3ec05a150 0x7fd3ec05c610 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fd3f0009d20 tx=0x7fd3f0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:08.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:08.909+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4000c4380 con 0x7fd4000be070 2023-08-17T00:12:09.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.069+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4000c4380 con 0x7fd4000be070 2023-08-17T00:12:09.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.073+0000 7fd3e6ffd700 1 -- 172.21.15.153:0/3701155550 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+16990 (secure 0 0 0) 0x7fd4000c4380 con 0x7fd4000be070 2023-08-17T00:12:09.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:09.077 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":126,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:05.859979+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:12:02.859311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T00:12:03.866983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:09.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3ec05a150 msgr2=0x7fd3ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3ec05a150 0x7fd3ec05c610 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7fd3f0009d20 tx=0x7fd3f0009060).stop 2023-08-17T00:12:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 msgr2=0x7fd40015d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd40015d0b0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fd3f4010000 tx=0x7fd3f4016000).stop 2023-08-17T00:12:09.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 shutdown_connections 2023-08-17T00:12:09.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3ec05a150 0x7fd3ec05c610 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd400157da0 0x7fd4000639d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4000be070 0x7fd40015d0b0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 --2- 172.21.15.153:0/3701155550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4000a5cb0 0x7fd400155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 >> 172.21.15.153:0/3701155550 conn(0x7fd4000c46b0 msgr2=0x7fd400156fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 shutdown_connections 2023-08-17T00:12:09.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.077+0000 7fd405369700 1 -- 172.21.15.153:0/3701155550 wait complete. 2023-08-17T00:12:09.103 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:12:09.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:12:09.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.257+0000 7fb84889b700 1 Processor -- start 2023-08-17T00:12:09.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.257+0000 7fb84889b700 1 -- start start 2023-08-17T00:12:09.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb84889b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb844065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb84889b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb844061fa0 con 0x7fb844151b90 2023-08-17T00:12:09.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb84889b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8441523d0 con 0x7fb844065b50 2023-08-17T00:12:09.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb84889b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440c3fb0 con 0x7fb844151f70 2023-08-17T00:12:09.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb84259c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb844151b90 0x7fb844063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56514/0 (socket says 172.21.15.153:56514) 2023-08-17T00:12:09.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb84259c700 1 -- 172.21.15.153:0/2447292191 learned_addr learned my addr 172.21.15.153:0/2447292191 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:09.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb83bfff700 1 --2- 172.21.15.153:0/2447292191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb844065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb841d9b700 1 -- 172.21.15.153:0/2447292191 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532001486 0 0) 0x7fb844061fa0 con 0x7fb844151b90 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb841d9b700 1 -- 172.21.15.153:0/2447292191 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8300033f0 con 0x7fb844151b90 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb83bfff700 1 -- 172.21.15.153:0/2447292191 >> v1:172.21.15.178:6789/0 conn(0x7fb844065b50 legacy=0x7fb844064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb83bfff700 1 -- 172.21.15.153:0/2447292191 >> v1:172.21.15.153:6789/0 conn(0x7fb844151b90 legacy=0x7fb844063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb83bfff700 1 -- 172.21.15.153:0/2447292191 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440621f0 con 0x7fb844151f70 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.261+0000 7fb83bfff700 1 --2- 172.21.15.153:0/2447292191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb844065660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb82c009790 tx=0x7fb82c009060).ready entity=mon.2 client_cookie=3300c3862246ce59 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:09.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb841d9b700 1 -- 172.21.15.153:0/2447292191 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c0090d0 con 0x7fb844151f70 2023-08-17T00:12:09.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb841d9b700 1 -- 172.21.15.153:0/2447292191 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c00f510 con 0x7fb844151f70 2023-08-17T00:12:09.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb841d9b700 1 -- 172.21.15.153:0/2447292191 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c00f890 con 0x7fb844151f70 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 -- 172.21.15.153:0/2447292191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 msgr2=0x7fb844065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 --2- 172.21.15.153:0/2447292191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb844065660 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fb82c009790 tx=0x7fb82c009060).stop 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 -- 172.21.15.153:0/2447292191 shutdown_connections 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 --2- 172.21.15.153:0/2447292191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb844065660 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 -- 172.21.15.153:0/2447292191 >> 172.21.15.153:0/2447292191 conn(0x7fb8440c7150 msgr2=0x7fb8440c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 -- 172.21.15.153:0/2447292191 shutdown_connections 2023-08-17T00:12:09.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 -- 172.21.15.153:0/2447292191 wait complete. 2023-08-17T00:12:09.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 Processor -- start 2023-08-17T00:12:09.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.265+0000 7fb84889b700 1 -- start start 2023-08-17T00:12:09.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 0x7fb8440a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 0x7fb8440a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb8440c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a70d0 con 0x7fb844065b50 2023-08-17T00:12:09.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a7560 con 0x7fb844151b90 2023-08-17T00:12:09.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440a64c0 con 0x7fb844151f70 2023-08-17T00:12:09.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 0x7fb8440a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 0x7fb8440a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83bfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 0x7fb8440a5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:53820/0 (socket says 172.21.15.153:53820) 2023-08-17T00:12:09.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83bfff700 1 -- 172.21.15.153:0/1887649236 learned_addr learned my addr 172.21.15.153:0/1887649236 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 0x7fb8440a3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54748/0 (socket says 172.21.15.153:54748) 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb842d9d700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb8440c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 -- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 msgr2=0x7fb8440c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb8440c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 -- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 msgr2=0x7fb8440a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 0x7fb8440a5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 -- 172.21.15.153:0/1887649236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c0092a0 con 0x7fb844065b50 2023-08-17T00:12:09.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83bfff700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 0x7fb8440a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:09.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84259c700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 0x7fb8440a3f30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fb834001ed0 tx=0x7fb834007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:09.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340070d0 con 0x7fb844065b50 2023-08-17T00:12:09.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb834007230 con 0x7fb844065b50 2023-08-17T00:12:09.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8340075f0 con 0x7fb844065b50 2023-08-17T00:12:09.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8440a67a0 con 0x7fb844065b50 2023-08-17T00:12:09.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.269+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8440a6d60 con 0x7fb844065b50 2023-08-17T00:12:09.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.273+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8440624d0 con 0x7fb844065b50 2023-08-17T00:12:09.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.273+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb834010070 con 0x7fb844065b50 2023-08-17T00:12:09.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.273+0000 7fb83a7fc700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb82405a120 0x7fb82405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.273+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb834073770 con 0x7fb844065b50 2023-08-17T00:12:09.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.273+0000 7fb83bfff700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb82405a120 0x7fb82405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.277+0000 7fb83bfff700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb82405a120 0x7fb82405c5e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fb84414fd80 tx=0x7fb82c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:09.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.281+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb834047110 con 0x7fb844065b50 2023-08-17T00:12:09.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.441+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8440a6ef0 con 0x7fb82405a120 2023-08-17T00:12:09.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.457+0000 7fb83a7fc700 1 -- 172.21.15.153:0/1887649236 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359561 (secure 0 0 0) 0x7fb8440a6ef0 con 0x7fb82405a120 2023-08-17T00:12:09.467 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:09.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb82405a120 msgr2=0x7fb82405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb82405a120 0x7fb82405c5e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fb84414fd80 tx=0x7fb82c017000).stop 2023-08-17T00:12:09.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 msgr2=0x7fb8440a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 0x7fb8440a3f30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7fb834001ed0 tx=0x7fb834007bd0).stop 2023-08-17T00:12:09.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 shutdown_connections 2023-08-17T00:12:09.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb82405a120 0x7fb82405c5e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb844151f70 0x7fb8440c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb844151b90 0x7fb8440a5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 --2- 172.21.15.153:0/1887649236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb844065b50 0x7fb8440a3f30 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 >> 172.21.15.153:0/1887649236 conn(0x7fb8440c7150 msgr2=0x7fb844151420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:09.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 shutdown_connections 2023-08-17T00:12:09.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.469+0000 7fb84889b700 1 -- 172.21.15.153:0/1887649236 wait complete. 2023-08-17T00:12:09.476 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:12:09.493 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2023-08-17T00:12:09.382700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443296,"kb_used_data":12256,"kb_used_omap":0,"kb_used_meta":2430976,"kb_avail":752531424,"statfs":{"total":773094113280,"available":770592178176,"internally_reserved":0,"allocated":12550144,"data_stored":5838316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489319424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077803701,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3206,"num_write_kb":-1053274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-63,"num_bytes_recovered":-66060288,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.963465"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891452+0000","last_change":"2023-08-17T00:12:04.886144+0000","last_active":"2023-08-17T00:12:04.891452+0000","last_peered":"2023-08-17T00:12:04.891452+0000","last_clean":"2023-08-17T00:12:04.891452+0000","last_became_active":"2023-08-17T00:12:04.885849+0000","last_became_peered":"2023-08-17T00:12:04.885849+0000","last_unstale":"2023-08-17T00:12:04.891452+0000","last_undegraded":"2023-08-17T00:12:04.891452+0000","last_fullsized":"2023-08-17T00:12:04.891452+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.900066+0000","last_change":"2023-08-17T00:12:04.460424+0000","last_active":"2023-08-17T00:12:04.900066+0000","last_peered":"2023-08-17T00:12:04.900066+0000","last_clean":"2023-08-17T00:12:04.900066+0000","last_became_active":"2023-08-17T00:12:04.460165+0000","last_became_peered":"2023-08-17T00:12:04.460165+0000","last_unstale":"2023-08-17T00:12:04.900066+0000","last_undegraded":"2023-08-17T00:12:04.900066+0000","last_fullsized":"2023-08-17T00:12:04.900066+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899081+0000","last_change":"2023-08-17T00:12:04.892839+0000","last_active":"2023-08-17T00:12:04.899081+0000","last_peered":"2023-08-17T00:12:04.899081+0000","last_clean":"2023-08-17T00:12:04.899081+0000","last_became_active":"2023-08-17T00:12:04.892269+0000","last_became_peered":"2023-08-17T00:12:04.892269+0000","last_unstale":"2023-08-17T00:12:04.899081+0000","last_undegraded":"2023-08-17T00:12:04.899081+0000","last_fullsized":"2023-08-17T00:12:04.899081+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.878855+0000","last_change":"2023-08-17T00:12:04.449055+0000","last_active":"2023-08-17T00:12:04.878855+0000","last_peered":"2023-08-17T00:12:04.878855+0000","last_clean":"2023-08-17T00:12:04.878855+0000","last_became_active":"2023-08-17T00:12:04.448757+0000","last_became_peered":"2023-08-17T00:12:04.448757+0000","last_unstale":"2023-08-17T00:12:04.878855+0000","last_undegraded":"2023-08-17T00:12:04.878855+0000","last_fullsized":"2023-08-17T00:12:04.878855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889561+0000","last_change":"2023-08-17T00:12:04.881853+0000","last_active":"2023-08-17T00:12:04.889561+0000","last_peered":"2023-08-17T00:12:04.889561+0000","last_clean":"2023-08-17T00:12:04.889561+0000","last_became_active":"2023-08-17T00:12:04.880687+0000","last_became_peered":"2023-08-17T00:12:04.880687+0000","last_unstale":"2023-08-17T00:12:04.889561+0000","last_undegraded":"2023-08-17T00:12:04.889561+0000","last_fullsized":"2023-08-17T00:12:04.889561+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.869927+0000","last_change":"2023-08-17T00:12:04.442597+0000","last_active":"2023-08-17T00:12:04.869927+0000","last_peered":"2023-08-17T00:12:04.869927+0000","last_clean":"2023-08-17T00:12:04.869927+0000","last_became_active":"2023-08-17T00:12:04.442308+0000","last_became_peered":"2023-08-17T00:12:04.442308+0000","last_unstale":"2023-08-17T00:12:04.869927+0000","last_undegraded":"2023-08-17T00:12:04.869927+0000","last_fullsized":"2023-08-17T00:12:04.869927+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897741+0000","last_change":"2023-08-17T00:12:04.888259+0000","last_active":"2023-08-17T00:12:04.897741+0000","last_peered":"2023-08-17T00:12:04.897741+0000","last_clean":"2023-08-17T00:12:04.897741+0000","last_became_active":"2023-08-17T00:12:04.887807+0000","last_became_peered":"2023-08-17T00:12:04.887807+0000","last_unstale":"2023-08-17T00:12:04.897741+0000","last_undegraded":"2023-08-17T00:12:04.897741+0000","last_fullsized":"2023-08-17T00:12:04.897741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893254+0000","last_change":"2023-08-17T00:12:04.448820+0000","last_active":"2023-08-17T00:12:04.893254+0000","last_peered":"2023-08-17T00:12:04.893254+0000","last_clean":"2023-08-17T00:12:04.893254+0000","last_became_active":"2023-08-17T00:12:04.448510+0000","last_became_peered":"2023-08-17T00:12:04.448510+0000","last_unstale":"2023-08-17T00:12:04.893254+0000","last_undegraded":"2023-08-17T00:12:04.893254+0000","last_fullsized":"2023-08-17T00:12:04.893254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893503+0000","last_change":"2023-08-17T00:12:04.884706+0000","last_active":"2023-08-17T00:12:04.893503+0000","last_peered":"2023-08-17T00:12:04.893503+0000","last_clean":"2023-08-17T00:12:04.893503+0000","last_became_active":"2023-08-17T00:12:04.884395+0000","last_became_peered":"2023-08-17T00:12:04.884395+0000","last_unstale":"2023-08-17T00:12:04.893503+0000","last_undegraded":"2023-08-17T00:12:04.893503+0000","last_fullsized":"2023-08-17T00:12:04.893503+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.887594+0000","last_change":"2023-08-17T00:12:04.458887+0000","last_active":"2023-08-17T00:12:04.887594+0000","last_peered":"2023-08-17T00:12:04.887594+0000","last_clean":"2023-08-17T00:12:04.887594+0000","last_became_active":"2023-08-17T00:12:04.458612+0000","last_became_peered":"2023-08-17T00:12:04.458612+0000","last_unstale":"2023-08-17T00:12:04.887594+0000","last_undegraded":"2023-08-17T00:12:04.887594+0000","last_fullsized":"2023-08-17T00:12:04.887594+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895844+0000","last_change":"2023-08-17T00:12:04.887685+0000","last_active":"2023-08-17T00:12:04.895844+0000","last_peered":"2023-08-17T00:12:04.895844+0000","last_clean":"2023-08-17T00:12:04.895844+0000","last_became_active":"2023-08-17T00:12:04.887401+0000","last_became_peered":"2023-08-17T00:12:04.887401+0000","last_unstale":"2023-08-17T00:12:04.895844+0000","last_undegraded":"2023-08-17T00:12:04.895844+0000","last_fullsized":"2023-08-17T00:12:04.895844+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893630+0000","last_change":"2023-08-17T00:12:04.442029+0000","last_active":"2023-08-17T00:12:04.893630+0000","last_peered":"2023-08-17T00:12:04.893630+0000","last_clean":"2023-08-17T00:12:04.893630+0000","last_became_active":"2023-08-17T00:12:04.441647+0000","last_became_peered":"2023-08-17T00:12:04.441647+0000","last_unstale":"2023-08-17T00:12:04.893630+0000","last_undegraded":"2023-08-17T00:12:04.893630+0000","last_fullsized":"2023-08-17T00:12:04.893630+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889426+0000","last_change":"2023-08-17T00:12:04.881147+0000","last_active":"2023-08-17T00:12:04.889426+0000","last_peered":"2023-08-17T00:12:04.889426+0000","last_clean":"2023-08-17T00:12:04.889426+0000","last_became_active":"2023-08-17T00:12:04.880880+0000","last_became_peered":"2023-08-17T00:12:04.880880+0000","last_unstale":"2023-08-17T00:12:04.889426+0000","last_undegraded":"2023-08-17T00:12:04.889426+0000","last_fullsized":"2023-08-17T00:12:04.889426+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876011+0000","last_change":"2023-08-17T00:12:04.456679+0000","last_active":"2023-08-17T00:12:04.876011+0000","last_peered":"2023-08-17T00:12:04.876011+0000","last_clean":"2023-08-17T00:12:04.876011+0000","last_became_active":"2023-08-17T00:12:04.456364+0000","last_became_peered":"2023-08-17T00:12:04.456364+0000","last_unstale":"2023-08-17T00:12:04.876011+0000","last_undegraded":"2023-08-17T00:12:04.876011+0000","last_fullsized":"2023-08-17T00:12:04.876011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897638+0000","last_change":"2023-08-17T00:12:04.891460+0000","last_active":"2023-08-17T00:12:04.897638+0000","last_peered":"2023-08-17T00:12:04.897638+0000","last_clean":"2023-08-17T00:12:04.897638+0000","last_became_active":"2023-08-17T00:12:04.891177+0000","last_became_peered":"2023-08-17T00:12:04.891177+0000","last_unstale":"2023-08-17T00:12:04.897638+0000","last_undegraded":"2023-08-17T00:12:04.897638+0000","last_fullsized":"2023-08-17T00:12:04.897638+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877434+0000","last_change":"2023-08-17T00:12:04.445783+0000","last_active":"2023-08-17T00:12:04.877434+0000","last_peered":"2023-08-17T00:12:04.877434+0000","last_clean":"2023-08-17T00:12:04.877434+0000","last_became_active":"2023-08-17T00:12:04.445450+0000","last_became_peered":"2023-08-17T00:12:04.445450+0000","last_unstale":"2023-08-17T00:12:04.877434+0000","last_undegraded":"2023-08-17T00:12:04.877434+0000","last_fullsized":"2023-08-17T00:12:04.877434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901262+0000","last_change":"2023-08-17T00:12:04.898372+0000","last_active":"2023-08-17T00:12:04.901262+0000","last_peered":"2023-08-17T00:12:04.901262+0000","last_clean":"2023-08-17T00:12:04.901262+0000","last_became_active":"2023-08-17T00:12:04.897771+0000","last_became_peered":"2023-08-17T00:12:04.897771+0000","last_unstale":"2023-08-17T00:12:04.901262+0000","last_undegraded":"2023-08-17T00:12:04.901262+0000","last_fullsized":"2023-08-17T00:12:04.901262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.875376+0000","last_change":"2023-08-17T00:12:04.459234+0000","last_active":"2023-08-17T00:12:04.875376+0000","last_peered":"2023-08-17T00:12:04.875376+0000","last_clean":"2023-08-17T00:12:04.875376+0000","last_became_active":"2023-08-17T00:12:04.458569+0000","last_became_peered":"2023-08-17T00:12:04.458569+0000","last_unstale":"2023-08-17T00:12:04.875376+0000","last_undegraded":"2023-08-17T00:12:04.875376+0000","last_fullsized":"2023-08-17T00:12:04.875376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897821+0000","last_change":"2023-08-17T00:12:04.890796+0000","last_active":"2023-08-17T00:12:04.897821+0000","last_peered":"2023-08-17T00:12:04.897821+0000","last_clean":"2023-08-17T00:12:04.897821+0000","last_became_active":"2023-08-17T00:12:04.889954+0000","last_became_peered":"2023-08-17T00:12:04.889954+0000","last_unstale":"2023-08-17T00:12:04.897821+0000","last_undegraded":"2023-08-17T00:12:04.897821+0000","last_fullsized":"2023-08-17T00:12:04.897821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877480+0000","last_change":"2023-08-17T00:12:04.457846+0000","last_active":"2023-08-17T00:12:04.877480+0000","last_peered":"2023-08-17T00:12:04.877480+0000","last_clean":"2023-08-17T00:12:04.877480+0000","last_became_active":"2023-08-17T00:12:04.457498+0000","last_became_peered":"2023-08-17T00:12:04.457498+0000","last_unstale":"2023-08-17T00:12:04.877480+0000","last_undegraded":"2023-08-17T00:12:04.877480+0000","last_fullsized":"2023-08-17T00:12:04.877480+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894931+0000","last_change":"2023-08-17T00:12:04.885977+0000","last_active":"2023-08-17T00:12:04.894931+0000","last_peered":"2023-08-17T00:12:04.894931+0000","last_clean":"2023-08-17T00:12:04.894931+0000","last_became_active":"2023-08-17T00:12:04.885631+0000","last_became_peered":"2023-08-17T00:12:04.885631+0000","last_unstale":"2023-08-17T00:12:04.894931+0000","last_undegraded":"2023-08-17T00:12:04.894931+0000","last_fullsized":"2023-08-17T00:12:04.894931+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.874979+0000","last_change":"2023-08-17T00:12:04.456526+0000","last_active":"2023-08-17T00:12:04.874979+0000","last_peered":"2023-08-17T00:12:04.874979+0000","last_clean":"2023-08-17T00:12:04.874979+0000","last_became_active":"2023-08-17T00:12:04.455843+0000","last_became_peered":"2023-08-17T00:12:04.455843+0000","last_unstale":"2023-08-17T00:12:04.874979+0000","last_undegraded":"2023-08-17T00:12:04.874979+0000","last_fullsized":"2023-08-17T00:12:04.874979+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891376+0000","last_change":"2023-08-17T00:12:04.885935+0000","last_active":"2023-08-17T00:12:04.891376+0000","last_peered":"2023-08-17T00:12:04.891376+0000","last_clean":"2023-08-17T00:12:04.891376+0000","last_became_active":"2023-08-17T00:12:04.885592+0000","last_became_peered":"2023-08-17T00:12:04.885592+0000","last_unstale":"2023-08-17T00:12:04.891376+0000","last_undegraded":"2023-08-17T00:12:04.891376+0000","last_fullsized":"2023-08-17T00:12:04.891376+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899547+0000","last_change":"2023-08-17T00:12:04.458274+0000","last_active":"2023-08-17T00:12:04.899547+0000","last_peered":"2023-08-17T00:12:04.899547+0000","last_clean":"2023-08-17T00:12:04.899547+0000","last_became_active":"2023-08-17T00:12:04.457934+0000","last_became_peered":"2023-08-17T00:12:04.457934+0000","last_unstale":"2023-08-17T00:12:04.899547+0000","last_undegraded":"2023-08-17T00:12:04.899547+0000","last_fullsized":"2023-08-17T00:12:04.899547+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901191+0000","last_change":"2023-08-17T00:12:04.895285+0000","last_active":"2023-08-17T00:12:04.901191+0000","last_peered":"2023-08-17T00:12:04.901191+0000","last_clean":"2023-08-17T00:12:04.901191+0000","last_became_active":"2023-08-17T00:12:04.894614+0000","last_became_peered":"2023-08-17T00:12:04.894614+0000","last_unstale":"2023-08-17T00:12:04.901191+0000","last_undegraded":"2023-08-17T00:12:04.901191+0000","last_fullsized":"2023-08-17T00:12:04.901191+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892448+0000","last_change":"2023-08-17T00:12:04.446862+0000","last_active":"2023-08-17T00:12:04.892448+0000","last_peered":"2023-08-17T00:12:04.892448+0000","last_clean":"2023-08-17T00:12:04.892448+0000","last_became_active":"2023-08-17T00:12:04.446577+0000","last_became_peered":"2023-08-17T00:12:04.446577+0000","last_unstale":"2023-08-17T00:12:04.892448+0000","last_undegraded":"2023-08-17T00:12:04.892448+0000","last_fullsized":"2023-08-17T00:12:04.892448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.896962+0000","last_change":"2023-08-17T00:12:04.890640+0000","last_active":"2023-08-17T00:12:04.896962+0000","last_peered":"2023-08-17T00:12:04.896962+0000","last_clean":"2023-08-17T00:12:04.896962+0000","last_became_active":"2023-08-17T00:12:04.890221+0000","last_became_peered":"2023-08-17T00:12:04.890221+0000","last_unstale":"2023-08-17T00:12:04.896962+0000","last_undegraded":"2023-08-17T00:12:04.896962+0000","last_fullsized":"2023-08-17T00:12:04.896962+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864182+0000","last_change":"2023-08-17T00:12:04.449933+0000","last_active":"2023-08-17T00:12:04.864182+0000","last_peered":"2023-08-17T00:12:04.864182+0000","last_clean":"2023-08-17T00:12:04.864182+0000","last_became_active":"2023-08-17T00:12:04.449623+0000","last_became_peered":"2023-08-17T00:12:04.449623+0000","last_unstale":"2023-08-17T00:12:04.864182+0000","last_undegraded":"2023-08-17T00:12:04.864182+0000","last_fullsized":"2023-08-17T00:12:04.864182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901217+0000","last_change":"2023-08-17T00:12:04.897435+0000","last_active":"2023-08-17T00:12:04.901217+0000","last_peered":"2023-08-17T00:12:04.901217+0000","last_clean":"2023-08-17T00:12:04.901217+0000","last_became_active":"2023-08-17T00:12:04.890210+0000","last_became_peered":"2023-08-17T00:12:04.890210+0000","last_unstale":"2023-08-17T00:12:04.901217+0000","last_undegraded":"2023-08-17T00:12:04.901217+0000","last_fullsized":"2023-08-17T00:12:04.901217+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873463+0000","last_change":"2023-08-17T00:12:04.452433+0000","last_active":"2023-08-17T00:12:04.873463+0000","last_peered":"2023-08-17T00:12:04.873463+0000","last_clean":"2023-08-17T00:12:04.873463+0000","last_became_active":"2023-08-17T00:12:04.452167+0000","last_became_peered":"2023-08-17T00:12:04.452167+0000","last_unstale":"2023-08-17T00:12:04.873463+0000","last_undegraded":"2023-08-17T00:12:04.873463+0000","last_fullsized":"2023-08-17T00:12:04.873463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897829+0000","last_change":"2023-08-17T00:12:04.891909+0000","last_active":"2023-08-17T00:12:04.897829+0000","last_peered":"2023-08-17T00:12:04.897829+0000","last_clean":"2023-08-17T00:12:04.897829+0000","last_became_active":"2023-08-17T00:12:04.891155+0000","last_became_peered":"2023-08-17T00:12:04.891155+0000","last_unstale":"2023-08-17T00:12:04.897829+0000","last_undegraded":"2023-08-17T00:12:04.897829+0000","last_fullsized":"2023-08-17T00:12:04.897829+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.896155+0000","last_change":"2023-08-17T00:12:04.447613+0000","last_active":"2023-08-17T00:12:04.896155+0000","last_peered":"2023-08-17T00:12:04.896155+0000","last_clean":"2023-08-17T00:12:04.896155+0000","last_became_active":"2023-08-17T00:12:04.447323+0000","last_became_peered":"2023-08-17T00:12:04.447323+0000","last_unstale":"2023-08-17T00:12:04.896155+0000","last_undegraded":"2023-08-17T00:12:04.896155+0000","last_fullsized":"2023-08-17T00:12:04.896155+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889451+0000","last_change":"2023-08-17T00:12:04.884746+0000","last_active":"2023-08-17T00:12:04.889451+0000","last_peered":"2023-08-17T00:12:04.889451+0000","last_clean":"2023-08-17T00:12:04.889451+0000","last_became_active":"2023-08-17T00:12:04.884445+0000","last_became_peered":"2023-08-17T00:12:04.884445+0000","last_unstale":"2023-08-17T00:12:04.889451+0000","last_undegraded":"2023-08-17T00:12:04.889451+0000","last_fullsized":"2023-08-17T00:12:04.889451+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.870757+0000","last_change":"2023-08-17T00:12:04.455465+0000","last_active":"2023-08-17T00:12:04.870757+0000","last_peered":"2023-08-17T00:12:04.870757+0000","last_clean":"2023-08-17T00:12:04.870757+0000","last_became_active":"2023-08-17T00:12:04.455129+0000","last_became_peered":"2023-08-17T00:12:04.455129+0000","last_unstale":"2023-08-17T00:12:04.870757+0000","last_undegraded":"2023-08-17T00:12:04.870757+0000","last_fullsized":"2023-08-17T00:12:04.870757+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890739+0000","last_change":"2023-08-17T00:12:04.887616+0000","last_active":"2023-08-17T00:12:04.890739+0000","last_peered":"2023-08-17T00:12:04.890739+0000","last_clean":"2023-08-17T00:12:04.890739+0000","last_became_active":"2023-08-17T00:12:04.886463+0000","last_became_peered":"2023-08-17T00:12:04.886463+0000","last_unstale":"2023-08-17T00:12:04.890739+0000","last_undegraded":"2023-08-17T00:12:04.890739+0000","last_fullsized":"2023-08-17T00:12:04.890739+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873195+0000","last_change":"2023-08-17T00:12:04.451299+0000","last_active":"2023-08-17T00:12:04.873195+0000","last_peered":"2023-08-17T00:12:04.873195+0000","last_clean":"2023-08-17T00:12:04.873195+0000","last_became_active":"2023-08-17T00:12:04.451039+0000","last_became_peered":"2023-08-17T00:12:04.451039+0000","last_unstale":"2023-08-17T00:12:04.873195+0000","last_undegraded":"2023-08-17T00:12:04.873195+0000","last_fullsized":"2023-08-17T00:12:04.873195+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899963+0000","last_change":"2023-08-17T00:12:04.892589+0000","last_active":"2023-08-17T00:12:04.899963+0000","last_peered":"2023-08-17T00:12:04.899963+0000","last_clean":"2023-08-17T00:12:04.899963+0000","last_became_active":"2023-08-17T00:12:04.892277+0000","last_became_peered":"2023-08-17T00:12:04.892277+0000","last_unstale":"2023-08-17T00:12:04.899963+0000","last_undegraded":"2023-08-17T00:12:04.899963+0000","last_fullsized":"2023-08-17T00:12:04.899963+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890940+0000","last_change":"2023-08-17T00:12:04.444781+0000","last_active":"2023-08-17T00:12:04.890940+0000","last_peered":"2023-08-17T00:12:04.890940+0000","last_clean":"2023-08-17T00:12:04.890940+0000","last_became_active":"2023-08-17T00:12:04.443977+0000","last_became_peered":"2023-08-17T00:12:04.443977+0000","last_unstale":"2023-08-17T00:12:04.890940+0000","last_undegraded":"2023-08-17T00:12:04.890940+0000","last_fullsized":"2023-08-17T00:12:04.890940+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894569+0000","last_change":"2023-08-17T00:12:04.887223+0000","last_active":"2023-08-17T00:12:04.894569+0000","last_peered":"2023-08-17T00:12:04.894569+0000","last_clean":"2023-08-17T00:12:04.894569+0000","last_became_active":"2023-08-17T00:12:04.886651+0000","last_became_peered":"2023-08-17T00:12:04.886651+0000","last_unstale":"2023-08-17T00:12:04.894569+0000","last_undegraded":"2023-08-17T00:12:04.894569+0000","last_fullsized":"2023-08-17T00:12:04.894569+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.871026+0000","last_change":"2023-08-17T00:12:04.455796+0000","last_active":"2023-08-17T00:12:04.871026+0000","last_peered":"2023-08-17T00:12:04.871026+0000","last_clean":"2023-08-17T00:12:04.871026+0000","last_became_active":"2023-08-17T00:12:04.455252+0000","last_became_peered":"2023-08-17T00:12:04.455252+0000","last_unstale":"2023-08-17T00:12:04.871026+0000","last_undegraded":"2023-08-17T00:12:04.871026+0000","last_fullsized":"2023-08-17T00:12:04.871026+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.888481+0000","last_change":"2023-08-17T00:12:04.887656+0000","last_active":"2023-08-17T00:12:04.888481+0000","last_peered":"2023-08-17T00:12:04.888481+0000","last_clean":"2023-08-17T00:12:04.888481+0000","last_became_active":"2023-08-17T00:12:04.887343+0000","last_became_peered":"2023-08-17T00:12:04.887343+0000","last_unstale":"2023-08-17T00:12:04.888481+0000","last_undegraded":"2023-08-17T00:12:04.888481+0000","last_fullsized":"2023-08-17T00:12:04.888481+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895480+0000","last_change":"2023-08-17T00:12:04.446368+0000","last_active":"2023-08-17T00:12:04.895480+0000","last_peered":"2023-08-17T00:12:04.895480+0000","last_clean":"2023-08-17T00:12:04.895480+0000","last_became_active":"2023-08-17T00:12:04.445475+0000","last_became_peered":"2023-08-17T00:12:04.445475+0000","last_unstale":"2023-08-17T00:12:04.895480+0000","last_undegraded":"2023-08-17T00:12:04.895480+0000","last_fullsized":"2023-08-17T00:12:04.895480+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.896938+0000","last_change":"2023-08-17T00:12:04.890473+0000","last_active":"2023-08-17T00:12:04.896938+0000","last_peered":"2023-08-17T00:12:04.896938+0000","last_clean":"2023-08-17T00:12:04.896938+0000","last_became_active":"2023-08-17T00:12:04.889883+0000","last_became_peered":"2023-08-17T00:12:04.889883+0000","last_unstale":"2023-08-17T00:12:04.896938+0000","last_undegraded":"2023-08-17T00:12:04.896938+0000","last_fullsized":"2023-08-17T00:12:04.896938+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.868757+0000","last_change":"2023-08-17T00:12:04.448313+0000","last_active":"2023-08-17T00:12:04.868757+0000","last_peered":"2023-08-17T00:12:04.868757+0000","last_clean":"2023-08-17T00:12:04.868757+0000","last_became_active":"2023-08-17T00:12:04.448038+0000","last_became_peered":"2023-08-17T00:12:04.448038+0000","last_unstale":"2023-08-17T00:12:04.868757+0000","last_undegraded":"2023-08-17T00:12:04.868757+0000","last_fullsized":"2023-08-17T00:12:04.868757+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897061+0000","last_change":"2023-08-17T00:12:04.892688+0000","last_active":"2023-08-17T00:12:04.897061+0000","last_peered":"2023-08-17T00:12:04.897061+0000","last_clean":"2023-08-17T00:12:04.897061+0000","last_became_active":"2023-08-17T00:12:04.892268+0000","last_became_peered":"2023-08-17T00:12:04.892268+0000","last_unstale":"2023-08-17T00:12:04.897061+0000","last_undegraded":"2023-08-17T00:12:04.897061+0000","last_fullsized":"2023-08-17T00:12:04.897061+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.863795+0000","last_change":"2023-08-17T00:12:04.461596+0000","last_active":"2023-08-17T00:12:04.863795+0000","last_peered":"2023-08-17T00:12:04.863795+0000","last_clean":"2023-08-17T00:12:04.863795+0000","last_became_active":"2023-08-17T00:12:04.461279+0000","last_became_peered":"2023-08-17T00:12:04.461279+0000","last_unstale":"2023-08-17T00:12:04.863795+0000","last_undegraded":"2023-08-17T00:12:04.863795+0000","last_fullsized":"2023-08-17T00:12:04.863795+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.883337+0000","last_change":"2023-08-17T00:12:04.875795+0000","last_active":"2023-08-17T00:12:04.883337+0000","last_peered":"2023-08-17T00:12:04.883337+0000","last_clean":"2023-08-17T00:12:04.883337+0000","last_became_active":"2023-08-17T00:12:04.875507+0000","last_became_peered":"2023-08-17T00:12:04.875507+0000","last_unstale":"2023-08-17T00:12:04.883337+0000","last_undegraded":"2023-08-17T00:12:04.883337+0000","last_fullsized":"2023-08-17T00:12:04.883337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.866229+0000","last_change":"2023-08-17T00:12:04.454472+0000","last_active":"2023-08-17T00:12:04.866229+0000","last_peered":"2023-08-17T00:12:04.866229+0000","last_clean":"2023-08-17T00:12:04.866229+0000","last_became_active":"2023-08-17T00:12:04.454194+0000","last_became_peered":"2023-08-17T00:12:04.454194+0000","last_unstale":"2023-08-17T00:12:04.866229+0000","last_undegraded":"2023-08-17T00:12:04.866229+0000","last_fullsized":"2023-08-17T00:12:04.866229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901275+0000","last_change":"2023-08-17T00:12:04.898549+0000","last_active":"2023-08-17T00:12:04.901275+0000","last_peered":"2023-08-17T00:12:04.901275+0000","last_clean":"2023-08-17T00:12:04.901275+0000","last_became_active":"2023-08-17T00:12:04.898111+0000","last_became_peered":"2023-08-17T00:12:04.898111+0000","last_unstale":"2023-08-17T00:12:04.901275+0000","last_undegraded":"2023-08-17T00:12:04.901275+0000","last_fullsized":"2023-08-17T00:12:04.901275+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876582+0000","last_change":"2023-08-17T00:12:04.451063+0000","last_active":"2023-08-17T00:12:04.876582+0000","last_peered":"2023-08-17T00:12:04.876582+0000","last_clean":"2023-08-17T00:12:04.876582+0000","last_became_active":"2023-08-17T00:12:04.450797+0000","last_became_peered":"2023-08-17T00:12:04.450797+0000","last_unstale":"2023-08-17T00:12:04.876582+0000","last_undegraded":"2023-08-17T00:12:04.876582+0000","last_fullsized":"2023-08-17T00:12:04.876582+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895449+0000","last_change":"2023-08-17T00:12:04.890415+0000","last_active":"2023-08-17T00:12:04.895449+0000","last_peered":"2023-08-17T00:12:04.895449+0000","last_clean":"2023-08-17T00:12:04.895449+0000","last_became_active":"2023-08-17T00:12:04.890163+0000","last_became_peered":"2023-08-17T00:12:04.890163+0000","last_unstale":"2023-08-17T00:12:04.895449+0000","last_undegraded":"2023-08-17T00:12:04.895449+0000","last_fullsized":"2023-08-17T00:12:04.895449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.869525+0000","last_change":"2023-08-17T00:12:04.436593+0000","last_active":"2023-08-17T00:12:04.869525+0000","last_peered":"2023-08-17T00:12:04.869525+0000","last_clean":"2023-08-17T00:12:04.869525+0000","last_became_active":"2023-08-17T00:12:04.436242+0000","last_became_peered":"2023-08-17T00:12:04.436242+0000","last_unstale":"2023-08-17T00:12:04.869525+0000","last_undegraded":"2023-08-17T00:12:04.869525+0000","last_fullsized":"2023-08-17T00:12:04.869525+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889345+0000","last_change":"2023-08-17T00:12:04.874979+0000","last_active":"2023-08-17T00:12:04.889345+0000","last_peered":"2023-08-17T00:12:04.889345+0000","last_clean":"2023-08-17T00:12:04.889345+0000","last_became_active":"2023-08-17T00:12:04.874620+0000","last_became_peered":"2023-08-17T00:12:04.874620+0000","last_unstale":"2023-08-17T00:12:04.889345+0000","last_undegraded":"2023-08-17T00:12:04.889345+0000","last_fullsized":"2023-08-17T00:12:04.889345+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.865639+0000","last_change":"2023-08-17T00:12:04.439725+0000","last_active":"2023-08-17T00:12:04.865639+0000","last_peered":"2023-08-17T00:12:04.865639+0000","last_clean":"2023-08-17T00:12:04.865639+0000","last_became_active":"2023-08-17T00:12:04.439404+0000","last_became_peered":"2023-08-17T00:12:04.439404+0000","last_unstale":"2023-08-17T00:12:04.865639+0000","last_undegraded":"2023-08-17T00:12:04.865639+0000","last_fullsized":"2023-08-17T00:12:04.865639+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897719+0000","last_change":"2023-08-17T00:12:04.888078+0000","last_active":"2023-08-17T00:12:04.897719+0000","last_peered":"2023-08-17T00:12:04.897719+0000","last_clean":"2023-08-17T00:12:04.897719+0000","last_became_active":"2023-08-17T00:12:04.887501+0000","last_became_peered":"2023-08-17T00:12:04.887501+0000","last_unstale":"2023-08-17T00:12:04.897719+0000","last_undegraded":"2023-08-17T00:12:04.897719+0000","last_fullsized":"2023-08-17T00:12:04.897719+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867466+0000","last_change":"2023-08-17T00:12:04.446499+0000","last_active":"2023-08-17T00:12:04.867466+0000","last_peered":"2023-08-17T00:12:04.867466+0000","last_clean":"2023-08-17T00:12:04.867466+0000","last_became_active":"2023-08-17T00:12:04.446192+0000","last_became_peered":"2023-08-17T00:12:04.446192+0000","last_unstale":"2023-08-17T00:12:04.867466+0000","last_undegraded":"2023-08-17T00:12:04.867466+0000","last_fullsized":"2023-08-17T00:12:04.867466+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899427+0000","last_change":"2023-08-17T00:12:04.895994+0000","last_active":"2023-08-17T00:12:04.899427+0000","last_peered":"2023-08-17T00:12:04.899427+0000","last_clean":"2023-08-17T00:12:04.899427+0000","last_became_active":"2023-08-17T00:12:04.895718+0000","last_became_peered":"2023-08-17T00:12:04.895718+0000","last_unstale":"2023-08-17T00:12:04.899427+0000","last_undegraded":"2023-08-17T00:12:04.899427+0000","last_fullsized":"2023-08-17T00:12:04.899427+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864417+0000","last_change":"2023-08-17T00:12:04.458217+0000","last_active":"2023-08-17T00:12:04.864417+0000","last_peered":"2023-08-17T00:12:04.864417+0000","last_clean":"2023-08-17T00:12:04.864417+0000","last_became_active":"2023-08-17T00:12:04.454488+0000","last_became_peered":"2023-08-17T00:12:04.454488+0000","last_unstale":"2023-08-17T00:12:04.864417+0000","last_undegraded":"2023-08-17T00:12:04.864417+0000","last_fullsized":"2023-08-17T00:12:04.864417+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897956+0000","last_change":"2023-08-17T00:12:04.887855+0000","last_active":"2023-08-17T00:12:04.897956+0000","last_peered":"2023-08-17T00:12:04.897956+0000","last_clean":"2023-08-17T00:12:04.897956+0000","last_became_active":"2023-08-17T00:12:04.887584+0000","last_became_peered":"2023-08-17T00:12:04.887584+0000","last_unstale":"2023-08-17T00:12:04.897956+0000","last_undegraded":"2023-08-17T00:12:04.897956+0000","last_fullsized":"2023-08-17T00:12:04.897956+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873008+0000","last_change":"2023-08-17T00:12:04.453099+0000","last_active":"2023-08-17T00:12:04.873008+0000","last_peered":"2023-08-17T00:12:04.873008+0000","last_clean":"2023-08-17T00:12:04.873008+0000","last_became_active":"2023-08-17T00:12:04.452746+0000","last_became_peered":"2023-08-17T00:12:04.452746+0000","last_unstale":"2023-08-17T00:12:04.873008+0000","last_undegraded":"2023-08-17T00:12:04.873008+0000","last_fullsized":"2023-08-17T00:12:04.873008+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.898762+0000","last_change":"2023-08-17T00:12:04.889741+0000","last_active":"2023-08-17T00:12:04.898762+0000","last_peered":"2023-08-17T00:12:04.898762+0000","last_clean":"2023-08-17T00:12:04.898762+0000","last_became_active":"2023-08-17T00:12:04.889438+0000","last_became_peered":"2023-08-17T00:12:04.889438+0000","last_unstale":"2023-08-17T00:12:04.898762+0000","last_undegraded":"2023-08-17T00:12:04.898762+0000","last_fullsized":"2023-08-17T00:12:04.898762+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873589+0000","last_change":"2023-08-17T00:12:04.456702+0000","last_active":"2023-08-17T00:12:04.873589+0000","last_peered":"2023-08-17T00:12:04.873589+0000","last_clean":"2023-08-17T00:12:04.873589+0000","last_became_active":"2023-08-17T00:12:04.456409+0000","last_became_peered":"2023-08-17T00:12:04.456409+0000","last_unstale":"2023-08-17T00:12:04.873589+0000","last_undegraded":"2023-08-17T00:12:04.873589+0000","last_fullsized":"2023-08-17T00:12:04.873589+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.898852+0000","last_change":"2023-08-17T00:12:04.891658+0000","last_active":"2023-08-17T00:12:04.898852+0000","last_peered":"2023-08-17T00:12:04.898852+0000","last_clean":"2023-08-17T00:12:04.898852+0000","last_became_active":"2023-08-17T00:12:04.891068+0000","last_became_peered":"2023-08-17T00:12:04.891068+0000","last_unstale":"2023-08-17T00:12:04.898852+0000","last_undegraded":"2023-08-17T00:12:04.898852+0000","last_fullsized":"2023-08-17T00:12:04.898852+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877140+0000","last_change":"2023-08-17T00:12:04.453304+0000","last_active":"2023-08-17T00:12:04.877140+0000","last_peered":"2023-08-17T00:12:04.877140+0000","last_clean":"2023-08-17T00:12:04.877140+0000","last_became_active":"2023-08-17T00:12:04.453029+0000","last_became_peered":"2023-08-17T00:12:04.453029+0000","last_unstale":"2023-08-17T00:12:04.877140+0000","last_undegraded":"2023-08-17T00:12:04.877140+0000","last_fullsized":"2023-08-17T00:12:04.877140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893304+0000","last_change":"2023-08-17T00:12:04.885233+0000","last_active":"2023-08-17T00:12:04.893304+0000","last_peered":"2023-08-17T00:12:04.893304+0000","last_clean":"2023-08-17T00:12:04.893304+0000","last_became_active":"2023-08-17T00:12:04.884945+0000","last_became_peered":"2023-08-17T00:12:04.884945+0000","last_unstale":"2023-08-17T00:12:04.893304+0000","last_undegraded":"2023-08-17T00:12:04.893304+0000","last_fullsized":"2023-08-17T00:12:04.893304+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892423+0000","last_change":"2023-08-17T00:12:04.461502+0000","last_active":"2023-08-17T00:12:04.892423+0000","last_peered":"2023-08-17T00:12:04.892423+0000","last_clean":"2023-08-17T00:12:04.892423+0000","last_became_active":"2023-08-17T00:12:04.460914+0000","last_became_peered":"2023-08-17T00:12:04.460914+0000","last_unstale":"2023-08-17T00:12:04.892423+0000","last_undegraded":"2023-08-17T00:12:04.892423+0000","last_fullsized":"2023-08-17T00:12:04.892423+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897307+0000","last_change":"2023-08-17T00:12:04.890074+0000","last_active":"2023-08-17T00:12:04.897307+0000","last_peered":"2023-08-17T00:12:04.897307+0000","last_clean":"2023-08-17T00:12:04.897307+0000","last_became_active":"2023-08-17T00:12:04.889773+0000","last_became_peered":"2023-08-17T00:12:04.889773+0000","last_unstale":"2023-08-17T00:12:04.897307+0000","last_undegraded":"2023-08-17T00:12:04.897307+0000","last_fullsized":"2023-08-17T00:12:04.897307+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.900012+0000","last_change":"2023-08-17T00:12:04.450187+0000","last_active":"2023-08-17T00:12:04.900012+0000","last_peered":"2023-08-17T00:12:04.900012+0000","last_clean":"2023-08-17T00:12:04.900012+0000","last_became_active":"2023-08-17T00:12:04.448987+0000","last_became_peered":"2023-08-17T00:12:04.448987+0000","last_unstale":"2023-08-17T00:12:04.900012+0000","last_undegraded":"2023-08-17T00:12:04.900012+0000","last_fullsized":"2023-08-17T00:12:04.900012+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892900+0000","last_change":"2023-08-17T00:12:04.884976+0000","last_active":"2023-08-17T00:12:04.892900+0000","last_peered":"2023-08-17T00:12:04.892900+0000","last_clean":"2023-08-17T00:12:04.892900+0000","last_became_active":"2023-08-17T00:12:04.884710+0000","last_became_peered":"2023-08-17T00:12:04.884710+0000","last_unstale":"2023-08-17T00:12:04.892900+0000","last_undegraded":"2023-08-17T00:12:04.892900+0000","last_fullsized":"2023-08-17T00:12:04.892900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890834+0000","last_change":"2023-08-17T00:12:04.444323+0000","last_active":"2023-08-17T00:12:04.890834+0000","last_peered":"2023-08-17T00:12:04.890834+0000","last_clean":"2023-08-17T00:12:04.890834+0000","last_became_active":"2023-08-17T00:12:04.443608+0000","last_became_peered":"2023-08-17T00:12:04.443608+0000","last_unstale":"2023-08-17T00:12:04.890834+0000","last_undegraded":"2023-08-17T00:12:04.890834+0000","last_fullsized":"2023-08-17T00:12:04.890834+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891396+0000","last_change":"2023-08-17T00:12:04.886214+0000","last_active":"2023-08-17T00:12:04.891396+0000","last_peered":"2023-08-17T00:12:04.891396+0000","last_clean":"2023-08-17T00:12:04.891396+0000","last_became_active":"2023-08-17T00:12:04.885281+0000","last_became_peered":"2023-08-17T00:12:04.885281+0000","last_unstale":"2023-08-17T00:12:04.891396+0000","last_undegraded":"2023-08-17T00:12:04.891396+0000","last_fullsized":"2023-08-17T00:12:04.891396+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867802+0000","last_change":"2023-08-17T00:12:04.450610+0000","last_active":"2023-08-17T00:12:04.867802+0000","last_peered":"2023-08-17T00:12:04.867802+0000","last_clean":"2023-08-17T00:12:04.867802+0000","last_became_active":"2023-08-17T00:12:04.450304+0000","last_became_peered":"2023-08-17T00:12:04.450304+0000","last_unstale":"2023-08-17T00:12:04.867802+0000","last_undegraded":"2023-08-17T00:12:04.867802+0000","last_fullsized":"2023-08-17T00:12:04.867802+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894243+0000","last_change":"2023-08-17T00:12:04.888591+0000","last_active":"2023-08-17T00:12:04.894243+0000","last_peered":"2023-08-17T00:12:04.894243+0000","last_clean":"2023-08-17T00:12:04.894243+0000","last_became_active":"2023-08-17T00:12:04.888243+0000","last_became_peered":"2023-08-17T00:12:04.888243+0000","last_unstale":"2023-08-17T00:12:04.894243+0000","last_undegraded":"2023-08-17T00:12:04.894243+0000","last_fullsized":"2023-08-17T00:12:04.894243+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873748+0000","last_change":"2023-08-17T00:12:04.446095+0000","last_active":"2023-08-17T00:12:04.873748+0000","last_peered":"2023-08-17T00:12:04.873748+0000","last_clean":"2023-08-17T00:12:04.873748+0000","last_became_active":"2023-08-17T00:12:04.445786+0000","last_became_peered":"2023-08-17T00:12:04.445786+0000","last_unstale":"2023-08-17T00:12:04.873748+0000","last_undegraded":"2023-08-17T00:12:04.873748+0000","last_fullsized":"2023-08-17T00:12:04.873748+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897977+0000","last_change":"2023-08-17T00:12:04.888900+0000","last_active":"2023-08-17T00:12:04.897977+0000","last_peered":"2023-08-17T00:12:04.897977+0000","last_clean":"2023-08-17T00:12:04.897977+0000","last_became_active":"2023-08-17T00:12:04.888646+0000","last_became_peered":"2023-08-17T00:12:04.888646+0000","last_unstale":"2023-08-17T00:12:04.897977+0000","last_undegraded":"2023-08-17T00:12:04.897977+0000","last_fullsized":"2023-08-17T00:12:04.897977+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.866307+0000","last_change":"2023-08-17T00:12:04.452493+0000","last_active":"2023-08-17T00:12:04.866307+0000","last_peered":"2023-08-17T00:12:04.866307+0000","last_clean":"2023-08-17T00:12:04.866307+0000","last_became_active":"2023-08-17T00:12:04.451990+0000","last_became_peered":"2023-08-17T00:12:04.451990+0000","last_unstale":"2023-08-17T00:12:04.866307+0000","last_undegraded":"2023-08-17T00:12:04.866307+0000","last_fullsized":"2023-08-17T00:12:04.866307+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899084+0000","last_change":"2023-08-17T00:12:04.896793+0000","last_active":"2023-08-17T00:12:04.899084+0000","last_peered":"2023-08-17T00:12:04.899084+0000","last_clean":"2023-08-17T00:12:04.899084+0000","last_became_active":"2023-08-17T00:12:04.896454+0000","last_became_peered":"2023-08-17T00:12:04.896454+0000","last_unstale":"2023-08-17T00:12:04.899084+0000","last_undegraded":"2023-08-17T00:12:04.899084+0000","last_fullsized":"2023-08-17T00:12:04.899084+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876101+0000","last_change":"2023-08-17T00:12:04.451329+0000","last_active":"2023-08-17T00:12:04.876101+0000","last_peered":"2023-08-17T00:12:04.876101+0000","last_clean":"2023-08-17T00:12:04.876101+0000","last_became_active":"2023-08-17T00:12:04.450993+0000","last_became_peered":"2023-08-17T00:12:04.450993+0000","last_unstale":"2023-08-17T00:12:04.876101+0000","last_undegraded":"2023-08-17T00:12:04.876101+0000","last_fullsized":"2023-08-17T00:12:04.876101+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890204+0000","last_change":"2023-08-17T00:12:04.878744+0000","last_active":"2023-08-17T00:12:04.890204+0000","last_peered":"2023-08-17T00:12:04.890204+0000","last_clean":"2023-08-17T00:12:04.890204+0000","last_became_active":"2023-08-17T00:12:04.878390+0000","last_became_peered":"2023-08-17T00:12:04.878390+0000","last_unstale":"2023-08-17T00:12:04.890204+0000","last_undegraded":"2023-08-17T00:12:04.890204+0000","last_fullsized":"2023-08-17T00:12:04.890204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877254+0000","last_change":"2023-08-17T00:12:04.457496+0000","last_active":"2023-08-17T00:12:04.877254+0000","last_peered":"2023-08-17T00:12:04.877254+0000","last_clean":"2023-08-17T00:12:04.877254+0000","last_became_active":"2023-08-17T00:12:04.457137+0000","last_became_peered":"2023-08-17T00:12:04.457137+0000","last_unstale":"2023-08-17T00:12:04.877254+0000","last_undegraded":"2023-08-17T00:12:04.877254+0000","last_fullsized":"2023-08-17T00:12:04.877254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899627+0000","last_change":"2023-08-17T00:12:04.897758+0000","last_active":"2023-08-17T00:12:04.899627+0000","last_peered":"2023-08-17T00:12:04.899627+0000","last_clean":"2023-08-17T00:12:04.899627+0000","last_became_active":"2023-08-17T00:12:04.897490+0000","last_became_peered":"2023-08-17T00:12:04.897490+0000","last_unstale":"2023-08-17T00:12:04.899627+0000","last_undegraded":"2023-08-17T00:12:04.899627+0000","last_fullsized":"2023-08-17T00:12:04.899627+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899822+0000","last_change":"2023-08-17T00:12:04.455936+0000","last_active":"2023-08-17T00:12:04.899822+0000","last_peered":"2023-08-17T00:12:04.899822+0000","last_clean":"2023-08-17T00:12:04.899822+0000","last_became_active":"2023-08-17T00:12:04.455480+0000","last_became_peered":"2023-08-17T00:12:04.455480+0000","last_unstale":"2023-08-17T00:12:04.899822+0000","last_undegraded":"2023-08-17T00:12:04.899822+0000","last_fullsized":"2023-08-17T00:12:04.899822+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897804+0000","last_change":"2023-08-17T00:12:04.889814+0000","last_active":"2023-08-17T00:12:04.897804+0000","last_peered":"2023-08-17T00:12:04.897804+0000","last_clean":"2023-08-17T00:12:04.897804+0000","last_became_active":"2023-08-17T00:12:04.889544+0000","last_became_peered":"2023-08-17T00:12:04.889544+0000","last_unstale":"2023-08-17T00:12:04.897804+0000","last_undegraded":"2023-08-17T00:12:04.897804+0000","last_fullsized":"2023-08-17T00:12:04.897804+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.900371+0000","last_change":"2023-08-17T00:12:04.454729+0000","last_active":"2023-08-17T00:12:04.900371+0000","last_peered":"2023-08-17T00:12:04.900371+0000","last_clean":"2023-08-17T00:12:04.900371+0000","last_became_active":"2023-08-17T00:12:04.454443+0000","last_became_peered":"2023-08-17T00:12:04.454443+0000","last_unstale":"2023-08-17T00:12:04.900371+0000","last_undegraded":"2023-08-17T00:12:04.900371+0000","last_fullsized":"2023-08-17T00:12:04.900371+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894952+0000","last_change":"2023-08-17T00:12:04.887713+0000","last_active":"2023-08-17T00:12:04.894952+0000","last_peered":"2023-08-17T00:12:04.894952+0000","last_clean":"2023-08-17T00:12:04.894952+0000","last_became_active":"2023-08-17T00:12:04.887383+0000","last_became_peered":"2023-08-17T00:12:04.887383+0000","last_unstale":"2023-08-17T00:12:04.894952+0000","last_undegraded":"2023-08-17T00:12:04.894952+0000","last_fullsized":"2023-08-17T00:12:04.894952+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.865737+0000","last_change":"2023-08-17T00:12:04.458765+0000","last_active":"2023-08-17T00:12:04.865737+0000","last_peered":"2023-08-17T00:12:04.865737+0000","last_clean":"2023-08-17T00:12:04.865737+0000","last_became_active":"2023-08-17T00:12:04.458487+0000","last_became_peered":"2023-08-17T00:12:04.458487+0000","last_unstale":"2023-08-17T00:12:04.865737+0000","last_undegraded":"2023-08-17T00:12:04.865737+0000","last_fullsized":"2023-08-17T00:12:04.865737+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897589+0000","last_change":"2023-08-17T00:12:04.892307+0000","last_active":"2023-08-17T00:12:04.897589+0000","last_peered":"2023-08-17T00:12:04.897589+0000","last_clean":"2023-08-17T00:12:04.897589+0000","last_became_active":"2023-08-17T00:12:04.892049+0000","last_became_peered":"2023-08-17T00:12:04.892049+0000","last_unstale":"2023-08-17T00:12:04.897589+0000","last_undegraded":"2023-08-17T00:12:04.897589+0000","last_fullsized":"2023-08-17T00:12:04.897589+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.872833+0000","last_change":"2023-08-17T00:12:04.456524+0000","last_active":"2023-08-17T00:12:04.872833+0000","last_peered":"2023-08-17T00:12:04.872833+0000","last_clean":"2023-08-17T00:12:04.872833+0000","last_became_active":"2023-08-17T00:12:04.456199+0000","last_became_peered":"2023-08-17T00:12:04.456199+0000","last_unstale":"2023-08-17T00:12:04.872833+0000","last_undegraded":"2023-08-17T00:12:04.872833+0000","last_fullsized":"2023-08-17T00:12:04.872833+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897706+0000","last_change":"2023-08-17T00:12:04.891602+0000","last_active":"2023-08-17T00:12:04.897706+0000","last_peered":"2023-08-17T00:12:04.897706+0000","last_clean":"2023-08-17T00:12:04.897706+0000","last_became_active":"2023-08-17T00:12:04.891223+0000","last_became_peered":"2023-08-17T00:12:04.891223+0000","last_unstale":"2023-08-17T00:12:04.897706+0000","last_undegraded":"2023-08-17T00:12:04.897706+0000","last_fullsized":"2023-08-17T00:12:04.897706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899804+0000","last_change":"2023-08-17T00:12:04.451004+0000","last_active":"2023-08-17T00:12:04.899804+0000","last_peered":"2023-08-17T00:12:04.899804+0000","last_clean":"2023-08-17T00:12:04.899804+0000","last_became_active":"2023-08-17T00:12:04.450714+0000","last_became_peered":"2023-08-17T00:12:04.450714+0000","last_unstale":"2023-08-17T00:12:04.899804+0000","last_undegraded":"2023-08-17T00:12:04.899804+0000","last_fullsized":"2023-08-17T00:12:04.899804+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899595+0000","last_change":"2023-08-17T00:12:04.888334+0000","last_active":"2023-08-17T00:12:04.899595+0000","last_peered":"2023-08-17T00:12:04.899595+0000","last_clean":"2023-08-17T00:12:04.899595+0000","last_became_active":"2023-08-17T00:12:04.885611+0000","last_became_peered":"2023-08-17T00:12:04.885611+0000","last_unstale":"2023-08-17T00:12:04.899595+0000","last_undegraded":"2023-08-17T00:12:04.899595+0000","last_fullsized":"2023-08-17T00:12:04.899595+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.871302+0000","last_change":"2023-08-17T00:12:04.443106+0000","last_active":"2023-08-17T00:12:04.871302+0000","last_peered":"2023-08-17T00:12:04.871302+0000","last_clean":"2023-08-17T00:12:04.871302+0000","last_became_active":"2023-08-17T00:12:04.442838+0000","last_became_peered":"2023-08-17T00:12:04.442838+0000","last_unstale":"2023-08-17T00:12:04.871302+0000","last_undegraded":"2023-08-17T00:12:04.871302+0000","last_fullsized":"2023-08-17T00:12:04.871302+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.898988+0000","last_change":"2023-08-17T00:12:04.892490+0000","last_active":"2023-08-17T00:12:04.898988+0000","last_peered":"2023-08-17T00:12:04.898988+0000","last_clean":"2023-08-17T00:12:04.898988+0000","last_became_active":"2023-08-17T00:12:04.892200+0000","last_became_peered":"2023-08-17T00:12:04.892200+0000","last_unstale":"2023-08-17T00:12:04.898988+0000","last_undegraded":"2023-08-17T00:12:04.898988+0000","last_fullsized":"2023-08-17T00:12:04.898988+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877042+0000","last_change":"2023-08-17T00:12:04.453117+0000","last_active":"2023-08-17T00:12:04.877042+0000","last_peered":"2023-08-17T00:12:04.877042+0000","last_clean":"2023-08-17T00:12:04.877042+0000","last_became_active":"2023-08-17T00:12:04.452845+0000","last_became_peered":"2023-08-17T00:12:04.452845+0000","last_unstale":"2023-08-17T00:12:04.877042+0000","last_undegraded":"2023-08-17T00:12:04.877042+0000","last_fullsized":"2023-08-17T00:12:04.877042+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897776+0000","last_change":"2023-08-17T00:12:04.889487+0000","last_active":"2023-08-17T00:12:04.897776+0000","last_peered":"2023-08-17T00:12:04.897776+0000","last_clean":"2023-08-17T00:12:04.897776+0000","last_became_active":"2023-08-17T00:12:04.889226+0000","last_became_peered":"2023-08-17T00:12:04.889226+0000","last_unstale":"2023-08-17T00:12:04.897776+0000","last_undegraded":"2023-08-17T00:12:04.897776+0000","last_fullsized":"2023-08-17T00:12:04.897776+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.863620+0000","last_change":"2023-08-17T00:12:04.453685+0000","last_active":"2023-08-17T00:12:04.863620+0000","last_peered":"2023-08-17T00:12:04.863620+0000","last_clean":"2023-08-17T00:12:04.863620+0000","last_became_active":"2023-08-17T00:12:04.453389+0000","last_became_peered":"2023-08-17T00:12:04.453389+0000","last_unstale":"2023-08-17T00:12:04.863620+0000","last_undegraded":"2023-08-17T00:12:04.863620+0000","last_fullsized":"2023-08-17T00:12:04.863620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901178+0000","last_change":"2023-08-17T00:12:04.895393+0000","last_active":"2023-08-17T00:12:04.901178+0000","last_peered":"2023-08-17T00:12:04.901178+0000","last_clean":"2023-08-17T00:12:04.901178+0000","last_became_active":"2023-08-17T00:12:04.894956+0000","last_became_peered":"2023-08-17T00:12:04.894956+0000","last_unstale":"2023-08-17T00:12:04.901178+0000","last_undegraded":"2023-08-17T00:12:04.901178+0000","last_fullsized":"2023-08-17T00:12:04.901178+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.888037+0000","last_change":"2023-08-17T00:12:04.441712+0000","last_active":"2023-08-17T00:12:04.888037+0000","last_peered":"2023-08-17T00:12:04.888037+0000","last_clean":"2023-08-17T00:12:04.888037+0000","last_became_active":"2023-08-17T00:12:04.441369+0000","last_became_peered":"2023-08-17T00:12:04.441369+0000","last_unstale":"2023-08-17T00:12:04.888037+0000","last_undegraded":"2023-08-17T00:12:04.888037+0000","last_fullsized":"2023-08-17T00:12:04.888037+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899060+0000","last_change":"2023-08-17T00:12:04.891984+0000","last_active":"2023-08-17T00:12:04.899060+0000","last_peered":"2023-08-17T00:12:04.899060+0000","last_clean":"2023-08-17T00:12:04.899060+0000","last_became_active":"2023-08-17T00:12:04.889781+0000","last_became_peered":"2023-08-17T00:12:04.889781+0000","last_unstale":"2023-08-17T00:12:04.899060+0000","last_undegraded":"2023-08-17T00:12:04.899060+0000","last_fullsized":"2023-08-17T00:12:04.899060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864064+0000","last_change":"2023-08-17T00:12:04.461048+0000","last_active":"2023-08-17T00:12:04.864064+0000","last_peered":"2023-08-17T00:12:04.864064+0000","last_clean":"2023-08-17T00:12:04.864064+0000","last_became_active":"2023-08-17T00:12:04.459924+0000","last_became_peered":"2023-08-17T00:12:04.459924+0000","last_unstale":"2023-08-17T00:12:04.864064+0000","last_undegraded":"2023-08-17T00:12:04.864064+0000","last_fullsized":"2023-08-17T00:12:04.864064+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891354+0000","last_change":"2023-08-17T00:12:04.887199+0000","last_active":"2023-08-17T00:12:04.891354+0000","last_peered":"2023-08-17T00:12:04.891354+0000","last_clean":"2023-08-17T00:12:04.891354+0000","last_became_active":"2023-08-17T00:12:04.886908+0000","last_became_peered":"2023-08-17T00:12:04.886908+0000","last_unstale":"2023-08-17T00:12:04.891354+0000","last_undegraded":"2023-08-17T00:12:04.891354+0000","last_fullsized":"2023-08-17T00:12:04.891354+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.865854+0000","last_change":"2023-08-17T00:12:04.459888+0000","last_active":"2023-08-17T00:12:04.865854+0000","last_peered":"2023-08-17T00:12:04.865854+0000","last_clean":"2023-08-17T00:12:04.865854+0000","last_became_active":"2023-08-17T00:12:04.459598+0000","last_became_peered":"2023-08-17T00:12:04.459598+0000","last_unstale":"2023-08-17T00:12:04.865854+0000","last_undegraded":"2023-08-17T00:12:04.865854+0000","last_fullsized":"2023-08-17T00:12:04.865854+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899065+0000","last_change":"2023-08-17T00:12:04.891911+0000","last_active":"2023-08-17T00:12:04.899065+0000","last_peered":"2023-08-17T00:12:04.899065+0000","last_clean":"2023-08-17T00:12:04.899065+0000","last_became_active":"2023-08-17T00:12:04.891513+0000","last_became_peered":"2023-08-17T00:12:04.891513+0000","last_unstale":"2023-08-17T00:12:04.899065+0000","last_undegraded":"2023-08-17T00:12:04.899065+0000","last_fullsized":"2023-08-17T00:12:04.899065+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.879057+0000","last_change":"2023-08-17T00:12:04.450883+0000","last_active":"2023-08-17T00:12:04.879057+0000","last_peered":"2023-08-17T00:12:04.879057+0000","last_clean":"2023-08-17T00:12:04.879057+0000","last_became_active":"2023-08-17T00:12:04.450464+0000","last_became_peered":"2023-08-17T00:12:04.450464+0000","last_unstale":"2023-08-17T00:12:04.879057+0000","last_undegraded":"2023-08-17T00:12:04.879057+0000","last_fullsized":"2023-08-17T00:12:04.879057+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901172+0000","last_change":"2023-08-17T00:12:04.895054+0000","last_active":"2023-08-17T00:12:04.901172+0000","last_peered":"2023-08-17T00:12:04.901172+0000","last_clean":"2023-08-17T00:12:04.901172+0000","last_became_active":"2023-08-17T00:12:04.894194+0000","last_became_peered":"2023-08-17T00:12:04.894194+0000","last_unstale":"2023-08-17T00:12:04.901172+0000","last_undegraded":"2023-08-17T00:12:04.901172+0000","last_fullsized":"2023-08-17T00:12:04.901172+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864620+0000","last_change":"2023-08-17T00:12:04.454748+0000","last_active":"2023-08-17T00:12:04.864620+0000","last_peered":"2023-08-17T00:12:04.864620+0000","last_clean":"2023-08-17T00:12:04.864620+0000","last_became_active":"2023-08-17T00:12:04.454186+0000","last_became_peered":"2023-08-17T00:12:04.454186+0000","last_unstale":"2023-08-17T00:12:04.864620+0000","last_undegraded":"2023-08-17T00:12:04.864620+0000","last_fullsized":"2023-08-17T00:12:04.864620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890289+0000","last_change":"2023-08-17T00:12:04.883706+0000","last_active":"2023-08-17T00:12:04.890289+0000","last_peered":"2023-08-17T00:12:04.890289+0000","last_clean":"2023-08-17T00:12:04.890289+0000","last_became_active":"2023-08-17T00:12:04.883221+0000","last_became_peered":"2023-08-17T00:12:04.883221+0000","last_unstale":"2023-08-17T00:12:04.890289+0000","last_undegraded":"2023-08-17T00:12:04.890289+0000","last_fullsized":"2023-08-17T00:12:04.890289+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.871501+0000","last_change":"2023-08-17T00:12:04.452091+0000","last_active":"2023-08-17T00:12:04.871501+0000","last_peered":"2023-08-17T00:12:04.871501+0000","last_clean":"2023-08-17T00:12:04.871501+0000","last_became_active":"2023-08-17T00:12:04.451752+0000","last_became_peered":"2023-08-17T00:12:04.451752+0000","last_unstale":"2023-08-17T00:12:04.871501+0000","last_undegraded":"2023-08-17T00:12:04.871501+0000","last_fullsized":"2023-08-17T00:12:04.871501+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.886787+0000","last_change":"2023-08-17T00:12:04.884124+0000","last_active":"2023-08-17T00:12:04.886787+0000","last_peered":"2023-08-17T00:12:04.886787+0000","last_clean":"2023-08-17T00:12:04.886787+0000","last_became_active":"2023-08-17T00:12:04.883822+0000","last_became_peered":"2023-08-17T00:12:04.883822+0000","last_unstale":"2023-08-17T00:12:04.886787+0000","last_undegraded":"2023-08-17T00:12:04.886787+0000","last_fullsized":"2023-08-17T00:12:04.886787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867922+0000","last_change":"2023-08-17T00:12:04.449711+0000","last_active":"2023-08-17T00:12:04.867922+0000","last_peered":"2023-08-17T00:12:04.867922+0000","last_clean":"2023-08-17T00:12:04.867922+0000","last_became_active":"2023-08-17T00:12:04.449434+0000","last_became_peered":"2023-08-17T00:12:04.449434+0000","last_unstale":"2023-08-17T00:12:04.867922+0000","last_undegraded":"2023-08-17T00:12:04.867922+0000","last_fullsized":"2023-08-17T00:12:04.867922+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895490+0000","last_change":"2023-08-17T00:12:04.889049+0000","last_active":"2023-08-17T00:12:04.895490+0000","last_peered":"2023-08-17T00:12:04.895490+0000","last_clean":"2023-08-17T00:12:04.895490+0000","last_became_active":"2023-08-17T00:12:04.888751+0000","last_became_peered":"2023-08-17T00:12:04.888751+0000","last_unstale":"2023-08-17T00:12:04.895490+0000","last_undegraded":"2023-08-17T00:12:04.895490+0000","last_fullsized":"2023-08-17T00:12:04.895490+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.863777+0000","last_change":"2023-08-17T00:12:04.458404+0000","last_active":"2023-08-17T00:12:04.863777+0000","last_peered":"2023-08-17T00:12:04.863777+0000","last_clean":"2023-08-17T00:12:04.863777+0000","last_became_active":"2023-08-17T00:12:04.458075+0000","last_became_peered":"2023-08-17T00:12:04.458075+0000","last_unstale":"2023-08-17T00:12:04.863777+0000","last_undegraded":"2023-08-17T00:12:04.863777+0000","last_fullsized":"2023-08-17T00:12:04.863777+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.883481+0000","last_change":"2023-08-17T00:12:04.875892+0000","last_active":"2023-08-17T00:12:04.883481+0000","last_peered":"2023-08-17T00:12:04.883481+0000","last_clean":"2023-08-17T00:12:04.883481+0000","last_became_active":"2023-08-17T00:12:04.875564+0000","last_became_peered":"2023-08-17T00:12:04.875564+0000","last_unstale":"2023-08-17T00:12:04.883481+0000","last_undegraded":"2023-08-17T00:12:04.883481+0000","last_fullsized":"2023-08-17T00:12:04.883481+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892113+0000","last_change":"2023-08-17T00:12:04.445674+0000","last_active":"2023-08-17T00:12:04.892113+0000","last_peered":"2023-08-17T00:12:04.892113+0000","last_clean":"2023-08-17T00:12:04.892113+0000","last_became_active":"2023-08-17T00:12:04.445404+0000","last_became_peered":"2023-08-17T00:12:04.445404+0000","last_unstale":"2023-08-17T00:12:04.892113+0000","last_undegraded":"2023-08-17T00:12:04.892113+0000","last_fullsized":"2023-08-17T00:12:04.892113+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876659+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:12:04.876659+0000","last_peered":"2023-08-17T00:12:04.876659+0000","last_clean":"2023-08-17T00:12:04.876659+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:12:04.876659+0000","last_undegraded":"2023-08-17T00:12:04.876659+0000","last_fullsized":"2023-08-17T00:12:04.876659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895271+0000","last_change":"2023-08-17T00:12:04.887323+0000","last_active":"2023-08-17T00:12:04.895271+0000","last_peered":"2023-08-17T00:12:04.895271+0000","last_clean":"2023-08-17T00:12:04.895271+0000","last_became_active":"2023-08-17T00:12:04.887025+0000","last_became_peered":"2023-08-17T00:12:04.887025+0000","last_unstale":"2023-08-17T00:12:04.895271+0000","last_undegraded":"2023-08-17T00:12:04.895271+0000","last_fullsized":"2023-08-17T00:12:04.895271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891736+0000","last_change":"2023-08-17T00:12:04.445803+0000","last_active":"2023-08-17T00:12:04.891736+0000","last_peered":"2023-08-17T00:12:04.891736+0000","last_clean":"2023-08-17T00:12:04.891736+0000","last_became_active":"2023-08-17T00:12:04.445334+0000","last_became_peered":"2023-08-17T00:12:04.445334+0000","last_unstale":"2023-08-17T00:12:04.891736+0000","last_undegraded":"2023-08-17T00:12:04.891736+0000","last_fullsized":"2023-08-17T00:12:04.891736+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.866174+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:12:04.866174+0000","last_peered":"2023-08-17T00:12:04.866174+0000","last_clean":"2023-08-17T00:12:04.866174+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:12:04.866174+0000","last_undegraded":"2023-08-17T00:12:04.866174+0000","last_fullsized":"2023-08-17T00:12:04.866174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891708+0000","last_change":"2023-08-17T00:12:04.885649+0000","last_active":"2023-08-17T00:12:04.891708+0000","last_peered":"2023-08-17T00:12:04.891708+0000","last_clean":"2023-08-17T00:12:04.891708+0000","last_became_active":"2023-08-17T00:12:04.885370+0000","last_became_peered":"2023-08-17T00:12:04.885370+0000","last_unstale":"2023-08-17T00:12:04.891708+0000","last_undegraded":"2023-08-17T00:12:04.891708+0000","last_fullsized":"2023-08-17T00:12:04.891708+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.878338+0000","last_change":"2023-08-17T00:12:04.452250+0000","last_active":"2023-08-17T00:12:04.878338+0000","last_peered":"2023-08-17T00:12:04.878338+0000","last_clean":"2023-08-17T00:12:04.878338+0000","last_became_active":"2023-08-17T00:12:04.451957+0000","last_became_peered":"2023-08-17T00:12:04.451957+0000","last_unstale":"2023-08-17T00:12:04.878338+0000","last_undegraded":"2023-08-17T00:12:04.878338+0000","last_fullsized":"2023-08-17T00:12:04.878338+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.875161+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:12:04.875161+0000","last_peered":"2023-08-17T00:12:04.875161+0000","last_clean":"2023-08-17T00:12:04.875161+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:12:04.875161+0000","last_undegraded":"2023-08-17T00:12:04.875161+0000","last_fullsized":"2023-08-17T00:12:04.875161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.887676+0000","last_change":"2023-08-17T00:12:04.882281+0000","last_active":"2023-08-17T00:12:04.887676+0000","last_peered":"2023-08-17T00:12:04.887676+0000","last_clean":"2023-08-17T00:12:04.887676+0000","last_became_active":"2023-08-17T00:12:04.882011+0000","last_became_peered":"2023-08-17T00:12:04.882011+0000","last_unstale":"2023-08-17T00:12:04.887676+0000","last_undegraded":"2023-08-17T00:12:04.887676+0000","last_fullsized":"2023-08-17T00:12:04.887676+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.879633+0000","last_change":"2023-08-17T00:12:04.447944+0000","last_active":"2023-08-17T00:12:04.879633+0000","last_peered":"2023-08-17T00:12:04.879633+0000","last_clean":"2023-08-17T00:12:04.879633+0000","last_became_active":"2023-08-17T00:12:04.446686+0000","last_became_peered":"2023-08-17T00:12:04.446686+0000","last_unstale":"2023-08-17T00:12:04.879633+0000","last_undegraded":"2023-08-17T00:12:04.879633+0000","last_fullsized":"2023-08-17T00:12:04.879633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867742+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:12:04.867742+0000","last_peered":"2023-08-17T00:12:04.867742+0000","last_clean":"2023-08-17T00:12:04.867742+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:12:04.867742+0000","last_undegraded":"2023-08-17T00:12:04.867742+0000","last_fullsized":"2023-08-17T00:12:04.867742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897601+0000","last_change":"2023-08-17T00:12:04.887117+0000","last_active":"2023-08-17T00:12:04.897601+0000","last_peered":"2023-08-17T00:12:04.897601+0000","last_clean":"2023-08-17T00:12:04.897601+0000","last_became_active":"2023-08-17T00:12:04.886758+0000","last_became_peered":"2023-08-17T00:12:04.886758+0000","last_unstale":"2023-08-17T00:12:04.897601+0000","last_undegraded":"2023-08-17T00:12:04.897601+0000","last_fullsized":"2023-08-17T00:12:04.897601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864955+0000","last_change":"2023-08-17T00:12:04.450034+0000","last_active":"2023-08-17T00:12:04.864955+0000","last_peered":"2023-08-17T00:12:04.864955+0000","last_clean":"2023-08-17T00:12:04.864955+0000","last_became_active":"2023-08-17T00:12:04.449526+0000","last_became_peered":"2023-08-17T00:12:04.449526+0000","last_unstale":"2023-08-17T00:12:04.864955+0000","last_undegraded":"2023-08-17T00:12:04.864955+0000","last_fullsized":"2023-08-17T00:12:04.864955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873090+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:12:04.873090+0000","last_peered":"2023-08-17T00:12:04.873090+0000","last_clean":"2023-08-17T00:12:04.873090+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:12:04.873090+0000","last_undegraded":"2023-08-17T00:12:04.873090+0000","last_fullsized":"2023-08-17T00:12:04.873090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890266+0000","last_change":"2023-08-17T00:12:04.883488+0000","last_active":"2023-08-17T00:12:04.890266+0000","last_peered":"2023-08-17T00:12:04.890266+0000","last_clean":"2023-08-17T00:12:04.890266+0000","last_became_active":"2023-08-17T00:12:04.882813+0000","last_became_peered":"2023-08-17T00:12:04.882813+0000","last_unstale":"2023-08-17T00:12:04.890266+0000","last_undegraded":"2023-08-17T00:12:04.890266+0000","last_fullsized":"2023-08-17T00:12:04.890266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.878980+0000","last_change":"2023-08-17T00:12:04.448160+0000","last_active":"2023-08-17T00:12:04.878980+0000","last_peered":"2023-08-17T00:12:04.878980+0000","last_clean":"2023-08-17T00:12:04.878980+0000","last_became_active":"2023-08-17T00:12:04.447821+0000","last_became_peered":"2023-08-17T00:12:04.447821+0000","last_unstale":"2023-08-17T00:12:04.878980+0000","last_undegraded":"2023-08-17T00:12:04.878980+0000","last_fullsized":"2023-08-17T00:12:04.878980+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877166+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:12:04.877166+0000","last_peered":"2023-08-17T00:12:04.877166+0000","last_clean":"2023-08-17T00:12:04.877166+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:12:04.877166+0000","last_undegraded":"2023-08-17T00:12:04.877166+0000","last_fullsized":"2023-08-17T00:12:04.877166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.883344+0000","last_change":"2023-08-17T00:12:04.875220+0000","last_active":"2023-08-17T00:12:04.883344+0000","last_peered":"2023-08-17T00:12:04.883344+0000","last_clean":"2023-08-17T00:12:04.883344+0000","last_became_active":"2023-08-17T00:12:04.874920+0000","last_became_peered":"2023-08-17T00:12:04.874920+0000","last_unstale":"2023-08-17T00:12:04.883344+0000","last_undegraded":"2023-08-17T00:12:04.883344+0000","last_fullsized":"2023-08-17T00:12:04.883344+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895434+0000","last_change":"2023-08-17T00:12:04.462284+0000","last_active":"2023-08-17T00:12:04.895434+0000","last_peered":"2023-08-17T00:12:04.895434+0000","last_clean":"2023-08-17T00:12:04.895434+0000","last_became_active":"2023-08-17T00:12:04.461990+0000","last_became_peered":"2023-08-17T00:12:04.461990+0000","last_unstale":"2023-08-17T00:12:04.895434+0000","last_undegraded":"2023-08-17T00:12:04.895434+0000","last_fullsized":"2023-08-17T00:12:04.895434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877506+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:12:04.877506+0000","last_peered":"2023-08-17T00:12:04.877506+0000","last_clean":"2023-08-17T00:12:04.877506+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:12:04.877506+0000","last_undegraded":"2023-08-17T00:12:04.877506+0000","last_fullsized":"2023-08-17T00:12:04.877506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897661+0000","last_change":"2023-08-17T00:12:04.891837+0000","last_active":"2023-08-17T00:12:04.897661+0000","last_peered":"2023-08-17T00:12:04.897661+0000","last_clean":"2023-08-17T00:12:04.897661+0000","last_became_active":"2023-08-17T00:12:04.891509+0000","last_became_peered":"2023-08-17T00:12:04.891509+0000","last_unstale":"2023-08-17T00:12:04.897661+0000","last_undegraded":"2023-08-17T00:12:04.897661+0000","last_fullsized":"2023-08-17T00:12:04.897661+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893607+0000","last_change":"2023-08-17T00:12:04.450133+0000","last_active":"2023-08-17T00:12:04.893607+0000","last_peered":"2023-08-17T00:12:04.893607+0000","last_clean":"2023-08-17T00:12:04.893607+0000","last_became_active":"2023-08-17T00:12:04.449836+0000","last_became_peered":"2023-08-17T00:12:04.449836+0000","last_unstale":"2023-08-17T00:12:04.893607+0000","last_undegraded":"2023-08-17T00:12:04.893607+0000","last_fullsized":"2023-08-17T00:12:04.893607+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.874981+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:12:04.874981+0000","last_peered":"2023-08-17T00:12:04.874981+0000","last_clean":"2023-08-17T00:12:04.874981+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:12:04.874981+0000","last_undegraded":"2023-08-17T00:12:04.874981+0000","last_fullsized":"2023-08-17T00:12:04.874981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873987+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:12:04.873987+0000","last_peered":"2023-08-17T00:12:04.873987+0000","last_clean":"2023-08-17T00:12:04.873987+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:12:04.873987+0000","last_undegraded":"2023-08-17T00:12:04.873987+0000","last_fullsized":"2023-08-17T00:12:04.873987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1568768,"data_stored":730175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1,"15min":1.2450000000000001},"min":{"1min":0.60799999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.601,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":0.747},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.075,"15min":1.298},"min":{"1min":0.64800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1379999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":0.874}]},{"osd":1,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.091,"15min":1.3129999999999999},"min":{"1min":0.78800000000000003,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.431,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.0820000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5620000000000001,"5min":1.782,"15min":8.8399999999999999},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.048,"15min":1.2110000000000001},"min":{"1min":0.65800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.478,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.355},"min":{"1min":0.63900000000000001,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.8340000000000001,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.093}]},{"osd":3,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.109,"15min":1.254},"min":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5649999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.125,"5min":1.2170000000000001,"15min":1.532},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.782,"5min":1.952,"15min":13.074999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1599999999999999,"15min":1.4910000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.2370000000000001,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.413},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.796,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.262,"15min":1.615},"min":{"1min":0.72299999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0840000000000001,"5min":2.9830000000000001,"15min":14.435},"last":1.244},{"interface":"front","average":{"1min":1.24,"5min":1.2649999999999999,"15min":1.583},"min":{"1min":0.77800000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.026}]},{"osd":6,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3180000000000001,"15min":1.607},"min":{"1min":0.82799999999999996,"5min":0.81299999999999994,"15min":0.80600000000000005},"max":{"1min":2.427,"5min":2.427,"15min":11.279999999999999},"last":1.278},{"interface":"front","average":{"1min":1.194,"5min":1.2529999999999999,"15min":1.528},"min":{"1min":0.71799999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.9299999999999999,"5min":2.4350000000000001,"15min":11.365},"last":1.0620000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1568768,"data_stored":729789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.056,"15min":1.0600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.496,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.121,"15min":1.139},"min":{"1min":0.59299999999999997,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":1.3779999999999999,"5min":10.519,"15min":10.519},"last":1.139}]},{"osd":1,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1659999999999999,"15min":1.1439999999999999},"min":{"1min":0.68700000000000006,"5min":0.443,"15min":0.443},"max":{"1min":1.347,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.56000000000000005,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.726,"5min":3.4460000000000002,"15min":11.391999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1399999999999999,"15min":1.165},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.494,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.022},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.296,"15min":1.2849999999999999},"min":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.476,"5min":10.669,"15min":10.669},"last":1.371}]},{"osd":3,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.1719999999999999},"min":{"1min":0.73899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":11.475},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.82299999999999995,"5min":0.70899999999999996,"15min":0.64500000000000002},"max":{"1min":1.55,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.093}]},{"osd":4,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.3120000000000001,"15min":1.284},"min":{"1min":0.72799999999999998,"5min":0.629,"15min":0.59199999999999997},"max":{"1min":1.992,"5min":10.632,"15min":10.632},"last":1.415},{"interface":"front","average":{"1min":1.123,"5min":1.226,"15min":1.2450000000000001},"min":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.4340000000000002,"5min":5.8280000000000003,"15min":11.438000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.266,"15min":1.2629999999999999},"min":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.591,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.4099999999999999,"15min":1.3720000000000001},"min":{"1min":0.76000000000000001,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.7310000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.302,"15min":1.3340000000000001},"min":{"1min":0.67100000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.579,"5min":3.3450000000000002,"15min":11.51},"last":1.216},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.3799999999999999,"15min":1.4119999999999999},"min":{"1min":0.81699999999999995,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.837,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.266}]}]},{"osd":5,"up_from":14,"seq":60129542260,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":1572864,"data_stored":730749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.002,"15min":1.3779999999999999},"min":{"1min":0.55100000000000005,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.6060000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.135},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.012,"15min":1.494},"min":{"1min":0.72299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.556,"5min":1.556,"15min":16.838999999999999},"last":1.4550000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0409999999999999,"15min":1.135},"min":{"1min":0.67200000000000004,"5min":0.53900000000000003,"15min":0.498},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.103,"15min":1.3580000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.3360000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.546},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":16.675000000000001},"last":1.196},{"interface":"front","average":{"1min":1.169,"5min":1.123,"15min":1.431},"min":{"1min":0.77300000000000002,"5min":0.64600000000000002,"15min":0.60299999999999998},"max":{"1min":1.6359999999999999,"5min":1.796,"15min":11.949},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1519999999999999,"15min":1.4770000000000001},"min":{"1min":0.70699999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6639999999999999,"5min":2.1349999999999998,"15min":13.125},"last":1.294},{"interface":"front","average":{"1min":1.204,"5min":1.177,"15min":1.4059999999999999},"min":{"1min":0.91500000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.704,"15min":8.4809999999999999},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.139,"15min":1.597},"min":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.581,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.236},{"interface":"front","average":{"1min":1.121,"5min":1.1970000000000001,"15min":1.72},"min":{"1min":0.61499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.51,"5min":1.7649999999999999,"15min":19.591000000000001},"last":1.3680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2250000000000001,"15min":1.6910000000000001},"min":{"1min":0.85099999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.6359999999999999,"5min":1.9350000000000001,"15min":17.158000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.238,"15min":1.694},"min":{"1min":0.75,"5min":0.65800000000000003,"15min":0.64400000000000002},"max":{"1min":1.5589999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2909999999999999,"15min":1.8},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5589999999999999,"5min":1.9610000000000001,"15min":18.158000000000001},"last":1.411},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.353,"15min":1.7410000000000001},"min":{"1min":1.006,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.859,"5min":2.0899999999999999,"15min":14.818},"last":1.2629999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542259,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302848,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068992,"statfs":{"total":96636764160,"available":96326647808,"internally_reserved":0,"allocated":1564672,"data_stored":729303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54900000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.625,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.58199999999999996,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2390000000000001,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.81599999999999995,"15min":0.90300000000000002},"min":{"1min":0.60799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2889999999999999,"5min":1.6299999999999999,"15min":2.5840000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.89800000000000002,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.25,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.997,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.4019999999999999,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.161,"15min":1.206},"min":{"1min":0.83499999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4590000000000001,"5min":2.274,"15min":3.9449999999999998},"last":1.022},{"interface":"front","average":{"1min":1.196,"5min":1.1519999999999999,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.734,"15min":3.9790000000000001},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.135,"15min":1.216},"min":{"1min":0.65200000000000002,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.579,"5min":1.883,"15min":2.1309999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1910000000000001,"15min":1.264},"min":{"1min":0.92800000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6539999999999999,"5min":1.669,"15min":2.6789999999999998},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.147,"15min":1.246},"min":{"1min":0.78500000000000003,"5min":0.64500000000000002,"15min":0.58299999999999996},"max":{"1min":1.623,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1639999999999999,"15min":1.2090000000000001},"min":{"1min":0.82299999999999995,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.968,"5min":2.0979999999999999,"15min":3.585},"last":0.89800000000000002}]},{"osd":7,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.2450000000000001},"min":{"1min":0.92100000000000004,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.907,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.153,"15min":1.234},"min":{"1min":0.81599999999999995,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.746,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.84499999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542259,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306948,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064892,"statfs":{"total":96636764160,"available":96322449408,"internally_reserved":0,"allocated":1568768,"data_stored":729857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.83799999999999997},"min":{"1min":0.5,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.4359999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.76400000000000001,"15min":0.94199999999999995},"min":{"1min":0.57199999999999995,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61099999999999999,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.286,"5min":2.097,"15min":3.7589999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.91300000000000003,"15min":1.0449999999999999},"min":{"1min":0.69199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2949999999999999,"5min":1.3799999999999999,"15min":3.911},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":1.1220000000000001},"min":{"1min":0.628,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":5.4059999999999997},"last":1.004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.98699999999999999},"min":{"1min":0.63500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4910000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0860000000000001,"15min":1.5900000000000001},"min":{"1min":0.76800000000000002,"5min":0.61699999999999999,"15min":0.48399999999999999},"max":{"1min":1.794,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.218},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.91700000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":8.4399999999999995},"last":1.2330000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2569999999999999,"15min":1.5980000000000001},"min":{"1min":1.107,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.734,"5min":1.734,"15min":12.914},"last":1.29},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.4430000000000001},"min":{"1min":0.94199999999999995,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.772,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1990000000000001,"15min":1.5469999999999999},"min":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":1.621,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.621},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2410000000000001,"15min":1.5960000000000001},"min":{"1min":1.03,"5min":0.82899999999999996,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":1.6879999999999999,"15min":12.698},"last":1.405}]},{"osd":7,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.5720000000000001},"min":{"1min":1.0109999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.627,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3129999999999999,"15min":1.583},"min":{"1min":0.79200000000000004,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.9159999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.75}]}]},{"osd":1,"up_from":14,"seq":60129542259,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1568768,"data_stored":729373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":2.6970000000000001,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.90400000000000003},"min":{"1min":0.501,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":13.093},"last":1.026}]},{"osd":2,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76000000000000001,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.84199999999999997,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.432,"15min":0.432},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.96199999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.95499999999999996,"15min":1.02},"min":{"1min":0.57799999999999996,"5min":0.437,"15min":0.437},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.077,"5min":0.875,"15min":0.97499999999999998},"min":{"1min":0.55100000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.032,"15min":1.1559999999999999},"min":{"1min":0.67700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.345,"5min":1.629,"15min":20.548999999999999},"last":1.357},{"interface":"front","average":{"1min":1.216,"5min":1.123,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.1970000000000001,"15min":1.3280000000000001},"min":{"1min":0.69499999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"max":{"1min":3.137,"5min":3.137,"15min":13.170999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.1890000000000001,"15min":1.26},"min":{"1min":0.97799999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9690000000000001,"5min":1.9990000000000001,"15min":5.4240000000000004},"last":1.3009999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.1839999999999999,"15min":1.264},"min":{"1min":0.71499999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.175,"15min":1.2130000000000001},"min":{"1min":0.93700000000000006,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":2.0150000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.1859999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2490000000000001,"15min":1.3200000000000001},"min":{"1min":0.85299999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.1520000000000001,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.2589999999999999,"15min":1.3560000000000001},"min":{"1min":1.008,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.2669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306948,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064892,"statfs":{"total":96636764160,"available":96322449408,"internally_reserved":0,"allocated":1568768,"data_stored":729801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.94899999999999995,"15min":0.83799999999999997},"min":{"1min":0.46800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1279999999999999,"5min":18.442,"15min":18.442},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.90100000000000002,"15min":0.83199999999999996},"min":{"1min":0.42399999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.01,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.044,"15min":0.94499999999999995},"min":{"1min":0.52400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.286,"5min":18.481999999999999,"15min":18.481999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97799999999999998,"15min":0.91600000000000004},"min":{"1min":0.60099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3029999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.105,"5min":1.613,"15min":1.613},"last":0.97099999999999997},{"interface":"front","average":{"1min":1,"5min":1.153,"15min":1.071},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3460000000000001,"5min":18.577000000000002,"15min":18.577000000000002},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.069,"15min":1.101},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.419,"5min":1.5800000000000001,"15min":1.7609999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.3540000000000001,"15min":1.2549999999999999},"min":{"1min":0.77000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.49,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.127}]},{"osd":5,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3939999999999999,"15min":1.3100000000000001},"min":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.579,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.194,"15min":1.2589999999999999},"min":{"1min":0.83499999999999996,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.5129999999999999,"5min":1.984,"15min":1.984},"last":1.286}]},{"osd":6,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.373,"15min":1.323},"min":{"1min":0.82299999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4430000000000001,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.3640000000000001,"15min":1.296},"min":{"1min":0.746,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5049999999999999,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.161}]},{"osd":7,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4019999999999999,"15min":1.3140000000000001},"min":{"1min":0.78100000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.486,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.242},{"interface":"front","average":{"1min":1.087,"5min":1.1559999999999999,"15min":1.226},"min":{"1min":0.72799999999999998,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.599,"5min":1.804,"15min":2.0750000000000002},"last":1.1020000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1568768,"data_stored":729269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1160000000000001,"15min":1.093},"min":{"1min":0.622,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.677,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.111,"15min":1.075},"min":{"1min":0.74399999999999999,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":1.7330000000000001,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":1.05}]},{"osd":1,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2809999999999999,"15min":1.2410000000000001},"min":{"1min":0.64600000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5089999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.268,"15min":1.256},"min":{"1min":0.73099999999999998,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2949999999999999,"15min":1.242},"min":{"1min":0.67700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.389,"5min":18.431000000000001,"15min":18.431000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.482,"15min":1.3440000000000001},"min":{"1min":0.755,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.583,"5min":36.531999999999996,"15min":36.531999999999996},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.135},"min":{"1min":0.85999999999999999,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":1.3400000000000001,"5min":2.722,"15min":2.722},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.4319999999999999,"15min":1.421},"min":{"1min":0.98399999999999999,"5min":0.746,"15min":0.40400000000000003},"max":{"1min":1.742,"5min":19.484999999999999,"15min":36.530000000000001},"last":1.343}]},{"osd":5,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.298,"15min":1.252},"min":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.433},"max":{"1min":1.7030000000000001,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3600000000000001,"15min":1.3069999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.63500000000000001},"max":{"1min":1.6299999999999999,"5min":9.4120000000000008,"15min":9.4120000000000008},"last":1.2290000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.89300000000000002,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.875,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.385,"15min":1.4199999999999999},"min":{"1min":0.77400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.911,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.216,"15min":1.2889999999999999},"min":{"1min":0.92600000000000005,"5min":0.755,"15min":0.56100000000000005},"max":{"1min":1.647,"5min":2.6190000000000002,"15min":2.8620000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.395,"15min":1.4319999999999999},"min":{"1min":0.79800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.9690000000000001,"5min":6.7430000000000003,"15min":8.327},"last":1.48}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:12:09.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:12:09.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3eface4700 1 Processor -- start 2023-08-17T00:12:09.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3eface4700 1 -- start start 2023-08-17T00:12:09.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3eface4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3ef4068820 0x7f3ef4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3eface4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef41585a0 con 0x7f3ef40a8df0 2023-08-17T00:12:09.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3eface4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef4066400 con 0x7f3ef40a96d0 2023-08-17T00:12:09.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3eface4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef40c1ba0 con 0x7f3ef4068820 2023-08-17T00:12:09.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3ef9ce2700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3ef40a8df0 0x7f3ef40c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56526/0 (socket says 172.21.15.153:56526) 2023-08-17T00:12:09.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3ef9ce2700 1 -- 172.21.15.153:0/2496352701 learned_addr learned my addr 172.21.15.153:0/2496352701 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:09.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.689+0000 7f3ef94e1700 1 --2- 172.21.15.153:0/2496352701 >> v2:172.21.15.178:3300/0 conn(0x7f3ef4068820 0x7f3ef4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1110882004 0 0) 0x7f3ef41585a0 con 0x7f3ef40a8df0 2023-08-17T00:12:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ee00033f0 con 0x7f3ef40a8df0 2023-08-17T00:12:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783725588 0 0) 0x7f3ef4066400 con 0x7f3ef40a96d0 2023-08-17T00:12:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef41585a0 con 0x7f3ef40a96d0 2023-08-17T00:12:09.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef94e1700 1 -- 172.21.15.153:0/2496352701 >> v1:172.21.15.178:6789/0 conn(0x7f3ef40a96d0 legacy=0x7f3ef40a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef94e1700 1 -- 172.21.15.153:0/2496352701 >> v1:172.21.15.153:6789/0 conn(0x7f3ef40a8df0 legacy=0x7f3ef40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef94e1700 1 -- 172.21.15.153:0/2496352701 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4069170 con 0x7f3ef4068820 2023-08-17T00:12:09.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef94e1700 1 --2- 172.21.15.153:0/2496352701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef4068820 0x7f3ef4068c80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f3ee4009760 tx=0x7f3ee4009060).ready entity=mon.1 client_cookie=ca650c6436902100 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:09.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400d4a0 con 0x7f3ef4068820 2023-08-17T00:12:09.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400d600 con 0x7f3ef4068820 2023-08-17T00:12:09.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3ef8ce0700 1 -- 172.21.15.153:0/2496352701 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400d980 con 0x7f3ef4068820 2023-08-17T00:12:09.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 -- 172.21.15.153:0/2496352701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef4068820 msgr2=0x7f3ef4068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 --2- 172.21.15.153:0/2496352701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef4068820 0x7f3ef4068c80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f3ee4009760 tx=0x7f3ee4009060).stop 2023-08-17T00:12:09.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 -- 172.21.15.153:0/2496352701 shutdown_connections 2023-08-17T00:12:09.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 --2- 172.21.15.153:0/2496352701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef4068820 0x7f3ef4068c80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 -- 172.21.15.153:0/2496352701 >> 172.21.15.153:0/2496352701 conn(0x7f3ef40c6620 msgr2=0x7f3ef40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:09.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 -- 172.21.15.153:0/2496352701 shutdown_connections 2023-08-17T00:12:09.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.693+0000 7f3eface4700 1 -- 172.21.15.153:0/2496352701 wait complete. 2023-08-17T00:12:09.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 Processor -- start 2023-08-17T00:12:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 -- start start 2023-08-17T00:12:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 0x7f3ef40bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ef40a8df0 0x7f3ef416bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef40a96d0 0x7f3ef416c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef416c640 con 0x7f3ef4068820 2023-08-17T00:12:09.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef415bd40 con 0x7f3ef40a96d0 2023-08-17T00:12:09.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3eface4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef40be4a0 con 0x7f3ef40a8df0 2023-08-17T00:12:09.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 0x7f3ef40bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 0x7f3ef40bdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54756/0 (socket says 172.21.15.153:54756) 2023-08-17T00:12:09.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 -- 172.21.15.153:0/3521632457 learned_addr learned my addr 172.21.15.153:0/3521632457 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:09.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef94e1700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ef40a8df0 0x7f3ef416bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3efa4e3700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef40a96d0 0x7f3ef416c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 -- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ef40a8df0 msgr2=0x7f3ef416bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ef40a8df0 0x7f3ef416bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 -- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef40a96d0 msgr2=0x7f3ef416c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef40a96d0 0x7f3ef416c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.697+0000 7f3ef9ce2700 1 -- 172.21.15.153:0/3521632457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40092a0 con 0x7f3ef4068820 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3ef9ce2700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 0x7f3ef40bdfb0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f3ef000c790 tx=0x7f3ef0007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00072e0 con 0x7f3ef4068820 2023-08-17T00:12:09.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0007440 con 0x7f3ef4068820 2023-08-17T00:12:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0005880 con 0x7f3ef4068820 2023-08-17T00:12:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef40c04e0 con 0x7f3ef4068820 2023-08-17T00:12:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef40be990 con 0x7f3ef4068820 2023-08-17T00:12:09.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef406b4c0 con 0x7f3ef4068820 2023-08-17T00:12:09.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.701+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3ef0010070 con 0x7f3ef4068820 2023-08-17T00:12:09.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.705+0000 7f3ee9ffb700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ed805a150 0x7f3ed805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:09.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.705+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3ef00737a0 con 0x7f3ef4068820 2023-08-17T00:12:09.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.705+0000 7f3ef94e1700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ed805a150 0x7f3ed805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:09.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.705+0000 7f3ef94e1700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ed805a150 0x7f3ed805c610 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f3ee400d260 tx=0x7f3ee4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:09.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.709+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ef0047140 con 0x7f3ef4068820 2023-08-17T00:12:09.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.869+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ef4064010 con 0x7f3ed805a150 2023-08-17T00:12:09.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.885+0000 7f3ee9ffb700 1 -- 172.21.15.153:0/3521632457 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359561 (secure 0 0 0) 0x7f3ef4064010 con 0x7f3ed805a150 2023-08-17T00:12:09.893 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ed805a150 msgr2=0x7f3ed805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ed805a150 0x7f3ed805c610 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f3ee400d260 tx=0x7f3ee4016000).stop 2023-08-17T00:12:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 msgr2=0x7f3ef40bdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 0x7f3ef40bdfb0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f3ef000c790 tx=0x7f3ef0007b60).stop 2023-08-17T00:12:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 shutdown_connections 2023-08-17T00:12:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ed805a150 0x7f3ed805c610 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ef40a96d0 0x7f3ef416c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ef40a8df0 0x7f3ef416bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 --2- 172.21.15.153:0/3521632457 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ef4068820 0x7f3ef40bdfb0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 >> 172.21.15.153:0/3521632457 conn(0x7f3ef40c6620 msgr2=0x7f3ef40a9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:09.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 shutdown_connections 2023-08-17T00:12:09.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:09.897+0000 7f3eface4700 1 -- 172.21.15.153:0/3521632457 wait complete. 2023-08-17T00:12:09.907 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:12:09.921 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2023-08-17T00:12:09.382700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443296,"kb_used_data":12256,"kb_used_omap":0,"kb_used_meta":2430976,"kb_avail":752531424,"statfs":{"total":773094113280,"available":770592178176,"internally_reserved":0,"allocated":12550144,"data_stored":5838316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489319424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077803701,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3206,"num_write_kb":-1053274,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-63,"num_bytes_recovered":-66060288,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.963465"},"pg_stats":[{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891452+0000","last_change":"2023-08-17T00:12:04.886144+0000","last_active":"2023-08-17T00:12:04.891452+0000","last_peered":"2023-08-17T00:12:04.891452+0000","last_clean":"2023-08-17T00:12:04.891452+0000","last_became_active":"2023-08-17T00:12:04.885849+0000","last_became_peered":"2023-08-17T00:12:04.885849+0000","last_unstale":"2023-08-17T00:12:04.891452+0000","last_undegraded":"2023-08-17T00:12:04.891452+0000","last_fullsized":"2023-08-17T00:12:04.891452+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3f","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.900066+0000","last_change":"2023-08-17T00:12:04.460424+0000","last_active":"2023-08-17T00:12:04.900066+0000","last_peered":"2023-08-17T00:12:04.900066+0000","last_clean":"2023-08-17T00:12:04.900066+0000","last_became_active":"2023-08-17T00:12:04.460165+0000","last_became_peered":"2023-08-17T00:12:04.460165+0000","last_unstale":"2023-08-17T00:12:04.900066+0000","last_undegraded":"2023-08-17T00:12:04.900066+0000","last_fullsized":"2023-08-17T00:12:04.900066+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899081+0000","last_change":"2023-08-17T00:12:04.892839+0000","last_active":"2023-08-17T00:12:04.899081+0000","last_peered":"2023-08-17T00:12:04.899081+0000","last_clean":"2023-08-17T00:12:04.899081+0000","last_became_active":"2023-08-17T00:12:04.892269+0000","last_became_peered":"2023-08-17T00:12:04.892269+0000","last_unstale":"2023-08-17T00:12:04.899081+0000","last_undegraded":"2023-08-17T00:12:04.899081+0000","last_fullsized":"2023-08-17T00:12:04.899081+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.878855+0000","last_change":"2023-08-17T00:12:04.449055+0000","last_active":"2023-08-17T00:12:04.878855+0000","last_peered":"2023-08-17T00:12:04.878855+0000","last_clean":"2023-08-17T00:12:04.878855+0000","last_became_active":"2023-08-17T00:12:04.448757+0000","last_became_peered":"2023-08-17T00:12:04.448757+0000","last_unstale":"2023-08-17T00:12:04.878855+0000","last_undegraded":"2023-08-17T00:12:04.878855+0000","last_fullsized":"2023-08-17T00:12:04.878855+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889561+0000","last_change":"2023-08-17T00:12:04.881853+0000","last_active":"2023-08-17T00:12:04.889561+0000","last_peered":"2023-08-17T00:12:04.889561+0000","last_clean":"2023-08-17T00:12:04.889561+0000","last_became_active":"2023-08-17T00:12:04.880687+0000","last_became_peered":"2023-08-17T00:12:04.880687+0000","last_unstale":"2023-08-17T00:12:04.889561+0000","last_undegraded":"2023-08-17T00:12:04.889561+0000","last_fullsized":"2023-08-17T00:12:04.889561+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.869927+0000","last_change":"2023-08-17T00:12:04.442597+0000","last_active":"2023-08-17T00:12:04.869927+0000","last_peered":"2023-08-17T00:12:04.869927+0000","last_clean":"2023-08-17T00:12:04.869927+0000","last_became_active":"2023-08-17T00:12:04.442308+0000","last_became_peered":"2023-08-17T00:12:04.442308+0000","last_unstale":"2023-08-17T00:12:04.869927+0000","last_undegraded":"2023-08-17T00:12:04.869927+0000","last_fullsized":"2023-08-17T00:12:04.869927+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897741+0000","last_change":"2023-08-17T00:12:04.888259+0000","last_active":"2023-08-17T00:12:04.897741+0000","last_peered":"2023-08-17T00:12:04.897741+0000","last_clean":"2023-08-17T00:12:04.897741+0000","last_became_active":"2023-08-17T00:12:04.887807+0000","last_became_peered":"2023-08-17T00:12:04.887807+0000","last_unstale":"2023-08-17T00:12:04.897741+0000","last_undegraded":"2023-08-17T00:12:04.897741+0000","last_fullsized":"2023-08-17T00:12:04.897741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3c","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893254+0000","last_change":"2023-08-17T00:12:04.448820+0000","last_active":"2023-08-17T00:12:04.893254+0000","last_peered":"2023-08-17T00:12:04.893254+0000","last_clean":"2023-08-17T00:12:04.893254+0000","last_became_active":"2023-08-17T00:12:04.448510+0000","last_became_peered":"2023-08-17T00:12:04.448510+0000","last_unstale":"2023-08-17T00:12:04.893254+0000","last_undegraded":"2023-08-17T00:12:04.893254+0000","last_fullsized":"2023-08-17T00:12:04.893254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893503+0000","last_change":"2023-08-17T00:12:04.884706+0000","last_active":"2023-08-17T00:12:04.893503+0000","last_peered":"2023-08-17T00:12:04.893503+0000","last_clean":"2023-08-17T00:12:04.893503+0000","last_became_active":"2023-08-17T00:12:04.884395+0000","last_became_peered":"2023-08-17T00:12:04.884395+0000","last_unstale":"2023-08-17T00:12:04.893503+0000","last_undegraded":"2023-08-17T00:12:04.893503+0000","last_fullsized":"2023-08-17T00:12:04.893503+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.887594+0000","last_change":"2023-08-17T00:12:04.458887+0000","last_active":"2023-08-17T00:12:04.887594+0000","last_peered":"2023-08-17T00:12:04.887594+0000","last_clean":"2023-08-17T00:12:04.887594+0000","last_became_active":"2023-08-17T00:12:04.458612+0000","last_became_peered":"2023-08-17T00:12:04.458612+0000","last_unstale":"2023-08-17T00:12:04.887594+0000","last_undegraded":"2023-08-17T00:12:04.887594+0000","last_fullsized":"2023-08-17T00:12:04.887594+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895844+0000","last_change":"2023-08-17T00:12:04.887685+0000","last_active":"2023-08-17T00:12:04.895844+0000","last_peered":"2023-08-17T00:12:04.895844+0000","last_clean":"2023-08-17T00:12:04.895844+0000","last_became_active":"2023-08-17T00:12:04.887401+0000","last_became_peered":"2023-08-17T00:12:04.887401+0000","last_unstale":"2023-08-17T00:12:04.895844+0000","last_undegraded":"2023-08-17T00:12:04.895844+0000","last_fullsized":"2023-08-17T00:12:04.895844+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3a","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893630+0000","last_change":"2023-08-17T00:12:04.442029+0000","last_active":"2023-08-17T00:12:04.893630+0000","last_peered":"2023-08-17T00:12:04.893630+0000","last_clean":"2023-08-17T00:12:04.893630+0000","last_became_active":"2023-08-17T00:12:04.441647+0000","last_became_peered":"2023-08-17T00:12:04.441647+0000","last_unstale":"2023-08-17T00:12:04.893630+0000","last_undegraded":"2023-08-17T00:12:04.893630+0000","last_fullsized":"2023-08-17T00:12:04.893630+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889426+0000","last_change":"2023-08-17T00:12:04.881147+0000","last_active":"2023-08-17T00:12:04.889426+0000","last_peered":"2023-08-17T00:12:04.889426+0000","last_clean":"2023-08-17T00:12:04.889426+0000","last_became_active":"2023-08-17T00:12:04.880880+0000","last_became_peered":"2023-08-17T00:12:04.880880+0000","last_unstale":"2023-08-17T00:12:04.889426+0000","last_undegraded":"2023-08-17T00:12:04.889426+0000","last_fullsized":"2023-08-17T00:12:04.889426+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876011+0000","last_change":"2023-08-17T00:12:04.456679+0000","last_active":"2023-08-17T00:12:04.876011+0000","last_peered":"2023-08-17T00:12:04.876011+0000","last_clean":"2023-08-17T00:12:04.876011+0000","last_became_active":"2023-08-17T00:12:04.456364+0000","last_became_peered":"2023-08-17T00:12:04.456364+0000","last_unstale":"2023-08-17T00:12:04.876011+0000","last_undegraded":"2023-08-17T00:12:04.876011+0000","last_fullsized":"2023-08-17T00:12:04.876011+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897638+0000","last_change":"2023-08-17T00:12:04.891460+0000","last_active":"2023-08-17T00:12:04.897638+0000","last_peered":"2023-08-17T00:12:04.897638+0000","last_clean":"2023-08-17T00:12:04.897638+0000","last_became_active":"2023-08-17T00:12:04.891177+0000","last_became_peered":"2023-08-17T00:12:04.891177+0000","last_unstale":"2023-08-17T00:12:04.897638+0000","last_undegraded":"2023-08-17T00:12:04.897638+0000","last_fullsized":"2023-08-17T00:12:04.897638+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877434+0000","last_change":"2023-08-17T00:12:04.445783+0000","last_active":"2023-08-17T00:12:04.877434+0000","last_peered":"2023-08-17T00:12:04.877434+0000","last_clean":"2023-08-17T00:12:04.877434+0000","last_became_active":"2023-08-17T00:12:04.445450+0000","last_became_peered":"2023-08-17T00:12:04.445450+0000","last_unstale":"2023-08-17T00:12:04.877434+0000","last_undegraded":"2023-08-17T00:12:04.877434+0000","last_fullsized":"2023-08-17T00:12:04.877434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901262+0000","last_change":"2023-08-17T00:12:04.898372+0000","last_active":"2023-08-17T00:12:04.901262+0000","last_peered":"2023-08-17T00:12:04.901262+0000","last_clean":"2023-08-17T00:12:04.901262+0000","last_became_active":"2023-08-17T00:12:04.897771+0000","last_became_peered":"2023-08-17T00:12:04.897771+0000","last_unstale":"2023-08-17T00:12:04.901262+0000","last_undegraded":"2023-08-17T00:12:04.901262+0000","last_fullsized":"2023-08-17T00:12:04.901262+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.875376+0000","last_change":"2023-08-17T00:12:04.459234+0000","last_active":"2023-08-17T00:12:04.875376+0000","last_peered":"2023-08-17T00:12:04.875376+0000","last_clean":"2023-08-17T00:12:04.875376+0000","last_became_active":"2023-08-17T00:12:04.458569+0000","last_became_peered":"2023-08-17T00:12:04.458569+0000","last_unstale":"2023-08-17T00:12:04.875376+0000","last_undegraded":"2023-08-17T00:12:04.875376+0000","last_fullsized":"2023-08-17T00:12:04.875376+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897821+0000","last_change":"2023-08-17T00:12:04.890796+0000","last_active":"2023-08-17T00:12:04.897821+0000","last_peered":"2023-08-17T00:12:04.897821+0000","last_clean":"2023-08-17T00:12:04.897821+0000","last_became_active":"2023-08-17T00:12:04.889954+0000","last_became_peered":"2023-08-17T00:12:04.889954+0000","last_unstale":"2023-08-17T00:12:04.897821+0000","last_undegraded":"2023-08-17T00:12:04.897821+0000","last_fullsized":"2023-08-17T00:12:04.897821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877480+0000","last_change":"2023-08-17T00:12:04.457846+0000","last_active":"2023-08-17T00:12:04.877480+0000","last_peered":"2023-08-17T00:12:04.877480+0000","last_clean":"2023-08-17T00:12:04.877480+0000","last_became_active":"2023-08-17T00:12:04.457498+0000","last_became_peered":"2023-08-17T00:12:04.457498+0000","last_unstale":"2023-08-17T00:12:04.877480+0000","last_undegraded":"2023-08-17T00:12:04.877480+0000","last_fullsized":"2023-08-17T00:12:04.877480+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894931+0000","last_change":"2023-08-17T00:12:04.885977+0000","last_active":"2023-08-17T00:12:04.894931+0000","last_peered":"2023-08-17T00:12:04.894931+0000","last_clean":"2023-08-17T00:12:04.894931+0000","last_became_active":"2023-08-17T00:12:04.885631+0000","last_became_peered":"2023-08-17T00:12:04.885631+0000","last_unstale":"2023-08-17T00:12:04.894931+0000","last_undegraded":"2023-08-17T00:12:04.894931+0000","last_fullsized":"2023-08-17T00:12:04.894931+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.874979+0000","last_change":"2023-08-17T00:12:04.456526+0000","last_active":"2023-08-17T00:12:04.874979+0000","last_peered":"2023-08-17T00:12:04.874979+0000","last_clean":"2023-08-17T00:12:04.874979+0000","last_became_active":"2023-08-17T00:12:04.455843+0000","last_became_peered":"2023-08-17T00:12:04.455843+0000","last_unstale":"2023-08-17T00:12:04.874979+0000","last_undegraded":"2023-08-17T00:12:04.874979+0000","last_fullsized":"2023-08-17T00:12:04.874979+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891376+0000","last_change":"2023-08-17T00:12:04.885935+0000","last_active":"2023-08-17T00:12:04.891376+0000","last_peered":"2023-08-17T00:12:04.891376+0000","last_clean":"2023-08-17T00:12:04.891376+0000","last_became_active":"2023-08-17T00:12:04.885592+0000","last_became_peered":"2023-08-17T00:12:04.885592+0000","last_unstale":"2023-08-17T00:12:04.891376+0000","last_undegraded":"2023-08-17T00:12:04.891376+0000","last_fullsized":"2023-08-17T00:12:04.891376+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.34","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899547+0000","last_change":"2023-08-17T00:12:04.458274+0000","last_active":"2023-08-17T00:12:04.899547+0000","last_peered":"2023-08-17T00:12:04.899547+0000","last_clean":"2023-08-17T00:12:04.899547+0000","last_became_active":"2023-08-17T00:12:04.457934+0000","last_became_peered":"2023-08-17T00:12:04.457934+0000","last_unstale":"2023-08-17T00:12:04.899547+0000","last_undegraded":"2023-08-17T00:12:04.899547+0000","last_fullsized":"2023-08-17T00:12:04.899547+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901191+0000","last_change":"2023-08-17T00:12:04.895285+0000","last_active":"2023-08-17T00:12:04.901191+0000","last_peered":"2023-08-17T00:12:04.901191+0000","last_clean":"2023-08-17T00:12:04.901191+0000","last_became_active":"2023-08-17T00:12:04.894614+0000","last_became_peered":"2023-08-17T00:12:04.894614+0000","last_unstale":"2023-08-17T00:12:04.901191+0000","last_undegraded":"2023-08-17T00:12:04.901191+0000","last_fullsized":"2023-08-17T00:12:04.901191+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.33","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892448+0000","last_change":"2023-08-17T00:12:04.446862+0000","last_active":"2023-08-17T00:12:04.892448+0000","last_peered":"2023-08-17T00:12:04.892448+0000","last_clean":"2023-08-17T00:12:04.892448+0000","last_became_active":"2023-08-17T00:12:04.446577+0000","last_became_peered":"2023-08-17T00:12:04.446577+0000","last_unstale":"2023-08-17T00:12:04.892448+0000","last_undegraded":"2023-08-17T00:12:04.892448+0000","last_fullsized":"2023-08-17T00:12:04.892448+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.896962+0000","last_change":"2023-08-17T00:12:04.890640+0000","last_active":"2023-08-17T00:12:04.896962+0000","last_peered":"2023-08-17T00:12:04.896962+0000","last_clean":"2023-08-17T00:12:04.896962+0000","last_became_active":"2023-08-17T00:12:04.890221+0000","last_became_peered":"2023-08-17T00:12:04.890221+0000","last_unstale":"2023-08-17T00:12:04.896962+0000","last_undegraded":"2023-08-17T00:12:04.896962+0000","last_fullsized":"2023-08-17T00:12:04.896962+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864182+0000","last_change":"2023-08-17T00:12:04.449933+0000","last_active":"2023-08-17T00:12:04.864182+0000","last_peered":"2023-08-17T00:12:04.864182+0000","last_clean":"2023-08-17T00:12:04.864182+0000","last_became_active":"2023-08-17T00:12:04.449623+0000","last_became_peered":"2023-08-17T00:12:04.449623+0000","last_unstale":"2023-08-17T00:12:04.864182+0000","last_undegraded":"2023-08-17T00:12:04.864182+0000","last_fullsized":"2023-08-17T00:12:04.864182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901217+0000","last_change":"2023-08-17T00:12:04.897435+0000","last_active":"2023-08-17T00:12:04.901217+0000","last_peered":"2023-08-17T00:12:04.901217+0000","last_clean":"2023-08-17T00:12:04.901217+0000","last_became_active":"2023-08-17T00:12:04.890210+0000","last_became_peered":"2023-08-17T00:12:04.890210+0000","last_unstale":"2023-08-17T00:12:04.901217+0000","last_undegraded":"2023-08-17T00:12:04.901217+0000","last_fullsized":"2023-08-17T00:12:04.901217+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873463+0000","last_change":"2023-08-17T00:12:04.452433+0000","last_active":"2023-08-17T00:12:04.873463+0000","last_peered":"2023-08-17T00:12:04.873463+0000","last_clean":"2023-08-17T00:12:04.873463+0000","last_became_active":"2023-08-17T00:12:04.452167+0000","last_became_peered":"2023-08-17T00:12:04.452167+0000","last_unstale":"2023-08-17T00:12:04.873463+0000","last_undegraded":"2023-08-17T00:12:04.873463+0000","last_fullsized":"2023-08-17T00:12:04.873463+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897829+0000","last_change":"2023-08-17T00:12:04.891909+0000","last_active":"2023-08-17T00:12:04.897829+0000","last_peered":"2023-08-17T00:12:04.897829+0000","last_clean":"2023-08-17T00:12:04.897829+0000","last_became_active":"2023-08-17T00:12:04.891155+0000","last_became_peered":"2023-08-17T00:12:04.891155+0000","last_unstale":"2023-08-17T00:12:04.897829+0000","last_undegraded":"2023-08-17T00:12:04.897829+0000","last_fullsized":"2023-08-17T00:12:04.897829+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.30","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.896155+0000","last_change":"2023-08-17T00:12:04.447613+0000","last_active":"2023-08-17T00:12:04.896155+0000","last_peered":"2023-08-17T00:12:04.896155+0000","last_clean":"2023-08-17T00:12:04.896155+0000","last_became_active":"2023-08-17T00:12:04.447323+0000","last_became_peered":"2023-08-17T00:12:04.447323+0000","last_unstale":"2023-08-17T00:12:04.896155+0000","last_undegraded":"2023-08-17T00:12:04.896155+0000","last_fullsized":"2023-08-17T00:12:04.896155+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889451+0000","last_change":"2023-08-17T00:12:04.884746+0000","last_active":"2023-08-17T00:12:04.889451+0000","last_peered":"2023-08-17T00:12:04.889451+0000","last_clean":"2023-08-17T00:12:04.889451+0000","last_became_active":"2023-08-17T00:12:04.884445+0000","last_became_peered":"2023-08-17T00:12:04.884445+0000","last_unstale":"2023-08-17T00:12:04.889451+0000","last_undegraded":"2023-08-17T00:12:04.889451+0000","last_fullsized":"2023-08-17T00:12:04.889451+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.870757+0000","last_change":"2023-08-17T00:12:04.455465+0000","last_active":"2023-08-17T00:12:04.870757+0000","last_peered":"2023-08-17T00:12:04.870757+0000","last_clean":"2023-08-17T00:12:04.870757+0000","last_became_active":"2023-08-17T00:12:04.455129+0000","last_became_peered":"2023-08-17T00:12:04.455129+0000","last_unstale":"2023-08-17T00:12:04.870757+0000","last_undegraded":"2023-08-17T00:12:04.870757+0000","last_fullsized":"2023-08-17T00:12:04.870757+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890739+0000","last_change":"2023-08-17T00:12:04.887616+0000","last_active":"2023-08-17T00:12:04.890739+0000","last_peered":"2023-08-17T00:12:04.890739+0000","last_clean":"2023-08-17T00:12:04.890739+0000","last_became_active":"2023-08-17T00:12:04.886463+0000","last_became_peered":"2023-08-17T00:12:04.886463+0000","last_unstale":"2023-08-17T00:12:04.890739+0000","last_undegraded":"2023-08-17T00:12:04.890739+0000","last_fullsized":"2023-08-17T00:12:04.890739+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873195+0000","last_change":"2023-08-17T00:12:04.451299+0000","last_active":"2023-08-17T00:12:04.873195+0000","last_peered":"2023-08-17T00:12:04.873195+0000","last_clean":"2023-08-17T00:12:04.873195+0000","last_became_active":"2023-08-17T00:12:04.451039+0000","last_became_peered":"2023-08-17T00:12:04.451039+0000","last_unstale":"2023-08-17T00:12:04.873195+0000","last_undegraded":"2023-08-17T00:12:04.873195+0000","last_fullsized":"2023-08-17T00:12:04.873195+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899963+0000","last_change":"2023-08-17T00:12:04.892589+0000","last_active":"2023-08-17T00:12:04.899963+0000","last_peered":"2023-08-17T00:12:04.899963+0000","last_clean":"2023-08-17T00:12:04.899963+0000","last_became_active":"2023-08-17T00:12:04.892277+0000","last_became_peered":"2023-08-17T00:12:04.892277+0000","last_unstale":"2023-08-17T00:12:04.899963+0000","last_undegraded":"2023-08-17T00:12:04.899963+0000","last_fullsized":"2023-08-17T00:12:04.899963+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890940+0000","last_change":"2023-08-17T00:12:04.444781+0000","last_active":"2023-08-17T00:12:04.890940+0000","last_peered":"2023-08-17T00:12:04.890940+0000","last_clean":"2023-08-17T00:12:04.890940+0000","last_became_active":"2023-08-17T00:12:04.443977+0000","last_became_peered":"2023-08-17T00:12:04.443977+0000","last_unstale":"2023-08-17T00:12:04.890940+0000","last_undegraded":"2023-08-17T00:12:04.890940+0000","last_fullsized":"2023-08-17T00:12:04.890940+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894569+0000","last_change":"2023-08-17T00:12:04.887223+0000","last_active":"2023-08-17T00:12:04.894569+0000","last_peered":"2023-08-17T00:12:04.894569+0000","last_clean":"2023-08-17T00:12:04.894569+0000","last_became_active":"2023-08-17T00:12:04.886651+0000","last_became_peered":"2023-08-17T00:12:04.886651+0000","last_unstale":"2023-08-17T00:12:04.894569+0000","last_undegraded":"2023-08-17T00:12:04.894569+0000","last_fullsized":"2023-08-17T00:12:04.894569+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.871026+0000","last_change":"2023-08-17T00:12:04.455796+0000","last_active":"2023-08-17T00:12:04.871026+0000","last_peered":"2023-08-17T00:12:04.871026+0000","last_clean":"2023-08-17T00:12:04.871026+0000","last_became_active":"2023-08-17T00:12:04.455252+0000","last_became_peered":"2023-08-17T00:12:04.455252+0000","last_unstale":"2023-08-17T00:12:04.871026+0000","last_undegraded":"2023-08-17T00:12:04.871026+0000","last_fullsized":"2023-08-17T00:12:04.871026+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.888481+0000","last_change":"2023-08-17T00:12:04.887656+0000","last_active":"2023-08-17T00:12:04.888481+0000","last_peered":"2023-08-17T00:12:04.888481+0000","last_clean":"2023-08-17T00:12:04.888481+0000","last_became_active":"2023-08-17T00:12:04.887343+0000","last_became_peered":"2023-08-17T00:12:04.887343+0000","last_unstale":"2023-08-17T00:12:04.888481+0000","last_undegraded":"2023-08-17T00:12:04.888481+0000","last_fullsized":"2023-08-17T00:12:04.888481+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895480+0000","last_change":"2023-08-17T00:12:04.446368+0000","last_active":"2023-08-17T00:12:04.895480+0000","last_peered":"2023-08-17T00:12:04.895480+0000","last_clean":"2023-08-17T00:12:04.895480+0000","last_became_active":"2023-08-17T00:12:04.445475+0000","last_became_peered":"2023-08-17T00:12:04.445475+0000","last_unstale":"2023-08-17T00:12:04.895480+0000","last_undegraded":"2023-08-17T00:12:04.895480+0000","last_fullsized":"2023-08-17T00:12:04.895480+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.896938+0000","last_change":"2023-08-17T00:12:04.890473+0000","last_active":"2023-08-17T00:12:04.896938+0000","last_peered":"2023-08-17T00:12:04.896938+0000","last_clean":"2023-08-17T00:12:04.896938+0000","last_became_active":"2023-08-17T00:12:04.889883+0000","last_became_peered":"2023-08-17T00:12:04.889883+0000","last_unstale":"2023-08-17T00:12:04.896938+0000","last_undegraded":"2023-08-17T00:12:04.896938+0000","last_fullsized":"2023-08-17T00:12:04.896938+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.868757+0000","last_change":"2023-08-17T00:12:04.448313+0000","last_active":"2023-08-17T00:12:04.868757+0000","last_peered":"2023-08-17T00:12:04.868757+0000","last_clean":"2023-08-17T00:12:04.868757+0000","last_became_active":"2023-08-17T00:12:04.448038+0000","last_became_peered":"2023-08-17T00:12:04.448038+0000","last_unstale":"2023-08-17T00:12:04.868757+0000","last_undegraded":"2023-08-17T00:12:04.868757+0000","last_fullsized":"2023-08-17T00:12:04.868757+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897061+0000","last_change":"2023-08-17T00:12:04.892688+0000","last_active":"2023-08-17T00:12:04.897061+0000","last_peered":"2023-08-17T00:12:04.897061+0000","last_clean":"2023-08-17T00:12:04.897061+0000","last_became_active":"2023-08-17T00:12:04.892268+0000","last_became_peered":"2023-08-17T00:12:04.892268+0000","last_unstale":"2023-08-17T00:12:04.897061+0000","last_undegraded":"2023-08-17T00:12:04.897061+0000","last_fullsized":"2023-08-17T00:12:04.897061+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.863795+0000","last_change":"2023-08-17T00:12:04.461596+0000","last_active":"2023-08-17T00:12:04.863795+0000","last_peered":"2023-08-17T00:12:04.863795+0000","last_clean":"2023-08-17T00:12:04.863795+0000","last_became_active":"2023-08-17T00:12:04.461279+0000","last_became_peered":"2023-08-17T00:12:04.461279+0000","last_unstale":"2023-08-17T00:12:04.863795+0000","last_undegraded":"2023-08-17T00:12:04.863795+0000","last_fullsized":"2023-08-17T00:12:04.863795+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.883337+0000","last_change":"2023-08-17T00:12:04.875795+0000","last_active":"2023-08-17T00:12:04.883337+0000","last_peered":"2023-08-17T00:12:04.883337+0000","last_clean":"2023-08-17T00:12:04.883337+0000","last_became_active":"2023-08-17T00:12:04.875507+0000","last_became_peered":"2023-08-17T00:12:04.875507+0000","last_unstale":"2023-08-17T00:12:04.883337+0000","last_undegraded":"2023-08-17T00:12:04.883337+0000","last_fullsized":"2023-08-17T00:12:04.883337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.866229+0000","last_change":"2023-08-17T00:12:04.454472+0000","last_active":"2023-08-17T00:12:04.866229+0000","last_peered":"2023-08-17T00:12:04.866229+0000","last_clean":"2023-08-17T00:12:04.866229+0000","last_became_active":"2023-08-17T00:12:04.454194+0000","last_became_peered":"2023-08-17T00:12:04.454194+0000","last_unstale":"2023-08-17T00:12:04.866229+0000","last_undegraded":"2023-08-17T00:12:04.866229+0000","last_fullsized":"2023-08-17T00:12:04.866229+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901275+0000","last_change":"2023-08-17T00:12:04.898549+0000","last_active":"2023-08-17T00:12:04.901275+0000","last_peered":"2023-08-17T00:12:04.901275+0000","last_clean":"2023-08-17T00:12:04.901275+0000","last_became_active":"2023-08-17T00:12:04.898111+0000","last_became_peered":"2023-08-17T00:12:04.898111+0000","last_unstale":"2023-08-17T00:12:04.901275+0000","last_undegraded":"2023-08-17T00:12:04.901275+0000","last_fullsized":"2023-08-17T00:12:04.901275+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876582+0000","last_change":"2023-08-17T00:12:04.451063+0000","last_active":"2023-08-17T00:12:04.876582+0000","last_peered":"2023-08-17T00:12:04.876582+0000","last_clean":"2023-08-17T00:12:04.876582+0000","last_became_active":"2023-08-17T00:12:04.450797+0000","last_became_peered":"2023-08-17T00:12:04.450797+0000","last_unstale":"2023-08-17T00:12:04.876582+0000","last_undegraded":"2023-08-17T00:12:04.876582+0000","last_fullsized":"2023-08-17T00:12:04.876582+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895449+0000","last_change":"2023-08-17T00:12:04.890415+0000","last_active":"2023-08-17T00:12:04.895449+0000","last_peered":"2023-08-17T00:12:04.895449+0000","last_clean":"2023-08-17T00:12:04.895449+0000","last_became_active":"2023-08-17T00:12:04.890163+0000","last_became_peered":"2023-08-17T00:12:04.890163+0000","last_unstale":"2023-08-17T00:12:04.895449+0000","last_undegraded":"2023-08-17T00:12:04.895449+0000","last_fullsized":"2023-08-17T00:12:04.895449+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.869525+0000","last_change":"2023-08-17T00:12:04.436593+0000","last_active":"2023-08-17T00:12:04.869525+0000","last_peered":"2023-08-17T00:12:04.869525+0000","last_clean":"2023-08-17T00:12:04.869525+0000","last_became_active":"2023-08-17T00:12:04.436242+0000","last_became_peered":"2023-08-17T00:12:04.436242+0000","last_unstale":"2023-08-17T00:12:04.869525+0000","last_undegraded":"2023-08-17T00:12:04.869525+0000","last_fullsized":"2023-08-17T00:12:04.869525+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.889345+0000","last_change":"2023-08-17T00:12:04.874979+0000","last_active":"2023-08-17T00:12:04.889345+0000","last_peered":"2023-08-17T00:12:04.889345+0000","last_clean":"2023-08-17T00:12:04.889345+0000","last_became_active":"2023-08-17T00:12:04.874620+0000","last_became_peered":"2023-08-17T00:12:04.874620+0000","last_unstale":"2023-08-17T00:12:04.889345+0000","last_undegraded":"2023-08-17T00:12:04.889345+0000","last_fullsized":"2023-08-17T00:12:04.889345+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.865639+0000","last_change":"2023-08-17T00:12:04.439725+0000","last_active":"2023-08-17T00:12:04.865639+0000","last_peered":"2023-08-17T00:12:04.865639+0000","last_clean":"2023-08-17T00:12:04.865639+0000","last_became_active":"2023-08-17T00:12:04.439404+0000","last_became_peered":"2023-08-17T00:12:04.439404+0000","last_unstale":"2023-08-17T00:12:04.865639+0000","last_undegraded":"2023-08-17T00:12:04.865639+0000","last_fullsized":"2023-08-17T00:12:04.865639+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897719+0000","last_change":"2023-08-17T00:12:04.888078+0000","last_active":"2023-08-17T00:12:04.897719+0000","last_peered":"2023-08-17T00:12:04.897719+0000","last_clean":"2023-08-17T00:12:04.897719+0000","last_became_active":"2023-08-17T00:12:04.887501+0000","last_became_peered":"2023-08-17T00:12:04.887501+0000","last_unstale":"2023-08-17T00:12:04.897719+0000","last_undegraded":"2023-08-17T00:12:04.897719+0000","last_fullsized":"2023-08-17T00:12:04.897719+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867466+0000","last_change":"2023-08-17T00:12:04.446499+0000","last_active":"2023-08-17T00:12:04.867466+0000","last_peered":"2023-08-17T00:12:04.867466+0000","last_clean":"2023-08-17T00:12:04.867466+0000","last_became_active":"2023-08-17T00:12:04.446192+0000","last_became_peered":"2023-08-17T00:12:04.446192+0000","last_unstale":"2023-08-17T00:12:04.867466+0000","last_undegraded":"2023-08-17T00:12:04.867466+0000","last_fullsized":"2023-08-17T00:12:04.867466+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899427+0000","last_change":"2023-08-17T00:12:04.895994+0000","last_active":"2023-08-17T00:12:04.899427+0000","last_peered":"2023-08-17T00:12:04.899427+0000","last_clean":"2023-08-17T00:12:04.899427+0000","last_became_active":"2023-08-17T00:12:04.895718+0000","last_became_peered":"2023-08-17T00:12:04.895718+0000","last_unstale":"2023-08-17T00:12:04.899427+0000","last_undegraded":"2023-08-17T00:12:04.899427+0000","last_fullsized":"2023-08-17T00:12:04.899427+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864417+0000","last_change":"2023-08-17T00:12:04.458217+0000","last_active":"2023-08-17T00:12:04.864417+0000","last_peered":"2023-08-17T00:12:04.864417+0000","last_clean":"2023-08-17T00:12:04.864417+0000","last_became_active":"2023-08-17T00:12:04.454488+0000","last_became_peered":"2023-08-17T00:12:04.454488+0000","last_unstale":"2023-08-17T00:12:04.864417+0000","last_undegraded":"2023-08-17T00:12:04.864417+0000","last_fullsized":"2023-08-17T00:12:04.864417+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897956+0000","last_change":"2023-08-17T00:12:04.887855+0000","last_active":"2023-08-17T00:12:04.897956+0000","last_peered":"2023-08-17T00:12:04.897956+0000","last_clean":"2023-08-17T00:12:04.897956+0000","last_became_active":"2023-08-17T00:12:04.887584+0000","last_became_peered":"2023-08-17T00:12:04.887584+0000","last_unstale":"2023-08-17T00:12:04.897956+0000","last_undegraded":"2023-08-17T00:12:04.897956+0000","last_fullsized":"2023-08-17T00:12:04.897956+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873008+0000","last_change":"2023-08-17T00:12:04.453099+0000","last_active":"2023-08-17T00:12:04.873008+0000","last_peered":"2023-08-17T00:12:04.873008+0000","last_clean":"2023-08-17T00:12:04.873008+0000","last_became_active":"2023-08-17T00:12:04.452746+0000","last_became_peered":"2023-08-17T00:12:04.452746+0000","last_unstale":"2023-08-17T00:12:04.873008+0000","last_undegraded":"2023-08-17T00:12:04.873008+0000","last_fullsized":"2023-08-17T00:12:04.873008+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.898762+0000","last_change":"2023-08-17T00:12:04.889741+0000","last_active":"2023-08-17T00:12:04.898762+0000","last_peered":"2023-08-17T00:12:04.898762+0000","last_clean":"2023-08-17T00:12:04.898762+0000","last_became_active":"2023-08-17T00:12:04.889438+0000","last_became_peered":"2023-08-17T00:12:04.889438+0000","last_unstale":"2023-08-17T00:12:04.898762+0000","last_undegraded":"2023-08-17T00:12:04.898762+0000","last_fullsized":"2023-08-17T00:12:04.898762+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873589+0000","last_change":"2023-08-17T00:12:04.456702+0000","last_active":"2023-08-17T00:12:04.873589+0000","last_peered":"2023-08-17T00:12:04.873589+0000","last_clean":"2023-08-17T00:12:04.873589+0000","last_became_active":"2023-08-17T00:12:04.456409+0000","last_became_peered":"2023-08-17T00:12:04.456409+0000","last_unstale":"2023-08-17T00:12:04.873589+0000","last_undegraded":"2023-08-17T00:12:04.873589+0000","last_fullsized":"2023-08-17T00:12:04.873589+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.898852+0000","last_change":"2023-08-17T00:12:04.891658+0000","last_active":"2023-08-17T00:12:04.898852+0000","last_peered":"2023-08-17T00:12:04.898852+0000","last_clean":"2023-08-17T00:12:04.898852+0000","last_became_active":"2023-08-17T00:12:04.891068+0000","last_became_peered":"2023-08-17T00:12:04.891068+0000","last_unstale":"2023-08-17T00:12:04.898852+0000","last_undegraded":"2023-08-17T00:12:04.898852+0000","last_fullsized":"2023-08-17T00:12:04.898852+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877140+0000","last_change":"2023-08-17T00:12:04.453304+0000","last_active":"2023-08-17T00:12:04.877140+0000","last_peered":"2023-08-17T00:12:04.877140+0000","last_clean":"2023-08-17T00:12:04.877140+0000","last_became_active":"2023-08-17T00:12:04.453029+0000","last_became_peered":"2023-08-17T00:12:04.453029+0000","last_unstale":"2023-08-17T00:12:04.877140+0000","last_undegraded":"2023-08-17T00:12:04.877140+0000","last_fullsized":"2023-08-17T00:12:04.877140+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893304+0000","last_change":"2023-08-17T00:12:04.885233+0000","last_active":"2023-08-17T00:12:04.893304+0000","last_peered":"2023-08-17T00:12:04.893304+0000","last_clean":"2023-08-17T00:12:04.893304+0000","last_became_active":"2023-08-17T00:12:04.884945+0000","last_became_peered":"2023-08-17T00:12:04.884945+0000","last_unstale":"2023-08-17T00:12:04.893304+0000","last_undegraded":"2023-08-17T00:12:04.893304+0000","last_fullsized":"2023-08-17T00:12:04.893304+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892423+0000","last_change":"2023-08-17T00:12:04.461502+0000","last_active":"2023-08-17T00:12:04.892423+0000","last_peered":"2023-08-17T00:12:04.892423+0000","last_clean":"2023-08-17T00:12:04.892423+0000","last_became_active":"2023-08-17T00:12:04.460914+0000","last_became_peered":"2023-08-17T00:12:04.460914+0000","last_unstale":"2023-08-17T00:12:04.892423+0000","last_undegraded":"2023-08-17T00:12:04.892423+0000","last_fullsized":"2023-08-17T00:12:04.892423+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897307+0000","last_change":"2023-08-17T00:12:04.890074+0000","last_active":"2023-08-17T00:12:04.897307+0000","last_peered":"2023-08-17T00:12:04.897307+0000","last_clean":"2023-08-17T00:12:04.897307+0000","last_became_active":"2023-08-17T00:12:04.889773+0000","last_became_peered":"2023-08-17T00:12:04.889773+0000","last_unstale":"2023-08-17T00:12:04.897307+0000","last_undegraded":"2023-08-17T00:12:04.897307+0000","last_fullsized":"2023-08-17T00:12:04.897307+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1e","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.900012+0000","last_change":"2023-08-17T00:12:04.450187+0000","last_active":"2023-08-17T00:12:04.900012+0000","last_peered":"2023-08-17T00:12:04.900012+0000","last_clean":"2023-08-17T00:12:04.900012+0000","last_became_active":"2023-08-17T00:12:04.448987+0000","last_became_peered":"2023-08-17T00:12:04.448987+0000","last_unstale":"2023-08-17T00:12:04.900012+0000","last_undegraded":"2023-08-17T00:12:04.900012+0000","last_fullsized":"2023-08-17T00:12:04.900012+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892900+0000","last_change":"2023-08-17T00:12:04.884976+0000","last_active":"2023-08-17T00:12:04.892900+0000","last_peered":"2023-08-17T00:12:04.892900+0000","last_clean":"2023-08-17T00:12:04.892900+0000","last_became_active":"2023-08-17T00:12:04.884710+0000","last_became_peered":"2023-08-17T00:12:04.884710+0000","last_unstale":"2023-08-17T00:12:04.892900+0000","last_undegraded":"2023-08-17T00:12:04.892900+0000","last_fullsized":"2023-08-17T00:12:04.892900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1d","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890834+0000","last_change":"2023-08-17T00:12:04.444323+0000","last_active":"2023-08-17T00:12:04.890834+0000","last_peered":"2023-08-17T00:12:04.890834+0000","last_clean":"2023-08-17T00:12:04.890834+0000","last_became_active":"2023-08-17T00:12:04.443608+0000","last_became_peered":"2023-08-17T00:12:04.443608+0000","last_unstale":"2023-08-17T00:12:04.890834+0000","last_undegraded":"2023-08-17T00:12:04.890834+0000","last_fullsized":"2023-08-17T00:12:04.890834+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891396+0000","last_change":"2023-08-17T00:12:04.886214+0000","last_active":"2023-08-17T00:12:04.891396+0000","last_peered":"2023-08-17T00:12:04.891396+0000","last_clean":"2023-08-17T00:12:04.891396+0000","last_became_active":"2023-08-17T00:12:04.885281+0000","last_became_peered":"2023-08-17T00:12:04.885281+0000","last_unstale":"2023-08-17T00:12:04.891396+0000","last_undegraded":"2023-08-17T00:12:04.891396+0000","last_fullsized":"2023-08-17T00:12:04.891396+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867802+0000","last_change":"2023-08-17T00:12:04.450610+0000","last_active":"2023-08-17T00:12:04.867802+0000","last_peered":"2023-08-17T00:12:04.867802+0000","last_clean":"2023-08-17T00:12:04.867802+0000","last_became_active":"2023-08-17T00:12:04.450304+0000","last_became_peered":"2023-08-17T00:12:04.450304+0000","last_unstale":"2023-08-17T00:12:04.867802+0000","last_undegraded":"2023-08-17T00:12:04.867802+0000","last_fullsized":"2023-08-17T00:12:04.867802+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894243+0000","last_change":"2023-08-17T00:12:04.888591+0000","last_active":"2023-08-17T00:12:04.894243+0000","last_peered":"2023-08-17T00:12:04.894243+0000","last_clean":"2023-08-17T00:12:04.894243+0000","last_became_active":"2023-08-17T00:12:04.888243+0000","last_became_peered":"2023-08-17T00:12:04.888243+0000","last_unstale":"2023-08-17T00:12:04.894243+0000","last_undegraded":"2023-08-17T00:12:04.894243+0000","last_fullsized":"2023-08-17T00:12:04.894243+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873748+0000","last_change":"2023-08-17T00:12:04.446095+0000","last_active":"2023-08-17T00:12:04.873748+0000","last_peered":"2023-08-17T00:12:04.873748+0000","last_clean":"2023-08-17T00:12:04.873748+0000","last_became_active":"2023-08-17T00:12:04.445786+0000","last_became_peered":"2023-08-17T00:12:04.445786+0000","last_unstale":"2023-08-17T00:12:04.873748+0000","last_undegraded":"2023-08-17T00:12:04.873748+0000","last_fullsized":"2023-08-17T00:12:04.873748+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897977+0000","last_change":"2023-08-17T00:12:04.888900+0000","last_active":"2023-08-17T00:12:04.897977+0000","last_peered":"2023-08-17T00:12:04.897977+0000","last_clean":"2023-08-17T00:12:04.897977+0000","last_became_active":"2023-08-17T00:12:04.888646+0000","last_became_peered":"2023-08-17T00:12:04.888646+0000","last_unstale":"2023-08-17T00:12:04.897977+0000","last_undegraded":"2023-08-17T00:12:04.897977+0000","last_fullsized":"2023-08-17T00:12:04.897977+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.866307+0000","last_change":"2023-08-17T00:12:04.452493+0000","last_active":"2023-08-17T00:12:04.866307+0000","last_peered":"2023-08-17T00:12:04.866307+0000","last_clean":"2023-08-17T00:12:04.866307+0000","last_became_active":"2023-08-17T00:12:04.451990+0000","last_became_peered":"2023-08-17T00:12:04.451990+0000","last_unstale":"2023-08-17T00:12:04.866307+0000","last_undegraded":"2023-08-17T00:12:04.866307+0000","last_fullsized":"2023-08-17T00:12:04.866307+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899084+0000","last_change":"2023-08-17T00:12:04.896793+0000","last_active":"2023-08-17T00:12:04.899084+0000","last_peered":"2023-08-17T00:12:04.899084+0000","last_clean":"2023-08-17T00:12:04.899084+0000","last_became_active":"2023-08-17T00:12:04.896454+0000","last_became_peered":"2023-08-17T00:12:04.896454+0000","last_unstale":"2023-08-17T00:12:04.899084+0000","last_undegraded":"2023-08-17T00:12:04.899084+0000","last_fullsized":"2023-08-17T00:12:04.899084+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876101+0000","last_change":"2023-08-17T00:12:04.451329+0000","last_active":"2023-08-17T00:12:04.876101+0000","last_peered":"2023-08-17T00:12:04.876101+0000","last_clean":"2023-08-17T00:12:04.876101+0000","last_became_active":"2023-08-17T00:12:04.450993+0000","last_became_peered":"2023-08-17T00:12:04.450993+0000","last_unstale":"2023-08-17T00:12:04.876101+0000","last_undegraded":"2023-08-17T00:12:04.876101+0000","last_fullsized":"2023-08-17T00:12:04.876101+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890204+0000","last_change":"2023-08-17T00:12:04.878744+0000","last_active":"2023-08-17T00:12:04.890204+0000","last_peered":"2023-08-17T00:12:04.890204+0000","last_clean":"2023-08-17T00:12:04.890204+0000","last_became_active":"2023-08-17T00:12:04.878390+0000","last_became_peered":"2023-08-17T00:12:04.878390+0000","last_unstale":"2023-08-17T00:12:04.890204+0000","last_undegraded":"2023-08-17T00:12:04.890204+0000","last_fullsized":"2023-08-17T00:12:04.890204+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877254+0000","last_change":"2023-08-17T00:12:04.457496+0000","last_active":"2023-08-17T00:12:04.877254+0000","last_peered":"2023-08-17T00:12:04.877254+0000","last_clean":"2023-08-17T00:12:04.877254+0000","last_became_active":"2023-08-17T00:12:04.457137+0000","last_became_peered":"2023-08-17T00:12:04.457137+0000","last_unstale":"2023-08-17T00:12:04.877254+0000","last_undegraded":"2023-08-17T00:12:04.877254+0000","last_fullsized":"2023-08-17T00:12:04.877254+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899627+0000","last_change":"2023-08-17T00:12:04.897758+0000","last_active":"2023-08-17T00:12:04.899627+0000","last_peered":"2023-08-17T00:12:04.899627+0000","last_clean":"2023-08-17T00:12:04.899627+0000","last_became_active":"2023-08-17T00:12:04.897490+0000","last_became_peered":"2023-08-17T00:12:04.897490+0000","last_unstale":"2023-08-17T00:12:04.899627+0000","last_undegraded":"2023-08-17T00:12:04.899627+0000","last_fullsized":"2023-08-17T00:12:04.899627+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.f","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899822+0000","last_change":"2023-08-17T00:12:04.455936+0000","last_active":"2023-08-17T00:12:04.899822+0000","last_peered":"2023-08-17T00:12:04.899822+0000","last_clean":"2023-08-17T00:12:04.899822+0000","last_became_active":"2023-08-17T00:12:04.455480+0000","last_became_peered":"2023-08-17T00:12:04.455480+0000","last_unstale":"2023-08-17T00:12:04.899822+0000","last_undegraded":"2023-08-17T00:12:04.899822+0000","last_fullsized":"2023-08-17T00:12:04.899822+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897804+0000","last_change":"2023-08-17T00:12:04.889814+0000","last_active":"2023-08-17T00:12:04.897804+0000","last_peered":"2023-08-17T00:12:04.897804+0000","last_clean":"2023-08-17T00:12:04.897804+0000","last_became_active":"2023-08-17T00:12:04.889544+0000","last_became_peered":"2023-08-17T00:12:04.889544+0000","last_unstale":"2023-08-17T00:12:04.897804+0000","last_undegraded":"2023-08-17T00:12:04.897804+0000","last_fullsized":"2023-08-17T00:12:04.897804+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.e","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.900371+0000","last_change":"2023-08-17T00:12:04.454729+0000","last_active":"2023-08-17T00:12:04.900371+0000","last_peered":"2023-08-17T00:12:04.900371+0000","last_clean":"2023-08-17T00:12:04.900371+0000","last_became_active":"2023-08-17T00:12:04.454443+0000","last_became_peered":"2023-08-17T00:12:04.454443+0000","last_unstale":"2023-08-17T00:12:04.900371+0000","last_undegraded":"2023-08-17T00:12:04.900371+0000","last_fullsized":"2023-08-17T00:12:04.900371+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.894952+0000","last_change":"2023-08-17T00:12:04.887713+0000","last_active":"2023-08-17T00:12:04.894952+0000","last_peered":"2023-08-17T00:12:04.894952+0000","last_clean":"2023-08-17T00:12:04.894952+0000","last_became_active":"2023-08-17T00:12:04.887383+0000","last_became_peered":"2023-08-17T00:12:04.887383+0000","last_unstale":"2023-08-17T00:12:04.894952+0000","last_undegraded":"2023-08-17T00:12:04.894952+0000","last_fullsized":"2023-08-17T00:12:04.894952+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.865737+0000","last_change":"2023-08-17T00:12:04.458765+0000","last_active":"2023-08-17T00:12:04.865737+0000","last_peered":"2023-08-17T00:12:04.865737+0000","last_clean":"2023-08-17T00:12:04.865737+0000","last_became_active":"2023-08-17T00:12:04.458487+0000","last_became_peered":"2023-08-17T00:12:04.458487+0000","last_unstale":"2023-08-17T00:12:04.865737+0000","last_undegraded":"2023-08-17T00:12:04.865737+0000","last_fullsized":"2023-08-17T00:12:04.865737+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897589+0000","last_change":"2023-08-17T00:12:04.892307+0000","last_active":"2023-08-17T00:12:04.897589+0000","last_peered":"2023-08-17T00:12:04.897589+0000","last_clean":"2023-08-17T00:12:04.897589+0000","last_became_active":"2023-08-17T00:12:04.892049+0000","last_became_peered":"2023-08-17T00:12:04.892049+0000","last_unstale":"2023-08-17T00:12:04.897589+0000","last_undegraded":"2023-08-17T00:12:04.897589+0000","last_fullsized":"2023-08-17T00:12:04.897589+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.872833+0000","last_change":"2023-08-17T00:12:04.456524+0000","last_active":"2023-08-17T00:12:04.872833+0000","last_peered":"2023-08-17T00:12:04.872833+0000","last_clean":"2023-08-17T00:12:04.872833+0000","last_became_active":"2023-08-17T00:12:04.456199+0000","last_became_peered":"2023-08-17T00:12:04.456199+0000","last_unstale":"2023-08-17T00:12:04.872833+0000","last_undegraded":"2023-08-17T00:12:04.872833+0000","last_fullsized":"2023-08-17T00:12:04.872833+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897706+0000","last_change":"2023-08-17T00:12:04.891602+0000","last_active":"2023-08-17T00:12:04.897706+0000","last_peered":"2023-08-17T00:12:04.897706+0000","last_clean":"2023-08-17T00:12:04.897706+0000","last_became_active":"2023-08-17T00:12:04.891223+0000","last_became_peered":"2023-08-17T00:12:04.891223+0000","last_unstale":"2023-08-17T00:12:04.897706+0000","last_undegraded":"2023-08-17T00:12:04.897706+0000","last_fullsized":"2023-08-17T00:12:04.897706+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.b","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899804+0000","last_change":"2023-08-17T00:12:04.451004+0000","last_active":"2023-08-17T00:12:04.899804+0000","last_peered":"2023-08-17T00:12:04.899804+0000","last_clean":"2023-08-17T00:12:04.899804+0000","last_became_active":"2023-08-17T00:12:04.450714+0000","last_became_peered":"2023-08-17T00:12:04.450714+0000","last_unstale":"2023-08-17T00:12:04.899804+0000","last_undegraded":"2023-08-17T00:12:04.899804+0000","last_fullsized":"2023-08-17T00:12:04.899804+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899595+0000","last_change":"2023-08-17T00:12:04.888334+0000","last_active":"2023-08-17T00:12:04.899595+0000","last_peered":"2023-08-17T00:12:04.899595+0000","last_clean":"2023-08-17T00:12:04.899595+0000","last_became_active":"2023-08-17T00:12:04.885611+0000","last_became_peered":"2023-08-17T00:12:04.885611+0000","last_unstale":"2023-08-17T00:12:04.899595+0000","last_undegraded":"2023-08-17T00:12:04.899595+0000","last_fullsized":"2023-08-17T00:12:04.899595+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.871302+0000","last_change":"2023-08-17T00:12:04.443106+0000","last_active":"2023-08-17T00:12:04.871302+0000","last_peered":"2023-08-17T00:12:04.871302+0000","last_clean":"2023-08-17T00:12:04.871302+0000","last_became_active":"2023-08-17T00:12:04.442838+0000","last_became_peered":"2023-08-17T00:12:04.442838+0000","last_unstale":"2023-08-17T00:12:04.871302+0000","last_undegraded":"2023-08-17T00:12:04.871302+0000","last_fullsized":"2023-08-17T00:12:04.871302+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.898988+0000","last_change":"2023-08-17T00:12:04.892490+0000","last_active":"2023-08-17T00:12:04.898988+0000","last_peered":"2023-08-17T00:12:04.898988+0000","last_clean":"2023-08-17T00:12:04.898988+0000","last_became_active":"2023-08-17T00:12:04.892200+0000","last_became_peered":"2023-08-17T00:12:04.892200+0000","last_unstale":"2023-08-17T00:12:04.898988+0000","last_undegraded":"2023-08-17T00:12:04.898988+0000","last_fullsized":"2023-08-17T00:12:04.898988+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877042+0000","last_change":"2023-08-17T00:12:04.453117+0000","last_active":"2023-08-17T00:12:04.877042+0000","last_peered":"2023-08-17T00:12:04.877042+0000","last_clean":"2023-08-17T00:12:04.877042+0000","last_became_active":"2023-08-17T00:12:04.452845+0000","last_became_peered":"2023-08-17T00:12:04.452845+0000","last_unstale":"2023-08-17T00:12:04.877042+0000","last_undegraded":"2023-08-17T00:12:04.877042+0000","last_fullsized":"2023-08-17T00:12:04.877042+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897776+0000","last_change":"2023-08-17T00:12:04.889487+0000","last_active":"2023-08-17T00:12:04.897776+0000","last_peered":"2023-08-17T00:12:04.897776+0000","last_clean":"2023-08-17T00:12:04.897776+0000","last_became_active":"2023-08-17T00:12:04.889226+0000","last_became_peered":"2023-08-17T00:12:04.889226+0000","last_unstale":"2023-08-17T00:12:04.897776+0000","last_undegraded":"2023-08-17T00:12:04.897776+0000","last_fullsized":"2023-08-17T00:12:04.897776+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.863620+0000","last_change":"2023-08-17T00:12:04.453685+0000","last_active":"2023-08-17T00:12:04.863620+0000","last_peered":"2023-08-17T00:12:04.863620+0000","last_clean":"2023-08-17T00:12:04.863620+0000","last_became_active":"2023-08-17T00:12:04.453389+0000","last_became_peered":"2023-08-17T00:12:04.453389+0000","last_unstale":"2023-08-17T00:12:04.863620+0000","last_undegraded":"2023-08-17T00:12:04.863620+0000","last_fullsized":"2023-08-17T00:12:04.863620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901178+0000","last_change":"2023-08-17T00:12:04.895393+0000","last_active":"2023-08-17T00:12:04.901178+0000","last_peered":"2023-08-17T00:12:04.901178+0000","last_clean":"2023-08-17T00:12:04.901178+0000","last_became_active":"2023-08-17T00:12:04.894956+0000","last_became_peered":"2023-08-17T00:12:04.894956+0000","last_unstale":"2023-08-17T00:12:04.901178+0000","last_undegraded":"2023-08-17T00:12:04.901178+0000","last_fullsized":"2023-08-17T00:12:04.901178+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.7","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.888037+0000","last_change":"2023-08-17T00:12:04.441712+0000","last_active":"2023-08-17T00:12:04.888037+0000","last_peered":"2023-08-17T00:12:04.888037+0000","last_clean":"2023-08-17T00:12:04.888037+0000","last_became_active":"2023-08-17T00:12:04.441369+0000","last_became_peered":"2023-08-17T00:12:04.441369+0000","last_unstale":"2023-08-17T00:12:04.888037+0000","last_undegraded":"2023-08-17T00:12:04.888037+0000","last_fullsized":"2023-08-17T00:12:04.888037+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899060+0000","last_change":"2023-08-17T00:12:04.891984+0000","last_active":"2023-08-17T00:12:04.899060+0000","last_peered":"2023-08-17T00:12:04.899060+0000","last_clean":"2023-08-17T00:12:04.899060+0000","last_became_active":"2023-08-17T00:12:04.889781+0000","last_became_peered":"2023-08-17T00:12:04.889781+0000","last_unstale":"2023-08-17T00:12:04.899060+0000","last_undegraded":"2023-08-17T00:12:04.899060+0000","last_fullsized":"2023-08-17T00:12:04.899060+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864064+0000","last_change":"2023-08-17T00:12:04.461048+0000","last_active":"2023-08-17T00:12:04.864064+0000","last_peered":"2023-08-17T00:12:04.864064+0000","last_clean":"2023-08-17T00:12:04.864064+0000","last_became_active":"2023-08-17T00:12:04.459924+0000","last_became_peered":"2023-08-17T00:12:04.459924+0000","last_unstale":"2023-08-17T00:12:04.864064+0000","last_undegraded":"2023-08-17T00:12:04.864064+0000","last_fullsized":"2023-08-17T00:12:04.864064+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891354+0000","last_change":"2023-08-17T00:12:04.887199+0000","last_active":"2023-08-17T00:12:04.891354+0000","last_peered":"2023-08-17T00:12:04.891354+0000","last_clean":"2023-08-17T00:12:04.891354+0000","last_became_active":"2023-08-17T00:12:04.886908+0000","last_became_peered":"2023-08-17T00:12:04.886908+0000","last_unstale":"2023-08-17T00:12:04.891354+0000","last_undegraded":"2023-08-17T00:12:04.891354+0000","last_fullsized":"2023-08-17T00:12:04.891354+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.865854+0000","last_change":"2023-08-17T00:12:04.459888+0000","last_active":"2023-08-17T00:12:04.865854+0000","last_peered":"2023-08-17T00:12:04.865854+0000","last_clean":"2023-08-17T00:12:04.865854+0000","last_became_active":"2023-08-17T00:12:04.459598+0000","last_became_peered":"2023-08-17T00:12:04.459598+0000","last_unstale":"2023-08-17T00:12:04.865854+0000","last_undegraded":"2023-08-17T00:12:04.865854+0000","last_fullsized":"2023-08-17T00:12:04.865854+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.899065+0000","last_change":"2023-08-17T00:12:04.891911+0000","last_active":"2023-08-17T00:12:04.899065+0000","last_peered":"2023-08-17T00:12:04.899065+0000","last_clean":"2023-08-17T00:12:04.899065+0000","last_became_active":"2023-08-17T00:12:04.891513+0000","last_became_peered":"2023-08-17T00:12:04.891513+0000","last_unstale":"2023-08-17T00:12:04.899065+0000","last_undegraded":"2023-08-17T00:12:04.899065+0000","last_fullsized":"2023-08-17T00:12:04.899065+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.879057+0000","last_change":"2023-08-17T00:12:04.450883+0000","last_active":"2023-08-17T00:12:04.879057+0000","last_peered":"2023-08-17T00:12:04.879057+0000","last_clean":"2023-08-17T00:12:04.879057+0000","last_became_active":"2023-08-17T00:12:04.450464+0000","last_became_peered":"2023-08-17T00:12:04.450464+0000","last_unstale":"2023-08-17T00:12:04.879057+0000","last_undegraded":"2023-08-17T00:12:04.879057+0000","last_fullsized":"2023-08-17T00:12:04.879057+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.901172+0000","last_change":"2023-08-17T00:12:04.895054+0000","last_active":"2023-08-17T00:12:04.901172+0000","last_peered":"2023-08-17T00:12:04.901172+0000","last_clean":"2023-08-17T00:12:04.901172+0000","last_became_active":"2023-08-17T00:12:04.894194+0000","last_became_peered":"2023-08-17T00:12:04.894194+0000","last_unstale":"2023-08-17T00:12:04.901172+0000","last_undegraded":"2023-08-17T00:12:04.901172+0000","last_fullsized":"2023-08-17T00:12:04.901172+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864620+0000","last_change":"2023-08-17T00:12:04.454748+0000","last_active":"2023-08-17T00:12:04.864620+0000","last_peered":"2023-08-17T00:12:04.864620+0000","last_clean":"2023-08-17T00:12:04.864620+0000","last_became_active":"2023-08-17T00:12:04.454186+0000","last_became_peered":"2023-08-17T00:12:04.454186+0000","last_unstale":"2023-08-17T00:12:04.864620+0000","last_undegraded":"2023-08-17T00:12:04.864620+0000","last_fullsized":"2023-08-17T00:12:04.864620+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890289+0000","last_change":"2023-08-17T00:12:04.883706+0000","last_active":"2023-08-17T00:12:04.890289+0000","last_peered":"2023-08-17T00:12:04.890289+0000","last_clean":"2023-08-17T00:12:04.890289+0000","last_became_active":"2023-08-17T00:12:04.883221+0000","last_became_peered":"2023-08-17T00:12:04.883221+0000","last_unstale":"2023-08-17T00:12:04.890289+0000","last_undegraded":"2023-08-17T00:12:04.890289+0000","last_fullsized":"2023-08-17T00:12:04.890289+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.871501+0000","last_change":"2023-08-17T00:12:04.452091+0000","last_active":"2023-08-17T00:12:04.871501+0000","last_peered":"2023-08-17T00:12:04.871501+0000","last_clean":"2023-08-17T00:12:04.871501+0000","last_became_active":"2023-08-17T00:12:04.451752+0000","last_became_peered":"2023-08-17T00:12:04.451752+0000","last_unstale":"2023-08-17T00:12:04.871501+0000","last_undegraded":"2023-08-17T00:12:04.871501+0000","last_fullsized":"2023-08-17T00:12:04.871501+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.886787+0000","last_change":"2023-08-17T00:12:04.884124+0000","last_active":"2023-08-17T00:12:04.886787+0000","last_peered":"2023-08-17T00:12:04.886787+0000","last_clean":"2023-08-17T00:12:04.886787+0000","last_became_active":"2023-08-17T00:12:04.883822+0000","last_became_peered":"2023-08-17T00:12:04.883822+0000","last_unstale":"2023-08-17T00:12:04.886787+0000","last_undegraded":"2023-08-17T00:12:04.886787+0000","last_fullsized":"2023-08-17T00:12:04.886787+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867922+0000","last_change":"2023-08-17T00:12:04.449711+0000","last_active":"2023-08-17T00:12:04.867922+0000","last_peered":"2023-08-17T00:12:04.867922+0000","last_clean":"2023-08-17T00:12:04.867922+0000","last_became_active":"2023-08-17T00:12:04.449434+0000","last_became_peered":"2023-08-17T00:12:04.449434+0000","last_unstale":"2023-08-17T00:12:04.867922+0000","last_undegraded":"2023-08-17T00:12:04.867922+0000","last_fullsized":"2023-08-17T00:12:04.867922+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895490+0000","last_change":"2023-08-17T00:12:04.889049+0000","last_active":"2023-08-17T00:12:04.895490+0000","last_peered":"2023-08-17T00:12:04.895490+0000","last_clean":"2023-08-17T00:12:04.895490+0000","last_became_active":"2023-08-17T00:12:04.888751+0000","last_became_peered":"2023-08-17T00:12:04.888751+0000","last_unstale":"2023-08-17T00:12:04.895490+0000","last_undegraded":"2023-08-17T00:12:04.895490+0000","last_fullsized":"2023-08-17T00:12:04.895490+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.863777+0000","last_change":"2023-08-17T00:12:04.458404+0000","last_active":"2023-08-17T00:12:04.863777+0000","last_peered":"2023-08-17T00:12:04.863777+0000","last_clean":"2023-08-17T00:12:04.863777+0000","last_became_active":"2023-08-17T00:12:04.458075+0000","last_became_peered":"2023-08-17T00:12:04.458075+0000","last_unstale":"2023-08-17T00:12:04.863777+0000","last_undegraded":"2023-08-17T00:12:04.863777+0000","last_fullsized":"2023-08-17T00:12:04.863777+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.883481+0000","last_change":"2023-08-17T00:12:04.875892+0000","last_active":"2023-08-17T00:12:04.883481+0000","last_peered":"2023-08-17T00:12:04.883481+0000","last_clean":"2023-08-17T00:12:04.883481+0000","last_became_active":"2023-08-17T00:12:04.875564+0000","last_became_peered":"2023-08-17T00:12:04.875564+0000","last_unstale":"2023-08-17T00:12:04.883481+0000","last_undegraded":"2023-08-17T00:12:04.883481+0000","last_fullsized":"2023-08-17T00:12:04.883481+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.14","version":"125'2","reported_seq":12,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.892113+0000","last_change":"2023-08-17T00:12:04.445674+0000","last_active":"2023-08-17T00:12:04.892113+0000","last_peered":"2023-08-17T00:12:04.892113+0000","last_clean":"2023-08-17T00:12:04.892113+0000","last_became_active":"2023-08-17T00:12:04.445404+0000","last_became_peered":"2023-08-17T00:12:04.445404+0000","last_unstale":"2023-08-17T00:12:04.892113+0000","last_undegraded":"2023-08-17T00:12:04.892113+0000","last_fullsized":"2023-08-17T00:12:04.892113+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.876659+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:12:04.876659+0000","last_peered":"2023-08-17T00:12:04.876659+0000","last_clean":"2023-08-17T00:12:04.876659+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:12:04.876659+0000","last_undegraded":"2023-08-17T00:12:04.876659+0000","last_fullsized":"2023-08-17T00:12:04.876659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895271+0000","last_change":"2023-08-17T00:12:04.887323+0000","last_active":"2023-08-17T00:12:04.895271+0000","last_peered":"2023-08-17T00:12:04.895271+0000","last_clean":"2023-08-17T00:12:04.895271+0000","last_became_active":"2023-08-17T00:12:04.887025+0000","last_became_peered":"2023-08-17T00:12:04.887025+0000","last_unstale":"2023-08-17T00:12:04.895271+0000","last_undegraded":"2023-08-17T00:12:04.895271+0000","last_fullsized":"2023-08-17T00:12:04.895271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"125'3","reported_seq":13,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891736+0000","last_change":"2023-08-17T00:12:04.445803+0000","last_active":"2023-08-17T00:12:04.891736+0000","last_peered":"2023-08-17T00:12:04.891736+0000","last_clean":"2023-08-17T00:12:04.891736+0000","last_became_active":"2023-08-17T00:12:04.445334+0000","last_became_peered":"2023-08-17T00:12:04.445334+0000","last_unstale":"2023-08-17T00:12:04.891736+0000","last_undegraded":"2023-08-17T00:12:04.891736+0000","last_fullsized":"2023-08-17T00:12:04.891736+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":117,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.866174+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:12:04.866174+0000","last_peered":"2023-08-17T00:12:04.866174+0000","last_clean":"2023-08-17T00:12:04.866174+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:12:04.866174+0000","last_undegraded":"2023-08-17T00:12:04.866174+0000","last_fullsized":"2023-08-17T00:12:04.866174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.891708+0000","last_change":"2023-08-17T00:12:04.885649+0000","last_active":"2023-08-17T00:12:04.891708+0000","last_peered":"2023-08-17T00:12:04.891708+0000","last_clean":"2023-08-17T00:12:04.891708+0000","last_became_active":"2023-08-17T00:12:04.885370+0000","last_became_peered":"2023-08-17T00:12:04.885370+0000","last_unstale":"2023-08-17T00:12:04.891708+0000","last_undegraded":"2023-08-17T00:12:04.891708+0000","last_fullsized":"2023-08-17T00:12:04.891708+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.878338+0000","last_change":"2023-08-17T00:12:04.452250+0000","last_active":"2023-08-17T00:12:04.878338+0000","last_peered":"2023-08-17T00:12:04.878338+0000","last_clean":"2023-08-17T00:12:04.878338+0000","last_became_active":"2023-08-17T00:12:04.451957+0000","last_became_peered":"2023-08-17T00:12:04.451957+0000","last_unstale":"2023-08-17T00:12:04.878338+0000","last_undegraded":"2023-08-17T00:12:04.878338+0000","last_fullsized":"2023-08-17T00:12:04.878338+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.875161+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:12:04.875161+0000","last_peered":"2023-08-17T00:12:04.875161+0000","last_clean":"2023-08-17T00:12:04.875161+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:12:04.875161+0000","last_undegraded":"2023-08-17T00:12:04.875161+0000","last_fullsized":"2023-08-17T00:12:04.875161+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.887676+0000","last_change":"2023-08-17T00:12:04.882281+0000","last_active":"2023-08-17T00:12:04.887676+0000","last_peered":"2023-08-17T00:12:04.887676+0000","last_clean":"2023-08-17T00:12:04.887676+0000","last_became_active":"2023-08-17T00:12:04.882011+0000","last_became_peered":"2023-08-17T00:12:04.882011+0000","last_unstale":"2023-08-17T00:12:04.887676+0000","last_undegraded":"2023-08-17T00:12:04.887676+0000","last_fullsized":"2023-08-17T00:12:04.887676+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.879633+0000","last_change":"2023-08-17T00:12:04.447944+0000","last_active":"2023-08-17T00:12:04.879633+0000","last_peered":"2023-08-17T00:12:04.879633+0000","last_clean":"2023-08-17T00:12:04.879633+0000","last_became_active":"2023-08-17T00:12:04.446686+0000","last_became_peered":"2023-08-17T00:12:04.446686+0000","last_unstale":"2023-08-17T00:12:04.879633+0000","last_undegraded":"2023-08-17T00:12:04.879633+0000","last_fullsized":"2023-08-17T00:12:04.879633+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":112,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.867742+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:12:04.867742+0000","last_peered":"2023-08-17T00:12:04.867742+0000","last_clean":"2023-08-17T00:12:04.867742+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:12:04.867742+0000","last_undegraded":"2023-08-17T00:12:04.867742+0000","last_fullsized":"2023-08-17T00:12:04.867742+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897601+0000","last_change":"2023-08-17T00:12:04.887117+0000","last_active":"2023-08-17T00:12:04.897601+0000","last_peered":"2023-08-17T00:12:04.897601+0000","last_clean":"2023-08-17T00:12:04.897601+0000","last_became_active":"2023-08-17T00:12:04.886758+0000","last_became_peered":"2023-08-17T00:12:04.886758+0000","last_unstale":"2023-08-17T00:12:04.897601+0000","last_undegraded":"2023-08-17T00:12:04.897601+0000","last_fullsized":"2023-08-17T00:12:04.897601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.864955+0000","last_change":"2023-08-17T00:12:04.450034+0000","last_active":"2023-08-17T00:12:04.864955+0000","last_peered":"2023-08-17T00:12:04.864955+0000","last_clean":"2023-08-17T00:12:04.864955+0000","last_became_active":"2023-08-17T00:12:04.449526+0000","last_became_peered":"2023-08-17T00:12:04.449526+0000","last_unstale":"2023-08-17T00:12:04.864955+0000","last_undegraded":"2023-08-17T00:12:04.864955+0000","last_fullsized":"2023-08-17T00:12:04.864955+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873090+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:12:04.873090+0000","last_peered":"2023-08-17T00:12:04.873090+0000","last_clean":"2023-08-17T00:12:04.873090+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:12:04.873090+0000","last_undegraded":"2023-08-17T00:12:04.873090+0000","last_fullsized":"2023-08-17T00:12:04.873090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.890266+0000","last_change":"2023-08-17T00:12:04.883488+0000","last_active":"2023-08-17T00:12:04.890266+0000","last_peered":"2023-08-17T00:12:04.890266+0000","last_clean":"2023-08-17T00:12:04.890266+0000","last_became_active":"2023-08-17T00:12:04.882813+0000","last_became_peered":"2023-08-17T00:12:04.882813+0000","last_unstale":"2023-08-17T00:12:04.890266+0000","last_undegraded":"2023-08-17T00:12:04.890266+0000","last_fullsized":"2023-08-17T00:12:04.890266+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.878980+0000","last_change":"2023-08-17T00:12:04.448160+0000","last_active":"2023-08-17T00:12:04.878980+0000","last_peered":"2023-08-17T00:12:04.878980+0000","last_clean":"2023-08-17T00:12:04.878980+0000","last_became_active":"2023-08-17T00:12:04.447821+0000","last_became_peered":"2023-08-17T00:12:04.447821+0000","last_unstale":"2023-08-17T00:12:04.878980+0000","last_undegraded":"2023-08-17T00:12:04.878980+0000","last_fullsized":"2023-08-17T00:12:04.878980+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":98,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877166+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:12:04.877166+0000","last_peered":"2023-08-17T00:12:04.877166+0000","last_clean":"2023-08-17T00:12:04.877166+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:12:04.877166+0000","last_undegraded":"2023-08-17T00:12:04.877166+0000","last_fullsized":"2023-08-17T00:12:04.877166+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.883344+0000","last_change":"2023-08-17T00:12:04.875220+0000","last_active":"2023-08-17T00:12:04.883344+0000","last_peered":"2023-08-17T00:12:04.883344+0000","last_clean":"2023-08-17T00:12:04.883344+0000","last_became_active":"2023-08-17T00:12:04.874920+0000","last_became_peered":"2023-08-17T00:12:04.874920+0000","last_unstale":"2023-08-17T00:12:04.883344+0000","last_undegraded":"2023-08-17T00:12:04.883344+0000","last_fullsized":"2023-08-17T00:12:04.883344+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.13","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.895434+0000","last_change":"2023-08-17T00:12:04.462284+0000","last_active":"2023-08-17T00:12:04.895434+0000","last_peered":"2023-08-17T00:12:04.895434+0000","last_clean":"2023-08-17T00:12:04.895434+0000","last_became_active":"2023-08-17T00:12:04.461990+0000","last_became_peered":"2023-08-17T00:12:04.461990+0000","last_unstale":"2023-08-17T00:12:04.895434+0000","last_undegraded":"2023-08-17T00:12:04.895434+0000","last_fullsized":"2023-08-17T00:12:04.895434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.877506+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:12:04.877506+0000","last_peered":"2023-08-17T00:12:04.877506+0000","last_clean":"2023-08-17T00:12:04.877506+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:12:04.877506+0000","last_undegraded":"2023-08-17T00:12:04.877506+0000","last_fullsized":"2023-08-17T00:12:04.877506+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.897661+0000","last_change":"2023-08-17T00:12:04.891837+0000","last_active":"2023-08-17T00:12:04.897661+0000","last_peered":"2023-08-17T00:12:04.897661+0000","last_clean":"2023-08-17T00:12:04.897661+0000","last_became_active":"2023-08-17T00:12:04.891509+0000","last_became_peered":"2023-08-17T00:12:04.891509+0000","last_unstale":"2023-08-17T00:12:04.897661+0000","last_undegraded":"2023-08-17T00:12:04.897661+0000","last_fullsized":"2023-08-17T00:12:04.897661+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":124,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:04.408655+0000","last_clean_scrub_stamp":"2023-08-17T00:12:04.408655+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"125'4","reported_seq":14,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.893607+0000","last_change":"2023-08-17T00:12:04.450133+0000","last_active":"2023-08-17T00:12:04.893607+0000","last_peered":"2023-08-17T00:12:04.893607+0000","last_clean":"2023-08-17T00:12:04.893607+0000","last_became_active":"2023-08-17T00:12:04.449836+0000","last_became_peered":"2023-08-17T00:12:04.449836+0000","last_unstale":"2023-08-17T00:12:04.893607+0000","last_undegraded":"2023-08-17T00:12:04.893607+0000","last_fullsized":"2023-08-17T00:12:04.893607+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:12:03.393895+0000","last_clean_scrub_stamp":"2023-08-17T00:12:03.393895+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":99,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.874981+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:12:04.874981+0000","last_peered":"2023-08-17T00:12:04.874981+0000","last_clean":"2023-08-17T00:12:04.874981+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:12:04.874981+0000","last_undegraded":"2023-08-17T00:12:04.874981+0000","last_fullsized":"2023-08-17T00:12:04.874981+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":100,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-08-17T00:12:04.873987+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:12:04.873987+0000","last_peered":"2023-08-17T00:12:04.873987+0000","last_clean":"2023-08-17T00:12:04.873987+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:12:04.873987+0000","last_undegraded":"2023-08-17T00:12:04.873987+0000","last_fullsized":"2023-08-17T00:12:04.873987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542259,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1568768,"data_stored":730175,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1,"15min":1.2450000000000001},"min":{"1min":0.60799999999999998,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.601,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":0.747},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.075,"15min":1.298},"min":{"1min":0.64800000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1379999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":0.874}]},{"osd":1,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":1.091,"15min":1.3129999999999999},"min":{"1min":0.78800000000000003,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.431,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.0820000000000001,"15min":1.3},"min":{"1min":0.71299999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5620000000000001,"5min":1.782,"15min":8.8399999999999999},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.012,"5min":1.048,"15min":1.2110000000000001},"min":{"1min":0.65800000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.478,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1619999999999999,"15min":1.355},"min":{"1min":0.63900000000000001,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.8340000000000001,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.093}]},{"osd":3,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.109,"15min":1.254},"min":{"1min":0.63300000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5649999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.125,"5min":1.2170000000000001,"15min":1.532},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.782,"5min":1.952,"15min":13.074999999999999},"last":1.1759999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.1599999999999999,"15min":1.4910000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":2.2370000000000001,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1539999999999999,"15min":1.413},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.796,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.1419999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.262,"15min":1.615},"min":{"1min":0.72299999999999998,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.0840000000000001,"5min":2.9830000000000001,"15min":14.435},"last":1.244},{"interface":"front","average":{"1min":1.24,"5min":1.2649999999999999,"15min":1.583},"min":{"1min":0.77800000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.026}]},{"osd":6,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.3180000000000001,"15min":1.607},"min":{"1min":0.82799999999999996,"5min":0.81299999999999994,"15min":0.80600000000000005},"max":{"1min":2.427,"5min":2.427,"15min":11.279999999999999},"last":1.278},{"interface":"front","average":{"1min":1.194,"5min":1.2529999999999999,"15min":1.528},"min":{"1min":0.71799999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.9299999999999999,"5min":2.4350000000000001,"15min":11.365},"last":1.0620000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542259,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1568768,"data_stored":729789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":1.056,"15min":1.0600000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.496,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.121,"15min":1.139},"min":{"1min":0.59299999999999997,"5min":0.51200000000000001,"15min":0.502},"max":{"1min":1.3779999999999999,"5min":10.519,"15min":10.519},"last":1.139}]},{"osd":1,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1659999999999999,"15min":1.1439999999999999},"min":{"1min":0.68700000000000006,"5min":0.443,"15min":0.443},"max":{"1min":1.347,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.028,"15min":1.038},"min":{"1min":0.56000000000000005,"5min":0.495,"15min":0.47199999999999998},"max":{"1min":1.726,"5min":3.4460000000000002,"15min":11.391999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1399999999999999,"15min":1.165},"min":{"1min":0.65300000000000002,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.494,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.022},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.296,"15min":1.2849999999999999},"min":{"1min":0.60999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.476,"5min":10.669,"15min":10.669},"last":1.371}]},{"osd":3,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.121,"15min":1.1719999999999999},"min":{"1min":0.73899999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":11.475},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.226,"15min":1.2589999999999999},"min":{"1min":0.82299999999999995,"5min":0.70899999999999996,"15min":0.64500000000000002},"max":{"1min":1.55,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.093}]},{"osd":4,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.3120000000000001,"15min":1.284},"min":{"1min":0.72799999999999998,"5min":0.629,"15min":0.59199999999999997},"max":{"1min":1.992,"5min":10.632,"15min":10.632},"last":1.415},{"interface":"front","average":{"1min":1.123,"5min":1.226,"15min":1.2450000000000001},"min":{"1min":0.70399999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.4340000000000002,"5min":5.8280000000000003,"15min":11.438000000000001},"last":0.90100000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.266,"15min":1.2629999999999999},"min":{"1min":0.71399999999999997,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.591,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.4099999999999999,"15min":1.3720000000000001},"min":{"1min":0.76000000000000001,"5min":0.628,"15min":0.628},"max":{"1min":1.901,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.7310000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.302,"15min":1.3340000000000001},"min":{"1min":0.67100000000000004,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.579,"5min":3.3450000000000002,"15min":11.51},"last":1.216},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.3799999999999999,"15min":1.4119999999999999},"min":{"1min":0.81699999999999995,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.837,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.266}]}]},{"osd":5,"up_from":14,"seq":60129542260,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":1572864,"data_stored":730749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.002,"15min":1.3779999999999999},"min":{"1min":0.55100000000000005,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.6060000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.135},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.012,"15min":1.494},"min":{"1min":0.72299999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.556,"5min":1.556,"15min":16.838999999999999},"last":1.4550000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0409999999999999,"15min":1.135},"min":{"1min":0.67200000000000004,"5min":0.53900000000000003,"15min":0.498},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.103,"15min":1.3580000000000001},"min":{"1min":0.624,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.3360000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1200000000000001,"15min":1.546},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.7010000000000001,"5min":1.7010000000000001,"15min":16.675000000000001},"last":1.196},{"interface":"front","average":{"1min":1.169,"5min":1.123,"15min":1.431},"min":{"1min":0.77300000000000002,"5min":0.64600000000000002,"15min":0.60299999999999998},"max":{"1min":1.6359999999999999,"5min":1.796,"15min":11.949},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1519999999999999,"15min":1.4770000000000001},"min":{"1min":0.70699999999999996,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6639999999999999,"5min":2.1349999999999998,"15min":13.125},"last":1.294},{"interface":"front","average":{"1min":1.204,"5min":1.177,"15min":1.4059999999999999},"min":{"1min":0.91500000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5449999999999999,"5min":1.704,"15min":8.4809999999999999},"last":0.95399999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.139,"15min":1.597},"min":{"1min":0.59499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.581,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.236},{"interface":"front","average":{"1min":1.121,"5min":1.1970000000000001,"15min":1.72},"min":{"1min":0.61499999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.51,"5min":1.7649999999999999,"15min":19.591000000000001},"last":1.3680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2250000000000001,"15min":1.6910000000000001},"min":{"1min":0.85099999999999998,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.6359999999999999,"5min":1.9350000000000001,"15min":17.158000000000001},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.238,"15min":1.694},"min":{"1min":0.75,"5min":0.65800000000000003,"15min":0.64400000000000002},"max":{"1min":1.5589999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:11:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2909999999999999,"15min":1.8},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.5589999999999999,"5min":1.9610000000000001,"15min":18.158000000000001},"last":1.411},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.353,"15min":1.7410000000000001},"min":{"1min":1.006,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.859,"5min":2.0899999999999999,"15min":14.818},"last":1.2629999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542259,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302848,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068992,"statfs":{"total":96636764160,"available":96326647808,"internally_reserved":0,"allocated":1564672,"data_stored":729303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.77600000000000002,"15min":0.78600000000000003},"min":{"1min":0.54900000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.86199999999999999,"15min":0.85499999999999998},"min":{"1min":0.625,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":2.6709999999999998,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83699999999999997,"15min":0.81299999999999994},"min":{"1min":0.58199999999999996,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2390000000000001,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.81599999999999995,"15min":0.90300000000000002},"min":{"1min":0.60799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2889999999999999,"5min":1.6299999999999999,"15min":2.5840000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.89800000000000002,"15min":0.91700000000000004},"min":{"1min":0.51800000000000002,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.25,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.997,"15min":1.0389999999999999},"min":{"1min":0.67400000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.4019999999999999,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":0.79000000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.161,"15min":1.206},"min":{"1min":0.83499999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4590000000000001,"5min":2.274,"15min":3.9449999999999998},"last":1.022},{"interface":"front","average":{"1min":1.196,"5min":1.1519999999999999,"15min":1.2110000000000001},"min":{"1min":0.83699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.734,"15min":3.9790000000000001},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.135,"15min":1.216},"min":{"1min":0.65200000000000002,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.579,"5min":1.883,"15min":2.1309999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.1910000000000001,"15min":1.264},"min":{"1min":0.92800000000000005,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6539999999999999,"5min":1.669,"15min":2.6789999999999998},"last":0.98899999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.147,"15min":1.246},"min":{"1min":0.78500000000000003,"5min":0.64500000000000002,"15min":0.58299999999999996},"max":{"1min":1.623,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.27,"5min":1.1639999999999999,"15min":1.2090000000000001},"min":{"1min":0.82299999999999995,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.968,"5min":2.0979999999999999,"15min":3.585},"last":0.89800000000000002}]},{"osd":7,"last update":"Thu Aug 17 00:12:03 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.2450000000000001},"min":{"1min":0.92100000000000004,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.907,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.153,"15min":1.234},"min":{"1min":0.81599999999999995,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.746,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.84499999999999997}]}]},{"osd":2,"up_from":14,"seq":60129542259,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306948,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064892,"statfs":{"total":96636764160,"available":96322449408,"internally_reserved":0,"allocated":1568768,"data_stored":729857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.83799999999999997},"min":{"1min":0.5,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.4359999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.76400000000000001,"15min":0.94199999999999995},"min":{"1min":0.57199999999999995,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61099999999999999,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.286,"5min":2.097,"15min":3.7589999999999999},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.91300000000000003,"15min":1.0449999999999999},"min":{"1min":0.69199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2949999999999999,"5min":1.3799999999999999,"15min":3.911},"last":1.1830000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":1.1220000000000001},"min":{"1min":0.628,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":5.4059999999999997},"last":1.004},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.98699999999999999},"min":{"1min":0.63500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4910000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":0.91700000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0860000000000001,"15min":1.5900000000000001},"min":{"1min":0.76800000000000002,"5min":0.61699999999999999,"15min":0.48399999999999999},"max":{"1min":1.794,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.218},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.91700000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":8.4399999999999995},"last":1.2330000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2569999999999999,"15min":1.5980000000000001},"min":{"1min":1.107,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.734,"5min":1.734,"15min":12.914},"last":1.29},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.4430000000000001},"min":{"1min":0.94199999999999995,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.772,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1990000000000001,"15min":1.5469999999999999},"min":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":1.621,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.621},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2410000000000001,"15min":1.5960000000000001},"min":{"1min":1.03,"5min":0.82899999999999996,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":1.6879999999999999,"15min":12.698},"last":1.405}]},{"osd":7,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.5720000000000001},"min":{"1min":1.0109999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.627,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3129999999999999,"15min":1.583},"min":{"1min":0.79200000000000004,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.9159999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.75}]}]},{"osd":1,"up_from":14,"seq":60129542259,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298756,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94073084,"statfs":{"total":96636764160,"available":96330838016,"internally_reserved":0,"allocated":1568768,"data_stored":729373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.80300000000000005,"15min":0.82199999999999995},"min":{"1min":0.46000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":2.6970000000000001,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.872,"5min":0.83799999999999997,"15min":0.90400000000000003},"min":{"1min":0.501,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.3380000000000001,"5min":1.367,"15min":13.093},"last":1.026}]},{"osd":2,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76000000000000001,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.84199999999999997,"15min":0.89400000000000002},"min":{"1min":0.54800000000000004,"5min":0.432,"15min":0.432},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.96199999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":0.95499999999999996,"15min":1.02},"min":{"1min":0.57799999999999996,"5min":0.437,"15min":0.437},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.077,"5min":0.875,"15min":0.97499999999999998},"min":{"1min":0.55100000000000005,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":3.3700000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.94299999999999995}]},{"osd":4,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.032,"15min":1.1559999999999999},"min":{"1min":0.67700000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.345,"5min":1.629,"15min":20.548999999999999},"last":1.357},{"interface":"front","average":{"1min":1.216,"5min":1.123,"15min":1.214},"min":{"1min":0.74199999999999999,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.7839999999999998,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.1970000000000001,"15min":1.3280000000000001},"min":{"1min":0.69499999999999995,"5min":0.67500000000000004,"15min":0.67200000000000004},"max":{"1min":3.137,"5min":3.137,"15min":13.170999999999999},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.1890000000000001,"15min":1.26},"min":{"1min":0.97799999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9690000000000001,"5min":1.9990000000000001,"15min":5.4240000000000004},"last":1.3009999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.1839999999999999,"15min":1.264},"min":{"1min":0.71499999999999997,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.175,"15min":1.2130000000000001},"min":{"1min":0.93700000000000006,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":2.0150000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.1859999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:11:56 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2490000000000001,"15min":1.3200000000000001},"min":{"1min":0.85299999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":3.1520000000000001,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.2589999999999999,"15min":1.3560000000000001},"min":{"1min":1.008,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":3.4180000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.2669999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542260,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306948,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064892,"statfs":{"total":96636764160,"available":96322449408,"internally_reserved":0,"allocated":1568768,"data_stored":729801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.94899999999999995,"15min":0.83799999999999997},"min":{"1min":0.46800000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.1279999999999999,"5min":18.442,"15min":18.442},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.90100000000000002,"15min":0.83199999999999996},"min":{"1min":0.42399999999999999,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.01,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":1.0640000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":1.044,"15min":0.94499999999999995},"min":{"1min":0.52400000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.286,"5min":18.481999999999999,"15min":18.481999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.97799999999999998,"15min":0.91600000000000004},"min":{"1min":0.60099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.3029999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.93700000000000006}]},{"osd":3,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.48199999999999998,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.105,"5min":1.613,"15min":1.613},"last":0.97099999999999997},{"interface":"front","average":{"1min":1,"5min":1.153,"15min":1.071},"min":{"1min":0.57899999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.3460000000000001,"5min":18.577000000000002,"15min":18.577000000000002},"last":0.88700000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.069,"15min":1.101},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.419,"5min":1.5800000000000001,"15min":1.7609999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.101,"5min":1.3540000000000001,"15min":1.2549999999999999},"min":{"1min":0.77000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.49,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.127}]},{"osd":5,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.3939999999999999,"15min":1.3100000000000001},"min":{"1min":0.74199999999999999,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.579,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.194,"15min":1.2589999999999999},"min":{"1min":0.83499999999999996,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.5129999999999999,"5min":1.984,"15min":1.984},"last":1.286}]},{"osd":6,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.373,"15min":1.323},"min":{"1min":0.82299999999999995,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.4430000000000001,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.3640000000000001,"15min":1.296},"min":{"1min":0.746,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.5049999999999999,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.161}]},{"osd":7,"last update":"Thu Aug 17 00:12:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.4019999999999999,"15min":1.3140000000000001},"min":{"1min":0.78100000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.486,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.242},{"interface":"front","average":{"1min":1.087,"5min":1.1559999999999999,"15min":1.226},"min":{"1min":0.72799999999999998,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.599,"5min":1.804,"15min":2.0750000000000002},"last":1.1020000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574964,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302852,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068988,"statfs":{"total":96636764160,"available":96326643712,"internally_reserved":0,"allocated":1568768,"data_stored":729269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.1160000000000001,"15min":1.093},"min":{"1min":0.622,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.677,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.056,"5min":1.111,"15min":1.075},"min":{"1min":0.74399999999999999,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":1.7330000000000001,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":1.05}]},{"osd":1,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2809999999999999,"15min":1.2410000000000001},"min":{"1min":0.64600000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5089999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.268,"15min":1.256},"min":{"1min":0.73099999999999998,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.2010000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2949999999999999,"15min":1.242},"min":{"1min":0.67700000000000005,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.389,"5min":18.431000000000001,"15min":18.431000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.482,"15min":1.3440000000000001},"min":{"1min":0.755,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.583,"5min":36.531999999999996,"15min":36.531999999999996},"last":1.0940000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1160000000000001,"15min":1.135},"min":{"1min":0.85999999999999999,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":1.3400000000000001,"5min":2.722,"15min":2.722},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.321,"5min":1.4319999999999999,"15min":1.421},"min":{"1min":0.98399999999999999,"5min":0.746,"15min":0.40400000000000003},"max":{"1min":1.742,"5min":19.484999999999999,"15min":36.530000000000001},"last":1.343}]},{"osd":5,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.298,"15min":1.252},"min":{"1min":0.66800000000000004,"5min":0.66100000000000003,"15min":0.433},"max":{"1min":1.7030000000000001,"5min":6.3250000000000002,"15min":6.3250000000000002},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3600000000000001,"15min":1.3069999999999999},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.63500000000000001},"max":{"1min":1.6299999999999999,"5min":9.4120000000000008,"15min":9.4120000000000008},"last":1.2290000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.335,"15min":1.3660000000000001},"min":{"1min":0.89300000000000002,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.875,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.337,"5min":1.385,"15min":1.4199999999999999},"min":{"1min":0.77400000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.911,"5min":6.1689999999999996,"15min":6.1689999999999996},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:12:00 2023","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.216,"15min":1.2889999999999999},"min":{"1min":0.92600000000000005,"5min":0.755,"15min":0.56100000000000005},"max":{"1min":1.647,"5min":2.6190000000000002,"15min":2.8620000000000001},"last":1.268},{"interface":"front","average":{"1min":1.3360000000000001,"5min":1.395,"15min":1.4319999999999999},"min":{"1min":0.79800000000000004,"5min":0.629,"15min":0.629},"max":{"1min":1.9690000000000001,"5min":6.7430000000000003,"15min":8.327},"last":1.48}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:12:09.932 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:12:09.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:12:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.133+0000 7f8fddd07700 1 Processor -- start 2023-08-17T00:12:10.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.133+0000 7f8fddd07700 1 -- start start 2023-08-17T00:12:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.137+0000 7f8fddd07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8fd814fe80 0x7f8fd8062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.137+0000 7f8fddd07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80634a0 0x7f8fd80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fddd07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80c51d0 con 0x7f8fd80c4d40 2023-08-17T00:12:10.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fddd07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd8063a10 con 0x7f8fd814fe80 2023-08-17T00:12:10.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fddd07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8151380 con 0x7f8fd80634a0 2023-08-17T00:12:10.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8fd814fe80 0x7f8fd8062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8fd814fe80 0x7f8fd8062fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:53840/0 (socket says 172.21.15.153:53840) 2023-08-17T00:12:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 -- 172.21.15.153:0/1987944014 learned_addr learned my addr 172.21.15.153:0/1987944014 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdd506700 1 --1- 172.21.15.153:0/1987944014 >> v1:172.21.15.178:6789/0 conn(0x7f8fd80c4d40 0x7f8fd8153980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:56726/0 (socket says 172.21.15.153:56726) 2023-08-17T00:12:10.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fd7fff700 1 --2- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80634a0 0x7f8fd80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 -- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80634a0 msgr2=0x7f8fd80c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 --2- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80634a0 0x7f8fd80c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fd77fe700 1 -- 172.21.15.153:0/1987944014 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223250550 0 0) 0x7f8fd80c51d0 con 0x7f8fd80c4d40 2023-08-17T00:12:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 -- 172.21.15.153:0/1987944014 >> v1:172.21.15.178:6789/0 conn(0x7f8fd80c4d40 legacy=0x7f8fd8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 -- 172.21.15.153:0/1987944014 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd81505c0 con 0x7f8fd814fe80 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fdcd05700 1 --2- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8062fb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f8fcc00d1a0 tx=0x7f8fcc00ba50).ready entity=mon.1 client_cookie=6ee60437c2aa6c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fd77fe700 1 -- 172.21.15.153:0/1987944014 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc010070 con 0x7f8fd814fe80 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fd77fe700 1 -- 172.21.15.153:0/1987944014 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00de10 con 0x7f8fd814fe80 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.141+0000 7f8fd77fe700 1 -- 172.21.15.153:0/1987944014 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc015680 con 0x7f8fd814fe80 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 -- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 msgr2=0x7f8fd8062fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 --2- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8062fb0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7f8fcc00d1a0 tx=0x7f8fcc00ba50).stop 2023-08-17T00:12:10.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 -- 172.21.15.153:0/1987944014 shutdown_connections 2023-08-17T00:12:10.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 --2- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80634a0 0x7f8fd80c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 --2- 172.21.15.153:0/1987944014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8062fb0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 -- 172.21.15.153:0/1987944014 >> 172.21.15.153:0/1987944014 conn(0x7f8fd80c4260 msgr2=0x7f8fd8068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:10.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 -- 172.21.15.153:0/1987944014 shutdown_connections 2023-08-17T00:12:10.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 -- 172.21.15.153:0/1987944014 wait complete. 2023-08-17T00:12:10.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 Processor -- start 2023-08-17T00:12:10.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.145+0000 7f8fddd07700 1 -- start start 2023-08-17T00:12:10.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 0x7f8fd80a7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80c4d40 0x7f8fd80ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80a8d40 con 0x7f8fd80634a0 2023-08-17T00:12:10.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd81648a0 con 0x7f8fd814fe80 2023-08-17T00:12:10.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80a91d0 con 0x7f8fd80c4d40 2023-08-17T00:12:10.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 0x7f8fd80a7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdd506700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 0x7f8fd80a7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54768/0 (socket says 172.21.15.153:54768) 2023-08-17T00:12:10.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 -- 172.21.15.153:0/3587426662 learned_addr learned my addr 172.21.15.153:0/3587426662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:10.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fd7fff700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80c4d40 0x7f8fd80ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 -- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80c4d40 msgr2=0x7f8fd80ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80c4d40 0x7f8fd80ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 -- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 msgr2=0x7f8fd8163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8163a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 -- 172.21.15.153:0/3587426662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fcc00bcf0 con 0x7f8fd80634a0 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fdcd05700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 0x7f8fd80a7540 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f8fd80c5360 tx=0x7f8fcc00ba50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc015c00 con 0x7f8fd80634a0 2023-08-17T00:12:10.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc015d60 con 0x7f8fd80634a0 2023-08-17T00:12:10.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd80a8130 con 0x7f8fd80634a0 2023-08-17T00:12:10.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.149+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc01e670 con 0x7f8fd80634a0 2023-08-17T00:12:10.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.153+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd80a86f0 con 0x7f8fd80634a0 2023-08-17T00:12:10.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.153+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd806b4c0 con 0x7f8fd80634a0 2023-08-17T00:12:10.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.153+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8fcc01eaa0 con 0x7f8fd80634a0 2023-08-17T00:12:10.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.157+0000 7f8fd4ff9700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fbc05a180 0x7f8fbc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.157+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8fcc075cf0 con 0x7f8fd80634a0 2023-08-17T00:12:10.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.157+0000 7f8fd7fff700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fbc05a180 0x7f8fbc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.157+0000 7f8fd7fff700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fbc05a180 0x7f8fbc05c640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f8fc4009b90 tx=0x7f8fc4009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:10.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.161+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8fcc0497a0 con 0x7f8fd80634a0 2023-08-17T00:12:10.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.377+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8fd81508a0 con 0x7f8fd80634a0 2023-08-17T00:12:10.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.385+0000 7f8fd4ff9700 1 -- 172.21.15.153:0/3587426662 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8fcc04cdc0 con 0x7f8fd80634a0 2023-08-17T00:12:10.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fbc05a180 msgr2=0x7f8fbc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fbc05a180 0x7f8fbc05c640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f8fc4009b90 tx=0x7f8fc4009060).stop 2023-08-17T00:12:10.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 msgr2=0x7f8fd80a7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 0x7f8fd80a7540 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 rx=0x7f8fd80c5360 tx=0x7f8fcc00ba50).stop 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 shutdown_connections 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fbc05a180 0x7f8fbc05c640 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd814fe80 0x7f8fd8163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80c4d40 0x7f8fd80ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 --2- 172.21.15.153:0/3587426662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd80634a0 0x7f8fd80a7540 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 >> 172.21.15.153:0/3587426662 conn(0x7f8fd80c4260 msgr2=0x7f8fd8064a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:10.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 shutdown_connections 2023-08-17T00:12:10.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.389+0000 7f8fddd07700 1 -- 172.21.15.153:0/3587426662 wait complete. 2023-08-17T00:12:10.399 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:12:10.393+0000 7f26cb9f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:12:10.399 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:12:10.418 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:10.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.573+0000 7f182759e700 1 Processor -- start 2023-08-17T00:12:10.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.573+0000 7f182759e700 1 -- start start 2023-08-17T00:12:10.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 0x7f1828068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1828068d10 0x7f1828064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18280ab9b0 con 0x7f1828150880 2023-08-17T00:12:10.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280691a0 con 0x7f1828068d10 2023-08-17T00:12:10.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18280a9080 con 0x7f18280aa8c0 2023-08-17T00:12:10.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1828150880 0x7f18280a8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56528/0 (socket says 172.21.15.153:56528) 2023-08-17T00:12:10.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182659c700 1 -- 172.21.15.153:0/1012893750 learned_addr learned my addr 172.21.15.153:0/1012893750 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:10.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249073168 0 0) 0x7f18280ab9b0 con 0x7f1828150880 2023-08-17T00:12:10.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1826d9d700 1 --2- 172.21.15.153:0/1012893750 >> v2:172.21.15.178:3300/0 conn(0x7f1828068d10 0x7f1828064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18140033f0 con 0x7f1828150880 2023-08-17T00:12:10.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f181dd9b700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 0x7f1828068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198032185 0 0) 0x7f18140033f0 con 0x7f1828150880 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 msgr2=0x7f1828068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 0x7f1828068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 >> v2:172.21.15.178:3300/0 conn(0x7f1828068d10 msgr2=0x7f1828064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 --2- 172.21.15.153:0/1012893750 >> v2:172.21.15.178:3300/0 conn(0x7f1828068d10 0x7f1828064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18280aada0 con 0x7f1828150880 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f18180015f0 con 0x7f1828150880 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 >> v1:172.21.15.153:6789/0 conn(0x7f1828150880 legacy=0x7f18280a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18140038e0 0x7f1814003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 0x7f1814004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1814004b80 0x7f1814005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280691a0 con 0x7f18140038e0 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18280a9080 con 0x7f1814004b80 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181400b8e0 con 0x7f18280aa8c0 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f182659c700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18140038e0 0x7f1814003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f1826d9d700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1814004b80 0x7f1814005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.577+0000 7f181dd9b700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 0x7f1814004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182659c700 1 -- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 msgr2=0x7f1814004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:10.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182659c700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18280aa8c0 0x7f1814004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182659c700 1 -- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1814004b80 msgr2=0x7f1814005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:10.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182659c700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1814004b80 0x7f1814005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182659c700 1 -- 172.21.15.153:0/1012893750 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18140033f0 con 0x7f18140038e0 2023-08-17T00:12:10.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182659c700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18140038e0 0x7f1814003d00 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f181800c210 tx=0x7f18180077a0).ready entity=mon.0 client_cookie=d0154312877b40c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:10.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180079d0 con 0x7f18140038e0 2023-08-17T00:12:10.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181800cae0 con 0x7f18140038e0 2023-08-17T00:12:10.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f1825d9b700 1 -- 172.21.15.153:0/1012893750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181800ce80 con 0x7f18140038e0 2023-08-17T00:12:10.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182759e700 1 -- 172.21.15.153:0/1012893750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18140038e0 msgr2=0x7f1814003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182759e700 1 --2- 172.21.15.153:0/1012893750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f18140038e0 0x7f1814003d00 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f181800c210 tx=0x7f18180077a0).stop 2023-08-17T00:12:10.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f1826d9d700 1 -- 172.21.15.153:0/1012893750 reap_dead start 2023-08-17T00:12:10.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182759e700 1 -- 172.21.15.153:0/1012893750 shutdown_connections 2023-08-17T00:12:10.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182759e700 1 -- 172.21.15.153:0/1012893750 >> 172.21.15.153:0/1012893750 conn(0x7f18280c6620 msgr2=0x7f18280c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:10.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182759e700 1 -- 172.21.15.153:0/1012893750 shutdown_connections 2023-08-17T00:12:10.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.581+0000 7f182759e700 1 -- 172.21.15.153:0/1012893750 wait complete. 2023-08-17T00:12:10.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 Processor -- start 2023-08-17T00:12:10.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 -- start start 2023-08-17T00:12:10.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18140038e0 0x7f1828164c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 0x7f1828150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18281568e0 0x7f1828156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1828157250 con 0x7f182813f8b0 2023-08-17T00:12:10.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18281516b0 con 0x7f18281568e0 2023-08-17T00:12:10.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f182759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1828151990 con 0x7f18140038e0 2023-08-17T00:12:10.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.585+0000 7f181dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 0x7f1828150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 0x7f1828150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54788/0 (socket says 172.21.15.153:54788) 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 -- 172.21.15.153:0/1588302375 learned_addr learned my addr 172.21.15.153:0/1588302375 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f1826d9d700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18281568e0 0x7f1828156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f182659c700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18140038e0 0x7f1828164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 -- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18140038e0 msgr2=0x7f1828164c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18140038e0 0x7f1828164c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 -- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18281568e0 msgr2=0x7f1828156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18281568e0 0x7f1828156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 -- 172.21.15.153:0/1588302375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1828151c70 con 0x7f182813f8b0 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181dd9b700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 0x7f1828150e80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f18100119f0 tx=0x7f1810009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000f710 con 0x7f182813f8b0 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181000f870 con 0x7f182813f8b0 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1828151f50 con 0x7f182813f8b0 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181000fbf0 con 0x7f182813f8b0 2023-08-17T00:12:10.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182813fd30 con 0x7f182813f8b0 2023-08-17T00:12:10.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.589+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18281523d0 con 0x7f182813f8b0 2023-08-17T00:12:10.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.593+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1810024070 con 0x7f182813f8b0 2023-08-17T00:12:10.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.593+0000 7f181effd700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f180805a180 0x7f180805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:10.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.593+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1810074b60 con 0x7f182813f8b0 2023-08-17T00:12:10.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.593+0000 7f182659c700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f180805a180 0x7f180805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:10.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.593+0000 7f182659c700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f180805a180 0x7f180805c640 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f181800cab0 tx=0x7f1818013000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:10.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.601+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1810048500 con 0x7f182813f8b0 2023-08-17T00:12:10.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.797+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18280ab080 con 0x7f182813f8b0 2023-08-17T00:12:10.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.797+0000 7f181effd700 1 -- 172.21.15.153:0/1588302375 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f181004bb20 con 0x7f182813f8b0 2023-08-17T00:12:10.802 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:10.802 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:10.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f180805a180 msgr2=0x7f180805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f180805a180 0x7f180805c640 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f181800cab0 tx=0x7f1818013000).stop 2023-08-17T00:12:10.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 msgr2=0x7f1828150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:10.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 0x7f1828150e80 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 rx=0x7f18100119f0 tx=0x7f1810009060).stop 2023-08-17T00:12:10.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 shutdown_connections 2023-08-17T00:12:10.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f180805a180 0x7f180805c640 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18281568e0 0x7f1828156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f182813f8b0 0x7f1828150e80 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 --2- 172.21.15.153:0/1588302375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18140038e0 0x7f1828164c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:10.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 >> 172.21.15.153:0/1588302375 conn(0x7f18280c6620 msgr2=0x7f18280c5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:10.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 shutdown_connections 2023-08-17T00:12:10.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:10.801+0000 7f182759e700 1 -- 172.21.15.153:0/1588302375 wait complete. 2023-08-17T00:12:10.807 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:11.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:12:04.855169+0000', 'modified': '2023-08-17T00:12:08.286701+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7947}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7947': {'gid': 7947, 'name': 'a', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/264350329', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6834', 'nonce': 264350329}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 264350329}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:12:11.229 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:12:11.230 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:12:11.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.389+0000 7f0a5b65b700 1 Processor -- start 2023-08-17T00:12:11.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.389+0000 7f0a5b65b700 1 -- start start 2023-08-17T00:12:11.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.389+0000 7f0a5b65b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a54151b40 0x7f0a540c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a54151f20 0x7f0a540c3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a540c4f90 con 0x7f0a540bdda0 2023-08-17T00:12:11.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540aad60 con 0x7f0a54151b40 2023-08-17T00:12:11.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a540c40d0 con 0x7f0a54151f20 2023-08-17T00:12:11.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a54151b40 0x7f0a540c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0a54151b40 0x7f0a540c5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54798/0 (socket says 172.21.15.153:54798) 2023-08-17T00:12:11.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 -- 172.21.15.153:0/4049618054 learned_addr learned my addr 172.21.15.153:0/4049618054 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/4049618054 >> v2:172.21.15.178:3300/0 conn(0x7f0a54151f20 0x7f0a540c3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 -- 172.21.15.153:0/4049618054 >> v2:172.21.15.178:3300/0 conn(0x7f0a54151f20 msgr2=0x7f0a540c3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 --2- 172.21.15.153:0/4049618054 >> v2:172.21.15.178:3300/0 conn(0x7f0a54151f20 0x7f0a540c3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 -- 172.21.15.153:0/4049618054 >> v1:172.21.15.153:6789/0 conn(0x7f0a540bdda0 legacy=0x7f0a54066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 -- 172.21.15.153:0/4049618054 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540c4380 con 0x7f0a54151b40 2023-08-17T00:12:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/4049618054 >> v2:172.21.15.178:3300/0 conn(0x7f0a54151f20 0x7f0a540c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a593f7700 1 --2- 172.21.15.153:0/4049618054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a54151b40 0x7f0a540c5a10 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f0a54155780 tx=0x7f0a44009840).ready entity=mon.0 client_cookie=77c41ef47a89d345 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a53fff700 1 -- 172.21.15.153:0/4049618054 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400e070 con 0x7f0a54151b40 2023-08-17T00:12:11.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a53fff700 1 -- 172.21.15.153:0/4049618054 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4400ba50 con 0x7f0a54151b40 2023-08-17T00:12:11.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a53fff700 1 -- 172.21.15.153:0/4049618054 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400bdd0 con 0x7f0a54151b40 2023-08-17T00:12:11.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- 172.21.15.153:0/4049618054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a54151b40 msgr2=0x7f0a540c5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/4049618054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a54151b40 0x7f0a540c5a10 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 rx=0x7f0a54155780 tx=0x7f0a44009840).stop 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- 172.21.15.153:0/4049618054 shutdown_connections 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/4049618054 >> v2:172.21.15.178:3300/0 conn(0x7f0a54151f20 0x7f0a540c3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/4049618054 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a54151b40 0x7f0a540c5a10 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- 172.21.15.153:0/4049618054 >> 172.21.15.153:0/4049618054 conn(0x7f0a540c92e0 msgr2=0x7f0a540c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- 172.21.15.153:0/4049618054 shutdown_connections 2023-08-17T00:12:11.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.393+0000 7f0a5b65b700 1 -- 172.21.15.153:0/4049618054 wait complete. 2023-08-17T00:12:11.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 Processor -- start 2023-08-17T00:12:11.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 -- start start 2023-08-17T00:12:11.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 0x7f0a54158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54151b40 0x7f0a54152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54151f20 0x7f0a54152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54152d20 con 0x7f0a540bdda0 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a540659c0 con 0x7f0a54151f20 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a5b65b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a54064db0 con 0x7f0a54151b40 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 0x7f0a54158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 0x7f0a54158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54812/0 (socket says 172.21.15.153:54812) 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 -- 172.21.15.153:0/365622441 learned_addr learned my addr 172.21.15.153:0/365622441 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54151b40 0x7f0a54152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 -- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54151b40 msgr2=0x7f0a54152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54151b40 0x7f0a54152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 -- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54151f20 msgr2=0x7f0a54152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54151f20 0x7f0a54152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54151f20 0x7f0a54152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a593f7700 1 -- 172.21.15.153:0/365622441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a44009ae0 con 0x7f0a540bdda0 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.397+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54151f20 0x7f0a54152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:11.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a593f7700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 0x7f0a54158e80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f0a44009fd0 tx=0x7f0a44009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a517fa700 1 -- 172.21.15.153:0/365622441 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440032d0 con 0x7f0a540bdda0 2023-08-17T00:12:11.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a517fa700 1 -- 172.21.15.153:0/365622441 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a44009500 con 0x7f0a540bdda0 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a54065090 con 0x7f0a540bdda0 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a517fa700 1 -- 172.21.15.153:0/365622441 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400bdd0 con 0x7f0a540bdda0 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a54065650 con 0x7f0a540bdda0 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.401+0000 7f0a517fa700 1 -- 172.21.15.153:0/365622441 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0a4401b040 con 0x7f0a540bdda0 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.405+0000 7f0a517fa700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4005a150 0x7f0a4005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.405+0000 7f0a517fa700 1 -- 172.21.15.153:0/365622441 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a44075af0 con 0x7f0a540bdda0 2023-08-17T00:12:11.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.405+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4005a150 0x7f0a4005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.405+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4005a150 0x7f0a4005c610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0a48006d80 tx=0x7f0a48008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 Processor -- start 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 -- start start 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23e1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x23e3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x239d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x230b5c0 con 0x23e1a10 2023-08-17T00:12:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2320e90 con 0x23a07f0 2023-08-17T00:12:11.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22e7220 con 0x23e42f0 2023-08-17T00:12:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23e1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23e1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54828/0 (socket says 172.21.15.153:54828) 2023-08-17T00:12:11.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 -- 172.21.15.153:0/1482919709 learned_addr learned my addr 172.21.15.153:0/1482919709 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x23e3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x239d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 -- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 msgr2=0x239d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x239d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 -- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 msgr2=0x23e3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x23e3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 -- 172.21.15.153:0/1482919709 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x232c500 con 0x23e1a10 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23e1df0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f0a4404cd90 tx=0x7f0a4400e000).ready entity=mon.0 client_cookie=ecfd42f81a7e08ea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a3a7fc700 1 -- 172.21.15.153:0/1482919709 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44011e20 con 0x23e1a10 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a3a7fc700 1 -- 172.21.15.153:0/1482919709 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4404b4f0 con 0x23e1a10 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.409+0000 7f0a3a7fc700 1 -- 172.21.15.153:0/1482919709 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4404c640 con 0x23e1a10 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- 172.21.15.153:0/1482919709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 msgr2=0x23e1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23e1df0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7f0a4404cd90 tx=0x7f0a4400e000).stop 2023-08-17T00:12:11.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- 172.21.15.153:0/1482919709 shutdown_connections 2023-08-17T00:12:11.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x239d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x23e3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1482919709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23e1df0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- 172.21.15.153:0/1482919709 >> 172.21.15.153:0/1482919709 conn(0x217f550 msgr2=0x23a0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- 172.21.15.153:0/1482919709 shutdown_connections 2023-08-17T00:12:11.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- 172.21.15.153:0/1482919709 wait complete. 2023-08-17T00:12:11.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- start start 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 Processor -- start 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 0x23c5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23e1a10 0x23ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22ec110 con 0x23a07f0 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x23cac20 con 0x23e1a10 2023-08-17T00:12:11.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x23ca7a0 con 0x23e42f0 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.413+0000 7f0a659fc740 10 client.0 ll_register_callbacks cb 0x23583c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 0x23c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 0x23c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54834/0 (socket says 172.21.15.153:54834) 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 -- 172.21.15.153:0/3715755111 learned_addr learned my addr 172.21.15.153:0/3715755111 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23e1a10 0x23ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 -- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 msgr2=0x23e0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23e0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 -- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23e1a10 msgr2=0x23ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23e1a10 0x23ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 -- 172.21.15.153:0/3715755111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a54065650 con 0x23a07f0 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23e1a10 0x23ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a593f7700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 0x23c5700 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f0a44049600 tx=0x7f0a44031000).ready entity=mon.0 client_cookie=10bd4ca434f0663a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:11.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 1 -- 172.21.15.153:0/3715755111 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400e040 con 0x23a07f0 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 1 -- 172.21.15.153:0/3715755111 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a44038070 con 0x23a07f0 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2316c60 con 0x23a07f0 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 1 -- 172.21.15.153:0/3715755111 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4404c0b0 con 0x23a07f0 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 10 client.8097 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x2319f80 con 0x23a07f0 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 1 -- 172.21.15.153:0/3715755111 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2316c60 con 0x23a07f0 2023-08-17T00:12:11.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 1 -- 172.21.15.153:0/3715755111 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a4404c210 con 0x23a07f0 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 10 client.8097 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 10 client.8097 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 20 client.8097 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x239a4d0 0x239a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 4 client.8097 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x230d1b0 con 0x239a4d0 2023-08-17T00:12:11.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x239a4d0 0x239a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a337fe700 10 client.8097 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.417+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x239a4d0 0x239a8b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9ebf4b8946f5a0a0 server_cookie=43f688724d171343 in_seq=0 out_seq=0 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a337fe700 1 -- 172.21.15.153:0/3715755111 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x230d1b0 con 0x239a4d0 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a337fe700 10 client.8097 handle_command_reply: tid=0 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 client.8097 shutdown 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 msgr2=0x23c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 0x23c5700 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7f0a44049600 tx=0x7f0a44031000).stop 2023-08-17T00:12:11.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 shutdown_connections 2023-08-17T00:12:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x239a4d0 0x239a8b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23e0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23e1a10 0x23ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 --2- 172.21.15.153:0/3715755111 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23a07f0 0x23c5700 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a337fe700 0 client.8097 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 >> 172.21.15.153:0/3715755111 conn(0x217f550 msgr2=0x23e26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 shutdown_connections 2023-08-17T00:12:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 1 -- 172.21.15.153:0/3715755111 wait complete. 2023-08-17T00:12:11.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.421+0000 7f0a659fc740 20 client.8097 trim_cache size 0 max 16384 2023-08-17T00:12:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 Processor -- start 2023-08-17T00:12:11.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 -- start start 2023-08-17T00:12:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x239b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23c9910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c54d0 con 0x23e1a10 2023-08-17T00:12:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x23ca2f0 con 0x23a07f0 2023-08-17T00:12:11.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x230d1b0 con 0x23e42f0 2023-08-17T00:12:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a58bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a58bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54836/0 (socket says 172.21.15.153:54836) 2023-08-17T00:12:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a58bf6700 1 -- 172.21.15.153:0/1670168013 learned_addr learned my addr 172.21.15.153:0/1670168013 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x239b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 -- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 msgr2=0x23c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 -- 172.21.15.153:0/1670168013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 msgr2=0x23c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 -- 172.21.15.153:0/1670168013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540c7340 con 0x23a07f0 2023-08-17T00:12:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.441+0000 7f0a593f7700 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x239b6d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f0a44049650 tx=0x7f0a44038000).ready entity=mon.1 client_cookie=deaa0fcee342f3b9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a3affd700 1 -- 172.21.15.153:0/1670168013 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400e020 con 0x23a07f0 2023-08-17T00:12:11.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a3affd700 1 -- 172.21.15.153:0/1670168013 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4404d150 con 0x23a07f0 2023-08-17T00:12:11.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a3affd700 1 -- 172.21.15.153:0/1670168013 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44075270 con 0x23a07f0 2023-08-17T00:12:11.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 msgr2=0x239b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x239b6d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7f0a44049650 tx=0x7f0a44038000).stop 2023-08-17T00:12:11.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- 172.21.15.153:0/1670168013 shutdown_connections 2023-08-17T00:12:11.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e42f0 0x23c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e1a10 0x23c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- 172.21.15.153:0/1670168013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x239b6d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- 172.21.15.153:0/1670168013 >> 172.21.15.153:0/1670168013 conn(0x217f550 msgr2=0x23fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- 172.21.15.153:0/1670168013 shutdown_connections 2023-08-17T00:12:11.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- 172.21.15.153:0/1670168013 wait complete. 2023-08-17T00:12:11.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- start start 2023-08-17T00:12:11.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 Processor -- start 2023-08-17T00:12:11.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x2447ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e1a10 0x23e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 0x23e37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x23e3cd0 con 0x23e42f0 2023-08-17T00:12:11.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c7320 con 0x23a07f0 2023-08-17T00:12:11.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24493d0 con 0x23e1a10 2023-08-17T00:12:11.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.445+0000 7f0a659fc740 10 client.0 ll_register_callbacks cb 0x7f0a4c007d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:11.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 0x23e37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 0x23e37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54850/0 (socket says 172.21.15.153:54850) 2023-08-17T00:12:11.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 -- 172.21.15.153:0/2301013275 learned_addr learned my addr 172.21.15.153:0/2301013275 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a593f7700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x2447ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a58bf6700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e1a10 0x23e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 -- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e1a10 msgr2=0x23e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e1a10 0x23e32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 -- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 msgr2=0x2447ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x2447ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 -- 172.21.15.153:0/2301013275 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a54065650 con 0x23e42f0 2023-08-17T00:12:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a593f7700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x2447ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:11.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a59bf8700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 0x23e37e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0a54164220 tx=0x7f0a4c009040).ready entity=mon.0 client_cookie=2e0e8905c0521ea1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a337fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:11.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a337fe700 1 -- 172.21.15.153:0/2301013275 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c014e60 con 0x23e42f0 2023-08-17T00:12:11.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21d64e0 con 0x23e42f0 2023-08-17T00:12:11.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a337fe700 1 -- 172.21.15.153:0/2301013275 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0a4c003570 con 0x23e42f0 2023-08-17T00:12:11.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a337fe700 1 -- 172.21.15.153:0/2301013275 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a4c016840 con 0x23e42f0 2023-08-17T00:12:11.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 10 client.8103 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x2315420 con 0x23e42f0 2023-08-17T00:12:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a337fe700 1 -- 172.21.15.153:0/2301013275 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21d64e0 con 0x23e42f0 2023-08-17T00:12:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a337fe700 1 -- 172.21.15.153:0/2301013275 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0a4c01d060 con 0x23e42f0 2023-08-17T00:12:11.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 10 client.8103 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 10 client.8103 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:12:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 20 client.8103 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23c43a0 0x23c4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 4 client.8103 mds_command: new command op to 7947 tid=0[{"prefix": "status"}] 2023-08-17T00:12:11.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "status"}) v1 -- 0x218c260 con 0x23c43a0 2023-08-17T00:12:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.449+0000 7f0a593f7700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23c43a0 0x23c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a593f7700 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23c43a0 0x23c4780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1f16d89cad7355ed server_cookie=fdee06e13457384a in_seq=0 out_seq=0 2023-08-17T00:12:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a337fe700 10 client.8103 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a337fe700 1 -- 172.21.15.153:0/2301013275 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x218c260 con 0x23c43a0 2023-08-17T00:12:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a337fe700 10 client.8103 handle_command_reply: tid=0 2023-08-17T00:12:11.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 client.8103 shutdown 2023-08-17T00:12:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 msgr2=0x23e37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 0x23e37e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7f0a54164220 tx=0x7f0a4c009040).stop 2023-08-17T00:12:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 shutdown_connections 2023-08-17T00:12:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23c43a0 0x23c4780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x23e42f0 0x23e37e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x23e1a10 0x23e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a337fe700 0 client.8103 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 --2- 172.21.15.153:0/2301013275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x23a07f0 0x2447ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 >> 172.21.15.153:0/2301013275 conn(0x217f550 msgr2=0x239eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 shutdown_connections 2023-08-17T00:12:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 1 -- 172.21.15.153:0/2301013275 wait complete. 2023-08-17T00:12:11.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a659fc740 20 client.8103 trim_cache size 0 max 16384 2023-08-17T00:12:11.473 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:11.473 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:12:11.473 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:12:11.473 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 7947, 2023-08-17T00:12:11.473 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:12:11.473 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.5953897960000001, 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 101, 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 126, 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 126, 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.987425864 2023-08-17T00:12:11.474 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:11.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4005a150 msgr2=0x7f0a4005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4005a150 0x7f0a4005c610 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0a48006d80 tx=0x7f0a48008040).stop 2023-08-17T00:12:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 msgr2=0x7f0a54158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 0x7f0a54158e80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7f0a44009fd0 tx=0x7f0a44009840).stop 2023-08-17T00:12:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 shutdown_connections 2023-08-17T00:12:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4005a150 0x7f0a4005c610 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a54151f20 0x7f0a54152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a54151b40 0x7f0a54152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 --2- 172.21.15.153:0/365622441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a540bdda0 0x7f0a54158e80 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 >> 172.21.15.153:0/365622441 conn(0x7f0a540c92e0 msgr2=0x7f0a540a8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 shutdown_connections 2023-08-17T00:12:11.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.453+0000 7f0a5b65b700 1 -- 172.21.15.153:0/365622441 wait complete. 2023-08-17T00:12:11.480 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:12:11.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 Processor -- start 2023-08-17T00:12:11.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 -- start start 2023-08-17T00:12:11.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d01516c0 0x7fd0d0157780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0d0068f40 0x7fd0d0062ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d0157d40 con 0x7fd0d0154be0 2023-08-17T00:12:11.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d00c2fc0 con 0x7fd0d0068f40 2023-08-17T00:12:11.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.609+0000 7fd0d5307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0158020 con 0x7fd0d01516c0 2023-08-17T00:12:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0d0068f40 0x7fd0d0062ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd0d0068f40 0x7fd0d0062ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54858/0 (socket says 172.21.15.153:54858) 2023-08-17T00:12:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 -- 172.21.15.153:0/3016942434 learned_addr learned my addr 172.21.15.153:0/3016942434 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0c77fe700 1 --1- 172.21.15.153:0/3016942434 >> v1:172.21.15.153:6789/0 conn(0x7fd0d0154be0 0x7fd0d0068830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56540/0 (socket says 172.21.15.153:56540) 2023-08-17T00:12:11.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0cffff700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d01516c0 0x7fd0d0157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 -- 172.21.15.153:0/3016942434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d01516c0 msgr2=0x7fd0d0157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d01516c0 0x7fd0d0157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 -- 172.21.15.153:0/3016942434 >> v1:172.21.15.153:6789/0 conn(0x7fd0d0154be0 legacy=0x7fd0d0068830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 -- 172.21.15.153:0/3016942434 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0158300 con 0x7fd0d0068f40 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0cffff700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d01516c0 0x7fd0d0157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d4b06700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0068f40 0x7fd0d0062ec0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fd0c8006fd0 tx=0x7fd0c80090f0).ready entity=mon.0 client_cookie=ce8eb2c5babe21f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0cf7fe700 1 -- 172.21.15.153:0/3016942434 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800b600 con 0x7fd0d0068f40 2023-08-17T00:12:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0cf7fe700 1 -- 172.21.15.153:0/3016942434 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c800b760 con 0x7fd0d0068f40 2023-08-17T00:12:11.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0cf7fe700 1 -- 172.21.15.153:0/3016942434 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800bae0 con 0x7fd0d0068f40 2023-08-17T00:12:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 -- 172.21.15.153:0/3016942434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0068f40 msgr2=0x7fd0d0062ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0068f40 0x7fd0d0062ec0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7fd0c8006fd0 tx=0x7fd0c80090f0).stop 2023-08-17T00:12:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 -- 172.21.15.153:0/3016942434 shutdown_connections 2023-08-17T00:12:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0068f40 0x7fd0d0062ec0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 --2- 172.21.15.153:0/3016942434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d01516c0 0x7fd0d0157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 -- 172.21.15.153:0/3016942434 >> 172.21.15.153:0/3016942434 conn(0x7fd0d0065d10 msgr2=0x7fd0d0066120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 -- 172.21.15.153:0/3016942434 shutdown_connections 2023-08-17T00:12:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.613+0000 7fd0d5307700 1 -- 172.21.15.153:0/3016942434 wait complete. 2023-08-17T00:12:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 Processor -- start 2023-08-17T00:12:11.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 -- start start 2023-08-17T00:12:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d0068f40 0x7fd0d0156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d01516c0 0x7fd0d014de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 0x7fd0d0168a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d0157790 con 0x7fd0d0154be0 2023-08-17T00:12:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d01550e0 con 0x7fd0d01516c0 2023-08-17T00:12:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d5307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d01553c0 con 0x7fd0d0068f40 2023-08-17T00:12:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d4b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 0x7fd0d0168a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d4b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 0x7fd0d0168a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54872/0 (socket says 172.21.15.153:54872) 2023-08-17T00:12:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0d4b06700 1 -- 172.21.15.153:0/1186179644 learned_addr learned my addr 172.21.15.153:0/1186179644 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0c77fe700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d01516c0 0x7fd0d014de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.617+0000 7fd0cffff700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d0068f40 0x7fd0d0156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d4b06700 1 -- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d0068f40 msgr2=0x7fd0d0156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d4b06700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d0068f40 0x7fd0d0156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d4b06700 1 -- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d01516c0 msgr2=0x7fd0d014de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d4b06700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d01516c0 0x7fd0d014de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d4b06700 1 -- 172.21.15.153:0/1186179644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c8009370 con 0x7fd0d0154be0 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0c77fe700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d01516c0 0x7fd0d014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d4b06700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 0x7fd0d0168a20 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fd0c8011000 tx=0x7fd0c8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800bae0 con 0x7fd0d0154be0 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c801c420 con 0x7fd0d0154be0 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c801c7c0 con 0x7fd0d0154be0 2023-08-17T00:12:11.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d014e2f0 con 0x7fd0d0154be0 2023-08-17T00:12:11.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d01694e0 con 0x7fd0d0154be0 2023-08-17T00:12:11.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.621+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d005ec30 con 0x7fd0d0154be0 2023-08-17T00:12:11.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.625+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd0c802c070 con 0x7fd0d0154be0 2023-08-17T00:12:11.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.625+0000 7fd0ccff9700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd0b005a150 0x7fd0b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:11.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.625+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd0c8075ff0 con 0x7fd0d0154be0 2023-08-17T00:12:11.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.625+0000 7fd0cffff700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd0b005a150 0x7fd0b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:11.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.625+0000 7fd0cffff700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd0b005a150 0x7fd0b005c610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fd0c000abd0 tx=0x7fd0c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:11.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.629+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd0c8049a50 con 0x7fd0d0154be0 2023-08-17T00:12:11.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.829+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0d0155500 con 0x7fd0d0154be0 2023-08-17T00:12:11.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.829+0000 7fd0ccff9700 1 -- 172.21.15.153:0/1186179644 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd0c802a070 con 0x7fd0d0154be0 2023-08-17T00:12:11.834 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:12:11.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd0b005a150 msgr2=0x7fd0b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd0b005a150 0x7fd0b005c610 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7fd0c000abd0 tx=0x7fd0c0008040).stop 2023-08-17T00:12:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 msgr2=0x7fd0d0168a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:11.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 0x7fd0d0168a20 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 rx=0x7fd0c8011000 tx=0x7fd0c8017000).stop 2023-08-17T00:12:11.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 shutdown_connections 2023-08-17T00:12:11.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd0b005a150 0x7fd0b005c610 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd0d0154be0 0x7fd0d0168a20 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d01516c0 0x7fd0d014de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 --2- 172.21.15.153:0/1186179644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d0068f40 0x7fd0d0156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 >> 172.21.15.153:0/1186179644 conn(0x7fd0d0065d10 msgr2=0x7fd0d00c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:11.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 shutdown_connections 2023-08-17T00:12:11.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:11.833+0000 7fd0d5307700 1 -- 172.21.15.153:0/1186179644 wait complete. 2023-08-17T00:12:11.856 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:12:11.857 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:12:11.857 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:12:11.857 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:12:11.857 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:12:11.858 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:12:11.858 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:12:11.858 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:12:11.858 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:12:11.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:11.859 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:12:11.878 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:12:11.879 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:12:11.880 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41881sec preferred_lft 41881sec 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:12:11.881 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.882 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:12:11.883 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:12:11.884 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:12:11.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:11.885 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:12:11.970 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:12:11.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:11.975 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:12:12.036 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:12:12.036 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:12:12.036 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:12:12.036 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:12:12.037 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:12:12.037 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:12:12.037 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:12:12.037 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:12:12.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:12.038 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:12:12.038 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:12.038 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:12:12.039 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:12:12.039 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:12:12.039 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:12.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:12.173 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:12:12.194 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:12:12.195 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:12:12.195 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:12:12.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:12.197 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:12:12.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:12.271 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:12:12.331 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:12:12.332 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:12:12.449 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:12:12.449 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:12:12.467 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:12:12.468 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:12:12.474 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:12:12.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:12.475 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:12:12.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:12.508 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:12.509 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:12.510 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.0 2023-08-17T00:12:12.511 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:12.511 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:12.512 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:12.514 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:12.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.629 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291043 s, 36.0 MB/s 2023-08-17T00:12:12.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.663 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030447 s, 34.4 MB/s 2023-08-17T00:12:12.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.694 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264681 s, 39.6 MB/s 2023-08-17T00:12:12.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.721 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228215 s, 45.9 MB/s 2023-08-17T00:12:12.753 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.754 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291254 s, 36.0 MB/s 2023-08-17T00:12:12.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.782 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244387 s, 42.9 MB/s 2023-08-17T00:12:12.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.814 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272284 s, 38.5 MB/s 2023-08-17T00:12:12.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301391 s, 34.8 MB/s 2023-08-17T00:12:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.887 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342434 s, 30.6 MB/s 2023-08-17T00:12:12.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.916 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242843 s, 43.2 MB/s 2023-08-17T00:12:12.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.943 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236244 s, 44.4 MB/s 2023-08-17T00:12:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:12.971 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026135 s, 40.1 MB/s 2023-08-17T00:12:13.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264792 s, 39.6 MB/s 2023-08-17T00:12:13.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.027 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209777 s, 50.0 MB/s 2023-08-17T00:12:13.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.055 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247106 s, 42.4 MB/s 2023-08-17T00:12:13.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.079 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217258 s, 48.3 MB/s 2023-08-17T00:12:13.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.108 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255331 s, 41.1 MB/s 2023-08-17T00:12:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220911 s, 47.5 MB/s 2023-08-17T00:12:13.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.162 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251325 s, 41.7 MB/s 2023-08-17T00:12:13.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.193 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265744 s, 39.5 MB/s 2023-08-17T00:12:13.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.228 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302647 s, 34.6 MB/s 2023-08-17T00:12:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220655 s, 47.5 MB/s 2023-08-17T00:12:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.282 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.283 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023698 s, 44.2 MB/s 2023-08-17T00:12:13.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272328 s, 38.5 MB/s 2023-08-17T00:12:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.344 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263546 s, 39.8 MB/s 2023-08-17T00:12:13.373 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.374 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260614 s, 40.2 MB/s 2023-08-17T00:12:13.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256322 s, 40.9 MB/s 2023-08-17T00:12:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264456 s, 39.7 MB/s 2023-08-17T00:12:13.468 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.469 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291597 s, 36.0 MB/s 2023-08-17T00:12:13.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202608 s, 51.8 MB/s 2023-08-17T00:12:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.523 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249895 s, 42.0 MB/s 2023-08-17T00:12:13.549 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.549 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.549 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225224 s, 46.6 MB/s 2023-08-17T00:12:13.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:13.551 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:13.551 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:13.552 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.1 2023-08-17T00:12:13.552 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:13.552 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:13.552 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:13.553 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:13.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.608 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250554 s, 41.9 MB/s 2023-08-17T00:12:13.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.637 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244483 s, 42.9 MB/s 2023-08-17T00:12:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.669 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283812 s, 36.9 MB/s 2023-08-17T00:12:13.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.700 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270116 s, 38.8 MB/s 2023-08-17T00:12:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.725 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218267 s, 48.0 MB/s 2023-08-17T00:12:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.756 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026513 s, 39.5 MB/s 2023-08-17T00:12:13.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022411 s, 46.8 MB/s 2023-08-17T00:12:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281401 s, 37.3 MB/s 2023-08-17T00:12:13.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235 s, 44.6 MB/s 2023-08-17T00:12:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.869 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224047 s, 46.8 MB/s 2023-08-17T00:12:13.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.910 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0368867 s, 28.4 MB/s 2023-08-17T00:12:13.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199888 s, 52.5 MB/s 2023-08-17T00:12:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:13.965 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282317 s, 37.1 MB/s 2023-08-17T00:12:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320131 s, 32.8 MB/s 2023-08-17T00:12:14.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.031 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247728 s, 42.3 MB/s 2023-08-17T00:12:14.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.064 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285029 s, 36.8 MB/s 2023-08-17T00:12:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.098 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313137 s, 33.5 MB/s 2023-08-17T00:12:14.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.123 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215889 s, 48.6 MB/s 2023-08-17T00:12:14.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.152 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247875 s, 42.3 MB/s 2023-08-17T00:12:14.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.183 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278303 s, 37.7 MB/s 2023-08-17T00:12:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260402 s, 40.3 MB/s 2023-08-17T00:12:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.239 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223891 s, 46.8 MB/s 2023-08-17T00:12:14.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.267 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229919 s, 45.6 MB/s 2023-08-17T00:12:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230964 s, 45.4 MB/s 2023-08-17T00:12:14.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.327 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.327 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029864 s, 35.1 MB/s 2023-08-17T00:12:14.351 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.352 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.352 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02026 s, 51.8 MB/s 2023-08-17T00:12:14.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213759 s, 49.1 MB/s 2023-08-17T00:12:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.408 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270243 s, 38.8 MB/s 2023-08-17T00:12:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.432 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210489 s, 49.8 MB/s 2023-08-17T00:12:14.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.458 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225572 s, 46.5 MB/s 2023-08-17T00:12:14.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.489 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258353 s, 40.6 MB/s 2023-08-17T00:12:14.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211075 s, 49.7 MB/s 2023-08-17T00:12:14.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:14.515 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:14.516 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:14.516 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.2 2023-08-17T00:12:14.517 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:14.517 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:14.517 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:14.518 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:14.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.577 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029192 s, 35.9 MB/s 2023-08-17T00:12:14.607 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.608 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260283 s, 40.3 MB/s 2023-08-17T00:12:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.635 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227542 s, 46.1 MB/s 2023-08-17T00:12:14.659 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.660 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212635 s, 49.3 MB/s 2023-08-17T00:12:14.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.690 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254745 s, 41.2 MB/s 2023-08-17T00:12:14.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.718 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232016 s, 45.2 MB/s 2023-08-17T00:12:14.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.751 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293156 s, 35.8 MB/s 2023-08-17T00:12:14.780 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.781 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252742 s, 41.5 MB/s 2023-08-17T00:12:14.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223431 s, 46.9 MB/s 2023-08-17T00:12:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242113 s, 43.3 MB/s 2023-08-17T00:12:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210209 s, 49.9 MB/s 2023-08-17T00:12:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.894 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286315 s, 36.6 MB/s 2023-08-17T00:12:14.922 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.923 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246466 s, 42.5 MB/s 2023-08-17T00:12:14.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.947 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216398 s, 48.5 MB/s 2023-08-17T00:12:14.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.969 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188038 s, 55.8 MB/s 2023-08-17T00:12:14.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:14.989 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017019 s, 61.6 MB/s 2023-08-17T00:12:15.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270341 s, 38.8 MB/s 2023-08-17T00:12:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.046 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021518 s, 48.7 MB/s 2023-08-17T00:12:15.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.074 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257687 s, 40.7 MB/s 2023-08-17T00:12:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252397 s, 41.5 MB/s 2023-08-17T00:12:15.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293009 s, 35.8 MB/s 2023-08-17T00:12:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250635 s, 41.8 MB/s 2023-08-17T00:12:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.194 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237782 s, 44.1 MB/s 2023-08-17T00:12:15.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.218 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204778 s, 51.2 MB/s 2023-08-17T00:12:15.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.247 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.247 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250288 s, 41.9 MB/s 2023-08-17T00:12:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.271 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205198 s, 51.1 MB/s 2023-08-17T00:12:15.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.297 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229715 s, 45.6 MB/s 2023-08-17T00:12:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312304 s, 33.6 MB/s 2023-08-17T00:12:15.360 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.361 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246621 s, 42.5 MB/s 2023-08-17T00:12:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.394 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292609 s, 35.8 MB/s 2023-08-17T00:12:15.418 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.418 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.419 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198521 s, 52.8 MB/s 2023-08-17T00:12:15.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.446 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233456 s, 44.9 MB/s 2023-08-17T00:12:15.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:15.448 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:15.449 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:15.449 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.3 2023-08-17T00:12:15.450 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:15.451 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:15.452 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:15.452 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:15.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.512 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249121 s, 42.1 MB/s 2023-08-17T00:12:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0163395 s, 64.2 MB/s 2023-08-17T00:12:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.559 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02358 s, 44.5 MB/s 2023-08-17T00:12:15.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.588 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.588 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245345 s, 42.7 MB/s 2023-08-17T00:12:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.616 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234347 s, 44.7 MB/s 2023-08-17T00:12:15.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230836 s, 45.4 MB/s 2023-08-17T00:12:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.661 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.662 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149295 s, 70.2 MB/s 2023-08-17T00:12:15.688 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.689 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234149 s, 44.8 MB/s 2023-08-17T00:12:15.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.713 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021169 s, 49.5 MB/s 2023-08-17T00:12:15.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.745 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281139 s, 37.3 MB/s 2023-08-17T00:12:15.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.779 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290769 s, 36.1 MB/s 2023-08-17T00:12:15.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225038 s, 46.6 MB/s 2023-08-17T00:12:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02739 s, 38.3 MB/s 2023-08-17T00:12:15.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238346 s, 44.0 MB/s 2023-08-17T00:12:15.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.892 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.892 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227313 s, 46.1 MB/s 2023-08-17T00:12:15.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224265 s, 46.8 MB/s 2023-08-17T00:12:15.944 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.945 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221306 s, 47.4 MB/s 2023-08-17T00:12:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:15.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:15.975 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241543 s, 43.4 MB/s 2023-08-17T00:12:16.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.001 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223649 s, 46.9 MB/s 2023-08-17T00:12:16.036 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.037 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.037 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320636 s, 32.7 MB/s 2023-08-17T00:12:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256289 s, 40.9 MB/s 2023-08-17T00:12:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.093 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226955 s, 46.2 MB/s 2023-08-17T00:12:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.120 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233928 s, 44.8 MB/s 2023-08-17T00:12:16.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.147 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220737 s, 47.5 MB/s 2023-08-17T00:12:16.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.176 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.176 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249691 s, 42.0 MB/s 2023-08-17T00:12:16.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.203 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236605 s, 44.3 MB/s 2023-08-17T00:12:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220893 s, 47.5 MB/s 2023-08-17T00:12:16.256 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.257 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239216 s, 43.8 MB/s 2023-08-17T00:12:16.284 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.284 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.284 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233708 s, 44.9 MB/s 2023-08-17T00:12:16.306 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.307 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199332 s, 52.6 MB/s 2023-08-17T00:12:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.334 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.335 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232335 s, 45.1 MB/s 2023-08-17T00:12:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.361 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220558 s, 47.5 MB/s 2023-08-17T00:12:16.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:16.363 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:16.363 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:16.363 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.4 2023-08-17T00:12:16.364 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:16.364 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:16.364 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:16.364 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:16.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.414 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180983 s, 57.9 MB/s 2023-08-17T00:12:16.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.441 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234188 s, 44.8 MB/s 2023-08-17T00:12:16.468 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.469 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023114 s, 45.4 MB/s 2023-08-17T00:12:16.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.505 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319772 s, 32.8 MB/s 2023-08-17T00:12:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.533 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238518 s, 44.0 MB/s 2023-08-17T00:12:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.566 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289401 s, 36.2 MB/s 2023-08-17T00:12:16.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219292 s, 47.8 MB/s 2023-08-17T00:12:16.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.619 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225037 s, 46.6 MB/s 2023-08-17T00:12:16.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:12:16.626 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:12:16.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.648 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246366 s, 42.6 MB/s 2023-08-17T00:12:16.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277914 s, 37.7 MB/s 2023-08-17T00:12:16.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.702 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204332 s, 51.3 MB/s 2023-08-17T00:12:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.731 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248889 s, 42.1 MB/s 2023-08-17T00:12:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.756 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211969 s, 49.5 MB/s 2023-08-17T00:12:16.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251999 s, 41.6 MB/s 2023-08-17T00:12:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.813 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241854 s, 43.4 MB/s 2023-08-17T00:12:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320007 s, 32.8 MB/s 2023-08-17T00:12:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.877 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226551 s, 46.3 MB/s 2023-08-17T00:12:16.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.907 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255722 s, 41.0 MB/s 2023-08-17T00:12:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.935 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238322 s, 44.0 MB/s 2023-08-17T00:12:16.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.959 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018931 s, 55.4 MB/s 2023-08-17T00:12:16.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:16.985 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220397 s, 47.6 MB/s 2023-08-17T00:12:17.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.014 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.014 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240915 s, 43.5 MB/s 2023-08-17T00:12:17.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.040 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229183 s, 45.8 MB/s 2023-08-17T00:12:17.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.075 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306533 s, 34.2 MB/s 2023-08-17T00:12:17.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.114 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338054 s, 31.0 MB/s 2023-08-17T00:12:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.133 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160331 s, 65.4 MB/s 2023-08-17T00:12:17.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281764 s, 37.2 MB/s 2023-08-17T00:12:17.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.192 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227807 s, 46.0 MB/s 2023-08-17T00:12:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200052 s, 52.4 MB/s 2023-08-17T00:12:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.241 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215944 s, 48.6 MB/s 2023-08-17T00:12:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.270 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250226 s, 41.9 MB/s 2023-08-17T00:12:17.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.301 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265291 s, 39.5 MB/s 2023-08-17T00:12:17.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:17.303 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:17.303 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:17.303 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.5 2023-08-17T00:12:17.304 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:17.304 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:17.304 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:17.304 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.398 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022715 s, 46.2 MB/s 2023-08-17T00:12:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.422 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204134 s, 51.4 MB/s 2023-08-17T00:12:17.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.454 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273423 s, 38.3 MB/s 2023-08-17T00:12:17.480 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.481 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243161 s, 43.1 MB/s 2023-08-17T00:12:17.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.509 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237451 s, 44.2 MB/s 2023-08-17T00:12:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.536 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226541 s, 46.3 MB/s 2023-08-17T00:12:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.560 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216093 s, 48.5 MB/s 2023-08-17T00:12:17.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.592 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284608 s, 36.8 MB/s 2023-08-17T00:12:17.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237975 s, 44.1 MB/s 2023-08-17T00:12:17.649 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.650 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253502 s, 41.4 MB/s 2023-08-17T00:12:17.677 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.678 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239851 s, 43.7 MB/s 2023-08-17T00:12:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.704 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225572 s, 46.5 MB/s 2023-08-17T00:12:17.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288375 s, 36.4 MB/s 2023-08-17T00:12:17.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023285 s, 45.0 MB/s 2023-08-17T00:12:17.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.790 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218303 s, 48.0 MB/s 2023-08-17T00:12:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.817 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235202 s, 44.6 MB/s 2023-08-17T00:12:17.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224956 s, 46.6 MB/s 2023-08-17T00:12:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.870 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224118 s, 46.8 MB/s 2023-08-17T00:12:17.896 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.897 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232474 s, 45.1 MB/s 2023-08-17T00:12:17.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210704 s, 49.8 MB/s 2023-08-17T00:12:17.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.949 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023918 s, 43.8 MB/s 2023-08-17T00:12:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:17.973 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211255 s, 49.6 MB/s 2023-08-17T00:12:18.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.003 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248943 s, 42.1 MB/s 2023-08-17T00:12:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.026 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194857 s, 53.8 MB/s 2023-08-17T00:12:18.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.065 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0351516 s, 29.8 MB/s 2023-08-17T00:12:18.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.090 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02121 s, 49.4 MB/s 2023-08-17T00:12:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.123 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288024 s, 36.4 MB/s 2023-08-17T00:12:18.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.150 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226258 s, 46.3 MB/s 2023-08-17T00:12:18.176 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.177 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224305 s, 46.7 MB/s 2023-08-17T00:12:18.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.204 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228613 s, 45.9 MB/s 2023-08-17T00:12:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.242 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327352 s, 32.0 MB/s 2023-08-17T00:12:18.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.269 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.269 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233679 s, 44.9 MB/s 2023-08-17T00:12:18.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:18.271 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:18.271 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:18.271 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.6 2023-08-17T00:12:18.272 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:18.272 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:18.272 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:18.272 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:18.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282421 s, 37.1 MB/s 2023-08-17T00:12:18.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.365 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275224 s, 38.1 MB/s 2023-08-17T00:12:18.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.395 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269384 s, 38.9 MB/s 2023-08-17T00:12:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215052 s, 48.8 MB/s 2023-08-17T00:12:18.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.455 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293049 s, 35.8 MB/s 2023-08-17T00:12:18.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.483 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235996 s, 44.4 MB/s 2023-08-17T00:12:18.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.509 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226151 s, 46.4 MB/s 2023-08-17T00:12:18.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.534 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175762 s, 59.7 MB/s 2023-08-17T00:12:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246916 s, 42.5 MB/s 2023-08-17T00:12:18.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.588 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.588 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253345 s, 41.4 MB/s 2023-08-17T00:12:18.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194781 s, 53.8 MB/s 2023-08-17T00:12:18.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244722 s, 42.8 MB/s 2023-08-17T00:12:18.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.664 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218862 s, 47.9 MB/s 2023-08-17T00:12:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310265 s, 33.8 MB/s 2023-08-17T00:12:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202626 s, 51.7 MB/s 2023-08-17T00:12:18.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.752 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240478 s, 43.6 MB/s 2023-08-17T00:12:18.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.782 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260333 s, 40.3 MB/s 2023-08-17T00:12:18.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.813 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255027 s, 41.1 MB/s 2023-08-17T00:12:18.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267419 s, 39.2 MB/s 2023-08-17T00:12:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.868 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208247 s, 50.4 MB/s 2023-08-17T00:12:18.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.900 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279533 s, 37.5 MB/s 2023-08-17T00:12:18.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.933 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290754 s, 36.1 MB/s 2023-08-17T00:12:18.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024197 s, 43.3 MB/s 2023-08-17T00:12:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:18.986 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220594 s, 47.5 MB/s 2023-08-17T00:12:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287681 s, 36.4 MB/s 2023-08-17T00:12:19.043 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.044 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209231 s, 50.1 MB/s 2023-08-17T00:12:19.068 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.069 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219324 s, 47.8 MB/s 2023-08-17T00:12:19.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.103 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285749 s, 36.7 MB/s 2023-08-17T00:12:19.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244972 s, 42.8 MB/s 2023-08-17T00:12:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.156 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222557 s, 47.1 MB/s 2023-08-17T00:12:19.180 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.181 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209859 s, 50.0 MB/s 2023-08-17T00:12:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.208 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222013 s, 47.2 MB/s 2023-08-17T00:12:19.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:19.210 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:19.210 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:19.211 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.7 2023-08-17T00:12:19.211 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:19.212 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:19.213 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:19.213 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026019 s, 40.3 MB/s 2023-08-17T00:12:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224459 s, 46.7 MB/s 2023-08-17T00:12:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253074 s, 41.4 MB/s 2023-08-17T00:12:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.350 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232988 s, 45.0 MB/s 2023-08-17T00:12:19.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235478 s, 44.5 MB/s 2023-08-17T00:12:19.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.403 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219925 s, 47.7 MB/s 2023-08-17T00:12:19.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.432 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024124 s, 43.5 MB/s 2023-08-17T00:12:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214664 s, 48.8 MB/s 2023-08-17T00:12:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.485 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250692 s, 41.8 MB/s 2023-08-17T00:12:19.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.507 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187584 s, 55.9 MB/s 2023-08-17T00:12:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021862 s, 48.0 MB/s 2023-08-17T00:12:19.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.555 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177592 s, 59.0 MB/s 2023-08-17T00:12:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.575 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199627 s, 52.5 MB/s 2023-08-17T00:12:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.606 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266428 s, 39.4 MB/s 2023-08-17T00:12:19.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.631 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214217 s, 48.9 MB/s 2023-08-17T00:12:19.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.656 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021631 s, 48.5 MB/s 2023-08-17T00:12:19.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.684 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233558 s, 44.9 MB/s 2023-08-17T00:12:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221982 s, 47.2 MB/s 2023-08-17T00:12:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230482 s, 45.5 MB/s 2023-08-17T00:12:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222047 s, 47.2 MB/s 2023-08-17T00:12:19.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.790 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224587 s, 46.7 MB/s 2023-08-17T00:12:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.824 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302875 s, 34.6 MB/s 2023-08-17T00:12:19.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.847 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191384 s, 54.8 MB/s 2023-08-17T00:12:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.878 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026843 s, 39.1 MB/s 2023-08-17T00:12:19.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235717 s, 44.5 MB/s 2023-08-17T00:12:19.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245881 s, 42.6 MB/s 2023-08-17T00:12:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.960 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221686 s, 47.3 MB/s 2023-08-17T00:12:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:19.985 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214603 s, 48.9 MB/s 2023-08-17T00:12:20.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221288 s, 47.4 MB/s 2023-08-17T00:12:20.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.041 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243318 s, 43.1 MB/s 2023-08-17T00:12:20.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.067 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224767 s, 46.7 MB/s 2023-08-17T00:12:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.095 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244723 s, 42.8 MB/s 2023-08-17T00:12:20.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:20.097 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:20.097 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:20.099 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.8 2023-08-17T00:12:20.099 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:20.100 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:20.100 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:20.100 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:20.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.163 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0306523 s, 34.2 MB/s 2023-08-17T00:12:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023086 s, 45.4 MB/s 2023-08-17T00:12:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.218 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236249 s, 44.4 MB/s 2023-08-17T00:12:20.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.243 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213498 s, 49.1 MB/s 2023-08-17T00:12:20.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.271 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.271 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023796 s, 44.1 MB/s 2023-08-17T00:12:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.297 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.298 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229235 s, 45.7 MB/s 2023-08-17T00:12:20.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.331 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256174 s, 40.9 MB/s 2023-08-17T00:12:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237158 s, 44.2 MB/s 2023-08-17T00:12:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.385 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269665 s, 38.9 MB/s 2023-08-17T00:12:20.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.412 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219292 s, 47.8 MB/s 2023-08-17T00:12:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.438 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222026 s, 47.2 MB/s 2023-08-17T00:12:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.468 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263882 s, 39.7 MB/s 2023-08-17T00:12:20.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176757 s, 59.3 MB/s 2023-08-17T00:12:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.520 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275486 s, 38.1 MB/s 2023-08-17T00:12:20.547 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241443 s, 43.4 MB/s 2023-08-17T00:12:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.573 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.574 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221544 s, 47.3 MB/s 2023-08-17T00:12:20.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.598 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212643 s, 49.3 MB/s 2023-08-17T00:12:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.017453 s, 60.1 MB/s 2023-08-17T00:12:20.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.646 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207898 s, 50.4 MB/s 2023-08-17T00:12:20.676 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.677 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.677 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282846 s, 37.1 MB/s 2023-08-17T00:12:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.703 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229471 s, 45.7 MB/s 2023-08-17T00:12:20.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.726 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196225 s, 53.4 MB/s 2023-08-17T00:12:20.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.752 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022521 s, 46.6 MB/s 2023-08-17T00:12:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.778 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228369 s, 45.9 MB/s 2023-08-17T00:12:20.803 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.803 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.803 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215609 s, 48.6 MB/s 2023-08-17T00:12:20.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.829 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02191 s, 47.9 MB/s 2023-08-17T00:12:20.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.859 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256605 s, 40.9 MB/s 2023-08-17T00:12:20.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.887 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226974 s, 46.2 MB/s 2023-08-17T00:12:20.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.915 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245678 s, 42.7 MB/s 2023-08-17T00:12:20.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.947 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273275 s, 38.4 MB/s 2023-08-17T00:12:20.973 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:20.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:20.974 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224599 s, 46.7 MB/s 2023-08-17T00:12:21.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240973 s, 43.5 MB/s 2023-08-17T00:12:21.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:21.004 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:21.004 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:21.005 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.9 2023-08-17T00:12:21.005 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:21.005 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:21.006 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:21.006 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:21.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226283 s, 46.3 MB/s 2023-08-17T00:12:21.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.088 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.088 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221263 s, 47.4 MB/s 2023-08-17T00:12:21.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.113 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.113 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019893 s, 52.7 MB/s 2023-08-17T00:12:21.139 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.139 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.140 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222485 s, 47.1 MB/s 2023-08-17T00:12:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248532 s, 42.2 MB/s 2023-08-17T00:12:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226826 s, 46.2 MB/s 2023-08-17T00:12:21.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.222 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234346 s, 44.7 MB/s 2023-08-17T00:12:21.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.251 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239667 s, 43.8 MB/s 2023-08-17T00:12:21.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.277 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224467 s, 46.7 MB/s 2023-08-17T00:12:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216773 s, 48.4 MB/s 2023-08-17T00:12:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025344 s, 41.4 MB/s 2023-08-17T00:12:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.356 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198006 s, 53.0 MB/s 2023-08-17T00:12:21.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173071 s, 60.6 MB/s 2023-08-17T00:12:21.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.406 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245693 s, 42.7 MB/s 2023-08-17T00:12:21.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030026 s, 34.9 MB/s 2023-08-17T00:12:21.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229528 s, 45.7 MB/s 2023-08-17T00:12:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.498 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278213 s, 37.7 MB/s 2023-08-17T00:12:21.528 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.528 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.528 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258529 s, 40.6 MB/s 2023-08-17T00:12:21.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.556 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.556 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234397 s, 44.7 MB/s 2023-08-17T00:12:21.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.583 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233979 s, 44.8 MB/s 2023-08-17T00:12:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218318 s, 48.0 MB/s 2023-08-17T00:12:21.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.637 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236772 s, 44.3 MB/s 2023-08-17T00:12:21.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244578 s, 42.9 MB/s 2023-08-17T00:12:21.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.699 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295049 s, 35.5 MB/s 2023-08-17T00:12:21.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.725 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022015 s, 47.6 MB/s 2023-08-17T00:12:21.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.758 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293765 s, 35.7 MB/s 2023-08-17T00:12:21.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.791 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289631 s, 36.2 MB/s 2023-08-17T00:12:21.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.820 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237945 s, 44.1 MB/s 2023-08-17T00:12:21.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.847 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023401 s, 44.8 MB/s 2023-08-17T00:12:21.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219397 s, 47.8 MB/s 2023-08-17T00:12:21.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.900 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.900 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237404 s, 44.2 MB/s 2023-08-17T00:12:21.924 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.924 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.924 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206911 s, 50.7 MB/s 2023-08-17T00:12:21.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:21.926 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:21.926 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:21.926 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.10 2023-08-17T00:12:21.927 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:21.927 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:21.927 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:21.928 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:21.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:21.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:21.974 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180642 s, 58.0 MB/s 2023-08-17T00:12:22.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234109 s, 44.8 MB/s 2023-08-17T00:12:22.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182997 s, 57.3 MB/s 2023-08-17T00:12:22.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.055 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276779 s, 37.9 MB/s 2023-08-17T00:12:22.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021037 s, 49.8 MB/s 2023-08-17T00:12:22.100 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.100 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.100 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01777 s, 59.0 MB/s 2023-08-17T00:12:22.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.128 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222211 s, 47.2 MB/s 2023-08-17T00:12:22.154 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.155 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021026 s, 49.9 MB/s 2023-08-17T00:12:22.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.178 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223372 s, 46.9 MB/s 2023-08-17T00:12:22.205 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.206 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228978 s, 45.8 MB/s 2023-08-17T00:12:22.232 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238701 s, 43.9 MB/s 2023-08-17T00:12:22.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227437 s, 46.1 MB/s 2023-08-17T00:12:22.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.287 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223925 s, 46.8 MB/s 2023-08-17T00:12:22.309 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.310 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173585 s, 60.4 MB/s 2023-08-17T00:12:22.335 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.336 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217647 s, 48.2 MB/s 2023-08-17T00:12:22.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0336637 s, 31.1 MB/s 2023-08-17T00:12:22.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.403 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245947 s, 42.6 MB/s 2023-08-17T00:12:22.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282282 s, 37.1 MB/s 2023-08-17T00:12:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.464 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233347 s, 44.9 MB/s 2023-08-17T00:12:22.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021489 s, 48.8 MB/s 2023-08-17T00:12:22.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235651 s, 44.5 MB/s 2023-08-17T00:12:22.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.541 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228342 s, 45.9 MB/s 2023-08-17T00:12:22.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232999 s, 45.0 MB/s 2023-08-17T00:12:22.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.600 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.600 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265583 s, 39.5 MB/s 2023-08-17T00:12:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242659 s, 43.2 MB/s 2023-08-17T00:12:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.655 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248735 s, 42.2 MB/s 2023-08-17T00:12:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210488 s, 49.8 MB/s 2023-08-17T00:12:22.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.711 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278893 s, 37.6 MB/s 2023-08-17T00:12:22.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216126 s, 48.5 MB/s 2023-08-17T00:12:22.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020791 s, 50.4 MB/s 2023-08-17T00:12:22.786 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.786 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.786 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195853 s, 53.5 MB/s 2023-08-17T00:12:22.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.812 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02296 s, 45.7 MB/s 2023-08-17T00:12:22.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:22.815 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:22.815 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:22.815 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.11 2023-08-17T00:12:22.816 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:22.816 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:22.816 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:22.816 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:22.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.912 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02267 s, 46.3 MB/s 2023-08-17T00:12:22.938 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.938 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.939 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023583 s, 44.5 MB/s 2023-08-17T00:12:22.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.965 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.965 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228792 s, 45.8 MB/s 2023-08-17T00:12:22.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:22.992 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:22.993 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233334 s, 44.9 MB/s 2023-08-17T00:12:23.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224725 s, 46.7 MB/s 2023-08-17T00:12:23.043 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.043 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.044 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203033 s, 51.6 MB/s 2023-08-17T00:12:23.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.071 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.071 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236294 s, 44.4 MB/s 2023-08-17T00:12:23.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.098 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234864 s, 44.6 MB/s 2023-08-17T00:12:23.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.125 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222846 s, 47.1 MB/s 2023-08-17T00:12:23.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.153 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235894 s, 44.5 MB/s 2023-08-17T00:12:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.182 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255416 s, 41.1 MB/s 2023-08-17T00:12:23.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.214 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270049 s, 38.8 MB/s 2023-08-17T00:12:23.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.240 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215851 s, 48.6 MB/s 2023-08-17T00:12:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.272 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.273 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282725 s, 37.1 MB/s 2023-08-17T00:12:23.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.296 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208645 s, 50.3 MB/s 2023-08-17T00:12:23.328 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.329 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.329 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284593 s, 36.8 MB/s 2023-08-17T00:12:23.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.360 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.360 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266901 s, 39.3 MB/s 2023-08-17T00:12:23.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227088 s, 46.2 MB/s 2023-08-17T00:12:23.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.414 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024677 s, 42.5 MB/s 2023-08-17T00:12:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214395 s, 48.9 MB/s 2023-08-17T00:12:23.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.467 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244227 s, 42.9 MB/s 2023-08-17T00:12:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204772 s, 51.2 MB/s 2023-08-17T00:12:23.516 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.517 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213447 s, 49.1 MB/s 2023-08-17T00:12:23.538 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.539 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0182484 s, 57.5 MB/s 2023-08-17T00:12:23.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.562 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189001 s, 55.5 MB/s 2023-08-17T00:12:23.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.585 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204586 s, 51.3 MB/s 2023-08-17T00:12:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302307 s, 34.7 MB/s 2023-08-17T00:12:23.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023145 s, 45.3 MB/s 2023-08-17T00:12:23.672 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.673 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223079 s, 47.0 MB/s 2023-08-17T00:12:23.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.704 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256103 s, 40.9 MB/s 2023-08-17T00:12:23.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.728 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204867 s, 51.2 MB/s 2023-08-17T00:12:23.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.761 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284551 s, 36.9 MB/s 2023-08-17T00:12:23.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:23.764 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:23.764 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:23.764 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.12 2023-08-17T00:12:23.765 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:23.765 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:23.765 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:23.765 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:23.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.832 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.832 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330922 s, 31.7 MB/s 2023-08-17T00:12:23.857 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.858 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228732 s, 45.8 MB/s 2023-08-17T00:12:23.890 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.890 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.891 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283741 s, 37.0 MB/s 2023-08-17T00:12:23.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.917 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240452 s, 43.6 MB/s 2023-08-17T00:12:23.944 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.945 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229467 s, 45.7 MB/s 2023-08-17T00:12:23.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:23.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:23.972 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225307 s, 46.5 MB/s 2023-08-17T00:12:23.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.000 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237565 s, 44.1 MB/s 2023-08-17T00:12:24.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.031 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.031 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027644 s, 37.9 MB/s 2023-08-17T00:12:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.191 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186039 s, 56.4 MB/s 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237417 s, 44.2 MB/s 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228039 s, 46.0 MB/s 2023-08-17T00:12:24.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0300627 s, 34.9 MB/s 2023-08-17T00:12:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020293 s, 51.7 MB/s 2023-08-17T00:12:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251142 s, 41.8 MB/s 2023-08-17T00:12:24.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.223 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233393 s, 44.9 MB/s 2023-08-17T00:12:24.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.251 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.251 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246194 s, 42.6 MB/s 2023-08-17T00:12:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304518 s, 34.4 MB/s 2023-08-17T00:12:24.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02823 s, 37.1 MB/s 2023-08-17T00:12:24.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261156 s, 40.2 MB/s 2023-08-17T00:12:24.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.381 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271438 s, 38.6 MB/s 2023-08-17T00:12:24.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.406 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209206 s, 50.1 MB/s 2023-08-17T00:12:24.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.434 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239559 s, 43.8 MB/s 2023-08-17T00:12:24.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238255 s, 44.0 MB/s 2023-08-17T00:12:24.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.489 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229832 s, 45.6 MB/s 2023-08-17T00:12:24.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227964 s, 46.0 MB/s 2023-08-17T00:12:24.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.535 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184696 s, 56.8 MB/s 2023-08-17T00:12:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.566 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239461 s, 43.8 MB/s 2023-08-17T00:12:24.584 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.585 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193679 s, 54.1 MB/s 2023-08-17T00:12:24.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223735 s, 46.9 MB/s 2023-08-17T00:12:24.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240209 s, 43.7 MB/s 2023-08-17T00:12:24.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.666 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220753 s, 47.5 MB/s 2023-08-17T00:12:24.700 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03111 s, 33.7 MB/s 2023-08-17T00:12:24.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:24.704 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:24.704 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:24.705 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.13 2023-08-17T00:12:24.705 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:24.705 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:24.706 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:24.706 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:24.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252726 s, 41.5 MB/s 2023-08-17T00:12:24.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.790 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217691 s, 48.2 MB/s 2023-08-17T00:12:24.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.820 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261041 s, 40.2 MB/s 2023-08-17T00:12:24.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.857 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310964 s, 33.7 MB/s 2023-08-17T00:12:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.883 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.884 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225468 s, 46.5 MB/s 2023-08-17T00:12:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179722 s, 58.3 MB/s 2023-08-17T00:12:24.925 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.926 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188958 s, 55.5 MB/s 2023-08-17T00:12:24.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.959 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292849 s, 35.8 MB/s 2023-08-17T00:12:24.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:24.985 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:24.985 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221712 s, 47.3 MB/s 2023-08-17T00:12:25.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.012 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226838 s, 46.2 MB/s 2023-08-17T00:12:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.039 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233839 s, 44.8 MB/s 2023-08-17T00:12:25.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.066 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229859 s, 45.6 MB/s 2023-08-17T00:12:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211944 s, 49.5 MB/s 2023-08-17T00:12:25.115 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.115 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.116 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206482 s, 50.8 MB/s 2023-08-17T00:12:25.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219557 s, 47.8 MB/s 2023-08-17T00:12:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215852 s, 48.6 MB/s 2023-08-17T00:12:25.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.191 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212454 s, 49.4 MB/s 2023-08-17T00:12:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286269 s, 36.6 MB/s 2023-08-17T00:12:25.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193336 s, 54.2 MB/s 2023-08-17T00:12:25.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256702 s, 40.8 MB/s 2023-08-17T00:12:25.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197353 s, 53.1 MB/s 2023-08-17T00:12:25.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.322 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194168 s, 54.0 MB/s 2023-08-17T00:12:25.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.345 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.345 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020526 s, 51.1 MB/s 2023-08-17T00:12:25.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262578 s, 39.9 MB/s 2023-08-17T00:12:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022025 s, 47.6 MB/s 2023-08-17T00:12:25.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.427 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.427 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221395 s, 47.4 MB/s 2023-08-17T00:12:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.453 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224976 s, 46.6 MB/s 2023-08-17T00:12:25.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.487 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302887 s, 34.6 MB/s 2023-08-17T00:12:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212702 s, 49.3 MB/s 2023-08-17T00:12:25.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.542 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247428 s, 42.4 MB/s 2023-08-17T00:12:25.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233584 s, 44.9 MB/s 2023-08-17T00:12:25.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207514 s, 50.5 MB/s 2023-08-17T00:12:25.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:25.595 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:25.596 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:25.596 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.14 2023-08-17T00:12:25.596 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:25.597 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:25.597 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:25.597 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309326 s, 33.9 MB/s 2023-08-17T00:12:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.692 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230746 s, 45.4 MB/s 2023-08-17T00:12:25.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.722 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254765 s, 41.2 MB/s 2023-08-17T00:12:25.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.746 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201374 s, 52.1 MB/s 2023-08-17T00:12:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.773 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228034 s, 46.0 MB/s 2023-08-17T00:12:25.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.802 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243228 s, 43.1 MB/s 2023-08-17T00:12:25.827 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.828 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234544 s, 44.7 MB/s 2023-08-17T00:12:25.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.860 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283689 s, 37.0 MB/s 2023-08-17T00:12:25.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214658 s, 48.8 MB/s 2023-08-17T00:12:25.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.914 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250802 s, 41.8 MB/s 2023-08-17T00:12:25.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.941 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219056 s, 47.9 MB/s 2023-08-17T00:12:25.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.967 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216738 s, 48.4 MB/s 2023-08-17T00:12:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:25.991 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200897 s, 52.2 MB/s 2023-08-17T00:12:26.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.013 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188482 s, 55.6 MB/s 2023-08-17T00:12:26.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.043 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.043 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025 s, 41.9 MB/s 2023-08-17T00:12:26.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.070 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243057 s, 43.1 MB/s 2023-08-17T00:12:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.104 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030614 s, 34.3 MB/s 2023-08-17T00:12:26.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.134 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262117 s, 40.0 MB/s 2023-08-17T00:12:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.157 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200862 s, 52.2 MB/s 2023-08-17T00:12:26.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284806 s, 36.8 MB/s 2023-08-17T00:12:26.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.218 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229737 s, 45.6 MB/s 2023-08-17T00:12:26.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240542 s, 43.6 MB/s 2023-08-17T00:12:26.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.277 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276189 s, 38.0 MB/s 2023-08-17T00:12:26.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.304 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230035 s, 45.6 MB/s 2023-08-17T00:12:26.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.337 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278439 s, 37.7 MB/s 2023-08-17T00:12:26.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.366 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.366 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246023 s, 42.6 MB/s 2023-08-17T00:12:26.389 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.390 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201638 s, 52.0 MB/s 2023-08-17T00:12:26.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278909 s, 37.6 MB/s 2023-08-17T00:12:26.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.449 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234598 s, 44.7 MB/s 2023-08-17T00:12:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.478 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252186 s, 41.6 MB/s 2023-08-17T00:12:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.506 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239855 s, 43.7 MB/s 2023-08-17T00:12:26.532 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.533 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233835 s, 44.8 MB/s 2023-08-17T00:12:26.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:26.535 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:26.535 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:26.536 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.15 2023-08-17T00:12:26.536 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:26.537 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:26.537 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:26.537 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:26.593 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.594 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021768 s, 48.2 MB/s 2023-08-17T00:12:26.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.628 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299805 s, 35.0 MB/s 2023-08-17T00:12:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285132 s, 36.8 MB/s 2023-08-17T00:12:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207937 s, 50.4 MB/s 2023-08-17T00:12:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244562 s, 42.9 MB/s 2023-08-17T00:12:26.743 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.743 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.744 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260148 s, 40.3 MB/s 2023-08-17T00:12:26.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.771 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230106 s, 45.6 MB/s 2023-08-17T00:12:26.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.796 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219054 s, 47.9 MB/s 2023-08-17T00:12:26.823 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.823 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.823 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234967 s, 44.6 MB/s 2023-08-17T00:12:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215242 s, 48.7 MB/s 2023-08-17T00:12:26.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0156727 s, 66.9 MB/s 2023-08-17T00:12:26.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.898 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279399 s, 37.5 MB/s 2023-08-17T00:12:26.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.926 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240887 s, 43.5 MB/s 2023-08-17T00:12:26.951 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.952 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221706 s, 47.3 MB/s 2023-08-17T00:12:26.980 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:26.981 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:26.981 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242011 s, 43.3 MB/s 2023-08-17T00:12:27.008 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.008 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.008 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229462 s, 45.7 MB/s 2023-08-17T00:12:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.034 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220091 s, 47.6 MB/s 2023-08-17T00:12:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246732 s, 42.5 MB/s 2023-08-17T00:12:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239734 s, 43.7 MB/s 2023-08-17T00:12:27.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187182 s, 56.0 MB/s 2023-08-17T00:12:27.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273086 s, 38.4 MB/s 2023-08-17T00:12:27.174 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.174 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.174 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275932 s, 38.0 MB/s 2023-08-17T00:12:27.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.204 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254851 s, 41.1 MB/s 2023-08-17T00:12:27.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244169 s, 42.9 MB/s 2023-08-17T00:12:27.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.262 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240261 s, 43.6 MB/s 2023-08-17T00:12:27.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.294 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297479 s, 35.2 MB/s 2023-08-17T00:12:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203347 s, 51.6 MB/s 2023-08-17T00:12:27.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.344 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.344 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216537 s, 48.4 MB/s 2023-08-17T00:12:27.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.372 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.372 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230191 s, 45.6 MB/s 2023-08-17T00:12:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.396 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021997 s, 47.7 MB/s 2023-08-17T00:12:27.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.422 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220371 s, 47.6 MB/s 2023-08-17T00:12:27.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.446 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208162 s, 50.4 MB/s 2023-08-17T00:12:27.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:27.449 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:27.449 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:27.450 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.16 2023-08-17T00:12:27.451 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:27.451 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:27.452 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:27.452 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:27.509 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.510 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.510 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225987 s, 46.4 MB/s 2023-08-17T00:12:27.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.535 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219979 s, 47.7 MB/s 2023-08-17T00:12:27.559 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213233 s, 49.2 MB/s 2023-08-17T00:12:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.589 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259095 s, 40.5 MB/s 2023-08-17T00:12:27.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.612 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.612 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191204 s, 54.8 MB/s 2023-08-17T00:12:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.640 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243923 s, 43.0 MB/s 2023-08-17T00:12:27.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.668 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231952 s, 45.2 MB/s 2023-08-17T00:12:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.700 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272623 s, 38.5 MB/s 2023-08-17T00:12:27.726 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239198 s, 43.8 MB/s 2023-08-17T00:12:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.755 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244012 s, 43.0 MB/s 2023-08-17T00:12:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209389 s, 50.1 MB/s 2023-08-17T00:12:27.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212912 s, 49.2 MB/s 2023-08-17T00:12:27.831 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.831 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.831 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219385 s, 47.8 MB/s 2023-08-17T00:12:27.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.857 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216519 s, 48.4 MB/s 2023-08-17T00:12:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.880 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020085 s, 52.2 MB/s 2023-08-17T00:12:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207188 s, 50.6 MB/s 2023-08-17T00:12:27.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.932 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234154 s, 44.8 MB/s 2023-08-17T00:12:27.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.961 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247604 s, 42.3 MB/s 2023-08-17T00:12:27.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:27.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:27.989 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222048 s, 47.2 MB/s 2023-08-17T00:12:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227727 s, 46.0 MB/s 2023-08-17T00:12:28.039 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.040 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226336 s, 46.3 MB/s 2023-08-17T00:12:28.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205999 s, 50.9 MB/s 2023-08-17T00:12:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.089 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.090 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229325 s, 45.7 MB/s 2023-08-17T00:12:28.121 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.121 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.121 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282382 s, 37.1 MB/s 2023-08-17T00:12:28.157 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.157 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.157 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302732 s, 34.6 MB/s 2023-08-17T00:12:28.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.183 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216988 s, 48.3 MB/s 2023-08-17T00:12:28.213 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.214 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264306 s, 39.7 MB/s 2023-08-17T00:12:28.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.242 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243271 s, 43.1 MB/s 2023-08-17T00:12:28.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.267 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.267 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209615 s, 50.0 MB/s 2023-08-17T00:12:28.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.295 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242309 s, 43.3 MB/s 2023-08-17T00:12:28.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.324 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.324 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245645 s, 42.7 MB/s 2023-08-17T00:12:28.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.347 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187064 s, 56.1 MB/s 2023-08-17T00:12:28.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:28.349 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:28.349 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:28.349 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.17 2023-08-17T00:12:28.350 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:28.350 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:28.351 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:28.351 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0328706 s, 31.9 MB/s 2023-08-17T00:12:28.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.447 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268999 s, 39.0 MB/s 2023-08-17T00:12:28.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.477 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254339 s, 41.2 MB/s 2023-08-17T00:12:28.506 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.507 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254894 s, 41.1 MB/s 2023-08-17T00:12:28.534 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235662 s, 44.5 MB/s 2023-08-17T00:12:28.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.565 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264336 s, 39.7 MB/s 2023-08-17T00:12:28.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.595 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246438 s, 42.5 MB/s 2023-08-17T00:12:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.619 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203094 s, 51.6 MB/s 2023-08-17T00:12:28.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.643 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208013 s, 50.4 MB/s 2023-08-17T00:12:28.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.670 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223696 s, 46.9 MB/s 2023-08-17T00:12:28.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.695 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.695 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217812 s, 48.1 MB/s 2023-08-17T00:12:28.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.719 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.719 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021209 s, 49.4 MB/s 2023-08-17T00:12:28.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.747 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022964 s, 45.7 MB/s 2023-08-17T00:12:28.770 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.770 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.770 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199322 s, 52.6 MB/s 2023-08-17T00:12:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274095 s, 38.3 MB/s 2023-08-17T00:12:28.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.835 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296607 s, 35.4 MB/s 2023-08-17T00:12:28.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.867 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274742 s, 38.2 MB/s 2023-08-17T00:12:28.897 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.898 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253068 s, 41.4 MB/s 2023-08-17T00:12:28.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020248 s, 51.8 MB/s 2023-08-17T00:12:28.941 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.942 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.942 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199872 s, 52.5 MB/s 2023-08-17T00:12:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0315347 s, 33.3 MB/s 2023-08-17T00:12:29.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.004 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220385 s, 47.6 MB/s 2023-08-17T00:12:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.027 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185005 s, 56.7 MB/s 2023-08-17T00:12:29.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.054 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237469 s, 44.2 MB/s 2023-08-17T00:12:29.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.079 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214068 s, 49.0 MB/s 2023-08-17T00:12:29.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241422 s, 43.4 MB/s 2023-08-17T00:12:29.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247337 s, 42.4 MB/s 2023-08-17T00:12:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.162 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211983 s, 49.5 MB/s 2023-08-17T00:12:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260163 s, 40.3 MB/s 2023-08-17T00:12:29.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222606 s, 47.1 MB/s 2023-08-17T00:12:29.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.247 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247869 s, 42.3 MB/s 2023-08-17T00:12:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235078 s, 44.6 MB/s 2023-08-17T00:12:29.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:29.275 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:29.276 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:29.276 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.18 2023-08-17T00:12:29.276 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:29.277 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:29.277 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:29.277 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:29.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.337 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025852 s, 40.6 MB/s 2023-08-17T00:12:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232072 s, 45.2 MB/s 2023-08-17T00:12:29.389 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.390 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215588 s, 48.6 MB/s 2023-08-17T00:12:29.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.415 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205361 s, 51.1 MB/s 2023-08-17T00:12:29.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.441 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.442 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230832 s, 45.4 MB/s 2023-08-17T00:12:29.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.467 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217345 s, 48.2 MB/s 2023-08-17T00:12:29.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224124 s, 46.8 MB/s 2023-08-17T00:12:29.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.518 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.518 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218027 s, 48.1 MB/s 2023-08-17T00:12:29.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.541 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205618 s, 51.0 MB/s 2023-08-17T00:12:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.565 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210174 s, 49.9 MB/s 2023-08-17T00:12:29.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.590 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208635 s, 50.3 MB/s 2023-08-17T00:12:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179309 s, 58.5 MB/s 2023-08-17T00:12:29.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238064 s, 44.0 MB/s 2023-08-17T00:12:29.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.662 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202501 s, 51.8 MB/s 2023-08-17T00:12:29.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.688 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.688 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217338 s, 48.2 MB/s 2023-08-17T00:12:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212677 s, 49.3 MB/s 2023-08-17T00:12:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233635 s, 44.9 MB/s 2023-08-17T00:12:29.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.766 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.766 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201306 s, 52.1 MB/s 2023-08-17T00:12:29.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.790 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233768 s, 44.9 MB/s 2023-08-17T00:12:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226943 s, 46.2 MB/s 2023-08-17T00:12:29.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271735 s, 38.6 MB/s 2023-08-17T00:12:29.871 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.872 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200323 s, 52.3 MB/s 2023-08-17T00:12:29.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.891 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165807 s, 63.2 MB/s 2023-08-17T00:12:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241852 s, 43.4 MB/s 2023-08-17T00:12:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.946 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241374 s, 43.4 MB/s 2023-08-17T00:12:29.972 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.972 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:29.973 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221719 s, 47.3 MB/s 2023-08-17T00:12:29.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:29.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.000 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231789 s, 45.2 MB/s 2023-08-17T00:12:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.026 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222484 s, 47.1 MB/s 2023-08-17T00:12:30.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.058 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269975 s, 38.8 MB/s 2023-08-17T00:12:30.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.082 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200541 s, 52.3 MB/s 2023-08-17T00:12:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251675 s, 41.7 MB/s 2023-08-17T00:12:30.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.137 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021338 s, 49.1 MB/s 2023-08-17T00:12:30.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:30.139 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:30.139 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:30.139 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.19 2023-08-17T00:12:30.140 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:30.140 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:30.140 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:30.140 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:30.199 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291757 s, 35.9 MB/s 2023-08-17T00:12:30.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.225 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212155 s, 49.4 MB/s 2023-08-17T00:12:30.248 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.249 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205502 s, 51.0 MB/s 2023-08-17T00:12:30.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.273 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197577 s, 53.1 MB/s 2023-08-17T00:12:30.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.301 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242425 s, 43.3 MB/s 2023-08-17T00:12:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.328 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235244 s, 44.6 MB/s 2023-08-17T00:12:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.357 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240159 s, 43.7 MB/s 2023-08-17T00:12:30.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.386 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.386 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240356 s, 43.6 MB/s 2023-08-17T00:12:30.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.413 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235896 s, 44.5 MB/s 2023-08-17T00:12:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232067 s, 45.2 MB/s 2023-08-17T00:12:30.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.464 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208173 s, 50.4 MB/s 2023-08-17T00:12:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243169 s, 43.1 MB/s 2023-08-17T00:12:30.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.522 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.522 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253444 s, 41.4 MB/s 2023-08-17T00:12:30.546 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.546 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.547 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212211 s, 49.4 MB/s 2023-08-17T00:12:30.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.572 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.572 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214179 s, 49.0 MB/s 2023-08-17T00:12:30.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.601 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264222 s, 39.7 MB/s 2023-08-17T00:12:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.633 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269794 s, 38.9 MB/s 2023-08-17T00:12:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216162 s, 48.5 MB/s 2023-08-17T00:12:30.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230382 s, 45.5 MB/s 2023-08-17T00:12:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249857 s, 42.0 MB/s 2023-08-17T00:12:30.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.746 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027237 s, 38.5 MB/s 2023-08-17T00:12:30.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.773 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222342 s, 47.2 MB/s 2023-08-17T00:12:30.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.801 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241774 s, 43.4 MB/s 2023-08-17T00:12:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232962 s, 45.0 MB/s 2023-08-17T00:12:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.853 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199931 s, 52.4 MB/s 2023-08-17T00:12:30.883 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.884 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025915 s, 40.5 MB/s 2023-08-17T00:12:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.909 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208685 s, 50.2 MB/s 2023-08-17T00:12:30.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230513 s, 45.5 MB/s 2023-08-17T00:12:30.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023454 s, 44.7 MB/s 2023-08-17T00:12:30.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:30.990 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222703 s, 47.1 MB/s 2023-08-17T00:12:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232348 s, 45.1 MB/s 2023-08-17T00:12:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.045 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236905 s, 44.3 MB/s 2023-08-17T00:12:31.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:31.047 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:31.047 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:31.048 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.20 2023-08-17T00:12:31.048 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:31.048 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:31.048 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:31.049 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:31.099 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.099 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.099 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233756 s, 44.9 MB/s 2023-08-17T00:12:31.123 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.124 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206697 s, 50.7 MB/s 2023-08-17T00:12:31.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.144 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.144 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.016928 s, 61.9 MB/s 2023-08-17T00:12:31.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.174 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261882 s, 40.0 MB/s 2023-08-17T00:12:31.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.202 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02479 s, 42.3 MB/s 2023-08-17T00:12:31.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.230 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233973 s, 44.8 MB/s 2023-08-17T00:12:31.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.254 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204806 s, 51.2 MB/s 2023-08-17T00:12:31.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.280 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211729 s, 49.5 MB/s 2023-08-17T00:12:31.312 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.312 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.312 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271676 s, 38.6 MB/s 2023-08-17T00:12:31.338 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.338 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.338 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214857 s, 48.8 MB/s 2023-08-17T00:12:31.367 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.368 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265007 s, 39.6 MB/s 2023-08-17T00:12:31.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.397 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247573 s, 42.4 MB/s 2023-08-17T00:12:31.423 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.424 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.424 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233916 s, 44.8 MB/s 2023-08-17T00:12:31.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.450 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.450 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232285 s, 45.1 MB/s 2023-08-17T00:12:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287903 s, 36.4 MB/s 2023-08-17T00:12:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.508 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022438 s, 46.7 MB/s 2023-08-17T00:12:31.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.544 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.544 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308119 s, 34.0 MB/s 2023-08-17T00:12:31.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.571 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.571 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220911 s, 47.5 MB/s 2023-08-17T00:12:31.598 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.599 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245274 s, 42.8 MB/s 2023-08-17T00:12:31.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.619 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169506 s, 61.9 MB/s 2023-08-17T00:12:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.650 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281018 s, 37.3 MB/s 2023-08-17T00:12:31.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237799 s, 44.1 MB/s 2023-08-17T00:12:31.705 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.705 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.706 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233179 s, 45.0 MB/s 2023-08-17T00:12:31.731 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.732 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220818 s, 47.5 MB/s 2023-08-17T00:12:31.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.760 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.760 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245279 s, 42.8 MB/s 2023-08-17T00:12:31.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.788 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236404 s, 44.4 MB/s 2023-08-17T00:12:31.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257732 s, 40.7 MB/s 2023-08-17T00:12:31.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224227 s, 46.8 MB/s 2023-08-17T00:12:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282465 s, 37.1 MB/s 2023-08-17T00:12:31.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230776 s, 45.4 MB/s 2023-08-17T00:12:31.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243888 s, 43.0 MB/s 2023-08-17T00:12:31.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:31.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:31.961 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024179 s, 43.4 MB/s 2023-08-17T00:12:31.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:31.963 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:31.963 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:31.964 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.21 2023-08-17T00:12:31.964 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:31.964 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:31.964 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:31.965 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:32.021 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.022 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220253 s, 47.6 MB/s 2023-08-17T00:12:32.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0374894 s, 28.0 MB/s 2023-08-17T00:12:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232231 s, 45.2 MB/s 2023-08-17T00:12:32.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.117 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234006 s, 44.8 MB/s 2023-08-17T00:12:32.139 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.140 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.140 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192285 s, 54.5 MB/s 2023-08-17T00:12:32.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.171 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272953 s, 38.4 MB/s 2023-08-17T00:12:32.199 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.199 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.199 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241979 s, 43.3 MB/s 2023-08-17T00:12:32.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.227 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249309 s, 42.1 MB/s 2023-08-17T00:12:32.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.252 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222843 s, 47.1 MB/s 2023-08-17T00:12:32.279 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.279 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.279 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022105 s, 47.4 MB/s 2023-08-17T00:12:32.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.303 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019399 s, 54.1 MB/s 2023-08-17T00:12:32.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261673 s, 40.1 MB/s 2023-08-17T00:12:32.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.360 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222925 s, 47.0 MB/s 2023-08-17T00:12:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.388 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.388 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247291 s, 42.4 MB/s 2023-08-17T00:12:32.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.414 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216423 s, 48.5 MB/s 2023-08-17T00:12:32.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.445 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268538 s, 39.0 MB/s 2023-08-17T00:12:32.470 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.470 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.470 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022013 s, 47.6 MB/s 2023-08-17T00:12:32.499 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.500 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.500 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250755 s, 41.8 MB/s 2023-08-17T00:12:32.525 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.526 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.526 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220519 s, 47.6 MB/s 2023-08-17T00:12:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.557 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279057 s, 37.6 MB/s 2023-08-17T00:12:32.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.583 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227738 s, 46.0 MB/s 2023-08-17T00:12:32.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.614 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266164 s, 39.4 MB/s 2023-08-17T00:12:32.635 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.635 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.635 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195854 s, 53.5 MB/s 2023-08-17T00:12:32.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.663 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231156 s, 45.4 MB/s 2023-08-17T00:12:32.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208707 s, 50.2 MB/s 2023-08-17T00:12:32.716 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.717 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254001 s, 41.3 MB/s 2023-08-17T00:12:32.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.740 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198759 s, 52.8 MB/s 2023-08-17T00:12:32.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.761 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184897 s, 56.7 MB/s 2023-08-17T00:12:32.790 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.791 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258312 s, 40.6 MB/s 2023-08-17T00:12:32.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.821 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259448 s, 40.4 MB/s 2023-08-17T00:12:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263006 s, 39.9 MB/s 2023-08-17T00:12:32.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.876 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211055 s, 49.7 MB/s 2023-08-17T00:12:32.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:32.878 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:32.878 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:32.879 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.22 2023-08-17T00:12:32.879 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:32.879 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:32.880 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:32.880 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:32.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.937 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212688 s, 49.3 MB/s 2023-08-17T00:12:32.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.967 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261477 s, 40.1 MB/s 2023-08-17T00:12:32.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:32.996 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:32.996 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245198 s, 42.8 MB/s 2023-08-17T00:12:33.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.023 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222664 s, 47.1 MB/s 2023-08-17T00:12:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216678 s, 48.4 MB/s 2023-08-17T00:12:33.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.078 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268304 s, 39.1 MB/s 2023-08-17T00:12:33.111 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.111 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287251 s, 36.5 MB/s 2023-08-17T00:12:33.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.143 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.143 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265329 s, 39.5 MB/s 2023-08-17T00:12:33.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224363 s, 46.7 MB/s 2023-08-17T00:12:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.195 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217036 s, 48.3 MB/s 2023-08-17T00:12:33.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.220 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022589 s, 46.4 MB/s 2023-08-17T00:12:33.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209846 s, 50.0 MB/s 2023-08-17T00:12:33.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227747 s, 46.0 MB/s 2023-08-17T00:12:33.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.302 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.302 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251777 s, 41.6 MB/s 2023-08-17T00:12:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257092 s, 40.8 MB/s 2023-08-17T00:12:33.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.359 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022055 s, 47.5 MB/s 2023-08-17T00:12:33.388 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.389 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.389 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266097 s, 39.4 MB/s 2023-08-17T00:12:33.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027529 s, 38.1 MB/s 2023-08-17T00:12:33.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.447 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225714 s, 46.5 MB/s 2023-08-17T00:12:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.475 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245575 s, 42.7 MB/s 2023-08-17T00:12:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198371 s, 52.9 MB/s 2023-08-17T00:12:33.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217016 s, 48.3 MB/s 2023-08-17T00:12:33.556 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.557 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.557 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028497 s, 36.8 MB/s 2023-08-17T00:12:33.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.591 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.591 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299234 s, 35.0 MB/s 2023-08-17T00:12:33.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242189 s, 43.3 MB/s 2023-08-17T00:12:33.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.648 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230756 s, 45.4 MB/s 2023-08-17T00:12:33.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.669 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186799 s, 56.1 MB/s 2023-08-17T00:12:33.701 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.702 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285272 s, 36.8 MB/s 2023-08-17T00:12:33.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.729 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232197 s, 45.2 MB/s 2023-08-17T00:12:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.757 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242712 s, 43.2 MB/s 2023-08-17T00:12:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221185 s, 47.4 MB/s 2023-08-17T00:12:33.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.809 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214095 s, 49.0 MB/s 2023-08-17T00:12:33.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:33.811 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:33.811 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:33.812 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.23 2023-08-17T00:12:33.812 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:33.812 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:33.813 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:33.813 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021997 s, 47.7 MB/s 2023-08-17T00:12:33.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.893 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233997 s, 44.8 MB/s 2023-08-17T00:12:33.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.917 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.917 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196493 s, 53.4 MB/s 2023-08-17T00:12:33.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.943 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219042 s, 47.9 MB/s 2023-08-17T00:12:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187025 s, 56.1 MB/s 2023-08-17T00:12:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:33.991 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233315 s, 44.9 MB/s 2023-08-17T00:12:34.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.017 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224868 s, 46.6 MB/s 2023-08-17T00:12:34.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.043 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.043 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222273 s, 47.2 MB/s 2023-08-17T00:12:34.068 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.068 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.068 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216292 s, 48.5 MB/s 2023-08-17T00:12:34.097 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.097 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.098 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247701 s, 42.3 MB/s 2023-08-17T00:12:34.123 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.124 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214761 s, 48.8 MB/s 2023-08-17T00:12:34.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.156 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278214 s, 37.7 MB/s 2023-08-17T00:12:34.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.181 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226896 s, 46.2 MB/s 2023-08-17T00:12:34.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.208 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.208 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227702 s, 46.1 MB/s 2023-08-17T00:12:34.232 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.232 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.232 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199512 s, 52.6 MB/s 2023-08-17T00:12:34.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.261 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243375 s, 43.1 MB/s 2023-08-17T00:12:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.287 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207909 s, 50.4 MB/s 2023-08-17T00:12:34.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02518 s, 41.6 MB/s 2023-08-17T00:12:34.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240648 s, 43.6 MB/s 2023-08-17T00:12:34.368 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.369 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227721 s, 46.0 MB/s 2023-08-17T00:12:34.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.398 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237943 s, 44.1 MB/s 2023-08-17T00:12:34.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.433 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312285 s, 33.6 MB/s 2023-08-17T00:12:34.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024577 s, 42.7 MB/s 2023-08-17T00:12:34.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026977 s, 38.9 MB/s 2023-08-17T00:12:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.519 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023048 s, 45.5 MB/s 2023-08-17T00:12:34.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.539 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0179943 s, 58.3 MB/s 2023-08-17T00:12:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244113 s, 43.0 MB/s 2023-08-17T00:12:34.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.593 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219311 s, 47.8 MB/s 2023-08-17T00:12:34.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.628 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312275 s, 33.6 MB/s 2023-08-17T00:12:34.653 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.654 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217477 s, 48.2 MB/s 2023-08-17T00:12:34.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.683 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025272 s, 41.5 MB/s 2023-08-17T00:12:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.712 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.713 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255397 s, 41.1 MB/s 2023-08-17T00:12:34.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:34.714 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:34.715 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:34.715 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.24 2023-08-17T00:12:34.715 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:34.716 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:34.716 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:34.717 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:34.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.773 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232362 s, 45.1 MB/s 2023-08-17T00:12:34.799 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.800 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238524 s, 44.0 MB/s 2023-08-17T00:12:34.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.834 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297039 s, 35.3 MB/s 2023-08-17T00:12:34.857 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.858 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192419 s, 54.5 MB/s 2023-08-17T00:12:34.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246138 s, 42.6 MB/s 2023-08-17T00:12:34.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.913 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234738 s, 44.7 MB/s 2023-08-17T00:12:34.938 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213863 s, 49.0 MB/s 2023-08-17T00:12:34.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264334 s, 39.7 MB/s 2023-08-17T00:12:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239426 s, 43.8 MB/s 2023-08-17T00:12:35.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.024 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215831 s, 48.6 MB/s 2023-08-17T00:12:35.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.050 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.050 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222076 s, 47.2 MB/s 2023-08-17T00:12:35.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.074 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209132 s, 50.1 MB/s 2023-08-17T00:12:35.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.097 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190426 s, 55.1 MB/s 2023-08-17T00:12:35.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.121 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211291 s, 49.6 MB/s 2023-08-17T00:12:35.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209225 s, 50.1 MB/s 2023-08-17T00:12:35.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.172 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209417 s, 50.1 MB/s 2023-08-17T00:12:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.195 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195079 s, 53.8 MB/s 2023-08-17T00:12:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.220 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205389 s, 51.1 MB/s 2023-08-17T00:12:35.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.253 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287127 s, 36.5 MB/s 2023-08-17T00:12:35.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282017 s, 37.2 MB/s 2023-08-17T00:12:35.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244166 s, 42.9 MB/s 2023-08-17T00:12:35.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261157 s, 40.2 MB/s 2023-08-17T00:12:35.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.369 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.369 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021871 s, 47.9 MB/s 2023-08-17T00:12:35.397 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.398 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234278 s, 44.8 MB/s 2023-08-17T00:12:35.424 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.425 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.425 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227768 s, 46.0 MB/s 2023-08-17T00:12:35.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.447 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186528 s, 56.2 MB/s 2023-08-17T00:12:35.474 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.475 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247698 s, 42.3 MB/s 2023-08-17T00:12:35.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.503 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258204 s, 40.6 MB/s 2023-08-17T00:12:35.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238042 s, 44.1 MB/s 2023-08-17T00:12:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252265 s, 41.6 MB/s 2023-08-17T00:12:35.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.586 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231821 s, 45.2 MB/s 2023-08-17T00:12:35.612 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.613 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229414 s, 45.7 MB/s 2023-08-17T00:12:35.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:35.615 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:35.615 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:35.615 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.25 2023-08-17T00:12:35.616 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:35.616 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:35.616 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:35.616 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:35.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.666 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216579 s, 48.4 MB/s 2023-08-17T00:12:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.693 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241828 s, 43.4 MB/s 2023-08-17T00:12:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.723 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269233 s, 38.9 MB/s 2023-08-17T00:12:35.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325714 s, 32.2 MB/s 2023-08-17T00:12:35.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.794 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286666 s, 36.6 MB/s 2023-08-17T00:12:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237069 s, 44.2 MB/s 2023-08-17T00:12:35.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225409 s, 46.5 MB/s 2023-08-17T00:12:35.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.878 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02491 s, 42.1 MB/s 2023-08-17T00:12:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.903 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02207 s, 47.5 MB/s 2023-08-17T00:12:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217153 s, 48.3 MB/s 2023-08-17T00:12:35.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.960 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.960 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250603 s, 41.8 MB/s 2023-08-17T00:12:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:35.986 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235686 s, 44.5 MB/s 2023-08-17T00:12:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.012 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226861 s, 46.2 MB/s 2023-08-17T00:12:36.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.035 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193498 s, 54.2 MB/s 2023-08-17T00:12:36.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.061 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222437 s, 47.1 MB/s 2023-08-17T00:12:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297516 s, 35.2 MB/s 2023-08-17T00:12:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.120 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237302 s, 44.2 MB/s 2023-08-17T00:12:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212985 s, 49.2 MB/s 2023-08-17T00:12:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.174 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.175 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236679 s, 44.3 MB/s 2023-08-17T00:12:36.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292395 s, 35.9 MB/s 2023-08-17T00:12:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.236 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.237 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248186 s, 42.2 MB/s 2023-08-17T00:12:36.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.261 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209058 s, 50.2 MB/s 2023-08-17T00:12:36.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.290 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236841 s, 44.3 MB/s 2023-08-17T00:12:36.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.315 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218289 s, 48.0 MB/s 2023-08-17T00:12:36.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.346 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024005 s, 43.7 MB/s 2023-08-17T00:12:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.371 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024123 s, 43.5 MB/s 2023-08-17T00:12:36.398 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.400 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.400 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239892 s, 43.7 MB/s 2023-08-17T00:12:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.423 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.424 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213629 s, 49.1 MB/s 2023-08-17T00:12:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.453 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245172 s, 42.8 MB/s 2023-08-17T00:12:36.476 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.477 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020575 s, 51.0 MB/s 2023-08-17T00:12:36.505 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.506 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.506 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251505 s, 41.7 MB/s 2023-08-17T00:12:36.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.533 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023487 s, 44.6 MB/s 2023-08-17T00:12:36.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:36.535 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:36.536 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:36.536 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.26 2023-08-17T00:12:36.536 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:36.536 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:36.537 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:36.538 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.596 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222402 s, 47.1 MB/s 2023-08-17T00:12:36.623 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.624 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237309 s, 44.2 MB/s 2023-08-17T00:12:36.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226074 s, 46.4 MB/s 2023-08-17T00:12:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237398 s, 44.2 MB/s 2023-08-17T00:12:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256086 s, 40.9 MB/s 2023-08-17T00:12:36.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.739 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258525 s, 40.6 MB/s 2023-08-17T00:12:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221827 s, 47.3 MB/s 2023-08-17T00:12:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.798 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280076 s, 37.4 MB/s 2023-08-17T00:12:36.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.826 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236789 s, 44.3 MB/s 2023-08-17T00:12:36.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.856 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272341 s, 38.5 MB/s 2023-08-17T00:12:36.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256849 s, 40.8 MB/s 2023-08-17T00:12:36.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.913 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240666 s, 43.6 MB/s 2023-08-17T00:12:36.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.941 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229483 s, 45.7 MB/s 2023-08-17T00:12:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.967 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221994 s, 47.2 MB/s 2023-08-17T00:12:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:36.997 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026529 s, 39.5 MB/s 2023-08-17T00:12:37.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.028 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270276 s, 38.8 MB/s 2023-08-17T00:12:37.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027234 s, 38.5 MB/s 2023-08-17T00:12:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274041 s, 38.3 MB/s 2023-08-17T00:12:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210687 s, 49.8 MB/s 2023-08-17T00:12:37.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.141 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221983 s, 47.2 MB/s 2023-08-17T00:12:37.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.172 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273497 s, 38.3 MB/s 2023-08-17T00:12:37.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.197 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212857 s, 49.3 MB/s 2023-08-17T00:12:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.226 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244116 s, 43.0 MB/s 2023-08-17T00:12:37.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.253 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221884 s, 47.3 MB/s 2023-08-17T00:12:37.278 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.279 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.279 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216996 s, 48.3 MB/s 2023-08-17T00:12:37.308 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.308 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.308 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246797 s, 42.5 MB/s 2023-08-17T00:12:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.334 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230225 s, 45.5 MB/s 2023-08-17T00:12:37.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.360 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.360 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221243 s, 47.4 MB/s 2023-08-17T00:12:37.386 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.387 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022248 s, 47.1 MB/s 2023-08-17T00:12:37.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.413 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229825 s, 45.6 MB/s 2023-08-17T00:12:37.444 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.444 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.444 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273516 s, 38.3 MB/s 2023-08-17T00:12:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.472 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240528 s, 43.6 MB/s 2023-08-17T00:12:37.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:37.474 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:37.475 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:37.475 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.27 2023-08-17T00:12:37.475 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:37.475 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:37.476 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:37.476 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:37.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.533 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261356 s, 40.1 MB/s 2023-08-17T00:12:37.564 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.564 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.564 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273269 s, 38.4 MB/s 2023-08-17T00:12:37.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.594 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255709 s, 41.0 MB/s 2023-08-17T00:12:37.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.618 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198033 s, 52.9 MB/s 2023-08-17T00:12:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255275 s, 41.1 MB/s 2023-08-17T00:12:37.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.673 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217487 s, 48.2 MB/s 2023-08-17T00:12:37.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.698 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.699 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215879 s, 48.6 MB/s 2023-08-17T00:12:37.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.723 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208439 s, 50.3 MB/s 2023-08-17T00:12:37.749 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.750 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201748 s, 52.0 MB/s 2023-08-17T00:12:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.774 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215206 s, 48.7 MB/s 2023-08-17T00:12:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282363 s, 37.1 MB/s 2023-08-17T00:12:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.833 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226101 s, 46.4 MB/s 2023-08-17T00:12:37.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278445 s, 37.7 MB/s 2023-08-17T00:12:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021749 s, 48.2 MB/s 2023-08-17T00:12:37.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.921 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256178 s, 40.9 MB/s 2023-08-17T00:12:37.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.952 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.952 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272728 s, 38.4 MB/s 2023-08-17T00:12:37.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:37.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:37.979 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215022 s, 48.8 MB/s 2023-08-17T00:12:38.006 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.006 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.007 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023782 s, 44.1 MB/s 2023-08-17T00:12:38.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.033 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238361 s, 44.0 MB/s 2023-08-17T00:12:38.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222987 s, 47.0 MB/s 2023-08-17T00:12:38.087 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.087 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.088 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246616 s, 42.5 MB/s 2023-08-17T00:12:38.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213856 s, 49.0 MB/s 2023-08-17T00:12:38.148 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.149 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313356 s, 33.5 MB/s 2023-08-17T00:12:38.187 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.188 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.188 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0346242 s, 30.3 MB/s 2023-08-17T00:12:38.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228511 s, 45.9 MB/s 2023-08-17T00:12:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.235 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0176307 s, 59.5 MB/s 2023-08-17T00:12:38.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0170541 s, 61.5 MB/s 2023-08-17T00:12:38.287 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.288 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282027 s, 37.2 MB/s 2023-08-17T00:12:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.322 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287623 s, 36.5 MB/s 2023-08-17T00:12:38.352 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.352 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.352 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268182 s, 39.1 MB/s 2023-08-17T00:12:38.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185415 s, 56.6 MB/s 2023-08-17T00:12:38.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.404 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240185 s, 43.7 MB/s 2023-08-17T00:12:38.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:38.405 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:38.406 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:38.406 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.28 2023-08-17T00:12:38.406 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:38.406 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:38.407 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:38.407 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:38.465 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.466 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234681 s, 44.7 MB/s 2023-08-17T00:12:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.498 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277237 s, 37.8 MB/s 2023-08-17T00:12:38.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.525 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.525 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230321 s, 45.5 MB/s 2023-08-17T00:12:38.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.555 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254456 s, 41.2 MB/s 2023-08-17T00:12:38.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.590 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.590 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314455 s, 33.3 MB/s 2023-08-17T00:12:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.621 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267453 s, 39.2 MB/s 2023-08-17T00:12:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.659 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0331818 s, 31.6 MB/s 2023-08-17T00:12:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.681 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190094 s, 55.2 MB/s 2023-08-17T00:12:38.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.709 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232026 s, 45.2 MB/s 2023-08-17T00:12:38.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229079 s, 45.8 MB/s 2023-08-17T00:12:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.758 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191992 s, 54.6 MB/s 2023-08-17T00:12:38.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.789 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.790 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273362 s, 38.4 MB/s 2023-08-17T00:12:38.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.813 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198667 s, 52.8 MB/s 2023-08-17T00:12:38.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314602 s, 33.3 MB/s 2023-08-17T00:12:38.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.876 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238819 s, 43.9 MB/s 2023-08-17T00:12:38.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261535 s, 40.1 MB/s 2023-08-17T00:12:38.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022896 s, 45.8 MB/s 2023-08-17T00:12:38.967 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.968 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02982 s, 35.2 MB/s 2023-08-17T00:12:38.996 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:38.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:38.997 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246127 s, 42.6 MB/s 2023-08-17T00:12:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294368 s, 35.6 MB/s 2023-08-17T00:12:39.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.058 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233043 s, 45.0 MB/s 2023-08-17T00:12:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.083 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207361 s, 50.6 MB/s 2023-08-17T00:12:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269458 s, 38.9 MB/s 2023-08-17T00:12:39.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.146 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027584 s, 38.0 MB/s 2023-08-17T00:12:39.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.172 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218308 s, 48.0 MB/s 2023-08-17T00:12:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0311746 s, 33.6 MB/s 2023-08-17T00:12:39.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.237 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.238 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259638 s, 40.4 MB/s 2023-08-17T00:12:39.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281039 s, 37.3 MB/s 2023-08-17T00:12:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.294 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221864 s, 47.3 MB/s 2023-08-17T00:12:39.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.320 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222234 s, 47.2 MB/s 2023-08-17T00:12:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207783 s, 50.5 MB/s 2023-08-17T00:12:39.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.377 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290043 s, 36.2 MB/s 2023-08-17T00:12:39.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:39.379 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:39.380 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:39.380 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.29 2023-08-17T00:12:39.381 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:39.381 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:39.381 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:39.381 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.435 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244957 s, 42.8 MB/s 2023-08-17T00:12:39.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.463 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236867 s, 44.3 MB/s 2023-08-17T00:12:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.489 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234895 s, 44.6 MB/s 2023-08-17T00:12:39.516 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.517 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.517 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023479 s, 44.7 MB/s 2023-08-17T00:12:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.543 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.544 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244241 s, 42.9 MB/s 2023-08-17T00:12:39.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217751 s, 48.2 MB/s 2023-08-17T00:12:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.597 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236141 s, 44.4 MB/s 2023-08-17T00:12:39.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.629 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.629 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026316 s, 39.8 MB/s 2023-08-17T00:12:39.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250551 s, 41.9 MB/s 2023-08-17T00:12:39.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.686 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241349 s, 43.4 MB/s 2023-08-17T00:12:39.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.721 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299528 s, 35.0 MB/s 2023-08-17T00:12:39.748 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.749 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.749 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238692 s, 43.9 MB/s 2023-08-17T00:12:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243179 s, 43.1 MB/s 2023-08-17T00:12:39.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279747 s, 37.5 MB/s 2023-08-17T00:12:39.839 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.839 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.839 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240792 s, 43.5 MB/s 2023-08-17T00:12:39.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.867 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.867 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244237 s, 42.9 MB/s 2023-08-17T00:12:39.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.899 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.899 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284228 s, 36.9 MB/s 2023-08-17T00:12:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.928 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256707 s, 40.8 MB/s 2023-08-17T00:12:39.956 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.957 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246507 s, 42.5 MB/s 2023-08-17T00:12:39.982 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:39.983 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:39.983 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226124 s, 46.4 MB/s 2023-08-17T00:12:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.010 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233312 s, 44.9 MB/s 2023-08-17T00:12:40.038 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.038 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.038 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239959 s, 43.7 MB/s 2023-08-17T00:12:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.065 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242323 s, 43.3 MB/s 2023-08-17T00:12:40.090 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217715 s, 48.2 MB/s 2023-08-17T00:12:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.116 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216816 s, 48.4 MB/s 2023-08-17T00:12:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.145 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025702 s, 40.8 MB/s 2023-08-17T00:12:40.172 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.173 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023017 s, 45.6 MB/s 2023-08-17T00:12:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239496 s, 43.8 MB/s 2023-08-17T00:12:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167845 s, 62.5 MB/s 2023-08-17T00:12:40.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234912 s, 44.6 MB/s 2023-08-17T00:12:40.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.274 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231258 s, 45.3 MB/s 2023-08-17T00:12:40.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.299 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213329 s, 49.2 MB/s 2023-08-17T00:12:40.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:40.301 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:40.301 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:40.301 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.30 2023-08-17T00:12:40.302 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:40.302 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:40.302 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:40.303 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:40.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.357 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239582 s, 43.8 MB/s 2023-08-17T00:12:40.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.384 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234177 s, 44.8 MB/s 2023-08-17T00:12:40.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.413 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242429 s, 43.3 MB/s 2023-08-17T00:12:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240111 s, 43.7 MB/s 2023-08-17T00:12:40.471 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.471 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.471 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266683 s, 39.3 MB/s 2023-08-17T00:12:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.498 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236156 s, 44.4 MB/s 2023-08-17T00:12:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226185 s, 46.4 MB/s 2023-08-17T00:12:40.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.553 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244565 s, 42.9 MB/s 2023-08-17T00:12:40.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.578 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215322 s, 48.7 MB/s 2023-08-17T00:12:40.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.607 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.607 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249412 s, 42.0 MB/s 2023-08-17T00:12:40.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.636 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257943 s, 40.7 MB/s 2023-08-17T00:12:40.661 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.661 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.661 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211686 s, 49.5 MB/s 2023-08-17T00:12:40.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.690 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250346 s, 41.9 MB/s 2023-08-17T00:12:40.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.719 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247043 s, 42.4 MB/s 2023-08-17T00:12:40.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.753 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302505 s, 34.7 MB/s 2023-08-17T00:12:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279043 s, 37.6 MB/s 2023-08-17T00:12:40.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198189 s, 52.9 MB/s 2023-08-17T00:12:40.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.836 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023976 s, 43.7 MB/s 2023-08-17T00:12:40.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.863 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237857 s, 44.1 MB/s 2023-08-17T00:12:40.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.889 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021308 s, 49.2 MB/s 2023-08-17T00:12:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.911 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198736 s, 52.8 MB/s 2023-08-17T00:12:40.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019717 s, 53.2 MB/s 2023-08-17T00:12:40.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.969 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303574 s, 34.5 MB/s 2023-08-17T00:12:40.998 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:40.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:40.999 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257375 s, 40.7 MB/s 2023-08-17T00:12:41.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.033 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316074 s, 33.2 MB/s 2023-08-17T00:12:41.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.066 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279479 s, 37.5 MB/s 2023-08-17T00:12:41.094 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.094 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.094 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240167 s, 43.7 MB/s 2023-08-17T00:12:41.121 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.121 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.121 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228283 s, 45.9 MB/s 2023-08-17T00:12:41.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.150 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226165 s, 46.4 MB/s 2023-08-17T00:12:41.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.172 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.172 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209819 s, 50.0 MB/s 2023-08-17T00:12:41.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240409 s, 43.6 MB/s 2023-08-17T00:12:41.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.224 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020425 s, 51.3 MB/s 2023-08-17T00:12:41.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:41.226 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:12:41.226 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:12:41.226 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.31 2023-08-17T00:12:41.227 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:12:41.227 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:12:41.227 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:12:41.228 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:12:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.297 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.297 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0342251 s, 30.6 MB/s 2023-08-17T00:12:41.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.330 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.330 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285572 s, 36.7 MB/s 2023-08-17T00:12:41.361 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.362 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.362 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027173 s, 38.6 MB/s 2023-08-17T00:12:41.386 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.387 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204209 s, 51.3 MB/s 2023-08-17T00:12:41.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.415 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231251 s, 45.3 MB/s 2023-08-17T00:12:41.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.443 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227326 s, 46.1 MB/s 2023-08-17T00:12:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.473 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276619 s, 37.9 MB/s 2023-08-17T00:12:41.496 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.496 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.496 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201473 s, 52.0 MB/s 2023-08-17T00:12:41.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319092 s, 32.9 MB/s 2023-08-17T00:12:41.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.555 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202142 s, 51.9 MB/s 2023-08-17T00:12:41.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.587 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279113 s, 37.6 MB/s 2023-08-17T00:12:41.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.614 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.614 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232045 s, 45.2 MB/s 2023-08-17T00:12:41.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.637 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203463 s, 51.5 MB/s 2023-08-17T00:12:41.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.670 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.670 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291816 s, 35.9 MB/s 2023-08-17T00:12:41.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.695 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.695 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214031 s, 49.0 MB/s 2023-08-17T00:12:41.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.725 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.725 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259952 s, 40.3 MB/s 2023-08-17T00:12:41.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.750 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.750 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221622 s, 47.3 MB/s 2023-08-17T00:12:41.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.782 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278012 s, 37.7 MB/s 2023-08-17T00:12:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.811 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256441 s, 40.9 MB/s 2023-08-17T00:12:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023377 s, 44.9 MB/s 2023-08-17T00:12:41.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.865 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224886 s, 46.6 MB/s 2023-08-17T00:12:41.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.894 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243115 s, 43.1 MB/s 2023-08-17T00:12:41.924 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.924 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.925 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265404 s, 39.5 MB/s 2023-08-17T00:12:41.956 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.957 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293057 s, 35.8 MB/s 2023-08-17T00:12:41.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:41.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:41.996 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0332066 s, 31.6 MB/s 2023-08-17T00:12:42.018 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.019 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.019 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192629 s, 54.4 MB/s 2023-08-17T00:12:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.052 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298158 s, 35.2 MB/s 2023-08-17T00:12:42.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.085 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287333 s, 36.5 MB/s 2023-08-17T00:12:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236004 s, 44.4 MB/s 2023-08-17T00:12:42.139 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.140 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.140 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237988 s, 44.1 MB/s 2023-08-17T00:12:42.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.163 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.163 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195223 s, 53.7 MB/s 2023-08-17T00:12:42.188 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:12:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:12:42.189 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228118 s, 46.0 MB/s 2023-08-17T00:12:42.191 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2023-08-17T00:12:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.349+0000 7f8fe31b9700 1 Processor -- start 2023-08-17T00:12:42.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.353+0000 7f8fe31b9700 1 -- start start 2023-08-17T00:12:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.353+0000 7f8fe31b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8fdc153730 0x7f8fdc1574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe31b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc061fa0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe31b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fdc157e40 con 0x7f8fdc154b20 2023-08-17T00:12:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe31b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fdc066870 con 0x7f8fdc153730 2023-08-17T00:12:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe19b6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8fdc1579e0 0x7f8fdc0bba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55808/0 (socket says 172.21.15.153:55808) 2023-08-17T00:12:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe19b6700 1 -- 172.21.15.153:0/1853136708 learned_addr learned my addr 172.21.15.153:0/1853136708 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:42.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/1853136708 >> v2:172.21.15.153:3300/0 conn(0x7f8fdc153730 0x7f8fdc1574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe11b5700 1 -- 172.21.15.153:0/1853136708 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302659546 0 0) 0x7f8fdc061fa0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe11b5700 1 -- 172.21.15.153:0/1853136708 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc80033f0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe11b5700 1 -- 172.21.15.153:0/1853136708 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504887554 0 0) 0x7f8fdc157e40 con 0x7f8fdc154b20 2023-08-17T00:12:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1853136708 >> v1:172.21.15.178:6789/0 conn(0x7f8fdc154b20 legacy=0x7f8fdc062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1853136708 >> v1:172.21.15.153:6789/0 conn(0x7f8fdc1579e0 legacy=0x7f8fdc0bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1853136708 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc0bc740 con 0x7f8fdc153730 2023-08-17T00:12:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/1853136708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc153730 0x7f8fdc1574f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f8fd8009760 tx=0x7f8fd8009060).ready entity=mon.0 client_cookie=33c2a8b29298d37d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe11b5700 1 -- 172.21.15.153:0/1853136708 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800f510 con 0x7f8fdc153730 2023-08-17T00:12:42.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe11b5700 1 -- 172.21.15.153:0/1853136708 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd800f670 con 0x7f8fdc153730 2023-08-17T00:12:42.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe11b5700 1 -- 172.21.15.153:0/1853136708 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800f9f0 con 0x7f8fdc153730 2023-08-17T00:12:42.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe31b9700 1 -- 172.21.15.153:0/1853136708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc153730 msgr2=0x7f8fdc1574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.357+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/1853136708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc153730 0x7f8fdc1574f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7f8fd8009760 tx=0x7f8fd8009060).stop 2023-08-17T00:12:42.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 -- 172.21.15.153:0/1853136708 shutdown_connections 2023-08-17T00:12:42.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/1853136708 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc153730 0x7f8fdc1574f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 -- 172.21.15.153:0/1853136708 >> 172.21.15.153:0/1853136708 conn(0x7f8fdc0c6ee0 msgr2=0x7f8fdc0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 -- 172.21.15.153:0/1853136708 shutdown_connections 2023-08-17T00:12:42.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 -- 172.21.15.153:0/1853136708 wait complete. 2023-08-17T00:12:42.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 Processor -- start 2023-08-17T00:12:42.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.361+0000 7f8fe31b9700 1 -- start start 2023-08-17T00:12:42.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fdc153730 0x7f8fdc14b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fdc154b20 0x7f8fdc167440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 0x7f8fdc167930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc167e20 con 0x7f8fdc1579e0 2023-08-17T00:12:42.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14b4f0 con 0x7f8fdc153730 2023-08-17T00:12:42.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fdc14fdd0 con 0x7f8fdc154b20 2023-08-17T00:12:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 0x7f8fdc167930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe21b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fdc153730 0x7f8fdc14b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 0x7f8fdc167930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48906/0 (socket says 172.21.15.153:48906) 2023-08-17T00:12:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 -- 172.21.15.153:0/20401922 learned_addr learned my addr 172.21.15.153:0/20401922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fdc154b20 0x7f8fdc167440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 -- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fdc154b20 msgr2=0x7f8fdc167440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fdc154b20 0x7f8fdc167440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 -- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fdc153730 msgr2=0x7f8fdc14b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fdc153730 0x7f8fdc14b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 -- 172.21.15.153:0/20401922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80092a0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 0x7f8fdc167930 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f8fd4001560 tx=0x7f8fd4007f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fd27fc700 1 -- 172.21.15.153:0/20401922 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400e4a0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fd27fc700 1 -- 172.21.15.153:0/20401922 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd400e600 con 0x7f8fdc1579e0 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fd27fc700 1 -- 172.21.15.153:0/20401922 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd400e9a0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fdc1500b0 con 0x7f8fdc1579e0 2023-08-17T00:12:42.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.365+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc150670 con 0x7f8fdc1579e0 2023-08-17T00:12:42.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.369+0000 7f8fd27fc700 1 -- 172.21.15.153:0/20401922 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8fd4019030 con 0x7f8fdc1579e0 2023-08-17T00:12:42.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.369+0000 7f8fd27fc700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fc005a150 0x7f8fc005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.369+0000 7f8fd27fc700 1 -- 172.21.15.153:0/20401922 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8fd4073670 con 0x7f8fdc1579e0 2023-08-17T00:12:42.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.369+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fc005a150 0x7f8fc005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fc005a150 0x7f8fc005c610 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8fd8009760 tx=0x7f8fd8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 Processor -- start 2023-08-17T00:12:42.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 -- start start 2023-08-17T00:12:42.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ba1260 0x1ba28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b26cc0 con 0x1be7800 2023-08-17T00:12:42.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ba6010 con 0x1ba1260 2023-08-17T00:12:42.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba0210 con 0x1be8220 2023-08-17T00:12:42.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fe21b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fe21b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48908/0 (socket says 172.21.15.153:48908) 2023-08-17T00:12:42.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fe21b7700 1 -- 172.21.15.153:0/769043527 learned_addr learned my addr 172.21.15.153:0/769043527 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.373+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ba1260 0x1ba28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe21b7700 1 -- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 msgr2=0x1ba06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe21b7700 1 -- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ba1260 msgr2=0x1ba28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ba1260 0x1ba28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe21b7700 1 -- 172.21.15.153:0/769043527 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b1fc00 con 0x1be7800 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be7be0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f8fd8009e00 tx=0x7f8fd801e040).ready entity=mon.0 client_cookie=1b76bb7b3242c206 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/769043527 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd801c880 con 0x1be7800 2023-08-17T00:12:42.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/769043527 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd801c9e0 con 0x1be7800 2023-08-17T00:12:42.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fbf7fe700 1 -- 172.21.15.153:0/769043527 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd801cb50 con 0x1be7800 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 -- 172.21.15.153:0/769043527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 msgr2=0x1be7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be7be0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7f8fd8009e00 tx=0x7f8fd801e040).stop 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 -- 172.21.15.153:0/769043527 shutdown_connections 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ba1260 0x1ba28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 --2- 172.21.15.153:0/769043527 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be7be0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 -- 172.21.15.153:0/769043527 >> 172.21.15.153:0/769043527 conn(0x1985920 msgr2=0x1ba6580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 -- 172.21.15.153:0/769043527 shutdown_connections 2023-08-17T00:12:42.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.377+0000 7f8fee785740 1 -- 172.21.15.153:0/769043527 wait complete. 2023-08-17T00:12:42.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 -- start start 2023-08-17T00:12:42.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 Processor -- start 2023-08-17T00:12:42.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bea010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1be8220 0x1bec250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 0x1bec740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bccac0 con 0x1bea500 2023-08-17T00:12:42.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bccda0 con 0x1be8220 2023-08-17T00:12:42.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bead40 con 0x1be7800 2023-08-17T00:12:42.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fee785740 10 client.0 ll_register_callbacks cb 0x1b1ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:42.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 0x1bec740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 0x1bec740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48922/0 (socket says 172.21.15.153:48922) 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 -- 172.21.15.153:0/3102655425 learned_addr learned my addr 172.21.15.153:0/3102655425 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1be8220 0x1bec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bea010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 -- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 msgr2=0x1bea010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bea010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 -- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1be8220 msgr2=0x1bec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1be8220 0x1bec250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.381+0000 7f8fe29b8700 1 -- 172.21.15.153:0/3102655425 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fdc0bc740 con 0x1bea500 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 0x1bec740 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f8fd40491c0 tx=0x7f8fd400f000).ready entity=mon.0 client_cookie=3b5bda31293526ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 1 -- 172.21.15.153:0/3102655425 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd404f070 con 0x1bea500 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 1 -- 172.21.15.153:0/3102655425 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8fd404a360 con 0x1bea500 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1b1c8e0 con 0x1bea500 2023-08-17T00:12:42.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 1 -- 172.21.15.153:0/3102655425 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fd4050230 con 0x1bea500 2023-08-17T00:12:42.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 10 client.8127 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:42.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x1b1b0a0 con 0x1bea500 2023-08-17T00:12:42.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 1 -- 172.21.15.153:0/3102655425 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1b1c8e0 con 0x1bea500 2023-08-17T00:12:42.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 1 -- 172.21.15.153:0/3102655425 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8fd4050390 con 0x1bea500 2023-08-17T00:12:42.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 10 client.8127 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:42.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 10 client.8127 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 20 client.8127 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1bcdaf0 0x1bcded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 4 client.8127 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b12e30 con 0x1bcdaf0 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1bcdaf0 0x1bcded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1bcdaf0 0x1bcded0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9cf64b8ae7dc63ba server_cookie=3840c03ee5188c36 in_seq=0 out_seq=0 2023-08-17T00:12:42.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 10 client.8127 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 1 -- 172.21.15.153:0/3102655425 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1b12e30 con 0x1bcdaf0 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fbcff9700 10 client.8127 handle_command_reply: tid=0 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.385+0000 7f8fee785740 1 client.8127 shutdown 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 msgr2=0x1bec740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 0x1bec740 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7f8fd40491c0 tx=0x7f8fd400f000).stop 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 shutdown_connections 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1bcdaf0 0x1bcded0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1bea500 0x1bec740 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fbcff9700 0 client.8127 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1be8220 0x1bec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 --2- 172.21.15.153:0/3102655425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bea010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 >> 172.21.15.153:0/3102655425 conn(0x1985920 msgr2=0x1bcae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 shutdown_connections 2023-08-17T00:12:42.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 1 -- 172.21.15.153:0/3102655425 wait complete. 2023-08-17T00:12:42.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.389+0000 7f8fee785740 20 client.8127 trim_cache size 0 max 16384 2023-08-17T00:12:42.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 Processor -- start 2023-08-17T00:12:42.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 -- start start 2023-08-17T00:12:42.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1ba0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bf8330 con 0x1be7800 2023-08-17T00:12:42.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b4f230 con 0x1bea500 2023-08-17T00:12:42.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.405+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b12e30 con 0x1be8220 2023-08-17T00:12:42.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48934/0 (socket says 172.21.15.153:48934) 2023-08-17T00:12:42.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1574562756 learned_addr learned my addr 172.21.15.153:0/1574562756 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 msgr2=0x1ba03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1ba0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 msgr2=0x1ba0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1ba0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 -- 172.21.15.153:0/1574562756 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fdc063210 con 0x1be7800 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1ba0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:42.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be99e0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f8fd800f560 tx=0x7f8fd8038280).ready entity=mon.0 client_cookie=850dd1870838fa0c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fbffff700 1 -- 172.21.15.153:0/1574562756 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800f990 con 0x1be7800 2023-08-17T00:12:42.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fbffff700 1 -- 172.21.15.153:0/1574562756 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd800faf0 con 0x1be7800 2023-08-17T00:12:42.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fbffff700 1 -- 172.21.15.153:0/1574562756 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd800fc60 con 0x1be7800 2023-08-17T00:12:42.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 -- 172.21.15.153:0/1574562756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 msgr2=0x1be99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be99e0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f8fd800f560 tx=0x7f8fd8038280).stop 2023-08-17T00:12:42.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 -- 172.21.15.153:0/1574562756 shutdown_connections 2023-08-17T00:12:42.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1ba0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be8220 0x1ba03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 --2- 172.21.15.153:0/1574562756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be7800 0x1be99e0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 -- 172.21.15.153:0/1574562756 >> 172.21.15.153:0/1574562756 conn(0x1985920 msgr2=0x1ba6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 -- 172.21.15.153:0/1574562756 shutdown_connections 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 -- 172.21.15.153:0/1574562756 wait complete. 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 -- start start 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.409+0000 7f8fee785740 1 Processor -- start 2023-08-17T00:12:42.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bcf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 0x1c4f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1be5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bd1990 con 0x1be8220 2023-08-17T00:12:42.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c04330 con 0x1bea500 2023-08-17T00:12:42.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ba2870 con 0x1be7800 2023-08-17T00:12:42.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 10 client.0 ll_register_callbacks cb 0x1b1ccf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:42.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 0x1c4f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 0x1c4f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48948/0 (socket says 172.21.15.153:48948) 2023-08-17T00:12:42.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 -- 172.21.15.153:0/2212010282 learned_addr learned my addr 172.21.15.153:0/2212010282 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bcf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe29b8700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1be5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 -- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 msgr2=0x1bcf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bcf1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 -- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 msgr2=0x1be5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1be5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 -- 172.21.15.153:0/2212010282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1b1fc00 con 0x1be8220 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fe19b6700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 0x1c4f740 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f8fdc0ac620 tx=0x7f8fcc009040).ready entity=mon.0 client_cookie=815a5a6b20653428 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fbcff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fbcff9700 1 -- 172.21.15.153:0/2212010282 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc007100 con 0x1be8220 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fd801c9e0 con 0x1be8220 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fbcff9700 1 -- 172.21.15.153:0/2212010282 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8fcc016b60 con 0x1be8220 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fbcff9700 1 -- 172.21.15.153:0/2212010282 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fcc016d60 con 0x1be8220 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 10 client.8133 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.413+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x1b1adf0 con 0x1be8220 2023-08-17T00:12:42.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fbcff9700 1 -- 172.21.15.153:0/2212010282 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd801c9e0 con 0x1be8220 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fbcff9700 1 -- 172.21.15.153:0/2212010282 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8fcc012070 con 0x1be8220 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fee785740 10 client.8133 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fee785740 10 client.8133 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fee785740 20 client.8133 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fee785740 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1beb200 0x1be5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fee785740 4 client.8133 mds_command: new command op to 7947 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x19dc8b0 con 0x1beb200 2023-08-17T00:12:42.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1beb200 0x1be5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fe21b7700 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1beb200 0x1be5fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a39ccb168741ed05 server_cookie=884f3ef4f421e92f in_seq=0 out_seq=0 2023-08-17T00:12:42.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.417+0000 7f8fbcff9700 10 client.8133 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fbcff9700 1 -- 172.21.15.153:0/2212010282 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x19dc8b0 con 0x1beb200 2023-08-17T00:12:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fbcff9700 10 client.8133 handle_command_reply: tid=0 2023-08-17T00:12:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 client.8133 shutdown 2023-08-17T00:12:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 msgr2=0x1c4f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 0x1c4f740 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f8fdc0ac620 tx=0x7f8fcc009040).stop 2023-08-17T00:12:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 shutdown_connections 2023-08-17T00:12:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x1beb200 0x1be5fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1bea500 0x1be5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1be8220 0x1c4f740 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 --2- 172.21.15.153:0/2212010282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1be7800 0x1bcf1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fbcff9700 0 client.8133 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 >> 172.21.15.153:0/2212010282 conn(0x1985920 msgr2=0x1be99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 shutdown_connections 2023-08-17T00:12:42.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 1 -- 172.21.15.153:0/2212010282 wait complete. 2023-08-17T00:12:42.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.421+0000 7f8fee785740 20 client.8133 trim_cache size 0 max 16384 2023-08-17T00:12:42.429 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:42.429 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:12:42.429 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "3d3018fa-b18e-4aa8-af63-4412f410c4f8", 2023-08-17T00:12:42.430 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:12:42.430 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:42.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fc005a150 msgr2=0x7f8fc005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fc005a150 0x7f8fc005c610 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f8fd8009760 tx=0x7f8fd8017000).stop 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 msgr2=0x7f8fdc167930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 0x7f8fdc167930 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7f8fd4001560 tx=0x7f8fd4007f40).stop 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 shutdown_connections 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fc005a150 0x7f8fc005c610 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fdc1579e0 0x7f8fdc167930 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fdc154b20 0x7f8fdc167440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 --2- 172.21.15.153:0/20401922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fdc153730 0x7f8fdc14b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 >> 172.21.15.153:0/20401922 conn(0x7f8fdc0c6ee0 msgr2=0x7f8fdc1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 shutdown_connections 2023-08-17T00:12:42.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.425+0000 7f8fe31b9700 1 -- 172.21.15.153:0/20401922 wait complete. 2023-08-17T00:12:42.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub pause 2023-08-17T00:12:42.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.625+0000 7fcd44d07700 1 Processor -- start 2023-08-17T00:12:42.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.625+0000 7fcd44d07700 1 -- start start 2023-08-17T00:12:42.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd44d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd400acb90 0x7fcd400acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd44d07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd400c7e00 con 0x7fcd400c8f30 2023-08-17T00:12:42.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd44d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd40153fa0 con 0x7fcd40061fa0 2023-08-17T00:12:42.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd44d07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd400c9ab0 con 0x7fcd400acb90 2023-08-17T00:12:42.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd400acb90 0x7fcd400acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd400acb90 0x7fcd400acf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48964/0 (socket says 172.21.15.153:48964) 2023-08-17T00:12:42.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 -- 172.21.15.153:0/2430725499 learned_addr learned my addr 172.21.15.153:0/2430725499 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd36ffd700 1 --1- 172.21.15.153:0/2430725499 >> v1:172.21.15.153:6789/0 conn(0x7fcd400c8f30 0x7fcd400ca0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55814/0 (socket says 172.21.15.153:55814) 2023-08-17T00:12:42.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 -- 172.21.15.153:0/2430725499 >> v1:172.21.15.178:6789/0 conn(0x7fcd40061fa0 legacy=0x7fcd400aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 -- 172.21.15.153:0/2430725499 >> v1:172.21.15.153:6789/0 conn(0x7fcd400c8f30 legacy=0x7fcd400ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 -- 172.21.15.153:0/2430725499 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400c9d90 con 0x7fcd400acb90 2023-08-17T00:12:42.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.629+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/2430725499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400acf70 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fcd30006fd0 tx=0x7fcd300090f0).ready entity=mon.0 client_cookie=b9919730a47692b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd3effd700 1 -- 172.21.15.153:0/2430725499 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000b600 con 0x7fcd400acb90 2023-08-17T00:12:42.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd3effd700 1 -- 172.21.15.153:0/2430725499 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000b760 con 0x7fcd400acb90 2023-08-17T00:12:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd3effd700 1 -- 172.21.15.153:0/2430725499 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000bae0 con 0x7fcd400acb90 2023-08-17T00:12:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 -- 172.21.15.153:0/2430725499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 msgr2=0x7fcd400acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 --2- 172.21.15.153:0/2430725499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400acf70 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fcd30006fd0 tx=0x7fcd300090f0).stop 2023-08-17T00:12:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 -- 172.21.15.153:0/2430725499 shutdown_connections 2023-08-17T00:12:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 --2- 172.21.15.153:0/2430725499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400acf70 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 -- 172.21.15.153:0/2430725499 >> 172.21.15.153:0/2430725499 conn(0x7fcd400cb380 msgr2=0x7fcd400c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 -- 172.21.15.153:0/2430725499 shutdown_connections 2023-08-17T00:12:42.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 -- 172.21.15.153:0/2430725499 wait complete. 2023-08-17T00:12:42.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.633+0000 7fcd44d07700 1 Processor -- start 2023-08-17T00:12:42.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 -- start start 2023-08-17T00:12:42.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd40061fa0 0x7fcd400a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd400c8f30 0x7fcd400ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40168490 con 0x7fcd400acb90 2023-08-17T00:12:42.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c28f0 con 0x7fcd40061fa0 2023-08-17T00:12:42.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd400c2bd0 con 0x7fcd400c8f30 2023-08-17T00:12:42.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd3f7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd40061fa0 0x7fcd400a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48980/0 (socket says 172.21.15.153:48980) 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 -- 172.21.15.153:0/1085548871 learned_addr learned my addr 172.21.15.153:0/1085548871 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd400c8f30 0x7fcd400ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 -- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd400c8f30 msgr2=0x7fcd400ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd400c8f30 0x7fcd400ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 -- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd40061fa0 msgr2=0x7fcd400a8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd40061fa0 0x7fcd400a8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 -- 172.21.15.153:0/1085548871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd30009370 con 0x7fcd400acb90 2023-08-17T00:12:42.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400a94c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fcd2800c440 tx=0x7fcd28007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd37fff700 1 -- 172.21.15.153:0/1085548871 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280070d0 con 0x7fcd400acb90 2023-08-17T00:12:42.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd37fff700 1 -- 172.21.15.153:0/1085548871 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd28007230 con 0x7fcd400acb90 2023-08-17T00:12:42.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd37fff700 1 -- 172.21.15.153:0/1085548871 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280075b0 con 0x7fcd400acb90 2023-08-17T00:12:42.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd400c2eb0 con 0x7fcd400acb90 2023-08-17T00:12:42.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.637+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd401421c0 con 0x7fcd400acb90 2023-08-17T00:12:42.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd37fff700 1 -- 172.21.15.153:0/1085548871 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcd28010070 con 0x7fcd400acb90 2023-08-17T00:12:42.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd37fff700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd2005a150 0x7fcd2005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd37fff700 1 -- 172.21.15.153:0/1085548871 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fcd28073670 con 0x7fcd400acb90 2023-08-17T00:12:42.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd2005a150 0x7fcd2005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd502f4740 1 Processor -- start 2023-08-17T00:12:42.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd502f4740 1 -- start start 2023-08-17T00:12:42.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.645+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd2005a150 0x7fcd2005c610 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fcd30009130 tx=0x7fcd30017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x27f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x27b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2701160 con 0x27b4c20 2023-08-17T00:12:42.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2721ff0 con 0x27b47a0 2023-08-17T00:12:42.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27f6c60 con 0x27f82f0 2023-08-17T00:12:42.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x27b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x27b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48994/0 (socket says 172.21.15.153:48994) 2023-08-17T00:12:42.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 -- 172.21.15.153:0/327556162 learned_addr learned my addr 172.21.15.153:0/327556162 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x27f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 -- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 msgr2=0x27f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x27f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 -- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 msgr2=0x27b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 -- 172.21.15.153:0/327556162 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x272efd0 con 0x27b4c20 2023-08-17T00:12:42.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x27b17b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fcd38002ca0 tx=0x7fcd38001530).ready entity=mon.0 client_cookie=5cc5537c4ac43d3f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd34ff9700 1 -- 172.21.15.153:0/327556162 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380028f0 con 0x27b4c20 2023-08-17T00:12:42.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd34ff9700 1 -- 172.21.15.153:0/327556162 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38006a20 con 0x27b4c20 2023-08-17T00:12:42.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd34ff9700 1 -- 172.21.15.153:0/327556162 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38006da0 con 0x27b4c20 2023-08-17T00:12:42.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- 172.21.15.153:0/327556162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 msgr2=0x27b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x27b17b0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 rx=0x7fcd38002ca0 tx=0x7fcd38001530).stop 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- 172.21.15.153:0/327556162 shutdown_connections 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x27b17b0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 --2- 172.21.15.153:0/327556162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x27f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- 172.21.15.153:0/327556162 >> 172.21.15.153:0/327556162 conn(0x2594640 msgr2=0x27b5200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- 172.21.15.153:0/327556162 shutdown_connections 2023-08-17T00:12:42.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.649+0000 7fcd502f4740 1 -- 172.21.15.153:0/327556162 wait complete. 2023-08-17T00:12:42.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 -- start start 2023-08-17T00:12:42.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 Processor -- start 2023-08-17T00:12:42.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27e13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x27dd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x27dd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2808080 con 0x27f82f0 2023-08-17T00:12:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27de3a0 con 0x27b47a0 2023-08-17T00:12:42.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27b1360 con 0x27b4c20 2023-08-17T00:12:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 10 client.0 ll_register_callbacks cb 0x276c440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x27dd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x27dd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:48996/0 (socket says 172.21.15.153:48996) 2023-08-17T00:12:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 -- 172.21.15.153:0/1126420896 learned_addr learned my addr 172.21.15.153:0/1126420896 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27e13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x27dd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 -- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 msgr2=0x27dd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x27dd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 -- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 msgr2=0x27e13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27e13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 -- 172.21.15.153:0/1126420896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd40153fa0 con 0x27f82f0 2023-08-17T00:12:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x27dd880 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x27f8050 tx=0x7fcd38018000).ready entity=mon.0 client_cookie=e28a15e1a5207231 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd1dffb700 1 -- 172.21.15.153:0/1126420896 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38001d50 con 0x27f82f0 2023-08-17T00:12:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x272bcb0 con 0x27f82f0 2023-08-17T00:12:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd1dffb700 1 -- 172.21.15.153:0/1126420896 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fcd3800f6c0 con 0x27f82f0 2023-08-17T00:12:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd1dffb700 1 -- 172.21.15.153:0/1126420896 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd38001eb0 con 0x27f82f0 2023-08-17T00:12:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 10 client.8148 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.653+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x272a470 con 0x27f82f0 2023-08-17T00:12:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd1dffb700 1 -- 172.21.15.153:0/1126420896 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x272bcb0 con 0x27f82f0 2023-08-17T00:12:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd1dffb700 1 -- 172.21.15.153:0/1126420896 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcd38012070 con 0x27f82f0 2023-08-17T00:12:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 10 client.8148 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 10 client.8148 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 20 client.8148 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b2050 0x27b2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 4 client.8148 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2722200 con 0x27b2050 2023-08-17T00:12:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b2050 0x27b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b2050 0x27b2430 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4b27c22111d6543a server_cookie=241ddf3c39dee3b0 in_seq=0 out_seq=0 2023-08-17T00:12:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd1dffb700 10 client.8148 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd1dffb700 1 -- 172.21.15.153:0/1126420896 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2722200 con 0x27b2050 2023-08-17T00:12:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd1dffb700 10 client.8148 handle_command_reply: tid=0 2023-08-17T00:12:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 client.8148 shutdown 2023-08-17T00:12:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 msgr2=0x27dd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x27dd880 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 rx=0x27f8050 tx=0x7fcd38018000).stop 2023-08-17T00:12:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 shutdown_connections 2023-08-17T00:12:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b2050 0x27b2430 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x27dd880 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x27dd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd1dffb700 0 client.8148 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 --2- 172.21.15.153:0/1126420896 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27e13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 >> 172.21.15.153:0/1126420896 conn(0x2594640 msgr2=0x27d9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 shutdown_connections 2023-08-17T00:12:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 1 -- 172.21.15.153:0/1126420896 wait complete. 2023-08-17T00:12:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.657+0000 7fcd502f4740 20 client.8148 trim_cache size 0 max 16384 2023-08-17T00:12:42.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 Processor -- start 2023-08-17T00:12:42.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 -- start start 2023-08-17T00:12:42.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27afc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x28056b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x2805ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27b1590 con 0x27f82f0 2023-08-17T00:12:42.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27f6e40 con 0x27b47a0 2023-08-17T00:12:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2778280 con 0x27b4c20 2023-08-17T00:12:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x2805ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd36ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x28056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x2805ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49010/0 (socket says 172.21.15.153:49010) 2023-08-17T00:12:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd3ffff700 1 -- 172.21.15.153:0/2286685186 learned_addr learned my addr 172.21.15.153:0/2286685186 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.677+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd36ffd700 1 -- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 msgr2=0x27afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd36ffd700 1 -- 172.21.15.153:0/2286685186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 msgr2=0x2805ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x2805ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd36ffd700 1 -- 172.21.15.153:0/2286685186 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400abe30 con 0x27b4c20 2023-08-17T00:12:42.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd36ffd700 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x28056b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x27b06b0 tx=0x7fcd2804c040).ready entity=mon.2 client_cookie=7a2c68b00a6ceaa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd357fa700 1 -- 172.21.15.153:0/2286685186 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28056070 con 0x27b4c20 2023-08-17T00:12:42.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd357fa700 1 -- 172.21.15.153:0/2286685186 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2804ac50 con 0x27b4c20 2023-08-17T00:12:42.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd357fa700 1 -- 172.21.15.153:0/2286685186 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280473c0 con 0x27b4c20 2023-08-17T00:12:42.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 msgr2=0x28056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x28056b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x27b06b0 tx=0x7fcd2804c040).stop 2023-08-17T00:12:42.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- 172.21.15.153:0/2286685186 shutdown_connections 2023-08-17T00:12:42.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27f82f0 0x2805ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27b4c20 0x28056b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- 172.21.15.153:0/2286685186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- 172.21.15.153:0/2286685186 >> 172.21.15.153:0/2286685186 conn(0x2594640 msgr2=0x27db130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- 172.21.15.153:0/2286685186 shutdown_connections 2023-08-17T00:12:42.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- 172.21.15.153:0/2286685186 wait complete. 2023-08-17T00:12:42.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- start start 2023-08-17T00:12:42.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 Processor -- start 2023-08-17T00:12:42.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27d8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x2816ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x28173c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2815630 con 0x27b4c20 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27e1460 con 0x27b47a0 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.681+0000 7fcd502f4740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x27d8f70 con 0x27f82f0 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 10 client.0 ll_register_callbacks cb 0x7fcd380028f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd36ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x2816ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x28173c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x28173c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:46456/0 (socket says 172.21.15.153:46456) 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 -- 172.21.15.153:0/104968922 learned_addr learned my addr 172.21.15.153:0/104968922 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 -- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 msgr2=0x27d8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27d8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 -- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 msgr2=0x2816ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x2816ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 -- 172.21.15.153:0/104968922 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd401421c0 con 0x27f82f0 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3ffff700 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x28173c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fcd38007b30 tx=0x7fcd38020000).ready entity=mon.2 client_cookie=e25150f107f072f2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.178:3301/0 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd1dffb700 1 -- 172.21.15.153:0/104968922 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38034070 con 0x27f82f0 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd1dffb700 1 -- 172.21.15.153:0/104968922 <== mon.2 v2:172.21.15.178:3301/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fcd3800f6c0 con 0x27f82f0 2023-08-17T00:12:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd38006a20 con 0x27f82f0 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd1dffb700 1 -- 172.21.15.153:0/104968922 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd3800feb0 con 0x27f82f0 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 10 client.6908 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x272a1c0 con 0x27f82f0 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd1dffb700 1 -- 172.21.15.153:0/104968922 <== mon.2 v2:172.21.15.178:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd38006a20 con 0x27f82f0 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd1dffb700 1 -- 172.21.15.153:0/104968922 <== mon.2 v2:172.21.15.178:3301/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcd38020660 con 0x27f82f0 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 10 client.6908 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 10 client.6908 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 20 client.6908 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b01b0 0x28178b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 4 client.6908 mds_command: new command op to 7947 tid=0[{"prefix": "scrub pause"}] 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x25eb5d0 con 0x27b01b0 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.685+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b01b0 0x28178b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd3f7fe700 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b01b0 0x28178b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7452bbcff60779b0 server_cookie=33aaddc7dee22c1c in_seq=0 out_seq=0 2023-08-17T00:12:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd1dffb700 10 client.6908 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd1dffb700 1 -- 172.21.15.153:0/104968922 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x25eb5d0 con 0x27b01b0 2023-08-17T00:12:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd1dffb700 10 client.6908 handle_command_reply: tid=0 2023-08-17T00:12:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 client.6908 shutdown 2023-08-17T00:12:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 msgr2=0x28173c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x28173c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fcd38007b30 tx=0x7fcd38020000).stop 2023-08-17T00:12:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 shutdown_connections 2023-08-17T00:12:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x27b01b0 0x28178b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x27f82f0 0x28173c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x27b4c20 0x2816ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 --2- 172.21.15.153:0/104968922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x27b47a0 0x27d8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd1dffb700 0 client.6908 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 >> 172.21.15.153:0/104968922 conn(0x2594640 msgr2=0x27daf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 shutdown_connections 2023-08-17T00:12:42.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 1 -- 172.21.15.153:0/104968922 wait complete. 2023-08-17T00:12:42.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd502f4740 20 client.6908 trim_cache size 0 max 16384 2023-08-17T00:12:42.701 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:42.702 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:12:42.702 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd2005a150 msgr2=0x7fcd2005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd2005a150 0x7fcd2005c610 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7fcd30009130 tx=0x7fcd30017000).stop 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 msgr2=0x7fcd400a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400a94c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 rx=0x7fcd2800c440 tx=0x7fcd28007dc0).stop 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 shutdown_connections 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd2005a150 0x7fcd2005c610 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd400c8f30 0x7fcd400ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd400acb90 0x7fcd400a94c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 --2- 172.21.15.153:0/1085548871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd40061fa0 0x7fcd400a8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 >> 172.21.15.153:0/1085548871 conn(0x7fcd400cb380 msgr2=0x7fcd400af890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 shutdown_connections 2023-08-17T00:12:42.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.689+0000 7fcd44d07700 1 -- 172.21.15.153:0/1085548871 wait complete. 2023-08-17T00:12:42.713 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2023-08-17T00:12:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.881+0000 7fa262569700 1 Processor -- start 2023-08-17T00:12:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.881+0000 7fa262569700 1 -- start start 2023-08-17T00:12:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa262569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa25c153e90 0x7fa25c0c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa262569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c0c7980 0x7fa25c0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa262569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25c0aa750 con 0x7fa25c153ab0 2023-08-17T00:12:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa262569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25c0c9dd0 con 0x7fa25c153e90 2023-08-17T00:12:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa262569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0aacf0 con 0x7fa25c0c7980 2023-08-17T00:12:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa25c153ab0 0x7fa25c0c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55826/0 (socket says 172.21.15.153:55826) 2023-08-17T00:12:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25bfff700 1 -- 172.21.15.153:0/3741875343 learned_addr learned my addr 172.21.15.153:0/3741875343 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa260b06700 1 --2- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c0c7980 0x7fa25c0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/3741875343 >> v2:172.21.15.178:3300/0 conn(0x7fa25c153e90 0x7fa25c0c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25affd700 1 -- 172.21.15.153:0/3741875343 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274826294 0 0) 0x7fa25c0aa750 con 0x7fa25c153ab0 2023-08-17T00:12:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25affd700 1 -- 172.21.15.153:0/3741875343 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2440033f0 con 0x7fa25c153ab0 2023-08-17T00:12:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25b7fe700 1 -- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c0c7980 msgr2=0x7fa25c0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c0c7980 0x7fa25c0ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25affd700 1 -- 172.21.15.153:0/3741875343 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1167884346 0 0) 0x7fa2440033f0 con 0x7fa25c153ab0 2023-08-17T00:12:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25b7fe700 1 -- 172.21.15.153:0/3741875343 >> v1:172.21.15.153:6789/0 conn(0x7fa25c153ab0 legacy=0x7fa25c0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25b7fe700 1 -- 172.21.15.153:0/3741875343 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c1542f0 con 0x7fa25c153e90 2023-08-17T00:12:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c153e90 0x7fa25c0c7490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fa250009760 tx=0x7fa250009060).ready entity=mon.1 client_cookie=c73cce273514e921 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25affd700 1 -- 172.21.15.153:0/3741875343 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c001490 con 0x7fa25c153e90 2023-08-17T00:12:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25affd700 1 -- 172.21.15.153:0/3741875343 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2500090d0 con 0x7fa25c153e90 2023-08-17T00:12:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.885+0000 7fa25affd700 1 -- 172.21.15.153:0/3741875343 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250011610 con 0x7fa25c153e90 2023-08-17T00:12:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 -- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c153e90 msgr2=0x7fa25c0c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 --2- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c153e90 0x7fa25c0c7490 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7fa250009760 tx=0x7fa250009060).stop 2023-08-17T00:12:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 -- 172.21.15.153:0/3741875343 shutdown_connections 2023-08-17T00:12:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 --2- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c0c7980 0x7fa25c0ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 --2- 172.21.15.153:0/3741875343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c153e90 0x7fa25c0c7490 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 -- 172.21.15.153:0/3741875343 >> 172.21.15.153:0/3741875343 conn(0x7fa25c061fa0 msgr2=0x7fa25c0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 -- 172.21.15.153:0/3741875343 shutdown_connections 2023-08-17T00:12:42.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 -- 172.21.15.153:0/3741875343 wait complete. 2023-08-17T00:12:42.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.889+0000 7fa262569700 1 Processor -- start 2023-08-17T00:12:42.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 -- start start 2023-08-17T00:12:42.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c0c7980 0x7fa25c164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 0x7fa25c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c153e90 0x7fa25c063590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c3b70 con 0x7fa25c153ab0 2023-08-17T00:12:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c2f60 con 0x7fa25c0c7980 2023-08-17T00:12:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25c0c3240 con 0x7fa25c153e90 2023-08-17T00:12:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 0x7fa25c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 0x7fa25c158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49036/0 (socket says 172.21.15.153:49036) 2023-08-17T00:12:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 -- 172.21.15.153:0/249801522 learned_addr learned my addr 172.21.15.153:0/249801522 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25bfff700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c0c7980 0x7fa25c164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa260b06700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c153e90 0x7fa25c063590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 -- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c153e90 msgr2=0x7fa25c063590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c153e90 0x7fa25c063590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 -- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c0c7980 msgr2=0x7fa25c164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c0c7980 0x7fa25c164e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 -- 172.21.15.153:0/249801522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500092a0 con 0x7fa25c153ab0 2023-08-17T00:12:42.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 0x7fa25c158b50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fa250009d50 tx=0x7fa250016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa243fff700 1 -- 172.21.15.153:0/249801522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2500107f0 con 0x7fa25c153ab0 2023-08-17T00:12:42.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa243fff700 1 -- 172.21.15.153:0/249801522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250010950 con 0x7fa25c153ab0 2023-08-17T00:12:42.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25c0c3520 con 0x7fa25c153ab0 2023-08-17T00:12:42.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa243fff700 1 -- 172.21.15.153:0/249801522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250010cf0 con 0x7fa25c153ab0 2023-08-17T00:12:42.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.893+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25c165330 con 0x7fa25c153ab0 2023-08-17T00:12:42.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.897+0000 7fa243fff700 1 -- 172.21.15.153:0/249801522 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa250024030 con 0x7fa25c153ab0 2023-08-17T00:12:42.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.901+0000 7fa243fff700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa24805a150 0x7fa24805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.901+0000 7fa243fff700 1 -- 172.21.15.153:0/249801522 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fa250074d00 con 0x7fa25c153ab0 2023-08-17T00:12:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.901+0000 7fa25bfff700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa24805a150 0x7fa24805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.901+0000 7fa25bfff700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa24805a150 0x7fa24805c610 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fa24c001640 tx=0x7fa24c0014e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.901+0000 7fa26c918740 1 Processor -- start 2023-08-17T00:12:42.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.901+0000 7fa26c918740 1 -- start start 2023-08-17T00:12:42.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x238f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2399140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2399630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22991a0 con 0x238ed20 2023-08-17T00:12:42.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x234d300 con 0x2372860 2023-08-17T00:12:42.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x234c730 con 0x2372ce0 2023-08-17T00:12:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x238f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x238f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49038/0 (socket says 172.21.15.153:49038) 2023-08-17T00:12:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 -- 172.21.15.153:0/1165549179 learned_addr learned my addr 172.21.15.153:0/1165549179 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2399140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa260b06700 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2399630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 -- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 msgr2=0x2399630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2399630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 -- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 msgr2=0x2399140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2399140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 -- 172.21.15.153:0/1165549179 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x22c7010 con 0x238ed20 2023-08-17T00:12:42.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2399140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa25bfff700 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x238f100 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fa24c00e910 tx=0x7fa24c00a000).ready entity=mon.0 client_cookie=7ba03b4abaaa4bbc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa2417fa700 1 -- 172.21.15.153:0/1165549179 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00ee50 con 0x238ed20 2023-08-17T00:12:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa2417fa700 1 -- 172.21.15.153:0/1165549179 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c018a30 con 0x238ed20 2023-08-17T00:12:42.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa2417fa700 1 -- 172.21.15.153:0/1165549179 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c018dd0 con 0x238ed20 2023-08-17T00:12:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 -- 172.21.15.153:0/1165549179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 msgr2=0x238f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x238f100 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7fa24c00e910 tx=0x7fa24c00a000).stop 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 -- 172.21.15.153:0/1165549179 shutdown_connections 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2399630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2399140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 --2- 172.21.15.153:0/1165549179 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x238f100 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.905+0000 7fa26c918740 1 -- 172.21.15.153:0/1165549179 >> 172.21.15.153:0/1165549179 conn(0x212c680 msgr2=0x234d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 -- 172.21.15.153:0/1165549179 shutdown_connections 2023-08-17T00:12:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 -- 172.21.15.153:0/1165549179 wait complete. 2023-08-17T00:12:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 -- start start 2023-08-17T00:12:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 Processor -- start 2023-08-17T00:12:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x236e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x234b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x23a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x23738e0 con 0x238ed20 2023-08-17T00:12:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2376080 con 0x2372860 2023-08-17T00:12:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2373a50 con 0x2372ce0 2023-08-17T00:12:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa26c918740 10 client.0 ll_register_callbacks cb 0x2304400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x23a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x23a2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49048/0 (socket says 172.21.15.153:49048) 2023-08-17T00:12:42.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 -- 172.21.15.153:0/2955792713 learned_addr learned my addr 172.21.15.153:0/2955792713 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa25bfff700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x236e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x234b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 -- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 msgr2=0x234b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x234b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 -- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 msgr2=0x236e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x236e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 -- 172.21.15.153:0/2955792713 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24c00f040 con 0x238ed20 2023-08-17T00:12:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x234b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa260b06700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x23a2ba0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fa254007df0 tx=0x7fa25400b040).ready entity=mon.0 client_cookie=54c50111507fa11c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa23a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2955792713 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400e040 con 0x238ed20 2023-08-17T00:12:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.909+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2955792713 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fa254009d70 con 0x238ed20 2023-08-17T00:12:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2295200 con 0x238ed20 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2955792713 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa254012ee0 con 0x238ed20 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 10 client.8166 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x22c24b0 con 0x238ed20 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2955792713 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2295200 con 0x238ed20 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2955792713 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa254014040 con 0x238ed20 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 10 client.8166 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 10 client.8166 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 20 client.8166 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2376da0 0x23771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 4 client.8166 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22c3cf0 con 0x2376da0 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa25bfff700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2376da0 0x23771b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa23a7fc700 10 client.8166 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa25bfff700 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2376da0 0x23771b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c47a692b6f37031a server_cookie=6a9255c3303148ed in_seq=0 out_seq=0 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2955792713 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x22c3cf0 con 0x2376da0 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa23a7fc700 10 client.8166 handle_command_reply: tid=0 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 client.8166 shutdown 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 msgr2=0x23a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.913+0000 7fa26c918740 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x23a2ba0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fa254007df0 tx=0x7fa25400b040).stop 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 shutdown_connections 2023-08-17T00:12:42.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2376da0 0x23771b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x23a2ba0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x234b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa23a7fc700 0 client.8166 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 --2- 172.21.15.153:0/2955792713 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x236e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 >> 172.21.15.153:0/2955792713 conn(0x212c680 msgr2=0x2371e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 shutdown_connections 2023-08-17T00:12:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 1 -- 172.21.15.153:0/2955792713 wait complete. 2023-08-17T00:12:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.917+0000 7fa26c918740 20 client.8166 trim_cache size 0 max 16384 2023-08-17T00:12:42.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 Processor -- start 2023-08-17T00:12:42.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 -- start start 2023-08-17T00:12:42.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2376370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2376860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x2377c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22b0710 con 0x238ed20 2023-08-17T00:12:42.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x23735b0 con 0x2372860 2023-08-17T00:12:42.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.933+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x238fa20 con 0x2372ce0 2023-08-17T00:12:42.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x2377c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x2377c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49056/0 (socket says 172.21.15.153:49056) 2023-08-17T00:12:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 -- 172.21.15.153:0/3585485663 learned_addr learned my addr 172.21.15.153:0/3585485663 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa25bfff700 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2376370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2376860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 -- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 msgr2=0x2376860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2376860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 -- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 msgr2=0x2376370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2376370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 -- 172.21.15.153:0/3585485663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c063de0 con 0x238ed20 2023-08-17T00:12:42.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa260b06700 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x2377c30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fa254007df0 tx=0x7fa254022000).ready entity=mon.0 client_cookie=f7d81490b6fff547 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa241ffb700 1 -- 172.21.15.153:0/3585485663 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400e070 con 0x238ed20 2023-08-17T00:12:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa241ffb700 1 -- 172.21.15.153:0/3585485663 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254009ce0 con 0x238ed20 2023-08-17T00:12:42.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa241ffb700 1 -- 172.21.15.153:0/3585485663 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25401f740 con 0x238ed20 2023-08-17T00:12:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 -- 172.21.15.153:0/3585485663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 msgr2=0x2377c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x2377c30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fa254007df0 tx=0x7fa254022000).stop 2023-08-17T00:12:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 -- 172.21.15.153:0/3585485663 shutdown_connections 2023-08-17T00:12:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x238ed20 0x2377c30 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2372ce0 0x2376860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 --2- 172.21.15.153:0/3585485663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372860 0x2376370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 -- 172.21.15.153:0/3585485663 >> 172.21.15.153:0/3585485663 conn(0x212c680 msgr2=0x2393d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 -- 172.21.15.153:0/3585485663 shutdown_connections 2023-08-17T00:12:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.937+0000 7fa26c918740 1 -- 172.21.15.153:0/3585485663 wait complete. 2023-08-17T00:12:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.941+0000 7fa26c918740 1 -- start start 2023-08-17T00:12:42.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.941+0000 7fa26c918740 1 Processor -- start 2023-08-17T00:12:42.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 0x23f5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372ce0 0x2377850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x238ed20 0x2377d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2378230 con 0x2372860 2023-08-17T00:12:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x23f6070 con 0x2372ce0 2023-08-17T00:12:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2371520 con 0x238ed20 2023-08-17T00:12:42.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 10 client.0 ll_register_callbacks cb 0x7fa2540079f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:42.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 0x23f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 0x23f5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49070/0 (socket says 172.21.15.153:49070) 2023-08-17T00:12:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 -- 172.21.15.153:0/2850892081 learned_addr learned my addr 172.21.15.153:0/2850892081 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa260b06700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x238ed20 0x2377d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372ce0 0x2377850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 -- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x238ed20 msgr2=0x2377d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x238ed20 0x2377d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 -- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372ce0 msgr2=0x2377850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372ce0 0x2377850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 -- 172.21.15.153:0/2850892081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x22c24b0 con 0x2372860 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa260b06700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x238ed20 0x2377d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25bfff700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 0x23f5440 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fa24c001c30 tx=0x7fa24c016000).ready entity=mon.0 client_cookie=f527cc4e3b1107cc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa23a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:42.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2850892081 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c029040 con 0x2372860 2023-08-17T00:12:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa24c018a30 con 0x2372860 2023-08-17T00:12:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2850892081 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fa24c018ba0 con 0x2372860 2023-08-17T00:12:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2850892081 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa24c02d280 con 0x2372860 2023-08-17T00:12:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 10 client.8172 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:42.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x22c2200 con 0x2372860 2023-08-17T00:12:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2850892081 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24c018a30 con 0x2372860 2023-08-17T00:12:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2850892081 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa24c016680 con 0x2372860 2023-08-17T00:12:42.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 10 client.8172 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 10 client.8172 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 20 client.8172 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23f5930 0x23a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 4 client.8172 mds_command: new command op to 7947 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x22ba240 con 0x23f5930 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.945+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23f5930 0x23a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:42.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa23a7fc700 10 client.8172 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa25b7fe700 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23f5930 0x23a1d50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=96b4fd00adcb0b6c server_cookie=586093db77957133 in_seq=0 out_seq=0 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa23a7fc700 1 -- 172.21.15.153:0/2850892081 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x22ba240 con 0x23f5930 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa23a7fc700 10 client.8172 handle_command_reply: tid=0 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 client.8172 shutdown 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 msgr2=0x23f5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 0x23f5440 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7fa24c001c30 tx=0x7fa24c016000).stop 2023-08-17T00:12:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 shutdown_connections 2023-08-17T00:12:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x23f5930 0x23a1d50 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x238ed20 0x2377d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2372ce0 0x2377850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 --2- 172.21.15.153:0/2850892081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2372860 0x23f5440 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa23a7fc700 0 client.8172 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 >> 172.21.15.153:0/2850892081 conn(0x212c680 msgr2=0x2376480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 shutdown_connections 2023-08-17T00:12:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 1 -- 172.21.15.153:0/2850892081 wait complete. 2023-08-17T00:12:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa26c918740 20 client.8172 trim_cache size 0 max 16384 2023-08-17T00:12:42.959 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:42.960 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-08-17T00:12:42.960 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:12:42.960 INFO:teuthology.orchestra.run.smithi153.stdout: "3d3018fa-b18e-4aa8-af63-4412f410c4f8": { 2023-08-17T00:12:42.960 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_control_test_path", 2023-08-17T00:12:42.960 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "3d3018fa-b18e-4aa8-af63-4412f410c4f8", 2023-08-17T00:12:42.960 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive" 2023-08-17T00:12:42.961 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:42.961 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:12:42.961 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:42.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa24805a150 msgr2=0x7fa24805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa24805a150 0x7fa24805c610 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fa24c001640 tx=0x7fa24c0014e0).stop 2023-08-17T00:12:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 msgr2=0x7fa25c158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 0x7fa25c158b50 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7fa250009d50 tx=0x7fa250016000).stop 2023-08-17T00:12:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 shutdown_connections 2023-08-17T00:12:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa24805a150 0x7fa24805c610 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa25c153e90 0x7fa25c063590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa25c153ab0 0x7fa25c158b50 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 --2- 172.21.15.153:0/249801522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa25c0c7980 0x7fa25c164e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 >> 172.21.15.153:0/249801522 conn(0x7fa25c061fa0 msgr2=0x7fa25c0a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 shutdown_connections 2023-08-17T00:12:42.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:42.949+0000 7fa262569700 1 -- 172.21.15.153:0/249801522 wait complete. 2023-08-17T00:12:42.976 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:43.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72c39700 1 Processor -- start 2023-08-17T00:12:43.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72c39700 1 -- start start 2023-08-17T00:12:43.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72c39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72c39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c1585a0 con 0x7f9c6c0aa6e0 2023-08-17T00:12:43.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72c39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c066400 con 0x7f9c6c068820 2023-08-17T00:12:43.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72c39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c062dc0 con 0x7f9c6c0a8df0 2023-08-17T00:12:43.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72438700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9c6c0aa6e0 0x7f9c6c0626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55830/0 (socket says 172.21.15.153:55830) 2023-08-17T00:12:43.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.137+0000 7f9c72438700 1 -- 172.21.15.153:0/3901822159 learned_addr learned my addr 172.21.15.153:0/3901822159 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:43.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c71c37700 1 --2- 172.21.15.153:0/3901822159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661079944 0 0) 0x7f9c6c1585a0 con 0x7f9c6c0aa6e0 2023-08-17T00:12:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c580033f0 con 0x7f9c6c0aa6e0 2023-08-17T00:12:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705935470 0 0) 0x7f9c6c066400 con 0x7f9c6c068820 2023-08-17T00:12:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c1585a0 con 0x7f9c6c068820 2023-08-17T00:12:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c71c37700 1 -- 172.21.15.153:0/3901822159 >> v1:172.21.15.178:6789/0 conn(0x7f9c6c068820 legacy=0x7f9c6c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1565896815 0 0) 0x7f9c580033f0 con 0x7f9c6c0aa6e0 2023-08-17T00:12:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c71c37700 1 -- 172.21.15.153:0/3901822159 >> v1:172.21.15.153:6789/0 conn(0x7f9c6c0aa6e0 legacy=0x7f9c6c0626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c71c37700 1 -- 172.21.15.153:0/3901822159 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0b9d30 con 0x7f9c6c0a8df0 2023-08-17T00:12:43.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c71c37700 1 --2- 172.21.15.153:0/3901822159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0c1490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f9c68009760 tx=0x7f9c68006f40).ready entity=mon.2 client_cookie=2eefbb8f3e4717c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640017f0 con 0x7f9c6c0a8df0 2023-08-17T00:12:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c68005880 con 0x7f9c6c0a8df0 2023-08-17T00:12:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c70c35700 1 -- 172.21.15.153:0/3901822159 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68005c00 con 0x7f9c6c0a8df0 2023-08-17T00:12:43.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c72c39700 1 -- 172.21.15.153:0/3901822159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 msgr2=0x7f9c6c0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3901822159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0c1490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f9c68009760 tx=0x7f9c68006f40).stop 2023-08-17T00:12:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c72c39700 1 -- 172.21.15.153:0/3901822159 shutdown_connections 2023-08-17T00:12:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3901822159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0c1490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c72c39700 1 -- 172.21.15.153:0/3901822159 >> 172.21.15.153:0/3901822159 conn(0x7f9c6c0c6620 msgr2=0x7f9c6c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.141+0000 7f9c72c39700 1 -- 172.21.15.153:0/3901822159 shutdown_connections 2023-08-17T00:12:43.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 -- 172.21.15.153:0/3901822159 wait complete. 2023-08-17T00:12:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 Processor -- start 2023-08-17T00:12:43.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 -- start start 2023-08-17T00:12:43.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 0x7f9c6c0bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0bc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c6c0aa6e0 0x7f9c6c1685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c159da0 con 0x7f9c6c068820 2023-08-17T00:12:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c156220 con 0x7f9c6c0aa6e0 2023-08-17T00:12:43.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c72c39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c0bce50 con 0x7f9c6c0a8df0 2023-08-17T00:12:43.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.145+0000 7f9c71c37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 0x7f9c6c0bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 0x7f9c6c0bc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49078/0 (socket says 172.21.15.153:49078) 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 -- 172.21.15.153:0/3832101036 learned_addr learned my addr 172.21.15.153:0/3832101036 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c72438700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c6c0aa6e0 0x7f9c6c1685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71436700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0bc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 -- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 msgr2=0x7f9c6c0bc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0bc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 -- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c6c0aa6e0 msgr2=0x7f9c6c1685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c6c0aa6e0 0x7f9c6c1685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 -- 172.21.15.153:0/3832101036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68009250 con 0x7f9c6c068820 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c72438700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c6c0aa6e0 0x7f9c6c1685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c71c37700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 0x7f9c6c0bc0a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f9c68006cd0 tx=0x7f9c68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68011600 con 0x7f9c6c068820 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c68011780 con 0x7f9c6c068820 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c0bd130 con 0x7f9c6c068820 2023-08-17T00:12:43.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c68011b40 con 0x7f9c6c068820 2023-08-17T00:12:43.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.149+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c1697c0 con 0x7f9c6c068820 2023-08-17T00:12:43.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.153+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c0bd370 con 0x7f9c6c068820 2023-08-17T00:12:43.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.153+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9c68025030 con 0x7f9c6c068820 2023-08-17T00:12:43.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.153+0000 7f9c61ffb700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c5005a150 0x7f9c5005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.153+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9c68075360 con 0x7f9c6c068820 2023-08-17T00:12:43.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.153+0000 7f9c71436700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c5005a150 0x7f9c5005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.157+0000 7f9c71436700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c5005a150 0x7f9c5005c610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f9c6c0be1b0 tx=0x7f9c5c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:43.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.161+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c68048ce0 con 0x7f9c6c068820 2023-08-17T00:12:43.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.357+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c6c06b4c0 con 0x7f9c6c068820 2023-08-17T00:12:43.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.357+0000 7f9c61ffb700 1 -- 172.21.15.153:0/3832101036 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f9c68023020 con 0x7f9c6c068820 2023-08-17T00:12:43.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:43.363 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:43.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c5005a150 msgr2=0x7f9c5005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c5005a150 0x7f9c5005c610 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7f9c6c0be1b0 tx=0x7f9c5c009040).stop 2023-08-17T00:12:43.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 msgr2=0x7f9c6c0bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 0x7f9c6c0bc0a0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 rx=0x7f9c68006cd0 tx=0x7f9c68015000).stop 2023-08-17T00:12:43.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 shutdown_connections 2023-08-17T00:12:43.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c5005a150 0x7f9c5005c610 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c6c0aa6e0 0x7f9c6c1685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c6c0a8df0 0x7f9c6c0bc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 --2- 172.21.15.153:0/3832101036 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c6c068820 0x7f9c6c0bc0a0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 >> 172.21.15.153:0/3832101036 conn(0x7f9c6c0c6620 msgr2=0x7f9c6c157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:43.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 shutdown_connections 2023-08-17T00:12:43.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.361+0000 7f9c72c39700 1 -- 172.21.15.153:0/3832101036 wait complete. 2023-08-17T00:12:43.369 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:43.386 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:12:43.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:12:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.533+0000 7fd3c988f700 1 Processor -- start 2023-08-17T00:12:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.533+0000 7fd3c988f700 1 -- start start 2023-08-17T00:12:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c988f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3c4069250 0x7fd3c4069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c988f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4153db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c988f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c4154ae0 con 0x7fd3c4065d90 2023-08-17T00:12:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c988f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c4064fd0 con 0x7fd3c4069250 2023-08-17T00:12:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c988f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40652b0 con 0x7fd3c40c1190 2023-08-17T00:12:43.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c888d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3c4069250 0x7fd3c4069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3bbfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd3c4065d90 0x7fd3c40c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:37812/0 (socket says 172.21.15.153:37812) 2023-08-17T00:12:43.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3bbfff700 1 -- 172.21.15.153:0/3617850792 learned_addr learned my addr 172.21.15.153:0/3617850792 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:43.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.537+0000 7fd3c908e700 1 --2- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c888d700 1 -- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 msgr2=0x7fd3c4153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c888d700 1 --2- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c888d700 1 -- 172.21.15.153:0/3617850792 >> v1:172.21.15.178:6789/0 conn(0x7fd3c4065d90 legacy=0x7fd3c40c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c888d700 1 -- 172.21.15.153:0/3617850792 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c4065590 con 0x7fd3c4069250 2023-08-17T00:12:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c888d700 1 --2- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c4069630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fd3c0006fd0 tx=0x7fd3c0006f40).ready entity=mon.1 client_cookie=ba16353727abe38 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3bb7fe700 1 -- 172.21.15.153:0/3617850792 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0005880 con 0x7fd3c4069250 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3bb7fe700 1 -- 172.21.15.153:0/3617850792 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c00059e0 con 0x7fd3c4069250 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3bb7fe700 1 -- 172.21.15.153:0/3617850792 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0005d60 con 0x7fd3c4069250 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 -- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 msgr2=0x7fd3c4069630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 --2- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c4069630 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7fd3c0006fd0 tx=0x7fd3c0006f40).stop 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 -- 172.21.15.153:0/3617850792 shutdown_connections 2023-08-17T00:12:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 --2- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 --2- 172.21.15.153:0/3617850792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c4069630 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 -- 172.21.15.153:0/3617850792 >> 172.21.15.153:0/3617850792 conn(0x7fd3c40c6620 msgr2=0x7fd3c40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 -- 172.21.15.153:0/3617850792 shutdown_connections 2023-08-17T00:12:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.541+0000 7fd3c988f700 1 -- 172.21.15.153:0/3617850792 wait complete. 2023-08-17T00:12:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 Processor -- start 2023-08-17T00:12:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 -- start start 2023-08-17T00:12:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 0x7fd3c40bf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40bf0d0 con 0x7fd3c4065d90 2023-08-17T00:12:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4155ea0 con 0x7fd3c4069250 2023-08-17T00:12:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c988f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40bf840 con 0x7fd3c40c1190 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 0x7fd3c40bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 0x7fd3c40bf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:49086/0 (socket says 172.21.15.153:49086) 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 -- 172.21.15.153:0/201643964 learned_addr learned my addr 172.21.15.153:0/201643964 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3bbfff700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c908e700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 -- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 msgr2=0x7fd3c4156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 -- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 msgr2=0x7fd3c414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 -- 172.21.15.153:0/201643964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c0009250 con 0x7fd3c4065d90 2023-08-17T00:12:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.545+0000 7fd3c888d700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 0x7fd3c40bf350 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fd3c4066820 tx=0x7fd3c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0005d60 con 0x7fd3c4065d90 2023-08-17T00:12:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c000f510 con 0x7fd3c4065d90 2023-08-17T00:12:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c000f8b0 con 0x7fd3c4065d90 2023-08-17T00:12:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4155290 con 0x7fd3c4065d90 2023-08-17T00:12:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c4155850 con 0x7fd3c4065d90 2023-08-17T00:12:43.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c40647b0 con 0x7fd3c4065d90 2023-08-17T00:12:43.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.549+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd3c0024030 con 0x7fd3c4065d90 2023-08-17T00:12:43.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.553+0000 7fd3b8ff9700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3b005a150 0x7fd3b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:43.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.553+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fd3c0074e90 con 0x7fd3c4065d90 2023-08-17T00:12:43.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.553+0000 7fd3bbfff700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3b005a150 0x7fd3b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:43.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.553+0000 7fd3bbfff700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3b005a150 0x7fd3b005c610 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd3c40a8be0 tx=0x7fd3b4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:43.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.557+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd3c0048810 con 0x7fd3c4065d90 2023-08-17T00:12:43.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.769+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd3c406b4c0 con 0x7fd3c4065d90 2023-08-17T00:12:43.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.769+0000 7fd3b8ff9700 1 -- 172.21.15.153:0/201643964 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1191 (secure 0 0 0) 0x7fd3c0022070 con 0x7fd3c4065d90 2023-08-17T00:12:43.776 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:43.776 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":611,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":952,"data_bytes":976728168,"bytes_used":4435484672,"bytes_avail":768658628608,"bytes_total":773094113280,"write_bytes_sec":23760066,"read_op_per_sec":0,"write_op_per_sec":22},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-08-17T00:11:55.378898+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:12:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3b005a150 msgr2=0x7fd3b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3b005a150 0x7fd3b005c610 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fd3c40a8be0 tx=0x7fd3b4009040).stop 2023-08-17T00:12:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 msgr2=0x7fd3c40bf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 0x7fd3c40bf350 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7fd3c4066820 tx=0x7fd3c0015000).stop 2023-08-17T00:12:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 shutdown_connections 2023-08-17T00:12:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd3b005a150 0x7fd3b005c610 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3c40c1190 0x7fd3c4156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3c4069250 0x7fd3c414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 --2- 172.21.15.153:0/201643964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd3c4065d90 0x7fd3c40bf350 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 >> 172.21.15.153:0/201643964 conn(0x7fd3c40c6620 msgr2=0x7fd3c4063040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 shutdown_connections 2023-08-17T00:12:43.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:43.773+0000 7fd3c988f700 1 -- 172.21.15.153:0/201643964 wait complete. 2023-08-17T00:12:43.798 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:12:44.799 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:44.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.957+0000 7fc4c9639700 1 Processor -- start 2023-08-17T00:12:44.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.961+0000 7fc4c9639700 1 -- start start 2023-08-17T00:12:44.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.961+0000 7fc4c9639700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4c40aa8c0 0x7fc4c4068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:44.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.961+0000 7fc4c9639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4c4068d10 0x7fc4c4064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:44.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.961+0000 7fc4c9639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c40ab9b0 con 0x7fc4c4150880 2023-08-17T00:12:44.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.961+0000 7fc4c9639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c40a9080 con 0x7fc4c4068d10 2023-08-17T00:12:44.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.961+0000 7fc4c9639700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c4069160 con 0x7fc4c40aa8c0 2023-08-17T00:12:44.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c8e38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4c4068d10 0x7fc4c4064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:44.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c8e38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4c4068d10 0x7fc4c4064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35528/0 (socket says 172.21.15.153:35528) 2023-08-17T00:12:44.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c37fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4c40aa8c0 0x7fc4c4068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:44.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c8e38700 1 -- 172.21.15.153:0/347548824 learned_addr learned my addr 172.21.15.153:0/347548824 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:44.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c37fe700 1 -- 172.21.15.153:0/347548824 >> v2:172.21.15.153:3300/0 conn(0x7fc4c4068d10 msgr2=0x7fc4c4064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:44.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c37fe700 1 --2- 172.21.15.153:0/347548824 >> v2:172.21.15.153:3300/0 conn(0x7fc4c4068d10 0x7fc4c4064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:44.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c37fe700 1 -- 172.21.15.153:0/347548824 >> v1:172.21.15.178:6789/0 conn(0x7fc4c4150880 legacy=0x7fc4c40a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:44.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c37fe700 1 -- 172.21.15.153:0/347548824 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c40aada0 con 0x7fc4c40aa8c0 2023-08-17T00:12:44.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c37fe700 1 --2- 172.21.15.153:0/347548824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4068820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fc4c4063ab0 tx=0x7fc4b8009060).ready entity=mon.1 client_cookie=6dc4dd55782c740e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:44.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c2ffd700 1 -- 172.21.15.153:0/347548824 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800f510 con 0x7fc4c40aa8c0 2023-08-17T00:12:44.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c2ffd700 1 -- 172.21.15.153:0/347548824 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b800f670 con 0x7fc4c40aa8c0 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c2ffd700 1 -- 172.21.15.153:0/347548824 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800f9f0 con 0x7fc4c40aa8c0 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 -- 172.21.15.153:0/347548824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c40aa8c0 msgr2=0x7fc4c4068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 --2- 172.21.15.153:0/347548824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4068820 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fc4c4063ab0 tx=0x7fc4b8009060).stop 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 -- 172.21.15.153:0/347548824 shutdown_connections 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 --2- 172.21.15.153:0/347548824 >> v2:172.21.15.153:3300/0 conn(0x7fc4c4068d10 0x7fc4c4064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 --2- 172.21.15.153:0/347548824 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4068820 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 -- 172.21.15.153:0/347548824 >> 172.21.15.153:0/347548824 conn(0x7fc4c40c6620 msgr2=0x7fc4c40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:44.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 -- 172.21.15.153:0/347548824 shutdown_connections 2023-08-17T00:12:44.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.965+0000 7fc4c9639700 1 -- 172.21.15.153:0/347548824 wait complete. 2023-08-17T00:12:44.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 Processor -- start 2023-08-17T00:12:44.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 -- start start 2023-08-17T00:12:44.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4c4068d10 0x7fc4c4147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:44.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:44.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 0x7fc4c40be7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:44.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40be350 con 0x7fc4c40aa8c0 2023-08-17T00:12:44.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c41480f0 con 0x7fc4c4150880 2023-08-17T00:12:44.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.969+0000 7fc4c9639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c40bd740 con 0x7fc4c4068d10 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4c4068d10 0x7fc4c4147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 0x7fc4c40be7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 0x7fc4c40be7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:35100/0 (socket says 172.21.15.153:35100) 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 -- 172.21.15.153:0/3395110826 learned_addr learned my addr 172.21.15.153:0/3395110826 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 -- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4c4068d10 msgr2=0x7fc4c4147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:44.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4c4068d10 0x7fc4c4147c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 -- 172.21.15.153:0/3395110826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c40aa8c0 msgr2=0x7fc4c4151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 -- 172.21.15.153:0/3395110826 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80092a0 con 0x7fc4c4150880 2023-08-17T00:12:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c8e38700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 0x7fc4c40be7e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc4bc00bfc0 tx=0x7fc4bc00d040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:44.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00b320 con 0x7fc4c4150880 2023-08-17T00:12:44.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4bc011040 con 0x7fc4c4150880 2023-08-17T00:12:44.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00ebf0 con 0x7fc4c4150880 2023-08-17T00:12:44.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c40bda20 con 0x7fc4c4150880 2023-08-17T00:12:44.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.973+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c40bdfe0 con 0x7fc4c4150880 2023-08-17T00:12:44.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.977+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c40be4c0 con 0x7fc4c4150880 2023-08-17T00:12:44.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.977+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc4bc009610 con 0x7fc4c4150880 2023-08-17T00:12:44.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.977+0000 7fc4abfff700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4b005a150 0x7fc4b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:44.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.977+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fc4bc076570 con 0x7fc4c4150880 2023-08-17T00:12:44.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.977+0000 7fc4c3fff700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4b005a150 0x7fc4b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:44.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.981+0000 7fc4c3fff700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4b005a150 0x7fc4b005c610 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc4b4007fd0 tx=0x7fc4b4007cf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:44.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:44.985+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4bc049ef0 con 0x7fc4c4150880 2023-08-17T00:12:45.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.185+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4c40ab080 con 0x7fc4c4150880 2023-08-17T00:12:45.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.185+0000 7fc4abfff700 1 -- 172.21.15.153:0/3395110826 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7fc4bc04d510 con 0x7fc4c4150880 2023-08-17T00:12:45.192 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:45.193 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4b005a150 msgr2=0x7fc4b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4b005a150 0x7fc4b005c610 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fc4b4007fd0 tx=0x7fc4b4007cf0).stop 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 msgr2=0x7fc4c40be7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 0x7fc4c40be7e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fc4bc00bfc0 tx=0x7fc4bc00d040).stop 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 shutdown_connections 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4b005a150 0x7fc4b005c610 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4c4150880 0x7fc4c40be7e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4c40aa8c0 0x7fc4c4151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 --2- 172.21.15.153:0/3395110826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4c4068d10 0x7fc4c4147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 >> 172.21.15.153:0/3395110826 conn(0x7fc4c40c6620 msgr2=0x7fc4c40c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 shutdown_connections 2023-08-17T00:12:45.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.189+0000 7fc4c9639700 1 -- 172.21.15.153:0/3395110826 wait complete. 2023-08-17T00:12:45.197 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:45.216 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:12:45.217 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:12:45.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.361+0000 7fda72d69700 1 Processor -- start 2023-08-17T00:12:45.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.361+0000 7fda72d69700 1 -- start start 2023-08-17T00:12:45.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda72d69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fda6c0c1370 0x7fda6c0c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda72d69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda6c0c4fd0 0x7fda6c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda72d69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c0c2520 con 0x7fda6c153670 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda72d69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c0c5460 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda72d69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c0c1910 con 0x7fda6c0c1370 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda70b05700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fda6c153670 0x7fda6c153a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33888/0 (socket says 172.21.15.153:33888) 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda70b05700 1 -- 172.21.15.153:0/983062748 learned_addr learned my addr 172.21.15.153:0/983062748 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda71306700 1 --2- 172.21.15.153:0/983062748 >> v2:172.21.15.153:3300/0 conn(0x7fda6c0c4fd0 0x7fda6c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.365+0000 7fda63fff700 1 --2- 172.21.15.153:0/983062748 >> v2:172.21.15.178:3300/0 conn(0x7fda6c0c1370 0x7fda6c0c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda637fe700 1 -- 172.21.15.153:0/983062748 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2638863115 0 0) 0x7fda6c0c2520 con 0x7fda6c153670 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda637fe700 1 -- 172.21.15.153:0/983062748 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda540033f0 con 0x7fda6c153670 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda71306700 1 -- 172.21.15.153:0/983062748 >> v2:172.21.15.178:3300/0 conn(0x7fda6c0c1370 msgr2=0x7fda6c0c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda71306700 1 --2- 172.21.15.153:0/983062748 >> v2:172.21.15.178:3300/0 conn(0x7fda6c0c1370 0x7fda6c0c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda71306700 1 -- 172.21.15.153:0/983062748 >> v1:172.21.15.178:6789/0 conn(0x7fda6c153670 legacy=0x7fda6c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda71306700 1 -- 172.21.15.153:0/983062748 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c0c1bf0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda71306700 1 --2- 172.21.15.153:0/983062748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c061fa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fda6c0a6820 tx=0x7fda64009780).ready entity=mon.0 client_cookie=ec601ec6038bfbd5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda637fe700 1 -- 172.21.15.153:0/983062748 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400e070 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda637fe700 1 -- 172.21.15.153:0/983062748 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6400bab0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda637fe700 1 -- 172.21.15.153:0/983062748 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6400be30 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 -- 172.21.15.153:0/983062748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 msgr2=0x7fda6c061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 --2- 172.21.15.153:0/983062748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c061fa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7fda6c0a6820 tx=0x7fda64009780).stop 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 -- 172.21.15.153:0/983062748 shutdown_connections 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 --2- 172.21.15.153:0/983062748 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c061fa0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 --2- 172.21.15.153:0/983062748 >> v2:172.21.15.178:3300/0 conn(0x7fda6c0c1370 0x7fda6c0c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 -- 172.21.15.153:0/983062748 >> 172.21.15.153:0/983062748 conn(0x7fda6c0c3810 msgr2=0x7fda6c0c3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 -- 172.21.15.153:0/983062748 shutdown_connections 2023-08-17T00:12:45.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.369+0000 7fda72d69700 1 -- 172.21.15.153:0/983062748 wait complete. 2023-08-17T00:12:45.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 Processor -- start 2023-08-17T00:12:45.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 -- start start 2023-08-17T00:12:45.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6c0c1370 0x7fda6c16bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda6c153670 0x7fda6c0a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c16c390 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c151d50 con 0x7fda6c153670 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda72d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c168320 con 0x7fda6c0c1370 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c161e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35556/0 (socket says 172.21.15.153:35556) 2023-08-17T00:12:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 -- 172.21.15.153:0/1851131434 learned_addr learned my addr 172.21.15.153:0/1851131434 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda71306700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda6c153670 0x7fda6c0a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda70b05700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6c0c1370 0x7fda6c16bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 -- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6c0c1370 msgr2=0x7fda6c16bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6c0c1370 0x7fda6c16bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 -- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda6c153670 msgr2=0x7fda6c0a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda6c153670 0x7fda6c0a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 -- 172.21.15.153:0/1851131434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64009a20 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.373+0000 7fda63fff700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c161e40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fda5c00e980 tx=0x7fda5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00c850 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c00c9b0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c168600 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00cd30 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c168bc0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c168de0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fda5c022070 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda60ff9700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda5805a150 0x7fda5805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.377+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fda5c074730 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.381+0000 7fda70b05700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda5805a150 0x7fda5805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.381+0000 7fda70b05700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda5805a150 0x7fda5805c610 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fda68005750 tx=0x7fda68009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.385+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda5c0480b0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.597+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fda6c06b4c0 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.597+0000 7fda60ff9700 1 -- 172.21.15.153:0/1851131434 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7fda5c016660 con 0x7fda6c0c4fd0 2023-08-17T00:12:45.603 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:45.603 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":613,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075651304,"bytes_used":4666007552,"bytes_avail":768428105728,"bytes_total":773094113280,"write_bytes_sec":36125268,"read_op_per_sec":0,"write_op_per_sec":35},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-08-17T00:12:45.397853+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:12:45.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda5805a150 msgr2=0x7fda5805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda5805a150 0x7fda5805c610 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fda68005750 tx=0x7fda68009040).stop 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 msgr2=0x7fda6c161e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c161e40 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7fda5c00e980 tx=0x7fda5c009060).stop 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 shutdown_connections 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda5805a150 0x7fda5805c610 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda6c153670 0x7fda6c0a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda6c0c4fd0 0x7fda6c161e40 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 --2- 172.21.15.153:0/1851131434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda6c0c1370 0x7fda6c16bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 >> 172.21.15.153:0/1851131434 conn(0x7fda6c0c3810 msgr2=0x7fda6c064a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 shutdown_connections 2023-08-17T00:12:45.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.601+0000 7fda72d69700 1 -- 172.21.15.153:0/1851131434 wait complete. 2023-08-17T00:12:45.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2023-08-17T00:12:45.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub abort 2023-08-17T00:12:45.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.780+0000 7f971f59e700 1 Processor -- start 2023-08-17T00:12:45.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.780+0000 7f971f59e700 1 -- start start 2023-08-17T00:12:45.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97200689c0 0x7f9720068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97201560f0 0x7f97200c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9720065da0 con 0x7f9720151530 2023-08-17T00:12:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9720155c60 con 0x7f97200689c0 2023-08-17T00:12:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9720156550 con 0x7f97201560f0 2023-08-17T00:12:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f97200689c0 0x7f9720068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971ed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9720151530 0x7f97201519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59208/0 (socket says 172.21.15.153:59208) 2023-08-17T00:12:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971ed9d700 1 -- 172.21.15.153:0/2154319512 learned_addr learned my addr 172.21.15.153:0/2154319512 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f9715d9b700 1 --2- 172.21.15.153:0/2154319512 >> v2:172.21.15.178:3300/0 conn(0x7f97201560f0 0x7f97200c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971dd9b700 1 -- 172.21.15.153:0/2154319512 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258100013 0 0) 0x7f9720065da0 con 0x7f9720151530 2023-08-17T00:12:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971dd9b700 1 -- 172.21.15.153:0/2154319512 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f970c0033f0 con 0x7f9720151530 2023-08-17T00:12:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971e59c700 1 -- 172.21.15.153:0/2154319512 >> v2:172.21.15.178:3300/0 conn(0x7f97201560f0 msgr2=0x7f97200c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971e59c700 1 --2- 172.21.15.153:0/2154319512 >> v2:172.21.15.178:3300/0 conn(0x7f97201560f0 0x7f97200c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971e59c700 1 -- 172.21.15.153:0/2154319512 >> v1:172.21.15.153:6789/0 conn(0x7f9720151530 legacy=0x7f97201519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971e59c700 1 -- 172.21.15.153:0/2154319512 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9720065ff0 con 0x7f97200689c0 2023-08-17T00:12:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971e59c700 1 --2- 172.21.15.153:0/2154319512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97200689c0 0x7f9720068da0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f97200bff90 tx=0x7f9710006f40).ready entity=mon.0 client_cookie=dd0667012a92fe24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971dd9b700 1 -- 172.21.15.153:0/2154319512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710005880 con 0x7f97200689c0 2023-08-17T00:12:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971dd9b700 1 -- 172.21.15.153:0/2154319512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97100059e0 con 0x7f97200689c0 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971dd9b700 1 -- 172.21.15.153:0/2154319512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710005d60 con 0x7f97200689c0 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 -- 172.21.15.153:0/2154319512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97200689c0 msgr2=0x7f9720068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.784+0000 7f971f59e700 1 --2- 172.21.15.153:0/2154319512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97200689c0 0x7f9720068da0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7f97200bff90 tx=0x7f9710006f40).stop 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 -- 172.21.15.153:0/2154319512 shutdown_connections 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 --2- 172.21.15.153:0/2154319512 >> v2:172.21.15.178:3300/0 conn(0x7f97201560f0 0x7f97200c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 --2- 172.21.15.153:0/2154319512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97200689c0 0x7f9720068da0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 -- 172.21.15.153:0/2154319512 >> 172.21.15.153:0/2154319512 conn(0x7f97200c6620 msgr2=0x7f97200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 -- 172.21.15.153:0/2154319512 shutdown_connections 2023-08-17T00:12:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 -- 172.21.15.153:0/2154319512 wait complete. 2023-08-17T00:12:45.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.788+0000 7f971f59e700 1 Processor -- start 2023-08-17T00:12:45.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 -- start start 2023-08-17T00:12:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97200689c0 0x7f97201657e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9720151530 0x7f9720150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 0x7f97200a2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9720166710 con 0x7f97201560f0 2023-08-17T00:12:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9720166150 con 0x7f97200689c0 2023-08-17T00:12:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9720166430 con 0x7f9720151530 2023-08-17T00:12:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 0x7f97200a2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 0x7f97200a2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35578/0 (socket says 172.21.15.153:35578) 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 -- 172.21.15.153:0/3525581720 learned_addr learned my addr 172.21.15.153:0/3525581720 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 -- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9720151530 msgr2=0x7f9720150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9720151530 0x7f9720150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 -- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97200689c0 msgr2=0x7f97201657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97200689c0 0x7f97201657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 -- 172.21.15.153:0/3525581720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9710009250 con 0x7f97201560f0 2023-08-17T00:12:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971ed9d700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 0x7f97200a2340 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f9718005ad0 tx=0x7f9718001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f9716ffd700 1 -- 172.21.15.153:0/3525581720 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718005d30 con 0x7f97201560f0 2023-08-17T00:12:45.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f9716ffd700 1 -- 172.21.15.153:0/3525581720 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718005e90 con 0x7f97201560f0 2023-08-17T00:12:45.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97200a1b40 con 0x7f97201560f0 2023-08-17T00:12:45.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f9716ffd700 1 -- 172.21.15.153:0/3525581720 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718007320 con 0x7f97201560f0 2023-08-17T00:12:45.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.792+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9720165cd0 con 0x7f97201560f0 2023-08-17T00:12:45.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.796+0000 7f9716ffd700 1 -- 172.21.15.153:0/3525581720 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9718010030 con 0x7f97201560f0 2023-08-17T00:12:45.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.796+0000 7f9716ffd700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f970005a150 0x7f970005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.796+0000 7f9716ffd700 1 -- 172.21.15.153:0/3525581720 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9718074060 con 0x7f97201560f0 2023-08-17T00:12:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f971e59c700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f970005a150 0x7f970005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f971e59c700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f970005a150 0x7f970005c610 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f97200a8b30 tx=0x7f9710015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 Processor -- start 2023-08-17T00:12:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 -- start start 2023-08-17T00:12:45.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20bb2f0 0x20bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x20742c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2077c20 0x20747b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fc4160 con 0x20777a0 2023-08-17T00:12:45.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fe4ff0 con 0x20bb2f0 2023-08-17T00:12:45.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20b9c60 con 0x2077c20 2023-08-17T00:12:45.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x20742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x20742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35582/0 (socket says 172.21.15.153:35582) 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 -- 172.21.15.153:0/3174065483 learned_addr learned my addr 172.21.15.153:0/3174065483 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f971ed9d700 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2077c20 0x20747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f971e59c700 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20bb2f0 0x20bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 -- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2077c20 msgr2=0x20747b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2077c20 0x20747b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 -- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20bb2f0 msgr2=0x20bb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20bb2f0 0x20bb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f9715d9b700 1 -- 172.21.15.153:0/3174065483 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ff1fd0 con 0x20777a0 2023-08-17T00:12:45.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.800+0000 7f971ed9d700 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2077c20 0x20747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:45.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x20742c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f9708009970 tx=0x7f9708009060).ready entity=mon.0 client_cookie=82276e234cc4102a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f96ff7fe700 1 -- 172.21.15.153:0/3174065483 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080093b0 con 0x20777a0 2023-08-17T00:12:45.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f96ff7fe700 1 -- 172.21.15.153:0/3174065483 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800e8d0 con 0x20777a0 2023-08-17T00:12:45.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f96ff7fe700 1 -- 172.21.15.153:0/3174065483 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800ec50 con 0x20777a0 2023-08-17T00:12:45.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 -- 172.21.15.153:0/3174065483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 msgr2=0x20742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x20742c0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f9708009970 tx=0x7f9708009060).stop 2023-08-17T00:12:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 -- 172.21.15.153:0/3174065483 shutdown_connections 2023-08-17T00:12:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2077c20 0x20747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x20742c0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 --2- 172.21.15.153:0/3174065483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20bb2f0 0x20bb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 -- 172.21.15.153:0/3174065483 >> 172.21.15.153:0/3174065483 conn(0x1e57640 msgr2=0x2078200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 -- 172.21.15.153:0/3174065483 shutdown_connections 2023-08-17T00:12:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 -- 172.21.15.153:0/3174065483 wait complete. 2023-08-17T00:12:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 -- start start 2023-08-17T00:12:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.804+0000 7f972f01b740 1 Processor -- start 2023-08-17T00:12:45.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20777a0 0x20b7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x2094210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 0x2091550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x20bdd80 con 0x20bb2f0 2023-08-17T00:12:45.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20b7f10 con 0x2077c20 2023-08-17T00:12:45.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20bc5b0 con 0x20777a0 2023-08-17T00:12:45.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 10 client.0 ll_register_callbacks cb 0x202f440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:45.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 0x2091550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 0x2091550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35584/0 (socket says 172.21.15.153:35584) 2023-08-17T00:12:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 -- 172.21.15.153:0/4230310341 learned_addr learned my addr 172.21.15.153:0/4230310341 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971e59c700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20777a0 0x20b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f9715d9b700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x2094210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 -- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20777a0 msgr2=0x20b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20777a0 0x20b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 -- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 msgr2=0x2094210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x2094210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 -- 172.21.15.153:0/4230310341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97080095a0 con 0x20bb2f0 2023-08-17T00:12:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f971ed9d700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 0x2091550 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f9718007fd0 tx=0x7f971800f000).ready entity=mon.0 client_cookie=485fb40964cc3815 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f96fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f96fcff9700 1 -- 172.21.15.153:0/4230310341 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718011570 con 0x20bb2f0 2023-08-17T00:12:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f96fcff9700 1 -- 172.21.15.153:0/4230310341 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9718059cc0 con 0x20bb2f0 2023-08-17T00:12:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1feecb0 con 0x20bb2f0 2023-08-17T00:12:45.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f96fcff9700 1 -- 172.21.15.153:0/4230310341 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9718059e80 con 0x20bb2f0 2023-08-17T00:12:45.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 10 client.8208 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:45.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.808+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x1fed470 con 0x20bb2f0 2023-08-17T00:12:45.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f96fcff9700 1 -- 172.21.15.153:0/4230310341 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1feecb0 con 0x20bb2f0 2023-08-17T00:12:45.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f96fcff9700 1 -- 172.21.15.153:0/4230310341 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9718007710 con 0x20bb2f0 2023-08-17T00:12:45.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 10 client.8208 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:45.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 10 client.8208 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 20 client.8208 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2091f30 0x20d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 4 client.8208 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1fe5200 con 0x2091f30 2023-08-17T00:12:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f971e59c700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2091f30 0x20d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f96fcff9700 10 client.8208 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f971e59c700 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2091f30 0x20d2150 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e44d295ffa7dd211 server_cookie=5353e91086862c57 in_seq=0 out_seq=0 2023-08-17T00:12:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f96fcff9700 1 -- 172.21.15.153:0/4230310341 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1fe5200 con 0x2091f30 2023-08-17T00:12:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f96fcff9700 10 client.8208 handle_command_reply: tid=0 2023-08-17T00:12:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 client.8208 shutdown 2023-08-17T00:12:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 msgr2=0x2091550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 0x2091550 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 rx=0x7f9718007fd0 tx=0x7f971800f000).stop 2023-08-17T00:12:45.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 shutdown_connections 2023-08-17T00:12:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2091f30 0x20d2150 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20bb2f0 0x2091550 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f96fcff9700 0 client.8208 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x2094210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 --2- 172.21.15.153:0/4230310341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20777a0 0x20b7810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 >> 172.21.15.153:0/4230310341 conn(0x1e57640 msgr2=0x2078070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 shutdown_connections 2023-08-17T00:12:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.812+0000 7f972f01b740 1 -- 172.21.15.153:0/4230310341 wait complete. 2023-08-17T00:12:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.816+0000 7f972f01b740 20 client.8208 trim_cache size 0 max 16384 2023-08-17T00:12:45.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 Processor -- start 2023-08-17T00:12:45.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 -- start start 2023-08-17T00:12:45.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20777a0 0x2093840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 0x20781b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x20786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x208fae0 con 0x2077c20 2023-08-17T00:12:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2078b90 con 0x20777a0 2023-08-17T00:12:45.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fcde80 con 0x20bb2f0 2023-08-17T00:12:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f9715d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 0x20781b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f9715d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 0x20781b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35592/0 (socket says 172.21.15.153:35592) 2023-08-17T00:12:45.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.832+0000 7f9715d9b700 1 -- 172.21.15.153:0/1996021449 learned_addr learned my addr 172.21.15.153:0/1996021449 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f971ed9d700 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x20786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f971e59c700 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20777a0 0x2093840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f9715d9b700 1 -- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 msgr2=0x20786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f9715d9b700 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x20786a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f9715d9b700 1 -- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20777a0 msgr2=0x2093840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f9715d9b700 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20777a0 0x2093840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f9715d9b700 1 -- 172.21.15.153:0/1996021449 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fed1c0 con 0x2077c20 2023-08-17T00:12:45.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f9715d9b700 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 0x20781b0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f970800e4b0 tx=0x7f970801a000).ready entity=mon.0 client_cookie=aa016f76e076d8f9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f96fffff700 1 -- 172.21.15.153:0/1996021449 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708021070 con 0x2077c20 2023-08-17T00:12:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f96fffff700 1 -- 172.21.15.153:0/1996021449 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708009e40 con 0x2077c20 2023-08-17T00:12:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f96fffff700 1 -- 172.21.15.153:0/1996021449 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800ea40 con 0x2077c20 2023-08-17T00:12:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 -- 172.21.15.153:0/1996021449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 msgr2=0x20781b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 0x20781b0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f970800e4b0 tx=0x7f970801a000).stop 2023-08-17T00:12:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 -- 172.21.15.153:0/1996021449 shutdown_connections 2023-08-17T00:12:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x20786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2077c20 0x20781b0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 --2- 172.21.15.153:0/1996021449 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x20777a0 0x2093840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 -- 172.21.15.153:0/1996021449 >> 172.21.15.153:0/1996021449 conn(0x1e57640 msgr2=0x20bb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 -- 172.21.15.153:0/1996021449 shutdown_connections 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 -- 172.21.15.153:0/1996021449 wait complete. 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 -- start start 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.836+0000 7f972f01b740 1 Processor -- start 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x2110b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x211c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x211cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x211d0e0 con 0x20777a0 2023-08-17T00:12:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x21116e0 con 0x2077c20 2023-08-17T00:12:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x211a210 con 0x20bb2f0 2023-08-17T00:12:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 10 client.0 ll_register_callbacks cb 0x7f9718047a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x2110b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x2110b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35600/0 (socket says 172.21.15.153:35600) 2023-08-17T00:12:45.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 -- 172.21.15.153:0/3336419364 learned_addr learned my addr 172.21.15.153:0/3336419364 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971ed9d700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x211cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x211c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 -- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 msgr2=0x211cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x211cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 -- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 msgr2=0x211c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x211c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 -- 172.21.15.153:0/3336419364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1ff1fd0 con 0x20777a0 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x211c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f971e59c700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x2110b30 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f97200667d0 tx=0x7f971002b040).ready entity=mon.0 client_cookie=55b12ded6fb92da6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f96fcff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f96fcff9700 1 -- 172.21.15.153:0/3336419364 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710006860 con 0x20777a0 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f970800e8d0 con 0x20777a0 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f96fcff9700 1 -- 172.21.15.153:0/3336419364 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9710022040 con 0x20777a0 2023-08-17T00:12:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f96fcff9700 1 -- 172.21.15.153:0/3336419364 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f971000dd20 con 0x20777a0 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 10 client.8214 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.840+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x1ef5940 con 0x20777a0 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f96fcff9700 1 -- 172.21.15.153:0/3336419364 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970800e8d0 con 0x20777a0 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f96fcff9700 1 -- 172.21.15.153:0/3336419364 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f971001d450 con 0x20777a0 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 10 client.8214 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 10 client.8214 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 20 client.8214 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:45.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2093840 0x2116d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:45.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 4 client.8214 mds_command: new command op to 7947 tid=0[{"prefix": "scrub abort"}] 2023-08-17T00:12:45.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x1eae5d0 con 0x2093840 2023-08-17T00:12:45.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2093840 0x2116d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:45.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f96fcff9700 10 client.8214 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:45.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f9715d9b700 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2093840 0x2116d30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=63802a7cd8cbabcb server_cookie=9a5cf7c8b1ade4fc in_seq=0 out_seq=0 2023-08-17T00:12:45.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f96fcff9700 1 -- 172.21.15.153:0/3336419364 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x1eae5d0 con 0x2093840 2023-08-17T00:12:45.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f96fcff9700 10 client.8214 handle_command_reply: tid=0 2023-08-17T00:12:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 client.8214 shutdown 2023-08-17T00:12:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 msgr2=0x2110b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x2110b30 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 rx=0x7f97200667d0 tx=0x7f971002b040).stop 2023-08-17T00:12:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 shutdown_connections 2023-08-17T00:12:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2093840 0x2116d30 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x20bb2f0 0x211cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2077c20 0x211c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 --2- 172.21.15.153:0/3336419364 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x20777a0 0x2110b30 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 >> 172.21.15.153:0/3336419364 conn(0x1e57640 msgr2=0x20bb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f96fcff9700 0 client.8214 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 shutdown_connections 2023-08-17T00:12:45.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 1 -- 172.21.15.153:0/3336419364 wait complete. 2023-08-17T00:12:45.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f972f01b740 20 client.8214 trim_cache size 0 max 16384 2023-08-17T00:12:45.864 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:45.864 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:12:45.864 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:45.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f970005a150 msgr2=0x7f970005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f970005a150 0x7f970005c610 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f97200a8b30 tx=0x7f9710015000).stop 2023-08-17T00:12:45.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 msgr2=0x7f97200a2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:45.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 0x7f97200a2340 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 rx=0x7f9718005ad0 tx=0x7f9718001650).stop 2023-08-17T00:12:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 shutdown_connections 2023-08-17T00:12:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f970005a150 0x7f970005c610 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97201560f0 0x7f97200a2340 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9720151530 0x7f9720150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 --2- 172.21.15.153:0/3525581720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97200689c0 0x7f97201657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 >> 172.21.15.153:0/3525581720 conn(0x7f97200c6620 msgr2=0x7f97200c4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.844+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 shutdown_connections 2023-08-17T00:12:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:45.848+0000 7f971f59e700 1 -- 172.21.15.153:0/3525581720 wait complete. 2023-08-17T00:12:45.873 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2023-08-17T00:12:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.032+0000 7f9391a9b700 1 Processor -- start 2023-08-17T00:12:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.032+0000 7f9391a9b700 1 -- start start 2023-08-17T00:12:46.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f9391a9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f938c154130 0x7f938c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f9391a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f938c0bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f9391a9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f938c065240 con 0x7f938c153d50 2023-08-17T00:12:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f9391a9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f938c063880 con 0x7f938c154130 2023-08-17T00:12:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f9391a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c064910 con 0x7f938c0656d0 2023-08-17T00:12:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f938b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f938c153d50 0x7f938c0629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59218/0 (socket says 172.21.15.153:59218) 2023-08-17T00:12:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f938b7fe700 1 -- 172.21.15.153:0/397467332 learned_addr learned my addr 172.21.15.153:0/397467332 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f938bfff700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f938c0bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f9383fff700 1 --2- 172.21.15.153:0/397467332 >> v2:172.21.15.178:3300/0 conn(0x7f938c154130 0x7f938c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3171810191 0 0) 0x7f938c065240 con 0x7f938c153d50 2023-08-17T00:12:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.036+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93780033f0 con 0x7f938c153d50 2023-08-17T00:12:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1885736161 0 0) 0x7f93780033f0 con 0x7f938c153d50 2023-08-17T00:12:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 msgr2=0x7f938c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f938c0bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 >> v2:172.21.15.178:3300/0 conn(0x7f938c154130 msgr2=0x7f938c0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 --2- 172.21.15.153:0/397467332 >> v2:172.21.15.178:3300/0 conn(0x7f938c154130 0x7f938c0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c064bf0 con 0x7f938c153d50 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f937c001470 con 0x7f938c153d50 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f9383fff700 1 --2- 172.21.15.153:0/397467332 >> v2:172.21.15.178:3300/0 conn(0x7f938c154130 0x7f938c0632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 >> v1:172.21.15.153:6789/0 conn(0x7f938c153d50 legacy=0x7f938c0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f93780038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9378003e10 0x7f9378004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9378004b80 0x7f9378005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c063880 con 0x7f9378004b80 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c064910 con 0x7f9378003e10 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f937800b8e0 con 0x7f938c0656d0 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f93780038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938bfff700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9378004b80 0x7f9378005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f9383fff700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9378003e10 0x7f9378004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 -- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9378003e10 msgr2=0x7f9378004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9378003e10 0x7f9378004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 -- 172.21.15.153:0/397467332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9378004b80 msgr2=0x7f9378005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9378004b80 0x7f9378005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 -- 172.21.15.153:0/397467332 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93780033f0 con 0x7f938c0656d0 2023-08-17T00:12:46.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938bfff700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9378004b80 0x7f9378005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938b7fe700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f93780038e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f937c00c240 tx=0x7f937c001e90).ready entity=mon.2 client_cookie=2e9a51c170725989 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c007a60 con 0x7f938c0656d0 2023-08-17T00:12:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f937c00cad0 con 0x7f938c0656d0 2023-08-17T00:12:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f938affd700 1 -- 172.21.15.153:0/397467332 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c00ce90 con 0x7f938c0656d0 2023-08-17T00:12:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f9391a9b700 1 -- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 msgr2=0x7f93780038e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.040+0000 7f9391a9b700 1 --2- 172.21.15.153:0/397467332 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c0656d0 0x7f93780038e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f937c00c240 tx=0x7f937c001e90).stop 2023-08-17T00:12:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f938bfff700 1 -- 172.21.15.153:0/397467332 reap_dead start 2023-08-17T00:12:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f9391a9b700 1 -- 172.21.15.153:0/397467332 shutdown_connections 2023-08-17T00:12:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f9391a9b700 1 -- 172.21.15.153:0/397467332 >> 172.21.15.153:0/397467332 conn(0x7f938c0c7150 msgr2=0x7f938c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f9391a9b700 1 -- 172.21.15.153:0/397467332 shutdown_connections 2023-08-17T00:12:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f9391a9b700 1 -- 172.21.15.153:0/397467332 wait complete. 2023-08-17T00:12:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f9391a9b700 1 Processor -- start 2023-08-17T00:12:46.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.044+0000 7f9391a9b700 1 -- start start 2023-08-17T00:12:46.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938c0656d0 0x7f938c142430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c155190 0x7f938c155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 0x7f938c0a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c1651e0 con 0x7f938c156030 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f938c142920 con 0x7f938c0656d0 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f938c154d00 con 0x7f938c155190 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 0x7f938c0a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 0x7f938c0a9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35610/0 (socket says 172.21.15.153:35610) 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 -- 172.21.15.153:0/1984765187 learned_addr learned my addr 172.21.15.153:0/1984765187 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9383fff700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c155190 0x7f938c155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938c0656d0 0x7f938c142430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 -- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c155190 msgr2=0x7f938c155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c155190 0x7f938c155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 -- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938c0656d0 msgr2=0x7f938c142430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938c0656d0 0x7f938c142430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 -- 172.21.15.153:0/1984765187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c1564b0 con 0x7f938c156030 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938c0656d0 0x7f938c142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:46.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f938bfff700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 0x7f938c0a9690 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f93840094d0 tx=0x7f938400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f93837fe700 1 -- 172.21.15.153:0/1984765187 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938400e040 con 0x7f938c156030 2023-08-17T00:12:46.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f93837fe700 1 -- 172.21.15.153:0/1984765187 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938400f040 con 0x7f938c156030 2023-08-17T00:12:46.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c164f00 con 0x7f938c156030 2023-08-17T00:12:46.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f93837fe700 1 -- 172.21.15.153:0/1984765187 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384015450 con 0x7f938c156030 2023-08-17T00:12:46.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.048+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c154990 con 0x7f938c156030 2023-08-17T00:12:46.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.052+0000 7f93837fe700 1 -- 172.21.15.153:0/1984765187 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f93840157c0 con 0x7f938c156030 2023-08-17T00:12:46.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.052+0000 7f93837fe700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936c05a150 0x7f936c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.052+0000 7f93837fe700 1 -- 172.21.15.153:0/1984765187 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9384074f70 con 0x7f938c156030 2023-08-17T00:12:46.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936c05a150 0x7f936c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 Processor -- start 2023-08-17T00:12:46.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 -- start start 2023-08-17T00:12:46.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936c05a150 0x7f936c05c610 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f937c00c160 tx=0x7f937c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24f8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x2502140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x2502630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24021a0 con 0x24db860 2023-08-17T00:12:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24b6300 con 0x24dbce0 2023-08-17T00:12:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24b5730 con 0x24f7d20 2023-08-17T00:12:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x2502140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x2502140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35624/0 (socket says 172.21.15.153:35624) 2023-08-17T00:12:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 -- 172.21.15.153:0/2119637567 learned_addr learned my addr 172.21.15.153:0/2119637567 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f938b7fe700 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f938bfff700 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x2502630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 -- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 msgr2=0x24f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 -- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 msgr2=0x2502630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x2502630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 -- 172.21.15.153:0/2119637567 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2430010 con 0x24db860 2023-08-17T00:12:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f938bfff700 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x2502630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.056+0000 7f9383fff700 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x2502140 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f9374009c30 tx=0x7f9374008040).ready entity=mon.0 client_cookie=355520e97a73ba00 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f9380ff9700 1 -- 172.21.15.153:0/2119637567 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93740097c0 con 0x24db860 2023-08-17T00:12:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f9380ff9700 1 -- 172.21.15.153:0/2119637567 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9374014c30 con 0x24db860 2023-08-17T00:12:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f9380ff9700 1 -- 172.21.15.153:0/2119637567 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9374016430 con 0x24db860 2023-08-17T00:12:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 -- 172.21.15.153:0/2119637567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 msgr2=0x2502140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x2502140 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7f9374009c30 tx=0x7f9374008040).stop 2023-08-17T00:12:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 -- 172.21.15.153:0/2119637567 shutdown_connections 2023-08-17T00:12:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x2502630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x2502140 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 --2- 172.21.15.153:0/2119637567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 -- 172.21.15.153:0/2119637567 >> 172.21.15.153:0/2119637567 conn(0x2295680 msgr2=0x24b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 -- 172.21.15.153:0/2119637567 shutdown_connections 2023-08-17T00:12:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 -- 172.21.15.153:0/2119637567 wait complete. 2023-08-17T00:12:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 -- start start 2023-08-17T00:12:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.060+0000 7f939be0c740 1 Processor -- start 2023-08-17T00:12:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24e1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24de890 con 0x24db860 2023-08-17T00:12:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24dd980 con 0x24dbce0 2023-08-17T00:12:46.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24daaa0 con 0x24f7d20 2023-08-17T00:12:46.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 10 client.0 ll_register_callbacks cb 0x246d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:46.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24e1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24e1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35632/0 (socket says 172.21.15.153:35632) 2023-08-17T00:12:46.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 -- 172.21.15.153:0/512219273 learned_addr learned my addr 172.21.15.153:0/512219273 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9383fff700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938bfff700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 -- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 msgr2=0x24de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24de3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 -- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 msgr2=0x24ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 -- 172.21.15.153:0/512219273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9374009990 con 0x24db860 2023-08-17T00:12:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f938b7fe700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24e1540 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f937c00c830 tx=0x7f937c01e000).ready entity=mon.0 client_cookie=8cf2c1b5774e3b16 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9369ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9369ffb700 1 -- 172.21.15.153:0/512219273 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c005b50 con 0x24db860 2023-08-17T00:12:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9369ffb700 1 -- 172.21.15.153:0/512219273 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f937c014cd0 con 0x24db860 2023-08-17T00:12:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23fe200 con 0x24db860 2023-08-17T00:12:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9369ffb700 1 -- 172.21.15.153:0/512219273 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f937c014e90 con 0x24db860 2023-08-17T00:12:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 10 client.8226 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x242b4b0 con 0x24db860 2023-08-17T00:12:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9369ffb700 1 -- 172.21.15.153:0/512219273 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23fe200 con 0x24db860 2023-08-17T00:12:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f9369ffb700 1 -- 172.21.15.153:0/512219273 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f937c013450 con 0x24db860 2023-08-17T00:12:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 10 client.8226 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 10 client.8226 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 20 client.8226 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2508ad0 0x2508ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 4 client.8226 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:46.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.064+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x242ccf0 con 0x2508ad0 2023-08-17T00:12:46.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f9383fff700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2508ad0 0x2508ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f9383fff700 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2508ad0 0x2508ee0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9fb5e2883d81c453 server_cookie=971e2d8b2009b1bb in_seq=0 out_seq=0 2023-08-17T00:12:46.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f9369ffb700 10 client.8226 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f9369ffb700 1 -- 172.21.15.153:0/512219273 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x242ccf0 con 0x2508ad0 2023-08-17T00:12:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f9369ffb700 10 client.8226 handle_command_reply: tid=0 2023-08-17T00:12:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 client.8226 shutdown 2023-08-17T00:12:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 msgr2=0x24e1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24e1540 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7f937c00c830 tx=0x7f937c01e000).stop 2023-08-17T00:12:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 shutdown_connections 2023-08-17T00:12:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x2508ad0 0x2508ee0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f9369ffb700 0 client.8226 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 --2- 172.21.15.153:0/512219273 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24e1540 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 >> 172.21.15.153:0/512219273 conn(0x2295680 msgr2=0x24b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 shutdown_connections 2023-08-17T00:12:46.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 1 -- 172.21.15.153:0/512219273 wait complete. 2023-08-17T00:12:46.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.068+0000 7f939be0c740 20 client.8226 trim_cache size 0 max 16384 2023-08-17T00:12:46.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 Processor -- start 2023-08-17T00:12:46.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 -- start start 2023-08-17T00:12:46.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24db860 0x2508eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x247c540 con 0x24f7d20 2023-08-17T00:12:46.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x240bf60 con 0x24dbce0 2023-08-17T00:12:46.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x241eaf0 con 0x24db860 2023-08-17T00:12:46.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35634/0 (socket says 172.21.15.153:35634) 2023-08-17T00:12:46.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 -- 172.21.15.153:0/3313255277 learned_addr learned my addr 172.21.15.153:0/3313255277 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f9383fff700 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 -- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24db860 msgr2=0x2508eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24db860 0x2508eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 -- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 msgr2=0x24ded30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ded30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.088+0000 7f938bfff700 1 -- 172.21.15.153:0/3313255277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0a9ee0 con 0x24f7d20 2023-08-17T00:12:46.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f938bfff700 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 0x24b4800 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f9384002230 tx=0x7f9384009780).ready entity=mon.0 client_cookie=9e9d830973982b7d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f93817fa700 1 -- 172.21.15.153:0/3313255277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384056070 con 0x24f7d20 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f93817fa700 1 -- 172.21.15.153:0/3313255277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938404c550 con 0x24f7d20 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f93817fa700 1 -- 172.21.15.153:0/3313255277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9384048cc0 con 0x24f7d20 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- 172.21.15.153:0/3313255277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 msgr2=0x24b4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 0x24b4800 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 rx=0x7f9384002230 tx=0x7f9384009780).stop 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- 172.21.15.153:0/3313255277 shutdown_connections 2023-08-17T00:12:46.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x24ded30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- 172.21.15.153:0/3313255277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24db860 0x2508eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:12:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- 172.21.15.153:0/3313255277 >> 172.21.15.153:0/3313255277 conn(0x2295680 msgr2=0x24e1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- 172.21.15.153:0/3313255277 shutdown_connections 2023-08-17T00:12:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- 172.21.15.153:0/3313255277 wait complete. 2023-08-17T00:12:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- start start 2023-08-17T00:12:46.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 Processor -- start 2023-08-17T00:12:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24d4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x25669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24d4ac0 con 0x24db860 2023-08-17T00:12:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24d1ed0 con 0x24dbce0 2023-08-17T00:12:46.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2566ea0 con 0x24f7d20 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f939be0c740 10 client.0 ll_register_callbacks cb 0x7f937c001810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.092+0000 7f938b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24d4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24d4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35648/0 (socket says 172.21.15.153:35648) 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 -- 172.21.15.153:0/1247190692 learned_addr learned my addr 172.21.15.153:0/1247190692 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938bfff700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9383fff700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x25669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 -- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 msgr2=0x24b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 -- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 msgr2=0x25669b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x25669b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 -- 172.21.15.153:0/1247190692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f938c154990 con 0x24db860 2023-08-17T00:12:46.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9383fff700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x25669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f938b7fe700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24d4480 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f937c00d010 tx=0x7f937c028000).ready entity=mon.0 client_cookie=bbd1892e03c6ff24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 1 -- 172.21.15.153:0/1247190692 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f937c013b70 con 0x24db860 2023-08-17T00:12:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 1 -- 172.21.15.153:0/1247190692 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f937c013cd0 con 0x24db860 2023-08-17T00:12:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9374014c30 con 0x24db860 2023-08-17T00:12:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 1 -- 172.21.15.153:0/1247190692 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f937c013e90 con 0x24db860 2023-08-17T00:12:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 10 client.8232 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x242b200 con 0x24db860 2023-08-17T00:12:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 1 -- 172.21.15.153:0/1247190692 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9374014c30 con 0x24db860 2023-08-17T00:12:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 1 -- 172.21.15.153:0/1247190692 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f937c020450 con 0x24db860 2023-08-17T00:12:46.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 10 client.8232 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 10 client.8232 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 20 client.8232 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x24b4cf0 0x24d2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 4 client.8232 mds_command: new command op to 7947 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:12:46.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x2423240 con 0x24b4cf0 2023-08-17T00:12:46.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9383fff700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x24b4cf0 0x24d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 10 client.8232 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9383fff700 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x24b4cf0 0x24d2360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=24b04ad0d156d5 server_cookie=d23d5725a956c97b in_seq=0 out_seq=0 2023-08-17T00:12:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 1 -- 172.21.15.153:0/1247190692 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x2423240 con 0x24b4cf0 2023-08-17T00:12:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f9369ffb700 10 client.8232 handle_command_reply: tid=0 2023-08-17T00:12:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.096+0000 7f939be0c740 1 client.8232 shutdown 2023-08-17T00:12:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 msgr2=0x24d4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24d4480 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f937c00d010 tx=0x7f937c028000).stop 2023-08-17T00:12:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 shutdown_connections 2023-08-17T00:12:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x24b4cf0 0x24d2360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x24f7d20 0x24b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x24dbce0 0x25669b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 --2- 172.21.15.153:0/1247190692 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x24db860 0x24d4480 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 >> 172.21.15.153:0/1247190692 conn(0x2295680 msgr2=0x24da2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9369ffb700 0 client.8232 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 shutdown_connections 2023-08-17T00:12:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 1 -- 172.21.15.153:0/1247190692 wait complete. 2023-08-17T00:12:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f939be0c740 20 client.8232 trim_cache size 0 max 16384 2023-08-17T00:12:46.117 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:46.117 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-08-17T00:12:46.117 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:12:46.118 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936c05a150 msgr2=0x7f936c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936c05a150 0x7f936c05c610 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7f937c00c160 tx=0x7f937c015000).stop 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 msgr2=0x7f938c0a9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 0x7f938c0a9690 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 rx=0x7f93840094d0 tx=0x7f938400b040).stop 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 shutdown_connections 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f936c05a150 0x7f936c05c610 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f938c156030 0x7f938c0a9690 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f938c155190 0x7f938c155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 --2- 172.21.15.153:0/1984765187 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f938c0656d0 0x7f938c142430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 >> 172.21.15.153:0/1984765187 conn(0x7f938c0c7150 msgr2=0x7f938c0c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 shutdown_connections 2023-08-17T00:12:46.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.100+0000 7f9391a9b700 1 -- 172.21.15.153:0/1984765187 wait complete. 2023-08-17T00:12:46.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:46.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.280+0000 7f4b32ff9700 1 Processor -- start 2023-08-17T00:12:46.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.284+0000 7f4b32ff9700 1 -- start start 2023-08-17T00:12:46.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.284+0000 7f4b32ff9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b2c0689c0 0x7f4b2c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.284+0000 7f4b32ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b2c065da0 con 0x7f4b2c151530 2023-08-17T00:12:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2c155c60 con 0x7f4b2c0689c0 2023-08-17T00:12:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c156550 con 0x7f4b2c1560f0 2023-08-17T00:12:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b31ff7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b2c0689c0 0x7f4b2c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b327f8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4b2c151530 0x7f4b2c1519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59228/0 (socket says 172.21.15.153:59228) 2023-08-17T00:12:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b327f8700 1 -- 172.21.15.153:0/103163572 learned_addr learned my addr 172.21.15.153:0/103163572 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b317f6700 1 --2- 172.21.15.153:0/103163572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b31ff7700 1 -- 172.21.15.153:0/103163572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 msgr2=0x7f4b2c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b31ff7700 1 --2- 172.21.15.153:0/103163572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c0c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b31ff7700 1 -- 172.21.15.153:0/103163572 >> v1:172.21.15.153:6789/0 conn(0x7f4b2c151530 legacy=0x7f4b2c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b31ff7700 1 -- 172.21.15.153:0/103163572 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b2c065ff0 con 0x7f4b2c0689c0 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b30ff5700 1 -- 172.21.15.153:0/103163572 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743042599 0 0) 0x7f4b2c065da0 con 0x7f4b2c151530 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b31ff7700 1 --2- 172.21.15.153:0/103163572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c068da0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f4b28006fd0 tx=0x7f4b28006f40).ready entity=mon.0 client_cookie=e0d3674a2afa7224 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b30ff5700 1 -- 172.21.15.153:0/103163572 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28005880 con 0x7f4b2c0689c0 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b30ff5700 1 -- 172.21.15.153:0/103163572 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b280059e0 con 0x7f4b2c0689c0 2023-08-17T00:12:46.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b30ff5700 1 -- 172.21.15.153:0/103163572 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b28005d60 con 0x7f4b2c0689c0 2023-08-17T00:12:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- 172.21.15.153:0/103163572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0689c0 msgr2=0x7f4b2c068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/103163572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c068da0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 rx=0x7f4b28006fd0 tx=0x7f4b28006f40).stop 2023-08-17T00:12:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- 172.21.15.153:0/103163572 shutdown_connections 2023-08-17T00:12:46.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/103163572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c0c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/103163572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c068da0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- 172.21.15.153:0/103163572 >> 172.21.15.153:0/103163572 conn(0x7f4b2c0c6620 msgr2=0x7f4b2c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- 172.21.15.153:0/103163572 shutdown_connections 2023-08-17T00:12:46.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.288+0000 7f4b32ff9700 1 -- 172.21.15.153:0/103163572 wait complete. 2023-08-17T00:12:46.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.292+0000 7f4b32ff9700 1 Processor -- start 2023-08-17T00:12:46.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.292+0000 7f4b32ff9700 1 -- start start 2023-08-17T00:12:46.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.292+0000 7f4b32ff9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.292+0000 7f4b32ff9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 0x7f4b2c1532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.292+0000 7f4b32ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c153790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b32ff9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c153c80 con 0x7f4b2c151530 2023-08-17T00:12:46.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b32ff9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0a38e0 con 0x7f4b2c0689c0 2023-08-17T00:12:46.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b32ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2c0c2a20 con 0x7f4b2c1560f0 2023-08-17T00:12:46.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 0x7f4b2c1532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 0x7f4b2c1532a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35678/0 (socket says 172.21.15.153:35678) 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 -- 172.21.15.153:0/3325678795 learned_addr learned my addr 172.21.15.153:0/3325678795 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b327f8700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c153790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b31ff7700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 -- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 msgr2=0x7f4b2c153790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c153790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 -- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b2c0689c0 msgr2=0x7f4b2c143e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 -- 172.21.15.153:0/3325678795 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28009250 con 0x7f4b2c151530 2023-08-17T00:12:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b327f8700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:46.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b317f6700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 0x7f4b2c1532a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4b1c00d890 tx=0x7f4b1c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c0125f0 con 0x7f4b2c151530 2023-08-17T00:12:46.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c012750 con 0x7f4b2c151530 2023-08-17T00:12:46.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c012ad0 con 0x7f4b2c151530 2023-08-17T00:12:46.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b2c0bda40 con 0x7f4b2c151530 2023-08-17T00:12:46.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b2c0bd6d0 con 0x7f4b2c151530 2023-08-17T00:12:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.296+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b2c0c24f0 con 0x7f4b2c151530 2023-08-17T00:12:46.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.300+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4b1c013480 con 0x7f4b2c151530 2023-08-17T00:12:46.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.300+0000 7f4b21ffb700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b1005a150 0x7f4b1005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.300+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f4b1c074090 con 0x7f4b2c151530 2023-08-17T00:12:46.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.300+0000 7f4b31ff7700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b1005a150 0x7f4b1005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.300+0000 7f4b31ff7700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b1005a150 0x7f4b1005c610 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f4b28009fd0 tx=0x7f4b28015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.304+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4b1c047ac0 con 0x7f4b2c151530 2023-08-17T00:12:46.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.504+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b2c06b4c0 con 0x7f4b2c151530 2023-08-17T00:12:46.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.504+0000 7f4b21ffb700 1 -- 172.21.15.153:0/3325678795 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f4b1c04b0e0 con 0x7f4b2c151530 2023-08-17T00:12:46.511 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:46.511 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b1005a150 msgr2=0x7f4b1005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b1005a150 0x7f4b1005c610 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f4b28009fd0 tx=0x7f4b28015000).stop 2023-08-17T00:12:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 msgr2=0x7f4b2c1532a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 0x7f4b2c1532a0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 rx=0x7f4b1c00d890 tx=0x7f4b1c008040).stop 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 shutdown_connections 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4b1005a150 0x7f4b1005c610 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b2c1560f0 0x7f4b2c153790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b2c151530 0x7f4b2c1532a0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 --2- 172.21.15.153:0/3325678795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b2c0689c0 0x7f4b2c143e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 >> 172.21.15.153:0/3325678795 conn(0x7f4b2c0c6620 msgr2=0x7f4b2c0c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.508+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 shutdown_connections 2023-08-17T00:12:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.512+0000 7f4b32ff9700 1 -- 172.21.15.153:0/3325678795 wait complete. 2023-08-17T00:12:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:46.536 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:12:46.537 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:12:46.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 Processor -- start 2023-08-17T00:12:46.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 -- start start 2023-08-17T00:12:46.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0abf10 0x7f568c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f568c0ac2f0 0x7f568c068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f568c0c0a80 0x7f568c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c069200 con 0x7f568c0c0a80 2023-08-17T00:12:46.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c1545e0 con 0x7f568c0ac2f0 2023-08-17T00:12:46.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f569089a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c0a96d0 con 0x7f568c0abf10 2023-08-17T00:12:46.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:12:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f568c0c0a80 0x7f568c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f568c0c0a80 0x7f568c0c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35684/0 (socket says 172.21.15.153:35684) 2023-08-17T00:12:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 -- 172.21.15.153:0/2085791723 learned_addr learned my addr 172.21.15.153:0/2085791723 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568a59c700 1 --2- 172.21.15.153:0/2085791723 >> v2:172.21.15.178:3300/0 conn(0x7f568c0ac2f0 0x7f568c068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568ad9d700 1 --2- 172.21.15.153:0/2085791723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0abf10 0x7f568c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 -- 172.21.15.153:0/2085791723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0abf10 msgr2=0x7f568c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 --2- 172.21.15.153:0/2085791723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0abf10 0x7f568c068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 -- 172.21.15.153:0/2085791723 >> v2:172.21.15.178:3300/0 conn(0x7f568c0ac2f0 msgr2=0x7f568c068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:46.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 --2- 172.21.15.153:0/2085791723 >> v2:172.21.15.178:3300/0 conn(0x7f568c0ac2f0 0x7f568c068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.688+0000 7f568b59e700 1 -- 172.21.15.153:0/2085791723 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0c1c50 con 0x7f568c0c0a80 2023-08-17T00:12:46.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f568b59e700 1 --2- 172.21.15.153:0/2085791723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0c0a80 0x7f568c0c0ef0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f568c066830 tx=0x7f5684009840).ready entity=mon.0 client_cookie=2a5abe1fad85c259 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f5689d9b700 1 -- 172.21.15.153:0/2085791723 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400e070 con 0x7f568c0c0a80 2023-08-17T00:12:46.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f5689d9b700 1 -- 172.21.15.153:0/2085791723 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568400b970 con 0x7f568c0c0a80 2023-08-17T00:12:46.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f5689d9b700 1 -- 172.21.15.153:0/2085791723 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400bcf0 con 0x7f568c0c0a80 2023-08-17T00:12:46.704 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:12:46.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 -- 172.21.15.153:0/2085791723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0c0a80 msgr2=0x7f568c0c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 --2- 172.21.15.153:0/2085791723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0c0a80 0x7f568c0c0ef0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 rx=0x7f568c066830 tx=0x7f5684009840).stop 2023-08-17T00:12:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 -- 172.21.15.153:0/2085791723 shutdown_connections 2023-08-17T00:12:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 --2- 172.21.15.153:0/2085791723 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0c0a80 0x7f568c0c0ef0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 --2- 172.21.15.153:0/2085791723 >> v2:172.21.15.178:3300/0 conn(0x7f568c0ac2f0 0x7f568c068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 --2- 172.21.15.153:0/2085791723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0abf10 0x7f568c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 -- 172.21.15.153:0/2085791723 >> 172.21.15.153:0/2085791723 conn(0x7f568c0c6620 msgr2=0x7f568c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 -- 172.21.15.153:0/2085791723 shutdown_connections 2023-08-17T00:12:46.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.692+0000 7f569089a700 1 -- 172.21.15.153:0/2085791723 wait complete. 2023-08-17T00:12:46.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 Processor -- start 2023-08-17T00:12:46.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 -- start start 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f568c0abf10 0x7f568c14bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 0x7f568c0bbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0c0a80 0x7f568c153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c168500 con 0x7f568c0ac2f0 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1678f0 con 0x7f568c0abf10 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.696+0000 7f569089a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c167bd0 con 0x7f568c0c0a80 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 0x7f568c0bbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 0x7f568c0bbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35694/0 (socket says 172.21.15.153:35694) 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 -- 172.21.15.153:0/2910949656 learned_addr learned my addr 172.21.15.153:0/2910949656 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568b59e700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0c0a80 0x7f568c153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568ad9d700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f568c0abf10 0x7f568c14bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 -- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0c0a80 msgr2=0x7f568c153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0c0a80 0x7f568c153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 -- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f568c0abf10 msgr2=0x7f568c14bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f568c0abf10 0x7f568c14bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 -- 172.21.15.153:0/2910949656 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009ae0 con 0x7f568c0ac2f0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f568a59c700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 0x7f568c0bbb10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f568000e8d0 tx=0x7f5680009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680012600 con 0x7f568c0ac2f0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680012760 con 0x7f568c0ac2f0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c167eb0 con 0x7f568c0ac2f0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680012ae0 con 0x7f568c0ac2f0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c0bc780 con 0x7f568c0ac2f0 2023-08-17T00:12:46.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.700+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c151be0 con 0x7f568c0ac2f0 2023-08-17T00:12:46.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.704+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5680022070 con 0x7f568c0ac2f0 2023-08-17T00:12:46.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.704+0000 7f5672ffd700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f567805a150 0x7f567805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:46.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.704+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f56800743e0 con 0x7f568c0ac2f0 2023-08-17T00:12:46.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.708+0000 7f568ad9d700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f567805a150 0x7f567805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:46.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.708+0000 7f568ad9d700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f567805a150 0x7f567805c610 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f567c006fd0 tx=0x7f567c006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:46.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.712+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5680047d60 con 0x7f568c0ac2f0 2023-08-17T00:12:46.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.936+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f568c168640 con 0x7f568c0ac2f0 2023-08-17T00:12:46.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.936+0000 7f5672ffd700 1 -- 172.21.15.153:0/2910949656 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7f568c168640 con 0x7f568c0ac2f0 2023-08-17T00:12:46.943 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:46.943 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":614,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075651304,"bytes_used":4666007552,"bytes_avail":768428105728,"bytes_total":773094113280,"write_bytes_sec":36125268,"read_op_per_sec":0,"write_op_per_sec":35},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-08-17T00:12:45.397853+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:12:46.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f567805a150 msgr2=0x7f567805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f567805a150 0x7f567805c610 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f567c006fd0 tx=0x7f567c006f40).stop 2023-08-17T00:12:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 msgr2=0x7f568c0bbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:46.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 0x7f568c0bbb10 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f568000e8d0 tx=0x7f5680009060).stop 2023-08-17T00:12:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 shutdown_connections 2023-08-17T00:12:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f567805a150 0x7f567805c610 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f568c0c0a80 0x7f568c153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f568c0ac2f0 0x7f568c0bbb10 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 --2- 172.21.15.153:0/2910949656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f568c0abf10 0x7f568c14bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:46.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 >> 172.21.15.153:0/2910949656 conn(0x7f568c0c6620 msgr2=0x7f568c14dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:46.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 shutdown_connections 2023-08-17T00:12:46.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:46.940+0000 7f569089a700 1 -- 172.21.15.153:0/2910949656 wait complete. 2023-08-17T00:12:46.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2023-08-17T00:12:46.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub resume 2023-08-17T00:12:47.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.124+0000 7f80d4f07700 1 Processor -- start 2023-08-17T00:12:47.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.124+0000 7f80d4f07700 1 -- start start 2023-08-17T00:12:47.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.124+0000 7f80d4f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.124+0000 7f80d4f07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80d0064590 0x7f80d00649f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80d4f07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d00bbc10 con 0x7f80d0064ee0 2023-08-17T00:12:47.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80d4f07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d00bc500 con 0x7f80d0064590 2023-08-17T00:12:47.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80d4f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0065390 con 0x7f80d0151800 2023-08-17T00:12:47.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80cf7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:53652/0 (socket says 172.21.15.153:53652) 2023-08-17T00:12:47.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80cffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f80d0064ee0 0x7f80d01555f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33896/0 (socket says 172.21.15.153:33896) 2023-08-17T00:12:47.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80cf7fe700 1 -- 172.21.15.153:0/154127488 learned_addr learned my addr 172.21.15.153:0/154127488 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ceffd700 1 --2- 172.21.15.153:0/154127488 >> v2:172.21.15.178:3300/0 conn(0x7f80d0064590 0x7f80d00649f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ce7fc700 1 -- 172.21.15.153:0/154127488 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387855744 0 0) 0x7f80d00bbc10 con 0x7f80d0064ee0 2023-08-17T00:12:47.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ceffd700 1 -- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 msgr2=0x7f80d0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ceffd700 1 --2- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ceffd700 1 -- 172.21.15.153:0/154127488 >> v1:172.21.15.178:6789/0 conn(0x7f80d0064ee0 legacy=0x7f80d01555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ceffd700 1 -- 172.21.15.153:0/154127488 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0066130 con 0x7f80d0064590 2023-08-17T00:12:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ceffd700 1 --2- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d00649f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f80c4009790 tx=0x7f80c4009060).ready entity=mon.1 client_cookie=5c7a75d665b438f6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ce7fc700 1 -- 172.21.15.153:0/154127488 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c40090d0 con 0x7f80d0064590 2023-08-17T00:12:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ce7fc700 1 -- 172.21.15.153:0/154127488 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400f510 con 0x7f80d0064590 2023-08-17T00:12:47.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.128+0000 7f80ce7fc700 1 -- 172.21.15.153:0/154127488 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400f890 con 0x7f80d0064590 2023-08-17T00:12:47.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 -- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 msgr2=0x7f80d00649f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 --2- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d00649f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f80c4009790 tx=0x7f80c4009060).stop 2023-08-17T00:12:47.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 -- 172.21.15.153:0/154127488 shutdown_connections 2023-08-17T00:12:47.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 --2- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d00649f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 --2- 172.21.15.153:0/154127488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 -- 172.21.15.153:0/154127488 >> 172.21.15.153:0/154127488 conn(0x7f80d00c2ed0 msgr2=0x7f80d00c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 -- 172.21.15.153:0/154127488 shutdown_connections 2023-08-17T00:12:47.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 -- 172.21.15.153:0/154127488 wait complete. 2023-08-17T00:12:47.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 Processor -- start 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.132+0000 7f80d4f07700 1 -- start start 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d0164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 0x7f80d014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0153ea0 con 0x7f80d0064ee0 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0150650 con 0x7f80d0064590 2023-08-17T00:12:47.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0165030 con 0x7f80d0151800 2023-08-17T00:12:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 0x7f80d014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 0x7f80d014f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35706/0 (socket says 172.21.15.153:35706) 2023-08-17T00:12:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 -- 172.21.15.153:0/4134985761 learned_addr learned my addr 172.21.15.153:0/4134985761 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d0164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80cffff700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 -- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 msgr2=0x7f80d0151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 -- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 msgr2=0x7f80d0164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d0164b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 -- 172.21.15.153:0/4134985761 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c0009370 con 0x7f80d0064ee0 2023-08-17T00:12:47.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80ceffd700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 0x7f80d014f9f0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f80d0068270 tx=0x7f80c4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80b77fe700 1 -- 172.21.15.153:0/4134985761 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c400f890 con 0x7f80d0064ee0 2023-08-17T00:12:47.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80b77fe700 1 -- 172.21.15.153:0/4134985761 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c400fc50 con 0x7f80d0064ee0 2023-08-17T00:12:47.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40092a0 con 0x7f80d0064ee0 2023-08-17T00:12:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80b77fe700 1 -- 172.21.15.153:0/4134985761 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c401b440 con 0x7f80d0064ee0 2023-08-17T00:12:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.136+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d0153570 con 0x7f80d0064ee0 2023-08-17T00:12:47.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.140+0000 7f80b77fe700 1 -- 172.21.15.153:0/4134985761 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f80c400f070 con 0x7f80d0064ee0 2023-08-17T00:12:47.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.140+0000 7f80b77fe700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f80bc05a180 0x7f80bc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.140+0000 7f80b77fe700 1 -- 172.21.15.153:0/4134985761 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f80c4075620 con 0x7f80d0064ee0 2023-08-17T00:12:47.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 Processor -- start 2023-08-17T00:12:47.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f80bc05a180 0x7f80bc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 -- start start 2023-08-17T00:12:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f80bc05a180 0x7f80bc05c640 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f80c0006fd0 tx=0x7f80c00090f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbf8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbcd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbcef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xb1e1a0 con 0xc13dd0 2023-08-17T00:12:47.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xc149b0 con 0xc139f0 2023-08-17T00:12:47.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbf8960 con 0xbd2330 2023-08-17T00:12:47.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbcef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbcef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35712/0 (socket says 172.21.15.153:35712) 2023-08-17T00:12:47.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 -- 172.21.15.153:0/513892821 learned_addr learned my addr 172.21.15.153:0/513892821 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbf8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80ceffd700 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbcd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 -- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 msgr2=0xbcd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbcd5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 -- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 msgr2=0xbf8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbf8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 -- 172.21.15.153:0/513892821 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xb4c010 con 0xc13dd0 2023-08-17T00:12:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80cffff700 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbcef00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f80c8007210 tx=0x7f80c8007eb0).ready entity=mon.0 client_cookie=847f7c17895c38bf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80b4ff9700 1 -- 172.21.15.153:0/513892821 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8004ba0 con 0xc13dd0 2023-08-17T00:12:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80b4ff9700 1 -- 172.21.15.153:0/513892821 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c8001b40 con 0xc13dd0 2023-08-17T00:12:47.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.144+0000 7f80b4ff9700 1 -- 172.21.15.153:0/513892821 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8001ee0 con 0xc13dd0 2023-08-17T00:12:47.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- 172.21.15.153:0/513892821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 msgr2=0xbcef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbcef00 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 rx=0x7f80c8007210 tx=0x7f80c8007eb0).stop 2023-08-17T00:12:47.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- 172.21.15.153:0/513892821 shutdown_connections 2023-08-17T00:12:47.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbcef00 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbcd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- 172.21.15.153:0/513892821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbf8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- 172.21.15.153:0/513892821 >> 172.21.15.153:0/513892821 conn(0x9b1680 msgr2=0xc18f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- 172.21.15.153:0/513892821 shutdown_connections 2023-08-17T00:12:47.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- 172.21.15.153:0/513892821 wait complete. 2023-08-17T00:12:47.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- start start 2023-08-17T00:12:47.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 Processor -- start 2023-08-17T00:12:47.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbf9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbd1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbfc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xbd1750 con 0xc13dd0 2023-08-17T00:12:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xbfd3f0 con 0xc139f0 2023-08-17T00:12:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbfcea0 con 0xbd2330 2023-08-17T00:12:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80e0501740 10 client.0 ll_register_callbacks cb 0xb89400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:47.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbfc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbfc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35728/0 (socket says 172.21.15.153:35728) 2023-08-17T00:12:47.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80cffff700 1 -- 172.21.15.153:0/2306846037 learned_addr learned my addr 172.21.15.153:0/2306846037 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbf9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.148+0000 7f80ceffd700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbd1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cffff700 1 -- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 msgr2=0xbf9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cffff700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbf9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cffff700 1 -- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 msgr2=0xbd1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cffff700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbd1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cffff700 1 -- 172.21.15.153:0/2306846037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c8004d90 con 0xc13dd0 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cffff700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbfc9b0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f80c800a000 tx=0x7f80c8017000).ready entity=mon.0 client_cookie=8ceceeab7aa11c2c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 1 -- 172.21.15.153:0/2306846037 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8012770 con 0xc13dd0 2023-08-17T00:12:47.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 1 -- 172.21.15.153:0/2306846037 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f80c801cb10 con 0xc13dd0 2023-08-17T00:12:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb1a200 con 0xc13dd0 2023-08-17T00:12:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 1 -- 172.21.15.153:0/2306846037 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80c80128d0 con 0xc13dd0 2023-08-17T00:12:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 10 client.8256 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0xb474b0 con 0xc13dd0 2023-08-17T00:12:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 1 -- 172.21.15.153:0/2306846037 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb1a200 con 0xc13dd0 2023-08-17T00:12:47.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 1 -- 172.21.15.153:0/2306846037 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f80c8029030 con 0xc13dd0 2023-08-17T00:12:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 10 client.8256 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 10 client.8256 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 20 client.8256 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xbcfab0 0xbcfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 4 client.8256 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:47.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb48cf0 con 0xbcfab0 2023-08-17T00:12:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xbcfab0 0xbcfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xbcfab0 0xbcfec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c182644da90ad01 server_cookie=cacca1fa560d626c in_seq=0 out_seq=0 2023-08-17T00:12:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 10 client.8256 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 1 -- 172.21.15.153:0/2306846037 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xb48cf0 con 0xbcfab0 2023-08-17T00:12:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80adffb700 10 client.8256 handle_command_reply: tid=0 2023-08-17T00:12:47.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 client.8256 shutdown 2023-08-17T00:12:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 msgr2=0xbfc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.152+0000 7f80e0501740 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbfc9b0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f80c800a000 tx=0x7f80c8017000).stop 2023-08-17T00:12:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 shutdown_connections 2023-08-17T00:12:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xbcfab0 0xbcfec0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xbfc9b0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xbd1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 --2- 172.21.15.153:0/2306846037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xbd2330 0xbf9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80adffb700 0 client.8256 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 >> 172.21.15.153:0/2306846037 conn(0x9b1680 msgr2=0xbf6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 shutdown_connections 2023-08-17T00:12:47.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 1 -- 172.21.15.153:0/2306846037 wait complete. 2023-08-17T00:12:47.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.156+0000 7f80e0501740 20 client.8256 trim_cache size 0 max 16384 2023-08-17T00:12:47.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 Processor -- start 2023-08-17T00:12:47.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 -- start start 2023-08-17T00:12:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xbd2330 0xc12810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xc27130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc13dd0 0xbf6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xb95240 con 0xbd2330 2023-08-17T00:12:47.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xb98540 con 0xc139f0 2023-08-17T00:12:47.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xbd0d90 con 0xc13dd0 2023-08-17T00:12:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80cf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xbd2330 0xc12810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80cf7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xbd2330 0xc12810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35734/0 (socket says 172.21.15.153:35734) 2023-08-17T00:12:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80cffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc13dd0 0xbf6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80cf7fe700 1 -- 172.21.15.153:0/1091111980 learned_addr learned my addr 172.21.15.153:0/1091111980 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.172+0000 7f80ceffd700 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xc27130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80cffff700 1 -- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 msgr2=0xc27130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80cffff700 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xc27130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80cffff700 1 -- 172.21.15.153:0/1091111980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xbd2330 msgr2=0xc12810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80cffff700 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xbd2330 0xc12810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80cffff700 1 -- 172.21.15.153:0/1091111980 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0152430 con 0xc13dd0 2023-08-17T00:12:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80cffff700 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc13dd0 0xbf6f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f80c80020a0 tx=0x7f80c8022000).ready entity=mon.2 client_cookie=b750dee3df71e322 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80b57fa700 1 -- 172.21.15.153:0/1091111980 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8007be0 con 0xc13dd0 2023-08-17T00:12:47.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80b57fa700 1 -- 172.21.15.153:0/1091111980 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c800b070 con 0xc13dd0 2023-08-17T00:12:47.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80b57fa700 1 -- 172.21.15.153:0/1091111980 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8001860 con 0xc13dd0 2023-08-17T00:12:47.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc13dd0 msgr2=0xbf6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc13dd0 0xbf6f60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f80c80020a0 tx=0x7f80c8022000).stop 2023-08-17T00:12:47.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- 172.21.15.153:0/1091111980 shutdown_connections 2023-08-17T00:12:47.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc13dd0 0xbf6f60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xc139f0 0xc27130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- 172.21.15.153:0/1091111980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xbd2330 0xc12810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- 172.21.15.153:0/1091111980 >> 172.21.15.153:0/1091111980 conn(0x9b1680 msgr2=0xbd0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- 172.21.15.153:0/1091111980 shutdown_connections 2023-08-17T00:12:47.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- 172.21.15.153:0/1091111980 wait complete. 2023-08-17T00:12:47.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- start start 2023-08-17T00:12:47.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 Processor -- start 2023-08-17T00:12:47.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbd2330 0xbf5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc139f0 0xc15950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xc15e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xbf40c0 con 0xc13dd0 2023-08-17T00:12:47.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xc16330 con 0xbd2330 2023-08-17T00:12:47.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.176+0000 7f80e0501740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xc7cf00 con 0xc139f0 2023-08-17T00:12:47.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 10 client.0 ll_register_callbacks cb 0x7f80c8017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:47.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xc15e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xc15e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35748/0 (socket says 172.21.15.153:35748) 2023-08-17T00:12:47.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 -- 172.21.15.153:0/2001335979 learned_addr learned my addr 172.21.15.153:0/2001335979 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80ceffd700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc139f0 0xc15950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbd2330 0xbf5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 -- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc139f0 msgr2=0xc15950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc139f0 0xc15950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 -- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbd2330 msgr2=0xbf5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbd2330 0xbf5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 -- 172.21.15.153:0/2001335979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb474b0 con 0xc13dd0 2023-08-17T00:12:47.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cffff700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xc15e40 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f80c8007800 tx=0x7f80c8016040).ready entity=mon.0 client_cookie=5693371edbc42b5d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 1 -- 172.21.15.153:0/2001335979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c8039070 con 0xc13dd0 2023-08-17T00:12:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 1 -- 172.21.15.153:0/2001335979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f80c8012770 con 0xc13dd0 2023-08-17T00:12:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80c8001b40 con 0xc13dd0 2023-08-17T00:12:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 1 -- 172.21.15.153:0/2001335979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80c801c500 con 0xc13dd0 2023-08-17T00:12:47.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 10 client.8262 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:47.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0xb47200 con 0xc13dd0 2023-08-17T00:12:47.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 1 -- 172.21.15.153:0/2001335979 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80c8001b40 con 0xc13dd0 2023-08-17T00:12:47.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 1 -- 172.21.15.153:0/2001335979 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f80c801e040 con 0xc13dd0 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 10 client.8262 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 10 client.8262 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 20 client.8262 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xc7b290 0xc7c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 4 client.8262 mds_command: new command op to 7947 tid=0[{"prefix": "scrub resume"}] 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0xb3f240 con 0xc7b290 2023-08-17T00:12:47.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xc7b290 0xc7c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80cf7fe700 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xc7b290 0xc7c0c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=62308bd239968daa server_cookie=1b2df77de0ef61f4 in_seq=0 out_seq=0 2023-08-17T00:12:47.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 10 client.8262 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 1 -- 172.21.15.153:0/2001335979 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0xb3f240 con 0xc7b290 2023-08-17T00:12:47.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80adffb700 10 client.8262 handle_command_reply: tid=0 2023-08-17T00:12:47.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 client.8262 shutdown 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 msgr2=0xc15e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.180+0000 7f80e0501740 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xc15e40 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f80c8007800 tx=0x7f80c8016040).stop 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 shutdown_connections 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0xc7b290 0xc7c0c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xc13dd0 0xc15e40 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xc139f0 0xc15950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80adffb700 0 client.8262 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 --2- 172.21.15.153:0/2001335979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xbd2330 0xbf5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 >> 172.21.15.153:0/2001335979 conn(0x9b1680 msgr2=0xbd0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 shutdown_connections 2023-08-17T00:12:47.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 1 -- 172.21.15.153:0/2001335979 wait complete. 2023-08-17T00:12:47.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80e0501740 20 client.8262 trim_cache size 0 max 16384 2023-08-17T00:12:47.198 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:47.199 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:12:47.199 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:47.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f80bc05a180 msgr2=0x7f80bc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f80bc05a180 0x7f80bc05c640 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f80c0006fd0 tx=0x7f80c00090f0).stop 2023-08-17T00:12:47.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 msgr2=0x7f80d014f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 0x7f80d014f9f0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f80d0068270 tx=0x7f80c4017000).stop 2023-08-17T00:12:47.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 shutdown_connections 2023-08-17T00:12:47.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f80bc05a180 0x7f80bc05c640 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80d0151800 0x7f80d0151be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f80d0064ee0 0x7f80d014f9f0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 --2- 172.21.15.153:0/4134985761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80d0064590 0x7f80d0164b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 >> 172.21.15.153:0/4134985761 conn(0x7f80d00c2ed0 msgr2=0x7f80d00ab420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 shutdown_connections 2023-08-17T00:12:47.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.184+0000 7f80d4f07700 1 -- 172.21.15.153:0/4134985761 wait complete. 2023-08-17T00:12:47.209 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2023-08-17T00:12:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.368+0000 7f8b1f039700 1 Processor -- start 2023-08-17T00:12:47.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.368+0000 7f8b1f039700 1 -- start start 2023-08-17T00:12:47.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1f039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b180a8df0 0x7f8b180c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1f039700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b181585a0 con 0x7f8b18068820 2023-08-17T00:12:47.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1f039700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b18066400 con 0x7f8b180aa6e0 2023-08-17T00:12:47.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1f039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18062dc0 con 0x7f8b180a8df0 2023-08-17T00:12:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d836700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8b18068820 0x7f8b18061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59242/0 (socket says 172.21.15.153:59242) 2023-08-17T00:12:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d836700 1 -- 172.21.15.153:0/2135639906 learned_addr learned my addr 172.21.15.153:0/2135639906 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:47.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2135639906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b180a8df0 0x7f8b180c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019303437 0 0) 0x7f8b181585a0 con 0x7f8b18068820 2023-08-17T00:12:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b040033f0 con 0x7f8b18068820 2023-08-17T00:12:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834278258 0 0) 0x7f8b18066400 con 0x7f8b180aa6e0 2023-08-17T00:12:47.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b181585a0 con 0x7f8b180aa6e0 2023-08-17T00:12:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1e037700 1 -- 172.21.15.153:0/2135639906 >> v1:172.21.15.178:6789/0 conn(0x7f8b180aa6e0 legacy=0x7f8b180626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1e037700 1 -- 172.21.15.153:0/2135639906 >> v1:172.21.15.153:6789/0 conn(0x7f8b18068820 legacy=0x7f8b18061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1e037700 1 -- 172.21.15.153:0/2135639906 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180b9d30 con 0x7f8b180a8df0 2023-08-17T00:12:47.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2135639906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b180a8df0 0x7f8b180c1490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8b14009760 tx=0x7f8b14006f40).ready entity=mon.2 client_cookie=8b4bce5b0e8491bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14005880 con 0x7f8b180a8df0 2023-08-17T00:12:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b140059e0 con 0x7f8b180a8df0 2023-08-17T00:12:47.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.372+0000 7f8b1d035700 1 -- 172.21.15.153:0/2135639906 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14005d60 con 0x7f8b180a8df0 2023-08-17T00:12:47.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 -- 172.21.15.153:0/2135639906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b180a8df0 msgr2=0x7f8b180c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 --2- 172.21.15.153:0/2135639906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b180a8df0 0x7f8b180c1490 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f8b14009760 tx=0x7f8b14006f40).stop 2023-08-17T00:12:47.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 -- 172.21.15.153:0/2135639906 shutdown_connections 2023-08-17T00:12:47.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 --2- 172.21.15.153:0/2135639906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b180a8df0 0x7f8b180c1490 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 -- 172.21.15.153:0/2135639906 >> 172.21.15.153:0/2135639906 conn(0x7f8b180c6620 msgr2=0x7f8b180c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 -- 172.21.15.153:0/2135639906 shutdown_connections 2023-08-17T00:12:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 -- 172.21.15.153:0/2135639906 wait complete. 2023-08-17T00:12:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.376+0000 7f8b1f039700 1 Processor -- start 2023-08-17T00:12:47.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 -- start start 2023-08-17T00:12:47.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b18068820 0x7f8b18155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 0x7f8b180ab030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b180aa6e0 0x7f8b180ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180aba10 con 0x7f8b180a8df0 2023-08-17T00:12:47.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180be1d0 con 0x7f8b180aa6e0 2023-08-17T00:12:47.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180bd250 con 0x7f8b18068820 2023-08-17T00:12:47.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 0x7f8b180ab030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 0x7f8b180ab030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35750/0 (socket says 172.21.15.153:35750) 2023-08-17T00:12:47.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 -- 172.21.15.153:0/3671439533 learned_addr learned my addr 172.21.15.153:0/3671439533 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1e037700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b18068820 0x7f8b18155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1e838700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b180aa6e0 0x7f8b180ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 -- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b18068820 msgr2=0x7f8b18155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b18068820 0x7f8b18155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 -- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b180aa6e0 msgr2=0x7f8b180ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b180aa6e0 0x7f8b180ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 -- 172.21.15.153:0/3671439533 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b14009250 con 0x7f8b180a8df0 2023-08-17T00:12:47.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1d836700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 0x7f8b180ab030 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f8b0800c560 tx=0x7f8b08007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b0e7fc700 1 -- 172.21.15.153:0/3671439533 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080072e0 con 0x7f8b180a8df0 2023-08-17T00:12:47.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b0e7fc700 1 -- 172.21.15.153:0/3671439533 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08007440 con 0x7f8b180a8df0 2023-08-17T00:12:47.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180bd8a0 con 0x7f8b180a8df0 2023-08-17T00:12:47.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b0e7fc700 1 -- 172.21.15.153:0/3671439533 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080057a0 con 0x7f8b180a8df0 2023-08-17T00:12:47.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.380+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180bde60 con 0x7f8b180a8df0 2023-08-17T00:12:47.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.384+0000 7f8b0e7fc700 1 -- 172.21.15.153:0/3671439533 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8b08010070 con 0x7f8b180a8df0 2023-08-17T00:12:47.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.384+0000 7f8b0e7fc700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8afc05a180 0x7f8afc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.388+0000 7f8b0e7fc700 1 -- 172.21.15.153:0/3671439533 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8b08073770 con 0x7f8b180a8df0 2023-08-17T00:12:47.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.388+0000 7f8b1e037700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8afc05a180 0x7f8afc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.388+0000 7f8b1e037700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8afc05a180 0x7f8afc05c640 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8b14006fa0 tx=0x7f8b14015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.388+0000 7f8b2a631740 1 Processor -- start 2023-08-17T00:12:47.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.388+0000 7f8b2a631740 1 -- start start 2023-08-17T00:12:47.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x28aa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2863380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2863870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x27b41a0 con 0x28a9c20 2023-08-17T00:12:47.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2862c80 con 0x288e090 2023-08-17T00:12:47.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2867e60 con 0x2867960 2023-08-17T00:12:47.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x28aa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x28aa000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35756/0 (socket says 172.21.15.153:35756) 2023-08-17T00:12:47.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 -- 172.21.15.153:0/2650867255 learned_addr learned my addr 172.21.15.153:0/2650867255 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e838700 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2863870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1d836700 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2863380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 -- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 msgr2=0x2863380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2863380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 -- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 msgr2=0x2863870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2863870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 -- 172.21.15.153:0/2650867255 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27e2010 con 0x28a9c20 2023-08-17T00:12:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1d836700 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2863380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x28aa000 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f8b14009d50 tx=0x7f8b14021070).ready entity=mon.0 client_cookie=610d70396e514745 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8afb7fe700 1 -- 172.21.15.153:0/2650867255 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b14006850 con 0x28a9c20 2023-08-17T00:12:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8afb7fe700 1 -- 172.21.15.153:0/2650867255 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400d4a0 con 0x28a9c20 2023-08-17T00:12:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8afb7fe700 1 -- 172.21.15.153:0/2650867255 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400d610 con 0x28a9c20 2023-08-17T00:12:47.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- 172.21.15.153:0/2650867255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 msgr2=0x28aa000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x28aa000 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f8b14009d50 tx=0x7f8b14021070).stop 2023-08-17T00:12:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- 172.21.15.153:0/2650867255 shutdown_connections 2023-08-17T00:12:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2863870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2863380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2650867255 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x28aa000 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- 172.21.15.153:0/2650867255 >> 172.21.15.153:0/2650867255 conn(0x2647680 msgr2=0x2868a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- 172.21.15.153:0/2650867255 shutdown_connections 2023-08-17T00:12:47.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.392+0000 7f8b2a631740 1 -- 172.21.15.153:0/2650867255 wait complete. 2023-08-17T00:12:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 -- start start 2023-08-17T00:12:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 Processor -- start 2023-08-17T00:12:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 0x288f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x28acb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x2890dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28ad5f0 con 0x2867960 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28af500 con 0x288e090 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x288f9d0 con 0x28a9c20 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 10 client.0 ll_register_callbacks cb 0x281f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 0x288f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 0x288f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35764/0 (socket says 172.21.15.153:35764) 2023-08-17T00:12:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 -- 172.21.15.153:0/1620244390 learned_addr learned my addr 172.21.15.153:0/1620244390 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1d836700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x28acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e838700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x2890dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 -- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 msgr2=0x2890dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x2890dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 -- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 msgr2=0x28acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x28acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 -- 172.21.15.153:0/1620244390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b180b9d30 con 0x2867960 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e838700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x2890dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b1e037700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 0x288f4e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f8b14005ee0 tx=0x7f8b14029000).ready entity=mon.0 client_cookie=e863a388a97fdf77 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8af8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1620244390 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1401f650 con 0x2867960 2023-08-17T00:12:47.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1620244390 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8b1401f7b0 con 0x2867960 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x27b0200 con 0x2867960 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.396+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1620244390 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b1401fb80 con 0x2867960 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 10 client.8274 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x27dd4b0 con 0x2867960 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1620244390 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x27b0200 con 0x2867960 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1620244390 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8b1401fce0 con 0x2867960 2023-08-17T00:12:47.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 10 client.8274 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:47.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 10 client.8274 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:47.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 20 client.8274 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:47.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x28ae250 0x28be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 4 client.8274 mds_command: new command op to 7947 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:12:47.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27decf0 con 0x28ae250 2023-08-17T00:12:47.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b1d836700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x28ae250 0x28be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8af8ff9700 10 client.8274 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b1d836700 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x28ae250 0x28be740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f03837bfb4cae465 server_cookie=5c36c2422d3d93e9 in_seq=0 out_seq=0 2023-08-17T00:12:47.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1620244390 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x27decf0 con 0x28ae250 2023-08-17T00:12:47.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8af8ff9700 10 client.8274 handle_command_reply: tid=0 2023-08-17T00:12:47.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 client.8274 shutdown 2023-08-17T00:12:47.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 msgr2=0x288f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 0x288f4e0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f8b14005ee0 tx=0x7f8b14029000).stop 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 shutdown_connections 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x28ae250 0x28be740 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x2890dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x28acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1620244390 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2867960 0x288f4e0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 >> 172.21.15.153:0/1620244390 conn(0x2647680 msgr2=0x28ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8af8ff9700 0 client.8274 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 shutdown_connections 2023-08-17T00:12:47.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 1 -- 172.21.15.153:0/1620244390 wait complete. 2023-08-17T00:12:47.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.400+0000 7f8b2a631740 20 client.8274 trim_cache size 0 max 16384 2023-08-17T00:12:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 Processor -- start 2023-08-17T00:12:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 -- start start 2023-08-17T00:12:47.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2867960 0x288e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 0x2864240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x28abf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28bea70 con 0x288e090 2023-08-17T00:12:47.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x27bdf60 con 0x2867960 2023-08-17T00:12:47.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28bed40 con 0x28a9c20 2023-08-17T00:12:47.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b1d836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 0x2864240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b1d836700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 0x2864240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35776/0 (socket says 172.21.15.153:35776) 2023-08-17T00:12:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b1d836700 1 -- 172.21.15.153:0/2209731756 learned_addr learned my addr 172.21.15.153:0/2209731756 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b1e838700 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x28abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.420+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2867960 0x288e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1d836700 1 -- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 msgr2=0x28abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1d836700 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x28abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1d836700 1 -- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2867960 msgr2=0x288e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1d836700 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2867960 0x288e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1d836700 1 -- 172.21.15.153:0/2209731756 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180c46f0 con 0x288e090 2023-08-17T00:12:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1e037700 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2867960 0x288e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b1d836700 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 0x2864240 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f8b080472b0 tx=0x7f8b0804c040).ready entity=mon.0 client_cookie=daa07d4e5286d4f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8afbfff700 1 -- 172.21.15.153:0/2209731756 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b08055070 con 0x288e090 2023-08-17T00:12:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8afbfff700 1 -- 172.21.15.153:0/2209731756 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b08048ef0 con 0x288e090 2023-08-17T00:12:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8afbfff700 1 -- 172.21.15.153:0/2209731756 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0804f040 con 0x288e090 2023-08-17T00:12:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 -- 172.21.15.153:0/2209731756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 msgr2=0x2864240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 0x2864240 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 rx=0x7f8b080472b0 tx=0x7f8b0804c040).stop 2023-08-17T00:12:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 -- 172.21.15.153:0/2209731756 shutdown_connections 2023-08-17T00:12:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28a9c20 0x28abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x288e090 0x2864240 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 --2- 172.21.15.153:0/2209731756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2867960 0x288e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 -- 172.21.15.153:0/2209731756 >> 172.21.15.153:0/2209731756 conn(0x2647680 msgr2=0x2866fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 -- 172.21.15.153:0/2209731756 shutdown_connections 2023-08-17T00:12:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.424+0000 7f8b2a631740 1 -- 172.21.15.153:0/2209731756 wait complete. 2023-08-17T00:12:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 -- start start 2023-08-17T00:12:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 Processor -- start 2023-08-17T00:12:47.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2911470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2890970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x2890e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2911960 con 0x28a9c20 2023-08-17T00:12:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2891350 con 0x288e090 2023-08-17T00:12:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29130d0 con 0x2867960 2023-08-17T00:12:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b2a631740 10 client.0 ll_register_callbacks cb 0x7f8b14006240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:12:47.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x2890e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x2890e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35790/0 (socket says 172.21.15.153:35790) 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 -- 172.21.15.153:0/1886568764 learned_addr learned my addr 172.21.15.153:0/1886568764 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e037700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2911470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1d836700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2890970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 -- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 msgr2=0x2911470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2911470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 -- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 msgr2=0x2890970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2890970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.428+0000 7f8b1e838700 1 -- 172.21.15.153:0/1886568764 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b08071e70 con 0x28a9c20 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b1e838700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x2890e60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f8b10001cf0 tx=0x7f8b10009040).ready entity=mon.0 client_cookie=71b8d8e9766fece4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1886568764 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10003ee0 con 0x28a9c20 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1886568764 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8b10004040 con 0x28a9c20 2023-08-17T00:12:47.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b1400d4a0 con 0x28a9c20 2023-08-17T00:12:47.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1886568764 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b10017640 con 0x28a9c20 2023-08-17T00:12:47.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 10 client.8280 fetch_fsmap learned FSMap version 101 2023-08-17T00:12:47.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x27dd200 con 0x28a9c20 2023-08-17T00:12:47.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1886568764 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400d4a0 con 0x28a9c20 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1886568764 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 101) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8b1001e060 con 0x28a9c20 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 10 client.8280 fetch_fsmap finished waiting for FSMap version 101 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 10 client.8280 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 20 client.8280 populate_metadata read hostname 'smithi153' 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x288e570 0x28c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 4 client.8280 mds_command: new command op to 7947 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 --> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x27d5240 con 0x288e570 2023-08-17T00:12:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b1e037700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x288e570 0x28c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 10 client.8280 ms_handle_connect on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b1e037700 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x288e570 0x28c52a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f3650b280fee7d5c server_cookie=c995968dd14b4caa in_seq=0 out_seq=0 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 1 -- 172.21.15.153:0/1886568764 <== mds.0 v2:172.21.15.153:6834/264350329 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x27d5240 con 0x288e570 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 10 client.8280 handle_command_reply: tid=0 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 client.8280 shutdown 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 msgr2=0x2890e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x2890e60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 rx=0x7f8b10001cf0 tx=0x7f8b10009040).stop 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 shutdown_connections 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:6834/264350329,v1:172.21.15.153:6835/264350329] conn(0x288e570 0x28c52a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28a9c20 0x2890e60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x288e090 0x2890970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 --2- 172.21.15.153:0/1886568764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2867960 0x2911470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8af8ff9700 0 client.8280 ms_handle_reset on v2:172.21.15.153:6834/264350329 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.432+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 >> 172.21.15.153:0/1886568764 conn(0x2647680 msgr2=0x2866ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 shutdown_connections 2023-08-17T00:12:47.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b2a631740 1 -- 172.21.15.153:0/1886568764 wait complete. 2023-08-17T00:12:47.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b2a631740 20 client.8280 trim_cache size 0 max 16384 2023-08-17T00:12:47.444 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:12:47.445 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:12:47.445 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:12:47.445 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8afc05a180 msgr2=0x7f8afc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8afc05a180 0x7f8afc05c640 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f8b14006fa0 tx=0x7f8b14015000).stop 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 msgr2=0x7f8b180ab030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 0x7f8b180ab030 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 rx=0x7f8b0800c560 tx=0x7f8b08007cc0).stop 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 shutdown_connections 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8afc05a180 0x7f8afc05c640 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b180aa6e0 0x7f8b180ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8b180a8df0 0x7f8b180ab030 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 --2- 172.21.15.153:0/3671439533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b18068820 0x7f8b18155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 >> 172.21.15.153:0/3671439533 conn(0x7f8b180c6620 msgr2=0x7f8b180c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 shutdown_connections 2023-08-17T00:12:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.436+0000 7f8b1f039700 1 -- 172.21.15.153:0/3671439533 wait complete. 2023-08-17T00:12:47.462 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:12:47.463 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:47.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.616+0000 7f09d9a39700 1 Processor -- start 2023-08-17T00:12:47.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.616+0000 7f09d9a39700 1 -- start start 2023-08-17T00:12:47.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d9a39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09d40acf30 0x7f09d40c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d9a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d4063bc0 0x7f09d40bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d9a39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d4154e90 con 0x7f09d40c5ea0 2023-08-17T00:12:47.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d9a39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d4153fc0 con 0x7f09d40acf30 2023-08-17T00:12:47.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d9a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d4154280 con 0x7f09d4063bc0 2023-08-17T00:12:47.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09d40acf30 0x7f09d40c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f09d40acf30 0x7f09d40c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35792/0 (socket says 172.21.15.153:35792) 2023-08-17T00:12:47.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 -- 172.21.15.153:0/3202534389 learned_addr learned my addr 172.21.15.153:0/3202534389 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d9238700 1 --2- 172.21.15.153:0/3202534389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d4063bc0 0x7f09d40bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 -- 172.21.15.153:0/3202534389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d4063bc0 msgr2=0x7f09d40bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 --2- 172.21.15.153:0/3202534389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d4063bc0 0x7f09d40bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d37fe700 1 -- 172.21.15.153:0/3202534389 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357625011 0 0) 0x7f09d4154e90 con 0x7f09d40c5ea0 2023-08-17T00:12:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 -- 172.21.15.153:0/3202534389 >> v1:172.21.15.178:6789/0 conn(0x7f09d40c5ea0 legacy=0x7f09d40634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 -- 172.21.15.153:0/3202534389 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4154560 con 0x7f09d40acf30 2023-08-17T00:12:47.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d8a37700 1 --2- 172.21.15.153:0/3202534389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d40acf30 0x7f09d40c1020 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f09c8009f20 tx=0x7f09c8009840).ready entity=mon.0 client_cookie=a42531717b1014df server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d37fe700 1 -- 172.21.15.153:0/3202534389 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800e070 con 0x7f09d40acf30 2023-08-17T00:12:47.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.620+0000 7f09d37fe700 1 -- 172.21.15.153:0/3202534389 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c800b9d0 con 0x7f09d40acf30 2023-08-17T00:12:47.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d37fe700 1 -- 172.21.15.153:0/3202534389 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800bd50 con 0x7f09d40acf30 2023-08-17T00:12:47.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 -- 172.21.15.153:0/3202534389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d40acf30 msgr2=0x7f09d40c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 --2- 172.21.15.153:0/3202534389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d40acf30 0x7f09d40c1020 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 rx=0x7f09c8009f20 tx=0x7f09c8009840).stop 2023-08-17T00:12:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 -- 172.21.15.153:0/3202534389 shutdown_connections 2023-08-17T00:12:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 --2- 172.21.15.153:0/3202534389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d4063bc0 0x7f09d40bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 --2- 172.21.15.153:0/3202534389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d40acf30 0x7f09d40c1020 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 -- 172.21.15.153:0/3202534389 >> 172.21.15.153:0/3202534389 conn(0x7f09d40cb330 msgr2=0x7f09d40c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 -- 172.21.15.153:0/3202534389 shutdown_connections 2023-08-17T00:12:47.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 -- 172.21.15.153:0/3202534389 wait complete. 2023-08-17T00:12:47.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.624+0000 7f09d9a39700 1 Processor -- start 2023-08-17T00:12:47.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 -- start start 2023-08-17T00:12:47.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 0x7f09d40ae210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09d40acf30 0x7f09d40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d40b03d0 0x7f09d40bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40c24a0 con 0x7f09d4063bc0 2023-08-17T00:12:47.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d40ae7d0 con 0x7f09d40acf30 2023-08-17T00:12:47.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d4168000 con 0x7f09d40b03d0 2023-08-17T00:12:47.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 0x7f09d40ae210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 0x7f09d40ae210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35796/0 (socket says 172.21.15.153:35796) 2023-08-17T00:12:47.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 -- 172.21.15.153:0/2855741440 learned_addr learned my addr 172.21.15.153:0/2855741440 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:47.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d9238700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d40b03d0 0x7f09d40bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d3fff700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09d40acf30 0x7f09d40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 -- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d40b03d0 msgr2=0x7f09d40bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d40b03d0 0x7f09d40bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 -- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09d40acf30 msgr2=0x7f09d40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09d40acf30 0x7f09d40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.628+0000 7f09d8a37700 1 -- 172.21.15.153:0/2855741440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c8009ae0 con 0x7f09d4063bc0 2023-08-17T00:12:47.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d8a37700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 0x7f09d40ae210 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f09d4083e70 tx=0x7f09c8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c800b640 con 0x7f09d4063bc0 2023-08-17T00:12:47.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c80092e0 con 0x7f09d4063bc0 2023-08-17T00:12:47.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c801e470 con 0x7f09d4063bc0 2023-08-17T00:12:47.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d4168490 con 0x7f09d4063bc0 2023-08-17T00:12:47.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d40b0830 con 0x7f09d4063bc0 2023-08-17T00:12:47.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d406b4c0 con 0x7f09d4063bc0 2023-08-17T00:12:47.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.632+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f09c8025030 con 0x7f09d4063bc0 2023-08-17T00:12:47.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.636+0000 7f09d0ff9700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09b805a150 0x7f09b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:47.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.636+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f09c8075300 con 0x7f09d4063bc0 2023-08-17T00:12:47.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.636+0000 7f09d3fff700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09b805a150 0x7f09b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:47.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.636+0000 7f09d3fff700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09b805a150 0x7f09b805c610 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f09d40ae700 tx=0x7f09c0007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:47.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.640+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f09c8048e40 con 0x7f09d4063bc0 2023-08-17T00:12:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.832+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09d4154840 con 0x7f09d4063bc0 2023-08-17T00:12:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.832+0000 7f09d0ff9700 1 -- 172.21.15.153:0/2855741440 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f09c8023070 con 0x7f09d4063bc0 2023-08-17T00:12:47.841 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:47.841 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:47.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09b805a150 msgr2=0x7f09b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09b805a150 0x7f09b805c610 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f09d40ae700 tx=0x7f09c0007d40).stop 2023-08-17T00:12:47.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 msgr2=0x7f09d40ae210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:47.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 0x7f09d40ae210 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 rx=0x7f09d4083e70 tx=0x7f09c8009840).stop 2023-08-17T00:12:47.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 shutdown_connections 2023-08-17T00:12:47.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f09b805a150 0x7f09b805c610 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09d40b03d0 0x7f09d40bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09d40acf30 0x7f09d40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 --2- 172.21.15.153:0/2855741440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f09d4063bc0 0x7f09d40ae210 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:47.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 >> 172.21.15.153:0/2855741440 conn(0x7f09d40cb330 msgr2=0x7f09d41521b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:47.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 shutdown_connections 2023-08-17T00:12:47.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:47.836+0000 7f09d9a39700 1 -- 172.21.15.153:0/2855741440 wait complete. 2023-08-17T00:12:47.847 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:47.860 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:12:47.861 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:12:48.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.004+0000 7ffa82279700 1 Processor -- start 2023-08-17T00:12:48.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.004+0000 7ffa82279700 1 -- start start 2023-08-17T00:12:48.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa82279700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa7c0a8df0 0x7ffa7c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa82279700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa7c068820 0x7ffa7c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa82279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c061fa0 0x7ffa7c062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa82279700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c1585a0 con 0x7ffa7c068820 2023-08-17T00:12:48.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa82279700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c066400 con 0x7ffa7c0a8df0 2023-08-17T00:12:48.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa82279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c069170 con 0x7ffa7c061fa0 2023-08-17T00:12:48.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa7c068820 0x7ffa7c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ffa7c068820 0x7ffa7c068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35802/0 (socket says 172.21.15.153:35802) 2023-08-17T00:12:48.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa81277700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffa7c0a8df0 0x7ffa7c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 -- 172.21.15.153:0/1033128138 learned_addr learned my addr 172.21.15.153:0/1033128138 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:48.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa81a78700 1 --2- 172.21.15.153:0/1033128138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c061fa0 0x7ffa7c062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 -- 172.21.15.153:0/1033128138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c061fa0 msgr2=0x7ffa7c062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:48.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 --2- 172.21.15.153:0/1033128138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c061fa0 0x7ffa7c062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 -- 172.21.15.153:0/1033128138 >> v2:172.21.15.178:3300/0 conn(0x7ffa7c0a8df0 msgr2=0x7ffa7c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:48.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 --2- 172.21.15.153:0/1033128138 >> v2:172.21.15.178:3300/0 conn(0x7ffa7c0a8df0 0x7ffa7c0c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 -- 172.21.15.153:0/1033128138 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c0b9d30 con 0x7ffa7c068820 2023-08-17T00:12:48.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa80a76700 1 --2- 172.21.15.153:0/1033128138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c068820 0x7ffa7c068c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7ffa7c0c3f30 tx=0x7ffa6c0090f0).ready entity=mon.0 client_cookie=4ddab493eba1453d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:48.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa73fff700 1 -- 172.21.15.153:0/1033128138 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00f510 con 0x7ffa7c068820 2023-08-17T00:12:48.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa73fff700 1 -- 172.21.15.153:0/1033128138 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00f670 con 0x7ffa7c068820 2023-08-17T00:12:48.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.008+0000 7ffa73fff700 1 -- 172.21.15.153:0/1033128138 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00fa10 con 0x7ffa7c068820 2023-08-17T00:12:48.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 -- 172.21.15.153:0/1033128138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c068820 msgr2=0x7ffa7c068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:48.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 --2- 172.21.15.153:0/1033128138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c068820 0x7ffa7c068c80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 rx=0x7ffa7c0c3f30 tx=0x7ffa6c0090f0).stop 2023-08-17T00:12:48.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 -- 172.21.15.153:0/1033128138 shutdown_connections 2023-08-17T00:12:48.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 --2- 172.21.15.153:0/1033128138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c061fa0 0x7ffa7c062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 --2- 172.21.15.153:0/1033128138 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c068820 0x7ffa7c068c80 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 --2- 172.21.15.153:0/1033128138 >> v2:172.21.15.178:3300/0 conn(0x7ffa7c0a8df0 0x7ffa7c0c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 -- 172.21.15.153:0/1033128138 >> 172.21.15.153:0/1033128138 conn(0x7ffa7c0c6620 msgr2=0x7ffa7c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 -- 172.21.15.153:0/1033128138 shutdown_connections 2023-08-17T00:12:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 -- 172.21.15.153:0/1033128138 wait complete. 2023-08-17T00:12:48.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 Processor -- start 2023-08-17T00:12:48.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.012+0000 7ffa82279700 1 -- start start 2023-08-17T00:12:48.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 0x7ffa7c0bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c068820 0x7ffa7c153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa7c0a8df0 0x7ffa7c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c153890 con 0x7ffa7c061fa0 2023-08-17T00:12:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1543f0 con 0x7ffa7c0a8df0 2023-08-17T00:12:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c1546d0 con 0x7ffa7c068820 2023-08-17T00:12:48.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 0x7ffa7c0bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 0x7ffa7c0bff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35818/0 (socket says 172.21.15.153:35818) 2023-08-17T00:12:48.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 -- 172.21.15.153:0/1775194669 learned_addr learned my addr 172.21.15.153:0/1775194669 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa80a76700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c068820 0x7ffa7c153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81a78700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa7c0a8df0 0x7ffa7c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 -- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c068820 msgr2=0x7ffa7c153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:48.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c068820 0x7ffa7c153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 -- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa7c0a8df0 msgr2=0x7ffa7c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa7c0a8df0 0x7ffa7c156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 -- 172.21.15.153:0/1775194669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009370 con 0x7ffa7c061fa0 2023-08-17T00:12:48.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81a78700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa7c0a8df0 0x7ffa7c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa81277700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 0x7ffa7c0bff20 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7ffa78009f40 tx=0x7ffa7800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78009c20 con 0x7ffa7c061fa0 2023-08-17T00:12:48.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7800f040 con 0x7ffa7c061fa0 2023-08-17T00:12:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa78013400 con 0x7ffa7c061fa0 2023-08-17T00:12:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c1549b0 con 0x7ffa7c061fa0 2023-08-17T00:12:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.016+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c154f70 con 0x7ffa7c061fa0 2023-08-17T00:12:48.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.020+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c06b4c0 con 0x7ffa7c061fa0 2023-08-17T00:12:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.020+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ffa78013770 con 0x7ffa7c061fa0 2023-08-17T00:12:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.020+0000 7ffa717fa700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6005a120 0x7ffa6005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:48.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.020+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7ffa78074c70 con 0x7ffa7c061fa0 2023-08-17T00:12:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.024+0000 7ffa80a76700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6005a120 0x7ffa6005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.024+0000 7ffa80a76700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6005a120 0x7ffa6005c5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ffa7c062f10 tx=0x7ffa6c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:48.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.028+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ffa780485f0 con 0x7ffa7c061fa0 2023-08-17T00:12:48.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.240+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ffa7c05e300 con 0x7ffa7c061fa0 2023-08-17T00:12:48.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.240+0000 7ffa717fa700 1 -- 172.21.15.153:0/1775194669 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7ffa7804bc10 con 0x7ffa7c061fa0 2023-08-17T00:12:48.248 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:48.248 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":615,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075651304,"bytes_used":4666007552,"bytes_avail":768428105728,"bytes_total":773094113280,"write_bytes_sec":36125268,"read_op_per_sec":0,"write_op_per_sec":35},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-08-17T00:12:45.397853+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:12:48.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.244+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6005a120 msgr2=0x7ffa6005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.244+0000 7ffa82279700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6005a120 0x7ffa6005c5e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7ffa7c062f10 tx=0x7ffa6c017000).stop 2023-08-17T00:12:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.244+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 msgr2=0x7ffa7c0bff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:48.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.244+0000 7ffa82279700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 0x7ffa7c0bff20 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 rx=0x7ffa78009f40 tx=0x7ffa7800b040).stop 2023-08-17T00:12:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 shutdown_connections 2023-08-17T00:12:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ffa6005a120 0x7ffa6005c5e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa7c0a8df0 0x7ffa7c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa7c068820 0x7ffa7c153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 --2- 172.21.15.153:0/1775194669 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ffa7c061fa0 0x7ffa7c0bff20 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 >> 172.21.15.153:0/1775194669 conn(0x7ffa7c0c6620 msgr2=0x7ffa7c157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 shutdown_connections 2023-08-17T00:12:48.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:48.248+0000 7ffa82279700 1 -- 172.21.15.153:0/1775194669 wait complete. 2023-08-17T00:12:48.272 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2023-08-17T00:12:49.274 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.428+0000 7f04d8ff9700 1 Processor -- start 2023-08-17T00:12:49.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d8ff9700 1 -- start start 2023-08-17T00:12:49.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d8ff9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04d40aa8c0 0x7f04d4068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:49.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d8ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d4064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:49.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d8ff9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04d40ab9b0 con 0x7f04d4150880 2023-08-17T00:12:49.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d8ff9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04d40691a0 con 0x7f04d40aa8c0 2023-08-17T00:12:49.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d8ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d40a9080 con 0x7f04d4068d10 2023-08-17T00:12:49.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d37fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f04d4150880 0x7f04d40a8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33934/0 (socket says 172.21.15.153:33934) 2023-08-17T00:12:49.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d37fe700 1 -- 172.21.15.153:0/575978051 learned_addr learned my addr 172.21.15.153:0/575978051 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:49.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04d3fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d4064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:49.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.432+0000 7f04caffd700 1 --2- 172.21.15.153:0/575978051 >> v2:172.21.15.178:3300/0 conn(0x7f04d40aa8c0 0x7f04d4068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:49.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d3fff700 1 -- 172.21.15.153:0/575978051 >> v2:172.21.15.178:3300/0 conn(0x7f04d40aa8c0 msgr2=0x7f04d4068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:49.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d3fff700 1 --2- 172.21.15.153:0/575978051 >> v2:172.21.15.178:3300/0 conn(0x7f04d40aa8c0 0x7f04d4068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d3fff700 1 -- 172.21.15.153:0/575978051 >> v1:172.21.15.178:6789/0 conn(0x7f04d4150880 legacy=0x7f04d40a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:49.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d2ffd700 1 -- 172.21.15.153:0/575978051 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501839553 0 0) 0x7f04d40ab9b0 con 0x7f04d4150880 2023-08-17T00:12:49.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d3fff700 1 -- 172.21.15.153:0/575978051 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40aada0 con 0x7f04d4068d10 2023-08-17T00:12:49.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04caffd700 1 --2- 172.21.15.153:0/575978051 >> v2:172.21.15.178:3300/0 conn(0x7f04d40aa8c0 0x7f04d4068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:49.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d3fff700 1 --2- 172.21.15.153:0/575978051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d4064670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f04cc009e60 tx=0x7f04cc009780).ready entity=mon.2 client_cookie=c23633f9e047cf5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:49.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d2ffd700 1 -- 172.21.15.153:0/575978051 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00e070 con 0x7f04d4068d10 2023-08-17T00:12:49.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d2ffd700 1 -- 172.21.15.153:0/575978051 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc00bb60 con 0x7f04d4068d10 2023-08-17T00:12:49.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d2ffd700 1 -- 172.21.15.153:0/575978051 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc012410 con 0x7f04d4068d10 2023-08-17T00:12:49.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 -- 172.21.15.153:0/575978051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 msgr2=0x7f04d4064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:49.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/575978051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d4064670 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f04cc009e60 tx=0x7f04cc009780).stop 2023-08-17T00:12:49.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 -- 172.21.15.153:0/575978051 shutdown_connections 2023-08-17T00:12:49.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/575978051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d4064670 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/575978051 >> v2:172.21.15.178:3300/0 conn(0x7f04d40aa8c0 0x7f04d4068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 -- 172.21.15.153:0/575978051 >> 172.21.15.153:0/575978051 conn(0x7f04d40c6620 msgr2=0x7f04d40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:49.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 -- 172.21.15.153:0/575978051 shutdown_connections 2023-08-17T00:12:49.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.436+0000 7f04d8ff9700 1 -- 172.21.15.153:0/575978051 wait complete. 2023-08-17T00:12:49.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 Processor -- start 2023-08-17T00:12:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 -- start start 2023-08-17T00:12:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 0x7f04d4155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04d4150880 0x7f04d41555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d41572a0 con 0x7f04d40aa8c0 2023-08-17T00:12:49.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4154380 con 0x7f04d4150880 2023-08-17T00:12:49.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.440+0000 7f04d8ff9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04d4154620 con 0x7f04d4068d10 2023-08-17T00:12:49.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 0x7f04d4155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:49.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 0x7f04d4155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35834/0 (socket says 172.21.15.153:35834) 2023-08-17T00:12:49.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 -- 172.21.15.153:0/3398552199 learned_addr learned my addr 172.21.15.153:0/3398552199 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:49.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04d3fff700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04d4150880 0x7f04d41555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:49.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04d37fe700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:49.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 -- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 msgr2=0x7f04d414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:49.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 -- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04d4150880 msgr2=0x7f04d41555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:49.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04d4150880 0x7f04d41555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 -- 172.21.15.153:0/3398552199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc0092a0 con 0x7f04d40aa8c0 2023-08-17T00:12:49.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04d3fff700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04d4150880 0x7f04d41555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:49.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04caffd700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 0x7f04d4155100 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f04bc00e980 tx=0x7f04bc009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:49.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00c850 con 0x7f04d40aa8c0 2023-08-17T00:12:49.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc00c9b0 con 0x7f04d40aa8c0 2023-08-17T00:12:49.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc009a20 con 0x7f04d40aa8c0 2023-08-17T00:12:49.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc00cd30 con 0x7f04d40aa8c0 2023-08-17T00:12:49.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04d4154be0 con 0x7f04d40aa8c0 2023-08-17T00:12:49.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.444+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04d406b4c0 con 0x7f04d40aa8c0 2023-08-17T00:12:49.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.448+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f04bc022070 con 0x7f04d40aa8c0 2023-08-17T00:12:49.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.448+0000 7f04cbfff700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f04b405a150 0x7f04b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:49.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.448+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f04bc074680 con 0x7f04d40aa8c0 2023-08-17T00:12:49.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.448+0000 7f04d37fe700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f04b405a150 0x7f04b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:49.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.452+0000 7f04d37fe700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f04b405a150 0x7f04b405c610 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f04c4001230 tx=0x7f04c4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:49.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.456+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f04bc048000 con 0x7f04d40aa8c0 2023-08-17T00:12:49.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.776+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04d40ab080 con 0x7f04d40aa8c0 2023-08-17T00:12:49.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.776+0000 7f04cbfff700 1 -- 172.21.15.153:0/3398552199 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f04bc04b620 con 0x7f04d40aa8c0 2023-08-17T00:12:49.848 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:49.848 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:49.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f04b405a150 msgr2=0x7f04b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f04b405a150 0x7f04b405c610 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f04c4001230 tx=0x7f04c4009040).stop 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 msgr2=0x7f04d4155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 0x7f04d4155100 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7f04bc00e980 tx=0x7f04bc009060).stop 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 shutdown_connections 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f04b405a150 0x7f04b405c610 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04d4150880 0x7f04d41555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04d40aa8c0 0x7f04d4155100 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 --2- 172.21.15.153:0/3398552199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04d4068d10 0x7f04d414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 >> 172.21.15.153:0/3398552199 conn(0x7f04d40c6620 msgr2=0x7f04d414f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 shutdown_connections 2023-08-17T00:12:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:49.780+0000 7f04d8ff9700 1 -- 172.21.15.153:0/3398552199 wait complete. 2023-08-17T00:12:49.851 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:49.852 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:12:49.852 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:12:50.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae99d69700 1 Processor -- start 2023-08-17T00:12:50.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae99d69700 1 -- start start 2023-08-17T00:12:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae99d69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae94153e90 0x7fae940c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae99d69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae940aa750 con 0x7fae94153ab0 2023-08-17T00:12:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae99d69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae941542f0 con 0x7fae940c7980 2023-08-17T00:12:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae99d69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae940c9dd0 con 0x7fae94153e90 2023-08-17T00:12:50.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae937fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fae94153ab0 0x7fae940c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59246/0 (socket says 172.21.15.153:59246) 2023-08-17T00:12:50.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae937fe700 1 -- 172.21.15.153:0/54338628 learned_addr learned my addr 172.21.15.153:0/54338628 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:50.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae92ffd700 1 --2- 172.21.15.153:0/54338628 >> v2:172.21.15.153:3300/0 conn(0x7fae94153e90 0x7fae940c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:50.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae92ffd700 1 -- 172.21.15.153:0/54338628 >> v1:172.21.15.178:6789/0 conn(0x7fae940c7980 legacy=0x7fae940ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae92ffd700 1 -- 172.21.15.153:0/54338628 >> v1:172.21.15.153:6789/0 conn(0x7fae94153ab0 legacy=0x7fae940c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.004+0000 7fae92ffd700 1 -- 172.21.15.153:0/54338628 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae940aacf0 con 0x7fae94153e90 2023-08-17T00:12:50.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae92ffd700 1 --2- 172.21.15.153:0/54338628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94153e90 0x7fae940c7490 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fae88009760 tx=0x7fae88009060).ready entity=mon.0 client_cookie=5d5c1b6f1eab6318 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:50.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae927fc700 1 -- 172.21.15.153:0/54338628 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88009120 con 0x7fae94153e90 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae927fc700 1 -- 172.21.15.153:0/54338628 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800b580 con 0x7fae94153e90 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae927fc700 1 -- 172.21.15.153:0/54338628 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800b900 con 0x7fae94153e90 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 -- 172.21.15.153:0/54338628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94153e90 msgr2=0x7fae940c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 --2- 172.21.15.153:0/54338628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94153e90 0x7fae940c7490 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fae88009760 tx=0x7fae88009060).stop 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 -- 172.21.15.153:0/54338628 shutdown_connections 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 --2- 172.21.15.153:0/54338628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae94153e90 0x7fae940c7490 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 -- 172.21.15.153:0/54338628 >> 172.21.15.153:0/54338628 conn(0x7fae94061fa0 msgr2=0x7fae940623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:50.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 -- 172.21.15.153:0/54338628 shutdown_connections 2023-08-17T00:12:50.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.008+0000 7fae99d69700 1 -- 172.21.15.153:0/54338628 wait complete. 2023-08-17T00:12:50.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 Processor -- start 2023-08-17T00:12:50.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 -- start start 2023-08-17T00:12:50.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 0x7fae941574f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:50.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94153ab0 0x7fae941417c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:50.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94153e90 0x7fae940af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:50.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae94141cb0 con 0x7fae940c7980 2023-08-17T00:12:50.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae940c21f0 con 0x7fae94153ab0 2023-08-17T00:12:50.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae940c43b0 con 0x7fae94153e90 2023-08-17T00:12:50.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 0x7fae941574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:50.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 0x7fae941574f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35856/0 (socket says 172.21.15.153:35856) 2023-08-17T00:12:50.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 -- 172.21.15.153:0/2113003911 learned_addr learned my addr 172.21.15.153:0/2113003911 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:50.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae92ffd700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94153ab0 0x7fae941417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:50.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae93fff700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94153e90 0x7fae940af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:50.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 -- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94153e90 msgr2=0x7fae940af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94153e90 0x7fae940af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 -- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94153ab0 msgr2=0x7fae941417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94153ab0 0x7fae941417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 -- 172.21.15.153:0/2113003911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880092a0 con 0x7fae940c7980 2023-08-17T00:12:50.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae92ffd700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94153ab0 0x7fae941417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:50.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae937fe700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 0x7fae941574f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fae8400c490 tx=0x7fae84007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:50.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840072e0 con 0x7fae940c7980 2023-08-17T00:12:50.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84007440 con 0x7fae940c7980 2023-08-17T00:12:50.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae940aefe0 con 0x7fae940c7980 2023-08-17T00:12:50.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840057a0 con 0x7fae940c7980 2023-08-17T00:12:50.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.012+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae940c1ba0 con 0x7fae940c7980 2023-08-17T00:12:50.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.016+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9406b530 con 0x7fae940c7980 2023-08-17T00:12:50.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.016+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fae8401a060 con 0x7fae940c7980 2023-08-17T00:12:50.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.016+0000 7fae7b7fe700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae8005a150 0x7fae8005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:50.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.016+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fae840738b0 con 0x7fae940c7980 2023-08-17T00:12:50.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.016+0000 7fae92ffd700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae8005a150 0x7fae8005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:50.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.020+0000 7fae92ffd700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae8005a150 0x7fae8005c610 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fae94159ba0 tx=0x7fae88017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:50.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.024+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae84047230 con 0x7fae940c7980 2023-08-17T00:12:50.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.236+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fae94063010 con 0x7fae940c7980 2023-08-17T00:12:50.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.236+0000 7fae7b7fe700 1 -- 172.21.15.153:0/2113003911 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7fae8404a850 con 0x7fae940c7980 2023-08-17T00:12:50.244 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:50.244 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":617,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075891427,"bytes_used":4666490880,"bytes_avail":768427622400,"bytes_total":773094113280,"write_bytes_sec":12034240,"read_op_per_sec":0,"write_op_per_sec":12},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-08-17T00:12:45.397853+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:12:50.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae8005a150 msgr2=0x7fae8005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae8005a150 0x7fae8005c610 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7fae94159ba0 tx=0x7fae88017000).stop 2023-08-17T00:12:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 msgr2=0x7fae941574f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 0x7fae941574f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fae8400c490 tx=0x7fae84007df0).stop 2023-08-17T00:12:50.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 shutdown_connections 2023-08-17T00:12:50.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae8005a150 0x7fae8005c610 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae94153e90 0x7fae940af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae94153ab0 0x7fae941417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 --2- 172.21.15.153:0/2113003911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae940c7980 0x7fae941574f0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:50.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 >> 172.21.15.153:0/2113003911 conn(0x7fae94061fa0 msgr2=0x7fae94062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 shutdown_connections 2023-08-17T00:12:50.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:50.240+0000 7fae99d69700 1 -- 172.21.15.153:0/2113003911 wait complete. 2023-08-17T00:12:50.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'a': 'paused'} 2023-08-17T00:12:51.266 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:51.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.428+0000 7fc88fc1b700 1 Processor -- start 2023-08-17T00:12:51.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.428+0000 7fc88fc1b700 1 -- start start 2023-08-17T00:12:51.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88fc1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880a8b70 0x7fc8880632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88fc1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8880a8f50 0x7fc8880629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88fc1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc888065240 con 0x7fc8880656d0 2023-08-17T00:12:51.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88fc1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc888062ea0 con 0x7fc8880a8f50 2023-08-17T00:12:51.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88fc1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880638a0 con 0x7fc8880a8b70 2023-08-17T00:12:51.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8880a8f50 0x7fc8880629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc8880a8f50 0x7fc8880629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35866/0 (socket says 172.21.15.153:35866) 2023-08-17T00:12:51.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 -- 172.21.15.153:0/3179492750 learned_addr learned my addr 172.21.15.153:0/3179492750 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:51.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d9b7700 1 --2- 172.21.15.153:0/3179492750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880a8b70 0x7fc8880632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 -- 172.21.15.153:0/3179492750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880a8b70 msgr2=0x7fc8880632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:51.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 --2- 172.21.15.153:0/3179492750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880a8b70 0x7fc8880632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 -- 172.21.15.153:0/3179492750 >> v1:172.21.15.178:6789/0 conn(0x7fc8880656d0 legacy=0x7fc8880bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 -- 172.21.15.153:0/3179492750 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888064910 con 0x7fc8880a8f50 2023-08-17T00:12:51.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88d1b6700 1 --2- 172.21.15.153:0/3179492750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc8880629b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7fc878006fd0 tx=0x7fc8780090f0).ready entity=mon.0 client_cookie=42e2ed50f50a579f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:51.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.432+0000 7fc88c9b5700 1 -- 172.21.15.153:0/3179492750 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800b600 con 0x7fc8880a8f50 2023-08-17T00:12:51.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88c9b5700 1 -- 172.21.15.153:0/3179492750 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87800b760 con 0x7fc8880a8f50 2023-08-17T00:12:51.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88c9b5700 1 -- 172.21.15.153:0/3179492750 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800bae0 con 0x7fc8880a8f50 2023-08-17T00:12:51.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 -- 172.21.15.153:0/3179492750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 msgr2=0x7fc8880629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/3179492750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc8880629b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 rx=0x7fc878006fd0 tx=0x7fc8780090f0).stop 2023-08-17T00:12:51.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 -- 172.21.15.153:0/3179492750 shutdown_connections 2023-08-17T00:12:51.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/3179492750 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc8880629b0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/3179492750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880a8b70 0x7fc8880632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 -- 172.21.15.153:0/3179492750 >> 172.21.15.153:0/3179492750 conn(0x7fc8880c7150 msgr2=0x7fc8880c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:51.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 -- 172.21.15.153:0/3179492750 shutdown_connections 2023-08-17T00:12:51.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 -- 172.21.15.153:0/3179492750 wait complete. 2023-08-17T00:12:51.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 Processor -- start 2023-08-17T00:12:51.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.436+0000 7fc88fc1b700 1 -- start start 2023-08-17T00:12:51.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880656d0 0x7fc88816c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880a8b70 0x7fc888159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc888159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8881597e0 con 0x7fc8880a8f50 2023-08-17T00:12:51.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88816bd70 con 0x7fc8880a8b70 2023-08-17T00:12:51.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88815a4d0 con 0x7fc8880656d0 2023-08-17T00:12:51.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc888159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc888159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35876/0 (socket says 172.21.15.153:35876) 2023-08-17T00:12:51.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 -- 172.21.15.153:0/1103175806 learned_addr learned my addr 172.21.15.153:0/1103175806 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:51.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88d9b7700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880656d0 0x7fc88816c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88d1b6700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880a8b70 0x7fc888159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 -- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880656d0 msgr2=0x7fc88816c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880656d0 0x7fc88816c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 -- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880a8b70 msgr2=0x7fc888159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880a8b70 0x7fc888159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 -- 172.21.15.153:0/1103175806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc878009370 con 0x7fc8880a8f50 2023-08-17T00:12:51.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88e1b8700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc888159f00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fc88000c440 tx=0x7fc880007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:51.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800123f0 con 0x7fc8880a8f50 2023-08-17T00:12:51.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880001e90 con 0x7fc8880a8f50 2023-08-17T00:12:51.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc888159350 con 0x7fc8880a8f50 2023-08-17T00:12:51.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880012760 con 0x7fc8880a8f50 2023-08-17T00:12:51.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc888158d00 con 0x7fc8880a8f50 2023-08-17T00:12:51.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.440+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8881594e0 con 0x7fc8880a8f50 2023-08-17T00:12:51.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.444+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc880010070 con 0x7fc8880a8f50 2023-08-17T00:12:51.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.444+0000 7fc87dffb700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86c05a150 0x7fc86c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.444+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fc880073270 con 0x7fc8880a8f50 2023-08-17T00:12:51.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.444+0000 7fc88d9b7700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86c05a150 0x7fc86c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.448+0000 7fc88d9b7700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86c05a150 0x7fc86c05c610 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fc884009fd0 tx=0x7fc884009880).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:51.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.452+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc880046d00 con 0x7fc8880a8f50 2023-08-17T00:12:51.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.648+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8880c3ab0 con 0x7fc8880a8f50 2023-08-17T00:12:51.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.648+0000 7fc87dffb700 1 -- 172.21.15.153:0/1103175806 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7fc88004a320 con 0x7fc8880a8f50 2023-08-17T00:12:51.655 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:51.655 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:51.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86c05a150 msgr2=0x7fc86c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86c05a150 0x7fc86c05c610 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fc884009fd0 tx=0x7fc884009880).stop 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 msgr2=0x7fc888159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc888159f00 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fc88000c440 tx=0x7fc880007d70).stop 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 shutdown_connections 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86c05a150 0x7fc86c05c610 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8880a8f50 0x7fc888159f00 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8880a8b70 0x7fc888159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 --2- 172.21.15.153:0/1103175806 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8880656d0 0x7fc88816c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 >> 172.21.15.153:0/1103175806 conn(0x7fc8880c7150 msgr2=0x7fc8880c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:51.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 shutdown_connections 2023-08-17T00:12:51.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.652+0000 7fc88fc1b700 1 -- 172.21.15.153:0/1103175806 wait complete. 2023-08-17T00:12:51.659 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:51.674 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:12:51.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:12:51.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.828+0000 7f4c3d01b700 1 Processor -- start 2023-08-17T00:12:51.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.832+0000 7f4c3d01b700 1 -- start start 2023-08-17T00:12:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.832+0000 7f4c3d01b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3814fff0 0x7f4c38062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.832+0000 7f4c3d01b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c381503d0 0x7f4c380c2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.832+0000 7f4c3d01b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c380a9170 con 0x7f4c38153da0 2023-08-17T00:12:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.832+0000 7f4c3d01b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c380c1b90 con 0x7f4c381503d0 2023-08-17T00:12:51.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.832+0000 7f4c3d01b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c38154280 con 0x7f4c3814fff0 2023-08-17T00:12:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c2e59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4c38153da0 0x7f4c380c2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59252/0 (socket says 172.21.15.153:59252) 2023-08-17T00:12:51.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c2e59c700 1 -- 172.21.15.153:0/2226475586 learned_addr learned my addr 172.21.15.153:0/2226475586 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c36d9d700 1 --2- 172.21.15.153:0/2226475586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3814fff0 0x7f4c38062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3759e700 1 --2- 172.21.15.153:0/2226475586 >> v2:172.21.15.178:3300/0 conn(0x7f4c381503d0 0x7f4c380c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3659c700 1 -- 172.21.15.153:0/2226475586 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924692835 0 0) 0x7f4c380a9170 con 0x7f4c38153da0 2023-08-17T00:12:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3659c700 1 -- 172.21.15.153:0/2226475586 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c240033f0 con 0x7f4c38153da0 2023-08-17T00:12:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3659c700 1 -- 172.21.15.153:0/2226475586 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3796390098 0 0) 0x7f4c240033f0 con 0x7f4c38153da0 2023-08-17T00:12:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2226475586 >> v2:172.21.15.178:3300/0 conn(0x7f4c381503d0 msgr2=0x7f4c380c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c36d9d700 1 --2- 172.21.15.153:0/2226475586 >> v2:172.21.15.178:3300/0 conn(0x7f4c381503d0 0x7f4c380c2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2226475586 >> v1:172.21.15.153:6789/0 conn(0x7f4c38153da0 legacy=0x7f4c380c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2226475586 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c38154560 con 0x7f4c3814fff0 2023-08-17T00:12:51.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3759e700 1 --2- 172.21.15.153:0/2226475586 >> v2:172.21.15.178:3300/0 conn(0x7f4c381503d0 0x7f4c380c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:51.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c36d9d700 1 --2- 172.21.15.153:0/2226475586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3814fff0 0x7f4c38062970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4c28009760 tx=0x7f4c28009060).ready entity=mon.2 client_cookie=a17cd3c40e75357e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:51.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3659c700 1 -- 172.21.15.153:0/2226475586 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c20001470 con 0x7f4c3814fff0 2023-08-17T00:12:51.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3659c700 1 -- 172.21.15.153:0/2226475586 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c280090d0 con 0x7f4c3814fff0 2023-08-17T00:12:51.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3659c700 1 -- 172.21.15.153:0/2226475586 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28011610 con 0x7f4c3814fff0 2023-08-17T00:12:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2226475586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3814fff0 msgr2=0x7f4c38062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2226475586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3814fff0 0x7f4c38062970 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f4c28009760 tx=0x7f4c28009060).stop 2023-08-17T00:12:51.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2226475586 shutdown_connections 2023-08-17T00:12:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2226475586 >> v2:172.21.15.178:3300/0 conn(0x7f4c381503d0 0x7f4c380c2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2226475586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c3814fff0 0x7f4c38062970 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.836+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2226475586 >> 172.21.15.153:0/2226475586 conn(0x7f4c380c7150 msgr2=0x7f4c380c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:51.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.840+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2226475586 shutdown_connections 2023-08-17T00:12:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.840+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2226475586 wait complete. 2023-08-17T00:12:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.840+0000 7f4c3d01b700 1 Processor -- start 2023-08-17T00:12:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.840+0000 7f4c3d01b700 1 -- start start 2023-08-17T00:12:51.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 0x7f4c380c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c381503d0 0x7f4c3814f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38153da0 0x7f4c3814b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3814f750 con 0x7f4c3814fff0 2023-08-17T00:12:51.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3814e1c0 con 0x7f4c381503d0 2023-08-17T00:12:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3814e4a0 con 0x7f4c38153da0 2023-08-17T00:12:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 0x7f4c380c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 0x7f4c380c6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35884/0 (socket says 172.21.15.153:35884) 2023-08-17T00:12:51.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2544393563 learned_addr learned my addr 172.21.15.153:0/2544393563 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3759e700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38153da0 0x7f4c3814b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c2e59c700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c381503d0 0x7f4c3814f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38153da0 msgr2=0x7f4c3814b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38153da0 0x7f4c3814b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c381503d0 msgr2=0x7f4c3814f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:51.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c381503d0 0x7f4c3814f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:51.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 -- 172.21.15.153:0/2544393563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30009a20 con 0x7f4c3814fff0 2023-08-17T00:12:51.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c2e59c700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c381503d0 0x7f4c3814f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:51.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c36d9d700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 0x7f4c380c6090 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f4c28009d50 tx=0x7f4c28016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:51.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2801c670 con 0x7f4c3814fff0 2023-08-17T00:12:51.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2801c7d0 con 0x7f4c3814fff0 2023-08-17T00:12:51.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c280092a0 con 0x7f4c3814fff0 2023-08-17T00:12:51.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2801cb90 con 0x7f4c3814fff0 2023-08-17T00:12:51.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.844+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3814ea60 con 0x7f4c3814fff0 2023-08-17T00:12:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.848+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3806b530 con 0x7f4c3814fff0 2023-08-17T00:12:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.848+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4c28024030 con 0x7f4c3814fff0 2023-08-17T00:12:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.848+0000 7f4c2f7fe700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1805a150 0x7f4c1805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:51.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.848+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f4c28074ad0 con 0x7f4c3814fff0 2023-08-17T00:12:51.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.848+0000 7f4c2e59c700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1805a150 0x7f4c1805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:51.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.852+0000 7f4c2e59c700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1805a150 0x7f4c1805c610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4c38069360 tx=0x7f4c20009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:51.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:51.856+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c28048560 con 0x7f4c3814fff0 2023-08-17T00:12:52.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.068+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4c380bcbc0 con 0x7f4c3814fff0 2023-08-17T00:12:52.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.068+0000 7f4c2f7fe700 1 -- 172.21.15.153:0/2544393563 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1580 (secure 0 0 0) 0x7f4c28022070 con 0x7f4c3814fff0 2023-08-17T00:12:52.077 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:52.077 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":619,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":128,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075891427,"bytes_used":4666490880,"bytes_avail":768427622400,"bytes_total":773094113280,"write_bytes_sec":10754924,"read_op_per_sec":0,"write_op_per_sec":11},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":7947}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2023-08-17T00:12:51.400227+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:12:52.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1805a150 msgr2=0x7f4c1805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:52.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1805a150 0x7f4c1805c610 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f4c38069360 tx=0x7f4c20009040).stop 2023-08-17T00:12:52.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 msgr2=0x7f4c380c6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:52.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 0x7f4c380c6090 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 rx=0x7f4c28009d50 tx=0x7f4c28016000).stop 2023-08-17T00:12:52.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 shutdown_connections 2023-08-17T00:12:52.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c1805a150 0x7f4c1805c610 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:52.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c38153da0 0x7f4c3814b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:52.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c381503d0 0x7f4c3814f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:52.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 --2- 172.21.15.153:0/2544393563 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c3814fff0 0x7f4c380c6090 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:52.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 >> 172.21.15.153:0/2544393563 conn(0x7f4c380c7150 msgr2=0x7f4c380ab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:52.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 shutdown_connections 2023-08-17T00:12:52.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:52.072+0000 7f4c3d01b700 1 -- 172.21.15.153:0/2544393563 wait complete. 2023-08-17T00:12:52.098 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:12:52.099 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:12:52.099 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:12:52.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:12:52.186 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:12:52.187 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:12:52.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:12:52.187 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:12:52.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:12:52.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:12:52.917 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:12:52.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:53.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.132+0000 7feb4eeb9700 1 Processor -- start 2023-08-17T00:12:53.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.132+0000 7feb4eeb9700 1 -- start start 2023-08-17T00:12:53.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.132+0000 7feb4eeb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feb4814ff20 0x7feb480a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.132+0000 7feb4eeb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb48150450 con 0x7feb480636c0 2023-08-17T00:12:53.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.132+0000 7feb4eeb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb48150730 con 0x7feb480ac020 2023-08-17T00:12:53.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.132+0000 7feb4eeb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb48150a10 con 0x7feb4814ff20 2023-08-17T00:12:53.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4d6b6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feb480636c0 0x7feb48151500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59256/0 (socket says 172.21.15.153:59256) 2023-08-17T00:12:53.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4d6b6700 1 -- 172.21.15.153:0/2779478132 learned_addr learned my addr 172.21.15.153:0/2779478132 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:53.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4e6b8700 1 --2- 172.21.15.153:0/2779478132 >> v2:172.21.15.178:3300/0 conn(0x7feb4814ff20 0x7feb480a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551706277 0 0) 0x7feb48150450 con 0x7feb480636c0 2023-08-17T00:12:53.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb34004500 con 0x7feb480636c0 2023-08-17T00:12:53.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445503802 0 0) 0x7feb48150730 con 0x7feb480ac020 2023-08-17T00:12:53.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb48150450 con 0x7feb480ac020 2023-08-17T00:12:53.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2120405731 0 0) 0x7feb34004500 con 0x7feb480636c0 2023-08-17T00:12:53.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4e6b8700 1 -- 172.21.15.153:0/2779478132 >> v1:172.21.15.178:6789/0 conn(0x7feb480ac020 legacy=0x7feb48062fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4e6b8700 1 -- 172.21.15.153:0/2779478132 >> v1:172.21.15.153:6789/0 conn(0x7feb480636c0 legacy=0x7feb48151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4e6b8700 1 -- 172.21.15.153:0/2779478132 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48150cf0 con 0x7feb4814ff20 2023-08-17T00:12:53.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4e6b8700 1 --2- 172.21.15.153:0/2779478132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4814ff20 0x7feb480a8f50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7feb40009e90 tx=0x7feb40009780).ready entity=mon.1 client_cookie=73977967eceb0ee0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380049a0 con 0x7feb4814ff20 2023-08-17T00:12:53.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4000b7a0 con 0x7feb4814ff20 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4ceb5700 1 -- 172.21.15.153:0/2779478132 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4000bb20 con 0x7feb4814ff20 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4eeb9700 1 -- 172.21.15.153:0/2779478132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4814ff20 msgr2=0x7feb480a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/2779478132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4814ff20 0x7feb480a8f50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7feb40009e90 tx=0x7feb40009780).stop 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4eeb9700 1 -- 172.21.15.153:0/2779478132 shutdown_connections 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/2779478132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb4814ff20 0x7feb480a8f50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.136+0000 7feb4eeb9700 1 -- 172.21.15.153:0/2779478132 >> 172.21.15.153:0/2779478132 conn(0x7feb480c3dd0 msgr2=0x7feb48068a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 -- 172.21.15.153:0/2779478132 shutdown_connections 2023-08-17T00:12:53.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 -- 172.21.15.153:0/2779478132 wait complete. 2023-08-17T00:12:53.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 Processor -- start 2023-08-17T00:12:53.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 -- start start 2023-08-17T00:12:53.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480636c0 0x7feb480bb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 0x7feb4814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4814ff20 0x7feb48065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480a4750 con 0x7feb480ac020 2023-08-17T00:12:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb481638e0 con 0x7feb480636c0 2023-08-17T00:12:53.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4eeb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480a6210 con 0x7feb4814ff20 2023-08-17T00:12:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.140+0000 7feb4d6b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 0x7feb4814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 0x7feb4814f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35892/0 (socket says 172.21.15.153:35892) 2023-08-17T00:12:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 -- 172.21.15.153:0/1997755001 learned_addr learned my addr 172.21.15.153:0/1997755001 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4e6b8700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4814ff20 0x7feb48065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4deb7700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480636c0 0x7feb480bb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 -- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4814ff20 msgr2=0x7feb48065a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4814ff20 0x7feb48065a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 -- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480636c0 msgr2=0x7feb480bb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480636c0 0x7feb480bb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 -- 172.21.15.153:0/1997755001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40009a20 con 0x7feb480ac020 2023-08-17T00:12:53.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4d6b6700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 0x7feb4814f330 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7feb3800d810 tx=0x7feb38001240).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3800f520 con 0x7feb480ac020 2023-08-17T00:12:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb480a3860 con 0x7feb480ac020 2023-08-17T00:12:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3800f6a0 con 0x7feb480ac020 2023-08-17T00:12:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3800fa60 con 0x7feb480ac020 2023-08-17T00:12:53.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb480a3e20 con 0x7feb480ac020 2023-08-17T00:12:53.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.144+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb48046dd0 con 0x7feb480ac020 2023-08-17T00:12:53.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.148+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7feb38013430 con 0x7feb480ac020 2023-08-17T00:12:53.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.148+0000 7feb3dffb700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feb2c05a180 0x7feb2c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.148+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7feb38073f30 con 0x7feb480ac020 2023-08-17T00:12:53.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.148+0000 7feb4deb7700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feb2c05a180 0x7feb2c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.152+0000 7feb4deb7700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feb2c05a180 0x7feb2c05c640 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7feb44003700 tx=0x7feb44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.156+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feb38047850 con 0x7feb480ac020 2023-08-17T00:12:53.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.352+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb48069e50 con 0x7feb480ac020 2023-08-17T00:12:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.352+0000 7feb3dffb700 1 -- 172.21.15.153:0/1997755001 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7feb3804ae70 con 0x7feb480ac020 2023-08-17T00:12:53.360 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:53.360 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:53.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feb2c05a180 msgr2=0x7feb2c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feb2c05a180 0x7feb2c05c640 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7feb44003700 tx=0x7feb44009040).stop 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 msgr2=0x7feb4814f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 0x7feb4814f330 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7feb3800d810 tx=0x7feb38001240).stop 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 shutdown_connections 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feb2c05a180 0x7feb2c05c640 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb4814ff20 0x7feb48065a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feb480ac020 0x7feb4814f330 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 --2- 172.21.15.153:0/1997755001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb480636c0 0x7feb480bb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 >> 172.21.15.153:0/1997755001 conn(0x7feb480c3dd0 msgr2=0x7feb480a9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 shutdown_connections 2023-08-17T00:12:53.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.360+0000 7feb4eeb9700 1 -- 172.21.15.153:0/1997755001 wait complete. 2023-08-17T00:12:53.367 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:53.385 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:53.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 Processor -- start 2023-08-17T00:12:53.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 -- start start 2023-08-17T00:12:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7918153e90 0x7f79180c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79180c7980 0x7f79180ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79180aa750 con 0x7f7918153ab0 2023-08-17T00:12:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180c9dd0 con 0x7f7918153e90 2023-08-17T00:12:53.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791c89b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79180aacf0 con 0x7f79180c7980 2023-08-17T00:12:53.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791659c700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f7918153ab0 0x7f79180c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:33974/0 (socket says 172.21.15.153:33974) 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f791659c700 1 -- 172.21.15.153:0/3755155012 learned_addr learned my addr 172.21.15.153:0/3755155012 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f790ffff700 1 --2- 172.21.15.153:0/3755155012 >> v2:172.21.15.153:3300/0 conn(0x7f7918153e90 0x7f79180c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.536+0000 7f7916d9d700 1 --2- 172.21.15.153:0/3755155012 >> v2:172.21.15.178:3300/0 conn(0x7f79180c7980 0x7f79180ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f7915d9b700 1 -- 172.21.15.153:0/3755155012 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246605088 0 0) 0x7f79180aa750 con 0x7f7918153ab0 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f7915d9b700 1 -- 172.21.15.153:0/3755155012 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79040033f0 con 0x7f7918153ab0 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f790ffff700 1 -- 172.21.15.153:0/3755155012 >> v2:172.21.15.178:3300/0 conn(0x7f79180c7980 msgr2=0x7f79180ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:53.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f790ffff700 1 --2- 172.21.15.153:0/3755155012 >> v2:172.21.15.178:3300/0 conn(0x7f79180c7980 0x7f79180ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f790ffff700 1 -- 172.21.15.153:0/3755155012 >> v1:172.21.15.178:6789/0 conn(0x7f7918153ab0 legacy=0x7f79180c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f790ffff700 1 -- 172.21.15.153:0/3755155012 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79181542f0 con 0x7f7918153e90 2023-08-17T00:12:53.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f790ffff700 1 --2- 172.21.15.153:0/3755155012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7918153e90 0x7f79180c7490 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f791805ea10 tx=0x7f7900009060).ready entity=mon.0 client_cookie=2bd72d69c870cd43 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f7915d9b700 1 -- 172.21.15.153:0/3755155012 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79000090d0 con 0x7f7918153e90 2023-08-17T00:12:53.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f7915d9b700 1 -- 172.21.15.153:0/3755155012 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790000d4a0 con 0x7f7918153e90 2023-08-17T00:12:53.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f7915d9b700 1 -- 172.21.15.153:0/3755155012 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000d820 con 0x7f7918153e90 2023-08-17T00:12:53.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 -- 172.21.15.153:0/3755155012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7918153e90 msgr2=0x7f79180c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 --2- 172.21.15.153:0/3755155012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7918153e90 0x7f79180c7490 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f791805ea10 tx=0x7f7900009060).stop 2023-08-17T00:12:53.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 -- 172.21.15.153:0/3755155012 shutdown_connections 2023-08-17T00:12:53.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 --2- 172.21.15.153:0/3755155012 >> v2:172.21.15.178:3300/0 conn(0x7f79180c7980 0x7f79180ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 --2- 172.21.15.153:0/3755155012 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7918153e90 0x7f79180c7490 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 -- 172.21.15.153:0/3755155012 >> 172.21.15.153:0/3755155012 conn(0x7f7918061fa0 msgr2=0x7f79180623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:53.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 -- 172.21.15.153:0/3755155012 shutdown_connections 2023-08-17T00:12:53.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.540+0000 7f791c89b700 1 -- 172.21.15.153:0/3755155012 wait complete. 2023-08-17T00:12:53.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.544+0000 7f791c89b700 1 Processor -- start 2023-08-17T00:12:53.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.544+0000 7f791c89b700 1 -- start start 2023-08-17T00:12:53.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791c89b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 0x7f79181655a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791c89b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918153ab0 0x7f7918158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791c89b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7918153e90 0x7f79181679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791c89b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7918165a90 con 0x7f79180c7980 2023-08-17T00:12:53.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791c89b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79180c32c0 con 0x7f7918153ab0 2023-08-17T00:12:53.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791c89b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7918159590 con 0x7f7918153e90 2023-08-17T00:12:53.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 0x7f79181655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 0x7f79181655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35910/0 (socket says 172.21.15.153:35910) 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 -- 172.21.15.153:0/860011447 learned_addr learned my addr 172.21.15.153:0/860011447 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f790ffff700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918153ab0 0x7f7918158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f7916d9d700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7918153e90 0x7f79181679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 -- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7918153e90 msgr2=0x7f79181679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7918153e90 0x7f79181679a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 -- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918153ab0 msgr2=0x7f7918158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918153ab0 0x7f7918158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 -- 172.21.15.153:0/860011447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79000092a0 con 0x7f79180c7980 2023-08-17T00:12:53.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.548+0000 7f791659c700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 0x7f79181655a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f790800c590 tx=0x7f7908007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.552+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908007e40 con 0x7f79180c7980 2023-08-17T00:12:53.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.552+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79080072e0 con 0x7f79180c7980 2023-08-17T00:12:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.552+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79180c2c70 con 0x7f79180c7980 2023-08-17T00:12:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.552+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79080057a0 con 0x7f79180c7980 2023-08-17T00:12:53.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.552+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7918159180 con 0x7f79180c7980 2023-08-17T00:12:53.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.552+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79180c2ad0 con 0x7f79180c7980 2023-08-17T00:12:53.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.556+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7908010070 con 0x7f79180c7980 2023-08-17T00:12:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.556+0000 7f790e7fc700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78f805a180 0x7f78f805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.556+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f7908073970 con 0x7f79180c7980 2023-08-17T00:12:53.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.556+0000 7f790ffff700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78f805a180 0x7f78f805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.556+0000 7f790ffff700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78f805a180 0x7f78f805c640 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f7900009fd0 tx=0x7f7900016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.564+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f79180c2ad0 con 0x7f79180c7980 2023-08-17T00:12:53.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.720+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79180c2ad0 con 0x7f79180c7980 2023-08-17T00:12:53.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.724+0000 7f790e7fc700 1 -- 172.21.15.153:0/860011447 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+17040 (secure 0 0 0) 0x7f79180c2ad0 con 0x7f79180c7980 2023-08-17T00:12:53.730 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:53.731 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":128,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:41.469781+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:12:02.859311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T00:12:03.866983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.21","mappings":[{"from":6,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78f805a180 msgr2=0x7f78f805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78f805a180 0x7f78f805c640 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f7900009fd0 tx=0x7f7900016000).stop 2023-08-17T00:12:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 msgr2=0x7f79181655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 0x7f79181655a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f790800c590 tx=0x7f7908007c80).stop 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 shutdown_connections 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78f805a180 0x7f78f805c640 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7918153e90 0x7f79181679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7918153ab0 0x7f7918158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 --2- 172.21.15.153:0/860011447 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79180c7980 0x7f79181655a0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 >> 172.21.15.153:0/860011447 conn(0x7f7918061fa0 msgr2=0x7f79180c0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:53.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 shutdown_connections 2023-08-17T00:12:53.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.728+0000 7f791c89b700 1 -- 172.21.15.153:0/860011447 wait complete. 2023-08-17T00:12:53.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:12:02.859311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:12:03.866983+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:12:53.756 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:12:53.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.908+0000 7fc4ecfb9700 1 Processor -- start 2023-08-17T00:12:53.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.908+0000 7fc4ecfb9700 1 -- start start 2023-08-17T00:12:53.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.908+0000 7fc4ecfb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4e8068f30 0x7fc4e815b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.908+0000 7fc4ecfb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e80ab9b0 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.908+0000 7fc4ecfb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e80a9080 con 0x7fc4e8150880 2023-08-17T00:12:53.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.908+0000 7fc4ecfb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e80aada0 con 0x7fc4e8068f30 2023-08-17T00:12:53.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4e8068f30 0x7fc4e815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc4e8068f30 0x7fc4e815b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35924/0 (socket says 172.21.15.153:35924) 2023-08-17T00:12:53.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 -- 172.21.15.153:0/4000576393 learned_addr learned my addr 172.21.15.153:0/4000576393 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:53.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e6ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc4e80aa8c0 0x7fc4e8068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59268/0 (socket says 172.21.15.153:59268) 2023-08-17T00:12:53.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 -- 172.21.15.153:0/4000576393 >> v1:172.21.15.178:6789/0 conn(0x7fc4e8150880 legacy=0x7fc4e80a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 -- 172.21.15.153:0/4000576393 >> v1:172.21.15.153:6789/0 conn(0x7fc4e80aa8c0 legacy=0x7fc4e8068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 -- 172.21.15.153:0/4000576393 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e80ab080 con 0x7fc4e8068f30 2023-08-17T00:12:53.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e7fff700 1 --2- 172.21.15.153:0/4000576393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e8068f30 0x7fc4e815b530 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fc4e0009f20 tx=0x7fc4e0009840).ready entity=mon.0 client_cookie=99f6fa79e3933ebd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e67fc700 1 -- 172.21.15.153:0/4000576393 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000e070 con 0x7fc4e8068f30 2023-08-17T00:12:53.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e67fc700 1 -- 172.21.15.153:0/4000576393 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e000ba80 con 0x7fc4e8068f30 2023-08-17T00:12:53.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4e67fc700 1 -- 172.21.15.153:0/4000576393 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e000be00 con 0x7fc4e8068f30 2023-08-17T00:12:53.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/4000576393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e8068f30 msgr2=0x7fc4e815b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/4000576393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e8068f30 0x7fc4e815b530 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7fc4e0009f20 tx=0x7fc4e0009840).stop 2023-08-17T00:12:53.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/4000576393 shutdown_connections 2023-08-17T00:12:53.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/4000576393 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e8068f30 0x7fc4e815b530 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/4000576393 >> 172.21.15.153:0/4000576393 conn(0x7fc4e80c6620 msgr2=0x7fc4e80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:53.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/4000576393 shutdown_connections 2023-08-17T00:12:53.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.912+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/4000576393 wait complete. 2023-08-17T00:12:53.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.916+0000 7fc4ecfb9700 1 Processor -- start 2023-08-17T00:12:53.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.916+0000 7fc4ecfb9700 1 -- start start 2023-08-17T00:12:53.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4e8068f30 0x7fc4e814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 0x7fc4e80a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4e8150880 0x7fc4e80bf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e8152df0 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e80a5470 con 0x7fc4e8150880 2023-08-17T00:12:53.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e814f4b0 con 0x7fc4e8068f30 2023-08-17T00:12:53.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 0x7fc4e80a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 0x7fc4e80a3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35936/0 (socket says 172.21.15.153:35936) 2023-08-17T00:12:53.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 -- 172.21.15.153:0/2955340338 learned_addr learned my addr 172.21.15.153:0/2955340338 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:53.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e77fe700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4e8068f30 0x7fc4e814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e7fff700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4e8150880 0x7fc4e80bf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 -- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4e8068f30 msgr2=0x7fc4e814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4e8068f30 0x7fc4e814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 -- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4e8150880 msgr2=0x7fc4e80bf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4e8150880 0x7fc4e80bf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 -- 172.21.15.153:0/2955340338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0009ae0 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4e6ffd700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 0x7fc4e80a3870 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fc4dc007fd0 tx=0x7fc4dc007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc00ce10 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc0072e0 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e8152270 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc0056e0 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.920+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e81528b0 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.924+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e80a5690 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.924+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc4dc01a060 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.924+0000 7fc4cf7fe700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4d405a150 0x7fc4d405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:53.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.924+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fc4dc073810 con 0x7fc4e80aa8c0 2023-08-17T00:12:53.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.924+0000 7fc4e77fe700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4d405a150 0x7fc4d405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:53.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.928+0000 7fc4e77fe700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4d405a150 0x7fc4d405c610 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fc4d8007fd0 tx=0x7fc4d8007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:53.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:53.928+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc4e80a5690 con 0x7fc4e80aa8c0 2023-08-17T00:12:54.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.084+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc4e80a5690 con 0x7fc4e80aa8c0 2023-08-17T00:12:54.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.084+0000 7fc4cf7fe700 1 -- 172.21.15.153:0/2955340338 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v128) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc4e80a5690 con 0x7fc4e80aa8c0 2023-08-17T00:12:54.091 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:12:54.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4d405a150 msgr2=0x7fc4d405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4d405a150 0x7fc4d405c610 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fc4d8007fd0 tx=0x7fc4d8007d30).stop 2023-08-17T00:12:54.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 msgr2=0x7fc4e80a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 0x7fc4e80a3870 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7fc4dc007fd0 tx=0x7fc4dc007df0).stop 2023-08-17T00:12:54.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 shutdown_connections 2023-08-17T00:12:54.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc4d405a150 0x7fc4d405c610 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4e8150880 0x7fc4e80bf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc4e80aa8c0 0x7fc4e80a3870 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 --2- 172.21.15.153:0/2955340338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc4e8068f30 0x7fc4e814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 >> 172.21.15.153:0/2955340338 conn(0x7fc4e80c6620 msgr2=0x7fc4e80c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:54.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 shutdown_connections 2023-08-17T00:12:54.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.088+0000 7fc4ecfb9700 1 -- 172.21.15.153:0/2955340338 wait complete. 2023-08-17T00:12:54.114 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:12:54.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.272+0000 7f9b3afa9700 1 Processor -- start 2023-08-17T00:12:54.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.272+0000 7f9b3afa9700 1 -- start start 2023-08-17T00:12:54.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b3afa9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b340a8b70 0x7f9b340632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b3afa9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b340629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b3afa9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b34065240 con 0x7f9b340656d0 2023-08-17T00:12:54.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b3afa9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b34062ea0 con 0x7f9b340a8b70 2023-08-17T00:12:54.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b3afa9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340638a0 con 0x7f9b340a8f50 2023-08-17T00:12:54.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b340a8b70 0x7f9b340632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b340a8b70 0x7f9b340632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:35452/0 (socket says 172.21.15.153:35452) 2023-08-17T00:12:54.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 -- 172.21.15.153:0/1236412885 learned_addr learned my addr 172.21.15.153:0/1236412885 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:54.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b33fff700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b340629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 -- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 msgr2=0x7f9b340629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:54.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b340629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 -- 172.21.15.153:0/1236412885 >> v1:172.21.15.178:6789/0 conn(0x7f9b340656d0 legacy=0x7f9b340bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 -- 172.21.15.153:0/1236412885 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b34064910 con 0x7f9b340a8b70 2023-08-17T00:12:54.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b33fff700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b340629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:54.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b38d45700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340a8b70 0x7f9b340632e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f9b24006fd0 tx=0x7f9b240090f0).ready entity=mon.1 client_cookie=cd28012e462e4439 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:54.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b337fe700 1 -- 172.21.15.153:0/1236412885 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400b600 con 0x7f9b340a8b70 2023-08-17T00:12:54.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b337fe700 1 -- 172.21.15.153:0/1236412885 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2400b760 con 0x7f9b340a8b70 2023-08-17T00:12:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.276+0000 7f9b337fe700 1 -- 172.21.15.153:0/1236412885 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2400bae0 con 0x7f9b340a8b70 2023-08-17T00:12:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340a8b70 msgr2=0x7f9b340632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340a8b70 0x7f9b340632e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f9b24006fd0 tx=0x7f9b240090f0).stop 2023-08-17T00:12:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1236412885 shutdown_connections 2023-08-17T00:12:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b340629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1236412885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340a8b70 0x7f9b340632e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1236412885 >> 172.21.15.153:0/1236412885 conn(0x7f9b340c7150 msgr2=0x7f9b340c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1236412885 shutdown_connections 2023-08-17T00:12:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1236412885 wait complete. 2023-08-17T00:12:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 Processor -- start 2023-08-17T00:12:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- start start 2023-08-17T00:12:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340656d0 0x7f9b340ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 0x7f9b34168570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b34156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340ac640 con 0x7f9b340a8b70 2023-08-17T00:12:54.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340be1f0 con 0x7f9b340656d0 2023-08-17T00:12:54.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.280+0000 7f9b3afa9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b340be4d0 con 0x7f9b340a8f50 2023-08-17T00:12:54.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 0x7f9b34168570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 0x7f9b34168570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35946/0 (socket says 172.21.15.153:35946) 2023-08-17T00:12:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b38d45700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340656d0 0x7f9b340ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 -- 172.21.15.153:0/1534565415 learned_addr learned my addr 172.21.15.153:0/1534565415 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b39546700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b34156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 -- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 msgr2=0x7f9b34156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b34156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 -- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340656d0 msgr2=0x7f9b340ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340656d0 0x7f9b340ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 -- 172.21.15.153:0/1534565415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b24009370 con 0x7f9b340a8b70 2023-08-17T00:12:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b33fff700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 0x7f9b34168570 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f9b2800d890 tx=0x7f9b28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28011590 con 0x7f9b340a8b70 2023-08-17T00:12:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b280116f0 con 0x7f9b340a8b70 2023-08-17T00:12:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b340be7b0 con 0x7f9b340a8b70 2023-08-17T00:12:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b28011a70 con 0x7f9b340a8b70 2023-08-17T00:12:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.284+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b340bed70 con 0x7f9b340a8b70 2023-08-17T00:12:54.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.288+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b340c13e0 con 0x7f9b340a8b70 2023-08-17T00:12:54.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.288+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9b2801c460 con 0x7f9b340a8b70 2023-08-17T00:12:54.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.288+0000 7f9b30ff9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9b2005a150 0x7f9b2005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.288+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f9b28073f20 con 0x7f9b340a8b70 2023-08-17T00:12:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.288+0000 7f9b38d45700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9b2005a150 0x7f9b2005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.292+0000 7f9b38d45700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9b2005a150 0x7f9b2005c610 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9b24009130 tx=0x7f9b24017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.296+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9b280a28f0 con 0x7f9b340a8b70 2023-08-17T00:12:54.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.456+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9b34064bf0 con 0x7f9b340a8b70 2023-08-17T00:12:54.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.456+0000 7f9b30ff9700 1 -- 172.21.15.153:0/1534565415 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v128) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9b340c13e0 con 0x7f9b340a8b70 2023-08-17T00:12:54.461 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:12:54.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9b2005a150 msgr2=0x7f9b2005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9b2005a150 0x7f9b2005c610 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7f9b24009130 tx=0x7f9b24017000).stop 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 msgr2=0x7f9b34168570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 0x7f9b34168570 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 rx=0x7f9b2800d890 tx=0x7f9b28008040).stop 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 shutdown_connections 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9b2005a150 0x7f9b2005c610 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b340a8f50 0x7f9b34156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9b340a8b70 0x7f9b34168570 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 --2- 172.21.15.153:0/1534565415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b340656d0 0x7f9b340ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 >> 172.21.15.153:0/1534565415 conn(0x7f9b340c7150 msgr2=0x7f9b340c1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 shutdown_connections 2023-08-17T00:12:54.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.460+0000 7f9b3afa9700 1 -- 172.21.15.153:0/1534565415 wait complete. 2023-08-17T00:12:54.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:12:54.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.644+0000 7f0a6b59e700 1 Processor -- start 2023-08-17T00:12:54.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.644+0000 7f0a6b59e700 1 -- start start 2023-08-17T00:12:54.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a6b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a6b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a6c0c01a0 0x7f0a6c0c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a6b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a6c0bfd10 con 0x7f0a6c0c57a0 2023-08-17T00:12:54.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a6b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a6c154860 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a6b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c154af0 con 0x7f0a6c153f50 2023-08-17T00:12:54.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a69d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a69d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:53932/0 (socket says 172.21.15.153:53932) 2023-08-17T00:12:54.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a6ad9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0a6c0c01a0 0x7f0a6c0c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.648+0000 7f0a69d9b700 1 -- 172.21.15.153:0/4202378243 learned_addr learned my addr 172.21.15.153:0/4202378243 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:54.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6ad9d700 1 -- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 msgr2=0x7f0a6c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6ad9d700 1 --2- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6ad9d700 1 -- 172.21.15.153:0/4202378243 >> v1:172.21.15.178:6789/0 conn(0x7f0a6c0c57a0 legacy=0x7f0a6c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6ad9d700 1 -- 172.21.15.153:0/4202378243 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6c154dd0 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a69d9b700 1 --2- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6ad9d700 1 --2- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c0c0630 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f0a64009e60 tx=0x7f0a64009780).ready entity=mon.1 client_cookie=6e5099dfa20b9281 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6959a700 1 -- 172.21.15.153:0/4202378243 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6400e070 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6959a700 1 -- 172.21.15.153:0/4202378243 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6400bb60 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6959a700 1 -- 172.21.15.153:0/4202378243 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a64012410 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 -- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c01a0 msgr2=0x7f0a6c0c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c0c0630 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f0a64009e60 tx=0x7f0a64009780).stop 2023-08-17T00:12:54.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 -- 172.21.15.153:0/4202378243 shutdown_connections 2023-08-17T00:12:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c0c0630 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/4202378243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 -- 172.21.15.153:0/4202378243 >> 172.21.15.153:0/4202378243 conn(0x7f0a6c062a70 msgr2=0x7f0a6c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 -- 172.21.15.153:0/4202378243 shutdown_connections 2023-08-17T00:12:54.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.652+0000 7f0a6b59e700 1 -- 172.21.15.153:0/4202378243 wait complete. 2023-08-17T00:12:54.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 Processor -- start 2023-08-17T00:12:54.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 -- start start 2023-08-17T00:12:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c13efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c57a0 0x7f0a6c0c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c0c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c4100 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c43e0 con 0x7f0a6c0c57a0 2023-08-17T00:12:54.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6c0c46c0 con 0x7f0a6c153f50 2023-08-17T00:12:54.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c13efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a69d9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c57a0 0x7f0a6c0c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c13efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35956/0 (socket says 172.21.15.153:35956) 2023-08-17T00:12:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 -- 172.21.15.153:0/2572100182 learned_addr learned my addr 172.21.15.153:0/2572100182 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6ad9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c0c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 -- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 msgr2=0x7f0a6c0c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c0c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 -- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c57a0 msgr2=0x7f0a6c0c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c57a0 0x7f0a6c0c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 -- 172.21.15.153:0/2572100182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60009370 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.656+0000 7f0a6a59c700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c13efa0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f0a5c00c440 tx=0x7f0a5c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c007020 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c007180 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a64009a20 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c007520 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6c13f490 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6c165600 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.660+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0a5c010070 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.664+0000 7f0a5a7fc700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4c05a120 0x7f0a4c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:54.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.664+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f0a5c0732d0 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.664+0000 7f0a69d9b700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4c05a120 0x7f0a4c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:54.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.664+0000 7f0a69d9b700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4c05a120 0x7f0a4c05c5e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f0a6c153940 tx=0x7f0a600090f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:54.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.668+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0a5c046c50 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.828+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a6c06b4c0 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.828+0000 7f0a5a7fc700 1 -- 172.21.15.153:0/2572100182 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v128) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a5c04a270 con 0x7f0a6c0c01a0 2023-08-17T00:12:54.835 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:12:54.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4c05a120 msgr2=0x7f0a4c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4c05a120 0x7f0a4c05c5e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f0a6c153940 tx=0x7f0a600090f0).stop 2023-08-17T00:12:54.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 msgr2=0x7f0a6c13efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:54.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c13efa0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f0a5c00c440 tx=0x7f0a5c007e00).stop 2023-08-17T00:12:54.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 shutdown_connections 2023-08-17T00:12:54.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0a4c05a120 0x7f0a4c05c5e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0a6c153f50 0x7f0a6c0c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0a6c0c57a0 0x7f0a6c0c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 --2- 172.21.15.153:0/2572100182 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0a6c0c01a0 0x7f0a6c13efa0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:54.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 >> 172.21.15.153:0/2572100182 conn(0x7f0a6c062a70 msgr2=0x7f0a6c156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:54.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 shutdown_connections 2023-08-17T00:12:54.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:54.832+0000 7f0a6b59e700 1 -- 172.21.15.153:0/2572100182 wait complete. 2023-08-17T00:12:54.858 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:12:55.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.012+0000 7fe14b2db700 1 Processor -- start 2023-08-17T00:12:55.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.016+0000 7fe14b2db700 1 -- start start 2023-08-17T00:12:55.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.016+0000 7fe14b2db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144063fd0 0x7fe1440670a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.016+0000 7fe14b2db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe144067590 0x7fe1440c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.016+0000 7fe14b2db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1440c6150 con 0x7fe144153bb0 2023-08-17T00:12:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1440c3330 con 0x7fe144067590 2023-08-17T00:12:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440be7d0 con 0x7fe144063fd0 2023-08-17T00:12:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149077700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe144153bb0 0x7fe144066990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38788/0 (socket says 172.21.15.153:38788) 2023-08-17T00:12:55.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149077700 1 -- 172.21.15.153:0/2495377968 learned_addr learned my addr 172.21.15.153:0/2495377968 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:55.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149878700 1 --2- 172.21.15.153:0/2495377968 >> v2:172.21.15.153:3300/0 conn(0x7fe144067590 0x7fe1440c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe148876700 1 --2- 172.21.15.153:0/2495377968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144063fd0 0x7fe1440670a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149878700 1 -- 172.21.15.153:0/2495377968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144063fd0 msgr2=0x7fe1440670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149878700 1 --2- 172.21.15.153:0/2495377968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144063fd0 0x7fe1440670a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149878700 1 -- 172.21.15.153:0/2495377968 >> v1:172.21.15.153:6789/0 conn(0x7fe144153bb0 legacy=0x7fe144066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149878700 1 -- 172.21.15.153:0/2495377968 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe144064d40 con 0x7fe144067590 2023-08-17T00:12:55.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe13bfff700 1 -- 172.21.15.153:0/2495377968 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840552081 0 0) 0x7fe1440c6150 con 0x7fe144153bb0 2023-08-17T00:12:55.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe149878700 1 --2- 172.21.15.153:0/2495377968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c37c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7fe13c009e60 tx=0x7fe13c009780).ready entity=mon.0 client_cookie=4894222f48513fa1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe13bfff700 1 -- 172.21.15.153:0/2495377968 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c00e070 con 0x7fe144067590 2023-08-17T00:12:55.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe13bfff700 1 -- 172.21.15.153:0/2495377968 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c00bc30 con 0x7fe144067590 2023-08-17T00:12:55.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe13bfff700 1 -- 172.21.15.153:0/2495377968 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c012410 con 0x7fe144067590 2023-08-17T00:12:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- 172.21.15.153:0/2495377968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 msgr2=0x7fe1440c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 --2- 172.21.15.153:0/2495377968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c37c0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7fe13c009e60 tx=0x7fe13c009780).stop 2023-08-17T00:12:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- 172.21.15.153:0/2495377968 shutdown_connections 2023-08-17T00:12:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 --2- 172.21.15.153:0/2495377968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c37c0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 --2- 172.21.15.153:0/2495377968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144063fd0 0x7fe1440670a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- 172.21.15.153:0/2495377968 >> 172.21.15.153:0/2495377968 conn(0x7fe1440c92e0 msgr2=0x7fe1440c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:55.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- 172.21.15.153:0/2495377968 shutdown_connections 2023-08-17T00:12:55.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.020+0000 7fe14b2db700 1 -- 172.21.15.153:0/2495377968 wait complete. 2023-08-17T00:12:55.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.024+0000 7fe14b2db700 1 Processor -- start 2023-08-17T00:12:55.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.024+0000 7fe14b2db700 1 -- start start 2023-08-17T00:12:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe144063fd0 0x7fe1440c16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144153bb0 0x7fe1441422d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440c1ca0 con 0x7fe144067590 2023-08-17T00:12:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440c1f80 con 0x7fe144063fd0 2023-08-17T00:12:55.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1440c2260 con 0x7fe144153bb0 2023-08-17T00:12:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47460/0 (socket says 172.21.15.153:47460) 2023-08-17T00:12:55.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 -- 172.21.15.153:0/3144312781 learned_addr learned my addr 172.21.15.153:0/3144312781 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe149077700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe144063fd0 0x7fe1440c16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe149878700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144153bb0 0x7fe1441422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 -- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144153bb0 msgr2=0x7fe1441422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144153bb0 0x7fe1441422d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 -- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe144063fd0 msgr2=0x7fe1440c16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe144063fd0 0x7fe1440c16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 -- 172.21.15.153:0/3144312781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c009a20 con 0x7fe144067590 2023-08-17T00:12:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe148876700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c0ef0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fe13400d860 tx=0x7fe134008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134011590 con 0x7fe144067590 2023-08-17T00:12:55.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1340116f0 con 0x7fe144067590 2023-08-17T00:12:55.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1440c2540 con 0x7fe144067590 2023-08-17T00:12:55.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe134011a90 con 0x7fe144067590 2023-08-17T00:12:55.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.028+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1441427c0 con 0x7fe144067590 2023-08-17T00:12:55.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.032+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14406b530 con 0x7fe144067590 2023-08-17T00:12:55.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.032+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe134012420 con 0x7fe144067590 2023-08-17T00:12:55.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.032+0000 7fe1397fa700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe12805a180 0x7fe12805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.032+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fe134073bd0 con 0x7fe144067590 2023-08-17T00:12:55.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.036+0000 7fe149077700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe12805a180 0x7fe12805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.036+0000 7fe149077700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe12805a180 0x7fe12805c640 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fe140007fd0 tx=0x7fe140007dd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.040+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe1340474f0 con 0x7fe144067590 2023-08-17T00:12:55.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.200+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe1440644a0 con 0x7fe144067590 2023-08-17T00:12:55.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe1397fa700 1 -- 172.21.15.153:0/3144312781 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v128) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe13404ab10 con 0x7fe144067590 2023-08-17T00:12:55.209 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:12:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe12805a180 msgr2=0x7fe12805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe12805a180 0x7fe12805c640 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fe140007fd0 tx=0x7fe140007dd0).stop 2023-08-17T00:12:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 msgr2=0x7fe1440c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c0ef0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7fe13400d860 tx=0x7fe134008040).stop 2023-08-17T00:12:55.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 shutdown_connections 2023-08-17T00:12:55.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe12805a180 0x7fe12805c640 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe144153bb0 0x7fe1441422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe144067590 0x7fe1440c0ef0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 --2- 172.21.15.153:0/3144312781 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe144063fd0 0x7fe1440c16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 >> 172.21.15.153:0/3144312781 conn(0x7fe1440c92e0 msgr2=0x7fe1440c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:55.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 shutdown_connections 2023-08-17T00:12:55.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.204+0000 7fe14b2db700 1 -- 172.21.15.153:0/3144312781 wait complete. 2023-08-17T00:12:55.234 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:55.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2759e700 1 Processor -- start 2023-08-17T00:12:55.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2759e700 1 -- start start 2023-08-17T00:12:55.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28065da0 con 0x7fda28151530 2023-08-17T00:12:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28155c60 con 0x7fda281560f0 2023-08-17T00:12:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28156550 con 0x7fda280689c0 2023-08-17T00:12:55.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda26d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fda28151530 0x7fda281519e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38804/0 (socket says 172.21.15.153:38804) 2023-08-17T00:12:55.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda26d9d700 1 -- 172.21.15.153:0/669509360 learned_addr learned my addr 172.21.15.153:0/669509360 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:55.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2659c700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051656797 0 0) 0x7fda28065da0 con 0x7fda28151530 2023-08-17T00:12:55.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda100033f0 con 0x7fda28151530 2023-08-17T00:12:55.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.384+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223212994 0 0) 0x7fda28155c60 con 0x7fda281560f0 2023-08-17T00:12:55.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda28065da0 con 0x7fda281560f0 2023-08-17T00:12:55.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458399450 0 0) 0x7fda100033f0 con 0x7fda28151530 2023-08-17T00:12:55.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 msgr2=0x7fda28068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 >> v1:172.21.15.178:6789/0 conn(0x7fda281560f0 legacy=0x7fda280c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28065ff0 con 0x7fda28151530 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fda200017f0 con 0x7fda28151530 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 >> v1:172.21.15.153:6789/0 conn(0x7fda28151530 legacy=0x7fda281519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda10003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10003fb0 0x7fda10004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda10004b80 0x7fda10005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28156550 con 0x7fda10004b80 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1000b9f0 con 0x7fda10003fb0 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1000bbb0 con 0x7fda280689c0 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda10003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda26d9d700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda10004b80 0x7fda10005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda25d9b700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10003fb0 0x7fda10004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 -- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10003fb0 msgr2=0x7fda10004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda10003fb0 0x7fda10004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 -- 172.21.15.153:0/669509360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda10004b80 msgr2=0x7fda10005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda10004b80 0x7fda10005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 -- 172.21.15.153:0/669509360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda100033f0 con 0x7fda280689c0 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda26d9d700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda10004b80 0x7fda10005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:55.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2659c700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda10003aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fda18006f10 tx=0x7fda18006f40).ready entity=mon.2 client_cookie=3f8ff8b08be13aaa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18009430 con 0x7fda280689c0 2023-08-17T00:12:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800e460 con 0x7fda280689c0 2023-08-17T00:12:55.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2559a700 1 -- 172.21.15.153:0/669509360 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800e7e0 con 0x7fda280689c0 2023-08-17T00:12:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2759e700 1 -- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 msgr2=0x7fda10003aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2759e700 1 --2- 172.21.15.153:0/669509360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda10003aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fda18006f10 tx=0x7fda18006f40).stop 2023-08-17T00:12:55.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda26d9d700 1 -- 172.21.15.153:0/669509360 reap_dead start 2023-08-17T00:12:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.388+0000 7fda2759e700 1 -- 172.21.15.153:0/669509360 shutdown_connections 2023-08-17T00:12:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.392+0000 7fda2759e700 1 -- 172.21.15.153:0/669509360 >> 172.21.15.153:0/669509360 conn(0x7fda280c6620 msgr2=0x7fda280c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.392+0000 7fda2759e700 1 -- 172.21.15.153:0/669509360 shutdown_connections 2023-08-17T00:12:55.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.392+0000 7fda2759e700 1 -- 172.21.15.153:0/669509360 wait complete. 2023-08-17T00:12:55.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.392+0000 7fda2759e700 1 Processor -- start 2023-08-17T00:12:55.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.392+0000 7fda2759e700 1 -- start start 2023-08-17T00:12:55.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 0x7fda280c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda280bf160 0x7fda280bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280be5b0 con 0x7fda280c3000 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda280baa10 con 0x7fda280bf160 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28141080 con 0x7fda280689c0 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 0x7fda280c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 0x7fda280c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47486/0 (socket says 172.21.15.153:47486) 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 -- 172.21.15.153:0/1927074269 learned_addr learned my addr 172.21.15.153:0/1927074269 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2659c700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda26d9d700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda280bf160 0x7fda280bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 -- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 msgr2=0x7fda28140b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28140b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 -- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda280bf160 msgr2=0x7fda280bf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda280bf160 0x7fda280bf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 -- 172.21.15.153:0/1927074269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280bd5a0 con 0x7fda280c3000 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda25d9b700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 0x7fda280c3480 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fda1c002a50 tx=0x7fda1c007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c002e30 con 0x7fda280c3000 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00f8d0 con 0x7fda280c3000 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda280be120 con 0x7fda280c3000 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00fc70 con 0x7fda280c3000 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280bd7f0 con 0x7fda280c3000 2023-08-17T00:12:55.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.396+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda280be2b0 con 0x7fda280c3000 2023-08-17T00:12:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.400+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fda1c01b030 con 0x7fda280c3000 2023-08-17T00:12:55.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.400+0000 7fda167fc700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0805a180 0x7fda0805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.400+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7fda1c073fe0 con 0x7fda280c3000 2023-08-17T00:12:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.400+0000 7fda2659c700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0805a180 0x7fda0805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.400+0000 7fda2659c700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0805a180 0x7fda0805c640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fda18006fa0 tx=0x7fda1801a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.408+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda1c047960 con 0x7fda280c3000 2023-08-17T00:12:55.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.600+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda280662d0 con 0x7fda280c3000 2023-08-17T00:12:55.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.604+0000 7fda167fc700 1 -- 172.21.15.153:0/1927074269 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7fda1c04af80 con 0x7fda280c3000 2023-08-17T00:12:55.609 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:55.609 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:55.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0805a180 msgr2=0x7fda0805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0805a180 0x7fda0805c640 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fda18006fa0 tx=0x7fda1801a000).stop 2023-08-17T00:12:55.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 msgr2=0x7fda280c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 0x7fda280c3480 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7fda1c002a50 tx=0x7fda1c007bb0).stop 2023-08-17T00:12:55.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 shutdown_connections 2023-08-17T00:12:55.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0805a180 0x7fda0805c640 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda280bf160 0x7fda280bf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda280c3000 0x7fda280c3480 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 --2- 172.21.15.153:0/1927074269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda280689c0 0x7fda28140b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 >> 172.21.15.153:0/1927074269 conn(0x7fda280c6620 msgr2=0x7fda28150c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:55.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 shutdown_connections 2023-08-17T00:12:55.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.608+0000 7fda2759e700 1 -- 172.21.15.153:0/1927074269 wait complete. 2023-08-17T00:12:55.617 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:55.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:55.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 Processor -- start 2023-08-17T00:12:55.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 -- start start 2023-08-17T00:12:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f73f4153ab0 0x7f73f4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 0x7f73f40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f40aa750 con 0x7f73f40c8d50 2023-08-17T00:12:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f40c9dd0 con 0x7f73f4153ab0 2023-08-17T00:12:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73fb11b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40aacf0 con 0x7f73f40c7ba0 2023-08-17T00:12:55.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73f3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f73f40c8d50 0x7f73f40c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38816/0 (socket says 172.21.15.153:38816) 2023-08-17T00:12:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.788+0000 7f73f3fff700 1 -- 172.21.15.153:0/80191389 learned_addr learned my addr 172.21.15.153:0/80191389 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309432916 0 0) 0x7f73f40aa750 con 0x7f73f40c8d50 2023-08-17T00:12:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f8eb7700 1 --2- 172.21.15.153:0/80191389 >> v2:172.21.15.178:3300/0 conn(0x7f73f4153ab0 0x7f73f4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 0x7f73f40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e40033f0 con 0x7f73f40c8d50 2023-08-17T00:12:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124156045 0 0) 0x7f73e40033f0 con 0x7f73f40c8d50 2023-08-17T00:12:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 msgr2=0x7f73f40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 0x7f73f40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 >> v2:172.21.15.178:3300/0 conn(0x7f73f4153ab0 msgr2=0x7f73f4153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 --2- 172.21.15.153:0/80191389 >> v2:172.21.15.178:3300/0 conn(0x7f73f4153ab0 0x7f73f4153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f40c5ca0 con 0x7f73f40c8d50 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f73e0001490 con 0x7f73f40c8d50 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 >> v1:172.21.15.153:6789/0 conn(0x7f73f40c8d50 legacy=0x7f73f40c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40038e0 0x7f73e4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 0x7f73e4004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e4004b80 0x7f73e4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40c9dd0 con 0x7f73e4004b80 2023-08-17T00:12:55.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40aacf0 con 0x7f73e40038e0 2023-08-17T00:12:55.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e400b8e0 con 0x7f73f40c7ba0 2023-08-17T00:12:55.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e4004b80 0x7f73e4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f8eb7700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40038e0 0x7f73e4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f3fff700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 0x7f73e4004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 -- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 msgr2=0x7f73e4004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f40c7ba0 0x7f73e4004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 -- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40038e0 msgr2=0x7f73e4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e40038e0 0x7f73e4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 -- 172.21.15.153:0/80191389 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40033f0 con 0x7f73e4004b80 2023-08-17T00:12:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f96b8700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e4004b80 0x7f73e4005000 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f73ec00e210 tx=0x7f73ec00b040).ready entity=mon.0 client_cookie=f049b81cae899659 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec009ac0 con 0x7f73e4004b80 2023-08-17T00:12:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73ec00f040 con 0x7f73e4004b80 2023-08-17T00:12:55.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73f37fe700 1 -- 172.21.15.153:0/80191389 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00ecd0 con 0x7f73e4004b80 2023-08-17T00:12:55.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73fb11b700 1 -- 172.21.15.153:0/80191389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e4004b80 msgr2=0x7f73e4005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.792+0000 7f73fb11b700 1 --2- 172.21.15.153:0/80191389 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73e4004b80 0x7f73e4005000 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 rx=0x7f73ec00e210 tx=0x7f73ec00b040).stop 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73f96b8700 1 -- 172.21.15.153:0/80191389 reap_dead start 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73fb11b700 1 -- 172.21.15.153:0/80191389 shutdown_connections 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73fb11b700 1 -- 172.21.15.153:0/80191389 >> 172.21.15.153:0/80191389 conn(0x7f73f4061fa0 msgr2=0x7f73f40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73fb11b700 1 -- 172.21.15.153:0/80191389 shutdown_connections 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73fb11b700 1 -- 172.21.15.153:0/80191389 wait complete. 2023-08-17T00:12:55.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73fb11b700 1 Processor -- start 2023-08-17T00:12:55.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.796+0000 7f73fb11b700 1 -- start start 2023-08-17T00:12:55.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 0x7f73f414f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f4154c40 0x7f73f40bf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 0x7f73f40bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f414f7c0 con 0x7f73f41550c0 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f40c03a0 con 0x7f73e4004b80 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f41673a0 con 0x7f73f4154c40 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f96b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 0x7f73f40bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 0x7f73f414f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 0x7f73f414f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:40124/0 (socket says 172.21.15.153:40124) 2023-08-17T00:12:55.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 -- 172.21.15.153:0/3793656616 learned_addr learned my addr 172.21.15.153:0/3793656616 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f96b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 0x7f73f40bfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47498/0 (socket says 172.21.15.153:47498) 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f3fff700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f4154c40 0x7f73f40bf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 -- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f4154c40 msgr2=0x7f73f40bf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f4154c40 0x7f73f40bf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 -- 172.21.15.153:0/3793656616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 msgr2=0x7f73f40bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 0x7f73f40bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 -- 172.21.15.153:0/3793656616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4167f20 con 0x7f73e4004b80 2023-08-17T00:12:55.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f96b8700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 0x7f73f40bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:55.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f8eb7700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 0x7f73f414f2d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f73e80119f0 tx=0x7f73e8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800f6e0 con 0x7f73e4004b80 2023-08-17T00:12:55.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e800f840 con 0x7f73e4004b80 2023-08-17T00:12:55.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f41675f0 con 0x7f73e4004b80 2023-08-17T00:12:55.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.800+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e800fbc0 con 0x7f73e4004b80 2023-08-17T00:12:55.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.804+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f4167bb0 con 0x7f73e4004b80 2023-08-17T00:12:55.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.804+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f406b530 con 0x7f73e4004b80 2023-08-17T00:12:55.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.804+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f73e8014440 con 0x7f73e4004b80 2023-08-17T00:12:55.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.808+0000 7f73f0ff9700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73d805a150 0x7f73d805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:55.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.808+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f73e80749e0 con 0x7f73e4004b80 2023-08-17T00:12:55.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.808+0000 7f73f3fff700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73d805a150 0x7f73d805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:55.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.808+0000 7f73f3fff700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73d805a150 0x7f73d805c610 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f73f4156810 tx=0x7f73e0007040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:55.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.812+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f73e8048300 con 0x7f73e4004b80 2023-08-17T00:12:55.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.976+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73f40c9810 con 0x7f73e4004b80 2023-08-17T00:12:55.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.980+0000 7f73f0ff9700 1 -- 172.21.15.153:0/3793656616 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+17040 (secure 0 0 0) 0x7f73e804b920 con 0x7f73e4004b80 2023-08-17T00:12:55.985 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:55.986 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":128,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:41.469781+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:12:02.859311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T00:12:03.866983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.21","mappings":[{"from":6,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:55.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73d805a150 msgr2=0x7f73d805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73d805a150 0x7f73d805c610 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f73f4156810 tx=0x7f73e0007040).stop 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 msgr2=0x7f73f414f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 0x7f73f414f2d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f73e80119f0 tx=0x7f73e8009060).stop 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 shutdown_connections 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f73d805a150 0x7f73d805c610 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f73f41550c0 0x7f73f40bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73f4154c40 0x7f73f40bf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 --2- 172.21.15.153:0/3793656616 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73e4004b80 0x7f73f414f2d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 >> 172.21.15.153:0/3793656616 conn(0x7f73f4061fa0 msgr2=0x7f73f40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 shutdown_connections 2023-08-17T00:12:55.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:55.984+0000 7f73fb11b700 1 -- 172.21.15.153:0/3793656616 wait complete. 2023-08-17T00:12:56.013 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:12:56.013 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.164+0000 7f421ce5b700 1 Processor -- start 2023-08-17T00:12:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.164+0000 7f421ce5b700 1 -- start start 2023-08-17T00:12:56.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f421ce5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42180bcd00 0x7f421815b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f421ce5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180a9170 con 0x7f421814fff0 2023-08-17T00:12:56.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f421ce5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180c1b90 con 0x7f4218153da0 2023-08-17T00:12:56.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f421ce5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4218154280 con 0x7f42180bcd00 2023-08-17T00:12:56.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f421659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f421814fff0 0x7f4218062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38820/0 (socket says 172.21.15.153:38820) 2023-08-17T00:12:56.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f421659c700 1 -- 172.21.15.153:0/2371653237 learned_addr learned my addr 172.21.15.153:0/2371653237 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4216d9d700 1 --2- 172.21.15.153:0/2371653237 >> v2:172.21.15.178:3300/0 conn(0x7f42180bcd00 0x7f421815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267219578 0 0) 0x7f42180a9170 con 0x7f421814fff0 2023-08-17T00:12:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42040033f0 con 0x7f421814fff0 2023-08-17T00:12:56.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3780648524 0 0) 0x7f42180c1b90 con 0x7f4218153da0 2023-08-17T00:12:56.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42180a9170 con 0x7f4218153da0 2023-08-17T00:12:56.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4216d9d700 1 -- 172.21.15.153:0/2371653237 >> v1:172.21.15.178:6789/0 conn(0x7f4218153da0 legacy=0x7f42180bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4216d9d700 1 -- 172.21.15.153:0/2371653237 >> v1:172.21.15.153:6789/0 conn(0x7f421814fff0 legacy=0x7f4218062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4216d9d700 1 -- 172.21.15.153:0/2371653237 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218154560 con 0x7f42180bcd00 2023-08-17T00:12:56.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4216d9d700 1 --2- 172.21.15.153:0/2371653237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f421815b140 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f4210009e60 tx=0x7f4210009780).ready entity=mon.1 client_cookie=f29dc4005ceab4a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000bab0 con 0x7f42180bcd00 2023-08-17T00:12:56.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421000bc10 con 0x7f42180bcd00 2023-08-17T00:12:56.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.168+0000 7f4215d9b700 1 -- 172.21.15.153:0/2371653237 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210010480 con 0x7f42180bcd00 2023-08-17T00:12:56.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- 172.21.15.153:0/2371653237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 msgr2=0x7f421815b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 --2- 172.21.15.153:0/2371653237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f421815b140 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f4210009e60 tx=0x7f4210009780).stop 2023-08-17T00:12:56.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- 172.21.15.153:0/2371653237 shutdown_connections 2023-08-17T00:12:56.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 --2- 172.21.15.153:0/2371653237 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f421815b140 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- 172.21.15.153:0/2371653237 >> 172.21.15.153:0/2371653237 conn(0x7f42180c7150 msgr2=0x7f42180c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:56.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- 172.21.15.153:0/2371653237 shutdown_connections 2023-08-17T00:12:56.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- 172.21.15.153:0/2371653237 wait complete. 2023-08-17T00:12:56.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 Processor -- start 2023-08-17T00:12:56.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- start start 2023-08-17T00:12:56.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f42180aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f421814fff0 0x7f42180aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 0x7f421815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4218153bc0 con 0x7f4218153da0 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180abfb0 con 0x7f42180bcd00 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.172+0000 7f421ce5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f421814c670 con 0x7f421814fff0 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 0x7f421815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 0x7f421815fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47504/0 (socket says 172.21.15.153:47504) 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 -- 172.21.15.153:0/3698450632 learned_addr learned my addr 172.21.15.153:0/3698450632 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f421659c700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f42180aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f420dd9b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f421814fff0 0x7f42180aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 -- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f421814fff0 msgr2=0x7f42180aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f421814fff0 0x7f42180aaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 -- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 msgr2=0x7f42180aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f42180aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 -- 172.21.15.153:0/3698450632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4210009a20 con 0x7f4218153da0 2023-08-17T00:12:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f4216d9d700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 0x7f421815fe60 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f4210013000 tx=0x7f4210009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210020070 con 0x7f4218153da0 2023-08-17T00:12:56.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4210019660 con 0x7f4218153da0 2023-08-17T00:12:56.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42180ab710 con 0x7f4218153da0 2023-08-17T00:12:56.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000bab0 con 0x7f4218153da0 2023-08-17T00:12:56.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.176+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42180abcd0 con 0x7f4218153da0 2023-08-17T00:12:56.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.180+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f421806b530 con 0x7f4218153da0 2023-08-17T00:12:56.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.180+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f421002c070 con 0x7f4218153da0 2023-08-17T00:12:56.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.180+0000 7f420effd700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.180+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f4210077a70 con 0x7f4218153da0 2023-08-17T00:12:56.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.180+0000 7f421659c700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.184+0000 7f421659c700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f4208007fd0 tx=0x7f4208009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.188+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f421004b3f0 con 0x7f4218153da0 2023-08-17T00:12:56.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.380+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f421814c7b0 con 0x7f4218153da0 2023-08-17T00:12:56.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.380+0000 7f420effd700 1 -- 172.21.15.153:0/3698450632 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f421002a070 con 0x7f4218153da0 2023-08-17T00:12:56.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:56.387 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 msgr2=0x7f41f805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f4208007fd0 tx=0x7f4208009040).stop 2023-08-17T00:12:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 msgr2=0x7f421815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 0x7f421815fe60 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f4210013000 tx=0x7f4210009780).stop 2023-08-17T00:12:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 shutdown_connections 2023-08-17T00:12:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4218153da0 0x7f421815fe60 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f421814fff0 0x7f42180aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 --2- 172.21.15.153:0/3698450632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42180bcd00 0x7f42180aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 >> 172.21.15.153:0/3698450632 conn(0x7f42180c7150 msgr2=0x7f42180c55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 shutdown_connections 2023-08-17T00:12:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.384+0000 7f421ce5b700 1 -- 172.21.15.153:0/3698450632 wait complete. 2023-08-17T00:12:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:56.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:12:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.548+0000 7f8a4181b700 1 Processor -- start 2023-08-17T00:12:56.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a4181b700 1 -- start start 2023-08-17T00:12:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a4181b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a3c151a10 0x7f8a3c0bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a4181b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8a3c066130 0x7f8a3c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a4181b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3c062c90 con 0x7f8a3c151630 2023-08-17T00:12:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a4181b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0657d0 con 0x7f8a3c151a10 2023-08-17T00:12:56.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a4181b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c0665e0 con 0x7f8a3c066130 2023-08-17T00:12:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a3c151a10 0x7f8a3c0bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8a3c151a10 0x7f8a3c0bbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47506/0 (socket says 172.21.15.153:47506) 2023-08-17T00:12:56.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 -- 172.21.15.153:0/2674056031 learned_addr learned my addr 172.21.15.153:0/2674056031 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:56.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a3b7fe700 1 --2- 172.21.15.153:0/2674056031 >> v2:172.21.15.178:3300/0 conn(0x7f8a3c066130 0x7f8a3c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 -- 172.21.15.153:0/2674056031 >> v2:172.21.15.178:3300/0 conn(0x7f8a3c066130 msgr2=0x7f8a3c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:56.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 --2- 172.21.15.153:0/2674056031 >> v2:172.21.15.178:3300/0 conn(0x7f8a3c066130 0x7f8a3c1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a3a7fc700 1 -- 172.21.15.153:0/2674056031 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057485505 0 0) 0x7f8a3c062c90 con 0x7f8a3c151630 2023-08-17T00:12:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 -- 172.21.15.153:0/2674056031 >> v1:172.21.15.178:6789/0 conn(0x7f8a3c151630 legacy=0x7f8a3c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.552+0000 7f8a327fc700 1 -- 172.21.15.153:0/2674056031 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c062980 con 0x7f8a3c151a10 2023-08-17T00:12:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a327fc700 1 --2- 172.21.15.153:0/2674056031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c151a10 0x7f8a3c0bbd50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f8a3c069e50 tx=0x7f8a240090f0).ready entity=mon.0 client_cookie=c73fa55baa06fbd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a3a7fc700 1 -- 172.21.15.153:0/2674056031 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400b520 con 0x7f8a3c151a10 2023-08-17T00:12:56.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a3a7fc700 1 -- 172.21.15.153:0/2674056031 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2400b680 con 0x7f8a3c151a10 2023-08-17T00:12:56.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a3a7fc700 1 -- 172.21.15.153:0/2674056031 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2400ba20 con 0x7f8a3c151a10 2023-08-17T00:12:56.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 -- 172.21.15.153:0/2674056031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c151a10 msgr2=0x7f8a3c0bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 --2- 172.21.15.153:0/2674056031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c151a10 0x7f8a3c0bbd50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 rx=0x7f8a3c069e50 tx=0x7f8a240090f0).stop 2023-08-17T00:12:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 -- 172.21.15.153:0/2674056031 shutdown_connections 2023-08-17T00:12:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 --2- 172.21.15.153:0/2674056031 >> v2:172.21.15.178:3300/0 conn(0x7f8a3c066130 0x7f8a3c1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 --2- 172.21.15.153:0/2674056031 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c151a10 0x7f8a3c0bbd50 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 -- 172.21.15.153:0/2674056031 >> 172.21.15.153:0/2674056031 conn(0x7f8a3c0c2fb0 msgr2=0x7f8a3c0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 -- 172.21.15.153:0/2674056031 shutdown_connections 2023-08-17T00:12:56.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.556+0000 7f8a4181b700 1 -- 172.21.15.153:0/2674056031 wait complete. 2023-08-17T00:12:56.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 Processor -- start 2023-08-17T00:12:56.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 -- start start 2023-08-17T00:12:56.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 0x7f8a3c149120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a3c151630 0x7f8a3c0a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a3c151a10 0x7f8a3c0a69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0a6ed0 con 0x7f8a3c066130 2023-08-17T00:12:56.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c150b70 con 0x7f8a3c151630 2023-08-17T00:12:56.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a4181b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0aae40 con 0x7f8a3c151a10 2023-08-17T00:12:56.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 0x7f8a3c149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 0x7f8a3c149120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47520/0 (socket says 172.21.15.153:47520) 2023-08-17T00:12:56.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 -- 172.21.15.153:0/1153729002 learned_addr learned my addr 172.21.15.153:0/1153729002 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:56.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a327fc700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a3c151630 0x7f8a3c0a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3b7fe700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a3c151a10 0x7f8a3c0a69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 -- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a3c151a10 msgr2=0x7f8a3c0a69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a3c151a10 0x7f8a3c0a69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 -- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a3c151630 msgr2=0x7f8a3c0a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a3c151630 0x7f8a3c0a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 -- 172.21.15.153:0/1153729002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24009370 con 0x7f8a3c066130 2023-08-17T00:12:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.560+0000 7f8a3affd700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 0x7f8a3c149120 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f8a2c007fd0 tx=0x7f8a2c007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00ce10 con 0x7f8a3c066130 2023-08-17T00:12:56.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00f470 con 0x7f8a3c066130 2023-08-17T00:12:56.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c0aa510 con 0x7f8a3c066130 2023-08-17T00:12:56.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00f830 con 0x7f8a3c066130 2023-08-17T00:12:56.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c0aaad0 con 0x7f8a3c066130 2023-08-17T00:12:56.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c06b4c0 con 0x7f8a3c066130 2023-08-17T00:12:56.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.564+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8a2c019030 con 0x7f8a3c066130 2023-08-17T00:12:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.568+0000 7f8a337fe700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2005a150 0x7f8a2005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.568+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f8a2c073450 con 0x7f8a3c066130 2023-08-17T00:12:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.568+0000 7f8a327fc700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2005a150 0x7f8a2005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.568+0000 7f8a327fc700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2005a150 0x7f8a2005c610 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f8a2400b2e0 tx=0x7f8a24017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.572+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a2c046e80 con 0x7f8a3c066130 2023-08-17T00:12:56.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.768+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a3c065a20 con 0x7f8a3c066130 2023-08-17T00:12:56.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.768+0000 7f8a337fe700 1 -- 172.21.15.153:0/1153729002 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4496 (secure 0 0 0) 0x7f8a2c04a4a0 con 0x7f8a3c066130 2023-08-17T00:12:56.776 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:56.776 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:12:04.855169+0000","modified":"2023-08-17T00:12:08.286701+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7947},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7947":{"gid":7947,"name":"a","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/264350329","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":264350329},{"type":"v1","addr":"172.21.15.153:6835","nonce":264350329}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-08-17T00:12:56.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2005a150 msgr2=0x7f8a2005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2005a150 0x7f8a2005c610 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f8a2400b2e0 tx=0x7f8a24017000).stop 2023-08-17T00:12:56.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 msgr2=0x7f8a3c149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 0x7f8a3c149120 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f8a2c007fd0 tx=0x7f8a2c007c20).stop 2023-08-17T00:12:56.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 shutdown_connections 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a2005a150 0x7f8a2005c610 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a3c151a10 0x7f8a3c0a69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a3c151630 0x7f8a3c0a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 --2- 172.21.15.153:0/1153729002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a3c066130 0x7f8a3c149120 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 >> 172.21.15.153:0/1153729002 conn(0x7f8a3c0c2fb0 msgr2=0x7f8a3c14c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 shutdown_connections 2023-08-17T00:12:56.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.772+0000 7f8a4181b700 1 -- 172.21.15.153:0/1153729002 wait complete. 2023-08-17T00:12:56.781 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 101 2023-08-17T00:12:56.798 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:12:56.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 Processor -- start 2023-08-17T00:12:56.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 -- start start 2023-08-17T00:12:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153780 0x7f89e0066be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89e0153b60 0x7f89e01549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e00c8790 con 0x7f89e00c7800 2023-08-17T00:12:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e0158160 con 0x7f89e0153b60 2023-08-17T00:12:56.961 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.952+0000 7f89e569b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e0154eb0 con 0x7f89e0153780 2023-08-17T00:12:56.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89deffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153780 0x7f89e0066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89dffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f89e00c7800 0x7f89e00c66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42928/0 (socket says 172.21.15.153:42928) 2023-08-17T00:12:56.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89dffff700 1 -- 172.21.15.153:0/4124667819 learned_addr learned my addr 172.21.15.153:0/4124667819 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:56.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89de7fc700 1 --2- 172.21.15.153:0/4124667819 >> v2:172.21.15.178:3300/0 conn(0x7f89e0153b60 0x7f89e01549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89ddffb700 1 -- 172.21.15.153:0/4124667819 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065233286 0 0) 0x7f89e00c8790 con 0x7f89e00c7800 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89ddffb700 1 -- 172.21.15.153:0/4124667819 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c80033f0 con 0x7f89e00c7800 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89deffd700 1 -- 172.21.15.153:0/4124667819 >> v2:172.21.15.178:3300/0 conn(0x7f89e0153b60 msgr2=0x7f89e01549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89deffd700 1 --2- 172.21.15.153:0/4124667819 >> v2:172.21.15.178:3300/0 conn(0x7f89e0153b60 0x7f89e01549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89deffd700 1 -- 172.21.15.153:0/4124667819 >> v1:172.21.15.178:6789/0 conn(0x7f89e00c7800 legacy=0x7f89e00c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89deffd700 1 -- 172.21.15.153:0/4124667819 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e0157550 con 0x7f89e0153780 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89deffd700 1 --2- 172.21.15.153:0/4124667819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153780 0x7f89e0066be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f89d0009760 tx=0x7f89d0009060).ready entity=mon.2 client_cookie=2473e37656e5cacc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89ddffb700 1 -- 172.21.15.153:0/4124667819 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0009120 con 0x7f89e0153780 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89ddffb700 1 -- 172.21.15.153:0/4124667819 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d000d4a0 con 0x7f89e0153780 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89ddffb700 1 -- 172.21.15.153:0/4124667819 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d000d820 con 0x7f89e0153780 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 -- 172.21.15.153:0/4124667819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153780 msgr2=0x7f89e0066be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 --2- 172.21.15.153:0/4124667819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153780 0x7f89e0066be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f89d0009760 tx=0x7f89d0009060).stop 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 -- 172.21.15.153:0/4124667819 shutdown_connections 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 --2- 172.21.15.153:0/4124667819 >> v2:172.21.15.178:3300/0 conn(0x7f89e0153b60 0x7f89e01549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 --2- 172.21.15.153:0/4124667819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153780 0x7f89e0066be0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 -- 172.21.15.153:0/4124667819 >> 172.21.15.153:0/4124667819 conn(0x7f89e00c9630 msgr2=0x7f89e0065f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 -- 172.21.15.153:0/4124667819 shutdown_connections 2023-08-17T00:12:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.956+0000 7f89e569b700 1 -- 172.21.15.153:0/4124667819 wait complete. 2023-08-17T00:12:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.960+0000 7f89e569b700 1 Processor -- start 2023-08-17T00:12:56.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.960+0000 7f89e569b700 1 -- start start 2023-08-17T00:12:56.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 0x7f89e00b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e0153780 0x7f89e00addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153b60 0x7f89e00ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00b11b0 con 0x7f89e00c7800 2023-08-17T00:12:56.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00b0880 con 0x7f89e0153780 2023-08-17T00:12:56.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e00b0b60 con 0x7f89e0153b60 2023-08-17T00:12:56.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 0x7f89e00b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 0x7f89e00b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47534/0 (socket says 172.21.15.153:47534) 2023-08-17T00:12:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 -- 172.21.15.153:0/24312633 learned_addr learned my addr 172.21.15.153:0/24312633 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89dffff700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153b60 0x7f89e00ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89de7fc700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e0153780 0x7f89e00addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 -- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153b60 msgr2=0x7f89e00ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153b60 0x7f89e00ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 -- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e0153780 msgr2=0x7f89e00addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e0153780 0x7f89e00addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:56.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 -- 172.21.15.153:0/24312633 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d00092a0 con 0x7f89e00c7800 2023-08-17T00:12:56.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89deffd700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 0x7f89e00b1640 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f89d0009d50 tx=0x7f89d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0006990 con 0x7f89e00c7800 2023-08-17T00:12:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d00127f0 con 0x7f89e00c7800 2023-08-17T00:12:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e00b0e40 con 0x7f89e00c7800 2023-08-17T00:12:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0012bb0 con 0x7f89e00c7800 2023-08-17T00:12:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.964+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e00ae790 con 0x7f89e00c7800 2023-08-17T00:12:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.968+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e006b530 con 0x7f89e00c7800 2023-08-17T00:12:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.968+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f89d000f070 con 0x7f89e00c7800 2023-08-17T00:12:56.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.972+0000 7f89c6ffd700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89cc05a150 0x7f89cc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:56.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.972+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f89d0075520 con 0x7f89e00c7800 2023-08-17T00:12:56.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.972+0000 7f89de7fc700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89cc05a150 0x7f89cc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.972+0000 7f89de7fc700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89cc05a150 0x7f89cc05c610 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f89e0152b50 tx=0x7f89d4006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:56.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:56.976+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89d0048ea0 con 0x7f89e00c7800 2023-08-17T00:12:57.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.140+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89e0157830 con 0x7f89e00c7800 2023-08-17T00:12:57.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89c6ffd700 1 -- 172.21.15.153:0/24312633 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+17040 (secure 0 0 0) 0x7f89d004c4c0 con 0x7f89e00c7800 2023-08-17T00:12:57.150 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:12:57.150 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":128,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:12:41.469781+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:12:02.859311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-08-17T00:12:03.866983+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"126","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.21","mappings":[{"from":6,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:12:57.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89cc05a150 msgr2=0x7f89cc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:57.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89cc05a150 0x7f89cc05c610 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f89e0152b50 tx=0x7f89d4006f40).stop 2023-08-17T00:12:57.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 msgr2=0x7f89e00b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:57.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 0x7f89e00b1640 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f89d0009d50 tx=0x7f89d0016000).stop 2023-08-17T00:12:57.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 shutdown_connections 2023-08-17T00:12:57.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89cc05a150 0x7f89cc05c610 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e0153b60 0x7f89e00ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e0153780 0x7f89e00addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 --2- 172.21.15.153:0/24312633 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e00c7800 0x7f89e00b1640 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 >> 172.21.15.153:0/24312633 conn(0x7f89e00c9630 msgr2=0x7f89e0147950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:57.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 shutdown_connections 2023-08-17T00:12:57.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.144+0000 7f89e569b700 1 -- 172.21.15.153:0/24312633 wait complete. 2023-08-17T00:12:57.173 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:12:57.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 Processor -- start 2023-08-17T00:12:57.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 -- start start 2023-08-17T00:12:57.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00abf10 0x7f52d0068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:57.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52d00ac2f0 0x7f52d0068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:57.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d01545e0 con 0x7f52d00c0a80 2023-08-17T00:12:57.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d0069200 con 0x7f52d00ac2f0 2023-08-17T00:12:57.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d6fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00c1c50 con 0x7f52d00abf10 2023-08-17T00:12:57.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d67b8700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f52d00c0a80 0x7f52d0156750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42932/0 (socket says 172.21.15.153:42932) 2023-08-17T00:12:57.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d67b8700 1 -- 172.21.15.153:0/2150679318 learned_addr learned my addr 172.21.15.153:0/2150679318 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:57.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d5fb7700 1 --2- 172.21.15.153:0/2150679318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00abf10 0x7f52d0068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:57.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.328+0000 7f52d57b6700 1 --2- 172.21.15.153:0/2150679318 >> v2:172.21.15.178:3300/0 conn(0x7f52d00ac2f0 0x7f52d0068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:57.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d4fb5700 1 -- 172.21.15.153:0/2150679318 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160770113 0 0) 0x7f52d01545e0 con 0x7f52d00c0a80 2023-08-17T00:12:57.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d4fb5700 1 -- 172.21.15.153:0/2150679318 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc0033f0 con 0x7f52d00c0a80 2023-08-17T00:12:57.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d5fb7700 1 -- 172.21.15.153:0/2150679318 >> v2:172.21.15.178:3300/0 conn(0x7f52d00ac2f0 msgr2=0x7f52d0068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:57.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d5fb7700 1 --2- 172.21.15.153:0/2150679318 >> v2:172.21.15.178:3300/0 conn(0x7f52d00ac2f0 0x7f52d0068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d5fb7700 1 -- 172.21.15.153:0/2150679318 >> v1:172.21.15.178:6789/0 conn(0x7f52d00c0a80 legacy=0x7f52d0156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:57.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d5fb7700 1 -- 172.21.15.153:0/2150679318 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00a96d0 con 0x7f52d00abf10 2023-08-17T00:12:57.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d57b6700 1 --2- 172.21.15.153:0/2150679318 >> v2:172.21.15.178:3300/0 conn(0x7f52d00ac2f0 0x7f52d0068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:57.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d5fb7700 1 --2- 172.21.15.153:0/2150679318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00abf10 0x7f52d0068820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f52cc006fd0 tx=0x7f52cc006f40).ready entity=mon.2 client_cookie=84f17865fe6b5365 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:57.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d4fb5700 1 -- 172.21.15.153:0/2150679318 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc005880 con 0x7f52d00abf10 2023-08-17T00:12:57.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d4fb5700 1 -- 172.21.15.153:0/2150679318 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc0059e0 con 0x7f52d00abf10 2023-08-17T00:12:57.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d4fb5700 1 -- 172.21.15.153:0/2150679318 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc005d60 con 0x7f52d00abf10 2023-08-17T00:12:57.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 -- 172.21.15.153:0/2150679318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00abf10 msgr2=0x7f52d0068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/2150679318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00abf10 0x7f52d0068820 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f52cc006fd0 tx=0x7f52cc006f40).stop 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 -- 172.21.15.153:0/2150679318 shutdown_connections 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/2150679318 >> v2:172.21.15.178:3300/0 conn(0x7f52d00ac2f0 0x7f52d0068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/2150679318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00abf10 0x7f52d0068820 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 -- 172.21.15.153:0/2150679318 >> 172.21.15.153:0/2150679318 conn(0x7f52d00c6620 msgr2=0x7f52d00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 -- 172.21.15.153:0/2150679318 shutdown_connections 2023-08-17T00:12:57.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.332+0000 7f52d6fb9700 1 -- 172.21.15.153:0/2150679318 wait complete. 2023-08-17T00:12:57.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 Processor -- start 2023-08-17T00:12:57.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 -- start start 2023-08-17T00:12:57.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 0x7f52d00bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:57.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d00ac2f0 0x7f52d014bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:57.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00c0a80 0x7f52d00bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:57.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0167cb0 con 0x7f52d00abf10 2023-08-17T00:12:57.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0167f90 con 0x7f52d00ac2f0 2023-08-17T00:12:57.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.336+0000 7f52d6fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d0168270 con 0x7f52d00c0a80 2023-08-17T00:12:57.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 0x7f52d00bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:57.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 0x7f52d00bd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47544/0 (socket says 172.21.15.153:47544) 2023-08-17T00:12:57.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 -- 172.21.15.153:0/3905928355 learned_addr learned my addr 172.21.15.153:0/3905928355 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d67b8700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00c0a80 0x7f52d00bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d57b6700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d00ac2f0 0x7f52d014bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 -- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00c0a80 msgr2=0x7f52d00bf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00c0a80 0x7f52d00bf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 -- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d00ac2f0 msgr2=0x7f52d014bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d00ac2f0 0x7f52d014bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:57.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 -- 172.21.15.153:0/3905928355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00092a0 con 0x7f52d00abf10 2023-08-17T00:12:57.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d5fb7700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 0x7f52d00bd5a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f52cc009fd0 tx=0x7f52cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:57.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc006c10 con 0x7f52d00abf10 2023-08-17T00:12:57.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00d6b0 con 0x7f52d00abf10 2023-08-17T00:12:57.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc009250 con 0x7f52d00abf10 2023-08-17T00:12:57.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00da70 con 0x7f52d00abf10 2023-08-17T00:12:57.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.340+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d00bfcb0 con 0x7f52d00abf10 2023-08-17T00:12:57.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.344+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d006b4c0 con 0x7f52d00abf10 2023-08-17T00:12:57.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.344+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f52cc00f070 con 0x7f52d00abf10 2023-08-17T00:12:57.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.344+0000 7f52c5ffb700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f52b405a150 0x7f52b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:57.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.344+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6150+0+0 (secure 0 0 0) 0x7f52cc075cb0 con 0x7f52d00abf10 2023-08-17T00:12:57.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.348+0000 7f52d57b6700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f52b405a150 0x7f52b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:57.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.348+0000 7f52d57b6700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f52b405a150 0x7f52b405c610 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f52d0156030 tx=0x7f52c0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:57.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.348+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f52cc049630 con 0x7f52d00abf10 2023-08-17T00:12:57.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:57.540+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f52d0156570 con 0x7f52d00abf10 2023-08-17T00:12:58.303 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:12:58.296+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:12:58.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.308+0000 7f52c5ffb700 1 -- 172.21.15.153:0/3905928355 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) v1 ==== 161+0+0 (secure 0 0 0) 0x7f52cc04cc50 con 0x7f52d00abf10 2023-08-17T00:12:58.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f52b405a150 msgr2=0x7f52b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f52b405a150 0x7f52b405c610 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f52d0156030 tx=0x7f52c0009060).stop 2023-08-17T00:12:58.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 msgr2=0x7f52d00bd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 0x7f52d00bd5a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7f52cc009fd0 tx=0x7f52cc015000).stop 2023-08-17T00:12:58.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 shutdown_connections 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f52b405a150 0x7f52b405c610 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d00c0a80 0x7f52d00bf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d00ac2f0 0x7f52d014bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 --2- 172.21.15.153:0/3905928355 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f52d00abf10 0x7f52d00bd5a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 >> 172.21.15.153:0/3905928355 conn(0x7f52d00c6620 msgr2=0x7f52d014dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 shutdown_connections 2023-08-17T00:12:58.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.316+0000 7f52d6fb9700 1 -- 172.21.15.153:0/3905928355 wait complete. 2023-08-17T00:12:58.325 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:12:58.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:12:58.391 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:12:58.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.500+0000 7f5785569700 1 Processor -- start 2023-08-17T00:12:58.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.500+0000 7f5785569700 1 -- start start 2023-08-17T00:12:58.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f5785569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57801537b0 0x7f5780153b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f5785569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5780157670 con 0x7f57800a9890 2023-08-17T00:12:58.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f5785569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57801578e0 con 0x7f57800c5e60 2023-08-17T00:12:58.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f5785569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5780157bc0 con 0x7f57801537b0 2023-08-17T00:12:58.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f57800a9890 0x7f57800c5750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38834/0 (socket says 172.21.15.153:38834) 2023-08-17T00:12:58.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 -- 172.21.15.153:0/4046510119 learned_addr learned my addr 172.21.15.153:0/4046510119 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:12:58.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577effd700 1 --2- 172.21.15.153:0/4046510119 >> v2:172.21.15.178:3300/0 conn(0x7f57801537b0 0x7f5780153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815502461 0 0) 0x7f5780157670 con 0x7f57800a9890 2023-08-17T00:12:58.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57680033f0 con 0x7f57800a9890 2023-08-17T00:12:58.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1392346274 0 0) 0x7f57801578e0 con 0x7f57800c5e60 2023-08-17T00:12:58.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5780157670 con 0x7f57800c5e60 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1424871535 0 0) 0x7f57680033f0 con 0x7f57800a9890 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 >> v2:172.21.15.178:3300/0 conn(0x7f57801537b0 msgr2=0x7f5780153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 --2- 172.21.15.153:0/4046510119 >> v2:172.21.15.178:3300/0 conn(0x7f57801537b0 0x7f5780153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 >> v1:172.21.15.178:6789/0 conn(0x7f57800c5e60 legacy=0x7f57800bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780157ea0 con 0x7f57800a9890 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f5774001470 con 0x7f57800a9890 2023-08-17T00:12:58.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 >> v1:172.21.15.153:6789/0 conn(0x7f57800a9890 legacy=0x7f57800c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768003a70 0x7f5768003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5768004690 0x7f5768004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5768005000 0x7f576800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5780157bc0 con 0x7f5768004690 2023-08-17T00:12:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576800bf60 con 0x7f5768003a70 2023-08-17T00:12:58.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576800c0d0 con 0x7f5768005000 2023-08-17T00:12:58.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5768004690 0x7f5768004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577effd700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768003a70 0x7f5768003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577f7fe700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5768005000 0x7f576800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 -- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5768005000 msgr2=0x7f576800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5768005000 0x7f576800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 -- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768003a70 msgr2=0x7f5768003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768003a70 0x7f5768003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577e7fc700 1 -- 172.21.15.153:0/4046510119 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680033f0 con 0x7f5768004690 2023-08-17T00:12:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577effd700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768003a70 0x7f5768003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:58.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.504+0000 7f577f7fe700 1 -- 172.21.15.153:0/4046510119 reap_dead start 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f577e7fc700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5768004690 0x7f5768004b10 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f577400c190 tx=0x7f5774001e10).ready entity=mon.0 client_cookie=d27f598f83a7ba63 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774007960 con 0x7f5768004690 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577400ca60 con 0x7f5768004690 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f577dffb700 1 -- 172.21.15.153:0/4046510119 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577400cde0 con 0x7f5768004690 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 -- 172.21.15.153:0/4046510119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5768004690 msgr2=0x7f5768004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5768004690 0x7f5768004b10 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f577400c190 tx=0x7f5774001e10).stop 2023-08-17T00:12:58.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 -- 172.21.15.153:0/4046510119 shutdown_connections 2023-08-17T00:12:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 --2- 172.21.15.153:0/4046510119 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5768004690 0x7f5768004b10 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 -- 172.21.15.153:0/4046510119 >> 172.21.15.153:0/4046510119 conn(0x7f5780061fa0 msgr2=0x7f57800623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 -- 172.21.15.153:0/4046510119 shutdown_connections 2023-08-17T00:12:58.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.508+0000 7f5785569700 1 -- 172.21.15.153:0/4046510119 wait complete. 2023-08-17T00:12:58.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 Processor -- start 2023-08-17T00:12:58.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 -- start start 2023-08-17T00:12:58.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768004690 0x7f57800c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5780147620 0x7f57800ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 0x7f578014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57800aec80 con 0x7f578014d8d0 2023-08-17T00:12:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578014e240 con 0x7f5768004690 2023-08-17T00:12:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f5785569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57800adda0 con 0x7f5780147620 2023-08-17T00:12:58.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 0x7f578014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 0x7f578014dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47584/0 (socket says 172.21.15.153:47584) 2023-08-17T00:12:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 -- 172.21.15.153:0/576619898 learned_addr learned my addr 172.21.15.153:0/576619898 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577e7fc700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5780147620 0x7f57800ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577effd700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768004690 0x7f57800c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 -- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5780147620 msgr2=0x7f57800ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5780147620 0x7f57800ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 -- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768004690 msgr2=0x7f57800c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768004690 0x7f57800c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 -- 172.21.15.153:0/576619898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800ae070 con 0x7f578014d8d0 2023-08-17T00:12:58.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577effd700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768004690 0x7f57800c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577e7fc700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5780147620 0x7f57800ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.512+0000 7f577f7fe700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 0x7f578014dd50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f57800aa720 tx=0x7f5778009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778003280 con 0x7f578014d8d0 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57780033e0 con 0x7f578014d8d0 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57780018f0 con 0x7f578014d8d0 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57800ae350 con 0x7f578014d8d0 2023-08-17T00:12:58.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57800ae910 con 0x7f578014d8d0 2023-08-17T00:12:58.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57800aeaa0 con 0x7f578014d8d0 2023-08-17T00:12:58.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.516+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5778001ce0 con 0x7f578014d8d0 2023-08-17T00:12:58.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.520+0000 7f5766ffd700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f576c05a150 0x7f576c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:58.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.520+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6236+0+0 (secure 0 0 0) 0x7f5778073d60 con 0x7f578014d8d0 2023-08-17T00:12:58.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.520+0000 7f577effd700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f576c05a150 0x7f576c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:58.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.520+0000 7f577effd700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f576c05a150 0x7f576c05c610 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f57800c9870 tx=0x7f5770008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:58.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.524+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5778047690 con 0x7f578014d8d0 2023-08-17T00:12:58.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:58.724+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f578006b4c0 con 0x7f578014d8d0 2023-08-17T00:12:59.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.316+0000 7f5766ffd700 1 -- 172.21.15.153:0/576619898 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v103) v1 ==== 104+0+0 (secure 0 0 0) 0x7f577804acb0 con 0x7f578014d8d0 2023-08-17T00:12:59.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f576c05a150 msgr2=0x7f576c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:59.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f576c05a150 0x7f576c05c610 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f57800c9870 tx=0x7f5770008040).stop 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 msgr2=0x7f578014dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 0x7f578014dd50 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 rx=0x7f57800aa720 tx=0x7f5778009040).stop 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 shutdown_connections 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f576c05a150 0x7f576c05c610 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f578014d8d0 0x7f578014dd50 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5780147620 0x7f57800ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 --2- 172.21.15.153:0/576619898 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768004690 0x7f57800c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 >> 172.21.15.153:0/576619898 conn(0x7f5780061fa0 msgr2=0x7f578014f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:59.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 shutdown_connections 2023-08-17T00:12:59.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.320+0000 7f5785569700 1 -- 172.21.15.153:0/576619898 wait complete. 2023-08-17T00:12:59.348 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:12:59.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.560+0000 7f008941b700 1 Processor -- start 2023-08-17T00:12:59.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.560+0000 7f008941b700 1 -- start start 2023-08-17T00:12:59.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f00840acaa0 0x7f00840ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840ace80 0x7f00840c5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00840c9100 con 0x7f00840c5c50 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0084154000 con 0x7f00840acaa0 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c93e0 con 0x7f00840ace80 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f00840acaa0 0x7f00840ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f00840acaa0 0x7f00840ca1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47588/0 (socket says 172.21.15.153:47588) 2023-08-17T00:12:59.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 -- 172.21.15.153:0/1869213175 learned_addr learned my addr 172.21.15.153:0/1869213175 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:59.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f00827fc700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840ace80 0x7f00840c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:59.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 -- 172.21.15.153:0/1869213175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840ace80 msgr2=0x7f00840c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:12:59.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840ace80 0x7f00840c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 -- 172.21.15.153:0/1869213175 >> v1:172.21.15.178:6789/0 conn(0x7f00840c5c50 legacy=0x7f00840632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 -- 172.21.15.153:0/1869213175 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840c96c0 con 0x7f00840acaa0 2023-08-17T00:12:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f00827fc700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840ace80 0x7f00840c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:12:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0082ffd700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f00840ca1a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f0074009830 tx=0x7f00740090f0).ready entity=mon.0 client_cookie=fd03b39607fb8106 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0081ffb700 1 -- 172.21.15.153:0/1869213175 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400b600 con 0x7f00840acaa0 2023-08-17T00:12:59.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0081ffb700 1 -- 172.21.15.153:0/1869213175 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b760 con 0x7f00840acaa0 2023-08-17T00:12:59.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f0081ffb700 1 -- 172.21.15.153:0/1869213175 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400bae0 con 0x7f00840acaa0 2023-08-17T00:12:59.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 -- 172.21.15.153:0/1869213175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 msgr2=0x7f00840ca1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:59.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.564+0000 7f008941b700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f00840ca1a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f0074009830 tx=0x7f00740090f0).stop 2023-08-17T00:12:59.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 -- 172.21.15.153:0/1869213175 shutdown_connections 2023-08-17T00:12:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840ace80 0x7f00840c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 --2- 172.21.15.153:0/1869213175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f00840ca1a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 -- 172.21.15.153:0/1869213175 >> 172.21.15.153:0/1869213175 conn(0x7f0084062a30 msgr2=0x7f00840ca7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:12:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 -- 172.21.15.153:0/1869213175 shutdown_connections 2023-08-17T00:12:59.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 -- 172.21.15.153:0/1869213175 wait complete. 2023-08-17T00:12:59.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.568+0000 7f008941b700 1 Processor -- start 2023-08-17T00:12:59.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 -- start start 2023-08-17T00:12:59.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f0084147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:59.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00840ace80 0x7f00840c39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:59.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5c50 0x7f0084156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0084154380 con 0x7f00840acaa0 2023-08-17T00:12:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c3000 con 0x7f00840ace80 2023-08-17T00:12:59.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f008941b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c2760 con 0x7f00840c5c50 2023-08-17T00:12:59.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f0084147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:59.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f00827fc700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00840ace80 0x7f00840c39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:59.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f0084147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47600/0 (socket says 172.21.15.153:47600) 2023-08-17T00:12:59.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 -- 172.21.15.153:0/172357175 learned_addr learned my addr 172.21.15.153:0/172357175 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:12:59.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f00837fe700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5c50 0x7f0084156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:59.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 -- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5c50 msgr2=0x7f0084156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5c50 0x7f0084156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 -- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00840ace80 msgr2=0x7f00840c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:12:59.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00840ace80 0x7f00840c39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:12:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 -- 172.21.15.153:0/172357175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009370 con 0x7f00840acaa0 2023-08-17T00:12:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f00827fc700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00840ace80 0x7f00840c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:12:59.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f0082ffd700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f0084147300 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f0084083a30 tx=0x7f0074017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.572+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400b8d0 con 0x7f00840acaa0 2023-08-17T00:12:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.576+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400ba30 con 0x7f00840acaa0 2023-08-17T00:12:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.576+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00840c2a40 con 0x7f00840acaa0 2023-08-17T00:12:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.576+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007401c670 con 0x7f00840acaa0 2023-08-17T00:12:59.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.576+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00841477f0 con 0x7f00840acaa0 2023-08-17T00:12:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.576+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084046dd0 con 0x7f00840acaa0 2023-08-17T00:12:59.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.580+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f007402c070 con 0x7f00840acaa0 2023-08-17T00:12:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.580+0000 7f006affd700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f007005a150 0x7f007005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:12:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.580+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6236+0+0 (secure 0 0 0) 0x7f0074075f80 con 0x7f00840acaa0 2023-08-17T00:12:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.580+0000 7f00827fc700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f007005a150 0x7f007005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:12:59.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.580+0000 7f00827fc700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f007005a150 0x7f007005c610 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f00840c3380 tx=0x7f0078008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:12:59.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.584+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f00740498b0 con 0x7f00840acaa0 2023-08-17T00:12:59.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:12:59.752+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f00840c99a0 con 0x7f00840acaa0 2023-08-17T00:13:00.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.608+0000 7f006affd700 1 -- 172.21.15.153:0/172357175 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v130) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0074020070 con 0x7f00840acaa0 2023-08-17T00:13:00.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f007005a150 msgr2=0x7f007005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f007005a150 0x7f007005c610 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f00840c3380 tx=0x7f0078008040).stop 2023-08-17T00:13:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 msgr2=0x7f0084147300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f0084147300 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f0084083a30 tx=0x7f0074017000).stop 2023-08-17T00:13:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 shutdown_connections 2023-08-17T00:13:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f007005a150 0x7f007005c610 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5c50 0x7f0084156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00840ace80 0x7f00840c39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 --2- 172.21.15.153:0/172357175 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f00840acaa0 0x7f0084147300 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 >> 172.21.15.153:0/172357175 conn(0x7f0084062a30 msgr2=0x7f00840bfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:00.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 shutdown_connections 2023-08-17T00:13:00.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.612+0000 7f008941b700 1 -- 172.21.15.153:0/172357175 wait complete. 2023-08-17T00:13:00.622 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:13:00.642 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:13:00.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.808+0000 7fe0c2fb9700 1 Processor -- start 2023-08-17T00:13:00.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.808+0000 7fe0c2fb9700 1 -- start start 2023-08-17T00:13:00.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c2fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc1539b0 0x7fe0bc0632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c2fb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe0bc153d90 0x7fe0bc0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c2fb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cb450 0x7fe0bc0a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c2fb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0aa180 con 0x7fe0bc0cb450 2023-08-17T00:13:00.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c2fb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0c00d0 con 0x7fe0bc153d90 2023-08-17T00:13:00.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c2fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0bf810 con 0x7fe0bc1539b0 2023-08-17T00:13:00.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cb450 0x7fe0bc0a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe0bc0cb450 0x7fe0bc0a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47606/0 (socket says 172.21.15.153:47606) 2023-08-17T00:13:00.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 -- 172.21.15.153:0/1960088544 learned_addr learned my addr 172.21.15.153:0/1960088544 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:00.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c17b6700 1 --2- 172.21.15.153:0/1960088544 >> v2:172.21.15.178:3300/0 conn(0x7fe0bc153d90 0x7fe0bc0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c1fb7700 1 --2- 172.21.15.153:0/1960088544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc1539b0 0x7fe0bc0632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 -- 172.21.15.153:0/1960088544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc1539b0 msgr2=0x7fe0bc0632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:00.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 --2- 172.21.15.153:0/1960088544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc1539b0 0x7fe0bc0632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 -- 172.21.15.153:0/1960088544 >> v2:172.21.15.178:3300/0 conn(0x7fe0bc153d90 msgr2=0x7fe0bc0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:00.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 --2- 172.21.15.153:0/1960088544 >> v2:172.21.15.178:3300/0 conn(0x7fe0bc153d90 0x7fe0bc0a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 -- 172.21.15.153:0/1960088544 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0aa910 con 0x7fe0bc0cb450 2023-08-17T00:13:00.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c27b8700 1 --2- 172.21.15.153:0/1960088544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0a9c90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fe0bc046c50 tx=0x7fe0b4009840).ready entity=mon.0 client_cookie=1d9c6f4d1c2d34ee server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:00.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c0fb5700 1 -- 172.21.15.153:0/1960088544 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400e070 con 0x7fe0bc0cb450 2023-08-17T00:13:00.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c0fb5700 1 -- 172.21.15.153:0/1960088544 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b400ba50 con 0x7fe0bc0cb450 2023-08-17T00:13:00.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.812+0000 7fe0c0fb5700 1 -- 172.21.15.153:0/1960088544 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b400bdd0 con 0x7fe0bc0cb450 2023-08-17T00:13:00.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/1960088544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc0cb450 msgr2=0x7fe0bc0a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:00.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/1960088544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0a9c90 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fe0bc046c50 tx=0x7fe0b4009840).stop 2023-08-17T00:13:00.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/1960088544 shutdown_connections 2023-08-17T00:13:00.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/1960088544 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0a9c90 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/1960088544 >> v2:172.21.15.178:3300/0 conn(0x7fe0bc153d90 0x7fe0bc0a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/1960088544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc1539b0 0x7fe0bc0632b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/1960088544 >> 172.21.15.153:0/1960088544 conn(0x7fe0bc062a10 msgr2=0x7fe0bc0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/1960088544 shutdown_connections 2023-08-17T00:13:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/1960088544 wait complete. 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 Processor -- start 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.816+0000 7fe0c2fb9700 1 -- start start 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 0x7fe0bc166d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc153d90 0x7fe0bc151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0c12d0 con 0x7fe0bc1539b0 2023-08-17T00:13:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14e890 con 0x7fe0bc0cb450 2023-08-17T00:13:00.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0c0700 con 0x7fe0bc153d90 2023-08-17T00:13:00.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 0x7fe0bc166d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 0x7fe0bc166d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47612/0 (socket says 172.21.15.153:47612) 2023-08-17T00:13:00.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 -- 172.21.15.153:0/566635775 learned_addr learned my addr 172.21.15.153:0/566635775 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:00.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c1fb7700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c27b8700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc153d90 0x7fe0bc151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 -- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc153d90 msgr2=0x7fe0bc151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc153d90 0x7fe0bc151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 -- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc0cb450 msgr2=0x7fe0bc0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 -- 172.21.15.153:0/566635775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b4009ae0 con 0x7fe0bc1539b0 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c17b6700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 0x7fe0bc166d20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fe0ac00d630 tx=0x7fe0ac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0104f0 con 0x7fe0bc1539b0 2023-08-17T00:13:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac010650 con 0x7fe0bc1539b0 2023-08-17T00:13:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc0c09a0 con 0x7fe0bc1539b0 2023-08-17T00:13:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0109d0 con 0x7fe0bc1539b0 2023-08-17T00:13:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.820+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc0c0f60 con 0x7fe0bc1539b0 2023-08-17T00:13:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.824+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc0caa20 con 0x7fe0bc1539b0 2023-08-17T00:13:00.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.824+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe0ac01a030 con 0x7fe0bc1539b0 2023-08-17T00:13:00.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.824+0000 7fe0b1ffb700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0a005a150 0x7fe0a005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:00.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.824+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5769+0+0 (secure 0 0 0) 0x7fe0ac073760 con 0x7fe0bc1539b0 2023-08-17T00:13:00.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.824+0000 7fe0c1fb7700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0a005a150 0x7fe0a005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:00.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.828+0000 7fe0c1fb7700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0a005a150 0x7fe0a005c610 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fe0b8006fd0 tx=0x7fe0b8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:00.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:00.832+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe0ac047420 con 0x7fe0bc1539b0 2023-08-17T00:13:01.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.000+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0bc046dd0 con 0x7fe0bc1539b0 2023-08-17T00:13:01.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.620+0000 7fe0b1ffb700 1 -- 172.21.15.153:0/566635775 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v131) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe0ac04aa40 con 0x7fe0bc1539b0 2023-08-17T00:13:01.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0a005a150 msgr2=0x7fe0a005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:01.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0a005a150 0x7fe0a005c610 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fe0b8006fd0 tx=0x7fe0b8008040).stop 2023-08-17T00:13:01.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 msgr2=0x7fe0bc166d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:01.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 0x7fe0bc166d20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7fe0ac00d630 tx=0x7fe0ac008040).stop 2023-08-17T00:13:01.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 shutdown_connections 2023-08-17T00:13:01.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0a005a150 0x7fe0a005c610 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0bc153d90 0x7fe0bc151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe0bc1539b0 0x7fe0bc166d20 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 --2- 172.21.15.153:0/566635775 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0bc0cb450 0x7fe0bc0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 >> 172.21.15.153:0/566635775 conn(0x7fe0bc062a10 msgr2=0x7fe0bc0c85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:01.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 shutdown_connections 2023-08-17T00:13:01.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.628+0000 7fe0c2fb9700 1 -- 172.21.15.153:0/566635775 wait complete. 2023-08-17T00:13:01.637 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:13:01.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:13:01.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 Processor -- start 2023-08-17T00:13:01.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 -- start start 2023-08-17T00:13:01.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280c5ea0 0x7f0f280634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:01.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0f280639a0 0x7f0f280bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:01.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f28154e90 con 0x7f0f280acf30 2023-08-17T00:13:01.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f280c1730 con 0x7f0f280639a0 2023-08-17T00:13:01.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.812+0000 7f0f2e107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28063e10 con 0x7f0f280c5ea0 2023-08-17T00:13:01.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d105700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0f280acf30 0x7f0f280c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42954/0 (socket says 172.21.15.153:42954) 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d105700 1 -- 172.21.15.153:0/2105230440 learned_addr learned my addr 172.21.15.153:0/2105230440 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d906700 1 --2- 172.21.15.153:0/2105230440 >> v2:172.21.15.153:3300/0 conn(0x7f0f280639a0 0x7f0f280bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2c904700 1 --2- 172.21.15.153:0/2105230440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280c5ea0 0x7f0f280634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f1ffff700 1 -- 172.21.15.153:0/2105230440 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195736345 0 0) 0x7f0f28154e90 con 0x7f0f280acf30 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f1ffff700 1 -- 172.21.15.153:0/2105230440 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f140033f0 con 0x7f0f280acf30 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d906700 1 -- 172.21.15.153:0/2105230440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280c5ea0 msgr2=0x7f0f280634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:01.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d906700 1 --2- 172.21.15.153:0/2105230440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280c5ea0 0x7f0f280634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d906700 1 -- 172.21.15.153:0/2105230440 >> v1:172.21.15.178:6789/0 conn(0x7f0f280acf30 legacy=0x7f0f280c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:01.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d906700 1 -- 172.21.15.153:0/2105230440 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f28153fc0 con 0x7f0f280639a0 2023-08-17T00:13:01.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2d906700 1 --2- 172.21.15.153:0/2105230440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f280bfad0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f0f20009e60 tx=0x7f0f20009780).ready entity=mon.0 client_cookie=b6648c0bacbd67c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:01.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f1ffff700 1 -- 172.21.15.153:0/2105230440 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000e070 con 0x7f0f280639a0 2023-08-17T00:13:01.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f1ffff700 1 -- 172.21.15.153:0/2105230440 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2000bab0 con 0x7f0f280639a0 2023-08-17T00:13:01.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f1ffff700 1 -- 172.21.15.153:0/2105230440 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2000be30 con 0x7f0f280639a0 2023-08-17T00:13:01.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 -- 172.21.15.153:0/2105230440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 msgr2=0x7f0f280bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:01.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 --2- 172.21.15.153:0/2105230440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f280bfad0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f0f20009e60 tx=0x7f0f20009780).stop 2023-08-17T00:13:01.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 -- 172.21.15.153:0/2105230440 shutdown_connections 2023-08-17T00:13:01.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 --2- 172.21.15.153:0/2105230440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f280bfad0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 --2- 172.21.15.153:0/2105230440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280c5ea0 0x7f0f280634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 -- 172.21.15.153:0/2105230440 >> 172.21.15.153:0/2105230440 conn(0x7f0f280cb330 msgr2=0x7f0f280c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:01.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 -- 172.21.15.153:0/2105230440 shutdown_connections 2023-08-17T00:13:01.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.816+0000 7f0f2e107700 1 -- 172.21.15.153:0/2105230440 wait complete. 2023-08-17T00:13:01.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.820+0000 7f0f2e107700 1 Processor -- start 2023-08-17T00:13:01.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.820+0000 7f0f2e107700 1 -- start start 2023-08-17T00:13:01.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f28142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:01.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280acf30 0x7f0f280c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:01.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f280c3f70 0x7f0f28163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:01.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f280c43f0 con 0x7f0f280639a0 2023-08-17T00:13:01.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28142a70 con 0x7f0f280c3f70 2023-08-17T00:13:01.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f28164cf0 con 0x7f0f280acf30 2023-08-17T00:13:01.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f28142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:01.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f28142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47638/0 (socket says 172.21.15.153:47638) 2023-08-17T00:13:01.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 -- 172.21.15.153:0/1287057879 learned_addr learned my addr 172.21.15.153:0/1287057879 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:01.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d906700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f280c3f70 0x7f0f28163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:01.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2c904700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280acf30 0x7f0f280c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:01.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 -- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280acf30 msgr2=0x7f0f280c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280acf30 0x7f0f280c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 -- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f280c3f70 msgr2=0x7f0f28163fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f280c3f70 0x7f0f28163fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 -- 172.21.15.153:0/1287057879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f20009a20 con 0x7f0f280639a0 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2d105700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f28142580 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f0f2400c590 tx=0x7f0f24007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240072e0 con 0x7f0f280639a0 2023-08-17T00:13:01.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24007440 con 0x7f0f280639a0 2023-08-17T00:13:01.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f28165040 con 0x7f0f280639a0 2023-08-17T00:13:01.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240057a0 con 0x7f0f280639a0 2023-08-17T00:13:01.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.824+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f28165600 con 0x7f0f280639a0 2023-08-17T00:13:01.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.828+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f280c4890 con 0x7f0f280639a0 2023-08-17T00:13:01.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.828+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0f24010070 con 0x7f0f280639a0 2023-08-17T00:13:01.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.828+0000 7f0f1d7fa700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f0c05a150 0x7f0f0c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:01.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.832+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0f24073520 con 0x7f0f280639a0 2023-08-17T00:13:01.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.832+0000 7f0f2c904700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f0c05a150 0x7f0f0c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:01.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.832+0000 7f0f2c904700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f0c05a150 0x7f0f0c05c610 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f0f280a9d50 tx=0x7f0f18009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:01.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.836+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0f280c4890 con 0x7f0f280639a0 2023-08-17T00:13:02.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:01.996+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0f280c4890 con 0x7f0f280639a0 2023-08-17T00:13:02.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.008+0000 7f0f1d7fa700 1 -- 172.21.15.153:0/1287057879 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f280c4890 con 0x7f0f280639a0 2023-08-17T00:13:02.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.008+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f0c05a150 msgr2=0x7f0f0c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.008+0000 7f0f2e107700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f0c05a150 0x7f0f0c05c610 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f0f280a9d50 tx=0x7f0f18009060).stop 2023-08-17T00:13:02.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.008+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 msgr2=0x7f0f28142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.008+0000 7f0f2e107700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f28142580 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7f0f2400c590 tx=0x7f0f24007c80).stop 2023-08-17T00:13:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 shutdown_connections 2023-08-17T00:13:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0f0c05a150 0x7f0f0c05c610 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f280c3f70 0x7f0f28163fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f280acf30 0x7f0f280c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 --2- 172.21.15.153:0/1287057879 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0f280639a0 0x7f0f28142580 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 >> 172.21.15.153:0/1287057879 conn(0x7f0f280cb330 msgr2=0x7f0f28156390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 shutdown_connections 2023-08-17T00:13:02.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.012+0000 7f0f2e107700 1 -- 172.21.15.153:0/1287057879 wait complete. 2023-08-17T00:13:02.038 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2023-08-17T00:13:02.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a9c1b700 1 Processor -- start 2023-08-17T00:13:02.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a9c1b700 1 -- start start 2023-08-17T00:13:02.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a9c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4151b90 0x7ff9a4151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a9c1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a4061fa0 con 0x7ff9a4064870 2023-08-17T00:13:02.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a9c1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a40621f0 con 0x7ff9a4063290 2023-08-17T00:13:02.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a9c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40c3fb0 con 0x7ff9a4151b90 2023-08-17T00:13:02.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a2ffd700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7ff9a4063290 0x7ff9a4065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42970/0 (socket says 172.21.15.153:42970) 2023-08-17T00:13:02.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a37fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4151b90 0x7ff9a4151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a2ffd700 1 -- 172.21.15.153:0/1445994298 learned_addr learned my addr 172.21.15.153:0/1445994298 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:02.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.204+0000 7ff9a3fff700 1 --1- 172.21.15.153:0/1445994298 >> v1:172.21.15.153:6789/0 conn(0x7ff9a4064870 0x7ff9a40a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38836/0 (socket says 172.21.15.153:38836) 2023-08-17T00:13:02.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a27fc700 1 -- 172.21.15.153:0/1445994298 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268797853 0 0) 0x7ff9a40621f0 con 0x7ff9a4063290 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a27fc700 1 -- 172.21.15.153:0/1445994298 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff98c0033f0 con 0x7ff9a4063290 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a37fe700 1 -- 172.21.15.153:0/1445994298 >> v1:172.21.15.178:6789/0 conn(0x7ff9a4063290 legacy=0x7ff9a4065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a37fe700 1 -- 172.21.15.153:0/1445994298 >> v1:172.21.15.153:6789/0 conn(0x7ff9a4064870 legacy=0x7ff9a40a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a37fe700 1 -- 172.21.15.153:0/1445994298 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a40624d0 con 0x7ff9a4151b90 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a37fe700 1 --2- 172.21.15.153:0/1445994298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4151b90 0x7ff9a4151f70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7ff994009790 tx=0x7ff994009060).ready entity=mon.2 client_cookie=b443f29de0cdc1c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a27fc700 1 -- 172.21.15.153:0/1445994298 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400f510 con 0x7ff9a4151b90 2023-08-17T00:13:02.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a27fc700 1 -- 172.21.15.153:0/1445994298 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99400f670 con 0x7ff9a4151b90 2023-08-17T00:13:02.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a27fc700 1 -- 172.21.15.153:0/1445994298 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99400f9f0 con 0x7ff9a4151b90 2023-08-17T00:13:02.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1445994298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4151b90 msgr2=0x7ff9a4151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1445994298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4151b90 0x7ff9a4151f70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7ff994009790 tx=0x7ff994009060).stop 2023-08-17T00:13:02.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1445994298 shutdown_connections 2023-08-17T00:13:02.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1445994298 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4151b90 0x7ff9a4151f70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1445994298 >> 172.21.15.153:0/1445994298 conn(0x7ff9a40c7150 msgr2=0x7ff9a40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:02.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1445994298 shutdown_connections 2023-08-17T00:13:02.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.208+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1445994298 wait complete. 2023-08-17T00:13:02.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 Processor -- start 2023-08-17T00:13:02.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 -- start start 2023-08-17T00:13:02.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4063290 0x7ff9a40bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 0x7ff9a40ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9a4151b90 0x7ff9a4146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40aac00 con 0x7ff9a4064870 2023-08-17T00:13:02.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40a9ff0 con 0x7ff9a4151b90 2023-08-17T00:13:02.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a40aa2d0 con 0x7ff9a4063290 2023-08-17T00:13:02.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 0x7ff9a40ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 0x7ff9a40ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47648/0 (socket says 172.21.15.153:47648) 2023-08-17T00:13:02.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 -- 172.21.15.153:0/1453557754 learned_addr learned my addr 172.21.15.153:0/1453557754 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:02.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a3fff700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9a4151b90 0x7ff9a4146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a37fe700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4063290 0x7ff9a40bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 -- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4063290 msgr2=0x7ff9a40bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4063290 0x7ff9a40bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 -- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9a4151b90 msgr2=0x7ff9a4146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9a4151b90 0x7ff9a4146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 -- 172.21.15.153:0/1453557754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940092a0 con 0x7ff9a4064870 2023-08-17T00:13:02.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a3fff700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9a4151b90 0x7ff9a4146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a37fe700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4063290 0x7ff9a40bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a2ffd700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 0x7ff9a40ab090 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7ff99800c4c0 tx=0x7ff998007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980072e0 con 0x7ff9a4064870 2023-08-17T00:13:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998007440 con 0x7ff9a4064870 2023-08-17T00:13:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980057a0 con 0x7ff9a4064870 2023-08-17T00:13:02.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.212+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a40aa5b0 con 0x7ff9a4064870 2023-08-17T00:13:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.216+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a416ceb0 con 0x7ff9a4064870 2023-08-17T00:13:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.216+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a406b530 con 0x7ff9a4064870 2023-08-17T00:13:02.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.216+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff998010070 con 0x7ff9a4064870 2023-08-17T00:13:02.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.220+0000 7ff98b7fe700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff99005a150 0x7ff99005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.220+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff998073410 con 0x7ff9a4064870 2023-08-17T00:13:02.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.220+0000 7ff9a37fe700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff99005a150 0x7ff99005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.220+0000 7ff9a37fe700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff99005a150 0x7ff99005c610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff9940096e0 tx=0x7ff994017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:02.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.224+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9980471c0 con 0x7ff9a4064870 2023-08-17T00:13:02.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.464+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7ff9a40c2e90 con 0x7ff9a4064870 2023-08-17T00:13:02.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.624+0000 7ff98b7fe700 1 -- 172.21.15.153:0/1453557754 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v478) v1 ==== 166+0+0 (secure 0 0 0) 0x7ff998007d90 con 0x7ff9a4064870 2023-08-17T00:13:02.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff99005a150 msgr2=0x7ff99005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff99005a150 0x7ff99005c610 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7ff9940096e0 tx=0x7ff994017000).stop 2023-08-17T00:13:02.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 msgr2=0x7ff9a40ab090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 0x7ff9a40ab090 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 rx=0x7ff99800c4c0 tx=0x7ff998007c50).stop 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 shutdown_connections 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff99005a150 0x7ff99005c610 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9a4151b90 0x7ff9a4146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9a4064870 0x7ff9a40ab090 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 --2- 172.21.15.153:0/1453557754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9a4063290 0x7ff9a40bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 >> 172.21.15.153:0/1453557754 conn(0x7ff9a40c7150 msgr2=0x7ff9a41512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:02.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 shutdown_connections 2023-08-17T00:13:02.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.628+0000 7ff9a9c1b700 1 -- 172.21.15.153:0/1453557754 wait complete. 2023-08-17T00:13:02.657 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-08-17T00:13:02.657 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-08-17T00:13:02.658 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2023-08-17T00:13:02.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 Processor -- start 2023-08-17T00:13:02.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 -- start start 2023-08-17T00:13:02.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42180bed50 0x7f4218153a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 0x7f42180a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180a8280 con 0x7f4218153680 2023-08-17T00:13:02.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42180a7fd0 con 0x7f42180bed50 2023-08-17T00:13:02.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f421d3f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180c43f0 con 0x7f42180c3f90 2023-08-17T00:13:02.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f4217fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4218153680 0x7f42180be640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38848/0 (socket says 172.21.15.153:38848) 2023-08-17T00:13:02.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.808+0000 7f4217fff700 1 -- 172.21.15.153:0/2850078535 learned_addr learned my addr 172.21.15.153:0/2850078535 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:02.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f421cbf8700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 0x7f42180a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382951509 0 0) 0x7f42180a8280 con 0x7f4218153680 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 --2- 172.21.15.153:0/2850078535 >> v2:172.21.15.178:3300/0 conn(0x7f42180bed50 0x7f4218153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42040033f0 con 0x7f4218153680 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3045636165 0 0) 0x7f42040033f0 con 0x7f4218153680 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 msgr2=0x7f42180a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 0x7f42180a7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 >> v2:172.21.15.178:3300/0 conn(0x7f42180bed50 msgr2=0x7f4218153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:02.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 --2- 172.21.15.153:0/2850078535 >> v2:172.21.15.178:3300/0 conn(0x7f42180bed50 0x7f4218153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180c4690 con 0x7f4218153680 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f4208001970 con 0x7f4218153680 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 >> v1:172.21.15.153:6789/0 conn(0x7f4218153680 legacy=0x7f42180be640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42040038e0 0x7f4204003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f4204004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 0x7f4204005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180a7fd0 con 0x7f4204004690 2023-08-17T00:13:02.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180c43f0 con 0x7f42040038e0 2023-08-17T00:13:02.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420400b8e0 con 0x7f42180c3f90 2023-08-17T00:13:02.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f4204004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4217fff700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42040038e0 0x7f4204003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f421cbf8700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 0x7f4204005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 -- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 msgr2=0x7f4204005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42180c3f90 0x7f4204005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 -- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42040038e0 msgr2=0x7f4204003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42040038e0 0x7f4204003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 -- 172.21.15.153:0/2850078535 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040033f0 con 0x7f4204004690 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f42177fe700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f4204004b10 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f42180bf150 tx=0x7f4200009060).ready entity=mon.0 client_cookie=d98c28f61b7d6a65 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:02.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200009e90 con 0x7f4204004690 2023-08-17T00:13:02.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4200009430 con 0x7f4204004690 2023-08-17T00:13:02.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.812+0000 7f4216ffd700 1 -- 172.21.15.153:0/2850078535 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000e850 con 0x7f4204004690 2023-08-17T00:13:02.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 -- 172.21.15.153:0/2850078535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 msgr2=0x7f4204004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2850078535 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f4204004b10 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 rx=0x7f42180bf150 tx=0x7f4200009060).stop 2023-08-17T00:13:02.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421cbf8700 1 -- 172.21.15.153:0/2850078535 reap_dead start 2023-08-17T00:13:02.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 -- 172.21.15.153:0/2850078535 shutdown_connections 2023-08-17T00:13:02.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 -- 172.21.15.153:0/2850078535 >> 172.21.15.153:0/2850078535 conn(0x7f42180c5170 msgr2=0x7f42180c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:02.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 -- 172.21.15.153:0/2850078535 shutdown_connections 2023-08-17T00:13:02.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 -- 172.21.15.153:0/2850078535 wait complete. 2023-08-17T00:13:02.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 Processor -- start 2023-08-17T00:13:02.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.816+0000 7f421d3f9700 1 -- start start 2023-08-17T00:13:02.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f42180acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4218156a70 0x7f4218154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4218154c10 0x7f4218155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ad210 con 0x7f4204004690 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ae010 con 0x7f4218156a70 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4218155580 con 0x7f4218154c10 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f42180acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f42180acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47668/0 (socket says 172.21.15.153:47668) 2023-08-17T00:13:02.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 -- 172.21.15.153:0/2499177193 learned_addr learned my addr 172.21.15.153:0/2499177193 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f42177fe700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4218156a70 0x7f4218154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421cbf8700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4218154c10 0x7f4218155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 -- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4218154c10 msgr2=0x7f4218155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4218154c10 0x7f4218155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 -- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4218156a70 msgr2=0x7f4218154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4218156a70 0x7f4218154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:02.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 -- 172.21.15.153:0/2499177193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180c1450 con 0x7f4204004690 2023-08-17T00:13:02.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f4217fff700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f42180acd20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f4208001ae0 tx=0x7f4208009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:02.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208005c00 con 0x7f4204004690 2023-08-17T00:13:02.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208005d60 con 0x7f4204004690 2023-08-17T00:13:02.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42180ad400 con 0x7f4204004690 2023-08-17T00:13:02.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208007300 con 0x7f4204004690 2023-08-17T00:13:02.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42180ad9c0 con 0x7f4204004690 2023-08-17T00:13:02.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.820+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42180c8440 con 0x7f4204004690 2023-08-17T00:13:02.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.824+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f420801a030 con 0x7f4204004690 2023-08-17T00:13:02.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.824+0000 7f420ffff700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:02.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.824+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f42080739b0 con 0x7f4204004690 2023-08-17T00:13:02.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.824+0000 7f42177fe700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:02.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.824+0000 7f42177fe700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f421814ecb0 tx=0x7f420001a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:02.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:02.828+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42180c8440 con 0x7f4204004690 2023-08-17T00:13:03.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.048+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f42180c8440 con 0x7f4204004690 2023-08-17T00:13:03.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.632+0000 7f420ffff700 1 -- 172.21.15.153:0/2499177193 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v479) v1 ==== 169+0+0 (secure 0 0 0) 0x7f42180c8440 con 0x7f4204004690 2023-08-17T00:13:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 msgr2=0x7f41f805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f421814ecb0 tx=0x7f420001a000).stop 2023-08-17T00:13:03.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 msgr2=0x7f42180acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f42180acd20 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f4208001ae0 tx=0x7f4208009040).stop 2023-08-17T00:13:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 shutdown_connections 2023-08-17T00:13:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41f805a150 0x7f41f805c610 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4218154c10 0x7f4218155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4218156a70 0x7f4218154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 --2- 172.21.15.153:0/2499177193 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4204004690 0x7f42180acd20 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.636+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 >> 172.21.15.153:0/2499177193 conn(0x7f42180c5170 msgr2=0x7f421814ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.640+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 shutdown_connections 2023-08-17T00:13:03.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.640+0000 7f421d3f9700 1 -- 172.21.15.153:0/2499177193 wait complete. 2023-08-17T00:13:03.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:13:03.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.828+0000 7f550c979700 1 Processor -- start 2023-08-17T00:13:03.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.828+0000 7f550c979700 1 -- start start 2023-08-17T00:13:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f550c979700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55080c57a0 0x7f55080c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f550c979700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5508153f50 0x7f5508154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:03.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f550c979700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55080bfd10 con 0x7f5508157600 2023-08-17T00:13:03.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f550c979700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5508154860 con 0x7f5508153f50 2023-08-17T00:13:03.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f550c979700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5508154af0 con 0x7f55080c57a0 2023-08-17T00:13:03.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5506ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5508153f50 0x7f5508154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:03.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5507fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5508157600 0x7f5508157a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38856/0 (socket says 172.21.15.153:38856) 2023-08-17T00:13:03.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5507fff700 1 -- 172.21.15.153:0/1338516616 learned_addr learned my addr 172.21.15.153:0/1338516616 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:03.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f55077fe700 1 --2- 172.21.15.153:0/1338516616 >> v2:172.21.15.178:3300/0 conn(0x7f55080c57a0 0x7f55080c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:03.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5506ffd700 1 -- 172.21.15.153:0/1338516616 >> v2:172.21.15.178:3300/0 conn(0x7f55080c57a0 msgr2=0x7f55080c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:03.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5506ffd700 1 --2- 172.21.15.153:0/1338516616 >> v2:172.21.15.178:3300/0 conn(0x7f55080c57a0 0x7f55080c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5506ffd700 1 -- 172.21.15.153:0/1338516616 >> v1:172.21.15.153:6789/0 conn(0x7f5508157600 legacy=0x7f5508157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:03.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5506ffd700 1 -- 172.21.15.153:0/1338516616 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508154dd0 con 0x7f5508153f50 2023-08-17T00:13:03.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.832+0000 7f5506ffd700 1 --2- 172.21.15.153:0/1338516616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5508153f50 0x7f5508154370 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f55080c54c0 tx=0x7f54fc009060).ready entity=mon.0 client_cookie=b9714ff716af4dce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f55067fc700 1 -- 172.21.15.153:0/1338516616 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00b580 con 0x7f5508153f50 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f55067fc700 1 -- 172.21.15.153:0/1338516616 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc00b6e0 con 0x7f5508153f50 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f55067fc700 1 -- 172.21.15.153:0/1338516616 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc00ba60 con 0x7f5508153f50 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 -- 172.21.15.153:0/1338516616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5508153f50 msgr2=0x7f5508154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 --2- 172.21.15.153:0/1338516616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5508153f50 0x7f5508154370 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 rx=0x7f55080c54c0 tx=0x7f54fc009060).stop 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 -- 172.21.15.153:0/1338516616 shutdown_connections 2023-08-17T00:13:03.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 --2- 172.21.15.153:0/1338516616 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5508153f50 0x7f5508154370 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 --2- 172.21.15.153:0/1338516616 >> v2:172.21.15.178:3300/0 conn(0x7f55080c57a0 0x7f55080c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 -- 172.21.15.153:0/1338516616 >> 172.21.15.153:0/1338516616 conn(0x7f5508062a70 msgr2=0x7f55080ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:03.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 -- 172.21.15.153:0/1338516616 shutdown_connections 2023-08-17T00:13:03.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.836+0000 7f550c979700 1 -- 172.21.15.153:0/1338516616 wait complete. 2023-08-17T00:13:03.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 Processor -- start 2023-08-17T00:13:03.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 -- start start 2023-08-17T00:13:03.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 0x7f5508168480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:03.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5508153f50 0x7f550814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:03.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5508157600 0x7f55080ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:03.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55080c2930 con 0x7f55080c57a0 2023-08-17T00:13:03.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5508168970 con 0x7f5508153f50 2023-08-17T00:13:03.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f550c979700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55080c1d20 con 0x7f5508157600 2023-08-17T00:13:03.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f55077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 0x7f5508168480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:03.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f55077fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 0x7f5508168480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47676/0 (socket says 172.21.15.153:47676) 2023-08-17T00:13:03.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f55077fe700 1 -- 172.21.15.153:0/3498829839 learned_addr learned my addr 172.21.15.153:0/3498829839 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:03.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.840+0000 7f5506ffd700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5508153f50 0x7f550814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:03.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f5507fff700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5508157600 0x7f55080ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:03.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f55077fe700 1 -- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5508157600 msgr2=0x7f55080ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:03.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f55077fe700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5508157600 0x7f55080ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f55077fe700 1 -- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5508153f50 msgr2=0x7f550814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:03.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f55077fe700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5508153f50 0x7f550814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:03.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f55077fe700 1 -- 172.21.15.153:0/3498829839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0092a0 con 0x7f55080c57a0 2023-08-17T00:13:03.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f55077fe700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 0x7f5508168480 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f54f800d860 tx=0x7f54f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:03.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011590 con 0x7f55080c57a0 2023-08-17T00:13:03.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f80116f0 con 0x7f55080c57a0 2023-08-17T00:13:03.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f8011a70 con 0x7f55080c57a0 2023-08-17T00:13:03.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55080c2000 con 0x7f55080c57a0 2023-08-17T00:13:03.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55080c25c0 con 0x7f55080c57a0 2023-08-17T00:13:03.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.844+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550806b4c0 con 0x7f55080c57a0 2023-08-17T00:13:03.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.848+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f54f8012420 con 0x7f55080c57a0 2023-08-17T00:13:03.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.848+0000 7f54ef7fe700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54f405a180 0x7f54f405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:03.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.848+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f54f8073a30 con 0x7f55080c57a0 2023-08-17T00:13:03.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.848+0000 7f5506ffd700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54f405a180 0x7f54f405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:03.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.848+0000 7f5506ffd700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54f405a180 0x7f54f405c640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f54fc009fd0 tx=0x7f54fc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:03.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:03.852+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54f8047670 con 0x7f55080c57a0 2023-08-17T00:13:04.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.016+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f55080bf9a0 con 0x7f55080c57a0 2023-08-17T00:13:04.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.024+0000 7f54ef7fe700 1 -- 172.21.15.153:0/3498829839 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f54f8011e60 con 0x7f55080c57a0 2023-08-17T00:13:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54f405a180 msgr2=0x7f54f405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54f405a180 0x7f54f405c640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f54fc009fd0 tx=0x7f54fc017000).stop 2023-08-17T00:13:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 msgr2=0x7f5508168480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 0x7f5508168480 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f54f800d860 tx=0x7f54f8008040).stop 2023-08-17T00:13:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 shutdown_connections 2023-08-17T00:13:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54f405a180 0x7f54f405c640 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5508157600 0x7f55080ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5508153f50 0x7f550814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 --2- 172.21.15.153:0/3498829839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55080c57a0 0x7f5508168480 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 >> 172.21.15.153:0/3498829839 conn(0x7f5508062a70 msgr2=0x7f5508063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 shutdown_connections 2023-08-17T00:13:04.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.028+0000 7f550c979700 1 -- 172.21.15.153:0/3498829839 wait complete. 2023-08-17T00:13:04.054 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:13:04.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:13:04.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:13:04.149 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:13:04.150 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:13:04.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:04.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7972439700 1 Processor -- start 2023-08-17T00:13:04.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7972439700 1 -- start start 2023-08-17T00:13:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7972439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 0x7f796c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7972439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0ab9b0 con 0x7f796c150880 2023-08-17T00:13:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7972439700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0691a0 con 0x7f796c068d10 2023-08-17T00:13:04.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7972439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0a9080 con 0x7f796c0aa8c0 2023-08-17T00:13:04.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7971437700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f796c150880 0x7f796c0a8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38862/0 (socket says 172.21.15.153:38862) 2023-08-17T00:13:04.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7971437700 1 -- 172.21.15.153:0/1183207360 learned_addr learned my addr 172.21.15.153:0/1183207360 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:04.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7970c36700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 0x7f796c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535991 0 0) 0x7f796c0ab9b0 con 0x7f796c150880 2023-08-17T00:13:04.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.304+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79580033f0 con 0x7f796c150880 2023-08-17T00:13:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227664865 0 0) 0x7f796c0691a0 con 0x7f796c068d10 2023-08-17T00:13:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f796c0ab9b0 con 0x7f796c068d10 2023-08-17T00:13:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209446260 0 0) 0x7f79580033f0 con 0x7f796c150880 2023-08-17T00:13:04.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 msgr2=0x7f796c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:04.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 0x7f796c068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 >> v1:172.21.15.178:6789/0 conn(0x7f796c068d10 legacy=0x7f796c064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0aada0 con 0x7f796c150880 2023-08-17T00:13:04.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f79680050e0 con 0x7f796c150880 2023-08-17T00:13:04.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 >> v1:172.21.15.153:6789/0 conn(0x7f796c150880 legacy=0x7f796c0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7958003aa0 0x7f7958003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 0x7f7958004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f7958005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0a9080 con 0x7f7958004b80 2023-08-17T00:13:04.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795800ba70 con 0x7f7958003aa0 2023-08-17T00:13:04.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795800bbb0 con 0x7f796c0aa8c0 2023-08-17T00:13:04.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f7958005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7970c36700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 0x7f7958004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971437700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7958003aa0 0x7f7958003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 -- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 msgr2=0x7f7958004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c0aa8c0 0x7f7958004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 -- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7958003aa0 msgr2=0x7f7958003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7958003aa0 0x7f7958003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 -- 172.21.15.153:0/1183207360 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580033f0 con 0x7f7958004b80 2023-08-17T00:13:04.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971437700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7958003aa0 0x7f7958003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f7958005000 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f79640018c0 tx=0x7f7964007bb0).ready entity=mon.0 client_cookie=a4d05a02c24c0278 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964007020 con 0x7f7958004b80 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964007180 con 0x7f7958004b80 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7963fff700 1 -- 172.21.15.153:0/1183207360 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964007500 con 0x7f7958004b80 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7972439700 1 -- 172.21.15.153:0/1183207360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 msgr2=0x7f7958005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7972439700 1 --2- 172.21.15.153:0/1183207360 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f7958005000 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 rx=0x7f79640018c0 tx=0x7f7964007bb0).stop 2023-08-17T00:13:04.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7971c38700 1 -- 172.21.15.153:0/1183207360 reap_dead start 2023-08-17T00:13:04.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7972439700 1 -- 172.21.15.153:0/1183207360 shutdown_connections 2023-08-17T00:13:04.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7972439700 1 -- 172.21.15.153:0/1183207360 >> 172.21.15.153:0/1183207360 conn(0x7f796c0c6620 msgr2=0x7f796c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:04.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7972439700 1 -- 172.21.15.153:0/1183207360 shutdown_connections 2023-08-17T00:13:04.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.308+0000 7f7972439700 1 -- 172.21.15.153:0/1183207360 wait complete. 2023-08-17T00:13:04.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.312+0000 7f7972439700 1 Processor -- start 2023-08-17T00:13:04.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.312+0000 7f7972439700 1 -- start start 2023-08-17T00:13:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.312+0000 7f7972439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f796c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.312+0000 7f7972439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c14d950 0x7f796c150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c151150 0x7f796c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0c4290 con 0x7f7958004b80 2023-08-17T00:13:04.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0c4e10 con 0x7f796c151150 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c0c44e0 con 0x7f796c14d950 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f796c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f796c14d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47698/0 (socket says 172.21.15.153:47698) 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 -- 172.21.15.153:0/4171922366 learned_addr learned my addr 172.21.15.153:0/4171922366 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7970c36700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c14d950 0x7f796c150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971c38700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c151150 0x7f796c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 -- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c14d950 msgr2=0x7f796c150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c14d950 0x7f796c150c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 -- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c151150 msgr2=0x7f796c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c151150 0x7f796c0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 -- 172.21.15.153:0/4171922366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0c47c0 con 0x7f7958004b80 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7971437700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f796c14d460 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f796800d9b0 tx=0x7f7968009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968007320 con 0x7f7958004b80 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79680055b0 con 0x7f7958004b80 2023-08-17T00:13:04.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c0c4aa0 con 0x7f7958004b80 2023-08-17T00:13:04.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968005930 con 0x7f7958004b80 2023-08-17T00:13:04.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0c5930 con 0x7f7958004b80 2023-08-17T00:13:04.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.316+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c06b4c0 con 0x7f7958004b80 2023-08-17T00:13:04.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.320+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7968005d60 con 0x7f7958004b80 2023-08-17T00:13:04.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.320+0000 7f79617fa700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795005a150 0x7f795005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.320+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f7968073c90 con 0x7f7958004b80 2023-08-17T00:13:04.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.320+0000 7f7970c36700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795005a150 0x7f795005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.320+0000 7f7970c36700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795005a150 0x7f795005c610 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f796c14dd50 tx=0x7f795c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:04.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.328+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7968047930 con 0x7f7958004b80 2023-08-17T00:13:04.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.520+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f796c0ab080 con 0x7f7958004b80 2023-08-17T00:13:04.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.524+0000 7f79617fa700 1 -- 172.21.15.153:0/4171922366 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+3537 (secure 0 0 0) 0x7f796804af50 con 0x7f7958004b80 2023-08-17T00:13:04.529 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:04.529 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":103,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2751245921","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2751245921},{"type":"v1","addr":"172.21.15.178:6835","nonce":2751245921}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1221399347","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1221399347},{"type":"v1","addr":"172.21.15.178:6837","nonce":1221399347}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7932,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6833/10352678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":10352678},{"type":"v1","addr":"172.21.15.153:6833","nonce":10352678}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":8391,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3066763181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6834","nonce":3066763181},{"type":"v1","addr":"172.21.15.153:6835","nonce":3066763181}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[]} 2023-08-17T00:13:04.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795005a150 msgr2=0x7f795005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795005a150 0x7f795005c610 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f796c14dd50 tx=0x7f795c008040).stop 2023-08-17T00:13:04.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 msgr2=0x7f796c14d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f796c14d460 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f796800d9b0 tx=0x7f7968009040).stop 2023-08-17T00:13:04.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 shutdown_connections 2023-08-17T00:13:04.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795005a150 0x7f795005c610 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f796c151150 0x7f796c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f796c14d950 0x7f796c150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 --2- 172.21.15.153:0/4171922366 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7958004b80 0x7f796c14d460 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 >> 172.21.15.153:0/4171922366 conn(0x7f796c0c6620 msgr2=0x7f796c14fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:04.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 shutdown_connections 2023-08-17T00:13:04.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.528+0000 7f7972439700 1 -- 172.21.15.153:0/4171922366 wait complete. 2023-08-17T00:13:04.536 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 103 2023-08-17T00:13:04.559 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:13:04.559 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:13:04.559 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:13:04.559 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:13:04.560 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:13:04.560 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:13:04.560 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:13:04.560 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:13:04.561 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:13:04.561 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:13:04.561 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:13:04.561 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:13:04.562 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:13:04.562 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:13:04.562 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:13:04.562 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:13:04.576 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:13:04.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:13:04.578 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:13:04.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:13:04.581 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:13:04.582 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:13:04.583 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:13:04.583 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:13:04.625 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:13:04.626 DEBUG:teuthology.parallel:result is None 2023-08-17T00:13:04.630 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:13:04.630 DEBUG:teuthology.parallel:result is None 2023-08-17T00:13:04.633 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:13:04.634 DEBUG:teuthology.parallel:result is None 2023-08-17T00:13:04.640 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:13:04.641 DEBUG:teuthology.parallel:result is None 2023-08-17T00:13:04.641 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:13:04.727 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:13:04.729 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:13:04.743 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:13:04.747 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:13:04.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 Processor -- start 2023-08-17T00:13:04.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 -- start start 2023-08-17T00:13:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840bdef0 0x7f47840c1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47840673f0 0x7f47840c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47840c3240 con 0x7f47840c36d0 2023-08-17T00:13:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4784154040 con 0x7f47840673f0 2023-08-17T00:13:04.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4789279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47840c2630 con 0x7f47840bdef0 2023-08-17T00:13:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47840673f0 0x7f47840c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f47840673f0 0x7f47840c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47748/0 (socket says 172.21.15.153:47748) 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 -- 172.21.15.153:0/2186313547 learned_addr learned my addr 172.21.15.153:0/2186313547 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4783fff700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840bdef0 0x7f47840c1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 -- 172.21.15.153:0/2186313547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840bdef0 msgr2=0x7f47840c1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840bdef0 0x7f47840c1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 -- 172.21.15.153:0/2186313547 >> v1:172.21.15.178:6789/0 conn(0x7f47840c36d0 legacy=0x7f4784066ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4788a78700 1 -- 172.21.15.153:0/2186313547 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47840c2910 con 0x7f47840673f0 2023-08-17T00:13:04.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.796+0000 7f4783fff700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840bdef0 0x7f47840c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:13:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4788a78700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840673f0 0x7f47840c20a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f477c009f20 tx=0x7f477c009840).ready entity=mon.0 client_cookie=d3a17691cc5c65c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:04.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4782ffd700 1 -- 172.21.15.153:0/2186313547 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00e070 con 0x7f47840673f0 2023-08-17T00:13:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4782ffd700 1 -- 172.21.15.153:0/2186313547 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c00ba80 con 0x7f47840673f0 2023-08-17T00:13:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4782ffd700 1 -- 172.21.15.153:0/2186313547 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c00be00 con 0x7f47840673f0 2023-08-17T00:13:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 -- 172.21.15.153:0/2186313547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840673f0 msgr2=0x7f47840c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840673f0 0x7f47840c20a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f477c009f20 tx=0x7f477c009840).stop 2023-08-17T00:13:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 -- 172.21.15.153:0/2186313547 shutdown_connections 2023-08-17T00:13:04.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840673f0 0x7f47840c20a0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 --2- 172.21.15.153:0/2186313547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840bdef0 0x7f47840c1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 -- 172.21.15.153:0/2186313547 >> 172.21.15.153:0/2186313547 conn(0x7f4784069740 msgr2=0x7f4784069b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 -- 172.21.15.153:0/2186313547 shutdown_connections 2023-08-17T00:13:04.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.800+0000 7f4789279700 1 -- 172.21.15.153:0/2186313547 wait complete. 2023-08-17T00:13:04.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 Processor -- start 2023-08-17T00:13:04.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 -- start start 2023-08-17T00:13:04.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840673f0 0x7f4784157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840bdef0 0x7f4784140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 0x7f4784155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784141030 con 0x7f47840c36d0 2023-08-17T00:13:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784156880 con 0x7f47840bdef0 2023-08-17T00:13:04.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4789279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784156b60 con 0x7f47840673f0 2023-08-17T00:13:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4788a78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 0x7f4784155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4788a78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 0x7f4784155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47756/0 (socket says 172.21.15.153:47756) 2023-08-17T00:13:04.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.804+0000 7f4788a78700 1 -- 172.21.15.153:0/1168763043 learned_addr learned my addr 172.21.15.153:0/1168763043 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4783fff700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840673f0 0x7f4784157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f47837fe700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840bdef0 0x7f4784140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4788a78700 1 -- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840673f0 msgr2=0x7f4784157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4788a78700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840673f0 0x7f4784157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4788a78700 1 -- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840bdef0 msgr2=0x7f4784140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4788a78700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840bdef0 0x7f4784140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:04.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4788a78700 1 -- 172.21.15.153:0/1168763043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c009ae0 con 0x7f47840c36d0 2023-08-17T00:13:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4788a78700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 0x7f4784155f50 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f47840c74e0 tx=0x7f477c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0092e0 con 0x7f47840c36d0 2023-08-17T00:13:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c01e470 con 0x7f47840c36d0 2023-08-17T00:13:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4784156e40 con 0x7f47840c36d0 2023-08-17T00:13:04.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c01e830 con 0x7f47840c36d0 2023-08-17T00:13:04.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784157400 con 0x7f47840c36d0 2023-08-17T00:13:04.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.808+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478406b4c0 con 0x7f47840c36d0 2023-08-17T00:13:04.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.812+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f477c025030 con 0x7f47840c36d0 2023-08-17T00:13:04.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.812+0000 7f476bfff700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f477005a180 0x7f477005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:04.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.812+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f477c075760 con 0x7f47840c36d0 2023-08-17T00:13:04.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.812+0000 7f4783fff700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f477005a180 0x7f477005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:04.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.812+0000 7f4783fff700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f477005a180 0x7f477005c640 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f477400abd0 tx=0x7f4774008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:04.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.820+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f477c049480 con 0x7f47840c36d0 2023-08-17T00:13:04.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:04.992+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f47840c2bf0 con 0x7f47840c36d0 2023-08-17T00:13:05.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.780+0000 7f476bfff700 1 -- 172.21.15.153:0/1168763043 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v136) v1 ==== 97+0+0 (secure 0 0 0) 0x7f477c023030 con 0x7f47840c36d0 2023-08-17T00:13:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f477005a180 msgr2=0x7f477005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f477005a180 0x7f477005c640 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f477400abd0 tx=0x7f4774008040).stop 2023-08-17T00:13:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 msgr2=0x7f4784155f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:05.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 0x7f4784155f50 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f47840c74e0 tx=0x7f477c009840).stop 2023-08-17T00:13:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 shutdown_connections 2023-08-17T00:13:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f477005a180 0x7f477005c640 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f47840c36d0 0x7f4784155f50 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47840bdef0 0x7f4784140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 --2- 172.21.15.153:0/1168763043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47840673f0 0x7f4784157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 >> 172.21.15.153:0/1168763043 conn(0x7f4784069740 msgr2=0x7f47840630b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:05.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.784+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 shutdown_connections 2023-08-17T00:13:05.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.788+0000 7f4789279700 1 -- 172.21.15.153:0/1168763043 wait complete. 2023-08-17T00:13:05.794 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:13:05.813 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:13:05.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.968+0000 7fb91951b700 1 Processor -- start 2023-08-17T00:13:05.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.968+0000 7fb91951b700 1 -- start start 2023-08-17T00:13:05.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb91951b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb914150c80 0x7fb9140ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:05.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb91951b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914154e50 0x7fb9141552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:05.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb91951b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb914066de0 con 0x7fb9141508a0 2023-08-17T00:13:05.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb91951b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9140ad7b0 con 0x7fb914150c80 2023-08-17T00:13:05.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb91951b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9141510e0 con 0x7fb914154e50 2023-08-17T00:13:05.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb914150c80 0x7fb9140ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:05.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb914150c80 0x7fb9140ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43474/0 (socket says 172.21.15.153:43474) 2023-08-17T00:13:05.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 -- 172.21.15.153:0/400288519 learned_addr learned my addr 172.21.15.153:0/400288519 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:05.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb913fff700 1 --2- 172.21.15.153:0/400288519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914154e50 0x7fb9141552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:05.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 -- 172.21.15.153:0/400288519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914154e50 msgr2=0x7fb9141552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:05.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 --2- 172.21.15.153:0/400288519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914154e50 0x7fb9141552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 -- 172.21.15.153:0/400288519 >> v1:172.21.15.178:6789/0 conn(0x7fb9141508a0 legacy=0x7fb914154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:05.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 -- 172.21.15.153:0/400288519 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9140ad9a0 con 0x7fb914150c80 2023-08-17T00:13:05.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb90a7fc700 1 --2- 172.21.15.153:0/400288519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb914150c80 0x7fb9140ad2c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fb8fc009830 tx=0x7fb8fc0090f0).ready entity=mon.0 client_cookie=8e680d0ce8c3ca60 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:05.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb9127fc700 1 -- 172.21.15.153:0/400288519 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00b580 con 0x7fb914150c80 2023-08-17T00:13:05.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb9127fc700 1 -- 172.21.15.153:0/400288519 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00b6e0 con 0x7fb914150c80 2023-08-17T00:13:05.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.972+0000 7fb9127fc700 1 -- 172.21.15.153:0/400288519 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00ba80 con 0x7fb914150c80 2023-08-17T00:13:05.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 -- 172.21.15.153:0/400288519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb914150c80 msgr2=0x7fb9140ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:05.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 --2- 172.21.15.153:0/400288519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb914150c80 0x7fb9140ad2c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7fb8fc009830 tx=0x7fb8fc0090f0).stop 2023-08-17T00:13:05.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 -- 172.21.15.153:0/400288519 shutdown_connections 2023-08-17T00:13:05.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 --2- 172.21.15.153:0/400288519 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914154e50 0x7fb9141552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 --2- 172.21.15.153:0/400288519 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb914150c80 0x7fb9140ad2c0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 -- 172.21.15.153:0/400288519 >> 172.21.15.153:0/400288519 conn(0x7fb9140c4950 msgr2=0x7fb9140c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:05.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 -- 172.21.15.153:0/400288519 shutdown_connections 2023-08-17T00:13:05.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 -- 172.21.15.153:0/400288519 wait complete. 2023-08-17T00:13:05.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 Processor -- start 2023-08-17T00:13:05.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.976+0000 7fb91951b700 1 -- start start 2023-08-17T00:13:05.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 0x7fb914149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:05.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914150c80 0x7fb914164b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:05.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb914154e50 0x7fb914147fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:05.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb914149820 con 0x7fb9141508a0 2023-08-17T00:13:05.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91414a300 con 0x7fb914154e50 2023-08-17T00:13:05.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb914149a60 con 0x7fb914150c80 2023-08-17T00:13:05.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 0x7fb914149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:05.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 0x7fb914149330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43484/0 (socket says 172.21.15.153:43484) 2023-08-17T00:13:05.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 -- 172.21.15.153:0/4244925112 learned_addr learned my addr 172.21.15.153:0/4244925112 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:05.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb913fff700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb914154e50 0x7fb914147fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:05.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb90a7fc700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914150c80 0x7fb914164b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 -- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914150c80 msgr2=0x7fb914164b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914150c80 0x7fb914164b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 -- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb914154e50 msgr2=0x7fb914147fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb914154e50 0x7fb914147fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 -- 172.21.15.153:0/4244925112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc009370 con 0x7fb9141508a0 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb913fff700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb914154e50 0x7fb914147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:05.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb912ffd700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 0x7fb914149330 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fb90400c4c0 tx=0x7fb904007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904007020 con 0x7fb9141508a0 2023-08-17T00:13:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904001e90 con 0x7fb9141508a0 2023-08-17T00:13:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb914149d40 con 0x7fb9141508a0 2023-08-17T00:13:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040073b0 con 0x7fb9141508a0 2023-08-17T00:13:05.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.980+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9140c0290 con 0x7fb9141508a0 2023-08-17T00:13:05.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.984+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91406b530 con 0x7fb9141508a0 2023-08-17T00:13:05.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.984+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb904010070 con 0x7fb9141508a0 2023-08-17T00:13:05.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.984+0000 7fb90b7fe700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb8f805a150 0x7fb8f805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:05.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.984+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb904073710 con 0x7fb9141508a0 2023-08-17T00:13:05.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.984+0000 7fb90a7fc700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb8f805a150 0x7fb8f805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:05.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.988+0000 7fb90a7fc700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb8f805a150 0x7fb8f805c610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fb914148d00 tx=0x7fb8fc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:05.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:05.992+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb904047400 con 0x7fb9141508a0 2023-08-17T00:13:06.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.200+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb9140664b0 con 0x7fb9141508a0 2023-08-17T00:13:06.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb90b7fe700 1 -- 172.21.15.153:0/4244925112 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb90404aa20 con 0x7fb9141508a0 2023-08-17T00:13:06.209 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.210 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:13:06.211 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.212 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:13:06.213 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:13:06.215 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:13:06.216 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.218 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:13:06.218 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:13:06.218 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.218 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.219 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.219 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.219 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.220 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.221 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:13:06.222 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.223 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.223 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.223 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.223 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.224 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:13:06.224 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:13:06.224 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.224 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.225 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.225 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.225 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.226 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:13:06.226 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:13:06.226 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.226 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:13:06.227 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.228 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:13:06.229 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:13:06.229 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.229 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.229 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:13:06.229 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:13:06.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:13:06.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.230 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.230 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.230 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:13:06.230 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:13:06.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:13:06.233 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:13:06.234 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.235 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:13:06.235 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:13:06.235 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.236 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:06.236 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:06.236 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:13:06.237 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:13:06.237 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:13:06.238 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:13:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb8f805a150 msgr2=0x7fb8f805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb8f805a150 0x7fb8f805c610 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fb914148d00 tx=0x7fb8fc017000).stop 2023-08-17T00:13:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 msgr2=0x7fb914149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 0x7fb914149330 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 rx=0x7fb90400c4c0 tx=0x7fb904007e00).stop 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 shutdown_connections 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb8f805a150 0x7fb8f805c610 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb914154e50 0x7fb914147fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb914150c80 0x7fb914164b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 --2- 172.21.15.153:0/4244925112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9141508a0 0x7fb914149330 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 >> 172.21.15.153:0/4244925112 conn(0x7fb9140c4950 msgr2=0x7fb9140c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 shutdown_connections 2023-08-17T00:13:06.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.204+0000 7fb91951b700 1 -- 172.21.15.153:0/4244925112 wait complete. 2023-08-17T00:13:06.242 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:13:06.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 Processor -- start 2023-08-17T00:13:06.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 -- start start 2023-08-17T00:13:06.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f178c0689c0 0x7f178c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c065da0 con 0x7f178c1560f0 2023-08-17T00:13:06.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c155c60 con 0x7f178c0689c0 2023-08-17T00:13:06.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.388+0000 7f1791507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c156550 con 0x7f178c151530 2023-08-17T00:13:06.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f178c0689c0 0x7f178c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f178c0689c0 0x7f178c068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43490/0 (socket says 172.21.15.153:43490) 2023-08-17T00:13:06.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 -- 172.21.15.153:0/4218078561 learned_addr learned my addr 172.21.15.153:0/4218078561 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1790d06700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 -- 172.21.15.153:0/4218078561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 msgr2=0x7f178c1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 -- 172.21.15.153:0/4218078561 >> v1:172.21.15.178:6789/0 conn(0x7f178c1560f0 legacy=0x7f178c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 -- 172.21.15.153:0/4218078561 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c065ff0 con 0x7f178c0689c0 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1790d06700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:06.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178bfff700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c068da0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f177c009810 tx=0x7f177c009060).ready entity=mon.0 client_cookie=8b4b6c6a5c4a30b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:06.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178affd700 1 -- 172.21.15.153:0/4218078561 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00b640 con 0x7f178c0689c0 2023-08-17T00:13:06.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178affd700 1 -- 172.21.15.153:0/4218078561 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00b7a0 con 0x7f178c0689c0 2023-08-17T00:13:06.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f178affd700 1 -- 172.21.15.153:0/4218078561 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00bb20 con 0x7f178c0689c0 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 -- 172.21.15.153:0/4218078561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 msgr2=0x7f178c068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c068da0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f177c009810 tx=0x7f177c009060).stop 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 -- 172.21.15.153:0/4218078561 shutdown_connections 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 --2- 172.21.15.153:0/4218078561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c068da0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 -- 172.21.15.153:0/4218078561 >> 172.21.15.153:0/4218078561 conn(0x7f178c0c6620 msgr2=0x7f178c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:06.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 -- 172.21.15.153:0/4218078561 shutdown_connections 2023-08-17T00:13:06.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.392+0000 7f1791507700 1 -- 172.21.15.153:0/4218078561 wait complete. 2023-08-17T00:13:06.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 Processor -- start 2023-08-17T00:13:06.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 -- start start 2023-08-17T00:13:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c165140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f178c1560f0 0x7f178c154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c164cb0 con 0x7f178c0689c0 2023-08-17T00:13:06.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1646a0 con 0x7f178c1560f0 2023-08-17T00:13:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1791507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c154df0 con 0x7f178c151530 2023-08-17T00:13:06.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f178bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f178bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c165140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43506/0 (socket says 172.21.15.153:43506) 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f178bfff700 1 -- 172.21.15.153:0/1144966121 learned_addr learned my addr 172.21.15.153:0/1144966121 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f178b7fe700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.396+0000 7f1790d06700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f178c1560f0 0x7f178c154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f178bfff700 1 -- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 msgr2=0x7f178c0a5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f178bfff700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c0a5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f178bfff700 1 -- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f178c1560f0 msgr2=0x7f178c154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f178bfff700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f178c1560f0 0x7f178c154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f178bfff700 1 -- 172.21.15.153:0/1144966121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c009300 con 0x7f178c0689c0 2023-08-17T00:13:06.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1790d06700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f178c1560f0 0x7f178c154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:06.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f178bfff700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c165140 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f178c0667d0 tx=0x7f177c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00b640 con 0x7f178c0689c0 2023-08-17T00:13:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177c00b910 con 0x7f178c0689c0 2023-08-17T00:13:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c164940 con 0x7f178c0689c0 2023-08-17T00:13:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c01b440 con 0x7f178c0689c0 2023-08-17T00:13:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0a74c0 con 0x7f178c0689c0 2023-08-17T00:13:06.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.400+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c0bfad0 con 0x7f178c0689c0 2023-08-17T00:13:06.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.404+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f177c022030 con 0x7f178c0689c0 2023-08-17T00:13:06.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.404+0000 7f1773fff700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f177805a150 0x7f177805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.404+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f177c074970 con 0x7f178c0689c0 2023-08-17T00:13:06.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.404+0000 7f178b7fe700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f177805a150 0x7f177805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.404+0000 7f178b7fe700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f177805a150 0x7f177805c610 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f1780004290 tx=0x7f1780001560).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:06.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.408+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f177c048710 con 0x7f178c0689c0 2023-08-17T00:13:06.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.568+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f178c06b4c0 con 0x7f178c0689c0 2023-08-17T00:13:06.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1773fff700 1 -- 172.21.15.153:0/1144966121 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f177c020070 con 0x7f178c0689c0 2023-08-17T00:13:06.577 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:06.578 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":136,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:13:05.775231+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:13:06.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f177805a150 msgr2=0x7f177805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f177805a150 0x7f177805c610 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f1780004290 tx=0x7f1780001560).stop 2023-08-17T00:13:06.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 msgr2=0x7f178c165140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c165140 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f178c0667d0 tx=0x7f177c017000).stop 2023-08-17T00:13:06.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 shutdown_connections 2023-08-17T00:13:06.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f177805a150 0x7f177805c610 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f178c1560f0 0x7f178c154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178c151530 0x7f178c0a5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 --2- 172.21.15.153:0/1144966121 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f178c0689c0 0x7f178c165140 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 >> 172.21.15.153:0/1144966121 conn(0x7f178c0c6620 msgr2=0x7f178c0645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:06.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 shutdown_connections 2023-08-17T00:13:06.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.572+0000 7f1791507700 1 -- 172.21.15.153:0/1144966121 wait complete. 2023-08-17T00:13:06.599 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:13:06.601 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:13:06.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 Processor -- start 2023-08-17T00:13:06.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 -- start start 2023-08-17T00:13:06.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21c0154af0 0x7f21c00a6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21c0155ee0 0x7f21c00bead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c00c2cd0 con 0x7f21c00be640 2023-08-17T00:13:06.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00c3570 con 0x7f21c0155ee0 2023-08-17T00:13:06.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c6507700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c0156310 con 0x7f21c0154af0 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21c0155ee0 0x7f21c00bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f21c0155ee0 0x7f21c00bead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43508/0 (socket says 172.21.15.153:43508) 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 -- 172.21.15.153:0/224004087 learned_addr learned my addr 172.21.15.153:0/224004087 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5505700 1 --2- 172.21.15.153:0/224004087 >> v2:172.21.15.178:3300/0 conn(0x7f21c0154af0 0x7f21c00a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 -- 172.21.15.153:0/224004087 >> v2:172.21.15.178:3300/0 conn(0x7f21c0154af0 msgr2=0x7f21c00a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 --2- 172.21.15.153:0/224004087 >> v2:172.21.15.178:3300/0 conn(0x7f21c0154af0 0x7f21c00a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 -- 172.21.15.153:0/224004087 >> v1:172.21.15.178:6789/0 conn(0x7f21c00be640 legacy=0x7f21c00a5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:06.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.760+0000 7f21c5d06700 1 -- 172.21.15.153:0/224004087 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c00befc0 con 0x7f21c0155ee0 2023-08-17T00:13:06.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c5d06700 1 --2- 172.21.15.153:0/224004087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c0155ee0 0x7f21c00bead0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f21c00696d0 tx=0x7f21b8009840).ready entity=mon.0 client_cookie=caad4aa9435076e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:06.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21b7fff700 1 -- 172.21.15.153:0/224004087 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800e070 con 0x7f21c0155ee0 2023-08-17T00:13:06.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21b7fff700 1 -- 172.21.15.153:0/224004087 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800ba10 con 0x7f21c0155ee0 2023-08-17T00:13:06.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21b7fff700 1 -- 172.21.15.153:0/224004087 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800bd90 con 0x7f21c0155ee0 2023-08-17T00:13:06.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 -- 172.21.15.153:0/224004087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c0155ee0 msgr2=0x7f21c00bead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 --2- 172.21.15.153:0/224004087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c0155ee0 0x7f21c00bead0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 rx=0x7f21c00696d0 tx=0x7f21b8009840).stop 2023-08-17T00:13:06.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 -- 172.21.15.153:0/224004087 shutdown_connections 2023-08-17T00:13:06.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 --2- 172.21.15.153:0/224004087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c0155ee0 0x7f21c00bead0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 --2- 172.21.15.153:0/224004087 >> v2:172.21.15.178:3300/0 conn(0x7f21c0154af0 0x7f21c00a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 -- 172.21.15.153:0/224004087 >> 172.21.15.153:0/224004087 conn(0x7f21c00c5170 msgr2=0x7f21c00c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:06.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 -- 172.21.15.153:0/224004087 shutdown_connections 2023-08-17T00:13:06.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.764+0000 7f21c6507700 1 -- 172.21.15.153:0/224004087 wait complete. 2023-08-17T00:13:06.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 Processor -- start 2023-08-17T00:13:06.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 -- start start 2023-08-17T00:13:06.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 0x7f21c01451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c0154af0 0x7f21c00ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c0155ee0 0x7f21c00ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0066220 con 0x7f21c00be640 2023-08-17T00:13:06.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01456c0 con 0x7f21c0155ee0 2023-08-17T00:13:06.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c6507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0065610 con 0x7f21c0154af0 2023-08-17T00:13:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 0x7f21c01451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 0x7f21c01451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43524/0 (socket says 172.21.15.153:43524) 2023-08-17T00:13:06.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 -- 172.21.15.153:0/1138577277 learned_addr learned my addr 172.21.15.153:0/1138577277 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5d06700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c0155ee0 0x7f21c00ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c4d04700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c0154af0 0x7f21c00ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 -- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c0154af0 msgr2=0x7f21c00ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c0154af0 0x7f21c00ac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 -- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c0155ee0 msgr2=0x7f21c00ac670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c0155ee0 0x7f21c00ac670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 -- 172.21.15.153:0/1138577277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009ae0 con 0x7f21c00be640 2023-08-17T00:13:06.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c4d04700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c0154af0 0x7f21c00ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:13:06.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21c5505700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 0x7f21c01451d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f21bc00d860 tx=0x7f21bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:06.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.768+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0125f0 con 0x7f21c00be640 2023-08-17T00:13:06.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.772+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc012750 con 0x7f21c00be640 2023-08-17T00:13:06.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.772+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c00658f0 con 0x7f21c00be640 2023-08-17T00:13:06.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.772+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc012ad0 con 0x7f21c00be640 2023-08-17T00:13:06.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.772+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c0065eb0 con 0x7f21c00be640 2023-08-17T00:13:06.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.772+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c006b4c0 con 0x7f21c00be640 2023-08-17T00:13:06.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.772+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f21bc013480 con 0x7f21c00be640 2023-08-17T00:13:06.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.776+0000 7f21b57fa700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f21a405a150 0x7f21a405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:06.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.776+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f21bc0742e0 con 0x7f21c00be640 2023-08-17T00:13:06.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.776+0000 7f21c4d04700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f21a405a150 0x7f21a405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:06.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.776+0000 7f21c4d04700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f21a405a150 0x7f21a405c610 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f21c0148e30 tx=0x7f21b0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:06.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.780+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f21bc048080 con 0x7f21c00be640 2023-08-17T00:13:06.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.936+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f21c00a6e90 con 0x7f21c00be640 2023-08-17T00:13:06.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.936+0000 7f21b57fa700 1 -- 172.21.15.153:0/1138577277 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v136) v1 ==== 110+0+10 (secure 0 0 0) 0x7f21bc04b6a0 con 0x7f21c00be640 2023-08-17T00:13:06.944 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:13:06.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.940+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f21a405a150 msgr2=0x7f21a405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.940+0000 7f21c6507700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f21a405a150 0x7f21a405c610 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f21c0148e30 tx=0x7f21b0009040).stop 2023-08-17T00:13:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.940+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 msgr2=0x7f21c01451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:06.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.940+0000 7f21c6507700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 0x7f21c01451d0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7f21bc00d860 tx=0x7f21bc008040).stop 2023-08-17T00:13:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 shutdown_connections 2023-08-17T00:13:06.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f21a405a150 0x7f21a405c610 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f21c0155ee0 0x7f21c00ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21c0154af0 0x7f21c00ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 --2- 172.21.15.153:0/1138577277 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f21c00be640 0x7f21c01451d0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 >> 172.21.15.153:0/1138577277 conn(0x7f21c00c5170 msgr2=0x7f21c014f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 shutdown_connections 2023-08-17T00:13:06.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:06.944+0000 7f21c6507700 1 -- 172.21.15.153:0/1138577277 wait complete. 2023-08-17T00:13:06.968 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 Processor -- start 2023-08-17T00:13:07.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 -- start start 2023-08-17T00:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c069630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf1c065d90 0x7fdf1c0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf1c0661f0 0x7fdf1c0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c154ae0 con 0x7fdf1c0661f0 2023-08-17T00:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c064fd0 con 0x7fdf1c065d90 2023-08-17T00:13:07.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0652b0 con 0x7fdf1c069250 2023-08-17T00:13:07.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf1c0661f0 0x7fdf1c0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf1c0661f0 0x7fdf1c0c0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43540/0 (socket says 172.21.15.153:43540) 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21106700 1 -- 172.21.15.153:0/1780821479 learned_addr learned my addr 172.21.15.153:0/1780821479 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf20905700 1 --2- 172.21.15.153:0/1780821479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c069630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf1bfff700 1 --2- 172.21.15.153:0/1780821479 >> v2:172.21.15.178:3300/0 conn(0x7fdf1c065d90 0x7fdf1c0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21106700 1 -- 172.21.15.153:0/1780821479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 msgr2=0x7fdf1c069630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.128+0000 7fdf21106700 1 --2- 172.21.15.153:0/1780821479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c069630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21106700 1 -- 172.21.15.153:0/1780821479 >> v2:172.21.15.178:3300/0 conn(0x7fdf1c065d90 msgr2=0x7fdf1c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:07.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21106700 1 --2- 172.21.15.153:0/1780821479 >> v2:172.21.15.178:3300/0 conn(0x7fdf1c065d90 0x7fdf1c0c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21106700 1 -- 172.21.15.153:0/1780821479 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c065590 con 0x7fdf1c0661f0 2023-08-17T00:13:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21106700 1 --2- 172.21.15.153:0/1780821479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c0661f0 0x7fdf1c0c0f70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fdf1c069c50 tx=0x7fdf1400a950).ready entity=mon.0 client_cookie=974e7dac6702001c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf1b7fe700 1 -- 172.21.15.153:0/1780821479 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400f070 con 0x7fdf1c0661f0 2023-08-17T00:13:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf1b7fe700 1 -- 172.21.15.153:0/1780821479 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf1400cdc0 con 0x7fdf1c0661f0 2023-08-17T00:13:07.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf1b7fe700 1 -- 172.21.15.153:0/1780821479 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1400a2e0 con 0x7fdf1c0661f0 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 -- 172.21.15.153:0/1780821479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c0661f0 msgr2=0x7fdf1c0c0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 --2- 172.21.15.153:0/1780821479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c0661f0 0x7fdf1c0c0f70 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fdf1c069c50 tx=0x7fdf1400a950).stop 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 -- 172.21.15.153:0/1780821479 shutdown_connections 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 --2- 172.21.15.153:0/1780821479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c0661f0 0x7fdf1c0c0f70 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 --2- 172.21.15.153:0/1780821479 >> v2:172.21.15.178:3300/0 conn(0x7fdf1c065d90 0x7fdf1c0c0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 --2- 172.21.15.153:0/1780821479 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c069630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 -- 172.21.15.153:0/1780821479 >> 172.21.15.153:0/1780821479 conn(0x7fdf1c0c6620 msgr2=0x7fdf1c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 -- 172.21.15.153:0/1780821479 shutdown_connections 2023-08-17T00:13:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.132+0000 7fdf21907700 1 -- 172.21.15.153:0/1780821479 wait complete. 2023-08-17T00:13:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 Processor -- start 2023-08-17T00:13:07.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 -- start start 2023-08-17T00:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 0x7fdf1c164280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c0a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c0a5f20 0x7fdf1c0a78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c167f10 con 0x7fdf1c065d90 2023-08-17T00:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0a6380 con 0x7fdf1c0a5f20 2023-08-17T00:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c168160 con 0x7fdf1c069250 2023-08-17T00:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 0x7fdf1c164280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 0x7fdf1c164280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43546/0 (socket says 172.21.15.153:43546) 2023-08-17T00:13:07.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 -- 172.21.15.153:0/166539009 learned_addr learned my addr 172.21.15.153:0/166539009 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21106700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c0a5f20 0x7fdf1c0a78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf1bfff700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c0a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 -- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 msgr2=0x7fdf1c0a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c0a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 -- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c0a5f20 msgr2=0x7fdf1c0a78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c0a5f20 0x7fdf1c0a78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 -- 172.21.15.153:0/166539009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1400abf0 con 0x7fdf1c065d90 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf20905700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 0x7fdf1c164280 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7fdf1000d680 tx=0x7fdf10008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011590 con 0x7fdf1c065d90 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf100116f0 con 0x7fdf1c065d90 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c168440 con 0x7fdf1c065d90 2023-08-17T00:13:07.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011a70 con 0x7fdf1c065d90 2023-08-17T00:13:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.136+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c168a00 con 0x7fdf1c065d90 2023-08-17T00:13:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.140+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c06b4c0 con 0x7fdf1c065d90 2023-08-17T00:13:07.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.140+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdf1001c460 con 0x7fdf1c065d90 2023-08-17T00:13:07.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.144+0000 7fdf18ff9700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf0005a150 0x7fdf0005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.144+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdf10073ff0 con 0x7fdf1c065d90 2023-08-17T00:13:07.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.144+0000 7fdf1bfff700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf0005a150 0x7fdf0005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.144+0000 7fdf1bfff700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf0005a150 0x7fdf0005c610 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fdf1c0a7690 tx=0x7fdf08008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.148+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf100a28f0 con 0x7fdf1c065d90 2023-08-17T00:13:07.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.308+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdf1c065870 con 0x7fdf1c065d90 2023-08-17T00:13:07.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.308+0000 7fdf18ff9700 1 -- 172.21.15.153:0/166539009 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v136) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdf10047c80 con 0x7fdf1c065d90 2023-08-17T00:13:07.314 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:13:07.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf0005a150 msgr2=0x7fdf0005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf0005a150 0x7fdf0005c610 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7fdf1c0a7690 tx=0x7fdf08008040).stop 2023-08-17T00:13:07.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 msgr2=0x7fdf1c164280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 0x7fdf1c164280 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 rx=0x7fdf1000d680 tx=0x7fdf10008040).stop 2023-08-17T00:13:07.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 shutdown_connections 2023-08-17T00:13:07.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf0005a150 0x7fdf0005c610 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf1c0a5f20 0x7fdf1c0a78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf1c069250 0x7fdf1c0a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 --2- 172.21.15.153:0/166539009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf1c065d90 0x7fdf1c164280 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 >> 172.21.15.153:0/166539009 conn(0x7fdf1c0c6620 msgr2=0x7fdf1c0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:07.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 shutdown_connections 2023-08-17T00:13:07.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.312+0000 7fdf21907700 1 -- 172.21.15.153:0/166539009 wait complete. 2023-08-17T00:13:07.337 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:13:07.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.484+0000 7f3ebebf9700 1 Processor -- start 2023-08-17T00:13:07.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebebf9700 1 -- start start 2023-08-17T00:13:07.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebebf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb8068f30 0x7f3eb80c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebebf9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb81545e0 con 0x7f3eb80abf10 2023-08-17T00:13:07.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebebf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb80a96d0 con 0x7f3eb80ac2f0 2023-08-17T00:13:07.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebebf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80c1c50 con 0x7f3eb8068f30 2023-08-17T00:13:07.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebdbf7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3eb80abf10 0x7f3eb8068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56294/0 (socket says 172.21.15.153:56294) 2023-08-17T00:13:07.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.488+0000 7f3ebdbf7700 1 -- 172.21.15.153:0/368948771 learned_addr learned my addr 172.21.15.153:0/368948771 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:07.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebd3f6700 1 --2- 172.21.15.153:0/368948771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb8068f30 0x7f3eb80c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebcbf5700 1 -- 172.21.15.153:0/368948771 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882589806 0 0) 0x7f3eb81545e0 con 0x7f3eb80abf10 2023-08-17T00:13:07.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebcbf5700 1 -- 172.21.15.153:0/368948771 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea40033f0 con 0x7f3eb80abf10 2023-08-17T00:13:07.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebcbf5700 1 -- 172.21.15.153:0/368948771 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805209235 0 0) 0x7f3eb80a96d0 con 0x7f3eb80ac2f0 2023-08-17T00:13:07.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/368948771 >> v1:172.21.15.178:6789/0 conn(0x7f3eb80ac2f0 legacy=0x7f3eb8156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/368948771 >> v1:172.21.15.153:6789/0 conn(0x7f3eb80abf10 legacy=0x7f3eb8068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/368948771 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb8064b80 con 0x7f3eb8068f30 2023-08-17T00:13:07.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebd3f6700 1 --2- 172.21.15.153:0/368948771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb8068f30 0x7f3eb80c0a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3ea8009790 tx=0x7f3ea8009060).ready entity=mon.2 client_cookie=8d20348ac6346bd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebcbf5700 1 -- 172.21.15.153:0/368948771 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80090d0 con 0x7f3eb8068f30 2023-08-17T00:13:07.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebcbf5700 1 -- 172.21.15.153:0/368948771 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea800f510 con 0x7f3eb8068f30 2023-08-17T00:13:07.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebcbf5700 1 -- 172.21.15.153:0/368948771 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800f890 con 0x7f3eb8068f30 2023-08-17T00:13:07.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 -- 172.21.15.153:0/368948771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb8068f30 msgr2=0x7f3eb80c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/368948771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb8068f30 0x7f3eb80c0a80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f3ea8009790 tx=0x7f3ea8009060).stop 2023-08-17T00:13:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 -- 172.21.15.153:0/368948771 shutdown_connections 2023-08-17T00:13:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/368948771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb8068f30 0x7f3eb80c0a80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 -- 172.21.15.153:0/368948771 >> 172.21.15.153:0/368948771 conn(0x7f3eb80c6620 msgr2=0x7f3eb80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 -- 172.21.15.153:0/368948771 shutdown_connections 2023-08-17T00:13:07.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.492+0000 7f3ebebf9700 1 -- 172.21.15.153:0/368948771 wait complete. 2023-08-17T00:13:07.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 Processor -- start 2023-08-17T00:13:07.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 -- start start 2023-08-17T00:13:07.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb8068f30 0x7f3eb80bb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 0x7f3eb8166e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80ac2f0 0x7f3eb81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb814c710 con 0x7f3eb80abf10 2023-08-17T00:13:07.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80bc4b0 con 0x7f3eb8068f30 2023-08-17T00:13:07.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebebf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb80bb930 con 0x7f3eb80ac2f0 2023-08-17T00:13:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.496+0000 7f3ebd3f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 0x7f3eb8166e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 0x7f3eb8166e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43552/0 (socket says 172.21.15.153:43552) 2023-08-17T00:13:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/2591776375 learned_addr learned my addr 172.21.15.153:0/2591776375 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:07.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebe3f8700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80ac2f0 0x7f3eb81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebdbf7700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb8068f30 0x7f3eb80bb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80ac2f0 msgr2=0x7f3eb81502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80ac2f0 0x7f3eb81502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb8068f30 msgr2=0x7f3eb80bb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb8068f30 0x7f3eb80bb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 -- 172.21.15.153:0/2591776375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80092a0 con 0x7f3eb80abf10 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebdbf7700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb8068f30 0x7f3eb80bb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebd3f6700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 0x7f3eb8166e90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f3eb80668e0 tx=0x7f3ea8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800f890 con 0x7f3eb80abf10 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea8000c40 con 0x7f3eb80abf10 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb80bbc10 con 0x7f3eb80abf10 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea800fe60 con 0x7f3eb80abf10 2023-08-17T00:13:07.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb80bc1d0 con 0x7f3eb80abf10 2023-08-17T00:13:07.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.500+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb806b4c0 con 0x7f3eb80abf10 2023-08-17T00:13:07.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.504+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3ea800f070 con 0x7f3eb80abf10 2023-08-17T00:13:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.504+0000 7f3eadffb700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9c05a150 0x7f3e9c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.504+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f3ea80756b0 con 0x7f3eb80abf10 2023-08-17T00:13:07.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.504+0000 7f3ebdbf7700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9c05a150 0x7f3e9c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.508+0000 7f3ebdbf7700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9c05a150 0x7f3e9c05c610 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f3eb4000c00 tx=0x7f3eb4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.512+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ea80493a0 con 0x7f3eb80abf10 2023-08-17T00:13:07.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.676+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3eb8064010 con 0x7f3eb80abf10 2023-08-17T00:13:07.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.676+0000 7f3eadffb700 1 -- 172.21.15.153:0/2591776375 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) v1 ==== 84+0+143 (secure 0 0 0) 0x7f3ea80280a0 con 0x7f3eb80abf10 2023-08-17T00:13:07.682 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:07.683 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:13:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:13:07.683 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:13:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:13:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:13:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:13:07.684 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:13:07.685 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:07.685 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:13:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9c05a150 msgr2=0x7f3e9c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9c05a150 0x7f3e9c05c610 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f3eb4000c00 tx=0x7f3eb4009040).stop 2023-08-17T00:13:07.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 msgr2=0x7f3eb8166e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 0x7f3eb8166e90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 rx=0x7f3eb80668e0 tx=0x7f3ea8017000).stop 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 shutdown_connections 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e9c05a150 0x7f3e9c05c610 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3eb80ac2f0 0x7f3eb81502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3eb80abf10 0x7f3eb8166e90 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 --2- 172.21.15.153:0/2591776375 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3eb8068f30 0x7f3eb80bb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 >> 172.21.15.153:0/2591776375 conn(0x7f3eb80c6620 msgr2=0x7f3eb814dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:07.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 shutdown_connections 2023-08-17T00:13:07.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.680+0000 7f3ebebf9700 1 -- 172.21.15.153:0/2591776375 wait complete. 2023-08-17T00:13:07.709 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:13:07.710 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:13:07.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.872+0000 7f8fef59e700 1 Processor -- start 2023-08-17T00:13:07.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.872+0000 7f8fef59e700 1 -- start start 2023-08-17T00:13:07.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fef59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8ff01539b0 0x7f8ff00632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fef59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff00c00d0 con 0x7f8ff00a9eb0 2023-08-17T00:13:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fef59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff00bf810 con 0x7f8ff0153d90 2023-08-17T00:13:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fef59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff00aa910 con 0x7f8ff01539b0 2023-08-17T00:13:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8feed9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8ff00a9eb0 0x7f8ff00c0560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56302/0 (socket says 172.21.15.153:56302) 2023-08-17T00:13:07.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8feed9d700 1 -- 172.21.15.153:0/3530404397 learned_addr learned my addr 172.21.15.153:0/3530404397 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:07.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fee59c700 1 --2- 172.21.15.153:0/3530404397 >> v2:172.21.15.178:3300/0 conn(0x7f8ff01539b0 0x7f8ff00632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885046942 0 0) 0x7f8ff00c00d0 con 0x7f8ff00a9eb0 2023-08-17T00:13:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fd80033f0 con 0x7f8ff00a9eb0 2023-08-17T00:13:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 596432842 0 0) 0x7f8fd80033f0 con 0x7f8ff00a9eb0 2023-08-17T00:13:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 >> v2:172.21.15.178:3300/0 conn(0x7f8ff01539b0 msgr2=0x7f8ff00632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 --2- 172.21.15.153:0/3530404397 >> v2:172.21.15.178:3300/0 conn(0x7f8ff01539b0 0x7f8ff00632b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 >> v1:172.21.15.178:6789/0 conn(0x7f8ff0153d90 legacy=0x7f8ff00a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00bfa80 con 0x7f8ff00a9eb0 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f8fe80017f0 con 0x7f8ff00a9eb0 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 >> v1:172.21.15.153:6789/0 conn(0x7f8ff00a9eb0 legacy=0x7f8ff00c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80038e0 0x7f8fd8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd8004690 0x7f8fd8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8fd800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00aa910 con 0x7f8fd8004690 2023-08-17T00:13:07.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd800bf60 con 0x7f8fd8005000 2023-08-17T00:13:07.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd800c0f0 con 0x7f8fd80038e0 2023-08-17T00:13:07.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fedd9b700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd8004690 0x7f8fd8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8feed9d700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8fd800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.876+0000 7f8fee59c700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80038e0 0x7f8fd8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 -- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80038e0 msgr2=0x7f8fd8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:07.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fd80038e0 0x7f8fd8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 -- 172.21.15.153:0/3530404397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd8004690 msgr2=0x7f8fd8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:07.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8fd8004690 0x7f8fd8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 -- 172.21.15.153:0/3530404397 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80033f0 con 0x7f8fd8005000 2023-08-17T00:13:07.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 -- 172.21.15.153:0/3530404397 reap_dead start 2023-08-17T00:13:07.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8feed9d700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8fd800b8e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f8fe800c450 tx=0x7f8fe800c760).ready entity=mon.1 client_cookie=1da68f2e4d6a8f02 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8002030 con 0x7f8fd8005000 2023-08-17T00:13:07.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe800cdf0 con 0x7f8fd8005000 2023-08-17T00:13:07.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fed59a700 1 -- 172.21.15.153:0/3530404397 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8005d30 con 0x7f8fd8005000 2023-08-17T00:13:07.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 -- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 msgr2=0x7f8fd800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8fd800b8e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f8fe800c450 tx=0x7f8fe800c760).stop 2023-08-17T00:13:07.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 -- 172.21.15.153:0/3530404397 shutdown_connections 2023-08-17T00:13:07.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 --2- 172.21.15.153:0/3530404397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8fd800b8e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 -- 172.21.15.153:0/3530404397 >> 172.21.15.153:0/3530404397 conn(0x7f8ff0062a10 msgr2=0x7f8ff00ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:07.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 -- 172.21.15.153:0/3530404397 shutdown_connections 2023-08-17T00:13:07.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.880+0000 7f8fef59e700 1 -- 172.21.15.153:0/3530404397 wait complete. 2023-08-17T00:13:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.884+0000 7f8fef59e700 1 Processor -- start 2023-08-17T00:13:07.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.884+0000 7f8fef59e700 1 -- start start 2023-08-17T00:13:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.884+0000 7f8fef59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8ff0167e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 0x7f8ff00ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0154bb0 0x7f8ff0155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0156440 con 0x7f8ff00ab510 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00abe80 con 0x7f8fd8005000 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff0155830 con 0x7f8ff0154bb0 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 0x7f8ff00ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 0x7f8ff00ab990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43572/0 (socket says 172.21.15.153:43572) 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 -- 172.21.15.153:0/1159355919 learned_addr learned my addr 172.21.15.153:0/1159355919 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fee59c700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8ff0167e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8feed9d700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0154bb0 0x7f8ff0155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 -- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0154bb0 msgr2=0x7f8ff0155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0154bb0 0x7f8ff0155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 -- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 msgr2=0x7f8ff0167e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8ff0167e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 -- 172.21.15.153:0/1159355919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff0155b10 con 0x7f8ff00ab510 2023-08-17T00:13:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fee59c700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8ff0167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:07.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fedd9b700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 0x7f8ff00ab990 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f8fe40028f0 tx=0x7f8fe4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400f6c0 con 0x7f8ff00ab510 2023-08-17T00:13:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400f820 con 0x7f8ff00ab510 2023-08-17T00:13:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff0155df0 con 0x7f8ff00ab510 2023-08-17T00:13:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400fba0 con 0x7f8ff00ab510 2023-08-17T00:13:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff0155520 con 0x7f8ff00ab510 2023-08-17T00:13:07.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.888+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff01565f0 con 0x7f8ff00ab510 2023-08-17T00:13:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.892+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8fe401b030 con 0x7f8ff00ab510 2023-08-17T00:13:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.892+0000 7f8fde7fc700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fd005a150 0x7f8fd005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.892+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f8fe40739f0 con 0x7f8ff00ab510 2023-08-17T00:13:07.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.892+0000 7f8fee59c700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fd005a150 0x7f8fd005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:07.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.896+0000 7f8fee59c700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fd005a150 0x7f8fd005c610 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f8fe0006f10 tx=0x7f8fe0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:07.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:07.900+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8ff01565f0 con 0x7f8ff00ab510 2023-08-17T00:13:08.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.064+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f8ff0156580 con 0x7f8ff00ab510 2023-08-17T00:13:08.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.668+0000 7f8fde7fc700 1 -- 172.21.15.153:0/1159355919 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v137) v1 ==== 152+0+0 (secure 0 0 0) 0x7f8fe4047790 con 0x7f8ff00ab510 2023-08-17T00:13:08.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fd005a150 msgr2=0x7f8fd005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fd005a150 0x7f8fd005c610 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f8fe0006f10 tx=0x7f8fe0008040).stop 2023-08-17T00:13:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 msgr2=0x7f8ff00ab990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 0x7f8ff00ab990 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7f8fe40028f0 tx=0x7f8fe4007bb0).stop 2023-08-17T00:13:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 shutdown_connections 2023-08-17T00:13:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8fd005a150 0x7f8fd005c610 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff0154bb0 0x7f8ff0155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8ff00ab510 0x7f8ff00ab990 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 --2- 172.21.15.153:0/1159355919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fd8005000 0x7f8ff0167e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 >> 172.21.15.153:0/1159355919 conn(0x7f8ff0062a10 msgr2=0x7f8ff00ac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:08.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 shutdown_connections 2023-08-17T00:13:08.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.684+0000 7f8fef59e700 1 -- 172.21.15.153:0/1159355919 wait complete. 2023-08-17T00:13:08.693 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:13:08.709 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:13:08.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.876+0000 7fb0aee5b700 1 Processor -- start 2023-08-17T00:13:08.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.880+0000 7fb0aee5b700 1 -- start start 2023-08-17T00:13:08.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.880+0000 7fb0aee5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb0a8153ab0 0x7fb0a8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:08.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.880+0000 7fb0aee5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 0x7fb0a80641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:08.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a80c0330 con 0x7fb0a80c07c0 2023-08-17T00:13:08.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a80646e0 con 0x7fb0a8153ab0 2023-08-17T00:13:08.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80c5e40 con 0x7fb0a80c59e0 2023-08-17T00:13:08.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 0x7fb0a80641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 0x7fb0a80641f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:41132/0 (socket says 172.21.15.153:41132) 2023-08-17T00:13:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 -- 172.21.15.153:0/1235894249 learned_addr learned my addr 172.21.15.153:0/1235894249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0acbf7700 1 --2- 172.21.15.153:0/1235894249 >> v2:172.21.15.178:3300/0 conn(0x7fb0a8153ab0 0x7fb0a8153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 -- 172.21.15.153:0/1235894249 >> v2:172.21.15.178:3300/0 conn(0x7fb0a8153ab0 msgr2=0x7fb0a8153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 --2- 172.21.15.153:0/1235894249 >> v2:172.21.15.178:3300/0 conn(0x7fb0a8153ab0 0x7fb0a8153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 -- 172.21.15.153:0/1235894249 >> v1:172.21.15.178:6789/0 conn(0x7fb0a80c07c0 legacy=0x7fb0a8061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:08.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 -- 172.21.15.153:0/1235894249 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a80c60a0 con 0x7fb0a80c59e0 2023-08-17T00:13:08.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0acbf7700 1 --2- 172.21.15.153:0/1235894249 >> v2:172.21.15.178:3300/0 conn(0x7fb0a8153ab0 0x7fb0a8153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:08.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09ffff700 1 --2- 172.21.15.153:0/1235894249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 0x7fb0a80641f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb098006fd0 tx=0x7fb0980090f0).ready entity=mon.2 client_cookie=84d753ff963c5a29 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09f7fe700 1 -- 172.21.15.153:0/1235894249 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800b600 con 0x7fb0a80c59e0 2023-08-17T00:13:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09f7fe700 1 -- 172.21.15.153:0/1235894249 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09800b760 con 0x7fb0a80c59e0 2023-08-17T00:13:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb09f7fe700 1 -- 172.21.15.153:0/1235894249 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800bb00 con 0x7fb0a80c59e0 2023-08-17T00:13:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- 172.21.15.153:0/1235894249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 msgr2=0x7fb0a80641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/1235894249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 0x7fb0a80641f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb098006fd0 tx=0x7fb0980090f0).stop 2023-08-17T00:13:08.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- 172.21.15.153:0/1235894249 shutdown_connections 2023-08-17T00:13:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/1235894249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c59e0 0x7fb0a80641f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/1235894249 >> v2:172.21.15.178:3300/0 conn(0x7fb0a8153ab0 0x7fb0a8153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- 172.21.15.153:0/1235894249 >> 172.21.15.153:0/1235894249 conn(0x7fb0a80caaa0 msgr2=0x7fb0a80caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.884+0000 7fb0aee5b700 1 -- 172.21.15.153:0/1235894249 shutdown_connections 2023-08-17T00:13:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.888+0000 7fb0aee5b700 1 -- 172.21.15.153:0/1235894249 wait complete. 2023-08-17T00:13:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.888+0000 7fb0aee5b700 1 Processor -- start 2023-08-17T00:13:08.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.888+0000 7fb0aee5b700 1 -- start start 2023-08-17T00:13:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c07c0 0x7fb0a80c1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a80c59e0 0x7fb0a8157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a8153ab0 0x7fb0a8157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8155fc0 con 0x7fb0a8153ab0 2023-08-17T00:13:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a8158240 con 0x7fb0a80c59e0 2023-08-17T00:13:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a80c2dc0 con 0x7fb0a80c07c0 2023-08-17T00:13:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0ad3f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a8153ab0 0x7fb0a8157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0acbf7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c07c0 0x7fb0a80c1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a80c59e0 0x7fb0a8157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0ad3f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a8153ab0 0x7fb0a8157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43588/0 (socket says 172.21.15.153:43588) 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0ad3f8700 1 -- 172.21.15.153:0/4086607864 learned_addr learned my addr 172.21.15.153:0/4086607864 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 -- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c07c0 msgr2=0x7fb0a80c1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c07c0 0x7fb0a80c1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 -- 172.21.15.153:0/4086607864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a8153ab0 msgr2=0x7fb0a8157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a8153ab0 0x7fb0a8157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 -- 172.21.15.153:0/4086607864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb098009370 con 0x7fb0a80c59e0 2023-08-17T00:13:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0acbf7700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c07c0 0x7fb0a80c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09ffff700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a80c59e0 0x7fb0a8157390 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fb098014000 tx=0x7fb098017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb098002f30 con 0x7fb0a80c59e0 2023-08-17T00:13:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb098000bc0 con 0x7fb0a80c59e0 2023-08-17T00:13:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09800bb00 con 0x7fb0a80c59e0 2023-08-17T00:13:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80c21b0 con 0x7fb0a80c59e0 2023-08-17T00:13:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.892+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a80c2770 con 0x7fb0a80c59e0 2023-08-17T00:13:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.896+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a806b530 con 0x7fb0a80c59e0 2023-08-17T00:13:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.896+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb09800f070 con 0x7fb0a80c59e0 2023-08-17T00:13:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.896+0000 7fb09cff9700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.896+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fb098075a90 con 0x7fb0a80c59e0 2023-08-17T00:13:08.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.896+0000 7fb0acbf7700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:08.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.896+0000 7fb0acbf7700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fb0a4006fd0 tx=0x7fb0a4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:08.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:08.904+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb0980496c0 con 0x7fb0a80c59e0 2023-08-17T00:13:09.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.072+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb0a80bfa00 con 0x7fb0a80c59e0 2023-08-17T00:13:09.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.684+0000 7fb09cff9700 1 -- 172.21.15.153:0/4086607864 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v138) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb098029070 con 0x7fb0a80c59e0 2023-08-17T00:13:09.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 msgr2=0x7fb09405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fb0a4006fd0 tx=0x7fb0a4008040).stop 2023-08-17T00:13:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a80c59e0 msgr2=0x7fb0a8157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a80c59e0 0x7fb0a8157390 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fb098014000 tx=0x7fb098017000).stop 2023-08-17T00:13:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 shutdown_connections 2023-08-17T00:13:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb09405a150 0x7fb09405c610 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:09.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0a8153ab0 0x7fb0a8157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0a80c59e0 0x7fb0a8157390 secure :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0x7fb098014000 tx=0x7fb098017000).stop 2023-08-17T00:13:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 --2- 172.21.15.153:0/4086607864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0a80c07c0 0x7fb0a80c1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 >> 172.21.15.153:0/4086607864 conn(0x7fb0a80caaa0 msgr2=0x7fb0a80c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 shutdown_connections 2023-08-17T00:13:09.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.692+0000 7fb0aee5b700 1 -- 172.21.15.153:0/4086607864 wait complete. 2023-08-17T00:13:09.705 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:13:09.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:13:09.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.880+0000 7f98c7507700 1 Processor -- start 2023-08-17T00:13:09.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.880+0000 7f98c7507700 1 -- start start 2023-08-17T00:13:09.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c7507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98c0154370 0x7f98c00c08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:09.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c7507700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c00bfd10 con 0x7f98c00c57a0 2023-08-17T00:13:09.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c7507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c0154af0 con 0x7f98c0153f50 2023-08-17T00:13:09.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c7507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c0154dd0 con 0x7f98c0154370 2023-08-17T00:13:09.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6505700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f98c00c57a0 0x7f98c00c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56314/0 (socket says 172.21.15.153:56314) 2023-08-17T00:13:09.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6505700 1 -- 172.21.15.153:0/3959423164 learned_addr learned my addr 172.21.15.153:0/3959423164 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:09.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6d06700 1 --2- 172.21.15.153:0/3959423164 >> v2:172.21.15.153:3300/0 conn(0x7f98c0154370 0x7f98c00c08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:09.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c5503700 1 -- 172.21.15.153:0/3959423164 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1848984253 0 0) 0x7f98c00bfd10 con 0x7f98c00c57a0 2023-08-17T00:13:09.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c5503700 1 -- 172.21.15.153:0/3959423164 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98ac0033f0 con 0x7f98c00c57a0 2023-08-17T00:13:09.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6d06700 1 -- 172.21.15.153:0/3959423164 >> v1:172.21.15.178:6789/0 conn(0x7f98c0153f50 legacy=0x7f98c00c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6d06700 1 -- 172.21.15.153:0/3959423164 >> v1:172.21.15.153:6789/0 conn(0x7f98c00c57a0 legacy=0x7f98c00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6d06700 1 -- 172.21.15.153:0/3959423164 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c00bf9a0 con 0x7f98c0154370 2023-08-17T00:13:09.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c6d06700 1 --2- 172.21.15.153:0/3959423164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c00c08b0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f98b8009e60 tx=0x7f98b8009780).ready entity=mon.0 client_cookie=b9e7140f7c1286dc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:09.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c5503700 1 -- 172.21.15.153:0/3959423164 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800e070 con 0x7f98c0154370 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c5503700 1 -- 172.21.15.153:0/3959423164 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800bb60 con 0x7f98c0154370 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.884+0000 7f98c5503700 1 -- 172.21.15.153:0/3959423164 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8012410 con 0x7f98c0154370 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 -- 172.21.15.153:0/3959423164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 msgr2=0x7f98c00c08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 --2- 172.21.15.153:0/3959423164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c00c08b0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7f98b8009e60 tx=0x7f98b8009780).stop 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 -- 172.21.15.153:0/3959423164 shutdown_connections 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 --2- 172.21.15.153:0/3959423164 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c00c08b0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:09.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 -- 172.21.15.153:0/3959423164 >> 172.21.15.153:0/3959423164 conn(0x7f98c0062a70 msgr2=0x7f98c00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:09.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 -- 172.21.15.153:0/3959423164 shutdown_connections 2023-08-17T00:13:09.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.888+0000 7f98c7507700 1 -- 172.21.15.153:0/3959423164 wait complete. 2023-08-17T00:13:09.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 Processor -- start 2023-08-17T00:13:09.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 -- start start 2023-08-17T00:13:09.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c00c57a0 0x7f98c00c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:09.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c0153f50 0x7f98c00c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:09.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c0168a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:09.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c00c3330 con 0x7f98c0154370 2023-08-17T00:13:09.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c00aed90 con 0x7f98c00c57a0 2023-08-17T00:13:09.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c7507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c00c2720 con 0x7f98c0153f50 2023-08-17T00:13:09.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c0168a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:09.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c0168a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43602/0 (socket says 172.21.15.153:43602) 2023-08-17T00:13:09.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 -- 172.21.15.153:0/1501007925 learned_addr learned my addr 172.21.15.153:0/1501007925 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:09.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6505700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c00c57a0 0x7f98c00c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:09.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c5d04700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c0153f50 0x7f98c00c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 -- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c0153f50 msgr2=0x7f98c00c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c0153f50 0x7f98c00c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 -- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c00c57a0 msgr2=0x7f98c00c19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c00c57a0 0x7f98c00c19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 -- 172.21.15.153:0/1501007925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8009a20 con 0x7f98c0154370 2023-08-17T00:13:09.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6505700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c00c57a0 0x7f98c00c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.892+0000 7f98c6d06700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c0168a80 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f98c0083860 tx=0x7f98b8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b801d5a0 con 0x7f98c0154370 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b801d700 con 0x7f98c0154370 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c00c2a00 con 0x7f98c0154370 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b801daa0 con 0x7f98c0154370 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c00c2fc0 con 0x7f98c0154370 2023-08-17T00:13:09.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c006b4c0 con 0x7f98c0154370 2023-08-17T00:13:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.896+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f98b801e430 con 0x7f98c0154370 2023-08-17T00:13:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.900+0000 7f98b67fc700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98a405a180 0x7f98a405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:09.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.900+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f98b80764e0 con 0x7f98c0154370 2023-08-17T00:13:09.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.900+0000 7f98c6505700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98a405a180 0x7f98a405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:09.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.900+0000 7f98c6505700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98a405a180 0x7f98a405c640 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f98bc005750 tx=0x7f98bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:09.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:09.904+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f98b804a040 con 0x7f98c0154370 2023-08-17T00:13:10.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.100+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f98c00aef00 con 0x7f98c0154370 2023-08-17T00:13:10.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.116+0000 7f98b67fc700 1 -- 172.21.15.153:0/1501007925 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v105) v1 ==== 174+0+0 (secure 0 0 0) 0x7f98b804d660 con 0x7f98c0154370 2023-08-17T00:13:10.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.132+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98a405a180 msgr2=0x7f98a405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.132+0000 7f98c7507700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98a405a180 0x7f98a405c640 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f98bc005750 tx=0x7f98bc009040).stop 2023-08-17T00:13:10.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.132+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 msgr2=0x7f98c0168a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.132+0000 7f98c7507700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c0168a80 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7f98c0083860 tx=0x7f98b8009780).stop 2023-08-17T00:13:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 shutdown_connections 2023-08-17T00:13:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f98a405a180 0x7f98a405c640 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98c0154370 0x7f98c0168a80 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98c0153f50 0x7f98c00c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 --2- 172.21.15.153:0/1501007925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98c00c57a0 0x7f98c00c19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 >> 172.21.15.153:0/1501007925 conn(0x7f98c0062a70 msgr2=0x7f98c01522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:10.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 shutdown_connections 2023-08-17T00:13:10.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.136+0000 7f98c7507700 1 -- 172.21.15.153:0/1501007925 wait complete. 2023-08-17T00:13:10.152 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 19 and data pool 20 2023-08-17T00:13:10.168 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:13:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 Processor -- start 2023-08-17T00:13:10.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 -- start start 2023-08-17T00:13:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f81560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1f8151530 0x7ff1f81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f8065da0 con 0x7ff1f80689c0 2023-08-17T00:13:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f8069200 con 0x7ff1f8151530 2023-08-17T00:13:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1fcdb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8155c60 con 0x7ff1f8068da0 2023-08-17T00:13:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1f6ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f81560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1f7fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1f8151530 0x7ff1f81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1f6ffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f81560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:41156/0 (socket says 172.21.15.153:41156) 2023-08-17T00:13:10.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.320+0000 7ff1f6ffd700 1 -- 172.21.15.153:0/2916273178 learned_addr learned my addr 172.21.15.153:0/2916273178 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f6ffd700 1 -- 172.21.15.153:0/2916273178 >> v2:172.21.15.178:3300/0 conn(0x7ff1f8151530 msgr2=0x7ff1f81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f6ffd700 1 --2- 172.21.15.153:0/2916273178 >> v2:172.21.15.178:3300/0 conn(0x7ff1f8151530 0x7ff1f81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f6ffd700 1 -- 172.21.15.153:0/2916273178 >> v1:172.21.15.178:6789/0 conn(0x7ff1f80689c0 legacy=0x7ff1f80c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f6ffd700 1 -- 172.21.15.153:0/2916273178 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f8065ff0 con 0x7ff1f8068da0 2023-08-17T00:13:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f6ffd700 1 --2- 172.21.15.153:0/2916273178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f81560f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff1ec006fd0 tx=0x7ff1ec0090f0).ready entity=mon.2 client_cookie=ab97a4ec333d2d6b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:10.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f67fc700 1 -- 172.21.15.153:0/2916273178 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec00b580 con 0x7ff1f8068da0 2023-08-17T00:13:10.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f67fc700 1 -- 172.21.15.153:0/2916273178 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00b6e0 con 0x7ff1f8068da0 2023-08-17T00:13:10.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1f67fc700 1 -- 172.21.15.153:0/2916273178 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec00ba80 con 0x7ff1f8068da0 2023-08-17T00:13:10.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/2916273178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 msgr2=0x7ff1f81560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/2916273178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f81560f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7ff1ec006fd0 tx=0x7ff1ec0090f0).stop 2023-08-17T00:13:10.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/2916273178 shutdown_connections 2023-08-17T00:13:10.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/2916273178 >> v2:172.21.15.178:3300/0 conn(0x7ff1f8151530 0x7ff1f81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/2916273178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f81560f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/2916273178 >> 172.21.15.153:0/2916273178 conn(0x7ff1f80c6620 msgr2=0x7ff1f80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:10.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/2916273178 shutdown_connections 2023-08-17T00:13:10.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.324+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/2916273178 wait complete. 2023-08-17T00:13:10.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 Processor -- start 2023-08-17T00:13:10.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 -- start start 2023-08-17T00:13:10.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 0x7ff1f81621c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f8164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f8151530 0x7ff1f8153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80bcc90 con 0x7ff1f80689c0 2023-08-17T00:13:10.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80ba130 con 0x7ff1f8151530 2023-08-17T00:13:10.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1fcdb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f80ba410 con 0x7ff1f8068da0 2023-08-17T00:13:10.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.328+0000 7ff1f77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 0x7ff1f81621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 0x7ff1f81621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43608/0 (socket says 172.21.15.153:43608) 2023-08-17T00:13:10.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 -- 172.21.15.153:0/3731878947 learned_addr learned my addr 172.21.15.153:0/3731878947 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:10.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f6ffd700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f8164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f7fff700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f8151530 0x7ff1f8153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 -- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 msgr2=0x7ff1f8164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f8164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 -- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f8151530 msgr2=0x7ff1f8153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f8151530 0x7ff1f8153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 -- 172.21.15.153:0/3731878947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ec009370 con 0x7ff1f80689c0 2023-08-17T00:13:10.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1f77fe700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 0x7ff1f81621c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7ff1e800c440 tx=0x7ff1e8007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:10.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8007020 con 0x7ff1f80689c0 2023-08-17T00:13:10.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e8007180 con 0x7ff1f80689c0 2023-08-17T00:13:10.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f80ba6f0 con 0x7ff1f80689c0 2023-08-17T00:13:10.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8007520 con 0x7ff1f80689c0 2023-08-17T00:13:10.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f8165490 con 0x7ff1f80689c0 2023-08-17T00:13:10.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.332+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f80b9f90 con 0x7ff1f80689c0 2023-08-17T00:13:10.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.336+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff1e8010070 con 0x7ff1f80689c0 2023-08-17T00:13:10.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.336+0000 7ff1df7fe700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1e405a120 0x7ff1e405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.336+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff1e8073310 con 0x7ff1f80689c0 2023-08-17T00:13:10.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.336+0000 7ff1f6ffd700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1e405a120 0x7ff1e405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.340+0000 7ff1f6ffd700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1e405a120 0x7ff1e405c5e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff1ec00b340 tx=0x7ff1ec017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:10.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.340+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1f80b9f90 con 0x7ff1f80689c0 2023-08-17T00:13:10.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.500+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1f806b4c0 con 0x7ff1f80689c0 2023-08-17T00:13:10.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1df7fe700 1 -- 172.21.15.153:0/3731878947 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17003 (secure 0 0 0) 0x7ff1e8046cb0 con 0x7ff1f80689c0 2023-08-17T00:13:10.510 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:10.510 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":139,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:13:10.107005+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:13:08.136187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T00:13:09.146761+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:13:10.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1e405a120 msgr2=0x7ff1e405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1e405a120 0x7ff1e405c5e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7ff1ec00b340 tx=0x7ff1ec017000).stop 2023-08-17T00:13:10.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 msgr2=0x7ff1f81621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 0x7ff1f81621c0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7ff1e800c440 tx=0x7ff1e8007e50).stop 2023-08-17T00:13:10.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 shutdown_connections 2023-08-17T00:13:10.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1e405a120 0x7ff1e405c5e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f8151530 0x7ff1f8153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f8068da0 0x7ff1f8164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 --2- 172.21.15.153:0/3731878947 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1f80689c0 0x7ff1f81621c0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.504+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 >> 172.21.15.153:0/3731878947 conn(0x7ff1f80c6620 msgr2=0x7ff1f80a8950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.508+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 shutdown_connections 2023-08-17T00:13:10.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.508+0000 7ff1fcdb9700 1 -- 172.21.15.153:0/3731878947 wait complete. 2023-08-17T00:13:10.532 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:13:10.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.688+0000 7fa817439700 1 Processor -- start 2023-08-17T00:13:10.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.688+0000 7fa817439700 1 -- start start 2023-08-17T00:13:10.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa810069630 0x7fa8100c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8100c0f70 0x7fa810068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa810154ae0 con 0x7fa810069250 2023-08-17T00:13:10.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100664a0 con 0x7fa810069630 2023-08-17T00:13:10.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa810064fd0 con 0x7fa8100c0f70 2023-08-17T00:13:10.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815c36700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa810069630 0x7fa8100c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa816437700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa810069250 0x7fa810065d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56326/0 (socket says 172.21.15.153:56326) 2023-08-17T00:13:10.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa816437700 1 -- 172.21.15.153:0/912871203 learned_addr learned my addr 172.21.15.153:0/912871203 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa816c38700 1 --2- 172.21.15.153:0/912871203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8100c0f70 0x7fa810068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815c36700 1 -- 172.21.15.153:0/912871203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8100c0f70 msgr2=0x7fa810068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815c36700 1 --2- 172.21.15.153:0/912871203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8100c0f70 0x7fa810068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815c36700 1 -- 172.21.15.153:0/912871203 >> v1:172.21.15.153:6789/0 conn(0x7fa810069250 legacy=0x7fa810065d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815c36700 1 -- 172.21.15.153:0/912871203 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100652b0 con 0x7fa810069630 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815c36700 1 --2- 172.21.15.153:0/912871203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa810069630 0x7fa8100c0a80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fa800009760 tx=0x7fa800009060).ready entity=mon.0 client_cookie=b2bcb5d6bb9c59ae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815435700 1 -- 172.21.15.153:0/912871203 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8000090d0 con 0x7fa810069630 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815435700 1 -- 172.21.15.153:0/912871203 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80000b580 con 0x7fa810069630 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa815435700 1 -- 172.21.15.153:0/912871203 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80000b900 con 0x7fa810069630 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- 172.21.15.153:0/912871203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa810069630 msgr2=0x7fa8100c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 --2- 172.21.15.153:0/912871203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa810069630 0x7fa8100c0a80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7fa800009760 tx=0x7fa800009060).stop 2023-08-17T00:13:10.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- 172.21.15.153:0/912871203 shutdown_connections 2023-08-17T00:13:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 --2- 172.21.15.153:0/912871203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa8100c0f70 0x7fa810068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 --2- 172.21.15.153:0/912871203 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa810069630 0x7fa8100c0a80 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- 172.21.15.153:0/912871203 >> 172.21.15.153:0/912871203 conn(0x7fa8100c6620 msgr2=0x7fa8100c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- 172.21.15.153:0/912871203 shutdown_connections 2023-08-17T00:13:10.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.692+0000 7fa817439700 1 -- 172.21.15.153:0/912871203 wait complete. 2023-08-17T00:13:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 Processor -- start 2023-08-17T00:13:10.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 -- start start 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa810069250 0x7fa8100a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810069630 0x7fa8100bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 0x7fa8101429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100a4ad0 con 0x7fa8100c0f70 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100bdd90 con 0x7fa810069630 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.696+0000 7fa817439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100c03b0 con 0x7fa810069250 2023-08-17T00:13:10.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 0x7fa8101429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 0x7fa8101429d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43624/0 (socket says 172.21.15.153:43624) 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 -- 172.21.15.153:0/4052104243 learned_addr learned my addr 172.21.15.153:0/4052104243 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa815c36700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810069630 0x7fa8100bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816437700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa810069250 0x7fa8100a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 -- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa810069250 msgr2=0x7fa8100a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa810069250 0x7fa8100a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 -- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810069630 msgr2=0x7fa8100bfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810069630 0x7fa8100bfec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 -- 172.21.15.153:0/4052104243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000092a0 con 0x7fa8100c0f70 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa816c38700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 0x7fa8101429d0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fa808009fa0 tx=0x7fa808009900).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80800ed20 con 0x7fa8100c0f70 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80800ee80 con 0x7fa8100c0f70 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808014610 con 0x7fa8100c0f70 2023-08-17T00:13:10.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8100a4cb0 con 0x7fa8100c0f70 2023-08-17T00:13:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8100bda20 con 0x7fa8100c0f70 2023-08-17T00:13:10.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.700+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8100bdf20 con 0x7fa8100c0f70 2023-08-17T00:13:10.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.704+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa80801b030 con 0x7fa8100c0f70 2023-08-17T00:13:10.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.704+0000 7fa8067fc700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7f405a150 0x7fa7f405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:10.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.704+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa8080746e0 con 0x7fa8100c0f70 2023-08-17T00:13:10.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.704+0000 7fa816437700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7f405a150 0x7fa7f405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:10.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.704+0000 7fa816437700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7f405a150 0x7fa7f405c610 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa80c002600 tx=0x7fa80c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:10.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.712+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa808048080 con 0x7fa8100c0f70 2023-08-17T00:13:10.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.872+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa81006b4c0 con 0x7fa8100c0f70 2023-08-17T00:13:10.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.872+0000 7fa8067fc700 1 -- 172.21.15.153:0/4052104243 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fa80804b6a0 con 0x7fa8100c0f70 2023-08-17T00:13:10.880 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:10.881 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":139,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:13:10.107005+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:13:08.136187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T00:13:09.146761+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:13:10.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7f405a150 msgr2=0x7fa7f405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7f405a150 0x7fa7f405c610 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fa80c002600 tx=0x7fa80c009040).stop 2023-08-17T00:13:10.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 msgr2=0x7fa8101429d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:10.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 0x7fa8101429d0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7fa808009fa0 tx=0x7fa808009900).stop 2023-08-17T00:13:10.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 shutdown_connections 2023-08-17T00:13:10.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa7f405a150 0x7fa7f405c610 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa8100c0f70 0x7fa8101429d0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa810069630 0x7fa8100bfec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 --2- 172.21.15.153:0/4052104243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa810069250 0x7fa8100a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:10.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 >> 172.21.15.153:0/4052104243 conn(0x7fa8100c6620 msgr2=0x7fa8101539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:10.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 shutdown_connections 2023-08-17T00:13:10.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:10.876+0000 7fa817439700 1 -- 172.21.15.153:0/4052104243 wait complete. 2023-08-17T00:13:10.904 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:13:11.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.056+0000 7f1800f79700 1 Processor -- start 2023-08-17T00:13:11.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.056+0000 7f1800f79700 1 -- start start 2023-08-17T00:13:11.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f1800f79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5ea0 0x7f17fc0634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:11.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f1800f79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17fc0639a0 0x7f17fc0bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:11.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f1800f79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17fc154e90 con 0x7f17fc0acf30 2023-08-17T00:13:11.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f1800f79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc0c1730 con 0x7f17fc0639a0 2023-08-17T00:13:11.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f1800f79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc063e10 con 0x7f17fc0c5ea0 2023-08-17T00:13:11.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17fc0639a0 0x7f17fc0bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:11.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fb7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f17fc0acf30 0x7f17fc0c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56340/0 (socket says 172.21.15.153:56340) 2023-08-17T00:13:11.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fbfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f17fc0639a0 0x7f17fc0bfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43630/0 (socket says 172.21.15.153:43630) 2023-08-17T00:13:11.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fb7fe700 1 -- 172.21.15.153:0/1677267753 learned_addr learned my addr 172.21.15.153:0/1677267753 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:11.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17faffd700 1 --2- 172.21.15.153:0/1677267753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5ea0 0x7f17fc0634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:11.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fbfff700 1 -- 172.21.15.153:0/1677267753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5ea0 msgr2=0x7f17fc0634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:11.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fbfff700 1 --2- 172.21.15.153:0/1677267753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5ea0 0x7f17fc0634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:11.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fbfff700 1 -- 172.21.15.153:0/1677267753 >> v1:172.21.15.153:6789/0 conn(0x7f17fc0acf30 legacy=0x7f17fc0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:11.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fa7fc700 1 -- 172.21.15.153:0/1677267753 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294256651 0 0) 0x7f17fc154e90 con 0x7f17fc0acf30 2023-08-17T00:13:11.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.060+0000 7f17fbfff700 1 -- 172.21.15.153:0/1677267753 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc153fc0 con 0x7f17fc0639a0 2023-08-17T00:13:11.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f17fbfff700 1 --2- 172.21.15.153:0/1677267753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0639a0 0x7f17fc0bfad0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f17f4009e60 tx=0x7f17f4009780).ready entity=mon.0 client_cookie=32425123f6b19742 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:11.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f17fa7fc700 1 -- 172.21.15.153:0/1677267753 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e070 con 0x7f17fc0639a0 2023-08-17T00:13:11.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f17fa7fc700 1 -- 172.21.15.153:0/1677267753 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400bb60 con 0x7f17fc0639a0 2023-08-17T00:13:11.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f17fa7fc700 1 -- 172.21.15.153:0/1677267753 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4012410 con 0x7f17fc0639a0 2023-08-17T00:13:11.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 -- 172.21.15.153:0/1677267753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0639a0 msgr2=0x7f17fc0bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:11.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 --2- 172.21.15.153:0/1677267753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0639a0 0x7f17fc0bfad0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f17f4009e60 tx=0x7f17f4009780).stop 2023-08-17T00:13:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 -- 172.21.15.153:0/1677267753 shutdown_connections 2023-08-17T00:13:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 --2- 172.21.15.153:0/1677267753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0639a0 0x7f17fc0bfad0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 --2- 172.21.15.153:0/1677267753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0c5ea0 0x7f17fc0634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 -- 172.21.15.153:0/1677267753 >> 172.21.15.153:0/1677267753 conn(0x7f17fc0cb330 msgr2=0x7f17fc0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 -- 172.21.15.153:0/1677267753 shutdown_connections 2023-08-17T00:13:11.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 -- 172.21.15.153:0/1677267753 wait complete. 2023-08-17T00:13:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.064+0000 7f1800f79700 1 Processor -- start 2023-08-17T00:13:11.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 -- start start 2023-08-17T00:13:11.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0639a0 0x7f17fc153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 0x7f17fc0a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc0a1b20 0x7f17fc0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0af860 con 0x7f17fc0acf30 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc158eb0 con 0x7f17fc0a1b20 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0aef30 con 0x7f17fc0639a0 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 0x7f17fc0a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:11.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 0x7f17fc0a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43632/0 (socket says 172.21.15.153:43632) 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 -- 172.21.15.153:0/656887320 learned_addr learned my addr 172.21.15.153:0/656887320 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17fb7fe700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0639a0 0x7f17fc153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17fbfff700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc0a1b20 0x7f17fc0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 -- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0639a0 msgr2=0x7f17fc153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0639a0 0x7f17fc153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 -- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc0a1b20 msgr2=0x7f17fc0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc0a1b20 0x7f17fc0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:11.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 -- 172.21.15.153:0/656887320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009a20 con 0x7f17fc0acf30 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17faffd700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 0x7f17fc0a1630 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f17f000e900 tx=0x7f17f0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0012600 con 0x7f17fc0acf30 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0012760 con 0x7f17fc0acf30 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc0af210 con 0x7f17fc0acf30 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0012ae0 con 0x7f17fc0acf30 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.068+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc0ae740 con 0x7f17fc0acf30 2023-08-17T00:13:11.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.072+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc0afa10 con 0x7f17fc0acf30 2023-08-17T00:13:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.072+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f17f0022070 con 0x7f17fc0acf30 2023-08-17T00:13:11.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.072+0000 7f17e37fe700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f17e805a150 0x7f17e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:11.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.072+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f17f0074300 con 0x7f17fc0acf30 2023-08-17T00:13:11.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.076+0000 7f17fb7fe700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f17e805a150 0x7f17e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:11.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.076+0000 7f17fb7fe700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f17e805a150 0x7f17e805c610 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f17ec0011e0 tx=0x7f17ec007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:11.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.080+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f17fc0afa10 con 0x7f17fc0acf30 2023-08-17T00:13:11.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:11.280+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f17fc06b4c0 con 0x7f17fc0acf30 2023-08-17T00:13:12.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.132+0000 7f17e37fe700 1 -- 172.21.15.153:0/656887320 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v108) v1 ==== 118+0+0 (secure 0 0 0) 0x7f17f0047ca0 con 0x7f17fc0acf30 2023-08-17T00:13:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f17e805a150 msgr2=0x7f17e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f17e805a150 0x7f17e805c610 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f17ec0011e0 tx=0x7f17ec007bb0).stop 2023-08-17T00:13:12.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 msgr2=0x7f17fc0a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:12.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 0x7f17fc0a1630 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 rx=0x7f17f000e900 tx=0x7f17f0009060).stop 2023-08-17T00:13:12.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 shutdown_connections 2023-08-17T00:13:12.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f17e805a150 0x7f17e805c610 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f17fc0a1b20 0x7f17fc0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f17fc0acf30 0x7f17fc0a1630 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 --2- 172.21.15.153:0/656887320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17fc0639a0 0x7f17fc153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 >> 172.21.15.153:0/656887320 conn(0x7f17fc0cb330 msgr2=0x7f17fc155430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:12.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 shutdown_connections 2023-08-17T00:13:12.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.136+0000 7f1800f79700 1 -- 172.21.15.153:0/656887320 wait complete. 2023-08-17T00:13:12.166 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:13:12.167 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:13:12.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.332+0000 7f58f25f9700 1 Processor -- start 2023-08-17T00:13:12.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.332+0000 7f58f25f9700 1 -- start start 2023-08-17T00:13:12.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.332+0000 7f58f25f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58ec14fe80 0x7f58ec062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:12.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f25f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0c4f60 0x7f58ec0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:12.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f25f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58ec1505c0 con 0x7f58ec0634a0 2023-08-17T00:13:12.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f25f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58ec063a10 con 0x7f58ec14fe80 2023-08-17T00:13:12.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f25f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec151380 con 0x7f58ec0c4f60 2023-08-17T00:13:12.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58ec14fe80 0x7f58ec062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:12.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58ec14fe80 0x7f58ec062fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43634/0 (socket says 172.21.15.153:43634) 2023-08-17T00:13:12.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 -- 172.21.15.153:0/3850050278 learned_addr learned my addr 172.21.15.153:0/3850050278 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:12.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f0df6700 1 --1- 172.21.15.153:0/3850050278 >> v1:172.21.15.178:6789/0 conn(0x7f58ec0634a0 0x7f58ec0c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:46170/0 (socket says 172.21.15.153:46170) 2023-08-17T00:13:12.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f1df8700 1 --2- 172.21.15.153:0/3850050278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0c4f60 0x7f58ec0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:12.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 -- 172.21.15.153:0/3850050278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0c4f60 msgr2=0x7f58ec0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:12.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 --2- 172.21.15.153:0/3850050278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0c4f60 0x7f58ec0c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 -- 172.21.15.153:0/3850050278 >> v1:172.21.15.178:6789/0 conn(0x7f58ec0634a0 legacy=0x7f58ec0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:12.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58e3fff700 1 -- 172.21.15.153:0/3850050278 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77408989 0 0) 0x7f58ec1505c0 con 0x7f58ec0634a0 2023-08-17T00:13:12.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 -- 172.21.15.153:0/3850050278 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec1508a0 con 0x7f58ec14fe80 2023-08-17T00:13:12.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f15f7700 1 --2- 172.21.15.153:0/3850050278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec062fb0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f58e800bad0 tx=0x7f58e800b3b0).ready entity=mon.0 client_cookie=e5bae7b70c9d5dae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:12.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58e3fff700 1 -- 172.21.15.153:0/3850050278 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800da30 con 0x7f58ec14fe80 2023-08-17T00:13:12.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58e3fff700 1 -- 172.21.15.153:0/3850050278 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800db90 con 0x7f58ec14fe80 2023-08-17T00:13:12.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58e3fff700 1 -- 172.21.15.153:0/3850050278 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8010470 con 0x7f58ec14fe80 2023-08-17T00:13:12.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f25f9700 1 -- 172.21.15.153:0/3850050278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 msgr2=0x7f58ec062fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:12.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.336+0000 7f58f25f9700 1 --2- 172.21.15.153:0/3850050278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec062fb0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f58e800bad0 tx=0x7f58e800b3b0).stop 2023-08-17T00:13:12.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 -- 172.21.15.153:0/3850050278 shutdown_connections 2023-08-17T00:13:12.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 --2- 172.21.15.153:0/3850050278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0c4f60 0x7f58ec0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 --2- 172.21.15.153:0/3850050278 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec062fb0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 -- 172.21.15.153:0/3850050278 >> 172.21.15.153:0/3850050278 conn(0x7f58ec0c4260 msgr2=0x7f58ec068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:12.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 -- 172.21.15.153:0/3850050278 shutdown_connections 2023-08-17T00:13:12.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 -- 172.21.15.153:0/3850050278 wait complete. 2023-08-17T00:13:12.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 Processor -- start 2023-08-17T00:13:12.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.340+0000 7f58f25f9700 1 -- start start 2023-08-17T00:13:12.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0634a0 0x7f58ec14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:12.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58ec0c4f60 0x7f58ec14d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:12.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec14de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:12.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec1657f0 con 0x7f58ec14fe80 2023-08-17T00:13:12.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec165ad0 con 0x7f58ec0c4f60 2023-08-17T00:13:12.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58ec165db0 con 0x7f58ec0634a0 2023-08-17T00:13:12.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec14de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:12.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec14de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43636/0 (socket says 172.21.15.153:43636) 2023-08-17T00:13:12.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 -- 172.21.15.153:0/947442757 learned_addr learned my addr 172.21.15.153:0/947442757 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:12.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f0df6700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58ec0c4f60 0x7f58ec14d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:12.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f15f7700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0634a0 0x7f58ec14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:12.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 -- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0634a0 msgr2=0x7f58ec14d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:12.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0634a0 0x7f58ec14d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 -- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58ec0c4f60 msgr2=0x7f58ec14d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:12.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58ec0c4f60 0x7f58ec14d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:12.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 -- 172.21.15.153:0/947442757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e800b610 con 0x7f58ec14fe80 2023-08-17T00:13:12.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f1df8700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec14de30 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f58e4009ec0 tx=0x7f58e400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:12.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e400cb70 con 0x7f58ec14fe80 2023-08-17T00:13:12.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e400f040 con 0x7f58ec14fe80 2023-08-17T00:13:12.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ec166090 con 0x7f58ec14fe80 2023-08-17T00:13:12.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e4013400 con 0x7f58ec14fe80 2023-08-17T00:13:12.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.344+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ec1621f0 con 0x7f58ec14fe80 2023-08-17T00:13:12.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.348+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58ec06b4c0 con 0x7f58ec14fe80 2023-08-17T00:13:12.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.348+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f58e4013770 con 0x7f58ec14fe80 2023-08-17T00:13:12.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.348+0000 7f58e17fa700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d005a150 0x7f58d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:12.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.348+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f58e4074b80 con 0x7f58ec14fe80 2023-08-17T00:13:12.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.348+0000 7f58f15f7700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d005a150 0x7f58d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:12.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.352+0000 7f58f15f7700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d005a150 0x7f58d005c610 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f58ec094ef0 tx=0x7f58e800b3b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:12.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.356+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58e4048520 con 0x7f58ec14fe80 2023-08-17T00:13:12.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:12.556+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f58ec150b80 con 0x7f58ec14fe80 2023-08-17T00:13:13.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.312+0000 7f58e17fa700 1 -- 172.21.15.153:0/947442757 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v109) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58e4074e60 con 0x7f58ec14fe80 2023-08-17T00:13:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d005a150 msgr2=0x7f58d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d005a150 0x7f58d005c610 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f58ec094ef0 tx=0x7f58e800b3b0).stop 2023-08-17T00:13:13.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 msgr2=0x7f58ec14de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec14de30 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 rx=0x7f58e4009ec0 tx=0x7f58e400b040).stop 2023-08-17T00:13:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 shutdown_connections 2023-08-17T00:13:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d005a150 0x7f58d005c610 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58ec14fe80 0x7f58ec14de30 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58ec0c4f60 0x7f58ec14d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 --2- 172.21.15.153:0/947442757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58ec0634a0 0x7f58ec14d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 >> 172.21.15.153:0/947442757 conn(0x7f58ec0c4260 msgr2=0x7f58ec149300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 shutdown_connections 2023-08-17T00:13:13.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.316+0000 7f58f25f9700 1 -- 172.21.15.153:0/947442757 wait complete. 2023-08-17T00:13:13.343 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:13:13.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.500+0000 7f2588346700 1 Processor -- start 2023-08-17T00:13:13.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.500+0000 7f2588346700 1 -- start start 2023-08-17T00:13:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f2588346700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2580151b90 0x7f2580151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f2588346700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2580061fa0 con 0x7f2580064870 2023-08-17T00:13:13.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f2588346700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25800621f0 con 0x7f2580063290 2023-08-17T00:13:13.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f2588346700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25800c3fb0 con 0x7f2580151b90 2023-08-17T00:13:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f25868e3700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2580064870 0x7f25800a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56346/0 (socket says 172.21.15.153:56346) 2023-08-17T00:13:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f25868e3700 1 -- 172.21.15.153:0/1476655557 learned_addr learned my addr 172.21.15.153:0/1476655557 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f25860e2700 1 --2- 172.21.15.153:0/1476655557 >> v2:172.21.15.178:3300/0 conn(0x7f2580151b90 0x7f2580151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139207958 0 0) 0x7f2580061fa0 con 0x7f2580064870 2023-08-17T00:13:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.504+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256c0033f0 con 0x7f2580064870 2023-08-17T00:13:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412534386 0 0) 0x7f25800621f0 con 0x7f2580063290 2023-08-17T00:13:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2580061fa0 con 0x7f2580063290 2023-08-17T00:13:13.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25860e2700 1 -- 172.21.15.153:0/1476655557 >> v1:172.21.15.178:6789/0 conn(0x7f2580063290 legacy=0x7f2580065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25860e2700 1 -- 172.21.15.153:0/1476655557 >> v1:172.21.15.153:6789/0 conn(0x7f2580064870 legacy=0x7f25800a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25860e2700 1 -- 172.21.15.153:0/1476655557 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25800624d0 con 0x7f2580151b90 2023-08-17T00:13:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25860e2700 1 --2- 172.21.15.153:0/1476655557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f2580151f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f257c009760 tx=0x7f257c009060).ready entity=mon.1 client_cookie=e7b7421641ce1c2d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00d4a0 con 0x7f2580151b90 2023-08-17T00:13:13.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00d600 con 0x7f2580151b90 2023-08-17T00:13:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f25850e0700 1 -- 172.21.15.153:0/1476655557 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00d980 con 0x7f2580151b90 2023-08-17T00:13:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 -- 172.21.15.153:0/1476655557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 msgr2=0x7f2580151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 --2- 172.21.15.153:0/1476655557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f2580151f70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f257c009760 tx=0x7f257c009060).stop 2023-08-17T00:13:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 -- 172.21.15.153:0/1476655557 shutdown_connections 2023-08-17T00:13:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 --2- 172.21.15.153:0/1476655557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f2580151f70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 -- 172.21.15.153:0/1476655557 >> 172.21.15.153:0/1476655557 conn(0x7f25800c7150 msgr2=0x7f25800c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 -- 172.21.15.153:0/1476655557 shutdown_connections 2023-08-17T00:13:13.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.508+0000 7f2588346700 1 -- 172.21.15.153:0/1476655557 wait complete. 2023-08-17T00:13:13.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.512+0000 7f2588346700 1 Processor -- start 2023-08-17T00:13:13.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.512+0000 7f2588346700 1 -- start start 2023-08-17T00:13:13.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 0x7f2580145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2580064870 0x7f2580153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f25800aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580145a60 con 0x7f2580063290 2023-08-17T00:13:13.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25801549f0 con 0x7f2580151b90 2023-08-17T00:13:13.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25800bd850 con 0x7f2580064870 2023-08-17T00:13:13.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 0x7f2580145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 0x7f2580145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43642/0 (socket says 172.21.15.153:43642) 2023-08-17T00:13:13.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 -- 172.21.15.153:0/2400077885 learned_addr learned my addr 172.21.15.153:0/2400077885 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:13.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25858e1700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2580064870 0x7f2580153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25868e3700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f25800aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 -- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2580064870 msgr2=0x7f2580153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2580064870 0x7f2580153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 -- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 msgr2=0x7f25800aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f25800aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 -- 172.21.15.153:0/2400077885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c0092a0 con 0x7f2580063290 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25860e2700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 0x7f2580145570 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f257c009d50 tx=0x7f257c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c00dcf0 con 0x7f2580063290 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c00de50 con 0x7f2580063290 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2580154150 con 0x7f2580063290 2023-08-17T00:13:13.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c01d430 con 0x7f2580063290 2023-08-17T00:13:13.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.516+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580154710 con 0x7f2580063290 2023-08-17T00:13:13.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.520+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258006b530 con 0x7f2580063290 2023-08-17T00:13:13.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.520+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f257c00f070 con 0x7f2580063290 2023-08-17T00:13:13.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.520+0000 7f25767fc700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f256405a150 0x7f256405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.520+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f257c0757e0 con 0x7f2580063290 2023-08-17T00:13:13.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.520+0000 7f25858e1700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f256405a150 0x7f256405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.524+0000 7f25858e1700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f256405a150 0x7f256405c610 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f25801501b0 tx=0x7f2570007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:13.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.528+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f257c049120 con 0x7f2580063290 2023-08-17T00:13:13.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.720+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25800c2e90 con 0x7f2580063290 2023-08-17T00:13:13.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.724+0000 7f25767fc700 1 -- 172.21.15.153:0/2400077885 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f257c04c740 con 0x7f2580063290 2023-08-17T00:13:13.730 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:13.730 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.724+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f256405a150 msgr2=0x7f256405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.724+0000 7f2588346700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f256405a150 0x7f256405c610 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f25801501b0 tx=0x7f2570007bd0).stop 2023-08-17T00:13:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.724+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 msgr2=0x7f2580145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.724+0000 7f2588346700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 0x7f2580145570 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 rx=0x7f257c009d50 tx=0x7f257c016000).stop 2023-08-17T00:13:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 shutdown_connections 2023-08-17T00:13:13.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f256405a150 0x7f256405c610 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2580151b90 0x7f25800aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2580064870 0x7f2580153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 --2- 172.21.15.153:0/2400077885 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2580063290 0x7f2580145570 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 >> 172.21.15.153:0/2400077885 conn(0x7f25800c7150 msgr2=0x7f258014fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:13.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 shutdown_connections 2023-08-17T00:13:13.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.728+0000 7f2588346700 1 -- 172.21.15.153:0/2400077885 wait complete. 2023-08-17T00:13:13.736 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:13.752 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:13:13.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.908+0000 7fdadbc9b700 1 Processor -- start 2023-08-17T00:13:13.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.908+0000 7fdadbc9b700 1 -- start start 2023-08-17T00:13:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdadbc9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdad40a8b70 0x7fdad40632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdadbc9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40629b0 0x7fdad40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdadbc9b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad4065240 con 0x7fdad40a8f50 2023-08-17T00:13:13.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdadbc9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad4062e60 con 0x7fdad40a8b70 2023-08-17T00:13:13.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdadbc9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40638a0 con 0x7fdad40629b0 2023-08-17T00:13:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9236700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fdad40a8f50 0x7fdad40656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56358/0 (socket says 172.21.15.153:56358) 2023-08-17T00:13:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9236700 1 -- 172.21.15.153:0/766594888 learned_addr learned my addr 172.21.15.153:0/766594888 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9a37700 1 --2- 172.21.15.153:0/766594888 >> v2:172.21.15.178:3300/0 conn(0x7fdad40a8b70 0x7fdad40632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdada238700 1 --2- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40629b0 0x7fdad40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad8a35700 1 -- 172.21.15.153:0/766594888 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833137601 0 0) 0x7fdad4065240 con 0x7fdad40a8f50 2023-08-17T00:13:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad8a35700 1 -- 172.21.15.153:0/766594888 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac00033f0 con 0x7fdad40a8f50 2023-08-17T00:13:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9a37700 1 -- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40629b0 msgr2=0x7fdad40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9a37700 1 --2- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40629b0 0x7fdad40bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad8a35700 1 -- 172.21.15.153:0/766594888 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2476550164 0 0) 0x7fdac00033f0 con 0x7fdad40a8f50 2023-08-17T00:13:13.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9a37700 1 -- 172.21.15.153:0/766594888 >> v1:172.21.15.153:6789/0 conn(0x7fdad40a8f50 legacy=0x7fdad40656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.912+0000 7fdad9a37700 1 -- 172.21.15.153:0/766594888 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad4065de0 con 0x7fdad40a8b70 2023-08-17T00:13:13.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdad9a37700 1 --2- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad40632e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fdad0009760 tx=0x7fdad0009060).ready entity=mon.1 client_cookie=9f6ffc5ce484f8f8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:13.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdad8a35700 1 -- 172.21.15.153:0/766594888 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4001470 con 0x7fdad40a8b70 2023-08-17T00:13:13.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdad8a35700 1 -- 172.21.15.153:0/766594888 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0011400 con 0x7fdad40a8b70 2023-08-17T00:13:13.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdad8a35700 1 -- 172.21.15.153:0/766594888 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0011780 con 0x7fdad40a8b70 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 -- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 msgr2=0x7fdad40632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad40632e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fdad0009760 tx=0x7fdad0009060).stop 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 -- 172.21.15.153:0/766594888 shutdown_connections 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40629b0 0x7fdad40bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/766594888 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad40632e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 -- 172.21.15.153:0/766594888 >> 172.21.15.153:0/766594888 conn(0x7fdad40c7150 msgr2=0x7fdad40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:13.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 -- 172.21.15.153:0/766594888 shutdown_connections 2023-08-17T00:13:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.916+0000 7fdadbc9b700 1 -- 172.21.15.153:0/766594888 wait complete. 2023-08-17T00:13:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 Processor -- start 2023-08-17T00:13:13.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 -- start start 2023-08-17T00:13:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 0x7fdad414bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad4159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40a8f50 0x7fdad4159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415a510 con 0x7fdad40629b0 2023-08-17T00:13:13.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415a7f0 con 0x7fdad40a8b70 2023-08-17T00:13:13.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415aad0 con 0x7fdad40a8f50 2023-08-17T00:13:13.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 0x7fdad414bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 0x7fdad414bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43648/0 (socket says 172.21.15.153:43648) 2023-08-17T00:13:13.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 -- 172.21.15.153:0/1732318109 learned_addr learned my addr 172.21.15.153:0/1732318109 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9236700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad4159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdada238700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40a8f50 0x7fdad4159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 -- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40a8f50 msgr2=0x7fdad4159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40a8f50 0x7fdad4159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 -- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 msgr2=0x7fdad4159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad4159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:13.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 -- 172.21.15.153:0/1732318109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00092a0 con 0x7fdad40629b0 2023-08-17T00:13:13.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9236700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad4159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:13.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdada238700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40a8f50 0x7fdad4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:13.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdad9a37700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 0x7fdad414bce0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fdad0009d50 tx=0x7fdad0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:13.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0010950 con 0x7fdad40629b0 2023-08-17T00:13:13.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0010ab0 con 0x7fdad40629b0 2023-08-17T00:13:13.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0010e70 con 0x7fdad40629b0 2023-08-17T00:13:13.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad415adb0 con 0x7fdad40629b0 2023-08-17T00:13:13.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.920+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40bf8f0 con 0x7fdad40629b0 2023-08-17T00:13:13.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.924+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad415b2c0 con 0x7fdad40629b0 2023-08-17T00:13:13.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.924+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdad0024030 con 0x7fdad40629b0 2023-08-17T00:13:13.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.928+0000 7fdac9ffb700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdab805a150 0x7fdab805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:13.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.928+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdad0074cc0 con 0x7fdad40629b0 2023-08-17T00:13:13.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.928+0000 7fdad9236700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdab805a150 0x7fdab805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:13.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.928+0000 7fdad9236700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdab805a150 0x7fdab805c610 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fdad40bf180 tx=0x7fdac4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:13.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:13.932+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdad007b080 con 0x7fdad40629b0 2023-08-17T00:13:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.092+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdad4064910 con 0x7fdad40629b0 2023-08-17T00:13:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.096+0000 7fdac9ffb700 1 -- 172.21.15.153:0/1732318109 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16990 (secure 0 0 0) 0x7fdad0022030 con 0x7fdad40629b0 2023-08-17T00:13:14.103 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:14.103 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":140,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:13:11.113267+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:13:08.136187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T00:13:09.146761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:13:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdab805a150 msgr2=0x7fdab805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdab805a150 0x7fdab805c610 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7fdad40bf180 tx=0x7fdac4009040).stop 2023-08-17T00:13:14.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 msgr2=0x7fdad414bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 0x7fdad414bce0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7fdad0009d50 tx=0x7fdad0016000).stop 2023-08-17T00:13:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 shutdown_connections 2023-08-17T00:13:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdab805a150 0x7fdab805c610 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdad40a8f50 0x7fdad4159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdad40a8b70 0x7fdad4159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 --2- 172.21.15.153:0/1732318109 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdad40629b0 0x7fdad414bce0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 >> 172.21.15.153:0/1732318109 conn(0x7fdad40c7150 msgr2=0x7fdad4157650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 shutdown_connections 2023-08-17T00:13:14.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.100+0000 7fdadbc9b700 1 -- 172.21.15.153:0/1732318109 wait complete. 2023-08-17T00:13:14.124 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:13:14.125 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:13:14.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.272+0000 7fa74359e700 1 Processor -- start 2023-08-17T00:13:14.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.272+0000 7fa74359e700 1 -- start start 2023-08-17T00:13:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7440acf30 0x7fa7440c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa7440c5ea0 0x7fa7440634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440639a0 0x7fa744157590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa744154e90 con 0x7fa7440acf30 2023-08-17T00:13:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa744063df0 con 0x7fa7440c5ea0 2023-08-17T00:13:14.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa744153fc0 con 0x7fa7440639a0 2023-08-17T00:13:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7440acf30 0x7fa7440c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74259c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa7440acf30 0x7fa7440c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43664/0 (socket says 172.21.15.153:43664) 2023-08-17T00:13:14.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.276+0000 7fa74259c700 1 -- 172.21.15.153:0/2993370232 learned_addr learned my addr 172.21.15.153:0/2993370232 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa742d9d700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440639a0 0x7fa744157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa73bfff700 1 --2- 172.21.15.153:0/2993370232 >> v2:172.21.15.178:3300/0 conn(0x7fa7440c5ea0 0x7fa7440634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74259c700 1 -- 172.21.15.153:0/2993370232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440639a0 msgr2=0x7fa744157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74259c700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440639a0 0x7fa744157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74259c700 1 -- 172.21.15.153:0/2993370232 >> v2:172.21.15.178:3300/0 conn(0x7fa7440c5ea0 msgr2=0x7fa7440634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74259c700 1 --2- 172.21.15.153:0/2993370232 >> v2:172.21.15.178:3300/0 conn(0x7fa7440c5ea0 0x7fa7440634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74259c700 1 -- 172.21.15.153:0/2993370232 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744154280 con 0x7fa7440acf30 2023-08-17T00:13:14.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa742d9d700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440639a0 0x7fa744157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:14.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74259c700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7440c1020 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fa7440b0a60 tx=0x7fa7340090f0).ready entity=mon.0 client_cookie=c67d62c189caec86 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:14.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa741d9b700 1 -- 172.21.15.153:0/2993370232 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400b600 con 0x7fa7440acf30 2023-08-17T00:13:14.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa741d9b700 1 -- 172.21.15.153:0/2993370232 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73400b760 con 0x7fa7440acf30 2023-08-17T00:13:14.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa741d9b700 1 -- 172.21.15.153:0/2993370232 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73400bb00 con 0x7fa7440acf30 2023-08-17T00:13:14.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 -- 172.21.15.153:0/2993370232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 msgr2=0x7fa7440c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7440c1020 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fa7440b0a60 tx=0x7fa7340090f0).stop 2023-08-17T00:13:14.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 -- 172.21.15.153:0/2993370232 shutdown_connections 2023-08-17T00:13:14.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7440639a0 0x7fa744157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 --2- 172.21.15.153:0/2993370232 >> v2:172.21.15.178:3300/0 conn(0x7fa7440c5ea0 0x7fa7440634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 --2- 172.21.15.153:0/2993370232 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7440c1020 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 -- 172.21.15.153:0/2993370232 >> 172.21.15.153:0/2993370232 conn(0x7fa7440cb330 msgr2=0x7fa7440c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:14.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 -- 172.21.15.153:0/2993370232 shutdown_connections 2023-08-17T00:13:14.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.280+0000 7fa74359e700 1 -- 172.21.15.153:0/2993370232 wait complete. 2023-08-17T00:13:14.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 Processor -- start 2023-08-17T00:13:14.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 -- start start 2023-08-17T00:13:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440639a0 0x7fa7440b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7441505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7441531b0 0x7fa744153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440b0900 con 0x7fa7440acf30 2023-08-17T00:13:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa744150ae0 con 0x7fa7440639a0 2023-08-17T00:13:14.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440aff80 con 0x7fa7441531b0 2023-08-17T00:13:14.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7441505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa73bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7441505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43678/0 (socket says 172.21.15.153:43678) 2023-08-17T00:13:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa73bfff700 1 -- 172.21.15.153:0/2336828828 learned_addr learned my addr 172.21.15.153:0/2336828828 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa74259c700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440639a0 0x7fa7440b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.284+0000 7fa742d9d700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7441531b0 0x7fa744153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73bfff700 1 -- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7441531b0 msgr2=0x7fa744153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73bfff700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7441531b0 0x7fa744153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73bfff700 1 -- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440639a0 msgr2=0x7fa7440b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73bfff700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440639a0 0x7fa7440b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73bfff700 1 -- 172.21.15.153:0/2336828828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa734009370 con 0x7fa7440acf30 2023-08-17T00:13:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa74259c700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440639a0 0x7fa7440b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:14.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73bfff700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7441505f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fa72c00d8c0 tx=0x7fa72c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011590 con 0x7fa7440acf30 2023-08-17T00:13:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c0116f0 con 0x7fa7440acf30 2023-08-17T00:13:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa744167b10 con 0x7fa7440acf30 2023-08-17T00:13:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011a70 con 0x7fa7440acf30 2023-08-17T00:13:14.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa744165150 con 0x7fa7440acf30 2023-08-17T00:13:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.288+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7441594e0 con 0x7fa7440acf30 2023-08-17T00:13:14.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.292+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa72c01c460 con 0x7fa7440acf30 2023-08-17T00:13:14.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.292+0000 7fa73a7fc700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa72405a150 0x7fa72405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.292+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa72c074070 con 0x7fa7440acf30 2023-08-17T00:13:14.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.292+0000 7fa74259c700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa72405a150 0x7fa72405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.296+0000 7fa74259c700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa72405a150 0x7fa72405c610 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fa734009fd0 tx=0x7fa734017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:14.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.300+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa72c0a28f0 con 0x7fa7440acf30 2023-08-17T00:13:14.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.460+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa744164ed0 con 0x7fa72405a150 2023-08-17T00:13:14.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.480+0000 7fa73a7fc700 1 -- 172.21.15.153:0/2336828828 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352466 (secure 0 0 0) 0x7fa744164ed0 con 0x7fa72405a150 2023-08-17T00:13:14.491 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:14.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa72405a150 msgr2=0x7fa72405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa72405a150 0x7fa72405c610 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fa734009fd0 tx=0x7fa734017000).stop 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 msgr2=0x7fa7441505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7441505f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 rx=0x7fa72c00d8c0 tx=0x7fa72c008040).stop 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 shutdown_connections 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa72405a150 0x7fa72405c610 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa7441531b0 0x7fa744153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa7440acf30 0x7fa7441505f0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 --2- 172.21.15.153:0/2336828828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7440639a0 0x7fa7440b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.484+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 >> 172.21.15.153:0/2336828828 conn(0x7fa7440cb330 msgr2=0x7fa744156980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.488+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 shutdown_connections 2023-08-17T00:13:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.488+0000 7fa74359e700 1 -- 172.21.15.153:0/2336828828 wait complete. 2023-08-17T00:13:14.495 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:13:14.512 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2023-08-17T00:13:13.408094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456660,"kb_used_data":13332,"kb_used_omap":0,"kb_used_meta":2443264,"kb_avail":752518060,"statfs":{"total":773094113280,"available":770578493440,"internally_reserved":0,"allocated":13651968,"data_stored":6366992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2501902336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077798280,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3202,"num_write_kb":-1053264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.219952"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149796+0000","last_change":"2023-08-17T00:13:09.705113+0000","last_active":"2023-08-17T00:13:10.149796+0000","last_peered":"2023-08-17T00:13:10.149796+0000","last_clean":"2023-08-17T00:13:10.149796+0000","last_became_active":"2023-08-17T00:13:09.704804+0000","last_became_peered":"2023-08-17T00:13:09.704804+0000","last_unstale":"2023-08-17T00:13:10.149796+0000","last_undegraded":"2023-08-17T00:13:10.149796+0000","last_fullsized":"2023-08-17T00:13:10.149796+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125940+0000","last_change":"2023-08-17T00:13:09.705945+0000","last_active":"2023-08-17T00:13:10.125940+0000","last_peered":"2023-08-17T00:13:10.125940+0000","last_clean":"2023-08-17T00:13:10.125940+0000","last_became_active":"2023-08-17T00:13:09.704883+0000","last_became_peered":"2023-08-17T00:13:09.704883+0000","last_unstale":"2023-08-17T00:13:10.125940+0000","last_undegraded":"2023-08-17T00:13:10.125940+0000","last_fullsized":"2023-08-17T00:13:10.125940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678761+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676109+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683419+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685550+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683880+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682905+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678655+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123985+0000","last_change":"2023-08-17T00:13:09.706671+0000","last_active":"2023-08-17T00:13:10.123985+0000","last_peered":"2023-08-17T00:13:10.123985+0000","last_clean":"2023-08-17T00:13:10.123985+0000","last_became_active":"2023-08-17T00:13:09.705653+0000","last_became_peered":"2023-08-17T00:13:09.705653+0000","last_unstale":"2023-08-17T00:13:10.123985+0000","last_undegraded":"2023-08-17T00:13:10.123985+0000","last_fullsized":"2023-08-17T00:13:10.123985+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676176+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683238+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149677+0000","last_change":"2023-08-17T00:13:10.135331+0000","last_active":"2023-08-17T00:13:10.149677+0000","last_peered":"2023-08-17T00:13:10.149677+0000","last_clean":"2023-08-17T00:13:10.149677+0000","last_became_active":"2023-08-17T00:13:10.135028+0000","last_became_peered":"2023-08-17T00:13:10.135028+0000","last_unstale":"2023-08-17T00:13:10.149677+0000","last_undegraded":"2023-08-17T00:13:10.149677+0000","last_fullsized":"2023-08-17T00:13:10.149677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676109+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680561+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682729+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682378+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678026+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682451+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149632+0000","last_change":"2023-08-17T00:13:09.704715+0000","last_active":"2023-08-17T00:13:10.149632+0000","last_peered":"2023-08-17T00:13:10.149632+0000","last_clean":"2023-08-17T00:13:10.149632+0000","last_became_active":"2023-08-17T00:13:09.704442+0000","last_became_peered":"2023-08-17T00:13:09.704442+0000","last_unstale":"2023-08-17T00:13:10.149632+0000","last_undegraded":"2023-08-17T00:13:10.149632+0000","last_fullsized":"2023-08-17T00:13:10.149632+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681934+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144511+0000","last_change":"2023-08-17T00:13:10.132288+0000","last_active":"2023-08-17T00:13:10.144511+0000","last_peered":"2023-08-17T00:13:10.144511+0000","last_clean":"2023-08-17T00:13:10.144511+0000","last_became_active":"2023-08-17T00:13:10.131952+0000","last_became_peered":"2023-08-17T00:13:10.131952+0000","last_unstale":"2023-08-17T00:13:10.144511+0000","last_undegraded":"2023-08-17T00:13:10.144511+0000","last_fullsized":"2023-08-17T00:13:10.144511+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685792+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119797+0000","last_change":"2023-08-17T00:13:09.704362+0000","last_active":"2023-08-17T00:13:10.119797+0000","last_peered":"2023-08-17T00:13:10.119797+0000","last_clean":"2023-08-17T00:13:10.119797+0000","last_became_active":"2023-08-17T00:13:09.703910+0000","last_became_peered":"2023-08-17T00:13:09.703910+0000","last_unstale":"2023-08-17T00:13:10.119797+0000","last_undegraded":"2023-08-17T00:13:10.119797+0000","last_fullsized":"2023-08-17T00:13:10.119797+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149441+0000","last_change":"2023-08-17T00:13:10.135316+0000","last_active":"2023-08-17T00:13:10.149441+0000","last_peered":"2023-08-17T00:13:10.149441+0000","last_clean":"2023-08-17T00:13:10.149441+0000","last_became_active":"2023-08-17T00:13:10.134715+0000","last_became_peered":"2023-08-17T00:13:10.134715+0000","last_unstale":"2023-08-17T00:13:10.149441+0000","last_undegraded":"2023-08-17T00:13:10.149441+0000","last_fullsized":"2023-08-17T00:13:10.149441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681870+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681796+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676205+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124104+0000","last_change":"2023-08-17T00:13:09.713360+0000","last_active":"2023-08-17T00:13:10.124104+0000","last_peered":"2023-08-17T00:13:10.124104+0000","last_clean":"2023-08-17T00:13:10.124104+0000","last_became_active":"2023-08-17T00:13:09.713047+0000","last_became_peered":"2023-08-17T00:13:09.713047+0000","last_unstale":"2023-08-17T00:13:10.124104+0000","last_undegraded":"2023-08-17T00:13:10.124104+0000","last_fullsized":"2023-08-17T00:13:10.124104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681215+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.684295+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.121807+0000","last_change":"2023-08-17T00:13:09.714585+0000","last_active":"2023-08-17T00:13:10.121807+0000","last_peered":"2023-08-17T00:13:10.121807+0000","last_clean":"2023-08-17T00:13:10.121807+0000","last_became_active":"2023-08-17T00:13:09.714324+0000","last_became_peered":"2023-08-17T00:13:09.714324+0000","last_unstale":"2023-08-17T00:13:10.121807+0000","last_undegraded":"2023-08-17T00:13:10.121807+0000","last_fullsized":"2023-08-17T00:13:10.121807+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119960+0000","last_change":"2023-08-17T00:13:09.704177+0000","last_active":"2023-08-17T00:13:10.119960+0000","last_peered":"2023-08-17T00:13:10.119960+0000","last_clean":"2023-08-17T00:13:10.119960+0000","last_became_active":"2023-08-17T00:13:09.703629+0000","last_became_peered":"2023-08-17T00:13:09.703629+0000","last_unstale":"2023-08-17T00:13:10.119960+0000","last_undegraded":"2023-08-17T00:13:10.119960+0000","last_fullsized":"2023-08-17T00:13:10.119960+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681220+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677309+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677412+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681599+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683584+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149507+0000","last_change":"2023-08-17T00:13:10.136335+0000","last_active":"2023-08-17T00:13:10.149507+0000","last_peered":"2023-08-17T00:13:10.149507+0000","last_clean":"2023-08-17T00:13:10.149507+0000","last_became_active":"2023-08-17T00:13:10.135737+0000","last_became_peered":"2023-08-17T00:13:10.135737+0000","last_unstale":"2023-08-17T00:13:10.149507+0000","last_undegraded":"2023-08-17T00:13:10.149507+0000","last_fullsized":"2023-08-17T00:13:10.149507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677404+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685346+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681994+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119521+0000","last_change":"2023-08-17T00:13:09.703051+0000","last_active":"2023-08-17T00:13:10.119521+0000","last_peered":"2023-08-17T00:13:10.119521+0000","last_clean":"2023-08-17T00:13:10.119521+0000","last_became_active":"2023-08-17T00:13:09.702719+0000","last_became_peered":"2023-08-17T00:13:09.702719+0000","last_unstale":"2023-08-17T00:13:10.119521+0000","last_undegraded":"2023-08-17T00:13:10.119521+0000","last_fullsized":"2023-08-17T00:13:10.119521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681437+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682962+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683496+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120333+0000","last_change":"2023-08-17T00:13:09.702990+0000","last_active":"2023-08-17T00:13:10.120333+0000","last_peered":"2023-08-17T00:13:10.120333+0000","last_clean":"2023-08-17T00:13:10.120333+0000","last_became_active":"2023-08-17T00:13:09.702687+0000","last_became_peered":"2023-08-17T00:13:09.702687+0000","last_unstale":"2023-08-17T00:13:10.120333+0000","last_undegraded":"2023-08-17T00:13:10.120333+0000","last_fullsized":"2023-08-17T00:13:10.120333+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.122097+0000","last_change":"2023-08-17T00:13:09.705408+0000","last_active":"2023-08-17T00:13:10.122097+0000","last_peered":"2023-08-17T00:13:10.122097+0000","last_clean":"2023-08-17T00:13:10.122097+0000","last_became_active":"2023-08-17T00:13:09.705098+0000","last_became_peered":"2023-08-17T00:13:09.705098+0000","last_unstale":"2023-08-17T00:13:10.122097+0000","last_undegraded":"2023-08-17T00:13:10.122097+0000","last_fullsized":"2023-08-17T00:13:10.122097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682817+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120087+0000","last_change":"2023-08-17T00:13:09.704921+0000","last_active":"2023-08-17T00:13:10.120087+0000","last_peered":"2023-08-17T00:13:10.120087+0000","last_clean":"2023-08-17T00:13:10.120087+0000","last_became_active":"2023-08-17T00:13:09.704624+0000","last_became_peered":"2023-08-17T00:13:09.704624+0000","last_unstale":"2023-08-17T00:13:10.120087+0000","last_undegraded":"2023-08-17T00:13:10.120087+0000","last_fullsized":"2023-08-17T00:13:10.120087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149756+0000","last_change":"2023-08-17T00:13:10.139142+0000","last_active":"2023-08-17T00:13:10.149756+0000","last_peered":"2023-08-17T00:13:10.149756+0000","last_clean":"2023-08-17T00:13:10.149756+0000","last_became_active":"2023-08-17T00:13:10.137758+0000","last_became_peered":"2023-08-17T00:13:10.137758+0000","last_unstale":"2023-08-17T00:13:10.149756+0000","last_undegraded":"2023-08-17T00:13:10.149756+0000","last_fullsized":"2023-08-17T00:13:10.149756+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682035+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680352+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149866+0000","last_change":"2023-08-17T00:13:09.710277+0000","last_active":"2023-08-17T00:13:10.149866+0000","last_peered":"2023-08-17T00:13:10.149866+0000","last_clean":"2023-08-17T00:13:10.149866+0000","last_became_active":"2023-08-17T00:13:09.709967+0000","last_became_peered":"2023-08-17T00:13:09.709967+0000","last_unstale":"2023-08-17T00:13:10.149866+0000","last_undegraded":"2023-08-17T00:13:10.149866+0000","last_fullsized":"2023-08-17T00:13:10.149866+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681145+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677184+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680737+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681540+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682663+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680099+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682388+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124215+0000","last_change":"2023-08-17T00:13:09.703795+0000","last_active":"2023-08-17T00:13:10.124215+0000","last_peered":"2023-08-17T00:13:10.124215+0000","last_clean":"2023-08-17T00:13:10.124215+0000","last_became_active":"2023-08-17T00:13:09.703457+0000","last_became_peered":"2023-08-17T00:13:09.703457+0000","last_unstale":"2023-08-17T00:13:10.124215+0000","last_undegraded":"2023-08-17T00:13:10.124215+0000","last_fullsized":"2023-08-17T00:13:10.124215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919504+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:13:05.919504+0000","last_peered":"2023-08-17T00:13:05.919504+0000","last_clean":"2023-08-17T00:13:05.919504+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:13:05.919504+0000","last_undegraded":"2023-08-17T00:13:05.919504+0000","last_fullsized":"2023-08-17T00:13:05.919504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149720+0000","last_change":"2023-08-17T00:13:10.138302+0000","last_active":"2023-08-17T00:13:10.149720+0000","last_peered":"2023-08-17T00:13:10.149720+0000","last_clean":"2023-08-17T00:13:10.149720+0000","last_became_active":"2023-08-17T00:13:10.138028+0000","last_became_peered":"2023-08-17T00:13:10.138028+0000","last_unstale":"2023-08-17T00:13:10.149720+0000","last_undegraded":"2023-08-17T00:13:10.149720+0000","last_fullsized":"2023-08-17T00:13:10.149720+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683525+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124304+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:13:10.124304+0000","last_peered":"2023-08-17T00:13:10.124304+0000","last_clean":"2023-08-17T00:13:10.124304+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:13:10.124304+0000","last_undegraded":"2023-08-17T00:13:10.124304+0000","last_fullsized":"2023-08-17T00:13:10.124304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682745+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919375+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:13:05.919375+0000","last_peered":"2023-08-17T00:13:05.919375+0000","last_clean":"2023-08-17T00:13:05.919375+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:13:05.919375+0000","last_undegraded":"2023-08-17T00:13:05.919375+0000","last_fullsized":"2023-08-17T00:13:05.919375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.684943+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.788016+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:13:05.788016+0000","last_peered":"2023-08-17T00:13:05.788016+0000","last_clean":"2023-08-17T00:13:05.788016+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:13:05.788016+0000","last_undegraded":"2023-08-17T00:13:05.788016+0000","last_fullsized":"2023-08-17T00:13:05.788016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681219+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919378+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:13:05.919378+0000","last_peered":"2023-08-17T00:13:05.919378+0000","last_clean":"2023-08-17T00:13:05.919378+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:13:05.919378+0000","last_undegraded":"2023-08-17T00:13:05.919378+0000","last_fullsized":"2023-08-17T00:13:05.919378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681904+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919579+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:13:05.919579+0000","last_peered":"2023-08-17T00:13:05.919579+0000","last_clean":"2023-08-17T00:13:05.919579+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:13:05.919579+0000","last_undegraded":"2023-08-17T00:13:05.919579+0000","last_fullsized":"2023-08-17T00:13:05.919579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682635+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919357+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:13:05.919357+0000","last_peered":"2023-08-17T00:13:05.919357+0000","last_clean":"2023-08-17T00:13:05.919357+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:13:05.919357+0000","last_undegraded":"2023-08-17T00:13:05.919357+0000","last_fullsized":"2023-08-17T00:13:05.919357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677205+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919219+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:13:05.919219+0000","last_peered":"2023-08-17T00:13:05.919219+0000","last_clean":"2023-08-17T00:13:05.919219+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:13:05.919219+0000","last_undegraded":"2023-08-17T00:13:05.919219+0000","last_fullsized":"2023-08-17T00:13:05.919219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":109,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.787445+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:13:05.787445+0000","last_peered":"2023-08-17T00:13:05.787445+0000","last_clean":"2023-08-17T00:13:05.787445+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:13:05.787445+0000","last_undegraded":"2023-08-17T00:13:05.787445+0000","last_fullsized":"2023-08-17T00:13:05.787445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311164,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060676,"statfs":{"total":96636764160,"available":96318132224,"internally_reserved":0,"allocated":1691648,"data_stored":788560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.2090000000000001},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2210000000000001,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.036,"15min":1.2529999999999999},"min":{"1min":0.57899999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3169999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0580000000000001,"15min":1.272},"min":{"1min":0.627,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.2769999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.097,"15min":1.2749999999999999},"min":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.028,"15min":1.1819999999999999},"min":{"1min":0.65200000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.276,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.1240000000000001,"15min":1.3169999999999999},"min":{"1min":0.629,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.4199999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.095,"15min":1.226},"min":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2509999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.075},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1819999999999999,"15min":1.4790000000000001},"min":{"1min":0.78100000000000003,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.359,"5min":1.952,"15min":13.074999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1539999999999999,"15min":1.4350000000000001},"min":{"1min":0.70799999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.3799999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1279999999999999,"15min":1.3700000000000001},"min":{"1min":0.80200000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3380000000000001,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.226,"15min":1.5569999999999999},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.9830000000000001,"15min":14.435},"last":1.175},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.226,"15min":1.526},"min":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.502,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.3560000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2969999999999999,"15min":1.556},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5920000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.238},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.2270000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.411,"5min":2.4350000000000001,"15min":11.365},"last":1.3899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542271,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311176,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060664,"statfs":{"total":96636764160,"available":96318119936,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.032,"15min":1.056},"min":{"1min":0.53800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.367,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":10.519,"15min":10.519},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.147,"15min":1.143},"min":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.3500000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4530000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":1.1839999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1319999999999999,"15min":1.161},"min":{"1min":0.71199999999999997,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.506,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2909999999999999,"15min":1.2809999999999999},"min":{"1min":0.72999999999999998,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5489999999999999,"5min":10.669,"15min":10.669},"last":1.377}]},{"osd":3,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.119,"15min":1.171},"min":{"1min":0.81000000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5860000000000001,"5min":1.9319999999999999,"15min":11.475},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.2310000000000001,"15min":1.252},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.304}]},{"osd":4,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.296,"15min":1.278},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.571,"5min":10.632,"15min":10.632},"last":1.325},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.2,"15min":1.236},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.7350000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":1.292}]},{"osd":5,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.80500000000000005,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.5880000000000001,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.079},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.413,"15min":1.3720000000000001},"min":{"1min":0.89000000000000001,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.7310000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.423}]},{"osd":7,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2969999999999999,"15min":1.329},"min":{"1min":0.77400000000000002,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.788,"5min":3.3450000000000002,"15min":11.51},"last":1.105},{"interface":"front","average":{"1min":1.286,"5min":1.377,"15min":1.4019999999999999},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.704,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.2170000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.3220000000000001},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4870000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.244},{"interface":"front","average":{"1min":1.155,"5min":1.0349999999999999,"15min":1.4350000000000001},"min":{"1min":0.67500000000000004,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.946}]},{"osd":1,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0389999999999999,"15min":1.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.423,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":1.746},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.113,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.5760000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.4279999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.153,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.2750000000000004,"5min":4.2750000000000004,"15min":16.675000000000001},"last":0.997},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.3879999999999999},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.60299999999999998},"max":{"1min":1.522,"5min":1.796,"15min":11.949},"last":1.383}]},{"osd":3,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.171,"15min":1.4399999999999999},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":13.125},"last":1.593},{"interface":"front","average":{"1min":1.206,"5min":1.1799999999999999,"15min":1.3740000000000001},"min":{"1min":0.82399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.306,"5min":2.306,"15min":8.4809999999999999},"last":1.887}]},{"osd":4,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.532},"min":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.458,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.7},{"interface":"front","average":{"1min":1.389,"5min":1.2310000000000001,"15min":1.6579999999999999},"min":{"1min":0.78300000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.456}]},{"osd":6,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.236,"15min":1.627},"min":{"1min":0.81499999999999995,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":1.627},"min":{"1min":0.92900000000000005,"5min":0.68600000000000005,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.5309999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3240000000000001,"15min":1.742},"min":{"1min":0.94999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.2130000000000001,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.345,"15min":1.6839999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0019999999999998,"5min":2.0899999999999999,"15min":14.818},"last":1.978}]}]},{"osd":3,"up_from":14,"seq":60129542271,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307068,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064772,"statfs":{"total":96636764160,"available":96322326528,"internally_reserved":0,"allocated":1691648,"data_stored":788560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3320000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.194,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.81100000000000005},"min":{"1min":0.53700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.423,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.83899999999999997,"15min":0.90200000000000002},"min":{"1min":0.47499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.2869999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.433,"15min":0.433},"max":{"1min":1.359,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.167}]},{"osd":4,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.198},"min":{"1min":0.74199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.498,"5min":2.274,"15min":3.9449999999999998},"last":1.365},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.143,"15min":1.206},"min":{"1min":0.749,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5860000000000001,"5min":1.649,"15min":3.9790000000000001},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1200000000000001,"15min":1.2090000000000001},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.89000000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6459999999999999,"5min":1.669,"15min":2.6789999999999998},"last":1.429}]},{"osd":6,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1399999999999999,"15min":1.236},"min":{"1min":0.629,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.603,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.331},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.206},"min":{"1min":0.83099999999999996,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.6899999999999999,"5min":2.0979999999999999,"15min":3.585},"last":1.22}]},{"osd":7,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.206,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.6319999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.2310000000000001},"min":{"1min":0.84499999999999997,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.679,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0840000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.83799999999999997},"min":{"1min":0.5,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.4359999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":1.103},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.76400000000000001,"15min":0.94199999999999995},"min":{"1min":0.57199999999999995,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61099999999999999,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.286,"5min":2.097,"15min":3.7589999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.91300000000000003,"15min":1.0449999999999999},"min":{"1min":0.69199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2949999999999999,"5min":1.3799999999999999,"15min":3.911},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":1.1220000000000001},"min":{"1min":0.628,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":5.4059999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.98699999999999999},"min":{"1min":0.63500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4910000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":1.02}]},{"osd":4,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0860000000000001,"15min":1.5900000000000001},"min":{"1min":0.76800000000000002,"5min":0.61699999999999999,"15min":0.48399999999999999},"max":{"1min":1.794,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.075},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.91700000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":8.4399999999999995},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2569999999999999,"15min":1.5980000000000001},"min":{"1min":1.107,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.734,"5min":1.734,"15min":12.914},"last":1.05},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.4430000000000001},"min":{"1min":0.94199999999999995,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.772,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.204}]},{"osd":6,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1990000000000001,"15min":1.5469999999999999},"min":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":1.621,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2410000000000001,"15min":1.5960000000000001},"min":{"1min":1.03,"5min":0.82899999999999996,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":1.6879999999999999,"15min":12.698},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.5720000000000001},"min":{"1min":1.0109999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.627,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.159},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3129999999999999,"15min":1.583},"min":{"1min":0.79200000000000004,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.9159999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.1819999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.298,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.90100000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2170000000000001,"5min":1.367,"15min":13.093},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.76500000000000001,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.3420000000000001,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.89000000000000001},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.365,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94699999999999995,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.4630000000000001,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.86099999999999999,"15min":0.96399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.26,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.036,"15min":1.1539999999999999},"min":{"1min":0.68300000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.671,"5min":1.671,"15min":20.548999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.125,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.764,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.222}]},{"osd":5,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1870000000000001,"15min":1.3140000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5309999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1799999999999999,"15min":1.2529999999999999},"min":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7470000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.2569999999999999},"min":{"1min":0.81000000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.1599999999999999,"15min":1.21},"min":{"1min":0.92300000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":1.6990000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.427}]},{"osd":7,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.25,"15min":1.3129999999999999},"min":{"1min":0.97699999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.9179999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.294},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.3440000000000001},"min":{"1min":0.91000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.6399999999999999,"5min":3.4180000000000001,"15min":13.131},"last":1.4019999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.83799999999999997},"min":{"1min":0.45700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.4830000000000001,"5min":18.442,"15min":18.442},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89800000000000002,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.5669999999999999,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.04,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.208,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.5840000000000001,"5min":1.613,"15min":1.613},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.167,"15min":1.0700000000000001},"min":{"1min":0.63900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.9079999999999999,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.0920000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.7609999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.343,"15min":1.2529999999999999},"min":{"1min":0.80000000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4099999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3799999999999999,"15min":1.304},"min":{"1min":0.88,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.9199999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2010000000000001,"15min":1.2529999999999999},"min":{"1min":0.85799999999999998,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.754,"5min":1.984,"15min":1.984},"last":0.996}]},{"osd":6,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3759999999999999,"15min":1.3169999999999999},"min":{"1min":1.081,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6859999999999999,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3959999999999999,"15min":1.3080000000000001},"min":{"1min":0.94999999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6579999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.93200000000000005,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.786,"5min":1.804,"15min":2.0750000000000002},"last":1.242}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0349999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.2889999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.097,"15min":1.069},"min":{"1min":0.62,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":2.5539999999999998,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5229999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.089},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1819999999999999,"15min":1.242},"min":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5129999999999999,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.236},"min":{"1min":0.74199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7030000000000001,"5min":6.6500000000000004,"15min":18.431000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.3340000000000001},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.623,"5min":1.738,"15min":36.531999999999996},"last":1.141}]},{"osd":3,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0980000000000001,"15min":1.133},"min":{"1min":0.751,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.996},{"interface":"front","average":{"1min":1.155,"5min":1.2290000000000001,"15min":1.411},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.40400000000000003},"max":{"1min":1.7569999999999999,"5min":6.6920000000000002,"15min":36.530000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.23,"15min":1.246},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.462,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.046},{"interface":"front","average":{"1min":1.244,"5min":1.268,"15min":1.302},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":3.2519999999999998,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.181}]},{"osd":6,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3520000000000001},"min":{"1min":0.73199999999999998,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.6080000000000001,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.345},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3049999999999999,"15min":1.403},"min":{"1min":0.81399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.526,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.371}]},{"osd":7,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.21,"15min":1.2829999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.4179999999999999},"min":{"1min":0.68600000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.8009999999999999,"5min":6.7430000000000003,"15min":8.327},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:13:14.521 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:13:14.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.716+0000 7fc24e0e4700 1 Processor -- start 2023-08-17T00:13:14.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.716+0000 7fc24e0e4700 1 -- start start 2023-08-17T00:13:14.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24e0e4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc248068da0 0x7fc2481560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24e0e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc248065da0 con 0x7fc248151530 2023-08-17T00:13:14.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24e0e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc248155c60 con 0x7fc2480689c0 2023-08-17T00:13:14.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24e0e4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc248069200 con 0x7fc248068da0 2023-08-17T00:13:14.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc248068da0 0x7fc2481560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc248068da0 0x7fc2481560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43684/0 (socket says 172.21.15.153:43684) 2023-08-17T00:13:14.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 -- 172.21.15.153:0/2670940672 learned_addr learned my addr 172.21.15.153:0/2670940672 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:14.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 -- 172.21.15.153:0/2670940672 >> v1:172.21.15.178:6789/0 conn(0x7fc2480689c0 legacy=0x7fc2480c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 -- 172.21.15.153:0/2670940672 >> v1:172.21.15.153:6789/0 conn(0x7fc248151530 legacy=0x7fc2481519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 -- 172.21.15.153:0/2670940672 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc248065ff0 con 0x7fc248068da0 2023-08-17T00:13:14.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc24c8e1700 1 --2- 172.21.15.153:0/2670940672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc248068da0 0x7fc2481560f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fc238006fd0 tx=0x7fc2380090f0).ready entity=mon.0 client_cookie=9a7c4d16c36377a8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:14.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc23ffff700 1 -- 172.21.15.153:0/2670940672 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800b600 con 0x7fc248068da0 2023-08-17T00:13:14.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc23ffff700 1 -- 172.21.15.153:0/2670940672 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23800b760 con 0x7fc248068da0 2023-08-17T00:13:14.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.720+0000 7fc23ffff700 1 -- 172.21.15.153:0/2670940672 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800bb00 con 0x7fc248068da0 2023-08-17T00:13:14.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2670940672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc248068da0 msgr2=0x7fc2481560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2670940672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc248068da0 0x7fc2481560f0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fc238006fd0 tx=0x7fc2380090f0).stop 2023-08-17T00:13:14.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2670940672 shutdown_connections 2023-08-17T00:13:14.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2670940672 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc248068da0 0x7fc2481560f0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2670940672 >> 172.21.15.153:0/2670940672 conn(0x7fc2480c6620 msgr2=0x7fc2480c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:14.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2670940672 shutdown_connections 2023-08-17T00:13:14.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2670940672 wait complete. 2023-08-17T00:13:14.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 Processor -- start 2023-08-17T00:13:14.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.724+0000 7fc24e0e4700 1 -- start start 2023-08-17T00:13:14.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 0x7fc2480a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc248068da0 0x7fc2480a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248151530 0x7fc2481533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc248155200 con 0x7fc2480689c0 2023-08-17T00:13:14.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2480a1590 con 0x7fc248068da0 2023-08-17T00:13:14.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc248154d70 con 0x7fc248151530 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 0x7fc2480a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 0x7fc2480a0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43696/0 (socket says 172.21.15.153:43696) 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 -- 172.21.15.153:0/2020123712 learned_addr learned my addr 172.21.15.153:0/2020123712 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d8e3700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248151530 0x7fc2481533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24c8e1700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc248068da0 0x7fc2480a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 -- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248151530 msgr2=0x7fc2481533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248151530 0x7fc2481533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 -- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc248068da0 msgr2=0x7fc2480a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc248068da0 0x7fc2480a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 -- 172.21.15.153:0/2020123712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238009370 con 0x7fc2480689c0 2023-08-17T00:13:14.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24d0e2700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 0x7fc2480a0bb0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fc24400c740 tx=0x7fc2440015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:14.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244006a70 con 0x7fc2480689c0 2023-08-17T00:13:14.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc244006bd0 con 0x7fc2480689c0 2023-08-17T00:13:14.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc244007020 con 0x7fc2480689c0 2023-08-17T00:13:14.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc248154160 con 0x7fc2480689c0 2023-08-17T00:13:14.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.728+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc248154720 con 0x7fc2480689c0 2023-08-17T00:13:14.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.732+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc24806b4c0 con 0x7fc2480689c0 2023-08-17T00:13:14.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.732+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc244018020 con 0x7fc2480689c0 2023-08-17T00:13:14.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.732+0000 7fc23d7fa700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc22c05a180 0x7fc22c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:14.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.732+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc244073d20 con 0x7fc2480689c0 2023-08-17T00:13:14.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.732+0000 7fc24c8e1700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc22c05a180 0x7fc22c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:14.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.736+0000 7fc24c8e1700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc22c05a180 0x7fc22c05c640 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fc2480c4f50 tx=0x7fc238017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:14.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.736+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc244079020 con 0x7fc2480689c0 2023-08-17T00:13:14.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.896+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc248064010 con 0x7fc22c05a180 2023-08-17T00:13:14.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.912+0000 7fc23d7fa700 1 -- 172.21.15.153:0/2020123712 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352466 (secure 0 0 0) 0x7fc248064010 con 0x7fc22c05a180 2023-08-17T00:13:14.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:14.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc22c05a180 msgr2=0x7fc22c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc22c05a180 0x7fc22c05c640 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7fc2480c4f50 tx=0x7fc238017000).stop 2023-08-17T00:13:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 msgr2=0x7fc2480a0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:14.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 0x7fc2480a0bb0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 rx=0x7fc24400c740 tx=0x7fc2440015e0).stop 2023-08-17T00:13:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 shutdown_connections 2023-08-17T00:13:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc22c05a180 0x7fc22c05c640 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248151530 0x7fc2481533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc248068da0 0x7fc2480a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 --2- 172.21.15.153:0/2020123712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc2480689c0 0x7fc2480a0bb0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 >> 172.21.15.153:0/2020123712 conn(0x7fc2480c6620 msgr2=0x7fc248061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 shutdown_connections 2023-08-17T00:13:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:14.924+0000 7fc24e0e4700 1 -- 172.21.15.153:0/2020123712 wait complete. 2023-08-17T00:13:14.932 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:13:14.950 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2023-08-17T00:13:13.408094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456660,"kb_used_data":13332,"kb_used_omap":0,"kb_used_meta":2443264,"kb_avail":752518060,"statfs":{"total":773094113280,"available":770578493440,"internally_reserved":0,"allocated":13651968,"data_stored":6366992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2501902336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077798280,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3202,"num_write_kb":-1053264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.219952"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149796+0000","last_change":"2023-08-17T00:13:09.705113+0000","last_active":"2023-08-17T00:13:10.149796+0000","last_peered":"2023-08-17T00:13:10.149796+0000","last_clean":"2023-08-17T00:13:10.149796+0000","last_became_active":"2023-08-17T00:13:09.704804+0000","last_became_peered":"2023-08-17T00:13:09.704804+0000","last_unstale":"2023-08-17T00:13:10.149796+0000","last_undegraded":"2023-08-17T00:13:10.149796+0000","last_fullsized":"2023-08-17T00:13:10.149796+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125940+0000","last_change":"2023-08-17T00:13:09.705945+0000","last_active":"2023-08-17T00:13:10.125940+0000","last_peered":"2023-08-17T00:13:10.125940+0000","last_clean":"2023-08-17T00:13:10.125940+0000","last_became_active":"2023-08-17T00:13:09.704883+0000","last_became_peered":"2023-08-17T00:13:09.704883+0000","last_unstale":"2023-08-17T00:13:10.125940+0000","last_undegraded":"2023-08-17T00:13:10.125940+0000","last_fullsized":"2023-08-17T00:13:10.125940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678761+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676109+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683419+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685550+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683880+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682905+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678655+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123985+0000","last_change":"2023-08-17T00:13:09.706671+0000","last_active":"2023-08-17T00:13:10.123985+0000","last_peered":"2023-08-17T00:13:10.123985+0000","last_clean":"2023-08-17T00:13:10.123985+0000","last_became_active":"2023-08-17T00:13:09.705653+0000","last_became_peered":"2023-08-17T00:13:09.705653+0000","last_unstale":"2023-08-17T00:13:10.123985+0000","last_undegraded":"2023-08-17T00:13:10.123985+0000","last_fullsized":"2023-08-17T00:13:10.123985+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676176+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683238+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149677+0000","last_change":"2023-08-17T00:13:10.135331+0000","last_active":"2023-08-17T00:13:10.149677+0000","last_peered":"2023-08-17T00:13:10.149677+0000","last_clean":"2023-08-17T00:13:10.149677+0000","last_became_active":"2023-08-17T00:13:10.135028+0000","last_became_peered":"2023-08-17T00:13:10.135028+0000","last_unstale":"2023-08-17T00:13:10.149677+0000","last_undegraded":"2023-08-17T00:13:10.149677+0000","last_fullsized":"2023-08-17T00:13:10.149677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676109+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680561+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682729+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682378+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678026+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682451+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149632+0000","last_change":"2023-08-17T00:13:09.704715+0000","last_active":"2023-08-17T00:13:10.149632+0000","last_peered":"2023-08-17T00:13:10.149632+0000","last_clean":"2023-08-17T00:13:10.149632+0000","last_became_active":"2023-08-17T00:13:09.704442+0000","last_became_peered":"2023-08-17T00:13:09.704442+0000","last_unstale":"2023-08-17T00:13:10.149632+0000","last_undegraded":"2023-08-17T00:13:10.149632+0000","last_fullsized":"2023-08-17T00:13:10.149632+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681934+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144511+0000","last_change":"2023-08-17T00:13:10.132288+0000","last_active":"2023-08-17T00:13:10.144511+0000","last_peered":"2023-08-17T00:13:10.144511+0000","last_clean":"2023-08-17T00:13:10.144511+0000","last_became_active":"2023-08-17T00:13:10.131952+0000","last_became_peered":"2023-08-17T00:13:10.131952+0000","last_unstale":"2023-08-17T00:13:10.144511+0000","last_undegraded":"2023-08-17T00:13:10.144511+0000","last_fullsized":"2023-08-17T00:13:10.144511+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685792+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119797+0000","last_change":"2023-08-17T00:13:09.704362+0000","last_active":"2023-08-17T00:13:10.119797+0000","last_peered":"2023-08-17T00:13:10.119797+0000","last_clean":"2023-08-17T00:13:10.119797+0000","last_became_active":"2023-08-17T00:13:09.703910+0000","last_became_peered":"2023-08-17T00:13:09.703910+0000","last_unstale":"2023-08-17T00:13:10.119797+0000","last_undegraded":"2023-08-17T00:13:10.119797+0000","last_fullsized":"2023-08-17T00:13:10.119797+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149441+0000","last_change":"2023-08-17T00:13:10.135316+0000","last_active":"2023-08-17T00:13:10.149441+0000","last_peered":"2023-08-17T00:13:10.149441+0000","last_clean":"2023-08-17T00:13:10.149441+0000","last_became_active":"2023-08-17T00:13:10.134715+0000","last_became_peered":"2023-08-17T00:13:10.134715+0000","last_unstale":"2023-08-17T00:13:10.149441+0000","last_undegraded":"2023-08-17T00:13:10.149441+0000","last_fullsized":"2023-08-17T00:13:10.149441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681870+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681796+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676205+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124104+0000","last_change":"2023-08-17T00:13:09.713360+0000","last_active":"2023-08-17T00:13:10.124104+0000","last_peered":"2023-08-17T00:13:10.124104+0000","last_clean":"2023-08-17T00:13:10.124104+0000","last_became_active":"2023-08-17T00:13:09.713047+0000","last_became_peered":"2023-08-17T00:13:09.713047+0000","last_unstale":"2023-08-17T00:13:10.124104+0000","last_undegraded":"2023-08-17T00:13:10.124104+0000","last_fullsized":"2023-08-17T00:13:10.124104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681215+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.684295+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.121807+0000","last_change":"2023-08-17T00:13:09.714585+0000","last_active":"2023-08-17T00:13:10.121807+0000","last_peered":"2023-08-17T00:13:10.121807+0000","last_clean":"2023-08-17T00:13:10.121807+0000","last_became_active":"2023-08-17T00:13:09.714324+0000","last_became_peered":"2023-08-17T00:13:09.714324+0000","last_unstale":"2023-08-17T00:13:10.121807+0000","last_undegraded":"2023-08-17T00:13:10.121807+0000","last_fullsized":"2023-08-17T00:13:10.121807+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119960+0000","last_change":"2023-08-17T00:13:09.704177+0000","last_active":"2023-08-17T00:13:10.119960+0000","last_peered":"2023-08-17T00:13:10.119960+0000","last_clean":"2023-08-17T00:13:10.119960+0000","last_became_active":"2023-08-17T00:13:09.703629+0000","last_became_peered":"2023-08-17T00:13:09.703629+0000","last_unstale":"2023-08-17T00:13:10.119960+0000","last_undegraded":"2023-08-17T00:13:10.119960+0000","last_fullsized":"2023-08-17T00:13:10.119960+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681220+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677309+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677412+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681599+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683584+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149507+0000","last_change":"2023-08-17T00:13:10.136335+0000","last_active":"2023-08-17T00:13:10.149507+0000","last_peered":"2023-08-17T00:13:10.149507+0000","last_clean":"2023-08-17T00:13:10.149507+0000","last_became_active":"2023-08-17T00:13:10.135737+0000","last_became_peered":"2023-08-17T00:13:10.135737+0000","last_unstale":"2023-08-17T00:13:10.149507+0000","last_undegraded":"2023-08-17T00:13:10.149507+0000","last_fullsized":"2023-08-17T00:13:10.149507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677404+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685346+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681994+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119521+0000","last_change":"2023-08-17T00:13:09.703051+0000","last_active":"2023-08-17T00:13:10.119521+0000","last_peered":"2023-08-17T00:13:10.119521+0000","last_clean":"2023-08-17T00:13:10.119521+0000","last_became_active":"2023-08-17T00:13:09.702719+0000","last_became_peered":"2023-08-17T00:13:09.702719+0000","last_unstale":"2023-08-17T00:13:10.119521+0000","last_undegraded":"2023-08-17T00:13:10.119521+0000","last_fullsized":"2023-08-17T00:13:10.119521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681437+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682962+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683496+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120333+0000","last_change":"2023-08-17T00:13:09.702990+0000","last_active":"2023-08-17T00:13:10.120333+0000","last_peered":"2023-08-17T00:13:10.120333+0000","last_clean":"2023-08-17T00:13:10.120333+0000","last_became_active":"2023-08-17T00:13:09.702687+0000","last_became_peered":"2023-08-17T00:13:09.702687+0000","last_unstale":"2023-08-17T00:13:10.120333+0000","last_undegraded":"2023-08-17T00:13:10.120333+0000","last_fullsized":"2023-08-17T00:13:10.120333+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.122097+0000","last_change":"2023-08-17T00:13:09.705408+0000","last_active":"2023-08-17T00:13:10.122097+0000","last_peered":"2023-08-17T00:13:10.122097+0000","last_clean":"2023-08-17T00:13:10.122097+0000","last_became_active":"2023-08-17T00:13:09.705098+0000","last_became_peered":"2023-08-17T00:13:09.705098+0000","last_unstale":"2023-08-17T00:13:10.122097+0000","last_undegraded":"2023-08-17T00:13:10.122097+0000","last_fullsized":"2023-08-17T00:13:10.122097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682817+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120087+0000","last_change":"2023-08-17T00:13:09.704921+0000","last_active":"2023-08-17T00:13:10.120087+0000","last_peered":"2023-08-17T00:13:10.120087+0000","last_clean":"2023-08-17T00:13:10.120087+0000","last_became_active":"2023-08-17T00:13:09.704624+0000","last_became_peered":"2023-08-17T00:13:09.704624+0000","last_unstale":"2023-08-17T00:13:10.120087+0000","last_undegraded":"2023-08-17T00:13:10.120087+0000","last_fullsized":"2023-08-17T00:13:10.120087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149756+0000","last_change":"2023-08-17T00:13:10.139142+0000","last_active":"2023-08-17T00:13:10.149756+0000","last_peered":"2023-08-17T00:13:10.149756+0000","last_clean":"2023-08-17T00:13:10.149756+0000","last_became_active":"2023-08-17T00:13:10.137758+0000","last_became_peered":"2023-08-17T00:13:10.137758+0000","last_unstale":"2023-08-17T00:13:10.149756+0000","last_undegraded":"2023-08-17T00:13:10.149756+0000","last_fullsized":"2023-08-17T00:13:10.149756+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682035+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680352+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149866+0000","last_change":"2023-08-17T00:13:09.710277+0000","last_active":"2023-08-17T00:13:10.149866+0000","last_peered":"2023-08-17T00:13:10.149866+0000","last_clean":"2023-08-17T00:13:10.149866+0000","last_became_active":"2023-08-17T00:13:09.709967+0000","last_became_peered":"2023-08-17T00:13:09.709967+0000","last_unstale":"2023-08-17T00:13:10.149866+0000","last_undegraded":"2023-08-17T00:13:10.149866+0000","last_fullsized":"2023-08-17T00:13:10.149866+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681145+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677184+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680737+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681540+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682663+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680099+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682388+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124215+0000","last_change":"2023-08-17T00:13:09.703795+0000","last_active":"2023-08-17T00:13:10.124215+0000","last_peered":"2023-08-17T00:13:10.124215+0000","last_clean":"2023-08-17T00:13:10.124215+0000","last_became_active":"2023-08-17T00:13:09.703457+0000","last_became_peered":"2023-08-17T00:13:09.703457+0000","last_unstale":"2023-08-17T00:13:10.124215+0000","last_undegraded":"2023-08-17T00:13:10.124215+0000","last_fullsized":"2023-08-17T00:13:10.124215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919504+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:13:05.919504+0000","last_peered":"2023-08-17T00:13:05.919504+0000","last_clean":"2023-08-17T00:13:05.919504+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:13:05.919504+0000","last_undegraded":"2023-08-17T00:13:05.919504+0000","last_fullsized":"2023-08-17T00:13:05.919504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149720+0000","last_change":"2023-08-17T00:13:10.138302+0000","last_active":"2023-08-17T00:13:10.149720+0000","last_peered":"2023-08-17T00:13:10.149720+0000","last_clean":"2023-08-17T00:13:10.149720+0000","last_became_active":"2023-08-17T00:13:10.138028+0000","last_became_peered":"2023-08-17T00:13:10.138028+0000","last_unstale":"2023-08-17T00:13:10.149720+0000","last_undegraded":"2023-08-17T00:13:10.149720+0000","last_fullsized":"2023-08-17T00:13:10.149720+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683525+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124304+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:13:10.124304+0000","last_peered":"2023-08-17T00:13:10.124304+0000","last_clean":"2023-08-17T00:13:10.124304+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:13:10.124304+0000","last_undegraded":"2023-08-17T00:13:10.124304+0000","last_fullsized":"2023-08-17T00:13:10.124304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682745+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919375+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:13:05.919375+0000","last_peered":"2023-08-17T00:13:05.919375+0000","last_clean":"2023-08-17T00:13:05.919375+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:13:05.919375+0000","last_undegraded":"2023-08-17T00:13:05.919375+0000","last_fullsized":"2023-08-17T00:13:05.919375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.684943+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.788016+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:13:05.788016+0000","last_peered":"2023-08-17T00:13:05.788016+0000","last_clean":"2023-08-17T00:13:05.788016+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:13:05.788016+0000","last_undegraded":"2023-08-17T00:13:05.788016+0000","last_fullsized":"2023-08-17T00:13:05.788016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681219+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919378+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:13:05.919378+0000","last_peered":"2023-08-17T00:13:05.919378+0000","last_clean":"2023-08-17T00:13:05.919378+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:13:05.919378+0000","last_undegraded":"2023-08-17T00:13:05.919378+0000","last_fullsized":"2023-08-17T00:13:05.919378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681904+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919579+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:13:05.919579+0000","last_peered":"2023-08-17T00:13:05.919579+0000","last_clean":"2023-08-17T00:13:05.919579+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:13:05.919579+0000","last_undegraded":"2023-08-17T00:13:05.919579+0000","last_fullsized":"2023-08-17T00:13:05.919579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682635+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919357+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:13:05.919357+0000","last_peered":"2023-08-17T00:13:05.919357+0000","last_clean":"2023-08-17T00:13:05.919357+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:13:05.919357+0000","last_undegraded":"2023-08-17T00:13:05.919357+0000","last_fullsized":"2023-08-17T00:13:05.919357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677205+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919219+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:13:05.919219+0000","last_peered":"2023-08-17T00:13:05.919219+0000","last_clean":"2023-08-17T00:13:05.919219+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:13:05.919219+0000","last_undegraded":"2023-08-17T00:13:05.919219+0000","last_fullsized":"2023-08-17T00:13:05.919219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":109,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.787445+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:13:05.787445+0000","last_peered":"2023-08-17T00:13:05.787445+0000","last_clean":"2023-08-17T00:13:05.787445+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:13:05.787445+0000","last_undegraded":"2023-08-17T00:13:05.787445+0000","last_fullsized":"2023-08-17T00:13:05.787445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311164,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060676,"statfs":{"total":96636764160,"available":96318132224,"internally_reserved":0,"allocated":1691648,"data_stored":788560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.2090000000000001},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2210000000000001,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.036,"15min":1.2529999999999999},"min":{"1min":0.57899999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3169999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0580000000000001,"15min":1.272},"min":{"1min":0.627,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.2769999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.097,"15min":1.2749999999999999},"min":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.028,"15min":1.1819999999999999},"min":{"1min":0.65200000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.276,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.1240000000000001,"15min":1.3169999999999999},"min":{"1min":0.629,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.4199999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.095,"15min":1.226},"min":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2509999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.075},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1819999999999999,"15min":1.4790000000000001},"min":{"1min":0.78100000000000003,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.359,"5min":1.952,"15min":13.074999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1539999999999999,"15min":1.4350000000000001},"min":{"1min":0.70799999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.3799999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1279999999999999,"15min":1.3700000000000001},"min":{"1min":0.80200000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3380000000000001,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.226,"15min":1.5569999999999999},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.9830000000000001,"15min":14.435},"last":1.175},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.226,"15min":1.526},"min":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.502,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.3560000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2969999999999999,"15min":1.556},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5920000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.238},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.2270000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.411,"5min":2.4350000000000001,"15min":11.365},"last":1.3899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542271,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311176,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060664,"statfs":{"total":96636764160,"available":96318119936,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.032,"15min":1.056},"min":{"1min":0.53800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.367,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":10.519,"15min":10.519},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.147,"15min":1.143},"min":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.3500000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4530000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":1.1839999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1319999999999999,"15min":1.161},"min":{"1min":0.71199999999999997,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.506,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2909999999999999,"15min":1.2809999999999999},"min":{"1min":0.72999999999999998,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5489999999999999,"5min":10.669,"15min":10.669},"last":1.377}]},{"osd":3,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.119,"15min":1.171},"min":{"1min":0.81000000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5860000000000001,"5min":1.9319999999999999,"15min":11.475},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.2310000000000001,"15min":1.252},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.304}]},{"osd":4,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.296,"15min":1.278},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.571,"5min":10.632,"15min":10.632},"last":1.325},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.2,"15min":1.236},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.7350000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":1.292}]},{"osd":5,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.80500000000000005,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.5880000000000001,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.079},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.413,"15min":1.3720000000000001},"min":{"1min":0.89000000000000001,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.7310000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.423}]},{"osd":7,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2969999999999999,"15min":1.329},"min":{"1min":0.77400000000000002,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.788,"5min":3.3450000000000002,"15min":11.51},"last":1.105},{"interface":"front","average":{"1min":1.286,"5min":1.377,"15min":1.4019999999999999},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.704,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.2170000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.3220000000000001},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4870000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.244},{"interface":"front","average":{"1min":1.155,"5min":1.0349999999999999,"15min":1.4350000000000001},"min":{"1min":0.67500000000000004,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.946}]},{"osd":1,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0389999999999999,"15min":1.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.423,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":1.746},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.113,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.5760000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.4279999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.153,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.2750000000000004,"5min":4.2750000000000004,"15min":16.675000000000001},"last":0.997},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.3879999999999999},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.60299999999999998},"max":{"1min":1.522,"5min":1.796,"15min":11.949},"last":1.383}]},{"osd":3,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.171,"15min":1.4399999999999999},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":13.125},"last":1.593},{"interface":"front","average":{"1min":1.206,"5min":1.1799999999999999,"15min":1.3740000000000001},"min":{"1min":0.82399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.306,"5min":2.306,"15min":8.4809999999999999},"last":1.887}]},{"osd":4,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.532},"min":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.458,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.7},{"interface":"front","average":{"1min":1.389,"5min":1.2310000000000001,"15min":1.6579999999999999},"min":{"1min":0.78300000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.456}]},{"osd":6,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.236,"15min":1.627},"min":{"1min":0.81499999999999995,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":1.627},"min":{"1min":0.92900000000000005,"5min":0.68600000000000005,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.5309999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3240000000000001,"15min":1.742},"min":{"1min":0.94999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.2130000000000001,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.345,"15min":1.6839999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0019999999999998,"5min":2.0899999999999999,"15min":14.818},"last":1.978}]}]},{"osd":3,"up_from":14,"seq":60129542271,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307068,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064772,"statfs":{"total":96636764160,"available":96322326528,"internally_reserved":0,"allocated":1691648,"data_stored":788560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3320000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.194,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.81100000000000005},"min":{"1min":0.53700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.423,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.83899999999999997,"15min":0.90200000000000002},"min":{"1min":0.47499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.2869999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.433,"15min":0.433},"max":{"1min":1.359,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.167}]},{"osd":4,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.198},"min":{"1min":0.74199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.498,"5min":2.274,"15min":3.9449999999999998},"last":1.365},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.143,"15min":1.206},"min":{"1min":0.749,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5860000000000001,"5min":1.649,"15min":3.9790000000000001},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1200000000000001,"15min":1.2090000000000001},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.89000000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6459999999999999,"5min":1.669,"15min":2.6789999999999998},"last":1.429}]},{"osd":6,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1399999999999999,"15min":1.236},"min":{"1min":0.629,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.603,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.331},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.206},"min":{"1min":0.83099999999999996,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.6899999999999999,"5min":2.0979999999999999,"15min":3.585},"last":1.22}]},{"osd":7,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.206,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.6319999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.2310000000000001},"min":{"1min":0.84499999999999997,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.679,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0840000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.83799999999999997},"min":{"1min":0.5,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.4359999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":1.103},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.76400000000000001,"15min":0.94199999999999995},"min":{"1min":0.57199999999999995,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61099999999999999,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.286,"5min":2.097,"15min":3.7589999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.91300000000000003,"15min":1.0449999999999999},"min":{"1min":0.69199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2949999999999999,"5min":1.3799999999999999,"15min":3.911},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":1.1220000000000001},"min":{"1min":0.628,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":5.4059999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.98699999999999999},"min":{"1min":0.63500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4910000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":1.02}]},{"osd":4,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0860000000000001,"15min":1.5900000000000001},"min":{"1min":0.76800000000000002,"5min":0.61699999999999999,"15min":0.48399999999999999},"max":{"1min":1.794,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.075},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.91700000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":8.4399999999999995},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2569999999999999,"15min":1.5980000000000001},"min":{"1min":1.107,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.734,"5min":1.734,"15min":12.914},"last":1.05},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.4430000000000001},"min":{"1min":0.94199999999999995,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.772,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.204}]},{"osd":6,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1990000000000001,"15min":1.5469999999999999},"min":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":1.621,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2410000000000001,"15min":1.5960000000000001},"min":{"1min":1.03,"5min":0.82899999999999996,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":1.6879999999999999,"15min":12.698},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.5720000000000001},"min":{"1min":1.0109999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.627,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.159},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3129999999999999,"15min":1.583},"min":{"1min":0.79200000000000004,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.9159999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.1819999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.298,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.90100000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2170000000000001,"5min":1.367,"15min":13.093},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.76500000000000001,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.3420000000000001,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.89000000000000001},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.365,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94699999999999995,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.4630000000000001,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.86099999999999999,"15min":0.96399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.26,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.036,"15min":1.1539999999999999},"min":{"1min":0.68300000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.671,"5min":1.671,"15min":20.548999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.125,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.764,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.222}]},{"osd":5,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1870000000000001,"15min":1.3140000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5309999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1799999999999999,"15min":1.2529999999999999},"min":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7470000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.2569999999999999},"min":{"1min":0.81000000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.1599999999999999,"15min":1.21},"min":{"1min":0.92300000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":1.6990000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.427}]},{"osd":7,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.25,"15min":1.3129999999999999},"min":{"1min":0.97699999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.9179999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.294},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.3440000000000001},"min":{"1min":0.91000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.6399999999999999,"5min":3.4180000000000001,"15min":13.131},"last":1.4019999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.83799999999999997},"min":{"1min":0.45700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.4830000000000001,"5min":18.442,"15min":18.442},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89800000000000002,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.5669999999999999,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.04,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.208,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.5840000000000001,"5min":1.613,"15min":1.613},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.167,"15min":1.0700000000000001},"min":{"1min":0.63900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.9079999999999999,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.0920000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.7609999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.343,"15min":1.2529999999999999},"min":{"1min":0.80000000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4099999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3799999999999999,"15min":1.304},"min":{"1min":0.88,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.9199999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2010000000000001,"15min":1.2529999999999999},"min":{"1min":0.85799999999999998,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.754,"5min":1.984,"15min":1.984},"last":0.996}]},{"osd":6,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3759999999999999,"15min":1.3169999999999999},"min":{"1min":1.081,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6859999999999999,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3959999999999999,"15min":1.3080000000000001},"min":{"1min":0.94999999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6579999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.93200000000000005,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.786,"5min":1.804,"15min":2.0750000000000002},"last":1.242}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0349999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.2889999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.097,"15min":1.069},"min":{"1min":0.62,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":2.5539999999999998,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5229999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.089},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1819999999999999,"15min":1.242},"min":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5129999999999999,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.236},"min":{"1min":0.74199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7030000000000001,"5min":6.6500000000000004,"15min":18.431000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.3340000000000001},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.623,"5min":1.738,"15min":36.531999999999996},"last":1.141}]},{"osd":3,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0980000000000001,"15min":1.133},"min":{"1min":0.751,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.996},{"interface":"front","average":{"1min":1.155,"5min":1.2290000000000001,"15min":1.411},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.40400000000000003},"max":{"1min":1.7569999999999999,"5min":6.6920000000000002,"15min":36.530000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.23,"15min":1.246},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.462,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.046},{"interface":"front","average":{"1min":1.244,"5min":1.268,"15min":1.302},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":3.2519999999999998,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.181}]},{"osd":6,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3520000000000001},"min":{"1min":0.73199999999999998,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.6080000000000001,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.345},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3049999999999999,"15min":1.403},"min":{"1min":0.81399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.526,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.371}]},{"osd":7,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.21,"15min":1.2829999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.4179999999999999},"min":{"1min":0.68600000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.8009999999999999,"5min":6.7430000000000003,"15min":8.327},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:13:14.998 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:13:15.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.156+0000 7f88cd307700 1 Processor -- start 2023-08-17T00:13:15.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.156+0000 7f88cd307700 1 -- start start 2023-08-17T00:13:15.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88cd307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c8150880 0x7f88c80a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88cd307700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88c80a8e60 0x7f88c8068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88cd307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80ab9b0 con 0x7f88c80aa8c0 2023-08-17T00:13:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88cd307700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80aada0 con 0x7f88c80a8e60 2023-08-17T00:13:15.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88cd307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ab080 con 0x7f88c8150880 2023-08-17T00:13:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88ccb06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f88c80aa8c0 0x7f88c80c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50852/0 (socket says 172.21.15.153:50852) 2023-08-17T00:13:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88ccb06700 1 -- 172.21.15.153:0/579558885 learned_addr learned my addr 172.21.15.153:0/579558885 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:15.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c7fff700 1 --2- 172.21.15.153:0/579558885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c8150880 0x7f88c80a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88bffff700 1 --2- 172.21.15.153:0/579558885 >> v2:172.21.15.178:3300/0 conn(0x7f88c80a8e60 0x7f88c8068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c77fe700 1 -- 172.21.15.153:0/579558885 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848796495 0 0) 0x7f88c80ab9b0 con 0x7f88c80aa8c0 2023-08-17T00:13:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c77fe700 1 -- 172.21.15.153:0/579558885 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b40033f0 con 0x7f88c80aa8c0 2023-08-17T00:13:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c7fff700 1 -- 172.21.15.153:0/579558885 >> v2:172.21.15.178:3300/0 conn(0x7f88c80a8e60 msgr2=0x7f88c8068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:15.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c7fff700 1 --2- 172.21.15.153:0/579558885 >> v2:172.21.15.178:3300/0 conn(0x7f88c80a8e60 0x7f88c8068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c7fff700 1 -- 172.21.15.153:0/579558885 >> v1:172.21.15.153:6789/0 conn(0x7f88c80aa8c0 legacy=0x7f88c80c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c7fff700 1 -- 172.21.15.153:0/579558885 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80ab360 con 0x7f88c8150880 2023-08-17T00:13:15.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.160+0000 7f88c7fff700 1 --2- 172.21.15.153:0/579558885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c8150880 0x7f88c80a8970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f88b8006fd0 tx=0x7f88b8006f40).ready entity=mon.2 client_cookie=df8cf8a0c1fdb756 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:15.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88c77fe700 1 -- 172.21.15.153:0/579558885 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8005880 con 0x7f88c8150880 2023-08-17T00:13:15.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88c77fe700 1 -- 172.21.15.153:0/579558885 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b80059e0 con 0x7f88c8150880 2023-08-17T00:13:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88c77fe700 1 -- 172.21.15.153:0/579558885 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8005d60 con 0x7f88c8150880 2023-08-17T00:13:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 -- 172.21.15.153:0/579558885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c8150880 msgr2=0x7f88c80a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 --2- 172.21.15.153:0/579558885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c8150880 0x7f88c80a8970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f88b8006fd0 tx=0x7f88b8006f40).stop 2023-08-17T00:13:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 -- 172.21.15.153:0/579558885 shutdown_connections 2023-08-17T00:13:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 --2- 172.21.15.153:0/579558885 >> v2:172.21.15.178:3300/0 conn(0x7f88c80a8e60 0x7f88c8068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 --2- 172.21.15.153:0/579558885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c8150880 0x7f88c80a8970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 -- 172.21.15.153:0/579558885 >> 172.21.15.153:0/579558885 conn(0x7f88c80c6620 msgr2=0x7f88c80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 -- 172.21.15.153:0/579558885 shutdown_connections 2023-08-17T00:13:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.164+0000 7f88cd307700 1 -- 172.21.15.153:0/579558885 wait complete. 2023-08-17T00:13:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 Processor -- start 2023-08-17T00:13:15.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 -- start start 2023-08-17T00:13:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c80a8e60 0x7f88c814df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c80aa8c0 0x7f88c80bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 0x7f88c80bbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c0290 con 0x7f88c8150880 2023-08-17T00:13:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80bb910 con 0x7f88c80a8e60 2023-08-17T00:13:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80bb300 con 0x7f88c80aa8c0 2023-08-17T00:13:15.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 0x7f88c80bbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 0x7f88c80bbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51602/0 (socket says 172.21.15.153:51602) 2023-08-17T00:13:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 -- 172.21.15.153:0/1173298827 learned_addr learned my addr 172.21.15.153:0/1173298827 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88c7fff700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c80a8e60 0x7f88c814df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88bffff700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c80aa8c0 0x7f88c80bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 -- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c80aa8c0 msgr2=0x7f88c80bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c80aa8c0 0x7f88c80bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 -- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c80a8e60 msgr2=0x7f88c814df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c80a8e60 0x7f88c814df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 -- 172.21.15.153:0/1173298827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009250 con 0x7f88c8150880 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88ccb06700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 0x7f88c80bbda0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f88c000c6e0 tx=0x7f88c0007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:15.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0005d30 con 0x7f88c8150880 2023-08-17T00:13:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0005e90 con 0x7f88c8150880 2023-08-17T00:13:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c8164e10 con 0x7f88c8150880 2023-08-17T00:13:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.168+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0007320 con 0x7f88c8150880 2023-08-17T00:13:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.172+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c81650f0 con 0x7f88c8150880 2023-08-17T00:13:15.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.172+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80bb160 con 0x7f88c8150880 2023-08-17T00:13:15.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.172+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f88c0010030 con 0x7f88c8150880 2023-08-17T00:13:15.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.176+0000 7f88c4ff9700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f88a805a150 0x7f88a805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.176+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f88c0073ff0 con 0x7f88c8150880 2023-08-17T00:13:15.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.176+0000 7f88c7fff700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f88a805a150 0x7f88a805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.176+0000 7f88c7fff700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f88a805a150 0x7f88a805c610 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f88b8006f80 tx=0x7f88b8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:15.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.180+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88c80bb160 con 0x7f88c8150880 2023-08-17T00:13:15.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.340+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88c80bb160 con 0x7f88a805a150 2023-08-17T00:13:15.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.356+0000 7f88c4ff9700 1 -- 172.21.15.153:0/1173298827 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+352466 (secure 0 0 0) 0x7f88c80bb160 con 0x7f88a805a150 2023-08-17T00:13:15.367 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:15.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f88a805a150 msgr2=0x7f88a805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f88a805a150 0x7f88a805c610 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f88b8006f80 tx=0x7f88b8017000).stop 2023-08-17T00:13:15.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 msgr2=0x7f88c80bbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 0x7f88c80bbda0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 rx=0x7f88c000c6e0 tx=0x7f88c0007f90).stop 2023-08-17T00:13:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 shutdown_connections 2023-08-17T00:13:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f88a805a150 0x7f88a805c610 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88c8150880 0x7f88c80bbda0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c80aa8c0 0x7f88c80bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 --2- 172.21.15.153:0/1173298827 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c80a8e60 0x7f88c814df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 >> 172.21.15.153:0/1173298827 conn(0x7f88c80c6620 msgr2=0x7f88c814fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:15.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 shutdown_connections 2023-08-17T00:13:15.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.368+0000 7f88cd307700 1 -- 172.21.15.153:0/1173298827 wait complete. 2023-08-17T00:13:15.376 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:13:15.394 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":448,"stamp":"2023-08-17T00:13:13.408094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":158,"acting":158,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2456660,"kb_used_data":13332,"kb_used_omap":0,"kb_used_meta":2443264,"kb_avail":752518060,"statfs":{"total":773094113280,"available":770578493440,"internally_reserved":0,"allocated":13651968,"data_stored":6366992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2501902336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077798280,"num_objects":-1078,"num_object_clones":0,"num_object_copies":-2156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1078,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3202,"num_write_kb":-1053264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.219952"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149796+0000","last_change":"2023-08-17T00:13:09.705113+0000","last_active":"2023-08-17T00:13:10.149796+0000","last_peered":"2023-08-17T00:13:10.149796+0000","last_clean":"2023-08-17T00:13:10.149796+0000","last_became_active":"2023-08-17T00:13:09.704804+0000","last_became_peered":"2023-08-17T00:13:09.704804+0000","last_unstale":"2023-08-17T00:13:10.149796+0000","last_undegraded":"2023-08-17T00:13:10.149796+0000","last_fullsized":"2023-08-17T00:13:10.149796+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125940+0000","last_change":"2023-08-17T00:13:09.705945+0000","last_active":"2023-08-17T00:13:10.125940+0000","last_peered":"2023-08-17T00:13:10.125940+0000","last_clean":"2023-08-17T00:13:10.125940+0000","last_became_active":"2023-08-17T00:13:09.704883+0000","last_became_peered":"2023-08-17T00:13:09.704883+0000","last_unstale":"2023-08-17T00:13:10.125940+0000","last_undegraded":"2023-08-17T00:13:10.125940+0000","last_fullsized":"2023-08-17T00:13:10.125940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678761+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676109+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683419+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685550+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683880+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682905+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678655+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123985+0000","last_change":"2023-08-17T00:13:09.706671+0000","last_active":"2023-08-17T00:13:10.123985+0000","last_peered":"2023-08-17T00:13:10.123985+0000","last_clean":"2023-08-17T00:13:10.123985+0000","last_became_active":"2023-08-17T00:13:09.705653+0000","last_became_peered":"2023-08-17T00:13:09.705653+0000","last_unstale":"2023-08-17T00:13:10.123985+0000","last_undegraded":"2023-08-17T00:13:10.123985+0000","last_fullsized":"2023-08-17T00:13:10.123985+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676176+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683238+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149677+0000","last_change":"2023-08-17T00:13:10.135331+0000","last_active":"2023-08-17T00:13:10.149677+0000","last_peered":"2023-08-17T00:13:10.149677+0000","last_clean":"2023-08-17T00:13:10.149677+0000","last_became_active":"2023-08-17T00:13:10.135028+0000","last_became_peered":"2023-08-17T00:13:10.135028+0000","last_unstale":"2023-08-17T00:13:10.149677+0000","last_undegraded":"2023-08-17T00:13:10.149677+0000","last_fullsized":"2023-08-17T00:13:10.149677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676109+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680561+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682729+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682378+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.678026+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682451+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149632+0000","last_change":"2023-08-17T00:13:09.704715+0000","last_active":"2023-08-17T00:13:10.149632+0000","last_peered":"2023-08-17T00:13:10.149632+0000","last_clean":"2023-08-17T00:13:10.149632+0000","last_became_active":"2023-08-17T00:13:09.704442+0000","last_became_peered":"2023-08-17T00:13:09.704442+0000","last_unstale":"2023-08-17T00:13:10.149632+0000","last_undegraded":"2023-08-17T00:13:10.149632+0000","last_fullsized":"2023-08-17T00:13:10.149632+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681934+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144511+0000","last_change":"2023-08-17T00:13:10.132288+0000","last_active":"2023-08-17T00:13:10.144511+0000","last_peered":"2023-08-17T00:13:10.144511+0000","last_clean":"2023-08-17T00:13:10.144511+0000","last_became_active":"2023-08-17T00:13:10.131952+0000","last_became_peered":"2023-08-17T00:13:10.131952+0000","last_unstale":"2023-08-17T00:13:10.144511+0000","last_undegraded":"2023-08-17T00:13:10.144511+0000","last_fullsized":"2023-08-17T00:13:10.144511+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685792+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119797+0000","last_change":"2023-08-17T00:13:09.704362+0000","last_active":"2023-08-17T00:13:10.119797+0000","last_peered":"2023-08-17T00:13:10.119797+0000","last_clean":"2023-08-17T00:13:10.119797+0000","last_became_active":"2023-08-17T00:13:09.703910+0000","last_became_peered":"2023-08-17T00:13:09.703910+0000","last_unstale":"2023-08-17T00:13:10.119797+0000","last_undegraded":"2023-08-17T00:13:10.119797+0000","last_fullsized":"2023-08-17T00:13:10.119797+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149441+0000","last_change":"2023-08-17T00:13:10.135316+0000","last_active":"2023-08-17T00:13:10.149441+0000","last_peered":"2023-08-17T00:13:10.149441+0000","last_clean":"2023-08-17T00:13:10.149441+0000","last_became_active":"2023-08-17T00:13:10.134715+0000","last_became_peered":"2023-08-17T00:13:10.134715+0000","last_unstale":"2023-08-17T00:13:10.149441+0000","last_undegraded":"2023-08-17T00:13:10.149441+0000","last_fullsized":"2023-08-17T00:13:10.149441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681870+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681796+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.676205+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124104+0000","last_change":"2023-08-17T00:13:09.713360+0000","last_active":"2023-08-17T00:13:10.124104+0000","last_peered":"2023-08-17T00:13:10.124104+0000","last_clean":"2023-08-17T00:13:10.124104+0000","last_became_active":"2023-08-17T00:13:09.713047+0000","last_became_peered":"2023-08-17T00:13:09.713047+0000","last_unstale":"2023-08-17T00:13:10.124104+0000","last_undegraded":"2023-08-17T00:13:10.124104+0000","last_fullsized":"2023-08-17T00:13:10.124104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681215+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.684295+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.121807+0000","last_change":"2023-08-17T00:13:09.714585+0000","last_active":"2023-08-17T00:13:10.121807+0000","last_peered":"2023-08-17T00:13:10.121807+0000","last_clean":"2023-08-17T00:13:10.121807+0000","last_became_active":"2023-08-17T00:13:09.714324+0000","last_became_peered":"2023-08-17T00:13:09.714324+0000","last_unstale":"2023-08-17T00:13:10.121807+0000","last_undegraded":"2023-08-17T00:13:10.121807+0000","last_fullsized":"2023-08-17T00:13:10.121807+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119960+0000","last_change":"2023-08-17T00:13:09.704177+0000","last_active":"2023-08-17T00:13:10.119960+0000","last_peered":"2023-08-17T00:13:10.119960+0000","last_clean":"2023-08-17T00:13:10.119960+0000","last_became_active":"2023-08-17T00:13:09.703629+0000","last_became_peered":"2023-08-17T00:13:09.703629+0000","last_unstale":"2023-08-17T00:13:10.119960+0000","last_undegraded":"2023-08-17T00:13:10.119960+0000","last_fullsized":"2023-08-17T00:13:10.119960+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681220+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677309+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677412+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681599+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683584+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149507+0000","last_change":"2023-08-17T00:13:10.136335+0000","last_active":"2023-08-17T00:13:10.149507+0000","last_peered":"2023-08-17T00:13:10.149507+0000","last_clean":"2023-08-17T00:13:10.149507+0000","last_became_active":"2023-08-17T00:13:10.135737+0000","last_became_peered":"2023-08-17T00:13:10.135737+0000","last_unstale":"2023-08-17T00:13:10.149507+0000","last_undegraded":"2023-08-17T00:13:10.149507+0000","last_fullsized":"2023-08-17T00:13:10.149507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677404+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.685346+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681994+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119521+0000","last_change":"2023-08-17T00:13:09.703051+0000","last_active":"2023-08-17T00:13:10.119521+0000","last_peered":"2023-08-17T00:13:10.119521+0000","last_clean":"2023-08-17T00:13:10.119521+0000","last_became_active":"2023-08-17T00:13:09.702719+0000","last_became_peered":"2023-08-17T00:13:09.702719+0000","last_unstale":"2023-08-17T00:13:10.119521+0000","last_undegraded":"2023-08-17T00:13:10.119521+0000","last_fullsized":"2023-08-17T00:13:10.119521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681437+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682962+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683496+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120333+0000","last_change":"2023-08-17T00:13:09.702990+0000","last_active":"2023-08-17T00:13:10.120333+0000","last_peered":"2023-08-17T00:13:10.120333+0000","last_clean":"2023-08-17T00:13:10.120333+0000","last_became_active":"2023-08-17T00:13:09.702687+0000","last_became_peered":"2023-08-17T00:13:09.702687+0000","last_unstale":"2023-08-17T00:13:10.120333+0000","last_undegraded":"2023-08-17T00:13:10.120333+0000","last_fullsized":"2023-08-17T00:13:10.120333+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.122097+0000","last_change":"2023-08-17T00:13:09.705408+0000","last_active":"2023-08-17T00:13:10.122097+0000","last_peered":"2023-08-17T00:13:10.122097+0000","last_clean":"2023-08-17T00:13:10.122097+0000","last_became_active":"2023-08-17T00:13:09.705098+0000","last_became_peered":"2023-08-17T00:13:09.705098+0000","last_unstale":"2023-08-17T00:13:10.122097+0000","last_undegraded":"2023-08-17T00:13:10.122097+0000","last_fullsized":"2023-08-17T00:13:10.122097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682817+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120087+0000","last_change":"2023-08-17T00:13:09.704921+0000","last_active":"2023-08-17T00:13:10.120087+0000","last_peered":"2023-08-17T00:13:10.120087+0000","last_clean":"2023-08-17T00:13:10.120087+0000","last_became_active":"2023-08-17T00:13:09.704624+0000","last_became_peered":"2023-08-17T00:13:09.704624+0000","last_unstale":"2023-08-17T00:13:10.120087+0000","last_undegraded":"2023-08-17T00:13:10.120087+0000","last_fullsized":"2023-08-17T00:13:10.120087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149756+0000","last_change":"2023-08-17T00:13:10.139142+0000","last_active":"2023-08-17T00:13:10.149756+0000","last_peered":"2023-08-17T00:13:10.149756+0000","last_clean":"2023-08-17T00:13:10.149756+0000","last_became_active":"2023-08-17T00:13:10.137758+0000","last_became_peered":"2023-08-17T00:13:10.137758+0000","last_unstale":"2023-08-17T00:13:10.149756+0000","last_undegraded":"2023-08-17T00:13:10.149756+0000","last_fullsized":"2023-08-17T00:13:10.149756+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682035+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680352+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149866+0000","last_change":"2023-08-17T00:13:09.710277+0000","last_active":"2023-08-17T00:13:10.149866+0000","last_peered":"2023-08-17T00:13:10.149866+0000","last_clean":"2023-08-17T00:13:10.149866+0000","last_became_active":"2023-08-17T00:13:09.709967+0000","last_became_peered":"2023-08-17T00:13:09.709967+0000","last_unstale":"2023-08-17T00:13:10.149866+0000","last_undegraded":"2023-08-17T00:13:10.149866+0000","last_fullsized":"2023-08-17T00:13:10.149866+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681145+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677184+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680737+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681540+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682663+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.680099+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682388+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124215+0000","last_change":"2023-08-17T00:13:09.703795+0000","last_active":"2023-08-17T00:13:10.124215+0000","last_peered":"2023-08-17T00:13:10.124215+0000","last_clean":"2023-08-17T00:13:10.124215+0000","last_became_active":"2023-08-17T00:13:09.703457+0000","last_became_peered":"2023-08-17T00:13:09.703457+0000","last_unstale":"2023-08-17T00:13:10.124215+0000","last_undegraded":"2023-08-17T00:13:10.124215+0000","last_fullsized":"2023-08-17T00:13:10.124215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919504+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:13:05.919504+0000","last_peered":"2023-08-17T00:13:05.919504+0000","last_clean":"2023-08-17T00:13:05.919504+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:13:05.919504+0000","last_undegraded":"2023-08-17T00:13:05.919504+0000","last_fullsized":"2023-08-17T00:13:05.919504+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149720+0000","last_change":"2023-08-17T00:13:10.138302+0000","last_active":"2023-08-17T00:13:10.149720+0000","last_peered":"2023-08-17T00:13:10.149720+0000","last_clean":"2023-08-17T00:13:10.149720+0000","last_became_active":"2023-08-17T00:13:10.138028+0000","last_became_peered":"2023-08-17T00:13:10.138028+0000","last_unstale":"2023-08-17T00:13:10.149720+0000","last_undegraded":"2023-08-17T00:13:10.149720+0000","last_fullsized":"2023-08-17T00:13:10.149720+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.683525+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124304+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:13:10.124304+0000","last_peered":"2023-08-17T00:13:10.124304+0000","last_clean":"2023-08-17T00:13:10.124304+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:13:10.124304+0000","last_undegraded":"2023-08-17T00:13:10.124304+0000","last_fullsized":"2023-08-17T00:13:10.124304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682745+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919375+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:13:05.919375+0000","last_peered":"2023-08-17T00:13:05.919375+0000","last_clean":"2023-08-17T00:13:05.919375+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:13:05.919375+0000","last_undegraded":"2023-08-17T00:13:05.919375+0000","last_fullsized":"2023-08-17T00:13:05.919375+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.684943+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":122,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.788016+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:13:05.788016+0000","last_peered":"2023-08-17T00:13:05.788016+0000","last_clean":"2023-08-17T00:13:05.788016+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:13:05.788016+0000","last_undegraded":"2023-08-17T00:13:05.788016+0000","last_fullsized":"2023-08-17T00:13:05.788016+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681219+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919378+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:13:05.919378+0000","last_peered":"2023-08-17T00:13:05.919378+0000","last_clean":"2023-08-17T00:13:05.919378+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:13:05.919378+0000","last_undegraded":"2023-08-17T00:13:05.919378+0000","last_fullsized":"2023-08-17T00:13:05.919378+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.681904+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":106,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919579+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:13:05.919579+0000","last_peered":"2023-08-17T00:13:05.919579+0000","last_clean":"2023-08-17T00:13:05.919579+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:13:05.919579+0000","last_undegraded":"2023-08-17T00:13:05.919579+0000","last_fullsized":"2023-08-17T00:13:05.919579+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.682635+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919357+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:13:05.919357+0000","last_peered":"2023-08-17T00:13:05.919357+0000","last_clean":"2023-08-17T00:13:05.919357+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:13:05.919357+0000","last_undegraded":"2023-08-17T00:13:05.919357+0000","last_fullsized":"2023-08-17T00:13:05.919357+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:13:09.672434+0000","last_change":"2023-08-17T00:13:09.672434+0000","last_active":"2023-08-17T00:13:09.672434+0000","last_peered":"2023-08-17T00:13:09.672434+0000","last_clean":"2023-08-17T00:13:09.672434+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:09.672434+0000","last_undegraded":"2023-08-17T00:13:09.672434+0000","last_fullsized":"2023-08-17T00:13:09.672434+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:13:08.660930+0000","last_change":"2023-08-17T00:13:08.677205+0000","last_active":"2023-08-17T00:13:08.660930+0000","last_peered":"2023-08-17T00:13:08.660930+0000","last_clean":"2023-08-17T00:13:08.660930+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:13:08.660930+0000","last_undegraded":"2023-08-17T00:13:08.660930+0000","last_fullsized":"2023-08-17T00:13:08.660930+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.919219+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:13:05.919219+0000","last_peered":"2023-08-17T00:13:05.919219+0000","last_clean":"2023-08-17T00:13:05.919219+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:13:05.919219+0000","last_undegraded":"2023-08-17T00:13:05.919219+0000","last_fullsized":"2023-08-17T00:13:05.919219+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":109,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-08-17T00:13:05.787445+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:13:05.787445+0000","last_peered":"2023-08-17T00:13:05.787445+0000","last_clean":"2023-08-17T00:13:05.787445+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:13:05.787445+0000","last_undegraded":"2023-08-17T00:13:05.787445+0000","last_fullsized":"2023-08-17T00:13:05.787445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":624,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311164,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060676,"statfs":{"total":96636764160,"available":96318132224,"internally_reserved":0,"allocated":1691648,"data_stored":788560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.2090000000000001},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2210000000000001,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.036,"15min":1.2529999999999999},"min":{"1min":0.57899999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3169999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":0.78900000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0580000000000001,"15min":1.272},"min":{"1min":0.627,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.2769999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.181,"5min":1.097,"15min":1.2749999999999999},"min":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.1299999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.028,"15min":1.1819999999999999},"min":{"1min":0.65200000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.276,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.1240000000000001,"15min":1.3169999999999999},"min":{"1min":0.629,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.4199999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":0.72299999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.095,"15min":1.226},"min":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2509999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.075},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1819999999999999,"15min":1.4790000000000001},"min":{"1min":0.78100000000000003,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.359,"5min":1.952,"15min":13.074999999999999},"last":0.88800000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1539999999999999,"15min":1.4350000000000001},"min":{"1min":0.70799999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.3799999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1279999999999999,"15min":1.3700000000000001},"min":{"1min":0.80200000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3380000000000001,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.3200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.226,"15min":1.5569999999999999},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.9830000000000001,"15min":14.435},"last":1.175},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.226,"15min":1.526},"min":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.502,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.3560000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2969999999999999,"15min":1.556},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5920000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.238},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.2270000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.411,"5min":2.4350000000000001,"15min":11.365},"last":1.3899999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542271,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311176,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060664,"statfs":{"total":96636764160,"available":96318119936,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.032,"15min":1.056},"min":{"1min":0.53800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.367,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.056,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":10.519,"15min":10.519},"last":1.2669999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.147,"15min":1.143},"min":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.3500000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4530000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":1.1839999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1319999999999999,"15min":1.161},"min":{"1min":0.71199999999999997,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.506,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2909999999999999,"15min":1.2809999999999999},"min":{"1min":0.72999999999999998,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5489999999999999,"5min":10.669,"15min":10.669},"last":1.377}]},{"osd":3,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.119,"15min":1.171},"min":{"1min":0.81000000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5860000000000001,"5min":1.9319999999999999,"15min":11.475},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.2310000000000001,"15min":1.252},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.304}]},{"osd":4,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.296,"15min":1.278},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.571,"5min":10.632,"15min":10.632},"last":1.325},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.2,"15min":1.236},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.7350000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":1.292}]},{"osd":5,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.80500000000000005,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.5880000000000001,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.079},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.413,"15min":1.3720000000000001},"min":{"1min":0.89000000000000001,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.7310000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.423}]},{"osd":7,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2969999999999999,"15min":1.329},"min":{"1min":0.77400000000000002,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.788,"5min":3.3450000000000002,"15min":11.51},"last":1.105},{"interface":"front","average":{"1min":1.286,"5min":1.377,"15min":1.4019999999999999},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.704,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.2170000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542272,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.3220000000000001},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4870000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.244},{"interface":"front","average":{"1min":1.155,"5min":1.0349999999999999,"15min":1.4350000000000001},"min":{"1min":0.67500000000000004,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.946}]},{"osd":1,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0389999999999999,"15min":1.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.423,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":1.746},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.113,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.5760000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.4279999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.153,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.2750000000000004,"5min":4.2750000000000004,"15min":16.675000000000001},"last":0.997},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.3879999999999999},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.60299999999999998},"max":{"1min":1.522,"5min":1.796,"15min":11.949},"last":1.383}]},{"osd":3,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.171,"15min":1.4399999999999999},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":13.125},"last":1.593},{"interface":"front","average":{"1min":1.206,"5min":1.1799999999999999,"15min":1.3740000000000001},"min":{"1min":0.82399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.306,"5min":2.306,"15min":8.4809999999999999},"last":1.887}]},{"osd":4,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.532},"min":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.458,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.7},{"interface":"front","average":{"1min":1.389,"5min":1.2310000000000001,"15min":1.6579999999999999},"min":{"1min":0.78300000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.456}]},{"osd":6,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.236,"15min":1.627},"min":{"1min":0.81499999999999995,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":1.627},"min":{"1min":0.92900000000000005,"5min":0.68600000000000005,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.5309999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3240000000000001,"15min":1.742},"min":{"1min":0.94999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.2130000000000001,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.7929999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.345,"15min":1.6839999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0019999999999998,"5min":2.0899999999999999,"15min":14.818},"last":1.978}]}]},{"osd":3,"up_from":14,"seq":60129542271,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307068,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064772,"statfs":{"total":96636764160,"available":96322326528,"internally_reserved":0,"allocated":1691648,"data_stored":788560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3320000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.194,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.90200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.81100000000000005},"min":{"1min":0.53700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.423,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.83899999999999997,"15min":0.90200000000000002},"min":{"1min":0.47499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.85599999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.2869999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.433,"15min":0.433},"max":{"1min":1.359,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.167}]},{"osd":4,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.198},"min":{"1min":0.74199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.498,"5min":2.274,"15min":3.9449999999999998},"last":1.365},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.143,"15min":1.206},"min":{"1min":0.749,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5860000000000001,"5min":1.649,"15min":3.9790000000000001},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1200000000000001,"15min":1.2090000000000001},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.89000000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6459999999999999,"5min":1.669,"15min":2.6789999999999998},"last":1.429}]},{"osd":6,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1399999999999999,"15min":1.236},"min":{"1min":0.629,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.603,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.331},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.206},"min":{"1min":0.83099999999999996,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.6899999999999999,"5min":2.0979999999999999,"15min":3.585},"last":1.22}]},{"osd":7,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.206,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.6319999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.296},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.2310000000000001},"min":{"1min":0.84499999999999997,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.679,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.0840000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.83799999999999997},"min":{"1min":0.5,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.4359999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":1.103},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.76400000000000001,"15min":0.94199999999999995},"min":{"1min":0.57199999999999995,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":3.1059999999999999,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81499999999999995,"15min":0.89300000000000002},"min":{"1min":0.61099999999999999,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.286,"5min":2.097,"15min":3.7589999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.91300000000000003,"15min":1.0449999999999999},"min":{"1min":0.69199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.2949999999999999,"5min":1.3799999999999999,"15min":3.911},"last":0.76000000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.88500000000000001,"15min":1.1220000000000001},"min":{"1min":0.628,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":5.4059999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.88100000000000001,"15min":0.98699999999999999},"min":{"1min":0.63500000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.4910000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":1.02}]},{"osd":4,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":1.0860000000000001,"15min":1.5900000000000001},"min":{"1min":0.76800000000000002,"5min":0.61699999999999999,"15min":0.48399999999999999},"max":{"1min":1.794,"5min":4.2770000000000001,"15min":16.521000000000001},"last":1.075},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.91700000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":8.4399999999999995},"last":0.89600000000000002}]},{"osd":5,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.2569999999999999,"15min":1.5980000000000001},"min":{"1min":1.107,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.734,"5min":1.734,"15min":12.914},"last":1.05},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.4430000000000001},"min":{"1min":0.94199999999999995,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.772,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.204}]},{"osd":6,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.1990000000000001,"15min":1.5469999999999999},"min":{"1min":0.70299999999999996,"5min":0.69599999999999995,"15min":0.58899999999999997},"max":{"1min":1.621,"5min":5.8029999999999999,"15min":13.864000000000001},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.2410000000000001,"15min":1.5960000000000001},"min":{"1min":1.03,"5min":0.82899999999999996,"15min":0.71799999999999997},"max":{"1min":1.5569999999999999,"5min":1.6879999999999999,"15min":12.698},"last":1.3580000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:12:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.5720000000000001},"min":{"1min":1.0109999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.627,"5min":3.4460000000000002,"15min":10.592000000000001},"last":1.159},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3129999999999999,"15min":1.583},"min":{"1min":0.79200000000000004,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.9159999999999999,"5min":4.3220000000000001,"15min":11.417},"last":1.1819999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542271,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.298,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.90100000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2170000000000001,"5min":1.367,"15min":13.093},"last":0.99299999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.76500000000000001,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.3420000000000001,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.89000000000000001},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.365,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94699999999999995,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.4630000000000001,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.3440000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.86099999999999999,"15min":0.96399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.26,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.036,"15min":1.1539999999999999},"min":{"1min":0.68300000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.671,"5min":1.671,"15min":20.548999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.125,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.764,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.222}]},{"osd":5,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1870000000000001,"15min":1.3140000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5309999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.103},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1799999999999999,"15min":1.2529999999999999},"min":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7470000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.2569999999999999},"min":{"1min":0.81000000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.1599999999999999,"15min":1.21},"min":{"1min":0.92300000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":1.6990000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.427}]},{"osd":7,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.25,"15min":1.3129999999999999},"min":{"1min":0.97699999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.9179999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.294},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.3440000000000001},"min":{"1min":0.91000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.6399999999999999,"5min":3.4180000000000001,"15min":13.131},"last":1.4019999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542272,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307080,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064760,"statfs":{"total":96636764160,"available":96322314240,"internally_reserved":0,"allocated":1703936,"data_stored":794781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.83799999999999997},"min":{"1min":0.45700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.4830000000000001,"5min":18.442,"15min":18.442},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89800000000000002,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.5669999999999999,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.79000000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.04,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.208,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.5840000000000001,"5min":1.613,"15min":1.613},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.167,"15min":1.0700000000000001},"min":{"1min":0.63900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.9079999999999999,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.0920000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.7609999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.343,"15min":1.2529999999999999},"min":{"1min":0.80000000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4099999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3799999999999999,"15min":1.304},"min":{"1min":0.88,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.9199999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.2010000000000001,"15min":1.2529999999999999},"min":{"1min":0.85799999999999998,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.754,"5min":1.984,"15min":1.984},"last":0.996}]},{"osd":6,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3759999999999999,"15min":1.3169999999999999},"min":{"1min":1.081,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6859999999999999,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3959999999999999,"15min":1.3080000000000001},"min":{"1min":0.94999999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6579999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.93200000000000005,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.786,"5min":1.804,"15min":2.0750000000000002},"last":1.242}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0349999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.2889999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.097,"15min":1.069},"min":{"1min":0.62,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":2.5539999999999998,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5229999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.089},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1819999999999999,"15min":1.242},"min":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5129999999999999,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.236},"min":{"1min":0.74199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7030000000000001,"5min":6.6500000000000004,"15min":18.431000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.3340000000000001},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.623,"5min":1.738,"15min":36.531999999999996},"last":1.141}]},{"osd":3,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0980000000000001,"15min":1.133},"min":{"1min":0.751,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.996},{"interface":"front","average":{"1min":1.155,"5min":1.2290000000000001,"15min":1.411},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.40400000000000003},"max":{"1min":1.7569999999999999,"5min":6.6920000000000002,"15min":36.530000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.23,"15min":1.246},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.462,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.046},{"interface":"front","average":{"1min":1.244,"5min":1.268,"15min":1.302},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":3.2519999999999998,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.181}]},{"osd":6,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3520000000000001},"min":{"1min":0.73199999999999998,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.6080000000000001,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.345},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3049999999999999,"15min":1.403},"min":{"1min":0.81399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.526,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.371}]},{"osd":7,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.21,"15min":1.2829999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.4179999999999999},"min":{"1min":0.68600000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.8009999999999999,"5min":6.7430000000000003,"15min":8.327},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:13:15.401 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-08-17T00:13:15.402 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.402 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-08-17T00:13:15.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.403 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-08-17T00:13:15.403 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3d is not active+clean 2023-08-17T00:13:15.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.678761+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.404 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-08-17T00:13:15.404 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.405 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3c is not active+clean 2023-08-17T00:13:15.405 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.676109+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:13:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-08-17T00:13:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3b is not active+clean 2023-08-17T00:13:15.406 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.683419+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:13:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-08-17T00:13:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.407 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3a is not active+clean 2023-08-17T00:13:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.685550+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-08-17T00:13:15.408 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.39 is not active+clean 2023-08-17T00:13:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.683880+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:13:15.409 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-08-17T00:13:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.38 is not active+clean 2023-08-17T00:13:15.410 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682905+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:13:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-08-17T00:13:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.37 is not active+clean 2023-08-17T00:13:15.411 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.678655+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-08-17T00:13:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.412 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-08-17T00:13:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.35 is not active+clean 2023-08-17T00:13:15.413 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.676176+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:13:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-08-17T00:13:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.34 is not active+clean 2023-08-17T00:13:15.414 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.683238+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.33 is not active+clean 2023-08-17T00:13:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.676109+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:13:15.415 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-08-17T00:13:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.32 is not active+clean 2023-08-17T00:13:15.416 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.680561+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-08-17T00:13:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.417 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.31 is not active+clean 2023-08-17T00:13:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682729+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:13:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-08-17T00:13:15.418 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.30 is not active+clean 2023-08-17T00:13:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682378+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-08-17T00:13:15.419 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2f is not active+clean 2023-08-17T00:13:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.678026+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.420 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-08-17T00:13:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2e is not active+clean 2023-08-17T00:13:15.421 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682451+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:13:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-08-17T00:13:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.422 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-08-17T00:13:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2c is not active+clean 2023-08-17T00:13:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681934+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:13:15.423 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2b is not active+clean 2023-08-17T00:13:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.685792+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-08-17T00:13:15.424 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.29 is not active+clean 2023-08-17T00:13:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681870+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:13:15.425 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-08-17T00:13:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.28 is not active+clean 2023-08-17T00:13:15.426 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681796+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:13:15.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-08-17T00:13:15.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.427 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.27 is not active+clean 2023-08-17T00:13:15.427 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.676205+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-17T00:13:15.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-08-17T00:13:15.428 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.428 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-08-17T00:13:15.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.429 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.25 is not active+clean 2023-08-17T00:13:15.429 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681215+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-08-17T00:13:15.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.430 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.24 is not active+clean 2023-08-17T00:13:15.430 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.684295+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:13:15.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-08-17T00:13:15.431 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.431 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-08-17T00:13:15.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.432 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-08-17T00:13:15.432 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.21 is not active+clean 2023-08-17T00:13:15.433 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681220+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:13:15.433 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-08-17T00:13:15.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.434 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.20 is not active+clean 2023-08-17T00:13:15.434 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.677309+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-08-17T00:13:15.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.435 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1f is not active+clean 2023-08-17T00:13:15.435 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.677412+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-08-17T00:13:15.436 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.436 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1e is not active+clean 2023-08-17T00:13:15.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681599+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.437 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-08-17T00:13:15.437 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1d is not active+clean 2023-08-17T00:13:15.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.683584+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.438 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1c is not active+clean 2023-08-17T00:13:15.438 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.677404+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-08-17T00:13:15.439 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.439 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1b is not active+clean 2023-08-17T00:13:15.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.685346+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.440 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-08-17T00:13:15.440 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1a is not active+clean 2023-08-17T00:13:15.441 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681994+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:13:15.441 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-08-17T00:13:15.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.442 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-08-17T00:13:15.442 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.18 is not active+clean 2023-08-17T00:13:15.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681437+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.443 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-08-17T00:13:15.443 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.f is not active+clean 2023-08-17T00:13:15.444 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682962+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:13:15.444 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-08-17T00:13:15.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.445 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.e is not active+clean 2023-08-17T00:13:15.445 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.683496+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:13:15.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-08-17T00:13:15.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.446 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-08-17T00:13:15.446 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-08-17T00:13:15.447 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.447 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.b is not active+clean 2023-08-17T00:13:15.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682817+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:13:15.448 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-08-17T00:13:15.448 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.9 is not active+clean 2023-08-17T00:13:15.449 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682035+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.449 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-08-17T00:13:15.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.8 is not active+clean 2023-08-17T00:13:15.450 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.680352+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.450 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-08-17T00:13:15.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.451 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-08-17T00:13:15.451 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.6 is not active+clean 2023-08-17T00:13:15.452 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681145+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:13:15.452 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-08-17T00:13:15.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.453 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.5 is not active+clean 2023-08-17T00:13:15.453 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.677184+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-08-17T00:13:15.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.454 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.4 is not active+clean 2023-08-17T00:13:15.454 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.680737+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-08-17T00:13:15.455 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.455 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.3 is not active+clean 2023-08-17T00:13:15.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681540+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.456 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-08-17T00:13:15.456 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.2 is not active+clean 2023-08-17T00:13:15.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682663+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.457 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-08-17T00:13:15.457 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.1 is not active+clean 2023-08-17T00:13:15.458 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.680099+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.458 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-08-17T00:13:15.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.459 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.0 is not active+clean 2023-08-17T00:13:15.459 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682388+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-17T00:13:15.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-08-17T00:13:15.460 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.460 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.17 is not active+clean 2023-08-17T00:13:15.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.683525+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-17T00:13:15.461 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-08-17T00:13:15.461 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.14 is not active+clean 2023-08-17T00:13:15.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682745+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.462 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-08-17T00:13:15.462 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.15 is not active+clean 2023-08-17T00:13:15.463 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.684943+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-08-17T00:13:15.463 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-08-17T00:13:15.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.464 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.13 is not active+clean 2023-08-17T00:13:15.464 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681219+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-08-17T00:13:15.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.465 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.10 is not active+clean 2023-08-17T00:13:15.465 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.681904+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-17T00:13:15.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-08-17T00:13:15.466 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.466 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.11 is not active+clean 2023-08-17T00:13:15.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.682635+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-17T00:13:15.467 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-08-17T00:13:15.467 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:13:09.672434+0000', 'last_change': '2023-08-17T00:13:09.672434+0000', 'last_active': '2023-08-17T00:13:09.672434+0000', 'last_peered': '2023-08-17T00:13:09.672434+0000', 'last_clean': '2023-08-17T00:13:09.672434+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:09.672434+0000', 'last_undegraded': '2023-08-17T00:13:09.672434+0000', 'last_fullsized': '2023-08-17T00:13:09.672434+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:09.672434+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:13:15.468 INFO:tasks.cephfs.filesystem.ceph_manager:PG 19.12 is not active+clean 2023-08-17T00:13:15.468 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '19.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:13:08.660930+0000', 'last_change': '2023-08-17T00:13:08.677205+0000', 'last_active': '2023-08-17T00:13:08.660930+0000', 'last_peered': '2023-08-17T00:13:08.660930+0000', 'last_clean': '2023-08-17T00:13:08.660930+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:13:08.660930+0000', 'last_undegraded': '2023-08-17T00:13:08.660930+0000', 'last_fullsized': '2023-08-17T00:13:08.660930+0000', 'mapping_epoch': 137, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 137, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'last_clean_scrub_stamp': '2023-08-17T00:13:08.660930+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-17T00:13:15.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:13:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e25369700 1 Processor -- start 2023-08-17T00:13:15.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e25369700 1 -- start start 2023-08-17T00:13:15.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e25369700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4e20158110 0x7f4e200ad300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e25369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e200ad8e0 con 0x7f4e200ac670 2023-08-17T00:13:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e25369700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e200abb90 con 0x7f4e200bde20 2023-08-17T00:13:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e25369700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e200abe70 con 0x7f4e20158110 2023-08-17T00:13:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e167fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4e200ac670 0x7f4e20065b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50858/0 (socket says 172.21.15.153:50858) 2023-08-17T00:13:15.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e167fc700 1 -- 172.21.15.153:0/780535003 learned_addr learned my addr 172.21.15.153:0/780535003 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.616+0000 7f4e1effd700 1 --2- 172.21.15.153:0/780535003 >> v2:172.21.15.153:3300/0 conn(0x7f4e20158110 0x7f4e200ad300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1effd700 1 -- 172.21.15.153:0/780535003 >> v1:172.21.15.178:6789/0 conn(0x7f4e200bde20 legacy=0x7f4e200c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1effd700 1 -- 172.21.15.153:0/780535003 >> v1:172.21.15.153:6789/0 conn(0x7f4e200ac670 legacy=0x7f4e20065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1effd700 1 -- 172.21.15.153:0/780535003 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e200ac150 con 0x7f4e20158110 2023-08-17T00:13:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1e7fc700 1 -- 172.21.15.153:0/780535003 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231190781 0 0) 0x7f4e200ad8e0 con 0x7f4e200ac670 2023-08-17T00:13:15.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1effd700 1 --2- 172.21.15.153:0/780535003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e200ad300 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f4e10009760 tx=0x7f4e10009060).ready entity=mon.0 client_cookie=ac36bec7cb75fa01 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1e7fc700 1 -- 172.21.15.153:0/780535003 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e10009120 con 0x7f4e20158110 2023-08-17T00:13:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1e7fc700 1 -- 172.21.15.153:0/780535003 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1000b580 con 0x7f4e20158110 2023-08-17T00:13:15.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e1e7fc700 1 -- 172.21.15.153:0/780535003 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1000b900 con 0x7f4e20158110 2023-08-17T00:13:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 -- 172.21.15.153:0/780535003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 msgr2=0x7f4e200ad300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 --2- 172.21.15.153:0/780535003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e200ad300 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 rx=0x7f4e10009760 tx=0x7f4e10009060).stop 2023-08-17T00:13:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 -- 172.21.15.153:0/780535003 shutdown_connections 2023-08-17T00:13:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 --2- 172.21.15.153:0/780535003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e200ad300 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 -- 172.21.15.153:0/780535003 >> 172.21.15.153:0/780535003 conn(0x7f4e200c4950 msgr2=0x7f4e200c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 -- 172.21.15.153:0/780535003 shutdown_connections 2023-08-17T00:13:15.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.620+0000 7f4e25369700 1 -- 172.21.15.153:0/780535003 wait complete. 2023-08-17T00:13:15.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 Processor -- start 2023-08-17T00:13:15.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 -- start start 2023-08-17T00:13:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e200ac670 0x7f4e2015b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e200bde20 0x7f4e2015c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e2015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e200a7e40 con 0x7f4e20158110 2023-08-17T00:13:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2015cd10 con 0x7f4e200bde20 2023-08-17T00:13:15.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e25369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e2015bec0 con 0x7f4e200ac670 2023-08-17T00:13:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e2015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e2015c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51630/0 (socket says 172.21.15.153:51630) 2023-08-17T00:13:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.624+0000 7f4e1ffff700 1 -- 172.21.15.153:0/3968209870 learned_addr learned my addr 172.21.15.153:0/3968209870 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e167fc700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e200bde20 0x7f4e2015c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1effd700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e200ac670 0x7f4e2015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1ffff700 1 -- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e200ac670 msgr2=0x7f4e2015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1ffff700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e200ac670 0x7f4e2015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1ffff700 1 -- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e200bde20 msgr2=0x7f4e2015c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1ffff700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e200bde20 0x7f4e2015c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1ffff700 1 -- 172.21.15.153:0/3968209870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100092a0 con 0x7f4e20158110 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1effd700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e200ac670 0x7f4e2015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e167fc700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e200bde20 0x7f4e2015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e1ffff700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e2015c820 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f4e1800c470 tx=0x7f4e18007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800f470 con 0x7f4e20158110 2023-08-17T00:13:15.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e18001e90 con 0x7f4e20158110 2023-08-17T00:13:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e200a9900 con 0x7f4e20158110 2023-08-17T00:13:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800f7e0 con 0x7f4e20158110 2023-08-17T00:13:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e200a7780 con 0x7f4e20158110 2023-08-17T00:13:15.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.628+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e200a7f80 con 0x7f4e20158110 2023-08-17T00:13:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.632+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4e18010070 con 0x7f4e20158110 2023-08-17T00:13:15.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.632+0000 7f4e177fe700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e0005a150 0x7f4e0005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.632+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4e18073420 con 0x7f4e20158110 2023-08-17T00:13:15.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.632+0000 7f4e1effd700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e0005a150 0x7f4e0005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:15.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.632+0000 7f4e1effd700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e0005a150 0x7f4e0005c610 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f4e1000b340 tx=0x7f4e10017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:15.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.640+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e200a7f80 con 0x7f4e20158110 2023-08-17T00:13:15.664 INFO:tasks.ceph.mds.b.smithi178.stderr:2023-08-17T00:13:15.661+0000 7f6eb0862700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:13:15.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.848+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4e200a7f80 con 0x7f4e20158110 2023-08-17T00:13:15.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e177fe700 1 -- 172.21.15.153:0/3968209870 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1116 (secure 0 0 0) 0x7f4e200a7f80 con 0x7f4e20158110 2023-08-17T00:13:15.857 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:15.857 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":643,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":21,"data_bytes":2306,"bytes_used":2520154112,"bytes_avail":770573959168,"bytes_total":773094113280},"fsmap":{"epoch":109,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-08-17T00:13:01.404283+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:13:15.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e0005a150 msgr2=0x7f4e0005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e0005a150 0x7f4e0005c610 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f4e1000b340 tx=0x7f4e10017000).stop 2023-08-17T00:13:15.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 msgr2=0x7f4e2015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:15.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e2015c820 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 rx=0x7f4e1800c470 tx=0x7f4e18007d70).stop 2023-08-17T00:13:15.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 shutdown_connections 2023-08-17T00:13:15.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e0005a150 0x7f4e0005c610 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e20158110 0x7f4e2015c820 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e200bde20 0x7f4e2015c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 --2- 172.21.15.153:0/3968209870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e200ac670 0x7f4e2015b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:15.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 >> 172.21.15.153:0/3968209870 conn(0x7f4e200c4950 msgr2=0x7f4e2015a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:15.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 shutdown_connections 2023-08-17T00:13:15.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:15.852+0000 7f4e25369700 1 -- 172.21.15.153:0/3968209870 wait complete. 2023-08-17T00:13:15.882 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T00:13:15.882 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:13:16.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.036+0000 7f9ea27f9700 1 Processor -- start 2023-08-17T00:13:16.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea27f9700 1 -- start start 2023-08-17T00:13:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea27f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c151c40 0x7f9e9c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea27f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c065da0 con 0x7f9e9c068da0 2023-08-17T00:13:16.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea27f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9c155c60 con 0x7f9e9c0689c0 2023-08-17T00:13:16.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea27f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c069200 con 0x7f9e9c151c40 2023-08-17T00:13:16.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea0ff6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9e9c068da0 0x7f9e9c151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50860/0 (socket says 172.21.15.153:50860) 2023-08-17T00:13:16.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea0ff6700 1 -- 172.21.15.153:0/3996622797 learned_addr learned my addr 172.21.15.153:0/3996622797 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:16.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9ea1ff8700 1 --2- 172.21.15.153:0/3996622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c151c40 0x7f9e9c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:16.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819208575 0 0) 0x7f9e9c065da0 con 0x7f9e9c068da0 2023-08-17T00:13:16.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e880033f0 con 0x7f9e9c068da0 2023-08-17T00:13:16.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629643465 0 0) 0x7f9e9c155c60 con 0x7f9e9c0689c0 2023-08-17T00:13:16.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.040+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e9c065da0 con 0x7f9e9c0689c0 2023-08-17T00:13:16.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea1ff8700 1 -- 172.21.15.153:0/3996622797 >> v1:172.21.15.178:6789/0 conn(0x7f9e9c0689c0 legacy=0x7f9e9c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea1ff8700 1 -- 172.21.15.153:0/3996622797 >> v1:172.21.15.153:6789/0 conn(0x7f9e9c068da0 legacy=0x7f9e9c151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea1ff8700 1 -- 172.21.15.153:0/3996622797 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9c065ff0 con 0x7f9e9c151c40 2023-08-17T00:13:16.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea1ff8700 1 --2- 172.21.15.153:0/3996622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c151c40 0x7f9e9c1560f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f9e94009e90 tx=0x7f9e94009780).ready entity=mon.2 client_cookie=d919b5b4696d52db server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:16.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400e070 con 0x7f9e9c151c40 2023-08-17T00:13:16.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9400bab0 con 0x7f9e9c151c40 2023-08-17T00:13:16.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9e93fff700 1 -- 172.21.15.153:0/3996622797 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9400be30 con 0x7f9e9c151c40 2023-08-17T00:13:16.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 -- 172.21.15.153:0/3996622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c151c40 msgr2=0x7f9e9c1560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/3996622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c151c40 0x7f9e9c1560f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f9e94009e90 tx=0x7f9e94009780).stop 2023-08-17T00:13:16.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 -- 172.21.15.153:0/3996622797 shutdown_connections 2023-08-17T00:13:16.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/3996622797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c151c40 0x7f9e9c1560f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 -- 172.21.15.153:0/3996622797 >> 172.21.15.153:0/3996622797 conn(0x7f9e9c0c6620 msgr2=0x7f9e9c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:16.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 -- 172.21.15.153:0/3996622797 shutdown_connections 2023-08-17T00:13:16.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.044+0000 7f9ea27f9700 1 -- 172.21.15.153:0/3996622797 wait complete. 2023-08-17T00:13:16.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.048+0000 7f9ea27f9700 1 Processor -- start 2023-08-17T00:13:16.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.048+0000 7f9ea27f9700 1 -- start start 2023-08-17T00:13:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c0689c0 0x7f9e9c0a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e9c068da0 0x7f9e9c0a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e9c151c40 0x7f9e9c153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:16.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0a8420 con 0x7f9e9c068da0 2023-08-17T00:13:16.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c0a5050 con 0x7f9e9c151c40 2023-08-17T00:13:16.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9c154e90 con 0x7f9e9c0689c0 2023-08-17T00:13:16.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea0ff6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e9c068da0 0x7f9e9c0a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:16.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea0ff6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e9c068da0 0x7f9e9c0a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51632/0 (socket says 172.21.15.153:51632) 2023-08-17T00:13:16.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea0ff6700 1 -- 172.21.15.153:0/2004164575 learned_addr learned my addr 172.21.15.153:0/2004164575 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:16.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c0689c0 0x7f9e9c0a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:16.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea1ff8700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e9c151c40 0x7f9e9c153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:16.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 -- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e9c151c40 msgr2=0x7f9e9c153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e9c151c40 0x7f9e9c153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 -- 172.21.15.153:0/2004164575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e9c068da0 msgr2=0x7f9e9c0a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e9c068da0 0x7f9e9c0a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 -- 172.21.15.153:0/2004164575 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94009a20 con 0x7f9e9c0689c0 2023-08-17T00:13:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea17f7700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c0689c0 0x7f9e9c0a4670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9e9800c450 tx=0x7f9e98007bc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98012400 con 0x7f9e9c0689c0 2023-08-17T00:13:16.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e98012560 con 0x7f9e9c0689c0 2023-08-17T00:13:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9c154280 con 0x7f9e9c0689c0 2023-08-17T00:13:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e98012920 con 0x7f9e9c0689c0 2023-08-17T00:13:16.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.052+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9c154840 con 0x7f9e9c0689c0 2023-08-17T00:13:16.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.056+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e9c06b4c0 con 0x7f9e9c0689c0 2023-08-17T00:13:16.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.056+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9e98019030 con 0x7f9e9c0689c0 2023-08-17T00:13:16.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.056+0000 7f9e917fa700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e8005a150 0x7f9e8005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:16.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.056+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e98073710 con 0x7f9e9c0689c0 2023-08-17T00:13:16.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.056+0000 7f9ea0ff6700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e8005a150 0x7f9e8005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:16.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.060+0000 7f9ea0ff6700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e8005a150 0x7f9e8005c610 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9e9c165650 tx=0x7f9e8c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:16.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.064+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e98047050 con 0x7f9e9c0689c0 2023-08-17T00:13:16.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.224+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e9c154fd0 con 0x7f9e8005a150 2023-08-17T00:13:16.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.244+0000 7f9e917fa700 1 -- 172.21.15.153:0/2004164575 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359857 (secure 0 0 0) 0x7f9e9c154fd0 con 0x7f9e8005a150 2023-08-17T00:13:16.253 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e8005a150 msgr2=0x7f9e8005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e8005a150 0x7f9e8005c610 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f9e9c165650 tx=0x7f9e8c009040).stop 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c0689c0 msgr2=0x7f9e9c0a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c0689c0 0x7f9e9c0a4670 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f9e9800c450 tx=0x7f9e98007bc0).stop 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 shutdown_connections 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e8005a150 0x7f9e8005c610 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e9c151c40 0x7f9e9c153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e9c068da0 0x7f9e9c0a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 --2- 172.21.15.153:0/2004164575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e9c0689c0 0x7f9e9c0a4670 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 >> 172.21.15.153:0/2004164575 conn(0x7f9e9c0c6620 msgr2=0x7f9e9c0c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 shutdown_connections 2023-08-17T00:13:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:16.252+0000 7f9ea27f9700 1 -- 172.21.15.153:0/2004164575 wait complete. 2023-08-17T00:13:16.260 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:13:16.278 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":449,"stamp":"2023-08-17T00:13:15.408930+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":244,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461088,"kb_used_data":13664,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752513632,"statfs":{"total":773094113280,"available":770573959168,"internally_reserved":0,"allocated":13991936,"data_stored":6527356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077796598,"num_objects":-1061,"num_object_clones":0,"num_object_copies":-2122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3166,"num_write_kb":-1053253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.219841"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146255+0000","last_change":"2023-08-17T00:13:10.134981+0000","last_active":"2023-08-17T00:13:10.146255+0000","last_peered":"2023-08-17T00:13:10.146255+0000","last_clean":"2023-08-17T00:13:10.146255+0000","last_became_active":"2023-08-17T00:13:10.134555+0000","last_became_peered":"2023-08-17T00:13:10.134555+0000","last_unstale":"2023-08-17T00:13:10.146255+0000","last_undegraded":"2023-08-17T00:13:10.146255+0000","last_fullsized":"2023-08-17T00:13:10.146255+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149796+0000","last_change":"2023-08-17T00:13:09.705113+0000","last_active":"2023-08-17T00:13:10.149796+0000","last_peered":"2023-08-17T00:13:10.149796+0000","last_clean":"2023-08-17T00:13:10.149796+0000","last_became_active":"2023-08-17T00:13:09.704804+0000","last_became_peered":"2023-08-17T00:13:09.704804+0000","last_unstale":"2023-08-17T00:13:10.149796+0000","last_undegraded":"2023-08-17T00:13:10.149796+0000","last_fullsized":"2023-08-17T00:13:10.149796+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.141389+0000","last_change":"2023-08-17T00:13:10.135682+0000","last_active":"2023-08-17T00:13:10.141389+0000","last_peered":"2023-08-17T00:13:10.141389+0000","last_clean":"2023-08-17T00:13:10.141389+0000","last_became_active":"2023-08-17T00:13:10.133859+0000","last_became_peered":"2023-08-17T00:13:10.133859+0000","last_unstale":"2023-08-17T00:13:10.141389+0000","last_undegraded":"2023-08-17T00:13:10.141389+0000","last_fullsized":"2023-08-17T00:13:10.141389+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125940+0000","last_change":"2023-08-17T00:13:09.705945+0000","last_active":"2023-08-17T00:13:10.125940+0000","last_peered":"2023-08-17T00:13:10.125940+0000","last_clean":"2023-08-17T00:13:10.125940+0000","last_became_active":"2023-08-17T00:13:09.704883+0000","last_became_peered":"2023-08-17T00:13:09.704883+0000","last_unstale":"2023-08-17T00:13:10.125940+0000","last_undegraded":"2023-08-17T00:13:10.125940+0000","last_fullsized":"2023-08-17T00:13:10.125940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153212+0000","last_change":"2023-08-17T00:13:10.152576+0000","last_active":"2023-08-17T00:13:10.153212+0000","last_peered":"2023-08-17T00:13:10.153212+0000","last_clean":"2023-08-17T00:13:10.153212+0000","last_became_active":"2023-08-17T00:13:10.152282+0000","last_became_peered":"2023-08-17T00:13:10.152282+0000","last_unstale":"2023-08-17T00:13:10.153212+0000","last_undegraded":"2023-08-17T00:13:10.153212+0000","last_fullsized":"2023-08-17T00:13:10.153212+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117881+0000","last_change":"2023-08-17T00:13:09.706433+0000","last_active":"2023-08-17T00:13:10.117881+0000","last_peered":"2023-08-17T00:13:10.117881+0000","last_clean":"2023-08-17T00:13:10.117881+0000","last_became_active":"2023-08-17T00:13:09.703789+0000","last_became_peered":"2023-08-17T00:13:09.703789+0000","last_unstale":"2023-08-17T00:13:10.117881+0000","last_undegraded":"2023-08-17T00:13:10.117881+0000","last_fullsized":"2023-08-17T00:13:10.117881+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150382+0000","last_change":"2023-08-17T00:13:10.143971+0000","last_active":"2023-08-17T00:13:10.150382+0000","last_peered":"2023-08-17T00:13:10.150382+0000","last_clean":"2023-08-17T00:13:10.150382+0000","last_became_active":"2023-08-17T00:13:10.143673+0000","last_became_peered":"2023-08-17T00:13:10.143673+0000","last_unstale":"2023-08-17T00:13:10.150382+0000","last_undegraded":"2023-08-17T00:13:10.150382+0000","last_fullsized":"2023-08-17T00:13:10.150382+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148103+0000","last_change":"2023-08-17T00:13:09.701169+0000","last_active":"2023-08-17T00:13:10.148103+0000","last_peered":"2023-08-17T00:13:10.148103+0000","last_clean":"2023-08-17T00:13:10.148103+0000","last_became_active":"2023-08-17T00:13:09.700665+0000","last_became_peered":"2023-08-17T00:13:09.700665+0000","last_unstale":"2023-08-17T00:13:10.148103+0000","last_undegraded":"2023-08-17T00:13:10.148103+0000","last_fullsized":"2023-08-17T00:13:10.148103+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.142897+0000","last_change":"2023-08-17T00:13:10.130238+0000","last_active":"2023-08-17T00:13:10.142897+0000","last_peered":"2023-08-17T00:13:10.142897+0000","last_clean":"2023-08-17T00:13:10.142897+0000","last_became_active":"2023-08-17T00:13:10.129911+0000","last_became_peered":"2023-08-17T00:13:10.129911+0000","last_unstale":"2023-08-17T00:13:10.142897+0000","last_undegraded":"2023-08-17T00:13:10.142897+0000","last_fullsized":"2023-08-17T00:13:10.142897+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.147590+0000","last_change":"2023-08-17T00:13:09.720809+0000","last_active":"2023-08-17T00:13:10.147590+0000","last_peered":"2023-08-17T00:13:10.147590+0000","last_clean":"2023-08-17T00:13:10.147590+0000","last_became_active":"2023-08-17T00:13:09.720539+0000","last_became_peered":"2023-08-17T00:13:09.720539+0000","last_unstale":"2023-08-17T00:13:10.147590+0000","last_undegraded":"2023-08-17T00:13:10.147590+0000","last_fullsized":"2023-08-17T00:13:10.147590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143491+0000","last_change":"2023-08-17T00:13:10.130268+0000","last_active":"2023-08-17T00:13:10.143491+0000","last_peered":"2023-08-17T00:13:10.143491+0000","last_clean":"2023-08-17T00:13:10.143491+0000","last_became_active":"2023-08-17T00:13:10.129988+0000","last_became_peered":"2023-08-17T00:13:10.129988+0000","last_unstale":"2023-08-17T00:13:10.143491+0000","last_undegraded":"2023-08-17T00:13:10.143491+0000","last_fullsized":"2023-08-17T00:13:10.143491+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.151291+0000","last_change":"2023-08-17T00:13:09.718597+0000","last_active":"2023-08-17T00:13:10.151291+0000","last_peered":"2023-08-17T00:13:10.151291+0000","last_clean":"2023-08-17T00:13:10.151291+0000","last_became_active":"2023-08-17T00:13:09.718265+0000","last_became_peered":"2023-08-17T00:13:09.718265+0000","last_unstale":"2023-08-17T00:13:10.151291+0000","last_undegraded":"2023-08-17T00:13:10.151291+0000","last_fullsized":"2023-08-17T00:13:10.151291+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.141315+0000","last_change":"2023-08-17T00:13:10.138150+0000","last_active":"2023-08-17T00:13:10.141315+0000","last_peered":"2023-08-17T00:13:10.141315+0000","last_clean":"2023-08-17T00:13:10.141315+0000","last_became_active":"2023-08-17T00:13:10.137850+0000","last_became_peered":"2023-08-17T00:13:10.137850+0000","last_unstale":"2023-08-17T00:13:10.141315+0000","last_undegraded":"2023-08-17T00:13:10.141315+0000","last_fullsized":"2023-08-17T00:13:10.141315+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123111+0000","last_change":"2023-08-17T00:13:09.714300+0000","last_active":"2023-08-17T00:13:10.123111+0000","last_peered":"2023-08-17T00:13:10.123111+0000","last_clean":"2023-08-17T00:13:10.123111+0000","last_became_active":"2023-08-17T00:13:09.711759+0000","last_became_peered":"2023-08-17T00:13:09.711759+0000","last_unstale":"2023-08-17T00:13:10.123111+0000","last_undegraded":"2023-08-17T00:13:10.123111+0000","last_fullsized":"2023-08-17T00:13:10.123111+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144104+0000","last_change":"2023-08-17T00:13:10.136618+0000","last_active":"2023-08-17T00:13:10.144104+0000","last_peered":"2023-08-17T00:13:10.144104+0000","last_clean":"2023-08-17T00:13:10.144104+0000","last_became_active":"2023-08-17T00:13:10.136342+0000","last_became_peered":"2023-08-17T00:13:10.136342+0000","last_unstale":"2023-08-17T00:13:10.144104+0000","last_undegraded":"2023-08-17T00:13:10.144104+0000","last_fullsized":"2023-08-17T00:13:10.144104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.126495+0000","last_change":"2023-08-17T00:13:09.710546+0000","last_active":"2023-08-17T00:13:10.126495+0000","last_peered":"2023-08-17T00:13:10.126495+0000","last_clean":"2023-08-17T00:13:10.126495+0000","last_became_active":"2023-08-17T00:13:09.710214+0000","last_became_peered":"2023-08-17T00:13:09.710214+0000","last_unstale":"2023-08-17T00:13:10.126495+0000","last_undegraded":"2023-08-17T00:13:10.126495+0000","last_fullsized":"2023-08-17T00:13:10.126495+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146368+0000","last_change":"2023-08-17T00:13:10.142648+0000","last_active":"2023-08-17T00:13:10.146368+0000","last_peered":"2023-08-17T00:13:10.146368+0000","last_clean":"2023-08-17T00:13:10.146368+0000","last_became_active":"2023-08-17T00:13:10.142379+0000","last_became_peered":"2023-08-17T00:13:10.142379+0000","last_unstale":"2023-08-17T00:13:10.146368+0000","last_undegraded":"2023-08-17T00:13:10.146368+0000","last_fullsized":"2023-08-17T00:13:10.146368+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117706+0000","last_change":"2023-08-17T00:13:09.713175+0000","last_active":"2023-08-17T00:13:10.117706+0000","last_peered":"2023-08-17T00:13:10.117706+0000","last_clean":"2023-08-17T00:13:10.117706+0000","last_became_active":"2023-08-17T00:13:09.712908+0000","last_became_peered":"2023-08-17T00:13:09.712908+0000","last_unstale":"2023-08-17T00:13:10.117706+0000","last_undegraded":"2023-08-17T00:13:10.117706+0000","last_fullsized":"2023-08-17T00:13:10.117706+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143655+0000","last_change":"2023-08-17T00:13:10.141405+0000","last_active":"2023-08-17T00:13:10.143655+0000","last_peered":"2023-08-17T00:13:10.143655+0000","last_clean":"2023-08-17T00:13:10.143655+0000","last_became_active":"2023-08-17T00:13:10.141104+0000","last_became_peered":"2023-08-17T00:13:10.141104+0000","last_unstale":"2023-08-17T00:13:10.143655+0000","last_undegraded":"2023-08-17T00:13:10.143655+0000","last_fullsized":"2023-08-17T00:13:10.143655+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123985+0000","last_change":"2023-08-17T00:13:09.706671+0000","last_active":"2023-08-17T00:13:10.123985+0000","last_peered":"2023-08-17T00:13:10.123985+0000","last_clean":"2023-08-17T00:13:10.123985+0000","last_became_active":"2023-08-17T00:13:09.705653+0000","last_became_peered":"2023-08-17T00:13:09.705653+0000","last_unstale":"2023-08-17T00:13:10.123985+0000","last_undegraded":"2023-08-17T00:13:10.123985+0000","last_fullsized":"2023-08-17T00:13:10.123985+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146236+0000","last_change":"2023-08-17T00:13:10.142054+0000","last_active":"2023-08-17T00:13:10.146236+0000","last_peered":"2023-08-17T00:13:10.146236+0000","last_clean":"2023-08-17T00:13:10.146236+0000","last_became_active":"2023-08-17T00:13:10.141745+0000","last_became_peered":"2023-08-17T00:13:10.141745+0000","last_unstale":"2023-08-17T00:13:10.146236+0000","last_undegraded":"2023-08-17T00:13:10.146236+0000","last_fullsized":"2023-08-17T00:13:10.146236+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124998+0000","last_change":"2023-08-17T00:13:09.714328+0000","last_active":"2023-08-17T00:13:10.124998+0000","last_peered":"2023-08-17T00:13:10.124998+0000","last_clean":"2023-08-17T00:13:10.124998+0000","last_became_active":"2023-08-17T00:13:09.713429+0000","last_became_peered":"2023-08-17T00:13:09.713429+0000","last_unstale":"2023-08-17T00:13:10.124998+0000","last_undegraded":"2023-08-17T00:13:10.124998+0000","last_fullsized":"2023-08-17T00:13:10.124998+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.140616+0000","last_change":"2023-08-17T00:13:10.138676+0000","last_active":"2023-08-17T00:13:10.140616+0000","last_peered":"2023-08-17T00:13:10.140616+0000","last_clean":"2023-08-17T00:13:10.140616+0000","last_became_active":"2023-08-17T00:13:10.138369+0000","last_became_peered":"2023-08-17T00:13:10.138369+0000","last_unstale":"2023-08-17T00:13:10.140616+0000","last_undegraded":"2023-08-17T00:13:10.140616+0000","last_fullsized":"2023-08-17T00:13:10.140616+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.34","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.154786+0000","last_change":"2023-08-17T00:13:09.720855+0000","last_active":"2023-08-17T00:13:10.154786+0000","last_peered":"2023-08-17T00:13:10.154786+0000","last_clean":"2023-08-17T00:13:10.154786+0000","last_became_active":"2023-08-17T00:13:09.720051+0000","last_became_peered":"2023-08-17T00:13:09.720051+0000","last_unstale":"2023-08-17T00:13:10.154786+0000","last_undegraded":"2023-08-17T00:13:10.154786+0000","last_fullsized":"2023-08-17T00:13:10.154786+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149677+0000","last_change":"2023-08-17T00:13:10.135331+0000","last_active":"2023-08-17T00:13:10.149677+0000","last_peered":"2023-08-17T00:13:10.149677+0000","last_clean":"2023-08-17T00:13:10.149677+0000","last_became_active":"2023-08-17T00:13:10.135028+0000","last_became_peered":"2023-08-17T00:13:10.135028+0000","last_unstale":"2023-08-17T00:13:10.149677+0000","last_undegraded":"2023-08-17T00:13:10.149677+0000","last_fullsized":"2023-08-17T00:13:10.149677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.33","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143196+0000","last_change":"2023-08-17T00:13:09.701083+0000","last_active":"2023-08-17T00:13:10.143196+0000","last_peered":"2023-08-17T00:13:10.143196+0000","last_clean":"2023-08-17T00:13:10.143196+0000","last_became_active":"2023-08-17T00:13:09.700791+0000","last_became_peered":"2023-08-17T00:13:09.700791+0000","last_unstale":"2023-08-17T00:13:10.143196+0000","last_undegraded":"2023-08-17T00:13:10.143196+0000","last_fullsized":"2023-08-17T00:13:10.143196+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.141506+0000","last_change":"2023-08-17T00:13:10.138110+0000","last_active":"2023-08-17T00:13:10.141506+0000","last_peered":"2023-08-17T00:13:10.141506+0000","last_clean":"2023-08-17T00:13:10.141506+0000","last_became_active":"2023-08-17T00:13:10.137839+0000","last_became_peered":"2023-08-17T00:13:10.137839+0000","last_unstale":"2023-08-17T00:13:10.141506+0000","last_undegraded":"2023-08-17T00:13:10.141506+0000","last_fullsized":"2023-08-17T00:13:10.141506+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127962+0000","last_change":"2023-08-17T00:13:09.714532+0000","last_active":"2023-08-17T00:13:10.127962+0000","last_peered":"2023-08-17T00:13:10.127962+0000","last_clean":"2023-08-17T00:13:10.127962+0000","last_became_active":"2023-08-17T00:13:09.714227+0000","last_became_peered":"2023-08-17T00:13:09.714227+0000","last_unstale":"2023-08-17T00:13:10.127962+0000","last_undegraded":"2023-08-17T00:13:10.127962+0000","last_fullsized":"2023-08-17T00:13:10.127962+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148686+0000","last_change":"2023-08-17T00:13:10.141000+0000","last_active":"2023-08-17T00:13:10.148686+0000","last_peered":"2023-08-17T00:13:10.148686+0000","last_clean":"2023-08-17T00:13:10.148686+0000","last_became_active":"2023-08-17T00:13:10.140713+0000","last_became_peered":"2023-08-17T00:13:10.140713+0000","last_unstale":"2023-08-17T00:13:10.148686+0000","last_undegraded":"2023-08-17T00:13:10.148686+0000","last_fullsized":"2023-08-17T00:13:10.148686+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.131323+0000","last_change":"2023-08-17T00:13:09.716107+0000","last_active":"2023-08-17T00:13:10.131323+0000","last_peered":"2023-08-17T00:13:10.131323+0000","last_clean":"2023-08-17T00:13:10.131323+0000","last_became_active":"2023-08-17T00:13:09.715776+0000","last_became_peered":"2023-08-17T00:13:09.715776+0000","last_unstale":"2023-08-17T00:13:10.131323+0000","last_undegraded":"2023-08-17T00:13:10.131323+0000","last_fullsized":"2023-08-17T00:13:10.131323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.151123+0000","last_change":"2023-08-17T00:13:10.145254+0000","last_active":"2023-08-17T00:13:10.151123+0000","last_peered":"2023-08-17T00:13:10.151123+0000","last_clean":"2023-08-17T00:13:10.151123+0000","last_became_active":"2023-08-17T00:13:10.144850+0000","last_became_peered":"2023-08-17T00:13:10.144850+0000","last_unstale":"2023-08-17T00:13:10.151123+0000","last_undegraded":"2023-08-17T00:13:10.151123+0000","last_fullsized":"2023-08-17T00:13:10.151123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.30","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153590+0000","last_change":"2023-08-17T00:13:09.723932+0000","last_active":"2023-08-17T00:13:10.153590+0000","last_peered":"2023-08-17T00:13:10.153590+0000","last_clean":"2023-08-17T00:13:10.153590+0000","last_became_active":"2023-08-17T00:13:09.723623+0000","last_became_peered":"2023-08-17T00:13:09.723623+0000","last_unstale":"2023-08-17T00:13:10.153590+0000","last_undegraded":"2023-08-17T00:13:10.153590+0000","last_fullsized":"2023-08-17T00:13:10.153590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148778+0000","last_change":"2023-08-17T00:13:10.140724+0000","last_active":"2023-08-17T00:13:10.148778+0000","last_peered":"2023-08-17T00:13:10.148778+0000","last_clean":"2023-08-17T00:13:10.148778+0000","last_became_active":"2023-08-17T00:13:10.140386+0000","last_became_peered":"2023-08-17T00:13:10.140386+0000","last_unstale":"2023-08-17T00:13:10.148778+0000","last_undegraded":"2023-08-17T00:13:10.148778+0000","last_fullsized":"2023-08-17T00:13:10.148778+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117841+0000","last_change":"2023-08-17T00:13:09.712006+0000","last_active":"2023-08-17T00:13:10.117841+0000","last_peered":"2023-08-17T00:13:10.117841+0000","last_clean":"2023-08-17T00:13:10.117841+0000","last_became_active":"2023-08-17T00:13:09.709248+0000","last_became_peered":"2023-08-17T00:13:09.709248+0000","last_unstale":"2023-08-17T00:13:10.117841+0000","last_undegraded":"2023-08-17T00:13:10.117841+0000","last_fullsized":"2023-08-17T00:13:10.117841+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.142954+0000","last_change":"2023-08-17T00:13:10.138764+0000","last_active":"2023-08-17T00:13:10.142954+0000","last_peered":"2023-08-17T00:13:10.142954+0000","last_clean":"2023-08-17T00:13:10.142954+0000","last_became_active":"2023-08-17T00:13:10.138482+0000","last_became_peered":"2023-08-17T00:13:10.138482+0000","last_unstale":"2023-08-17T00:13:10.142954+0000","last_undegraded":"2023-08-17T00:13:10.142954+0000","last_fullsized":"2023-08-17T00:13:10.142954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.132945+0000","last_change":"2023-08-17T00:13:09.723271+0000","last_active":"2023-08-17T00:13:10.132945+0000","last_peered":"2023-08-17T00:13:10.132945+0000","last_clean":"2023-08-17T00:13:10.132945+0000","last_became_active":"2023-08-17T00:13:09.723013+0000","last_became_peered":"2023-08-17T00:13:09.723013+0000","last_unstale":"2023-08-17T00:13:10.132945+0000","last_undegraded":"2023-08-17T00:13:10.132945+0000","last_fullsized":"2023-08-17T00:13:10.132945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.140127+0000","last_change":"2023-08-17T00:13:10.138585+0000","last_active":"2023-08-17T00:13:10.140127+0000","last_peered":"2023-08-17T00:13:10.140127+0000","last_clean":"2023-08-17T00:13:10.140127+0000","last_became_active":"2023-08-17T00:13:10.138177+0000","last_became_peered":"2023-08-17T00:13:10.138177+0000","last_unstale":"2023-08-17T00:13:10.140127+0000","last_undegraded":"2023-08-17T00:13:10.140127+0000","last_fullsized":"2023-08-17T00:13:10.140127+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149632+0000","last_change":"2023-08-17T00:13:09.704715+0000","last_active":"2023-08-17T00:13:10.149632+0000","last_peered":"2023-08-17T00:13:10.149632+0000","last_clean":"2023-08-17T00:13:10.149632+0000","last_became_active":"2023-08-17T00:13:09.704442+0000","last_became_peered":"2023-08-17T00:13:09.704442+0000","last_unstale":"2023-08-17T00:13:10.149632+0000","last_undegraded":"2023-08-17T00:13:10.149632+0000","last_fullsized":"2023-08-17T00:13:10.149632+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143353+0000","last_change":"2023-08-17T00:13:10.133246+0000","last_active":"2023-08-17T00:13:10.143353+0000","last_peered":"2023-08-17T00:13:10.143353+0000","last_clean":"2023-08-17T00:13:10.143353+0000","last_became_active":"2023-08-17T00:13:10.131240+0000","last_became_peered":"2023-08-17T00:13:10.131240+0000","last_unstale":"2023-08-17T00:13:10.143353+0000","last_undegraded":"2023-08-17T00:13:10.143353+0000","last_fullsized":"2023-08-17T00:13:10.143353+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.135851+0000","last_change":"2023-08-17T00:13:09.708794+0000","last_active":"2023-08-17T00:13:10.135851+0000","last_peered":"2023-08-17T00:13:10.135851+0000","last_clean":"2023-08-17T00:13:10.135851+0000","last_became_active":"2023-08-17T00:13:09.708523+0000","last_became_peered":"2023-08-17T00:13:09.708523+0000","last_unstale":"2023-08-17T00:13:10.135851+0000","last_undegraded":"2023-08-17T00:13:10.135851+0000","last_fullsized":"2023-08-17T00:13:10.135851+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144511+0000","last_change":"2023-08-17T00:13:10.132288+0000","last_active":"2023-08-17T00:13:10.144511+0000","last_peered":"2023-08-17T00:13:10.144511+0000","last_clean":"2023-08-17T00:13:10.144511+0000","last_became_active":"2023-08-17T00:13:10.131952+0000","last_became_peered":"2023-08-17T00:13:10.131952+0000","last_unstale":"2023-08-17T00:13:10.144511+0000","last_undegraded":"2023-08-17T00:13:10.144511+0000","last_fullsized":"2023-08-17T00:13:10.144511+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152475+0000","last_change":"2023-08-17T00:13:09.722191+0000","last_active":"2023-08-17T00:13:10.152475+0000","last_peered":"2023-08-17T00:13:10.152475+0000","last_clean":"2023-08-17T00:13:10.152475+0000","last_became_active":"2023-08-17T00:13:09.721759+0000","last_became_peered":"2023-08-17T00:13:09.721759+0000","last_unstale":"2023-08-17T00:13:10.152475+0000","last_undegraded":"2023-08-17T00:13:10.152475+0000","last_fullsized":"2023-08-17T00:13:10.152475+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143217+0000","last_change":"2023-08-17T00:13:10.138861+0000","last_active":"2023-08-17T00:13:10.143217+0000","last_peered":"2023-08-17T00:13:10.143217+0000","last_clean":"2023-08-17T00:13:10.143217+0000","last_became_active":"2023-08-17T00:13:10.138578+0000","last_became_peered":"2023-08-17T00:13:10.138578+0000","last_unstale":"2023-08-17T00:13:10.143217+0000","last_undegraded":"2023-08-17T00:13:10.143217+0000","last_fullsized":"2023-08-17T00:13:10.143217+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119797+0000","last_change":"2023-08-17T00:13:09.704362+0000","last_active":"2023-08-17T00:13:10.119797+0000","last_peered":"2023-08-17T00:13:10.119797+0000","last_clean":"2023-08-17T00:13:10.119797+0000","last_became_active":"2023-08-17T00:13:09.703910+0000","last_became_peered":"2023-08-17T00:13:09.703910+0000","last_unstale":"2023-08-17T00:13:10.119797+0000","last_undegraded":"2023-08-17T00:13:10.119797+0000","last_fullsized":"2023-08-17T00:13:10.119797+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149441+0000","last_change":"2023-08-17T00:13:10.135316+0000","last_active":"2023-08-17T00:13:10.149441+0000","last_peered":"2023-08-17T00:13:10.149441+0000","last_clean":"2023-08-17T00:13:10.149441+0000","last_became_active":"2023-08-17T00:13:10.134715+0000","last_became_peered":"2023-08-17T00:13:10.134715+0000","last_unstale":"2023-08-17T00:13:10.149441+0000","last_undegraded":"2023-08-17T00:13:10.149441+0000","last_fullsized":"2023-08-17T00:13:10.149441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127624+0000","last_change":"2023-08-17T00:13:09.715067+0000","last_active":"2023-08-17T00:13:10.127624+0000","last_peered":"2023-08-17T00:13:10.127624+0000","last_clean":"2023-08-17T00:13:10.127624+0000","last_became_active":"2023-08-17T00:13:09.714773+0000","last_became_peered":"2023-08-17T00:13:09.714773+0000","last_unstale":"2023-08-17T00:13:10.127624+0000","last_undegraded":"2023-08-17T00:13:10.127624+0000","last_fullsized":"2023-08-17T00:13:10.127624+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146222+0000","last_change":"2023-08-17T00:13:10.140368+0000","last_active":"2023-08-17T00:13:10.146222+0000","last_peered":"2023-08-17T00:13:10.146222+0000","last_clean":"2023-08-17T00:13:10.146222+0000","last_became_active":"2023-08-17T00:13:10.140053+0000","last_became_peered":"2023-08-17T00:13:10.140053+0000","last_unstale":"2023-08-17T00:13:10.146222+0000","last_undegraded":"2023-08-17T00:13:10.146222+0000","last_fullsized":"2023-08-17T00:13:10.146222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.129713+0000","last_change":"2023-08-17T00:13:09.721658+0000","last_active":"2023-08-17T00:13:10.129713+0000","last_peered":"2023-08-17T00:13:10.129713+0000","last_clean":"2023-08-17T00:13:10.129713+0000","last_became_active":"2023-08-17T00:13:09.721347+0000","last_became_peered":"2023-08-17T00:13:09.721347+0000","last_unstale":"2023-08-17T00:13:10.129713+0000","last_undegraded":"2023-08-17T00:13:10.129713+0000","last_fullsized":"2023-08-17T00:13:10.129713+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149661+0000","last_change":"2023-08-17T00:13:10.147061+0000","last_active":"2023-08-17T00:13:10.149661+0000","last_peered":"2023-08-17T00:13:10.149661+0000","last_clean":"2023-08-17T00:13:10.149661+0000","last_became_active":"2023-08-17T00:13:10.146740+0000","last_became_peered":"2023-08-17T00:13:10.146740+0000","last_unstale":"2023-08-17T00:13:10.149661+0000","last_undegraded":"2023-08-17T00:13:10.149661+0000","last_fullsized":"2023-08-17T00:13:10.149661+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125580+0000","last_change":"2023-08-17T00:13:09.702331+0000","last_active":"2023-08-17T00:13:10.125580+0000","last_peered":"2023-08-17T00:13:10.125580+0000","last_clean":"2023-08-17T00:13:10.125580+0000","last_became_active":"2023-08-17T00:13:09.701736+0000","last_became_peered":"2023-08-17T00:13:09.701736+0000","last_unstale":"2023-08-17T00:13:10.125580+0000","last_undegraded":"2023-08-17T00:13:10.125580+0000","last_fullsized":"2023-08-17T00:13:10.125580+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149687+0000","last_change":"2023-08-17T00:13:10.146614+0000","last_active":"2023-08-17T00:13:10.149687+0000","last_peered":"2023-08-17T00:13:10.149687+0000","last_clean":"2023-08-17T00:13:10.149687+0000","last_became_active":"2023-08-17T00:13:10.146361+0000","last_became_peered":"2023-08-17T00:13:10.146361+0000","last_unstale":"2023-08-17T00:13:10.149687+0000","last_undegraded":"2023-08-17T00:13:10.149687+0000","last_fullsized":"2023-08-17T00:13:10.149687+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124104+0000","last_change":"2023-08-17T00:13:09.713360+0000","last_active":"2023-08-17T00:13:10.124104+0000","last_peered":"2023-08-17T00:13:10.124104+0000","last_clean":"2023-08-17T00:13:10.124104+0000","last_became_active":"2023-08-17T00:13:09.713047+0000","last_became_peered":"2023-08-17T00:13:09.713047+0000","last_unstale":"2023-08-17T00:13:10.124104+0000","last_undegraded":"2023-08-17T00:13:10.124104+0000","last_fullsized":"2023-08-17T00:13:10.124104+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149765+0000","last_change":"2023-08-17T00:13:10.145126+0000","last_active":"2023-08-17T00:13:10.149765+0000","last_peered":"2023-08-17T00:13:10.149765+0000","last_clean":"2023-08-17T00:13:10.149765+0000","last_became_active":"2023-08-17T00:13:10.144456+0000","last_became_peered":"2023-08-17T00:13:10.144456+0000","last_unstale":"2023-08-17T00:13:10.149765+0000","last_undegraded":"2023-08-17T00:13:10.149765+0000","last_fullsized":"2023-08-17T00:13:10.149765+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127348+0000","last_change":"2023-08-17T00:13:09.718583+0000","last_active":"2023-08-17T00:13:10.127348+0000","last_peered":"2023-08-17T00:13:10.127348+0000","last_clean":"2023-08-17T00:13:10.127348+0000","last_became_active":"2023-08-17T00:13:09.718328+0000","last_became_peered":"2023-08-17T00:13:09.718328+0000","last_unstale":"2023-08-17T00:13:10.127348+0000","last_undegraded":"2023-08-17T00:13:10.127348+0000","last_fullsized":"2023-08-17T00:13:10.127348+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148316+0000","last_change":"2023-08-17T00:13:10.142752+0000","last_active":"2023-08-17T00:13:10.148316+0000","last_peered":"2023-08-17T00:13:10.148316+0000","last_clean":"2023-08-17T00:13:10.148316+0000","last_became_active":"2023-08-17T00:13:10.142480+0000","last_became_peered":"2023-08-17T00:13:10.142480+0000","last_unstale":"2023-08-17T00:13:10.148316+0000","last_undegraded":"2023-08-17T00:13:10.148316+0000","last_fullsized":"2023-08-17T00:13:10.148316+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127070+0000","last_change":"2023-08-17T00:13:09.713275+0000","last_active":"2023-08-17T00:13:10.127070+0000","last_peered":"2023-08-17T00:13:10.127070+0000","last_clean":"2023-08-17T00:13:10.127070+0000","last_became_active":"2023-08-17T00:13:09.712157+0000","last_became_peered":"2023-08-17T00:13:09.712157+0000","last_unstale":"2023-08-17T00:13:10.127070+0000","last_undegraded":"2023-08-17T00:13:10.127070+0000","last_fullsized":"2023-08-17T00:13:10.127070+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153052+0000","last_change":"2023-08-17T00:13:10.151922+0000","last_active":"2023-08-17T00:13:10.153052+0000","last_peered":"2023-08-17T00:13:10.153052+0000","last_clean":"2023-08-17T00:13:10.153052+0000","last_became_active":"2023-08-17T00:13:10.151590+0000","last_became_peered":"2023-08-17T00:13:10.151590+0000","last_unstale":"2023-08-17T00:13:10.153052+0000","last_undegraded":"2023-08-17T00:13:10.153052+0000","last_fullsized":"2023-08-17T00:13:10.153052+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.121807+0000","last_change":"2023-08-17T00:13:09.714585+0000","last_active":"2023-08-17T00:13:10.121807+0000","last_peered":"2023-08-17T00:13:10.121807+0000","last_clean":"2023-08-17T00:13:10.121807+0000","last_became_active":"2023-08-17T00:13:09.714324+0000","last_became_peered":"2023-08-17T00:13:09.714324+0000","last_unstale":"2023-08-17T00:13:10.121807+0000","last_undegraded":"2023-08-17T00:13:10.121807+0000","last_fullsized":"2023-08-17T00:13:10.121807+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146785+0000","last_change":"2023-08-17T00:13:10.141694+0000","last_active":"2023-08-17T00:13:10.146785+0000","last_peered":"2023-08-17T00:13:10.146785+0000","last_clean":"2023-08-17T00:13:10.146785+0000","last_became_active":"2023-08-17T00:13:10.141264+0000","last_became_peered":"2023-08-17T00:13:10.141264+0000","last_unstale":"2023-08-17T00:13:10.146785+0000","last_undegraded":"2023-08-17T00:13:10.146785+0000","last_fullsized":"2023-08-17T00:13:10.146785+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119960+0000","last_change":"2023-08-17T00:13:09.704177+0000","last_active":"2023-08-17T00:13:10.119960+0000","last_peered":"2023-08-17T00:13:10.119960+0000","last_clean":"2023-08-17T00:13:10.119960+0000","last_became_active":"2023-08-17T00:13:09.703629+0000","last_became_peered":"2023-08-17T00:13:09.703629+0000","last_unstale":"2023-08-17T00:13:10.119960+0000","last_undegraded":"2023-08-17T00:13:10.119960+0000","last_fullsized":"2023-08-17T00:13:10.119960+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143101+0000","last_change":"2023-08-17T00:13:10.131719+0000","last_active":"2023-08-17T00:13:10.143101+0000","last_peered":"2023-08-17T00:13:10.143101+0000","last_clean":"2023-08-17T00:13:10.143101+0000","last_became_active":"2023-08-17T00:13:10.131458+0000","last_became_peered":"2023-08-17T00:13:10.131458+0000","last_unstale":"2023-08-17T00:13:10.143101+0000","last_undegraded":"2023-08-17T00:13:10.143101+0000","last_fullsized":"2023-08-17T00:13:10.143101+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127731+0000","last_change":"2023-08-17T00:13:09.706097+0000","last_active":"2023-08-17T00:13:10.127731+0000","last_peered":"2023-08-17T00:13:10.127731+0000","last_clean":"2023-08-17T00:13:10.127731+0000","last_became_active":"2023-08-17T00:13:09.705810+0000","last_became_peered":"2023-08-17T00:13:09.705810+0000","last_unstale":"2023-08-17T00:13:10.127731+0000","last_undegraded":"2023-08-17T00:13:10.127731+0000","last_fullsized":"2023-08-17T00:13:10.127731+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144906+0000","last_change":"2023-08-17T00:13:10.133088+0000","last_active":"2023-08-17T00:13:10.144906+0000","last_peered":"2023-08-17T00:13:10.144906+0000","last_clean":"2023-08-17T00:13:10.144906+0000","last_became_active":"2023-08-17T00:13:10.132758+0000","last_became_peered":"2023-08-17T00:13:10.132758+0000","last_unstale":"2023-08-17T00:13:10.144906+0000","last_undegraded":"2023-08-17T00:13:10.144906+0000","last_fullsized":"2023-08-17T00:13:10.144906+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117576+0000","last_change":"2023-08-17T00:13:09.710487+0000","last_active":"2023-08-17T00:13:10.117576+0000","last_peered":"2023-08-17T00:13:10.117576+0000","last_clean":"2023-08-17T00:13:10.117576+0000","last_became_active":"2023-08-17T00:13:09.710200+0000","last_became_peered":"2023-08-17T00:13:09.710200+0000","last_unstale":"2023-08-17T00:13:10.117576+0000","last_undegraded":"2023-08-17T00:13:10.117576+0000","last_fullsized":"2023-08-17T00:13:10.117576+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146236+0000","last_change":"2023-08-17T00:13:10.134818+0000","last_active":"2023-08-17T00:13:10.146236+0000","last_peered":"2023-08-17T00:13:10.146236+0000","last_clean":"2023-08-17T00:13:10.146236+0000","last_became_active":"2023-08-17T00:13:10.134174+0000","last_became_peered":"2023-08-17T00:13:10.134174+0000","last_unstale":"2023-08-17T00:13:10.146236+0000","last_undegraded":"2023-08-17T00:13:10.146236+0000","last_fullsized":"2023-08-17T00:13:10.146236+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152396+0000","last_change":"2023-08-17T00:13:09.712188+0000","last_active":"2023-08-17T00:13:10.152396+0000","last_peered":"2023-08-17T00:13:10.152396+0000","last_clean":"2023-08-17T00:13:10.152396+0000","last_became_active":"2023-08-17T00:13:09.711482+0000","last_became_peered":"2023-08-17T00:13:09.711482+0000","last_unstale":"2023-08-17T00:13:10.152396+0000","last_undegraded":"2023-08-17T00:13:10.152396+0000","last_fullsized":"2023-08-17T00:13:10.152396+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148824+0000","last_change":"2023-08-17T00:13:10.141561+0000","last_active":"2023-08-17T00:13:10.148824+0000","last_peered":"2023-08-17T00:13:10.148824+0000","last_clean":"2023-08-17T00:13:10.148824+0000","last_became_active":"2023-08-17T00:13:10.141302+0000","last_became_peered":"2023-08-17T00:13:10.141302+0000","last_unstale":"2023-08-17T00:13:10.148824+0000","last_undegraded":"2023-08-17T00:13:10.148824+0000","last_fullsized":"2023-08-17T00:13:10.148824+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.151291+0000","last_change":"2023-08-17T00:13:09.711877+0000","last_active":"2023-08-17T00:13:10.151291+0000","last_peered":"2023-08-17T00:13:10.151291+0000","last_clean":"2023-08-17T00:13:10.151291+0000","last_became_active":"2023-08-17T00:13:09.711521+0000","last_became_peered":"2023-08-17T00:13:09.711521+0000","last_unstale":"2023-08-17T00:13:10.151291+0000","last_undegraded":"2023-08-17T00:13:10.151291+0000","last_fullsized":"2023-08-17T00:13:10.151291+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149781+0000","last_change":"2023-08-17T00:13:10.145756+0000","last_active":"2023-08-17T00:13:10.149781+0000","last_peered":"2023-08-17T00:13:10.149781+0000","last_clean":"2023-08-17T00:13:10.149781+0000","last_became_active":"2023-08-17T00:13:10.144441+0000","last_became_peered":"2023-08-17T00:13:10.144441+0000","last_unstale":"2023-08-17T00:13:10.149781+0000","last_undegraded":"2023-08-17T00:13:10.149781+0000","last_fullsized":"2023-08-17T00:13:10.149781+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146506+0000","last_change":"2023-08-17T00:13:09.721797+0000","last_active":"2023-08-17T00:13:10.146506+0000","last_peered":"2023-08-17T00:13:10.146506+0000","last_clean":"2023-08-17T00:13:10.146506+0000","last_became_active":"2023-08-17T00:13:09.721470+0000","last_became_peered":"2023-08-17T00:13:09.721470+0000","last_unstale":"2023-08-17T00:13:10.146506+0000","last_undegraded":"2023-08-17T00:13:10.146506+0000","last_fullsized":"2023-08-17T00:13:10.146506+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149507+0000","last_change":"2023-08-17T00:13:10.136335+0000","last_active":"2023-08-17T00:13:10.149507+0000","last_peered":"2023-08-17T00:13:10.149507+0000","last_clean":"2023-08-17T00:13:10.149507+0000","last_became_active":"2023-08-17T00:13:10.135737+0000","last_became_peered":"2023-08-17T00:13:10.135737+0000","last_unstale":"2023-08-17T00:13:10.149507+0000","last_undegraded":"2023-08-17T00:13:10.149507+0000","last_fullsized":"2023-08-17T00:13:10.149507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117655+0000","last_change":"2023-08-17T00:13:09.709149+0000","last_active":"2023-08-17T00:13:10.117655+0000","last_peered":"2023-08-17T00:13:10.117655+0000","last_clean":"2023-08-17T00:13:10.117655+0000","last_became_active":"2023-08-17T00:13:09.708813+0000","last_became_peered":"2023-08-17T00:13:09.708813+0000","last_unstale":"2023-08-17T00:13:10.117655+0000","last_undegraded":"2023-08-17T00:13:10.117655+0000","last_fullsized":"2023-08-17T00:13:10.117655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152820+0000","last_change":"2023-08-17T00:13:10.142656+0000","last_active":"2023-08-17T00:13:10.152820+0000","last_peered":"2023-08-17T00:13:10.152820+0000","last_clean":"2023-08-17T00:13:10.152820+0000","last_became_active":"2023-08-17T00:13:10.142378+0000","last_became_peered":"2023-08-17T00:13:10.142378+0000","last_unstale":"2023-08-17T00:13:10.152820+0000","last_undegraded":"2023-08-17T00:13:10.152820+0000","last_fullsized":"2023-08-17T00:13:10.152820+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125625+0000","last_change":"2023-08-17T00:13:09.719799+0000","last_active":"2023-08-17T00:13:10.125625+0000","last_peered":"2023-08-17T00:13:10.125625+0000","last_clean":"2023-08-17T00:13:10.125625+0000","last_became_active":"2023-08-17T00:13:09.719514+0000","last_became_peered":"2023-08-17T00:13:09.719514+0000","last_unstale":"2023-08-17T00:13:10.125625+0000","last_undegraded":"2023-08-17T00:13:10.125625+0000","last_fullsized":"2023-08-17T00:13:10.125625+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152822+0000","last_change":"2023-08-17T00:13:10.143592+0000","last_active":"2023-08-17T00:13:10.152822+0000","last_peered":"2023-08-17T00:13:10.152822+0000","last_clean":"2023-08-17T00:13:10.152822+0000","last_became_active":"2023-08-17T00:13:10.143306+0000","last_became_peered":"2023-08-17T00:13:10.143306+0000","last_unstale":"2023-08-17T00:13:10.152822+0000","last_undegraded":"2023-08-17T00:13:10.152822+0000","last_fullsized":"2023-08-17T00:13:10.152822+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.130511+0000","last_change":"2023-08-17T00:13:09.712335+0000","last_active":"2023-08-17T00:13:10.130511+0000","last_peered":"2023-08-17T00:13:10.130511+0000","last_clean":"2023-08-17T00:13:10.130511+0000","last_became_active":"2023-08-17T00:13:09.711610+0000","last_became_peered":"2023-08-17T00:13:09.711610+0000","last_unstale":"2023-08-17T00:13:10.130511+0000","last_undegraded":"2023-08-17T00:13:10.130511+0000","last_fullsized":"2023-08-17T00:13:10.130511+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150507+0000","last_change":"2023-08-17T00:13:10.143490+0000","last_active":"2023-08-17T00:13:10.150507+0000","last_peered":"2023-08-17T00:13:10.150507+0000","last_clean":"2023-08-17T00:13:10.150507+0000","last_became_active":"2023-08-17T00:13:10.143226+0000","last_became_peered":"2023-08-17T00:13:10.143226+0000","last_unstale":"2023-08-17T00:13:10.150507+0000","last_undegraded":"2023-08-17T00:13:10.150507+0000","last_fullsized":"2023-08-17T00:13:10.150507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119521+0000","last_change":"2023-08-17T00:13:09.703051+0000","last_active":"2023-08-17T00:13:10.119521+0000","last_peered":"2023-08-17T00:13:10.119521+0000","last_clean":"2023-08-17T00:13:10.119521+0000","last_became_active":"2023-08-17T00:13:09.702719+0000","last_became_peered":"2023-08-17T00:13:09.702719+0000","last_unstale":"2023-08-17T00:13:10.119521+0000","last_undegraded":"2023-08-17T00:13:10.119521+0000","last_fullsized":"2023-08-17T00:13:10.119521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152375+0000","last_change":"2023-08-17T00:13:10.140592+0000","last_active":"2023-08-17T00:13:10.152375+0000","last_peered":"2023-08-17T00:13:10.152375+0000","last_clean":"2023-08-17T00:13:10.152375+0000","last_became_active":"2023-08-17T00:13:10.137955+0000","last_became_peered":"2023-08-17T00:13:10.137955+0000","last_unstale":"2023-08-17T00:13:10.152375+0000","last_undegraded":"2023-08-17T00:13:10.152375+0000","last_fullsized":"2023-08-17T00:13:10.152375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123009+0000","last_change":"2023-08-17T00:13:09.704781+0000","last_active":"2023-08-17T00:13:10.123009+0000","last_peered":"2023-08-17T00:13:10.123009+0000","last_clean":"2023-08-17T00:13:10.123009+0000","last_became_active":"2023-08-17T00:13:09.704465+0000","last_became_peered":"2023-08-17T00:13:09.704465+0000","last_unstale":"2023-08-17T00:13:10.123009+0000","last_undegraded":"2023-08-17T00:13:10.123009+0000","last_fullsized":"2023-08-17T00:13:10.123009+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149681+0000","last_change":"2023-08-17T00:13:10.146117+0000","last_active":"2023-08-17T00:13:10.149681+0000","last_peered":"2023-08-17T00:13:10.149681+0000","last_clean":"2023-08-17T00:13:10.149681+0000","last_became_active":"2023-08-17T00:13:10.145845+0000","last_became_peered":"2023-08-17T00:13:10.145845+0000","last_unstale":"2023-08-17T00:13:10.149681+0000","last_undegraded":"2023-08-17T00:13:10.149681+0000","last_fullsized":"2023-08-17T00:13:10.149681+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.145795+0000","last_change":"2023-08-17T00:13:09.714695+0000","last_active":"2023-08-17T00:13:10.145795+0000","last_peered":"2023-08-17T00:13:10.145795+0000","last_clean":"2023-08-17T00:13:10.145795+0000","last_became_active":"2023-08-17T00:13:09.714142+0000","last_became_peered":"2023-08-17T00:13:09.714142+0000","last_unstale":"2023-08-17T00:13:10.145795+0000","last_undegraded":"2023-08-17T00:13:10.145795+0000","last_fullsized":"2023-08-17T00:13:10.145795+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144619+0000","last_change":"2023-08-17T00:13:10.139938+0000","last_active":"2023-08-17T00:13:10.144619+0000","last_peered":"2023-08-17T00:13:10.144619+0000","last_clean":"2023-08-17T00:13:10.144619+0000","last_became_active":"2023-08-17T00:13:10.139631+0000","last_became_peered":"2023-08-17T00:13:10.139631+0000","last_unstale":"2023-08-17T00:13:10.144619+0000","last_undegraded":"2023-08-17T00:13:10.144619+0000","last_fullsized":"2023-08-17T00:13:10.144619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146629+0000","last_change":"2023-08-17T00:13:09.717029+0000","last_active":"2023-08-17T00:13:10.146629+0000","last_peered":"2023-08-17T00:13:10.146629+0000","last_clean":"2023-08-17T00:13:10.146629+0000","last_became_active":"2023-08-17T00:13:09.716751+0000","last_became_peered":"2023-08-17T00:13:09.716751+0000","last_unstale":"2023-08-17T00:13:10.146629+0000","last_undegraded":"2023-08-17T00:13:10.146629+0000","last_fullsized":"2023-08-17T00:13:10.146629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149645+0000","last_change":"2023-08-17T00:13:10.145838+0000","last_active":"2023-08-17T00:13:10.149645+0000","last_peered":"2023-08-17T00:13:10.149645+0000","last_clean":"2023-08-17T00:13:10.149645+0000","last_became_active":"2023-08-17T00:13:10.145499+0000","last_became_peered":"2023-08-17T00:13:10.145499+0000","last_unstale":"2023-08-17T00:13:10.149645+0000","last_undegraded":"2023-08-17T00:13:10.149645+0000","last_fullsized":"2023-08-17T00:13:10.149645+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120333+0000","last_change":"2023-08-17T00:13:09.702990+0000","last_active":"2023-08-17T00:13:10.120333+0000","last_peered":"2023-08-17T00:13:10.120333+0000","last_clean":"2023-08-17T00:13:10.120333+0000","last_became_active":"2023-08-17T00:13:09.702687+0000","last_became_peered":"2023-08-17T00:13:09.702687+0000","last_unstale":"2023-08-17T00:13:10.120333+0000","last_undegraded":"2023-08-17T00:13:10.120333+0000","last_fullsized":"2023-08-17T00:13:10.120333+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150362+0000","last_change":"2023-08-17T00:13:10.143588+0000","last_active":"2023-08-17T00:13:10.150362+0000","last_peered":"2023-08-17T00:13:10.150362+0000","last_clean":"2023-08-17T00:13:10.150362+0000","last_became_active":"2023-08-17T00:13:10.143313+0000","last_became_peered":"2023-08-17T00:13:10.143313+0000","last_unstale":"2023-08-17T00:13:10.150362+0000","last_undegraded":"2023-08-17T00:13:10.150362+0000","last_fullsized":"2023-08-17T00:13:10.150362+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.122097+0000","last_change":"2023-08-17T00:13:09.705408+0000","last_active":"2023-08-17T00:13:10.122097+0000","last_peered":"2023-08-17T00:13:10.122097+0000","last_clean":"2023-08-17T00:13:10.122097+0000","last_became_active":"2023-08-17T00:13:09.705098+0000","last_became_peered":"2023-08-17T00:13:09.705098+0000","last_unstale":"2023-08-17T00:13:10.122097+0000","last_undegraded":"2023-08-17T00:13:10.122097+0000","last_fullsized":"2023-08-17T00:13:10.122097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.147292+0000","last_change":"2023-08-17T00:13:10.145736+0000","last_active":"2023-08-17T00:13:10.147292+0000","last_peered":"2023-08-17T00:13:10.147292+0000","last_clean":"2023-08-17T00:13:10.147292+0000","last_became_active":"2023-08-17T00:13:10.145458+0000","last_became_peered":"2023-08-17T00:13:10.145458+0000","last_unstale":"2023-08-17T00:13:10.147292+0000","last_undegraded":"2023-08-17T00:13:10.147292+0000","last_fullsized":"2023-08-17T00:13:10.147292+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153121+0000","last_change":"2023-08-17T00:13:09.712697+0000","last_active":"2023-08-17T00:13:10.153121+0000","last_peered":"2023-08-17T00:13:10.153121+0000","last_clean":"2023-08-17T00:13:10.153121+0000","last_became_active":"2023-08-17T00:13:09.712391+0000","last_became_peered":"2023-08-17T00:13:09.712391+0000","last_unstale":"2023-08-17T00:13:10.153121+0000","last_undegraded":"2023-08-17T00:13:10.153121+0000","last_fullsized":"2023-08-17T00:13:10.153121+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146208+0000","last_change":"2023-08-17T00:13:10.141394+0000","last_active":"2023-08-17T00:13:10.146208+0000","last_peered":"2023-08-17T00:13:10.146208+0000","last_clean":"2023-08-17T00:13:10.146208+0000","last_became_active":"2023-08-17T00:13:10.139413+0000","last_became_peered":"2023-08-17T00:13:10.139413+0000","last_unstale":"2023-08-17T00:13:10.146208+0000","last_undegraded":"2023-08-17T00:13:10.146208+0000","last_fullsized":"2023-08-17T00:13:10.146208+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120087+0000","last_change":"2023-08-17T00:13:09.704921+0000","last_active":"2023-08-17T00:13:10.120087+0000","last_peered":"2023-08-17T00:13:10.120087+0000","last_clean":"2023-08-17T00:13:10.120087+0000","last_became_active":"2023-08-17T00:13:09.704624+0000","last_became_peered":"2023-08-17T00:13:09.704624+0000","last_unstale":"2023-08-17T00:13:10.120087+0000","last_undegraded":"2023-08-17T00:13:10.120087+0000","last_fullsized":"2023-08-17T00:13:10.120087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149756+0000","last_change":"2023-08-17T00:13:10.139142+0000","last_active":"2023-08-17T00:13:10.149756+0000","last_peered":"2023-08-17T00:13:10.149756+0000","last_clean":"2023-08-17T00:13:10.149756+0000","last_became_active":"2023-08-17T00:13:10.137758+0000","last_became_peered":"2023-08-17T00:13:10.137758+0000","last_unstale":"2023-08-17T00:13:10.149756+0000","last_undegraded":"2023-08-17T00:13:10.149756+0000","last_fullsized":"2023-08-17T00:13:10.149756+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123562+0000","last_change":"2023-08-17T00:13:09.722713+0000","last_active":"2023-08-17T00:13:10.123562+0000","last_peered":"2023-08-17T00:13:10.123562+0000","last_clean":"2023-08-17T00:13:10.123562+0000","last_became_active":"2023-08-17T00:13:09.722260+0000","last_became_peered":"2023-08-17T00:13:09.722260+0000","last_unstale":"2023-08-17T00:13:10.123562+0000","last_undegraded":"2023-08-17T00:13:10.123562+0000","last_fullsized":"2023-08-17T00:13:10.123562+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144703+0000","last_change":"2023-08-17T00:13:10.139830+0000","last_active":"2023-08-17T00:13:10.144703+0000","last_peered":"2023-08-17T00:13:10.144703+0000","last_clean":"2023-08-17T00:13:10.144703+0000","last_became_active":"2023-08-17T00:13:10.139552+0000","last_became_peered":"2023-08-17T00:13:10.139552+0000","last_unstale":"2023-08-17T00:13:10.144703+0000","last_undegraded":"2023-08-17T00:13:10.144703+0000","last_fullsized":"2023-08-17T00:13:10.144703+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.128980+0000","last_change":"2023-08-17T00:13:09.713772+0000","last_active":"2023-08-17T00:13:10.128980+0000","last_peered":"2023-08-17T00:13:10.128980+0000","last_clean":"2023-08-17T00:13:10.128980+0000","last_became_active":"2023-08-17T00:13:09.713494+0000","last_became_peered":"2023-08-17T00:13:09.713494+0000","last_unstale":"2023-08-17T00:13:10.128980+0000","last_undegraded":"2023-08-17T00:13:10.128980+0000","last_fullsized":"2023-08-17T00:13:10.128980+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152146+0000","last_change":"2023-08-17T00:13:10.149871+0000","last_active":"2023-08-17T00:13:10.152146+0000","last_peered":"2023-08-17T00:13:10.152146+0000","last_clean":"2023-08-17T00:13:10.152146+0000","last_became_active":"2023-08-17T00:13:10.148974+0000","last_became_peered":"2023-08-17T00:13:10.148974+0000","last_unstale":"2023-08-17T00:13:10.152146+0000","last_undegraded":"2023-08-17T00:13:10.152146+0000","last_fullsized":"2023-08-17T00:13:10.152146+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149866+0000","last_change":"2023-08-17T00:13:09.710277+0000","last_active":"2023-08-17T00:13:10.149866+0000","last_peered":"2023-08-17T00:13:10.149866+0000","last_clean":"2023-08-17T00:13:10.149866+0000","last_became_active":"2023-08-17T00:13:09.709967+0000","last_became_peered":"2023-08-17T00:13:09.709967+0000","last_unstale":"2023-08-17T00:13:10.149866+0000","last_undegraded":"2023-08-17T00:13:10.149866+0000","last_fullsized":"2023-08-17T00:13:10.149866+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148163+0000","last_change":"2023-08-17T00:13:10.142795+0000","last_active":"2023-08-17T00:13:10.148163+0000","last_peered":"2023-08-17T00:13:10.148163+0000","last_clean":"2023-08-17T00:13:10.148163+0000","last_became_active":"2023-08-17T00:13:10.142517+0000","last_became_peered":"2023-08-17T00:13:10.142517+0000","last_unstale":"2023-08-17T00:13:10.148163+0000","last_undegraded":"2023-08-17T00:13:10.148163+0000","last_fullsized":"2023-08-17T00:13:10.148163+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.126719+0000","last_change":"2023-08-17T00:13:09.706589+0000","last_active":"2023-08-17T00:13:10.126719+0000","last_peered":"2023-08-17T00:13:10.126719+0000","last_clean":"2023-08-17T00:13:10.126719+0000","last_became_active":"2023-08-17T00:13:09.706237+0000","last_became_peered":"2023-08-17T00:13:09.706237+0000","last_unstale":"2023-08-17T00:13:10.126719+0000","last_undegraded":"2023-08-17T00:13:10.126719+0000","last_fullsized":"2023-08-17T00:13:10.126719+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152713+0000","last_change":"2023-08-17T00:13:10.141842+0000","last_active":"2023-08-17T00:13:10.152713+0000","last_peered":"2023-08-17T00:13:10.152713+0000","last_clean":"2023-08-17T00:13:10.152713+0000","last_became_active":"2023-08-17T00:13:10.141585+0000","last_became_peered":"2023-08-17T00:13:10.141585+0000","last_unstale":"2023-08-17T00:13:10.152713+0000","last_undegraded":"2023-08-17T00:13:10.152713+0000","last_fullsized":"2023-08-17T00:13:10.152713+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117737+0000","last_change":"2023-08-17T00:13:09.704483+0000","last_active":"2023-08-17T00:13:10.117737+0000","last_peered":"2023-08-17T00:13:10.117737+0000","last_clean":"2023-08-17T00:13:10.117737+0000","last_became_active":"2023-08-17T00:13:09.703730+0000","last_became_peered":"2023-08-17T00:13:09.703730+0000","last_unstale":"2023-08-17T00:13:10.117737+0000","last_undegraded":"2023-08-17T00:13:10.117737+0000","last_fullsized":"2023-08-17T00:13:10.117737+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144965+0000","last_change":"2023-08-17T00:13:10.143200+0000","last_active":"2023-08-17T00:13:10.144965+0000","last_peered":"2023-08-17T00:13:10.144965+0000","last_clean":"2023-08-17T00:13:10.144965+0000","last_became_active":"2023-08-17T00:13:10.142765+0000","last_became_peered":"2023-08-17T00:13:10.142765+0000","last_unstale":"2023-08-17T00:13:10.144965+0000","last_undegraded":"2023-08-17T00:13:10.144965+0000","last_fullsized":"2023-08-17T00:13:10.144965+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.128314+0000","last_change":"2023-08-17T00:13:09.708701+0000","last_active":"2023-08-17T00:13:10.128314+0000","last_peered":"2023-08-17T00:13:10.128314+0000","last_clean":"2023-08-17T00:13:10.128314+0000","last_became_active":"2023-08-17T00:13:09.708348+0000","last_became_peered":"2023-08-17T00:13:09.708348+0000","last_unstale":"2023-08-17T00:13:10.128314+0000","last_undegraded":"2023-08-17T00:13:10.128314+0000","last_fullsized":"2023-08-17T00:13:10.128314+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148158+0000","last_change":"2023-08-17T00:13:10.144652+0000","last_active":"2023-08-17T00:13:10.148158+0000","last_peered":"2023-08-17T00:13:10.148158+0000","last_clean":"2023-08-17T00:13:10.148158+0000","last_became_active":"2023-08-17T00:13:10.144316+0000","last_became_peered":"2023-08-17T00:13:10.144316+0000","last_unstale":"2023-08-17T00:13:10.148158+0000","last_undegraded":"2023-08-17T00:13:10.148158+0000","last_fullsized":"2023-08-17T00:13:10.148158+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125729+0000","last_change":"2023-08-17T00:13:09.718852+0000","last_active":"2023-08-17T00:13:10.125729+0000","last_peered":"2023-08-17T00:13:10.125729+0000","last_clean":"2023-08-17T00:13:10.125729+0000","last_became_active":"2023-08-17T00:13:09.718531+0000","last_became_peered":"2023-08-17T00:13:09.718531+0000","last_unstale":"2023-08-17T00:13:10.125729+0000","last_undegraded":"2023-08-17T00:13:10.125729+0000","last_fullsized":"2023-08-17T00:13:10.125729+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143561+0000","last_change":"2023-08-17T00:13:10.139228+0000","last_active":"2023-08-17T00:13:10.143561+0000","last_peered":"2023-08-17T00:13:10.143561+0000","last_clean":"2023-08-17T00:13:10.143561+0000","last_became_active":"2023-08-17T00:13:10.138796+0000","last_became_peered":"2023-08-17T00:13:10.138796+0000","last_unstale":"2023-08-17T00:13:10.143561+0000","last_undegraded":"2023-08-17T00:13:10.143561+0000","last_fullsized":"2023-08-17T00:13:10.143561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.126107+0000","last_change":"2023-08-17T00:13:09.722082+0000","last_active":"2023-08-17T00:13:10.126107+0000","last_peered":"2023-08-17T00:13:10.126107+0000","last_clean":"2023-08-17T00:13:10.126107+0000","last_became_active":"2023-08-17T00:13:09.721794+0000","last_became_peered":"2023-08-17T00:13:09.721794+0000","last_unstale":"2023-08-17T00:13:10.126107+0000","last_undegraded":"2023-08-17T00:13:10.126107+0000","last_fullsized":"2023-08-17T00:13:10.126107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143677+0000","last_change":"2023-08-17T00:13:10.141732+0000","last_active":"2023-08-17T00:13:10.143677+0000","last_peered":"2023-08-17T00:13:10.143677+0000","last_clean":"2023-08-17T00:13:10.143677+0000","last_became_active":"2023-08-17T00:13:10.141380+0000","last_became_peered":"2023-08-17T00:13:10.141380+0000","last_unstale":"2023-08-17T00:13:10.143677+0000","last_undegraded":"2023-08-17T00:13:10.143677+0000","last_fullsized":"2023-08-17T00:13:10.143677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127395+0000","last_change":"2023-08-17T00:13:09.717558+0000","last_active":"2023-08-17T00:13:10.127395+0000","last_peered":"2023-08-17T00:13:10.127395+0000","last_clean":"2023-08-17T00:13:10.127395+0000","last_became_active":"2023-08-17T00:13:09.717281+0000","last_became_peered":"2023-08-17T00:13:09.717281+0000","last_unstale":"2023-08-17T00:13:10.127395+0000","last_undegraded":"2023-08-17T00:13:10.127395+0000","last_fullsized":"2023-08-17T00:13:10.127395+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144671+0000","last_change":"2023-08-17T00:13:10.133242+0000","last_active":"2023-08-17T00:13:10.144671+0000","last_peered":"2023-08-17T00:13:10.144671+0000","last_clean":"2023-08-17T00:13:10.144671+0000","last_became_active":"2023-08-17T00:13:10.130866+0000","last_became_peered":"2023-08-17T00:13:10.130866+0000","last_unstale":"2023-08-17T00:13:10.144671+0000","last_undegraded":"2023-08-17T00:13:10.144671+0000","last_fullsized":"2023-08-17T00:13:10.144671+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.129607+0000","last_change":"2023-08-17T00:13:09.721642+0000","last_active":"2023-08-17T00:13:10.129607+0000","last_peered":"2023-08-17T00:13:10.129607+0000","last_clean":"2023-08-17T00:13:10.129607+0000","last_became_active":"2023-08-17T00:13:09.721335+0000","last_became_peered":"2023-08-17T00:13:09.721335+0000","last_unstale":"2023-08-17T00:13:10.129607+0000","last_undegraded":"2023-08-17T00:13:10.129607+0000","last_fullsized":"2023-08-17T00:13:10.129607+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.147318+0000","last_change":"2023-08-17T00:13:10.145338+0000","last_active":"2023-08-17T00:13:10.147318+0000","last_peered":"2023-08-17T00:13:10.147318+0000","last_clean":"2023-08-17T00:13:10.147318+0000","last_became_active":"2023-08-17T00:13:10.145053+0000","last_became_peered":"2023-08-17T00:13:10.145053+0000","last_unstale":"2023-08-17T00:13:10.147318+0000","last_undegraded":"2023-08-17T00:13:10.147318+0000","last_fullsized":"2023-08-17T00:13:10.147318+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124215+0000","last_change":"2023-08-17T00:13:09.703795+0000","last_active":"2023-08-17T00:13:10.124215+0000","last_peered":"2023-08-17T00:13:10.124215+0000","last_clean":"2023-08-17T00:13:10.124215+0000","last_became_active":"2023-08-17T00:13:09.703457+0000","last_became_peered":"2023-08-17T00:13:09.703457+0000","last_unstale":"2023-08-17T00:13:10.124215+0000","last_undegraded":"2023-08-17T00:13:10.124215+0000","last_fullsized":"2023-08-17T00:13:10.124215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.118142+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:13:10.118142+0000","last_peered":"2023-08-17T00:13:10.118142+0000","last_clean":"2023-08-17T00:13:10.118142+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:13:10.118142+0000","last_undegraded":"2023-08-17T00:13:10.118142+0000","last_fullsized":"2023-08-17T00:13:10.118142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149720+0000","last_change":"2023-08-17T00:13:10.138302+0000","last_active":"2023-08-17T00:13:10.149720+0000","last_peered":"2023-08-17T00:13:10.149720+0000","last_clean":"2023-08-17T00:13:10.149720+0000","last_became_active":"2023-08-17T00:13:10.138028+0000","last_became_peered":"2023-08-17T00:13:10.138028+0000","last_unstale":"2023-08-17T00:13:10.149720+0000","last_undegraded":"2023-08-17T00:13:10.149720+0000","last_fullsized":"2023-08-17T00:13:10.149720+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124779+0000","last_change":"2023-08-17T00:13:09.715879+0000","last_active":"2023-08-17T00:13:10.124779+0000","last_peered":"2023-08-17T00:13:10.124779+0000","last_clean":"2023-08-17T00:13:10.124779+0000","last_became_active":"2023-08-17T00:13:09.715627+0000","last_became_peered":"2023-08-17T00:13:09.715627+0000","last_unstale":"2023-08-17T00:13:10.124779+0000","last_undegraded":"2023-08-17T00:13:10.124779+0000","last_fullsized":"2023-08-17T00:13:10.124779+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124304+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:13:10.124304+0000","last_peered":"2023-08-17T00:13:10.124304+0000","last_clean":"2023-08-17T00:13:10.124304+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:13:10.124304+0000","last_undegraded":"2023-08-17T00:13:10.124304+0000","last_fullsized":"2023-08-17T00:13:10.124304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152633+0000","last_change":"2023-08-17T00:13:10.141097+0000","last_active":"2023-08-17T00:13:10.152633+0000","last_peered":"2023-08-17T00:13:10.152633+0000","last_clean":"2023-08-17T00:13:10.152633+0000","last_became_active":"2023-08-17T00:13:10.140794+0000","last_became_peered":"2023-08-17T00:13:10.140794+0000","last_unstale":"2023-08-17T00:13:10.152633+0000","last_undegraded":"2023-08-17T00:13:10.152633+0000","last_fullsized":"2023-08-17T00:13:10.152633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152530+0000","last_change":"2023-08-17T00:13:09.721055+0000","last_active":"2023-08-17T00:13:10.152530+0000","last_peered":"2023-08-17T00:13:10.152530+0000","last_clean":"2023-08-17T00:13:10.152530+0000","last_became_active":"2023-08-17T00:13:09.720403+0000","last_became_peered":"2023-08-17T00:13:09.720403+0000","last_unstale":"2023-08-17T00:13:10.152530+0000","last_undegraded":"2023-08-17T00:13:10.152530+0000","last_fullsized":"2023-08-17T00:13:10.152530+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117999+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:13:10.117999+0000","last_peered":"2023-08-17T00:13:10.117999+0000","last_clean":"2023-08-17T00:13:10.117999+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:13:10.117999+0000","last_undegraded":"2023-08-17T00:13:10.117999+0000","last_fullsized":"2023-08-17T00:13:10.117999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150050+0000","last_change":"2023-08-17T00:13:10.144544+0000","last_active":"2023-08-17T00:13:10.150050+0000","last_peered":"2023-08-17T00:13:10.150050+0000","last_clean":"2023-08-17T00:13:10.150050+0000","last_became_active":"2023-08-17T00:13:10.144287+0000","last_became_peered":"2023-08-17T00:13:10.144287+0000","last_unstale":"2023-08-17T00:13:10.150050+0000","last_undegraded":"2023-08-17T00:13:10.150050+0000","last_fullsized":"2023-08-17T00:13:10.150050+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150635+0000","last_change":"2023-08-17T00:13:09.702572+0000","last_active":"2023-08-17T00:13:10.150635+0000","last_peered":"2023-08-17T00:13:10.150635+0000","last_clean":"2023-08-17T00:13:10.150635+0000","last_became_active":"2023-08-17T00:13:09.702233+0000","last_became_peered":"2023-08-17T00:13:09.702233+0000","last_unstale":"2023-08-17T00:13:10.150635+0000","last_undegraded":"2023-08-17T00:13:10.150635+0000","last_fullsized":"2023-08-17T00:13:10.150635+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125354+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:13:10.125354+0000","last_peered":"2023-08-17T00:13:10.125354+0000","last_clean":"2023-08-17T00:13:10.125354+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:13:10.125354+0000","last_undegraded":"2023-08-17T00:13:10.125354+0000","last_fullsized":"2023-08-17T00:13:10.125354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144542+0000","last_change":"2023-08-17T00:13:10.138381+0000","last_active":"2023-08-17T00:13:10.144542+0000","last_peered":"2023-08-17T00:13:10.144542+0000","last_clean":"2023-08-17T00:13:10.144542+0000","last_became_active":"2023-08-17T00:13:10.138124+0000","last_became_peered":"2023-08-17T00:13:10.138124+0000","last_unstale":"2023-08-17T00:13:10.144542+0000","last_undegraded":"2023-08-17T00:13:10.144542+0000","last_fullsized":"2023-08-17T00:13:10.144542+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.13","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144042+0000","last_change":"2023-08-17T00:13:09.708713+0000","last_active":"2023-08-17T00:13:10.144042+0000","last_peered":"2023-08-17T00:13:10.144042+0000","last_clean":"2023-08-17T00:13:10.144042+0000","last_became_active":"2023-08-17T00:13:09.708443+0000","last_became_peered":"2023-08-17T00:13:09.708443+0000","last_unstale":"2023-08-17T00:13:10.144042+0000","last_undegraded":"2023-08-17T00:13:10.144042+0000","last_fullsized":"2023-08-17T00:13:10.144042+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117078+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:13:10.117078+0000","last_peered":"2023-08-17T00:13:10.117078+0000","last_clean":"2023-08-17T00:13:10.117078+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:13:10.117078+0000","last_undegraded":"2023-08-17T00:13:10.117078+0000","last_fullsized":"2023-08-17T00:13:10.117078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152197+0000","last_change":"2023-08-17T00:13:10.150737+0000","last_active":"2023-08-17T00:13:10.152197+0000","last_peered":"2023-08-17T00:13:10.152197+0000","last_clean":"2023-08-17T00:13:10.152197+0000","last_became_active":"2023-08-17T00:13:10.150428+0000","last_became_peered":"2023-08-17T00:13:10.150428+0000","last_unstale":"2023-08-17T00:13:10.152197+0000","last_undegraded":"2023-08-17T00:13:10.152197+0000","last_fullsized":"2023-08-17T00:13:10.152197+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153508+0000","last_change":"2023-08-17T00:13:09.723948+0000","last_active":"2023-08-17T00:13:10.153508+0000","last_peered":"2023-08-17T00:13:10.153508+0000","last_clean":"2023-08-17T00:13:10.153508+0000","last_became_active":"2023-08-17T00:13:09.723616+0000","last_became_peered":"2023-08-17T00:13:09.723616+0000","last_unstale":"2023-08-17T00:13:10.153508+0000","last_undegraded":"2023-08-17T00:13:10.153508+0000","last_fullsized":"2023-08-17T00:13:10.153508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.131404+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:13:10.131404+0000","last_peered":"2023-08-17T00:13:10.131404+0000","last_clean":"2023-08-17T00:13:10.131404+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:13:10.131404+0000","last_undegraded":"2023-08-17T00:13:10.131404+0000","last_fullsized":"2023-08-17T00:13:10.131404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149740+0000","last_change":"2023-08-17T00:13:10.146467+0000","last_active":"2023-08-17T00:13:10.149740+0000","last_peered":"2023-08-17T00:13:10.149740+0000","last_clean":"2023-08-17T00:13:10.149740+0000","last_became_active":"2023-08-17T00:13:10.146215+0000","last_became_peered":"2023-08-17T00:13:10.146215+0000","last_unstale":"2023-08-17T00:13:10.149740+0000","last_undegraded":"2023-08-17T00:13:10.149740+0000","last_fullsized":"2023-08-17T00:13:10.149740+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123413+0000","last_change":"2023-08-17T00:13:09.710007+0000","last_active":"2023-08-17T00:13:10.123413+0000","last_peered":"2023-08-17T00:13:10.123413+0000","last_clean":"2023-08-17T00:13:10.123413+0000","last_became_active":"2023-08-17T00:13:09.709726+0000","last_became_peered":"2023-08-17T00:13:09.709726+0000","last_unstale":"2023-08-17T00:13:10.123413+0000","last_undegraded":"2023-08-17T00:13:10.123413+0000","last_fullsized":"2023-08-17T00:13:10.123413+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117697+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:13:10.117697+0000","last_peered":"2023-08-17T00:13:10.117697+0000","last_clean":"2023-08-17T00:13:10.117697+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:13:10.117697+0000","last_undegraded":"2023-08-17T00:13:10.117697+0000","last_fullsized":"2023-08-17T00:13:10.117697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150197+0000","last_change":"2023-08-17T00:13:10.147360+0000","last_active":"2023-08-17T00:13:10.150197+0000","last_peered":"2023-08-17T00:13:10.150197+0000","last_clean":"2023-08-17T00:13:10.150197+0000","last_became_active":"2023-08-17T00:13:10.147105+0000","last_became_peered":"2023-08-17T00:13:10.147105+0000","last_unstale":"2023-08-17T00:13:10.150197+0000","last_undegraded":"2023-08-17T00:13:10.150197+0000","last_fullsized":"2023-08-17T00:13:10.150197+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.116969+0000","last_change":"2023-08-17T00:13:09.711131+0000","last_active":"2023-08-17T00:13:10.116969+0000","last_peered":"2023-08-17T00:13:10.116969+0000","last_clean":"2023-08-17T00:13:10.116969+0000","last_became_active":"2023-08-17T00:13:09.710806+0000","last_became_peered":"2023-08-17T00:13:09.710806+0000","last_unstale":"2023-08-17T00:13:10.116969+0000","last_undegraded":"2023-08-17T00:13:10.116969+0000","last_fullsized":"2023-08-17T00:13:10.116969+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.118318+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:13:10.118318+0000","last_peered":"2023-08-17T00:13:10.118318+0000","last_clean":"2023-08-17T00:13:10.118318+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:13:10.118318+0000","last_undegraded":"2023-08-17T00:13:10.118318+0000","last_fullsized":"2023-08-17T00:13:10.118318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125759+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:13:10.125759+0000","last_peered":"2023-08-17T00:13:10.125759+0000","last_clean":"2023-08-17T00:13:10.125759+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:13:10.125759+0000","last_undegraded":"2023-08-17T00:13:10.125759+0000","last_fullsized":"2023-08-17T00:13:10.125759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542272,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311212,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060628,"statfs":{"total":96636764160,"available":96318083072,"internally_reserved":0,"allocated":1740800,"data_stored":815343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.2090000000000001},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2210000000000001,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":1.2250000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.036,"15min":1.2529999999999999},"min":{"1min":0.57899999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3169999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":1.1970000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0580000000000001,"15min":1.272},"min":{"1min":0.627,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.2769999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.097,"15min":1.2749999999999999},"min":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":0.995}]},{"osd":2,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.028,"15min":1.1819999999999999},"min":{"1min":0.65200000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.276,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.048},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.1240000000000001,"15min":1.3169999999999999},"min":{"1min":0.629,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.4199999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.325}]},{"osd":3,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.095,"15min":1.226},"min":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2509999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1819999999999999,"15min":1.4790000000000001},"min":{"1min":0.78100000000000003,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.359,"5min":1.952,"15min":13.074999999999999},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1539999999999999,"15min":1.4350000000000001},"min":{"1min":0.70799999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.3799999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1279999999999999,"15min":1.3700000000000001},"min":{"1min":0.80200000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3380000000000001,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.302}]},{"osd":5,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.226,"15min":1.5569999999999999},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.9830000000000001,"15min":14.435},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.226,"15min":1.526},"min":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.502,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.1200000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2969999999999999,"15min":1.556},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5920000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.274},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.2270000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.411,"5min":2.4350000000000001,"15min":11.365},"last":0.90000000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542272,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311216,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060624,"statfs":{"total":96636764160,"available":96318078976,"internally_reserved":0,"allocated":1744896,"data_stored":815377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.032,"15min":1.056},"min":{"1min":0.53800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.367,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":1.405},{"interface":"front","average":{"1min":1.056,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":10.519,"15min":10.519},"last":0.89600000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.147,"15min":1.143},"min":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.3500000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.099},{"interface":"front","average":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4530000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":0.91800000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1319999999999999,"15min":1.161},"min":{"1min":0.71199999999999997,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.506,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2909999999999999,"15min":1.2809999999999999},"min":{"1min":0.72999999999999998,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5489999999999999,"5min":10.669,"15min":10.669},"last":1.2709999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.119,"15min":1.171},"min":{"1min":0.81000000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5860000000000001,"5min":1.9319999999999999,"15min":11.475},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.2310000000000001,"15min":1.252},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.222}]},{"osd":4,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.296,"15min":1.278},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.571,"5min":10.632,"15min":10.632},"last":1.016},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.2,"15min":1.236},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.7350000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":1}]},{"osd":5,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.80500000000000005,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.5880000000000001,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.038},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.413,"15min":1.3720000000000001},"min":{"1min":0.89000000000000001,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.7310000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.381}]},{"osd":7,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2969999999999999,"15min":1.329},"min":{"1min":0.77400000000000002,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.788,"5min":3.3450000000000002,"15min":11.51},"last":1.075},{"interface":"front","average":{"1min":1.286,"5min":1.377,"15min":1.4019999999999999},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.704,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.3140000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.3220000000000001},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4870000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.383},{"interface":"front","average":{"1min":1.155,"5min":1.0349999999999999,"15min":1.4350000000000001},"min":{"1min":0.67500000000000004,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0389999999999999,"15min":1.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.423,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":1.331},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.113,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.5760000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.131}]},{"osd":2,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.153,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.2750000000000004,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.3879999999999999},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.60299999999999998},"max":{"1min":1.522,"5min":1.796,"15min":11.949},"last":1.2410000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.171,"15min":1.4399999999999999},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":13.125},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1799999999999999,"15min":1.3740000000000001},"min":{"1min":0.82399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.306,"5min":2.306,"15min":8.4809999999999999},"last":1.4950000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.532},"min":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.458,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.2310000000000001,"15min":1.6579999999999999},"min":{"1min":0.78300000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.4079999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.236,"15min":1.627},"min":{"1min":0.81499999999999995,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":1.627},"min":{"1min":0.92900000000000005,"5min":0.68600000000000005,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.454}]},{"osd":7,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3240000000000001,"15min":1.742},"min":{"1min":0.94999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.2130000000000001,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.345,"15min":1.6839999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0019999999999998,"5min":2.0899999999999999,"15min":14.818},"last":1.5469999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542272,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307116,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064724,"statfs":{"total":96636764160,"available":96322277376,"internally_reserved":0,"allocated":1740800,"data_stored":815343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3320000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.194,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.0600000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.81100000000000005},"min":{"1min":0.53700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.423,"5min":11.215999999999999,"15min":11.215999999999999},"last":1.345},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.83899999999999997,"15min":0.90200000000000002},"min":{"1min":0.47499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.2869999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":1.587},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.433,"15min":0.433},"max":{"1min":1.359,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.2589999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.198},"min":{"1min":0.74199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.498,"5min":2.274,"15min":3.9449999999999998},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.143,"15min":1.206},"min":{"1min":0.749,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5860000000000001,"5min":1.649,"15min":3.9790000000000001},"last":1.516}]},{"osd":5,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1200000000000001,"15min":1.2090000000000001},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.89000000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6459999999999999,"5min":1.669,"15min":2.6789999999999998},"last":1.53}]},{"osd":6,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1399999999999999,"15min":1.236},"min":{"1min":0.629,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.603,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.403},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.206},"min":{"1min":0.83099999999999996,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.6899999999999999,"5min":2.0979999999999999,"15min":3.585},"last":1.373}]},{"osd":7,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.206,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.6319999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.2310000000000001},"min":{"1min":0.84499999999999997,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.679,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.147}]}]},{"osd":2,"up_from":14,"seq":60129542272,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.748,"15min":0.82299999999999995},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.103,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77000000000000002,"15min":0.91800000000000004},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.278,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.79700000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.879},"min":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.327,"5min":2.097,"15min":3.7589999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.044,"5min":0.92100000000000004,"15min":1.036},"min":{"1min":0.62,"5min":0.376,"15min":0.376},"max":{"1min":1.54,"5min":1.54,"15min":3.911},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.90100000000000002,"15min":1.0980000000000001},"min":{"1min":0.66800000000000004,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88400000000000001,"15min":0.97699999999999998},"min":{"1min":0.59599999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.4049999999999998,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.5149999999999999},"min":{"1min":0.70499999999999996,"5min":0.69999999999999996,"15min":0.48399999999999999},"max":{"1min":1.51,"5min":1.794,"15min":16.521000000000001},"last":1.089},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.4239999999999999},"min":{"1min":0.79000000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":8.4399999999999995},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.258,"15min":1.5529999999999999},"min":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.873,"5min":1.873,"15min":12.914},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.206,"15min":1.405},"min":{"1min":0.84999999999999998,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.4690000000000001,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.119}]},{"osd":6,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1459999999999999,"15min":1.4910000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.615,"5min":1.621,"15min":13.864000000000001},"last":1.024},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.248,"15min":1.55},"min":{"1min":0.92600000000000005,"5min":0.84499999999999997,"15min":0.71799999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.3540000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2649999999999999,"15min":1.528},"min":{"1min":0.86599999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.609,"5min":2.6779999999999999,"15min":10.592000000000001},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.5389999999999999},"min":{"1min":0.93899999999999995,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.694,"5min":1.9159999999999999,"15min":11.417},"last":1.228}]}]},{"osd":1,"up_from":14,"seq":60129542272,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303036,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068804,"statfs":{"total":96636764160,"available":96326455296,"internally_reserved":0,"allocated":1757184,"data_stored":816969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.298,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.90100000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2170000000000001,"5min":1.367,"15min":13.093},"last":1.0800000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.76500000000000001,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.3420000000000001,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.89000000000000001},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.365,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94699999999999995,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.4630000000000001,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.032},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.86099999999999999,"15min":0.96399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.26,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.878}]},{"osd":4,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.036,"15min":1.1539999999999999},"min":{"1min":0.68300000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.671,"5min":1.671,"15min":20.548999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.125,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.764,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.125}]},{"osd":5,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1870000000000001,"15min":1.3140000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5309999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1799999999999999,"15min":1.2529999999999999},"min":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7470000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3340000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.2569999999999999},"min":{"1min":0.81000000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.157},{"interface":"front","average":{"1min":1.181,"5min":1.1599999999999999,"15min":1.21},"min":{"1min":0.92300000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":1.6990000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.4039999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.25,"15min":1.3129999999999999},"min":{"1min":0.97699999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.9179999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.363},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.3440000000000001},"min":{"1min":0.91000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.6399999999999999,"5min":3.4180000000000001,"15min":13.131},"last":1.3049999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307136,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064704,"statfs":{"total":96636764160,"available":96322256896,"internally_reserved":0,"allocated":1761280,"data_stored":817523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.83799999999999997},"min":{"1min":0.45700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.4830000000000001,"5min":18.442,"15min":18.442},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89800000000000002,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.5669999999999999,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.04,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.208,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.87},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.5840000000000001,"5min":1.613,"15min":1.613},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.167,"15min":1.0700000000000001},"min":{"1min":0.63900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.9079999999999999,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.03}]},{"osd":4,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.7609999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.343,"15min":1.2529999999999999},"min":{"1min":0.80000000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4099999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.3340000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3799999999999999,"15min":1.304},"min":{"1min":0.88,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.9199999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.357},{"interface":"front","average":{"1min":1.272,"5min":1.2010000000000001,"15min":1.2529999999999999},"min":{"1min":0.85799999999999998,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.754,"5min":1.984,"15min":1.984},"last":1.155}]},{"osd":6,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3759999999999999,"15min":1.3169999999999999},"min":{"1min":1.081,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6859999999999999,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.407},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.1399999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3959999999999999,"15min":1.3080000000000001},"min":{"1min":0.94999999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6579999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.93200000000000005,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.786,"5min":1.804,"15min":2.0750000000000002},"last":1.3120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574977,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0349999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.2889999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.097,"15min":1.069},"min":{"1min":0.62,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":2.5539999999999998,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5229999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.089},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1819999999999999,"15min":1.242},"min":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5129999999999999,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":0.91300000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.236},"min":{"1min":0.74199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7030000000000001,"5min":6.6500000000000004,"15min":18.431000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.3340000000000001},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.623,"5min":1.738,"15min":36.531999999999996},"last":1.141}]},{"osd":3,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0980000000000001,"15min":1.133},"min":{"1min":0.751,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.996},{"interface":"front","average":{"1min":1.155,"5min":1.2290000000000001,"15min":1.411},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.40400000000000003},"max":{"1min":1.7569999999999999,"5min":6.6920000000000002,"15min":36.530000000000001},"last":0.95799999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.23,"15min":1.246},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.462,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.046},{"interface":"front","average":{"1min":1.244,"5min":1.268,"15min":1.302},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":3.2519999999999998,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.181}]},{"osd":6,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3520000000000001},"min":{"1min":0.73199999999999998,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.6080000000000001,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.345},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3049999999999999,"15min":1.403},"min":{"1min":0.81399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.526,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.371}]},{"osd":7,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.21,"15min":1.2829999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.4179999999999999},"min":{"1min":0.68600000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.8009999999999999,"5min":6.7430000000000003,"15min":8.327},"last":1.405}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:13:16.791 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:13:16.800 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:13:19.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:13:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 Processor -- start 2023-08-17T00:13:19.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 -- start start 2023-08-17T00:13:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe11c151630 0x7fe11c0bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c1553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe11c062c90 con 0x7fe11c151a10 2023-08-17T00:13:19.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe11c0657d0 con 0x7fe11c151630 2023-08-17T00:13:19.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.444+0000 7fe1218db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c0665e0 con 0x7fe11c066130 2023-08-17T00:13:19.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe11c151630 0x7fe11c0bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe11c151630 0x7fe11c0bbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51642/0 (socket says 172.21.15.153:51642) 2023-08-17T00:13:19.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 -- 172.21.15.153:0/3682389882 learned_addr learned my addr 172.21.15.153:0/3682389882 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:19.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11b7fe700 1 --2- 172.21.15.153:0/3682389882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c1553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 -- 172.21.15.153:0/3682389882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 msgr2=0x7fe11c1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:19.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 --2- 172.21.15.153:0/3682389882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c1553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 -- 172.21.15.153:0/3682389882 >> v1:172.21.15.178:6789/0 conn(0x7fe11c151a10 legacy=0x7fe11c063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 -- 172.21.15.153:0/3682389882 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe11c062980 con 0x7fe11c151630 2023-08-17T00:13:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11affd700 1 --2- 172.21.15.153:0/3682389882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c0bbd50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fe10c006fd0 tx=0x7fe10c0090f0).ready entity=mon.0 client_cookie=10a96f3404e213c6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11a7fc700 1 -- 172.21.15.153:0/3682389882 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00b580 con 0x7fe11c151630 2023-08-17T00:13:19.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11a7fc700 1 -- 172.21.15.153:0/3682389882 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe10c00b6e0 con 0x7fe11c151630 2023-08-17T00:13:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe11a7fc700 1 -- 172.21.15.153:0/3682389882 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00ba80 con 0x7fe11c151630 2023-08-17T00:13:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 -- 172.21.15.153:0/3682389882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 msgr2=0x7fe11c0bbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 --2- 172.21.15.153:0/3682389882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c0bbd50 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 rx=0x7fe10c006fd0 tx=0x7fe10c0090f0).stop 2023-08-17T00:13:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 -- 172.21.15.153:0/3682389882 shutdown_connections 2023-08-17T00:13:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 --2- 172.21.15.153:0/3682389882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c1553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 --2- 172.21.15.153:0/3682389882 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c0bbd50 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 -- 172.21.15.153:0/3682389882 >> 172.21.15.153:0/3682389882 conn(0x7fe11c0c2fb0 msgr2=0x7fe11c0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 -- 172.21.15.153:0/3682389882 shutdown_connections 2023-08-17T00:13:19.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.448+0000 7fe1218db700 1 -- 172.21.15.153:0/3682389882 wait complete. 2023-08-17T00:13:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.452+0000 7fe1218db700 1 Processor -- start 2023-08-17T00:13:19.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.452+0000 7fe1218db700 1 -- start start 2023-08-17T00:13:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c164ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe11c151a10 0x7fe11c165390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c154440 con 0x7fe11c151630 2023-08-17T00:13:19.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c153830 con 0x7fe11c151a10 2023-08-17T00:13:19.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe11c153b10 con 0x7fe11c066130 2023-08-17T00:13:19.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c164ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c164ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51646/0 (socket says 172.21.15.153:51646) 2023-08-17T00:13:19.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 -- 172.21.15.153:0/1509054919 learned_addr learned my addr 172.21.15.153:0/1509054919 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:19.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe11b7fe700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe11c151a10 0x7fe11c165390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe11affd700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 -- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 msgr2=0x7fe11c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 -- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe11c151a10 msgr2=0x7fe11c165390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe11c151a10 0x7fe11c165390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 -- 172.21.15.153:0/1509054919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c009370 con 0x7fe11c151630 2023-08-17T00:13:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe113fff700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c164ea0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fe10400c440 tx=0x7fe104007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104007020 con 0x7fe11c151630 2023-08-17T00:13:19.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe104007180 con 0x7fe11c151630 2023-08-17T00:13:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe11c153df0 con 0x7fe11c151630 2023-08-17T00:13:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe104007520 con 0x7fe11c151630 2023-08-17T00:13:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.456+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe11c164950 con 0x7fe11c151630 2023-08-17T00:13:19.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.460+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe11c1545f0 con 0x7fe11c151630 2023-08-17T00:13:19.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.460+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe104010070 con 0x7fe11c151630 2023-08-17T00:13:19.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.464+0000 7fe112ffd700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0fc05a150 0x7fe0fc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.464+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe104073240 con 0x7fe11c151630 2023-08-17T00:13:19.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.464+0000 7fe11affd700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0fc05a150 0x7fe0fc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.464+0000 7fe11affd700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0fc05a150 0x7fe0fc05c610 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fe10c00b340 tx=0x7fe10c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:19.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.472+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe11c1545f0 con 0x7fe11c151630 2023-08-17T00:13:19.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.632+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe11c06b4c0 con 0x7fe0fc05a150 2023-08-17T00:13:19.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.652+0000 7fe112ffd700 1 -- 172.21.15.153:0/1509054919 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359880 (secure 0 0 0) 0x7fe11c06b4c0 con 0x7fe0fc05a150 2023-08-17T00:13:19.661 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:19.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0fc05a150 msgr2=0x7fe0fc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0fc05a150 0x7fe0fc05c610 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fe10c00b340 tx=0x7fe10c017000).stop 2023-08-17T00:13:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 msgr2=0x7fe11c164ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c164ea0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 rx=0x7fe10400c440 tx=0x7fe104007e00).stop 2023-08-17T00:13:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 shutdown_connections 2023-08-17T00:13:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe0fc05a150 0x7fe0fc05c610 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe11c151a10 0x7fe11c165390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe11c151630 0x7fe11c164ea0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 --2- 172.21.15.153:0/1509054919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe11c066130 0x7fe11c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 >> 172.21.15.153:0/1509054919 conn(0x7fe11c0c2fb0 msgr2=0x7fe11c0646d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 shutdown_connections 2023-08-17T00:13:19.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.660+0000 7fe1218db700 1 -- 172.21.15.153:0/1509054919 wait complete. 2023-08-17T00:13:19.669 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:13:19.685 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2023-08-17T00:13:19.410616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":274,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461088,"kb_used_data":13664,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752513632,"statfs":{"total":773094113280,"available":770573959168,"internally_reserved":0,"allocated":13991936,"data_stored":6527356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1077797708,"num_objects":-1061,"num_object_clones":0,"num_object_copies":-2122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1061,"num_whiteouts":0,"num_read":-33,"num_read_kb":0,"num_write":-3337,"num_write_kb":-1053773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.220900"},"pg_stats":[{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146255+0000","last_change":"2023-08-17T00:13:10.134981+0000","last_active":"2023-08-17T00:13:10.146255+0000","last_peered":"2023-08-17T00:13:10.146255+0000","last_clean":"2023-08-17T00:13:10.146255+0000","last_became_active":"2023-08-17T00:13:10.134555+0000","last_became_peered":"2023-08-17T00:13:10.134555+0000","last_unstale":"2023-08-17T00:13:10.146255+0000","last_undegraded":"2023-08-17T00:13:10.146255+0000","last_fullsized":"2023-08-17T00:13:10.146255+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3f","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149796+0000","last_change":"2023-08-17T00:13:09.705113+0000","last_active":"2023-08-17T00:13:10.149796+0000","last_peered":"2023-08-17T00:13:10.149796+0000","last_clean":"2023-08-17T00:13:10.149796+0000","last_became_active":"2023-08-17T00:13:09.704804+0000","last_became_peered":"2023-08-17T00:13:09.704804+0000","last_unstale":"2023-08-17T00:13:10.149796+0000","last_undegraded":"2023-08-17T00:13:10.149796+0000","last_fullsized":"2023-08-17T00:13:10.149796+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.141389+0000","last_change":"2023-08-17T00:13:10.135682+0000","last_active":"2023-08-17T00:13:10.141389+0000","last_peered":"2023-08-17T00:13:10.141389+0000","last_clean":"2023-08-17T00:13:10.141389+0000","last_became_active":"2023-08-17T00:13:10.133859+0000","last_became_peered":"2023-08-17T00:13:10.133859+0000","last_unstale":"2023-08-17T00:13:10.141389+0000","last_undegraded":"2023-08-17T00:13:10.141389+0000","last_fullsized":"2023-08-17T00:13:10.141389+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125940+0000","last_change":"2023-08-17T00:13:09.705945+0000","last_active":"2023-08-17T00:13:10.125940+0000","last_peered":"2023-08-17T00:13:10.125940+0000","last_clean":"2023-08-17T00:13:10.125940+0000","last_became_active":"2023-08-17T00:13:09.704883+0000","last_became_peered":"2023-08-17T00:13:09.704883+0000","last_unstale":"2023-08-17T00:13:10.125940+0000","last_undegraded":"2023-08-17T00:13:10.125940+0000","last_fullsized":"2023-08-17T00:13:10.125940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153212+0000","last_change":"2023-08-17T00:13:10.152576+0000","last_active":"2023-08-17T00:13:10.153212+0000","last_peered":"2023-08-17T00:13:10.153212+0000","last_clean":"2023-08-17T00:13:10.153212+0000","last_became_active":"2023-08-17T00:13:10.152282+0000","last_became_peered":"2023-08-17T00:13:10.152282+0000","last_unstale":"2023-08-17T00:13:10.153212+0000","last_undegraded":"2023-08-17T00:13:10.153212+0000","last_fullsized":"2023-08-17T00:13:10.153212+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117881+0000","last_change":"2023-08-17T00:13:09.706433+0000","last_active":"2023-08-17T00:13:10.117881+0000","last_peered":"2023-08-17T00:13:10.117881+0000","last_clean":"2023-08-17T00:13:10.117881+0000","last_became_active":"2023-08-17T00:13:09.703789+0000","last_became_peered":"2023-08-17T00:13:09.703789+0000","last_unstale":"2023-08-17T00:13:10.117881+0000","last_undegraded":"2023-08-17T00:13:10.117881+0000","last_fullsized":"2023-08-17T00:13:10.117881+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150382+0000","last_change":"2023-08-17T00:13:10.143971+0000","last_active":"2023-08-17T00:13:10.150382+0000","last_peered":"2023-08-17T00:13:10.150382+0000","last_clean":"2023-08-17T00:13:10.150382+0000","last_became_active":"2023-08-17T00:13:10.143673+0000","last_became_peered":"2023-08-17T00:13:10.143673+0000","last_unstale":"2023-08-17T00:13:10.150382+0000","last_undegraded":"2023-08-17T00:13:10.150382+0000","last_fullsized":"2023-08-17T00:13:10.150382+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148103+0000","last_change":"2023-08-17T00:13:09.701169+0000","last_active":"2023-08-17T00:13:10.148103+0000","last_peered":"2023-08-17T00:13:10.148103+0000","last_clean":"2023-08-17T00:13:10.148103+0000","last_became_active":"2023-08-17T00:13:09.700665+0000","last_became_peered":"2023-08-17T00:13:09.700665+0000","last_unstale":"2023-08-17T00:13:10.148103+0000","last_undegraded":"2023-08-17T00:13:10.148103+0000","last_fullsized":"2023-08-17T00:13:10.148103+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.142897+0000","last_change":"2023-08-17T00:13:10.130238+0000","last_active":"2023-08-17T00:13:10.142897+0000","last_peered":"2023-08-17T00:13:10.142897+0000","last_clean":"2023-08-17T00:13:10.142897+0000","last_became_active":"2023-08-17T00:13:10.129911+0000","last_became_peered":"2023-08-17T00:13:10.129911+0000","last_unstale":"2023-08-17T00:13:10.142897+0000","last_undegraded":"2023-08-17T00:13:10.142897+0000","last_fullsized":"2023-08-17T00:13:10.142897+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.147590+0000","last_change":"2023-08-17T00:13:09.720809+0000","last_active":"2023-08-17T00:13:10.147590+0000","last_peered":"2023-08-17T00:13:10.147590+0000","last_clean":"2023-08-17T00:13:10.147590+0000","last_became_active":"2023-08-17T00:13:09.720539+0000","last_became_peered":"2023-08-17T00:13:09.720539+0000","last_unstale":"2023-08-17T00:13:10.147590+0000","last_undegraded":"2023-08-17T00:13:10.147590+0000","last_fullsized":"2023-08-17T00:13:10.147590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143491+0000","last_change":"2023-08-17T00:13:10.130268+0000","last_active":"2023-08-17T00:13:10.143491+0000","last_peered":"2023-08-17T00:13:10.143491+0000","last_clean":"2023-08-17T00:13:10.143491+0000","last_became_active":"2023-08-17T00:13:10.129988+0000","last_became_peered":"2023-08-17T00:13:10.129988+0000","last_unstale":"2023-08-17T00:13:10.143491+0000","last_undegraded":"2023-08-17T00:13:10.143491+0000","last_fullsized":"2023-08-17T00:13:10.143491+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.151291+0000","last_change":"2023-08-17T00:13:09.718597+0000","last_active":"2023-08-17T00:13:10.151291+0000","last_peered":"2023-08-17T00:13:10.151291+0000","last_clean":"2023-08-17T00:13:10.151291+0000","last_became_active":"2023-08-17T00:13:09.718265+0000","last_became_peered":"2023-08-17T00:13:09.718265+0000","last_unstale":"2023-08-17T00:13:10.151291+0000","last_undegraded":"2023-08-17T00:13:10.151291+0000","last_fullsized":"2023-08-17T00:13:10.151291+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.141315+0000","last_change":"2023-08-17T00:13:10.138150+0000","last_active":"2023-08-17T00:13:10.141315+0000","last_peered":"2023-08-17T00:13:10.141315+0000","last_clean":"2023-08-17T00:13:10.141315+0000","last_became_active":"2023-08-17T00:13:10.137850+0000","last_became_peered":"2023-08-17T00:13:10.137850+0000","last_unstale":"2023-08-17T00:13:10.141315+0000","last_undegraded":"2023-08-17T00:13:10.141315+0000","last_fullsized":"2023-08-17T00:13:10.141315+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123111+0000","last_change":"2023-08-17T00:13:09.714300+0000","last_active":"2023-08-17T00:13:10.123111+0000","last_peered":"2023-08-17T00:13:10.123111+0000","last_clean":"2023-08-17T00:13:10.123111+0000","last_became_active":"2023-08-17T00:13:09.711759+0000","last_became_peered":"2023-08-17T00:13:09.711759+0000","last_unstale":"2023-08-17T00:13:10.123111+0000","last_undegraded":"2023-08-17T00:13:10.123111+0000","last_fullsized":"2023-08-17T00:13:10.123111+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144104+0000","last_change":"2023-08-17T00:13:10.136618+0000","last_active":"2023-08-17T00:13:10.144104+0000","last_peered":"2023-08-17T00:13:10.144104+0000","last_clean":"2023-08-17T00:13:10.144104+0000","last_became_active":"2023-08-17T00:13:10.136342+0000","last_became_peered":"2023-08-17T00:13:10.136342+0000","last_unstale":"2023-08-17T00:13:10.144104+0000","last_undegraded":"2023-08-17T00:13:10.144104+0000","last_fullsized":"2023-08-17T00:13:10.144104+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.126495+0000","last_change":"2023-08-17T00:13:09.710546+0000","last_active":"2023-08-17T00:13:10.126495+0000","last_peered":"2023-08-17T00:13:10.126495+0000","last_clean":"2023-08-17T00:13:10.126495+0000","last_became_active":"2023-08-17T00:13:09.710214+0000","last_became_peered":"2023-08-17T00:13:09.710214+0000","last_unstale":"2023-08-17T00:13:10.126495+0000","last_undegraded":"2023-08-17T00:13:10.126495+0000","last_fullsized":"2023-08-17T00:13:10.126495+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146368+0000","last_change":"2023-08-17T00:13:10.142648+0000","last_active":"2023-08-17T00:13:10.146368+0000","last_peered":"2023-08-17T00:13:10.146368+0000","last_clean":"2023-08-17T00:13:10.146368+0000","last_became_active":"2023-08-17T00:13:10.142379+0000","last_became_peered":"2023-08-17T00:13:10.142379+0000","last_unstale":"2023-08-17T00:13:10.146368+0000","last_undegraded":"2023-08-17T00:13:10.146368+0000","last_fullsized":"2023-08-17T00:13:10.146368+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117706+0000","last_change":"2023-08-17T00:13:09.713175+0000","last_active":"2023-08-17T00:13:10.117706+0000","last_peered":"2023-08-17T00:13:10.117706+0000","last_clean":"2023-08-17T00:13:10.117706+0000","last_became_active":"2023-08-17T00:13:09.712908+0000","last_became_peered":"2023-08-17T00:13:09.712908+0000","last_unstale":"2023-08-17T00:13:10.117706+0000","last_undegraded":"2023-08-17T00:13:10.117706+0000","last_fullsized":"2023-08-17T00:13:10.117706+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143655+0000","last_change":"2023-08-17T00:13:10.141405+0000","last_active":"2023-08-17T00:13:10.143655+0000","last_peered":"2023-08-17T00:13:10.143655+0000","last_clean":"2023-08-17T00:13:10.143655+0000","last_became_active":"2023-08-17T00:13:10.141104+0000","last_became_peered":"2023-08-17T00:13:10.141104+0000","last_unstale":"2023-08-17T00:13:10.143655+0000","last_undegraded":"2023-08-17T00:13:10.143655+0000","last_fullsized":"2023-08-17T00:13:10.143655+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123985+0000","last_change":"2023-08-17T00:13:09.706671+0000","last_active":"2023-08-17T00:13:10.123985+0000","last_peered":"2023-08-17T00:13:10.123985+0000","last_clean":"2023-08-17T00:13:10.123985+0000","last_became_active":"2023-08-17T00:13:09.705653+0000","last_became_peered":"2023-08-17T00:13:09.705653+0000","last_unstale":"2023-08-17T00:13:10.123985+0000","last_undegraded":"2023-08-17T00:13:10.123985+0000","last_fullsized":"2023-08-17T00:13:10.123985+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146236+0000","last_change":"2023-08-17T00:13:10.142054+0000","last_active":"2023-08-17T00:13:10.146236+0000","last_peered":"2023-08-17T00:13:10.146236+0000","last_clean":"2023-08-17T00:13:10.146236+0000","last_became_active":"2023-08-17T00:13:10.141745+0000","last_became_peered":"2023-08-17T00:13:10.141745+0000","last_unstale":"2023-08-17T00:13:10.146236+0000","last_undegraded":"2023-08-17T00:13:10.146236+0000","last_fullsized":"2023-08-17T00:13:10.146236+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124998+0000","last_change":"2023-08-17T00:13:09.714328+0000","last_active":"2023-08-17T00:13:10.124998+0000","last_peered":"2023-08-17T00:13:10.124998+0000","last_clean":"2023-08-17T00:13:10.124998+0000","last_became_active":"2023-08-17T00:13:09.713429+0000","last_became_peered":"2023-08-17T00:13:09.713429+0000","last_unstale":"2023-08-17T00:13:10.124998+0000","last_undegraded":"2023-08-17T00:13:10.124998+0000","last_fullsized":"2023-08-17T00:13:10.124998+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.140616+0000","last_change":"2023-08-17T00:13:10.138676+0000","last_active":"2023-08-17T00:13:10.140616+0000","last_peered":"2023-08-17T00:13:10.140616+0000","last_clean":"2023-08-17T00:13:10.140616+0000","last_became_active":"2023-08-17T00:13:10.138369+0000","last_became_peered":"2023-08-17T00:13:10.138369+0000","last_unstale":"2023-08-17T00:13:10.140616+0000","last_undegraded":"2023-08-17T00:13:10.140616+0000","last_fullsized":"2023-08-17T00:13:10.140616+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.34","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.154786+0000","last_change":"2023-08-17T00:13:09.720855+0000","last_active":"2023-08-17T00:13:10.154786+0000","last_peered":"2023-08-17T00:13:10.154786+0000","last_clean":"2023-08-17T00:13:10.154786+0000","last_became_active":"2023-08-17T00:13:09.720051+0000","last_became_peered":"2023-08-17T00:13:09.720051+0000","last_unstale":"2023-08-17T00:13:10.154786+0000","last_undegraded":"2023-08-17T00:13:10.154786+0000","last_fullsized":"2023-08-17T00:13:10.154786+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149677+0000","last_change":"2023-08-17T00:13:10.135331+0000","last_active":"2023-08-17T00:13:10.149677+0000","last_peered":"2023-08-17T00:13:10.149677+0000","last_clean":"2023-08-17T00:13:10.149677+0000","last_became_active":"2023-08-17T00:13:10.135028+0000","last_became_peered":"2023-08-17T00:13:10.135028+0000","last_unstale":"2023-08-17T00:13:10.149677+0000","last_undegraded":"2023-08-17T00:13:10.149677+0000","last_fullsized":"2023-08-17T00:13:10.149677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.33","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143196+0000","last_change":"2023-08-17T00:13:09.701083+0000","last_active":"2023-08-17T00:13:10.143196+0000","last_peered":"2023-08-17T00:13:10.143196+0000","last_clean":"2023-08-17T00:13:10.143196+0000","last_became_active":"2023-08-17T00:13:09.700791+0000","last_became_peered":"2023-08-17T00:13:09.700791+0000","last_unstale":"2023-08-17T00:13:10.143196+0000","last_undegraded":"2023-08-17T00:13:10.143196+0000","last_fullsized":"2023-08-17T00:13:10.143196+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.141506+0000","last_change":"2023-08-17T00:13:10.138110+0000","last_active":"2023-08-17T00:13:10.141506+0000","last_peered":"2023-08-17T00:13:10.141506+0000","last_clean":"2023-08-17T00:13:10.141506+0000","last_became_active":"2023-08-17T00:13:10.137839+0000","last_became_peered":"2023-08-17T00:13:10.137839+0000","last_unstale":"2023-08-17T00:13:10.141506+0000","last_undegraded":"2023-08-17T00:13:10.141506+0000","last_fullsized":"2023-08-17T00:13:10.141506+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127962+0000","last_change":"2023-08-17T00:13:09.714532+0000","last_active":"2023-08-17T00:13:10.127962+0000","last_peered":"2023-08-17T00:13:10.127962+0000","last_clean":"2023-08-17T00:13:10.127962+0000","last_became_active":"2023-08-17T00:13:09.714227+0000","last_became_peered":"2023-08-17T00:13:09.714227+0000","last_unstale":"2023-08-17T00:13:10.127962+0000","last_undegraded":"2023-08-17T00:13:10.127962+0000","last_fullsized":"2023-08-17T00:13:10.127962+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148686+0000","last_change":"2023-08-17T00:13:10.141000+0000","last_active":"2023-08-17T00:13:10.148686+0000","last_peered":"2023-08-17T00:13:10.148686+0000","last_clean":"2023-08-17T00:13:10.148686+0000","last_became_active":"2023-08-17T00:13:10.140713+0000","last_became_peered":"2023-08-17T00:13:10.140713+0000","last_unstale":"2023-08-17T00:13:10.148686+0000","last_undegraded":"2023-08-17T00:13:10.148686+0000","last_fullsized":"2023-08-17T00:13:10.148686+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.131323+0000","last_change":"2023-08-17T00:13:09.716107+0000","last_active":"2023-08-17T00:13:10.131323+0000","last_peered":"2023-08-17T00:13:10.131323+0000","last_clean":"2023-08-17T00:13:10.131323+0000","last_became_active":"2023-08-17T00:13:09.715776+0000","last_became_peered":"2023-08-17T00:13:09.715776+0000","last_unstale":"2023-08-17T00:13:10.131323+0000","last_undegraded":"2023-08-17T00:13:10.131323+0000","last_fullsized":"2023-08-17T00:13:10.131323+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.151123+0000","last_change":"2023-08-17T00:13:10.145254+0000","last_active":"2023-08-17T00:13:10.151123+0000","last_peered":"2023-08-17T00:13:10.151123+0000","last_clean":"2023-08-17T00:13:10.151123+0000","last_became_active":"2023-08-17T00:13:10.144850+0000","last_became_peered":"2023-08-17T00:13:10.144850+0000","last_unstale":"2023-08-17T00:13:10.151123+0000","last_undegraded":"2023-08-17T00:13:10.151123+0000","last_fullsized":"2023-08-17T00:13:10.151123+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.30","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153590+0000","last_change":"2023-08-17T00:13:09.723932+0000","last_active":"2023-08-17T00:13:10.153590+0000","last_peered":"2023-08-17T00:13:10.153590+0000","last_clean":"2023-08-17T00:13:10.153590+0000","last_became_active":"2023-08-17T00:13:09.723623+0000","last_became_peered":"2023-08-17T00:13:09.723623+0000","last_unstale":"2023-08-17T00:13:10.153590+0000","last_undegraded":"2023-08-17T00:13:10.153590+0000","last_fullsized":"2023-08-17T00:13:10.153590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148778+0000","last_change":"2023-08-17T00:13:10.140724+0000","last_active":"2023-08-17T00:13:10.148778+0000","last_peered":"2023-08-17T00:13:10.148778+0000","last_clean":"2023-08-17T00:13:10.148778+0000","last_became_active":"2023-08-17T00:13:10.140386+0000","last_became_peered":"2023-08-17T00:13:10.140386+0000","last_unstale":"2023-08-17T00:13:10.148778+0000","last_undegraded":"2023-08-17T00:13:10.148778+0000","last_fullsized":"2023-08-17T00:13:10.148778+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117841+0000","last_change":"2023-08-17T00:13:09.712006+0000","last_active":"2023-08-17T00:13:10.117841+0000","last_peered":"2023-08-17T00:13:10.117841+0000","last_clean":"2023-08-17T00:13:10.117841+0000","last_became_active":"2023-08-17T00:13:09.709248+0000","last_became_peered":"2023-08-17T00:13:09.709248+0000","last_unstale":"2023-08-17T00:13:10.117841+0000","last_undegraded":"2023-08-17T00:13:10.117841+0000","last_fullsized":"2023-08-17T00:13:10.117841+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.142954+0000","last_change":"2023-08-17T00:13:10.138764+0000","last_active":"2023-08-17T00:13:10.142954+0000","last_peered":"2023-08-17T00:13:10.142954+0000","last_clean":"2023-08-17T00:13:10.142954+0000","last_became_active":"2023-08-17T00:13:10.138482+0000","last_became_peered":"2023-08-17T00:13:10.138482+0000","last_unstale":"2023-08-17T00:13:10.142954+0000","last_undegraded":"2023-08-17T00:13:10.142954+0000","last_fullsized":"2023-08-17T00:13:10.142954+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.132945+0000","last_change":"2023-08-17T00:13:09.723271+0000","last_active":"2023-08-17T00:13:10.132945+0000","last_peered":"2023-08-17T00:13:10.132945+0000","last_clean":"2023-08-17T00:13:10.132945+0000","last_became_active":"2023-08-17T00:13:09.723013+0000","last_became_peered":"2023-08-17T00:13:09.723013+0000","last_unstale":"2023-08-17T00:13:10.132945+0000","last_undegraded":"2023-08-17T00:13:10.132945+0000","last_fullsized":"2023-08-17T00:13:10.132945+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.140127+0000","last_change":"2023-08-17T00:13:10.138585+0000","last_active":"2023-08-17T00:13:10.140127+0000","last_peered":"2023-08-17T00:13:10.140127+0000","last_clean":"2023-08-17T00:13:10.140127+0000","last_became_active":"2023-08-17T00:13:10.138177+0000","last_became_peered":"2023-08-17T00:13:10.138177+0000","last_unstale":"2023-08-17T00:13:10.140127+0000","last_undegraded":"2023-08-17T00:13:10.140127+0000","last_fullsized":"2023-08-17T00:13:10.140127+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149632+0000","last_change":"2023-08-17T00:13:09.704715+0000","last_active":"2023-08-17T00:13:10.149632+0000","last_peered":"2023-08-17T00:13:10.149632+0000","last_clean":"2023-08-17T00:13:10.149632+0000","last_became_active":"2023-08-17T00:13:09.704442+0000","last_became_peered":"2023-08-17T00:13:09.704442+0000","last_unstale":"2023-08-17T00:13:10.149632+0000","last_undegraded":"2023-08-17T00:13:10.149632+0000","last_fullsized":"2023-08-17T00:13:10.149632+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143353+0000","last_change":"2023-08-17T00:13:10.133246+0000","last_active":"2023-08-17T00:13:10.143353+0000","last_peered":"2023-08-17T00:13:10.143353+0000","last_clean":"2023-08-17T00:13:10.143353+0000","last_became_active":"2023-08-17T00:13:10.131240+0000","last_became_peered":"2023-08-17T00:13:10.131240+0000","last_unstale":"2023-08-17T00:13:10.143353+0000","last_undegraded":"2023-08-17T00:13:10.143353+0000","last_fullsized":"2023-08-17T00:13:10.143353+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.135851+0000","last_change":"2023-08-17T00:13:09.708794+0000","last_active":"2023-08-17T00:13:10.135851+0000","last_peered":"2023-08-17T00:13:10.135851+0000","last_clean":"2023-08-17T00:13:10.135851+0000","last_became_active":"2023-08-17T00:13:09.708523+0000","last_became_peered":"2023-08-17T00:13:09.708523+0000","last_unstale":"2023-08-17T00:13:10.135851+0000","last_undegraded":"2023-08-17T00:13:10.135851+0000","last_fullsized":"2023-08-17T00:13:10.135851+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144511+0000","last_change":"2023-08-17T00:13:10.132288+0000","last_active":"2023-08-17T00:13:10.144511+0000","last_peered":"2023-08-17T00:13:10.144511+0000","last_clean":"2023-08-17T00:13:10.144511+0000","last_became_active":"2023-08-17T00:13:10.131952+0000","last_became_peered":"2023-08-17T00:13:10.131952+0000","last_unstale":"2023-08-17T00:13:10.144511+0000","last_undegraded":"2023-08-17T00:13:10.144511+0000","last_fullsized":"2023-08-17T00:13:10.144511+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152475+0000","last_change":"2023-08-17T00:13:09.722191+0000","last_active":"2023-08-17T00:13:10.152475+0000","last_peered":"2023-08-17T00:13:10.152475+0000","last_clean":"2023-08-17T00:13:10.152475+0000","last_became_active":"2023-08-17T00:13:09.721759+0000","last_became_peered":"2023-08-17T00:13:09.721759+0000","last_unstale":"2023-08-17T00:13:10.152475+0000","last_undegraded":"2023-08-17T00:13:10.152475+0000","last_fullsized":"2023-08-17T00:13:10.152475+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143217+0000","last_change":"2023-08-17T00:13:10.138861+0000","last_active":"2023-08-17T00:13:10.143217+0000","last_peered":"2023-08-17T00:13:10.143217+0000","last_clean":"2023-08-17T00:13:10.143217+0000","last_became_active":"2023-08-17T00:13:10.138578+0000","last_became_peered":"2023-08-17T00:13:10.138578+0000","last_unstale":"2023-08-17T00:13:10.143217+0000","last_undegraded":"2023-08-17T00:13:10.143217+0000","last_fullsized":"2023-08-17T00:13:10.143217+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119797+0000","last_change":"2023-08-17T00:13:09.704362+0000","last_active":"2023-08-17T00:13:10.119797+0000","last_peered":"2023-08-17T00:13:10.119797+0000","last_clean":"2023-08-17T00:13:10.119797+0000","last_became_active":"2023-08-17T00:13:09.703910+0000","last_became_peered":"2023-08-17T00:13:09.703910+0000","last_unstale":"2023-08-17T00:13:10.119797+0000","last_undegraded":"2023-08-17T00:13:10.119797+0000","last_fullsized":"2023-08-17T00:13:10.119797+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149441+0000","last_change":"2023-08-17T00:13:10.135316+0000","last_active":"2023-08-17T00:13:10.149441+0000","last_peered":"2023-08-17T00:13:10.149441+0000","last_clean":"2023-08-17T00:13:10.149441+0000","last_became_active":"2023-08-17T00:13:10.134715+0000","last_became_peered":"2023-08-17T00:13:10.134715+0000","last_unstale":"2023-08-17T00:13:10.149441+0000","last_undegraded":"2023-08-17T00:13:10.149441+0000","last_fullsized":"2023-08-17T00:13:10.149441+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127624+0000","last_change":"2023-08-17T00:13:09.715067+0000","last_active":"2023-08-17T00:13:10.127624+0000","last_peered":"2023-08-17T00:13:10.127624+0000","last_clean":"2023-08-17T00:13:10.127624+0000","last_became_active":"2023-08-17T00:13:09.714773+0000","last_became_peered":"2023-08-17T00:13:09.714773+0000","last_unstale":"2023-08-17T00:13:10.127624+0000","last_undegraded":"2023-08-17T00:13:10.127624+0000","last_fullsized":"2023-08-17T00:13:10.127624+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146222+0000","last_change":"2023-08-17T00:13:10.140368+0000","last_active":"2023-08-17T00:13:10.146222+0000","last_peered":"2023-08-17T00:13:10.146222+0000","last_clean":"2023-08-17T00:13:10.146222+0000","last_became_active":"2023-08-17T00:13:10.140053+0000","last_became_peered":"2023-08-17T00:13:10.140053+0000","last_unstale":"2023-08-17T00:13:10.146222+0000","last_undegraded":"2023-08-17T00:13:10.146222+0000","last_fullsized":"2023-08-17T00:13:10.146222+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.129713+0000","last_change":"2023-08-17T00:13:09.721658+0000","last_active":"2023-08-17T00:13:10.129713+0000","last_peered":"2023-08-17T00:13:10.129713+0000","last_clean":"2023-08-17T00:13:10.129713+0000","last_became_active":"2023-08-17T00:13:09.721347+0000","last_became_peered":"2023-08-17T00:13:09.721347+0000","last_unstale":"2023-08-17T00:13:10.129713+0000","last_undegraded":"2023-08-17T00:13:10.129713+0000","last_fullsized":"2023-08-17T00:13:10.129713+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149661+0000","last_change":"2023-08-17T00:13:10.147061+0000","last_active":"2023-08-17T00:13:10.149661+0000","last_peered":"2023-08-17T00:13:10.149661+0000","last_clean":"2023-08-17T00:13:10.149661+0000","last_became_active":"2023-08-17T00:13:10.146740+0000","last_became_peered":"2023-08-17T00:13:10.146740+0000","last_unstale":"2023-08-17T00:13:10.149661+0000","last_undegraded":"2023-08-17T00:13:10.149661+0000","last_fullsized":"2023-08-17T00:13:10.149661+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125580+0000","last_change":"2023-08-17T00:13:09.702331+0000","last_active":"2023-08-17T00:13:10.125580+0000","last_peered":"2023-08-17T00:13:10.125580+0000","last_clean":"2023-08-17T00:13:10.125580+0000","last_became_active":"2023-08-17T00:13:09.701736+0000","last_became_peered":"2023-08-17T00:13:09.701736+0000","last_unstale":"2023-08-17T00:13:10.125580+0000","last_undegraded":"2023-08-17T00:13:10.125580+0000","last_fullsized":"2023-08-17T00:13:10.125580+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149687+0000","last_change":"2023-08-17T00:13:10.146614+0000","last_active":"2023-08-17T00:13:10.149687+0000","last_peered":"2023-08-17T00:13:10.149687+0000","last_clean":"2023-08-17T00:13:10.149687+0000","last_became_active":"2023-08-17T00:13:10.146361+0000","last_became_peered":"2023-08-17T00:13:10.146361+0000","last_unstale":"2023-08-17T00:13:10.149687+0000","last_undegraded":"2023-08-17T00:13:10.149687+0000","last_fullsized":"2023-08-17T00:13:10.149687+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"140'1","reported_seq":11,"reported_epoch":140,"state":"active+clean","last_fresh":"2023-08-17T00:13:11.128015+0000","last_change":"2023-08-17T00:13:09.713360+0000","last_active":"2023-08-17T00:13:11.128015+0000","last_peered":"2023-08-17T00:13:11.128015+0000","last_clean":"2023-08-17T00:13:11.128015+0000","last_became_active":"2023-08-17T00:13:09.713047+0000","last_became_peered":"2023-08-17T00:13:09.713047+0000","last_unstale":"2023-08-17T00:13:11.128015+0000","last_undegraded":"2023-08-17T00:13:11.128015+0000","last_fullsized":"2023-08-17T00:13:11.128015+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149765+0000","last_change":"2023-08-17T00:13:10.145126+0000","last_active":"2023-08-17T00:13:10.149765+0000","last_peered":"2023-08-17T00:13:10.149765+0000","last_clean":"2023-08-17T00:13:10.149765+0000","last_became_active":"2023-08-17T00:13:10.144456+0000","last_became_peered":"2023-08-17T00:13:10.144456+0000","last_unstale":"2023-08-17T00:13:10.149765+0000","last_undegraded":"2023-08-17T00:13:10.149765+0000","last_fullsized":"2023-08-17T00:13:10.149765+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127348+0000","last_change":"2023-08-17T00:13:09.718583+0000","last_active":"2023-08-17T00:13:10.127348+0000","last_peered":"2023-08-17T00:13:10.127348+0000","last_clean":"2023-08-17T00:13:10.127348+0000","last_became_active":"2023-08-17T00:13:09.718328+0000","last_became_peered":"2023-08-17T00:13:09.718328+0000","last_unstale":"2023-08-17T00:13:10.127348+0000","last_undegraded":"2023-08-17T00:13:10.127348+0000","last_fullsized":"2023-08-17T00:13:10.127348+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148316+0000","last_change":"2023-08-17T00:13:10.142752+0000","last_active":"2023-08-17T00:13:10.148316+0000","last_peered":"2023-08-17T00:13:10.148316+0000","last_clean":"2023-08-17T00:13:10.148316+0000","last_became_active":"2023-08-17T00:13:10.142480+0000","last_became_peered":"2023-08-17T00:13:10.142480+0000","last_unstale":"2023-08-17T00:13:10.148316+0000","last_undegraded":"2023-08-17T00:13:10.148316+0000","last_fullsized":"2023-08-17T00:13:10.148316+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127070+0000","last_change":"2023-08-17T00:13:09.713275+0000","last_active":"2023-08-17T00:13:10.127070+0000","last_peered":"2023-08-17T00:13:10.127070+0000","last_clean":"2023-08-17T00:13:10.127070+0000","last_became_active":"2023-08-17T00:13:09.712157+0000","last_became_peered":"2023-08-17T00:13:09.712157+0000","last_unstale":"2023-08-17T00:13:10.127070+0000","last_undegraded":"2023-08-17T00:13:10.127070+0000","last_fullsized":"2023-08-17T00:13:10.127070+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153052+0000","last_change":"2023-08-17T00:13:10.151922+0000","last_active":"2023-08-17T00:13:10.153052+0000","last_peered":"2023-08-17T00:13:10.153052+0000","last_clean":"2023-08-17T00:13:10.153052+0000","last_became_active":"2023-08-17T00:13:10.151590+0000","last_became_peered":"2023-08-17T00:13:10.151590+0000","last_unstale":"2023-08-17T00:13:10.153052+0000","last_undegraded":"2023-08-17T00:13:10.153052+0000","last_fullsized":"2023-08-17T00:13:10.153052+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.121807+0000","last_change":"2023-08-17T00:13:09.714585+0000","last_active":"2023-08-17T00:13:10.121807+0000","last_peered":"2023-08-17T00:13:10.121807+0000","last_clean":"2023-08-17T00:13:10.121807+0000","last_became_active":"2023-08-17T00:13:09.714324+0000","last_became_peered":"2023-08-17T00:13:09.714324+0000","last_unstale":"2023-08-17T00:13:10.121807+0000","last_undegraded":"2023-08-17T00:13:10.121807+0000","last_fullsized":"2023-08-17T00:13:10.121807+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146785+0000","last_change":"2023-08-17T00:13:10.141694+0000","last_active":"2023-08-17T00:13:10.146785+0000","last_peered":"2023-08-17T00:13:10.146785+0000","last_clean":"2023-08-17T00:13:10.146785+0000","last_became_active":"2023-08-17T00:13:10.141264+0000","last_became_peered":"2023-08-17T00:13:10.141264+0000","last_unstale":"2023-08-17T00:13:10.146785+0000","last_undegraded":"2023-08-17T00:13:10.146785+0000","last_fullsized":"2023-08-17T00:13:10.146785+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119960+0000","last_change":"2023-08-17T00:13:09.704177+0000","last_active":"2023-08-17T00:13:10.119960+0000","last_peered":"2023-08-17T00:13:10.119960+0000","last_clean":"2023-08-17T00:13:10.119960+0000","last_became_active":"2023-08-17T00:13:09.703629+0000","last_became_peered":"2023-08-17T00:13:09.703629+0000","last_unstale":"2023-08-17T00:13:10.119960+0000","last_undegraded":"2023-08-17T00:13:10.119960+0000","last_fullsized":"2023-08-17T00:13:10.119960+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143101+0000","last_change":"2023-08-17T00:13:10.131719+0000","last_active":"2023-08-17T00:13:10.143101+0000","last_peered":"2023-08-17T00:13:10.143101+0000","last_clean":"2023-08-17T00:13:10.143101+0000","last_became_active":"2023-08-17T00:13:10.131458+0000","last_became_peered":"2023-08-17T00:13:10.131458+0000","last_unstale":"2023-08-17T00:13:10.143101+0000","last_undegraded":"2023-08-17T00:13:10.143101+0000","last_fullsized":"2023-08-17T00:13:10.143101+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127731+0000","last_change":"2023-08-17T00:13:09.706097+0000","last_active":"2023-08-17T00:13:10.127731+0000","last_peered":"2023-08-17T00:13:10.127731+0000","last_clean":"2023-08-17T00:13:10.127731+0000","last_became_active":"2023-08-17T00:13:09.705810+0000","last_became_peered":"2023-08-17T00:13:09.705810+0000","last_unstale":"2023-08-17T00:13:10.127731+0000","last_undegraded":"2023-08-17T00:13:10.127731+0000","last_fullsized":"2023-08-17T00:13:10.127731+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144906+0000","last_change":"2023-08-17T00:13:10.133088+0000","last_active":"2023-08-17T00:13:10.144906+0000","last_peered":"2023-08-17T00:13:10.144906+0000","last_clean":"2023-08-17T00:13:10.144906+0000","last_became_active":"2023-08-17T00:13:10.132758+0000","last_became_peered":"2023-08-17T00:13:10.132758+0000","last_unstale":"2023-08-17T00:13:10.144906+0000","last_undegraded":"2023-08-17T00:13:10.144906+0000","last_fullsized":"2023-08-17T00:13:10.144906+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117576+0000","last_change":"2023-08-17T00:13:09.710487+0000","last_active":"2023-08-17T00:13:10.117576+0000","last_peered":"2023-08-17T00:13:10.117576+0000","last_clean":"2023-08-17T00:13:10.117576+0000","last_became_active":"2023-08-17T00:13:09.710200+0000","last_became_peered":"2023-08-17T00:13:09.710200+0000","last_unstale":"2023-08-17T00:13:10.117576+0000","last_undegraded":"2023-08-17T00:13:10.117576+0000","last_fullsized":"2023-08-17T00:13:10.117576+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146236+0000","last_change":"2023-08-17T00:13:10.134818+0000","last_active":"2023-08-17T00:13:10.146236+0000","last_peered":"2023-08-17T00:13:10.146236+0000","last_clean":"2023-08-17T00:13:10.146236+0000","last_became_active":"2023-08-17T00:13:10.134174+0000","last_became_peered":"2023-08-17T00:13:10.134174+0000","last_unstale":"2023-08-17T00:13:10.146236+0000","last_undegraded":"2023-08-17T00:13:10.146236+0000","last_fullsized":"2023-08-17T00:13:10.146236+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152396+0000","last_change":"2023-08-17T00:13:09.712188+0000","last_active":"2023-08-17T00:13:10.152396+0000","last_peered":"2023-08-17T00:13:10.152396+0000","last_clean":"2023-08-17T00:13:10.152396+0000","last_became_active":"2023-08-17T00:13:09.711482+0000","last_became_peered":"2023-08-17T00:13:09.711482+0000","last_unstale":"2023-08-17T00:13:10.152396+0000","last_undegraded":"2023-08-17T00:13:10.152396+0000","last_fullsized":"2023-08-17T00:13:10.152396+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148824+0000","last_change":"2023-08-17T00:13:10.141561+0000","last_active":"2023-08-17T00:13:10.148824+0000","last_peered":"2023-08-17T00:13:10.148824+0000","last_clean":"2023-08-17T00:13:10.148824+0000","last_became_active":"2023-08-17T00:13:10.141302+0000","last_became_peered":"2023-08-17T00:13:10.141302+0000","last_unstale":"2023-08-17T00:13:10.148824+0000","last_undegraded":"2023-08-17T00:13:10.148824+0000","last_fullsized":"2023-08-17T00:13:10.148824+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.151291+0000","last_change":"2023-08-17T00:13:09.711877+0000","last_active":"2023-08-17T00:13:10.151291+0000","last_peered":"2023-08-17T00:13:10.151291+0000","last_clean":"2023-08-17T00:13:10.151291+0000","last_became_active":"2023-08-17T00:13:09.711521+0000","last_became_peered":"2023-08-17T00:13:09.711521+0000","last_unstale":"2023-08-17T00:13:10.151291+0000","last_undegraded":"2023-08-17T00:13:10.151291+0000","last_fullsized":"2023-08-17T00:13:10.151291+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149781+0000","last_change":"2023-08-17T00:13:10.145756+0000","last_active":"2023-08-17T00:13:10.149781+0000","last_peered":"2023-08-17T00:13:10.149781+0000","last_clean":"2023-08-17T00:13:10.149781+0000","last_became_active":"2023-08-17T00:13:10.144441+0000","last_became_peered":"2023-08-17T00:13:10.144441+0000","last_unstale":"2023-08-17T00:13:10.149781+0000","last_undegraded":"2023-08-17T00:13:10.149781+0000","last_fullsized":"2023-08-17T00:13:10.149781+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146506+0000","last_change":"2023-08-17T00:13:09.721797+0000","last_active":"2023-08-17T00:13:10.146506+0000","last_peered":"2023-08-17T00:13:10.146506+0000","last_clean":"2023-08-17T00:13:10.146506+0000","last_became_active":"2023-08-17T00:13:09.721470+0000","last_became_peered":"2023-08-17T00:13:09.721470+0000","last_unstale":"2023-08-17T00:13:10.146506+0000","last_undegraded":"2023-08-17T00:13:10.146506+0000","last_fullsized":"2023-08-17T00:13:10.146506+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149507+0000","last_change":"2023-08-17T00:13:10.136335+0000","last_active":"2023-08-17T00:13:10.149507+0000","last_peered":"2023-08-17T00:13:10.149507+0000","last_clean":"2023-08-17T00:13:10.149507+0000","last_became_active":"2023-08-17T00:13:10.135737+0000","last_became_peered":"2023-08-17T00:13:10.135737+0000","last_unstale":"2023-08-17T00:13:10.149507+0000","last_undegraded":"2023-08-17T00:13:10.149507+0000","last_fullsized":"2023-08-17T00:13:10.149507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117655+0000","last_change":"2023-08-17T00:13:09.709149+0000","last_active":"2023-08-17T00:13:10.117655+0000","last_peered":"2023-08-17T00:13:10.117655+0000","last_clean":"2023-08-17T00:13:10.117655+0000","last_became_active":"2023-08-17T00:13:09.708813+0000","last_became_peered":"2023-08-17T00:13:09.708813+0000","last_unstale":"2023-08-17T00:13:10.117655+0000","last_undegraded":"2023-08-17T00:13:10.117655+0000","last_fullsized":"2023-08-17T00:13:10.117655+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152820+0000","last_change":"2023-08-17T00:13:10.142656+0000","last_active":"2023-08-17T00:13:10.152820+0000","last_peered":"2023-08-17T00:13:10.152820+0000","last_clean":"2023-08-17T00:13:10.152820+0000","last_became_active":"2023-08-17T00:13:10.142378+0000","last_became_peered":"2023-08-17T00:13:10.142378+0000","last_unstale":"2023-08-17T00:13:10.152820+0000","last_undegraded":"2023-08-17T00:13:10.152820+0000","last_fullsized":"2023-08-17T00:13:10.152820+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125625+0000","last_change":"2023-08-17T00:13:09.719799+0000","last_active":"2023-08-17T00:13:10.125625+0000","last_peered":"2023-08-17T00:13:10.125625+0000","last_clean":"2023-08-17T00:13:10.125625+0000","last_became_active":"2023-08-17T00:13:09.719514+0000","last_became_peered":"2023-08-17T00:13:09.719514+0000","last_unstale":"2023-08-17T00:13:10.125625+0000","last_undegraded":"2023-08-17T00:13:10.125625+0000","last_fullsized":"2023-08-17T00:13:10.125625+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152822+0000","last_change":"2023-08-17T00:13:10.143592+0000","last_active":"2023-08-17T00:13:10.152822+0000","last_peered":"2023-08-17T00:13:10.152822+0000","last_clean":"2023-08-17T00:13:10.152822+0000","last_became_active":"2023-08-17T00:13:10.143306+0000","last_became_peered":"2023-08-17T00:13:10.143306+0000","last_unstale":"2023-08-17T00:13:10.152822+0000","last_undegraded":"2023-08-17T00:13:10.152822+0000","last_fullsized":"2023-08-17T00:13:10.152822+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.130511+0000","last_change":"2023-08-17T00:13:09.712335+0000","last_active":"2023-08-17T00:13:10.130511+0000","last_peered":"2023-08-17T00:13:10.130511+0000","last_clean":"2023-08-17T00:13:10.130511+0000","last_became_active":"2023-08-17T00:13:09.711610+0000","last_became_peered":"2023-08-17T00:13:09.711610+0000","last_unstale":"2023-08-17T00:13:10.130511+0000","last_undegraded":"2023-08-17T00:13:10.130511+0000","last_fullsized":"2023-08-17T00:13:10.130511+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150507+0000","last_change":"2023-08-17T00:13:10.143490+0000","last_active":"2023-08-17T00:13:10.150507+0000","last_peered":"2023-08-17T00:13:10.150507+0000","last_clean":"2023-08-17T00:13:10.150507+0000","last_became_active":"2023-08-17T00:13:10.143226+0000","last_became_peered":"2023-08-17T00:13:10.143226+0000","last_unstale":"2023-08-17T00:13:10.150507+0000","last_undegraded":"2023-08-17T00:13:10.150507+0000","last_fullsized":"2023-08-17T00:13:10.150507+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.119521+0000","last_change":"2023-08-17T00:13:09.703051+0000","last_active":"2023-08-17T00:13:10.119521+0000","last_peered":"2023-08-17T00:13:10.119521+0000","last_clean":"2023-08-17T00:13:10.119521+0000","last_became_active":"2023-08-17T00:13:09.702719+0000","last_became_peered":"2023-08-17T00:13:09.702719+0000","last_unstale":"2023-08-17T00:13:10.119521+0000","last_undegraded":"2023-08-17T00:13:10.119521+0000","last_fullsized":"2023-08-17T00:13:10.119521+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152375+0000","last_change":"2023-08-17T00:13:10.140592+0000","last_active":"2023-08-17T00:13:10.152375+0000","last_peered":"2023-08-17T00:13:10.152375+0000","last_clean":"2023-08-17T00:13:10.152375+0000","last_became_active":"2023-08-17T00:13:10.137955+0000","last_became_peered":"2023-08-17T00:13:10.137955+0000","last_unstale":"2023-08-17T00:13:10.152375+0000","last_undegraded":"2023-08-17T00:13:10.152375+0000","last_fullsized":"2023-08-17T00:13:10.152375+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123009+0000","last_change":"2023-08-17T00:13:09.704781+0000","last_active":"2023-08-17T00:13:10.123009+0000","last_peered":"2023-08-17T00:13:10.123009+0000","last_clean":"2023-08-17T00:13:10.123009+0000","last_became_active":"2023-08-17T00:13:09.704465+0000","last_became_peered":"2023-08-17T00:13:09.704465+0000","last_unstale":"2023-08-17T00:13:10.123009+0000","last_undegraded":"2023-08-17T00:13:10.123009+0000","last_fullsized":"2023-08-17T00:13:10.123009+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149681+0000","last_change":"2023-08-17T00:13:10.146117+0000","last_active":"2023-08-17T00:13:10.149681+0000","last_peered":"2023-08-17T00:13:10.149681+0000","last_clean":"2023-08-17T00:13:10.149681+0000","last_became_active":"2023-08-17T00:13:10.145845+0000","last_became_peered":"2023-08-17T00:13:10.145845+0000","last_unstale":"2023-08-17T00:13:10.149681+0000","last_undegraded":"2023-08-17T00:13:10.149681+0000","last_fullsized":"2023-08-17T00:13:10.149681+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.145795+0000","last_change":"2023-08-17T00:13:09.714695+0000","last_active":"2023-08-17T00:13:10.145795+0000","last_peered":"2023-08-17T00:13:10.145795+0000","last_clean":"2023-08-17T00:13:10.145795+0000","last_became_active":"2023-08-17T00:13:09.714142+0000","last_became_peered":"2023-08-17T00:13:09.714142+0000","last_unstale":"2023-08-17T00:13:10.145795+0000","last_undegraded":"2023-08-17T00:13:10.145795+0000","last_fullsized":"2023-08-17T00:13:10.145795+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144619+0000","last_change":"2023-08-17T00:13:10.139938+0000","last_active":"2023-08-17T00:13:10.144619+0000","last_peered":"2023-08-17T00:13:10.144619+0000","last_clean":"2023-08-17T00:13:10.144619+0000","last_became_active":"2023-08-17T00:13:10.139631+0000","last_became_peered":"2023-08-17T00:13:10.139631+0000","last_unstale":"2023-08-17T00:13:10.144619+0000","last_undegraded":"2023-08-17T00:13:10.144619+0000","last_fullsized":"2023-08-17T00:13:10.144619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146629+0000","last_change":"2023-08-17T00:13:09.717029+0000","last_active":"2023-08-17T00:13:10.146629+0000","last_peered":"2023-08-17T00:13:10.146629+0000","last_clean":"2023-08-17T00:13:10.146629+0000","last_became_active":"2023-08-17T00:13:09.716751+0000","last_became_peered":"2023-08-17T00:13:09.716751+0000","last_unstale":"2023-08-17T00:13:10.146629+0000","last_undegraded":"2023-08-17T00:13:10.146629+0000","last_fullsized":"2023-08-17T00:13:10.146629+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149645+0000","last_change":"2023-08-17T00:13:10.145838+0000","last_active":"2023-08-17T00:13:10.149645+0000","last_peered":"2023-08-17T00:13:10.149645+0000","last_clean":"2023-08-17T00:13:10.149645+0000","last_became_active":"2023-08-17T00:13:10.145499+0000","last_became_peered":"2023-08-17T00:13:10.145499+0000","last_unstale":"2023-08-17T00:13:10.149645+0000","last_undegraded":"2023-08-17T00:13:10.149645+0000","last_fullsized":"2023-08-17T00:13:10.149645+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120333+0000","last_change":"2023-08-17T00:13:09.702990+0000","last_active":"2023-08-17T00:13:10.120333+0000","last_peered":"2023-08-17T00:13:10.120333+0000","last_clean":"2023-08-17T00:13:10.120333+0000","last_became_active":"2023-08-17T00:13:09.702687+0000","last_became_peered":"2023-08-17T00:13:09.702687+0000","last_unstale":"2023-08-17T00:13:10.120333+0000","last_undegraded":"2023-08-17T00:13:10.120333+0000","last_fullsized":"2023-08-17T00:13:10.120333+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150362+0000","last_change":"2023-08-17T00:13:10.143588+0000","last_active":"2023-08-17T00:13:10.150362+0000","last_peered":"2023-08-17T00:13:10.150362+0000","last_clean":"2023-08-17T00:13:10.150362+0000","last_became_active":"2023-08-17T00:13:10.143313+0000","last_became_peered":"2023-08-17T00:13:10.143313+0000","last_unstale":"2023-08-17T00:13:10.150362+0000","last_undegraded":"2023-08-17T00:13:10.150362+0000","last_fullsized":"2023-08-17T00:13:10.150362+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.122097+0000","last_change":"2023-08-17T00:13:09.705408+0000","last_active":"2023-08-17T00:13:10.122097+0000","last_peered":"2023-08-17T00:13:10.122097+0000","last_clean":"2023-08-17T00:13:10.122097+0000","last_became_active":"2023-08-17T00:13:09.705098+0000","last_became_peered":"2023-08-17T00:13:09.705098+0000","last_unstale":"2023-08-17T00:13:10.122097+0000","last_undegraded":"2023-08-17T00:13:10.122097+0000","last_fullsized":"2023-08-17T00:13:10.122097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.147292+0000","last_change":"2023-08-17T00:13:10.145736+0000","last_active":"2023-08-17T00:13:10.147292+0000","last_peered":"2023-08-17T00:13:10.147292+0000","last_clean":"2023-08-17T00:13:10.147292+0000","last_became_active":"2023-08-17T00:13:10.145458+0000","last_became_peered":"2023-08-17T00:13:10.145458+0000","last_unstale":"2023-08-17T00:13:10.147292+0000","last_undegraded":"2023-08-17T00:13:10.147292+0000","last_fullsized":"2023-08-17T00:13:10.147292+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153121+0000","last_change":"2023-08-17T00:13:09.712697+0000","last_active":"2023-08-17T00:13:10.153121+0000","last_peered":"2023-08-17T00:13:10.153121+0000","last_clean":"2023-08-17T00:13:10.153121+0000","last_became_active":"2023-08-17T00:13:09.712391+0000","last_became_peered":"2023-08-17T00:13:09.712391+0000","last_unstale":"2023-08-17T00:13:10.153121+0000","last_undegraded":"2023-08-17T00:13:10.153121+0000","last_fullsized":"2023-08-17T00:13:10.153121+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.146208+0000","last_change":"2023-08-17T00:13:10.141394+0000","last_active":"2023-08-17T00:13:10.146208+0000","last_peered":"2023-08-17T00:13:10.146208+0000","last_clean":"2023-08-17T00:13:10.146208+0000","last_became_active":"2023-08-17T00:13:10.139413+0000","last_became_peered":"2023-08-17T00:13:10.139413+0000","last_unstale":"2023-08-17T00:13:10.146208+0000","last_undegraded":"2023-08-17T00:13:10.146208+0000","last_fullsized":"2023-08-17T00:13:10.146208+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.120087+0000","last_change":"2023-08-17T00:13:09.704921+0000","last_active":"2023-08-17T00:13:10.120087+0000","last_peered":"2023-08-17T00:13:10.120087+0000","last_clean":"2023-08-17T00:13:10.120087+0000","last_became_active":"2023-08-17T00:13:09.704624+0000","last_became_peered":"2023-08-17T00:13:09.704624+0000","last_unstale":"2023-08-17T00:13:10.120087+0000","last_undegraded":"2023-08-17T00:13:10.120087+0000","last_fullsized":"2023-08-17T00:13:10.120087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149756+0000","last_change":"2023-08-17T00:13:10.139142+0000","last_active":"2023-08-17T00:13:10.149756+0000","last_peered":"2023-08-17T00:13:10.149756+0000","last_clean":"2023-08-17T00:13:10.149756+0000","last_became_active":"2023-08-17T00:13:10.137758+0000","last_became_peered":"2023-08-17T00:13:10.137758+0000","last_unstale":"2023-08-17T00:13:10.149756+0000","last_undegraded":"2023-08-17T00:13:10.149756+0000","last_fullsized":"2023-08-17T00:13:10.149756+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123562+0000","last_change":"2023-08-17T00:13:09.722713+0000","last_active":"2023-08-17T00:13:10.123562+0000","last_peered":"2023-08-17T00:13:10.123562+0000","last_clean":"2023-08-17T00:13:10.123562+0000","last_became_active":"2023-08-17T00:13:09.722260+0000","last_became_peered":"2023-08-17T00:13:09.722260+0000","last_unstale":"2023-08-17T00:13:10.123562+0000","last_undegraded":"2023-08-17T00:13:10.123562+0000","last_fullsized":"2023-08-17T00:13:10.123562+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144703+0000","last_change":"2023-08-17T00:13:10.139830+0000","last_active":"2023-08-17T00:13:10.144703+0000","last_peered":"2023-08-17T00:13:10.144703+0000","last_clean":"2023-08-17T00:13:10.144703+0000","last_became_active":"2023-08-17T00:13:10.139552+0000","last_became_peered":"2023-08-17T00:13:10.139552+0000","last_unstale":"2023-08-17T00:13:10.144703+0000","last_undegraded":"2023-08-17T00:13:10.144703+0000","last_fullsized":"2023-08-17T00:13:10.144703+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.128980+0000","last_change":"2023-08-17T00:13:09.713772+0000","last_active":"2023-08-17T00:13:10.128980+0000","last_peered":"2023-08-17T00:13:10.128980+0000","last_clean":"2023-08-17T00:13:10.128980+0000","last_became_active":"2023-08-17T00:13:09.713494+0000","last_became_peered":"2023-08-17T00:13:09.713494+0000","last_unstale":"2023-08-17T00:13:10.128980+0000","last_undegraded":"2023-08-17T00:13:10.128980+0000","last_fullsized":"2023-08-17T00:13:10.128980+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152146+0000","last_change":"2023-08-17T00:13:10.149871+0000","last_active":"2023-08-17T00:13:10.152146+0000","last_peered":"2023-08-17T00:13:10.152146+0000","last_clean":"2023-08-17T00:13:10.152146+0000","last_became_active":"2023-08-17T00:13:10.148974+0000","last_became_peered":"2023-08-17T00:13:10.148974+0000","last_unstale":"2023-08-17T00:13:10.152146+0000","last_undegraded":"2023-08-17T00:13:10.152146+0000","last_fullsized":"2023-08-17T00:13:10.152146+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149866+0000","last_change":"2023-08-17T00:13:09.710277+0000","last_active":"2023-08-17T00:13:10.149866+0000","last_peered":"2023-08-17T00:13:10.149866+0000","last_clean":"2023-08-17T00:13:10.149866+0000","last_became_active":"2023-08-17T00:13:09.709967+0000","last_became_peered":"2023-08-17T00:13:09.709967+0000","last_unstale":"2023-08-17T00:13:10.149866+0000","last_undegraded":"2023-08-17T00:13:10.149866+0000","last_fullsized":"2023-08-17T00:13:10.149866+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148163+0000","last_change":"2023-08-17T00:13:10.142795+0000","last_active":"2023-08-17T00:13:10.148163+0000","last_peered":"2023-08-17T00:13:10.148163+0000","last_clean":"2023-08-17T00:13:10.148163+0000","last_became_active":"2023-08-17T00:13:10.142517+0000","last_became_peered":"2023-08-17T00:13:10.142517+0000","last_unstale":"2023-08-17T00:13:10.148163+0000","last_undegraded":"2023-08-17T00:13:10.148163+0000","last_fullsized":"2023-08-17T00:13:10.148163+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.126719+0000","last_change":"2023-08-17T00:13:09.706589+0000","last_active":"2023-08-17T00:13:10.126719+0000","last_peered":"2023-08-17T00:13:10.126719+0000","last_clean":"2023-08-17T00:13:10.126719+0000","last_became_active":"2023-08-17T00:13:09.706237+0000","last_became_peered":"2023-08-17T00:13:09.706237+0000","last_unstale":"2023-08-17T00:13:10.126719+0000","last_undegraded":"2023-08-17T00:13:10.126719+0000","last_fullsized":"2023-08-17T00:13:10.126719+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152713+0000","last_change":"2023-08-17T00:13:10.141842+0000","last_active":"2023-08-17T00:13:10.152713+0000","last_peered":"2023-08-17T00:13:10.152713+0000","last_clean":"2023-08-17T00:13:10.152713+0000","last_became_active":"2023-08-17T00:13:10.141585+0000","last_became_peered":"2023-08-17T00:13:10.141585+0000","last_unstale":"2023-08-17T00:13:10.152713+0000","last_undegraded":"2023-08-17T00:13:10.152713+0000","last_fullsized":"2023-08-17T00:13:10.152713+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117737+0000","last_change":"2023-08-17T00:13:09.704483+0000","last_active":"2023-08-17T00:13:10.117737+0000","last_peered":"2023-08-17T00:13:10.117737+0000","last_clean":"2023-08-17T00:13:10.117737+0000","last_became_active":"2023-08-17T00:13:09.703730+0000","last_became_peered":"2023-08-17T00:13:09.703730+0000","last_unstale":"2023-08-17T00:13:10.117737+0000","last_undegraded":"2023-08-17T00:13:10.117737+0000","last_fullsized":"2023-08-17T00:13:10.117737+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144965+0000","last_change":"2023-08-17T00:13:10.143200+0000","last_active":"2023-08-17T00:13:10.144965+0000","last_peered":"2023-08-17T00:13:10.144965+0000","last_clean":"2023-08-17T00:13:10.144965+0000","last_became_active":"2023-08-17T00:13:10.142765+0000","last_became_peered":"2023-08-17T00:13:10.142765+0000","last_unstale":"2023-08-17T00:13:10.144965+0000","last_undegraded":"2023-08-17T00:13:10.144965+0000","last_fullsized":"2023-08-17T00:13:10.144965+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.128314+0000","last_change":"2023-08-17T00:13:09.708701+0000","last_active":"2023-08-17T00:13:10.128314+0000","last_peered":"2023-08-17T00:13:10.128314+0000","last_clean":"2023-08-17T00:13:10.128314+0000","last_became_active":"2023-08-17T00:13:09.708348+0000","last_became_peered":"2023-08-17T00:13:09.708348+0000","last_unstale":"2023-08-17T00:13:10.128314+0000","last_undegraded":"2023-08-17T00:13:10.128314+0000","last_fullsized":"2023-08-17T00:13:10.128314+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.148158+0000","last_change":"2023-08-17T00:13:10.144652+0000","last_active":"2023-08-17T00:13:10.148158+0000","last_peered":"2023-08-17T00:13:10.148158+0000","last_clean":"2023-08-17T00:13:10.148158+0000","last_became_active":"2023-08-17T00:13:10.144316+0000","last_became_peered":"2023-08-17T00:13:10.144316+0000","last_unstale":"2023-08-17T00:13:10.148158+0000","last_undegraded":"2023-08-17T00:13:10.148158+0000","last_fullsized":"2023-08-17T00:13:10.148158+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125729+0000","last_change":"2023-08-17T00:13:09.718852+0000","last_active":"2023-08-17T00:13:10.125729+0000","last_peered":"2023-08-17T00:13:10.125729+0000","last_clean":"2023-08-17T00:13:10.125729+0000","last_became_active":"2023-08-17T00:13:09.718531+0000","last_became_peered":"2023-08-17T00:13:09.718531+0000","last_unstale":"2023-08-17T00:13:10.125729+0000","last_undegraded":"2023-08-17T00:13:10.125729+0000","last_fullsized":"2023-08-17T00:13:10.125729+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143561+0000","last_change":"2023-08-17T00:13:10.139228+0000","last_active":"2023-08-17T00:13:10.143561+0000","last_peered":"2023-08-17T00:13:10.143561+0000","last_clean":"2023-08-17T00:13:10.143561+0000","last_became_active":"2023-08-17T00:13:10.138796+0000","last_became_peered":"2023-08-17T00:13:10.138796+0000","last_unstale":"2023-08-17T00:13:10.143561+0000","last_undegraded":"2023-08-17T00:13:10.143561+0000","last_fullsized":"2023-08-17T00:13:10.143561+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.126107+0000","last_change":"2023-08-17T00:13:09.722082+0000","last_active":"2023-08-17T00:13:10.126107+0000","last_peered":"2023-08-17T00:13:10.126107+0000","last_clean":"2023-08-17T00:13:10.126107+0000","last_became_active":"2023-08-17T00:13:09.721794+0000","last_became_peered":"2023-08-17T00:13:09.721794+0000","last_unstale":"2023-08-17T00:13:10.126107+0000","last_undegraded":"2023-08-17T00:13:10.126107+0000","last_fullsized":"2023-08-17T00:13:10.126107+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.143677+0000","last_change":"2023-08-17T00:13:10.141732+0000","last_active":"2023-08-17T00:13:10.143677+0000","last_peered":"2023-08-17T00:13:10.143677+0000","last_clean":"2023-08-17T00:13:10.143677+0000","last_became_active":"2023-08-17T00:13:10.141380+0000","last_became_peered":"2023-08-17T00:13:10.141380+0000","last_unstale":"2023-08-17T00:13:10.143677+0000","last_undegraded":"2023-08-17T00:13:10.143677+0000","last_fullsized":"2023-08-17T00:13:10.143677+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.127395+0000","last_change":"2023-08-17T00:13:09.717558+0000","last_active":"2023-08-17T00:13:10.127395+0000","last_peered":"2023-08-17T00:13:10.127395+0000","last_clean":"2023-08-17T00:13:10.127395+0000","last_became_active":"2023-08-17T00:13:09.717281+0000","last_became_peered":"2023-08-17T00:13:09.717281+0000","last_unstale":"2023-08-17T00:13:10.127395+0000","last_undegraded":"2023-08-17T00:13:10.127395+0000","last_fullsized":"2023-08-17T00:13:10.127395+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144671+0000","last_change":"2023-08-17T00:13:10.133242+0000","last_active":"2023-08-17T00:13:10.144671+0000","last_peered":"2023-08-17T00:13:10.144671+0000","last_clean":"2023-08-17T00:13:10.144671+0000","last_became_active":"2023-08-17T00:13:10.130866+0000","last_became_peered":"2023-08-17T00:13:10.130866+0000","last_unstale":"2023-08-17T00:13:10.144671+0000","last_undegraded":"2023-08-17T00:13:10.144671+0000","last_fullsized":"2023-08-17T00:13:10.144671+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.129607+0000","last_change":"2023-08-17T00:13:09.721642+0000","last_active":"2023-08-17T00:13:10.129607+0000","last_peered":"2023-08-17T00:13:10.129607+0000","last_clean":"2023-08-17T00:13:10.129607+0000","last_became_active":"2023-08-17T00:13:09.721335+0000","last_became_peered":"2023-08-17T00:13:09.721335+0000","last_unstale":"2023-08-17T00:13:10.129607+0000","last_undegraded":"2023-08-17T00:13:10.129607+0000","last_fullsized":"2023-08-17T00:13:10.129607+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.147318+0000","last_change":"2023-08-17T00:13:10.145338+0000","last_active":"2023-08-17T00:13:10.147318+0000","last_peered":"2023-08-17T00:13:10.147318+0000","last_clean":"2023-08-17T00:13:10.147318+0000","last_became_active":"2023-08-17T00:13:10.145053+0000","last_became_peered":"2023-08-17T00:13:10.145053+0000","last_unstale":"2023-08-17T00:13:10.147318+0000","last_undegraded":"2023-08-17T00:13:10.147318+0000","last_fullsized":"2023-08-17T00:13:10.147318+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124215+0000","last_change":"2023-08-17T00:13:09.703795+0000","last_active":"2023-08-17T00:13:10.124215+0000","last_peered":"2023-08-17T00:13:10.124215+0000","last_clean":"2023-08-17T00:13:10.124215+0000","last_became_active":"2023-08-17T00:13:09.703457+0000","last_became_peered":"2023-08-17T00:13:09.703457+0000","last_unstale":"2023-08-17T00:13:10.124215+0000","last_undegraded":"2023-08-17T00:13:10.124215+0000","last_fullsized":"2023-08-17T00:13:10.124215+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.118142+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:13:10.118142+0000","last_peered":"2023-08-17T00:13:10.118142+0000","last_clean":"2023-08-17T00:13:10.118142+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:13:10.118142+0000","last_undegraded":"2023-08-17T00:13:10.118142+0000","last_fullsized":"2023-08-17T00:13:10.118142+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149720+0000","last_change":"2023-08-17T00:13:10.138302+0000","last_active":"2023-08-17T00:13:10.149720+0000","last_peered":"2023-08-17T00:13:10.149720+0000","last_clean":"2023-08-17T00:13:10.149720+0000","last_became_active":"2023-08-17T00:13:10.138028+0000","last_became_peered":"2023-08-17T00:13:10.138028+0000","last_unstale":"2023-08-17T00:13:10.149720+0000","last_undegraded":"2023-08-17T00:13:10.149720+0000","last_fullsized":"2023-08-17T00:13:10.149720+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124779+0000","last_change":"2023-08-17T00:13:09.715879+0000","last_active":"2023-08-17T00:13:10.124779+0000","last_peered":"2023-08-17T00:13:10.124779+0000","last_clean":"2023-08-17T00:13:10.124779+0000","last_became_active":"2023-08-17T00:13:09.715627+0000","last_became_peered":"2023-08-17T00:13:09.715627+0000","last_unstale":"2023-08-17T00:13:10.124779+0000","last_undegraded":"2023-08-17T00:13:10.124779+0000","last_fullsized":"2023-08-17T00:13:10.124779+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":131,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.124304+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:13:10.124304+0000","last_peered":"2023-08-17T00:13:10.124304+0000","last_clean":"2023-08-17T00:13:10.124304+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:13:10.124304+0000","last_undegraded":"2023-08-17T00:13:10.124304+0000","last_fullsized":"2023-08-17T00:13:10.124304+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152633+0000","last_change":"2023-08-17T00:13:10.141097+0000","last_active":"2023-08-17T00:13:10.152633+0000","last_peered":"2023-08-17T00:13:10.152633+0000","last_clean":"2023-08-17T00:13:10.152633+0000","last_became_active":"2023-08-17T00:13:10.140794+0000","last_became_peered":"2023-08-17T00:13:10.140794+0000","last_unstale":"2023-08-17T00:13:10.152633+0000","last_undegraded":"2023-08-17T00:13:10.152633+0000","last_fullsized":"2023-08-17T00:13:10.152633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152530+0000","last_change":"2023-08-17T00:13:09.721055+0000","last_active":"2023-08-17T00:13:10.152530+0000","last_peered":"2023-08-17T00:13:10.152530+0000","last_clean":"2023-08-17T00:13:10.152530+0000","last_became_active":"2023-08-17T00:13:09.720403+0000","last_became_peered":"2023-08-17T00:13:09.720403+0000","last_unstale":"2023-08-17T00:13:10.152530+0000","last_undegraded":"2023-08-17T00:13:10.152530+0000","last_fullsized":"2023-08-17T00:13:10.152530+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117999+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:13:10.117999+0000","last_peered":"2023-08-17T00:13:10.117999+0000","last_clean":"2023-08-17T00:13:10.117999+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:13:10.117999+0000","last_undegraded":"2023-08-17T00:13:10.117999+0000","last_fullsized":"2023-08-17T00:13:10.117999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150050+0000","last_change":"2023-08-17T00:13:10.144544+0000","last_active":"2023-08-17T00:13:10.150050+0000","last_peered":"2023-08-17T00:13:10.150050+0000","last_clean":"2023-08-17T00:13:10.150050+0000","last_became_active":"2023-08-17T00:13:10.144287+0000","last_became_peered":"2023-08-17T00:13:10.144287+0000","last_unstale":"2023-08-17T00:13:10.150050+0000","last_undegraded":"2023-08-17T00:13:10.150050+0000","last_fullsized":"2023-08-17T00:13:10.150050+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150635+0000","last_change":"2023-08-17T00:13:09.702572+0000","last_active":"2023-08-17T00:13:10.150635+0000","last_peered":"2023-08-17T00:13:10.150635+0000","last_clean":"2023-08-17T00:13:10.150635+0000","last_became_active":"2023-08-17T00:13:09.702233+0000","last_became_peered":"2023-08-17T00:13:09.702233+0000","last_unstale":"2023-08-17T00:13:10.150635+0000","last_undegraded":"2023-08-17T00:13:10.150635+0000","last_fullsized":"2023-08-17T00:13:10.150635+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":125,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125354+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:13:10.125354+0000","last_peered":"2023-08-17T00:13:10.125354+0000","last_clean":"2023-08-17T00:13:10.125354+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:13:10.125354+0000","last_undegraded":"2023-08-17T00:13:10.125354+0000","last_fullsized":"2023-08-17T00:13:10.125354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144542+0000","last_change":"2023-08-17T00:13:10.138381+0000","last_active":"2023-08-17T00:13:10.144542+0000","last_peered":"2023-08-17T00:13:10.144542+0000","last_clean":"2023-08-17T00:13:10.144542+0000","last_became_active":"2023-08-17T00:13:10.138124+0000","last_became_peered":"2023-08-17T00:13:10.138124+0000","last_unstale":"2023-08-17T00:13:10.144542+0000","last_undegraded":"2023-08-17T00:13:10.144542+0000","last_fullsized":"2023-08-17T00:13:10.144542+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.13","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.144042+0000","last_change":"2023-08-17T00:13:09.708713+0000","last_active":"2023-08-17T00:13:10.144042+0000","last_peered":"2023-08-17T00:13:10.144042+0000","last_clean":"2023-08-17T00:13:10.144042+0000","last_became_active":"2023-08-17T00:13:09.708443+0000","last_became_peered":"2023-08-17T00:13:09.708443+0000","last_unstale":"2023-08-17T00:13:10.144042+0000","last_undegraded":"2023-08-17T00:13:10.144042+0000","last_fullsized":"2023-08-17T00:13:10.144042+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117078+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:13:10.117078+0000","last_peered":"2023-08-17T00:13:10.117078+0000","last_clean":"2023-08-17T00:13:10.117078+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:13:10.117078+0000","last_undegraded":"2023-08-17T00:13:10.117078+0000","last_fullsized":"2023-08-17T00:13:10.117078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.152197+0000","last_change":"2023-08-17T00:13:10.150737+0000","last_active":"2023-08-17T00:13:10.152197+0000","last_peered":"2023-08-17T00:13:10.152197+0000","last_clean":"2023-08-17T00:13:10.152197+0000","last_became_active":"2023-08-17T00:13:10.150428+0000","last_became_peered":"2023-08-17T00:13:10.150428+0000","last_unstale":"2023-08-17T00:13:10.152197+0000","last_undegraded":"2023-08-17T00:13:10.152197+0000","last_fullsized":"2023-08-17T00:13:10.152197+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.153508+0000","last_change":"2023-08-17T00:13:09.723948+0000","last_active":"2023-08-17T00:13:10.153508+0000","last_peered":"2023-08-17T00:13:10.153508+0000","last_clean":"2023-08-17T00:13:10.153508+0000","last_became_active":"2023-08-17T00:13:09.723616+0000","last_became_peered":"2023-08-17T00:13:09.723616+0000","last_unstale":"2023-08-17T00:13:10.153508+0000","last_undegraded":"2023-08-17T00:13:10.153508+0000","last_fullsized":"2023-08-17T00:13:10.153508+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":109,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.131404+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:13:10.131404+0000","last_peered":"2023-08-17T00:13:10.131404+0000","last_clean":"2023-08-17T00:13:10.131404+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:13:10.131404+0000","last_undegraded":"2023-08-17T00:13:10.131404+0000","last_fullsized":"2023-08-17T00:13:10.131404+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.149740+0000","last_change":"2023-08-17T00:13:10.146467+0000","last_active":"2023-08-17T00:13:10.149740+0000","last_peered":"2023-08-17T00:13:10.149740+0000","last_clean":"2023-08-17T00:13:10.149740+0000","last_became_active":"2023-08-17T00:13:10.146215+0000","last_became_peered":"2023-08-17T00:13:10.146215+0000","last_unstale":"2023-08-17T00:13:10.149740+0000","last_undegraded":"2023-08-17T00:13:10.149740+0000","last_fullsized":"2023-08-17T00:13:10.149740+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.123413+0000","last_change":"2023-08-17T00:13:09.710007+0000","last_active":"2023-08-17T00:13:10.123413+0000","last_peered":"2023-08-17T00:13:10.123413+0000","last_clean":"2023-08-17T00:13:10.123413+0000","last_became_active":"2023-08-17T00:13:09.709726+0000","last_became_peered":"2023-08-17T00:13:09.709726+0000","last_unstale":"2023-08-17T00:13:10.123413+0000","last_undegraded":"2023-08-17T00:13:10.123413+0000","last_fullsized":"2023-08-17T00:13:10.123413+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.117697+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:13:10.117697+0000","last_peered":"2023-08-17T00:13:10.117697+0000","last_clean":"2023-08-17T00:13:10.117697+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:13:10.117697+0000","last_undegraded":"2023-08-17T00:13:10.117697+0000","last_fullsized":"2023-08-17T00:13:10.117697+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.150197+0000","last_change":"2023-08-17T00:13:10.147360+0000","last_active":"2023-08-17T00:13:10.150197+0000","last_peered":"2023-08-17T00:13:10.150197+0000","last_clean":"2023-08-17T00:13:10.150197+0000","last_became_active":"2023-08-17T00:13:10.147105+0000","last_became_peered":"2023-08-17T00:13:10.147105+0000","last_unstale":"2023-08-17T00:13:10.150197+0000","last_undegraded":"2023-08-17T00:13:10.150197+0000","last_fullsized":"2023-08-17T00:13:10.150197+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:09.672434+0000","last_clean_scrub_stamp":"2023-08-17T00:13:09.672434+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.116969+0000","last_change":"2023-08-17T00:13:09.711131+0000","last_active":"2023-08-17T00:13:10.116969+0000","last_peered":"2023-08-17T00:13:10.116969+0000","last_clean":"2023-08-17T00:13:10.116969+0000","last_became_active":"2023-08-17T00:13:09.710806+0000","last_became_peered":"2023-08-17T00:13:09.710806+0000","last_unstale":"2023-08-17T00:13:10.116969+0000","last_undegraded":"2023-08-17T00:13:10.116969+0000","last_fullsized":"2023-08-17T00:13:10.116969+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:13:08.660930+0000","last_clean_scrub_stamp":"2023-08-17T00:13:08.660930+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":110,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.118318+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:13:10.118318+0000","last_peered":"2023-08-17T00:13:10.118318+0000","last_clean":"2023-08-17T00:13:10.118318+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:13:10.118318+0000","last_undegraded":"2023-08-17T00:13:10.118318+0000","last_fullsized":"2023-08-17T00:13:10.118318+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":112,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-08-17T00:13:10.125759+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:13:10.125759+0000","last_peered":"2023-08-17T00:13:10.125759+0000","last_clean":"2023-08-17T00:13:10.125759+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:13:10.125759+0000","last_undegraded":"2023-08-17T00:13:10.125759+0000","last_fullsized":"2023-08-17T00:13:10.125759+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542273,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311212,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060628,"statfs":{"total":96636764160,"available":96318083072,"internally_reserved":0,"allocated":1740800,"data_stored":815343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.95499999999999996,"5min":0.98199999999999998,"15min":1.2090000000000001},"min":{"1min":0.52900000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2210000000000001,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.89900000000000002,"5min":1.036,"15min":1.2529999999999999},"min":{"1min":0.57899999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3169999999999999,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":1.04}]},{"osd":1,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":1.0580000000000001,"15min":1.272},"min":{"1min":0.627,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.2769999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.097,"15min":1.2749999999999999},"min":{"1min":0.59599999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.7669999999999999,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.254}]},{"osd":2,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.028,"15min":1.1819999999999999},"min":{"1min":0.65200000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1.276,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.298},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.1240000000000001,"15min":1.3169999999999999},"min":{"1min":0.629,"5min":0.58099999999999996,"15min":0.57899999999999996},"max":{"1min":1.4199999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.1990000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.095,"15min":1.226},"min":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.2509999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.1819999999999999,"15min":1.4790000000000001},"min":{"1min":0.78100000000000003,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.359,"5min":1.952,"15min":13.074999999999999},"last":1.272}]},{"osd":4,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.1539999999999999,"15min":1.4350000000000001},"min":{"1min":0.70799999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.3799999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.1279999999999999,"15min":1.3700000000000001},"min":{"1min":0.80200000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.3380000000000001,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.012}]},{"osd":5,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.226,"15min":1.5569999999999999},"min":{"1min":0.83599999999999997,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.482,"5min":2.9830000000000001,"15min":14.435},"last":0.876},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.226,"15min":1.526},"min":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.502,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.3540000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:03 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2969999999999999,"15min":1.556},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5920000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.417},{"interface":"front","average":{"1min":1.1140000000000001,"5min":1.2270000000000001,"15min":1.48},"min":{"1min":0.89200000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.411,"5min":2.4350000000000001,"15min":11.365},"last":1.1140000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311216,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060624,"statfs":{"total":96636764160,"available":96318078976,"internally_reserved":0,"allocated":1744896,"data_stored":815377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.032,"15min":1.056},"min":{"1min":0.53800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.367,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":1.335},{"interface":"front","average":{"1min":1.056,"5min":1.1200000000000001,"15min":1.1339999999999999},"min":{"1min":0.70499999999999996,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4139999999999999,"5min":10.519,"15min":10.519},"last":1.2110000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.147,"15min":1.143},"min":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.3500000000000001,"5min":10.704000000000001,"15min":10.704000000000001},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0209999999999999,"15min":1.0409999999999999},"min":{"1min":0.66900000000000004,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4530000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.1319999999999999,"15min":1.161},"min":{"1min":0.71199999999999997,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.506,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.23},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2909999999999999,"15min":1.2809999999999999},"min":{"1min":0.72999999999999998,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5489999999999999,"5min":10.669,"15min":10.669},"last":1.4419999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.119,"15min":1.171},"min":{"1min":0.81000000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.5860000000000001,"5min":1.9319999999999999,"15min":11.475},"last":1.458},{"interface":"front","average":{"1min":1.147,"5min":1.2310000000000001,"15min":1.252},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":1.266}]},{"osd":4,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.296,"15min":1.278},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.571,"5min":10.632,"15min":10.632},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.2,"15min":1.236},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.7350000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":1.157}]},{"osd":5,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.2490000000000001,"15min":1.2569999999999999},"min":{"1min":0.80500000000000005,"5min":0.65800000000000003,"15min":0.40899999999999997},"max":{"1min":1.5880000000000001,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.413,"15min":1.3720000000000001},"min":{"1min":0.89000000000000001,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.7310000000000001,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.3009999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:13:04 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.2969999999999999,"15min":1.329},"min":{"1min":0.77400000000000002,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.788,"5min":3.3450000000000002,"15min":11.51},"last":1.357},{"interface":"front","average":{"1min":1.286,"5min":1.377,"15min":1.4019999999999999},"min":{"1min":1.03,"5min":0.72399999999999998,"15min":0.66900000000000004},"max":{"1min":1.704,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.1890000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542274,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98399999999999999,"15min":1.3220000000000001},"min":{"1min":0.62,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4870000000000001,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.0349999999999999,"15min":1.4350000000000001},"min":{"1min":0.67500000000000004,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.2050000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0389999999999999,"15min":1.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.498},"max":{"1min":1.423,"5min":1.5509999999999999,"15min":4.2270000000000003},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.1220000000000001,"5min":1.113,"15min":1.3220000000000001},"min":{"1min":0.72899999999999998,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.5760000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.153,"15min":1.4990000000000001},"min":{"1min":0.82199999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":4.2750000000000004,"5min":4.2750000000000004,"15min":16.675000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1140000000000001,"15min":1.3879999999999999},"min":{"1min":0.85599999999999998,"5min":0.66000000000000003,"15min":0.60299999999999998},"max":{"1min":1.522,"5min":1.796,"15min":11.949},"last":1.2350000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.171,"15min":1.4399999999999999},"min":{"1min":0.747,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":4.3250000000000002,"5min":4.3250000000000002,"15min":13.125},"last":1.044},{"interface":"front","average":{"1min":1.206,"5min":1.1799999999999999,"15min":1.3740000000000001},"min":{"1min":0.82399999999999995,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":2.306,"5min":2.306,"15min":8.4809999999999999},"last":1.319}]},{"osd":4,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.149,"15min":1.532},"min":{"1min":0.68700000000000006,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.458,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.2310000000000001,"15min":1.6579999999999999},"min":{"1min":0.78300000000000003,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":4.8170000000000002,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.141}]},{"osd":6,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.236,"15min":1.627},"min":{"1min":0.81499999999999995,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.466},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2330000000000001,"15min":1.627},"min":{"1min":0.92900000000000005,"5min":0.68600000000000005,"15min":0.64400000000000002},"max":{"1min":1.5369999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.292}]},{"osd":7,"last update":"Thu Aug 17 00:13:02 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.3240000000000001,"15min":1.742},"min":{"1min":0.94999999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":5.2130000000000001,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.272},{"interface":"front","average":{"1min":1.323,"5min":1.345,"15min":1.6839999999999999},"min":{"1min":0.79800000000000004,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.0019999999999998,"5min":2.0899999999999999,"15min":14.818},"last":1.4219999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542273,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307116,"kb_used_data":1700,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064724,"statfs":{"total":96636764160,"available":96322277376,"internally_reserved":0,"allocated":1740800,"data_stored":815343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76900000000000002,"15min":0.78700000000000003},"min":{"1min":0.54200000000000004,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.3320000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86299999999999999,"15min":0.85499999999999998},"min":{"1min":0.55400000000000005,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.194,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.145}]},{"osd":1,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.83899999999999997,"15min":0.81100000000000005},"min":{"1min":0.53700000000000003,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.423,"5min":11.215999999999999,"15min":11.215999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.83899999999999997,"15min":0.90200000000000002},"min":{"1min":0.47499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.7810000000000001,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.86699999999999999,"15min":0.90700000000000003},"min":{"1min":0.499,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.2869999999999999,"5min":2.0270000000000001,"15min":2.0270000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.96799999999999997,"15min":1.0329999999999999},"min":{"1min":0.499,"5min":0.433,"15min":0.433},"max":{"1min":1.359,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.046}]},{"osd":4,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1439999999999999,"15min":1.198},"min":{"1min":0.74199999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.498,"5min":2.274,"15min":3.9449999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.143,"15min":1.206},"min":{"1min":0.749,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5860000000000001,"5min":1.649,"15min":3.9790000000000001},"last":1.21}]},{"osd":5,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1200000000000001,"15min":1.2090000000000001},"min":{"1min":0.80700000000000005,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.337},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.1850000000000001,"15min":1.2569999999999999},"min":{"1min":0.89000000000000001,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6459999999999999,"5min":1.669,"15min":2.6789999999999998},"last":1.1890000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1399999999999999,"15min":1.236},"min":{"1min":0.629,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.603,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.127},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.206},"min":{"1min":0.83099999999999996,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.6899999999999999,"5min":2.0979999999999999,"15min":3.585},"last":1.3959999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:13:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.206,"15min":1.2410000000000001},"min":{"1min":0.86399999999999999,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.6319999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.1599999999999999,"15min":1.2310000000000001},"min":{"1min":0.84499999999999997,"5min":0.64100000000000001,"15min":0.64000000000000001},"max":{"1min":1.679,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.4199999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542273,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.748,"15min":0.82299999999999995},"min":{"1min":0.439,"5min":0.36499999999999999,"15min":0.34599999999999997},"max":{"1min":1.103,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.77000000000000002,"15min":0.91800000000000004},"min":{"1min":0.435,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.278,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.82599999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79900000000000004,"15min":0.879},"min":{"1min":0.47499999999999998,"5min":0.45400000000000001,"15min":0.35999999999999999},"max":{"1min":1.327,"5min":2.097,"15min":3.7589999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.044,"5min":0.92100000000000004,"15min":1.036},"min":{"1min":0.62,"5min":0.376,"15min":0.376},"max":{"1min":1.54,"5min":1.54,"15min":3.911},"last":1.5389999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":0.90100000000000002,"15min":1.0980000000000001},"min":{"1min":0.66800000000000004,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":1.034},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.88400000000000001,"15min":0.97699999999999998},"min":{"1min":0.59599999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.4049999999999998,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0580000000000001,"15min":1.5149999999999999},"min":{"1min":0.70499999999999996,"5min":0.69999999999999996,"15min":0.48399999999999999},"max":{"1min":1.51,"5min":1.794,"15min":16.521000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.141,"15min":1.4239999999999999},"min":{"1min":0.79000000000000004,"5min":0.61499999999999999,"15min":0.60099999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":8.4399999999999995},"last":1.3300000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.258,"15min":1.5529999999999999},"min":{"1min":0.82899999999999996,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.873,"5min":1.873,"15min":12.914},"last":1.6279999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.206,"15min":1.405},"min":{"1min":0.84999999999999998,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.4690000000000001,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.286}]},{"osd":6,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.1459999999999999,"15min":1.4910000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.615,"5min":1.621,"15min":13.864000000000001},"last":1.111},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.248,"15min":1.55},"min":{"1min":0.92600000000000005,"5min":0.84499999999999997,"15min":0.71799999999999997},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.454}]},{"osd":7,"last update":"Thu Aug 17 00:13:10 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2649999999999999,"15min":1.528},"min":{"1min":0.86599999999999999,"5min":0.748,"15min":0.69599999999999995},"max":{"1min":1.609,"5min":2.6779999999999999,"15min":10.592000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.282,"15min":1.5389999999999999},"min":{"1min":0.93899999999999995,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.694,"5min":1.9159999999999999,"15min":11.417},"last":1.3759999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542273,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303036,"kb_used_data":1716,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068804,"statfs":{"total":96636764160,"available":96326455296,"internally_reserved":0,"allocated":1757184,"data_stored":816969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.82299999999999995},"min":{"1min":0.53200000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.298,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.82099999999999995,"15min":0.90100000000000002},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2170000000000001,"5min":1.367,"15min":13.093},"last":1}]},{"osd":2,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.76500000000000001,"15min":0.80800000000000005},"min":{"1min":0.60299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":1.3420000000000001,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83899999999999997,"15min":0.89000000000000001},"min":{"1min":0.54400000000000004,"5min":0.432,"15min":0.432},"max":{"1min":1.365,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.94699999999999995,"15min":1.0169999999999999},"min":{"1min":0.56699999999999995,"5min":0.437,"15min":0.437},"max":{"1min":1.4630000000000001,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.86099999999999999,"15min":0.96399999999999997},"min":{"1min":0.47399999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.26,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.81000000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.036,"15min":1.1539999999999999},"min":{"1min":0.68300000000000005,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.671,"5min":1.671,"15min":20.548999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.125,"15min":1.21},"min":{"1min":0.81999999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.764,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.1539999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.1870000000000001,"15min":1.3140000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5309999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1799999999999999,"15min":1.2529999999999999},"min":{"1min":0.79500000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7470000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.135}]},{"osd":6,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1779999999999999,"15min":1.2569999999999999},"min":{"1min":0.81000000000000005,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8029999999999999,"5min":3.2610000000000001,"15min":13.050000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.181,"5min":1.1599999999999999,"15min":1.21},"min":{"1min":0.92300000000000004,"5min":0.78500000000000003,"15min":0.77800000000000002},"max":{"1min":1.6990000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.0429999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:12:56 2023","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.25,"15min":1.3129999999999999},"min":{"1min":0.97699999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.9179999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.242,"15min":1.3440000000000001},"min":{"1min":0.91000000000000003,"5min":0.84399999999999997,"15min":0.84399999999999997},"max":{"1min":1.6399999999999999,"5min":3.4180000000000001,"15min":13.131},"last":1.1970000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307136,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064704,"statfs":{"total":96636764160,"available":96322256896,"internally_reserved":0,"allocated":1761280,"data_stored":817523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.95099999999999996,"15min":0.83799999999999997},"min":{"1min":0.45700000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.4830000000000001,"5min":18.442,"15min":18.442},"last":1.212},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.89800000000000002,"15min":0.83299999999999996},"min":{"1min":0.54300000000000004,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":1.5669999999999999,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":1.04,"15min":0.94399999999999995},"min":{"1min":0.51000000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.208,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.95099999999999996,"15min":0.91000000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0469999999999999,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.93600000000000005}]},{"osd":3,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.85899999999999999,"15min":0.85799999999999998},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.5840000000000001,"5min":1.613,"15min":1.613},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.0629999999999999,"5min":1.167,"15min":1.0700000000000001},"min":{"1min":0.63900000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.9079999999999999,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.0680000000000001,"15min":1.099},"min":{"1min":0.69099999999999995,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.728,"5min":1.728,"15min":1.7609999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.343,"15min":1.2529999999999999},"min":{"1min":0.80000000000000004,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.4099999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.355}]},{"osd":5,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3799999999999999,"15min":1.304},"min":{"1min":0.88,"5min":0.73599999999999999,"15min":0.67700000000000005},"max":{"1min":1.9199999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.2010000000000001,"15min":1.2529999999999999},"min":{"1min":0.85799999999999998,"5min":0.70399999999999996,"15min":0.63200000000000001},"max":{"1min":1.754,"5min":1.984,"15min":1.984},"last":1.1830000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.3759999999999999,"15min":1.3169999999999999},"min":{"1min":1.081,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.6859999999999999,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.397},{"interface":"front","average":{"1min":1.194,"5min":1.3600000000000001,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4790000000000001,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.089}]},{"osd":7,"last update":"Thu Aug 17 00:13:06 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.3959999999999999,"15min":1.3080000000000001},"min":{"1min":0.94999999999999996,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.6579999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.1639999999999999,"15min":1.2230000000000001},"min":{"1min":0.93200000000000005,"5min":0.69399999999999995,"15min":0.60199999999999998},"max":{"1min":1.786,"5min":1.804,"15min":2.0750000000000002},"last":1.0740000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574978,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307124,"kb_used_data":1708,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064716,"statfs":{"total":96636764160,"available":96322269184,"internally_reserved":0,"allocated":1748992,"data_stored":815967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0349999999999999,"15min":1.0800000000000001},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.38300000000000001},"max":{"1min":1.2889999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.097,"15min":1.069},"min":{"1min":0.62,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":2.5539999999999998,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":0.91400000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.2250000000000001,"15min":1.23},"min":{"1min":0.49099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.5229999999999999,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.198},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.1819999999999999,"15min":1.242},"min":{"1min":0.65100000000000002,"5min":0.63200000000000001,"15min":0.48099999999999998},"max":{"1min":1.5129999999999999,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.2629999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1220000000000001,"15min":1.236},"min":{"1min":0.74199999999999999,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.7030000000000001,"5min":6.6500000000000004,"15min":18.431000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.083,"15min":1.3340000000000001},"min":{"1min":0.79500000000000004,"5min":0.64600000000000002,"15min":0.36699999999999999},"max":{"1min":1.623,"5min":1.738,"15min":36.531999999999996},"last":0.98899999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.0980000000000001,"15min":1.133},"min":{"1min":0.751,"5min":0.73099999999999998,"15min":0.60699999999999998},"max":{"1min":2.9889999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.224},{"interface":"front","average":{"1min":1.155,"5min":1.2290000000000001,"15min":1.411},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.40400000000000003},"max":{"1min":1.7569999999999999,"5min":6.6920000000000002,"15min":36.530000000000001},"last":1.4099999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.23,"15min":1.246},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.462,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.363},{"interface":"front","average":{"1min":1.244,"5min":1.268,"15min":1.302},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":3.2519999999999998,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2929999999999999,"15min":1.3520000000000001},"min":{"1min":0.73199999999999998,"5min":0.51300000000000001,"15min":0.44700000000000001},"max":{"1min":1.6080000000000001,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.546},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.3049999999999999,"15min":1.403},"min":{"1min":0.81399999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.526,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2949999999999999,"5min":1.21,"15min":1.2829999999999999},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":3.645,"5min":3.645,"15min":3.645},"last":1.506},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.3300000000000001,"15min":1.4179999999999999},"min":{"1min":0.68600000000000005,"5min":0.629,"15min":0.629},"max":{"1min":1.8009999999999999,"5min":6.7430000000000003,"15min":8.327},"last":1.7210000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:13:19.699 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:13:19.700 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:13:19.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.892+0000 7fb1428b9700 1 Processor -- start 2023-08-17T00:13:19.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1428b9700 1 -- start start 2023-08-17T00:13:19.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1428b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb13c153f50 0x7fb13c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1428b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb13c0c01a0 0x7fb13c0c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1428b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0bfd10 con 0x7fb13c0c57a0 2023-08-17T00:13:19.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1428b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c154860 con 0x7fb13c153f50 2023-08-17T00:13:19.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1428b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c154af0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1418b7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb13c0c57a0 0x7fb13c0c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50876/0 (socket says 172.21.15.153:50876) 2023-08-17T00:13:19.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1418b7700 1 -- 172.21.15.153:0/791140428 learned_addr learned my addr 172.21.15.153:0/791140428 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:19.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1410b6700 1 --2- 172.21.15.153:0/791140428 >> v2:172.21.15.153:3300/0 conn(0x7fb13c153f50 0x7fb13c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1420b8700 1 --2- 172.21.15.153:0/791140428 >> v2:172.21.15.178:3300/0 conn(0x7fb13c0c01a0 0x7fb13c0c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1410b6700 1 -- 172.21.15.153:0/791140428 >> v2:172.21.15.178:3300/0 conn(0x7fb13c0c01a0 msgr2=0x7fb13c0c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1410b6700 1 --2- 172.21.15.153:0/791140428 >> v2:172.21.15.178:3300/0 conn(0x7fb13c0c01a0 0x7fb13c0c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1410b6700 1 -- 172.21.15.153:0/791140428 >> v1:172.21.15.153:6789/0 conn(0x7fb13c0c57a0 legacy=0x7fb13c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1410b6700 1 -- 172.21.15.153:0/791140428 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c154dd0 con 0x7fb13c153f50 2023-08-17T00:13:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.896+0000 7fb1410b6700 1 --2- 172.21.15.153:0/791140428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c153f50 0x7fb13c154370 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fb13c06a440 tx=0x7fb12c009060).ready entity=mon.0 client_cookie=44e089dfcf76865a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:19.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1408b5700 1 -- 172.21.15.153:0/791140428 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c00f510 con 0x7fb13c153f50 2023-08-17T00:13:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1408b5700 1 -- 172.21.15.153:0/791140428 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c00f670 con 0x7fb13c153f50 2023-08-17T00:13:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1408b5700 1 -- 172.21.15.153:0/791140428 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c00f9f0 con 0x7fb13c153f50 2023-08-17T00:13:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 -- 172.21.15.153:0/791140428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c153f50 msgr2=0x7fb13c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 --2- 172.21.15.153:0/791140428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c153f50 0x7fb13c154370 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7fb13c06a440 tx=0x7fb12c009060).stop 2023-08-17T00:13:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 -- 172.21.15.153:0/791140428 shutdown_connections 2023-08-17T00:13:19.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 --2- 172.21.15.153:0/791140428 >> v2:172.21.15.178:3300/0 conn(0x7fb13c0c01a0 0x7fb13c0c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 --2- 172.21.15.153:0/791140428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c153f50 0x7fb13c154370 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 -- 172.21.15.153:0/791140428 >> 172.21.15.153:0/791140428 conn(0x7fb13c062a70 msgr2=0x7fb13c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:19.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 -- 172.21.15.153:0/791140428 shutdown_connections 2023-08-17T00:13:19.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.900+0000 7fb1428b9700 1 -- 172.21.15.153:0/791140428 wait complete. 2023-08-17T00:13:19.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.904+0000 7fb1428b9700 1 Processor -- start 2023-08-17T00:13:19.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.904+0000 7fb1428b9700 1 -- start start 2023-08-17T00:13:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 0x7fb13c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb13c0c57a0 0x7fb13c14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb13c153f50 0x7fb13c0c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0c2880 con 0x7fb13c0c01a0 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c151ad0 con 0x7fb13c153f50 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0c2ad0 con 0x7fb13c0c57a0 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 0x7fb13c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 0x7fb13c14a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51668/0 (socket says 172.21.15.153:51668) 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 -- 172.21.15.153:0/3149981752 learned_addr learned my addr 172.21.15.153:0/3149981752 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1410b6700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb13c0c57a0 0x7fb13c14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1420b8700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb13c153f50 0x7fb13c0c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 -- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb13c0c57a0 msgr2=0x7fb13c14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb13c0c57a0 0x7fb13c14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 -- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb13c153f50 msgr2=0x7fb13c0c3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb13c153f50 0x7fb13c0c3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 -- 172.21.15.153:0/3149981752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c0092a0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1410b6700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb13c0c57a0 0x7fb13c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1418b7700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 0x7fb13c14a870 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fb138007fd0 tx=0x7fb138007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1380072e0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb138007440 con 0x7fb13c0c01a0 2023-08-17T00:13:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1380057a0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c0c2db0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.908+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c0c3370 con 0x7fb13c0c01a0 2023-08-17T00:13:19.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.912+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c05dae0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.912+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb138010070 con 0x7fb13c0c01a0 2023-08-17T00:13:19.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.912+0000 7fb131ffb700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb12005a180 0x7fb12005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.912+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb1380737b0 con 0x7fb13c0c01a0 2023-08-17T00:13:19.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.912+0000 7fb1410b6700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb12005a180 0x7fb12005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:19.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.916+0000 7fb1410b6700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb12005a180 0x7fb12005c640 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fb13c0ca2b0 tx=0x7fb12c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:19.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:19.920+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb13c05dae0 con 0x7fb13c0c01a0 2023-08-17T00:13:20.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.132+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb13c05dae0 con 0x7fb13c0c01a0 2023-08-17T00:13:20.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.144+0000 7fb131ffb700 1 -- 172.21.15.153:0/3149981752 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb13c05dae0 con 0x7fb13c0c01a0 2023-08-17T00:13:20.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb12005a180 msgr2=0x7fb12005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb12005a180 0x7fb12005c640 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fb13c0ca2b0 tx=0x7fb12c017000).stop 2023-08-17T00:13:20.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 msgr2=0x7fb13c14a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 0x7fb13c14a870 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 rx=0x7fb138007fd0 tx=0x7fb138007df0).stop 2023-08-17T00:13:20.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 shutdown_connections 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb12005a180 0x7fb12005c640 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb13c153f50 0x7fb13c0c3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb13c0c57a0 0x7fb13c14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 --2- 172.21.15.153:0/3149981752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb13c0c01a0 0x7fb13c14a870 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 >> 172.21.15.153:0/3149981752 conn(0x7fb13c062a70 msgr2=0x7fb13c0ab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 shutdown_connections 2023-08-17T00:13:20.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.148+0000 7fb1428b9700 1 -- 172.21.15.153:0/3149981752 wait complete. 2023-08-17T00:13:20.156 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:13:20.175 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:20.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 Processor -- start 2023-08-17T00:13:20.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 -- start start 2023-08-17T00:13:20.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540632e0 0x7f1b540a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:20.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b540629b0 0x7f1b540bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:20.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b54065240 con 0x7f1b540a8b70 2023-08-17T00:13:20.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b54062e40 con 0x7f1b540629b0 2023-08-17T00:13:20.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b59369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540638a0 con 0x7f1b540632e0 2023-08-17T00:13:20.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b537fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b540629b0 0x7f1b540bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b537fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b540629b0 0x7f1b540bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:44772/0 (socket says 172.21.15.153:44772) 2023-08-17T00:13:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b537fe700 1 -- 172.21.15.153:0/1481868159 learned_addr learned my addr 172.21.15.153:0/1481868159 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.328+0000 7f1b4bfff700 1 --2- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540632e0 0x7f1b540a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b537fe700 1 -- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540632e0 msgr2=0x7f1b540a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b537fe700 1 --2- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540632e0 0x7f1b540a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b537fe700 1 -- 172.21.15.153:0/1481868159 >> v1:172.21.15.178:6789/0 conn(0x7f1b540a8b70 legacy=0x7f1b540656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b537fe700 1 -- 172.21.15.153:0/1481868159 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b54065de0 con 0x7f1b540629b0 2023-08-17T00:13:20.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b537fe700 1 --2- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b540bbdc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f1b4c009f20 tx=0x7f1b4c009840).ready entity=mon.1 client_cookie=5467edc694b8ac0e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:20.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b527fc700 1 -- 172.21.15.153:0/1481868159 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00e070 con 0x7f1b540629b0 2023-08-17T00:13:20.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b527fc700 1 -- 172.21.15.153:0/1481868159 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c00b9d0 con 0x7f1b540629b0 2023-08-17T00:13:20.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b527fc700 1 -- 172.21.15.153:0/1481868159 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00bd50 con 0x7f1b540629b0 2023-08-17T00:13:20.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 -- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 msgr2=0x7f1b540bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 --2- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b540bbdc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f1b4c009f20 tx=0x7f1b4c009840).stop 2023-08-17T00:13:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 -- 172.21.15.153:0/1481868159 shutdown_connections 2023-08-17T00:13:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 --2- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b540bbdc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 --2- 172.21.15.153:0/1481868159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540632e0 0x7f1b540a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 -- 172.21.15.153:0/1481868159 >> 172.21.15.153:0/1481868159 conn(0x7f1b540c7150 msgr2=0x7f1b540c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 -- 172.21.15.153:0/1481868159 shutdown_connections 2023-08-17T00:13:20.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.332+0000 7f1b59369700 1 -- 172.21.15.153:0/1481868159 wait complete. 2023-08-17T00:13:20.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 Processor -- start 2023-08-17T00:13:20.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 -- start start 2023-08-17T00:13:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b54151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 0x7f1b540aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540a8b70 0x7f1b541534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541524b0 con 0x7f1b540632e0 2023-08-17T00:13:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54152700 con 0x7f1b540629b0 2023-08-17T00:13:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.336+0000 7f1b59369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b541529e0 con 0x7f1b540a8b70 2023-08-17T00:13:20.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 0x7f1b540aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 0x7f1b540aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51674/0 (socket says 172.21.15.153:51674) 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 -- 172.21.15.153:0/2524801910 learned_addr learned my addr 172.21.15.153:0/2524801910 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b52ffd700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b54151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b537fe700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540a8b70 0x7f1b541534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 -- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540a8b70 msgr2=0x7f1b541534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540a8b70 0x7f1b541534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 -- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 msgr2=0x7f1b54151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b54151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 -- 172.21.15.153:0/2524801910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c009ae0 con 0x7f1b540632e0 2023-08-17T00:13:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b52ffd700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b54151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4bfff700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 0x7f1b540aa0a0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f1b3c00e930 tx=0x7f1b3c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c012600 con 0x7f1b540632e0 2023-08-17T00:13:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3c012760 con 0x7f1b540632e0 2023-08-17T00:13:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b54152cc0 con 0x7f1b540632e0 2023-08-17T00:13:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c012ae0 con 0x7f1b540632e0 2023-08-17T00:13:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b54152240 con 0x7f1b540632e0 2023-08-17T00:13:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.340+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5406b530 con 0x7f1b540632e0 2023-08-17T00:13:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.344+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1b3c022070 con 0x7f1b540632e0 2023-08-17T00:13:20.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.344+0000 7f1b4affd700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b3405a180 0x7f1b3405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:20.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.344+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b3c074460 con 0x7f1b540632e0 2023-08-17T00:13:20.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.344+0000 7f1b52ffd700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b3405a180 0x7f1b3405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.348+0000 7f1b52ffd700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b3405a180 0x7f1b3405c640 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f1b44001ba0 tx=0x7f1b44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:20.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.348+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b3c047e00 con 0x7f1b540632e0 2023-08-17T00:13:20.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.544+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b54064910 con 0x7f1b540632e0 2023-08-17T00:13:20.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.544+0000 7f1b4affd700 1 -- 172.21.15.153:0/2524801910 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f1b3c04b420 con 0x7f1b540632e0 2023-08-17T00:13:20.551 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:20.551 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b3405a180 msgr2=0x7f1b3405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b3405a180 0x7f1b3405c640 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7f1b44001ba0 tx=0x7f1b44009040).stop 2023-08-17T00:13:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 msgr2=0x7f1b540aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 0x7f1b540aa0a0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7f1b3c00e930 tx=0x7f1b3c009060).stop 2023-08-17T00:13:20.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 shutdown_connections 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b3405a180 0x7f1b3405c640 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b540a8b70 0x7f1b541534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b540632e0 0x7f1b540aa0a0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 --2- 172.21.15.153:0/2524801910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b540629b0 0x7f1b54151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 >> 172.21.15.153:0/2524801910 conn(0x7f1b540c7150 msgr2=0x7f1b541556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 shutdown_connections 2023-08-17T00:13:20.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:20.548+0000 7f1b59369700 1 -- 172.21.15.153:0/2524801910 wait complete. 2023-08-17T00:13:20.556 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:20.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:13:10.107853+0000', 'modified': '2023-08-17T00:13:13.307532+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8463': {'gid': 8463, 'name': 'b', 'rank': 0, 'incarnation': 105, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6835/3000779485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3000779485}, {'type': 'v1', 'addr': '172.21.15.178:6835', 'nonce': 3000779485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:13:20.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:13:20.977 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-08-17T00:13:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02e1569700 1 Processor -- start 2023-08-17T00:13:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02e1569700 1 -- start start 2023-08-17T00:13:21.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02e1569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02dc064ed0 0x7f02dc065310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02e1569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc0bc1b0 con 0x7f02dc157140 2023-08-17T00:13:21.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02e1569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02dc063380 con 0x7f02dc0bbd70 2023-08-17T00:13:21.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02e1569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02dc0bcea0 con 0x7f02dc064ed0 2023-08-17T00:13:21.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02db7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f02dc064ed0 0x7f02dc065310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02daffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f02dc157140 0x7f02dc0bb590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50880/0 (socket says 172.21.15.153:50880) 2023-08-17T00:13:21.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02daffd700 1 -- 172.21.15.153:0/2393191604 learned_addr learned my addr 172.21.15.153:0/2393191604 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:21.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02d9ffb700 1 -- 172.21.15.153:0/2393191604 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737973891 0 0) 0x7f02dc0bc1b0 con 0x7f02dc157140 2023-08-17T00:13:21.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02d9ffb700 1 -- 172.21.15.153:0/2393191604 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c40033f0 con 0x7f02dc157140 2023-08-17T00:13:21.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02db7fe700 1 -- 172.21.15.153:0/2393191604 >> v1:172.21.15.178:6789/0 conn(0x7f02dc0bbd70 legacy=0x7f02dc0647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02db7fe700 1 -- 172.21.15.153:0/2393191604 >> v1:172.21.15.153:6789/0 conn(0x7f02dc157140 legacy=0x7f02dc0bb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.132+0000 7f02db7fe700 1 -- 172.21.15.153:0/2393191604 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc065800 con 0x7f02dc064ed0 2023-08-17T00:13:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02db7fe700 1 --2- 172.21.15.153:0/2393191604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc065310 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f02d4009e60 tx=0x7f02d4009780).ready entity=mon.0 client_cookie=a7cb6a549838b33b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02d9ffb700 1 -- 172.21.15.153:0/2393191604 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400e070 con 0x7f02dc064ed0 2023-08-17T00:13:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02d9ffb700 1 -- 172.21.15.153:0/2393191604 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d400bb60 con 0x7f02dc064ed0 2023-08-17T00:13:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02d9ffb700 1 -- 172.21.15.153:0/2393191604 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4012410 con 0x7f02dc064ed0 2023-08-17T00:13:21.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 -- 172.21.15.153:0/2393191604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 msgr2=0x7f02dc065310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 --2- 172.21.15.153:0/2393191604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc065310 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f02d4009e60 tx=0x7f02d4009780).stop 2023-08-17T00:13:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 -- 172.21.15.153:0/2393191604 shutdown_connections 2023-08-17T00:13:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 --2- 172.21.15.153:0/2393191604 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc065310 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 -- 172.21.15.153:0/2393191604 >> 172.21.15.153:0/2393191604 conn(0x7f02dc0c2fb0 msgr2=0x7f02dc0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 -- 172.21.15.153:0/2393191604 shutdown_connections 2023-08-17T00:13:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.136+0000 7f02e1569700 1 -- 172.21.15.153:0/2393191604 wait complete. 2023-08-17T00:13:21.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 Processor -- start 2023-08-17T00:13:21.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 -- start start 2023-08-17T00:13:21.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc0abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02dc0bbd70 0x7f02dc164e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02dc157140 0x7f02dc0a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0bf4a0 con 0x7f02dc064ed0 2023-08-17T00:13:21.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc14f640 con 0x7f02dc157140 2023-08-17T00:13:21.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02dc0a6dc0 con 0x7f02dc0bbd70 2023-08-17T00:13:21.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc0abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc0abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51696/0 (socket says 172.21.15.153:51696) 2023-08-17T00:13:21.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 -- 172.21.15.153:0/1787224414 learned_addr learned my addr 172.21.15.153:0/1787224414 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:21.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02db7fe700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02dc157140 0x7f02dc0a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02da7fc700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02dc0bbd70 0x7f02dc164e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 -- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02dc0bbd70 msgr2=0x7f02dc164e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02dc0bbd70 0x7f02dc164e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 -- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02dc157140 msgr2=0x7f02dc0a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02dc157140 0x7f02dc0a4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 -- 172.21.15.153:0/1787224414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d4009a20 con 0x7f02dc064ed0 2023-08-17T00:13:21.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02daffd700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc0abc80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f02cc00c420 tx=0x7f02cc007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02c2ffd700 1 -- 172.21.15.153:0/1787224414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0072e0 con 0x7f02dc064ed0 2023-08-17T00:13:21.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02c2ffd700 1 -- 172.21.15.153:0/1787224414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02cc007440 con 0x7f02dc064ed0 2023-08-17T00:13:21.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02dc0bf1c0 con 0x7f02dc064ed0 2023-08-17T00:13:21.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02c2ffd700 1 -- 172.21.15.153:0/1787224414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0057a0 con 0x7f02dc064ed0 2023-08-17T00:13:21.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.140+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc0a72d0 con 0x7f02dc064ed0 2023-08-17T00:13:21.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.144+0000 7f02c2ffd700 1 -- 172.21.15.153:0/1787224414 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f02cc01a060 con 0x7f02dc064ed0 2023-08-17T00:13:21.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.144+0000 7f02c2ffd700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f02c805a120 0x7f02c805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.144+0000 7f02c2ffd700 1 -- 172.21.15.153:0/1787224414 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f02cc073550 con 0x7f02dc064ed0 2023-08-17T00:13:21.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02da7fc700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f02c805a120 0x7f02c805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 Processor -- start 2023-08-17T00:13:21.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 -- start start 2023-08-17T00:13:21.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02da7fc700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f02c805a120 0x7f02c805c5e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f02dc0ac600 tx=0x7f02d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x1065f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x101f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x1070760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf8f5c0 con 0x101fd90 2023-08-17T00:13:21.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa4e90 con 0x1065b60 2023-08-17T00:13:21.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf6b220 con 0x1021380 2023-08-17T00:13:21.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x1070760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x1070760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51698/0 (socket says 172.21.15.153:51698) 2023-08-17T00:13:21.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 -- 172.21.15.153:0/1078753858 learned_addr learned my addr 172.21.15.153:0/1078753858 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:21.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02da7fc700 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x101f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02daffd700 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x1065f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 -- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 msgr2=0x101f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x101f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 -- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 msgr2=0x1065f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x1065f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 -- 172.21.15.153:0/1078753858 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfb0500 con 0x101fd90 2023-08-17T00:13:21.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02db7fe700 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x1070760 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f02d4009980 tx=0x7f02d4009780).ready entity=mon.0 client_cookie=604aedba2d5090c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.148+0000 7f02bbfff700 1 -- 172.21.15.153:0/1078753858 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d400be20 con 0x101fd90 2023-08-17T00:13:21.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02bbfff700 1 -- 172.21.15.153:0/1078753858 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4012780 con 0x101fd90 2023-08-17T00:13:21.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02bbfff700 1 -- 172.21.15.153:0/1078753858 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d4012b20 con 0x101fd90 2023-08-17T00:13:21.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- 172.21.15.153:0/1078753858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 msgr2=0x1070760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x1070760 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 rx=0x7f02d4009980 tx=0x7f02d4009780).stop 2023-08-17T00:13:21.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- 172.21.15.153:0/1078753858 shutdown_connections 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x1070760 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x101f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- 172.21.15.153:0/1078753858 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x1065f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- 172.21.15.153:0/1078753858 >> 172.21.15.153:0/1078753858 conn(0xe03550 msgr2=0x1024e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- 172.21.15.153:0/1078753858 shutdown_connections 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- 172.21.15.153:0/1078753858 wait complete. 2023-08-17T00:13:21.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- start start 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 Processor -- start 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x104dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1021380 0x10496b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x1049ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf70110 con 0x101fd90 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10680e0 con 0x1021380 2023-08-17T00:13:21.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10683c0 con 0x1065b60 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.152+0000 7f02eb925740 10 client.0 ll_register_callbacks cb 0xfdc3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x104dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x104dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51714/0 (socket says 172.21.15.153:51714) 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 -- 172.21.15.153:0/2478170088 learned_addr learned my addr 172.21.15.153:0/2478170088 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02da7fc700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1021380 0x10496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02db7fe700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x1049ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 -- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 msgr2=0x1049ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x1049ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 -- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1021380 msgr2=0x10496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1021380 0x10496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 -- 172.21.15.153:0/2478170088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02dc065800 con 0x101fd90 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02daffd700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x104dc20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f02cc04a610 tx=0x7f02cc04d040).ready entity=mon.0 client_cookie=421f8fa6c3a3040d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02b97fa700 1 -- 172.21.15.153:0/2478170088 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc050040 con 0x101fd90 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02b97fa700 1 -- 172.21.15.153:0/2478170088 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f02cc019260 con 0x101fd90 2023-08-17T00:13:21.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xf9ac60 con 0x101fd90 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02b97fa700 1 -- 172.21.15.153:0/2478170088 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02cc04a0a0 con 0x101fd90 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 10 client.8628 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0xf9df80 con 0x101fd90 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02b97fa700 1 -- 172.21.15.153:0/2478170088 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xf9ac60 con 0x101fd90 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02b97fa700 1 -- 172.21.15.153:0/2478170088 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f02cc0730a0 con 0x101fd90 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 10 client.8628 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:21.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 10 client.8628 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T00:13:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 20 client.8628 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x104be00 0x104af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 4 client.8628 mds_command: new command op to 8463 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:13:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xf911b0 con 0x104be00 2023-08-17T00:13:21.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.156+0000 7f02da7fc700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x104be00 0x104af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02da7fc700 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x104be00 0x104af40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5d07359394819ece server_cookie=bd7d322d56e09936 in_seq=0 out_seq=0 2023-08-17T00:13:21.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02b97fa700 10 client.8628 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:21.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02b97fa700 1 -- 172.21.15.153:0/2478170088 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xf911b0 con 0x104be00 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02b97fa700 10 client.8628 handle_command_reply: tid=0 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 client.8628 shutdown 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 msgr2=0x104dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x104dc20 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f02cc04a610 tx=0x7f02cc04d040).stop 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 shutdown_connections 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x104be00 0x104af40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x1049ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1021380 0x10496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02b97fa700 0 client.8628 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 --2- 172.21.15.153:0/2478170088 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x104dc20 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 >> 172.21.15.153:0/2478170088 conn(0xe03550 msgr2=0x106bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 shutdown_connections 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 1 -- 172.21.15.153:0/2478170088 wait complete. 2023-08-17T00:13:21.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.160+0000 7f02eb925740 20 client.8628 trim_cache size 0 max 16384 2023-08-17T00:13:21.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 Processor -- start 2023-08-17T00:13:21.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 -- start start 2023-08-17T00:13:21.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101fd90 0x1051070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 0x104af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x10505e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe7db0 con 0x1021380 2023-08-17T00:13:21.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x104ad30 con 0x101fd90 2023-08-17T00:13:21.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.180+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x104b410 con 0x1065b60 2023-08-17T00:13:21.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 0x104af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 0x104af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51726/0 (socket says 172.21.15.153:51726) 2023-08-17T00:13:21.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 -- 172.21.15.153:0/3499805059 learned_addr learned my addr 172.21.15.153:0/3499805059 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:21.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02daffd700 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101fd90 0x1051070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02db7fe700 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x10505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 -- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 msgr2=0x10505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x10505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 -- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101fd90 msgr2=0x1051070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101fd90 0x1051070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 -- 172.21.15.153:0/3499805059 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02dc0a7820 con 0x1021380 2023-08-17T00:13:21.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02da7fc700 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 0x104af20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0xf7bcf0 tx=0x7f02d0002000).ready entity=mon.0 client_cookie=cf26283a67a0f562 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02c0ff9700 1 -- 172.21.15.153:0/3499805059 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d0017d10 con 0x1021380 2023-08-17T00:13:21.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02c0ff9700 1 -- 172.21.15.153:0/3499805059 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d001d040 con 0x1021380 2023-08-17T00:13:21.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02c0ff9700 1 -- 172.21.15.153:0/3499805059 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d00257c0 con 0x1021380 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 -- 172.21.15.153:0/3499805059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 msgr2=0x104af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 0x104af20 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 rx=0xf7bcf0 tx=0x7f02d0002000).stop 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 -- 172.21.15.153:0/3499805059 shutdown_connections 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1065b60 0x10505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1021380 0x104af20 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 --2- 172.21.15.153:0/3499805059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x101fd90 0x1051070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 -- 172.21.15.153:0/3499805059 >> 172.21.15.153:0/3499805059 conn(0xe03550 msgr2=0x1076a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 -- 172.21.15.153:0/3499805059 shutdown_connections 2023-08-17T00:13:21.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.184+0000 7f02eb925740 1 -- 172.21.15.153:0/3499805059 wait complete. 2023-08-17T00:13:21.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 -- start start 2023-08-17T00:13:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 Processor -- start 2023-08-17T00:13:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x10d8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x107b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x107b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x107dde0 con 0x101fd90 2023-08-17T00:13:21.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10252e0 con 0x1065b60 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1022800 con 0x1021380 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 10 client.0 ll_register_callbacks cb 0x7f02cc04a920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x10d8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x10d8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51736/0 (socket says 172.21.15.153:51736) 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 -- 172.21.15.153:0/2058763168 learned_addr learned my addr 172.21.15.153:0/2058763168 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02da7fc700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x107b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02db7fe700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x107b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 -- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 msgr2=0x107b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x107b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 -- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 msgr2=0x107b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x107b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 -- 172.21.15.153:0/2058763168 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d000f040 con 0x101fd90 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02db7fe700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x107b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02daffd700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x10d8a90 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f02cc04a8b0 tx=0x7f02cc053000).ready entity=mon.0 client_cookie=3e7edd727bfe5e00 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02b97fa700 1 -- 172.21.15.153:0/2058763168 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02cc050040 con 0x101fd90 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02b97fa700 1 -- 172.21.15.153:0/2058763168 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f02cc019260 con 0x101fd90 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.188+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02d4012780 con 0x101fd90 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 1 -- 172.21.15.153:0/2058763168 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02cc046bb0 con 0x101fd90 2023-08-17T00:13:21.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 10 client.8634 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0xf99420 con 0x101fd90 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 1 -- 172.21.15.153:0/2058763168 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d4012780 con 0x101fd90 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 1 -- 172.21.15.153:0/2058763168 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f02cc049b10 con 0x101fd90 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 10 client.8634 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 10 client.8634 resolve_mds: resolved name 'b' to daemon mds.b 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 20 client.8634 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:21.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x1021760 0x1021b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 4 client.8634 mds_command: new command op to 8463 tid=0[{"prefix": "status"}] 2023-08-17T00:13:21.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "status"}) v1 -- 0xe5a4e0 con 0x1021760 2023-08-17T00:13:21.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02da7fc700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x1021760 0x1021b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02da7fc700 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x1021760 0x1021b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ac4d264748e62373 server_cookie=fd691c7389f529f5 in_seq=0 out_seq=0 2023-08-17T00:13:21.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 10 client.8634 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:21.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 1 -- 172.21.15.153:0/2058763168 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0xe5a4e0 con 0x1021760 2023-08-17T00:13:21.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 10 client.8634 handle_command_reply: tid=0 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 client.8634 shutdown 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 msgr2=0x10d8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x10d8a90 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f02cc04a8b0 tx=0x7f02cc053000).stop 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 shutdown_connections 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x1021760 0x1021b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1065b60 0x107b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1021380 0x107b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 --2- 172.21.15.153:0/2058763168 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x101fd90 0x10d8a90 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 >> 172.21.15.153:0/2058763168 conn(0xe03550 msgr2=0x104c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02b97fa700 0 client.8634 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 shutdown_connections 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.192+0000 7f02eb925740 1 -- 172.21.15.153:0/2058763168 wait complete. 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02eb925740 20 client.8634 trim_cache size 0 max 16384 2023-08-17T00:13:21.204 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:13:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:13:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:13:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 8463, 2023-08-17T00:13:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:13:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:13:21.205 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:13:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 11.083879748999999, 2023-08-17T00:13:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 109, 2023-08-17T00:13:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 140, 2023-08-17T00:13:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 140, 2023-08-17T00:13:21.206 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 16.448921597999998 2023-08-17T00:13:21.206 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:13:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f02c805a120 msgr2=0x7f02c805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f02c805a120 0x7f02c805c5e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f02dc0ac600 tx=0x7f02d0009040).stop 2023-08-17T00:13:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 msgr2=0x7f02dc0abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc0abc80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f02cc00c420 tx=0x7f02cc007c80).stop 2023-08-17T00:13:21.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 shutdown_connections 2023-08-17T00:13:21.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f02c805a120 0x7f02c805c5e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02dc157140 0x7f02dc0a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02dc0bbd70 0x7f02dc164e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 --2- 172.21.15.153:0/1787224414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02dc064ed0 0x7f02dc0abc80 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 >> 172.21.15.153:0/1787224414 conn(0x7f02dc0c2fb0 msgr2=0x7f02dc155ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 shutdown_connections 2023-08-17T00:13:21.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.196+0000 7f02e1569700 1 -- 172.21.15.153:0/1787224414 wait complete. 2023-08-17T00:13:21.222 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:13:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 Processor -- start 2023-08-17T00:13:21.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 -- start start 2023-08-17T00:13:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c940c5bf0 0x7f4c940c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4c940c78d0 0x7f4c94153640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c94066260 con 0x7f4c940666f0 2023-08-17T00:13:21.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940c7e40 con 0x7f4c940c78d0 2023-08-17T00:13:21.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c99969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c94065c10 con 0x7f4c940c5bf0 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c927fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4c940666f0 0x7f4c940c71c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50886/0 (socket says 172.21.15.153:50886) 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c927fc700 1 -- 172.21.15.153:0/3877104345 learned_addr learned my addr 172.21.15.153:0/3877104345 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c937fe700 1 --2- 172.21.15.153:0/3877104345 >> v2:172.21.15.153:3300/0 conn(0x7f4c940c78d0 0x7f4c94153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.352+0000 7f4c92ffd700 1 --2- 172.21.15.153:0/3877104345 >> v2:172.21.15.178:3300/0 conn(0x7f4c940c5bf0 0x7f4c940c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c91ffb700 1 -- 172.21.15.153:0/3877104345 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286497899 0 0) 0x7f4c94066260 con 0x7f4c940666f0 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c91ffb700 1 -- 172.21.15.153:0/3877104345 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c7c0033f0 con 0x7f4c940666f0 2023-08-17T00:13:21.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c937fe700 1 -- 172.21.15.153:0/3877104345 >> v2:172.21.15.178:3300/0 conn(0x7f4c940c5bf0 msgr2=0x7f4c940c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c937fe700 1 --2- 172.21.15.153:0/3877104345 >> v2:172.21.15.178:3300/0 conn(0x7f4c940c5bf0 0x7f4c940c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c91ffb700 1 -- 172.21.15.153:0/3877104345 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1652501954 0 0) 0x7f4c7c0033f0 con 0x7f4c940666f0 2023-08-17T00:13:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c937fe700 1 -- 172.21.15.153:0/3877104345 >> v1:172.21.15.153:6789/0 conn(0x7f4c940666f0 legacy=0x7f4c940c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c937fe700 1 -- 172.21.15.153:0/3877104345 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c94065ef0 con 0x7f4c940c78d0 2023-08-17T00:13:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c937fe700 1 --2- 172.21.15.153:0/3877104345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940c78d0 0x7f4c94153640 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f4c940cbb20 tx=0x7f4c8c009780).ready entity=mon.0 client_cookie=8f7a7d0aa766e340 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c91ffb700 1 -- 172.21.15.153:0/3877104345 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c00e070 con 0x7f4c940c78d0 2023-08-17T00:13:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c91ffb700 1 -- 172.21.15.153:0/3877104345 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c00b7a0 con 0x7f4c940c78d0 2023-08-17T00:13:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c91ffb700 1 -- 172.21.15.153:0/3877104345 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c88001470 con 0x7f4c940c78d0 2023-08-17T00:13:21.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 -- 172.21.15.153:0/3877104345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940c78d0 msgr2=0x7f4c94153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 --2- 172.21.15.153:0/3877104345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940c78d0 0x7f4c94153640 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f4c940cbb20 tx=0x7f4c8c009780).stop 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 -- 172.21.15.153:0/3877104345 shutdown_connections 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 --2- 172.21.15.153:0/3877104345 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940c78d0 0x7f4c94153640 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 --2- 172.21.15.153:0/3877104345 >> v2:172.21.15.178:3300/0 conn(0x7f4c940c5bf0 0x7f4c940c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 -- 172.21.15.153:0/3877104345 >> 172.21.15.153:0/3877104345 conn(0x7f4c94067820 msgr2=0x7f4c94067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 -- 172.21.15.153:0/3877104345 shutdown_connections 2023-08-17T00:13:21.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.356+0000 7f4c99969700 1 -- 172.21.15.153:0/3877104345 wait complete. 2023-08-17T00:13:21.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 Processor -- start 2023-08-17T00:13:21.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 -- start start 2023-08-17T00:13:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 0x7f4c94158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c940c5bf0 0x7f4c94145670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940c78d0 0x7f4c941649c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94145b60 con 0x7f4c940666f0 2023-08-17T00:13:21.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94158390 con 0x7f4c940c78d0 2023-08-17T00:13:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94157780 con 0x7f4c940c5bf0 2023-08-17T00:13:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 0x7f4c94158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 0x7f4c94158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51754/0 (socket says 172.21.15.153:51754) 2023-08-17T00:13:21.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 -- 172.21.15.153:0/2740785325 learned_addr learned my addr 172.21.15.153:0/2740785325 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c937fe700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940c78d0 0x7f4c941649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c927fc700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c940c5bf0 0x7f4c94145670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 -- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c940c5bf0 msgr2=0x7f4c94145670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c940c5bf0 0x7f4c94145670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 -- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940c78d0 msgr2=0x7f4c941649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940c78d0 0x7f4c941649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 -- 172.21.15.153:0/2740785325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009a20 con 0x7f4c940666f0 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c92ffd700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 0x7f4c94158820 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f4c8400e950 tx=0x7f4c84009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400c850 con 0x7f4c940666f0 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8400c9b0 con 0x7f4c940666f0 2023-08-17T00:13:21.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c94157a60 con 0x7f4c940666f0 2023-08-17T00:13:21.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400cd30 con 0x7f4c940666f0 2023-08-17T00:13:21.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.360+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c94158020 con 0x7f4c940666f0 2023-08-17T00:13:21.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.364+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c94046dd0 con 0x7f4c940666f0 2023-08-17T00:13:21.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.364+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4c84022070 con 0x7f4c940666f0 2023-08-17T00:13:21.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.368+0000 7f4c7affd700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c8005a150 0x7f4c8005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:21.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.368+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4c840745c0 con 0x7f4c940666f0 2023-08-17T00:13:21.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.368+0000 7f4c927fc700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c8005a150 0x7f4c8005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:21.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.368+0000 7f4c927fc700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c8005a150 0x7f4c8005c610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f4c941674b0 tx=0x7f4c88001520).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:21.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.372+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4c84048070 con 0x7f4c940666f0 2023-08-17T00:13:21.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.564+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4c940c8250 con 0x7f4c940666f0 2023-08-17T00:13:21.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.568+0000 7f4c7affd700 1 -- 172.21.15.153:0/2740785325 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4c84016020 con 0x7f4c940666f0 2023-08-17T00:13:21.573 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:13:21.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c8005a150 msgr2=0x7f4c8005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c8005a150 0x7f4c8005c610 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f4c941674b0 tx=0x7f4c88001520).stop 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 msgr2=0x7f4c94158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 0x7f4c94158820 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f4c8400e950 tx=0x7f4c84009060).stop 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 shutdown_connections 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4c8005a150 0x7f4c8005c610 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c940c78d0 0x7f4c941649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c940c5bf0 0x7f4c94145670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 --2- 172.21.15.153:0/2740785325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4c940666f0 0x7f4c94158820 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:21.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 >> 172.21.15.153:0/2740785325 conn(0x7f4c94067820 msgr2=0x7f4c940ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:21.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 shutdown_connections 2023-08-17T00:13:21.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:21.572+0000 7f4c99969700 1 -- 172.21.15.153:0/2740785325 wait complete. 2023-08-17T00:13:21.596 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:13:21.596 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:13:21.597 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:13:21.597 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:13:21.597 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:13:21.597 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:13:21.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:13:21.598 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:13:21.598 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:13:21.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:21.599 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:13:21.618 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:13:21.619 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:13:21.620 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41812sec preferred_lft 41812sec 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:13:21.621 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:13:21.622 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:13:21.623 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:13:21.624 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:13:21.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:21.625 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:13:21.705 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:13:21.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:21.709 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:13:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:13:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:13:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:13:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:13:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:13:21.773 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:13:21.774 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:13:21.774 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:13:21.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:21.775 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:13:21.775 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:21.775 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:13:21.775 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:13:21.776 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:13:21.776 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:21.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:21.914 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:13:21.930 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:13:21.930 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:13:21.931 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:13:21.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:21.932 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:13:22.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:22.007 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:13:22.066 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:13:22.066 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:13:22.184 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:13:22.184 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:13:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:13:22.205 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:13:22.212 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:13:22.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:13:22.213 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:13:22.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:22.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.436+0000 7f2bfb59e700 1 Processor -- start 2023-08-17T00:13:22.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfb59e700 1 -- start start 2023-08-17T00:13:22.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfb59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2bfc068f30 0x7f2bfc15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0ab9b0 con 0x7f2bfc150880 2023-08-17T00:13:22.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfb59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0a9080 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfb59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0aada0 con 0x7f2bfc068f30 2023-08-17T00:13:22.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfa59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2bfc150880 0x7f2bfc0a8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50892/0 (socket says 172.21.15.153:50892) 2023-08-17T00:13:22.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfa59c700 1 -- 172.21.15.153:0/1434752546 learned_addr learned my addr 172.21.15.153:0/1434752546 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:22.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.440+0000 7f2bfad9d700 1 --2- 172.21.15.153:0/1434752546 >> v2:172.21.15.153:3300/0 conn(0x7f2bfc068f30 0x7f2bfc15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bf9d9b700 1 -- 172.21.15.153:0/1434752546 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203014134 0 0) 0x7f2bfc0ab9b0 con 0x7f2bfc150880 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bf9d9b700 1 -- 172.21.15.153:0/1434752546 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2be80033f0 con 0x7f2bfc150880 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfad9d700 1 -- 172.21.15.153:0/1434752546 >> v1:172.21.15.178:6789/0 conn(0x7f2bfc0aa8c0 legacy=0x7f2bfc068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bf9d9b700 1 -- 172.21.15.153:0/1434752546 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079398035 0 0) 0x7f2bfc0a9080 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfad9d700 1 -- 172.21.15.153:0/1434752546 >> v1:172.21.15.153:6789/0 conn(0x7f2bfc150880 legacy=0x7f2bfc0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfad9d700 1 -- 172.21.15.153:0/1434752546 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0ab080 con 0x7f2bfc068f30 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfad9d700 1 --2- 172.21.15.153:0/1434752546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc068f30 0x7f2bfc15b530 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f2bf4009e60 tx=0x7f2bf4009780).ready entity=mon.0 client_cookie=c0f8bae18f8ac01d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:22.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bf9d9b700 1 -- 172.21.15.153:0/1434752546 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf400bb60 con 0x7f2bfc068f30 2023-08-17T00:13:22.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bf9d9b700 1 -- 172.21.15.153:0/1434752546 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf400bcc0 con 0x7f2bfc068f30 2023-08-17T00:13:22.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bf9d9b700 1 -- 172.21.15.153:0/1434752546 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4011480 con 0x7f2bfc068f30 2023-08-17T00:13:22.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 -- 172.21.15.153:0/1434752546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc068f30 msgr2=0x7f2bfc15b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/1434752546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc068f30 0x7f2bfc15b530 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f2bf4009e60 tx=0x7f2bf4009780).stop 2023-08-17T00:13:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 -- 172.21.15.153:0/1434752546 shutdown_connections 2023-08-17T00:13:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/1434752546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc068f30 0x7f2bfc15b530 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 -- 172.21.15.153:0/1434752546 >> 172.21.15.153:0/1434752546 conn(0x7f2bfc0c6620 msgr2=0x7f2bfc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 -- 172.21.15.153:0/1434752546 shutdown_connections 2023-08-17T00:13:22.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.444+0000 7f2bfb59e700 1 -- 172.21.15.153:0/1434752546 wait complete. 2023-08-17T00:13:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 Processor -- start 2023-08-17T00:13:22.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 -- start start 2023-08-17T00:13:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bfc068f30 0x7f2bfc1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 0x7f2bfc0bc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bfc150880 0x7f2bfc061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0a3870 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0a6800 con 0x7f2bfc150880 2023-08-17T00:13:22.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0a6ae0 con 0x7f2bfc068f30 2023-08-17T00:13:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 0x7f2bfc0bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 0x7f2bfc0bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51764/0 (socket says 172.21.15.153:51764) 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 -- 172.21.15.153:0/3272031217 learned_addr learned my addr 172.21.15.153:0/3272031217 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfa59c700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bfc068f30 0x7f2bfc1651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bfad9d700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bfc150880 0x7f2bfc061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 -- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bfc068f30 msgr2=0x7f2bfc1651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bfc068f30 0x7f2bfc1651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 -- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bfc150880 msgr2=0x7f2bfc061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bfc150880 0x7f2bfc061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.448+0000 7f2bf1d9b700 1 -- 172.21.15.153:0/3272031217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4009a20 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bf1d9b700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 0x7f2bfc0bc160 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f2be4001eb0 tx=0x7f2be4007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:22.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be400f470 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be400f5f0 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc0a3ac0 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be400f9b0 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc0bc650 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc0a3f40 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.452+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2be4019030 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.456+0000 7f2bf2ffd700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bdc05a180 0x7f2bdc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.456+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2be4073670 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.456+0000 7f2bfa59c700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bdc05a180 0x7f2bdc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.456+0000 7f2bfa59c700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bdc05a180 0x7f2bdc05c640 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f2bec000c00 tx=0x7f2bec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.464+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2be4047120 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.660+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bfc06b4c0 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.660+0000 7f2bf2ffd700 1 -- 172.21.15.153:0/3272031217 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f2be404a740 con 0x7f2bfc0aa8c0 2023-08-17T00:13:22.666 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:22.666 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:22.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bdc05a180 msgr2=0x7f2bdc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bdc05a180 0x7f2bdc05c640 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f2bec000c00 tx=0x7f2bec009040).stop 2023-08-17T00:13:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 msgr2=0x7f2bfc0bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 0x7f2bfc0bc160 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f2be4001eb0 tx=0x7f2be4007c70).stop 2023-08-17T00:13:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 shutdown_connections 2023-08-17T00:13:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bdc05a180 0x7f2bdc05c640 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bfc150880 0x7f2bfc061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bfc0aa8c0 0x7f2bfc0bc160 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 --2- 172.21.15.153:0/3272031217 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bfc068f30 0x7f2bfc1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 >> 172.21.15.153:0/3272031217 conn(0x7f2bfc0c6620 msgr2=0x7f2bfc0bcce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 shutdown_connections 2023-08-17T00:13:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.664+0000 7f2bfb59e700 1 -- 172.21.15.153:0/3272031217 wait complete. 2023-08-17T00:13:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:22.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:22.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.836+0000 7f58e31a9700 1 Processor -- start 2023-08-17T00:13:22.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.836+0000 7f58e31a9700 1 -- start start 2023-08-17T00:13:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58e31a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58dc151f70 0x7f58dc065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58e31a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc061fa0 con 0x7f58dc065b50 2023-08-17T00:13:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58e31a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc1523d0 con 0x7f58dc151b90 2023-08-17T00:13:22.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58e31a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc0c3fb0 con 0x7f58dc151f70 2023-08-17T00:13:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58d3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58dc151f70 0x7f58dc065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58e1746700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f58dc065b50 0x7f58dc064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50900/0 (socket says 172.21.15.153:50900) 2023-08-17T00:13:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58e1746700 1 -- 172.21.15.153:0/967428479 learned_addr learned my addr 172.21.15.153:0/967428479 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58d3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f58dc151f70 0x7f58dc065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51766/0 (socket says 172.21.15.153:51766) 2023-08-17T00:13:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58d3fff700 1 -- 172.21.15.153:0/967428479 >> v1:172.21.15.178:6789/0 conn(0x7f58dc151b90 legacy=0x7f58dc063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58d3fff700 1 -- 172.21.15.153:0/967428479 >> v1:172.21.15.153:6789/0 conn(0x7f58dc065b50 legacy=0x7f58dc064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58d3fff700 1 -- 172.21.15.153:0/967428479 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0621f0 con 0x7f58dc151f70 2023-08-17T00:13:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.840+0000 7f58d37fe700 1 -- 172.21.15.153:0/967428479 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021164484 0 0) 0x7f58dc061fa0 con 0x7f58dc065b50 2023-08-17T00:13:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58d3fff700 1 --2- 172.21.15.153:0/967428479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc151f70 0x7f58dc065660 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f58cc009760 tx=0x7f58cc009060).ready entity=mon.0 client_cookie=3c0aa901cf91a177 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58d37fe700 1 -- 172.21.15.153:0/967428479 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00b580 con 0x7f58dc151f70 2023-08-17T00:13:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58d37fe700 1 -- 172.21.15.153:0/967428479 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc00b6e0 con 0x7f58dc151f70 2023-08-17T00:13:22.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58d37fe700 1 -- 172.21.15.153:0/967428479 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc00ba60 con 0x7f58dc151f70 2023-08-17T00:13:22.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 -- 172.21.15.153:0/967428479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc151f70 msgr2=0x7f58dc065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 --2- 172.21.15.153:0/967428479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc151f70 0x7f58dc065660 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f58cc009760 tx=0x7f58cc009060).stop 2023-08-17T00:13:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 -- 172.21.15.153:0/967428479 shutdown_connections 2023-08-17T00:13:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 --2- 172.21.15.153:0/967428479 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc151f70 0x7f58dc065660 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 -- 172.21.15.153:0/967428479 >> 172.21.15.153:0/967428479 conn(0x7f58dc0c7150 msgr2=0x7f58dc0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 -- 172.21.15.153:0/967428479 shutdown_connections 2023-08-17T00:13:22.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.844+0000 7f58e31a9700 1 -- 172.21.15.153:0/967428479 wait complete. 2023-08-17T00:13:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 Processor -- start 2023-08-17T00:13:22.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 -- start start 2023-08-17T00:13:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 0x7f58dc14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58dc151b90 0x7f58dc1631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58dc151f70 0x7f58dc0aaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc153ba0 con 0x7f58dc065b50 2023-08-17T00:13:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc14e2e0 con 0x7f58dc151b90 2023-08-17T00:13:22.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e31a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc14e5c0 con 0x7f58dc151f70 2023-08-17T00:13:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 0x7f58dc14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 0x7f58dc14dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51782/0 (socket says 172.21.15.153:51782) 2023-08-17T00:13:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 -- 172.21.15.153:0/2140979843 learned_addr learned my addr 172.21.15.153:0/2140979843 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:22.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e1746700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58dc151f70 0x7f58dc0aaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58d3fff700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58dc151b90 0x7f58dc1631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 -- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58dc151f70 msgr2=0x7f58dc0aaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58dc151f70 0x7f58dc0aaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 -- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58dc151b90 msgr2=0x7f58dc1631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58dc151b90 0x7f58dc1631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:22.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 -- 172.21.15.153:0/2140979843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0092a0 con 0x7f58dc065b50 2023-08-17T00:13:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.848+0000 7f58e0f45700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 0x7f58dc14dd00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f58d800c4c0 tx=0x7f58d8007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d8007020 con 0x7f58dc065b50 2023-08-17T00:13:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d8001e90 con 0x7f58dc065b50 2023-08-17T00:13:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d80073b0 con 0x7f58dc065b50 2023-08-17T00:13:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc153830 con 0x7f58dc065b50 2023-08-17T00:13:22.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc155340 con 0x7f58dc065b50 2023-08-17T00:13:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc14e7e0 con 0x7f58dc065b50 2023-08-17T00:13:22.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.852+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f58d8010070 con 0x7f58dc065b50 2023-08-17T00:13:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.856+0000 7f58d0ff9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58c805a180 0x7f58c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.856+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f58d8073a60 con 0x7f58dc065b50 2023-08-17T00:13:22.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.856+0000 7f58d3fff700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58c805a180 0x7f58c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:22.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.856+0000 7f58d3fff700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58c805a180 0x7f58c805c640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f58dc0ac240 tx=0x7f58cc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:22.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:22.860+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58d8047400 con 0x7f58dc065b50 2023-08-17T00:13:23.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.052+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58dc153670 con 0x7f58dc065b50 2023-08-17T00:13:23.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.056+0000 7f58d0ff9700 1 -- 172.21.15.153:0/2140979843 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f58d804aa20 con 0x7f58dc065b50 2023-08-17T00:13:23.061 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:23.062 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58c805a180 msgr2=0x7f58c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:23.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58c805a180 0x7f58c805c640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f58dc0ac240 tx=0x7f58cc017000).stop 2023-08-17T00:13:23.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 msgr2=0x7f58dc14dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:23.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 0x7f58dc14dd00 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7f58d800c4c0 tx=0x7f58d8007e00).stop 2023-08-17T00:13:23.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 shutdown_connections 2023-08-17T00:13:23.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58c805a180 0x7f58c805c640 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:23.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58dc151f70 0x7f58dc0aaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:23.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58dc151b90 0x7f58dc1631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:23.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 --2- 172.21.15.153:0/2140979843 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58dc065b50 0x7f58dc14dd00 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:23.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 >> 172.21.15.153:0/2140979843 conn(0x7f58dc0c7150 msgr2=0x7f58dc14c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:23.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 shutdown_connections 2023-08-17T00:13:23.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:23.060+0000 7f58e31a9700 1 -- 172.21.15.153:0/2140979843 wait complete. 2023-08-17T00:13:23.070 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:23.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:23.088 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:23.089 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:23.089 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.0 2023-08-17T00:13:23.090 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:23.091 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:23.091 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:23.091 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:23.166 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.167 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.167 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267276 s, 39.2 MB/s 2023-08-17T00:13:23.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.196 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256757 s, 40.8 MB/s 2023-08-17T00:13:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.227 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289537 s, 36.2 MB/s 2023-08-17T00:13:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.258 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247832 s, 42.3 MB/s 2023-08-17T00:13:23.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.288 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284113 s, 36.9 MB/s 2023-08-17T00:13:23.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.321 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.321 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273749 s, 38.3 MB/s 2023-08-17T00:13:23.347 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.347 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.347 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229103 s, 45.8 MB/s 2023-08-17T00:13:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.381 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312132 s, 33.6 MB/s 2023-08-17T00:13:23.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.411 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255412 s, 41.1 MB/s 2023-08-17T00:13:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212695 s, 49.3 MB/s 2023-08-17T00:13:23.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.464 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.464 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246497 s, 42.5 MB/s 2023-08-17T00:13:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.492 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246153 s, 42.6 MB/s 2023-08-17T00:13:23.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.521 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271318 s, 38.6 MB/s 2023-08-17T00:13:23.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.550 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247448 s, 42.4 MB/s 2023-08-17T00:13:23.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244184 s, 42.9 MB/s 2023-08-17T00:13:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257764 s, 40.7 MB/s 2023-08-17T00:13:23.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254648 s, 41.2 MB/s 2023-08-17T00:13:23.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226981 s, 46.2 MB/s 2023-08-17T00:13:23.693 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.694 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248629 s, 42.2 MB/s 2023-08-17T00:13:23.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.724 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.724 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261705 s, 40.1 MB/s 2023-08-17T00:13:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.764 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0361609 s, 29.0 MB/s 2023-08-17T00:13:23.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251928 s, 41.6 MB/s 2023-08-17T00:13:23.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.821 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233564 s, 44.9 MB/s 2023-08-17T00:13:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234461 s, 44.7 MB/s 2023-08-17T00:13:23.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.874 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231137 s, 45.4 MB/s 2023-08-17T00:13:23.912 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.912 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.912 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0337153 s, 31.1 MB/s 2023-08-17T00:13:23.938 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.939 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.939 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236144 s, 44.4 MB/s 2023-08-17T00:13:23.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.963 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222489 s, 47.1 MB/s 2023-08-17T00:13:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:23.991 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023794 s, 44.1 MB/s 2023-08-17T00:13:24.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.024 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284003 s, 36.9 MB/s 2023-08-17T00:13:24.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.054 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253545 s, 41.4 MB/s 2023-08-17T00:13:24.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.079 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218788 s, 47.9 MB/s 2023-08-17T00:13:24.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:24.081 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:24.082 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:24.082 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.1 2023-08-17T00:13:24.083 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:24.083 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:24.084 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:24.084 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:24.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.147 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267564 s, 39.2 MB/s 2023-08-17T00:13:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243778 s, 43.0 MB/s 2023-08-17T00:13:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222713 s, 47.1 MB/s 2023-08-17T00:13:24.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.226 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209763 s, 50.0 MB/s 2023-08-17T00:13:24.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.254 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240016 s, 43.7 MB/s 2023-08-17T00:13:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274191 s, 38.2 MB/s 2023-08-17T00:13:24.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.320 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289925 s, 36.2 MB/s 2023-08-17T00:13:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.346 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237474 s, 44.2 MB/s 2023-08-17T00:13:24.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.379 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289596 s, 36.2 MB/s 2023-08-17T00:13:24.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228975 s, 45.8 MB/s 2023-08-17T00:13:24.426 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.426 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.427 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185976 s, 56.4 MB/s 2023-08-17T00:13:24.451 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.452 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.452 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216713 s, 48.4 MB/s 2023-08-17T00:13:24.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.481 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250919 s, 41.8 MB/s 2023-08-17T00:13:24.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.508 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226506 s, 46.3 MB/s 2023-08-17T00:13:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198841 s, 52.7 MB/s 2023-08-17T00:13:24.556 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.557 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.557 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218525 s, 48.0 MB/s 2023-08-17T00:13:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.584 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023468 s, 44.7 MB/s 2023-08-17T00:13:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.612 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236948 s, 44.3 MB/s 2023-08-17T00:13:24.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.633 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187154 s, 56.0 MB/s 2023-08-17T00:13:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.671 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0349432 s, 30.0 MB/s 2023-08-17T00:13:24.696 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.697 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.697 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211692 s, 49.5 MB/s 2023-08-17T00:13:24.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.721 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206247 s, 50.8 MB/s 2023-08-17T00:13:24.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.751 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259222 s, 40.5 MB/s 2023-08-17T00:13:24.776 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213705 s, 49.1 MB/s 2023-08-17T00:13:24.798 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.799 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.799 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183689 s, 57.1 MB/s 2023-08-17T00:13:24.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.03448 s, 30.4 MB/s 2023-08-17T00:13:24.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.865 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236059 s, 44.4 MB/s 2023-08-17T00:13:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.888 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019494 s, 53.8 MB/s 2023-08-17T00:13:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266018 s, 39.4 MB/s 2023-08-17T00:13:24.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.949 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260087 s, 40.3 MB/s 2023-08-17T00:13:24.975 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:24.976 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:24.976 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023251 s, 45.1 MB/s 2023-08-17T00:13:25.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.003 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241396 s, 43.4 MB/s 2023-08-17T00:13:25.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:25.005 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:25.005 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:25.006 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.2 2023-08-17T00:13:25.006 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:25.007 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:25.007 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:25.007 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:25.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.059 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217374 s, 48.2 MB/s 2023-08-17T00:13:25.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.085 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.085 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218834 s, 47.9 MB/s 2023-08-17T00:13:25.119 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304061 s, 34.5 MB/s 2023-08-17T00:13:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.145 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02062 s, 50.9 MB/s 2023-08-17T00:13:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.171 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216823 s, 48.4 MB/s 2023-08-17T00:13:25.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.198 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229014 s, 45.8 MB/s 2023-08-17T00:13:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.223 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021199 s, 49.5 MB/s 2023-08-17T00:13:25.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.254 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280364 s, 37.4 MB/s 2023-08-17T00:13:25.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.281 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225186 s, 46.6 MB/s 2023-08-17T00:13:25.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.305 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204077 s, 51.4 MB/s 2023-08-17T00:13:25.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.331 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221105 s, 47.4 MB/s 2023-08-17T00:13:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236628 s, 44.3 MB/s 2023-08-17T00:13:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022235 s, 47.2 MB/s 2023-08-17T00:13:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.410 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228204 s, 45.9 MB/s 2023-08-17T00:13:25.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255637 s, 41.0 MB/s 2023-08-17T00:13:25.466 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.467 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232658 s, 45.1 MB/s 2023-08-17T00:13:25.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232101 s, 45.2 MB/s 2023-08-17T00:13:25.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.525 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.525 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026574 s, 39.5 MB/s 2023-08-17T00:13:25.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223084 s, 47.0 MB/s 2023-08-17T00:13:25.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.580 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264024 s, 39.7 MB/s 2023-08-17T00:13:25.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259546 s, 40.4 MB/s 2023-08-17T00:13:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213449 s, 49.1 MB/s 2023-08-17T00:13:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224385 s, 46.7 MB/s 2023-08-17T00:13:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.686 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206397 s, 50.8 MB/s 2023-08-17T00:13:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.713 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224459 s, 46.7 MB/s 2023-08-17T00:13:25.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.740 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228655 s, 45.9 MB/s 2023-08-17T00:13:25.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203056 s, 51.6 MB/s 2023-08-17T00:13:25.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.785 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.786 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187487 s, 55.9 MB/s 2023-08-17T00:13:25.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.811 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210622 s, 49.8 MB/s 2023-08-17T00:13:25.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.837 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.837 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229914 s, 45.6 MB/s 2023-08-17T00:13:25.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.864 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236274 s, 44.4 MB/s 2023-08-17T00:13:25.890 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.891 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.891 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226884 s, 46.2 MB/s 2023-08-17T00:13:25.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:25.893 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:25.893 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:25.894 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.3 2023-08-17T00:13:25.894 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:25.895 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:25.895 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:25.896 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:25.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.958 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270845 s, 38.7 MB/s 2023-08-17T00:13:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:25.993 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310853 s, 33.7 MB/s 2023-08-17T00:13:26.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.025 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274772 s, 38.2 MB/s 2023-08-17T00:13:26.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.053 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.053 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234228 s, 44.8 MB/s 2023-08-17T00:13:26.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.080 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225368 s, 46.5 MB/s 2023-08-17T00:13:26.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235094 s, 44.6 MB/s 2023-08-17T00:13:26.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.134 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022632 s, 46.3 MB/s 2023-08-17T00:13:26.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.162 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238148 s, 44.0 MB/s 2023-08-17T00:13:26.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.192 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262286 s, 40.0 MB/s 2023-08-17T00:13:26.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.221 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239443 s, 43.8 MB/s 2023-08-17T00:13:26.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.259 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.260 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.034867 s, 30.1 MB/s 2023-08-17T00:13:26.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.284 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207988 s, 50.4 MB/s 2023-08-17T00:13:26.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255009 s, 41.1 MB/s 2023-08-17T00:13:26.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.338 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201718 s, 52.0 MB/s 2023-08-17T00:13:26.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.376 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0343061 s, 30.6 MB/s 2023-08-17T00:13:26.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025295 s, 41.5 MB/s 2023-08-17T00:13:26.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255779 s, 41.0 MB/s 2023-08-17T00:13:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224266 s, 46.8 MB/s 2023-08-17T00:13:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248316 s, 42.2 MB/s 2023-08-17T00:13:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.515 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197258 s, 53.2 MB/s 2023-08-17T00:13:26.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.542 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.542 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229153 s, 45.8 MB/s 2023-08-17T00:13:26.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229831 s, 45.6 MB/s 2023-08-17T00:13:26.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.607 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.607 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0329644 s, 31.8 MB/s 2023-08-17T00:13:26.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.634 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224241 s, 46.8 MB/s 2023-08-17T00:13:26.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.662 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.662 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239492 s, 43.8 MB/s 2023-08-17T00:13:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209806 s, 50.0 MB/s 2023-08-17T00:13:26.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.719 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.719 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270527 s, 38.8 MB/s 2023-08-17T00:13:26.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.742 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.018843 s, 55.6 MB/s 2023-08-17T00:13:26.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204654 s, 51.2 MB/s 2023-08-17T00:13:26.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.792 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229086 s, 45.8 MB/s 2023-08-17T00:13:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251804 s, 41.6 MB/s 2023-08-17T00:13:26.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.847 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211399 s, 49.6 MB/s 2023-08-17T00:13:26.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:26.849 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:26.849 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:26.850 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.4 2023-08-17T00:13:26.850 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:26.851 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:26.851 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:26.852 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:26.913 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.914 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02902 s, 36.1 MB/s 2023-08-17T00:13:26.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0165984 s, 63.2 MB/s 2023-08-17T00:13:26.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.962 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221367 s, 47.4 MB/s 2023-08-17T00:13:26.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:26.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:26.989 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022946 s, 45.7 MB/s 2023-08-17T00:13:27.007 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.007 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.007 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0158924 s, 66.0 MB/s 2023-08-17T00:13:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.029 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188083 s, 55.8 MB/s 2023-08-17T00:13:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265638 s, 39.5 MB/s 2023-08-17T00:13:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.094 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0285609 s, 36.7 MB/s 2023-08-17T00:13:27.118 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.119 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.119 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216389 s, 48.5 MB/s 2023-08-17T00:13:27.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.153 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0310224 s, 33.8 MB/s 2023-08-17T00:13:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.187 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.188 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030486 s, 34.4 MB/s 2023-08-17T00:13:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240715 s, 43.6 MB/s 2023-08-17T00:13:27.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.240 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209394 s, 50.1 MB/s 2023-08-17T00:13:27.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.266 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210912 s, 49.7 MB/s 2023-08-17T00:13:27.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238164 s, 44.0 MB/s 2023-08-17T00:13:27.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.320 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228791 s, 45.8 MB/s 2023-08-17T00:13:27.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.349 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.349 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250113 s, 41.9 MB/s 2023-08-17T00:13:27.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.377 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237945 s, 44.1 MB/s 2023-08-17T00:13:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.404 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229919 s, 45.6 MB/s 2023-08-17T00:13:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256856 s, 40.8 MB/s 2023-08-17T00:13:27.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.460 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.460 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226937 s, 46.2 MB/s 2023-08-17T00:13:27.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.487 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214762 s, 48.8 MB/s 2023-08-17T00:13:27.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.511 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220838 s, 47.5 MB/s 2023-08-17T00:13:27.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.537 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209086 s, 50.2 MB/s 2023-08-17T00:13:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201586 s, 52.0 MB/s 2023-08-17T00:13:27.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.583 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188401 s, 55.7 MB/s 2023-08-17T00:13:27.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243503 s, 43.1 MB/s 2023-08-17T00:13:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.639 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235869 s, 44.5 MB/s 2023-08-17T00:13:27.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.667 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.667 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238992 s, 43.9 MB/s 2023-08-17T00:13:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210507 s, 49.8 MB/s 2023-08-17T00:13:27.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.719 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.719 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239589 s, 43.8 MB/s 2023-08-17T00:13:27.748 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.749 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.749 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265271 s, 39.5 MB/s 2023-08-17T00:13:27.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:27.751 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:27.752 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:27.752 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.5 2023-08-17T00:13:27.753 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:27.753 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:27.754 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:27.754 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:27.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.813 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255703 s, 41.0 MB/s 2023-08-17T00:13:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.844 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256111 s, 40.9 MB/s 2023-08-17T00:13:27.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.870 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216429 s, 48.4 MB/s 2023-08-17T00:13:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216858 s, 48.4 MB/s 2023-08-17T00:13:27.918 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203884 s, 51.4 MB/s 2023-08-17T00:13:27.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.948 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259168 s, 40.5 MB/s 2023-08-17T00:13:27.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:27.984 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:27.985 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316753 s, 33.1 MB/s 2023-08-17T00:13:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258198 s, 40.6 MB/s 2023-08-17T00:13:28.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233574 s, 44.9 MB/s 2023-08-17T00:13:28.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.070 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242542 s, 43.2 MB/s 2023-08-17T00:13:28.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.103 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283206 s, 37.0 MB/s 2023-08-17T00:13:28.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240242 s, 43.6 MB/s 2023-08-17T00:13:28.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.156 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199027 s, 52.7 MB/s 2023-08-17T00:13:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0295804 s, 35.4 MB/s 2023-08-17T00:13:28.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236013 s, 44.4 MB/s 2023-08-17T00:13:28.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.242 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209168 s, 50.1 MB/s 2023-08-17T00:13:28.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.270 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024409 s, 43.0 MB/s 2023-08-17T00:13:28.295 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.296 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212573 s, 49.3 MB/s 2023-08-17T00:13:28.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.323 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023207 s, 45.2 MB/s 2023-08-17T00:13:28.352 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.353 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257889 s, 40.7 MB/s 2023-08-17T00:13:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.381 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237196 s, 44.2 MB/s 2023-08-17T00:13:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302386 s, 34.7 MB/s 2023-08-17T00:13:28.444 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.445 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.445 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249408 s, 42.0 MB/s 2023-08-17T00:13:28.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.474 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251237 s, 41.7 MB/s 2023-08-17T00:13:28.500 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.500 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.501 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228294 s, 45.9 MB/s 2023-08-17T00:13:28.526 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.526 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.527 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227296 s, 46.1 MB/s 2023-08-17T00:13:28.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.553 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.553 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220284 s, 47.6 MB/s 2023-08-17T00:13:28.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.580 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239415 s, 43.8 MB/s 2023-08-17T00:13:28.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.615 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.615 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030546 s, 34.3 MB/s 2023-08-17T00:13:28.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.641 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.641 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021921 s, 47.8 MB/s 2023-08-17T00:13:28.668 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.669 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.669 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024655 s, 42.5 MB/s 2023-08-17T00:13:28.696 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.696 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.696 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022736 s, 46.1 MB/s 2023-08-17T00:13:28.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:28.698 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:28.698 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:28.698 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.6 2023-08-17T00:13:28.699 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:28.699 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:28.699 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:28.700 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.752 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.752 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196235 s, 53.4 MB/s 2023-08-17T00:13:28.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.784 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279228 s, 37.6 MB/s 2023-08-17T00:13:28.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.809 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.809 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205203 s, 51.1 MB/s 2023-08-17T00:13:28.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.836 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022659 s, 46.3 MB/s 2023-08-17T00:13:28.862 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.863 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226985 s, 46.2 MB/s 2023-08-17T00:13:28.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.886 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184571 s, 56.8 MB/s 2023-08-17T00:13:28.916 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.916 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.916 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258714 s, 40.5 MB/s 2023-08-17T00:13:28.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.949 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283204 s, 37.0 MB/s 2023-08-17T00:13:28.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:28.975 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:28.975 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02166 s, 48.4 MB/s 2023-08-17T00:13:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.001 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225903 s, 46.4 MB/s 2023-08-17T00:13:29.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.032 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267399 s, 39.2 MB/s 2023-08-17T00:13:29.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248685 s, 42.2 MB/s 2023-08-17T00:13:29.094 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.094 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.095 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289936 s, 36.2 MB/s 2023-08-17T00:13:29.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.120 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.121 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217476 s, 48.2 MB/s 2023-08-17T00:13:29.148 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.149 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235699 s, 44.5 MB/s 2023-08-17T00:13:29.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251927 s, 41.6 MB/s 2023-08-17T00:13:29.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.205 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.205 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227995 s, 46.0 MB/s 2023-08-17T00:13:29.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191277 s, 54.8 MB/s 2023-08-17T00:13:29.256 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.256 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.256 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236749 s, 44.3 MB/s 2023-08-17T00:13:29.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.289 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280633 s, 37.4 MB/s 2023-08-17T00:13:29.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.316 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227793 s, 46.0 MB/s 2023-08-17T00:13:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.348 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289061 s, 36.3 MB/s 2023-08-17T00:13:29.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.376 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230517 s, 45.5 MB/s 2023-08-17T00:13:29.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.403 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.403 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235496 s, 44.5 MB/s 2023-08-17T00:13:29.429 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.429 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.430 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221185 s, 47.4 MB/s 2023-08-17T00:13:29.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.456 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221595 s, 47.3 MB/s 2023-08-17T00:13:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.483 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237903 s, 44.1 MB/s 2023-08-17T00:13:29.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.508 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214007 s, 49.0 MB/s 2023-08-17T00:13:29.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.535 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234783 s, 44.7 MB/s 2023-08-17T00:13:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.558 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198595 s, 52.8 MB/s 2023-08-17T00:13:29.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.585 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233978 s, 44.8 MB/s 2023-08-17T00:13:29.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.610 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203255 s, 51.6 MB/s 2023-08-17T00:13:29.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:29.611 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:29.612 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:29.612 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.7 2023-08-17T00:13:29.612 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:29.613 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:29.613 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:29.613 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:29.664 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.665 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192252 s, 54.5 MB/s 2023-08-17T00:13:29.690 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.691 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.691 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218675 s, 48.0 MB/s 2023-08-17T00:13:29.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198963 s, 52.7 MB/s 2023-08-17T00:13:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.741 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207449 s, 50.5 MB/s 2023-08-17T00:13:29.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.772 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.773 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274757 s, 38.2 MB/s 2023-08-17T00:13:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252746 s, 41.5 MB/s 2023-08-17T00:13:29.828 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.829 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225309 s, 46.5 MB/s 2023-08-17T00:13:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.855 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021984 s, 47.7 MB/s 2023-08-17T00:13:29.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.878 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203823 s, 51.4 MB/s 2023-08-17T00:13:29.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223329 s, 47.0 MB/s 2023-08-17T00:13:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217753 s, 48.2 MB/s 2023-08-17T00:13:29.954 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.955 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211862 s, 49.5 MB/s 2023-08-17T00:13:29.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:29.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:29.979 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216847 s, 48.4 MB/s 2023-08-17T00:13:30.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.005 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.005 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021761 s, 48.2 MB/s 2023-08-17T00:13:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.035 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260145 s, 40.3 MB/s 2023-08-17T00:13:30.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.065 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025672 s, 40.8 MB/s 2023-08-17T00:13:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217438 s, 48.2 MB/s 2023-08-17T00:13:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031232 s, 33.6 MB/s 2023-08-17T00:13:30.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.156 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252796 s, 41.5 MB/s 2023-08-17T00:13:30.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.184 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240177 s, 43.7 MB/s 2023-08-17T00:13:30.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.215 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258937 s, 40.5 MB/s 2023-08-17T00:13:30.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269608 s, 38.9 MB/s 2023-08-17T00:13:30.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.274 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237718 s, 44.1 MB/s 2023-08-17T00:13:30.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.300 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214869 s, 48.8 MB/s 2023-08-17T00:13:30.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.322 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.322 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187083 s, 56.0 MB/s 2023-08-17T00:13:30.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.351 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.351 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238832 s, 43.9 MB/s 2023-08-17T00:13:30.374 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.375 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.375 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210303 s, 49.9 MB/s 2023-08-17T00:13:30.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.408 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0288882 s, 36.3 MB/s 2023-08-17T00:13:30.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.431 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198777 s, 52.8 MB/s 2023-08-17T00:13:30.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.460 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246896 s, 42.5 MB/s 2023-08-17T00:13:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030536 s, 34.3 MB/s 2023-08-17T00:13:30.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.519 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.519 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213074 s, 49.2 MB/s 2023-08-17T00:13:30.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:30.521 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:30.522 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:30.522 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.8 2023-08-17T00:13:30.522 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:30.522 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:30.523 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:30.523 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.631 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299867 s, 35.0 MB/s 2023-08-17T00:13:30.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216633 s, 48.4 MB/s 2023-08-17T00:13:30.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.689 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271821 s, 38.6 MB/s 2023-08-17T00:13:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231359 s, 45.3 MB/s 2023-08-17T00:13:30.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.743 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.743 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209248 s, 50.1 MB/s 2023-08-17T00:13:30.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023554 s, 44.5 MB/s 2023-08-17T00:13:30.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209045 s, 50.2 MB/s 2023-08-17T00:13:30.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.819 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214771 s, 48.8 MB/s 2023-08-17T00:13:30.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.846 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230147 s, 45.6 MB/s 2023-08-17T00:13:30.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240978 s, 43.5 MB/s 2023-08-17T00:13:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195331 s, 53.7 MB/s 2023-08-17T00:13:30.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.931 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031227 s, 33.6 MB/s 2023-08-17T00:13:30.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.959 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240053 s, 43.7 MB/s 2023-08-17T00:13:30.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:30.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:30.987 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247304 s, 42.4 MB/s 2023-08-17T00:13:31.016 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.016 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261364 s, 40.1 MB/s 2023-08-17T00:13:31.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.047 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262454 s, 40.0 MB/s 2023-08-17T00:13:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250973 s, 41.8 MB/s 2023-08-17T00:13:31.108 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.108 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.108 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278407 s, 37.7 MB/s 2023-08-17T00:13:31.140 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.141 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280516 s, 37.4 MB/s 2023-08-17T00:13:31.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.175 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.175 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294773 s, 35.6 MB/s 2023-08-17T00:13:31.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.202 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.202 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228832 s, 45.8 MB/s 2023-08-17T00:13:31.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.229 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225192 s, 46.6 MB/s 2023-08-17T00:13:31.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.255 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.255 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221754 s, 47.3 MB/s 2023-08-17T00:13:31.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.281 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229344 s, 45.7 MB/s 2023-08-17T00:13:31.307 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.307 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.307 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215949 s, 48.6 MB/s 2023-08-17T00:13:31.338 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027545 s, 38.1 MB/s 2023-08-17T00:13:31.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.371 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279042 s, 37.6 MB/s 2023-08-17T00:13:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255693 s, 41.0 MB/s 2023-08-17T00:13:31.432 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.433 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.433 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273479 s, 38.3 MB/s 2023-08-17T00:13:31.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.459 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.459 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216177 s, 48.5 MB/s 2023-08-17T00:13:31.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.486 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.486 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226572 s, 46.3 MB/s 2023-08-17T00:13:31.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234865 s, 44.6 MB/s 2023-08-17T00:13:31.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:31.515 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:31.515 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:31.516 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.9 2023-08-17T00:13:31.517 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:31.517 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:31.518 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:31.518 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:31.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193468 s, 54.2 MB/s 2023-08-17T00:13:31.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.595 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224955 s, 46.6 MB/s 2023-08-17T00:13:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.621 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022472 s, 46.7 MB/s 2023-08-17T00:13:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265371 s, 39.5 MB/s 2023-08-17T00:13:31.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.683 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256825 s, 40.8 MB/s 2023-08-17T00:13:31.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.713 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278003 s, 37.7 MB/s 2023-08-17T00:13:31.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.742 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234553 s, 44.7 MB/s 2023-08-17T00:13:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.767 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229375 s, 45.7 MB/s 2023-08-17T00:13:31.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.801 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.801 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298028 s, 35.2 MB/s 2023-08-17T00:13:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266697 s, 39.3 MB/s 2023-08-17T00:13:31.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.858 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226312 s, 46.3 MB/s 2023-08-17T00:13:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229691 s, 45.7 MB/s 2023-08-17T00:13:31.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.919 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.919 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297738 s, 35.2 MB/s 2023-08-17T00:13:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.948 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241537 s, 43.4 MB/s 2023-08-17T00:13:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:31.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:31.975 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229205 s, 45.7 MB/s 2023-08-17T00:13:32.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218502 s, 48.0 MB/s 2023-08-17T00:13:32.032 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.033 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273683 s, 38.3 MB/s 2023-08-17T00:13:32.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.059 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217575 s, 48.2 MB/s 2023-08-17T00:13:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.091 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290322 s, 36.1 MB/s 2023-08-17T00:13:32.115 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.116 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019708 s, 53.2 MB/s 2023-08-17T00:13:32.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233567 s, 44.9 MB/s 2023-08-17T00:13:32.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.169 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.169 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228978 s, 45.8 MB/s 2023-08-17T00:13:32.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.201 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297272 s, 35.3 MB/s 2023-08-17T00:13:32.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.234 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.234 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276197 s, 38.0 MB/s 2023-08-17T00:13:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.257 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.257 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0192178 s, 54.6 MB/s 2023-08-17T00:13:32.280 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.281 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.281 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213123 s, 49.2 MB/s 2023-08-17T00:13:32.310 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.311 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266084 s, 39.4 MB/s 2023-08-17T00:13:32.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.337 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.338 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228175 s, 46.0 MB/s 2023-08-17T00:13:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.364 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.365 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230974 s, 45.4 MB/s 2023-08-17T00:13:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196869 s, 53.3 MB/s 2023-08-17T00:13:32.413 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.414 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.414 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228132 s, 46.0 MB/s 2023-08-17T00:13:32.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.440 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218361 s, 48.0 MB/s 2023-08-17T00:13:32.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:32.442 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:32.442 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:32.443 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.10 2023-08-17T00:13:32.443 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:32.443 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:32.444 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:32.444 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:32.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287971 s, 36.4 MB/s 2023-08-17T00:13:32.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.577 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.577 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022367 s, 46.9 MB/s 2023-08-17T00:13:32.600 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.601 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205087 s, 51.1 MB/s 2023-08-17T00:13:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.630 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251378 s, 41.7 MB/s 2023-08-17T00:13:32.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234647 s, 44.7 MB/s 2023-08-17T00:13:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.687 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251955 s, 41.6 MB/s 2023-08-17T00:13:32.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229316 s, 45.7 MB/s 2023-08-17T00:13:32.741 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.742 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240449 s, 43.6 MB/s 2023-08-17T00:13:32.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233264 s, 45.0 MB/s 2023-08-17T00:13:32.799 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.799 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.799 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254314 s, 41.2 MB/s 2023-08-17T00:13:32.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.825 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.825 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223607 s, 46.9 MB/s 2023-08-17T00:13:32.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.855 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.855 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025098 s, 41.8 MB/s 2023-08-17T00:13:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.887 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279561 s, 37.5 MB/s 2023-08-17T00:13:32.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.911 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187931 s, 55.8 MB/s 2023-08-17T00:13:32.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.936 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220214 s, 47.6 MB/s 2023-08-17T00:13:32.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.962 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.962 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232194 s, 45.2 MB/s 2023-08-17T00:13:32.989 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:32.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:32.990 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230353 s, 45.5 MB/s 2023-08-17T00:13:33.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.023 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.024 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0292377 s, 35.9 MB/s 2023-08-17T00:13:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232826 s, 45.0 MB/s 2023-08-17T00:13:33.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.082 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259002 s, 40.5 MB/s 2023-08-17T00:13:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.116 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.117 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0298199 s, 35.2 MB/s 2023-08-17T00:13:33.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.151 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0301825 s, 34.7 MB/s 2023-08-17T00:13:33.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.177 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021786 s, 48.1 MB/s 2023-08-17T00:13:33.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.200 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.200 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185631 s, 56.5 MB/s 2023-08-17T00:13:33.232 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275161 s, 38.1 MB/s 2023-08-17T00:13:33.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.263 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267939 s, 39.1 MB/s 2023-08-17T00:13:33.296 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.297 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.297 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280855 s, 37.3 MB/s 2023-08-17T00:13:33.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0318199 s, 33.0 MB/s 2023-08-17T00:13:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.357 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203972 s, 51.4 MB/s 2023-08-17T00:13:33.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.384 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229693 s, 45.7 MB/s 2023-08-17T00:13:33.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.410 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229642 s, 45.7 MB/s 2023-08-17T00:13:33.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.435 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220478 s, 47.6 MB/s 2023-08-17T00:13:33.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:33.438 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:33.438 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:33.438 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.11 2023-08-17T00:13:33.438 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:33.439 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:33.439 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:33.439 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242909 s, 43.2 MB/s 2023-08-17T00:13:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026622 s, 39.4 MB/s 2023-08-17T00:13:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251612 s, 41.7 MB/s 2023-08-17T00:13:33.587 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.588 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.588 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225395 s, 46.5 MB/s 2023-08-17T00:13:33.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.612 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.612 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198398 s, 52.9 MB/s 2023-08-17T00:13:33.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.638 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.638 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214264 s, 48.9 MB/s 2023-08-17T00:13:33.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.664 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219618 s, 47.7 MB/s 2023-08-17T00:13:33.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.687 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204586 s, 51.3 MB/s 2023-08-17T00:13:33.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.714 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.714 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024481 s, 42.8 MB/s 2023-08-17T00:13:33.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.739 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.740 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219446 s, 47.8 MB/s 2023-08-17T00:13:33.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.768 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247147 s, 42.4 MB/s 2023-08-17T00:13:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.794 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211388 s, 49.6 MB/s 2023-08-17T00:13:33.814 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.815 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189689 s, 55.3 MB/s 2023-08-17T00:13:33.840 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.840 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.840 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216436 s, 48.4 MB/s 2023-08-17T00:13:33.865 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214914 s, 48.8 MB/s 2023-08-17T00:13:33.894 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.895 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.895 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024905 s, 42.1 MB/s 2023-08-17T00:13:33.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.920 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212166 s, 49.4 MB/s 2023-08-17T00:13:33.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.943 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.943 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200398 s, 52.3 MB/s 2023-08-17T00:13:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177139 s, 59.2 MB/s 2023-08-17T00:13:33.993 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:33.994 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:33.994 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256009 s, 41.0 MB/s 2023-08-17T00:13:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.025 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.026 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276525 s, 37.9 MB/s 2023-08-17T00:13:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191456 s, 54.8 MB/s 2023-08-17T00:13:34.077 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.078 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.078 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258161 s, 40.6 MB/s 2023-08-17T00:13:34.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.107 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252293 s, 41.6 MB/s 2023-08-17T00:13:34.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.134 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.134 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231209 s, 45.4 MB/s 2023-08-17T00:13:34.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.159 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.159 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211003 s, 49.7 MB/s 2023-08-17T00:13:34.183 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.184 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0210648 s, 49.8 MB/s 2023-08-17T00:13:34.210 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.211 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231131 s, 45.4 MB/s 2023-08-17T00:13:34.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0195343 s, 53.7 MB/s 2023-08-17T00:13:34.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.262 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024684 s, 42.5 MB/s 2023-08-17T00:13:34.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267597 s, 39.2 MB/s 2023-08-17T00:13:34.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.316 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198619 s, 52.8 MB/s 2023-08-17T00:13:34.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:34.318 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:34.319 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:34.319 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.12 2023-08-17T00:13:34.319 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:34.320 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:34.320 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:34.320 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:34.378 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.379 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244509 s, 42.9 MB/s 2023-08-17T00:13:34.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021844 s, 48.0 MB/s 2023-08-17T00:13:34.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.437 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.437 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0269411 s, 38.9 MB/s 2023-08-17T00:13:34.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.456 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.456 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159693 s, 65.7 MB/s 2023-08-17T00:13:34.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268114 s, 39.1 MB/s 2023-08-17T00:13:34.511 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.512 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209337 s, 50.1 MB/s 2023-08-17T00:13:34.538 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.538 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.539 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224916 s, 46.6 MB/s 2023-08-17T00:13:34.566 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247598 s, 42.3 MB/s 2023-08-17T00:13:34.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.594 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236943 s, 44.3 MB/s 2023-08-17T00:13:34.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.621 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.621 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226418 s, 46.3 MB/s 2023-08-17T00:13:34.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.648 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.648 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236671 s, 44.3 MB/s 2023-08-17T00:13:34.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.674 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223897 s, 46.8 MB/s 2023-08-17T00:13:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.699 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021903 s, 47.9 MB/s 2023-08-17T00:13:34.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.728 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.728 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255252 s, 41.1 MB/s 2023-08-17T00:13:34.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.754 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220019 s, 47.7 MB/s 2023-08-17T00:13:34.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.780 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216503 s, 48.4 MB/s 2023-08-17T00:13:34.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223389 s, 46.9 MB/s 2023-08-17T00:13:34.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.836 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254819 s, 41.1 MB/s 2023-08-17T00:13:34.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.863 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.864 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233962 s, 44.8 MB/s 2023-08-17T00:13:34.887 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.888 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193301 s, 54.2 MB/s 2023-08-17T00:13:34.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.914 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.914 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220309 s, 47.6 MB/s 2023-08-17T00:13:34.939 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216444 s, 48.4 MB/s 2023-08-17T00:13:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.970 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.971 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261508 s, 40.1 MB/s 2023-08-17T00:13:34.997 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223799 s, 46.9 MB/s 2023-08-17T00:13:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203186 s, 51.6 MB/s 2023-08-17T00:13:35.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.049 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232979 s, 45.0 MB/s 2023-08-17T00:13:35.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270028 s, 38.8 MB/s 2023-08-17T00:13:35.113 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.114 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.114 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284462 s, 36.9 MB/s 2023-08-17T00:13:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.146 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02806 s, 37.4 MB/s 2023-08-17T00:13:35.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.174 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233743 s, 44.9 MB/s 2023-08-17T00:13:35.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.198 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202708 s, 51.7 MB/s 2023-08-17T00:13:35.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.229 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280693 s, 37.4 MB/s 2023-08-17T00:13:35.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:35.230 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:35.231 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:35.231 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.13 2023-08-17T00:13:35.232 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:35.232 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:35.233 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:35.233 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:35.290 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.290 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.290 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244458 s, 42.9 MB/s 2023-08-17T00:13:35.314 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.315 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.315 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218053 s, 48.1 MB/s 2023-08-17T00:13:35.340 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.341 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.341 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212996 s, 49.2 MB/s 2023-08-17T00:13:35.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.371 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.372 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278364 s, 37.7 MB/s 2023-08-17T00:13:35.399 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.400 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.400 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239396 s, 43.8 MB/s 2023-08-17T00:13:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.422 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196765 s, 53.3 MB/s 2023-08-17T00:13:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.455 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290058 s, 36.2 MB/s 2023-08-17T00:13:35.480 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.481 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218386 s, 48.0 MB/s 2023-08-17T00:13:35.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.505 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.505 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208274 s, 50.3 MB/s 2023-08-17T00:13:35.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217363 s, 48.2 MB/s 2023-08-17T00:13:35.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.552 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.553 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191927 s, 54.6 MB/s 2023-08-17T00:13:35.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214966 s, 48.8 MB/s 2023-08-17T00:13:35.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.607 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024165 s, 43.4 MB/s 2023-08-17T00:13:35.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.635 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.635 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249239 s, 42.1 MB/s 2023-08-17T00:13:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.663 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238148 s, 44.0 MB/s 2023-08-17T00:13:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.692 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024647 s, 42.5 MB/s 2023-08-17T00:13:35.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.718 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.718 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022284 s, 47.1 MB/s 2023-08-17T00:13:35.743 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213255 s, 49.2 MB/s 2023-08-17T00:13:35.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.771 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.771 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222748 s, 47.1 MB/s 2023-08-17T00:13:35.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.796 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212027 s, 49.5 MB/s 2023-08-17T00:13:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.821 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208522 s, 50.3 MB/s 2023-08-17T00:13:35.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223755 s, 46.9 MB/s 2023-08-17T00:13:35.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.876 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.876 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241823 s, 43.4 MB/s 2023-08-17T00:13:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244633 s, 42.9 MB/s 2023-08-17T00:13:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.929 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211695 s, 49.5 MB/s 2023-08-17T00:13:35.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.961 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.961 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280505 s, 37.4 MB/s 2023-08-17T00:13:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:35.990 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247819 s, 42.3 MB/s 2023-08-17T00:13:36.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.021 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273693 s, 38.3 MB/s 2023-08-17T00:13:36.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.049 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243541 s, 43.1 MB/s 2023-08-17T00:13:36.079 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.080 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262815 s, 39.9 MB/s 2023-08-17T00:13:36.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.107 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.108 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230447 s, 45.5 MB/s 2023-08-17T00:13:36.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.132 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213283 s, 49.2 MB/s 2023-08-17T00:13:36.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:36.134 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:36.134 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:36.135 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.14 2023-08-17T00:13:36.135 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:36.135 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:36.136 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:36.136 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:36.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.197 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268505 s, 39.1 MB/s 2023-08-17T00:13:36.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.225 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239992 s, 43.7 MB/s 2023-08-17T00:13:36.260 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.260 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.260 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0309968 s, 33.8 MB/s 2023-08-17T00:13:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290306 s, 36.1 MB/s 2023-08-17T00:13:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.323 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262712 s, 39.9 MB/s 2023-08-17T00:13:36.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.350 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223688 s, 46.9 MB/s 2023-08-17T00:13:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.377 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225709 s, 46.5 MB/s 2023-08-17T00:13:36.410 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.411 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303199 s, 34.6 MB/s 2023-08-17T00:13:36.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.443 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.444 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275777 s, 38.0 MB/s 2023-08-17T00:13:36.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.469 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021723 s, 48.3 MB/s 2023-08-17T00:13:36.499 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.500 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.500 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.026241 s, 40.0 MB/s 2023-08-17T00:13:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268715 s, 39.0 MB/s 2023-08-17T00:13:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.558 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233597 s, 44.9 MB/s 2023-08-17T00:13:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.586 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023796 s, 44.1 MB/s 2023-08-17T00:13:36.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.613 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.613 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228926 s, 45.8 MB/s 2023-08-17T00:13:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.643 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265447 s, 39.5 MB/s 2023-08-17T00:13:36.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.673 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.673 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262569 s, 39.9 MB/s 2023-08-17T00:13:36.697 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.697 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.697 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200696 s, 52.2 MB/s 2023-08-17T00:13:36.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.722 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209996 s, 49.9 MB/s 2023-08-17T00:13:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215961 s, 48.6 MB/s 2023-08-17T00:13:36.776 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255612 s, 41.0 MB/s 2023-08-17T00:13:36.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.808 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.808 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270724 s, 38.7 MB/s 2023-08-17T00:13:36.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.835 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224549 s, 46.7 MB/s 2023-08-17T00:13:36.857 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.858 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198873 s, 52.7 MB/s 2023-08-17T00:13:36.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.884 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222904 s, 47.0 MB/s 2023-08-17T00:13:36.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.910 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220621 s, 47.5 MB/s 2023-08-17T00:13:36.939 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.940 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.940 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251737 s, 41.7 MB/s 2023-08-17T00:13:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:36.969 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242709 s, 43.2 MB/s 2023-08-17T00:13:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.003 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.004 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0304002 s, 34.5 MB/s 2023-08-17T00:13:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.030 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225493 s, 46.5 MB/s 2023-08-17T00:13:37.057 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236766 s, 44.3 MB/s 2023-08-17T00:13:37.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.084 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.084 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221848 s, 47.3 MB/s 2023-08-17T00:13:37.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:37.086 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:37.086 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:37.086 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.15 2023-08-17T00:13:37.087 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:37.087 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:37.087 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:37.088 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:37.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.142 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.143 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020654 s, 50.8 MB/s 2023-08-17T00:13:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.170 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02336 s, 44.9 MB/s 2023-08-17T00:13:37.195 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.196 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219476 s, 47.8 MB/s 2023-08-17T00:13:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.216 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177515 s, 59.1 MB/s 2023-08-17T00:13:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.239 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.240 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190198 s, 55.1 MB/s 2023-08-17T00:13:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.266 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021765 s, 48.2 MB/s 2023-08-17T00:13:37.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.289 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.290 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208982 s, 50.2 MB/s 2023-08-17T00:13:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.325 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.326 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0322637 s, 32.5 MB/s 2023-08-17T00:13:37.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.359 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0293985 s, 35.7 MB/s 2023-08-17T00:13:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.385 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023018 s, 45.6 MB/s 2023-08-17T00:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.409 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213722 s, 49.1 MB/s 2023-08-17T00:13:37.447 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.448 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0335217 s, 31.3 MB/s 2023-08-17T00:13:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.477 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.478 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253236 s, 41.4 MB/s 2023-08-17T00:13:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259902 s, 40.3 MB/s 2023-08-17T00:13:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276389 s, 37.9 MB/s 2023-08-17T00:13:37.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229544 s, 45.7 MB/s 2023-08-17T00:13:37.595 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.596 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241213 s, 43.5 MB/s 2023-08-17T00:13:37.623 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.623 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.623 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241589 s, 43.4 MB/s 2023-08-17T00:13:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02337 s, 44.9 MB/s 2023-08-17T00:13:37.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.680 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264615 s, 39.6 MB/s 2023-08-17T00:13:37.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261842 s, 40.0 MB/s 2023-08-17T00:13:37.742 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.743 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.743 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286939 s, 36.5 MB/s 2023-08-17T00:13:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.769 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223013 s, 47.0 MB/s 2023-08-17T00:13:37.794 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.795 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219267 s, 47.8 MB/s 2023-08-17T00:13:37.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199138 s, 52.7 MB/s 2023-08-17T00:13:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.849 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270174 s, 38.8 MB/s 2023-08-17T00:13:37.880 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.881 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.881 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268579 s, 39.0 MB/s 2023-08-17T00:13:37.916 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.916 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.917 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0313302 s, 33.5 MB/s 2023-08-17T00:13:37.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.947 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249713 s, 42.0 MB/s 2023-08-17T00:13:37.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:37.969 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:37.969 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203742 s, 51.5 MB/s 2023-08-17T00:13:38.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.002 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.002 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286543 s, 36.6 MB/s 2023-08-17T00:13:38.029 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.030 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235315 s, 44.6 MB/s 2023-08-17T00:13:38.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:38.031 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:38.032 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:38.032 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.16 2023-08-17T00:13:38.032 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:38.032 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:38.033 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:38.033 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.082 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193108 s, 54.3 MB/s 2023-08-17T00:13:38.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.103 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.103 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174161 s, 60.2 MB/s 2023-08-17T00:13:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.128 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.129 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021337 s, 49.1 MB/s 2023-08-17T00:13:38.160 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.161 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.161 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278895 s, 37.6 MB/s 2023-08-17T00:13:38.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.190 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.190 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254502 s, 41.2 MB/s 2023-08-17T00:13:38.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.217 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.217 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232077 s, 45.2 MB/s 2023-08-17T00:13:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.243 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214393 s, 48.9 MB/s 2023-08-17T00:13:38.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.277 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302785 s, 34.6 MB/s 2023-08-17T00:13:38.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.313 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0326586 s, 32.1 MB/s 2023-08-17T00:13:38.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.342 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.342 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250282 s, 41.9 MB/s 2023-08-17T00:13:38.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0338273 s, 31.0 MB/s 2023-08-17T00:13:38.408 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.408 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.408 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242843 s, 43.2 MB/s 2023-08-17T00:13:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.430 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193313 s, 54.2 MB/s 2023-08-17T00:13:38.453 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.454 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0198823 s, 52.7 MB/s 2023-08-17T00:13:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.482 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233816 s, 44.8 MB/s 2023-08-17T00:13:38.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.508 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.509 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233034 s, 45.0 MB/s 2023-08-17T00:13:38.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.537 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.537 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241327 s, 43.5 MB/s 2023-08-17T00:13:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027086 s, 38.7 MB/s 2023-08-17T00:13:38.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.597 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.597 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242896 s, 43.2 MB/s 2023-08-17T00:13:38.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.626 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245971 s, 42.6 MB/s 2023-08-17T00:13:38.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.650 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.651 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215022 s, 48.8 MB/s 2023-08-17T00:13:38.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.680 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.680 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256054 s, 41.0 MB/s 2023-08-17T00:13:38.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271795 s, 38.6 MB/s 2023-08-17T00:13:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220295 s, 47.6 MB/s 2023-08-17T00:13:38.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.768 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.768 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027528 s, 38.1 MB/s 2023-08-17T00:13:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.795 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220076 s, 47.6 MB/s 2023-08-17T00:13:38.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.818 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199286 s, 52.6 MB/s 2023-08-17T00:13:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.850 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280498 s, 37.4 MB/s 2023-08-17T00:13:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.879 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235815 s, 44.5 MB/s 2023-08-17T00:13:38.904 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.905 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221185 s, 47.4 MB/s 2023-08-17T00:13:38.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.933 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251822 s, 41.6 MB/s 2023-08-17T00:13:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:38.959 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220432 s, 47.6 MB/s 2023-08-17T00:13:38.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:38.961 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:38.961 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:38.962 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.17 2023-08-17T00:13:38.962 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:38.962 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:38.963 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:38.963 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:39.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021942 s, 47.8 MB/s 2023-08-17T00:13:39.095 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.096 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294281 s, 35.6 MB/s 2023-08-17T00:13:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240372 s, 43.6 MB/s 2023-08-17T00:13:39.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.150 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.150 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020992 s, 50.0 MB/s 2023-08-17T00:13:39.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.182 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028019 s, 37.4 MB/s 2023-08-17T00:13:39.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.206 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216763 s, 48.4 MB/s 2023-08-17T00:13:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234205 s, 44.8 MB/s 2023-08-17T00:13:39.261 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.262 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.262 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244497 s, 42.9 MB/s 2023-08-17T00:13:39.283 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.284 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184604 s, 56.8 MB/s 2023-08-17T00:13:39.311 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.312 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.312 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228617 s, 45.9 MB/s 2023-08-17T00:13:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.336 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204391 s, 51.3 MB/s 2023-08-17T00:13:39.358 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.359 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196798 s, 53.3 MB/s 2023-08-17T00:13:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.387 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246688 s, 42.5 MB/s 2023-08-17T00:13:39.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.409 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.409 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190123 s, 55.2 MB/s 2023-08-17T00:13:39.430 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.431 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187643 s, 55.9 MB/s 2023-08-17T00:13:39.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.455 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.456 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209337 s, 50.1 MB/s 2023-08-17T00:13:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.485 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268524 s, 39.0 MB/s 2023-08-17T00:13:39.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236167 s, 44.4 MB/s 2023-08-17T00:13:39.539 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.540 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224119 s, 46.8 MB/s 2023-08-17T00:13:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.570 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260378 s, 40.3 MB/s 2023-08-17T00:13:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.596 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216998 s, 48.3 MB/s 2023-08-17T00:13:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268318 s, 39.1 MB/s 2023-08-17T00:13:39.653 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.654 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231237 s, 45.3 MB/s 2023-08-17T00:13:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242059 s, 43.3 MB/s 2023-08-17T00:13:39.711 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.711 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.712 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264101 s, 39.7 MB/s 2023-08-17T00:13:39.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.740 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.741 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238127 s, 44.0 MB/s 2023-08-17T00:13:39.767 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.767 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.767 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226339 s, 46.3 MB/s 2023-08-17T00:13:39.796 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.797 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246174 s, 42.6 MB/s 2023-08-17T00:13:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0197186 s, 53.2 MB/s 2023-08-17T00:13:39.852 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.853 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0316112 s, 33.2 MB/s 2023-08-17T00:13:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251286 s, 41.7 MB/s 2023-08-17T00:13:39.909 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.910 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224675 s, 46.7 MB/s 2023-08-17T00:13:39.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:39.912 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:39.913 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:39.914 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.18 2023-08-17T00:13:39.914 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:39.915 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:39.916 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:39.917 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:39.977 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275419 s, 38.1 MB/s 2023-08-17T00:13:40.004 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.004 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.005 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227591 s, 46.1 MB/s 2023-08-17T00:13:40.027 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.028 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199283 s, 52.6 MB/s 2023-08-17T00:13:40.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.054 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.054 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02226 s, 47.1 MB/s 2023-08-17T00:13:40.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.081 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.081 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229904 s, 45.6 MB/s 2023-08-17T00:13:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.106 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201642 s, 52.0 MB/s 2023-08-17T00:13:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.136 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256012 s, 41.0 MB/s 2023-08-17T00:13:40.162 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.163 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.164 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217143 s, 48.3 MB/s 2023-08-17T00:13:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267704 s, 39.2 MB/s 2023-08-17T00:13:40.219 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.220 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237182 s, 44.2 MB/s 2023-08-17T00:13:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.249 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0261885 s, 40.0 MB/s 2023-08-17T00:13:40.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.277 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.277 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229476 s, 45.7 MB/s 2023-08-17T00:13:40.304 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.305 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.305 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238095 s, 44.0 MB/s 2023-08-17T00:13:40.331 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226107 s, 46.4 MB/s 2023-08-17T00:13:40.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.363 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.363 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279404 s, 37.5 MB/s 2023-08-17T00:13:40.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.391 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241447 s, 43.4 MB/s 2023-08-17T00:13:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.420 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253256 s, 41.4 MB/s 2023-08-17T00:13:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.454 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297508 s, 35.2 MB/s 2023-08-17T00:13:40.481 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.482 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023507 s, 44.6 MB/s 2023-08-17T00:13:40.512 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.513 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.513 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0276597 s, 37.9 MB/s 2023-08-17T00:13:40.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.541 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.541 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235037 s, 44.6 MB/s 2023-08-17T00:13:40.567 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242004 s, 43.3 MB/s 2023-08-17T00:13:40.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.592 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.592 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205639 s, 51.0 MB/s 2023-08-17T00:13:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223841 s, 46.8 MB/s 2023-08-17T00:13:40.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.644 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218885 s, 47.9 MB/s 2023-08-17T00:13:40.665 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.666 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0186775 s, 56.1 MB/s 2023-08-17T00:13:40.695 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:40.695 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:40.696 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252657 s, 41.5 MB/s 2023-08-17T00:13:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.562 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.862868 s, 1.2 MB/s 2023-08-17T00:13:41.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.589 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.589 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247358 s, 42.4 MB/s 2023-08-17T00:13:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.620 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263995 s, 39.7 MB/s 2023-08-17T00:13:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175655 s, 59.7 MB/s 2023-08-17T00:13:41.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.666 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.666 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232665 s, 45.1 MB/s 2023-08-17T00:13:41.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:41.668 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:41.669 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:41.669 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.19 2023-08-17T00:13:41.669 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:41.670 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:41.671 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:41.671 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:41.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.721 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.721 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221474 s, 47.3 MB/s 2023-08-17T00:13:41.744 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.745 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202333 s, 51.8 MB/s 2023-08-17T00:13:41.775 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.775 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.776 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027665 s, 37.9 MB/s 2023-08-17T00:13:41.804 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.805 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256633 s, 40.9 MB/s 2023-08-17T00:13:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.830 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215596 s, 48.6 MB/s 2023-08-17T00:13:41.858 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.859 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0255461 s, 41.0 MB/s 2023-08-17T00:13:41.888 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.889 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.889 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256905 s, 40.8 MB/s 2023-08-17T00:13:41.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.915 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.915 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224676 s, 46.7 MB/s 2023-08-17T00:13:41.939 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.939 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.940 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019111 s, 54.9 MB/s 2023-08-17T00:13:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:41.968 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248909 s, 42.1 MB/s 2023-08-17T00:13:42.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.001 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.001 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279766 s, 37.5 MB/s 2023-08-17T00:13:42.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.033 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.033 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028997 s, 36.2 MB/s 2023-08-17T00:13:42.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.061 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.062 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238739 s, 43.9 MB/s 2023-08-17T00:13:42.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.094 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.094 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279802 s, 37.5 MB/s 2023-08-17T00:13:42.127 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.127 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.127 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287331 s, 36.5 MB/s 2023-08-17T00:13:42.154 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.155 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236386 s, 44.4 MB/s 2023-08-17T00:13:42.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.184 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239643 s, 43.8 MB/s 2023-08-17T00:13:42.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212446 s, 49.4 MB/s 2023-08-17T00:13:42.242 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.243 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.243 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314658 s, 33.3 MB/s 2023-08-17T00:13:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185579 s, 56.5 MB/s 2023-08-17T00:13:42.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.288 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.288 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199115 s, 52.7 MB/s 2023-08-17T00:13:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.320 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271318 s, 38.6 MB/s 2023-08-17T00:13:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.350 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0273928 s, 38.3 MB/s 2023-08-17T00:13:42.376 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.377 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211889 s, 49.5 MB/s 2023-08-17T00:13:42.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.408 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.408 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0284812 s, 36.8 MB/s 2023-08-17T00:13:42.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.436 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.436 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239758 s, 43.7 MB/s 2023-08-17T00:13:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0290005 s, 36.2 MB/s 2023-08-17T00:13:42.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.497 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.497 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228882 s, 45.8 MB/s 2023-08-17T00:13:42.520 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.521 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0194429 s, 53.9 MB/s 2023-08-17T00:13:42.546 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.546 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.547 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218606 s, 48.0 MB/s 2023-08-17T00:13:42.572 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.572 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.572 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221681 s, 47.3 MB/s 2023-08-17T00:13:42.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.611 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.611 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0344007 s, 30.5 MB/s 2023-08-17T00:13:42.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:42.614 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:42.614 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:42.614 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.20 2023-08-17T00:13:42.615 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:42.615 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:42.615 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:42.615 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204387 s, 51.3 MB/s 2023-08-17T00:13:42.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.738 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242424 s, 43.3 MB/s 2023-08-17T00:13:42.766 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.766 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.767 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258131 s, 40.6 MB/s 2023-08-17T00:13:42.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.793 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224422 s, 46.7 MB/s 2023-08-17T00:13:42.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.816 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.019412 s, 54.0 MB/s 2023-08-17T00:13:42.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.846 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025141 s, 41.7 MB/s 2023-08-17T00:13:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280421 s, 37.4 MB/s 2023-08-17T00:13:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230401 s, 45.5 MB/s 2023-08-17T00:13:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.931 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021985 s, 47.7 MB/s 2023-08-17T00:13:42.957 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.958 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.959 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240044 s, 43.7 MB/s 2023-08-17T00:13:42.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:42.988 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257486 s, 40.7 MB/s 2023-08-17T00:13:43.017 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.018 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.018 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253281 s, 41.4 MB/s 2023-08-17T00:13:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.047 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250917 s, 41.8 MB/s 2023-08-17T00:13:43.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.075 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245434 s, 42.7 MB/s 2023-08-17T00:13:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226988 s, 46.2 MB/s 2023-08-17T00:13:43.129 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.130 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237684 s, 44.1 MB/s 2023-08-17T00:13:43.156 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.157 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.157 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229259 s, 45.7 MB/s 2023-08-17T00:13:43.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.178 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0188941 s, 55.5 MB/s 2023-08-17T00:13:43.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.201 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.201 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203512 s, 51.5 MB/s 2023-08-17T00:13:43.227 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.228 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.228 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233733 s, 44.9 MB/s 2023-08-17T00:13:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154612 s, 67.8 MB/s 2023-08-17T00:13:43.272 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.273 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230395 s, 45.5 MB/s 2023-08-17T00:13:43.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.298 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.298 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209691 s, 50.0 MB/s 2023-08-17T00:13:43.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.323 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.324 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218515 s, 48.0 MB/s 2023-08-17T00:13:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0174548 s, 60.1 MB/s 2023-08-17T00:13:43.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.377 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.378 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302176 s, 34.7 MB/s 2023-08-17T00:13:43.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.406 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.407 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248197 s, 42.2 MB/s 2023-08-17T00:13:43.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.431 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.431 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213373 s, 49.1 MB/s 2023-08-17T00:13:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.458 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.459 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237592 s, 44.1 MB/s 2023-08-17T00:13:43.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.487 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253571 s, 41.4 MB/s 2023-08-17T00:13:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.514 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225242 s, 46.6 MB/s 2023-08-17T00:13:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223852 s, 46.8 MB/s 2023-08-17T00:13:43.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:43.542 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:43.542 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:43.542 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.21 2023-08-17T00:13:43.543 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:43.543 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:43.544 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:43.544 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:43.600 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.600 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.600 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249085 s, 42.1 MB/s 2023-08-17T00:13:43.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.634 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296172 s, 35.4 MB/s 2023-08-17T00:13:43.661 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.661 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.661 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240185 s, 43.7 MB/s 2023-08-17T00:13:43.694 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.695 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.695 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.028728 s, 36.5 MB/s 2023-08-17T00:13:43.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.723 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.723 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024915 s, 42.1 MB/s 2023-08-17T00:13:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265037 s, 39.6 MB/s 2023-08-17T00:13:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.779 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.780 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206535 s, 50.8 MB/s 2023-08-17T00:13:43.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225591 s, 46.5 MB/s 2023-08-17T00:13:43.842 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330287 s, 31.7 MB/s 2023-08-17T00:13:43.877 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.030478 s, 34.4 MB/s 2023-08-17T00:13:43.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.907 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251252 s, 41.7 MB/s 2023-08-17T00:13:43.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.932 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.932 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217435 s, 48.2 MB/s 2023-08-17T00:13:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231011 s, 45.4 MB/s 2023-08-17T00:13:43.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:43.987 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:43.988 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243875 s, 43.0 MB/s 2023-08-17T00:13:44.009 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.010 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0189334 s, 55.4 MB/s 2023-08-17T00:13:44.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.042 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277922 s, 37.7 MB/s 2023-08-17T00:13:44.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.070 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241123 s, 43.5 MB/s 2023-08-17T00:13:44.096 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.097 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.097 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224364 s, 46.7 MB/s 2023-08-17T00:13:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245192 s, 42.8 MB/s 2023-08-17T00:13:44.150 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.151 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.151 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217465 s, 48.2 MB/s 2023-08-17T00:13:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.178 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237093 s, 44.2 MB/s 2023-08-17T00:13:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.207 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251662 s, 41.7 MB/s 2023-08-17T00:13:44.232 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216354 s, 48.5 MB/s 2023-08-17T00:13:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.263 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0259742 s, 40.4 MB/s 2023-08-17T00:13:44.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263835 s, 39.7 MB/s 2023-08-17T00:13:44.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221582 s, 47.3 MB/s 2023-08-17T00:13:44.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.348 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.348 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251345 s, 41.7 MB/s 2023-08-17T00:13:44.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0265673 s, 39.5 MB/s 2023-08-17T00:13:44.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.405 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225238 s, 46.6 MB/s 2023-08-17T00:13:44.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.434 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.434 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245009 s, 42.8 MB/s 2023-08-17T00:13:44.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.463 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258429 s, 40.6 MB/s 2023-08-17T00:13:44.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.491 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240677 s, 43.6 MB/s 2023-08-17T00:13:44.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:44.493 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:44.493 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:44.494 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.22 2023-08-17T00:13:44.494 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:44.494 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:44.494 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:44.495 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232098 s, 45.2 MB/s 2023-08-17T00:13:44.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.582 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256926 s, 40.8 MB/s 2023-08-17T00:13:44.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.610 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235511 s, 44.5 MB/s 2023-08-17T00:13:44.636 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.637 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.637 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230712 s, 45.4 MB/s 2023-08-17T00:13:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.672 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.672 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299358 s, 35.0 MB/s 2023-08-17T00:13:44.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.703 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275426 s, 38.1 MB/s 2023-08-17T00:13:44.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.729 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.729 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213898 s, 49.0 MB/s 2023-08-17T00:13:44.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.754 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.754 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205934 s, 50.9 MB/s 2023-08-17T00:13:44.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.782 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.782 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238637 s, 43.9 MB/s 2023-08-17T00:13:44.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.810 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.811 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242687 s, 43.2 MB/s 2023-08-17T00:13:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.836 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225347 s, 46.5 MB/s 2023-08-17T00:13:44.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.864 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.864 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228244 s, 45.9 MB/s 2023-08-17T00:13:44.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.898 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303572 s, 34.5 MB/s 2023-08-17T00:13:44.925 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.925 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.926 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231829 s, 45.2 MB/s 2023-08-17T00:13:44.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.955 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.955 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254087 s, 41.3 MB/s 2023-08-17T00:13:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:44.979 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215392 s, 48.7 MB/s 2023-08-17T00:13:45.010 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.011 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277346 s, 37.8 MB/s 2023-08-17T00:13:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226136 s, 46.4 MB/s 2023-08-17T00:13:45.065 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.066 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.066 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244283 s, 42.9 MB/s 2023-08-17T00:13:45.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.093 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229148 s, 45.8 MB/s 2023-08-17T00:13:45.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0168204 s, 62.3 MB/s 2023-08-17T00:13:45.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.141 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.142 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252536 s, 41.5 MB/s 2023-08-17T00:13:45.170 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.171 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.171 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025626 s, 40.9 MB/s 2023-08-17T00:13:45.193 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.194 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0187237 s, 56.0 MB/s 2023-08-17T00:13:45.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.226 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.226 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267496 s, 39.2 MB/s 2023-08-17T00:13:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248802 s, 42.1 MB/s 2023-08-17T00:13:45.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.274 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.275 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172478 s, 60.8 MB/s 2023-08-17T00:13:45.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.301 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.301 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232696 s, 45.1 MB/s 2023-08-17T00:13:45.326 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.327 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.327 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022748 s, 46.1 MB/s 2023-08-17T00:13:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237436 s, 44.2 MB/s 2023-08-17T00:13:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0242979 s, 43.2 MB/s 2023-08-17T00:13:45.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.412 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247622 s, 42.3 MB/s 2023-08-17T00:13:45.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:45.414 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:45.415 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:45.415 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.23 2023-08-17T00:13:45.416 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:45.416 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:45.417 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:45.417 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:45.470 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.470 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.470 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203024 s, 51.6 MB/s 2023-08-17T00:13:45.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.493 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.493 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201257 s, 52.1 MB/s 2023-08-17T00:13:45.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.524 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268487 s, 39.1 MB/s 2023-08-17T00:13:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.554 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245056 s, 42.8 MB/s 2023-08-17T00:13:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253602 s, 41.3 MB/s 2023-08-17T00:13:45.616 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.617 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.617 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0303996 s, 34.5 MB/s 2023-08-17T00:13:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.641 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199126 s, 52.7 MB/s 2023-08-17T00:13:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283925 s, 36.9 MB/s 2023-08-17T00:13:45.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.708 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.708 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0299658 s, 35.0 MB/s 2023-08-17T00:13:45.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225575 s, 46.5 MB/s 2023-08-17T00:13:45.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.761 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.761 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216034 s, 48.5 MB/s 2023-08-17T00:13:45.780 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.781 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0169992 s, 61.7 MB/s 2023-08-17T00:13:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217229 s, 48.3 MB/s 2023-08-17T00:13:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.834 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225742 s, 46.5 MB/s 2023-08-17T00:13:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243487 s, 43.1 MB/s 2023-08-17T00:13:45.884 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.885 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203461 s, 51.5 MB/s 2023-08-17T00:13:45.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.911 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214868 s, 48.8 MB/s 2023-08-17T00:13:45.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.937 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.938 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228366 s, 45.9 MB/s 2023-08-17T00:13:45.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.963 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.963 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220819 s, 47.5 MB/s 2023-08-17T00:13:45.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:45.988 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:45.988 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213018 s, 49.2 MB/s 2023-08-17T00:13:46.016 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.016 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.016 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235904 s, 44.4 MB/s 2023-08-17T00:13:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021235 s, 49.4 MB/s 2023-08-17T00:13:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277993 s, 37.7 MB/s 2023-08-17T00:13:46.101 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.102 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.103 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223455 s, 46.9 MB/s 2023-08-17T00:13:46.127 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.127 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.128 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0214942 s, 48.8 MB/s 2023-08-17T00:13:46.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.153 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.153 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208889 s, 50.2 MB/s 2023-08-17T00:13:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.181 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234588 s, 44.7 MB/s 2023-08-17T00:13:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.214 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287516 s, 36.5 MB/s 2023-08-17T00:13:46.240 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.241 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.241 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229882 s, 45.6 MB/s 2023-08-17T00:13:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224653 s, 46.7 MB/s 2023-08-17T00:13:46.292 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230062 s, 45.6 MB/s 2023-08-17T00:13:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.320 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237372 s, 44.2 MB/s 2023-08-17T00:13:46.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:46.323 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:46.323 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:46.324 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.24 2023-08-17T00:13:46.325 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:46.326 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:46.326 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:46.327 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:46.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.391 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.391 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0289027 s, 36.3 MB/s 2023-08-17T00:13:46.418 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.419 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.419 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244894 s, 42.8 MB/s 2023-08-17T00:13:46.438 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.439 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177626 s, 59.0 MB/s 2023-08-17T00:13:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206901 s, 50.7 MB/s 2023-08-17T00:13:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.490 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232196 s, 45.2 MB/s 2023-08-17T00:13:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0307092 s, 34.1 MB/s 2023-08-17T00:13:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.551 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021506 s, 48.8 MB/s 2023-08-17T00:13:46.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238102 s, 44.0 MB/s 2023-08-17T00:13:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.602 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.603 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201345 s, 52.1 MB/s 2023-08-17T00:13:46.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.628 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0209324 s, 50.1 MB/s 2023-08-17T00:13:46.656 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.657 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252032 s, 41.6 MB/s 2023-08-17T00:13:46.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.683 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.684 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221763 s, 47.3 MB/s 2023-08-17T00:13:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.709 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213559 s, 49.1 MB/s 2023-08-17T00:13:46.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.738 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236967 s, 44.2 MB/s 2023-08-17T00:13:46.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240132 s, 43.7 MB/s 2023-08-17T00:13:46.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.793 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232235 s, 45.2 MB/s 2023-08-17T00:13:46.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021901 s, 47.9 MB/s 2023-08-17T00:13:46.845 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.846 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.846 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233117 s, 45.0 MB/s 2023-08-17T00:13:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.872 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.873 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216422 s, 48.5 MB/s 2023-08-17T00:13:46.906 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.907 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.907 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308269 s, 34.0 MB/s 2023-08-17T00:13:46.933 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.934 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.934 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234815 s, 44.7 MB/s 2023-08-17T00:13:46.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.964 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.964 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262859 s, 39.9 MB/s 2023-08-17T00:13:46.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:46.995 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:46.995 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267165 s, 39.2 MB/s 2023-08-17T00:13:47.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.022 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.022 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227318 s, 46.1 MB/s 2023-08-17T00:13:47.048 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.049 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.049 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215102 s, 48.7 MB/s 2023-08-17T00:13:47.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:13:47.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:13:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219738 s, 47.7 MB/s 2023-08-17T00:13:47.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.112 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.112 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0320897 s, 32.7 MB/s 2023-08-17T00:13:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.137 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.138 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220277 s, 47.6 MB/s 2023-08-17T00:13:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239044 s, 43.9 MB/s 2023-08-17T00:13:47.196 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.197 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0279552 s, 37.5 MB/s 2023-08-17T00:13:47.224 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.225 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023168 s, 45.3 MB/s 2023-08-17T00:13:47.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.250 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.250 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221963 s, 47.2 MB/s 2023-08-17T00:13:47.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:47.252 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:47.252 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:47.253 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.25 2023-08-17T00:13:47.254 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:47.254 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:47.255 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:47.255 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:47.355 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.356 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271755 s, 38.6 MB/s 2023-08-17T00:13:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.383 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02337 s, 44.9 MB/s 2023-08-17T00:13:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.407 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211555 s, 49.6 MB/s 2023-08-17T00:13:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.443 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314485 s, 33.3 MB/s 2023-08-17T00:13:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.468 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206482 s, 50.8 MB/s 2023-08-17T00:13:47.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.490 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.491 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200994 s, 52.2 MB/s 2023-08-17T00:13:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.515 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0205482 s, 51.0 MB/s 2023-08-17T00:13:47.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.536 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.536 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0184464 s, 56.8 MB/s 2023-08-17T00:13:47.565 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.566 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.566 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252739 s, 41.5 MB/s 2023-08-17T00:13:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.602 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.602 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031386 s, 33.4 MB/s 2023-08-17T00:13:47.627 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.628 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021843 s, 48.0 MB/s 2023-08-17T00:13:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.655 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.655 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229858 s, 45.6 MB/s 2023-08-17T00:13:47.686 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.687 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.687 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0283243 s, 37.0 MB/s 2023-08-17T00:13:47.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.715 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.715 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244677 s, 42.9 MB/s 2023-08-17T00:13:47.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.747 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263338 s, 39.8 MB/s 2023-08-17T00:13:47.776 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.777 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.777 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263489 s, 39.8 MB/s 2023-08-17T00:13:47.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.806 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.806 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254019 s, 41.3 MB/s 2023-08-17T00:13:47.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.834 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.834 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237573 s, 44.1 MB/s 2023-08-17T00:13:47.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.859 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.860 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206638 s, 50.7 MB/s 2023-08-17T00:13:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.885 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.886 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227025 s, 46.2 MB/s 2023-08-17T00:13:47.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.911 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.912 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221409 s, 47.4 MB/s 2023-08-17T00:13:47.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.947 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.947 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0312999 s, 33.5 MB/s 2023-08-17T00:13:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226644 s, 46.3 MB/s 2023-08-17T00:13:47.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.000 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.000 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218311 s, 48.0 MB/s 2023-08-17T00:13:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.028 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240985 s, 43.5 MB/s 2023-08-17T00:13:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.055 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023088 s, 45.4 MB/s 2023-08-17T00:13:48.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.080 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.080 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215886 s, 48.6 MB/s 2023-08-17T00:13:48.105 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.106 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.106 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219327 s, 47.8 MB/s 2023-08-17T00:13:48.135 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.136 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.136 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254675 s, 41.2 MB/s 2023-08-17T00:13:48.164 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0244511 s, 42.9 MB/s 2023-08-17T00:13:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.029393 s, 35.7 MB/s 2023-08-17T00:13:48.231 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.231 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0286266 s, 36.6 MB/s 2023-08-17T00:13:48.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:48.234 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:48.234 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:48.234 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.26 2023-08-17T00:13:48.235 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:48.235 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:48.235 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:48.236 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:48.292 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.293 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232712 s, 45.1 MB/s 2023-08-17T00:13:48.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.316 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.317 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021856 s, 48.0 MB/s 2023-08-17T00:13:48.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.343 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.343 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238403 s, 44.0 MB/s 2023-08-17T00:13:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0228391 s, 45.9 MB/s 2023-08-17T00:13:48.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.395 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.395 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220093 s, 47.6 MB/s 2023-08-17T00:13:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231515 s, 45.3 MB/s 2023-08-17T00:13:48.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.449 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.449 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0220341 s, 47.6 MB/s 2023-08-17T00:13:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253723 s, 41.3 MB/s 2023-08-17T00:13:48.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.504 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206525 s, 50.8 MB/s 2023-08-17T00:13:48.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.523 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.523 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0167175 s, 62.7 MB/s 2023-08-17T00:13:48.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.556 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.556 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0281652 s, 37.2 MB/s 2023-08-17T00:13:48.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.580 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202762 s, 51.7 MB/s 2023-08-17T00:13:48.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.605 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208646 s, 50.3 MB/s 2023-08-17T00:13:48.631 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.632 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.632 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235151 s, 44.6 MB/s 2023-08-17T00:13:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.658 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230646 s, 45.5 MB/s 2023-08-17T00:13:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023211 s, 45.2 MB/s 2023-08-17T00:13:48.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.710 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.711 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021352 s, 49.1 MB/s 2023-08-17T00:13:48.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.737 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.737 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229444 s, 45.7 MB/s 2023-08-17T00:13:48.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219837 s, 47.7 MB/s 2023-08-17T00:13:48.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.788 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218978 s, 47.9 MB/s 2023-08-17T00:13:48.812 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.813 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.813 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201647 s, 52.0 MB/s 2023-08-17T00:13:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.843 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274808 s, 38.2 MB/s 2023-08-17T00:13:48.869 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.870 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233969 s, 44.8 MB/s 2023-08-17T00:13:48.898 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.899 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247671 s, 42.3 MB/s 2023-08-17T00:13:48.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.926 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.926 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234371 s, 44.7 MB/s 2023-08-17T00:13:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.954 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.954 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023194 s, 45.2 MB/s 2023-08-17T00:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:48.990 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0327211 s, 32.0 MB/s 2023-08-17T00:13:49.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.013 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.013 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191532 s, 54.7 MB/s 2023-08-17T00:13:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235912 s, 44.4 MB/s 2023-08-17T00:13:49.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.071 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.071 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247401 s, 42.4 MB/s 2023-08-17T00:13:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245326 s, 42.7 MB/s 2023-08-17T00:13:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0274916 s, 38.1 MB/s 2023-08-17T00:13:49.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:49.133 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:49.133 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:49.134 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.27 2023-08-17T00:13:49.134 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:49.134 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:49.135 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:49.135 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:49.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.189 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.189 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213974 s, 49.0 MB/s 2023-08-17T00:13:49.221 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.222 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.222 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0278887 s, 37.6 MB/s 2023-08-17T00:13:49.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.249 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.249 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.023418 s, 44.8 MB/s 2023-08-17T00:13:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.271 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0191118 s, 54.9 MB/s 2023-08-17T00:13:49.299 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.300 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253386 s, 41.4 MB/s 2023-08-17T00:13:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.333 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0287249 s, 36.5 MB/s 2023-08-17T00:13:49.366 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.366 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.367 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280323 s, 37.4 MB/s 2023-08-17T00:13:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.392 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231434 s, 45.3 MB/s 2023-08-17T00:13:49.420 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.421 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.421 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241335 s, 43.4 MB/s 2023-08-17T00:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.448 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.449 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232418 s, 45.1 MB/s 2023-08-17T00:13:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.475 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231479 s, 45.3 MB/s 2023-08-17T00:13:49.502 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.503 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.503 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225915 s, 46.4 MB/s 2023-08-17T00:13:49.535 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.536 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.536 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294084 s, 35.7 MB/s 2023-08-17T00:13:49.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.569 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.569 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0294434 s, 35.6 MB/s 2023-08-17T00:13:49.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.594 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.594 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211195 s, 49.6 MB/s 2023-08-17T00:13:49.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.618 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.619 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208506 s, 50.3 MB/s 2023-08-17T00:13:49.646 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.647 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236254 s, 44.4 MB/s 2023-08-17T00:13:49.678 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.679 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0270949 s, 38.7 MB/s 2023-08-17T00:13:49.706 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.707 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.707 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247505 s, 42.4 MB/s 2023-08-17T00:13:49.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.738 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.738 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.027714 s, 37.8 MB/s 2023-08-17T00:13:49.764 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.765 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.765 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02291 s, 45.8 MB/s 2023-08-17T00:13:49.791 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.792 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218013 s, 48.1 MB/s 2023-08-17T00:13:49.821 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.822 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.822 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275573 s, 38.1 MB/s 2023-08-17T00:13:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.850 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239521 s, 43.8 MB/s 2023-08-17T00:13:49.873 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.874 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0201264 s, 52.1 MB/s 2023-08-17T00:13:49.902 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.902 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.903 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024858 s, 42.2 MB/s 2023-08-17T00:13:49.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.928 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.929 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219527 s, 47.8 MB/s 2023-08-17T00:13:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.949 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0161658 s, 64.9 MB/s 2023-08-17T00:13:49.977 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:49.978 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236966 s, 44.3 MB/s 2023-08-17T00:13:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.011 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0296835 s, 35.3 MB/s 2023-08-17T00:13:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.040 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.041 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249076 s, 42.1 MB/s 2023-08-17T00:13:50.070 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.071 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.071 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258165 s, 40.6 MB/s 2023-08-17T00:13:50.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:50.073 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:50.073 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:50.074 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.28 2023-08-17T00:13:50.074 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:50.074 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:50.075 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:50.075 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:50.130 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.131 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218328 s, 48.0 MB/s 2023-08-17T00:13:50.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.158 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.158 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233356 s, 44.9 MB/s 2023-08-17T00:13:50.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.184 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.184 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218235 s, 48.0 MB/s 2023-08-17T00:13:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.212 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243093 s, 43.1 MB/s 2023-08-17T00:13:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.238 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222085 s, 47.2 MB/s 2023-08-17T00:13:50.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.268 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.268 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260853 s, 40.2 MB/s 2023-08-17T00:13:50.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.291 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.292 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190626 s, 55.0 MB/s 2023-08-17T00:13:50.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0236294 s, 44.4 MB/s 2023-08-17T00:13:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.353 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302566 s, 34.7 MB/s 2023-08-17T00:13:50.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.381 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238689 s, 43.9 MB/s 2023-08-17T00:13:50.411 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.412 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.412 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0272355 s, 38.5 MB/s 2023-08-17T00:13:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229291 s, 45.7 MB/s 2023-08-17T00:13:50.467 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.468 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258474 s, 40.6 MB/s 2023-08-17T00:13:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0204044 s, 51.4 MB/s 2023-08-17T00:13:50.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.521 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.521 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249268 s, 42.1 MB/s 2023-08-17T00:13:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.550 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245851 s, 42.7 MB/s 2023-08-17T00:13:50.578 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.579 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.579 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251236 s, 41.7 MB/s 2023-08-17T00:13:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.606 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245142 s, 42.8 MB/s 2023-08-17T00:13:50.629 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.630 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.630 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0193645 s, 54.1 MB/s 2023-08-17T00:13:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.657 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.024482 s, 42.8 MB/s 2023-08-17T00:13:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.685 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239046 s, 43.9 MB/s 2023-08-17T00:13:50.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.709 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.710 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208875 s, 50.2 MB/s 2023-08-17T00:13:50.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.736 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.736 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229678 s, 45.7 MB/s 2023-08-17T00:13:50.762 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219349 s, 47.8 MB/s 2023-08-17T00:13:50.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.784 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.785 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183796 s, 57.1 MB/s 2023-08-17T00:13:50.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.817 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0275978 s, 38.0 MB/s 2023-08-17T00:13:50.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.848 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.848 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0268032 s, 39.1 MB/s 2023-08-17T00:13:50.874 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.874 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.874 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0202503 s, 51.8 MB/s 2023-08-17T00:13:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.910 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.911 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0330118 s, 31.8 MB/s 2023-08-17T00:13:50.935 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.936 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.936 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216359 s, 48.5 MB/s 2023-08-17T00:13:50.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.972 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.031608 s, 33.2 MB/s 2023-08-17T00:13:50.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:50.999 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:50.999 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239398 s, 43.8 MB/s 2023-08-17T00:13:51.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:51.002 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:51.002 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:51.003 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.29 2023-08-17T00:13:51.004 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:51.005 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:51.005 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:51.006 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217978 s, 48.1 MB/s 2023-08-17T00:13:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0277086 s, 37.8 MB/s 2023-08-17T00:13:51.117 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.118 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211457 s, 49.6 MB/s 2023-08-17T00:13:51.146 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.147 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248175 s, 42.3 MB/s 2023-08-17T00:13:51.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.173 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.173 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226226 s, 46.4 MB/s 2023-08-17T00:13:51.204 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.205 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.205 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0267756 s, 39.2 MB/s 2023-08-17T00:13:51.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.233 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.233 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0246063 s, 42.6 MB/s 2023-08-17T00:13:51.260 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.260 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.260 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225813 s, 46.4 MB/s 2023-08-17T00:13:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223347 s, 46.9 MB/s 2023-08-17T00:13:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0291909 s, 35.9 MB/s 2023-08-17T00:13:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224714 s, 46.7 MB/s 2023-08-17T00:13:51.379 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.380 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.380 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0297164 s, 35.3 MB/s 2023-08-17T00:13:51.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.404 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.405 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217919 s, 48.1 MB/s 2023-08-17T00:13:51.444 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.444 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.444 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0355173 s, 29.5 MB/s 2023-08-17T00:13:51.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.473 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.474 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254055 s, 41.3 MB/s 2023-08-17T00:13:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.501 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.502 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230134 s, 45.6 MB/s 2023-08-17T00:13:51.530 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.531 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.531 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0262769 s, 39.9 MB/s 2023-08-17T00:13:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.561 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264337 s, 39.7 MB/s 2023-08-17T00:13:51.582 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.583 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.583 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0180604 s, 58.1 MB/s 2023-08-17T00:13:51.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.619 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.619 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325079 s, 32.3 MB/s 2023-08-17T00:13:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.645 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.646 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0223338 s, 47.0 MB/s 2023-08-17T00:13:51.670 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.671 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207978 s, 50.4 MB/s 2023-08-17T00:13:51.705 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.705 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.705 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0314507 s, 33.3 MB/s 2023-08-17T00:13:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.735 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249947 s, 42.0 MB/s 2023-08-17T00:13:51.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.763 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.763 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0232958 s, 45.0 MB/s 2023-08-17T00:13:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.792 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0254703 s, 41.2 MB/s 2023-08-17T00:13:51.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.817 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.818 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0207796 s, 50.5 MB/s 2023-08-17T00:13:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.844 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.845 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231248 s, 45.3 MB/s 2023-08-17T00:13:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.866 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.867 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0185227 s, 56.6 MB/s 2023-08-17T00:13:51.892 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.893 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.02228 s, 47.1 MB/s 2023-08-17T00:13:51.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.920 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.921 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022562 s, 46.5 MB/s 2023-08-17T00:13:51.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:51.946 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:51.946 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218368 s, 48.0 MB/s 2023-08-17T00:13:51.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:51.949 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:51.950 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:51.950 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.30 2023-08-17T00:13:51.950 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:51.951 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:51.951 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:51.951 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:52.009 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.009 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.009 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230727 s, 45.4 MB/s 2023-08-17T00:13:52.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.034 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.034 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211113 s, 49.7 MB/s 2023-08-17T00:13:52.062 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.063 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241375 s, 43.4 MB/s 2023-08-17T00:13:52.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.093 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.093 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266698 s, 39.3 MB/s 2023-08-17T00:13:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.122 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248359 s, 42.2 MB/s 2023-08-17T00:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.147 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.148 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211154 s, 49.7 MB/s 2023-08-17T00:13:52.176 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.176 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.176 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0243288 s, 43.1 MB/s 2023-08-17T00:13:52.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.206 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0263421 s, 39.8 MB/s 2023-08-17T00:13:52.234 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.234 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.234 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233808 s, 44.8 MB/s 2023-08-17T00:13:52.260 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.260 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.260 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219561 s, 47.8 MB/s 2023-08-17T00:13:52.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.286 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.286 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0229181 s, 45.8 MB/s 2023-08-17T00:13:52.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.313 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.314 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225254 s, 46.6 MB/s 2023-08-17T00:13:52.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.336 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.336 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196596 s, 53.3 MB/s 2023-08-17T00:13:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.365 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0258878 s, 40.5 MB/s 2023-08-17T00:13:52.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.392 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.393 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224288 s, 46.8 MB/s 2023-08-17T00:13:52.417 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.417 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.418 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0211365 s, 49.6 MB/s 2023-08-17T00:13:52.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.446 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.447 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251357 s, 41.7 MB/s 2023-08-17T00:13:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.475 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.476 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0257868 s, 40.7 MB/s 2023-08-17T00:13:52.504 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.505 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.505 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0264913 s, 39.6 MB/s 2023-08-17T00:13:52.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.533 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.534 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0247682 s, 42.3 MB/s 2023-08-17T00:13:52.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.560 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.560 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222347 s, 47.2 MB/s 2023-08-17T00:13:52.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.581 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0159974 s, 65.5 MB/s 2023-08-17T00:13:52.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.609 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.609 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0249364 s, 42.0 MB/s 2023-08-17T00:13:52.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.644 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.644 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0308439 s, 34.0 MB/s 2023-08-17T00:13:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.671 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234497 s, 44.7 MB/s 2023-08-17T00:13:52.703 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.704 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.704 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0282125 s, 37.2 MB/s 2023-08-17T00:13:52.732 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.733 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.733 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0252276 s, 41.6 MB/s 2023-08-17T00:13:52.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.758 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.759 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0217491 s, 48.2 MB/s 2023-08-17T00:13:52.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.788 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.788 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248777 s, 42.1 MB/s 2023-08-17T00:13:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.816 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.817 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238462 s, 44.0 MB/s 2023-08-17T00:13:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.847 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260074 s, 40.3 MB/s 2023-08-17T00:13:52.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.875 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.876 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0248081 s, 42.3 MB/s 2023-08-17T00:13:52.878 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:13:52.879 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-08-17T00:13:52.879 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:13:52.879 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p scrub_control_test_path/dir.31 2023-08-17T00:13:52.880 DEBUG:teuthology.orchestra.run.smithi153:> for ((i = 0; i < 32; i++)); do 2023-08-17T00:13:52.880 DEBUG:teuthology.orchestra.run.smithi153:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-08-17T00:13:52.880 DEBUG:teuthology.orchestra.run.smithi153:> done 2023-08-17T00:13:52.881 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:13:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.945 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0302147 s, 34.7 MB/s 2023-08-17T00:13:52.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.971 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.971 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221366 s, 47.4 MB/s 2023-08-17T00:13:52.996 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:52.996 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:52.997 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0200717 s, 52.2 MB/s 2023-08-17T00:13:53.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.020 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.020 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0212225 s, 49.4 MB/s 2023-08-17T00:13:53.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.047 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.048 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219534 s, 47.8 MB/s 2023-08-17T00:13:53.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.073 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.073 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0221841 s, 47.3 MB/s 2023-08-17T00:13:53.097 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.098 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.098 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0206379 s, 50.8 MB/s 2023-08-17T00:13:53.124 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.125 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.125 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230156 s, 45.6 MB/s 2023-08-17T00:13:53.149 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.150 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226423 s, 46.3 MB/s 2023-08-17T00:13:53.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.177 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.177 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.022814 s, 46.0 MB/s 2023-08-17T00:13:53.206 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.207 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.208 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0251403 s, 41.7 MB/s 2023-08-17T00:13:53.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.245 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.245 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0340624 s, 30.8 MB/s 2023-08-17T00:13:53.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.276 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.276 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266673 s, 39.3 MB/s 2023-08-17T00:13:53.303 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.303 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.304 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0233713 s, 44.9 MB/s 2023-08-17T00:13:53.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.332 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.332 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245016 s, 42.8 MB/s 2023-08-17T00:13:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.359 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0234471 s, 44.7 MB/s 2023-08-17T00:13:53.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.390 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.390 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0271648 s, 38.6 MB/s 2023-08-17T00:13:53.419 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.419 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.419 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0237928 s, 44.1 MB/s 2023-08-17T00:13:53.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.442 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.442 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.020458 s, 51.3 MB/s 2023-08-17T00:13:53.468 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.469 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.469 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0224807 s, 46.6 MB/s 2023-08-17T00:13:53.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.495 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.496 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0238372 s, 44.0 MB/s 2023-08-17T00:13:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.524 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.525 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0256141 s, 40.9 MB/s 2023-08-17T00:13:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.555 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0280108 s, 37.4 MB/s 2023-08-17T00:13:53.580 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.581 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.581 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0215183 s, 48.7 MB/s 2023-08-17T00:13:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.605 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0203616 s, 51.5 MB/s 2023-08-17T00:13:53.633 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.634 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.634 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0239048 s, 43.9 MB/s 2023-08-17T00:13:53.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.660 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.660 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0230849 s, 45.4 MB/s 2023-08-17T00:13:53.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.689 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.689 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245684 s, 42.7 MB/s 2023-08-17T00:13:53.719 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.720 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.721 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0266287 s, 39.4 MB/s 2023-08-17T00:13:53.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.746 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.746 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0222919 s, 47.0 MB/s 2023-08-17T00:13:53.773 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.774 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0240323 s, 43.6 MB/s 2023-08-17T00:13:53.803 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records in 2023-08-17T00:13:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:1+0 records out 2023-08-17T00:13:53.804 INFO:teuthology.orchestra.run.smithi153.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0260566 s, 40.2 MB/s 2023-08-17T00:13:53.806 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2023-08-17T00:13:53.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.959+0000 7ff759edb700 1 Processor -- start 2023-08-17T00:13:53.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.959+0000 7ff759edb700 1 -- start start 2023-08-17T00:13:53.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff759edb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff75414fc70 0x7ff754150050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff759edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7540c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff759edb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff754065780 con 0x7ff754154490 2023-08-17T00:13:53.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff759edb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7540c3e80 con 0x7ff75414fc70 2023-08-17T00:13:53.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff759edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff754065a60 con 0x7ff754066820 2023-08-17T00:13:53.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff75414fc70 0x7ff754150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff75414fc70 0x7ff754150050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:44070/0 (socket says 172.21.15.153:44070) 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 -- 172.21.15.153:0/3918283302 learned_addr learned my addr 172.21.15.153:0/3918283302 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff74affd700 1 --2- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7540c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff753fff700 1 --1- 172.21.15.153:0/3918283302 >> v1:172.21.15.178:6789/0 conn(0x7ff754154490 0x7ff7540c3770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:34370/0 (socket says 172.21.15.153:34370) 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 -- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 msgr2=0x7ff7540c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 --2- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7540c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 -- 172.21.15.153:0/3918283302 >> v1:172.21.15.178:6789/0 conn(0x7ff754154490 legacy=0x7ff7540c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:53.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.963+0000 7ff7537fe700 1 -- 172.21.15.153:0/3918283302 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff754065d40 con 0x7ff75414fc70 2023-08-17T00:13:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff7537fe700 1 --2- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff754150050 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff744006fd0 tx=0x7ff74400b3b0).ready entity=mon.1 client_cookie=1744f43f02eb30bb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff752ffd700 1 -- 172.21.15.153:0/3918283302 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400da70 con 0x7ff75414fc70 2023-08-17T00:13:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff752ffd700 1 -- 172.21.15.153:0/3918283302 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74400dbd0 con 0x7ff75414fc70 2023-08-17T00:13:53.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff752ffd700 1 -- 172.21.15.153:0/3918283302 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744010470 con 0x7ff75414fc70 2023-08-17T00:13:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 -- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 msgr2=0x7ff754150050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 --2- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff754150050 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff744006fd0 tx=0x7ff74400b3b0).stop 2023-08-17T00:13:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 -- 172.21.15.153:0/3918283302 shutdown_connections 2023-08-17T00:13:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 --2- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7540c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 --2- 172.21.15.153:0/3918283302 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff754150050 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 -- 172.21.15.153:0/3918283302 >> 172.21.15.153:0/3918283302 conn(0x7ff7540c7090 msgr2=0x7ff7540c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 -- 172.21.15.153:0/3918283302 shutdown_connections 2023-08-17T00:13:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.967+0000 7ff759edb700 1 -- 172.21.15.153:0/3918283302 wait complete. 2023-08-17T00:13:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 Processor -- start 2023-08-17T00:13:53.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 -- start start 2023-08-17T00:13:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7541505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff7540bf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 0x7ff7540a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a96f0 con 0x7ff754154490 2023-08-17T00:13:53.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a9910 con 0x7ff75414fc70 2023-08-17T00:13:53.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff759edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7540a9bf0 con 0x7ff754066820 2023-08-17T00:13:53.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff753fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 0x7ff7540a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff753fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 0x7ff7540a8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40256/0 (socket says 172.21.15.153:40256) 2023-08-17T00:13:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff753fff700 1 -- 172.21.15.153:0/1175683169 learned_addr learned my addr 172.21.15.153:0/1175683169 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7541505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.971+0000 7ff74affd700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff7540bf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff753fff700 1 -- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 msgr2=0x7ff7541505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff753fff700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7541505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff753fff700 1 -- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 msgr2=0x7ff7540bf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff753fff700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff7540bf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff753fff700 1 -- 172.21.15.153:0/1175683169 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff74400b610 con 0x7ff754154490 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff753fff700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 0x7ff7540a8450 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7ff74c00c790 tx=0x7ff74c0015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff74bfff700 1 -- 172.21.15.153:0/1175683169 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c005c70 con 0x7ff754154490 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff74bfff700 1 -- 172.21.15.153:0/1175683169 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff74c005dd0 con 0x7ff754154490 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7540a9ed0 con 0x7ff754154490 2023-08-17T00:13:53.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff74bfff700 1 -- 172.21.15.153:0/1175683169 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74c007320 con 0x7ff754154490 2023-08-17T00:13:53.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.975+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7540bf510 con 0x7ff754154490 2023-08-17T00:13:53.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff74bfff700 1 -- 172.21.15.153:0/1175683169 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff74c010030 con 0x7ff754154490 2023-08-17T00:13:53.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff74bfff700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff73405a150 0x7ff73405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff74bfff700 1 -- 172.21.15.153:0/1175683169 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7ff74c073fe0 con 0x7ff754154490 2023-08-17T00:13:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff764247740 1 Processor -- start 2023-08-17T00:13:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff73405a150 0x7ff73405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff764247740 1 -- start start 2023-08-17T00:13:53.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.979+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff73405a150 0x7ff73405c610 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7ff74400b4a0 tx=0x7ff74400b3b0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12b8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x12702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12707e0 0x1270c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f7cc0 con 0x12b8190 2023-08-17T00:13:53.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1271920 con 0x12707e0 2023-08-17T00:13:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12b4260 con 0x12b8a60 2023-08-17T00:13:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12b8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12b8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40260/0 (socket says 172.21.15.153:40260) 2023-08-17T00:13:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 -- 172.21.15.153:0/1706304822 learned_addr learned my addr 172.21.15.153:0/1706304822 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff753fff700 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12707e0 0x1270c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff74affd700 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x12702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 -- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 msgr2=0x12702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x12702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 -- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12707e0 msgr2=0x1270c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12707e0 0x1270c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 -- 172.21.15.153:0/1706304822 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11f0c00 con 0x12b8190 2023-08-17T00:13:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12b8570 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7ff74400d5d0 tx=0x7ff744020000).ready entity=mon.0 client_cookie=bcf89eb2d91647c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff748ff9700 1 -- 172.21.15.153:0/1706304822 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744020070 con 0x12b8190 2023-08-17T00:13:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff748ff9700 1 -- 172.21.15.153:0/1706304822 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744010cc0 con 0x12b8190 2023-08-17T00:13:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff748ff9700 1 -- 172.21.15.153:0/1706304822 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744019660 con 0x12b8190 2023-08-17T00:13:53.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- 172.21.15.153:0/1706304822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 msgr2=0x12b8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12b8570 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 rx=0x7ff74400d5d0 tx=0x7ff744020000).stop 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- 172.21.15.153:0/1706304822 shutdown_connections 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12707e0 0x1270c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x12702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 --2- 172.21.15.153:0/1706304822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12b8570 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- 172.21.15.153:0/1706304822 >> 172.21.15.153:0/1706304822 conn(0x1056920 msgr2=0x12773f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- 172.21.15.153:0/1706304822 shutdown_connections 2023-08-17T00:13:53.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.983+0000 7ff764247740 1 -- 172.21.15.153:0/1706304822 wait complete. 2023-08-17T00:13:54.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 -- start start 2023-08-17T00:13:54.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 Processor -- start 2023-08-17T00:13:54.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12707e0 0x1299eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x12a3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12bd090 con 0x12b8190 2023-08-17T00:13:54.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x12a01b0 con 0x12b8a60 2023-08-17T00:13:54.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x129db80 con 0x12707e0 2023-08-17T00:13:54.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 10 client.0 ll_register_callbacks cb 0x11edcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:54.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12a2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40264/0 (socket says 172.21.15.153:40264) 2023-08-17T00:13:54.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 -- 172.21.15.153:0/979615454 learned_addr learned my addr 172.21.15.153:0/979615454 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff753fff700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x12a3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff7537fe700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12707e0 0x1299eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 -- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12707e0 msgr2=0x1299eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12707e0 0x1299eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 -- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 msgr2=0x12a3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x12a3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 -- 172.21.15.153:0/979615454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff754065d40 con 0x12b8190 2023-08-17T00:13:54.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff74affd700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12a2f30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7ff73c0149b0 tx=0x7ff73c009060).ready entity=mon.0 client_cookie=6e218bd300411d34 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff731ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff731ffb700 1 -- 172.21.15.153:0/979615454 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c009e60 con 0x12b8190 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11ed8e0 con 0x12b8190 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.987+0000 7ff731ffb700 1 -- 172.21.15.153:0/979615454 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7ff73c015630 con 0x12b8190 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff731ffb700 1 -- 172.21.15.153:0/979615454 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff73c015a00 con 0x12b8190 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 10 client.8673 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:54.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x11ec0a0 con 0x12b8190 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff731ffb700 1 -- 172.21.15.153:0/979615454 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11ed8e0 con 0x12b8190 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff731ffb700 1 -- 172.21.15.153:0/979615454 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff73c015b60 con 0x12b8190 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 10 client.8673 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 10 client.8673 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.b 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 20 client.8673 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12ba6d0 0x12baab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 4 client.8673 mds_command: new command op to 8463 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11e3e30 con 0x12ba6d0 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff7537fe700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12ba6d0 0x12baab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff7537fe700 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12ba6d0 0x12baab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7f0e565290533791 server_cookie=102f3fca5b4d624a in_seq=0 out_seq=0 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff731ffb700 10 client.8673 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff731ffb700 1 -- 172.21.15.153:0/979615454 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x11e3e30 con 0x12ba6d0 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff731ffb700 10 client.8673 handle_command_reply: tid=0 2023-08-17T00:13:54.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 1 client.8673 shutdown 2023-08-17T00:13:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 msgr2=0x12a2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.991+0000 7ff764247740 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12a2f30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7ff73c0149b0 tx=0x7ff73c009060).stop 2023-08-17T00:13:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 shutdown_connections 2023-08-17T00:13:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12ba6d0 0x12baab0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x12a3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x12a2f30 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff731ffb700 0 client.8673 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 --2- 172.21.15.153:0/979615454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12707e0 0x1299eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 >> 172.21.15.153:0/979615454 conn(0x1056920 msgr2=0x1277260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 shutdown_connections 2023-08-17T00:13:54.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 1 -- 172.21.15.153:0/979615454 wait complete. 2023-08-17T00:13:54.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:53.995+0000 7ff764247740 20 client.8673 trim_cache size 0 max 16384 2023-08-17T00:13:54.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 Processor -- start 2023-08-17T00:13:54.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 -- start start 2023-08-17T00:13:54.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 0x1277670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8190 0x126cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x129a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x129acb0 con 0x12707e0 2023-08-17T00:13:54.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x12bb2c0 con 0x12b8a60 2023-08-17T00:13:54.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11cca80 con 0x12b8190 2023-08-17T00:13:54.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff7537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 0x1277670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff753fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x129a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff74affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8190 0x126cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff753fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x129a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:44104/0 (socket says 172.21.15.153:44104) 2023-08-17T00:13:54.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff753fff700 1 -- 172.21.15.153:0/886019469 learned_addr learned my addr 172.21.15.153:0/886019469 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.011+0000 7ff7537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 0x1277670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40268/0 (socket says 172.21.15.153:40268) 2023-08-17T00:13:54.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7537fe700 1 -- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8190 msgr2=0x126cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7537fe700 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8190 0x126cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7537fe700 1 -- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 msgr2=0x129a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7537fe700 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x129a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7537fe700 1 -- 172.21.15.153:0/886019469 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11ebdf0 con 0x12707e0 2023-08-17T00:13:54.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff753fff700 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x129a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:54.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7537fe700 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 0x1277670 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7ff754153a40 tx=0x7ff744037280).ready entity=mon.0 client_cookie=348b32846b1720ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7497fa700 1 -- 172.21.15.153:0/886019469 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744020040 con 0x12707e0 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7497fa700 1 -- 172.21.15.153:0/886019469 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744010590 con 0x12707e0 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff7497fa700 1 -- 172.21.15.153:0/886019469 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744019450 con 0x12707e0 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 -- 172.21.15.153:0/886019469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 msgr2=0x1277670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 0x1277670 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 rx=0x7ff754153a40 tx=0x7ff744037280).stop 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 -- 172.21.15.153:0/886019469 shutdown_connections 2023-08-17T00:13:54.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12b8a60 0x129a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8190 0x126cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 --2- 172.21.15.153:0/886019469 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12707e0 0x1277670 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 -- 172.21.15.153:0/886019469 >> 172.21.15.153:0/886019469 conn(0x1056920 msgr2=0x12a3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 -- 172.21.15.153:0/886019469 shutdown_connections 2023-08-17T00:13:54.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 -- 172.21.15.153:0/886019469 wait complete. 2023-08-17T00:13:54.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 -- start start 2023-08-17T00:13:54.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.015+0000 7ff764247740 1 Processor -- start 2023-08-17T00:13:54.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x129bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x129c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12bd950 0x12b6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x129c6e0 con 0x12b8190 2023-08-17T00:13:54.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x129b560 con 0x12bd950 2023-08-17T00:13:54.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1329c70 con 0x12b8a60 2023-08-17T00:13:54.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff764247740 10 client.0 ll_register_callbacks cb 0x7ff73c009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x129bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x129bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40272/0 (socket says 172.21.15.153:40272) 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 -- 172.21.15.153:0/1120874942 learned_addr learned my addr 172.21.15.153:0/1120874942 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff753fff700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12bd950 0x12b6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff74affd700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x129c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 -- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 msgr2=0x129c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x129c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 -- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12bd950 msgr2=0x12b6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12bd950 0x12b6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 -- 172.21.15.153:0/1120874942 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7540bf510 con 0x12b8190 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff7537fe700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x129bd00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7ff744025000 tx=0x7ff744032040).ready entity=mon.0 client_cookie=ea676aa7ad7c4d7e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff731ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.019+0000 7ff731ffb700 1 -- 172.21.15.153:0/1120874942 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744020040 con 0x12b8190 2023-08-17T00:13:54.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff744010cc0 con 0x12b8190 2023-08-17T00:13:54.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff731ffb700 1 -- 172.21.15.153:0/1120874942 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7ff744019450 con 0x12b8190 2023-08-17T00:13:54.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff731ffb700 1 -- 172.21.15.153:0/1120874942 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff744019610 con 0x12b8190 2023-08-17T00:13:54.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 10 client.8679 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:54.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x11f0c00 con 0x12b8190 2023-08-17T00:13:54.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff731ffb700 1 -- 172.21.15.153:0/1120874942 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744010cc0 con 0x12b8190 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff731ffb700 1 -- 172.21.15.153:0/1120874942 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff744043470 con 0x12b8190 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 10 client.8679 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 10 client.8679 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.b 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 20 client.8679 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12b6c70 0x12b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 4 client.8679 mds_command: new command op to 8463 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-08-17T00:13:54.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x10ad8b0 con 0x12b6c70 2023-08-17T00:13:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff74affd700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12b6c70 0x12b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff731ffb700 10 client.8679 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.023+0000 7ff74affd700 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12b6c70 0x12b7080 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7aec11aa5549211e server_cookie=5efa582a8f7ce574 in_seq=0 out_seq=0 2023-08-17T00:13:54.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.027+0000 7ff731ffb700 1 -- 172.21.15.153:0/1120874942 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x10ad8b0 con 0x12b6c70 2023-08-17T00:13:54.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.027+0000 7ff731ffb700 10 client.8679 handle_command_reply: tid=0 2023-08-17T00:13:54.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.027+0000 7ff764247740 1 client.8679 shutdown 2023-08-17T00:13:54.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 msgr2=0x129bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x129bd00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7ff744025000 tx=0x7ff744032040).stop 2023-08-17T00:13:54.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 shutdown_connections 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x12b6c70 0x12b7080 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12bd950 0x12b6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12b8a60 0x129c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 --2- 172.21.15.153:0/1120874942 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12b8190 0x129bd00 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff731ffb700 0 client.8679 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 >> 172.21.15.153:0/1120874942 conn(0x1056920 msgr2=0x12a1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 shutdown_connections 2023-08-17T00:13:54.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 1 -- 172.21.15.153:0/1120874942 wait complete. 2023-08-17T00:13:54.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff764247740 20 client.8679 trim_cache size 0 max 16384 2023-08-17T00:13:54.039 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:13:54.040 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:13:54.040 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "7770ae7b-3c0c-4857-8a7d-36818dfc71df", 2023-08-17T00:13:54.040 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:13:54.040 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:13:54.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff73405a150 msgr2=0x7ff73405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff73405a150 0x7ff73405c610 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7ff74400b4a0 tx=0x7ff74400b3b0).stop 2023-08-17T00:13:54.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 msgr2=0x7ff7540a8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 0x7ff7540a8450 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7ff74c00c790 tx=0x7ff74c0015e0).stop 2023-08-17T00:13:54.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 shutdown_connections 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff73405a150 0x7ff73405c610 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff754154490 0x7ff7540a8450 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff75414fc70 0x7ff7540bf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 --2- 172.21.15.153:0/1175683169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff754066820 0x7ff7541505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 >> 172.21.15.153:0/1175683169 conn(0x7ff7540c7090 msgr2=0x7ff7540c1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 shutdown_connections 2023-08-17T00:13:54.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.031+0000 7ff759edb700 1 -- 172.21.15.153:0/1175683169 wait complete. 2023-08-17T00:13:54.061 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub pause 2023-08-17T00:13:54.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.227+0000 7f231421b700 1 Processor -- start 2023-08-17T00:13:54.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.227+0000 7f231421b700 1 -- start start 2023-08-17T00:13:54.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.227+0000 7f231421b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 0x7f230c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.227+0000 7f231421b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f230c0a8f50 0x7f230c0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f231421b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f230c065240 con 0x7f230c0656d0 2023-08-17T00:13:54.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f231421b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f230c062ea0 con 0x7f230c0a8f50 2023-08-17T00:13:54.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f231421b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0638a0 con 0x7f230c0a8b70 2023-08-17T00:13:54.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 0x7f230c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 0x7f230c0632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:49586/0 (socket says 172.21.15.153:49586) 2023-08-17T00:13:54.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 -- 172.21.15.153:0/3996885722 learned_addr learned my addr 172.21.15.153:0/3996885722 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f23117b6700 1 --2- 172.21.15.153:0/3996885722 >> v2:172.21.15.178:3300/0 conn(0x7f230c0a8f50 0x7f230c0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2310fb5700 1 -- 172.21.15.153:0/3996885722 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848457075 0 0) 0x7f230c065240 con 0x7f230c0656d0 2023-08-17T00:13:54.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 -- 172.21.15.153:0/3996885722 >> v2:172.21.15.178:3300/0 conn(0x7f230c0a8f50 msgr2=0x7f230c0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 --2- 172.21.15.153:0/3996885722 >> v2:172.21.15.178:3300/0 conn(0x7f230c0a8f50 0x7f230c0629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 -- 172.21.15.153:0/3996885722 >> v1:172.21.15.178:6789/0 conn(0x7f230c0656d0 legacy=0x7f230c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 -- 172.21.15.153:0/3996885722 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230c064910 con 0x7f230c0a8b70 2023-08-17T00:13:54.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2311fb7700 1 --2- 172.21.15.153:0/3996885722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 0x7f230c0632e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f2308006fd0 tx=0x7f23080090f0).ready entity=mon.2 client_cookie=b25c0b94288ad8ec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2310fb5700 1 -- 172.21.15.153:0/3996885722 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800b580 con 0x7f230c0a8b70 2023-08-17T00:13:54.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2310fb5700 1 -- 172.21.15.153:0/3996885722 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b6e0 con 0x7f230c0a8b70 2023-08-17T00:13:54.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.231+0000 7f2310fb5700 1 -- 172.21.15.153:0/3996885722 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800ba60 con 0x7f230c0a8b70 2023-08-17T00:13:54.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- 172.21.15.153:0/3996885722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 msgr2=0x7f230c0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 --2- 172.21.15.153:0/3996885722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 0x7f230c0632e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f2308006fd0 tx=0x7f23080090f0).stop 2023-08-17T00:13:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- 172.21.15.153:0/3996885722 shutdown_connections 2023-08-17T00:13:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 --2- 172.21.15.153:0/3996885722 >> v2:172.21.15.178:3300/0 conn(0x7f230c0a8f50 0x7f230c0629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 --2- 172.21.15.153:0/3996885722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8b70 0x7f230c0632e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- 172.21.15.153:0/3996885722 >> 172.21.15.153:0/3996885722 conn(0x7f230c0c7150 msgr2=0x7f230c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- 172.21.15.153:0/3996885722 shutdown_connections 2023-08-17T00:13:54.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- 172.21.15.153:0/3996885722 wait complete. 2023-08-17T00:13:54.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 Processor -- start 2023-08-17T00:13:54.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- start start 2023-08-17T00:13:54.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 0x7f230c0be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f230c0a8b70 0x7f230c16bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8f50 0x7f230c0becc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c0be5e0 con 0x7f230c0656d0 2023-08-17T00:13:54.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f230c1686f0 con 0x7f230c0a8b70 2023-08-17T00:13:54.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.235+0000 7f231421b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230c16c1b0 con 0x7f230c0a8f50 2023-08-17T00:13:54.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 0x7f230c0be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 0x7f230c0be0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40286/0 (socket says 172.21.15.153:40286) 2023-08-17T00:13:54.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 -- 172.21.15.153:0/938191512 learned_addr learned my addr 172.21.15.153:0/938191512 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f23117b6700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f230c0a8b70 0x7f230c16bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f23127b8700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8f50 0x7f230c0becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 -- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8f50 msgr2=0x7f230c0becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8f50 0x7f230c0becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 -- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f230c0a8b70 msgr2=0x7f230c16bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f230c0a8b70 0x7f230c16bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 -- 172.21.15.153:0/938191512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2308009370 con 0x7f230c0656d0 2023-08-17T00:13:54.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2311fb7700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 0x7f230c0be0f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f2308009fd0 tx=0x7f2308017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2301ffb700 1 -- 172.21.15.153:0/938191512 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800b850 con 0x7f230c0656d0 2023-08-17T00:13:54.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2301ffb700 1 -- 172.21.15.153:0/938191512 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800b9b0 con 0x7f230c0656d0 2023-08-17T00:13:54.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f230c16cc60 con 0x7f230c0656d0 2023-08-17T00:13:54.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f2301ffb700 1 -- 172.21.15.153:0/938191512 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230801c670 con 0x7f230c0656d0 2023-08-17T00:13:54.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.239+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c16c6a0 con 0x7f230c0656d0 2023-08-17T00:13:54.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.243+0000 7f2301ffb700 1 -- 172.21.15.153:0/938191512 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f230802c070 con 0x7f230c0656d0 2023-08-17T00:13:54.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.243+0000 7f2301ffb700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22f005a150 0x7f22f005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.243+0000 7f2301ffb700 1 -- 172.21.15.153:0/938191512 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f2308075c30 con 0x7f230c0656d0 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.243+0000 7f23117b6700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22f005a150 0x7f22f005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.243+0000 7f23117b6700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22f005a150 0x7f22f005c610 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f230c0c48d0 tx=0x7f22fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.243+0000 7f231e59d740 1 Processor -- start 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- start start 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22257b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2243470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x21fc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x214c160 con 0x2241130 2023-08-17T00:13:54.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x216cff0 con 0x2240d50 2023-08-17T00:13:54.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21ffc90 con 0x21fc2c0 2023-08-17T00:13:54.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2243470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2243470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40298/0 (socket says 172.21.15.153:40298) 2023-08-17T00:13:54.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 -- 172.21.15.153:0/3830226122 learned_addr learned my addr 172.21.15.153:0/3830226122 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23127b8700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x21fc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f2311fb7700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22257b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 -- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 msgr2=0x21fc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x21fc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 -- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 msgr2=0x22257b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22257b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 -- 172.21.15.153:0/3830226122 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2179fd0 con 0x2241130 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23127b8700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x21fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:54.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f2311fb7700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22257b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f23117b6700 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2243470 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f22fc011a90 tx=0x7f22fc016000).ready entity=mon.0 client_cookie=2583d0fa4c0b000b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f22f6ffd700 1 -- 172.21.15.153:0/3830226122 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc015910 con 0x2241130 2023-08-17T00:13:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f22f6ffd700 1 -- 172.21.15.153:0/3830226122 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc015a70 con 0x2241130 2023-08-17T00:13:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f22f6ffd700 1 -- 172.21.15.153:0/3830226122 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc015e30 con 0x2241130 2023-08-17T00:13:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- 172.21.15.153:0/3830226122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 msgr2=0x2243470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2243470 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f22fc011a90 tx=0x7f22fc016000).stop 2023-08-17T00:13:54.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- 172.21.15.153:0/3830226122 shutdown_connections 2023-08-17T00:13:54.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x21fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2243470 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 --2- 172.21.15.153:0/3830226122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22257b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- 172.21.15.153:0/3830226122 >> 172.21.15.153:0/3830226122 conn(0x1fdf640 msgr2=0x21fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- 172.21.15.153:0/3830226122 shutdown_connections 2023-08-17T00:13:54.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.247+0000 7f231e59d740 1 -- 172.21.15.153:0/3830226122 wait complete. 2023-08-17T00:13:54.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 -- start start 2023-08-17T00:13:54.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 Processor -- start 2023-08-17T00:13:54.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x22249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2224ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2241130 0x22465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22296f0 con 0x2240d50 2023-08-17T00:13:54.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22299d0 con 0x2241130 2023-08-17T00:13:54.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x222a1d0 con 0x21fc2c0 2023-08-17T00:13:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 10 client.0 ll_register_callbacks cb 0x21b7440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2224ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2224ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40306/0 (socket says 172.21.15.153:40306) 2023-08-17T00:13:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 -- 172.21.15.153:0/1416400368 learned_addr learned my addr 172.21.15.153:0/1416400368 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f2311fb7700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x22249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23127b8700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2241130 0x22465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 -- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 msgr2=0x22249d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x22249d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 -- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2241130 msgr2=0x22465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2241130 0x22465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 -- 172.21.15.153:0/1416400368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc011750 con 0x2240d50 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f23117b6700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2224ec0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f22fc023040 tx=0x7f22fc020000).ready entity=mon.0 client_cookie=3109da1ab77550c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f22ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:54.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f22ebfff700 1 -- 172.21.15.153:0/1416400368 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc015910 con 0x2240d50 2023-08-17T00:13:54.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f22ebfff700 1 -- 172.21.15.153:0/1416400368 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f22fc020e30 con 0x2240d50 2023-08-17T00:13:54.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.251+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2176cb0 con 0x2240d50 2023-08-17T00:13:54.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f22ebfff700 1 -- 172.21.15.153:0/1416400368 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22fc029600 con 0x2240d50 2023-08-17T00:13:54.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 10 client.8688 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:54.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x2175470 con 0x2240d50 2023-08-17T00:13:54.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f22ebfff700 1 -- 172.21.15.153:0/1416400368 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2176cb0 con 0x2240d50 2023-08-17T00:13:54.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f22ebfff700 1 -- 172.21.15.153:0/1416400368 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f22fc02f060 con 0x2240d50 2023-08-17T00:13:54.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 10 client.8688 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:54.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 10 client.8688 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.b 2023-08-17T00:13:54.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 20 client.8688 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:54.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223e5f0 0x223ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 4 client.8688 mds_command: new command op to 8463 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:13:54.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x216d200 con 0x223e5f0 2023-08-17T00:13:54.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f2311fb7700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223e5f0 0x223ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f2311fb7700 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223e5f0 0x223ea00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=46662e73234f950d server_cookie=fb6f0d0f81cc8906 in_seq=0 out_seq=0 2023-08-17T00:13:54.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f22ebfff700 10 client.8688 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f22ebfff700 1 -- 172.21.15.153:0/1416400368 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x216d200 con 0x223e5f0 2023-08-17T00:13:54.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f22ebfff700 10 client.8688 handle_command_reply: tid=0 2023-08-17T00:13:54.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.255+0000 7f231e59d740 1 client.8688 shutdown 2023-08-17T00:13:54.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 msgr2=0x2224ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2224ec0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f22fc023040 tx=0x7f22fc020000).stop 2023-08-17T00:13:54.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 shutdown_connections 2023-08-17T00:13:54.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223e5f0 0x223ea00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2241130 0x22465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f22ebfff700 0 client.8688 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2224ec0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 --2- 172.21.15.153:0/1416400368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x22249d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 >> 172.21.15.153:0/1416400368 conn(0x1fdf640 msgr2=0x22459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 shutdown_connections 2023-08-17T00:13:54.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 1 -- 172.21.15.153:0/1416400368 wait complete. 2023-08-17T00:13:54.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.259+0000 7f231e59d740 20 client.8688 trim_cache size 0 max 16384 2023-08-17T00:13:54.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.275+0000 7f231e59d740 1 Processor -- start 2023-08-17T00:13:54.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.275+0000 7f231e59d740 1 -- start start 2023-08-17T00:13:54.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x2200280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22440a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2244590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x21a8940 con 0x2241130 2023-08-17T00:13:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22463c0 con 0x2240d50 2023-08-17T00:13:54.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2176cb0 con 0x21fc2c0 2023-08-17T00:13:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2244590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f2311fb7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x2200280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2244590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40322/0 (socket says 172.21.15.153:40322) 2023-08-17T00:13:54.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 -- 172.21.15.153:0/3954224186 learned_addr learned my addr 172.21.15.153:0/3954224186 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23117b6700 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 -- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 msgr2=0x2200280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x2200280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 -- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 msgr2=0x22440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 -- 172.21.15.153:0/3954224186 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2246900 con 0x2241130 2023-08-17T00:13:54.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f2311fb7700 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x2200280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:54.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f23127b8700 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2244590 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f2304001cf0 tx=0x7f2304003040).ready entity=mon.0 client_cookie=f484ac76129e090f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f22f77fe700 1 -- 172.21.15.153:0/3954224186 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304011a80 con 0x2241130 2023-08-17T00:13:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f22f77fe700 1 -- 172.21.15.153:0/3954224186 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2304011be0 con 0x2241130 2023-08-17T00:13:54.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f22f77fe700 1 -- 172.21.15.153:0/3954224186 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304015430 con 0x2241130 2023-08-17T00:13:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 -- 172.21.15.153:0/3954224186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 msgr2=0x2244590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2244590 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f2304001cf0 tx=0x7f2304003040).stop 2023-08-17T00:13:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 -- 172.21.15.153:0/3954224186 shutdown_connections 2023-08-17T00:13:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2241130 0x2244590 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2240d50 0x22440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 --2- 172.21.15.153:0/3954224186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x21fc2c0 0x2200280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.279+0000 7f231e59d740 1 -- 172.21.15.153:0/3954224186 >> 172.21.15.153:0/3954224186 conn(0x1fdf640 msgr2=0x22459c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.283+0000 7f231e59d740 1 -- 172.21.15.153:0/3954224186 shutdown_connections 2023-08-17T00:13:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.283+0000 7f231e59d740 1 -- 172.21.15.153:0/3954224186 wait complete. 2023-08-17T00:13:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.283+0000 7f231e59d740 1 -- start start 2023-08-17T00:13:54.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.283+0000 7f231e59d740 1 Processor -- start 2023-08-17T00:13:54.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21fc2c0 0x22a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2242c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2241130 0x22430f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22454f0 con 0x2240d50 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22ac4e0 con 0x21fc2c0 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2228c40 con 0x2241130 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 10 client.0 ll_register_callbacks cb 0x7f22fc023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2242c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2242c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40328/0 (socket says 172.21.15.153:40328) 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 -- 172.21.15.153:0/2204733698 learned_addr learned my addr 172.21.15.153:0/2204733698 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f2311fb7700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21fc2c0 0x22a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23127b8700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2241130 0x22430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 -- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2241130 msgr2=0x22430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2241130 0x22430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 -- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21fc2c0 msgr2=0x22a81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21fc2c0 0x22a81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 -- 172.21.15.153:0/2204733698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f230c16c6a0 con 0x2240d50 2023-08-17T00:13:54.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23127b8700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2241130 0x22430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:13:54.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f2311fb7700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21fc2c0 0x22a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:54.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f23117b6700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2242c00 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f22fc015760 tx=0x7f22fc028000).ready entity=mon.0 client_cookie=4c0541f7aa480c9e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f22ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:54.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f22ebfff700 1 -- 172.21.15.153:0/2204733698 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22fc020aa0 con 0x2240d50 2023-08-17T00:13:54.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f22ebfff700 1 -- 172.21.15.153:0/2204733698 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f22fc005a90 con 0x2240d50 2023-08-17T00:13:54.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22fc015a70 con 0x2240d50 2023-08-17T00:13:54.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f22ebfff700 1 -- 172.21.15.153:0/2204733698 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22fc029600 con 0x2240d50 2023-08-17T00:13:54.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 10 client.8694 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:54.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x7f2304001a20 con 0x2240d50 2023-08-17T00:13:54.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f22ebfff700 1 -- 172.21.15.153:0/2204733698 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22fc015a70 con 0x2240d50 2023-08-17T00:13:54.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f22ebfff700 1 -- 172.21.15.153:0/2204733698 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f22fc029820 con 0x2240d50 2023-08-17T00:13:54.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 10 client.8694 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:54.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 10 client.8694 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.b 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 20 client.8694 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223f4e0 0x22a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 4 client.8694 mds_command: new command op to 8463 tid=0[{"prefix": "scrub pause"}] 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x20365d0 con 0x223f4e0 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.287+0000 7f2311fb7700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223f4e0 0x22a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f22ebfff700 10 client.8694 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f2311fb7700 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223f4e0 0x22a8d70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=f58c0ca8a4f9b036 server_cookie=ebb84f91f4027a21 in_seq=0 out_seq=0 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f22ebfff700 1 -- 172.21.15.153:0/2204733698 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x20365d0 con 0x223f4e0 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f22ebfff700 10 client.8694 handle_command_reply: tid=0 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 client.8694 shutdown 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 msgr2=0x2242c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2242c00 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f22fc015760 tx=0x7f22fc028000).stop 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 shutdown_connections 2023-08-17T00:13:54.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x223f4e0 0x22a8d70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2241130 0x22430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f22ebfff700 0 client.8694 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2240d50 0x2242c00 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 --2- 172.21.15.153:0/2204733698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x21fc2c0 0x22a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 >> 172.21.15.153:0/2204733698 conn(0x1fdf640 msgr2=0x22459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 shutdown_connections 2023-08-17T00:13:54.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 1 -- 172.21.15.153:0/2204733698 wait complete. 2023-08-17T00:13:54.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231e59d740 20 client.8694 trim_cache size 0 max 16384 2023-08-17T00:13:54.304 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:13:54.304 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0 2023-08-17T00:13:54.304 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:13:54.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22f005a150 msgr2=0x7f22f005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22f005a150 0x7f22f005c610 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7f230c0c48d0 tx=0x7f22fc008040).stop 2023-08-17T00:13:54.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 msgr2=0x7f230c0be0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 0x7f230c0be0f0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f2308009fd0 tx=0x7f2308017000).stop 2023-08-17T00:13:54.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 shutdown_connections 2023-08-17T00:13:54.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f22f005a150 0x7f22f005c610 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f230c0a8f50 0x7f230c0becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f230c0a8b70 0x7f230c16bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 --2- 172.21.15.153:0/938191512 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f230c0656d0 0x7f230c0be0f0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.291+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 >> 172.21.15.153:0/938191512 conn(0x7f230c0c7150 msgr2=0x7f230c14fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.295+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 shutdown_connections 2023-08-17T00:13:54.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.295+0000 7f231421b700 1 -- 172.21.15.153:0/938191512 wait complete. 2023-08-17T00:13:54.320 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub status 2023-08-17T00:13:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.487+0000 7fd5317f9700 1 Processor -- start 2023-08-17T00:13:54.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.487+0000 7fd5317f9700 1 -- start start 2023-08-17T00:13:54.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.487+0000 7fd5317f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 0x7fd52c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.487+0000 7fd5317f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c0bfd10 con 0x7fd52c153f50 2023-08-17T00:13:54.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.487+0000 7fd5317f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52c158420 con 0x7fd52c0c11b0 2023-08-17T00:13:54.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.487+0000 7fd5317f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c154af0 con 0x7fd52c0c57a0 2023-08-17T00:13:54.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 0x7fd52c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 0x7fd52c0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:49628/0 (socket says 172.21.15.153:49628) 2023-08-17T00:13:54.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 -- 172.21.15.153:0/3102711827 learned_addr learned my addr 172.21.15.153:0/3102711827 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd523fff700 1 --1- 172.21.15.153:0/3102711827 >> v1:172.21.15.153:6789/0 conn(0x7fd52c153f50 0x7fd52c157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:59600/0 (socket says 172.21.15.153:59600) 2023-08-17T00:13:54.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 -- 172.21.15.153:0/3102711827 >> v1:172.21.15.178:6789/0 conn(0x7fd52c0c11b0 legacy=0x7fd52c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52b7fe700 1 -- 172.21.15.153:0/3102711827 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499900251 0 0) 0x7fd52c0bfd10 con 0x7fd52c153f50 2023-08-17T00:13:54.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 -- 172.21.15.153:0/3102711827 >> v1:172.21.15.153:6789/0 conn(0x7fd52c153f50 legacy=0x7fd52c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 -- 172.21.15.153:0/3102711827 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c154dd0 con 0x7fd52c0c57a0 2023-08-17T00:13:54.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52bfff700 1 --2- 172.21.15.153:0/3102711827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 0x7fd52c0c5b80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd51c009830 tx=0x7fd51c0090f0).ready entity=mon.2 client_cookie=a8e354dc2625d605 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52b7fe700 1 -- 172.21.15.153:0/3102711827 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00b640 con 0x7fd52c0c57a0 2023-08-17T00:13:54.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52b7fe700 1 -- 172.21.15.153:0/3102711827 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c00b7a0 con 0x7fd52c0c57a0 2023-08-17T00:13:54.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd52b7fe700 1 -- 172.21.15.153:0/3102711827 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c00bb20 con 0x7fd52c0c57a0 2023-08-17T00:13:54.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd5317f9700 1 -- 172.21.15.153:0/3102711827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 msgr2=0x7fd52c0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.491+0000 7fd5317f9700 1 --2- 172.21.15.153:0/3102711827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 0x7fd52c0c5b80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd51c009830 tx=0x7fd51c0090f0).stop 2023-08-17T00:13:54.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- 172.21.15.153:0/3102711827 shutdown_connections 2023-08-17T00:13:54.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 --2- 172.21.15.153:0/3102711827 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c57a0 0x7fd52c0c5b80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- 172.21.15.153:0/3102711827 >> 172.21.15.153:0/3102711827 conn(0x7fd52c062a70 msgr2=0x7fd52c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- 172.21.15.153:0/3102711827 shutdown_connections 2023-08-17T00:13:54.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- 172.21.15.153:0/3102711827 wait complete. 2023-08-17T00:13:54.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 Processor -- start 2023-08-17T00:13:54.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- start start 2023-08-17T00:13:54.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c11b0 0x7fd52c14add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52c0c57a0 0x7fd52c0c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 0x7fd52c0c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c0c2320 con 0x7fd52c153f50 2023-08-17T00:13:54.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c14b2c0 con 0x7fd52c0c57a0 2023-08-17T00:13:54.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.495+0000 7fd5317f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c155010 con 0x7fd52c0c11b0 2023-08-17T00:13:54.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 0x7fd52c0c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd523fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52c0c57a0 0x7fd52c0c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c11b0 0x7fd52c14add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 0x7fd52c0c1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40332/0 (socket says 172.21.15.153:40332) 2023-08-17T00:13:54.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 -- 172.21.15.153:0/773632897 learned_addr learned my addr 172.21.15.153:0/773632897 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 -- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c11b0 msgr2=0x7fd52c14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c11b0 0x7fd52c14add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 -- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52c0c57a0 msgr2=0x7fd52c0c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52c0c57a0 0x7fd52c0c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 -- 172.21.15.153:0/773632897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c009370 con 0x7fd52c153f50 2023-08-17T00:13:54.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd530ff8700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 0x7fd52c0c1e30 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fd52400c7c0 tx=0x7fd5240014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd528ff9700 1 -- 172.21.15.153:0/773632897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400e4a0 con 0x7fd52c153f50 2023-08-17T00:13:54.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd528ff9700 1 -- 172.21.15.153:0/773632897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52400e600 con 0x7fd52c153f50 2023-08-17T00:13:54.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c1555d0 con 0x7fd52c153f50 2023-08-17T00:13:54.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd528ff9700 1 -- 172.21.15.153:0/773632897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52400e9a0 con 0x7fd52c153f50 2023-08-17T00:13:54.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.499+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c0c25a0 con 0x7fd52c153f50 2023-08-17T00:13:54.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.503+0000 7fd528ff9700 1 -- 172.21.15.153:0/773632897 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd524010070 con 0x7fd52c153f50 2023-08-17T00:13:54.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.503+0000 7fd528ff9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd50c05a120 0x7fd50c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.503+0000 7fd528ff9700 1 -- 172.21.15.153:0/773632897 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fd5240738b0 con 0x7fd52c153f50 2023-08-17T00:13:54.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.503+0000 7fd52bfff700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd50c05a120 0x7fd50c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd52bfff700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd50c05a120 0x7fd50c05c5e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fd51c008000 tx=0x7fd51c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 Processor -- start 2023-08-17T00:13:54.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 -- start start 2023-08-17T00:13:54.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x2905050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28df330 0x28da5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 0x28dbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x282b1a0 con 0x2920dd0 2023-08-17T00:13:54.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29219b0 con 0x29209f0 2023-08-17T00:13:54.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2905960 con 0x28df330 2023-08-17T00:13:54.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 0x28dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 0x28dbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40336/0 (socket says 172.21.15.153:40336) 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 -- 172.21.15.153:0/2550771979 learned_addr learned my addr 172.21.15.153:0/2550771979 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd523fff700 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28df330 0x28da5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd52bfff700 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x2905050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 -- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28df330 msgr2=0x28da5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28df330 0x28da5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 -- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 msgr2=0x2905050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x2905050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 -- 172.21.15.153:0/2550771979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2859010 con 0x2920dd0 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd52bfff700 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x2905050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd530ff8700 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 0x28dbf00 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7fd52404a7e0 tx=0x7fd52400f000).ready entity=mon.0 client_cookie=740d106c3b300426 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd5217fa700 1 -- 172.21.15.153:0/2550771979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524049220 con 0x2920dd0 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd5217fa700 1 -- 172.21.15.153:0/2550771979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524071990 con 0x2920dd0 2023-08-17T00:13:54.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.507+0000 7fd5217fa700 1 -- 172.21.15.153:0/2550771979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd524071b00 con 0x2920dd0 2023-08-17T00:13:54.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- 172.21.15.153:0/2550771979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 msgr2=0x28dbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 0x28dbf00 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7fd52404a7e0 tx=0x7fd52400f000).stop 2023-08-17T00:13:54.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- 172.21.15.153:0/2550771979 shutdown_connections 2023-08-17T00:13:54.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2920dd0 0x28dbf00 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28df330 0x28da5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- 172.21.15.153:0/2550771979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x2905050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- 172.21.15.153:0/2550771979 >> 172.21.15.153:0/2550771979 conn(0x26be680 msgr2=0x2925f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- 172.21.15.153:0/2550771979 shutdown_connections 2023-08-17T00:13:54.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- 172.21.15.153:0/2550771979 wait complete. 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- start start 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 Processor -- start 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2905af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x28de160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x2901f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2905fe0 con 0x28df330 2023-08-17T00:13:54.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2908820 con 0x29209f0 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x290ab60 con 0x2920dd0 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd53cde8740 10 client.0 ll_register_callbacks cb 0x2896400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2905af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2905af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40352/0 (socket says 172.21.15.153:40352) 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd52bfff700 1 -- 172.21.15.153:0/1132039328 learned_addr learned my addr 172.21.15.153:0/1132039328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd523fff700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x28de160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.511+0000 7fd530ff8700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x2901f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd52bfff700 1 -- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 msgr2=0x2901f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd52bfff700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x2901f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd52bfff700 1 -- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 msgr2=0x28de160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd52bfff700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x28de160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd52bfff700 1 -- 172.21.15.153:0/1132039328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c0c25a0 con 0x28df330 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd52bfff700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2905af0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fd51c006bc0 tx=0x7fd51c01e040).ready entity=mon.0 client_cookie=f36df18f2067cc2b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:54.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 1 -- 172.21.15.153:0/1132039328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c026610 con 0x28df330 2023-08-17T00:13:54.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 1 -- 172.21.15.153:0/1132039328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fd51c026770 con 0x28df330 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2827200 con 0x28df330 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 1 -- 172.21.15.153:0/1132039328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd51c026930 con 0x28df330 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 10 client.8706 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x28544b0 con 0x28df330 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 1 -- 172.21.15.153:0/1132039328 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2827200 con 0x28df330 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 1 -- 172.21.15.153:0/1132039328 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd51c026a90 con 0x28df330 2023-08-17T00:13:54.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 10 client.8706 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 10 client.8706 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.b 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 20 client.8706 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x290b400 0x290b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 4 client.8706 mds_command: new command op to 8463 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2855cf0 con 0x290b400 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd523fff700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x290b400 0x290b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd50a7fc700 10 client.8706 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.515+0000 7fd523fff700 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x290b400 0x290b7e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=6ab53bc115f8be7d server_cookie=c1e3ceef9ec382b in_seq=0 out_seq=0 2023-08-17T00:13:54.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd50a7fc700 1 -- 172.21.15.153:0/1132039328 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x2855cf0 con 0x290b400 2023-08-17T00:13:54.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd50a7fc700 10 client.8706 handle_command_reply: tid=0 2023-08-17T00:13:54.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 client.8706 shutdown 2023-08-17T00:13:54.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 msgr2=0x2905af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2905af0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 rx=0x7fd51c006bc0 tx=0x7fd51c01e040).stop 2023-08-17T00:13:54.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 shutdown_connections 2023-08-17T00:13:54.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x290b400 0x290b7e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x2901f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29209f0 0x28de160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1132039328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2905af0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 >> 172.21.15.153:0/1132039328 conn(0x26be680 msgr2=0x29231d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd50a7fc700 0 client.8706 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 shutdown_connections 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 1 -- 172.21.15.153:0/1132039328 wait complete. 2023-08-17T00:13:54.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.519+0000 7fd53cde8740 20 client.8706 trim_cache size 0 max 16384 2023-08-17T00:13:54.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 Processor -- start 2023-08-17T00:13:54.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 -- start start 2023-08-17T00:13:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28df330 0x290a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 0x28dc070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x28dc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x290aca0 con 0x29209f0 2023-08-17T00:13:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29265a0 con 0x28df330 2023-08-17T00:13:54.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2903ee0 con 0x2920dd0 2023-08-17T00:13:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 0x28dc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 0x28dc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40358/0 (socket says 172.21.15.153:40358) 2023-08-17T00:13:54.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 -- 172.21.15.153:0/1272200218 learned_addr learned my addr 172.21.15.153:0/1272200218 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd52bfff700 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28df330 0x290a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd530ff8700 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x28dc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 -- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 msgr2=0x28dc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x28dc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 -- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28df330 msgr2=0x290a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28df330 0x290a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 -- 172.21.15.153:0/1272200218 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c0c9cc0 con 0x29209f0 2023-08-17T00:13:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd530ff8700 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x28dc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:13:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd523fff700 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 0x28dc070 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fd514000fb0 tx=0x7fd514009040).ready entity=mon.0 client_cookie=baed4122f0ec8a0c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd521ffb700 1 -- 172.21.15.153:0/1272200218 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514020070 con 0x29209f0 2023-08-17T00:13:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd521ffb700 1 -- 172.21.15.153:0/1272200218 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514019890 con 0x29209f0 2023-08-17T00:13:54.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.539+0000 7fd521ffb700 1 -- 172.21.15.153:0/1272200218 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514019c30 con 0x29209f0 2023-08-17T00:13:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- 172.21.15.153:0/1272200218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 msgr2=0x28dc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 0x28dc070 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fd514000fb0 tx=0x7fd514009040).stop 2023-08-17T00:13:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- 172.21.15.153:0/1272200218 shutdown_connections 2023-08-17T00:13:54.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2920dd0 0x28dc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29209f0 0x28dc070 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- 172.21.15.153:0/1272200218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28df330 0x290a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- 172.21.15.153:0/1272200218 >> 172.21.15.153:0/1272200218 conn(0x26be680 msgr2=0x2925e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- 172.21.15.153:0/1272200218 shutdown_connections 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- 172.21.15.153:0/1272200218 wait complete. 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- start start 2023-08-17T00:13:54.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 Processor -- start 2023-08-17T00:13:54.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2977c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29209f0 0x2933ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2920dd0 0x2933fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2903b90 con 0x28df330 2023-08-17T00:13:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x29344b0 con 0x2920dd0 2023-08-17T00:13:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2980530 con 0x29209f0 2023-08-17T00:13:54.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd53cde8740 10 client.0 ll_register_callbacks cb 0x7fd51c01c4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2977c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd52bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2977c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40372/0 (socket says 172.21.15.153:40372) 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd52bfff700 1 -- 172.21.15.153:0/182213092 learned_addr learned my addr 172.21.15.153:0/182213092 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.543+0000 7fd523fff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29209f0 0x2933ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd530ff8700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2920dd0 0x2933fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd52bfff700 1 -- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29209f0 msgr2=0x2933ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd52bfff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29209f0 0x2933ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd52bfff700 1 -- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2920dd0 msgr2=0x2933fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd52bfff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2920dd0 0x2933fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd52bfff700 1 -- 172.21.15.153:0/182213092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd514004980 con 0x28df330 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd523fff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29209f0 0x2933ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd52bfff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2977c70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fd51c026b90 tx=0x7fd51c028070).ready entity=mon.0 client_cookie=ea65471094a7bed6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:13:54.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 1 -- 172.21.15.153:0/182213092 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c02f420 con 0x28df330 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd524071990 con 0x28df330 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 1 -- 172.21.15.153:0/182213092 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fd51c02f580 con 0x28df330 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 1 -- 172.21.15.153:0/182213092 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd51c02f950 con 0x28df330 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 10 client.8712 fetch_fsmap learned FSMap version 109 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x2854200 con 0x28df330 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 1 -- 172.21.15.153:0/182213092 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524071990 con 0x28df330 2023-08-17T00:13:54.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 1 -- 172.21.15.153:0/182213092 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 109) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd51c02fab0 con 0x28df330 2023-08-17T00:13:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 10 client.8712 fetch_fsmap finished waiting for FSMap version 109 2023-08-17T00:13:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 10 client.8712 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.b 2023-08-17T00:13:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 20 client.8712 populate_metadata read hostname 'smithi153' 2023-08-17T00:13:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x29346a0 0x297f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 4 client.8712 mds_command: new command op to 8463 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:13:54.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 --> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x284c240 con 0x29346a0 2023-08-17T00:13:54.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd523fff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x29346a0 0x297f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd50a7fc700 10 client.8712 ms_handle_connect on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.547+0000 7fd523fff700 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x29346a0 0x297f520 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3e1b9c3994ed99c6 server_cookie=feef22478fae9873 in_seq=0 out_seq=0 2023-08-17T00:13:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd50a7fc700 1 -- 172.21.15.153:0/182213092 <== mds.0 v2:172.21.15.178:6834/3000779485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x284c240 con 0x29346a0 2023-08-17T00:13:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd50a7fc700 10 client.8712 handle_command_reply: tid=0 2023-08-17T00:13:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 client.8712 shutdown 2023-08-17T00:13:54.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 msgr2=0x2977c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2977c70 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fd51c026b90 tx=0x7fd51c028070).stop 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 shutdown_connections 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:6834/3000779485,v1:172.21.15.178:6835/3000779485] conn(0x29346a0 0x297f520 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2920dd0 0x2933fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29209f0 0x2933ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 --2- 172.21.15.153:0/182213092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28df330 0x2977c70 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd50a7fc700 0 client.8712 ms_handle_reset on v2:172.21.15.178:6834/3000779485 2023-08-17T00:13:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 >> 172.21.15.153:0/182213092 conn(0x26be680 msgr2=0x290a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 shutdown_connections 2023-08-17T00:13:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 1 -- 172.21.15.153:0/182213092 wait complete. 2023-08-17T00:13:54.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd53cde8740 20 client.8712 trim_cache size 0 max 16384 2023-08-17T00:13:54.563 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:13:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-08-17T00:13:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:13:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "7770ae7b-3c0c-4857-8a7d-36818dfc71df": { 2023-08-17T00:13:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/scrub_control_test_path", 2023-08-17T00:13:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "7770ae7b-3c0c-4857-8a7d-36818dfc71df", 2023-08-17T00:13:54.564 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive" 2023-08-17T00:13:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:54.565 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:13:54.565 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:13:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd50c05a120 msgr2=0x7fd50c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd50c05a120 0x7fd50c05c5e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fd51c008000 tx=0x7fd51c017000).stop 2023-08-17T00:13:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 msgr2=0x7fd52c0c1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 0x7fd52c0c1e30 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7fd52400c7c0 tx=0x7fd5240014e0).stop 2023-08-17T00:13:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 shutdown_connections 2023-08-17T00:13:54.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd50c05a120 0x7fd50c05c5e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd52c153f50 0x7fd52c0c1e30 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52c0c57a0 0x7fd52c0c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 --2- 172.21.15.153:0/773632897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52c0c11b0 0x7fd52c14add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 >> 172.21.15.153:0/773632897 conn(0x7fd52c062a70 msgr2=0x7fd52c063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 shutdown_connections 2023-08-17T00:13:54.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.551+0000 7fd5317f9700 1 -- 172.21.15.153:0/773632897 wait complete. 2023-08-17T00:13:54.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:54.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.723+0000 7fbb46cb9700 1 Processor -- start 2023-08-17T00:13:54.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.723+0000 7fbb46cb9700 1 -- start start 2023-08-17T00:13:54.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb46cb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb40068820 0x7fbb40068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb46cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb400a96d0 0x7fbb400a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb46cb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb401585a0 con 0x7fbb400a8df0 2023-08-17T00:13:54.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb46cb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb400c1ba0 con 0x7fbb40068820 2023-08-17T00:13:54.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb46cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb40066400 con 0x7fbb400a96d0 2023-08-17T00:13:54.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb40068820 0x7fbb40068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbb40068820 0x7fbb40068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40384/0 (socket says 172.21.15.153:40384) 2023-08-17T00:13:54.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 -- 172.21.15.153:0/1479432680 learned_addr learned my addr 172.21.15.153:0/1479432680 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb464b8700 1 --2- 172.21.15.153:0/1479432680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb400a96d0 0x7fbb400a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 -- 172.21.15.153:0/1479432680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb400a96d0 msgr2=0x7fbb400a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:54.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 --2- 172.21.15.153:0/1479432680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb400a96d0 0x7fbb400a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 -- 172.21.15.153:0/1479432680 >> v1:172.21.15.178:6789/0 conn(0x7fbb400a8df0 legacy=0x7fbb400c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 -- 172.21.15.153:0/1479432680 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb40069170 con 0x7fbb40068820 2023-08-17T00:13:54.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb454b6700 1 --2- 172.21.15.153:0/1479432680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb40068820 0x7fbb40068c80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fbb30006fd0 tx=0x7fbb300090f0).ready entity=mon.0 client_cookie=92d2e8625de3f61f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb44cb5700 1 -- 172.21.15.153:0/1479432680 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000b580 con 0x7fbb40068820 2023-08-17T00:13:54.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb44cb5700 1 -- 172.21.15.153:0/1479432680 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3000b6e0 con 0x7fbb40068820 2023-08-17T00:13:54.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.727+0000 7fbb44cb5700 1 -- 172.21.15.153:0/1479432680 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3000ba60 con 0x7fbb40068820 2023-08-17T00:13:54.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 -- 172.21.15.153:0/1479432680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb40068820 msgr2=0x7fbb40068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/1479432680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb40068820 0x7fbb40068c80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 rx=0x7fbb30006fd0 tx=0x7fbb300090f0).stop 2023-08-17T00:13:54.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 -- 172.21.15.153:0/1479432680 shutdown_connections 2023-08-17T00:13:54.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/1479432680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb400a96d0 0x7fbb400a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/1479432680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb40068820 0x7fbb40068c80 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 -- 172.21.15.153:0/1479432680 >> 172.21.15.153:0/1479432680 conn(0x7fbb400c6620 msgr2=0x7fbb400c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 -- 172.21.15.153:0/1479432680 shutdown_connections 2023-08-17T00:13:54.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 -- 172.21.15.153:0/1479432680 wait complete. 2023-08-17T00:13:54.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 Processor -- start 2023-08-17T00:13:54.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.731+0000 7fbb46cb9700 1 -- start start 2023-08-17T00:13:54.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb40068820 0x7fbb40156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb400a8df0 0x7fbb400bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 0x7fbb400bd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400bf1c0 con 0x7fbb400a96d0 2023-08-17T00:13:54.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4015c1a0 con 0x7fbb400a8df0 2023-08-17T00:13:54.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb400be920 con 0x7fbb40068820 2023-08-17T00:13:54.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 0x7fbb400bd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 0x7fbb400bd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40400/0 (socket says 172.21.15.153:40400) 2023-08-17T00:13:54.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 -- 172.21.15.153:0/603890158 learned_addr learned my addr 172.21.15.153:0/603890158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:54.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb45cb7700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb40068820 0x7fbb40156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb454b6700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb400a8df0 0x7fbb400bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 -- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb40068820 msgr2=0x7fbb40156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb40068820 0x7fbb40156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 -- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb400a8df0 msgr2=0x7fbb400bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb400a8df0 0x7fbb400bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 -- 172.21.15.153:0/603890158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb30009370 con 0x7fbb400a96d0 2023-08-17T00:13:54.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb464b8700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 0x7fbb400bd9f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fbb38009e20 tx=0x7fbb3800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800caa0 con 0x7fbb400a96d0 2023-08-17T00:13:54.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3800f040 con 0x7fbb400a96d0 2023-08-17T00:13:54.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb400bec00 con 0x7fbb400a96d0 2023-08-17T00:13:54.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3800ce10 con 0x7fbb400a96d0 2023-08-17T00:13:54.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.735+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb40157440 con 0x7fbb400a96d0 2023-08-17T00:13:54.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.739+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4006b4c0 con 0x7fbb400a96d0 2023-08-17T00:13:54.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.739+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbb38013610 con 0x7fbb400a96d0 2023-08-17T00:13:54.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.739+0000 7fbb35ffb700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb2405a120 0x7fbb2405c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:54.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.739+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fbb38074aa0 con 0x7fbb400a96d0 2023-08-17T00:13:54.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.743+0000 7fbb45cb7700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb2405a120 0x7fbb2405c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:54.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.743+0000 7fbb45cb7700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb2405a120 0x7fbb2405c5e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fbb3c007fd0 tx=0x7fbb3c007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:54.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.747+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbb38048540 con 0x7fbb400a96d0 2023-08-17T00:13:54.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.959+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb40064010 con 0x7fbb400a96d0 2023-08-17T00:13:54.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.959+0000 7fbb35ffb700 1 -- 172.21.15.153:0/603890158 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7fbb3804bb60 con 0x7fbb400a96d0 2023-08-17T00:13:54.966 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:54.967 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:54.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb2405a120 msgr2=0x7fbb2405c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb2405a120 0x7fbb2405c5e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fbb3c007fd0 tx=0x7fbb3c007d30).stop 2023-08-17T00:13:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 msgr2=0x7fbb400bd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 0x7fbb400bd9f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7fbb38009e20 tx=0x7fbb3800b040).stop 2023-08-17T00:13:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 shutdown_connections 2023-08-17T00:13:54.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbb2405a120 0x7fbb2405c5e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb400a96d0 0x7fbb400bd9f0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb400a8df0 0x7fbb400bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 --2- 172.21.15.153:0/603890158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb40068820 0x7fbb40156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:54.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 >> 172.21.15.153:0/603890158 conn(0x7fbb400c6620 msgr2=0x7fbb400c5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:54.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 shutdown_connections 2023-08-17T00:13:54.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:54.963+0000 7fbb46cb9700 1 -- 172.21.15.153:0/603890158 wait complete. 2023-08-17T00:13:54.971 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:54.987 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:13:54.988 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:13:55.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9dc9d700 1 Processor -- start 2023-08-17T00:13:55.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9dc9d700 1 -- start start 2023-08-17T00:13:55.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9dc9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c5ea0 0x7f5d980634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:55.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9dc9d700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d98154e90 con 0x7f5d980acf30 2023-08-17T00:13:55.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9dc9d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d98063e10 con 0x7f5d980639a0 2023-08-17T00:13:55.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9dc9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980c1730 con 0x7f5d980c5ea0 2023-08-17T00:13:55.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9cc9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5d980acf30 0x7f5d980c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38010/0 (socket says 172.21.15.153:38010) 2023-08-17T00:13:55.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d9cc9b700 1 -- 172.21.15.153:0/716558227 learned_addr learned my addr 172.21.15.153:0/716558227 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:55.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.139+0000 7f5d8ffff700 1 --2- 172.21.15.153:0/716558227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c5ea0 0x7f5d980634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:55.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902936147 0 0) 0x7f5d98154e90 con 0x7f5d980acf30 2023-08-17T00:13:55.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d800033f0 con 0x7f5d980acf30 2023-08-17T00:13:55.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129560594 0 0) 0x7f5d98063e10 con 0x7f5d980639a0 2023-08-17T00:13:55.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d98154e90 con 0x7f5d980639a0 2023-08-17T00:13:55.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8ffff700 1 -- 172.21.15.153:0/716558227 >> v1:172.21.15.178:6789/0 conn(0x7f5d980639a0 legacy=0x7f5d980bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8ffff700 1 -- 172.21.15.153:0/716558227 >> v1:172.21.15.153:6789/0 conn(0x7f5d980acf30 legacy=0x7f5d980c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2932398862 0 0) 0x7f5d800033f0 con 0x7f5d980acf30 2023-08-17T00:13:55.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8ffff700 1 -- 172.21.15.153:0/716558227 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d98153fc0 con 0x7f5d980c5ea0 2023-08-17T00:13:55.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8ffff700 1 --2- 172.21.15.153:0/716558227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c5ea0 0x7f5d980634b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5d88009790 tx=0x7f5d88009060).ready entity=mon.2 client_cookie=7d1f3124a12bec49 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:55.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94001470 con 0x7f5d980c5ea0 2023-08-17T00:13:55.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d880090d0 con 0x7f5d980c5ea0 2023-08-17T00:13:55.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d8f7fe700 1 -- 172.21.15.153:0/716558227 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88011610 con 0x7f5d980c5ea0 2023-08-17T00:13:55.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/716558227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c5ea0 msgr2=0x7f5d980634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/716558227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c5ea0 0x7f5d980634b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f5d88009790 tx=0x7f5d88009060).stop 2023-08-17T00:13:55.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/716558227 shutdown_connections 2023-08-17T00:13:55.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/716558227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980c5ea0 0x7f5d980634b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/716558227 >> 172.21.15.153:0/716558227 conn(0x7f5d980cb330 msgr2=0x7f5d980c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:55.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/716558227 shutdown_connections 2023-08-17T00:13:55.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.143+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/716558227 wait complete. 2023-08-17T00:13:55.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.147+0000 7f5d9dc9d700 1 Processor -- start 2023-08-17T00:13:55.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.147+0000 7f5d9dc9d700 1 -- start start 2023-08-17T00:13:55.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 0x7f5d98150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:55.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980acf30 0x7f5d980c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:55.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d981535b0 0x7f5d980c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:55.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980aff10 con 0x7f5d980639a0 2023-08-17T00:13:55.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980af340 con 0x7f5d981535b0 2023-08-17T00:13:55.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980af5e0 con 0x7f5d980acf30 2023-08-17T00:13:55.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 0x7f5d98150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:55.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 0x7f5d98150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58008/0 (socket says 172.21.15.153:58008) 2023-08-17T00:13:55.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 -- 172.21.15.153:0/345675224 learned_addr learned my addr 172.21.15.153:0/345675224 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:55.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d8ffff700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980acf30 0x7f5d980c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:55.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9d49c700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d981535b0 0x7f5d980c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:55.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 -- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980acf30 msgr2=0x7f5d980c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980acf30 0x7f5d980c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 -- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d981535b0 msgr2=0x7f5d980c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d981535b0 0x7f5d980c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 -- 172.21.15.153:0/345675224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880092a0 con 0x7f5d980639a0 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9d49c700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d981535b0 0x7f5d980c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9cc9b700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 0x7f5d98150800 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f5d9400c800 tx=0x7f5d94001a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94007170 con 0x7f5d980639a0 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d940072f0 con 0x7f5d980639a0 2023-08-17T00:13:55.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d980af8c0 con 0x7f5d980639a0 2023-08-17T00:13:55.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d940048c0 con 0x7f5d980639a0 2023-08-17T00:13:55.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.151+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d98150cf0 con 0x7f5d980639a0 2023-08-17T00:13:55.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.155+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9806b4c0 con 0x7f5d980639a0 2023-08-17T00:13:55.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.155+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5d94010070 con 0x7f5d980639a0 2023-08-17T00:13:55.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.155+0000 7f5d8cff9700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d8405a150 0x7f5d8405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:55.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.155+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f5d94073cc0 con 0x7f5d980639a0 2023-08-17T00:13:55.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.155+0000 7f5d8ffff700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d8405a150 0x7f5d8405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:55.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.159+0000 7f5d8ffff700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d8405a150 0x7f5d8405c610 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f5d880096e0 tx=0x7f5d88016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:55.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.159+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5d9407a080 con 0x7f5d980639a0 2023-08-17T00:13:55.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.375+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5d98154280 con 0x7f5d980639a0 2023-08-17T00:13:55.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.375+0000 7f5d8cff9700 1 -- 172.21.15.153:0/345675224 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1366 (secure 0 0 0) 0x7f5d94047570 con 0x7f5d980639a0 2023-08-17T00:13:55.383 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:55.383 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":683,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":906,"data_bytes":928400173,"bytes_used":4337295360,"bytes_avail":768756817920,"bytes_total":773094113280,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":3528812,"recovering_keys_per_sec":0,"num_objects_recovered":40,"num_bytes_recovered":41943040,"num_keys_recovered":0,"write_bytes_sec":29524856,"read_op_per_sec":0,"write_op_per_sec":29},"fsmap":{"epoch":109,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-08-17T00:13:01.404283+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:13:55.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d8405a150 msgr2=0x7f5d8405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d8405a150 0x7f5d8405c610 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f5d880096e0 tx=0x7f5d88016000).stop 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 msgr2=0x7f5d98150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 0x7f5d98150800 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7f5d9400c800 tx=0x7f5d94001a20).stop 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 shutdown_connections 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5d8405a150 0x7f5d8405c610 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5d981535b0 0x7f5d980c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5d980acf30 0x7f5d980c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 --2- 172.21.15.153:0/345675224 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5d980639a0 0x7f5d98150800 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 >> 172.21.15.153:0/345675224 conn(0x7f5d980cb330 msgr2=0x7f5d980bfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 shutdown_connections 2023-08-17T00:13:55.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:55.379+0000 7f5d9dc9d700 1 -- 172.21.15.153:0/345675224 wait complete. 2023-08-17T00:13:55.406 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:13:56.407 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c7985b700 1 Processor -- start 2023-08-17T00:13:56.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c7985b700 1 -- start start 2023-08-17T00:13:56.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c7985b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2c74153da0 0x7f2c740bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c7985b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740a9170 con 0x7f2c7414fff0 2023-08-17T00:13:56.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c7985b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c740c1b90 con 0x7f2c741503d0 2023-08-17T00:13:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c7985b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c74154280 con 0x7f2c74153da0 2023-08-17T00:13:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c72ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2c7414fff0 0x7f2c74062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38022/0 (socket says 172.21.15.153:38022) 2023-08-17T00:13:56.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c72ffd700 1 -- 172.21.15.153:0/968412017 learned_addr learned my addr 172.21.15.153:0/968412017 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:56.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c6bfff700 1 --2- 172.21.15.153:0/968412017 >> v2:172.21.15.153:3300/0 conn(0x7f2c74153da0 0x7f2c740bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.567+0000 7f2c727fc700 1 -- 172.21.15.153:0/968412017 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184443707 0 0) 0x7f2c740a9170 con 0x7f2c7414fff0 2023-08-17T00:13:56.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c727fc700 1 -- 172.21.15.153:0/968412017 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c600033f0 con 0x7f2c7414fff0 2023-08-17T00:13:56.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c727fc700 1 -- 172.21.15.153:0/968412017 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481406658 0 0) 0x7f2c740c1b90 con 0x7f2c741503d0 2023-08-17T00:13:56.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c6bfff700 1 -- 172.21.15.153:0/968412017 >> v1:172.21.15.178:6789/0 conn(0x7f2c741503d0 legacy=0x7f2c740bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c6bfff700 1 -- 172.21.15.153:0/968412017 >> v1:172.21.15.153:6789/0 conn(0x7f2c7414fff0 legacy=0x7f2c74062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c6bfff700 1 -- 172.21.15.153:0/968412017 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74154560 con 0x7f2c74153da0 2023-08-17T00:13:56.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c6bfff700 1 --2- 172.21.15.153:0/968412017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740bb5e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f2c5c009760 tx=0x7f2c5c009060).ready entity=mon.0 client_cookie=11b7d19c2f65beeb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:56.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c727fc700 1 -- 172.21.15.153:0/968412017 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0090d0 con 0x7f2c74153da0 2023-08-17T00:13:56.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c727fc700 1 -- 172.21.15.153:0/968412017 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c00f510 con 0x7f2c74153da0 2023-08-17T00:13:56.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c727fc700 1 -- 172.21.15.153:0/968412017 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c00f890 con 0x7f2c74153da0 2023-08-17T00:13:56.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 -- 172.21.15.153:0/968412017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 msgr2=0x7f2c740bb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 --2- 172.21.15.153:0/968412017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740bb5e0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7f2c5c009760 tx=0x7f2c5c009060).stop 2023-08-17T00:13:56.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 -- 172.21.15.153:0/968412017 shutdown_connections 2023-08-17T00:13:56.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 --2- 172.21.15.153:0/968412017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740bb5e0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 -- 172.21.15.153:0/968412017 >> 172.21.15.153:0/968412017 conn(0x7f2c740c7150 msgr2=0x7f2c740c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:56.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 -- 172.21.15.153:0/968412017 shutdown_connections 2023-08-17T00:13:56.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.571+0000 7f2c7985b700 1 -- 172.21.15.153:0/968412017 wait complete. 2023-08-17T00:13:56.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 Processor -- start 2023-08-17T00:13:56.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 -- start start 2023-08-17T00:13:56.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7414fff0 0x7f2c7413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c741503d0 0x7f2c741525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74150d30 con 0x7f2c74153da0 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c74151010 con 0x7f2c7414fff0 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c7985b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c741512f0 con 0x7f2c741503d0 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.575+0000 7f2c737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58022/0 (socket says 172.21.15.153:58022) 2023-08-17T00:13:56.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 -- 172.21.15.153:0/3985753343 learned_addr learned my addr 172.21.15.153:0/3985753343 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:56.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c72ffd700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7414fff0 0x7f2c7413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c6bfff700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c741503d0 0x7f2c741525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 -- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c741503d0 msgr2=0x7f2c741525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c741503d0 0x7f2c741525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 -- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7414fff0 msgr2=0x7f2c7413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7414fff0 0x7f2c7413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 -- 172.21.15.153:0/3985753343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0092a0 con 0x7f2c74153da0 2023-08-17T00:13:56.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c6bfff700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c741503d0 0x7f2c741525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:56.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c737fe700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740ab8a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f2c6c00c810 tx=0x7f2c6c001500).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:56.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c010510 con 0x7f2c74153da0 2023-08-17T00:13:56.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c010670 con 0x7f2c74153da0 2023-08-17T00:13:56.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c741515d0 con 0x7f2c74153da0 2023-08-17T00:13:56.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c0109f0 con 0x7f2c74153da0 2023-08-17T00:13:56.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c74152ab0 con 0x7f2c74153da0 2023-08-17T00:13:56.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.579+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74151760 con 0x7f2c74153da0 2023-08-17T00:13:56.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.583+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2c6c019030 con 0x7f2c74153da0 2023-08-17T00:13:56.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.583+0000 7f2c6affd700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c5405a150 0x7f2c5405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.583+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f2c6c0738f0 con 0x7f2c74153da0 2023-08-17T00:13:56.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.583+0000 7f2c72ffd700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c5405a150 0x7f2c5405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.587+0000 7f2c72ffd700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c5405a150 0x7f2c5405c610 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2c64005750 tx=0x7f2c64009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:56.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.591+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c6c0473c0 con 0x7f2c74153da0 2023-08-17T00:13:56.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.783+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c74154840 con 0x7f2c74153da0 2023-08-17T00:13:56.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.783+0000 7f2c6affd700 1 -- 172.21.15.153:0/3985753343 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f2c6c04a9e0 con 0x7f2c74153da0 2023-08-17T00:13:56.792 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:56.792 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c5405a150 msgr2=0x7f2c5405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c5405a150 0x7f2c5405c610 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f2c64005750 tx=0x7f2c64009040).stop 2023-08-17T00:13:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 msgr2=0x7f2c740ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740ab8a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7f2c6c00c810 tx=0x7f2c6c001500).stop 2023-08-17T00:13:56.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 shutdown_connections 2023-08-17T00:13:56.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c5405a150 0x7f2c5405c610 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c74153da0 0x7f2c740ab8a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c741503d0 0x7f2c741525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 --2- 172.21.15.153:0/3985753343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c7414fff0 0x7f2c7413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 >> 172.21.15.153:0/3985753343 conn(0x7f2c740c7150 msgr2=0x7f2c740bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:56.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 shutdown_connections 2023-08-17T00:13:56.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.787+0000 7f2c7985b700 1 -- 172.21.15.153:0/3985753343 wait complete. 2023-08-17T00:13:56.798 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:56.817 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:13:56.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:13:56.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.963+0000 7f6fd0c8f700 1 Processor -- start 2023-08-17T00:13:56.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.963+0000 7f6fd0c8f700 1 -- start start 2023-08-17T00:13:56.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fd0c8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fd0c8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f6fcc0a96d0 0x7f6fcc0a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fd0c8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc1585a0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fd0c8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc0c1ba0 con 0x7f6fcc0a96d0 2023-08-17T00:13:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fd0c8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc066400 con 0x7f6fcc068820 2023-08-17T00:13:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcb7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6fcc0a8df0 0x7f6fcc0c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38032/0 (socket says 172.21.15.153:38032) 2023-08-17T00:13:56.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcb7fe700 1 -- 172.21.15.153:0/3752002225 learned_addr learned my addr 172.21.15.153:0/3752002225 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:56.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcbfff700 1 --2- 172.21.15.153:0/3752002225 >> v2:172.21.15.153:3300/0 conn(0x7f6fcc0a96d0 0x7f6fcc0a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fc2ffd700 1 --2- 172.21.15.153:0/3752002225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcaffd700 1 -- 172.21.15.153:0/3752002225 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412809338 0 0) 0x7f6fcc1585a0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcaffd700 1 -- 172.21.15.153:0/3752002225 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb80033f0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcbfff700 1 -- 172.21.15.153:0/3752002225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 msgr2=0x7f6fcc068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcbfff700 1 --2- 172.21.15.153:0/3752002225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcbfff700 1 -- 172.21.15.153:0/3752002225 >> v1:172.21.15.153:6789/0 conn(0x7f6fcc0a8df0 legacy=0x7f6fcc0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcbfff700 1 -- 172.21.15.153:0/3752002225 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc069170 con 0x7f6fcc0a96d0 2023-08-17T00:13:56.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcbfff700 1 --2- 172.21.15.153:0/3752002225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0a9b30 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f6fc4009e60 tx=0x7f6fc4009780).ready entity=mon.0 client_cookie=280859b6d852fe9d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcaffd700 1 -- 172.21.15.153:0/3752002225 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400e070 con 0x7f6fcc0a96d0 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcaffd700 1 -- 172.21.15.153:0/3752002225 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400bab0 con 0x7f6fcc0a96d0 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.967+0000 7f6fcaffd700 1 -- 172.21.15.153:0/3752002225 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400be30 con 0x7f6fcc0a96d0 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/3752002225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a96d0 msgr2=0x7f6fcc0a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/3752002225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0a9b30 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f6fc4009e60 tx=0x7f6fc4009780).stop 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/3752002225 shutdown_connections 2023-08-17T00:13:56.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/3752002225 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0a9b30 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/3752002225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/3752002225 >> 172.21.15.153:0/3752002225 conn(0x7f6fcc0c6620 msgr2=0x7f6fcc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:56.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/3752002225 shutdown_connections 2023-08-17T00:13:56.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/3752002225 wait complete. 2023-08-17T00:13:56.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.971+0000 7f6fd0c8f700 1 Processor -- start 2023-08-17T00:13:56.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 -- start start 2023-08-17T00:13:56.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc168d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 0x7f6fcc0bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0bcfc0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc159260 con 0x7f6fcc0a96d0 2023-08-17T00:13:56.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fd0c8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc159540 con 0x7f6fcc068820 2023-08-17T00:13:56.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 0x7f6fcc0bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 0x7f6fcc0bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58046/0 (socket says 172.21.15.153:58046) 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 -- 172.21.15.153:0/4256130055 learned_addr learned my addr 172.21.15.153:0/4256130055 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fcbfff700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fcb7fe700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc168d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 -- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 msgr2=0x7f6fcc168d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc168d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 -- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc0a96d0 msgr2=0x7f6fcc0bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0bcad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 -- 172.21.15.153:0/4256130055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc4009a20 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fcbfff700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.975+0000 7f6fc2ffd700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 0x7f6fcc0bc5e0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f6fb400e930 tx=0x7f6fb4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400eed0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400c850 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc159820 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400cbd0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc159de0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc0c4290 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.979+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6fb4022070 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.983+0000 7f6fc3fff700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6fac05a150 0x7f6fac05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:56.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.983+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f6fb40746c0 con 0x7f6fcc0a8df0 2023-08-17T00:13:56.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.983+0000 7f6fcb7fe700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6fac05a150 0x7f6fac05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:56.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.983+0000 7f6fcb7fe700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6fac05a150 0x7f6fac05c610 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6fcc15b730 tx=0x7f6fbc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:56.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:56.987+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6fcc0c4290 con 0x7f6fcc0a8df0 2023-08-17T00:13:57.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.195+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6fcc0c4290 con 0x7f6fcc0a8df0 2023-08-17T00:13:57.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.199+0000 7f6fc3fff700 1 -- 172.21.15.153:0/4256130055 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1368 (secure 0 0 0) 0x7f6fcc0c4290 con 0x7f6fcc0a8df0 2023-08-17T00:13:57.205 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:57.206 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":684,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1045,"data_bytes":1074512744,"bytes_used":4659929088,"bytes_avail":768434184192,"bytes_total":773094113280,"recovering_objects_per_sec":3,"recovering_bytes_per_sec":3493517,"recovering_keys_per_sec":0,"num_objects_recovered":40,"num_bytes_recovered":41943040,"num_keys_recovered":0,"write_bytes_sec":39913094,"read_op_per_sec":0,"write_op_per_sec":39},"fsmap":{"epoch":109,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-08-17T00:13:01.404283+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:13:57.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6fac05a150 msgr2=0x7f6fac05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:57.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6fac05a150 0x7f6fac05c610 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f6fcc15b730 tx=0x7f6fbc009040).stop 2023-08-17T00:13:57.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 msgr2=0x7f6fcc0bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:57.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 0x7f6fcc0bc5e0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 rx=0x7f6fb400e930 tx=0x7f6fb4009060).stop 2023-08-17T00:13:57.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 shutdown_connections 2023-08-17T00:13:57.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6fac05a150 0x7f6fac05c610 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:57.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fcc0a96d0 0x7f6fcc0bcad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:57.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6fcc0a8df0 0x7f6fcc0bc5e0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:57.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 --2- 172.21.15.153:0/4256130055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fcc068820 0x7f6fcc168d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:57.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 >> 172.21.15.153:0/4256130055 conn(0x7f6fcc0c6620 msgr2=0x7f6fcc061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:57.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 shutdown_connections 2023-08-17T00:13:57.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:57.203+0000 7f6fd0c8f700 1 -- 172.21.15.153:0/4256130055 wait complete. 2023-08-17T00:13:57.229 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-08-17T00:13:58.230 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:13:58.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 Processor -- start 2023-08-17T00:13:58.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 -- start start 2023-08-17T00:13:58.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff4bc151630 0x7ff4bc0bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc066130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc062c90 con 0x7ff4bc063120 2023-08-17T00:13:58.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc066620 con 0x7ff4bc151630 2023-08-17T00:13:58.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4c1769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0657d0 con 0x7ff4bc151a10 2023-08-17T00:13:58.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4bb7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff4bc063120 0x7ff4bc1553f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38036/0 (socket says 172.21.15.153:38036) 2023-08-17T00:13:58.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4bb7fe700 1 -- 172.21.15.153:0/2171087689 learned_addr learned my addr 172.21.15.153:0/2171087689 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:58.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4baffd700 1 --2- 172.21.15.153:0/2171087689 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc151630 0x7ff4bc0bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4ba7fc700 1 --2- 172.21.15.153:0/2171087689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc066130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4b9ffb700 1 -- 172.21.15.153:0/2171087689 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701209339 0 0) 0x7ff4bc062c90 con 0x7ff4bc063120 2023-08-17T00:13:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.387+0000 7ff4b9ffb700 1 -- 172.21.15.153:0/2171087689 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a40033f0 con 0x7ff4bc063120 2023-08-17T00:13:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4ba7fc700 1 -- 172.21.15.153:0/2171087689 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc151630 msgr2=0x7ff4bc0bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:13:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4ba7fc700 1 --2- 172.21.15.153:0/2171087689 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc151630 0x7ff4bc0bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4b9ffb700 1 -- 172.21.15.153:0/2171087689 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349128821 0 0) 0x7ff4a40033f0 con 0x7ff4bc063120 2023-08-17T00:13:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4ba7fc700 1 -- 172.21.15.153:0/2171087689 >> v1:172.21.15.153:6789/0 conn(0x7ff4bc063120 legacy=0x7ff4bc1553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4ba7fc700 1 -- 172.21.15.153:0/2171087689 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc062980 con 0x7ff4bc151a10 2023-08-17T00:13:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4baffd700 1 --2- 172.21.15.153:0/2171087689 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc151630 0x7ff4bc0bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4ba7fc700 1 --2- 172.21.15.153:0/2171087689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc066130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff4b0009760 tx=0x7ff4b0009060).ready entity=mon.2 client_cookie=a2edbf26c18ca8f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:58.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4b9ffb700 1 -- 172.21.15.153:0/2171087689 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40017f0 con 0x7ff4bc151a10 2023-08-17T00:13:58.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4b9ffb700 1 -- 172.21.15.153:0/2171087689 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b00090d0 con 0x7ff4bc151a10 2023-08-17T00:13:58.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4b9ffb700 1 -- 172.21.15.153:0/2171087689 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0011610 con 0x7ff4bc151a10 2023-08-17T00:13:58.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 -- 172.21.15.153:0/2171087689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 msgr2=0x7ff4bc066130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 --2- 172.21.15.153:0/2171087689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc066130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff4b0009760 tx=0x7ff4b0009060).stop 2023-08-17T00:13:58.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 -- 172.21.15.153:0/2171087689 shutdown_connections 2023-08-17T00:13:58.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 --2- 172.21.15.153:0/2171087689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc066130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 --2- 172.21.15.153:0/2171087689 >> v2:172.21.15.178:3300/0 conn(0x7ff4bc151630 0x7ff4bc0bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 -- 172.21.15.153:0/2171087689 >> 172.21.15.153:0/2171087689 conn(0x7ff4bc0c2fb0 msgr2=0x7ff4bc0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:58.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 -- 172.21.15.153:0/2171087689 shutdown_connections 2023-08-17T00:13:58.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.391+0000 7ff4c1769700 1 -- 172.21.15.153:0/2171087689 wait complete. 2023-08-17T00:13:58.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 Processor -- start 2023-08-17T00:13:58.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 -- start start 2023-08-17T00:13:58.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc063120 0x7ff4bc0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 0x7ff4bc14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0a94a0 con 0x7ff4bc151630 2023-08-17T00:13:58.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc14ecf0 con 0x7ff4bc063120 2023-08-17T00:13:58.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.395+0000 7ff4c1769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc14efd0 con 0x7ff4bc151a10 2023-08-17T00:13:58.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4ba7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 0x7ff4bc14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc063120 0x7ff4bc0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4ba7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 0x7ff4bc14e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58052/0 (socket says 172.21.15.153:58052) 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4ba7fc700 1 -- 172.21.15.153:0/439078541 learned_addr learned my addr 172.21.15.153:0/439078541 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4bb7fe700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 -- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 msgr2=0x7ff4bc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 -- 172.21.15.153:0/439078541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 msgr2=0x7ff4bc14e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 0x7ff4bc14e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 -- 172.21.15.153:0/439078541 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac0092a0 con 0x7ff4bc063120 2023-08-17T00:13:58.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4ba7fc700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 0x7ff4bc14e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:58.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4baffd700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc063120 0x7ff4bc0ac1d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7ff4ac00e980 tx=0x7ff4ac009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:58.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac012600 con 0x7ff4bc063120 2023-08-17T00:13:58.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac012760 con 0x7ff4bc063120 2023-08-17T00:13:58.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b00092a0 con 0x7ff4bc063120 2023-08-17T00:13:58.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac012ae0 con 0x7ff4bc063120 2023-08-17T00:13:58.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.399+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc0a9990 con 0x7ff4bc063120 2023-08-17T00:13:58.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.403+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc06b4c0 con 0x7ff4bc063120 2023-08-17T00:13:58.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.403+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff4ac022070 con 0x7ff4bc063120 2023-08-17T00:13:58.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.403+0000 7ff4a2ffd700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff4a805a1a0 0x7ff4a805c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.403+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7ff4ac0744e0 con 0x7ff4bc063120 2023-08-17T00:13:58.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.407+0000 7ff4ba7fc700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff4a805a1a0 0x7ff4a805c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.407+0000 7ff4ba7fc700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff4a805a1a0 0x7ff4a805c660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7ff4bc0ab7b0 tx=0x7ff4b0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:58.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.415+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff4ac047e70 con 0x7ff4bc063120 2023-08-17T00:13:58.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.607+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4bc069ba0 con 0x7ff4bc063120 2023-08-17T00:13:58.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.607+0000 7ff4a2ffd700 1 -- 172.21.15.153:0/439078541 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7ff4ac016090 con 0x7ff4bc063120 2023-08-17T00:13:58.616 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:58.616 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:13:58.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff4a805a1a0 msgr2=0x7ff4a805c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff4a805a1a0 0x7ff4a805c660 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7ff4bc0ab7b0 tx=0x7ff4b0016000).stop 2023-08-17T00:13:58.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc063120 msgr2=0x7ff4bc0ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc063120 0x7ff4bc0ac1d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7ff4ac00e980 tx=0x7ff4ac009060).stop 2023-08-17T00:13:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 shutdown_connections 2023-08-17T00:13:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff4a805a1a0 0x7ff4a805c660 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4bc151a10 0x7ff4bc140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff4bc151630 0x7ff4bc14e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 --2- 172.21.15.153:0/439078541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff4bc063120 0x7ff4bc0ac1d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 >> 172.21.15.153:0/439078541 conn(0x7ff4bc0c2fb0 msgr2=0x7ff4bc0a6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:58.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 shutdown_connections 2023-08-17T00:13:58.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.611+0000 7ff4c1769700 1 -- 172.21.15.153:0/439078541 wait complete. 2023-08-17T00:13:58.622 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:13:58.639 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:13:58.639 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:13:58.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.787+0000 7f3feb59e700 1 Processor -- start 2023-08-17T00:13:58.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.787+0000 7f3feb59e700 1 -- start start 2023-08-17T00:13:58.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151a80 0x7f3fec0c4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3feb59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0a8d20 con 0x7f3fec0be7e0 2023-08-17T00:13:58.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3feb59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0a54a0 con 0x7f3fec0bebc0 2023-08-17T00:13:58.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3feb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec0a5780 con 0x7f3fec151a80 2023-08-17T00:13:58.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fea59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3fec0be7e0 0x7f3fec0a8610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38048/0 (socket says 172.21.15.153:38048) 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fea59c700 1 -- 172.21.15.153:0/2519199325 learned_addr learned my addr 172.21.15.153:0/2519199325 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fead9d700 1 --2- 172.21.15.153:0/2519199325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151a80 0x7f3fec0c4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439005988 0 0) 0x7f3fec0a8d20 con 0x7f3fec0be7e0 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd40033f0 con 0x7f3fec0be7e0 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3825336136 0 0) 0x7f3fec0a54a0 con 0x7f3fec0bebc0 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fec0a8d20 con 0x7f3fec0bebc0 2023-08-17T00:13:58.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fead9d700 1 -- 172.21.15.153:0/2519199325 >> v1:172.21.15.178:6789/0 conn(0x7f3fec0bebc0 legacy=0x7f3fec151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fead9d700 1 -- 172.21.15.153:0/2519199325 >> v1:172.21.15.153:6789/0 conn(0x7f3fec0be7e0 legacy=0x7f3fec0a8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fead9d700 1 -- 172.21.15.153:0/2519199325 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0a5a60 con 0x7f3fec151a80 2023-08-17T00:13:58.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.791+0000 7f3fead9d700 1 --2- 172.21.15.153:0/2519199325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151a80 0x7f3fec0c4470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3fe4009e90 tx=0x7f3fe4009780).ready entity=mon.2 client_cookie=142b7e59963aa8b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:58.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400e070 con 0x7f3fec151a80 2023-08-17T00:13:58.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe400bab0 con 0x7f3fec151a80 2023-08-17T00:13:58.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3fe959a700 1 -- 172.21.15.153:0/2519199325 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe400be30 con 0x7f3fec151a80 2023-08-17T00:13:58.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 -- 172.21.15.153:0/2519199325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151a80 msgr2=0x7f3fec0c4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2519199325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151a80 0x7f3fec0c4470 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f3fe4009e90 tx=0x7f3fe4009780).stop 2023-08-17T00:13:58.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 -- 172.21.15.153:0/2519199325 shutdown_connections 2023-08-17T00:13:58.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2519199325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec151a80 0x7f3fec0c4470 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 -- 172.21.15.153:0/2519199325 >> 172.21.15.153:0/2519199325 conn(0x7f3fec0c5170 msgr2=0x7f3fec0c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:58.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 -- 172.21.15.153:0/2519199325 shutdown_connections 2023-08-17T00:13:58.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.795+0000 7f3feb59e700 1 -- 172.21.15.153:0/2519199325 wait complete. 2023-08-17T00:13:58.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 Processor -- start 2023-08-17T00:13:58.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 -- start start 2023-08-17T00:13:58.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec0be7e0 0x7f3fec152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec0bebc0 0x7f3fec152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 0x7f3fec155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec156bd0 con 0x7f3fec151a80 2023-08-17T00:13:58.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec166140 con 0x7f3fec0be7e0 2023-08-17T00:13:58.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3feb59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec144e40 con 0x7f3fec0bebc0 2023-08-17T00:13:58.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3fead9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 0x7f3fec155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3fea59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec0be7e0 0x7f3fec152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3fe9d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec0bebc0 0x7f3fec152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3fead9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 0x7f3fec155370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58062/0 (socket says 172.21.15.153:58062) 2023-08-17T00:13:58.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.799+0000 7f3fead9d700 1 -- 172.21.15.153:0/2949180659 learned_addr learned my addr 172.21.15.153:0/2949180659 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:13:58.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fea59c700 1 -- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec0bebc0 msgr2=0x7f3fec152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fea59c700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec0bebc0 0x7f3fec152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fea59c700 1 -- 172.21.15.153:0/2949180659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 msgr2=0x7f3fec155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fea59c700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 0x7f3fec155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fea59c700 1 -- 172.21.15.153:0/2949180659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009a20 con 0x7f3fec0be7e0 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fead9d700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 0x7f3fec155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fea59c700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec0be7e0 0x7f3fec152010 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3fdc00c410 tx=0x7f3fdc007b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0070d0 con 0x7f3fec0be7e0 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc007230 con 0x7f3fec0be7e0 2023-08-17T00:13:58.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec155f50 con 0x7f3fec0be7e0 2023-08-17T00:13:58.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0075b0 con 0x7f3fec0be7e0 2023-08-17T00:13:58.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec1567f0 con 0x7f3fec0be7e0 2023-08-17T00:13:58.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec06b4c0 con 0x7f3fec0be7e0 2023-08-17T00:13:58.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.803+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3fdc010070 con 0x7f3fec0be7e0 2023-08-17T00:13:58.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.807+0000 7f3fda7fc700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fcc05a150 0x7f3fcc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:13:58.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.807+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f3fdc0736f0 con 0x7f3fec0be7e0 2023-08-17T00:13:58.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.807+0000 7f3fe9d9b700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fcc05a150 0x7f3fcc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:13:58.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.807+0000 7f3fe9d9b700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fcc05a150 0x7f3fcc05c610 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f3fec0ab1e0 tx=0x7f3fe0007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:13:58.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:58.815+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3fdc047000 con 0x7f3fec0be7e0 2023-08-17T00:13:59.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.035+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3fec06a3b0 con 0x7f3fec0be7e0 2023-08-17T00:13:59.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.035+0000 7f3fda7fc700 1 -- 172.21.15.153:0/2949180659 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1636 (secure 0 0 0) 0x7f3fdc04a620 con 0x7f3fec0be7e0 2023-08-17T00:13:59.044 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:13:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":686,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1045,"data_bytes":1074512744,"bytes_used":4659929088,"bytes_avail":768434184192,"bytes_total":773094113280,"write_bytes_sec":28790206,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":109,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2023-08-17T00:13:57.428085+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:13:59.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.039+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fcc05a150 msgr2=0x7f3fcc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.039+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fcc05a150 0x7f3fcc05c610 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f3fec0ab1e0 tx=0x7f3fe0007bd0).stop 2023-08-17T00:13:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.039+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec0be7e0 msgr2=0x7f3fec152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:13:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.039+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec0be7e0 0x7f3fec152010 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f3fdc00c410 tx=0x7f3fdc007b90).stop 2023-08-17T00:13:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 shutdown_connections 2023-08-17T00:13:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3fcc05a150 0x7f3fcc05c610 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:59.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3fec151a80 0x7f3fec155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:59.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3fec0bebc0 0x7f3fec152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:59.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 --2- 172.21.15.153:0/2949180659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3fec0be7e0 0x7f3fec152010 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:13:59.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 >> 172.21.15.153:0/2949180659 conn(0x7f3fec0c5170 msgr2=0x7f3fec0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:13:59.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 shutdown_connections 2023-08-17T00:13:59.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:13:59.043+0000 7f3feb59e700 1 -- 172.21.15.153:0/2949180659 wait complete. 2023-08-17T00:13:59.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'active paths [/scrub_control_test_path]'} 2023-08-17T00:14:00.071 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:00.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.219+0000 7fcd061db700 1 Processor -- start 2023-08-17T00:14:00.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.219+0000 7fcd061db700 1 -- start start 2023-08-17T00:14:00.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.219+0000 7fcd061db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd00151b90 0x7fcd00151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd00061fa0 con 0x7fcd00064870 2023-08-17T00:14:00.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd000621f0 con 0x7fcd00063290 2023-08-17T00:14:00.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd000c3fb0 con 0x7fcd00151b90 2023-08-17T00:14:00.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcd00064870 0x7fcd000a9ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38052/0 (socket says 172.21.15.153:38052) 2023-08-17T00:14:00.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccff7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcd00151b90 0x7fcd00151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfffff700 1 -- 172.21.15.153:0/1206755338 learned_addr learned my addr 172.21.15.153:0/1206755338 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:00.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfeffd700 1 -- 172.21.15.153:0/1206755338 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617984461 0 0) 0x7fcd00061fa0 con 0x7fcd00064870 2023-08-17T00:14:00.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfeffd700 1 -- 172.21.15.153:0/1206755338 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce00033f0 con 0x7fcd00064870 2023-08-17T00:14:00.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccff7fe700 1 -- 172.21.15.153:0/1206755338 >> v1:172.21.15.178:6789/0 conn(0x7fcd00063290 legacy=0x7fcd00065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccff7fe700 1 -- 172.21.15.153:0/1206755338 >> v1:172.21.15.153:6789/0 conn(0x7fcd00064870 legacy=0x7fcd000a9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccff7fe700 1 -- 172.21.15.153:0/1206755338 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000624d0 con 0x7fcd00151b90 2023-08-17T00:14:00.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccff7fe700 1 --2- 172.21.15.153:0/1206755338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00151b90 0x7fcd00151f70 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fccf0009760 tx=0x7fccf0009060).ready entity=mon.0 client_cookie=c7597c9b6aa4f46c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:00.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfeffd700 1 -- 172.21.15.153:0/1206755338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000f510 con 0x7fcd00151b90 2023-08-17T00:14:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfeffd700 1 -- 172.21.15.153:0/1206755338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000f670 con 0x7fcd00151b90 2023-08-17T00:14:00.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fccfeffd700 1 -- 172.21.15.153:0/1206755338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000f9f0 con 0x7fcd00151b90 2023-08-17T00:14:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- 172.21.15.153:0/1206755338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00151b90 msgr2=0x7fcd00151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 --2- 172.21.15.153:0/1206755338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00151b90 0x7fcd00151f70 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fccf0009760 tx=0x7fccf0009060).stop 2023-08-17T00:14:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- 172.21.15.153:0/1206755338 shutdown_connections 2023-08-17T00:14:00.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 --2- 172.21.15.153:0/1206755338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00151b90 0x7fcd00151f70 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- 172.21.15.153:0/1206755338 >> 172.21.15.153:0/1206755338 conn(0x7fcd000c7150 msgr2=0x7fcd000c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- 172.21.15.153:0/1206755338 shutdown_connections 2023-08-17T00:14:00.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.223+0000 7fcd061db700 1 -- 172.21.15.153:0/1206755338 wait complete. 2023-08-17T00:14:00.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.227+0000 7fcd061db700 1 Processor -- start 2023-08-17T00:14:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.227+0000 7fcd061db700 1 -- start start 2023-08-17T00:14:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 0x7fcd0014e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd00064870 0x7fcd000a4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd00151b90 0x7fcd001537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00153350 con 0x7fcd00063290 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00152740 con 0x7fcd00064870 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00152a20 con 0x7fcd00151b90 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 0x7fcd0014e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 0x7fcd0014e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58068/0 (socket says 172.21.15.153:58068) 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 -- 172.21.15.153:0/3058044639 learned_addr learned my addr 172.21.15.153:0/3058044639 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccf6ffd700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd00064870 0x7fcd000a4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccfffff700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd00151b90 0x7fcd001537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 -- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd00151b90 msgr2=0x7fcd001537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd00151b90 0x7fcd001537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 -- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd00064870 msgr2=0x7fcd000a4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd00064870 0x7fcd000a4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 -- 172.21.15.153:0/3058044639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00092a0 con 0x7fcd00063290 2023-08-17T00:14:00.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccf6ffd700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd00064870 0x7fcd000a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccff7fe700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 0x7fcd0014e750 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fccf0009e00 tx=0x7fccf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000f7e0 con 0x7fcd00063290 2023-08-17T00:14:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000f940 con 0x7fcd00063290 2023-08-17T00:14:00.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf001b660 con 0x7fcd00063290 2023-08-17T00:14:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd00152d00 con 0x7fcd00063290 2023-08-17T00:14:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.231+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0014ec40 con 0x7fcd00063290 2023-08-17T00:14:00.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.235+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0006b530 con 0x7fcd00063290 2023-08-17T00:14:00.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.235+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fccf002b070 con 0x7fcd00063290 2023-08-17T00:14:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.235+0000 7fccf7fff700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcce405a150 0x7fcce405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.235+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fccf0075a50 con 0x7fcd00063290 2023-08-17T00:14:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.235+0000 7fccf6ffd700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcce405a150 0x7fcce405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.239+0000 7fccf6ffd700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcce405a150 0x7fcce405c610 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fcd000a55b0 tx=0x7fcce8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:00.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.243+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fccf0049410 con 0x7fcd00063290 2023-08-17T00:14:00.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.435+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd000c3ab0 con 0x7fcd00063290 2023-08-17T00:14:00.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.439+0000 7fccf7fff700 1 -- 172.21.15.153:0/3058044639 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7fccf0029020 con 0x7fcd00063290 2023-08-17T00:14:00.446 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:00.446 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcce405a150 msgr2=0x7fcce405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcce405a150 0x7fcce405c610 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fcd000a55b0 tx=0x7fcce8009040).stop 2023-08-17T00:14:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 msgr2=0x7fcd0014e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 0x7fcd0014e750 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 rx=0x7fccf0009e00 tx=0x7fccf0017000).stop 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 shutdown_connections 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcce405a150 0x7fcce405c610 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd00151b90 0x7fcd001537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd00064870 0x7fcd000a4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 --2- 172.21.15.153:0/3058044639 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd00063290 0x7fcd0014e750 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 >> 172.21.15.153:0/3058044639 conn(0x7fcd000c7150 msgr2=0x7fcd000655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 shutdown_connections 2023-08-17T00:14:00.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.443+0000 7fcd061db700 1 -- 172.21.15.153:0/3058044639 wait complete. 2023-08-17T00:14:00.452 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:14:00.469 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:14:00.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:14:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.615+0000 7fa92a679700 1 Processor -- start 2023-08-17T00:14:00.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.615+0000 7fa92a679700 1 -- start start 2023-08-17T00:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa92a679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa9240c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa92a679700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa924068820 0x7fa924068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa92a679700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9241585a0 con 0x7fa924061fa0 2023-08-17T00:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa92a679700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa924066400 con 0x7fa924068820 2023-08-17T00:14:00.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa92a679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa924069170 con 0x7fa9240a8df0 2023-08-17T00:14:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa928e76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa924068820 0x7fa924068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa928e76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa924068820 0x7fa924068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58082/0 (socket says 172.21.15.153:58082) 2023-08-17T00:14:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa928e76700 1 -- 172.21.15.153:0/1904150303 learned_addr learned my addr 172.21.15.153:0/1904150303 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa929677700 1 --2- 172.21.15.153:0/1904150303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa9240c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa928e76700 1 -- 172.21.15.153:0/1904150303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 msgr2=0x7fa9240c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.619+0000 7fa928e76700 1 --2- 172.21.15.153:0/1904150303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa9240c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa928e76700 1 -- 172.21.15.153:0/1904150303 >> v1:172.21.15.178:6789/0 conn(0x7fa924061fa0 legacy=0x7fa924062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa928e76700 1 -- 172.21.15.153:0/1904150303 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240b9d30 con 0x7fa924068820 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa928e76700 1 --2- 172.21.15.153:0/1904150303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa924068c80 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fa914006fd0 tx=0x7fa9140090f0).ready entity=mon.0 client_cookie=52072ec16304321 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa91bfff700 1 -- 172.21.15.153:0/1904150303 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400b580 con 0x7fa924068820 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa91bfff700 1 -- 172.21.15.153:0/1904150303 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400b6e0 con 0x7fa924068820 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa91bfff700 1 -- 172.21.15.153:0/1904150303 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400ba60 con 0x7fa924068820 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 -- 172.21.15.153:0/1904150303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 msgr2=0x7fa924068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 --2- 172.21.15.153:0/1904150303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa924068c80 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fa914006fd0 tx=0x7fa9140090f0).stop 2023-08-17T00:14:00.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 -- 172.21.15.153:0/1904150303 shutdown_connections 2023-08-17T00:14:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 --2- 172.21.15.153:0/1904150303 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa924068c80 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 --2- 172.21.15.153:0/1904150303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa9240c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 -- 172.21.15.153:0/1904150303 >> 172.21.15.153:0/1904150303 conn(0x7fa9240c6620 msgr2=0x7fa9240c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 -- 172.21.15.153:0/1904150303 shutdown_connections 2023-08-17T00:14:00.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.623+0000 7fa92a679700 1 -- 172.21.15.153:0/1904150303 wait complete. 2023-08-17T00:14:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 Processor -- start 2023-08-17T00:14:00.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 -- start start 2023-08-17T00:14:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa924061fa0 0x7fa9240bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa92415a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa924169540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240bcb50 con 0x7fa924068820 2023-08-17T00:14:00.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924159880 con 0x7fa924061fa0 2023-08-17T00:14:00.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa924159b60 con 0x7fa9240a8df0 2023-08-17T00:14:00.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa92415a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa92415a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58086/0 (socket says 172.21.15.153:58086) 2023-08-17T00:14:00.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 -- 172.21.15.153:0/3250567041 learned_addr learned my addr 172.21.15.153:0/3250567041 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 -- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 msgr2=0x7fa924169540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa924169540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 -- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa924061fa0 msgr2=0x7fa9240bc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa929677700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa924061fa0 0x7fa9240bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa924061fa0 0x7fa9240bc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 -- 172.21.15.153:0/3250567041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914009370 con 0x7fa924068820 2023-08-17T00:14:00.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa928e76700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa92415a360 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fa914009fd0 tx=0x7fa914017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400b850 con 0x7fa924068820 2023-08-17T00:14:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400b9b0 con 0x7fa924068820 2023-08-17T00:14:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa924159e40 con 0x7fa924068820 2023-08-17T00:14:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91401b660 con 0x7fa924068820 2023-08-17T00:14:00.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.627+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa924169a30 con 0x7fa924068820 2023-08-17T00:14:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.631+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92406b4c0 con 0x7fa924068820 2023-08-17T00:14:00.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.631+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa91402b070 con 0x7fa924068820 2023-08-17T00:14:00.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.631+0000 7fa9197fa700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa90805a180 0x7fa90805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.635+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fa914075aa0 con 0x7fa924068820 2023-08-17T00:14:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.635+0000 7fa929677700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa90805a180 0x7fa90805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.635+0000 7fa929677700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa90805a180 0x7fa90805c640 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fa920009fd0 tx=0x7fa92000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.639+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9140493b0 con 0x7fa924068820 2023-08-17T00:14:00.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.855+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa924064010 con 0x7fa924068820 2023-08-17T00:14:00.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.855+0000 7fa9197fa700 1 -- 172.21.15.153:0/3250567041 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1636 (secure 0 0 0) 0x7fa914029020 con 0x7fa924068820 2023-08-17T00:14:00.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:00.863 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":688,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075839082,"bytes_used":4676214784,"bytes_avail":768417898496,"bytes_total":773094113280,"write_bytes_sec":28904451,"read_op_per_sec":0,"write_op_per_sec":28},"fsmap":{"epoch":109,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2023-08-17T00:13:57.428085+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"active paths [/scrub_control_test_path]"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:14:00.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa90805a180 msgr2=0x7fa90805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa90805a180 0x7fa90805c640 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fa920009fd0 tx=0x7fa92000b040).stop 2023-08-17T00:14:00.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 msgr2=0x7fa92415a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:00.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa92415a360 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fa914009fd0 tx=0x7fa914017000).stop 2023-08-17T00:14:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 shutdown_connections 2023-08-17T00:14:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa90805a180 0x7fa90805c640 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9240a8df0 0x7fa924169540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa924068820 0x7fa92415a360 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 --2- 172.21.15.153:0/3250567041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa924061fa0 0x7fa9240bc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:00.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 >> 172.21.15.153:0/3250567041 conn(0x7fa9240c6620 msgr2=0x7fa924157ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:00.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 shutdown_connections 2023-08-17T00:14:00.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:00.859+0000 7fa92a679700 1 -- 172.21.15.153:0/3250567041 wait complete. 2023-08-17T00:14:00.885 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'active paths [/scrub_control_test_path]'} 2023-08-17T00:14:01.886 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:02.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.039+0000 7f2cf1e5b700 1 Processor -- start 2023-08-17T00:14:02.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.039+0000 7f2cf1e5b700 1 -- start start 2023-08-17T00:14:02.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cf1e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cf1e5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2cec065b50 0x7f2cec064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cf1e5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec061fa0 con 0x7f2cec151b90 2023-08-17T00:14:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cf1e5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0c3fb0 con 0x7f2cec065b50 2023-08-17T00:14:02.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cf1e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1523d0 con 0x7f2cec151f70 2023-08-17T00:14:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceb7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2cec151b90 0x7f2cec063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38054/0 (socket says 172.21.15.153:38054) 2023-08-17T00:14:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceb7fe700 1 -- 172.21.15.153:0/517284119 learned_addr learned my addr 172.21.15.153:0/517284119 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceaffd700 1 --2- 172.21.15.153:0/517284119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cebfff700 1 --2- 172.21.15.153:0/517284119 >> v2:172.21.15.178:3300/0 conn(0x7f2cec065b50 0x7f2cec064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cea7fc700 1 -- 172.21.15.153:0/517284119 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2866000085 0 0) 0x7f2cec061fa0 con 0x7f2cec151b90 2023-08-17T00:14:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cea7fc700 1 -- 172.21.15.153:0/517284119 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd40033f0 con 0x7f2cec151b90 2023-08-17T00:14:02.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceaffd700 1 -- 172.21.15.153:0/517284119 >> v2:172.21.15.178:3300/0 conn(0x7f2cec065b50 msgr2=0x7f2cec064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceaffd700 1 --2- 172.21.15.153:0/517284119 >> v2:172.21.15.178:3300/0 conn(0x7f2cec065b50 0x7f2cec064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceaffd700 1 -- 172.21.15.153:0/517284119 >> v1:172.21.15.153:6789/0 conn(0x7f2cec151b90 legacy=0x7f2cec063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceaffd700 1 -- 172.21.15.153:0/517284119 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0621f0 con 0x7f2cec151f70 2023-08-17T00:14:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cebfff700 1 --2- 172.21.15.153:0/517284119 >> v2:172.21.15.178:3300/0 conn(0x7f2cec065b50 0x7f2cec064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:02.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2ceaffd700 1 --2- 172.21.15.153:0/517284119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec065660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2ce0009760 tx=0x7f2ce0009060).ready entity=mon.2 client_cookie=b989450b6005a354 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:02.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cea7fc700 1 -- 172.21.15.153:0/517284119 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00090d0 con 0x7f2cec151f70 2023-08-17T00:14:02.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cea7fc700 1 -- 172.21.15.153:0/517284119 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce000d4a0 con 0x7f2cec151f70 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.043+0000 7f2cea7fc700 1 -- 172.21.15.153:0/517284119 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000d820 con 0x7f2cec151f70 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/517284119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 msgr2=0x7f2cec065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/517284119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec065660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f2ce0009760 tx=0x7f2ce0009060).stop 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/517284119 shutdown_connections 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/517284119 >> v2:172.21.15.178:3300/0 conn(0x7f2cec065b50 0x7f2cec064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/517284119 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec065660 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/517284119 >> 172.21.15.153:0/517284119 conn(0x7f2cec0c7150 msgr2=0x7f2cec0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:02.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/517284119 shutdown_connections 2023-08-17T00:14:02.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/517284119 wait complete. 2023-08-17T00:14:02.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 Processor -- start 2023-08-17T00:14:02.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 -- start start 2023-08-17T00:14:02.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec065b50 0x7f2cec14f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 0x7f2cec1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.047+0000 7f2cf1e5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec0c0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cf1e5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec154b40 con 0x7f2cec151b90 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cf1e5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec153620 con 0x7f2cec065b50 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cf1e5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec14fbf0 con 0x7f2cec151f70 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 0x7f2cec1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 0x7f2cec1422c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58102/0 (socket says 172.21.15.153:58102) 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 -- 172.21.15.153:0/3490396014 learned_addr learned my addr 172.21.15.153:0/3490396014 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:02.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceb7fe700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec065b50 0x7f2cec14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cebfff700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec0c0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 -- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 msgr2=0x7f2cec0c0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec0c0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 -- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec065b50 msgr2=0x7f2cec14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec065b50 0x7f2cec14f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 -- 172.21.15.153:0/3490396014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009a20 con 0x7f2cec151b90 2023-08-17T00:14:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2ceaffd700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 0x7f2cec1422c0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f2cec152510 tx=0x7f2ce0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:02.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0012920 con 0x7f2cec151b90 2023-08-17T00:14:02.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0012a80 con 0x7f2cec151b90 2023-08-17T00:14:02.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce00092a0 con 0x7f2cec151b90 2023-08-17T00:14:02.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0012e20 con 0x7f2cec151b90 2023-08-17T00:14:02.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec153340 con 0x7f2cec151b90 2023-08-17T00:14:02.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.051+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec1507d0 con 0x7f2cec151b90 2023-08-17T00:14:02.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.055+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2ce000f070 con 0x7f2cec151b90 2023-08-17T00:14:02.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.055+0000 7f2cd37fe700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2cd805a150 0x7f2cd805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.055+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f2ce00754c0 con 0x7f2cec151b90 2023-08-17T00:14:02.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.055+0000 7f2ceb7fe700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2cd805a150 0x7f2cd805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.059+0000 7f2ceb7fe700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2cd805a150 0x7f2cd805c610 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f2cdc005750 tx=0x7f2cdc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:02.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.063+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2ce0048ee0 con 0x7f2cec151b90 2023-08-17T00:14:02.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.251+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2cec0624d0 con 0x7f2cec151b90 2023-08-17T00:14:02.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.251+0000 7f2cd37fe700 1 -- 172.21.15.153:0/3490396014 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f2ce004c500 con 0x7f2cec151b90 2023-08-17T00:14:02.260 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:02.261 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:02.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2cd805a150 msgr2=0x7f2cd805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2cd805a150 0x7f2cd805c610 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f2cdc005750 tx=0x7f2cdc009040).stop 2023-08-17T00:14:02.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 msgr2=0x7f2cec1422c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 0x7f2cec1422c0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f2cec152510 tx=0x7f2ce0016000).stop 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 shutdown_connections 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2cd805a150 0x7f2cd805c610 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cec151f70 0x7f2cec0c0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2cec151b90 0x7f2cec1422c0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 --2- 172.21.15.153:0/3490396014 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cec065b50 0x7f2cec14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 >> 172.21.15.153:0/3490396014 conn(0x7f2cec0c7150 msgr2=0x7f2cec14eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:02.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 shutdown_connections 2023-08-17T00:14:02.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.255+0000 7f2cf1e5b700 1 -- 172.21.15.153:0/3490396014 wait complete. 2023-08-17T00:14:02.265 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:14:02.281 DEBUG:tasks.cephfs.test_scrub_checks:current active=['b'] 2023-08-17T00:14:02.281 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:14:02.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.439+0000 7f120341b700 1 Processor -- start 2023-08-17T00:14:02.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.439+0000 7f120341b700 1 -- start start 2023-08-17T00:14:02.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f120341b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11fc0c47d0 0x7f11fc15e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f120341b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0c6150 con 0x7f11fc153bb0 2023-08-17T00:14:02.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f120341b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11fc0c3330 con 0x7f11fc063fd0 2023-08-17T00:14:02.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f120341b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11fc0677b0 con 0x7f11fc0c47d0 2023-08-17T00:14:02.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12011b7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f11fc153bb0 0x7f11fc066990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38066/0 (socket says 172.21.15.153:38066) 2023-08-17T00:14:02.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12011b7700 1 -- 172.21.15.153:0/3159380811 learned_addr learned my addr 172.21.15.153:0/3159380811 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:02.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 --2- 172.21.15.153:0/3159380811 >> v2:172.21.15.178:3300/0 conn(0x7f11fc0c47d0 0x7f11fc15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986807129 0 0) 0x7f11fc0c6150 con 0x7f11fc153bb0 2023-08-17T00:14:02.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e80033f0 con 0x7f11fc153bb0 2023-08-17T00:14:02.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376739901 0 0) 0x7f11fc0c3330 con 0x7f11fc063fd0 2023-08-17T00:14:02.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11fc0c6150 con 0x7f11fc063fd0 2023-08-17T00:14:02.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700137511 0 0) 0x7f11e80033f0 con 0x7f11fc153bb0 2023-08-17T00:14:02.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 >> v2:172.21.15.178:3300/0 conn(0x7f11fc0c47d0 msgr2=0x7f11fc15e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:02.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 --2- 172.21.15.153:0/3159380811 >> v2:172.21.15.178:3300/0 conn(0x7f11fc0c47d0 0x7f11fc15e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 >> v1:172.21.15.178:6789/0 conn(0x7f11fc063fd0 legacy=0x7f11fc0670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc0be7d0 con 0x7f11fc153bb0 2023-08-17T00:14:02.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f11f80017f0 con 0x7f11fc153bb0 2023-08-17T00:14:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 >> v1:172.21.15.153:6789/0 conn(0x7f11fc153bb0 legacy=0x7f11fc066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8003a70 0x7f11e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11e8004690 0x7f11e8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e8005000 0x7f11e800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc0677b0 con 0x7f11e8005000 2023-08-17T00:14:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e800bf60 con 0x7f11e8003a70 2023-08-17T00:14:02.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e800c0d0 con 0x7f11e8004690 2023-08-17T00:14:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e8005000 0x7f11e800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12009b6700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11e8004690 0x7f11e8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 -- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11e8004690 msgr2=0x7f11e8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:02.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11e8004690 0x7f11e8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 -- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8003a70 msgr2=0x7f11e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:02.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12011b7700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8003a70 0x7f11e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8003a70 0x7f11e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 -- 172.21.15.153:0/3159380811 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80033f0 con 0x7f11e8005000 2023-08-17T00:14:02.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12011b7700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8003a70 0x7f11e8003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:02.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 -- 172.21.15.153:0/3159380811 reap_dead start 2023-08-17T00:14:02.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f12019b8700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e8005000 0x7f11e800b8e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f11f4009a80 tx=0x7f11f4009060).ready entity=mon.0 client_cookie=7fa50611d7d0c261 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:02.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.443+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4009430 con 0x7f11e8005000 2023-08-17T00:14:02.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f400e640 con 0x7f11e8005000 2023-08-17T00:14:02.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f11f3fff700 1 -- 172.21.15.153:0/3159380811 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f400ea00 con 0x7f11e8005000 2023-08-17T00:14:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- 172.21.15.153:0/3159380811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e8005000 msgr2=0x7f11e800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e8005000 0x7f11e800b8e0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 rx=0x7f11f4009a80 tx=0x7f11f4009060).stop 2023-08-17T00:14:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- 172.21.15.153:0/3159380811 shutdown_connections 2023-08-17T00:14:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 --2- 172.21.15.153:0/3159380811 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11e8005000 0x7f11e800b8e0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- 172.21.15.153:0/3159380811 >> 172.21.15.153:0/3159380811 conn(0x7f11fc0c92e0 msgr2=0x7f11fc0c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- 172.21.15.153:0/3159380811 shutdown_connections 2023-08-17T00:14:02.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- 172.21.15.153:0/3159380811 wait complete. 2023-08-17T00:14:02.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 Processor -- start 2023-08-17T00:14:02.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- start start 2023-08-17T00:14:02.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 0x7f11fc0c23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11fc1642f0 0x7f11fc150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11fc150a00 0x7f11fc0c3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc14fd50 con 0x7f11fc1642f0 2023-08-17T00:14:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc164cb0 con 0x7f11e8005000 2023-08-17T00:14:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.447+0000 7f120341b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11fc164f90 con 0x7f11fc150a00 2023-08-17T00:14:02.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12011b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 0x7f11fc0c23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11fc1642f0 0x7f11fc150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12011b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 0x7f11fc0c23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:52974/0 (socket says 172.21.15.153:52974) 2023-08-17T00:14:02.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12011b7700 1 -- 172.21.15.153:0/3106634096 learned_addr learned my addr 172.21.15.153:0/3106634096 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:02.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12019b8700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11fc150a00 0x7f11fc0c3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 -- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11fc150a00 msgr2=0x7f11fc0c3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11fc150a00 0x7f11fc0c3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 -- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 msgr2=0x7f11fc0c23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 0x7f11fc0c23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 -- 172.21.15.153:0/3106634096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc14fff0 con 0x7f11fc1642f0 2023-08-17T00:14:02.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12011b7700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 0x7f11fc0c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:02.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f12009b6700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11fc1642f0 0x7f11fc150510 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f11ec007cc0 tx=0x7f11ec007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:02.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00f5f0 con 0x7f11fc1642f0 2023-08-17T00:14:02.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11ec00f750 con 0x7f11fc1642f0 2023-08-17T00:14:02.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11fc165270 con 0x7f11fc1642f0 2023-08-17T00:14:02.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00fad0 con 0x7f11fc1642f0 2023-08-17T00:14:02.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11fc164990 con 0x7f11fc1642f0 2023-08-17T00:14:02.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.451+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11fc0a7b80 con 0x7f11fc1642f0 2023-08-17T00:14:02.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.455+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f11ec01b030 con 0x7f11fc1642f0 2023-08-17T00:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.455+0000 7f11f17fa700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f11e005a150 0x7f11e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.455+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f11ec073e70 con 0x7f11fc1642f0 2023-08-17T00:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.455+0000 7f12011b7700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f11e005a150 0x7f11e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:02.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.455+0000 7f12011b7700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f11e005a150 0x7f11e005c610 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f11f8002250 tx=0x7f11f8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:02.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.463+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11fc0a7b80 con 0x7f11fc1642f0 2023-08-17T00:14:02.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.671+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f11fc0a7b80 con 0x7f11fc1642f0 2023-08-17T00:14:02.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.671+0000 7f11f17fa700 1 -- 172.21.15.153:0/3106634096 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7f11fc0a7b80 con 0x7f11fc1642f0 2023-08-17T00:14:02.680 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:02.681 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":690,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":142,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1046,"data_bytes":1075839082,"bytes_used":4676214784,"bytes_avail":768417898496,"bytes_total":773094113280,"write_bytes_sec":14031442,"read_op_per_sec":0,"write_op_per_sec":14},"fsmap":{"epoch":109,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"b","status":"up:active","gid":8463}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2023-08-17T00:14:01.429953+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-08-17T00:14:02.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.675+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f11e005a150 msgr2=0x7f11e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.675+0000 7f120341b700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f11e005a150 0x7f11e005c610 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f11f8002250 tx=0x7f11f8009040).stop 2023-08-17T00:14:02.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.675+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11fc1642f0 msgr2=0x7f11fc150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:02.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.675+0000 7f120341b700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11fc1642f0 0x7f11fc150510 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f11ec007cc0 tx=0x7f11ec007bb0).stop 2023-08-17T00:14:02.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 shutdown_connections 2023-08-17T00:14:02.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f11e005a150 0x7f11e005c610 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11fc150a00 0x7f11fc0c3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11fc1642f0 0x7f11fc150510 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 --2- 172.21.15.153:0/3106634096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11e8005000 0x7f11fc0c23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:02.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 >> 172.21.15.153:0/3106634096 conn(0x7f11fc0c92e0 msgr2=0x7f11fc151360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:02.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 shutdown_connections 2023-08-17T00:14:02.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:02.679+0000 7f120341b700 1 -- 172.21.15.153:0/3106634096 wait complete. 2023-08-17T00:14:02.704 INFO:tasks.cephfs.filesystem.ceph_manager:{'b': 'paused'} 2023-08-17T00:14:02.705 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:14:02.705 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:14:02.730 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:14:02.731 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'c', 'a', 'd'} 2023-08-17T00:14:02.731 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-08-17T00:14:02.899 INFO:teuthology.orchestra.run.smithi153.stdout:{"mds_beacon_grace":"15.000000"} 2023-08-17T00:14:02.900 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-08-17T00:14:02.900 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:03.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.043+0000 7f38994db700 1 Processor -- start 2023-08-17T00:14:03.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.043+0000 7f38994db700 1 -- start start 2023-08-17T00:14:03.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f38994db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 0x7f3894061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f38994db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940c11d0 con 0x7f3894153aa0 2023-08-17T00:14:03.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f38994db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38940c5e80 con 0x7f3894062490 2023-08-17T00:14:03.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f38994db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940628f0 con 0x7f38940cb240 2023-08-17T00:14:03.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3892ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3894153aa0 0x7f38940c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:38072/0 (socket says 172.21.15.153:38072) 2023-08-17T00:14:03.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3892ffd700 1 -- 172.21.15.153:0/451837209 learned_addr learned my addr 172.21.15.153:0/451837209 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:03.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f38927fc700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 0x7f3894061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280837809 0 0) 0x7f38940c11d0 con 0x7f3894153aa0 2023-08-17T00:14:03.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f387c0033f0 con 0x7f3894153aa0 2023-08-17T00:14:03.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439947632 0 0) 0x7f38940c5e80 con 0x7f3894062490 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38940c11d0 con 0x7f3894062490 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3185521661 0 0) 0x7f387c0033f0 con 0x7f3894153aa0 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 msgr2=0x7f3894061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 0x7f3894061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 >> v1:172.21.15.178:6789/0 conn(0x7f3894062490 legacy=0x7f38940aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.047+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940c1660 con 0x7f3894153aa0 2023-08-17T00:14:03.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f3884001470 con 0x7f3894153aa0 2023-08-17T00:14:03.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 >> v1:172.21.15.153:6789/0 conn(0x7f3894153aa0 legacy=0x7f38940c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c003aa0 0x7f387c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c004690 0x7f387c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 0x7f387c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940628f0 con 0x7f387c004690 2023-08-17T00:14:03.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c00b910 con 0x7f387c003aa0 2023-08-17T00:14:03.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c00bad0 con 0x7f38940cb240 2023-08-17T00:14:03.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c004690 0x7f387c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3892ffd700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c003aa0 0x7f387c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38937fe700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 0x7f387c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 -- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 msgr2=0x7f387c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:03.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38940cb240 0x7f387c005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 -- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c003aa0 msgr2=0x7f387c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c003aa0 0x7f387c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 -- 172.21.15.153:0/451837209 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0033f0 con 0x7f387c004690 2023-08-17T00:14:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3892ffd700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387c003aa0 0x7f387c003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:03.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38927fc700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c004690 0x7f387c004b10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f38940cb660 tx=0x7f3888009060).ready entity=mon.0 client_cookie=f3263904d83dd5fe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3888009e90 con 0x7f387c004690 2023-08-17T00:14:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3888009430 con 0x7f387c004690 2023-08-17T00:14:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f3891ffb700 1 -- 172.21.15.153:0/451837209 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388800e850 con 0x7f387c004690 2023-08-17T00:14:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38994db700 1 -- 172.21.15.153:0/451837209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c004690 msgr2=0x7f387c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38994db700 1 --2- 172.21.15.153:0/451837209 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f387c004690 0x7f387c004b10 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7f38940cb660 tx=0x7f3888009060).stop 2023-08-17T00:14:03.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38937fe700 1 -- 172.21.15.153:0/451837209 reap_dead start 2023-08-17T00:14:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38994db700 1 -- 172.21.15.153:0/451837209 shutdown_connections 2023-08-17T00:14:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38994db700 1 -- 172.21.15.153:0/451837209 >> 172.21.15.153:0/451837209 conn(0x7f38940640b0 msgr2=0x7f38940ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38994db700 1 -- 172.21.15.153:0/451837209 shutdown_connections 2023-08-17T00:14:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.051+0000 7f38994db700 1 -- 172.21.15.153:0/451837209 wait complete. 2023-08-17T00:14:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 Processor -- start 2023-08-17T00:14:03.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 -- start start 2023-08-17T00:14:03.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f387c004690 0x7f38940af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 0x7f38941504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38941509c0 0x7f3894155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940c1930 con 0x7f3894164df0 2023-08-17T00:14:03.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38940afbc0 con 0x7f38941509c0 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38994db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38940c1b40 con 0x7f387c004690 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 0x7f38941504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 0x7f38941504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:58118/0 (socket says 172.21.15.153:58118) 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 -- 172.21.15.153:0/805175215 learned_addr learned my addr 172.21.15.153:0/805175215 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f3892ffd700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f387c004690 0x7f38940af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38937fe700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38941509c0 0x7f3894155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 -- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f387c004690 msgr2=0x7f38940af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f387c004690 0x7f38940af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 -- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38941509c0 msgr2=0x7f3894155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38941509c0 0x7f3894155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38927fc700 1 -- 172.21.15.153:0/805175215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38940c1e20 con 0x7f3894164df0 2023-08-17T00:14:03.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.055+0000 7f38937fe700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38941509c0 0x7f3894155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:03.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f38927fc700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 0x7f38941504d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f388800e4b0 tx=0x7f388801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:03.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388801da80 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388801dbe0 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38940c2100 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388801b450 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3894156210 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f389406b4c0 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.059+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f388801b840 con 0x7f3894164df0 2023-08-17T00:14:03.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.063+0000 7f387affd700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f388005a150 0x7f388005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:03.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.063+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f3888075e60 con 0x7f3894164df0 2023-08-17T00:14:03.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.063+0000 7f3892ffd700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f388005a150 0x7f388005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:03.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.063+0000 7f3892ffd700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f388005a150 0x7f388005c610 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f3884000e10 tx=0x7f3884009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:03.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.067+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3888049770 con 0x7f3894164df0 2023-08-17T00:14:03.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.259+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f389406a210 con 0x7f3894164df0 2023-08-17T00:14:03.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.259+0000 7f387affd700 1 -- 172.21.15.153:0/805175215 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f3888016030 con 0x7f3894164df0 2023-08-17T00:14:03.267 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:03.268 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:03.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f388005a150 msgr2=0x7f388005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f388005a150 0x7f388005c610 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f3884000e10 tx=0x7f3884009040).stop 2023-08-17T00:14:03.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 msgr2=0x7f38941504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 0x7f38941504d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 rx=0x7f388800e4b0 tx=0x7f388801a000).stop 2023-08-17T00:14:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 shutdown_connections 2023-08-17T00:14:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f388005a150 0x7f388005c610 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38941509c0 0x7f3894155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3894164df0 0x7f38941504d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 --2- 172.21.15.153:0/805175215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f387c004690 0x7f38940af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:03.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 >> 172.21.15.153:0/805175215 conn(0x7f38940640b0 msgr2=0x7f38940ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:03.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 shutdown_connections 2023-08-17T00:14:03.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:03.263+0000 7f38994db700 1 -- 172.21.15.153:0/805175215 wait complete. 2023-08-17T00:14:03.272 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:14:03.291 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-08-17T00:14:08.292 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.455+0000 7f6d11d69700 1 Processor -- start 2023-08-17T00:14:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.455+0000 7f6d11d69700 1 -- start start 2023-08-17T00:14:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d11d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c0bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d11d69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6d0c1503d0 0x7f6d0c0bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d11d69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c0a9170 con 0x7f6d0c14fff0 2023-08-17T00:14:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d11d69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c0bcfd0 con 0x7f6d0c1503d0 2023-08-17T00:14:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d11d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0c1b90 con 0x7f6d0c153da0 2023-08-17T00:14:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d0b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6d0c14fff0 0x7f6d0c062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:33744/0 (socket says 172.21.15.153:33744) 2023-08-17T00:14:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d0b7fe700 1 -- 172.21.15.153:0/2116286974 learned_addr learned my addr 172.21.15.153:0/2116286974 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d0affd700 1 --2- 172.21.15.153:0/2116286974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c0bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d0bfff700 1 --2- 172.21.15.153:0/2116286974 >> v2:172.21.15.178:3300/0 conn(0x7f6d0c1503d0 0x7f6d0c0bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.459+0000 7f6d0a7fc700 1 -- 172.21.15.153:0/2116286974 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257197844 0 0) 0x7f6d0c0a9170 con 0x7f6d0c14fff0 2023-08-17T00:14:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0a7fc700 1 -- 172.21.15.153:0/2116286974 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cf40033f0 con 0x7f6d0c14fff0 2023-08-17T00:14:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0affd700 1 -- 172.21.15.153:0/2116286974 >> v2:172.21.15.178:3300/0 conn(0x7f6d0c1503d0 msgr2=0x7f6d0c0bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0affd700 1 --2- 172.21.15.153:0/2116286974 >> v2:172.21.15.178:3300/0 conn(0x7f6d0c1503d0 0x7f6d0c0bbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0affd700 1 -- 172.21.15.153:0/2116286974 >> v1:172.21.15.153:6789/0 conn(0x7f6d0c14fff0 legacy=0x7f6d0c062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0affd700 1 -- 172.21.15.153:0/2116286974 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c154280 con 0x7f6d0c153da0 2023-08-17T00:14:08.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0affd700 1 --2- 172.21.15.153:0/2116286974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c0bb5e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6d00009760 tx=0x7f6d00009060).ready entity=mon.2 client_cookie=755a119f830f7739 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:08.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0a7fc700 1 -- 172.21.15.153:0/2116286974 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000090d0 con 0x7f6d0c153da0 2023-08-17T00:14:08.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0a7fc700 1 -- 172.21.15.153:0/2116286974 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000d4a0 con 0x7f6d0c153da0 2023-08-17T00:14:08.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d0a7fc700 1 -- 172.21.15.153:0/2116286974 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000d820 con 0x7f6d0c153da0 2023-08-17T00:14:08.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 -- 172.21.15.153:0/2116286974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 msgr2=0x7f6d0c0bb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:08.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2116286974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c0bb5e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f6d00009760 tx=0x7f6d00009060).stop 2023-08-17T00:14:08.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 -- 172.21.15.153:0/2116286974 shutdown_connections 2023-08-17T00:14:08.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2116286974 >> v2:172.21.15.178:3300/0 conn(0x7f6d0c1503d0 0x7f6d0c0bbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2116286974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c0bb5e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 -- 172.21.15.153:0/2116286974 >> 172.21.15.153:0/2116286974 conn(0x7f6d0c0c7150 msgr2=0x7f6d0c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 -- 172.21.15.153:0/2116286974 shutdown_connections 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.463+0000 7f6d11d69700 1 -- 172.21.15.153:0/2116286974 wait complete. 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 Processor -- start 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 -- start start 2023-08-17T00:14:08.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d0c14fff0 0x7f6d0c14c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 0x7f6d0c0a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c168020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0aad80 con 0x7f6d0c1503d0 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0aa170 con 0x7f6d0c14fff0 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d11d69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c0aa450 con 0x7f6d0c153da0 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d0affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 0x7f6d0c0a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d0b7fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d0c14fff0 0x7f6d0c14c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d0affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 0x7f6d0c0a7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35486/0 (socket says 172.21.15.153:35486) 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.467+0000 7f6d0affd700 1 -- 172.21.15.153:0/2819195013 learned_addr learned my addr 172.21.15.153:0/2819195013 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0bfff700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c168020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0b7fe700 1 -- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 msgr2=0x7f6d0c168020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0b7fe700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c168020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0b7fe700 1 -- 172.21.15.153:0/2819195013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 msgr2=0x7f6d0c0a7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:08.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0b7fe700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 0x7f6d0c0a7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0b7fe700 1 -- 172.21.15.153:0/2819195013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d000092a0 con 0x7f6d0c14fff0 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0affd700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 0x7f6d0c0a7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d0b7fe700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d0c14fff0 0x7f6d0c14c170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f6cfc00c410 tx=0x7f6cfc007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc0070d0 con 0x7f6d0c14fff0 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cfc007230 con 0x7f6d0c14fff0 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc0075f0 con 0x7f6d0c14fff0 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c0aa730 con 0x7f6d0c14fff0 2023-08-17T00:14:08.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c14c660 con 0x7f6d0c14fff0 2023-08-17T00:14:08.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.471+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c14c880 con 0x7f6d0c14fff0 2023-08-17T00:14:08.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.475+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6cfc010070 con 0x7f6d0c14fff0 2023-08-17T00:14:08.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.475+0000 7f6cf37fe700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6cf805a180 0x7f6cf805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:08.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.475+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f6cfc073650 con 0x7f6d0c14fff0 2023-08-17T00:14:08.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.475+0000 7f6d0affd700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6cf805a180 0x7f6cf805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:08.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.475+0000 7f6d0affd700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6cf805a180 0x7f6cf805c640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6d00006c00 tx=0x7f6d00016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:08.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.483+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6cfc047010 con 0x7f6d0c14fff0 2023-08-17T00:14:08.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.683+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d0c06b530 con 0x7f6d0c14fff0 2023-08-17T00:14:08.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.683+0000 7f6cf37fe700 1 -- 172.21.15.153:0/2819195013 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7f6cfc04a630 con 0x7f6d0c14fff0 2023-08-17T00:14:08.687 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:08.687 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:08.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6cf805a180 msgr2=0x7f6cf805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6cf805a180 0x7f6cf805c640 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f6d00006c00 tx=0x7f6d00016000).stop 2023-08-17T00:14:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d0c14fff0 msgr2=0x7f6d0c14c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d0c14fff0 0x7f6d0c14c170 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f6cfc00c410 tx=0x7f6cfc007bd0).stop 2023-08-17T00:14:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 shutdown_connections 2023-08-17T00:14:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6cf805a180 0x7f6cf805c640 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d0c153da0 0x7f6d0c168020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6d0c1503d0 0x7f6d0c0a7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 --2- 172.21.15.153:0/2819195013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d0c14fff0 0x7f6d0c14c170 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 >> 172.21.15.153:0/2819195013 conn(0x7f6d0c0c7150 msgr2=0x7f6d0c0c20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 shutdown_connections 2023-08-17T00:14:08.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:08.687+0000 7f6d11d69700 1 -- 172.21.15.153:0/2819195013 wait complete. 2023-08-17T00:14:08.692 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:14:08.711 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-08-17T00:14:13.716 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.871+0000 7fb486af1700 1 Processor -- start 2023-08-17T00:14:13.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb486af1700 1 -- start start 2023-08-17T00:14:13.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb486af1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb480153ab0 0x7fb480153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb486af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800641f0 0x7fb480061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb486af1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800c0330 con 0x7fb4800c59e0 2023-08-17T00:14:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb486af1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4800c0ed0 con 0x7fb480153ab0 2023-08-17T00:14:13.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb486af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800c5e40 con 0x7fb4800641f0 2023-08-17T00:14:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb48488d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb480153ab0 0x7fb480153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb48488d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb480153ab0 0x7fb480153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35492/0 (socket says 172.21.15.153:35492) 2023-08-17T00:14:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.875+0000 7fb48488d700 1 -- 172.21.15.153:0/3638184504 learned_addr learned my addr 172.21.15.153:0/3638184504 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:13.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb48508e700 1 --2- 172.21.15.153:0/3638184504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800641f0 0x7fb480061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb48488d700 1 -- 172.21.15.153:0/3638184504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800641f0 msgr2=0x7fb480061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb48488d700 1 --2- 172.21.15.153:0/3638184504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800641f0 0x7fb480061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb48488d700 1 -- 172.21.15.153:0/3638184504 >> v1:172.21.15.178:6789/0 conn(0x7fb4800c59e0 legacy=0x7fb4800c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:13.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb48488d700 1 -- 172.21.15.153:0/3638184504 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480064660 con 0x7fb480153ab0 2023-08-17T00:14:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb48488d700 1 --2- 172.21.15.153:0/3638184504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480153e90 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fb474006fd0 tx=0x7fb4740090f0).ready entity=mon.0 client_cookie=979f556f5cc927cd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb47f7fe700 1 -- 172.21.15.153:0/3638184504 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400b580 con 0x7fb480153ab0 2023-08-17T00:14:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb47f7fe700 1 -- 172.21.15.153:0/3638184504 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47400b6e0 con 0x7fb480153ab0 2023-08-17T00:14:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb47f7fe700 1 -- 172.21.15.153:0/3638184504 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47400ba80 con 0x7fb480153ab0 2023-08-17T00:14:13.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 -- 172.21.15.153:0/3638184504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 msgr2=0x7fb480153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 --2- 172.21.15.153:0/3638184504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480153e90 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 rx=0x7fb474006fd0 tx=0x7fb4740090f0).stop 2023-08-17T00:14:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 -- 172.21.15.153:0/3638184504 shutdown_connections 2023-08-17T00:14:13.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 --2- 172.21.15.153:0/3638184504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800641f0 0x7fb480061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 --2- 172.21.15.153:0/3638184504 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480153e90 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 -- 172.21.15.153:0/3638184504 >> 172.21.15.153:0/3638184504 conn(0x7fb4800caaa0 msgr2=0x7fb4800caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 -- 172.21.15.153:0/3638184504 shutdown_connections 2023-08-17T00:14:13.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.879+0000 7fb486af1700 1 -- 172.21.15.153:0/3638184504 wait complete. 2023-08-17T00:14:13.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.883+0000 7fb486af1700 1 Processor -- start 2023-08-17T00:14:13.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.883+0000 7fb486af1700 1 -- start start 2023-08-17T00:14:13.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4800641f0 0x7fb480166b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:13.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800c59e0 0x7fb480063630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:13.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480063b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:13.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480064010 con 0x7fb480153ab0 2023-08-17T00:14:13.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480150510 con 0x7fb4800641f0 2023-08-17T00:14:13.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480167080 con 0x7fb4800c59e0 2023-08-17T00:14:13.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:13.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480063b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:35500/0 (socket says 172.21.15.153:35500) 2023-08-17T00:14:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 -- 172.21.15.153:0/82116796 learned_addr learned my addr 172.21.15.153:0/82116796 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48488d700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4800641f0 0x7fb480166b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb47ffff700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800c59e0 0x7fb480063630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 -- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800c59e0 msgr2=0x7fb480063630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800c59e0 0x7fb480063630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:13.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 -- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4800641f0 msgr2=0x7fb480166b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4800641f0 0x7fb480166b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 -- 172.21.15.153:0/82116796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474009370 con 0x7fb480153ab0 2023-08-17T00:14:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48488d700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4800641f0 0x7fb480166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:13.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb48508e700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480063b20 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fb478009ec0 tx=0x7fb47800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800cb70 con 0x7fb480153ab0 2023-08-17T00:14:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800f040 con 0x7fb480153ab0 2023-08-17T00:14:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48014f900 con 0x7fb480153ab0 2023-08-17T00:14:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800cee0 con 0x7fb480153ab0 2023-08-17T00:14:13.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.887+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48014fec0 con 0x7fb480153ab0 2023-08-17T00:14:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.891+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48006b530 con 0x7fb480153ab0 2023-08-17T00:14:13.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.891+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb478013610 con 0x7fb480153ab0 2023-08-17T00:14:13.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.891+0000 7fb47cff9700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb46405a150 0x7fb46405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.891+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6266+0+0 (secure 0 0 0) 0x7fb478074b10 con 0x7fb480153ab0 2023-08-17T00:14:13.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.891+0000 7fb48488d700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb46405a150 0x7fb46405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:13.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.895+0000 7fb48488d700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb46405a150 0x7fb46405c610 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fb474009fd0 tx=0x7fb474017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:13.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:13.895+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb478048420 con 0x7fb480153ab0 2023-08-17T00:14:14.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.091+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb480150650 con 0x7fb480153ab0 2023-08-17T00:14:14.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb47cff9700 1 -- 172.21.15.153:0/82116796 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4509 (secure 0 0 0) 0x7fb47804ba40 con 0x7fb480153ab0 2023-08-17T00:14:14.098 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:14.098 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8457,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:13:13.307532+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8463":{"gid":8463,"name":"b","rank":0,"incarnation":105,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6835/3000779485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3000779485},{"type":"v1","addr":"172.21.15.178:6835","nonce":3000779485}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb46405a150 msgr2=0x7fb46405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb46405a150 0x7fb46405c610 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fb474009fd0 tx=0x7fb474017000).stop 2023-08-17T00:14:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 msgr2=0x7fb480063b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480063b20 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 rx=0x7fb478009ec0 tx=0x7fb47800b040).stop 2023-08-17T00:14:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 shutdown_connections 2023-08-17T00:14:14.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb46405a150 0x7fb46405c610 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb480153ab0 0x7fb480063b20 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4800c59e0 0x7fb480063630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 --2- 172.21.15.153:0/82116796 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4800641f0 0x7fb480166b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 >> 172.21.15.153:0/82116796 conn(0x7fb4800caaa0 msgr2=0x7fb4800ab590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:14.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 shutdown_connections 2023-08-17T00:14:14.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:14.095+0000 7fb486af1700 1 -- 172.21.15.153:0/82116796 wait complete. 2023-08-17T00:14:14.103 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 109 2023-08-17T00:14:14.120 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-08-17T00:14:17.141 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:14:17.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:14:19.122 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:19.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.278+0000 7fbcfd2db700 1 Processor -- start 2023-08-17T00:14:19.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.278+0000 7fbcfd2db700 1 -- start start 2023-08-17T00:14:19.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcfd2db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbcf80632e0 0x7fbcf80a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcfd2db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80629b0 0x7fbcf80bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcfd2db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf8065240 con 0x7fbcf80a8b70 2023-08-17T00:14:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcfd2db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf8062e40 con 0x7fbcf80632e0 2023-08-17T00:14:19.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcfd2db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80638a0 con 0x7fbcf80629b0 2023-08-17T00:14:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf6ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbcf80a8b70 0x7fbcf80656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56400/0 (socket says 172.21.15.153:56400) 2023-08-17T00:14:19.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf6ffd700 1 -- 172.21.15.153:0/3779260301 learned_addr learned my addr 172.21.15.153:0/3779260301 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:19.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf77fe700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80629b0 0x7fbcf80bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:19.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf67fc700 1 --2- 172.21.15.153:0/3779260301 >> v2:172.21.15.178:3300/0 conn(0x7fbcf80632e0 0x7fbcf80a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:19.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf5ffb700 1 -- 172.21.15.153:0/3779260301 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191245226 0 0) 0x7fbcf8065240 con 0x7fbcf80a8b70 2023-08-17T00:14:19.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf5ffb700 1 -- 172.21.15.153:0/3779260301 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce00033f0 con 0x7fbcf80a8b70 2023-08-17T00:14:19.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf67fc700 1 -- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80629b0 msgr2=0x7fbcf80bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:19.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf67fc700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80629b0 0x7fbcf80bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf67fc700 1 -- 172.21.15.153:0/3779260301 >> v1:172.21.15.153:6789/0 conn(0x7fbcf80a8b70 legacy=0x7fbcf80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:19.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf67fc700 1 -- 172.21.15.153:0/3779260301 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8065de0 con 0x7fbcf80632e0 2023-08-17T00:14:19.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf77fe700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80629b0 0x7fbcf80bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:19.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf67fc700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80632e0 0x7fbcf80a8f50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fbcec009760 tx=0x7fbcec009060).ready entity=mon.1 client_cookie=48d8e5f80c61b302 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:19.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf5ffb700 1 -- 172.21.15.153:0/3779260301 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00d4a0 con 0x7fbcf80632e0 2023-08-17T00:14:19.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf5ffb700 1 -- 172.21.15.153:0/3779260301 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec00d600 con 0x7fbcf80632e0 2023-08-17T00:14:19.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.282+0000 7fbcf5ffb700 1 -- 172.21.15.153:0/3779260301 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00d980 con 0x7fbcf80632e0 2023-08-17T00:14:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 -- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80632e0 msgr2=0x7fbcf80a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80632e0 0x7fbcf80a8f50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7fbcec009760 tx=0x7fbcec009060).stop 2023-08-17T00:14:19.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 -- 172.21.15.153:0/3779260301 shutdown_connections 2023-08-17T00:14:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80629b0 0x7fbcf80bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/3779260301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80632e0 0x7fbcf80a8f50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 -- 172.21.15.153:0/3779260301 >> 172.21.15.153:0/3779260301 conn(0x7fbcf80c7150 msgr2=0x7fbcf80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 -- 172.21.15.153:0/3779260301 shutdown_connections 2023-08-17T00:14:19.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 -- 172.21.15.153:0/3779260301 wait complete. 2023-08-17T00:14:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 Processor -- start 2023-08-17T00:14:19.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.286+0000 7fbcfd2db700 1 -- start start 2023-08-17T00:14:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80629b0 0x7fbcf80ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80632e0 0x7fbcf81593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 0x7fbcf814f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:19.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80abfe0 con 0x7fbcf80a8b70 2023-08-17T00:14:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80bd720 con 0x7fbcf80629b0 2023-08-17T00:14:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80aa4b0 con 0x7fbcf80632e0 2023-08-17T00:14:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 0x7fbcf814f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 0x7fbcf814f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51724/0 (socket says 172.21.15.153:51724) 2023-08-17T00:14:19.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 -- 172.21.15.153:0/2424911251 learned_addr learned my addr 172.21.15.153:0/2424911251 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf6ffd700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80629b0 0x7fbcf80ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf67fc700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80632e0 0x7fbcf81593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 -- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80632e0 msgr2=0x7fbcf81593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80632e0 0x7fbcf81593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 -- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80629b0 msgr2=0x7fbcf80ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:19.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80629b0 0x7fbcf80ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 -- 172.21.15.153:0/2424911251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0009a20 con 0x7fbcf80a8b70 2023-08-17T00:14:19.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcf77fe700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 0x7fbcf814f110 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fbcf0009fc0 tx=0x7fbcf000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf000ccd0 con 0x7fbcf80a8b70 2023-08-17T00:14:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf000f040 con 0x7fbcf80a8b70 2023-08-17T00:14:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec0092a0 con 0x7fbcf80a8b70 2023-08-17T00:14:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0013610 con 0x7fbcf80a8b70 2023-08-17T00:14:19.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.290+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf80bdc10 con 0x7fbcf80a8b70 2023-08-17T00:14:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.294+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf806b530 con 0x7fbcf80a8b70 2023-08-17T00:14:19.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.294+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbcf0013a00 con 0x7fbcf80a8b70 2023-08-17T00:14:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.294+0000 7fbcdeffd700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbce405a150 0x7fbce405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.294+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fbcf0074d30 con 0x7fbcf80a8b70 2023-08-17T00:14:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.298+0000 7fbcf6ffd700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbce405a150 0x7fbce405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:19.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.298+0000 7fbcf6ffd700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbce405a150 0x7fbce405c610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fbce8005750 tx=0x7fbce8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:19.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.302+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbcf0048700 con 0x7fbcf80a8b70 2023-08-17T00:14:19.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.506+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbcf8064910 con 0x7fbcf80a8b70 2023-08-17T00:14:19.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.506+0000 7fbcdeffd700 1 -- 172.21.15.153:0/2424911251 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3751 (secure 0 0 0) 0x7fbcf004bd20 con 0x7fbcf80a8b70 2023-08-17T00:14:19.511 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:19.511 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:19.399383+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:rejoin","state_seq":21,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbce405a150 msgr2=0x7fbce405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbce405a150 0x7fbce405c610 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fbce8005750 tx=0x7fbce8009040).stop 2023-08-17T00:14:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 msgr2=0x7fbcf814f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 0x7fbcf814f110 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fbcf0009fc0 tx=0x7fbcf000b040).stop 2023-08-17T00:14:19.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 shutdown_connections 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbce405a150 0x7fbce405c610 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbcf80a8b70 0x7fbcf814f110 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbcf80632e0 0x7fbcf81593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 --2- 172.21.15.153:0/2424911251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbcf80629b0 0x7fbcf80ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 >> 172.21.15.153:0/2424911251 conn(0x7fbcf80c7150 msgr2=0x7fbcf80c2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 shutdown_connections 2023-08-17T00:14:19.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:19.510+0000 7fbcfd2db700 1 -- 172.21.15.153:0/2424911251 wait complete. 2023-08-17T00:14:19.517 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 112 2023-08-17T00:14:19.535 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-08-17T00:14:24.536 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.698+0000 7f39ee81b700 1 Processor -- start 2023-08-17T00:14:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.698+0000 7f39ee81b700 1 -- start start 2023-08-17T00:14:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39ee81b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 0x7f39e80a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39ee81b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80bc0b0 con 0x7f39e80c0c80 2023-08-17T00:14:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39ee81b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e8062fb0 con 0x7f39e80a89c0 2023-08-17T00:14:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39ee81b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80bd590 con 0x7f39e8150ce0 2023-08-17T00:14:24.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39df7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f39e80c0c80 0x7f39e81505d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:56412/0 (socket says 172.21.15.153:56412) 2023-08-17T00:14:24.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39df7fe700 1 -- 172.21.15.153:0/400233705 learned_addr learned my addr 172.21.15.153:0/400233705 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39ecdb8700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 0x7f39e80a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3804767852 0 0) 0x7f39e80bc0b0 con 0x7f39e80c0c80 2023-08-17T00:14:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d40033f0 con 0x7f39e80c0c80 2023-08-17T00:14:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1108202257 0 0) 0x7f39d40033f0 con 0x7f39e80c0c80 2023-08-17T00:14:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 msgr2=0x7f39e80a8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 0x7f39e80a8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 >> v1:172.21.15.178:6789/0 conn(0x7f39e80a89c0 legacy=0x7f39e80bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80bb780 con 0x7f39e80c0c80 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f39d0001470 con 0x7f39e80c0c80 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 >> v1:172.21.15.153:6789/0 conn(0x7f39e80c0c80 legacy=0x7f39e81505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39d4003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d4004690 0x7f39d4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 0x7f39d4005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80bd590 con 0x7f39d4003910 2023-08-17T00:14:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d400db40 con 0x7f39d4004690 2023-08-17T00:14:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d400dd00 con 0x7f39e8150ce0 2023-08-17T00:14:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39df7fe700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d4004690 0x7f39d4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39d4003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39ecdb8700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 0x7f39d4005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 -- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 msgr2=0x7f39d4005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e8150ce0 0x7f39d4005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 -- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d4004690 msgr2=0x7f39d4004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39d4004690 0x7f39d4004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 -- 172.21.15.153:0/400233705 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d40033f0 con 0x7f39d4003910 2023-08-17T00:14:24.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e7fff700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39d4003cf0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f39d8001820 tx=0x7f39d8007b90).ready entity=mon.0 client_cookie=610b5c5f5d8efc3f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007ea0 con 0x7f39d4003910 2023-08-17T00:14:24.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8012400 con 0x7f39d4003910 2023-08-17T00:14:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.702+0000 7f39e77fe700 1 -- 172.21.15.153:0/400233705 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80127c0 con 0x7f39d4003910 2023-08-17T00:14:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 -- 172.21.15.153:0/400233705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 msgr2=0x7f39d4003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 --2- 172.21.15.153:0/400233705 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39d4003cf0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f39d8001820 tx=0x7f39d8007b90).stop 2023-08-17T00:14:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ecdb8700 1 -- 172.21.15.153:0/400233705 reap_dead start 2023-08-17T00:14:24.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 -- 172.21.15.153:0/400233705 shutdown_connections 2023-08-17T00:14:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 -- 172.21.15.153:0/400233705 >> 172.21.15.153:0/400233705 conn(0x7f39e80c7150 msgr2=0x7f39e80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 -- 172.21.15.153:0/400233705 shutdown_connections 2023-08-17T00:14:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 -- 172.21.15.153:0/400233705 wait complete. 2023-08-17T00:14:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 Processor -- start 2023-08-17T00:14:24.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.706+0000 7f39ee81b700 1 -- start start 2023-08-17T00:14:24.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39e80bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39e81511d0 0x7f39e813d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e80c22f0 0x7f39e80c2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c0110 con 0x7f39d4003910 2023-08-17T00:14:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c2c60 con 0x7f39e81511d0 2023-08-17T00:14:24.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e814fc90 con 0x7f39e80c22f0 2023-08-17T00:14:24.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39e80bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39e80bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:51742/0 (socket says 172.21.15.153:51742) 2023-08-17T00:14:24.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 -- 172.21.15.153:0/233273081 learned_addr learned my addr 172.21.15.153:0/233273081 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:24.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39df7fe700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39e81511d0 0x7f39e813d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ecdb8700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e80c22f0 0x7f39e80c2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 -- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e80c22f0 msgr2=0x7f39e80c2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e80c22f0 0x7f39e80c2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:24.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 -- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39e81511d0 msgr2=0x7f39e813d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:24.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39e81511d0 0x7f39e813d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:24.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 -- 172.21.15.153:0/233273081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80c0320 con 0x7f39d4003910 2023-08-17T00:14:24.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39df7fe700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39e81511d0 0x7f39e813d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:24.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e7fff700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39e80bfc20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f39d8001e10 tx=0x7f39d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:24.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007ea0 con 0x7f39d4003910 2023-08-17T00:14:24.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8007240 con 0x7f39d4003910 2023-08-17T00:14:24.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e81539b0 con 0x7f39d4003910 2023-08-17T00:14:24.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80075c0 con 0x7f39d4003910 2023-08-17T00:14:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.710+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e8153f70 con 0x7f39d4003910 2023-08-17T00:14:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.714+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e806b530 con 0x7f39d4003910 2023-08-17T00:14:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.714+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f39d801b040 con 0x7f39d4003910 2023-08-17T00:14:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.714+0000 7f39e4ff9700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39c805a180 0x7f39c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:24.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.714+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f39d8074de0 con 0x7f39d4003910 2023-08-17T00:14:24.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.714+0000 7f39df7fe700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39c805a180 0x7f39c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:24.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.718+0000 7f39df7fe700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39c805a180 0x7f39c805c640 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f39d0001200 tx=0x7f39d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:24.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:24.722+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39d80486c0 con 0x7f39d4003910 2023-08-17T00:14:25.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39e80bba60 con 0x7f39d4003910 2023-08-17T00:14:25.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39e4ff9700 1 -- 172.21.15.153:0/233273081 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+3751 (secure 0 0 0) 0x7f39d804bce0 con 0x7f39d4003910 2023-08-17T00:14:25.034 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:25.034 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":113,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:20.411964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":22,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:25.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39c805a180 msgr2=0x7f39c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39c805a180 0x7f39c805c640 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f39d0001200 tx=0x7f39d0009040).stop 2023-08-17T00:14:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 msgr2=0x7f39e80bfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39e80bfc20 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 rx=0x7f39d8001e10 tx=0x7f39d8016000).stop 2023-08-17T00:14:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 shutdown_connections 2023-08-17T00:14:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f39c805a180 0x7f39c805c640 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39e80c22f0 0x7f39e80c2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39e81511d0 0x7f39e813d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.030+0000 7f39ee81b700 1 --2- 172.21.15.153:0/233273081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39d4003910 0x7f39e80bfc20 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.034+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 >> 172.21.15.153:0/233273081 conn(0x7f39e80c7150 msgr2=0x7f39e8150430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.034+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 shutdown_connections 2023-08-17T00:14:25.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.034+0000 7f39ee81b700 1 -- 172.21.15.153:0/233273081 wait complete. 2023-08-17T00:14:25.040 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 113 2023-08-17T00:14:25.056 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-08-17T00:14:25.056 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:25.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 Processor -- start 2023-08-17T00:14:25.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 -- start start 2023-08-17T00:14:25.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0a56e0 0x7fe3cc0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3cc0bb470 0x7fe3cc0c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3cc151a40 con 0x7fe3cc061fa0 2023-08-17T00:14:25.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3cc0647c0 con 0x7fe3cc0bb470 2023-08-17T00:14:25.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3d12db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0649d0 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3ca7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3cc0bb470 0x7fe3cc0c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3caffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0a56e0 0x7fe3cc0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3ca7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe3cc0bb470 0x7fe3cc0c20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:60702/0 (socket says 172.21.15.153:60702) 2023-08-17T00:14:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.210+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/3888395159 learned_addr learned my addr 172.21.15.153:0/3888395159 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0a56e0 msgr2=0x7fe3cc0a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0a56e0 0x7fe3cc0a5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/3888395159 >> v1:172.21.15.178:6789/0 conn(0x7fe3cc061fa0 legacy=0x7fe3cc0c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/3888395159 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3cc064cb0 con 0x7fe3cc0bb470 2023-08-17T00:14:25.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc0c20f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fe3c0006fd0 tx=0x7fe3c000b3b0).ready entity=mon.1 client_cookie=7696cf9473d2c050 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:25.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3c9ffb700 1 -- 172.21.15.153:0/3888395159 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000da70 con 0x7fe3cc0bb470 2023-08-17T00:14:25.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3c9ffb700 1 -- 172.21.15.153:0/3888395159 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000dbd0 con 0x7fe3cc0bb470 2023-08-17T00:14:25.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3c9ffb700 1 -- 172.21.15.153:0/3888395159 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0010470 con 0x7fe3cc0bb470 2023-08-17T00:14:25.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 -- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 msgr2=0x7fe3cc0c20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 --2- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc0c20f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7fe3c0006fd0 tx=0x7fe3c000b3b0).stop 2023-08-17T00:14:25.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 -- 172.21.15.153:0/3888395159 shutdown_connections 2023-08-17T00:14:25.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 --2- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc0c20f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 --2- 172.21.15.153:0/3888395159 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc0a56e0 0x7fe3cc0a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 -- 172.21.15.153:0/3888395159 >> 172.21.15.153:0/3888395159 conn(0x7fe3cc0c2fb0 msgr2=0x7fe3cc0c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 -- 172.21.15.153:0/3888395159 shutdown_connections 2023-08-17T00:14:25.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.214+0000 7fe3d12db700 1 -- 172.21.15.153:0/3888395159 wait complete. 2023-08-17T00:14:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.218+0000 7fe3d12db700 1 Processor -- start 2023-08-17T00:14:25.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.218+0000 7fe3d12db700 1 -- start start 2023-08-17T00:14:25.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.218+0000 7fe3d12db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc061fa0 0x7fe3cc0aa490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.218+0000 7fe3d12db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 0x7fe3cc13ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3d12db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc146b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3d12db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0ab8f0 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3d12db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0abd80 con 0x7fe3cc0bb470 2023-08-17T00:14:25.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3d12db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3cc0aace0 con 0x7fe3cc061fa0 2023-08-17T00:14:25.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 0x7fe3cc13ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 0x7fe3cc13ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41364/0 (socket says 172.21.15.153:41364) 2023-08-17T00:14:25.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/1392783165 learned_addr learned my addr 172.21.15.153:0/1392783165 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:25.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3caffd700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc061fa0 0x7fe3cc0aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3cb7fe700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc146b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc061fa0 msgr2=0x7fe3cc0aa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc061fa0 0x7fe3cc0aa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 msgr2=0x7fe3cc146b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc146b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 -- 172.21.15.153:0/1392783165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c000b610 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3ca7fc700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 0x7fe3cc13ef10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fe3c0013000 tx=0x7fe3c000b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c001e070 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c0019450 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3cc0aafc0 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c000da70 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.222+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3cc0ab580 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.226+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3cc0abaa0 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.226+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe3c002a070 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.226+0000 7fe3b2ffd700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a150 0x7fe3b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.226+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fe3c0075680 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.230+0000 7fe3caffd700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a150 0x7fe3b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.230+0000 7fe3caffd700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a150 0x7fe3b805c610 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fe3bc009b00 tx=0x7fe3bc009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:25.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.230+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3cc0abaa0 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.422+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3cc0aba30 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.422+0000 7fe3b2ffd700 1 -- 172.21.15.153:0/1392783165 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+3751 (secure 0 0 0) 0x7fe3c0028090 con 0x7fe3cc0a56e0 2023-08-17T00:14:25.429 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:25.429 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":113,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:20.411964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":22,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a150 msgr2=0x7fe3b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a150 0x7fe3b805c610 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fe3bc009b00 tx=0x7fe3bc009060).stop 2023-08-17T00:14:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 msgr2=0x7fe3cc13ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 0x7fe3cc13ef10 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fe3c0013000 tx=0x7fe3c000b3b0).stop 2023-08-17T00:14:25.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 shutdown_connections 2023-08-17T00:14:25.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3b805a150 0x7fe3b805c610 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3cc0bb470 0x7fe3cc146b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3cc0a56e0 0x7fe3cc13ef10 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.426+0000 7fe3d12db700 1 --2- 172.21.15.153:0/1392783165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3cc061fa0 0x7fe3cc0aa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.430+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 >> 172.21.15.153:0/1392783165 conn(0x7fe3cc0c2fb0 msgr2=0x7fe3cc0a79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:25.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.430+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 shutdown_connections 2023-08-17T00:14:25.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.430+0000 7fe3d12db700 1 -- 172.21.15.153:0/1392783165 wait complete. 2023-08-17T00:14:25.436 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 113 2023-08-17T00:14:25.452 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-08-17T00:14:25.453 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:14:25.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 Processor -- start 2023-08-17T00:14:25.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 -- start start 2023-08-17T00:14:25.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75fc068820 0x7f75fc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75fc0a96d0 0x7f75fc0a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75fc1585a0 con 0x7f75fc0a8df0 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc0c1ba0 con 0x7f75fc068820 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75fc066400 con 0x7f75fc0a96d0 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75fc068820 0x7f75fc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f75fc068820 0x7f75fc068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41372/0 (socket says 172.21.15.153:41372) 2023-08-17T00:14:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 -- 172.21.15.153:0/61205596 learned_addr learned my addr 172.21.15.153:0/61205596 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 -- 172.21.15.153:0/61205596 >> v2:172.21.15.178:3300/0 conn(0x7f75fc0a96d0 msgr2=0x7f75fc0a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7602638700 1 --2- 172.21.15.153:0/61205596 >> v2:172.21.15.178:3300/0 conn(0x7f75fc0a96d0 0x7f75fc0a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 --2- 172.21.15.153:0/61205596 >> v2:172.21.15.178:3300/0 conn(0x7f75fc0a96d0 0x7f75fc0a9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 -- 172.21.15.153:0/61205596 >> v1:172.21.15.178:6789/0 conn(0x7f75fc0a8df0 legacy=0x7f75fc0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.598+0000 7f7601636700 1 -- 172.21.15.153:0/61205596 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc069170 con 0x7f75fc068820 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602638700 1 --2- 172.21.15.153:0/61205596 >> v2:172.21.15.178:3300/0 conn(0x7f75fc0a96d0 0x7f75fc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7601636700 1 --2- 172.21.15.153:0/61205596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc068820 0x7f75fc068c80 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f75fc066a40 tx=0x7f75ec0090f0).ready entity=mon.0 client_cookie=9a7d724a59c1930c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7600e35700 1 -- 172.21.15.153:0/61205596 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00b5a0 con 0x7f75fc068820 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7600e35700 1 -- 172.21.15.153:0/61205596 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec00b700 con 0x7f75fc068820 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7600e35700 1 -- 172.21.15.153:0/61205596 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00ba80 con 0x7f75fc068820 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 -- 172.21.15.153:0/61205596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc068820 msgr2=0x7f75fc068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 --2- 172.21.15.153:0/61205596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc068820 0x7f75fc068c80 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7f75fc066a40 tx=0x7f75ec0090f0).stop 2023-08-17T00:14:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 -- 172.21.15.153:0/61205596 shutdown_connections 2023-08-17T00:14:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 --2- 172.21.15.153:0/61205596 >> v2:172.21.15.178:3300/0 conn(0x7f75fc0a96d0 0x7f75fc0a9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 --2- 172.21.15.153:0/61205596 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc068820 0x7f75fc068c80 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 -- 172.21.15.153:0/61205596 >> 172.21.15.153:0/61205596 conn(0x7f75fc0c6620 msgr2=0x7f75fc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 -- 172.21.15.153:0/61205596 shutdown_connections 2023-08-17T00:14:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.602+0000 7f7602e39700 1 -- 172.21.15.153:0/61205596 wait complete. 2023-08-17T00:14:25.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.606+0000 7f7602e39700 1 Processor -- start 2023-08-17T00:14:25.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.606+0000 7f7602e39700 1 -- start start 2023-08-17T00:14:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.606+0000 7f7602e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75fc068820 0x7f75fc0bcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.606+0000 7f7602e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 0x7f75fc156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.606+0000 7f7602e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75fc0a96d0 0x7f75fc148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0bf040 con 0x7f75fc0a8df0 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0be740 con 0x7f75fc068820 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75fc0bacd0 con 0x7f75fc0a96d0 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 0x7f75fc156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 0x7f75fc156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41388/0 (socket says 172.21.15.153:41388) 2023-08-17T00:14:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 -- 172.21.15.153:0/1233747380 learned_addr learned my addr 172.21.15.153:0/1233747380 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601e37700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75fc068820 0x7f75fc0bcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602638700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75fc0a96d0 0x7f75fc148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 -- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75fc0a96d0 msgr2=0x7f75fc148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75fc0a96d0 0x7f75fc148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 -- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75fc068820 msgr2=0x7f75fc0bcfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75fc068820 0x7f75fc0bcfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 -- 172.21.15.153:0/1233747380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec009370 con 0x7f75fc0a8df0 2023-08-17T00:14:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602638700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75fc0a96d0 0x7f75fc148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7601636700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 0x7f75fc156cd0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f75ec009130 tx=0x7f75ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec00ba80 con 0x7f75fc0a8df0 2023-08-17T00:14:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec000d10 con 0x7f75fc0a8df0 2023-08-17T00:14:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75fc0bafb0 con 0x7f75fc0a8df0 2023-08-17T00:14:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec01b660 con 0x7f75fc0a8df0 2023-08-17T00:14:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75fc0becd0 con 0x7f75fc0a8df0 2023-08-17T00:14:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.610+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75fc0bf1f0 con 0x7f75fc0a8df0 2023-08-17T00:14:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.614+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f75ec02b070 con 0x7f75fc0a8df0 2023-08-17T00:14:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.614+0000 7f75f1ffb700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75e005a150 0x7f75e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.614+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f75ec075d80 con 0x7f75fc0a8df0 2023-08-17T00:14:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.614+0000 7f7601e37700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75e005a150 0x7f75e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.618+0000 7f7601e37700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75e005a150 0x7f75e005c610 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f75f800b7d0 tx=0x7f75f8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.622+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f75fc0bf1f0 con 0x7f75fc0a8df0 2023-08-17T00:14:25.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.834+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f75fc06b4c0 con 0x7f75fc0a8df0 2023-08-17T00:14:25.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f75f1ffb700 1 -- 172.21.15.153:0/1233747380 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1028 (secure 0 0 0) 0x7f75ec01f080 con 0x7f75fc0a8df0 2023-08-17T00:14:25.842 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:25.842 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":713,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":143,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":137}],"num_pgs":137,"num_pools":4,"num_objects":1078,"data_bytes":1075892303,"bytes_used":4676419584,"bytes_avail":768417693696,"bytes_total":773094113280,"read_bytes_sec":223442,"read_op_per_sec":1,"write_op_per_sec":0},"fsmap":{"epoch":113,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8457}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2023-08-17T00:14:17.436783+0000","services":{}},"progress_events":{}} 2023-08-17T00:14:25.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75e005a150 msgr2=0x7f75e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75e005a150 0x7f75e005c610 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f75f800b7d0 tx=0x7f75f8008040).stop 2023-08-17T00:14:25.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 msgr2=0x7f75fc156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:25.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 0x7f75fc156cd0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 rx=0x7f75ec009130 tx=0x7f75ec015000).stop 2023-08-17T00:14:25.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 shutdown_connections 2023-08-17T00:14:25.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f75e005a150 0x7f75e005c610 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75fc0a96d0 0x7f75fc148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.838+0000 7f7602e39700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f75fc0a8df0 0x7f75fc156cd0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.842+0000 7f7602e39700 1 --2- 172.21.15.153:0/1233747380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75fc068820 0x7f75fc0bcfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:25.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.842+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 >> 172.21.15.153:0/1233747380 conn(0x7f75fc0c6620 msgr2=0x7f75fc1579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:25.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.842+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 shutdown_connections 2023-08-17T00:14:25.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:25.842+0000 7f7602e39700 1 -- 172.21.15.153:0/1233747380 wait complete. 2023-08-17T00:14:25.864 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:14:25.864 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:14:25.902 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:14:25.946 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:14:25.946 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:14:25.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:14:25.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:14:26.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:14:26.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:26.035 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:14:26.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:26.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.258+0000 7f19f6879700 1 Processor -- start 2023-08-17T00:14:26.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6879700 1 -- start start 2023-08-17T00:14:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6879700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19f00acf20 0x7f19f00c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6879700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 0x7f19f00c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6879700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00bf790 con 0x7f19f00c7520 2023-08-17T00:14:26.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6879700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f00bfd50 con 0x7f19f00acf20 2023-08-17T00:14:26.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6879700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0063f90 con 0x7f19f01545f0 2023-08-17T00:14:26.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6078700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 0x7f19f00c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f5877700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19f00acf20 0x7f19f00c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6078700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 0x7f19f00c01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:59020/0 (socket says 172.21.15.153:59020) 2023-08-17T00:14:26.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.262+0000 7f19f6078700 1 -- 172.21.15.153:0/30641671 learned_addr learned my addr 172.21.15.153:0/30641671 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:26.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6078700 1 -- 172.21.15.153:0/30641671 >> v2:172.21.15.178:3300/0 conn(0x7f19f00acf20 msgr2=0x7f19f00c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:26.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6078700 1 --2- 172.21.15.153:0/30641671 >> v2:172.21.15.178:3300/0 conn(0x7f19f00acf20 0x7f19f00c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6078700 1 -- 172.21.15.153:0/30641671 >> v1:172.21.15.178:6789/0 conn(0x7f19f00c7520 legacy=0x7f19f0153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6078700 1 -- 172.21.15.153:0/30641671 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00ad300 con 0x7f19f01545f0 2023-08-17T00:14:26.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f4875700 1 -- 172.21.15.153:0/30641671 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3564065772 0 0) 0x7f19f00bf790 con 0x7f19f00c7520 2023-08-17T00:14:26.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6078700 1 --2- 172.21.15.153:0/30641671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 0x7f19f00c01e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f19e8009f20 tx=0x7f19e8009840).ready entity=mon.2 client_cookie=4369035b3913d50c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:26.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f4875700 1 -- 172.21.15.153:0/30641671 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e800e070 con 0x7f19f01545f0 2023-08-17T00:14:26.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f4875700 1 -- 172.21.15.153:0/30641671 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e800b9d0 con 0x7f19f01545f0 2023-08-17T00:14:26.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f4875700 1 -- 172.21.15.153:0/30641671 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e800bd50 con 0x7f19f01545f0 2023-08-17T00:14:26.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 -- 172.21.15.153:0/30641671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 msgr2=0x7f19f00c01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 --2- 172.21.15.153:0/30641671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 0x7f19f00c01e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f19e8009f20 tx=0x7f19e8009840).stop 2023-08-17T00:14:26.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 -- 172.21.15.153:0/30641671 shutdown_connections 2023-08-17T00:14:26.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 --2- 172.21.15.153:0/30641671 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f01545f0 0x7f19f00c01e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 --2- 172.21.15.153:0/30641671 >> v2:172.21.15.178:3300/0 conn(0x7f19f00acf20 0x7f19f00c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 -- 172.21.15.153:0/30641671 >> 172.21.15.153:0/30641671 conn(0x7f19f0062a20 msgr2=0x7f19f0063580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:26.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 -- 172.21.15.153:0/30641671 shutdown_connections 2023-08-17T00:14:26.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.266+0000 7f19f6879700 1 -- 172.21.15.153:0/30641671 wait complete. 2023-08-17T00:14:26.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.270+0000 7f19f6879700 1 Processor -- start 2023-08-17T00:14:26.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.270+0000 7f19f6879700 1 -- start start 2023-08-17T00:14:26.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f00acf20 0x7f19f00c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 0x7f19f0145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f01545f0 0x7f19f00c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0151b30 con 0x7f19f00c7520 2023-08-17T00:14:26.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c4180 con 0x7f19f01545f0 2023-08-17T00:14:26.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00c4460 con 0x7f19f00acf20 2023-08-17T00:14:26.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 0x7f19f0145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5877700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f00acf20 0x7f19f00c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 0x7f19f0145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41398/0 (socket says 172.21.15.153:41398) 2023-08-17T00:14:26.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 -- 172.21.15.153:0/1035921405 learned_addr learned my addr 172.21.15.153:0/1035921405 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:26.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6078700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f01545f0 0x7f19f00c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 -- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f00acf20 msgr2=0x7f19f00c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f00acf20 0x7f19f00c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 -- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f01545f0 msgr2=0x7f19f00c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f01545f0 0x7f19f00c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 -- 172.21.15.153:0/1035921405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009ae0 con 0x7f19f00c7520 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f5076700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 0x7f19f0145340 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f19e0001eb0 tx=0x7f19e0007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e000ce60 con 0x7f19f00c7520 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e000f470 con 0x7f19f00c7520 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00c4740 con 0x7f19f00c7520 2023-08-17T00:14:26.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e000f810 con 0x7f19f00c7520 2023-08-17T00:14:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.274+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00c3e20 con 0x7f19f00c7520 2023-08-17T00:14:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.278+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f0046dd0 con 0x7f19f00c7520 2023-08-17T00:14:26.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.278+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f19e0019030 con 0x7f19f00c7520 2023-08-17T00:14:26.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.278+0000 7f19e5ffb700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19d405a150 0x7f19d405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.282+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f19e0073610 con 0x7f19f00c7520 2023-08-17T00:14:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.282+0000 7f19f5877700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19d405a150 0x7f19d405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.282+0000 7f19f5877700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19d405a150 0x7f19d405c610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f19ec009b90 tx=0x7f19ec009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:26.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.286+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19e0046fe0 con 0x7f19f00c7520 2023-08-17T00:14:26.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.482+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19f00c7cc0 con 0x7f19f00c7520 2023-08-17T00:14:26.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.482+0000 7f19e5ffb700 1 -- 172.21.15.153:0/1035921405 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+3751 (secure 0 0 0) 0x7f19e004a600 con 0x7f19f00c7520 2023-08-17T00:14:26.488 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:26.488 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":113,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:20.411964+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":22,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19d405a150 msgr2=0x7f19d405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19d405a150 0x7f19d405c610 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f19ec009b90 tx=0x7f19ec009060).stop 2023-08-17T00:14:26.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 msgr2=0x7f19f0145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 0x7f19f0145340 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7f19e0001eb0 tx=0x7f19e0007c70).stop 2023-08-17T00:14:26.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 shutdown_connections 2023-08-17T00:14:26.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f19d405a150 0x7f19d405c610 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19f01545f0 0x7f19f00c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19f00c7520 0x7f19f0145340 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 --2- 172.21.15.153:0/1035921405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19f00acf20 0x7f19f00c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 >> 172.21.15.153:0/1035921405 conn(0x7f19f0062a20 msgr2=0x7f19f0156280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:26.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 shutdown_connections 2023-08-17T00:14:26.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.486+0000 7f19f6879700 1 -- 172.21.15.153:0/1035921405 wait complete. 2023-08-17T00:14:26.493 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 113 2023-08-17T00:14:26.512 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:26.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.666+0000 7f27fbedb700 1 Processor -- start 2023-08-17T00:14:26.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.670+0000 7f27fbedb700 1 -- start start 2023-08-17T00:14:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.670+0000 7f27fbedb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f40632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.670+0000 7f27fbedb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27f40656d0 0x7f27f40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.670+0000 7f27fbedb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f4065240 con 0x7f27f4153d50 2023-08-17T00:14:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.670+0000 7f27fbedb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f4063880 con 0x7f27f40656d0 2023-08-17T00:14:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.670+0000 7f27fbedb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4064910 con 0x7f27f4154130 2023-08-17T00:14:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9476700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f40632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9c77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f27f4153d50 0x7f27f40629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35342/0 (socket says 172.21.15.153:35342) 2023-08-17T00:14:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9c77700 1 -- 172.21.15.153:0/1119002784 learned_addr learned my addr 172.21.15.153:0/1119002784 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:26.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fa478700 1 --2- 172.21.15.153:0/1119002784 >> v2:172.21.15.178:3300/0 conn(0x7f27f40656d0 0x7f27f40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f8c75700 1 -- 172.21.15.153:0/1119002784 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830844036 0 0) 0x7f27f4065240 con 0x7f27f4153d50 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f8c75700 1 -- 172.21.15.153:0/1119002784 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27e00033f0 con 0x7f27f4153d50 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9476700 1 -- 172.21.15.153:0/1119002784 >> v2:172.21.15.178:3300/0 conn(0x7f27f40656d0 msgr2=0x7f27f40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9476700 1 --2- 172.21.15.153:0/1119002784 >> v2:172.21.15.178:3300/0 conn(0x7f27f40656d0 0x7f27f40bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9476700 1 -- 172.21.15.153:0/1119002784 >> v1:172.21.15.153:6789/0 conn(0x7f27f4153d50 legacy=0x7f27f40629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9476700 1 -- 172.21.15.153:0/1119002784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f4064bf0 con 0x7f27f4154130 2023-08-17T00:14:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fa478700 1 --2- 172.21.15.153:0/1119002784 >> v2:172.21.15.178:3300/0 conn(0x7f27f40656d0 0x7f27f40bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f9476700 1 --2- 172.21.15.153:0/1119002784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f40632e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f27e4009760 tx=0x7f27e4009060).ready entity=mon.2 client_cookie=f70c765b4a2ed87f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f8c75700 1 -- 172.21.15.153:0/1119002784 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e40090d0 con 0x7f27f4154130 2023-08-17T00:14:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f8c75700 1 -- 172.21.15.153:0/1119002784 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e400f510 con 0x7f27f4154130 2023-08-17T00:14:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27f8c75700 1 -- 172.21.15.153:0/1119002784 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400f890 con 0x7f27f4154130 2023-08-17T00:14:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 -- 172.21.15.153:0/1119002784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 msgr2=0x7f27f40632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 --2- 172.21.15.153:0/1119002784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f40632e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f27e4009760 tx=0x7f27e4009060).stop 2023-08-17T00:14:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 -- 172.21.15.153:0/1119002784 shutdown_connections 2023-08-17T00:14:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 --2- 172.21.15.153:0/1119002784 >> v2:172.21.15.178:3300/0 conn(0x7f27f40656d0 0x7f27f40bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 --2- 172.21.15.153:0/1119002784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f40632e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 -- 172.21.15.153:0/1119002784 >> 172.21.15.153:0/1119002784 conn(0x7f27f40c7150 msgr2=0x7f27f40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.674+0000 7f27fbedb700 1 -- 172.21.15.153:0/1119002784 shutdown_connections 2023-08-17T00:14:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 -- 172.21.15.153:0/1119002784 wait complete. 2023-08-17T00:14:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 Processor -- start 2023-08-17T00:14:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 -- start start 2023-08-17T00:14:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 0x7f27f41692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27f4153d50 0x7f27f4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f4157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4156150 con 0x7f27f40656d0 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4155580 con 0x7f27f4153d50 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27fbedb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4152030 con 0x7f27f4154130 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 0x7f27f41692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 0x7f27f41692b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41412/0 (socket says 172.21.15.153:41412) 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 -- 172.21.15.153:0/3881317590 learned_addr learned my addr 172.21.15.153:0/3881317590 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9476700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27f4153d50 0x7f27f4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 -- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 msgr2=0x7f27f4157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f4157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 -- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27f4153d50 msgr2=0x7f27f4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27f4153d50 0x7f27f4151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9c77700 1 -- 172.21.15.153:0/3881317590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e40092a0 con 0x7f27f40656d0 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.678+0000 7f27f9476700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27f4153d50 0x7f27f4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27f9c77700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 0x7f27f41692b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f27f000c420 tx=0x7f27f0007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00072e0 con 0x7f27f40656d0 2023-08-17T00:14:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0007440 con 0x7f27f40656d0 2023-08-17T00:14:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f4155820 con 0x7f27f40656d0 2023-08-17T00:14:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f00057a0 con 0x7f27f40656d0 2023-08-17T00:14:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f4155de0 con 0x7f27f40656d0 2023-08-17T00:14:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f406b530 con 0x7f27f40656d0 2023-08-17T00:14:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.682+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f27f0010070 con 0x7f27f40656d0 2023-08-17T00:14:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.686+0000 7f27e9ffb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27d805a150 0x7f27d805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.686+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f27f00739f0 con 0x7f27f40656d0 2023-08-17T00:14:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.686+0000 7f27f9476700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27d805a150 0x7f27d805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:26.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.686+0000 7f27f9476700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27d805a150 0x7f27d805c610 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f27f40c4fd0 tx=0x7f27e4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.690+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f27f00472d0 con 0x7f27f40656d0 2023-08-17T00:14:26.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.854+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27f4064ed0 con 0x7f27f40656d0 2023-08-17T00:14:26.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.858+0000 7f27e9ffb700 1 -- 172.21.15.153:0/3881317590 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+17362 (secure 0 0 0) 0x7f27f004a8f0 con 0x7f27f40656d0 2023-08-17T00:14:26.862 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:26.862 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":143,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:17.331131+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:13:08.136187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T00:13:09.146761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"20.0","mappings":[{"from":3,"to":7}]},{"pgid":"20.12","mappings":[{"from":3,"to":7}]},{"pgid":"20.24","mappings":[{"from":3,"to":1}]},{"pgid":"20.35","mappings":[{"from":3,"to":7}]},{"pgid":"20.3c","mappings":[{"from":3,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.178:6835/3000779485":"2023-08-18T00:14:17.330996+0000","172.21.15.178:6834/3000779485":"2023-08-18T00:14:17.330996+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:26.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27d805a150 msgr2=0x7f27d805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27d805a150 0x7f27d805c610 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f27f40c4fd0 tx=0x7f27e4017000).stop 2023-08-17T00:14:26.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 msgr2=0x7f27f41692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:26.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 0x7f27f41692b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f27f000c420 tx=0x7f27f0007c80).stop 2023-08-17T00:14:26.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 shutdown_connections 2023-08-17T00:14:26.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f27d805a150 0x7f27d805c610 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27f4154130 0x7f27f4157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27f4153d50 0x7f27f4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 --2- 172.21.15.153:0/3881317590 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f27f40656d0 0x7f27f41692b0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 >> 172.21.15.153:0/3881317590 conn(0x7f27f40c7150 msgr2=0x7f27f4068840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 shutdown_connections 2023-08-17T00:14:26.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:26.862+0000 7f27fbedb700 1 -- 172.21.15.153:0/3881317590 wait complete. 2023-08-17T00:14:26.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:13:08.136187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:13:09.146761+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:14:26.888 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:14:27.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.050+0000 7fefbc69b700 1 Processor -- start 2023-08-17T00:14:27.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.050+0000 7fefbc69b700 1 -- start start 2023-08-17T00:14:27.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbc69b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fefb40a7e10 0x7fefb40be2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbc69b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fefb40c5a50 0x7fefb415b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbc69b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb40c4fe0 con 0x7fefb40be790 2023-08-17T00:14:27.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbc69b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40a81f0 con 0x7fefb40c5a50 2023-08-17T00:14:27.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbc69b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40c43d0 con 0x7fefb40a7e10 2023-08-17T00:14:27.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefb9c36700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fefb40be790 0x7fefb40c5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35346/0 (socket says 172.21.15.153:35346) 2023-08-17T00:14:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefb9c36700 1 -- 172.21.15.153:0/89827391 learned_addr learned my addr 172.21.15.153:0/89827391 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefba437700 1 --2- 172.21.15.153:0/89827391 >> v2:172.21.15.178:3300/0 conn(0x7fefb40a7e10 0x7fefb40be2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbac38700 1 --2- 172.21.15.153:0/89827391 >> v2:172.21.15.153:3300/0 conn(0x7fefb40c5a50 0x7fefb415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefb9435700 1 -- 172.21.15.153:0/89827391 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441223557 0 0) 0x7fefb40c4fe0 con 0x7fefb40be790 2023-08-17T00:14:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefb9435700 1 -- 172.21.15.153:0/89827391 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa00033f0 con 0x7fefb40be790 2023-08-17T00:14:27.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbac38700 1 -- 172.21.15.153:0/89827391 >> v2:172.21.15.178:3300/0 conn(0x7fefb40a7e10 msgr2=0x7fefb40be2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:27.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbac38700 1 --2- 172.21.15.153:0/89827391 >> v2:172.21.15.178:3300/0 conn(0x7fefb40a7e10 0x7fefb40be2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbac38700 1 -- 172.21.15.153:0/89827391 >> v1:172.21.15.153:6789/0 conn(0x7fefb40be790 legacy=0x7fefb40c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbac38700 1 -- 172.21.15.153:0/89827391 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40c46b0 con 0x7fefb40c5a50 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.054+0000 7fefbac38700 1 --2- 172.21.15.153:0/89827391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40c5a50 0x7fefb415b670 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fefb4069780 tx=0x7fefac009780).ready entity=mon.0 client_cookie=62dde1e91ebf3602 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefb9435700 1 -- 172.21.15.153:0/89827391 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00e070 con 0x7fefb40c5a50 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefb9435700 1 -- 172.21.15.153:0/89827391 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac00bab0 con 0x7fefb40c5a50 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefb9435700 1 -- 172.21.15.153:0/89827391 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00be30 con 0x7fefb40c5a50 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 -- 172.21.15.153:0/89827391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40c5a50 msgr2=0x7fefb415b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 --2- 172.21.15.153:0/89827391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40c5a50 0x7fefb415b670 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 rx=0x7fefb4069780 tx=0x7fefac009780).stop 2023-08-17T00:14:27.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 -- 172.21.15.153:0/89827391 shutdown_connections 2023-08-17T00:14:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 --2- 172.21.15.153:0/89827391 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40c5a50 0x7fefb415b670 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 --2- 172.21.15.153:0/89827391 >> v2:172.21.15.178:3300/0 conn(0x7fefb40a7e10 0x7fefb40be2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 -- 172.21.15.153:0/89827391 >> 172.21.15.153:0/89827391 conn(0x7fefb4065aa0 msgr2=0x7fefb4065eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 -- 172.21.15.153:0/89827391 shutdown_connections 2023-08-17T00:14:27.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 -- 172.21.15.153:0/89827391 wait complete. 2023-08-17T00:14:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 Processor -- start 2023-08-17T00:14:27.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.058+0000 7fefbc69b700 1 -- start start 2023-08-17T00:14:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 0x7fefb40ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb40be790 0x7fefb40aa910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb40c5a50 0x7fefb41649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40aae00 con 0x7fefb40a7e10 2023-08-17T00:14:27.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40c0120 con 0x7fefb40c5a50 2023-08-17T00:14:27.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4164ea0 con 0x7fefb40be790 2023-08-17T00:14:27.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 0x7fefb40ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 0x7fefb40ad7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41430/0 (socket says 172.21.15.153:41430) 2023-08-17T00:14:27.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 -- 172.21.15.153:0/348839413 learned_addr learned my addr 172.21.15.153:0/348839413 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:27.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefb9c36700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb40be790 0x7fefb40aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 -- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb40be790 msgr2=0x7fefb40aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbac38700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb40c5a50 0x7fefb41649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb40be790 0x7fefb40aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 -- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb40c5a50 msgr2=0x7fefb41649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb40c5a50 0x7fefb41649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 -- 172.21.15.153:0/348839413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac009a20 con 0x7fefb40a7e10 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefb9c36700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb40be790 0x7fefb40aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:27.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbac38700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb40c5a50 0x7fefb41649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefba437700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 0x7fefb40ad7b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fefb000e930 tx=0x7fefb0009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000eed0 con 0x7fefb40a7e10 2023-08-17T00:14:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb000c850 con 0x7fefb40a7e10 2023-08-17T00:14:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000cbd0 con 0x7fefb40a7e10 2023-08-17T00:14:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb40add40 con 0x7fefb40a7e10 2023-08-17T00:14:27.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.062+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb40ae300 con 0x7fefb40a7e10 2023-08-17T00:14:27.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.066+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb406b530 con 0x7fefb40a7e10 2023-08-17T00:14:27.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.066+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fefb0022070 con 0x7fefb40a7e10 2023-08-17T00:14:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.066+0000 7fefaa7fc700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef9805a150 0x7fef9805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.066+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fefb0074660 con 0x7fefb40a7e10 2023-08-17T00:14:27.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.066+0000 7fefb9c36700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef9805a150 0x7fef9805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.070+0000 7fefb9c36700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef9805a150 0x7fef9805c610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fefa4005750 tx=0x7fefa4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.070+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fefb0047fd0 con 0x7fefb40a7e10 2023-08-17T00:14:27.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.230+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fefb40630b0 con 0x7fefb40a7e10 2023-08-17T00:14:27.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.230+0000 7fefaa7fc700 1 -- 172.21.15.153:0/348839413 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v143) v1 ==== 110+0+10 (secure 0 0 0) 0x7fefb004b5f0 con 0x7fefb40a7e10 2023-08-17T00:14:27.234 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:14:27.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.230+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef9805a150 msgr2=0x7fef9805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef9805a150 0x7fef9805c610 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fefa4005750 tx=0x7fefa4009040).stop 2023-08-17T00:14:27.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 msgr2=0x7fefb40ad7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 0x7fefb40ad7b0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7fefb000e930 tx=0x7fefb0009060).stop 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 shutdown_connections 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fef9805a150 0x7fef9805c610 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefb40c5a50 0x7fefb41649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefb40be790 0x7fefb40aa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 --2- 172.21.15.153:0/348839413 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fefb40a7e10 0x7fefb40ad7b0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 >> 172.21.15.153:0/348839413 conn(0x7fefb4065aa0 msgr2=0x7fefb41514e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:27.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 shutdown_connections 2023-08-17T00:14:27.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.234+0000 7fefbc69b700 1 -- 172.21.15.153:0/348839413 wait complete. 2023-08-17T00:14:27.254 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:14:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.410+0000 7f5fca3f9700 1 Processor -- start 2023-08-17T00:14:27.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.410+0000 7f5fca3f9700 1 -- start start 2023-08-17T00:14:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc40c57a0 0x7f5fc40c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fc4153f50 0x7f5fc4154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc40bfd10 con 0x7f5fc4157600 2023-08-17T00:14:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc4154860 con 0x7f5fc4153f50 2023-08-17T00:14:27.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4154af0 con 0x7f5fc40c57a0 2023-08-17T00:14:27.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fc4153f50 0x7f5fc4154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5fc4153f50 0x7f5fc4154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41446/0 (socket says 172.21.15.153:41446) 2023-08-17T00:14:27.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/1055524628 learned_addr learned my addr 172.21.15.153:0/1055524628 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc93f7700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc40c57a0 0x7f5fc40c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/1055524628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc40c57a0 msgr2=0x7f5fc40c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc40c57a0 0x7f5fc40c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/1055524628 >> v1:172.21.15.153:6789/0 conn(0x7f5fc4157600 legacy=0x7f5fc4157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/1055524628 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4154dd0 con 0x7f5fc4153f50 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc93f7700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc40c57a0 0x7f5fc40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:27.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fc8bf6700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc4154370 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f5fb4006fd0 tx=0x7f5fb40090f0).ready entity=mon.0 client_cookie=a018a201e2084a57 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fbbfff700 1 -- 172.21.15.153:0/1055524628 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400b600 con 0x7f5fc4153f50 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fbbfff700 1 -- 172.21.15.153:0/1055524628 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb400b760 con 0x7f5fc4153f50 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fbbfff700 1 -- 172.21.15.153:0/1055524628 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400bae0 con 0x7f5fc4153f50 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 -- 172.21.15.153:0/1055524628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 msgr2=0x7f5fc4154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc4154370 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 rx=0x7f5fb4006fd0 tx=0x7f5fb40090f0).stop 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 -- 172.21.15.153:0/1055524628 shutdown_connections 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc4154370 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/1055524628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc40c57a0 0x7f5fc40c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.414+0000 7f5fca3f9700 1 -- 172.21.15.153:0/1055524628 >> 172.21.15.153:0/1055524628 conn(0x7f5fc4062a70 msgr2=0x7f5fc40ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:27.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.418+0000 7f5fca3f9700 1 -- 172.21.15.153:0/1055524628 shutdown_connections 2023-08-17T00:14:27.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.418+0000 7f5fca3f9700 1 -- 172.21.15.153:0/1055524628 wait complete. 2023-08-17T00:14:27.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.418+0000 7f5fca3f9700 1 Processor -- start 2023-08-17T00:14:27.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.418+0000 7f5fca3f9700 1 -- start start 2023-08-17T00:14:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fca3f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fc40c57a0 0x7f5fc40c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fca3f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc40c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fca3f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc4157600 0x7f5fc40ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fca3f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc41654c0 con 0x7f5fc4153f50 2023-08-17T00:14:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fca3f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40c9680 con 0x7f5fc40c57a0 2023-08-17T00:14:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fca3f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40c8d50 con 0x7f5fc4157600 2023-08-17T00:14:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc40c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc40c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41452/0 (socket says 172.21.15.153:41452) 2023-08-17T00:14:27.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/3917621548 learned_addr learned my addr 172.21.15.153:0/3917621548 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc93f7700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fc40c57a0 0x7f5fc40c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc9bf8700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc4157600 0x7f5fc40ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc4157600 msgr2=0x7f5fc40ab830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc4157600 0x7f5fc40ab830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fc40c57a0 msgr2=0x7f5fc40c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fc40c57a0 0x7f5fc40c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.422+0000 7f5fc8bf6700 1 -- 172.21.15.153:0/3917621548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4009370 con 0x7f5fc4153f50 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fc8bf6700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc40c9b10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f5fc4083860 tx=0x7f5fb4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400bae0 con 0x7f5fc4153f50 2023-08-17T00:14:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb4000c90 con 0x7f5fc4153f50 2023-08-17T00:14:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc40c9030 con 0x7f5fc4153f50 2023-08-17T00:14:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb401b640 con 0x7f5fc4153f50 2023-08-17T00:14:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc40c89c0 con 0x7f5fc4153f50 2023-08-17T00:14:27.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc40c9810 con 0x7f5fc4153f50 2023-08-17T00:14:27.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.426+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5fb402a070 con 0x7f5fc4153f50 2023-08-17T00:14:27.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.430+0000 7f5fb97fa700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5fa805a180 0x7f5fa805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.430+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f5fb40758f0 con 0x7f5fc4153f50 2023-08-17T00:14:27.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.430+0000 7f5fc93f7700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5fa805a180 0x7f5fa805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.430+0000 7f5fc93f7700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5fa805a180 0x7f5fa805c640 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f5fc4162140 tx=0x7f5fc0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.434+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5fb40491d0 con 0x7f5fc4153f50 2023-08-17T00:14:27.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.602+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5fc406b4c0 con 0x7f5fc4153f50 2023-08-17T00:14:27.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.606+0000 7f5fb97fa700 1 -- 172.21.15.153:0/3917621548 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v143) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5fb401f020 con 0x7f5fc4153f50 2023-08-17T00:14:27.610 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:14:27.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5fa805a180 msgr2=0x7f5fa805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5fa805a180 0x7f5fa805c640 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f5fc4162140 tx=0x7f5fc0008040).stop 2023-08-17T00:14:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 msgr2=0x7f5fc40c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc40c9b10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 rx=0x7f5fc4083860 tx=0x7f5fb4017000).stop 2023-08-17T00:14:27.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 shutdown_connections 2023-08-17T00:14:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5fa805a180 0x7f5fa805c640 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fc4157600 0x7f5fc40ab830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5fc4153f50 0x7f5fc40c9b10 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 --2- 172.21.15.153:0/3917621548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fc40c57a0 0x7f5fc40c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 >> 172.21.15.153:0/3917621548 conn(0x7f5fc4062a70 msgr2=0x7f5fc40aa8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:27.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 shutdown_connections 2023-08-17T00:14:27.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.610+0000 7f5fca3f9700 1 -- 172.21.15.153:0/3917621548 wait complete. 2023-08-17T00:14:27.634 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:14:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.786+0000 7f71a4b07700 1 Processor -- start 2023-08-17T00:14:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.786+0000 7f71a4b07700 1 -- start start 2023-08-17T00:14:27.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f71a4b07700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71a0063bc0 0x7f71a015e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f71a4b07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a0154e90 con 0x7f71a00c5ea0 2023-08-17T00:14:27.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f71a4b07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a0153fc0 con 0x7f71a00acf30 2023-08-17T00:14:27.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f71a4b07700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a00c1730 con 0x7f71a0063bc0 2023-08-17T00:14:27.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f71a00c5ea0 0x7f71a00634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35360/0 (socket says 172.21.15.153:35360) 2023-08-17T00:14:27.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719effd700 1 -- 172.21.15.153:0/4054517042 learned_addr learned my addr 172.21.15.153:0/4054517042 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:27.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719ffff700 1 --2- 172.21.15.153:0/4054517042 >> v2:172.21.15.178:3300/0 conn(0x7f71a0063bc0 0x7f71a015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203649345 0 0) 0x7f71a0154e90 con 0x7f71a00c5ea0 2023-08-17T00:14:27.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71880033f0 con 0x7f71a00c5ea0 2023-08-17T00:14:27.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086998492 0 0) 0x7f71a0153fc0 con 0x7f71a00acf30 2023-08-17T00:14:27.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71a0154e90 con 0x7f71a00acf30 2023-08-17T00:14:27.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679417531 0 0) 0x7f71880033f0 con 0x7f71a00c5ea0 2023-08-17T00:14:27.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 >> v2:172.21.15.178:3300/0 conn(0x7f71a0063bc0 msgr2=0x7f71a015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:27.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 --2- 172.21.15.153:0/4054517042 >> v2:172.21.15.178:3300/0 conn(0x7f71a0063bc0 0x7f71a015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 >> v1:172.21.15.178:6789/0 conn(0x7f71a00acf30 legacy=0x7f71a00c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a0154280 con 0x7f71a00c5ea0 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.790+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f7194001470 con 0x7f71a00c5ea0 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 >> v1:172.21.15.153:6789/0 conn(0x7f71a00c5ea0 legacy=0x7f71a00634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188003a70 0x7f7188003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7188004690 0x7f7188004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7188005000 0x7f718800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00c1730 con 0x7f7188005000 2023-08-17T00:14:27.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718800bf60 con 0x7f7188003a70 2023-08-17T00:14:27.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718800c0d0 con 0x7f7188004690 2023-08-17T00:14:27.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7188005000 0x7f718800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719f7fe700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188003a70 0x7f7188003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719effd700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7188004690 0x7f7188004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 -- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7188004690 msgr2=0x7f7188004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:27.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7188004690 0x7f7188004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 -- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188003a70 msgr2=0x7f7188003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:27.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188003a70 0x7f7188003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 -- 172.21.15.153:0/4054517042 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880033f0 con 0x7f7188005000 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 -- 172.21.15.153:0/4054517042 reap_dead start 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719ffff700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7188005000 0x7f718800b8e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f71a0063fc0 tx=0x7f719800b040).ready entity=mon.0 client_cookie=dc1de88a6ea789cf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7198017070 con 0x7f7188005000 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719800f040 con 0x7f7188005000 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f719e7fc700 1 -- 172.21.15.153:0/4054517042 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719800ece0 con 0x7f7188005000 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 -- 172.21.15.153:0/4054517042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7188005000 msgr2=0x7f718800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7188005000 0x7f718800b8e0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 rx=0x7f71a0063fc0 tx=0x7f719800b040).stop 2023-08-17T00:14:27.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 -- 172.21.15.153:0/4054517042 shutdown_connections 2023-08-17T00:14:27.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 --2- 172.21.15.153:0/4054517042 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7188005000 0x7f718800b8e0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 -- 172.21.15.153:0/4054517042 >> 172.21.15.153:0/4054517042 conn(0x7f71a00cb330 msgr2=0x7f71a00c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:27.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 -- 172.21.15.153:0/4054517042 shutdown_connections 2023-08-17T00:14:27.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.794+0000 7f71a4b07700 1 -- 172.21.15.153:0/4054517042 wait complete. 2023-08-17T00:14:27.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.798+0000 7f71a4b07700 1 Processor -- start 2023-08-17T00:14:27.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.798+0000 7f71a4b07700 1 -- start start 2023-08-17T00:14:27.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188005000 0x7f71a00ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 0x7f71a0151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71a00c3200 0x7f71a00c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00c3b70 con 0x7f71a00af850 2023-08-17T00:14:27.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00ae830 con 0x7f7188005000 2023-08-17T00:14:27.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00aeb10 con 0x7f71a00c3200 2023-08-17T00:14:27.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 0x7f71a0151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 0x7f71a0151460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41470/0 (socket says 172.21.15.153:41470) 2023-08-17T00:14:27.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 -- 172.21.15.153:0/1237865018 learned_addr learned my addr 172.21.15.153:0/1237865018 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:27.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719f7fe700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188005000 0x7f71a00ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719ffff700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71a00c3200 0x7f71a00c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 -- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71a00c3200 msgr2=0x7f71a00c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71a00c3200 0x7f71a00c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 -- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188005000 msgr2=0x7f71a00ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188005000 0x7f71a00ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 -- 172.21.15.153:0/1237865018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a00aedf0 con 0x7f71a00af850 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f719effd700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 0x7f71a0151460 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f719400e800 tx=0x7f7194001ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194010490 con 0x7f71a00af850 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194010040 con 0x7f71a00af850 2023-08-17T00:14:27.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194010820 con 0x7f71a00af850 2023-08-17T00:14:27.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a00af0d0 con 0x7f71a00af850 2023-08-17T00:14:27.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.802+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a00b0520 con 0x7f71a00af850 2023-08-17T00:14:27.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.806+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a0163f00 con 0x7f71a00af850 2023-08-17T00:14:27.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.806+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7194010b90 con 0x7f71a00af850 2023-08-17T00:14:27.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.806+0000 7f71877fe700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f718c05a180 0x7f718c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:27.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.806+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f7194073ad0 con 0x7f71a00af850 2023-08-17T00:14:27.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.810+0000 7f719f7fe700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f718c05a180 0x7f718c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:27.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.810+0000 7f719f7fe700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f718c05a180 0x7f718c05c640 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f71900038d0 tx=0x7f719000c040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:27.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.814+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7194047350 con 0x7f71a00af850 2023-08-17T00:14:27.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.974+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71a006b4c0 con 0x7f71a00af850 2023-08-17T00:14:27.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.978+0000 7f71877fe700 1 -- 172.21.15.153:0/1237865018 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v143) v1 ==== 104+0+11 (secure 0 0 0) 0x7f719401a070 con 0x7f71a00af850 2023-08-17T00:14:27.982 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:14:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f718c05a180 msgr2=0x7f718c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f718c05a180 0x7f718c05c640 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f71900038d0 tx=0x7f719000c040).stop 2023-08-17T00:14:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 msgr2=0x7f71a0151460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 0x7f71a0151460 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 rx=0x7f719400e800 tx=0x7f7194001ca0).stop 2023-08-17T00:14:27.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 shutdown_connections 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f718c05a180 0x7f718c05c640 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71a00c3200 0x7f71a00c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f71a00af850 0x7f71a0151460 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 --2- 172.21.15.153:0/1237865018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7188005000 0x7f71a00ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 >> 172.21.15.153:0/1237865018 conn(0x7f71a00cb330 msgr2=0x7f71a01536f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 shutdown_connections 2023-08-17T00:14:27.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:27.982+0000 7f71a4b07700 1 -- 172.21.15.153:0/1237865018 wait complete. 2023-08-17T00:14:28.007 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.166+0000 7fc79e747700 1 Processor -- start 2023-08-17T00:14:28.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.166+0000 7fc79e747700 1 -- start start 2023-08-17T00:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79e747700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc798153f50 0x7fc798154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79e747700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7980c01a0 0x7fc7980c0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79e747700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7980bfd10 con 0x7fc7980c57a0 2023-08-17T00:14:28.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79e747700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc798154860 con 0x7fc7980c01a0 2023-08-17T00:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79e747700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc798154af0 con 0x7fc798153f50 2023-08-17T00:14:28.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79d745700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc7980c57a0 0x7fc7980c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35374/0 (socket says 172.21.15.153:35374) 2023-08-17T00:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79d745700 1 -- 172.21.15.153:0/1576181259 learned_addr learned my addr 172.21.15.153:0/1576181259 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79df46700 1 --2- 172.21.15.153:0/1576181259 >> v2:172.21.15.178:3300/0 conn(0x7fc7980c01a0 0x7fc7980c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79cf44700 1 --2- 172.21.15.153:0/1576181259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc798153f50 0x7fc798154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc78ffff700 1 -- 172.21.15.153:0/1576181259 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 419384718 0 0) 0x7fc7980bfd10 con 0x7fc7980c57a0 2023-08-17T00:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc78ffff700 1 -- 172.21.15.153:0/1576181259 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7840033f0 con 0x7fc7980c57a0 2023-08-17T00:14:28.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79cf44700 1 -- 172.21.15.153:0/1576181259 >> v2:172.21.15.178:3300/0 conn(0x7fc7980c01a0 msgr2=0x7fc7980c0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79cf44700 1 --2- 172.21.15.153:0/1576181259 >> v2:172.21.15.178:3300/0 conn(0x7fc7980c01a0 0x7fc7980c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79cf44700 1 -- 172.21.15.153:0/1576181259 >> v1:172.21.15.153:6789/0 conn(0x7fc7980c57a0 legacy=0x7fc7980c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79cf44700 1 -- 172.21.15.153:0/1576181259 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798154dd0 con 0x7fc798153f50 2023-08-17T00:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.170+0000 7fc79cf44700 1 --2- 172.21.15.153:0/1576181259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc798153f50 0x7fc798154370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc788009760 tx=0x7fc788009060).ready entity=mon.2 client_cookie=158da43bb5fc851b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc78ffff700 1 -- 172.21.15.153:0/1576181259 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800d4a0 con 0x7fc798153f50 2023-08-17T00:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc78ffff700 1 -- 172.21.15.153:0/1576181259 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800d600 con 0x7fc798153f50 2023-08-17T00:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc78ffff700 1 -- 172.21.15.153:0/1576181259 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800d980 con 0x7fc798153f50 2023-08-17T00:14:28.178 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 -- 172.21.15.153:0/1576181259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc798153f50 msgr2=0x7fc798154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 --2- 172.21.15.153:0/1576181259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc798153f50 0x7fc798154370 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fc788009760 tx=0x7fc788009060).stop 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 -- 172.21.15.153:0/1576181259 shutdown_connections 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 --2- 172.21.15.153:0/1576181259 >> v2:172.21.15.178:3300/0 conn(0x7fc7980c01a0 0x7fc7980c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 --2- 172.21.15.153:0/1576181259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc798153f50 0x7fc798154370 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 -- 172.21.15.153:0/1576181259 >> 172.21.15.153:0/1576181259 conn(0x7fc798062a70 msgr2=0x7fc7980ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 -- 172.21.15.153:0/1576181259 shutdown_connections 2023-08-17T00:14:28.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 -- 172.21.15.153:0/1576181259 wait complete. 2023-08-17T00:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 Processor -- start 2023-08-17T00:14:28.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.174+0000 7fc79e747700 1 -- start start 2023-08-17T00:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 0x7fc798168650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7980c57a0 0x7fc7980afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc798153f50 0x7fc7980b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7980b0890 con 0x7fc7980c01a0 2023-08-17T00:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc798169860 con 0x7fc798153f50 2023-08-17T00:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc798169b40 con 0x7fc7980c57a0 2023-08-17T00:14:28.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 0x7fc798168650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 0x7fc798168650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41472/0 (socket says 172.21.15.153:41472) 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 -- 172.21.15.153:0/3244496002 learned_addr learned my addr 172.21.15.153:0/3244496002 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79cf44700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7980c57a0 0x7fc7980afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79df46700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc798153f50 0x7fc7980b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 -- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7980c57a0 msgr2=0x7fc7980afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7980c57a0 0x7fc7980afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 -- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc798153f50 msgr2=0x7fc7980b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc798153f50 0x7fc7980b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 -- 172.21.15.153:0/3244496002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880092a0 con 0x7fc7980c01a0 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79cf44700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7980c57a0 0x7fc7980afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79df46700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc798153f50 0x7fc7980b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79d745700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 0x7fc798168650 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fc79400c450 tx=0x7fc794007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940072e0 con 0x7fc7980c01a0 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc794007440 con 0x7fc7980c01a0 2023-08-17T00:14:28.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7940057a0 con 0x7fc7980c01a0 2023-08-17T00:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc798168ee0 con 0x7fc7980c01a0 2023-08-17T00:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.178+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7981694a0 con 0x7fc7980c01a0 2023-08-17T00:14:28.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.182+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79806b4c0 con 0x7fc7980c01a0 2023-08-17T00:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.182+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc794010070 con 0x7fc7980c01a0 2023-08-17T00:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.182+0000 7fc78d7fa700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc77c05a120 0x7fc77c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.182+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fc794073930 con 0x7fc7980c01a0 2023-08-17T00:14:28.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.182+0000 7fc79cf44700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc77c05a120 0x7fc77c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.186+0000 7fc79cf44700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc77c05a120 0x7fc77c05c5e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fc7980c6210 tx=0x7fc788016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.190+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc794047210 con 0x7fc7980c01a0 2023-08-17T00:14:28.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.346+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7980bf9a0 con 0x7fc7980c01a0 2023-08-17T00:14:28.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.350+0000 7fc78d7fa700 1 -- 172.21.15.153:0/3244496002 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v143) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc79404a830 con 0x7fc7980c01a0 2023-08-17T00:14:28.353 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:14:28.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc77c05a120 msgr2=0x7fc77c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc77c05a120 0x7fc77c05c5e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fc7980c6210 tx=0x7fc788016000).stop 2023-08-17T00:14:28.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 msgr2=0x7fc798168650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 0x7fc798168650 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 rx=0x7fc79400c450 tx=0x7fc794007c80).stop 2023-08-17T00:14:28.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 shutdown_connections 2023-08-17T00:14:28.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc77c05a120 0x7fc77c05c5e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc798153f50 0x7fc7980b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7980c57a0 0x7fc7980afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 --2- 172.21.15.153:0/3244496002 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7980c01a0 0x7fc798168650 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 >> 172.21.15.153:0/3244496002 conn(0x7fc798062a70 msgr2=0x7fc7980aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:28.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 shutdown_connections 2023-08-17T00:14:28.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.354+0000 7fc79e747700 1 -- 172.21.15.153:0/3244496002 wait complete. 2023-08-17T00:14:28.376 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:28.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 Processor -- start 2023-08-17T00:14:28.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 -- start start 2023-08-17T00:14:28.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f407c0c0c80 0x7f407c0a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c1505d0 0x7f407c150a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407c0bc0b0 con 0x7f407c0a89c0 2023-08-17T00:14:28.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407c0bd590 con 0x7f407c0c0c80 2023-08-17T00:14:28.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.526+0000 7f4082edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c062fb0 con 0x7f407c1505d0 2023-08-17T00:14:28.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f4080c77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f407c0a89c0 0x7f407c0bcdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35384/0 (socket says 172.21.15.153:35384) 2023-08-17T00:14:28.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f4080c77700 1 -- 172.21.15.153:0/2970588535 learned_addr learned my addr 172.21.15.153:0/2970588535 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:28.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407bfff700 1 --2- 172.21.15.153:0/2970588535 >> v2:172.21.15.178:3300/0 conn(0x7f407c0c0c80 0x7f407c0a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f4081478700 1 --2- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c1505d0 0x7f407c150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407b7fe700 1 -- 172.21.15.153:0/2970588535 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1418494360 0 0) 0x7f407c0bc0b0 con 0x7f407c0a89c0 2023-08-17T00:14:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407b7fe700 1 -- 172.21.15.153:0/2970588535 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f406c0033f0 con 0x7f407c0a89c0 2023-08-17T00:14:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407bfff700 1 -- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c1505d0 msgr2=0x7f407c150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407bfff700 1 --2- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c1505d0 0x7f407c150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407bfff700 1 -- 172.21.15.153:0/2970588535 >> v1:172.21.15.153:6789/0 conn(0x7f407c0a89c0 legacy=0x7f407c0bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407bfff700 1 -- 172.21.15.153:0/2970588535 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0bb780 con 0x7f407c0c0c80 2023-08-17T00:14:28.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407bfff700 1 --2- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a8da0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f4068009760 tx=0x7f4068009060).ready entity=mon.1 client_cookie=266b9f06ad7cf616 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407b7fe700 1 -- 172.21.15.153:0/2970588535 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40680090d0 con 0x7f407c0c0c80 2023-08-17T00:14:28.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407b7fe700 1 -- 172.21.15.153:0/2970588535 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406800d4a0 con 0x7f407c0c0c80 2023-08-17T00:14:28.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.530+0000 7f407b7fe700 1 -- 172.21.15.153:0/2970588535 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406800d820 con 0x7f407c0c0c80 2023-08-17T00:14:28.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 -- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 msgr2=0x7f407c0a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 --2- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a8da0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f4068009760 tx=0x7f4068009060).stop 2023-08-17T00:14:28.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 -- 172.21.15.153:0/2970588535 shutdown_connections 2023-08-17T00:14:28.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 --2- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c1505d0 0x7f407c150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 --2- 172.21.15.153:0/2970588535 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a8da0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 -- 172.21.15.153:0/2970588535 >> 172.21.15.153:0/2970588535 conn(0x7f407c0c7150 msgr2=0x7f407c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:28.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 -- 172.21.15.153:0/2970588535 shutdown_connections 2023-08-17T00:14:28.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.534+0000 7f4082edb700 1 -- 172.21.15.153:0/2970588535 wait complete. 2023-08-17T00:14:28.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 Processor -- start 2023-08-17T00:14:28.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 -- start start 2023-08-17T00:14:28.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c0a89c0 0x7f407c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 0x7f407c1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c153db0 con 0x7f407c1505d0 2023-08-17T00:14:28.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407c150d30 con 0x7f407c0c0c80 2023-08-17T00:14:28.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4082edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407c0bf380 con 0x7f407c0a89c0 2023-08-17T00:14:28.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 0x7f407c1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 0x7f407c1513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41486/0 (socket says 172.21.15.153:41486) 2023-08-17T00:14:28.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 -- 172.21.15.153:0/179550107 learned_addr learned my addr 172.21.15.153:0/179550107 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:28.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f407bfff700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4080c77700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c0a89c0 0x7f407c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 -- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c0a89c0 msgr2=0x7f407c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c0a89c0 0x7f407c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 -- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 msgr2=0x7f407c0a7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 -- 172.21.15.153:0/179550107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40680092a0 con 0x7f407c1505d0 2023-08-17T00:14:28.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.538+0000 7f4081478700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 0x7f407c1513e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f4074009df0 tx=0x7f407400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407400cb50 con 0x7f407c1505d0 2023-08-17T00:14:28.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407c153ad0 con 0x7f407c1505d0 2023-08-17T00:14:28.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400f040 con 0x7f407c1505d0 2023-08-17T00:14:28.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407400cec0 con 0x7f407c1505d0 2023-08-17T00:14:28.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407c0bf010 con 0x7f407c1505d0 2023-08-17T00:14:28.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407c06b530 con 0x7f407c1505d0 2023-08-17T00:14:28.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.542+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4074013610 con 0x7f407c1505d0 2023-08-17T00:14:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.546+0000 7f4078ff9700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f406005a150 0x7f406005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.546+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f4074074b30 con 0x7f407c1505d0 2023-08-17T00:14:28.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.546+0000 7f4080c77700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f406005a150 0x7f406005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.546+0000 7f4080c77700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f406005a150 0x7f406005c610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f407c0ab390 tx=0x7f4070009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.550+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f40740485a0 con 0x7f407c1505d0 2023-08-17T00:14:28.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.738+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f407c0a8e40 con 0x7f407c1505d0 2023-08-17T00:14:28.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.742+0000 7f4078ff9700 1 -- 172.21.15.153:0/179550107 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+3751 (secure 0 0 0) 0x7f407404bbc0 con 0x7f407c1505d0 2023-08-17T00:14:28.745 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:28.746 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:28.341600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":24,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:28.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f406005a150 msgr2=0x7f406005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f406005a150 0x7f406005c610 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f407c0ab390 tx=0x7f4070009040).stop 2023-08-17T00:14:28.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 msgr2=0x7f407c1513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 0x7f407c1513e0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 rx=0x7f4074009df0 tx=0x7f407400b040).stop 2023-08-17T00:14:28.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 shutdown_connections 2023-08-17T00:14:28.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f406005a150 0x7f406005c610 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f407c1505d0 0x7f407c1513e0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f407c0c0c80 0x7f407c0a7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 --2- 172.21.15.153:0/179550107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f407c0a89c0 0x7f407c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 >> 172.21.15.153:0/179550107 conn(0x7f407c0c7150 msgr2=0x7f407c0694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 shutdown_connections 2023-08-17T00:14:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.746+0000 7f4082edb700 1 -- 172.21.15.153:0/179550107 wait complete. 2023-08-17T00:14:28.751 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 114 2023-08-17T00:14:28.769 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:28.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 Processor -- start 2023-08-17T00:14:28.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 -- start start 2023-08-17T00:14:28.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd27c0c57a0 0x7fd27c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c153f50 0x7fd27c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd27c0bfd10 con 0x7fd27c157600 2023-08-17T00:14:28.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27c154860 con 0x7fd27c0c57a0 2023-08-17T00:14:28.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd281107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c154af0 con 0x7fd27c153f50 2023-08-17T00:14:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd27bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd27c0c57a0 0x7fd27c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd27bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd27c0c57a0 0x7fd27c0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41500/0 (socket says 172.21.15.153:41500) 2023-08-17T00:14:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd27bfff700 1 -- 172.21.15.153:0/3066564081 learned_addr learned my addr 172.21.15.153:0/3066564081 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:28.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd273fff700 1 --2- 172.21.15.153:0/3066564081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c153f50 0x7fd27c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.922+0000 7fd27bfff700 1 -- 172.21.15.153:0/3066564081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c153f50 msgr2=0x7fd27c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27bfff700 1 --2- 172.21.15.153:0/3066564081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c153f50 0x7fd27c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27bfff700 1 -- 172.21.15.153:0/3066564081 >> v1:172.21.15.178:6789/0 conn(0x7fd27c157600 legacy=0x7fd27c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27bfff700 1 -- 172.21.15.153:0/3066564081 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27c154dd0 con 0x7fd27c0c57a0 2023-08-17T00:14:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27bfff700 1 --2- 172.21.15.153:0/3066564081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c5b80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fd26c009f20 tx=0x7fd26c009840).ready entity=mon.0 client_cookie=c68976a43b75938b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27b7fe700 1 -- 172.21.15.153:0/3066564081 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00e070 con 0x7fd27c0c57a0 2023-08-17T00:14:28.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27b7fe700 1 -- 172.21.15.153:0/3066564081 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00b9d0 con 0x7fd27c0c57a0 2023-08-17T00:14:28.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd27b7fe700 1 -- 172.21.15.153:0/3066564081 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c00bd50 con 0x7fd27c0c57a0 2023-08-17T00:14:28.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 -- 172.21.15.153:0/3066564081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 msgr2=0x7fd27c0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 --2- 172.21.15.153:0/3066564081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c5b80 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 rx=0x7fd26c009f20 tx=0x7fd26c009840).stop 2023-08-17T00:14:28.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 -- 172.21.15.153:0/3066564081 shutdown_connections 2023-08-17T00:14:28.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 --2- 172.21.15.153:0/3066564081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c153f50 0x7fd27c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 --2- 172.21.15.153:0/3066564081 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c5b80 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 -- 172.21.15.153:0/3066564081 >> 172.21.15.153:0/3066564081 conn(0x7fd27c062a70 msgr2=0x7fd27c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:28.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 -- 172.21.15.153:0/3066564081 shutdown_connections 2023-08-17T00:14:28.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.926+0000 7fd281107700 1 -- 172.21.15.153:0/3066564081 wait complete. 2023-08-17T00:14:28.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 Processor -- start 2023-08-17T00:14:28.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 -- start start 2023-08-17T00:14:28.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd27c153f50 0x7fd27c0ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c157600 0x7fd27c0aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0c4b60 con 0x7fd27c0c57a0 2023-08-17T00:14:28.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0ae920 con 0x7fd27c153f50 2023-08-17T00:14:28.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27c0c2410 con 0x7fd27c157600 2023-08-17T00:14:28.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41506/0 (socket says 172.21.15.153:41506) 2023-08-17T00:14:28.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 -- 172.21.15.153:0/309371707 learned_addr learned my addr 172.21.15.153:0/309371707 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:28.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd273fff700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd27c153f50 0x7fd27c0ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd280906700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c157600 0x7fd27c0aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 -- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c157600 msgr2=0x7fd27c0aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c157600 0x7fd27c0aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 -- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd27c153f50 msgr2=0x7fd27c0ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd27c153f50 0x7fd27c0ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 -- 172.21.15.153:0/309371707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd26c009ae0 con 0x7fd27c0c57a0 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd27bfff700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c4670 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fd26c00b610 tx=0x7fd26c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c0092e0 con 0x7fd27c0c57a0 2023-08-17T00:14:28.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26c00bb40 con 0x7fd27c0c57a0 2023-08-17T00:14:28.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd27c0ae080 con 0x7fd27c0c57a0 2023-08-17T00:14:28.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26c01c400 con 0x7fd27c0c57a0 2023-08-17T00:14:28.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.930+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27c0ae640 con 0x7fd27c0c57a0 2023-08-17T00:14:28.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.934+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27c0c21e0 con 0x7fd27c0c57a0 2023-08-17T00:14:28.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.934+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd26c01c770 con 0x7fd27c0c57a0 2023-08-17T00:14:28.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.938+0000 7fd278ff9700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25c05a150 0x7fd25c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:28.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.938+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7fd26c075a10 con 0x7fd27c0c57a0 2023-08-17T00:14:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.938+0000 7fd273fff700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25c05a150 0x7fd25c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.938+0000 7fd273fff700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25c05a150 0x7fd25c05c610 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd27c0c9c10 tx=0x7fd264009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:28.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:28.942+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd27c0c21e0 con 0x7fd27c0c57a0 2023-08-17T00:14:29.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.102+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd27c0c21e0 con 0x7fd27c0c57a0 2023-08-17T00:14:29.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.106+0000 7fd278ff9700 1 -- 172.21.15.153:0/309371707 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+17362 (secure 0 0 0) 0x7fd27c0c21e0 con 0x7fd27c0c57a0 2023-08-17T00:14:29.111 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:29.111 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":143,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:17.331131+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:13:08.136187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T00:13:09.146761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"20.0","mappings":[{"from":3,"to":7}]},{"pgid":"20.12","mappings":[{"from":3,"to":7}]},{"pgid":"20.24","mappings":[{"from":3,"to":1}]},{"pgid":"20.35","mappings":[{"from":3,"to":7}]},{"pgid":"20.3c","mappings":[{"from":3,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.178:6835/3000779485":"2023-08-18T00:14:17.330996+0000","172.21.15.178:6834/3000779485":"2023-08-18T00:14:17.330996+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:29.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25c05a150 msgr2=0x7fd25c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25c05a150 0x7fd25c05c610 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fd27c0c9c10 tx=0x7fd264009060).stop 2023-08-17T00:14:29.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 msgr2=0x7fd27c0c4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c4670 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 rx=0x7fd26c00b610 tx=0x7fd26c009840).stop 2023-08-17T00:14:29.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 shutdown_connections 2023-08-17T00:14:29.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd25c05a150 0x7fd25c05c610 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd27c157600 0x7fd27c0aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd27c153f50 0x7fd27c0ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 --2- 172.21.15.153:0/309371707 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd27c0c57a0 0x7fd27c0c4670 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 >> 172.21.15.153:0/309371707 conn(0x7fd27c062a70 msgr2=0x7fd27c152140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:29.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 shutdown_connections 2023-08-17T00:14:29.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.110+0000 7fd281107700 1 -- 172.21.15.153:0/309371707 wait complete. 2023-08-17T00:14:29.134 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:14:29.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:29.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.286+0000 7f420df69700 1 Processor -- start 2023-08-17T00:14:29.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.286+0000 7f420df69700 1 -- start start 2023-08-17T00:14:29.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f420df69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 0x7f4208065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f420df69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4208065b50 0x7f4208064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f420df69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4208061fa0 con 0x7f4208151b90 2023-08-17T00:14:29.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f420df69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42080c3fb0 con 0x7f4208065b50 2023-08-17T00:14:29.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f420df69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42081523d0 con 0x7f4208151f70 2023-08-17T00:14:29.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f4207fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4208065b50 0x7f4208064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f41fffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 0x7f4208065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f41fffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 0x7f4208065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:59160/0 (socket says 172.21.15.153:59160) 2023-08-17T00:14:29.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f41fffff700 1 -- 172.21.15.153:0/3555797417 learned_addr learned my addr 172.21.15.153:0/3555797417 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:29.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.290+0000 7f42077fe700 1 --1- 172.21.15.153:0/3555797417 >> v1:172.21.15.178:6789/0 conn(0x7f4208151b90 0x7f4208063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:48280/0 (socket says 172.21.15.153:48280) 2023-08-17T00:14:29.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4207fff700 1 -- 172.21.15.153:0/3555797417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 msgr2=0x7f4208065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:29.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4207fff700 1 --2- 172.21.15.153:0/3555797417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 0x7f4208065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4206ffd700 1 -- 172.21.15.153:0/3555797417 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3736952041 0 0) 0x7f4208061fa0 con 0x7f4208151b90 2023-08-17T00:14:29.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4207fff700 1 -- 172.21.15.153:0/3555797417 >> v1:172.21.15.178:6789/0 conn(0x7f4208151b90 legacy=0x7f4208063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4207fff700 1 -- 172.21.15.153:0/3555797417 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080621f0 con 0x7f4208065b50 2023-08-17T00:14:29.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f41fffff700 1 --2- 172.21.15.153:0/3555797417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 0x7f4208065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:29.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4207fff700 1 --2- 172.21.15.153:0/3555797417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208065b50 0x7f4208064870 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f4200009e60 tx=0x7f4200009780).ready entity=mon.0 client_cookie=7f4215881a20ddbd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:29.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4206ffd700 1 -- 172.21.15.153:0/3555797417 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420000e070 con 0x7f4208065b50 2023-08-17T00:14:29.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4206ffd700 1 -- 172.21.15.153:0/3555797417 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420000bb60 con 0x7f4208065b50 2023-08-17T00:14:29.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f4206ffd700 1 -- 172.21.15.153:0/3555797417 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4200012410 con 0x7f4208065b50 2023-08-17T00:14:29.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 -- 172.21.15.153:0/3555797417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208065b50 msgr2=0x7f4208064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 --2- 172.21.15.153:0/3555797417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208065b50 0x7f4208064870 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 rx=0x7f4200009e60 tx=0x7f4200009780).stop 2023-08-17T00:14:29.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 -- 172.21.15.153:0/3555797417 shutdown_connections 2023-08-17T00:14:29.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 --2- 172.21.15.153:0/3555797417 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208065b50 0x7f4208064870 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 --2- 172.21.15.153:0/3555797417 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208151f70 0x7f4208065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 -- 172.21.15.153:0/3555797417 >> 172.21.15.153:0/3555797417 conn(0x7f42080c7150 msgr2=0x7f42080c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:29.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 -- 172.21.15.153:0/3555797417 shutdown_connections 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 -- 172.21.15.153:0/3555797417 wait complete. 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.294+0000 7f420df69700 1 Processor -- start 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 -- start start 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208065b50 0x7f42080c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 0x7f42080c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4208151f70 0x7f42080c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42080c2310 con 0x7f4208151b90 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42080aa510 con 0x7f4208151f70 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42080c0570 con 0x7f4208065b50 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 0x7f42080c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 0x7f42080c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41526/0 (socket says 172.21.15.153:41526) 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 -- 172.21.15.153:0/1285209033 learned_addr learned my addr 172.21.15.153:0/1285209033 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f42077fe700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208065b50 0x7f42080c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f4207fff700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4208151f70 0x7f42080c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 -- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208065b50 msgr2=0x7f42080c0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208065b50 0x7f42080c0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 -- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4208151f70 msgr2=0x7f42080c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4208151f70 0x7f42080c1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 -- 172.21.15.153:0/1285209033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f0009370 con 0x7f4208151b90 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41fffff700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 0x7f42080c1930 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f41f000ea50 tx=0x7f41f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000c850 con 0x7f4208151b90 2023-08-17T00:14:29.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000c9b0 con 0x7f4208151b90 2023-08-17T00:14:29.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4200009a20 con 0x7f4208151b90 2023-08-17T00:14:29.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f000cd30 con 0x7f4208151b90 2023-08-17T00:14:29.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.298+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42081541d0 con 0x7f4208151b90 2023-08-17T00:14:29.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.302+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f41f0022070 con 0x7f4208151b90 2023-08-17T00:14:29.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.302+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420806b530 con 0x7f4208151b90 2023-08-17T00:14:29.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.302+0000 7f41ff7fe700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e805a150 0x7f41e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.302+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f41f0074710 con 0x7f4208151b90 2023-08-17T00:14:29.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.302+0000 7f42077fe700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e805a150 0x7f41e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.302+0000 7f42077fe700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e805a150 0x7f41e805c610 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f41f80011e0 tx=0x7f41f8007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:29.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.306+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f41f0047ff0 con 0x7f4208151b90 2023-08-17T00:14:29.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.502+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42080c3ab0 con 0x7f4208151b90 2023-08-17T00:14:29.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.502+0000 7f41ff7fe700 1 -- 172.21.15.153:0/1285209033 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+3751 (secure 0 0 0) 0x7f41f0016090 con 0x7f4208151b90 2023-08-17T00:14:29.508 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:29.508 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:28.341600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":24,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:29.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e805a150 msgr2=0x7f41e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e805a150 0x7f41e805c610 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f41f80011e0 tx=0x7f41f8007bd0).stop 2023-08-17T00:14:29.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 msgr2=0x7f42080c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 0x7f42080c1930 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 rx=0x7f41f000ea50 tx=0x7f41f00090f0).stop 2023-08-17T00:14:29.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 shutdown_connections 2023-08-17T00:14:29.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e805a150 0x7f41e805c610 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4208151f70 0x7f42080c1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4208151b90 0x7f42080c1930 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 --2- 172.21.15.153:0/1285209033 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4208065b50 0x7f42080c0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 >> 172.21.15.153:0/1285209033 conn(0x7f42080c7150 msgr2=0x7f42080c5210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:29.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 shutdown_connections 2023-08-17T00:14:29.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.506+0000 7f420df69700 1 -- 172.21.15.153:0/1285209033 wait complete. 2023-08-17T00:14:29.514 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 114 2023-08-17T00:14:29.530 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:29.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.682+0000 7f396d1b9700 1 Processor -- start 2023-08-17T00:14:29.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.682+0000 7f396d1b9700 1 -- start start 2023-08-17T00:14:29.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396d1b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39680abf10 0x7f3968068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396d1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680c1190 0x7f3968068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396d1b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39681545e0 con 0x7f39680ac2f0 2023-08-17T00:14:29.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396d1b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3968069200 con 0x7f39680abf10 2023-08-17T00:14:29.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396d1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680c1c50 con 0x7f39680c1190 2023-08-17T00:14:29.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f3967fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39680abf10 0x7f3968068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f395f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f39680ac2f0 0x7f39680c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35396/0 (socket says 172.21.15.153:35396) 2023-08-17T00:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f395f7fe700 1 -- 172.21.15.153:0/3691275875 learned_addr learned my addr 172.21.15.153:0/3691275875 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396c9b8700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680c1190 0x7f3968068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f39677fe700 1 -- 172.21.15.153:0/3691275875 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360858164 0 0) 0x7f39681545e0 con 0x7f39680ac2f0 2023-08-17T00:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f39677fe700 1 -- 172.21.15.153:0/3691275875 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39540033f0 con 0x7f39680ac2f0 2023-08-17T00:14:29.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f3967fff700 1 -- 172.21.15.153:0/3691275875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680c1190 msgr2=0x7f3968068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f3967fff700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680c1190 0x7f3968068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f3967fff700 1 -- 172.21.15.153:0/3691275875 >> v1:172.21.15.153:6789/0 conn(0x7f39680ac2f0 legacy=0x7f39680c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f3967fff700 1 -- 172.21.15.153:0/3691275875 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39680a96d0 con 0x7f39680abf10 2023-08-17T00:14:29.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f396c9b8700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680c1190 0x7f3968068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.686+0000 7f3967fff700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680abf10 0x7f3968068820 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f3958009eb0 tx=0x7f3958009780).ready entity=mon.0 client_cookie=48e1b0a18ea1048a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f39677fe700 1 -- 172.21.15.153:0/3691275875 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800e070 con 0x7f39680abf10 2023-08-17T00:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f39677fe700 1 -- 172.21.15.153:0/3691275875 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800bc30 con 0x7f39680abf10 2023-08-17T00:14:29.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f39677fe700 1 -- 172.21.15.153:0/3691275875 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958012410 con 0x7f39680abf10 2023-08-17T00:14:29.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 -- 172.21.15.153:0/3691275875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680abf10 msgr2=0x7f3968068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680abf10 0x7f3968068820 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 rx=0x7f3958009eb0 tx=0x7f3958009780).stop 2023-08-17T00:14:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 -- 172.21.15.153:0/3691275875 shutdown_connections 2023-08-17T00:14:29.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680c1190 0x7f3968068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3691275875 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680abf10 0x7f3968068820 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 -- 172.21.15.153:0/3691275875 >> 172.21.15.153:0/3691275875 conn(0x7f39680c6620 msgr2=0x7f39680c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 -- 172.21.15.153:0/3691275875 shutdown_connections 2023-08-17T00:14:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 -- 172.21.15.153:0/3691275875 wait complete. 2023-08-17T00:14:29.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 Processor -- start 2023-08-17T00:14:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.690+0000 7f396d1b9700 1 -- start start 2023-08-17T00:14:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680abf10 0x7f39680b9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39680ac2f0 0x7f39680bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 0x7f39680bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396814c680 con 0x7f39680c1190 2023-08-17T00:14:29.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39680bc8e0 con 0x7f39680ac2f0 2023-08-17T00:14:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39680bb110 con 0x7f39680abf10 2023-08-17T00:14:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 0x7f39680bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 0x7f39680bc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41552/0 (socket says 172.21.15.153:41552) 2023-08-17T00:14:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 -- 172.21.15.153:0/3330512941 learned_addr learned my addr 172.21.15.153:0/3330512941 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f3967fff700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680abf10 0x7f39680b9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f395f7fe700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39680ac2f0 0x7f39680bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 -- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680abf10 msgr2=0x7f39680b9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680abf10 0x7f39680b9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 -- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39680ac2f0 msgr2=0x7f39680bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39680ac2f0 0x7f39680bbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 -- 172.21.15.153:0/3330512941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958009a20 con 0x7f39680c1190 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f3967fff700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680abf10 0x7f39680b9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:29.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396c9b8700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 0x7f39680bc3f0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f396000d630 tx=0x7f3960008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960011590 con 0x7f39680c1190 2023-08-17T00:14:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39600116f0 con 0x7f39680c1190 2023-08-17T00:14:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39680ba500 con 0x7f39680c1190 2023-08-17T00:14:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960011a90 con 0x7f39680c1190 2023-08-17T00:14:29.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.694+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39680baac0 con 0x7f39680c1190 2023-08-17T00:14:29.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.698+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39680c61f0 con 0x7f39680c1190 2023-08-17T00:14:29.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.698+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3960012420 con 0x7f39680c1190 2023-08-17T00:14:29.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.702+0000 7f3964ff9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f394805a150 0x7f394805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:29.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.702+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f3960073d50 con 0x7f39680c1190 2023-08-17T00:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.702+0000 7f3967fff700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f394805a150 0x7f394805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:29.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.702+0000 7f3967fff700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f394805a150 0x7f394805c610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f395800b9f0 tx=0x7f3968064af0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:29.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.706+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f39680c61f0 con 0x7f39680c1190 2023-08-17T00:14:29.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.922+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f39680c61f0 con 0x7f39680c1190 2023-08-17T00:14:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f3964ff9700 1 -- 172.21.15.153:0/3330512941 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+3751 (secure 0 0 0) 0x7f39680c61f0 con 0x7f39680c1190 2023-08-17T00:14:29.930 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:29.930 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":114,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:13:10.107853+0000","modified":"2023-08-17T00:14:28.341600+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":143,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8457":{"gid":8457,"name":"a","rank":0,"incarnation":110,"state":"up:active","state_seq":24,"addr":"172.21.15.153:6835/1483559229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":1483559229},{"type":"v1","addr":"172.21.15.153:6835","nonce":1483559229}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-08-17T00:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f394805a150 msgr2=0x7f394805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f394805a150 0x7f394805c610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f395800b9f0 tx=0x7f3968064af0).stop 2023-08-17T00:14:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 msgr2=0x7f39680bc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:29.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 0x7f39680bc3f0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 rx=0x7f396000d630 tx=0x7f3960008040).stop 2023-08-17T00:14:29.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 shutdown_connections 2023-08-17T00:14:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f394805a150 0x7f394805c610 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39680c1190 0x7f39680bc3f0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39680ac2f0 0x7f39680bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 --2- 172.21.15.153:0/3330512941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39680abf10 0x7f39680b9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.926+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 >> 172.21.15.153:0/3330512941 conn(0x7f39680c6620 msgr2=0x7f39680a98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.930+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 shutdown_connections 2023-08-17T00:14:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:29.930+0000 7f396d1b9700 1 -- 172.21.15.153:0/3330512941 wait complete. 2023-08-17T00:14:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 114 2023-08-17T00:14:29.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.106+0000 7f8bef569700 1 Processor -- start 2023-08-17T00:14:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bef569700 1 -- start start 2023-08-17T00:14:30.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bef569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be8151b90 0x7f8be8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bef569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8be8063290 0x7f8be8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bef569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be8061fa0 con 0x7f8be8065b50 2023-08-17T00:14:30.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bef569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80c3fb0 con 0x7f8be8151b90 2023-08-17T00:14:30.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bef569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be8152460 con 0x7f8be8063290 2023-08-17T00:14:30.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bed305700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be8151b90 0x7f8be8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bed305700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8be8151b90 0x7f8be8151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41568/0 (socket says 172.21.15.153:41568) 2023-08-17T00:14:30.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.110+0000 7f8bed305700 1 -- 172.21.15.153:0/702772047 learned_addr learned my addr 172.21.15.153:0/702772047 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:30.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8becb04700 1 --2- 172.21.15.153:0/702772047 >> v2:172.21.15.178:3300/0 conn(0x7f8be8063290 0x7f8be8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8bed305700 1 -- 172.21.15.153:0/702772047 >> v2:172.21.15.178:3300/0 conn(0x7f8be8063290 msgr2=0x7f8be8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:30.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8bed305700 1 --2- 172.21.15.153:0/702772047 >> v2:172.21.15.178:3300/0 conn(0x7f8be8063290 0x7f8be8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8bed305700 1 -- 172.21.15.153:0/702772047 >> v1:172.21.15.178:6789/0 conn(0x7f8be8065b50 legacy=0x7f8be8064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8bed305700 1 -- 172.21.15.153:0/702772047 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be80621f0 con 0x7f8be8151b90 2023-08-17T00:14:30.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8bed305700 1 --2- 172.21.15.153:0/702772047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8151b90 0x7f8be8151f70 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f8be805ebc0 tx=0x7f8be40090f0).ready entity=mon.0 client_cookie=72417bc88949af7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:30.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.114+0000 7f8bdffff700 1 -- 172.21.15.153:0/702772047 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400b600 con 0x7f8be8151b90 2023-08-17T00:14:30.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bdffff700 1 -- 172.21.15.153:0/702772047 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400b760 con 0x7f8be8151b90 2023-08-17T00:14:30.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bdffff700 1 -- 172.21.15.153:0/702772047 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400bae0 con 0x7f8be8151b90 2023-08-17T00:14:30.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 -- 172.21.15.153:0/702772047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8151b90 msgr2=0x7f8be8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 --2- 172.21.15.153:0/702772047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8151b90 0x7f8be8151f70 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 rx=0x7f8be805ebc0 tx=0x7f8be40090f0).stop 2023-08-17T00:14:30.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 -- 172.21.15.153:0/702772047 shutdown_connections 2023-08-17T00:14:30.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 --2- 172.21.15.153:0/702772047 >> v2:172.21.15.178:3300/0 conn(0x7f8be8063290 0x7f8be8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 --2- 172.21.15.153:0/702772047 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8151b90 0x7f8be8151f70 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 -- 172.21.15.153:0/702772047 >> 172.21.15.153:0/702772047 conn(0x7f8be80c7150 msgr2=0x7f8be80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:30.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 -- 172.21.15.153:0/702772047 shutdown_connections 2023-08-17T00:14:30.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 -- 172.21.15.153:0/702772047 wait complete. 2023-08-17T00:14:30.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 Processor -- start 2023-08-17T00:14:30.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.118+0000 7f8bef569700 1 -- start start 2023-08-17T00:14:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 0x7f8be80c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8be8065b50 0x7f8be8141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8be8151b90 0x7f8be80c0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80bfb10 con 0x7f8be8063290 2023-08-17T00:14:30.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8153730 con 0x7f8be8065b50 2023-08-17T00:14:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be80bf270 con 0x7f8be8151b90 2023-08-17T00:14:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 0x7f8be80c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 0x7f8be80c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41582/0 (socket says 172.21.15.153:41582) 2023-08-17T00:14:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 -- 172.21.15.153:0/3155654429 learned_addr learned my addr 172.21.15.153:0/3155654429 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8becb04700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8be8065b50 0x7f8be8141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bedb06700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8be8151b90 0x7f8be80c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 -- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8be8151b90 msgr2=0x7f8be80c0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8be8151b90 0x7f8be80c0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 -- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8be8065b50 msgr2=0x7f8be8141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8be8065b50 0x7f8be8141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 -- 172.21.15.153:0/3155654429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009370 con 0x7f8be8063290 2023-08-17T00:14:30.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bed305700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 0x7f8be80c2590 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f8be4006fd0 tx=0x7f8be4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:30.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400b8d0 con 0x7f8be8063290 2023-08-17T00:14:30.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be400ba30 con 0x7f8be8063290 2023-08-17T00:14:30.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be401b620 con 0x7f8be8063290 2023-08-17T00:14:30.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be80bf550 con 0x7f8be8063290 2023-08-17T00:14:30.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.122+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be80c2a80 con 0x7f8be8063290 2023-08-17T00:14:30.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.126+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be80c2c70 con 0x7f8be8063290 2023-08-17T00:14:30.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.126+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8be400f070 con 0x7f8be8063290 2023-08-17T00:14:30.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.126+0000 7f8bdd7fa700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8bcc05a150 0x7f8bcc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.126+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f8be4075620 con 0x7f8be8063290 2023-08-17T00:14:30.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.126+0000 7f8becb04700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8bcc05a150 0x7f8bcc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.130+0000 7f8becb04700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8bcc05a150 0x7f8bcc05c610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f8be81555a0 tx=0x7f8bd8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:30.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.134+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8be4048fb0 con 0x7f8be8063290 2023-08-17T00:14:30.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.298+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8be806b530 con 0x7f8be8063290 2023-08-17T00:14:30.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bdd7fa700 1 -- 172.21.15.153:0/3155654429 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+17362 (secure 0 0 0) 0x7f8be404c5d0 con 0x7f8be8063290 2023-08-17T00:14:30.305 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:30.306 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":143,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:17.331131+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:13:08.136187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-08-17T00:13:09.146761+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"20.0","mappings":[{"from":3,"to":7}]},{"pgid":"20.12","mappings":[{"from":3,"to":7}]},{"pgid":"20.24","mappings":[{"from":3,"to":1}]},{"pgid":"20.35","mappings":[{"from":3,"to":7}]},{"pgid":"20.3c","mappings":[{"from":3,"to":7}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.178:6835/3000779485":"2023-08-18T00:14:17.330996+0000","172.21.15.178:6834/3000779485":"2023-08-18T00:14:17.330996+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8bcc05a150 msgr2=0x7f8bcc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8bcc05a150 0x7f8bcc05c610 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f8be81555a0 tx=0x7f8bd8008040).stop 2023-08-17T00:14:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 msgr2=0x7f8be80c2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 0x7f8be80c2590 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 rx=0x7f8be4006fd0 tx=0x7f8be4017000).stop 2023-08-17T00:14:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 shutdown_connections 2023-08-17T00:14:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8bcc05a150 0x7f8bcc05c610 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8be8151b90 0x7f8be80c0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8be8065b50 0x7f8be8141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 --2- 172.21.15.153:0/3155654429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8be8063290 0x7f8be80c2590 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 >> 172.21.15.153:0/3155654429 conn(0x7f8be80c7150 msgr2=0x7f8be80abd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 shutdown_connections 2023-08-17T00:14:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.302+0000 7f8bef569700 1 -- 172.21.15.153:0/3155654429 wait complete. 2023-08-17T00:14:30.329 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:14:30.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.482+0000 7f659a9db700 1 Processor -- start 2023-08-17T00:14:30.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.482+0000 7f659a9db700 1 -- start start 2023-08-17T00:14:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f659a9db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6594153e90 0x7f65940c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f659a9db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 0x7f65940ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f659a9db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65940aa750 con 0x7f6594153ab0 2023-08-17T00:14:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f659a9db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65940c9dd0 con 0x7f6594153e90 2023-08-17T00:14:30.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f659a9db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940aacf0 con 0x7f65940c7980 2023-08-17T00:14:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f6593fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6594153ab0 0x7f65940c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35406/0 (socket says 172.21.15.153:35406) 2023-08-17T00:14:30.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f6593fff700 1 -- 172.21.15.153:0/2153830895 learned_addr learned my addr 172.21.15.153:0/2153830895 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f6598f78700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 0x7f65940ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f658b7fe700 1 --2- 172.21.15.153:0/2153830895 >> v2:172.21.15.178:3300/0 conn(0x7f6594153e90 0x7f65940c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062095196 0 0) 0x7f65940aa750 con 0x7f6594153ab0 2023-08-17T00:14:30.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65800033f0 con 0x7f6594153ab0 2023-08-17T00:14:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3712450789 0 0) 0x7f65800033f0 con 0x7f6594153ab0 2023-08-17T00:14:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 msgr2=0x7f65940ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 0x7f65940ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 >> v2:172.21.15.178:3300/0 conn(0x7f6594153e90 msgr2=0x7f65940c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 --2- 172.21.15.153:0/2153830895 >> v2:172.21.15.178:3300/0 conn(0x7f6594153e90 0x7f65940c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65941542f0 con 0x7f6594153ab0 2023-08-17T00:14:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f6584001810 con 0x7f6594153ab0 2023-08-17T00:14:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 >> v1:172.21.15.153:6789/0 conn(0x7f6594153ab0 legacy=0x7f65940c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65800038e0 0x7f6580003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 0x7f6580004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6580004b80 0x7f6580005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c9dd0 con 0x7f6580004b80 2023-08-17T00:14:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940aacf0 con 0x7f65800038e0 2023-08-17T00:14:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.486+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658000b8e0 con 0x7f65940c7980 2023-08-17T00:14:30.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6580004b80 0x7f6580005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f658b7fe700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 0x7f6580004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6593fff700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65800038e0 0x7f6580003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 -- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 msgr2=0x7f6580004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940c7980 0x7f6580004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 -- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65800038e0 msgr2=0x7f6580003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:30.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65800038e0 0x7f6580003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 -- 172.21.15.153:0/2153830895 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65800033f0 con 0x7f6580004b80 2023-08-17T00:14:30.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6580004b80 0x7f6580005000 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f658c009a80 tx=0x7f658c009060).ready entity=mon.0 client_cookie=1badb9d86651e020 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c009430 con 0x7f6580004b80 2023-08-17T00:14:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c00e640 con 0x7f6580004b80 2023-08-17T00:14:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f65937fe700 1 -- 172.21.15.153:0/2153830895 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c00e9c0 con 0x7f6580004b80 2023-08-17T00:14:30.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f659a9db700 1 -- 172.21.15.153:0/2153830895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6580004b80 msgr2=0x7f6580005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f659a9db700 1 --2- 172.21.15.153:0/2153830895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6580004b80 0x7f6580005000 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 rx=0x7f658c009a80 tx=0x7f658c009060).stop 2023-08-17T00:14:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f6598f78700 1 -- 172.21.15.153:0/2153830895 reap_dead start 2023-08-17T00:14:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f659a9db700 1 -- 172.21.15.153:0/2153830895 shutdown_connections 2023-08-17T00:14:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f659a9db700 1 -- 172.21.15.153:0/2153830895 >> 172.21.15.153:0/2153830895 conn(0x7f6594061fa0 msgr2=0x7f65940623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:30.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f659a9db700 1 -- 172.21.15.153:0/2153830895 shutdown_connections 2023-08-17T00:14:30.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.490+0000 7f659a9db700 1 -- 172.21.15.153:0/2153830895 wait complete. 2023-08-17T00:14:30.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.494+0000 7f659a9db700 1 Processor -- start 2023-08-17T00:14:30.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.494+0000 7f659a9db700 1 -- start start 2023-08-17T00:14:30.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.494+0000 7f659a9db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6580004b80 0x7f6594169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940af940 0x7f6594068c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 0x7f65940c36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940b0a30 con 0x7f65940c3240 2023-08-17T00:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c2ad0 con 0x7f6580004b80 2023-08-17T00:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c2db0 con 0x7f65940af940 2023-08-17T00:14:30.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 0x7f65940c36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 0x7f65940c36c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41602/0 (socket says 172.21.15.153:41602) 2023-08-17T00:14:30.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 -- 172.21.15.153:0/3943767505 learned_addr learned my addr 172.21.15.153:0/3943767505 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:30.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f658b7fe700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940af940 0x7f6594068c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6593fff700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6580004b80 0x7f6594169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 -- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940af940 msgr2=0x7f6594068c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940af940 0x7f6594068c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 -- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6580004b80 msgr2=0x7f6594169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:30.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6580004b80 0x7f6594169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:30.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 -- 172.21.15.153:0/3943767505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940b0190 con 0x7f65940c3240 2023-08-17T00:14:30.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6598f78700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 0x7f65940c36c0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f658c00e4b0 tx=0x7f658c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:30.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c009ec0 con 0x7f65940c3240 2023-08-17T00:14:30.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c00e7b0 con 0x7f65940c3240 2023-08-17T00:14:30.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c026670 con 0x7f65940c3240 2023-08-17T00:14:30.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65940b0470 con 0x7f65940c3240 2023-08-17T00:14:30.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65940afdc0 con 0x7f65940c3240 2023-08-17T00:14:30.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.498+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65940c2f40 con 0x7f65940c3240 2023-08-17T00:14:30.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.502+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f658c0269e0 con 0x7f65940c3240 2023-08-17T00:14:30.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.502+0000 7f6590ff9700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f657405a180 0x7f657405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:30.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.502+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6352+0+0 (secure 0 0 0) 0x7f658c075f80 con 0x7f65940c3240 2023-08-17T00:14:30.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.502+0000 7f6593fff700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f657405a180 0x7f657405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:30.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.506+0000 7f6593fff700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f657405a180 0x7f657405c640 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f65941512e0 tx=0x7f65940c9f10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:30.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.510+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f658c049860 con 0x7f65940c3240 2023-08-17T00:14:30.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:30.702+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f659406b530 con 0x7f65940c3240 2023-08-17T00:14:31.123 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:14:31.118+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:14:31.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f6590ff9700 1 -- 172.21.15.153:0/3943767505 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) v1 ==== 161+0+0 (secure 0 0 0) 0x7f658c02b070 con 0x7f65940c3240 2023-08-17T00:14:31.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f657405a180 msgr2=0x7f657405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:31.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f657405a180 0x7f657405c640 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f65941512e0 tx=0x7f65940c9f10).stop 2023-08-17T00:14:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 msgr2=0x7f65940c36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 0x7f65940c36c0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 rx=0x7f658c00e4b0 tx=0x7f658c01a000).stop 2023-08-17T00:14:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 shutdown_connections 2023-08-17T00:14:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f657405a180 0x7f657405c640 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.126+0000 7f659a9db700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f65940c3240 0x7f65940c36c0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.130+0000 7f659a9db700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65940af940 0x7f6594068c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.130+0000 7f659a9db700 1 --2- 172.21.15.153:0/3943767505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6580004b80 0x7f6594169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.130+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 >> 172.21.15.153:0/3943767505 conn(0x7f6594061fa0 msgr2=0x7f65940cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:31.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.130+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 shutdown_connections 2023-08-17T00:14:31.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.130+0000 7f659a9db700 1 -- 172.21.15.153:0/3943767505 wait complete. 2023-08-17T00:14:31.135 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:14:31.154 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:14:31.199 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:14:31.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.322+0000 7fa2de29b700 1 Processor -- start 2023-08-17T00:14:31.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.322+0000 7fa2de29b700 1 -- start start 2023-08-17T00:14:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8065e80 0x7fa2d80631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:31.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa2d8154310 0x7fa2d80c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d8062d50 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d80c34f0 con 0x7fa2d8154310 2023-08-17T00:14:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8154aa0 con 0x7fa2d8065e80 2023-08-17T00:14:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d77fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa2d80c2ba0 0x7fa2d8153c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35420/0 (socket says 172.21.15.153:35420) 2023-08-17T00:14:31.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d77fe700 1 -- 172.21.15.153:0/1106280398 learned_addr learned my addr 172.21.15.153:0/1106280398 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:31.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2dc838700 1 --2- 172.21.15.153:0/1106280398 >> v2:172.21.15.153:3300/0 conn(0x7fa2d8154310 0x7fa2d80c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:31.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d7fff700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8065e80 0x7fa2d80631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:31.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d6ffd700 1 -- 172.21.15.153:0/1106280398 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50036132 0 0) 0x7fa2d8062d50 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d6ffd700 1 -- 172.21.15.153:0/1106280398 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c00033f0 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2dc838700 1 -- 172.21.15.153:0/1106280398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8065e80 msgr2=0x7fa2d80631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:31.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2dc838700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8065e80 0x7fa2d80631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2dc838700 1 -- 172.21.15.153:0/1106280398 >> v1:172.21.15.153:6789/0 conn(0x7fa2d80c2ba0 legacy=0x7fa2d8153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:31.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2dc838700 1 -- 172.21.15.153:0/1106280398 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8062140 con 0x7fa2d8154310 2023-08-17T00:14:31.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d7fff700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8065e80 0x7fa2d80631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:31.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2dc838700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d8154310 0x7fa2d80c3000 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fa2d000af70 tx=0x7fa2d000a890).ready entity=mon.0 client_cookie=727c6da6c415e4f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:31.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d6ffd700 1 -- 172.21.15.153:0/1106280398 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000f070 con 0x7fa2d8154310 2023-08-17T00:14:31.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d6ffd700 1 -- 172.21.15.153:0/1106280398 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000a2e0 con 0x7fa2d8154310 2023-08-17T00:14:31.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2d6ffd700 1 -- 172.21.15.153:0/1106280398 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000cc30 con 0x7fa2d8154310 2023-08-17T00:14:31.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 -- 172.21.15.153:0/1106280398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d8154310 msgr2=0x7fa2d80c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:31.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d8154310 0x7fa2d80c3000 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 rx=0x7fa2d000af70 tx=0x7fa2d000a890).stop 2023-08-17T00:14:31.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 -- 172.21.15.153:0/1106280398 shutdown_connections 2023-08-17T00:14:31.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d8154310 0x7fa2d80c3000 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1106280398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8065e80 0x7fa2d80631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.326+0000 7fa2de29b700 1 -- 172.21.15.153:0/1106280398 >> 172.21.15.153:0/1106280398 conn(0x7fa2d80c39c0 msgr2=0x7fa2d80c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:31.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.330+0000 7fa2de29b700 1 -- 172.21.15.153:0/1106280398 shutdown_connections 2023-08-17T00:14:31.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.330+0000 7fa2de29b700 1 -- 172.21.15.153:0/1106280398 wait complete. 2023-08-17T00:14:31.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.330+0000 7fa2de29b700 1 Processor -- start 2023-08-17T00:14:31.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 -- start start 2023-08-17T00:14:31.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d8065e80 0x7fa2d80a9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 0x7fa2d8163270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8154310 0x7fa2d80a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80aad60 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80aa3a0 con 0x7fa2d8065e80 2023-08-17T00:14:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80a6850 con 0x7fa2d8154310 2023-08-17T00:14:31.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 0x7fa2d8163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:31.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 0x7fa2d8163270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41632/0 (socket says 172.21.15.153:41632) 2023-08-17T00:14:31.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 -- 172.21.15.153:0/1698257956 learned_addr learned my addr 172.21.15.153:0/1698257956 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2dc838700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8154310 0x7fa2d80a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d7fff700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d8065e80 0x7fa2d80a9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 -- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8154310 msgr2=0x7fa2d80a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8154310 0x7fa2d80a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 -- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d8065e80 msgr2=0x7fa2d80a9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:31.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d8065e80 0x7fa2d80a9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:31.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 -- 172.21.15.153:0/1698257956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d000ab30 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2d77fe700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 0x7fa2d8163270 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fa2cc00c4c0 tx=0x7fa2cc007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:31.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0072e0 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc007440 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80a6b30 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0057a0 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.334+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d80a70f0 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.338+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d806b530 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.338+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa2cc010070 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.338+0000 7fa2bffff700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2c405a150 0x7fa2c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:31.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.338+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6438+0+0 (secure 0 0 0) 0x7fa2cc073840 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.338+0000 7fa2d7fff700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2c405a150 0x7fa2c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:31.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.342+0000 7fa2d7fff700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2c405a150 0x7fa2c405c610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fa2c8006fd0 tx=0x7fa2c8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:31.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.346+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa2cc047150 con 0x7fa2d80c2ba0 2023-08-17T00:14:31.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:31.542+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa2d8062420 con 0x7fa2d80c2ba0 2023-08-17T00:14:32.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.142+0000 7fa2bffff700 1 -- 172.21.15.153:0/1698257956 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v116) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2cc04a770 con 0x7fa2d80c2ba0 2023-08-17T00:14:32.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2c405a150 msgr2=0x7fa2c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2c405a150 0x7fa2c405c610 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7fa2c8006fd0 tx=0x7fa2c8008040).stop 2023-08-17T00:14:32.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 msgr2=0x7fa2d8163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 0x7fa2d8163270 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 rx=0x7fa2cc00c4c0 tx=0x7fa2cc007c10).stop 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 shutdown_connections 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa2c405a150 0x7fa2c405c610 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2d8154310 0x7fa2d80a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa2d80c2ba0 0x7fa2d8163270 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 --2- 172.21.15.153:0/1698257956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2d8065e80 0x7fa2d80a9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 >> 172.21.15.153:0/1698257956 conn(0x7fa2d80c39c0 msgr2=0x7fa2d805dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 shutdown_connections 2023-08-17T00:14:32.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.150+0000 7fa2de29b700 1 -- 172.21.15.153:0/1698257956 wait complete. 2023-08-17T00:14:32.174 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:14:32.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.378+0000 7f93eaab9700 1 Processor -- start 2023-08-17T00:14:32.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.378+0000 7f93eaab9700 1 -- start start 2023-08-17T00:14:32.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.378+0000 7f93eaab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e4157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:32.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.378+0000 7f93eaab9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40bff60 con 0x7f93e40c57d0 2023-08-17T00:14:32.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.378+0000 7f93eaab9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e4064130 con 0x7f93e4157be0 2023-08-17T00:14:32.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.378+0000 7f93eaab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4064410 con 0x7f93e40acd50 2023-08-17T00:14:32.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e92b6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f93e40c57d0 0x7f93e40c03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35424/0 (socket says 172.21.15.153:35424) 2023-08-17T00:14:32.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e92b6700 1 -- 172.21.15.153:0/232906960 learned_addr learned my addr 172.21.15.153:0/232906960 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:32.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93ea2b8700 1 --2- 172.21.15.153:0/232906960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e4157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606390221 0 0) 0x7f93e40bff60 con 0x7f93e40c57d0 2023-08-17T00:14:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d00033f0 con 0x7f93e40c57d0 2023-08-17T00:14:32.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704639853 0 0) 0x7f93e4064130 con 0x7f93e4157be0 2023-08-17T00:14:32.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e40bff60 con 0x7f93e4157be0 2023-08-17T00:14:32.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93ea2b8700 1 -- 172.21.15.153:0/232906960 >> v1:172.21.15.178:6789/0 conn(0x7f93e4157be0 legacy=0x7f93e40c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93ea2b8700 1 -- 172.21.15.153:0/232906960 >> v1:172.21.15.153:6789/0 conn(0x7f93e40c57d0 legacy=0x7f93e40c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93ea2b8700 1 -- 172.21.15.153:0/232906960 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40bf910 con 0x7f93e40acd50 2023-08-17T00:14:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93ea2b8700 1 --2- 172.21.15.153:0/232906960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e4157fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f93dc009e90 tx=0x7f93dc009780).ready entity=mon.2 client_cookie=5cbd92a2d0d731d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00e070 con 0x7f93e40acd50 2023-08-17T00:14:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc00bab0 con 0x7f93e40acd50 2023-08-17T00:14:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93e8ab5700 1 -- 172.21.15.153:0/232906960 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc00be30 con 0x7f93e40acd50 2023-08-17T00:14:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 -- 172.21.15.153:0/232906960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 msgr2=0x7f93e4157fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 --2- 172.21.15.153:0/232906960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e4157fc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f93dc009e90 tx=0x7f93dc009780).stop 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 -- 172.21.15.153:0/232906960 shutdown_connections 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 --2- 172.21.15.153:0/232906960 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e4157fc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 -- 172.21.15.153:0/232906960 >> 172.21.15.153:0/232906960 conn(0x7f93e4062a10 msgr2=0x7f93e40ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 -- 172.21.15.153:0/232906960 shutdown_connections 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.382+0000 7f93eaab9700 1 -- 172.21.15.153:0/232906960 wait complete. 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 Processor -- start 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 -- start start 2023-08-17T00:14:32.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e416ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 0x7f93e4144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e4157be0 0x7f93e4144d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4145240 con 0x7f93e40c57d0 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e416c6f0 con 0x7f93e4157be0 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93eaab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4145420 con 0x7f93e40acd50 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 0x7f93e4144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:32.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 0x7f93e4144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41648/0 (socket says 172.21.15.153:41648) 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 -- 172.21.15.153:0/2265519856 learned_addr learned my addr 172.21.15.153:0/2265519856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93ea2b8700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e4157be0 0x7f93e4144d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e9ab7700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e416ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 -- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 msgr2=0x7f93e416ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e416ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 -- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e4157be0 msgr2=0x7f93e4144d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:32.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e4157be0 0x7f93e4144d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 -- 172.21.15.153:0/2265519856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009a20 con 0x7f93e40c57d0 2023-08-17T00:14:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.386+0000 7f93e92b6700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 0x7f93e4144860 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f93d400c560 tx=0x7f93d4007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d400ce50 con 0x7f93e40c57d0 2023-08-17T00:14:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d40072e0 con 0x7f93e40c57d0 2023-08-17T00:14:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e4145700 con 0x7f93e40c57d0 2023-08-17T00:14:32.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4007660 con 0x7f93e40c57d0 2023-08-17T00:14:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e4145d40 con 0x7f93e40c57d0 2023-08-17T00:14:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e4046dd0 con 0x7f93e40c57d0 2023-08-17T00:14:32.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.390+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f93d4010070 con 0x7f93e40c57d0 2023-08-17T00:14:32.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.394+0000 7f93d9ffb700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93c805a180 0x7f93c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:32.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.394+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6438+0+0 (secure 0 0 0) 0x7f93d40737e0 con 0x7f93e40c57d0 2023-08-17T00:14:32.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.394+0000 7f93e9ab7700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93c805a180 0x7f93c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:32.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.394+0000 7f93e9ab7700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93c805a180 0x7f93c805c640 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f93e00038c0 tx=0x7f93e0007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:32.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.398+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93d4047040 con 0x7f93e40c57d0 2023-08-17T00:14:32.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:32.562+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f93e4081f80 con 0x7f93e40c57d0 2023-08-17T00:14:33.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.358+0000 7f93d9ffb700 1 -- 172.21.15.153:0/2265519856 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v145) v1 ==== 181+0+0 (secure 0 0 0) 0x7f93d404a660 con 0x7f93e40c57d0 2023-08-17T00:14:33.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93c805a180 msgr2=0x7f93c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:33.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93c805a180 0x7f93c805c640 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f93e00038c0 tx=0x7f93e0007bc0).stop 2023-08-17T00:14:33.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 msgr2=0x7f93e4144860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:33.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 0x7f93e4144860 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 rx=0x7f93d400c560 tx=0x7f93d4007cc0).stop 2023-08-17T00:14:33.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 shutdown_connections 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93c805a180 0x7f93c805c640 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e4157be0 0x7f93e4144d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f93e40c57d0 0x7f93e4144860 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 --2- 172.21.15.153:0/2265519856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e40acd50 0x7f93e416ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 >> 172.21.15.153:0/2265519856 conn(0x7f93e4062a10 msgr2=0x7f93e40c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 shutdown_connections 2023-08-17T00:14:33.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.362+0000 7f93eaab9700 1 -- 172.21.15.153:0/2265519856 wait complete. 2023-08-17T00:14:33.368 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:14:33.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:14:33.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.550+0000 7fb9355a9700 1 Processor -- start 2023-08-17T00:14:33.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.550+0000 7fb9355a9700 1 -- start start 2023-08-17T00:14:33.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb9355a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9300c1c70 0x7fb9300656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:33.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb9355a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb93014b860 0x7fb93014bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:33.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb9355a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9300c2d50 con 0x7fb9300652f0 2023-08-17T00:14:33.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb9355a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb930152e10 con 0x7fb9300c1c70 2023-08-17T00:14:33.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb9355a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9301521f0 con 0x7fb93014b860 2023-08-17T00:14:33.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9300c1c70 0x7fb9300656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb93014b860 0x7fb93014bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9300c1c70 0x7fb9300656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:60968/0 (socket says 172.21.15.153:60968) 2023-08-17T00:14:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 -- 172.21.15.153:0/1711237823 learned_addr learned my addr 172.21.15.153:0/1711237823 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92effd700 1 --1- 172.21.15.153:0/1711237823 >> v1:172.21.15.178:6789/0 conn(0x7fb9300652f0 0x7fb9300c1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:48324/0 (socket says 172.21.15.153:48324) 2023-08-17T00:14:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 -- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb93014b860 msgr2=0x7fb93014bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:33.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 --2- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb93014b860 0x7fb93014bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 -- 172.21.15.153:0/1711237823 >> v1:172.21.15.178:6789/0 conn(0x7fb9300652f0 legacy=0x7fb9300c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:33.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 -- 172.21.15.153:0/1711237823 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300c2140 con 0x7fb9300c1c70 2023-08-17T00:14:33.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.554+0000 7fb92e7fc700 1 --2- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9300c1c70 0x7fb9300656d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fb924006fd0 tx=0x7fb9240090f0).ready entity=mon.1 client_cookie=ff3acbbedd457a26 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:33.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb92dffb700 1 -- 172.21.15.153:0/1711237823 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400b580 con 0x7fb9300c1c70 2023-08-17T00:14:33.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb92dffb700 1 -- 172.21.15.153:0/1711237823 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400b6e0 con 0x7fb9300c1c70 2023-08-17T00:14:33.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb92dffb700 1 -- 172.21.15.153:0/1711237823 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92400ba80 con 0x7fb9300c1c70 2023-08-17T00:14:33.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 -- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9300c1c70 msgr2=0x7fb9300656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:33.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 --2- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9300c1c70 0x7fb9300656d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fb924006fd0 tx=0x7fb9240090f0).stop 2023-08-17T00:14:33.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 -- 172.21.15.153:0/1711237823 shutdown_connections 2023-08-17T00:14:33.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 --2- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb93014b860 0x7fb93014bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 --2- 172.21.15.153:0/1711237823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9300c1c70 0x7fb9300656d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 -- 172.21.15.153:0/1711237823 >> 172.21.15.153:0/1711237823 conn(0x7fb9300c7090 msgr2=0x7fb9300c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:33.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 -- 172.21.15.153:0/1711237823 shutdown_connections 2023-08-17T00:14:33.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 -- 172.21.15.153:0/1711237823 wait complete. 2023-08-17T00:14:33.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 Processor -- start 2023-08-17T00:14:33.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.558+0000 7fb9355a9700 1 -- start start 2023-08-17T00:14:33.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9300652f0 0x7fb93014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 0x7fb93014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb93014b860 0x7fb9300c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93014d610 con 0x7fb9300c1c70 2023-08-17T00:14:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93014edd0 con 0x7fb93014b860 2023-08-17T00:14:33.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93014e450 con 0x7fb9300652f0 2023-08-17T00:14:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 0x7fb93014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 0x7fb93014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41656/0 (socket says 172.21.15.153:41656) 2023-08-17T00:14:33.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 -- 172.21.15.153:0/94895202 learned_addr learned my addr 172.21.15.153:0/94895202 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92f7fe700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb93014b860 0x7fb9300c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92effd700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9300652f0 0x7fb93014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 -- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9300652f0 msgr2=0x7fb93014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9300652f0 0x7fb93014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 -- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb93014b860 msgr2=0x7fb9300c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:33.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb93014b860 0x7fb9300c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 -- 172.21.15.153:0/94895202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924009370 con 0x7fb9300c1c70 2023-08-17T00:14:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb92e7fc700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 0x7fb93014e8e0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fb924011000 tx=0x7fb924017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:33.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb924006970 con 0x7fb9300c1c70 2023-08-17T00:14:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92400be40 con 0x7fb9300c1c70 2023-08-17T00:14:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92401c420 con 0x7fb9300c1c70 2023-08-17T00:14:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93014d840 con 0x7fb9300c1c70 2023-08-17T00:14:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.562+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93014de00 con 0x7fb9300c1c70 2023-08-17T00:14:33.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.566+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb930069a20 con 0x7fb9300c1c70 2023-08-17T00:14:33.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.566+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb92402c070 con 0x7fb9300c1c70 2023-08-17T00:14:33.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.566+0000 7fb916ffd700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb91c05a150 0x7fb91c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:33.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.570+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6000+0+0 (secure 0 0 0) 0x7fb924075c20 con 0x7fb9300c1c70 2023-08-17T00:14:33.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.570+0000 7fb92effd700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb91c05a150 0x7fb91c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:33.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.570+0000 7fb92effd700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb91c05a150 0x7fb91c05c610 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fb9200076b0 tx=0x7fb920007bf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:33.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.574+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb930069a20 con 0x7fb9300c1c70 2023-08-17T00:14:33.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:33.734+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb930069a20 con 0x7fb9300c1c70 2023-08-17T00:14:34.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.366+0000 7fb916ffd700 1 -- 172.21.15.153:0/94895202 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v146) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb930069a20 con 0x7fb9300c1c70 2023-08-17T00:14:34.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb91c05a150 msgr2=0x7fb91c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb91c05a150 0x7fb91c05c610 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fb9200076b0 tx=0x7fb920007bf0).stop 2023-08-17T00:14:34.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 msgr2=0x7fb93014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 0x7fb93014e8e0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 rx=0x7fb924011000 tx=0x7fb924017000).stop 2023-08-17T00:14:34.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 shutdown_connections 2023-08-17T00:14:34.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb91c05a150 0x7fb91c05c610 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb93014b860 0x7fb9300c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb9300c1c70 0x7fb93014e8e0 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 --2- 172.21.15.153:0/94895202 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9300652f0 0x7fb93014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 >> 172.21.15.153:0/94895202 conn(0x7fb9300c7090 msgr2=0x7fb9300bc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:34.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 shutdown_connections 2023-08-17T00:14:34.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.374+0000 7fb9355a9700 1 -- 172.21.15.153:0/94895202 wait complete. 2023-08-17T00:14:34.384 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:14:34.408 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:14:34.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.554+0000 7ff14ae79700 1 Processor -- start 2023-08-17T00:14:34.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff14ae79700 1 -- start start 2023-08-17T00:14:34.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff14ae79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c57a0 0x7ff1440c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff14ae79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1440c11b0 0x7ff144154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff14ae79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1440bfd10 con 0x7ff144153f50 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff14ae79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff144154860 con 0x7ff1440c11b0 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff14ae79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff144154af0 con 0x7ff1440c57a0 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff149676700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff144153f50 0x7ff144157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35426/0 (socket says 172.21.15.153:35426) 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.558+0000 7ff149676700 1 -- 172.21.15.153:0/2802878065 learned_addr learned my addr 172.21.15.153:0/2802878065 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:34.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff149e77700 1 --2- 172.21.15.153:0/2802878065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c57a0 0x7ff1440c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14a678700 1 --2- 172.21.15.153:0/2802878065 >> v2:172.21.15.178:3300/0 conn(0x7ff1440c11b0 0x7ff144154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff148e75700 1 -- 172.21.15.153:0/2802878065 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301479745 0 0) 0x7ff1440bfd10 con 0x7ff144153f50 2023-08-17T00:14:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff148e75700 1 -- 172.21.15.153:0/2802878065 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1300033f0 con 0x7ff144153f50 2023-08-17T00:14:34.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff149e77700 1 -- 172.21.15.153:0/2802878065 >> v2:172.21.15.178:3300/0 conn(0x7ff1440c11b0 msgr2=0x7ff144154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff149e77700 1 --2- 172.21.15.153:0/2802878065 >> v2:172.21.15.178:3300/0 conn(0x7ff1440c11b0 0x7ff144154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff149e77700 1 -- 172.21.15.153:0/2802878065 >> v1:172.21.15.153:6789/0 conn(0x7ff144153f50 legacy=0x7ff144157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff148e75700 1 -- 172.21.15.153:0/2802878065 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2015681406 0 0) 0x7ff1300033f0 con 0x7ff144153f50 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff149e77700 1 -- 172.21.15.153:0/2802878065 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff144154dd0 con 0x7ff1440c57a0 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff149e77700 1 --2- 172.21.15.153:0/2802878065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c57a0 0x7ff1440c5b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7ff140009760 tx=0x7ff140009060).ready entity=mon.2 client_cookie=882dec77dd49d845 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff148e75700 1 -- 172.21.15.153:0/2802878065 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000d4a0 con 0x7ff1440c57a0 2023-08-17T00:14:34.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff148e75700 1 -- 172.21.15.153:0/2802878065 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14000d600 con 0x7ff1440c57a0 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff148e75700 1 -- 172.21.15.153:0/2802878065 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000d980 con 0x7ff1440c57a0 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 -- 172.21.15.153:0/2802878065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c57a0 msgr2=0x7ff1440c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2802878065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c57a0 0x7ff1440c5b80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7ff140009760 tx=0x7ff140009060).stop 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 -- 172.21.15.153:0/2802878065 shutdown_connections 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2802878065 >> v2:172.21.15.178:3300/0 conn(0x7ff1440c11b0 0x7ff144154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2802878065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c57a0 0x7ff1440c5b80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 -- 172.21.15.153:0/2802878065 >> 172.21.15.153:0/2802878065 conn(0x7ff144062a70 msgr2=0x7ff1440ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:34.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 -- 172.21.15.153:0/2802878065 shutdown_connections 2023-08-17T00:14:34.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.562+0000 7ff14ae79700 1 -- 172.21.15.153:0/2802878065 wait complete. 2023-08-17T00:14:34.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 Processor -- start 2023-08-17T00:14:34.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 -- start start 2023-08-17T00:14:34.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c11b0 0x7ff1440c2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 0x7ff144164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff144153f50 0x7ff1441563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440c1f00 con 0x7ff1440c57a0 2023-08-17T00:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1440c2b50 con 0x7ff144153f50 2023-08-17T00:14:34.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14ae79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1441650e0 con 0x7ff1440c11b0 2023-08-17T00:14:34.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 0x7ff144164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 0x7ff144164bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41658/0 (socket says 172.21.15.153:41658) 2023-08-17T00:14:34.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 -- 172.21.15.153:0/2289341570 learned_addr learned my addr 172.21.15.153:0/2289341570 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:34.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149e77700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c11b0 0x7ff1440c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14a678700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff144153f50 0x7ff1441563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 -- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c11b0 msgr2=0x7ff1440c2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c11b0 0x7ff1440c2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 -- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff144153f50 msgr2=0x7ff1441563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff144153f50 0x7ff1441563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 -- 172.21.15.153:0/2289341570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400092a0 con 0x7ff1440c57a0 2023-08-17T00:14:34.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149e77700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c11b0 0x7ff1440c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:34.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff14a678700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff144153f50 0x7ff1441563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:34.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.566+0000 7ff149676700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 0x7ff144164bf0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7ff13400c4e0 tx=0x7ff134007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:34.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.570+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134007170 con 0x7ff1440c57a0 2023-08-17T00:14:34.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.570+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1340072f0 con 0x7ff1440c57a0 2023-08-17T00:14:34.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.570+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1440c1940 con 0x7ff1440c57a0 2023-08-17T00:14:34.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.570+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1340048c0 con 0x7ff1440c57a0 2023-08-17T00:14:34.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.570+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1440ae820 con 0x7ff1440c57a0 2023-08-17T00:14:34.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.570+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1440ae680 con 0x7ff1440c57a0 2023-08-17T00:14:34.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.574+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff134004c30 con 0x7ff1440c57a0 2023-08-17T00:14:34.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.574+0000 7ff139ffb700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff12805a150 0x7ff12805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.574+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5441+0+0 (secure 0 0 0) 0x7ff1340738c0 con 0x7ff1440c57a0 2023-08-17T00:14:34.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.574+0000 7ff149e77700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff12805a150 0x7ff12805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.578+0000 7ff149e77700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff12805a150 0x7ff12805c610 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7ff144156e80 tx=0x7ff140016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:34.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.582+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff1440ae680 con 0x7ff1440c57a0 2023-08-17T00:14:34.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.742+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff1440c2380 con 0x7ff1440c57a0 2023-08-17T00:14:34.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.750+0000 7ff139ffb700 1 -- 172.21.15.153:0/2289341570 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff1440c2380 con 0x7ff1440c57a0 2023-08-17T00:14:34.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff12805a150 msgr2=0x7ff12805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff12805a150 0x7ff12805c610 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7ff144156e80 tx=0x7ff140016000).stop 2023-08-17T00:14:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 msgr2=0x7ff144164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 0x7ff144164bf0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 rx=0x7ff13400c4e0 tx=0x7ff134007a10).stop 2023-08-17T00:14:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 shutdown_connections 2023-08-17T00:14:34.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff12805a150 0x7ff12805c610 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff144153f50 0x7ff1441563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1440c57a0 0x7ff144164bf0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 --2- 172.21.15.153:0/2289341570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1440c11b0 0x7ff1440c2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 >> 172.21.15.153:0/2289341570 conn(0x7ff144062a70 msgr2=0x7ff1440c8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 shutdown_connections 2023-08-17T00:14:34.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.754+0000 7ff14ae79700 1 -- 172.21.15.153:0/2289341570 wait complete. 2023-08-17T00:14:34.780 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2023-08-17T00:14:34.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd944d1b700 1 Processor -- start 2023-08-17T00:14:34.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd944d1b700 1 -- start start 2023-08-17T00:14:34.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd944d1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd940153e90 0x7fd9400c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd944d1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9400aa750 con 0x7fd940153ab0 2023-08-17T00:14:34.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd944d1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9401542f0 con 0x7fd9400c7980 2023-08-17T00:14:34.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd944d1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9400c9dd0 con 0x7fd940153e90 2023-08-17T00:14:34.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd937fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd940153e90 0x7fd9400c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd93e59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd940153ab0 0x7fd9400c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35428/0 (socket says 172.21.15.153:35428) 2023-08-17T00:14:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd93e59c700 1 -- 172.21.15.153:0/3827525646 learned_addr learned my addr 172.21.15.153:0/3827525646 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd937fff700 1 -- 172.21.15.153:0/3827525646 >> v1:172.21.15.178:6789/0 conn(0x7fd9400c7980 legacy=0x7fd9400ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd937fff700 1 -- 172.21.15.153:0/3827525646 >> v1:172.21.15.153:6789/0 conn(0x7fd940153ab0 legacy=0x7fd9400c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd937fff700 1 -- 172.21.15.153:0/3827525646 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9400aacf0 con 0x7fd940153e90 2023-08-17T00:14:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.938+0000 7fd93dd9b700 1 -- 172.21.15.153:0/3827525646 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728988288 0 0) 0x7fd9400aa750 con 0x7fd940153ab0 2023-08-17T00:14:34.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd937fff700 1 --2- 172.21.15.153:0/3827525646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153e90 0x7fd9400c7490 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fd928009760 tx=0x7fd928009060).ready entity=mon.0 client_cookie=e2ef7e73a6f362cd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:34.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd93dd9b700 1 -- 172.21.15.153:0/3827525646 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9280090d0 con 0x7fd940153e90 2023-08-17T00:14:34.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd93dd9b700 1 -- 172.21.15.153:0/3827525646 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800b520 con 0x7fd940153e90 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd93dd9b700 1 -- 172.21.15.153:0/3827525646 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800b8a0 con 0x7fd940153e90 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 -- 172.21.15.153:0/3827525646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153e90 msgr2=0x7fd9400c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 --2- 172.21.15.153:0/3827525646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153e90 0x7fd9400c7490 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 rx=0x7fd928009760 tx=0x7fd928009060).stop 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 -- 172.21.15.153:0/3827525646 shutdown_connections 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 --2- 172.21.15.153:0/3827525646 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153e90 0x7fd9400c7490 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 -- 172.21.15.153:0/3827525646 >> 172.21.15.153:0/3827525646 conn(0x7fd940061fa0 msgr2=0x7fd9400623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:34.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 -- 172.21.15.153:0/3827525646 shutdown_connections 2023-08-17T00:14:34.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 -- 172.21.15.153:0/3827525646 wait complete. 2023-08-17T00:14:34.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 Processor -- start 2023-08-17T00:14:34.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.942+0000 7fd944d1b700 1 -- start start 2023-08-17T00:14:34.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9400c7980 0x7fd940066670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 0x7fd94014e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd940153e90 0x7fd9400c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd940066b60 con 0x7fd940153ab0 2023-08-17T00:14:34.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400ade20 con 0x7fd9400c7980 2023-08-17T00:14:34.950 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9400c3520 con 0x7fd940153e90 2023-08-17T00:14:34.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 0x7fd94014e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 0x7fd94014e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:41672/0 (socket says 172.21.15.153:41672) 2023-08-17T00:14:34.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 -- 172.21.15.153:0/1334667229 learned_addr learned my addr 172.21.15.153:0/1334667229 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:34.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd93e59c700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9400c7980 0x7fd940066670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd93ed9d700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd940153e90 0x7fd9400c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 -- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd940153e90 msgr2=0x7fd9400c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd940153e90 0x7fd9400c2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 -- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9400c7980 msgr2=0x7fd940066670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:34.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9400c7980 0x7fd940066670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:34.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 -- 172.21.15.153:0/1334667229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280092a0 con 0x7fd940153ab0 2023-08-17T00:14:34.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd93ed9d700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd940153e90 0x7fd9400c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:34.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd937fff700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 0x7fd94014e890 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fd928009eb0 tx=0x7fd928017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:34.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd928011a60 con 0x7fd940153ab0 2023-08-17T00:14:34.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd928011bc0 con 0x7fd940153ab0 2023-08-17T00:14:34.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9400c3800 con 0x7fd940153ab0 2023-08-17T00:14:34.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92801b410 con 0x7fd940153ab0 2023-08-17T00:14:34.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.946+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9400adab0 con 0x7fd940153ab0 2023-08-17T00:14:34.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.950+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9400adfb0 con 0x7fd940153ab0 2023-08-17T00:14:34.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.950+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd92800f070 con 0x7fd940153ab0 2023-08-17T00:14:34.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.954+0000 7fd9367fc700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd92005a150 0x7fd92005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:34.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.954+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fd9280756f0 con 0x7fd940153ab0 2023-08-17T00:14:34.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.954+0000 7fd93e59c700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd92005a150 0x7fd92005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:34.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.954+0000 7fd93e59c700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd92005a150 0x7fd92005c610 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fd9300011e0 tx=0x7fd930007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:34.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:34.958+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd928049330 con 0x7fd940153ab0 2023-08-17T00:14:35.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.174+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7fd94006b530 con 0x7fd940153ab0 2023-08-17T00:14:35.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.370+0000 7fd9367fc700 1 -- 172.21.15.153:0/1334667229 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v550) v1 ==== 166+0+0 (secure 0 0 0) 0x7fd92801f020 con 0x7fd940153ab0 2023-08-17T00:14:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd92005a150 msgr2=0x7fd92005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:35.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd92005a150 0x7fd92005c610 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fd9300011e0 tx=0x7fd930007bb0).stop 2023-08-17T00:14:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 msgr2=0x7fd94014e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 0x7fd94014e890 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 rx=0x7fd928009eb0 tx=0x7fd928017000).stop 2023-08-17T00:14:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 shutdown_connections 2023-08-17T00:14:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd92005a150 0x7fd92005c610 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd940153e90 0x7fd9400c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd940153ab0 0x7fd94014e890 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 --2- 172.21.15.153:0/1334667229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9400c7980 0x7fd940066670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 >> 172.21.15.153:0/1334667229 conn(0x7fd940061fa0 msgr2=0x7fd940150740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 shutdown_connections 2023-08-17T00:14:35.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.374+0000 7fd944d1b700 1 -- 172.21.15.153:0/1334667229 wait complete. 2023-08-17T00:14:35.400 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-08-17T00:14:35.401 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2023-08-17T00:14:35.402 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2023-08-17T00:14:35.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 Processor -- start 2023-08-17T00:14:35.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 -- start start 2023-08-17T00:14:35.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f90153da0 0x7f7f900bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:35.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f901503d0 0x7f7f900bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:35.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f900a9170 con 0x7f7f9014fff0 2023-08-17T00:14:35.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f900bcfd0 con 0x7f7f901503d0 2023-08-17T00:14:35.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f967db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f900c1b90 con 0x7f7f90153da0 2023-08-17T00:14:35.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f8ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7f9014fff0 0x7f7f90062970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44144/0 (socket says 172.21.15.153:44144) 2023-08-17T00:14:35.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f8ffff700 1 -- 172.21.15.153:0/885457169 learned_addr learned my addr 172.21.15.153:0/885457169 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:35.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.550+0000 7f7f94d78700 1 --2- 172.21.15.153:0/885457169 >> v2:172.21.15.178:3300/0 conn(0x7f7f901503d0 0x7f7f900bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:35.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f87fff700 1 --2- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f90153da0 0x7f7f900bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:35.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f94d78700 1 -- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f90153da0 msgr2=0x7f7f900bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:35.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f94d78700 1 --2- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f90153da0 0x7f7f900bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f8f7fe700 1 -- 172.21.15.153:0/885457169 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998699193 0 0) 0x7f7f900a9170 con 0x7f7f9014fff0 2023-08-17T00:14:35.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f94d78700 1 -- 172.21.15.153:0/885457169 >> v1:172.21.15.153:6789/0 conn(0x7f7f9014fff0 legacy=0x7f7f90062970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:35.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f94d78700 1 -- 172.21.15.153:0/885457169 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90154280 con 0x7f7f901503d0 2023-08-17T00:14:35.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f94d78700 1 --2- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f900bbad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7f88009e60 tx=0x7f7f88009780).ready entity=mon.1 client_cookie=1bced9c2e33c687 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f8f7fe700 1 -- 172.21.15.153:0/885457169 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800e070 con 0x7f7f901503d0 2023-08-17T00:14:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f8f7fe700 1 -- 172.21.15.153:0/885457169 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800bb60 con 0x7f7f901503d0 2023-08-17T00:14:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f8f7fe700 1 -- 172.21.15.153:0/885457169 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88012410 con 0x7f7f901503d0 2023-08-17T00:14:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 -- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 msgr2=0x7f7f900bbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:35.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 --2- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f900bbad0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f7f88009e60 tx=0x7f7f88009780).stop 2023-08-17T00:14:35.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 -- 172.21.15.153:0/885457169 shutdown_connections 2023-08-17T00:14:35.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 --2- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f900bbad0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 --2- 172.21.15.153:0/885457169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f90153da0 0x7f7f900bb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 -- 172.21.15.153:0/885457169 >> 172.21.15.153:0/885457169 conn(0x7f7f900c7150 msgr2=0x7f7f900c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:35.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 -- 172.21.15.153:0/885457169 shutdown_connections 2023-08-17T00:14:35.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.554+0000 7f7f967db700 1 -- 172.21.15.153:0/885457169 wait complete. 2023-08-17T00:14:35.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 Processor -- start 2023-08-17T00:14:35.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 -- start start 2023-08-17T00:14:35.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9014fff0 0x7f7f9014e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f9014b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 0x7f7f90161d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f901514f0 con 0x7f7f90153da0 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f901508e0 con 0x7f7f901503d0 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.558+0000 7f7f967db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f90150bc0 con 0x7f7f9014fff0 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 0x7f7f90161d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:35.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 0x7f7f90161d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43808/0 (socket says 172.21.15.153:43808) 2023-08-17T00:14:35.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 -- 172.21.15.153:0/2443980609 learned_addr learned my addr 172.21.15.153:0/2443980609 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f8ffff700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9014fff0 0x7f7f9014e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 -- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9014fff0 msgr2=0x7f7f9014e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9014fff0 0x7f7f9014e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 -- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 msgr2=0x7f7f9014b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f87fff700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f9014b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f9014b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:35.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 -- 172.21.15.153:0/2443980609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88009a20 con 0x7f7f90153da0 2023-08-17T00:14:35.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f87fff700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f9014b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:35.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f94d78700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 0x7f7f90161d50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f7f8800b6c0 tx=0x7f7f88009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:35.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88012410 con 0x7f7f90153da0 2023-08-17T00:14:35.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8801d630 con 0x7f7f90153da0 2023-08-17T00:14:35.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f880070e0 con 0x7f7f90153da0 2023-08-17T00:14:35.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f90150ea0 con 0x7f7f90153da0 2023-08-17T00:14:35.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9014e720 con 0x7f7f90153da0 2023-08-17T00:14:35.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9006b530 con 0x7f7f90153da0 2023-08-17T00:14:35.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.562+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7f8801dc80 con 0x7f7f90153da0 2023-08-17T00:14:35.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.566+0000 7f7f8cff9700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f7405a150 0x7f7f7405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:35.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.566+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f7f880761c0 con 0x7f7f90153da0 2023-08-17T00:14:35.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.566+0000 7f7f8ffff700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f7405a150 0x7f7f7405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:35.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.566+0000 7f7f8ffff700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f7405a150 0x7f7f7405c610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7f8000c7d0 tx=0x7f7f80009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:35.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.570+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7f8804d8b0 con 0x7f7f90153da0 2023-08-17T00:14:35.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:35.822+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) v1 -- 0x7f7f90151630 con 0x7f7f90153da0 2023-08-17T00:14:36.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.378+0000 7f7f8cff9700 1 -- 172.21.15.153:0/2443980609 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v551) v1 ==== 143+0+0 (secure 0 0 0) 0x7f7f8804d4a0 con 0x7f7f90153da0 2023-08-17T00:14:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f7405a150 msgr2=0x7f7f7405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f7405a150 0x7f7f7405c610 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f7f8000c7d0 tx=0x7f7f80009040).stop 2023-08-17T00:14:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 msgr2=0x7f7f90161d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 0x7f7f90161d50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 rx=0x7f7f8800b6c0 tx=0x7f7f88009780).stop 2023-08-17T00:14:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 shutdown_connections 2023-08-17T00:14:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f7405a150 0x7f7f7405c610 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f90153da0 0x7f7f90161d50 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f901503d0 0x7f7f9014b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 --2- 172.21.15.153:0/2443980609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f9014fff0 0x7f7f9014e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 >> 172.21.15.153:0/2443980609 conn(0x7f7f900c7150 msgr2=0x7f7f900bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 shutdown_connections 2023-08-17T00:14:36.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.382+0000 7f7f967db700 1 -- 172.21.15.153:0/2443980609 wait complete. 2023-08-17T00:14:36.409 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:14:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.570+0000 7f992d49b700 1 Processor -- start 2023-08-17T00:14:36.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.570+0000 7f992d49b700 1 -- start start 2023-08-17T00:14:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f992d49b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928151b90 0x7f9928151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f992d49b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9928063290 0x7f9928065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f992d49b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9928065b50 0x7f9928064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f992d49b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99280c3fb0 con 0x7f9928063290 2023-08-17T00:14:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f992d49b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9928152460 con 0x7f9928065b50 2023-08-17T00:14:36.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f992d49b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9928061fa0 con 0x7f9928151b90 2023-08-17T00:14:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f99267fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9928063290 0x7f9928065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f99267fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9928063290 0x7f9928065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43818/0 (socket says 172.21.15.153:43818) 2023-08-17T00:14:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f99267fc700 1 -- 172.21.15.153:0/1642181858 learned_addr learned my addr 172.21.15.153:0/1642181858 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f9926ffd700 1 --2- 172.21.15.153:0/1642181858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928151b90 0x7f9928151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.574+0000 7f99277fe700 1 --2- 172.21.15.153:0/1642181858 >> v2:172.21.15.178:3300/0 conn(0x7f9928065b50 0x7f9928064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f99267fc700 1 -- 172.21.15.153:0/1642181858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928151b90 msgr2=0x7f9928151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f99267fc700 1 --2- 172.21.15.153:0/1642181858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928151b90 0x7f9928151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f99267fc700 1 -- 172.21.15.153:0/1642181858 >> v2:172.21.15.178:3300/0 conn(0x7f9928065b50 msgr2=0x7f9928064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f99267fc700 1 --2- 172.21.15.153:0/1642181858 >> v2:172.21.15.178:3300/0 conn(0x7f9928065b50 0x7f9928064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f99267fc700 1 -- 172.21.15.153:0/1642181858 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99280621f0 con 0x7f9928063290 2023-08-17T00:14:36.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f99267fc700 1 --2- 172.21.15.153:0/1642181858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928063290 0x7f9928065660 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f99280a9df0 tx=0x7f991c0090f0).ready entity=mon.0 client_cookie=5ff047e8b0426d5c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f9925ffb700 1 -- 172.21.15.153:0/1642181858 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00f510 con 0x7f9928063290 2023-08-17T00:14:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f9925ffb700 1 -- 172.21.15.153:0/1642181858 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c00f670 con 0x7f9928063290 2023-08-17T00:14:36.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f9925ffb700 1 -- 172.21.15.153:0/1642181858 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00fa10 con 0x7f9928063290 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 -- 172.21.15.153:0/1642181858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928063290 msgr2=0x7f9928065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 --2- 172.21.15.153:0/1642181858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928063290 0x7f9928065660 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 rx=0x7f99280a9df0 tx=0x7f991c0090f0).stop 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 -- 172.21.15.153:0/1642181858 shutdown_connections 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 --2- 172.21.15.153:0/1642181858 >> v2:172.21.15.178:3300/0 conn(0x7f9928065b50 0x7f9928064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 --2- 172.21.15.153:0/1642181858 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928063290 0x7f9928065660 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 --2- 172.21.15.153:0/1642181858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928151b90 0x7f9928151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 -- 172.21.15.153:0/1642181858 >> 172.21.15.153:0/1642181858 conn(0x7f99280c7150 msgr2=0x7f99280c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 -- 172.21.15.153:0/1642181858 shutdown_connections 2023-08-17T00:14:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.578+0000 7f992d49b700 1 -- 172.21.15.153:0/1642181858 wait complete. 2023-08-17T00:14:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 Processor -- start 2023-08-17T00:14:36.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 -- start start 2023-08-17T00:14:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928063290 0x7f9928150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 0x7f99281525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9928151b90 0x7f9928152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9928156bb0 con 0x7f9928065b50 2023-08-17T00:14:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9928157170 con 0x7f9928151b90 2023-08-17T00:14:36.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f992d49b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99281595a0 con 0x7f9928063290 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 0x7f99281525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 0x7f99281525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43834/0 (socket says 172.21.15.153:43834) 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 -- 172.21.15.153:0/2472198160 learned_addr learned my addr 172.21.15.153:0/2472198160 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99277fe700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9928151b90 0x7f9928152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f9926ffd700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928063290 0x7f9928150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 -- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928063290 msgr2=0x7f9928150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928063290 0x7f9928150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 -- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9928151b90 msgr2=0x7f9928152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9928151b90 0x7f9928152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 -- 172.21.15.153:0/2472198160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c009370 con 0x7f9928065b50 2023-08-17T00:14:36.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.582+0000 7f99267fc700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 0x7f99281525d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f992805e420 tx=0x7f991c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:36.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c00fea0 con 0x7f9928065b50 2023-08-17T00:14:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c00f7e0 con 0x7f9928065b50 2023-08-17T00:14:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9928159880 con 0x7f9928065b50 2023-08-17T00:14:36.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c024470 con 0x7f9928065b50 2023-08-17T00:14:36.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99281505f0 con 0x7f9928065b50 2023-08-17T00:14:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992806b530 con 0x7f9928065b50 2023-08-17T00:14:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.586+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f991c00f070 con 0x7f9928065b50 2023-08-17T00:14:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.590+0000 7f990effd700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f991405a150 0x7f991405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.590+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f991c075a20 con 0x7f9928065b50 2023-08-17T00:14:36.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.590+0000 7f9926ffd700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f991405a150 0x7f991405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:36.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.590+0000 7f9926ffd700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f991405a150 0x7f991405c610 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f9918009b20 tx=0x7f9918008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:36.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.594+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f991c049660 con 0x7f9928065b50 2023-08-17T00:14:36.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.754+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f99280c3ab0 con 0x7f9928065b50 2023-08-17T00:14:36.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f990effd700 1 -- 172.21.15.153:0/2472198160 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f991c04cc80 con 0x7f9928065b50 2023-08-17T00:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f991405a150 msgr2=0x7f991405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f991405a150 0x7f991405c610 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f9918009b20 tx=0x7f9918008040).stop 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 msgr2=0x7f99281525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 0x7f99281525d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 rx=0x7f992805e420 tx=0x7f991c017000).stop 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 shutdown_connections 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f991405a150 0x7f991405c610 secure :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0x7f9918009b20 tx=0x7f9918008040).stop 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9928151b90 0x7f9928152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9928065b50 0x7f99281525d0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 --2- 172.21.15.153:0/2472198160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9928063290 0x7f9928150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:36.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 >> 172.21.15.153:0/2472198160 conn(0x7f99280c7150 msgr2=0x7f99280c5250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:36.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 shutdown_connections 2023-08-17T00:14:36.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:36.762+0000 7f992d49b700 1 -- 172.21.15.153:0/2472198160 wait complete. 2023-08-17T00:14:36.791 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:14:36.792 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:14:36.831 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:14:36.876 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:14:36.876 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:14:36.877 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:37.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 Processor -- start 2023-08-17T00:14:37.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 -- start start 2023-08-17T00:14:37.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0a9c40 0x7fd4fc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd4fc0c9f00 0x7fd4fc0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4fc0c9a70 con 0x7fd4fc0ca4f0 2023-08-17T00:14:37.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4fc153fa0 con 0x7fd4fc0c9f00 2023-08-17T00:14:37.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.042+0000 7fd502a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc0c9140 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd4fc0c9f00 0x7fd4fc0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd501a37700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0a9c40 0x7fd4fc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd4fc0c9f00 0x7fd4fc0aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:59440/0 (socket says 172.21.15.153:59440) 2023-08-17T00:14:37.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd501236700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd4fc0ca4f0 0x7fd4fc061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:56426/0 (socket says 172.21.15.153:56426) 2023-08-17T00:14:37.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 -- 172.21.15.153:0/4134960269 learned_addr learned my addr 172.21.15.153:0/4134960269 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:37.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 -- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0a9c40 msgr2=0x7fd4fc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:37.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 --2- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0a9c40 0x7fd4fc0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 -- 172.21.15.153:0/4134960269 >> v1:172.21.15.178:6789/0 conn(0x7fd4fc0ca4f0 legacy=0x7fd4fc061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd500a35700 1 -- 172.21.15.153:0/4134960269 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047068940 0 0) 0x7fd4fc0c9a70 con 0x7fd4fc0ca4f0 2023-08-17T00:14:37.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 -- 172.21.15.153:0/4134960269 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc0c9420 con 0x7fd4fc0c9f00 2023-08-17T00:14:37.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502238700 1 --2- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0c9f00 0x7fd4fc0aa680 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fd4f4009f20 tx=0x7fd4f4009840).ready entity=mon.1 client_cookie=86e5e230a134896f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:37.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd500a35700 1 -- 172.21.15.153:0/4134960269 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400e070 con 0x7fd4fc0c9f00 2023-08-17T00:14:37.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd500a35700 1 -- 172.21.15.153:0/4134960269 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f400b9d0 con 0x7fd4fc0c9f00 2023-08-17T00:14:37.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd500a35700 1 -- 172.21.15.153:0/4134960269 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f400bd50 con 0x7fd4fc0c9f00 2023-08-17T00:14:37.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502a39700 1 -- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0c9f00 msgr2=0x7fd4fc0aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502a39700 1 --2- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0c9f00 0x7fd4fc0aa680 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7fd4f4009f20 tx=0x7fd4f4009840).stop 2023-08-17T00:14:37.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502a39700 1 -- 172.21.15.153:0/4134960269 shutdown_connections 2023-08-17T00:14:37.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502a39700 1 --2- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0c9f00 0x7fd4fc0aa680 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502a39700 1 --2- 172.21.15.153:0/4134960269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0a9c40 0x7fd4fc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.046+0000 7fd502a39700 1 -- 172.21.15.153:0/4134960269 >> 172.21.15.153:0/4134960269 conn(0x7fd4fc0cb370 msgr2=0x7fd4fc0c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:37.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.050+0000 7fd502a39700 1 -- 172.21.15.153:0/4134960269 shutdown_connections 2023-08-17T00:14:37.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.050+0000 7fd502a39700 1 -- 172.21.15.153:0/4134960269 wait complete. 2023-08-17T00:14:37.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.050+0000 7fd502a39700 1 Processor -- start 2023-08-17T00:14:37.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.050+0000 7fd502a39700 1 -- start start 2023-08-17T00:14:37.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 0x7fd4fc1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0c9f00 0x7fd4fc164a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4fc0ca4f0 0x7fd4fc0c04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc155760 con 0x7fd4fc0ca4f0 2023-08-17T00:14:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc164f00 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc165160 con 0x7fd4fc0c9f00 2023-08-17T00:14:37.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 0x7fd4fc1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502238700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4fc0ca4f0 0x7fd4fc0c04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 0x7fd4fc1488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:59452/0 (socket says 172.21.15.153:59452) 2023-08-17T00:14:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 -- 172.21.15.153:0/545766649 learned_addr learned my addr 172.21.15.153:0/545766649 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501236700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0c9f00 0x7fd4fc164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 -- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0c9f00 msgr2=0x7fd4fc164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0c9f00 0x7fd4fc164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 -- 172.21.15.153:0/545766649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4fc0ca4f0 msgr2=0x7fd4fc0c04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4fc0ca4f0 0x7fd4fc0c04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 -- 172.21.15.153:0/545766649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009ae0 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502238700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4fc0ca4f0 0x7fd4fc0c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:37.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd501a37700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 0x7fd4fc1488d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fd4f800e930 tx=0x7fd4f8009060).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:37.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8012600 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f8012760 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc154b50 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.054+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f8012ae0 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.058+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc155110 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.058+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc06b4c0 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.058+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd4f8022070 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.062+0000 7fd4f1ffb700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd4e005a150 0x7fd4e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.062+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fd4f80742a0 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.062+0000 7fd501236700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd4e005a150 0x7fd4e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.062+0000 7fd501236700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd4e005a150 0x7fd4e005c610 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fd4fc0c3430 tx=0x7fd4ec007d70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:37.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.066+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd4f8047ee0 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.262+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4fc0c9700 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd4f1ffb700 1 -- 172.21.15.153:0/545766649 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+2785 (secure 0 0 0) 0x7fd4f804b500 con 0x7fd4fc0a9c40 2023-08-17T00:14:37.269 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:37.269 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":116,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7166,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1574374598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":1574374598},{"type":"v1","addr":"172.21.15.178:6837","nonce":1574374598}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/1806486883","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1806486883},{"type":"v1","addr":"172.21.15.153:6834","nonce":1806486883}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":104},{"gid":8904,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2427806887","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2427806887},{"type":"v1","addr":"172.21.15.153:6835","nonce":2427806887}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[]} 2023-08-17T00:14:37.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd4e005a150 msgr2=0x7fd4e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd4e005a150 0x7fd4e005c610 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fd4fc0c3430 tx=0x7fd4ec007d70).stop 2023-08-17T00:14:37.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 msgr2=0x7fd4fc1488d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 0x7fd4fc1488d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fd4f800e930 tx=0x7fd4f8009060).stop 2023-08-17T00:14:37.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 shutdown_connections 2023-08-17T00:14:37.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd4e005a150 0x7fd4e005c610 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4fc0ca4f0 0x7fd4fc0c04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4fc0c9f00 0x7fd4fc164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 --2- 172.21.15.153:0/545766649 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4fc0a9c40 0x7fd4fc1488d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 >> 172.21.15.153:0/545766649 conn(0x7fd4fc0cb370 msgr2=0x7fd4fc153530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:37.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 shutdown_connections 2023-08-17T00:14:37.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.266+0000 7fd502a39700 1 -- 172.21.15.153:0/545766649 wait complete. 2023-08-17T00:14:37.274 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 116 2023-08-17T00:14:37.293 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:14:37.293 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:14:37.294 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:14:37.294 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:14:37.294 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:14:37.294 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:14:37.295 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:14:37.295 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:14:37.295 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:14:37.295 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:14:37.296 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:14:37.296 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:14:37.297 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:14:37.297 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:14:37.312 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:14:37.312 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:14:37.314 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:14:37.314 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:14:37.317 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:14:37.317 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:14:37.321 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:14:37.321 DEBUG:teuthology.parallel:result is None 2023-08-17T00:14:37.325 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:14:37.325 DEBUG:teuthology.parallel:result is None 2023-08-17T00:14:37.361 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:14:37.361 DEBUG:teuthology.parallel:result is None 2023-08-17T00:14:37.365 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:14:37.366 DEBUG:teuthology.parallel:result is None 2023-08-17T00:14:37.366 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:14:37.432 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:14:37.435 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:14:37.467 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:14:37.468 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:14:37.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.526+0000 7f59b6cf1700 1 Processor -- start 2023-08-17T00:14:37.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.526+0000 7f59b6cf1700 1 -- start start 2023-08-17T00:14:37.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b6cf1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f59b0151cd0 0x7f59b0069120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b6cf1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b00a4cf0 con 0x7f59b00c7d20 2023-08-17T00:14:37.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b6cf1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b00a4fd0 con 0x7f59b00c7940 2023-08-17T00:14:37.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b6cf1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b00a64a0 con 0x7f59b0151cd0 2023-08-17T00:14:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59affff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f59b00c7d20 0x7f59b01515c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44166/0 (socket says 172.21.15.153:44166) 2023-08-17T00:14:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59affff700 1 -- 172.21.15.153:0/383234166 learned_addr learned my addr 172.21.15.153:0/383234166 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b528e700 1 --2- 172.21.15.153:0/383234166 >> v2:172.21.15.153:3300/0 conn(0x7f59b0151cd0 0x7f59b0069120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59af7fe700 1 -- 172.21.15.153:0/383234166 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3632592408 0 0) 0x7f59b00a4cf0 con 0x7f59b00c7d20 2023-08-17T00:14:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59af7fe700 1 -- 172.21.15.153:0/383234166 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59a00033f0 con 0x7f59b00c7d20 2023-08-17T00:14:37.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b528e700 1 -- 172.21.15.153:0/383234166 >> v1:172.21.15.178:6789/0 conn(0x7f59b00c7940 legacy=0x7f59b00a5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59af7fe700 1 -- 172.21.15.153:0/383234166 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2977185126 0 0) 0x7f59b00a4fd0 con 0x7f59b00c7940 2023-08-17T00:14:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b528e700 1 -- 172.21.15.153:0/383234166 >> v1:172.21.15.153:6789/0 conn(0x7f59b00c7d20 legacy=0x7f59b01515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b528e700 1 -- 172.21.15.153:0/383234166 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00a52b0 con 0x7f59b0151cd0 2023-08-17T00:14:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b528e700 1 --2- 172.21.15.153:0/383234166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b0151cd0 0x7f59b0069120 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f59a8009e60 tx=0x7f59a8009780).ready entity=mon.0 client_cookie=1c2b4597c91f447c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59af7fe700 1 -- 172.21.15.153:0/383234166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800e070 con 0x7f59b0151cd0 2023-08-17T00:14:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59af7fe700 1 -- 172.21.15.153:0/383234166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a800bb60 con 0x7f59b0151cd0 2023-08-17T00:14:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59af7fe700 1 -- 172.21.15.153:0/383234166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800bee0 con 0x7f59b0151cd0 2023-08-17T00:14:37.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b6cf1700 1 -- 172.21.15.153:0/383234166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b0151cd0 msgr2=0x7f59b0069120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.530+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/383234166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b0151cd0 0x7f59b0069120 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 rx=0x7f59a8009e60 tx=0x7f59a8009780).stop 2023-08-17T00:14:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- 172.21.15.153:0/383234166 shutdown_connections 2023-08-17T00:14:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/383234166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b0151cd0 0x7f59b0069120 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- 172.21.15.153:0/383234166 >> 172.21.15.153:0/383234166 conn(0x7f59b00aa820 msgr2=0x7f59b00aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- 172.21.15.153:0/383234166 shutdown_connections 2023-08-17T00:14:37.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- 172.21.15.153:0/383234166 wait complete. 2023-08-17T00:14:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 Processor -- start 2023-08-17T00:14:37.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- start start 2023-08-17T00:14:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b00c7940 0x7f59b00a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 0x7f59b00a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b0151cd0 0x7f59b013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0069610 con 0x7f59b00c7d20 2023-08-17T00:14:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0065530 con 0x7f59b0151cd0 2023-08-17T00:14:37.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59b6cf1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00a9e80 con 0x7f59b00c7940 2023-08-17T00:14:37.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59affff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 0x7f59b00a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59affff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 0x7f59b00a6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43904/0 (socket says 172.21.15.153:43904) 2023-08-17T00:14:37.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.534+0000 7f59affff700 1 -- 172.21.15.153:0/2024954492 learned_addr learned my addr 172.21.15.153:0/2024954492 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:37.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59b4a8d700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b00c7940 0x7f59b00a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59b528e700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b0151cd0 0x7f59b013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59affff700 1 -- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b00c7940 msgr2=0x7f59b00a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59affff700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b00c7940 0x7f59b00a95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59affff700 1 -- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b0151cd0 msgr2=0x7f59b013d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59affff700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b0151cd0 0x7f59b013d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59affff700 1 -- 172.21.15.153:0/2024954492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a8009a20 con 0x7f59b00c7d20 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59affff700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 0x7f59b00a6db0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f599c00c410 tx=0x7f599c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0072e0 con 0x7f59b00c7d20 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599c007440 con 0x7f59b00c7d20 2023-08-17T00:14:37.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599c0057a0 con 0x7f59b00c7d20 2023-08-17T00:14:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b00aa160 con 0x7f59b00c7d20 2023-08-17T00:14:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b0065a60 con 0x7f59b00c7d20 2023-08-17T00:14:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.538+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b006b530 con 0x7f59b00c7d20 2023-08-17T00:14:37.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.542+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f599c010070 con 0x7f59b00c7d20 2023-08-17T00:14:37.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.542+0000 7f59acff9700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f599405a150 0x7f599405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:37.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.542+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f599c0733d0 con 0x7f59b00c7d20 2023-08-17T00:14:37.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.542+0000 7f59b4a8d700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f599405a150 0x7f599405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:37.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.546+0000 7f59b4a8d700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f599405a150 0x7f599405c610 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f59a40036f0 tx=0x7f59a4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:37.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.550+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f599c046fb0 con 0x7f59b00c7d20 2023-08-17T00:14:37.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:37.726+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f59b00c1fc0 con 0x7f59b00c7d20 2023-08-17T00:14:38.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.494+0000 7f59acff9700 1 -- 172.21.15.153:0/2024954492 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v150) v1 ==== 97+0+0 (secure 0 0 0) 0x7f599c018070 con 0x7f59b00c7d20 2023-08-17T00:14:38.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f599405a150 msgr2=0x7f599405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f599405a150 0x7f599405c610 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7f59a40036f0 tx=0x7f59a4009040).stop 2023-08-17T00:14:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 msgr2=0x7f59b00a6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 0x7f59b00a6db0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 rx=0x7f599c00c410 tx=0x7f599c007c70).stop 2023-08-17T00:14:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 shutdown_connections 2023-08-17T00:14:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f599405a150 0x7f599405c610 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59b0151cd0 0x7f59b013d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f59b00c7d20 0x7f59b00a6db0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 --2- 172.21.15.153:0/2024954492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59b00c7940 0x7f59b00a95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 >> 172.21.15.153:0/2024954492 conn(0x7f59b00aa820 msgr2=0x7f59b00c1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 shutdown_connections 2023-08-17T00:14:38.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.498+0000 7f59b6cf1700 1 -- 172.21.15.153:0/2024954492 wait complete. 2023-08-17T00:14:38.506 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:14:38.525 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:14:38.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.686+0000 7fdf76af1700 1 Processor -- start 2023-08-17T00:14:38.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.686+0000 7fdf76af1700 1 -- start start 2023-08-17T00:14:38.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf76af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70151b90 0x7fdf70151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf76af1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf70063290 0x7fdf70065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf76af1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf70065b50 0x7fdf70064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf76af1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700c3fb0 con 0x7fdf70065b50 2023-08-17T00:14:38.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf76af1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf70152460 con 0x7fdf70063290 2023-08-17T00:14:38.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf76af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70061fa0 con 0x7fdf70151b90 2023-08-17T00:14:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf70065b50 0x7fdf70064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7488d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70151b90 0x7fdf70151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf70065b50 0x7fdf70064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43918/0 (socket says 172.21.15.153:43918) 2023-08-17T00:14:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7488d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70151b90 0x7fdf70151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:60656/0 (socket says 172.21.15.153:60656) 2023-08-17T00:14:38.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf6ffff700 1 --2- 172.21.15.153:0/3883381678 >> v2:172.21.15.178:3300/0 conn(0x7fdf70063290 0x7fdf70065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 -- 172.21.15.153:0/3883381678 learned_addr learned my addr 172.21.15.153:0/3883381678 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 -- 172.21.15.153:0/3883381678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70151b90 msgr2=0x7fdf70151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 --2- 172.21.15.153:0/3883381678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70151b90 0x7fdf70151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 -- 172.21.15.153:0/3883381678 >> v2:172.21.15.178:3300/0 conn(0x7fdf70063290 msgr2=0x7fdf70065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 --2- 172.21.15.153:0/3883381678 >> v2:172.21.15.178:3300/0 conn(0x7fdf70063290 0x7fdf70065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 -- 172.21.15.153:0/3883381678 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700621f0 con 0x7fdf70065b50 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf6ffff700 1 --2- 172.21.15.153:0/3883381678 >> v2:172.21.15.178:3300/0 conn(0x7fdf70063290 0x7fdf70065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:38.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.690+0000 7fdf7508e700 1 --2- 172.21.15.153:0/3883381678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70064870 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fdf70068340 tx=0x7fdf68009840).ready entity=mon.0 client_cookie=6208d6c95c789de7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:38.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf6f7fe700 1 -- 172.21.15.153:0/3883381678 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800e070 con 0x7fdf70065b50 2023-08-17T00:14:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf6f7fe700 1 -- 172.21.15.153:0/3883381678 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6800b970 con 0x7fdf70065b50 2023-08-17T00:14:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf6f7fe700 1 -- 172.21.15.153:0/3883381678 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6800bcf0 con 0x7fdf70065b50 2023-08-17T00:14:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 -- 172.21.15.153:0/3883381678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 msgr2=0x7fdf70064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 --2- 172.21.15.153:0/3883381678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70064870 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 rx=0x7fdf70068340 tx=0x7fdf68009840).stop 2023-08-17T00:14:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 -- 172.21.15.153:0/3883381678 shutdown_connections 2023-08-17T00:14:38.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 --2- 172.21.15.153:0/3883381678 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70064870 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 --2- 172.21.15.153:0/3883381678 >> v2:172.21.15.178:3300/0 conn(0x7fdf70063290 0x7fdf70065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 --2- 172.21.15.153:0/3883381678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70151b90 0x7fdf70151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 -- 172.21.15.153:0/3883381678 >> 172.21.15.153:0/3883381678 conn(0x7fdf700c7150 msgr2=0x7fdf700c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:38.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 -- 172.21.15.153:0/3883381678 shutdown_connections 2023-08-17T00:14:38.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 -- 172.21.15.153:0/3883381678 wait complete. 2023-08-17T00:14:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.694+0000 7fdf76af1700 1 Processor -- start 2023-08-17T00:14:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 -- start start 2023-08-17T00:14:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70063290 0x7fdf701550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70164070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70151b90 0x7fdf700aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70153520 con 0x7fdf70065b50 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70164560 con 0x7fdf70151b90 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70153180 con 0x7fdf70063290 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70164070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70164070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43924/0 (socket says 172.21.15.153:43924) 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 -- 172.21.15.153:0/1599151222 learned_addr learned my addr 172.21.15.153:0/1599151222 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:38.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf7488d700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70063290 0x7fdf701550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf7508e700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70151b90 0x7fdf700aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 -- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70063290 msgr2=0x7fdf701550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70063290 0x7fdf701550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 -- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70151b90 msgr2=0x7fdf700aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70151b90 0x7fdf700aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 -- 172.21.15.153:0/1599151222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf5c0092a0 con 0x7fdf70065b50 2023-08-17T00:14:38.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6ffff700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70164070 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fdf5c00e9d0 tx=0x7fdf5c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:38.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00c850 con 0x7fdf70065b50 2023-08-17T00:14:38.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5c00c9b0 con 0x7fdf70065b50 2023-08-17T00:14:38.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf68009ae0 con 0x7fdf70065b50 2023-08-17T00:14:38.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5c00cd30 con 0x7fdf70065b50 2023-08-17T00:14:38.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.698+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf700bde80 con 0x7fdf70065b50 2023-08-17T00:14:38.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.702+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700bd920 con 0x7fdf70065b50 2023-08-17T00:14:38.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.702+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdf5c022070 con 0x7fdf70065b50 2023-08-17T00:14:38.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.702+0000 7fdf6cff9700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf5405a150 0x7fdf5405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:38.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.702+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fdf5c0743b0 con 0x7fdf70065b50 2023-08-17T00:14:38.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.706+0000 7fdf7488d700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf5405a150 0x7fdf5405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:38.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.706+0000 7fdf7488d700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf5405a150 0x7fdf5405c610 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fdf64009b20 tx=0x7fdf64008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:38.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.710+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf5c0480a0 con 0x7fdf70065b50 2023-08-17T00:14:38.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.922+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdf700624d0 con 0x7fdf70065b50 2023-08-17T00:14:38.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.922+0000 7fdf6cff9700 1 -- 172.21.15.153:0/1599151222 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdf5c016090 con 0x7fdf70065b50 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:14:38.927 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:14:38.928 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:14:38.928 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.928 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.928 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.929 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.929 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:14:38.929 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:14:38.929 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.929 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.930 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:14:38.930 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:14:38.930 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.930 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.930 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.930 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:14:38.931 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.932 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.933 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.934 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.935 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:14:38.935 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:14:38.935 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.935 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.936 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.936 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.936 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.936 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.936 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:14:38.936 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:14:38.937 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.937 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:14:38.938 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.939 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:14:38.940 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:14:38.940 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.940 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.940 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.941 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:14:38.942 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.943 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.944 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:14:38.945 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.946 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:14:38.947 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.948 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:14:38.949 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:14:38.950 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.950 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.950 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.950 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:14:38.950 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:14:38.950 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:14:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:14:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:14:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.951 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:14:38.952 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:14:38.953 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:14:38.954 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:14:38.954 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:14:38.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.954 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:38.954 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:14:38.954 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:14:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf5405a150 msgr2=0x7fdf5405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf5405a150 0x7fdf5405c610 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7fdf64009b20 tx=0x7fdf64008040).stop 2023-08-17T00:14:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 msgr2=0x7fdf70164070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:38.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70164070 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 rx=0x7fdf5c00e9d0 tx=0x7fdf5c009060).stop 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 shutdown_connections 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf5405a150 0x7fdf5405c610 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf70151b90 0x7fdf700aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf70065b50 0x7fdf70164070 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 --2- 172.21.15.153:0/1599151222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf70063290 0x7fdf701550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 >> 172.21.15.153:0/1599151222 conn(0x7fdf700c7150 msgr2=0x7fdf700c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:38.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 shutdown_connections 2023-08-17T00:14:38.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:38.926+0000 7fdf76af1700 1 -- 172.21.15.153:0/1599151222 wait complete. 2023-08-17T00:14:38.958 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:39.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.106+0000 7efc23347700 1 Processor -- start 2023-08-17T00:14:39.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.106+0000 7efc23347700 1 -- start start 2023-08-17T00:14:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.106+0000 7efc23347700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc1c0a8df0 0x7efc1c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.106+0000 7efc23347700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c1585a0 con 0x7efc1c0aa6e0 2023-08-17T00:14:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.106+0000 7efc23347700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc1c066400 con 0x7efc1c068820 2023-08-17T00:14:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.106+0000 7efc23347700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1c062dc0 con 0x7efc1c0a8df0 2023-08-17T00:14:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22b46700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7efc1c0aa6e0 0x7efc1c0626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44176/0 (socket says 172.21.15.153:44176) 2023-08-17T00:14:39.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22b46700 1 -- 172.21.15.153:0/2263847934 learned_addr learned my addr 172.21.15.153:0/2263847934 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22345700 1 --2- 172.21.15.153:0/2263847934 >> v2:172.21.15.178:3300/0 conn(0x7efc1c0a8df0 0x7efc1c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060636894 0 0) 0x7efc1c1585a0 con 0x7efc1c0aa6e0 2023-08-17T00:14:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc080033f0 con 0x7efc1c0aa6e0 2023-08-17T00:14:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492710322 0 0) 0x7efc1c066400 con 0x7efc1c068820 2023-08-17T00:14:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc1c1585a0 con 0x7efc1c068820 2023-08-17T00:14:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22345700 1 -- 172.21.15.153:0/2263847934 >> v1:172.21.15.178:6789/0 conn(0x7efc1c068820 legacy=0x7efc1c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22345700 1 -- 172.21.15.153:0/2263847934 >> v1:172.21.15.153:6789/0 conn(0x7efc1c0aa6e0 legacy=0x7efc1c0626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22345700 1 -- 172.21.15.153:0/2263847934 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0b9d30 con 0x7efc1c0a8df0 2023-08-17T00:14:39.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc22345700 1 --2- 172.21.15.153:0/2263847934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0a8df0 0x7efc1c0c1490 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7efc18009eb0 tx=0x7efc18009780).ready entity=mon.1 client_cookie=883a6eacc7889aa4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800e070 con 0x7efc1c0a8df0 2023-08-17T00:14:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1800bb80 con 0x7efc1c0a8df0 2023-08-17T00:14:39.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc21343700 1 -- 172.21.15.153:0/2263847934 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc18012410 con 0x7efc1c0a8df0 2023-08-17T00:14:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc23347700 1 -- 172.21.15.153:0/2263847934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0a8df0 msgr2=0x7efc1c0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.110+0000 7efc23347700 1 --2- 172.21.15.153:0/2263847934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0a8df0 0x7efc1c0c1490 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7efc18009eb0 tx=0x7efc18009780).stop 2023-08-17T00:14:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 -- 172.21.15.153:0/2263847934 shutdown_connections 2023-08-17T00:14:39.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 --2- 172.21.15.153:0/2263847934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0a8df0 0x7efc1c0c1490 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 -- 172.21.15.153:0/2263847934 >> 172.21.15.153:0/2263847934 conn(0x7efc1c0c6620 msgr2=0x7efc1c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 -- 172.21.15.153:0/2263847934 shutdown_connections 2023-08-17T00:14:39.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 -- 172.21.15.153:0/2263847934 wait complete. 2023-08-17T00:14:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 Processor -- start 2023-08-17T00:14:39.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.114+0000 7efc23347700 1 -- start start 2023-08-17T00:14:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc23347700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 0x7efc1c16bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc23347700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc1c0a8df0 0x7efc1c169240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc23347700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0aa6e0 0x7efc1c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc23347700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c16c790 con 0x7efc1c068820 2023-08-17T00:14:39.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc23347700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c16ca70 con 0x7efc1c0aa6e0 2023-08-17T00:14:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc23347700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc1c16cd50 con 0x7efc1c0a8df0 2023-08-17T00:14:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 0x7efc1c16bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 0x7efc1c16bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43926/0 (socket says 172.21.15.153:43926) 2023-08-17T00:14:39.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 -- 172.21.15.153:0/31304077 learned_addr learned my addr 172.21.15.153:0/31304077 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22b46700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0aa6e0 0x7efc1c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc21b44700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc1c0a8df0 0x7efc1c169240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 -- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc1c0a8df0 msgr2=0x7efc1c169240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc1c0a8df0 0x7efc1c169240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 -- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0aa6e0 msgr2=0x7efc1c0c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0aa6e0 0x7efc1c0c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 -- 172.21.15.153:0/31304077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc18009a20 con 0x7efc1c068820 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc21b44700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc1c0a8df0 0x7efc1c169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22b46700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0aa6e0 0x7efc1c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.118+0000 7efc22345700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 0x7efc1c16bf80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7efc1800b610 tx=0x7efc18009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1800be70 con 0x7efc1c068820 2023-08-17T00:14:39.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1801d630 con 0x7efc1c068820 2023-08-17T00:14:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc1c168d20 con 0x7efc1c068820 2023-08-17T00:14:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1801d9f0 con 0x7efc1c068820 2023-08-17T00:14:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc1c169730 con 0x7efc1c068820 2023-08-17T00:14:39.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc1c0c2910 con 0x7efc1c068820 2023-08-17T00:14:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.122+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efc1801dd60 con 0x7efc1c068820 2023-08-17T00:14:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.126+0000 7efc127fc700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc0005a180 0x7efc0005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.126+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5269+0+0 (secure 0 0 0) 0x7efc18075b90 con 0x7efc1c068820 2023-08-17T00:14:39.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.126+0000 7efc21b44700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc0005a180 0x7efc0005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.126+0000 7efc21b44700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc0005a180 0x7efc0005c640 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7efc1c0c5e50 tx=0x7efc0c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.130+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efc1c0c2910 con 0x7efc1c068820 2023-08-17T00:14:39.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.294+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc1c065780 con 0x7efc1c068820 2023-08-17T00:14:39.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc127fc700 1 -- 172.21.15.153:0/31304077 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+13770 (secure 0 0 0) 0x7efc1c065780 con 0x7efc1c068820 2023-08-17T00:14:39.302 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:39.302 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":150,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:38.489561+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":141,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc0005a180 msgr2=0x7efc0005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc0005a180 0x7efc0005c640 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7efc1c0c5e50 tx=0x7efc0c009040).stop 2023-08-17T00:14:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 msgr2=0x7efc1c16bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 0x7efc1c16bf80 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 rx=0x7efc1800b610 tx=0x7efc18009780).stop 2023-08-17T00:14:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 shutdown_connections 2023-08-17T00:14:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efc0005a180 0x7efc0005c640 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc1c0aa6e0 0x7efc1c0c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc1c0a8df0 0x7efc1c169240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 --2- 172.21.15.153:0/31304077 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efc1c068820 0x7efc1c16bf80 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 >> 172.21.15.153:0/31304077 conn(0x7efc1c0c6620 msgr2=0x7efc1c0ab340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.298+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 shutdown_connections 2023-08-17T00:14:39.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.302+0000 7efc23347700 1 -- 172.21.15.153:0/31304077 wait complete. 2023-08-17T00:14:39.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:14:39.324 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:14:39.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.482+0000 7f025a579700 1 Processor -- start 2023-08-17T00:14:39.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.482+0000 7f025a579700 1 -- start start 2023-08-17T00:14:39.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f025a579700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f0254062fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f025a579700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02541505c0 con 0x7f02540634a0 2023-08-17T00:14:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f025a579700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02541508a0 con 0x7f02540c4f60 2023-08-17T00:14:39.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f025a579700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0254063a10 con 0x7f025414fe80 2023-08-17T00:14:39.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f0258d76700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f02540634a0 0x7f02540c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44180/0 (socket says 172.21.15.153:44180) 2023-08-17T00:14:39.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f0258d76700 1 -- 172.21.15.153:0/4258063270 learned_addr learned my addr 172.21.15.153:0/4258063270 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:39.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f0259577700 1 --2- 172.21.15.153:0/4258063270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f0254062fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480279726 0 0) 0x7f02541505c0 con 0x7f02540634a0 2023-08-17T00:14:39.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02400033f0 con 0x7f02540634a0 2023-08-17T00:14:39.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965751235 0 0) 0x7f02541508a0 con 0x7f02540c4f60 2023-08-17T00:14:39.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02541505c0 con 0x7f02540c4f60 2023-08-17T00:14:39.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f0259577700 1 -- 172.21.15.153:0/4258063270 >> v1:172.21.15.178:6789/0 conn(0x7f02540c4f60 legacy=0x7f02540c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f0259577700 1 -- 172.21.15.153:0/4258063270 >> v1:172.21.15.153:6789/0 conn(0x7f02540634a0 legacy=0x7f02540c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.486+0000 7f0259577700 1 -- 172.21.15.153:0/4258063270 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0254150b80 con 0x7f025414fe80 2023-08-17T00:14:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f0259577700 1 --2- 172.21.15.153:0/4258063270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f0254062fb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f025000a930 tx=0x7f025000a200).ready entity=mon.2 client_cookie=89665af7182508e1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000c710 con 0x7f025414fe80 2023-08-17T00:14:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025000c870 con 0x7f025414fe80 2023-08-17T00:14:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f024bfff700 1 -- 172.21.15.153:0/4258063270 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025000cbf0 con 0x7f025414fe80 2023-08-17T00:14:39.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 -- 172.21.15.153:0/4258063270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 msgr2=0x7f0254062fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 --2- 172.21.15.153:0/4258063270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f0254062fb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f025000a930 tx=0x7f025000a200).stop 2023-08-17T00:14:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 -- 172.21.15.153:0/4258063270 shutdown_connections 2023-08-17T00:14:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 --2- 172.21.15.153:0/4258063270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f0254062fb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 -- 172.21.15.153:0/4258063270 >> 172.21.15.153:0/4258063270 conn(0x7f02540c4260 msgr2=0x7f0254068e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 -- 172.21.15.153:0/4258063270 shutdown_connections 2023-08-17T00:14:39.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.490+0000 7f025a579700 1 -- 172.21.15.153:0/4258063270 wait complete. 2023-08-17T00:14:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 Processor -- start 2023-08-17T00:14:39.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 -- start start 2023-08-17T00:14:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02540634a0 0x7f0254164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 0x7f02540c0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f02540bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02541654b0 con 0x7f02540c4f60 2023-08-17T00:14:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540aa700 con 0x7f02540634a0 2023-08-17T00:14:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f025a579700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02540a9dd0 con 0x7f025414fe80 2023-08-17T00:14:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 0x7f02540c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 0x7f02540c0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43930/0 (socket says 172.21.15.153:43930) 2023-08-17T00:14:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 -- 172.21.15.153:0/1168179817 learned_addr learned my addr 172.21.15.153:0/1168179817 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0259577700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02540634a0 0x7f0254164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0259d78700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f02540bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 -- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 msgr2=0x7f02540bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f02540bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 -- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02540634a0 msgr2=0x7f0254164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02540634a0 0x7f0254164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 -- 172.21.15.153:0/1168179817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025000a440 con 0x7f02540c4f60 2023-08-17T00:14:39.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.494+0000 7f0258d76700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 0x7f02540c0090 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f024400c490 tx=0x7f0244007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.498+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02440070d0 con 0x7f02540c4f60 2023-08-17T00:14:39.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.498+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0244007230 con 0x7f02540c4f60 2023-08-17T00:14:39.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.498+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02440075b0 con 0x7f02540c4f60 2023-08-17T00:14:39.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.498+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02540aa0b0 con 0x7f02540c4f60 2023-08-17T00:14:39.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.498+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02540bf8c0 con 0x7f02540c4f60 2023-08-17T00:14:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.498+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540aa890 con 0x7f02540c4f60 2023-08-17T00:14:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.502+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0244010070 con 0x7f02540c4f60 2023-08-17T00:14:39.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.502+0000 7f02497fa700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f023805a150 0x7f023805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.502+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f0244073250 con 0x7f02540c4f60 2023-08-17T00:14:39.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.502+0000 7f0259577700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f023805a150 0x7f023805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.502+0000 7f0259577700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f023805a150 0x7f023805c610 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f025000d010 tx=0x7f025000a200).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.510+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0244047050 con 0x7f02540c4f60 2023-08-17T00:14:39.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.670+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f025406b4c0 con 0x7f02540c4f60 2023-08-17T00:14:39.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.670+0000 7f02497fa700 1 -- 172.21.15.153:0/1168179817 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v150) v1 ==== 110+0+10 (secure 0 0 0) 0x7f024404a670 con 0x7f02540c4f60 2023-08-17T00:14:39.675 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:14:39.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.674+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f023805a150 msgr2=0x7f023805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.674+0000 7f025a579700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f023805a150 0x7f023805c610 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7f025000d010 tx=0x7f025000a200).stop 2023-08-17T00:14:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.674+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 msgr2=0x7f02540c0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 0x7f02540c0090 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 rx=0x7f024400c490 tx=0x7f0244007cc0).stop 2023-08-17T00:14:39.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 shutdown_connections 2023-08-17T00:14:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f023805a150 0x7f023805c610 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025414fe80 0x7f02540bf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f02540c4f60 0x7f02540c0090 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 --2- 172.21.15.153:0/1168179817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02540634a0 0x7f0254164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 >> 172.21.15.153:0/1168179817 conn(0x7f02540c4260 msgr2=0x7f0254069190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:39.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 shutdown_connections 2023-08-17T00:14:39.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.678+0000 7f025a579700 1 -- 172.21.15.153:0/1168179817 wait complete. 2023-08-17T00:14:39.701 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:14:39.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.862+0000 7fbab3af1700 1 Processor -- start 2023-08-17T00:14:39.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.862+0000 7fbab3af1700 1 -- start start 2023-08-17T00:14:39.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab3af1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbaac153ab0 0x7fbaac153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab3af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac0c7ba0 0x7fbaac0c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab3af1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaac0aa750 con 0x7fbaac0c8d50 2023-08-17T00:14:39.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab3af1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaac0c9dd0 con 0x7fbaac153ab0 2023-08-17T00:14:39.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab3af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0aacf0 con 0x7fbaac0c7ba0 2023-08-17T00:14:39.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab108c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbaac0c8d50 0x7fbaac0c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44194/0 (socket says 172.21.15.153:44194) 2023-08-17T00:14:39.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab188d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbaac153ab0 0x7fbaac153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab108c700 1 -- 172.21.15.153:0/827359786 learned_addr learned my addr 172.21.15.153:0/827359786 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:39.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab208e700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac0c7ba0 0x7fbaac0c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab088b700 1 -- 172.21.15.153:0/827359786 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302439970 0 0) 0x7fbaac0aa750 con 0x7fbaac0c8d50 2023-08-17T00:14:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab088b700 1 -- 172.21.15.153:0/827359786 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba980033f0 con 0x7fbaac0c8d50 2023-08-17T00:14:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab188d700 1 -- 172.21.15.153:0/827359786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac0c7ba0 msgr2=0x7fbaac0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab188d700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac0c7ba0 0x7fbaac0c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab188d700 1 -- 172.21.15.153:0/827359786 >> v1:172.21.15.153:6789/0 conn(0x7fbaac0c8d50 legacy=0x7fbaac0c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab188d700 1 -- 172.21.15.153:0/827359786 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac0c5ca0 con 0x7fbaac153ab0 2023-08-17T00:14:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab208e700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac0c7ba0 0x7fbaac0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab188d700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac153ab0 0x7fbaac153e90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fbaa8009760 tx=0x7fbaa8009060).ready entity=mon.0 client_cookie=ba3ecf277a2be426 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab088b700 1 -- 172.21.15.153:0/827359786 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80090d0 con 0x7fbaac153ab0 2023-08-17T00:14:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab088b700 1 -- 172.21.15.153:0/827359786 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa800d4a0 con 0x7fbaac153ab0 2023-08-17T00:14:39.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.866+0000 7fbab088b700 1 -- 172.21.15.153:0/827359786 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800d820 con 0x7fbaac153ab0 2023-08-17T00:14:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 -- 172.21.15.153:0/827359786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac153ab0 msgr2=0x7fbaac153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac153ab0 0x7fbaac153e90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 rx=0x7fbaa8009760 tx=0x7fbaa8009060).stop 2023-08-17T00:14:39.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 -- 172.21.15.153:0/827359786 shutdown_connections 2023-08-17T00:14:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac0c7ba0 0x7fbaac0c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 --2- 172.21.15.153:0/827359786 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac153ab0 0x7fbaac153e90 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 -- 172.21.15.153:0/827359786 >> 172.21.15.153:0/827359786 conn(0x7fbaac061fa0 msgr2=0x7fbaac0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:39.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 -- 172.21.15.153:0/827359786 shutdown_connections 2023-08-17T00:14:39.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 -- 172.21.15.153:0/827359786 wait complete. 2023-08-17T00:14:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 Processor -- start 2023-08-17T00:14:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.870+0000 7fbab3af1700 1 -- start start 2023-08-17T00:14:39.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaac0c7ba0 0x7fbaac156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 0x7fbaac0ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac153ab0 0x7fbaac154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0ae8e0 con 0x7fbaac0c8d50 2023-08-17T00:14:39.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac0af700 con 0x7fbaac0c7ba0 2023-08-17T00:14:39.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaac154d70 con 0x7fbaac153ab0 2023-08-17T00:14:39.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 0x7fbaac0ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 0x7fbaac0ae3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43942/0 (socket says 172.21.15.153:43942) 2023-08-17T00:14:39.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 -- 172.21.15.153:0/2395927155 learned_addr learned my addr 172.21.15.153:0/2395927155 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab208e700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac153ab0 0x7fbaac154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab188d700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaac0c7ba0 0x7fbaac156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 -- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac153ab0 msgr2=0x7fbaac154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac153ab0 0x7fbaac154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 -- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaac0c7ba0 msgr2=0x7fbaac156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaac0c7ba0 0x7fbaac156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 -- 172.21.15.153:0/2395927155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4009a20 con 0x7fbaac0c8d50 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab108c700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 0x7fbaac0ae3f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fba9c00c490 tx=0x7fba9c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0072e0 con 0x7fbaac0c8d50 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c007440 con 0x7fbaac0c8d50 2023-08-17T00:14:39.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0057a0 con 0x7fbaac0c8d50 2023-08-17T00:14:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa80092a0 con 0x7fbaac0c8d50 2023-08-17T00:14:39.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.874+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac0aee50 con 0x7fbaac0c8d50 2023-08-17T00:14:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.878+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaac06b530 con 0x7fbaac0c8d50 2023-08-17T00:14:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.878+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fba9c010070 con 0x7fbaac0c8d50 2023-08-17T00:14:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.878+0000 7fbaa1ffb700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba9005a150 0x7fba9005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.878+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fba9c073410 con 0x7fbaac0c8d50 2023-08-17T00:14:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.878+0000 7fbab188d700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba9005a150 0x7fba9005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:39.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.882+0000 7fbab188d700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba9005a150 0x7fba9005c610 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fbaa8003000 tx=0x7fbaa8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:39.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:39.886+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba9c047210 con 0x7fbaac0c8d50 2023-08-17T00:14:40.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.038+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbaac0c9810 con 0x7fbaac0c8d50 2023-08-17T00:14:40.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbaa1ffb700 1 -- 172.21.15.153:0/2395927155 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v150) v1 ==== 92+0+10 (secure 0 0 0) 0x7fba9c04a830 con 0x7fbaac0c8d50 2023-08-17T00:14:40.045 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:14:40.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba9005a150 msgr2=0x7fba9005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba9005a150 0x7fba9005c610 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7fbaa8003000 tx=0x7fbaa8016000).stop 2023-08-17T00:14:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 msgr2=0x7fbaac0ae3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 0x7fbaac0ae3f0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 rx=0x7fba9c00c490 tx=0x7fba9c007c50).stop 2023-08-17T00:14:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 shutdown_connections 2023-08-17T00:14:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba9005a150 0x7fba9005c610 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaac153ab0 0x7fbaac154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaac0c8d50 0x7fbaac0ae3f0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 --2- 172.21.15.153:0/2395927155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaac0c7ba0 0x7fbaac156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 >> 172.21.15.153:0/2395927155 conn(0x7fbaac061fa0 msgr2=0x7fbaac0bf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:40.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 shutdown_connections 2023-08-17T00:14:40.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.042+0000 7fbab3af1700 1 -- 172.21.15.153:0/2395927155 wait complete. 2023-08-17T00:14:40.066 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:14:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 Processor -- start 2023-08-17T00:14:40.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 -- start start 2023-08-17T00:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15200a8df0 0x7f15200c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15200aa6e0 0x7f1520068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15201585a0 con 0x7f1520068820 2023-08-17T00:14:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1520066400 con 0x7f15200a8df0 2023-08-17T00:14:40.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f1524bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1520069170 con 0x7f15200aa6e0 2023-08-17T00:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f151f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15200a8df0 0x7f15200c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f151ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15200aa6e0 0x7f1520068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f151f7fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15200a8df0 0x7f15200c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:59554/0 (socket says 172.21.15.153:59554) 2023-08-17T00:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.222+0000 7f151f7fe700 1 -- 172.21.15.153:0/190480317 learned_addr learned my addr 172.21.15.153:0/190480317 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151f7fe700 1 -- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15200aa6e0 msgr2=0x7f1520068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:40.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151f7fe700 1 --2- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15200aa6e0 0x7f1520068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151f7fe700 1 -- 172.21.15.153:0/190480317 >> v1:172.21.15.178:6789/0 conn(0x7f1520068820 legacy=0x7f1520061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151f7fe700 1 -- 172.21.15.153:0/190480317 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15200b9d30 con 0x7f15200a8df0 2023-08-17T00:14:40.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151f7fe700 1 --2- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c1490 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1510009f70 tx=0x7f1510009840).ready entity=mon.1 client_cookie=7c80f83ffc524a74 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:40.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151effd700 1 -- 172.21.15.153:0/190480317 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000e070 con 0x7f15200a8df0 2023-08-17T00:14:40.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151effd700 1 -- 172.21.15.153:0/190480317 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151000ba20 con 0x7f15200a8df0 2023-08-17T00:14:40.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f151effd700 1 -- 172.21.15.153:0/190480317 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000bda0 con 0x7f15200a8df0 2023-08-17T00:14:40.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 -- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 msgr2=0x7f15200c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 --2- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c1490 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7f1510009f70 tx=0x7f1510009840).stop 2023-08-17T00:14:40.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 -- 172.21.15.153:0/190480317 shutdown_connections 2023-08-17T00:14:40.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 --2- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15200aa6e0 0x7f1520068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 --2- 172.21.15.153:0/190480317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c1490 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 -- 172.21.15.153:0/190480317 >> 172.21.15.153:0/190480317 conn(0x7f15200c6620 msgr2=0x7f15200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:40.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 -- 172.21.15.153:0/190480317 shutdown_connections 2023-08-17T00:14:40.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.226+0000 7f1524bb9700 1 -- 172.21.15.153:0/190480317 wait complete. 2023-08-17T00:14:40.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.230+0000 7f1524bb9700 1 Processor -- start 2023-08-17T00:14:40.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.230+0000 7f1524bb9700 1 -- start start 2023-08-17T00:14:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.230+0000 7f1524bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 0x7f15200ba310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.230+0000 7f1524bb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1524bb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15200aa6e0 0x7f1520168ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1524bb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15200bac10 con 0x7f15200aa6e0 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1524bb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1520169460 con 0x7f15200a8df0 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1524bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1520169740 con 0x7f1520068820 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 0x7f15200ba310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15200aa6e0 0x7f1520168ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 0x7f15200ba310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:60742/0 (socket says 172.21.15.153:60742) 2023-08-17T00:14:40.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 -- 172.21.15.153:0/1069767188 learned_addr learned my addr 172.21.15.153:0/1069767188 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1516ffd700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 -- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 msgr2=0x7f15200c00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 -- 172.21.15.153:0/1069767188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15200aa6e0 msgr2=0x7f1520168ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15200aa6e0 0x7f1520168ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 -- 172.21.15.153:0/1069767188 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510009ae0 con 0x7f1520068820 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151ffff700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15200aa6e0 0x7f1520168ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f151f7fe700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 0x7f15200ba310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f15200668e0 tx=0x7f1510009840).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:40.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510013ad0 con 0x7f1520068820 2023-08-17T00:14:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1510013c30 con 0x7f1520068820 2023-08-17T00:14:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1520169a20 con 0x7f1520068820 2023-08-17T00:14:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151001c400 con 0x7f1520068820 2023-08-17T00:14:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.234+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1520168fd0 con 0x7f1520068820 2023-08-17T00:14:40.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.238+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152006b4c0 con 0x7f1520068820 2023-08-17T00:14:40.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.238+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f151001c830 con 0x7f1520068820 2023-08-17T00:14:40.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.238+0000 7f1517fff700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f150005a150 0x7f150005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.238+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f1510075650 con 0x7f1520068820 2023-08-17T00:14:40.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.242+0000 7f1516ffd700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f150005a150 0x7f150005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.242+0000 7f1516ffd700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f150005a150 0x7f150005c610 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f152015b510 tx=0x7f1508007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:40.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.246+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1510049340 con 0x7f1520068820 2023-08-17T00:14:40.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1520064010 con 0x7f1520068820 2023-08-17T00:14:40.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1517fff700 1 -- 172.21.15.153:0/1069767188 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v150) v1 ==== 84+0+143 (secure 0 0 0) 0x7f151004c960 con 0x7f1520068820 2023-08-17T00:14:40.423 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:40.423 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:14:40.424 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:40.424 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:14:40.424 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:14:40.425 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:14:40.425 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:14:40.425 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:14:40.425 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:14:40.425 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:40.426 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:14:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f150005a150 msgr2=0x7f150005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f150005a150 0x7f150005c610 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f152015b510 tx=0x7f1508007d40).stop 2023-08-17T00:14:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 msgr2=0x7f15200ba310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 0x7f15200ba310 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f15200668e0 tx=0x7f1510009840).stop 2023-08-17T00:14:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 shutdown_connections 2023-08-17T00:14:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f150005a150 0x7f150005c610 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15200aa6e0 0x7f1520168ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15200a8df0 0x7f15200c00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.418+0000 7f1524bb9700 1 --2- 172.21.15.153:0/1069767188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1520068820 0x7f15200ba310 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.422+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 >> 172.21.15.153:0/1069767188 conn(0x7f15200c6620 msgr2=0x7f15200aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:40.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.422+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 shutdown_connections 2023-08-17T00:14:40.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.422+0000 7f1524bb9700 1 -- 172.21.15.153:0/1069767188 wait complete. 2023-08-17T00:14:40.444 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:14:40.445 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:14:40.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.606+0000 7f95095a9700 1 Processor -- start 2023-08-17T00:14:40.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.610+0000 7f95095a9700 1 -- start start 2023-08-17T00:14:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.610+0000 7f95095a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9504153800 0x7f9504153be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.610+0000 7f95095a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 0x7f95040c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.610+0000 7f95095a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95040a97f0 0x7f95040a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.610+0000 7f95095a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040c00d0 con 0x7f95040a97f0 2023-08-17T00:14:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95040aa170 con 0x7f9504153800 2023-08-17T00:14:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95040bf7c0 con 0x7f95040c5590 2023-08-17T00:14:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 0x7f95040c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95037fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f95040a97f0 0x7f95040a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f9502ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9504153800 0x7f9504153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 0x7f95040c59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:60750/0 (socket says 172.21.15.153:60750) 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 -- 172.21.15.153:0/1370173147 learned_addr learned my addr 172.21.15.153:0/1370173147 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 -- 172.21.15.153:0/1370173147 >> v2:172.21.15.178:3300/0 conn(0x7f9504153800 msgr2=0x7f9504153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 --2- 172.21.15.153:0/1370173147 >> v2:172.21.15.178:3300/0 conn(0x7f9504153800 0x7f9504153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 -- 172.21.15.153:0/1370173147 >> v2:172.21.15.153:3300/0 conn(0x7f95040a97f0 msgr2=0x7f95040a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 --2- 172.21.15.153:0/1370173147 >> v2:172.21.15.153:3300/0 conn(0x7f95040a97f0 0x7f95040a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 -- 172.21.15.153:0/1370173147 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95040c6050 con 0x7f95040c5590 2023-08-17T00:14:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95027fc700 1 --2- 172.21.15.153:0/1370173147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 0x7f95040c59f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9504060b90 tx=0x7f94f80090f0).ready entity=mon.2 client_cookie=898ac63bc5901853 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f9501ffb700 1 -- 172.21.15.153:0/1370173147 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800f510 con 0x7f95040c5590 2023-08-17T00:14:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f9501ffb700 1 -- 172.21.15.153:0/1370173147 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f800f670 con 0x7f95040c5590 2023-08-17T00:14:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f9501ffb700 1 -- 172.21.15.153:0/1370173147 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f800fa10 con 0x7f95040c5590 2023-08-17T00:14:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- 172.21.15.153:0/1370173147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 msgr2=0x7f95040c59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 --2- 172.21.15.153:0/1370173147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 0x7f95040c59f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f9504060b90 tx=0x7f94f80090f0).stop 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- 172.21.15.153:0/1370173147 shutdown_connections 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 --2- 172.21.15.153:0/1370173147 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95040c5590 0x7f95040c59f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 --2- 172.21.15.153:0/1370173147 >> v2:172.21.15.153:3300/0 conn(0x7f95040a97f0 0x7f95040a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 --2- 172.21.15.153:0/1370173147 >> v2:172.21.15.178:3300/0 conn(0x7f9504153800 0x7f9504153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- 172.21.15.153:0/1370173147 >> 172.21.15.153:0/1370173147 conn(0x7f9504062a70 msgr2=0x7f95040ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- 172.21.15.153:0/1370173147 shutdown_connections 2023-08-17T00:14:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.614+0000 7f95095a9700 1 -- 172.21.15.153:0/1370173147 wait complete. 2023-08-17T00:14:40.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.618+0000 7f95095a9700 1 Processor -- start 2023-08-17T00:14:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.618+0000 7f95095a9700 1 -- start start 2023-08-17T00:14:40.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 0x7f9504149af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95040c5590 0x7f950414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9504153800 0x7f95040c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950414bde0 con 0x7f95040a97f0 2023-08-17T00:14:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950414b7d0 con 0x7f95040c5590 2023-08-17T00:14:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950414ea70 con 0x7f9504153800 2023-08-17T00:14:40.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 0x7f9504149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 0x7f9504149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43970/0 (socket says 172.21.15.153:43970) 2023-08-17T00:14:40.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 -- 172.21.15.153:0/1655196215 learned_addr learned my addr 172.21.15.153:0/1655196215 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:40.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95027fc700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95040c5590 0x7f950414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95037fe700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9504153800 0x7f95040c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 -- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9504153800 msgr2=0x7f95040c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9504153800 0x7f95040c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 -- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95040c5590 msgr2=0x7f950414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95040c5590 0x7f950414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 -- 172.21.15.153:0/1655196215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009370 con 0x7f95040a97f0 2023-08-17T00:14:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95027fc700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95040c5590 0x7f950414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f9502ffd700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 0x7f9504149af0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f94f400e900 tx=0x7f94f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:40.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4012600 con 0x7f95040a97f0 2023-08-17T00:14:40.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4012760 con 0x7f95040a97f0 2023-08-17T00:14:40.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950414ba70 con 0x7f95040a97f0 2023-08-17T00:14:40.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4012ae0 con 0x7f95040a97f0 2023-08-17T00:14:40.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.622+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9504149fe0 con 0x7f95040a97f0 2023-08-17T00:14:40.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.626+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950414b630 con 0x7f95040a97f0 2023-08-17T00:14:40.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.626+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f94f4022070 con 0x7f95040a97f0 2023-08-17T00:14:40.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.630+0000 7f94eaffd700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94f005a180 0x7f94f005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:40.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.630+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f94f4073f20 con 0x7f95040a97f0 2023-08-17T00:14:40.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.630+0000 7f95027fc700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94f005a180 0x7f94f005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:40.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.630+0000 7f95027fc700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94f005a180 0x7f94f005c640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f9504167410 tx=0x7f94f8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:40.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.634+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f94f40a28f0 con 0x7f95040a97f0 2023-08-17T00:14:40.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:40.798+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f9504046dd0 con 0x7f95040a97f0 2023-08-17T00:14:41.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.430+0000 7f94eaffd700 1 -- 172.21.15.153:0/1655196215 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v151) v1 ==== 152+0+0 (secure 0 0 0) 0x7f94f4016020 con 0x7f95040a97f0 2023-08-17T00:14:41.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.438+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94f005a180 msgr2=0x7f94f005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.438+0000 7f95095a9700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94f005a180 0x7f94f005c640 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7f9504167410 tx=0x7f94f8016000).stop 2023-08-17T00:14:41.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.438+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 msgr2=0x7f9504149af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.438+0000 7f95095a9700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 0x7f9504149af0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 rx=0x7f94f400e900 tx=0x7f94f4009060).stop 2023-08-17T00:14:41.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 shutdown_connections 2023-08-17T00:14:41.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f94f005a180 0x7f94f005c640 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9504153800 0x7f95040c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95040c5590 0x7f950414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 --2- 172.21.15.153:0/1655196215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f95040a97f0 0x7f9504149af0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 >> 172.21.15.153:0/1655196215 conn(0x7f9504062a70 msgr2=0x7f95040631c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:41.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 shutdown_connections 2023-08-17T00:14:41.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.442+0000 7f95095a9700 1 -- 172.21.15.153:0/1655196215 wait complete. 2023-08-17T00:14:41.451 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:14:41.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:14:41.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.630+0000 7f29ff107700 1 Processor -- start 2023-08-17T00:14:41.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.630+0000 7f29ff107700 1 -- start start 2023-08-17T00:14:41.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29ff107700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29f80c5ea0 0x7f29f80634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29ff107700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f8154e90 con 0x7f29f80acf30 2023-08-17T00:14:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29ff107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f8153fc0 con 0x7f29f80639a0 2023-08-17T00:14:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29ff107700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80c1730 con 0x7f29f80c5ea0 2023-08-17T00:14:41.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fe105700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f29f80acf30 0x7f29f80c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44200/0 (socket says 172.21.15.153:44200) 2023-08-17T00:14:41.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fe105700 1 -- 172.21.15.153:0/3309001165 learned_addr learned my addr 172.21.15.153:0/3309001165 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd904700 1 --2- 172.21.15.153:0/3309001165 >> v2:172.21.15.178:3300/0 conn(0x7f29f80c5ea0 0x7f29f80634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:41.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd103700 1 -- 172.21.15.153:0/3309001165 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244458491 0 0) 0x7f29f8154e90 con 0x7f29f80acf30 2023-08-17T00:14:41.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd904700 1 -- 172.21.15.153:0/3309001165 >> v1:172.21.15.178:6789/0 conn(0x7f29f80639a0 legacy=0x7f29f80bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd904700 1 -- 172.21.15.153:0/3309001165 >> v1:172.21.15.153:6789/0 conn(0x7f29f80acf30 legacy=0x7f29f80c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd904700 1 -- 172.21.15.153:0/3309001165 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f8154280 con 0x7f29f80c5ea0 2023-08-17T00:14:41.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd904700 1 --2- 172.21.15.153:0/3309001165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80c5ea0 0x7f29f80634b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f29e8009760 tx=0x7f29e8009060).ready entity=mon.1 client_cookie=a56228790919dec server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:41.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd103700 1 -- 172.21.15.153:0/3309001165 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800b580 con 0x7f29f80c5ea0 2023-08-17T00:14:41.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.634+0000 7f29fd103700 1 -- 172.21.15.153:0/3309001165 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800b6e0 con 0x7f29f80c5ea0 2023-08-17T00:14:41.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29fd103700 1 -- 172.21.15.153:0/3309001165 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800ba60 con 0x7f29f80c5ea0 2023-08-17T00:14:41.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 -- 172.21.15.153:0/3309001165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80c5ea0 msgr2=0x7f29f80634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 --2- 172.21.15.153:0/3309001165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80c5ea0 0x7f29f80634b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7f29e8009760 tx=0x7f29e8009060).stop 2023-08-17T00:14:41.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 -- 172.21.15.153:0/3309001165 shutdown_connections 2023-08-17T00:14:41.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 --2- 172.21.15.153:0/3309001165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80c5ea0 0x7f29f80634b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 -- 172.21.15.153:0/3309001165 >> 172.21.15.153:0/3309001165 conn(0x7f29f80cb330 msgr2=0x7f29f80c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:41.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 -- 172.21.15.153:0/3309001165 shutdown_connections 2023-08-17T00:14:41.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 -- 172.21.15.153:0/3309001165 wait complete. 2023-08-17T00:14:41.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 Processor -- start 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.638+0000 7f29ff107700 1 -- start start 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80639a0 0x7f29f80c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 0x7f29f80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f81505f0 0x7f29f8167480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80c37d0 con 0x7f29f80acf30 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80add30 con 0x7f29f80639a0 2023-08-17T00:14:41.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b03d0 con 0x7f29f81505f0 2023-08-17T00:14:41.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 0x7f29f80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:41.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 0x7f29f80ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43976/0 (socket says 172.21.15.153:43976) 2023-08-17T00:14:41.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 -- 172.21.15.153:0/1884401206 learned_addr learned my addr 172.21.15.153:0/1884401206 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:41.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fe105700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80639a0 0x7f29f80c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:41.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fe906700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f81505f0 0x7f29f8167480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:41.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 -- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f81505f0 msgr2=0x7f29f8167480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f81505f0 0x7f29f8167480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 -- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80639a0 msgr2=0x7f29f80c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80639a0 0x7f29f80c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 -- 172.21.15.153:0/1884401206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e80092a0 con 0x7f29f80acf30 2023-08-17T00:14:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fe906700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f81505f0 0x7f29f8167480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:41.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29fd904700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 0x7f29f80ad840 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f29e8009eb0 tx=0x7f29e8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800b850 con 0x7f29f80acf30 2023-08-17T00:14:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800b9b0 con 0x7f29f80acf30 2023-08-17T00:14:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80b06b0 con 0x7f29f80acf30 2023-08-17T00:14:41.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e801b670 con 0x7f29f80acf30 2023-08-17T00:14:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.642+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80b0020 con 0x7f29f80acf30 2023-08-17T00:14:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.646+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80c3940 con 0x7f29f80acf30 2023-08-17T00:14:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.646+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f29e802a070 con 0x7f29f80acf30 2023-08-17T00:14:41.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.646+0000 7f29ee7fc700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29dc05a150 0x7f29dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.646+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f29e8075590 con 0x7f29f80acf30 2023-08-17T00:14:41.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.646+0000 7f29fe105700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29dc05a150 0x7f29dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:41.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.650+0000 7f29fe105700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29dc05a150 0x7f29dc05c610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f29f40011e0 tx=0x7f29f4007b90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:41.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.654+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f29e8049220 con 0x7f29f80acf30 2023-08-17T00:14:41.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:41.810+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f29f806b4c0 con 0x7f29f80acf30 2023-08-17T00:14:42.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.438+0000 7f29ee7fc700 1 -- 172.21.15.153:0/1884401206 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v152) v1 ==== 170+0+0 (secure 0 0 0) 0x7f29e80280d0 con 0x7f29f80acf30 2023-08-17T00:14:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.450+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29dc05a150 msgr2=0x7f29dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.450+0000 7f29ff107700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29dc05a150 0x7f29dc05c610 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f29f40011e0 tx=0x7f29f4007b90).stop 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.450+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 msgr2=0x7f29f80ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.450+0000 7f29ff107700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 0x7f29f80ad840 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 rx=0x7f29e8009eb0 tx=0x7f29e8017000).stop 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.454+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 shutdown_connections 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.454+0000 7f29ff107700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f29dc05a150 0x7f29dc05c610 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.454+0000 7f29ff107700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29f81505f0 0x7f29f8167480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.454+0000 7f29ff107700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29f80acf30 0x7f29f80ad840 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.454+0000 7f29ff107700 1 --2- 172.21.15.153:0/1884401206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29f80639a0 0x7f29f80c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.454+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 >> 172.21.15.153:0/1884401206 conn(0x7f29f80cb330 msgr2=0x7f29f81524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:42.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.462+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 shutdown_connections 2023-08-17T00:14:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.466+0000 7f29ff107700 1 -- 172.21.15.153:0/1884401206 wait complete. 2023-08-17T00:14:42.476 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:14:42.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:14:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.658+0000 7f9239379700 1 Processor -- start 2023-08-17T00:14:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.658+0000 7f9239379700 1 -- start start 2023-08-17T00:14:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9239379700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92340acf30 0x7f92340c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9239379700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9234063bc0 0x7f92340bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9239379700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9234154e90 con 0x7f92340c5ea0 2023-08-17T00:14:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9239379700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9234153fc0 con 0x7f92340acf30 2023-08-17T00:14:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9239379700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9234154280 con 0x7f9234063bc0 2023-08-17T00:14:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9233fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92340acf30 0x7f92340c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f922bfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f92340c5ea0 0x7f92340634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:56510/0 (socket says 172.21.15.153:56510) 2023-08-17T00:14:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9233fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f92340acf30 0x7f92340c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43990/0 (socket says 172.21.15.153:43990) 2023-08-17T00:14:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f922bfff700 1 -- 172.21.15.153:0/3705179342 learned_addr learned my addr 172.21.15.153:0/3705179342 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.662+0000 7f9238b78700 1 --2- 172.21.15.153:0/3705179342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9234063bc0 0x7f92340bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f92337fe700 1 -- 172.21.15.153:0/3705179342 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064973912 0 0) 0x7f9234154e90 con 0x7f92340c5ea0 2023-08-17T00:14:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f92337fe700 1 -- 172.21.15.153:0/3705179342 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92200033f0 con 0x7f92340c5ea0 2023-08-17T00:14:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9233fff700 1 -- 172.21.15.153:0/3705179342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9234063bc0 msgr2=0x7f92340bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9233fff700 1 --2- 172.21.15.153:0/3705179342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9234063bc0 0x7f92340bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9233fff700 1 -- 172.21.15.153:0/3705179342 >> v1:172.21.15.178:6789/0 conn(0x7f92340c5ea0 legacy=0x7f92340634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9233fff700 1 -- 172.21.15.153:0/3705179342 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9234154560 con 0x7f92340acf30 2023-08-17T00:14:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9233fff700 1 --2- 172.21.15.153:0/3705179342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340c1020 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f9224009760 tx=0x7f9224009060).ready entity=mon.0 client_cookie=1af08d14e1bae45b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f92337fe700 1 -- 172.21.15.153:0/3705179342 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92240090d0 con 0x7f92340acf30 2023-08-17T00:14:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f92337fe700 1 -- 172.21.15.153:0/3705179342 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922400d4a0 con 0x7f92340acf30 2023-08-17T00:14:42.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f92337fe700 1 -- 172.21.15.153:0/3705179342 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f922400d820 con 0x7f92340acf30 2023-08-17T00:14:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 -- 172.21.15.153:0/3705179342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 msgr2=0x7f92340c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 --2- 172.21.15.153:0/3705179342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340c1020 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 rx=0x7f9224009760 tx=0x7f9224009060).stop 2023-08-17T00:14:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 -- 172.21.15.153:0/3705179342 shutdown_connections 2023-08-17T00:14:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 --2- 172.21.15.153:0/3705179342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9234063bc0 0x7f92340bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 --2- 172.21.15.153:0/3705179342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340c1020 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 -- 172.21.15.153:0/3705179342 >> 172.21.15.153:0/3705179342 conn(0x7f92340cb330 msgr2=0x7f92340c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:42.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 -- 172.21.15.153:0/3705179342 shutdown_connections 2023-08-17T00:14:42.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.666+0000 7f9239379700 1 -- 172.21.15.153:0/3705179342 wait complete. 2023-08-17T00:14:42.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 Processor -- start 2023-08-17T00:14:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 -- start start 2023-08-17T00:14:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9234063bc0 0x7f9234162040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92340aefc0 0x7f92341669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234166550 con 0x7f92340acf30 2023-08-17T00:14:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9234165940 con 0x7f9234063bc0 2023-08-17T00:14:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9234165c20 con 0x7f92340aefc0 2023-08-17T00:14:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:42.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340aead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:43996/0 (socket says 172.21.15.153:43996) 2023-08-17T00:14:42.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 -- 172.21.15.153:0/2496386126 learned_addr learned my addr 172.21.15.153:0/2496386126 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:42.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9233fff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9234063bc0 0x7f9234162040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9238b78700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92340aefc0 0x7f92341669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 -- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92340aefc0 msgr2=0x7f92341669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92340aefc0 0x7f92341669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 -- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9234063bc0 msgr2=0x7f9234162040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9234063bc0 0x7f9234162040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 -- 172.21.15.153:0/2496386126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92240092a0 con 0x7f92340acf30 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9233fff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9234063bc0 0x7f9234162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f922bfff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340aead0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f921c00c420 tx=0x7f921c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0070d0 con 0x7f92340acf30 2023-08-17T00:14:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921c007230 con 0x7f92340acf30 2023-08-17T00:14:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0075b0 con 0x7f92340acf30 2023-08-17T00:14:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.670+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9234165f00 con 0x7f92340acf30 2023-08-17T00:14:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.674+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92340a9cb0 con 0x7f92340acf30 2023-08-17T00:14:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.674+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92340af3a0 con 0x7f92340acf30 2023-08-17T00:14:42.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.674+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f921c010070 con 0x7f92340acf30 2023-08-17T00:14:42.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.678+0000 7f9230ff9700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f921405a150 0x7f921405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:42.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.678+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f921c073680 con 0x7f92340acf30 2023-08-17T00:14:42.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.678+0000 7f9233fff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f921405a150 0x7f921405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:42.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.678+0000 7f9233fff700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f921405a150 0x7f921405c610 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f922400d260 tx=0x7f9224016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:42.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.682+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f921c047080 con 0x7f92340acf30 2023-08-17T00:14:42.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.878+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f923406b4c0 con 0x7f92340acf30 2023-08-17T00:14:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.890+0000 7f9230ff9700 1 -- 172.21.15.153:0/2496386126 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v118) v1 ==== 174+0+0 (secure 0 0 0) 0x7f921c04a6a0 con 0x7f92340acf30 2023-08-17T00:14:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.898+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f921405a150 msgr2=0x7f921405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.898+0000 7f9239379700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f921405a150 0x7f921405c610 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f922400d260 tx=0x7f9224016000).stop 2023-08-17T00:14:42.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.898+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 msgr2=0x7f92340aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:42.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.898+0000 7f9239379700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340aead0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 rx=0x7f921c00c420 tx=0x7f921c007c80).stop 2023-08-17T00:14:42.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 shutdown_connections 2023-08-17T00:14:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f921405a150 0x7f921405c610 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92340aefc0 0x7f92341669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92340acf30 0x7f92340aead0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 --2- 172.21.15.153:0/2496386126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9234063bc0 0x7f9234162040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:42.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 >> 172.21.15.153:0/2496386126 conn(0x7f92340cb330 msgr2=0x7f9234152220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 shutdown_connections 2023-08-17T00:14:42.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:42.906+0000 7f9239379700 1 -- 172.21.15.153:0/2496386126 wait complete. 2023-08-17T00:14:42.921 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 21 and data pool 22 2023-08-17T00:14:42.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:43.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ed509b700 1 Processor -- start 2023-08-17T00:14:43.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ed509b700 1 -- start start 2023-08-17T00:14:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ed509b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 0x7f1ed015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ed509b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed00aa750 con 0x7f1ed0153e90 2023-08-17T00:14:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ed509b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed01542f0 con 0x7f1ed0153ab0 2023-08-17T00:14:43.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ed509b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00c9dd0 con 0x7f1ed00c7ba0 2023-08-17T00:14:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ece59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1ed0153e90 0x7f1ed00c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44214/0 (socket says 172.21.15.153:44214) 2023-08-17T00:14:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ece59c700 1 -- 172.21.15.153:0/4133882165 learned_addr learned my addr 172.21.15.153:0/4133882165 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:43.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ecf59e700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 0x7f1ed015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541085946 0 0) 0x7f1ed00aa750 con 0x7f1ed0153e90 2023-08-17T00:14:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.094+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1eb80033f0 con 0x7f1ed0153e90 2023-08-17T00:14:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120686431 0 0) 0x7f1ed01542f0 con 0x7f1ed0153ab0 2023-08-17T00:14:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ed00aa750 con 0x7f1ed0153ab0 2023-08-17T00:14:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55408444 0 0) 0x7f1eb80033f0 con 0x7f1ed0153e90 2023-08-17T00:14:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 msgr2=0x7f1ed015e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:43.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 0x7f1ed015e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 >> v1:172.21.15.178:6789/0 conn(0x7f1ed0153ab0 legacy=0x7f1ed00c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00aacf0 con 0x7f1ed0153e90 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f1ec4001490 con 0x7f1ed0153e90 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 >> v1:172.21.15.153:6789/0 conn(0x7f1ed0153e90 legacy=0x7f1ed00c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8003aa0 0x7f1eb8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1eb8004690 0x7f1eb8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 0x7f1eb80050b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00c9dd0 con 0x7f1eb8004690 2023-08-17T00:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb800ba10 con 0x7f1eb8003aa0 2023-08-17T00:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb800bbd0 con 0x7f1ed00c7ba0 2023-08-17T00:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1eb8004690 0x7f1eb8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecf59e700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 0x7f1eb80050b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1eced9d700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8003aa0 0x7f1eb8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 -- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 msgr2=0x7f1eb80050b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:43.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed00c7ba0 0x7f1eb80050b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 -- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8003aa0 msgr2=0x7f1eb8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8003aa0 0x7f1eb8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 -- 172.21.15.153:0/4133882165 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb80033f0 con 0x7f1eb8004690 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ece59c700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1eb8004690 0x7f1eb8004b10 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f1ec4007f70 tx=0x7f1ed00c9f10).ready entity=mon.0 client_cookie=ab1bbfa8291b1b44 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4007170 con 0x7f1eb8004690 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec40072d0 con 0x7f1eb8004690 2023-08-17T00:14:43.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecdd9b700 1 -- 172.21.15.153:0/4133882165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400c980 con 0x7f1eb8004690 2023-08-17T00:14:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ed509b700 1 -- 172.21.15.153:0/4133882165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1eb8004690 msgr2=0x7f1eb8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ed509b700 1 --2- 172.21.15.153:0/4133882165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1eb8004690 0x7f1eb8004b10 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 rx=0x7f1ec4007f70 tx=0x7f1ed00c9f10).stop 2023-08-17T00:14:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ecf59e700 1 -- 172.21.15.153:0/4133882165 reap_dead start 2023-08-17T00:14:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ed509b700 1 -- 172.21.15.153:0/4133882165 shutdown_connections 2023-08-17T00:14:43.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ed509b700 1 -- 172.21.15.153:0/4133882165 >> 172.21.15.153:0/4133882165 conn(0x7f1ed0061fa0 msgr2=0x7f1ed00623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.098+0000 7f1ed509b700 1 -- 172.21.15.153:0/4133882165 shutdown_connections 2023-08-17T00:14:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.102+0000 7f1ed509b700 1 -- 172.21.15.153:0/4133882165 wait complete. 2023-08-17T00:14:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.102+0000 7f1ed509b700 1 Processor -- start 2023-08-17T00:14:43.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.102+0000 7f1ed509b700 1 -- start start 2023-08-17T00:14:43.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8004690 0x7f1ed00b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 0x7f1ed0151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed0151920 0x7f1ed00af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00ae170 con 0x7f1ed00c1b00 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00aecf0 con 0x7f1eb8004690 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed00c1f80 con 0x7f1ed0151920 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 0x7f1ed0151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 0x7f1ed0151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44012/0 (socket says 172.21.15.153:44012) 2023-08-17T00:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 -- 172.21.15.153:0/1861968561 learned_addr learned my addr 172.21.15.153:0/1861968561 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1eced9d700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8004690 0x7f1ed00b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ecf59e700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed0151920 0x7f1ed00af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 -- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed0151920 msgr2=0x7f1ed00af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed0151920 0x7f1ed00af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 -- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8004690 msgr2=0x7f1ed00b0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8004690 0x7f1ed00b0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 -- 172.21.15.153:0/1861968561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed00ae3c0 con 0x7f1ed00c1b00 2023-08-17T00:14:43.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ece59c700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 0x7f1ed0151430 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f1ec400c6a0 tx=0x7f1ec4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec4004e80 con 0x7f1ed00c1b00 2023-08-17T00:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec4000bc0 con 0x7f1ed00c1b00 2023-08-17T00:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed00ae6a0 con 0x7f1ed00c1b00 2023-08-17T00:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec400ccf0 con 0x7f1ed00c1b00 2023-08-17T00:14:43.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.106+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed00af670 con 0x7f1ed00c1b00 2023-08-17T00:14:43.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.110+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed00aee80 con 0x7f1ed00c1b00 2023-08-17T00:14:43.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.110+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1ec4010030 con 0x7f1ed00c1b00 2023-08-17T00:14:43.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.110+0000 7f1eb6ffd700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ebc05a150 0x7f1ebc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.110+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1ec401c040 con 0x7f1ed00c1b00 2023-08-17T00:14:43.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.110+0000 7f1eced9d700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ebc05a150 0x7f1ebc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.114+0000 7f1eced9d700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ebc05a150 0x7f1ebc05c610 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f1ec00010e0 tx=0x7f1ec0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.118+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1ec4048ee0 con 0x7f1ed00c1b00 2023-08-17T00:14:43.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.274+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed006b530 con 0x7f1ed00c1b00 2023-08-17T00:14:43.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.278+0000 7f1eb6ffd700 1 -- 172.21.15.153:0/1861968561 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f1ec404c500 con 0x7f1ed00c1b00 2023-08-17T00:14:43.283 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:43.283 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:42.883730+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:14:40.874126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T00:14:41.882057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ebc05a150 msgr2=0x7f1ebc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ebc05a150 0x7f1ebc05c610 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f1ec00010e0 tx=0x7f1ec0009040).stop 2023-08-17T00:14:43.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 msgr2=0x7f1ed0151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 0x7f1ed0151430 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 rx=0x7f1ec400c6a0 tx=0x7f1ec4015000).stop 2023-08-17T00:14:43.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 shutdown_connections 2023-08-17T00:14:43.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1ebc05a150 0x7f1ebc05c610 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ed0151920 0x7f1ed00af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1ed00c1b00 0x7f1ed0151430 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 --2- 172.21.15.153:0/1861968561 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb8004690 0x7f1ed00b0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 >> 172.21.15.153:0/1861968561 conn(0x7f1ed0061fa0 msgr2=0x7f1ed00ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:43.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 shutdown_connections 2023-08-17T00:14:43.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.282+0000 7f1ed509b700 1 -- 172.21.15.153:0/1861968561 wait complete. 2023-08-17T00:14:43.307 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 Processor -- start 2023-08-17T00:14:43.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 -- start start 2023-08-17T00:14:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2bd8153ab0 0x7f2bd8153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bd80c8d50 0x7f2bd80c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd80aa750 con 0x7f2bd80c7490 2023-08-17T00:14:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80c9dd0 con 0x7f2bd8153ab0 2023-08-17T00:14:43.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdf21b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80aacf0 con 0x7f2bd80c8d50 2023-08-17T00:14:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdcfb7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2bd8153ab0 0x7f2bd8153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdcfb7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2bd8153ab0 0x7f2bd8153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44016/0 (socket says 172.21.15.153:44016) 2023-08-17T00:14:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/2142696192 learned_addr learned my addr 172.21.15.153:0/2142696192 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/2142696192 >> v2:172.21.15.178:3300/0 conn(0x7f2bd80c8d50 msgr2=0x7f2bd80c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:43.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.458+0000 7f2bd7fff700 1 --2- 172.21.15.153:0/2142696192 >> v2:172.21.15.178:3300/0 conn(0x7f2bd80c8d50 0x7f2bd80c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdcfb7700 1 --2- 172.21.15.153:0/2142696192 >> v2:172.21.15.178:3300/0 conn(0x7f2bd80c8d50 0x7f2bd80c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/2142696192 >> v1:172.21.15.153:6789/0 conn(0x7f2bd80c7490 legacy=0x7f2bd80c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/2142696192 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80c5ca0 con 0x7f2bd8153ab0 2023-08-17T00:14:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bd7fff700 1 --2- 172.21.15.153:0/2142696192 >> v2:172.21.15.178:3300/0 conn(0x7f2bd80c8d50 0x7f2bd80c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:43.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdcfb7700 1 --2- 172.21.15.153:0/2142696192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd8153ab0 0x7f2bd8153e90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f2bd8083da0 tx=0x7f2bcc0090f0).ready entity=mon.0 client_cookie=780f9f29b2f8438a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bd77fe700 1 -- 172.21.15.153:0/2142696192 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00b600 con 0x7f2bd8153ab0 2023-08-17T00:14:43.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bd77fe700 1 -- 172.21.15.153:0/2142696192 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00b760 con 0x7f2bd8153ab0 2023-08-17T00:14:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bd77fe700 1 -- 172.21.15.153:0/2142696192 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00bb00 con 0x7f2bd8153ab0 2023-08-17T00:14:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 -- 172.21.15.153:0/2142696192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd8153ab0 msgr2=0x7f2bd8153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/2142696192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd8153ab0 0x7f2bd8153e90 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 rx=0x7f2bd8083da0 tx=0x7f2bcc0090f0).stop 2023-08-17T00:14:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 -- 172.21.15.153:0/2142696192 shutdown_connections 2023-08-17T00:14:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/2142696192 >> v2:172.21.15.178:3300/0 conn(0x7f2bd80c8d50 0x7f2bd80c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/2142696192 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd8153ab0 0x7f2bd8153e90 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 -- 172.21.15.153:0/2142696192 >> 172.21.15.153:0/2142696192 conn(0x7f2bd8061fa0 msgr2=0x7f2bd80623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 -- 172.21.15.153:0/2142696192 shutdown_connections 2023-08-17T00:14:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 -- 172.21.15.153:0/2142696192 wait complete. 2023-08-17T00:14:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.462+0000 7f2bdf21b700 1 Processor -- start 2023-08-17T00:14:43.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 -- start start 2023-08-17T00:14:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 0x7f2bd8148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd80c8d50 0x7f2bd81471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd8153ab0 0x7f2bd80ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8158190 con 0x7f2bd80c7490 2023-08-17T00:14:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8157580 con 0x7f2bd8153ab0 2023-08-17T00:14:43.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdf21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8157860 con 0x7f2bd80c8d50 2023-08-17T00:14:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdcfb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 0x7f2bd8148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdcfb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 0x7f2bd8148f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44030/0 (socket says 172.21.15.153:44030) 2023-08-17T00:14:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/4222334158 learned_addr learned my addr 172.21.15.153:0/4222334158 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bdd7b8700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd8153ab0 0x7f2bd80ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.466+0000 7f2bd7fff700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd80c8d50 0x7f2bd81471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd80c8d50 msgr2=0x7f2bd81471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdcfb7700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd80c8d50 0x7f2bd81471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd8153ab0 msgr2=0x7f2bd80ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdcfb7700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd8153ab0 0x7f2bd80ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdcfb7700 1 -- 172.21.15.153:0/4222334158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bcc009370 con 0x7f2bd80c7490 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bd7fff700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd80c8d50 0x7f2bd81471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdcfb7700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 0x7f2bd8148f10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f2bcc006fd0 tx=0x7f2bcc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc00bec0 con 0x7f2bd80c7490 2023-08-17T00:14:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bcc00b8d0 con 0x7f2bd80c7490 2023-08-17T00:14:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd8157b40 con 0x7f2bd80c7490 2023-08-17T00:14:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc024470 con 0x7f2bd80c7490 2023-08-17T00:14:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd8149400 con 0x7f2bd80c7490 2023-08-17T00:14:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd806b530 con 0x7f2bd80c7490 2023-08-17T00:14:43.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.470+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2bcc00f070 con 0x7f2bd80c7490 2023-08-17T00:14:43.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.474+0000 7f2bd4ff9700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bbc05a150 0x7f2bbc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.474+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2bcc075d00 con 0x7f2bd80c7490 2023-08-17T00:14:43.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.474+0000 7f2bd7fff700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bbc05a150 0x7f2bbc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.474+0000 7f2bd7fff700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bbc05a150 0x7f2bbc05c610 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f2bd81675a0 tx=0x7f2bc4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.478+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2bcc0496a0 con 0x7f2bd80c7490 2023-08-17T00:14:43.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.642+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd80c9810 con 0x7f2bd80c7490 2023-08-17T00:14:43.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.642+0000 7f2bd4ff9700 1 -- 172.21.15.153:0/4222334158 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f2bcc04ccc0 con 0x7f2bd80c7490 2023-08-17T00:14:43.648 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:43.648 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:42.883730+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:14:40.874126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T00:14:41.882057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bbc05a150 msgr2=0x7f2bbc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bbc05a150 0x7f2bbc05c610 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f2bd81675a0 tx=0x7f2bc4008040).stop 2023-08-17T00:14:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 msgr2=0x7f2bd8148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 0x7f2bd8148f10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 rx=0x7f2bcc006fd0 tx=0x7f2bcc017000).stop 2023-08-17T00:14:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 shutdown_connections 2023-08-17T00:14:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2bbc05a150 0x7f2bbc05c610 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bd8153ab0 0x7f2bd80ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bd80c8d50 0x7f2bd81471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 --2- 172.21.15.153:0/4222334158 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2bd80c7490 0x7f2bd8148f10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 >> 172.21.15.153:0/4222334158 conn(0x7f2bd8061fa0 msgr2=0x7f2bd8159980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 shutdown_connections 2023-08-17T00:14:43.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.646+0000 7f2bdf21b700 1 -- 172.21.15.153:0/4222334158 wait complete. 2023-08-17T00:14:43.673 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:14:43.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.826+0000 7fd2139a9700 1 Processor -- start 2023-08-17T00:14:43.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd2139a9700 1 -- start start 2023-08-17T00:14:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd2139a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd20c0a8b70 0x7fd20c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd2139a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0629b0 0x7fd20c0bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd2139a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20c065240 con 0x7fd20c0a8f50 2023-08-17T00:14:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd2139a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20c062e60 con 0x7fd20c0a8b70 2023-08-17T00:14:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd2139a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0638a0 con 0x7fd20c0629b0 2023-08-17T00:14:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd211745700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd20c0a8b70 0x7fd20c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd211745700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd20c0a8b70 0x7fd20c0632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44038/0 (socket says 172.21.15.153:44038) 2023-08-17T00:14:43.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd211745700 1 -- 172.21.15.153:0/3956187128 learned_addr learned my addr 172.21.15.153:0/3956187128 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:43.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.830+0000 7fd210f44700 1 --1- 172.21.15.153:0/3956187128 >> v1:172.21.15.153:6789/0 conn(0x7fd20c0a8f50 0x7fd20c0656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:44226/0 (socket says 172.21.15.153:44226) 2023-08-17T00:14:43.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd211745700 1 -- 172.21.15.153:0/3956187128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0629b0 msgr2=0x7fd20c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:43.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd211745700 1 --2- 172.21.15.153:0/3956187128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0629b0 0x7fd20c0bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:43.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd211745700 1 -- 172.21.15.153:0/3956187128 >> v1:172.21.15.153:6789/0 conn(0x7fd20c0a8f50 legacy=0x7fd20c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:43.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd211745700 1 -- 172.21.15.153:0/3956187128 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c065de0 con 0x7fd20c0a8b70 2023-08-17T00:14:43.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd211745700 1 --2- 172.21.15.153:0/3956187128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0a8b70 0x7fd20c0632e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fd208006fd0 tx=0x7fd2080090f0).ready entity=mon.0 client_cookie=68a528e343abae33 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd203fff700 1 -- 172.21.15.153:0/3956187128 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800b600 con 0x7fd20c0a8b70 2023-08-17T00:14:43.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd203fff700 1 -- 172.21.15.153:0/3956187128 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800b760 con 0x7fd20c0a8b70 2023-08-17T00:14:43.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd203fff700 1 -- 172.21.15.153:0/3956187128 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800bae0 con 0x7fd20c0a8b70 2023-08-17T00:14:43.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 -- 172.21.15.153:0/3956187128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0a8b70 msgr2=0x7fd20c0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 --2- 172.21.15.153:0/3956187128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0a8b70 0x7fd20c0632e0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 rx=0x7fd208006fd0 tx=0x7fd2080090f0).stop 2023-08-17T00:14:43.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 -- 172.21.15.153:0/3956187128 shutdown_connections 2023-08-17T00:14:43.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 --2- 172.21.15.153:0/3956187128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0629b0 0x7fd20c0bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:43.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 --2- 172.21.15.153:0/3956187128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0a8b70 0x7fd20c0632e0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 -- 172.21.15.153:0/3956187128 >> 172.21.15.153:0/3956187128 conn(0x7fd20c0c7150 msgr2=0x7fd20c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:43.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 -- 172.21.15.153:0/3956187128 shutdown_connections 2023-08-17T00:14:43.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.834+0000 7fd2139a9700 1 -- 172.21.15.153:0/3956187128 wait complete. 2023-08-17T00:14:43.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 Processor -- start 2023-08-17T00:14:43.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 -- start start 2023-08-17T00:14:43.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 0x7fd20c168bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0a8b70 0x7fd20c169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c0a8f50 0x7fd20c16a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c0a9aa0 con 0x7fd20c0629b0 2023-08-17T00:14:43.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c169480 con 0x7fd20c0a8f50 2023-08-17T00:14:43.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd2139a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20c169760 con 0x7fd20c0a8b70 2023-08-17T00:14:43.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd211745700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 0x7fd20c168bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd211745700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 0x7fd20c168bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44044/0 (socket says 172.21.15.153:44044) 2023-08-17T00:14:43.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.838+0000 7fd211745700 1 -- 172.21.15.153:0/439428017 learned_addr learned my addr 172.21.15.153:0/439428017 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:43.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd210f44700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0a8b70 0x7fd20c169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211f46700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c0a8f50 0x7fd20c16a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211745700 1 -- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0a8b70 msgr2=0x7fd20c169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211745700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0a8b70 0x7fd20c169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211745700 1 -- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c0a8f50 msgr2=0x7fd20c16a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:43.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211745700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c0a8f50 0x7fd20c16a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:43.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211745700 1 -- 172.21.15.153:0/439428017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208009370 con 0x7fd20c0629b0 2023-08-17T00:14:43.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211f46700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c0a8f50 0x7fd20c16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:43.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd211745700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 0x7fd20c168bc0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd20c05e420 tx=0x7fd208017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800bae0 con 0x7fd20c0629b0 2023-08-17T00:14:43.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208000c90 con 0x7fd20c0629b0 2023-08-17T00:14:43.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20801b640 con 0x7fd20c0629b0 2023-08-17T00:14:43.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20c169a40 con 0x7fd20c0629b0 2023-08-17T00:14:43.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20c1690b0 con 0x7fd20c0629b0 2023-08-17T00:14:43.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20c06b530 con 0x7fd20c0629b0 2023-08-17T00:14:43.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.842+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd20802b070 con 0x7fd20c0629b0 2023-08-17T00:14:43.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.846+0000 7fd2017fa700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1f005a120 0x7fd1f005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:43.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.846+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2080759e0 con 0x7fd20c0629b0 2023-08-17T00:14:43.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.846+0000 7fd210f44700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1f005a120 0x7fd1f005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:43.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.846+0000 7fd210f44700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1f005a120 0x7fd1f005c5e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fd20c0c6460 tx=0x7fd1fc007bf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:43.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:43.850+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd208049510 con 0x7fd20c0629b0 2023-08-17T00:14:44.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.042+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd20c064910 con 0x7fd20c0629b0 2023-08-17T00:14:44.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.906+0000 7fd2017fa700 1 -- 172.21.15.153:0/439428017 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v121) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd208029070 con 0x7fd20c0629b0 2023-08-17T00:14:44.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1f005a120 msgr2=0x7fd1f005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:44.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1f005a120 0x7fd1f005c5e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7fd20c0c6460 tx=0x7fd1fc007bf0).stop 2023-08-17T00:14:44.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 msgr2=0x7fd20c168bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 0x7fd20c168bc0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 rx=0x7fd20c05e420 tx=0x7fd208017000).stop 2023-08-17T00:14:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 shutdown_connections 2023-08-17T00:14:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd1f005a120 0x7fd1f005c5e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd20c0a8f50 0x7fd20c16a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:44.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd20c0a8b70 0x7fd20c169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:44.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 --2- 172.21.15.153:0/439428017 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd20c0629b0 0x7fd20c168bc0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:44.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 >> 172.21.15.153:0/439428017 conn(0x7fd20c0c7150 msgr2=0x7fd20c0c2410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:44.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 shutdown_connections 2023-08-17T00:14:44.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:44.910+0000 7fd2139a9700 1 -- 172.21.15.153:0/439428017 wait complete. 2023-08-17T00:14:44.938 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:14:44.939 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:14:45.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.098+0000 7f4a89d07700 1 Processor -- start 2023-08-17T00:14:45.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.098+0000 7f4a89d07700 1 -- start start 2023-08-17T00:14:45.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a89d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 0x7f4a84153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a89d07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a840a7600 con 0x7f4a840a8280 2023-08-17T00:14:45.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a89d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a84095110 con 0x7f4a840a5400 2023-08-17T00:14:45.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a89d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84094e70 con 0x7f4a84153910 2023-08-17T00:14:45.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a89506700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4a840a8280 0x7f4a840955a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37848/0 (socket says 172.21.15.153:37848) 2023-08-17T00:14:45.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a89506700 1 -- 172.21.15.153:0/2960843792 learned_addr learned my addr 172.21.15.153:0/2960843792 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:45.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a88d05700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 0x7f4a84153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178994181 0 0) 0x7f4a7c001490 con 0x7f4a840a8280 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.102+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a740033f0 con 0x7f4a840a8280 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2456703819 0 0) 0x7f4a740033f0 con 0x7f4a840a8280 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 msgr2=0x7f4a84153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 0x7f4a84153cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 >> v1:172.21.15.178:6789/0 conn(0x7f4a840a5400 legacy=0x7f4a840a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a840a7840 con 0x7f4a840a8280 2023-08-17T00:14:45.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f4a7c001980 con 0x7f4a840a8280 2023-08-17T00:14:45.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 >> v1:172.21.15.153:6789/0 conn(0x7f4a840a8280 legacy=0x7f4a840955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a74003910 0x7f4a74003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a74004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 0x7f4a74005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a84094e70 con 0x7f4a74004690 2023-08-17T00:14:45.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74014140 con 0x7f4a74003910 2023-08-17T00:14:45.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74014300 con 0x7f4a84153910 2023-08-17T00:14:45.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a74004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a88d05700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a74003910 0x7f4a74003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89506700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 0x7f4a74005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 -- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 msgr2=0x7f4a74005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84153910 0x7f4a74005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 -- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a74003910 msgr2=0x7f4a74003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a74003910 0x7f4a74003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 -- 172.21.15.153:0/2960843792 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740033f0 con 0x7f4a74004690 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a74004b10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f4a840c61e0 tx=0x7f4a70007bb0).ready entity=mon.0 client_cookie=fa3169361b232007 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012400 con 0x7f4a74004690 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70012560 con 0x7f4a74004690 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a837fe700 1 -- 172.21.15.153:0/2960843792 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012920 con 0x7f4a74004690 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89d07700 1 -- 172.21.15.153:0/2960843792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 msgr2=0x7f4a74004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2960843792 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a74004b10 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 rx=0x7f4a840c61e0 tx=0x7f4a70007bb0).stop 2023-08-17T00:14:45.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89506700 1 -- 172.21.15.153:0/2960843792 reap_dead start 2023-08-17T00:14:45.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89d07700 1 -- 172.21.15.153:0/2960843792 shutdown_connections 2023-08-17T00:14:45.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89d07700 1 -- 172.21.15.153:0/2960843792 >> 172.21.15.153:0/2960843792 conn(0x7f4a840c5170 msgr2=0x7f4a840c5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:45.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89d07700 1 -- 172.21.15.153:0/2960843792 shutdown_connections 2023-08-17T00:14:45.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.106+0000 7f4a89d07700 1 -- 172.21.15.153:0/2960843792 wait complete. 2023-08-17T00:14:45.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 Processor -- start 2023-08-17T00:14:45.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 -- start start 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a840acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a84150140 0x7f4a8414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84160720 0x7f4a84160b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840ae300 con 0x7f4a74004690 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840ac760 con 0x7f4a84150140 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a840ad0e0 con 0x7f4a84160720 2023-08-17T00:14:45.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a840acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a840acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55014/0 (socket says 172.21.15.153:55014) 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 -- 172.21.15.153:0/2435432624 learned_addr learned my addr 172.21.15.153:0/2435432624 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a89506700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84160720 0x7f4a84160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a84150140 0x7f4a8414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 -- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84160720 msgr2=0x7f4a84160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84160720 0x7f4a84160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 -- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a84150140 msgr2=0x7f4a8414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a84150140 0x7f4a8414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 -- 172.21.15.153:0/2435432624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8414fe30 con 0x7f4a74004690 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a84150140 0x7f4a8414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.110+0000 7f4a88d05700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a840acbf0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f4a78011a50 tx=0x7f4a78006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800f940 con 0x7f4a74004690 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a7800faa0 con 0x7f4a74004690 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a840ae020 con 0x7f4a74004690 2023-08-17T00:14:45.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7800fe20 con 0x7f4a74004690 2023-08-17T00:14:45.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a840ac3f0 con 0x7f4a74004690 2023-08-17T00:14:45.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8406b4c0 con 0x7f4a74004690 2023-08-17T00:14:45.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.114+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4a78024070 con 0x7f4a74004690 2023-08-17T00:14:45.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.118+0000 7f4a80ff9700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a6805a150 0x7f4a6805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.118+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4a78074bc0 con 0x7f4a74004690 2023-08-17T00:14:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.118+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a6805a150 0x7f4a6805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:45.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.118+0000 7f4a83fff700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a6805a150 0x7f4a6805c610 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f4a840c3a20 tx=0x7f4a70017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:45.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.122+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a78048560 con 0x7f4a74004690 2023-08-17T00:14:45.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.318+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4a840a7b20 con 0x7f4a74004690 2023-08-17T00:14:45.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.914+0000 7f4a80ff9700 1 -- 172.21.15.153:0/2435432624 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v122) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4a78022030 con 0x7f4a74004690 2023-08-17T00:14:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a6805a150 msgr2=0x7f4a6805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a6805a150 0x7f4a6805c610 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f4a840c3a20 tx=0x7f4a70017000).stop 2023-08-17T00:14:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 msgr2=0x7f4a840acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:45.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a840acbf0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 rx=0x7f4a78011a50 tx=0x7f4a78006f40).stop 2023-08-17T00:14:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 shutdown_connections 2023-08-17T00:14:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a6805a150 0x7f4a6805c610 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a84160720 0x7f4a84160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a84150140 0x7f4a8414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 --2- 172.21.15.153:0/2435432624 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a74004690 0x7f4a840acbf0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:45.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 >> 172.21.15.153:0/2435432624 conn(0x7f4a840c5170 msgr2=0x7f4a841529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 shutdown_connections 2023-08-17T00:14:45.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:45.918+0000 7f4a89d07700 1 -- 172.21.15.153:0/2435432624 wait complete. 2023-08-17T00:14:45.946 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:14:45.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:46.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.102+0000 7f3b6fc9b700 1 Processor -- start 2023-08-17T00:14:46.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6fc9b700 1 -- start start 2023-08-17T00:14:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6fc9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b680a8b70 0x7f3b680632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6fc9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b680a8f50 0x7f3b680629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6fc9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b68065240 con 0x7f3b680656d0 2023-08-17T00:14:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6fc9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b68062ea0 con 0x7f3b680a8b70 2023-08-17T00:14:46.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6fc9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b680638a0 con 0x7f3b680a8f50 2023-08-17T00:14:46.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b680a8b70 0x7f3b680632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3b680a8b70 0x7f3b680632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55020/0 (socket says 172.21.15.153:55020) 2023-08-17T00:14:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 -- 172.21.15.153:0/459953591 learned_addr learned my addr 172.21.15.153:0/459953591 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 -- 172.21.15.153:0/459953591 >> v2:172.21.15.178:3300/0 conn(0x7f3b680a8f50 msgr2=0x7f3b680629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 --2- 172.21.15.153:0/459953591 >> v2:172.21.15.178:3300/0 conn(0x7f3b680a8f50 0x7f3b680629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 -- 172.21.15.153:0/459953591 >> v1:172.21.15.178:6789/0 conn(0x7f3b680656d0 legacy=0x7f3b680bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 -- 172.21.15.153:0/459953591 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68064910 con 0x7f3b680a8b70 2023-08-17T00:14:46.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.106+0000 7f3b6da37700 1 --2- 172.21.15.153:0/459953591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680a8b70 0x7f3b680632e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f3b68069d30 tx=0x7f3b640090f0).ready entity=mon.0 client_cookie=c8f329168456118 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6ca35700 1 -- 172.21.15.153:0/459953591 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400b5a0 con 0x7f3b680a8b70 2023-08-17T00:14:46.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6ca35700 1 -- 172.21.15.153:0/459953591 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400b700 con 0x7f3b680a8b70 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6ca35700 1 -- 172.21.15.153:0/459953591 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400ba80 con 0x7f3b680a8b70 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/459953591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680a8b70 msgr2=0x7f3b680632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/459953591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680a8b70 0x7f3b680632e0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 rx=0x7f3b68069d30 tx=0x7f3b640090f0).stop 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/459953591 shutdown_connections 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/459953591 >> v2:172.21.15.178:3300/0 conn(0x7f3b680a8f50 0x7f3b680629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/459953591 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680a8b70 0x7f3b680632e0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/459953591 >> 172.21.15.153:0/459953591 conn(0x7f3b680c7150 msgr2=0x7f3b680c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/459953591 shutdown_connections 2023-08-17T00:14:46.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.110+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/459953591 wait complete. 2023-08-17T00:14:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.114+0000 7f3b6fc9b700 1 Processor -- start 2023-08-17T00:14:46.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.114+0000 7f3b6fc9b700 1 -- start start 2023-08-17T00:14:46.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.114+0000 7f3b6fc9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 0x7f3b68158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.114+0000 7f3b6fc9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b680a8b70 0x7f3b68146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.114+0000 7f3b6fc9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b680a8f50 0x7f3b680c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6fc9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680ab080 con 0x7f3b680656d0 2023-08-17T00:14:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6fc9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680a9c00 con 0x7f3b680a8f50 2023-08-17T00:14:46.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6fc9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b680a9ee0 con 0x7f3b680a8b70 2023-08-17T00:14:46.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 0x7f3b68158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 0x7f3b68158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55028/0 (socket says 172.21.15.153:55028) 2023-08-17T00:14:46.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 -- 172.21.15.153:0/3889322442 learned_addr learned my addr 172.21.15.153:0/3889322442 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:46.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6d236700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b680a8b70 0x7f3b68146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6e238700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b680a8f50 0x7f3b680c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 -- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b680a8b70 msgr2=0x7f3b68146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b680a8b70 0x7f3b68146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 -- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b680a8f50 msgr2=0x7f3b680c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b680a8f50 0x7f3b680c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 -- 172.21.15.153:0/3889322442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b64009370 con 0x7f3b680656d0 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6da37700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 0x7f3b68158c00 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3b64009130 tx=0x7f3b64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64000bc0 con 0x7f3b680656d0 2023-08-17T00:14:46.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400b870 con 0x7f3b680656d0 2023-08-17T00:14:46.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b680aa1c0 con 0x7f3b680656d0 2023-08-17T00:14:46.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64000d20 con 0x7f3b680656d0 2023-08-17T00:14:46.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.118+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b681590f0 con 0x7f3b680656d0 2023-08-17T00:14:46.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.122+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b6806b530 con 0x7f3b680656d0 2023-08-17T00:14:46.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.122+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3b6402b070 con 0x7f3b680656d0 2023-08-17T00:14:46.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.122+0000 7f3b5dffb700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b4c05a150 0x7f3b4c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.122+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3b64075840 con 0x7f3b680656d0 2023-08-17T00:14:46.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.122+0000 7f3b6d236700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b4c05a150 0x7f3b4c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.126+0000 7f3b6d236700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b4c05a150 0x7f3b4c05c610 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f3b681561b0 tx=0x7f3b58006f10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.130+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3b640491e0 con 0x7f3b680656d0 2023-08-17T00:14:46.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.326+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b68064bf0 con 0x7f3b680656d0 2023-08-17T00:14:46.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.326+0000 7f3b5dffb700 1 -- 172.21.15.153:0/3889322442 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f3b64029020 con 0x7f3b680656d0 2023-08-17T00:14:46.331 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:46.331 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:14:42.884494+0000","modified":"2023-08-17T00:14:45.904108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4258690159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4258690159},{"type":"v1","addr":"172.21.15.153:6835","nonce":4258690159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T00:14:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b4c05a150 msgr2=0x7f3b4c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b4c05a150 0x7f3b4c05c610 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f3b681561b0 tx=0x7f3b58006f10).stop 2023-08-17T00:14:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 msgr2=0x7f3b68158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 0x7f3b68158c00 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 rx=0x7f3b64009130 tx=0x7f3b64015000).stop 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 shutdown_connections 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3b4c05a150 0x7f3b4c05c610 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b680a8f50 0x7f3b680c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b680a8b70 0x7f3b68146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 --2- 172.21.15.153:0/3889322442 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3b680656d0 0x7f3b68158c00 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 >> 172.21.15.153:0/3889322442 conn(0x7f3b680c7150 msgr2=0x7f3b681577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:46.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 shutdown_connections 2023-08-17T00:14:46.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.330+0000 7f3b6fc9b700 1 -- 172.21.15.153:0/3889322442 wait complete. 2023-08-17T00:14:46.336 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 122 2023-08-17T00:14:46.355 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:14:46.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 Processor -- start 2023-08-17T00:14:46.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 -- start start 2023-08-17T00:14:46.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b78151b90 0x7f0b78151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78063290 0x7f0b78065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b78061fa0 con 0x7f0b78065b50 2023-08-17T00:14:46.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b780c3fb0 con 0x7f0b78151b90 2023-08-17T00:14:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7cc5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78152460 con 0x7f0b78063290 2023-08-17T00:14:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b75d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78063290 0x7f0b78065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.506+0000 7f0b7659c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b78151b90 0x7f0b78151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b76d9d700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0b78065b50 0x7f0b78064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:44578/0 (socket says 172.21.15.153:44578) 2023-08-17T00:14:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b76d9d700 1 -- 172.21.15.153:0/2606814431 learned_addr learned my addr 172.21.15.153:0/2606814431 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7659c700 1 -- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78063290 msgr2=0x7f0b78065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7659c700 1 --2- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78063290 0x7f0b78065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7659c700 1 -- 172.21.15.153:0/2606814431 >> v1:172.21.15.178:6789/0 conn(0x7f0b78065b50 legacy=0x7f0b78064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7659c700 1 -- 172.21.15.153:0/2606814431 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780621f0 con 0x7f0b78151b90 2023-08-17T00:14:46.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7659c700 1 --2- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78151b90 0x7f0b78151f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f0b68009760 tx=0x7f0b68009060).ready entity=mon.1 client_cookie=e86242ba749079ea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7559a700 1 -- 172.21.15.153:0/2606814431 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680090d0 con 0x7f0b78151b90 2023-08-17T00:14:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7559a700 1 -- 172.21.15.153:0/2606814431 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800f510 con 0x7f0b78151b90 2023-08-17T00:14:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7559a700 1 -- 172.21.15.153:0/2606814431 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800f890 con 0x7f0b78151b90 2023-08-17T00:14:46.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78151b90 msgr2=0x7f0b78151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78151b90 0x7f0b78151f70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7f0b68009760 tx=0x7f0b68009060).stop 2023-08-17T00:14:46.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/2606814431 shutdown_connections 2023-08-17T00:14:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78063290 0x7f0b78065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/2606814431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78151b90 0x7f0b78151f70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/2606814431 >> 172.21.15.153:0/2606814431 conn(0x7f0b780c7150 msgr2=0x7f0b780c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:46.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/2606814431 shutdown_connections 2023-08-17T00:14:46.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.510+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/2606814431 wait complete. 2023-08-17T00:14:46.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 Processor -- start 2023-08-17T00:14:46.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 -- start start 2023-08-17T00:14:46.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78063290 0x7f0b78152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78065b50 0x7f0b780be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 0x7f0b780aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780bf1a0 con 0x7f0b78151b90 2023-08-17T00:14:46.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780be690 con 0x7f0b78063290 2023-08-17T00:14:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b7cc5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78153590 con 0x7f0b78065b50 2023-08-17T00:14:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.514+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 0x7f0b780aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 0x7f0b780aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55036/0 (socket says 172.21.15.153:55036) 2023-08-17T00:14:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 -- 172.21.15.153:0/3279651139 learned_addr learned my addr 172.21.15.153:0/3279651139 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b75d9b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78065b50 0x7f0b780be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b7659c700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78063290 0x7f0b78152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 -- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78065b50 msgr2=0x7f0b780be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78065b50 0x7f0b780be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 -- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78063290 msgr2=0x7f0b78152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78063290 0x7f0b78152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 -- 172.21.15.153:0/3279651139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680092a0 con 0x7f0b78151b90 2023-08-17T00:14:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b75d9b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78065b50 0x7f0b780be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:46.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b76d9d700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 0x7f0b780aaff0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f0b7000c7c0 tx=0x7f0b700015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b70005d30 con 0x7f0b78151b90 2023-08-17T00:14:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b70005e90 con 0x7f0b78151b90 2023-08-17T00:14:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b78153870 con 0x7f0b78151b90 2023-08-17T00:14:46.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b700072e0 con 0x7f0b78151b90 2023-08-17T00:14:46.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b780bee30 con 0x7f0b78151b90 2023-08-17T00:14:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.518+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7806b530 con 0x7f0b78151b90 2023-08-17T00:14:46.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.522+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0b7001a060 con 0x7f0b78151b90 2023-08-17T00:14:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.522+0000 7f0b667fc700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5805a150 0x7f0b5805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.522+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b70073a50 con 0x7f0b78151b90 2023-08-17T00:14:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.522+0000 7f0b7659c700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5805a150 0x7f0b5805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.522+0000 7f0b7659c700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5805a150 0x7f0b5805c610 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f0b68009fd0 tx=0x7f0b68017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.530+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b700473f0 con 0x7f0b78151b90 2023-08-17T00:14:46.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.690+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b780c3ab0 con 0x7f0b78151b90 2023-08-17T00:14:46.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.690+0000 7f0b667fc700 1 -- 172.21.15.153:0/3279651139 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f0b70018030 con 0x7f0b78151b90 2023-08-17T00:14:46.698 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:46.698 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":154,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:43.889439+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:14:40.874126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T00:14:41.882057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:14:46.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5805a150 msgr2=0x7f0b5805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5805a150 0x7f0b5805c610 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f0b68009fd0 tx=0x7f0b68017000).stop 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 msgr2=0x7f0b780aaff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 0x7f0b780aaff0 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 rx=0x7f0b7000c7c0 tx=0x7f0b700015e0).stop 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 shutdown_connections 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0b5805a150 0x7f0b5805c610 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b78151b90 0x7f0b780aaff0 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b78065b50 0x7f0b780be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 --2- 172.21.15.153:0/3279651139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b78063290 0x7f0b78152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 >> 172.21.15.153:0/3279651139 conn(0x7f0b780c7150 msgr2=0x7f0b780c5120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:46.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 shutdown_connections 2023-08-17T00:14:46.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.698+0000 7f0b7cc5b700 1 -- 172.21.15.153:0/3279651139 wait complete. 2023-08-17T00:14:46.721 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:14:46.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:14:46.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.878+0000 7fe627af1700 1 Processor -- start 2023-08-17T00:14:46.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.878+0000 7fe627af1700 1 -- start start 2023-08-17T00:14:46.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe627af1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6200a8b70 0x7fe6200632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe627af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200629b0 0x7fe6200bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe627af1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe620065240 con 0x7fe6200a8f50 2023-08-17T00:14:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe627af1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe620062e60 con 0x7fe6200a8b70 2023-08-17T00:14:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe627af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200638a0 con 0x7fe6200629b0 2023-08-17T00:14:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6200a8b70 0x7fe6200632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe6200a8b70 0x7fe6200632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55038/0 (socket says 172.21.15.153:55038) 2023-08-17T00:14:46.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 -- 172.21.15.153:0/1890393313 learned_addr learned my addr 172.21.15.153:0/1890393313 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:46.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62608e700 1 --2- 172.21.15.153:0/1890393313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200629b0 0x7fe6200bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 -- 172.21.15.153:0/1890393313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200629b0 msgr2=0x7fe6200bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:46.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 --2- 172.21.15.153:0/1890393313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200629b0 0x7fe6200bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 -- 172.21.15.153:0/1890393313 >> v1:172.21.15.178:6789/0 conn(0x7fe6200a8f50 legacy=0x7fe6200656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 -- 172.21.15.153:0/1890393313 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620065de0 con 0x7fe6200a8b70 2023-08-17T00:14:46.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62588d700 1 --2- 172.21.15.153:0/1890393313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe6200632e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fe61c006fd0 tx=0x7fe61c0090f0).ready entity=mon.0 client_cookie=7598563a722a9d47 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62488b700 1 -- 172.21.15.153:0/1890393313 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c00b580 con 0x7fe6200a8b70 2023-08-17T00:14:46.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62488b700 1 -- 172.21.15.153:0/1890393313 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c00b6e0 con 0x7fe6200a8b70 2023-08-17T00:14:46.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.882+0000 7fe62488b700 1 -- 172.21.15.153:0/1890393313 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c00ba60 con 0x7fe6200a8b70 2023-08-17T00:14:46.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 -- 172.21.15.153:0/1890393313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 msgr2=0x7fe6200632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 --2- 172.21.15.153:0/1890393313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe6200632e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 rx=0x7fe61c006fd0 tx=0x7fe61c0090f0).stop 2023-08-17T00:14:46.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 -- 172.21.15.153:0/1890393313 shutdown_connections 2023-08-17T00:14:46.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 --2- 172.21.15.153:0/1890393313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200629b0 0x7fe6200bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 --2- 172.21.15.153:0/1890393313 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe6200632e0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 -- 172.21.15.153:0/1890393313 >> 172.21.15.153:0/1890393313 conn(0x7fe6200c7150 msgr2=0x7fe6200c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:46.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 -- 172.21.15.153:0/1890393313 shutdown_connections 2023-08-17T00:14:46.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.886+0000 7fe627af1700 1 -- 172.21.15.153:0/1890393313 wait complete. 2023-08-17T00:14:46.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 Processor -- start 2023-08-17T00:14:46.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 -- start start 2023-08-17T00:14:46.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6200629b0 0x7fe620146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe62015be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200a8f50 0x7fe62015c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62015c830 con 0x7fe6200a8b70 2023-08-17T00:14:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe620168730 con 0x7fe6200629b0 2023-08-17T00:14:46.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe627af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe620168970 con 0x7fe6200a8f50 2023-08-17T00:14:46.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe62508c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe62015be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe62508c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe62015be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55048/0 (socket says 172.21.15.153:55048) 2023-08-17T00:14:46.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe62508c700 1 -- 172.21.15.153:0/22809429 learned_addr learned my addr 172.21.15.153:0/22809429 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:46.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe62588d700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6200629b0 0x7fe620146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.890+0000 7fe62608e700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200a8f50 0x7fe62015c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62588d700 1 -- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200a8f50 msgr2=0x7fe62015c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62588d700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200a8f50 0x7fe62015c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62588d700 1 -- 172.21.15.153:0/22809429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 msgr2=0x7fe62015be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62588d700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe62015be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62588d700 1 -- 172.21.15.153:0/22809429 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c009370 con 0x7fe6200629b0 2023-08-17T00:14:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62508c700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe62015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe62588d700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6200629b0 0x7fe620146a10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fe61c014000 tx=0x7fe61c017000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c006d90 con 0x7fe6200629b0 2023-08-17T00:14:46.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c000bc0 con 0x7fe6200629b0 2023-08-17T00:14:46.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe620168c50 con 0x7fe6200629b0 2023-08-17T00:14:46.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c01c420 con 0x7fe6200629b0 2023-08-17T00:14:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe620169210 con 0x7fe6200629b0 2023-08-17T00:14:46.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.894+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62006b530 con 0x7fe6200629b0 2023-08-17T00:14:46.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.898+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe61c02c070 con 0x7fe6200629b0 2023-08-17T00:14:46.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.898+0000 7fe615ffb700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60405a150 0x7fe60405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:46.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.898+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe61c075bd0 con 0x7fe6200629b0 2023-08-17T00:14:46.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.898+0000 7fe62508c700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60405a150 0x7fe60405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:46.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.902+0000 7fe62508c700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60405a150 0x7fe60405c610 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fe6200c0c50 tx=0x7fe610009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:46.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:46.906+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe61c049570 con 0x7fe6200629b0 2023-08-17T00:14:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.070+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe6200c3ab0 con 0x7fe60405a150 2023-08-17T00:14:47.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.090+0000 7fe615ffb700 1 -- 172.21.15.153:0/22809429 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359617 (secure 0 0 0) 0x7fe6200c3ab0 con 0x7fe60405a150 2023-08-17T00:14:47.104 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:47.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60405a150 msgr2=0x7fe60405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60405a150 0x7fe60405c610 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7fe6200c0c50 tx=0x7fe610009040).stop 2023-08-17T00:14:47.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6200629b0 msgr2=0x7fe620146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6200629b0 0x7fe620146a10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fe61c014000 tx=0x7fe61c017000).stop 2023-08-17T00:14:47.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 shutdown_connections 2023-08-17T00:14:47.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe60405a150 0x7fe60405c610 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6200a8f50 0x7fe62015c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe6200a8b70 0x7fe62015be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 --2- 172.21.15.153:0/22809429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6200629b0 0x7fe620146a10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 >> 172.21.15.153:0/22809429 conn(0x7fe6200c7150 msgr2=0x7fe6200622a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:47.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 shutdown_connections 2023-08-17T00:14:47.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.098+0000 7fe627af1700 1 -- 172.21.15.153:0/22809429 wait complete. 2023-08-17T00:14:47.111 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:14:47.122 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2023-08-17T00:14:45.446342+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2474688,"kb_used_data":14976,"kb_used_omap":0,"kb_used_meta":2459648,"kb_avail":752500032,"statfs":{"total":773094113280,"available":770560032768,"internally_reserved":0,"allocated":15335424,"data_stored":7181724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2518679552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078616967,"num_objects":-1063,"num_object_clones":0,"num_object_copies":-2126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1063,"num_whiteouts":0,"num_read":-51,"num_read_kb":-2216,"num_write":-6355,"num_write_kb":-1055504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-40,"num_bytes_recovered":-41943040,"num_keys_recovered":0,"num_objects_omap":-35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657717"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918923+0000","last_change":"2023-08-17T00:14:42.918923+0000","last_active":"2023-08-17T00:14:42.918923+0000","last_peered":"2023-08-17T00:14:42.918923+0000","last_clean":"2023-08-17T00:14:42.918923+0000","last_became_active":"2023-08-17T00:14:42.918651+0000","last_became_peered":"2023-08-17T00:14:42.918651+0000","last_unstale":"2023-08-17T00:14:42.918923+0000","last_undegraded":"2023-08-17T00:14:42.918923+0000","last_fullsized":"2023-08-17T00:14:42.918923+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3f","version":"153'3","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915744+0000","last_change":"2023-08-17T00:14:42.465523+0000","last_active":"2023-08-17T00:14:42.915744+0000","last_peered":"2023-08-17T00:14:42.915744+0000","last_clean":"2023-08-17T00:14:42.915744+0000","last_became_active":"2023-08-17T00:14:42.465198+0000","last_became_peered":"2023-08-17T00:14:42.465198+0000","last_unstale":"2023-08-17T00:14:42.915744+0000","last_undegraded":"2023-08-17T00:14:42.915744+0000","last_fullsized":"2023-08-17T00:14:42.915744+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918863+0000","last_change":"2023-08-17T00:14:42.918863+0000","last_active":"2023-08-17T00:14:42.918863+0000","last_peered":"2023-08-17T00:14:42.918863+0000","last_clean":"2023-08-17T00:14:42.918863+0000","last_became_active":"2023-08-17T00:14:42.918353+0000","last_became_peered":"2023-08-17T00:14:42.918353+0000","last_unstale":"2023-08-17T00:14:42.918863+0000","last_undegraded":"2023-08-17T00:14:42.918863+0000","last_fullsized":"2023-08-17T00:14:42.918863+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.899014+0000","last_change":"2023-08-17T00:14:42.469099+0000","last_active":"2023-08-17T00:14:42.899014+0000","last_peered":"2023-08-17T00:14:42.899014+0000","last_clean":"2023-08-17T00:14:42.899014+0000","last_became_active":"2023-08-17T00:14:42.468809+0000","last_became_peered":"2023-08-17T00:14:42.468809+0000","last_unstale":"2023-08-17T00:14:42.899014+0000","last_undegraded":"2023-08-17T00:14:42.899014+0000","last_fullsized":"2023-08-17T00:14:42.899014+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918912+0000","last_change":"2023-08-17T00:14:42.914040+0000","last_active":"2023-08-17T00:14:42.918912+0000","last_peered":"2023-08-17T00:14:42.918912+0000","last_clean":"2023-08-17T00:14:42.918912+0000","last_became_active":"2023-08-17T00:14:42.913445+0000","last_became_peered":"2023-08-17T00:14:42.913445+0000","last_unstale":"2023-08-17T00:14:42.918912+0000","last_undegraded":"2023-08-17T00:14:42.918912+0000","last_fullsized":"2023-08-17T00:14:42.918912+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.473643+0000","last_change":"2023-08-17T00:14:42.470537+0000","last_active":"2023-08-17T00:14:42.473643+0000","last_peered":"2023-08-17T00:14:42.473643+0000","last_clean":"2023-08-17T00:14:42.473643+0000","last_became_active":"2023-08-17T00:14:42.470123+0000","last_became_peered":"2023-08-17T00:14:42.470123+0000","last_unstale":"2023-08-17T00:14:42.473643+0000","last_undegraded":"2023-08-17T00:14:42.473643+0000","last_fullsized":"2023-08-17T00:14:42.473643+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914511+0000","last_change":"2023-08-17T00:14:42.914511+0000","last_active":"2023-08-17T00:14:42.914511+0000","last_peered":"2023-08-17T00:14:42.914511+0000","last_clean":"2023-08-17T00:14:42.914511+0000","last_became_active":"2023-08-17T00:14:42.914251+0000","last_became_peered":"2023-08-17T00:14:42.914251+0000","last_unstale":"2023-08-17T00:14:42.914511+0000","last_undegraded":"2023-08-17T00:14:42.914511+0000","last_fullsized":"2023-08-17T00:14:42.914511+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.932487+0000","last_change":"2023-08-17T00:14:42.474785+0000","last_active":"2023-08-17T00:14:42.932487+0000","last_peered":"2023-08-17T00:14:42.932487+0000","last_clean":"2023-08-17T00:14:42.932487+0000","last_became_active":"2023-08-17T00:14:42.474493+0000","last_became_peered":"2023-08-17T00:14:42.474493+0000","last_unstale":"2023-08-17T00:14:42.932487+0000","last_undegraded":"2023-08-17T00:14:42.932487+0000","last_fullsized":"2023-08-17T00:14:42.932487+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.910943+0000","last_change":"2023-08-17T00:14:42.910943+0000","last_active":"2023-08-17T00:14:42.910943+0000","last_peered":"2023-08-17T00:14:42.910943+0000","last_clean":"2023-08-17T00:14:42.910943+0000","last_became_active":"2023-08-17T00:14:42.910662+0000","last_became_peered":"2023-08-17T00:14:42.910662+0000","last_unstale":"2023-08-17T00:14:42.910943+0000","last_undegraded":"2023-08-17T00:14:42.910943+0000","last_fullsized":"2023-08-17T00:14:42.910943+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3b","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903739+0000","last_change":"2023-08-17T00:14:42.479642+0000","last_active":"2023-08-17T00:14:42.903739+0000","last_peered":"2023-08-17T00:14:42.903739+0000","last_clean":"2023-08-17T00:14:42.903739+0000","last_became_active":"2023-08-17T00:14:42.479379+0000","last_became_peered":"2023-08-17T00:14:42.479379+0000","last_unstale":"2023-08-17T00:14:42.903739+0000","last_undegraded":"2023-08-17T00:14:42.903739+0000","last_fullsized":"2023-08-17T00:14:42.903739+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.902649+0000","last_change":"2023-08-17T00:14:42.902649+0000","last_active":"2023-08-17T00:14:42.902649+0000","last_peered":"2023-08-17T00:14:42.902649+0000","last_clean":"2023-08-17T00:14:42.902649+0000","last_became_active":"2023-08-17T00:14:42.902396+0000","last_became_peered":"2023-08-17T00:14:42.902396+0000","last_unstale":"2023-08-17T00:14:42.902649+0000","last_undegraded":"2023-08-17T00:14:42.902649+0000","last_fullsized":"2023-08-17T00:14:42.902649+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3a","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903701+0000","last_change":"2023-08-17T00:14:42.473956+0000","last_active":"2023-08-17T00:14:42.903701+0000","last_peered":"2023-08-17T00:14:42.903701+0000","last_clean":"2023-08-17T00:14:42.903701+0000","last_became_active":"2023-08-17T00:14:42.473638+0000","last_became_peered":"2023-08-17T00:14:42.473638+0000","last_unstale":"2023-08-17T00:14:42.903701+0000","last_undegraded":"2023-08-17T00:14:42.903701+0000","last_fullsized":"2023-08-17T00:14:42.903701+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914692+0000","last_change":"2023-08-17T00:14:42.914692+0000","last_active":"2023-08-17T00:14:42.914692+0000","last_peered":"2023-08-17T00:14:42.914692+0000","last_clean":"2023-08-17T00:14:42.914692+0000","last_became_active":"2023-08-17T00:14:42.914370+0000","last_became_peered":"2023-08-17T00:14:42.914370+0000","last_unstale":"2023-08-17T00:14:42.914692+0000","last_undegraded":"2023-08-17T00:14:42.914692+0000","last_fullsized":"2023-08-17T00:14:42.914692+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.907756+0000","last_change":"2023-08-17T00:14:42.466640+0000","last_active":"2023-08-17T00:14:42.907756+0000","last_peered":"2023-08-17T00:14:42.907756+0000","last_clean":"2023-08-17T00:14:42.907756+0000","last_became_active":"2023-08-17T00:14:42.466356+0000","last_became_peered":"2023-08-17T00:14:42.466356+0000","last_unstale":"2023-08-17T00:14:42.907756+0000","last_undegraded":"2023-08-17T00:14:42.907756+0000","last_fullsized":"2023-08-17T00:14:42.907756+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916251+0000","last_change":"2023-08-17T00:14:42.907452+0000","last_active":"2023-08-17T00:14:42.916251+0000","last_peered":"2023-08-17T00:14:42.916251+0000","last_clean":"2023-08-17T00:14:42.916251+0000","last_became_active":"2023-08-17T00:14:42.907137+0000","last_became_peered":"2023-08-17T00:14:42.907137+0000","last_unstale":"2023-08-17T00:14:42.916251+0000","last_undegraded":"2023-08-17T00:14:42.916251+0000","last_fullsized":"2023-08-17T00:14:42.916251+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.470087+0000","last_change":"2023-08-17T00:14:42.463708+0000","last_active":"2023-08-17T00:14:42.470087+0000","last_peered":"2023-08-17T00:14:42.470087+0000","last_clean":"2023-08-17T00:14:42.470087+0000","last_became_active":"2023-08-17T00:14:42.463429+0000","last_became_peered":"2023-08-17T00:14:42.463429+0000","last_unstale":"2023-08-17T00:14:42.470087+0000","last_undegraded":"2023-08-17T00:14:42.470087+0000","last_fullsized":"2023-08-17T00:14:42.470087+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.919392+0000","last_change":"2023-08-17T00:14:42.913743+0000","last_active":"2023-08-17T00:14:42.919392+0000","last_peered":"2023-08-17T00:14:42.919392+0000","last_clean":"2023-08-17T00:14:42.919392+0000","last_became_active":"2023-08-17T00:14:42.911926+0000","last_became_peered":"2023-08-17T00:14:42.911926+0000","last_unstale":"2023-08-17T00:14:42.919392+0000","last_undegraded":"2023-08-17T00:14:42.919392+0000","last_fullsized":"2023-08-17T00:14:42.919392+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.471932+0000","last_change":"2023-08-17T00:14:42.469274+0000","last_active":"2023-08-17T00:14:42.471932+0000","last_peered":"2023-08-17T00:14:42.471932+0000","last_clean":"2023-08-17T00:14:42.471932+0000","last_became_active":"2023-08-17T00:14:42.469014+0000","last_became_peered":"2023-08-17T00:14:42.469014+0000","last_unstale":"2023-08-17T00:14:42.471932+0000","last_undegraded":"2023-08-17T00:14:42.471932+0000","last_fullsized":"2023-08-17T00:14:42.471932+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925065+0000","last_change":"2023-08-17T00:14:42.922855+0000","last_active":"2023-08-17T00:14:42.925065+0000","last_peered":"2023-08-17T00:14:42.925065+0000","last_clean":"2023-08-17T00:14:42.925065+0000","last_became_active":"2023-08-17T00:14:42.922560+0000","last_became_peered":"2023-08-17T00:14:42.922560+0000","last_unstale":"2023-08-17T00:14:42.925065+0000","last_undegraded":"2023-08-17T00:14:42.925065+0000","last_fullsized":"2023-08-17T00:14:42.925065+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.480910+0000","last_change":"2023-08-17T00:14:42.476679+0000","last_active":"2023-08-17T00:14:42.480910+0000","last_peered":"2023-08-17T00:14:42.480910+0000","last_clean":"2023-08-17T00:14:42.480910+0000","last_became_active":"2023-08-17T00:14:42.476412+0000","last_became_peered":"2023-08-17T00:14:42.476412+0000","last_unstale":"2023-08-17T00:14:42.480910+0000","last_undegraded":"2023-08-17T00:14:42.480910+0000","last_fullsized":"2023-08-17T00:14:42.480910+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.921132+0000","last_change":"2023-08-17T00:14:42.921132+0000","last_active":"2023-08-17T00:14:42.921132+0000","last_peered":"2023-08-17T00:14:42.921132+0000","last_clean":"2023-08-17T00:14:42.921132+0000","last_became_active":"2023-08-17T00:14:42.920827+0000","last_became_peered":"2023-08-17T00:14:42.920827+0000","last_unstale":"2023-08-17T00:14:42.921132+0000","last_undegraded":"2023-08-17T00:14:42.921132+0000","last_fullsized":"2023-08-17T00:14:42.921132+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.472083+0000","last_change":"2023-08-17T00:14:42.468036+0000","last_active":"2023-08-17T00:14:42.472083+0000","last_peered":"2023-08-17T00:14:42.472083+0000","last_clean":"2023-08-17T00:14:42.472083+0000","last_became_active":"2023-08-17T00:14:42.466542+0000","last_became_peered":"2023-08-17T00:14:42.466542+0000","last_unstale":"2023-08-17T00:14:42.472083+0000","last_undegraded":"2023-08-17T00:14:42.472083+0000","last_fullsized":"2023-08-17T00:14:42.472083+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918880+0000","last_change":"2023-08-17T00:14:42.913196+0000","last_active":"2023-08-17T00:14:42.918880+0000","last_peered":"2023-08-17T00:14:42.918880+0000","last_clean":"2023-08-17T00:14:42.918880+0000","last_became_active":"2023-08-17T00:14:42.912734+0000","last_became_peered":"2023-08-17T00:14:42.912734+0000","last_unstale":"2023-08-17T00:14:42.918880+0000","last_undegraded":"2023-08-17T00:14:42.918880+0000","last_fullsized":"2023-08-17T00:14:42.918880+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.34","version":"153'4","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.933154+0000","last_change":"2023-08-17T00:14:42.468435+0000","last_active":"2023-08-17T00:14:42.933154+0000","last_peered":"2023-08-17T00:14:42.933154+0000","last_clean":"2023-08-17T00:14:42.933154+0000","last_became_active":"2023-08-17T00:14:42.468149+0000","last_became_peered":"2023-08-17T00:14:42.468149+0000","last_unstale":"2023-08-17T00:14:42.933154+0000","last_undegraded":"2023-08-17T00:14:42.933154+0000","last_fullsized":"2023-08-17T00:14:42.933154+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924089+0000","last_change":"2023-08-17T00:14:42.916528+0000","last_active":"2023-08-17T00:14:42.924089+0000","last_peered":"2023-08-17T00:14:42.924089+0000","last_clean":"2023-08-17T00:14:42.924089+0000","last_became_active":"2023-08-17T00:14:42.916228+0000","last_became_peered":"2023-08-17T00:14:42.916228+0000","last_unstale":"2023-08-17T00:14:42.924089+0000","last_undegraded":"2023-08-17T00:14:42.924089+0000","last_fullsized":"2023-08-17T00:14:42.924089+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.33","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903831+0000","last_change":"2023-08-17T00:14:42.467499+0000","last_active":"2023-08-17T00:14:42.903831+0000","last_peered":"2023-08-17T00:14:42.903831+0000","last_clean":"2023-08-17T00:14:42.903831+0000","last_became_active":"2023-08-17T00:14:42.467095+0000","last_became_peered":"2023-08-17T00:14:42.467095+0000","last_unstale":"2023-08-17T00:14:42.903831+0000","last_undegraded":"2023-08-17T00:14:42.903831+0000","last_fullsized":"2023-08-17T00:14:42.903831+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927934+0000","last_change":"2023-08-17T00:14:42.925931+0000","last_active":"2023-08-17T00:14:42.927934+0000","last_peered":"2023-08-17T00:14:42.927934+0000","last_clean":"2023-08-17T00:14:42.927934+0000","last_became_active":"2023-08-17T00:14:42.925378+0000","last_became_peered":"2023-08-17T00:14:42.925378+0000","last_unstale":"2023-08-17T00:14:42.927934+0000","last_undegraded":"2023-08-17T00:14:42.927934+0000","last_fullsized":"2023-08-17T00:14:42.927934+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896712+0000","last_change":"2023-08-17T00:14:42.473724+0000","last_active":"2023-08-17T00:14:42.896712+0000","last_peered":"2023-08-17T00:14:42.896712+0000","last_clean":"2023-08-17T00:14:42.896712+0000","last_became_active":"2023-08-17T00:14:42.470704+0000","last_became_peered":"2023-08-17T00:14:42.470704+0000","last_unstale":"2023-08-17T00:14:42.896712+0000","last_undegraded":"2023-08-17T00:14:42.896712+0000","last_fullsized":"2023-08-17T00:14:42.896712+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925141+0000","last_change":"2023-08-17T00:14:42.925141+0000","last_active":"2023-08-17T00:14:42.925141+0000","last_peered":"2023-08-17T00:14:42.925141+0000","last_clean":"2023-08-17T00:14:42.925141+0000","last_became_active":"2023-08-17T00:14:42.924855+0000","last_became_peered":"2023-08-17T00:14:42.924855+0000","last_unstale":"2023-08-17T00:14:42.925141+0000","last_undegraded":"2023-08-17T00:14:42.925141+0000","last_fullsized":"2023-08-17T00:14:42.925141+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.463669+0000","last_change":"2023-08-17T00:14:42.458061+0000","last_active":"2023-08-17T00:14:42.463669+0000","last_peered":"2023-08-17T00:14:42.463669+0000","last_clean":"2023-08-17T00:14:42.463669+0000","last_became_active":"2023-08-17T00:14:42.457761+0000","last_became_peered":"2023-08-17T00:14:42.457761+0000","last_unstale":"2023-08-17T00:14:42.463669+0000","last_undegraded":"2023-08-17T00:14:42.463669+0000","last_fullsized":"2023-08-17T00:14:42.463669+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915906+0000","last_change":"2023-08-17T00:14:42.902016+0000","last_active":"2023-08-17T00:14:42.915906+0000","last_peered":"2023-08-17T00:14:42.915906+0000","last_clean":"2023-08-17T00:14:42.915906+0000","last_became_active":"2023-08-17T00:14:42.901676+0000","last_became_peered":"2023-08-17T00:14:42.901676+0000","last_unstale":"2023-08-17T00:14:42.915906+0000","last_undegraded":"2023-08-17T00:14:42.915906+0000","last_fullsized":"2023-08-17T00:14:42.915906+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"153'4","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924360+0000","last_change":"2023-08-17T00:14:42.461934+0000","last_active":"2023-08-17T00:14:42.924360+0000","last_peered":"2023-08-17T00:14:42.924360+0000","last_clean":"2023-08-17T00:14:42.924360+0000","last_became_active":"2023-08-17T00:14:42.461485+0000","last_became_peered":"2023-08-17T00:14:42.461485+0000","last_unstale":"2023-08-17T00:14:42.924360+0000","last_undegraded":"2023-08-17T00:14:42.924360+0000","last_fullsized":"2023-08-17T00:14:42.924360+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926769+0000","last_change":"2023-08-17T00:14:42.923583+0000","last_active":"2023-08-17T00:14:42.926769+0000","last_peered":"2023-08-17T00:14:42.926769+0000","last_clean":"2023-08-17T00:14:42.926769+0000","last_became_active":"2023-08-17T00:14:42.922371+0000","last_became_peered":"2023-08-17T00:14:42.922371+0000","last_unstale":"2023-08-17T00:14:42.926769+0000","last_undegraded":"2023-08-17T00:14:42.926769+0000","last_fullsized":"2023-08-17T00:14:42.926769+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483362+0000","last_change":"2023-08-17T00:14:42.479157+0000","last_active":"2023-08-17T00:14:42.483362+0000","last_peered":"2023-08-17T00:14:42.483362+0000","last_clean":"2023-08-17T00:14:42.483362+0000","last_became_active":"2023-08-17T00:14:42.478501+0000","last_became_peered":"2023-08-17T00:14:42.478501+0000","last_unstale":"2023-08-17T00:14:42.483362+0000","last_undegraded":"2023-08-17T00:14:42.483362+0000","last_fullsized":"2023-08-17T00:14:42.483362+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917439+0000","last_change":"2023-08-17T00:14:42.917439+0000","last_active":"2023-08-17T00:14:42.917439+0000","last_peered":"2023-08-17T00:14:42.917439+0000","last_clean":"2023-08-17T00:14:42.917439+0000","last_became_active":"2023-08-17T00:14:42.917131+0000","last_became_peered":"2023-08-17T00:14:42.917131+0000","last_unstale":"2023-08-17T00:14:42.917439+0000","last_undegraded":"2023-08-17T00:14:42.917439+0000","last_fullsized":"2023-08-17T00:14:42.917439+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.475439+0000","last_change":"2023-08-17T00:14:42.467845+0000","last_active":"2023-08-17T00:14:42.475439+0000","last_peered":"2023-08-17T00:14:42.475439+0000","last_clean":"2023-08-17T00:14:42.475439+0000","last_became_active":"2023-08-17T00:14:42.466851+0000","last_became_peered":"2023-08-17T00:14:42.466851+0000","last_unstale":"2023-08-17T00:14:42.475439+0000","last_undegraded":"2023-08-17T00:14:42.475439+0000","last_fullsized":"2023-08-17T00:14:42.475439+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918930+0000","last_change":"2023-08-17T00:14:42.914227+0000","last_active":"2023-08-17T00:14:42.918930+0000","last_peered":"2023-08-17T00:14:42.918930+0000","last_clean":"2023-08-17T00:14:42.918930+0000","last_became_active":"2023-08-17T00:14:42.913730+0000","last_became_peered":"2023-08-17T00:14:42.913730+0000","last_unstale":"2023-08-17T00:14:42.918930+0000","last_undegraded":"2023-08-17T00:14:42.918930+0000","last_fullsized":"2023-08-17T00:14:42.918930+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.895533+0000","last_change":"2023-08-17T00:14:42.467713+0000","last_active":"2023-08-17T00:14:42.895533+0000","last_peered":"2023-08-17T00:14:42.895533+0000","last_clean":"2023-08-17T00:14:42.895533+0000","last_became_active":"2023-08-17T00:14:42.467391+0000","last_became_peered":"2023-08-17T00:14:42.467391+0000","last_unstale":"2023-08-17T00:14:42.895533+0000","last_undegraded":"2023-08-17T00:14:42.895533+0000","last_fullsized":"2023-08-17T00:14:42.895533+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.928919+0000","last_change":"2023-08-17T00:14:42.919996+0000","last_active":"2023-08-17T00:14:42.928919+0000","last_peered":"2023-08-17T00:14:42.928919+0000","last_clean":"2023-08-17T00:14:42.928919+0000","last_became_active":"2023-08-17T00:14:42.919730+0000","last_became_peered":"2023-08-17T00:14:42.919730+0000","last_unstale":"2023-08-17T00:14:42.928919+0000","last_undegraded":"2023-08-17T00:14:42.928919+0000","last_fullsized":"2023-08-17T00:14:42.928919+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.474827+0000","last_change":"2023-08-17T00:14:42.472036+0000","last_active":"2023-08-17T00:14:42.474827+0000","last_peered":"2023-08-17T00:14:42.474827+0000","last_clean":"2023-08-17T00:14:42.474827+0000","last_became_active":"2023-08-17T00:14:42.471736+0000","last_became_peered":"2023-08-17T00:14:42.471736+0000","last_unstale":"2023-08-17T00:14:42.474827+0000","last_undegraded":"2023-08-17T00:14:42.474827+0000","last_fullsized":"2023-08-17T00:14:42.474827+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917440+0000","last_change":"2023-08-17T00:14:42.917440+0000","last_active":"2023-08-17T00:14:42.917440+0000","last_peered":"2023-08-17T00:14:42.917440+0000","last_clean":"2023-08-17T00:14:42.917440+0000","last_became_active":"2023-08-17T00:14:42.917104+0000","last_became_peered":"2023-08-17T00:14:42.917104+0000","last_unstale":"2023-08-17T00:14:42.917440+0000","last_undegraded":"2023-08-17T00:14:42.917440+0000","last_fullsized":"2023-08-17T00:14:42.917440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2b","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.893909+0000","last_change":"2023-08-17T00:14:42.478832+0000","last_active":"2023-08-17T00:14:42.893909+0000","last_peered":"2023-08-17T00:14:42.893909+0000","last_clean":"2023-08-17T00:14:42.893909+0000","last_became_active":"2023-08-17T00:14:42.478497+0000","last_became_peered":"2023-08-17T00:14:42.478497+0000","last_unstale":"2023-08-17T00:14:42.893909+0000","last_undegraded":"2023-08-17T00:14:42.893909+0000","last_fullsized":"2023-08-17T00:14:42.893909+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914816+0000","last_change":"2023-08-17T00:14:42.914816+0000","last_active":"2023-08-17T00:14:42.914816+0000","last_peered":"2023-08-17T00:14:42.914816+0000","last_clean":"2023-08-17T00:14:42.914816+0000","last_became_active":"2023-08-17T00:14:42.914543+0000","last_became_peered":"2023-08-17T00:14:42.914543+0000","last_unstale":"2023-08-17T00:14:42.914816+0000","last_undegraded":"2023-08-17T00:14:42.914816+0000","last_fullsized":"2023-08-17T00:14:42.914816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896856+0000","last_change":"2023-08-17T00:14:42.459504+0000","last_active":"2023-08-17T00:14:42.896856+0000","last_peered":"2023-08-17T00:14:42.896856+0000","last_clean":"2023-08-17T00:14:42.896856+0000","last_became_active":"2023-08-17T00:14:42.459198+0000","last_became_peered":"2023-08-17T00:14:42.459198+0000","last_unstale":"2023-08-17T00:14:42.896856+0000","last_undegraded":"2023-08-17T00:14:42.896856+0000","last_fullsized":"2023-08-17T00:14:42.896856+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.923475+0000","last_change":"2023-08-17T00:14:42.923475+0000","last_active":"2023-08-17T00:14:42.923475+0000","last_peered":"2023-08-17T00:14:42.923475+0000","last_clean":"2023-08-17T00:14:42.923475+0000","last_became_active":"2023-08-17T00:14:42.923174+0000","last_became_peered":"2023-08-17T00:14:42.923174+0000","last_unstale":"2023-08-17T00:14:42.923475+0000","last_undegraded":"2023-08-17T00:14:42.923475+0000","last_fullsized":"2023-08-17T00:14:42.923475+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483572+0000","last_change":"2023-08-17T00:14:42.469822+0000","last_active":"2023-08-17T00:14:42.483572+0000","last_peered":"2023-08-17T00:14:42.483572+0000","last_clean":"2023-08-17T00:14:42.483572+0000","last_became_active":"2023-08-17T00:14:42.469233+0000","last_became_peered":"2023-08-17T00:14:42.469233+0000","last_unstale":"2023-08-17T00:14:42.483572+0000","last_undegraded":"2023-08-17T00:14:42.483572+0000","last_fullsized":"2023-08-17T00:14:42.483572+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927962+0000","last_change":"2023-08-17T00:14:42.926222+0000","last_active":"2023-08-17T00:14:42.927962+0000","last_peered":"2023-08-17T00:14:42.927962+0000","last_clean":"2023-08-17T00:14:42.927962+0000","last_became_active":"2023-08-17T00:14:42.924781+0000","last_became_peered":"2023-08-17T00:14:42.924781+0000","last_unstale":"2023-08-17T00:14:42.927962+0000","last_undegraded":"2023-08-17T00:14:42.927962+0000","last_fullsized":"2023-08-17T00:14:42.927962+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.475463+0000","last_change":"2023-08-17T00:14:42.469077+0000","last_active":"2023-08-17T00:14:42.475463+0000","last_peered":"2023-08-17T00:14:42.475463+0000","last_clean":"2023-08-17T00:14:42.475463+0000","last_became_active":"2023-08-17T00:14:42.468774+0000","last_became_peered":"2023-08-17T00:14:42.468774+0000","last_unstale":"2023-08-17T00:14:42.475463+0000","last_undegraded":"2023-08-17T00:14:42.475463+0000","last_fullsized":"2023-08-17T00:14:42.475463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926486+0000","last_change":"2023-08-17T00:14:42.925111+0000","last_active":"2023-08-17T00:14:42.926486+0000","last_peered":"2023-08-17T00:14:42.926486+0000","last_clean":"2023-08-17T00:14:42.926486+0000","last_became_active":"2023-08-17T00:14:42.924700+0000","last_became_peered":"2023-08-17T00:14:42.924700+0000","last_unstale":"2023-08-17T00:14:42.926486+0000","last_undegraded":"2023-08-17T00:14:42.926486+0000","last_fullsized":"2023-08-17T00:14:42.926486+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.899077+0000","last_change":"2023-08-17T00:14:42.474230+0000","last_active":"2023-08-17T00:14:42.899077+0000","last_peered":"2023-08-17T00:14:42.899077+0000","last_clean":"2023-08-17T00:14:42.899077+0000","last_became_active":"2023-08-17T00:14:42.473900+0000","last_became_peered":"2023-08-17T00:14:42.473900+0000","last_unstale":"2023-08-17T00:14:42.899077+0000","last_undegraded":"2023-08-17T00:14:42.899077+0000","last_fullsized":"2023-08-17T00:14:42.899077+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920807+0000","last_change":"2023-08-17T00:14:42.920807+0000","last_active":"2023-08-17T00:14:42.920807+0000","last_peered":"2023-08-17T00:14:42.920807+0000","last_clean":"2023-08-17T00:14:42.920807+0000","last_became_active":"2023-08-17T00:14:42.920497+0000","last_became_peered":"2023-08-17T00:14:42.920497+0000","last_unstale":"2023-08-17T00:14:42.920807+0000","last_undegraded":"2023-08-17T00:14:42.920807+0000","last_fullsized":"2023-08-17T00:14:42.920807+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.474744+0000","last_change":"2023-08-17T00:14:42.471608+0000","last_active":"2023-08-17T00:14:42.474744+0000","last_peered":"2023-08-17T00:14:42.474744+0000","last_clean":"2023-08-17T00:14:42.474744+0000","last_became_active":"2023-08-17T00:14:42.471088+0000","last_became_peered":"2023-08-17T00:14:42.471088+0000","last_unstale":"2023-08-17T00:14:42.474744+0000","last_undegraded":"2023-08-17T00:14:42.474744+0000","last_fullsized":"2023-08-17T00:14:42.474744+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926736+0000","last_change":"2023-08-17T00:14:42.926736+0000","last_active":"2023-08-17T00:14:42.926736+0000","last_peered":"2023-08-17T00:14:42.926736+0000","last_clean":"2023-08-17T00:14:42.926736+0000","last_became_active":"2023-08-17T00:14:42.926458+0000","last_became_peered":"2023-08-17T00:14:42.926458+0000","last_unstale":"2023-08-17T00:14:42.926736+0000","last_undegraded":"2023-08-17T00:14:42.926736+0000","last_fullsized":"2023-08-17T00:14:42.926736+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.898037+0000","last_change":"2023-08-17T00:14:42.474319+0000","last_active":"2023-08-17T00:14:42.898037+0000","last_peered":"2023-08-17T00:14:42.898037+0000","last_clean":"2023-08-17T00:14:42.898037+0000","last_became_active":"2023-08-17T00:14:42.474013+0000","last_became_peered":"2023-08-17T00:14:42.474013+0000","last_unstale":"2023-08-17T00:14:42.898037+0000","last_undegraded":"2023-08-17T00:14:42.898037+0000","last_fullsized":"2023-08-17T00:14:42.898037+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903331+0000","last_change":"2023-08-17T00:14:42.903331+0000","last_active":"2023-08-17T00:14:42.903331+0000","last_peered":"2023-08-17T00:14:42.903331+0000","last_clean":"2023-08-17T00:14:42.903331+0000","last_became_active":"2023-08-17T00:14:42.903050+0000","last_became_peered":"2023-08-17T00:14:42.903050+0000","last_unstale":"2023-08-17T00:14:42.903331+0000","last_undegraded":"2023-08-17T00:14:42.903331+0000","last_fullsized":"2023-08-17T00:14:42.903331+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.899192+0000","last_change":"2023-08-17T00:14:42.469318+0000","last_active":"2023-08-17T00:14:42.899192+0000","last_peered":"2023-08-17T00:14:42.899192+0000","last_clean":"2023-08-17T00:14:42.899192+0000","last_became_active":"2023-08-17T00:14:42.468997+0000","last_became_peered":"2023-08-17T00:14:42.468997+0000","last_unstale":"2023-08-17T00:14:42.899192+0000","last_undegraded":"2023-08-17T00:14:42.899192+0000","last_fullsized":"2023-08-17T00:14:42.899192+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925338+0000","last_change":"2023-08-17T00:14:42.925338+0000","last_active":"2023-08-17T00:14:42.925338+0000","last_peered":"2023-08-17T00:14:42.925338+0000","last_clean":"2023-08-17T00:14:42.925338+0000","last_became_active":"2023-08-17T00:14:42.925062+0000","last_became_peered":"2023-08-17T00:14:42.925062+0000","last_unstale":"2023-08-17T00:14:42.925338+0000","last_undegraded":"2023-08-17T00:14:42.925338+0000","last_fullsized":"2023-08-17T00:14:42.925338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.470292+0000","last_change":"2023-08-17T00:14:42.464933+0000","last_active":"2023-08-17T00:14:42.470292+0000","last_peered":"2023-08-17T00:14:42.470292+0000","last_clean":"2023-08-17T00:14:42.470292+0000","last_became_active":"2023-08-17T00:14:42.464495+0000","last_became_peered":"2023-08-17T00:14:42.464495+0000","last_unstale":"2023-08-17T00:14:42.470292+0000","last_undegraded":"2023-08-17T00:14:42.470292+0000","last_fullsized":"2023-08-17T00:14:42.470292+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924116+0000","last_change":"2023-08-17T00:14:42.918124+0000","last_active":"2023-08-17T00:14:42.924116+0000","last_peered":"2023-08-17T00:14:42.924116+0000","last_clean":"2023-08-17T00:14:42.924116+0000","last_became_active":"2023-08-17T00:14:42.917805+0000","last_became_peered":"2023-08-17T00:14:42.917805+0000","last_unstale":"2023-08-17T00:14:42.924116+0000","last_undegraded":"2023-08-17T00:14:42.924116+0000","last_fullsized":"2023-08-17T00:14:42.924116+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896999+0000","last_change":"2023-08-17T00:14:42.459984+0000","last_active":"2023-08-17T00:14:42.896999+0000","last_peered":"2023-08-17T00:14:42.896999+0000","last_clean":"2023-08-17T00:14:42.896999+0000","last_became_active":"2023-08-17T00:14:42.459703+0000","last_became_peered":"2023-08-17T00:14:42.459703+0000","last_unstale":"2023-08-17T00:14:42.896999+0000","last_undegraded":"2023-08-17T00:14:42.896999+0000","last_fullsized":"2023-08-17T00:14:42.896999+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920117+0000","last_change":"2023-08-17T00:14:42.920117+0000","last_active":"2023-08-17T00:14:42.920117+0000","last_peered":"2023-08-17T00:14:42.920117+0000","last_clean":"2023-08-17T00:14:42.920117+0000","last_became_active":"2023-08-17T00:14:42.919847+0000","last_became_peered":"2023-08-17T00:14:42.919847+0000","last_unstale":"2023-08-17T00:14:42.920117+0000","last_undegraded":"2023-08-17T00:14:42.920117+0000","last_fullsized":"2023-08-17T00:14:42.920117+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896514+0000","last_change":"2023-08-17T00:14:42.475486+0000","last_active":"2023-08-17T00:14:42.896514+0000","last_peered":"2023-08-17T00:14:42.896514+0000","last_clean":"2023-08-17T00:14:42.896514+0000","last_became_active":"2023-08-17T00:14:42.475121+0000","last_became_peered":"2023-08-17T00:14:42.475121+0000","last_unstale":"2023-08-17T00:14:42.896514+0000","last_undegraded":"2023-08-17T00:14:42.896514+0000","last_fullsized":"2023-08-17T00:14:42.896514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917309+0000","last_change":"2023-08-17T00:14:42.917309+0000","last_active":"2023-08-17T00:14:42.917309+0000","last_peered":"2023-08-17T00:14:42.917309+0000","last_clean":"2023-08-17T00:14:42.917309+0000","last_became_active":"2023-08-17T00:14:42.916884+0000","last_became_peered":"2023-08-17T00:14:42.916884+0000","last_unstale":"2023-08-17T00:14:42.917309+0000","last_undegraded":"2023-08-17T00:14:42.917309+0000","last_fullsized":"2023-08-17T00:14:42.917309+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.895677+0000","last_change":"2023-08-17T00:14:42.469704+0000","last_active":"2023-08-17T00:14:42.895677+0000","last_peered":"2023-08-17T00:14:42.895677+0000","last_clean":"2023-08-17T00:14:42.895677+0000","last_became_active":"2023-08-17T00:14:42.469358+0000","last_became_peered":"2023-08-17T00:14:42.469358+0000","last_unstale":"2023-08-17T00:14:42.895677+0000","last_undegraded":"2023-08-17T00:14:42.895677+0000","last_fullsized":"2023-08-17T00:14:42.895677+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926809+0000","last_change":"2023-08-17T00:14:42.923858+0000","last_active":"2023-08-17T00:14:42.926809+0000","last_peered":"2023-08-17T00:14:42.926809+0000","last_clean":"2023-08-17T00:14:42.926809+0000","last_became_active":"2023-08-17T00:14:42.923231+0000","last_became_peered":"2023-08-17T00:14:42.923231+0000","last_unstale":"2023-08-17T00:14:42.926809+0000","last_undegraded":"2023-08-17T00:14:42.926809+0000","last_fullsized":"2023-08-17T00:14:42.926809+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.923014+0000","last_change":"2023-08-17T00:14:42.455780+0000","last_active":"2023-08-17T00:14:42.923014+0000","last_peered":"2023-08-17T00:14:42.923014+0000","last_clean":"2023-08-17T00:14:42.923014+0000","last_became_active":"2023-08-17T00:14:42.455486+0000","last_became_peered":"2023-08-17T00:14:42.455486+0000","last_unstale":"2023-08-17T00:14:42.923014+0000","last_undegraded":"2023-08-17T00:14:42.923014+0000","last_fullsized":"2023-08-17T00:14:42.923014+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.919604+0000","last_change":"2023-08-17T00:14:42.914370+0000","last_active":"2023-08-17T00:14:42.919604+0000","last_peered":"2023-08-17T00:14:42.919604+0000","last_clean":"2023-08-17T00:14:42.919604+0000","last_became_active":"2023-08-17T00:14:42.914110+0000","last_became_peered":"2023-08-17T00:14:42.914110+0000","last_unstale":"2023-08-17T00:14:42.919604+0000","last_undegraded":"2023-08-17T00:14:42.919604+0000","last_fullsized":"2023-08-17T00:14:42.919604+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.900057+0000","last_change":"2023-08-17T00:14:42.479773+0000","last_active":"2023-08-17T00:14:42.900057+0000","last_peered":"2023-08-17T00:14:42.900057+0000","last_clean":"2023-08-17T00:14:42.900057+0000","last_became_active":"2023-08-17T00:14:42.479507+0000","last_became_peered":"2023-08-17T00:14:42.479507+0000","last_unstale":"2023-08-17T00:14:42.900057+0000","last_undegraded":"2023-08-17T00:14:42.900057+0000","last_fullsized":"2023-08-17T00:14:42.900057+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917373+0000","last_change":"2023-08-17T00:14:42.913324+0000","last_active":"2023-08-17T00:14:42.917373+0000","last_peered":"2023-08-17T00:14:42.917373+0000","last_clean":"2023-08-17T00:14:42.917373+0000","last_became_active":"2023-08-17T00:14:42.912801+0000","last_became_peered":"2023-08-17T00:14:42.912801+0000","last_unstale":"2023-08-17T00:14:42.917373+0000","last_undegraded":"2023-08-17T00:14:42.917373+0000","last_fullsized":"2023-08-17T00:14:42.917373+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1d","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.929857+0000","last_change":"2023-08-17T00:14:42.473359+0000","last_active":"2023-08-17T00:14:42.929857+0000","last_peered":"2023-08-17T00:14:42.929857+0000","last_clean":"2023-08-17T00:14:42.929857+0000","last_became_active":"2023-08-17T00:14:42.473059+0000","last_became_peered":"2023-08-17T00:14:42.473059+0000","last_unstale":"2023-08-17T00:14:42.929857+0000","last_undegraded":"2023-08-17T00:14:42.929857+0000","last_fullsized":"2023-08-17T00:14:42.929857+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924250+0000","last_change":"2023-08-17T00:14:42.924250+0000","last_active":"2023-08-17T00:14:42.924250+0000","last_peered":"2023-08-17T00:14:42.924250+0000","last_clean":"2023-08-17T00:14:42.924250+0000","last_became_active":"2023-08-17T00:14:42.923978+0000","last_became_peered":"2023-08-17T00:14:42.923978+0000","last_unstale":"2023-08-17T00:14:42.924250+0000","last_undegraded":"2023-08-17T00:14:42.924250+0000","last_fullsized":"2023-08-17T00:14:42.924250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.474191+0000","last_change":"2023-08-17T00:14:42.471796+0000","last_active":"2023-08-17T00:14:42.474191+0000","last_peered":"2023-08-17T00:14:42.474191+0000","last_clean":"2023-08-17T00:14:42.474191+0000","last_became_active":"2023-08-17T00:14:42.471520+0000","last_became_peered":"2023-08-17T00:14:42.471520+0000","last_unstale":"2023-08-17T00:14:42.474191+0000","last_undegraded":"2023-08-17T00:14:42.474191+0000","last_fullsized":"2023-08-17T00:14:42.474191+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924109+0000","last_change":"2023-08-17T00:14:42.918616+0000","last_active":"2023-08-17T00:14:42.924109+0000","last_peered":"2023-08-17T00:14:42.924109+0000","last_clean":"2023-08-17T00:14:42.924109+0000","last_became_active":"2023-08-17T00:14:42.918348+0000","last_became_peered":"2023-08-17T00:14:42.918348+0000","last_unstale":"2023-08-17T00:14:42.924109+0000","last_undegraded":"2023-08-17T00:14:42.924109+0000","last_fullsized":"2023-08-17T00:14:42.924109+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483776+0000","last_change":"2023-08-17T00:14:42.474639+0000","last_active":"2023-08-17T00:14:42.483776+0000","last_peered":"2023-08-17T00:14:42.483776+0000","last_clean":"2023-08-17T00:14:42.483776+0000","last_became_active":"2023-08-17T00:14:42.474341+0000","last_became_peered":"2023-08-17T00:14:42.474341+0000","last_unstale":"2023-08-17T00:14:42.483776+0000","last_undegraded":"2023-08-17T00:14:42.483776+0000","last_fullsized":"2023-08-17T00:14:42.483776+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924671+0000","last_change":"2023-08-17T00:14:42.924671+0000","last_active":"2023-08-17T00:14:42.924671+0000","last_peered":"2023-08-17T00:14:42.924671+0000","last_clean":"2023-08-17T00:14:42.924671+0000","last_became_active":"2023-08-17T00:14:42.924423+0000","last_became_peered":"2023-08-17T00:14:42.924423+0000","last_unstale":"2023-08-17T00:14:42.924671+0000","last_undegraded":"2023-08-17T00:14:42.924671+0000","last_fullsized":"2023-08-17T00:14:42.924671+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897356+0000","last_change":"2023-08-17T00:14:42.478106+0000","last_active":"2023-08-17T00:14:42.897356+0000","last_peered":"2023-08-17T00:14:42.897356+0000","last_clean":"2023-08-17T00:14:42.897356+0000","last_became_active":"2023-08-17T00:14:42.477827+0000","last_became_peered":"2023-08-17T00:14:42.477827+0000","last_unstale":"2023-08-17T00:14:42.897356+0000","last_undegraded":"2023-08-17T00:14:42.897356+0000","last_fullsized":"2023-08-17T00:14:42.897356+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914772+0000","last_change":"2023-08-17T00:14:42.914772+0000","last_active":"2023-08-17T00:14:42.914772+0000","last_peered":"2023-08-17T00:14:42.914772+0000","last_clean":"2023-08-17T00:14:42.914772+0000","last_became_active":"2023-08-17T00:14:42.914480+0000","last_became_peered":"2023-08-17T00:14:42.914480+0000","last_unstale":"2023-08-17T00:14:42.914772+0000","last_undegraded":"2023-08-17T00:14:42.914772+0000","last_fullsized":"2023-08-17T00:14:42.914772+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.477853+0000","last_change":"2023-08-17T00:14:42.461610+0000","last_active":"2023-08-17T00:14:42.477853+0000","last_peered":"2023-08-17T00:14:42.477853+0000","last_clean":"2023-08-17T00:14:42.477853+0000","last_became_active":"2023-08-17T00:14:42.461299+0000","last_became_peered":"2023-08-17T00:14:42.461299+0000","last_unstale":"2023-08-17T00:14:42.477853+0000","last_undegraded":"2023-08-17T00:14:42.477853+0000","last_fullsized":"2023-08-17T00:14:42.477853+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920904+0000","last_change":"2023-08-17T00:14:42.920904+0000","last_active":"2023-08-17T00:14:42.920904+0000","last_peered":"2023-08-17T00:14:42.920904+0000","last_clean":"2023-08-17T00:14:42.920904+0000","last_became_active":"2023-08-17T00:14:42.920653+0000","last_became_peered":"2023-08-17T00:14:42.920653+0000","last_unstale":"2023-08-17T00:14:42.920904+0000","last_undegraded":"2023-08-17T00:14:42.920904+0000","last_fullsized":"2023-08-17T00:14:42.920904+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896474+0000","last_change":"2023-08-17T00:14:42.475277+0000","last_active":"2023-08-17T00:14:42.896474+0000","last_peered":"2023-08-17T00:14:42.896474+0000","last_clean":"2023-08-17T00:14:42.896474+0000","last_became_active":"2023-08-17T00:14:42.474884+0000","last_became_peered":"2023-08-17T00:14:42.474884+0000","last_unstale":"2023-08-17T00:14:42.896474+0000","last_undegraded":"2023-08-17T00:14:42.896474+0000","last_fullsized":"2023-08-17T00:14:42.896474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.904158+0000","last_change":"2023-08-17T00:14:42.904158+0000","last_active":"2023-08-17T00:14:42.904158+0000","last_peered":"2023-08-17T00:14:42.904158+0000","last_clean":"2023-08-17T00:14:42.904158+0000","last_became_active":"2023-08-17T00:14:42.903858+0000","last_became_peered":"2023-08-17T00:14:42.903858+0000","last_unstale":"2023-08-17T00:14:42.904158+0000","last_undegraded":"2023-08-17T00:14:42.904158+0000","last_fullsized":"2023-08-17T00:14:42.904158+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.f","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926164+0000","last_change":"2023-08-17T00:14:42.476348+0000","last_active":"2023-08-17T00:14:42.926164+0000","last_peered":"2023-08-17T00:14:42.926164+0000","last_clean":"2023-08-17T00:14:42.926164+0000","last_became_active":"2023-08-17T00:14:42.476030+0000","last_became_peered":"2023-08-17T00:14:42.476030+0000","last_unstale":"2023-08-17T00:14:42.926164+0000","last_undegraded":"2023-08-17T00:14:42.926164+0000","last_fullsized":"2023-08-17T00:14:42.926164+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.910937+0000","last_change":"2023-08-17T00:14:42.910937+0000","last_active":"2023-08-17T00:14:42.910937+0000","last_peered":"2023-08-17T00:14:42.910937+0000","last_clean":"2023-08-17T00:14:42.910937+0000","last_became_active":"2023-08-17T00:14:42.910578+0000","last_became_peered":"2023-08-17T00:14:42.910578+0000","last_unstale":"2023-08-17T00:14:42.910937+0000","last_undegraded":"2023-08-17T00:14:42.910937+0000","last_fullsized":"2023-08-17T00:14:42.910937+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.e","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920801+0000","last_change":"2023-08-17T00:14:42.468928+0000","last_active":"2023-08-17T00:14:42.920801+0000","last_peered":"2023-08-17T00:14:42.920801+0000","last_clean":"2023-08-17T00:14:42.920801+0000","last_became_active":"2023-08-17T00:14:42.468635+0000","last_became_peered":"2023-08-17T00:14:42.468635+0000","last_unstale":"2023-08-17T00:14:42.920801+0000","last_undegraded":"2023-08-17T00:14:42.920801+0000","last_fullsized":"2023-08-17T00:14:42.920801+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.929043+0000","last_change":"2023-08-17T00:14:42.920297+0000","last_active":"2023-08-17T00:14:42.929043+0000","last_peered":"2023-08-17T00:14:42.929043+0000","last_clean":"2023-08-17T00:14:42.929043+0000","last_became_active":"2023-08-17T00:14:42.920015+0000","last_became_peered":"2023-08-17T00:14:42.920015+0000","last_unstale":"2023-08-17T00:14:42.929043+0000","last_undegraded":"2023-08-17T00:14:42.929043+0000","last_fullsized":"2023-08-17T00:14:42.929043+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.472100+0000","last_change":"2023-08-17T00:14:42.468397+0000","last_active":"2023-08-17T00:14:42.472100+0000","last_peered":"2023-08-17T00:14:42.472100+0000","last_clean":"2023-08-17T00:14:42.472100+0000","last_became_active":"2023-08-17T00:14:42.468111+0000","last_became_peered":"2023-08-17T00:14:42.468111+0000","last_unstale":"2023-08-17T00:14:42.472100+0000","last_undegraded":"2023-08-17T00:14:42.472100+0000","last_fullsized":"2023-08-17T00:14:42.472100+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916242+0000","last_change":"2023-08-17T00:14:42.916242+0000","last_active":"2023-08-17T00:14:42.916242+0000","last_peered":"2023-08-17T00:14:42.916242+0000","last_clean":"2023-08-17T00:14:42.916242+0000","last_became_active":"2023-08-17T00:14:42.915939+0000","last_became_peered":"2023-08-17T00:14:42.915939+0000","last_unstale":"2023-08-17T00:14:42.916242+0000","last_undegraded":"2023-08-17T00:14:42.916242+0000","last_fullsized":"2023-08-17T00:14:42.916242+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.475543+0000","last_change":"2023-08-17T00:14:42.469022+0000","last_active":"2023-08-17T00:14:42.475543+0000","last_peered":"2023-08-17T00:14:42.475543+0000","last_clean":"2023-08-17T00:14:42.475543+0000","last_became_active":"2023-08-17T00:14:42.468700+0000","last_became_peered":"2023-08-17T00:14:42.468700+0000","last_unstale":"2023-08-17T00:14:42.475543+0000","last_undegraded":"2023-08-17T00:14:42.475543+0000","last_fullsized":"2023-08-17T00:14:42.475543+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.908305+0000","last_change":"2023-08-17T00:14:42.908305+0000","last_active":"2023-08-17T00:14:42.908305+0000","last_peered":"2023-08-17T00:14:42.908305+0000","last_clean":"2023-08-17T00:14:42.908305+0000","last_became_active":"2023-08-17T00:14:42.907980+0000","last_became_peered":"2023-08-17T00:14:42.907980+0000","last_unstale":"2023-08-17T00:14:42.908305+0000","last_undegraded":"2023-08-17T00:14:42.908305+0000","last_fullsized":"2023-08-17T00:14:42.908305+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.b","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926119+0000","last_change":"2023-08-17T00:14:42.476211+0000","last_active":"2023-08-17T00:14:42.926119+0000","last_peered":"2023-08-17T00:14:42.926119+0000","last_clean":"2023-08-17T00:14:42.926119+0000","last_became_active":"2023-08-17T00:14:42.475895+0000","last_became_peered":"2023-08-17T00:14:42.475895+0000","last_unstale":"2023-08-17T00:14:42.926119+0000","last_undegraded":"2023-08-17T00:14:42.926119+0000","last_fullsized":"2023-08-17T00:14:42.926119+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914995+0000","last_change":"2023-08-17T00:14:42.914995+0000","last_active":"2023-08-17T00:14:42.914995+0000","last_peered":"2023-08-17T00:14:42.914995+0000","last_clean":"2023-08-17T00:14:42.914995+0000","last_became_active":"2023-08-17T00:14:42.914674+0000","last_became_peered":"2023-08-17T00:14:42.914674+0000","last_unstale":"2023-08-17T00:14:42.914995+0000","last_undegraded":"2023-08-17T00:14:42.914995+0000","last_fullsized":"2023-08-17T00:14:42.914995+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897140+0000","last_change":"2023-08-17T00:14:42.457484+0000","last_active":"2023-08-17T00:14:42.897140+0000","last_peered":"2023-08-17T00:14:42.897140+0000","last_clean":"2023-08-17T00:14:42.897140+0000","last_became_active":"2023-08-17T00:14:42.456764+0000","last_became_peered":"2023-08-17T00:14:42.456764+0000","last_unstale":"2023-08-17T00:14:42.897140+0000","last_undegraded":"2023-08-17T00:14:42.897140+0000","last_fullsized":"2023-08-17T00:14:42.897140+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.901968+0000","last_change":"2023-08-17T00:14:42.901968+0000","last_active":"2023-08-17T00:14:42.901968+0000","last_peered":"2023-08-17T00:14:42.901968+0000","last_clean":"2023-08-17T00:14:42.901968+0000","last_became_active":"2023-08-17T00:14:42.901678+0000","last_became_peered":"2023-08-17T00:14:42.901678+0000","last_unstale":"2023-08-17T00:14:42.901968+0000","last_undegraded":"2023-08-17T00:14:42.901968+0000","last_fullsized":"2023-08-17T00:14:42.901968+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896617+0000","last_change":"2023-08-17T00:14:42.476334+0000","last_active":"2023-08-17T00:14:42.896617+0000","last_peered":"2023-08-17T00:14:42.896617+0000","last_clean":"2023-08-17T00:14:42.896617+0000","last_became_active":"2023-08-17T00:14:42.475848+0000","last_became_peered":"2023-08-17T00:14:42.475848+0000","last_unstale":"2023-08-17T00:14:42.896617+0000","last_undegraded":"2023-08-17T00:14:42.896617+0000","last_fullsized":"2023-08-17T00:14:42.896617+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926370+0000","last_change":"2023-08-17T00:14:42.921779+0000","last_active":"2023-08-17T00:14:42.926370+0000","last_peered":"2023-08-17T00:14:42.926370+0000","last_clean":"2023-08-17T00:14:42.926370+0000","last_became_active":"2023-08-17T00:14:42.921457+0000","last_became_peered":"2023-08-17T00:14:42.921457+0000","last_unstale":"2023-08-17T00:14:42.926370+0000","last_undegraded":"2023-08-17T00:14:42.926370+0000","last_fullsized":"2023-08-17T00:14:42.926370+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897457+0000","last_change":"2023-08-17T00:14:42.466465+0000","last_active":"2023-08-17T00:14:42.897457+0000","last_peered":"2023-08-17T00:14:42.897457+0000","last_clean":"2023-08-17T00:14:42.897457+0000","last_became_active":"2023-08-17T00:14:42.466180+0000","last_became_peered":"2023-08-17T00:14:42.466180+0000","last_unstale":"2023-08-17T00:14:42.897457+0000","last_undegraded":"2023-08-17T00:14:42.897457+0000","last_fullsized":"2023-08-17T00:14:42.897457+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926793+0000","last_change":"2023-08-17T00:14:42.923726+0000","last_active":"2023-08-17T00:14:42.926793+0000","last_peered":"2023-08-17T00:14:42.926793+0000","last_clean":"2023-08-17T00:14:42.926793+0000","last_became_active":"2023-08-17T00:14:42.922732+0000","last_became_peered":"2023-08-17T00:14:42.922732+0000","last_unstale":"2023-08-17T00:14:42.926793+0000","last_undegraded":"2023-08-17T00:14:42.926793+0000","last_fullsized":"2023-08-17T00:14:42.926793+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.7","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.929964+0000","last_change":"2023-08-17T00:14:42.475040+0000","last_active":"2023-08-17T00:14:42.929964+0000","last_peered":"2023-08-17T00:14:42.929964+0000","last_clean":"2023-08-17T00:14:42.929964+0000","last_became_active":"2023-08-17T00:14:42.474412+0000","last_became_peered":"2023-08-17T00:14:42.474412+0000","last_unstale":"2023-08-17T00:14:42.929964+0000","last_undegraded":"2023-08-17T00:14:42.929964+0000","last_fullsized":"2023-08-17T00:14:42.929964+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916816+0000","last_change":"2023-08-17T00:14:42.916816+0000","last_active":"2023-08-17T00:14:42.916816+0000","last_peered":"2023-08-17T00:14:42.916816+0000","last_clean":"2023-08-17T00:14:42.916816+0000","last_became_active":"2023-08-17T00:14:42.916560+0000","last_became_peered":"2023-08-17T00:14:42.916560+0000","last_unstale":"2023-08-17T00:14:42.916816+0000","last_undegraded":"2023-08-17T00:14:42.916816+0000","last_fullsized":"2023-08-17T00:14:42.916816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483670+0000","last_change":"2023-08-17T00:14:42.473214+0000","last_active":"2023-08-17T00:14:42.483670+0000","last_peered":"2023-08-17T00:14:42.483670+0000","last_clean":"2023-08-17T00:14:42.483670+0000","last_became_active":"2023-08-17T00:14:42.472873+0000","last_became_peered":"2023-08-17T00:14:42.472873+0000","last_unstale":"2023-08-17T00:14:42.483670+0000","last_undegraded":"2023-08-17T00:14:42.483670+0000","last_fullsized":"2023-08-17T00:14:42.483670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927657+0000","last_change":"2023-08-17T00:14:42.927657+0000","last_active":"2023-08-17T00:14:42.927657+0000","last_peered":"2023-08-17T00:14:42.927657+0000","last_clean":"2023-08-17T00:14:42.927657+0000","last_became_active":"2023-08-17T00:14:42.918629+0000","last_became_peered":"2023-08-17T00:14:42.918629+0000","last_unstale":"2023-08-17T00:14:42.927657+0000","last_undegraded":"2023-08-17T00:14:42.927657+0000","last_fullsized":"2023-08-17T00:14:42.927657+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.470693+0000","last_change":"2023-08-17T00:14:42.469712+0000","last_active":"2023-08-17T00:14:42.470693+0000","last_peered":"2023-08-17T00:14:42.470693+0000","last_clean":"2023-08-17T00:14:42.470693+0000","last_became_active":"2023-08-17T00:14:42.469428+0000","last_became_peered":"2023-08-17T00:14:42.469428+0000","last_unstale":"2023-08-17T00:14:42.470693+0000","last_undegraded":"2023-08-17T00:14:42.470693+0000","last_fullsized":"2023-08-17T00:14:42.470693+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918858+0000","last_change":"2023-08-17T00:14:42.913006+0000","last_active":"2023-08-17T00:14:42.918858+0000","last_peered":"2023-08-17T00:14:42.918858+0000","last_clean":"2023-08-17T00:14:42.918858+0000","last_became_active":"2023-08-17T00:14:42.912386+0000","last_became_peered":"2023-08-17T00:14:42.912386+0000","last_unstale":"2023-08-17T00:14:42.918858+0000","last_undegraded":"2023-08-17T00:14:42.918858+0000","last_fullsized":"2023-08-17T00:14:42.918858+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.469456+0000","last_change":"2023-08-17T00:14:42.462757+0000","last_active":"2023-08-17T00:14:42.469456+0000","last_peered":"2023-08-17T00:14:42.469456+0000","last_clean":"2023-08-17T00:14:42.469456+0000","last_became_active":"2023-08-17T00:14:42.462341+0000","last_became_peered":"2023-08-17T00:14:42.462341+0000","last_unstale":"2023-08-17T00:14:42.469456+0000","last_undegraded":"2023-08-17T00:14:42.469456+0000","last_fullsized":"2023-08-17T00:14:42.469456+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925219+0000","last_change":"2023-08-17T00:14:42.925219+0000","last_active":"2023-08-17T00:14:42.925219+0000","last_peered":"2023-08-17T00:14:42.925219+0000","last_clean":"2023-08-17T00:14:42.925219+0000","last_became_active":"2023-08-17T00:14:42.924945+0000","last_became_peered":"2023-08-17T00:14:42.924945+0000","last_unstale":"2023-08-17T00:14:42.925219+0000","last_undegraded":"2023-08-17T00:14:42.925219+0000","last_fullsized":"2023-08-17T00:14:42.925219+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.477728+0000","last_change":"2023-08-17T00:14:42.459759+0000","last_active":"2023-08-17T00:14:42.477728+0000","last_peered":"2023-08-17T00:14:42.477728+0000","last_clean":"2023-08-17T00:14:42.477728+0000","last_became_active":"2023-08-17T00:14:42.459429+0000","last_became_peered":"2023-08-17T00:14:42.459429+0000","last_unstale":"2023-08-17T00:14:42.477728+0000","last_undegraded":"2023-08-17T00:14:42.477728+0000","last_fullsized":"2023-08-17T00:14:42.477728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.913184+0000","last_change":"2023-08-17T00:14:42.913184+0000","last_active":"2023-08-17T00:14:42.913184+0000","last_peered":"2023-08-17T00:14:42.913184+0000","last_clean":"2023-08-17T00:14:42.913184+0000","last_became_active":"2023-08-17T00:14:42.912865+0000","last_became_peered":"2023-08-17T00:14:42.912865+0000","last_unstale":"2023-08-17T00:14:42.913184+0000","last_undegraded":"2023-08-17T00:14:42.913184+0000","last_fullsized":"2023-08-17T00:14:42.913184+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.904226+0000","last_change":"2023-08-17T00:14:42.464640+0000","last_active":"2023-08-17T00:14:42.904226+0000","last_peered":"2023-08-17T00:14:42.904226+0000","last_clean":"2023-08-17T00:14:42.904226+0000","last_became_active":"2023-08-17T00:14:42.462241+0000","last_became_peered":"2023-08-17T00:14:42.462241+0000","last_unstale":"2023-08-17T00:14:42.904226+0000","last_undegraded":"2023-08-17T00:14:42.904226+0000","last_fullsized":"2023-08-17T00:14:42.904226+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916047+0000","last_change":"2023-08-17T00:14:42.916047+0000","last_active":"2023-08-17T00:14:42.916047+0000","last_peered":"2023-08-17T00:14:42.916047+0000","last_clean":"2023-08-17T00:14:42.916047+0000","last_became_active":"2023-08-17T00:14:42.914724+0000","last_became_peered":"2023-08-17T00:14:42.914724+0000","last_unstale":"2023-08-17T00:14:42.916047+0000","last_undegraded":"2023-08-17T00:14:42.916047+0000","last_fullsized":"2023-08-17T00:14:42.916047+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.473512+0000","last_change":"2023-08-17T00:14:42.470765+0000","last_active":"2023-08-17T00:14:42.473512+0000","last_peered":"2023-08-17T00:14:42.473512+0000","last_clean":"2023-08-17T00:14:42.473512+0000","last_became_active":"2023-08-17T00:14:42.470418+0000","last_became_peered":"2023-08-17T00:14:42.470418+0000","last_unstale":"2023-08-17T00:14:42.473512+0000","last_undegraded":"2023-08-17T00:14:42.473512+0000","last_fullsized":"2023-08-17T00:14:42.473512+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917143+0000","last_change":"2023-08-17T00:14:42.917143+0000","last_active":"2023-08-17T00:14:42.917143+0000","last_peered":"2023-08-17T00:14:42.917143+0000","last_clean":"2023-08-17T00:14:42.917143+0000","last_became_active":"2023-08-17T00:14:42.916531+0000","last_became_peered":"2023-08-17T00:14:42.916531+0000","last_unstale":"2023-08-17T00:14:42.917143+0000","last_undegraded":"2023-08-17T00:14:42.917143+0000","last_fullsized":"2023-08-17T00:14:42.917143+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.477700+0000","last_change":"2023-08-17T00:14:42.460357+0000","last_active":"2023-08-17T00:14:42.477700+0000","last_peered":"2023-08-17T00:14:42.477700+0000","last_clean":"2023-08-17T00:14:42.477700+0000","last_became_active":"2023-08-17T00:14:42.460080+0000","last_became_peered":"2023-08-17T00:14:42.460080+0000","last_unstale":"2023-08-17T00:14:42.477700+0000","last_undegraded":"2023-08-17T00:14:42.477700+0000","last_fullsized":"2023-08-17T00:14:42.477700+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.908924+0000","last_change":"2023-08-17T00:14:42.908924+0000","last_active":"2023-08-17T00:14:42.908924+0000","last_peered":"2023-08-17T00:14:42.908924+0000","last_clean":"2023-08-17T00:14:42.908924+0000","last_became_active":"2023-08-17T00:14:42.908578+0000","last_became_peered":"2023-08-17T00:14:42.908578+0000","last_unstale":"2023-08-17T00:14:42.908924+0000","last_undegraded":"2023-08-17T00:14:42.908924+0000","last_fullsized":"2023-08-17T00:14:42.908924+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.10","version":"153'4","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.930067+0000","last_change":"2023-08-17T00:14:42.473431+0000","last_active":"2023-08-17T00:14:42.930067+0000","last_peered":"2023-08-17T00:14:42.930067+0000","last_clean":"2023-08-17T00:14:42.930067+0000","last_became_active":"2023-08-17T00:14:42.473158+0000","last_became_peered":"2023-08-17T00:14:42.473158+0000","last_unstale":"2023-08-17T00:14:42.930067+0000","last_undegraded":"2023-08-17T00:14:42.930067+0000","last_fullsized":"2023-08-17T00:14:42.930067+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.464696+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:14:42.464696+0000","last_peered":"2023-08-17T00:14:42.464696+0000","last_clean":"2023-08-17T00:14:42.464696+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:14:42.464696+0000","last_undegraded":"2023-08-17T00:14:42.464696+0000","last_fullsized":"2023-08-17T00:14:42.464696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920089+0000","last_change":"2023-08-17T00:14:42.915749+0000","last_active":"2023-08-17T00:14:42.920089+0000","last_peered":"2023-08-17T00:14:42.920089+0000","last_clean":"2023-08-17T00:14:42.920089+0000","last_became_active":"2023-08-17T00:14:42.915461+0000","last_became_peered":"2023-08-17T00:14:42.915461+0000","last_unstale":"2023-08-17T00:14:42.920089+0000","last_undegraded":"2023-08-17T00:14:42.920089+0000","last_fullsized":"2023-08-17T00:14:42.920089+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483442+0000","last_change":"2023-08-17T00:14:42.468794+0000","last_active":"2023-08-17T00:14:42.483442+0000","last_peered":"2023-08-17T00:14:42.483442+0000","last_clean":"2023-08-17T00:14:42.483442+0000","last_became_active":"2023-08-17T00:14:42.468521+0000","last_became_peered":"2023-08-17T00:14:42.468521+0000","last_unstale":"2023-08-17T00:14:42.483442+0000","last_undegraded":"2023-08-17T00:14:42.483442+0000","last_fullsized":"2023-08-17T00:14:42.483442+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.451278+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:14:42.451278+0000","last_peered":"2023-08-17T00:14:42.451278+0000","last_clean":"2023-08-17T00:14:42.451278+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:14:42.451278+0000","last_undegraded":"2023-08-17T00:14:42.451278+0000","last_fullsized":"2023-08-17T00:14:42.451278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915854+0000","last_change":"2023-08-17T00:14:42.915854+0000","last_active":"2023-08-17T00:14:42.915854+0000","last_peered":"2023-08-17T00:14:42.915854+0000","last_clean":"2023-08-17T00:14:42.915854+0000","last_became_active":"2023-08-17T00:14:42.915480+0000","last_became_peered":"2023-08-17T00:14:42.915480+0000","last_unstale":"2023-08-17T00:14:42.915854+0000","last_undegraded":"2023-08-17T00:14:42.915854+0000","last_fullsized":"2023-08-17T00:14:42.915854+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483395+0000","last_change":"2023-08-17T00:14:42.468295+0000","last_active":"2023-08-17T00:14:42.483395+0000","last_peered":"2023-08-17T00:14:42.483395+0000","last_clean":"2023-08-17T00:14:42.483395+0000","last_became_active":"2023-08-17T00:14:42.467968+0000","last_became_peered":"2023-08-17T00:14:42.467968+0000","last_unstale":"2023-08-17T00:14:42.483395+0000","last_undegraded":"2023-08-17T00:14:42.483395+0000","last_fullsized":"2023-08-17T00:14:42.483395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.458944+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:14:42.458944+0000","last_peered":"2023-08-17T00:14:42.458944+0000","last_clean":"2023-08-17T00:14:42.458944+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:14:42.458944+0000","last_undegraded":"2023-08-17T00:14:42.458944+0000","last_fullsized":"2023-08-17T00:14:42.458944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914724+0000","last_change":"2023-08-17T00:14:42.914724+0000","last_active":"2023-08-17T00:14:42.914724+0000","last_peered":"2023-08-17T00:14:42.914724+0000","last_clean":"2023-08-17T00:14:42.914724+0000","last_became_active":"2023-08-17T00:14:42.914458+0000","last_became_peered":"2023-08-17T00:14:42.914458+0000","last_unstale":"2023-08-17T00:14:42.914724+0000","last_undegraded":"2023-08-17T00:14:42.914724+0000","last_fullsized":"2023-08-17T00:14:42.914724+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.895796+0000","last_change":"2023-08-17T00:14:42.464753+0000","last_active":"2023-08-17T00:14:42.895796+0000","last_peered":"2023-08-17T00:14:42.895796+0000","last_clean":"2023-08-17T00:14:42.895796+0000","last_became_active":"2023-08-17T00:14:42.464155+0000","last_became_peered":"2023-08-17T00:14:42.464155+0000","last_unstale":"2023-08-17T00:14:42.895796+0000","last_undegraded":"2023-08-17T00:14:42.895796+0000","last_fullsized":"2023-08-17T00:14:42.895796+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.908557+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:14:42.908557+0000","last_peered":"2023-08-17T00:14:42.908557+0000","last_clean":"2023-08-17T00:14:42.908557+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:14:42.908557+0000","last_undegraded":"2023-08-17T00:14:42.908557+0000","last_fullsized":"2023-08-17T00:14:42.908557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920186+0000","last_change":"2023-08-17T00:14:42.917282+0000","last_active":"2023-08-17T00:14:42.920186+0000","last_peered":"2023-08-17T00:14:42.920186+0000","last_clean":"2023-08-17T00:14:42.920186+0000","last_became_active":"2023-08-17T00:14:42.916980+0000","last_became_peered":"2023-08-17T00:14:42.916980+0000","last_unstale":"2023-08-17T00:14:42.920186+0000","last_undegraded":"2023-08-17T00:14:42.920186+0000","last_fullsized":"2023-08-17T00:14:42.920186+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"153'3","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924329+0000","last_change":"2023-08-17T00:14:42.465114+0000","last_active":"2023-08-17T00:14:42.924329+0000","last_peered":"2023-08-17T00:14:42.924329+0000","last_clean":"2023-08-17T00:14:42.924329+0000","last_became_active":"2023-08-17T00:14:42.464757+0000","last_became_peered":"2023-08-17T00:14:42.464757+0000","last_unstale":"2023-08-17T00:14:42.924329+0000","last_undegraded":"2023-08-17T00:14:42.924329+0000","last_fullsized":"2023-08-17T00:14:42.924329+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.461312+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:14:42.461312+0000","last_peered":"2023-08-17T00:14:42.461312+0000","last_clean":"2023-08-17T00:14:42.461312+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:14:42.461312+0000","last_undegraded":"2023-08-17T00:14:42.461312+0000","last_fullsized":"2023-08-17T00:14:42.461312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927861+0000","last_change":"2023-08-17T00:14:42.925196+0000","last_active":"2023-08-17T00:14:42.927861+0000","last_peered":"2023-08-17T00:14:42.927861+0000","last_clean":"2023-08-17T00:14:42.927861+0000","last_became_active":"2023-08-17T00:14:42.924845+0000","last_became_peered":"2023-08-17T00:14:42.924845+0000","last_unstale":"2023-08-17T00:14:42.927861+0000","last_undegraded":"2023-08-17T00:14:42.927861+0000","last_fullsized":"2023-08-17T00:14:42.927861+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483454+0000","last_change":"2023-08-17T00:14:42.468843+0000","last_active":"2023-08-17T00:14:42.483454+0000","last_peered":"2023-08-17T00:14:42.483454+0000","last_clean":"2023-08-17T00:14:42.483454+0000","last_became_active":"2023-08-17T00:14:42.468577+0000","last_became_peered":"2023-08-17T00:14:42.468577+0000","last_unstale":"2023-08-17T00:14:42.483454+0000","last_undegraded":"2023-08-17T00:14:42.483454+0000","last_fullsized":"2023-08-17T00:14:42.483454+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897398+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:14:42.897398+0000","last_peered":"2023-08-17T00:14:42.897398+0000","last_clean":"2023-08-17T00:14:42.897398+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:14:42.897398+0000","last_undegraded":"2023-08-17T00:14:42.897398+0000","last_fullsized":"2023-08-17T00:14:42.897398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915405+0000","last_change":"2023-08-17T00:14:42.915405+0000","last_active":"2023-08-17T00:14:42.915405+0000","last_peered":"2023-08-17T00:14:42.915405+0000","last_clean":"2023-08-17T00:14:42.915405+0000","last_became_active":"2023-08-17T00:14:42.915123+0000","last_became_peered":"2023-08-17T00:14:42.915123+0000","last_unstale":"2023-08-17T00:14:42.915405+0000","last_undegraded":"2023-08-17T00:14:42.915405+0000","last_fullsized":"2023-08-17T00:14:42.915405+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.898007+0000","last_change":"2023-08-17T00:14:42.474345+0000","last_active":"2023-08-17T00:14:42.898007+0000","last_peered":"2023-08-17T00:14:42.898007+0000","last_clean":"2023-08-17T00:14:42.898007+0000","last_became_active":"2023-08-17T00:14:42.474064+0000","last_became_peered":"2023-08-17T00:14:42.474064+0000","last_unstale":"2023-08-17T00:14:42.898007+0000","last_undegraded":"2023-08-17T00:14:42.898007+0000","last_fullsized":"2023-08-17T00:14:42.898007+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.459565+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:14:42.459565+0000","last_peered":"2023-08-17T00:14:42.459565+0000","last_clean":"2023-08-17T00:14:42.459565+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:14:42.459565+0000","last_undegraded":"2023-08-17T00:14:42.459565+0000","last_fullsized":"2023-08-17T00:14:42.459565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.911683+0000","last_change":"2023-08-17T00:14:42.911683+0000","last_active":"2023-08-17T00:14:42.911683+0000","last_peered":"2023-08-17T00:14:42.911683+0000","last_clean":"2023-08-17T00:14:42.911683+0000","last_became_active":"2023-08-17T00:14:42.911414+0000","last_became_peered":"2023-08-17T00:14:42.911414+0000","last_unstale":"2023-08-17T00:14:42.911683+0000","last_undegraded":"2023-08-17T00:14:42.911683+0000","last_fullsized":"2023-08-17T00:14:42.911683+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.14","version":"153'2","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.928428+0000","last_change":"2023-08-17T00:14:42.471482+0000","last_active":"2023-08-17T00:14:42.928428+0000","last_peered":"2023-08-17T00:14:42.928428+0000","last_clean":"2023-08-17T00:14:42.928428+0000","last_became_active":"2023-08-17T00:14:42.471212+0000","last_became_peered":"2023-08-17T00:14:42.471212+0000","last_unstale":"2023-08-17T00:14:42.928428+0000","last_undegraded":"2023-08-17T00:14:42.928428+0000","last_fullsized":"2023-08-17T00:14:42.928428+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.460075+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:14:42.460075+0000","last_peered":"2023-08-17T00:14:42.460075+0000","last_clean":"2023-08-17T00:14:42.460075+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:14:42.460075+0000","last_undegraded":"2023-08-17T00:14:42.460075+0000","last_fullsized":"2023-08-17T00:14:42.460075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.455175+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:14:42.455175+0000","last_peered":"2023-08-17T00:14:42.455175+0000","last_clean":"2023-08-17T00:14:42.455175+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:14:42.455175+0000","last_undegraded":"2023-08-17T00:14:42.455175+0000","last_fullsized":"2023-08-17T00:14:42.455175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542290,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311384,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060456,"statfs":{"total":96636764160,"available":96317906944,"internally_reserved":0,"allocated":1916928,"data_stored":897251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.006,"15min":1.175},"min":{"1min":0.68200000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.444,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":1.6539999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.038,"15min":1.2110000000000001},"min":{"1min":0.54700000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3360000000000001,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":1.2310000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0609999999999999,"15min":1.2410000000000001},"min":{"1min":0.72099999999999997,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.48,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":1.095},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.109,"15min":1.24},"min":{"1min":0.68300000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.337,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.335}]},{"osd":2,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0489999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.298,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1359999999999999,"15min":1.2909999999999999},"min":{"1min":0.72299999999999998,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.5489999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.262}]},{"osd":3,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1060000000000001,"15min":1.2050000000000001},"min":{"1min":0.628,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3799999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.179,"15min":1.4330000000000001},"min":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5289999999999999,"5min":1.952,"15min":13.074999999999999},"last":1.379}]},{"osd":4,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.1259999999999999,"15min":1.381},"min":{"1min":0.69899999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.468,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.135},{"interface":"front","average":{"1min":1.175,"5min":1.1319999999999999,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.502,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.397}]},{"osd":5,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2010000000000001,"15min":1.5},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.601,"5min":2.9830000000000001,"15min":14.435},"last":1.575},{"interface":"front","average":{"1min":1.272,"5min":1.234,"15min":1.4810000000000001},"min":{"1min":0.80200000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8799999999999999,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.7829999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.282,"15min":1.5109999999999999},"min":{"1min":0.84599999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.526,"5min":2.427,"15min":11.279999999999999},"last":1.8640000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.4379999999999999},"min":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5,"5min":2.4350000000000001,"15min":11.365},"last":1.302}]}]},{"osd":6,"up_from":14,"seq":60129542290,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315476,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056364,"statfs":{"total":96636764160,"available":96313716736,"internally_reserved":0,"allocated":1912832,"data_stored":897209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0589999999999999},"min":{"1min":0.56299999999999994,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.6819999999999999,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.123,"15min":1.121},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.429,"5min":10.519,"15min":10.519},"last":0.94199999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1599999999999999,"15min":1.1419999999999999},"min":{"1min":0.65800000000000003,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.7569999999999999,"5min":10.704000000000001,"15min":10.704000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.0640000000000001,"15min":1.0489999999999999},"min":{"1min":0.83499999999999996,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4850000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.79300000000000004,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.6299999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.27},{"interface":"front","average":{"1min":1.23,"5min":1.306,"15min":1.2789999999999999},"min":{"1min":0.76400000000000001,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.708,"5min":10.669,"15min":10.669},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.177,"15min":1.1830000000000001},"min":{"1min":0.80400000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":11.475},"last":1.012},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":3.5339999999999998,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.874}]},{"osd":4,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.268},"min":{"1min":0.77500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.341,"5min":10.632,"15min":10.632},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.202,"15min":1.234},"min":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.6220000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.234,"15min":1.25},"min":{"1min":0.874,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.5009999999999999,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.129},{"interface":"front","average":{"1min":1.262,"5min":1.399,"15min":1.3700000000000001},"min":{"1min":0.85399999999999998,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.526,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.415}]},{"osd":7,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2789999999999999,"15min":1.3260000000000001},"min":{"1min":0.93600000000000005,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.7230000000000001,"5min":3.3450000000000002,"15min":11.51},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.367,"15min":1.391},"min":{"1min":0.96099999999999997,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.5669999999999999,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.3480000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1921024,"data_stored":897873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.004,"15min":1.266},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.44700000000000001},"max":{"1min":1.383,"5min":2.1389999999999998,"15min":15.007999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.069,"15min":1.371},"min":{"1min":0.76900000000000002,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":1.946,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.093,"15min":1.119},"min":{"1min":0.79500000000000004,"5min":0.59199999999999997,"15min":0.498},"max":{"1min":1.746,"5min":1.746,"15min":4.2270000000000003},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.121,"15min":1.2809999999999999},"min":{"1min":0.73799999999999999,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4279999999999999,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.1479999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1519999999999999,"15min":1.4330000000000001},"min":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8100000000000001,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1339999999999999,"15min":1.345},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.60299999999999998},"max":{"1min":1.456,"5min":1.796,"15min":11.949},"last":1.0329999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1899999999999999,"15min":1.397},"min":{"1min":0.94199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8500000000000001,"5min":4.3250000000000002,"15min":13.125},"last":1.212},{"interface":"front","average":{"1min":1.268,"5min":1.2130000000000001,"15min":1.347},"min":{"1min":0.871,"5min":0.77900000000000003,"15min":0.63400000000000001},"max":{"1min":1.887,"5min":2.306,"15min":8.4809999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.76800000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7,"5min":2.2789999999999999,"15min":17.510000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.234,"15min":1.583},"min":{"1min":0.77200000000000002,"5min":0.61299999999999999,"15min":0.54000000000000004},"max":{"1min":1.8819999999999999,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.167}]},{"osd":6,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.236,"15min":1.5609999999999999},"min":{"1min":0.79800000000000004,"5min":0.70299999999999996,"15min":0.60099999999999998},"max":{"1min":1.5780000000000001,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.117},{"interface":"front","average":{"1min":1.153,"5min":1.224,"15min":1.556},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.64400000000000002},"max":{"1min":1.569,"5min":3.4159999999999999,"15min":17.050000000000001},"last":0.876}]},{"osd":7,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3260000000000001,"15min":1.671},"min":{"1min":0.76300000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.923,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.248},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3640000000000001,"15min":1.6299999999999999},"min":{"1min":0.90100000000000002,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.978,"5min":2.0899999999999999,"15min":14.818},"last":1.276}]}]},{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307288,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064552,"statfs":{"total":96636764160,"available":96322101248,"internally_reserved":0,"allocated":1916928,"data_stored":897783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.32000000000000001},"max":{"1min":1.2829999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91000000000000003,"15min":0.85899999999999999},"min":{"1min":0.63400000000000001,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.3240000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.96499999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.274,"5min":3.274,"15min":11.215999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.873,"15min":0.89200000000000002},"min":{"1min":0.54000000000000004,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":1.1379999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.014}]},{"osd":2,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.54000000000000004,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.587,"5min":1.7929999999999999,"15min":2.0270000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1,"15min":1.0289999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.4139999999999999,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.288}]},{"osd":4,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.1890000000000001,"15min":1.2},"min":{"1min":0.92400000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":3.9449999999999998},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.175,"15min":1.204},"min":{"1min":0.79300000000000004,"5min":0.60399999999999998,"15min":0.56699999999999995},"max":{"1min":1.5269999999999999,"5min":1.649,"15min":3.9790000000000001},"last":1.3080000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1499999999999999,"15min":1.2030000000000001},"min":{"1min":0.77900000000000003,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.522,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.23},{"interface":"front","average":{"1min":1.224,"5min":1.22,"15min":1.2509999999999999},"min":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.53,"5min":1.669,"15min":2.6789999999999998},"last":1.375}]},{"osd":6,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.1830000000000001,"15min":1.228},"min":{"1min":0.76300000000000001,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.702,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2170000000000001,"15min":1.2030000000000001},"min":{"1min":0.86099999999999999,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.514,"5min":2.0979999999999999,"15min":3.585},"last":1.048}]},{"osd":7,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.246,"15min":1.238},"min":{"1min":0.92700000000000005,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.5209999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.85099999999999998,"5min":0.66000000000000003,"15min":0.64000000000000001},"max":{"1min":1.5640000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1679999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311384,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060456,"statfs":{"total":96636764160,"available":96317906944,"internally_reserved":0,"allocated":1916928,"data_stored":898585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":1.855,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79000000000000004,"15min":0.89200000000000002},"min":{"1min":0.45800000000000002,"5min":0.317,"15min":0.28799999999999998},"max":{"1min":1.1950000000000001,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.87,"15min":0.88},"min":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.35999999999999999},"max":{"1min":4.4160000000000004,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.016,"15min":1.0369999999999999},"min":{"1min":0.57599999999999996,"5min":0.376,"15min":0.376},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":1.0680000000000001},"min":{"1min":0.63400000000000001,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.135,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.92400000000000004,"15min":0.96299999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.5600000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.256,"15min":1.4990000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":18.597999999999999,"5min":18.597999999999999,"15min":18.597999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.3440000000000001,"15min":1.4379999999999999},"min":{"1min":0.753,"5min":0.68000000000000005,"15min":0.60099999999999998},"max":{"1min":17.988,"5min":17.988,"15min":17.988},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.28,"15min":1.5029999999999999},"min":{"1min":0.90100000000000002,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.6279999999999999,"5min":1.873,"15min":12.914},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.3680000000000001},"min":{"1min":0.746,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.472,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.153,"15min":1.431},"min":{"1min":0.74299999999999999,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.512,"5min":1.621,"15min":13.864000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.4990000000000001},"min":{"1min":0.85699999999999998,"5min":0.84499999999999997,"15min":0.71799999999999997},"max":{"1min":1.542,"5min":1.9359999999999999,"15min":12.698},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2949999999999999,"15min":1.4850000000000001},"min":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.69599999999999995},"max":{"1min":1.7609999999999999,"5min":2.6779999999999999,"15min":10.592000000000001},"last":1.169},{"interface":"front","average":{"1min":1.256,"5min":1.2969999999999999,"15min":1.494},"min":{"1min":0.84199999999999997,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.7749999999999999,"5min":1.9159999999999999,"15min":11.417},"last":1.1259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303188,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068652,"statfs":{"total":96636764160,"available":96326299648,"internally_reserved":0,"allocated":1912832,"data_stored":897161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.83799999999999997,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.309,"15min":0.309},"max":{"1min":0.997,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.89700000000000002},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2310000000000001,"5min":1.367,"15min":13.093},"last":1.238}]},{"osd":2,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.504,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.325,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97299999999999998,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.55700000000000005,"15min":0.437},"max":{"1min":1.385,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.272},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.88,"15min":0.95099999999999996},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.121,"5min":3.3700000000000001,"15min":12.981999999999999},"last":1.117}]},{"osd":4,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.026,"15min":1.1399999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.671,"15min":20.548999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.59699999999999998},"max":{"1min":1.46,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.375}]},{"osd":5,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.198,"15min":1.296},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4259999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.1799999999999999,"15min":1.24},"min":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5920000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3899999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1950000000000001,"15min":1.248},"min":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.556,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5369999999999999,"5min":2.472,"15min":5.5359999999999996},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.276,"15min":1.304},"min":{"1min":0.873,"5min":0.80500000000000005,"15min":0.79100000000000004},"max":{"1min":1.702,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.444},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.333},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5880000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.419}]}]},{"osd":0,"up_from":14,"seq":60129542291,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311384,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060456,"statfs":{"total":96636764160,"available":96317906944,"internally_reserved":0,"allocated":1916928,"data_stored":898065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.96799999999999997,"15min":0.83199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.212,"5min":18.442,"15min":18.442},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.91200000000000003,"15min":0.83099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.242,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0700000000000001,"15min":0.94299999999999995},"min":{"1min":0.622,"5min":0.45100000000000001,"15min":0.34999999999999998},"max":{"1min":1.232,"5min":18.481999999999999,"15min":18.481999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.21,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.877,"15min":0.85699999999999998},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.2210000000000001,"5min":1.5840000000000001,"15min":1.613},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.202,"15min":1.0620000000000001},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.45800000000000002},"max":{"1min":1.347,"5min":18.577000000000002,"15min":18.577000000000002},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0800000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.454,"5min":1.728,"15min":1.7609999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.3740000000000001,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5349999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.405,"15min":1.2949999999999999},"min":{"1min":0.78300000000000003,"5min":0.74199999999999999,"15min":0.67700000000000005},"max":{"1min":1.5049999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.175},{"interface":"front","average":{"1min":1.157,"5min":1.218,"15min":1.2410000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.6379999999999999,"5min":1.984,"15min":1.984},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.3049999999999999},"min":{"1min":0.76300000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.466,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.3740000000000001,"15min":1.278},"min":{"1min":0.91400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.401,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.266}]},{"osd":7,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.407,"15min":1.3},"min":{"1min":0.93200000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.4199999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1850000000000001,"15min":1.2130000000000001},"min":{"1min":0.80300000000000005,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.5700000000000001,"5min":1.786,"15min":2.0750000000000002},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1921024,"data_stored":897797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.52200000000000002,"15min":0.38300000000000001},"max":{"1min":1.2290000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.53},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.0609999999999999},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":1.8169999999999999,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":1.6299999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2450000000000001,"15min":1.222},"min":{"1min":0.751,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.304,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.2,"15min":1.228},"min":{"1min":0.77900000000000003,"5min":0.65100000000000002,"15min":0.48099999999999998},"max":{"1min":1.385,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1419999999999999,"15min":1.228},"min":{"1min":0.66100000000000003,"5min":0.58399999999999996,"15min":0.47399999999999998},"max":{"1min":1.357,"5min":6.6500000000000004,"15min":18.431000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.095,"15min":1.323},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.36699999999999999},"max":{"1min":1.1850000000000001,"5min":1.738,"15min":36.531999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.111,"15min":1.1240000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.8600000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.2210000000000001,"15min":1.3939999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.4650000000000001,"5min":6.6920000000000002,"15min":36.530000000000001},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.222,"15min":1.2410000000000001},"min":{"1min":0.89100000000000001,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.3799999999999999,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.254,"15min":1.2909999999999999},"min":{"1min":0.85499999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.4990000000000001,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.323}]},{"osd":6,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.288,"15min":1.3380000000000001},"min":{"1min":0.69299999999999995,"5min":0.60099999999999998,"15min":0.44700000000000001},"max":{"1min":1.546,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3069999999999999,"15min":1.3879999999999999},"min":{"1min":0.91400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.496,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.276}]},{"osd":7,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.196,"15min":1.27},"min":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.506,"5min":3.645,"15min":3.645},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.333,"15min":1.405},"min":{"1min":0.84599999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.7210000000000001,"5min":6.7430000000000003,"15min":8.327},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:14:47.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:14:47.255 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:14:47.262 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:14:47.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.318+0000 7f5749969700 1 Processor -- start 2023-08-17T00:14:47.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5749969700 1 -- start start 2023-08-17T00:14:47.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5749969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f57440640b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5749969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5744153ed0 0x7f57440bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5749969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57440bdfe0 con 0x7f57440bd400 2023-08-17T00:14:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5749969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5744063c20 con 0x7f5744153ed0 2023-08-17T00:14:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5749969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5744063010 con 0x7f5744153af0 2023-08-17T00:14:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f57437fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f57440bd400 0x7f5744066cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37858/0 (socket says 172.21.15.153:37858) 2023-08-17T00:14:47.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f57437fe700 1 -- 172.21.15.153:0/1218979357 learned_addr learned my addr 172.21.15.153:0/1218979357 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:47.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f573bfff700 1 --2- 172.21.15.153:0/1218979357 >> v2:172.21.15.178:3300/0 conn(0x7f5744153ed0 0x7f57440bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5742ffd700 1 --2- 172.21.15.153:0/1218979357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f57440640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f57427fc700 1 -- 172.21.15.153:0/1218979357 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59779061 0 0) 0x7f57440bdfe0 con 0x7f57440bd400 2023-08-17T00:14:47.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f57427fc700 1 -- 172.21.15.153:0/1218979357 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57300033f0 con 0x7f57440bd400 2023-08-17T00:14:47.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5742ffd700 1 -- 172.21.15.153:0/1218979357 >> v2:172.21.15.178:3300/0 conn(0x7f5744153ed0 msgr2=0x7f57440bcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:47.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5742ffd700 1 --2- 172.21.15.153:0/1218979357 >> v2:172.21.15.178:3300/0 conn(0x7f5744153ed0 0x7f57440bcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5742ffd700 1 -- 172.21.15.153:0/1218979357 >> v1:172.21.15.153:6789/0 conn(0x7f57440bd400 legacy=0x7f5744066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f57427fc700 1 -- 172.21.15.153:0/1218979357 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 606540181 0 0) 0x7f57300033f0 con 0x7f57440bd400 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f5742ffd700 1 -- 172.21.15.153:0/1218979357 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57440632f0 con 0x7f5744153af0 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.322+0000 7f573bfff700 1 --2- 172.21.15.153:0/1218979357 >> v2:172.21.15.178:3300/0 conn(0x7f5744153ed0 0x7f57440bcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5742ffd700 1 --2- 172.21.15.153:0/1218979357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f57440640b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f5734009760 tx=0x7f5734009060).ready entity=mon.2 client_cookie=a07bf774d378d6fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f57427fc700 1 -- 172.21.15.153:0/1218979357 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340090d0 con 0x7f5744153af0 2023-08-17T00:14:47.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f57427fc700 1 -- 172.21.15.153:0/1218979357 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573400d4a0 con 0x7f5744153af0 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f57427fc700 1 -- 172.21.15.153:0/1218979357 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573400d820 con 0x7f5744153af0 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 -- 172.21.15.153:0/1218979357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 msgr2=0x7f57440640b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 --2- 172.21.15.153:0/1218979357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f57440640b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f5734009760 tx=0x7f5734009060).stop 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 -- 172.21.15.153:0/1218979357 shutdown_connections 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 --2- 172.21.15.153:0/1218979357 >> v2:172.21.15.178:3300/0 conn(0x7f5744153ed0 0x7f57440bcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 --2- 172.21.15.153:0/1218979357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f57440640b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 -- 172.21.15.153:0/1218979357 >> 172.21.15.153:0/1218979357 conn(0x7f5744069750 msgr2=0x7f5744069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 -- 172.21.15.153:0/1218979357 shutdown_connections 2023-08-17T00:14:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.326+0000 7f5749969700 1 -- 172.21.15.153:0/1218979357 wait complete. 2023-08-17T00:14:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 Processor -- start 2023-08-17T00:14:47.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 -- start start 2023-08-17T00:14:47.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57440bd400 0x7f5744168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f5744157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 0x7f574414c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5744157c60 con 0x7f57440be670 2023-08-17T00:14:47.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57440c06a0 con 0x7f57440bd400 2023-08-17T00:14:47.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5749969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57440a4050 con 0x7f5744153af0 2023-08-17T00:14:47.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f57437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 0x7f574414c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5742ffd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57440bd400 0x7f5744168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f57437fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 0x7f574414c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55056/0 (socket says 172.21.15.153:55056) 2023-08-17T00:14:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f57437fe700 1 -- 172.21.15.153:0/465155529 learned_addr learned my addr 172.21.15.153:0/465155529 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f5742ffd700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57440bd400 0x7f5744168050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:41878/0 (socket says 172.21.15.153:41878) 2023-08-17T00:14:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.330+0000 7f573bfff700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f5744157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f57437fe700 1 -- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 msgr2=0x7f5744157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f57437fe700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f5744157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f57437fe700 1 -- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57440bd400 msgr2=0x7f5744168050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f57437fe700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57440bd400 0x7f5744168050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f57437fe700 1 -- 172.21.15.153:0/465155529 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0092a0 con 0x7f57440be670 2023-08-17T00:14:47.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f57437fe700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 0x7f574414c5a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f573c00c7e0 tx=0x7f573c007f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:47.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c004c40 con 0x7f57440be670 2023-08-17T00:14:47.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573c004da0 con 0x7f57440be670 2023-08-17T00:14:47.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573c007380 con 0x7f57440be670 2023-08-17T00:14:47.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57340092a0 con 0x7f57440be670 2023-08-17T00:14:47.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57440a3d70 con 0x7f57440be670 2023-08-17T00:14:47.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.334+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57440c0830 con 0x7f57440be670 2023-08-17T00:14:47.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.338+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f573c007770 con 0x7f57440be670 2023-08-17T00:14:47.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.338+0000 7f573affd700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f572405a150 0x7f572405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.338+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f573c073dd0 con 0x7f57440be670 2023-08-17T00:14:47.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.338+0000 7f5742ffd700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f572405a150 0x7f572405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.338+0000 7f5742ffd700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f572405a150 0x7f572405c610 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f573400d260 tx=0x7f5734016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:47.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.342+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f573c078070 con 0x7f57440be670 2023-08-17T00:14:47.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.502+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f574406b4c0 con 0x7f572405a150 2023-08-17T00:14:47.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.518+0000 7f573affd700 1 -- 172.21.15.153:0/465155529 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359617 (secure 0 0 0) 0x7f574406b4c0 con 0x7f572405a150 2023-08-17T00:14:47.527 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:47.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f572405a150 msgr2=0x7f572405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f572405a150 0x7f572405c610 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f573400d260 tx=0x7f5734016000).stop 2023-08-17T00:14:47.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 msgr2=0x7f574414c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 0x7f574414c5a0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 rx=0x7f573c00c7e0 tx=0x7f573c007f20).stop 2023-08-17T00:14:47.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 shutdown_connections 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f572405a150 0x7f572405c610 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57440be670 0x7f574414c5a0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5744153af0 0x7f5744157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 --2- 172.21.15.153:0/465155529 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57440bd400 0x7f5744168050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 >> 172.21.15.153:0/465155529 conn(0x7f5744069750 msgr2=0x7f57440c5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 shutdown_connections 2023-08-17T00:14:47.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.530+0000 7f5749969700 1 -- 172.21.15.153:0/465155529 wait complete. 2023-08-17T00:14:47.535 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:14:47.555 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2023-08-17T00:14:47.447221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":132,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2474688,"kb_used_data":14976,"kb_used_omap":0,"kb_used_meta":2459648,"kb_avail":752500032,"statfs":{"total":773094113280,"available":770560032768,"internally_reserved":0,"allocated":15335424,"data_stored":7181724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2518679552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1078616967,"num_objects":-1063,"num_object_clones":0,"num_object_copies":-2126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1063,"num_whiteouts":0,"num_read":-51,"num_read_kb":-2216,"num_write":-6355,"num_write_kb":-1055504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-40,"num_bytes_recovered":-41943040,"num_keys_recovered":0,"num_objects_omap":-35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.925149"},"pg_stats":[{"pgid":"22.3c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918923+0000","last_change":"2023-08-17T00:14:42.918923+0000","last_active":"2023-08-17T00:14:42.918923+0000","last_peered":"2023-08-17T00:14:42.918923+0000","last_clean":"2023-08-17T00:14:42.918923+0000","last_became_active":"2023-08-17T00:14:42.918651+0000","last_became_peered":"2023-08-17T00:14:42.918651+0000","last_unstale":"2023-08-17T00:14:42.918923+0000","last_undegraded":"2023-08-17T00:14:42.918923+0000","last_fullsized":"2023-08-17T00:14:42.918923+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3f","version":"153'3","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915744+0000","last_change":"2023-08-17T00:14:42.465523+0000","last_active":"2023-08-17T00:14:42.915744+0000","last_peered":"2023-08-17T00:14:42.915744+0000","last_clean":"2023-08-17T00:14:42.915744+0000","last_became_active":"2023-08-17T00:14:42.465198+0000","last_became_peered":"2023-08-17T00:14:42.465198+0000","last_unstale":"2023-08-17T00:14:42.915744+0000","last_undegraded":"2023-08-17T00:14:42.915744+0000","last_fullsized":"2023-08-17T00:14:42.915744+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918863+0000","last_change":"2023-08-17T00:14:42.918863+0000","last_active":"2023-08-17T00:14:42.918863+0000","last_peered":"2023-08-17T00:14:42.918863+0000","last_clean":"2023-08-17T00:14:42.918863+0000","last_became_active":"2023-08-17T00:14:42.918353+0000","last_became_peered":"2023-08-17T00:14:42.918353+0000","last_unstale":"2023-08-17T00:14:42.918863+0000","last_undegraded":"2023-08-17T00:14:42.918863+0000","last_fullsized":"2023-08-17T00:14:42.918863+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.899014+0000","last_change":"2023-08-17T00:14:42.469099+0000","last_active":"2023-08-17T00:14:42.899014+0000","last_peered":"2023-08-17T00:14:42.899014+0000","last_clean":"2023-08-17T00:14:42.899014+0000","last_became_active":"2023-08-17T00:14:42.468809+0000","last_became_peered":"2023-08-17T00:14:42.468809+0000","last_unstale":"2023-08-17T00:14:42.899014+0000","last_undegraded":"2023-08-17T00:14:42.899014+0000","last_fullsized":"2023-08-17T00:14:42.899014+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918912+0000","last_change":"2023-08-17T00:14:42.914040+0000","last_active":"2023-08-17T00:14:42.918912+0000","last_peered":"2023-08-17T00:14:42.918912+0000","last_clean":"2023-08-17T00:14:42.918912+0000","last_became_active":"2023-08-17T00:14:42.913445+0000","last_became_peered":"2023-08-17T00:14:42.913445+0000","last_unstale":"2023-08-17T00:14:42.918912+0000","last_undegraded":"2023-08-17T00:14:42.918912+0000","last_fullsized":"2023-08-17T00:14:42.918912+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.473643+0000","last_change":"2023-08-17T00:14:42.470537+0000","last_active":"2023-08-17T00:14:42.473643+0000","last_peered":"2023-08-17T00:14:42.473643+0000","last_clean":"2023-08-17T00:14:42.473643+0000","last_became_active":"2023-08-17T00:14:42.470123+0000","last_became_peered":"2023-08-17T00:14:42.470123+0000","last_unstale":"2023-08-17T00:14:42.473643+0000","last_undegraded":"2023-08-17T00:14:42.473643+0000","last_fullsized":"2023-08-17T00:14:42.473643+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914511+0000","last_change":"2023-08-17T00:14:42.914511+0000","last_active":"2023-08-17T00:14:42.914511+0000","last_peered":"2023-08-17T00:14:42.914511+0000","last_clean":"2023-08-17T00:14:42.914511+0000","last_became_active":"2023-08-17T00:14:42.914251+0000","last_became_peered":"2023-08-17T00:14:42.914251+0000","last_unstale":"2023-08-17T00:14:42.914511+0000","last_undegraded":"2023-08-17T00:14:42.914511+0000","last_fullsized":"2023-08-17T00:14:42.914511+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.932487+0000","last_change":"2023-08-17T00:14:42.474785+0000","last_active":"2023-08-17T00:14:42.932487+0000","last_peered":"2023-08-17T00:14:42.932487+0000","last_clean":"2023-08-17T00:14:42.932487+0000","last_became_active":"2023-08-17T00:14:42.474493+0000","last_became_peered":"2023-08-17T00:14:42.474493+0000","last_unstale":"2023-08-17T00:14:42.932487+0000","last_undegraded":"2023-08-17T00:14:42.932487+0000","last_fullsized":"2023-08-17T00:14:42.932487+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.910943+0000","last_change":"2023-08-17T00:14:42.910943+0000","last_active":"2023-08-17T00:14:42.910943+0000","last_peered":"2023-08-17T00:14:42.910943+0000","last_clean":"2023-08-17T00:14:42.910943+0000","last_became_active":"2023-08-17T00:14:42.910662+0000","last_became_peered":"2023-08-17T00:14:42.910662+0000","last_unstale":"2023-08-17T00:14:42.910943+0000","last_undegraded":"2023-08-17T00:14:42.910943+0000","last_fullsized":"2023-08-17T00:14:42.910943+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3b","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903739+0000","last_change":"2023-08-17T00:14:42.479642+0000","last_active":"2023-08-17T00:14:42.903739+0000","last_peered":"2023-08-17T00:14:42.903739+0000","last_clean":"2023-08-17T00:14:42.903739+0000","last_became_active":"2023-08-17T00:14:42.479379+0000","last_became_peered":"2023-08-17T00:14:42.479379+0000","last_unstale":"2023-08-17T00:14:42.903739+0000","last_undegraded":"2023-08-17T00:14:42.903739+0000","last_fullsized":"2023-08-17T00:14:42.903739+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.902649+0000","last_change":"2023-08-17T00:14:42.902649+0000","last_active":"2023-08-17T00:14:42.902649+0000","last_peered":"2023-08-17T00:14:42.902649+0000","last_clean":"2023-08-17T00:14:42.902649+0000","last_became_active":"2023-08-17T00:14:42.902396+0000","last_became_peered":"2023-08-17T00:14:42.902396+0000","last_unstale":"2023-08-17T00:14:42.902649+0000","last_undegraded":"2023-08-17T00:14:42.902649+0000","last_fullsized":"2023-08-17T00:14:42.902649+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3a","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903701+0000","last_change":"2023-08-17T00:14:42.473956+0000","last_active":"2023-08-17T00:14:42.903701+0000","last_peered":"2023-08-17T00:14:42.903701+0000","last_clean":"2023-08-17T00:14:42.903701+0000","last_became_active":"2023-08-17T00:14:42.473638+0000","last_became_peered":"2023-08-17T00:14:42.473638+0000","last_unstale":"2023-08-17T00:14:42.903701+0000","last_undegraded":"2023-08-17T00:14:42.903701+0000","last_fullsized":"2023-08-17T00:14:42.903701+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914692+0000","last_change":"2023-08-17T00:14:42.914692+0000","last_active":"2023-08-17T00:14:42.914692+0000","last_peered":"2023-08-17T00:14:42.914692+0000","last_clean":"2023-08-17T00:14:42.914692+0000","last_became_active":"2023-08-17T00:14:42.914370+0000","last_became_peered":"2023-08-17T00:14:42.914370+0000","last_unstale":"2023-08-17T00:14:42.914692+0000","last_undegraded":"2023-08-17T00:14:42.914692+0000","last_fullsized":"2023-08-17T00:14:42.914692+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.907756+0000","last_change":"2023-08-17T00:14:42.466640+0000","last_active":"2023-08-17T00:14:42.907756+0000","last_peered":"2023-08-17T00:14:42.907756+0000","last_clean":"2023-08-17T00:14:42.907756+0000","last_became_active":"2023-08-17T00:14:42.466356+0000","last_became_peered":"2023-08-17T00:14:42.466356+0000","last_unstale":"2023-08-17T00:14:42.907756+0000","last_undegraded":"2023-08-17T00:14:42.907756+0000","last_fullsized":"2023-08-17T00:14:42.907756+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916251+0000","last_change":"2023-08-17T00:14:42.907452+0000","last_active":"2023-08-17T00:14:42.916251+0000","last_peered":"2023-08-17T00:14:42.916251+0000","last_clean":"2023-08-17T00:14:42.916251+0000","last_became_active":"2023-08-17T00:14:42.907137+0000","last_became_peered":"2023-08-17T00:14:42.907137+0000","last_unstale":"2023-08-17T00:14:42.916251+0000","last_undegraded":"2023-08-17T00:14:42.916251+0000","last_fullsized":"2023-08-17T00:14:42.916251+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.470087+0000","last_change":"2023-08-17T00:14:42.463708+0000","last_active":"2023-08-17T00:14:42.470087+0000","last_peered":"2023-08-17T00:14:42.470087+0000","last_clean":"2023-08-17T00:14:42.470087+0000","last_became_active":"2023-08-17T00:14:42.463429+0000","last_became_peered":"2023-08-17T00:14:42.463429+0000","last_unstale":"2023-08-17T00:14:42.470087+0000","last_undegraded":"2023-08-17T00:14:42.470087+0000","last_fullsized":"2023-08-17T00:14:42.470087+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.919392+0000","last_change":"2023-08-17T00:14:42.913743+0000","last_active":"2023-08-17T00:14:42.919392+0000","last_peered":"2023-08-17T00:14:42.919392+0000","last_clean":"2023-08-17T00:14:42.919392+0000","last_became_active":"2023-08-17T00:14:42.911926+0000","last_became_peered":"2023-08-17T00:14:42.911926+0000","last_unstale":"2023-08-17T00:14:42.919392+0000","last_undegraded":"2023-08-17T00:14:42.919392+0000","last_fullsized":"2023-08-17T00:14:42.919392+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.471932+0000","last_change":"2023-08-17T00:14:42.469274+0000","last_active":"2023-08-17T00:14:42.471932+0000","last_peered":"2023-08-17T00:14:42.471932+0000","last_clean":"2023-08-17T00:14:42.471932+0000","last_became_active":"2023-08-17T00:14:42.469014+0000","last_became_peered":"2023-08-17T00:14:42.469014+0000","last_unstale":"2023-08-17T00:14:42.471932+0000","last_undegraded":"2023-08-17T00:14:42.471932+0000","last_fullsized":"2023-08-17T00:14:42.471932+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925065+0000","last_change":"2023-08-17T00:14:42.922855+0000","last_active":"2023-08-17T00:14:42.925065+0000","last_peered":"2023-08-17T00:14:42.925065+0000","last_clean":"2023-08-17T00:14:42.925065+0000","last_became_active":"2023-08-17T00:14:42.922560+0000","last_became_peered":"2023-08-17T00:14:42.922560+0000","last_unstale":"2023-08-17T00:14:42.925065+0000","last_undegraded":"2023-08-17T00:14:42.925065+0000","last_fullsized":"2023-08-17T00:14:42.925065+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.480910+0000","last_change":"2023-08-17T00:14:42.476679+0000","last_active":"2023-08-17T00:14:42.480910+0000","last_peered":"2023-08-17T00:14:42.480910+0000","last_clean":"2023-08-17T00:14:42.480910+0000","last_became_active":"2023-08-17T00:14:42.476412+0000","last_became_peered":"2023-08-17T00:14:42.476412+0000","last_unstale":"2023-08-17T00:14:42.480910+0000","last_undegraded":"2023-08-17T00:14:42.480910+0000","last_fullsized":"2023-08-17T00:14:42.480910+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.921132+0000","last_change":"2023-08-17T00:14:42.921132+0000","last_active":"2023-08-17T00:14:42.921132+0000","last_peered":"2023-08-17T00:14:42.921132+0000","last_clean":"2023-08-17T00:14:42.921132+0000","last_became_active":"2023-08-17T00:14:42.920827+0000","last_became_peered":"2023-08-17T00:14:42.920827+0000","last_unstale":"2023-08-17T00:14:42.921132+0000","last_undegraded":"2023-08-17T00:14:42.921132+0000","last_fullsized":"2023-08-17T00:14:42.921132+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.472083+0000","last_change":"2023-08-17T00:14:42.468036+0000","last_active":"2023-08-17T00:14:42.472083+0000","last_peered":"2023-08-17T00:14:42.472083+0000","last_clean":"2023-08-17T00:14:42.472083+0000","last_became_active":"2023-08-17T00:14:42.466542+0000","last_became_peered":"2023-08-17T00:14:42.466542+0000","last_unstale":"2023-08-17T00:14:42.472083+0000","last_undegraded":"2023-08-17T00:14:42.472083+0000","last_fullsized":"2023-08-17T00:14:42.472083+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918880+0000","last_change":"2023-08-17T00:14:42.913196+0000","last_active":"2023-08-17T00:14:42.918880+0000","last_peered":"2023-08-17T00:14:42.918880+0000","last_clean":"2023-08-17T00:14:42.918880+0000","last_became_active":"2023-08-17T00:14:42.912734+0000","last_became_peered":"2023-08-17T00:14:42.912734+0000","last_unstale":"2023-08-17T00:14:42.918880+0000","last_undegraded":"2023-08-17T00:14:42.918880+0000","last_fullsized":"2023-08-17T00:14:42.918880+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.34","version":"153'4","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.933154+0000","last_change":"2023-08-17T00:14:42.468435+0000","last_active":"2023-08-17T00:14:42.933154+0000","last_peered":"2023-08-17T00:14:42.933154+0000","last_clean":"2023-08-17T00:14:42.933154+0000","last_became_active":"2023-08-17T00:14:42.468149+0000","last_became_peered":"2023-08-17T00:14:42.468149+0000","last_unstale":"2023-08-17T00:14:42.933154+0000","last_undegraded":"2023-08-17T00:14:42.933154+0000","last_fullsized":"2023-08-17T00:14:42.933154+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924089+0000","last_change":"2023-08-17T00:14:42.916528+0000","last_active":"2023-08-17T00:14:42.924089+0000","last_peered":"2023-08-17T00:14:42.924089+0000","last_clean":"2023-08-17T00:14:42.924089+0000","last_became_active":"2023-08-17T00:14:42.916228+0000","last_became_peered":"2023-08-17T00:14:42.916228+0000","last_unstale":"2023-08-17T00:14:42.924089+0000","last_undegraded":"2023-08-17T00:14:42.924089+0000","last_fullsized":"2023-08-17T00:14:42.924089+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.33","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903831+0000","last_change":"2023-08-17T00:14:42.467499+0000","last_active":"2023-08-17T00:14:42.903831+0000","last_peered":"2023-08-17T00:14:42.903831+0000","last_clean":"2023-08-17T00:14:42.903831+0000","last_became_active":"2023-08-17T00:14:42.467095+0000","last_became_peered":"2023-08-17T00:14:42.467095+0000","last_unstale":"2023-08-17T00:14:42.903831+0000","last_undegraded":"2023-08-17T00:14:42.903831+0000","last_fullsized":"2023-08-17T00:14:42.903831+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927934+0000","last_change":"2023-08-17T00:14:42.925931+0000","last_active":"2023-08-17T00:14:42.927934+0000","last_peered":"2023-08-17T00:14:42.927934+0000","last_clean":"2023-08-17T00:14:42.927934+0000","last_became_active":"2023-08-17T00:14:42.925378+0000","last_became_peered":"2023-08-17T00:14:42.925378+0000","last_unstale":"2023-08-17T00:14:42.927934+0000","last_undegraded":"2023-08-17T00:14:42.927934+0000","last_fullsized":"2023-08-17T00:14:42.927934+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896712+0000","last_change":"2023-08-17T00:14:42.473724+0000","last_active":"2023-08-17T00:14:42.896712+0000","last_peered":"2023-08-17T00:14:42.896712+0000","last_clean":"2023-08-17T00:14:42.896712+0000","last_became_active":"2023-08-17T00:14:42.470704+0000","last_became_peered":"2023-08-17T00:14:42.470704+0000","last_unstale":"2023-08-17T00:14:42.896712+0000","last_undegraded":"2023-08-17T00:14:42.896712+0000","last_fullsized":"2023-08-17T00:14:42.896712+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925141+0000","last_change":"2023-08-17T00:14:42.925141+0000","last_active":"2023-08-17T00:14:42.925141+0000","last_peered":"2023-08-17T00:14:42.925141+0000","last_clean":"2023-08-17T00:14:42.925141+0000","last_became_active":"2023-08-17T00:14:42.924855+0000","last_became_peered":"2023-08-17T00:14:42.924855+0000","last_unstale":"2023-08-17T00:14:42.925141+0000","last_undegraded":"2023-08-17T00:14:42.925141+0000","last_fullsized":"2023-08-17T00:14:42.925141+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.463669+0000","last_change":"2023-08-17T00:14:42.458061+0000","last_active":"2023-08-17T00:14:42.463669+0000","last_peered":"2023-08-17T00:14:42.463669+0000","last_clean":"2023-08-17T00:14:42.463669+0000","last_became_active":"2023-08-17T00:14:42.457761+0000","last_became_peered":"2023-08-17T00:14:42.457761+0000","last_unstale":"2023-08-17T00:14:42.463669+0000","last_undegraded":"2023-08-17T00:14:42.463669+0000","last_fullsized":"2023-08-17T00:14:42.463669+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915906+0000","last_change":"2023-08-17T00:14:42.902016+0000","last_active":"2023-08-17T00:14:42.915906+0000","last_peered":"2023-08-17T00:14:42.915906+0000","last_clean":"2023-08-17T00:14:42.915906+0000","last_became_active":"2023-08-17T00:14:42.901676+0000","last_became_peered":"2023-08-17T00:14:42.901676+0000","last_unstale":"2023-08-17T00:14:42.915906+0000","last_undegraded":"2023-08-17T00:14:42.915906+0000","last_fullsized":"2023-08-17T00:14:42.915906+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"153'4","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924360+0000","last_change":"2023-08-17T00:14:42.461934+0000","last_active":"2023-08-17T00:14:42.924360+0000","last_peered":"2023-08-17T00:14:42.924360+0000","last_clean":"2023-08-17T00:14:42.924360+0000","last_became_active":"2023-08-17T00:14:42.461485+0000","last_became_peered":"2023-08-17T00:14:42.461485+0000","last_unstale":"2023-08-17T00:14:42.924360+0000","last_undegraded":"2023-08-17T00:14:42.924360+0000","last_fullsized":"2023-08-17T00:14:42.924360+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926769+0000","last_change":"2023-08-17T00:14:42.923583+0000","last_active":"2023-08-17T00:14:42.926769+0000","last_peered":"2023-08-17T00:14:42.926769+0000","last_clean":"2023-08-17T00:14:42.926769+0000","last_became_active":"2023-08-17T00:14:42.922371+0000","last_became_peered":"2023-08-17T00:14:42.922371+0000","last_unstale":"2023-08-17T00:14:42.926769+0000","last_undegraded":"2023-08-17T00:14:42.926769+0000","last_fullsized":"2023-08-17T00:14:42.926769+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483362+0000","last_change":"2023-08-17T00:14:42.479157+0000","last_active":"2023-08-17T00:14:42.483362+0000","last_peered":"2023-08-17T00:14:42.483362+0000","last_clean":"2023-08-17T00:14:42.483362+0000","last_became_active":"2023-08-17T00:14:42.478501+0000","last_became_peered":"2023-08-17T00:14:42.478501+0000","last_unstale":"2023-08-17T00:14:42.483362+0000","last_undegraded":"2023-08-17T00:14:42.483362+0000","last_fullsized":"2023-08-17T00:14:42.483362+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917439+0000","last_change":"2023-08-17T00:14:42.917439+0000","last_active":"2023-08-17T00:14:42.917439+0000","last_peered":"2023-08-17T00:14:42.917439+0000","last_clean":"2023-08-17T00:14:42.917439+0000","last_became_active":"2023-08-17T00:14:42.917131+0000","last_became_peered":"2023-08-17T00:14:42.917131+0000","last_unstale":"2023-08-17T00:14:42.917439+0000","last_undegraded":"2023-08-17T00:14:42.917439+0000","last_fullsized":"2023-08-17T00:14:42.917439+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.475439+0000","last_change":"2023-08-17T00:14:42.467845+0000","last_active":"2023-08-17T00:14:42.475439+0000","last_peered":"2023-08-17T00:14:42.475439+0000","last_clean":"2023-08-17T00:14:42.475439+0000","last_became_active":"2023-08-17T00:14:42.466851+0000","last_became_peered":"2023-08-17T00:14:42.466851+0000","last_unstale":"2023-08-17T00:14:42.475439+0000","last_undegraded":"2023-08-17T00:14:42.475439+0000","last_fullsized":"2023-08-17T00:14:42.475439+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918930+0000","last_change":"2023-08-17T00:14:42.914227+0000","last_active":"2023-08-17T00:14:42.918930+0000","last_peered":"2023-08-17T00:14:42.918930+0000","last_clean":"2023-08-17T00:14:42.918930+0000","last_became_active":"2023-08-17T00:14:42.913730+0000","last_became_peered":"2023-08-17T00:14:42.913730+0000","last_unstale":"2023-08-17T00:14:42.918930+0000","last_undegraded":"2023-08-17T00:14:42.918930+0000","last_fullsized":"2023-08-17T00:14:42.918930+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2d","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.895533+0000","last_change":"2023-08-17T00:14:42.467713+0000","last_active":"2023-08-17T00:14:42.895533+0000","last_peered":"2023-08-17T00:14:42.895533+0000","last_clean":"2023-08-17T00:14:42.895533+0000","last_became_active":"2023-08-17T00:14:42.467391+0000","last_became_peered":"2023-08-17T00:14:42.467391+0000","last_unstale":"2023-08-17T00:14:42.895533+0000","last_undegraded":"2023-08-17T00:14:42.895533+0000","last_fullsized":"2023-08-17T00:14:42.895533+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.928919+0000","last_change":"2023-08-17T00:14:42.919996+0000","last_active":"2023-08-17T00:14:42.928919+0000","last_peered":"2023-08-17T00:14:42.928919+0000","last_clean":"2023-08-17T00:14:42.928919+0000","last_became_active":"2023-08-17T00:14:42.919730+0000","last_became_peered":"2023-08-17T00:14:42.919730+0000","last_unstale":"2023-08-17T00:14:42.928919+0000","last_undegraded":"2023-08-17T00:14:42.928919+0000","last_fullsized":"2023-08-17T00:14:42.928919+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.474827+0000","last_change":"2023-08-17T00:14:42.472036+0000","last_active":"2023-08-17T00:14:42.474827+0000","last_peered":"2023-08-17T00:14:42.474827+0000","last_clean":"2023-08-17T00:14:42.474827+0000","last_became_active":"2023-08-17T00:14:42.471736+0000","last_became_peered":"2023-08-17T00:14:42.471736+0000","last_unstale":"2023-08-17T00:14:42.474827+0000","last_undegraded":"2023-08-17T00:14:42.474827+0000","last_fullsized":"2023-08-17T00:14:42.474827+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917440+0000","last_change":"2023-08-17T00:14:42.917440+0000","last_active":"2023-08-17T00:14:42.917440+0000","last_peered":"2023-08-17T00:14:42.917440+0000","last_clean":"2023-08-17T00:14:42.917440+0000","last_became_active":"2023-08-17T00:14:42.917104+0000","last_became_peered":"2023-08-17T00:14:42.917104+0000","last_unstale":"2023-08-17T00:14:42.917440+0000","last_undegraded":"2023-08-17T00:14:42.917440+0000","last_fullsized":"2023-08-17T00:14:42.917440+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2b","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.893909+0000","last_change":"2023-08-17T00:14:42.478832+0000","last_active":"2023-08-17T00:14:42.893909+0000","last_peered":"2023-08-17T00:14:42.893909+0000","last_clean":"2023-08-17T00:14:42.893909+0000","last_became_active":"2023-08-17T00:14:42.478497+0000","last_became_peered":"2023-08-17T00:14:42.478497+0000","last_unstale":"2023-08-17T00:14:42.893909+0000","last_undegraded":"2023-08-17T00:14:42.893909+0000","last_fullsized":"2023-08-17T00:14:42.893909+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914816+0000","last_change":"2023-08-17T00:14:42.914816+0000","last_active":"2023-08-17T00:14:42.914816+0000","last_peered":"2023-08-17T00:14:42.914816+0000","last_clean":"2023-08-17T00:14:42.914816+0000","last_became_active":"2023-08-17T00:14:42.914543+0000","last_became_peered":"2023-08-17T00:14:42.914543+0000","last_unstale":"2023-08-17T00:14:42.914816+0000","last_undegraded":"2023-08-17T00:14:42.914816+0000","last_fullsized":"2023-08-17T00:14:42.914816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896856+0000","last_change":"2023-08-17T00:14:42.459504+0000","last_active":"2023-08-17T00:14:42.896856+0000","last_peered":"2023-08-17T00:14:42.896856+0000","last_clean":"2023-08-17T00:14:42.896856+0000","last_became_active":"2023-08-17T00:14:42.459198+0000","last_became_peered":"2023-08-17T00:14:42.459198+0000","last_unstale":"2023-08-17T00:14:42.896856+0000","last_undegraded":"2023-08-17T00:14:42.896856+0000","last_fullsized":"2023-08-17T00:14:42.896856+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.923475+0000","last_change":"2023-08-17T00:14:42.923475+0000","last_active":"2023-08-17T00:14:42.923475+0000","last_peered":"2023-08-17T00:14:42.923475+0000","last_clean":"2023-08-17T00:14:42.923475+0000","last_became_active":"2023-08-17T00:14:42.923174+0000","last_became_peered":"2023-08-17T00:14:42.923174+0000","last_unstale":"2023-08-17T00:14:42.923475+0000","last_undegraded":"2023-08-17T00:14:42.923475+0000","last_fullsized":"2023-08-17T00:14:42.923475+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483572+0000","last_change":"2023-08-17T00:14:42.469822+0000","last_active":"2023-08-17T00:14:42.483572+0000","last_peered":"2023-08-17T00:14:42.483572+0000","last_clean":"2023-08-17T00:14:42.483572+0000","last_became_active":"2023-08-17T00:14:42.469233+0000","last_became_peered":"2023-08-17T00:14:42.469233+0000","last_unstale":"2023-08-17T00:14:42.483572+0000","last_undegraded":"2023-08-17T00:14:42.483572+0000","last_fullsized":"2023-08-17T00:14:42.483572+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927962+0000","last_change":"2023-08-17T00:14:42.926222+0000","last_active":"2023-08-17T00:14:42.927962+0000","last_peered":"2023-08-17T00:14:42.927962+0000","last_clean":"2023-08-17T00:14:42.927962+0000","last_became_active":"2023-08-17T00:14:42.924781+0000","last_became_peered":"2023-08-17T00:14:42.924781+0000","last_unstale":"2023-08-17T00:14:42.927962+0000","last_undegraded":"2023-08-17T00:14:42.927962+0000","last_fullsized":"2023-08-17T00:14:42.927962+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.475463+0000","last_change":"2023-08-17T00:14:42.469077+0000","last_active":"2023-08-17T00:14:42.475463+0000","last_peered":"2023-08-17T00:14:42.475463+0000","last_clean":"2023-08-17T00:14:42.475463+0000","last_became_active":"2023-08-17T00:14:42.468774+0000","last_became_peered":"2023-08-17T00:14:42.468774+0000","last_unstale":"2023-08-17T00:14:42.475463+0000","last_undegraded":"2023-08-17T00:14:42.475463+0000","last_fullsized":"2023-08-17T00:14:42.475463+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926486+0000","last_change":"2023-08-17T00:14:42.925111+0000","last_active":"2023-08-17T00:14:42.926486+0000","last_peered":"2023-08-17T00:14:42.926486+0000","last_clean":"2023-08-17T00:14:42.926486+0000","last_became_active":"2023-08-17T00:14:42.924700+0000","last_became_peered":"2023-08-17T00:14:42.924700+0000","last_unstale":"2023-08-17T00:14:42.926486+0000","last_undegraded":"2023-08-17T00:14:42.926486+0000","last_fullsized":"2023-08-17T00:14:42.926486+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.899077+0000","last_change":"2023-08-17T00:14:42.474230+0000","last_active":"2023-08-17T00:14:42.899077+0000","last_peered":"2023-08-17T00:14:42.899077+0000","last_clean":"2023-08-17T00:14:42.899077+0000","last_became_active":"2023-08-17T00:14:42.473900+0000","last_became_peered":"2023-08-17T00:14:42.473900+0000","last_unstale":"2023-08-17T00:14:42.899077+0000","last_undegraded":"2023-08-17T00:14:42.899077+0000","last_fullsized":"2023-08-17T00:14:42.899077+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920807+0000","last_change":"2023-08-17T00:14:42.920807+0000","last_active":"2023-08-17T00:14:42.920807+0000","last_peered":"2023-08-17T00:14:42.920807+0000","last_clean":"2023-08-17T00:14:42.920807+0000","last_became_active":"2023-08-17T00:14:42.920497+0000","last_became_peered":"2023-08-17T00:14:42.920497+0000","last_unstale":"2023-08-17T00:14:42.920807+0000","last_undegraded":"2023-08-17T00:14:42.920807+0000","last_fullsized":"2023-08-17T00:14:42.920807+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.474744+0000","last_change":"2023-08-17T00:14:42.471608+0000","last_active":"2023-08-17T00:14:42.474744+0000","last_peered":"2023-08-17T00:14:42.474744+0000","last_clean":"2023-08-17T00:14:42.474744+0000","last_became_active":"2023-08-17T00:14:42.471088+0000","last_became_peered":"2023-08-17T00:14:42.471088+0000","last_unstale":"2023-08-17T00:14:42.474744+0000","last_undegraded":"2023-08-17T00:14:42.474744+0000","last_fullsized":"2023-08-17T00:14:42.474744+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926736+0000","last_change":"2023-08-17T00:14:42.926736+0000","last_active":"2023-08-17T00:14:42.926736+0000","last_peered":"2023-08-17T00:14:42.926736+0000","last_clean":"2023-08-17T00:14:42.926736+0000","last_became_active":"2023-08-17T00:14:42.926458+0000","last_became_peered":"2023-08-17T00:14:42.926458+0000","last_unstale":"2023-08-17T00:14:42.926736+0000","last_undegraded":"2023-08-17T00:14:42.926736+0000","last_fullsized":"2023-08-17T00:14:42.926736+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.898037+0000","last_change":"2023-08-17T00:14:42.474319+0000","last_active":"2023-08-17T00:14:42.898037+0000","last_peered":"2023-08-17T00:14:42.898037+0000","last_clean":"2023-08-17T00:14:42.898037+0000","last_became_active":"2023-08-17T00:14:42.474013+0000","last_became_peered":"2023-08-17T00:14:42.474013+0000","last_unstale":"2023-08-17T00:14:42.898037+0000","last_undegraded":"2023-08-17T00:14:42.898037+0000","last_fullsized":"2023-08-17T00:14:42.898037+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.903331+0000","last_change":"2023-08-17T00:14:42.903331+0000","last_active":"2023-08-17T00:14:42.903331+0000","last_peered":"2023-08-17T00:14:42.903331+0000","last_clean":"2023-08-17T00:14:42.903331+0000","last_became_active":"2023-08-17T00:14:42.903050+0000","last_became_peered":"2023-08-17T00:14:42.903050+0000","last_unstale":"2023-08-17T00:14:42.903331+0000","last_undegraded":"2023-08-17T00:14:42.903331+0000","last_fullsized":"2023-08-17T00:14:42.903331+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.899192+0000","last_change":"2023-08-17T00:14:42.469318+0000","last_active":"2023-08-17T00:14:42.899192+0000","last_peered":"2023-08-17T00:14:42.899192+0000","last_clean":"2023-08-17T00:14:42.899192+0000","last_became_active":"2023-08-17T00:14:42.468997+0000","last_became_peered":"2023-08-17T00:14:42.468997+0000","last_unstale":"2023-08-17T00:14:42.899192+0000","last_undegraded":"2023-08-17T00:14:42.899192+0000","last_fullsized":"2023-08-17T00:14:42.899192+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925338+0000","last_change":"2023-08-17T00:14:42.925338+0000","last_active":"2023-08-17T00:14:42.925338+0000","last_peered":"2023-08-17T00:14:42.925338+0000","last_clean":"2023-08-17T00:14:42.925338+0000","last_became_active":"2023-08-17T00:14:42.925062+0000","last_became_peered":"2023-08-17T00:14:42.925062+0000","last_unstale":"2023-08-17T00:14:42.925338+0000","last_undegraded":"2023-08-17T00:14:42.925338+0000","last_fullsized":"2023-08-17T00:14:42.925338+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.470292+0000","last_change":"2023-08-17T00:14:42.464933+0000","last_active":"2023-08-17T00:14:42.470292+0000","last_peered":"2023-08-17T00:14:42.470292+0000","last_clean":"2023-08-17T00:14:42.470292+0000","last_became_active":"2023-08-17T00:14:42.464495+0000","last_became_peered":"2023-08-17T00:14:42.464495+0000","last_unstale":"2023-08-17T00:14:42.470292+0000","last_undegraded":"2023-08-17T00:14:42.470292+0000","last_fullsized":"2023-08-17T00:14:42.470292+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924116+0000","last_change":"2023-08-17T00:14:42.918124+0000","last_active":"2023-08-17T00:14:42.924116+0000","last_peered":"2023-08-17T00:14:42.924116+0000","last_clean":"2023-08-17T00:14:42.924116+0000","last_became_active":"2023-08-17T00:14:42.917805+0000","last_became_peered":"2023-08-17T00:14:42.917805+0000","last_unstale":"2023-08-17T00:14:42.924116+0000","last_undegraded":"2023-08-17T00:14:42.924116+0000","last_fullsized":"2023-08-17T00:14:42.924116+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896999+0000","last_change":"2023-08-17T00:14:42.459984+0000","last_active":"2023-08-17T00:14:42.896999+0000","last_peered":"2023-08-17T00:14:42.896999+0000","last_clean":"2023-08-17T00:14:42.896999+0000","last_became_active":"2023-08-17T00:14:42.459703+0000","last_became_peered":"2023-08-17T00:14:42.459703+0000","last_unstale":"2023-08-17T00:14:42.896999+0000","last_undegraded":"2023-08-17T00:14:42.896999+0000","last_fullsized":"2023-08-17T00:14:42.896999+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920117+0000","last_change":"2023-08-17T00:14:42.920117+0000","last_active":"2023-08-17T00:14:42.920117+0000","last_peered":"2023-08-17T00:14:42.920117+0000","last_clean":"2023-08-17T00:14:42.920117+0000","last_became_active":"2023-08-17T00:14:42.919847+0000","last_became_peered":"2023-08-17T00:14:42.919847+0000","last_unstale":"2023-08-17T00:14:42.920117+0000","last_undegraded":"2023-08-17T00:14:42.920117+0000","last_fullsized":"2023-08-17T00:14:42.920117+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896514+0000","last_change":"2023-08-17T00:14:42.475486+0000","last_active":"2023-08-17T00:14:42.896514+0000","last_peered":"2023-08-17T00:14:42.896514+0000","last_clean":"2023-08-17T00:14:42.896514+0000","last_became_active":"2023-08-17T00:14:42.475121+0000","last_became_peered":"2023-08-17T00:14:42.475121+0000","last_unstale":"2023-08-17T00:14:42.896514+0000","last_undegraded":"2023-08-17T00:14:42.896514+0000","last_fullsized":"2023-08-17T00:14:42.896514+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917309+0000","last_change":"2023-08-17T00:14:42.917309+0000","last_active":"2023-08-17T00:14:42.917309+0000","last_peered":"2023-08-17T00:14:42.917309+0000","last_clean":"2023-08-17T00:14:42.917309+0000","last_became_active":"2023-08-17T00:14:42.916884+0000","last_became_peered":"2023-08-17T00:14:42.916884+0000","last_unstale":"2023-08-17T00:14:42.917309+0000","last_undegraded":"2023-08-17T00:14:42.917309+0000","last_fullsized":"2023-08-17T00:14:42.917309+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.895677+0000","last_change":"2023-08-17T00:14:42.469704+0000","last_active":"2023-08-17T00:14:42.895677+0000","last_peered":"2023-08-17T00:14:42.895677+0000","last_clean":"2023-08-17T00:14:42.895677+0000","last_became_active":"2023-08-17T00:14:42.469358+0000","last_became_peered":"2023-08-17T00:14:42.469358+0000","last_unstale":"2023-08-17T00:14:42.895677+0000","last_undegraded":"2023-08-17T00:14:42.895677+0000","last_fullsized":"2023-08-17T00:14:42.895677+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926809+0000","last_change":"2023-08-17T00:14:42.923858+0000","last_active":"2023-08-17T00:14:42.926809+0000","last_peered":"2023-08-17T00:14:42.926809+0000","last_clean":"2023-08-17T00:14:42.926809+0000","last_became_active":"2023-08-17T00:14:42.923231+0000","last_became_peered":"2023-08-17T00:14:42.923231+0000","last_unstale":"2023-08-17T00:14:42.926809+0000","last_undegraded":"2023-08-17T00:14:42.926809+0000","last_fullsized":"2023-08-17T00:14:42.926809+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1f","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.923014+0000","last_change":"2023-08-17T00:14:42.455780+0000","last_active":"2023-08-17T00:14:42.923014+0000","last_peered":"2023-08-17T00:14:42.923014+0000","last_clean":"2023-08-17T00:14:42.923014+0000","last_became_active":"2023-08-17T00:14:42.455486+0000","last_became_peered":"2023-08-17T00:14:42.455486+0000","last_unstale":"2023-08-17T00:14:42.923014+0000","last_undegraded":"2023-08-17T00:14:42.923014+0000","last_fullsized":"2023-08-17T00:14:42.923014+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.919604+0000","last_change":"2023-08-17T00:14:42.914370+0000","last_active":"2023-08-17T00:14:42.919604+0000","last_peered":"2023-08-17T00:14:42.919604+0000","last_clean":"2023-08-17T00:14:42.919604+0000","last_became_active":"2023-08-17T00:14:42.914110+0000","last_became_peered":"2023-08-17T00:14:42.914110+0000","last_unstale":"2023-08-17T00:14:42.919604+0000","last_undegraded":"2023-08-17T00:14:42.919604+0000","last_fullsized":"2023-08-17T00:14:42.919604+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.900057+0000","last_change":"2023-08-17T00:14:42.479773+0000","last_active":"2023-08-17T00:14:42.900057+0000","last_peered":"2023-08-17T00:14:42.900057+0000","last_clean":"2023-08-17T00:14:42.900057+0000","last_became_active":"2023-08-17T00:14:42.479507+0000","last_became_peered":"2023-08-17T00:14:42.479507+0000","last_unstale":"2023-08-17T00:14:42.900057+0000","last_undegraded":"2023-08-17T00:14:42.900057+0000","last_fullsized":"2023-08-17T00:14:42.900057+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917373+0000","last_change":"2023-08-17T00:14:42.913324+0000","last_active":"2023-08-17T00:14:42.917373+0000","last_peered":"2023-08-17T00:14:42.917373+0000","last_clean":"2023-08-17T00:14:42.917373+0000","last_became_active":"2023-08-17T00:14:42.912801+0000","last_became_peered":"2023-08-17T00:14:42.912801+0000","last_unstale":"2023-08-17T00:14:42.917373+0000","last_undegraded":"2023-08-17T00:14:42.917373+0000","last_fullsized":"2023-08-17T00:14:42.917373+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1d","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.929857+0000","last_change":"2023-08-17T00:14:42.473359+0000","last_active":"2023-08-17T00:14:42.929857+0000","last_peered":"2023-08-17T00:14:42.929857+0000","last_clean":"2023-08-17T00:14:42.929857+0000","last_became_active":"2023-08-17T00:14:42.473059+0000","last_became_peered":"2023-08-17T00:14:42.473059+0000","last_unstale":"2023-08-17T00:14:42.929857+0000","last_undegraded":"2023-08-17T00:14:42.929857+0000","last_fullsized":"2023-08-17T00:14:42.929857+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924250+0000","last_change":"2023-08-17T00:14:42.924250+0000","last_active":"2023-08-17T00:14:42.924250+0000","last_peered":"2023-08-17T00:14:42.924250+0000","last_clean":"2023-08-17T00:14:42.924250+0000","last_became_active":"2023-08-17T00:14:42.923978+0000","last_became_peered":"2023-08-17T00:14:42.923978+0000","last_unstale":"2023-08-17T00:14:42.924250+0000","last_undegraded":"2023-08-17T00:14:42.924250+0000","last_fullsized":"2023-08-17T00:14:42.924250+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.474191+0000","last_change":"2023-08-17T00:14:42.471796+0000","last_active":"2023-08-17T00:14:42.474191+0000","last_peered":"2023-08-17T00:14:42.474191+0000","last_clean":"2023-08-17T00:14:42.474191+0000","last_became_active":"2023-08-17T00:14:42.471520+0000","last_became_peered":"2023-08-17T00:14:42.471520+0000","last_unstale":"2023-08-17T00:14:42.474191+0000","last_undegraded":"2023-08-17T00:14:42.474191+0000","last_fullsized":"2023-08-17T00:14:42.474191+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924109+0000","last_change":"2023-08-17T00:14:42.918616+0000","last_active":"2023-08-17T00:14:42.924109+0000","last_peered":"2023-08-17T00:14:42.924109+0000","last_clean":"2023-08-17T00:14:42.924109+0000","last_became_active":"2023-08-17T00:14:42.918348+0000","last_became_peered":"2023-08-17T00:14:42.918348+0000","last_unstale":"2023-08-17T00:14:42.924109+0000","last_undegraded":"2023-08-17T00:14:42.924109+0000","last_fullsized":"2023-08-17T00:14:42.924109+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483776+0000","last_change":"2023-08-17T00:14:42.474639+0000","last_active":"2023-08-17T00:14:42.483776+0000","last_peered":"2023-08-17T00:14:42.483776+0000","last_clean":"2023-08-17T00:14:42.483776+0000","last_became_active":"2023-08-17T00:14:42.474341+0000","last_became_peered":"2023-08-17T00:14:42.474341+0000","last_unstale":"2023-08-17T00:14:42.483776+0000","last_undegraded":"2023-08-17T00:14:42.483776+0000","last_fullsized":"2023-08-17T00:14:42.483776+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924671+0000","last_change":"2023-08-17T00:14:42.924671+0000","last_active":"2023-08-17T00:14:42.924671+0000","last_peered":"2023-08-17T00:14:42.924671+0000","last_clean":"2023-08-17T00:14:42.924671+0000","last_became_active":"2023-08-17T00:14:42.924423+0000","last_became_peered":"2023-08-17T00:14:42.924423+0000","last_unstale":"2023-08-17T00:14:42.924671+0000","last_undegraded":"2023-08-17T00:14:42.924671+0000","last_fullsized":"2023-08-17T00:14:42.924671+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897356+0000","last_change":"2023-08-17T00:14:42.478106+0000","last_active":"2023-08-17T00:14:42.897356+0000","last_peered":"2023-08-17T00:14:42.897356+0000","last_clean":"2023-08-17T00:14:42.897356+0000","last_became_active":"2023-08-17T00:14:42.477827+0000","last_became_peered":"2023-08-17T00:14:42.477827+0000","last_unstale":"2023-08-17T00:14:42.897356+0000","last_undegraded":"2023-08-17T00:14:42.897356+0000","last_fullsized":"2023-08-17T00:14:42.897356+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914772+0000","last_change":"2023-08-17T00:14:42.914772+0000","last_active":"2023-08-17T00:14:42.914772+0000","last_peered":"2023-08-17T00:14:42.914772+0000","last_clean":"2023-08-17T00:14:42.914772+0000","last_became_active":"2023-08-17T00:14:42.914480+0000","last_became_peered":"2023-08-17T00:14:42.914480+0000","last_unstale":"2023-08-17T00:14:42.914772+0000","last_undegraded":"2023-08-17T00:14:42.914772+0000","last_fullsized":"2023-08-17T00:14:42.914772+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.477853+0000","last_change":"2023-08-17T00:14:42.461610+0000","last_active":"2023-08-17T00:14:42.477853+0000","last_peered":"2023-08-17T00:14:42.477853+0000","last_clean":"2023-08-17T00:14:42.477853+0000","last_became_active":"2023-08-17T00:14:42.461299+0000","last_became_peered":"2023-08-17T00:14:42.461299+0000","last_unstale":"2023-08-17T00:14:42.477853+0000","last_undegraded":"2023-08-17T00:14:42.477853+0000","last_fullsized":"2023-08-17T00:14:42.477853+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920904+0000","last_change":"2023-08-17T00:14:42.920904+0000","last_active":"2023-08-17T00:14:42.920904+0000","last_peered":"2023-08-17T00:14:42.920904+0000","last_clean":"2023-08-17T00:14:42.920904+0000","last_became_active":"2023-08-17T00:14:42.920653+0000","last_became_peered":"2023-08-17T00:14:42.920653+0000","last_unstale":"2023-08-17T00:14:42.920904+0000","last_undegraded":"2023-08-17T00:14:42.920904+0000","last_fullsized":"2023-08-17T00:14:42.920904+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896474+0000","last_change":"2023-08-17T00:14:42.475277+0000","last_active":"2023-08-17T00:14:42.896474+0000","last_peered":"2023-08-17T00:14:42.896474+0000","last_clean":"2023-08-17T00:14:42.896474+0000","last_became_active":"2023-08-17T00:14:42.474884+0000","last_became_peered":"2023-08-17T00:14:42.474884+0000","last_unstale":"2023-08-17T00:14:42.896474+0000","last_undegraded":"2023-08-17T00:14:42.896474+0000","last_fullsized":"2023-08-17T00:14:42.896474+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.904158+0000","last_change":"2023-08-17T00:14:42.904158+0000","last_active":"2023-08-17T00:14:42.904158+0000","last_peered":"2023-08-17T00:14:42.904158+0000","last_clean":"2023-08-17T00:14:42.904158+0000","last_became_active":"2023-08-17T00:14:42.903858+0000","last_became_peered":"2023-08-17T00:14:42.903858+0000","last_unstale":"2023-08-17T00:14:42.904158+0000","last_undegraded":"2023-08-17T00:14:42.904158+0000","last_fullsized":"2023-08-17T00:14:42.904158+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.f","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926164+0000","last_change":"2023-08-17T00:14:42.476348+0000","last_active":"2023-08-17T00:14:42.926164+0000","last_peered":"2023-08-17T00:14:42.926164+0000","last_clean":"2023-08-17T00:14:42.926164+0000","last_became_active":"2023-08-17T00:14:42.476030+0000","last_became_peered":"2023-08-17T00:14:42.476030+0000","last_unstale":"2023-08-17T00:14:42.926164+0000","last_undegraded":"2023-08-17T00:14:42.926164+0000","last_fullsized":"2023-08-17T00:14:42.926164+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.910937+0000","last_change":"2023-08-17T00:14:42.910937+0000","last_active":"2023-08-17T00:14:42.910937+0000","last_peered":"2023-08-17T00:14:42.910937+0000","last_clean":"2023-08-17T00:14:42.910937+0000","last_became_active":"2023-08-17T00:14:42.910578+0000","last_became_peered":"2023-08-17T00:14:42.910578+0000","last_unstale":"2023-08-17T00:14:42.910937+0000","last_undegraded":"2023-08-17T00:14:42.910937+0000","last_fullsized":"2023-08-17T00:14:42.910937+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.e","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920801+0000","last_change":"2023-08-17T00:14:42.468928+0000","last_active":"2023-08-17T00:14:42.920801+0000","last_peered":"2023-08-17T00:14:42.920801+0000","last_clean":"2023-08-17T00:14:42.920801+0000","last_became_active":"2023-08-17T00:14:42.468635+0000","last_became_peered":"2023-08-17T00:14:42.468635+0000","last_unstale":"2023-08-17T00:14:42.920801+0000","last_undegraded":"2023-08-17T00:14:42.920801+0000","last_fullsized":"2023-08-17T00:14:42.920801+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.929043+0000","last_change":"2023-08-17T00:14:42.920297+0000","last_active":"2023-08-17T00:14:42.929043+0000","last_peered":"2023-08-17T00:14:42.929043+0000","last_clean":"2023-08-17T00:14:42.929043+0000","last_became_active":"2023-08-17T00:14:42.920015+0000","last_became_peered":"2023-08-17T00:14:42.920015+0000","last_unstale":"2023-08-17T00:14:42.929043+0000","last_undegraded":"2023-08-17T00:14:42.929043+0000","last_fullsized":"2023-08-17T00:14:42.929043+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.472100+0000","last_change":"2023-08-17T00:14:42.468397+0000","last_active":"2023-08-17T00:14:42.472100+0000","last_peered":"2023-08-17T00:14:42.472100+0000","last_clean":"2023-08-17T00:14:42.472100+0000","last_became_active":"2023-08-17T00:14:42.468111+0000","last_became_peered":"2023-08-17T00:14:42.468111+0000","last_unstale":"2023-08-17T00:14:42.472100+0000","last_undegraded":"2023-08-17T00:14:42.472100+0000","last_fullsized":"2023-08-17T00:14:42.472100+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916242+0000","last_change":"2023-08-17T00:14:42.916242+0000","last_active":"2023-08-17T00:14:42.916242+0000","last_peered":"2023-08-17T00:14:42.916242+0000","last_clean":"2023-08-17T00:14:42.916242+0000","last_became_active":"2023-08-17T00:14:42.915939+0000","last_became_peered":"2023-08-17T00:14:42.915939+0000","last_unstale":"2023-08-17T00:14:42.916242+0000","last_undegraded":"2023-08-17T00:14:42.916242+0000","last_fullsized":"2023-08-17T00:14:42.916242+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.475543+0000","last_change":"2023-08-17T00:14:42.469022+0000","last_active":"2023-08-17T00:14:42.475543+0000","last_peered":"2023-08-17T00:14:42.475543+0000","last_clean":"2023-08-17T00:14:42.475543+0000","last_became_active":"2023-08-17T00:14:42.468700+0000","last_became_peered":"2023-08-17T00:14:42.468700+0000","last_unstale":"2023-08-17T00:14:42.475543+0000","last_undegraded":"2023-08-17T00:14:42.475543+0000","last_fullsized":"2023-08-17T00:14:42.475543+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.908305+0000","last_change":"2023-08-17T00:14:42.908305+0000","last_active":"2023-08-17T00:14:42.908305+0000","last_peered":"2023-08-17T00:14:42.908305+0000","last_clean":"2023-08-17T00:14:42.908305+0000","last_became_active":"2023-08-17T00:14:42.907980+0000","last_became_peered":"2023-08-17T00:14:42.907980+0000","last_unstale":"2023-08-17T00:14:42.908305+0000","last_undegraded":"2023-08-17T00:14:42.908305+0000","last_fullsized":"2023-08-17T00:14:42.908305+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.b","version":"153'1","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926119+0000","last_change":"2023-08-17T00:14:42.476211+0000","last_active":"2023-08-17T00:14:42.926119+0000","last_peered":"2023-08-17T00:14:42.926119+0000","last_clean":"2023-08-17T00:14:42.926119+0000","last_became_active":"2023-08-17T00:14:42.475895+0000","last_became_peered":"2023-08-17T00:14:42.475895+0000","last_unstale":"2023-08-17T00:14:42.926119+0000","last_undegraded":"2023-08-17T00:14:42.926119+0000","last_fullsized":"2023-08-17T00:14:42.926119+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914995+0000","last_change":"2023-08-17T00:14:42.914995+0000","last_active":"2023-08-17T00:14:42.914995+0000","last_peered":"2023-08-17T00:14:42.914995+0000","last_clean":"2023-08-17T00:14:42.914995+0000","last_became_active":"2023-08-17T00:14:42.914674+0000","last_became_peered":"2023-08-17T00:14:42.914674+0000","last_unstale":"2023-08-17T00:14:42.914995+0000","last_undegraded":"2023-08-17T00:14:42.914995+0000","last_fullsized":"2023-08-17T00:14:42.914995+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897140+0000","last_change":"2023-08-17T00:14:42.457484+0000","last_active":"2023-08-17T00:14:42.897140+0000","last_peered":"2023-08-17T00:14:42.897140+0000","last_clean":"2023-08-17T00:14:42.897140+0000","last_became_active":"2023-08-17T00:14:42.456764+0000","last_became_peered":"2023-08-17T00:14:42.456764+0000","last_unstale":"2023-08-17T00:14:42.897140+0000","last_undegraded":"2023-08-17T00:14:42.897140+0000","last_fullsized":"2023-08-17T00:14:42.897140+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.901968+0000","last_change":"2023-08-17T00:14:42.901968+0000","last_active":"2023-08-17T00:14:42.901968+0000","last_peered":"2023-08-17T00:14:42.901968+0000","last_clean":"2023-08-17T00:14:42.901968+0000","last_became_active":"2023-08-17T00:14:42.901678+0000","last_became_peered":"2023-08-17T00:14:42.901678+0000","last_unstale":"2023-08-17T00:14:42.901968+0000","last_undegraded":"2023-08-17T00:14:42.901968+0000","last_fullsized":"2023-08-17T00:14:42.901968+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.896617+0000","last_change":"2023-08-17T00:14:42.476334+0000","last_active":"2023-08-17T00:14:42.896617+0000","last_peered":"2023-08-17T00:14:42.896617+0000","last_clean":"2023-08-17T00:14:42.896617+0000","last_became_active":"2023-08-17T00:14:42.475848+0000","last_became_peered":"2023-08-17T00:14:42.475848+0000","last_unstale":"2023-08-17T00:14:42.896617+0000","last_undegraded":"2023-08-17T00:14:42.896617+0000","last_fullsized":"2023-08-17T00:14:42.896617+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926370+0000","last_change":"2023-08-17T00:14:42.921779+0000","last_active":"2023-08-17T00:14:42.926370+0000","last_peered":"2023-08-17T00:14:42.926370+0000","last_clean":"2023-08-17T00:14:42.926370+0000","last_became_active":"2023-08-17T00:14:42.921457+0000","last_became_peered":"2023-08-17T00:14:42.921457+0000","last_unstale":"2023-08-17T00:14:42.926370+0000","last_undegraded":"2023-08-17T00:14:42.926370+0000","last_fullsized":"2023-08-17T00:14:42.926370+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897457+0000","last_change":"2023-08-17T00:14:42.466465+0000","last_active":"2023-08-17T00:14:42.897457+0000","last_peered":"2023-08-17T00:14:42.897457+0000","last_clean":"2023-08-17T00:14:42.897457+0000","last_became_active":"2023-08-17T00:14:42.466180+0000","last_became_peered":"2023-08-17T00:14:42.466180+0000","last_unstale":"2023-08-17T00:14:42.897457+0000","last_undegraded":"2023-08-17T00:14:42.897457+0000","last_fullsized":"2023-08-17T00:14:42.897457+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.926793+0000","last_change":"2023-08-17T00:14:42.923726+0000","last_active":"2023-08-17T00:14:42.926793+0000","last_peered":"2023-08-17T00:14:42.926793+0000","last_clean":"2023-08-17T00:14:42.926793+0000","last_became_active":"2023-08-17T00:14:42.922732+0000","last_became_peered":"2023-08-17T00:14:42.922732+0000","last_unstale":"2023-08-17T00:14:42.926793+0000","last_undegraded":"2023-08-17T00:14:42.926793+0000","last_fullsized":"2023-08-17T00:14:42.926793+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.7","version":"153'2","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.929964+0000","last_change":"2023-08-17T00:14:42.475040+0000","last_active":"2023-08-17T00:14:42.929964+0000","last_peered":"2023-08-17T00:14:42.929964+0000","last_clean":"2023-08-17T00:14:42.929964+0000","last_became_active":"2023-08-17T00:14:42.474412+0000","last_became_peered":"2023-08-17T00:14:42.474412+0000","last_unstale":"2023-08-17T00:14:42.929964+0000","last_undegraded":"2023-08-17T00:14:42.929964+0000","last_fullsized":"2023-08-17T00:14:42.929964+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916816+0000","last_change":"2023-08-17T00:14:42.916816+0000","last_active":"2023-08-17T00:14:42.916816+0000","last_peered":"2023-08-17T00:14:42.916816+0000","last_clean":"2023-08-17T00:14:42.916816+0000","last_became_active":"2023-08-17T00:14:42.916560+0000","last_became_peered":"2023-08-17T00:14:42.916560+0000","last_unstale":"2023-08-17T00:14:42.916816+0000","last_undegraded":"2023-08-17T00:14:42.916816+0000","last_fullsized":"2023-08-17T00:14:42.916816+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483670+0000","last_change":"2023-08-17T00:14:42.473214+0000","last_active":"2023-08-17T00:14:42.483670+0000","last_peered":"2023-08-17T00:14:42.483670+0000","last_clean":"2023-08-17T00:14:42.483670+0000","last_became_active":"2023-08-17T00:14:42.472873+0000","last_became_peered":"2023-08-17T00:14:42.472873+0000","last_unstale":"2023-08-17T00:14:42.483670+0000","last_undegraded":"2023-08-17T00:14:42.483670+0000","last_fullsized":"2023-08-17T00:14:42.483670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927657+0000","last_change":"2023-08-17T00:14:42.927657+0000","last_active":"2023-08-17T00:14:42.927657+0000","last_peered":"2023-08-17T00:14:42.927657+0000","last_clean":"2023-08-17T00:14:42.927657+0000","last_became_active":"2023-08-17T00:14:42.918629+0000","last_became_peered":"2023-08-17T00:14:42.918629+0000","last_unstale":"2023-08-17T00:14:42.927657+0000","last_undegraded":"2023-08-17T00:14:42.927657+0000","last_fullsized":"2023-08-17T00:14:42.927657+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.470693+0000","last_change":"2023-08-17T00:14:42.469712+0000","last_active":"2023-08-17T00:14:42.470693+0000","last_peered":"2023-08-17T00:14:42.470693+0000","last_clean":"2023-08-17T00:14:42.470693+0000","last_became_active":"2023-08-17T00:14:42.469428+0000","last_became_peered":"2023-08-17T00:14:42.469428+0000","last_unstale":"2023-08-17T00:14:42.470693+0000","last_undegraded":"2023-08-17T00:14:42.470693+0000","last_fullsized":"2023-08-17T00:14:42.470693+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.918858+0000","last_change":"2023-08-17T00:14:42.913006+0000","last_active":"2023-08-17T00:14:42.918858+0000","last_peered":"2023-08-17T00:14:42.918858+0000","last_clean":"2023-08-17T00:14:42.918858+0000","last_became_active":"2023-08-17T00:14:42.912386+0000","last_became_peered":"2023-08-17T00:14:42.912386+0000","last_unstale":"2023-08-17T00:14:42.918858+0000","last_undegraded":"2023-08-17T00:14:42.918858+0000","last_fullsized":"2023-08-17T00:14:42.918858+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.469456+0000","last_change":"2023-08-17T00:14:42.462757+0000","last_active":"2023-08-17T00:14:42.469456+0000","last_peered":"2023-08-17T00:14:42.469456+0000","last_clean":"2023-08-17T00:14:42.469456+0000","last_became_active":"2023-08-17T00:14:42.462341+0000","last_became_peered":"2023-08-17T00:14:42.462341+0000","last_unstale":"2023-08-17T00:14:42.469456+0000","last_undegraded":"2023-08-17T00:14:42.469456+0000","last_fullsized":"2023-08-17T00:14:42.469456+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.925219+0000","last_change":"2023-08-17T00:14:42.925219+0000","last_active":"2023-08-17T00:14:42.925219+0000","last_peered":"2023-08-17T00:14:42.925219+0000","last_clean":"2023-08-17T00:14:42.925219+0000","last_became_active":"2023-08-17T00:14:42.924945+0000","last_became_peered":"2023-08-17T00:14:42.924945+0000","last_unstale":"2023-08-17T00:14:42.925219+0000","last_undegraded":"2023-08-17T00:14:42.925219+0000","last_fullsized":"2023-08-17T00:14:42.925219+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.477728+0000","last_change":"2023-08-17T00:14:42.459759+0000","last_active":"2023-08-17T00:14:42.477728+0000","last_peered":"2023-08-17T00:14:42.477728+0000","last_clean":"2023-08-17T00:14:42.477728+0000","last_became_active":"2023-08-17T00:14:42.459429+0000","last_became_peered":"2023-08-17T00:14:42.459429+0000","last_unstale":"2023-08-17T00:14:42.477728+0000","last_undegraded":"2023-08-17T00:14:42.477728+0000","last_fullsized":"2023-08-17T00:14:42.477728+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.913184+0000","last_change":"2023-08-17T00:14:42.913184+0000","last_active":"2023-08-17T00:14:42.913184+0000","last_peered":"2023-08-17T00:14:42.913184+0000","last_clean":"2023-08-17T00:14:42.913184+0000","last_became_active":"2023-08-17T00:14:42.912865+0000","last_became_peered":"2023-08-17T00:14:42.912865+0000","last_unstale":"2023-08-17T00:14:42.913184+0000","last_undegraded":"2023-08-17T00:14:42.913184+0000","last_fullsized":"2023-08-17T00:14:42.913184+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.904226+0000","last_change":"2023-08-17T00:14:42.464640+0000","last_active":"2023-08-17T00:14:42.904226+0000","last_peered":"2023-08-17T00:14:42.904226+0000","last_clean":"2023-08-17T00:14:42.904226+0000","last_became_active":"2023-08-17T00:14:42.462241+0000","last_became_peered":"2023-08-17T00:14:42.462241+0000","last_unstale":"2023-08-17T00:14:42.904226+0000","last_undegraded":"2023-08-17T00:14:42.904226+0000","last_fullsized":"2023-08-17T00:14:42.904226+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.916047+0000","last_change":"2023-08-17T00:14:42.916047+0000","last_active":"2023-08-17T00:14:42.916047+0000","last_peered":"2023-08-17T00:14:42.916047+0000","last_clean":"2023-08-17T00:14:42.916047+0000","last_became_active":"2023-08-17T00:14:42.914724+0000","last_became_peered":"2023-08-17T00:14:42.914724+0000","last_unstale":"2023-08-17T00:14:42.916047+0000","last_undegraded":"2023-08-17T00:14:42.916047+0000","last_fullsized":"2023-08-17T00:14:42.916047+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.473512+0000","last_change":"2023-08-17T00:14:42.470765+0000","last_active":"2023-08-17T00:14:42.473512+0000","last_peered":"2023-08-17T00:14:42.473512+0000","last_clean":"2023-08-17T00:14:42.473512+0000","last_became_active":"2023-08-17T00:14:42.470418+0000","last_became_peered":"2023-08-17T00:14:42.470418+0000","last_unstale":"2023-08-17T00:14:42.473512+0000","last_undegraded":"2023-08-17T00:14:42.473512+0000","last_fullsized":"2023-08-17T00:14:42.473512+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.917143+0000","last_change":"2023-08-17T00:14:42.917143+0000","last_active":"2023-08-17T00:14:42.917143+0000","last_peered":"2023-08-17T00:14:42.917143+0000","last_clean":"2023-08-17T00:14:42.917143+0000","last_became_active":"2023-08-17T00:14:42.916531+0000","last_became_peered":"2023-08-17T00:14:42.916531+0000","last_unstale":"2023-08-17T00:14:42.917143+0000","last_undegraded":"2023-08-17T00:14:42.917143+0000","last_fullsized":"2023-08-17T00:14:42.917143+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.477700+0000","last_change":"2023-08-17T00:14:42.460357+0000","last_active":"2023-08-17T00:14:42.477700+0000","last_peered":"2023-08-17T00:14:42.477700+0000","last_clean":"2023-08-17T00:14:42.477700+0000","last_became_active":"2023-08-17T00:14:42.460080+0000","last_became_peered":"2023-08-17T00:14:42.460080+0000","last_unstale":"2023-08-17T00:14:42.477700+0000","last_undegraded":"2023-08-17T00:14:42.477700+0000","last_fullsized":"2023-08-17T00:14:42.477700+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.908924+0000","last_change":"2023-08-17T00:14:42.908924+0000","last_active":"2023-08-17T00:14:42.908924+0000","last_peered":"2023-08-17T00:14:42.908924+0000","last_clean":"2023-08-17T00:14:42.908924+0000","last_became_active":"2023-08-17T00:14:42.908578+0000","last_became_peered":"2023-08-17T00:14:42.908578+0000","last_unstale":"2023-08-17T00:14:42.908924+0000","last_undegraded":"2023-08-17T00:14:42.908924+0000","last_fullsized":"2023-08-17T00:14:42.908924+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.10","version":"153'4","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.930067+0000","last_change":"2023-08-17T00:14:42.473431+0000","last_active":"2023-08-17T00:14:42.930067+0000","last_peered":"2023-08-17T00:14:42.930067+0000","last_clean":"2023-08-17T00:14:42.930067+0000","last_became_active":"2023-08-17T00:14:42.473158+0000","last_became_peered":"2023-08-17T00:14:42.473158+0000","last_unstale":"2023-08-17T00:14:42.930067+0000","last_undegraded":"2023-08-17T00:14:42.930067+0000","last_fullsized":"2023-08-17T00:14:42.930067+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.464696+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:14:42.464696+0000","last_peered":"2023-08-17T00:14:42.464696+0000","last_clean":"2023-08-17T00:14:42.464696+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:14:42.464696+0000","last_undegraded":"2023-08-17T00:14:42.464696+0000","last_fullsized":"2023-08-17T00:14:42.464696+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920089+0000","last_change":"2023-08-17T00:14:42.915749+0000","last_active":"2023-08-17T00:14:42.920089+0000","last_peered":"2023-08-17T00:14:42.920089+0000","last_clean":"2023-08-17T00:14:42.920089+0000","last_became_active":"2023-08-17T00:14:42.915461+0000","last_became_peered":"2023-08-17T00:14:42.915461+0000","last_unstale":"2023-08-17T00:14:42.920089+0000","last_undegraded":"2023-08-17T00:14:42.920089+0000","last_fullsized":"2023-08-17T00:14:42.920089+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483442+0000","last_change":"2023-08-17T00:14:42.468794+0000","last_active":"2023-08-17T00:14:42.483442+0000","last_peered":"2023-08-17T00:14:42.483442+0000","last_clean":"2023-08-17T00:14:42.483442+0000","last_became_active":"2023-08-17T00:14:42.468521+0000","last_became_peered":"2023-08-17T00:14:42.468521+0000","last_unstale":"2023-08-17T00:14:42.483442+0000","last_undegraded":"2023-08-17T00:14:42.483442+0000","last_fullsized":"2023-08-17T00:14:42.483442+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.451278+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:14:42.451278+0000","last_peered":"2023-08-17T00:14:42.451278+0000","last_clean":"2023-08-17T00:14:42.451278+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:14:42.451278+0000","last_undegraded":"2023-08-17T00:14:42.451278+0000","last_fullsized":"2023-08-17T00:14:42.451278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915854+0000","last_change":"2023-08-17T00:14:42.915854+0000","last_active":"2023-08-17T00:14:42.915854+0000","last_peered":"2023-08-17T00:14:42.915854+0000","last_clean":"2023-08-17T00:14:42.915854+0000","last_became_active":"2023-08-17T00:14:42.915480+0000","last_became_peered":"2023-08-17T00:14:42.915480+0000","last_unstale":"2023-08-17T00:14:42.915854+0000","last_undegraded":"2023-08-17T00:14:42.915854+0000","last_fullsized":"2023-08-17T00:14:42.915854+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483395+0000","last_change":"2023-08-17T00:14:42.468295+0000","last_active":"2023-08-17T00:14:42.483395+0000","last_peered":"2023-08-17T00:14:42.483395+0000","last_clean":"2023-08-17T00:14:42.483395+0000","last_became_active":"2023-08-17T00:14:42.467968+0000","last_became_peered":"2023-08-17T00:14:42.467968+0000","last_unstale":"2023-08-17T00:14:42.483395+0000","last_undegraded":"2023-08-17T00:14:42.483395+0000","last_fullsized":"2023-08-17T00:14:42.483395+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.458944+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:14:42.458944+0000","last_peered":"2023-08-17T00:14:42.458944+0000","last_clean":"2023-08-17T00:14:42.458944+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:14:42.458944+0000","last_undegraded":"2023-08-17T00:14:42.458944+0000","last_fullsized":"2023-08-17T00:14:42.458944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.914724+0000","last_change":"2023-08-17T00:14:42.914724+0000","last_active":"2023-08-17T00:14:42.914724+0000","last_peered":"2023-08-17T00:14:42.914724+0000","last_clean":"2023-08-17T00:14:42.914724+0000","last_became_active":"2023-08-17T00:14:42.914458+0000","last_became_peered":"2023-08-17T00:14:42.914458+0000","last_unstale":"2023-08-17T00:14:42.914724+0000","last_undegraded":"2023-08-17T00:14:42.914724+0000","last_fullsized":"2023-08-17T00:14:42.914724+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.13","version":"153'1","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.895796+0000","last_change":"2023-08-17T00:14:42.464753+0000","last_active":"2023-08-17T00:14:42.895796+0000","last_peered":"2023-08-17T00:14:42.895796+0000","last_clean":"2023-08-17T00:14:42.895796+0000","last_became_active":"2023-08-17T00:14:42.464155+0000","last_became_peered":"2023-08-17T00:14:42.464155+0000","last_unstale":"2023-08-17T00:14:42.895796+0000","last_undegraded":"2023-08-17T00:14:42.895796+0000","last_fullsized":"2023-08-17T00:14:42.895796+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.908557+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:14:42.908557+0000","last_peered":"2023-08-17T00:14:42.908557+0000","last_clean":"2023-08-17T00:14:42.908557+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:14:42.908557+0000","last_undegraded":"2023-08-17T00:14:42.908557+0000","last_fullsized":"2023-08-17T00:14:42.908557+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.920186+0000","last_change":"2023-08-17T00:14:42.917282+0000","last_active":"2023-08-17T00:14:42.920186+0000","last_peered":"2023-08-17T00:14:42.920186+0000","last_clean":"2023-08-17T00:14:42.920186+0000","last_became_active":"2023-08-17T00:14:42.916980+0000","last_became_peered":"2023-08-17T00:14:42.916980+0000","last_unstale":"2023-08-17T00:14:42.920186+0000","last_undegraded":"2023-08-17T00:14:42.920186+0000","last_fullsized":"2023-08-17T00:14:42.920186+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"153'3","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.924329+0000","last_change":"2023-08-17T00:14:42.465114+0000","last_active":"2023-08-17T00:14:42.924329+0000","last_peered":"2023-08-17T00:14:42.924329+0000","last_clean":"2023-08-17T00:14:42.924329+0000","last_became_active":"2023-08-17T00:14:42.464757+0000","last_became_peered":"2023-08-17T00:14:42.464757+0000","last_unstale":"2023-08-17T00:14:42.924329+0000","last_undegraded":"2023-08-17T00:14:42.924329+0000","last_fullsized":"2023-08-17T00:14:42.924329+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.461312+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:14:42.461312+0000","last_peered":"2023-08-17T00:14:42.461312+0000","last_clean":"2023-08-17T00:14:42.461312+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:14:42.461312+0000","last_undegraded":"2023-08-17T00:14:42.461312+0000","last_fullsized":"2023-08-17T00:14:42.461312+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.927861+0000","last_change":"2023-08-17T00:14:42.925196+0000","last_active":"2023-08-17T00:14:42.927861+0000","last_peered":"2023-08-17T00:14:42.927861+0000","last_clean":"2023-08-17T00:14:42.927861+0000","last_became_active":"2023-08-17T00:14:42.924845+0000","last_became_peered":"2023-08-17T00:14:42.924845+0000","last_unstale":"2023-08-17T00:14:42.927861+0000","last_undegraded":"2023-08-17T00:14:42.927861+0000","last_fullsized":"2023-08-17T00:14:42.927861+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.483454+0000","last_change":"2023-08-17T00:14:42.468843+0000","last_active":"2023-08-17T00:14:42.483454+0000","last_peered":"2023-08-17T00:14:42.483454+0000","last_clean":"2023-08-17T00:14:42.483454+0000","last_became_active":"2023-08-17T00:14:42.468577+0000","last_became_peered":"2023-08-17T00:14:42.468577+0000","last_unstale":"2023-08-17T00:14:42.483454+0000","last_undegraded":"2023-08-17T00:14:42.483454+0000","last_fullsized":"2023-08-17T00:14:42.483454+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":121,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.897398+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:14:42.897398+0000","last_peered":"2023-08-17T00:14:42.897398+0000","last_clean":"2023-08-17T00:14:42.897398+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:14:42.897398+0000","last_undegraded":"2023-08-17T00:14:42.897398+0000","last_fullsized":"2023-08-17T00:14:42.897398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.915405+0000","last_change":"2023-08-17T00:14:42.915405+0000","last_active":"2023-08-17T00:14:42.915405+0000","last_peered":"2023-08-17T00:14:42.915405+0000","last_clean":"2023-08-17T00:14:42.915405+0000","last_became_active":"2023-08-17T00:14:42.915123+0000","last_became_peered":"2023-08-17T00:14:42.915123+0000","last_unstale":"2023-08-17T00:14:42.915405+0000","last_undegraded":"2023-08-17T00:14:42.915405+0000","last_fullsized":"2023-08-17T00:14:42.915405+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.898007+0000","last_change":"2023-08-17T00:14:42.474345+0000","last_active":"2023-08-17T00:14:42.898007+0000","last_peered":"2023-08-17T00:14:42.898007+0000","last_clean":"2023-08-17T00:14:42.898007+0000","last_became_active":"2023-08-17T00:14:42.474064+0000","last_became_peered":"2023-08-17T00:14:42.474064+0000","last_unstale":"2023-08-17T00:14:42.898007+0000","last_undegraded":"2023-08-17T00:14:42.898007+0000","last_fullsized":"2023-08-17T00:14:42.898007+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.459565+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:14:42.459565+0000","last_peered":"2023-08-17T00:14:42.459565+0000","last_clean":"2023-08-17T00:14:42.459565+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:14:42.459565+0000","last_undegraded":"2023-08-17T00:14:42.459565+0000","last_fullsized":"2023-08-17T00:14:42.459565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":8,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.911683+0000","last_change":"2023-08-17T00:14:42.911683+0000","last_active":"2023-08-17T00:14:42.911683+0000","last_peered":"2023-08-17T00:14:42.911683+0000","last_clean":"2023-08-17T00:14:42.911683+0000","last_became_active":"2023-08-17T00:14:42.911414+0000","last_became_peered":"2023-08-17T00:14:42.911414+0000","last_unstale":"2023-08-17T00:14:42.911683+0000","last_undegraded":"2023-08-17T00:14:42.911683+0000","last_fullsized":"2023-08-17T00:14:42.911683+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:42.428727+0000","last_clean_scrub_stamp":"2023-08-17T00:14:42.428727+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.14","version":"153'2","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.928428+0000","last_change":"2023-08-17T00:14:42.471482+0000","last_active":"2023-08-17T00:14:42.928428+0000","last_peered":"2023-08-17T00:14:42.928428+0000","last_clean":"2023-08-17T00:14:42.928428+0000","last_became_active":"2023-08-17T00:14:42.471212+0000","last_became_peered":"2023-08-17T00:14:42.471212+0000","last_unstale":"2023-08-17T00:14:42.928428+0000","last_undegraded":"2023-08-17T00:14:42.928428+0000","last_fullsized":"2023-08-17T00:14:42.928428+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:14:41.413604+0000","last_clean_scrub_stamp":"2023-08-17T00:14:41.413604+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":121,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.460075+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:14:42.460075+0000","last_peered":"2023-08-17T00:14:42.460075+0000","last_clean":"2023-08-17T00:14:42.460075+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:14:42.460075+0000","last_undegraded":"2023-08-17T00:14:42.460075+0000","last_fullsized":"2023-08-17T00:14:42.460075+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":124,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-08-17T00:14:42.455175+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:14:42.455175+0000","last_peered":"2023-08-17T00:14:42.455175+0000","last_clean":"2023-08-17T00:14:42.455175+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:14:42.455175+0000","last_undegraded":"2023-08-17T00:14:42.455175+0000","last_fullsized":"2023-08-17T00:14:42.455175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542290,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311384,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060456,"statfs":{"total":96636764160,"available":96317906944,"internally_reserved":0,"allocated":1916928,"data_stored":897251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.006,"15min":1.175},"min":{"1min":0.68200000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.444,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":1.6539999999999999},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.038,"15min":1.2110000000000001},"min":{"1min":0.54700000000000004,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.3360000000000001,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":1.2310000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0609999999999999,"15min":1.2410000000000001},"min":{"1min":0.72099999999999997,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.48,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":1.095},{"interface":"front","average":{"1min":1.0389999999999999,"5min":1.109,"15min":1.24},"min":{"1min":0.68300000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.337,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.335}]},{"osd":2,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0489999999999999,"15min":1.1579999999999999},"min":{"1min":0.74299999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.298,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1359999999999999,"15min":1.2909999999999999},"min":{"1min":0.72299999999999998,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.5489999999999999,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.262}]},{"osd":3,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.1060000000000001,"15min":1.2050000000000001},"min":{"1min":0.628,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3799999999999999,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.179,"15min":1.4330000000000001},"min":{"1min":0.77500000000000002,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5289999999999999,"5min":1.952,"15min":13.074999999999999},"last":1.379}]},{"osd":4,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.1259999999999999,"15min":1.381},"min":{"1min":0.69899999999999995,"5min":0.62,"15min":0.62},"max":{"1min":1.468,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.135},{"interface":"front","average":{"1min":1.175,"5min":1.1319999999999999,"15min":1.335},"min":{"1min":0.68799999999999994,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.502,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.397}]},{"osd":5,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.2010000000000001,"15min":1.5},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.601,"5min":2.9830000000000001,"15min":14.435},"last":1.575},{"interface":"front","average":{"1min":1.272,"5min":1.234,"15min":1.4810000000000001},"min":{"1min":0.80200000000000005,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8799999999999999,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.7829999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:14:07 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.282,"15min":1.5109999999999999},"min":{"1min":0.84599999999999997,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.526,"5min":2.427,"15min":11.279999999999999},"last":1.8640000000000001},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2050000000000001,"15min":1.4379999999999999},"min":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.5,"5min":2.4350000000000001,"15min":11.365},"last":1.302}]}]},{"osd":6,"up_from":14,"seq":60129542290,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315476,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056364,"statfs":{"total":96636764160,"available":96313716736,"internally_reserved":0,"allocated":1912832,"data_stored":897209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0740000000000001,"15min":1.0589999999999999},"min":{"1min":0.56299999999999994,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.6819999999999999,"5min":8.0909999999999993,"15min":8.0909999999999993},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.95199999999999996,"5min":1.123,"15min":1.121},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.429,"5min":10.519,"15min":10.519},"last":0.94199999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1599999999999999,"15min":1.1419999999999999},"min":{"1min":0.65800000000000003,"5min":0.61699999999999999,"15min":0.443},"max":{"1min":1.7569999999999999,"5min":10.704000000000001,"15min":10.704000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.0640000000000001,"15min":1.0489999999999999},"min":{"1min":0.83499999999999996,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.4850000000000001,"5min":3.4460000000000002,"15min":11.391999999999999},"last":1.1950000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1439999999999999,"15min":1.159},"min":{"1min":0.79300000000000004,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.6299999999999999,"5min":5.3799999999999999,"15min":5.3799999999999999},"last":1.27},{"interface":"front","average":{"1min":1.23,"5min":1.306,"15min":1.2789999999999999},"min":{"1min":0.76400000000000001,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.708,"5min":10.669,"15min":10.669},"last":1.3240000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.177,"15min":1.1830000000000001},"min":{"1min":0.80400000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":3.4809999999999999,"5min":3.4809999999999999,"15min":11.475},"last":1.012},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.266,"15min":1.2549999999999999},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":3.5339999999999998,"5min":5.3330000000000002,"15min":5.3330000000000002},"last":0.874}]},{"osd":4,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.2689999999999999,"15min":1.268},"min":{"1min":0.77500000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.341,"5min":10.632,"15min":10.632},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.167,"5min":1.202,"15min":1.234},"min":{"1min":0.71799999999999997,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.6220000000000001,"5min":5.8280000000000003,"15min":11.438000000000001},"last":0.91100000000000003}]},{"osd":5,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.234,"15min":1.25},"min":{"1min":0.874,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.5009999999999999,"5min":5.0759999999999996,"15min":5.2640000000000002},"last":1.129},{"interface":"front","average":{"1min":1.262,"5min":1.399,"15min":1.3700000000000001},"min":{"1min":0.85399999999999998,"5min":0.76000000000000001,"15min":0.628},"max":{"1min":1.526,"5min":10.592000000000001,"15min":10.592000000000001},"last":1.415}]},{"osd":7,"last update":"Thu Aug 17 00:14:06 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2789999999999999,"15min":1.3260000000000001},"min":{"1min":0.93600000000000005,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.7230000000000001,"5min":3.3450000000000002,"15min":11.51},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.367,"15min":1.391},"min":{"1min":0.96099999999999997,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.5669999999999999,"5min":5.4100000000000001,"15min":5.4100000000000001},"last":1.3480000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542291,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1921024,"data_stored":897873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":1.004,"15min":1.266},"min":{"1min":0.68999999999999995,"5min":0.51400000000000001,"15min":0.44700000000000001},"max":{"1min":1.383,"5min":2.1389999999999998,"15min":15.007999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.095,"5min":1.069,"15min":1.371},"min":{"1min":0.76900000000000002,"5min":0.629,"15min":0.51700000000000002},"max":{"1min":1.946,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.99099999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.093,"15min":1.119},"min":{"1min":0.79500000000000004,"5min":0.59199999999999997,"15min":0.498},"max":{"1min":1.746,"5min":1.746,"15min":4.2270000000000003},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.121,"15min":1.2809999999999999},"min":{"1min":0.73799999999999999,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4279999999999999,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.1479999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1519999999999999,"15min":1.4330000000000001},"min":{"1min":0.68999999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.8100000000000001,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.1339999999999999,"15min":1.345},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.60299999999999998},"max":{"1min":1.456,"5min":1.796,"15min":11.949},"last":1.0329999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1899999999999999,"15min":1.397},"min":{"1min":0.94199999999999995,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.8500000000000001,"5min":4.3250000000000002,"15min":13.125},"last":1.212},{"interface":"front","average":{"1min":1.268,"5min":1.2130000000000001,"15min":1.347},"min":{"1min":0.871,"5min":0.77900000000000003,"15min":0.63400000000000001},"max":{"1min":1.887,"5min":2.306,"15min":8.4809999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.139,"15min":1.4650000000000001},"min":{"1min":0.76800000000000002,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7,"5min":2.2789999999999999,"15min":17.510000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.234,"15min":1.583},"min":{"1min":0.77200000000000002,"5min":0.61299999999999999,"15min":0.54000000000000004},"max":{"1min":1.8819999999999999,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.167}]},{"osd":6,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.236,"15min":1.5609999999999999},"min":{"1min":0.79800000000000004,"5min":0.70299999999999996,"15min":0.60099999999999998},"max":{"1min":1.5780000000000001,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.117},{"interface":"front","average":{"1min":1.153,"5min":1.224,"15min":1.556},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.64400000000000002},"max":{"1min":1.569,"5min":3.4159999999999999,"15min":17.050000000000001},"last":0.876}]},{"osd":7,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.3260000000000001,"15min":1.671},"min":{"1min":0.76300000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.923,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.248},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3640000000000001,"15min":1.6299999999999999},"min":{"1min":0.90100000000000002,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.978,"5min":2.0899999999999999,"15min":14.818},"last":1.276}]}]},{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307288,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064552,"statfs":{"total":96636764160,"available":96322101248,"internally_reserved":0,"allocated":1916928,"data_stored":897783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80700000000000005,"15min":0.78900000000000003},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.32000000000000001},"max":{"1min":1.2829999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.91000000000000003,"15min":0.85899999999999999},"min":{"1min":0.63400000000000001,"5min":0.42199999999999999,"15min":0.38100000000000001},"max":{"1min":1.3240000000000001,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.96499999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":3.274,"5min":3.274,"15min":11.215999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.873,"15min":0.89200000000000002},"min":{"1min":0.54000000000000004,"5min":0.40699999999999997,"15min":0.35499999999999998},"max":{"1min":1.1379999999999999,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.014}]},{"osd":2,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.877,"15min":0.90300000000000002},"min":{"1min":0.54000000000000004,"5min":0.46200000000000002,"15min":0.33800000000000002},"max":{"1min":1.587,"5min":1.7929999999999999,"15min":2.0270000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1,"15min":1.0289999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.4139999999999999,"5min":1.6890000000000001,"15min":2.6360000000000001},"last":1.288}]},{"osd":4,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.1890000000000001,"15min":1.2},"min":{"1min":0.92400000000000004,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6799999999999999,"5min":2.274,"15min":3.9449999999999998},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.175,"15min":1.204},"min":{"1min":0.79300000000000004,"5min":0.60399999999999998,"15min":0.56699999999999995},"max":{"1min":1.5269999999999999,"5min":1.649,"15min":3.9790000000000001},"last":1.3080000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.1499999999999999,"15min":1.2030000000000001},"min":{"1min":0.77900000000000003,"5min":0.56999999999999995,"15min":0.54600000000000004},"max":{"1min":1.522,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.23},{"interface":"front","average":{"1min":1.224,"5min":1.22,"15min":1.2509999999999999},"min":{"1min":0.66800000000000004,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.53,"5min":1.669,"15min":2.6789999999999998},"last":1.375}]},{"osd":6,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.1830000000000001,"15min":1.228},"min":{"1min":0.76300000000000001,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.702,"5min":1.7589999999999999,"15min":3.4249999999999998},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2170000000000001,"15min":1.2030000000000001},"min":{"1min":0.86099999999999999,"5min":0.625,"15min":0.48399999999999999},"max":{"1min":1.514,"5min":2.0979999999999999,"15min":3.585},"last":1.048}]},{"osd":7,"last update":"Thu Aug 17 00:14:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.246,"15min":1.238},"min":{"1min":0.92700000000000005,"5min":0.68300000000000005,"15min":0.52600000000000002},"max":{"1min":1.5209999999999999,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2030000000000001,"15min":1.2250000000000001},"min":{"1min":0.85099999999999998,"5min":0.66000000000000003,"15min":0.64000000000000001},"max":{"1min":1.5640000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1679999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311384,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060456,"statfs":{"total":96636764160,"available":96317906944,"internally_reserved":0,"allocated":1916928,"data_stored":898585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.41799999999999998,"5min":0.38600000000000001,"15min":0.34599999999999997},"max":{"1min":1.855,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79000000000000004,"15min":0.89200000000000002},"min":{"1min":0.45800000000000002,"5min":0.317,"15min":0.28799999999999998},"max":{"1min":1.1950000000000001,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.68999999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":0.87,"15min":0.88},"min":{"1min":0.51300000000000001,"5min":0.47499999999999998,"15min":0.35999999999999999},"max":{"1min":4.4160000000000004,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.016,"15min":1.0369999999999999},"min":{"1min":0.57599999999999996,"5min":0.376,"15min":0.376},"max":{"1min":4.3150000000000004,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93300000000000005,"15min":1.0680000000000001},"min":{"1min":0.63400000000000001,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.135,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.92400000000000004,"15min":0.96299999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.5600000000000001,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":0.92200000000000004}]},{"osd":4,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.9590000000000001,"5min":1.256,"15min":1.4990000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":18.597999999999999,"5min":18.597999999999999,"15min":18.597999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.3440000000000001,"15min":1.4379999999999999},"min":{"1min":0.753,"5min":0.68000000000000005,"15min":0.60099999999999998},"max":{"1min":17.988,"5min":17.988,"15min":17.988},"last":0.88200000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.28,"15min":1.5029999999999999},"min":{"1min":0.90100000000000002,"5min":0.63200000000000001,"15min":0.58799999999999997},"max":{"1min":1.6279999999999999,"5min":1.873,"15min":12.914},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.216,"15min":1.3680000000000001},"min":{"1min":0.746,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.472,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.153,"15min":1.431},"min":{"1min":0.74299999999999999,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.512,"5min":1.621,"15min":13.864000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.234,"5min":1.2689999999999999,"15min":1.4990000000000001},"min":{"1min":0.85699999999999998,"5min":0.84499999999999997,"15min":0.71799999999999997},"max":{"1min":1.542,"5min":1.9359999999999999,"15min":12.698},"last":0.93300000000000005}]},{"osd":7,"last update":"Thu Aug 17 00:14:15 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.2949999999999999,"15min":1.4850000000000001},"min":{"1min":0.84199999999999997,"5min":0.79300000000000004,"15min":0.69599999999999995},"max":{"1min":1.7609999999999999,"5min":2.6779999999999999,"15min":10.592000000000001},"last":1.169},{"interface":"front","average":{"1min":1.256,"5min":1.2969999999999999,"15min":1.494},"min":{"1min":0.84199999999999997,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.7749999999999999,"5min":1.9159999999999999,"15min":11.417},"last":1.1259999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303188,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068652,"statfs":{"total":96636764160,"available":96326299648,"internally_reserved":0,"allocated":1912832,"data_stored":897161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.83799999999999997,"15min":0.82199999999999995},"min":{"1min":0.625,"5min":0.309,"15min":0.309},"max":{"1min":0.997,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84899999999999998,"15min":0.89700000000000002},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2310000000000001,"5min":1.367,"15min":13.093},"last":1.238}]},{"osd":2,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.77900000000000003,"15min":0.80200000000000005},"min":{"1min":0.504,"5min":0.314,"15min":0.314},"max":{"1min":0.95999999999999996,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":1.0780000000000001},{"interface":"front","average":{"1min":0.872,"5min":0.86799999999999999,"15min":0.88800000000000001},"min":{"1min":0.57499999999999996,"5min":0.432,"15min":0.432},"max":{"1min":1.325,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97299999999999998,"15min":1.0109999999999999},"min":{"1min":0.63200000000000001,"5min":0.55700000000000005,"15min":0.437},"max":{"1min":1.385,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.272},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.88,"15min":0.95099999999999996},"min":{"1min":0.54500000000000004,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.121,"5min":3.3700000000000001,"15min":12.981999999999999},"last":1.117}]},{"osd":4,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.026,"15min":1.1399999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.1319999999999999,"5min":1.671,"15min":20.548999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.1439999999999999,"15min":1.2},"min":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.59699999999999998},"max":{"1min":1.46,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.375}]},{"osd":5,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.198,"15min":1.296},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.4259999999999999,"5min":3.137,"15min":13.170999999999999},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.1799999999999999,"15min":1.24},"min":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5920000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3899999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.1950000000000001,"15min":1.248},"min":{"1min":0.68999999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.556,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.181,"15min":1.2050000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5369999999999999,"5min":2.472,"15min":5.5359999999999996},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:13:57 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.276,"15min":1.304},"min":{"1min":0.873,"5min":0.80500000000000005,"15min":0.79100000000000004},"max":{"1min":1.702,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.444},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2709999999999999,"15min":1.333},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.5880000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.419}]}]},{"osd":0,"up_from":14,"seq":60129542291,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311384,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060456,"statfs":{"total":96636764160,"available":96317906944,"internally_reserved":0,"allocated":1916928,"data_stored":898065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.96799999999999997,"15min":0.83199999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.212,"5min":18.442,"15min":18.442},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.91200000000000003,"15min":0.83099999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.242,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":1.0700000000000001,"15min":0.94299999999999995},"min":{"1min":0.622,"5min":0.45100000000000001,"15min":0.34999999999999998},"max":{"1min":1.232,"5min":18.481999999999999,"15min":18.481999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.97399999999999998,"15min":0.91200000000000003},"min":{"1min":0.55500000000000005,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.21,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.877,"15min":0.85699999999999998},"min":{"1min":0.46899999999999997,"5min":0.41699999999999998,"15min":0.39800000000000002},"max":{"1min":1.2210000000000001,"5min":1.5840000000000001,"15min":1.613},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.94899999999999995,"5min":1.202,"15min":1.0620000000000001},"min":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.45800000000000002},"max":{"1min":1.347,"5min":18.577000000000002,"15min":18.577000000000002},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.0800000000000001,"15min":1.0940000000000001},"min":{"1min":0.84099999999999997,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.454,"5min":1.728,"15min":1.7609999999999999},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.157,"5min":1.3740000000000001,"15min":1.2490000000000001},"min":{"1min":0.72199999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.5349999999999999,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.405,"15min":1.2949999999999999},"min":{"1min":0.78300000000000003,"5min":0.74199999999999999,"15min":0.67700000000000005},"max":{"1min":1.5049999999999999,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.175},{"interface":"front","average":{"1min":1.157,"5min":1.218,"15min":1.2410000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.6379999999999999,"5min":1.984,"15min":1.984},"last":1.1539999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.401,"15min":1.3049999999999999},"min":{"1min":0.76300000000000001,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.466,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.3740000000000001,"15min":1.278},"min":{"1min":0.91400000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.401,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.266}]},{"osd":7,"last update":"Thu Aug 17 00:14:08 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.407,"15min":1.3},"min":{"1min":0.93200000000000005,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.4199999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1850000000000001,"15min":1.2130000000000001},"min":{"1min":0.80300000000000005,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.5700000000000001,"5min":1.786,"15min":2.0750000000000002},"last":1.226}]}]},{"osd":4,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307292,"kb_used_data":1876,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064548,"statfs":{"total":96636764160,"available":96322097152,"internally_reserved":0,"allocated":1921024,"data_stored":897797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":1.0580000000000001,"15min":1.0700000000000001},"min":{"1min":0.71499999999999997,"5min":0.52200000000000002,"15min":0.38300000000000001},"max":{"1min":1.2290000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":1.53},{"interface":"front","average":{"1min":0.97799999999999998,"5min":1.1200000000000001,"15min":1.0609999999999999},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":1.8169999999999999,"5min":7.7380000000000004,"15min":7.7380000000000004},"last":1.6299999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2450000000000001,"15min":1.222},"min":{"1min":0.751,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.304,"5min":7.0469999999999997,"15min":8.3800000000000008},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.2,"15min":1.228},"min":{"1min":0.77900000000000003,"5min":0.65100000000000002,"15min":0.48099999999999998},"max":{"1min":1.385,"5min":6.9000000000000004,"15min":6.9000000000000004},"last":1.3700000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.1419999999999999,"15min":1.228},"min":{"1min":0.66100000000000003,"5min":0.58399999999999996,"15min":0.47399999999999998},"max":{"1min":1.357,"5min":6.6500000000000004,"15min":18.431000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.095,"15min":1.323},"min":{"1min":0.78600000000000003,"5min":0.72399999999999998,"15min":0.36699999999999999},"max":{"1min":1.1850000000000001,"5min":1.738,"15min":36.531999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.111,"15min":1.1240000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.8600000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.2210000000000001,"15min":1.3939999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.4650000000000001,"5min":6.6920000000000002,"15min":36.530000000000001},"last":1.3440000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.222,"15min":1.2410000000000001},"min":{"1min":0.89100000000000001,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.3799999999999999,"5min":5.2720000000000002,"15min":6.3250000000000002},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.254,"15min":1.2909999999999999},"min":{"1min":0.85499999999999998,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.4990000000000001,"5min":5.4569999999999999,"15min":9.4120000000000008},"last":1.323}]},{"osd":6,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.288,"15min":1.3380000000000001},"min":{"1min":0.69299999999999995,"5min":0.60099999999999998,"15min":0.44700000000000001},"max":{"1min":1.546,"5min":6.9320000000000004,"15min":8.4190000000000005},"last":1.6850000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.3069999999999999,"15min":1.3879999999999999},"min":{"1min":0.91400000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.496,"5min":2.5619999999999998,"15min":6.1689999999999996},"last":1.276}]},{"osd":7,"last update":"Thu Aug 17 00:14:03 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.196,"15min":1.27},"min":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.506,"5min":3.645,"15min":3.645},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.333,"15min":1.405},"min":{"1min":0.84599999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.7210000000000001,"5min":6.7430000000000003,"15min":8.327},"last":1.4550000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:14:47.567 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:14:47.568 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:14:47.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.766+0000 7fad3b21b700 1 Processor -- start 2023-08-17T00:14:47.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.766+0000 7fad3b21b700 1 -- start start 2023-08-17T00:14:47.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad3b21b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fad34153ab0 0x7fad34153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad3b21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad340c7ba0 0x7fad340c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad3b21b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad340aa750 con 0x7fad340c8d50 2023-08-17T00:14:47.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad3b21b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad340c9dd0 con 0x7fad34153ab0 2023-08-17T00:14:47.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad3b21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340aacf0 con 0x7fad340c7ba0 2023-08-17T00:14:47.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad33fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fad340c8d50 0x7fad340c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37860/0 (socket says 172.21.15.153:37860) 2023-08-17T00:14:47.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad33fff700 1 -- 172.21.15.153:0/1735191238 learned_addr learned my addr 172.21.15.153:0/1735191238 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:47.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad38fb7700 1 --2- 172.21.15.153:0/1735191238 >> v2:172.21.15.153:3300/0 conn(0x7fad34153ab0 0x7fad34153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad397b8700 1 --2- 172.21.15.153:0/1735191238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad340c7ba0 0x7fad340c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad337fe700 1 -- 172.21.15.153:0/1735191238 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415090820 0 0) 0x7fad340aa750 con 0x7fad340c8d50 2023-08-17T00:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad337fe700 1 -- 172.21.15.153:0/1735191238 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad240033f0 con 0x7fad340c8d50 2023-08-17T00:14:47.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad38fb7700 1 -- 172.21.15.153:0/1735191238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad340c7ba0 msgr2=0x7fad340c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad38fb7700 1 --2- 172.21.15.153:0/1735191238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad340c7ba0 0x7fad340c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad38fb7700 1 -- 172.21.15.153:0/1735191238 >> v1:172.21.15.153:6789/0 conn(0x7fad340c8d50 legacy=0x7fad340c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad38fb7700 1 -- 172.21.15.153:0/1735191238 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad340c5ca0 con 0x7fad34153ab0 2023-08-17T00:14:47.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad38fb7700 1 --2- 172.21.15.153:0/1735191238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad34153ab0 0x7fad34153e90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fad28009760 tx=0x7fad28009060).ready entity=mon.0 client_cookie=6679adbc63151db3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.770+0000 7fad337fe700 1 -- 172.21.15.153:0/1735191238 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad280090d0 con 0x7fad34153ab0 2023-08-17T00:14:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad337fe700 1 -- 172.21.15.153:0/1735191238 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2800d4a0 con 0x7fad34153ab0 2023-08-17T00:14:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad337fe700 1 -- 172.21.15.153:0/1735191238 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2800d820 con 0x7fad34153ab0 2023-08-17T00:14:47.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 -- 172.21.15.153:0/1735191238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad34153ab0 msgr2=0x7fad34153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 --2- 172.21.15.153:0/1735191238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad34153ab0 0x7fad34153e90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 rx=0x7fad28009760 tx=0x7fad28009060).stop 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 -- 172.21.15.153:0/1735191238 shutdown_connections 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 --2- 172.21.15.153:0/1735191238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad340c7ba0 0x7fad340c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 --2- 172.21.15.153:0/1735191238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad34153ab0 0x7fad34153e90 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 -- 172.21.15.153:0/1735191238 >> 172.21.15.153:0/1735191238 conn(0x7fad34061fa0 msgr2=0x7fad340623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 -- 172.21.15.153:0/1735191238 shutdown_connections 2023-08-17T00:14:47.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 -- 172.21.15.153:0/1735191238 wait complete. 2023-08-17T00:14:47.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 Processor -- start 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.774+0000 7fad3b21b700 1 -- start start 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad340c7ba0 0x7fad340c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 0x7fad340adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad34153ab0 0x7fad3414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340aeee0 con 0x7fad340c8d50 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad340ae050 con 0x7fad340c7ba0 2023-08-17T00:14:47.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad340ae2d0 con 0x7fad34153ab0 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 0x7fad340adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 0x7fad340adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55066/0 (socket says 172.21.15.153:55066) 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 -- 172.21.15.153:0/2512021857 learned_addr learned my addr 172.21.15.153:0/2512021857 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad38fb7700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad340c7ba0 0x7fad340c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad397b8700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad34153ab0 0x7fad3414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 -- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad34153ab0 msgr2=0x7fad3414eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad34153ab0 0x7fad3414eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 -- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad340c7ba0 msgr2=0x7fad340c3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad340c7ba0 0x7fad340c3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 -- 172.21.15.153:0/2512021857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad280092a0 con 0x7fad340c8d50 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad33fff700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 0x7fad340adb60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fad2000c470 tx=0x7fad20007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200072e0 con 0x7fad340c8d50 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad20007440 con 0x7fad340c8d50 2023-08-17T00:14:47.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad340ae5b0 con 0x7fad340c8d50 2023-08-17T00:14:47.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad200057a0 con 0x7fad340c8d50 2023-08-17T00:14:47.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad340aeb70 con 0x7fad340c8d50 2023-08-17T00:14:47.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.778+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad340af090 con 0x7fad340c8d50 2023-08-17T00:14:47.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.782+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fad20010070 con 0x7fad340c8d50 2023-08-17T00:14:47.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.782+0000 7fad30ff9700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1805a150 0x7fad1805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:47.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.782+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fad20073890 con 0x7fad340c8d50 2023-08-17T00:14:47.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.782+0000 7fad38fb7700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1805a150 0x7fad1805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:47.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.786+0000 7fad38fb7700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1805a150 0x7fad1805c610 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fad2800d260 tx=0x7fad28016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:47.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:47.790+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad340af090 con 0x7fad340c8d50 2023-08-17T00:14:48.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.006+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fad340af090 con 0x7fad340c8d50 2023-08-17T00:14:48.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.014+0000 7fad30ff9700 1 -- 172.21.15.153:0/2512021857 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7fad340af090 con 0x7fad340c8d50 2023-08-17T00:14:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1805a150 msgr2=0x7fad1805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1805a150 0x7fad1805c610 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fad2800d260 tx=0x7fad28016000).stop 2023-08-17T00:14:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 msgr2=0x7fad340adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 0x7fad340adb60 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 rx=0x7fad2000c470 tx=0x7fad20007c50).stop 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 shutdown_connections 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1805a150 0x7fad1805c610 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad34153ab0 0x7fad3414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad340c8d50 0x7fad340adb60 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 --2- 172.21.15.153:0/2512021857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad340c7ba0 0x7fad340c3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 >> 172.21.15.153:0/2512021857 conn(0x7fad34061fa0 msgr2=0x7fad34063ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:48.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 shutdown_connections 2023-08-17T00:14:48.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.018+0000 7fad3b21b700 1 -- 172.21.15.153:0/2512021857 wait complete. 2023-08-17T00:14:48.024 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:14:48.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:14:48.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.198+0000 7fdf34a5b700 1 Processor -- start 2023-08-17T00:14:48.204 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.198+0000 7fdf34a5b700 1 -- start start 2023-08-17T00:14:48.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf34a5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf300c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:48.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf34a5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf30068020 0x7fdf300684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:48.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf34a5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300bdc20 con 0x7fdf300ab220 2023-08-17T00:14:48.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf34a5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf30152310 con 0x7fdf30068020 2023-08-17T00:14:48.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf34a5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30068990 con 0x7fdf300aae40 2023-08-17T00:14:48.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf30068020 0x7fdf300684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:48.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fdf30068020 0x7fdf300684a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55072/0 (socket says 172.21.15.153:55072) 2023-08-17T00:14:48.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 -- 172.21.15.153:0/2325744476 learned_addr learned my addr 172.21.15.153:0/2325744476 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf27fff700 1 --1- 172.21.15.153:0/2325744476 >> v1:172.21.15.153:6789/0 conn(0x7fdf300ab220 0x7fdf30152e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37862/0 (socket says 172.21.15.153:37862) 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2e59c700 1 --2- 172.21.15.153:0/2325744476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf300c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 -- 172.21.15.153:0/2325744476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 msgr2=0x7fdf300c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 --2- 172.21.15.153:0/2325744476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf300c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 -- 172.21.15.153:0/2325744476 >> v1:172.21.15.153:6789/0 conn(0x7fdf300ab220 legacy=0x7fdf30152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 -- 172.21.15.153:0/2325744476 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300c38e0 con 0x7fdf30068020 2023-08-17T00:14:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2ed9d700 1 --2- 172.21.15.153:0/2325744476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf30068020 0x7fdf300684a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fdf28009f20 tx=0x7fdf28009840).ready entity=mon.0 client_cookie=39b08c3204c6daed server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:48.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2dd9b700 1 -- 172.21.15.153:0/2325744476 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800e070 con 0x7fdf30068020 2023-08-17T00:14:48.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2dd9b700 1 -- 172.21.15.153:0/2325744476 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800ba80 con 0x7fdf30068020 2023-08-17T00:14:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.202+0000 7fdf2dd9b700 1 -- 172.21.15.153:0/2325744476 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800be00 con 0x7fdf30068020 2023-08-17T00:14:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- 172.21.15.153:0/2325744476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf30068020 msgr2=0x7fdf300684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/2325744476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf30068020 0x7fdf300684a0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 rx=0x7fdf28009f20 tx=0x7fdf28009840).stop 2023-08-17T00:14:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- 172.21.15.153:0/2325744476 shutdown_connections 2023-08-17T00:14:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/2325744476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf30068020 0x7fdf300684a0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/2325744476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf300c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- 172.21.15.153:0/2325744476 >> 172.21.15.153:0/2325744476 conn(0x7fdf300c5e20 msgr2=0x7fdf300652c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- 172.21.15.153:0/2325744476 shutdown_connections 2023-08-17T00:14:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- 172.21.15.153:0/2325744476 wait complete. 2023-08-17T00:14:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 Processor -- start 2023-08-17T00:14:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- start start 2023-08-17T00:14:48.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf30068020 0x7fdf30162c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:48.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf301509d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:48.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 0x7fdf300a9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300c18f0 con 0x7fdf300c1d80 2023-08-17T00:14:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30163120 con 0x7fdf30068020 2023-08-17T00:14:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.206+0000 7fdf34a5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300c0ce0 con 0x7fdf300aae40 2023-08-17T00:14:48.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf2ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 0x7fdf300a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:48.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf301509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf2ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 0x7fdf300a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55082/0 (socket says 172.21.15.153:55082) 2023-08-17T00:14:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf2ed9d700 1 -- 172.21.15.153:0/3479112670 learned_addr learned my addr 172.21.15.153:0/3479112670 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf2e59c700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf30068020 0x7fdf30162c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 -- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf30068020 msgr2=0x7fdf30162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf30068020 0x7fdf30162c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 -- 172.21.15.153:0/3479112670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 msgr2=0x7fdf300a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 0x7fdf300a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 -- 172.21.15.153:0/3479112670 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009ae0 con 0x7fdf300aae40 2023-08-17T00:14:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf2ed9d700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 0x7fdf300a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf27fff700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf301509d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fdf300a8360 tx=0x7fdf18007d30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180070d0 con 0x7fdf300aae40 2023-08-17T00:14:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf18007230 con 0x7fdf300aae40 2023-08-17T00:14:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300c0fc0 con 0x7fdf300aae40 2023-08-17T00:14:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180075b0 con 0x7fdf300aae40 2023-08-17T00:14:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf300c1580 con 0x7fdf300aae40 2023-08-17T00:14:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.210+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf300c1aa0 con 0x7fdf300aae40 2023-08-17T00:14:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.214+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fdf1801a060 con 0x7fdf300aae40 2023-08-17T00:14:48.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.214+0000 7fdf267fc700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf1005a1d0 0x7fdf1005c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:48.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.214+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fdf18073760 con 0x7fdf300aae40 2023-08-17T00:14:48.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.214+0000 7fdf2e59c700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf1005a1d0 0x7fdf1005c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:48.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.214+0000 7fdf2e59c700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf1005a1d0 0x7fdf1005c690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fdf2000bbc0 tx=0x7fdf20008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:48.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.222+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fdf18047230 con 0x7fdf300aae40 2023-08-17T00:14:48.407 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:14:48.402+0000 7fbba0779700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:14:48.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.426+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf300c1a60 con 0x7fdf300aae40 2023-08-17T00:14:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf267fc700 1 -- 172.21.15.153:0/3479112670 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4511 (secure 0 0 0) 0x7fdf18018070 con 0x7fdf300aae40 2023-08-17T00:14:48.433 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:48.434 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:14:42.884494+0000","modified":"2023-08-17T00:14:45.904108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4258690159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4258690159},{"type":"v1","addr":"172.21.15.153:6835","nonce":4258690159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T00:14:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf1005a1d0 msgr2=0x7fdf1005c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf1005a1d0 0x7fdf1005c690 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fdf2000bbc0 tx=0x7fdf20008040).stop 2023-08-17T00:14:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 msgr2=0x7fdf301509d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf301509d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fdf300a8360 tx=0x7fdf18007d30).stop 2023-08-17T00:14:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 shutdown_connections 2023-08-17T00:14:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fdf1005a1d0 0x7fdf1005c690 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fdf300c1d80 0x7fdf300a9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf300aae40 0x7fdf301509d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 --2- 172.21.15.153:0/3479112670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf30068020 0x7fdf30162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 >> 172.21.15.153:0/3479112670 conn(0x7fdf300c5e20 msgr2=0x7fdf30151620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 shutdown_connections 2023-08-17T00:14:48.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:48.430+0000 7fdf34a5b700 1 -- 172.21.15.153:0/3479112670 wait complete. 2023-08-17T00:14:48.439 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 122 2023-08-17T00:14:48.859 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 122, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:14:42.884494+0000', 'modified': '2023-08-17T00:14:45.904108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8982}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8982': {'gid': 8982, 'name': 'a', 'rank': 0, 'incarnation': 118, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/4258690159', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 4258690159}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 4258690159}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:14:48.860 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:14:48.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:14:49.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 Processor -- start 2023-08-17T00:14:49.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 -- start start 2023-08-17T00:14:49.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7f380c8d50 0x7f7f380c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f380c7490 0x7f7f380c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f380aa750 con 0x7f7f380c7490 2023-08-17T00:14:49.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f380c7e30 con 0x7f7f380c8d50 2023-08-17T00:14:49.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3f569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f380c9dd0 con 0x7f7f38153ab0 2023-08-17T00:14:49.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f380c7490 0x7f7f380c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7f380c7490 0x7f7f380c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55092/0 (socket says 172.21.15.153:55092) 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 -- 172.21.15.153:0/150848803 learned_addr learned my addr 172.21.15.153:0/150848803 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3d305700 1 --2- 172.21.15.153:0/150848803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/150848803 >> v2:172.21.15.178:3300/0 conn(0x7f7f380c8d50 0x7f7f380c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 -- 172.21.15.153:0/150848803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 msgr2=0x7f7f38153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 --2- 172.21.15.153:0/150848803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 -- 172.21.15.153:0/150848803 >> v2:172.21.15.178:3300/0 conn(0x7f7f380c8d50 msgr2=0x7f7f380c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 --2- 172.21.15.153:0/150848803 >> v2:172.21.15.178:3300/0 conn(0x7f7f380c8d50 0x7f7f380c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3db06700 1 -- 172.21.15.153:0/150848803 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f380aacf0 con 0x7f7f380c7490 2023-08-17T00:14:49.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.026+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/150848803 >> v2:172.21.15.178:3300/0 conn(0x7f7f380c8d50 0x7f7f380c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:49.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3db06700 1 --2- 172.21.15.153:0/150848803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c7490 0x7f7f380c7940 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f7f3805e680 tx=0x7f7f30009840).ready entity=mon.0 client_cookie=b03e6ee0e4cbf203 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f2ffff700 1 -- 172.21.15.153:0/150848803 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000e070 con 0x7f7f380c7490 2023-08-17T00:14:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f2ffff700 1 -- 172.21.15.153:0/150848803 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3000ba20 con 0x7f7f380c7490 2023-08-17T00:14:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f2ffff700 1 -- 172.21.15.153:0/150848803 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3000bda0 con 0x7f7f380c7490 2023-08-17T00:14:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 -- 172.21.15.153:0/150848803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c7490 msgr2=0x7f7f380c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 --2- 172.21.15.153:0/150848803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c7490 0x7f7f380c7940 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 rx=0x7f7f3805e680 tx=0x7f7f30009840).stop 2023-08-17T00:14:49.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 -- 172.21.15.153:0/150848803 shutdown_connections 2023-08-17T00:14:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 --2- 172.21.15.153:0/150848803 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c7490 0x7f7f380c7940 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 --2- 172.21.15.153:0/150848803 >> v2:172.21.15.178:3300/0 conn(0x7f7f380c8d50 0x7f7f380c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 --2- 172.21.15.153:0/150848803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 -- 172.21.15.153:0/150848803 >> 172.21.15.153:0/150848803 conn(0x7f7f38061fa0 msgr2=0x7f7f380623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 -- 172.21.15.153:0/150848803 shutdown_connections 2023-08-17T00:14:49.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.030+0000 7f7f3f569700 1 -- 172.21.15.153:0/150848803 wait complete. 2023-08-17T00:14:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 Processor -- start 2023-08-17T00:14:49.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 -- start start 2023-08-17T00:14:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f380c7490 0x7f7f38150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 0x7f7f381548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38155360 con 0x7f7f380c8d50 2023-08-17T00:14:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38155640 con 0x7f7f380c7490 2023-08-17T00:14:49.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3f569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f38155920 con 0x7f7f38153ab0 2023-08-17T00:14:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 0x7f7f381548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 0x7f7f381548a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55098/0 (socket says 172.21.15.153:55098) 2023-08-17T00:14:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 -- 172.21.15.153:0/3517459626 learned_addr learned my addr 172.21.15.153:0/3517459626 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3db06700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f380c7490 0x7f7f38150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 -- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 msgr2=0x7f7f38154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 -- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f380c7490 msgr2=0x7f7f38150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f380c7490 0x7f7f38150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 -- 172.21.15.153:0/3517459626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30009ae0 con 0x7f7f380c8d50 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f380c7490 0x7f7f38150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:49.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 0x7f7f381548a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f7f2800d860 tx=0x7f7f28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f2d7fa700 1 -- 172.21.15.153:0/3517459626 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f280125f0 con 0x7f7f380c8d50 2023-08-17T00:14:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f2d7fa700 1 -- 172.21.15.153:0/3517459626 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f28012750 con 0x7f7f380c8d50 2023-08-17T00:14:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.034+0000 7f7f2d7fa700 1 -- 172.21.15.153:0/3517459626 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28012ad0 con 0x7f7f380c8d50 2023-08-17T00:14:49.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.038+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f380a17a0 con 0x7f7f380c8d50 2023-08-17T00:14:49.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.038+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f380c3c40 con 0x7f7f380c8d50 2023-08-17T00:14:49.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.042+0000 7f7f2d7fa700 1 -- 172.21.15.153:0/3517459626 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7f28013480 con 0x7f7f380c8d50 2023-08-17T00:14:49.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.042+0000 7f7f2d7fa700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f1c05a150 0x7f7f1c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.042+0000 7f7f2d7fa700 1 -- 172.21.15.153:0/3517459626 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7f28074120 con 0x7f7f380c8d50 2023-08-17T00:14:49.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.042+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f1c05a150 0x7f7f1c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f1c05a150 0x7f7f1c05c610 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f7f34006d80 tx=0x7f7f34008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 Processor -- start 2023-08-17T00:14:49.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 -- start start 2023-08-17T00:14:49.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 0x19f7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19215c0 con 0x19f7a10 2023-08-17T00:14:49.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1936e90 con 0x19fa2f0 2023-08-17T00:14:49.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x18fd220 con 0x19b67f0 2023-08-17T00:14:49.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 0x19f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 0x19f7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55108/0 (socket says 172.21.15.153:55108) 2023-08-17T00:14:49.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 -- 172.21.15.153:0/2088958136 learned_addr learned my addr 172.21.15.153:0/2088958136 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 -- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 msgr2=0x19f9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19f9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 -- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 msgr2=0x19b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 -- 172.21.15.153:0/2088958136 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1942500 con 0x19f7a10 2023-08-17T00:14:49.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 0x19f7df0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f7f34010a70 tx=0x7f7f34014000).ready entity=mon.0 client_cookie=a7ba358a453bd120 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f227fc700 1 -- 172.21.15.153:0/2088958136 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34010e50 con 0x19f7a10 2023-08-17T00:14:49.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f227fc700 1 -- 172.21.15.153:0/2088958136 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34015ac0 con 0x19f7a10 2023-08-17T00:14:49.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.046+0000 7f7f227fc700 1 -- 172.21.15.153:0/2088958136 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34015e40 con 0x19f7a10 2023-08-17T00:14:49.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 -- 172.21.15.153:0/2088958136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 msgr2=0x19f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 0x19f7df0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 rx=0x7f7f34010a70 tx=0x7f7f34014000).stop 2023-08-17T00:14:49.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 -- 172.21.15.153:0/2088958136 shutdown_connections 2023-08-17T00:14:49.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19f9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2088958136 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19f7a10 0x19f7df0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 -- 172.21.15.153:0/2088958136 >> 172.21.15.153:0/2088958136 conn(0x1795550 msgr2=0x19b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 -- 172.21.15.153:0/2088958136 shutdown_connections 2023-08-17T00:14:49.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 -- 172.21.15.153:0/2088958136 wait complete. 2023-08-17T00:14:49.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 -- start start 2023-08-17T00:14:49.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.050+0000 7f7f4992c740 1 Processor -- start 2023-08-17T00:14:49.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19f7a10 0x19db5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1902110 con 0x19fa2f0 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19e00d0 con 0x19f7a10 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19e0650 con 0x19b67f0 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 10 client.0 ll_register_callbacks cb 0x196e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55114/0 (socket says 172.21.15.153:55114) 2023-08-17T00:14:49.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 -- 172.21.15.153:0/2442548065 learned_addr learned my addr 172.21.15.153:0/2442548065 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19f7a10 0x19db5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 -- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 msgr2=0x19e0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19e0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 -- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19f7a10 msgr2=0x19db5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19f7a10 0x19db5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 -- 172.21.15.153:0/2442548065 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3400e070 con 0x19fa2f0 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19fd0c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f7f30010000 tx=0x7f7f380aac60).ready entity=mon.0 client_cookie=ffcadb03beba33ac server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f177fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:49.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f177fe700 1 -- 172.21.15.153:0/2442548065 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30013840 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f177fe700 1 -- 172.21.15.153:0/2442548065 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7f300139a0 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x192cc60 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f177fe700 1 -- 172.21.15.153:0/2442548065 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f30013d70 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 10 client.9120 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x192ff80 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f177fe700 1 -- 172.21.15.153:0/2442548065 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x192cc60 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f177fe700 1 -- 172.21.15.153:0/2442548065 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7f30026060 con 0x19fa2f0 2023-08-17T00:14:49.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 10 client.9120 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:49.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 10 client.9120 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:14:49.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 20 client.9120 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:49.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1a0a850 0x1a16470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 4 client.9120 mds_command: new command op to 8982 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:14:49.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.054+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19231b0 con 0x1a0a850 2023-08-17T00:14:49.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1a0a850 0x1a16470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1a0a850 0x1a16470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=89227a0cc86e0552 server_cookie=3f1813888ef5849f in_seq=0 out_seq=0 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f177fe700 10 client.9120 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f177fe700 1 -- 172.21.15.153:0/2442548065 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x19231b0 con 0x1a0a850 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f177fe700 10 client.9120 handle_command_reply: tid=0 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 client.9120 shutdown 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 msgr2=0x19fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19fd0c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 rx=0x7f7f30010000 tx=0x7f7f380aac60).stop 2023-08-17T00:14:49.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 shutdown_connections 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1a0a850 0x1a16470 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19fd0c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19f7a10 0x19db5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2442548065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19b67f0 0x19e0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f177fe700 0 client.9120 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 >> 172.21.15.153:0/2442548065 conn(0x1795550 msgr2=0x19f86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 shutdown_connections 2023-08-17T00:14:49.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 1 -- 172.21.15.153:0/2442548065 wait complete. 2023-08-17T00:14:49.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.058+0000 7f7f4992c740 20 client.9120 trim_cache size 0 max 16384 2023-08-17T00:14:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.078+0000 7f7f4992c740 1 Processor -- start 2023-08-17T00:14:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.078+0000 7f7f4992c740 1 -- start start 2023-08-17T00:14:49.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 0x19df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x19e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19db8f0 con 0x19fa2f0 2023-08-17T00:14:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1979db0 con 0x19b67f0 2023-08-17T00:14:49.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19b1b10 con 0x19f7a10 2023-08-17T00:14:49.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3d305700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 0x19df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3d305700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 0x19df8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:41954/0 (socket says 172.21.15.153:41954) 2023-08-17T00:14:49.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3d305700 1 -- 172.21.15.153:0/2308817102 learned_addr learned my addr 172.21.15.153:0/2308817102 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19df2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55120/0 (socket says 172.21.15.153:55120) 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x19e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 -- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 msgr2=0x19e1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x19e1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 -- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 msgr2=0x19df8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 0x19df8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 -- 172.21.15.153:0/2308817102 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38151450 con 0x19fa2f0 2023-08-17T00:14:49.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3d305700 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 0x19df8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:49.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f3db06700 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19df2b0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f7f30010000 tx=0x7f7f30020000).ready entity=mon.0 client_cookie=b93c490864cf4127 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f22ffd700 1 -- 172.21.15.153:0/2308817102 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30009400 con 0x19fa2f0 2023-08-17T00:14:49.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f22ffd700 1 -- 172.21.15.153:0/2308817102 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f30013420 con 0x19fa2f0 2023-08-17T00:14:49.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f22ffd700 1 -- 172.21.15.153:0/2308817102 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f30013840 con 0x19fa2f0 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 -- 172.21.15.153:0/2308817102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 msgr2=0x19df2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19df2b0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 rx=0x7f7f30010000 tx=0x7f7f30020000).stop 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 -- 172.21.15.153:0/2308817102 shutdown_connections 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19fa2f0 0x19df2b0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x19e1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 --2- 172.21.15.153:0/2308817102 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19b67f0 0x19df8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.082+0000 7f7f4992c740 1 -- 172.21.15.153:0/2308817102 >> 172.21.15.153:0/2308817102 conn(0x1795550 msgr2=0x1a1a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.086+0000 7f7f4992c740 1 -- 172.21.15.153:0/2308817102 shutdown_connections 2023-08-17T00:14:49.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.086+0000 7f7f4992c740 1 -- 172.21.15.153:0/2308817102 wait complete. 2023-08-17T00:14:49.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.086+0000 7f7f4992c740 1 -- start start 2023-08-17T00:14:49.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.086+0000 7f7f4992c740 1 Processor -- start 2023-08-17T00:14:49.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 0x1a5ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x1a5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19d9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a5ef10 con 0x19b67f0 2023-08-17T00:14:49.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19dabf0 con 0x19fa2f0 2023-08-17T00:14:49.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a5f480 con 0x19f7a10 2023-08-17T00:14:49.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 10 client.0 ll_register_callbacks cb 0x7f7f34006e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:49.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 0x1a5ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 0x1a5ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55128/0 (socket says 172.21.15.153:55128) 2023-08-17T00:14:49.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 -- 172.21.15.153:0/3629375525 learned_addr learned my addr 172.21.15.153:0/3629375525 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x1a5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 -- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 msgr2=0x1a5f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3db06700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19d9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x1a5f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 -- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 msgr2=0x19d9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19d9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 -- 172.21.15.153:0/3629375525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f34025040 con 0x19b67f0 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x1a5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3db06700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19d9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3d305700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 0x1a5ea20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f7f3401e000 tx=0x7f7f34023040).ready entity=mon.0 client_cookie=e6e9619c2c6cca16 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f177fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f177fe700 1 -- 172.21.15.153:0/3629375525 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34010e80 con 0x19b67f0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f177fe700 1 -- 172.21.15.153:0/3629375525 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7f3402f650 con 0x19b67f0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f34015ac0 con 0x19b67f0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f177fe700 1 -- 172.21.15.153:0/3629375525 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f3402fa20 con 0x19b67f0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 10 client.9126 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x192ff80 con 0x19b67f0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f177fe700 1 -- 172.21.15.153:0/3629375525 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34015ac0 con 0x19b67f0 2023-08-17T00:14:49.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f177fe700 1 -- 172.21.15.153:0/3629375525 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7f3402fb80 con 0x19b67f0 2023-08-17T00:14:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 10 client.9126 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 10 client.9126 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:14:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 20 client.9126 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x19df2b0 0x19df690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 4 client.9126 mds_command: new command op to 8982 tid=0[{"prefix": "status"}] 2023-08-17T00:14:49.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "status"}) v1 -- 0x17ec4e0 con 0x19df2b0 2023-08-17T00:14:49.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.090+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x19df2b0 0x19df690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3cb04700 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x19df2b0 0x19df690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d1c38fd7b5264272 server_cookie=4fdbe03e99502614 in_seq=0 out_seq=0 2023-08-17T00:14:49.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f177fe700 10 client.9126 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:49.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f177fe700 1 -- 172.21.15.153:0/3629375525 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x17ec4e0 con 0x19df2b0 2023-08-17T00:14:49.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f177fe700 10 client.9126 handle_command_reply: tid=0 2023-08-17T00:14:49.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 client.9126 shutdown 2023-08-17T00:14:49.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 msgr2=0x1a5ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 0x1a5ea20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 rx=0x7f7f3401e000 tx=0x7f7f34023040).stop 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 shutdown_connections 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x19df2b0 0x19df690 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19fa2f0 0x19d9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f177fe700 0 client.9126 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19f7a10 0x1a5f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 --2- 172.21.15.153:0/3629375525 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19b67f0 0x1a5ea20 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 >> 172.21.15.153:0/3629375525 conn(0x1795550 msgr2=0x19f62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 shutdown_connections 2023-08-17T00:14:49.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 1 -- 172.21.15.153:0/3629375525 wait complete. 2023-08-17T00:14:49.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f4992c740 20 client.9126 trim_cache size 0 max 16384 2023-08-17T00:14:49.103 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:14:49.103 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 8982, 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.2061234169999997, 2023-08-17T00:14:49.104 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 122, 2023-08-17T00:14:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 154, 2023-08-17T00:14:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 154, 2023-08-17T00:14:49.105 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.625162270000001 2023-08-17T00:14:49.105 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:14:49.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f1c05a150 msgr2=0x7f7f1c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f1c05a150 0x7f7f1c05c610 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f7f34006d80 tx=0x7f7f34008040).stop 2023-08-17T00:14:49.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 msgr2=0x7f7f381548a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 0x7f7f381548a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 rx=0x7f7f2800d860 tx=0x7f7f28008040).stop 2023-08-17T00:14:49.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 shutdown_connections 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7f1c05a150 0x7f7f1c05c610 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7f38153ab0 0x7f7f38154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7f380c8d50 0x7f7f381548a0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 --2- 172.21.15.153:0/3517459626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7f380c7490 0x7f7f38150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 >> 172.21.15.153:0/3517459626 conn(0x7f7f38061fa0 msgr2=0x7f7f38151bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 shutdown_connections 2023-08-17T00:14:49.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.094+0000 7f7f3f569700 1 -- 172.21.15.153:0/3517459626 wait complete. 2023-08-17T00:14:49.120 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:14:49.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.246+0000 7f66d5547700 1 Processor -- start 2023-08-17T00:14:49.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.246+0000 7f66d5547700 1 -- start start 2023-08-17T00:14:49.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66d00c5510 0x7f66d0151b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0156270 con 0x7f66d00c3720 2023-08-17T00:14:49.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66d0155660 con 0x7f66d00c5c50 2023-08-17T00:14:49.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66d0155940 con 0x7f66d00c5510 2023-08-17T00:14:49.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d4d46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f66d00c5510 0x7f66d0151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66c77fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f66d00c3720 0x7f66d0151440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37878/0 (socket says 172.21.15.153:37878) 2023-08-17T00:14:49.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66c77fe700 1 -- 172.21.15.153:0/5562392 learned_addr learned my addr 172.21.15.153:0/5562392 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d4d46700 1 -- 172.21.15.153:0/5562392 >> v1:172.21.15.178:6789/0 conn(0x7f66d00c5c50 legacy=0x7f66d00c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d4d46700 1 -- 172.21.15.153:0/5562392 >> v1:172.21.15.153:6789/0 conn(0x7f66d00c3720 legacy=0x7f66d0151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d4d46700 1 -- 172.21.15.153:0/5562392 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0155c20 con 0x7f66d00c5510 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66cf7fe700 1 -- 172.21.15.153:0/5562392 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 281006437 0 0) 0x7f66d0156270 con 0x7f66d00c3720 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d4d46700 1 --2- 172.21.15.153:0/5562392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c5510 0x7f66d0151b50 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f66c8009e60 tx=0x7f66c8009780).ready entity=mon.0 client_cookie=c31b977d84825b66 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66cf7fe700 1 -- 172.21.15.153:0/5562392 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c800e070 con 0x7f66d00c5510 2023-08-17T00:14:49.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66cf7fe700 1 -- 172.21.15.153:0/5562392 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c800bc30 con 0x7f66d00c5510 2023-08-17T00:14:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66cf7fe700 1 -- 172.21.15.153:0/5562392 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8012410 con 0x7f66d00c5510 2023-08-17T00:14:49.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- 172.21.15.153:0/5562392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c5510 msgr2=0x7f66d0151b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 --2- 172.21.15.153:0/5562392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c5510 0x7f66d0151b50 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 rx=0x7f66c8009e60 tx=0x7f66c8009780).stop 2023-08-17T00:14:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- 172.21.15.153:0/5562392 shutdown_connections 2023-08-17T00:14:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 --2- 172.21.15.153:0/5562392 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c5510 0x7f66d0151b50 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- 172.21.15.153:0/5562392 >> 172.21.15.153:0/5562392 conn(0x7f66d005dca0 msgr2=0x7f66d005e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- 172.21.15.153:0/5562392 shutdown_connections 2023-08-17T00:14:49.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.250+0000 7f66d5547700 1 -- 172.21.15.153:0/5562392 wait complete. 2023-08-17T00:14:49.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.254+0000 7f66d5547700 1 Processor -- start 2023-08-17T00:14:49.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.254+0000 7f66d5547700 1 -- start start 2023-08-17T00:14:49.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 0x7f66d00a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d00c5510 0x7f66d00aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d00c5c50 0x7f66d014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00a58d0 con 0x7f66d00c3720 2023-08-17T00:14:49.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00aabe0 con 0x7f66d00c5510 2023-08-17T00:14:49.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d00aaeb0 con 0x7f66d00c5c50 2023-08-17T00:14:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 0x7f66d00a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 0x7f66d00a53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55142/0 (socket says 172.21.15.153:55142) 2023-08-17T00:14:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 -- 172.21.15.153:0/1048239248 learned_addr learned my addr 172.21.15.153:0/1048239248 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66c77fe700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d00c5510 0x7f66d00aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d4d46700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d00c5c50 0x7f66d014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 -- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d00c5c50 msgr2=0x7f66d014a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d00c5c50 0x7f66d014a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 -- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d00c5510 msgr2=0x7f66d00aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d00c5510 0x7f66d00aa6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 -- 172.21.15.153:0/1048239248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c8009a20 con 0x7f66d00c3720 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66cffff700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 0x7f66d00a53e0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f66c000c4c0 tx=0x7f66c0007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0007020 con 0x7f66d00c3720 2023-08-17T00:14:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c0001e90 con 0x7f66d00c3720 2023-08-17T00:14:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d00ab190 con 0x7f66d00c3720 2023-08-17T00:14:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00073b0 con 0x7f66d00c3720 2023-08-17T00:14:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.258+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d00ab750 con 0x7f66d00c3720 2023-08-17T00:14:49.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.262+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d00c6cf0 con 0x7f66d00c3720 2023-08-17T00:14:49.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.262+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f66c0010070 con 0x7f66d00c3720 2023-08-17T00:14:49.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.262+0000 7f66ccff9700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66b005a150 0x7f66b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:49.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.266+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f66c00739b0 con 0x7f66d00c3720 2023-08-17T00:14:49.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.266+0000 7f66c77fe700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66b005a150 0x7f66b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:49.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.266+0000 7f66c77fe700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66b005a150 0x7f66b005c610 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f66d00aa2f0 tx=0x7f66b8007db0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:49.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.270+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f66d00c6cf0 con 0x7f66d00c3720 2023-08-17T00:14:49.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.470+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f66d005ec30 con 0x7f66d00c3720 2023-08-17T00:14:49.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66ccff9700 1 -- 172.21.15.153:0/1048239248 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v122) v1 ==== 53+0+73 (secure 0 0 0) 0x7f66c0047460 con 0x7f66d00c3720 2023-08-17T00:14:49.477 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:14:49.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66b005a150 msgr2=0x7f66b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66b005a150 0x7f66b005c610 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f66d00aa2f0 tx=0x7f66b8007db0).stop 2023-08-17T00:14:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 msgr2=0x7f66d00a53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 0x7f66d00a53e0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 rx=0x7f66c000c4c0 tx=0x7f66c0007e00).stop 2023-08-17T00:14:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 shutdown_connections 2023-08-17T00:14:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f66b005a150 0x7f66b005c610 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66d00c5c50 0x7f66d014a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f66d00c5510 0x7f66d00aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 --2- 172.21.15.153:0/1048239248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f66d00c3720 0x7f66d00a53e0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 >> 172.21.15.153:0/1048239248 conn(0x7f66d005dca0 msgr2=0x7f66d00a6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 shutdown_connections 2023-08-17T00:14:49.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:49.474+0000 7f66d5547700 1 -- 172.21.15.153:0/1048239248 wait complete. 2023-08-17T00:14:49.496 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:14:49.496 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:14:49.497 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:14:49.497 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:14:49.497 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:14:49.497 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:14:49.498 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:14:49.498 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:14:49.498 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:14:49.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.499 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:14:49.519 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:14:49.519 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:14:49.519 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:14:49.519 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.520 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:14:49.520 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:14:49.520 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:14:49.520 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:14:49.520 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:14:49.521 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:14:49.521 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:14:49.521 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:14:49.521 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:14:49.522 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:14:49.522 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:14:49.522 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41724sec preferred_lft 41724sec 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:14:49.523 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.524 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:14:49.525 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:14:49.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.527 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:14:49.605 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:14:49.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.609 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:14:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:14:49.676 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:14:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:14:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:14:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:14:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:14:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:14:49.677 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:14:49.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.678 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:14:49.678 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:14:49.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:14:49.679 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:14:49.680 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:14:49.680 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:14:49.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.824 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:14:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:14:49.843 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:14:49.844 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:14:49.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.845 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:14:49.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:49.920 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:14:49.979 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:14:49.980 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:14:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:14:50.100 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:14:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:14:50.122 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:14:50.126 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:14:50.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:14:50.127 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:14:50.158 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 damage ls 2023-08-17T00:14:50.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.362+0000 7f229969b700 1 Processor -- start 2023-08-17T00:14:50.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f229969b700 1 -- start start 2023-08-17T00:14:50.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f229969b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294151b90 0x7f2294151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f229969b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2294064870 0x7f2294064d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f229969b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2294065210 con 0x7f2294063290 2023-08-17T00:14:50.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f229969b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22940c3fb0 con 0x7f2294064870 2023-08-17T00:14:50.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f229969b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294152460 con 0x7f2294151b90 2023-08-17T00:14:50.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f22927fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2294063290 0x7f2294065660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37886/0 (socket says 172.21.15.153:37886) 2023-08-17T00:14:50.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f22927fc700 1 -- 172.21.15.153:0/4224571723 learned_addr learned my addr 172.21.15.153:0/4224571723 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:50.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f2292ffd700 1 --2- 172.21.15.153:0/4224571723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294151b90 0x7f2294151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.366+0000 7f22937fe700 1 --2- 172.21.15.153:0/4224571723 >> v2:172.21.15.178:3300/0 conn(0x7f2294064870 0x7f2294064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.370+0000 7f2292ffd700 1 -- 172.21.15.153:0/4224571723 >> v2:172.21.15.178:3300/0 conn(0x7f2294064870 msgr2=0x7f2294064d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.370+0000 7f2292ffd700 1 --2- 172.21.15.153:0/4224571723 >> v2:172.21.15.178:3300/0 conn(0x7f2294064870 0x7f2294064d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.370+0000 7f2292ffd700 1 -- 172.21.15.153:0/4224571723 >> v1:172.21.15.153:6789/0 conn(0x7f2294063290 legacy=0x7f2294065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.370+0000 7f2292ffd700 1 -- 172.21.15.153:0/4224571723 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294061fa0 con 0x7f2294151b90 2023-08-17T00:14:50.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.370+0000 7f2292ffd700 1 --2- 172.21.15.153:0/4224571723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294151b90 0x7f2294151f70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2284009760 tx=0x7f2284009060).ready entity=mon.2 client_cookie=4aae5bf5cf7688aa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f2291ffb700 1 -- 172.21.15.153:0/4224571723 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400f510 con 0x7f2294151b90 2023-08-17T00:14:50.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f2291ffb700 1 -- 172.21.15.153:0/4224571723 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400f670 con 0x7f2294151b90 2023-08-17T00:14:50.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f2291ffb700 1 -- 172.21.15.153:0/4224571723 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400f9f0 con 0x7f2294151b90 2023-08-17T00:14:50.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 -- 172.21.15.153:0/4224571723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294151b90 msgr2=0x7f2294151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 --2- 172.21.15.153:0/4224571723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294151b90 0x7f2294151f70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f2284009760 tx=0x7f2284009060).stop 2023-08-17T00:14:50.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 -- 172.21.15.153:0/4224571723 shutdown_connections 2023-08-17T00:14:50.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 --2- 172.21.15.153:0/4224571723 >> v2:172.21.15.178:3300/0 conn(0x7f2294064870 0x7f2294064d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 --2- 172.21.15.153:0/4224571723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294151b90 0x7f2294151f70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 -- 172.21.15.153:0/4224571723 >> 172.21.15.153:0/4224571723 conn(0x7f22940c7150 msgr2=0x7f22940c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 -- 172.21.15.153:0/4224571723 shutdown_connections 2023-08-17T00:14:50.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.374+0000 7f229969b700 1 -- 172.21.15.153:0/4224571723 wait complete. 2023-08-17T00:14:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.378+0000 7f229969b700 1 Processor -- start 2023-08-17T00:14:50.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.378+0000 7f229969b700 1 -- start start 2023-08-17T00:14:50.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 0x7f229414ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294064870 0x7f22940bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2294151b90 0x7f22940be480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940be970 con 0x7f2294063290 2023-08-17T00:14:50.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22940c1550 con 0x7f2294151b90 2023-08-17T00:14:50.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2294154f50 con 0x7f2294064870 2023-08-17T00:14:50.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 0x7f229414ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 0x7f229414ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55146/0 (socket says 172.21.15.153:55146) 2023-08-17T00:14:50.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 -- 172.21.15.153:0/4254613584 learned_addr learned my addr 172.21.15.153:0/4254613584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f22927fc700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294064870 0x7f22940bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f22937fe700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2294151b90 0x7f22940be480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 -- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294064870 msgr2=0x7f22940bdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294064870 0x7f22940bdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 -- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2294151b90 msgr2=0x7f22940be480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2294151b90 0x7f22940be480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 -- 172.21.15.153:0/4254613584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840092a0 con 0x7f2294063290 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f22927fc700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294064870 0x7f22940bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f2292ffd700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 0x7f229414ec70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f2284009e00 tx=0x7f2284017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f227affd700 1 -- 172.21.15.153:0/4254613584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228400f7e0 con 0x7f2294063290 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f227affd700 1 -- 172.21.15.153:0/4254613584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228400f940 con 0x7f2294063290 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22940c0f40 con 0x7f2294063290 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f227affd700 1 -- 172.21.15.153:0/4254613584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228401b660 con 0x7f2294063290 2023-08-17T00:14:50.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.382+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2294154c70 con 0x7f2294063290 2023-08-17T00:14:50.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.386+0000 7f227affd700 1 -- 172.21.15.153:0/4254613584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f228400f070 con 0x7f2294063290 2023-08-17T00:14:50.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.386+0000 7f22a3a42740 1 Processor -- start 2023-08-17T00:14:50.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.386+0000 7f22a3a42740 1 -- start start 2023-08-17T00:14:50.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.386+0000 7f227affd700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f228005a180 0x7f228005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.386+0000 7f227affd700 1 -- 172.21.15.153:0/4254613584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2284075480 con 0x7f2294063290 2023-08-17T00:14:50.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22937fe700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f228005a180 0x7f228005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10fa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10051a0 con 0x10f9fd0 2023-08-17T00:14:50.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b8920 con 0x10b90c0 2023-08-17T00:14:50.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10b8be0 con 0x10ff390 2023-08-17T00:14:50.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10b6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55162/0 (socket says 172.21.15.153:55162) 2023-08-17T00:14:50.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 -- 172.21.15.153:0/3889056342 learned_addr learned my addr 172.21.15.153:0/3889056342 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:50.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22937fe700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f228005a180 0x7f228005c640 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f228c009fd0 tx=0x7f228c00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22937fe700 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22927fc700 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10fa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 -- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 msgr2=0x10b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 -- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 msgr2=0x10fa3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10fa3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 -- 172.21.15.153:0/3889056342 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1044e30 con 0x10f9fd0 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2292ffd700 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10b6dd0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f2284009fd0 tx=0x7f228400e000).ready entity=mon.0 client_cookie=722e0aa390c27b20 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2273fff700 1 -- 172.21.15.153:0/3889056342 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228404af30 con 0x10f9fd0 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2273fff700 1 -- 172.21.15.153:0/3889056342 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2284073270 con 0x10f9fd0 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f2273fff700 1 -- 172.21.15.153:0/3889056342 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22840733e0 con 0x10f9fd0 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- 172.21.15.153:0/3889056342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 msgr2=0x10b6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10b6dd0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 rx=0x7f2284009fd0 tx=0x7f228400e000).stop 2023-08-17T00:14:50.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- 172.21.15.153:0/3889056342 shutdown_connections 2023-08-17T00:14:50.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10fa3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3889056342 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10b6dd0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- 172.21.15.153:0/3889056342 >> 172.21.15.153:0/3889056342 conn(0xe98680 msgr2=0x10ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- 172.21.15.153:0/3889056342 shutdown_connections 2023-08-17T00:14:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.390+0000 7f22a3a42740 1 -- 172.21.15.153:0/3889056342 wait complete. 2023-08-17T00:14:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 -- start start 2023-08-17T00:14:50.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 Processor -- start 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e3960 con 0x10f9fd0 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10dd450 con 0x10b90c0 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x110cab0 con 0x10ff390 2023-08-17T00:14:50.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22a3a42740 10 client.0 ll_register_callbacks cb 0xffbb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55166/0 (socket says 172.21.15.153:55166) 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22927fc700 1 -- 172.21.15.153:0/663843140 learned_addr learned my addr 172.21.15.153:0/663843140 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f2292ffd700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22937fe700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f2292ffd700 1 -- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 msgr2=0x10e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f2292ffd700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f2292ffd700 1 -- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 msgr2=0x10d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f2292ffd700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f2292ffd700 1 -- 172.21.15.153:0/663843140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2294154c70 con 0x10b90c0 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.394+0000 7f22927fc700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f2292ffd700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10e3d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f2284049090 tx=0x7f228402e000).ready entity=mon.1 client_cookie=29eddd54d704e63b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 1 -- 172.21.15.153:0/663843140 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228404af30 con 0x10b90c0 2023-08-17T00:14:50.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 1 -- 172.21.15.153:0/663843140 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f22840750a0 con 0x10b90c0 2023-08-17T00:14:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x102fcf0 con 0x10b90c0 2023-08-17T00:14:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 1 -- 172.21.15.153:0/663843140 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2284075260 con 0x10b90c0 2023-08-17T00:14:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 10 client.8719 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:50.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x1033010 con 0x10b90c0 2023-08-17T00:14:50.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 1 -- 172.21.15.153:0/663843140 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x102fcf0 con 0x10b90c0 2023-08-17T00:14:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 1 -- 172.21.15.153:0/663843140 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2284073b60 con 0x10b90c0 2023-08-17T00:14:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 10 client.8719 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:50.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 10 client.8719 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 20 client.8719 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x110c340 0x10df130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 4 client.8719 mds_command: new command op to 8982 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1026240 con 0x110c340 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22927fc700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x110c340 0x10df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22927fc700 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x110c340 0x10df130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=151827447513be97 server_cookie=2004ed0746b7bd2a in_seq=0 out_seq=0 2023-08-17T00:14:50.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 10 client.8719 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 1 -- 172.21.15.153:0/663843140 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1026240 con 0x110c340 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22717fa700 10 client.8719 handle_command_reply: tid=0 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.398+0000 7f22a3a42740 1 client.8719 shutdown 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 msgr2=0x10e3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10e3d80 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f2284049090 tx=0x7f228402e000).stop 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 shutdown_connections 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x110c340 0x10df130 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10f9fd0 0x10d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 --2- 172.21.15.153:0/663843140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10b90c0 0x10e3d80 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22717fa700 0 client.8719 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 >> 172.21.15.153:0/663843140 conn(0xe98680 msgr2=0x10fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 shutdown_connections 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 1 -- 172.21.15.153:0/663843140 wait complete. 2023-08-17T00:14:50.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.402+0000 7f22a3a42740 20 client.8719 trim_cache size 0 max 16384 2023-08-17T00:14:50.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 Processor -- start 2023-08-17T00:14:50.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 -- start start 2023-08-17T00:14:50.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x10e3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10f9fd0 0x10fa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e2da0 con 0x10b90c0 2023-08-17T00:14:50.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e3140 con 0x10f9fd0 2023-08-17T00:14:50.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1026240 con 0x10ff390 2023-08-17T00:14:50.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x10e3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x10e3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55178/0 (socket says 172.21.15.153:55178) 2023-08-17T00:14:50.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 -- 172.21.15.153:0/2904649269 learned_addr learned my addr 172.21.15.153:0/2904649269 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:50.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22937fe700 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f22927fc700 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10f9fd0 0x10fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 -- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 msgr2=0x10e4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 -- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10f9fd0 msgr2=0x10fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10f9fd0 0x10fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 -- 172.21.15.153:0/2904649269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940c5680 con 0x10b90c0 2023-08-17T00:14:50.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.418+0000 7f2292ffd700 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x10e3d60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f228400fb60 tx=0x7f2284034000).ready entity=mon.0 client_cookie=c9bbf3d7fe1f63db server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f2278ff9700 1 -- 172.21.15.153:0/2904649269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228404af30 con 0x10b90c0 2023-08-17T00:14:50.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f2278ff9700 1 -- 172.21.15.153:0/2904649269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f228404c290 con 0x10b90c0 2023-08-17T00:14:50.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f2278ff9700 1 -- 172.21.15.153:0/2904649269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2284073b60 con 0x10b90c0 2023-08-17T00:14:50.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 -- 172.21.15.153:0/2904649269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 msgr2=0x10e3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x10e3d60 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 rx=0x7f228400fb60 tx=0x7f2284034000).stop 2023-08-17T00:14:50.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 -- 172.21.15.153:0/2904649269 shutdown_connections 2023-08-17T00:14:50.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10ff390 0x10e4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10f9fd0 0x10fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 --2- 172.21.15.153:0/2904649269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x10e3d60 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 -- 172.21.15.153:0/2904649269 >> 172.21.15.153:0/2904649269 conn(0xe98680 msgr2=0x10fb090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 -- 172.21.15.153:0/2904649269 shutdown_connections 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 -- 172.21.15.153:0/2904649269 wait complete. 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 -- start start 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.422+0000 7f22a3a42740 1 Processor -- start 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x1164b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10f9fd0 0x10e4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10ff390 0x10e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10f8fd0 con 0x10b90c0 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e5160 con 0x10ff390 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10de390 con 0x10f9fd0 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 10 client.0 ll_register_callbacks cb 0x7f228404c900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x1164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x1164b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55192/0 (socket says 172.21.15.153:55192) 2023-08-17T00:14:50.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 -- 172.21.15.153:0/3220144799 learned_addr learned my addr 172.21.15.153:0/3220144799 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22927fc700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10f9fd0 0x10e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22937fe700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10ff390 0x10e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 -- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10f9fd0 msgr2=0x10e4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10f9fd0 0x10e4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 -- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10ff390 msgr2=0x10e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10ff390 0x10e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 -- 172.21.15.153:0/3220144799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1033010 con 0x10b90c0 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22937fe700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10ff390 0x10e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f2292ffd700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x1164b40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f2284011f00 tx=0x7f2284038000).ready entity=mon.0 client_cookie=77daa19c05e74e47 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22717fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22717fa700 1 -- 172.21.15.153:0/3220144799 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f228404af30 con 0x10b90c0 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2284073270 con 0x10b90c0 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22717fa700 1 -- 172.21.15.153:0/3220144799 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f228404acd0 con 0x10b90c0 2023-08-17T00:14:50.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22717fa700 1 -- 172.21.15.153:0/3220144799 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f228404cb30 con 0x10b90c0 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 10 client.9153 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x102e4b0 con 0x10b90c0 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22717fa700 1 -- 172.21.15.153:0/3220144799 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2284073270 con 0x10b90c0 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22717fa700 1 -- 172.21.15.153:0/3220144799 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f228404cc90 con 0x10b90c0 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 10 client.9153 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 10 client.9153 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:14:50.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 20 client.9153 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x10fa8c0 0x10db740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 4 client.9153 mds_command: new command op to 8982 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0xeef610 con 0x10fa8c0 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.426+0000 7f22927fc700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x10fa8c0 0x10db740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22717fa700 10 client.9153 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22927fc700 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x10fa8c0 0x10db740 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=64635cb15d290d61 server_cookie=fc57efce7125d22b in_seq=0 out_seq=0 2023-08-17T00:14:50.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22717fa700 1 -- 172.21.15.153:0/3220144799 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0xeef610 con 0x10fa8c0 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22717fa700 10 client.9153 handle_command_reply: tid=0 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 client.9153 shutdown 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 msgr2=0x1164b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x1164b40 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 rx=0x7f2284011f00 tx=0x7f2284038000).stop 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 shutdown_connections 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x10fa8c0 0x10db740 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x10ff390 0x10e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x10f9fd0 0x10e4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22717fa700 0 client.9153 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:50.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 --2- 172.21.15.153:0/3220144799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x10b90c0 0x1164b40 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 >> 172.21.15.153:0/3220144799 conn(0xe98680 msgr2=0x10e3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 shutdown_connections 2023-08-17T00:14:50.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 1 -- 172.21.15.153:0/3220144799 wait complete. 2023-08-17T00:14:50.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f22a3a42740 20 client.9153 trim_cache size 0 max 16384 2023-08-17T00:14:50.445 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-08-17T00:14:50.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f228005a180 msgr2=0x7f228005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f228005a180 0x7f228005c640 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f228c009fd0 tx=0x7f228c00b040).stop 2023-08-17T00:14:50.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 msgr2=0x7f229414ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 0x7f229414ec70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 rx=0x7f2284009e00 tx=0x7f2284017000).stop 2023-08-17T00:14:50.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 shutdown_connections 2023-08-17T00:14:50.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f228005a180 0x7f228005c640 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2294151b90 0x7f22940be480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2294064870 0x7f22940bdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 --2- 172.21.15.153:0/4254613584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2294063290 0x7f229414ec70 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 >> 172.21.15.153:0/4254613584 conn(0x7f22940c7150 msgr2=0x7f229414aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 shutdown_connections 2023-08-17T00:14:50.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.430+0000 7f229969b700 1 -- 172.21.15.153:0/4254613584 wait complete. 2023-08-17T00:14:50.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-17T00:14:50.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 Processor -- start 2023-08-17T00:14:50.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 -- start start 2023-08-17T00:14:50.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3144066760 0x7f3144068940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3144064790 0x7f3144064bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31440a9df0 con 0x7f3144068e30 2023-08-17T00:14:50.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31441500c0 con 0x7f3144064790 2023-08-17T00:14:50.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3149747700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3144069290 con 0x7f3144066760 2023-08-17T00:14:50.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3148f46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3144064790 0x7f3144064bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f313bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3144068e30 0x7f314414f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37888/0 (socket says 172.21.15.153:37888) 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3148f46700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3144064790 0x7f3144064bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55206/0 (socket says 172.21.15.153:55206) 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f313bfff700 1 -- 172.21.15.153:0/2390616878 learned_addr learned my addr 172.21.15.153:0/2390616878 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f3143fff700 1 --2- 172.21.15.153:0/2390616878 >> v2:172.21.15.178:3300/0 conn(0x7f3144066760 0x7f3144068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.610+0000 7f31437fe700 1 -- 172.21.15.153:0/2390616878 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876872891 0 0) 0x7f31440a9df0 con 0x7f3144068e30 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3148f46700 1 -- 172.21.15.153:0/2390616878 >> v2:172.21.15.178:3300/0 conn(0x7f3144066760 msgr2=0x7f3144068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3148f46700 1 --2- 172.21.15.153:0/2390616878 >> v2:172.21.15.178:3300/0 conn(0x7f3144066760 0x7f3144068940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3148f46700 1 -- 172.21.15.153:0/2390616878 >> v1:172.21.15.153:6789/0 conn(0x7f3144068e30 legacy=0x7f314414f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3148f46700 1 -- 172.21.15.153:0/2390616878 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3144065500 con 0x7f3144064790 2023-08-17T00:14:50.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3148f46700 1 --2- 172.21.15.153:0/2390616878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144064790 0x7f3144064bb0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f31440c63e0 tx=0x7f313c009780).ready entity=mon.0 client_cookie=28b78fe633b2f78c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f31437fe700 1 -- 172.21.15.153:0/2390616878 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00e070 con 0x7f3144064790 2023-08-17T00:14:50.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f31437fe700 1 -- 172.21.15.153:0/2390616878 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00bb60 con 0x7f3144064790 2023-08-17T00:14:50.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f31437fe700 1 -- 172.21.15.153:0/2390616878 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c012410 con 0x7f3144064790 2023-08-17T00:14:50.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 -- 172.21.15.153:0/2390616878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144064790 msgr2=0x7f3144064bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 --2- 172.21.15.153:0/2390616878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144064790 0x7f3144064bb0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 rx=0x7f31440c63e0 tx=0x7f313c009780).stop 2023-08-17T00:14:50.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 -- 172.21.15.153:0/2390616878 shutdown_connections 2023-08-17T00:14:50.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 --2- 172.21.15.153:0/2390616878 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144064790 0x7f3144064bb0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 --2- 172.21.15.153:0/2390616878 >> v2:172.21.15.178:3300/0 conn(0x7f3144066760 0x7f3144068940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 -- 172.21.15.153:0/2390616878 >> 172.21.15.153:0/2390616878 conn(0x7f31440c6620 msgr2=0x7f31440c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 -- 172.21.15.153:0/2390616878 shutdown_connections 2023-08-17T00:14:50.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.614+0000 7f3149747700 1 -- 172.21.15.153:0/2390616878 wait complete. 2023-08-17T00:14:50.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 Processor -- start 2023-08-17T00:14:50.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 -- start start 2023-08-17T00:14:50.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144064790 0x7f31440bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144066760 0x7f31440bbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 0x7f3144155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440bcb80 con 0x7f3144068e30 2023-08-17T00:14:50.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3144153cb0 con 0x7f3144066760 2023-08-17T00:14:50.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440bc5c0 con 0x7f3144064790 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 0x7f3144155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 0x7f3144155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55210/0 (socket says 172.21.15.153:55210) 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 -- 172.21.15.153:0/3892190662 learned_addr learned my addr 172.21.15.153:0/3892190662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 -- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144064790 msgr2=0x7f31440bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144064790 0x7f31440bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 -- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144066760 msgr2=0x7f31440bbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144066760 0x7f31440bbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:50.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 -- 172.21.15.153:0/3892190662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009a20 con 0x7f3144068e30 2023-08-17T00:14:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3148f46700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 0x7f3144155970 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f313c00b6c0 tx=0x7f313c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c01d630 con 0x7f3144068e30 2023-08-17T00:14:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c01d790 con 0x7f3144068e30 2023-08-17T00:14:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440bc8a0 con 0x7f3144068e30 2023-08-17T00:14:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.618+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c01db10 con 0x7f3144068e30 2023-08-17T00:14:50.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.622+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314414ec30 con 0x7f3144068e30 2023-08-17T00:14:50.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.622+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31441537a0 con 0x7f3144068e30 2023-08-17T00:14:50.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.622+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f313c026410 con 0x7f3144068e30 2023-08-17T00:14:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.626+0000 7f3140ff9700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312805a150 0x7f312805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.626+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f313c076190 con 0x7f3144068e30 2023-08-17T00:14:50.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.626+0000 7f3143fff700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312805a150 0x7f312805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:50.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.626+0000 7f3143fff700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312805a150 0x7f312805c610 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3134006fd0 tx=0x7f3134006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:50.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.630+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31441537a0 con 0x7f3144068e30 2023-08-17T00:14:50.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.826+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f31441537a0 con 0x7f3144068e30 2023-08-17T00:14:50.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.826+0000 7f3140ff9700 1 -- 172.21.15.153:0/3892190662 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f31441537a0 con 0x7f3144068e30 2023-08-17T00:14:50.831 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:14:50.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312805a150 msgr2=0x7f312805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312805a150 0x7f312805c610 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f3134006fd0 tx=0x7f3134006f40).stop 2023-08-17T00:14:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 msgr2=0x7f3144155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:50.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 0x7f3144155970 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 rx=0x7f313c00b6c0 tx=0x7f313c009780).stop 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 shutdown_connections 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f312805a150 0x7f312805c610 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3144068e30 0x7f3144155970 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3144066760 0x7f31440bbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 --2- 172.21.15.153:0/3892190662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3144064790 0x7f31440bbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 >> 172.21.15.153:0/3892190662 conn(0x7f31440c6620 msgr2=0x7f3144152470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 shutdown_connections 2023-08-17T00:14:50.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:50.830+0000 7f3149747700 1 -- 172.21.15.153:0/3892190662 wait complete. 2023-08-17T00:14:50.855 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-17T00:14:50.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub start '~mdsdir' recursive 2023-08-17T00:14:51.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.022+0000 7f4f7e707700 1 Processor -- start 2023-08-17T00:14:51.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.022+0000 7f4f7e707700 1 -- start start 2023-08-17T00:14:51.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7e707700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4f78157f30 0x7f4f78064a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7e707700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f78062650 con 0x7f4f78157b50 2023-08-17T00:14:51.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7e707700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f78062040 con 0x7f4f7815bfe0 2023-08-17T00:14:51.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7e707700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f780bcfd0 con 0x7f4f78157f30 2023-08-17T00:14:51.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7d705700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4f78157b50 0x7f4f7815b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37902/0 (socket says 172.21.15.153:37902) 2023-08-17T00:14:51.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7d705700 1 -- 172.21.15.153:0/3282821927 learned_addr learned my addr 172.21.15.153:0/3282821927 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:51.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3282821927 >> v2:172.21.15.178:3300/0 conn(0x7f4f78157f30 0x7f4f78064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14835710 0 0) 0x7f4f78062650 con 0x7f4f78157b50 2023-08-17T00:14:51.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f640033f0 con 0x7f4f78157b50 2023-08-17T00:14:51.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612056143 0 0) 0x7f4f78062040 con 0x7f4f7815bfe0 2023-08-17T00:14:51.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f78062650 con 0x7f4f7815bfe0 2023-08-17T00:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797168279 0 0) 0x7f4f640033f0 con 0x7f4f78157b50 2023-08-17T00:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 >> v2:172.21.15.178:3300/0 conn(0x7f4f78157f30 msgr2=0x7f4f78064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 --2- 172.21.15.153:0/3282821927 >> v2:172.21.15.178:3300/0 conn(0x7f4f78157f30 0x7f4f78064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 >> v1:172.21.15.178:6789/0 conn(0x7f4f7815bfe0 legacy=0x7f4f780bb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780622e0 con 0x7f4f78157b50 2023-08-17T00:14:51.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f4f74001470 con 0x7f4f78157b50 2023-08-17T00:14:51.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3282821927 >> v2:172.21.15.178:3300/0 conn(0x7f4f78157f30 0x7f4f78064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:14:51.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 >> v1:172.21.15.153:6789/0 conn(0x7f4f78157b50 legacy=0x7f4f7815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f64003a70 0x7f4f64003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f64004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f64005000 0x7f4f6400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780bcfd0 con 0x7f4f64004690 2023-08-17T00:14:51.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6400bf60 con 0x7f4f64003a70 2023-08-17T00:14:51.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6400c0d0 con 0x7f4f64005000 2023-08-17T00:14:51.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f64004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f64005000 0x7f4f6400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 -- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f64005000 msgr2=0x7f4f6400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f64005000 0x7f4f6400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 -- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f64003a70 msgr2=0x7f4f64003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f64003a70 0x7f4f64003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:14:51.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 -- 172.21.15.153:0/3282821927 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640033f0 con 0x7f4f64004690 2023-08-17T00:14:51.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f64005000 0x7f4f6400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:51.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7df06700 1 -- 172.21.15.153:0/3282821927 reap_dead start 2023-08-17T00:14:51.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.026+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f64004b10 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f4f68001860 tx=0x7f4f68007bb0).ready entity=mon.0 client_cookie=c83f0e85a6abe0fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68007020 con 0x7f4f64004690 2023-08-17T00:14:51.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f68007180 con 0x7f4f64004690 2023-08-17T00:14:51.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f6ffff700 1 -- 172.21.15.153:0/3282821927 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68007520 con 0x7f4f64004690 2023-08-17T00:14:51.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 -- 172.21.15.153:0/3282821927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 msgr2=0x7f4f64004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f64004b10 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 rx=0x7f4f68001860 tx=0x7f4f68007bb0).stop 2023-08-17T00:14:51.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 -- 172.21.15.153:0/3282821927 shutdown_connections 2023-08-17T00:14:51.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 --2- 172.21.15.153:0/3282821927 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f64004b10 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 -- 172.21.15.153:0/3282821927 >> 172.21.15.153:0/3282821927 conn(0x7f4f780c6ee0 msgr2=0x7f4f780c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 -- 172.21.15.153:0/3282821927 shutdown_connections 2023-08-17T00:14:51.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.030+0000 7f4f7e707700 1 -- 172.21.15.153:0/3282821927 wait complete. 2023-08-17T00:14:51.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 Processor -- start 2023-08-17T00:14:51.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 -- start start 2023-08-17T00:14:51.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f7816b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f78167bb0 0x7f4f780ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f781546d0 0x7f4f78068540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f780ab650 con 0x7f4f64004690 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7816b6e0 con 0x7f4f781546d0 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7e707700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7816b9c0 con 0x7f4f78167bb0 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f7816b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f7816b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55238/0 (socket says 172.21.15.153:55238) 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 -- 172.21.15.153:0/2847827281 learned_addr learned my addr 172.21.15.153:0/2847827281 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f78167bb0 0x7f4f780ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7df06700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f781546d0 0x7f4f78068540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 -- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f78167bb0 msgr2=0x7f4f780ab160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f78167bb0 0x7f4f780ab160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 -- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f781546d0 msgr2=0x7f4f78068540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f781546d0 0x7f4f78068540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 -- 172.21.15.153:0/2847827281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7816bca0 con 0x7f4f64004690 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7df06700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f781546d0 0x7f4f78068540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:51.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.034+0000 7f4f7d705700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f7816b120 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f4f7400c590 tx=0x7f4f74000db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.038+0000 7f4f6d7fa700 1 -- 172.21.15.153:0/2847827281 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74007170 con 0x7f4f64004690 2023-08-17T00:14:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.038+0000 7f4f6d7fa700 1 -- 172.21.15.153:0/2847827281 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f740072d0 con 0x7f4f64004690 2023-08-17T00:14:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.038+0000 7f4f6d7fa700 1 -- 172.21.15.153:0/2847827281 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740048c0 con 0x7f4f64004690 2023-08-17T00:14:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.038+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f7816bf80 con 0x7f4f64004690 2023-08-17T00:14:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.038+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78154b50 con 0x7f4f64004690 2023-08-17T00:14:51.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.038+0000 7f4f6d7fa700 1 -- 172.21.15.153:0/2847827281 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4f7401b070 con 0x7f4f64004690 2023-08-17T00:14:51.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f6d7fa700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f5c05a180 0x7f4f5c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f6d7fa700 1 -- 172.21.15.153:0/2847827281 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f74073860 con 0x7f4f64004690 2023-08-17T00:14:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f5c05a180 0x7f4f5c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 Processor -- start 2023-08-17T00:14:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f5c05a180 0x7f4f5c05c640 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f4f68000c00 tx=0x7f4f68015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 -- start start 2023-08-17T00:14:51.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2601610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25b82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x250a2c0 con 0x2601230 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25bde00 con 0x2604260 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25b7e60 con 0x25e3890 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f7d705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2601610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.042+0000 7f4f7d705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2601610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55254/0 (socket says 172.21.15.153:55254) 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 -- 172.21.15.153:0/524037223 learned_addr learned my addr 172.21.15.153:0/524037223 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25b82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7df06700 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 -- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 msgr2=0x25ba3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25ba3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 -- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 msgr2=0x25b82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25b82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 -- 172.21.15.153:0/524037223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2538130 con 0x2601230 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f7d705700 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2601610 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f4f7404aad0 tx=0x7f4f7400f000).ready entity=mon.0 client_cookie=8d8d12231b1183db server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f627fc700 1 -- 172.21.15.153:0/524037223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f740505a0 con 0x2601230 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f627fc700 1 -- 172.21.15.153:0/524037223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74049200 con 0x2601230 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f627fc700 1 -- 172.21.15.153:0/524037223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f74047570 con 0x2601230 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 -- 172.21.15.153:0/524037223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 msgr2=0x2601610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2601610 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 rx=0x7f4f7404aad0 tx=0x7f4f7400f000).stop 2023-08-17T00:14:51.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 -- 172.21.15.153:0/524037223 shutdown_connections 2023-08-17T00:14:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25ba3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25b82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/524037223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2601610 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 -- 172.21.15.153:0/524037223 >> 172.21.15.153:0/524037223 conn(0x239d7c0 msgr2=0x25be1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 -- 172.21.15.153:0/524037223 shutdown_connections 2023-08-17T00:14:51.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 -- 172.21.15.153:0/524037223 wait complete. 2023-08-17T00:14:51.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 -- start start 2023-08-17T00:14:51.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.046+0000 7f4f89cf6740 1 Processor -- start 2023-08-17T00:14:51.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x26046f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2604be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x26050d0 con 0x2601230 2023-08-17T00:14:51.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25fdaf0 con 0x2604260 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25e5990 con 0x25e3890 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 10 client.0 ll_register_callbacks cb 0x25753f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2604be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2604be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55256/0 (socket says 172.21.15.153:55256) 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 -- 172.21.15.153:0/863828405 learned_addr learned my addr 172.21.15.153:0/863828405 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7df06700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7d705700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x26046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 -- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 msgr2=0x26046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x26046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 -- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 msgr2=0x25fb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25fb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 -- 172.21.15.153:0/863828405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f78154b50 con 0x2601230 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2604be0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f4f640045c0 tx=0x7f4f6801f000).ready entity=mon.0 client_cookie=620bcd8361951dae server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f577fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f577fe700 1 -- 172.21.15.153:0/863828405 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f68020870 con 0x2601230 2023-08-17T00:14:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f577fe700 1 -- 172.21.15.153:0/863828405 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f6802ec60 con 0x2601230 2023-08-17T00:14:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2534e10 con 0x2601230 2023-08-17T00:14:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f577fe700 1 -- 172.21.15.153:0/863828405 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f6802ee70 con 0x2601230 2023-08-17T00:14:51.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 10 client.9174 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x25335d0 con 0x2601230 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f577fe700 1 -- 172.21.15.153:0/863828405 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2534e10 con 0x2601230 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f577fe700 1 -- 172.21.15.153:0/863828405 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f6802b070 con 0x2601230 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 10 client.9174 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 10 client.9174 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 20 client.9174 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x25e6d40 0x25fc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 4 client.9174 mds_command: new command op to 8982 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:14:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.050+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x252b360 con 0x25e6d40 2023-08-17T00:14:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f7d705700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x25e6d40 0x25fc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f577fe700 10 client.9174 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f7d705700 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x25e6d40 0x25fc150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d1442d7fe1010e25 server_cookie=6ae4c90bf904f75c in_seq=0 out_seq=0 2023-08-17T00:14:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f577fe700 1 -- 172.21.15.153:0/863828405 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x252b360 con 0x25e6d40 2023-08-17T00:14:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f577fe700 10 client.9174 handle_command_reply: tid=0 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 client.9174 shutdown 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 msgr2=0x2604be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2604be0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 rx=0x7f4f640045c0 tx=0x7f4f6801f000).stop 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 shutdown_connections 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x25e6d40 0x25fc150 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2604260 0x25fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2601230 0x2604be0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/863828405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x26046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f577fe700 0 client.9174 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 >> 172.21.15.153:0/863828405 conn(0x239d7c0 msgr2=0x25feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 shutdown_connections 2023-08-17T00:14:51.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 1 -- 172.21.15.153:0/863828405 wait complete. 2023-08-17T00:14:51.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.054+0000 7f4f89cf6740 20 client.9174 trim_cache size 0 max 16384 2023-08-17T00:14:51.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 Processor -- start 2023-08-17T00:14:51.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 -- start start 2023-08-17T00:14:51.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2601230 0x2603ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x25e9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25e2b60 con 0x2604260 2023-08-17T00:14:51.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25b3b90 con 0x2601230 2023-08-17T00:14:51.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25bd600 con 0x25e3890 2023-08-17T00:14:51.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x25e9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x25e9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55268/0 (socket says 172.21.15.153:55268) 2023-08-17T00:14:51.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 -- 172.21.15.153:0/2034025260 learned_addr learned my addr 172.21.15.153:0/2034025260 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7d705700 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2601230 0x2603ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 -- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 msgr2=0x25fd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25fd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 -- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2601230 msgr2=0x2603ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2601230 0x2603ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 -- 172.21.15.153:0/2034025260 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f78068d90 con 0x2604260 2023-08-17T00:14:51.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.074+0000 7f4f7df06700 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x25e9310 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f4f78158340 tx=0x7f4f7000b040).ready entity=mon.0 client_cookie=bbc77318d78fde08 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f62ffd700 1 -- 172.21.15.153:0/2034025260 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70018420 con 0x2604260 2023-08-17T00:14:51.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f62ffd700 1 -- 172.21.15.153:0/2034025260 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7000f040 con 0x2604260 2023-08-17T00:14:51.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f62ffd700 1 -- 172.21.15.153:0/2034025260 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f700187b0 con 0x2604260 2023-08-17T00:14:51.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 -- 172.21.15.153:0/2034025260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 msgr2=0x25e9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x25e9310 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 rx=0x7f4f78158340 tx=0x7f4f7000b040).stop 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 -- 172.21.15.153:0/2034025260 shutdown_connections 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x25e9310 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2601230 0x2603ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/2034025260 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25e3890 0x25fd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 -- 172.21.15.153:0/2034025260 >> 172.21.15.153:0/2034025260 conn(0x239d7c0 msgr2=0x25fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 -- 172.21.15.153:0/2034025260 shutdown_connections 2023-08-17T00:14:51.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 -- 172.21.15.153:0/2034025260 wait complete. 2023-08-17T00:14:51.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.078+0000 7f4f89cf6740 1 -- start start 2023-08-17T00:14:51.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 Processor -- start 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x25e3890 0x25b7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2601230 0x25e96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x2622540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25b8490 con 0x2604260 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2668f10 con 0x25e3890 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25fff20 con 0x2601230 2023-08-17T00:14:51.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f89cf6740 10 client.0 ll_register_callbacks cb 0x7f4f68006980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:51.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x2622540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x2622540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55272/0 (socket says 172.21.15.153:55272) 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 -- 172.21.15.153:0/3009707570 learned_addr learned my addr 172.21.15.153:0/3009707570 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7cf04700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2601230 0x25e96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7d705700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x25e3890 0x25b7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 -- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2601230 msgr2=0x25e96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2601230 0x25e96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 -- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x25e3890 msgr2=0x25b7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x25e3890 0x25b7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 -- 172.21.15.153:0/3009707570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f70009a20 con 0x2604260 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7d705700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x25e3890 0x25b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f7df06700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x2622540 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f4f700011d0 tx=0x7f4f70021000).ready entity=mon.0 client_cookie=53a4502242822dde server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.082+0000 7f4f577fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 1 -- 172.21.15.153:0/3009707570 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f70021450 con 0x2604260 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f74049200 con 0x2604260 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 1 -- 172.21.15.153:0/3009707570 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4f700215b0 con 0x2604260 2023-08-17T00:14:51.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 1 -- 172.21.15.153:0/3009707570 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f70021980 con 0x2604260 2023-08-17T00:14:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 10 client.9180 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x2533320 con 0x2604260 2023-08-17T00:14:51.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 1 -- 172.21.15.153:0/3009707570 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f74049200 con 0x2604260 2023-08-17T00:14:51.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 1 -- 172.21.15.153:0/3009707570 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f70021ae0 con 0x2604260 2023-08-17T00:14:51.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 10 client.9180 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 10 client.9180 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 20 client.9180 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x2622a30 0x2667c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 4 client.9180 mds_command: new command op to 8982 tid=0[{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x23f4750 con 0x2622a30 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f7d705700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x2622a30 0x2667c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f7d705700 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x2622a30 0x2667c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=fb4819d4881308d0 server_cookie=a2a1067ce8e0497e in_seq=0 out_seq=0 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 10 client.9180 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 1 -- 172.21.15.153:0/3009707570 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x23f4750 con 0x2622a30 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 10 client.9180 handle_command_reply: tid=0 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 client.9180 shutdown 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 msgr2=0x2622540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x2622540 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 rx=0x7f4f700011d0 tx=0x7f4f70021000).stop 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 shutdown_connections 2023-08-17T00:14:51.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x2622a30 0x2667c70 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f577fe700 0 client.9180 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x2604260 0x2622540 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2601230 0x25e96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 --2- 172.21.15.153:0/3009707570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x25e3890 0x25b7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.086+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 >> 172.21.15.153:0/3009707570 conn(0x239d7c0 msgr2=0x25bdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 shutdown_connections 2023-08-17T00:14:51.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f89cf6740 1 -- 172.21.15.153:0/3009707570 wait complete. 2023-08-17T00:14:51.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f89cf6740 20 client.9180 trim_cache size 0 max 16384 2023-08-17T00:14:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:14:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:14:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "62eb53a3-3062-4485-bccf-9335a1818f60", 2023-08-17T00:14:51.097 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:14:51.097 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:14:51.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f5c05a180 msgr2=0x7f4f5c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f5c05a180 0x7f4f5c05c640 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7f4f68000c00 tx=0x7f4f68015000).stop 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 msgr2=0x7f4f7816b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f7816b120 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 rx=0x7f4f7400c590 tx=0x7f4f74000db0).stop 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 shutdown_connections 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f5c05a180 0x7f4f5c05c640 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f781546d0 0x7f4f78068540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f78167bb0 0x7f4f780ab160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 --2- 172.21.15.153:0/2847827281 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f64004690 0x7f4f7816b120 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 >> 172.21.15.153:0/2847827281 conn(0x7f4f780c6ee0 msgr2=0x7f4f78156d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 shutdown_connections 2023-08-17T00:14:51.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.090+0000 7f4f7e707700 1 -- 172.21.15.153:0/2847827281 wait complete. 2023-08-17T00:14:51.113 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub status 2023-08-17T00:14:51.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b9ab9700 1 Processor -- start 2023-08-17T00:14:51.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b9ab9700 1 -- start start 2023-08-17T00:14:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b9ab9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1b40acf30 0x7fe1b40c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b9ab9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b4154e90 con 0x7fe1b40c5ea0 2023-08-17T00:14:51.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b9ab9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b4153fc0 con 0x7fe1b4063bc0 2023-08-17T00:14:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b9ab9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b4154280 con 0x7fe1b40acf30 2023-08-17T00:14:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe1b40c5ea0 0x7fe1b40634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37910/0 (socket says 172.21.15.153:37910) 2023-08-17T00:14:51.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b3fff700 1 -- 172.21.15.153:0/1000443221 learned_addr learned my addr 172.21.15.153:0/1000443221 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:14:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/1000443221 >> v2:172.21.15.178:3300/0 conn(0x7fe1b40acf30 0x7fe1b40c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053925224 0 0) 0x7fe1b4154e90 con 0x7fe1b40c5ea0 2023-08-17T00:14:51.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.278+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a40033f0 con 0x7fe1b40c5ea0 2023-08-17T00:14:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357919267 0 0) 0x7fe1a40033f0 con 0x7fe1b40c5ea0 2023-08-17T00:14:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 >> v2:172.21.15.178:3300/0 conn(0x7fe1b40acf30 msgr2=0x7fe1b40c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 --2- 172.21.15.153:0/1000443221 >> v2:172.21.15.178:3300/0 conn(0x7fe1b40acf30 0x7fe1b40c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 >> v1:172.21.15.178:6789/0 conn(0x7fe1b4063bc0 legacy=0x7fe1b40bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4154560 con 0x7fe1b40c5ea0 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fe1a0001470 con 0x7fe1b40c5ea0 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 >> v1:172.21.15.153:6789/0 conn(0x7fe1b40c5ea0 legacy=0x7fe1b40634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40038e0 0x7fe1a4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a4004690 0x7fe1a4004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4005000 0x7fe1a400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4154280 con 0x7fe1a4004690 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a400bf60 con 0x7fe1a4005000 2023-08-17T00:14:51.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1a400c0f0 con 0x7fe1a40038e0 2023-08-17T00:14:51.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a4004690 0x7fe1a4004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40038e0 0x7fe1a4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4005000 0x7fe1a400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 -- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40038e0 msgr2=0x7fe1a4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1a40038e0 0x7fe1a4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 -- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4005000 msgr2=0x7fe1a400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4005000 0x7fe1a400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 -- 172.21.15.153:0/1000443221 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a40033f0 con 0x7fe1a4004690 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4005000 0x7fe1a400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b92b8700 1 -- 172.21.15.153:0/1000443221 reap_dead start 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a4004690 0x7fe1a4004b10 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fe1a000c190 tx=0x7fe1a0001e50).ready entity=mon.0 client_cookie=730174aafd20f8a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0007a20 con 0x7fe1a4004690 2023-08-17T00:14:51.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a000cac0 con 0x7fe1a4004690 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b37fe700 1 -- 172.21.15.153:0/1000443221 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a000ce40 con 0x7fe1a4004690 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1000443221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a4004690 msgr2=0x7fe1a4004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.282+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a4004690 0x7fe1a4004b10 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 rx=0x7fe1a000c190 tx=0x7fe1a0001e50).stop 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.286+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1000443221 shutdown_connections 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.286+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1000443221 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1a4004690 0x7fe1a4004b10 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.286+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1000443221 >> 172.21.15.153:0/1000443221 conn(0x7fe1b40cb330 msgr2=0x7fe1b40c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.286+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1000443221 shutdown_connections 2023-08-17T00:14:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.286+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1000443221 wait complete. 2023-08-17T00:14:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.286+0000 7fe1b9ab9700 1 Processor -- start 2023-08-17T00:14:51.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 -- start start 2023-08-17T00:14:51.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4004690 0x7fe1b41505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b40c2790 0x7fe1b40c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 0x7fe1b40ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40c9500 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b4150ac0 con 0x7fe1a4004690 2023-08-17T00:14:51.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40adff0 con 0x7fe1b40c2790 2023-08-17T00:14:51.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 0x7fe1b40ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 0x7fe1b40ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55288/0 (socket says 172.21.15.153:55288) 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 -- 172.21.15.153:0/1734973311 learned_addr learned my addr 172.21.15.153:0/1734973311 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4004690 0x7fe1b41505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b40c2790 0x7fe1b40c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 -- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b40c2790 msgr2=0x7fe1b40c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b40c2790 0x7fe1b40c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 -- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4004690 msgr2=0x7fe1b41505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4004690 0x7fe1b41505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 -- 172.21.15.153:0/1734973311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40abe50 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b40c2790 0x7fe1b40c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 0x7fe1b40ab960 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7fe1b4063fc0 tx=0x7fe1ac009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b0ff9700 1 -- 172.21.15.153:0/1734973311 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00ee60 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b0ff9700 1 -- 172.21.15.153:0/1734973311 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac002490 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40ad9e0 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b0ff9700 1 -- 172.21.15.153:0/1734973311 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac002810 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.290+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b40adc80 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.294+0000 7fe1b0ff9700 1 -- 172.21.15.153:0/1734973311 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe1ac002bc0 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1b0ff9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19805a150 0x7fe19805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1b0ff9700 1 -- 172.21.15.153:0/1734973311 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1ac073dc0 con 0x7fe1b40ab4e0 2023-08-17T00:14:51.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19805a150 0x7fe19805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 Processor -- start 2023-08-17T00:14:51.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 -- start start 2023-08-17T00:14:51.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19805a150 0x7fe19805c610 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fe1a8006d80 tx=0x7fe1a8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x1260050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x12355b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x1236f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11861a0 con 0x123a330 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x127c9b0 con 0x127bdd0 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.298+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1260960 con 0x127b9f0 2023-08-17T00:14:51.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x12355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x12355b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55302/0 (socket says 172.21.15.153:55302) 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 -- 172.21.15.153:0/3384447978 learned_addr learned my addr 172.21.15.153:0/3384447978 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x1236f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x1260050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 -- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 msgr2=0x1260050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x1260050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 -- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 msgr2=0x1236f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x1236f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 -- 172.21.15.153:0/3384447978 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11b4010 con 0x123a330 2023-08-17T00:14:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x12355b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fe1a000c780 tx=0x7fe1a0015000).ready entity=mon.0 client_cookie=a5be60b0d484fbb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe19dffb700 1 -- 172.21.15.153:0/3384447978 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0001470 con 0x123a330 2023-08-17T00:14:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe19dffb700 1 -- 172.21.15.153:0/3384447978 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0000c30 con 0x123a330 2023-08-17T00:14:51.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe19dffb700 1 -- 172.21.15.153:0/3384447978 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0001c30 con 0x123a330 2023-08-17T00:14:51.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 -- 172.21.15.153:0/3384447978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 msgr2=0x12355b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x12355b0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 rx=0x7fe1a000c780 tx=0x7fe1a0015000).stop 2023-08-17T00:14:51.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 -- 172.21.15.153:0/3384447978 shutdown_connections 2023-08-17T00:14:51.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x1236f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x12355b0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3384447978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x1260050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 -- 172.21.15.153:0/3384447978 >> 172.21.15.153:0/3384447978 conn(0x1019680 msgr2=0x1280f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 -- 172.21.15.153:0/3384447978 shutdown_connections 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 -- 172.21.15.153:0/3384447978 wait complete. 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.302+0000 7fe1c509e740 1 -- start start 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 Processor -- start 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x12388a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1264690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1264f40 con 0x127bdd0 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1238d90 con 0x123a330 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1264c60 con 0x127b9f0 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 10 client.0 ll_register_callbacks cb 0x11f1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1264690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1264690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55314/0 (socket says 172.21.15.153:55314) 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 -- 172.21.15.153:0/2867721318 learned_addr learned my addr 172.21.15.153:0/2867721318 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x12388a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 -- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 msgr2=0x12641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 -- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 msgr2=0x12388a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x12388a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 -- 172.21.15.153:0/2867721318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a40033f0 con 0x127bdd0 2023-08-17T00:14:51.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1264690 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fe1ac00eb80 tx=0x7fe1ac04d040).ready entity=mon.0 client_cookie=418dd9f089885adc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe192ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe192ffd700 1 -- 172.21.15.153:0/2867721318 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac04ab20 con 0x127bdd0 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe192ffd700 1 -- 172.21.15.153:0/2867721318 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1ac047210 con 0x127bdd0 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1182200 con 0x127bdd0 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe192ffd700 1 -- 172.21.15.153:0/2867721318 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ac04a380 con 0x127bdd0 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 10 client.9192 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:51.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.306+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x11af4b0 con 0x127bdd0 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe192ffd700 1 -- 172.21.15.153:0/2867721318 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1182200 con 0x127bdd0 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe192ffd700 1 -- 172.21.15.153:0/2867721318 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe1ac04a4e0 con 0x127bdd0 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 10 client.9192 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 10 client.9192 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 20 client.9192 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1261dc0 0x12621a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 4 client.9192 mds_command: new command op to 8982 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:14:51.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11b0cf0 con 0x1261dc0 2023-08-17T00:14:51.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1261dc0 0x12621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1261dc0 0x12621a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c6a97bc1a75526b3 server_cookie=9b9a7b9c87eb3be4 in_seq=0 out_seq=0 2023-08-17T00:14:51.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe192ffd700 10 client.9192 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe192ffd700 1 -- 172.21.15.153:0/2867721318 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x11b0cf0 con 0x1261dc0 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe192ffd700 10 client.9192 handle_command_reply: tid=0 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 client.9192 shutdown 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 msgr2=0x1264690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1264690 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 rx=0x7fe1ac00eb80 tx=0x7fe1ac04d040).stop 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 shutdown_connections 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1261dc0 0x12621a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1264690 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 --2- 172.21.15.153:0/2867721318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x12388a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe192ffd700 0 client.9192 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 >> 172.21.15.153:0/2867721318 conn(0x1019680 msgr2=0x127cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 shutdown_connections 2023-08-17T00:14:51.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 1 -- 172.21.15.153:0/2867721318 wait complete. 2023-08-17T00:14:51.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.310+0000 7fe1c509e740 20 client.9192 trim_cache size 0 max 16384 2023-08-17T00:14:51.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 Processor -- start 2023-08-17T00:14:51.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 -- start start 2023-08-17T00:14:51.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x1234d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x125ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x12da260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11fd240 con 0x123a330 2023-08-17T00:14:51.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1200540 con 0x127bdd0 2023-08-17T00:14:51.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1182200 con 0x127b9f0 2023-08-17T00:14:51.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1b8ab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x1234d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1b8ab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x1234d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55330/0 (socket says 172.21.15.153:55330) 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1b8ab7700 1 -- 172.21.15.153:0/574100264 learned_addr learned my addr 172.21.15.153:0/574100264 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x125ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x12da260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.330+0000 7fe1b8ab7700 1 -- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 msgr2=0x125ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x125ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1b8ab7700 1 -- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 msgr2=0x12da260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x12da260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1b8ab7700 1 -- 172.21.15.153:0/574100264 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b4155450 con 0x123a330 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x12da260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x1234d80 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x1262850 tx=0x7fe1a801a000).ready entity=mon.0 client_cookie=8ff672a439e96e9e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe19e7fc700 1 -- 172.21.15.153:0/574100264 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8026070 con 0x123a330 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe19e7fc700 1 -- 172.21.15.153:0/574100264 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a8019070 con 0x123a330 2023-08-17T00:14:51.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe19e7fc700 1 -- 172.21.15.153:0/574100264 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a8015a60 con 0x123a330 2023-08-17T00:14:51.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 -- 172.21.15.153:0/574100264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 msgr2=0x1234d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x1234d80 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 rx=0x1262850 tx=0x7fe1a801a000).stop 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 -- 172.21.15.153:0/574100264 shutdown_connections 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x127bdd0 0x12da260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x125ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 --2- 172.21.15.153:0/574100264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x123a330 0x1234d80 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 -- 172.21.15.153:0/574100264 >> 172.21.15.153:0/574100264 conn(0x1019680 msgr2=0x1263dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.341 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 -- 172.21.15.153:0/574100264 shutdown_connections 2023-08-17T00:14:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 -- 172.21.15.153:0/574100264 wait complete. 2023-08-17T00:14:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.334+0000 7fe1c509e740 1 -- start start 2023-08-17T00:14:51.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 Processor -- start 2023-08-17T00:14:51.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x1262c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1233eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1236af0 con 0x127bdd0 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1234c20 con 0x123a330 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12dc690 con 0x127b9f0 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 10 client.0 ll_register_callbacks cb 0x7fe1ac04b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1233eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1233eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55336/0 (socket says 172.21.15.153:55336) 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 -- 172.21.15.153:0/3045865623 learned_addr learned my addr 172.21.15.153:0/3045865623 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x1262c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b3fff700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 -- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 msgr2=0x12339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 -- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 msgr2=0x1262c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:14:51.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x1262c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 -- 172.21.15.153:0/3045865623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a8014d50 con 0x127bdd0 2023-08-17T00:14:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x1262c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:14:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1b92b8700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1233eb0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fe1ac0478d0 tx=0x7fe1ac01f000).ready entity=mon.0 client_cookie=e0d4e0696c62521b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:14:51.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe192ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:14:51.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe192ffd700 1 -- 172.21.15.153:0/3045865623 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac002970 con 0x127bdd0 2023-08-17T00:14:51.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1a0000c30 con 0x127bdd0 2023-08-17T00:14:51.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe192ffd700 1 -- 172.21.15.153:0/3045865623 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe1ac049a80 con 0x127bdd0 2023-08-17T00:14:51.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe192ffd700 1 -- 172.21.15.153:0/3045865623 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ac049e50 con 0x127bdd0 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 10 client.9198 fetch_fsmap learned FSMap version 122 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x11af200 con 0x127bdd0 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.338+0000 7fe192ffd700 1 -- 172.21.15.153:0/3045865623 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a0000c30 con 0x127bdd0 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe192ffd700 1 -- 172.21.15.153:0/3045865623 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe1ac0713f0 con 0x127bdd0 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 10 client.9198 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 10 client.9198 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:14:51.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 20 client.9198 populate_metadata read hostname 'smithi153' 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x12dc270 0x12343a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 4 client.9198 mds_command: new command op to 8982 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x11a7240 con 0x12dc270 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x12dc270 0x12343a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1b8ab7700 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x12dc270 0x12343a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c3de4d2edfc47457 server_cookie=c5f5704ed16dfdbc in_seq=0 out_seq=0 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe192ffd700 10 client.9198 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe192ffd700 1 -- 172.21.15.153:0/3045865623 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+257 (crc 0 0 0) 0x11a7240 con 0x12dc270 2023-08-17T00:14:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe192ffd700 10 client.9198 handle_command_reply: tid=0 2023-08-17T00:14:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 client.9198 shutdown 2023-08-17T00:14:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 msgr2=0x1233eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1233eb0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 rx=0x7fe1ac0478d0 tx=0x7fe1ac01f000).stop 2023-08-17T00:14:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 shutdown_connections 2023-08-17T00:14:51.351 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x12dc270 0x12343a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x127bdd0 0x1233eb0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x127b9f0 0x12339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 --2- 172.21.15.153:0/3045865623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x123a330 0x1262c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 >> 172.21.15.153:0/3045865623 conn(0x1019680 msgr2=0x1263dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe192ffd700 0 client.9198 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 shutdown_connections 2023-08-17T00:14:51.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 1 -- 172.21.15.153:0/3045865623 wait complete. 2023-08-17T00:14:51.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1c509e740 20 client.9198 trim_cache size 0 max 16384 2023-08-17T00:14:51.353 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:14:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:14:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:14:51.353 INFO:teuthology.orchestra.run.smithi153.stdout: "62eb53a3-3062-4485-bccf-9335a1818f60": { 2023-08-17T00:14:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "~mds0", 2023-08-17T00:14:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "62eb53a3-3062-4485-bccf-9335a1818f60", 2023-08-17T00:14:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive" 2023-08-17T00:14:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:51.354 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:14:51.354 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:14:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19805a150 msgr2=0x7fe19805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19805a150 0x7fe19805c610 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fe1a8006d80 tx=0x7fe1a8009060).stop 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 msgr2=0x7fe1b40ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.342+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 0x7fe1b40ab960 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 rx=0x7fe1b4063fc0 tx=0x7fe1ac009040).stop 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 shutdown_connections 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe19805a150 0x7fe19805c610 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe1b40ab4e0 0x7fe1b40ab960 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1b40c2790 0x7fe1b40c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 --2- 172.21.15.153:0/1734973311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1a4004690 0x7fe1b41505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:14:51.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 >> 172.21.15.153:0/1734973311 conn(0x7fe1b40cb330 msgr2=0x7fe1b40c7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:14:51.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 shutdown_connections 2023-08-17T00:14:51.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:14:51.346+0000 7fe1b9ab9700 1 -- 172.21.15.153:0/1734973311 wait complete. 2023-08-17T00:14:51.370 INFO:tasks.cephfs.filesystem:scrub status for tag:62eb53a3-3062-4485-bccf-9335a1818f60 - {'path': '~mds0', 'tag': '62eb53a3-3062-4485-bccf-9335a1818f60', 'options': 'recursive'} 2023-08-17T00:15:17.343 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:15:17.350 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:15:21.372 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub status 2023-08-17T00:15:21.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 Processor -- start 2023-08-17T00:15:21.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 -- start start 2023-08-17T00:15:21.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e38150880 0x7f8e380a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e380a8e60 0x7f8e38068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380ab9b0 con 0x7f8e380aa8c0 2023-08-17T00:15:21.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380aada0 con 0x7f8e380a8e60 2023-08-17T00:15:21.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e3d28f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380ab080 con 0x7f8e38150880 2023-08-17T00:15:21.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.529+0000 7f8e2ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8e380a8e60 0x7f8e38068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3ca8e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8e380aa8c0 0x7f8e380c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53472/0 (socket says 172.21.15.153:53472) 2023-08-17T00:15:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/3851842682 learned_addr learned my addr 172.21.15.153:0/3851842682 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:21.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e37fff700 1 --2- 172.21.15.153:0/3851842682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e38150880 0x7f8e380a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e2ffff700 1 -- 172.21.15.153:0/3851842682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e38150880 msgr2=0x7f8e380a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/3851842682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e38150880 0x7f8e380a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e2ffff700 1 -- 172.21.15.153:0/3851842682 >> v1:172.21.15.153:6789/0 conn(0x7f8e380aa8c0 legacy=0x7f8e380c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e377fe700 1 -- 172.21.15.153:0/3851842682 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355873358 0 0) 0x7f8e380ab9b0 con 0x7f8e380aa8c0 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e2ffff700 1 -- 172.21.15.153:0/3851842682 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380ab360 con 0x7f8e380a8e60 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/3851842682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e380a8e60 0x7f8e38068820 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f8e20009760 tx=0x7f8e20009060).ready entity=mon.0 client_cookie=dc2380754d02b4c3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e377fe700 1 -- 172.21.15.153:0/3851842682 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200090d0 con 0x7f8e380a8e60 2023-08-17T00:15:21.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e377fe700 1 -- 172.21.15.153:0/3851842682 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000f510 con 0x7f8e380a8e60 2023-08-17T00:15:21.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e377fe700 1 -- 172.21.15.153:0/3851842682 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000f890 con 0x7f8e380a8e60 2023-08-17T00:15:21.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 -- 172.21.15.153:0/3851842682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e380a8e60 msgr2=0x7f8e38068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/3851842682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e380a8e60 0x7f8e38068820 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 rx=0x7f8e20009760 tx=0x7f8e20009060).stop 2023-08-17T00:15:21.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 -- 172.21.15.153:0/3851842682 shutdown_connections 2023-08-17T00:15:21.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/3851842682 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e380a8e60 0x7f8e38068820 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/3851842682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e38150880 0x7f8e380a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 -- 172.21.15.153:0/3851842682 >> 172.21.15.153:0/3851842682 conn(0x7f8e380c6620 msgr2=0x7f8e380c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 -- 172.21.15.153:0/3851842682 shutdown_connections 2023-08-17T00:15:21.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.533+0000 7f8e3d28f700 1 -- 172.21.15.153:0/3851842682 wait complete. 2023-08-17T00:15:21.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.537+0000 7f8e3d28f700 1 Processor -- start 2023-08-17T00:15:21.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.537+0000 7f8e3d28f700 1 -- start start 2023-08-17T00:15:21.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.537+0000 7f8e3d28f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e380a8e60 0x7f8e38164830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.537+0000 7f8e3d28f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380aa8c0 0x7f8e380a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3d28f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 0x7f8e380a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3d28f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380beef0 con 0x7f8e38150880 2023-08-17T00:15:21.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3d28f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38164d20 con 0x7f8e380a8e60 2023-08-17T00:15:21.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3d28f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380be2e0 con 0x7f8e380aa8c0 2023-08-17T00:15:21.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 0x7f8e380a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e37fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e380a8e60 0x7f8e38164830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 0x7f8e380a3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44204/0 (socket says 172.21.15.153:44204) 2023-08-17T00:15:21.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/1524556730 learned_addr learned my addr 172.21.15.153:0/1524556730 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380aa8c0 0x7f8e380a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380aa8c0 msgr2=0x7f8e380a7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380aa8c0 0x7f8e380a7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e380a8e60 msgr2=0x7f8e38164830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e380a8e60 0x7f8e38164830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/1524556730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200092a0 con 0x7f8e38150880 2023-08-17T00:15:21.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 0x7f8e380a3870 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f8e3000c810 tx=0x7f8e30007f30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e34ff9700 1 -- 172.21.15.153:0/1524556730 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30005d30 con 0x7f8e38150880 2023-08-17T00:15:21.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e34ff9700 1 -- 172.21.15.153:0/1524556730 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e30005e90 con 0x7f8e38150880 2023-08-17T00:15:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e34ff9700 1 -- 172.21.15.153:0/1524556730 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30007360 con 0x7f8e38150880 2023-08-17T00:15:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e380be5c0 con 0x7f8e38150880 2023-08-17T00:15:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.541+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e380beb80 con 0x7f8e38150880 2023-08-17T00:15:21.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.545+0000 7f8e34ff9700 1 -- 172.21.15.153:0/1524556730 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8e30010030 con 0x7f8e38150880 2023-08-17T00:15:21.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.545+0000 7f8e34ff9700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e1805a150 0x7f8e1805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.545+0000 7f8e34ff9700 1 -- 172.21.15.153:0/1524556730 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e30073eb0 con 0x7f8e38150880 2023-08-17T00:15:21.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.545+0000 7f8e37fff700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e1805a150 0x7f8e1805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e37fff700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e1805a150 0x7f8e1805c610 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f8e3814f050 tx=0x7f8e28006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 Processor -- start 2023-08-17T00:15:21.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 -- start start 2023-08-17T00:15:21.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe349f0 0xe19050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xdee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xdeff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xd3f1a0 con 0xe34dd0 2023-08-17T00:15:21.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe359b0 con 0xdf3330 2023-08-17T00:15:21.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xe19960 con 0xe349f0 2023-08-17T00:15:21.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xdeff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xdeff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44218/0 (socket says 172.21.15.153:44218) 2023-08-17T00:15:21.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/4110721951 learned_addr learned my addr 172.21.15.153:0/4110721951 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e37fff700 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe349f0 0xe19050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xdee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe349f0 msgr2=0xe19050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe349f0 0xe19050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 msgr2=0xdee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xdee5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/4110721951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd6d010 con 0xe34dd0 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.549+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xdeff00 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f8e3004b290 tx=0x7f8e3000f000).ready entity=mon.0 client_cookie=ee2649beeed1d4a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e2d7fa700 1 -- 172.21.15.153:0/4110721951 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30054030 con 0xe34dd0 2023-08-17T00:15:21.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e2d7fa700 1 -- 172.21.15.153:0/4110721951 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e300499c0 con 0xe34dd0 2023-08-17T00:15:21.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e2d7fa700 1 -- 172.21.15.153:0/4110721951 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30047d30 con 0xe34dd0 2023-08-17T00:15:21.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- 172.21.15.153:0/4110721951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 msgr2=0xdeff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xdeff00 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 rx=0x7f8e3004b290 tx=0x7f8e3000f000).stop 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- 172.21.15.153:0/4110721951 shutdown_connections 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xdeff00 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xdee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4110721951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe349f0 0xe19050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- 172.21.15.153:0/4110721951 >> 172.21.15.153:0/4110721951 conn(0xbd2680 msgr2=0xe39f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- 172.21.15.153:0/4110721951 shutdown_connections 2023-08-17T00:15:21.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- 172.21.15.153:0/4110721951 wait complete. 2023-08-17T00:15:21.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- start start 2023-08-17T00:15:21.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 Processor -- start 2023-08-17T00:15:21.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe1fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe1b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xded7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xe1e5d0 con 0xe349f0 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe1c9a0 con 0xdf3330 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xe1bae0 con 0xe34dd0 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e488c2740 10 client.0 ll_register_callbacks cb 0xdaa400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:21.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.553+0000 7f8e2ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe1b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe1b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44220/0 (socket says 172.21.15.153:44220) 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 -- 172.21.15.153:0/4091967307 learned_addr learned my addr 172.21.15.153:0/4091967307 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e37fff700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe1fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xded7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 -- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 msgr2=0xded7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xded7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 -- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 msgr2=0xe1fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe1fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 -- 172.21.15.153:0/4091967307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e380beb80 con 0xe349f0 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe1b5f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f8e380669d0 tx=0x7f8e20017000).ready entity=mon.0 client_cookie=94a6f8a2e981ac24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 1 -- 172.21.15.153:0/4091967307 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20021070 con 0xe349f0 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd3b200 con 0xe349f0 2023-08-17T00:15:21.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 1 -- 172.21.15.153:0/4091967307 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e2001c630 con 0xe349f0 2023-08-17T00:15:21.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 1 -- 172.21.15.153:0/4091967307 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e20009110 con 0xe349f0 2023-08-17T00:15:21.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 10 client.9213 fetch_fsmap learned FSMap version 122 2023-08-17T00:15:21.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0xd684b0 con 0xe349f0 2023-08-17T00:15:21.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 1 -- 172.21.15.153:0/4091967307 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd3b200 con 0xe349f0 2023-08-17T00:15:21.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 1 -- 172.21.15.153:0/4091967307 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8e20018030 con 0xe349f0 2023-08-17T00:15:21.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 10 client.9213 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:15:21.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 10 client.9213 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:15:21.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 20 client.9213 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:21.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xdf1380 0xdf1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 4 client.9213 mds_command: new command op to 8982 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:15:21.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd69cf0 con 0xdf1380 2023-08-17T00:15:21.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e37fff700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xdf1380 0xdf1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e37fff700 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xdf1380 0xdf1760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=bc3b2ab8aff9d2bf server_cookie=e5c8f53841964806 in_seq=0 out_seq=0 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.557+0000 7f8e167fc700 10 client.9213 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e167fc700 1 -- 172.21.15.153:0/4091967307 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xd69cf0 con 0xdf1380 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e167fc700 10 client.9213 handle_command_reply: tid=0 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 client.9213 shutdown 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 msgr2=0xe1b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe1b5f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 rx=0x7f8e380669d0 tx=0x7f8e20017000).stop 2023-08-17T00:15:21.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 shutdown_connections 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xdf1380 0xdf1760 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xded7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe1b5f0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 --2- 172.21.15.153:0/4091967307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe1fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e167fc700 0 client.9213 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 >> 172.21.15.153:0/4091967307 conn(0xbd2680 msgr2=0xe18050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 shutdown_connections 2023-08-17T00:15:21.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 1 -- 172.21.15.153:0/4091967307 wait complete. 2023-08-17T00:15:21.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.561+0000 7f8e488c2740 20 client.9213 trim_cache size 0 max 16384 2023-08-17T00:15:21.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 Processor -- start 2023-08-17T00:15:21.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 -- start start 2023-08-17T00:15:21.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdf3330 0xdefec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xe349f0 0xdf03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xe32540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb6240 con 0xe34dd0 2023-08-17T00:15:21.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xdf08a0 con 0xe349f0 2023-08-17T00:15:21.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xe15cf0 con 0xdf3330 2023-08-17T00:15:21.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xe32540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xe32540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44222/0 (socket says 172.21.15.153:44222) 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/2850982735 learned_addr learned my addr 172.21.15.153:0/2850982735 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xe349f0 0xdf03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e37fff700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdf3330 0xdefec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdf3330 msgr2=0xdefec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdf3330 0xdefec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xe349f0 msgr2=0xdf03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xe349f0 0xdf03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 -- 172.21.15.153:0/2850982735 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd68200 con 0xe34dd0 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e37fff700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdf3330 0xdefec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xe349f0 0xdf03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xe32540 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f8e3000a0b0 tx=0x7f8e30055000).ready entity=mon.0 client_cookie=5dc101d4ddbc70b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e2dffb700 1 -- 172.21.15.153:0/2850982735 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30060070 con 0xe34dd0 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e2dffb700 1 -- 172.21.15.153:0/2850982735 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e30005b20 con 0xe34dd0 2023-08-17T00:15:21.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e2dffb700 1 -- 172.21.15.153:0/2850982735 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e30072130 con 0xe34dd0 2023-08-17T00:15:21.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 -- 172.21.15.153:0/2850982735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 msgr2=0xe32540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.581+0000 7f8e488c2740 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xe32540 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 rx=0x7f8e3000a0b0 tx=0x7f8e30055000).stop 2023-08-17T00:15:21.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- 172.21.15.153:0/2850982735 shutdown_connections 2023-08-17T00:15:21.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe34dd0 0xe32540 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xe349f0 0xdf03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 --2- 172.21.15.153:0/2850982735 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xdf3330 0xdefec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- 172.21.15.153:0/2850982735 >> 172.21.15.153:0/2850982735 conn(0xbd2680 msgr2=0xe35af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- 172.21.15.153:0/2850982735 shutdown_connections 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- 172.21.15.153:0/2850982735 wait complete. 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- start start 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 Processor -- start 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe14600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe9c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xe372f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xe1fc90 con 0xe349f0 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe331c0 con 0xdf3330 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xe1f480 con 0xe34dd0 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e488c2740 10 client.0 ll_register_callbacks cb 0x7f8e20009f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e2ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe9c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e2ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe9c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44230/0 (socket says 172.21.15.153:44230) 2023-08-17T00:15:21.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e2ffff700 1 -- 172.21.15.153:0/1113513443 learned_addr learned my addr 172.21.15.153:0/1113513443 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e37fff700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe14600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.585+0000 7f8e3ca8e700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xe372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e37fff700 1 -- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 msgr2=0xe372f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e37fff700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xe372f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e37fff700 1 -- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 msgr2=0xe9c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e37fff700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe9c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e37fff700 1 -- 172.21.15.153:0/1113513443 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd6d010 con 0xdf3330 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e37fff700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe14600 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0xe1c280 tx=0x7f8e28016000).ready entity=mon.1 client_cookie=d00e9dc39ef80aea server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 1 -- 172.21.15.153:0/1113513443 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28006310 con 0xdf3330 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 1 -- 172.21.15.153:0/1113513443 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8e28006470 con 0xdf3330 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e300499c0 con 0xdf3330 2023-08-17T00:15:21.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 1 -- 172.21.15.153:0/1113513443 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e28014440 con 0xdf3330 2023-08-17T00:15:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 10 client.8776 fetch_fsmap learned FSMap version 122 2023-08-17T00:15:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0xc70980 con 0xdf3330 2023-08-17T00:15:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 1 -- 172.21.15.153:0/1113513443 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e300499c0 con 0xdf3330 2023-08-17T00:15:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 1 -- 172.21.15.153:0/1113513443 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8e280145a0 con 0xdf3330 2023-08-17T00:15:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 10 client.8776 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:15:21.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 10 client.8776 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:15:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 20 client.8776 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xe32540 0xe32920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 4 client.8776 mds_command: new command op to 8982 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:15:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xd60240 con 0xe32540 2023-08-17T00:15:21.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xe32540 0xe32920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 10 client.8776 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e2ffff700 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xe32540 0xe32920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5d433d145db28bb0 server_cookie=58b426a853dcc7cb in_seq=0 out_seq=0 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 1 -- 172.21.15.153:0/1113513443 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xd60240 con 0xe32540 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 10 client.8776 handle_command_reply: tid=0 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 client.8776 shutdown 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 msgr2=0xe14600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe14600 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0xe1c280 tx=0x7f8e28016000).stop 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 shutdown_connections 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0xe32540 0xe32920 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xe34dd0 0xe372f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xe349f0 0xe9c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 --2- 172.21.15.153:0/1113513443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xdf3330 0xe14600 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 >> 172.21.15.153:0/1113513443 conn(0xbd2680 msgr2=0xe175d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.589+0000 7f8e167fc700 0 client.8776 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 shutdown_connections 2023-08-17T00:15:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e488c2740 1 -- 172.21.15.153:0/1113513443 wait complete. 2023-08-17T00:15:21.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e488c2740 20 client.8776 trim_cache size 0 max 16384 2023-08-17T00:15:21.603 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:15:21.603 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:15:21.604 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:15:21.604 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:15:21.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e1805a150 msgr2=0x7f8e1805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e1805a150 0x7f8e1805c610 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f8e3814f050 tx=0x7f8e28006f40).stop 2023-08-17T00:15:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 msgr2=0x7f8e380a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 0x7f8e380a3870 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 rx=0x7f8e3000c810 tx=0x7f8e30007f30).stop 2023-08-17T00:15:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 shutdown_connections 2023-08-17T00:15:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8e1805a150 0x7f8e1805c610 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8e38150880 0x7f8e380a3870 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e380aa8c0 0x7f8e380a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 --2- 172.21.15.153:0/1524556730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e380a8e60 0x7f8e38164830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 >> 172.21.15.153:0/1524556730 conn(0x7f8e380c6620 msgr2=0x7f8e380c2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 shutdown_connections 2023-08-17T00:15:21.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.593+0000 7f8e3d28f700 1 -- 172.21.15.153:0/1524556730 wait complete. 2023-08-17T00:15:21.618 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:15:21.619 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 damage ls 2023-08-17T00:15:21.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.769+0000 7f16e2df9700 1 Processor -- start 2023-08-17T00:15:21.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.769+0000 7f16e2df9700 1 -- start start 2023-08-17T00:15:21.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.769+0000 7f16e2df9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16dc0a8df0 0x7f16dc0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.769+0000 7f16e2df9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f16dc068820 0x7f16dc068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.769+0000 7f16e2df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.769+0000 7f16e2df9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc1585a0 con 0x7f16dc0a8df0 2023-08-17T00:15:21.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc066400 con 0x7f16dc068820 2023-08-17T00:15:21.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc069170 con 0x7f16dc061fa0 2023-08-17T00:15:21.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16dc0a8df0 0x7f16dc0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f16dc0a8df0 0x7f16dc0c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44242/0 (socket says 172.21.15.153:44242) 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 -- 172.21.15.153:0/1408894709 learned_addr learned my addr 172.21.15.153:0/1408894709 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1408894709 >> v2:172.21.15.178:3300/0 conn(0x7f16dc068820 0x7f16dc068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 -- 172.21.15.153:0/1408894709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc061fa0 msgr2=0x7f16dc062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e25f8700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 -- 172.21.15.153:0/1408894709 >> v2:172.21.15.178:3300/0 conn(0x7f16dc068820 msgr2=0x7f16dc068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1408894709 >> v2:172.21.15.178:3300/0 conn(0x7f16dc068820 0x7f16dc068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 -- 172.21.15.153:0/1408894709 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0b9d30 con 0x7f16dc0a8df0 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e25f8700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1408894709 >> v2:172.21.15.178:3300/0 conn(0x7f16dc068820 0x7f16dc068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc0a8df0 0x7f16dc0c1490 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f16dc0c2ef0 tx=0x7f16d8009060).ready entity=mon.0 client_cookie=f26941caef1bb078 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e0df5700 1 -- 172.21.15.153:0/1408894709 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8005880 con 0x7f16dc0a8df0 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e0df5700 1 -- 172.21.15.153:0/1408894709 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d80059e0 con 0x7f16dc0a8df0 2023-08-17T00:15:21.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e0df5700 1 -- 172.21.15.153:0/1408894709 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8005d60 con 0x7f16dc0a8df0 2023-08-17T00:15:21.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- 172.21.15.153:0/1408894709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc0a8df0 msgr2=0x7f16dc0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc0a8df0 0x7f16dc0c1490 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 rx=0x7f16dc0c2ef0 tx=0x7f16d8009060).stop 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- 172.21.15.153:0/1408894709 shutdown_connections 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1408894709 >> v2:172.21.15.178:3300/0 conn(0x7f16dc068820 0x7f16dc068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1408894709 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc0a8df0 0x7f16dc0c1490 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- 172.21.15.153:0/1408894709 >> 172.21.15.153:0/1408894709 conn(0x7f16dc0c6620 msgr2=0x7f16dc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- 172.21.15.153:0/1408894709 shutdown_connections 2023-08-17T00:15:21.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.773+0000 7f16e2df9700 1 -- 172.21.15.153:0/1408894709 wait complete. 2023-08-17T00:15:21.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.777+0000 7f16e2df9700 1 Processor -- start 2023-08-17T00:15:21.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.777+0000 7f16e2df9700 1 -- start start 2023-08-17T00:15:21.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc068820 0x7f16dc0628f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16dc0a8df0 0x7f16dc159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc168620 con 0x7f16dc061fa0 2023-08-17T00:15:21.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc062de0 con 0x7f16dc0a8df0 2023-08-17T00:15:21.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0bd170 con 0x7f16dc068820 2023-08-17T00:15:21.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44254/0 (socket says 172.21.15.153:44254) 2023-08-17T00:15:21.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 -- 172.21.15.153:0/1550372911 learned_addr learned my addr 172.21.15.153:0/1550372911 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e25f8700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16dc0a8df0 0x7f16dc159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc068820 0x7f16dc0628f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 -- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc068820 msgr2=0x7f16dc0628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc068820 0x7f16dc0628f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 -- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16dc0a8df0 msgr2=0x7f16dc159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16dc0a8df0 0x7f16dc159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 -- 172.21.15.153:0/1550372911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d8009300 con 0x7f16dc061fa0 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc068820 0x7f16dc0628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:21.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e25f8700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16dc0a8df0 0x7f16dc159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:21.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 0x7f16dc062400 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f16dc0668e0 tx=0x7f16d8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16d1ffb700 1 -- 172.21.15.153:0/1550372911 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8002f50 con 0x7f16dc061fa0 2023-08-17T00:15:21.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16d1ffb700 1 -- 172.21.15.153:0/1550372911 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d800b810 con 0x7f16dc061fa0 2023-08-17T00:15:21.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16dc0bdd50 con 0x7f16dc061fa0 2023-08-17T00:15:21.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16d1ffb700 1 -- 172.21.15.153:0/1550372911 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d800bbb0 con 0x7f16dc061fa0 2023-08-17T00:15:21.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.781+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc0bce90 con 0x7f16dc061fa0 2023-08-17T00:15:21.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.785+0000 7f16d1ffb700 1 -- 172.21.15.153:0/1550372911 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f16d802a070 con 0x7f16dc061fa0 2023-08-17T00:15:21.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16d1ffb700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f16c005a180 0x7f16c005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16d1ffb700 1 -- 172.21.15.153:0/1550372911 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f16d8075200 con 0x7f16dc061fa0 2023-08-17T00:15:21.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 Processor -- start 2023-08-17T00:15:21.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f16c005a180 0x7f16c005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 -- start start 2023-08-17T00:15:21.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f16c005a180 0x7f16c005c640 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f16dc15ad80 tx=0x7f16cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 0x1575a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x154af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x154c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x149c1a0 con 0x1590f30 2023-08-17T00:15:21.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1550060 con 0x1597480 2023-08-17T00:15:21.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x154fd80 con 0x1591310 2023-08-17T00:15:21.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 0x1575a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 0x1575a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44268/0 (socket says 172.21.15.153:44268) 2023-08-17T00:15:21.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 -- 172.21.15.153:0/24396414 learned_addr learned my addr 172.21.15.153:0/24396414 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e25f8700 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x154c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e15f6700 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x154af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 -- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 msgr2=0x154c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x154c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 -- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 msgr2=0x154af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x154af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 -- 172.21.15.153:0/24396414 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x14dbe30 con 0x1590f30 2023-08-17T00:15:21.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.789+0000 7f16e1df7700 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 0x1575a40 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f16d8009230 tx=0x7f16d8075040).ready entity=mon.0 client_cookie=1af4f611a4bab482 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16c6ffd700 1 -- 172.21.15.153:0/24396414 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d804c1c0 con 0x1590f30 2023-08-17T00:15:21.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16c6ffd700 1 -- 172.21.15.153:0/24396414 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d804c800 con 0x1590f30 2023-08-17T00:15:21.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16c6ffd700 1 -- 172.21.15.153:0/24396414 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8048f70 con 0x1590f30 2023-08-17T00:15:21.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 -- 172.21.15.153:0/24396414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 msgr2=0x1575a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 0x1575a40 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 rx=0x7f16d8009230 tx=0x7f16d8075040).stop 2023-08-17T00:15:21.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 -- 172.21.15.153:0/24396414 shutdown_connections 2023-08-17T00:15:21.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x154c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x154af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/24396414 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1590f30 0x1575a40 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 -- 172.21.15.153:0/24396414 >> 172.21.15.153:0/24396414 conn(0x132f680 msgr2=0x1596930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 -- 172.21.15.153:0/24396414 shutdown_connections 2023-08-17T00:15:21.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 -- 172.21.15.153:0/24396414 wait complete. 2023-08-17T00:15:21.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 -- start start 2023-08-17T00:15:21.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.793+0000 7f16ee3ec740 1 Processor -- start 2023-08-17T00:15:21.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1590f30 0x1595580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x1579e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x157a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x157adb0 con 0x1597480 2023-08-17T00:15:21.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1595d50 con 0x1590f30 2023-08-17T00:15:21.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1596bb0 con 0x1591310 2023-08-17T00:15:21.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 10 client.0 ll_register_callbacks cb 0x1492b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:21.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e25f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x157a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1590f30 0x1595580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e25f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x157a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44274/0 (socket says 172.21.15.153:44274) 2023-08-17T00:15:21.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e25f8700 1 -- 172.21.15.153:0/3757372205 learned_addr learned my addr 172.21.15.153:0/3757372205 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e15f6700 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x1579e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 -- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 msgr2=0x1579e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x1579e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 -- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 msgr2=0x157a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x157a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 -- 172.21.15.153:0/3757372205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc0bce90 con 0x1590f30 2023-08-17T00:15:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e1df7700 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1590f30 0x1595580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f16d804f000 tx=0x7f16d802e000).ready entity=mon.1 client_cookie=838c1e863a21b736 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:15:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16bbfff700 1 -- 172.21.15.153:0/3757372205 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d804acd0 con 0x1590f30 2023-08-17T00:15:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16bbfff700 1 -- 172.21.15.153:0/3757372205 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f16d8048650 con 0x1590f30 2023-08-17T00:15:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14c6cf0 con 0x1590f30 2023-08-17T00:15:21.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16bbfff700 1 -- 172.21.15.153:0/3757372205 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16d804b7c0 con 0x1590f30 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 10 client.8788 fetch_fsmap learned FSMap version 122 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x14ca010 con 0x1590f30 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16bbfff700 1 -- 172.21.15.153:0/3757372205 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14c6cf0 con 0x1590f30 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16bbfff700 1 -- 172.21.15.153:0/3757372205 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f16d804b920 con 0x1590f30 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 10 client.8788 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 10 client.8788 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:15:21.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 20 client.8788 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:21.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x157c7f0 0x15af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 4 client.8788 mds_command: new command op to 8982 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:15:21.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x14bd240 con 0x157c7f0 2023-08-17T00:15:21.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.797+0000 7f16e15f6700 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x157c7f0 0x15af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16e15f6700 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x157c7f0 0x15af7b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=df3b54bb6385e62b server_cookie=51973adbf8d6f1e2 in_seq=0 out_seq=0 2023-08-17T00:15:21.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16bbfff700 10 client.8788 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16bbfff700 1 -- 172.21.15.153:0/3757372205 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x14bd240 con 0x157c7f0 2023-08-17T00:15:21.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16bbfff700 10 client.8788 handle_command_reply: tid=0 2023-08-17T00:15:21.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 client.8788 shutdown 2023-08-17T00:15:21.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1590f30 msgr2=0x1595580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1590f30 0x1595580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f16d804f000 tx=0x7f16d802e000).stop 2023-08-17T00:15:21.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 shutdown_connections 2023-08-17T00:15:21.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x157c7f0 0x15af7b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x157a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1591310 0x1579e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/3757372205 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1590f30 0x1595580 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16bbfff700 0 client.8788 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 >> 172.21.15.153:0/3757372205 conn(0x132f680 msgr2=0x154e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 shutdown_connections 2023-08-17T00:15:21.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 1 -- 172.21.15.153:0/3757372205 wait complete. 2023-08-17T00:15:21.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.801+0000 7f16ee3ec740 20 client.8788 trim_cache size 0 max 16384 2023-08-17T00:15:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 Processor -- start 2023-08-17T00:15:21.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 -- start start 2023-08-17T00:15:21.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x1594bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 0x1571e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x1572340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15909c0 con 0x1597480 2023-08-17T00:15:21.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15756f0 con 0x1591310 2023-08-17T00:15:21.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x154c710 con 0x1590f30 2023-08-17T00:15:21.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e25f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x1572340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 0x1571e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 0x1571e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:36802/0 (socket says 172.21.15.153:36802) 2023-08-17T00:15:21.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 -- 172.21.15.153:0/1118505832 learned_addr learned my addr 172.21.15.153:0/1118505832 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e25f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x1572340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44284/0 (socket says 172.21.15.153:44284) 2023-08-17T00:15:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x1594bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 -- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 msgr2=0x1594bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x1594bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 -- 172.21.15.153:0/1118505832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 msgr2=0x1572340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x1572340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.817+0000 7f16e15f6700 1 -- 172.21.15.153:0/1118505832 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0c6010 con 0x1591310 2023-08-17T00:15:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16e1df7700 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x1594bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16e15f6700 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 0x1571e50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f16dc0bb290 tx=0x7f16cc014000).ready entity=mon.1 client_cookie=67ea124151023c9f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16c77fe700 1 -- 172.21.15.153:0/1118505832 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc026070 con 0x1591310 2023-08-17T00:15:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16c77fe700 1 -- 172.21.15.153:0/1118505832 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc0218f0 con 0x1591310 2023-08-17T00:15:21.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16c77fe700 1 -- 172.21.15.153:0/1118505832 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc021a60 con 0x1591310 2023-08-17T00:15:21.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 msgr2=0x1571e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 0x1571e50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f16dc0bb290 tx=0x7f16cc014000).stop 2023-08-17T00:15:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- 172.21.15.153:0/1118505832 shutdown_connections 2023-08-17T00:15:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1597480 0x1572340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1591310 0x1571e50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/1118505832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x1594bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- 172.21.15.153:0/1118505832 >> 172.21.15.153:0/1118505832 conn(0x132f680 msgr2=0x1579e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- 172.21.15.153:0/1118505832 shutdown_connections 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- 172.21.15.153:0/1118505832 wait complete. 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- start start 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 Processor -- start 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x15e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 0x158f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x1571e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15f8960 con 0x1591310 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x15766a0 con 0x1597480 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.821+0000 7f16ee3ec740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15f9740 con 0x1590f30 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 10 client.0 ll_register_callbacks cb 0x7f16d80736f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 0x158f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 0x158f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44298/0 (socket says 172.21.15.153:44298) 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 -- 172.21.15.153:0/2119371365 learned_addr learned my addr 172.21.15.153:0/2119371365 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:21.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e25f8700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x1571e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e1df7700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x15e1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 -- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 msgr2=0x15e1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x15e1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 -- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 msgr2=0x1571e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:21.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x1571e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 -- 172.21.15.153:0/2119371365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16cc00e040 con 0x1591310 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e15f6700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 0x158f890 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f16cc00ba90 tx=0x7f16cc022000).ready entity=mon.0 client_cookie=52ab6f8e9fa58616 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 1 -- 172.21.15.153:0/2119371365 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc021e10 con 0x1591310 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16d804c800 con 0x1591310 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 1 -- 172.21.15.153:0/2119371365 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f16cc034c50 con 0x1591310 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 1 -- 172.21.15.153:0/2119371365 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16cc034e10 con 0x1591310 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 10 client.9237 fetch_fsmap learned FSMap version 122 2023-08-17T00:15:21.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x14c54b0 con 0x1591310 2023-08-17T00:15:21.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 1 -- 172.21.15.153:0/2119371365 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d804c800 con 0x1591310 2023-08-17T00:15:21.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 1 -- 172.21.15.153:0/2119371365 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f16cc02ac60 con 0x1591310 2023-08-17T00:15:21.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 10 client.9237 fetch_fsmap finished waiting for FSMap version 122 2023-08-17T00:15:21.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 10 client.9237 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-08-17T00:15:21.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 20 client.9237 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:21.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1572340 0x15fbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 4 client.9237 mds_command: new command op to 8982 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 --> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x1386610 con 0x1572340 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e1df7700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1572340 0x15fbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16e1df7700 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1572340 0x15fbff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2dfa9f6b0a068864 server_cookie=d7168eb1b78dc292 in_seq=0 out_seq=0 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.825+0000 7f16bbfff700 10 client.9237 ms_handle_connect on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16bbfff700 1 -- 172.21.15.153:0/2119371365 <== mds.0 v2:172.21.15.153:6833/4258690159 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x1386610 con 0x1572340 2023-08-17T00:15:21.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16bbfff700 10 client.9237 handle_command_reply: tid=0 2023-08-17T00:15:21.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 client.9237 shutdown 2023-08-17T00:15:21.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 msgr2=0x158f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 0x158f890 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 rx=0x7f16cc00ba90 tx=0x7f16cc022000).stop 2023-08-17T00:15:21.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 shutdown_connections 2023-08-17T00:15:21.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:6833/4258690159,v1:172.21.15.153:6835/4258690159] conn(0x1572340 0x15fbff0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1597480 0x1571e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1591310 0x158f890 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16bbfff700 0 client.9237 ms_handle_reset on v2:172.21.15.153:6833/4258690159 2023-08-17T00:15:21.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 --2- 172.21.15.153:0/2119371365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1590f30 0x15e1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 >> 172.21.15.153:0/2119371365 conn(0x132f680 msgr2=0x1573890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 shutdown_connections 2023-08-17T00:15:21.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 1 -- 172.21.15.153:0/2119371365 wait complete. 2023-08-17T00:15:21.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16ee3ec740 20 client.9237 trim_cache size 0 max 16384 2023-08-17T00:15:21.843 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-08-17T00:15:21.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f16c005a180 msgr2=0x7f16c005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f16c005a180 0x7f16c005c640 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f16dc15ad80 tx=0x7f16cc008040).stop 2023-08-17T00:15:21.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 msgr2=0x7f16dc062400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:21.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 0x7f16dc062400 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 rx=0x7f16dc0668e0 tx=0x7f16d8016000).stop 2023-08-17T00:15:21.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 shutdown_connections 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f16c005a180 0x7f16c005c640 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16dc0a8df0 0x7f16dc159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16dc068820 0x7f16dc0628f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 --2- 172.21.15.153:0/1550372911 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f16dc061fa0 0x7f16dc062400 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 >> 172.21.15.153:0/1550372911 conn(0x7f16dc0c6620 msgr2=0x7f16dc0694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 shutdown_connections 2023-08-17T00:15:21.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:21.829+0000 7f16e2df9700 1 -- 172.21.15.153:0/1550372911 wait complete. 2023-08-17T00:15:21.856 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-17T00:15:22.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.009+0000 7f4d7b59e700 1 Processor -- start 2023-08-17T00:15:22.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.009+0000 7f4d7b59e700 1 -- start start 2023-08-17T00:15:22.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d7c150880 0x7f4d7c0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d7c0a8e60 0x7f4d7c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0ab9b0 con 0x7f4d7c0aa8c0 2023-08-17T00:15:22.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c0aada0 con 0x7f4d7c150880 2023-08-17T00:15:22.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c0ab080 con 0x7f4d7c0a8e60 2023-08-17T00:15:22.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d7c150880 0x7f4d7c0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d7c150880 0x7f4d7c0a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44306/0 (socket says 172.21.15.153:44306) 2023-08-17T00:15:22.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 -- 172.21.15.153:0/1556168056 learned_addr learned my addr 172.21.15.153:0/1556168056 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:22.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d71d9b700 1 --2- 172.21.15.153:0/1556168056 >> v2:172.21.15.178:3300/0 conn(0x7f4d7c0a8e60 0x7f4d7c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 -- 172.21.15.153:0/1556168056 >> v2:172.21.15.178:3300/0 conn(0x7f4d7c0a8e60 msgr2=0x7f4d7c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:22.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 --2- 172.21.15.153:0/1556168056 >> v2:172.21.15.178:3300/0 conn(0x7f4d7c0a8e60 0x7f4d7c068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 -- 172.21.15.153:0/1556168056 >> v1:172.21.15.178:6789/0 conn(0x7f4d7c0aa8c0 legacy=0x7f4d7c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 -- 172.21.15.153:0/1556168056 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0ab360 con 0x7f4d7c150880 2023-08-17T00:15:22.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d71d9b700 1 --2- 172.21.15.153:0/1556168056 >> v2:172.21.15.178:3300/0 conn(0x7f4d7c0a8e60 0x7f4d7c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d7a59c700 1 --2- 172.21.15.153:0/1556168056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a8970 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f4d7c063ab0 tx=0x7f4d6c009060).ready entity=mon.0 client_cookie=2c8fe28b02854e30 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d79d9b700 1 -- 172.21.15.153:0/1556168056 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c005880 con 0x7f4d7c150880 2023-08-17T00:15:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d79d9b700 1 -- 172.21.15.153:0/1556168056 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c0059e0 con 0x7f4d7c150880 2023-08-17T00:15:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.013+0000 7f4d79d9b700 1 -- 172.21.15.153:0/1556168056 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c005d60 con 0x7f4d7c150880 2023-08-17T00:15:22.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1556168056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 msgr2=0x7f4d7c0a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1556168056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a8970 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 rx=0x7f4d7c063ab0 tx=0x7f4d6c009060).stop 2023-08-17T00:15:22.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1556168056 shutdown_connections 2023-08-17T00:15:22.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1556168056 >> v2:172.21.15.178:3300/0 conn(0x7f4d7c0a8e60 0x7f4d7c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1556168056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a8970 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1556168056 >> 172.21.15.153:0/1556168056 conn(0x7f4d7c0c6620 msgr2=0x7f4d7c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:22.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1556168056 shutdown_connections 2023-08-17T00:15:22.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1556168056 wait complete. 2023-08-17T00:15:22.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.017+0000 7f4d7b59e700 1 Processor -- start 2023-08-17T00:15:22.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 -- start start 2023-08-17T00:15:22.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d7c0a8e60 0x7f4d7c0bf170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d7c0aa8c0 0x7f4d7c0a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0be720 con 0x7f4d7c150880 2023-08-17T00:15:22.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0bf660 con 0x7f4d7c0a8e60 2023-08-17T00:15:22.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0a7f60 con 0x7f4d7c0aa8c0 2023-08-17T00:15:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44308/0 (socket says 172.21.15.153:44308) 2023-08-17T00:15:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 -- 172.21.15.153:0/1787324583 learned_addr learned my addr 172.21.15.153:0/1787324583 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:22.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d71d9b700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d7c0aa8c0 0x7f4d7c0a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7a59c700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d7c0a8e60 0x7f4d7c0bf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 -- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d7c0aa8c0 msgr2=0x7f4d7c0a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d7c0aa8c0 0x7f4d7c0a5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 -- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d7c0a8e60 msgr2=0x7f4d7c0bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d7c0a8e60 0x7f4d7c0bf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.021+0000 7f4d7ad9d700 1 -- 172.21.15.153:0/1787324583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c009300 con 0x7f4d7c150880 2023-08-17T00:15:22.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d7ad9d700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a7560 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f4d7400c7c0 tx=0x7f4d74001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:22.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400e4a0 con 0x7f4d7c150880 2023-08-17T00:15:22.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7400e600 con 0x7f4d7c150880 2023-08-17T00:15:22.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c0a8240 con 0x7f4d7c150880 2023-08-17T00:15:22.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400e980 con 0x7f4d7c150880 2023-08-17T00:15:22.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c0bec50 con 0x7f4d7c150880 2023-08-17T00:15:22.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.025+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c0bee70 con 0x7f4d7c150880 2023-08-17T00:15:22.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.029+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d74019030 con 0x7f4d7c150880 2023-08-17T00:15:22.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.029+0000 7f4d72ffd700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d5c05a150 0x7f4d5c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.029+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4d74073680 con 0x7f4d7c150880 2023-08-17T00:15:22.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.029+0000 7f4d7a59c700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d5c05a150 0x7f4d5c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.029+0000 7f4d7a59c700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d5c05a150 0x7f4d5c05c610 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f4d6c009150 tx=0x7f4d6c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:22.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.037+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d74047160 con 0x7f4d7c150880 2023-08-17T00:15:22.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.229+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4d7c06b4c0 con 0x7f4d7c150880 2023-08-17T00:15:22.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.229+0000 7f4d72ffd700 1 -- 172.21.15.153:0/1787324583 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f4d74017020 con 0x7f4d7c150880 2023-08-17T00:15:22.236 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:22.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d5c05a150 msgr2=0x7f4d5c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d5c05a150 0x7f4d5c05c610 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7f4d6c009150 tx=0x7f4d6c016000).stop 2023-08-17T00:15:22.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 msgr2=0x7f4d7c0a7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a7560 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 rx=0x7f4d7400c7c0 tx=0x7f4d74001510).stop 2023-08-17T00:15:22.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 shutdown_connections 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d5c05a150 0x7f4d5c05c610 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d7c150880 0x7f4d7c0a7560 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d7c0aa8c0 0x7f4d7c0a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 --2- 172.21.15.153:0/1787324583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d7c0a8e60 0x7f4d7c0bf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 >> 172.21.15.153:0/1787324583 conn(0x7f4d7c0c6620 msgr2=0x7f4d7c0c2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 shutdown_connections 2023-08-17T00:15:22.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.233+0000 7f4d7b59e700 1 -- 172.21.15.153:0/1787324583 wait complete. 2023-08-17T00:15:22.259 INFO:teuthology.orchestra.run.smithi153.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-17T00:15:22.259 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:15:22.260 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:15:22.300 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:15:22.343 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:15:22.343 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:15:22.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:15:22.344 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:15:22.455 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:15:22.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:22.456 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:15:22.477 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.661+0000 7f9ac6907700 1 Processor -- start 2023-08-17T00:15:22.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.661+0000 7f9ac6907700 1 -- start start 2023-08-17T00:15:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ac00acc70 0x7f9ac0158140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac0063ea0 con 0x7f9ac0157d60 2023-08-17T00:15:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac015c9b0 con 0x7f9ac00acc70 2023-08-17T00:15:22.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00ad3e0 con 0x7f9ac00c57c0 2023-08-17T00:15:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ac00acc70 0x7f9ac0158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9ac00acc70 0x7f9ac0158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44316/0 (socket says 172.21.15.153:44316) 2023-08-17T00:15:22.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 -- 172.21.15.153:0/297050290 learned_addr learned my addr 172.21.15.153:0/297050290 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:22.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac5104700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 -- 172.21.15.153:0/297050290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 msgr2=0x7f9ac015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:22.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 -- 172.21.15.153:0/297050290 >> v1:172.21.15.178:6789/0 conn(0x7f9ac0157d60 legacy=0x7f9ac00c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 -- 172.21.15.153:0/297050290 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac00c0810 con 0x7f9ac00acc70 2023-08-17T00:15:22.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac5104700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:22.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac6106700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00acc70 0x7f9ac0158140 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f9ab8009f50 tx=0x7f9ab8009840).ready entity=mon.0 client_cookie=5929b23a1c42d678 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:22.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac4903700 1 -- 172.21.15.153:0/297050290 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800e070 con 0x7f9ac00acc70 2023-08-17T00:15:22.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac4903700 1 -- 172.21.15.153:0/297050290 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab800ba70 con 0x7f9ac00acc70 2023-08-17T00:15:22.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.665+0000 7f9ac4903700 1 -- 172.21.15.153:0/297050290 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab800bdf0 con 0x7f9ac00acc70 2023-08-17T00:15:22.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- 172.21.15.153:0/297050290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00acc70 msgr2=0x7f9ac0158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00acc70 0x7f9ac0158140 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 rx=0x7f9ab8009f50 tx=0x7f9ab8009840).stop 2023-08-17T00:15:22.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- 172.21.15.153:0/297050290 shutdown_connections 2023-08-17T00:15:22.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac00acc70 0x7f9ac0158140 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 --2- 172.21.15.153:0/297050290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- 172.21.15.153:0/297050290 >> 172.21.15.153:0/297050290 conn(0x7f9ac0062a70 msgr2=0x7f9ac00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:22.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- 172.21.15.153:0/297050290 shutdown_connections 2023-08-17T00:15:22.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- 172.21.15.153:0/297050290 wait complete. 2023-08-17T00:15:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 Processor -- start 2023-08-17T00:15:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- start start 2023-08-17T00:15:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac00acc70 0x7f9ac01473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac00af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 0x7f9ac00c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00adfd0 con 0x7f9ac0157d60 2023-08-17T00:15:22.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac01478c0 con 0x7f9ac00acc70 2023-08-17T00:15:22.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.669+0000 7f9ac6907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac00b0570 con 0x7f9ac00c57c0 2023-08-17T00:15:22.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 0x7f9ac00c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 0x7f9ac00c2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44332/0 (socket says 172.21.15.153:44332) 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 -- 172.21.15.153:0/1132850970 learned_addr learned my addr 172.21.15.153:0/1132850970 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac5104700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac00af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac5905700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac00acc70 0x7f9ac01473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 -- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 msgr2=0x7f9ac00af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac00af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 -- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac00acc70 msgr2=0x7f9ac01473d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac00acc70 0x7f9ac01473d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 -- 172.21.15.153:0/1132850970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab8009ae0 con 0x7f9ac0157d60 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac5905700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac00acc70 0x7f9ac01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6106700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 0x7f9ac00c2c60 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f9ac0083860 tx=0x7f9ab8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80032f0 con 0x7f9ac0157d60 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab8013de0 con 0x7f9ac0157d60 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab801d690 con 0x7f9ac0157d60 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac00b0290 con 0x7f9ac0157d60 2023-08-17T00:15:22.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac00adc60 con 0x7f9ac0157d60 2023-08-17T00:15:22.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.673+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac00ae140 con 0x7f9ac0157d60 2023-08-17T00:15:22.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.677+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9ab8024030 con 0x7f9ac0157d60 2023-08-17T00:15:22.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.677+0000 7f9ab5ffb700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa405a150 0x7f9aa405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:22.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.677+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9ab80755b0 con 0x7f9ac0157d60 2023-08-17T00:15:22.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.677+0000 7f9ac5905700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa405a150 0x7f9aa405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:22.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.677+0000 7f9ac5905700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa405a150 0x7f9aa405c610 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f9abc001690 tx=0x7f9abc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:22.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.685+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9ab8049000 con 0x7f9ac0157d60 2023-08-17T00:15:22.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.877+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ac006b4c0 con 0x7f9ac0157d60 2023-08-17T00:15:22.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.877+0000 7f9ab5ffb700 1 -- 172.21.15.153:0/1132850970 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f9ab8022070 con 0x7f9ac0157d60 2023-08-17T00:15:22.885 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:22.885 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:14:42.884494+0000","modified":"2023-08-17T00:14:45.904108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4258690159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4258690159},{"type":"v1","addr":"172.21.15.153:6835","nonce":4258690159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T00:15:22.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa405a150 msgr2=0x7f9aa405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa405a150 0x7f9aa405c610 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7f9abc001690 tx=0x7f9abc009040).stop 2023-08-17T00:15:22.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 msgr2=0x7f9ac00c2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:22.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 0x7f9ac00c2c60 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 rx=0x7f9ac0083860 tx=0x7f9ab8009840).stop 2023-08-17T00:15:22.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 shutdown_connections 2023-08-17T00:15:22.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9aa405a150 0x7f9aa405c610 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9ac0157d60 0x7f9ac00c2c60 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ac00c57c0 0x7f9ac00af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 --2- 172.21.15.153:0/1132850970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ac00acc70 0x7f9ac01473d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:22.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 >> 172.21.15.153:0/1132850970 conn(0x7f9ac0062a70 msgr2=0x7f9ac00c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:22.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 shutdown_connections 2023-08-17T00:15:22.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:22.881+0000 7f9ac6907700 1 -- 172.21.15.153:0/1132850970 wait complete. 2023-08-17T00:15:22.892 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 122 2023-08-17T00:15:22.908 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:23.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.057+0000 7f96897db700 1 Processor -- start 2023-08-17T00:15:23.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.057+0000 7f96897db700 1 -- start start 2023-08-17T00:15:23.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.057+0000 7f96897db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96840a9fa0 0x7f9684153b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.057+0000 7f96897db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f96840c5750 0x7f96840c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.057+0000 7f96897db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9684157670 con 0x7f96841537b0 2023-08-17T00:15:23.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.057+0000 7f96897db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96841578e0 con 0x7f96840a9fa0 2023-08-17T00:15:23.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9684157bc0 con 0x7f96840c5750 2023-08-17T00:15:23.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96840a9fa0 0x7f9684153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f96840a9fa0 0x7f9684153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44344/0 (socket says 172.21.15.153:44344) 2023-08-17T00:15:23.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 -- 172.21.15.153:0/1037091491 learned_addr learned my addr 172.21.15.153:0/1037091491 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:23.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f9682ffd700 1 --1- 172.21.15.153:0/1037091491 >> v1:172.21.15.153:6789/0 conn(0x7f96841537b0 0x7f96840a9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53482/0 (socket says 172.21.15.153:53482) 2023-08-17T00:15:23.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96837fe700 1 --2- 172.21.15.153:0/1037091491 >> v2:172.21.15.178:3300/0 conn(0x7f96840c5750 0x7f96840c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 -- 172.21.15.153:0/1037091491 >> v2:172.21.15.178:3300/0 conn(0x7f96840c5750 msgr2=0x7f96840c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:23.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 --2- 172.21.15.153:0/1037091491 >> v2:172.21.15.178:3300/0 conn(0x7f96840c5750 0x7f96840c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 -- 172.21.15.153:0/1037091491 >> v1:172.21.15.153:6789/0 conn(0x7f96841537b0 legacy=0x7f96840a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 -- 172.21.15.153:0/1037091491 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684157ea0 con 0x7f96840a9fa0 2023-08-17T00:15:23.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96827fc700 1 --2- 172.21.15.153:0/1037091491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684153b90 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f9684154080 tx=0x7f96780090f0).ready entity=mon.0 client_cookie=d10e647f4b99b249 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f9681ffb700 1 -- 172.21.15.153:0/1037091491 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800b600 con 0x7f96840a9fa0 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f9681ffb700 1 -- 172.21.15.153:0/1037091491 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967800b760 con 0x7f96840a9fa0 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f9681ffb700 1 -- 172.21.15.153:0/1037091491 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967800bae0 con 0x7f96840a9fa0 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 -- 172.21.15.153:0/1037091491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 msgr2=0x7f9684153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 --2- 172.21.15.153:0/1037091491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684153b90 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 rx=0x7f9684154080 tx=0x7f96780090f0).stop 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 -- 172.21.15.153:0/1037091491 shutdown_connections 2023-08-17T00:15:23.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 --2- 172.21.15.153:0/1037091491 >> v2:172.21.15.178:3300/0 conn(0x7f96840c5750 0x7f96840c5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 --2- 172.21.15.153:0/1037091491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684153b90 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 -- 172.21.15.153:0/1037091491 >> 172.21.15.153:0/1037091491 conn(0x7f9684061fa0 msgr2=0x7f96840623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 -- 172.21.15.153:0/1037091491 shutdown_connections 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.061+0000 7f96897db700 1 -- 172.21.15.153:0/1037091491 wait complete. 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 Processor -- start 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 -- start start 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96840c5750 0x7f9684154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96841537b0 0x7f968414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841683a0 con 0x7f96840a9fa0 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840c1980 con 0x7f96841537b0 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96897db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9684154fb0 con 0x7f96840c5750 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44352/0 (socket says 172.21.15.153:44352) 2023-08-17T00:15:23.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 -- 172.21.15.153:0/874313897 learned_addr learned my addr 172.21.15.153:0/874313897 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96837fe700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96841537b0 0x7f968414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f96827fc700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96840c5750 0x7f9684154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 -- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96840c5750 msgr2=0x7f9684154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96840c5750 0x7f9684154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 -- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96841537b0 msgr2=0x7f968414dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96841537b0 0x7f968414dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 -- 172.21.15.153:0/874313897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9678009370 con 0x7f96840a9fa0 2023-08-17T00:15:23.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.065+0000 7f9682ffd700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684155580 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f967400c410 tx=0x7f9674007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740070d0 con 0x7f96840a9fa0 2023-08-17T00:15:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674007230 con 0x7f96840a9fa0 2023-08-17T00:15:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96740075b0 con 0x7f96840a9fa0 2023-08-17T00:15:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9684167790 con 0x7f96840a9fa0 2023-08-17T00:15:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9684167d50 con 0x7f96840a9fa0 2023-08-17T00:15:23.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968406b4c0 con 0x7f96840a9fa0 2023-08-17T00:15:23.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.069+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9674010070 con 0x7f96840a9fa0 2023-08-17T00:15:23.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.073+0000 7f966affd700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f967005a180 0x7f967005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.073+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9674073680 con 0x7f96840a9fa0 2023-08-17T00:15:23.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.073+0000 7f96827fc700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f967005a180 0x7f967005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.073+0000 7f96827fc700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f967005a180 0x7f967005c640 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f96840aa3a0 tx=0x7f9678017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.077+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96740470d0 con 0x7f96840a9fa0 2023-08-17T00:15:23.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.241+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9684158180 con 0x7f96840a9fa0 2023-08-17T00:15:23.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.241+0000 7f966affd700 1 -- 172.21.15.153:0/874313897 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f967404a6f0 con 0x7f96840a9fa0 2023-08-17T00:15:23.249 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:23.250 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":154,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:43.889439+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:14:40.874126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T00:14:41.882057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:23.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f967005a180 msgr2=0x7f967005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f967005a180 0x7f967005c640 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f96840aa3a0 tx=0x7f9678017000).stop 2023-08-17T00:15:23.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 msgr2=0x7f9684155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684155580 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 rx=0x7f967400c410 tx=0x7f9674007df0).stop 2023-08-17T00:15:23.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 shutdown_connections 2023-08-17T00:15:23.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f967005a180 0x7f967005c640 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96841537b0 0x7f968414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96840c5750 0x7f9684154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 --2- 172.21.15.153:0/874313897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f96840a9fa0 0x7f9684155580 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 >> 172.21.15.153:0/874313897 conn(0x7f9684061fa0 msgr2=0x7f96840c86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 shutdown_connections 2023-08-17T00:15:23.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.245+0000 7f96897db700 1 -- 172.21.15.153:0/874313897 wait complete. 2023-08-17T00:15:23.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:14:40.874126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:14:41.882057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '154', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:15:23.272 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:15:23.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.417+0000 7f970cd07700 1 Processor -- start 2023-08-17T00:15:23.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.417+0000 7f970cd07700 1 -- start start 2023-08-17T00:15:23.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f970cd07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f970cd07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97081585a0 con 0x7f9708068820 2023-08-17T00:15:23.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f970cd07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9708066400 con 0x7f97080aa6e0 2023-08-17T00:15:23.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f970cd07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9708062dc0 con 0x7f97080a8df0 2023-08-17T00:15:23.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f96feffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9708068820 0x7f9708061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53492/0 (socket says 172.21.15.153:53492) 2023-08-17T00:15:23.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f96feffd700 1 -- 172.21.15.153:0/1326082054 learned_addr learned my addr 172.21.15.153:0/1326082054 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:23.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f97077fe700 1 --2- 172.21.15.153:0/1326082054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f9706ffd700 1 -- 172.21.15.153:0/1326082054 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386543521 0 0) 0x7f97081585a0 con 0x7f9708068820 2023-08-17T00:15:23.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f9706ffd700 1 -- 172.21.15.153:0/1326082054 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96f40033f0 con 0x7f9708068820 2023-08-17T00:15:23.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f9706ffd700 1 -- 172.21.15.153:0/1326082054 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701418255 0 0) 0x7f9708066400 con 0x7f97080aa6e0 2023-08-17T00:15:23.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f97077fe700 1 -- 172.21.15.153:0/1326082054 >> v1:172.21.15.178:6789/0 conn(0x7f97080aa6e0 legacy=0x7f97080626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f97077fe700 1 -- 172.21.15.153:0/1326082054 >> v1:172.21.15.153:6789/0 conn(0x7f9708068820 legacy=0x7f9708061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f97077fe700 1 -- 172.21.15.153:0/1326082054 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080b9d30 con 0x7f97080a8df0 2023-08-17T00:15:23.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.421+0000 7f97077fe700 1 --2- 172.21.15.153:0/1326082054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080c1490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f96f8009ee0 tx=0x7f96f8009780).ready entity=mon.2 client_cookie=a94eb685b829cdf2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f9706ffd700 1 -- 172.21.15.153:0/1326082054 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f800e070 con 0x7f97080a8df0 2023-08-17T00:15:23.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f9706ffd700 1 -- 172.21.15.153:0/1326082054 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f800bc30 con 0x7f97080a8df0 2023-08-17T00:15:23.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f9706ffd700 1 -- 172.21.15.153:0/1326082054 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f8012410 con 0x7f97080a8df0 2023-08-17T00:15:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 -- 172.21.15.153:0/1326082054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 msgr2=0x7f97080c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 --2- 172.21.15.153:0/1326082054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080c1490 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f96f8009ee0 tx=0x7f96f8009780).stop 2023-08-17T00:15:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 -- 172.21.15.153:0/1326082054 shutdown_connections 2023-08-17T00:15:23.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 --2- 172.21.15.153:0/1326082054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080c1490 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 -- 172.21.15.153:0/1326082054 >> 172.21.15.153:0/1326082054 conn(0x7f97080c6620 msgr2=0x7f97080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:23.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 -- 172.21.15.153:0/1326082054 shutdown_connections 2023-08-17T00:15:23.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 -- 172.21.15.153:0/1326082054 wait complete. 2023-08-17T00:15:23.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.425+0000 7f970cd07700 1 Processor -- start 2023-08-17T00:15:23.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 -- start start 2023-08-17T00:15:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 0x7f97081586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080b9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97080aa6e0 0x7f970816c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97080b9720 con 0x7f97080aa6e0 2023-08-17T00:15:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9708159050 con 0x7f9708068820 2023-08-17T00:15:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97081598f0 con 0x7f97080a8df0 2023-08-17T00:15:23.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97080aa6e0 0x7f970816c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f97077fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 0x7f97081586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f96feffd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f97077fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 0x7f97081586c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:36878/0 (socket says 172.21.15.153:36878) 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f97077fe700 1 -- 172.21.15.153:0/340399370 learned_addr learned my addr 172.21.15.153:0/340399370 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 -- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 msgr2=0x7f97080b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 -- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 msgr2=0x7f97081586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 0x7f97081586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 -- 172.21.15.153:0/340399370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f8009a20 con 0x7f97080aa6e0 2023-08-17T00:15:23.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f97077fe700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 0x7f97081586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f9707fff700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97080aa6e0 0x7f970816c3b0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f970000c490 tx=0x7f9700007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000123f0 con 0x7f97080aa6e0 2023-08-17T00:15:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9700012550 con 0x7f97080aa6e0 2023-08-17T00:15:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9708158c80 con 0x7f97080aa6e0 2023-08-17T00:15:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.429+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000128f0 con 0x7f97080aa6e0 2023-08-17T00:15:23.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.433+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9708159580 con 0x7f97080aa6e0 2023-08-17T00:15:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.433+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9708159aa0 con 0x7f97080aa6e0 2023-08-17T00:15:23.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.433+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9700010070 con 0x7f97080aa6e0 2023-08-17T00:15:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.437+0000 7f96fffff700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f96e805a150 0x7f96e805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.437+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9700073480 con 0x7f97080aa6e0 2023-08-17T00:15:23.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.437+0000 7f97077fe700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f96e805a150 0x7f96e805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.437+0000 7f97077fe700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f96e805a150 0x7f96e805c610 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f96f800b9f0 tx=0x7f96f8009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.441+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9708159aa0 con 0x7f97080aa6e0 2023-08-17T00:15:23.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.605+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9708159a60 con 0x7f97080aa6e0 2023-08-17T00:15:23.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.605+0000 7f96fffff700 1 -- 172.21.15.153:0/340399370 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v154) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9700046e20 con 0x7f97080aa6e0 2023-08-17T00:15:23.613 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:15:23.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f96e805a150 msgr2=0x7f96e805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f96e805a150 0x7f96e805c610 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f96f800b9f0 tx=0x7f96f8009780).stop 2023-08-17T00:15:23.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97080aa6e0 msgr2=0x7f970816c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97080aa6e0 0x7f970816c3b0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 rx=0x7f970000c490 tx=0x7f9700007d20).stop 2023-08-17T00:15:23.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 shutdown_connections 2023-08-17T00:15:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f96e805a150 0x7f96e805c610 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97080aa6e0 0x7f970816c3b0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97080a8df0 0x7f97080b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 --2- 172.21.15.153:0/340399370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9708068820 0x7f97081586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 >> 172.21.15.153:0/340399370 conn(0x7f97080c6620 msgr2=0x7f97080c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 shutdown_connections 2023-08-17T00:15:23.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.609+0000 7f970cd07700 1 -- 172.21.15.153:0/340399370 wait complete. 2023-08-17T00:15:23.635 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:15:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.789+0000 7f144df07700 1 Processor -- start 2023-08-17T00:15:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.789+0000 7f144df07700 1 -- start start 2023-08-17T00:15:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f14480689c0 0x7f1448068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14481560f0 0x7f14480c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1448065da0 con 0x7f1448151530 2023-08-17T00:15:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1448155c60 con 0x7f14480689c0 2023-08-17T00:15:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1448156550 con 0x7f14481560f0 2023-08-17T00:15:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f14480689c0 0x7f1448068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f14480689c0 0x7f1448068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44382/0 (socket says 172.21.15.153:44382) 2023-08-17T00:15:23.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 -- 172.21.15.153:0/1396209856 learned_addr learned my addr 172.21.15.153:0/1396209856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:23.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f1447fff700 1 --2- 172.21.15.153:0/1396209856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14481560f0 0x7f14480c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 -- 172.21.15.153:0/1396209856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14481560f0 msgr2=0x7f14480c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:23.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 --2- 172.21.15.153:0/1396209856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14481560f0 0x7f14480c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 -- 172.21.15.153:0/1396209856 >> v1:172.21.15.178:6789/0 conn(0x7f1448151530 legacy=0x7f14481519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 -- 172.21.15.153:0/1396209856 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1448065ff0 con 0x7f14480689c0 2023-08-17T00:15:23.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144cf05700 1 --2- 172.21.15.153:0/1396209856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14480689c0 0x7f1448068da0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f143c009810 tx=0x7f143c009060).ready entity=mon.0 client_cookie=ce92db5edcb86ad8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f14477fe700 1 -- 172.21.15.153:0/1396209856 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c005880 con 0x7f14480689c0 2023-08-17T00:15:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f14477fe700 1 -- 172.21.15.153:0/1396209856 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c0059e0 con 0x7f14480689c0 2023-08-17T00:15:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f14477fe700 1 -- 172.21.15.153:0/1396209856 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c005d60 con 0x7f14480689c0 2023-08-17T00:15:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- 172.21.15.153:0/1396209856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14480689c0 msgr2=0x7f1448068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 --2- 172.21.15.153:0/1396209856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14480689c0 0x7f1448068da0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 rx=0x7f143c009810 tx=0x7f143c009060).stop 2023-08-17T00:15:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- 172.21.15.153:0/1396209856 shutdown_connections 2023-08-17T00:15:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 --2- 172.21.15.153:0/1396209856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14481560f0 0x7f14480c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 --2- 172.21.15.153:0/1396209856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f14480689c0 0x7f1448068da0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- 172.21.15.153:0/1396209856 >> 172.21.15.153:0/1396209856 conn(0x7f14480c6620 msgr2=0x7f14480c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:23.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- 172.21.15.153:0/1396209856 shutdown_connections 2023-08-17T00:15:23.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.793+0000 7f144df07700 1 -- 172.21.15.153:0/1396209856 wait complete. 2023-08-17T00:15:23.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.797+0000 7f144df07700 1 Processor -- start 2023-08-17T00:15:23.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.797+0000 7f144df07700 1 -- start start 2023-08-17T00:15:23.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14480689c0 0x7f1448144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 0x7f1448154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14481560f0 0x7f14480bc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448145910 con 0x7f1448151530 2023-08-17T00:15:23.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480bb010 con 0x7f14481560f0 2023-08-17T00:15:23.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480ba400 con 0x7f14480689c0 2023-08-17T00:15:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 0x7f1448154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144cf05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14480689c0 0x7f1448144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 0x7f1448154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44396/0 (socket says 172.21.15.153:44396) 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 -- 172.21.15.153:0/1156866029 learned_addr learned my addr 172.21.15.153:0/1156866029 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144d706700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14481560f0 0x7f14480bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 -- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14480689c0 msgr2=0x7f1448144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14480689c0 0x7f1448144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 -- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14481560f0 msgr2=0x7f14480bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14481560f0 0x7f14480bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 -- 172.21.15.153:0/1156866029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c009300 con 0x7f1448151530 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1447fff700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 0x7f1448154430 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f143400d890 tx=0x7f1434008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434011590 con 0x7f1448151530 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14340116f0 con 0x7f1448151530 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480ba6e0 con 0x7f1448151530 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.801+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1434011a70 con 0x7f1448151530 2023-08-17T00:15:23.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.805+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14480baca0 con 0x7f1448151530 2023-08-17T00:15:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.805+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144806b4c0 con 0x7f1448151530 2023-08-17T00:15:23.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.805+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f143401c460 con 0x7f1448151530 2023-08-17T00:15:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.809+0000 7f1444ff9700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f142c05a150 0x7f142c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:23.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.809+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1434073fc0 con 0x7f1448151530 2023-08-17T00:15:23.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.809+0000 7f144cf05700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f142c05a150 0x7f142c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:23.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.809+0000 7f144cf05700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f142c05a150 0x7f142c05c610 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f143c009fd0 tx=0x7f143c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:23.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.813+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1434047900 con 0x7f1448151530 2023-08-17T00:15:23.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.969+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1448063750 con 0x7f1448151530 2023-08-17T00:15:23.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.969+0000 7f1444ff9700 1 -- 172.21.15.153:0/1156866029 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1434011e60 con 0x7f1448151530 2023-08-17T00:15:23.976 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:15:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f142c05a150 msgr2=0x7f142c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f142c05a150 0x7f142c05c610 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f143c009fd0 tx=0x7f143c016000).stop 2023-08-17T00:15:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 msgr2=0x7f1448154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 0x7f1448154430 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 rx=0x7f143400d890 tx=0x7f1434008040).stop 2023-08-17T00:15:23.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 shutdown_connections 2023-08-17T00:15:23.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f142c05a150 0x7f142c05c610 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f14481560f0 0x7f14480bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1448151530 0x7f1448154430 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 --2- 172.21.15.153:0/1156866029 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f14480689c0 0x7f1448144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:23.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 >> 172.21.15.153:0/1156866029 conn(0x7f14480c6620 msgr2=0x7f14480c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:23.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 shutdown_connections 2023-08-17T00:15:23.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:23.973+0000 7f144df07700 1 -- 172.21.15.153:0/1156866029 wait complete. 2023-08-17T00:15:23.999 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:15:24.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 Processor -- start 2023-08-17T00:15:24.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 -- start start 2023-08-17T00:15:24.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb0ac151f70 0x7fb0ac065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac065b50 0x7fb0ac064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ac061fa0 con 0x7fb0ac151b90 2023-08-17T00:15:24.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ac0c3fb0 con 0x7fb0ac151f70 2023-08-17T00:15:24.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b2769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac1523d0 con 0x7fb0ac065b50 2023-08-17T00:15:24.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0abfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb0ac151b90 0x7fb0ac063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53502/0 (socket says 172.21.15.153:53502) 2023-08-17T00:15:24.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0abfff700 1 -- 172.21.15.153:0/4148958344 learned_addr learned my addr 172.21.15.153:0/4148958344 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:24.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0b0d06700 1 --2- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac065b50 0x7fb0ac064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0a37fe700 1 --2- 172.21.15.153:0/4148958344 >> v2:172.21.15.178:3300/0 conn(0x7fb0ac151f70 0x7fb0ac065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0a37fe700 1 -- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac065b50 msgr2=0x7fb0ac064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:24.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0a37fe700 1 --2- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac065b50 0x7fb0ac064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0a37fe700 1 -- 172.21.15.153:0/4148958344 >> v1:172.21.15.153:6789/0 conn(0x7fb0ac151b90 legacy=0x7fb0ac063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.149+0000 7fb0ab7fe700 1 -- 172.21.15.153:0/4148958344 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634920981 0 0) 0x7fb0ac061fa0 con 0x7fb0ac151b90 2023-08-17T00:15:24.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0a37fe700 1 -- 172.21.15.153:0/4148958344 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0621f0 con 0x7fb0ac151f70 2023-08-17T00:15:24.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0a37fe700 1 --2- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac151f70 0x7fb0ac065660 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fb094009760 tx=0x7fb094009060).ready entity=mon.1 client_cookie=7774636e96880c37 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0ab7fe700 1 -- 172.21.15.153:0/4148958344 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0940090d0 con 0x7fb0ac151f70 2023-08-17T00:15:24.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0ab7fe700 1 -- 172.21.15.153:0/4148958344 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09400f510 con 0x7fb0ac151f70 2023-08-17T00:15:24.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0ab7fe700 1 -- 172.21.15.153:0/4148958344 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09400f890 con 0x7fb0ac151f70 2023-08-17T00:15:24.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 -- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac151f70 msgr2=0x7fb0ac065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 --2- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac151f70 0x7fb0ac065660 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fb094009760 tx=0x7fb094009060).stop 2023-08-17T00:15:24.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 -- 172.21.15.153:0/4148958344 shutdown_connections 2023-08-17T00:15:24.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 --2- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac065b50 0x7fb0ac064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 --2- 172.21.15.153:0/4148958344 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac151f70 0x7fb0ac065660 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 -- 172.21.15.153:0/4148958344 >> 172.21.15.153:0/4148958344 conn(0x7fb0ac0c7150 msgr2=0x7fb0ac0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:24.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 -- 172.21.15.153:0/4148958344 shutdown_connections 2023-08-17T00:15:24.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.153+0000 7fb0b2769700 1 -- 172.21.15.153:0/4148958344 wait complete. 2023-08-17T00:15:24.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.157+0000 7fb0b2769700 1 Processor -- start 2023-08-17T00:15:24.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.157+0000 7fb0b2769700 1 -- start start 2023-08-17T00:15:24.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac065b50 0x7fb0ac13a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac151b90 0x7fb0ac0bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 0x7fb0ac0bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0be100 con 0x7fb0ac151f70 2023-08-17T00:15:24.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0aac90 con 0x7fb0ac065b50 2023-08-17T00:15:24.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ac0aaf70 con 0x7fb0ac151b90 2023-08-17T00:15:24.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 0x7fb0ac0bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 0x7fb0ac0bdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44412/0 (socket says 172.21.15.153:44412) 2023-08-17T00:15:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 -- 172.21.15.153:0/2056884913 learned_addr learned my addr 172.21.15.153:0/2056884913 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0abfff700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac065b50 0x7fb0ac13a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0a37fe700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac151b90 0x7fb0ac0bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 -- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac151b90 msgr2=0x7fb0ac0bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac151b90 0x7fb0ac0bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 -- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac065b50 msgr2=0x7fb0ac13a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac065b50 0x7fb0ac13a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 -- 172.21.15.153:0/2056884913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0940092a0 con 0x7fb0ac151f70 2023-08-17T00:15:24.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0a37fe700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac151b90 0x7fb0ac0bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:24.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0abfff700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac065b50 0x7fb0ac13a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:24.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b0d06700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 0x7fb0ac0bdc10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fb0a4009df0 tx=0x7fb0a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400cb50 con 0x7fb0ac151f70 2023-08-17T00:15:24.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a400f040 con 0x7fb0ac151f70 2023-08-17T00:15:24.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a400cec0 con 0x7fb0ac151f70 2023-08-17T00:15:24.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ac0ab250 con 0x7fb0ac151f70 2023-08-17T00:15:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.161+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ac13a630 con 0x7fb0ac151f70 2023-08-17T00:15:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.165+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ac13a880 con 0x7fb0ac151f70 2023-08-17T00:15:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.165+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb0a4013610 con 0x7fb0ac151f70 2023-08-17T00:15:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.165+0000 7fb0a8ff9700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb08c05a120 0x7fb08c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.165+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb0a4074a50 con 0x7fb0ac151f70 2023-08-17T00:15:24.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.165+0000 7fb0abfff700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb08c05a120 0x7fb08c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.165+0000 7fb0abfff700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb08c05a120 0x7fb08c05c5e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb09c007fd0 tx=0x7fb09c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.169+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb0ac13a880 con 0x7fb0ac151f70 2023-08-17T00:15:24.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.329+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0ac152ca0 con 0x7fb0ac151f70 2023-08-17T00:15:24.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.329+0000 7fb0a8ff9700 1 -- 172.21.15.153:0/2056884913 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v154) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0ac152ca0 con 0x7fb0ac151f70 2023-08-17T00:15:24.334 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:15:24.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb08c05a120 msgr2=0x7fb08c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb08c05a120 0x7fb08c05c5e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb09c007fd0 tx=0x7fb09c009040).stop 2023-08-17T00:15:24.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 msgr2=0x7fb0ac0bdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 0x7fb0ac0bdc10 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 rx=0x7fb0a4009df0 tx=0x7fb0a400b040).stop 2023-08-17T00:15:24.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 shutdown_connections 2023-08-17T00:15:24.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb08c05a120 0x7fb08c05c5e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb0ac151f70 0x7fb0ac0bdc10 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0ac151b90 0x7fb0ac0bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 --2- 172.21.15.153:0/2056884913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0ac065b50 0x7fb0ac13a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 >> 172.21.15.153:0/2056884913 conn(0x7fb0ac0c7150 msgr2=0x7fb0ac14fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:24.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 shutdown_connections 2023-08-17T00:15:24.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.333+0000 7fb0b2769700 1 -- 172.21.15.153:0/2056884913 wait complete. 2023-08-17T00:15:24.359 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:15:24.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.513+0000 7f0e6b1db700 1 Processor -- start 2023-08-17T00:15:24.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.513+0000 7f0e6b1db700 1 -- start start 2023-08-17T00:15:24.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0e64153d50 0x7f0e640632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0e64154130 0x7f0e640629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e64065240 con 0x7f0e640656d0 2023-08-17T00:15:24.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e64062ea0 con 0x7f0e64153d50 2023-08-17T00:15:24.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e64063880 con 0x7f0e64154130 2023-08-17T00:15:24.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0e64153d50 0x7f0e640632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0e64153d50 0x7f0e640632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44422/0 (socket says 172.21.15.153:44422) 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 -- 172.21.15.153:0/1999260680 learned_addr learned my addr 172.21.15.153:0/1999260680 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e5bfff700 1 --2- 172.21.15.153:0/1999260680 >> v2:172.21.15.178:3300/0 conn(0x7f0e64154130 0x7f0e640629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 -- 172.21.15.153:0/1999260680 >> v2:172.21.15.178:3300/0 conn(0x7f0e64154130 msgr2=0x7f0e640629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 --2- 172.21.15.153:0/1999260680 >> v2:172.21.15.178:3300/0 conn(0x7f0e64154130 0x7f0e640629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 -- 172.21.15.153:0/1999260680 >> v1:172.21.15.178:6789/0 conn(0x7f0e640656d0 legacy=0x7f0e640bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 -- 172.21.15.153:0/1999260680 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e64064910 con 0x7f0e64153d50 2023-08-17T00:15:24.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e5bfff700 1 --2- 172.21.15.153:0/1999260680 >> v2:172.21.15.178:3300/0 conn(0x7f0e64154130 0x7f0e640629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:24.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e68f77700 1 --2- 172.21.15.153:0/1999260680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64153d50 0x7f0e640632e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f0e64064150 tx=0x7f0e600090f0).ready entity=mon.0 client_cookie=b3f033186d971458 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e5b7fe700 1 -- 172.21.15.153:0/1999260680 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000b600 con 0x7f0e64153d50 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e5b7fe700 1 -- 172.21.15.153:0/1999260680 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000b760 con 0x7f0e64153d50 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e5b7fe700 1 -- 172.21.15.153:0/1999260680 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000bb00 con 0x7f0e64153d50 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- 172.21.15.153:0/1999260680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64153d50 msgr2=0x7f0e640632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/1999260680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64153d50 0x7f0e640632e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 rx=0x7f0e64064150 tx=0x7f0e600090f0).stop 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- 172.21.15.153:0/1999260680 shutdown_connections 2023-08-17T00:15:24.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/1999260680 >> v2:172.21.15.178:3300/0 conn(0x7f0e64154130 0x7f0e640629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/1999260680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64153d50 0x7f0e640632e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- 172.21.15.153:0/1999260680 >> 172.21.15.153:0/1999260680 conn(0x7f0e640c7150 msgr2=0x7f0e640c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:24.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- 172.21.15.153:0/1999260680 shutdown_connections 2023-08-17T00:15:24.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.517+0000 7f0e6b1db700 1 -- 172.21.15.153:0/1999260680 wait complete. 2023-08-17T00:15:24.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 Processor -- start 2023-08-17T00:15:24.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 -- start start 2023-08-17T00:15:24.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e640656d0 0x7f0e640ac190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e64153d50 0x7f0e641642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 0x7f0e641647e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64156410 con 0x7f0e64154130 2023-08-17T00:15:24.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640a9c00 con 0x7f0e640656d0 2023-08-17T00:15:24.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e6b1db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e640a9ee0 con 0x7f0e64153d50 2023-08-17T00:15:24.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e69778700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 0x7f0e641647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e69778700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 0x7f0e641647e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44436/0 (socket says 172.21.15.153:44436) 2023-08-17T00:15:24.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e69778700 1 -- 172.21.15.153:0/3666201271 learned_addr learned my addr 172.21.15.153:0/3666201271 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:24.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.521+0000 7f0e68f77700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e640656d0 0x7f0e640ac190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e5bfff700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e64153d50 0x7f0e641642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e69778700 1 -- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e64153d50 msgr2=0x7f0e641642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e69778700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e64153d50 0x7f0e641642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e69778700 1 -- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e640656d0 msgr2=0x7f0e640ac190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e69778700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e640656d0 0x7f0e640ac190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e69778700 1 -- 172.21.15.153:0/3666201271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009370 con 0x7f0e64154130 2023-08-17T00:15:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e68f77700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e640656d0 0x7f0e640ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:24.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e69778700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 0x7f0e641647e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f0e5c00c7c0 tx=0x7f0e5c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c010510 con 0x7f0e64154130 2023-08-17T00:15:24.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e5c010670 con 0x7f0e64154130 2023-08-17T00:15:24.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e640aa1c0 con 0x7f0e64154130 2023-08-17T00:15:24.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e5c0109f0 con 0x7f0e64154130 2023-08-17T00:15:24.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e640ac680 con 0x7f0e64154130 2023-08-17T00:15:24.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.525+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6406b530 con 0x7f0e64154130 2023-08-17T00:15:24.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.529+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0e5c010070 con 0x7f0e64154130 2023-08-17T00:15:24.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.529+0000 7f0e58ff9700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e5005a150 0x7f0e5005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.529+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0e5c073e80 con 0x7f0e64154130 2023-08-17T00:15:24.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.529+0000 7f0e68f77700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e5005a150 0x7f0e5005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.529+0000 7f0e68f77700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e5005a150 0x7f0e5005c610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0e60009fd0 tx=0x7f0e60017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.533+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0e5c047820 con 0x7f0e64154130 2023-08-17T00:15:24.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.697+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e64064bf0 con 0x7f0e64154130 2023-08-17T00:15:24.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.697+0000 7f0e58ff9700 1 -- 172.21.15.153:0/3666201271 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v154) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e5c04ae40 con 0x7f0e64154130 2023-08-17T00:15:24.703 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:15:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e5005a150 msgr2=0x7f0e5005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e5005a150 0x7f0e5005c610 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f0e60009fd0 tx=0x7f0e60017000).stop 2023-08-17T00:15:24.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 msgr2=0x7f0e641647e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 0x7f0e641647e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 rx=0x7f0e5c00c7c0 tx=0x7f0e5c001510).stop 2023-08-17T00:15:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 shutdown_connections 2023-08-17T00:15:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0e5005a150 0x7f0e5005c610 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0e64154130 0x7f0e641647e0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e64153d50 0x7f0e641642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 --2- 172.21.15.153:0/3666201271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e640656d0 0x7f0e640ac190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 >> 172.21.15.153:0/3666201271 conn(0x7f0e640c7150 msgr2=0x7f0e640bf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 shutdown_connections 2023-08-17T00:15:24.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.701+0000 7f0e6b1db700 1 -- 172.21.15.153:0/3666201271 wait complete. 2023-08-17T00:15:24.728 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:24.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 Processor -- start 2023-08-17T00:15:24.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 -- start start 2023-08-17T00:15:24.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ea4153d50 0x7f6ea40632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea40656d0 0x7f6ea40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea4065240 con 0x7f6ea4154130 2023-08-17T00:15:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea4063880 con 0x7f6ea4153d50 2023-08-17T00:15:24.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.885+0000 7f6eaa769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4064910 con 0x7f6ea40656d0 2023-08-17T00:15:24.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea3fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ea4153d50 0x7f6ea40632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6e9bfff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f6ea4154130 0x7f6ea40629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:34870/0 (socket says 172.21.15.153:34870) 2023-08-17T00:15:24.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6e9bfff700 1 -- 172.21.15.153:0/1775376566 learned_addr learned my addr 172.21.15.153:0/1775376566 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:24.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea8d06700 1 --2- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea40656d0 0x7f6ea40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea40656d0 msgr2=0x7f6ea40bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea3fff700 1 --2- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea40656d0 0x7f6ea40bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1775376566 >> v1:172.21.15.178:6789/0 conn(0x7f6ea4154130 legacy=0x7f6ea40629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1775376566 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4064bf0 con 0x7f6ea4153d50 2023-08-17T00:15:24.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea3fff700 1 --2- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4153d50 0x7f6ea40632e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6e94009760 tx=0x7f6e94009060).ready entity=mon.1 client_cookie=8fe5c6a32d133343 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea37fe700 1 -- 172.21.15.153:0/1775376566 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e940090d0 con 0x7f6ea4153d50 2023-08-17T00:15:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea37fe700 1 -- 172.21.15.153:0/1775376566 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9400f510 con 0x7f6ea4153d50 2023-08-17T00:15:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6ea37fe700 1 -- 172.21.15.153:0/1775376566 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400f890 con 0x7f6ea4153d50 2023-08-17T00:15:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6eaa769700 1 -- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4153d50 msgr2=0x7f6ea40632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4153d50 0x7f6ea40632e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f6e94009760 tx=0x7f6e94009060).stop 2023-08-17T00:15:24.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6eaa769700 1 -- 172.21.15.153:0/1775376566 shutdown_connections 2023-08-17T00:15:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea40656d0 0x7f6ea40bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1775376566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4153d50 0x7f6ea40632e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.889+0000 7f6eaa769700 1 -- 172.21.15.153:0/1775376566 >> 172.21.15.153:0/1775376566 conn(0x7f6ea40c7150 msgr2=0x7f6ea40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 -- 172.21.15.153:0/1775376566 shutdown_connections 2023-08-17T00:15:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 -- 172.21.15.153:0/1775376566 wait complete. 2023-08-17T00:15:24.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 Processor -- start 2023-08-17T00:15:24.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 -- start start 2023-08-17T00:15:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 0x7f6ea4164430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea4153d50 0x7f6ea4154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4154130 0x7f6ea4168010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4150f00 con 0x7f6ea40656d0 2023-08-17T00:15:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea4164920 con 0x7f6ea4154130 2023-08-17T00:15:24.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6eaa769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea41502f0 con 0x7f6ea4153d50 2023-08-17T00:15:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6ea3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 0x7f6ea4164430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6ea3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 0x7f6ea4164430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44442/0 (socket says 172.21.15.153:44442) 2023-08-17T00:15:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1366464767 learned_addr learned my addr 172.21.15.153:0/1366464767 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.893+0000 7f6e9bfff700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea4153d50 0x7f6ea4154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea8d06700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4154130 0x7f6ea4168010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea4153d50 msgr2=0x7f6ea4154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea3fff700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea4153d50 0x7f6ea4154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4154130 msgr2=0x7f6ea4168010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea3fff700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4154130 0x7f6ea4168010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea3fff700 1 -- 172.21.15.153:0/1366464767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e940092a0 con 0x7f6ea40656d0 2023-08-17T00:15:24.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea3fff700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 0x7f6ea4164430 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f6e94009150 tx=0x7f6e94017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400f680 con 0x7f6ea40656d0 2023-08-17T00:15:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9400f7e0 con 0x7f6ea40656d0 2023-08-17T00:15:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9401b690 con 0x7f6ea40656d0 2023-08-17T00:15:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea41505d0 con 0x7f6ea40656d0 2023-08-17T00:15:24.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea4150b90 con 0x7f6ea40656d0 2023-08-17T00:15:24.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.897+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea406b530 con 0x7f6ea40656d0 2023-08-17T00:15:24.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.901+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6e9402a070 con 0x7f6ea40656d0 2023-08-17T00:15:24.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.901+0000 7f6ea0ff9700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e8405a180 0x7f6e8405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:24.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.901+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6e940755a0 con 0x7f6ea40656d0 2023-08-17T00:15:24.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.901+0000 7f6e9bfff700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e8405a180 0x7f6e8405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:24.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.901+0000 7f6e9bfff700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e8405a180 0x7f6e8405c640 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f6ea4148b40 tx=0x7f6e8c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:24.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:24.905+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6e94049050 con 0x7f6ea40656d0 2023-08-17T00:15:25.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.097+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ea4064ed0 con 0x7f6ea40656d0 2023-08-17T00:15:25.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.097+0000 7f6ea0ff9700 1 -- 172.21.15.153:0/1366464767 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f6e94028090 con 0x7f6ea40656d0 2023-08-17T00:15:25.104 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:25.105 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:14:42.884494+0000","modified":"2023-08-17T00:14:45.904108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4258690159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4258690159},{"type":"v1","addr":"172.21.15.153:6835","nonce":4258690159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e8405a180 msgr2=0x7f6e8405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e8405a180 0x7f6e8405c640 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7f6ea4148b40 tx=0x7f6e8c009040).stop 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 msgr2=0x7f6ea4164430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 0x7f6ea4164430 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 rx=0x7f6e94009150 tx=0x7f6e94017000).stop 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 shutdown_connections 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6e8405a180 0x7f6e8405c640 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea4154130 0x7f6ea4168010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea4153d50 0x7f6ea4154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 --2- 172.21.15.153:0/1366464767 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ea40656d0 0x7f6ea4164430 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 >> 172.21.15.153:0/1366464767 conn(0x7f6ea40c7150 msgr2=0x7f6ea40bf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:25.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 shutdown_connections 2023-08-17T00:15:25.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.101+0000 7f6eaa769700 1 -- 172.21.15.153:0/1366464767 wait complete. 2023-08-17T00:15:25.109 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 122 2023-08-17T00:15:25.126 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 Processor -- start 2023-08-17T00:15:25.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 -- start start 2023-08-17T00:15:25.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 0x7f43940ad460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f43940a7340 0x7f43940aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940bce10 0x7f43941555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43940ac1c0 con 0x7f43940a6f60 2023-08-17T00:15:25.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4394065b30 con 0x7f43940a7340 2023-08-17T00:15:25.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4399946700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43940ada60 con 0x7f43940bce10 2023-08-17T00:15:25.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4392ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 0x7f43940ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4392ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 0x7f43940ad460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37714/0 (socket says 172.21.15.153:37714) 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4392ffd700 1 -- 172.21.15.153:0/2973140161 learned_addr learned my addr 172.21.15.153:0/2973140161 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f4393fff700 1 --2- 172.21.15.153:0/2973140161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940bce10 0x7f43941555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.285+0000 7f43927fc700 1 --2- 172.21.15.153:0/2973140161 >> v2:172.21.15.178:3300/0 conn(0x7f43940a7340 0x7f43940aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4393fff700 1 -- 172.21.15.153:0/2973140161 >> v2:172.21.15.178:3300/0 conn(0x7f43940a7340 msgr2=0x7f43940aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4393fff700 1 --2- 172.21.15.153:0/2973140161 >> v2:172.21.15.178:3300/0 conn(0x7f43940a7340 0x7f43940aaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4393fff700 1 -- 172.21.15.153:0/2973140161 >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 msgr2=0x7f43940ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:25.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4393fff700 1 --2- 172.21.15.153:0/2973140161 >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 0x7f43940ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4393fff700 1 -- 172.21.15.153:0/2973140161 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4394067b80 con 0x7f43940bce10 2023-08-17T00:15:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4392ffd700 1 --2- 172.21.15.153:0/2973140161 >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 0x7f43940ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:25.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4393fff700 1 --2- 172.21.15.153:0/2973140161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940bce10 0x7f43941555e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f43940be930 tx=0x7f438c009780).ready entity=mon.2 client_cookie=c3d6eb7616a0cb7b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4391ffb700 1 -- 172.21.15.153:0/2973140161 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00e070 con 0x7f43940bce10 2023-08-17T00:15:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4391ffb700 1 -- 172.21.15.153:0/2973140161 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c00bab0 con 0x7f43940bce10 2023-08-17T00:15:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4391ffb700 1 -- 172.21.15.153:0/2973140161 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c00be30 con 0x7f43940bce10 2023-08-17T00:15:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 -- 172.21.15.153:0/2973140161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940bce10 msgr2=0x7f43941555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 --2- 172.21.15.153:0/2973140161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940bce10 0x7f43941555e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f43940be930 tx=0x7f438c009780).stop 2023-08-17T00:15:25.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 -- 172.21.15.153:0/2973140161 shutdown_connections 2023-08-17T00:15:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 --2- 172.21.15.153:0/2973140161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940bce10 0x7f43941555e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 --2- 172.21.15.153:0/2973140161 >> v2:172.21.15.178:3300/0 conn(0x7f43940a7340 0x7f43940aaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 --2- 172.21.15.153:0/2973140161 >> v2:172.21.15.153:3300/0 conn(0x7f43940a6f60 0x7f43940ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 -- 172.21.15.153:0/2973140161 >> 172.21.15.153:0/2973140161 conn(0x7f43940c4950 msgr2=0x7f43940c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 -- 172.21.15.153:0/2973140161 shutdown_connections 2023-08-17T00:15:25.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.289+0000 7f4399946700 1 -- 172.21.15.153:0/2973140161 wait complete. 2023-08-17T00:15:25.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 Processor -- start 2023-08-17T00:15:25.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 -- start start 2023-08-17T00:15:25.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940a6f60 0x7f439413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 0x7f43940c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43940bce10 0x7f43940c32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439414f0b0 con 0x7f43940a7340 2023-08-17T00:15:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439414e780 con 0x7f43940bce10 2023-08-17T00:15:25.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4399946700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439414ea60 con 0x7f43940a6f60 2023-08-17T00:15:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f43927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 0x7f43940c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f43927fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 0x7f43940c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37722/0 (socket says 172.21.15.153:37722) 2023-08-17T00:15:25.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f43927fc700 1 -- 172.21.15.153:0/2198236115 learned_addr learned my addr 172.21.15.153:0/2198236115 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4393fff700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43940bce10 0x7f43940c32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.293+0000 7f4392ffd700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940a6f60 0x7f439413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f43927fc700 1 -- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940a6f60 msgr2=0x7f439413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f43927fc700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940a6f60 0x7f439413a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f43927fc700 1 -- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43940bce10 msgr2=0x7f43940c32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f43927fc700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43940bce10 0x7f43940c32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f43927fc700 1 -- 172.21.15.153:0/2198236115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4384009370 con 0x7f43940a7340 2023-08-17T00:15:25.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f43927fc700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 0x7f43940c2de0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f438800e930 tx=0x7f4388009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:25.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388012600 con 0x7f43940a7340 2023-08-17T00:15:25.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4388012760 con 0x7f43940a7340 2023-08-17T00:15:25.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438c009a20 con 0x7f43940a7340 2023-08-17T00:15:25.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4388012ae0 con 0x7f43940a7340 2023-08-17T00:15:25.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439414e430 con 0x7f43940a7340 2023-08-17T00:15:25.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.297+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439414f260 con 0x7f43940a7340 2023-08-17T00:15:25.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.301+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4388022070 con 0x7f43940a7340 2023-08-17T00:15:25.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.301+0000 7f437affd700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f438005a180 0x7f438005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.301+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4388074470 con 0x7f43940a7340 2023-08-17T00:15:25.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.301+0000 7f4392ffd700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f438005a180 0x7f438005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.301+0000 7f4392ffd700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f438005a180 0x7f438005c640 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f4384006fd0 tx=0x7f43840090f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:25.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.305+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f439414f260 con 0x7f43940a7340 2023-08-17T00:15:25.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.465+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f439406b530 con 0x7f43940a7340 2023-08-17T00:15:25.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.465+0000 7f437affd700 1 -- 172.21.15.153:0/2198236115 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f4388047e10 con 0x7f43940a7340 2023-08-17T00:15:25.471 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:25.472 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":154,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:43.889439+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:14:40.874126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T00:14:41.882057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:25.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f438005a180 msgr2=0x7f438005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f438005a180 0x7f438005c640 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f4384006fd0 tx=0x7f43840090f0).stop 2023-08-17T00:15:25.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 msgr2=0x7f43940c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 0x7f43940c2de0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 rx=0x7f438800e930 tx=0x7f4388009060).stop 2023-08-17T00:15:25.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 shutdown_connections 2023-08-17T00:15:25.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f438005a180 0x7f438005c640 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43940bce10 0x7f43940c32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f43940a7340 0x7f43940c2de0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 --2- 172.21.15.153:0/2198236115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43940a6f60 0x7f439413a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 >> 172.21.15.153:0/2198236115 conn(0x7f43940c4950 msgr2=0x7f43940a5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:25.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 shutdown_connections 2023-08-17T00:15:25.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.469+0000 7f4399946700 1 -- 172.21.15.153:0/2198236115 wait complete. 2023-08-17T00:15:25.493 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:15:25.494 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:25.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 Processor -- start 2023-08-17T00:15:25.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 -- start start 2023-08-17T00:15:25.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb40e1a20 0x7efeb40e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efeb4054010 0x7efeb4057980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb4054470 con 0x7efeb4037930 2023-08-17T00:15:25.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb4038b60 con 0x7efeb4054010 2023-08-17T00:15:25.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec2679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4057e70 con 0x7efeb40e1a20 2023-08-17T00:15:25.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efeb4054010 0x7efeb4057980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7efeb4054010 0x7efeb4057980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37726/0 (socket says 172.21.15.153:37726) 2023-08-17T00:15:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 -- 172.21.15.153:0/3981270428 learned_addr learned my addr 172.21.15.153:0/3981270428 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec1677700 1 --2- 172.21.15.153:0/3981270428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb40e1a20 0x7efeb40e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 -- 172.21.15.153:0/3981270428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb40e1a20 msgr2=0x7efeb40e1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 --2- 172.21.15.153:0/3981270428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb40e1a20 0x7efeb40e1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 -- 172.21.15.153:0/3981270428 >> v1:172.21.15.178:6789/0 conn(0x7efeb4037930 legacy=0x7efeb40e5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.645+0000 7efec0e76700 1 -- 172.21.15.153:0/3981270428 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40580c0 con 0x7efeb4054010 2023-08-17T00:15:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec0e76700 1 --2- 172.21.15.153:0/3981270428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4054010 0x7efeb4057980 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7efeac006fd0 tx=0x7efeac0090f0).ready entity=mon.0 client_cookie=1adc83ea1b3f7e7e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efeb3fff700 1 -- 172.21.15.153:0/3981270428 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00b600 con 0x7efeb4054010 2023-08-17T00:15:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efeb3fff700 1 -- 172.21.15.153:0/3981270428 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac00b760 con 0x7efeb4054010 2023-08-17T00:15:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efeb3fff700 1 -- 172.21.15.153:0/3981270428 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00bae0 con 0x7efeb4054010 2023-08-17T00:15:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 -- 172.21.15.153:0/3981270428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4054010 msgr2=0x7efeb4057980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 --2- 172.21.15.153:0/3981270428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4054010 0x7efeb4057980 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 rx=0x7efeac006fd0 tx=0x7efeac0090f0).stop 2023-08-17T00:15:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 -- 172.21.15.153:0/3981270428 shutdown_connections 2023-08-17T00:15:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 --2- 172.21.15.153:0/3981270428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4054010 0x7efeb4057980 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 --2- 172.21.15.153:0/3981270428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb40e1a20 0x7efeb40e1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 -- 172.21.15.153:0/3981270428 >> 172.21.15.153:0/3981270428 conn(0x7efeb4055500 msgr2=0x7efeb40558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 -- 172.21.15.153:0/3981270428 shutdown_connections 2023-08-17T00:15:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.649+0000 7efec2679700 1 -- 172.21.15.153:0/3981270428 wait complete. 2023-08-17T00:15:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 Processor -- start 2023-08-17T00:15:25.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 -- start start 2023-08-17T00:15:25.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 0x7efeb40d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb4054010 0x7efeb40e2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40e1a20 0x7efeb40e2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4038d70 con 0x7efeb4037930 2023-08-17T00:15:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4052750 con 0x7efeb40e1a20 2023-08-17T00:15:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb4039010 con 0x7efeb4054010 2023-08-17T00:15:25.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 0x7efeb40d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 0x7efeb40d03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37734/0 (socket says 172.21.15.153:37734) 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 -- 172.21.15.153:0/2015294476 learned_addr learned my addr 172.21.15.153:0/2015294476 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec0e76700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb4054010 0x7efeb40e2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1e78700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40e1a20 0x7efeb40e2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 -- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb4054010 msgr2=0x7efeb40e2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb4054010 0x7efeb40e2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 -- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40e1a20 msgr2=0x7efeb40e2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40e1a20 0x7efeb40e2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 -- 172.21.15.153:0/2015294476 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac009370 con 0x7efeb4037930 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec0e76700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb4054010 0x7efeb40e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec1677700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 0x7efeb40d03c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7efeb800d890 tx=0x7efeb8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb80125f0 con 0x7efeb4037930 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb8012750 con 0x7efeb4037930 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb40392f0 con 0x7efeb4037930 2023-08-17T00:15:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.653+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb8012ad0 con 0x7efeb4037930 2023-08-17T00:15:25.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.657+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb40d08b0 con 0x7efeb4037930 2023-08-17T00:15:25.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.657+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb4005720 con 0x7efeb4037930 2023-08-17T00:15:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.657+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efeb8013480 con 0x7efeb4037930 2023-08-17T00:15:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.661+0000 7efeb17fa700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efea005a150 0x7efea005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.661+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7efeb8073f90 con 0x7efeb4037930 2023-08-17T00:15:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.661+0000 7efec0e76700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efea005a150 0x7efea005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.661+0000 7efec0e76700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efea005a150 0x7efea005c610 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7efeac006fd0 tx=0x7efeac017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.665+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efeb80479e0 con 0x7efeb4037930 2023-08-17T00:15:25.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.861+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efeb40583a0 con 0x7efeb4037930 2023-08-17T00:15:25.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.861+0000 7efeb17fa700 1 -- 172.21.15.153:0/2015294476 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4511 (secure 0 0 0) 0x7efeb804b000 con 0x7efeb4037930 2023-08-17T00:15:25.868 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:25.869 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:14:42.884494+0000","modified":"2023-08-17T00:14:45.904108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4258690159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4258690159},{"type":"v1","addr":"172.21.15.153:6835","nonce":4258690159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T00:15:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efea005a150 msgr2=0x7efea005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efea005a150 0x7efea005c610 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7efeac006fd0 tx=0x7efeac017000).stop 2023-08-17T00:15:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 msgr2=0x7efeb40d03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 0x7efeb40d03c0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 rx=0x7efeb800d890 tx=0x7efeb8008040).stop 2023-08-17T00:15:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 shutdown_connections 2023-08-17T00:15:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efea005a150 0x7efea005c610 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efeb40e1a20 0x7efeb40e2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efeb4054010 0x7efeb40e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 --2- 172.21.15.153:0/2015294476 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efeb4037930 0x7efeb40d03c0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 >> 172.21.15.153:0/2015294476 conn(0x7efeb4055500 msgr2=0x7efeb4037da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 shutdown_connections 2023-08-17T00:15:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:25.865+0000 7efec2679700 1 -- 172.21.15.153:0/2015294476 wait complete. 2023-08-17T00:15:25.874 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 122 2023-08-17T00:15:25.891 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:26.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.041+0000 7fc8db59e700 1 Processor -- start 2023-08-17T00:15:26.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.041+0000 7fc8db59e700 1 -- start start 2023-08-17T00:15:26.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8db59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 0x7fc8dc15b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8db59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0ab9b0 con 0x7fc8dc150880 2023-08-17T00:15:26.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8db59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8dc0a9080 con 0x7fc8dc0aa8c0 2023-08-17T00:15:26.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8db59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0aada0 con 0x7fc8dc068f30 2023-08-17T00:15:26.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8da59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc8dc150880 0x7fc8dc0a8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53076/0 (socket says 172.21.15.153:53076) 2023-08-17T00:15:26.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8da59c700 1 -- 172.21.15.153:0/2192261144 learned_addr learned my addr 172.21.15.153:0/2192261144 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:26.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8dad9d700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 0x7fc8dc15b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3767630727 0 0) 0x7fc8dc0ab9b0 con 0x7fc8dc150880 2023-08-17T00:15:26.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8c80033f0 con 0x7fc8dc150880 2023-08-17T00:15:26.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238596829 0 0) 0x7fc8dc0a9080 con 0x7fc8dc0aa8c0 2023-08-17T00:15:26.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8dc0ab9b0 con 0x7fc8dc0aa8c0 2023-08-17T00:15:26.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1928329642 0 0) 0x7fc8c80033f0 con 0x7fc8dc150880 2023-08-17T00:15:26.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 msgr2=0x7fc8dc15b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:26.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 0x7fc8dc15b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 >> v1:172.21.15.178:6789/0 conn(0x7fc8dc0aa8c0 legacy=0x7fc8dc068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0ab080 con 0x7fc8dc150880 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fc8cc004d60 con 0x7fc8dc150880 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 >> v1:172.21.15.153:6789/0 conn(0x7fc8dc150880 legacy=0x7fc8dc0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8c8003aa0 0x7fc8c8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8004690 0x7fc8c8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 0x7fc8c8005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0aada0 con 0x7fc8c8004690 2023-08-17T00:15:26.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c800dba0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c800dd60 con 0x7fc8dc068f30 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8d1d9b700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8004690 0x7fc8c8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8da59c700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8c8003aa0 0x7fc8c8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.045+0000 7fc8dad9d700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 0x7fc8c8005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8da59c700 1 -- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 msgr2=0x7fc8c8005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8da59c700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc068f30 0x7fc8c8005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8da59c700 1 -- 172.21.15.153:0/2192261144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8004690 msgr2=0x7fc8c8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:26.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8da59c700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8004690 0x7fc8c8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8da59c700 1 -- 172.21.15.153:0/2192261144 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c80033f0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8d1d9b700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8004690 0x7fc8c8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:26.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8da59c700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8c8003aa0 0x7fc8c8003ea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fc8cc00c0e0 tx=0x7fc8cc0056e0).ready entity=mon.1 client_cookie=58ea290086ac7d72 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc007960 con 0x7fc8c8003aa0 2023-08-17T00:15:26.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc00ca10 con 0x7fc8c8003aa0 2023-08-17T00:15:26.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8d9d9b700 1 -- 172.21.15.153:0/2192261144 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc00cdb0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8db59e700 1 -- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8c8003aa0 msgr2=0x7fc8c8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8db59e700 1 --2- 172.21.15.153:0/2192261144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8c8003aa0 0x7fc8c8003ea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7fc8cc00c0e0 tx=0x7fc8cc0056e0).stop 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8dad9d700 1 -- 172.21.15.153:0/2192261144 reap_dead start 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8db59e700 1 -- 172.21.15.153:0/2192261144 shutdown_connections 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8db59e700 1 -- 172.21.15.153:0/2192261144 >> 172.21.15.153:0/2192261144 conn(0x7fc8dc0c6620 msgr2=0x7fc8dc0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8db59e700 1 -- 172.21.15.153:0/2192261144 shutdown_connections 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.049+0000 7fc8db59e700 1 -- 172.21.15.153:0/2192261144 wait complete. 2023-08-17T00:15:26.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 Processor -- start 2023-08-17T00:15:26.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 -- start start 2023-08-17T00:15:26.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 0x7fc8dc14f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc14fbf0 0x7fc8dc153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc153720 0x7fc8dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0be720 con 0x7fc8c8003aa0 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0bf2a0 con 0x7fc8dc14fbf0 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8dc0be970 con 0x7fc8dc153720 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 0x7fc8dc14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 0x7fc8dc14f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37752/0 (socket says 172.21.15.153:37752) 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 -- 172.21.15.153:0/1386310293 learned_addr learned my addr 172.21.15.153:0/1386310293 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8d1d9b700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc14fbf0 0x7fc8dc153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8dad9d700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc153720 0x7fc8dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 -- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc153720 msgr2=0x7fc8dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc153720 0x7fc8dc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 -- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc14fbf0 msgr2=0x7fc8dc153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc14fbf0 0x7fc8dc153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 -- 172.21.15.153:0/1386310293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8dc0bec50 con 0x7fc8c8003aa0 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8d1d9b700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc14fbf0 0x7fc8dc153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8da59c700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 0x7fc8dc14f700 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7fc8c800dd30 tx=0x7fc8cc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc0072e0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8cc007440 con 0x7fc8c8003aa0 2023-08-17T00:15:26.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8dc0bef30 con 0x7fc8c8003aa0 2023-08-17T00:15:26.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.053+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8cc005780 con 0x7fc8c8003aa0 2023-08-17T00:15:26.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.057+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8dc0bf730 con 0x7fc8c8003aa0 2023-08-17T00:15:26.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.057+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc0be700 con 0x7fc8c8003aa0 2023-08-17T00:15:26.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.057+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc8cc010070 con 0x7fc8c8003aa0 2023-08-17T00:15:26.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.057+0000 7fc8d2ffd700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc8bc05a150 0x7fc8bc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.057+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc8cc019070 con 0x7fc8c8003aa0 2023-08-17T00:15:26.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.061+0000 7fc8d1d9b700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc8bc05a150 0x7fc8bc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.061+0000 7fc8d1d9b700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc8bc05a150 0x7fc8bc05c610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fc8c4007a40 tx=0x7fc8c4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.065+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8cc0489b0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.257+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8dc06b4c0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.257+0000 7fc8d2ffd700 1 -- 172.21.15.153:0/1386310293 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4511 (secure 0 0 0) 0x7fc8cc04bfd0 con 0x7fc8c8003aa0 2023-08-17T00:15:26.263 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:26.264 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":122,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:14:42.884494+0000","modified":"2023-08-17T00:14:45.904108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8982},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8982":{"gid":8982,"name":"a","rank":0,"incarnation":118,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4258690159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4258690159},{"type":"v1","addr":"172.21.15.153:6835","nonce":4258690159}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-08-17T00:15:26.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc8bc05a150 msgr2=0x7fc8bc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc8bc05a150 0x7fc8bc05c610 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fc8c4007a40 tx=0x7fc8c4009040).stop 2023-08-17T00:15:26.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 msgr2=0x7fc8dc14f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 0x7fc8dc14f700 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 rx=0x7fc8c800dd30 tx=0x7fc8cc015000).stop 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 shutdown_connections 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc8bc05a150 0x7fc8bc05c610 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8dc153720 0x7fc8dc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8dc14fbf0 0x7fc8dc153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 --2- 172.21.15.153:0/1386310293 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8c8003aa0 0x7fc8dc14f700 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 >> 172.21.15.153:0/1386310293 conn(0x7fc8dc0c6620 msgr2=0x7fc8dc0687f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:26.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 shutdown_connections 2023-08-17T00:15:26.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.261+0000 7fc8db59e700 1 -- 172.21.15.153:0/1386310293 wait complete. 2023-08-17T00:15:26.268 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 122 2023-08-17T00:15:26.288 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:26.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.441+0000 7fcc2d569700 1 Processor -- start 2023-08-17T00:15:26.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.441+0000 7fcc2d569700 1 -- start start 2023-08-17T00:15:26.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc28153ce0 0x7fcc281540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280644b0 0x7fcc28063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc280bfb60 con 0x7fcc280aaa80 2023-08-17T00:15:26.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280642e0 con 0x7fcc28153ce0 2023-08-17T00:15:26.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280c09c0 con 0x7fcc280644b0 2023-08-17T00:15:26.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc28153ce0 0x7fcc281540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcc28153ce0 0x7fcc281540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37762/0 (socket says 172.21.15.153:37762) 2023-08-17T00:15:26.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 -- 172.21.15.153:0/662006009 learned_addr learned my addr 172.21.15.153:0/662006009 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:26.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc277fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcc280aaa80 0x7fcc280c5800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53086/0 (socket says 172.21.15.153:53086) 2023-08-17T00:15:26.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc267fc700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280644b0 0x7fcc28063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 -- 172.21.15.153:0/662006009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280644b0 msgr2=0x7fcc28063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:26.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280644b0 0x7fcc28063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 -- 172.21.15.153:0/662006009 >> v1:172.21.15.153:6789/0 conn(0x7fcc280aaa80 legacy=0x7fcc280c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 -- 172.21.15.153:0/662006009 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280bfdb0 con 0x7fcc28153ce0 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc267fc700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280644b0 0x7fcc28063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc26ffd700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc28153ce0 0x7fcc281540c0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fcc18006fd0 tx=0x7fcc180090f0).ready entity=mon.0 client_cookie=18e9838031cb1fda server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc25ffb700 1 -- 172.21.15.153:0/662006009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800b600 con 0x7fcc28153ce0 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc25ffb700 1 -- 172.21.15.153:0/662006009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800b760 con 0x7fcc28153ce0 2023-08-17T00:15:26.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc25ffb700 1 -- 172.21.15.153:0/662006009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800bb00 con 0x7fcc28153ce0 2023-08-17T00:15:26.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 -- 172.21.15.153:0/662006009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc28153ce0 msgr2=0x7fcc281540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc28153ce0 0x7fcc281540c0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 rx=0x7fcc18006fd0 tx=0x7fcc180090f0).stop 2023-08-17T00:15:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 -- 172.21.15.153:0/662006009 shutdown_connections 2023-08-17T00:15:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280644b0 0x7fcc28063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.445+0000 7fcc2d569700 1 --2- 172.21.15.153:0/662006009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc28153ce0 0x7fcc281540c0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.449+0000 7fcc2d569700 1 -- 172.21.15.153:0/662006009 >> 172.21.15.153:0/662006009 conn(0x7fcc280cb710 msgr2=0x7fcc280c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.449+0000 7fcc2d569700 1 -- 172.21.15.153:0/662006009 shutdown_connections 2023-08-17T00:15:26.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.449+0000 7fcc2d569700 1 -- 172.21.15.153:0/662006009 wait complete. 2023-08-17T00:15:26.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 Processor -- start 2023-08-17T00:15:26.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 -- start start 2023-08-17T00:15:26.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 0x7fcc281695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280aaa80 0x7fcc28165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc28153ce0 0x7fcc280af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2814b820 con 0x7fcc280644b0 2023-08-17T00:15:26.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280aeba0 con 0x7fcc28153ce0 2023-08-17T00:15:26.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280adf90 con 0x7fcc280aaa80 2023-08-17T00:15:26.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 0x7fcc281695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 0x7fcc281695e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37776/0 (socket says 172.21.15.153:37776) 2023-08-17T00:15:26.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 -- 172.21.15.153:0/412018655 learned_addr learned my addr 172.21.15.153:0/412018655 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:26.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc267fc700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280aaa80 0x7fcc28165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc277fe700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc28153ce0 0x7fcc280af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 -- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280aaa80 msgr2=0x7fcc28165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280aaa80 0x7fcc28165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 -- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc28153ce0 msgr2=0x7fcc280af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc28153ce0 0x7fcc280af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 -- 172.21.15.153:0/412018655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009370 con 0x7fcc280644b0 2023-08-17T00:15:26.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc267fc700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280aaa80 0x7fcc28165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc277fe700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc28153ce0 0x7fcc280af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc26ffd700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 0x7fcc281695e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fcc18009170 tx=0x7fcc18017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18002f30 con 0x7fcc280644b0 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800b8d0 con 0x7fcc280644b0 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc280ae270 con 0x7fcc280644b0 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18024470 con 0x7fcc280644b0 2023-08-17T00:15:26.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.453+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc280ae830 con 0x7fcc280644b0 2023-08-17T00:15:26.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.457+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2806b530 con 0x7fcc280644b0 2023-08-17T00:15:26.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.457+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcc1800f070 con 0x7fcc280644b0 2023-08-17T00:15:26.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.457+0000 7fcc0effd700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcc1405a150 0x7fcc1405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.457+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcc18075df0 con 0x7fcc280644b0 2023-08-17T00:15:26.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.461+0000 7fcc267fc700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcc1405a150 0x7fcc1405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.461+0000 7fcc267fc700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcc1405a150 0x7fcc1405c610 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fcc1c006fd0 tx=0x7fcc1c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.465+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcc18049790 con 0x7fcc280644b0 2023-08-17T00:15:26.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.629+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc280c0090 con 0x7fcc280644b0 2023-08-17T00:15:26.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.629+0000 7fcc0effd700 1 -- 172.21.15.153:0/412018655 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+16990 (secure 0 0 0) 0x7fcc1804cdb0 con 0x7fcc280644b0 2023-08-17T00:15:26.637 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:26.637 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":154,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:14:43.889439+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:14:40.874126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-08-17T00:14:41.882057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:26.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcc1405a150 msgr2=0x7fcc1405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcc1405a150 0x7fcc1405c610 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fcc1c006fd0 tx=0x7fcc1c008040).stop 2023-08-17T00:15:26.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 msgr2=0x7fcc281695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 0x7fcc281695e0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 rx=0x7fcc18009170 tx=0x7fcc18017000).stop 2023-08-17T00:15:26.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 shutdown_connections 2023-08-17T00:15:26.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcc1405a150 0x7fcc1405c610 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc28153ce0 0x7fcc280af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc280aaa80 0x7fcc28165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 --2- 172.21.15.153:0/412018655 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcc280644b0 0x7fcc281695e0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 >> 172.21.15.153:0/412018655 conn(0x7fcc280cb710 msgr2=0x7fcc28147b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 shutdown_connections 2023-08-17T00:15:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.633+0000 7fcc2d569700 1 -- 172.21.15.153:0/412018655 wait complete. 2023-08-17T00:15:26.661 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:15:26.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 Processor -- start 2023-08-17T00:15:26.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 -- start start 2023-08-17T00:15:26.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb050153d50 0x7fb0500632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb050154130 0x7fb0500629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb050065240 con 0x7fb0500656d0 2023-08-17T00:15:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb050062ea0 con 0x7fb050153d50 2023-08-17T00:15:26.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.813+0000 7fb05491b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb050063880 con 0x7fb050154130 2023-08-17T00:15:26.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb050153d50 0x7fb0500632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb050153d50 0x7fb0500632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37786/0 (socket says 172.21.15.153:37786) 2023-08-17T00:15:26.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 -- 172.21.15.153:0/3800951369 learned_addr learned my addr 172.21.15.153:0/3800951369 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:26.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04dd9b700 1 --2- 172.21.15.153:0/3800951369 >> v2:172.21.15.178:3300/0 conn(0x7fb050154130 0x7fb0500629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 -- 172.21.15.153:0/3800951369 >> v2:172.21.15.178:3300/0 conn(0x7fb050154130 msgr2=0x7fb0500629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:26.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 --2- 172.21.15.153:0/3800951369 >> v2:172.21.15.178:3300/0 conn(0x7fb050154130 0x7fb0500629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 -- 172.21.15.153:0/3800951369 >> v1:172.21.15.178:6789/0 conn(0x7fb0500656d0 legacy=0x7fb0500bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 -- 172.21.15.153:0/3800951369 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb050064910 con 0x7fb050153d50 2023-08-17T00:15:26.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04e59c700 1 --2- 172.21.15.153:0/3800951369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050153d50 0x7fb0500632e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7fb050064150 tx=0x7fb0400090f0).ready entity=mon.0 client_cookie=120b94c9a47c72e8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04d59a700 1 -- 172.21.15.153:0/3800951369 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000b600 con 0x7fb050153d50 2023-08-17T00:15:26.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04d59a700 1 -- 172.21.15.153:0/3800951369 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000b760 con 0x7fb050153d50 2023-08-17T00:15:26.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb04d59a700 1 -- 172.21.15.153:0/3800951369 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000bb00 con 0x7fb050153d50 2023-08-17T00:15:26.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 -- 172.21.15.153:0/3800951369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050153d50 msgr2=0x7fb0500632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 --2- 172.21.15.153:0/3800951369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050153d50 0x7fb0500632e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 rx=0x7fb050064150 tx=0x7fb0400090f0).stop 2023-08-17T00:15:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 -- 172.21.15.153:0/3800951369 shutdown_connections 2023-08-17T00:15:26.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 --2- 172.21.15.153:0/3800951369 >> v2:172.21.15.178:3300/0 conn(0x7fb050154130 0x7fb0500629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 --2- 172.21.15.153:0/3800951369 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050153d50 0x7fb0500632e0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 -- 172.21.15.153:0/3800951369 >> 172.21.15.153:0/3800951369 conn(0x7fb0500c7150 msgr2=0x7fb0500c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:26.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 -- 172.21.15.153:0/3800951369 shutdown_connections 2023-08-17T00:15:26.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.817+0000 7fb05491b700 1 -- 172.21.15.153:0/3800951369 wait complete. 2023-08-17T00:15:26.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.821+0000 7fb05491b700 1 Processor -- start 2023-08-17T00:15:26.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.821+0000 7fb05491b700 1 -- start start 2023-08-17T00:15:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0500656d0 0x7fb050165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb050153d50 0x7fb0500bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 0x7fb0500bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb050165910 con 0x7fb050154130 2023-08-17T00:15:26.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500c0110 con 0x7fb0500656d0 2023-08-17T00:15:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500a9ba0 con 0x7fb050153d50 2023-08-17T00:15:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 0x7fb0500bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 0x7fb0500bfc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37798/0 (socket says 172.21.15.153:37798) 2023-08-17T00:15:26.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04e59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0500656d0 0x7fb050165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 -- 172.21.15.153:0/1141731971 learned_addr learned my addr 172.21.15.153:0/1141731971 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04dd9b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb050153d50 0x7fb0500bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 -- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb050153d50 msgr2=0x7fb0500bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb050153d50 0x7fb0500bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 -- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0500656d0 msgr2=0x7fb050165aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0500656d0 0x7fb050165aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:26.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 -- 172.21.15.153:0/1141731971 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009370 con 0x7fb050154130 2023-08-17T00:15:26.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb04ed9d700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 0x7fb0500bfc20 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7fb04800c7c0 tx=0x7fb0480014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800e4a0 con 0x7fb050154130 2023-08-17T00:15:26.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800e600 con 0x7fb050154130 2023-08-17T00:15:26.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb050165350 con 0x7fb050154130 2023-08-17T00:15:26.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.825+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0500a9830 con 0x7fb050154130 2023-08-17T00:15:26.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.829+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800e980 con 0x7fb050154130 2023-08-17T00:15:26.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.829+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb034005120 con 0x7fb050154130 2023-08-17T00:15:26.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.829+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb048010070 con 0x7fb050154130 2023-08-17T00:15:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.833+0000 7fb03e7fc700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb03005a150 0x7fb03005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:26.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.833+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb048073fd0 con 0x7fb050154130 2023-08-17T00:15:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.833+0000 7fb04e59c700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb03005a150 0x7fb03005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:26.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.833+0000 7fb04e59c700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb03005a150 0x7fb03005c610 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fb04000b3c0 tx=0x7fb040017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:26.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:26.837+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb0480479f0 con 0x7fb050154130 2023-08-17T00:15:27.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.033+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb0340056a0 con 0x7fb050154130 2023-08-17T00:15:27.581 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:15:27.577+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:15:27.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.589+0000 7fb03e7fc700 1 -- 172.21.15.153:0/1141731971 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v123) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb048020070 con 0x7fb050154130 2023-08-17T00:15:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb03005a150 msgr2=0x7fb03005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb03005a150 0x7fb03005c610 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7fb04000b3c0 tx=0x7fb040017000).stop 2023-08-17T00:15:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 msgr2=0x7fb0500bfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:27.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 0x7fb0500bfc20 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 rx=0x7fb04800c7c0 tx=0x7fb0480014e0).stop 2023-08-17T00:15:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 shutdown_connections 2023-08-17T00:15:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb03005a150 0x7fb03005c610 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb050154130 0x7fb0500bfc20 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb050153d50 0x7fb0500bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 --2- 172.21.15.153:0/1141731971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb0500656d0 0x7fb050165aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 >> 172.21.15.153:0/1141731971 conn(0x7fb0500c7150 msgr2=0x7fb0500c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:27.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 shutdown_connections 2023-08-17T00:15:27.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.593+0000 7fb05491b700 1 -- 172.21.15.153:0/1141731971 wait complete. 2023-08-17T00:15:27.601 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:15:27.604 INFO:tasks.ceph.mds.a.smithi153.stderr: -1941> 2023-08-17T00:14:48.402+0000 7fbba0779700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:15:27.620 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:15:27.650 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:15:27.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.769+0000 7ff91e6e4700 1 Processor -- start 2023-08-17T00:15:27.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.769+0000 7ff91e6e4700 1 -- start start 2023-08-17T00:15:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9180acf30 0x7ff9180c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff9180c5ea0 0x7ff9180634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:27.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff918154e90 con 0x7ff9180639a0 2023-08-17T00:15:27.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918153fc0 con 0x7ff9180acf30 2023-08-17T00:15:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff918154280 con 0x7ff9180c5ea0 2023-08-17T00:15:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9180acf30 0x7ff9180c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff9180acf30 0x7ff9180c1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37822/0 (socket says 172.21.15.153:37822) 2023-08-17T00:15:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 -- 172.21.15.153:0/194583910 learned_addr learned my addr 172.21.15.153:0/194583910 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91cee1700 1 --2- 172.21.15.153:0/194583910 >> v2:172.21.15.178:3300/0 conn(0x7ff9180c5ea0 0x7ff9180634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:27.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 -- 172.21.15.153:0/194583910 >> v2:172.21.15.178:3300/0 conn(0x7ff9180c5ea0 msgr2=0x7ff9180634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 --2- 172.21.15.153:0/194583910 >> v2:172.21.15.178:3300/0 conn(0x7ff9180c5ea0 0x7ff9180634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 -- 172.21.15.153:0/194583910 >> v1:172.21.15.153:6789/0 conn(0x7ff9180639a0 legacy=0x7ff918157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 -- 172.21.15.153:0/194583910 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918154560 con 0x7ff9180acf30 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91d6e2700 1 --2- 172.21.15.153:0/194583910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c1020 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7ff9180b0a60 tx=0x7ff9140090f0).ready entity=mon.0 client_cookie=16a06ef12325bd86 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff90ffff700 1 -- 172.21.15.153:0/194583910 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91400b600 con 0x7ff9180acf30 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff90ffff700 1 -- 172.21.15.153:0/194583910 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91400b760 con 0x7ff9180acf30 2023-08-17T00:15:27.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff90ffff700 1 -- 172.21.15.153:0/194583910 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91400bae0 con 0x7ff9180acf30 2023-08-17T00:15:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 -- 172.21.15.153:0/194583910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 msgr2=0x7ff9180c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.773+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/194583910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c1020 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 rx=0x7ff9180b0a60 tx=0x7ff9140090f0).stop 2023-08-17T00:15:27.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- 172.21.15.153:0/194583910 shutdown_connections 2023-08-17T00:15:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/194583910 >> v2:172.21.15.178:3300/0 conn(0x7ff9180c5ea0 0x7ff9180634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/194583910 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c1020 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- 172.21.15.153:0/194583910 >> 172.21.15.153:0/194583910 conn(0x7ff9180cb330 msgr2=0x7ff9180c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- 172.21.15.153:0/194583910 shutdown_connections 2023-08-17T00:15:27.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- 172.21.15.153:0/194583910 wait complete. 2023-08-17T00:15:27.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 Processor -- start 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- start start 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9180639a0 0x7ff9180b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9180ca210 0x7ff918167390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180ae030 con 0x7ff9180acf30 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180ca690 con 0x7ff9180639a0 2023-08-17T00:15:27.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91e6e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918168050 con 0x7ff9180ca210 2023-08-17T00:15:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.777+0000 7ff91cee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37830/0 (socket says 172.21.15.153:37830) 2023-08-17T00:15:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 -- 172.21.15.153:0/3169444103 learned_addr learned my addr 172.21.15.153:0/3169444103 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:27.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91d6e2700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9180639a0 0x7ff9180b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:27.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91dee3700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9180ca210 0x7ff918167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:27.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 -- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9180ca210 msgr2=0x7ff918167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:27.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9180ca210 0x7ff918167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 -- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9180639a0 msgr2=0x7ff9180b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9180639a0 0x7ff9180b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 -- 172.21.15.153:0/3169444103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff914009370 con 0x7ff9180acf30 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91cee1700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c9d20 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7ff90800d890 tx=0x7ff908008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011590 con 0x7ff9180acf30 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9080116f0 con 0x7ff9180acf30 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9180ad9e0 con 0x7ff9180acf30 2023-08-17T00:15:27.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011a70 con 0x7ff9180acf30 2023-08-17T00:15:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9180b06e0 con 0x7ff9180acf30 2023-08-17T00:15:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.781+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9180ad840 con 0x7ff9180acf30 2023-08-17T00:15:27.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.785+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff908012420 con 0x7ff9180acf30 2023-08-17T00:15:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.785+0000 7ff90d7fa700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff8fc05a150 0x7ff8fc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:27.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.785+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6207+0+0 (secure 0 0 0) 0x7ff908073d50 con 0x7ff9180acf30 2023-08-17T00:15:27.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.785+0000 7ff91d6e2700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff8fc05a150 0x7ff8fc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:27.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.785+0000 7ff91d6e2700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff8fc05a150 0x7ff8fc05c610 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff914009130 tx=0x7ff914017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:27.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.793+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff9180ad840 con 0x7ff9180acf30 2023-08-17T00:15:27.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:27.989+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff9180ae1e0 con 0x7ff9180acf30 2023-08-17T00:15:28.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.593+0000 7ff90d7fa700 1 -- 172.21.15.153:0/3169444103 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v124) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff9180ae1e0 con 0x7ff9180acf30 2023-08-17T00:15:28.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff8fc05a150 msgr2=0x7ff8fc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff8fc05a150 0x7ff8fc05c610 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7ff914009130 tx=0x7ff914017000).stop 2023-08-17T00:15:28.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 msgr2=0x7ff9180c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c9d20 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 rx=0x7ff90800d890 tx=0x7ff908008040).stop 2023-08-17T00:15:28.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 shutdown_connections 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff8fc05a150 0x7ff8fc05c610 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9180ca210 0x7ff918167390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff9180acf30 0x7ff9180c9d20 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 --2- 172.21.15.153:0/3169444103 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9180639a0 0x7ff9180b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 >> 172.21.15.153:0/3169444103 conn(0x7ff9180cb330 msgr2=0x7ff9180c05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 shutdown_connections 2023-08-17T00:15:28.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.597+0000 7ff91e6e4700 1 -- 172.21.15.153:0/3169444103 wait complete. 2023-08-17T00:15:28.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:15:28.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4fa5edb700 1 Processor -- start 2023-08-17T00:15:28.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4fa5edb700 1 -- start start 2023-08-17T00:15:28.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4fa5edb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4fa00c1c70 0x7f4fa00656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:28.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4fa5edb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa00c2d50 con 0x7f4fa014b860 2023-08-17T00:15:28.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4fa5edb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa01521f0 con 0x7f4fa00652f0 2023-08-17T00:15:28.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4fa5edb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa0152e10 con 0x7f4fa00c1c70 2023-08-17T00:15:28.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.829+0000 7f4f9f7fe700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4fa00652f0 0x7f4fa00c1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42948/0 (socket says 172.21.15.153:42948) 2023-08-17T00:15:28.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9f7fe700 1 -- 172.21.15.153:0/3127397778 learned_addr learned my addr 172.21.15.153:0/3127397778 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:28.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f96ffd700 1 --2- 172.21.15.153:0/3127397778 >> v2:172.21.15.153:3300/0 conn(0x7f4fa00c1c70 0x7f4fa00656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:28.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9ffff700 1 --1- 172.21.15.153:0/3127397778 >> v1:172.21.15.153:6789/0 conn(0x7f4fa014b860 0x7f4fa014bcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53116/0 (socket says 172.21.15.153:53116) 2023-08-17T00:15:28.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9effd700 1 -- 172.21.15.153:0/3127397778 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029574957 0 0) 0x7f4fa01521f0 con 0x7f4fa00652f0 2023-08-17T00:15:28.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9effd700 1 -- 172.21.15.153:0/3127397778 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f8c0033f0 con 0x7f4fa00652f0 2023-08-17T00:15:28.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f96ffd700 1 -- 172.21.15.153:0/3127397778 >> v1:172.21.15.178:6789/0 conn(0x7f4fa00652f0 legacy=0x7f4fa00c1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f96ffd700 1 -- 172.21.15.153:0/3127397778 >> v1:172.21.15.153:6789/0 conn(0x7f4fa014b860 legacy=0x7f4fa014bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9effd700 1 -- 172.21.15.153:0/3127397778 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288654228 0 0) 0x7f4fa00c2d50 con 0x7f4fa014b860 2023-08-17T00:15:28.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f96ffd700 1 -- 172.21.15.153:0/3127397778 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00c2140 con 0x7f4fa00c1c70 2023-08-17T00:15:28.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f96ffd700 1 --2- 172.21.15.153:0/3127397778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa00c1c70 0x7f4fa00656d0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f4f88009760 tx=0x7f4f88009060).ready entity=mon.0 client_cookie=970a7d1e071440a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:28.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9effd700 1 -- 172.21.15.153:0/3127397778 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800f510 con 0x7f4fa00c1c70 2023-08-17T00:15:28.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9effd700 1 -- 172.21.15.153:0/3127397778 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8800f670 con 0x7f4fa00c1c70 2023-08-17T00:15:28.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4f9effd700 1 -- 172.21.15.153:0/3127397778 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800f9f0 con 0x7f4fa00c1c70 2023-08-17T00:15:28.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 -- 172.21.15.153:0/3127397778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa00c1c70 msgr2=0x7f4fa00656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/3127397778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa00c1c70 0x7f4fa00656d0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 rx=0x7f4f88009760 tx=0x7f4f88009060).stop 2023-08-17T00:15:28.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 -- 172.21.15.153:0/3127397778 shutdown_connections 2023-08-17T00:15:28.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/3127397778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa00c1c70 0x7f4fa00656d0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 -- 172.21.15.153:0/3127397778 >> 172.21.15.153:0/3127397778 conn(0x7f4fa00c7090 msgr2=0x7f4fa00c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:28.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 -- 172.21.15.153:0/3127397778 shutdown_connections 2023-08-17T00:15:28.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.833+0000 7f4fa5edb700 1 -- 172.21.15.153:0/3127397778 wait complete. 2023-08-17T00:15:28.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.837+0000 7f4fa5edb700 1 Processor -- start 2023-08-17T00:15:28.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.837+0000 7f4fa5edb700 1 -- start start 2023-08-17T00:15:28.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fa00652f0 0x7f4fa014da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:28.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa00c1c70 0x7f4fa0161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 0x7f4fa00bfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa013cb60 con 0x7f4fa014b860 2023-08-17T00:15:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa014d5a0 con 0x7f4fa00c1c70 2023-08-17T00:15:28.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0165e60 con 0x7f4fa00652f0 2023-08-17T00:15:28.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 0x7f4fa00bfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:28.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 0x7f4fa00bfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37842/0 (socket says 172.21.15.153:37842) 2023-08-17T00:15:28.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 -- 172.21.15.153:0/834262485 learned_addr learned my addr 172.21.15.153:0/834262485 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:28.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9f7fe700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fa00652f0 0x7f4fa014da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:28.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f96ffd700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa00c1c70 0x7f4fa0161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 -- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fa00652f0 msgr2=0x7f4fa014da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fa00652f0 0x7f4fa014da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 -- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa00c1c70 msgr2=0x7f4fa0161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa00c1c70 0x7f4fa0161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 -- 172.21.15.153:0/834262485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880092a0 con 0x7f4fa014b860 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f9ffff700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 0x7f4fa00bfd90 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f4f9800c490 tx=0x7f4f98007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:28.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800ce70 con 0x7f4fa014b860 2023-08-17T00:15:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f980072e0 con 0x7f4fa014b860 2023-08-17T00:15:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa0161930 con 0x7f4fa014b860 2023-08-17T00:15:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980056e0 con 0x7f4fa014b860 2023-08-17T00:15:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.841+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa00ac470 con 0x7f4fa014b860 2023-08-17T00:15:28.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.845+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa014d730 con 0x7f4fa014b860 2023-08-17T00:15:28.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.845+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4f9801a060 con 0x7f4fa014b860 2023-08-17T00:15:28.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.845+0000 7f4f97fff700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f8005a150 0x7f4f8005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:28.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.845+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f4f980737b0 con 0x7f4fa014b860 2023-08-17T00:15:28.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.845+0000 7f4f9f7fe700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f8005a150 0x7f4f8005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:28.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.849+0000 7f4f9f7fe700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f8005a150 0x7f4f8005c610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f4f90005ad0 tx=0x7f4f90009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:28.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:28.853+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f98047210 con 0x7f4fa014b860 2023-08-17T00:15:29.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.013+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4fa006b530 con 0x7f4fa014b860 2023-08-17T00:15:29.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.605+0000 7f4f97fff700 1 -- 172.21.15.153:0/834262485 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v156) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4f98018070 con 0x7f4fa014b860 2023-08-17T00:15:29.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f8005a150 msgr2=0x7f4f8005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f8005a150 0x7f4f8005c610 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 rx=0x7f4f90005ad0 tx=0x7f4f90009040).stop 2023-08-17T00:15:29.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 msgr2=0x7f4fa00bfd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 0x7f4fa00bfd90 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 rx=0x7f4f9800c490 tx=0x7f4f98007dc0).stop 2023-08-17T00:15:29.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 shutdown_connections 2023-08-17T00:15:29.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f8005a150 0x7f4f8005c610 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4fa014b860 0x7f4fa00bfd90 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4fa00c1c70 0x7f4fa0161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 --2- 172.21.15.153:0/834262485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4fa00652f0 0x7f4fa014da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 >> 172.21.15.153:0/834262485 conn(0x7f4fa00c7090 msgr2=0x7f4fa00bce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:29.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 shutdown_connections 2023-08-17T00:15:29.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.613+0000 7f4fa5edb700 1 -- 172.21.15.153:0/834262485 wait complete. 2023-08-17T00:15:29.621 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:15:29.638 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:15:29.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.789+0000 7f672b59e700 1 Processor -- start 2023-08-17T00:15:29.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.789+0000 7f672b59e700 1 -- start start 2023-08-17T00:15:29.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f672c1539b0 0x7f672c0632b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:29.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0c00d0 con 0x7f672c153d90 2023-08-17T00:15:29.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c0bf810 con 0x7f672c0a9eb0 2023-08-17T00:15:29.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c0aa910 con 0x7f672c1539b0 2023-08-17T00:15:29.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f6729d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f672c153d90 0x7f672c0a97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53126/0 (socket says 172.21.15.153:53126) 2023-08-17T00:15:29.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f6729d9b700 1 -- 172.21.15.153:0/1509682845 learned_addr learned my addr 172.21.15.153:0/1509682845 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672a59c700 1 --2- 172.21.15.153:0/1509682845 >> v2:172.21.15.178:3300/0 conn(0x7f672c1539b0 0x7f672c0632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295072392 0 0) 0x7f672c0c00d0 con 0x7f672c153d90 2023-08-17T00:15:29.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.793+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67140033f0 con 0x7f672c153d90 2023-08-17T00:15:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930211347 0 0) 0x7f672c0bf810 con 0x7f672c0a9eb0 2023-08-17T00:15:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c0c00d0 con 0x7f672c0a9eb0 2023-08-17T00:15:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2020187598 0 0) 0x7f67140033f0 con 0x7f672c153d90 2023-08-17T00:15:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672a59c700 1 -- 172.21.15.153:0/1509682845 >> v1:172.21.15.178:6789/0 conn(0x7f672c0a9eb0 legacy=0x7f672c0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672a59c700 1 -- 172.21.15.153:0/1509682845 >> v1:172.21.15.153:6789/0 conn(0x7f672c153d90 legacy=0x7f672c0a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672a59c700 1 -- 172.21.15.153:0/1509682845 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0bfa80 con 0x7f672c1539b0 2023-08-17T00:15:29.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672a59c700 1 --2- 172.21.15.153:0/1509682845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c1539b0 0x7f672c0632b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f671c006fd0 tx=0x7f671c006f40).ready entity=mon.1 client_cookie=2cd85a97acea406 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:29.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720001470 con 0x7f672c1539b0 2023-08-17T00:15:29.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671c005880 con 0x7f672c1539b0 2023-08-17T00:15:29.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672959a700 1 -- 172.21.15.153:0/1509682845 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671c005c00 con 0x7f672c1539b0 2023-08-17T00:15:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 -- 172.21.15.153:0/1509682845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c1539b0 msgr2=0x7f672c0632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 --2- 172.21.15.153:0/1509682845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c1539b0 0x7f672c0632b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f671c006fd0 tx=0x7f671c006f40).stop 2023-08-17T00:15:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 -- 172.21.15.153:0/1509682845 shutdown_connections 2023-08-17T00:15:29.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 --2- 172.21.15.153:0/1509682845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c1539b0 0x7f672c0632b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 -- 172.21.15.153:0/1509682845 >> 172.21.15.153:0/1509682845 conn(0x7f672c062a10 msgr2=0x7f672c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 -- 172.21.15.153:0/1509682845 shutdown_connections 2023-08-17T00:15:29.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.797+0000 7f672b59e700 1 -- 172.21.15.153:0/1509682845 wait complete. 2023-08-17T00:15:29.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 Processor -- start 2023-08-17T00:15:29.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 -- start start 2023-08-17T00:15:29.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c0a9eb0 0x7f672c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:29.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f672c1539b0 0x7f672c14a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:29.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 0x7f672c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:29.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0c1390 con 0x7f672c153d90 2023-08-17T00:15:29.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0c1fd0 con 0x7f672c0a9eb0 2023-08-17T00:15:29.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.801+0000 7f672b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0c16a0 con 0x7f672c1539b0 2023-08-17T00:15:29.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 0x7f672c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:29.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 0x7f672c0aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37858/0 (socket says 172.21.15.153:37858) 2023-08-17T00:15:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 -- 172.21.15.153:0/519097149 learned_addr learned my addr 172.21.15.153:0/519097149 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f6729d9b700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f672c1539b0 0x7f672c14a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672a59c700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c0a9eb0 0x7f672c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 -- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f672c1539b0 msgr2=0x7f672c14a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f672c1539b0 0x7f672c14a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 -- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c0a9eb0 msgr2=0x7f672c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:29.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c0a9eb0 0x7f672c150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:29.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 -- 172.21.15.153:0/519097149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671c009250 con 0x7f672c153d90 2023-08-17T00:15:29.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f6729d9b700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f672c1539b0 0x7f672c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:29.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672a59c700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c0a9eb0 0x7f672c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:29.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672ad9d700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 0x7f672c0aee20 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f672400c7f0 tx=0x7f6724007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:29.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672400a520 con 0x7f672c153d90 2023-08-17T00:15:29.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672400a680 con 0x7f672c153d90 2023-08-17T00:15:29.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672400aa20 con 0x7f672c153d90 2023-08-17T00:15:29.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c0c1980 con 0x7f672c153d90 2023-08-17T00:15:29.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c151090 con 0x7f672c153d90 2023-08-17T00:15:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.805+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c046dd0 con 0x7f672c153d90 2023-08-17T00:15:29.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.809+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6724010070 con 0x7f672c153d90 2023-08-17T00:15:29.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.809+0000 7f671a7fc700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670c05a150 0x7f670c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.809+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5769+0+0 (secure 0 0 0) 0x7f6724073e20 con 0x7f672c153d90 2023-08-17T00:15:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.809+0000 7f672a59c700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670c05a150 0x7f670c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:29.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.809+0000 7f672a59c700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670c05a150 0x7f670c05c610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f671c006fa0 tx=0x7f671c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:29.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.817+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6724047920 con 0x7f672c153d90 2023-08-17T00:15:29.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:29.989+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f672c0c2110 con 0x7f672c153d90 2023-08-17T00:15:30.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.613+0000 7f671a7fc700 1 -- 172.21.15.153:0/519097149 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v157) v1 ==== 169+0+0 (secure 0 0 0) 0x7f672404af40 con 0x7f672c153d90 2023-08-17T00:15:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670c05a150 msgr2=0x7f670c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670c05a150 0x7f670c05c610 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f671c006fa0 tx=0x7f671c015000).stop 2023-08-17T00:15:30.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 msgr2=0x7f672c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 0x7f672c0aee20 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 rx=0x7f672400c7f0 tx=0x7f6724007f50).stop 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 shutdown_connections 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670c05a150 0x7f670c05c610 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f672c153d90 0x7f672c0aee20 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f672c1539b0 0x7f672c14a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 --2- 172.21.15.153:0/519097149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f672c0a9eb0 0x7f672c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 >> 172.21.15.153:0/519097149 conn(0x7f672c062a10 msgr2=0x7f672c0c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 shutdown_connections 2023-08-17T00:15:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.621+0000 7f672b59e700 1 -- 172.21.15.153:0/519097149 wait complete. 2023-08-17T00:15:30.628 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:15:30.646 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:15:30.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.809+0000 7f223549b700 1 Processor -- start 2023-08-17T00:15:30.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.809+0000 7f223549b700 1 -- start start 2023-08-17T00:15:30.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f223549b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22300c7ba0 0x7f223015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f223549b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22300aa750 con 0x7f2230153e90 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f223549b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22301542f0 con 0x7f2230153ab0 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f223549b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22300c9dd0 con 0x7f22300c7ba0 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f222f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f22300c7ba0 0x7f223015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f222e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2230153e90 0x7f22300c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53136/0 (socket says 172.21.15.153:53136) 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f222e7fc700 1 -- 172.21.15.153:0/799688731 learned_addr learned my addr 172.21.15.153:0/799688731 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:30.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.813+0000 7f222effd700 1 --1- 172.21.15.153:0/799688731 >> v1:172.21.15.178:6789/0 conn(0x7f2230153ab0 0x7f22300c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42962/0 (socket says 172.21.15.153:42962) 2023-08-17T00:15:30.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222f7fe700 1 -- 172.21.15.153:0/799688731 >> v1:172.21.15.178:6789/0 conn(0x7f2230153ab0 legacy=0x7f22300c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222dffb700 1 -- 172.21.15.153:0/799688731 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169164398 0 0) 0x7f22300aa750 con 0x7f2230153e90 2023-08-17T00:15:30.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222f7fe700 1 -- 172.21.15.153:0/799688731 >> v1:172.21.15.153:6789/0 conn(0x7f2230153e90 legacy=0x7f22300c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222f7fe700 1 -- 172.21.15.153:0/799688731 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22300aacf0 con 0x7f22300c7ba0 2023-08-17T00:15:30.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222f7fe700 1 --2- 172.21.15.153:0/799688731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300c7ba0 0x7f223015e9a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f2228009e60 tx=0x7f2228009780).ready entity=mon.0 client_cookie=87f16fdfd80e9ca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:30.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222dffb700 1 -- 172.21.15.153:0/799688731 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800e070 con 0x7f22300c7ba0 2023-08-17T00:15:30.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222dffb700 1 -- 172.21.15.153:0/799688731 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222800bc30 con 0x7f22300c7ba0 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f222dffb700 1 -- 172.21.15.153:0/799688731 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228012410 con 0x7f22300c7ba0 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 -- 172.21.15.153:0/799688731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300c7ba0 msgr2=0x7f223015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 --2- 172.21.15.153:0/799688731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300c7ba0 0x7f223015e9a0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 rx=0x7f2228009e60 tx=0x7f2228009780).stop 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 -- 172.21.15.153:0/799688731 shutdown_connections 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 --2- 172.21.15.153:0/799688731 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f22300c7ba0 0x7f223015e9a0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 -- 172.21.15.153:0/799688731 >> 172.21.15.153:0/799688731 conn(0x7f2230061fa0 msgr2=0x7f22300623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 -- 172.21.15.153:0/799688731 shutdown_connections 2023-08-17T00:15:30.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.817+0000 7f223549b700 1 -- 172.21.15.153:0/799688731 wait complete. 2023-08-17T00:15:30.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 Processor -- start 2023-08-17T00:15:30.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 -- start start 2023-08-17T00:15:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300c7ba0 0x7f2230158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230153ab0 0x7f22301653b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 0x7f2230164180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:30.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300b08e0 con 0x7f2230153e90 2023-08-17T00:15:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300add80 con 0x7f2230153ab0 2023-08-17T00:15:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f223549b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22301591b0 con 0x7f22300c7ba0 2023-08-17T00:15:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f222f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 0x7f2230164180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f222f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 0x7f2230164180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37878/0 (socket says 172.21.15.153:37878) 2023-08-17T00:15:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f222f7fe700 1 -- 172.21.15.153:0/4099358215 learned_addr learned my addr 172.21.15.153:0/4099358215 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:30.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f222effd700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300c7ba0 0x7f2230158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:30.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.821+0000 7f222e7fc700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230153ab0 0x7f22301653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f222f7fe700 1 -- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300c7ba0 msgr2=0x7f2230158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f222f7fe700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300c7ba0 0x7f2230158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f222f7fe700 1 -- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230153ab0 msgr2=0x7f22301653b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f222f7fe700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230153ab0 0x7f22301653b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f222f7fe700 1 -- 172.21.15.153:0/4099358215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2228009a20 con 0x7f2230153e90 2023-08-17T00:15:30.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f222f7fe700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 0x7f2230164180 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f22300c1a50 tx=0x7f22300c9f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222801d630 con 0x7f2230153e90 2023-08-17T00:15:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222801d790 con 0x7f2230153e90 2023-08-17T00:15:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2230164aa0 con 0x7f2230153e90 2023-08-17T00:15:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222801db50 con 0x7f2230153e90 2023-08-17T00:15:30.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2230165060 con 0x7f2230153e90 2023-08-17T00:15:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300c4d40 con 0x7f2230153e90 2023-08-17T00:15:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.825+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2228026410 con 0x7f2230153e90 2023-08-17T00:15:30.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.829+0000 7f2216ffd700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f221c05a150 0x7f221c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.829+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f22280761b0 con 0x7f2230153e90 2023-08-17T00:15:30.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.829+0000 7f222effd700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f221c05a150 0x7f221c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:30.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.829+0000 7f222effd700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f221c05a150 0x7f221c05c610 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f2220007fd0 tx=0x7f2220007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:30.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:30.833+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2228049f00 con 0x7f2230153e90 2023-08-17T00:15:31.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.001+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f22300adef0 con 0x7f2230153e90 2023-08-17T00:15:31.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f2216ffd700 1 -- 172.21.15.153:0/4099358215 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f222804d520 con 0x7f2230153e90 2023-08-17T00:15:31.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f221c05a150 msgr2=0x7f221c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f221c05a150 0x7f221c05c610 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f2220007fd0 tx=0x7f2220007d30).stop 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 msgr2=0x7f2230164180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 0x7f2230164180 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 rx=0x7f22300c1a50 tx=0x7f22300c9f10).stop 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 shutdown_connections 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f221c05a150 0x7f221c05c610 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2230153e90 0x7f2230164180 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2230153ab0 0x7f22301653b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 --2- 172.21.15.153:0/4099358215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f22300c7ba0 0x7f2230158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 >> 172.21.15.153:0/4099358215 conn(0x7f2230061fa0 msgr2=0x7f22300ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 shutdown_connections 2023-08-17T00:15:31.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.009+0000 7f223549b700 1 -- 172.21.15.153:0/4099358215 wait complete. 2023-08-17T00:15:31.038 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2023-08-17T00:15:31.205 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe5a68f700 1 Processor -- start 2023-08-17T00:15:31.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe5a68f700 1 -- start start 2023-08-17T00:15:31.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe5a68f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe54151c40 0x7fbe541560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe5a68f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54065da0 con 0x7fbe54068da0 2023-08-17T00:15:31.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe5a68f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe54155c60 con 0x7fbe540689c0 2023-08-17T00:15:31.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe5a68f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54069200 con 0x7fbe54151c40 2023-08-17T00:15:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe58e8c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbe54068da0 0x7fbe54151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53148/0 (socket says 172.21.15.153:53148) 2023-08-17T00:15:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe58e8c700 1 -- 172.21.15.153:0/3190398191 learned_addr learned my addr 172.21.15.153:0/3190398191 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.201+0000 7fbe59e8e700 1 --2- 172.21.15.153:0/3190398191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe54151c40 0x7fbe541560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1537062492 0 0) 0x7fbe54065da0 con 0x7fbe54068da0 2023-08-17T00:15:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe400033f0 con 0x7fbe54068da0 2023-08-17T00:15:31.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398440302 0 0) 0x7fbe54155c60 con 0x7fbe540689c0 2023-08-17T00:15:31.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe54065da0 con 0x7fbe540689c0 2023-08-17T00:15:31.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274331475 0 0) 0x7fbe400033f0 con 0x7fbe54068da0 2023-08-17T00:15:31.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe59e8e700 1 -- 172.21.15.153:0/3190398191 >> v1:172.21.15.178:6789/0 conn(0x7fbe540689c0 legacy=0x7fbe540c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe59e8e700 1 -- 172.21.15.153:0/3190398191 >> v1:172.21.15.153:6789/0 conn(0x7fbe54068da0 legacy=0x7fbe54151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe59e8e700 1 -- 172.21.15.153:0/3190398191 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54065ff0 con 0x7fbe54151c40 2023-08-17T00:15:31.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe59e8e700 1 --2- 172.21.15.153:0/3190398191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe54151c40 0x7fbe541560f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fbe4c009e90 tx=0x7fbe4c009780).ready entity=mon.2 client_cookie=7bf002fe24eae071 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c00e070 con 0x7fbe54151c40 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c00b7a0 con 0x7fbe54151c40 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe4bfff700 1 -- 172.21.15.153:0/3190398191 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44001470 con 0x7fbe54151c40 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3190398191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe54151c40 msgr2=0x7fbe541560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3190398191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe54151c40 0x7fbe541560f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fbe4c009e90 tx=0x7fbe4c009780).stop 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3190398191 shutdown_connections 2023-08-17T00:15:31.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3190398191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe54151c40 0x7fbe541560f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3190398191 >> 172.21.15.153:0/3190398191 conn(0x7fbe540c6620 msgr2=0x7fbe540c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:31.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3190398191 shutdown_connections 2023-08-17T00:15:31.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.205+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3190398191 wait complete. 2023-08-17T00:15:31.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 Processor -- start 2023-08-17T00:15:31.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 -- start start 2023-08-17T00:15:31.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe540689c0 0x7fbe5414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 0x7fbe5414b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe54151c40 0x7fbe5414b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54147700 con 0x7fbe54068da0 2023-08-17T00:15:31.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5414bf40 con 0x7fbe54151c40 2023-08-17T00:15:31.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.209+0000 7fbe5a68f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe541479a0 con 0x7fbe540689c0 2023-08-17T00:15:31.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 0x7fbe5414b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 0x7fbe5414b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37880/0 (socket says 172.21.15.153:37880) 2023-08-17T00:15:31.219 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 -- 172.21.15.153:0/3810044431 learned_addr learned my addr 172.21.15.153:0/3810044431 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:31.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe5968d700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe540689c0 0x7fbe5414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe59e8e700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe54151c40 0x7fbe5414b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.220 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 -- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe540689c0 msgr2=0x7fbe5414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe540689c0 0x7fbe5414f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 -- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe54151c40 msgr2=0x7fbe5414b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe54151c40 0x7fbe5414b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.221 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 -- 172.21.15.153:0/3810044431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009a20 con 0x7fbe54068da0 2023-08-17T00:15:31.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe58e8c700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 0x7fbe5414b4a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fbe4400c800 tx=0x7fbe44001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:31.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44007170 con 0x7fbe54068da0 2023-08-17T00:15:31.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440072d0 con 0x7fbe54068da0 2023-08-17T00:15:31.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54147c80 con 0x7fbe54068da0 2023-08-17T00:15:31.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440048c0 con 0x7fbe54068da0 2023-08-17T00:15:31.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5414a3d0 con 0x7fbe54068da0 2023-08-17T00:15:31.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.213+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe54148180 con 0x7fbe54068da0 2023-08-17T00:15:31.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.217+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbe4401b070 con 0x7fbe54068da0 2023-08-17T00:15:31.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.217+0000 7fbe497fa700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbe3805a180 0x7fbe3805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.217+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fbe44073660 con 0x7fbe54068da0 2023-08-17T00:15:31.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.217+0000 7fbe5968d700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbe3805a180 0x7fbe3805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.217+0000 7fbe5968d700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbe3805a180 0x7fbe3805c640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fbe500038c0 tx=0x7fbe50007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:31.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.225+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbe44047300 con 0x7fbe54068da0 2023-08-17T00:15:31.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.441+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) v1 -- 0x7fbe54063750 con 0x7fbe54068da0 2023-08-17T00:15:31.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.629+0000 7fbe497fa700 1 -- 172.21.15.153:0/3810044431 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v591) v1 ==== 140+0+0 (secure 0 0 0) 0x7fbe44019030 con 0x7fbe54068da0 2023-08-17T00:15:31.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbe3805a180 msgr2=0x7fbe3805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbe3805a180 0x7fbe3805c640 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 rx=0x7fbe500038c0 tx=0x7fbe50007bc0).stop 2023-08-17T00:15:31.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 msgr2=0x7fbe5414b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 0x7fbe5414b4a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 rx=0x7fbe4400c800 tx=0x7fbe44001ab0).stop 2023-08-17T00:15:31.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 shutdown_connections 2023-08-17T00:15:31.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbe3805a180 0x7fbe3805c640 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe54151c40 0x7fbe5414b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbe54068da0 0x7fbe5414b4a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 --2- 172.21.15.153:0/3810044431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe540689c0 0x7fbe5414f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 >> 172.21.15.153:0/3810044431 conn(0x7fbe540c6620 msgr2=0x7fbe54150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:31.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 shutdown_connections 2023-08-17T00:15:31.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.633+0000 7fbe5a68f700 1 -- 172.21.15.153:0/3810044431 wait complete. 2023-08-17T00:15:31.661 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-08-17T00:15:31.662 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2023-08-17T00:15:31.662 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2023-08-17T00:15:31.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.817+0000 7fbc37a9b700 1 Processor -- start 2023-08-17T00:15:31.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.817+0000 7fbc37a9b700 1 -- start start 2023-08-17T00:15:31.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc37a9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc300a8b70 0x7fbc300632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc37a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc300bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc37a9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc30065240 con 0x7fbc300a8f50 2023-08-17T00:15:31.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc37a9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc30062e60 con 0x7fbc300a8b70 2023-08-17T00:15:31.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc37a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300638a0 con 0x7fbc300629b0 2023-08-17T00:15:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc36038700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc300bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc35036700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fbc300a8f50 0x7fbc300656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42988/0 (socket says 172.21.15.153:42988) 2023-08-17T00:15:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc35036700 1 -- 172.21.15.153:0/3911108121 learned_addr learned my addr 172.21.15.153:0/3911108121 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:31.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc35837700 1 --2- 172.21.15.153:0/3911108121 >> v2:172.21.15.178:3300/0 conn(0x7fbc300a8b70 0x7fbc300632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc34835700 1 -- 172.21.15.153:0/3911108121 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2379949535 0 0) 0x7fbc30065240 con 0x7fbc300a8f50 2023-08-17T00:15:31.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.821+0000 7fbc34835700 1 -- 172.21.15.153:0/3911108121 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc1c0033f0 con 0x7fbc300a8f50 2023-08-17T00:15:31.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc36038700 1 -- 172.21.15.153:0/3911108121 >> v2:172.21.15.178:3300/0 conn(0x7fbc300a8b70 msgr2=0x7fbc300632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:31.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc36038700 1 --2- 172.21.15.153:0/3911108121 >> v2:172.21.15.178:3300/0 conn(0x7fbc300a8b70 0x7fbc300632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc36038700 1 -- 172.21.15.153:0/3911108121 >> v1:172.21.15.178:6789/0 conn(0x7fbc300a8f50 legacy=0x7fbc300656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc36038700 1 -- 172.21.15.153:0/3911108121 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30065de0 con 0x7fbc300629b0 2023-08-17T00:15:31.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc35837700 1 --2- 172.21.15.153:0/3911108121 >> v2:172.21.15.178:3300/0 conn(0x7fbc300a8b70 0x7fbc300632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc36038700 1 --2- 172.21.15.153:0/3911108121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc300bbdc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fbc28009e60 tx=0x7fbc28009780).ready entity=mon.2 client_cookie=b32d195c5f066f38 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc34835700 1 -- 172.21.15.153:0/3911108121 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800e070 con 0x7fbc300629b0 2023-08-17T00:15:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc34835700 1 -- 172.21.15.153:0/3911108121 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800bab0 con 0x7fbc300629b0 2023-08-17T00:15:31.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc34835700 1 -- 172.21.15.153:0/3911108121 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800be30 con 0x7fbc300629b0 2023-08-17T00:15:31.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3911108121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 msgr2=0x7fbc300bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3911108121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc300bbdc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fbc28009e60 tx=0x7fbc28009780).stop 2023-08-17T00:15:31.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3911108121 shutdown_connections 2023-08-17T00:15:31.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3911108121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc300bbdc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3911108121 >> v2:172.21.15.178:3300/0 conn(0x7fbc300a8b70 0x7fbc300632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3911108121 >> 172.21.15.153:0/3911108121 conn(0x7fbc300c7150 msgr2=0x7fbc300c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:31.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3911108121 shutdown_connections 2023-08-17T00:15:31.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.825+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3911108121 wait complete. 2023-08-17T00:15:31.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 Processor -- start 2023-08-17T00:15:31.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 -- start start 2023-08-17T00:15:31.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc3014ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 0x7fbc3015a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300a8f50 0x7fbc3015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015abf0 con 0x7fbc300a8b70 2023-08-17T00:15:31.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300a9d90 con 0x7fbc300a8f50 2023-08-17T00:15:31.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.829+0000 7fbc37a9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300be580 con 0x7fbc300629b0 2023-08-17T00:15:31.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 0x7fbc3015a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 0x7fbc3015a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37892/0 (socket says 172.21.15.153:37892) 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 -- 172.21.15.153:0/3427722038 learned_addr learned my addr 172.21.15.153:0/3427722038 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35837700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc3014ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc36038700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300a8f50 0x7fbc3015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 -- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 msgr2=0x7fbc3014ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc3014ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 -- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300a8f50 msgr2=0x7fbc3015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:31.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300a8f50 0x7fbc3015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 -- 172.21.15.153:0/3427722038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0092a0 con 0x7fbc300a8b70 2023-08-17T00:15:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc35036700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 0x7fbc3015a210 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fbc2000c450 tx=0x7fbc20007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2000ce70 con 0x7fbc300a8b70 2023-08-17T00:15:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc200072e0 con 0x7fbc300a8b70 2023-08-17T00:15:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc28009a20 con 0x7fbc300a8b70 2023-08-17T00:15:31.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc200057a0 con 0x7fbc300a8b70 2023-08-17T00:15:31.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.833+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300bda00 con 0x7fbc300a8b70 2023-08-17T00:15:31.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.837+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300a9f20 con 0x7fbc300a8b70 2023-08-17T00:15:31.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.837+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbc2001a060 con 0x7fbc300a8b70 2023-08-17T00:15:31.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.837+0000 7fbc25ffb700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc1405a150 0x7fbc1405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:31.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.837+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fbc20073570 con 0x7fbc300a8b70 2023-08-17T00:15:31.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.841+0000 7fbc35837700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc1405a150 0x7fbc1405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:31.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.841+0000 7fbc35837700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc1405a150 0x7fbc1405c610 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fbc2c009dc0 tx=0x7fbc2c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:31.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:31.845+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbc20047210 con 0x7fbc300a8b70 2023-08-17T00:15:32.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.065+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) v1 -- 0x7fbc30064910 con 0x7fbc300a8b70 2023-08-17T00:15:32.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.633+0000 7fbc25ffb700 1 -- 172.21.15.153:0/3427722038 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v592) v1 ==== 136+0+0 (secure 0 0 0) 0x7fbc20018020 con 0x7fbc300a8b70 2023-08-17T00:15:32.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc1405a150 msgr2=0x7fbc1405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc1405a150 0x7fbc1405c610 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7fbc2c009dc0 tx=0x7fbc2c009060).stop 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 msgr2=0x7fbc3015a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 0x7fbc3015a210 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 rx=0x7fbc2000c450 tx=0x7fbc20007c50).stop 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 shutdown_connections 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbc1405a150 0x7fbc1405c610 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc300a8f50 0x7fbc3015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbc300a8b70 0x7fbc3015a210 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 --2- 172.21.15.153:0/3427722038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc300629b0 0x7fbc3014ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 >> 172.21.15.153:0/3427722038 conn(0x7fbc300c7150 msgr2=0x7fbc300656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 shutdown_connections 2023-08-17T00:15:32.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.637+0000 7fbc37a9b700 1 -- 172.21.15.153:0/3427722038 wait complete. 2023-08-17T00:15:32.667 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:15:32.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.829+0000 7fea5359e700 1 Processor -- start 2023-08-17T00:15:32.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.829+0000 7fea5359e700 1 -- start start 2023-08-17T00:15:32.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fea54068c80 0x7fea540a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:32.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea541585a0 con 0x7fea540a8df0 2023-08-17T00:15:32.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5359e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea54066400 con 0x7fea54068820 2023-08-17T00:15:32.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea540c1ba0 con 0x7fea54068c80 2023-08-17T00:15:32.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fea54068c80 0x7fea540a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:32.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fea54068c80 0x7fea540a9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37894/0 (socket says 172.21.15.153:37894) 2023-08-17T00:15:32.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 -- 172.21.15.153:0/244015089 learned_addr learned my addr 172.21.15.153:0/244015089 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:32.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5259c700 1 --1- 172.21.15.153:0/244015089 >> v1:172.21.15.153:6789/0 conn(0x7fea540a8df0 0x7fea540c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:53164/0 (socket says 172.21.15.153:53164) 2023-08-17T00:15:32.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 -- 172.21.15.153:0/244015089 >> v1:172.21.15.178:6789/0 conn(0x7fea54068820 legacy=0x7fea540a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 -- 172.21.15.153:0/244015089 >> v1:172.21.15.153:6789/0 conn(0x7fea540a8df0 legacy=0x7fea540c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 -- 172.21.15.153:0/244015089 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea540b9d30 con 0x7fea54068c80 2023-08-17T00:15:32.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea52d9d700 1 --2- 172.21.15.153:0/244015089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea540a9de0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fea4c006fd0 tx=0x7fea4c0090f0).ready entity=mon.0 client_cookie=bd6c220416acf24b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:32.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea51d9b700 1 -- 172.21.15.153:0/244015089 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00b600 con 0x7fea54068c80 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea51d9b700 1 -- 172.21.15.153:0/244015089 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c00b760 con 0x7fea54068c80 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea51d9b700 1 -- 172.21.15.153:0/244015089 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c00bae0 con 0x7fea54068c80 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5359e700 1 -- 172.21.15.153:0/244015089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 msgr2=0x7fea540a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.833+0000 7fea5359e700 1 --2- 172.21.15.153:0/244015089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea540a9de0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 rx=0x7fea4c006fd0 tx=0x7fea4c0090f0).stop 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.837+0000 7fea5359e700 1 -- 172.21.15.153:0/244015089 shutdown_connections 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.837+0000 7fea5359e700 1 --2- 172.21.15.153:0/244015089 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea540a9de0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.837+0000 7fea5359e700 1 -- 172.21.15.153:0/244015089 >> 172.21.15.153:0/244015089 conn(0x7fea540c6620 msgr2=0x7fea540c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:32.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.837+0000 7fea5359e700 1 -- 172.21.15.153:0/244015089 shutdown_connections 2023-08-17T00:15:32.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.837+0000 7fea5359e700 1 -- 172.21.15.153:0/244015089 wait complete. 2023-08-17T00:15:32.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.837+0000 7fea5359e700 1 Processor -- start 2023-08-17T00:15:32.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 -- start start 2023-08-17T00:15:32.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea54068820 0x7fea54144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:32.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea5416c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:32.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea540a8df0 0x7fea540aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:32.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea54144720 con 0x7fea54068c80 2023-08-17T00:15:32.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea540bc6d0 con 0x7fea54068820 2023-08-17T00:15:32.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea540bc9b0 con 0x7fea540a8df0 2023-08-17T00:15:32.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea5416c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:32.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea5416c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37898/0 (socket says 172.21.15.153:37898) 2023-08-17T00:15:32.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 -- 172.21.15.153:0/2456392318 learned_addr learned my addr 172.21.15.153:0/2456392318 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:32.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5259c700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea54068820 0x7fea54144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea52d9d700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea540a8df0 0x7fea540aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 -- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea540a8df0 msgr2=0x7fea540aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea540a8df0 0x7fea540aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 -- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea54068820 msgr2=0x7fea54144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea54068820 0x7fea54144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 -- 172.21.15.153:0/2456392318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c009370 con 0x7fea54068c80 2023-08-17T00:15:32.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea49d9b700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea5416c0a0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fea3c00c440 tx=0x7fea3c007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c007020 con 0x7fea54068c80 2023-08-17T00:15:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3c007180 con 0x7fea54068c80 2023-08-17T00:15:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea540bcc90 con 0x7fea54068c80 2023-08-17T00:15:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.841+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3c007520 con 0x7fea54068c80 2023-08-17T00:15:32.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.845+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea540bd250 con 0x7fea54068c80 2023-08-17T00:15:32.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.845+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea54144a00 con 0x7fea54068c80 2023-08-17T00:15:32.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.845+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fea3c010070 con 0x7fea54068c80 2023-08-17T00:15:32.853 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.849+0000 7fea4affd700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea3405a150 0x7fea3405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:32.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.849+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fea3c072ea0 con 0x7fea54068c80 2023-08-17T00:15:32.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.849+0000 7fea5259c700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea3405a150 0x7fea3405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:32.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.849+0000 7fea5259c700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea3405a150 0x7fea3405c610 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fea44002f70 tx=0x7fea44009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:32.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:32.853+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fea3c046c50 con 0x7fea54068c80 2023-08-17T00:15:33.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.021+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fea54064010 con 0x7fea54068c80 2023-08-17T00:15:33.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.029+0000 7fea4affd700 1 -- 172.21.15.153:0/2456392318 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fea3c04a270 con 0x7fea54068c80 2023-08-17T00:15:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.029+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea3405a150 msgr2=0x7fea3405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.029+0000 7fea5359e700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea3405a150 0x7fea3405c610 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7fea44002f70 tx=0x7fea44009040).stop 2023-08-17T00:15:33.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 msgr2=0x7fea5416c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea5416c0a0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 rx=0x7fea3c00c440 tx=0x7fea3c007e00).stop 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 shutdown_connections 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fea3405a150 0x7fea3405c610 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea540a8df0 0x7fea540aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fea54068c80 0x7fea5416c0a0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 --2- 172.21.15.153:0/2456392318 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea54068820 0x7fea54144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 >> 172.21.15.153:0/2456392318 conn(0x7fea540c6620 msgr2=0x7fea540694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 shutdown_connections 2023-08-17T00:15:33.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.033+0000 7fea5359e700 1 -- 172.21.15.153:0/2456392318 wait complete. 2023-08-17T00:15:33.056 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:15:33.057 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:15:33.099 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:15:33.142 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:15:33.142 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:15:33.143 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:33.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 Processor -- start 2023-08-17T00:15:33.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 -- start start 2023-08-17T00:15:33.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3580632e0 0x7fc3580a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc3580629b0 0x7fc3580bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc358065240 con 0x7fc3580a8b70 2023-08-17T00:15:33.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580638a0 con 0x7fc3580632e0 2023-08-17T00:15:33.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35fcdb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc358065de0 con 0x7fc3580629b0 2023-08-17T00:15:33.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.301+0000 7fc35d276700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3580632e0 0x7fc3580a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc3580632e0 0x7fc3580a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37906/0 (socket says 172.21.15.153:37906) 2023-08-17T00:15:33.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 -- 172.21.15.153:0/862972798 learned_addr learned my addr 172.21.15.153:0/862972798 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:33.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35e278700 1 --2- 172.21.15.153:0/862972798 >> v2:172.21.15.178:3300/0 conn(0x7fc3580629b0 0x7fc3580bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 -- 172.21.15.153:0/862972798 >> v2:172.21.15.178:3300/0 conn(0x7fc3580629b0 msgr2=0x7fc3580bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:33.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 --2- 172.21.15.153:0/862972798 >> v2:172.21.15.178:3300/0 conn(0x7fc3580629b0 0x7fc3580bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 -- 172.21.15.153:0/862972798 >> v1:172.21.15.178:6789/0 conn(0x7fc3580a8b70 legacy=0x7fc3580656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 -- 172.21.15.153:0/862972798 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc358062e20 con 0x7fc3580632e0 2023-08-17T00:15:33.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35d276700 1 --2- 172.21.15.153:0/862972798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580632e0 0x7fc3580a8f50 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fc358069b10 tx=0x7fc3480090f0).ready entity=mon.0 client_cookie=6aab9ac0a5ccf2ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:33.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35ca75700 1 -- 172.21.15.153:0/862972798 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34800b520 con 0x7fc3580632e0 2023-08-17T00:15:33.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35ca75700 1 -- 172.21.15.153:0/862972798 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34800b680 con 0x7fc3580632e0 2023-08-17T00:15:33.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35ca75700 1 -- 172.21.15.153:0/862972798 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34800ba00 con 0x7fc3580632e0 2023-08-17T00:15:33.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 -- 172.21.15.153:0/862972798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580632e0 msgr2=0x7fc3580a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/862972798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580632e0 0x7fc3580a8f50 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 rx=0x7fc358069b10 tx=0x7fc3480090f0).stop 2023-08-17T00:15:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 -- 172.21.15.153:0/862972798 shutdown_connections 2023-08-17T00:15:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/862972798 >> v2:172.21.15.178:3300/0 conn(0x7fc3580629b0 0x7fc3580bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/862972798 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580632e0 0x7fc3580a8f50 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 -- 172.21.15.153:0/862972798 >> 172.21.15.153:0/862972798 conn(0x7fc3580c7150 msgr2=0x7fc3580c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 -- 172.21.15.153:0/862972798 shutdown_connections 2023-08-17T00:15:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.305+0000 7fc35fcdb700 1 -- 172.21.15.153:0/862972798 wait complete. 2023-08-17T00:15:33.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.309+0000 7fc35fcdb700 1 Processor -- start 2023-08-17T00:15:33.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.309+0000 7fc35fcdb700 1 -- start start 2023-08-17T00:15:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 0x7fc35815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3580632e0 0x7fc3580ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3580a8b70 0x7fc3581592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580bd720 con 0x7fc3580629b0 2023-08-17T00:15:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580bda00 con 0x7fc3580632e0 2023-08-17T00:15:33.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580bdce0 con 0x7fc3580a8b70 2023-08-17T00:15:33.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 0x7fc35815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 0x7fc35815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37922/0 (socket says 172.21.15.153:37922) 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 -- 172.21.15.153:0/1217899583 learned_addr learned my addr 172.21.15.153:0/1217899583 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35d276700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3580632e0 0x7fc3580ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35e278700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3580a8b70 0x7fc3581592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 -- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3580a8b70 msgr2=0x7fc3581592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3580a8b70 0x7fc3581592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 -- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3580632e0 msgr2=0x7fc3580ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3580632e0 0x7fc3580ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 -- 172.21.15.153:0/1217899583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348009370 con 0x7fc3580629b0 2023-08-17T00:15:33.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35da77700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 0x7fc35815ad40 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fc35400c440 tx=0x7fc354007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:33.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354007020 con 0x7fc3580629b0 2023-08-17T00:15:33.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc354007180 con 0x7fc3580629b0 2023-08-17T00:15:33.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc354007520 con 0x7fc3580629b0 2023-08-17T00:15:33.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3580bdfc0 con 0x7fc3580629b0 2023-08-17T00:15:33.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.313+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3580ac5d0 con 0x7fc3580629b0 2023-08-17T00:15:33.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.317+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35806b530 con 0x7fc3580629b0 2023-08-17T00:15:33.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.317+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc354010070 con 0x7fc3580629b0 2023-08-17T00:15:33.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.317+0000 7fc34dffb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc33c05a150 0x7fc33c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.317+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc354072ff0 con 0x7fc3580629b0 2023-08-17T00:15:33.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.317+0000 7fc35d276700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc33c05a150 0x7fc33c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.321+0000 7fc35d276700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc33c05a150 0x7fc33c05c610 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fc348009130 tx=0x7fc348017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:33.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.321+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3540a18f0 con 0x7fc3580629b0 2023-08-17T00:15:33.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.517+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc358064910 con 0x7fc3580629b0 2023-08-17T00:15:33.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.517+0000 7fc34dffb700 1 -- 172.21.15.153:0/1217899583 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 124 v124) v1 ==== 95+0+3546 (secure 0 0 0) 0x7fc354046cf0 con 0x7fc3580629b0 2023-08-17T00:15:33.524 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:33.525 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":124,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3905976969","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3905976969},{"type":"v1","addr":"172.21.15.178:6836","nonce":3905976969}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8572,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3848021628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3848021628},{"type":"v1","addr":"172.21.15.178:6837","nonce":3848021628}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":8979,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3969915364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3969915364},{"type":"v1","addr":"172.21.15.153:6834","nonce":3969915364}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117},{"gid":9321,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/2955821805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":2955821805},{"type":"v1","addr":"172.21.15.153:6835","nonce":2955821805}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[]} 2023-08-17T00:15:33.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc33c05a150 msgr2=0x7fc33c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc33c05a150 0x7fc33c05c610 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fc348009130 tx=0x7fc348017000).stop 2023-08-17T00:15:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 msgr2=0x7fc35815ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 0x7fc35815ad40 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 rx=0x7fc35400c440 tx=0x7fc354007e00).stop 2023-08-17T00:15:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 shutdown_connections 2023-08-17T00:15:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc33c05a150 0x7fc33c05c610 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc3580a8b70 0x7fc3581592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc3580632e0 0x7fc3580ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 --2- 172.21.15.153:0/1217899583 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc3580629b0 0x7fc35815ad40 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 >> 172.21.15.153:0/1217899583 conn(0x7fc3580c7150 msgr2=0x7fc3580bbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 shutdown_connections 2023-08-17T00:15:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.521+0000 7fc35fcdb700 1 -- 172.21.15.153:0/1217899583 wait complete. 2023-08-17T00:15:33.531 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 124 2023-08-17T00:15:33.548 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:15:33.549 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:15:33.549 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:15:33.549 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:15:33.550 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:15:33.550 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:15:33.550 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:15:33.550 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:15:33.551 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:15:33.551 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:15:33.551 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:15:33.551 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:15:33.552 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:15:33.552 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:15:33.552 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:15:33.552 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:15:33.566 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:15:33.567 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:15:33.569 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:15:33.570 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:15:33.575 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:15:33.575 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:15:33.578 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:15:33.578 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:15:33.622 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:15:33.622 DEBUG:teuthology.parallel:result is None 2023-08-17T00:15:33.626 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:15:33.626 DEBUG:teuthology.parallel:result is None 2023-08-17T00:15:33.629 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:15:33.630 DEBUG:teuthology.parallel:result is None 2023-08-17T00:15:33.636 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:15:33.637 DEBUG:teuthology.parallel:result is None 2023-08-17T00:15:33.637 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:15:33.725 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:15:33.726 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:15:33.742 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:15:33.743 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:15:33.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.773+0000 7fb4eda1b700 1 Processor -- start 2023-08-17T00:15:33.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.773+0000 7fb4eda1b700 1 -- start start 2023-08-17T00:15:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4eda1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4e8153920 0x7fb4e80bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4eda1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e80658d0 0x7fb4e8065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4eda1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e8066210 con 0x7fb4e80674f0 2023-08-17T00:15:33.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4eda1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e8157630 con 0x7fb4e8153920 2023-08-17T00:15:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4eda1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80a67a0 con 0x7fb4e80658d0 2023-08-17T00:15:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4e8153920 0x7fb4e80bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e77fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e80658d0 0x7fb4e8065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb4e8153920 0x7fb4e80bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37970/0 (socket says 172.21.15.153:37970) 2023-08-17T00:15:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/2899858895 learned_addr learned my addr 172.21.15.153:0/2899858895 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4dffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb4e80674f0 0x7fb4e8157da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:43034/0 (socket says 172.21.15.153:43034) 2023-08-17T00:15:33.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/2899858895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e80658d0 msgr2=0x7fb4e8065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 --2- 172.21.15.153:0/2899858895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e80658d0 0x7fb4e8065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e67fc700 1 -- 172.21.15.153:0/2899858895 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254295381 0 0) 0x7fb4d0001110 con 0x7fb4e80674f0 2023-08-17T00:15:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/2899858895 >> v1:172.21.15.178:6789/0 conn(0x7fb4e80674f0 legacy=0x7fb4e8157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/2899858895 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e80a6a60 con 0x7fb4e8153920 2023-08-17T00:15:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e77fe700 1 --2- 172.21.15.153:0/2899858895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e80658d0 0x7fb4e8065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:33.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.777+0000 7fb4e6ffd700 1 --2- 172.21.15.153:0/2899858895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e8153920 0x7fb4e80bc580 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fb4d8006fd0 tx=0x7fb4d80090f0).ready entity=mon.0 client_cookie=dc86283965607fd0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4e67fc700 1 -- 172.21.15.153:0/2899858895 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800b580 con 0x7fb4e8153920 2023-08-17T00:15:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4e67fc700 1 -- 172.21.15.153:0/2899858895 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d800b6e0 con 0x7fb4e8153920 2023-08-17T00:15:33.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4e67fc700 1 -- 172.21.15.153:0/2899858895 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800ba80 con 0x7fb4e8153920 2023-08-17T00:15:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 -- 172.21.15.153:0/2899858895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e8153920 msgr2=0x7fb4e80bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/2899858895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e8153920 0x7fb4e80bc580 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 rx=0x7fb4d8006fd0 tx=0x7fb4d80090f0).stop 2023-08-17T00:15:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 -- 172.21.15.153:0/2899858895 shutdown_connections 2023-08-17T00:15:33.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/2899858895 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e80658d0 0x7fb4e8065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/2899858895 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e8153920 0x7fb4e80bc580 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 -- 172.21.15.153:0/2899858895 >> 172.21.15.153:0/2899858895 conn(0x7fb4e80c80a0 msgr2=0x7fb4e80c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 -- 172.21.15.153:0/2899858895 shutdown_connections 2023-08-17T00:15:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.781+0000 7fb4eda1b700 1 -- 172.21.15.153:0/2899858895 wait complete. 2023-08-17T00:15:33.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 Processor -- start 2023-08-17T00:15:33.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 -- start start 2023-08-17T00:15:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 0x7fb4e814f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4e80674f0 0x7fb4e80bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e8153920 0x7fb4e8163f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8164f60 con 0x7fb4e80658d0 2023-08-17T00:15:33.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80bec50 con 0x7fb4e80674f0 2023-08-17T00:15:33.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e81649a0 con 0x7fb4e8153920 2023-08-17T00:15:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 0x7fb4e814f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 0x7fb4e814f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37980/0 (socket says 172.21.15.153:37980) 2023-08-17T00:15:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/831872407 learned_addr learned my addr 172.21.15.153:0/831872407 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:33.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e77fe700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e8153920 0x7fb4e8163f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4dffff700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4e80674f0 0x7fb4e80bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e8153920 msgr2=0x7fb4e8163f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e8153920 0x7fb4e8163f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4e80674f0 msgr2=0x7fb4e80bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4e80674f0 0x7fb4e80bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 -- 172.21.15.153:0/831872407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009a20 con 0x7fb4e80658d0 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e77fe700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e8153920 0x7fb4e8163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:33.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4dffff700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4e80674f0 0x7fb4e80bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:33.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4e6ffd700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 0x7fb4e814f630 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fb4e8063010 tx=0x7fb4d8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:33.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800be40 con 0x7fb4e80658d0 2023-08-17T00:15:33.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d800b850 con 0x7fb4e80658d0 2023-08-17T00:15:33.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d8009370 con 0x7fb4e80658d0 2023-08-17T00:15:33.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d801c420 con 0x7fb4e80658d0 2023-08-17T00:15:33.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.785+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80be8e0 con 0x7fb4e80658d0 2023-08-17T00:15:33.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.789+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e806b4c0 con 0x7fb4e80658d0 2023-08-17T00:15:33.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.789+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb4d802c070 con 0x7fb4e80658d0 2023-08-17T00:15:33.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.793+0000 7fb4deffd700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c805a180 0x7fb4c805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:33.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.793+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fb4d80758e0 con 0x7fb4e80658d0 2023-08-17T00:15:33.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.793+0000 7fb4dffff700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c805a180 0x7fb4c805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:33.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.793+0000 7fb4dffff700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c805a180 0x7fb4c805c640 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb4e8157030 tx=0x7fb4d0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:33.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.797+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb4d8049580 con 0x7fb4e80658d0 2023-08-17T00:15:33.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:33.973+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb4e8095450 con 0x7fb4e80658d0 2023-08-17T00:15:34.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.773+0000 7fb4deffd700 1 -- 172.21.15.153:0/831872407 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v162) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb4d8020070 con 0x7fb4e80658d0 2023-08-17T00:15:34.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c805a180 msgr2=0x7fb4c805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:34.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c805a180 0x7fb4c805c640 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7fb4e8157030 tx=0x7fb4d0009040).stop 2023-08-17T00:15:34.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 msgr2=0x7fb4e814f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:34.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 0x7fb4e814f630 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 rx=0x7fb4e8063010 tx=0x7fb4d8017000).stop 2023-08-17T00:15:34.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 shutdown_connections 2023-08-17T00:15:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb4c805a180 0x7fb4c805c640 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4e8153920 0x7fb4e8163f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4e80674f0 0x7fb4e80bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 --2- 172.21.15.153:0/831872407 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb4e80658d0 0x7fb4e814f630 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 >> 172.21.15.153:0/831872407 conn(0x7fb4e80c80a0 msgr2=0x7fb4e8064400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:34.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 shutdown_connections 2023-08-17T00:15:34.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.777+0000 7fb4eda1b700 1 -- 172.21.15.153:0/831872407 wait complete. 2023-08-17T00:15:34.785 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:15:34.807 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:15:34.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.965+0000 7f507c9b9700 1 Processor -- start 2023-08-17T00:15:34.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f507c9b9700 1 -- start start 2023-08-17T00:15:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f507c9b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50780689c0 0x7f5078068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:34.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f507c9b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f50781560f0 0x7f50780c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f507c9b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5078065da0 con 0x7f5078151530 2023-08-17T00:15:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f507c9b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5078155c60 con 0x7f50780689c0 2023-08-17T00:15:34.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f507c9b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5078156550 con 0x7f50781560f0 2023-08-17T00:15:34.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50780689c0 0x7f5078068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:34.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f50780689c0 0x7f5078068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38066/0 (socket says 172.21.15.153:38066) 2023-08-17T00:15:34.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 -- 172.21.15.153:0/2968950822 learned_addr learned my addr 172.21.15.153:0/2968950822 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f506ffff700 1 --2- 172.21.15.153:0/2968950822 >> v2:172.21.15.178:3300/0 conn(0x7f50781560f0 0x7f50780c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 -- 172.21.15.153:0/2968950822 >> v2:172.21.15.178:3300/0 conn(0x7f50781560f0 msgr2=0x7f50780c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 --2- 172.21.15.153:0/2968950822 >> v2:172.21.15.178:3300/0 conn(0x7f50781560f0 0x7f50780c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 -- 172.21.15.153:0/2968950822 >> v1:172.21.15.178:6789/0 conn(0x7f5078151530 legacy=0x7f50781519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 -- 172.21.15.153:0/2968950822 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078065ff0 con 0x7f50780689c0 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f506ffff700 1 --2- 172.21.15.153:0/2968950822 >> v2:172.21.15.178:3300/0 conn(0x7f50781560f0 0x7f50780c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:34.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f50777fe700 1 --2- 172.21.15.153:0/2968950822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f5078068da0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f50780bff90 tx=0x7f5068009060).ready entity=mon.0 client_cookie=77d0ae33eb78ba2d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f5076ffd700 1 -- 172.21.15.153:0/2968950822 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005880 con 0x7f50780689c0 2023-08-17T00:15:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f5076ffd700 1 -- 172.21.15.153:0/2968950822 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680059e0 con 0x7f50780689c0 2023-08-17T00:15:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.969+0000 7f5076ffd700 1 -- 172.21.15.153:0/2968950822 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005d60 con 0x7f50780689c0 2023-08-17T00:15:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 -- 172.21.15.153:0/2968950822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 msgr2=0x7f5078068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 --2- 172.21.15.153:0/2968950822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f5078068da0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 rx=0x7f50780bff90 tx=0x7f5068009060).stop 2023-08-17T00:15:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 -- 172.21.15.153:0/2968950822 shutdown_connections 2023-08-17T00:15:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 --2- 172.21.15.153:0/2968950822 >> v2:172.21.15.178:3300/0 conn(0x7f50781560f0 0x7f50780c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 --2- 172.21.15.153:0/2968950822 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f5078068da0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 -- 172.21.15.153:0/2968950822 >> 172.21.15.153:0/2968950822 conn(0x7f50780c6620 msgr2=0x7f50780c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:34.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 -- 172.21.15.153:0/2968950822 shutdown_connections 2023-08-17T00:15:34.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.973+0000 7f507c9b9700 1 -- 172.21.15.153:0/2968950822 wait complete. 2023-08-17T00:15:34.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 Processor -- start 2023-08-17T00:15:34.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 -- start start 2023-08-17T00:15:34.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f507814ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:34.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5078151530 0x7f5078153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:34.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50781560f0 0x7f5078153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:34.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780b54c0 con 0x7f50780689c0 2023-08-17T00:15:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780c0a00 con 0x7f5078151530 2023-08-17T00:15:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f507c9b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5078154640 con 0x7f50781560f0 2023-08-17T00:15:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f507814ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f507814ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38068/0 (socket says 172.21.15.153:38068) 2023-08-17T00:15:34.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 -- 172.21.15.153:0/543153462 learned_addr learned my addr 172.21.15.153:0/543153462 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f506ffff700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5078151530 0x7f5078153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f5077fff700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50781560f0 0x7f5078153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 -- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50781560f0 msgr2=0x7f5078153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50781560f0 0x7f5078153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 -- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5078151530 msgr2=0x7f5078153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:34.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5078151530 0x7f5078153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:34.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 -- 172.21.15.153:0/543153462 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068009300 con 0x7f50780689c0 2023-08-17T00:15:34.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f5077fff700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50781560f0 0x7f5078153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:34.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.977+0000 7f50777fe700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f507814ff40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f50780667d0 tx=0x7f5068016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:34.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068005880 con 0x7f50780689c0 2023-08-17T00:15:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068006850 con 0x7f50780689c0 2023-08-17T00:15:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50780c0ca0 con 0x7f50780689c0 2023-08-17T00:15:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800b9c0 con 0x7f50780689c0 2023-08-17T00:15:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50780c1260 con 0x7f50780689c0 2023-08-17T00:15:34.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507806b4c0 con 0x7f50780689c0 2023-08-17T00:15:34.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.981+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5068022030 con 0x7f50780689c0 2023-08-17T00:15:34.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.985+0000 7f506f7fe700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f505805a150 0x7f505805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.985+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5068074720 con 0x7f50780689c0 2023-08-17T00:15:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.985+0000 7f506ffff700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f505805a150 0x7f505805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.985+0000 7f506ffff700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f505805a150 0x7f505805c610 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f5078150b50 tx=0x7f5060008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:34.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:34.989+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5068048520 con 0x7f50780689c0 2023-08-17T00:15:35.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.201+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5078063750 con 0x7f50780689c0 2023-08-17T00:15:35.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f506f7fe700 1 -- 172.21.15.153:0/543153462 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5068020070 con 0x7f50780689c0 2023-08-17T00:15:35.209 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:35.209 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.210 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:15:35.211 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:15:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.212 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:15:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:15:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.213 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.214 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:15:35.215 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:15:35.216 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.217 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.218 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.219 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.220 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.220 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.220 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:15:35.220 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:15:35.220 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.220 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:15:35.221 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:15:35.222 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.222 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.222 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.222 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.222 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.223 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.223 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.223 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:15:35.223 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:15:35.224 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.224 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.224 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.224 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.224 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.224 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.225 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:15:35.226 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.227 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:15:35.228 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.229 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:15:35.230 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:15:35.231 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:15:35.232 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.233 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:15:35.233 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:15:35.233 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:15:35.233 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:15:35.234 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:15:35.235 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:15:35.236 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:15:35.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f505805a150 msgr2=0x7f505805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f505805a150 0x7f505805c610 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7f5078150b50 tx=0x7f5060008040).stop 2023-08-17T00:15:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 msgr2=0x7f507814ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f507814ff40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 rx=0x7f50780667d0 tx=0x7f5068016000).stop 2023-08-17T00:15:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 shutdown_connections 2023-08-17T00:15:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f505805a150 0x7f505805c610 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50781560f0 0x7f5078153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5078151530 0x7f5078153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 --2- 172.21.15.153:0/543153462 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f50780689c0 0x7f507814ff40 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 >> 172.21.15.153:0/543153462 conn(0x7f50780c6620 msgr2=0x7f5078154bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:35.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 shutdown_connections 2023-08-17T00:15:35.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.205+0000 7f507c9b9700 1 -- 172.21.15.153:0/543153462 wait complete. 2023-08-17T00:15:35.240 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.393+0000 7f961d85b700 1 Processor -- start 2023-08-17T00:15:35.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.393+0000 7f961d85b700 1 -- start start 2023-08-17T00:15:35.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f961d85b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9618151350 0x7f96180cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f961d85b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9618151730 0x7f9618157510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f961d85b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618157a00 0x7f9618153f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f961d85b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9618157eb0 con 0x7f9618151350 2023-08-17T00:15:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f961d85b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96181582e0 con 0x7f9618151730 2023-08-17T00:15:35.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f961d85b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9618063f40 con 0x7f9618157a00 2023-08-17T00:15:35.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9618151350 0x7f96180cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9618151350 0x7f96180cb9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38074/0 (socket says 172.21.15.153:38074) 2023-08-17T00:15:35.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 -- 172.21.15.153:0/1778312930 learned_addr learned my addr 172.21.15.153:0/1778312930 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9617fff700 1 --2- 172.21.15.153:0/1778312930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618157a00 0x7f9618153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f96167fc700 1 --2- 172.21.15.153:0/1778312930 >> v2:172.21.15.178:3300/0 conn(0x7f9618151730 0x7f9618157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 -- 172.21.15.153:0/1778312930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618157a00 msgr2=0x7f9618153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 --2- 172.21.15.153:0/1778312930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618157a00 0x7f9618153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 -- 172.21.15.153:0/1778312930 >> v2:172.21.15.178:3300/0 conn(0x7f9618151730 msgr2=0x7f9618157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:35.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 --2- 172.21.15.153:0/1778312930 >> v2:172.21.15.178:3300/0 conn(0x7f9618151730 0x7f9618157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.397+0000 7f9616ffd700 1 -- 172.21.15.153:0/1778312930 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9618064220 con 0x7f9618151350 2023-08-17T00:15:35.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f9616ffd700 1 --2- 172.21.15.153:0/1778312930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f96180cb9b0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f96180b22c0 tx=0x7f96080090f0).ready entity=mon.0 client_cookie=d15f9949f11694a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f9615ffb700 1 -- 172.21.15.153:0/1778312930 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800b520 con 0x7f9618151350 2023-08-17T00:15:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f9615ffb700 1 -- 172.21.15.153:0/1778312930 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800b680 con 0x7f9618151350 2023-08-17T00:15:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f9615ffb700 1 -- 172.21.15.153:0/1778312930 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800ba20 con 0x7f9618151350 2023-08-17T00:15:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 -- 172.21.15.153:0/1778312930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 msgr2=0x7f96180cb9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 --2- 172.21.15.153:0/1778312930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f96180cb9b0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 rx=0x7f96180b22c0 tx=0x7f96080090f0).stop 2023-08-17T00:15:35.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 -- 172.21.15.153:0/1778312930 shutdown_connections 2023-08-17T00:15:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 --2- 172.21.15.153:0/1778312930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618157a00 0x7f9618153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 --2- 172.21.15.153:0/1778312930 >> v2:172.21.15.178:3300/0 conn(0x7f9618151730 0x7f9618157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 --2- 172.21.15.153:0/1778312930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f96180cb9b0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 -- 172.21.15.153:0/1778312930 >> 172.21.15.153:0/1778312930 conn(0x7f96180c9650 msgr2=0x7f9618065f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 -- 172.21.15.153:0/1778312930 shutdown_connections 2023-08-17T00:15:35.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 -- 172.21.15.153:0/1778312930 wait complete. 2023-08-17T00:15:35.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 Processor -- start 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.401+0000 7f961d85b700 1 -- start start 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f9618149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618151730 0x7f96181553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9618157a00 0x7f96181558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9618155da0 con 0x7f9618151350 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c7000 con 0x7f9618157a00 2023-08-17T00:15:35.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96180c5ee0 con 0x7f9618151730 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f9618149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f9618149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38088/0 (socket says 172.21.15.153:38088) 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 -- 172.21.15.153:0/219394956 learned_addr learned my addr 172.21.15.153:0/219394956 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 -- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618151730 msgr2=0x7f96181553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618151730 0x7f96181553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 -- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9618157a00 msgr2=0x7f96181558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9618157a00 0x7f96181558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:35.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 -- 172.21.15.153:0/219394956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009370 con 0x7f9618151350 2023-08-17T00:15:35.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f9616ffd700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f9618149230 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f9618065870 tx=0x7f9608017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800beb0 con 0x7f9618151350 2023-08-17T00:15:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f960800b7f0 con 0x7f9618151350 2023-08-17T00:15:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96180c66d0 con 0x7f9618151350 2023-08-17T00:15:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960801c420 con 0x7f9618151350 2023-08-17T00:15:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.405+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96180c6c90 con 0x7f9618151350 2023-08-17T00:15:35.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.409+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961806b530 con 0x7f9618151350 2023-08-17T00:15:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.409+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f960802c070 con 0x7f9618151350 2023-08-17T00:15:35.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.409+0000 7f95feffd700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960405a150 0x7f960405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.409+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f96080758f0 con 0x7f9618151350 2023-08-17T00:15:35.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.409+0000 7f96167fc700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960405a150 0x7f960405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.413+0000 7f96167fc700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960405a150 0x7f960405c610 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f96180ae200 tx=0x7f960c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:35.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.417+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f96080496f0 con 0x7f9618151350 2023-08-17T00:15:35.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.577+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9618064500 con 0x7f9618151350 2023-08-17T00:15:35.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.577+0000 7f95feffd700 1 -- 172.21.15.153:0/219394956 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f9608020020 con 0x7f9618151350 2023-08-17T00:15:35.584 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:35.584 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":162,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:34.764331+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:35.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960405a150 msgr2=0x7f960405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960405a150 0x7f960405c610 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7f96180ae200 tx=0x7f960c008040).stop 2023-08-17T00:15:35.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 msgr2=0x7f9618149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f9618149230 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 rx=0x7f9618065870 tx=0x7f9608017000).stop 2023-08-17T00:15:35.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 shutdown_connections 2023-08-17T00:15:35.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f960405a150 0x7f960405c610 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9618157a00 0x7f96181558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:35.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9618151730 0x7f96181553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:35.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 --2- 172.21.15.153:0/219394956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9618151350 0x7f9618149230 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 >> 172.21.15.153:0/219394956 conn(0x7f96180c9650 msgr2=0x7f96181568e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:35.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 shutdown_connections 2023-08-17T00:15:35.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.581+0000 7f961d85b700 1 -- 172.21.15.153:0/219394956 wait complete. 2023-08-17T00:15:35.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:15:35.608 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:15:35.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.765+0000 7fe26b107700 1 Processor -- start 2023-08-17T00:15:35.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.765+0000 7fe26b107700 1 -- start start 2023-08-17T00:15:35.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26b107700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2640be1e0 0x7fe2640c30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26b107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640c35e0 0x7fe2640bc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26b107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2640a6cd0 con 0x7fe2640bde00 2023-08-17T00:15:35.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26b107700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe264150e90 con 0x7fe2640be1e0 2023-08-17T00:15:35.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26b107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264067040 con 0x7fe2640c35e0 2023-08-17T00:15:35.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2640be1e0 0x7fe2640c30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2640be1e0 0x7fe2640c30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:51982/0 (socket says 172.21.15.153:51982) 2023-08-17T00:15:35.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 -- 172.21.15.153:0/1766905253 learned_addr learned my addr 172.21.15.153:0/1766905253 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:35.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26a906700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640c35e0 0x7fe2640bc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 -- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640c35e0 msgr2=0x7fe2640bc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640c35e0 0x7fe2640bc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 -- 172.21.15.153:0/1766905253 >> v1:172.21.15.178:6789/0 conn(0x7fe2640bde00 legacy=0x7fe264063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 -- 172.21.15.153:0/1766905253 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264067320 con 0x7fe2640be1e0 2023-08-17T00:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe26a906700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640c35e0 0x7fe2640bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:35.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.769+0000 7fe269904700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640be1e0 0x7fe2640c30f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fe254006fd0 tx=0x7fe2540090f0).ready entity=mon.1 client_cookie=27e092ab71fa9fe server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe269103700 1 -- 172.21.15.153:0/1766905253 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400b600 con 0x7fe2640be1e0 2023-08-17T00:15:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe269103700 1 -- 172.21.15.153:0/1766905253 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25400b760 con 0x7fe2640be1e0 2023-08-17T00:15:35.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe269103700 1 -- 172.21.15.153:0/1766905253 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25400bae0 con 0x7fe2640be1e0 2023-08-17T00:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 -- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640be1e0 msgr2=0x7fe2640c30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640be1e0 0x7fe2640c30f0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7fe254006fd0 tx=0x7fe2540090f0).stop 2023-08-17T00:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 -- 172.21.15.153:0/1766905253 shutdown_connections 2023-08-17T00:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640c35e0 0x7fe2640bc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 --2- 172.21.15.153:0/1766905253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640be1e0 0x7fe2640c30f0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 -- 172.21.15.153:0/1766905253 >> 172.21.15.153:0/1766905253 conn(0x7fe264069760 msgr2=0x7fe264069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 -- 172.21.15.153:0/1766905253 shutdown_connections 2023-08-17T00:15:35.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.773+0000 7fe26b107700 1 -- 172.21.15.153:0/1766905253 wait complete. 2023-08-17T00:15:35.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 Processor -- start 2023-08-17T00:15:35.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 -- start start 2023-08-17T00:15:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640bde00 0x7fe2640aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640be1e0 0x7fe2640bf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 0x7fe26414f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640c0450 con 0x7fe2640c35e0 2023-08-17T00:15:35.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264151040 con 0x7fe2640bde00 2023-08-17T00:15:35.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26b107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2640bf550 con 0x7fe2640be1e0 2023-08-17T00:15:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26a906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 0x7fe26414f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26a906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 0x7fe26414f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38100/0 (socket says 172.21.15.153:38100) 2023-08-17T00:15:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26a906700 1 -- 172.21.15.153:0/864764166 learned_addr learned my addr 172.21.15.153:0/864764166 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:35.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe26a105700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640bde00 0x7fe2640aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.777+0000 7fe269904700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640be1e0 0x7fe2640bf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26a906700 1 -- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640be1e0 msgr2=0x7fe2640bf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26a906700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640be1e0 0x7fe2640bf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26a906700 1 -- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640bde00 msgr2=0x7fe2640aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26a906700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640bde00 0x7fe2640aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26a906700 1 -- 172.21.15.153:0/864764166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe254009370 con 0x7fe2640c35e0 2023-08-17T00:15:35.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe269904700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640be1e0 0x7fe2640bf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26a906700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 0x7fe26414f1b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fe25c009fc0 tx=0x7fe25c0099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c00dc90 con 0x7fe2640c35e0 2023-08-17T00:15:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c00f040 con 0x7fe2640c35e0 2023-08-17T00:15:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2640bf7d0 con 0x7fe2640c35e0 2023-08-17T00:15:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c0133f0 con 0x7fe2640c35e0 2023-08-17T00:15:35.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2640c0070 con 0x7fe2640c35e0 2023-08-17T00:15:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2640c0590 con 0x7fe2640c35e0 2023-08-17T00:15:35.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.781+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe25c0137e0 con 0x7fe2640c35e0 2023-08-17T00:15:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.785+0000 7fe25a7fc700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe24805a150 0x7fe24805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.785+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fe25c0746e0 con 0x7fe2640c35e0 2023-08-17T00:15:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.785+0000 7fe26a105700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe24805a150 0x7fe24805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:35.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.785+0000 7fe26a105700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe24805a150 0x7fe24805c610 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fe260003870 tx=0x7fe260007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:35.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.789+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe2640c0590 con 0x7fe2640c35e0 2023-08-17T00:15:35.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.953+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe2640c0590 con 0x7fe2640c35e0 2023-08-17T00:15:35.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.953+0000 7fe25a7fc700 1 -- 172.21.15.153:0/864764166 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v162) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe2640c0590 con 0x7fe2640c35e0 2023-08-17T00:15:35.960 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:15:35.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe24805a150 msgr2=0x7fe24805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe24805a150 0x7fe24805c610 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fe260003870 tx=0x7fe260007d40).stop 2023-08-17T00:15:35.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 msgr2=0x7fe26414f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:35.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 0x7fe26414f1b0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 rx=0x7fe25c009fc0 tx=0x7fe25c0099b0).stop 2023-08-17T00:15:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 shutdown_connections 2023-08-17T00:15:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe24805a150 0x7fe24805c610 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2640c35e0 0x7fe26414f1b0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2640be1e0 0x7fe2640bf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 --2- 172.21.15.153:0/864764166 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2640bde00 0x7fe2640aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 >> 172.21.15.153:0/864764166 conn(0x7fe264069760 msgr2=0x7fe2640c50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:35.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 shutdown_connections 2023-08-17T00:15:35.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:35.961+0000 7fe26b107700 1 -- 172.21.15.153:0/864764166 wait complete. 2023-08-17T00:15:35.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:15:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.141+0000 7f06d359e700 1 Processor -- start 2023-08-17T00:15:36.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.141+0000 7f06d359e700 1 -- start start 2023-08-17T00:15:36.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f06d40acf30 0x7f06d40c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.149 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06d40c5ea0 0x7f06d40634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d4154e90 con 0x7f06d40639a0 2023-08-17T00:15:36.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d4153fc0 con 0x7f06d40acf30 2023-08-17T00:15:36.150 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d4154280 con 0x7f06d40c5ea0 2023-08-17T00:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d2d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f06d40639a0 0x7f06d4157590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60412/0 (socket says 172.21.15.153:60412) 2023-08-17T00:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d2d9d700 1 -- 172.21.15.153:0/647859565 learned_addr learned my addr 172.21.15.153:0/647859565 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d259c700 1 --2- 172.21.15.153:0/647859565 >> v2:172.21.15.153:3300/0 conn(0x7f06d40acf30 0x7f06d40c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d1d9b700 1 --2- 172.21.15.153:0/647859565 >> v2:172.21.15.178:3300/0 conn(0x7f06d40c5ea0 0x7f06d40634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d159a700 1 -- 172.21.15.153:0/647859565 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2580068283 0 0) 0x7f06d4154e90 con 0x7f06d40639a0 2023-08-17T00:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d159a700 1 -- 172.21.15.153:0/647859565 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06bc0033f0 con 0x7f06d40639a0 2023-08-17T00:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d259c700 1 -- 172.21.15.153:0/647859565 >> v2:172.21.15.178:3300/0 conn(0x7f06d40c5ea0 msgr2=0x7f06d40634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d259c700 1 --2- 172.21.15.153:0/647859565 >> v2:172.21.15.178:3300/0 conn(0x7f06d40c5ea0 0x7f06d40634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d259c700 1 -- 172.21.15.153:0/647859565 >> v1:172.21.15.153:6789/0 conn(0x7f06d40639a0 legacy=0x7f06d4157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d259c700 1 -- 172.21.15.153:0/647859565 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d4154560 con 0x7f06d40acf30 2023-08-17T00:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d259c700 1 --2- 172.21.15.153:0/647859565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40acf30 0x7f06d40c1020 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f06d40b0a60 tx=0x7f06c4009060).ready entity=mon.0 client_cookie=d520585728917940 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d159a700 1 -- 172.21.15.153:0/647859565 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400d4a0 con 0x7f06d40acf30 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d159a700 1 -- 172.21.15.153:0/647859565 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400d600 con 0x7f06d40acf30 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d159a700 1 -- 172.21.15.153:0/647859565 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400d980 con 0x7f06d40acf30 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 -- 172.21.15.153:0/647859565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40acf30 msgr2=0x7f06d40c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.145+0000 7f06d359e700 1 --2- 172.21.15.153:0/647859565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40acf30 0x7f06d40c1020 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 rx=0x7f06d40b0a60 tx=0x7f06c4009060).stop 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.149+0000 7f06d359e700 1 -- 172.21.15.153:0/647859565 shutdown_connections 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.149+0000 7f06d359e700 1 --2- 172.21.15.153:0/647859565 >> v2:172.21.15.178:3300/0 conn(0x7f06d40c5ea0 0x7f06d40634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.149+0000 7f06d359e700 1 --2- 172.21.15.153:0/647859565 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40acf30 0x7f06d40c1020 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.149+0000 7f06d359e700 1 -- 172.21.15.153:0/647859565 >> 172.21.15.153:0/647859565 conn(0x7f06d40cb330 msgr2=0x7f06d40c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.149+0000 7f06d359e700 1 -- 172.21.15.153:0/647859565 shutdown_connections 2023-08-17T00:15:36.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.149+0000 7f06d359e700 1 -- 172.21.15.153:0/647859565 wait complete. 2023-08-17T00:15:36.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 Processor -- start 2023-08-17T00:15:36.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 -- start start 2023-08-17T00:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 0x7f06d41556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40acf30 0x7f06d4155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40ada40 0x7f06d40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d41560c0 con 0x7f06d40639a0 2023-08-17T00:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4164aa0 con 0x7f06d40ada40 2023-08-17T00:15:36.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4164630 con 0x7f06d40acf30 2023-08-17T00:15:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 0x7f06d41556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 0x7f06d41556e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38122/0 (socket says 172.21.15.153:38122) 2023-08-17T00:15:36.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 -- 172.21.15.153:0/3850236005 learned_addr learned my addr 172.21.15.153:0/3850236005 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d2d9d700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40ada40 0x7f06d40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d1d9b700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40acf30 0x7f06d4155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 -- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40acf30 msgr2=0x7f06d4155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40acf30 0x7f06d4155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 -- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40ada40 msgr2=0x7f06d40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40ada40 0x7f06d40c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 -- 172.21.15.153:0/3850236005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c40092a0 con 0x7f06d40639a0 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d1d9b700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40acf30 0x7f06d4155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d259c700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 0x7f06d41556e0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f06c4009d20 tx=0x7f06c4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4000c90 con 0x7f06d40639a0 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400d770 con 0x7f06d40639a0 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d41506f0 con 0x7f06d40639a0 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c401d430 con 0x7f06d40639a0 2023-08-17T00:15:36.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.153+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d4163d00 con 0x7f06d40639a0 2023-08-17T00:15:36.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.157+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d406a210 con 0x7f06d40639a0 2023-08-17T00:15:36.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.157+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f06c4024030 con 0x7f06d40639a0 2023-08-17T00:15:36.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.157+0000 7f06c27fc700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f06b405a150 0x7f06b405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.157+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f06c4074b90 con 0x7f06d40639a0 2023-08-17T00:15:36.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.161+0000 7f06d1d9b700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f06b405a150 0x7f06b405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.161+0000 7f06d1d9b700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f06b405a150 0x7f06b405c610 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f06c8006d80 tx=0x7f06c8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.165+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f06d406a210 con 0x7f06d40639a0 2023-08-17T00:15:36.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.321+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f06d406a210 con 0x7f06d40639a0 2023-08-17T00:15:36.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06c27fc700 1 -- 172.21.15.153:0/3850236005 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7f06d406a210 con 0x7f06d40639a0 2023-08-17T00:15:36.330 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:15:36.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f06b405a150 msgr2=0x7f06b405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f06b405a150 0x7f06b405c610 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 rx=0x7f06c8006d80 tx=0x7f06c8008040).stop 2023-08-17T00:15:36.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 msgr2=0x7f06d41556e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 0x7f06d41556e0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 rx=0x7f06c4009d20 tx=0x7f06c4016000).stop 2023-08-17T00:15:36.332 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 shutdown_connections 2023-08-17T00:15:36.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f06b405a150 0x7f06b405c610 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06d40ada40 0x7f06d40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06d40acf30 0x7f06d4155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 --2- 172.21.15.153:0/3850236005 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f06d40639a0 0x7f06d41556e0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 >> 172.21.15.153:0/3850236005 conn(0x7f06d40cb330 msgr2=0x7f06d40ac110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 shutdown_connections 2023-08-17T00:15:36.334 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.325+0000 7f06d359e700 1 -- 172.21.15.153:0/3850236005 wait complete. 2023-08-17T00:15:36.354 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:15:36.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.505+0000 7fb5a789b700 1 Processor -- start 2023-08-17T00:15:36.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.505+0000 7fb5a789b700 1 -- start start 2023-08-17T00:15:36.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a789b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 0x7fb5a00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a789b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb5a00c7450 0x7fb5a00c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a789b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5a00aa680 con 0x7fb5a014e2d0 2023-08-17T00:15:36.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a789b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5a0158850 con 0x7fb5a00c7450 2023-08-17T00:15:36.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a789b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c5eb0 con 0x7fb5a014def0 2023-08-17T00:15:36.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a4e36700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fb5a014e2d0 0x7fb5a0154c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60416/0 (socket says 172.21.15.153:60416) 2023-08-17T00:15:36.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a4e36700 1 -- 172.21.15.153:0/1410836453 learned_addr learned my addr 172.21.15.153:0/1410836453 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:36.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433470322 0 0) 0x7fb5a00aa680 con 0x7fb5a014e2d0 2023-08-17T00:15:36.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 0x7fb5a00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5e38700 1 --2- 172.21.15.153:0/1410836453 >> v2:172.21.15.178:3300/0 conn(0x7fb5a00c7450 0x7fb5a00c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb58c0033f0 con 0x7fb5a014e2d0 2023-08-17T00:15:36.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1452741959 0 0) 0x7fb58c0033f0 con 0x7fb5a014e2d0 2023-08-17T00:15:36.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 msgr2=0x7fb5a00c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 0x7fb5a00c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 >> v2:172.21.15.178:3300/0 conn(0x7fb5a00c7450 msgr2=0x7fb5a00c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 --2- 172.21.15.153:0/1410836453 >> v2:172.21.15.178:3300/0 conn(0x7fb5a00c7450 0x7fb5a00c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00c7dd0 con 0x7fb5a014e2d0 2023-08-17T00:15:36.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fb590001490 con 0x7fb5a014e2d0 2023-08-17T00:15:36.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 >> v1:172.21.15.153:6789/0 conn(0x7fb5a014e2d0 legacy=0x7fb5a0154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb58c0038e0 0x7fb58c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 0x7fb58c004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c004b80 0x7fb58c005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a0158850 con 0x7fb58c0038e0 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c5eb0 con 0x7fb58c004b80 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58c00b8e0 con 0x7fb5a014def0 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5e38700 1 --2- 172.21.15.153:0/1410836453 >> v2:172.21.15.178:3300/0 conn(0x7fb5a00c7450 0x7fb5a00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:36.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb58c0038e0 0x7fb58c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a4e36700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 0x7fb58c004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 -- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 msgr2=0x7fb58c004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014def0 0x7fb58c004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 -- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c004b80 msgr2=0x7fb58c005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb58c004b80 0x7fb58c005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 -- 172.21.15.153:0/1410836453 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0033f0 con 0x7fb58c0038e0 2023-08-17T00:15:36.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.509+0000 7fb5a5637700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb58c0038e0 0x7fb58c003d00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7fb59c009a80 tx=0x7fb59c009060).ready entity=mon.0 client_cookie=ef8d929db0f6c1e2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c009430 con 0x7fb58c0038e0 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59c00e640 con 0x7fb58c0038e0 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb597fff700 1 -- 172.21.15.153:0/1410836453 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c00e9c0 con 0x7fb58c0038e0 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a789b700 1 -- 172.21.15.153:0/1410836453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb58c0038e0 msgr2=0x7fb58c003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a789b700 1 --2- 172.21.15.153:0/1410836453 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb58c0038e0 0x7fb58c003d00 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 rx=0x7fb59c009a80 tx=0x7fb59c009060).stop 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a5e38700 1 -- 172.21.15.153:0/1410836453 reap_dead start 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a789b700 1 -- 172.21.15.153:0/1410836453 shutdown_connections 2023-08-17T00:15:36.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a789b700 1 -- 172.21.15.153:0/1410836453 >> 172.21.15.153:0/1410836453 conn(0x7fb5a0061fa0 msgr2=0x7fb5a00623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:36.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a789b700 1 -- 172.21.15.153:0/1410836453 shutdown_connections 2023-08-17T00:15:36.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.513+0000 7fb5a789b700 1 -- 172.21.15.153:0/1410836453 wait complete. 2023-08-17T00:15:36.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 Processor -- start 2023-08-17T00:15:36.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 -- start start 2023-08-17T00:15:36.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014c900 0x7fb5a014cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 0x7fb5a00ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a00c24d0 0x7fb5a00c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00c4020 con 0x7fb5a00ac510 2023-08-17T00:15:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00a98c0 con 0x7fb5a00c24d0 2023-08-17T00:15:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5a00ace60 con 0x7fb5a014c900 2023-08-17T00:15:36.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 0x7fb5a00ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 0x7fb5a00ac970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38150/0 (socket says 172.21.15.153:38150) 2023-08-17T00:15:36.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 -- 172.21.15.153:0/643134902 learned_addr learned my addr 172.21.15.153:0/643134902 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:36.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a5e38700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a00c24d0 0x7fb5a00c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a5637700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014c900 0x7fb5a014cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 -- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014c900 msgr2=0x7fb5a014cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014c900 0x7fb5a014cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 -- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a00c24d0 msgr2=0x7fb5a00c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a00c24d0 0x7fb5a00c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 -- 172.21.15.153:0/643134902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a00c34a0 con 0x7fb5a00ac510 2023-08-17T00:15:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a5e38700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a00c24d0 0x7fb5a00c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:36.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a4e36700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 0x7fb5a00ac970 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fb59000e840 tx=0x7fb590001d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59000c5a0 con 0x7fb5a00ac510 2023-08-17T00:15:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb59000c700 con 0x7fb5a00ac510 2023-08-17T00:15:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59000ca80 con 0x7fb5a00ac510 2023-08-17T00:15:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.517+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5a00c3780 con 0x7fb5a00ac510 2023-08-17T00:15:36.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.521+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5a00c3d40 con 0x7fb5a00ac510 2023-08-17T00:15:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.521+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5a006b530 con 0x7fb5a00ac510 2023-08-17T00:15:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.521+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb590014430 con 0x7fb5a00ac510 2023-08-17T00:15:36.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.521+0000 7fb5957fa700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb58405a150 0x7fb58405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.521+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fb590073b00 con 0x7fb5a00ac510 2023-08-17T00:15:36.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.525+0000 7fb5a5637700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb58405a150 0x7fb58405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.525+0000 7fb5a5637700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb58405a150 0x7fb58405c610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fb5a00caa00 tx=0x7fb59c01a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.529+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb590075e60 con 0x7fb5a00ac510 2023-08-17T00:15:36.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.693+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb5a0063010 con 0x7fb5a00ac510 2023-08-17T00:15:36.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.693+0000 7fb5957fa700 1 -- 172.21.15.153:0/643134902 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v162) v1 ==== 84+0+143 (secure 0 0 0) 0x7fb590047790 con 0x7fb5a00ac510 2023-08-17T00:15:36.698 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:36.698 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:15:36.699 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:36.700 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:15:36.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb58405a150 msgr2=0x7fb58405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb58405a150 0x7fb58405c610 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7fb5a00caa00 tx=0x7fb59c01a000).stop 2023-08-17T00:15:36.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 msgr2=0x7fb5a00ac970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 0x7fb5a00ac970 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 rx=0x7fb59000e840 tx=0x7fb590001d80).stop 2023-08-17T00:15:36.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 shutdown_connections 2023-08-17T00:15:36.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb58405a150 0x7fb58405c610 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5a00c24d0 0x7fb5a00c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb5a00ac510 0x7fb5a00ac970 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 --2- 172.21.15.153:0/643134902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb5a014c900 0x7fb5a014cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 >> 172.21.15.153:0/643134902 conn(0x7fb5a0061fa0 msgr2=0x7fb5a00c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:36.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 shutdown_connections 2023-08-17T00:15:36.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.697+0000 7fb5a789b700 1 -- 172.21.15.153:0/643134902 wait complete. 2023-08-17T00:15:36.723 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:15:36.724 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:15:36.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.885+0000 7f043bf69700 1 Processor -- start 2023-08-17T00:15:36.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.885+0000 7f043bf69700 1 -- start start 2023-08-17T00:15:36.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f04340ad250 0x7f04340c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04340626b0 0x7f0434154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0434155170 con 0x7f04340bfe50 2023-08-17T00:15:36.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04340ad630 con 0x7f04340ad250 2023-08-17T00:15:36.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04340c02e0 con 0x7f04340626b0 2023-08-17T00:15:36.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f04340ad250 0x7f04340c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f04340ad250 0x7f04340c1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38160/0 (socket says 172.21.15.153:38160) 2023-08-17T00:15:36.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 -- 172.21.15.153:0/1515348450 learned_addr learned my addr 172.21.15.153:0/1515348450 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:36.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 -- 172.21.15.153:0/1515348450 >> v2:172.21.15.178:3300/0 conn(0x7f04340626b0 msgr2=0x7f0434154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 --2- 172.21.15.153:0/1515348450 >> v2:172.21.15.178:3300/0 conn(0x7f04340626b0 0x7f0434154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:36.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 -- 172.21.15.153:0/1515348450 >> v1:172.21.15.178:6789/0 conn(0x7f04340bfe50 legacy=0x7f0434061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:36.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 -- 172.21.15.153:0/1515348450 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340c04c0 con 0x7f04340ad250 2023-08-17T00:15:36.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0439d05700 1 --2- 172.21.15.153:0/1515348450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340ad250 0x7f04340c1560 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f043406a1e0 tx=0x7f04300090f0).ready entity=mon.0 client_cookie=36a408b5bbe0e55 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0438d03700 1 -- 172.21.15.153:0/1515348450 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000b580 con 0x7f04340ad250 2023-08-17T00:15:36.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0438d03700 1 -- 172.21.15.153:0/1515348450 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000b6e0 con 0x7f04340ad250 2023-08-17T00:15:36.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f0438d03700 1 -- 172.21.15.153:0/1515348450 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000ba80 con 0x7f04340ad250 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 -- 172.21.15.153:0/1515348450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340ad250 msgr2=0x7f04340c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 --2- 172.21.15.153:0/1515348450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340ad250 0x7f04340c1560 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 rx=0x7f043406a1e0 tx=0x7f04300090f0).stop 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 -- 172.21.15.153:0/1515348450 shutdown_connections 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 --2- 172.21.15.153:0/1515348450 >> v2:172.21.15.178:3300/0 conn(0x7f04340626b0 0x7f0434154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.889+0000 7f043bf69700 1 --2- 172.21.15.153:0/1515348450 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340ad250 0x7f04340c1560 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- 172.21.15.153:0/1515348450 >> 172.21.15.153:0/1515348450 conn(0x7f04340caa10 msgr2=0x7f04340cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- 172.21.15.153:0/1515348450 shutdown_connections 2023-08-17T00:15:36.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- 172.21.15.153:0/1515348450 wait complete. 2023-08-17T00:15:36.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 Processor -- start 2023-08-17T00:15:36.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- start start 2023-08-17T00:15:36.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04340626b0 0x7f04341505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04340ad250 0x7f04340af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340bfe50 0x7f04340c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04340aff60 con 0x7f04340bfe50 2023-08-17T00:15:36.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04340b0240 con 0x7f04340ad250 2023-08-17T00:15:36.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.893+0000 7f043bf69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04340b0520 con 0x7f04340626b0 2023-08-17T00:15:36.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0439d05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04340626b0 0x7f04341505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340bfe50 0x7f04340c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0439d05700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04340626b0 0x7f04341505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:60690/0 (socket says 172.21.15.153:60690) 2023-08-17T00:15:36.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0439d05700 1 -- 172.21.15.153:0/2146509338 learned_addr learned my addr 172.21.15.153:0/2146509338 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:36.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0439504700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04340ad250 0x7f04340af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 -- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04340626b0 msgr2=0x7f04341505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04340626b0 0x7f04341505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 -- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04340ad250 msgr2=0x7f04340af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:36.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04340ad250 0x7f04340af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:36.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 -- 172.21.15.153:0/2146509338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430009370 con 0x7f04340bfe50 2023-08-17T00:15:36.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043a506700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340bfe50 0x7f04340c9890 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f042c00b810 tx=0x7f042c009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00d4a0 con 0x7f04340bfe50 2023-08-17T00:15:36.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00d620 con 0x7f04340bfe50 2023-08-17T00:15:36.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04340b0800 con 0x7f04340bfe50 2023-08-17T00:15:36.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00d9e0 con 0x7f04340bfe50 2023-08-17T00:15:36.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0434150ac0 con 0x7f04340bfe50 2023-08-17T00:15:36.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.897+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043406b530 con 0x7f04340bfe50 2023-08-17T00:15:36.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.901+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f042c018030 con 0x7f04340bfe50 2023-08-17T00:15:36.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.901+0000 7f0429ffb700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f041805a150 0x7f041805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:36.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.901+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f042c073400 con 0x7f04340bfe50 2023-08-17T00:15:36.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.901+0000 7f0439d05700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f041805a150 0x7f041805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:36.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.901+0000 7f0439d05700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f041805a150 0x7f041805c610 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f0430006cc0 tx=0x7f0430017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:36.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:36.909+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f042c04ace0 con 0x7f04340bfe50 2023-08-17T00:15:37.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.069+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f043406a250 con 0x7f04340bfe50 2023-08-17T00:15:37.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.785+0000 7f0429ffb700 1 -- 172.21.15.153:0/2146509338 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v163) v1 ==== 152+0+0 (secure 0 0 0) 0x7f042c009370 con 0x7f04340bfe50 2023-08-17T00:15:37.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f041805a150 msgr2=0x7f041805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f041805a150 0x7f041805c610 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7f0430006cc0 tx=0x7f0430017000).stop 2023-08-17T00:15:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340bfe50 msgr2=0x7f04340c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:37.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340bfe50 0x7f04340c9890 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 rx=0x7f042c00b810 tx=0x7f042c009270).stop 2023-08-17T00:15:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 shutdown_connections 2023-08-17T00:15:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f041805a150 0x7f041805c610 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f04340bfe50 0x7f04340c9890 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04340ad250 0x7f04340af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:37.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 --2- 172.21.15.153:0/2146509338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04340626b0 0x7f04341505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 >> 172.21.15.153:0/2146509338 conn(0x7f04340caa10 msgr2=0x7f04340642d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 shutdown_connections 2023-08-17T00:15:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.801+0000 7f043bf69700 1 -- 172.21.15.153:0/2146509338 wait complete. 2023-08-17T00:15:37.809 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:15:37.826 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:15:37.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.989+0000 7fe3f228f700 1 Processor -- start 2023-08-17T00:15:37.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.989+0000 7fe3f228f700 1 -- start start 2023-08-17T00:15:37.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f228f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0c1190 0x7fe3ec156750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f228f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec1545e0 con 0x7fe3ec068f30 2023-08-17T00:15:37.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f228f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3ec0a96d0 con 0x7fe3ec0abf10 2023-08-17T00:15:37.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f228f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0c1c50 con 0x7fe3ec0c1190 2023-08-17T00:15:38.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f0a8c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe3ec068f30 0x7fe3ec0c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60432/0 (socket says 172.21.15.153:60432) 2023-08-17T00:15:38.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f0a8c700 1 -- 172.21.15.153:0/4191746094 learned_addr learned my addr 172.21.15.153:0/4191746094 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:38.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f1a8e700 1 --2- 172.21.15.153:0/4191746094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0c1190 0x7fe3ec156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:38.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053031019 0 0) 0x7fe3ec0a96d0 con 0x7fe3ec0abf10 2023-08-17T00:15:38.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d80033f0 con 0x7fe3ec0abf10 2023-08-17T00:15:38.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866716573 0 0) 0x7fe3ec1545e0 con 0x7fe3ec068f30 2023-08-17T00:15:38.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3ec0a96d0 con 0x7fe3ec068f30 2023-08-17T00:15:38.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f1a8e700 1 -- 172.21.15.153:0/4191746094 >> v1:172.21.15.178:6789/0 conn(0x7fe3ec0abf10 legacy=0x7fe3ec068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f1a8e700 1 -- 172.21.15.153:0/4191746094 >> v1:172.21.15.153:6789/0 conn(0x7fe3ec068f30 legacy=0x7fe3ec0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f1a8e700 1 -- 172.21.15.153:0/4191746094 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec064b80 con 0x7fe3ec0c1190 2023-08-17T00:15:38.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3f1a8e700 1 --2- 172.21.15.153:0/4191746094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0c1190 0x7fe3ec156750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe3e4009e90 tx=0x7fe3e4009780).ready entity=mon.2 client_cookie=fde0269c969156ef server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:38.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400e070 con 0x7fe3ec0c1190 2023-08-17T00:15:38.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e400bab0 con 0x7fe3ec0c1190 2023-08-17T00:15:38.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.993+0000 7fe3e3fff700 1 -- 172.21.15.153:0/4191746094 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e400be30 con 0x7fe3ec0c1190 2023-08-17T00:15:38.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 -- 172.21.15.153:0/4191746094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0c1190 msgr2=0x7fe3ec156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 --2- 172.21.15.153:0/4191746094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0c1190 0x7fe3ec156750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe3e4009e90 tx=0x7fe3e4009780).stop 2023-08-17T00:15:38.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 -- 172.21.15.153:0/4191746094 shutdown_connections 2023-08-17T00:15:38.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 --2- 172.21.15.153:0/4191746094 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0c1190 0x7fe3ec156750 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 -- 172.21.15.153:0/4191746094 >> 172.21.15.153:0/4191746094 conn(0x7fe3ec0c6620 msgr2=0x7fe3ec0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:38.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 -- 172.21.15.153:0/4191746094 shutdown_connections 2023-08-17T00:15:38.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 -- 172.21.15.153:0/4191746094 wait complete. 2023-08-17T00:15:38.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 Processor -- start 2023-08-17T00:15:38.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:37.997+0000 7fe3f228f700 1 -- start start 2023-08-17T00:15:38.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 0x7fe3ec145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:38.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0abf10 0x7fe3ec0bb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:38.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3ec0c1190 0x7fe3ec0aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:38.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec14eb10 con 0x7fe3ec068f30 2023-08-17T00:15:38.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0bbcd0 con 0x7fe3ec0c1190 2023-08-17T00:15:38.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3ec0bbfb0 con 0x7fe3ec0abf10 2023-08-17T00:15:38.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 0x7fe3ec145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:38.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 0x7fe3ec145bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38172/0 (socket says 172.21.15.153:38172) 2023-08-17T00:15:38.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 -- 172.21.15.153:0/3941339645 learned_addr learned my addr 172.21.15.153:0/3941339645 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:38.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f1a8e700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3ec0c1190 0x7fe3ec0aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:38.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f0a8c700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0abf10 0x7fe3ec0bb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:38.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 -- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0abf10 msgr2=0x7fe3ec0bb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0abf10 0x7fe3ec0bb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 -- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3ec0c1190 msgr2=0x7fe3ec0aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3ec0c1190 0x7fe3ec0aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 -- 172.21.15.153:0/3941339645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4009a20 con 0x7fe3ec068f30 2023-08-17T00:15:38.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f0a8c700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0abf10 0x7fe3ec0bb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:38.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f128d700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 0x7fe3ec145bf0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fe3e800c590 tx=0x7fe3e8007ca0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:38.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8007e40 con 0x7fe3ec068f30 2023-08-17T00:15:38.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e800f470 con 0x7fe3ec068f30 2023-08-17T00:15:38.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3ec0bc290 con 0x7fe3ec068f30 2023-08-17T00:15:38.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800f7f0 con 0x7fe3ec068f30 2023-08-17T00:15:38.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.001+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3ec1460e0 con 0x7fe3ec068f30 2023-08-17T00:15:38.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.005+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3ec06b4c0 con 0x7fe3ec068f30 2023-08-17T00:15:38.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.005+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe3e8019030 con 0x7fe3ec068f30 2023-08-17T00:15:38.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.009+0000 7fe3e17fa700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3d005a150 0x7fe3d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:38.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.009+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fe3e8073260 con 0x7fe3ec068f30 2023-08-17T00:15:38.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.009+0000 7fe3f0a8c700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3d005a150 0x7fe3d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:38.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.009+0000 7fe3f0a8c700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3d005a150 0x7fe3d005c610 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fe3ec167380 tx=0x7fe3dc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:38.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.013+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe3e8046e90 con 0x7fe3ec068f30 2023-08-17T00:15:38.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.181+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe3ec0c1690 con 0x7fe3ec068f30 2023-08-17T00:15:38.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.797+0000 7fe3e17fa700 1 -- 172.21.15.153:0/3941339645 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v164) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe3ec0c1690 con 0x7fe3ec068f30 2023-08-17T00:15:38.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.817+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3d005a150 msgr2=0x7fe3d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3d005a150 0x7fe3d005c610 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7fe3ec167380 tx=0x7fe3dc009040).stop 2023-08-17T00:15:38.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 msgr2=0x7fe3ec145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:38.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 0x7fe3ec145bf0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 rx=0x7fe3e800c590 tx=0x7fe3e8007ca0).stop 2023-08-17T00:15:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 shutdown_connections 2023-08-17T00:15:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe3d005a150 0x7fe3d005c610 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3ec0c1190 0x7fe3ec0aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3ec0abf10 0x7fe3ec0bb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 --2- 172.21.15.153:0/3941339645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe3ec068f30 0x7fe3ec145bf0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:38.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 >> 172.21.15.153:0/3941339645 conn(0x7fe3ec0c6620 msgr2=0x7fe3ec0a9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:38.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 shutdown_connections 2023-08-17T00:15:38.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:38.821+0000 7fe3f228f700 1 -- 172.21.15.153:0/3941339645 wait complete. 2023-08-17T00:15:38.831 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:15:38.851 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:15:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.009+0000 7f4b0cf69700 1 Processor -- start 2023-08-17T00:15:39.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.009+0000 7f4b0cf69700 1 -- start start 2023-08-17T00:15:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0cf69700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b08153ab0 0x7f4b08153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0cf69700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b080aa750 con 0x7f4b080c8d50 2023-08-17T00:15:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0cf69700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b080c9dd0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0cf69700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b080aacf0 con 0x7f4b08153ab0 2023-08-17T00:15:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4b08153ab0 0x7f4b08153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4afffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4b080c8d50 0x7f4b080c7490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60446/0 (socket says 172.21.15.153:60446) 2023-08-17T00:15:39.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4afffff700 1 -- 172.21.15.153:0/3468060007 learned_addr learned my addr 172.21.15.153:0/3468060007 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:39.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0659c700 1 -- 172.21.15.153:0/3468060007 >> v1:172.21.15.178:6789/0 conn(0x7f4b080c7ba0 legacy=0x7f4b080ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0659c700 1 -- 172.21.15.153:0/3468060007 >> v1:172.21.15.153:6789/0 conn(0x7f4b080c8d50 legacy=0x7f4b080c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0659c700 1 -- 172.21.15.153:0/3468060007 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b080c5ca0 con 0x7f4b08153ab0 2023-08-17T00:15:39.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b05d9b700 1 -- 172.21.15.153:0/3468060007 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719345393 0 0) 0x7f4b080aa750 con 0x7f4b080c8d50 2023-08-17T00:15:39.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b0659c700 1 --2- 172.21.15.153:0/3468060007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b08153ab0 0x7f4b08153e90 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f4af8009760 tx=0x7f4af8009060).ready entity=mon.0 client_cookie=de7bcdd7aa227d24 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.013+0000 7f4b05d9b700 1 -- 172.21.15.153:0/3468060007 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8009120 con 0x7f4b08153ab0 2023-08-17T00:15:39.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b05d9b700 1 -- 172.21.15.153:0/3468060007 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800b580 con 0x7f4b08153ab0 2023-08-17T00:15:39.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b05d9b700 1 -- 172.21.15.153:0/3468060007 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af800b900 con 0x7f4b08153ab0 2023-08-17T00:15:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3468060007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b08153ab0 msgr2=0x7f4b08153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3468060007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b08153ab0 0x7f4b08153e90 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 rx=0x7f4af8009760 tx=0x7f4af8009060).stop 2023-08-17T00:15:39.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3468060007 shutdown_connections 2023-08-17T00:15:39.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3468060007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b08153ab0 0x7f4b08153e90 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3468060007 >> 172.21.15.153:0/3468060007 conn(0x7f4b08061fa0 msgr2=0x7f4b080623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:39.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3468060007 shutdown_connections 2023-08-17T00:15:39.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3468060007 wait complete. 2023-08-17T00:15:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 Processor -- start 2023-08-17T00:15:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.017+0000 7f4b0cf69700 1 -- start start 2023-08-17T00:15:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 0x7f4b080b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b080c8d50 0x7f4b080c3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b08153ab0 0x7f4b08158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080b0a70 con 0x7f4b080c7ba0 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b080c3570 con 0x7f4b080c8d50 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b081587a0 con 0x7f4b08153ab0 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 0x7f4b080b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 0x7f4b080b03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38190/0 (socket says 172.21.15.153:38190) 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 -- 172.21.15.153:0/3536614285 learned_addr learned my addr 172.21.15.153:0/3536614285 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:39.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4afffff700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b080c8d50 0x7f4b080c3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 -- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b08153ab0 msgr2=0x7f4b08158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b08153ab0 0x7f4b08158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 -- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b080c8d50 msgr2=0x7f4b080c3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b080c8d50 0x7f4b080c3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 -- 172.21.15.153:0/3536614285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af80092a0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4afffff700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b080c8d50 0x7f4b080c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:39.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0659c700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 0x7f4b080b03b0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f4af800b340 tx=0x7f4af8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af8006950 con 0x7f4b080c7ba0 2023-08-17T00:15:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4af800bcc0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af801b440 con 0x7f4b080c7ba0 2023-08-17T00:15:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b08157bd0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.021+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b08158150 con 0x7f4b080c7ba0 2023-08-17T00:15:39.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.025+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b0806b530 con 0x7f4b080c7ba0 2023-08-17T00:15:39.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.025+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4af802a070 con 0x7f4b080c7ba0 2023-08-17T00:15:39.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.025+0000 7f4afe7fc700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ae805a150 0x7f4ae805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.025+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f4af80757c0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.025+0000 7f4afffff700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ae805a150 0x7f4ae805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.029+0000 7f4afffff700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ae805a150 0x7f4ae805c610 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f4b08159950 tx=0x7f4af0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.033+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4af80491c0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.225+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4b080c9810 con 0x7f4b080c7ba0 2023-08-17T00:15:39.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.241+0000 7f4afe7fc700 1 -- 172.21.15.153:0/3536614285 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v126) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4af80280c0 con 0x7f4b080c7ba0 2023-08-17T00:15:39.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.249+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ae805a150 msgr2=0x7f4ae805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.249+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ae805a150 0x7f4ae805c610 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f4b08159950 tx=0x7f4af0009040).stop 2023-08-17T00:15:39.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.249+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 msgr2=0x7f4b080b03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.249+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 0x7f4b080b03b0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 rx=0x7f4af800b340 tx=0x7f4af8017000).stop 2023-08-17T00:15:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 shutdown_connections 2023-08-17T00:15:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ae805a150 0x7f4ae805c610 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b08153ab0 0x7f4b08158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b080c8d50 0x7f4b080c3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 --2- 172.21.15.153:0/3536614285 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4b080c7ba0 0x7f4b080b03b0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 >> 172.21.15.153:0/3536614285 conn(0x7f4b08061fa0 msgr2=0x7f4b08151790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:39.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 shutdown_connections 2023-08-17T00:15:39.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.253+0000 7f4b0cf69700 1 -- 172.21.15.153:0/3536614285 wait complete. 2023-08-17T00:15:39.266 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 23 and data pool 24 2023-08-17T00:15:39.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:39.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 Processor -- start 2023-08-17T00:15:39.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 -- start start 2023-08-17T00:15:39.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 0x7fcbec068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbec151530 0x7fcbec1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbec065da0 con 0x7fcbec1560f0 2023-08-17T00:15:39.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec155c60 con 0x7fcbec151530 2023-08-17T00:15:39.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf1639700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbec156550 con 0x7fcbec0689c0 2023-08-17T00:15:39.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf0e38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbec151530 0x7fcbec1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbebfff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 0x7fcbec068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf0e38700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fcbec151530 0x7fcbec1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38202/0 (socket says 172.21.15.153:38202) 2023-08-17T00:15:39.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbebfff700 1 --2- 172.21.15.153:0/2644944771 >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 0x7fcbec068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:52078/0 (socket says 172.21.15.153:52078) 2023-08-17T00:15:39.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbf0e38700 1 -- 172.21.15.153:0/2644944771 learned_addr learned my addr 172.21.15.153:0/2644944771 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:39.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.433+0000 7fcbeb7fe700 1 --1- 172.21.15.153:0/2644944771 >> v1:172.21.15.178:6789/0 conn(0x7fcbec1560f0 0x7fcbec0c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:58714/0 (socket says 172.21.15.153:58714) 2023-08-17T00:15:39.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf0e38700 1 -- 172.21.15.153:0/2644944771 >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 msgr2=0x7fcbec068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:39.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf0e38700 1 --2- 172.21.15.153:0/2644944771 >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 0x7fcbec068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf0e38700 1 -- 172.21.15.153:0/2644944771 >> v1:172.21.15.178:6789/0 conn(0x7fcbec1560f0 legacy=0x7fcbec0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf0e38700 1 -- 172.21.15.153:0/2644944771 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbec065ff0 con 0x7fcbec151530 2023-08-17T00:15:39.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbebfff700 1 --2- 172.21.15.153:0/2644944771 >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 0x7fcbec068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:39.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf0e38700 1 --2- 172.21.15.153:0/2644944771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec151530 0x7fcbec1519c0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fcbec0c2d60 tx=0x7fcbe40090f0).ready entity=mon.0 client_cookie=87099f207537f6f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbeaffd700 1 -- 172.21.15.153:0/2644944771 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400b520 con 0x7fcbec151530 2023-08-17T00:15:39.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbeaffd700 1 -- 172.21.15.153:0/2644944771 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400b680 con 0x7fcbec151530 2023-08-17T00:15:39.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbeaffd700 1 -- 172.21.15.153:0/2644944771 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe400ba00 con 0x7fcbec151530 2023-08-17T00:15:39.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 -- 172.21.15.153:0/2644944771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec151530 msgr2=0x7fcbec1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 --2- 172.21.15.153:0/2644944771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec151530 0x7fcbec1519c0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 rx=0x7fcbec0c2d60 tx=0x7fcbe40090f0).stop 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 -- 172.21.15.153:0/2644944771 shutdown_connections 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 --2- 172.21.15.153:0/2644944771 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec151530 0x7fcbec1519c0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 --2- 172.21.15.153:0/2644944771 >> v2:172.21.15.178:3300/0 conn(0x7fcbec0689c0 0x7fcbec068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 -- 172.21.15.153:0/2644944771 >> 172.21.15.153:0/2644944771 conn(0x7fcbec0c6620 msgr2=0x7fcbec0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 -- 172.21.15.153:0/2644944771 shutdown_connections 2023-08-17T00:15:39.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.437+0000 7fcbf1639700 1 -- 172.21.15.153:0/2644944771 wait complete. 2023-08-17T00:15:39.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 Processor -- start 2023-08-17T00:15:39.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 -- start start 2023-08-17T00:15:39.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbec0689c0 0x7fcbec0a4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbec151530 0x7fcbec0c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 0x7fcbec0a7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0a3d40 con 0x7fcbec1560f0 2023-08-17T00:15:39.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0a45e0 con 0x7fcbec151530 2023-08-17T00:15:39.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbec0a8380 con 0x7fcbec0689c0 2023-08-17T00:15:39.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 0x7fcbec0a7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 0x7fcbec0a7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38216/0 (socket says 172.21.15.153:38216) 2023-08-17T00:15:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 -- 172.21.15.153:0/811618256 learned_addr learned my addr 172.21.15.153:0/811618256 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbeb7fe700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbec151530 0x7fcbec0c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbebfff700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbec0689c0 0x7fcbec0a4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 -- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbec0689c0 msgr2=0x7fcbec0a4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbec0689c0 0x7fcbec0a4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 -- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbec151530 msgr2=0x7fcbec0c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbec151530 0x7fcbec0c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 -- 172.21.15.153:0/811618256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009a20 con 0x7fcbec1560f0 2023-08-17T00:15:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf0e38700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 0x7fcbec0a7d10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fcbe4006fd0 tx=0x7fcbe4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4006950 con 0x7fcbec1560f0 2023-08-17T00:15:39.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe400b7f0 con 0x7fcbec1560f0 2023-08-17T00:15:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe401c630 con 0x7fcbec1560f0 2023-08-17T00:15:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe4009370 con 0x7fcbec1560f0 2023-08-17T00:15:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.441+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbec0a4270 con 0x7fcbec1560f0 2023-08-17T00:15:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.445+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbec0a4750 con 0x7fcbec1560f0 2023-08-17T00:15:39.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.445+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcbe402c070 con 0x7fcbec1560f0 2023-08-17T00:15:39.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.449+0000 7fcbd3fff700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbd805a180 0x7fcbd805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.449+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcbe4075ea0 con 0x7fcbec1560f0 2023-08-17T00:15:39.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.449+0000 7fcbebfff700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbd805a180 0x7fcbd805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.449+0000 7fcbebfff700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbd805a180 0x7fcbd805c640 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fcbdc0099f0 tx=0x7fcbdc00b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.453+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcbe4049820 con 0x7fcbec1560f0 2023-08-17T00:15:39.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.621+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbec0662d0 con 0x7fcbec1560f0 2023-08-17T00:15:39.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.625+0000 7fcbd3fff700 1 -- 172.21.15.153:0/811618256 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fcbe402a070 con 0x7fcbec1560f0 2023-08-17T00:15:39.631 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:39.631 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":165,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:39.231396+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:15:37.144808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T00:15:38.254935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbd805a180 msgr2=0x7fcbd805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbd805a180 0x7fcbd805c640 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 rx=0x7fcbdc0099f0 tx=0x7fcbdc00b040).stop 2023-08-17T00:15:39.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 msgr2=0x7fcbec0a7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 0x7fcbec0a7d10 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 rx=0x7fcbe4006fd0 tx=0x7fcbe4017000).stop 2023-08-17T00:15:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 shutdown_connections 2023-08-17T00:15:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcbd805a180 0x7fcbd805c640 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcbec1560f0 0x7fcbec0a7d10 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcbec151530 0x7fcbec0c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 --2- 172.21.15.153:0/811618256 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcbec0689c0 0x7fcbec0a4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 >> 172.21.15.153:0/811618256 conn(0x7fcbec0c6620 msgr2=0x7fcbec0a8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 shutdown_connections 2023-08-17T00:15:39.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.629+0000 7fcbf1639700 1 -- 172.21.15.153:0/811618256 wait complete. 2023-08-17T00:15:39.654 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48e4a8f700 1 Processor -- start 2023-08-17T00:15:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48e4a8f700 1 -- start start 2023-08-17T00:15:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48e4a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48e4a8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e01585a0 con 0x7f48e00aa6e0 2023-08-17T00:15:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48e4a8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e0066400 con 0x7f48e0068820 2023-08-17T00:15:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48e4a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0062dc0 con 0x7f48e00a8df0 2023-08-17T00:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f48e00aa6e0 0x7f48e00626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60452/0 (socket says 172.21.15.153:60452) 2023-08-17T00:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.805+0000 7f48dffff700 1 -- 172.21.15.153:0/2755321313 learned_addr learned my addr 172.21.15.153:0/2755321313 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48df7fe700 1 --2- 172.21.15.153:0/2755321313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240477322 0 0) 0x7f48e01585a0 con 0x7f48e00aa6e0 2023-08-17T00:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48c80033f0 con 0x7f48e00aa6e0 2023-08-17T00:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477374831 0 0) 0x7f48e0066400 con 0x7f48e0068820 2023-08-17T00:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e01585a0 con 0x7f48e0068820 2023-08-17T00:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48df7fe700 1 -- 172.21.15.153:0/2755321313 >> v1:172.21.15.178:6789/0 conn(0x7f48e0068820 legacy=0x7f48e0061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48df7fe700 1 -- 172.21.15.153:0/2755321313 >> v1:172.21.15.153:6789/0 conn(0x7f48e00aa6e0 legacy=0x7f48e00626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48df7fe700 1 -- 172.21.15.153:0/2755321313 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e00b9d30 con 0x7f48e00a8df0 2023-08-17T00:15:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48df7fe700 1 --2- 172.21.15.153:0/2755321313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00c1490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f48d0009760 tx=0x7f48d0006f40).ready entity=mon.2 client_cookie=359c2263e4bbd732 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0005880 con 0x7f48e00a8df0 2023-08-17T00:15:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00059e0 con 0x7f48e00a8df0 2023-08-17T00:15:39.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.809+0000 7f48de7fc700 1 -- 172.21.15.153:0/2755321313 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0005d60 con 0x7f48e00a8df0 2023-08-17T00:15:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2755321313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 msgr2=0x7f48e00c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2755321313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00c1490 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f48d0009760 tx=0x7f48d0006f40).stop 2023-08-17T00:15:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2755321313 shutdown_connections 2023-08-17T00:15:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2755321313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00c1490 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2755321313 >> 172.21.15.153:0/2755321313 conn(0x7f48e00c6620 msgr2=0x7f48e00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2755321313 shutdown_connections 2023-08-17T00:15:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.813+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2755321313 wait complete. 2023-08-17T00:15:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 Processor -- start 2023-08-17T00:15:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 -- start start 2023-08-17T00:15:39.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 0x7f48e00bd650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00bdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48e00aa6e0 0x7f48e0061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e0168730 con 0x7f48e0068820 2023-08-17T00:15:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00bc540 con 0x7f48e00aa6e0 2023-08-17T00:15:39.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48e4a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00bbc10 con 0x7f48e00a8df0 2023-08-17T00:15:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 0x7f48e00bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 0x7f48e00bd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38218/0 (socket says 172.21.15.153:38218) 2023-08-17T00:15:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 -- 172.21.15.153:0/2466489016 learned_addr learned my addr 172.21.15.153:0/2466489016 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48dffff700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48e00aa6e0 0x7f48e0061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48deffd700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00bdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 -- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 msgr2=0x7f48e00bdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00bdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 -- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48e00aa6e0 msgr2=0x7f48e0061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48e00aa6e0 0x7f48e0061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48df7fe700 1 -- 172.21.15.153:0/2466489016 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d0009250 con 0x7f48e0068820 2023-08-17T00:15:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.817+0000 7f48deffd700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00bdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:39.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48df7fe700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 0x7f48e00bd650 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f48d0007fd0 tx=0x7f48d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d000d6b0 con 0x7f48e0068820 2023-08-17T00:15:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d000d810 con 0x7f48e0068820 2023-08-17T00:15:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00bbef0 con 0x7f48e0068820 2023-08-17T00:15:39.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d000db90 con 0x7f48e0068820 2023-08-17T00:15:39.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00bdb40 con 0x7f48e0068820 2023-08-17T00:15:39.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.821+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e006b4c0 con 0x7f48e0068820 2023-08-17T00:15:39.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.825+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f48d0024030 con 0x7f48e0068820 2023-08-17T00:15:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.825+0000 7f48c77fe700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f48cc05a150 0x7f48cc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.825+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f48d0075340 con 0x7f48e0068820 2023-08-17T00:15:39.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.825+0000 7f48deffd700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f48cc05a150 0x7f48cc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.825+0000 7f48deffd700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f48cc05a150 0x7f48cc05c610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f48d4007fd0 tx=0x7f48d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:39.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.829+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f48d0048ea0 con 0x7f48e0068820 2023-08-17T00:15:39.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.985+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48e0064010 con 0x7f48e0068820 2023-08-17T00:15:39.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.989+0000 7f48c77fe700 1 -- 172.21.15.153:0/2466489016 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f48d0022070 con 0x7f48e0068820 2023-08-17T00:15:39.996 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:39.996 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":165,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:39.231396+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:15:37.144808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T00:15:38.254935+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f48cc05a150 msgr2=0x7f48cc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f48cc05a150 0x7f48cc05c610 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f48d4007fd0 tx=0x7f48d4009040).stop 2023-08-17T00:15:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 msgr2=0x7f48e00bd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 0x7f48e00bd650 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 rx=0x7f48d0007fd0 tx=0x7f48d0015000).stop 2023-08-17T00:15:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 shutdown_connections 2023-08-17T00:15:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f48cc05a150 0x7f48cc05c610 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f48e00aa6e0 0x7f48e0061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f48e00a8df0 0x7f48e00bdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 --2- 172.21.15.153:0/2466489016 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f48e0068820 0x7f48e00bd650 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 >> 172.21.15.153:0/2466489016 conn(0x7f48e00c6620 msgr2=0x7f48e0157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:40.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 shutdown_connections 2023-08-17T00:15:40.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:39.993+0000 7f48e4a8f700 1 -- 172.21.15.153:0/2466489016 wait complete. 2023-08-17T00:15:40.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:15:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.177+0000 7f579f507700 1 Processor -- start 2023-08-17T00:15:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.177+0000 7f579f507700 1 -- start start 2023-08-17T00:15:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579f507700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5798068820 0x7f5798068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579f507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579f507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57981585a0 con 0x7f57980a8df0 2023-08-17T00:15:40.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579f507700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57980c1ba0 con 0x7f5798068820 2023-08-17T00:15:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579f507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5798066400 con 0x7f57980a96d0 2023-08-17T00:15:40.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5798068820 0x7f5798068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:40.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5798068820 0x7f5798068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:52110/0 (socket says 172.21.15.153:52110) 2023-08-17T00:15:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 -- 172.21.15.153:0/1606129991 learned_addr learned my addr 172.21.15.153:0/1606129991 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579ed06700 1 --2- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 -- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 msgr2=0x7f57980a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579d503700 1 -- 172.21.15.153:0/1606129991 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394495018 0 0) 0x7f57981585a0 con 0x7f57980a8df0 2023-08-17T00:15:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 --2- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 -- 172.21.15.153:0/1606129991 >> v1:172.21.15.178:6789/0 conn(0x7f57980a8df0 legacy=0x7f57980c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 -- 172.21.15.153:0/1606129991 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798069170 con 0x7f5798068820 2023-08-17T00:15:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579dd04700 1 --2- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5798068820 0x7f5798068c80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f5788006fd0 tx=0x7f57880090f0).ready entity=mon.1 client_cookie=d75377a8f45f7f36 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579d503700 1 -- 172.21.15.153:0/1606129991 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800b580 con 0x7f5798068820 2023-08-17T00:15:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579d503700 1 -- 172.21.15.153:0/1606129991 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578800b6e0 con 0x7f5798068820 2023-08-17T00:15:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.181+0000 7f579d503700 1 -- 172.21.15.153:0/1606129991 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578800ba60 con 0x7f5798068820 2023-08-17T00:15:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 -- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5798068820 msgr2=0x7f5798068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 --2- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5798068820 0x7f5798068c80 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f5788006fd0 tx=0x7f57880090f0).stop 2023-08-17T00:15:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 -- 172.21.15.153:0/1606129991 shutdown_connections 2023-08-17T00:15:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 --2- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 --2- 172.21.15.153:0/1606129991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5798068820 0x7f5798068c80 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 -- 172.21.15.153:0/1606129991 >> 172.21.15.153:0/1606129991 conn(0x7f57980c6620 msgr2=0x7f57980c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 -- 172.21.15.153:0/1606129991 shutdown_connections 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 -- 172.21.15.153:0/1606129991 wait complete. 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 Processor -- start 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.185+0000 7f579f507700 1 -- start start 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 0x7f57980bcee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57980a8df0 0x7f5798147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798144710 con 0x7f5798068820 2023-08-17T00:15:40.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798144fb0 con 0x7f57980a8df0 2023-08-17T00:15:40.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579815b240 con 0x7f57980a96d0 2023-08-17T00:15:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 0x7f57980bcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 0x7f57980bcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38228/0 (socket says 172.21.15.153:38228) 2023-08-17T00:15:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 -- 172.21.15.153:0/652680698 learned_addr learned my addr 172.21.15.153:0/652680698 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579dd04700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57980a8df0 0x7f5798147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579ed06700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 -- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 msgr2=0x7f57980bbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:40.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980bbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 -- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57980a8df0 msgr2=0x7f5798147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57980a8df0 0x7f5798147230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 -- 172.21.15.153:0/652680698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5788009370 con 0x7f5798068820 2023-08-17T00:15:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579e505700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 0x7f57980bcee0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f579400c4d0 tx=0x7f5794007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400f470 con 0x7f5798068820 2023-08-17T00:15:40.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400f5f0 con 0x7f5798068820 2023-08-17T00:15:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5798144960 con 0x7f5798068820 2023-08-17T00:15:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400f9b0 con 0x7f5798068820 2023-08-17T00:15:40.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.189+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57980bc2f0 con 0x7f5798068820 2023-08-17T00:15:40.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.193+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579806b4c0 con 0x7f5798068820 2023-08-17T00:15:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.193+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5794019030 con 0x7f5798068820 2023-08-17T00:15:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.193+0000 7f578e7fc700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f577c05a150 0x7f577c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.193+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f57940736f0 con 0x7f5798068820 2023-08-17T00:15:40.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.193+0000 7f579dd04700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f577c05a150 0x7f577c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:40.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.197+0000 7f579dd04700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f577c05a150 0x7f577c05c610 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f5788009fd0 tx=0x7f5788017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:40.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.201+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5794047090 con 0x7f5798068820 2023-08-17T00:15:40.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:40.401+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5798064010 con 0x7f5798068820 2023-08-17T00:15:41.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.253+0000 7f578e7fc700 1 -- 172.21.15.153:0/652680698 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v129) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5794007d70 con 0x7f5798068820 2023-08-17T00:15:41.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f577c05a150 msgr2=0x7f577c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:41.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f577c05a150 0x7f577c05c610 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f5788009fd0 tx=0x7f5788017000).stop 2023-08-17T00:15:41.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 msgr2=0x7f57980bcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:41.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 0x7f57980bcee0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 rx=0x7f579400c4d0 tx=0x7f5794007c50).stop 2023-08-17T00:15:41.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 shutdown_connections 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f577c05a150 0x7f577c05c610 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57980a96d0 0x7f57980bbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57980a8df0 0x7f5798147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 --2- 172.21.15.153:0/652680698 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5798068820 0x7f57980bcee0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 >> 172.21.15.153:0/652680698 conn(0x7f57980c6620 msgr2=0x7f57980c3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 shutdown_connections 2023-08-17T00:15:41.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.257+0000 7f579f507700 1 -- 172.21.15.153:0/652680698 wait complete. 2023-08-17T00:15:41.285 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:15:41.286 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:15:41.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.445+0000 7fceb6369700 1 Processor -- start 2023-08-17T00:15:41.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.445+0000 7fceb6369700 1 -- start start 2023-08-17T00:15:41.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceb6369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fceb0151f70 0x7fceb0065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:41.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceb6369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0065b50 0x7fceb0064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:41.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceb6369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb0061fa0 con 0x7fceb0151b90 2023-08-17T00:15:41.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceb6369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00c3fb0 con 0x7fceb0151f70 2023-08-17T00:15:41.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceb6369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb01523d0 con 0x7fceb0065b50 2023-08-17T00:15:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fceb0151b90 0x7fceb0063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60456/0 (socket says 172.21.15.153:60456) 2023-08-17T00:15:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaffff700 1 -- 172.21.15.153:0/2226916198 learned_addr learned my addr 172.21.15.153:0/2226916198 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fcea77fe700 1 --2- 172.21.15.153:0/2226916198 >> v2:172.21.15.178:3300/0 conn(0x7fceb0151f70 0x7fceb0065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceb4906700 1 --2- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0065b50 0x7fceb0064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:41.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaf7fe700 1 -- 172.21.15.153:0/2226916198 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320426385 0 0) 0x7fceb0061fa0 con 0x7fceb0151b90 2023-08-17T00:15:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaf7fe700 1 -- 172.21.15.153:0/2226916198 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce9c0033f0 con 0x7fceb0151b90 2023-08-17T00:15:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fcea77fe700 1 -- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0065b50 msgr2=0x7fceb0064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaf7fe700 1 -- 172.21.15.153:0/2226916198 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 932374707 0 0) 0x7fce9c0033f0 con 0x7fceb0151b90 2023-08-17T00:15:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fcea77fe700 1 --2- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0065b50 0x7fceb0064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fcea77fe700 1 -- 172.21.15.153:0/2226916198 >> v1:172.21.15.153:6789/0 conn(0x7fceb0151b90 legacy=0x7fceb0063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:41.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fcea77fe700 1 -- 172.21.15.153:0/2226916198 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00621f0 con 0x7fceb0151f70 2023-08-17T00:15:41.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fcea77fe700 1 --2- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0151f70 0x7fceb0065660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fce98009760 tx=0x7fce98009060).ready entity=mon.1 client_cookie=8d4d3e8adf5791aa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:41.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaf7fe700 1 -- 172.21.15.153:0/2226916198 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0001470 con 0x7fceb0151f70 2023-08-17T00:15:41.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaf7fe700 1 -- 172.21.15.153:0/2226916198 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce980090d0 con 0x7fceb0151f70 2023-08-17T00:15:41.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.449+0000 7fceaf7fe700 1 -- 172.21.15.153:0/2226916198 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98011610 con 0x7fceb0151f70 2023-08-17T00:15:41.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 -- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0151f70 msgr2=0x7fceb0065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:41.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 --2- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0151f70 0x7fceb0065660 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fce98009760 tx=0x7fce98009060).stop 2023-08-17T00:15:41.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 -- 172.21.15.153:0/2226916198 shutdown_connections 2023-08-17T00:15:41.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 --2- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0065b50 0x7fceb0064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 --2- 172.21.15.153:0/2226916198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0151f70 0x7fceb0065660 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 -- 172.21.15.153:0/2226916198 >> 172.21.15.153:0/2226916198 conn(0x7fceb00c7150 msgr2=0x7fceb00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:41.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 -- 172.21.15.153:0/2226916198 shutdown_connections 2023-08-17T00:15:41.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 -- 172.21.15.153:0/2226916198 wait complete. 2023-08-17T00:15:41.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.453+0000 7fceb6369700 1 Processor -- start 2023-08-17T00:15:41.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 -- start start 2023-08-17T00:15:41.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0065b50 0x7fceb01506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:41.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0151b90 0x7fceb016c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:41.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 0x7fceb00c1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00c1490 con 0x7fceb0151f70 2023-08-17T00:15:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0158ca0 con 0x7fceb0065b50 2023-08-17T00:15:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb6369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0150bc0 con 0x7fceb0151b90 2023-08-17T00:15:41.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 0x7fceb00c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 0x7fceb00c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38236/0 (socket says 172.21.15.153:38236) 2023-08-17T00:15:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 -- 172.21.15.153:0/2206540699 learned_addr learned my addr 172.21.15.153:0/2206540699 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:41.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceaffff700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0065b50 0x7fceb01506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fcea77fe700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0151b90 0x7fceb016c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 -- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0151b90 msgr2=0x7fceb016c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0151b90 0x7fceb016c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 -- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0065b50 msgr2=0x7fceb01506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0065b50 0x7fceb01506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 -- 172.21.15.153:0/2206540699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce980092a0 con 0x7fceb0151f70 2023-08-17T00:15:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceb4906700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 0x7fceb00c1920 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fcea8009e20 tx=0x7fcea800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:41.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.457+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800caa0 con 0x7fceb0151f70 2023-08-17T00:15:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.461+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea800f040 con 0x7fceb0151f70 2023-08-17T00:15:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.461+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb0159a60 con 0x7fceb0151f70 2023-08-17T00:15:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.461+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea800ce10 con 0x7fceb0151f70 2023-08-17T00:15:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.461+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb0159780 con 0x7fceb0151f70 2023-08-17T00:15:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.461+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb00c1640 con 0x7fceb0151f70 2023-08-17T00:15:41.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.461+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcea8013610 con 0x7fceb0151f70 2023-08-17T00:15:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.465+0000 7fceacff9700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce9005a180 0x7fce9005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.465+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcea8074a60 con 0x7fceb0151f70 2023-08-17T00:15:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.465+0000 7fceaffff700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce9005a180 0x7fce9005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:41.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.465+0000 7fceaffff700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce9005a180 0x7fce9005c640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fcea0004bc0 tx=0x7fcea0001680).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:41.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.469+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fceb00c1640 con 0x7fceb0151f70 2023-08-17T00:15:41.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:41.665+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fceb00c1640 con 0x7fceb0151f70 2023-08-17T00:15:42.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.261+0000 7fceacff9700 1 -- 172.21.15.153:0/2206540699 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v130) v1 ==== 122+0+0 (secure 0 0 0) 0x7fceb00c1640 con 0x7fceb0151f70 2023-08-17T00:15:42.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce9005a180 msgr2=0x7fce9005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce9005a180 0x7fce9005c640 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7fcea0004bc0 tx=0x7fcea0001680).stop 2023-08-17T00:15:42.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 msgr2=0x7fceb00c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 0x7fceb00c1920 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 rx=0x7fcea8009e20 tx=0x7fcea800b040).stop 2023-08-17T00:15:42.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 shutdown_connections 2023-08-17T00:15:42.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fce9005a180 0x7fce9005c640 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fceb0151f70 0x7fceb00c1920 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fceb0151b90 0x7fceb016c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 --2- 172.21.15.153:0/2206540699 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fceb0065b50 0x7fceb01506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 >> 172.21.15.153:0/2206540699 conn(0x7fceb00c7150 msgr2=0x7fceb0151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:42.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 shutdown_connections 2023-08-17T00:15:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.265+0000 7fceb6369700 1 -- 172.21.15.153:0/2206540699 wait complete. 2023-08-17T00:15:42.294 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:15:42.295 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:42.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f109189b700 1 Processor -- start 2023-08-17T00:15:42.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f109189b700 1 -- start start 2023-08-17T00:15:42.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f109189b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c153ab0 0x7f108c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f109189b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0c0330 con 0x7f108c0c59e0 2023-08-17T00:15:42.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f109189b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0c0ed0 con 0x7f108c0641f0 2023-08-17T00:15:42.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f109189b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0c5e40 con 0x7f108c153ab0 2023-08-17T00:15:42.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f108a7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f108c0c59e0 0x7f108c0c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60472/0 (socket says 172.21.15.153:60472) 2023-08-17T00:15:42.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f108a7fc700 1 -- 172.21.15.153:0/587227631 learned_addr learned my addr 172.21.15.153:0/587227631 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:42.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f108affd700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c153ab0 0x7f108c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148808419 0 0) 0x7f108c0c0330 con 0x7f108c0c59e0 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10740033f0 con 0x7f108c0c59e0 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325418901 0 0) 0x7f108c0c0ed0 con 0x7f108c0641f0 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f108c0c0330 con 0x7f108c0641f0 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.461+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1473653494 0 0) 0x7f10740033f0 con 0x7f108c0c59e0 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c153ab0 msgr2=0x7f108c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c153ab0 0x7f108c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 >> v1:172.21.15.178:6789/0 conn(0x7f108c0641f0 legacy=0x7f108c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0646a0 con 0x7f108c0c59e0 2023-08-17T00:15:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f1080001470 con 0x7f108c0c59e0 2023-08-17T00:15:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 >> v1:172.21.15.153:6789/0 conn(0x7f108c0c59e0 legacy=0x7f108c0c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074003aa0 0x7f1074003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1074004690 0x7f1074004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1074005000 0x7f107400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0c5e40 con 0x7f1074004690 2023-08-17T00:15:42.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107400bf00 con 0x7f1074005000 2023-08-17T00:15:42.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107400c0c0 con 0x7f1074003aa0 2023-08-17T00:15:42.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1074004690 0x7f1074004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108b7fe700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1074005000 0x7f107400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108affd700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074003aa0 0x7f1074003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 -- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074003aa0 msgr2=0x7f1074003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074003aa0 0x7f1074003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 -- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1074005000 msgr2=0x7f107400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1074005000 0x7f107400b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 -- 172.21.15.153:0/587227631 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740033f0 con 0x7f1074004690 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108b7fe700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1074005000 0x7f107400b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:42.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108a7fc700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1074004690 0x7f1074004b10 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f108000c160 tx=0x7f1080001e10).ready entity=mon.0 client_cookie=230498b7f97af468 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:42.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000c9d0 con 0x7f1074004690 2023-08-17T00:15:42.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f108000cb30 con 0x7f1074004690 2023-08-17T00:15:42.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f1089ffb700 1 -- 172.21.15.153:0/587227631 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10800070d0 con 0x7f1074004690 2023-08-17T00:15:42.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f109189b700 1 -- 172.21.15.153:0/587227631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1074004690 msgr2=0x7f1074004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f109189b700 1 --2- 172.21.15.153:0/587227631 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1074004690 0x7f1074004b10 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 rx=0x7f108000c160 tx=0x7f1080001e10).stop 2023-08-17T00:15:42.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f108b7fe700 1 -- 172.21.15.153:0/587227631 reap_dead start 2023-08-17T00:15:42.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f109189b700 1 -- 172.21.15.153:0/587227631 shutdown_connections 2023-08-17T00:15:42.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f109189b700 1 -- 172.21.15.153:0/587227631 >> 172.21.15.153:0/587227631 conn(0x7f108c0caaa0 msgr2=0x7f108c0caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:42.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f109189b700 1 -- 172.21.15.153:0/587227631 shutdown_connections 2023-08-17T00:15:42.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.465+0000 7f109189b700 1 -- 172.21.15.153:0/587227631 wait complete. 2023-08-17T00:15:42.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.469+0000 7f109189b700 1 Processor -- start 2023-08-17T00:15:42.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.469+0000 7f109189b700 1 -- start start 2023-08-17T00:15:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074004690 0x7f108c153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c1577b0 0x7f108c0ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 0x7f108c163f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1544e0 con 0x7f108c0ab910 2023-08-17T00:15:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1547c0 con 0x7f108c1577b0 2023-08-17T00:15:42.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c154aa0 con 0x7f1074004690 2023-08-17T00:15:42.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 0x7f108c163f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 0x7f108c163f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38262/0 (socket says 172.21.15.153:38262) 2023-08-17T00:15:42.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 -- 172.21.15.153:0/1648253534 learned_addr learned my addr 172.21.15.153:0/1648253534 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:42.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108a7fc700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c1577b0 0x7f108c0ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108affd700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074004690 0x7f108c153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 -- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074004690 msgr2=0x7f108c153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074004690 0x7f108c153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 -- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c1577b0 msgr2=0x7f108c0ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c1577b0 0x7f108c0ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 -- 172.21.15.153:0/1648253534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c154d80 con 0x7f108c0ab910 2023-08-17T00:15:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f108b7fe700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 0x7f108c163f60 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f1084001460 tx=0x7f1084009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084003030 con 0x7f108c0ab910 2023-08-17T00:15:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1084003190 con 0x7f108c0ab910 2023-08-17T00:15:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c155060 con 0x7f108c0ab910 2023-08-17T00:15:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1084003530 con 0x7f108c0ab910 2023-08-17T00:15:42.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c164450 con 0x7f108c0ab910 2023-08-17T00:15:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.473+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c06b530 con 0x7f108c0ab910 2023-08-17T00:15:42.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.477+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1084001b00 con 0x7f108c0ab910 2023-08-17T00:15:42.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.477+0000 7f1072ffd700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f107805a180 0x7f107805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.477+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1084073350 con 0x7f108c0ab910 2023-08-17T00:15:42.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.477+0000 7f108affd700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f107805a180 0x7f107805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.481+0000 7f108affd700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f107805a180 0x7f107805c640 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f108c05eb60 tx=0x7f107c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:42.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.485+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1084046e00 con 0x7f108c0ab910 2023-08-17T00:15:42.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.685+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f108c0c60a0 con 0x7f108c0ab910 2023-08-17T00:15:42.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.685+0000 7f1072ffd700 1 -- 172.21.15.153:0/1648253534 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f108401c070 con 0x7f108c0ab910 2023-08-17T00:15:42.691 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:42.691 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:15:42.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f107805a180 msgr2=0x7f107805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f107805a180 0x7f107805c640 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 rx=0x7f108c05eb60 tx=0x7f107c008040).stop 2023-08-17T00:15:42.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 msgr2=0x7f108c163f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 0x7f108c163f60 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 rx=0x7f1084001460 tx=0x7f1084009040).stop 2023-08-17T00:15:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 shutdown_connections 2023-08-17T00:15:42.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f107805a180 0x7f107805c640 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f108c0ab910 0x7f108c163f60 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c1577b0 0x7f108c0ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 --2- 172.21.15.153:0/1648253534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1074004690 0x7f108c153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 >> 172.21.15.153:0/1648253534 conn(0x7f108c0caaa0 msgr2=0x7f108c14e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 shutdown_connections 2023-08-17T00:15:42.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.689+0000 7f109189b700 1 -- 172.21.15.153:0/1648253534 wait complete. 2023-08-17T00:15:42.696 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:15:42.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:15:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad34f79700 1 Processor -- start 2023-08-17T00:15:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad34f79700 1 -- start start 2023-08-17T00:15:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad34f79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad30068820 0x7fad30068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad34f79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad301585a0 con 0x7fad300a96d0 2023-08-17T00:15:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad34f79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad30066400 con 0x7fad300a8df0 2023-08-17T00:15:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad34f79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad300c1ba0 con 0x7fad30068820 2023-08-17T00:15:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad2ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fad300a96d0 0x7fad300a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60486/0 (socket says 172.21.15.153:60486) 2023-08-17T00:15:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad2ffff700 1 -- 172.21.15.153:0/408319476 learned_addr learned my addr 172.21.15.153:0/408319476 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad2effd700 1 --2- 172.21.15.153:0/408319476 >> v2:172.21.15.178:3300/0 conn(0x7fad30068820 0x7fad30068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.873+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601768061 0 0) 0x7fad30066400 con 0x7fad300a8df0 2023-08-17T00:15:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad180033f0 con 0x7fad300a8df0 2023-08-17T00:15:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223330478 0 0) 0x7fad301585a0 con 0x7fad300a96d0 2023-08-17T00:15:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad30066400 con 0x7fad300a96d0 2023-08-17T00:15:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2effd700 1 -- 172.21.15.153:0/408319476 >> v1:172.21.15.178:6789/0 conn(0x7fad300a8df0 legacy=0x7fad300c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2effd700 1 -- 172.21.15.153:0/408319476 >> v1:172.21.15.153:6789/0 conn(0x7fad300a96d0 legacy=0x7fad300a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2effd700 1 -- 172.21.15.153:0/408319476 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30069170 con 0x7fad30068820 2023-08-17T00:15:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2effd700 1 --2- 172.21.15.153:0/408319476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad30068820 0x7fad30068c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fad24009760 tx=0x7fad24009060).ready entity=mon.1 client_cookie=abf678b3d505bd9d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400d4a0 con 0x7fad30068820 2023-08-17T00:15:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400d600 con 0x7fad30068820 2023-08-17T00:15:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad2e7fc700 1 -- 172.21.15.153:0/408319476 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400d980 con 0x7fad30068820 2023-08-17T00:15:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 -- 172.21.15.153:0/408319476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad30068820 msgr2=0x7fad30068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 --2- 172.21.15.153:0/408319476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad30068820 0x7fad30068c80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7fad24009760 tx=0x7fad24009060).stop 2023-08-17T00:15:42.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 -- 172.21.15.153:0/408319476 shutdown_connections 2023-08-17T00:15:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 --2- 172.21.15.153:0/408319476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad30068820 0x7fad30068c80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 -- 172.21.15.153:0/408319476 >> 172.21.15.153:0/408319476 conn(0x7fad300c6620 msgr2=0x7fad300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 -- 172.21.15.153:0/408319476 shutdown_connections 2023-08-17T00:15:42.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.877+0000 7fad34f79700 1 -- 172.21.15.153:0/408319476 wait complete. 2023-08-17T00:15:42.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 Processor -- start 2023-08-17T00:15:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 -- start start 2023-08-17T00:15:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad30068820 0x7fad30157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 0x7fad300b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300a96d0 0x7fad3016b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300bc020 con 0x7fad300a8df0 2023-08-17T00:15:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad300bce80 con 0x7fad300a96d0 2023-08-17T00:15:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad34f79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad300ba450 con 0x7fad30068820 2023-08-17T00:15:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 0x7fad300b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 0x7fad300b9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38268/0 (socket says 172.21.15.153:38268) 2023-08-17T00:15:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 -- 172.21.15.153:0/3624641464 learned_addr learned my addr 172.21.15.153:0/3624641464 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2ffff700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300a96d0 0x7fad3016b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2f7fe700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad30068820 0x7fad30157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 -- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad30068820 msgr2=0x7fad30157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad30068820 0x7fad30157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 -- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300a96d0 msgr2=0x7fad3016b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300a96d0 0x7fad3016b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 -- 172.21.15.153:0/3624641464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad240092a0 con 0x7fad300a8df0 2023-08-17T00:15:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2ffff700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300a96d0 0x7fad3016b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2f7fe700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad30068820 0x7fad30157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.881+0000 7fad2effd700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 0x7fad300b9f60 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7fad24009d50 tx=0x7fad24016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24000cb0 con 0x7fad300a8df0 2023-08-17T00:15:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400d770 con 0x7fad300a8df0 2023-08-17T00:15:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2401d640 con 0x7fad300a8df0 2023-08-17T00:15:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad300bc270 con 0x7fad300a8df0 2023-08-17T00:15:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad300bc830 con 0x7fad300a8df0 2023-08-17T00:15:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad300bd010 con 0x7fad300a8df0 2023-08-17T00:15:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.885+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fad24024030 con 0x7fad300a8df0 2023-08-17T00:15:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.889+0000 7fad177fe700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1c05a150 0x7fad1c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:42.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.889+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fad24074f40 con 0x7fad300a8df0 2023-08-17T00:15:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.889+0000 7fad2f7fe700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1c05a150 0x7fad1c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:42.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.889+0000 7fad2f7fe700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1c05a150 0x7fad1c05c610 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fad200037f0 tx=0x7fad20009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:42.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:42.893+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fad24048a10 con 0x7fad300a8df0 2023-08-17T00:15:43.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.049+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad3006b4c0 con 0x7fad300a8df0 2023-08-17T00:15:43.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.053+0000 7fad177fe700 1 -- 172.21.15.153:0/3624641464 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+16990 (secure 0 0 0) 0x7fad24022070 con 0x7fad300a8df0 2023-08-17T00:15:43.059 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:43.060 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":166,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:40.236606+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:15:37.144808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T00:15:38.254935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:15:43.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1c05a150 msgr2=0x7fad1c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1c05a150 0x7fad1c05c610 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7fad200037f0 tx=0x7fad20009040).stop 2023-08-17T00:15:43.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 msgr2=0x7fad300b9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 0x7fad300b9f60 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 rx=0x7fad24009d50 tx=0x7fad24016000).stop 2023-08-17T00:15:43.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 shutdown_connections 2023-08-17T00:15:43.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fad1c05a150 0x7fad1c05c610 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad300a96d0 0x7fad3016b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fad300a8df0 0x7fad300b9f60 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 --2- 172.21.15.153:0/3624641464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad30068820 0x7fad30157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 >> 172.21.15.153:0/3624641464 conn(0x7fad300c6620 msgr2=0x7fad30157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:43.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 shutdown_connections 2023-08-17T00:15:43.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.057+0000 7fad34f79700 1 -- 172.21.15.153:0/3624641464 wait complete. 2023-08-17T00:15:43.082 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:15:43.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:15:43.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.237+0000 7f0b0f969700 1 Processor -- start 2023-08-17T00:15:43.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.237+0000 7f0b0f969700 1 -- start start 2023-08-17T00:15:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0f969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b080632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0f969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b080629b0 0x7f0b080bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0f969700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b08065240 con 0x7f0b080a8f50 2023-08-17T00:15:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0f969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b08062e60 con 0x7f0b080629b0 2023-08-17T00:15:43.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0f969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080638a0 con 0x7f0b080a8b70 2023-08-17T00:15:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b080629b0 0x7f0b080bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0b080629b0 0x7f0b080bbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38274/0 (socket says 172.21.15.153:38274) 2023-08-17T00:15:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 -- 172.21.15.153:0/3332125900 learned_addr learned my addr 172.21.15.153:0/3332125900 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0d705700 1 --2- 172.21.15.153:0/3332125900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b080632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 -- 172.21.15.153:0/3332125900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 msgr2=0x7f0b080632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 --2- 172.21.15.153:0/3332125900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b080632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 -- 172.21.15.153:0/3332125900 >> v1:172.21.15.178:6789/0 conn(0x7f0b080a8f50 legacy=0x7f0b080656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 -- 172.21.15.153:0/3332125900 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08065de0 con 0x7f0b080629b0 2023-08-17T00:15:43.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0b0df06700 1 --2- 172.21.15.153:0/3332125900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080629b0 0x7f0b080bbdc0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f0b00009f20 tx=0x7f0b00009840).ready entity=mon.0 client_cookie=b317c38fedf3fc85 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:43.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0afffff700 1 -- 172.21.15.153:0/3332125900 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000e070 con 0x7f0b080629b0 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0afffff700 1 -- 172.21.15.153:0/3332125900 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000ba80 con 0x7f0b080629b0 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.241+0000 7f0afffff700 1 -- 172.21.15.153:0/3332125900 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000be00 con 0x7f0b080629b0 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 -- 172.21.15.153:0/3332125900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080629b0 msgr2=0x7f0b080bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 --2- 172.21.15.153:0/3332125900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080629b0 0x7f0b080bbdc0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 rx=0x7f0b00009f20 tx=0x7f0b00009840).stop 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 -- 172.21.15.153:0/3332125900 shutdown_connections 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 --2- 172.21.15.153:0/3332125900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080629b0 0x7f0b080bbdc0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 --2- 172.21.15.153:0/3332125900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b080632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 -- 172.21.15.153:0/3332125900 >> 172.21.15.153:0/3332125900 conn(0x7f0b080c7150 msgr2=0x7f0b080c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:43.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 -- 172.21.15.153:0/3332125900 shutdown_connections 2023-08-17T00:15:43.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 -- 172.21.15.153:0/3332125900 wait complete. 2023-08-17T00:15:43.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 Processor -- start 2023-08-17T00:15:43.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.245+0000 7f0b0f969700 1 -- start start 2023-08-17T00:15:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b080629b0 0x7f0b080ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b0815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 0x7f0b080aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080aa880 con 0x7f0b080a8f50 2023-08-17T00:15:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0815b6f0 con 0x7f0b080629b0 2023-08-17T00:15:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0815a440 con 0x7f0b080a8b70 2023-08-17T00:15:43.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 0x7f0b080aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 0x7f0b080aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38284/0 (socket says 172.21.15.153:38284) 2023-08-17T00:15:43.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 -- 172.21.15.153:0/2617938243 learned_addr learned my addr 172.21.15.153:0/2617938243 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:43.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0d705700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b080629b0 0x7f0b080ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0cf04700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b0815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 -- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 msgr2=0x7f0b0815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b0815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 -- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b080629b0 msgr2=0x7f0b080ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b080629b0 0x7f0b080ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 -- 172.21.15.153:0/2617938243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b00009ae0 con 0x7f0b080a8f50 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0df06700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 0x7f0b080aa0a0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f0b00007080 tx=0x7f0b00009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0000be00 con 0x7f0b080a8f50 2023-08-17T00:15:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000b6f0 con 0x7f0b080a8f50 2023-08-17T00:15:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0815a720 con 0x7f0b080a8f50 2023-08-17T00:15:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0001d6b0 con 0x7f0b080a8f50 2023-08-17T00:15:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.249+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0815ace0 con 0x7f0b080a8f50 2023-08-17T00:15:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.253+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0815af00 con 0x7f0b080a8f50 2023-08-17T00:15:43.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.253+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0b00024030 con 0x7f0b080a8f50 2023-08-17T00:15:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.253+0000 7f0afd7fa700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0aec05a150 0x7f0aec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.253+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0b000756e0 con 0x7f0b080a8f50 2023-08-17T00:15:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.253+0000 7f0b0d705700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0aec05a150 0x7f0aec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.257+0000 7f0b0d705700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0aec05a150 0x7f0aec05c610 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f0b0400bbc0 tx=0x7f0b04008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:43.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.261+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0b00049190 con 0x7f0b080a8f50 2023-08-17T00:15:43.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.413+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b080c3ab0 con 0x7f0aec05a150 2023-08-17T00:15:43.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.433+0000 7f0afd7fa700 1 -- 172.21.15.153:0/2617938243 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358353 (secure 0 0 0) 0x7f0b080c3ab0 con 0x7f0aec05a150 2023-08-17T00:15:43.445 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:43.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0aec05a150 msgr2=0x7f0aec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0aec05a150 0x7f0aec05c610 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f0b0400bbc0 tx=0x7f0b04008040).stop 2023-08-17T00:15:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 msgr2=0x7f0b080aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 0x7f0b080aa0a0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 rx=0x7f0b00007080 tx=0x7f0b00009840).stop 2023-08-17T00:15:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 shutdown_connections 2023-08-17T00:15:43.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0aec05a150 0x7f0aec05c610 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0b080a8f50 0x7f0b080aa0a0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b080a8b70 0x7f0b0815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 --2- 172.21.15.153:0/2617938243 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b080629b0 0x7f0b080ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 >> 172.21.15.153:0/2617938243 conn(0x7f0b080c7150 msgr2=0x7f0b080c2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:43.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 shutdown_connections 2023-08-17T00:15:43.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.441+0000 7f0b0f969700 1 -- 172.21.15.153:0/2617938243 wait complete. 2023-08-17T00:15:43.451 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:15:43.468 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2023-08-17T00:15:41.469171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2284,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":262,"acting":262,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2479780,"kb_used_data":15972,"kb_used_omap":0,"kb_used_meta":2463744,"kb_avail":752494940,"statfs":{"total":773094113280,"available":770554818560,"internally_reserved":0,"allocated":16355328,"data_stored":7673189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2522873856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3664,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-49,"num_write_kb":-17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.144319"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262292+0000","last_change":"2023-08-17T00:15:39.262292+0000","last_active":"2023-08-17T00:15:39.262292+0000","last_peered":"2023-08-17T00:15:39.262292+0000","last_clean":"2023-08-17T00:15:39.262292+0000","last_became_active":"2023-08-17T00:15:39.262025+0000","last_became_peered":"2023-08-17T00:15:39.262025+0000","last_unstale":"2023-08-17T00:15:39.262292+0000","last_undegraded":"2023-08-17T00:15:39.262292+0000","last_fullsized":"2023-08-17T00:15:39.262292+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3f","version":"165'3","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.272571+0000","last_change":"2023-08-17T00:15:38.829501+0000","last_active":"2023-08-17T00:15:39.272571+0000","last_peered":"2023-08-17T00:15:39.272571+0000","last_clean":"2023-08-17T00:15:39.272571+0000","last_became_active":"2023-08-17T00:15:38.828805+0000","last_became_peered":"2023-08-17T00:15:38.828805+0000","last_unstale":"2023-08-17T00:15:39.272571+0000","last_undegraded":"2023-08-17T00:15:39.272571+0000","last_fullsized":"2023-08-17T00:15:39.272571+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.274831+0000","last_change":"2023-08-17T00:15:39.274831+0000","last_active":"2023-08-17T00:15:39.274831+0000","last_peered":"2023-08-17T00:15:39.274831+0000","last_clean":"2023-08-17T00:15:39.274831+0000","last_became_active":"2023-08-17T00:15:39.274347+0000","last_became_peered":"2023-08-17T00:15:39.274347+0000","last_unstale":"2023-08-17T00:15:39.274831+0000","last_undegraded":"2023-08-17T00:15:39.274831+0000","last_fullsized":"2023-08-17T00:15:39.274831+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.833399+0000","last_change":"2023-08-17T00:15:38.829415+0000","last_active":"2023-08-17T00:15:38.833399+0000","last_peered":"2023-08-17T00:15:38.833399+0000","last_clean":"2023-08-17T00:15:38.833399+0000","last_became_active":"2023-08-17T00:15:38.829104+0000","last_became_peered":"2023-08-17T00:15:38.829104+0000","last_unstale":"2023-08-17T00:15:38.833399+0000","last_undegraded":"2023-08-17T00:15:38.833399+0000","last_fullsized":"2023-08-17T00:15:38.833399+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270969+0000","last_change":"2023-08-17T00:15:39.270969+0000","last_active":"2023-08-17T00:15:39.270969+0000","last_peered":"2023-08-17T00:15:39.270969+0000","last_clean":"2023-08-17T00:15:39.270969+0000","last_became_active":"2023-08-17T00:15:39.270706+0000","last_became_peered":"2023-08-17T00:15:39.270706+0000","last_unstale":"2023-08-17T00:15:39.270969+0000","last_undegraded":"2023-08-17T00:15:39.270969+0000","last_fullsized":"2023-08-17T00:15:39.270969+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.833632+0000","last_change":"2023-08-17T00:15:38.828791+0000","last_active":"2023-08-17T00:15:38.833632+0000","last_peered":"2023-08-17T00:15:38.833632+0000","last_clean":"2023-08-17T00:15:38.833632+0000","last_became_active":"2023-08-17T00:15:38.828493+0000","last_became_peered":"2023-08-17T00:15:38.828493+0000","last_unstale":"2023-08-17T00:15:38.833632+0000","last_undegraded":"2023-08-17T00:15:38.833632+0000","last_fullsized":"2023-08-17T00:15:38.833632+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262268+0000","last_change":"2023-08-17T00:15:39.262268+0000","last_active":"2023-08-17T00:15:39.262268+0000","last_peered":"2023-08-17T00:15:39.262268+0000","last_clean":"2023-08-17T00:15:39.262268+0000","last_became_active":"2023-08-17T00:15:39.261993+0000","last_became_peered":"2023-08-17T00:15:39.261993+0000","last_unstale":"2023-08-17T00:15:39.262268+0000","last_undegraded":"2023-08-17T00:15:39.262268+0000","last_fullsized":"2023-08-17T00:15:39.262268+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.796902+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263786+0000","last_change":"2023-08-17T00:15:39.263786+0000","last_active":"2023-08-17T00:15:39.263786+0000","last_peered":"2023-08-17T00:15:39.263786+0000","last_clean":"2023-08-17T00:15:39.263786+0000","last_became_active":"2023-08-17T00:15:39.263540+0000","last_became_peered":"2023-08-17T00:15:39.263540+0000","last_unstale":"2023-08-17T00:15:39.263786+0000","last_undegraded":"2023-08-17T00:15:39.263786+0000","last_fullsized":"2023-08-17T00:15:39.263786+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3b","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.248566+0000","last_change":"2023-08-17T00:15:38.829516+0000","last_active":"2023-08-17T00:15:39.248566+0000","last_peered":"2023-08-17T00:15:39.248566+0000","last_clean":"2023-08-17T00:15:39.248566+0000","last_became_active":"2023-08-17T00:15:38.829146+0000","last_became_peered":"2023-08-17T00:15:38.829146+0000","last_unstale":"2023-08-17T00:15:39.248566+0000","last_undegraded":"2023-08-17T00:15:39.248566+0000","last_fullsized":"2023-08-17T00:15:39.248566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270019+0000","last_change":"2023-08-17T00:15:39.270019+0000","last_active":"2023-08-17T00:15:39.270019+0000","last_peered":"2023-08-17T00:15:39.270019+0000","last_clean":"2023-08-17T00:15:39.270019+0000","last_became_active":"2023-08-17T00:15:39.269735+0000","last_became_peered":"2023-08-17T00:15:39.269735+0000","last_unstale":"2023-08-17T00:15:39.270019+0000","last_undegraded":"2023-08-17T00:15:39.270019+0000","last_fullsized":"2023-08-17T00:15:39.270019+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.250416+0000","last_change":"2023-08-17T00:15:38.830732+0000","last_active":"2023-08-17T00:15:39.250416+0000","last_peered":"2023-08-17T00:15:39.250416+0000","last_clean":"2023-08-17T00:15:39.250416+0000","last_became_active":"2023-08-17T00:15:38.830420+0000","last_became_peered":"2023-08-17T00:15:38.830420+0000","last_unstale":"2023-08-17T00:15:39.250416+0000","last_undegraded":"2023-08-17T00:15:39.250416+0000","last_fullsized":"2023-08-17T00:15:39.250416+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264710+0000","last_change":"2023-08-17T00:15:39.264710+0000","last_active":"2023-08-17T00:15:39.264710+0000","last_peered":"2023-08-17T00:15:39.264710+0000","last_clean":"2023-08-17T00:15:39.264710+0000","last_became_active":"2023-08-17T00:15:39.264288+0000","last_became_peered":"2023-08-17T00:15:39.264288+0000","last_unstale":"2023-08-17T00:15:39.264710+0000","last_undegraded":"2023-08-17T00:15:39.264710+0000","last_fullsized":"2023-08-17T00:15:39.264710+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.832767+0000","last_change":"2023-08-17T00:15:38.826239+0000","last_active":"2023-08-17T00:15:38.832767+0000","last_peered":"2023-08-17T00:15:38.832767+0000","last_clean":"2023-08-17T00:15:38.832767+0000","last_became_active":"2023-08-17T00:15:38.825880+0000","last_became_peered":"2023-08-17T00:15:38.825880+0000","last_unstale":"2023-08-17T00:15:38.832767+0000","last_undegraded":"2023-08-17T00:15:38.832767+0000","last_fullsized":"2023-08-17T00:15:38.832767+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270296+0000","last_change":"2023-08-17T00:15:39.270296+0000","last_active":"2023-08-17T00:15:39.270296+0000","last_peered":"2023-08-17T00:15:39.270296+0000","last_clean":"2023-08-17T00:15:39.270296+0000","last_became_active":"2023-08-17T00:15:39.270014+0000","last_became_peered":"2023-08-17T00:15:39.270014+0000","last_unstale":"2023-08-17T00:15:39.270296+0000","last_undegraded":"2023-08-17T00:15:39.270296+0000","last_fullsized":"2023-08-17T00:15:39.270296+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.827933+0000","last_change":"2023-08-17T00:15:38.819105+0000","last_active":"2023-08-17T00:15:38.827933+0000","last_peered":"2023-08-17T00:15:38.827933+0000","last_clean":"2023-08-17T00:15:38.827933+0000","last_became_active":"2023-08-17T00:15:38.817770+0000","last_became_peered":"2023-08-17T00:15:38.817770+0000","last_unstale":"2023-08-17T00:15:38.827933+0000","last_undegraded":"2023-08-17T00:15:38.827933+0000","last_fullsized":"2023-08-17T00:15:38.827933+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:15:38.788461+0000","last_change":"2023-08-17T00:15:38.788461+0000","last_active":"2023-08-17T00:15:38.788461+0000","last_peered":"2023-08-17T00:15:38.788461+0000","last_clean":"2023-08-17T00:15:38.788461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:38.788461+0000","last_undegraded":"2023-08-17T00:15:38.788461+0000","last_fullsized":"2023-08-17T00:15:38.788461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836514+0000","last_change":"2023-08-17T00:15:38.832551+0000","last_active":"2023-08-17T00:15:38.836514+0000","last_peered":"2023-08-17T00:15:38.836514+0000","last_clean":"2023-08-17T00:15:38.836514+0000","last_became_active":"2023-08-17T00:15:38.832278+0000","last_became_peered":"2023-08-17T00:15:38.832278+0000","last_unstale":"2023-08-17T00:15:38.836514+0000","last_undegraded":"2023-08-17T00:15:38.836514+0000","last_fullsized":"2023-08-17T00:15:38.836514+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264093+0000","last_change":"2023-08-17T00:15:39.264093+0000","last_active":"2023-08-17T00:15:39.264093+0000","last_peered":"2023-08-17T00:15:39.264093+0000","last_clean":"2023-08-17T00:15:39.264093+0000","last_became_active":"2023-08-17T00:15:39.263745+0000","last_became_peered":"2023-08-17T00:15:39.263745+0000","last_unstale":"2023-08-17T00:15:39.264093+0000","last_undegraded":"2023-08-17T00:15:39.264093+0000","last_fullsized":"2023-08-17T00:15:39.264093+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835265+0000","last_change":"2023-08-17T00:15:38.825376+0000","last_active":"2023-08-17T00:15:38.835265+0000","last_peered":"2023-08-17T00:15:38.835265+0000","last_clean":"2023-08-17T00:15:38.835265+0000","last_became_active":"2023-08-17T00:15:38.825105+0000","last_became_peered":"2023-08-17T00:15:38.825105+0000","last_unstale":"2023-08-17T00:15:38.835265+0000","last_undegraded":"2023-08-17T00:15:38.835265+0000","last_fullsized":"2023-08-17T00:15:38.835265+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263442+0000","last_change":"2023-08-17T00:15:39.263442+0000","last_active":"2023-08-17T00:15:39.263442+0000","last_peered":"2023-08-17T00:15:39.263442+0000","last_clean":"2023-08-17T00:15:39.263442+0000","last_became_active":"2023-08-17T00:15:39.263148+0000","last_became_peered":"2023-08-17T00:15:39.263148+0000","last_unstale":"2023-08-17T00:15:39.263442+0000","last_undegraded":"2023-08-17T00:15:39.263442+0000","last_fullsized":"2023-08-17T00:15:39.263442+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838780+0000","last_change":"2023-08-17T00:15:38.833017+0000","last_active":"2023-08-17T00:15:38.838780+0000","last_peered":"2023-08-17T00:15:38.838780+0000","last_clean":"2023-08-17T00:15:38.838780+0000","last_became_active":"2023-08-17T00:15:38.831513+0000","last_became_peered":"2023-08-17T00:15:38.831513+0000","last_unstale":"2023-08-17T00:15:38.838780+0000","last_undegraded":"2023-08-17T00:15:38.838780+0000","last_fullsized":"2023-08-17T00:15:38.838780+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269395+0000","last_change":"2023-08-17T00:15:39.269395+0000","last_active":"2023-08-17T00:15:39.269395+0000","last_peered":"2023-08-17T00:15:39.269395+0000","last_clean":"2023-08-17T00:15:39.269395+0000","last_became_active":"2023-08-17T00:15:39.269060+0000","last_became_peered":"2023-08-17T00:15:39.269060+0000","last_unstale":"2023-08-17T00:15:39.269395+0000","last_undegraded":"2023-08-17T00:15:39.269395+0000","last_fullsized":"2023-08-17T00:15:39.269395+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278403+0000","last_change":"2023-08-17T00:15:38.832341+0000","last_active":"2023-08-17T00:15:39.278403+0000","last_peered":"2023-08-17T00:15:39.278403+0000","last_clean":"2023-08-17T00:15:39.278403+0000","last_became_active":"2023-08-17T00:15:38.832067+0000","last_became_peered":"2023-08-17T00:15:38.832067+0000","last_unstale":"2023-08-17T00:15:39.278403+0000","last_undegraded":"2023-08-17T00:15:39.278403+0000","last_fullsized":"2023-08-17T00:15:39.278403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264111+0000","last_change":"2023-08-17T00:15:39.264111+0000","last_active":"2023-08-17T00:15:39.264111+0000","last_peered":"2023-08-17T00:15:39.264111+0000","last_clean":"2023-08-17T00:15:39.264111+0000","last_became_active":"2023-08-17T00:15:39.263722+0000","last_became_peered":"2023-08-17T00:15:39.263722+0000","last_unstale":"2023-08-17T00:15:39.264111+0000","last_undegraded":"2023-08-17T00:15:39.264111+0000","last_fullsized":"2023-08-17T00:15:39.264111+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.33","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.240601+0000","last_change":"2023-08-17T00:15:38.831011+0000","last_active":"2023-08-17T00:15:39.240601+0000","last_peered":"2023-08-17T00:15:39.240601+0000","last_clean":"2023-08-17T00:15:39.240601+0000","last_became_active":"2023-08-17T00:15:38.830715+0000","last_became_peered":"2023-08-17T00:15:38.830715+0000","last_unstale":"2023-08-17T00:15:39.240601+0000","last_undegraded":"2023-08-17T00:15:39.240601+0000","last_fullsized":"2023-08-17T00:15:39.240601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265901+0000","last_change":"2023-08-17T00:15:39.265901+0000","last_active":"2023-08-17T00:15:39.265901+0000","last_peered":"2023-08-17T00:15:39.265901+0000","last_clean":"2023-08-17T00:15:39.265901+0000","last_became_active":"2023-08-17T00:15:39.265534+0000","last_became_peered":"2023-08-17T00:15:39.265534+0000","last_unstale":"2023-08-17T00:15:39.265901+0000","last_undegraded":"2023-08-17T00:15:39.265901+0000","last_fullsized":"2023-08-17T00:15:39.265901+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835304+0000","last_change":"2023-08-17T00:15:38.823467+0000","last_active":"2023-08-17T00:15:38.835304+0000","last_peered":"2023-08-17T00:15:38.835304+0000","last_clean":"2023-08-17T00:15:38.835304+0000","last_became_active":"2023-08-17T00:15:38.823120+0000","last_became_peered":"2023-08-17T00:15:38.823120+0000","last_unstale":"2023-08-17T00:15:38.835304+0000","last_undegraded":"2023-08-17T00:15:38.835304+0000","last_fullsized":"2023-08-17T00:15:38.835304+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262845+0000","last_change":"2023-08-17T00:15:39.262845+0000","last_active":"2023-08-17T00:15:39.262845+0000","last_peered":"2023-08-17T00:15:39.262845+0000","last_clean":"2023-08-17T00:15:39.262845+0000","last_became_active":"2023-08-17T00:15:39.262576+0000","last_became_peered":"2023-08-17T00:15:39.262576+0000","last_unstale":"2023-08-17T00:15:39.262845+0000","last_undegraded":"2023-08-17T00:15:39.262845+0000","last_fullsized":"2023-08-17T00:15:39.262845+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.827804+0000","last_change":"2023-08-17T00:15:38.816569+0000","last_active":"2023-08-17T00:15:38.827804+0000","last_peered":"2023-08-17T00:15:38.827804+0000","last_clean":"2023-08-17T00:15:38.827804+0000","last_became_active":"2023-08-17T00:15:38.815443+0000","last_became_peered":"2023-08-17T00:15:38.815443+0000","last_unstale":"2023-08-17T00:15:38.827804+0000","last_undegraded":"2023-08-17T00:15:38.827804+0000","last_fullsized":"2023-08-17T00:15:38.827804+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263950+0000","last_change":"2023-08-17T00:15:39.263950+0000","last_active":"2023-08-17T00:15:39.263950+0000","last_peered":"2023-08-17T00:15:39.263950+0000","last_clean":"2023-08-17T00:15:39.263950+0000","last_became_active":"2023-08-17T00:15:39.263509+0000","last_became_peered":"2023-08-17T00:15:39.263509+0000","last_unstale":"2023-08-17T00:15:39.263950+0000","last_undegraded":"2023-08-17T00:15:39.263950+0000","last_fullsized":"2023-08-17T00:15:39.263950+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.30","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278907+0000","last_change":"2023-08-17T00:15:38.822451+0000","last_active":"2023-08-17T00:15:39.278907+0000","last_peered":"2023-08-17T00:15:39.278907+0000","last_clean":"2023-08-17T00:15:39.278907+0000","last_became_active":"2023-08-17T00:15:38.822138+0000","last_became_peered":"2023-08-17T00:15:38.822138+0000","last_unstale":"2023-08-17T00:15:39.278907+0000","last_undegraded":"2023-08-17T00:15:39.278907+0000","last_fullsized":"2023-08-17T00:15:39.278907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278988+0000","last_change":"2023-08-17T00:15:39.278988+0000","last_active":"2023-08-17T00:15:39.278988+0000","last_peered":"2023-08-17T00:15:39.278988+0000","last_clean":"2023-08-17T00:15:39.278988+0000","last_became_active":"2023-08-17T00:15:39.278663+0000","last_became_peered":"2023-08-17T00:15:39.278663+0000","last_unstale":"2023-08-17T00:15:39.278988+0000","last_undegraded":"2023-08-17T00:15:39.278988+0000","last_fullsized":"2023-08-17T00:15:39.278988+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838017+0000","last_change":"2023-08-17T00:15:38.833319+0000","last_active":"2023-08-17T00:15:38.838017+0000","last_peered":"2023-08-17T00:15:38.838017+0000","last_clean":"2023-08-17T00:15:38.838017+0000","last_became_active":"2023-08-17T00:15:38.832811+0000","last_became_peered":"2023-08-17T00:15:38.832811+0000","last_unstale":"2023-08-17T00:15:38.838017+0000","last_undegraded":"2023-08-17T00:15:38.838017+0000","last_fullsized":"2023-08-17T00:15:38.838017+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.275042+0000","last_change":"2023-08-17T00:15:39.275042+0000","last_active":"2023-08-17T00:15:39.275042+0000","last_peered":"2023-08-17T00:15:39.275042+0000","last_clean":"2023-08-17T00:15:39.275042+0000","last_became_active":"2023-08-17T00:15:39.274754+0000","last_became_peered":"2023-08-17T00:15:39.274754+0000","last_unstale":"2023-08-17T00:15:39.275042+0000","last_undegraded":"2023-08-17T00:15:39.275042+0000","last_fullsized":"2023-08-17T00:15:39.275042+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.795130+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270443+0000","last_change":"2023-08-17T00:15:39.270443+0000","last_active":"2023-08-17T00:15:39.270443+0000","last_peered":"2023-08-17T00:15:39.270443+0000","last_clean":"2023-08-17T00:15:39.270443+0000","last_became_active":"2023-08-17T00:15:39.270187+0000","last_became_peered":"2023-08-17T00:15:39.270187+0000","last_unstale":"2023-08-17T00:15:39.270443+0000","last_undegraded":"2023-08-17T00:15:39.270443+0000","last_fullsized":"2023-08-17T00:15:39.270443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.2d","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.256043+0000","last_change":"2023-08-17T00:15:38.833679+0000","last_active":"2023-08-17T00:15:39.256043+0000","last_peered":"2023-08-17T00:15:39.256043+0000","last_clean":"2023-08-17T00:15:39.256043+0000","last_became_active":"2023-08-17T00:15:38.833306+0000","last_became_peered":"2023-08-17T00:15:38.833306+0000","last_unstale":"2023-08-17T00:15:39.256043+0000","last_undegraded":"2023-08-17T00:15:39.256043+0000","last_fullsized":"2023-08-17T00:15:39.256043+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265694+0000","last_change":"2023-08-17T00:15:39.265694+0000","last_active":"2023-08-17T00:15:39.265694+0000","last_peered":"2023-08-17T00:15:39.265694+0000","last_clean":"2023-08-17T00:15:39.265694+0000","last_became_active":"2023-08-17T00:15:39.265446+0000","last_became_peered":"2023-08-17T00:15:39.265446+0000","last_unstale":"2023-08-17T00:15:39.265694+0000","last_undegraded":"2023-08-17T00:15:39.265694+0000","last_fullsized":"2023-08-17T00:15:39.265694+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.831209+0000","last_change":"2023-08-17T00:15:38.824875+0000","last_active":"2023-08-17T00:15:38.831209+0000","last_peered":"2023-08-17T00:15:38.831209+0000","last_clean":"2023-08-17T00:15:38.831209+0000","last_became_active":"2023-08-17T00:15:38.823794+0000","last_became_peered":"2023-08-17T00:15:38.823794+0000","last_unstale":"2023-08-17T00:15:38.831209+0000","last_undegraded":"2023-08-17T00:15:38.831209+0000","last_fullsized":"2023-08-17T00:15:38.831209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258672+0000","last_change":"2023-08-17T00:15:39.258672+0000","last_active":"2023-08-17T00:15:39.258672+0000","last_peered":"2023-08-17T00:15:39.258672+0000","last_clean":"2023-08-17T00:15:39.258672+0000","last_became_active":"2023-08-17T00:15:39.258348+0000","last_became_peered":"2023-08-17T00:15:39.258348+0000","last_unstale":"2023-08-17T00:15:39.258672+0000","last_undegraded":"2023-08-17T00:15:39.258672+0000","last_fullsized":"2023-08-17T00:15:39.258672+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2b","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.251387+0000","last_change":"2023-08-17T00:15:38.836410+0000","last_active":"2023-08-17T00:15:39.251387+0000","last_peered":"2023-08-17T00:15:39.251387+0000","last_clean":"2023-08-17T00:15:39.251387+0000","last_became_active":"2023-08-17T00:15:38.836115+0000","last_became_peered":"2023-08-17T00:15:38.836115+0000","last_unstale":"2023-08-17T00:15:39.251387+0000","last_undegraded":"2023-08-17T00:15:39.251387+0000","last_fullsized":"2023-08-17T00:15:39.251387+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278948+0000","last_change":"2023-08-17T00:15:39.278948+0000","last_active":"2023-08-17T00:15:39.278948+0000","last_peered":"2023-08-17T00:15:39.278948+0000","last_clean":"2023-08-17T00:15:39.278948+0000","last_became_active":"2023-08-17T00:15:39.278648+0000","last_became_peered":"2023-08-17T00:15:39.278648+0000","last_unstale":"2023-08-17T00:15:39.278948+0000","last_undegraded":"2023-08-17T00:15:39.278948+0000","last_fullsized":"2023-08-17T00:15:39.278948+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838531+0000","last_change":"2023-08-17T00:15:38.829424+0000","last_active":"2023-08-17T00:15:38.838531+0000","last_peered":"2023-08-17T00:15:38.838531+0000","last_clean":"2023-08-17T00:15:38.838531+0000","last_became_active":"2023-08-17T00:15:38.829100+0000","last_became_peered":"2023-08-17T00:15:38.829100+0000","last_unstale":"2023-08-17T00:15:38.838531+0000","last_undegraded":"2023-08-17T00:15:38.838531+0000","last_fullsized":"2023-08-17T00:15:38.838531+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259605+0000","last_change":"2023-08-17T00:15:39.259605+0000","last_active":"2023-08-17T00:15:39.259605+0000","last_peered":"2023-08-17T00:15:39.259605+0000","last_clean":"2023-08-17T00:15:39.259605+0000","last_became_active":"2023-08-17T00:15:39.259301+0000","last_became_peered":"2023-08-17T00:15:39.259301+0000","last_unstale":"2023-08-17T00:15:39.259605+0000","last_undegraded":"2023-08-17T00:15:39.259605+0000","last_fullsized":"2023-08-17T00:15:39.259605+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836187+0000","last_change":"2023-08-17T00:15:38.829228+0000","last_active":"2023-08-17T00:15:38.836187+0000","last_peered":"2023-08-17T00:15:38.836187+0000","last_clean":"2023-08-17T00:15:38.836187+0000","last_became_active":"2023-08-17T00:15:38.828949+0000","last_became_peered":"2023-08-17T00:15:38.828949+0000","last_unstale":"2023-08-17T00:15:38.836187+0000","last_undegraded":"2023-08-17T00:15:38.836187+0000","last_fullsized":"2023-08-17T00:15:38.836187+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263142+0000","last_change":"2023-08-17T00:15:39.263142+0000","last_active":"2023-08-17T00:15:39.263142+0000","last_peered":"2023-08-17T00:15:39.263142+0000","last_clean":"2023-08-17T00:15:39.263142+0000","last_became_active":"2023-08-17T00:15:39.262879+0000","last_became_peered":"2023-08-17T00:15:39.262879+0000","last_unstale":"2023-08-17T00:15:39.263142+0000","last_undegraded":"2023-08-17T00:15:39.263142+0000","last_fullsized":"2023-08-17T00:15:39.263142+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838601+0000","last_change":"2023-08-17T00:15:38.830179+0000","last_active":"2023-08-17T00:15:38.838601+0000","last_peered":"2023-08-17T00:15:38.838601+0000","last_clean":"2023-08-17T00:15:38.838601+0000","last_became_active":"2023-08-17T00:15:38.829883+0000","last_became_peered":"2023-08-17T00:15:38.829883+0000","last_unstale":"2023-08-17T00:15:38.838601+0000","last_undegraded":"2023-08-17T00:15:38.838601+0000","last_fullsized":"2023-08-17T00:15:38.838601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265358+0000","last_change":"2023-08-17T00:15:39.265358+0000","last_active":"2023-08-17T00:15:39.265358+0000","last_peered":"2023-08-17T00:15:39.265358+0000","last_clean":"2023-08-17T00:15:39.265358+0000","last_became_active":"2023-08-17T00:15:39.265086+0000","last_became_peered":"2023-08-17T00:15:39.265086+0000","last_unstale":"2023-08-17T00:15:39.265358+0000","last_undegraded":"2023-08-17T00:15:39.265358+0000","last_fullsized":"2023-08-17T00:15:39.265358+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838608+0000","last_change":"2023-08-17T00:15:38.830953+0000","last_active":"2023-08-17T00:15:38.838608+0000","last_peered":"2023-08-17T00:15:38.838608+0000","last_clean":"2023-08-17T00:15:38.838608+0000","last_became_active":"2023-08-17T00:15:38.830693+0000","last_became_peered":"2023-08-17T00:15:38.830693+0000","last_unstale":"2023-08-17T00:15:38.838608+0000","last_undegraded":"2023-08-17T00:15:38.838608+0000","last_fullsized":"2023-08-17T00:15:38.838608+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263466+0000","last_change":"2023-08-17T00:15:39.263466+0000","last_active":"2023-08-17T00:15:39.263466+0000","last_peered":"2023-08-17T00:15:39.263466+0000","last_clean":"2023-08-17T00:15:39.263466+0000","last_became_active":"2023-08-17T00:15:39.263186+0000","last_became_peered":"2023-08-17T00:15:39.263186+0000","last_unstale":"2023-08-17T00:15:39.263466+0000","last_undegraded":"2023-08-17T00:15:39.263466+0000","last_fullsized":"2023-08-17T00:15:39.263466+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836259+0000","last_change":"2023-08-17T00:15:38.830283+0000","last_active":"2023-08-17T00:15:38.836259+0000","last_peered":"2023-08-17T00:15:38.836259+0000","last_clean":"2023-08-17T00:15:38.836259+0000","last_became_active":"2023-08-17T00:15:38.827198+0000","last_became_peered":"2023-08-17T00:15:38.827198+0000","last_unstale":"2023-08-17T00:15:38.836259+0000","last_undegraded":"2023-08-17T00:15:38.836259+0000","last_fullsized":"2023-08-17T00:15:38.836259+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262701+0000","last_change":"2023-08-17T00:15:39.262701+0000","last_active":"2023-08-17T00:15:39.262701+0000","last_peered":"2023-08-17T00:15:39.262701+0000","last_clean":"2023-08-17T00:15:39.262701+0000","last_became_active":"2023-08-17T00:15:39.262085+0000","last_became_peered":"2023-08-17T00:15:39.262085+0000","last_unstale":"2023-08-17T00:15:39.262701+0000","last_undegraded":"2023-08-17T00:15:39.262701+0000","last_fullsized":"2023-08-17T00:15:39.262701+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.834604+0000","last_change":"2023-08-17T00:15:38.825695+0000","last_active":"2023-08-17T00:15:38.834604+0000","last_peered":"2023-08-17T00:15:38.834604+0000","last_clean":"2023-08-17T00:15:38.834604+0000","last_became_active":"2023-08-17T00:15:38.825391+0000","last_became_peered":"2023-08-17T00:15:38.825391+0000","last_unstale":"2023-08-17T00:15:38.834604+0000","last_undegraded":"2023-08-17T00:15:38.834604+0000","last_fullsized":"2023-08-17T00:15:38.834604+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262729+0000","last_change":"2023-08-17T00:15:39.262729+0000","last_active":"2023-08-17T00:15:39.262729+0000","last_peered":"2023-08-17T00:15:39.262729+0000","last_clean":"2023-08-17T00:15:39.262729+0000","last_became_active":"2023-08-17T00:15:39.262441+0000","last_became_peered":"2023-08-17T00:15:39.262441+0000","last_unstale":"2023-08-17T00:15:39.262729+0000","last_undegraded":"2023-08-17T00:15:39.262729+0000","last_fullsized":"2023-08-17T00:15:39.262729+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836084+0000","last_change":"2023-08-17T00:15:38.831869+0000","last_active":"2023-08-17T00:15:38.836084+0000","last_peered":"2023-08-17T00:15:38.836084+0000","last_clean":"2023-08-17T00:15:38.836084+0000","last_became_active":"2023-08-17T00:15:38.831558+0000","last_became_peered":"2023-08-17T00:15:38.831558+0000","last_unstale":"2023-08-17T00:15:38.836084+0000","last_undegraded":"2023-08-17T00:15:38.836084+0000","last_fullsized":"2023-08-17T00:15:38.836084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:15:38.788461+0000","last_change":"2023-08-17T00:15:38.788461+0000","last_active":"2023-08-17T00:15:38.788461+0000","last_peered":"2023-08-17T00:15:38.788461+0000","last_clean":"2023-08-17T00:15:38.788461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:38.788461+0000","last_undegraded":"2023-08-17T00:15:38.788461+0000","last_fullsized":"2023-08-17T00:15:38.788461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.833434+0000","last_change":"2023-08-17T00:15:38.828386+0000","last_active":"2023-08-17T00:15:38.833434+0000","last_peered":"2023-08-17T00:15:38.833434+0000","last_clean":"2023-08-17T00:15:38.833434+0000","last_became_active":"2023-08-17T00:15:38.828103+0000","last_became_peered":"2023-08-17T00:15:38.828103+0000","last_unstale":"2023-08-17T00:15:38.833434+0000","last_undegraded":"2023-08-17T00:15:38.833434+0000","last_fullsized":"2023-08-17T00:15:38.833434+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.266813+0000","last_change":"2023-08-17T00:15:39.266813+0000","last_active":"2023-08-17T00:15:39.266813+0000","last_peered":"2023-08-17T00:15:39.266813+0000","last_clean":"2023-08-17T00:15:39.266813+0000","last_became_active":"2023-08-17T00:15:39.265912+0000","last_became_peered":"2023-08-17T00:15:39.265912+0000","last_unstale":"2023-08-17T00:15:39.266813+0000","last_undegraded":"2023-08-17T00:15:39.266813+0000","last_fullsized":"2023-08-17T00:15:39.266813+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835327+0000","last_change":"2023-08-17T00:15:38.823512+0000","last_active":"2023-08-17T00:15:38.835327+0000","last_peered":"2023-08-17T00:15:38.835327+0000","last_clean":"2023-08-17T00:15:38.835327+0000","last_became_active":"2023-08-17T00:15:38.823213+0000","last_became_peered":"2023-08-17T00:15:38.823213+0000","last_unstale":"2023-08-17T00:15:38.835327+0000","last_undegraded":"2023-08-17T00:15:38.835327+0000","last_fullsized":"2023-08-17T00:15:38.835327+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.272476+0000","last_change":"2023-08-17T00:15:39.272476+0000","last_active":"2023-08-17T00:15:39.272476+0000","last_peered":"2023-08-17T00:15:39.272476+0000","last_clean":"2023-08-17T00:15:39.272476+0000","last_became_active":"2023-08-17T00:15:39.272158+0000","last_became_peered":"2023-08-17T00:15:39.272158+0000","last_unstale":"2023-08-17T00:15:39.272476+0000","last_undegraded":"2023-08-17T00:15:39.272476+0000","last_fullsized":"2023-08-17T00:15:39.272476+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835644+0000","last_change":"2023-08-17T00:15:38.831197+0000","last_active":"2023-08-17T00:15:38.835644+0000","last_peered":"2023-08-17T00:15:38.835644+0000","last_clean":"2023-08-17T00:15:38.835644+0000","last_became_active":"2023-08-17T00:15:38.830940+0000","last_became_peered":"2023-08-17T00:15:38.830940+0000","last_unstale":"2023-08-17T00:15:38.835644+0000","last_undegraded":"2023-08-17T00:15:38.835644+0000","last_fullsized":"2023-08-17T00:15:38.835644+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269892+0000","last_change":"2023-08-17T00:15:39.269892+0000","last_active":"2023-08-17T00:15:39.269892+0000","last_peered":"2023-08-17T00:15:39.269892+0000","last_clean":"2023-08-17T00:15:39.269892+0000","last_became_active":"2023-08-17T00:15:39.269045+0000","last_became_peered":"2023-08-17T00:15:39.269045+0000","last_unstale":"2023-08-17T00:15:39.269892+0000","last_undegraded":"2023-08-17T00:15:39.269892+0000","last_fullsized":"2023-08-17T00:15:39.269892+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838100+0000","last_change":"2023-08-17T00:15:38.834273+0000","last_active":"2023-08-17T00:15:38.838100+0000","last_peered":"2023-08-17T00:15:38.838100+0000","last_clean":"2023-08-17T00:15:38.838100+0000","last_became_active":"2023-08-17T00:15:38.833616+0000","last_became_peered":"2023-08-17T00:15:38.833616+0000","last_unstale":"2023-08-17T00:15:38.838100+0000","last_undegraded":"2023-08-17T00:15:38.838100+0000","last_fullsized":"2023-08-17T00:15:38.838100+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262815+0000","last_change":"2023-08-17T00:15:39.262815+0000","last_active":"2023-08-17T00:15:39.262815+0000","last_peered":"2023-08-17T00:15:39.262815+0000","last_clean":"2023-08-17T00:15:39.262815+0000","last_became_active":"2023-08-17T00:15:39.262531+0000","last_became_peered":"2023-08-17T00:15:39.262531+0000","last_unstale":"2023-08-17T00:15:39.262815+0000","last_undegraded":"2023-08-17T00:15:39.262815+0000","last_fullsized":"2023-08-17T00:15:39.262815+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.248045+0000","last_change":"2023-08-17T00:15:38.829700+0000","last_active":"2023-08-17T00:15:39.248045+0000","last_peered":"2023-08-17T00:15:39.248045+0000","last_clean":"2023-08-17T00:15:39.248045+0000","last_became_active":"2023-08-17T00:15:38.829204+0000","last_became_peered":"2023-08-17T00:15:38.829204+0000","last_unstale":"2023-08-17T00:15:39.248045+0000","last_undegraded":"2023-08-17T00:15:39.248045+0000","last_fullsized":"2023-08-17T00:15:39.248045+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262674+0000","last_change":"2023-08-17T00:15:39.262674+0000","last_active":"2023-08-17T00:15:39.262674+0000","last_peered":"2023-08-17T00:15:39.262674+0000","last_clean":"2023-08-17T00:15:39.262674+0000","last_became_active":"2023-08-17T00:15:39.262377+0000","last_became_peered":"2023-08-17T00:15:39.262377+0000","last_unstale":"2023-08-17T00:15:39.262674+0000","last_undegraded":"2023-08-17T00:15:39.262674+0000","last_fullsized":"2023-08-17T00:15:39.262674+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.794336+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269800+0000","last_change":"2023-08-17T00:15:39.269800+0000","last_active":"2023-08-17T00:15:39.269800+0000","last_peered":"2023-08-17T00:15:39.269800+0000","last_clean":"2023-08-17T00:15:39.269800+0000","last_became_active":"2023-08-17T00:15:39.269471+0000","last_became_peered":"2023-08-17T00:15:39.269471+0000","last_unstale":"2023-08-17T00:15:39.269800+0000","last_undegraded":"2023-08-17T00:15:39.269800+0000","last_fullsized":"2023-08-17T00:15:39.269800+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269029+0000","last_change":"2023-08-17T00:15:38.818920+0000","last_active":"2023-08-17T00:15:39.269029+0000","last_peered":"2023-08-17T00:15:39.269029+0000","last_clean":"2023-08-17T00:15:39.269029+0000","last_became_active":"2023-08-17T00:15:38.818600+0000","last_became_peered":"2023-08-17T00:15:38.818600+0000","last_unstale":"2023-08-17T00:15:39.269029+0000","last_undegraded":"2023-08-17T00:15:39.269029+0000","last_fullsized":"2023-08-17T00:15:39.269029+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258138+0000","last_change":"2023-08-17T00:15:39.258138+0000","last_active":"2023-08-17T00:15:39.258138+0000","last_peered":"2023-08-17T00:15:39.258138+0000","last_clean":"2023-08-17T00:15:39.258138+0000","last_became_active":"2023-08-17T00:15:39.257857+0000","last_became_peered":"2023-08-17T00:15:39.257857+0000","last_unstale":"2023-08-17T00:15:39.258138+0000","last_undegraded":"2023-08-17T00:15:39.258138+0000","last_fullsized":"2023-08-17T00:15:39.258138+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838006+0000","last_change":"2023-08-17T00:15:38.833489+0000","last_active":"2023-08-17T00:15:38.838006+0000","last_peered":"2023-08-17T00:15:38.838006+0000","last_clean":"2023-08-17T00:15:38.838006+0000","last_became_active":"2023-08-17T00:15:38.832967+0000","last_became_peered":"2023-08-17T00:15:38.832967+0000","last_unstale":"2023-08-17T00:15:38.838006+0000","last_undegraded":"2023-08-17T00:15:38.838006+0000","last_fullsized":"2023-08-17T00:15:38.838006+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278632+0000","last_change":"2023-08-17T00:15:39.278632+0000","last_active":"2023-08-17T00:15:39.278632+0000","last_peered":"2023-08-17T00:15:39.278632+0000","last_clean":"2023-08-17T00:15:39.278632+0000","last_became_active":"2023-08-17T00:15:39.278286+0000","last_became_peered":"2023-08-17T00:15:39.278286+0000","last_unstale":"2023-08-17T00:15:39.278632+0000","last_undegraded":"2023-08-17T00:15:39.278632+0000","last_fullsized":"2023-08-17T00:15:39.278632+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838077+0000","last_change":"2023-08-17T00:15:38.834166+0000","last_active":"2023-08-17T00:15:38.838077+0000","last_peered":"2023-08-17T00:15:38.838077+0000","last_clean":"2023-08-17T00:15:38.838077+0000","last_became_active":"2023-08-17T00:15:38.833754+0000","last_became_peered":"2023-08-17T00:15:38.833754+0000","last_unstale":"2023-08-17T00:15:38.838077+0000","last_undegraded":"2023-08-17T00:15:38.838077+0000","last_fullsized":"2023-08-17T00:15:38.838077+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.271102+0000","last_change":"2023-08-17T00:15:39.271102+0000","last_active":"2023-08-17T00:15:39.271102+0000","last_peered":"2023-08-17T00:15:39.271102+0000","last_clean":"2023-08-17T00:15:39.271102+0000","last_became_active":"2023-08-17T00:15:39.270802+0000","last_became_peered":"2023-08-17T00:15:39.270802+0000","last_unstale":"2023-08-17T00:15:39.271102+0000","last_undegraded":"2023-08-17T00:15:39.271102+0000","last_fullsized":"2023-08-17T00:15:39.271102+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.793899+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264624+0000","last_change":"2023-08-17T00:15:39.264624+0000","last_active":"2023-08-17T00:15:39.264624+0000","last_peered":"2023-08-17T00:15:39.264624+0000","last_clean":"2023-08-17T00:15:39.264624+0000","last_became_active":"2023-08-17T00:15:39.264019+0000","last_became_peered":"2023-08-17T00:15:39.264019+0000","last_unstale":"2023-08-17T00:15:39.264624+0000","last_undegraded":"2023-08-17T00:15:39.264624+0000","last_fullsized":"2023-08-17T00:15:39.264624+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.794248+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.257681+0000","last_change":"2023-08-17T00:15:39.257681+0000","last_active":"2023-08-17T00:15:39.257681+0000","last_peered":"2023-08-17T00:15:39.257681+0000","last_clean":"2023-08-17T00:15:39.257681+0000","last_became_active":"2023-08-17T00:15:39.257378+0000","last_became_peered":"2023-08-17T00:15:39.257378+0000","last_unstale":"2023-08-17T00:15:39.257681+0000","last_undegraded":"2023-08-17T00:15:39.257681+0000","last_fullsized":"2023-08-17T00:15:39.257681+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.830550+0000","last_change":"2023-08-17T00:15:38.828682+0000","last_active":"2023-08-17T00:15:38.830550+0000","last_peered":"2023-08-17T00:15:38.830550+0000","last_clean":"2023-08-17T00:15:38.830550+0000","last_became_active":"2023-08-17T00:15:38.828362+0000","last_became_peered":"2023-08-17T00:15:38.828362+0000","last_unstale":"2023-08-17T00:15:38.830550+0000","last_undegraded":"2023-08-17T00:15:38.830550+0000","last_fullsized":"2023-08-17T00:15:38.830550+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:15:38.788461+0000","last_change":"2023-08-17T00:15:38.788461+0000","last_active":"2023-08-17T00:15:38.788461+0000","last_peered":"2023-08-17T00:15:38.788461+0000","last_clean":"2023-08-17T00:15:38.788461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:38.788461+0000","last_undegraded":"2023-08-17T00:15:38.788461+0000","last_fullsized":"2023-08-17T00:15:38.788461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.797020+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263805+0000","last_change":"2023-08-17T00:15:39.263805+0000","last_active":"2023-08-17T00:15:39.263805+0000","last_peered":"2023-08-17T00:15:39.263805+0000","last_clean":"2023-08-17T00:15:39.263805+0000","last_became_active":"2023-08-17T00:15:39.263544+0000","last_became_peered":"2023-08-17T00:15:39.263544+0000","last_unstale":"2023-08-17T00:15:39.263805+0000","last_undegraded":"2023-08-17T00:15:39.263805+0000","last_fullsized":"2023-08-17T00:15:39.263805+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269733+0000","last_change":"2023-08-17T00:15:38.826155+0000","last_active":"2023-08-17T00:15:39.269733+0000","last_peered":"2023-08-17T00:15:39.269733+0000","last_clean":"2023-08-17T00:15:39.269733+0000","last_became_active":"2023-08-17T00:15:38.825823+0000","last_became_peered":"2023-08-17T00:15:38.825823+0000","last_unstale":"2023-08-17T00:15:39.269733+0000","last_undegraded":"2023-08-17T00:15:39.269733+0000","last_fullsized":"2023-08-17T00:15:39.269733+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262871+0000","last_change":"2023-08-17T00:15:39.262871+0000","last_active":"2023-08-17T00:15:39.262871+0000","last_peered":"2023-08-17T00:15:39.262871+0000","last_clean":"2023-08-17T00:15:39.262871+0000","last_became_active":"2023-08-17T00:15:39.262450+0000","last_became_peered":"2023-08-17T00:15:39.262450+0000","last_unstale":"2023-08-17T00:15:39.262871+0000","last_undegraded":"2023-08-17T00:15:39.262871+0000","last_fullsized":"2023-08-17T00:15:39.262871+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.830560+0000","last_change":"2023-08-17T00:15:38.828554+0000","last_active":"2023-08-17T00:15:38.830560+0000","last_peered":"2023-08-17T00:15:38.830560+0000","last_clean":"2023-08-17T00:15:38.830560+0000","last_became_active":"2023-08-17T00:15:38.828271+0000","last_became_peered":"2023-08-17T00:15:38.828271+0000","last_unstale":"2023-08-17T00:15:38.830560+0000","last_undegraded":"2023-08-17T00:15:38.830560+0000","last_fullsized":"2023-08-17T00:15:38.830560+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270321+0000","last_change":"2023-08-17T00:15:39.270321+0000","last_active":"2023-08-17T00:15:39.270321+0000","last_peered":"2023-08-17T00:15:39.270321+0000","last_clean":"2023-08-17T00:15:39.270321+0000","last_became_active":"2023-08-17T00:15:39.270065+0000","last_became_peered":"2023-08-17T00:15:39.270065+0000","last_unstale":"2023-08-17T00:15:39.270321+0000","last_undegraded":"2023-08-17T00:15:39.270321+0000","last_fullsized":"2023-08-17T00:15:39.270321+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.796422+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259258+0000","last_change":"2023-08-17T00:15:39.259258+0000","last_active":"2023-08-17T00:15:39.259258+0000","last_peered":"2023-08-17T00:15:39.259258+0000","last_clean":"2023-08-17T00:15:39.259258+0000","last_became_active":"2023-08-17T00:15:39.258978+0000","last_became_peered":"2023-08-17T00:15:39.258978+0000","last_unstale":"2023-08-17T00:15:39.259258+0000","last_undegraded":"2023-08-17T00:15:39.259258+0000","last_fullsized":"2023-08-17T00:15:39.259258+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.b","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.247222+0000","last_change":"2023-08-17T00:15:38.827547+0000","last_active":"2023-08-17T00:15:39.247222+0000","last_peered":"2023-08-17T00:15:39.247222+0000","last_clean":"2023-08-17T00:15:39.247222+0000","last_became_active":"2023-08-17T00:15:38.825343+0000","last_became_peered":"2023-08-17T00:15:38.825343+0000","last_unstale":"2023-08-17T00:15:39.247222+0000","last_undegraded":"2023-08-17T00:15:39.247222+0000","last_fullsized":"2023-08-17T00:15:39.247222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264631+0000","last_change":"2023-08-17T00:15:39.264631+0000","last_active":"2023-08-17T00:15:39.264631+0000","last_peered":"2023-08-17T00:15:39.264631+0000","last_clean":"2023-08-17T00:15:39.264631+0000","last_became_active":"2023-08-17T00:15:39.264376+0000","last_became_peered":"2023-08-17T00:15:39.264376+0000","last_unstale":"2023-08-17T00:15:39.264631+0000","last_undegraded":"2023-08-17T00:15:39.264631+0000","last_fullsized":"2023-08-17T00:15:39.264631+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835895+0000","last_change":"2023-08-17T00:15:38.831149+0000","last_active":"2023-08-17T00:15:38.835895+0000","last_peered":"2023-08-17T00:15:38.835895+0000","last_clean":"2023-08-17T00:15:38.835895+0000","last_became_active":"2023-08-17T00:15:38.830745+0000","last_became_peered":"2023-08-17T00:15:38.830745+0000","last_unstale":"2023-08-17T00:15:38.835895+0000","last_undegraded":"2023-08-17T00:15:38.835895+0000","last_fullsized":"2023-08-17T00:15:38.835895+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265977+0000","last_change":"2023-08-17T00:15:39.265977+0000","last_active":"2023-08-17T00:15:39.265977+0000","last_peered":"2023-08-17T00:15:39.265977+0000","last_clean":"2023-08-17T00:15:39.265977+0000","last_became_active":"2023-08-17T00:15:39.265231+0000","last_became_peered":"2023-08-17T00:15:39.265231+0000","last_unstale":"2023-08-17T00:15:39.265977+0000","last_undegraded":"2023-08-17T00:15:39.265977+0000","last_fullsized":"2023-08-17T00:15:39.265977+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.832724+0000","last_change":"2023-08-17T00:15:38.825424+0000","last_active":"2023-08-17T00:15:38.832724+0000","last_peered":"2023-08-17T00:15:38.832724+0000","last_clean":"2023-08-17T00:15:38.832724+0000","last_became_active":"2023-08-17T00:15:38.825134+0000","last_became_peered":"2023-08-17T00:15:38.825134+0000","last_unstale":"2023-08-17T00:15:38.832724+0000","last_undegraded":"2023-08-17T00:15:38.832724+0000","last_fullsized":"2023-08-17T00:15:38.832724+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264276+0000","last_change":"2023-08-17T00:15:39.264276+0000","last_active":"2023-08-17T00:15:39.264276+0000","last_peered":"2023-08-17T00:15:39.264276+0000","last_clean":"2023-08-17T00:15:39.264276+0000","last_became_active":"2023-08-17T00:15:39.257258+0000","last_became_peered":"2023-08-17T00:15:39.257258+0000","last_unstale":"2023-08-17T00:15:39.264276+0000","last_undegraded":"2023-08-17T00:15:39.264276+0000","last_fullsized":"2023-08-17T00:15:39.264276+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.831374+0000","last_change":"2023-08-17T00:15:38.824508+0000","last_active":"2023-08-17T00:15:38.831374+0000","last_peered":"2023-08-17T00:15:38.831374+0000","last_clean":"2023-08-17T00:15:38.831374+0000","last_became_active":"2023-08-17T00:15:38.824195+0000","last_became_peered":"2023-08-17T00:15:38.824195+0000","last_unstale":"2023-08-17T00:15:38.831374+0000","last_undegraded":"2023-08-17T00:15:38.831374+0000","last_fullsized":"2023-08-17T00:15:38.831374+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.267809+0000","last_change":"2023-08-17T00:15:39.267809+0000","last_active":"2023-08-17T00:15:39.267809+0000","last_peered":"2023-08-17T00:15:39.267809+0000","last_clean":"2023-08-17T00:15:39.267809+0000","last_became_active":"2023-08-17T00:15:39.267532+0000","last_became_peered":"2023-08-17T00:15:39.267532+0000","last_unstale":"2023-08-17T00:15:39.267809+0000","last_undegraded":"2023-08-17T00:15:39.267809+0000","last_fullsized":"2023-08-17T00:15:39.267809+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.796095+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:15:38.788461+0000","last_change":"2023-08-17T00:15:38.788461+0000","last_active":"2023-08-17T00:15:38.788461+0000","last_peered":"2023-08-17T00:15:38.788461+0000","last_clean":"2023-08-17T00:15:38.788461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:38.788461+0000","last_undegraded":"2023-08-17T00:15:38.788461+0000","last_fullsized":"2023-08-17T00:15:38.788461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836241+0000","last_change":"2023-08-17T00:15:38.829827+0000","last_active":"2023-08-17T00:15:38.836241+0000","last_peered":"2023-08-17T00:15:38.836241+0000","last_clean":"2023-08-17T00:15:38.836241+0000","last_became_active":"2023-08-17T00:15:38.825774+0000","last_became_peered":"2023-08-17T00:15:38.825774+0000","last_unstale":"2023-08-17T00:15:38.836241+0000","last_undegraded":"2023-08-17T00:15:38.836241+0000","last_fullsized":"2023-08-17T00:15:38.836241+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:15:38.788461+0000","last_change":"2023-08-17T00:15:38.788461+0000","last_active":"2023-08-17T00:15:38.788461+0000","last_peered":"2023-08-17T00:15:38.788461+0000","last_clean":"2023-08-17T00:15:38.788461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:38.788461+0000","last_undegraded":"2023-08-17T00:15:38.788461+0000","last_fullsized":"2023-08-17T00:15:38.788461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.794207+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259401+0000","last_change":"2023-08-17T00:15:39.259401+0000","last_active":"2023-08-17T00:15:39.259401+0000","last_peered":"2023-08-17T00:15:39.259401+0000","last_clean":"2023-08-17T00:15:39.259401+0000","last_became_active":"2023-08-17T00:15:39.259076+0000","last_became_peered":"2023-08-17T00:15:39.259076+0000","last_unstale":"2023-08-17T00:15:39.259401+0000","last_undegraded":"2023-08-17T00:15:39.259401+0000","last_fullsized":"2023-08-17T00:15:39.259401+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:15:37.777219+0000","last_change":"2023-08-17T00:15:37.795923+0000","last_active":"2023-08-17T00:15:37.777219+0000","last_peered":"2023-08-17T00:15:37.777219+0000","last_clean":"2023-08-17T00:15:37.777219+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:37.777219+0000","last_undegraded":"2023-08-17T00:15:37.777219+0000","last_fullsized":"2023-08-17T00:15:37.777219+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.257589+0000","last_change":"2023-08-17T00:15:39.257589+0000","last_active":"2023-08-17T00:15:39.257589+0000","last_peered":"2023-08-17T00:15:39.257589+0000","last_clean":"2023-08-17T00:15:39.257589+0000","last_became_active":"2023-08-17T00:15:39.257286+0000","last_became_peered":"2023-08-17T00:15:39.257286+0000","last_unstale":"2023-08-17T00:15:39.257589+0000","last_undegraded":"2023-08-17T00:15:39.257589+0000","last_fullsized":"2023-08-17T00:15:39.257589+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.830633+0000","last_change":"2023-08-17T00:15:38.821556+0000","last_active":"2023-08-17T00:15:38.830633+0000","last_peered":"2023-08-17T00:15:38.830633+0000","last_clean":"2023-08-17T00:15:38.830633+0000","last_became_active":"2023-08-17T00:15:38.821250+0000","last_became_peered":"2023-08-17T00:15:38.821250+0000","last_unstale":"2023-08-17T00:15:38.830633+0000","last_undegraded":"2023-08-17T00:15:38.830633+0000","last_fullsized":"2023-08-17T00:15:38.830633+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.268355+0000","last_change":"2023-08-17T00:15:39.268355+0000","last_active":"2023-08-17T00:15:39.268355+0000","last_peered":"2023-08-17T00:15:39.268355+0000","last_clean":"2023-08-17T00:15:39.268355+0000","last_became_active":"2023-08-17T00:15:39.267931+0000","last_became_peered":"2023-08-17T00:15:39.267931+0000","last_unstale":"2023-08-17T00:15:39.268355+0000","last_undegraded":"2023-08-17T00:15:39.268355+0000","last_fullsized":"2023-08-17T00:15:39.268355+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838125+0000","last_change":"2023-08-17T00:15:38.834288+0000","last_active":"2023-08-17T00:15:38.838125+0000","last_peered":"2023-08-17T00:15:38.838125+0000","last_clean":"2023-08-17T00:15:38.838125+0000","last_became_active":"2023-08-17T00:15:38.833986+0000","last_became_peered":"2023-08-17T00:15:38.833986+0000","last_unstale":"2023-08-17T00:15:38.838125+0000","last_undegraded":"2023-08-17T00:15:38.838125+0000","last_fullsized":"2023-08-17T00:15:38.838125+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:15:38.788461+0000","last_change":"2023-08-17T00:15:38.788461+0000","last_active":"2023-08-17T00:15:38.788461+0000","last_peered":"2023-08-17T00:15:38.788461+0000","last_clean":"2023-08-17T00:15:38.788461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:15:38.788461+0000","last_undegraded":"2023-08-17T00:15:38.788461+0000","last_fullsized":"2023-08-17T00:15:38.788461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835569+0000","last_change":"2023-08-17T00:15:38.830059+0000","last_active":"2023-08-17T00:15:38.835569+0000","last_peered":"2023-08-17T00:15:38.835569+0000","last_clean":"2023-08-17T00:15:38.835569+0000","last_became_active":"2023-08-17T00:15:38.829711+0000","last_became_peered":"2023-08-17T00:15:38.829711+0000","last_unstale":"2023-08-17T00:15:38.835569+0000","last_undegraded":"2023-08-17T00:15:38.835569+0000","last_fullsized":"2023-08-17T00:15:38.835569+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264495+0000","last_change":"2023-08-17T00:15:39.264495+0000","last_active":"2023-08-17T00:15:39.264495+0000","last_peered":"2023-08-17T00:15:39.264495+0000","last_clean":"2023-08-17T00:15:39.264495+0000","last_became_active":"2023-08-17T00:15:39.264242+0000","last_became_peered":"2023-08-17T00:15:39.264242+0000","last_unstale":"2023-08-17T00:15:39.264495+0000","last_undegraded":"2023-08-17T00:15:39.264495+0000","last_fullsized":"2023-08-17T00:15:39.264495+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.831714+0000","last_change":"2023-08-17T00:15:38.826420+0000","last_active":"2023-08-17T00:15:38.831714+0000","last_peered":"2023-08-17T00:15:38.831714+0000","last_clean":"2023-08-17T00:15:38.831714+0000","last_became_active":"2023-08-17T00:15:38.826127+0000","last_became_peered":"2023-08-17T00:15:38.826127+0000","last_unstale":"2023-08-17T00:15:38.831714+0000","last_undegraded":"2023-08-17T00:15:38.831714+0000","last_fullsized":"2023-08-17T00:15:38.831714+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.261259+0000","last_change":"2023-08-17T00:15:39.261259+0000","last_active":"2023-08-17T00:15:39.261259+0000","last_peered":"2023-08-17T00:15:39.261259+0000","last_clean":"2023-08-17T00:15:39.261259+0000","last_became_active":"2023-08-17T00:15:39.260994+0000","last_became_peered":"2023-08-17T00:15:39.260994+0000","last_unstale":"2023-08-17T00:15:39.261259+0000","last_undegraded":"2023-08-17T00:15:39.261259+0000","last_fullsized":"2023-08-17T00:15:39.261259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.828952+0000","last_change":"2023-08-17T00:15:38.820194+0000","last_active":"2023-08-17T00:15:38.828952+0000","last_peered":"2023-08-17T00:15:38.828952+0000","last_clean":"2023-08-17T00:15:38.828952+0000","last_became_active":"2023-08-17T00:15:38.819798+0000","last_became_peered":"2023-08-17T00:15:38.819798+0000","last_unstale":"2023-08-17T00:15:38.828952+0000","last_undegraded":"2023-08-17T00:15:38.828952+0000","last_fullsized":"2023-08-17T00:15:38.828952+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.813746+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:15:38.813746+0000","last_peered":"2023-08-17T00:15:38.813746+0000","last_clean":"2023-08-17T00:15:38.813746+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:15:38.813746+0000","last_undegraded":"2023-08-17T00:15:38.813746+0000","last_fullsized":"2023-08-17T00:15:38.813746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258171+0000","last_change":"2023-08-17T00:15:39.258171+0000","last_active":"2023-08-17T00:15:39.258171+0000","last_peered":"2023-08-17T00:15:39.258171+0000","last_clean":"2023-08-17T00:15:39.258171+0000","last_became_active":"2023-08-17T00:15:39.257780+0000","last_became_peered":"2023-08-17T00:15:39.257780+0000","last_unstale":"2023-08-17T00:15:39.258171+0000","last_undegraded":"2023-08-17T00:15:39.258171+0000","last_fullsized":"2023-08-17T00:15:39.258171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.13","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.247169+0000","last_change":"2023-08-17T00:15:38.817521+0000","last_active":"2023-08-17T00:15:39.247169+0000","last_peered":"2023-08-17T00:15:39.247169+0000","last_clean":"2023-08-17T00:15:39.247169+0000","last_became_active":"2023-08-17T00:15:38.817201+0000","last_became_peered":"2023-08-17T00:15:38.817201+0000","last_unstale":"2023-08-17T00:15:39.247169+0000","last_undegraded":"2023-08-17T00:15:39.247169+0000","last_fullsized":"2023-08-17T00:15:39.247169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":154,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-08-17T00:15:34.774112+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:15:34.774112+0000","last_peered":"2023-08-17T00:15:34.774112+0000","last_clean":"2023-08-17T00:15:34.774112+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:15:34.774112+0000","last_undegraded":"2023-08-17T00:15:34.774112+0000","last_fullsized":"2023-08-17T00:15:34.774112+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259904+0000","last_change":"2023-08-17T00:15:39.259904+0000","last_active":"2023-08-17T00:15:39.259904+0000","last_peered":"2023-08-17T00:15:39.259904+0000","last_clean":"2023-08-17T00:15:39.259904+0000","last_became_active":"2023-08-17T00:15:39.259639+0000","last_became_peered":"2023-08-17T00:15:39.259639+0000","last_unstale":"2023-08-17T00:15:39.259904+0000","last_undegraded":"2023-08-17T00:15:39.259904+0000","last_fullsized":"2023-08-17T00:15:39.259904+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.10","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.266876+0000","last_change":"2023-08-17T00:15:38.828999+0000","last_active":"2023-08-17T00:15:39.266876+0000","last_peered":"2023-08-17T00:15:39.266876+0000","last_clean":"2023-08-17T00:15:39.266876+0000","last_became_active":"2023-08-17T00:15:38.828674+0000","last_became_peered":"2023-08-17T00:15:38.828674+0000","last_unstale":"2023-08-17T00:15:39.266876+0000","last_undegraded":"2023-08-17T00:15:39.266876+0000","last_fullsized":"2023-08-17T00:15:39.266876+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.811315+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:15:38.811315+0000","last_peered":"2023-08-17T00:15:38.811315+0000","last_clean":"2023-08-17T00:15:38.811315+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:15:38.811315+0000","last_undegraded":"2023-08-17T00:15:38.811315+0000","last_fullsized":"2023-08-17T00:15:38.811315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258865+0000","last_change":"2023-08-17T00:15:39.258865+0000","last_active":"2023-08-17T00:15:39.258865+0000","last_peered":"2023-08-17T00:15:39.258865+0000","last_clean":"2023-08-17T00:15:39.258865+0000","last_became_active":"2023-08-17T00:15:39.258564+0000","last_became_peered":"2023-08-17T00:15:39.258564+0000","last_unstale":"2023-08-17T00:15:39.258865+0000","last_undegraded":"2023-08-17T00:15:39.258865+0000","last_fullsized":"2023-08-17T00:15:39.258865+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835383+0000","last_change":"2023-08-17T00:15:38.824255+0000","last_active":"2023-08-17T00:15:38.835383+0000","last_peered":"2023-08-17T00:15:38.835383+0000","last_clean":"2023-08-17T00:15:38.835383+0000","last_became_active":"2023-08-17T00:15:38.823980+0000","last_became_peered":"2023-08-17T00:15:38.823980+0000","last_unstale":"2023-08-17T00:15:38.835383+0000","last_undegraded":"2023-08-17T00:15:38.835383+0000","last_fullsized":"2023-08-17T00:15:38.835383+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.802652+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:15:38.802652+0000","last_peered":"2023-08-17T00:15:38.802652+0000","last_clean":"2023-08-17T00:15:38.802652+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:15:38.802652+0000","last_undegraded":"2023-08-17T00:15:38.802652+0000","last_fullsized":"2023-08-17T00:15:38.802652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.268884+0000","last_change":"2023-08-17T00:15:39.268884+0000","last_active":"2023-08-17T00:15:39.268884+0000","last_peered":"2023-08-17T00:15:39.268884+0000","last_clean":"2023-08-17T00:15:39.268884+0000","last_became_active":"2023-08-17T00:15:39.268620+0000","last_became_peered":"2023-08-17T00:15:39.268620+0000","last_unstale":"2023-08-17T00:15:39.268884+0000","last_undegraded":"2023-08-17T00:15:39.268884+0000","last_fullsized":"2023-08-17T00:15:39.268884+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836636+0000","last_change":"2023-08-17T00:15:38.830084+0000","last_active":"2023-08-17T00:15:38.836636+0000","last_peered":"2023-08-17T00:15:38.836636+0000","last_clean":"2023-08-17T00:15:38.836636+0000","last_became_active":"2023-08-17T00:15:38.829801+0000","last_became_peered":"2023-08-17T00:15:38.829801+0000","last_unstale":"2023-08-17T00:15:38.836636+0000","last_undegraded":"2023-08-17T00:15:38.836636+0000","last_fullsized":"2023-08-17T00:15:38.836636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.808900+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:15:38.808900+0000","last_peered":"2023-08-17T00:15:38.808900+0000","last_clean":"2023-08-17T00:15:38.808900+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:15:38.808900+0000","last_undegraded":"2023-08-17T00:15:38.808900+0000","last_fullsized":"2023-08-17T00:15:38.808900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265377+0000","last_change":"2023-08-17T00:15:39.265377+0000","last_active":"2023-08-17T00:15:39.265377+0000","last_peered":"2023-08-17T00:15:39.265377+0000","last_clean":"2023-08-17T00:15:39.265377+0000","last_became_active":"2023-08-17T00:15:39.265060+0000","last_became_peered":"2023-08-17T00:15:39.265060+0000","last_unstale":"2023-08-17T00:15:39.265377+0000","last_undegraded":"2023-08-17T00:15:39.265377+0000","last_fullsized":"2023-08-17T00:15:39.265377+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"165'2","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269535+0000","last_change":"2023-08-17T00:15:38.823674+0000","last_active":"2023-08-17T00:15:39.269535+0000","last_peered":"2023-08-17T00:15:39.269535+0000","last_clean":"2023-08-17T00:15:39.269535+0000","last_became_active":"2023-08-17T00:15:38.823384+0000","last_became_peered":"2023-08-17T00:15:38.823384+0000","last_unstale":"2023-08-17T00:15:39.269535+0000","last_undegraded":"2023-08-17T00:15:39.269535+0000","last_fullsized":"2023-08-17T00:15:39.269535+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.819515+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:15:38.819515+0000","last_peered":"2023-08-17T00:15:38.819515+0000","last_clean":"2023-08-17T00:15:38.819515+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:15:38.819515+0000","last_undegraded":"2023-08-17T00:15:38.819515+0000","last_fullsized":"2023-08-17T00:15:38.819515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.271376+0000","last_change":"2023-08-17T00:15:39.271376+0000","last_active":"2023-08-17T00:15:39.271376+0000","last_peered":"2023-08-17T00:15:39.271376+0000","last_clean":"2023-08-17T00:15:39.271376+0000","last_became_active":"2023-08-17T00:15:39.270676+0000","last_became_peered":"2023-08-17T00:15:39.270676+0000","last_unstale":"2023-08-17T00:15:39.271376+0000","last_undegraded":"2023-08-17T00:15:39.271376+0000","last_fullsized":"2023-08-17T00:15:39.271376+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.267920+0000","last_change":"2023-08-17T00:15:38.831617+0000","last_active":"2023-08-17T00:15:39.267920+0000","last_peered":"2023-08-17T00:15:39.267920+0000","last_clean":"2023-08-17T00:15:39.267920+0000","last_became_active":"2023-08-17T00:15:38.828214+0000","last_became_peered":"2023-08-17T00:15:38.828214+0000","last_unstale":"2023-08-17T00:15:39.267920+0000","last_undegraded":"2023-08-17T00:15:39.267920+0000","last_fullsized":"2023-08-17T00:15:39.267920+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.812034+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:15:38.812034+0000","last_peered":"2023-08-17T00:15:38.812034+0000","last_clean":"2023-08-17T00:15:38.812034+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:15:38.812034+0000","last_undegraded":"2023-08-17T00:15:38.812034+0000","last_fullsized":"2023-08-17T00:15:38.812034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.261161+0000","last_change":"2023-08-17T00:15:39.261161+0000","last_active":"2023-08-17T00:15:39.261161+0000","last_peered":"2023-08-17T00:15:39.261161+0000","last_clean":"2023-08-17T00:15:39.261161+0000","last_became_active":"2023-08-17T00:15:39.260459+0000","last_became_peered":"2023-08-17T00:15:39.260459+0000","last_unstale":"2023-08-17T00:15:39.261161+0000","last_undegraded":"2023-08-17T00:15:39.261161+0000","last_fullsized":"2023-08-17T00:15:39.261161+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836903+0000","last_change":"2023-08-17T00:15:38.832580+0000","last_active":"2023-08-17T00:15:38.836903+0000","last_peered":"2023-08-17T00:15:38.836903+0000","last_clean":"2023-08-17T00:15:38.836903+0000","last_became_active":"2023-08-17T00:15:38.832247+0000","last_became_peered":"2023-08-17T00:15:38.832247+0000","last_unstale":"2023-08-17T00:15:38.836903+0000","last_undegraded":"2023-08-17T00:15:38.836903+0000","last_fullsized":"2023-08-17T00:15:38.836903+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.814160+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:15:38.814160+0000","last_peered":"2023-08-17T00:15:38.814160+0000","last_clean":"2023-08-17T00:15:38.814160+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:15:38.814160+0000","last_undegraded":"2023-08-17T00:15:38.814160+0000","last_fullsized":"2023-08-17T00:15:38.814160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.813034+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:15:38.813034+0000","last_peered":"2023-08-17T00:15:38.813034+0000","last_clean":"2023-08-17T00:15:38.813034+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:15:38.813034+0000","last_undegraded":"2023-08-17T00:15:38.813034+0000","last_fullsized":"2023-08-17T00:15:38.813034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2284,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315600,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056240,"statfs":{"total":96636764160,"available":96313589760,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.026,"15min":1.151},"min":{"1min":0.72399999999999998,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.6539999999999999,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0349999999999999,"15min":1.1799999999999999},"min":{"1min":0.68700000000000006,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.4810000000000001,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":1.1579999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.077,"15min":1.214},"min":{"1min":0.93400000000000005,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.5329999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":1.383},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1100000000000001,"15min":1.212},"min":{"1min":0.85699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.359,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.0720000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.1359999999999999},"min":{"1min":0.91700000000000004,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.3240000000000001,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.018},{"interface":"front","average":{"1min":1.167,"5min":1.1180000000000001,"15min":1.264},"min":{"1min":0.73599999999999999,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.51,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.617}]},{"osd":3,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1160000000000001,"15min":1.1910000000000001},"min":{"1min":1.014,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.595,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.167,"15min":1.391},"min":{"1min":0.86199999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.4750000000000001,"5min":1.952,"15min":13.074999999999999},"last":1.5680000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.3280000000000001},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.62},"max":{"1min":1.5089999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1379999999999999,"15min":1.3009999999999999},"min":{"1min":0.80500000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6419999999999999,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.331}]},{"osd":5,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.198,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.629,"5min":2.9830000000000001,"15min":14.435},"last":1.657},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.234,"15min":1.4359999999999999},"min":{"1min":0.88200000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7829999999999999,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.23}]},{"osd":6,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2689999999999999,"15min":1.4650000000000001},"min":{"1min":0.77700000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8640000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.484},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.204,"15min":1.397},"min":{"1min":0.99299999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.4019999999999999,"5min":2.4350000000000001,"15min":11.365},"last":1.5940000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542301,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315612,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056228,"statfs":{"total":96636764160,"available":96313577472,"internally_reserved":0,"allocated":2052096,"data_stored":963323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.056},"min":{"1min":0.78300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.27,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":0.752},{"interface":"front","average":{"1min":1.014,"5min":0.99299999999999999,"15min":1.1120000000000001},"min":{"1min":0.755,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.3420000000000001,"5min":1.4890000000000001,"15min":10.519},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.054,"15min":1.141},"min":{"1min":0.66500000000000004,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.379,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.038,"15min":1.0569999999999999},"min":{"1min":0.749,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":11.391999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.131,"15min":1.165},"min":{"1min":0.94799999999999995,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.5309999999999999,"5min":1.8540000000000001,"15min":5.3799999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.1899999999999999,"15min":1.2789999999999999},"min":{"1min":0.90800000000000003,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5640000000000001,"5min":1.708,"15min":10.669},"last":1.1719999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1870000000000001,"15min":1.1859999999999999},"min":{"1min":0.85699999999999998,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":2.1509999999999998,"5min":3.4809999999999999,"15min":11.475},"last":0.87},{"interface":"front","average":{"1min":1.304,"5min":1.232,"15min":1.258},"min":{"1min":0.874,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":2.101,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1579999999999999,"15min":1.268},"min":{"1min":0.91000000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.758,"5min":1.992,"15min":10.632},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.206,"5min":1.147,"15min":1.234},"min":{"1min":0.88800000000000001,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":11.438000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.21,"15min":1.256},"min":{"1min":0.90800000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.407,"5min":1.306,"15min":1.3759999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":1.258}]},{"osd":7,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.256,"15min":1.3280000000000001},"min":{"1min":0.74299999999999999,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":11.51},"last":1.002},{"interface":"front","average":{"1min":1.413,"5min":1.3240000000000001,"15min":1.3899999999999999},"min":{"1min":0.99199999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":2.532,"5min":2.532,"15min":5.4100000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":2052096,"data_stored":963323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0069999999999999,"15min":1.214},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.679,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.333},{"interface":"front","average":{"1min":1.054,"5min":1.083,"15min":1.3049999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.3220000000000001,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.238}]},{"osd":1,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.4419999999999999,"5min":1.746,"15min":4.2270000000000003},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.2410000000000001},"min":{"1min":0.66200000000000003,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.379,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.175}]},{"osd":2,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.143,"15min":1.3720000000000001},"min":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5009999999999999,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.02},{"interface":"front","average":{"1min":1.159,"5min":1.137,"15min":1.302},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.647,"5min":1.796,"15min":11.949},"last":0.96499999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2010000000000001,"15min":1.351},"min":{"1min":0.77500000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5349999999999999,"5min":4.3250000000000002,"15min":13.125},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.214,"15min":1.3120000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.4910000000000001,"5min":2.306,"15min":8.4809999999999999},"last":1.21}]},{"osd":4,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1399999999999999,"15min":1.397},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.452,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.077},{"interface":"front","average":{"1min":1.208,"5min":1.228,"15min":1.5089999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.54000000000000004},"max":{"1min":1.4710000000000001,"5min":4.8170000000000002,"15min":19.591000000000001},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2310000000000001,"15min":1.4910000000000001},"min":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.5680000000000001,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.28},{"interface":"front","average":{"1min":1.123,"5min":1.212,"15min":1.4830000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5049999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.327,"15min":1.601},"min":{"1min":0.85299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.629,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.353,"15min":1.573},"min":{"1min":0.91300000000000003,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.615,"5min":2.0899999999999999,"15min":14.818},"last":1.3580000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80200000000000005,"15min":0.79100000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.1040000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.89500000000000002,"15min":0.85899999999999999},"min":{"1min":0.58799999999999997,"5min":0.50900000000000001,"15min":0.38100000000000001},"max":{"1min":1.1399999999999999,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.097}]},{"osd":1,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3160000000000001,"5min":3.274,"15min":11.215999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.073,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.2210000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.48199999999999998,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":1.587,"15min":2.0270000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.0129999999999999,"15min":1.03},"min":{"1min":0.57999999999999996,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.413,"5min":1.4750000000000001,"15min":2.6360000000000001},"last":1.306}]},{"osd":4,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.79800000000000004,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.4790000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.575,"5min":1.5860000000000001,"15min":3.9790000000000001},"last":1.258}]},{"osd":5,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1399999999999999,"15min":1.1890000000000001},"min":{"1min":0.623,"5min":0.61899999999999999,"15min":0.54600000000000004},"max":{"1min":1.5329999999999999,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.246},"min":{"1min":1.0389999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.516,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.373}]},{"osd":6,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1890000000000001,"15min":1.2210000000000001},"min":{"1min":0.99199999999999999,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.611,"5min":1.702,"15min":3.4249999999999998},"last":1.423},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2070000000000001,"15min":1.1970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.891,"5min":1.968,"15min":3.585},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.996,"5min":1.996,"15min":2.1930000000000001},"last":1.204},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1890000000000001,"15min":1.212},"min":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64000000000000001},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":2.0419999999999998},"last":1.071}]}]},{"osd":2,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311516,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060324,"statfs":{"total":96636764160,"available":96317771776,"internally_reserved":0,"allocated":2052096,"data_stored":963323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.2589999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.80400000000000005,"15min":0.873},"min":{"1min":0.60199999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.3280000000000001,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":1.1899999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.441,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.5529999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.04,"15min":1.028},"min":{"1min":0.66200000000000003,"5min":0.40699999999999997,"15min":0.376},"max":{"1min":1.6879999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.96699999999999997,"15min":1.048},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3340000000000001,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":1.147},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.476,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2629999999999999,"15min":1.429},"min":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.571,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.375,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":2.0600000000000001,"5min":17.988,"15min":17.988},"last":1.496}]},{"osd":5,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.294,"15min":1.4590000000000001},"min":{"1min":0.94899999999999995,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.629,"5min":1.873,"15min":12.914},"last":1.599},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.232,"15min":1.3380000000000001},"min":{"1min":0.85699999999999998,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.5349999999999999,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.4430000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1559999999999999,"15min":1.381},"min":{"1min":0.751,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.5169999999999999,"5min":1.621,"15min":13.864000000000001},"last":1.7789999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2829999999999999,"15min":1.4530000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6100000000000001,"5min":1.9359999999999999,"15min":12.698},"last":1.6399999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.45},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.6779999999999999,"15min":10.592000000000001},"last":1.54},{"interface":"front","average":{"1min":1.349,"5min":1.298,"15min":1.456},"min":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.6100000000000001,"5min":1.9159999999999999,"15min":11.417},"last":1.891}]}]},{"osd":1,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.64800000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.101,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.123},{"interface":"front","average":{"1min":1.028,"5min":0.88200000000000001,"15min":0.90600000000000003},"min":{"1min":0.68400000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":13.093},"last":0.93899999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.3069999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.875,"15min":0.88800000000000001},"min":{"1min":0.59799999999999998,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.6930000000000001,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.98499999999999999,"15min":1.0129999999999999},"min":{"1min":0.71599999999999997,"5min":0.55700000000000005,"15min":0.437},"max":{"1min":1.2829999999999999,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":0.995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90900000000000003,"15min":0.94999999999999996},"min":{"1min":0.68700000000000006,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.359,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0369999999999999,"15min":1.1379999999999999},"min":{"1min":0.83799999999999997,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.659,"5min":1.671,"15min":20.548999999999999},"last":1.552},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.165,"15min":1.2010000000000001},"min":{"1min":1.004,"5min":0.72499999999999998,"15min":0.59699999999999998},"max":{"1min":1.8300000000000001,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.5169999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.228,"15min":1.294},"min":{"1min":0.999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0830000000000002,"5min":3.137,"15min":13.170999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.196,"15min":1.2390000000000001},"min":{"1min":1.0509999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8009999999999999,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.369}]},{"osd":6,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.224,"15min":1.248},"min":{"1min":1.054,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9730000000000001,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.2,"15min":1.206},"min":{"1min":0.93600000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8740000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.202}]},{"osd":7,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.3},"min":{"1min":0.98299999999999998,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.8959999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.675},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.3240000000000001},"min":{"1min":1.073,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7290000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.2769999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311504,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060336,"statfs":{"total":96636764160,"available":96317784064,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97199999999999998,"15min":0.83099999999999996},"min":{"1min":0.51300000000000001,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.3080000000000001,"5min":18.442,"15min":18.442},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.92000000000000004,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.264,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":1.002}]},{"osd":2,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.073,"15min":0.94299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45100000000000001,"15min":0.34999999999999998},"max":{"1min":1.3100000000000001,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97499999999999998,"15min":0.91400000000000003},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.4970000000000001,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1859999999999999,"5min":1.5840000000000001,"15min":1.613},"last":1.046},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.0549999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.377,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.4099999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.081,"15min":1.093},"min":{"1min":0.754,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.6279999999999999,"5min":1.728,"15min":1.7609999999999999},"last":1.226},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.365,"15min":1.2490000000000001},"min":{"1min":0.72699999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.542,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.4810000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.4059999999999999,"15min":1.2909999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.373},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.202,"15min":1.23},"min":{"1min":0.80600000000000005,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.4550000000000001,"5min":1.984,"15min":1.984},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3979999999999999,"15min":1.2969999999999999},"min":{"1min":0.79100000000000004,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.502,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3620000000000001,"15min":1.2689999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.665,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.395,"15min":1.2929999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8779999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80300000000000005,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.98399999999999999,"15min":1.0649999999999999},"min":{"1min":0.71099999999999997,"5min":0.61199999999999999,"15min":0.38300000000000001},"max":{"1min":1.53,"5min":1.677,"15min":7.1379999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0189999999999999,"15min":1.0580000000000001},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":1.6299999999999999,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":0.97699999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.119,"15min":1.2230000000000001},"min":{"1min":0.61599999999999999,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.026},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1299999999999999,"15min":1.2230000000000001},"min":{"1min":0.88600000000000001,"5min":0.65100000000000002,"15min":0.48099999999999998},"max":{"1min":1.5649999999999999,"5min":1.5660000000000001,"15min":6.9000000000000004},"last":1.145}]},{"osd":2,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.2210000000000001},"min":{"1min":0.68799999999999994,"5min":0.58399999999999996,"15min":0.47399999999999998},"max":{"1min":1.4910000000000001,"5min":1.7030000000000001,"15min":18.431000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0800000000000001,"15min":1.3160000000000001},"min":{"1min":0.84099999999999997,"5min":0.72399999999999998,"15min":0.36699999999999999},"max":{"1min":1.3779999999999999,"5min":1.623,"15min":36.531999999999996},"last":1.0589999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.097,"15min":1.121},"min":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4219999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.153,"15min":1.385},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.595,"5min":1.7809999999999999,"15min":36.530000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1619999999999999,"15min":1.24},"min":{"1min":0.85299999999999998,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.093},{"interface":"front","average":{"1min":1.258,"5min":1.212,"15min":1.2869999999999999},"min":{"1min":0.92100000000000004,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.417,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.569}]},{"osd":6,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2250000000000001,"15min":1.329},"min":{"1min":0.82799999999999996,"5min":0.60099999999999998,"15min":0.44700000000000001},"max":{"1min":1.7330000000000001,"5min":2.0840000000000001,"15min":8.4190000000000005},"last":1.169},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.294,"15min":1.377},"min":{"1min":1.034,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8120000000000001,"5min":1.911,"15min":6.1689999999999996},"last":1.4319999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2070000000000001,"15min":1.256},"min":{"1min":0.85599999999999998,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.325,"5min":3.645,"15min":3.645},"last":1.476},{"interface":"front","average":{"1min":1.341,"5min":1.2929999999999999,"15min":1.3959999999999999},"min":{"1min":0.875,"5min":0.629,"15min":0.629},"max":{"1min":1.615,"5min":1.9690000000000001,"15min":8.327},"last":1.4159999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:15:43.476 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:15:43.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.665+0000 7f831949b700 1 Processor -- start 2023-08-17T00:15:43.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.665+0000 7f831949b700 1 -- start start 2023-08-17T00:15:43.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.665+0000 7f831949b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f83140ad460 0x7f83141555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.665+0000 7f831949b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8314065b30 con 0x7f83140a6f60 2023-08-17T00:15:43.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.665+0000 7f831949b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83140ada60 con 0x7f83140a7340 2023-08-17T00:15:43.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.665+0000 7f831949b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83140ac1c0 con 0x7f83140ad460 2023-08-17T00:15:43.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8312ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f83140a6f60 0x7f83140aaf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60494/0 (socket says 172.21.15.153:60494) 2023-08-17T00:15:43.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8312ffd700 1 -- 172.21.15.153:0/825634553 learned_addr learned my addr 172.21.15.153:0/825634553 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:43.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8313fff700 1 --2- 172.21.15.153:0/825634553 >> v2:172.21.15.153:3300/0 conn(0x7f83140ad460 0x7f83141555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8311ffb700 1 -- 172.21.15.153:0/825634553 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087707012 0 0) 0x7f8314065b30 con 0x7f83140a6f60 2023-08-17T00:15:43.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8311ffb700 1 -- 172.21.15.153:0/825634553 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82fc0033f0 con 0x7f83140a6f60 2023-08-17T00:15:43.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8311ffb700 1 -- 172.21.15.153:0/825634553 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951199993 0 0) 0x7f83140ada60 con 0x7f83140a7340 2023-08-17T00:15:43.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8313fff700 1 -- 172.21.15.153:0/825634553 >> v1:172.21.15.178:6789/0 conn(0x7f83140a7340 legacy=0x7f83140bce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8313fff700 1 -- 172.21.15.153:0/825634553 >> v1:172.21.15.153:6789/0 conn(0x7f83140a6f60 legacy=0x7f83140aaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8313fff700 1 -- 172.21.15.153:0/825634553 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314067b80 con 0x7f83140ad460 2023-08-17T00:15:43.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8313fff700 1 --2- 172.21.15.153:0/825634553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83141555e0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f830c009e60 tx=0x7f830c009780).ready entity=mon.0 client_cookie=1e76ae0c095f1604 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:43.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8311ffb700 1 -- 172.21.15.153:0/825634553 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00e070 con 0x7f83140ad460 2023-08-17T00:15:43.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8311ffb700 1 -- 172.21.15.153:0/825634553 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c00bb60 con 0x7f83140ad460 2023-08-17T00:15:43.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f8311ffb700 1 -- 172.21.15.153:0/825634553 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00bee0 con 0x7f83140ad460 2023-08-17T00:15:43.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 -- 172.21.15.153:0/825634553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 msgr2=0x7f83141555e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 --2- 172.21.15.153:0/825634553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83141555e0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 rx=0x7f830c009e60 tx=0x7f830c009780).stop 2023-08-17T00:15:43.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 -- 172.21.15.153:0/825634553 shutdown_connections 2023-08-17T00:15:43.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 --2- 172.21.15.153:0/825634553 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83141555e0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 -- 172.21.15.153:0/825634553 >> 172.21.15.153:0/825634553 conn(0x7f83140c4950 msgr2=0x7f83140c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:43.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 -- 172.21.15.153:0/825634553 shutdown_connections 2023-08-17T00:15:43.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.669+0000 7f831949b700 1 -- 172.21.15.153:0/825634553 wait complete. 2023-08-17T00:15:43.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.673+0000 7f831949b700 1 Processor -- start 2023-08-17T00:15:43.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.673+0000 7f831949b700 1 -- start start 2023-08-17T00:15:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140a6f60 0x7f83141679e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83140a7340 0x7f83141631e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83140a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140a8a50 con 0x7f83140ad460 2023-08-17T00:15:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83140a8050 con 0x7f83140a7340 2023-08-17T00:15:43.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831414f550 con 0x7f83140a6f60 2023-08-17T00:15:43.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83140a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83140a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38316/0 (socket says 172.21.15.153:38316) 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 -- 172.21.15.153:0/3986680412 learned_addr learned my addr 172.21.15.153:0/3986680412 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8312ffd700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140a6f60 0x7f83141679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f83127fc700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83140a7340 0x7f83141631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 -- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140a6f60 msgr2=0x7f83141679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140a6f60 0x7f83141679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 -- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83140a7340 msgr2=0x7f83141631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83140a7340 0x7f83141631e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 -- 172.21.15.153:0/3986680412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830c009a20 con 0x7f83140ad460 2023-08-17T00:15:43.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f8313fff700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83140a9ff0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f830c00b6c0 tx=0x7f8314065aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:43.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c00bea0 con 0x7f83140ad460 2023-08-17T00:15:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830c01d630 con 0x7f83140ad460 2023-08-17T00:15:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8314167ed0 con 0x7f83140ad460 2023-08-17T00:15:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830c01d9f0 con 0x7f83140ad460 2023-08-17T00:15:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.677+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83140a8400 con 0x7f83140ad460 2023-08-17T00:15:43.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.681+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831406b530 con 0x7f83140ad460 2023-08-17T00:15:43.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.681+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f830c01dd60 con 0x7f83140ad460 2023-08-17T00:15:43.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.681+0000 7f82faffd700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f830005a150 0x7f830005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:43.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.685+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f830c076300 con 0x7f83140ad460 2023-08-17T00:15:43.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.685+0000 7f8312ffd700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f830005a150 0x7f830005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:43.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.685+0000 7f8312ffd700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f830005a150 0x7f830005c610 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f8304005750 tx=0x7f8304009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:43.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.685+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f830c049d20 con 0x7f83140ad460 2023-08-17T00:15:43.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.845+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83140c57c0 con 0x7f830005a150 2023-08-17T00:15:43.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.861+0000 7f82faffd700 1 -- 172.21.15.153:0/3986680412 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359424 (secure 0 0 0) 0x7f83140c57c0 con 0x7f830005a150 2023-08-17T00:15:43.877 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f830005a150 msgr2=0x7f830005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f830005a150 0x7f830005c610 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f8304005750 tx=0x7f8304009040).stop 2023-08-17T00:15:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 msgr2=0x7f83140a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:43.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83140a9ff0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 rx=0x7f830c00b6c0 tx=0x7f8314065aa0).stop 2023-08-17T00:15:43.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 shutdown_connections 2023-08-17T00:15:43.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f830005a150 0x7f830005c610 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f83140ad460 0x7f83140a9ff0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83140a7340 0x7f83141631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 --2- 172.21.15.153:0/3986680412 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83140a6f60 0x7f83141679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:43.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 >> 172.21.15.153:0/3986680412 conn(0x7f83140c4950 msgr2=0x7f83140a58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:43.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 shutdown_connections 2023-08-17T00:15:43.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:43.873+0000 7f831949b700 1 -- 172.21.15.153:0/3986680412 wait complete. 2023-08-17T00:15:43.883 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:15:43.898 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":549,"stamp":"2023-08-17T00:15:43.469830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":54,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2479820,"kb_used_data":16012,"kb_used_omap":0,"kb_used_meta":2463744,"kb_avail":752494900,"statfs":{"total":773094113280,"available":770554777600,"internally_reserved":0,"allocated":16396288,"data_stored":7693773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2522873856},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":51,"apply_latency_ms":51,"commit_latency_ns":51000000,"apply_latency_ns":51000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3642,"num_objects":-19,"num_object_clones":0,"num_object_copies":-38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-19,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-42,"num_write_kb":-16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.562988"},"pg_stats":[{"pgid":"24.30","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262292+0000","last_change":"2023-08-17T00:15:39.262292+0000","last_active":"2023-08-17T00:15:39.262292+0000","last_peered":"2023-08-17T00:15:39.262292+0000","last_clean":"2023-08-17T00:15:39.262292+0000","last_became_active":"2023-08-17T00:15:39.262025+0000","last_became_peered":"2023-08-17T00:15:39.262025+0000","last_unstale":"2023-08-17T00:15:39.262292+0000","last_undegraded":"2023-08-17T00:15:39.262292+0000","last_fullsized":"2023-08-17T00:15:39.262292+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3f","version":"165'3","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.272571+0000","last_change":"2023-08-17T00:15:38.829501+0000","last_active":"2023-08-17T00:15:39.272571+0000","last_peered":"2023-08-17T00:15:39.272571+0000","last_clean":"2023-08-17T00:15:39.272571+0000","last_became_active":"2023-08-17T00:15:38.828805+0000","last_became_peered":"2023-08-17T00:15:38.828805+0000","last_unstale":"2023-08-17T00:15:39.272571+0000","last_undegraded":"2023-08-17T00:15:39.272571+0000","last_fullsized":"2023-08-17T00:15:39.272571+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.274831+0000","last_change":"2023-08-17T00:15:39.274831+0000","last_active":"2023-08-17T00:15:39.274831+0000","last_peered":"2023-08-17T00:15:39.274831+0000","last_clean":"2023-08-17T00:15:39.274831+0000","last_became_active":"2023-08-17T00:15:39.274347+0000","last_became_peered":"2023-08-17T00:15:39.274347+0000","last_unstale":"2023-08-17T00:15:39.274831+0000","last_undegraded":"2023-08-17T00:15:39.274831+0000","last_fullsized":"2023-08-17T00:15:39.274831+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.833399+0000","last_change":"2023-08-17T00:15:38.829415+0000","last_active":"2023-08-17T00:15:38.833399+0000","last_peered":"2023-08-17T00:15:38.833399+0000","last_clean":"2023-08-17T00:15:38.833399+0000","last_became_active":"2023-08-17T00:15:38.829104+0000","last_became_peered":"2023-08-17T00:15:38.829104+0000","last_unstale":"2023-08-17T00:15:38.833399+0000","last_undegraded":"2023-08-17T00:15:38.833399+0000","last_fullsized":"2023-08-17T00:15:38.833399+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270969+0000","last_change":"2023-08-17T00:15:39.270969+0000","last_active":"2023-08-17T00:15:39.270969+0000","last_peered":"2023-08-17T00:15:39.270969+0000","last_clean":"2023-08-17T00:15:39.270969+0000","last_became_active":"2023-08-17T00:15:39.270706+0000","last_became_peered":"2023-08-17T00:15:39.270706+0000","last_unstale":"2023-08-17T00:15:39.270969+0000","last_undegraded":"2023-08-17T00:15:39.270969+0000","last_fullsized":"2023-08-17T00:15:39.270969+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.833632+0000","last_change":"2023-08-17T00:15:38.828791+0000","last_active":"2023-08-17T00:15:38.833632+0000","last_peered":"2023-08-17T00:15:38.833632+0000","last_clean":"2023-08-17T00:15:38.833632+0000","last_became_active":"2023-08-17T00:15:38.828493+0000","last_became_peered":"2023-08-17T00:15:38.828493+0000","last_unstale":"2023-08-17T00:15:38.833632+0000","last_undegraded":"2023-08-17T00:15:38.833632+0000","last_fullsized":"2023-08-17T00:15:38.833632+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262268+0000","last_change":"2023-08-17T00:15:39.262268+0000","last_active":"2023-08-17T00:15:39.262268+0000","last_peered":"2023-08-17T00:15:39.262268+0000","last_clean":"2023-08-17T00:15:39.262268+0000","last_became_active":"2023-08-17T00:15:39.261993+0000","last_became_peered":"2023-08-17T00:15:39.261993+0000","last_unstale":"2023-08-17T00:15:39.262268+0000","last_undegraded":"2023-08-17T00:15:39.262268+0000","last_fullsized":"2023-08-17T00:15:39.262268+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3c","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.273238+0000","last_change":"2023-08-17T00:15:38.830549+0000","last_active":"2023-08-17T00:15:39.273238+0000","last_peered":"2023-08-17T00:15:39.273238+0000","last_clean":"2023-08-17T00:15:39.273238+0000","last_became_active":"2023-08-17T00:15:38.829457+0000","last_became_peered":"2023-08-17T00:15:38.829457+0000","last_unstale":"2023-08-17T00:15:39.273238+0000","last_undegraded":"2023-08-17T00:15:39.273238+0000","last_fullsized":"2023-08-17T00:15:39.273238+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263786+0000","last_change":"2023-08-17T00:15:39.263786+0000","last_active":"2023-08-17T00:15:39.263786+0000","last_peered":"2023-08-17T00:15:39.263786+0000","last_clean":"2023-08-17T00:15:39.263786+0000","last_became_active":"2023-08-17T00:15:39.263540+0000","last_became_peered":"2023-08-17T00:15:39.263540+0000","last_unstale":"2023-08-17T00:15:39.263786+0000","last_undegraded":"2023-08-17T00:15:39.263786+0000","last_fullsized":"2023-08-17T00:15:39.263786+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.3b","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.248566+0000","last_change":"2023-08-17T00:15:38.829516+0000","last_active":"2023-08-17T00:15:39.248566+0000","last_peered":"2023-08-17T00:15:39.248566+0000","last_clean":"2023-08-17T00:15:39.248566+0000","last_became_active":"2023-08-17T00:15:38.829146+0000","last_became_peered":"2023-08-17T00:15:38.829146+0000","last_unstale":"2023-08-17T00:15:39.248566+0000","last_undegraded":"2023-08-17T00:15:39.248566+0000","last_fullsized":"2023-08-17T00:15:39.248566+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270019+0000","last_change":"2023-08-17T00:15:39.270019+0000","last_active":"2023-08-17T00:15:39.270019+0000","last_peered":"2023-08-17T00:15:39.270019+0000","last_clean":"2023-08-17T00:15:39.270019+0000","last_became_active":"2023-08-17T00:15:39.269735+0000","last_became_peered":"2023-08-17T00:15:39.269735+0000","last_unstale":"2023-08-17T00:15:39.270019+0000","last_undegraded":"2023-08-17T00:15:39.270019+0000","last_fullsized":"2023-08-17T00:15:39.270019+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.250416+0000","last_change":"2023-08-17T00:15:38.830732+0000","last_active":"2023-08-17T00:15:39.250416+0000","last_peered":"2023-08-17T00:15:39.250416+0000","last_clean":"2023-08-17T00:15:39.250416+0000","last_became_active":"2023-08-17T00:15:38.830420+0000","last_became_peered":"2023-08-17T00:15:38.830420+0000","last_unstale":"2023-08-17T00:15:39.250416+0000","last_undegraded":"2023-08-17T00:15:39.250416+0000","last_fullsized":"2023-08-17T00:15:39.250416+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264710+0000","last_change":"2023-08-17T00:15:39.264710+0000","last_active":"2023-08-17T00:15:39.264710+0000","last_peered":"2023-08-17T00:15:39.264710+0000","last_clean":"2023-08-17T00:15:39.264710+0000","last_became_active":"2023-08-17T00:15:39.264288+0000","last_became_peered":"2023-08-17T00:15:39.264288+0000","last_unstale":"2023-08-17T00:15:39.264710+0000","last_undegraded":"2023-08-17T00:15:39.264710+0000","last_fullsized":"2023-08-17T00:15:39.264710+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.832767+0000","last_change":"2023-08-17T00:15:38.826239+0000","last_active":"2023-08-17T00:15:38.832767+0000","last_peered":"2023-08-17T00:15:38.832767+0000","last_clean":"2023-08-17T00:15:38.832767+0000","last_became_active":"2023-08-17T00:15:38.825880+0000","last_became_peered":"2023-08-17T00:15:38.825880+0000","last_unstale":"2023-08-17T00:15:38.832767+0000","last_undegraded":"2023-08-17T00:15:38.832767+0000","last_fullsized":"2023-08-17T00:15:38.832767+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270296+0000","last_change":"2023-08-17T00:15:39.270296+0000","last_active":"2023-08-17T00:15:39.270296+0000","last_peered":"2023-08-17T00:15:39.270296+0000","last_clean":"2023-08-17T00:15:39.270296+0000","last_became_active":"2023-08-17T00:15:39.270014+0000","last_became_peered":"2023-08-17T00:15:39.270014+0000","last_unstale":"2023-08-17T00:15:39.270296+0000","last_undegraded":"2023-08-17T00:15:39.270296+0000","last_fullsized":"2023-08-17T00:15:39.270296+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.827933+0000","last_change":"2023-08-17T00:15:38.819105+0000","last_active":"2023-08-17T00:15:38.827933+0000","last_peered":"2023-08-17T00:15:38.827933+0000","last_clean":"2023-08-17T00:15:38.827933+0000","last_became_active":"2023-08-17T00:15:38.817770+0000","last_became_peered":"2023-08-17T00:15:38.817770+0000","last_unstale":"2023-08-17T00:15:38.827933+0000","last_undegraded":"2023-08-17T00:15:38.827933+0000","last_fullsized":"2023-08-17T00:15:38.827933+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.272872+0000","last_change":"2023-08-17T00:15:39.264564+0000","last_active":"2023-08-17T00:15:39.272872+0000","last_peered":"2023-08-17T00:15:39.272872+0000","last_clean":"2023-08-17T00:15:39.272872+0000","last_became_active":"2023-08-17T00:15:39.264279+0000","last_became_peered":"2023-08-17T00:15:39.264279+0000","last_unstale":"2023-08-17T00:15:39.272872+0000","last_undegraded":"2023-08-17T00:15:39.272872+0000","last_fullsized":"2023-08-17T00:15:39.272872+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836514+0000","last_change":"2023-08-17T00:15:38.832551+0000","last_active":"2023-08-17T00:15:38.836514+0000","last_peered":"2023-08-17T00:15:38.836514+0000","last_clean":"2023-08-17T00:15:38.836514+0000","last_became_active":"2023-08-17T00:15:38.832278+0000","last_became_peered":"2023-08-17T00:15:38.832278+0000","last_unstale":"2023-08-17T00:15:38.836514+0000","last_undegraded":"2023-08-17T00:15:38.836514+0000","last_fullsized":"2023-08-17T00:15:38.836514+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264093+0000","last_change":"2023-08-17T00:15:39.264093+0000","last_active":"2023-08-17T00:15:39.264093+0000","last_peered":"2023-08-17T00:15:39.264093+0000","last_clean":"2023-08-17T00:15:39.264093+0000","last_became_active":"2023-08-17T00:15:39.263745+0000","last_became_peered":"2023-08-17T00:15:39.263745+0000","last_unstale":"2023-08-17T00:15:39.264093+0000","last_undegraded":"2023-08-17T00:15:39.264093+0000","last_fullsized":"2023-08-17T00:15:39.264093+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835265+0000","last_change":"2023-08-17T00:15:38.825376+0000","last_active":"2023-08-17T00:15:38.835265+0000","last_peered":"2023-08-17T00:15:38.835265+0000","last_clean":"2023-08-17T00:15:38.835265+0000","last_became_active":"2023-08-17T00:15:38.825105+0000","last_became_peered":"2023-08-17T00:15:38.825105+0000","last_unstale":"2023-08-17T00:15:38.835265+0000","last_undegraded":"2023-08-17T00:15:38.835265+0000","last_fullsized":"2023-08-17T00:15:38.835265+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263442+0000","last_change":"2023-08-17T00:15:39.263442+0000","last_active":"2023-08-17T00:15:39.263442+0000","last_peered":"2023-08-17T00:15:39.263442+0000","last_clean":"2023-08-17T00:15:39.263442+0000","last_became_active":"2023-08-17T00:15:39.263148+0000","last_became_peered":"2023-08-17T00:15:39.263148+0000","last_unstale":"2023-08-17T00:15:39.263442+0000","last_undegraded":"2023-08-17T00:15:39.263442+0000","last_fullsized":"2023-08-17T00:15:39.263442+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838780+0000","last_change":"2023-08-17T00:15:38.833017+0000","last_active":"2023-08-17T00:15:38.838780+0000","last_peered":"2023-08-17T00:15:38.838780+0000","last_clean":"2023-08-17T00:15:38.838780+0000","last_became_active":"2023-08-17T00:15:38.831513+0000","last_became_peered":"2023-08-17T00:15:38.831513+0000","last_unstale":"2023-08-17T00:15:38.838780+0000","last_undegraded":"2023-08-17T00:15:38.838780+0000","last_fullsized":"2023-08-17T00:15:38.838780+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269395+0000","last_change":"2023-08-17T00:15:39.269395+0000","last_active":"2023-08-17T00:15:39.269395+0000","last_peered":"2023-08-17T00:15:39.269395+0000","last_clean":"2023-08-17T00:15:39.269395+0000","last_became_active":"2023-08-17T00:15:39.269060+0000","last_became_peered":"2023-08-17T00:15:39.269060+0000","last_unstale":"2023-08-17T00:15:39.269395+0000","last_undegraded":"2023-08-17T00:15:39.269395+0000","last_fullsized":"2023-08-17T00:15:39.269395+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278403+0000","last_change":"2023-08-17T00:15:38.832341+0000","last_active":"2023-08-17T00:15:39.278403+0000","last_peered":"2023-08-17T00:15:39.278403+0000","last_clean":"2023-08-17T00:15:39.278403+0000","last_became_active":"2023-08-17T00:15:38.832067+0000","last_became_peered":"2023-08-17T00:15:38.832067+0000","last_unstale":"2023-08-17T00:15:39.278403+0000","last_undegraded":"2023-08-17T00:15:39.278403+0000","last_fullsized":"2023-08-17T00:15:39.278403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264111+0000","last_change":"2023-08-17T00:15:39.264111+0000","last_active":"2023-08-17T00:15:39.264111+0000","last_peered":"2023-08-17T00:15:39.264111+0000","last_clean":"2023-08-17T00:15:39.264111+0000","last_became_active":"2023-08-17T00:15:39.263722+0000","last_became_peered":"2023-08-17T00:15:39.263722+0000","last_unstale":"2023-08-17T00:15:39.264111+0000","last_undegraded":"2023-08-17T00:15:39.264111+0000","last_fullsized":"2023-08-17T00:15:39.264111+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.33","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.240601+0000","last_change":"2023-08-17T00:15:38.831011+0000","last_active":"2023-08-17T00:15:39.240601+0000","last_peered":"2023-08-17T00:15:39.240601+0000","last_clean":"2023-08-17T00:15:39.240601+0000","last_became_active":"2023-08-17T00:15:38.830715+0000","last_became_peered":"2023-08-17T00:15:38.830715+0000","last_unstale":"2023-08-17T00:15:39.240601+0000","last_undegraded":"2023-08-17T00:15:39.240601+0000","last_fullsized":"2023-08-17T00:15:39.240601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265901+0000","last_change":"2023-08-17T00:15:39.265901+0000","last_active":"2023-08-17T00:15:39.265901+0000","last_peered":"2023-08-17T00:15:39.265901+0000","last_clean":"2023-08-17T00:15:39.265901+0000","last_became_active":"2023-08-17T00:15:39.265534+0000","last_became_peered":"2023-08-17T00:15:39.265534+0000","last_unstale":"2023-08-17T00:15:39.265901+0000","last_undegraded":"2023-08-17T00:15:39.265901+0000","last_fullsized":"2023-08-17T00:15:39.265901+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835304+0000","last_change":"2023-08-17T00:15:38.823467+0000","last_active":"2023-08-17T00:15:38.835304+0000","last_peered":"2023-08-17T00:15:38.835304+0000","last_clean":"2023-08-17T00:15:38.835304+0000","last_became_active":"2023-08-17T00:15:38.823120+0000","last_became_peered":"2023-08-17T00:15:38.823120+0000","last_unstale":"2023-08-17T00:15:38.835304+0000","last_undegraded":"2023-08-17T00:15:38.835304+0000","last_fullsized":"2023-08-17T00:15:38.835304+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262845+0000","last_change":"2023-08-17T00:15:39.262845+0000","last_active":"2023-08-17T00:15:39.262845+0000","last_peered":"2023-08-17T00:15:39.262845+0000","last_clean":"2023-08-17T00:15:39.262845+0000","last_became_active":"2023-08-17T00:15:39.262576+0000","last_became_peered":"2023-08-17T00:15:39.262576+0000","last_unstale":"2023-08-17T00:15:39.262845+0000","last_undegraded":"2023-08-17T00:15:39.262845+0000","last_fullsized":"2023-08-17T00:15:39.262845+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.827804+0000","last_change":"2023-08-17T00:15:38.816569+0000","last_active":"2023-08-17T00:15:38.827804+0000","last_peered":"2023-08-17T00:15:38.827804+0000","last_clean":"2023-08-17T00:15:38.827804+0000","last_became_active":"2023-08-17T00:15:38.815443+0000","last_became_peered":"2023-08-17T00:15:38.815443+0000","last_unstale":"2023-08-17T00:15:38.827804+0000","last_undegraded":"2023-08-17T00:15:38.827804+0000","last_fullsized":"2023-08-17T00:15:38.827804+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263950+0000","last_change":"2023-08-17T00:15:39.263950+0000","last_active":"2023-08-17T00:15:39.263950+0000","last_peered":"2023-08-17T00:15:39.263950+0000","last_clean":"2023-08-17T00:15:39.263950+0000","last_became_active":"2023-08-17T00:15:39.263509+0000","last_became_peered":"2023-08-17T00:15:39.263509+0000","last_unstale":"2023-08-17T00:15:39.263950+0000","last_undegraded":"2023-08-17T00:15:39.263950+0000","last_fullsized":"2023-08-17T00:15:39.263950+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.30","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278907+0000","last_change":"2023-08-17T00:15:38.822451+0000","last_active":"2023-08-17T00:15:39.278907+0000","last_peered":"2023-08-17T00:15:39.278907+0000","last_clean":"2023-08-17T00:15:39.278907+0000","last_became_active":"2023-08-17T00:15:38.822138+0000","last_became_peered":"2023-08-17T00:15:38.822138+0000","last_unstale":"2023-08-17T00:15:39.278907+0000","last_undegraded":"2023-08-17T00:15:39.278907+0000","last_fullsized":"2023-08-17T00:15:39.278907+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278988+0000","last_change":"2023-08-17T00:15:39.278988+0000","last_active":"2023-08-17T00:15:39.278988+0000","last_peered":"2023-08-17T00:15:39.278988+0000","last_clean":"2023-08-17T00:15:39.278988+0000","last_became_active":"2023-08-17T00:15:39.278663+0000","last_became_peered":"2023-08-17T00:15:39.278663+0000","last_unstale":"2023-08-17T00:15:39.278988+0000","last_undegraded":"2023-08-17T00:15:39.278988+0000","last_fullsized":"2023-08-17T00:15:39.278988+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838017+0000","last_change":"2023-08-17T00:15:38.833319+0000","last_active":"2023-08-17T00:15:38.838017+0000","last_peered":"2023-08-17T00:15:38.838017+0000","last_clean":"2023-08-17T00:15:38.838017+0000","last_became_active":"2023-08-17T00:15:38.832811+0000","last_became_peered":"2023-08-17T00:15:38.832811+0000","last_unstale":"2023-08-17T00:15:38.838017+0000","last_undegraded":"2023-08-17T00:15:38.838017+0000","last_fullsized":"2023-08-17T00:15:38.838017+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.275042+0000","last_change":"2023-08-17T00:15:39.275042+0000","last_active":"2023-08-17T00:15:39.275042+0000","last_peered":"2023-08-17T00:15:39.275042+0000","last_clean":"2023-08-17T00:15:39.275042+0000","last_became_active":"2023-08-17T00:15:39.274754+0000","last_became_peered":"2023-08-17T00:15:39.274754+0000","last_unstale":"2023-08-17T00:15:39.275042+0000","last_undegraded":"2023-08-17T00:15:39.275042+0000","last_fullsized":"2023-08-17T00:15:39.275042+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.245656+0000","last_change":"2023-08-17T00:15:38.836457+0000","last_active":"2023-08-17T00:15:39.245656+0000","last_peered":"2023-08-17T00:15:39.245656+0000","last_clean":"2023-08-17T00:15:39.245656+0000","last_became_active":"2023-08-17T00:15:38.835909+0000","last_became_peered":"2023-08-17T00:15:38.835909+0000","last_unstale":"2023-08-17T00:15:39.245656+0000","last_undegraded":"2023-08-17T00:15:39.245656+0000","last_fullsized":"2023-08-17T00:15:39.245656+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270443+0000","last_change":"2023-08-17T00:15:39.270443+0000","last_active":"2023-08-17T00:15:39.270443+0000","last_peered":"2023-08-17T00:15:39.270443+0000","last_clean":"2023-08-17T00:15:39.270443+0000","last_became_active":"2023-08-17T00:15:39.270187+0000","last_became_peered":"2023-08-17T00:15:39.270187+0000","last_unstale":"2023-08-17T00:15:39.270443+0000","last_undegraded":"2023-08-17T00:15:39.270443+0000","last_fullsized":"2023-08-17T00:15:39.270443+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.2d","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.256043+0000","last_change":"2023-08-17T00:15:38.833679+0000","last_active":"2023-08-17T00:15:39.256043+0000","last_peered":"2023-08-17T00:15:39.256043+0000","last_clean":"2023-08-17T00:15:39.256043+0000","last_became_active":"2023-08-17T00:15:38.833306+0000","last_became_peered":"2023-08-17T00:15:38.833306+0000","last_unstale":"2023-08-17T00:15:39.256043+0000","last_undegraded":"2023-08-17T00:15:39.256043+0000","last_fullsized":"2023-08-17T00:15:39.256043+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265694+0000","last_change":"2023-08-17T00:15:39.265694+0000","last_active":"2023-08-17T00:15:39.265694+0000","last_peered":"2023-08-17T00:15:39.265694+0000","last_clean":"2023-08-17T00:15:39.265694+0000","last_became_active":"2023-08-17T00:15:39.265446+0000","last_became_peered":"2023-08-17T00:15:39.265446+0000","last_unstale":"2023-08-17T00:15:39.265694+0000","last_undegraded":"2023-08-17T00:15:39.265694+0000","last_fullsized":"2023-08-17T00:15:39.265694+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.831209+0000","last_change":"2023-08-17T00:15:38.824875+0000","last_active":"2023-08-17T00:15:38.831209+0000","last_peered":"2023-08-17T00:15:38.831209+0000","last_clean":"2023-08-17T00:15:38.831209+0000","last_became_active":"2023-08-17T00:15:38.823794+0000","last_became_peered":"2023-08-17T00:15:38.823794+0000","last_unstale":"2023-08-17T00:15:38.831209+0000","last_undegraded":"2023-08-17T00:15:38.831209+0000","last_fullsized":"2023-08-17T00:15:38.831209+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258672+0000","last_change":"2023-08-17T00:15:39.258672+0000","last_active":"2023-08-17T00:15:39.258672+0000","last_peered":"2023-08-17T00:15:39.258672+0000","last_clean":"2023-08-17T00:15:39.258672+0000","last_became_active":"2023-08-17T00:15:39.258348+0000","last_became_peered":"2023-08-17T00:15:39.258348+0000","last_unstale":"2023-08-17T00:15:39.258672+0000","last_undegraded":"2023-08-17T00:15:39.258672+0000","last_fullsized":"2023-08-17T00:15:39.258672+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2b","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.251387+0000","last_change":"2023-08-17T00:15:38.836410+0000","last_active":"2023-08-17T00:15:39.251387+0000","last_peered":"2023-08-17T00:15:39.251387+0000","last_clean":"2023-08-17T00:15:39.251387+0000","last_became_active":"2023-08-17T00:15:38.836115+0000","last_became_peered":"2023-08-17T00:15:38.836115+0000","last_unstale":"2023-08-17T00:15:39.251387+0000","last_undegraded":"2023-08-17T00:15:39.251387+0000","last_fullsized":"2023-08-17T00:15:39.251387+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278948+0000","last_change":"2023-08-17T00:15:39.278948+0000","last_active":"2023-08-17T00:15:39.278948+0000","last_peered":"2023-08-17T00:15:39.278948+0000","last_clean":"2023-08-17T00:15:39.278948+0000","last_became_active":"2023-08-17T00:15:39.278648+0000","last_became_peered":"2023-08-17T00:15:39.278648+0000","last_unstale":"2023-08-17T00:15:39.278948+0000","last_undegraded":"2023-08-17T00:15:39.278948+0000","last_fullsized":"2023-08-17T00:15:39.278948+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838531+0000","last_change":"2023-08-17T00:15:38.829424+0000","last_active":"2023-08-17T00:15:38.838531+0000","last_peered":"2023-08-17T00:15:38.838531+0000","last_clean":"2023-08-17T00:15:38.838531+0000","last_became_active":"2023-08-17T00:15:38.829100+0000","last_became_peered":"2023-08-17T00:15:38.829100+0000","last_unstale":"2023-08-17T00:15:38.838531+0000","last_undegraded":"2023-08-17T00:15:38.838531+0000","last_fullsized":"2023-08-17T00:15:38.838531+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259605+0000","last_change":"2023-08-17T00:15:39.259605+0000","last_active":"2023-08-17T00:15:39.259605+0000","last_peered":"2023-08-17T00:15:39.259605+0000","last_clean":"2023-08-17T00:15:39.259605+0000","last_became_active":"2023-08-17T00:15:39.259301+0000","last_became_peered":"2023-08-17T00:15:39.259301+0000","last_unstale":"2023-08-17T00:15:39.259605+0000","last_undegraded":"2023-08-17T00:15:39.259605+0000","last_fullsized":"2023-08-17T00:15:39.259605+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836187+0000","last_change":"2023-08-17T00:15:38.829228+0000","last_active":"2023-08-17T00:15:38.836187+0000","last_peered":"2023-08-17T00:15:38.836187+0000","last_clean":"2023-08-17T00:15:38.836187+0000","last_became_active":"2023-08-17T00:15:38.828949+0000","last_became_peered":"2023-08-17T00:15:38.828949+0000","last_unstale":"2023-08-17T00:15:38.836187+0000","last_undegraded":"2023-08-17T00:15:38.836187+0000","last_fullsized":"2023-08-17T00:15:38.836187+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263142+0000","last_change":"2023-08-17T00:15:39.263142+0000","last_active":"2023-08-17T00:15:39.263142+0000","last_peered":"2023-08-17T00:15:39.263142+0000","last_clean":"2023-08-17T00:15:39.263142+0000","last_became_active":"2023-08-17T00:15:39.262879+0000","last_became_peered":"2023-08-17T00:15:39.262879+0000","last_unstale":"2023-08-17T00:15:39.263142+0000","last_undegraded":"2023-08-17T00:15:39.263142+0000","last_fullsized":"2023-08-17T00:15:39.263142+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838601+0000","last_change":"2023-08-17T00:15:38.830179+0000","last_active":"2023-08-17T00:15:38.838601+0000","last_peered":"2023-08-17T00:15:38.838601+0000","last_clean":"2023-08-17T00:15:38.838601+0000","last_became_active":"2023-08-17T00:15:38.829883+0000","last_became_peered":"2023-08-17T00:15:38.829883+0000","last_unstale":"2023-08-17T00:15:38.838601+0000","last_undegraded":"2023-08-17T00:15:38.838601+0000","last_fullsized":"2023-08-17T00:15:38.838601+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265358+0000","last_change":"2023-08-17T00:15:39.265358+0000","last_active":"2023-08-17T00:15:39.265358+0000","last_peered":"2023-08-17T00:15:39.265358+0000","last_clean":"2023-08-17T00:15:39.265358+0000","last_became_active":"2023-08-17T00:15:39.265086+0000","last_became_peered":"2023-08-17T00:15:39.265086+0000","last_unstale":"2023-08-17T00:15:39.265358+0000","last_undegraded":"2023-08-17T00:15:39.265358+0000","last_fullsized":"2023-08-17T00:15:39.265358+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838608+0000","last_change":"2023-08-17T00:15:38.830953+0000","last_active":"2023-08-17T00:15:38.838608+0000","last_peered":"2023-08-17T00:15:38.838608+0000","last_clean":"2023-08-17T00:15:38.838608+0000","last_became_active":"2023-08-17T00:15:38.830693+0000","last_became_peered":"2023-08-17T00:15:38.830693+0000","last_unstale":"2023-08-17T00:15:38.838608+0000","last_undegraded":"2023-08-17T00:15:38.838608+0000","last_fullsized":"2023-08-17T00:15:38.838608+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263466+0000","last_change":"2023-08-17T00:15:39.263466+0000","last_active":"2023-08-17T00:15:39.263466+0000","last_peered":"2023-08-17T00:15:39.263466+0000","last_clean":"2023-08-17T00:15:39.263466+0000","last_became_active":"2023-08-17T00:15:39.263186+0000","last_became_peered":"2023-08-17T00:15:39.263186+0000","last_unstale":"2023-08-17T00:15:39.263466+0000","last_undegraded":"2023-08-17T00:15:39.263466+0000","last_fullsized":"2023-08-17T00:15:39.263466+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836259+0000","last_change":"2023-08-17T00:15:38.830283+0000","last_active":"2023-08-17T00:15:38.836259+0000","last_peered":"2023-08-17T00:15:38.836259+0000","last_clean":"2023-08-17T00:15:38.836259+0000","last_became_active":"2023-08-17T00:15:38.827198+0000","last_became_peered":"2023-08-17T00:15:38.827198+0000","last_unstale":"2023-08-17T00:15:38.836259+0000","last_undegraded":"2023-08-17T00:15:38.836259+0000","last_fullsized":"2023-08-17T00:15:38.836259+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262701+0000","last_change":"2023-08-17T00:15:39.262701+0000","last_active":"2023-08-17T00:15:39.262701+0000","last_peered":"2023-08-17T00:15:39.262701+0000","last_clean":"2023-08-17T00:15:39.262701+0000","last_became_active":"2023-08-17T00:15:39.262085+0000","last_became_peered":"2023-08-17T00:15:39.262085+0000","last_unstale":"2023-08-17T00:15:39.262701+0000","last_undegraded":"2023-08-17T00:15:39.262701+0000","last_fullsized":"2023-08-17T00:15:39.262701+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.834604+0000","last_change":"2023-08-17T00:15:38.825695+0000","last_active":"2023-08-17T00:15:38.834604+0000","last_peered":"2023-08-17T00:15:38.834604+0000","last_clean":"2023-08-17T00:15:38.834604+0000","last_became_active":"2023-08-17T00:15:38.825391+0000","last_became_peered":"2023-08-17T00:15:38.825391+0000","last_unstale":"2023-08-17T00:15:38.834604+0000","last_undegraded":"2023-08-17T00:15:38.834604+0000","last_fullsized":"2023-08-17T00:15:38.834604+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262729+0000","last_change":"2023-08-17T00:15:39.262729+0000","last_active":"2023-08-17T00:15:39.262729+0000","last_peered":"2023-08-17T00:15:39.262729+0000","last_clean":"2023-08-17T00:15:39.262729+0000","last_became_active":"2023-08-17T00:15:39.262441+0000","last_became_peered":"2023-08-17T00:15:39.262441+0000","last_unstale":"2023-08-17T00:15:39.262729+0000","last_undegraded":"2023-08-17T00:15:39.262729+0000","last_fullsized":"2023-08-17T00:15:39.262729+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836084+0000","last_change":"2023-08-17T00:15:38.831869+0000","last_active":"2023-08-17T00:15:38.836084+0000","last_peered":"2023-08-17T00:15:38.836084+0000","last_clean":"2023-08-17T00:15:38.836084+0000","last_became_active":"2023-08-17T00:15:38.831558+0000","last_became_peered":"2023-08-17T00:15:38.831558+0000","last_unstale":"2023-08-17T00:15:38.836084+0000","last_undegraded":"2023-08-17T00:15:38.836084+0000","last_fullsized":"2023-08-17T00:15:38.836084+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.261642+0000","last_change":"2023-08-17T00:15:39.253611+0000","last_active":"2023-08-17T00:15:39.261642+0000","last_peered":"2023-08-17T00:15:39.261642+0000","last_clean":"2023-08-17T00:15:39.261642+0000","last_became_active":"2023-08-17T00:15:39.253316+0000","last_became_peered":"2023-08-17T00:15:39.253316+0000","last_unstale":"2023-08-17T00:15:39.261642+0000","last_undegraded":"2023-08-17T00:15:39.261642+0000","last_fullsized":"2023-08-17T00:15:39.261642+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.833434+0000","last_change":"2023-08-17T00:15:38.828386+0000","last_active":"2023-08-17T00:15:38.833434+0000","last_peered":"2023-08-17T00:15:38.833434+0000","last_clean":"2023-08-17T00:15:38.833434+0000","last_became_active":"2023-08-17T00:15:38.828103+0000","last_became_peered":"2023-08-17T00:15:38.828103+0000","last_unstale":"2023-08-17T00:15:38.833434+0000","last_undegraded":"2023-08-17T00:15:38.833434+0000","last_fullsized":"2023-08-17T00:15:38.833434+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.266813+0000","last_change":"2023-08-17T00:15:39.266813+0000","last_active":"2023-08-17T00:15:39.266813+0000","last_peered":"2023-08-17T00:15:39.266813+0000","last_clean":"2023-08-17T00:15:39.266813+0000","last_became_active":"2023-08-17T00:15:39.265912+0000","last_became_peered":"2023-08-17T00:15:39.265912+0000","last_unstale":"2023-08-17T00:15:39.266813+0000","last_undegraded":"2023-08-17T00:15:39.266813+0000","last_fullsized":"2023-08-17T00:15:39.266813+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835327+0000","last_change":"2023-08-17T00:15:38.823512+0000","last_active":"2023-08-17T00:15:38.835327+0000","last_peered":"2023-08-17T00:15:38.835327+0000","last_clean":"2023-08-17T00:15:38.835327+0000","last_became_active":"2023-08-17T00:15:38.823213+0000","last_became_peered":"2023-08-17T00:15:38.823213+0000","last_unstale":"2023-08-17T00:15:38.835327+0000","last_undegraded":"2023-08-17T00:15:38.835327+0000","last_fullsized":"2023-08-17T00:15:38.835327+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.272476+0000","last_change":"2023-08-17T00:15:39.272476+0000","last_active":"2023-08-17T00:15:39.272476+0000","last_peered":"2023-08-17T00:15:39.272476+0000","last_clean":"2023-08-17T00:15:39.272476+0000","last_became_active":"2023-08-17T00:15:39.272158+0000","last_became_peered":"2023-08-17T00:15:39.272158+0000","last_unstale":"2023-08-17T00:15:39.272476+0000","last_undegraded":"2023-08-17T00:15:39.272476+0000","last_fullsized":"2023-08-17T00:15:39.272476+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835644+0000","last_change":"2023-08-17T00:15:38.831197+0000","last_active":"2023-08-17T00:15:38.835644+0000","last_peered":"2023-08-17T00:15:38.835644+0000","last_clean":"2023-08-17T00:15:38.835644+0000","last_became_active":"2023-08-17T00:15:38.830940+0000","last_became_peered":"2023-08-17T00:15:38.830940+0000","last_unstale":"2023-08-17T00:15:38.835644+0000","last_undegraded":"2023-08-17T00:15:38.835644+0000","last_fullsized":"2023-08-17T00:15:38.835644+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269892+0000","last_change":"2023-08-17T00:15:39.269892+0000","last_active":"2023-08-17T00:15:39.269892+0000","last_peered":"2023-08-17T00:15:39.269892+0000","last_clean":"2023-08-17T00:15:39.269892+0000","last_became_active":"2023-08-17T00:15:39.269045+0000","last_became_peered":"2023-08-17T00:15:39.269045+0000","last_unstale":"2023-08-17T00:15:39.269892+0000","last_undegraded":"2023-08-17T00:15:39.269892+0000","last_fullsized":"2023-08-17T00:15:39.269892+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838100+0000","last_change":"2023-08-17T00:15:38.834273+0000","last_active":"2023-08-17T00:15:38.838100+0000","last_peered":"2023-08-17T00:15:38.838100+0000","last_clean":"2023-08-17T00:15:38.838100+0000","last_became_active":"2023-08-17T00:15:38.833616+0000","last_became_peered":"2023-08-17T00:15:38.833616+0000","last_unstale":"2023-08-17T00:15:38.838100+0000","last_undegraded":"2023-08-17T00:15:38.838100+0000","last_fullsized":"2023-08-17T00:15:38.838100+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262815+0000","last_change":"2023-08-17T00:15:39.262815+0000","last_active":"2023-08-17T00:15:39.262815+0000","last_peered":"2023-08-17T00:15:39.262815+0000","last_clean":"2023-08-17T00:15:39.262815+0000","last_became_active":"2023-08-17T00:15:39.262531+0000","last_became_peered":"2023-08-17T00:15:39.262531+0000","last_unstale":"2023-08-17T00:15:39.262815+0000","last_undegraded":"2023-08-17T00:15:39.262815+0000","last_fullsized":"2023-08-17T00:15:39.262815+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.248045+0000","last_change":"2023-08-17T00:15:38.829700+0000","last_active":"2023-08-17T00:15:39.248045+0000","last_peered":"2023-08-17T00:15:39.248045+0000","last_clean":"2023-08-17T00:15:39.248045+0000","last_became_active":"2023-08-17T00:15:38.829204+0000","last_became_peered":"2023-08-17T00:15:38.829204+0000","last_unstale":"2023-08-17T00:15:39.248045+0000","last_undegraded":"2023-08-17T00:15:39.248045+0000","last_fullsized":"2023-08-17T00:15:39.248045+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262674+0000","last_change":"2023-08-17T00:15:39.262674+0000","last_active":"2023-08-17T00:15:39.262674+0000","last_peered":"2023-08-17T00:15:39.262674+0000","last_clean":"2023-08-17T00:15:39.262674+0000","last_became_active":"2023-08-17T00:15:39.262377+0000","last_became_peered":"2023-08-17T00:15:39.262377+0000","last_unstale":"2023-08-17T00:15:39.262674+0000","last_undegraded":"2023-08-17T00:15:39.262674+0000","last_fullsized":"2023-08-17T00:15:39.262674+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.273063+0000","last_change":"2023-08-17T00:15:38.827580+0000","last_active":"2023-08-17T00:15:39.273063+0000","last_peered":"2023-08-17T00:15:39.273063+0000","last_clean":"2023-08-17T00:15:39.273063+0000","last_became_active":"2023-08-17T00:15:38.827263+0000","last_became_peered":"2023-08-17T00:15:38.827263+0000","last_unstale":"2023-08-17T00:15:39.273063+0000","last_undegraded":"2023-08-17T00:15:39.273063+0000","last_fullsized":"2023-08-17T00:15:39.273063+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269800+0000","last_change":"2023-08-17T00:15:39.269800+0000","last_active":"2023-08-17T00:15:39.269800+0000","last_peered":"2023-08-17T00:15:39.269800+0000","last_clean":"2023-08-17T00:15:39.269800+0000","last_became_active":"2023-08-17T00:15:39.269471+0000","last_became_peered":"2023-08-17T00:15:39.269471+0000","last_unstale":"2023-08-17T00:15:39.269800+0000","last_undegraded":"2023-08-17T00:15:39.269800+0000","last_fullsized":"2023-08-17T00:15:39.269800+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1d","version":"165'2","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269029+0000","last_change":"2023-08-17T00:15:38.818920+0000","last_active":"2023-08-17T00:15:39.269029+0000","last_peered":"2023-08-17T00:15:39.269029+0000","last_clean":"2023-08-17T00:15:39.269029+0000","last_became_active":"2023-08-17T00:15:38.818600+0000","last_became_peered":"2023-08-17T00:15:38.818600+0000","last_unstale":"2023-08-17T00:15:39.269029+0000","last_undegraded":"2023-08-17T00:15:39.269029+0000","last_fullsized":"2023-08-17T00:15:39.269029+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258138+0000","last_change":"2023-08-17T00:15:39.258138+0000","last_active":"2023-08-17T00:15:39.258138+0000","last_peered":"2023-08-17T00:15:39.258138+0000","last_clean":"2023-08-17T00:15:39.258138+0000","last_became_active":"2023-08-17T00:15:39.257857+0000","last_became_peered":"2023-08-17T00:15:39.257857+0000","last_unstale":"2023-08-17T00:15:39.258138+0000","last_undegraded":"2023-08-17T00:15:39.258138+0000","last_fullsized":"2023-08-17T00:15:39.258138+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838006+0000","last_change":"2023-08-17T00:15:38.833489+0000","last_active":"2023-08-17T00:15:38.838006+0000","last_peered":"2023-08-17T00:15:38.838006+0000","last_clean":"2023-08-17T00:15:38.838006+0000","last_became_active":"2023-08-17T00:15:38.832967+0000","last_became_peered":"2023-08-17T00:15:38.832967+0000","last_unstale":"2023-08-17T00:15:38.838006+0000","last_undegraded":"2023-08-17T00:15:38.838006+0000","last_fullsized":"2023-08-17T00:15:38.838006+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278632+0000","last_change":"2023-08-17T00:15:39.278632+0000","last_active":"2023-08-17T00:15:39.278632+0000","last_peered":"2023-08-17T00:15:39.278632+0000","last_clean":"2023-08-17T00:15:39.278632+0000","last_became_active":"2023-08-17T00:15:39.278286+0000","last_became_peered":"2023-08-17T00:15:39.278286+0000","last_unstale":"2023-08-17T00:15:39.278632+0000","last_undegraded":"2023-08-17T00:15:39.278632+0000","last_fullsized":"2023-08-17T00:15:39.278632+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838077+0000","last_change":"2023-08-17T00:15:38.834166+0000","last_active":"2023-08-17T00:15:38.838077+0000","last_peered":"2023-08-17T00:15:38.838077+0000","last_clean":"2023-08-17T00:15:38.838077+0000","last_became_active":"2023-08-17T00:15:38.833754+0000","last_became_peered":"2023-08-17T00:15:38.833754+0000","last_unstale":"2023-08-17T00:15:38.838077+0000","last_undegraded":"2023-08-17T00:15:38.838077+0000","last_fullsized":"2023-08-17T00:15:38.838077+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.271102+0000","last_change":"2023-08-17T00:15:39.271102+0000","last_active":"2023-08-17T00:15:39.271102+0000","last_peered":"2023-08-17T00:15:39.271102+0000","last_clean":"2023-08-17T00:15:39.271102+0000","last_became_active":"2023-08-17T00:15:39.270802+0000","last_became_peered":"2023-08-17T00:15:39.270802+0000","last_unstale":"2023-08-17T00:15:39.271102+0000","last_undegraded":"2023-08-17T00:15:39.271102+0000","last_fullsized":"2023-08-17T00:15:39.271102+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.243870+0000","last_change":"2023-08-17T00:15:38.822327+0000","last_active":"2023-08-17T00:15:39.243870+0000","last_peered":"2023-08-17T00:15:39.243870+0000","last_clean":"2023-08-17T00:15:39.243870+0000","last_became_active":"2023-08-17T00:15:38.822032+0000","last_became_peered":"2023-08-17T00:15:38.822032+0000","last_unstale":"2023-08-17T00:15:39.243870+0000","last_undegraded":"2023-08-17T00:15:39.243870+0000","last_fullsized":"2023-08-17T00:15:39.243870+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264624+0000","last_change":"2023-08-17T00:15:39.264624+0000","last_active":"2023-08-17T00:15:39.264624+0000","last_peered":"2023-08-17T00:15:39.264624+0000","last_clean":"2023-08-17T00:15:39.264624+0000","last_became_active":"2023-08-17T00:15:39.264019+0000","last_became_peered":"2023-08-17T00:15:39.264019+0000","last_unstale":"2023-08-17T00:15:39.264624+0000","last_undegraded":"2023-08-17T00:15:39.264624+0000","last_fullsized":"2023-08-17T00:15:39.264624+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.243800+0000","last_change":"2023-08-17T00:15:38.820005+0000","last_active":"2023-08-17T00:15:39.243800+0000","last_peered":"2023-08-17T00:15:39.243800+0000","last_clean":"2023-08-17T00:15:39.243800+0000","last_became_active":"2023-08-17T00:15:38.816549+0000","last_became_peered":"2023-08-17T00:15:38.816549+0000","last_unstale":"2023-08-17T00:15:39.243800+0000","last_undegraded":"2023-08-17T00:15:39.243800+0000","last_fullsized":"2023-08-17T00:15:39.243800+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.257681+0000","last_change":"2023-08-17T00:15:39.257681+0000","last_active":"2023-08-17T00:15:39.257681+0000","last_peered":"2023-08-17T00:15:39.257681+0000","last_clean":"2023-08-17T00:15:39.257681+0000","last_became_active":"2023-08-17T00:15:39.257378+0000","last_became_peered":"2023-08-17T00:15:39.257378+0000","last_unstale":"2023-08-17T00:15:39.257681+0000","last_undegraded":"2023-08-17T00:15:39.257681+0000","last_fullsized":"2023-08-17T00:15:39.257681+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.830550+0000","last_change":"2023-08-17T00:15:38.828682+0000","last_active":"2023-08-17T00:15:38.830550+0000","last_peered":"2023-08-17T00:15:38.830550+0000","last_clean":"2023-08-17T00:15:38.830550+0000","last_became_active":"2023-08-17T00:15:38.828362+0000","last_became_peered":"2023-08-17T00:15:38.828362+0000","last_unstale":"2023-08-17T00:15:38.830550+0000","last_undegraded":"2023-08-17T00:15:38.830550+0000","last_fullsized":"2023-08-17T00:15:38.830550+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.255588+0000","last_change":"2023-08-17T00:15:39.253527+0000","last_active":"2023-08-17T00:15:39.255588+0000","last_peered":"2023-08-17T00:15:39.255588+0000","last_clean":"2023-08-17T00:15:39.255588+0000","last_became_active":"2023-08-17T00:15:39.253230+0000","last_became_peered":"2023-08-17T00:15:39.253230+0000","last_unstale":"2023-08-17T00:15:39.255588+0000","last_undegraded":"2023-08-17T00:15:39.255588+0000","last_fullsized":"2023-08-17T00:15:39.255588+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.f","version":"165'1","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.274111+0000","last_change":"2023-08-17T00:15:38.831853+0000","last_active":"2023-08-17T00:15:39.274111+0000","last_peered":"2023-08-17T00:15:39.274111+0000","last_clean":"2023-08-17T00:15:39.274111+0000","last_became_active":"2023-08-17T00:15:38.829397+0000","last_became_peered":"2023-08-17T00:15:38.829397+0000","last_unstale":"2023-08-17T00:15:39.274111+0000","last_undegraded":"2023-08-17T00:15:39.274111+0000","last_fullsized":"2023-08-17T00:15:39.274111+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.263805+0000","last_change":"2023-08-17T00:15:39.263805+0000","last_active":"2023-08-17T00:15:39.263805+0000","last_peered":"2023-08-17T00:15:39.263805+0000","last_clean":"2023-08-17T00:15:39.263805+0000","last_became_active":"2023-08-17T00:15:39.263544+0000","last_became_peered":"2023-08-17T00:15:39.263544+0000","last_unstale":"2023-08-17T00:15:39.263805+0000","last_undegraded":"2023-08-17T00:15:39.263805+0000","last_fullsized":"2023-08-17T00:15:39.263805+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"165'2","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269733+0000","last_change":"2023-08-17T00:15:38.826155+0000","last_active":"2023-08-17T00:15:39.269733+0000","last_peered":"2023-08-17T00:15:39.269733+0000","last_clean":"2023-08-17T00:15:39.269733+0000","last_became_active":"2023-08-17T00:15:38.825823+0000","last_became_peered":"2023-08-17T00:15:38.825823+0000","last_unstale":"2023-08-17T00:15:39.269733+0000","last_undegraded":"2023-08-17T00:15:39.269733+0000","last_fullsized":"2023-08-17T00:15:39.269733+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.262871+0000","last_change":"2023-08-17T00:15:39.262871+0000","last_active":"2023-08-17T00:15:39.262871+0000","last_peered":"2023-08-17T00:15:39.262871+0000","last_clean":"2023-08-17T00:15:39.262871+0000","last_became_active":"2023-08-17T00:15:39.262450+0000","last_became_peered":"2023-08-17T00:15:39.262450+0000","last_unstale":"2023-08-17T00:15:39.262871+0000","last_undegraded":"2023-08-17T00:15:39.262871+0000","last_fullsized":"2023-08-17T00:15:39.262871+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.830560+0000","last_change":"2023-08-17T00:15:38.828554+0000","last_active":"2023-08-17T00:15:38.830560+0000","last_peered":"2023-08-17T00:15:38.830560+0000","last_clean":"2023-08-17T00:15:38.830560+0000","last_became_active":"2023-08-17T00:15:38.828271+0000","last_became_peered":"2023-08-17T00:15:38.828271+0000","last_unstale":"2023-08-17T00:15:38.830560+0000","last_undegraded":"2023-08-17T00:15:38.830560+0000","last_fullsized":"2023-08-17T00:15:38.830560+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.270321+0000","last_change":"2023-08-17T00:15:39.270321+0000","last_active":"2023-08-17T00:15:39.270321+0000","last_peered":"2023-08-17T00:15:39.270321+0000","last_clean":"2023-08-17T00:15:39.270321+0000","last_became_active":"2023-08-17T00:15:39.270065+0000","last_became_peered":"2023-08-17T00:15:39.270065+0000","last_unstale":"2023-08-17T00:15:39.270321+0000","last_undegraded":"2023-08-17T00:15:39.270321+0000","last_fullsized":"2023-08-17T00:15:39.270321+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.245103+0000","last_change":"2023-08-17T00:15:38.830042+0000","last_active":"2023-08-17T00:15:39.245103+0000","last_peered":"2023-08-17T00:15:39.245103+0000","last_clean":"2023-08-17T00:15:39.245103+0000","last_became_active":"2023-08-17T00:15:38.829747+0000","last_became_peered":"2023-08-17T00:15:38.829747+0000","last_unstale":"2023-08-17T00:15:39.245103+0000","last_undegraded":"2023-08-17T00:15:39.245103+0000","last_fullsized":"2023-08-17T00:15:39.245103+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259258+0000","last_change":"2023-08-17T00:15:39.259258+0000","last_active":"2023-08-17T00:15:39.259258+0000","last_peered":"2023-08-17T00:15:39.259258+0000","last_clean":"2023-08-17T00:15:39.259258+0000","last_became_active":"2023-08-17T00:15:39.258978+0000","last_became_peered":"2023-08-17T00:15:39.258978+0000","last_unstale":"2023-08-17T00:15:39.259258+0000","last_undegraded":"2023-08-17T00:15:39.259258+0000","last_fullsized":"2023-08-17T00:15:39.259258+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.b","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.247222+0000","last_change":"2023-08-17T00:15:38.827547+0000","last_active":"2023-08-17T00:15:39.247222+0000","last_peered":"2023-08-17T00:15:39.247222+0000","last_clean":"2023-08-17T00:15:39.247222+0000","last_became_active":"2023-08-17T00:15:38.825343+0000","last_became_peered":"2023-08-17T00:15:38.825343+0000","last_unstale":"2023-08-17T00:15:39.247222+0000","last_undegraded":"2023-08-17T00:15:39.247222+0000","last_fullsized":"2023-08-17T00:15:39.247222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264631+0000","last_change":"2023-08-17T00:15:39.264631+0000","last_active":"2023-08-17T00:15:39.264631+0000","last_peered":"2023-08-17T00:15:39.264631+0000","last_clean":"2023-08-17T00:15:39.264631+0000","last_became_active":"2023-08-17T00:15:39.264376+0000","last_became_peered":"2023-08-17T00:15:39.264376+0000","last_unstale":"2023-08-17T00:15:39.264631+0000","last_undegraded":"2023-08-17T00:15:39.264631+0000","last_fullsized":"2023-08-17T00:15:39.264631+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835895+0000","last_change":"2023-08-17T00:15:38.831149+0000","last_active":"2023-08-17T00:15:38.835895+0000","last_peered":"2023-08-17T00:15:38.835895+0000","last_clean":"2023-08-17T00:15:38.835895+0000","last_became_active":"2023-08-17T00:15:38.830745+0000","last_became_peered":"2023-08-17T00:15:38.830745+0000","last_unstale":"2023-08-17T00:15:38.835895+0000","last_undegraded":"2023-08-17T00:15:38.835895+0000","last_fullsized":"2023-08-17T00:15:38.835895+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265977+0000","last_change":"2023-08-17T00:15:39.265977+0000","last_active":"2023-08-17T00:15:39.265977+0000","last_peered":"2023-08-17T00:15:39.265977+0000","last_clean":"2023-08-17T00:15:39.265977+0000","last_became_active":"2023-08-17T00:15:39.265231+0000","last_became_peered":"2023-08-17T00:15:39.265231+0000","last_unstale":"2023-08-17T00:15:39.265977+0000","last_undegraded":"2023-08-17T00:15:39.265977+0000","last_fullsized":"2023-08-17T00:15:39.265977+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.832724+0000","last_change":"2023-08-17T00:15:38.825424+0000","last_active":"2023-08-17T00:15:38.832724+0000","last_peered":"2023-08-17T00:15:38.832724+0000","last_clean":"2023-08-17T00:15:38.832724+0000","last_became_active":"2023-08-17T00:15:38.825134+0000","last_became_peered":"2023-08-17T00:15:38.825134+0000","last_unstale":"2023-08-17T00:15:38.832724+0000","last_undegraded":"2023-08-17T00:15:38.832724+0000","last_fullsized":"2023-08-17T00:15:38.832724+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264276+0000","last_change":"2023-08-17T00:15:39.264276+0000","last_active":"2023-08-17T00:15:39.264276+0000","last_peered":"2023-08-17T00:15:39.264276+0000","last_clean":"2023-08-17T00:15:39.264276+0000","last_became_active":"2023-08-17T00:15:39.257258+0000","last_became_peered":"2023-08-17T00:15:39.257258+0000","last_unstale":"2023-08-17T00:15:39.264276+0000","last_undegraded":"2023-08-17T00:15:39.264276+0000","last_fullsized":"2023-08-17T00:15:39.264276+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.831374+0000","last_change":"2023-08-17T00:15:38.824508+0000","last_active":"2023-08-17T00:15:38.831374+0000","last_peered":"2023-08-17T00:15:38.831374+0000","last_clean":"2023-08-17T00:15:38.831374+0000","last_became_active":"2023-08-17T00:15:38.824195+0000","last_became_peered":"2023-08-17T00:15:38.824195+0000","last_unstale":"2023-08-17T00:15:38.831374+0000","last_undegraded":"2023-08-17T00:15:38.831374+0000","last_fullsized":"2023-08-17T00:15:38.831374+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.267809+0000","last_change":"2023-08-17T00:15:39.267809+0000","last_active":"2023-08-17T00:15:39.267809+0000","last_peered":"2023-08-17T00:15:39.267809+0000","last_clean":"2023-08-17T00:15:39.267809+0000","last_became_active":"2023-08-17T00:15:39.267532+0000","last_became_peered":"2023-08-17T00:15:39.267532+0000","last_unstale":"2023-08-17T00:15:39.267809+0000","last_undegraded":"2023-08-17T00:15:39.267809+0000","last_fullsized":"2023-08-17T00:15:39.267809+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"165'2","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.278768+0000","last_change":"2023-08-17T00:15:38.821637+0000","last_active":"2023-08-17T00:15:39.278768+0000","last_peered":"2023-08-17T00:15:39.278768+0000","last_clean":"2023-08-17T00:15:39.278768+0000","last_became_active":"2023-08-17T00:15:38.821068+0000","last_became_peered":"2023-08-17T00:15:38.821068+0000","last_unstale":"2023-08-17T00:15:39.278768+0000","last_undegraded":"2023-08-17T00:15:39.278768+0000","last_fullsized":"2023-08-17T00:15:39.278768+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.272845+0000","last_change":"2023-08-17T00:15:39.264759+0000","last_active":"2023-08-17T00:15:39.272845+0000","last_peered":"2023-08-17T00:15:39.272845+0000","last_clean":"2023-08-17T00:15:39.272845+0000","last_became_active":"2023-08-17T00:15:39.264391+0000","last_became_peered":"2023-08-17T00:15:39.264391+0000","last_unstale":"2023-08-17T00:15:39.272845+0000","last_undegraded":"2023-08-17T00:15:39.272845+0000","last_fullsized":"2023-08-17T00:15:39.272845+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836241+0000","last_change":"2023-08-17T00:15:38.829827+0000","last_active":"2023-08-17T00:15:38.836241+0000","last_peered":"2023-08-17T00:15:38.836241+0000","last_clean":"2023-08-17T00:15:38.836241+0000","last_became_active":"2023-08-17T00:15:38.825774+0000","last_became_peered":"2023-08-17T00:15:38.825774+0000","last_unstale":"2023-08-17T00:15:38.836241+0000","last_undegraded":"2023-08-17T00:15:38.836241+0000","last_fullsized":"2023-08-17T00:15:38.836241+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.266876+0000","last_change":"2023-08-17T00:15:39.258561+0000","last_active":"2023-08-17T00:15:39.266876+0000","last_peered":"2023-08-17T00:15:39.266876+0000","last_clean":"2023-08-17T00:15:39.266876+0000","last_became_active":"2023-08-17T00:15:39.258222+0000","last_became_peered":"2023-08-17T00:15:39.258222+0000","last_unstale":"2023-08-17T00:15:39.266876+0000","last_undegraded":"2023-08-17T00:15:39.266876+0000","last_fullsized":"2023-08-17T00:15:39.266876+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.245819+0000","last_change":"2023-08-17T00:15:38.824344+0000","last_active":"2023-08-17T00:15:39.245819+0000","last_peered":"2023-08-17T00:15:39.245819+0000","last_clean":"2023-08-17T00:15:39.245819+0000","last_became_active":"2023-08-17T00:15:38.824043+0000","last_became_peered":"2023-08-17T00:15:38.824043+0000","last_unstale":"2023-08-17T00:15:39.245819+0000","last_undegraded":"2023-08-17T00:15:39.245819+0000","last_fullsized":"2023-08-17T00:15:39.245819+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259401+0000","last_change":"2023-08-17T00:15:39.259401+0000","last_active":"2023-08-17T00:15:39.259401+0000","last_peered":"2023-08-17T00:15:39.259401+0000","last_clean":"2023-08-17T00:15:39.259401+0000","last_became_active":"2023-08-17T00:15:39.259076+0000","last_became_peered":"2023-08-17T00:15:39.259076+0000","last_unstale":"2023-08-17T00:15:39.259401+0000","last_undegraded":"2023-08-17T00:15:39.259401+0000","last_fullsized":"2023-08-17T00:15:39.259401+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.245247+0000","last_change":"2023-08-17T00:15:38.822804+0000","last_active":"2023-08-17T00:15:39.245247+0000","last_peered":"2023-08-17T00:15:39.245247+0000","last_clean":"2023-08-17T00:15:39.245247+0000","last_became_active":"2023-08-17T00:15:38.822464+0000","last_became_peered":"2023-08-17T00:15:38.822464+0000","last_unstale":"2023-08-17T00:15:39.245247+0000","last_undegraded":"2023-08-17T00:15:39.245247+0000","last_fullsized":"2023-08-17T00:15:39.245247+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.257589+0000","last_change":"2023-08-17T00:15:39.257589+0000","last_active":"2023-08-17T00:15:39.257589+0000","last_peered":"2023-08-17T00:15:39.257589+0000","last_clean":"2023-08-17T00:15:39.257589+0000","last_became_active":"2023-08-17T00:15:39.257286+0000","last_became_peered":"2023-08-17T00:15:39.257286+0000","last_unstale":"2023-08-17T00:15:39.257589+0000","last_undegraded":"2023-08-17T00:15:39.257589+0000","last_fullsized":"2023-08-17T00:15:39.257589+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.830633+0000","last_change":"2023-08-17T00:15:38.821556+0000","last_active":"2023-08-17T00:15:38.830633+0000","last_peered":"2023-08-17T00:15:38.830633+0000","last_clean":"2023-08-17T00:15:38.830633+0000","last_became_active":"2023-08-17T00:15:38.821250+0000","last_became_peered":"2023-08-17T00:15:38.821250+0000","last_unstale":"2023-08-17T00:15:38.830633+0000","last_undegraded":"2023-08-17T00:15:38.830633+0000","last_fullsized":"2023-08-17T00:15:38.830633+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.268355+0000","last_change":"2023-08-17T00:15:39.268355+0000","last_active":"2023-08-17T00:15:39.268355+0000","last_peered":"2023-08-17T00:15:39.268355+0000","last_clean":"2023-08-17T00:15:39.268355+0000","last_became_active":"2023-08-17T00:15:39.267931+0000","last_became_peered":"2023-08-17T00:15:39.267931+0000","last_unstale":"2023-08-17T00:15:39.268355+0000","last_undegraded":"2023-08-17T00:15:39.268355+0000","last_fullsized":"2023-08-17T00:15:39.268355+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.838125+0000","last_change":"2023-08-17T00:15:38.834288+0000","last_active":"2023-08-17T00:15:38.838125+0000","last_peered":"2023-08-17T00:15:38.838125+0000","last_clean":"2023-08-17T00:15:38.838125+0000","last_became_active":"2023-08-17T00:15:38.833986+0000","last_became_peered":"2023-08-17T00:15:38.833986+0000","last_unstale":"2023-08-17T00:15:38.838125+0000","last_undegraded":"2023-08-17T00:15:38.838125+0000","last_fullsized":"2023-08-17T00:15:38.838125+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.275068+0000","last_change":"2023-08-17T00:15:39.274431+0000","last_active":"2023-08-17T00:15:39.275068+0000","last_peered":"2023-08-17T00:15:39.275068+0000","last_clean":"2023-08-17T00:15:39.275068+0000","last_became_active":"2023-08-17T00:15:39.274100+0000","last_became_peered":"2023-08-17T00:15:39.274100+0000","last_unstale":"2023-08-17T00:15:39.275068+0000","last_undegraded":"2023-08-17T00:15:39.275068+0000","last_fullsized":"2023-08-17T00:15:39.275068+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835569+0000","last_change":"2023-08-17T00:15:38.830059+0000","last_active":"2023-08-17T00:15:38.835569+0000","last_peered":"2023-08-17T00:15:38.835569+0000","last_clean":"2023-08-17T00:15:38.835569+0000","last_became_active":"2023-08-17T00:15:38.829711+0000","last_became_peered":"2023-08-17T00:15:38.829711+0000","last_unstale":"2023-08-17T00:15:38.835569+0000","last_undegraded":"2023-08-17T00:15:38.835569+0000","last_fullsized":"2023-08-17T00:15:38.835569+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.264495+0000","last_change":"2023-08-17T00:15:39.264495+0000","last_active":"2023-08-17T00:15:39.264495+0000","last_peered":"2023-08-17T00:15:39.264495+0000","last_clean":"2023-08-17T00:15:39.264495+0000","last_became_active":"2023-08-17T00:15:39.264242+0000","last_became_peered":"2023-08-17T00:15:39.264242+0000","last_unstale":"2023-08-17T00:15:39.264495+0000","last_undegraded":"2023-08-17T00:15:39.264495+0000","last_fullsized":"2023-08-17T00:15:39.264495+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.831714+0000","last_change":"2023-08-17T00:15:38.826420+0000","last_active":"2023-08-17T00:15:38.831714+0000","last_peered":"2023-08-17T00:15:38.831714+0000","last_clean":"2023-08-17T00:15:38.831714+0000","last_became_active":"2023-08-17T00:15:38.826127+0000","last_became_peered":"2023-08-17T00:15:38.826127+0000","last_unstale":"2023-08-17T00:15:38.831714+0000","last_undegraded":"2023-08-17T00:15:38.831714+0000","last_fullsized":"2023-08-17T00:15:38.831714+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.261259+0000","last_change":"2023-08-17T00:15:39.261259+0000","last_active":"2023-08-17T00:15:39.261259+0000","last_peered":"2023-08-17T00:15:39.261259+0000","last_clean":"2023-08-17T00:15:39.261259+0000","last_became_active":"2023-08-17T00:15:39.260994+0000","last_became_peered":"2023-08-17T00:15:39.260994+0000","last_unstale":"2023-08-17T00:15:39.261259+0000","last_undegraded":"2023-08-17T00:15:39.261259+0000","last_fullsized":"2023-08-17T00:15:39.261259+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.828952+0000","last_change":"2023-08-17T00:15:38.820194+0000","last_active":"2023-08-17T00:15:38.828952+0000","last_peered":"2023-08-17T00:15:38.828952+0000","last_clean":"2023-08-17T00:15:38.828952+0000","last_became_active":"2023-08-17T00:15:38.819798+0000","last_became_peered":"2023-08-17T00:15:38.819798+0000","last_unstale":"2023-08-17T00:15:38.828952+0000","last_undegraded":"2023-08-17T00:15:38.828952+0000","last_fullsized":"2023-08-17T00:15:38.828952+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.813746+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:15:38.813746+0000","last_peered":"2023-08-17T00:15:38.813746+0000","last_clean":"2023-08-17T00:15:38.813746+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:15:38.813746+0000","last_undegraded":"2023-08-17T00:15:38.813746+0000","last_fullsized":"2023-08-17T00:15:38.813746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258171+0000","last_change":"2023-08-17T00:15:39.258171+0000","last_active":"2023-08-17T00:15:39.258171+0000","last_peered":"2023-08-17T00:15:39.258171+0000","last_clean":"2023-08-17T00:15:39.258171+0000","last_became_active":"2023-08-17T00:15:39.257780+0000","last_became_peered":"2023-08-17T00:15:39.257780+0000","last_unstale":"2023-08-17T00:15:39.258171+0000","last_undegraded":"2023-08-17T00:15:39.258171+0000","last_fullsized":"2023-08-17T00:15:39.258171+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.13","version":"165'1","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.247169+0000","last_change":"2023-08-17T00:15:38.817521+0000","last_active":"2023-08-17T00:15:39.247169+0000","last_peered":"2023-08-17T00:15:39.247169+0000","last_clean":"2023-08-17T00:15:39.247169+0000","last_became_active":"2023-08-17T00:15:38.817201+0000","last_became_peered":"2023-08-17T00:15:38.817201+0000","last_unstale":"2023-08-17T00:15:39.247169+0000","last_undegraded":"2023-08-17T00:15:39.247169+0000","last_fullsized":"2023-08-17T00:15:39.247169+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":157,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.245973+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:15:39.245973+0000","last_peered":"2023-08-17T00:15:39.245973+0000","last_clean":"2023-08-17T00:15:39.245973+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:15:39.245973+0000","last_undegraded":"2023-08-17T00:15:39.245973+0000","last_fullsized":"2023-08-17T00:15:39.245973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.259904+0000","last_change":"2023-08-17T00:15:39.259904+0000","last_active":"2023-08-17T00:15:39.259904+0000","last_peered":"2023-08-17T00:15:39.259904+0000","last_clean":"2023-08-17T00:15:39.259904+0000","last_became_active":"2023-08-17T00:15:39.259639+0000","last_became_peered":"2023-08-17T00:15:39.259639+0000","last_unstale":"2023-08-17T00:15:39.259904+0000","last_undegraded":"2023-08-17T00:15:39.259904+0000","last_fullsized":"2023-08-17T00:15:39.259904+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.10","version":"165'4","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.266876+0000","last_change":"2023-08-17T00:15:38.828999+0000","last_active":"2023-08-17T00:15:39.266876+0000","last_peered":"2023-08-17T00:15:39.266876+0000","last_clean":"2023-08-17T00:15:39.266876+0000","last_became_active":"2023-08-17T00:15:38.828674+0000","last_became_peered":"2023-08-17T00:15:38.828674+0000","last_unstale":"2023-08-17T00:15:39.266876+0000","last_undegraded":"2023-08-17T00:15:39.266876+0000","last_fullsized":"2023-08-17T00:15:39.266876+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.811315+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:15:38.811315+0000","last_peered":"2023-08-17T00:15:38.811315+0000","last_clean":"2023-08-17T00:15:38.811315+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:15:38.811315+0000","last_undegraded":"2023-08-17T00:15:38.811315+0000","last_fullsized":"2023-08-17T00:15:38.811315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.258865+0000","last_change":"2023-08-17T00:15:39.258865+0000","last_active":"2023-08-17T00:15:39.258865+0000","last_peered":"2023-08-17T00:15:39.258865+0000","last_clean":"2023-08-17T00:15:39.258865+0000","last_became_active":"2023-08-17T00:15:39.258564+0000","last_became_peered":"2023-08-17T00:15:39.258564+0000","last_unstale":"2023-08-17T00:15:39.258865+0000","last_undegraded":"2023-08-17T00:15:39.258865+0000","last_fullsized":"2023-08-17T00:15:39.258865+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.835383+0000","last_change":"2023-08-17T00:15:38.824255+0000","last_active":"2023-08-17T00:15:38.835383+0000","last_peered":"2023-08-17T00:15:38.835383+0000","last_clean":"2023-08-17T00:15:38.835383+0000","last_became_active":"2023-08-17T00:15:38.823980+0000","last_became_peered":"2023-08-17T00:15:38.823980+0000","last_unstale":"2023-08-17T00:15:38.835383+0000","last_undegraded":"2023-08-17T00:15:38.835383+0000","last_fullsized":"2023-08-17T00:15:38.835383+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":149,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.802652+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:15:38.802652+0000","last_peered":"2023-08-17T00:15:38.802652+0000","last_clean":"2023-08-17T00:15:38.802652+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:15:38.802652+0000","last_undegraded":"2023-08-17T00:15:38.802652+0000","last_fullsized":"2023-08-17T00:15:38.802652+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.268884+0000","last_change":"2023-08-17T00:15:39.268884+0000","last_active":"2023-08-17T00:15:39.268884+0000","last_peered":"2023-08-17T00:15:39.268884+0000","last_clean":"2023-08-17T00:15:39.268884+0000","last_became_active":"2023-08-17T00:15:39.268620+0000","last_became_peered":"2023-08-17T00:15:39.268620+0000","last_unstale":"2023-08-17T00:15:39.268884+0000","last_undegraded":"2023-08-17T00:15:39.268884+0000","last_fullsized":"2023-08-17T00:15:39.268884+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836636+0000","last_change":"2023-08-17T00:15:38.830084+0000","last_active":"2023-08-17T00:15:38.836636+0000","last_peered":"2023-08-17T00:15:38.836636+0000","last_clean":"2023-08-17T00:15:38.836636+0000","last_became_active":"2023-08-17T00:15:38.829801+0000","last_became_peered":"2023-08-17T00:15:38.829801+0000","last_unstale":"2023-08-17T00:15:38.836636+0000","last_undegraded":"2023-08-17T00:15:38.836636+0000","last_fullsized":"2023-08-17T00:15:38.836636+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.808900+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:15:38.808900+0000","last_peered":"2023-08-17T00:15:38.808900+0000","last_clean":"2023-08-17T00:15:38.808900+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:15:38.808900+0000","last_undegraded":"2023-08-17T00:15:38.808900+0000","last_fullsized":"2023-08-17T00:15:38.808900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.265377+0000","last_change":"2023-08-17T00:15:39.265377+0000","last_active":"2023-08-17T00:15:39.265377+0000","last_peered":"2023-08-17T00:15:39.265377+0000","last_clean":"2023-08-17T00:15:39.265377+0000","last_became_active":"2023-08-17T00:15:39.265060+0000","last_became_peered":"2023-08-17T00:15:39.265060+0000","last_unstale":"2023-08-17T00:15:39.265377+0000","last_undegraded":"2023-08-17T00:15:39.265377+0000","last_fullsized":"2023-08-17T00:15:39.265377+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"165'2","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.269535+0000","last_change":"2023-08-17T00:15:38.823674+0000","last_active":"2023-08-17T00:15:39.269535+0000","last_peered":"2023-08-17T00:15:39.269535+0000","last_clean":"2023-08-17T00:15:39.269535+0000","last_became_active":"2023-08-17T00:15:38.823384+0000","last_became_peered":"2023-08-17T00:15:38.823384+0000","last_unstale":"2023-08-17T00:15:39.269535+0000","last_undegraded":"2023-08-17T00:15:39.269535+0000","last_fullsized":"2023-08-17T00:15:39.269535+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":129,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.819515+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:15:38.819515+0000","last_peered":"2023-08-17T00:15:38.819515+0000","last_clean":"2023-08-17T00:15:38.819515+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:15:38.819515+0000","last_undegraded":"2023-08-17T00:15:38.819515+0000","last_fullsized":"2023-08-17T00:15:38.819515+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.271376+0000","last_change":"2023-08-17T00:15:39.271376+0000","last_active":"2023-08-17T00:15:39.271376+0000","last_peered":"2023-08-17T00:15:39.271376+0000","last_clean":"2023-08-17T00:15:39.271376+0000","last_became_active":"2023-08-17T00:15:39.270676+0000","last_became_peered":"2023-08-17T00:15:39.270676+0000","last_unstale":"2023-08-17T00:15:39.271376+0000","last_undegraded":"2023-08-17T00:15:39.271376+0000","last_fullsized":"2023-08-17T00:15:39.271376+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.15","version":"165'3","reported_seq":12,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.267920+0000","last_change":"2023-08-17T00:15:38.831617+0000","last_active":"2023-08-17T00:15:39.267920+0000","last_peered":"2023-08-17T00:15:39.267920+0000","last_clean":"2023-08-17T00:15:39.267920+0000","last_became_active":"2023-08-17T00:15:38.828214+0000","last_became_peered":"2023-08-17T00:15:38.828214+0000","last_unstale":"2023-08-17T00:15:39.267920+0000","last_undegraded":"2023-08-17T00:15:39.267920+0000","last_fullsized":"2023-08-17T00:15:39.267920+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.812034+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:15:38.812034+0000","last_peered":"2023-08-17T00:15:38.812034+0000","last_clean":"2023-08-17T00:15:38.812034+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:15:38.812034+0000","last_undegraded":"2023-08-17T00:15:38.812034+0000","last_fullsized":"2023-08-17T00:15:38.812034+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-08-17T00:15:39.261161+0000","last_change":"2023-08-17T00:15:39.261161+0000","last_active":"2023-08-17T00:15:39.261161+0000","last_peered":"2023-08-17T00:15:39.261161+0000","last_clean":"2023-08-17T00:15:39.261161+0000","last_became_active":"2023-08-17T00:15:39.260459+0000","last_became_peered":"2023-08-17T00:15:39.260459+0000","last_unstale":"2023-08-17T00:15:39.261161+0000","last_undegraded":"2023-08-17T00:15:39.261161+0000","last_fullsized":"2023-08-17T00:15:39.261161+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:38.788461+0000","last_clean_scrub_stamp":"2023-08-17T00:15:38.788461+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.836903+0000","last_change":"2023-08-17T00:15:38.832580+0000","last_active":"2023-08-17T00:15:38.836903+0000","last_peered":"2023-08-17T00:15:38.836903+0000","last_clean":"2023-08-17T00:15:38.836903+0000","last_became_active":"2023-08-17T00:15:38.832247+0000","last_became_peered":"2023-08-17T00:15:38.832247+0000","last_unstale":"2023-08-17T00:15:38.836903+0000","last_undegraded":"2023-08-17T00:15:38.836903+0000","last_fullsized":"2023-08-17T00:15:38.836903+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:15:37.777219+0000","last_clean_scrub_stamp":"2023-08-17T00:15:37.777219+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":130,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.814160+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:15:38.814160+0000","last_peered":"2023-08-17T00:15:38.814160+0000","last_clean":"2023-08-17T00:15:38.814160+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:15:38.814160+0000","last_undegraded":"2023-08-17T00:15:38.814160+0000","last_fullsized":"2023-08-17T00:15:38.814160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":133,"reported_epoch":164,"state":"active+clean","last_fresh":"2023-08-17T00:15:38.813034+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:15:38.813034+0000","last_peered":"2023-08-17T00:15:38.813034+0000","last_clean":"2023-08-17T00:15:38.813034+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:15:38.813034+0000","last_undegraded":"2023-08-17T00:15:38.813034+0000","last_fullsized":"2023-08-17T00:15:38.813034+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315600,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056240,"statfs":{"total":96636764160,"available":96313589760,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.026,"15min":1.151},"min":{"1min":0.72399999999999998,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.6539999999999999,"5min":2.2639999999999998,"15min":8.7769999999999992},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.091,"5min":1.0349999999999999,"15min":1.1799999999999999},"min":{"1min":0.68700000000000006,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.4810000000000001,"5min":2.6400000000000001,"15min":9.6530000000000005},"last":1.1579999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.077,"15min":1.214},"min":{"1min":0.93400000000000005,"5min":0.53700000000000003,"15min":0.48199999999999998},"max":{"1min":1.5329999999999999,"5min":3.1030000000000002,"15min":9.8800000000000008},"last":1.383},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1100000000000001,"15min":1.212},"min":{"1min":0.85699999999999998,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.359,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.0720000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0509999999999999,"15min":1.1359999999999999},"min":{"1min":0.91700000000000004,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.3240000000000001,"5min":2.4910000000000001,"15min":7.0190000000000001},"last":1.018},{"interface":"front","average":{"1min":1.167,"5min":1.1180000000000001,"15min":1.264},"min":{"1min":0.73599999999999999,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.51,"5min":1.8999999999999999,"15min":9.4239999999999995},"last":1.617}]},{"osd":3,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1160000000000001,"15min":1.1910000000000001},"min":{"1min":1.014,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.595,"5min":2.3769999999999998,"15min":7.7080000000000002},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.167,"15min":1.391},"min":{"1min":0.86199999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.4750000000000001,"5min":1.952,"15min":13.074999999999999},"last":1.5680000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.109,"15min":1.3280000000000001},"min":{"1min":0.68799999999999994,"5min":0.62,"15min":0.62},"max":{"1min":1.5089999999999999,"5min":2.5870000000000002,"15min":13.784000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.1910000000000001,"5min":1.1379999999999999,"15min":1.3009999999999999},"min":{"1min":0.80500000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.6419999999999999,"5min":2.6869999999999998,"15min":10.045999999999999},"last":1.331}]},{"osd":5,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.198,"15min":1.4450000000000001},"min":{"1min":0.84999999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.629,"5min":2.9830000000000001,"15min":14.435},"last":1.657},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.234,"15min":1.4359999999999999},"min":{"1min":0.88200000000000001,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.7829999999999999,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.23}]},{"osd":6,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2689999999999999,"15min":1.4650000000000001},"min":{"1min":0.77700000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.8640000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.484},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.204,"15min":1.397},"min":{"1min":0.99299999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.4019999999999999,"5min":2.4350000000000001,"15min":11.365},"last":1.5940000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542301,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315612,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056228,"statfs":{"total":96636764160,"available":96313577472,"internally_reserved":0,"allocated":2052096,"data_stored":963323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.056},"min":{"1min":0.78300000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.27,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":0.752},{"interface":"front","average":{"1min":1.014,"5min":0.99299999999999999,"15min":1.1120000000000001},"min":{"1min":0.755,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.3420000000000001,"5min":1.4890000000000001,"15min":10.519},"last":0.66000000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.054,"15min":1.141},"min":{"1min":0.66500000000000004,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.379,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.073,"5min":1.038,"15min":1.0569999999999999},"min":{"1min":0.749,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":11.391999999999999},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.131,"15min":1.165},"min":{"1min":0.94799999999999995,"5min":0.54800000000000004,"15min":0.372},"max":{"1min":1.5309999999999999,"5min":1.8540000000000001,"15min":5.3799999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.1899999999999999,"15min":1.2789999999999999},"min":{"1min":0.90800000000000003,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.5640000000000001,"5min":1.708,"15min":10.669},"last":1.1719999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1870000000000001,"15min":1.1859999999999999},"min":{"1min":0.85699999999999998,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":2.1509999999999998,"5min":3.4809999999999999,"15min":11.475},"last":0.87},{"interface":"front","average":{"1min":1.304,"5min":1.232,"15min":1.258},"min":{"1min":0.874,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":2.101,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.1579999999999999,"15min":1.268},"min":{"1min":0.91000000000000003,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.758,"5min":1.992,"15min":10.632},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.206,"5min":1.147,"15min":1.234},"min":{"1min":0.88800000000000001,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":11.438000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.21,"15min":1.256},"min":{"1min":0.90800000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.407,"5min":1.306,"15min":1.3759999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":1.258}]},{"osd":7,"last update":"Thu Aug 17 00:15:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.256,"15min":1.3280000000000001},"min":{"1min":0.74299999999999999,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":2.3519999999999999,"5min":2.3519999999999999,"15min":11.51},"last":1.002},{"interface":"front","average":{"1min":1.413,"5min":1.3240000000000001,"15min":1.3899999999999999},"min":{"1min":0.99199999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":2.532,"5min":2.532,"15min":5.4100000000000001},"last":1.0629999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":2052096,"data_stored":963323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0069999999999999,"15min":1.214},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.679,"5min":2.1389999999999998,"15min":15.007999999999999},"last":1.333},{"interface":"front","average":{"1min":1.054,"5min":1.083,"15min":1.3049999999999999},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.3220000000000001,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.238}]},{"osd":1,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.097,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.4419999999999999,"5min":1.746,"15min":4.2270000000000003},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.1140000000000001,"15min":1.2410000000000001},"min":{"1min":0.66200000000000003,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.379,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.175}]},{"osd":2,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.143,"15min":1.3720000000000001},"min":{"1min":0.69699999999999995,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5009999999999999,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.02},{"interface":"front","average":{"1min":1.159,"5min":1.137,"15min":1.302},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.647,"5min":1.796,"15min":11.949},"last":0.96499999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2010000000000001,"15min":1.351},"min":{"1min":0.77500000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5349999999999999,"5min":4.3250000000000002,"15min":13.125},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.214,"15min":1.3120000000000001},"min":{"1min":0.748,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.4910000000000001,"5min":2.306,"15min":8.4809999999999999},"last":1.21}]},{"osd":4,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.1399999999999999,"15min":1.397},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.452,"5min":2.2789999999999999,"15min":17.510000000000002},"last":1.077},{"interface":"front","average":{"1min":1.208,"5min":1.228,"15min":1.5089999999999999},"min":{"1min":0.64500000000000002,"5min":0.61299999999999999,"15min":0.54000000000000004},"max":{"1min":1.4710000000000001,"5min":4.8170000000000002,"15min":19.591000000000001},"last":0.93300000000000005}]},{"osd":6,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.2310000000000001,"15min":1.4910000000000001},"min":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.5680000000000001,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.28},{"interface":"front","average":{"1min":1.123,"5min":1.212,"15min":1.4830000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.5049999999999999,"5min":3.4159999999999999,"15min":17.050000000000001},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.327,"15min":1.601},"min":{"1min":0.85299999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.629,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.1060000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.353,"15min":1.573},"min":{"1min":0.91300000000000003,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.615,"5min":2.0899999999999999,"15min":14.818},"last":1.3580000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542301,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307408,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064432,"statfs":{"total":96636764160,"available":96321978368,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80200000000000005,"15min":0.79100000000000004},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.1040000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.872,"5min":0.89500000000000002,"15min":0.85899999999999999},"min":{"1min":0.58799999999999997,"5min":0.50900000000000001,"15min":0.38100000000000001},"max":{"1min":1.1399999999999999,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.097}]},{"osd":1,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.3160000000000001,"5min":3.274,"15min":11.215999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.877,"15min":0.88800000000000001},"min":{"1min":0.66100000000000003,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.073,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.2210000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.59499999999999997,"5min":0.48199999999999998,"15min":0.33800000000000002},"max":{"1min":1.143,"5min":1.587,"15min":2.0270000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.0129999999999999,"15min":1.03},"min":{"1min":0.57999999999999996,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.413,"5min":1.4750000000000001,"15min":2.6360000000000001},"last":1.306}]},{"osd":4,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.1930000000000001,"15min":1.198},"min":{"1min":0.79800000000000004,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.4790000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.143,"5min":1.1759999999999999,"15min":1.196},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.575,"5min":1.5860000000000001,"15min":3.9790000000000001},"last":1.258}]},{"osd":5,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.1399999999999999,"15min":1.1890000000000001},"min":{"1min":0.623,"5min":0.61899999999999999,"15min":0.54600000000000004},"max":{"1min":1.5329999999999999,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.2210000000000001,"15min":1.246},"min":{"1min":1.0389999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.516,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.373}]},{"osd":6,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1890000000000001,"15min":1.2210000000000001},"min":{"1min":0.99199999999999999,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.611,"5min":1.702,"15min":3.4249999999999998},"last":1.423},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.2070000000000001,"15min":1.1970000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.891,"5min":1.968,"15min":3.585},"last":1.2809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2370000000000001,"15min":1.2330000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.996,"5min":1.996,"15min":2.1930000000000001},"last":1.204},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1890000000000001,"15min":1.212},"min":{"1min":0.67300000000000004,"5min":0.66000000000000003,"15min":0.64000000000000001},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":2.0419999999999998},"last":1.071}]}]},{"osd":2,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311516,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060324,"statfs":{"total":96636764160,"available":96317771776,"internally_reserved":0,"allocated":2052096,"data_stored":963323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.2589999999999999,"5min":2.4319999999999999,"15min":3.1099999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.80400000000000005,"15min":0.873},"min":{"1min":0.60199999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.3280000000000001,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":1.1899999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.86099999999999999,"15min":0.874},"min":{"1min":0.441,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.5529999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.04,"15min":1.028},"min":{"1min":0.66200000000000003,"5min":0.40699999999999997,"15min":0.376},"max":{"1min":1.6879999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.69499999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":0.96699999999999997,"15min":1.048},"min":{"1min":0.73299999999999998,"5min":0.44900000000000001,"15min":0.42899999999999999},"max":{"1min":1.3340000000000001,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":1.147},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.93799999999999994,"15min":0.95199999999999996},"min":{"1min":0.58199999999999996,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.476,"5min":2.5049999999999999,"15min":3.3410000000000002},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2629999999999999,"15min":1.429},"min":{"1min":0.69999999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.571,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.6910000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.375,"15min":1.4019999999999999},"min":{"1min":0.88200000000000001,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":2.0600000000000001,"5min":17.988,"15min":17.988},"last":1.496}]},{"osd":5,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.294,"15min":1.4590000000000001},"min":{"1min":0.94899999999999995,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.629,"5min":1.873,"15min":12.914},"last":1.599},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.232,"15min":1.3380000000000001},"min":{"1min":0.85699999999999998,"5min":0.70699999999999996,"15min":0.64200000000000002},"max":{"1min":1.5349999999999999,"5min":2.7290000000000001,"15min":9.5519999999999996},"last":1.4430000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.1559999999999999,"15min":1.381},"min":{"1min":0.751,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.5169999999999999,"5min":1.621,"15min":13.864000000000001},"last":1.7789999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.2829999999999999,"15min":1.4530000000000001},"min":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6100000000000001,"5min":1.9359999999999999,"15min":12.698},"last":1.6399999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:17 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.3160000000000001,"15min":1.45},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.6779999999999999,"15min":10.592000000000001},"last":1.54},{"interface":"front","average":{"1min":1.349,"5min":1.298,"15min":1.456},"min":{"1min":0.81100000000000005,"5min":0.77600000000000002,"15min":0.54100000000000004},"max":{"1min":1.6100000000000001,"5min":1.9159999999999999,"15min":11.417},"last":1.891}]}]},{"osd":1,"up_from":14,"seq":60129542301,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.64800000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.101,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.123},{"interface":"front","average":{"1min":1.028,"5min":0.88200000000000001,"15min":0.90600000000000003},"min":{"1min":0.68400000000000005,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":13.093},"last":0.93899999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60699999999999998,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.3069999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.875,"15min":0.88800000000000001},"min":{"1min":0.59799999999999998,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.6930000000000001,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.98499999999999999,"15min":1.0129999999999999},"min":{"1min":0.71599999999999997,"5min":0.55700000000000005,"15min":0.437},"max":{"1min":1.2829999999999999,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":0.995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":0.90900000000000003,"15min":0.94999999999999996},"min":{"1min":0.68700000000000006,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.359,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.0369999999999999,"15min":1.1379999999999999},"min":{"1min":0.83799999999999997,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.659,"5min":1.671,"15min":20.548999999999999},"last":1.552},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.165,"15min":1.2010000000000001},"min":{"1min":1.004,"5min":0.72499999999999998,"15min":0.59699999999999998},"max":{"1min":1.8300000000000001,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.5169999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.228,"15min":1.294},"min":{"1min":0.999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0830000000000002,"5min":3.137,"15min":13.170999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.196,"15min":1.2390000000000001},"min":{"1min":1.0509999999999999,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.8009999999999999,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.369}]},{"osd":6,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.224,"15min":1.248},"min":{"1min":1.054,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.9730000000000001,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.2,"15min":1.206},"min":{"1min":0.93600000000000005,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.8740000000000001,"5min":2.472,"15min":5.5359999999999996},"last":1.202}]},{"osd":7,"last update":"Thu Aug 17 00:15:01 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2909999999999999,"15min":1.3},"min":{"1min":0.98299999999999998,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.8959999999999999,"5min":4.6289999999999996,"15min":6.9779999999999998},"last":1.675},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.3240000000000001},"min":{"1min":1.073,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7290000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.2769999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542302,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311504,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060336,"statfs":{"total":96636764160,"available":96317784064,"internally_reserved":0,"allocated":2039808,"data_stored":956644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97199999999999998,"15min":0.83099999999999996},"min":{"1min":0.51300000000000001,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.3080000000000001,"5min":18.442,"15min":18.442},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.92000000000000004,"15min":0.83599999999999997},"min":{"1min":0.58499999999999996,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.264,"5min":7.9720000000000004,"15min":7.9720000000000004},"last":1.002}]},{"osd":2,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":1.073,"15min":0.94299999999999995},"min":{"1min":0.45200000000000001,"5min":0.45100000000000001,"15min":0.34999999999999998},"max":{"1min":1.3100000000000001,"5min":18.481999999999999,"15min":18.481999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.97499999999999998,"15min":0.91400000000000003},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.4970000000000001,"5min":8.0079999999999991,"15min":8.0079999999999991},"last":0.91400000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.86799999999999999,"15min":0.85399999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.1859999999999999,"5min":1.5840000000000001,"15min":1.613},"last":1.046},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.1870000000000001,"15min":1.0549999999999999},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.377,"5min":18.577000000000002,"15min":18.577000000000002},"last":1.4099999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.081,"15min":1.093},"min":{"1min":0.754,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.6279999999999999,"5min":1.728,"15min":1.7609999999999999},"last":1.226},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.365,"15min":1.2490000000000001},"min":{"1min":0.72699999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.542,"5min":18.515000000000001,"15min":18.515000000000001},"last":1.4810000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.4059999999999999,"15min":1.2909999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.591,"5min":17.152999999999999,"15min":17.152999999999999},"last":1.373},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.202,"15min":1.23},"min":{"1min":0.80600000000000005,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.4550000000000001,"5min":1.984,"15min":1.984},"last":1.4319999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.3979999999999999,"15min":1.2969999999999999},"min":{"1min":0.79100000000000004,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.502,"5min":18.545000000000002,"15min":18.545000000000002},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.3620000000000001,"15min":1.2689999999999999},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.665,"5min":17.204000000000001,"15min":17.204000000000001},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:15:13 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.395,"15min":1.2929999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.8779999999999999,"5min":17.236999999999998,"15min":17.236999999999998},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.1779999999999999,"15min":1.2070000000000001},"min":{"1min":0.80300000000000005,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.8500000000000001,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.323}]}]},{"osd":4,"up_from":13,"seq":55834575007,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307448,"kb_used_data":2032,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064392,"statfs":{"total":96636764160,"available":96321937408,"internally_reserved":0,"allocated":2080768,"data_stored":977228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":0.98399999999999999,"15min":1.0649999999999999},"min":{"1min":0.71099999999999997,"5min":0.61199999999999999,"15min":0.38300000000000001},"max":{"1min":1.53,"5min":1.677,"15min":7.1379999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.0189999999999999,"15min":1.0580000000000001},"min":{"1min":0.65100000000000002,"5min":0.502,"15min":0.40100000000000002},"max":{"1min":1.6299999999999999,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":0.97699999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.119,"15min":1.2230000000000001},"min":{"1min":0.61599999999999999,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.026},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.1299999999999999,"15min":1.2230000000000001},"min":{"1min":0.88600000000000001,"5min":0.65100000000000002,"15min":0.48099999999999998},"max":{"1min":1.5649999999999999,"5min":1.5660000000000001,"15min":6.9000000000000004},"last":1.145}]},{"osd":2,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.069,"15min":1.2210000000000001},"min":{"1min":0.68799999999999994,"5min":0.58399999999999996,"15min":0.47399999999999998},"max":{"1min":1.4910000000000001,"5min":1.7030000000000001,"15min":18.431000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.0800000000000001,"15min":1.3160000000000001},"min":{"1min":0.84099999999999997,"5min":0.72399999999999998,"15min":0.36699999999999999},"max":{"1min":1.3779999999999999,"5min":1.623,"15min":36.531999999999996},"last":1.0589999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.097,"15min":1.121},"min":{"1min":0.74099999999999999,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4219999999999999,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.153,"15min":1.385},"min":{"1min":0.77500000000000002,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.595,"5min":1.7809999999999999,"15min":36.530000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.1619999999999999,"15min":1.24},"min":{"1min":0.85299999999999998,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.093},{"interface":"front","average":{"1min":1.258,"5min":1.212,"15min":1.2869999999999999},"min":{"1min":0.92100000000000004,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.417,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.569}]},{"osd":6,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.272,"5min":1.2250000000000001,"15min":1.329},"min":{"1min":0.82799999999999996,"5min":0.60099999999999998,"15min":0.44700000000000001},"max":{"1min":1.7330000000000001,"5min":2.0840000000000001,"15min":8.4190000000000005},"last":1.169},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.294,"15min":1.377},"min":{"1min":1.034,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.8120000000000001,"5min":1.911,"15min":6.1689999999999996},"last":1.4319999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:15:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.2070000000000001,"15min":1.256},"min":{"1min":0.85599999999999998,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.325,"5min":3.645,"15min":3.645},"last":1.476},{"interface":"front","average":{"1min":1.341,"5min":1.2929999999999999,"15min":1.3959999999999999},"min":{"1min":0.875,"5min":0.629,"15min":0.629},"max":{"1min":1.615,"5min":1.9690000000000001,"15min":8.327},"last":1.4159999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:15:43.907 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:15:43.907 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:15:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.101+0000 7fbb11747700 1 Processor -- start 2023-08-17T00:15:44.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.105+0000 7fbb11747700 1 -- start start 2023-08-17T00:15:44.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb11747700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbb0c151950 0x7fbb0c066ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb11747700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c067090 con 0x7fbb0c151570 2023-08-17T00:15:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb11747700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0c067880 con 0x7fbb0c0c1cc0 2023-08-17T00:15:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb11747700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0c062440 con 0x7fbb0c151950 2023-08-17T00:15:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbb0c151570 0x7fbb0c0c15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60506/0 (socket says 172.21.15.153:60506) 2023-08-17T00:15:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0bfff700 1 -- 172.21.15.153:0/4211259810 learned_addr learned my addr 172.21.15.153:0/4211259810 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb10f46700 1 --2- 172.21.15.153:0/4211259810 >> v2:172.21.15.178:3300/0 conn(0x7fbb0c151950 0x7fbb0c066ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119729590 0 0) 0x7fbb0c067090 con 0x7fbb0c151570 2023-08-17T00:15:44.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf80033f0 con 0x7fbb0c151570 2023-08-17T00:15:44.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2973247223 0 0) 0x7fbb0c067880 con 0x7fbb0c0c1cc0 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb0c067090 con 0x7fbb0c0c1cc0 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4276197349 0 0) 0x7fbaf80033f0 con 0x7fbb0c151570 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 >> v2:172.21.15.178:3300/0 conn(0x7fbb0c151950 msgr2=0x7fbb0c066ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 --2- 172.21.15.153:0/4211259810 >> v2:172.21.15.178:3300/0 conn(0x7fbb0c151950 0x7fbb0c066ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 >> v1:172.21.15.178:6789/0 conn(0x7fbb0c0c1cc0 legacy=0x7fbb0c0628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0672c0 con 0x7fbb0c151570 2023-08-17T00:15:44.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fbafc001470 con 0x7fbb0c151570 2023-08-17T00:15:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 >> v1:172.21.15.153:6789/0 conn(0x7fbb0c151570 legacy=0x7fbb0c0c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8003ac0 0x7fbaf8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8004690 0x7fbaf8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaf8005070 0x7fbaf800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c062440 con 0x7fbaf8004690 2023-08-17T00:15:44.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf800c010 con 0x7fbaf8003ac0 2023-08-17T00:15:44.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf800c1d0 con 0x7fbaf8005070 2023-08-17T00:15:44.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8004690 0x7fbaf8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0bfff700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8003ac0 0x7fbaf8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 -- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaf8005070 msgr2=0x7fbaf800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:44.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbaf8005070 0x7fbaf800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:44.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 -- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8003ac0 msgr2=0x7fbaf8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8003ac0 0x7fbaf8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 -- 172.21.15.153:0/4211259810 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf80033f0 con 0x7fbaf8004690 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0bfff700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8003ac0 0x7fbaf8003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb10f46700 1 -- 172.21.15.153:0/4211259810 reap_dead start 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb037fe700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8004690 0x7fbaf8004b10 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7fbaf4001860 tx=0x7fbaf4007bb0).ready entity=mon.0 client_cookie=b2d56eb2695a1bba server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4007020 con 0x7fbaf8004690 2023-08-17T00:15:44.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf4007180 con 0x7fbaf8004690 2023-08-17T00:15:44.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.109+0000 7fbb0b7fe700 1 -- 172.21.15.153:0/4211259810 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4007520 con 0x7fbaf8004690 2023-08-17T00:15:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 -- 172.21.15.153:0/4211259810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8004690 msgr2=0x7fbaf8004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8004690 0x7fbaf8004b10 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 rx=0x7fbaf4001860 tx=0x7fbaf4007bb0).stop 2023-08-17T00:15:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 -- 172.21.15.153:0/4211259810 shutdown_connections 2023-08-17T00:15:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 --2- 172.21.15.153:0/4211259810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbaf8004690 0x7fbaf8004b10 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 -- 172.21.15.153:0/4211259810 >> 172.21.15.153:0/4211259810 conn(0x7fbb0c064d60 msgr2=0x7fbb0c065140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 -- 172.21.15.153:0/4211259810 shutdown_connections 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 -- 172.21.15.153:0/4211259810 wait complete. 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 Processor -- start 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.113+0000 7fbb11747700 1 -- start start 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8004690 0x7fbb0c0c07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 0x7fbb0c0a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb0c1437a0 0x7fbb0c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0a5920 con 0x7fbb0c150090 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c14f0a0 con 0x7fbaf8004690 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0c0a56f0 con 0x7fbb0c1437a0 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 0x7fbb0c0a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 0x7fbb0c0a5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38336/0 (socket says 172.21.15.153:38336) 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 -- 172.21.15.153:0/2824431584 learned_addr learned my addr 172.21.15.153:0/2824431584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:44.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb0bfff700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8004690 0x7fbb0c0c07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb10f46700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb0c1437a0 0x7fbb0c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 -- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb0c1437a0 msgr2=0x7fbb0c1554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb0c1437a0 0x7fbb0c1554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 -- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8004690 msgr2=0x7fbb0c0c07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8004690 0x7fbb0c0c07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 -- 172.21.15.153:0/2824431584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c150510 con 0x7fbb0c150090 2023-08-17T00:15:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb037fe700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 0x7fbb0c0a5200 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7fbaf4001e50 tx=0x7fbaf4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4006e10 con 0x7fbb0c150090 2023-08-17T00:15:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf4006f70 con 0x7fbb0c150090 2023-08-17T00:15:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf401d400 con 0x7fbb0c150090 2023-08-17T00:15:44.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c14f2d0 con 0x7fbb0c150090 2023-08-17T00:15:44.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0c14f890 con 0x7fbb0c150090 2023-08-17T00:15:44.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.117+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb0c0a5920 con 0x7fbb0c150090 2023-08-17T00:15:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.121+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbaf4010070 con 0x7fbb0c150090 2023-08-17T00:15:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.121+0000 7fbb08ff9700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaec05a180 0x7fbaec05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.121+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbaf4074360 con 0x7fbb0c150090 2023-08-17T00:15:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.121+0000 7fbb0bfff700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaec05a180 0x7fbaec05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.121+0000 7fbb0bfff700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaec05a180 0x7fbaec05c640 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fbafc0015a0 tx=0x7fbafc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:44.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.129+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbaf4047db0 con 0x7fbb0c150090 2023-08-17T00:15:44.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.345+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbb0c150510 con 0x7fbb0c150090 2023-08-17T00:15:44.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.353+0000 7fbb08ff9700 1 -- 172.21.15.153:0/2824431584 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbb0c150510 con 0x7fbb0c150090 2023-08-17T00:15:44.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaec05a180 msgr2=0x7fbaec05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaec05a180 0x7fbaec05c640 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fbafc0015a0 tx=0x7fbafc009040).stop 2023-08-17T00:15:44.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 msgr2=0x7fbb0c0a5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 0x7fbb0c0a5200 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 rx=0x7fbaf4001e50 tx=0x7fbaf4015000).stop 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 shutdown_connections 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbaec05a180 0x7fbaec05c640 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb0c1437a0 0x7fbb0c1554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbb0c150090 0x7fbb0c0a5200 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 --2- 172.21.15.153:0/2824431584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbaf8004690 0x7fbb0c0c07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 >> 172.21.15.153:0/2824431584 conn(0x7fbb0c064d60 msgr2=0x7fbb0c0c6190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:44.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 shutdown_connections 2023-08-17T00:15:44.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.357+0000 7fbb11747700 1 -- 172.21.15.153:0/2824431584 wait complete. 2023-08-17T00:15:44.365 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:15:44.384 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:44.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.537+0000 7f7768a5a700 1 Processor -- start 2023-08-17T00:15:44.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7768a5a700 1 -- start start 2023-08-17T00:15:44.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7768a5a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 0x7f77640a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7768a5a700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77641585a0 con 0x7f77640a8df0 2023-08-17T00:15:44.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7768a5a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7764066400 con 0x7f7764068820 2023-08-17T00:15:44.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7768a5a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77640c1ba0 con 0x7f7764068c80 2023-08-17T00:15:44.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7762d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f77640a8df0 0x7f77640c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60520/0 (socket says 172.21.15.153:60520) 2023-08-17T00:15:44.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f7762d9d700 1 -- 172.21.15.153:0/915243176 learned_addr learned my addr 172.21.15.153:0/915243176 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1098006817 0 0) 0x7f77641585a0 con 0x7f77640a8df0 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77500033f0 con 0x7f77640a8df0 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776359e700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 0x7f77640a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 723881481 0 0) 0x7f77500033f0 con 0x7f77640a8df0 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 msgr2=0x7f77640a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 0x7f77640a9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 >> v1:172.21.15.178:6789/0 conn(0x7f7764068820 legacy=0x7f77640a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640b9d30 con 0x7f77640a8df0 2023-08-17T00:15:44.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f77540015f0 con 0x7f77640a8df0 2023-08-17T00:15:44.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.541+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 >> v1:172.21.15.153:6789/0 conn(0x7f77640a8df0 legacy=0x7f77640c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7750003910 0x7f7750003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 0x7f7750004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f7750005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640c1ba0 con 0x7f7750004b80 2023-08-17T00:15:44.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775000b8e0 con 0x7f7750003910 2023-08-17T00:15:44.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775000ba70 con 0x7f7764068c80 2023-08-17T00:15:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f7750005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7762d9d700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7750003910 0x7f7750003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f775a59c700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 0x7f7750004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 -- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 msgr2=0x7f7750004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:44.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7764068c80 0x7f7750004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 -- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7750003910 msgr2=0x7f7750003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:44.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7750003910 0x7f7750003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 -- 172.21.15.153:0/915243176 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500033f0 con 0x7f7750004b80 2023-08-17T00:15:44.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f7750005000 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f775c00e210 tx=0x7f775c00b040).ready entity=mon.0 client_cookie=5e87566b14596523 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:44.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c009ac0 con 0x7f7750004b80 2023-08-17T00:15:44.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c00f040 con 0x7f7750004b80 2023-08-17T00:15:44.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776259c700 1 -- 172.21.15.153:0/915243176 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c00ecd0 con 0x7f7750004b80 2023-08-17T00:15:44.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7768a5a700 1 -- 172.21.15.153:0/915243176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 msgr2=0x7f7750005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7768a5a700 1 --2- 172.21.15.153:0/915243176 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f7750005000 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 rx=0x7f775c00e210 tx=0x7f775c00b040).stop 2023-08-17T00:15:44.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f776359e700 1 -- 172.21.15.153:0/915243176 reap_dead start 2023-08-17T00:15:44.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7768a5a700 1 -- 172.21.15.153:0/915243176 shutdown_connections 2023-08-17T00:15:44.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7768a5a700 1 -- 172.21.15.153:0/915243176 >> 172.21.15.153:0/915243176 conn(0x7f77640c6620 msgr2=0x7f77640c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:44.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7768a5a700 1 -- 172.21.15.153:0/915243176 shutdown_connections 2023-08-17T00:15:44.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.545+0000 7f7768a5a700 1 -- 172.21.15.153:0/915243176 wait complete. 2023-08-17T00:15:44.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 Processor -- start 2023-08-17T00:15:44.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 -- start start 2023-08-17T00:15:44.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f77640bda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f776415b230 0x7f77641588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7764158dc0 0x7f7764159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640bee80 con 0x7f7750004b80 2023-08-17T00:15:44.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77640be270 con 0x7f7764158dc0 2023-08-17T00:15:44.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7768a5a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77640be550 con 0x7f776415b230 2023-08-17T00:15:44.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7762d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f77640bda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7762d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f77640bda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:38366/0 (socket says 172.21.15.153:38366) 2023-08-17T00:15:44.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f7762d9d700 1 -- 172.21.15.153:0/1286446328 learned_addr learned my addr 172.21.15.153:0/1286446328 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:44.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f775a59c700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f776415b230 0x7f77641588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.549+0000 7f776359e700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7764158dc0 0x7f7764159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7762d9d700 1 -- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f776415b230 msgr2=0x7f77641588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7762d9d700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f776415b230 0x7f77641588d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7762d9d700 1 -- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7764158dc0 msgr2=0x7f7764159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7762d9d700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7764158dc0 0x7f7764159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7762d9d700 1 -- 172.21.15.153:0/1286446328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640be830 con 0x7f7750004b80 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f776359e700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7764158dc0 0x7f7764159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7762d9d700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f77640bda20 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f775400f890 tx=0x7f7754009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77540070d0 con 0x7f7750004b80 2023-08-17T00:15:44.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7754007230 con 0x7f7750004b80 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754005880 con 0x7f7750004b80 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77640beb10 con 0x7f7750004b80 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77640bdf10 con 0x7f7750004b80 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776406b4c0 con 0x7f7750004b80 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.553+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f775401a030 con 0x7f7750004b80 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.557+0000 7f775b7fe700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f774405a150 0x7f774405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:44.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.557+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7754073920 con 0x7f7750004b80 2023-08-17T00:15:44.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.557+0000 7f775a59c700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f774405a150 0x7f774405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:44.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.557+0000 7f775a59c700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f774405a150 0x7f774405c610 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f774c0010e0 tx=0x7f774c00c040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:44.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.561+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7754047370 con 0x7f7750004b80 2023-08-17T00:15:44.660 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:15:44.653+0000 7fa204d99700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:15:44.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.753+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7764064010 con 0x7f7750004b80 2023-08-17T00:15:44.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.753+0000 7f775b7fe700 1 -- 172.21.15.153:0/1286446328 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f775404a990 con 0x7f7750004b80 2023-08-17T00:15:44.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:44.760 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:15:44.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f774405a150 msgr2=0x7f774405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f774405a150 0x7f774405c610 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f774c0010e0 tx=0x7f774c00c040).stop 2023-08-17T00:15:44.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 msgr2=0x7f77640bda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f77640bda20 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 rx=0x7f775400f890 tx=0x7f7754009040).stop 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 shutdown_connections 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f774405a150 0x7f774405c610 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7764158dc0 0x7f7764159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f776415b230 0x7f77641588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 --2- 172.21.15.153:0/1286446328 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7750004b80 0x7f77640bda20 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:44.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 >> 172.21.15.153:0/1286446328 conn(0x7f77640c6620 msgr2=0x7f77640c56b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:44.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 shutdown_connections 2023-08-17T00:15:44.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:44.757+0000 7f7768a5a700 1 -- 172.21.15.153:0/1286446328 wait complete. 2023-08-17T00:15:44.765 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:15:45.185 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 130, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:15:39.231720+0000', 'modified': '2023-08-17T00:15:42.252112+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9390}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9390': {'gid': 9390, 'name': 'c', 'rank': 0, 'incarnation': 126, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/723499345', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 723499345}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 723499345}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:15:45.186 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:15:45.186 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T00:15:45.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.349+0000 7ff6955f9700 1 Processor -- start 2023-08-17T00:15:45.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.349+0000 7ff6955f9700 1 -- start start 2023-08-17T00:15:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6900689c0 0x7ff690068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6901560f0 0x7ff6900c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff6901519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff690065da0 con 0x7ff6901560f0 2023-08-17T00:15:45.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff690155c60 con 0x7ff6900689c0 2023-08-17T00:15:45.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff690156550 con 0x7ff690151530 2023-08-17T00:15:45.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6901560f0 0x7ff6900c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff6901560f0 0x7ff6900c0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44066/0 (socket says 172.21.15.153:44066) 2023-08-17T00:15:45.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 -- 172.21.15.153:0/731553445 learned_addr learned my addr 172.21.15.153:0/731553445 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff694df8700 1 --2- 172.21.15.153:0/731553445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff6901519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff68ffff700 1 --2- 172.21.15.153:0/731553445 >> v2:172.21.15.178:3300/0 conn(0x7ff6900689c0 0x7ff690068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 -- 172.21.15.153:0/731553445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 msgr2=0x7ff6901519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 --2- 172.21.15.153:0/731553445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff6901519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 -- 172.21.15.153:0/731553445 >> v2:172.21.15.178:3300/0 conn(0x7ff6900689c0 msgr2=0x7ff690068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 --2- 172.21.15.153:0/731553445 >> v2:172.21.15.178:3300/0 conn(0x7ff6900689c0 0x7ff690068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 -- 172.21.15.153:0/731553445 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff690065ff0 con 0x7ff6901560f0 2023-08-17T00:15:45.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6877fe700 1 --2- 172.21.15.153:0/731553445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6901560f0 0x7ff6900c0270 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7ff6900c2d60 tx=0x7ff6780090f0).ready entity=mon.0 client_cookie=a45408bb00c4ecce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff68f7fe700 1 -- 172.21.15.153:0/731553445 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800f510 con 0x7ff6901560f0 2023-08-17T00:15:45.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff68f7fe700 1 -- 172.21.15.153:0/731553445 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67800f670 con 0x7ff6901560f0 2023-08-17T00:15:45.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff68f7fe700 1 -- 172.21.15.153:0/731553445 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67800fa10 con 0x7ff6901560f0 2023-08-17T00:15:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 -- 172.21.15.153:0/731553445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6901560f0 msgr2=0x7ff6900c0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.353+0000 7ff6955f9700 1 --2- 172.21.15.153:0/731553445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6901560f0 0x7ff6900c0270 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 rx=0x7ff6900c2d60 tx=0x7ff6780090f0).stop 2023-08-17T00:15:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 -- 172.21.15.153:0/731553445 shutdown_connections 2023-08-17T00:15:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 --2- 172.21.15.153:0/731553445 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff6901519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 --2- 172.21.15.153:0/731553445 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6901560f0 0x7ff6900c0270 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 --2- 172.21.15.153:0/731553445 >> v2:172.21.15.178:3300/0 conn(0x7ff6900689c0 0x7ff690068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 -- 172.21.15.153:0/731553445 >> 172.21.15.153:0/731553445 conn(0x7ff6900c6620 msgr2=0x7ff6900c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 -- 172.21.15.153:0/731553445 shutdown_connections 2023-08-17T00:15:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 -- 172.21.15.153:0/731553445 wait complete. 2023-08-17T00:15:45.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.357+0000 7ff6955f9700 1 Processor -- start 2023-08-17T00:15:45.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 -- start start 2023-08-17T00:15:45.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 0x7ff6900a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff690147a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6901560f0 0x7ff6900c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900a7a80 con 0x7ff6900689c0 2023-08-17T00:15:45.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900c2680 con 0x7ff6901560f0 2023-08-17T00:15:45.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6955f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6900c2960 con 0x7ff690151530 2023-08-17T00:15:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 0x7ff6900a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 0x7ff6900a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44072/0 (socket says 172.21.15.153:44072) 2023-08-17T00:15:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 -- 172.21.15.153:0/1624584693 learned_addr learned my addr 172.21.15.153:0/1624584693 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff6877fe700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff690147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff694df8700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6901560f0 0x7ff6900c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 -- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 msgr2=0x7ff690147a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff690147a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 -- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6901560f0 msgr2=0x7ff6900c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6901560f0 0x7ff6900c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.361+0000 7ff68ffff700 1 -- 172.21.15.153:0/1624584693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff678009370 con 0x7ff6900689c0 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.365+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 0x7ff6900a7f10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7ff68000e8d0 tx=0x7ff680006f40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.365+0000 7ff68cff9700 1 -- 172.21.15.153:0/1624584693 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680012600 con 0x7ff6900689c0 2023-08-17T00:15:45.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.365+0000 7ff68cff9700 1 -- 172.21.15.153:0/1624584693 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff680012760 con 0x7ff6900689c0 2023-08-17T00:15:45.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.365+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6900a7710 con 0x7ff6900689c0 2023-08-17T00:15:45.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.365+0000 7ff68cff9700 1 -- 172.21.15.153:0/1624584693 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680012ae0 con 0x7ff6900689c0 2023-08-17T00:15:45.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.365+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6900a7350 con 0x7ff6900689c0 2023-08-17T00:15:45.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.369+0000 7ff68cff9700 1 -- 172.21.15.153:0/1624584693 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff680022070 con 0x7ff6900689c0 2023-08-17T00:15:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.369+0000 7ff68cff9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff67005a120 0x7ff67005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.369+0000 7ff68cff9700 1 -- 172.21.15.153:0/1624584693 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff680074490 con 0x7ff6900689c0 2023-08-17T00:15:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff67005a120 0x7ff67005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 Processor -- start 2023-08-17T00:15:45.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 -- start start 2023-08-17T00:15:45.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff67005a120 0x7ff67005c5e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ff690154db0 tx=0x7ff678016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1847a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1803de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x176f5c0 con 0x17fff80 2023-08-17T00:15:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1784e90 con 0x182a6f0 2023-08-17T00:15:45.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x174b220 con 0x1801380 2023-08-17T00:15:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1803de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1803de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44086/0 (socket says 172.21.15.153:44086) 2023-08-17T00:15:45.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 -- 172.21.15.153:0/348350736 learned_addr learned my addr 172.21.15.153:0/348350736 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff694df8700 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff68ffff700 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1847a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 -- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 msgr2=0x18042d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18042d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 -- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 msgr2=0x1847a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1847a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 -- 172.21.15.153:0/348350736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1790500 con 0x17fff80 2023-08-17T00:15:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff68ffff700 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1847a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.373+0000 7ff6877fe700 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1803de0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7ff678000c70 tx=0x7ff67801f040).ready entity=mon.0 client_cookie=d687050d1aa0894c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6857fa700 1 -- 172.21.15.153:0/348350736 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67801d8e0 con 0x17fff80 2023-08-17T00:15:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6857fa700 1 -- 172.21.15.153:0/348350736 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67801da40 con 0x17fff80 2023-08-17T00:15:45.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6857fa700 1 -- 172.21.15.153:0/348350736 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67801ddc0 con 0x17fff80 2023-08-17T00:15:45.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 -- 172.21.15.153:0/348350736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 msgr2=0x1803de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1803de0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 rx=0x7ff678000c70 tx=0x7ff67801f040).stop 2023-08-17T00:15:45.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 -- 172.21.15.153:0/348350736 shutdown_connections 2023-08-17T00:15:45.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18042d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1803de0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/348350736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1847a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 -- 172.21.15.153:0/348350736 >> 172.21.15.153:0/348350736 conn(0x15e3550 msgr2=0x1804e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 -- 172.21.15.153:0/348350736 shutdown_connections 2023-08-17T00:15:45.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 -- 172.21.15.153:0/348350736 wait complete. 2023-08-17T00:15:45.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 -- start start 2023-08-17T00:15:45.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.377+0000 7ff6a0bff740 1 Processor -- start 2023-08-17T00:15:45.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17fff80 0x1844c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 0x1842430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1829b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1750110 con 0x1801380 2023-08-17T00:15:45.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x182d050 con 0x17fff80 2023-08-17T00:15:45.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1842a30 con 0x182a6f0 2023-08-17T00:15:45.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 10 client.0 ll_register_callbacks cb 0x17bc3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:45.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 0x1842430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 0x1842430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44090/0 (socket says 172.21.15.153:44090) 2023-08-17T00:15:45.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 -- 172.21.15.153:0/1290522396 learned_addr learned my addr 172.21.15.153:0/1290522396 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17fff80 0x1844c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff694df8700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1829b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 -- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 msgr2=0x1829b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1829b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 -- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17fff80 msgr2=0x1844c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17fff80 0x1844c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 -- 172.21.15.153:0/1290522396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff690065ff0 con 0x1801380 2023-08-17T00:15:45.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17fff80 0x1844c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:45.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6877fe700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 0x1842430 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7ff678028000 tx=0x7ff678027000).ready entity=mon.0 client_cookie=d932502707928f8d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff66e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff66e7fc700 1 -- 172.21.15.153:0/1290522396 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff678027610 con 0x1801380 2023-08-17T00:15:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff66e7fc700 1 -- 172.21.15.153:0/1290522396 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff67800b930 con 0x1801380 2023-08-17T00:15:45.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x177ac60 con 0x1801380 2023-08-17T00:15:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff66e7fc700 1 -- 172.21.15.153:0/1290522396 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff67800bd00 con 0x1801380 2023-08-17T00:15:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 10 client.9534 fetch_fsmap learned FSMap version 130 2023-08-17T00:15:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x177df80 con 0x1801380 2023-08-17T00:15:45.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff66e7fc700 1 -- 172.21.15.153:0/1290522396 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x177ac60 con 0x1801380 2023-08-17T00:15:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff66e7fc700 1 -- 172.21.15.153:0/1290522396 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff67800b120 con 0x1801380 2023-08-17T00:15:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 10 client.9534 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:15:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 10 client.9534 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:15:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 20 client.9534 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:45.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x182fb50 0x182ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 4 client.9534 mds_command: new command op to 9390 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.381+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17711b0 con 0x182fb50 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x182fb50 0x182ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff66e7fc700 10 client.9534 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff68ffff700 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x182fb50 0x182ff30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b78a2fcac4697b23 server_cookie=80a8fffaabd97d6d in_seq=0 out_seq=0 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff66e7fc700 1 -- 172.21.15.153:0/1290522396 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x17711b0 con 0x182fb50 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff66e7fc700 10 client.9534 handle_command_reply: tid=0 2023-08-17T00:15:45.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 client.9534 shutdown 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 msgr2=0x1842430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 0x1842430 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 rx=0x7ff678028000 tx=0x7ff678027000).stop 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 shutdown_connections 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x182fb50 0x182ff30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1829b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1801380 0x1842430 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/1290522396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x17fff80 0x1844c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 >> 172.21.15.153:0/1290522396 conn(0x15e3550 msgr2=0x1848490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff66e7fc700 0 client.9534 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 shutdown_connections 2023-08-17T00:15:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 1 -- 172.21.15.153:0/1290522396 wait complete. 2023-08-17T00:15:45.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.385+0000 7ff6a0bff740 20 client.9534 trim_cache size 0 max 16384 2023-08-17T00:15:45.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.405+0000 7ff6a0bff740 1 Processor -- start 2023-08-17T00:15:45.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.405+0000 7ff6a0bff740 1 -- start start 2023-08-17T00:15:45.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x18309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1801380 0x1829d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1868dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x182e820 con 0x17fff80 2023-08-17T00:15:45.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x182b2f0 con 0x1801380 2023-08-17T00:15:45.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x178f750 con 0x182a6f0 2023-08-17T00:15:45.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x18309d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x18309d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44096/0 (socket says 172.21.15.153:44096) 2023-08-17T00:15:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 -- 172.21.15.153:0/587192979 learned_addr learned my addr 172.21.15.153:0/587192979 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6877fe700 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1801380 0x1829d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 -- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 msgr2=0x1868dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1868dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 -- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1801380 msgr2=0x1829d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1801380 0x1829d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 -- 172.21.15.153:0/587192979 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900c5190 con 0x17fff80 2023-08-17T00:15:45.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6877fe700 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1801380 0x1829d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:45.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff68ffff700 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x18309d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7ff68000e7f0 tx=0x7ff680053040).ready entity=mon.0 client_cookie=3bb5ae5c3abe7cc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff685ffb700 1 -- 172.21.15.153:0/587192979 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680050040 con 0x17fff80 2023-08-17T00:15:45.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff685ffb700 1 -- 172.21.15.153:0/587192979 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff680049d00 con 0x17fff80 2023-08-17T00:15:45.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff685ffb700 1 -- 172.21.15.153:0/587192979 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68004b630 con 0x17fff80 2023-08-17T00:15:45.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 -- 172.21.15.153:0/587192979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 msgr2=0x18309d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.409+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x18309d0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 rx=0x7ff68000e7f0 tx=0x7ff680053040).stop 2023-08-17T00:15:45.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 -- 172.21.15.153:0/587192979 shutdown_connections 2023-08-17T00:15:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x182a6f0 0x1868dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1801380 0x1829d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/587192979 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x18309d0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 -- 172.21.15.153:0/587192979 >> 172.21.15.153:0/587192979 conn(0x15e3550 msgr2=0x1804200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 -- 172.21.15.153:0/587192979 shutdown_connections 2023-08-17T00:15:45.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 -- 172.21.15.153:0/587192979 wait complete. 2023-08-17T00:15:45.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 -- start start 2023-08-17T00:15:45.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 Processor -- start 2023-08-17T00:15:45.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1828b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.413+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1804c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1802c60 con 0x17fff80 2023-08-17T00:15:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1828310 con 0x182a6f0 2023-08-17T00:15:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1802630 con 0x1801380 2023-08-17T00:15:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 10 client.0 ll_register_callbacks cb 0x7ff678009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1828b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1828b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44112/0 (socket says 172.21.15.153:44112) 2023-08-17T00:15:45.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 -- 172.21.15.153:0/395389152 learned_addr learned my addr 172.21.15.153:0/395389152 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 -- 172.21.15.153:0/395389152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 msgr2=0x18ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:45.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 -- 172.21.15.153:0/395389152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 msgr2=0x1804c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1804c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 -- 172.21.15.153:0/395389152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6900a7350 con 0x17fff80 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff68ffff700 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1828b10 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7ff680051390 tx=0x7ff68004d000).ready entity=mon.0 client_cookie=39afc8c1a08c0c8d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 1 -- 172.21.15.153:0/395389152 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff680050030 con 0x17fff80 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 1 -- 172.21.15.153:0/395389152 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff680048200 con 0x17fff80 2023-08-17T00:15:45.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff67801da40 con 0x17fff80 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 1 -- 172.21.15.153:0/395389152 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff68004afe0 con 0x17fff80 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 10 client.9540 fetch_fsmap learned FSMap version 130 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x1779420 con 0x17fff80 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 1 -- 172.21.15.153:0/395389152 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67801da40 con 0x17fff80 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 1 -- 172.21.15.153:0/395389152 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff680072b70 con 0x17fff80 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 10 client.9540 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 10 client.9540 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:15:45.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 20 client.9540 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x18aeb30 0x18aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 4 client.9540 mds_command: new command op to 9390 tid=0[{"prefix": "status"}] 2023-08-17T00:15:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "status"}) v1 -- 0x163a4e0 con 0x18aeb30 2023-08-17T00:15:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6877fe700 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x18aeb30 0x18aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 10 client.9540 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:45.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6877fe700 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x18aeb30 0x18aef50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3eff4193d45874b3 server_cookie=7b0905a4ae80d725 in_seq=0 out_seq=0 2023-08-17T00:15:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 1 -- 172.21.15.153:0/395389152 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x163a4e0 con 0x18aeb30 2023-08-17T00:15:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 10 client.9540 handle_command_reply: tid=0 2023-08-17T00:15:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 client.9540 shutdown 2023-08-17T00:15:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 msgr2=0x1828b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1828b10 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 rx=0x7ff680051390 tx=0x7ff68004d000).stop 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 shutdown_connections 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x18aeb30 0x18aef50 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x182a6f0 0x1804c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1801380 0x18ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 --2- 172.21.15.153:0/395389152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x17fff80 0x1828b10 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 >> 172.21.15.153:0/395389152 conn(0x15e3550 msgr2=0x1829d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.417+0000 7ff66e7fc700 0 client.9540 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 shutdown_connections 2023-08-17T00:15:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6a0bff740 1 -- 172.21.15.153:0/395389152 wait complete. 2023-08-17T00:15:45.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6a0bff740 20 client.9540 trim_cache size 0 max 16384 2023-08-17T00:15:45.431 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 9390, 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:15:45.432 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.1853874529999997, 2023-08-17T00:15:45.433 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 130, 2023-08-17T00:15:45.433 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 166, 2023-08-17T00:15:45.433 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 166, 2023-08-17T00:15:45.433 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.694340079 2023-08-17T00:15:45.433 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:15:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff67005a120 msgr2=0x7ff67005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff67005a120 0x7ff67005c5e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7ff690154db0 tx=0x7ff678016000).stop 2023-08-17T00:15:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 msgr2=0x7ff6900a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 0x7ff6900a7f10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 rx=0x7ff68000e8d0 tx=0x7ff680006f40).stop 2023-08-17T00:15:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 shutdown_connections 2023-08-17T00:15:45.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff67005a120 0x7ff67005c5e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6901560f0 0x7ff6900c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff690151530 0x7ff690147a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 --2- 172.21.15.153:0/1624584693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6900689c0 0x7ff6900a7f10 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 >> 172.21.15.153:0/1624584693 conn(0x7ff6900c6620 msgr2=0x7ff690150d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 shutdown_connections 2023-08-17T00:15:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.421+0000 7ff6955f9700 1 -- 172.21.15.153:0/1624584693 wait complete. 2023-08-17T00:15:45.448 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:15:45.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.573+0000 7f917a639700 1 Processor -- start 2023-08-17T00:15:45.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.573+0000 7f917a639700 1 -- start start 2023-08-17T00:15:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f917a639700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9174157720 0x7f9174157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f917a639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f91740ca790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f917a639700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740adaf0 con 0x7f91740ae590 2023-08-17T00:15:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f917a639700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91740cb430 con 0x7f9174157720 2023-08-17T00:15:45.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f917a639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740add90 con 0x7f9174153bc0 2023-08-17T00:15:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9178e36700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f91740ae590 0x7f91741534b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47482/0 (socket says 172.21.15.153:47482) 2023-08-17T00:15:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9178e36700 1 -- 172.21.15.153:0/2213429240 learned_addr learned my addr 172.21.15.153:0/2213429240 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179637700 1 --2- 172.21.15.153:0/2213429240 >> v2:172.21.15.178:3300/0 conn(0x7f9174157720 0x7f9174157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179e38700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f91740ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f916bfff700 1 -- 172.21.15.153:0/2213429240 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752995101 0 0) 0x7f91740adaf0 con 0x7f91740ae590 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f916bfff700 1 -- 172.21.15.153:0/2213429240 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91600033f0 con 0x7f91740ae590 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f916bfff700 1 -- 172.21.15.153:0/2213429240 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1850895921 0 0) 0x7f91600033f0 con 0x7f91740ae590 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179637700 1 -- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 msgr2=0x7f91740ca790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179637700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f91740ca790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179637700 1 -- 172.21.15.153:0/2213429240 >> v1:172.21.15.153:6789/0 conn(0x7f91740ae590 legacy=0x7f91741534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179637700 1 -- 172.21.15.153:0/2213429240 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740ae070 con 0x7f9174157720 2023-08-17T00:15:45.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179e38700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f91740ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:45.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.577+0000 7f9179637700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9174157720 0x7f9174157b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f9170009790 tx=0x7f9170009060).ready entity=mon.1 client_cookie=efd12965daa8f19d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f916bfff700 1 -- 172.21.15.153:0/2213429240 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164001470 con 0x7f9174157720 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f916bfff700 1 -- 172.21.15.153:0/2213429240 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170011400 con 0x7f9174157720 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f916bfff700 1 -- 172.21.15.153:0/2213429240 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170011780 con 0x7f9174157720 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 -- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9174157720 msgr2=0x7f9174157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9174157720 0x7f9174157b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f9170009790 tx=0x7f9170009060).stop 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 -- 172.21.15.153:0/2213429240 shutdown_connections 2023-08-17T00:15:45.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f91740ca790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 --2- 172.21.15.153:0/2213429240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9174157720 0x7f9174157b00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 -- 172.21.15.153:0/2213429240 >> 172.21.15.153:0/2213429240 conn(0x7f9174067820 msgr2=0x7f9174067c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 -- 172.21.15.153:0/2213429240 shutdown_connections 2023-08-17T00:15:45.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.581+0000 7f917a639700 1 -- 172.21.15.153:0/2213429240 wait complete. 2023-08-17T00:15:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 Processor -- start 2023-08-17T00:15:45.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 -- start start 2023-08-17T00:15:45.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740ae590 0x7f917414c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f9174167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 0x7f9174167c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174166490 con 0x7f9174157720 2023-08-17T00:15:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917414d790 con 0x7f91740ae590 2023-08-17T00:15:45.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9174165c30 con 0x7f9174153bc0 2023-08-17T00:15:45.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 0x7f9174167c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.592 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 0x7f9174167c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44118/0 (socket says 172.21.15.153:44118) 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 -- 172.21.15.153:0/441337663 learned_addr learned my addr 172.21.15.153:0/441337663 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179637700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740ae590 0x7f917414c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9178e36700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f9174167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 -- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 msgr2=0x7f9174167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f9174167780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 -- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740ae590 msgr2=0x7f917414c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740ae590 0x7f917414c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 -- 172.21.15.153:0/441337663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c009a20 con 0x7f9174157720 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f9179e38700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 0x7f9174167c70 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f916c00efc0 tx=0x7f916c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00cbd0 con 0x7f9174157720 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00f040 con 0x7f9174157720 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91700092a0 con 0x7f9174157720 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c013400 con 0x7f9174157720 2023-08-17T00:15:45.594 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.585+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91741661b0 con 0x7f9174157720 2023-08-17T00:15:45.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.589+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917405ec30 con 0x7f9174157720 2023-08-17T00:15:45.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.589+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f916c0137f0 con 0x7f9174157720 2023-08-17T00:15:45.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.593+0000 7f91697fa700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915805a150 0x7f915805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:45.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.593+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f916c074b10 con 0x7f9174157720 2023-08-17T00:15:45.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.593+0000 7f9179637700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915805a150 0x7f915805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:45.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.593+0000 7f9179637700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915805a150 0x7f915805c610 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f917000a010 tx=0x7f9170016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:45.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.597+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f916c0485c0 con 0x7f9174157720 2023-08-17T00:15:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.793+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91740acdf0 con 0x7f9174157720 2023-08-17T00:15:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.793+0000 7f91697fa700 1 -- 172.21.15.153:0/441337663 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v130) v1 ==== 53+0+73 (secure 0 0 0) 0x7f916c04bbe0 con 0x7f9174157720 2023-08-17T00:15:45.800 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:15:45.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915805a150 msgr2=0x7f915805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915805a150 0x7f915805c610 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7f917000a010 tx=0x7f9170016000).stop 2023-08-17T00:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 msgr2=0x7f9174167c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 0x7f9174167c70 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 rx=0x7f916c00efc0 tx=0x7f916c00b040).stop 2023-08-17T00:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 shutdown_connections 2023-08-17T00:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f915805a150 0x7f915805c610 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9174157720 0x7f9174167c70 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9174153bc0 0x7f9174167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 --2- 172.21.15.153:0/441337663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91740ae590 0x7f917414c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 >> 172.21.15.153:0/441337663 conn(0x7f9174067820 msgr2=0x7f917414fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 shutdown_connections 2023-08-17T00:15:45.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:45.797+0000 7f917a639700 1 -- 172.21.15.153:0/441337663 wait complete. 2023-08-17T00:15:45.822 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:15:45.823 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:15:45.823 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:15:45.823 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:15:45.824 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:15:45.824 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:15:45.824 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:15:45.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:15:45.825 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:15:45.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:45.826 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:15:45.843 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:15:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:15:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:15:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:15:45.844 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:15:45.845 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41667sec preferred_lft 41667sec 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.846 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.847 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:15:45.848 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:15:45.849 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:15:45.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:45.850 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:15:45.931 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:15:45.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:45.935 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:15:45.996 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:15:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:15:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:15:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:15:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:15:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:15:45.997 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:15:45.998 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:15:45.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:45.999 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:15:46.000 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:15:46.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:15:46.000 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:15:46.001 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:15:46.001 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:15:46.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:46.125 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:15:46.143 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:15:46.143 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:15:46.144 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:15:46.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:46.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:15:46.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:46.228 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:15:46.288 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:15:46.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:15:46.405 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:15:46.405 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:15:46.429 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:15:46.429 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:15:46.434 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:15:46.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:15:46.435 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:15:46.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:15:46.466 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-08-17T00:15:46.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:15:46.543 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-08-17T00:15:46.701 INFO:teuthology.orchestra.run.smithi153.stderr:6+0 records in 2023-08-17T00:15:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:6+0 records out 2023-08-17T00:15:46.702 INFO:teuthology.orchestra.run.smithi153.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0931047 s, 67.6 MB/s 2023-08-17T00:15:46.704 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:15:46.708 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:15:46.782 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-08-17T00:15:46.782 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.783 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:15:46.784 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-08-17T00:15:46.785 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:15:46.786 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.787 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:15:46.788 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.789 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-08-17T00:15:46.790 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.791 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-08-17T00:15:46.792 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:15:46.793 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.794 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-08-17T00:15:46.795 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.796 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.797 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-08-17T00:15:46.798 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2023-08-17T00:15:46.799 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-08-17T00:15:46.800 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: mds cache max size = 1000 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = True 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: mds log max segments = 1 2023-08-17T00:15:46.801 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-08-17T00:15:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = False 2023-08-17T00:15:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:15:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.802 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.802 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.803 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.804 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.805 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-08-17T00:15:46.806 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.807 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:15:46.808 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-08-17T00:15:46.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-08-17T00:15:46.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:15:46.811 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2023-08-17T00:15:46.812 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:15:46.813 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-08-17T00:15:46.815 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-08-17T00:15:46.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:15:46.817 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-08-17T00:15:46.818 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.819 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-08-17T00:15:46.820 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: mds cache max size = 1000 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: mds log max segments = 1 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-08-17T00:15:46.821 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = False 2023-08-17T00:15:46.822 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:15:46.822 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.822 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.824 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:15:46.831 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:15:46.896 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-08-17T00:15:46.897 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-08-17T00:15:46.897 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:15:46.897 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-08-17T00:15:46.897 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.897 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.898 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-08-17T00:15:46.899 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-08-17T00:15:46.899 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.899 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:15:46.900 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-08-17T00:15:46.900 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.900 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:15:46.900 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:15:46.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.901 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-08-17T00:15:46.901 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.902 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-08-17T00:15:46.902 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-08-17T00:15:46.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:15:46.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:15:46.903 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-08-17T00:15:46.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:15:46.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-08-17T00:15:46.904 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:15:46.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:15:46.905 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-08-17T00:15:46.905 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.905 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:15:46.906 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.906 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-08-17T00:15:46.906 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.906 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-08-17T00:15:46.907 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.907 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-08-17T00:15:46.907 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-08-17T00:15:46.907 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-08-17T00:15:46.908 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:15:46.908 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2023-08-17T00:15:46.909 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:15:46.909 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.909 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-08-17T00:15:46.909 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-08-17T00:15:46.909 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.910 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-08-17T00:15:46.910 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-08-17T00:15:46.910 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.910 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-08-17T00:15:46.910 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-08-17T00:15:46.911 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.911 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-08-17T00:15:46.911 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-08-17T00:15:46.912 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-08-17T00:15:46.912 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.912 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-08-17T00:15:46.913 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-08-17T00:15:46.913 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.913 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:15:46.913 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.913 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-08-17T00:15:46.913 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.914 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-08-17T00:15:46.914 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.914 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:15:46.914 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-08-17T00:15:46.914 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.915 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-08-17T00:15:46.915 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-08-17T00:15:46.915 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-08-17T00:15:46.915 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-08-17T00:15:46.916 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-08-17T00:15:46.916 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-08-17T00:15:46.916 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-08-17T00:15:46.916 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-08-17T00:15:46.917 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-08-17T00:15:46.917 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.918 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-08-17T00:15:46.918 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-08-17T00:15:46.918 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:15:46.919 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-08-17T00:15:46.919 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:15:46.919 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:15:46.920 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-08-17T00:15:46.920 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:15:46.920 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.921 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-08-17T00:15:46.921 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.921 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-08-17T00:15:46.922 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:15:46.922 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:15:46.922 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.922 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.922 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-08-17T00:15:46.923 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.923 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-08-17T00:15:46.923 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.923 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:15:46.924 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-08-17T00:15:46.924 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:15:46.924 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-08-17T00:15:46.924 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-08-17T00:15:46.925 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.925 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-08-17T00:15:46.925 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-08-17T00:15:46.925 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.925 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.925 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:15:46.926 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:15:46.926 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:15:46.926 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.926 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:15:46.927 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:15:46.927 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:15:46.927 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-08-17T00:15:46.927 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:46.927 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-08-17T00:15:46.927 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-08-17T00:15:46.928 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.929 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2023-08-17T00:15:46.929 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.929 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.929 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-08-17T00:15:46.929 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-08-17T00:15:46.929 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:15:46.930 INFO:teuthology.orchestra.run.smithi153.stdout: mds cache max size = 1000 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = False 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: mds log max segments = 1 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = False 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:15:46.931 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.932 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.933 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-08-17T00:15:46.933 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-08-17T00:15:46.933 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.934 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:15:46.935 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.936 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:15:46.937 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.938 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-08-17T00:15:46.939 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.940 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-08-17T00:15:46.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-08-17T00:15:46.941 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-08-17T00:15:46.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-08-17T00:15:46.941 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-08-17T00:15:46.941 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.942 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-08-17T00:15:46.943 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.943 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:15:46.943 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-08-17T00:15:46.943 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.943 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-08-17T00:15:46.943 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-08-17T00:15:46.944 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2023-08-17T00:15:46.944 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2023-08-17T00:15:46.944 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2023-08-17T00:15:46.944 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-08-17T00:15:46.944 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-08-17T00:15:46.944 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-08-17T00:15:46.945 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-08-17T00:15:46.946 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.947 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:15:46.948 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-08-17T00:15:46.948 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:15:46.948 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-08-17T00:15:46.948 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-08-17T00:15:46.948 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:15:46.948 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.949 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-08-17T00:15:46.950 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.951 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-08-17T00:15:46.952 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout: mds cache max size = 1000 2023-08-17T00:15:46.953 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = False 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: mds log max segments = 1 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = False 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:15:46.954 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:15:46.955 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:15:46.955 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:15:46.955 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:15:46.956 DEBUG:teuthology.orchestra.run.smithi153:> import json 2023-08-17T00:15:46.956 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2023-08-17T00:15:46.956 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:15:46.957 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:15:46.957 DEBUG:teuthology.orchestra.run.smithi153:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-08-17T00:15:46.957 DEBUG:teuthology.orchestra.run.smithi153:> except OSError as e: 2023-08-17T00:15:46.957 DEBUG:teuthology.orchestra.run.smithi153:> sys.exit(e.errno) 2023-08-17T00:15:46.958 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:15:46.958 DEBUG:teuthology.orchestra.run.smithi153:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-08-17T00:15:46.958 DEBUG:teuthology.orchestra.run.smithi153:> print(json.dumps( 2023-08-17T00:15:46.958 DEBUG:teuthology.orchestra.run.smithi153:> dict([(a, getattr(s, a)) for a in attrs]), 2023-08-17T00:15:46.959 DEBUG:teuthology.orchestra.run.smithi153:> indent=2)) 2023-08-17T00:15:46.959 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:15:47.060 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:15:47.060 INFO:teuthology.orchestra.run.smithi153.stdout: "st_mode": 33204, 2023-08-17T00:15:47.061 INFO:teuthology.orchestra.run.smithi153.stdout: "st_ino": 1099511627777, 2023-08-17T00:15:47.061 INFO:teuthology.orchestra.run.smithi153.stdout: "st_dev": 49, 2023-08-17T00:15:47.061 INFO:teuthology.orchestra.run.smithi153.stdout: "st_nlink": 1, 2023-08-17T00:15:47.061 INFO:teuthology.orchestra.run.smithi153.stdout: "st_uid": 1000, 2023-08-17T00:15:47.062 INFO:teuthology.orchestra.run.smithi153.stdout: "st_gid": 1267, 2023-08-17T00:15:47.062 INFO:teuthology.orchestra.run.smithi153.stdout: "st_size": 6291456, 2023-08-17T00:15:47.062 INFO:teuthology.orchestra.run.smithi153.stdout: "st_atime": 1692231346.6010606, 2023-08-17T00:15:47.063 INFO:teuthology.orchestra.run.smithi153.stdout: "st_mtime": 1692231346.6490595, 2023-08-17T00:15:47.063 INFO:teuthology.orchestra.run.smithi153.stdout: "st_ctime": 1692231346.6490595 2023-08-17T00:15:47.063 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:15:47.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:15:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 Processor -- start 2023-08-17T00:15:47.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 -- start start 2023-08-17T00:15:47.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8b70 0x7fd5d00632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5d00a8f50 0x7fd5d00629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d0065240 con 0x7fd5d00656d0 2023-08-17T00:15:47.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d0062ea0 con 0x7fd5d00a8f50 2023-08-17T00:15:47.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.441+0000 7fd5d48f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00638a0 con 0x7fd5d00a8b70 2023-08-17T00:15:47.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5c7fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd5d00a8f50 0x7fd5d00629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5ced9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd5d00656d0 0x7fd5d00bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47490/0 (socket says 172.21.15.153:47490) 2023-08-17T00:15:47.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5ced9d700 1 -- 172.21.15.153:0/3168640966 learned_addr learned my addr 172.21.15.153:0/3168640966 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:47.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5ce59c700 1 --2- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8b70 0x7fd5d00632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5c7fff700 1 -- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8b70 msgr2=0x7fd5d00632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:47.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5c7fff700 1 --2- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8b70 0x7fd5d00632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5c7fff700 1 -- 172.21.15.153:0/3168640966 >> v1:172.21.15.153:6789/0 conn(0x7fd5d00656d0 legacy=0x7fd5d00bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5c7fff700 1 -- 172.21.15.153:0/3168640966 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0064910 con 0x7fd5d00a8f50 2023-08-17T00:15:47.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5c7fff700 1 --2- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00a8f50 0x7fd5d00629b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fd5b8009760 tx=0x7fd5b8009060).ready entity=mon.1 client_cookie=b4e525c68c94459f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5cdd9b700 1 -- 172.21.15.153:0/3168640966 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800b580 con 0x7fd5d00a8f50 2023-08-17T00:15:47.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5cdd9b700 1 -- 172.21.15.153:0/3168640966 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b800b6e0 con 0x7fd5d00a8f50 2023-08-17T00:15:47.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5cdd9b700 1 -- 172.21.15.153:0/3168640966 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800ba60 con 0x7fd5d00a8f50 2023-08-17T00:15:47.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 -- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00a8f50 msgr2=0x7fd5d00629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00a8f50 0x7fd5d00629b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fd5b8009760 tx=0x7fd5b8009060).stop 2023-08-17T00:15:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 -- 172.21.15.153:0/3168640966 shutdown_connections 2023-08-17T00:15:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00a8f50 0x7fd5d00629b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/3168640966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8b70 0x7fd5d00632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 -- 172.21.15.153:0/3168640966 >> 172.21.15.153:0/3168640966 conn(0x7fd5d00c7150 msgr2=0x7fd5d00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 -- 172.21.15.153:0/3168640966 shutdown_connections 2023-08-17T00:15:47.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.445+0000 7fd5d48f1700 1 -- 172.21.15.153:0/3168640966 wait complete. 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 Processor -- start 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 -- start start 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00656d0 0x7fd5d0143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 0x7fd5d00c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8f50 0x7fd5d00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00c5b60 con 0x7fd5d00a8b70 2023-08-17T00:15:47.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d01588f0 con 0x7fd5d00656d0 2023-08-17T00:15:47.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5d48f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0158bd0 con 0x7fd5d00a8f50 2023-08-17T00:15:47.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 0x7fd5d00c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5c7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 0x7fd5d00c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44122/0 (socket says 172.21.15.153:44122) 2023-08-17T00:15:47.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.449+0000 7fd5c7fff700 1 -- 172.21.15.153:0/1649257485 learned_addr learned my addr 172.21.15.153:0/1649257485 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:47.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5ce59c700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00656d0 0x7fd5d0143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5ced9d700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8f50 0x7fd5d00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c7fff700 1 -- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8f50 msgr2=0x7fd5d00c5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c7fff700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8f50 0x7fd5d00c5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c7fff700 1 -- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00656d0 msgr2=0x7fd5d0143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c7fff700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00656d0 0x7fd5d0143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c7fff700 1 -- 172.21.15.153:0/1649257485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b80092a0 con 0x7fd5d00a8b70 2023-08-17T00:15:47.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c7fff700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 0x7fd5d00c5180 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7fd5b8011000 tx=0x7fd5b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800be60 con 0x7fd5d00a8b70 2023-08-17T00:15:47.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b800b850 con 0x7fd5d00a8b70 2023-08-17T00:15:47.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d0158eb0 con 0x7fd5d00a8b70 2023-08-17T00:15:47.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b801b440 con 0x7fd5d00a8b70 2023-08-17T00:15:47.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d0159470 con 0x7fd5d00a8b70 2023-08-17T00:15:47.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.453+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d0159660 con 0x7fd5d00a8b70 2023-08-17T00:15:47.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.457+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd5b800f070 con 0x7fd5d00a8b70 2023-08-17T00:15:47.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.457+0000 7fd5c67fc700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd5b005a150 0x7fd5b005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.457+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd5b8075770 con 0x7fd5d00a8b70 2023-08-17T00:15:47.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.457+0000 7fd5ce59c700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd5b005a150 0x7fd5b005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.457+0000 7fd5ce59c700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd5b005a150 0x7fd5b005c610 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fd5c000bbc0 tx=0x7fd5c0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.465+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd5b8049220 con 0x7fd5d00a8b70 2023-08-17T00:15:47.598 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:15:47.606 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:15:47.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.657+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5d006b530 con 0x7fd5d00a8b70 2023-08-17T00:15:47.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.657+0000 7fd5c67fc700 1 -- 172.21.15.153:0/1649257485 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fd5b804c840 con 0x7fd5d00a8b70 2023-08-17T00:15:47.664 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:15:47.664 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:15:47.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd5b005a150 msgr2=0x7fd5b005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd5b005a150 0x7fd5b005c610 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 rx=0x7fd5c000bbc0 tx=0x7fd5c0008040).stop 2023-08-17T00:15:47.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 msgr2=0x7fd5d00c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 0x7fd5d00c5180 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 rx=0x7fd5b8011000 tx=0x7fd5b8017000).stop 2023-08-17T00:15:47.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 shutdown_connections 2023-08-17T00:15:47.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd5b005a150 0x7fd5b005c610 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd5d00a8f50 0x7fd5d00c5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd5d00a8b70 0x7fd5d00c5180 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 --2- 172.21.15.153:0/1649257485 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd5d00656d0 0x7fd5d0143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 >> 172.21.15.153:0/1649257485 conn(0x7fd5d00c7150 msgr2=0x7fd5d01577b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:47.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 shutdown_connections 2023-08-17T00:15:47.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.661+0000 7fd5d48f1700 1 -- 172.21.15.153:0/1649257485 wait complete. 2023-08-17T00:15:47.671 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:15:47.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-08-17T00:15:47.905 INFO:teuthology.orchestra.run.smithi153.stdout:{"message":"","return_code":0} 2023-08-17T00:15:47.906 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-08-17T00:15:47.906 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2023-08-17T00:15:47.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 Processor -- start 2023-08-17T00:15:47.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 -- start start 2023-08-17T00:15:47.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db67a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db66fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db66f7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db66fb8e0 con 0x558db67a5620 2023-08-17T00:15:47.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db6715b20 con 0x558db66f9c90 2023-08-17T00:15:47.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bfaaddd00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558db66fb150 con 0x558db67a0b70 2023-08-17T00:15:47.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db66f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.965 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db66f7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44138/0 (socket says 172.21.15.153:44138) 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 -- 172.21.15.153:0/369052921 learned_addr learned my addr 172.21.15.153:0/369052921 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8437700 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db67a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6befc36700 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db66fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 -- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 msgr2=0x558db66fbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db66fbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 -- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 msgr2=0x558db67a42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:47.966 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db67a42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 -- 172.21.15.153:0/369052921 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8005db0 con 0x558db67a5620 2023-08-17T00:15:47.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.957+0000 7f6bf8c38700 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db66f7880 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f6bf000a760 tx=0x7f6bf0005bc0).ready entity=mon.0 client_cookie=128041f8fad5d19b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bf7435700 1 -- 172.21.15.153:0/369052921 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000f070 con 0x558db67a5620 2023-08-17T00:15:47.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bf7435700 1 -- 172.21.15.153:0/369052921 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf0007620 con 0x558db67a5620 2023-08-17T00:15:47.967 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bf7435700 1 -- 172.21.15.153:0/369052921 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00079c0 con 0x558db67a5620 2023-08-17T00:15:47.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/369052921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 msgr2=0x558db66f7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db66f7880 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 rx=0x7f6bf000a760 tx=0x7f6bf0005bc0).stop 2023-08-17T00:15:47.968 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/369052921 shutdown_connections 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db66f7880 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db66fbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/369052921 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db67a42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/369052921 >> 172.21.15.153:0/369052921 conn(0x558db6718790 msgr2=0x558db670e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/369052921 shutdown_connections 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/369052921 wait complete. 2023-08-17T00:15:47.969 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 Processor -- start 2023-08-17T00:15:47.970 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.961+0000 7f6bfaaddd00 1 -- start start 2023-08-17T00:15:47.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db66f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db6793590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.971 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db6793a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db6798a70 con 0x558db67a5620 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558db6793f70 con 0x558db66f9c90 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558db679d310 con 0x558db67a0b70 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db6793a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db6793a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44150/0 (socket says 172.21.15.153:44150) 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 -- 172.21.15.153:0/2693132288 learned_addr learned my addr 172.21.15.153:0/2693132288 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:47.972 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6befc36700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db6793590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8437700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db66f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 -- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 msgr2=0x558db6793590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558db67a0b70 0x558db6793590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 -- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 msgr2=0x558db66f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558db66f9c90 0x558db66f8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 -- 172.21.15.153:0/2693132288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf000a440 con 0x558db67a5620 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf8c38700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db6793a80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f6bf0005c40 tx=0x7f6bf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.973 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf5c32700 1 -- 172.21.15.153:0/2693132288 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0014d40 con 0x558db67a5620 2023-08-17T00:15:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf5c32700 1 -- 172.21.15.153:0/2693132288 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf001d400 con 0x558db67a5620 2023-08-17T00:15:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558db666a4e0 con 0x558db67a5620 2023-08-17T00:15:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bf5c32700 1 -- 172.21.15.153:0/2693132288 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0014ea0 con 0x558db67a5620 2023-08-17T00:15:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.965+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558db666a230 con 0x558db67a5620 2023-08-17T00:15:47.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6bf5c32700 1 -- 172.21.15.153:0/2693132288 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6bf0007d70 con 0x558db67a5620 2023-08-17T00:15:47.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6bf5c32700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6bd8058c30 0x7f6bd805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6bf5c32700 1 -- 172.21.15.153:0/2693132288 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f6bf0074d40 con 0x558db67a5620 2023-08-17T00:15:47.975 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x558db679dcb0 0x558db679e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:47.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 --> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] -- osd_op(unknown.0.0:1 24.7 24:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected e166) v8 -- 0x558db679e5f0 con 0x558db679dcb0 2023-08-17T00:15:47.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6bf8437700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6bd8058c30 0x7f6bd805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.969+0000 7f6befc36700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x558db679dcb0 0x558db679e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:47.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bf8437700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6bd8058c30 0x7f6bd805b0f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f6be800afd0 tx=0x7f6be8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6befc36700 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x558db679dcb0 0x558db679e100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6befc36700 1 -- 172.21.15.153:0/2693132288 <== osd.3 v2:172.21.15.153:6801/32816 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v166'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6be0002c00 con 0x558db679dcb0 2023-08-17T00:15:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x558db679dcb0 msgr2=0x558db679e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x558db679dcb0 0x558db679e100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6bd8058c30 msgr2=0x7f6bd805b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6bd8058c30 0x7f6bd805b0f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f6be800afd0 tx=0x7f6be8016000).stop 2023-08-17T00:15:47.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 msgr2=0x558db6793a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 --2- 172.21.15.153:0/2693132288 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x558db67a5620 0x558db6793a80 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 rx=0x7f6bf0005c40 tx=0x7f6bf0017000).stop 2023-08-17T00:15:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bf8c38700 1 -- 172.21.15.153:0/2693132288 reap_dead start 2023-08-17T00:15:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 shutdown_connections 2023-08-17T00:15:47.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 >> 172.21.15.153:0/2693132288 conn(0x558db6718790 msgr2=0x558db670cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:47.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 shutdown_connections 2023-08-17T00:15:47.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:47.973+0000 7f6bfaaddd00 1 -- 172.21.15.153:0/2693132288 wait complete. 2023-08-17T00:15:47.985 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub start / recursive,repair 2023-08-17T00:15:48.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.145+0000 7f97b1ab9700 1 Processor -- start 2023-08-17T00:15:48.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.145+0000 7f97b1ab9700 1 -- start start 2023-08-17T00:15:48.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b1ab9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97ac0c3a80 0x7f97ac0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b1ab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b1ab9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac0bdcc0 con 0x7f97ac1559b0 2023-08-17T00:15:48.154 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b1ab9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0c4350 con 0x7f97ac0c3a80 2023-08-17T00:15:48.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b1ab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac155df0 con 0x7f97ac0c63a0 2023-08-17T00:15:48.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97abfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b0ab7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97ac0c3a80 0x7f97ac0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97abfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac1554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:43672/0 (socket says 172.21.15.153:43672) 2023-08-17T00:15:48.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97abfff700 1 -- 172.21.15.153:0/1675657226 learned_addr learned my addr 172.21.15.153:0/1675657226 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b12b8700 1 --1- 172.21.15.153:0/1675657226 >> v1:172.21.15.178:6789/0 conn(0x7f97ac1559b0 0x7f97ac0c5070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:47990/0 (socket says 172.21.15.153:47990) 2023-08-17T00:15:48.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b0ab7700 1 -- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 msgr2=0x7f97ac1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac1554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b0ab7700 1 -- 172.21.15.153:0/1675657226 >> v1:172.21.15.178:6789/0 conn(0x7f97ac1559b0 legacy=0x7f97ac0c5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b0ab7700 1 -- 172.21.15.153:0/1675657226 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac148e40 con 0x7f97ac0c3a80 2023-08-17T00:15:48.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.149+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac0c3e60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f97a0006fd0 tx=0x7f97a0006f40).ready entity=mon.1 client_cookie=7e8e5cc46ea1285c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97ab7fe700 1 -- 172.21.15.153:0/1675657226 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0005880 con 0x7f97ac0c3a80 2023-08-17T00:15:48.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97ab7fe700 1 -- 172.21.15.153:0/1675657226 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00059e0 con 0x7f97ac0c3a80 2023-08-17T00:15:48.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97ab7fe700 1 -- 172.21.15.153:0/1675657226 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a0005d60 con 0x7f97ac0c3a80 2023-08-17T00:15:48.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 msgr2=0x7f97ac0c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac0c3e60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f97a0006fd0 tx=0x7f97a0006f40).stop 2023-08-17T00:15:48.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1675657226 shutdown_connections 2023-08-17T00:15:48.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1675657226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac0c3e60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1675657226 >> 172.21.15.153:0/1675657226 conn(0x7f97ac091c80 msgr2=0x7f97ac065aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1675657226 shutdown_connections 2023-08-17T00:15:48.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.153+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1675657226 wait complete. 2023-08-17T00:15:48.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 Processor -- start 2023-08-17T00:15:48.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 -- start start 2023-08-17T00:15:48.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac14a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac146d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 0x7f97ac154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac162b80 con 0x7f97ac1559b0 2023-08-17T00:15:48.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac161f20 con 0x7f97ac0c3a80 2023-08-17T00:15:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b1ab9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac1621e0 con 0x7f97ac0c63a0 2023-08-17T00:15:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b12b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 0x7f97ac154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b0ab7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac14a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97abfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac146d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b12b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 0x7f97ac154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44162/0 (socket says 172.21.15.153:44162) 2023-08-17T00:15:48.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.157+0000 7f97b12b8700 1 -- 172.21.15.153:0/1475359006 learned_addr learned my addr 172.21.15.153:0/1475359006 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b12b8700 1 -- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 msgr2=0x7f97ac146d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b12b8700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac146d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b12b8700 1 -- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 msgr2=0x7f97ac14a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b12b8700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac14a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b12b8700 1 -- 172.21.15.153:0/1475359006 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97a0009250 con 0x7f97ac1559b0 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b12b8700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 0x7f97ac154db0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f97a4001f00 tx=0x7f97a400e630).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97a8ff9700 1 -- 172.21.15.153:0/1475359006 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4013070 con 0x7f97ac1559b0 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97a8ff9700 1 -- 172.21.15.153:0/1475359006 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a400e2e0 con 0x7f97ac1559b0 2023-08-17T00:15:48.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97a8ff9700 1 -- 172.21.15.153:0/1475359006 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4005c70 con 0x7f97ac1559b0 2023-08-17T00:15:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac1624c0 con 0x7f97ac1559b0 2023-08-17T00:15:48.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.161+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac14c600 con 0x7f97ac1559b0 2023-08-17T00:15:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.165+0000 7f97a8ff9700 1 -- 172.21.15.153:0/1475359006 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f97a40072e0 con 0x7f97ac1559b0 2023-08-17T00:15:48.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.165+0000 7f97a8ff9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f979005a150 0x7f979005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.165+0000 7f97a8ff9700 1 -- 172.21.15.153:0/1475359006 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f97a4077eb0 con 0x7f97ac1559b0 2023-08-17T00:15:48.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.165+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f979005a150 0x7f979005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.165+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f979005a150 0x7f979005c610 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f97a0006f80 tx=0x7f97a0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 Processor -- start 2023-08-17T00:15:48.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 -- start start 2023-08-17T00:15:48.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 0x11bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x11bd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11c2860 0x1178a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10c8270 con 0xf5b7f0 2023-08-17T00:15:48.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e9100 con 0x117b7e0 2023-08-17T00:15:48.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x10f29e0 con 0x11c2860 2023-08-17T00:15:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b0ab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 0x11bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b0ab7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 0x11bf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44168/0 (socket says 172.21.15.153:44168) 2023-08-17T00:15:48.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b0ab7700 1 -- 172.21.15.153:0/3525404795 learned_addr learned my addr 172.21.15.153:0/3525404795 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11c2860 0x1178a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97abfff700 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x11bd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 -- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 msgr2=0x11bd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x11bd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 -- 172.21.15.153:0/3525404795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 msgr2=0x11bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 0x11bf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 -- 172.21.15.153:0/3525404795 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10f60e0 con 0x11c2860 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 0x11bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11c2860 0x1178a40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f97a404f440 tx=0x7f97a4013000).ready entity=mon.2 client_cookie=3ff857459272d127 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f9795ffb700 1 -- 172.21.15.153:0/3525404795 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a404b870 con 0x11c2860 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f9795ffb700 1 -- 172.21.15.153:0/3525404795 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a404d650 con 0x11c2860 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.169+0000 7f9795ffb700 1 -- 172.21.15.153:0/3525404795 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a404bc20 con 0x11c2860 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 -- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11c2860 msgr2=0x1178a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11c2860 0x1178a40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f97a404f440 tx=0x7f97a4013000).stop 2023-08-17T00:15:48.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 -- 172.21.15.153:0/3525404795 shutdown_connections 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x11c2860 0x1178a40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x11bd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3525404795 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf5b7f0 0x11bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 -- 172.21.15.153:0/3525404795 >> 172.21.15.153:0/3525404795 conn(0x1139d50 msgr2=0x117c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 -- 172.21.15.153:0/3525404795 shutdown_connections 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 -- 172.21.15.153:0/3525404795 wait complete. 2023-08-17T00:15:48.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 -- start start 2023-08-17T00:15:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.173+0000 7f97bd09e740 1 Processor -- start 2023-08-17T00:15:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf5b7f0 0x11945d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x117b7e0 0x11a6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1179ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11a5880 con 0x11c2860 2023-08-17T00:15:48.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1179680 con 0xf5b7f0 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x11a6e20 con 0x117b7e0 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 10 client.0 ll_register_callbacks cb 0x1133900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1179ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1179ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44172/0 (socket says 172.21.15.153:44172) 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 -- 172.21.15.153:0/2086213315 learned_addr learned my addr 172.21.15.153:0/2086213315 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97abfff700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x117b7e0 0x11a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf5b7f0 0x11945d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 -- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x117b7e0 msgr2=0x11a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x117b7e0 0x11a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 -- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf5b7f0 msgr2=0x11945d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf5b7f0 0x11945d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 -- 172.21.15.153:0/2086213315 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac148e40 con 0x11c2860 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97abfff700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x117b7e0 0x11a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97b12b8700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1179ad0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f97a404f440 tx=0x7f97a4058000).ready entity=mon.0 client_cookie=8b68695c3a1ae322 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f978affd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f978affd700 1 -- 172.21.15.153:0/2086213315 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4064070 con 0x11c2860 2023-08-17T00:15:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f978affd700 1 -- 172.21.15.153:0/2086213315 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f97a4054e40 con 0x11c2860 2023-08-17T00:15:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10f2dc0 con 0x11c2860 2023-08-17T00:15:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f978affd700 1 -- 172.21.15.153:0/2086213315 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97a404d980 con 0x11c2860 2023-08-17T00:15:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 10 client.9570 fetch_fsmap learned FSMap version 130 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x7f97ac14c600 con 0x11c2860 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f978affd700 1 -- 172.21.15.153:0/2086213315 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x10f2dc0 con 0x11c2860 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f978affd700 1 -- 172.21.15.153:0/2086213315 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f97a404b300 con 0x11c2860 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 10 client.9570 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 10 client.9570 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.177+0000 7f97bd09e740 20 client.9570 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d2270 0x11d2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 4 client.9570 mds_command: new command op to 9390 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:15:48.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10e9310 con 0x11d2270 2023-08-17T00:15:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d2270 0x11d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d2270 0x11d2680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=61e018cff77b071e server_cookie=46788c2c0e94579a in_seq=0 out_seq=0 2023-08-17T00:15:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f978affd700 10 client.9570 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f978affd700 1 -- 172.21.15.153:0/2086213315 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x10e9310 con 0x11d2270 2023-08-17T00:15:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f978affd700 10 client.9570 handle_command_reply: tid=0 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 client.9570 shutdown 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 msgr2=0x1179ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1179ad0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 rx=0x7f97a404f440 tx=0x7f97a4058000).stop 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 shutdown_connections 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d2270 0x11d2680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1179ad0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x117b7e0 0x11a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 --2- 172.21.15.153:0/2086213315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf5b7f0 0x11945d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f978affd700 0 client.9570 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 >> 172.21.15.153:0/2086213315 conn(0x1139d50 msgr2=0x11c02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 shutdown_connections 2023-08-17T00:15:48.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 1 -- 172.21.15.153:0/2086213315 wait complete. 2023-08-17T00:15:48.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.181+0000 7f97bd09e740 20 client.9570 trim_cache size 0 max 16384 2023-08-17T00:15:48.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 Processor -- start 2023-08-17T00:15:48.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 -- start start 2023-08-17T00:15:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x1177670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x1178a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1178f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x10d1f60 con 0x11c2860 2023-08-17T00:15:48.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1172450 con 0x117b7e0 2023-08-17T00:15:48.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1179420 con 0xf5b7f0 2023-08-17T00:15:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.201+0000 7f97b12b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1178f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1178f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44188/0 (socket says 172.21.15.153:44188) 2023-08-17T00:15:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 -- 172.21.15.153:0/3252388494 learned_addr learned my addr 172.21.15.153:0/3252388494 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x1177670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97abfff700 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x1178a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 -- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 msgr2=0x1177670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x1177670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 -- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 msgr2=0x1178a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x1178a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 -- 172.21.15.153:0/3252388494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac155600 con 0x11c2860 2023-08-17T00:15:48.211 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97b12b8700 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1178f30 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f97a400efd0 tx=0x7f97a4064000).ready entity=mon.0 client_cookie=1c10f3d4c9acd903 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.212 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97967fc700 1 -- 172.21.15.153:0/3252388494 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a404ee70 con 0x11c2860 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97967fc700 1 -- 172.21.15.153:0/3252388494 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a404d980 con 0x11c2860 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97967fc700 1 -- 172.21.15.153:0/3252388494 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a404b300 con 0x11c2860 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 -- 172.21.15.153:0/3252388494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 msgr2=0x1178f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1178f30 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 rx=0x7f97a400efd0 tx=0x7f97a4064000).stop 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 -- 172.21.15.153:0/3252388494 shutdown_connections 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x11c2860 0x1178f30 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x117b7e0 0x1178a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 --2- 172.21.15.153:0/3252388494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x1177670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 -- 172.21.15.153:0/3252388494 >> 172.21.15.153:0/3252388494 conn(0x1139d50 msgr2=0x117c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 -- 172.21.15.153:0/3252388494 shutdown_connections 2023-08-17T00:15:48.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.205+0000 7f97bd09e740 1 -- 172.21.15.153:0/3252388494 wait complete. 2023-08-17T00:15:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 -- start start 2023-08-17T00:15:48.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 Processor -- start 2023-08-17T00:15:48.216 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x122e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 0x11d8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11c2860 0x11d8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.217 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x122d5d0 con 0x117b7e0 2023-08-17T00:15:48.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x122d1c0 con 0x11c2860 2023-08-17T00:15:48.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x122d3c0 con 0xf5b7f0 2023-08-17T00:15:48.218 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.209+0000 7f97bd09e740 10 client.0 ll_register_callbacks cb 0x7f97a404f5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:48.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 0x11d8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 0x11d8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44200/0 (socket says 172.21.15.153:44200) 2023-08-17T00:15:48.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 -- 172.21.15.153:0/732729582 learned_addr learned my addr 172.21.15.153:0/732729582 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x122e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97b12b8700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11c2860 0x11d8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 -- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 msgr2=0x122e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x122e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 -- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11c2860 msgr2=0x11d8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11c2860 0x11d8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 -- 172.21.15.153:0/732729582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac14c600 con 0x117b7e0 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x122e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:48.224 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97abfff700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 0x11d8210 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f9798006bc0 tx=0x7f9798017040).ready entity=mon.0 client_cookie=6f8cbad34249f64e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 1 -- 172.21.15.153:0/732729582 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979801a030 con 0x117b7e0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97a404d650 con 0x117b7e0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 1 -- 172.21.15.153:0/732729582 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9798014ae0 con 0x117b7e0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 1 -- 172.21.15.153:0/732729582 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9798014eb0 con 0x117b7e0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 10 client.9576 fetch_fsmap learned FSMap version 130 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x10f1580 con 0x117b7e0 2023-08-17T00:15:48.225 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 1 -- 172.21.15.153:0/732729582 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a404d650 con 0x117b7e0 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 1 -- 172.21.15.153:0/732729582 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9798020460 con 0x117b7e0 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 10 client.9576 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 10 client.9576 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 20 client.9576 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d1620 0x11bd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 4 client.9576 mds_command: new command op to 9390 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2023-08-17T00:15:48.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0xfb2780 con 0x11d1620 2023-08-17T00:15:48.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d1620 0x11bd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f978affd700 10 client.9576 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.213+0000 7f97b0ab7700 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d1620 0x11bd510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=65607d602e0e0dfb server_cookie=a7c57afd0d07bd6a in_seq=0 out_seq=0 2023-08-17T00:15:48.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f978affd700 1 -- 172.21.15.153:0/732729582 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xfb2780 con 0x11d1620 2023-08-17T00:15:48.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f978affd700 10 client.9576 handle_command_reply: tid=0 2023-08-17T00:15:48.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 client.9576 shutdown 2023-08-17T00:15:48.228 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:15:48.217+0000 7fa201592700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2023-08-17T00:15:46.645059+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={7946=0-12582912@1} caps={7946=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=7946 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5639b41af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(24)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-17T00:15:48.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 msgr2=0x11d8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 0x11d8210 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 rx=0x7f9798006bc0 tx=0x7f9798017040).stop 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 shutdown_connections 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x11d1620 0x11bd510 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x11c2860 0x11d8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x117b7e0 0x11d8210 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f978affd700 0 client.9576 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 --2- 172.21.15.153:0/732729582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf5b7f0 0x122e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 >> 172.21.15.153:0/732729582 conn(0x1139d50 msgr2=0x11d0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 shutdown_connections 2023-08-17T00:15:48.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 1 -- 172.21.15.153:0/732729582 wait complete. 2023-08-17T00:15:48.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.217+0000 7f97bd09e740 20 client.9576 trim_cache size 0 max 16384 2023-08-17T00:15:48.230 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:15:48.230 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:15:48.230 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "249ec6fa-fc25-4fca-b58c-4f76ace7c1e0", 2023-08-17T00:15:48.231 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:15:48.231 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:15:48.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f979005a150 msgr2=0x7f979005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f979005a150 0x7f979005c610 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f97a0006f80 tx=0x7f97a0016000).stop 2023-08-17T00:15:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 msgr2=0x7f97ac154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 0x7f97ac154db0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 rx=0x7f97a4001f00 tx=0x7f97a400e630).stop 2023-08-17T00:15:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 shutdown_connections 2023-08-17T00:15:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f979005a150 0x7f979005c610 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f97ac1559b0 0x7f97ac154db0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97ac0c63a0 0x7f97ac146d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 --2- 172.21.15.153:0/1475359006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97ac0c3a80 0x7f97ac14a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 >> 172.21.15.153:0/1475359006 conn(0x7f97ac091c80 msgr2=0x7f97ac0667e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 shutdown_connections 2023-08-17T00:15:48.233 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.221+0000 7f97b1ab9700 1 -- 172.21.15.153:0/1475359006 wait complete. 2023-08-17T00:15:48.246 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub status 2023-08-17T00:15:48.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.405+0000 7fd2dc8db700 1 Processor -- start 2023-08-17T00:15:48.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.405+0000 7fd2dc8db700 1 -- start start 2023-08-17T00:15:48.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153e90 0x7fd2d80c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd2d80c7980 0x7fd2d80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80aa750 con 0x7fd2d8153ab0 2023-08-17T00:15:48.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d80c9dd0 con 0x7fd2d80c7980 2023-08-17T00:15:48.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80aacf0 con 0x7fd2d8153e90 2023-08-17T00:15:48.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd2d8153ab0 0x7fd2d80c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47500/0 (socket says 172.21.15.153:47500) 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d659c700 1 -- 172.21.15.153:0/3574756152 learned_addr learned my addr 172.21.15.153:0/3574756152 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3574756152 >> v2:172.21.15.153:3300/0 conn(0x7fd2d80c7980 0x7fd2d80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/3574756152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153e90 0x7fd2d80c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d559a700 1 -- 172.21.15.153:0/3574756152 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774152121 0 0) 0x7fd2d80aa750 con 0x7fd2d8153ab0 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d559a700 1 -- 172.21.15.153:0/3574756152 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c00033f0 con 0x7fd2d8153ab0 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3574756152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153e90 msgr2=0x7fd2d80c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3574756152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153e90 0x7fd2d80c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3574756152 >> v1:172.21.15.153:6789/0 conn(0x7fd2d8153ab0 legacy=0x7fd2d80c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3574756152 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d81542f0 con 0x7fd2d80c7980 2023-08-17T00:15:48.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3574756152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d80c7980 0x7fd2d80ab180 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fd2d0009e60 tx=0x7fd2d0009780).ready entity=mon.0 client_cookie=e61c11b4612ff833 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d559a700 1 -- 172.21.15.153:0/3574756152 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000e070 con 0x7fd2d80c7980 2023-08-17T00:15:48.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d559a700 1 -- 172.21.15.153:0/3574756152 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d000bab0 con 0x7fd2d80c7980 2023-08-17T00:15:48.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2d559a700 1 -- 172.21.15.153:0/3574756152 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000be30 con 0x7fd2d80c7980 2023-08-17T00:15:48.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3574756152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d80c7980 msgr2=0x7fd2d80ab180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3574756152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d80c7980 0x7fd2d80ab180 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 rx=0x7fd2d0009e60 tx=0x7fd2d0009780).stop 2023-08-17T00:15:48.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3574756152 shutdown_connections 2023-08-17T00:15:48.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3574756152 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d80c7980 0x7fd2d80ab180 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3574756152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153e90 0x7fd2d80c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3574756152 >> 172.21.15.153:0/3574756152 conn(0x7fd2d8061fa0 msgr2=0x7fd2d80623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.409+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3574756152 shutdown_connections 2023-08-17T00:15:48.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3574756152 wait complete. 2023-08-17T00:15:48.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 Processor -- start 2023-08-17T00:15:48.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 -- start start 2023-08-17T00:15:48.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d80c7980 0x7fd2d80af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153ab0 0x7fd2d814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 0x7fd2d814fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8150290 con 0x7fd2d8153e90 2023-08-17T00:15:48.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80b0a40 con 0x7fd2d80c7980 2023-08-17T00:15:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2dc8db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80afe30 con 0x7fd2d8153ab0 2023-08-17T00:15:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 0x7fd2d814fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 0x7fd2d814fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44224/0 (socket says 172.21.15.153:44224) 2023-08-17T00:15:48.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3578904642 learned_addr learned my addr 172.21.15.153:0/3578904642 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153ab0 0x7fd2d814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d80c7980 0x7fd2d80af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153ab0 msgr2=0x7fd2d814f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153ab0 0x7fd2d814f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d80c7980 msgr2=0x7fd2d80af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.413+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d80c7980 0x7fd2d80af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/3578904642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0009a20 con 0x7fd2d8153e90 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d80c7980 0x7fd2d80af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:15:48.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 0x7fd2d814fda0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fd2d000b610 tx=0x7fd2d80aac60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2c67fc700 1 -- 172.21.15.153:0/3578904642 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d001d630 con 0x7fd2d8153e90 2023-08-17T00:15:48.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2c67fc700 1 -- 172.21.15.153:0/3578904642 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d001d790 con 0x7fd2d8153e90 2023-08-17T00:15:48.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d80b0110 con 0x7fd2d8153e90 2023-08-17T00:15:48.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2c67fc700 1 -- 172.21.15.153:0/3578904642 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d001db50 con 0x7fd2d8153e90 2023-08-17T00:15:48.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.417+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80b06d0 con 0x7fd2d8153e90 2023-08-17T00:15:48.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2c67fc700 1 -- 172.21.15.153:0/3578904642 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd2d0027460 con 0x7fd2d8153e90 2023-08-17T00:15:48.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2c67fc700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b805a150 0x7fd2b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2c67fc700 1 -- 172.21.15.153:0/3578904642 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2d00762c0 con 0x7fd2d8153e90 2023-08-17T00:15:48.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 Processor -- start 2023-08-17T00:15:48.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 -- start start 2023-08-17T00:15:48.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b805a150 0x7fd2b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x12ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12d4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x12d4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x11d41a0 con 0x12adce0 2023-08-17T00:15:48.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1288300 con 0x12ad860 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.421+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1287730 con 0x12c9d20 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b805a150 0x7fd2b805c610 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fd2c8005750 tx=0x7fd2c8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x12d4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x12d4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44232/0 (socket says 172.21.15.153:44232) 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/704178505 learned_addr learned my addr 172.21.15.153:0/704178505 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12d4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d659c700 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x12ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 msgr2=0x12ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x12ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 msgr2=0x12d4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12d4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/704178505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1202010 con 0x12adce0 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x12d4630 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fd2d004d630 tx=0x7fd2d000e000).ready entity=mon.0 client_cookie=60fe3c33a24d6d1f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2b77fe700 1 -- 172.21.15.153:0/704178505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00760a0 con 0x12adce0 2023-08-17T00:15:48.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2b77fe700 1 -- 172.21.15.153:0/704178505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d004d860 con 0x12adce0 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2b77fe700 1 -- 172.21.15.153:0/704178505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0053000 con 0x12adce0 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/704178505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 msgr2=0x12d4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x12d4630 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 rx=0x7fd2d004d630 tx=0x7fd2d000e000).stop 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/704178505 shutdown_connections 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x12d4630 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12d4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/704178505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x12ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/704178505 >> 172.21.15.153:0/704178505 conn(0x1067680 msgr2=0x12887d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/704178505 shutdown_connections 2023-08-17T00:15:48.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/704178505 wait complete. 2023-08-17T00:15:48.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 -- start start 2023-08-17T00:15:48.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.425+0000 7fd2e6c7c740 1 Processor -- start 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12a90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 0x12ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12a95c0 con 0x12c9d20 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x12b30b0 con 0x12ad860 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12b4580 con 0x12adce0 2023-08-17T00:15:48.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 10 client.0 ll_register_callbacks cb 0x123f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 0x12ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 0x12ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44246/0 (socket says 172.21.15.153:44246) 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/1330816850 learned_addr learned my addr 172.21.15.153:0/1330816850 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d659c700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12a90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 msgr2=0x12ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ac640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 msgr2=0x12a90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12a90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 -- 172.21.15.153:0/1330816850 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d80b06d0 con 0x12c9d20 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 0x12ced90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7fd2d0013e20 tx=0x7fd2d001f000).ready entity=mon.0 client_cookie=6c65d50bf17670e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/1330816850 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d000e040 con 0x12c9d20 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/1330816850 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2d0049fd0 con 0x12c9d20 2023-08-17T00:15:48.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x11d0200 con 0x12c9d20 2023-08-17T00:15:48.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/1330816850 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2d004a190 con 0x12c9d20 2023-08-17T00:15:48.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 10 client.9591 fetch_fsmap learned FSMap version 130 2023-08-17T00:15:48.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x11fd4b0 con 0x12c9d20 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/1330816850 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x11d0200 con 0x12c9d20 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/1330816850 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd2d004daf0 con 0x12c9d20 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 10 client.9591 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 10 client.9591 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 20 client.9591 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12dde50 0x12de260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 4 client.9591 mds_command: new command op to 9390 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:15:48.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.429+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11fecf0 con 0x12dde50 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2d659c700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12dde50 0x12de260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2d659c700 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12dde50 0x12de260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=953c51a60139f09b server_cookie=f185caf6c78cda47 in_seq=0 out_seq=0 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2b4ff9700 10 client.9591 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/1330816850 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x11fecf0 con 0x12dde50 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2b4ff9700 10 client.9591 handle_command_reply: tid=0 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 client.9591 shutdown 2023-08-17T00:15:48.442 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 msgr2=0x12ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 0x12ced90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 rx=0x7fd2d0013e20 tx=0x7fd2d001f000).stop 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 shutdown_connections 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12dde50 0x12de260 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12c9d20 0x12ced90 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/1330816850 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12ad860 0x12a90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.443 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2b4ff9700 0 client.9591 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 >> 172.21.15.153:0/1330816850 conn(0x1067680 msgr2=0x1286b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 shutdown_connections 2023-08-17T00:15:48.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/1330816850 wait complete. 2023-08-17T00:15:48.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.433+0000 7fd2e6c7c740 20 client.9591 trim_cache size 0 max 16384 2023-08-17T00:15:48.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 Processor -- start 2023-08-17T00:15:48.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 -- start start 2023-08-17T00:15:48.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 0x1286b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c9d20 0x12ace60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x12caf30 con 0x12ad860 2023-08-17T00:15:48.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x122c680 con 0x12c9d20 2023-08-17T00:15:48.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12b3910 con 0x12adce0 2023-08-17T00:15:48.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 0x1286b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 0x1286b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:44256/0 (socket says 172.21.15.153:44256) 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 -- 172.21.15.153:0/2514222294 learned_addr learned my addr 172.21.15.153:0/2514222294 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c9d20 0x12ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 -- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 msgr2=0x12ab7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ab7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 -- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c9d20 msgr2=0x12ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c9d20 0x12ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 -- 172.21.15.153:0/2514222294 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12a9430 con 0x12ad860 2023-08-17T00:15:48.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:15:48.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.453+0000 7fd2d659c700 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 0x1286b40 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7fd2c8007d90 tx=0x7fd2c8007000).ready entity=mon.0 client_cookie=8950532ccbca28c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2b7fff700 1 -- 172.21.15.153:0/2514222294 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c801c070 con 0x12ad860 2023-08-17T00:15:48.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2b7fff700 1 -- 172.21.15.153:0/2514222294 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c801d040 con 0x12ad860 2023-08-17T00:15:48.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2b7fff700 1 -- 172.21.15.153:0/2514222294 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80236e0 con 0x12ad860 2023-08-17T00:15:48.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/2514222294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 msgr2=0x1286b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 0x1286b40 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 rx=0x7fd2c8007d90 tx=0x7fd2c8007000).stop 2023-08-17T00:15:48.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/2514222294 shutdown_connections 2023-08-17T00:15:48.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12c9d20 0x12ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12adce0 0x12ab7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/2514222294 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12ad860 0x1286b40 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/2514222294 >> 172.21.15.153:0/2514222294 conn(0x1067680 msgr2=0x12ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/2514222294 shutdown_connections 2023-08-17T00:15:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/2514222294 wait complete. 2023-08-17T00:15:48.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 -- start start 2023-08-17T00:15:48.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.457+0000 7fd2e6c7c740 1 Processor -- start 2023-08-17T00:15:48.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x1332ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x13333b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12e8e00 0x12b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1339f80 con 0x12adce0 2023-08-17T00:15:48.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x133ca20 con 0x12e8e00 2023-08-17T00:15:48.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x12ac8b0 con 0x12c9d20 2023-08-17T00:15:48.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2e6c7c740 10 client.0 ll_register_callbacks cb 0x7fd2cc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:15:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d5d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x13333b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x1332ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d5d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x13333b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:43754/0 (socket says 172.21.15.153:43754) 2023-08-17T00:15:48.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d5d9b700 1 -- 172.21.15.153:0/3088340053 learned_addr learned my addr 172.21.15.153:0/3088340053 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:15:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d6d9d700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12e8e00 0x12b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 -- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 msgr2=0x13333b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x13333b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 -- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12e8e00 msgr2=0x12b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:15:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12e8e00 0x12b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 -- 172.21.15.153:0/3088340053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c00033f0 con 0x12adce0 2023-08-17T00:15:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x13333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:15:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2d659c700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x1332ec0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7fd2c8022000 tx=0x7fd2c801f000).ready entity=mon.0 client_cookie=bec8ca24657decf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:15:48.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.461+0000 7fd2b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:15:48.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/3088340053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8023a90 con 0x12adce0 2023-08-17T00:15:48.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2d004d860 con 0x12adce0 2023-08-17T00:15:48.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/3088340053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd2c8023bf0 con 0x12adce0 2023-08-17T00:15:48.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/3088340053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2c802c400 con 0x12adce0 2023-08-17T00:15:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 10 client.9597 fetch_fsmap learned FSMap version 130 2023-08-17T00:15:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x7fd2d80ca270 con 0x12adce0 2023-08-17T00:15:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/3088340053 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d004d860 con 0x12adce0 2023-08-17T00:15:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/3088340053 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd2c8022030 con 0x12adce0 2023-08-17T00:15:48.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 10 client.9597 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 10 client.9597 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 20 client.9597 populate_metadata read hostname 'smithi153' 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12d9df0 0x12da200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 4 client.9597 mds_command: new command op to 9390 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x11f5240 con 0x12d9df0 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12d9df0 0x12da200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:15:48.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 10 client.9597 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2d5d9b700 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12d9df0 0x12da200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=5d702256e3fdd897 server_cookie=1fc921b39c633c4a in_seq=0 out_seq=0 2023-08-17T00:15:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 1 -- 172.21.15.153:0/3088340053 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x11f5240 con 0x12d9df0 2023-08-17T00:15:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 10 client.9597 handle_command_reply: tid=0 2023-08-17T00:15:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 client.9597 shutdown 2023-08-17T00:15:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 msgr2=0x1332ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x1332ec0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 rx=0x7fd2c8022000 tx=0x7fd2c801f000).stop 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 shutdown_connections 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x12d9df0 0x12da200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x12e8e00 0x12b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2b4ff9700 0 client.9597 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x12c9d20 0x13333b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 --2- 172.21.15.153:0/3088340053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x12adce0 0x1332ec0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.465+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 >> 172.21.15.153:0/3088340053 conn(0x1067680 msgr2=0x12869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 shutdown_connections 2023-08-17T00:15:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2e6c7c740 1 -- 172.21.15.153:0/3088340053 wait complete. 2023-08-17T00:15:48.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2e6c7c740 20 client.9597 trim_cache size 0 max 16384 2023-08-17T00:15:48.479 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:15:48.479 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:15:48.480 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:15:48.480 INFO:teuthology.orchestra.run.smithi153.stdout: "249ec6fa-fc25-4fca-b58c-4f76ace7c1e0": { 2023-08-17T00:15:48.480 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2023-08-17T00:15:48.480 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "249ec6fa-fc25-4fca-b58c-4f76ace7c1e0", 2023-08-17T00:15:48.480 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive,repair" 2023-08-17T00:15:48.480 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:48.481 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:15:48.481 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:15:48.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b805a150 msgr2=0x7fd2b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b805a150 0x7fd2b805c610 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7fd2c8005750 tx=0x7fd2c8009040).stop 2023-08-17T00:15:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 msgr2=0x7fd2d814fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:15:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 0x7fd2d814fda0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 rx=0x7fd2d000b610 tx=0x7fd2d80aac60).stop 2023-08-17T00:15:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 shutdown_connections 2023-08-17T00:15:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd2b805a150 0x7fd2b805c610 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd2d8153e90 0x7fd2d814fda0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd2d8153ab0 0x7fd2d814f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 --2- 172.21.15.153:0/3578904642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd2d80c7980 0x7fd2d80af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:15:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 >> 172.21.15.153:0/3578904642 conn(0x7fd2d8061fa0 msgr2=0x7fd2d8063fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:15:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 shutdown_connections 2023-08-17T00:15:48.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:15:48.469+0000 7fd2dc8db700 1 -- 172.21.15.153:0/3578904642 wait complete. 2023-08-17T00:15:48.495 INFO:tasks.cephfs.filesystem:scrub status for tag:249ec6fa-fc25-4fca-b58c-4f76ace7c1e0 - {'path': '/', 'tag': '249ec6fa-fc25-4fca-b58c-4f76ace7c1e0', 'options': 'recursive,repair'} 2023-08-17T00:16:17.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:16:17.694 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:16:18.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub status 2023-08-17T00:16:18.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.660+0000 7f216229b700 1 Processor -- start 2023-08-17T00:16:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.660+0000 7f216229b700 1 -- start start 2023-08-17T00:16:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f216229b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f215c0632e0 0x7f215c0a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f216229b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f215c0629b0 0x7f215c0bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f216229b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c065240 con 0x7f215c0a8b70 2023-08-17T00:16:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f216229b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c0638a0 con 0x7f215c0632e0 2023-08-17T00:16:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f216229b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c065de0 con 0x7f215c0629b0 2023-08-17T00:16:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f215bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f215c0a8b70 0x7f215c0656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47720/0 (socket says 172.21.15.153:47720) 2023-08-17T00:16:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f215bfff700 1 -- 172.21.15.153:0/350858184 learned_addr learned my addr 172.21.15.153:0/350858184 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f21537fe700 1 --2- 172.21.15.153:0/350858184 >> v2:172.21.15.153:3300/0 conn(0x7f215c0632e0 0x7f215c0a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f2160838700 1 --2- 172.21.15.153:0/350858184 >> v2:172.21.15.178:3300/0 conn(0x7f215c0629b0 0x7f215c0bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f215b7fe700 1 -- 172.21.15.153:0/350858184 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423950163 0 0) 0x7f215c065240 con 0x7f215c0a8b70 2023-08-17T00:16:18.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f215b7fe700 1 -- 172.21.15.153:0/350858184 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21480033f0 con 0x7f215c0a8b70 2023-08-17T00:16:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f21537fe700 1 -- 172.21.15.153:0/350858184 >> v2:172.21.15.178:3300/0 conn(0x7f215c0629b0 msgr2=0x7f215c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f21537fe700 1 --2- 172.21.15.153:0/350858184 >> v2:172.21.15.178:3300/0 conn(0x7f215c0629b0 0x7f215c0bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f21537fe700 1 -- 172.21.15.153:0/350858184 >> v1:172.21.15.153:6789/0 conn(0x7f215c0a8b70 legacy=0x7f215c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f21537fe700 1 -- 172.21.15.153:0/350858184 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c062e20 con 0x7f215c0632e0 2023-08-17T00:16:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.664+0000 7f21537fe700 1 --2- 172.21.15.153:0/350858184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0632e0 0x7f215c0a8f50 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f215c069b10 tx=0x7f2144009060).ready entity=mon.0 client_cookie=c168fda222268db5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f215b7fe700 1 -- 172.21.15.153:0/350858184 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400d4a0 con 0x7f215c0632e0 2023-08-17T00:16:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f215b7fe700 1 -- 172.21.15.153:0/350858184 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214400d600 con 0x7f215c0632e0 2023-08-17T00:16:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f215b7fe700 1 -- 172.21.15.153:0/350858184 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214400d980 con 0x7f215c0632e0 2023-08-17T00:16:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 -- 172.21.15.153:0/350858184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0632e0 msgr2=0x7f215c0a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 --2- 172.21.15.153:0/350858184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0632e0 0x7f215c0a8f50 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 rx=0x7f215c069b10 tx=0x7f2144009060).stop 2023-08-17T00:16:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 -- 172.21.15.153:0/350858184 shutdown_connections 2023-08-17T00:16:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 --2- 172.21.15.153:0/350858184 >> v2:172.21.15.178:3300/0 conn(0x7f215c0629b0 0x7f215c0bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 --2- 172.21.15.153:0/350858184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0632e0 0x7f215c0a8f50 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 -- 172.21.15.153:0/350858184 >> 172.21.15.153:0/350858184 conn(0x7f215c0c7150 msgr2=0x7f215c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 -- 172.21.15.153:0/350858184 shutdown_connections 2023-08-17T00:16:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 -- 172.21.15.153:0/350858184 wait complete. 2023-08-17T00:16:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 Processor -- start 2023-08-17T00:16:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.668+0000 7f216229b700 1 -- start start 2023-08-17T00:16:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 0x7f215c0c00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f215c0632e0 0x7f215c0ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f215c0a8b70 0x7f215c1576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0c0590 con 0x7f215c0629b0 2023-08-17T00:16:18.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0a9bc0 con 0x7f215c0632e0 2023-08-17T00:16:18.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0a9ea0 con 0x7f215c0a8b70 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 0x7f215c0c00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f21537fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f215c0632e0 0x7f215c0ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 0x7f215c0c00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54344/0 (socket says 172.21.15.153:54344) 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 -- 172.21.15.153:0/3505664670 learned_addr learned my addr 172.21.15.153:0/3505664670 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f2160838700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f215c0a8b70 0x7f215c1576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 -- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f215c0a8b70 msgr2=0x7f215c1576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f215c0a8b70 0x7f215c1576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 -- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f215c0632e0 msgr2=0x7f215c0ab700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f215c0632e0 0x7f215c0ab700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 -- 172.21.15.153:0/3505664670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440092a0 con 0x7f215c0629b0 2023-08-17T00:16:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f215bfff700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 0x7f215c0c00a0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f214c00c420 tx=0x7f214c007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f2158ff9700 1 -- 172.21.15.153:0/3505664670 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0070d0 con 0x7f215c0629b0 2023-08-17T00:16:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f2158ff9700 1 -- 172.21.15.153:0/3505664670 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c007230 con 0x7f215c0629b0 2023-08-17T00:16:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c0aa180 con 0x7f215c0629b0 2023-08-17T00:16:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f2158ff9700 1 -- 172.21.15.153:0/3505664670 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c0075b0 con 0x7f215c0629b0 2023-08-17T00:16:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.672+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c1591d0 con 0x7f215c0629b0 2023-08-17T00:16:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.676+0000 7f2158ff9700 1 -- 172.21.15.153:0/3505664670 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f214c01a060 con 0x7f215c0629b0 2023-08-17T00:16:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f2158ff9700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f213c05a180 0x7f213c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f2158ff9700 1 -- 172.21.15.153:0/3505664670 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f214c0736d0 con 0x7f215c0629b0 2023-08-17T00:16:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f21537fe700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f213c05a180 0x7f213c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f21537fe700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f213c05a180 0x7f213c05c640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f214400d260 tx=0x7f2144016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f216c61b740 1 Processor -- start 2023-08-17T00:16:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f216c61b740 1 -- start start 2023-08-17T00:16:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f216c61b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f88100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1f92140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.680+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f92630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e921a0 con 0x1f87d20 2023-08-17T00:16:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f46300 con 0x1f6b860 2023-08-17T00:16:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f45730 con 0x1f6bce0 2023-08-17T00:16:18.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f88100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f88100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54350/0 (socket says 172.21.15.153:54350) 2023-08-17T00:16:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 -- 172.21.15.153:0/4102729987 learned_addr learned my addr 172.21.15.153:0/4102729987 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f2160838700 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f92630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f21537fe700 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1f92140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 -- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 msgr2=0x1f92630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f92630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 -- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 msgr2=0x1f92140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1f92140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 -- 172.21.15.153:0/4102729987 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ec0010 con 0x1f87d20 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f21537fe700 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1f92140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f215bfff700 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f88100 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f214c007f30 tx=0x7f214c00f000).ready entity=mon.0 client_cookie=63980689154bad01 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f21517fa700 1 -- 172.21.15.153:0/4102729987 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c054030 con 0x1f87d20 2023-08-17T00:16:18.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f21517fa700 1 -- 172.21.15.153:0/4102729987 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c0491e0 con 0x1f87d20 2023-08-17T00:16:18.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f21517fa700 1 -- 172.21.15.153:0/4102729987 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c04a330 con 0x1f87d20 2023-08-17T00:16:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- 172.21.15.153:0/4102729987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 msgr2=0x1f88100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f88100 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 rx=0x7f214c007f30 tx=0x7f214c00f000).stop 2023-08-17T00:16:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- 172.21.15.153:0/4102729987 shutdown_connections 2023-08-17T00:16:18.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f92630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1f92140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 --2- 172.21.15.153:0/4102729987 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f88100 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- 172.21.15.153:0/4102729987 >> 172.21.15.153:0/4102729987 conn(0x1d25680 msgr2=0x1f467d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- 172.21.15.153:0/4102729987 shutdown_connections 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.684+0000 7f216c61b740 1 -- 172.21.15.153:0/4102729987 wait complete. 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 -- start start 2023-08-17T00:16:18.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 Processor -- start 2023-08-17T00:16:18.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6b860 0x1f6c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 0x1f85bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f99370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6d460 con 0x1f6bce0 2023-08-17T00:16:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f6d740 con 0x1f87d20 2023-08-17T00:16:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f99860 con 0x1f6b860 2023-08-17T00:16:18.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f216c61b740 10 client.0 ll_register_callbacks cb 0x1efd400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 0x1f85bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 0x1f85bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54364/0 (socket says 172.21.15.153:54364) 2023-08-17T00:16:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 -- 172.21.15.153:0/847613828 learned_addr learned my addr 172.21.15.153:0/847613828 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f215bfff700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6b860 0x1f6c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f2160838700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f99370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 -- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6b860 msgr2=0x1f6c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6b860 0x1f6c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 -- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 msgr2=0x1f99370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f99370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 -- 172.21.15.153:0/847613828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c1591d0 con 0x1f6bce0 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f2160838700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f99370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f21537fe700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 0x1f85bc0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f2144010000 tx=0x7f2144020070).ready entity=mon.0 client_cookie=87f30ad92ad084b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.688+0000 7f213a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 1 -- 172.21.15.153:0/847613828 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144029410 con 0x1f6bce0 2023-08-17T00:16:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 1 -- 172.21.15.153:0/847613828 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2144029570 con 0x1f6bce0 2023-08-17T00:16:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e8e200 con 0x1f6bce0 2023-08-17T00:16:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 1 -- 172.21.15.153:0/847613828 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2144029940 con 0x1f6bce0 2023-08-17T00:16:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 10 client.9612 fetch_fsmap learned FSMap version 130 2023-08-17T00:16:18.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x1ebb4b0 con 0x1f6bce0 2023-08-17T00:16:18.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 1 -- 172.21.15.153:0/847613828 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e8e200 con 0x1f6bce0 2023-08-17T00:16:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 1 -- 172.21.15.153:0/847613828 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2144029aa0 con 0x1f6bce0 2023-08-17T00:16:18.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 10 client.9612 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:16:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 10 client.9612 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-08-17T00:16:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 20 client.9612 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1f84290 0x1f846a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 4 client.9612 mds_command: new command op to 9390 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:16:18.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ebccf0 con 0x1f84290 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f215bfff700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1f84290 0x1f846a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f215bfff700 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1f84290 0x1f846a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=36b7ec4fef1b91b server_cookie=e1b6d79acf321bd2 in_seq=0 out_seq=0 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 10 client.9612 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 1 -- 172.21.15.153:0/847613828 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1ebccf0 con 0x1f84290 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 10 client.9612 handle_command_reply: tid=0 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 client.9612 shutdown 2023-08-17T00:16:18.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 msgr2=0x1f85bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 0x1f85bc0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 rx=0x7f2144010000 tx=0x7f2144020070).stop 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 shutdown_connections 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1f84290 0x1f846a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f99370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6bce0 0x1f85bc0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f213a7fc700 0 client.9612 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 --2- 172.21.15.153:0/847613828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6b860 0x1f6c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.692+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 >> 172.21.15.153:0/847613828 conn(0x1d25680 msgr2=0x1f44bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.696+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 shutdown_connections 2023-08-17T00:16:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.696+0000 7f216c61b740 1 -- 172.21.15.153:0/847613828 wait complete. 2023-08-17T00:16:18.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.696+0000 7f216c61b740 20 client.9612 trim_cache size 0 max 16384 2023-08-17T00:16:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 Processor -- start 2023-08-17T00:16:18.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 -- start start 2023-08-17T00:16:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6b860 0x1f992c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f40e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f41ae0 con 0x1f6b860 2023-08-17T00:16:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f8ce00 con 0x1f87d20 2023-08-17T00:16:18.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.712+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1e9bf60 con 0x1f6bce0 2023-08-17T00:16:18.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f215bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6b860 0x1f992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f21537fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f40e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f40e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:37486/0 (socket says 172.21.15.153:37486) 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 -- 172.21.15.153:0/2724782330 learned_addr learned my addr 172.21.15.153:0/2724782330 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f215bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6b860 0x1f992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54370/0 (socket says 172.21.15.153:54370) 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f21537fe700 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f434f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:54058/0 (socket says 172.21.15.153:54058) 2023-08-17T00:16:18.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 -- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 msgr2=0x1f434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 -- 172.21.15.153:0/2724782330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6b860 msgr2=0x1f992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6b860 0x1f992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 -- 172.21.15.153:0/2724782330 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c157f10 con 0x1f87d20 2023-08-17T00:16:18.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2160838700 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f40e20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f2154007a80 tx=0x7f215400b040).ready entity=mon.1 client_cookie=8ee17f77b16b5d25 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2151ffb700 1 -- 172.21.15.153:0/2724782330 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400e040 con 0x1f87d20 2023-08-17T00:16:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2151ffb700 1 -- 172.21.15.153:0/2724782330 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215401b070 con 0x1f87d20 2023-08-17T00:16:18.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f2151ffb700 1 -- 172.21.15.153:0/2724782330 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154007ec0 con 0x1f87d20 2023-08-17T00:16:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 -- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 msgr2=0x1f40e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f40e20 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f2154007a80 tx=0x7f215400b040).stop 2023-08-17T00:16:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 -- 172.21.15.153:0/2724782330 shutdown_connections 2023-08-17T00:16:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f87d20 0x1f40e20 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 --2- 172.21.15.153:0/2724782330 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f6b860 0x1f992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 -- 172.21.15.153:0/2724782330 >> 172.21.15.153:0/2724782330 conn(0x1d25680 msgr2=0x1f45ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 -- 172.21.15.153:0/2724782330 shutdown_connections 2023-08-17T00:16:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 -- 172.21.15.153:0/2724782330 wait complete. 2023-08-17T00:16:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.716+0000 7f216c61b740 1 -- start start 2023-08-17T00:16:18.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 Processor -- start 2023-08-17T00:16:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1fef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f86ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f87190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f87680 con 0x1f87d20 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fefcf0 con 0x1f6b860 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f43710 con 0x1f6bce0 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 10 client.0 ll_register_callbacks cb 0x7f214400de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f87190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f87190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54380/0 (socket says 172.21.15.153:54380) 2023-08-17T00:16:18.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 -- 172.21.15.153:0/1750049129 learned_addr learned my addr 172.21.15.153:0/1750049129 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f215bfff700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1fef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f21537fe700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f86ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 -- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 msgr2=0x1f86ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f86ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 -- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 msgr2=0x1fef0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:18.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1fef0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 -- 172.21.15.153:0/1750049129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2154007750 con 0x1f87d20 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f21537fe700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f86ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f2160838700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f87190 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f215401a000 tx=0x7f215401e000).ready entity=mon.0 client_cookie=b6e550beb69ddd02 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f213a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f213a7fc700 1 -- 172.21.15.153:0/1750049129 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400e070 con 0x1f87d20 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f214c0491e0 con 0x1f87d20 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.720+0000 7f213a7fc700 1 -- 172.21.15.153:0/1750049129 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2154020630 con 0x1f87d20 2023-08-17T00:16:18.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 1 -- 172.21.15.153:0/1750049129 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=130) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2154016ed0 con 0x1f87d20 2023-08-17T00:16:18.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 10 client.9618 fetch_fsmap learned FSMap version 130 2023-08-17T00:16:18.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=130,monmap=2+}) v3 -- 0x1ebb200 con 0x1f87d20 2023-08-17T00:16:18.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 1 -- 172.21.15.153:0/1750049129 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c0491e0 con 0x1f87d20 2023-08-17T00:16:18.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 1 -- 172.21.15.153:0/1750049129 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 130) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2154020a00 con 0x1f87d20 2023-08-17T00:16:18.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 10 client.9618 fetch_fsmap finished waiting for FSMap version 130 2023-08-17T00:16:18.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 10 client.9618 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-08-17T00:16:18.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 20 client.9618 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:18.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1fef5a0 0x1f6dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:18.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 4 client.9618 mds_command: new command op to 9390 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:16:18.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 --> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1eb3240 con 0x1fef5a0 2023-08-17T00:16:18.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f215bfff700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1fef5a0 0x1f6dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:18.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 10 client.9618 ms_handle_connect on v2:172.21.15.153:6833/723499345 2023-08-17T00:16:18.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f215bfff700 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1fef5a0 0x1f6dd80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d233a8acb2426f77 server_cookie=3ac94c8c805cc5b6 in_seq=0 out_seq=0 2023-08-17T00:16:18.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 1 -- 172.21.15.153:0/1750049129 <== mds.0 v2:172.21.15.153:6833/723499345 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1eb3240 con 0x1fef5a0 2023-08-17T00:16:18.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 10 client.9618 handle_command_reply: tid=0 2023-08-17T00:16:18.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 client.9618 shutdown 2023-08-17T00:16:18.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 msgr2=0x1f87190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f87190 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 rx=0x7f215401a000 tx=0x7f215401e000).stop 2023-08-17T00:16:18.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 shutdown_connections 2023-08-17T00:16:18.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:6833/723499345,v1:172.21.15.153:6835/723499345] conn(0x1fef5a0 0x1f6dd80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f87d20 0x1f87190 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f6bce0 0x1f86ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f213a7fc700 0 client.9618 ms_handle_reset on v2:172.21.15.153:6833/723499345 2023-08-17T00:16:18.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 --2- 172.21.15.153:0/1750049129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f6b860 0x1fef0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 >> 172.21.15.153:0/1750049129 conn(0x1d25680 msgr2=0x1f458c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:18.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 shutdown_connections 2023-08-17T00:16:18.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 1 -- 172.21.15.153:0/1750049129 wait complete. 2023-08-17T00:16:18.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216c61b740 20 client.9618 trim_cache size 0 max 16384 2023-08-17T00:16:18.742 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:16:18.742 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:16:18.742 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:16:18.743 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:16:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f213c05a180 msgr2=0x7f213c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216229b700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f213c05a180 0x7f213c05c640 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 rx=0x7f214400d260 tx=0x7f2144016000).stop 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 msgr2=0x7f215c0c00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.724+0000 7f216229b700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 0x7f215c0c00a0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 rx=0x7f214c00c420 tx=0x7f214c007c80).stop 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 shutdown_connections 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f213c05a180 0x7f213c05c640 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f215c0a8b70 0x7f215c1576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f215c0632e0 0x7f215c0ab700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 --2- 172.21.15.153:0/3505664670 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f215c0629b0 0x7f215c0c00a0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 >> 172.21.15.153:0/3505664670 conn(0x7f215c0c7150 msgr2=0x7f215c0656d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 shutdown_connections 2023-08-17T00:16:18.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:18.728+0000 7f216229b700 1 -- 172.21.15.153:0/3505664670 wait complete. 2023-08-17T00:16:18.754 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:16:18.755 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:16:18.755 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:16:18.755 DEBUG:teuthology.orchestra.run.smithi153:> import stat 2023-08-17T00:16:18.756 DEBUG:teuthology.orchestra.run.smithi153:> import json 2023-08-17T00:16:18.756 DEBUG:teuthology.orchestra.run.smithi153:> import sys 2023-08-17T00:16:18.756 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:16:18.756 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:16:18.757 DEBUG:teuthology.orchestra.run.smithi153:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-08-17T00:16:18.757 DEBUG:teuthology.orchestra.run.smithi153:> except OSError as e: 2023-08-17T00:16:18.757 DEBUG:teuthology.orchestra.run.smithi153:> sys.exit(e.errno) 2023-08-17T00:16:18.758 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:16:18.758 DEBUG:teuthology.orchestra.run.smithi153:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-08-17T00:16:18.758 DEBUG:teuthology.orchestra.run.smithi153:> print(json.dumps( 2023-08-17T00:16:18.758 DEBUG:teuthology.orchestra.run.smithi153:> dict([(a, getattr(s, a)) for a in attrs]), 2023-08-17T00:16:18.759 DEBUG:teuthology.orchestra.run.smithi153:> indent=2)) 2023-08-17T00:16:18.759 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:16:18.861 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_mode": 33204, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_ino": 1099511627777, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_dev": 49, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_nlink": 1, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_uid": 1000, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_gid": 1267, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_size": 6291456, 2023-08-17T00:16:18.862 INFO:teuthology.orchestra.run.smithi153.stdout: "st_atime": 1692231346.6010606, 2023-08-17T00:16:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "st_mtime": 1692231346.6490595, 2023-08-17T00:16:18.863 INFO:teuthology.orchestra.run.smithi153.stdout: "st_ctime": 1692231346.6490595 2023-08-17T00:16:18.863 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:16:19.045 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:19.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.248+0000 7fb3ed1b9700 1 Processor -- start 2023-08-17T00:16:19.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.248+0000 7fb3ed1b9700 1 -- start start 2023-08-17T00:16:19.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3ed1b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb3e80a8df0 0x7fb3e80c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3ed1b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3e8068820 0x7fb3e8068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3ed1b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e81585a0 con 0x7fb3e8061fa0 2023-08-17T00:16:19.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3ed1b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e8066400 con 0x7fb3e8068820 2023-08-17T00:16:19.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3ed1b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e8069170 con 0x7fb3e80a8df0 2023-08-17T00:16:19.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3e8068820 0x7fb3e8068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb3e8068820 0x7fb3e8068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54382/0 (socket says 172.21.15.153:54382) 2023-08-17T00:16:19.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 -- 172.21.15.153:0/737921112 learned_addr learned my addr 172.21.15.153:0/737921112 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:19.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3e7fff700 1 --2- 172.21.15.153:0/737921112 >> v2:172.21.15.178:3300/0 conn(0x7fb3e80a8df0 0x7fb3e80c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 -- 172.21.15.153:0/737921112 >> v2:172.21.15.178:3300/0 conn(0x7fb3e80a8df0 msgr2=0x7fb3e80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 --2- 172.21.15.153:0/737921112 >> v2:172.21.15.178:3300/0 conn(0x7fb3e80a8df0 0x7fb3e80c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 -- 172.21.15.153:0/737921112 >> v1:172.21.15.178:6789/0 conn(0x7fb3e8061fa0 legacy=0x7fb3e8062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 -- 172.21.15.153:0/737921112 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80b9d30 con 0x7fb3e8068820 2023-08-17T00:16:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3df7fe700 1 --2- 172.21.15.153:0/737921112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8068820 0x7fb3e8068c80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7fb3e80c3f30 tx=0x7fb3d00090f0).ready entity=mon.0 client_cookie=6946d9872fccaa41 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.252+0000 7fb3e77fe700 1 -- 172.21.15.153:0/737921112 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d000b520 con 0x7fb3e8068820 2023-08-17T00:16:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3e77fe700 1 -- 172.21.15.153:0/737921112 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d000b680 con 0x7fb3e8068820 2023-08-17T00:16:19.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3e77fe700 1 -- 172.21.15.153:0/737921112 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d000ba00 con 0x7fb3e8068820 2023-08-17T00:16:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/737921112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8068820 msgr2=0x7fb3e8068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/737921112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8068820 0x7fb3e8068c80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 rx=0x7fb3e80c3f30 tx=0x7fb3d00090f0).stop 2023-08-17T00:16:19.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/737921112 shutdown_connections 2023-08-17T00:16:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/737921112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e8068820 0x7fb3e8068c80 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/737921112 >> v2:172.21.15.178:3300/0 conn(0x7fb3e80a8df0 0x7fb3e80c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/737921112 >> 172.21.15.153:0/737921112 conn(0x7fb3e80c6620 msgr2=0x7fb3e80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/737921112 shutdown_connections 2023-08-17T00:16:19.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/737921112 wait complete. 2023-08-17T00:16:19.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.256+0000 7fb3ed1b9700 1 Processor -- start 2023-08-17T00:16:19.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 -- start start 2023-08-17T00:16:19.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 0x7fb3e80ba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e8068820 0x7fb3e80be670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e80a8df0 0x7fb3e80beb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80bd640 con 0x7fb3e80a8df0 2023-08-17T00:16:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80bd8b0 con 0x7fb3e8061fa0 2023-08-17T00:16:19.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ed1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80bdb90 con 0x7fb3e8068820 2023-08-17T00:16:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 0x7fb3e80ba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ec9b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e80a8df0 0x7fb3e80beb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3e7fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 0x7fb3e80ba8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:37506/0 (socket says 172.21.15.153:37506) 2023-08-17T00:16:19.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3e7fff700 1 -- 172.21.15.153:0/115202346 learned_addr learned my addr 172.21.15.153:0/115202346 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:19.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3df7fe700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e8068820 0x7fb3e80be670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ec9b8700 1 -- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e8068820 msgr2=0x7fb3e80be670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ec9b8700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e8068820 0x7fb3e80be670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ec9b8700 1 -- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 msgr2=0x7fb3e80ba8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ec9b8700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 0x7fb3e80ba8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.260+0000 7fb3ec9b8700 1 -- 172.21.15.153:0/115202346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d0009370 con 0x7fb3e80a8df0 2023-08-17T00:16:19.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3df7fe700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e8068820 0x7fb3e80be670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:19.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3e7fff700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 0x7fb3e80ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:19.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3ec9b8700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e80a8df0 0x7fb3e80beb60 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fb3e000c790 tx=0x7fb3e0001460).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000e4a0 con 0x7fb3e80a8df0 2023-08-17T00:16:19.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000e600 con 0x7fb3e80a8df0 2023-08-17T00:16:19.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e80bde70 con 0x7fb3e80a8df0 2023-08-17T00:16:19.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000e980 con 0x7fb3e80a8df0 2023-08-17T00:16:19.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e80badb0 con 0x7fb3e80a8df0 2023-08-17T00:16:19.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e80be370 con 0x7fb3e80a8df0 2023-08-17T00:16:19.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.264+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb3e0010070 con 0x7fb3e80a8df0 2023-08-17T00:16:19.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.268+0000 7fb3e4ff9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3c805a150 0x7fb3c805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.268+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fb3e00738d0 con 0x7fb3e80a8df0 2023-08-17T00:16:19.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.268+0000 7fb3e7fff700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3c805a150 0x7fb3c805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.268+0000 7fb3e7fff700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3c805a150 0x7fb3c805c610 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fb3d8006920 tx=0x7fb3d8006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.272+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fb3e0047270 con 0x7fb3e80a8df0 2023-08-17T00:16:19.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.460+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3e806b4c0 con 0x7fb3e80a8df0 2023-08-17T00:16:19.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.464+0000 7fb3e4ff9700 1 -- 172.21.15.153:0/115202346 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fb3e004a890 con 0x7fb3e80a8df0 2023-08-17T00:16:19.473 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:19.474 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:16:19.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3c805a150 msgr2=0x7fb3c805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3c805a150 0x7fb3c805c610 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fb3d8006920 tx=0x7fb3d8006f40).stop 2023-08-17T00:16:19.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e80a8df0 msgr2=0x7fb3e80beb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e80a8df0 0x7fb3e80beb60 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 rx=0x7fb3e000c790 tx=0x7fb3e0001460).stop 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 shutdown_connections 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb3c805a150 0x7fb3c805c610 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb3e80a8df0 0x7fb3e80beb60 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb3e8068820 0x7fb3e80be670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 --2- 172.21.15.153:0/115202346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb3e8061fa0 0x7fb3e80ba8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 >> 172.21.15.153:0/115202346 conn(0x7fb3e80c6620 msgr2=0x7fb3e8156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:19.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 shutdown_connections 2023-08-17T00:16:19.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.468+0000 7fb3ed1b9700 1 -- 172.21.15.153:0/115202346 wait complete. 2023-08-17T00:16:19.477 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:16:19.496 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-08-17T00:16:19.674 INFO:teuthology.orchestra.run.smithi153.stdout:{"message":"","return_code":0} 2023-08-17T00:16:19.674 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-08-17T00:16:19.675 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-08-17T00:16:19.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.728+0000 7f62f893dd00 1 Processor -- start 2023-08-17T00:16:19.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.728+0000 7f62f893dd00 1 -- start start 2023-08-17T00:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c01002c70 0x561c010a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 0x561c010a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9f30 0x561c01001af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c00f49ce0 con 0x561c010a9b50 2023-08-17T00:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0101e950 con 0x561c010a9f30 2023-08-17T00:16:19.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c010a5d20 con 0x561c01002c70 2023-08-17T00:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 0x561c010a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 0x561c010a60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54406/0 (socket says 172.21.15.153:54406) 2023-08-17T00:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 -- 172.21.15.153:0/2653432739 learned_addr learned my addr 172.21.15.153:0/2653432739 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62ecf47700 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c01002c70 0x561c010a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62ed748700 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9f30 0x561c01001af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 -- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c01002c70 msgr2=0x561c010a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c01002c70 0x561c010a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 -- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9f30 msgr2=0x561c01001af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9f30 0x561c01001af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 -- 172.21.15.153:0/2653432739 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62dc005db0 con 0x561c010a9b50 2023-08-17T00:16:19.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e4746700 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 0x561c010a60c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f62d4001d60 tx=0x7f62d40017e0).ready entity=mon.0 client_cookie=5a9c5271af618e7f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e77fe700 1 -- 172.21.15.153:0/2653432739 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400bdd0 con 0x561c010a9b50 2023-08-17T00:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e77fe700 1 -- 172.21.15.153:0/2653432739 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400f450 con 0x561c010a9b50 2023-08-17T00:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62e77fe700 1 -- 172.21.15.153:0/2653432739 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400f7d0 con 0x561c010a9b50 2023-08-17T00:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- 172.21.15.153:0/2653432739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 msgr2=0x561c010a60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 0x561c010a60c0 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 rx=0x7f62d4001d60 tx=0x7f62d40017e0).stop 2023-08-17T00:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- 172.21.15.153:0/2653432739 shutdown_connections 2023-08-17T00:16:19.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9f30 0x561c01001af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c010a9b50 0x561c010a60c0 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 --2- 172.21.15.153:0/2653432739 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c01002c70 0x561c010a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- 172.21.15.153:0/2653432739 >> 172.21.15.153:0/2653432739 conn(0x561c01021770 msgr2=0x561c01005d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:19.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- 172.21.15.153:0/2653432739 shutdown_connections 2023-08-17T00:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.732+0000 7f62f893dd00 1 -- 172.21.15.153:0/2653432739 wait complete. 2023-08-17T00:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 Processor -- start 2023-08-17T00:16:19.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 -- start start 2023-08-17T00:16:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c01002c70 0x561c010a35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9b50 0x561c0109fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c010a9f30 0x561c010acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c010a15c0 con 0x561c01002c70 2023-08-17T00:16:19.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c010a0010 con 0x561c010a9b50 2023-08-17T00:16:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c01006220 con 0x561c010a9f30 2023-08-17T00:16:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c01002c70 0x561c010a35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c01002c70 0x561c010a35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54408/0 (socket says 172.21.15.153:54408) 2023-08-17T00:16:19.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 -- 172.21.15.153:0/52671087 learned_addr learned my addr 172.21.15.153:0/52671087 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:19.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62e4746700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9b50 0x561c0109fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ed748700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c010a9f30 0x561c010acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 -- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c010a9f30 msgr2=0x561c010acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561c010a9f30 0x561c010acde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 -- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9b50 msgr2=0x561c0109fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561c010a9b50 0x561c0109fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 -- 172.21.15.153:0/52671087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c00f78040 con 0x561c01002c70 2023-08-17T00:16:19.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62ecf47700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c01002c70 0x561c010a35a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f62dc00a5a0 tx=0x7f62dc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62e5ffb700 1 -- 172.21.15.153:0/52671087 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc008c20 con 0x561c01002c70 2023-08-17T00:16:19.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62e5ffb700 1 -- 172.21.15.153:0/52671087 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc013650 con 0x561c01002c70 2023-08-17T00:16:19.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561c00f73230 con 0x561c01002c70 2023-08-17T00:16:19.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.736+0000 7f62e5ffb700 1 -- 172.21.15.153:0/52671087 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0139f0 con 0x561c01002c70 2023-08-17T00:16:19.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.740+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c00f42a70 con 0x561c01002c70 2023-08-17T00:16:19.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.740+0000 7f62e5ffb700 1 -- 172.21.15.153:0/52671087 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f62dc013d60 con 0x561c01002c70 2023-08-17T00:16:19.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.740+0000 7f62e5ffb700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f62cc058c30 0x7f62cc05b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.740+0000 7f62e5ffb700 1 -- 172.21.15.153:0/52671087 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f62dc075220 con 0x561c01002c70 2023-08-17T00:16:19.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x561c01017350 0x561c010a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:19.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 --> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] -- osd_op(unknown.0.0:1 24.7 24:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected e166) v8 -- 0x561c010a0c90 con 0x561c01017350 2023-08-17T00:16:19.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62e4746700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f62cc058c30 0x7f62cc05b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62ed748700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x561c01017350 0x561c010a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:19.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62ed748700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x561c01017350 0x561c010a07a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62e4746700 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f62cc058c30 0x7f62cc05b0f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x561c01000760 tx=0x7f62d40017e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62ed748700 1 -- 172.21.15.153:0/52671087 <== osd.3 v2:172.21.15.153:6801/32816 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f62e800dac0 con 0x561c01017350 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x561c01017350 msgr2=0x561c010a07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x561c01017350 0x561c010a07a0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f62cc058c30 msgr2=0x7f62cc05b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f62cc058c30 0x7f62cc05b0f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 rx=0x561c01000760 tx=0x7f62d40017e0).stop 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c01002c70 msgr2=0x561c010a35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:19.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 --2- 172.21.15.153:0/52671087 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x561c01002c70 0x561c010a35a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 rx=0x7f62dc00a5a0 tx=0x7f62dc016000).stop 2023-08-17T00:16:19.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62ed748700 1 -- 172.21.15.153:0/52671087 reap_dead start 2023-08-17T00:16:19.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 shutdown_connections 2023-08-17T00:16:19.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 >> 172.21.15.153:0/52671087 conn(0x561c01021770 msgr2=0x561c00fd1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:19.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 shutdown_connections 2023-08-17T00:16:19.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:19.744+0000 7f62f893dd00 1 -- 172.21.15.153:0/52671087 wait complete. 2023-08-17T00:16:19.759 INFO:teuthology.orchestra.run.smithi153.stdout:Ysixmegssubdir 2023-08-17T00:16:19.759 DEBUG:teuthology.orchestra.run.smithi153:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-08-17T00:16:19.846 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:16:19.846 INFO:teuthology.orchestra.run.smithi153.stdout: "ino": 1099511627777, 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: "ancestors": [ 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: "dirino": 1099511627776, 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: "dname": "sixmegs", 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: "version": 6 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:19.847 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:19.848 INFO:teuthology.orchestra.run.smithi153.stdout: "dirino": 1, 2023-08-17T00:16:19.848 INFO:teuthology.orchestra.run.smithi153.stdout: "dname": "subdir", 2023-08-17T00:16:19.848 INFO:teuthology.orchestra.run.smithi153.stdout: "version": 8 2023-08-17T00:16:19.848 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:19.848 INFO:teuthology.orchestra.run.smithi153.stdout: ], 2023-08-17T00:16:19.849 INFO:teuthology.orchestra.run.smithi153.stdout: "pool": 24, 2023-08-17T00:16:19.849 INFO:teuthology.orchestra.run.smithi153.stdout: "old_pools": [] 2023-08-17T00:16:19.849 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:16:19.849 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:19.852 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:16:19.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:19.940 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:19.985 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:16:19.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:16:19.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:16:19.986 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:16:20.118 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:16:20.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:20.118 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:16:20.136 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 Processor -- start 2023-08-17T00:16:20.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 -- start start 2023-08-17T00:16:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d680689c0 0x7f8d68068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d681519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d68065da0 con 0x7f8d681560f0 2023-08-17T00:16:20.344 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d68155c60 con 0x7f8d680689c0 2023-08-17T00:16:20.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.336+0000 7f8d6c907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68156550 con 0x7f8d68151530 2023-08-17T00:16:20.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d680689c0 0x7f8d68068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8d680689c0 0x7f8d68068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54420/0 (socket says 172.21.15.153:54420) 2023-08-17T00:16:20.345 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 -- 172.21.15.153:0/1378241338 learned_addr learned my addr 172.21.15.153:0/1378241338 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d5effd700 1 --1- 172.21.15.153:0/1378241338 >> v1:172.21.15.153:6789/0 conn(0x7f8d681560f0 0x7f8d680c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47740/0 (socket says 172.21.15.153:47740) 2023-08-17T00:16:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d67fff700 1 --2- 172.21.15.153:0/1378241338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d681519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 -- 172.21.15.153:0/1378241338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 msgr2=0x7f8d681519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:20.346 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 --2- 172.21.15.153:0/1378241338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d681519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 -- 172.21.15.153:0/1378241338 >> v1:172.21.15.153:6789/0 conn(0x7f8d681560f0 legacy=0x7f8d680c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 -- 172.21.15.153:0/1378241338 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d68065ff0 con 0x7f8d680689c0 2023-08-17T00:16:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d677fe700 1 --2- 172.21.15.153:0/1378241338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d68068da0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f8d58009810 tx=0x7f8d58009060).ready entity=mon.0 client_cookie=5fa6f8b8978bf931 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d66ffd700 1 -- 172.21.15.153:0/1378241338 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58005880 con 0x7f8d680689c0 2023-08-17T00:16:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d66ffd700 1 -- 172.21.15.153:0/1378241338 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d580059e0 con 0x7f8d680689c0 2023-08-17T00:16:20.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d66ffd700 1 -- 172.21.15.153:0/1378241338 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58005d60 con 0x7f8d680689c0 2023-08-17T00:16:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 -- 172.21.15.153:0/1378241338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 msgr2=0x7f8d68068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1378241338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d68068da0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 rx=0x7f8d58009810 tx=0x7f8d58009060).stop 2023-08-17T00:16:20.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 -- 172.21.15.153:0/1378241338 shutdown_connections 2023-08-17T00:16:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1378241338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d681519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1378241338 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d68068da0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 -- 172.21.15.153:0/1378241338 >> 172.21.15.153:0/1378241338 conn(0x7f8d680c6620 msgr2=0x7f8d680c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 -- 172.21.15.153:0/1378241338 shutdown_connections 2023-08-17T00:16:20.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.340+0000 7f8d6c907700 1 -- 172.21.15.153:0/1378241338 wait complete. 2023-08-17T00:16:20.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 Processor -- start 2023-08-17T00:16:20.350 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 -- start start 2023-08-17T00:16:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d681642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d68153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d681560f0 0x7f8d680a8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680a5330 con 0x7f8d680689c0 2023-08-17T00:16:20.352 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d680a8510 con 0x7f8d681560f0 2023-08-17T00:16:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d6c907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68153fb0 con 0x7f8d68151530 2023-08-17T00:16:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d681642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d681642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54434/0 (socket says 172.21.15.153:54434) 2023-08-17T00:16:20.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 -- 172.21.15.153:0/1467867753 learned_addr learned my addr 172.21.15.153:0/1467867753 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:20.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d5effd700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d68153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d67fff700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d681560f0 0x7f8d680a8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 -- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 msgr2=0x7f8d68153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d68153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 -- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d681560f0 msgr2=0x7f8d680a8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d681560f0 0x7f8d680a8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d677fe700 1 -- 172.21.15.153:0/1467867753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58009300 con 0x7f8d680689c0 2023-08-17T00:16:20.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.344+0000 7f8d67fff700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d681560f0 0x7f8d680a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d677fe700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d681642b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f8d58009fd0 tx=0x7f8d58016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58005880 con 0x7f8d680689c0 2023-08-17T00:16:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5800b850 con 0x7f8d680689c0 2023-08-17T00:16:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5800bbf0 con 0x7f8d680689c0 2023-08-17T00:16:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68154290 con 0x7f8d680689c0 2023-08-17T00:16:20.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d68154850 con 0x7f8d680689c0 2023-08-17T00:16:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6806b4c0 con 0x7f8d680689c0 2023-08-17T00:16:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.348+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8d5800f070 con 0x7f8d680689c0 2023-08-17T00:16:20.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.352+0000 7f8d5ffff700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d4805a150 0x7f8d4805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.352+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8d580752c0 con 0x7f8d680689c0 2023-08-17T00:16:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.352+0000 7f8d5effd700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d4805a150 0x7f8d4805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.352+0000 7f8d5effd700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d4805a150 0x7f8d4805c610 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f8d680632b0 tx=0x7f8d50007bf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:20.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.356+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8d58048c60 con 0x7f8d680689c0 2023-08-17T00:16:20.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.556+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d680662d0 con 0x7f8d680689c0 2023-08-17T00:16:20.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.556+0000 7f8d5ffff700 1 -- 172.21.15.153:0/1467867753 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f8d5804c280 con 0x7f8d680689c0 2023-08-17T00:16:20.563 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:20.563 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:16:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d4805a150 msgr2=0x7f8d4805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d4805a150 0x7f8d4805c610 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 rx=0x7f8d680632b0 tx=0x7f8d50007bf0).stop 2023-08-17T00:16:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 msgr2=0x7f8d681642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d681642b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 rx=0x7f8d58009fd0 tx=0x7f8d58016000).stop 2023-08-17T00:16:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 shutdown_connections 2023-08-17T00:16:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8d4805a150 0x7f8d4805c610 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d681560f0 0x7f8d680a8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d68151530 0x7f8d68153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 --2- 172.21.15.153:0/1467867753 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8d680689c0 0x7f8d681642b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 >> 172.21.15.153:0/1467867753 conn(0x7f8d680c6620 msgr2=0x7f8d680bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 shutdown_connections 2023-08-17T00:16:20.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.560+0000 7f8d6c907700 1 -- 172.21.15.153:0/1467867753 wait complete. 2023-08-17T00:16:20.572 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:16:20.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 Processor -- start 2023-08-17T00:16:20.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 -- start start 2023-08-17T00:16:20.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbdac153d50 0x7fbdac0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fbdac0656d0 0x7fbdac065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac065240 con 0x7fbdac154130 2023-08-17T00:16:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac063880 con 0x7fbdac0656d0 2023-08-17T00:16:20.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb4569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac064910 con 0x7fbdac153d50 2023-08-17T00:16:20.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb1b04700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fbdac154130 0x7fbdac0629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47744/0 (socket says 172.21.15.153:47744) 2023-08-17T00:16:20.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb1b04700 1 -- 172.21.15.153:0/219411688 learned_addr learned my addr 172.21.15.153:0/219411688 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:20.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb2b06700 1 --2- 172.21.15.153:0/219411688 >> v2:172.21.15.153:3300/0 conn(0x7fbdac0656d0 0x7fbdac065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.736+0000 7fbdb2305700 1 --2- 172.21.15.153:0/219411688 >> v2:172.21.15.178:3300/0 conn(0x7fbdac153d50 0x7fbdac0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb1303700 1 -- 172.21.15.153:0/219411688 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197717167 0 0) 0x7fbdac065240 con 0x7fbdac154130 2023-08-17T00:16:20.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb1303700 1 -- 172.21.15.153:0/219411688 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd980033f0 con 0x7fbdac154130 2023-08-17T00:16:20.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb2b06700 1 -- 172.21.15.153:0/219411688 >> v2:172.21.15.178:3300/0 conn(0x7fbdac153d50 msgr2=0x7fbdac0632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:20.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb2b06700 1 --2- 172.21.15.153:0/219411688 >> v2:172.21.15.178:3300/0 conn(0x7fbdac153d50 0x7fbdac0632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb2b06700 1 -- 172.21.15.153:0/219411688 >> v1:172.21.15.153:6789/0 conn(0x7fbdac154130 legacy=0x7fbdac0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb2b06700 1 -- 172.21.15.153:0/219411688 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac064bf0 con 0x7fbdac0656d0 2023-08-17T00:16:20.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb2b06700 1 --2- 172.21.15.153:0/219411688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac065ae0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fbdac064280 tx=0x7fbda4009780).ready entity=mon.0 client_cookie=556a4bd195877d45 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:20.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb1303700 1 -- 172.21.15.153:0/219411688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400e070 con 0x7fbdac0656d0 2023-08-17T00:16:20.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb1303700 1 -- 172.21.15.153:0/219411688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda400bab0 con 0x7fbdac0656d0 2023-08-17T00:16:20.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb1303700 1 -- 172.21.15.153:0/219411688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda400be30 con 0x7fbdac0656d0 2023-08-17T00:16:20.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 -- 172.21.15.153:0/219411688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 msgr2=0x7fbdac065ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 --2- 172.21.15.153:0/219411688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac065ae0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 rx=0x7fbdac064280 tx=0x7fbda4009780).stop 2023-08-17T00:16:20.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 -- 172.21.15.153:0/219411688 shutdown_connections 2023-08-17T00:16:20.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 --2- 172.21.15.153:0/219411688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac065ae0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 --2- 172.21.15.153:0/219411688 >> v2:172.21.15.178:3300/0 conn(0x7fbdac153d50 0x7fbdac0632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 -- 172.21.15.153:0/219411688 >> 172.21.15.153:0/219411688 conn(0x7fbdac0c7150 msgr2=0x7fbdac0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:20.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 -- 172.21.15.153:0/219411688 shutdown_connections 2023-08-17T00:16:20.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.740+0000 7fbdb4569700 1 -- 172.21.15.153:0/219411688 wait complete. 2023-08-17T00:16:20.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 Processor -- start 2023-08-17T00:16:20.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 -- start start 2023-08-17T00:16:20.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac153d50 0x7fbdac0ab120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdac154130 0x7fbdac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac164240 con 0x7fbdac0656d0 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac158010 con 0x7fbdac153d50 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb4569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac1582f0 con 0x7fbdac154130 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54446/0 (socket says 172.21.15.153:54446) 2023-08-17T00:16:20.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 -- 172.21.15.153:0/964200379 learned_addr learned my addr 172.21.15.153:0/964200379 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb1b04700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac153d50 0x7fbdac0ab120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 -- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdac154130 msgr2=0x7fbdac068850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2b06700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdac154130 0x7fbdac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdac154130 0x7fbdac068850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 -- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac153d50 msgr2=0x7fbdac0ab120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac153d50 0x7fbdac0ab120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 -- 172.21.15.153:0/964200379 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda4009a20 con 0x7fbdac0656d0 2023-08-17T00:16:20.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb1b04700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac153d50 0x7fbdac0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:20.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbdb2305700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac151ae0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fbda800e930 tx=0x7fbda8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:20.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800eed0 con 0x7fbdac0656d0 2023-08-17T00:16:20.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.744+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda800c850 con 0x7fbdac0656d0 2023-08-17T00:16:20.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.748+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac1585d0 con 0x7fbdac0656d0 2023-08-17T00:16:20.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.748+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda800cbd0 con 0x7fbdac0656d0 2023-08-17T00:16:20.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.748+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac157c30 con 0x7fbdac0656d0 2023-08-17T00:16:20.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.748+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac06b530 con 0x7fbdac0656d0 2023-08-17T00:16:20.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.748+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fbda8022070 con 0x7fbdac0656d0 2023-08-17T00:16:20.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.748+0000 7fbda27fc700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd9005a150 0x7fbd9005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:20.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.752+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fbda8074510 con 0x7fbdac0656d0 2023-08-17T00:16:20.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.752+0000 7fbdb1b04700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd9005a150 0x7fbd9005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:20.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.752+0000 7fbdb1b04700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd9005a150 0x7fbd9005c610 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fbd9c005750 tx=0x7fbd9c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:20.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.756+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fbda8047fc0 con 0x7fbdac0656d0 2023-08-17T00:16:20.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.912+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdac064ed0 con 0x7fbdac0656d0 2023-08-17T00:16:20.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.916+0000 7fbda27fc700 1 -- 172.21.15.153:0/964200379 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+16990 (secure 0 0 0) 0x7fbda804b5e0 con 0x7fbdac0656d0 2023-08-17T00:16:20.923 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:20.923 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":166,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:40.236606+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:15:37.144808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T00:15:38.254935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:20.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd9005a150 msgr2=0x7fbd9005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd9005a150 0x7fbd9005c610 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fbd9c005750 tx=0x7fbd9c009040).stop 2023-08-17T00:16:20.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 msgr2=0x7fbdac151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:20.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac151ae0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 rx=0x7fbda800e930 tx=0x7fbda8009060).stop 2023-08-17T00:16:20.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 shutdown_connections 2023-08-17T00:16:20.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fbd9005a150 0x7fbd9005c610 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdac154130 0x7fbdac068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdac153d50 0x7fbdac0ab120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 --2- 172.21.15.153:0/964200379 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fbdac0656d0 0x7fbdac151ae0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:20.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 >> 172.21.15.153:0/964200379 conn(0x7fbdac0c7150 msgr2=0x7fbdac0c5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:20.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 shutdown_connections 2023-08-17T00:16:20.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:20.920+0000 7fbdb4569700 1 -- 172.21.15.153:0/964200379 wait complete. 2023-08-17T00:16:20.946 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:15:37.144808+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '165', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:15:38.254935+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '166', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:16:20.947 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:16:21.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.108+0000 7f393d307700 1 Processor -- start 2023-08-17T00:16:21.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.108+0000 7f393d307700 1 -- start start 2023-08-17T00:16:21.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f393d307700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39380aa8c0 0x7f3938068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f393d307700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3938068d10 0x7f3938064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f393d307700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380ab9b0 con 0x7f3938150880 2023-08-17T00:16:21.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f393d307700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39380a9080 con 0x7f39380aa8c0 2023-08-17T00:16:21.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f393d307700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3938069160 con 0x7f3938068d10 2023-08-17T00:16:21.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f39377fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f39380aa8c0 0x7f3938068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f3937fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3938150880 0x7f39380a8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47758/0 (socket says 172.21.15.153:47758) 2023-08-17T00:16:21.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f3937fff700 1 -- 172.21.15.153:0/3348435568 learned_addr learned my addr 172.21.15.153:0/3348435568 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:21.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f393cb06700 1 --2- 172.21.15.153:0/3348435568 >> v2:172.21.15.178:3300/0 conn(0x7f3938068d10 0x7f3938064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f39377fe700 1 -- 172.21.15.153:0/3348435568 >> v2:172.21.15.178:3300/0 conn(0x7f3938068d10 msgr2=0x7f3938064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:21.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f3936ffd700 1 -- 172.21.15.153:0/3348435568 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115719062 0 0) 0x7f39380ab9b0 con 0x7f3938150880 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f39377fe700 1 --2- 172.21.15.153:0/3348435568 >> v2:172.21.15.178:3300/0 conn(0x7f3938068d10 0x7f3938064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f39377fe700 1 -- 172.21.15.153:0/3348435568 >> v1:172.21.15.153:6789/0 conn(0x7f3938150880 legacy=0x7f39380a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.112+0000 7f39377fe700 1 -- 172.21.15.153:0/3348435568 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380aada0 con 0x7f39380aa8c0 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f39377fe700 1 --2- 172.21.15.153:0/3348435568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39380aa8c0 0x7f3938068820 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f39380bd530 tx=0x7f392c009060).ready entity=mon.0 client_cookie=67ce562417bb0521 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f3936ffd700 1 -- 172.21.15.153:0/3348435568 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0090d0 con 0x7f39380aa8c0 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f3936ffd700 1 -- 172.21.15.153:0/3348435568 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c00f510 con 0x7f39380aa8c0 2023-08-17T00:16:21.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f3936ffd700 1 -- 172.21.15.153:0/3348435568 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00f890 con 0x7f39380aa8c0 2023-08-17T00:16:21.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 -- 172.21.15.153:0/3348435568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39380aa8c0 msgr2=0x7f3938068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 --2- 172.21.15.153:0/3348435568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39380aa8c0 0x7f3938068820 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 rx=0x7f39380bd530 tx=0x7f392c009060).stop 2023-08-17T00:16:21.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 -- 172.21.15.153:0/3348435568 shutdown_connections 2023-08-17T00:16:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 --2- 172.21.15.153:0/3348435568 >> v2:172.21.15.178:3300/0 conn(0x7f3938068d10 0x7f3938064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 --2- 172.21.15.153:0/3348435568 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f39380aa8c0 0x7f3938068820 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 -- 172.21.15.153:0/3348435568 >> 172.21.15.153:0/3348435568 conn(0x7f39380c6620 msgr2=0x7f39380c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 -- 172.21.15.153:0/3348435568 shutdown_connections 2023-08-17T00:16:21.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.116+0000 7f393d307700 1 -- 172.21.15.153:0/3348435568 wait complete. 2023-08-17T00:16:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 Processor -- start 2023-08-17T00:16:21.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 -- start start 2023-08-17T00:16:21.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938068d10 0x7f3938152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39380aa8c0 0x7f3938163de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 0x7f39380c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380bd5a0 con 0x7f3938150880 2023-08-17T00:16:21.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938157020 con 0x7f3938068d10 2023-08-17T00:16:21.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393d307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39381566f0 con 0x7f39380aa8c0 2023-08-17T00:16:21.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 0x7f39380c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 0x7f39380c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54452/0 (socket says 172.21.15.153:54452) 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 -- 172.21.15.153:0/1876619951 learned_addr learned my addr 172.21.15.153:0/1876619951 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f3937fff700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938068d10 0x7f3938152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f39377fe700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39380aa8c0 0x7f3938163de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 -- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39380aa8c0 msgr2=0x7f3938163de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39380aa8c0 0x7f3938163de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 -- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938068d10 msgr2=0x7f3938152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938068d10 0x7f3938152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.120+0000 7f393cb06700 1 -- 172.21.15.153:0/1876619951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0092a0 con 0x7f3938150880 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f393cb06700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 0x7f39380c5410 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f3930009df0 tx=0x7f393000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cb50 con 0x7f3938150880 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393000f040 con 0x7f3938150880 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cec0 con 0x7f3938150880 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39381569d0 con 0x7f3938150880 2023-08-17T00:16:21.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39381532a0 con 0x7f3938150880 2023-08-17T00:16:21.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938153490 con 0x7f3938150880 2023-08-17T00:16:21.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.124+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3930013610 con 0x7f3938150880 2023-08-17T00:16:21.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.128+0000 7f391ffff700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f392405a150 0x7f392405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.128+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3930074b90 con 0x7f3938150880 2023-08-17T00:16:21.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.128+0000 7f3937fff700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f392405a150 0x7f392405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.128+0000 7f3937fff700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f392405a150 0x7f392405c610 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f3928001360 tx=0x7f3928009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.132+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3930048530 con 0x7f3938150880 2023-08-17T00:16:21.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.292+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f39380bd6e0 con 0x7f3938150880 2023-08-17T00:16:21.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.292+0000 7f391ffff700 1 -- 172.21.15.153:0/1876619951 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v166) v1 ==== 110+0+10 (secure 0 0 0) 0x7f393004bb50 con 0x7f3938150880 2023-08-17T00:16:21.300 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:16:21.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f392405a150 msgr2=0x7f392405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f392405a150 0x7f392405c610 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7f3928001360 tx=0x7f3928009040).stop 2023-08-17T00:16:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 msgr2=0x7f39380c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 0x7f39380c5410 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 rx=0x7f3930009df0 tx=0x7f393000b040).stop 2023-08-17T00:16:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 shutdown_connections 2023-08-17T00:16:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f392405a150 0x7f392405c610 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3938150880 0x7f39380c5410 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39380aa8c0 0x7f3938163de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 --2- 172.21.15.153:0/1876619951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3938068d10 0x7f3938152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 >> 172.21.15.153:0/1876619951 conn(0x7f39380c6620 msgr2=0x7f393814fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:21.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 shutdown_connections 2023-08-17T00:16:21.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.296+0000 7f393d307700 1 -- 172.21.15.153:0/1876619951 wait complete. 2023-08-17T00:16:21.323 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:16:21.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.480+0000 7f9e2759e700 1 Processor -- start 2023-08-17T00:16:21.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.480+0000 7f9e2759e700 1 -- start start 2023-08-17T00:16:21.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9e280abf10 0x7f9e28068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9e280ac2f0 0x7f9e28068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e281545e0 con 0x7f9e280c0a80 2023-08-17T00:16:21.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e28069200 con 0x7f9e280abf10 2023-08-17T00:16:21.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e280c1c50 con 0x7f9e280ac2f0 2023-08-17T00:16:21.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e26d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9e280c0a80 0x7f9e280c0ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47762/0 (socket says 172.21.15.153:47762) 2023-08-17T00:16:21.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e26d9d700 1 -- 172.21.15.153:0/1250651420 learned_addr learned my addr 172.21.15.153:0/1250651420 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:21.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2659c700 1 --2- 172.21.15.153:0/1250651420 >> v2:172.21.15.153:3300/0 conn(0x7f9e280abf10 0x7f9e28068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e1dd9b700 1 --2- 172.21.15.153:0/1250651420 >> v2:172.21.15.178:3300/0 conn(0x7f9e280ac2f0 0x7f9e28068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e25d9b700 1 -- 172.21.15.153:0/1250651420 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286419901 0 0) 0x7f9e281545e0 con 0x7f9e280c0a80 2023-08-17T00:16:21.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e25d9b700 1 -- 172.21.15.153:0/1250651420 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e140033f0 con 0x7f9e280c0a80 2023-08-17T00:16:21.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2659c700 1 -- 172.21.15.153:0/1250651420 >> v2:172.21.15.178:3300/0 conn(0x7f9e280ac2f0 msgr2=0x7f9e28068d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:21.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2659c700 1 --2- 172.21.15.153:0/1250651420 >> v2:172.21.15.178:3300/0 conn(0x7f9e280ac2f0 0x7f9e28068d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2659c700 1 -- 172.21.15.153:0/1250651420 >> v1:172.21.15.153:6789/0 conn(0x7f9e280c0a80 legacy=0x7f9e280c0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.484+0000 7f9e2659c700 1 -- 172.21.15.153:0/1250651420 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e280a96d0 con 0x7f9e280abf10 2023-08-17T00:16:21.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2659c700 1 --2- 172.21.15.153:0/1250651420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28068820 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f9e280693d0 tx=0x7f9e18006f40).ready entity=mon.0 client_cookie=9462a3dede60df36 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e25d9b700 1 -- 172.21.15.153:0/1250651420 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18005880 con 0x7f9e280abf10 2023-08-17T00:16:21.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e25d9b700 1 -- 172.21.15.153:0/1250651420 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e180059e0 con 0x7f9e280abf10 2023-08-17T00:16:21.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e25d9b700 1 -- 172.21.15.153:0/1250651420 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18005d60 con 0x7f9e280abf10 2023-08-17T00:16:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 -- 172.21.15.153:0/1250651420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 msgr2=0x7f9e28068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1250651420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28068820 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 rx=0x7f9e280693d0 tx=0x7f9e18006f40).stop 2023-08-17T00:16:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 -- 172.21.15.153:0/1250651420 shutdown_connections 2023-08-17T00:16:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1250651420 >> v2:172.21.15.178:3300/0 conn(0x7f9e280ac2f0 0x7f9e28068d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1250651420 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28068820 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 -- 172.21.15.153:0/1250651420 >> 172.21.15.153:0/1250651420 conn(0x7f9e280c6620 msgr2=0x7f9e280c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:21.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 -- 172.21.15.153:0/1250651420 shutdown_connections 2023-08-17T00:16:21.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.488+0000 7f9e2759e700 1 -- 172.21.15.153:0/1250651420 wait complete. 2023-08-17T00:16:21.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 Processor -- start 2023-08-17T00:16:21.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 -- start start 2023-08-17T00:16:21.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28141a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280ac2f0 0x7f9e280bce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c0a80 0x7f9e280c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2814e4f0 con 0x7f9e280abf10 2023-08-17T00:16:21.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28150660 con 0x7f9e280ac2f0 2023-08-17T00:16:21.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e28141f60 con 0x7f9e280c0a80 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28141a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28141a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54482/0 (socket says 172.21.15.153:54482) 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 -- 172.21.15.153:0/1399225575 learned_addr learned my addr 172.21.15.153:0/1399225575 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e1dd9b700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280ac2f0 0x7f9e280bce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e26d9d700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c0a80 0x7f9e280c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 -- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c0a80 msgr2=0x7f9e280c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c0a80 0x7f9e280c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 -- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280ac2f0 msgr2=0x7f9e280bce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280ac2f0 0x7f9e280bce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 -- 172.21.15.153:0/1399225575 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18009250 con 0x7f9e280abf10 2023-08-17T00:16:21.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e26d9d700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c0a80 0x7f9e280c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:21.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e2659c700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28141a70 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f9e18006fd0 tx=0x7f9e18015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.492+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e18005880 con 0x7f9e280abf10 2023-08-17T00:16:21.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.496+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1800d6b0 con 0x7f9e280abf10 2023-08-17T00:16:21.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.496+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800da50 con 0x7f9e280abf10 2023-08-17T00:16:21.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.496+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e280bd2f0 con 0x7f9e280abf10 2023-08-17T00:16:21.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.496+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e28150010 con 0x7f9e280abf10 2023-08-17T00:16:21.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.496+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2806b4c0 con 0x7f9e280abf10 2023-08-17T00:16:21.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.496+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9e1800f070 con 0x7f9e280abf10 2023-08-17T00:16:21.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.500+0000 7f9e1effd700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0805a150 0x7f9e0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.500+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f9e18075c20 con 0x7f9e280abf10 2023-08-17T00:16:21.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.500+0000 7f9e1dd9b700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0805a150 0x7f9e0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.500+0000 7f9e1dd9b700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0805a150 0x7f9e0805c610 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f9e281597f0 tx=0x7f9e10008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.504+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9e180495c0 con 0x7f9e280abf10 2023-08-17T00:16:21.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.668+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9e28062c90 con 0x7f9e280abf10 2023-08-17T00:16:21.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.668+0000 7f9e1effd700 1 -- 172.21.15.153:0/1399225575 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v166) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9e1804cbe0 con 0x7f9e280abf10 2023-08-17T00:16:21.676 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:16:21.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0805a150 msgr2=0x7f9e0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0805a150 0x7f9e0805c610 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f9e281597f0 tx=0x7f9e10008040).stop 2023-08-17T00:16:21.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 msgr2=0x7f9e28141a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28141a70 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 rx=0x7f9e18006fd0 tx=0x7f9e18015000).stop 2023-08-17T00:16:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 shutdown_connections 2023-08-17T00:16:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9e0805a150 0x7f9e0805c610 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e280c0a80 0x7f9e280c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e280ac2f0 0x7f9e280bce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 --2- 172.21.15.153:0/1399225575 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9e280abf10 0x7f9e28141a70 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 >> 172.21.15.153:0/1399225575 conn(0x7f9e280c6620 msgr2=0x7f9e280c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:21.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 shutdown_connections 2023-08-17T00:16:21.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.672+0000 7f9e2759e700 1 -- 172.21.15.153:0/1399225575 wait complete. 2023-08-17T00:16:21.699 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:16:21.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.864+0000 7f0015279700 1 Processor -- start 2023-08-17T00:16:21.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.864+0000 7f0015279700 1 -- start start 2023-08-17T00:16:21.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f0015279700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00100c57a0 0x7f00100c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f0015279700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00100bfd10 con 0x7f00100c11b0 2023-08-17T00:16:21.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f0015279700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0010158420 con 0x7f0010153f50 2023-08-17T00:16:21.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f0015279700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0010154af0 con 0x7f00100c57a0 2023-08-17T00:16:21.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f0014a78700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f00100c11b0 0x7f0010157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47768/0 (socket says 172.21.15.153:47768) 2023-08-17T00:16:21.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f0014a78700 1 -- 172.21.15.153:0/1801936416 learned_addr learned my addr 172.21.15.153:0/1801936416 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:21.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f000ffff700 1 --2- 172.21.15.153:0/1801936416 >> v2:172.21.15.178:3300/0 conn(0x7f00100c57a0 0x7f00100c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f000effd700 1 -- 172.21.15.153:0/1801936416 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357663214 0 0) 0x7f00100bfd10 con 0x7f00100c11b0 2023-08-17T00:16:21.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f000effd700 1 -- 172.21.15.153:0/1801936416 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff80033f0 con 0x7f00100c11b0 2023-08-17T00:16:21.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f000ffff700 1 -- 172.21.15.153:0/1801936416 >> v1:172.21.15.178:6789/0 conn(0x7f0010153f50 legacy=0x7f0010157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f000ffff700 1 -- 172.21.15.153:0/1801936416 >> v1:172.21.15.153:6789/0 conn(0x7f00100c11b0 legacy=0x7f0010157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.868+0000 7f000ffff700 1 -- 172.21.15.153:0/1801936416 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010154dd0 con 0x7f00100c57a0 2023-08-17T00:16:21.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f000ffff700 1 --2- 172.21.15.153:0/1801936416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c57a0 0x7f00100c5b80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f0000009760 tx=0x7f0000009060).ready entity=mon.1 client_cookie=69c89bf9bbcf775f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f000effd700 1 -- 172.21.15.153:0/1801936416 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000f510 con 0x7f00100c57a0 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f000effd700 1 -- 172.21.15.153:0/1801936416 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000000f670 con 0x7f00100c57a0 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f000effd700 1 -- 172.21.15.153:0/1801936416 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000000f9f0 con 0x7f00100c57a0 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 -- 172.21.15.153:0/1801936416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c57a0 msgr2=0x7f00100c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 --2- 172.21.15.153:0/1801936416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c57a0 0x7f00100c5b80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f0000009760 tx=0x7f0000009060).stop 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 -- 172.21.15.153:0/1801936416 shutdown_connections 2023-08-17T00:16:21.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 --2- 172.21.15.153:0/1801936416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c57a0 0x7f00100c5b80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 -- 172.21.15.153:0/1801936416 >> 172.21.15.153:0/1801936416 conn(0x7f0010062a70 msgr2=0x7f00100ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:21.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 -- 172.21.15.153:0/1801936416 shutdown_connections 2023-08-17T00:16:21.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 -- 172.21.15.153:0/1801936416 wait complete. 2023-08-17T00:16:21.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 Processor -- start 2023-08-17T00:16:21.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.872+0000 7f0015279700 1 -- start start 2023-08-17T00:16:21.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c11b0 0x7f00100b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100c57a0 0x7f0010164cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 0x7f0010150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100afe70 con 0x7f0010153f50 2023-08-17T00:16:21.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00100af260 con 0x7f00100c11b0 2023-08-17T00:16:21.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100af540 con 0x7f00100c57a0 2023-08-17T00:16:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 0x7f0010150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 0x7f0010150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54490/0 (socket says 172.21.15.153:54490) 2023-08-17T00:16:21.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 -- 172.21.15.153:0/2746998487 learned_addr learned my addr 172.21.15.153:0/2746998487 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f000ffff700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c11b0 0x7f00100b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f000f7fe700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100c57a0 0x7f0010164cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 -- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100c57a0 msgr2=0x7f0010164cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100c57a0 0x7f0010164cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 -- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c11b0 msgr2=0x7f00100b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:21.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c11b0 0x7f00100b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:21.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 -- 172.21.15.153:0/2746998487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00000092a0 con 0x7f0010153f50 2023-08-17T00:16:21.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f000f7fe700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100c57a0 0x7f0010164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:21.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f000ffff700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c11b0 0x7f00100b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:21.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0014a78700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 0x7f0010150c00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f0008005ad0 tx=0x7f00080015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008005d30 con 0x7f0010153f50 2023-08-17T00:16:21.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0008005e90 con 0x7f0010153f50 2023-08-17T00:16:21.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00100af820 con 0x7f0010153f50 2023-08-17T00:16:21.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0008007320 con 0x7f0010153f50 2023-08-17T00:16:21.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.876+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00101651a0 con 0x7f0010153f50 2023-08-17T00:16:21.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.880+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001006b4c0 con 0x7f0010153f50 2023-08-17T00:16:21.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.880+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0008010030 con 0x7f0010153f50 2023-08-17T00:16:21.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.884+0000 7efff7fff700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efffc05a150 0x7efffc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:21.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.884+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f0008073ff0 con 0x7f0010153f50 2023-08-17T00:16:21.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.884+0000 7f000ffff700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efffc05a150 0x7efffc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:21.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.884+0000 7f000ffff700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efffc05a150 0x7efffc05c610 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f0000009760 tx=0x7f0000017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:21.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:21.888+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0008047aa0 con 0x7f0010153f50 2023-08-17T00:16:22.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.048+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00100bf9a0 con 0x7f0010153f50 2023-08-17T00:16:22.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7efff7fff700 1 -- 172.21.15.153:0/2746998487 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v166) v1 ==== 104+0+11 (secure 0 0 0) 0x7f000804b0c0 con 0x7f0010153f50 2023-08-17T00:16:22.057 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:16:22.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efffc05a150 msgr2=0x7efffc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efffc05a150 0x7efffc05c610 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7f0000009760 tx=0x7f0000017000).stop 2023-08-17T00:16:22.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 msgr2=0x7f0010150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 0x7f0010150c00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 rx=0x7f0008005ad0 tx=0x7f00080015b0).stop 2023-08-17T00:16:22.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 shutdown_connections 2023-08-17T00:16:22.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efffc05a150 0x7efffc05c610 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0010153f50 0x7f0010150c00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100c57a0 0x7f0010164cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 --2- 172.21.15.153:0/2746998487 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100c11b0 0x7f00100b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.052+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 >> 172.21.15.153:0/2746998487 conn(0x7f0010062a70 msgr2=0x7f00100aa930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.056+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 shutdown_connections 2023-08-17T00:16:22.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.056+0000 7f0015279700 1 -- 172.21.15.153:0/2746998487 wait complete. 2023-08-17T00:16:22.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:16:22.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.240+0000 7fe8e5cb9700 1 Processor -- start 2023-08-17T00:16:22.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.240+0000 7fe8e5cb9700 1 -- start start 2023-08-17T00:16:22.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e5cb9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8e00c57a0 0x7fe8e00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e5cb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e00bfd10 con 0x7fe8e0153f50 2023-08-17T00:16:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e5cb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e0158420 con 0x7fe8e00c11b0 2023-08-17T00:16:22.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e5cb9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e0154af0 con 0x7fe8e00c57a0 2023-08-17T00:16:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e4cb7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8e00c57a0 0x7fe8e00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe8e0153f50 0x7fe8e0157600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47770/0 (socket says 172.21.15.153:47770) 2023-08-17T00:16:22.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8dffff700 1 -- 172.21.15.153:0/1022909269 learned_addr learned my addr 172.21.15.153:0/1022909269 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853060317 0 0) 0x7fe8e00bfd10 con 0x7fe8e0153f50 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d00033f0 con 0x7fe8e0153f50 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672219895 0 0) 0x7fe8e0158420 con 0x7fe8e00c11b0 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e00bfd10 con 0x7fe8e00c11b0 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/1022909269 >> v1:172.21.15.178:6789/0 conn(0x7fe8e00c11b0 legacy=0x7fe8e0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/1022909269 >> v1:172.21.15.153:6789/0 conn(0x7fe8e0153f50 legacy=0x7fe8e0157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/1022909269 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e0154dd0 con 0x7fe8e00c57a0 2023-08-17T00:16:22.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.244+0000 7fe8e4cb7700 1 --2- 172.21.15.153:0/1022909269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c57a0 0x7fe8e00c5b80 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7fe8d4009760 tx=0x7fe8d4009060).ready entity=mon.0 client_cookie=e580144261675e9f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400d4a0 con 0x7fe8e00c57a0 2023-08-17T00:16:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400d600 con 0x7fe8e00c57a0 2023-08-17T00:16:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8df7fe700 1 -- 172.21.15.153:0/1022909269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400d980 con 0x7fe8e00c57a0 2023-08-17T00:16:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/1022909269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c57a0 msgr2=0x7fe8e00c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/1022909269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c57a0 0x7fe8e00c5b80 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 rx=0x7fe8d4009760 tx=0x7fe8d4009060).stop 2023-08-17T00:16:22.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/1022909269 shutdown_connections 2023-08-17T00:16:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/1022909269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c57a0 0x7fe8e00c5b80 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/1022909269 >> 172.21.15.153:0/1022909269 conn(0x7fe8e0062a70 msgr2=0x7fe8e00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/1022909269 shutdown_connections 2023-08-17T00:16:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/1022909269 wait complete. 2023-08-17T00:16:22.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 Processor -- start 2023-08-17T00:16:22.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.248+0000 7fe8e5cb9700 1 -- start start 2023-08-17T00:16:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 0x7fe8e00ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e00c57a0 0x7fe8e0164930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e0153f50 0x7fe8e00ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e00adba0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0165220 con 0x7fe8e00c57a0 2023-08-17T00:16:22.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e0165500 con 0x7fe8e0153f50 2023-08-17T00:16:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 0x7fe8e00ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 0x7fe8e00ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54516/0 (socket says 172.21.15.153:54516) 2023-08-17T00:16:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/478840949 learned_addr learned my addr 172.21.15.153:0/478840949 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8dffff700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e00c57a0 0x7fe8e0164930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e54b8700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e0153f50 0x7fe8e00ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e0153f50 msgr2=0x7fe8e00ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e0153f50 0x7fe8e00ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e00c57a0 msgr2=0x7fe8e0164930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e00c57a0 0x7fe8e0164930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 -- 172.21.15.153:0/478840949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40092a0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e54b8700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e0153f50 0x7fe8e00ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e4cb7700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 0x7fe8e00ac170 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fe8e0083860 tx=0x7fe8d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400dcf0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400de50 con 0x7fe8e00c11b0 2023-08-17T00:16:22.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e01657e0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d401d430 con 0x7fe8e00c11b0 2023-08-17T00:16:22.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.252+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e0164e20 con 0x7fe8e00c11b0 2023-08-17T00:16:22.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.256+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e006b4c0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.256+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe8d400f070 con 0x7fe8e00c11b0 2023-08-17T00:16:22.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.256+0000 7fe8dcff9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8c405a150 0x7fe8c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.256+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fe8d4075880 con 0x7fe8e00c11b0 2023-08-17T00:16:22.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.256+0000 7fe8dffff700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8c405a150 0x7fe8c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.260+0000 7fe8dffff700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8c405a150 0x7fe8c405c610 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fe8e0063960 tx=0x7fe8cc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:22.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.264+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8d40491c0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.424+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8e00bf9a0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8dcff9700 1 -- 172.21.15.153:0/478840949 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v166) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8d404c7e0 con 0x7fe8e00c11b0 2023-08-17T00:16:22.434 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:16:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8c405a150 msgr2=0x7fe8c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8c405a150 0x7fe8c405c610 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fe8e0063960 tx=0x7fe8cc009040).stop 2023-08-17T00:16:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 msgr2=0x7fe8e00ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.437 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 0x7fe8e00ac170 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 rx=0x7fe8e0083860 tx=0x7fe8d4016000).stop 2023-08-17T00:16:22.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 shutdown_connections 2023-08-17T00:16:22.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8c405a150 0x7fe8c405c610 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e0153f50 0x7fe8e00ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.438 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e00c57a0 0x7fe8e0164930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 --2- 172.21.15.153:0/478840949 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8e00c11b0 0x7fe8e00ac170 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.428+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 >> 172.21.15.153:0/478840949 conn(0x7fe8e0062a70 msgr2=0x7fe8e00c86d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:22.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.432+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 shutdown_connections 2023-08-17T00:16:22.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.432+0000 7fe8e5cb9700 1 -- 172.21.15.153:0/478840949 wait complete. 2023-08-17T00:16:22.457 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:22.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.604+0000 7f4d09569700 1 Processor -- start 2023-08-17T00:16:22.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.604+0000 7f4d09569700 1 -- start start 2023-08-17T00:16:22.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d09569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d04151a10 0x7f4d040bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d09569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04066130 0x7f4d041553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d09569700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d04062c90 con 0x7f4d04151630 2023-08-17T00:16:22.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d09569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d040657d0 con 0x7f4d04151a10 2023-08-17T00:16:22.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d09569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040665e0 con 0x7f4d04066130 2023-08-17T00:16:22.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4cfa7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d04151a10 0x7f4d040bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4cfa7fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d04151a10 0x7f4d040bbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54528/0 (socket says 172.21.15.153:54528) 2023-08-17T00:16:22.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4cfa7fc700 1 -- 172.21.15.153:0/3097345508 learned_addr learned my addr 172.21.15.153:0/3097345508 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:22.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d037fe700 1 --2- 172.21.15.153:0/3097345508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04066130 0x7f4d041553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d037fe700 1 -- 172.21.15.153:0/3097345508 >> v2:172.21.15.153:3300/0 conn(0x7f4d04151a10 msgr2=0x7f4d040bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d037fe700 1 --2- 172.21.15.153:0/3097345508 >> v2:172.21.15.153:3300/0 conn(0x7f4d04151a10 0x7f4d040bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d037fe700 1 -- 172.21.15.153:0/3097345508 >> v1:172.21.15.178:6789/0 conn(0x7f4d04151630 legacy=0x7f4d04063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d027fc700 1 -- 172.21.15.153:0/3097345508 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969688473 0 0) 0x7f4d04062c90 con 0x7f4d04151630 2023-08-17T00:16:22.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d037fe700 1 -- 172.21.15.153:0/3097345508 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04062980 con 0x7f4d04066130 2023-08-17T00:16:22.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d037fe700 1 --2- 172.21.15.153:0/3097345508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04066130 0x7f4d041553f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f4cfc009e60 tx=0x7f4cfc009780).ready entity=mon.2 client_cookie=61c92d6fb668dd47 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:22.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d027fc700 1 -- 172.21.15.153:0/3097345508 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00e070 con 0x7f4d04066130 2023-08-17T00:16:22.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d027fc700 1 -- 172.21.15.153:0/3097345508 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00bb60 con 0x7f4d04066130 2023-08-17T00:16:22.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.608+0000 7f4d027fc700 1 -- 172.21.15.153:0/3097345508 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc012410 con 0x7f4d04066130 2023-08-17T00:16:22.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 -- 172.21.15.153:0/3097345508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04066130 msgr2=0x7f4d041553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 --2- 172.21.15.153:0/3097345508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04066130 0x7f4d041553f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f4cfc009e60 tx=0x7f4cfc009780).stop 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 -- 172.21.15.153:0/3097345508 shutdown_connections 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 --2- 172.21.15.153:0/3097345508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04066130 0x7f4d041553f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 --2- 172.21.15.153:0/3097345508 >> v2:172.21.15.153:3300/0 conn(0x7f4d04151a10 0x7f4d040bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 -- 172.21.15.153:0/3097345508 >> 172.21.15.153:0/3097345508 conn(0x7f4d040c2fb0 msgr2=0x7f4d040c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 -- 172.21.15.153:0/3097345508 shutdown_connections 2023-08-17T00:16:22.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.612+0000 7f4d09569700 1 -- 172.21.15.153:0/3097345508 wait complete. 2023-08-17T00:16:22.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 Processor -- start 2023-08-17T00:16:22.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 -- start start 2023-08-17T00:16:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04066130 0x7f4d04143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04151630 0x7f4d040a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 0x7f4d040a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0414c8b0 con 0x7f4d04151a10 2023-08-17T00:16:22.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041407d0 con 0x7f4d04066130 2023-08-17T00:16:22.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d09569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040a9f40 con 0x7f4d04151630 2023-08-17T00:16:22.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 0x7f4d040a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 0x7f4d040a99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54534/0 (socket says 172.21.15.153:54534) 2023-08-17T00:16:22.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 -- 172.21.15.153:0/927699441 learned_addr learned my addr 172.21.15.153:0/927699441 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:22.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4cfa7fc700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04151630 0x7f4d040a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d02ffd700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04066130 0x7f4d04143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 -- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04151630 msgr2=0x7f4d040a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04151630 0x7f4d040a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 -- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04066130 msgr2=0x7f4d04143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04066130 0x7f4d04143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 -- 172.21.15.153:0/927699441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc009a20 con 0x7f4d04151a10 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d02ffd700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04066130 0x7f4d04143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.616+0000 7f4d037fe700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 0x7f4d040a99b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f4cfc00b6c0 tx=0x7f4cfc009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:22.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc012410 con 0x7f4d04151a10 2023-08-17T00:16:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc01d630 con 0x7f4d04151a10 2023-08-17T00:16:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0070e0 con 0x7f4d04151a10 2023-08-17T00:16:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d040aa220 con 0x7f4d04151a10 2023-08-17T00:16:22.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d040aa7e0 con 0x7f4d04151a10 2023-08-17T00:16:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0406b4c0 con 0x7f4d04151a10 2023-08-17T00:16:22.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.620+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4cfc01dc80 con 0x7f4d04151a10 2023-08-17T00:16:22.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.624+0000 7f4cfb7fe700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ce405a150 0x7f4ce405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:22.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.624+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f4cfc076310 con 0x7f4d04151a10 2023-08-17T00:16:22.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.624+0000 7f4d02ffd700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ce405a150 0x7f4ce405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:22.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.624+0000 7f4d02ffd700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ce405a150 0x7f4ce405c610 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f4cf4007fd0 tx=0x7f4cf4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:22.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.628+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4cfc04d870 con 0x7f4d04151a10 2023-08-17T00:16:22.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.828+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d04065a20 con 0x7f4d04151a10 2023-08-17T00:16:22.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.828+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/927699441 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f4cfc04d460 con 0x7f4d04151a10 2023-08-17T00:16:22.836 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:22.836 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:16:22.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ce405a150 msgr2=0x7f4ce405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ce405a150 0x7f4ce405c610 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f4cf4007fd0 tx=0x7f4cf4009040).stop 2023-08-17T00:16:22.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 msgr2=0x7f4d040a99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:22.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 0x7f4d040a99b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 rx=0x7f4cfc00b6c0 tx=0x7f4cfc009780).stop 2023-08-17T00:16:22.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 shutdown_connections 2023-08-17T00:16:22.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4ce405a150 0x7f4ce405c610 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d04151a10 0x7f4d040a99b0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d04151630 0x7f4d040a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 --2- 172.21.15.153:0/927699441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04066130 0x7f4d04143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:22.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 >> 172.21.15.153:0/927699441 conn(0x7f4d040c2fb0 msgr2=0x7f4d040c4910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:22.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 shutdown_connections 2023-08-17T00:16:22.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:22.832+0000 7f4d09569700 1 -- 172.21.15.153:0/927699441 wait complete. 2023-08-17T00:16:22.840 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:16:22.860 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:23.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.012+0000 7f7b5ca79700 1 Processor -- start 2023-08-17T00:16:23.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.012+0000 7f7b5ca79700 1 -- start start 2023-08-17T00:16:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b5ca79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7b58068da0 0x7f7b581560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b5ca79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b58151530 0x7f7b581519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b5ca79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b58065da0 con 0x7f7b580689c0 2023-08-17T00:16:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b5ca79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58069200 con 0x7f7b58151530 2023-08-17T00:16:23.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b5ca79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b58155c60 con 0x7f7b58068da0 2023-08-17T00:16:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b58151530 0x7f7b581519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7b58151530 0x7f7b581519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54550/0 (socket says 172.21.15.153:54550) 2023-08-17T00:16:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 -- 172.21.15.153:0/1477247032 learned_addr learned my addr 172.21.15.153:0/1477247032 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b4ffff700 1 --2- 172.21.15.153:0/1477247032 >> v2:172.21.15.178:3300/0 conn(0x7f7b58068da0 0x7f7b581560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 -- 172.21.15.153:0/1477247032 >> v2:172.21.15.178:3300/0 conn(0x7f7b58068da0 msgr2=0x7f7b581560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 --2- 172.21.15.153:0/1477247032 >> v2:172.21.15.178:3300/0 conn(0x7f7b58068da0 0x7f7b581560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 -- 172.21.15.153:0/1477247032 >> v1:172.21.15.178:6789/0 conn(0x7f7b580689c0 legacy=0x7f7b580c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 -- 172.21.15.153:0/1477247032 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58065ff0 con 0x7f7b58151530 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b4ffff700 1 --2- 172.21.15.153:0/1477247032 >> v2:172.21.15.178:3300/0 conn(0x7f7b58068da0 0x7f7b581560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b57fff700 1 --2- 172.21.15.153:0/1477247032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b581519c0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f7b580bff90 tx=0x7f7b50009840).ready entity=mon.0 client_cookie=bf49962ef32247fd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.016+0000 7f7b56ffd700 1 -- 172.21.15.153:0/1477247032 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000e070 con 0x7f7b58151530 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b56ffd700 1 -- 172.21.15.153:0/1477247032 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5000ba50 con 0x7f7b58151530 2023-08-17T00:16:23.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b56ffd700 1 -- 172.21.15.153:0/1477247032 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5000bdd0 con 0x7f7b58151530 2023-08-17T00:16:23.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 -- 172.21.15.153:0/1477247032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 msgr2=0x7f7b581519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/1477247032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b581519c0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 rx=0x7f7b580bff90 tx=0x7f7b50009840).stop 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 -- 172.21.15.153:0/1477247032 shutdown_connections 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/1477247032 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b581519c0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/1477247032 >> v2:172.21.15.178:3300/0 conn(0x7f7b58068da0 0x7f7b581560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 -- 172.21.15.153:0/1477247032 >> 172.21.15.153:0/1477247032 conn(0x7f7b580c6620 msgr2=0x7f7b580c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 -- 172.21.15.153:0/1477247032 shutdown_connections 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 -- 172.21.15.153:0/1477247032 wait complete. 2023-08-17T00:16:23.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 Processor -- start 2023-08-17T00:16:23.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.020+0000 7f7b5ca79700 1 -- start start 2023-08-17T00:16:23.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b580689c0 0x7f7b58145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b58068da0 0x7f7b580a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b580c1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a8670 con 0x7f7b58151530 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a8390 con 0x7f7b580689c0 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580a3910 con 0x7f7b58068da0 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b580c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b580c1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54552/0 (socket says 172.21.15.153:54552) 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 -- 172.21.15.153:0/618458661 learned_addr learned my addr 172.21.15.153:0/618458661 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b4ffff700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b58068da0 0x7f7b580a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b577fe700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b580689c0 0x7f7b58145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 -- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b58068da0 msgr2=0x7f7b580a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b58068da0 0x7f7b580a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 -- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b580689c0 msgr2=0x7f7b58145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b580689c0 0x7f7b58145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 -- 172.21.15.153:0/618458661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b50009ae0 con 0x7f7b58151530 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b57fff700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b580c1390 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f7b50009fd0 tx=0x7f7b50009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b500032f0 con 0x7f7b58151530 2023-08-17T00:16:23.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b50007080 con 0x7f7b58151530 2023-08-17T00:16:23.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580a3bf0 con 0x7f7b58151530 2023-08-17T00:16:23.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50007820 con 0x7f7b58151530 2023-08-17T00:16:23.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.024+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580a60b0 con 0x7f7b58151530 2023-08-17T00:16:23.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.028+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5806b4c0 con 0x7f7b58151530 2023-08-17T00:16:23.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.028+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7b50026030 con 0x7f7b58151530 2023-08-17T00:16:23.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.028+0000 7f7b4f7fe700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3805a150 0x7f7b3805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.028+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7b50075d20 con 0x7f7b58151530 2023-08-17T00:16:23.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.028+0000 7f7b577fe700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3805a150 0x7f7b3805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.032+0000 7f7b577fe700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3805a150 0x7f7b3805c610 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f7b48007fd0 tx=0x7f7b48007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.036+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7b50049770 con 0x7f7b58151530 2023-08-17T00:16:23.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.192+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b58064010 con 0x7f7b58151530 2023-08-17T00:16:23.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.196+0000 7f7b4f7fe700 1 -- 172.21.15.153:0/618458661 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f7b50024030 con 0x7f7b58151530 2023-08-17T00:16:23.204 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:23.204 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":166,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:40.236606+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:15:37.144808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T00:15:38.254935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3805a150 msgr2=0x7f7b3805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3805a150 0x7f7b3805c610 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f7b48007fd0 tx=0x7f7b48007d30).stop 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 msgr2=0x7f7b580c1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b580c1390 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 rx=0x7f7b50009fd0 tx=0x7f7b50009840).stop 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 shutdown_connections 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b3805a150 0x7f7b3805c610 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b58151530 0x7f7b580c1390 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b58068da0 0x7f7b580a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 --2- 172.21.15.153:0/618458661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b580689c0 0x7f7b58145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 >> 172.21.15.153:0/618458661 conn(0x7f7b580c6620 msgr2=0x7f7b580bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:23.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 shutdown_connections 2023-08-17T00:16:23.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.200+0000 7f7b5ca79700 1 -- 172.21.15.153:0/618458661 wait complete. 2023-08-17T00:16:23.228 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:16:23.228 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:23.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 Processor -- start 2023-08-17T00:16:23.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 -- start start 2023-08-17T00:16:23.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcba40acb90 0x7fcba40acf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba40c8f30 0x7fcba40ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba40c7e00 con 0x7fcba4061fa0 2023-08-17T00:16:23.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba4153fa0 con 0x7fcba40acb90 2023-08-17T00:16:23.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcbaa5b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40c9ab0 con 0x7fcba40c8f30 2023-08-17T00:16:23.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcba8db6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba40c8f30 0x7fcba40ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcba8db6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba40c8f30 0x7fcba40ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:54224/0 (socket says 172.21.15.153:54224) 2023-08-17T00:16:23.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.380+0000 7fcba95b7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcba40acb90 0x7fcba40acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcba8db6700 1 -- 172.21.15.153:0/238785694 learned_addr learned my addr 172.21.15.153:0/238785694 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcba95b7700 1 -- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba40c8f30 msgr2=0x7fcba40ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcba95b7700 1 --2- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba40c8f30 0x7fcba40ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcba95b7700 1 -- 172.21.15.153:0/238785694 >> v1:172.21.15.178:6789/0 conn(0x7fcba4061fa0 legacy=0x7fcba40aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcb9bfff700 1 -- 172.21.15.153:0/238785694 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944759476 0 0) 0x7fcba40c7e00 con 0x7fcba4061fa0 2023-08-17T00:16:23.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcba95b7700 1 -- 172.21.15.153:0/238785694 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba40c9d90 con 0x7fcba40acb90 2023-08-17T00:16:23.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcba95b7700 1 --2- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba40acf70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fcba0009760 tx=0x7fcba0009060).ready entity=mon.1 client_cookie=14a8ea8d68da8c3f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcb9bfff700 1 -- 172.21.15.153:0/238785694 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba00090d0 con 0x7fcba40acb90 2023-08-17T00:16:23.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcb9bfff700 1 -- 172.21.15.153:0/238785694 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba000f510 con 0x7fcba40acb90 2023-08-17T00:16:23.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcb9bfff700 1 -- 172.21.15.153:0/238785694 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba000f890 con 0x7fcba40acb90 2023-08-17T00:16:23.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 msgr2=0x7fcba40acf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba40acf70 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7fcba0009760 tx=0x7fcba0009060).stop 2023-08-17T00:16:23.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/238785694 shutdown_connections 2023-08-17T00:16:23.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba40c8f30 0x7fcba40ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/238785694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba40acf70 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/238785694 >> 172.21.15.153:0/238785694 conn(0x7fcba40cb380 msgr2=0x7fcba40c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:23.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/238785694 shutdown_connections 2023-08-17T00:16:23.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.384+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/238785694 wait complete. 2023-08-17T00:16:23.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.388+0000 7fcbaa5b9700 1 Processor -- start 2023-08-17T00:16:23.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.388+0000 7fcbaa5b9700 1 -- start start 2023-08-17T00:16:23.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba4061fa0 0x7fcba414b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba4164db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 0x7fcba40c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40ae630 con 0x7fcba40c8f30 2023-08-17T00:16:23.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba414b9e0 con 0x7fcba40acb90 2023-08-17T00:16:23.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba40ada20 con 0x7fcba4061fa0 2023-08-17T00:16:23.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 0x7fcba40c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 0x7fcba40c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54568/0 (socket says 172.21.15.153:54568) 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 -- 172.21.15.153:0/1587471396 learned_addr learned my addr 172.21.15.153:0/1587471396 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba95b7700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba4061fa0 0x7fcba414b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba8db6700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba4164db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 -- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba4061fa0 msgr2=0x7fcba414b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba4061fa0 0x7fcba414b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 -- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 msgr2=0x7fcba4164db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba4164db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 -- 172.21.15.153:0/1587471396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00092a0 con 0x7fcba40c8f30 2023-08-17T00:16:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba8db6700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba4164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcba9db8700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 0x7fcba40c5250 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fcb9c00c840 tx=0x7fcb9c0014a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c010510 con 0x7fcba40c8f30 2023-08-17T00:16:23.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c010670 con 0x7fcba40c8f30 2023-08-17T00:16:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba40add00 con 0x7fcba40c8f30 2023-08-17T00:16:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c010a30 con 0x7fcba40c8f30 2023-08-17T00:16:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba40ae2c0 con 0x7fcba40c8f30 2023-08-17T00:16:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.392+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba40ae7e0 con 0x7fcba40c8f30 2023-08-17T00:16:23.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.396+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcb9c019030 con 0x7fcba40c8f30 2023-08-17T00:16:23.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.396+0000 7fcb997fa700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8805a180 0x7fcb8805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.396+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fcb9c073950 con 0x7fcba40c8f30 2023-08-17T00:16:23.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.396+0000 7fcba95b7700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8805a180 0x7fcb8805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.400+0000 7fcba95b7700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8805a180 0x7fcb8805c640 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fcba0009fd0 tx=0x7fcba0017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.404+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcba40ae7e0 con 0x7fcba40c8f30 2023-08-17T00:16:23.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.596+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcba406b4c0 con 0x7fcba40c8f30 2023-08-17T00:16:23.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.596+0000 7fcb997fa700 1 -- 172.21.15.153:0/1587471396 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fcb9c0473a0 con 0x7fcba40c8f30 2023-08-17T00:16:23.603 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:23.603 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:16:23.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8805a180 msgr2=0x7fcb8805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8805a180 0x7fcb8805c640 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 rx=0x7fcba0009fd0 tx=0x7fcba0017000).stop 2023-08-17T00:16:23.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 msgr2=0x7fcba40c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 0x7fcba40c5250 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 rx=0x7fcb9c00c840 tx=0x7fcb9c0014a0).stop 2023-08-17T00:16:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 shutdown_connections 2023-08-17T00:16:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcb8805a180 0x7fcb8805c640 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcba40c8f30 0x7fcba40c5250 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcba40acb90 0x7fcba4164db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 --2- 172.21.15.153:0/1587471396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcba4061fa0 0x7fcba414b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 >> 172.21.15.153:0/1587471396 conn(0x7fcba40cb380 msgr2=0x7fcba40ab760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 shutdown_connections 2023-08-17T00:16:23.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.600+0000 7fcbaa5b9700 1 -- 172.21.15.153:0/1587471396 wait complete. 2023-08-17T00:16:23.610 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:16:23.628 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:23.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.776+0000 7f7375e39700 1 Processor -- start 2023-08-17T00:16:23.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.776+0000 7f7375e39700 1 -- start start 2023-08-17T00:16:23.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7370068f30 0x7f73700c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f73700ac2f0 0x7f73700c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73701545e0 con 0x7f73700abf10 2023-08-17T00:16:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73700c1c50 con 0x7f7370068f30 2023-08-17T00:16:23.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7370064b80 con 0x7f73700ac2f0 2023-08-17T00:16:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7370068f30 0x7f73700c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7370068f30 0x7f73700c0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54578/0 (socket says 172.21.15.153:54578) 2023-08-17T00:16:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 -- 172.21.15.153:0/575352053 learned_addr learned my addr 172.21.15.153:0/575352053 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7374e37700 1 --1- 172.21.15.153:0/575352053 >> v1:172.21.15.153:6789/0 conn(0x7f73700abf10 0x7f7370068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47772/0 (socket says 172.21.15.153:47772) 2023-08-17T00:16:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375638700 1 --2- 172.21.15.153:0/575352053 >> v2:172.21.15.178:3300/0 conn(0x7f73700ac2f0 0x7f73700c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 -- 172.21.15.153:0/575352053 >> v2:172.21.15.178:3300/0 conn(0x7f73700ac2f0 msgr2=0x7f73700c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:23.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 --2- 172.21.15.153:0/575352053 >> v2:172.21.15.178:3300/0 conn(0x7f73700ac2f0 0x7f73700c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 -- 172.21.15.153:0/575352053 >> v1:172.21.15.153:6789/0 conn(0x7f73700abf10 legacy=0x7f7370068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 -- 172.21.15.153:0/575352053 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700c1460 con 0x7f7370068f30 2023-08-17T00:16:23.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7367fff700 1 --2- 172.21.15.153:0/575352053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f73700c0a80 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f7370063b10 tx=0x7f73600090f0).ready entity=mon.0 client_cookie=40c62f68239048f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f73677fe700 1 -- 172.21.15.153:0/575352053 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736000b520 con 0x7f7370068f30 2023-08-17T00:16:23.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f73677fe700 1 -- 172.21.15.153:0/575352053 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736000b680 con 0x7f7370068f30 2023-08-17T00:16:23.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f73677fe700 1 -- 172.21.15.153:0/575352053 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736000ba00 con 0x7f7370068f30 2023-08-17T00:16:23.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- 172.21.15.153:0/575352053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 msgr2=0x7f73700c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 --2- 172.21.15.153:0/575352053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f73700c0a80 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 rx=0x7f7370063b10 tx=0x7f73600090f0).stop 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- 172.21.15.153:0/575352053 shutdown_connections 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 --2- 172.21.15.153:0/575352053 >> v2:172.21.15.178:3300/0 conn(0x7f73700ac2f0 0x7f73700c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 --2- 172.21.15.153:0/575352053 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f73700c0a80 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- 172.21.15.153:0/575352053 >> 172.21.15.153:0/575352053 conn(0x7f73700c6620 msgr2=0x7f73700c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- 172.21.15.153:0/575352053 shutdown_connections 2023-08-17T00:16:23.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.780+0000 7f7375e39700 1 -- 172.21.15.153:0/575352053 wait complete. 2023-08-17T00:16:23.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.784+0000 7f7375e39700 1 Processor -- start 2023-08-17T00:16:23.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.784+0000 7f7375e39700 1 -- start start 2023-08-17T00:16:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f737014cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73700abf10 0x7f7370062e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73700ac2f0 0x7f73700be100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73700636d0 con 0x7f7370068f30 2023-08-17T00:16:23.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73701661e0 con 0x7f73700ac2f0 2023-08-17T00:16:23.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73701658b0 con 0x7f73700abf10 2023-08-17T00:16:23.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f737014cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f737014cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54588/0 (socket says 172.21.15.153:54588) 2023-08-17T00:16:23.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 -- 172.21.15.153:0/104279665 learned_addr learned my addr 172.21.15.153:0/104279665 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:23.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7367fff700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73700abf10 0x7f7370062e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375638700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73700ac2f0 0x7f73700be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 -- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73700abf10 msgr2=0x7f7370062e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73700abf10 0x7f7370062e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 -- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73700ac2f0 msgr2=0x7f73700be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:23.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73700ac2f0 0x7f73700be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:23.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 -- 172.21.15.153:0/104279665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7360009370 con 0x7f7370068f30 2023-08-17T00:16:23.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7374e37700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f737014cc50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f736c00c4f0 tx=0x7f736c007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00ce60 con 0x7f7370068f30 2023-08-17T00:16:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736c001e90 con 0x7f7370068f30 2023-08-17T00:16:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c0074f0 con 0x7f7370068f30 2023-08-17T00:16:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73700a96d0 con 0x7f7370068f30 2023-08-17T00:16:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.788+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7370165e70 con 0x7f7370068f30 2023-08-17T00:16:23.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.792+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737006b4c0 con 0x7f7370068f30 2023-08-17T00:16:23.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.792+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f736c005880 con 0x7f7370068f30 2023-08-17T00:16:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.796+0000 7f7364ff9700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f735c05a120 0x7f735c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:23.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.796+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f736c073960 con 0x7f7370068f30 2023-08-17T00:16:23.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.796+0000 7f7367fff700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f735c05a120 0x7f735c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:23.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.796+0000 7f7367fff700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f735c05a120 0x7f735c05c5e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f7370063b10 tx=0x7f7360017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:23.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.800+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f736c047300 con 0x7f7370068f30 2023-08-17T00:16:24.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:23.996+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73700c1690 con 0x7f7370068f30 2023-08-17T00:16:24.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7364ff9700 1 -- 172.21.15.153:0/104279665 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f736c04a920 con 0x7f7370068f30 2023-08-17T00:16:24.006 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:24.006 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":130,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125}],"filesystems":[{"mdsmap":{"epoch":130,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:15:39.231720+0000","modified":"2023-08-17T00:15:42.252112+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9390},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9390":{"gid":9390,"name":"c","rank":0,"incarnation":126,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/723499345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":723499345},{"type":"v1","addr":"172.21.15.153:6835","nonce":723499345}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-08-17T00:16:24.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f735c05a120 msgr2=0x7f735c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f735c05a120 0x7f735c05c5e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7f7370063b10 tx=0x7f7360017000).stop 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 msgr2=0x7f737014cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f737014cc50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 rx=0x7f736c00c4f0 tx=0x7f736c007d20).stop 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 shutdown_connections 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f735c05a120 0x7f735c05c5e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f73700ac2f0 0x7f73700be100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73700abf10 0x7f7370062e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 --2- 172.21.15.153:0/104279665 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7370068f30 0x7f737014cc50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 >> 172.21.15.153:0/104279665 conn(0x7f73700c6620 msgr2=0x7f73700c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:24.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 shutdown_connections 2023-08-17T00:16:24.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.000+0000 7f7375e39700 1 -- 172.21.15.153:0/104279665 wait complete. 2023-08-17T00:16:24.011 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 130 2023-08-17T00:16:24.028 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:24.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 Processor -- start 2023-08-17T00:16:24.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 -- start start 2023-08-17T00:16:24.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1980064bf0 0x7f1980066200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980158000 0x7f19800c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1980065160 con 0x7f19800a60b0 2023-08-17T00:16:24.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1980065440 con 0x7f1980064bf0 2023-08-17T00:16:24.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f19864e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1980065720 con 0x7f1980158000 2023-08-17T00:16:24.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f1984ce1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1980064bf0 0x7f1980066200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f1985ce3700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980158000 0x7f19800c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f1984ce1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1980064bf0 0x7f1980066200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54594/0 (socket says 172.21.15.153:54594) 2023-08-17T00:16:24.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.176+0000 7f1984ce1700 1 -- 172.21.15.153:0/4215364904 learned_addr learned my addr 172.21.15.153:0/4215364904 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:24.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1984ce1700 1 -- 172.21.15.153:0/4215364904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980158000 msgr2=0x7f19800c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:24.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1984ce1700 1 --2- 172.21.15.153:0/4215364904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980158000 0x7f19800c1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1984ce1700 1 -- 172.21.15.153:0/4215364904 >> v1:172.21.15.178:6789/0 conn(0x7f19800a60b0 legacy=0x7f19801578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1984ce1700 1 -- 172.21.15.153:0/4215364904 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980065a00 con 0x7f1980064bf0 2023-08-17T00:16:24.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1984ce1700 1 --2- 172.21.15.153:0/4215364904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980064bf0 0x7f1980066200 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f1970006fd0 tx=0x7f19700090f0).ready entity=mon.0 client_cookie=9e6d38c32fa0e110 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:24.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1977fff700 1 -- 172.21.15.153:0/4215364904 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000b580 con 0x7f1980064bf0 2023-08-17T00:16:24.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1977fff700 1 -- 172.21.15.153:0/4215364904 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197000b6e0 con 0x7f1980064bf0 2023-08-17T00:16:24.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f1977fff700 1 -- 172.21.15.153:0/4215364904 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000ba80 con 0x7f1980064bf0 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 -- 172.21.15.153:0/4215364904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980064bf0 msgr2=0x7f1980066200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 --2- 172.21.15.153:0/4215364904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980064bf0 0x7f1980066200 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 rx=0x7f1970006fd0 tx=0x7f19700090f0).stop 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 -- 172.21.15.153:0/4215364904 shutdown_connections 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 --2- 172.21.15.153:0/4215364904 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980158000 0x7f19800c1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 --2- 172.21.15.153:0/4215364904 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980064bf0 0x7f1980066200 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 -- 172.21.15.153:0/4215364904 >> 172.21.15.153:0/4215364904 conn(0x7f19800c7470 msgr2=0x7f19800c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:24.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 -- 172.21.15.153:0/4215364904 shutdown_connections 2023-08-17T00:16:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.180+0000 7f19864e4700 1 -- 172.21.15.153:0/4215364904 wait complete. 2023-08-17T00:16:24.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.184+0000 7f19864e4700 1 Processor -- start 2023-08-17T00:16:24.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.184+0000 7f19864e4700 1 -- start start 2023-08-17T00:16:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980064bf0 0x7f1980164cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19800a60b0 0x7f19800a8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 0x7f19800a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800a7cd0 con 0x7f1980158000 2023-08-17T00:16:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800a8850 con 0x7f19800a60b0 2023-08-17T00:16:24.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19800a7f20 con 0x7f1980064bf0 2023-08-17T00:16:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 0x7f19800a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 0x7f19800a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54600/0 (socket says 172.21.15.153:54600) 2023-08-17T00:16:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 -- 172.21.15.153:0/2506796433 learned_addr learned my addr 172.21.15.153:0/2506796433 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19854e2700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980064bf0 0x7f1980164cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1984ce1700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19800a60b0 0x7f19800a8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 -- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980064bf0 msgr2=0x7f1980164cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980064bf0 0x7f1980164cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 -- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19800a60b0 msgr2=0x7f19800a8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19800a60b0 0x7f19800a8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 -- 172.21.15.153:0/2506796433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1970009370 con 0x7f1980158000 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1984ce1700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19800a60b0 0x7f19800a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:24.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f1985ce3700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 0x7f19800a9a10 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f1978009e90 tx=0x7f197800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:24.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800cb50 con 0x7f1980158000 2023-08-17T00:16:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800f040 con 0x7f1980158000 2023-08-17T00:16:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19800a8200 con 0x7f1980158000 2023-08-17T00:16:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800cec0 con 0x7f1980158000 2023-08-17T00:16:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.188+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19801651b0 con 0x7f1980158000 2023-08-17T00:16:24.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.192+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19800a89c0 con 0x7f1980158000 2023-08-17T00:16:24.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.192+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1978013610 con 0x7f1980158000 2023-08-17T00:16:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.192+0000 7f19757fa700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196405a180 0x7f196405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.192+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1978074c40 con 0x7f1980158000 2023-08-17T00:16:24.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.196+0000 7f19854e2700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196405a180 0x7f196405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.196+0000 7f19854e2700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196405a180 0x7f196405c640 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f19800c2160 tx=0x7f197c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:24.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.200+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f197804c010 con 0x7f1980158000 2023-08-17T00:16:24.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.360+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19800c4320 con 0x7f1980158000 2023-08-17T00:16:24.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19757fa700 1 -- 172.21.15.153:0/2506796433 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f197804bc00 con 0x7f1980158000 2023-08-17T00:16:24.370 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:24.370 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":166,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:15:40.236606+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:15:37.144808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-08-17T00:15:38.254935+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:24.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196405a180 msgr2=0x7f196405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196405a180 0x7f196405c640 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 rx=0x7f19800c2160 tx=0x7f197c009040).stop 2023-08-17T00:16:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 msgr2=0x7f19800a9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 0x7f19800a9a10 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 rx=0x7f1978009e90 tx=0x7f197800b040).stop 2023-08-17T00:16:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 shutdown_connections 2023-08-17T00:16:24.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196405a180 0x7f196405c640 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1980158000 0x7f19800a9a10 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19800a60b0 0x7f19800a8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 --2- 172.21.15.153:0/2506796433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1980064bf0 0x7f1980164cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.364+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 >> 172.21.15.153:0/2506796433 conn(0x7f19800c7470 msgr2=0x7f19800a4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:24.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.368+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 shutdown_connections 2023-08-17T00:16:24.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.368+0000 7f19864e4700 1 -- 172.21.15.153:0/2506796433 wait complete. 2023-08-17T00:16:24.392 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:16:24.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.548+0000 7ff070c1b700 1 Processor -- start 2023-08-17T00:16:24.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.548+0000 7ff070c1b700 1 -- start start 2023-08-17T00:16:24.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.548+0000 7ff070c1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff06c064870 0x7ff06c064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.548+0000 7ff070c1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c061fa0 con 0x7ff06c151b90 2023-08-17T00:16:24.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.548+0000 7ff070c1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06c1523d0 con 0x7ff06c151f70 2023-08-17T00:16:24.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.548+0000 7ff070c1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff06c0c3fb0 con 0x7ff06c064870 2023-08-17T00:16:24.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06a59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff06c151b90 0x7ff06c063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:47776/0 (socket says 172.21.15.153:47776) 2023-08-17T00:16:24.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06a59c700 1 -- 172.21.15.153:0/3184448730 learned_addr learned my addr 172.21.15.153:0/3184448730 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:24.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06ad9d700 1 --2- 172.21.15.153:0/3184448730 >> v2:172.21.15.178:3300/0 conn(0x7ff06c064870 0x7ff06c064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1206317683 0 0) 0x7ff06c061fa0 con 0x7ff06c151b90 2023-08-17T00:16:24.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0540033f0 con 0x7ff06c151b90 2023-08-17T00:16:24.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859052530 0 0) 0x7ff06c1523d0 con 0x7ff06c151f70 2023-08-17T00:16:24.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff06c061fa0 con 0x7ff06c151f70 2023-08-17T00:16:24.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06ad9d700 1 -- 172.21.15.153:0/3184448730 >> v1:172.21.15.178:6789/0 conn(0x7ff06c151f70 legacy=0x7ff06c065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06ad9d700 1 -- 172.21.15.153:0/3184448730 >> v1:172.21.15.153:6789/0 conn(0x7ff06c151b90 legacy=0x7ff06c063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06ad9d700 1 -- 172.21.15.153:0/3184448730 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c0651b0 con 0x7ff06c064870 2023-08-17T00:16:24.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06ad9d700 1 --2- 172.21.15.153:0/3184448730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c064870 0x7ff06c064cc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7ff064009e60 tx=0x7ff064009780).ready entity=mon.1 client_cookie=d3c98092d50dcd39 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:24.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400e070 con 0x7ff06c064870 2023-08-17T00:16:24.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06400bab0 con 0x7ff06c064870 2023-08-17T00:16:24.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.552+0000 7ff06959a700 1 -- 172.21.15.153:0/3184448730 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400be30 con 0x7ff06c064870 2023-08-17T00:16:24.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 -- 172.21.15.153:0/3184448730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c064870 msgr2=0x7ff06c064cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 --2- 172.21.15.153:0/3184448730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c064870 0x7ff06c064cc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7ff064009e60 tx=0x7ff064009780).stop 2023-08-17T00:16:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 -- 172.21.15.153:0/3184448730 shutdown_connections 2023-08-17T00:16:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 --2- 172.21.15.153:0/3184448730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c064870 0x7ff06c064cc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 -- 172.21.15.153:0/3184448730 >> 172.21.15.153:0/3184448730 conn(0x7ff06c0c7150 msgr2=0x7ff06c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 -- 172.21.15.153:0/3184448730 shutdown_connections 2023-08-17T00:16:24.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 -- 172.21.15.153:0/3184448730 wait complete. 2023-08-17T00:16:24.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 Processor -- start 2023-08-17T00:16:24.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.556+0000 7ff070c1b700 1 -- start start 2023-08-17T00:16:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff06c064870 0x7ff06c0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c151b90 0x7ff06c0a6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 0x7ff06c0a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c0a7700 con 0x7ff06c151f70 2023-08-17T00:16:24.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c158f00 con 0x7ff06c151b90 2023-08-17T00:16:24.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06c1591e0 con 0x7ff06c064870 2023-08-17T00:16:24.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 0x7ff06c0a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 0x7ff06c0a6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:54602/0 (socket says 172.21.15.153:54602) 2023-08-17T00:16:24.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 -- 172.21.15.153:0/716305693 learned_addr learned my addr 172.21.15.153:0/716305693 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:24.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06a59c700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff06c064870 0x7ff06c0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff069d9b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c151b90 0x7ff06c0a6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 -- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff06c064870 msgr2=0x7ff06c0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff06c064870 0x7ff06c0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 -- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c151b90 msgr2=0x7ff06c0a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:24.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c151b90 0x7ff06c0a6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:24.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 -- 172.21.15.153:0/716305693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff064009a20 con 0x7ff06c151f70 2023-08-17T00:16:24.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff06ad9d700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 0x7ff06c0a6e60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7ff06400b610 tx=0x7ff064009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:24.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06401d630 con 0x7ff06c151f70 2023-08-17T00:16:24.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06401d790 con 0x7ff06c151f70 2023-08-17T00:16:24.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff06c1594c0 con 0x7ff06c151f70 2023-08-17T00:16:24.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06401db10 con 0x7ff06c151f70 2023-08-17T00:16:24.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06c0a7350 con 0x7ff06c151f70 2023-08-17T00:16:24.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.560+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06c06b530 con 0x7ff06c151f70 2023-08-17T00:16:24.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.564+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff064026410 con 0x7ff06c151f70 2023-08-17T00:16:24.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.564+0000 7ff05a7fc700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04c05a150 0x7ff04c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:24.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.564+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff0640760f0 con 0x7ff06c151f70 2023-08-17T00:16:24.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.564+0000 7ff06a59c700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04c05a150 0x7ff04c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:24.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.564+0000 7ff06a59c700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04c05a150 0x7ff04c05c610 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7ff05c005750 tx=0x7ff05c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:24.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.568+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff064049ae0 con 0x7ff06c151f70 2023-08-17T00:16:24.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:24.760+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff06c0c3ab0 con 0x7ff06c151f70 2023-08-17T00:16:25.669 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:16:25.664+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:16:25.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.676+0000 7ff05a7fc700 1 -- 172.21.15.153:0/716305693 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v131) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff06404d100 con 0x7ff06c151f70 2023-08-17T00:16:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04c05a150 msgr2=0x7ff04c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04c05a150 0x7ff04c05c610 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7ff05c005750 tx=0x7ff05c009040).stop 2023-08-17T00:16:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 msgr2=0x7ff06c0a6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:25.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 0x7ff06c0a6e60 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 rx=0x7ff06400b610 tx=0x7ff064009780).stop 2023-08-17T00:16:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 shutdown_connections 2023-08-17T00:16:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04c05a150 0x7ff04c05c610 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff06c151f70 0x7ff06c0a6e60 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff06c151b90 0x7ff06c0a6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 --2- 172.21.15.153:0/716305693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff06c064870 0x7ff06c0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 >> 172.21.15.153:0/716305693 conn(0x7ff06c0c7150 msgr2=0x7ff06c0c5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 shutdown_connections 2023-08-17T00:16:25.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.680+0000 7ff070c1b700 1 -- 172.21.15.153:0/716305693 wait complete. 2023-08-17T00:16:25.690 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:16:25.698 INFO:tasks.ceph.mds.c.smithi153.stderr: -4703> 2023-08-17T00:15:44.653+0000 7fa204d99700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:16:25.703 INFO:tasks.ceph.mds.c.smithi153.stderr: -2966> 2023-08-17T00:15:48.217+0000 7fa201592700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2023-08-17T00:15:46.645059+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={7946=0-12582912@1} caps={7946=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@4},l=7946 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x5639b41af600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(24)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-08-17T00:16:25.711 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:16:25.744 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:16:25.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 Processor -- start 2023-08-17T00:16:25.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 -- start start 2023-08-17T00:16:25.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe5080689c0 0x7fe508068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe508151530 0x7fe5081519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe508065da0 con 0x7fe5081560f0 2023-08-17T00:16:25.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe508155c60 con 0x7fe5080689c0 2023-08-17T00:16:25.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50df47700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe508156550 con 0x7fe508151530 2023-08-17T00:16:25.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe507fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe5081560f0 0x7fe5080c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55914/0 (socket says 172.21.15.153:55914) 2023-08-17T00:16:25.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe507fff700 1 -- 172.21.15.153:0/3139814736 learned_addr learned my addr 172.21.15.153:0/3139814736 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:25.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.860+0000 7fe50cf45700 1 --2- 172.21.15.153:0/3139814736 >> v2:172.21.15.153:3300/0 conn(0x7fe5080689c0 0x7fe508068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654465613 0 0) 0x7fe508065da0 con 0x7fe5081560f0 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 --2- 172.21.15.153:0/3139814736 >> v2:172.21.15.178:3300/0 conn(0x7fe508151530 0x7fe5081519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f80033f0 con 0x7fe5081560f0 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883446452 0 0) 0x7fe4f80033f0 con 0x7fe5081560f0 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 >> v2:172.21.15.178:3300/0 conn(0x7fe508151530 msgr2=0x7fe5081519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 --2- 172.21.15.153:0/3139814736 >> v2:172.21.15.178:3300/0 conn(0x7fe508151530 0x7fe5081519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 >> v2:172.21.15.153:3300/0 conn(0x7fe5080689c0 msgr2=0x7fe508068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:25.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 --2- 172.21.15.153:0/3139814736 >> v2:172.21.15.153:3300/0 conn(0x7fe5080689c0 0x7fe508068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe508065ff0 con 0x7fe5081560f0 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fe4f4001470 con 0x7fe5081560f0 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50cf45700 1 --2- 172.21.15.153:0/3139814736 >> v2:172.21.15.153:3300/0 conn(0x7fe5080689c0 0x7fe508068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 >> v1:172.21.15.153:6789/0 conn(0x7fe5081560f0 legacy=0x7fe5080c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f80038e0 0x7fe4f8003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8004690 0x7fe4f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f8005000 0x7fe4f800fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508155c60 con 0x7fe4f8005000 2023-08-17T00:16:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe508156550 con 0x7fe4f8004690 2023-08-17T00:16:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f80102e0 con 0x7fe4f80038e0 2023-08-17T00:16:25.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f8005000 0x7fe4f800fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe507fff700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8004690 0x7fe4f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50cf45700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f80038e0 0x7fe4f8003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 -- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f80038e0 msgr2=0x7fe4f8003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f80038e0 0x7fe4f8003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 -- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8004690 msgr2=0x7fe4f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8004690 0x7fe4f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 -- 172.21.15.153:0/3139814736 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80033f0 con 0x7fe4f8005000 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50cf45700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4f80038e0 0x7fe4f8003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 -- 172.21.15.153:0/3139814736 reap_dead start 2023-08-17T00:16:25.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50d746700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f8005000 0x7fe4f800fcf0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fe50000e210 tx=0x7fe50000b040).ready entity=mon.0 client_cookie=48a44b6b921720af server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe500009ac0 con 0x7fe4f8005000 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50000f040 con 0x7fe4f8005000 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe5077fe700 1 -- 172.21.15.153:0/3139814736 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50000ed10 con 0x7fe4f8005000 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50df47700 1 -- 172.21.15.153:0/3139814736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f8005000 msgr2=0x7fe4f800fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.864+0000 7fe50df47700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f8005000 0x7fe4f800fcf0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 rx=0x7fe50000e210 tx=0x7fe50000b040).stop 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 -- 172.21.15.153:0/3139814736 shutdown_connections 2023-08-17T00:16:25.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 --2- 172.21.15.153:0/3139814736 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4f8005000 0x7fe4f800fcf0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 -- 172.21.15.153:0/3139814736 >> 172.21.15.153:0/3139814736 conn(0x7fe5080c6620 msgr2=0x7fe5080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 -- 172.21.15.153:0/3139814736 shutdown_connections 2023-08-17T00:16:25.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 -- 172.21.15.153:0/3139814736 wait complete. 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 Processor -- start 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.868+0000 7fe50df47700 1 -- start start 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8005000 0x7fe5081409b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe50815fc30 0x7fe5080be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 0x7fe5080c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080beea0 con 0x7fe5080be9b0 2023-08-17T00:16:25.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080bf920 con 0x7fe4f8005000 2023-08-17T00:16:25.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5080bfc00 con 0x7fe50815fc30 2023-08-17T00:16:25.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 0x7fe5080c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 0x7fe5080c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60304/0 (socket says 172.21.15.153:60304) 2023-08-17T00:16:25.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 -- 172.21.15.153:0/1918198687 learned_addr learned my addr 172.21.15.153:0/1918198687 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:25.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe507fff700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe50815fc30 0x7fe5080be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50cf45700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8005000 0x7fe5081409b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 -- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe50815fc30 msgr2=0x7fe5080be4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe50815fc30 0x7fe5080be4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 -- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8005000 msgr2=0x7fe5081409b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8005000 0x7fe5081409b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 -- 172.21.15.153:0/1918198687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5080bfee0 con 0x7fe5080be9b0 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50d746700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 0x7fe5080c1d90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fe50000afd0 tx=0x7fe500018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50001d460 con 0x7fe5080be9b0 2023-08-17T00:16:25.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50001d5c0 con 0x7fe5080be9b0 2023-08-17T00:16:25.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50001d980 con 0x7fe5080be9b0 2023-08-17T00:16:25.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5080c01c0 con 0x7fe5080be9b0 2023-08-17T00:16:25.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.872+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5080bd6f0 con 0x7fe5080be9b0 2023-08-17T00:16:25.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.876+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5080bd8e0 con 0x7fe5080be9b0 2023-08-17T00:16:25.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.876+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe500019040 con 0x7fe5080be9b0 2023-08-17T00:16:25.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.876+0000 7fe504ff9700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4ec05a150 0x7fe4ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:25.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.876+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fe500076310 con 0x7fe5080be9b0 2023-08-17T00:16:25.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.876+0000 7fe50cf45700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4ec05a150 0x7fe4ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:25.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.876+0000 7fe50cf45700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4ec05a150 0x7fe4ec05c610 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fe4fc009210 tx=0x7fe4fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:25.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:25.884+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe5080bd8e0 con 0x7fe5080be9b0 2023-08-17T00:16:26.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.076+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe5080697f0 con 0x7fe5080be9b0 2023-08-17T00:16:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe504ff9700 1 -- 172.21.15.153:0/1918198687 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v132) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5080697f0 con 0x7fe5080be9b0 2023-08-17T00:16:26.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4ec05a150 msgr2=0x7fe4ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4ec05a150 0x7fe4ec05c610 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7fe4fc009210 tx=0x7fe4fc008040).stop 2023-08-17T00:16:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 msgr2=0x7fe5080c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 0x7fe5080c1d90 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 rx=0x7fe50000afd0 tx=0x7fe500018000).stop 2023-08-17T00:16:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 shutdown_connections 2023-08-17T00:16:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4ec05a150 0x7fe4ec05c610 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe5080be9b0 0x7fe5080c1d90 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe50815fc30 0x7fe5080be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 --2- 172.21.15.153:0/1918198687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4f8005000 0x7fe5081409b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.684+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 >> 172.21.15.153:0/1918198687 conn(0x7fe5080c6620 msgr2=0x7fe5080c5770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.688+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 shutdown_connections 2023-08-17T00:16:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.688+0000 7fe50df47700 1 -- 172.21.15.153:0/1918198687 wait complete. 2023-08-17T00:16:26.712 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:16:26.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.916+0000 7f5405bdb700 1 Processor -- start 2023-08-17T00:16:26.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.916+0000 7f5405bdb700 1 -- start start 2023-08-17T00:16:26.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f5405bdb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f54000c1af0 0x7f54000c5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:26.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f5405bdb700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54000c5160 con 0x7f54000c1710 2023-08-17T00:16:26.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f5405bdb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5400062f00 con 0x7f5400066110 2023-08-17T00:16:26.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f5405bdb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54000c1f60 con 0x7f54000c1af0 2023-08-17T00:16:26.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53ff7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f54000c1710 0x7f5400063390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55918/0 (socket says 172.21.15.153:55918) 2023-08-17T00:16:26.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53ff7fe700 1 -- 172.21.15.153:0/921860585 learned_addr learned my addr 172.21.15.153:0/921860585 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:26.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53feffd700 1 --2- 172.21.15.153:0/921860585 >> v2:172.21.15.178:3300/0 conn(0x7f54000c1af0 0x7f54000c5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:26.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3471838433 0 0) 0x7f5400062f00 con 0x7f5400066110 2023-08-17T00:16:26.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53e80033f0 con 0x7f5400066110 2023-08-17T00:16:26.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401928715 0 0) 0x7f54000c5160 con 0x7f54000c1710 2023-08-17T00:16:26.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5400062f00 con 0x7f54000c1710 2023-08-17T00:16:26.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53feffd700 1 -- 172.21.15.153:0/921860585 >> v1:172.21.15.178:6789/0 conn(0x7f5400066110 legacy=0x7f5400066560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53feffd700 1 -- 172.21.15.153:0/921860585 >> v1:172.21.15.153:6789/0 conn(0x7f54000c1710 legacy=0x7f5400063390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53feffd700 1 -- 172.21.15.153:0/921860585 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54000622f0 con 0x7f54000c1af0 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53feffd700 1 --2- 172.21.15.153:0/921860585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f54000c5d00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f53f4009760 tx=0x7f53f4009060).ready entity=mon.1 client_cookie=3b8789769086201d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400d4a0 con 0x7f54000c1af0 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400d600 con 0x7f54000c1af0 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.920+0000 7f53fe7fc700 1 -- 172.21.15.153:0/921860585 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400d980 con 0x7f54000c1af0 2023-08-17T00:16:26.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 -- 172.21.15.153:0/921860585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 msgr2=0x7f54000c5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 --2- 172.21.15.153:0/921860585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f54000c5d00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f53f4009760 tx=0x7f53f4009060).stop 2023-08-17T00:16:26.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 -- 172.21.15.153:0/921860585 shutdown_connections 2023-08-17T00:16:26.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 --2- 172.21.15.153:0/921860585 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f54000c5d00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 -- 172.21.15.153:0/921860585 >> 172.21.15.153:0/921860585 conn(0x7f54000c7090 msgr2=0x7f54000c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:26.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 -- 172.21.15.153:0/921860585 shutdown_connections 2023-08-17T00:16:26.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.924+0000 7f5405bdb700 1 -- 172.21.15.153:0/921860585 wait complete. 2023-08-17T00:16:26.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 Processor -- start 2023-08-17T00:16:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 -- start start 2023-08-17T00:16:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5400066110 0x7f5400159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 0x7f54000abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f540015ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400159c30 con 0x7f54000c1710 2023-08-17T00:16:26.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5400159f90 con 0x7f54000c1af0 2023-08-17T00:16:26.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540015a270 con 0x7f5400066110 2023-08-17T00:16:26.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 0x7f54000abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:26.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 0x7f54000abff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60314/0 (socket says 172.21.15.153:60314) 2023-08-17T00:16:26.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 -- 172.21.15.153:0/3847804505 learned_addr learned my addr 172.21.15.153:0/3847804505 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:26.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53fffff700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f540015ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:26.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53ff7fe700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5400066110 0x7f5400159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:26.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 -- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5400066110 msgr2=0x7f5400159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5400066110 0x7f5400159590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 -- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 msgr2=0x7f540015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f540015ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 -- 172.21.15.153:0/3847804505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40092a0 con 0x7f54000c1710 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53feffd700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 0x7f54000abff0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f5400063b50 tx=0x7f53f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f400dcf0 con 0x7f54000c1710 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f400de50 con 0x7f54000c1710 2023-08-17T00:16:26.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f401d430 con 0x7f54000c1710 2023-08-17T00:16:26.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540015a550 con 0x7f54000c1710 2023-08-17T00:16:26.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.928+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54000ac4e0 con 0x7f54000c1710 2023-08-17T00:16:26.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.932+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54000c0d90 con 0x7f54000c1710 2023-08-17T00:16:26.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.932+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f53f400f070 con 0x7f54000c1710 2023-08-17T00:16:26.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.936+0000 7f53e77fe700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53ec05a150 0x7f53ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:26.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.936+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f53f4075820 con 0x7f54000c1710 2023-08-17T00:16:26.942 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.936+0000 7f53ff7fe700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53ec05a150 0x7f53ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:26.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.936+0000 7f53ff7fe700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53ec05a150 0x7f53ec05c610 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f53f0005750 tx=0x7f53f0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:26.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:26.940+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f54000c0d90 con 0x7f54000c1710 2023-08-17T00:16:27.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.100+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54000c0d90 con 0x7f54000c1710 2023-08-17T00:16:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.684+0000 7f53e77fe700 1 -- 172.21.15.153:0/3847804505 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v168) v1 ==== 181+0+0 (secure 0 0 0) 0x7f54000c0d90 con 0x7f54000c1710 2023-08-17T00:16:27.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53ec05a150 msgr2=0x7f53ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53ec05a150 0x7f53ec05c610 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f53f0005750 tx=0x7f53f0009040).stop 2023-08-17T00:16:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 msgr2=0x7f54000abff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 0x7f54000abff0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 rx=0x7f5400063b50 tx=0x7f53f4016000).stop 2023-08-17T00:16:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 shutdown_connections 2023-08-17T00:16:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53ec05a150 0x7f53ec05c610 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54000c1af0 0x7f540015ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f54000c1710 0x7f54000abff0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 --2- 172.21.15.153:0/3847804505 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5400066110 0x7f5400159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 >> 172.21.15.153:0/3847804505 conn(0x7f54000c7090 msgr2=0x7f54000c5d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 shutdown_connections 2023-08-17T00:16:27.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.692+0000 7f5405bdb700 1 -- 172.21.15.153:0/3847804505 wait complete. 2023-08-17T00:16:27.700 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:16:27.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:16:27.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.884+0000 7fe71281b700 1 Processor -- start 2023-08-17T00:16:27.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.884+0000 7fe71281b700 1 -- start start 2023-08-17T00:16:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe71281b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe70c0c7ad0 0x7fe70c0a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe71281b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c154620 con 0x7fe70c158190 2023-08-17T00:16:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe71281b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c154900 con 0x7fe70c0a9be0 2023-08-17T00:16:27.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe71281b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c154be0 con 0x7fe70c0c7ad0 2023-08-17T00:16:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe710db8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe70c158190 0x7fe70c0c91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55922/0 (socket says 172.21.15.153:55922) 2023-08-17T00:16:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe710db8700 1 -- 172.21.15.153:0/720172127 learned_addr learned my addr 172.21.15.153:0/720172127 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:27.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe703fff700 1 --2- 172.21.15.153:0/720172127 >> v2:172.21.15.153:3300/0 conn(0x7fe70c0c7ad0 0x7fe70c0a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215108849 0 0) 0x7fe70c154620 con 0x7fe70c158190 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f80033f0 con 0x7fe70c158190 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794508632 0 0) 0x7fe70c154900 con 0x7fe70c0a9be0 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe70c154620 con 0x7fe70c0a9be0 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe703fff700 1 -- 172.21.15.153:0/720172127 >> v1:172.21.15.178:6789/0 conn(0x7fe70c0a9be0 legacy=0x7fe70c0c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe703fff700 1 -- 172.21.15.153:0/720172127 >> v1:172.21.15.153:6789/0 conn(0x7fe70c158190 legacy=0x7fe70c0c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe703fff700 1 -- 172.21.15.153:0/720172127 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c154ec0 con 0x7fe70c0c7ad0 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.888+0000 7fe703fff700 1 --2- 172.21.15.153:0/720172127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0c7ad0 0x7fe70c0a9fc0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7fe6f4009760 tx=0x7fe6f4009060).ready entity=mon.0 client_cookie=37bfcd8b43a0894f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4009120 con 0x7fe70c0c7ad0 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f400d4a0 con 0x7fe70c0c7ad0 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe70b7fe700 1 -- 172.21.15.153:0/720172127 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f400d820 con 0x7fe70c0c7ad0 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 -- 172.21.15.153:0/720172127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0c7ad0 msgr2=0x7fe70c0a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 --2- 172.21.15.153:0/720172127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0c7ad0 0x7fe70c0a9fc0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 rx=0x7fe6f4009760 tx=0x7fe6f4009060).stop 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 -- 172.21.15.153:0/720172127 shutdown_connections 2023-08-17T00:16:27.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 --2- 172.21.15.153:0/720172127 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0c7ad0 0x7fe70c0a9fc0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 -- 172.21.15.153:0/720172127 >> 172.21.15.153:0/720172127 conn(0x7fe70c061fa0 msgr2=0x7fe70c062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:27.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 -- 172.21.15.153:0/720172127 shutdown_connections 2023-08-17T00:16:27.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.892+0000 7fe71281b700 1 -- 172.21.15.153:0/720172127 wait complete. 2023-08-17T00:16:27.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 Processor -- start 2023-08-17T00:16:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 -- start start 2023-08-17T00:16:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 0x7fe70c164060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c7ad0 0x7fe70c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c158190 0x7fe70c0ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:27.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b0a10 con 0x7fe70c0a9be0 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0af1d0 con 0x7fe70c158190 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0c2be0 con 0x7fe70c0c7ad0 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 0x7fe70c164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 0x7fe70c164060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60336/0 (socket says 172.21.15.153:60336) 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 -- 172.21.15.153:0/1077315598 learned_addr learned my addr 172.21.15.153:0/1077315598 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe710db8700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c158190 0x7fe70c0ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe703fff700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c7ad0 0x7fe70c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:27.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 -- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c7ad0 msgr2=0x7fe70c152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c7ad0 0x7fe70c152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 -- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c158190 msgr2=0x7fe70c0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c158190 0x7fe70c0ae710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:27.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 -- 172.21.15.153:0/1077315598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f40092a0 con 0x7fe70c0a9be0 2023-08-17T00:16:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe70bfff700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 0x7fe70c164060 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7fe6fc00c490 tx=0x7fe6fc007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00ce40 con 0x7fe70c0a9be0 2023-08-17T00:16:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00f470 con 0x7fe70c0a9be0 2023-08-17T00:16:27.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c0c2ec0 con 0x7fe70c0a9be0 2023-08-17T00:16:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00f810 con 0x7fe70c0a9be0 2023-08-17T00:16:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.896+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c0c3480 con 0x7fe70c0a9be0 2023-08-17T00:16:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.900+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c06b530 con 0x7fe70c0a9be0 2023-08-17T00:16:27.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.900+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe6fc019030 con 0x7fe70c0a9be0 2023-08-17T00:16:27.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.904+0000 7fe708ff9700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe6ec05a150 0x7fe6ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.904+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5769+0+0 (secure 0 0 0) 0x7fe6fc073480 con 0x7fe70c0a9be0 2023-08-17T00:16:27.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.904+0000 7fe703fff700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe6ec05a150 0x7fe6ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:27.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.904+0000 7fe703fff700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe6ec05a150 0x7fe6ec05c610 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fe70c0c7ed0 tx=0x7fe6f4016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:27.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:27.908+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe6fc046f80 con 0x7fe70c0a9be0 2023-08-17T00:16:28.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.064+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe70c158600 con 0x7fe70c0a9be0 2023-08-17T00:16:28.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.696+0000 7fe708ff9700 1 -- 172.21.15.153:0/1077315598 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v169) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe6fc04a5a0 con 0x7fe70c0a9be0 2023-08-17T00:16:28.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe6ec05a150 msgr2=0x7fe6ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe6ec05a150 0x7fe6ec05c610 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 rx=0x7fe70c0c7ed0 tx=0x7fe6f4016000).stop 2023-08-17T00:16:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 msgr2=0x7fe70c164060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:28.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 0x7fe70c164060 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 rx=0x7fe6fc00c490 tx=0x7fe6fc007c90).stop 2023-08-17T00:16:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 shutdown_connections 2023-08-17T00:16:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe6ec05a150 0x7fe6ec05c610 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe70c158190 0x7fe70c0ae710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe70c0c7ad0 0x7fe70c152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 --2- 172.21.15.153:0/1077315598 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe70c0a9be0 0x7fe70c164060 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 >> 172.21.15.153:0/1077315598 conn(0x7fe70c061fa0 msgr2=0x7fe70c063470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 shutdown_connections 2023-08-17T00:16:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.704+0000 7fe71281b700 1 -- 172.21.15.153:0/1077315598 wait complete. 2023-08-17T00:16:28.712 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:16:28.730 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:16:28.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.888+0000 7fe76759e700 1 Processor -- start 2023-08-17T00:16:28.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.892+0000 7fe76759e700 1 -- start start 2023-08-17T00:16:28.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe7680c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe768153f50 0x7fe768154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe768157600 0x7fe768157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7680bfd10 con 0x7fe768153f50 2023-08-17T00:16:28.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe768154860 con 0x7fe768157600 2023-08-17T00:16:28.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe768154af0 con 0x7fe7680c57a0 2023-08-17T00:16:28.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe768153f50 0x7fe768154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe768153f50 0x7fe768154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60352/0 (socket says 172.21.15.153:60352) 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 -- 172.21.15.153:0/3130506562 learned_addr learned my addr 172.21.15.153:0/3130506562 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe766d9d700 1 --2- 172.21.15.153:0/3130506562 >> v2:172.21.15.178:3300/0 conn(0x7fe768157600 0x7fe768157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76659c700 1 --2- 172.21.15.153:0/3130506562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe7680c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 -- 172.21.15.153:0/3130506562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 msgr2=0x7fe7680c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 --2- 172.21.15.153:0/3130506562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe7680c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 -- 172.21.15.153:0/3130506562 >> v2:172.21.15.178:3300/0 conn(0x7fe768157600 msgr2=0x7fe768157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 --2- 172.21.15.153:0/3130506562 >> v2:172.21.15.178:3300/0 conn(0x7fe768157600 0x7fe768157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 -- 172.21.15.153:0/3130506562 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe768154dd0 con 0x7fe768153f50 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe765d9b700 1 --2- 172.21.15.153:0/3130506562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe768154370 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fe7680840c0 tx=0x7fe75c0090f0).ready entity=mon.0 client_cookie=cd5408e8dadd3175 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76559a700 1 -- 172.21.15.153:0/3130506562 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c00b520 con 0x7fe768153f50 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76559a700 1 -- 172.21.15.153:0/3130506562 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c00b680 con 0x7fe768153f50 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76559a700 1 -- 172.21.15.153:0/3130506562 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c00ba00 con 0x7fe768153f50 2023-08-17T00:16:28.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- 172.21.15.153:0/3130506562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 msgr2=0x7fe768154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- 172.21.15.153:0/3130506562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe768154370 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 rx=0x7fe7680840c0 tx=0x7fe75c0090f0).stop 2023-08-17T00:16:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- 172.21.15.153:0/3130506562 shutdown_connections 2023-08-17T00:16:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- 172.21.15.153:0/3130506562 >> v2:172.21.15.178:3300/0 conn(0x7fe768157600 0x7fe768157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- 172.21.15.153:0/3130506562 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe768154370 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 --2- 172.21.15.153:0/3130506562 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe7680c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- 172.21.15.153:0/3130506562 >> 172.21.15.153:0/3130506562 conn(0x7fe768062a70 msgr2=0x7fe7680ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- 172.21.15.153:0/3130506562 shutdown_connections 2023-08-17T00:16:28.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.896+0000 7fe76759e700 1 -- 172.21.15.153:0/3130506562 wait complete. 2023-08-17T00:16:28.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 Processor -- start 2023-08-17T00:16:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 -- start start 2023-08-17T00:16:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe768151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe7680ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe768157600 0x7fe7680acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680c7e80 con 0x7fe768153f50 2023-08-17T00:16:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7680ad080 con 0x7fe768157600 2023-08-17T00:16:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76816c2f0 con 0x7fe7680c57a0 2023-08-17T00:16:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe7680ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe7680ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60366/0 (socket says 172.21.15.153:60366) 2023-08-17T00:16:28.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 -- 172.21.15.153:0/298727715 learned_addr learned my addr 172.21.15.153:0/298727715 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe766d9d700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe768157600 0x7fe7680acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76659c700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe768151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 -- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 msgr2=0x7fe768151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe768151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 -- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe768157600 msgr2=0x7fe7680acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:28.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe768157600 0x7fe7680acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 -- 172.21.15.153:0/298727715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c009370 con 0x7fe768153f50 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe76659c700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe768151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.900+0000 7fe765d9b700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe7680ac6a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fe75c011000 tx=0x7fe75c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c00b7f0 con 0x7fe768153f50 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c00b950 con 0x7fe768153f50 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76816cb50 con 0x7fe768153f50 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe75c01b660 con 0x7fe768153f50 2023-08-17T00:16:28.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76816c500 con 0x7fe768153f50 2023-08-17T00:16:28.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7680aa050 con 0x7fe768153f50 2023-08-17T00:16:28.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.904+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe75c02b070 con 0x7fe768153f50 2023-08-17T00:16:28.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.908+0000 7fe7567fc700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe74805a150 0x7fe74805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:28.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.908+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe75c0755d0 con 0x7fe768153f50 2023-08-17T00:16:28.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.908+0000 7fe76659c700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe74805a150 0x7fe74805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:28.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.908+0000 7fe76659c700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe74805a150 0x7fe74805c610 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fe758009810 tx=0x7fe758008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:28.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:28.912+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe7680aa050 con 0x7fe768153f50 2023-08-17T00:16:29.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.072+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe76806a210 con 0x7fe768153f50 2023-08-17T00:16:29.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.080+0000 7fe7567fc700 1 -- 172.21.15.153:0/298727715 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe76806a210 con 0x7fe768153f50 2023-08-17T00:16:29.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe74805a150 msgr2=0x7fe74805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe74805a150 0x7fe74805c610 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 rx=0x7fe758009810 tx=0x7fe758008040).stop 2023-08-17T00:16:29.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 msgr2=0x7fe7680ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe7680ac6a0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 rx=0x7fe75c011000 tx=0x7fe75c017000).stop 2023-08-17T00:16:29.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 shutdown_connections 2023-08-17T00:16:29.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe74805a150 0x7fe74805c610 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe768157600 0x7fe7680acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe768153f50 0x7fe7680ac6a0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 --2- 172.21.15.153:0/298727715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7680c57a0 0x7fe768151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 >> 172.21.15.153:0/298727715 conn(0x7fe768062a70 msgr2=0x7fe7681521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:29.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 shutdown_connections 2023-08-17T00:16:29.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.084+0000 7fe76759e700 1 -- 172.21.15.153:0/298727715 wait complete. 2023-08-17T00:16:29.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2023-08-17T00:16:29.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.256+0000 7f11ad079700 1 Processor -- start 2023-08-17T00:16:29.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.256+0000 7f11ad079700 1 -- start start 2023-08-17T00:16:29.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11ad079700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11a80aa8c0 0x7f11a8068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11ad079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11ad079700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a80ab9b0 con 0x7f11a8150880 2023-08-17T00:16:29.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11ad079700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a80691a0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11ad079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a80a9080 con 0x7f11a8068d10 2023-08-17T00:16:29.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11a80aa8c0 0x7f11a8068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11a80aa8c0 0x7f11a8068820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:46768/0 (socket says 172.21.15.153:46768) 2023-08-17T00:16:29.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 -- 172.21.15.153:0/2752628369 learned_addr learned my addr 172.21.15.153:0/2752628369 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:29.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11ac878700 1 --2- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 -- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 msgr2=0x7f11a8064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:29.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 --2- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8064670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 -- 172.21.15.153:0/2752628369 >> v1:172.21.15.178:6789/0 conn(0x7f11a8150880 legacy=0x7f11a80a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 -- 172.21.15.153:0/2752628369 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a80aada0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a77fe700 1 --2- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a80aa8c0 0x7f11a8068820 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f119c006fd0 tx=0x7f119c0090f0).ready entity=mon.1 client_cookie=3762399645dd651d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:29.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.260+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2752628369 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00f6b0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2752628369 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00f810 con 0x7f11a80aa8c0 2023-08-17T00:16:29.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11a6ffd700 1 -- 172.21.15.153:0/2752628369 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00fbb0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 -- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a80aa8c0 msgr2=0x7f11a8068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 --2- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a80aa8c0 0x7f11a8068820 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f119c006fd0 tx=0x7f119c0090f0).stop 2023-08-17T00:16:29.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 -- 172.21.15.153:0/2752628369 shutdown_connections 2023-08-17T00:16:29.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 --2- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8064670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 --2- 172.21.15.153:0/2752628369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a80aa8c0 0x7f11a8068820 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 -- 172.21.15.153:0/2752628369 >> 172.21.15.153:0/2752628369 conn(0x7f11a80c6620 msgr2=0x7f11a80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 -- 172.21.15.153:0/2752628369 shutdown_connections 2023-08-17T00:16:29.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.264+0000 7f11ad079700 1 -- 172.21.15.153:0/2752628369 wait complete. 2023-08-17T00:16:29.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 Processor -- start 2023-08-17T00:16:29.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 -- start start 2023-08-17T00:16:29.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 0x7f11a81447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a8150880 0x7f11a8144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8151380 con 0x7f11a80aa8c0 2023-08-17T00:16:29.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a81451a0 con 0x7f11a8150880 2023-08-17T00:16:29.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ad079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8150d00 con 0x7f11a8068d10 2023-08-17T00:16:29.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 0x7f11a81447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 0x7f11a81447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60370/0 (socket says 172.21.15.153:60370) 2023-08-17T00:16:29.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 -- 172.21.15.153:0/1329319274 learned_addr learned my addr 172.21.15.153:0/1329319274 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:29.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a7fff700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ac878700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a8150880 0x7f11a8144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 -- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 msgr2=0x7f11a8147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 -- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a8150880 msgr2=0x7f11a8144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a8150880 0x7f11a8144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a77fe700 1 -- 172.21.15.153:0/1329319274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c009370 con 0x7f11a80aa8c0 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11a7fff700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:29.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.268+0000 7f11ac878700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a8150880 0x7f11a8144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:29.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f11a77fe700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 0x7f11a81447c0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f119c009ea0 tx=0x7f119c019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:29.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00fb90 con 0x7f11a80aa8c0 2023-08-17T00:16:29.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a80bec50 con 0x7f11a80aa8c0 2023-08-17T00:16:29.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00e1d0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c019680 con 0x7f11a80aa8c0 2023-08-17T00:16:29.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a80bef30 con 0x7f11a80aa8c0 2023-08-17T00:16:29.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a81514c0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.272+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f119c016030 con 0x7f11a80aa8c0 2023-08-17T00:16:29.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.276+0000 7f118ffff700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119405a150 0x7f119405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.276+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f119c075480 con 0x7f11a80aa8c0 2023-08-17T00:16:29.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.276+0000 7f11a7fff700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119405a150 0x7f119405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.276+0000 7f11a7fff700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119405a150 0x7f119405c610 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f1198007fd0 tx=0x7f1198009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:29.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.280+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f11a81514c0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.496+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) v1 -- 0x7f11a81514c0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.704+0000 7f118ffff700 1 -- 172.21.15.153:0/1329319274 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v633) v1 ==== 133+0+0 (secure 0 0 0) 0x7f11a81514c0 con 0x7f11a80aa8c0 2023-08-17T00:16:29.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119405a150 msgr2=0x7f119405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119405a150 0x7f119405c610 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 rx=0x7f1198007fd0 tx=0x7f1198009040).stop 2023-08-17T00:16:29.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 msgr2=0x7f11a81447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 0x7f11a81447c0 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 rx=0x7f119c009ea0 tx=0x7f119c019000).stop 2023-08-17T00:16:29.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 shutdown_connections 2023-08-17T00:16:29.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f119405a150 0x7f119405c610 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11a8150880 0x7f11a8144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f11a80aa8c0 0x7f11a81447c0 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 --2- 172.21.15.153:0/1329319274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11a8068d10 0x7f11a8147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 >> 172.21.15.153:0/1329319274 conn(0x7f11a80c6620 msgr2=0x7f11a80656a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:29.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 shutdown_connections 2023-08-17T00:16:29.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.708+0000 7f11ad079700 1 -- 172.21.15.153:0/1329319274 wait complete. 2023-08-17T00:16:29.738 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-08-17T00:16:29.739 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2023-08-17T00:16:29.739 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2023-08-17T00:16:29.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1412107700 1 Processor -- start 2023-08-17T00:16:29.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1412107700 1 -- start start 2023-08-17T00:16:29.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1412107700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f140c0c5ea0 0x7f140c0634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1412107700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c154e90 con 0x7f140c0639a0 2023-08-17T00:16:29.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1412107700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f140c153fc0 con 0x7f140c0acf30 2023-08-17T00:16:29.903 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1412107700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140c0c1730 con 0x7f140c0c5ea0 2023-08-17T00:16:29.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1411906700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f140c0639a0 0x7f140c0bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55930/0 (socket says 172.21.15.153:55930) 2023-08-17T00:16:29.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1411906700 1 -- 172.21.15.153:0/1962260673 learned_addr learned my addr 172.21.15.153:0/1962260673 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:29.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1410904700 1 --2- 172.21.15.153:0/1962260673 >> v2:172.21.15.178:3300/0 conn(0x7f140c0c5ea0 0x7f140c0634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1403fff700 1 -- 172.21.15.153:0/1962260673 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392982060 0 0) 0x7f140c154e90 con 0x7f140c0639a0 2023-08-17T00:16:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1403fff700 1 -- 172.21.15.153:0/1962260673 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f80033f0 con 0x7f140c0639a0 2023-08-17T00:16:29.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1410904700 1 -- 172.21.15.153:0/1962260673 >> v1:172.21.15.178:6789/0 conn(0x7f140c0acf30 legacy=0x7f140c0c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1410904700 1 -- 172.21.15.153:0/1962260673 >> v1:172.21.15.153:6789/0 conn(0x7f140c0639a0 legacy=0x7f140c0bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1410904700 1 -- 172.21.15.153:0/1962260673 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c154280 con 0x7f140c0c5ea0 2023-08-17T00:16:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.896+0000 7f1410904700 1 --2- 172.21.15.153:0/1962260673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c5ea0 0x7f140c0634b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f13fc009760 tx=0x7f13fc009060).ready entity=mon.1 client_cookie=63452b0e97088bc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1403fff700 1 -- 172.21.15.153:0/1962260673 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00f510 con 0x7f140c0c5ea0 2023-08-17T00:16:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1403fff700 1 -- 172.21.15.153:0/1962260673 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00f670 con 0x7f140c0c5ea0 2023-08-17T00:16:29.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1403fff700 1 -- 172.21.15.153:0/1962260673 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00f9f0 con 0x7f140c0c5ea0 2023-08-17T00:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 -- 172.21.15.153:0/1962260673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c5ea0 msgr2=0x7f140c0634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 --2- 172.21.15.153:0/1962260673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c5ea0 0x7f140c0634b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f13fc009760 tx=0x7f13fc009060).stop 2023-08-17T00:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 -- 172.21.15.153:0/1962260673 shutdown_connections 2023-08-17T00:16:29.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 --2- 172.21.15.153:0/1962260673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c5ea0 0x7f140c0634b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 -- 172.21.15.153:0/1962260673 >> 172.21.15.153:0/1962260673 conn(0x7f140c0cb330 msgr2=0x7f140c0c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 -- 172.21.15.153:0/1962260673 shutdown_connections 2023-08-17T00:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 -- 172.21.15.153:0/1962260673 wait complete. 2023-08-17T00:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 Processor -- start 2023-08-17T00:16:29.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.900+0000 7f1412107700 1 -- start start 2023-08-17T00:16:29.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c0639a0 0x7f140c150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f140c0acf30 0x7f140c0c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c9130 0x7f140c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0c32c0 con 0x7f140c0639a0 2023-08-17T00:16:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0c35a0 con 0x7f140c0c9130 2023-08-17T00:16:29.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140c0c3880 con 0x7f140c0acf30 2023-08-17T00:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1411105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c0639a0 0x7f140c150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1411105700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c0639a0 0x7f140c150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60372/0 (socket says 172.21.15.153:60372) 2023-08-17T00:16:29.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f140c0acf30 0x7f140c0c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1411105700 1 -- 172.21.15.153:0/1114921551 learned_addr learned my addr 172.21.15.153:0/1114921551 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:29.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1411906700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c9130 0x7f140c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 -- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c9130 msgr2=0x7f140c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c9130 0x7f140c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 -- 172.21.15.153:0/1114921551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c0639a0 msgr2=0x7f140c150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c0639a0 0x7f140c150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 -- 172.21.15.153:0/1114921551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc0092a0 con 0x7f140c0acf30 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1410904700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f140c0acf30 0x7f140c0c2970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f13fc014000 tx=0x7f13fc017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc00f7e0 con 0x7f140c0acf30 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc00f940 con 0x7f140c0acf30 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140c0c3b60 con 0x7f140c0acf30 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc01b690 con 0x7f140c0acf30 2023-08-17T00:16:29.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.904+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140c150ac0 con 0x7f140c0acf30 2023-08-17T00:16:29.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.908+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f140c06b4c0 con 0x7f140c0acf30 2023-08-17T00:16:29.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.908+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f13fc02a070 con 0x7f140c0acf30 2023-08-17T00:16:29.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.908+0000 7f14017fa700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13f005a150 0x7f13f005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:29.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.908+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f13fc075340 con 0x7f140c0acf30 2023-08-17T00:16:29.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.912+0000 7f1411105700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13f005a150 0x7f13f005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:29.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.912+0000 7f1411105700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13f005a150 0x7f13f005c610 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f14080039c0 tx=0x7f1408007e00).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:29.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:29.916+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f13fc048fe0 con 0x7f140c0acf30 2023-08-17T00:16:30.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.140+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) v1 -- 0x7f140c0c3cf0 con 0x7f140c0acf30 2023-08-17T00:16:30.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.712+0000 7f14017fa700 1 -- 172.21.15.153:0/1114921551 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v634) v1 ==== 150+0+0 (secure 0 0 0) 0x7f13fc0280d0 con 0x7f140c0acf30 2023-08-17T00:16:30.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13f005a150 msgr2=0x7f13f005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13f005a150 0x7f13f005c610 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f14080039c0 tx=0x7f1408007e00).stop 2023-08-17T00:16:30.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f140c0acf30 msgr2=0x7f140c0c2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f140c0acf30 0x7f140c0c2970 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f13fc014000 tx=0x7f13fc017000).stop 2023-08-17T00:16:30.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 shutdown_connections 2023-08-17T00:16:30.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f13f005a150 0x7f13f005c610 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f140c0c9130 0x7f140c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f140c0acf30 0x7f140c0c2970 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 --2- 172.21.15.153:0/1114921551 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f140c0639a0 0x7f140c150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 >> 172.21.15.153:0/1114921551 conn(0x7f140c0cb330 msgr2=0x7f140c1522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 shutdown_connections 2023-08-17T00:16:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.716+0000 7f1412107700 1 -- 172.21.15.153:0/1114921551 wait complete. 2023-08-17T00:16:30.745 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:16:30.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.904+0000 7f9af6df9700 1 Processor -- start 2023-08-17T00:16:30.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.904+0000 7f9af6df9700 1 -- start start 2023-08-17T00:16:30.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af6df9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9af00bcba0 0x7f9af00c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:30.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af6df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af0062d50 con 0x7f9af01395b0 2023-08-17T00:16:30.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af6df9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af0062140 con 0x7f9af0139990 2023-08-17T00:16:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af6df9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af0062420 con 0x7f9af00bcba0 2023-08-17T00:16:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af5df7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9af01395b0 0x7f9af00bc490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55936/0 (socket says 172.21.15.153:55936) 2023-08-17T00:16:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af5df7700 1 -- 172.21.15.153:0/2481298227 learned_addr learned my addr 172.21.15.153:0/2481298227 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:30.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af65f8700 1 --2- 172.21.15.153:0/2481298227 >> v2:172.21.15.178:3300/0 conn(0x7f9af00bcba0 0x7f9af00c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:30.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af4df5700 1 -- 172.21.15.153:0/2481298227 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167903592 0 0) 0x7f9af0062d50 con 0x7f9af01395b0 2023-08-17T00:16:30.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.908+0000 7f9af4df5700 1 -- 172.21.15.153:0/2481298227 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9adc004500 con 0x7f9af01395b0 2023-08-17T00:16:30.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af65f8700 1 -- 172.21.15.153:0/2481298227 >> v1:172.21.15.178:6789/0 conn(0x7f9af0139990 legacy=0x7f9af0157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af65f8700 1 -- 172.21.15.153:0/2481298227 >> v1:172.21.15.153:6789/0 conn(0x7f9af01395b0 legacy=0x7f9af00bc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af65f8700 1 -- 172.21.15.153:0/2481298227 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0062700 con 0x7f9af00bcba0 2023-08-17T00:16:30.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af65f8700 1 --2- 172.21.15.153:0/2481298227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af00bcba0 0x7f9af00c2aa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f9ae8009e60 tx=0x7f9ae8009780).ready entity=mon.1 client_cookie=c709092b2851042 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:30.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af4df5700 1 -- 172.21.15.153:0/2481298227 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800bb60 con 0x7f9af00bcba0 2023-08-17T00:16:30.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af4df5700 1 -- 172.21.15.153:0/2481298227 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800bcc0 con 0x7f9af00bcba0 2023-08-17T00:16:30.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af4df5700 1 -- 172.21.15.153:0/2481298227 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8011690 con 0x7f9af00bcba0 2023-08-17T00:16:30.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 -- 172.21.15.153:0/2481298227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af00bcba0 msgr2=0x7f9af00c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 --2- 172.21.15.153:0/2481298227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af00bcba0 0x7f9af00c2aa0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f9ae8009e60 tx=0x7f9ae8009780).stop 2023-08-17T00:16:30.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 -- 172.21.15.153:0/2481298227 shutdown_connections 2023-08-17T00:16:30.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 --2- 172.21.15.153:0/2481298227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af00bcba0 0x7f9af00c2aa0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 -- 172.21.15.153:0/2481298227 >> 172.21.15.153:0/2481298227 conn(0x7f9af00c7470 msgr2=0x7f9af00c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:30.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 -- 172.21.15.153:0/2481298227 shutdown_connections 2023-08-17T00:16:30.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.912+0000 7f9af6df9700 1 -- 172.21.15.153:0/2481298227 wait complete. 2023-08-17T00:16:30.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 Processor -- start 2023-08-17T00:16:30.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 -- start start 2023-08-17T00:16:30.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 0x7f9af015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:30.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af01395b0 0x7f9af014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:30.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af0139990 0x7f9af00a86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:30.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00aa620 con 0x7f9af00bcba0 2023-08-17T00:16:30.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00a9a10 con 0x7f9af01395b0 2023-08-17T00:16:30.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af6df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00a9cf0 con 0x7f9af0139990 2023-08-17T00:16:30.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 0x7f9af015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:30.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 0x7f9af015fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60384/0 (socket says 172.21.15.153:60384) 2023-08-17T00:16:30.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 -- 172.21.15.153:0/4262889142 learned_addr learned my addr 172.21.15.153:0/4262889142 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:30.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af65f8700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af0139990 0x7f9af00a86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:30.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af55f6700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af01395b0 0x7f9af014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 -- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af0139990 msgr2=0x7f9af00a86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af0139990 0x7f9af00a86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 -- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af01395b0 msgr2=0x7f9af014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af01395b0 0x7f9af014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 -- 172.21.15.153:0/4262889142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009a20 con 0x7f9af00bcba0 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af55f6700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af01395b0 0x7f9af014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:30.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.916+0000 7f9af5df7700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 0x7f9af015fb00 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f9aec00c590 tx=0x7f9aec007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec007e40 con 0x7f9af00bcba0 2023-08-17T00:16:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec0072e0 con 0x7f9af00bcba0 2023-08-17T00:16:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0057a0 con 0x7f9af00bcba0 2023-08-17T00:16:30.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af00a9fd0 con 0x7f9af00bcba0 2023-08-17T00:16:30.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af015fff0 con 0x7f9af00bcba0 2023-08-17T00:16:30.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af006b4c0 con 0x7f9af00bcba0 2023-08-17T00:16:30.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.920+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9aec010070 con 0x7f9af00bcba0 2023-08-17T00:16:30.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.924+0000 7f9ae5ffb700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad405a180 0x7f9ad405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:30.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.924+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f9aec073550 con 0x7f9af00bcba0 2023-08-17T00:16:30.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.924+0000 7f9af55f6700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad405a180 0x7f9ad405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:30.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.924+0000 7f9af55f6700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad405a180 0x7f9ad405c640 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f9af0134630 tx=0x7f9ae0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:30.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:30.928+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9aec0471f0 con 0x7f9af00bcba0 2023-08-17T00:16:31.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.092+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9af00629e0 con 0x7f9af00bcba0 2023-08-17T00:16:31.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.104+0000 7f9ae5ffb700 1 -- 172.21.15.153:0/4262889142 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9aec04a810 con 0x7f9af00bcba0 2023-08-17T00:16:31.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.104+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad405a180 msgr2=0x7f9ad405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.104+0000 7f9af6df9700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad405a180 0x7f9ad405c640 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f9af0134630 tx=0x7f9ae0009040).stop 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.104+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 msgr2=0x7f9af015fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.104+0000 7f9af6df9700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 0x7f9af015fb00 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 rx=0x7f9aec00c590 tx=0x7f9aec007c80).stop 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 shutdown_connections 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9ad405a180 0x7f9ad405c640 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9af0139990 0x7f9af00a86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9af01395b0 0x7f9af014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 --2- 172.21.15.153:0/4262889142 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9af00bcba0 0x7f9af015fb00 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 >> 172.21.15.153:0/4262889142 conn(0x7f9af00c7470 msgr2=0x7f9af00c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:31.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 shutdown_connections 2023-08-17T00:16:31.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.108+0000 7f9af6df9700 1 -- 172.21.15.153:0/4262889142 wait complete. 2023-08-17T00:16:31.134 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:16:31.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:31.179 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:31.220 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:16:31.221 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:16:31.222 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:31.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.380+0000 7f3ec7507700 1 Processor -- start 2023-08-17T00:16:31.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.380+0000 7f3ec7507700 1 -- start start 2023-08-17T00:16:31.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec7507700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ec0068da0 0x7f3ec01560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec7507700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec0065da0 con 0x7f3ec0151530 2023-08-17T00:16:31.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec7507700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec0155c60 con 0x7f3ec00689c0 2023-08-17T00:16:31.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec7507700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec0069200 con 0x7f3ec0068da0 2023-08-17T00:16:31.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5d04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3ec0068da0 0x7f3ec01560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec6d06700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3ec0151530 0x7f3ec01519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55938/0 (socket says 172.21.15.153:55938) 2023-08-17T00:16:31.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec6d06700 1 -- 172.21.15.153:0/3330369585 learned_addr learned my addr 172.21.15.153:0/3330369585 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:31.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5d04700 1 -- 172.21.15.153:0/3330369585 >> v1:172.21.15.178:6789/0 conn(0x7f3ec00689c0 legacy=0x7f3ec00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5d04700 1 -- 172.21.15.153:0/3330369585 >> v1:172.21.15.153:6789/0 conn(0x7f3ec0151530 legacy=0x7f3ec01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5d04700 1 -- 172.21.15.153:0/3330369585 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0065ff0 con 0x7f3ec0068da0 2023-08-17T00:16:31.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5d04700 1 --2- 172.21.15.153:0/3330369585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec01560f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f3eb0009760 tx=0x7f3eb0009060).ready entity=mon.0 client_cookie=9b309584b890b22d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:31.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5503700 1 -- 172.21.15.153:0/3330369585 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0009120 con 0x7f3ec0068da0 2023-08-17T00:16:31.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5503700 1 -- 172.21.15.153:0/3330369585 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000b580 con 0x7f3ec0068da0 2023-08-17T00:16:31.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.384+0000 7f3ec5503700 1 -- 172.21.15.153:0/3330369585 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb000b900 con 0x7f3ec0068da0 2023-08-17T00:16:31.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 -- 172.21.15.153:0/3330369585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 msgr2=0x7f3ec01560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 --2- 172.21.15.153:0/3330369585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec01560f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 rx=0x7f3eb0009760 tx=0x7f3eb0009060).stop 2023-08-17T00:16:31.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 -- 172.21.15.153:0/3330369585 shutdown_connections 2023-08-17T00:16:31.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 --2- 172.21.15.153:0/3330369585 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec01560f0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 -- 172.21.15.153:0/3330369585 >> 172.21.15.153:0/3330369585 conn(0x7f3ec00c6620 msgr2=0x7f3ec00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:31.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 -- 172.21.15.153:0/3330369585 shutdown_connections 2023-08-17T00:16:31.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.388+0000 7f3ec7507700 1 -- 172.21.15.153:0/3330369585 wait complete. 2023-08-17T00:16:31.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 Processor -- start 2023-08-17T00:16:31.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 -- start start 2023-08-17T00:16:31.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec00689c0 0x7f3ec00bf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec00a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec0151530 0x7f3ec00a68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00a5600 con 0x7f3ec0068da0 2023-08-17T00:16:31.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00a4280 con 0x7f3ec00689c0 2023-08-17T00:16:31.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec00a4560 con 0x7f3ec0151530 2023-08-17T00:16:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec00a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec00a6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60396/0 (socket says 172.21.15.153:60396) 2023-08-17T00:16:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 -- 172.21.15.153:0/795543737 learned_addr learned my addr 172.21.15.153:0/795543737 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec6d06700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec0151530 0x7f3ec00a68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec6505700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec00689c0 0x7f3ec00bf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 -- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec0151530 msgr2=0x7f3ec00a68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec0151530 0x7f3ec00a68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 -- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec00689c0 msgr2=0x7f3ec00bf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec00689c0 0x7f3ec00bf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 -- 172.21.15.153:0/795543737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb00092a0 con 0x7f3ec0068da0 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec5d04700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec00a6400 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f3eb0009eb0 tx=0x7f3eb0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:31.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0006910 con 0x7f3ec0068da0 2023-08-17T00:16:31.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb000b6f0 con 0x7f3ec0068da0 2023-08-17T00:16:31.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb001b440 con 0x7f3ec0068da0 2023-08-17T00:16:31.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.392+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec00a4840 con 0x7f3ec0068da0 2023-08-17T00:16:31.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.396+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec00a4e00 con 0x7f3ec0068da0 2023-08-17T00:16:31.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.396+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec00a8580 con 0x7f3ec0068da0 2023-08-17T00:16:31.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.396+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3eb000f070 con 0x7f3ec0068da0 2023-08-17T00:16:31.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.396+0000 7f3eb67fc700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ea405a150 0x7f3ea405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.396+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3eb0075540 con 0x7f3ec0068da0 2023-08-17T00:16:31.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.400+0000 7f3ec6505700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ea405a150 0x7f3ea405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.400+0000 7f3ec6505700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ea405a150 0x7f3ea405c610 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f3ebc007fd0 tx=0x7f3ebc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:31.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.404+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3ec00a8580 con 0x7f3ec0068da0 2023-08-17T00:16:31.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.596+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3ec006b4c0 con 0x7f3ec0068da0 2023-08-17T00:16:31.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3eb67fc700 1 -- 172.21.15.153:0/795543737 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 132 v132) v1 ==== 95+0+3543 (secure 0 0 0) 0x7f3eb00492f0 con 0x7f3ec0068da0 2023-08-17T00:16:31.605 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:31.606 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":132,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3088141697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6836","nonce":3088141697},{"type":"v1","addr":"172.21.15.178:6837","nonce":3088141697}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":8950,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6835/2651597723","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2651597723},{"type":"v1","addr":"172.21.15.178:6835","nonce":2651597723}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9387,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/632352801","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":632352801},{"type":"v1","addr":"172.21.15.153:6834","nonce":632352801}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":125},{"gid":9726,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/3628375001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":3628375001},{"type":"v1","addr":"172.21.15.153:6835","nonce":3628375001}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":132}],"filesystems":[]} 2023-08-17T00:16:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ea405a150 msgr2=0x7f3ea405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ea405a150 0x7f3ea405c610 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7f3ebc007fd0 tx=0x7f3ebc009040).stop 2023-08-17T00:16:31.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 msgr2=0x7f3ec00a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec00a6400 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 rx=0x7f3eb0009eb0 tx=0x7f3eb0017000).stop 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 shutdown_connections 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ea405a150 0x7f3ea405c610 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3ec0151530 0x7f3ec00a68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3ec0068da0 0x7f3ec00a6400 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 --2- 172.21.15.153:0/795543737 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3ec00689c0 0x7f3ec00bf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 >> 172.21.15.153:0/795543737 conn(0x7f3ec00c6620 msgr2=0x7f3ec00c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:31.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 shutdown_connections 2023-08-17T00:16:31.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.600+0000 7f3ec7507700 1 -- 172.21.15.153:0/795543737 wait complete. 2023-08-17T00:16:31.610 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 132 2023-08-17T00:16:31.628 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:16:31.628 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:16:31.628 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:16:31.628 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:31.629 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:16:31.629 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:16:31.629 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:16:31.629 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:31.630 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:16:31.630 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:16:31.630 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:16:31.630 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:31.630 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:16:31.631 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:16:31.631 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:16:31.631 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:31.650 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:16:31.650 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:16:31.651 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:16:31.651 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:16:31.657 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:16:31.657 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:16:31.658 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:16:31.658 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:16:31.703 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:16:31.704 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:31.709 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:16:31.709 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:31.711 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:16:31.711 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:31.714 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:16:31.715 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:31.715 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:16:31.807 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:16:31.809 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:16:31.819 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:16:31.822 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:16:31.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.860+0000 7f10196e4700 1 Processor -- start 2023-08-17T00:16:31.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.860+0000 7f10196e4700 1 -- start start 2023-08-17T00:16:31.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f10196e4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1014150880 0x7f10140a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f10196e4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1014068f30 0x7f1014064670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f10196e4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10140ab9b0 con 0x7f10140a8e60 2023-08-17T00:16:31.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f10196e4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140aada0 con 0x7f1014068f30 2023-08-17T00:16:31.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f10196e4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10140ab080 con 0x7f1014150880 2023-08-17T00:16:31.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1014068f30 0x7f1014064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1014068f30 0x7f1014064670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60426/0 (socket says 172.21.15.153:60426) 2023-08-17T00:16:31.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 -- 172.21.15.153:0/2201322026 learned_addr learned my addr 172.21.15.153:0/2201322026 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:31.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1013fff700 1 --2- 172.21.15.153:0/2201322026 >> v2:172.21.15.178:3300/0 conn(0x7f1014150880 0x7f10140a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 -- 172.21.15.153:0/2201322026 >> v2:172.21.15.178:3300/0 conn(0x7f1014150880 msgr2=0x7f10140a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:31.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 --2- 172.21.15.153:0/2201322026 >> v2:172.21.15.178:3300/0 conn(0x7f1014150880 0x7f10140a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 -- 172.21.15.153:0/2201322026 >> v1:172.21.15.178:6789/0 conn(0x7f10140a8e60 legacy=0x7f1014068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.864+0000 7f1018ee3700 1 -- 172.21.15.153:0/2201322026 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10140ab360 con 0x7f1014068f30 2023-08-17T00:16:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f1018ee3700 1 --2- 172.21.15.153:0/2201322026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1014068f30 0x7f1014064670 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f1014066830 tx=0x7f100c009840).ready entity=mon.0 client_cookie=6d2a002c8c3c8a95 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10137fe700 1 -- 172.21.15.153:0/2201322026 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c00ba50 con 0x7f1014068f30 2023-08-17T00:16:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10137fe700 1 -- 172.21.15.153:0/2201322026 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100c00bbb0 con 0x7f1014068f30 2023-08-17T00:16:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10137fe700 1 -- 172.21.15.153:0/2201322026 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f100c011480 con 0x7f1014068f30 2023-08-17T00:16:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 -- 172.21.15.153:0/2201322026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1014068f30 msgr2=0x7f1014064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 --2- 172.21.15.153:0/2201322026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1014068f30 0x7f1014064670 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 rx=0x7f1014066830 tx=0x7f100c009840).stop 2023-08-17T00:16:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 -- 172.21.15.153:0/2201322026 shutdown_connections 2023-08-17T00:16:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 --2- 172.21.15.153:0/2201322026 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1014068f30 0x7f1014064670 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 --2- 172.21.15.153:0/2201322026 >> v2:172.21.15.178:3300/0 conn(0x7f1014150880 0x7f10140a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 -- 172.21.15.153:0/2201322026 >> 172.21.15.153:0/2201322026 conn(0x7f10140c6620 msgr2=0x7f10140c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 -- 172.21.15.153:0/2201322026 shutdown_connections 2023-08-17T00:16:31.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.868+0000 7f10196e4700 1 -- 172.21.15.153:0/2201322026 wait complete. 2023-08-17T00:16:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 Processor -- start 2023-08-17T00:16:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 -- start start 2023-08-17T00:16:31.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1014068f30 0x7f101414fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 0x7f10140c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1014150880 0x7f10140c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140c3900 con 0x7f10140a8e60 2023-08-17T00:16:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10140a6780 con 0x7f1014068f30 2023-08-17T00:16:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.872+0000 7f10196e4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10140a5b70 con 0x7f1014150880 2023-08-17T00:16:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 0x7f10140c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f1013fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1014068f30 0x7f101414fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 0x7f10140c2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60442/0 (socket says 172.21.15.153:60442) 2023-08-17T00:16:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 -- 172.21.15.153:0/2956383788 learned_addr learned my addr 172.21.15.153:0/2956383788 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f1018ee3700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1014150880 0x7f10140c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 -- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1014150880 msgr2=0x7f10140c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1014150880 0x7f10140c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 -- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1014068f30 msgr2=0x7f101414fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1014068f30 0x7f101414fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 -- 172.21.15.153:0/2956383788 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f100c009ae0 con 0x7f10140a8e60 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f1013fff700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1014068f30 0x7f101414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f100bfff700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 0x7f10140c2f20 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f0ffc00c4c0 tx=0x7f0ffc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc00ce70 con 0x7f10140a8e60 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ffc001e90 con 0x7f10140a8e60 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10140a5e50 con 0x7f10140a8e60 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc007250 con 0x7f10140a8e60 2023-08-17T00:16:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.876+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10140a6410 con 0x7f10140a8e60 2023-08-17T00:16:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.880+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101406b4c0 con 0x7f10140a8e60 2023-08-17T00:16:31.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.880+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0ffc010070 con 0x7f10140a8e60 2023-08-17T00:16:31.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.880+0000 7f1010ff9700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ff405a180 0x7f0ff405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:31.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.884+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f0ffc0735b0 con 0x7f10140a8e60 2023-08-17T00:16:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.884+0000 7f1013fff700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ff405a180 0x7f0ff405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.884+0000 7f1013fff700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ff405a180 0x7f0ff405c640 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f100400b860 tx=0x7f1004008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:31.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:31.888+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f0ffc047250 con 0x7f10140a8e60 2023-08-17T00:16:32.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.060+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f10140ab640 con 0x7f10140a8e60 2023-08-17T00:16:32.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.852+0000 7f1010ff9700 1 -- 172.21.15.153:0/2956383788 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v174) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0ffc04a870 con 0x7f10140a8e60 2023-08-17T00:16:32.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.852+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ff405a180 msgr2=0x7f0ff405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:32.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.852+0000 7f10196e4700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ff405a180 0x7f0ff405c640 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7f100400b860 tx=0x7f1004008040).stop 2023-08-17T00:16:32.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.852+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 msgr2=0x7f10140c2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.852+0000 7f10196e4700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 0x7f10140c2f20 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 rx=0x7f0ffc00c4c0 tx=0x7f0ffc007e00).stop 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 shutdown_connections 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0ff405a180 0x7f0ff405c640 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1014150880 0x7f10140c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f10140a8e60 0x7f10140c2f20 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 --2- 172.21.15.153:0/2956383788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1014068f30 0x7f101414fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:32.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 >> 172.21.15.153:0/2956383788 conn(0x7f10140c6620 msgr2=0x7f10140bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:32.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 shutdown_connections 2023-08-17T00:16:32.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:32.856+0000 7f10196e4700 1 -- 172.21.15.153:0/2956383788 wait complete. 2023-08-17T00:16:32.863 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:16:32.883 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:16:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 Processor -- start 2023-08-17T00:16:33.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 -- start start 2023-08-17T00:16:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7974068820 0x7f7974068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79740a96d0 0x7f79740a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79741585a0 con 0x7f79740a8df0 2023-08-17T00:16:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79740c1ba0 con 0x7f7974068820 2023-08-17T00:16:33.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f797ab47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7974066400 con 0x7f79740a96d0 2023-08-17T00:16:33.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f7979344700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7974068820 0x7f7974068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f7979344700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7974068820 0x7f7974068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60454/0 (socket says 172.21.15.153:60454) 2023-08-17T00:16:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.036+0000 7f7979344700 1 -- 172.21.15.153:0/800000925 learned_addr learned my addr 172.21.15.153:0/800000925 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797a346700 1 --2- 172.21.15.153:0/800000925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79740a96d0 0x7f79740a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7979344700 1 -- 172.21.15.153:0/800000925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79740a96d0 msgr2=0x7f79740a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7979344700 1 --2- 172.21.15.153:0/800000925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79740a96d0 0x7f79740a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7979344700 1 -- 172.21.15.153:0/800000925 >> v1:172.21.15.178:6789/0 conn(0x7f79740a8df0 legacy=0x7f79740c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7979344700 1 -- 172.21.15.153:0/800000925 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974069170 con 0x7f7974068820 2023-08-17T00:16:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7979344700 1 --2- 172.21.15.153:0/800000925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7974068820 0x7f7974068c80 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f7964006fd0 tx=0x7f79640090f0).ready entity=mon.0 client_cookie=b2af958a00499c5e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7978b43700 1 -- 172.21.15.153:0/800000925 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400b600 con 0x7f7974068820 2023-08-17T00:16:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7978b43700 1 -- 172.21.15.153:0/800000925 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400b760 con 0x7f7974068820 2023-08-17T00:16:33.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f7978b43700 1 -- 172.21.15.153:0/800000925 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400bae0 con 0x7f7974068820 2023-08-17T00:16:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 -- 172.21.15.153:0/800000925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7974068820 msgr2=0x7f7974068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 --2- 172.21.15.153:0/800000925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7974068820 0x7f7974068c80 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 rx=0x7f7964006fd0 tx=0x7f79640090f0).stop 2023-08-17T00:16:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 -- 172.21.15.153:0/800000925 shutdown_connections 2023-08-17T00:16:33.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 --2- 172.21.15.153:0/800000925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79740a96d0 0x7f79740a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 --2- 172.21.15.153:0/800000925 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7974068820 0x7f7974068c80 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 -- 172.21.15.153:0/800000925 >> 172.21.15.153:0/800000925 conn(0x7f79740c6620 msgr2=0x7f79740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:33.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 -- 172.21.15.153:0/800000925 shutdown_connections 2023-08-17T00:16:33.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.040+0000 7f797ab47700 1 -- 172.21.15.153:0/800000925 wait complete. 2023-08-17T00:16:33.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.044+0000 7f797ab47700 1 Processor -- start 2023-08-17T00:16:33.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.044+0000 7f797ab47700 1 -- start start 2023-08-17T00:16:33.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7974068820 0x7f79740bcae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 0x7f79740bfee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79740a96d0 0x7f797415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797415a880 con 0x7f79740a8df0 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7974159c70 con 0x7f79740a96d0 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7974159f50 con 0x7f7974068820 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 0x7f79740bfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 0x7f79740bfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60468/0 (socket says 172.21.15.153:60468) 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 -- 172.21.15.153:0/337837145 learned_addr learned my addr 172.21.15.153:0/337837145 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979b45700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7974068820 0x7f79740bcae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797a346700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79740a96d0 0x7f797415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 -- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7974068820 msgr2=0x7f79740bcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7974068820 0x7f79740bcae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 -- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79740a96d0 msgr2=0x7f797415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79740a96d0 0x7f797415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 -- 172.21.15.153:0/337837145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7964009370 con 0x7f79740a8df0 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797a346700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79740a96d0 0x7f797415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:33.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7979344700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 0x7f79740bfee0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f79740668e0 tx=0x7f7964017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796400b8d0 con 0x7f79740a8df0 2023-08-17T00:16:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796400ba30 con 0x7f79740a8df0 2023-08-17T00:16:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797415a230 con 0x7f79740a8df0 2023-08-17T00:16:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796401c670 con 0x7f79740a8df0 2023-08-17T00:16:33.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.048+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79740bcfd0 con 0x7f79740a8df0 2023-08-17T00:16:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.052+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797415a9f0 con 0x7f79740a8df0 2023-08-17T00:16:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.052+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f796402c070 con 0x7f79740a8df0 2023-08-17T00:16:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.052+0000 7f7969ffb700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a180 0x7f795805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.052+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7964075a90 con 0x7f79740a8df0 2023-08-17T00:16:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.056+0000 7f7979b45700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a180 0x7f795805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.056+0000 7f7979b45700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a180 0x7f795805c640 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f7970003710 tx=0x7f7970009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.060+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7964049940 con 0x7f79740a8df0 2023-08-17T00:16:33.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.272+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f797406b4c0 con 0x7f79740a8df0 2023-08-17T00:16:33.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.272+0000 7f7969ffb700 1 -- 172.21.15.153:0/337837145 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7964020070 con 0x7f79740a8df0 2023-08-17T00:16:33.280 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:33.280 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:16:33.280 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:16:33.281 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.281 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:16:33.281 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:16:33.281 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.281 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.281 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.282 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.283 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:16:33.283 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:16:33.283 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.283 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.283 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:16:33.283 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:16:33.284 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.284 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.284 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.284 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.285 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:16:33.285 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:16:33.285 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.285 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.285 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:16:33.285 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:16:33.286 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.286 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.286 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.287 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.288 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:16:33.288 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:16:33.288 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.288 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.288 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:16:33.289 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.290 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.291 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.292 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.292 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.292 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:16:33.292 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.293 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.294 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.295 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.295 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.295 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:16:33.295 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:16:33.295 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.296 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.296 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.296 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.296 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.296 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.296 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.297 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.298 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:16:33.299 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.300 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:16:33.300 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:16:33.300 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.300 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.301 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.301 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.301 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:16:33.301 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:16:33.301 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.302 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.302 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:16:33.302 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:16:33.302 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.302 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.302 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.303 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:16:33.303 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:16:33.303 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.303 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.303 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:16:33.303 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:16:33.304 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.305 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.305 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:16:33.305 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:16:33.305 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:16:33.305 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.305 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:16:33.306 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:16:33.307 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.308 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.309 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.310 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:33.310 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:33.310 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:16:33.310 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:16:33.311 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:16:33.311 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:16:33.311 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:16:33.311 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:16:33.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.311 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:33.312 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:16:33.312 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:16:33.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a180 msgr2=0x7f795805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a180 0x7f795805c640 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f7970003710 tx=0x7f7970009040).stop 2023-08-17T00:16:33.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 msgr2=0x7f79740bfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 0x7f79740bfee0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 rx=0x7f79740668e0 tx=0x7f7964017000).stop 2023-08-17T00:16:33.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 shutdown_connections 2023-08-17T00:16:33.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f795805a180 0x7f795805c640 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79740a96d0 0x7f797415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79740a8df0 0x7f79740bfee0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 --2- 172.21.15.153:0/337837145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7974068820 0x7f79740bcae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 >> 172.21.15.153:0/337837145 conn(0x7f79740c6620 msgr2=0x7f7974157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:33.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 shutdown_connections 2023-08-17T00:16:33.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.276+0000 7f797ab47700 1 -- 172.21.15.153:0/337837145 wait complete. 2023-08-17T00:16:33.316 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:33.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.472+0000 7f642a4f1700 1 Processor -- start 2023-08-17T00:16:33.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.472+0000 7f642a4f1700 1 -- start start 2023-08-17T00:16:33.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f642a4f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6424064870 0x7f6424064cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f642a4f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6424061fa0 con 0x7f6424151b90 2023-08-17T00:16:33.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f642a4f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64241523d0 con 0x7f6424151f70 2023-08-17T00:16:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f642a4f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64240c3fb0 con 0x7f6424064870 2023-08-17T00:16:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f6423fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6424151b90 0x7f6424063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55956/0 (socket says 172.21.15.153:55956) 2023-08-17T00:16:33.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f6423fff700 1 -- 172.21.15.153:0/1816666254 learned_addr learned my addr 172.21.15.153:0/1816666254 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:33.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f6428a8e700 1 --2- 172.21.15.153:0/1816666254 >> v2:172.21.15.178:3300/0 conn(0x7f6424064870 0x7f6424064cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.476+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718347015 0 0) 0x7f64241523d0 con 0x7f6424151f70 2023-08-17T00:16:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64100033f0 con 0x7f6424151f70 2023-08-17T00:16:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982749385 0 0) 0x7f6424061fa0 con 0x7f6424151b90 2023-08-17T00:16:33.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64241523d0 con 0x7f6424151b90 2023-08-17T00:16:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f6428a8e700 1 -- 172.21.15.153:0/1816666254 >> v1:172.21.15.178:6789/0 conn(0x7f6424151f70 legacy=0x7f6424065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f6428a8e700 1 -- 172.21.15.153:0/1816666254 >> v1:172.21.15.153:6789/0 conn(0x7f6424151b90 legacy=0x7f6424063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f6428a8e700 1 -- 172.21.15.153:0/1816666254 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64240651b0 con 0x7f6424064870 2023-08-17T00:16:33.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f6428a8e700 1 --2- 172.21.15.153:0/1816666254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424064870 0x7f6424064cc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f641c009e60 tx=0x7f641c009780).ready entity=mon.1 client_cookie=649f7516af040b76 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00e070 con 0x7f6424064870 2023-08-17T00:16:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c00bab0 con 0x7f6424064870 2023-08-17T00:16:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f64237fe700 1 -- 172.21.15.153:0/1816666254 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c00be30 con 0x7f6424064870 2023-08-17T00:16:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 -- 172.21.15.153:0/1816666254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424064870 msgr2=0x7f6424064cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1816666254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424064870 0x7f6424064cc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7f641c009e60 tx=0x7f641c009780).stop 2023-08-17T00:16:33.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 -- 172.21.15.153:0/1816666254 shutdown_connections 2023-08-17T00:16:33.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1816666254 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424064870 0x7f6424064cc0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 -- 172.21.15.153:0/1816666254 >> 172.21.15.153:0/1816666254 conn(0x7f64240c7150 msgr2=0x7f64240c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:33.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 -- 172.21.15.153:0/1816666254 shutdown_connections 2023-08-17T00:16:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.480+0000 7f642a4f1700 1 -- 172.21.15.153:0/1816666254 wait complete. 2023-08-17T00:16:33.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 Processor -- start 2023-08-17T00:16:33.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 -- start start 2023-08-17T00:16:33.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6424064870 0x7f6424140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424151b90 0x7f6424165500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 0x7f64241659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6424140900 con 0x7f6424151f70 2023-08-17T00:16:33.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64240bd720 con 0x7f6424151b90 2023-08-17T00:16:33.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.484+0000 7f642a4f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64240aa190 con 0x7f6424064870 2023-08-17T00:16:33.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 0x7f64241659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 0x7f64241659f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60474/0 (socket says 172.21.15.153:60474) 2023-08-17T00:16:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 -- 172.21.15.153:0/1804818787 learned_addr learned my addr 172.21.15.153:0/1804818787 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6423fff700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6424064870 0x7f6424140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f641b7fe700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424151b90 0x7f6424165500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 -- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6424064870 msgr2=0x7f6424140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6424064870 0x7f6424140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 -- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424151b90 msgr2=0x7f6424165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424151b90 0x7f6424165500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 -- 172.21.15.153:0/1804818787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c009a20 con 0x7f6424151f70 2023-08-17T00:16:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6428a8e700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 0x7f64241659f0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f641c00b610 tx=0x7f641c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c012ea0 con 0x7f6424151f70 2023-08-17T00:16:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c01d630 con 0x7f6424151f70 2023-08-17T00:16:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642414bb60 con 0x7f6424151f70 2023-08-17T00:16:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c01d9d0 con 0x7f6424151f70 2023-08-17T00:16:33.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6424155050 con 0x7f6424151f70 2023-08-17T00:16:33.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.488+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f642406b530 con 0x7f6424151f70 2023-08-17T00:16:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.492+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f641c026410 con 0x7f6424151f70 2023-08-17T00:16:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.492+0000 7f6420ff9700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f640405a150 0x7f640405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.492+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f641c075bf0 con 0x7f6424151f70 2023-08-17T00:16:33.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.492+0000 7f6423fff700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f640405a150 0x7f640405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.492+0000 7f6423fff700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f640405a150 0x7f640405c610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f6414005750 tx=0x7f6414009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.505 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.496+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f641c049990 con 0x7f6424151f70 2023-08-17T00:16:33.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.660+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64240621f0 con 0x7f6424151f70 2023-08-17T00:16:33.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.660+0000 7f6420ff9700 1 -- 172.21.15.153:0/1804818787 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) v1 ==== 74+0+13770 (secure 0 0 0) 0x7f641c04cfb0 con 0x7f6424151f70 2023-08-17T00:16:33.669 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:33.669 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":174,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:32.846956+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:33.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f640405a150 msgr2=0x7f640405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f640405a150 0x7f640405c610 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f6414005750 tx=0x7f6414009040).stop 2023-08-17T00:16:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 msgr2=0x7f64241659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 0x7f64241659f0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 rx=0x7f641c00b610 tx=0x7f641c009780).stop 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 shutdown_connections 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f640405a150 0x7f640405c610 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6424151f70 0x7f64241659f0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6424151b90 0x7f6424165500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 --2- 172.21.15.153:0/1804818787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6424064870 0x7f6424140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 >> 172.21.15.153:0/1804818787 conn(0x7f64240c7150 msgr2=0x7f642414c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:33.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 shutdown_connections 2023-08-17T00:16:33.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.664+0000 7f642a4f1700 1 -- 172.21.15.153:0/1804818787 wait complete. 2023-08-17T00:16:33.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:16:33.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:16:33.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.852+0000 7f89b17a9700 1 Processor -- start 2023-08-17T00:16:33.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.852+0000 7f89b17a9700 1 -- start start 2023-08-17T00:16:33.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89ac0652d0 0x7f89ac154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89ac0bbe80 0x7f89ac062280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac0bc5b0 con 0x7f89ac151770 2023-08-17T00:16:33.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0bc890 con 0x7f89ac0bbe80 2023-08-17T00:16:33.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0bcb70 con 0x7f89ac0652d0 2023-08-17T00:16:33.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89ab7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89ac0bbe80 0x7f89ac062280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89aaffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f89ac151770 0x7f89ac064bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55964/0 (socket says 172.21.15.153:55964) 2023-08-17T00:16:33.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89aaffd700 1 -- 172.21.15.153:0/3008646546 learned_addr learned my addr 172.21.15.153:0/3008646546 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:33.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89aa7fc700 1 --2- 172.21.15.153:0/3008646546 >> v2:172.21.15.178:3300/0 conn(0x7f89ac0652d0 0x7f89ac154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89ab7fe700 1 -- 172.21.15.153:0/3008646546 >> v2:172.21.15.178:3300/0 conn(0x7f89ac0652d0 msgr2=0x7f89ac154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:33.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89ab7fe700 1 --2- 172.21.15.153:0/3008646546 >> v2:172.21.15.178:3300/0 conn(0x7f89ac0652d0 0x7f89ac154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89ab7fe700 1 -- 172.21.15.153:0/3008646546 >> v1:172.21.15.153:6789/0 conn(0x7f89ac151770 legacy=0x7f89ac064bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89ab7fe700 1 -- 172.21.15.153:0/3008646546 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0bce50 con 0x7f89ac0bbe80 2023-08-17T00:16:33.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89a9ffb700 1 -- 172.21.15.153:0/3008646546 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462837354 0 0) 0x7f89ac0bc5b0 con 0x7f89ac151770 2023-08-17T00:16:33.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89ab7fe700 1 --2- 172.21.15.153:0/3008646546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0bbe80 0x7f89ac062280 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f89ac094f60 tx=0x7f89a4009780).ready entity=mon.0 client_cookie=499cce3c84dde518 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89a9ffb700 1 -- 172.21.15.153:0/3008646546 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400e070 con 0x7f89ac0bbe80 2023-08-17T00:16:33.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89a9ffb700 1 -- 172.21.15.153:0/3008646546 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400bb60 con 0x7f89ac0bbe80 2023-08-17T00:16:33.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89a9ffb700 1 -- 172.21.15.153:0/3008646546 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4012410 con 0x7f89ac0bbe80 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- 172.21.15.153:0/3008646546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0bbe80 msgr2=0x7f89ac062280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 --2- 172.21.15.153:0/3008646546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0bbe80 0x7f89ac062280 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 rx=0x7f89ac094f60 tx=0x7f89a4009780).stop 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- 172.21.15.153:0/3008646546 shutdown_connections 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 --2- 172.21.15.153:0/3008646546 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0bbe80 0x7f89ac062280 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 --2- 172.21.15.153:0/3008646546 >> v2:172.21.15.178:3300/0 conn(0x7f89ac0652d0 0x7f89ac154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- 172.21.15.153:0/3008646546 >> 172.21.15.153:0/3008646546 conn(0x7f89ac0c39c0 msgr2=0x7f89ac0c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- 172.21.15.153:0/3008646546 shutdown_connections 2023-08-17T00:16:33.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.856+0000 7f89b17a9700 1 -- 172.21.15.153:0/3008646546 wait complete. 2023-08-17T00:16:33.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.860+0000 7f89b17a9700 1 Processor -- start 2023-08-17T00:16:33.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.860+0000 7f89b17a9700 1 -- start start 2023-08-17T00:16:33.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 0x7f89ac0aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ac0bbe80 0x7f89ac0a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ac151770 0x7f89ac148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0aaf70 con 0x7f89ac0652d0 2023-08-17T00:16:33.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a7460 con 0x7f89ac0bbe80 2023-08-17T00:16:33.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0a9440 con 0x7f89ac151770 2023-08-17T00:16:33.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 0x7f89ac0aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 0x7f89ac0aa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60490/0 (socket says 172.21.15.153:60490) 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 -- 172.21.15.153:0/1538588893 learned_addr learned my addr 172.21.15.153:0/1538588893 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aa7fc700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ac0bbe80 0x7f89ac0a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89ab7fe700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ac151770 0x7f89ac148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 -- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ac151770 msgr2=0x7f89ac148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ac151770 0x7f89ac148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 -- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ac0bbe80 msgr2=0x7f89ac0a8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ac0bbe80 0x7f89ac0a8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 -- 172.21.15.153:0/1538588893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4009a20 con 0x7f89ac0652d0 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89aaffd700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 0x7f89ac0aa8e0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f899c00c510 tx=0x7f899c007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00ce80 con 0x7f89ac0652d0 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c0072e0 con 0x7f89ac0652d0 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac148f60 con 0x7f89ac0652d0 2023-08-17T00:16:33.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c007660 con 0x7f89ac0652d0 2023-08-17T00:16:33.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.864+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac0a6e10 con 0x7f89ac0652d0 2023-08-17T00:16:33.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.868+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac0a63a0 con 0x7f89ac0652d0 2023-08-17T00:16:33.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.868+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f899c010070 con 0x7f89ac0652d0 2023-08-17T00:16:33.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.868+0000 7f8992ffd700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:33.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.868+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f899c073500 con 0x7f89ac0652d0 2023-08-17T00:16:33.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.868+0000 7f89aa7fc700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:33.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.872+0000 7f89aa7fc700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f89ac0ab3b0 tx=0x7f89a0009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:33.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:33.876+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f899c0472a0 con 0x7f89ac0652d0 2023-08-17T00:16:34.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.036+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f89ac06b530 con 0x7f89ac0652d0 2023-08-17T00:16:34.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.036+0000 7f8992ffd700 1 -- 172.21.15.153:0/1538588893 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v174) v1 ==== 110+0+10 (secure 0 0 0) 0x7f899c04a8c0 con 0x7f89ac0652d0 2023-08-17T00:16:34.045 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:16:34.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 msgr2=0x7f899805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 rx=0x7f89ac0ab3b0 tx=0x7f89a0009060).stop 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 msgr2=0x7f89ac0aa8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 0x7f89ac0aa8e0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 rx=0x7f899c00c510 tx=0x7f899c007c70).stop 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 shutdown_connections 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ac151770 0x7f89ac148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ac0bbe80 0x7f89ac0a8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 --2- 172.21.15.153:0/1538588893 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89ac0652d0 0x7f89ac0aa8e0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 >> 172.21.15.153:0/1538588893 conn(0x7f89ac0c39c0 msgr2=0x7f89ac0c1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:34.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 shutdown_connections 2023-08-17T00:16:34.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.040+0000 7f89b17a9700 1 -- 172.21.15.153:0/1538588893 wait complete. 2023-08-17T00:16:34.067 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:16:34.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.224+0000 7ff685479700 1 Processor -- start 2023-08-17T00:16:34.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.224+0000 7ff685479700 1 -- start start 2023-08-17T00:16:34.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff685479700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff6800acf30 0x7ff6800c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff685479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 0x7ff6800634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff685479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff680154e90 con 0x7ff6800639a0 2023-08-17T00:16:34.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff685479700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff680063e10 con 0x7ff6800acf30 2023-08-17T00:16:34.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff685479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff680153fc0 con 0x7ff6800c5ea0 2023-08-17T00:16:34.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff677fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 0x7ff6800634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff677fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 0x7ff6800634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:48078/0 (socket says 172.21.15.153:48078) 2023-08-17T00:16:34.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff677fff700 1 -- 172.21.15.153:0/1244581313 learned_addr learned my addr 172.21.15.153:0/1244581313 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:34.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff67ffff700 1 --2- 172.21.15.153:0/1244581313 >> v2:172.21.15.178:3300/0 conn(0x7ff6800acf30 0x7ff6800c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.228+0000 7ff67f7fe700 1 -- 172.21.15.153:0/1244581313 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146243658 0 0) 0x7ff680154e90 con 0x7ff6800639a0 2023-08-17T00:16:34.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67f7fe700 1 -- 172.21.15.153:0/1244581313 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66c0033f0 con 0x7ff6800639a0 2023-08-17T00:16:34.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67ffff700 1 -- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 msgr2=0x7ff6800634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:34.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67ffff700 1 --2- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 0x7ff6800634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67ffff700 1 -- 172.21.15.153:0/1244581313 >> v1:172.21.15.178:6789/0 conn(0x7ff6800639a0 legacy=0x7ff680157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67ffff700 1 -- 172.21.15.153:0/1244581313 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff680154280 con 0x7ff6800acf30 2023-08-17T00:16:34.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff677fff700 1 --2- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 0x7ff6800634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:34.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67ffff700 1 --2- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6800acf30 0x7ff6800c1020 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff670009760 tx=0x7ff670009060).ready entity=mon.1 client_cookie=b2e164160b60f509 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67f7fe700 1 -- 172.21.15.153:0/1244581313 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6700090d0 con 0x7ff6800acf30 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67f7fe700 1 -- 172.21.15.153:0/1244581313 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67000d4a0 con 0x7ff6800acf30 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff67f7fe700 1 -- 172.21.15.153:0/1244581313 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67000d820 con 0x7ff6800acf30 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 -- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6800acf30 msgr2=0x7ff6800c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 --2- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6800acf30 0x7ff6800c1020 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff670009760 tx=0x7ff670009060).stop 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 -- 172.21.15.153:0/1244581313 shutdown_connections 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 --2- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800c5ea0 0x7ff6800634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 --2- 172.21.15.153:0/1244581313 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6800acf30 0x7ff6800c1020 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 -- 172.21.15.153:0/1244581313 >> 172.21.15.153:0/1244581313 conn(0x7ff6800cb330 msgr2=0x7ff6800c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:34.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 -- 172.21.15.153:0/1244581313 shutdown_connections 2023-08-17T00:16:34.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.232+0000 7ff685479700 1 -- 172.21.15.153:0/1244581313 wait complete. 2023-08-17T00:16:34.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 Processor -- start 2023-08-17T00:16:34.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 -- start start 2023-08-17T00:16:34.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800639a0 0x7ff680166760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 0x7ff6801557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff680163b50 0x7ff680155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c2df0 con 0x7ff6800acf30 2023-08-17T00:16:34.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6801561c0 con 0x7ff680163b50 2023-08-17T00:16:34.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff685479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6800c2200 con 0x7ff6800639a0 2023-08-17T00:16:34.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 0x7ff6801557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 0x7ff6801557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60498/0 (socket says 172.21.15.153:60498) 2023-08-17T00:16:34.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 -- 172.21.15.153:0/3593175373 learned_addr learned my addr 172.21.15.153:0/3593175373 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff67ffff700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800639a0 0x7ff680166760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff684c78700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff680163b50 0x7ff680155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 -- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800639a0 msgr2=0x7ff680166760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800639a0 0x7ff680166760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 -- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff680163b50 msgr2=0x7ff680155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff680163b50 0x7ff680155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.236+0000 7ff677fff700 1 -- 172.21.15.153:0/3593175373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668009370 con 0x7ff6800acf30 2023-08-17T00:16:34.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff677fff700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 0x7ff6801557e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7ff668006d00 tx=0x7ff6680090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6680095b0 con 0x7ff6800acf30 2023-08-17T00:16:34.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff668012600 con 0x7ff6800acf30 2023-08-17T00:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6700092a0 con 0x7ff6800acf30 2023-08-17T00:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff668012980 con 0x7ff6800acf30 2023-08-17T00:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6800c2730 con 0x7ff6800acf30 2023-08-17T00:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff680153e20 con 0x7ff6800acf30 2023-08-17T00:16:34.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.240+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff668022070 con 0x7ff6800acf30 2023-08-17T00:16:34.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.244+0000 7ff67cff9700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff66005a150 0x7ff66005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.244+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5269+0+0 (secure 0 0 0) 0x7ff668074020 con 0x7ff6800acf30 2023-08-17T00:16:34.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.244+0000 7ff67ffff700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff66005a150 0x7ff66005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.244+0000 7ff67ffff700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff66005a150 0x7ff66005c610 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7ff67000d260 tx=0x7ff670016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.248+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff680153e20 con 0x7ff6800acf30 2023-08-17T00:16:34.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.408+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff680153e20 con 0x7ff6800acf30 2023-08-17T00:16:34.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.412+0000 7ff67cff9700 1 -- 172.21.15.153:0/3593175373 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v174) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff680153e20 con 0x7ff6800acf30 2023-08-17T00:16:34.418 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:16:34.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff66005a150 msgr2=0x7ff66005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff66005a150 0x7ff66005c610 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7ff67000d260 tx=0x7ff670016000).stop 2023-08-17T00:16:34.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 msgr2=0x7ff6801557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 0x7ff6801557e0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 rx=0x7ff668006d00 tx=0x7ff6680090f0).stop 2023-08-17T00:16:34.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 shutdown_connections 2023-08-17T00:16:34.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff66005a150 0x7ff66005c610 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff680163b50 0x7ff680155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff6800acf30 0x7ff6801557e0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 --2- 172.21.15.153:0/3593175373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6800639a0 0x7ff680166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 >> 172.21.15.153:0/3593175373 conn(0x7ff6800cb330 msgr2=0x7ff6801566a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:34.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 shutdown_connections 2023-08-17T00:16:34.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.416+0000 7ff685479700 1 -- 172.21.15.153:0/3593175373 wait complete. 2023-08-17T00:16:34.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:16:34.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 Processor -- start 2023-08-17T00:16:34.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 -- start start 2023-08-17T00:16:34.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f554c0a96d0 0x7f554c0a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554c1585a0 con 0x7f554c0a8df0 2023-08-17T00:16:34.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554c0c1ba0 con 0x7f554c0a96d0 2023-08-17T00:16:34.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f555128f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c066400 con 0x7f554c068820 2023-08-17T00:16:34.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.596+0000 7f5550a8e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f554c0a96d0 0x7f554c0a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f5550a8e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f554c0a96d0 0x7f554c0a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60500/0 (socket says 172.21.15.153:60500) 2023-08-17T00:16:34.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f5550a8e700 1 -- 172.21.15.153:0/2282357532 learned_addr learned my addr 172.21.15.153:0/2282357532 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:34.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f55437fe700 1 --2- 172.21.15.153:0/2282357532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f55437fe700 1 -- 172.21.15.153:0/2282357532 >> v2:172.21.15.153:3300/0 conn(0x7f554c0a96d0 msgr2=0x7f554c0a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:34.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f55437fe700 1 --2- 172.21.15.153:0/2282357532 >> v2:172.21.15.153:3300/0 conn(0x7f554c0a96d0 0x7f554c0a9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f55437fe700 1 -- 172.21.15.153:0/2282357532 >> v1:172.21.15.178:6789/0 conn(0x7f554c0a8df0 legacy=0x7f554c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f55437fe700 1 -- 172.21.15.153:0/2282357532 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554c069170 con 0x7f554c068820 2023-08-17T00:16:34.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f55437fe700 1 --2- 172.21.15.153:0/2282357532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c068c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f5534009760 tx=0x7f5534009060).ready entity=mon.2 client_cookie=2845bd03d3e21a1e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f554b7fe700 1 -- 172.21.15.153:0/2282357532 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400f510 con 0x7f554c068820 2023-08-17T00:16:34.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f554b7fe700 1 -- 172.21.15.153:0/2282357532 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553400f670 con 0x7f554c068820 2023-08-17T00:16:34.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f554b7fe700 1 -- 172.21.15.153:0/2282357532 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553400f9f0 con 0x7f554c068820 2023-08-17T00:16:34.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 -- 172.21.15.153:0/2282357532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 msgr2=0x7f554c068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 --2- 172.21.15.153:0/2282357532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c068c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f5534009760 tx=0x7f5534009060).stop 2023-08-17T00:16:34.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 -- 172.21.15.153:0/2282357532 shutdown_connections 2023-08-17T00:16:34.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 --2- 172.21.15.153:0/2282357532 >> v2:172.21.15.153:3300/0 conn(0x7f554c0a96d0 0x7f554c0a9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 --2- 172.21.15.153:0/2282357532 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c068c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 -- 172.21.15.153:0/2282357532 >> 172.21.15.153:0/2282357532 conn(0x7f554c0c6620 msgr2=0x7f554c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:34.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 -- 172.21.15.153:0/2282357532 shutdown_connections 2023-08-17T00:16:34.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.600+0000 7f555128f700 1 -- 172.21.15.153:0/2282357532 wait complete. 2023-08-17T00:16:34.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.604+0000 7f555128f700 1 Processor -- start 2023-08-17T00:16:34.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.604+0000 7f555128f700 1 -- start start 2023-08-17T00:16:34.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c0bb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f554c0a8df0 0x7f554c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 0x7f554c0bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0bf2b0 con 0x7f554c0a96d0 2023-08-17T00:16:34.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0bba80 con 0x7f554c0a8df0 2023-08-17T00:16:34.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554c0be3c0 con 0x7f554c068820 2023-08-17T00:16:34.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 0x7f554c0bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 0x7f554c0bd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:60516/0 (socket says 172.21.15.153:60516) 2023-08-17T00:16:34.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 -- 172.21.15.153:0/3763779387 learned_addr learned my addr 172.21.15.153:0/3763779387 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:34.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f554bfff700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c0bb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f55437fe700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f554c0a8df0 0x7f554c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 -- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 msgr2=0x7f554c0bb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c0bb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 -- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f554c0a8df0 msgr2=0x7f554c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f554c0a8df0 0x7f554c155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 -- 172.21.15.153:0/3763779387 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55340092a0 con 0x7f554c0a96d0 2023-08-17T00:16:34.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5550a8e700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 0x7f554c0bd7e0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f5544009db0 tx=0x7f554400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400c890 con 0x7f554c0a96d0 2023-08-17T00:16:34.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554400f040 con 0x7f554c0a96d0 2023-08-17T00:16:34.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f554c0be6a0 con 0x7f554c0a96d0 2023-08-17T00:16:34.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554400cc20 con 0x7f554c0a96d0 2023-08-17T00:16:34.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554c0bef40 con 0x7f554c0a96d0 2023-08-17T00:16:34.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.608+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554c06b4c0 con 0x7f554c0a96d0 2023-08-17T00:16:34.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.612+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5544014620 con 0x7f554c0a96d0 2023-08-17T00:16:34.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.612+0000 7f5548ff9700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f553005a120 0x7f553005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.612+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f5544073fd0 con 0x7f554c0a96d0 2023-08-17T00:16:34.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.616+0000 7f554bfff700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f553005a120 0x7f553005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.616+0000 7f554bfff700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f553005a120 0x7f553005c5e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f553c007fd0 tx=0x7f553c007d30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.620+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5544047cc0 con 0x7f554c0a96d0 2023-08-17T00:16:34.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.779+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f554c064010 con 0x7f554c0a96d0 2023-08-17T00:16:34.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f5548ff9700 1 -- 172.21.15.153:0/3763779387 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v174) v1 ==== 84+0+143 (secure 0 0 0) 0x7f554404b2e0 con 0x7f554c0a96d0 2023-08-17T00:16:34.789 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:16:34.790 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:16:34.791 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:16:34.791 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:16:34.791 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:16:34.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f553005a120 msgr2=0x7f553005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f553005a120 0x7f553005c5e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f553c007fd0 tx=0x7f553c007d30).stop 2023-08-17T00:16:34.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 msgr2=0x7f554c0bd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 0x7f554c0bd7e0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 rx=0x7f5544009db0 tx=0x7f554400b040).stop 2023-08-17T00:16:34.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 shutdown_connections 2023-08-17T00:16:34.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f553005a120 0x7f553005c5e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f554c0a96d0 0x7f554c0bd7e0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f554c0a8df0 0x7f554c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 --2- 172.21.15.153:0/3763779387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f554c068820 0x7f554c0bb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 >> 172.21.15.153:0/3763779387 conn(0x7f554c0c6620 msgr2=0x7f554c157a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:34.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 shutdown_connections 2023-08-17T00:16:34.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.783+0000 7f555128f700 1 -- 172.21.15.153:0/3763779387 wait complete. 2023-08-17T00:16:34.811 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:16:34.812 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:16:34.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.971+0000 7f9c9b59e700 1 Processor -- start 2023-08-17T00:16:34.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.971+0000 7f9c9b59e700 1 -- start start 2023-08-17T00:16:34.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c9b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0a9cd0 0x7f9c9c153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c9b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c0bfc80 con 0x7f9c9c0c5c40 2023-08-17T00:16:34.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c9b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c6be0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c60d0 con 0x7f9c9c1543b0 2023-08-17T00:16:34.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c9a59c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0a9cd0 0x7f9c9c153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:41888/0 (socket says 172.21.15.153:41888) 2023-08-17T00:16:34.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 -- 172.21.15.153:0/300901090 learned_addr learned my addr 172.21.15.153:0/300901090 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 -- 172.21.15.153:0/300901090 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0a9cd0 msgr2=0x7f9c9c153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 --2- 172.21.15.153:0/300901090 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0a9cd0 0x7f9c9c153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 -- 172.21.15.153:0/300901090 >> v1:172.21.15.178:6789/0 conn(0x7f9c9c0c5c40 legacy=0x7f9c9c1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 -- 172.21.15.153:0/300901090 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0aa0b0 con 0x7f9c9c1543b0 2023-08-17T00:16:34.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.975+0000 7f9c99d9b700 1 --2- 172.21.15.153:0/300901090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c0c5750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9c90006fd0 tx=0x7f9c900090f0).ready entity=mon.2 client_cookie=115c38cf35baac4b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9959a700 1 -- 172.21.15.153:0/300901090 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000b580 con 0x7f9c9c1543b0 2023-08-17T00:16:34.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9959a700 1 -- 172.21.15.153:0/300901090 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000b6e0 con 0x7f9c9c1543b0 2023-08-17T00:16:34.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9959a700 1 -- 172.21.15.153:0/300901090 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000ba60 con 0x7f9c9c1543b0 2023-08-17T00:16:34.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 -- 172.21.15.153:0/300901090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 msgr2=0x7f9c9c0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/300901090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c0c5750 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f9c90006fd0 tx=0x7f9c900090f0).stop 2023-08-17T00:16:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 -- 172.21.15.153:0/300901090 shutdown_connections 2023-08-17T00:16:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/300901090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c0c5750 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/300901090 >> v2:172.21.15.178:3300/0 conn(0x7f9c9c0a9cd0 0x7f9c9c153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 -- 172.21.15.153:0/300901090 >> 172.21.15.153:0/300901090 conn(0x7f9c9c062a70 msgr2=0x7f9c9c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:34.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 -- 172.21.15.153:0/300901090 shutdown_connections 2023-08-17T00:16:34.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 -- 172.21.15.153:0/300901090 wait complete. 2023-08-17T00:16:34.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 Processor -- start 2023-08-17T00:16:34.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.979+0000 7f9c9b59e700 1 -- start start 2023-08-17T00:16:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 0x7f9c9c141b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0c5c40 0x7f9c9c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c167730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0c4be0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c165330 con 0x7f9c9c0c5c40 2023-08-17T00:16:34.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0aedd0 con 0x7f9c9c1543b0 2023-08-17T00:16:34.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 0x7f9c9c141b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 0x7f9c9c141b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39110/0 (socket says 172.21.15.153:39110) 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 -- 172.21.15.153:0/3620637117 learned_addr learned my addr 172.21.15.153:0/3620637117 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9ad9d700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c167730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c99d9b700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0c5c40 0x7f9c9c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 -- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 msgr2=0x7f9c9c167730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c167730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 -- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0c5c40 msgr2=0x7f9c9c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:34.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0c5c40 0x7f9c9c0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:34.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 -- 172.21.15.153:0/3620637117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009370 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c99d9b700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0c5c40 0x7f9c9c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:34.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9a59c700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 0x7f9c9c141b70 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f9c8c00e900 tx=0x7f9c8c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:34.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c012600 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c012760 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c012ae0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c0af0b0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.994 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.983+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c0af670 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.995 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.987+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c046dd0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.996 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.987+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9c8c022070 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.991+0000 7f9c8a7fc700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7c05a150 0x7f9c7c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.991+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f9c8c0740f0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:34.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.991+0000 7f9c99d9b700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7c05a150 0x7f9c7c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:34.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.991+0000 7f9c99d9b700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7c05a150 0x7f9c7c05c610 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f9c90009130 tx=0x7f9c90017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:35.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:34.995+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9c8c047de0 con 0x7f9c9c0a9cd0 2023-08-17T00:16:35.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.155+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f9c9c0ad310 con 0x7f9c9c0a9cd0 2023-08-17T00:16:35.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.871+0000 7f9c8a7fc700 1 -- 172.21.15.153:0/3620637117 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v175) v1 ==== 152+0+0 (secure 0 0 0) 0x7f9c8c04b400 con 0x7f9c9c0a9cd0 2023-08-17T00:16:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7c05a150 msgr2=0x7f9c7c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7c05a150 0x7f9c7c05c610 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 rx=0x7f9c90009130 tx=0x7f9c90017000).stop 2023-08-17T00:16:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 msgr2=0x7f9c9c141b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:35.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 0x7f9c9c141b70 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 rx=0x7f9c8c00e900 tx=0x7f9c8c009060).stop 2023-08-17T00:16:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 shutdown_connections 2023-08-17T00:16:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9c7c05a150 0x7f9c7c05c610 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:35.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c1543b0 0x7f9c9c167730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c0c5c40 0x7f9c9c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 --2- 172.21.15.153:0/3620637117 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9c9c0a9cd0 0x7f9c9c141b70 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 >> 172.21.15.153:0/3620637117 conn(0x7f9c9c062a70 msgr2=0x7f9c9c0c5310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 shutdown_connections 2023-08-17T00:16:35.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:35.875+0000 7f9c9b59e700 1 -- 172.21.15.153:0/3620637117 wait complete. 2023-08-17T00:16:35.887 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:16:35.905 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:16:36.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.067+0000 7f89b759e700 1 Processor -- start 2023-08-17T00:16:36.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.067+0000 7f89b759e700 1 -- start start 2023-08-17T00:16:36.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 0x7f89b8068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:36.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b8065da0 con 0x7f89b8151530 2023-08-17T00:16:36.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b8155c60 con 0x7f89b81560f0 2023-08-17T00:16:36.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8156550 con 0x7f89b80689c0 2023-08-17T00:16:36.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b659c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 0x7f89b8068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:36.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b6d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f89b8151530 0x7f89b81519e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45290/0 (socket says 172.21.15.153:45290) 2023-08-17T00:16:36.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b659c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 0x7f89b8068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:41898/0 (socket says 172.21.15.153:41898) 2023-08-17T00:16:36.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b6d9d700 1 -- 172.21.15.153:0/3805775252 learned_addr learned my addr 172.21.15.153:0/3805775252 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:36.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.071+0000 7f89b5d9b700 1 --1- 172.21.15.153:0/3805775252 >> v1:172.21.15.178:6789/0 conn(0x7f89b81560f0 0x7f89b80c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:44706/0 (socket says 172.21.15.153:44706) 2023-08-17T00:16:36.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b659c700 1 -- 172.21.15.153:0/3805775252 >> v1:172.21.15.178:6789/0 conn(0x7f89b81560f0 legacy=0x7f89b80c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b659c700 1 -- 172.21.15.153:0/3805775252 >> v1:172.21.15.153:6789/0 conn(0x7f89b8151530 legacy=0x7f89b81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b559a700 1 -- 172.21.15.153:0/3805775252 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715909496 0 0) 0x7f89b8155c60 con 0x7f89b81560f0 2023-08-17T00:16:36.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b659c700 1 -- 172.21.15.153:0/3805775252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b8065ff0 con 0x7f89b80689c0 2023-08-17T00:16:36.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b659c700 1 --2- 172.21.15.153:0/3805775252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 0x7f89b8068da0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f89a8009790 tx=0x7f89a8006f40).ready entity=mon.2 client_cookie=809d13790e60db72 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:36.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b559a700 1 -- 172.21.15.153:0/3805775252 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8005880 con 0x7f89b80689c0 2023-08-17T00:16:36.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b559a700 1 -- 172.21.15.153:0/3805775252 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80059e0 con 0x7f89b80689c0 2023-08-17T00:16:36.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b559a700 1 -- 172.21.15.153:0/3805775252 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8005d60 con 0x7f89b80689c0 2023-08-17T00:16:36.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 -- 172.21.15.153:0/3805775252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 msgr2=0x7f89b8068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 --2- 172.21.15.153:0/3805775252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 0x7f89b8068da0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f89a8009790 tx=0x7f89a8006f40).stop 2023-08-17T00:16:36.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 -- 172.21.15.153:0/3805775252 shutdown_connections 2023-08-17T00:16:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 --2- 172.21.15.153:0/3805775252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b80689c0 0x7f89b8068da0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 -- 172.21.15.153:0/3805775252 >> 172.21.15.153:0/3805775252 conn(0x7f89b80c6620 msgr2=0x7f89b80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 -- 172.21.15.153:0/3805775252 shutdown_connections 2023-08-17T00:16:36.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.075+0000 7f89b759e700 1 -- 172.21.15.153:0/3805775252 wait complete. 2023-08-17T00:16:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 Processor -- start 2023-08-17T00:16:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 -- start start 2023-08-17T00:16:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b80689c0 0x7f89b8164f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:36.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 0x7f89b80a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b81560f0 0x7f89b8167960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b81543e0 con 0x7f89b8151530 2023-08-17T00:16:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80a8680 con 0x7f89b80689c0 2023-08-17T00:16:36.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8168170 con 0x7f89b81560f0 2023-08-17T00:16:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 0x7f89b80a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 0x7f89b80a8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39124/0 (socket says 172.21.15.153:39124) 2023-08-17T00:16:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 -- 172.21.15.153:0/4103560500 learned_addr learned my addr 172.21.15.153:0/4103560500 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:36.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b6d9d700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b81560f0 0x7f89b8167960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b659c700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b80689c0 0x7f89b8164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 -- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b81560f0 msgr2=0x7f89b8167960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b81560f0 0x7f89b8167960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 -- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b80689c0 msgr2=0x7f89b8164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b80689c0 0x7f89b8164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 -- 172.21.15.153:0/4103560500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009250 con 0x7f89b8151530 2023-08-17T00:16:36.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b5d9b700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 0x7f89b80a8190 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f89ac00c510 tx=0x7f89ac007c60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00ce40 con 0x7f89b8151530 2023-08-17T00:16:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac0072e0 con 0x7f89b8151530 2023-08-17T00:16:36.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b8168450 con 0x7f89b8151530 2023-08-17T00:16:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac0056e0 con 0x7f89b8151530 2023-08-17T00:16:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.079+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b8154070 con 0x7f89b8151530 2023-08-17T00:16:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.083+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80c59c0 con 0x7f89b8151530 2023-08-17T00:16:36.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.083+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f89ac01a060 con 0x7f89b8151530 2023-08-17T00:16:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.083+0000 7f89a67fc700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:36.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.083+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5639+0+0 (secure 0 0 0) 0x7f89ac0736a0 con 0x7f89b8151530 2023-08-17T00:16:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.087+0000 7f89b659c700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:36.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.087+0000 7f89b659c700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f89a8009fd0 tx=0x7f89a8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:36.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.091+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89b80c59c0 con 0x7f89b8151530 2023-08-17T00:16:36.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.251+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f89b80c59c0 con 0x7f89b8151530 2023-08-17T00:16:36.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.883+0000 7f89a67fc700 1 -- 172.21.15.153:0/4103560500 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v176) v1 ==== 170+0+0 (secure 0 0 0) 0x7f89b80c59c0 con 0x7f89b8151530 2023-08-17T00:16:36.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 msgr2=0x7f899805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f89a8009fd0 tx=0x7f89a8015000).stop 2023-08-17T00:16:36.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 msgr2=0x7f89b80a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:36.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 0x7f89b80a8190 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 rx=0x7f89ac00c510 tx=0x7f89ac007c60).stop 2023-08-17T00:16:36.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 shutdown_connections 2023-08-17T00:16:36.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f899805a150 0x7f899805c610 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89b81560f0 0x7f89b8167960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89b8151530 0x7f89b80a8190 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 --2- 172.21.15.153:0/4103560500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89b80689c0 0x7f89b8164f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:36.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.899+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 >> 172.21.15.153:0/4103560500 conn(0x7f89b80c6620 msgr2=0x7f89b80c4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:36.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.903+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 shutdown_connections 2023-08-17T00:16:36.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:36.903+0000 7f89b759e700 1 -- 172.21.15.153:0/4103560500 wait complete. 2023-08-17T00:16:36.915 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:16:36.935 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:16:37.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.087+0000 7fba255b9700 1 Processor -- start 2023-08-17T00:16:37.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.087+0000 7fba255b9700 1 -- start start 2023-08-17T00:16:37.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba255b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fba20153f50 0x7fba20154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba255b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fba200c01a0 0x7fba200c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba255b9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200bfd10 con 0x7fba200c57a0 2023-08-17T00:16:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba255b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba20154860 con 0x7fba200c01a0 2023-08-17T00:16:37.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba255b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba20154af0 con 0x7fba20153f50 2023-08-17T00:16:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fba200c57a0 0x7fba200c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45302/0 (socket says 172.21.15.153:45302) 2023-08-17T00:16:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1ffff700 1 -- 172.21.15.153:0/3682657799 learned_addr learned my addr 172.21.15.153:0/3682657799 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba24db8700 1 --2- 172.21.15.153:0/3682657799 >> v2:172.21.15.153:3300/0 conn(0x7fba200c01a0 0x7fba200c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1f7fe700 1 --2- 172.21.15.153:0/3682657799 >> v2:172.21.15.178:3300/0 conn(0x7fba20153f50 0x7fba20154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1f7fe700 1 -- 172.21.15.153:0/3682657799 >> v2:172.21.15.153:3300/0 conn(0x7fba200c01a0 msgr2=0x7fba200c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1f7fe700 1 --2- 172.21.15.153:0/3682657799 >> v2:172.21.15.153:3300/0 conn(0x7fba200c01a0 0x7fba200c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1f7fe700 1 -- 172.21.15.153:0/3682657799 >> v1:172.21.15.153:6789/0 conn(0x7fba200c57a0 legacy=0x7fba200c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1f7fe700 1 -- 172.21.15.153:0/3682657799 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20154dd0 con 0x7fba20153f50 2023-08-17T00:16:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.091+0000 7fba1effd700 1 -- 172.21.15.153:0/3682657799 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533888766 0 0) 0x7fba200bfd10 con 0x7fba200c57a0 2023-08-17T00:16:37.102 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba1f7fe700 1 --2- 172.21.15.153:0/3682657799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20154370 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fba200c86a0 tx=0x7fba14009060).ready entity=mon.1 client_cookie=7299180d77919a32 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba1effd700 1 -- 172.21.15.153:0/3682657799 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400f510 con 0x7fba20153f50 2023-08-17T00:16:37.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba1effd700 1 -- 172.21.15.153:0/3682657799 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400f670 con 0x7fba20153f50 2023-08-17T00:16:37.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba1effd700 1 -- 172.21.15.153:0/3682657799 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400f9f0 con 0x7fba20153f50 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 -- 172.21.15.153:0/3682657799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 msgr2=0x7fba20154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 --2- 172.21.15.153:0/3682657799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20154370 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fba200c86a0 tx=0x7fba14009060).stop 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 -- 172.21.15.153:0/3682657799 shutdown_connections 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 --2- 172.21.15.153:0/3682657799 >> v2:172.21.15.153:3300/0 conn(0x7fba200c01a0 0x7fba200c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 --2- 172.21.15.153:0/3682657799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20154370 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 -- 172.21.15.153:0/3682657799 >> 172.21.15.153:0/3682657799 conn(0x7fba20062a70 msgr2=0x7fba200ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:37.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 -- 172.21.15.153:0/3682657799 shutdown_connections 2023-08-17T00:16:37.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 -- 172.21.15.153:0/3682657799 wait complete. 2023-08-17T00:16:37.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.095+0000 7fba255b9700 1 Processor -- start 2023-08-17T00:16:37.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 -- start start 2023-08-17T00:16:37.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 0x7fba200afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba200c57a0 0x7fba20167570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba20155de0 con 0x7fba200c01a0 2023-08-17T00:16:37.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba20167da0 con 0x7fba20153f50 2023-08-17T00:16:37.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba20168080 con 0x7fba200c57a0 2023-08-17T00:16:37.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 0x7fba200afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 0x7fba200afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39146/0 (socket says 172.21.15.153:39146) 2023-08-17T00:16:37.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 -- 172.21.15.153:0/3131481402 learned_addr learned my addr 172.21.15.153:0/3131481402 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:37.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba24db8700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1f7fe700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba200c57a0 0x7fba20167570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 -- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba200c57a0 msgr2=0x7fba20167570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba200c57a0 0x7fba20167570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 -- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 msgr2=0x7fba20152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 -- 172.21.15.153:0/3131481402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140092a0 con 0x7fba200c01a0 2023-08-17T00:16:37.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba1ffff700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 0x7fba200afcb0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7fba1000c4e0 tx=0x7fba10007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1000ce90 con 0x7fba200c01a0 2023-08-17T00:16:37.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba100072e0 con 0x7fba200c01a0 2023-08-17T00:16:37.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba20168360 con 0x7fba200c01a0 2023-08-17T00:16:37.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba10007660 con 0x7fba200c01a0 2023-08-17T00:16:37.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.099+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba20167a60 con 0x7fba200c01a0 2023-08-17T00:16:37.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.103+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba2006b4c0 con 0x7fba200c01a0 2023-08-17T00:16:37.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.103+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fba10010070 con 0x7fba200c01a0 2023-08-17T00:16:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.107+0000 7fba07fff700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba0c05a150 0x7fba0c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.107+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6021+0+0 (secure 0 0 0) 0x7fba10073840 con 0x7fba200c01a0 2023-08-17T00:16:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.107+0000 7fba1f7fe700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba0c05a150 0x7fba0c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.107+0000 7fba1f7fe700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba0c05a150 0x7fba0c05c610 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fba200a9d50 tx=0x7fba14017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.115+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fba10047240 con 0x7fba200c01a0 2023-08-17T00:16:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.307+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fba200cafb0 con 0x7fba200c01a0 2023-08-17T00:16:37.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.319+0000 7fba07fff700 1 -- 172.21.15.153:0/3131481402 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v134) v1 ==== 174+0+0 (secure 0 0 0) 0x7fba10007db0 con 0x7fba200c01a0 2023-08-17T00:16:37.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.327+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba0c05a150 msgr2=0x7fba0c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.327+0000 7fba255b9700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba0c05a150 0x7fba0c05c610 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7fba200a9d50 tx=0x7fba14017000).stop 2023-08-17T00:16:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.327+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 msgr2=0x7fba200afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.327+0000 7fba255b9700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 0x7fba200afcb0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 rx=0x7fba1000c4e0 tx=0x7fba10007c70).stop 2023-08-17T00:16:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 shutdown_connections 2023-08-17T00:16:37.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fba0c05a150 0x7fba0c05c610 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba20153f50 0x7fba20152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba200c57a0 0x7fba20167570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 --2- 172.21.15.153:0/3131481402 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fba200c01a0 0x7fba200afcb0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 >> 172.21.15.153:0/3131481402 conn(0x7fba20062a70 msgr2=0x7fba200c9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 shutdown_connections 2023-08-17T00:16:37.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.331+0000 7fba255b9700 1 -- 172.21.15.153:0/3131481402 wait complete. 2023-08-17T00:16:37.343 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 25 and data pool 26 2023-08-17T00:16:37.367 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 Processor -- start 2023-08-17T00:16:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 -- start start 2023-08-17T00:16:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa660151b90 0x7fa660151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660063290 0x7fa660065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa660065b50 0x7fa660064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600c3fb0 con 0x7fa660151b90 2023-08-17T00:16:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa660152460 con 0x7fa660065b50 2023-08-17T00:16:37.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa66741b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa660061fa0 con 0x7fa660063290 2023-08-17T00:16:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6651b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa660151b90 0x7fa660151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6651b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa660151b90 0x7fa660151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39154/0 (socket says 172.21.15.153:39154) 2023-08-17T00:16:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6651b7700 1 -- 172.21.15.153:0/907273082 learned_addr learned my addr 172.21.15.153:0/907273082 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6651b7700 1 -- 172.21.15.153:0/907273082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660063290 msgr2=0x7fa660065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6659b8700 1 --2- 172.21.15.153:0/907273082 >> v2:172.21.15.178:3300/0 conn(0x7fa660065b50 0x7fa660064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6649b6700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660063290 0x7fa660065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.507+0000 7fa6651b7700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660063290 0x7fa660065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa6651b7700 1 -- 172.21.15.153:0/907273082 >> v2:172.21.15.178:3300/0 conn(0x7fa660065b50 msgr2=0x7fa660064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa6651b7700 1 --2- 172.21.15.153:0/907273082 >> v2:172.21.15.178:3300/0 conn(0x7fa660065b50 0x7fa660064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa6651b7700 1 -- 172.21.15.153:0/907273082 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600621f0 con 0x7fa660151b90 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa6659b8700 1 --2- 172.21.15.153:0/907273082 >> v2:172.21.15.178:3300/0 conn(0x7fa660065b50 0x7fa660064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa6649b6700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660063290 0x7fa660065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:37.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa6651b7700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660151b90 0x7fa660151f70 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fa660066010 tx=0x7fa65c0090f0).ready entity=mon.0 client_cookie=3fed39d85f2d46f4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa657fff700 1 -- 172.21.15.153:0/907273082 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00b600 con 0x7fa660151b90 2023-08-17T00:16:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa657fff700 1 -- 172.21.15.153:0/907273082 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c00b760 con 0x7fa660151b90 2023-08-17T00:16:37.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa657fff700 1 -- 172.21.15.153:0/907273082 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c00bb00 con 0x7fa660151b90 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 -- 172.21.15.153:0/907273082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660151b90 msgr2=0x7fa660151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660151b90 0x7fa660151f70 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 rx=0x7fa660066010 tx=0x7fa65c0090f0).stop 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 -- 172.21.15.153:0/907273082 shutdown_connections 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660063290 0x7fa660065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 --2- 172.21.15.153:0/907273082 >> v2:172.21.15.178:3300/0 conn(0x7fa660065b50 0x7fa660064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 --2- 172.21.15.153:0/907273082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660151b90 0x7fa660151f70 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.521 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 -- 172.21.15.153:0/907273082 >> 172.21.15.153:0/907273082 conn(0x7fa6600c7150 msgr2=0x7fa6600c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 -- 172.21.15.153:0/907273082 shutdown_connections 2023-08-17T00:16:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.511+0000 7fa66741b700 1 -- 172.21.15.153:0/907273082 wait complete. 2023-08-17T00:16:37.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 Processor -- start 2023-08-17T00:16:37.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 -- start start 2023-08-17T00:16:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa660063290 0x7fa6600bd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 0x7fa660145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660151b90 0x7fa660150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600bdc10 con 0x7fa660065b50 2023-08-17T00:16:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66014b030 con 0x7fa660063290 2023-08-17T00:16:37.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa66741b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa660152740 con 0x7fa660151b90 2023-08-17T00:16:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa6649b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 0x7fa660145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa6649b6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 0x7fa660145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39164/0 (socket says 172.21.15.153:39164) 2023-08-17T00:16:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.515+0000 7fa6649b6700 1 -- 172.21.15.153:0/1905757700 learned_addr learned my addr 172.21.15.153:0/1905757700 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:37.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6651b7700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa660063290 0x7fa6600bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6659b8700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660151b90 0x7fa660150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6649b6700 1 -- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660151b90 msgr2=0x7fa660150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6649b6700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660151b90 0x7fa660150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6649b6700 1 -- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa660063290 msgr2=0x7fa6600bd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6649b6700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa660063290 0x7fa6600bd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6649b6700 1 -- 172.21.15.153:0/1905757700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c009370 con 0x7fa660065b50 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6651b7700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa660063290 0x7fa6600bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6649b6700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 0x7fa660145440 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fa65000c880 tx=0x7fa650008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650010580 con 0x7fa660065b50 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6500106e0 con 0x7fa660065b50 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa660152a20 con 0x7fa660065b50 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650010a60 con 0x7fa660065b50 2023-08-17T00:16:37.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa660145930 con 0x7fa660065b50 2023-08-17T00:16:37.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.519+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6601525a0 con 0x7fa660065b50 2023-08-17T00:16:37.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.523+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa65001b460 con 0x7fa660065b50 2023-08-17T00:16:37.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.523+0000 7fa6557fa700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa64405a1d0 0x7fa64405c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.523+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fa6500742b0 con 0x7fa660065b50 2023-08-17T00:16:37.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.523+0000 7fa6651b7700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa64405a1d0 0x7fa64405c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.523+0000 7fa6651b7700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa64405a1d0 0x7fa64405c690 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fa66015cd50 tx=0x7fa65c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.527+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6601525a0 con 0x7fa660065b50 2023-08-17T00:16:37.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.691+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6601525a0 con 0x7fa660065b50 2023-08-17T00:16:37.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.691+0000 7fa6557fa700 1 -- 172.21.15.153:0/1905757700 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fa6601525a0 con 0x7fa660065b50 2023-08-17T00:16:37.700 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:37.700 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":177,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:37.313642+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:16:35.234407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-17T00:16:36.324685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:37.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa64405a1d0 msgr2=0x7fa64405c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa64405a1d0 0x7fa64405c690 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 rx=0x7fa66015cd50 tx=0x7fa65c017000).stop 2023-08-17T00:16:37.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 msgr2=0x7fa660145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 0x7fa660145440 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 rx=0x7fa65000c880 tx=0x7fa650008040).stop 2023-08-17T00:16:37.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 shutdown_connections 2023-08-17T00:16:37.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa64405a1d0 0x7fa64405c690 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa660151b90 0x7fa660150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa660065b50 0x7fa660145440 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 --2- 172.21.15.153:0/1905757700 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa660063290 0x7fa6600bd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 >> 172.21.15.153:0/1905757700 conn(0x7fa6600c7150 msgr2=0x7fa6600c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 shutdown_connections 2023-08-17T00:16:37.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.695+0000 7fa66741b700 1 -- 172.21.15.153:0/1905757700 wait complete. 2023-08-17T00:16:37.726 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:37.739 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:16:37.731+0000 7fb04aadc700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:16:37.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2d79700 1 Processor -- start 2023-08-17T00:16:37.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2d79700 1 -- start start 2023-08-17T00:16:37.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2d79700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7ec0c0f90 0x7fc7ec0c1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2d79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec062ec0 con 0x7fc7ec0c1900 2023-08-17T00:16:37.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2d79700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7ec0bbf60 con 0x7fc7ec0c2520 2023-08-17T00:16:37.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2d79700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7ec062970 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2578700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc7ec0c1900 0x7fc7ec0649e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45310/0 (socket says 172.21.15.153:45310) 2023-08-17T00:16:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f1576700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc7ec0c0f90 0x7fc7ec0c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f2578700 1 -- 172.21.15.153:0/2192570165 learned_addr learned my addr 172.21.15.153:0/2192570165 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:37.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f1576700 1 -- 172.21.15.153:0/2192570165 >> v1:172.21.15.178:6789/0 conn(0x7fc7ec0c2520 legacy=0x7fc7ec063350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f1576700 1 -- 172.21.15.153:0/2192570165 >> v1:172.21.15.153:6789/0 conn(0x7fc7ec0c1900 legacy=0x7fc7ec0649e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.871+0000 7fc7f0d75700 1 -- 172.21.15.153:0/2192570165 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843340740 0 0) 0x7fc7ec0bbf60 con 0x7fc7ec0c2520 2023-08-17T00:16:37.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f1576700 1 -- 172.21.15.153:0/2192570165 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0bc240 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f1576700 1 --2- 172.21.15.153:0/2192570165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0c1410 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7fc7dc009760 tx=0x7fc7dc009060).ready entity=mon.0 client_cookie=3255c68c7166010b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f0d75700 1 -- 172.21.15.153:0/2192570165 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc0090d0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f0d75700 1 -- 172.21.15.153:0/2192570165 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7dc00f510 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f0d75700 1 -- 172.21.15.153:0/2192570165 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00f890 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 -- 172.21.15.153:0/2192570165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 msgr2=0x7fc7ec0c1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/2192570165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0c1410 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 rx=0x7fc7dc009760 tx=0x7fc7dc009060).stop 2023-08-17T00:16:37.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 -- 172.21.15.153:0/2192570165 shutdown_connections 2023-08-17T00:16:37.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/2192570165 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0c1410 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 -- 172.21.15.153:0/2192570165 >> 172.21.15.153:0/2192570165 conn(0x7fc7ec0c2ed0 msgr2=0x7fc7ec0c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:37.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 -- 172.21.15.153:0/2192570165 shutdown_connections 2023-08-17T00:16:37.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.875+0000 7fc7f2d79700 1 -- 172.21.15.153:0/2192570165 wait complete. 2023-08-17T00:16:37.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 Processor -- start 2023-08-17T00:16:37.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 -- start start 2023-08-17T00:16:37.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0c1900 0x7fc7ec068630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0c2520 0x7fc7ec068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec0a9ca0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec069010 con 0x7fc7ec0c2520 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2d79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec169500 con 0x7fc7ec0c1900 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0a94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39186/0 (socket says 172.21.15.153:39186) 2023-08-17T00:16:37.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 -- 172.21.15.153:0/4101743980 learned_addr learned my addr 172.21.15.153:0/4101743980 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:37.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2578700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0c2520 0x7fc7ec068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 -- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0c1900 msgr2=0x7fc7ec068630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0c1900 0x7fc7ec068630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:37.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 -- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0c2520 msgr2=0x7fc7ec068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:37.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0c2520 0x7fc7ec068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:37.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 -- 172.21.15.153:0/4101743980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0092a0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f2578700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0c2520 0x7fc7ec068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.879+0000 7fc7f1d77700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0a94c0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7fc7e800c490 tx=0x7fc7e8007de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800f470 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800f5f0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec168990 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800f9b0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec168eb0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7ec0680c0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.883+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc7e8010070 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.887+0000 7fc7e1ffb700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc7d005a150 0x7fc7d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:37.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.887+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc7e80735e0 con 0x7fc7ec0c0f90 2023-08-17T00:16:37.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.887+0000 7fc7f1576700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc7d005a150 0x7fc7d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:37.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.887+0000 7fc7f1576700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc7d005a150 0x7fc7d005c610 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fc7ec0ab8c0 tx=0x7fc7dc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:37.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:37.891+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc7ec0680c0 con 0x7fc7ec0c0f90 2023-08-17T00:16:38.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.059+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7ec168990 con 0x7fc7ec0c0f90 2023-08-17T00:16:38.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.059+0000 7fc7e1ffb700 1 -- 172.21.15.153:0/4101743980 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fc7ec168990 con 0x7fc7ec0c0f90 2023-08-17T00:16:38.068 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:38.068 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":177,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:37.313642+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:16:35.234407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-17T00:16:36.324685+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:38.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc7d005a150 msgr2=0x7fc7d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:38.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc7d005a150 0x7fc7d005c610 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7fc7ec0ab8c0 tx=0x7fc7dc017000).stop 2023-08-17T00:16:38.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 msgr2=0x7fc7ec0a94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:38.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0a94c0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 rx=0x7fc7e800c490 tx=0x7fc7e8007de0).stop 2023-08-17T00:16:38.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 shutdown_connections 2023-08-17T00:16:38.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc7d005a150 0x7fc7d005c610 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7ec0c2520 0x7fc7ec068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7ec0c1900 0x7fc7ec068630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:38.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 --2- 172.21.15.153:0/4101743980 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7ec0c0f90 0x7fc7ec0a94c0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 >> 172.21.15.153:0/4101743980 conn(0x7fc7ec0c2ed0 msgr2=0x7fc7ec157630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 shutdown_connections 2023-08-17T00:16:38.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.063+0000 7fc7f2d79700 1 -- 172.21.15.153:0/4101743980 wait complete. 2023-08-17T00:16:38.092 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:16:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.295+0000 7f328971b700 1 Processor -- start 2023-08-17T00:16:38.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.295+0000 7f328971b700 1 -- start start 2023-08-17T00:16:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f328971b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3284151630 0x7f32840bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f328971b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3284066130 0x7f32841553f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f328971b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3284062c90 con 0x7f3284151a10 2023-08-17T00:16:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f328971b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840657d0 con 0x7f3284066130 2023-08-17T00:16:38.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f328971b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840665e0 con 0x7f3284151630 2023-08-17T00:16:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3284066130 0x7f32841553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:38.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3284066130 0x7f32841553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39194/0 (socket says 172.21.15.153:39194) 2023-08-17T00:16:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 -- 172.21.15.153:0/1621013868 learned_addr learned my addr 172.21.15.153:0/1621013868 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f3282ffd700 1 --2- 172.21.15.153:0/1621013868 >> v2:172.21.15.178:3300/0 conn(0x7f3284151630 0x7f32840bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 -- 172.21.15.153:0/1621013868 >> v2:172.21.15.178:3300/0 conn(0x7f3284151630 msgr2=0x7f32840bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 --2- 172.21.15.153:0/1621013868 >> v2:172.21.15.178:3300/0 conn(0x7f3284151630 0x7f32840bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 -- 172.21.15.153:0/1621013868 >> v1:172.21.15.178:6789/0 conn(0x7f3284151a10 legacy=0x7f3284063120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:38.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.299+0000 7f32837fe700 1 -- 172.21.15.153:0/1621013868 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3284062980 con 0x7f3284066130 2023-08-17T00:16:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f32837fe700 1 --2- 172.21.15.153:0/1621013868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284066130 0x7f32841553f0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f3284063b80 tx=0x7f327c0090f0).ready entity=mon.0 client_cookie=a0209efe7acca0dc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f32827fc700 1 -- 172.21.15.153:0/1621013868 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c00b520 con 0x7f3284066130 2023-08-17T00:16:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f32827fc700 1 -- 172.21.15.153:0/1621013868 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c00b680 con 0x7f3284066130 2023-08-17T00:16:38.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f32827fc700 1 -- 172.21.15.153:0/1621013868 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c00ba20 con 0x7f3284066130 2023-08-17T00:16:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 -- 172.21.15.153:0/1621013868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284066130 msgr2=0x7f32841553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 --2- 172.21.15.153:0/1621013868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284066130 0x7f32841553f0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 rx=0x7f3284063b80 tx=0x7f327c0090f0).stop 2023-08-17T00:16:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 -- 172.21.15.153:0/1621013868 shutdown_connections 2023-08-17T00:16:38.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 --2- 172.21.15.153:0/1621013868 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284066130 0x7f32841553f0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 --2- 172.21.15.153:0/1621013868 >> v2:172.21.15.178:3300/0 conn(0x7f3284151630 0x7f32840bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 -- 172.21.15.153:0/1621013868 >> 172.21.15.153:0/1621013868 conn(0x7f32840c2fb0 msgr2=0x7f32840c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:38.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 -- 172.21.15.153:0/1621013868 shutdown_connections 2023-08-17T00:16:38.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.303+0000 7f328971b700 1 -- 172.21.15.153:0/1621013868 wait complete. 2023-08-17T00:16:38.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 Processor -- start 2023-08-17T00:16:38.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 -- start start 2023-08-17T00:16:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3284066130 0x7f32840ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3284151630 0x7f3284152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 0x7f3284154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284153cc0 con 0x7f3284151a10 2023-08-17T00:16:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32841530b0 con 0x7f3284066130 2023-08-17T00:16:38.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f328971b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3284153390 con 0x7f3284151630 2023-08-17T00:16:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f32837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 0x7f3284154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f32837fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 0x7f3284154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39196/0 (socket says 172.21.15.153:39196) 2023-08-17T00:16:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f32837fe700 1 -- 172.21.15.153:0/1077062745 learned_addr learned my addr 172.21.15.153:0/1077062745 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f3282ffd700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3284066130 0x7f32840ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.307+0000 7f327a7fc700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3284151630 0x7f3284152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:38.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f32837fe700 1 -- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3284151630 msgr2=0x7f3284152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f32837fe700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3284151630 0x7f3284152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f32837fe700 1 -- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3284066130 msgr2=0x7f32840ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f32837fe700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3284066130 0x7f32840ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f32837fe700 1 -- 172.21.15.153:0/1077062745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009370 con 0x7f3284151a10 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f3282ffd700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3284066130 0x7f32840ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f327a7fc700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3284151630 0x7f3284152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f32837fe700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 0x7f3284154150 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f3284063b50 tx=0x7f327c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:38.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c006d90 con 0x7f3284151a10 2023-08-17T00:16:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c00b7f0 con 0x7f3284151a10 2023-08-17T00:16:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3284153670 con 0x7f3284151a10 2023-08-17T00:16:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c01c420 con 0x7f3284151a10 2023-08-17T00:16:38.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3284152d50 con 0x7f3284151a10 2023-08-17T00:16:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.311+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3284153e30 con 0x7f3284151a10 2023-08-17T00:16:38.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.315+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f327c02c070 con 0x7f3284151a10 2023-08-17T00:16:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.315+0000 7f327b7fe700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f326405a150 0x7f326405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:38.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.315+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f327c075df0 con 0x7f3284151a10 2023-08-17T00:16:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.315+0000 7f3282ffd700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f326405a150 0x7f326405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:38.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.315+0000 7f3282ffd700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f326405a150 0x7f326405c610 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f3274011310 tx=0x7f3274009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:38.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.323+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f327c0497d0 con 0x7f3284151a10 2023-08-17T00:16:38.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:38.523+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3284065a20 con 0x7f3284151a10 2023-08-17T00:16:39.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.407+0000 7f327b7fe700 1 -- 172.21.15.153:0/1077062745 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v136) v1 ==== 118+0+0 (secure 0 0 0) 0x7f327c02a070 con 0x7f3284151a10 2023-08-17T00:16:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f326405a150 msgr2=0x7f326405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f326405a150 0x7f326405c610 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f3274011310 tx=0x7f3274009060).stop 2023-08-17T00:16:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 msgr2=0x7f3284154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 0x7f3284154150 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 rx=0x7f3284063b50 tx=0x7f327c017000).stop 2023-08-17T00:16:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 shutdown_connections 2023-08-17T00:16:39.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f326405a150 0x7f326405c610 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3284151a10 0x7f3284154150 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3284151630 0x7f3284152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 --2- 172.21.15.153:0/1077062745 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3284066130 0x7f32840ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 >> 172.21.15.153:0/1077062745 conn(0x7f32840c2fb0 msgr2=0x7f328414d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 shutdown_connections 2023-08-17T00:16:39.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.411+0000 7f328971b700 1 -- 172.21.15.153:0/1077062745 wait complete. 2023-08-17T00:16:39.442 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:16:39.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:16:39.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.599+0000 7f05be9b9700 1 Processor -- start 2023-08-17T00:16:39.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.603+0000 7f05be9b9700 1 -- start start 2023-08-17T00:16:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.603+0000 7f05be9b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f05b80c57a0 0x7f05b80c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.603+0000 7f05be9b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b8153f50 0x7f05b8154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.603+0000 7f05be9b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b80bfd10 con 0x7f05b8157600 2023-08-17T00:16:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.603+0000 7f05be9b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b8154860 con 0x7f05b80c57a0 2023-08-17T00:16:39.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.603+0000 7f05be9b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b8154af0 con 0x7f05b8153f50 2023-08-17T00:16:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd1b6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b8153f50 0x7f05b8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be1b8700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f05b8157600 0x7f05b8157a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:44736/0 (socket says 172.21.15.153:44736) 2023-08-17T00:16:39.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be1b8700 1 -- 172.21.15.153:0/563286829 learned_addr learned my addr 172.21.15.153:0/563286829 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd9b7700 1 --2- 172.21.15.153:0/563286829 >> v2:172.21.15.178:3300/0 conn(0x7f05b80c57a0 0x7f05b80c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bc9b5700 1 -- 172.21.15.153:0/563286829 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214121029 0 0) 0x7f05b80bfd10 con 0x7f05b8157600 2023-08-17T00:16:39.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bc9b5700 1 -- 172.21.15.153:0/563286829 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a40033f0 con 0x7f05b8157600 2023-08-17T00:16:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd1b6700 1 -- 172.21.15.153:0/563286829 >> v2:172.21.15.178:3300/0 conn(0x7f05b80c57a0 msgr2=0x7f05b80c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd1b6700 1 --2- 172.21.15.153:0/563286829 >> v2:172.21.15.178:3300/0 conn(0x7f05b80c57a0 0x7f05b80c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd1b6700 1 -- 172.21.15.153:0/563286829 >> v1:172.21.15.178:6789/0 conn(0x7f05b8157600 legacy=0x7f05b8157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd1b6700 1 -- 172.21.15.153:0/563286829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8154dd0 con 0x7f05b8153f50 2023-08-17T00:16:39.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bd1b6700 1 --2- 172.21.15.153:0/563286829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b8153f50 0x7f05b8154370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f05a8009760 tx=0x7f05a8009060).ready entity=mon.2 client_cookie=301c8ab3833aa709 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bc9b5700 1 -- 172.21.15.153:0/563286829 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800d4a0 con 0x7f05b8153f50 2023-08-17T00:16:39.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bc9b5700 1 -- 172.21.15.153:0/563286829 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a800d600 con 0x7f05b8153f50 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05bc9b5700 1 -- 172.21.15.153:0/563286829 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a800d980 con 0x7f05b8153f50 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be9b9700 1 -- 172.21.15.153:0/563286829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b8153f50 msgr2=0x7f05b8154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be9b9700 1 --2- 172.21.15.153:0/563286829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b8153f50 0x7f05b8154370 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f05a8009760 tx=0x7f05a8009060).stop 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be9b9700 1 -- 172.21.15.153:0/563286829 shutdown_connections 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be9b9700 1 --2- 172.21.15.153:0/563286829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b8153f50 0x7f05b8154370 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be9b9700 1 --2- 172.21.15.153:0/563286829 >> v2:172.21.15.178:3300/0 conn(0x7f05b80c57a0 0x7f05b80c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.607+0000 7f05be9b9700 1 -- 172.21.15.153:0/563286829 >> 172.21.15.153:0/563286829 conn(0x7f05b8062a70 msgr2=0x7f05b80ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 -- 172.21.15.153:0/563286829 shutdown_connections 2023-08-17T00:16:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 -- 172.21.15.153:0/563286829 wait complete. 2023-08-17T00:16:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 Processor -- start 2023-08-17T00:16:39.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 -- start start 2023-08-17T00:16:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b80c57a0 0x7f05b80c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:39.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b8153f50 0x7f05b813ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 0x7f05b80c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80c2360 con 0x7f05b8157600 2023-08-17T00:16:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80c2640 con 0x7f05b8153f50 2023-08-17T00:16:39.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be9b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b80c2920 con 0x7f05b80c57a0 2023-08-17T00:16:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 0x7f05b80c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be1b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 0x7f05b80c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39210/0 (socket says 172.21.15.153:39210) 2023-08-17T00:16:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.611+0000 7f05be1b8700 1 -- 172.21.15.153:0/921954662 learned_addr learned my addr 172.21.15.153:0/921954662 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:39.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05bd9b7700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b80c57a0 0x7f05b80c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05bd1b6700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b8153f50 0x7f05b813ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be1b8700 1 -- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b80c57a0 msgr2=0x7f05b80c9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be1b8700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b80c57a0 0x7f05b80c9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be1b8700 1 -- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b8153f50 msgr2=0x7f05b813ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be1b8700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b8153f50 0x7f05b813ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:39.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be1b8700 1 -- 172.21.15.153:0/921954662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a80092a0 con 0x7f05b8157600 2023-08-17T00:16:39.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05bd9b7700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b80c57a0 0x7f05b80c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:39.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be1b8700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 0x7f05b80c8dd0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f05b0005ad0 tx=0x7f05b0001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:39.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0005d30 con 0x7f05b8157600 2023-08-17T00:16:39.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b0005e90 con 0x7f05b8157600 2023-08-17T00:16:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b0007320 con 0x7f05b8157600 2023-08-17T00:16:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b80c2c00 con 0x7f05b8157600 2023-08-17T00:16:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b80c2010 con 0x7f05b8157600 2023-08-17T00:16:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.615+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b806b4c0 con 0x7f05b8157600 2023-08-17T00:16:39.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.619+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f05b0010030 con 0x7f05b8157600 2023-08-17T00:16:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.619+0000 7f05adffb700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f059c05a150 0x7f059c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:39.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.619+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f05b0074030 con 0x7f05b8157600 2023-08-17T00:16:39.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.619+0000 7f05bd9b7700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f059c05a150 0x7f059c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:39.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.619+0000 7f05bd9b7700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f059c05a150 0x7f059c05c610 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f05b4009b60 tx=0x7f05b4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:39.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.623+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f05b0047a80 con 0x7f05b8157600 2023-08-17T00:16:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:39.819+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f05b80bf9a0 con 0x7f05b8157600 2023-08-17T00:16:40.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.415+0000 7f05adffb700 1 -- 172.21.15.153:0/921954662 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v137) v1 ==== 122+0+0 (secure 0 0 0) 0x7f05b004b0a0 con 0x7f05b8157600 2023-08-17T00:16:40.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f059c05a150 msgr2=0x7f059c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f059c05a150 0x7f059c05c610 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f05b4009b60 tx=0x7f05b4008040).stop 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 msgr2=0x7f05b80c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 0x7f05b80c8dd0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 rx=0x7f05b0005ad0 tx=0x7f05b0001650).stop 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 shutdown_connections 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f059c05a150 0x7f059c05c610 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f05b8157600 0x7f05b80c8dd0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f05b8153f50 0x7f05b813ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 --2- 172.21.15.153:0/921954662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f05b80c57a0 0x7f05b80c9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 >> 172.21.15.153:0/921954662 conn(0x7f05b8062a70 msgr2=0x7f05b8153250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 shutdown_connections 2023-08-17T00:16:40.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.419+0000 7f05be9b9700 1 -- 172.21.15.153:0/921954662 wait complete. 2023-08-17T00:16:40.449 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:16:40.450 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:40.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 Processor -- start 2023-08-17T00:16:40.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 -- start start 2023-08-17T00:16:40.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19880689c0 0x7f1988068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1988151530 0x7f19881519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1988065da0 con 0x7f19881560f0 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1988155c60 con 0x7f19880689c0 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198d579700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1988156550 con 0x7f1988151530 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19880689c0 0x7f1988068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19880689c0 0x7f1988068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39218/0 (socket says 172.21.15.153:39218) 2023-08-17T00:16:40.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 -- 172.21.15.153:0/44714367 learned_addr learned my addr 172.21.15.153:0/44714367 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:40.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198cd78700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1988151530 0x7f19881519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 -- 172.21.15.153:0/44714367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1988151530 msgr2=0x7f19881519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1988151530 0x7f19881519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 -- 172.21.15.153:0/44714367 >> v1:172.21.15.178:6789/0 conn(0x7f19881560f0 legacy=0x7f19880c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 -- 172.21.15.153:0/44714367 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988065ff0 con 0x7f19880689c0 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f198cd78700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1988151530 0x7f19881519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.607+0000 7f1987fff700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19880689c0 0x7f1988068da0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f1978009f70 tx=0x7f1978009840).ready entity=mon.0 client_cookie=a3615bc70c1e114d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:40.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f19877fe700 1 -- 172.21.15.153:0/44714367 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800e070 con 0x7f19880689c0 2023-08-17T00:16:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f19877fe700 1 -- 172.21.15.153:0/44714367 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800bad0 con 0x7f19880689c0 2023-08-17T00:16:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f19877fe700 1 -- 172.21.15.153:0/44714367 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197800be50 con 0x7f19880689c0 2023-08-17T00:16:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 -- 172.21.15.153:0/44714367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19880689c0 msgr2=0x7f1988068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19880689c0 0x7f1988068da0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 rx=0x7f1978009f70 tx=0x7f1978009840).stop 2023-08-17T00:16:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 -- 172.21.15.153:0/44714367 shutdown_connections 2023-08-17T00:16:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1988151530 0x7f19881519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 --2- 172.21.15.153:0/44714367 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19880689c0 0x7f1988068da0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 -- 172.21.15.153:0/44714367 >> 172.21.15.153:0/44714367 conn(0x7f19880c6620 msgr2=0x7f19880c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 -- 172.21.15.153:0/44714367 shutdown_connections 2023-08-17T00:16:40.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 -- 172.21.15.153:0/44714367 wait complete. 2023-08-17T00:16:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.611+0000 7f198d579700 1 Processor -- start 2023-08-17T00:16:40.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 -- start start 2023-08-17T00:16:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19880689c0 0x7f1988142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 0x7f198809f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19881560f0 0x7f198809f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:40.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1988150420 con 0x7f1988151530 2023-08-17T00:16:40.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880a0900 con 0x7f19881560f0 2023-08-17T00:16:40.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880a0000 con 0x7f19880689c0 2023-08-17T00:16:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 0x7f198809f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198cd78700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19881560f0 0x7f198809f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 0x7f198809f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39220/0 (socket says 172.21.15.153:39220) 2023-08-17T00:16:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 -- 172.21.15.153:0/4092578458 learned_addr learned my addr 172.21.15.153:0/4092578458 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f1987fff700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19880689c0 0x7f1988142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:40.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 -- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19880689c0 msgr2=0x7f1988142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19880689c0 0x7f1988142a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 -- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19881560f0 msgr2=0x7f198809f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19881560f0 0x7f198809f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 -- 172.21.15.153:0/4092578458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1978009ae0 con 0x7f1988151530 2023-08-17T00:16:40.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f197f7fe700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 0x7f198809f460 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f197000c4c0 tx=0x7f1970007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197000ce70 con 0x7f1988151530 2023-08-17T00:16:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1970001e90 con 0x7f1988151530 2023-08-17T00:16:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19880a02e0 con 0x7f1988151530 2023-08-17T00:16:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970007250 con 0x7f1988151530 2023-08-17T00:16:40.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.615+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19880a05c0 con 0x7f1988151530 2023-08-17T00:16:40.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.619+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198806b4c0 con 0x7f1988151530 2023-08-17T00:16:40.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.619+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1970010070 con 0x7f1988151530 2023-08-17T00:16:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.619+0000 7f1984ff9700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196805a150 0x7f196805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.623+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1970073910 con 0x7f1988151530 2023-08-17T00:16:40.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.623+0000 7f1987fff700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196805a150 0x7f196805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:40.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.623+0000 7f1987fff700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196805a150 0x7f196805c610 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f1978009930 tx=0x7f1978009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:40.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.627+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19700472b0 con 0x7f1988151530 2023-08-17T00:16:40.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.823+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1988063750 con 0x7f1988151530 2023-08-17T00:16:40.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.823+0000 7f1984ff9700 1 -- 172.21.15.153:0/4092578458 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f197004a8d0 con 0x7f1988151530 2023-08-17T00:16:40.831 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:40.831 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":137,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:16:37.314463+0000","modified":"2023-08-17T00:16:40.409153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"a","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/935397889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":935397889},{"type":"v1","addr":"172.21.15.153:6835","nonce":935397889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-08-17T00:16:40.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196805a150 msgr2=0x7f196805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196805a150 0x7f196805c610 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 rx=0x7f1978009930 tx=0x7f1978009840).stop 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 msgr2=0x7f198809f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 0x7f198809f460 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 rx=0x7f197000c4c0 tx=0x7f1970007e00).stop 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 shutdown_connections 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f196805a150 0x7f196805c610 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19881560f0 0x7f198809f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1988151530 0x7f198809f460 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 --2- 172.21.15.153:0/4092578458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19880689c0 0x7f1988142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:40.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 >> 172.21.15.153:0/4092578458 conn(0x7f19880c6620 msgr2=0x7f1988065160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:40.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 shutdown_connections 2023-08-17T00:16:40.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:40.827+0000 7f198d579700 1 -- 172.21.15.153:0/4092578458 wait complete. 2023-08-17T00:16:40.836 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 137 2023-08-17T00:16:40.855 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:41.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6a28f700 1 Processor -- start 2023-08-17T00:16:41.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6a28f700 1 -- start start 2023-08-17T00:16:41.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6a28f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7e640c5ea0 0x7f7e640634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6a28f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e64154e90 con 0x7f7e640acf30 2023-08-17T00:16:41.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6a28f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e64153fc0 con 0x7f7e640639a0 2023-08-17T00:16:41.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6a28f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e640c1730 con 0x7f7e640c5ea0 2023-08-17T00:16:41.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e68a8c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f7e640c5ea0 0x7f7e640634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6928d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7e640acf30 0x7f7e640c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45326/0 (socket says 172.21.15.153:45326) 2023-08-17T00:16:41.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.011+0000 7f7e6928d700 1 -- 172.21.15.153:0/686466991 learned_addr learned my addr 172.21.15.153:0/686466991 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:41.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e5bfff700 1 -- 172.21.15.153:0/686466991 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601400432 0 0) 0x7f7e64154e90 con 0x7f7e640acf30 2023-08-17T00:16:41.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e5bfff700 1 -- 172.21.15.153:0/686466991 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e500033f0 con 0x7f7e640acf30 2023-08-17T00:16:41.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e68a8c700 1 -- 172.21.15.153:0/686466991 >> v1:172.21.15.178:6789/0 conn(0x7f7e640639a0 legacy=0x7f7e640bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e5bfff700 1 -- 172.21.15.153:0/686466991 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922037022 0 0) 0x7f7e64153fc0 con 0x7f7e640639a0 2023-08-17T00:16:41.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e68a8c700 1 -- 172.21.15.153:0/686466991 >> v1:172.21.15.153:6789/0 conn(0x7f7e640acf30 legacy=0x7f7e640c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e68a8c700 1 -- 172.21.15.153:0/686466991 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64154280 con 0x7f7e640c5ea0 2023-08-17T00:16:41.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e68a8c700 1 --2- 172.21.15.153:0/686466991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640c5ea0 0x7f7e640634b0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f7e54009760 tx=0x7f7e54009060).ready entity=mon.0 client_cookie=ab30e40780d47d75 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e5bfff700 1 -- 172.21.15.153:0/686466991 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5400f510 con 0x7f7e640c5ea0 2023-08-17T00:16:41.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e5bfff700 1 -- 172.21.15.153:0/686466991 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5400f670 con 0x7f7e640c5ea0 2023-08-17T00:16:41.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e5bfff700 1 -- 172.21.15.153:0/686466991 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5400f9f0 con 0x7f7e640c5ea0 2023-08-17T00:16:41.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 -- 172.21.15.153:0/686466991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640c5ea0 msgr2=0x7f7e640634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/686466991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640c5ea0 0x7f7e640634b0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 rx=0x7f7e54009760 tx=0x7f7e54009060).stop 2023-08-17T00:16:41.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 -- 172.21.15.153:0/686466991 shutdown_connections 2023-08-17T00:16:41.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/686466991 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640c5ea0 0x7f7e640634b0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 -- 172.21.15.153:0/686466991 >> 172.21.15.153:0/686466991 conn(0x7f7e640cb330 msgr2=0x7f7e640c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:41.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 -- 172.21.15.153:0/686466991 shutdown_connections 2023-08-17T00:16:41.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.015+0000 7f7e6a28f700 1 -- 172.21.15.153:0/686466991 wait complete. 2023-08-17T00:16:41.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 Processor -- start 2023-08-17T00:16:41.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 -- start start 2023-08-17T00:16:41.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 0x7f7e64163e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e640acf30 0x7f7e640c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e640c4690 0x7f7e64166b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640af500 con 0x7f7e640639a0 2023-08-17T00:16:41.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640ae8f0 con 0x7f7e640acf30 2023-08-17T00:16:41.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6a28f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e640aebd0 con 0x7f7e640c4690 2023-08-17T00:16:41.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 0x7f7e64163e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 0x7f7e64163e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39236/0 (socket says 172.21.15.153:39236) 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 -- 172.21.15.153:0/2959674572 learned_addr learned my addr 172.21.15.153:0/2959674572 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e69a8e700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e640c4690 0x7f7e64166b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e68a8c700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e640acf30 0x7f7e640c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 -- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e640c4690 msgr2=0x7f7e64166b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e640c4690 0x7f7e64166b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 -- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e640acf30 msgr2=0x7f7e640c1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e640acf30 0x7f7e640c1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e6928d700 1 -- 172.21.15.153:0/2959674572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e540092a0 con 0x7f7e640639a0 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.019+0000 7f7e69a8e700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e640c4690 0x7f7e64166b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e6928d700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 0x7f7e64163e90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f7e60001ed0 tx=0x7f7e60007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600072e0 con 0x7f7e640639a0 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60007440 con 0x7f7e640639a0 2023-08-17T00:16:41.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e600057a0 con 0x7f7e640639a0 2023-08-17T00:16:41.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e640aeeb0 con 0x7f7e640639a0 2023-08-17T00:16:41.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e640c1e20 con 0x7f7e640639a0 2023-08-17T00:16:41.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6406b4c0 con 0x7f7e640639a0 2023-08-17T00:16:41.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.023+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7e60010070 con 0x7f7e640639a0 2023-08-17T00:16:41.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.027+0000 7f7e597fa700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e4805a150 0x7f7e4805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.027+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7e60073700 con 0x7f7e640639a0 2023-08-17T00:16:41.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.027+0000 7f7e68a8c700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e4805a150 0x7f7e4805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.027+0000 7f7e68a8c700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e4805a150 0x7f7e4805c610 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f7e640bf9f0 tx=0x7f7e54017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.031+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7e600471b0 con 0x7f7e640639a0 2023-08-17T00:16:41.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.195+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e64154560 con 0x7f7e640639a0 2023-08-17T00:16:41.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.195+0000 7f7e597fa700 1 -- 172.21.15.153:0/2959674572 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v178) v1 ==== 74+0+16990 (secure 0 0 0) 0x7f7e60018070 con 0x7f7e640639a0 2023-08-17T00:16:41.203 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:41.204 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":178,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:38.318447+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:16:35.234407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-17T00:16:36.324685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:41.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e4805a150 msgr2=0x7f7e4805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e4805a150 0x7f7e4805c610 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 rx=0x7f7e640bf9f0 tx=0x7f7e54017000).stop 2023-08-17T00:16:41.206 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 msgr2=0x7f7e64163e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 0x7f7e64163e90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 rx=0x7f7e60001ed0 tx=0x7f7e60007c70).stop 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 shutdown_connections 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7e4805a150 0x7f7e4805c610 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e640c4690 0x7f7e64166b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e640acf30 0x7f7e640c1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 --2- 172.21.15.153:0/2959674572 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7e640639a0 0x7f7e64163e90 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.207 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 >> 172.21.15.153:0/2959674572 conn(0x7f7e640cb330 msgr2=0x7f7e64153920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 shutdown_connections 2023-08-17T00:16:41.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.199+0000 7f7e6a28f700 1 -- 172.21.15.153:0/2959674572 wait complete. 2023-08-17T00:16:41.224 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:16:41.224 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:16:41.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.375+0000 7f3e7e45b700 1 Processor -- start 2023-08-17T00:16:41.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.375+0000 7f3e7e45b700 1 -- start start 2023-08-17T00:16:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e7e45b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3e780c2b70 0x7f3e781542c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e7e45b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e780665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e7e45b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e78155280 con 0x7f3e781547b0 2023-08-17T00:16:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e7e45b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e78066140 con 0x7f3e780c2b70 2023-08-17T00:16:41.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e7e45b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78154cc0 con 0x7f3e780636c0 2023-08-17T00:16:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e6f7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3e781547b0 0x7f3e78062fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45332/0 (socket says 172.21.15.153:45332) 2023-08-17T00:16:41.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e6f7fe700 1 -- 172.21.15.153:0/2295255465 learned_addr learned my addr 172.21.15.153:0/2295255465 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e77fff700 1 --2- 172.21.15.153:0/2295255465 >> v2:172.21.15.153:3300/0 conn(0x7f3e780c2b70 0x7f3e781542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e7c9f8700 1 --2- 172.21.15.153:0/2295255465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e780665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.379+0000 7f3e777fe700 1 -- 172.21.15.153:0/2295255465 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125207758 0 0) 0x7f3e78155280 con 0x7f3e781547b0 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e777fe700 1 -- 172.21.15.153:0/2295255465 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e640033f0 con 0x7f3e781547b0 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e77fff700 1 -- 172.21.15.153:0/2295255465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 msgr2=0x7f3e780665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e77fff700 1 --2- 172.21.15.153:0/2295255465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e780665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e77fff700 1 -- 172.21.15.153:0/2295255465 >> v1:172.21.15.153:6789/0 conn(0x7f3e781547b0 legacy=0x7f3e78062fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e77fff700 1 -- 172.21.15.153:0/2295255465 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78154fa0 con 0x7f3e780c2b70 2023-08-17T00:16:41.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e77fff700 1 --2- 172.21.15.153:0/2295255465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e780c2b70 0x7f3e781542c0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f3e68009760 tx=0x7f3e68009060).ready entity=mon.0 client_cookie=6c421fc0a15e666f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e777fe700 1 -- 172.21.15.153:0/2295255465 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680090d0 con 0x7f3e780c2b70 2023-08-17T00:16:41.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e777fe700 1 -- 172.21.15.153:0/2295255465 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6800d4a0 con 0x7f3e780c2b70 2023-08-17T00:16:41.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e777fe700 1 -- 172.21.15.153:0/2295255465 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6800d820 con 0x7f3e780c2b70 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 -- 172.21.15.153:0/2295255465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e780c2b70 msgr2=0x7f3e781542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/2295255465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e780c2b70 0x7f3e781542c0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 rx=0x7f3e68009760 tx=0x7f3e68009060).stop 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 -- 172.21.15.153:0/2295255465 shutdown_connections 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/2295255465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e780665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/2295255465 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e780c2b70 0x7f3e781542c0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 -- 172.21.15.153:0/2295255465 >> 172.21.15.153:0/2295255465 conn(0x7f3e780c41d0 msgr2=0x7f3e78068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:41.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 -- 172.21.15.153:0/2295255465 shutdown_connections 2023-08-17T00:16:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.383+0000 7f3e7e45b700 1 -- 172.21.15.153:0/2295255465 wait complete. 2023-08-17T00:16:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 Processor -- start 2023-08-17T00:16:41.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 -- start start 2023-08-17T00:16:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e7813ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e780c2b70 0x7f3e781507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 0x7f3e780a6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e780bdeb0 con 0x7f3e781547b0 2023-08-17T00:16:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78151120 con 0x7f3e780c2b70 2023-08-17T00:16:41.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7e45b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78151400 con 0x7f3e780636c0 2023-08-17T00:16:41.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 0x7f3e780a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e77fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e7813ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 0x7f3e780a6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39242/0 (socket says 172.21.15.153:39242) 2023-08-17T00:16:41.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 -- 172.21.15.153:0/1802978463 learned_addr learned my addr 172.21.15.153:0/1802978463 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e6f7fe700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e780c2b70 0x7f3e781507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 -- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 msgr2=0x7f3e7813ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e7813ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 -- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e780c2b70 msgr2=0x7f3e781507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e780c2b70 0x7f3e781507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 -- 172.21.15.153:0/1802978463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e680092a0 con 0x7f3e781547b0 2023-08-17T00:16:41.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e7c9f8700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 0x7f3e780a6740 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f3e70009ec0 tx=0x7f3e7000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7000cb70 con 0x7f3e781547b0 2023-08-17T00:16:41.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.387+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7000f040 con 0x7f3e781547b0 2023-08-17T00:16:41.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.391+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e781516e0 con 0x7f3e781547b0 2023-08-17T00:16:41.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.391+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e70013400 con 0x7f3e781547b0 2023-08-17T00:16:41.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.391+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7813d300 con 0x7f3e781547b0 2023-08-17T00:16:41.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.391+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e780be060 con 0x7f3e781547b0 2023-08-17T00:16:41.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.391+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3e70013770 con 0x7f3e781547b0 2023-08-17T00:16:41.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.395+0000 7f3e74ff9700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e5805a120 0x7f3e5805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.395+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3e70074bb0 con 0x7f3e781547b0 2023-08-17T00:16:41.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.395+0000 7f3e77fff700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e5805a120 0x7f3e5805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.395+0000 7f3e77fff700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e5805a120 0x7f3e5805c5e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f3e6800d260 tx=0x7f3e68016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.399+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3e780be060 con 0x7f3e781547b0 2023-08-17T00:16:41.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.563+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e780bdff0 con 0x7f3e5805a120 2023-08-17T00:16:41.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.579+0000 7f3e74ff9700 1 -- 172.21.15.153:0/1802978463 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359366 (secure 0 0 0) 0x7f3e780bdff0 con 0x7f3e5805a120 2023-08-17T00:16:41.593 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:41.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e5805a120 msgr2=0x7f3e5805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e5805a120 0x7f3e5805c5e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f3e6800d260 tx=0x7f3e68016000).stop 2023-08-17T00:16:41.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 msgr2=0x7f3e780a6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 0x7f3e780a6740 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 rx=0x7f3e70009ec0 tx=0x7f3e7000b040).stop 2023-08-17T00:16:41.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 shutdown_connections 2023-08-17T00:16:41.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3e5805a120 0x7f3e5805c5e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3e781547b0 0x7f3e780a6740 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e780c2b70 0x7f3e781507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 --2- 172.21.15.153:0/1802978463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e780636c0 0x7f3e7813ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 >> 172.21.15.153:0/1802978463 conn(0x7f3e780c41d0 msgr2=0x7f3e78153310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:41.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 shutdown_connections 2023-08-17T00:16:41.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.587+0000 7f3e7e45b700 1 -- 172.21.15.153:0/1802978463 wait complete. 2023-08-17T00:16:41.597 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:16:41.614 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2023-08-17T00:16:41.492962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464892,"kb_used_data":17468,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752509828,"statfs":{"total":773094113280,"available":770570063872,"internally_reserved":0,"allocated":17887232,"data_stored":8389052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308378,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-87,"num_write_kb":-6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.928189"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352198+0000","last_change":"2023-08-17T00:16:37.343457+0000","last_active":"2023-08-17T00:16:37.352198+0000","last_peered":"2023-08-17T00:16:37.352198+0000","last_clean":"2023-08-17T00:16:37.352198+0000","last_became_active":"2023-08-17T00:16:37.342785+0000","last_became_peered":"2023-08-17T00:16:37.342785+0000","last_unstale":"2023-08-17T00:16:37.352198+0000","last_undegraded":"2023-08-17T00:16:37.352198+0000","last_fullsized":"2023-08-17T00:16:37.352198+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3f","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362505+0000","last_change":"2023-08-17T00:16:36.906836+0000","last_active":"2023-08-17T00:16:37.362505+0000","last_peered":"2023-08-17T00:16:37.362505+0000","last_clean":"2023-08-17T00:16:37.362505+0000","last_became_active":"2023-08-17T00:16:36.906487+0000","last_became_peered":"2023-08-17T00:16:36.906487+0000","last_unstale":"2023-08-17T00:16:37.362505+0000","last_undegraded":"2023-08-17T00:16:37.362505+0000","last_fullsized":"2023-08-17T00:16:37.362505+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363158+0000","last_change":"2023-08-17T00:16:37.360342+0000","last_active":"2023-08-17T00:16:37.363158+0000","last_peered":"2023-08-17T00:16:37.363158+0000","last_clean":"2023-08-17T00:16:37.363158+0000","last_became_active":"2023-08-17T00:16:37.359986+0000","last_became_peered":"2023-08-17T00:16:37.359986+0000","last_unstale":"2023-08-17T00:16:37.363158+0000","last_undegraded":"2023-08-17T00:16:37.363158+0000","last_fullsized":"2023-08-17T00:16:37.363158+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337001+0000","last_change":"2023-08-17T00:16:36.908669+0000","last_active":"2023-08-17T00:16:37.337001+0000","last_peered":"2023-08-17T00:16:37.337001+0000","last_clean":"2023-08-17T00:16:37.337001+0000","last_became_active":"2023-08-17T00:16:36.908341+0000","last_became_peered":"2023-08-17T00:16:36.908341+0000","last_unstale":"2023-08-17T00:16:37.337001+0000","last_undegraded":"2023-08-17T00:16:37.337001+0000","last_fullsized":"2023-08-17T00:16:37.337001+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358567+0000","last_change":"2023-08-17T00:16:37.357079+0000","last_active":"2023-08-17T00:16:37.358567+0000","last_peered":"2023-08-17T00:16:37.358567+0000","last_clean":"2023-08-17T00:16:37.358567+0000","last_became_active":"2023-08-17T00:16:37.356740+0000","last_became_peered":"2023-08-17T00:16:37.356740+0000","last_unstale":"2023-08-17T00:16:37.358567+0000","last_undegraded":"2023-08-17T00:16:37.358567+0000","last_fullsized":"2023-08-17T00:16:37.358567+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334519+0000","last_change":"2023-08-17T00:16:36.911265+0000","last_active":"2023-08-17T00:16:37.334519+0000","last_peered":"2023-08-17T00:16:37.334519+0000","last_clean":"2023-08-17T00:16:37.334519+0000","last_became_active":"2023-08-17T00:16:36.911003+0000","last_became_peered":"2023-08-17T00:16:36.911003+0000","last_unstale":"2023-08-17T00:16:37.334519+0000","last_undegraded":"2023-08-17T00:16:37.334519+0000","last_fullsized":"2023-08-17T00:16:37.334519+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353984+0000","last_change":"2023-08-17T00:16:37.347428+0000","last_active":"2023-08-17T00:16:37.353984+0000","last_peered":"2023-08-17T00:16:37.353984+0000","last_clean":"2023-08-17T00:16:37.353984+0000","last_became_active":"2023-08-17T00:16:37.347161+0000","last_became_peered":"2023-08-17T00:16:37.347161+0000","last_unstale":"2023-08-17T00:16:37.353984+0000","last_undegraded":"2023-08-17T00:16:37.353984+0000","last_fullsized":"2023-08-17T00:16:37.353984+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354924+0000","last_change":"2023-08-17T00:16:36.901036+0000","last_active":"2023-08-17T00:16:37.354924+0000","last_peered":"2023-08-17T00:16:37.354924+0000","last_clean":"2023-08-17T00:16:37.354924+0000","last_became_active":"2023-08-17T00:16:36.900747+0000","last_became_peered":"2023-08-17T00:16:36.900747+0000","last_unstale":"2023-08-17T00:16:37.354924+0000","last_undegraded":"2023-08-17T00:16:37.354924+0000","last_fullsized":"2023-08-17T00:16:37.354924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348914+0000","last_change":"2023-08-17T00:16:37.340785+0000","last_active":"2023-08-17T00:16:37.348914+0000","last_peered":"2023-08-17T00:16:37.348914+0000","last_clean":"2023-08-17T00:16:37.348914+0000","last_became_active":"2023-08-17T00:16:37.340436+0000","last_became_peered":"2023-08-17T00:16:37.340436+0000","last_unstale":"2023-08-17T00:16:37.348914+0000","last_undegraded":"2023-08-17T00:16:37.348914+0000","last_fullsized":"2023-08-17T00:16:37.348914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362348+0000","last_change":"2023-08-17T00:16:36.921543+0000","last_active":"2023-08-17T00:16:37.362348+0000","last_peered":"2023-08-17T00:16:37.362348+0000","last_clean":"2023-08-17T00:16:37.362348+0000","last_became_active":"2023-08-17T00:16:36.920994+0000","last_became_peered":"2023-08-17T00:16:36.920994+0000","last_unstale":"2023-08-17T00:16:37.362348+0000","last_undegraded":"2023-08-17T00:16:37.362348+0000","last_fullsized":"2023-08-17T00:16:37.362348+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348945+0000","last_change":"2023-08-17T00:16:37.342603+0000","last_active":"2023-08-17T00:16:37.348945+0000","last_peered":"2023-08-17T00:16:37.348945+0000","last_clean":"2023-08-17T00:16:37.348945+0000","last_became_active":"2023-08-17T00:16:37.342267+0000","last_became_peered":"2023-08-17T00:16:37.342267+0000","last_unstale":"2023-08-17T00:16:37.348945+0000","last_undegraded":"2023-08-17T00:16:37.348945+0000","last_fullsized":"2023-08-17T00:16:37.348945+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3a","version":"177'1","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326543+0000","last_change":"2023-08-17T00:16:36.903798+0000","last_active":"2023-08-17T00:16:37.326543+0000","last_peered":"2023-08-17T00:16:37.326543+0000","last_clean":"2023-08-17T00:16:37.326543+0000","last_became_active":"2023-08-17T00:16:36.903500+0000","last_became_peered":"2023-08-17T00:16:36.903500+0000","last_unstale":"2023-08-17T00:16:37.326543+0000","last_undegraded":"2023-08-17T00:16:37.326543+0000","last_fullsized":"2023-08-17T00:16:37.326543+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354216+0000","last_change":"2023-08-17T00:16:37.350684+0000","last_active":"2023-08-17T00:16:37.354216+0000","last_peered":"2023-08-17T00:16:37.354216+0000","last_clean":"2023-08-17T00:16:37.354216+0000","last_became_active":"2023-08-17T00:16:37.350390+0000","last_became_peered":"2023-08-17T00:16:37.350390+0000","last_unstale":"2023-08-17T00:16:37.354216+0000","last_undegraded":"2023-08-17T00:16:37.354216+0000","last_fullsized":"2023-08-17T00:16:37.354216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.323019+0000","last_change":"2023-08-17T00:16:36.906274+0000","last_active":"2023-08-17T00:16:37.323019+0000","last_peered":"2023-08-17T00:16:37.323019+0000","last_clean":"2023-08-17T00:16:37.323019+0000","last_became_active":"2023-08-17T00:16:36.905206+0000","last_became_peered":"2023-08-17T00:16:36.905206+0000","last_unstale":"2023-08-17T00:16:37.323019+0000","last_undegraded":"2023-08-17T00:16:37.323019+0000","last_fullsized":"2023-08-17T00:16:37.323019+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353661+0000","last_change":"2023-08-17T00:16:37.345506+0000","last_active":"2023-08-17T00:16:37.353661+0000","last_peered":"2023-08-17T00:16:37.353661+0000","last_clean":"2023-08-17T00:16:37.353661+0000","last_became_active":"2023-08-17T00:16:37.345235+0000","last_became_peered":"2023-08-17T00:16:37.345235+0000","last_unstale":"2023-08-17T00:16:37.353661+0000","last_undegraded":"2023-08-17T00:16:37.353661+0000","last_fullsized":"2023-08-17T00:16:37.353661+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336942+0000","last_change":"2023-08-17T00:16:36.921539+0000","last_active":"2023-08-17T00:16:37.336942+0000","last_peered":"2023-08-17T00:16:37.336942+0000","last_clean":"2023-08-17T00:16:37.336942+0000","last_became_active":"2023-08-17T00:16:36.921240+0000","last_became_peered":"2023-08-17T00:16:36.921240+0000","last_unstale":"2023-08-17T00:16:37.336942+0000","last_undegraded":"2023-08-17T00:16:37.336942+0000","last_fullsized":"2023-08-17T00:16:37.336942+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.346062+0000","last_change":"2023-08-17T00:16:37.346062+0000","last_active":"2023-08-17T00:16:37.346062+0000","last_peered":"2023-08-17T00:16:37.346062+0000","last_clean":"2023-08-17T00:16:37.346062+0000","last_became_active":"2023-08-17T00:16:37.345650+0000","last_became_peered":"2023-08-17T00:16:37.345650+0000","last_unstale":"2023-08-17T00:16:37.346062+0000","last_undegraded":"2023-08-17T00:16:37.346062+0000","last_fullsized":"2023-08-17T00:16:37.346062+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.339489+0000","last_change":"2023-08-17T00:16:36.914498+0000","last_active":"2023-08-17T00:16:37.339489+0000","last_peered":"2023-08-17T00:16:37.339489+0000","last_clean":"2023-08-17T00:16:37.339489+0000","last_became_active":"2023-08-17T00:16:36.913039+0000","last_became_peered":"2023-08-17T00:16:36.913039+0000","last_unstale":"2023-08-17T00:16:37.339489+0000","last_undegraded":"2023-08-17T00:16:37.339489+0000","last_fullsized":"2023-08-17T00:16:37.339489+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358746+0000","last_change":"2023-08-17T00:16:37.352236+0000","last_active":"2023-08-17T00:16:37.358746+0000","last_peered":"2023-08-17T00:16:37.358746+0000","last_clean":"2023-08-17T00:16:37.358746+0000","last_became_active":"2023-08-17T00:16:37.351920+0000","last_became_peered":"2023-08-17T00:16:37.351920+0000","last_unstale":"2023-08-17T00:16:37.358746+0000","last_undegraded":"2023-08-17T00:16:37.358746+0000","last_fullsized":"2023-08-17T00:16:37.358746+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326091+0000","last_change":"2023-08-17T00:16:36.917520+0000","last_active":"2023-08-17T00:16:37.326091+0000","last_peered":"2023-08-17T00:16:37.326091+0000","last_clean":"2023-08-17T00:16:37.326091+0000","last_became_active":"2023-08-17T00:16:36.917223+0000","last_became_peered":"2023-08-17T00:16:36.917223+0000","last_unstale":"2023-08-17T00:16:37.326091+0000","last_undegraded":"2023-08-17T00:16:37.326091+0000","last_fullsized":"2023-08-17T00:16:37.326091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.342705+0000","last_change":"2023-08-17T00:16:37.342705+0000","last_active":"2023-08-17T00:16:37.342705+0000","last_peered":"2023-08-17T00:16:37.342705+0000","last_clean":"2023-08-17T00:16:37.342705+0000","last_became_active":"2023-08-17T00:16:37.342399+0000","last_became_peered":"2023-08-17T00:16:37.342399+0000","last_unstale":"2023-08-17T00:16:37.342705+0000","last_undegraded":"2023-08-17T00:16:37.342705+0000","last_fullsized":"2023-08-17T00:16:37.342705+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353769+0000","last_change":"2023-08-17T00:16:36.903458+0000","last_active":"2023-08-17T00:16:37.353769+0000","last_peered":"2023-08-17T00:16:37.353769+0000","last_clean":"2023-08-17T00:16:37.353769+0000","last_became_active":"2023-08-17T00:16:36.903092+0000","last_became_peered":"2023-08-17T00:16:36.903092+0000","last_unstale":"2023-08-17T00:16:37.353769+0000","last_undegraded":"2023-08-17T00:16:37.353769+0000","last_fullsized":"2023-08-17T00:16:37.353769+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.342593+0000","last_change":"2023-08-17T00:16:37.337074+0000","last_active":"2023-08-17T00:16:37.342593+0000","last_peered":"2023-08-17T00:16:37.342593+0000","last_clean":"2023-08-17T00:16:37.342593+0000","last_became_active":"2023-08-17T00:16:37.336777+0000","last_became_peered":"2023-08-17T00:16:37.336777+0000","last_unstale":"2023-08-17T00:16:37.342593+0000","last_undegraded":"2023-08-17T00:16:37.342593+0000","last_fullsized":"2023-08-17T00:16:37.342593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.34","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.365162+0000","last_change":"2023-08-17T00:16:36.911449+0000","last_active":"2023-08-17T00:16:37.365162+0000","last_peered":"2023-08-17T00:16:37.365162+0000","last_clean":"2023-08-17T00:16:37.365162+0000","last_became_active":"2023-08-17T00:16:36.910872+0000","last_became_peered":"2023-08-17T00:16:36.910872+0000","last_unstale":"2023-08-17T00:16:37.365162+0000","last_undegraded":"2023-08-17T00:16:37.365162+0000","last_fullsized":"2023-08-17T00:16:37.365162+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.349081+0000","last_change":"2023-08-17T00:16:37.349081+0000","last_active":"2023-08-17T00:16:37.349081+0000","last_peered":"2023-08-17T00:16:37.349081+0000","last_clean":"2023-08-17T00:16:37.349081+0000","last_became_active":"2023-08-17T00:16:37.348804+0000","last_became_peered":"2023-08-17T00:16:37.348804+0000","last_unstale":"2023-08-17T00:16:37.349081+0000","last_undegraded":"2023-08-17T00:16:37.349081+0000","last_fullsized":"2023-08-17T00:16:37.349081+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.33","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357278+0000","last_change":"2023-08-17T00:16:36.906896+0000","last_active":"2023-08-17T00:16:37.357278+0000","last_peered":"2023-08-17T00:16:37.357278+0000","last_clean":"2023-08-17T00:16:37.357278+0000","last_became_active":"2023-08-17T00:16:36.906570+0000","last_became_peered":"2023-08-17T00:16:36.906570+0000","last_unstale":"2023-08-17T00:16:37.357278+0000","last_undegraded":"2023-08-17T00:16:37.357278+0000","last_fullsized":"2023-08-17T00:16:37.357278+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358992+0000","last_change":"2023-08-17T00:16:37.356415+0000","last_active":"2023-08-17T00:16:37.358992+0000","last_peered":"2023-08-17T00:16:37.358992+0000","last_clean":"2023-08-17T00:16:37.358992+0000","last_became_active":"2023-08-17T00:16:37.356110+0000","last_became_peered":"2023-08-17T00:16:37.356110+0000","last_unstale":"2023-08-17T00:16:37.358992+0000","last_undegraded":"2023-08-17T00:16:37.358992+0000","last_fullsized":"2023-08-17T00:16:37.358992+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336705+0000","last_change":"2023-08-17T00:16:36.906850+0000","last_active":"2023-08-17T00:16:37.336705+0000","last_peered":"2023-08-17T00:16:37.336705+0000","last_clean":"2023-08-17T00:16:37.336705+0000","last_became_active":"2023-08-17T00:16:36.906580+0000","last_became_peered":"2023-08-17T00:16:36.906580+0000","last_unstale":"2023-08-17T00:16:37.336705+0000","last_undegraded":"2023-08-17T00:16:37.336705+0000","last_fullsized":"2023-08-17T00:16:37.336705+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354243+0000","last_change":"2023-08-17T00:16:37.350738+0000","last_active":"2023-08-17T00:16:37.354243+0000","last_peered":"2023-08-17T00:16:37.354243+0000","last_clean":"2023-08-17T00:16:37.354243+0000","last_became_active":"2023-08-17T00:16:37.350459+0000","last_became_peered":"2023-08-17T00:16:37.350459+0000","last_unstale":"2023-08-17T00:16:37.354243+0000","last_undegraded":"2023-08-17T00:16:37.354243+0000","last_fullsized":"2023-08-17T00:16:37.354243+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.347259+0000","last_change":"2023-08-17T00:16:36.901969+0000","last_active":"2023-08-17T00:16:37.347259+0000","last_peered":"2023-08-17T00:16:37.347259+0000","last_clean":"2023-08-17T00:16:37.347259+0000","last_became_active":"2023-08-17T00:16:36.901659+0000","last_became_peered":"2023-08-17T00:16:36.901659+0000","last_unstale":"2023-08-17T00:16:37.347259+0000","last_undegraded":"2023-08-17T00:16:37.347259+0000","last_fullsized":"2023-08-17T00:16:37.347259+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.349207+0000","last_change":"2023-08-17T00:16:37.345522+0000","last_active":"2023-08-17T00:16:37.349207+0000","last_peered":"2023-08-17T00:16:37.349207+0000","last_clean":"2023-08-17T00:16:37.349207+0000","last_became_active":"2023-08-17T00:16:37.345250+0000","last_became_peered":"2023-08-17T00:16:37.345250+0000","last_unstale":"2023-08-17T00:16:37.349207+0000","last_undegraded":"2023-08-17T00:16:37.349207+0000","last_fullsized":"2023-08-17T00:16:37.349207+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.359748+0000","last_change":"2023-08-17T00:16:36.907697+0000","last_active":"2023-08-17T00:16:37.359748+0000","last_peered":"2023-08-17T00:16:37.359748+0000","last_clean":"2023-08-17T00:16:37.359748+0000","last_became_active":"2023-08-17T00:16:36.907405+0000","last_became_peered":"2023-08-17T00:16:36.907405+0000","last_unstale":"2023-08-17T00:16:37.359748+0000","last_undegraded":"2023-08-17T00:16:37.359748+0000","last_fullsized":"2023-08-17T00:16:37.359748+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354118+0000","last_change":"2023-08-17T00:16:37.343767+0000","last_active":"2023-08-17T00:16:37.354118+0000","last_peered":"2023-08-17T00:16:37.354118+0000","last_clean":"2023-08-17T00:16:37.354118+0000","last_became_active":"2023-08-17T00:16:37.343116+0000","last_became_peered":"2023-08-17T00:16:37.343116+0000","last_unstale":"2023-08-17T00:16:37.354118+0000","last_undegraded":"2023-08-17T00:16:37.354118+0000","last_fullsized":"2023-08-17T00:16:37.354118+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.909092+0000","last_change":"2023-08-17T00:16:36.906637+0000","last_active":"2023-08-17T00:16:36.909092+0000","last_peered":"2023-08-17T00:16:36.909092+0000","last_clean":"2023-08-17T00:16:36.909092+0000","last_became_active":"2023-08-17T00:16:36.906354+0000","last_became_peered":"2023-08-17T00:16:36.906354+0000","last_unstale":"2023-08-17T00:16:36.909092+0000","last_undegraded":"2023-08-17T00:16:36.909092+0000","last_fullsized":"2023-08-17T00:16:36.909092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353886+0000","last_change":"2023-08-17T00:16:37.349564+0000","last_active":"2023-08-17T00:16:37.353886+0000","last_peered":"2023-08-17T00:16:37.353886+0000","last_clean":"2023-08-17T00:16:37.353886+0000","last_became_active":"2023-08-17T00:16:37.348934+0000","last_became_peered":"2023-08-17T00:16:37.348934+0000","last_unstale":"2023-08-17T00:16:37.353886+0000","last_undegraded":"2023-08-17T00:16:37.353886+0000","last_fullsized":"2023-08-17T00:16:37.353886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.323982+0000","last_change":"2023-08-17T00:16:36.908012+0000","last_active":"2023-08-17T00:16:37.323982+0000","last_peered":"2023-08-17T00:16:37.323982+0000","last_clean":"2023-08-17T00:16:37.323982+0000","last_became_active":"2023-08-17T00:16:36.907743+0000","last_became_peered":"2023-08-17T00:16:36.907743+0000","last_unstale":"2023-08-17T00:16:37.323982+0000","last_undegraded":"2023-08-17T00:16:37.323982+0000","last_fullsized":"2023-08-17T00:16:37.323982+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358598+0000","last_change":"2023-08-17T00:16:37.350395+0000","last_active":"2023-08-17T00:16:37.358598+0000","last_peered":"2023-08-17T00:16:37.358598+0000","last_clean":"2023-08-17T00:16:37.358598+0000","last_became_active":"2023-08-17T00:16:37.349932+0000","last_became_peered":"2023-08-17T00:16:37.349932+0000","last_unstale":"2023-08-17T00:16:37.358598+0000","last_undegraded":"2023-08-17T00:16:37.358598+0000","last_fullsized":"2023-08-17T00:16:37.358598+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357261+0000","last_change":"2023-08-17T00:16:36.914297+0000","last_active":"2023-08-17T00:16:37.357261+0000","last_peered":"2023-08-17T00:16:37.357261+0000","last_clean":"2023-08-17T00:16:37.357261+0000","last_became_active":"2023-08-17T00:16:36.913507+0000","last_became_peered":"2023-08-17T00:16:36.913507+0000","last_unstale":"2023-08-17T00:16:37.357261+0000","last_undegraded":"2023-08-17T00:16:37.357261+0000","last_fullsized":"2023-08-17T00:16:37.357261+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358852+0000","last_change":"2023-08-17T00:16:37.356602+0000","last_active":"2023-08-17T00:16:37.358852+0000","last_peered":"2023-08-17T00:16:37.358852+0000","last_clean":"2023-08-17T00:16:37.358852+0000","last_became_active":"2023-08-17T00:16:37.356282+0000","last_became_peered":"2023-08-17T00:16:37.356282+0000","last_unstale":"2023-08-17T00:16:37.358852+0000","last_undegraded":"2023-08-17T00:16:37.358852+0000","last_fullsized":"2023-08-17T00:16:37.358852+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336994+0000","last_change":"2023-08-17T00:16:36.922780+0000","last_active":"2023-08-17T00:16:37.336994+0000","last_peered":"2023-08-17T00:16:37.336994+0000","last_clean":"2023-08-17T00:16:37.336994+0000","last_became_active":"2023-08-17T00:16:36.922497+0000","last_became_peered":"2023-08-17T00:16:36.922497+0000","last_unstale":"2023-08-17T00:16:37.336994+0000","last_undegraded":"2023-08-17T00:16:37.336994+0000","last_fullsized":"2023-08-17T00:16:37.336994+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357462+0000","last_change":"2023-08-17T00:16:37.355521+0000","last_active":"2023-08-17T00:16:37.357462+0000","last_peered":"2023-08-17T00:16:37.357462+0000","last_clean":"2023-08-17T00:16:37.357462+0000","last_became_active":"2023-08-17T00:16:37.355239+0000","last_became_peered":"2023-08-17T00:16:37.355239+0000","last_unstale":"2023-08-17T00:16:37.357462+0000","last_undegraded":"2023-08-17T00:16:37.357462+0000","last_fullsized":"2023-08-17T00:16:37.357462+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357249+0000","last_change":"2023-08-17T00:16:36.909022+0000","last_active":"2023-08-17T00:16:37.357249+0000","last_peered":"2023-08-17T00:16:37.357249+0000","last_clean":"2023-08-17T00:16:37.357249+0000","last_became_active":"2023-08-17T00:16:36.908742+0000","last_became_peered":"2023-08-17T00:16:36.908742+0000","last_unstale":"2023-08-17T00:16:37.357249+0000","last_undegraded":"2023-08-17T00:16:37.357249+0000","last_fullsized":"2023-08-17T00:16:37.357249+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354191+0000","last_change":"2023-08-17T00:16:37.348081+0000","last_active":"2023-08-17T00:16:37.354191+0000","last_peered":"2023-08-17T00:16:37.354191+0000","last_clean":"2023-08-17T00:16:37.354191+0000","last_became_active":"2023-08-17T00:16:37.347815+0000","last_became_peered":"2023-08-17T00:16:37.347815+0000","last_unstale":"2023-08-17T00:16:37.354191+0000","last_undegraded":"2023-08-17T00:16:37.354191+0000","last_fullsized":"2023-08-17T00:16:37.354191+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.339371+0000","last_change":"2023-08-17T00:16:36.922211+0000","last_active":"2023-08-17T00:16:37.339371+0000","last_peered":"2023-08-17T00:16:37.339371+0000","last_clean":"2023-08-17T00:16:37.339371+0000","last_became_active":"2023-08-17T00:16:36.921927+0000","last_became_peered":"2023-08-17T00:16:36.921927+0000","last_unstale":"2023-08-17T00:16:37.339371+0000","last_undegraded":"2023-08-17T00:16:37.339371+0000","last_fullsized":"2023-08-17T00:16:37.339371+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357483+0000","last_change":"2023-08-17T00:16:37.355504+0000","last_active":"2023-08-17T00:16:37.357483+0000","last_peered":"2023-08-17T00:16:37.357483+0000","last_clean":"2023-08-17T00:16:37.357483+0000","last_became_active":"2023-08-17T00:16:37.355166+0000","last_became_peered":"2023-08-17T00:16:37.355166+0000","last_unstale":"2023-08-17T00:16:37.357483+0000","last_undegraded":"2023-08-17T00:16:37.357483+0000","last_fullsized":"2023-08-17T00:16:37.357483+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326431+0000","last_change":"2023-08-17T00:16:36.922705+0000","last_active":"2023-08-17T00:16:37.326431+0000","last_peered":"2023-08-17T00:16:37.326431+0000","last_clean":"2023-08-17T00:16:37.326431+0000","last_became_active":"2023-08-17T00:16:36.922404+0000","last_became_peered":"2023-08-17T00:16:36.922404+0000","last_unstale":"2023-08-17T00:16:37.326431+0000","last_undegraded":"2023-08-17T00:16:37.326431+0000","last_fullsized":"2023-08-17T00:16:37.326431+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348759+0000","last_change":"2023-08-17T00:16:37.339783+0000","last_active":"2023-08-17T00:16:37.348759+0000","last_peered":"2023-08-17T00:16:37.348759+0000","last_clean":"2023-08-17T00:16:37.348759+0000","last_became_active":"2023-08-17T00:16:37.339447+0000","last_became_peered":"2023-08-17T00:16:37.339447+0000","last_unstale":"2023-08-17T00:16:37.348759+0000","last_undegraded":"2023-08-17T00:16:37.348759+0000","last_fullsized":"2023-08-17T00:16:37.348759+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336730+0000","last_change":"2023-08-17T00:16:36.913378+0000","last_active":"2023-08-17T00:16:37.336730+0000","last_peered":"2023-08-17T00:16:37.336730+0000","last_clean":"2023-08-17T00:16:37.336730+0000","last_became_active":"2023-08-17T00:16:36.912759+0000","last_became_peered":"2023-08-17T00:16:36.912759+0000","last_unstale":"2023-08-17T00:16:37.336730+0000","last_undegraded":"2023-08-17T00:16:37.336730+0000","last_fullsized":"2023-08-17T00:16:37.336730+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.340071+0000","last_change":"2023-08-17T00:16:37.340071+0000","last_active":"2023-08-17T00:16:37.340071+0000","last_peered":"2023-08-17T00:16:37.340071+0000","last_clean":"2023-08-17T00:16:37.340071+0000","last_became_active":"2023-08-17T00:16:37.339773+0000","last_became_peered":"2023-08-17T00:16:37.339773+0000","last_unstale":"2023-08-17T00:16:37.340071+0000","last_undegraded":"2023-08-17T00:16:37.340071+0000","last_fullsized":"2023-08-17T00:16:37.340071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.339575+0000","last_change":"2023-08-17T00:16:36.914839+0000","last_active":"2023-08-17T00:16:37.339575+0000","last_peered":"2023-08-17T00:16:37.339575+0000","last_clean":"2023-08-17T00:16:37.339575+0000","last_became_active":"2023-08-17T00:16:36.913453+0000","last_became_peered":"2023-08-17T00:16:36.913453+0000","last_unstale":"2023-08-17T00:16:37.339575+0000","last_undegraded":"2023-08-17T00:16:37.339575+0000","last_fullsized":"2023-08-17T00:16:37.339575+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.359465+0000","last_change":"2023-08-17T00:16:37.346811+0000","last_active":"2023-08-17T00:16:37.359465+0000","last_peered":"2023-08-17T00:16:37.359465+0000","last_clean":"2023-08-17T00:16:37.359465+0000","last_became_active":"2023-08-17T00:16:37.346544+0000","last_became_peered":"2023-08-17T00:16:37.346544+0000","last_unstale":"2023-08-17T00:16:37.359465+0000","last_undegraded":"2023-08-17T00:16:37.359465+0000","last_fullsized":"2023-08-17T00:16:37.359465+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.330104+0000","last_change":"2023-08-17T00:16:36.909889+0000","last_active":"2023-08-17T00:16:37.330104+0000","last_peered":"2023-08-17T00:16:37.330104+0000","last_clean":"2023-08-17T00:16:37.330104+0000","last_became_active":"2023-08-17T00:16:36.909616+0000","last_became_peered":"2023-08-17T00:16:36.909616+0000","last_unstale":"2023-08-17T00:16:37.330104+0000","last_undegraded":"2023-08-17T00:16:37.330104+0000","last_fullsized":"2023-08-17T00:16:37.330104+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358581+0000","last_change":"2023-08-17T00:16:37.350229+0000","last_active":"2023-08-17T00:16:37.358581+0000","last_peered":"2023-08-17T00:16:37.358581+0000","last_clean":"2023-08-17T00:16:37.358581+0000","last_became_active":"2023-08-17T00:16:37.349564+0000","last_became_peered":"2023-08-17T00:16:37.349564+0000","last_unstale":"2023-08-17T00:16:37.358581+0000","last_undegraded":"2023-08-17T00:16:37.358581+0000","last_fullsized":"2023-08-17T00:16:37.358581+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334611+0000","last_change":"2023-08-17T00:16:36.914569+0000","last_active":"2023-08-17T00:16:37.334611+0000","last_peered":"2023-08-17T00:16:37.334611+0000","last_clean":"2023-08-17T00:16:37.334611+0000","last_became_active":"2023-08-17T00:16:36.913840+0000","last_became_peered":"2023-08-17T00:16:36.913840+0000","last_unstale":"2023-08-17T00:16:37.334611+0000","last_undegraded":"2023-08-17T00:16:37.334611+0000","last_fullsized":"2023-08-17T00:16:37.334611+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.346281+0000","last_change":"2023-08-17T00:16:37.346281+0000","last_active":"2023-08-17T00:16:37.346281+0000","last_peered":"2023-08-17T00:16:37.346281+0000","last_clean":"2023-08-17T00:16:37.346281+0000","last_became_active":"2023-08-17T00:16:37.345718+0000","last_became_peered":"2023-08-17T00:16:37.345718+0000","last_unstale":"2023-08-17T00:16:37.346281+0000","last_undegraded":"2023-08-17T00:16:37.346281+0000","last_fullsized":"2023-08-17T00:16:37.346281+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.328063+0000","last_change":"2023-08-17T00:16:36.911371+0000","last_active":"2023-08-17T00:16:37.328063+0000","last_peered":"2023-08-17T00:16:37.328063+0000","last_clean":"2023-08-17T00:16:37.328063+0000","last_became_active":"2023-08-17T00:16:36.909907+0000","last_became_peered":"2023-08-17T00:16:36.909907+0000","last_unstale":"2023-08-17T00:16:37.328063+0000","last_undegraded":"2023-08-17T00:16:37.328063+0000","last_fullsized":"2023-08-17T00:16:37.328063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354311+0000","last_change":"2023-08-17T00:16:37.351931+0000","last_active":"2023-08-17T00:16:37.354311+0000","last_peered":"2023-08-17T00:16:37.354311+0000","last_clean":"2023-08-17T00:16:37.354311+0000","last_became_active":"2023-08-17T00:16:37.351642+0000","last_became_peered":"2023-08-17T00:16:37.351642+0000","last_unstale":"2023-08-17T00:16:37.354311+0000","last_undegraded":"2023-08-17T00:16:37.354311+0000","last_fullsized":"2023-08-17T00:16:37.354311+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.329930+0000","last_change":"2023-08-17T00:16:36.922686+0000","last_active":"2023-08-17T00:16:37.329930+0000","last_peered":"2023-08-17T00:16:37.329930+0000","last_clean":"2023-08-17T00:16:37.329930+0000","last_became_active":"2023-08-17T00:16:36.922372+0000","last_became_peered":"2023-08-17T00:16:36.922372+0000","last_unstale":"2023-08-17T00:16:37.329930+0000","last_undegraded":"2023-08-17T00:16:37.329930+0000","last_fullsized":"2023-08-17T00:16:37.329930+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352157+0000","last_change":"2023-08-17T00:16:37.341434+0000","last_active":"2023-08-17T00:16:37.352157+0000","last_peered":"2023-08-17T00:16:37.352157+0000","last_clean":"2023-08-17T00:16:37.352157+0000","last_became_active":"2023-08-17T00:16:37.341122+0000","last_became_peered":"2023-08-17T00:16:37.341122+0000","last_unstale":"2023-08-17T00:16:37.352157+0000","last_undegraded":"2023-08-17T00:16:37.352157+0000","last_fullsized":"2023-08-17T00:16:37.352157+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.333975+0000","last_change":"2023-08-17T00:16:36.910572+0000","last_active":"2023-08-17T00:16:37.333975+0000","last_peered":"2023-08-17T00:16:37.333975+0000","last_clean":"2023-08-17T00:16:37.333975+0000","last_became_active":"2023-08-17T00:16:36.910249+0000","last_became_peered":"2023-08-17T00:16:36.910249+0000","last_unstale":"2023-08-17T00:16:37.333975+0000","last_undegraded":"2023-08-17T00:16:37.333975+0000","last_fullsized":"2023-08-17T00:16:37.333975+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354009+0000","last_change":"2023-08-17T00:16:37.344616+0000","last_active":"2023-08-17T00:16:37.354009+0000","last_peered":"2023-08-17T00:16:37.354009+0000","last_clean":"2023-08-17T00:16:37.354009+0000","last_became_active":"2023-08-17T00:16:37.344301+0000","last_became_peered":"2023-08-17T00:16:37.344301+0000","last_unstale":"2023-08-17T00:16:37.354009+0000","last_undegraded":"2023-08-17T00:16:37.354009+0000","last_fullsized":"2023-08-17T00:16:37.354009+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337638+0000","last_change":"2023-08-17T00:16:36.918782+0000","last_active":"2023-08-17T00:16:37.337638+0000","last_peered":"2023-08-17T00:16:37.337638+0000","last_clean":"2023-08-17T00:16:37.337638+0000","last_became_active":"2023-08-17T00:16:36.918454+0000","last_became_peered":"2023-08-17T00:16:36.918454+0000","last_unstale":"2023-08-17T00:16:37.337638+0000","last_undegraded":"2023-08-17T00:16:37.337638+0000","last_fullsized":"2023-08-17T00:16:37.337638+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.364782+0000","last_change":"2023-08-17T00:16:37.361056+0000","last_active":"2023-08-17T00:16:37.364782+0000","last_peered":"2023-08-17T00:16:37.364782+0000","last_clean":"2023-08-17T00:16:37.364782+0000","last_became_active":"2023-08-17T00:16:37.360631+0000","last_became_peered":"2023-08-17T00:16:37.360631+0000","last_unstale":"2023-08-17T00:16:37.364782+0000","last_undegraded":"2023-08-17T00:16:37.364782+0000","last_fullsized":"2023-08-17T00:16:37.364782+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336834+0000","last_change":"2023-08-17T00:16:36.921409+0000","last_active":"2023-08-17T00:16:37.336834+0000","last_peered":"2023-08-17T00:16:37.336834+0000","last_clean":"2023-08-17T00:16:37.336834+0000","last_became_active":"2023-08-17T00:16:36.921096+0000","last_became_peered":"2023-08-17T00:16:36.921096+0000","last_unstale":"2023-08-17T00:16:37.336834+0000","last_undegraded":"2023-08-17T00:16:37.336834+0000","last_fullsized":"2023-08-17T00:16:37.336834+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.361163+0000","last_change":"2023-08-17T00:16:37.353101+0000","last_active":"2023-08-17T00:16:37.361163+0000","last_peered":"2023-08-17T00:16:37.361163+0000","last_clean":"2023-08-17T00:16:37.361163+0000","last_became_active":"2023-08-17T00:16:37.352651+0000","last_became_peered":"2023-08-17T00:16:37.352651+0000","last_unstale":"2023-08-17T00:16:37.361163+0000","last_undegraded":"2023-08-17T00:16:37.361163+0000","last_fullsized":"2023-08-17T00:16:37.361163+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326215+0000","last_change":"2023-08-17T00:16:36.913898+0000","last_active":"2023-08-17T00:16:37.326215+0000","last_peered":"2023-08-17T00:16:37.326215+0000","last_clean":"2023-08-17T00:16:37.326215+0000","last_became_active":"2023-08-17T00:16:36.913103+0000","last_became_peered":"2023-08-17T00:16:36.913103+0000","last_unstale":"2023-08-17T00:16:37.326215+0000","last_undegraded":"2023-08-17T00:16:37.326215+0000","last_fullsized":"2023-08-17T00:16:37.326215+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.345744+0000","last_change":"2023-08-17T00:16:37.345744+0000","last_active":"2023-08-17T00:16:37.345744+0000","last_peered":"2023-08-17T00:16:37.345744+0000","last_clean":"2023-08-17T00:16:37.345744+0000","last_became_active":"2023-08-17T00:16:37.345444+0000","last_became_peered":"2023-08-17T00:16:37.345444+0000","last_unstale":"2023-08-17T00:16:37.345744+0000","last_undegraded":"2023-08-17T00:16:37.345744+0000","last_fullsized":"2023-08-17T00:16:37.345744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334259+0000","last_change":"2023-08-17T00:16:36.905595+0000","last_active":"2023-08-17T00:16:37.334259+0000","last_peered":"2023-08-17T00:16:37.334259+0000","last_clean":"2023-08-17T00:16:37.334259+0000","last_became_active":"2023-08-17T00:16:36.905024+0000","last_became_peered":"2023-08-17T00:16:36.905024+0000","last_unstale":"2023-08-17T00:16:37.334259+0000","last_undegraded":"2023-08-17T00:16:37.334259+0000","last_fullsized":"2023-08-17T00:16:37.334259+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.359989+0000","last_change":"2023-08-17T00:16:37.356452+0000","last_active":"2023-08-17T00:16:37.359989+0000","last_peered":"2023-08-17T00:16:37.359989+0000","last_clean":"2023-08-17T00:16:37.359989+0000","last_became_active":"2023-08-17T00:16:37.356128+0000","last_became_peered":"2023-08-17T00:16:37.356128+0000","last_unstale":"2023-08-17T00:16:37.359989+0000","last_undegraded":"2023-08-17T00:16:37.359989+0000","last_fullsized":"2023-08-17T00:16:37.359989+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.15","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354236+0000","last_change":"2023-08-17T00:16:36.913403+0000","last_active":"2023-08-17T00:16:37.354236+0000","last_peered":"2023-08-17T00:16:37.354236+0000","last_clean":"2023-08-17T00:16:37.354236+0000","last_became_active":"2023-08-17T00:16:36.913088+0000","last_became_peered":"2023-08-17T00:16:36.913088+0000","last_unstale":"2023-08-17T00:16:37.354236+0000","last_undegraded":"2023-08-17T00:16:37.354236+0000","last_fullsized":"2023-08-17T00:16:37.354236+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353252+0000","last_change":"2023-08-17T00:16:37.348338+0000","last_active":"2023-08-17T00:16:37.353252+0000","last_peered":"2023-08-17T00:16:37.353252+0000","last_clean":"2023-08-17T00:16:37.353252+0000","last_became_active":"2023-08-17T00:16:37.348066+0000","last_became_peered":"2023-08-17T00:16:37.348066+0000","last_unstale":"2023-08-17T00:16:37.353252+0000","last_undegraded":"2023-08-17T00:16:37.353252+0000","last_fullsized":"2023-08-17T00:16:37.353252+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.14","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363433+0000","last_change":"2023-08-17T00:16:36.911625+0000","last_active":"2023-08-17T00:16:37.363433+0000","last_peered":"2023-08-17T00:16:37.363433+0000","last_clean":"2023-08-17T00:16:37.363433+0000","last_became_active":"2023-08-17T00:16:36.911169+0000","last_became_peered":"2023-08-17T00:16:36.911169+0000","last_unstale":"2023-08-17T00:16:37.363433+0000","last_undegraded":"2023-08-17T00:16:37.363433+0000","last_fullsized":"2023-08-17T00:16:37.363433+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.341273+0000","last_change":"2023-08-17T00:16:37.341273+0000","last_active":"2023-08-17T00:16:37.341273+0000","last_peered":"2023-08-17T00:16:37.341273+0000","last_clean":"2023-08-17T00:16:37.341273+0000","last_became_active":"2023-08-17T00:16:37.341007+0000","last_became_peered":"2023-08-17T00:16:37.341007+0000","last_unstale":"2023-08-17T00:16:37.341273+0000","last_undegraded":"2023-08-17T00:16:37.341273+0000","last_fullsized":"2023-08-17T00:16:37.341273+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.13","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363007+0000","last_change":"2023-08-17T00:16:36.905822+0000","last_active":"2023-08-17T00:16:37.363007+0000","last_peered":"2023-08-17T00:16:37.363007+0000","last_clean":"2023-08-17T00:16:37.363007+0000","last_became_active":"2023-08-17T00:16:36.905561+0000","last_became_peered":"2023-08-17T00:16:36.905561+0000","last_unstale":"2023-08-17T00:16:37.363007+0000","last_undegraded":"2023-08-17T00:16:37.363007+0000","last_fullsized":"2023-08-17T00:16:37.363007+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.343350+0000","last_change":"2023-08-17T00:16:37.343350+0000","last_active":"2023-08-17T00:16:37.343350+0000","last_peered":"2023-08-17T00:16:37.343350+0000","last_clean":"2023-08-17T00:16:37.343350+0000","last_became_active":"2023-08-17T00:16:37.343072+0000","last_became_peered":"2023-08-17T00:16:37.343072+0000","last_unstale":"2023-08-17T00:16:37.343350+0000","last_undegraded":"2023-08-17T00:16:37.343350+0000","last_fullsized":"2023-08-17T00:16:37.343350+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.327652+0000","last_change":"2023-08-17T00:16:36.921036+0000","last_active":"2023-08-17T00:16:37.327652+0000","last_peered":"2023-08-17T00:16:37.327652+0000","last_clean":"2023-08-17T00:16:37.327652+0000","last_became_active":"2023-08-17T00:16:36.920716+0000","last_became_peered":"2023-08-17T00:16:36.920716+0000","last_unstale":"2023-08-17T00:16:37.327652+0000","last_undegraded":"2023-08-17T00:16:37.327652+0000","last_fullsized":"2023-08-17T00:16:37.327652+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352350+0000","last_change":"2023-08-17T00:16:37.348667+0000","last_active":"2023-08-17T00:16:37.352350+0000","last_peered":"2023-08-17T00:16:37.352350+0000","last_clean":"2023-08-17T00:16:37.352350+0000","last_became_active":"2023-08-17T00:16:37.348344+0000","last_became_peered":"2023-08-17T00:16:37.348344+0000","last_unstale":"2023-08-17T00:16:37.352350+0000","last_undegraded":"2023-08-17T00:16:37.352350+0000","last_fullsized":"2023-08-17T00:16:37.352350+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337736+0000","last_change":"2023-08-17T00:16:36.920118+0000","last_active":"2023-08-17T00:16:37.337736+0000","last_peered":"2023-08-17T00:16:37.337736+0000","last_clean":"2023-08-17T00:16:37.337736+0000","last_became_active":"2023-08-17T00:16:36.919791+0000","last_became_peered":"2023-08-17T00:16:36.919791+0000","last_unstale":"2023-08-17T00:16:37.337736+0000","last_undegraded":"2023-08-17T00:16:37.337736+0000","last_fullsized":"2023-08-17T00:16:37.337736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363138+0000","last_change":"2023-08-17T00:16:37.360883+0000","last_active":"2023-08-17T00:16:37.363138+0000","last_peered":"2023-08-17T00:16:37.363138+0000","last_clean":"2023-08-17T00:16:37.363138+0000","last_became_active":"2023-08-17T00:16:37.360312+0000","last_became_peered":"2023-08-17T00:16:37.360312+0000","last_unstale":"2023-08-17T00:16:37.363138+0000","last_undegraded":"2023-08-17T00:16:37.363138+0000","last_fullsized":"2023-08-17T00:16:37.363138+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.10","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357273+0000","last_change":"2023-08-17T00:16:36.911358+0000","last_active":"2023-08-17T00:16:37.357273+0000","last_peered":"2023-08-17T00:16:37.357273+0000","last_clean":"2023-08-17T00:16:37.357273+0000","last_became_active":"2023-08-17T00:16:36.911021+0000","last_became_peered":"2023-08-17T00:16:36.911021+0000","last_unstale":"2023-08-17T00:16:37.357273+0000","last_undegraded":"2023-08-17T00:16:37.357273+0000","last_fullsized":"2023-08-17T00:16:37.357273+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353521+0000","last_change":"2023-08-17T00:16:37.344069+0000","last_active":"2023-08-17T00:16:37.353521+0000","last_peered":"2023-08-17T00:16:37.353521+0000","last_clean":"2023-08-17T00:16:37.353521+0000","last_became_active":"2023-08-17T00:16:37.342340+0000","last_became_peered":"2023-08-17T00:16:37.342340+0000","last_unstale":"2023-08-17T00:16:37.353521+0000","last_undegraded":"2023-08-17T00:16:37.353521+0000","last_fullsized":"2023-08-17T00:16:37.353521+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354968+0000","last_change":"2023-08-17T00:16:36.919003+0000","last_active":"2023-08-17T00:16:37.354968+0000","last_peered":"2023-08-17T00:16:37.354968+0000","last_clean":"2023-08-17T00:16:37.354968+0000","last_became_active":"2023-08-17T00:16:36.918701+0000","last_became_peered":"2023-08-17T00:16:36.918701+0000","last_unstale":"2023-08-17T00:16:37.354968+0000","last_undegraded":"2023-08-17T00:16:37.354968+0000","last_fullsized":"2023-08-17T00:16:37.354968+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.350966+0000","last_change":"2023-08-17T00:16:37.337614+0000","last_active":"2023-08-17T00:16:37.350966+0000","last_peered":"2023-08-17T00:16:37.350966+0000","last_clean":"2023-08-17T00:16:37.350966+0000","last_became_active":"2023-08-17T00:16:37.337315+0000","last_became_peered":"2023-08-17T00:16:37.337315+0000","last_unstale":"2023-08-17T00:16:37.350966+0000","last_undegraded":"2023-08-17T00:16:37.350966+0000","last_fullsized":"2023-08-17T00:16:37.350966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363369+0000","last_change":"2023-08-17T00:16:36.910601+0000","last_active":"2023-08-17T00:16:37.363369+0000","last_peered":"2023-08-17T00:16:37.363369+0000","last_clean":"2023-08-17T00:16:37.363369+0000","last_became_active":"2023-08-17T00:16:36.909542+0000","last_became_peered":"2023-08-17T00:16:36.909542+0000","last_unstale":"2023-08-17T00:16:37.363369+0000","last_undegraded":"2023-08-17T00:16:37.363369+0000","last_fullsized":"2023-08-17T00:16:37.363369+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358889+0000","last_change":"2023-08-17T00:16:37.351991+0000","last_active":"2023-08-17T00:16:37.358889+0000","last_peered":"2023-08-17T00:16:37.358889+0000","last_clean":"2023-08-17T00:16:37.358889+0000","last_became_active":"2023-08-17T00:16:37.351725+0000","last_became_peered":"2023-08-17T00:16:37.351725+0000","last_unstale":"2023-08-17T00:16:37.358889+0000","last_undegraded":"2023-08-17T00:16:37.358889+0000","last_fullsized":"2023-08-17T00:16:37.358889+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.330987+0000","last_change":"2023-08-17T00:16:36.913371+0000","last_active":"2023-08-17T00:16:37.330987+0000","last_peered":"2023-08-17T00:16:37.330987+0000","last_clean":"2023-08-17T00:16:37.330987+0000","last_became_active":"2023-08-17T00:16:36.913112+0000","last_became_peered":"2023-08-17T00:16:36.913112+0000","last_unstale":"2023-08-17T00:16:37.330987+0000","last_undegraded":"2023-08-17T00:16:37.330987+0000","last_fullsized":"2023-08-17T00:16:37.330987+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354039+0000","last_change":"2023-08-17T00:16:37.348832+0000","last_active":"2023-08-17T00:16:37.354039+0000","last_peered":"2023-08-17T00:16:37.354039+0000","last_clean":"2023-08-17T00:16:37.354039+0000","last_became_active":"2023-08-17T00:16:37.348523+0000","last_became_peered":"2023-08-17T00:16:37.348523+0000","last_unstale":"2023-08-17T00:16:37.354039+0000","last_undegraded":"2023-08-17T00:16:37.354039+0000","last_fullsized":"2023-08-17T00:16:37.354039+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337491+0000","last_change":"2023-08-17T00:16:36.911616+0000","last_active":"2023-08-17T00:16:37.337491+0000","last_peered":"2023-08-17T00:16:37.337491+0000","last_clean":"2023-08-17T00:16:37.337491+0000","last_became_active":"2023-08-17T00:16:36.911335+0000","last_became_peered":"2023-08-17T00:16:36.911335+0000","last_unstale":"2023-08-17T00:16:37.337491+0000","last_undegraded":"2023-08-17T00:16:37.337491+0000","last_fullsized":"2023-08-17T00:16:37.337491+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.345622+0000","last_change":"2023-08-17T00:16:37.345622+0000","last_active":"2023-08-17T00:16:37.345622+0000","last_peered":"2023-08-17T00:16:37.345622+0000","last_clean":"2023-08-17T00:16:37.345622+0000","last_became_active":"2023-08-17T00:16:37.345302+0000","last_became_peered":"2023-08-17T00:16:37.345302+0000","last_unstale":"2023-08-17T00:16:37.345622+0000","last_undegraded":"2023-08-17T00:16:37.345622+0000","last_fullsized":"2023-08-17T00:16:37.345622+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363092+0000","last_change":"2023-08-17T00:16:36.919858+0000","last_active":"2023-08-17T00:16:37.363092+0000","last_peered":"2023-08-17T00:16:37.363092+0000","last_clean":"2023-08-17T00:16:37.363092+0000","last_became_active":"2023-08-17T00:16:36.919539+0000","last_became_peered":"2023-08-17T00:16:36.919539+0000","last_unstale":"2023-08-17T00:16:37.363092+0000","last_undegraded":"2023-08-17T00:16:37.363092+0000","last_fullsized":"2023-08-17T00:16:37.363092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352833+0000","last_change":"2023-08-17T00:16:37.347693+0000","last_active":"2023-08-17T00:16:37.352833+0000","last_peered":"2023-08-17T00:16:37.352833+0000","last_clean":"2023-08-17T00:16:37.352833+0000","last_became_active":"2023-08-17T00:16:37.347416+0000","last_became_peered":"2023-08-17T00:16:37.347416+0000","last_unstale":"2023-08-17T00:16:37.352833+0000","last_undegraded":"2023-08-17T00:16:37.352833+0000","last_fullsized":"2023-08-17T00:16:37.352833+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.909112+0000","last_change":"2023-08-17T00:16:36.907265+0000","last_active":"2023-08-17T00:16:36.909112+0000","last_peered":"2023-08-17T00:16:36.909112+0000","last_clean":"2023-08-17T00:16:36.909112+0000","last_became_active":"2023-08-17T00:16:36.905537+0000","last_became_peered":"2023-08-17T00:16:36.905537+0000","last_unstale":"2023-08-17T00:16:36.909112+0000","last_undegraded":"2023-08-17T00:16:36.909112+0000","last_fullsized":"2023-08-17T00:16:36.909112+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336099+0000","last_change":"2023-08-17T00:16:37.336099+0000","last_active":"2023-08-17T00:16:37.336099+0000","last_peered":"2023-08-17T00:16:37.336099+0000","last_clean":"2023-08-17T00:16:37.336099+0000","last_became_active":"2023-08-17T00:16:37.335799+0000","last_became_peered":"2023-08-17T00:16:37.335799+0000","last_unstale":"2023-08-17T00:16:37.336099+0000","last_undegraded":"2023-08-17T00:16:37.336099+0000","last_fullsized":"2023-08-17T00:16:37.336099+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326541+0000","last_change":"2023-08-17T00:16:36.917544+0000","last_active":"2023-08-17T00:16:37.326541+0000","last_peered":"2023-08-17T00:16:37.326541+0000","last_clean":"2023-08-17T00:16:37.326541+0000","last_became_active":"2023-08-17T00:16:36.917251+0000","last_became_peered":"2023-08-17T00:16:36.917251+0000","last_unstale":"2023-08-17T00:16:37.326541+0000","last_undegraded":"2023-08-17T00:16:37.326541+0000","last_fullsized":"2023-08-17T00:16:37.326541+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354163+0000","last_change":"2023-08-17T00:16:37.344671+0000","last_active":"2023-08-17T00:16:37.354163+0000","last_peered":"2023-08-17T00:16:37.354163+0000","last_clean":"2023-08-17T00:16:37.354163+0000","last_became_active":"2023-08-17T00:16:37.342389+0000","last_became_peered":"2023-08-17T00:16:37.342389+0000","last_unstale":"2023-08-17T00:16:37.354163+0000","last_undegraded":"2023-08-17T00:16:37.354163+0000","last_fullsized":"2023-08-17T00:16:37.354163+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348621+0000","last_change":"2023-08-17T00:16:36.914472+0000","last_active":"2023-08-17T00:16:37.348621+0000","last_peered":"2023-08-17T00:16:37.348621+0000","last_clean":"2023-08-17T00:16:37.348621+0000","last_became_active":"2023-08-17T00:16:36.914176+0000","last_became_peered":"2023-08-17T00:16:36.914176+0000","last_unstale":"2023-08-17T00:16:37.348621+0000","last_undegraded":"2023-08-17T00:16:37.348621+0000","last_fullsized":"2023-08-17T00:16:37.348621+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348969+0000","last_change":"2023-08-17T00:16:37.342883+0000","last_active":"2023-08-17T00:16:37.348969+0000","last_peered":"2023-08-17T00:16:37.348969+0000","last_clean":"2023-08-17T00:16:37.348969+0000","last_became_active":"2023-08-17T00:16:37.342455+0000","last_became_peered":"2023-08-17T00:16:37.342455+0000","last_unstale":"2023-08-17T00:16:37.348969+0000","last_undegraded":"2023-08-17T00:16:37.348969+0000","last_fullsized":"2023-08-17T00:16:37.348969+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.7","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352777+0000","last_change":"2023-08-17T00:16:36.904777+0000","last_active":"2023-08-17T00:16:37.352777+0000","last_peered":"2023-08-17T00:16:37.352777+0000","last_clean":"2023-08-17T00:16:37.352777+0000","last_became_active":"2023-08-17T00:16:36.903877+0000","last_became_peered":"2023-08-17T00:16:36.903877+0000","last_unstale":"2023-08-17T00:16:37.352777+0000","last_undegraded":"2023-08-17T00:16:37.352777+0000","last_fullsized":"2023-08-17T00:16:37.352777+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348895+0000","last_change":"2023-08-17T00:16:37.342087+0000","last_active":"2023-08-17T00:16:37.348895+0000","last_peered":"2023-08-17T00:16:37.348895+0000","last_clean":"2023-08-17T00:16:37.348895+0000","last_became_active":"2023-08-17T00:16:37.341799+0000","last_became_peered":"2023-08-17T00:16:37.341799+0000","last_unstale":"2023-08-17T00:16:37.348895+0000","last_undegraded":"2023-08-17T00:16:37.348895+0000","last_fullsized":"2023-08-17T00:16:37.348895+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334371+0000","last_change":"2023-08-17T00:16:36.902416+0000","last_active":"2023-08-17T00:16:37.334371+0000","last_peered":"2023-08-17T00:16:37.334371+0000","last_clean":"2023-08-17T00:16:37.334371+0000","last_became_active":"2023-08-17T00:16:36.902067+0000","last_became_peered":"2023-08-17T00:16:36.902067+0000","last_unstale":"2023-08-17T00:16:37.334371+0000","last_undegraded":"2023-08-17T00:16:37.334371+0000","last_fullsized":"2023-08-17T00:16:37.334371+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362547+0000","last_change":"2023-08-17T00:16:37.359641+0000","last_active":"2023-08-17T00:16:37.362547+0000","last_peered":"2023-08-17T00:16:37.362547+0000","last_clean":"2023-08-17T00:16:37.362547+0000","last_became_active":"2023-08-17T00:16:37.359369+0000","last_became_peered":"2023-08-17T00:16:37.359369+0000","last_unstale":"2023-08-17T00:16:37.362547+0000","last_undegraded":"2023-08-17T00:16:37.362547+0000","last_fullsized":"2023-08-17T00:16:37.362547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.340298+0000","last_change":"2023-08-17T00:16:36.920273+0000","last_active":"2023-08-17T00:16:37.340298+0000","last_peered":"2023-08-17T00:16:37.340298+0000","last_clean":"2023-08-17T00:16:37.340298+0000","last_became_active":"2023-08-17T00:16:36.920003+0000","last_became_peered":"2023-08-17T00:16:36.920003+0000","last_unstale":"2023-08-17T00:16:37.340298+0000","last_undegraded":"2023-08-17T00:16:37.340298+0000","last_fullsized":"2023-08-17T00:16:37.340298+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348352+0000","last_change":"2023-08-17T00:16:37.348352+0000","last_active":"2023-08-17T00:16:37.348352+0000","last_peered":"2023-08-17T00:16:37.348352+0000","last_clean":"2023-08-17T00:16:37.348352+0000","last_became_active":"2023-08-17T00:16:37.348055+0000","last_became_peered":"2023-08-17T00:16:37.348055+0000","last_unstale":"2023-08-17T00:16:37.348352+0000","last_undegraded":"2023-08-17T00:16:37.348352+0000","last_fullsized":"2023-08-17T00:16:37.348352+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334021+0000","last_change":"2023-08-17T00:16:36.913393+0000","last_active":"2023-08-17T00:16:37.334021+0000","last_peered":"2023-08-17T00:16:37.334021+0000","last_clean":"2023-08-17T00:16:37.334021+0000","last_became_active":"2023-08-17T00:16:36.913051+0000","last_became_peered":"2023-08-17T00:16:36.913051+0000","last_unstale":"2023-08-17T00:16:37.334021+0000","last_undegraded":"2023-08-17T00:16:37.334021+0000","last_fullsized":"2023-08-17T00:16:37.334021+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.346960+0000","last_change":"2023-08-17T00:16:37.342978+0000","last_active":"2023-08-17T00:16:37.346960+0000","last_peered":"2023-08-17T00:16:37.346960+0000","last_clean":"2023-08-17T00:16:37.346960+0000","last_became_active":"2023-08-17T00:16:37.342711+0000","last_became_peered":"2023-08-17T00:16:37.342711+0000","last_unstale":"2023-08-17T00:16:37.346960+0000","last_undegraded":"2023-08-17T00:16:37.346960+0000","last_fullsized":"2023-08-17T00:16:37.346960+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.349573+0000","last_change":"2023-08-17T00:16:36.907711+0000","last_active":"2023-08-17T00:16:37.349573+0000","last_peered":"2023-08-17T00:16:37.349573+0000","last_clean":"2023-08-17T00:16:37.349573+0000","last_became_active":"2023-08-17T00:16:36.907451+0000","last_became_peered":"2023-08-17T00:16:36.907451+0000","last_unstale":"2023-08-17T00:16:37.349573+0000","last_undegraded":"2023-08-17T00:16:37.349573+0000","last_fullsized":"2023-08-17T00:16:37.349573+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353865+0000","last_change":"2023-08-17T00:16:37.344849+0000","last_active":"2023-08-17T00:16:37.353865+0000","last_peered":"2023-08-17T00:16:37.353865+0000","last_clean":"2023-08-17T00:16:37.353865+0000","last_became_active":"2023-08-17T00:16:37.344579+0000","last_became_peered":"2023-08-17T00:16:37.344579+0000","last_unstale":"2023-08-17T00:16:37.353865+0000","last_undegraded":"2023-08-17T00:16:37.353865+0000","last_fullsized":"2023-08-17T00:16:37.353865+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336817+0000","last_change":"2023-08-17T00:16:36.914283+0000","last_active":"2023-08-17T00:16:37.336817+0000","last_peered":"2023-08-17T00:16:37.336817+0000","last_clean":"2023-08-17T00:16:37.336817+0000","last_became_active":"2023-08-17T00:16:36.913293+0000","last_became_peered":"2023-08-17T00:16:36.913293+0000","last_unstale":"2023-08-17T00:16:37.336817+0000","last_undegraded":"2023-08-17T00:16:37.336817+0000","last_fullsized":"2023-08-17T00:16:37.336817+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353302+0000","last_change":"2023-08-17T00:16:37.348823+0000","last_active":"2023-08-17T00:16:37.353302+0000","last_peered":"2023-08-17T00:16:37.353302+0000","last_clean":"2023-08-17T00:16:37.353302+0000","last_became_active":"2023-08-17T00:16:37.348518+0000","last_became_peered":"2023-08-17T00:16:37.348518+0000","last_unstale":"2023-08-17T00:16:37.353302+0000","last_undegraded":"2023-08-17T00:16:37.353302+0000","last_fullsized":"2023-08-17T00:16:37.353302+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337829+0000","last_change":"2023-08-17T00:16:36.922245+0000","last_active":"2023-08-17T00:16:37.337829+0000","last_peered":"2023-08-17T00:16:37.337829+0000","last_clean":"2023-08-17T00:16:37.337829+0000","last_became_active":"2023-08-17T00:16:36.921943+0000","last_became_peered":"2023-08-17T00:16:36.921943+0000","last_unstale":"2023-08-17T00:16:37.337829+0000","last_undegraded":"2023-08-17T00:16:37.337829+0000","last_fullsized":"2023-08-17T00:16:37.337829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358735+0000","last_change":"2023-08-17T00:16:37.350794+0000","last_active":"2023-08-17T00:16:37.358735+0000","last_peered":"2023-08-17T00:16:37.358735+0000","last_clean":"2023-08-17T00:16:37.358735+0000","last_became_active":"2023-08-17T00:16:37.348273+0000","last_became_peered":"2023-08-17T00:16:37.348273+0000","last_unstale":"2023-08-17T00:16:37.358735+0000","last_undegraded":"2023-08-17T00:16:37.358735+0000","last_fullsized":"2023-08-17T00:16:37.358735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336889+0000","last_change":"2023-08-17T00:16:36.906850+0000","last_active":"2023-08-17T00:16:37.336889+0000","last_peered":"2023-08-17T00:16:37.336889+0000","last_clean":"2023-08-17T00:16:37.336889+0000","last_became_active":"2023-08-17T00:16:36.906614+0000","last_became_peered":"2023-08-17T00:16:36.906614+0000","last_unstale":"2023-08-17T00:16:37.336889+0000","last_undegraded":"2023-08-17T00:16:37.336889+0000","last_fullsized":"2023-08-17T00:16:37.336889+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.355032+0000","last_change":"2023-08-17T00:16:37.345562+0000","last_active":"2023-08-17T00:16:37.355032+0000","last_peered":"2023-08-17T00:16:37.355032+0000","last_clean":"2023-08-17T00:16:37.355032+0000","last_became_active":"2023-08-17T00:16:37.345284+0000","last_became_peered":"2023-08-17T00:16:37.345284+0000","last_unstale":"2023-08-17T00:16:37.355032+0000","last_undegraded":"2023-08-17T00:16:37.355032+0000","last_fullsized":"2023-08-17T00:16:37.355032+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337386+0000","last_change":"2023-08-17T00:16:36.904167+0000","last_active":"2023-08-17T00:16:37.337386+0000","last_peered":"2023-08-17T00:16:37.337386+0000","last_clean":"2023-08-17T00:16:37.337386+0000","last_became_active":"2023-08-17T00:16:36.903876+0000","last_became_peered":"2023-08-17T00:16:36.903876+0000","last_unstale":"2023-08-17T00:16:37.337386+0000","last_undegraded":"2023-08-17T00:16:37.337386+0000","last_fullsized":"2023-08-17T00:16:37.337386+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352978+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:16:37.352978+0000","last_peered":"2023-08-17T00:16:37.352978+0000","last_clean":"2023-08-17T00:16:37.352978+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:16:37.352978+0000","last_undegraded":"2023-08-17T00:16:37.352978+0000","last_fullsized":"2023-08-17T00:16:37.352978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362289+0000","last_change":"2023-08-17T00:16:37.355972+0000","last_active":"2023-08-17T00:16:37.362289+0000","last_peered":"2023-08-17T00:16:37.362289+0000","last_clean":"2023-08-17T00:16:37.362289+0000","last_became_active":"2023-08-17T00:16:37.355141+0000","last_became_peered":"2023-08-17T00:16:37.355141+0000","last_unstale":"2023-08-17T00:16:37.362289+0000","last_undegraded":"2023-08-17T00:16:37.362289+0000","last_fullsized":"2023-08-17T00:16:37.362289+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.1d","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.356211+0000","last_change":"2023-08-17T00:16:36.907723+0000","last_active":"2023-08-17T00:16:37.356211+0000","last_peered":"2023-08-17T00:16:37.356211+0000","last_clean":"2023-08-17T00:16:37.356211+0000","last_became_active":"2023-08-17T00:16:36.907429+0000","last_became_peered":"2023-08-17T00:16:36.907429+0000","last_unstale":"2023-08-17T00:16:37.356211+0000","last_undegraded":"2023-08-17T00:16:37.356211+0000","last_fullsized":"2023-08-17T00:16:37.356211+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.894160+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:16:36.894160+0000","last_peered":"2023-08-17T00:16:36.894160+0000","last_clean":"2023-08-17T00:16:36.894160+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:16:36.894160+0000","last_undegraded":"2023-08-17T00:16:36.894160+0000","last_fullsized":"2023-08-17T00:16:36.894160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.338709+0000","last_change":"2023-08-17T00:16:37.338709+0000","last_active":"2023-08-17T00:16:37.338709+0000","last_peered":"2023-08-17T00:16:37.338709+0000","last_clean":"2023-08-17T00:16:37.338709+0000","last_became_active":"2023-08-17T00:16:37.338425+0000","last_became_peered":"2023-08-17T00:16:37.338425+0000","last_unstale":"2023-08-17T00:16:37.338709+0000","last_undegraded":"2023-08-17T00:16:37.338709+0000","last_fullsized":"2023-08-17T00:16:37.338709+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363327+0000","last_change":"2023-08-17T00:16:36.922846+0000","last_active":"2023-08-17T00:16:37.363327+0000","last_peered":"2023-08-17T00:16:37.363327+0000","last_clean":"2023-08-17T00:16:37.363327+0000","last_became_active":"2023-08-17T00:16:36.922540+0000","last_became_peered":"2023-08-17T00:16:36.922540+0000","last_unstale":"2023-08-17T00:16:37.363327+0000","last_undegraded":"2023-08-17T00:16:37.363327+0000","last_fullsized":"2023-08-17T00:16:37.363327+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353846+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:16:37.353846+0000","last_peered":"2023-08-17T00:16:37.353846+0000","last_clean":"2023-08-17T00:16:37.353846+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:16:37.353846+0000","last_undegraded":"2023-08-17T00:16:37.353846+0000","last_fullsized":"2023-08-17T00:16:37.353846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.360072+0000","last_change":"2023-08-17T00:16:37.356709+0000","last_active":"2023-08-17T00:16:37.360072+0000","last_peered":"2023-08-17T00:16:37.360072+0000","last_clean":"2023-08-17T00:16:37.360072+0000","last_became_active":"2023-08-17T00:16:37.356450+0000","last_became_peered":"2023-08-17T00:16:37.356450+0000","last_unstale":"2023-08-17T00:16:37.360072+0000","last_undegraded":"2023-08-17T00:16:37.360072+0000","last_fullsized":"2023-08-17T00:16:37.360072+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353130+0000","last_change":"2023-08-17T00:16:36.920432+0000","last_active":"2023-08-17T00:16:37.353130+0000","last_peered":"2023-08-17T00:16:37.353130+0000","last_clean":"2023-08-17T00:16:37.353130+0000","last_became_active":"2023-08-17T00:16:36.920150+0000","last_became_peered":"2023-08-17T00:16:36.920150+0000","last_unstale":"2023-08-17T00:16:37.353130+0000","last_undegraded":"2023-08-17T00:16:37.353130+0000","last_fullsized":"2023-08-17T00:16:37.353130+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334101+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:16:37.334101+0000","last_peered":"2023-08-17T00:16:37.334101+0000","last_clean":"2023-08-17T00:16:37.334101+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:16:37.334101+0000","last_undegraded":"2023-08-17T00:16:37.334101+0000","last_fullsized":"2023-08-17T00:16:37.334101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.360110+0000","last_change":"2023-08-17T00:16:37.357779+0000","last_active":"2023-08-17T00:16:37.360110+0000","last_peered":"2023-08-17T00:16:37.360110+0000","last_clean":"2023-08-17T00:16:37.360110+0000","last_became_active":"2023-08-17T00:16:37.357442+0000","last_became_peered":"2023-08-17T00:16:37.357442+0000","last_unstale":"2023-08-17T00:16:37.360110+0000","last_undegraded":"2023-08-17T00:16:37.360110+0000","last_fullsized":"2023-08-17T00:16:37.360110+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.347384+0000","last_change":"2023-08-17T00:16:36.914375+0000","last_active":"2023-08-17T00:16:37.347384+0000","last_peered":"2023-08-17T00:16:37.347384+0000","last_clean":"2023-08-17T00:16:37.347384+0000","last_became_active":"2023-08-17T00:16:36.914095+0000","last_became_peered":"2023-08-17T00:16:36.914095+0000","last_unstale":"2023-08-17T00:16:37.347384+0000","last_undegraded":"2023-08-17T00:16:37.347384+0000","last_fullsized":"2023-08-17T00:16:37.347384+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348812+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:16:37.348812+0000","last_peered":"2023-08-17T00:16:37.348812+0000","last_clean":"2023-08-17T00:16:37.348812+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:16:37.348812+0000","last_undegraded":"2023-08-17T00:16:37.348812+0000","last_fullsized":"2023-08-17T00:16:37.348812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.338980+0000","last_change":"2023-08-17T00:16:37.338980+0000","last_active":"2023-08-17T00:16:37.338980+0000","last_peered":"2023-08-17T00:16:37.338980+0000","last_clean":"2023-08-17T00:16:37.338980+0000","last_became_active":"2023-08-17T00:16:37.338701+0000","last_became_peered":"2023-08-17T00:16:37.338701+0000","last_unstale":"2023-08-17T00:16:37.338980+0000","last_undegraded":"2023-08-17T00:16:37.338980+0000","last_fullsized":"2023-08-17T00:16:37.338980+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.908100+0000","last_change":"2023-08-17T00:16:36.903717+0000","last_active":"2023-08-17T00:16:36.908100+0000","last_peered":"2023-08-17T00:16:36.908100+0000","last_clean":"2023-08-17T00:16:36.908100+0000","last_became_active":"2023-08-17T00:16:36.903135+0000","last_became_peered":"2023-08-17T00:16:36.903135+0000","last_unstale":"2023-08-17T00:16:36.908100+0000","last_undegraded":"2023-08-17T00:16:36.908100+0000","last_fullsized":"2023-08-17T00:16:36.908100+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337939+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:16:37.337939+0000","last_peered":"2023-08-17T00:16:37.337939+0000","last_clean":"2023-08-17T00:16:37.337939+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:16:37.337939+0000","last_undegraded":"2023-08-17T00:16:37.337939+0000","last_fullsized":"2023-08-17T00:16:37.337939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358903+0000","last_change":"2023-08-17T00:16:37.350050+0000","last_active":"2023-08-17T00:16:37.358903+0000","last_peered":"2023-08-17T00:16:37.358903+0000","last_clean":"2023-08-17T00:16:37.358903+0000","last_became_active":"2023-08-17T00:16:37.348295+0000","last_became_peered":"2023-08-17T00:16:37.348295+0000","last_unstale":"2023-08-17T00:16:37.358903+0000","last_undegraded":"2023-08-17T00:16:37.358903+0000","last_fullsized":"2023-08-17T00:16:37.358903+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337006+0000","last_change":"2023-08-17T00:16:36.921355+0000","last_active":"2023-08-17T00:16:37.337006+0000","last_peered":"2023-08-17T00:16:37.337006+0000","last_clean":"2023-08-17T00:16:37.337006+0000","last_became_active":"2023-08-17T00:16:36.920605+0000","last_became_peered":"2023-08-17T00:16:36.920605+0000","last_unstale":"2023-08-17T00:16:37.337006+0000","last_undegraded":"2023-08-17T00:16:37.337006+0000","last_fullsized":"2023-08-17T00:16:37.337006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348723+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:16:37.348723+0000","last_peered":"2023-08-17T00:16:37.348723+0000","last_clean":"2023-08-17T00:16:37.348723+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:16:37.348723+0000","last_undegraded":"2023-08-17T00:16:37.348723+0000","last_fullsized":"2023-08-17T00:16:37.348723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.340668+0000","last_change":"2023-08-17T00:16:37.339249+0000","last_active":"2023-08-17T00:16:37.340668+0000","last_peered":"2023-08-17T00:16:37.340668+0000","last_clean":"2023-08-17T00:16:37.340668+0000","last_became_active":"2023-08-17T00:16:37.338950+0000","last_became_peered":"2023-08-17T00:16:37.338950+0000","last_unstale":"2023-08-17T00:16:37.340668+0000","last_undegraded":"2023-08-17T00:16:37.340668+0000","last_fullsized":"2023-08-17T00:16:37.340668+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.914240+0000","last_change":"2023-08-17T00:16:36.910332+0000","last_active":"2023-08-17T00:16:36.914240+0000","last_peered":"2023-08-17T00:16:36.914240+0000","last_clean":"2023-08-17T00:16:36.914240+0000","last_became_active":"2023-08-17T00:16:36.910015+0000","last_became_peered":"2023-08-17T00:16:36.910015+0000","last_unstale":"2023-08-17T00:16:36.914240+0000","last_undegraded":"2023-08-17T00:16:36.914240+0000","last_fullsized":"2023-08-17T00:16:36.914240+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.351728+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:16:37.351728+0000","last_peered":"2023-08-17T00:16:37.351728+0000","last_clean":"2023-08-17T00:16:37.351728+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:16:37.351728+0000","last_undegraded":"2023-08-17T00:16:37.351728+0000","last_fullsized":"2023-08-17T00:16:37.351728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336972+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:16:37.336972+0000","last_peered":"2023-08-17T00:16:37.336972+0000","last_clean":"2023-08-17T00:16:37.336972+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:16:37.336972+0000","last_undegraded":"2023-08-17T00:16:37.336972+0000","last_fullsized":"2023-08-17T00:16:37.336972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542313,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315780,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056060,"statfs":{"total":96636764160,"available":96313405440,"internally_reserved":0,"allocated":2224128,"data_stored":1043887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":1.331},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.3680000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.008},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.256}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.109}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.401},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.468}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":1.5349999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299412,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072428,"statfs":{"total":96636764160,"available":96330166272,"internally_reserved":0,"allocated":2240512,"data_stored":1051213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":1.2370000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.373}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":1.181},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":1.4219999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542314,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307604,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064236,"statfs":{"total":96636764160,"available":96321777664,"internally_reserved":0,"allocated":2240512,"data_stored":1050729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.2390000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.004},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1579999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.296}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.226},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.385}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.359},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.2749999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307604,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064236,"statfs":{"total":96636764160,"available":96321777664,"internally_reserved":0,"allocated":2240512,"data_stored":1052015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.004},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.1990000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.3}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.24},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.335}]}]},{"osd":2,"up_from":14,"seq":60129542313,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311704,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060136,"statfs":{"total":96636764160,"available":96317579264,"internally_reserved":0,"allocated":2244608,"data_stored":1051247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":1.1970000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":1.028},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":1.484}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":1.4279999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.532}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.1100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.179},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.625}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.3939999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542313,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":2232320,"data_stored":1050569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.873,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.2789999999999999,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91800000000000004,"15min":0.91300000000000003},"min":{"1min":0.752,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.214,"5min":1.6200000000000001,"15min":13.093},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.2689999999999999,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0249999999999999,"15min":1.0129999999999999},"min":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.363,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.054},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.0800000000000001,"15min":1.139},"min":{"1min":0.92600000000000005,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.552,"5min":1.671,"15min":20.548999999999999},"last":1.131},{"interface":"front","average":{"1min":1.3,"5min":1.214,"15min":1.204},"min":{"1min":0.97399999999999998,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.381}]},{"osd":5,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":1.1779999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.623,"5min":3.137,"15min":13.170999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2270000000000001,"15min":1.236},"min":{"1min":1.0760000000000001,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.4510000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3120000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.95899999999999996,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.603,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.087},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.216,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5620000000000001,"5min":2.0150000000000001,"15min":5.5359999999999996},"last":1.244}]},{"osd":7,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.294,"15min":1.298},"min":{"1min":1.0409999999999999,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.675,"5min":3.1520000000000001,"15min":6.9779999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.319},"min":{"1min":1.0229999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7230000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.1830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542314,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311700,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060140,"statfs":{"total":96636764160,"available":96317583360,"internally_reserved":0,"allocated":2240512,"data_stored":1045493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":1.016},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.03}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.111},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":1.1279999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":0.96099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575018,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307588,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064252,"statfs":{"total":96636764160,"available":96321794048,"internally_reserved":0,"allocated":2224128,"data_stored":1043899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":1.0600000000000001},"min":{"1min":0.77600000000000002,"5min":0.622,"15min":0.38300000000000001},"max":{"1min":1.4350000000000001,"5min":1.677,"15min":7.1379999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.345,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1379999999999999,"15min":1.22},"min":{"1min":0.745,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.4039999999999999,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.085},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.153,"15min":1.216},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.732,"5min":1.732,"15min":6.9000000000000004},"last":1.24}]},{"osd":2,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.083,"15min":1.2130000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.4179999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.083,"15min":1.3089999999999999},"min":{"1min":0.91600000000000004,"5min":0.755,"15min":0.36699999999999999},"max":{"1min":1.5880000000000001,"5min":1.623,"15min":36.531999999999996},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.117},"min":{"1min":0.79300000000000004,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.522,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.175,"15min":1.3779999999999999},"min":{"1min":0.876,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.603,"5min":1.7569999999999999,"15min":36.530000000000001},"last":1.002}]},{"osd":5,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.24},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.228,"15min":1.2829999999999999},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.633,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2390000000000001,"15min":1.3200000000000001},"min":{"1min":0.877,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.875,"15min":8.4190000000000005},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.321,"15min":1.369},"min":{"1min":1.032,"5min":0.77400000000000002,"15min":0.49399999999999999},"max":{"1min":1.8260000000000001,"5min":1.911,"15min":6.1689999999999996},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.222,"15min":1.248},"min":{"1min":0.83399999999999996,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.5249999999999999,"5min":3.645,"15min":3.645},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3220000000000001,"15min":1.3879999999999999},"min":{"1min":1.0149999999999999,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.879,"5min":1.9690000000000001,"15min":8.327},"last":1.1599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:16:41.623 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:16:41.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.811+0000 7eff488db700 1 Processor -- start 2023-08-17T00:16:41.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.815+0000 7eff488db700 1 -- start start 2023-08-17T00:16:41.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.815+0000 7eff488db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff440626b0 0x7eff440c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.815+0000 7eff488db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff440c0330 con 0x7eff44153e90 2023-08-17T00:16:41.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.815+0000 7eff488db700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff440c0ed0 con 0x7eff44153ab0 2023-08-17T00:16:41.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.815+0000 7eff488db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff441542f0 con 0x7eff440626b0 2023-08-17T00:16:41.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff41d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7eff44153e90 0x7eff44061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45348/0 (socket says 172.21.15.153:45348) 2023-08-17T00:16:41.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff41d9b700 1 -- 172.21.15.153:0/3389159125 learned_addr learned my addr 172.21.15.153:0/3389159125 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:41.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 --2- 172.21.15.153:0/3389159125 >> v2:172.21.15.178:3300/0 conn(0x7eff440626b0 0x7eff440c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408186211 0 0) 0x7eff440c0330 con 0x7eff44153e90 2023-08-17T00:16:41.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff2c0033f0 con 0x7eff44153e90 2023-08-17T00:16:41.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311462713 0 0) 0x7eff440c0ed0 con 0x7eff44153ab0 2023-08-17T00:16:41.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff440c0330 con 0x7eff44153ab0 2023-08-17T00:16:41.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631185237 0 0) 0x7eff2c0033f0 con 0x7eff44153e90 2023-08-17T00:16:41.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 >> v2:172.21.15.178:3300/0 conn(0x7eff440626b0 msgr2=0x7eff440c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:41.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 --2- 172.21.15.153:0/3389159125 >> v2:172.21.15.178:3300/0 conn(0x7eff440626b0 0x7eff440c59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 >> v1:172.21.15.178:6789/0 conn(0x7eff44153ab0 legacy=0x7eff440c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff440c60a0 con 0x7eff44153e90 2023-08-17T00:16:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7eff38001470 con 0x7eff44153e90 2023-08-17T00:16:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 >> v1:172.21.15.153:6789/0 conn(0x7eff44153e90 legacy=0x7eff44061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c003a70 0x7eff2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff2c004690 0x7eff2c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c005050 0x7eff2c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff441542f0 con 0x7eff2c005050 2023-08-17T00:16:41.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c00bfc0 con 0x7eff2c004690 2023-08-17T00:16:41.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c00c180 con 0x7eff2c003a70 2023-08-17T00:16:41.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c005050 0x7eff2c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff41d9b700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff2c004690 0x7eff2c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4259c700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c003a70 0x7eff2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 -- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c003a70 msgr2=0x7eff2c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:41.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c003a70 0x7eff2c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 -- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff2c004690 msgr2=0x7eff2c004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:41.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff2c004690 0x7eff2c004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 -- 172.21.15.153:0/3389159125 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0033f0 con 0x7eff2c005050 2023-08-17T00:16:41.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 -- 172.21.15.153:0/3389159125 reap_dead start 2023-08-17T00:16:41.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff42d9d700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c005050 0x7eff2c00b8e0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7eff3c00e210 tx=0x7eff3c00b040).ready entity=mon.0 client_cookie=e256b277ca667758 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c009ac0 con 0x7eff2c005050 2023-08-17T00:16:41.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c00f040 con 0x7eff2c005050 2023-08-17T00:16:41.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.819+0000 7eff4159a700 1 -- 172.21.15.153:0/3389159125 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c00ed10 con 0x7eff2c005050 2023-08-17T00:16:41.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 -- 172.21.15.153:0/3389159125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c005050 msgr2=0x7eff2c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c005050 0x7eff2c00b8e0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 rx=0x7eff3c00e210 tx=0x7eff3c00b040).stop 2023-08-17T00:16:41.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 -- 172.21.15.153:0/3389159125 shutdown_connections 2023-08-17T00:16:41.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 --2- 172.21.15.153:0/3389159125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff2c005050 0x7eff2c00b8e0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 -- 172.21.15.153:0/3389159125 >> 172.21.15.153:0/3389159125 conn(0x7eff440caaa0 msgr2=0x7eff440caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:41.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 -- 172.21.15.153:0/3389159125 shutdown_connections 2023-08-17T00:16:41.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 -- 172.21.15.153:0/3389159125 wait complete. 2023-08-17T00:16:41.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 Processor -- start 2023-08-17T00:16:41.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.823+0000 7eff488db700 1 -- start start 2023-08-17T00:16:41.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c005050 0x7eff44168200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff44063630 0x7eff44063a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 0x7eff441581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff4413f180 con 0x7eff44157d60 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff440b04f0 con 0x7eff44063630 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff44063f80 con 0x7eff2c005050 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 0x7eff441581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 0x7eff441581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39268/0 (socket says 172.21.15.153:39268) 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 -- 172.21.15.153:0/2848904727 learned_addr learned my addr 172.21.15.153:0/2848904727 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff4259c700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c005050 0x7eff44168200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff41d9b700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff44063630 0x7eff44063a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 -- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c005050 msgr2=0x7eff44168200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c005050 0x7eff44168200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 -- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff44063630 msgr2=0x7eff44063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff44063630 0x7eff44063a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 -- 172.21.15.153:0/2848904727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff44158ab0 con 0x7eff44157d60 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff42d9d700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 0x7eff441581c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7eff440c1760 tx=0x7eff3c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c01d460 con 0x7eff44157d60 2023-08-17T00:16:41.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c01d5e0 con 0x7eff44157d60 2023-08-17T00:16:41.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff44158d90 con 0x7eff44157d60 2023-08-17T00:16:41.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff3c01d9a0 con 0x7eff44157d60 2023-08-17T00:16:41.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.827+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff44159350 con 0x7eff44157d60 2023-08-17T00:16:41.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.831+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff4406b530 con 0x7eff44157d60 2023-08-17T00:16:41.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.831+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7eff3c019040 con 0x7eff44157d60 2023-08-17T00:16:41.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.831+0000 7eff327fc700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff2405a150 0x7eff2405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:41.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.831+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6179+0+0 (secure 0 0 0) 0x7eff3c0762d0 con 0x7eff44157d60 2023-08-17T00:16:41.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.835+0000 7eff4259c700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff2405a150 0x7eff2405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:41.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.835+0000 7eff4259c700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff2405a150 0x7eff2405c610 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7eff34007fd0 tx=0x7eff34007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:41.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.835+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff3c049c30 con 0x7eff44157d60 2023-08-17T00:16:41.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:41.991+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff440bfa00 con 0x7eff2405a150 2023-08-17T00:16:42.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.007+0000 7eff327fc700 1 -- 172.21.15.153:0/2848904727 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359366 (secure 0 0 0) 0x7eff440bfa00 con 0x7eff2405a150 2023-08-17T00:16:42.021 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:42.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff2405a150 msgr2=0x7eff2405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff2405a150 0x7eff2405c610 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7eff34007fd0 tx=0x7eff34007bb0).stop 2023-08-17T00:16:42.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 msgr2=0x7eff441581c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 0x7eff441581c0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 rx=0x7eff440c1760 tx=0x7eff3c018000).stop 2023-08-17T00:16:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 shutdown_connections 2023-08-17T00:16:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7eff2405a150 0x7eff2405c610 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff44157d60 0x7eff441581c0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff44063630 0x7eff44063a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 --2- 172.21.15.153:0/2848904727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff2c005050 0x7eff44168200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 >> 172.21.15.153:0/2848904727 conn(0x7eff440caaa0 msgr2=0x7eff44154430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:42.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 shutdown_connections 2023-08-17T00:16:42.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.015+0000 7eff488db700 1 -- 172.21.15.153:0/2848904727 wait complete. 2023-08-17T00:16:42.026 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:16:42.043 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":591,"stamp":"2023-08-17T00:16:41.492962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2464892,"kb_used_data":17468,"kb_used_omap":0,"kb_used_meta":2447360,"kb_avail":752509828,"statfs":{"total":773094113280,"available":770570063872,"internally_reserved":0,"allocated":17887232,"data_stored":8389052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506096640},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308378,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-7,"num_read_kb":-4,"num_write":-87,"num_write_kb":-6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.928189"},"pg_stats":[{"pgid":"26.3c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352198+0000","last_change":"2023-08-17T00:16:37.343457+0000","last_active":"2023-08-17T00:16:37.352198+0000","last_peered":"2023-08-17T00:16:37.352198+0000","last_clean":"2023-08-17T00:16:37.352198+0000","last_became_active":"2023-08-17T00:16:37.342785+0000","last_became_peered":"2023-08-17T00:16:37.342785+0000","last_unstale":"2023-08-17T00:16:37.352198+0000","last_undegraded":"2023-08-17T00:16:37.352198+0000","last_fullsized":"2023-08-17T00:16:37.352198+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3f","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362505+0000","last_change":"2023-08-17T00:16:36.906836+0000","last_active":"2023-08-17T00:16:37.362505+0000","last_peered":"2023-08-17T00:16:37.362505+0000","last_clean":"2023-08-17T00:16:37.362505+0000","last_became_active":"2023-08-17T00:16:36.906487+0000","last_became_peered":"2023-08-17T00:16:36.906487+0000","last_unstale":"2023-08-17T00:16:37.362505+0000","last_undegraded":"2023-08-17T00:16:37.362505+0000","last_fullsized":"2023-08-17T00:16:37.362505+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363158+0000","last_change":"2023-08-17T00:16:37.360342+0000","last_active":"2023-08-17T00:16:37.363158+0000","last_peered":"2023-08-17T00:16:37.363158+0000","last_clean":"2023-08-17T00:16:37.363158+0000","last_became_active":"2023-08-17T00:16:37.359986+0000","last_became_peered":"2023-08-17T00:16:37.359986+0000","last_unstale":"2023-08-17T00:16:37.363158+0000","last_undegraded":"2023-08-17T00:16:37.363158+0000","last_fullsized":"2023-08-17T00:16:37.363158+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337001+0000","last_change":"2023-08-17T00:16:36.908669+0000","last_active":"2023-08-17T00:16:37.337001+0000","last_peered":"2023-08-17T00:16:37.337001+0000","last_clean":"2023-08-17T00:16:37.337001+0000","last_became_active":"2023-08-17T00:16:36.908341+0000","last_became_peered":"2023-08-17T00:16:36.908341+0000","last_unstale":"2023-08-17T00:16:37.337001+0000","last_undegraded":"2023-08-17T00:16:37.337001+0000","last_fullsized":"2023-08-17T00:16:37.337001+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358567+0000","last_change":"2023-08-17T00:16:37.357079+0000","last_active":"2023-08-17T00:16:37.358567+0000","last_peered":"2023-08-17T00:16:37.358567+0000","last_clean":"2023-08-17T00:16:37.358567+0000","last_became_active":"2023-08-17T00:16:37.356740+0000","last_became_peered":"2023-08-17T00:16:37.356740+0000","last_unstale":"2023-08-17T00:16:37.358567+0000","last_undegraded":"2023-08-17T00:16:37.358567+0000","last_fullsized":"2023-08-17T00:16:37.358567+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334519+0000","last_change":"2023-08-17T00:16:36.911265+0000","last_active":"2023-08-17T00:16:37.334519+0000","last_peered":"2023-08-17T00:16:37.334519+0000","last_clean":"2023-08-17T00:16:37.334519+0000","last_became_active":"2023-08-17T00:16:36.911003+0000","last_became_peered":"2023-08-17T00:16:36.911003+0000","last_unstale":"2023-08-17T00:16:37.334519+0000","last_undegraded":"2023-08-17T00:16:37.334519+0000","last_fullsized":"2023-08-17T00:16:37.334519+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353984+0000","last_change":"2023-08-17T00:16:37.347428+0000","last_active":"2023-08-17T00:16:37.353984+0000","last_peered":"2023-08-17T00:16:37.353984+0000","last_clean":"2023-08-17T00:16:37.353984+0000","last_became_active":"2023-08-17T00:16:37.347161+0000","last_became_peered":"2023-08-17T00:16:37.347161+0000","last_unstale":"2023-08-17T00:16:37.353984+0000","last_undegraded":"2023-08-17T00:16:37.353984+0000","last_fullsized":"2023-08-17T00:16:37.353984+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3c","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354924+0000","last_change":"2023-08-17T00:16:36.901036+0000","last_active":"2023-08-17T00:16:37.354924+0000","last_peered":"2023-08-17T00:16:37.354924+0000","last_clean":"2023-08-17T00:16:37.354924+0000","last_became_active":"2023-08-17T00:16:36.900747+0000","last_became_peered":"2023-08-17T00:16:36.900747+0000","last_unstale":"2023-08-17T00:16:37.354924+0000","last_undegraded":"2023-08-17T00:16:37.354924+0000","last_fullsized":"2023-08-17T00:16:37.354924+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348914+0000","last_change":"2023-08-17T00:16:37.340785+0000","last_active":"2023-08-17T00:16:37.348914+0000","last_peered":"2023-08-17T00:16:37.348914+0000","last_clean":"2023-08-17T00:16:37.348914+0000","last_became_active":"2023-08-17T00:16:37.340436+0000","last_became_peered":"2023-08-17T00:16:37.340436+0000","last_unstale":"2023-08-17T00:16:37.348914+0000","last_undegraded":"2023-08-17T00:16:37.348914+0000","last_fullsized":"2023-08-17T00:16:37.348914+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.3b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362348+0000","last_change":"2023-08-17T00:16:36.921543+0000","last_active":"2023-08-17T00:16:37.362348+0000","last_peered":"2023-08-17T00:16:37.362348+0000","last_clean":"2023-08-17T00:16:37.362348+0000","last_became_active":"2023-08-17T00:16:36.920994+0000","last_became_peered":"2023-08-17T00:16:36.920994+0000","last_unstale":"2023-08-17T00:16:37.362348+0000","last_undegraded":"2023-08-17T00:16:37.362348+0000","last_fullsized":"2023-08-17T00:16:37.362348+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348945+0000","last_change":"2023-08-17T00:16:37.342603+0000","last_active":"2023-08-17T00:16:37.348945+0000","last_peered":"2023-08-17T00:16:37.348945+0000","last_clean":"2023-08-17T00:16:37.348945+0000","last_became_active":"2023-08-17T00:16:37.342267+0000","last_became_peered":"2023-08-17T00:16:37.342267+0000","last_unstale":"2023-08-17T00:16:37.348945+0000","last_undegraded":"2023-08-17T00:16:37.348945+0000","last_fullsized":"2023-08-17T00:16:37.348945+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3a","version":"177'1","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326543+0000","last_change":"2023-08-17T00:16:36.903798+0000","last_active":"2023-08-17T00:16:37.326543+0000","last_peered":"2023-08-17T00:16:37.326543+0000","last_clean":"2023-08-17T00:16:37.326543+0000","last_became_active":"2023-08-17T00:16:36.903500+0000","last_became_peered":"2023-08-17T00:16:36.903500+0000","last_unstale":"2023-08-17T00:16:37.326543+0000","last_undegraded":"2023-08-17T00:16:37.326543+0000","last_fullsized":"2023-08-17T00:16:37.326543+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354216+0000","last_change":"2023-08-17T00:16:37.350684+0000","last_active":"2023-08-17T00:16:37.354216+0000","last_peered":"2023-08-17T00:16:37.354216+0000","last_clean":"2023-08-17T00:16:37.354216+0000","last_became_active":"2023-08-17T00:16:37.350390+0000","last_became_peered":"2023-08-17T00:16:37.350390+0000","last_unstale":"2023-08-17T00:16:37.354216+0000","last_undegraded":"2023-08-17T00:16:37.354216+0000","last_fullsized":"2023-08-17T00:16:37.354216+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.323019+0000","last_change":"2023-08-17T00:16:36.906274+0000","last_active":"2023-08-17T00:16:37.323019+0000","last_peered":"2023-08-17T00:16:37.323019+0000","last_clean":"2023-08-17T00:16:37.323019+0000","last_became_active":"2023-08-17T00:16:36.905206+0000","last_became_peered":"2023-08-17T00:16:36.905206+0000","last_unstale":"2023-08-17T00:16:37.323019+0000","last_undegraded":"2023-08-17T00:16:37.323019+0000","last_fullsized":"2023-08-17T00:16:37.323019+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353661+0000","last_change":"2023-08-17T00:16:37.345506+0000","last_active":"2023-08-17T00:16:37.353661+0000","last_peered":"2023-08-17T00:16:37.353661+0000","last_clean":"2023-08-17T00:16:37.353661+0000","last_became_active":"2023-08-17T00:16:37.345235+0000","last_became_peered":"2023-08-17T00:16:37.345235+0000","last_unstale":"2023-08-17T00:16:37.353661+0000","last_undegraded":"2023-08-17T00:16:37.353661+0000","last_fullsized":"2023-08-17T00:16:37.353661+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336942+0000","last_change":"2023-08-17T00:16:36.921539+0000","last_active":"2023-08-17T00:16:37.336942+0000","last_peered":"2023-08-17T00:16:37.336942+0000","last_clean":"2023-08-17T00:16:37.336942+0000","last_became_active":"2023-08-17T00:16:36.921240+0000","last_became_peered":"2023-08-17T00:16:36.921240+0000","last_unstale":"2023-08-17T00:16:37.336942+0000","last_undegraded":"2023-08-17T00:16:37.336942+0000","last_fullsized":"2023-08-17T00:16:37.336942+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.346062+0000","last_change":"2023-08-17T00:16:37.346062+0000","last_active":"2023-08-17T00:16:37.346062+0000","last_peered":"2023-08-17T00:16:37.346062+0000","last_clean":"2023-08-17T00:16:37.346062+0000","last_became_active":"2023-08-17T00:16:37.345650+0000","last_became_peered":"2023-08-17T00:16:37.345650+0000","last_unstale":"2023-08-17T00:16:37.346062+0000","last_undegraded":"2023-08-17T00:16:37.346062+0000","last_fullsized":"2023-08-17T00:16:37.346062+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.339489+0000","last_change":"2023-08-17T00:16:36.914498+0000","last_active":"2023-08-17T00:16:37.339489+0000","last_peered":"2023-08-17T00:16:37.339489+0000","last_clean":"2023-08-17T00:16:37.339489+0000","last_became_active":"2023-08-17T00:16:36.913039+0000","last_became_peered":"2023-08-17T00:16:36.913039+0000","last_unstale":"2023-08-17T00:16:37.339489+0000","last_undegraded":"2023-08-17T00:16:37.339489+0000","last_fullsized":"2023-08-17T00:16:37.339489+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358746+0000","last_change":"2023-08-17T00:16:37.352236+0000","last_active":"2023-08-17T00:16:37.358746+0000","last_peered":"2023-08-17T00:16:37.358746+0000","last_clean":"2023-08-17T00:16:37.358746+0000","last_became_active":"2023-08-17T00:16:37.351920+0000","last_became_peered":"2023-08-17T00:16:37.351920+0000","last_unstale":"2023-08-17T00:16:37.358746+0000","last_undegraded":"2023-08-17T00:16:37.358746+0000","last_fullsized":"2023-08-17T00:16:37.358746+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326091+0000","last_change":"2023-08-17T00:16:36.917520+0000","last_active":"2023-08-17T00:16:37.326091+0000","last_peered":"2023-08-17T00:16:37.326091+0000","last_clean":"2023-08-17T00:16:37.326091+0000","last_became_active":"2023-08-17T00:16:36.917223+0000","last_became_peered":"2023-08-17T00:16:36.917223+0000","last_unstale":"2023-08-17T00:16:37.326091+0000","last_undegraded":"2023-08-17T00:16:37.326091+0000","last_fullsized":"2023-08-17T00:16:37.326091+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.342705+0000","last_change":"2023-08-17T00:16:37.342705+0000","last_active":"2023-08-17T00:16:37.342705+0000","last_peered":"2023-08-17T00:16:37.342705+0000","last_clean":"2023-08-17T00:16:37.342705+0000","last_became_active":"2023-08-17T00:16:37.342399+0000","last_became_peered":"2023-08-17T00:16:37.342399+0000","last_unstale":"2023-08-17T00:16:37.342705+0000","last_undegraded":"2023-08-17T00:16:37.342705+0000","last_fullsized":"2023-08-17T00:16:37.342705+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353769+0000","last_change":"2023-08-17T00:16:36.903458+0000","last_active":"2023-08-17T00:16:37.353769+0000","last_peered":"2023-08-17T00:16:37.353769+0000","last_clean":"2023-08-17T00:16:37.353769+0000","last_became_active":"2023-08-17T00:16:36.903092+0000","last_became_peered":"2023-08-17T00:16:36.903092+0000","last_unstale":"2023-08-17T00:16:37.353769+0000","last_undegraded":"2023-08-17T00:16:37.353769+0000","last_fullsized":"2023-08-17T00:16:37.353769+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.342593+0000","last_change":"2023-08-17T00:16:37.337074+0000","last_active":"2023-08-17T00:16:37.342593+0000","last_peered":"2023-08-17T00:16:37.342593+0000","last_clean":"2023-08-17T00:16:37.342593+0000","last_became_active":"2023-08-17T00:16:37.336777+0000","last_became_peered":"2023-08-17T00:16:37.336777+0000","last_unstale":"2023-08-17T00:16:37.342593+0000","last_undegraded":"2023-08-17T00:16:37.342593+0000","last_fullsized":"2023-08-17T00:16:37.342593+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.34","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.365162+0000","last_change":"2023-08-17T00:16:36.911449+0000","last_active":"2023-08-17T00:16:37.365162+0000","last_peered":"2023-08-17T00:16:37.365162+0000","last_clean":"2023-08-17T00:16:37.365162+0000","last_became_active":"2023-08-17T00:16:36.910872+0000","last_became_peered":"2023-08-17T00:16:36.910872+0000","last_unstale":"2023-08-17T00:16:37.365162+0000","last_undegraded":"2023-08-17T00:16:37.365162+0000","last_fullsized":"2023-08-17T00:16:37.365162+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.349081+0000","last_change":"2023-08-17T00:16:37.349081+0000","last_active":"2023-08-17T00:16:37.349081+0000","last_peered":"2023-08-17T00:16:37.349081+0000","last_clean":"2023-08-17T00:16:37.349081+0000","last_became_active":"2023-08-17T00:16:37.348804+0000","last_became_peered":"2023-08-17T00:16:37.348804+0000","last_unstale":"2023-08-17T00:16:37.349081+0000","last_undegraded":"2023-08-17T00:16:37.349081+0000","last_fullsized":"2023-08-17T00:16:37.349081+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.33","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357278+0000","last_change":"2023-08-17T00:16:36.906896+0000","last_active":"2023-08-17T00:16:37.357278+0000","last_peered":"2023-08-17T00:16:37.357278+0000","last_clean":"2023-08-17T00:16:37.357278+0000","last_became_active":"2023-08-17T00:16:36.906570+0000","last_became_peered":"2023-08-17T00:16:36.906570+0000","last_unstale":"2023-08-17T00:16:37.357278+0000","last_undegraded":"2023-08-17T00:16:37.357278+0000","last_fullsized":"2023-08-17T00:16:37.357278+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358992+0000","last_change":"2023-08-17T00:16:37.356415+0000","last_active":"2023-08-17T00:16:37.358992+0000","last_peered":"2023-08-17T00:16:37.358992+0000","last_clean":"2023-08-17T00:16:37.358992+0000","last_became_active":"2023-08-17T00:16:37.356110+0000","last_became_peered":"2023-08-17T00:16:37.356110+0000","last_unstale":"2023-08-17T00:16:37.358992+0000","last_undegraded":"2023-08-17T00:16:37.358992+0000","last_fullsized":"2023-08-17T00:16:37.358992+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336705+0000","last_change":"2023-08-17T00:16:36.906850+0000","last_active":"2023-08-17T00:16:37.336705+0000","last_peered":"2023-08-17T00:16:37.336705+0000","last_clean":"2023-08-17T00:16:37.336705+0000","last_became_active":"2023-08-17T00:16:36.906580+0000","last_became_peered":"2023-08-17T00:16:36.906580+0000","last_unstale":"2023-08-17T00:16:37.336705+0000","last_undegraded":"2023-08-17T00:16:37.336705+0000","last_fullsized":"2023-08-17T00:16:37.336705+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354243+0000","last_change":"2023-08-17T00:16:37.350738+0000","last_active":"2023-08-17T00:16:37.354243+0000","last_peered":"2023-08-17T00:16:37.354243+0000","last_clean":"2023-08-17T00:16:37.354243+0000","last_became_active":"2023-08-17T00:16:37.350459+0000","last_became_peered":"2023-08-17T00:16:37.350459+0000","last_unstale":"2023-08-17T00:16:37.354243+0000","last_undegraded":"2023-08-17T00:16:37.354243+0000","last_fullsized":"2023-08-17T00:16:37.354243+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.347259+0000","last_change":"2023-08-17T00:16:36.901969+0000","last_active":"2023-08-17T00:16:37.347259+0000","last_peered":"2023-08-17T00:16:37.347259+0000","last_clean":"2023-08-17T00:16:37.347259+0000","last_became_active":"2023-08-17T00:16:36.901659+0000","last_became_peered":"2023-08-17T00:16:36.901659+0000","last_unstale":"2023-08-17T00:16:37.347259+0000","last_undegraded":"2023-08-17T00:16:37.347259+0000","last_fullsized":"2023-08-17T00:16:37.347259+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.349207+0000","last_change":"2023-08-17T00:16:37.345522+0000","last_active":"2023-08-17T00:16:37.349207+0000","last_peered":"2023-08-17T00:16:37.349207+0000","last_clean":"2023-08-17T00:16:37.349207+0000","last_became_active":"2023-08-17T00:16:37.345250+0000","last_became_peered":"2023-08-17T00:16:37.345250+0000","last_unstale":"2023-08-17T00:16:37.349207+0000","last_undegraded":"2023-08-17T00:16:37.349207+0000","last_fullsized":"2023-08-17T00:16:37.349207+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.30","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.359748+0000","last_change":"2023-08-17T00:16:36.907697+0000","last_active":"2023-08-17T00:16:37.359748+0000","last_peered":"2023-08-17T00:16:37.359748+0000","last_clean":"2023-08-17T00:16:37.359748+0000","last_became_active":"2023-08-17T00:16:36.907405+0000","last_became_peered":"2023-08-17T00:16:36.907405+0000","last_unstale":"2023-08-17T00:16:37.359748+0000","last_undegraded":"2023-08-17T00:16:37.359748+0000","last_fullsized":"2023-08-17T00:16:37.359748+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354118+0000","last_change":"2023-08-17T00:16:37.343767+0000","last_active":"2023-08-17T00:16:37.354118+0000","last_peered":"2023-08-17T00:16:37.354118+0000","last_clean":"2023-08-17T00:16:37.354118+0000","last_became_active":"2023-08-17T00:16:37.343116+0000","last_became_peered":"2023-08-17T00:16:37.343116+0000","last_unstale":"2023-08-17T00:16:37.354118+0000","last_undegraded":"2023-08-17T00:16:37.354118+0000","last_fullsized":"2023-08-17T00:16:37.354118+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.909092+0000","last_change":"2023-08-17T00:16:36.906637+0000","last_active":"2023-08-17T00:16:36.909092+0000","last_peered":"2023-08-17T00:16:36.909092+0000","last_clean":"2023-08-17T00:16:36.909092+0000","last_became_active":"2023-08-17T00:16:36.906354+0000","last_became_peered":"2023-08-17T00:16:36.906354+0000","last_unstale":"2023-08-17T00:16:36.909092+0000","last_undegraded":"2023-08-17T00:16:36.909092+0000","last_fullsized":"2023-08-17T00:16:36.909092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353886+0000","last_change":"2023-08-17T00:16:37.349564+0000","last_active":"2023-08-17T00:16:37.353886+0000","last_peered":"2023-08-17T00:16:37.353886+0000","last_clean":"2023-08-17T00:16:37.353886+0000","last_became_active":"2023-08-17T00:16:37.348934+0000","last_became_peered":"2023-08-17T00:16:37.348934+0000","last_unstale":"2023-08-17T00:16:37.353886+0000","last_undegraded":"2023-08-17T00:16:37.353886+0000","last_fullsized":"2023-08-17T00:16:37.353886+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.323982+0000","last_change":"2023-08-17T00:16:36.908012+0000","last_active":"2023-08-17T00:16:37.323982+0000","last_peered":"2023-08-17T00:16:37.323982+0000","last_clean":"2023-08-17T00:16:37.323982+0000","last_became_active":"2023-08-17T00:16:36.907743+0000","last_became_peered":"2023-08-17T00:16:36.907743+0000","last_unstale":"2023-08-17T00:16:37.323982+0000","last_undegraded":"2023-08-17T00:16:37.323982+0000","last_fullsized":"2023-08-17T00:16:37.323982+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358598+0000","last_change":"2023-08-17T00:16:37.350395+0000","last_active":"2023-08-17T00:16:37.358598+0000","last_peered":"2023-08-17T00:16:37.358598+0000","last_clean":"2023-08-17T00:16:37.358598+0000","last_became_active":"2023-08-17T00:16:37.349932+0000","last_became_peered":"2023-08-17T00:16:37.349932+0000","last_unstale":"2023-08-17T00:16:37.358598+0000","last_undegraded":"2023-08-17T00:16:37.358598+0000","last_fullsized":"2023-08-17T00:16:37.358598+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.2d","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357261+0000","last_change":"2023-08-17T00:16:36.914297+0000","last_active":"2023-08-17T00:16:37.357261+0000","last_peered":"2023-08-17T00:16:37.357261+0000","last_clean":"2023-08-17T00:16:37.357261+0000","last_became_active":"2023-08-17T00:16:36.913507+0000","last_became_peered":"2023-08-17T00:16:36.913507+0000","last_unstale":"2023-08-17T00:16:37.357261+0000","last_undegraded":"2023-08-17T00:16:37.357261+0000","last_fullsized":"2023-08-17T00:16:37.357261+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358852+0000","last_change":"2023-08-17T00:16:37.356602+0000","last_active":"2023-08-17T00:16:37.358852+0000","last_peered":"2023-08-17T00:16:37.358852+0000","last_clean":"2023-08-17T00:16:37.358852+0000","last_became_active":"2023-08-17T00:16:37.356282+0000","last_became_peered":"2023-08-17T00:16:37.356282+0000","last_unstale":"2023-08-17T00:16:37.358852+0000","last_undegraded":"2023-08-17T00:16:37.358852+0000","last_fullsized":"2023-08-17T00:16:37.358852+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336994+0000","last_change":"2023-08-17T00:16:36.922780+0000","last_active":"2023-08-17T00:16:37.336994+0000","last_peered":"2023-08-17T00:16:37.336994+0000","last_clean":"2023-08-17T00:16:37.336994+0000","last_became_active":"2023-08-17T00:16:36.922497+0000","last_became_peered":"2023-08-17T00:16:36.922497+0000","last_unstale":"2023-08-17T00:16:37.336994+0000","last_undegraded":"2023-08-17T00:16:37.336994+0000","last_fullsized":"2023-08-17T00:16:37.336994+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357462+0000","last_change":"2023-08-17T00:16:37.355521+0000","last_active":"2023-08-17T00:16:37.357462+0000","last_peered":"2023-08-17T00:16:37.357462+0000","last_clean":"2023-08-17T00:16:37.357462+0000","last_became_active":"2023-08-17T00:16:37.355239+0000","last_became_peered":"2023-08-17T00:16:37.355239+0000","last_unstale":"2023-08-17T00:16:37.357462+0000","last_undegraded":"2023-08-17T00:16:37.357462+0000","last_fullsized":"2023-08-17T00:16:37.357462+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357249+0000","last_change":"2023-08-17T00:16:36.909022+0000","last_active":"2023-08-17T00:16:37.357249+0000","last_peered":"2023-08-17T00:16:37.357249+0000","last_clean":"2023-08-17T00:16:37.357249+0000","last_became_active":"2023-08-17T00:16:36.908742+0000","last_became_peered":"2023-08-17T00:16:36.908742+0000","last_unstale":"2023-08-17T00:16:37.357249+0000","last_undegraded":"2023-08-17T00:16:37.357249+0000","last_fullsized":"2023-08-17T00:16:37.357249+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354191+0000","last_change":"2023-08-17T00:16:37.348081+0000","last_active":"2023-08-17T00:16:37.354191+0000","last_peered":"2023-08-17T00:16:37.354191+0000","last_clean":"2023-08-17T00:16:37.354191+0000","last_became_active":"2023-08-17T00:16:37.347815+0000","last_became_peered":"2023-08-17T00:16:37.347815+0000","last_unstale":"2023-08-17T00:16:37.354191+0000","last_undegraded":"2023-08-17T00:16:37.354191+0000","last_fullsized":"2023-08-17T00:16:37.354191+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.339371+0000","last_change":"2023-08-17T00:16:36.922211+0000","last_active":"2023-08-17T00:16:37.339371+0000","last_peered":"2023-08-17T00:16:37.339371+0000","last_clean":"2023-08-17T00:16:37.339371+0000","last_became_active":"2023-08-17T00:16:36.921927+0000","last_became_peered":"2023-08-17T00:16:36.921927+0000","last_unstale":"2023-08-17T00:16:37.339371+0000","last_undegraded":"2023-08-17T00:16:37.339371+0000","last_fullsized":"2023-08-17T00:16:37.339371+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357483+0000","last_change":"2023-08-17T00:16:37.355504+0000","last_active":"2023-08-17T00:16:37.357483+0000","last_peered":"2023-08-17T00:16:37.357483+0000","last_clean":"2023-08-17T00:16:37.357483+0000","last_became_active":"2023-08-17T00:16:37.355166+0000","last_became_peered":"2023-08-17T00:16:37.355166+0000","last_unstale":"2023-08-17T00:16:37.357483+0000","last_undegraded":"2023-08-17T00:16:37.357483+0000","last_fullsized":"2023-08-17T00:16:37.357483+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326431+0000","last_change":"2023-08-17T00:16:36.922705+0000","last_active":"2023-08-17T00:16:37.326431+0000","last_peered":"2023-08-17T00:16:37.326431+0000","last_clean":"2023-08-17T00:16:37.326431+0000","last_became_active":"2023-08-17T00:16:36.922404+0000","last_became_peered":"2023-08-17T00:16:36.922404+0000","last_unstale":"2023-08-17T00:16:37.326431+0000","last_undegraded":"2023-08-17T00:16:37.326431+0000","last_fullsized":"2023-08-17T00:16:37.326431+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348759+0000","last_change":"2023-08-17T00:16:37.339783+0000","last_active":"2023-08-17T00:16:37.348759+0000","last_peered":"2023-08-17T00:16:37.348759+0000","last_clean":"2023-08-17T00:16:37.348759+0000","last_became_active":"2023-08-17T00:16:37.339447+0000","last_became_peered":"2023-08-17T00:16:37.339447+0000","last_unstale":"2023-08-17T00:16:37.348759+0000","last_undegraded":"2023-08-17T00:16:37.348759+0000","last_fullsized":"2023-08-17T00:16:37.348759+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336730+0000","last_change":"2023-08-17T00:16:36.913378+0000","last_active":"2023-08-17T00:16:37.336730+0000","last_peered":"2023-08-17T00:16:37.336730+0000","last_clean":"2023-08-17T00:16:37.336730+0000","last_became_active":"2023-08-17T00:16:36.912759+0000","last_became_peered":"2023-08-17T00:16:36.912759+0000","last_unstale":"2023-08-17T00:16:37.336730+0000","last_undegraded":"2023-08-17T00:16:37.336730+0000","last_fullsized":"2023-08-17T00:16:37.336730+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.340071+0000","last_change":"2023-08-17T00:16:37.340071+0000","last_active":"2023-08-17T00:16:37.340071+0000","last_peered":"2023-08-17T00:16:37.340071+0000","last_clean":"2023-08-17T00:16:37.340071+0000","last_became_active":"2023-08-17T00:16:37.339773+0000","last_became_peered":"2023-08-17T00:16:37.339773+0000","last_unstale":"2023-08-17T00:16:37.340071+0000","last_undegraded":"2023-08-17T00:16:37.340071+0000","last_fullsized":"2023-08-17T00:16:37.340071+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.339575+0000","last_change":"2023-08-17T00:16:36.914839+0000","last_active":"2023-08-17T00:16:37.339575+0000","last_peered":"2023-08-17T00:16:37.339575+0000","last_clean":"2023-08-17T00:16:37.339575+0000","last_became_active":"2023-08-17T00:16:36.913453+0000","last_became_peered":"2023-08-17T00:16:36.913453+0000","last_unstale":"2023-08-17T00:16:37.339575+0000","last_undegraded":"2023-08-17T00:16:37.339575+0000","last_fullsized":"2023-08-17T00:16:37.339575+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.359465+0000","last_change":"2023-08-17T00:16:37.346811+0000","last_active":"2023-08-17T00:16:37.359465+0000","last_peered":"2023-08-17T00:16:37.359465+0000","last_clean":"2023-08-17T00:16:37.359465+0000","last_became_active":"2023-08-17T00:16:37.346544+0000","last_became_peered":"2023-08-17T00:16:37.346544+0000","last_unstale":"2023-08-17T00:16:37.359465+0000","last_undegraded":"2023-08-17T00:16:37.359465+0000","last_fullsized":"2023-08-17T00:16:37.359465+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.330104+0000","last_change":"2023-08-17T00:16:36.909889+0000","last_active":"2023-08-17T00:16:37.330104+0000","last_peered":"2023-08-17T00:16:37.330104+0000","last_clean":"2023-08-17T00:16:37.330104+0000","last_became_active":"2023-08-17T00:16:36.909616+0000","last_became_peered":"2023-08-17T00:16:36.909616+0000","last_unstale":"2023-08-17T00:16:37.330104+0000","last_undegraded":"2023-08-17T00:16:37.330104+0000","last_fullsized":"2023-08-17T00:16:37.330104+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358581+0000","last_change":"2023-08-17T00:16:37.350229+0000","last_active":"2023-08-17T00:16:37.358581+0000","last_peered":"2023-08-17T00:16:37.358581+0000","last_clean":"2023-08-17T00:16:37.358581+0000","last_became_active":"2023-08-17T00:16:37.349564+0000","last_became_peered":"2023-08-17T00:16:37.349564+0000","last_unstale":"2023-08-17T00:16:37.358581+0000","last_undegraded":"2023-08-17T00:16:37.358581+0000","last_fullsized":"2023-08-17T00:16:37.358581+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334611+0000","last_change":"2023-08-17T00:16:36.914569+0000","last_active":"2023-08-17T00:16:37.334611+0000","last_peered":"2023-08-17T00:16:37.334611+0000","last_clean":"2023-08-17T00:16:37.334611+0000","last_became_active":"2023-08-17T00:16:36.913840+0000","last_became_peered":"2023-08-17T00:16:36.913840+0000","last_unstale":"2023-08-17T00:16:37.334611+0000","last_undegraded":"2023-08-17T00:16:37.334611+0000","last_fullsized":"2023-08-17T00:16:37.334611+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.346281+0000","last_change":"2023-08-17T00:16:37.346281+0000","last_active":"2023-08-17T00:16:37.346281+0000","last_peered":"2023-08-17T00:16:37.346281+0000","last_clean":"2023-08-17T00:16:37.346281+0000","last_became_active":"2023-08-17T00:16:37.345718+0000","last_became_peered":"2023-08-17T00:16:37.345718+0000","last_unstale":"2023-08-17T00:16:37.346281+0000","last_undegraded":"2023-08-17T00:16:37.346281+0000","last_fullsized":"2023-08-17T00:16:37.346281+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.328063+0000","last_change":"2023-08-17T00:16:36.911371+0000","last_active":"2023-08-17T00:16:37.328063+0000","last_peered":"2023-08-17T00:16:37.328063+0000","last_clean":"2023-08-17T00:16:37.328063+0000","last_became_active":"2023-08-17T00:16:36.909907+0000","last_became_peered":"2023-08-17T00:16:36.909907+0000","last_unstale":"2023-08-17T00:16:37.328063+0000","last_undegraded":"2023-08-17T00:16:37.328063+0000","last_fullsized":"2023-08-17T00:16:37.328063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354311+0000","last_change":"2023-08-17T00:16:37.351931+0000","last_active":"2023-08-17T00:16:37.354311+0000","last_peered":"2023-08-17T00:16:37.354311+0000","last_clean":"2023-08-17T00:16:37.354311+0000","last_became_active":"2023-08-17T00:16:37.351642+0000","last_became_peered":"2023-08-17T00:16:37.351642+0000","last_unstale":"2023-08-17T00:16:37.354311+0000","last_undegraded":"2023-08-17T00:16:37.354311+0000","last_fullsized":"2023-08-17T00:16:37.354311+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.329930+0000","last_change":"2023-08-17T00:16:36.922686+0000","last_active":"2023-08-17T00:16:37.329930+0000","last_peered":"2023-08-17T00:16:37.329930+0000","last_clean":"2023-08-17T00:16:37.329930+0000","last_became_active":"2023-08-17T00:16:36.922372+0000","last_became_peered":"2023-08-17T00:16:36.922372+0000","last_unstale":"2023-08-17T00:16:37.329930+0000","last_undegraded":"2023-08-17T00:16:37.329930+0000","last_fullsized":"2023-08-17T00:16:37.329930+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352157+0000","last_change":"2023-08-17T00:16:37.341434+0000","last_active":"2023-08-17T00:16:37.352157+0000","last_peered":"2023-08-17T00:16:37.352157+0000","last_clean":"2023-08-17T00:16:37.352157+0000","last_became_active":"2023-08-17T00:16:37.341122+0000","last_became_peered":"2023-08-17T00:16:37.341122+0000","last_unstale":"2023-08-17T00:16:37.352157+0000","last_undegraded":"2023-08-17T00:16:37.352157+0000","last_fullsized":"2023-08-17T00:16:37.352157+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.333975+0000","last_change":"2023-08-17T00:16:36.910572+0000","last_active":"2023-08-17T00:16:37.333975+0000","last_peered":"2023-08-17T00:16:37.333975+0000","last_clean":"2023-08-17T00:16:37.333975+0000","last_became_active":"2023-08-17T00:16:36.910249+0000","last_became_peered":"2023-08-17T00:16:36.910249+0000","last_unstale":"2023-08-17T00:16:37.333975+0000","last_undegraded":"2023-08-17T00:16:37.333975+0000","last_fullsized":"2023-08-17T00:16:37.333975+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354009+0000","last_change":"2023-08-17T00:16:37.344616+0000","last_active":"2023-08-17T00:16:37.354009+0000","last_peered":"2023-08-17T00:16:37.354009+0000","last_clean":"2023-08-17T00:16:37.354009+0000","last_became_active":"2023-08-17T00:16:37.344301+0000","last_became_peered":"2023-08-17T00:16:37.344301+0000","last_unstale":"2023-08-17T00:16:37.354009+0000","last_undegraded":"2023-08-17T00:16:37.354009+0000","last_fullsized":"2023-08-17T00:16:37.354009+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337638+0000","last_change":"2023-08-17T00:16:36.918782+0000","last_active":"2023-08-17T00:16:37.337638+0000","last_peered":"2023-08-17T00:16:37.337638+0000","last_clean":"2023-08-17T00:16:37.337638+0000","last_became_active":"2023-08-17T00:16:36.918454+0000","last_became_peered":"2023-08-17T00:16:36.918454+0000","last_unstale":"2023-08-17T00:16:37.337638+0000","last_undegraded":"2023-08-17T00:16:37.337638+0000","last_fullsized":"2023-08-17T00:16:37.337638+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.364782+0000","last_change":"2023-08-17T00:16:37.361056+0000","last_active":"2023-08-17T00:16:37.364782+0000","last_peered":"2023-08-17T00:16:37.364782+0000","last_clean":"2023-08-17T00:16:37.364782+0000","last_became_active":"2023-08-17T00:16:37.360631+0000","last_became_peered":"2023-08-17T00:16:37.360631+0000","last_unstale":"2023-08-17T00:16:37.364782+0000","last_undegraded":"2023-08-17T00:16:37.364782+0000","last_fullsized":"2023-08-17T00:16:37.364782+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336834+0000","last_change":"2023-08-17T00:16:36.921409+0000","last_active":"2023-08-17T00:16:37.336834+0000","last_peered":"2023-08-17T00:16:37.336834+0000","last_clean":"2023-08-17T00:16:37.336834+0000","last_became_active":"2023-08-17T00:16:36.921096+0000","last_became_peered":"2023-08-17T00:16:36.921096+0000","last_unstale":"2023-08-17T00:16:37.336834+0000","last_undegraded":"2023-08-17T00:16:37.336834+0000","last_fullsized":"2023-08-17T00:16:37.336834+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.361163+0000","last_change":"2023-08-17T00:16:37.353101+0000","last_active":"2023-08-17T00:16:37.361163+0000","last_peered":"2023-08-17T00:16:37.361163+0000","last_clean":"2023-08-17T00:16:37.361163+0000","last_became_active":"2023-08-17T00:16:37.352651+0000","last_became_peered":"2023-08-17T00:16:37.352651+0000","last_unstale":"2023-08-17T00:16:37.361163+0000","last_undegraded":"2023-08-17T00:16:37.361163+0000","last_fullsized":"2023-08-17T00:16:37.361163+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326215+0000","last_change":"2023-08-17T00:16:36.913898+0000","last_active":"2023-08-17T00:16:37.326215+0000","last_peered":"2023-08-17T00:16:37.326215+0000","last_clean":"2023-08-17T00:16:37.326215+0000","last_became_active":"2023-08-17T00:16:36.913103+0000","last_became_peered":"2023-08-17T00:16:36.913103+0000","last_unstale":"2023-08-17T00:16:37.326215+0000","last_undegraded":"2023-08-17T00:16:37.326215+0000","last_fullsized":"2023-08-17T00:16:37.326215+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.345744+0000","last_change":"2023-08-17T00:16:37.345744+0000","last_active":"2023-08-17T00:16:37.345744+0000","last_peered":"2023-08-17T00:16:37.345744+0000","last_clean":"2023-08-17T00:16:37.345744+0000","last_became_active":"2023-08-17T00:16:37.345444+0000","last_became_peered":"2023-08-17T00:16:37.345444+0000","last_unstale":"2023-08-17T00:16:37.345744+0000","last_undegraded":"2023-08-17T00:16:37.345744+0000","last_fullsized":"2023-08-17T00:16:37.345744+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334259+0000","last_change":"2023-08-17T00:16:36.905595+0000","last_active":"2023-08-17T00:16:37.334259+0000","last_peered":"2023-08-17T00:16:37.334259+0000","last_clean":"2023-08-17T00:16:37.334259+0000","last_became_active":"2023-08-17T00:16:36.905024+0000","last_became_peered":"2023-08-17T00:16:36.905024+0000","last_unstale":"2023-08-17T00:16:37.334259+0000","last_undegraded":"2023-08-17T00:16:37.334259+0000","last_fullsized":"2023-08-17T00:16:37.334259+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.359989+0000","last_change":"2023-08-17T00:16:37.356452+0000","last_active":"2023-08-17T00:16:37.359989+0000","last_peered":"2023-08-17T00:16:37.359989+0000","last_clean":"2023-08-17T00:16:37.359989+0000","last_became_active":"2023-08-17T00:16:37.356128+0000","last_became_peered":"2023-08-17T00:16:37.356128+0000","last_unstale":"2023-08-17T00:16:37.359989+0000","last_undegraded":"2023-08-17T00:16:37.359989+0000","last_fullsized":"2023-08-17T00:16:37.359989+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.15","version":"177'3","reported_seq":13,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354236+0000","last_change":"2023-08-17T00:16:36.913403+0000","last_active":"2023-08-17T00:16:37.354236+0000","last_peered":"2023-08-17T00:16:37.354236+0000","last_clean":"2023-08-17T00:16:37.354236+0000","last_became_active":"2023-08-17T00:16:36.913088+0000","last_became_peered":"2023-08-17T00:16:36.913088+0000","last_unstale":"2023-08-17T00:16:37.354236+0000","last_undegraded":"2023-08-17T00:16:37.354236+0000","last_fullsized":"2023-08-17T00:16:37.354236+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353252+0000","last_change":"2023-08-17T00:16:37.348338+0000","last_active":"2023-08-17T00:16:37.353252+0000","last_peered":"2023-08-17T00:16:37.353252+0000","last_clean":"2023-08-17T00:16:37.353252+0000","last_became_active":"2023-08-17T00:16:37.348066+0000","last_became_peered":"2023-08-17T00:16:37.348066+0000","last_unstale":"2023-08-17T00:16:37.353252+0000","last_undegraded":"2023-08-17T00:16:37.353252+0000","last_fullsized":"2023-08-17T00:16:37.353252+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.14","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363433+0000","last_change":"2023-08-17T00:16:36.911625+0000","last_active":"2023-08-17T00:16:37.363433+0000","last_peered":"2023-08-17T00:16:37.363433+0000","last_clean":"2023-08-17T00:16:37.363433+0000","last_became_active":"2023-08-17T00:16:36.911169+0000","last_became_peered":"2023-08-17T00:16:36.911169+0000","last_unstale":"2023-08-17T00:16:37.363433+0000","last_undegraded":"2023-08-17T00:16:37.363433+0000","last_fullsized":"2023-08-17T00:16:37.363433+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.341273+0000","last_change":"2023-08-17T00:16:37.341273+0000","last_active":"2023-08-17T00:16:37.341273+0000","last_peered":"2023-08-17T00:16:37.341273+0000","last_clean":"2023-08-17T00:16:37.341273+0000","last_became_active":"2023-08-17T00:16:37.341007+0000","last_became_peered":"2023-08-17T00:16:37.341007+0000","last_unstale":"2023-08-17T00:16:37.341273+0000","last_undegraded":"2023-08-17T00:16:37.341273+0000","last_fullsized":"2023-08-17T00:16:37.341273+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.13","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363007+0000","last_change":"2023-08-17T00:16:36.905822+0000","last_active":"2023-08-17T00:16:37.363007+0000","last_peered":"2023-08-17T00:16:37.363007+0000","last_clean":"2023-08-17T00:16:37.363007+0000","last_became_active":"2023-08-17T00:16:36.905561+0000","last_became_peered":"2023-08-17T00:16:36.905561+0000","last_unstale":"2023-08-17T00:16:37.363007+0000","last_undegraded":"2023-08-17T00:16:37.363007+0000","last_fullsized":"2023-08-17T00:16:37.363007+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.343350+0000","last_change":"2023-08-17T00:16:37.343350+0000","last_active":"2023-08-17T00:16:37.343350+0000","last_peered":"2023-08-17T00:16:37.343350+0000","last_clean":"2023-08-17T00:16:37.343350+0000","last_became_active":"2023-08-17T00:16:37.343072+0000","last_became_peered":"2023-08-17T00:16:37.343072+0000","last_unstale":"2023-08-17T00:16:37.343350+0000","last_undegraded":"2023-08-17T00:16:37.343350+0000","last_fullsized":"2023-08-17T00:16:37.343350+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.327652+0000","last_change":"2023-08-17T00:16:36.921036+0000","last_active":"2023-08-17T00:16:37.327652+0000","last_peered":"2023-08-17T00:16:37.327652+0000","last_clean":"2023-08-17T00:16:37.327652+0000","last_became_active":"2023-08-17T00:16:36.920716+0000","last_became_peered":"2023-08-17T00:16:36.920716+0000","last_unstale":"2023-08-17T00:16:37.327652+0000","last_undegraded":"2023-08-17T00:16:37.327652+0000","last_fullsized":"2023-08-17T00:16:37.327652+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352350+0000","last_change":"2023-08-17T00:16:37.348667+0000","last_active":"2023-08-17T00:16:37.352350+0000","last_peered":"2023-08-17T00:16:37.352350+0000","last_clean":"2023-08-17T00:16:37.352350+0000","last_became_active":"2023-08-17T00:16:37.348344+0000","last_became_peered":"2023-08-17T00:16:37.348344+0000","last_unstale":"2023-08-17T00:16:37.352350+0000","last_undegraded":"2023-08-17T00:16:37.352350+0000","last_fullsized":"2023-08-17T00:16:37.352350+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337736+0000","last_change":"2023-08-17T00:16:36.920118+0000","last_active":"2023-08-17T00:16:37.337736+0000","last_peered":"2023-08-17T00:16:37.337736+0000","last_clean":"2023-08-17T00:16:37.337736+0000","last_became_active":"2023-08-17T00:16:36.919791+0000","last_became_peered":"2023-08-17T00:16:36.919791+0000","last_unstale":"2023-08-17T00:16:37.337736+0000","last_undegraded":"2023-08-17T00:16:37.337736+0000","last_fullsized":"2023-08-17T00:16:37.337736+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363138+0000","last_change":"2023-08-17T00:16:37.360883+0000","last_active":"2023-08-17T00:16:37.363138+0000","last_peered":"2023-08-17T00:16:37.363138+0000","last_clean":"2023-08-17T00:16:37.363138+0000","last_became_active":"2023-08-17T00:16:37.360312+0000","last_became_peered":"2023-08-17T00:16:37.360312+0000","last_unstale":"2023-08-17T00:16:37.363138+0000","last_undegraded":"2023-08-17T00:16:37.363138+0000","last_fullsized":"2023-08-17T00:16:37.363138+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.10","version":"177'4","reported_seq":14,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.357273+0000","last_change":"2023-08-17T00:16:36.911358+0000","last_active":"2023-08-17T00:16:37.357273+0000","last_peered":"2023-08-17T00:16:37.357273+0000","last_clean":"2023-08-17T00:16:37.357273+0000","last_became_active":"2023-08-17T00:16:36.911021+0000","last_became_peered":"2023-08-17T00:16:36.911021+0000","last_unstale":"2023-08-17T00:16:37.357273+0000","last_undegraded":"2023-08-17T00:16:37.357273+0000","last_fullsized":"2023-08-17T00:16:37.357273+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353521+0000","last_change":"2023-08-17T00:16:37.344069+0000","last_active":"2023-08-17T00:16:37.353521+0000","last_peered":"2023-08-17T00:16:37.353521+0000","last_clean":"2023-08-17T00:16:37.353521+0000","last_became_active":"2023-08-17T00:16:37.342340+0000","last_became_peered":"2023-08-17T00:16:37.342340+0000","last_unstale":"2023-08-17T00:16:37.353521+0000","last_undegraded":"2023-08-17T00:16:37.353521+0000","last_fullsized":"2023-08-17T00:16:37.353521+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354968+0000","last_change":"2023-08-17T00:16:36.919003+0000","last_active":"2023-08-17T00:16:37.354968+0000","last_peered":"2023-08-17T00:16:37.354968+0000","last_clean":"2023-08-17T00:16:37.354968+0000","last_became_active":"2023-08-17T00:16:36.918701+0000","last_became_peered":"2023-08-17T00:16:36.918701+0000","last_unstale":"2023-08-17T00:16:37.354968+0000","last_undegraded":"2023-08-17T00:16:37.354968+0000","last_fullsized":"2023-08-17T00:16:37.354968+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.350966+0000","last_change":"2023-08-17T00:16:37.337614+0000","last_active":"2023-08-17T00:16:37.350966+0000","last_peered":"2023-08-17T00:16:37.350966+0000","last_clean":"2023-08-17T00:16:37.350966+0000","last_became_active":"2023-08-17T00:16:37.337315+0000","last_became_peered":"2023-08-17T00:16:37.337315+0000","last_unstale":"2023-08-17T00:16:37.350966+0000","last_undegraded":"2023-08-17T00:16:37.350966+0000","last_fullsized":"2023-08-17T00:16:37.350966+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.e","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363369+0000","last_change":"2023-08-17T00:16:36.910601+0000","last_active":"2023-08-17T00:16:37.363369+0000","last_peered":"2023-08-17T00:16:37.363369+0000","last_clean":"2023-08-17T00:16:37.363369+0000","last_became_active":"2023-08-17T00:16:36.909542+0000","last_became_peered":"2023-08-17T00:16:36.909542+0000","last_unstale":"2023-08-17T00:16:37.363369+0000","last_undegraded":"2023-08-17T00:16:37.363369+0000","last_fullsized":"2023-08-17T00:16:37.363369+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358889+0000","last_change":"2023-08-17T00:16:37.351991+0000","last_active":"2023-08-17T00:16:37.358889+0000","last_peered":"2023-08-17T00:16:37.358889+0000","last_clean":"2023-08-17T00:16:37.358889+0000","last_became_active":"2023-08-17T00:16:37.351725+0000","last_became_peered":"2023-08-17T00:16:37.351725+0000","last_unstale":"2023-08-17T00:16:37.358889+0000","last_undegraded":"2023-08-17T00:16:37.358889+0000","last_fullsized":"2023-08-17T00:16:37.358889+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.330987+0000","last_change":"2023-08-17T00:16:36.913371+0000","last_active":"2023-08-17T00:16:37.330987+0000","last_peered":"2023-08-17T00:16:37.330987+0000","last_clean":"2023-08-17T00:16:37.330987+0000","last_became_active":"2023-08-17T00:16:36.913112+0000","last_became_peered":"2023-08-17T00:16:36.913112+0000","last_unstale":"2023-08-17T00:16:37.330987+0000","last_undegraded":"2023-08-17T00:16:37.330987+0000","last_fullsized":"2023-08-17T00:16:37.330987+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354039+0000","last_change":"2023-08-17T00:16:37.348832+0000","last_active":"2023-08-17T00:16:37.354039+0000","last_peered":"2023-08-17T00:16:37.354039+0000","last_clean":"2023-08-17T00:16:37.354039+0000","last_became_active":"2023-08-17T00:16:37.348523+0000","last_became_peered":"2023-08-17T00:16:37.348523+0000","last_unstale":"2023-08-17T00:16:37.354039+0000","last_undegraded":"2023-08-17T00:16:37.354039+0000","last_fullsized":"2023-08-17T00:16:37.354039+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337491+0000","last_change":"2023-08-17T00:16:36.911616+0000","last_active":"2023-08-17T00:16:37.337491+0000","last_peered":"2023-08-17T00:16:37.337491+0000","last_clean":"2023-08-17T00:16:37.337491+0000","last_became_active":"2023-08-17T00:16:36.911335+0000","last_became_peered":"2023-08-17T00:16:36.911335+0000","last_unstale":"2023-08-17T00:16:37.337491+0000","last_undegraded":"2023-08-17T00:16:37.337491+0000","last_fullsized":"2023-08-17T00:16:37.337491+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.345622+0000","last_change":"2023-08-17T00:16:37.345622+0000","last_active":"2023-08-17T00:16:37.345622+0000","last_peered":"2023-08-17T00:16:37.345622+0000","last_clean":"2023-08-17T00:16:37.345622+0000","last_became_active":"2023-08-17T00:16:37.345302+0000","last_became_peered":"2023-08-17T00:16:37.345302+0000","last_unstale":"2023-08-17T00:16:37.345622+0000","last_undegraded":"2023-08-17T00:16:37.345622+0000","last_fullsized":"2023-08-17T00:16:37.345622+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.b","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363092+0000","last_change":"2023-08-17T00:16:36.919858+0000","last_active":"2023-08-17T00:16:37.363092+0000","last_peered":"2023-08-17T00:16:37.363092+0000","last_clean":"2023-08-17T00:16:37.363092+0000","last_became_active":"2023-08-17T00:16:36.919539+0000","last_became_peered":"2023-08-17T00:16:36.919539+0000","last_unstale":"2023-08-17T00:16:37.363092+0000","last_undegraded":"2023-08-17T00:16:37.363092+0000","last_fullsized":"2023-08-17T00:16:37.363092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352833+0000","last_change":"2023-08-17T00:16:37.347693+0000","last_active":"2023-08-17T00:16:37.352833+0000","last_peered":"2023-08-17T00:16:37.352833+0000","last_clean":"2023-08-17T00:16:37.352833+0000","last_became_active":"2023-08-17T00:16:37.347416+0000","last_became_peered":"2023-08-17T00:16:37.347416+0000","last_unstale":"2023-08-17T00:16:37.352833+0000","last_undegraded":"2023-08-17T00:16:37.352833+0000","last_fullsized":"2023-08-17T00:16:37.352833+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.909112+0000","last_change":"2023-08-17T00:16:36.907265+0000","last_active":"2023-08-17T00:16:36.909112+0000","last_peered":"2023-08-17T00:16:36.909112+0000","last_clean":"2023-08-17T00:16:36.909112+0000","last_became_active":"2023-08-17T00:16:36.905537+0000","last_became_peered":"2023-08-17T00:16:36.905537+0000","last_unstale":"2023-08-17T00:16:36.909112+0000","last_undegraded":"2023-08-17T00:16:36.909112+0000","last_fullsized":"2023-08-17T00:16:36.909112+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336099+0000","last_change":"2023-08-17T00:16:37.336099+0000","last_active":"2023-08-17T00:16:37.336099+0000","last_peered":"2023-08-17T00:16:37.336099+0000","last_clean":"2023-08-17T00:16:37.336099+0000","last_became_active":"2023-08-17T00:16:37.335799+0000","last_became_peered":"2023-08-17T00:16:37.335799+0000","last_unstale":"2023-08-17T00:16:37.336099+0000","last_undegraded":"2023-08-17T00:16:37.336099+0000","last_fullsized":"2023-08-17T00:16:37.336099+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.326541+0000","last_change":"2023-08-17T00:16:36.917544+0000","last_active":"2023-08-17T00:16:37.326541+0000","last_peered":"2023-08-17T00:16:37.326541+0000","last_clean":"2023-08-17T00:16:37.326541+0000","last_became_active":"2023-08-17T00:16:36.917251+0000","last_became_peered":"2023-08-17T00:16:36.917251+0000","last_unstale":"2023-08-17T00:16:37.326541+0000","last_undegraded":"2023-08-17T00:16:37.326541+0000","last_fullsized":"2023-08-17T00:16:37.326541+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.354163+0000","last_change":"2023-08-17T00:16:37.344671+0000","last_active":"2023-08-17T00:16:37.354163+0000","last_peered":"2023-08-17T00:16:37.354163+0000","last_clean":"2023-08-17T00:16:37.354163+0000","last_became_active":"2023-08-17T00:16:37.342389+0000","last_became_peered":"2023-08-17T00:16:37.342389+0000","last_unstale":"2023-08-17T00:16:37.354163+0000","last_undegraded":"2023-08-17T00:16:37.354163+0000","last_fullsized":"2023-08-17T00:16:37.354163+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348621+0000","last_change":"2023-08-17T00:16:36.914472+0000","last_active":"2023-08-17T00:16:37.348621+0000","last_peered":"2023-08-17T00:16:37.348621+0000","last_clean":"2023-08-17T00:16:37.348621+0000","last_became_active":"2023-08-17T00:16:36.914176+0000","last_became_peered":"2023-08-17T00:16:36.914176+0000","last_unstale":"2023-08-17T00:16:37.348621+0000","last_undegraded":"2023-08-17T00:16:37.348621+0000","last_fullsized":"2023-08-17T00:16:37.348621+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348969+0000","last_change":"2023-08-17T00:16:37.342883+0000","last_active":"2023-08-17T00:16:37.348969+0000","last_peered":"2023-08-17T00:16:37.348969+0000","last_clean":"2023-08-17T00:16:37.348969+0000","last_became_active":"2023-08-17T00:16:37.342455+0000","last_became_peered":"2023-08-17T00:16:37.342455+0000","last_unstale":"2023-08-17T00:16:37.348969+0000","last_undegraded":"2023-08-17T00:16:37.348969+0000","last_fullsized":"2023-08-17T00:16:37.348969+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.7","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352777+0000","last_change":"2023-08-17T00:16:36.904777+0000","last_active":"2023-08-17T00:16:37.352777+0000","last_peered":"2023-08-17T00:16:37.352777+0000","last_clean":"2023-08-17T00:16:37.352777+0000","last_became_active":"2023-08-17T00:16:36.903877+0000","last_became_peered":"2023-08-17T00:16:36.903877+0000","last_unstale":"2023-08-17T00:16:37.352777+0000","last_undegraded":"2023-08-17T00:16:37.352777+0000","last_fullsized":"2023-08-17T00:16:37.352777+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348895+0000","last_change":"2023-08-17T00:16:37.342087+0000","last_active":"2023-08-17T00:16:37.348895+0000","last_peered":"2023-08-17T00:16:37.348895+0000","last_clean":"2023-08-17T00:16:37.348895+0000","last_became_active":"2023-08-17T00:16:37.341799+0000","last_became_peered":"2023-08-17T00:16:37.341799+0000","last_unstale":"2023-08-17T00:16:37.348895+0000","last_undegraded":"2023-08-17T00:16:37.348895+0000","last_fullsized":"2023-08-17T00:16:37.348895+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334371+0000","last_change":"2023-08-17T00:16:36.902416+0000","last_active":"2023-08-17T00:16:37.334371+0000","last_peered":"2023-08-17T00:16:37.334371+0000","last_clean":"2023-08-17T00:16:37.334371+0000","last_became_active":"2023-08-17T00:16:36.902067+0000","last_became_peered":"2023-08-17T00:16:36.902067+0000","last_unstale":"2023-08-17T00:16:37.334371+0000","last_undegraded":"2023-08-17T00:16:37.334371+0000","last_fullsized":"2023-08-17T00:16:37.334371+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362547+0000","last_change":"2023-08-17T00:16:37.359641+0000","last_active":"2023-08-17T00:16:37.362547+0000","last_peered":"2023-08-17T00:16:37.362547+0000","last_clean":"2023-08-17T00:16:37.362547+0000","last_became_active":"2023-08-17T00:16:37.359369+0000","last_became_peered":"2023-08-17T00:16:37.359369+0000","last_unstale":"2023-08-17T00:16:37.362547+0000","last_undegraded":"2023-08-17T00:16:37.362547+0000","last_fullsized":"2023-08-17T00:16:37.362547+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.340298+0000","last_change":"2023-08-17T00:16:36.920273+0000","last_active":"2023-08-17T00:16:37.340298+0000","last_peered":"2023-08-17T00:16:37.340298+0000","last_clean":"2023-08-17T00:16:37.340298+0000","last_became_active":"2023-08-17T00:16:36.920003+0000","last_became_peered":"2023-08-17T00:16:36.920003+0000","last_unstale":"2023-08-17T00:16:37.340298+0000","last_undegraded":"2023-08-17T00:16:37.340298+0000","last_fullsized":"2023-08-17T00:16:37.340298+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348352+0000","last_change":"2023-08-17T00:16:37.348352+0000","last_active":"2023-08-17T00:16:37.348352+0000","last_peered":"2023-08-17T00:16:37.348352+0000","last_clean":"2023-08-17T00:16:37.348352+0000","last_became_active":"2023-08-17T00:16:37.348055+0000","last_became_peered":"2023-08-17T00:16:37.348055+0000","last_unstale":"2023-08-17T00:16:37.348352+0000","last_undegraded":"2023-08-17T00:16:37.348352+0000","last_fullsized":"2023-08-17T00:16:37.348352+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334021+0000","last_change":"2023-08-17T00:16:36.913393+0000","last_active":"2023-08-17T00:16:37.334021+0000","last_peered":"2023-08-17T00:16:37.334021+0000","last_clean":"2023-08-17T00:16:37.334021+0000","last_became_active":"2023-08-17T00:16:36.913051+0000","last_became_peered":"2023-08-17T00:16:36.913051+0000","last_unstale":"2023-08-17T00:16:37.334021+0000","last_undegraded":"2023-08-17T00:16:37.334021+0000","last_fullsized":"2023-08-17T00:16:37.334021+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.346960+0000","last_change":"2023-08-17T00:16:37.342978+0000","last_active":"2023-08-17T00:16:37.346960+0000","last_peered":"2023-08-17T00:16:37.346960+0000","last_clean":"2023-08-17T00:16:37.346960+0000","last_became_active":"2023-08-17T00:16:37.342711+0000","last_became_peered":"2023-08-17T00:16:37.342711+0000","last_unstale":"2023-08-17T00:16:37.346960+0000","last_undegraded":"2023-08-17T00:16:37.346960+0000","last_fullsized":"2023-08-17T00:16:37.346960+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.349573+0000","last_change":"2023-08-17T00:16:36.907711+0000","last_active":"2023-08-17T00:16:37.349573+0000","last_peered":"2023-08-17T00:16:37.349573+0000","last_clean":"2023-08-17T00:16:37.349573+0000","last_became_active":"2023-08-17T00:16:36.907451+0000","last_became_peered":"2023-08-17T00:16:36.907451+0000","last_unstale":"2023-08-17T00:16:37.349573+0000","last_undegraded":"2023-08-17T00:16:37.349573+0000","last_fullsized":"2023-08-17T00:16:37.349573+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353865+0000","last_change":"2023-08-17T00:16:37.344849+0000","last_active":"2023-08-17T00:16:37.353865+0000","last_peered":"2023-08-17T00:16:37.353865+0000","last_clean":"2023-08-17T00:16:37.353865+0000","last_became_active":"2023-08-17T00:16:37.344579+0000","last_became_peered":"2023-08-17T00:16:37.344579+0000","last_unstale":"2023-08-17T00:16:37.353865+0000","last_undegraded":"2023-08-17T00:16:37.353865+0000","last_fullsized":"2023-08-17T00:16:37.353865+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336817+0000","last_change":"2023-08-17T00:16:36.914283+0000","last_active":"2023-08-17T00:16:37.336817+0000","last_peered":"2023-08-17T00:16:37.336817+0000","last_clean":"2023-08-17T00:16:37.336817+0000","last_became_active":"2023-08-17T00:16:36.913293+0000","last_became_peered":"2023-08-17T00:16:36.913293+0000","last_unstale":"2023-08-17T00:16:37.336817+0000","last_undegraded":"2023-08-17T00:16:37.336817+0000","last_fullsized":"2023-08-17T00:16:37.336817+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353302+0000","last_change":"2023-08-17T00:16:37.348823+0000","last_active":"2023-08-17T00:16:37.353302+0000","last_peered":"2023-08-17T00:16:37.353302+0000","last_clean":"2023-08-17T00:16:37.353302+0000","last_became_active":"2023-08-17T00:16:37.348518+0000","last_became_peered":"2023-08-17T00:16:37.348518+0000","last_unstale":"2023-08-17T00:16:37.353302+0000","last_undegraded":"2023-08-17T00:16:37.353302+0000","last_fullsized":"2023-08-17T00:16:37.353302+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337829+0000","last_change":"2023-08-17T00:16:36.922245+0000","last_active":"2023-08-17T00:16:37.337829+0000","last_peered":"2023-08-17T00:16:37.337829+0000","last_clean":"2023-08-17T00:16:37.337829+0000","last_became_active":"2023-08-17T00:16:36.921943+0000","last_became_peered":"2023-08-17T00:16:36.921943+0000","last_unstale":"2023-08-17T00:16:37.337829+0000","last_undegraded":"2023-08-17T00:16:37.337829+0000","last_fullsized":"2023-08-17T00:16:37.337829+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358735+0000","last_change":"2023-08-17T00:16:37.350794+0000","last_active":"2023-08-17T00:16:37.358735+0000","last_peered":"2023-08-17T00:16:37.358735+0000","last_clean":"2023-08-17T00:16:37.358735+0000","last_became_active":"2023-08-17T00:16:37.348273+0000","last_became_peered":"2023-08-17T00:16:37.348273+0000","last_unstale":"2023-08-17T00:16:37.358735+0000","last_undegraded":"2023-08-17T00:16:37.358735+0000","last_fullsized":"2023-08-17T00:16:37.358735+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336889+0000","last_change":"2023-08-17T00:16:36.906850+0000","last_active":"2023-08-17T00:16:37.336889+0000","last_peered":"2023-08-17T00:16:37.336889+0000","last_clean":"2023-08-17T00:16:37.336889+0000","last_became_active":"2023-08-17T00:16:36.906614+0000","last_became_peered":"2023-08-17T00:16:36.906614+0000","last_unstale":"2023-08-17T00:16:37.336889+0000","last_undegraded":"2023-08-17T00:16:37.336889+0000","last_fullsized":"2023-08-17T00:16:37.336889+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.355032+0000","last_change":"2023-08-17T00:16:37.345562+0000","last_active":"2023-08-17T00:16:37.355032+0000","last_peered":"2023-08-17T00:16:37.355032+0000","last_clean":"2023-08-17T00:16:37.355032+0000","last_became_active":"2023-08-17T00:16:37.345284+0000","last_became_peered":"2023-08-17T00:16:37.345284+0000","last_unstale":"2023-08-17T00:16:37.355032+0000","last_undegraded":"2023-08-17T00:16:37.355032+0000","last_fullsized":"2023-08-17T00:16:37.355032+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337386+0000","last_change":"2023-08-17T00:16:36.904167+0000","last_active":"2023-08-17T00:16:37.337386+0000","last_peered":"2023-08-17T00:16:37.337386+0000","last_clean":"2023-08-17T00:16:37.337386+0000","last_became_active":"2023-08-17T00:16:36.903876+0000","last_became_peered":"2023-08-17T00:16:36.903876+0000","last_unstale":"2023-08-17T00:16:37.337386+0000","last_undegraded":"2023-08-17T00:16:37.337386+0000","last_fullsized":"2023-08-17T00:16:37.337386+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.352978+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:16:37.352978+0000","last_peered":"2023-08-17T00:16:37.352978+0000","last_clean":"2023-08-17T00:16:37.352978+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:16:37.352978+0000","last_undegraded":"2023-08-17T00:16:37.352978+0000","last_fullsized":"2023-08-17T00:16:37.352978+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.362289+0000","last_change":"2023-08-17T00:16:37.355972+0000","last_active":"2023-08-17T00:16:37.362289+0000","last_peered":"2023-08-17T00:16:37.362289+0000","last_clean":"2023-08-17T00:16:37.362289+0000","last_became_active":"2023-08-17T00:16:37.355141+0000","last_became_peered":"2023-08-17T00:16:37.355141+0000","last_unstale":"2023-08-17T00:16:37.362289+0000","last_undegraded":"2023-08-17T00:16:37.362289+0000","last_fullsized":"2023-08-17T00:16:37.362289+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.1d","version":"177'2","reported_seq":12,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.356211+0000","last_change":"2023-08-17T00:16:36.907723+0000","last_active":"2023-08-17T00:16:37.356211+0000","last_peered":"2023-08-17T00:16:37.356211+0000","last_clean":"2023-08-17T00:16:37.356211+0000","last_became_active":"2023-08-17T00:16:36.907429+0000","last_became_peered":"2023-08-17T00:16:36.907429+0000","last_unstale":"2023-08-17T00:16:37.356211+0000","last_undegraded":"2023-08-17T00:16:37.356211+0000","last_fullsized":"2023-08-17T00:16:37.356211+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.894160+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:16:36.894160+0000","last_peered":"2023-08-17T00:16:36.894160+0000","last_clean":"2023-08-17T00:16:36.894160+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:16:36.894160+0000","last_undegraded":"2023-08-17T00:16:36.894160+0000","last_fullsized":"2023-08-17T00:16:36.894160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.338709+0000","last_change":"2023-08-17T00:16:37.338709+0000","last_active":"2023-08-17T00:16:37.338709+0000","last_peered":"2023-08-17T00:16:37.338709+0000","last_clean":"2023-08-17T00:16:37.338709+0000","last_became_active":"2023-08-17T00:16:37.338425+0000","last_became_peered":"2023-08-17T00:16:37.338425+0000","last_unstale":"2023-08-17T00:16:37.338709+0000","last_undegraded":"2023-08-17T00:16:37.338709+0000","last_fullsized":"2023-08-17T00:16:37.338709+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1e","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.363327+0000","last_change":"2023-08-17T00:16:36.922846+0000","last_active":"2023-08-17T00:16:37.363327+0000","last_peered":"2023-08-17T00:16:37.363327+0000","last_clean":"2023-08-17T00:16:37.363327+0000","last_became_active":"2023-08-17T00:16:36.922540+0000","last_became_peered":"2023-08-17T00:16:36.922540+0000","last_unstale":"2023-08-17T00:16:37.363327+0000","last_undegraded":"2023-08-17T00:16:37.363327+0000","last_fullsized":"2023-08-17T00:16:37.363327+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353846+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:16:37.353846+0000","last_peered":"2023-08-17T00:16:37.353846+0000","last_clean":"2023-08-17T00:16:37.353846+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:16:37.353846+0000","last_undegraded":"2023-08-17T00:16:37.353846+0000","last_fullsized":"2023-08-17T00:16:37.353846+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.360072+0000","last_change":"2023-08-17T00:16:37.356709+0000","last_active":"2023-08-17T00:16:37.360072+0000","last_peered":"2023-08-17T00:16:37.360072+0000","last_clean":"2023-08-17T00:16:37.360072+0000","last_became_active":"2023-08-17T00:16:37.356450+0000","last_became_peered":"2023-08-17T00:16:37.356450+0000","last_unstale":"2023-08-17T00:16:37.360072+0000","last_undegraded":"2023-08-17T00:16:37.360072+0000","last_fullsized":"2023-08-17T00:16:37.360072+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1f","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.353130+0000","last_change":"2023-08-17T00:16:36.920432+0000","last_active":"2023-08-17T00:16:37.353130+0000","last_peered":"2023-08-17T00:16:37.353130+0000","last_clean":"2023-08-17T00:16:37.353130+0000","last_became_active":"2023-08-17T00:16:36.920150+0000","last_became_peered":"2023-08-17T00:16:36.920150+0000","last_unstale":"2023-08-17T00:16:37.353130+0000","last_undegraded":"2023-08-17T00:16:37.353130+0000","last_fullsized":"2023-08-17T00:16:37.353130+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.334101+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:16:37.334101+0000","last_peered":"2023-08-17T00:16:37.334101+0000","last_clean":"2023-08-17T00:16:37.334101+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:16:37.334101+0000","last_undegraded":"2023-08-17T00:16:37.334101+0000","last_fullsized":"2023-08-17T00:16:37.334101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.360110+0000","last_change":"2023-08-17T00:16:37.357779+0000","last_active":"2023-08-17T00:16:37.360110+0000","last_peered":"2023-08-17T00:16:37.360110+0000","last_clean":"2023-08-17T00:16:37.360110+0000","last_became_active":"2023-08-17T00:16:37.357442+0000","last_became_peered":"2023-08-17T00:16:37.357442+0000","last_unstale":"2023-08-17T00:16:37.360110+0000","last_undegraded":"2023-08-17T00:16:37.360110+0000","last_fullsized":"2023-08-17T00:16:37.360110+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.347384+0000","last_change":"2023-08-17T00:16:36.914375+0000","last_active":"2023-08-17T00:16:37.347384+0000","last_peered":"2023-08-17T00:16:37.347384+0000","last_clean":"2023-08-17T00:16:37.347384+0000","last_became_active":"2023-08-17T00:16:36.914095+0000","last_became_peered":"2023-08-17T00:16:36.914095+0000","last_unstale":"2023-08-17T00:16:37.347384+0000","last_undegraded":"2023-08-17T00:16:37.347384+0000","last_fullsized":"2023-08-17T00:16:37.347384+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348812+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:16:37.348812+0000","last_peered":"2023-08-17T00:16:37.348812+0000","last_clean":"2023-08-17T00:16:37.348812+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:16:37.348812+0000","last_undegraded":"2023-08-17T00:16:37.348812+0000","last_fullsized":"2023-08-17T00:16:37.348812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":8,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.338980+0000","last_change":"2023-08-17T00:16:37.338980+0000","last_active":"2023-08-17T00:16:37.338980+0000","last_peered":"2023-08-17T00:16:37.338980+0000","last_clean":"2023-08-17T00:16:37.338980+0000","last_became_active":"2023-08-17T00:16:37.338701+0000","last_became_peered":"2023-08-17T00:16:37.338701+0000","last_unstale":"2023-08-17T00:16:37.338980+0000","last_undegraded":"2023-08-17T00:16:37.338980+0000","last_fullsized":"2023-08-17T00:16:37.338980+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.908100+0000","last_change":"2023-08-17T00:16:36.903717+0000","last_active":"2023-08-17T00:16:36.908100+0000","last_peered":"2023-08-17T00:16:36.908100+0000","last_clean":"2023-08-17T00:16:36.908100+0000","last_became_active":"2023-08-17T00:16:36.903135+0000","last_became_peered":"2023-08-17T00:16:36.903135+0000","last_unstale":"2023-08-17T00:16:36.908100+0000","last_undegraded":"2023-08-17T00:16:36.908100+0000","last_fullsized":"2023-08-17T00:16:36.908100+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":139,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337939+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:16:37.337939+0000","last_peered":"2023-08-17T00:16:37.337939+0000","last_clean":"2023-08-17T00:16:37.337939+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:16:37.337939+0000","last_undegraded":"2023-08-17T00:16:37.337939+0000","last_fullsized":"2023-08-17T00:16:37.337939+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.358903+0000","last_change":"2023-08-17T00:16:37.350050+0000","last_active":"2023-08-17T00:16:37.358903+0000","last_peered":"2023-08-17T00:16:37.358903+0000","last_clean":"2023-08-17T00:16:37.358903+0000","last_became_active":"2023-08-17T00:16:37.348295+0000","last_became_peered":"2023-08-17T00:16:37.348295+0000","last_unstale":"2023-08-17T00:16:37.358903+0000","last_undegraded":"2023-08-17T00:16:37.358903+0000","last_fullsized":"2023-08-17T00:16:37.358903+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":10,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.337006+0000","last_change":"2023-08-17T00:16:36.921355+0000","last_active":"2023-08-17T00:16:37.337006+0000","last_peered":"2023-08-17T00:16:37.337006+0000","last_clean":"2023-08-17T00:16:37.337006+0000","last_became_active":"2023-08-17T00:16:36.920605+0000","last_became_peered":"2023-08-17T00:16:36.920605+0000","last_unstale":"2023-08-17T00:16:37.337006+0000","last_undegraded":"2023-08-17T00:16:37.337006+0000","last_fullsized":"2023-08-17T00:16:37.337006+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.348723+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:16:37.348723+0000","last_peered":"2023-08-17T00:16:37.348723+0000","last_clean":"2023-08-17T00:16:37.348723+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:16:37.348723+0000","last_undegraded":"2023-08-17T00:16:37.348723+0000","last_fullsized":"2023-08-17T00:16:37.348723+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.340668+0000","last_change":"2023-08-17T00:16:37.339249+0000","last_active":"2023-08-17T00:16:37.340668+0000","last_peered":"2023-08-17T00:16:37.340668+0000","last_clean":"2023-08-17T00:16:37.340668+0000","last_became_active":"2023-08-17T00:16:37.338950+0000","last_became_peered":"2023-08-17T00:16:37.338950+0000","last_unstale":"2023-08-17T00:16:37.340668+0000","last_undegraded":"2023-08-17T00:16:37.340668+0000","last_fullsized":"2023-08-17T00:16:37.340668+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":176,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:36.872407+0000","last_clean_scrub_stamp":"2023-08-17T00:16:36.872407+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-08-17T00:16:36.914240+0000","last_change":"2023-08-17T00:16:36.910332+0000","last_active":"2023-08-17T00:16:36.914240+0000","last_peered":"2023-08-17T00:16:36.914240+0000","last_clean":"2023-08-17T00:16:36.914240+0000","last_became_active":"2023-08-17T00:16:36.910015+0000","last_became_peered":"2023-08-17T00:16:36.910015+0000","last_unstale":"2023-08-17T00:16:36.914240+0000","last_undegraded":"2023-08-17T00:16:36.914240+0000","last_fullsized":"2023-08-17T00:16:36.914240+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:16:35.859040+0000","last_clean_scrub_stamp":"2023-08-17T00:16:35.859040+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":142,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.351728+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:16:37.351728+0000","last_peered":"2023-08-17T00:16:37.351728+0000","last_clean":"2023-08-17T00:16:37.351728+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:16:37.351728+0000","last_undegraded":"2023-08-17T00:16:37.351728+0000","last_fullsized":"2023-08-17T00:16:37.351728+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":144,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-08-17T00:16:37.336972+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:16:37.336972+0000","last_peered":"2023-08-17T00:16:37.336972+0000","last_clean":"2023-08-17T00:16:37.336972+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:16:37.336972+0000","last_undegraded":"2023-08-17T00:16:37.336972+0000","last_fullsized":"2023-08-17T00:16:37.336972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542313,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315780,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":313600,"kb_avail":94056060,"statfs":{"total":96636764160,"available":96313405440,"internally_reserved":0,"allocated":2224128,"data_stored":1043887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321126400},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":1.331},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.89300000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.3680000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":1.0649999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.008},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.256}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.109}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.401},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.468}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":1.5349999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299412,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072428,"statfs":{"total":96636764160,"available":96330166272,"internally_reserved":0,"allocated":2240512,"data_stored":1051213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":1.2370000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":1.1539999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.373}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":1.3280000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":1.181},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":1.4219999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542314,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307604,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064236,"statfs":{"total":96636764160,"available":96321777664,"internally_reserved":0,"allocated":2240512,"data_stored":1050729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":1.0960000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":1.2390000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.004},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.0580000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1579999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.296}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.226},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.385}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.359},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.2749999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542313,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307604,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064236,"statfs":{"total":96636764160,"available":96321777664,"internally_reserved":0,"allocated":2240512,"data_stored":1052015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.004},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.1990000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.2589999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.3640000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.3}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.24},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.335}]}]},{"osd":2,"up_from":14,"seq":60129542313,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311704,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060136,"statfs":{"total":96636764160,"available":96317579264,"internally_reserved":0,"allocated":2244608,"data_stored":1051247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":1.1970000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":1.028},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":1.484}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":1.4279999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":1.0009999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.532}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.1100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.179},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.625}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.3600000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.3939999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542313,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303500,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":94068340,"statfs":{"total":96636764160,"available":96325980160,"internally_reserved":0,"allocated":2232320,"data_stored":1050569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.873,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.2789999999999999,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91800000000000004,"15min":0.91300000000000003},"min":{"1min":0.752,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.214,"5min":1.6200000000000001,"15min":13.093},"last":0.93300000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.2689999999999999,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":0.88500000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0249999999999999,"15min":1.0129999999999999},"min":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.363,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":1.054},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.0800000000000001,"15min":1.139},"min":{"1min":0.92600000000000005,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.552,"5min":1.671,"15min":20.548999999999999},"last":1.131},{"interface":"front","average":{"1min":1.3,"5min":1.214,"15min":1.204},"min":{"1min":0.97399999999999998,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.381}]},{"osd":5,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":1.1779999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.623,"5min":3.137,"15min":13.170999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.2270000000000001,"15min":1.236},"min":{"1min":1.0760000000000001,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.4510000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.3120000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.95899999999999996,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.603,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.087},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.216,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5620000000000001,"5min":2.0150000000000001,"15min":5.5359999999999996},"last":1.244}]},{"osd":7,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.294,"15min":1.298},"min":{"1min":1.0409999999999999,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.675,"5min":3.1520000000000001,"15min":6.9779999999999998},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.319},"min":{"1min":1.0229999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7230000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.1830000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542314,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311700,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94060140,"statfs":{"total":96636764160,"available":96317583360,"internally_reserved":0,"allocated":2240512,"data_stored":1045493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":0.53600000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":1.016},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":0.86099999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.03}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.111},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":1.1279999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":0.96099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575018,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307588,"kb_used_data":2172,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064252,"statfs":{"total":96636764160,"available":96321794048,"internally_reserved":0,"allocated":2224128,"data_stored":1043899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":1.0600000000000001},"min":{"1min":0.77600000000000002,"5min":0.622,"15min":0.38300000000000001},"max":{"1min":1.4350000000000001,"5min":1.677,"15min":7.1379999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.345,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1379999999999999,"15min":1.22},"min":{"1min":0.745,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.4039999999999999,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.085},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.153,"15min":1.216},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.732,"5min":1.732,"15min":6.9000000000000004},"last":1.24}]},{"osd":2,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.083,"15min":1.2130000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.4179999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.083,"15min":1.3089999999999999},"min":{"1min":0.91600000000000004,"5min":0.755,"15min":0.36699999999999999},"max":{"1min":1.5880000000000001,"5min":1.623,"15min":36.531999999999996},"last":1.1299999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.117},"min":{"1min":0.79300000000000004,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.522,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.175,"15min":1.3779999999999999},"min":{"1min":0.876,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.603,"5min":1.7569999999999999,"15min":36.530000000000001},"last":1.002}]},{"osd":5,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.24},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.254,"5min":1.228,"15min":1.2829999999999999},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.633,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2390000000000001,"15min":1.3200000000000001},"min":{"1min":0.877,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.875,"15min":8.4190000000000005},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.321,"15min":1.369},"min":{"1min":1.032,"5min":0.77400000000000002,"15min":0.49399999999999999},"max":{"1min":1.8260000000000001,"5min":1.911,"15min":6.1689999999999996},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.222,"15min":1.248},"min":{"1min":0.83399999999999996,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.5249999999999999,"5min":3.645,"15min":3.645},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3220000000000001,"15min":1.3879999999999999},"min":{"1min":1.0149999999999999,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.879,"5min":1.9690000000000001,"15min":8.327},"last":1.1599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:16:42.054 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:16:42.055 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:16:42.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.251+0000 7fe8f385b700 1 Processor -- start 2023-08-17T00:16:42.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.251+0000 7fe8f385b700 1 -- start start 2023-08-17T00:16:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f385b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f385b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe8ec154130 0x7fe8ec0629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f385b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8ec065240 con 0x7fe8ec0656d0 2023-08-17T00:16:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f385b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec062ea0 con 0x7fe8ec154130 2023-08-17T00:16:42.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f385b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec063880 con 0x7fe8ec153d50 2023-08-17T00:16:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f1df8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe8ec0656d0 0x7fe8ec0bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45364/0 (socket says 172.21.15.153:45364) 2023-08-17T00:16:42.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f1df8700 1 -- 172.21.15.153:0/1032308268 learned_addr learned my addr 172.21.15.153:0/1032308268 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f15f7700 1 --2- 172.21.15.153:0/1032308268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.255+0000 7fe8f0df6700 1 --2- 172.21.15.153:0/1032308268 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec154130 0x7fe8ec0629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8e3fff700 1 -- 172.21.15.153:0/1032308268 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323037872 0 0) 0x7fe8ec065240 con 0x7fe8ec0656d0 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f15f7700 1 -- 172.21.15.153:0/1032308268 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec154130 msgr2=0x7fe8ec0629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f15f7700 1 --2- 172.21.15.153:0/1032308268 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec154130 0x7fe8ec0629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f15f7700 1 -- 172.21.15.153:0/1032308268 >> v1:172.21.15.153:6789/0 conn(0x7fe8ec0656d0 legacy=0x7fe8ec0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f15f7700 1 -- 172.21.15.153:0/1032308268 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec064910 con 0x7fe8ec153d50 2023-08-17T00:16:42.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f15f7700 1 --2- 172.21.15.153:0/1032308268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0632e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fe8e8009760 tx=0x7fe8e8009060).ready entity=mon.2 client_cookie=e0376d9bad1ff993 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:42.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8e3fff700 1 -- 172.21.15.153:0/1032308268 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e80090d0 con 0x7fe8ec153d50 2023-08-17T00:16:42.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8e3fff700 1 -- 172.21.15.153:0/1032308268 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e800f510 con 0x7fe8ec153d50 2023-08-17T00:16:42.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8e3fff700 1 -- 172.21.15.153:0/1032308268 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e800f890 con 0x7fe8ec153d50 2023-08-17T00:16:42.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 -- 172.21.15.153:0/1032308268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 msgr2=0x7fe8ec0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 --2- 172.21.15.153:0/1032308268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0632e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7fe8e8009760 tx=0x7fe8e8009060).stop 2023-08-17T00:16:42.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 -- 172.21.15.153:0/1032308268 shutdown_connections 2023-08-17T00:16:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 --2- 172.21.15.153:0/1032308268 >> v2:172.21.15.153:3300/0 conn(0x7fe8ec154130 0x7fe8ec0629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 --2- 172.21.15.153:0/1032308268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0632e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 -- 172.21.15.153:0/1032308268 >> 172.21.15.153:0/1032308268 conn(0x7fe8ec0c7150 msgr2=0x7fe8ec0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 -- 172.21.15.153:0/1032308268 shutdown_connections 2023-08-17T00:16:42.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.259+0000 7fe8f385b700 1 -- 172.21.15.153:0/1032308268 wait complete. 2023-08-17T00:16:42.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 Processor -- start 2023-08-17T00:16:42.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 -- start start 2023-08-17T00:16:42.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8ec0656d0 0x7fe8ec154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 0x7fe8ec0c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0c6420 con 0x7fe8ec154130 2023-08-17T00:16:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec155720 con 0x7fe8ec0656d0 2023-08-17T00:16:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f385b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec165910 con 0x7fe8ec153d50 2023-08-17T00:16:42.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.263+0000 7fe8f1df8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 0x7fe8ec0c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:42056/0 (socket says 172.21.15.153:42056) 2023-08-17T00:16:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 -- 172.21.15.153:0/4087730371 learned_addr learned my addr 172.21.15.153:0/4087730371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f1df8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 0x7fe8ec0c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39276/0 (socket says 172.21.15.153:39276) 2023-08-17T00:16:42.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f15f7700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8ec0656d0 0x7fe8ec154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 -- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8ec0656d0 msgr2=0x7fe8ec154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8ec0656d0 0x7fe8ec154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 -- 172.21.15.153:0/4087730371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 msgr2=0x7fe8ec0c5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 0x7fe8ec0c5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 -- 172.21.15.153:0/4087730371 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80092a0 con 0x7fe8ec153d50 2023-08-17T00:16:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f1df8700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 0x7fe8ec0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f0df6700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0c5a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe8dc00e930 tx=0x7fe8dc009060).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc012600 con 0x7fe8ec153d50 2023-08-17T00:16:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc012760 con 0x7fe8ec153d50 2023-08-17T00:16:42.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec154e80 con 0x7fe8ec153d50 2023-08-17T00:16:42.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc012ae0 con 0x7fe8ec153d50 2023-08-17T00:16:42.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec155440 con 0x7fe8ec153d50 2023-08-17T00:16:42.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.267+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec06b530 con 0x7fe8ec153d50 2023-08-17T00:16:42.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.271+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe8dc022070 con 0x7fe8ec153d50 2023-08-17T00:16:42.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.271+0000 7fe8e17fa700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8d005a150 0x7fe8d005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.271+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fe8dc0744d0 con 0x7fe8ec153d50 2023-08-17T00:16:42.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.275+0000 7fe8f15f7700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8d005a150 0x7fe8d005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.275+0000 7fe8f15f7700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8d005a150 0x7fe8d005c610 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fe8ec0ac8b0 tx=0x7fe8e8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:42.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.279+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe8dc047e30 con 0x7fe8ec153d50 2023-08-17T00:16:42.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.507+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe8ec064bf0 con 0x7fe8ec153d50 2023-08-17T00:16:42.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.519+0000 7fe8e17fa700 1 -- 172.21.15.153:0/4087730371 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe8dc04b450 con 0x7fe8ec153d50 2023-08-17T00:16:42.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8d005a150 msgr2=0x7fe8d005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8d005a150 0x7fe8d005c610 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7fe8ec0ac8b0 tx=0x7fe8e8017000).stop 2023-08-17T00:16:42.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 msgr2=0x7fe8ec0c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0c5a40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fe8dc00e930 tx=0x7fe8dc009060).stop 2023-08-17T00:16:42.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 shutdown_connections 2023-08-17T00:16:42.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe8d005a150 0x7fe8d005c610 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe8ec154130 0x7fe8ec0c5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8ec153d50 0x7fe8ec0c5a40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 --2- 172.21.15.153:0/4087730371 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8ec0656d0 0x7fe8ec154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 >> 172.21.15.153:0/4087730371 conn(0x7fe8ec0c7150 msgr2=0x7fe8ec1532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:42.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 shutdown_connections 2023-08-17T00:16:42.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.523+0000 7fe8f385b700 1 -- 172.21.15.153:0/4087730371 wait complete. 2023-08-17T00:16:42.532 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:16:42.548 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:42.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.695+0000 7fa9e6079700 1 Processor -- start 2023-08-17T00:16:42.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e6079700 1 -- start start 2023-08-17T00:16:42.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e6079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e00689c0 0x7fa9e0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e6079700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e0065da0 con 0x7fa9e01560f0 2023-08-17T00:16:42.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e6079700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e0155c60 con 0x7fa9e0151530 2023-08-17T00:16:42.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e6079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0156550 con 0x7fa9e00689c0 2023-08-17T00:16:42.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e4876700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa9e01560f0 0x7fa9e00c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45380/0 (socket says 172.21.15.153:45380) 2023-08-17T00:16:42.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e4876700 1 -- 172.21.15.153:0/591186858 learned_addr learned my addr 172.21.15.153:0/591186858 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:42.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e5077700 1 --2- 172.21.15.153:0/591186858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e00689c0 0x7fa9e0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010025532 0 0) 0x7fa9e0065da0 con 0x7fa9e01560f0 2023-08-17T00:16:42.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9cc0033f0 con 0x7fa9e01560f0 2023-08-17T00:16:42.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031309536 0 0) 0x7fa9e0155c60 con 0x7fa9e0151530 2023-08-17T00:16:42.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e0065da0 con 0x7fa9e0151530 2023-08-17T00:16:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e5077700 1 -- 172.21.15.153:0/591186858 >> v1:172.21.15.178:6789/0 conn(0x7fa9e0151530 legacy=0x7fa9e01519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e5077700 1 -- 172.21.15.153:0/591186858 >> v1:172.21.15.153:6789/0 conn(0x7fa9e01560f0 legacy=0x7fa9e00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754711624 0 0) 0x7fa9cc0033f0 con 0x7fa9e01560f0 2023-08-17T00:16:42.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.699+0000 7fa9e5077700 1 -- 172.21.15.153:0/591186858 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0065ff0 con 0x7fa9e00689c0 2023-08-17T00:16:42.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e5077700 1 --2- 172.21.15.153:0/591186858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e00689c0 0x7fa9e0068da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fa9dc009790 tx=0x7fa9dc006f40).ready entity=mon.2 client_cookie=1fef19f79567cc19 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:42.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0001470 con 0x7fa9e00689c0 2023-08-17T00:16:42.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9dc005880 con 0x7fa9e00689c0 2023-08-17T00:16:42.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9d7fff700 1 -- 172.21.15.153:0/591186858 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc005c00 con 0x7fa9e00689c0 2023-08-17T00:16:42.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 -- 172.21.15.153:0/591186858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e00689c0 msgr2=0x7fa9e0068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 --2- 172.21.15.153:0/591186858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e00689c0 0x7fa9e0068da0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fa9dc009790 tx=0x7fa9dc006f40).stop 2023-08-17T00:16:42.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 -- 172.21.15.153:0/591186858 shutdown_connections 2023-08-17T00:16:42.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 --2- 172.21.15.153:0/591186858 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e00689c0 0x7fa9e0068da0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 -- 172.21.15.153:0/591186858 >> 172.21.15.153:0/591186858 conn(0x7fa9e00c6620 msgr2=0x7fa9e00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:42.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 -- 172.21.15.153:0/591186858 shutdown_connections 2023-08-17T00:16:42.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.703+0000 7fa9e6079700 1 -- 172.21.15.153:0/591186858 wait complete. 2023-08-17T00:16:42.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 Processor -- start 2023-08-17T00:16:42.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 -- start start 2023-08-17T00:16:42.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9e00689c0 0x7fa9e00a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e0151530 0x7fa9e00bc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 0x7fa9e0166aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e0166610 con 0x7fa9e01560f0 2023-08-17T00:16:42.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00a4da0 con 0x7fa9e00689c0 2023-08-17T00:16:42.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e6079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e00a7c90 con 0x7fa9e0151530 2023-08-17T00:16:42.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 0x7fa9e0166aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 0x7fa9e0166aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39290/0 (socket says 172.21.15.153:39290) 2023-08-17T00:16:42.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 -- 172.21.15.153:0/2206157419 learned_addr learned my addr 172.21.15.153:0/2206157419 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:42.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5077700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9e00689c0 0x7fa9e00a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e4876700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e0151530 0x7fa9e00bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 -- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e0151530 msgr2=0x7fa9e00bc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e0151530 0x7fa9e00bc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 -- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9e00689c0 msgr2=0x7fa9e00a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9e00689c0 0x7fa9e00a48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 -- 172.21.15.153:0/2206157419 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc009250 con 0x7fa9e01560f0 2023-08-17T00:16:42.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5077700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9e00689c0 0x7fa9e00a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:42.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.707+0000 7fa9e5878700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 0x7fa9e0166aa0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7fa9d800c7c0 tx=0x7fa9d800cb80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:42.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8002240 con 0x7fa9e01560f0 2023-08-17T00:16:42.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80023a0 con 0x7fa9e01560f0 2023-08-17T00:16:42.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e0165a00 con 0x7fa9e01560f0 2023-08-17T00:16:42.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d80017e0 con 0x7fa9e01560f0 2023-08-17T00:16:42.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e0165fc0 con 0x7fa9e01560f0 2023-08-17T00:16:42.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e01667c0 con 0x7fa9e01560f0 2023-08-17T00:16:42.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.711+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa9d8019030 con 0x7fa9e01560f0 2023-08-17T00:16:42.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.715+0000 7fa9d57fa700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa9c405a150 0x7fa9c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:42.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.715+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fa9d8073750 con 0x7fa9e01560f0 2023-08-17T00:16:42.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.715+0000 7fa9e5077700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa9c405a150 0x7fa9c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:42.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.715+0000 7fa9e5077700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa9c405a150 0x7fa9c405c610 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fa9dc005fd0 tx=0x7fa9dc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:42.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.719+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa9e01667c0 con 0x7fa9e01560f0 2023-08-17T00:16:42.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.915+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9e006b4c0 con 0x7fa9e01560f0 2023-08-17T00:16:42.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.915+0000 7fa9d57fa700 1 -- 172.21.15.153:0/2206157419 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fa9d8047160 con 0x7fa9e01560f0 2023-08-17T00:16:42.924 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:42.924 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":137,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:16:37.314463+0000","modified":"2023-08-17T00:16:40.409153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"a","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/935397889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":935397889},{"type":"v1","addr":"172.21.15.153:6835","nonce":935397889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-08-17T00:16:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa9c405a150 msgr2=0x7fa9c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa9c405a150 0x7fa9c405c610 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7fa9dc005fd0 tx=0x7fa9dc015000).stop 2023-08-17T00:16:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 msgr2=0x7fa9e0166aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:42.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 0x7fa9e0166aa0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 rx=0x7fa9d800c7c0 tx=0x7fa9d800cb80).stop 2023-08-17T00:16:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 shutdown_connections 2023-08-17T00:16:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa9c405a150 0x7fa9c405c610 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa9e01560f0 0x7fa9e0166aa0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9e0151530 0x7fa9e00bc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 --2- 172.21.15.153:0/2206157419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9e00689c0 0x7fa9e00a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 >> 172.21.15.153:0/2206157419 conn(0x7fa9e00c6620 msgr2=0x7fa9e00bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:42.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 shutdown_connections 2023-08-17T00:16:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:42.919+0000 7fa9e6079700 1 -- 172.21.15.153:0/2206157419 wait complete. 2023-08-17T00:16:42.930 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 137 2023-08-17T00:16:43.348 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 137, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:16:37.314463+0000', 'modified': '2023-08-17T00:16:40.409153+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9789}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9789': {'gid': 9789, 'name': 'a', 'rank': 0, 'incarnation': 134, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/935397889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 935397889}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 935397889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:16:43.349 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:16:43.349 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-17T00:16:43.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.511+0000 7f0336a1b700 1 Processor -- start 2023-08-17T00:16:43.519 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.511+0000 7f0336a1b700 1 -- start start 2023-08-17T00:16:43.522 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f0336a1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f0330153e90 0x7f03300c7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f0336a1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03300c7980 0x7f03300ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f0336a1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03300aa750 con 0x7f0330153ab0 2023-08-17T00:16:43.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f0336a1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03300c9dd0 con 0x7f0330153e90 2023-08-17T00:16:43.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f0336a1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03300aacf0 con 0x7f03300c7980 2023-08-17T00:16:43.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f0330153ab0 0x7f03300c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45386/0 (socket says 172.21.15.153:45386) 2023-08-17T00:16:43.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032ffff700 1 -- 172.21.15.153:0/1110686981 learned_addr learned my addr 172.21.15.153:0/1110686981 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032f7fe700 1 --2- 172.21.15.153:0/1110686981 >> v2:172.21.15.153:3300/0 conn(0x7f0330153e90 0x7f03300c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f0334fb8700 1 --2- 172.21.15.153:0/1110686981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03300c7980 0x7f03300ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032effd700 1 -- 172.21.15.153:0/1110686981 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767491961 0 0) 0x7f03300aa750 con 0x7f0330153ab0 2023-08-17T00:16:43.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032effd700 1 -- 172.21.15.153:0/1110686981 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03180033f0 con 0x7f0330153ab0 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032f7fe700 1 -- 172.21.15.153:0/1110686981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03300c7980 msgr2=0x7f03300ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032f7fe700 1 --2- 172.21.15.153:0/1110686981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03300c7980 0x7f03300ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032f7fe700 1 -- 172.21.15.153:0/1110686981 >> v1:172.21.15.153:6789/0 conn(0x7f0330153ab0 legacy=0x7f03300c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032f7fe700 1 -- 172.21.15.153:0/1110686981 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03301542f0 con 0x7f0330153e90 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032f7fe700 1 --2- 172.21.15.153:0/1110686981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0330153e90 0x7f03300c7490 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f0324009760 tx=0x7f0324009060).ready entity=mon.0 client_cookie=51d3f10f9b9ff783 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.515+0000 7f032effd700 1 -- 172.21.15.153:0/1110686981 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03240090d0 con 0x7f0330153e90 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f032effd700 1 -- 172.21.15.153:0/1110686981 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032400d4a0 con 0x7f0330153e90 2023-08-17T00:16:43.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f032effd700 1 -- 172.21.15.153:0/1110686981 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032400d820 con 0x7f0330153e90 2023-08-17T00:16:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 -- 172.21.15.153:0/1110686981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0330153e90 msgr2=0x7f03300c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 --2- 172.21.15.153:0/1110686981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0330153e90 0x7f03300c7490 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 rx=0x7f0324009760 tx=0x7f0324009060).stop 2023-08-17T00:16:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 -- 172.21.15.153:0/1110686981 shutdown_connections 2023-08-17T00:16:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 --2- 172.21.15.153:0/1110686981 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03300c7980 0x7f03300ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 --2- 172.21.15.153:0/1110686981 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f0330153e90 0x7f03300c7490 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 -- 172.21.15.153:0/1110686981 >> 172.21.15.153:0/1110686981 conn(0x7f0330061fa0 msgr2=0x7f03300623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 -- 172.21.15.153:0/1110686981 shutdown_connections 2023-08-17T00:16:43.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 -- 172.21.15.153:0/1110686981 wait complete. 2023-08-17T00:16:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 Processor -- start 2023-08-17T00:16:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.519+0000 7f0336a1b700 1 -- start start 2023-08-17T00:16:43.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 0x7f03300b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0330153ab0 0x7f0330063730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0330153e90 0x7f033014def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03301685a0 con 0x7f03300c7980 2023-08-17T00:16:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330167a20 con 0x7f0330153ab0 2023-08-17T00:16:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0330167d00 con 0x7f0330153e90 2023-08-17T00:16:43.531 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 0x7f03300b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 0x7f03300b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39302/0 (socket says 172.21.15.153:39302) 2023-08-17T00:16:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 -- 172.21.15.153:0/3345477249 learned_addr learned my addr 172.21.15.153:0/3345477249 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0330153ab0 0x7f0330063730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0334fb8700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0330153e90 0x7f033014def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.532 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 -- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0330153e90 msgr2=0x7f033014def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0330153e90 0x7f033014def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 -- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0330153ab0 msgr2=0x7f0330063730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0330153ab0 0x7f0330063730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 -- 172.21.15.153:0/3345477249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03240092a0 con 0x7f03300c7980 2023-08-17T00:16:43.533 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f032ffff700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 0x7f03300b0230 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f032800c770 tx=0x7f03280015d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0317fff700 1 -- 172.21.15.153:0/3345477249 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328005d30 con 0x7f03300c7980 2023-08-17T00:16:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0317fff700 1 -- 172.21.15.153:0/3345477249 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328005e90 con 0x7f03300c7980 2023-08-17T00:16:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0317fff700 1 -- 172.21.15.153:0/3345477249 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328007340 con 0x7f03300c7980 2023-08-17T00:16:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0330167fe0 con 0x7f03300c7980 2023-08-17T00:16:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.523+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0330167680 con 0x7f03300c7980 2023-08-17T00:16:43.534 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.527+0000 7f0317fff700 1 -- 172.21.15.153:0/3345477249 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f0328010030 con 0x7f03300c7980 2023-08-17T00:16:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.527+0000 7f0317fff700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f031c05a150 0x7f031c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.527+0000 7f0317fff700 1 -- 172.21.15.153:0/3345477249 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f03280741a0 con 0x7f03300c7980 2023-08-17T00:16:43.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.527+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f031c05a150 0x7f031c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.527+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f031c05a150 0x7f031c05c610 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f032400d260 tx=0x7f0324016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 Processor -- start 2023-08-17T00:16:43.537 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 -- start start 2023-08-17T00:16:43.538 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x290edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28cd7f0 0x2910e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x28ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28385c0 con 0x290ea10 2023-08-17T00:16:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x284de90 con 0x28cd7f0 2023-08-17T00:16:43.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2814220 con 0x29112f0 2023-08-17T00:16:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x290edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x290edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39310/0 (socket says 172.21.15.153:39310) 2023-08-17T00:16:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 -- 172.21.15.153:0/69057341 learned_addr learned my addr 172.21.15.153:0/69057341 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:43.540 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032f7fe700 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28cd7f0 0x2910e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0334fb8700 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x28ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 -- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 msgr2=0x28ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x28ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 -- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28cd7f0 msgr2=0x2910e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28cd7f0 0x2910e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 -- 172.21.15.153:0/69057341 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2859500 con 0x290ea10 2023-08-17T00:16:43.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032f7fe700 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28cd7f0 0x2910e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:43.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f032ffff700 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x290edf0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7f032804b4f0 tx=0x7f032800f000).ready entity=mon.0 client_cookie=5c79968ff3329b14 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0315ffb700 1 -- 172.21.15.153:0/69057341 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328049a50 con 0x290ea10 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0315ffb700 1 -- 172.21.15.153:0/69057341 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328049be0 con 0x290ea10 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.531+0000 7f0315ffb700 1 -- 172.21.15.153:0/69057341 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328047f50 con 0x290ea10 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 -- 172.21.15.153:0/69057341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 msgr2=0x290edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x290edf0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 rx=0x7f032804b4f0 tx=0x7f032800f000).stop 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 -- 172.21.15.153:0/69057341 shutdown_connections 2023-08-17T00:16:43.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x28ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x28cd7f0 0x2910e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 --2- 172.21.15.153:0/69057341 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x290edf0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 -- 172.21.15.153:0/69057341 >> 172.21.15.153:0/69057341 conn(0x26ac550 msgr2=0x28cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 -- 172.21.15.153:0/69057341 shutdown_connections 2023-08-17T00:16:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 -- 172.21.15.153:0/69057341 wait complete. 2023-08-17T00:16:43.544 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 -- start start 2023-08-17T00:16:43.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.535+0000 7f0340daf740 1 Processor -- start 2023-08-17T00:16:43.545 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 0x28f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x28f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x290d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2819110 con 0x28cd7f0 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2913900 con 0x290ea10 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28f4110 con 0x29112f0 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 10 client.0 ll_register_callbacks cb 0x28853c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:43.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 0x28f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 0x28f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39320/0 (socket says 172.21.15.153:39320) 2023-08-17T00:16:43.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 -- 172.21.15.153:0/3951765184 learned_addr learned my addr 172.21.15.153:0/3951765184 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x28f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0334fb8700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x290d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 -- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 msgr2=0x290d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x290d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 -- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 msgr2=0x28f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x28f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 -- 172.21.15.153:0/3951765184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0330167680 con 0x28cd7f0 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032ffff700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 0x28f2c50 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f032804b4f0 tx=0x7f0328055000).ready entity=mon.0 client_cookie=dce182bbbf197167 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 1 -- 172.21.15.153:0/3951765184 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032805d070 con 0x28cd7f0 2023-08-17T00:16:43.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 1 -- 172.21.15.153:0/3951765184 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f032804ad30 con 0x28cd7f0 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2843c60 con 0x28cd7f0 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 1 -- 172.21.15.153:0/3951765184 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0328047630 con 0x28cd7f0 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 10 client.9942 fetch_fsmap learned FSMap version 137 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) v3 -- 0x2846f80 con 0x28cd7f0 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 1 -- 172.21.15.153:0/3951765184 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2843c60 con 0x28cd7f0 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 1 -- 172.21.15.153:0/3951765184 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 137) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0328047790 con 0x28cd7f0 2023-08-17T00:16:43.550 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 10 client.9942 fetch_fsmap finished waiting for FSMap version 137 2023-08-17T00:16:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 10 client.9942 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:16:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 20 client.9942 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28f6140 0x292d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 4 client.9942 mds_command: new command op to 9789 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:16:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 --> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x283a1b0 con 0x28f6140 2023-08-17T00:16:43.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28f6140 0x292d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28f6140 0x292d0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=c4e5cde082cabeda server_cookie=6f848e3a911ac70b in_seq=0 out_seq=0 2023-08-17T00:16:43.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.539+0000 7f030e7fc700 10 client.9942 ms_handle_connect on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f030e7fc700 1 -- 172.21.15.153:0/3951765184 <== mds.0 v2:172.21.15.153:6833/935397889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x283a1b0 con 0x28f6140 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f030e7fc700 10 client.9942 handle_command_reply: tid=0 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 client.9942 shutdown 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 msgr2=0x28f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 0x28f2c50 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 rx=0x7f032804b4f0 tx=0x7f0328055000).stop 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 shutdown_connections 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28f6140 0x292d0d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29112f0 0x290d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x28f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f030e7fc700 0 client.9942 ms_handle_reset on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 --2- 172.21.15.153:0/3951765184 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x28cd7f0 0x28f2c50 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 >> 172.21.15.153:0/3951765184 conn(0x26ac550 msgr2=0x28cc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 shutdown_connections 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 1 -- 172.21.15.153:0/3951765184 wait complete. 2023-08-17T00:16:43.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.543+0000 7f0340daf740 20 client.9942 trim_cache size 0 max 16384 2023-08-17T00:16:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 Processor -- start 2023-08-17T00:16:43.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 -- start start 2023-08-17T00:16:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x28f9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x290a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 0x28c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x29150e0 con 0x29112f0 2023-08-17T00:16:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x290ff20 con 0x290ea10 2023-08-17T00:16:43.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2890db0 con 0x28cd7f0 2023-08-17T00:16:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 0x28c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 0x28c7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39336/0 (socket says 172.21.15.153:39336) 2023-08-17T00:16:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 -- 172.21.15.153:0/12347207 learned_addr learned my addr 172.21.15.153:0/12347207 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f032f7fe700 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x290a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f032ffff700 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x28f9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 -- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 msgr2=0x28f9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x28f9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 -- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 msgr2=0x290a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x290a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 -- 172.21.15.153:0/12347207 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033014e740 con 0x29112f0 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f032ffff700 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x28f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:43.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f0334fb8700 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 0x28c7870 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f0320009ba0 tx=0x7f0320008040).ready entity=mon.0 client_cookie=c57eaae068115fd1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f03167fc700 1 -- 172.21.15.153:0/12347207 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320009630 con 0x29112f0 2023-08-17T00:16:43.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f03167fc700 1 -- 172.21.15.153:0/12347207 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320016910 con 0x29112f0 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.563+0000 7f03167fc700 1 -- 172.21.15.153:0/12347207 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320016cb0 con 0x29112f0 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 -- 172.21.15.153:0/12347207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 msgr2=0x28c7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 0x28c7870 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 rx=0x7f0320009ba0 tx=0x7f0320008040).stop 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 -- 172.21.15.153:0/12347207 shutdown_connections 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29112f0 0x28c7870 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x290ea10 0x290a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 --2- 172.21.15.153:0/12347207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x28f9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 -- 172.21.15.153:0/12347207 >> 172.21.15.153:0/12347207 conn(0x26ac550 msgr2=0x290d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 -- 172.21.15.153:0/12347207 shutdown_connections 2023-08-17T00:16:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 -- 172.21.15.153:0/12347207 wait complete. 2023-08-17T00:16:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 -- start start 2023-08-17T00:16:43.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.567+0000 7f0340daf740 1 Processor -- start 2023-08-17T00:16:43.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x296bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x28f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29112f0 0x28f3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f3630 con 0x290ea10 2023-08-17T00:16:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x28f03c0 con 0x29112f0 2023-08-17T00:16:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x28c8dc0 con 0x28cd7f0 2023-08-17T00:16:43.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 10 client.0 ll_register_callbacks cb 0x7f0328072720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x28f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x28f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39350/0 (socket says 172.21.15.153:39350) 2023-08-17T00:16:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 -- 172.21.15.153:0/3747292964 learned_addr learned my addr 172.21.15.153:0/3747292964 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032ffff700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x296bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0334fb8700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29112f0 0x28f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 -- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 msgr2=0x296bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x296bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 -- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29112f0 msgr2=0x28f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29112f0 0x28f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 -- 172.21.15.153:0/3747292964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0320009870 con 0x290ea10 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f032f7fe700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x28f2c50 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f0324010000 tx=0x7f0324014000).ready entity=mon.0 client_cookie=d23b68412b89d49 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f030e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f030e7fc700 1 -- 172.21.15.153:0/3747292964 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0324029450 con 0x290ea10 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0328049be0 con 0x290ea10 2023-08-17T00:16:43.581 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f030e7fc700 1 -- 172.21.15.153:0/3747292964 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f0324022040 con 0x290ea10 2023-08-17T00:16:43.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f030e7fc700 1 -- 172.21.15.153:0/3747292964 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0324011610 con 0x290ea10 2023-08-17T00:16:43.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 10 client.9948 fetch_fsmap learned FSMap version 137 2023-08-17T00:16:43.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) v3 -- 0x2842420 con 0x290ea10 2023-08-17T00:16:43.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f030e7fc700 1 -- 172.21.15.153:0/3747292964 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328049be0 con 0x290ea10 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f030e7fc700 1 -- 172.21.15.153:0/3747292964 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 137) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0324011770 con 0x290ea10 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 10 client.9948 fetch_fsmap finished waiting for FSMap version 137 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 10 client.9948 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 20 client.9948 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28ef4f0 0x28ef8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 4 client.9948 mds_command: new command op to 9789 tid=0[{"prefix": "status"}] 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.571+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 --> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] -- command(tid 0: {"prefix": "status"}) v1 -- 0x27034e0 con 0x28ef4f0 2023-08-17T00:16:43.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f032ffff700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28ef4f0 0x28ef8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f030e7fc700 10 client.9948 ms_handle_connect on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f032ffff700 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28ef4f0 0x28ef8d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b669a9784c466ea2 server_cookie=38cbfe7c4e32030c in_seq=0 out_seq=0 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f030e7fc700 1 -- 172.21.15.153:0/3747292964 <== mds.0 v2:172.21.15.153:6833/935397889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x27034e0 con 0x28ef4f0 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f030e7fc700 10 client.9948 handle_command_reply: tid=0 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 client.9948 shutdown 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 msgr2=0x28f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x28f2c50 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 rx=0x7f0324010000 tx=0x7f0324014000).stop 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 shutdown_connections 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x28ef4f0 0x28ef8d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29112f0 0x28f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x290ea10 0x28f2c50 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 --2- 172.21.15.153:0/3747292964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x28cd7f0 0x296bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f030e7fc700 0 client.9948 ms_handle_reset on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 >> 172.21.15.153:0/3747292964 conn(0x26ac550 msgr2=0x28f6750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 shutdown_connections 2023-08-17T00:16:43.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 1 -- 172.21.15.153:0/3747292964 wait complete. 2023-08-17T00:16:43.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0340daf740 20 client.9948 trim_cache size 0 max 16384 2023-08-17T00:16:43.587 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:16:43.587 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:16:43.587 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 9789, 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 6.2599962790000001, 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 137, 2023-08-17T00:16:43.588 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 180, 2023-08-17T00:16:43.589 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 178, 2023-08-17T00:16:43.589 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 11.768980928 2023-08-17T00:16:43.589 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:16:43.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f031c05a150 msgr2=0x7f031c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f031c05a150 0x7f031c05c610 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 rx=0x7f032400d260 tx=0x7f0324016000).stop 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 msgr2=0x7f03300b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 0x7f03300b0230 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 rx=0x7f032800c770 tx=0x7f03280015d0).stop 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 shutdown_connections 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f031c05a150 0x7f031c05c610 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0330153e90 0x7f033014def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0330153ab0 0x7f0330063730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 --2- 172.21.15.153:0/3345477249 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f03300c7980 0x7f03300b0230 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 >> 172.21.15.153:0/3345477249 conn(0x7f0330061fa0 msgr2=0x7f03300c11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 shutdown_connections 2023-08-17T00:16:43.591 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.575+0000 7f0336a1b700 1 -- 172.21.15.153:0/3345477249 wait complete. 2023-08-17T00:16:43.605 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:16:43.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 Processor -- start 2023-08-17T00:16:43.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 -- start start 2023-08-17T00:16:43.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4694153c70 0x7f46940a6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f46940c3250 0x7f4694067820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4694068570 con 0x7f46940a7290 2023-08-17T00:16:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940c86a0 con 0x7f4694153c70 2023-08-17T00:16:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f469989b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4694095610 con 0x7f46940c3250 2023-08-17T00:16:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f46927fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f46940a7290 0x7f4694062bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45402/0 (socket says 172.21.15.153:45402) 2023-08-17T00:16:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f46927fc700 1 -- 172.21.15.153:0/843752007 learned_addr learned my addr 172.21.15.153:0/843752007 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:43.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f4692ffd700 1 --2- 172.21.15.153:0/843752007 >> v2:172.21.15.153:3300/0 conn(0x7f4694153c70 0x7f46940a6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403886353 0 0) 0x7f4694068570 con 0x7f46940a7290 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f4693fff700 1 --2- 172.21.15.153:0/843752007 >> v2:172.21.15.178:3300/0 conn(0x7f46940c3250 0x7f4694067820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.731+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c0033f0 con 0x7f46940a7290 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 694239076 0 0) 0x7f467c0033f0 con 0x7f46940a7290 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 >> v2:172.21.15.178:3300/0 conn(0x7f46940c3250 msgr2=0x7f4694067820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 --2- 172.21.15.153:0/843752007 >> v2:172.21.15.178:3300/0 conn(0x7f46940c3250 0x7f4694067820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 >> v2:172.21.15.153:3300/0 conn(0x7f4694153c70 msgr2=0x7f46940a6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 --2- 172.21.15.153:0/843752007 >> v2:172.21.15.153:3300/0 conn(0x7f4694153c70 0x7f46940a6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940958f0 con 0x7f46940a7290 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f4688001470 con 0x7f46940a7290 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 >> v1:172.21.15.153:6789/0 conn(0x7f46940a7290 legacy=0x7f4694062bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0038e0 0x7f467c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004690 0x7f467c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c005000 0x7f467c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940c86a0 con 0x7f467c005000 2023-08-17T00:16:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694095610 con 0x7f467c004690 2023-08-17T00:16:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00be50 con 0x7f467c0038e0 2023-08-17T00:16:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004690 0x7f467c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4692ffd700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0038e0 0x7f467c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4693fff700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c005000 0x7f467c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 -- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0038e0 msgr2=0x7f467c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0038e0 0x7f467c003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 -- 172.21.15.153:0/843752007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c005000 msgr2=0x7f467c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c005000 0x7f467c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 -- 172.21.15.153:0/843752007 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0033f0 con 0x7f467c004690 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4693fff700 1 -- 172.21.15.153:0/843752007 reap_dead start 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f46927fc700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004690 0x7f467c004b10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f468800c1e0 tx=0x7f4688001e90).ready entity=mon.1 client_cookie=291ec1fea029fc8b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688007a60 con 0x7f467c004690 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800cab0 con 0x7f467c004690 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.735+0000 7f4691ffb700 1 -- 172.21.15.153:0/843752007 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800ce50 con 0x7f467c004690 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 -- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004690 msgr2=0x7f467c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004690 0x7f467c004b10 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f468800c1e0 tx=0x7f4688001e90).stop 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 -- 172.21.15.153:0/843752007 shutdown_connections 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 --2- 172.21.15.153:0/843752007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004690 0x7f467c004b10 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 -- 172.21.15.153:0/843752007 >> 172.21.15.153:0/843752007 conn(0x7f46940698d0 msgr2=0x7f46940c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 -- 172.21.15.153:0/843752007 shutdown_connections 2023-08-17T00:16:43.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 -- 172.21.15.153:0/843752007 wait complete. 2023-08-17T00:16:43.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 Processor -- start 2023-08-17T00:16:43.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.739+0000 7f469989b700 1 -- start start 2023-08-17T00:16:43.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 0x7f46940ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46940aabf0 0x7f46940ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4694164990 0x7f4694164e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469414f4d0 con 0x7f467c004690 2023-08-17T00:16:43.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940ab560 con 0x7f4694164990 2023-08-17T00:16:43.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940acb50 con 0x7f46940aabf0 2023-08-17T00:16:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 0x7f46940ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 0x7f46940ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:39384/0 (socket says 172.21.15.153:39384) 2023-08-17T00:16:43.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 -- 172.21.15.153:0/695600714 learned_addr learned my addr 172.21.15.153:0/695600714 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:43.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4693fff700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4694164990 0x7f4694164e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f46927fc700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46940aabf0 0x7f46940ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 -- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46940aabf0 msgr2=0x7f46940ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46940aabf0 0x7f46940ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 -- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4694164990 msgr2=0x7f4694164e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4694164990 0x7f4694164e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 -- 172.21.15.153:0/695600714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940ace30 con 0x7f467c004690 2023-08-17T00:16:43.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4693fff700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4694164990 0x7f4694164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f4692ffd700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 0x7f46940ac590 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f46840119d0 tx=0x7f4684009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468400f940 con 0x7f467c004690 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468400faa0 con 0x7f467c004690 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940ad110 con 0x7f467c004690 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468400fe20 con 0x7f467c004690 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.743+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4694165300 con 0x7f467c004690 2023-08-17T00:16:43.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.747+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46940a7720 con 0x7f467c004690 2023-08-17T00:16:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.747+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4684024070 con 0x7f467c004690 2023-08-17T00:16:43.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.747+0000 7f467affd700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:43.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.747+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f4684074c40 con 0x7f467c004690 2023-08-17T00:16:43.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.751+0000 7f46927fc700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:43.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.751+0000 7f46927fc700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f4688001ed0 tx=0x7f4688015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:43.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.755+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46840485a0 con 0x7f467c004690 2023-08-17T00:16:43.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.951+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f46941655b0 con 0x7f467c004690 2023-08-17T00:16:43.960 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.951+0000 7f467affd700 1 -- 172.21.15.153:0/695600714 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v137) v1 ==== 53+0+73 (secure 0 0 0) 0x7f468404bbc0 con 0x7f467c004690 2023-08-17T00:16:43.960 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:16:43.962 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 msgr2=0x7f468005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f4688001ed0 tx=0x7f4688015000).stop 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 msgr2=0x7f46940ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 0x7f46940ac590 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 rx=0x7f46840119d0 tx=0x7f4684009060).stop 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 shutdown_connections 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468005a150 0x7f468005c610 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4694164990 0x7f4694164e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46940aabf0 0x7f46940ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 --2- 172.21.15.153:0/695600714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f467c004690 0x7f46940ac590 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 >> 172.21.15.153:0/695600714 conn(0x7f46940698d0 msgr2=0x7f4694067c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 shutdown_connections 2023-08-17T00:16:43.964 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:43.955+0000 7f469989b700 1 -- 172.21.15.153:0/695600714 wait complete. 2023-08-17T00:16:43.981 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:16:43.981 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:16:43.982 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:16:43.982 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:16:43.982 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:16:43.983 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:16:43.983 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:16:43.983 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:16:43.983 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:16:43.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:43.984 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:16:44.003 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:16:44.004 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:16:44.005 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41609sec preferred_lft 41609sec 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:16:44.006 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.007 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:16:44.008 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:16:44.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.010 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:16:44.089 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:16:44.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.092 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:16:44.152 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:16:44.153 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:16:44.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.154 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:16:44.154 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:16:44.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:16:44.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:16:44.155 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:16:44.156 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:16:44.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.291 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:16:44.307 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:16:44.307 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:16:44.308 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:16:44.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.309 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:16:44.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.384 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:16:44.443 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:16:44.444 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:16:44.561 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:16:44.561 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:16:44.580 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:16:44.581 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:16:44.588 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:16:44.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:44.589 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:16:44.621 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits daemon-helper kill python3 -c ' 2023-08-17T00:16:44.622 DEBUG:teuthology.orchestra.run.smithi153:> import os 2023-08-17T00:16:44.622 DEBUG:teuthology.orchestra.run.smithi153:> import uuid 2023-08-17T00:16:44.622 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:16:44.623 DEBUG:teuthology.orchestra.run.smithi153:> n = 1000 2023-08-17T00:16:44.623 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = False 2023-08-17T00:16:44.623 DEBUG:teuthology.orchestra.run.smithi153:> if 0 > 0: 2023-08-17T00:16:44.623 DEBUG:teuthology.orchestra.run.smithi153:> create_hard_links = True 2023-08-17T00:16:44.624 DEBUG:teuthology.orchestra.run.smithi153:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2023-08-17T00:16:44.624 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:16:44.624 DEBUG:teuthology.orchestra.run.smithi153:> dpath = os.path.dirname(path) 2023-08-17T00:16:44.625 DEBUG:teuthology.orchestra.run.smithi153:> fnameprefix = os.path.basename(path) 2023-08-17T00:16:44.625 DEBUG:teuthology.orchestra.run.smithi153:> os.makedirs(dpath, exist_ok=True) 2023-08-17T00:16:44.625 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:16:44.626 DEBUG:teuthology.orchestra.run.smithi153:> try: 2023-08-17T00:16:44.626 DEBUG:teuthology.orchestra.run.smithi153:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-08-17T00:16:44.626 DEBUG:teuthology.orchestra.run.smithi153:> 2023-08-17T00:16:44.626 DEBUG:teuthology.orchestra.run.smithi153:> for i in range(n): 2023-08-17T00:16:44.627 DEBUG:teuthology.orchestra.run.smithi153:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-08-17T00:16:44.627 DEBUG:teuthology.orchestra.run.smithi153:> with open(fpath, '"'"'w'"'"') as f: 2023-08-17T00:16:44.627 DEBUG:teuthology.orchestra.run.smithi153:> f.write(f"{i}") 2023-08-17T00:16:44.627 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:16:44.628 DEBUG:teuthology.orchestra.run.smithi153:> f.flush() 2023-08-17T00:16:44.628 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(f.fileno()) 2023-08-17T00:16:44.628 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:16:44.629 DEBUG:teuthology.orchestra.run.smithi153:> os.unlink(fpath) 2023-08-17T00:16:44.629 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:16:44.629 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2023-08-17T00:16:44.630 DEBUG:teuthology.orchestra.run.smithi153:> if create_hard_links: 2023-08-17T00:16:44.630 DEBUG:teuthology.orchestra.run.smithi153:> for j in range(0): 2023-08-17T00:16:44.630 DEBUG:teuthology.orchestra.run.smithi153:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-08-17T00:16:44.631 DEBUG:teuthology.orchestra.run.smithi153:> if False: 2023-08-17T00:16:44.631 DEBUG:teuthology.orchestra.run.smithi153:> os.fsync(dirfd) 2023-08-17T00:16:44.631 DEBUG:teuthology.orchestra.run.smithi153:> finally: 2023-08-17T00:16:44.632 DEBUG:teuthology.orchestra.run.smithi153:> os.close(dirfd) 2023-08-17T00:16:44.632 DEBUG:teuthology.orchestra.run.smithi153:> ' 2023-08-17T00:16:45.553 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.12:0 scrub status 2023-08-17T00:16:45.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.751+0000 7f5c3f61b700 1 Processor -- start 2023-08-17T00:16:45.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.751+0000 7f5c3f61b700 1 -- start start 2023-08-17T00:16:45.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3f61b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c38151b90 0x7f5c38151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3f61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c38065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3f61b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c38065b50 0x7f5c38064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3f61b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c380c3fb0 con 0x7f5c38065b50 2023-08-17T00:16:45.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3f61b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c38152460 con 0x7f5c38151b90 2023-08-17T00:16:45.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3f61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38061fa0 con 0x7f5c38063290 2023-08-17T00:16:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c38065b50 0x7f5c38064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5c38065b50 0x7f5c38064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33272/0 (socket says 172.21.15.153:33272) 2023-08-17T00:16:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/1034602384 learned_addr learned my addr 172.21.15.153:0/1034602384 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/1034602384 >> v2:172.21.15.178:3300/0 conn(0x7f5c38151b90 0x7f5c38151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/1034602384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c38065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/1034602384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 msgr2=0x7f5c38065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/1034602384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c38065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/1034602384 >> v2:172.21.15.178:3300/0 conn(0x7f5c38151b90 msgr2=0x7f5c38151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/1034602384 >> v2:172.21.15.178:3300/0 conn(0x7f5c38151b90 0x7f5c38151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/1034602384 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380621f0 con 0x7f5c38065b50 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/1034602384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38065b50 0x7f5c38064870 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f5c380682a0 tx=0x7f5c30009840).ready entity=mon.0 client_cookie=fd3e2e5b05b5cd34 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c2ffff700 1 -- 172.21.15.153:0/1034602384 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000e070 con 0x7f5c38065b50 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c2ffff700 1 -- 172.21.15.153:0/1034602384 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3000b970 con 0x7f5c38065b50 2023-08-17T00:16:45.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.755+0000 7f5c2ffff700 1 -- 172.21.15.153:0/1034602384 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000bcf0 con 0x7f5c38065b50 2023-08-17T00:16:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 -- 172.21.15.153:0/1034602384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38065b50 msgr2=0x7f5c38064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/1034602384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38065b50 0x7f5c38064870 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 rx=0x7f5c380682a0 tx=0x7f5c30009840).stop 2023-08-17T00:16:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 -- 172.21.15.153:0/1034602384 shutdown_connections 2023-08-17T00:16:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/1034602384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c38065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/1034602384 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38065b50 0x7f5c38064870 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/1034602384 >> v2:172.21.15.178:3300/0 conn(0x7f5c38151b90 0x7f5c38151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 -- 172.21.15.153:0/1034602384 >> 172.21.15.153:0/1034602384 conn(0x7f5c380c7150 msgr2=0x7f5c380c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:45.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 -- 172.21.15.153:0/1034602384 shutdown_connections 2023-08-17T00:16:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 -- 172.21.15.153:0/1034602384 wait complete. 2023-08-17T00:16:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 Processor -- start 2023-08-17T00:16:45.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.759+0000 7f5c3f61b700 1 -- start start 2023-08-17T00:16:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c381682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c38065b50 0x7f5c381525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 0x7f5c3813ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c380ab5d0 con 0x7f5c38151b90 2023-08-17T00:16:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c380aba60 con 0x7f5c38065b50 2023-08-17T00:16:45.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c38152a90 con 0x7f5c38063290 2023-08-17T00:16:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 0x7f5c3813ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 0x7f5c3813ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33274/0 (socket says 172.21.15.153:33274) 2023-08-17T00:16:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/274008145 learned_addr learned my addr 172.21.15.153:0/274008145 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c38065b50 0x7f5c381525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c381682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 msgr2=0x7f5c381682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c381682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c38065b50 msgr2=0x7f5c381525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c38065b50 0x7f5c381525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/274008145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30009ae0 con 0x7f5c38151b90 2023-08-17T00:16:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 0x7f5c3813ee30 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f5c3000b610 tx=0x7f5c30009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c2d7fa700 1 -- 172.21.15.153:0/274008145 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000bee0 con 0x7f5c38151b90 2023-08-17T00:16:45.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c2d7fa700 1 -- 172.21.15.153:0/274008145 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30007080 con 0x7f5c38151b90 2023-08-17T00:16:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c2d7fa700 1 -- 172.21.15.153:0/274008145 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3001e6a0 con 0x7f5c38151b90 2023-08-17T00:16:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c380aa9c0 con 0x7f5c38151b90 2023-08-17T00:16:45.775 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.763+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c380aaf80 con 0x7f5c38151b90 2023-08-17T00:16:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.767+0000 7f5c2d7fa700 1 -- 172.21.15.153:0/274008145 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5c30025030 con 0x7f5c38151b90 2023-08-17T00:16:45.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.767+0000 7f5c2d7fa700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c1c05a150 0x7f5c1c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.767+0000 7f5c2d7fa700 1 -- 172.21.15.153:0/274008145 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f5c30075590 con 0x7f5c38151b90 2023-08-17T00:16:45.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c1c05a150 0x7f5c1c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c1c05a150 0x7f5c1c05c610 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f5c34009b20 tx=0x7f5c34008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 Processor -- start 2023-08-17T00:16:45.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 -- start start 2023-08-17T00:16:45.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x1895140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x1895630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x17951a0 con 0x186ece0 2023-08-17T00:16:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1849300 con 0x186e860 2023-08-17T00:16:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1848730 con 0x188ad20 2023-08-17T00:16:45.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3dbb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x1895630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3dbb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x1895630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33284/0 (socket says 172.21.15.153:33284) 2023-08-17T00:16:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/2622657045 learned_addr learned my addr 172.21.15.153:0/2622657045 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.771+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x1895140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 msgr2=0x188b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 msgr2=0x1895140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.785 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x1895140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c3dbb8700 1 -- 172.21.15.153:0/2622657045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17c3010 con 0x186ece0 2023-08-17T00:16:45.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x1895630 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f5c30009430 tx=0x7f5c3000e000).ready entity=mon.0 client_cookie=e6a43788b3e7ac5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.786 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c227fc700 1 -- 172.21.15.153:0/2622657045 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3004b110 con 0x186ece0 2023-08-17T00:16:45.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c227fc700 1 -- 172.21.15.153:0/2622657045 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300522c0 con 0x186ece0 2023-08-17T00:16:45.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c227fc700 1 -- 172.21.15.153:0/2622657045 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30052430 con 0x186ece0 2023-08-17T00:16:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 -- 172.21.15.153:0/2622657045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 msgr2=0x1895630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x1895630 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 rx=0x7f5c30009430 tx=0x7f5c3000e000).stop 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 -- 172.21.15.153:0/2622657045 shutdown_connections 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x1895630 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x1895140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2622657045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 -- 172.21.15.153:0/2622657045 >> 172.21.15.153:0/2622657045 conn(0x1628680 msgr2=0x18497d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 -- 172.21.15.153:0/2622657045 shutdown_connections 2023-08-17T00:16:45.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 -- 172.21.15.153:0/2622657045 wait complete. 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 -- start start 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.775+0000 7f5c499bf740 1 Processor -- start 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x186a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x186d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x186a5c0 con 0x186ece0 2023-08-17T00:16:45.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x18740b0 con 0x186e860 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1875580 con 0x188ad20 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 10 client.0 ll_register_callbacks cb 0x1800400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3cbb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x186d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x186a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3cbb6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x186d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33298/0 (socket says 172.21.15.153:33298) 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3cbb6700 1 -- 172.21.15.153:0/2063016309 learned_addr learned my addr 172.21.15.153:0/2063016309 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:45.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 msgr2=0x188fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 msgr2=0x186d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x186d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/2063016309 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c380aaf80 con 0x186e860 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x186d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x186a0d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f5c34011540 tx=0x7f5c34016000).ready entity=mon.1 client_cookie=53a06a2ac2b40dcf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.793 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c177fe700 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c177fe700 1 -- 172.21.15.153:0/2063016309 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c340145f0 con 0x186e860 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1791200 con 0x186e860 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.779+0000 7f5c177fe700 1 -- 172.21.15.153:0/2063016309 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f5c34014750 con 0x186e860 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 1 -- 172.21.15.153:0/2063016309 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c34014b20 con 0x186e860 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 10 client.9481 fetch_fsmap learned FSMap version 137 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) v3 -- 0x17be4b0 con 0x186e860 2023-08-17T00:16:45.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 1 -- 172.21.15.153:0/2063016309 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1791200 con 0x186e860 2023-08-17T00:16:45.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 1 -- 172.21.15.153:0/2063016309 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 137) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5c34014c80 con 0x186e860 2023-08-17T00:16:45.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 10 client.9481 fetch_fsmap finished waiting for FSMap version 137 2023-08-17T00:16:45.796 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 10 client.9481 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-08-17T00:16:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 20 client.9481 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x189ee50 0x189f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 4 client.9481 mds_command: new command op to 9789 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:16:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 --> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17bfcf0 con 0x189ee50 2023-08-17T00:16:45.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x189ee50 0x189f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x189ee50 0x189f230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e2c5b72e39e7380b server_cookie=c70daf5d8ab7b86 in_seq=0 out_seq=0 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 10 client.9481 ms_handle_connect on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 1 -- 172.21.15.153:0/2063016309 <== mds.0 v2:172.21.15.153:6833/935397889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x17bfcf0 con 0x189ee50 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 10 client.9481 handle_command_reply: tid=0 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 client.9481 shutdown 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 msgr2=0x186a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x186a0d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7f5c34011540 tx=0x7f5c34016000).stop 2023-08-17T00:16:45.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 shutdown_connections 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x189ee50 0x189f230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x188ad20 0x188fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186ece0 0x186d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c177fe700 0 client.9481 ms_handle_reset on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 --2- 172.21.15.153:0/2063016309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x186e860 0x186a0d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.783+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 >> 172.21.15.153:0/2063016309 conn(0x1628680 msgr2=0x1847b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:45.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.787+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 shutdown_connections 2023-08-17T00:16:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.787+0000 7f5c499bf740 1 -- 172.21.15.153:0/2063016309 wait complete. 2023-08-17T00:16:45.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.787+0000 7f5c499bf740 20 client.9481 trim_cache size 0 max 16384 2023-08-17T00:16:45.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 Processor -- start 2023-08-17T00:16:45.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 -- start start 2023-08-17T00:16:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x1872940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x1872e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x189ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1845210 con 0x186e860 2023-08-17T00:16:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1873320 con 0x188ad20 2023-08-17T00:16:45.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.803+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1791200 con 0x186ece0 2023-08-17T00:16:45.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x1872940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x1872940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33310/0 (socket says 172.21.15.153:33310) 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/595022025 learned_addr learned my addr 172.21.15.153:0/595022025 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x1872e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x189ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 msgr2=0x1872e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x1872e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 msgr2=0x189ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x189ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/595022025 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380a7f50 con 0x186e860 2023-08-17T00:16:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x1872940 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f5c34000c00 tx=0x7f5c34018000).ready entity=mon.0 client_cookie=6b1ad6d3b1b209be server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c22ffd700 1 -- 172.21.15.153:0/595022025 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34014740 con 0x186e860 2023-08-17T00:16:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c22ffd700 1 -- 172.21.15.153:0/595022025 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c34014b20 con 0x186e860 2023-08-17T00:16:45.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c22ffd700 1 -- 172.21.15.153:0/595022025 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34032440 con 0x186e860 2023-08-17T00:16:45.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 -- 172.21.15.153:0/595022025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 msgr2=0x1872940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x1872940 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 rx=0x7f5c34000c00 tx=0x7f5c34018000).stop 2023-08-17T00:16:45.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 -- 172.21.15.153:0/595022025 shutdown_connections 2023-08-17T00:16:45.817 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x189ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x1872e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 --2- 172.21.15.153:0/595022025 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x1872940 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 -- 172.21.15.153:0/595022025 >> 172.21.15.153:0/595022025 conn(0x1628680 msgr2=0x18746e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:45.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 -- 172.21.15.153:0/595022025 shutdown_connections 2023-08-17T00:16:45.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.807+0000 7f5c499bf740 1 -- 172.21.15.153:0/595022025 wait complete. 2023-08-17T00:16:45.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 -- start start 2023-08-17T00:16:45.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 Processor -- start 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x18f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x186c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x186cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x186d180 con 0x186e860 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x18ab770 con 0x188ad20 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x18687b0 con 0x186ece0 2023-08-17T00:16:45.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.811+0000 7f5c499bf740 10 client.0 ll_register_callbacks cb 0x7f5c34011d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x18f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x18f0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33326/0 (socket says 172.21.15.153:33326) 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/718959499 learned_addr learned my addr 172.21.15.153:0/718959499 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x186c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3dbb8700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x186cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 msgr2=0x186c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x186c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 msgr2=0x186cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x186cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 -- 172.21.15.153:0/718959499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x17be4b0 con 0x186e860 2023-08-17T00:16:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3d3b7700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x18f0f70 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f5c340093a0 tx=0x7f5c34032000).ready entity=mon.0 client_cookie=1061ae81b8890863 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:45.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 1 -- 172.21.15.153:0/718959499 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c34032440 con 0x186e860 2023-08-17T00:16:45.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 1 -- 172.21.15.153:0/718959499 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f5c34005880 con 0x186e860 2023-08-17T00:16:45.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5c300522c0 con 0x186e860 2023-08-17T00:16:45.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 1 -- 172.21.15.153:0/718959499 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c34005c50 con 0x186e860 2023-08-17T00:16:45.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 10 client.9978 fetch_fsmap learned FSMap version 137 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) v3 -- 0x17be200 con 0x186e860 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 1 -- 172.21.15.153:0/718959499 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c300522c0 con 0x186e860 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 1 -- 172.21.15.153:0/718959499 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 137) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5c34032830 con 0x186e860 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 10 client.9978 fetch_fsmap finished waiting for FSMap version 137 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 10 client.9978 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 20 client.9978 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:45.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1868c40 0x1869020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 4 client.9978 mds_command: new command op to 9789 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 --> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x17b6240 con 0x1868c40 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1868c40 0x1869020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c177fe700 10 client.9978 ms_handle_connect on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.815+0000 7f5c3cbb6700 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1868c40 0x1869020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7ba0b31af81c5ddc server_cookie=27a4b008bbafe7eb in_seq=0 out_seq=0 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c177fe700 1 -- 172.21.15.153:0/718959499 <== mds.0 v2:172.21.15.153:6833/935397889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x17b6240 con 0x1868c40 2023-08-17T00:16:45.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c177fe700 10 client.9978 handle_command_reply: tid=0 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 client.9978 shutdown 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 msgr2=0x18f0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x18f0f70 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 rx=0x7f5c340093a0 tx=0x7f5c34032000).stop 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 shutdown_connections 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1868c40 0x1869020 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x188ad20 0x186cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x186ece0 0x186c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 --2- 172.21.15.153:0/718959499 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x186e860 0x18f0f70 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 >> 172.21.15.153:0/718959499 conn(0x1628680 msgr2=0x1872880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:45.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c177fe700 0 client.9978 ms_handle_reset on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:45.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 shutdown_connections 2023-08-17T00:16:45.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 1 -- 172.21.15.153:0/718959499 wait complete. 2023-08-17T00:16:45.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c499bf740 20 client.9978 trim_cache size 0 max 16384 2023-08-17T00:16:45.831 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:16:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:16:45.831 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:16:45.831 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:16:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c1c05a150 msgr2=0x7f5c1c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c1c05a150 0x7f5c1c05c610 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f5c34009b20 tx=0x7f5c34008040).stop 2023-08-17T00:16:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 msgr2=0x7f5c3813ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 0x7f5c3813ee30 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 rx=0x7f5c3000b610 tx=0x7f5c30009840).stop 2023-08-17T00:16:45.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 shutdown_connections 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5c1c05a150 0x7f5c1c05c610 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5c38151b90 0x7f5c3813ee30 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c38065b50 0x7f5c381525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 --2- 172.21.15.153:0/274008145 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c38063290 0x7f5c381682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 >> 172.21.15.153:0/274008145 conn(0x7f5c380c7150 msgr2=0x7f5c380bc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 shutdown_connections 2023-08-17T00:16:45.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:45.819+0000 7f5c3f61b700 1 -- 172.21.15.153:0/274008145 wait complete. 2023-08-17T00:16:45.847 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:16:45.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.12:0 damage ls 2023-08-17T00:16:46.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.007+0000 7f1b5dd1b700 1 Processor -- start 2023-08-17T00:16:46.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.007+0000 7f1b5dd1b700 1 -- start start 2023-08-17T00:16:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b5dd1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b580c3a30 0x7f1b580a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b5dd1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b58066ee0 0x7f1b58067310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b5dd1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b58154380 con 0x7f1b580a69b0 2023-08-17T00:16:46.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b5dd1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b58067800 con 0x7f1b58066ee0 2023-08-17T00:16:46.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b5dd1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b580c3ee0 con 0x7f1b580c3a30 2023-08-17T00:16:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b57fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b58066ee0 0x7f1b58067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b57fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b58066ee0 0x7f1b58067310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33328/0 (socket says 172.21.15.153:33328) 2023-08-17T00:16:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.011+0000 7f1b57fff700 1 -- 172.21.15.153:0/917163382 learned_addr learned my addr 172.21.15.153:0/917163382 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/917163382 >> v2:172.21.15.178:3300/0 conn(0x7f1b580c3a30 0x7f1b580a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b57fff700 1 -- 172.21.15.153:0/917163382 >> v2:172.21.15.178:3300/0 conn(0x7f1b580c3a30 msgr2=0x7f1b580a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b57fff700 1 --2- 172.21.15.153:0/917163382 >> v2:172.21.15.178:3300/0 conn(0x7f1b580c3a30 0x7f1b580a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b57fff700 1 -- 172.21.15.153:0/917163382 >> v1:172.21.15.178:6789/0 conn(0x7f1b580a69b0 legacy=0x7f1b580c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b57fff700 1 -- 172.21.15.153:0/917163382 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b581545d0 con 0x7f1b58066ee0 2023-08-17T00:16:46.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b57fff700 1 --2- 172.21.15.153:0/917163382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b58067310 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f1b580c6c10 tx=0x7f1b50009840).ready entity=mon.0 client_cookie=7d7938f2cd309831 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b567fc700 1 -- 172.21.15.153:0/917163382 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000e070 con 0x7f1b58066ee0 2023-08-17T00:16:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b567fc700 1 -- 172.21.15.153:0/917163382 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b5000ba50 con 0x7f1b58066ee0 2023-08-17T00:16:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b567fc700 1 -- 172.21.15.153:0/917163382 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b5000bdd0 con 0x7f1b58066ee0 2023-08-17T00:16:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/917163382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 msgr2=0x7f1b58067310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/917163382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b58067310 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 rx=0x7f1b580c6c10 tx=0x7f1b50009840).stop 2023-08-17T00:16:46.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/917163382 shutdown_connections 2023-08-17T00:16:46.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/917163382 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b58067310 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/917163382 >> v2:172.21.15.178:3300/0 conn(0x7f1b580c3a30 0x7f1b580a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/917163382 >> 172.21.15.153:0/917163382 conn(0x7f1b580c4250 msgr2=0x7f1b580c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:46.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/917163382 shutdown_connections 2023-08-17T00:16:46.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.015+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/917163382 wait complete. 2023-08-17T00:16:46.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 Processor -- start 2023-08-17T00:16:46.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 -- start start 2023-08-17T00:16:46.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b580a4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b580a69b0 0x7f1b580a4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b580c3a30 0x7f1b5814dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580a59f0 con 0x7f1b58066ee0 2023-08-17T00:16:46.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580a5e80 con 0x7f1b580c3a30 2023-08-17T00:16:46.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b5dd1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580a4de0 con 0x7f1b580a69b0 2023-08-17T00:16:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b580a4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b580a4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33342/0 (socket says 172.21.15.153:33342) 2023-08-17T00:16:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 -- 172.21.15.153:0/3065568363 learned_addr learned my addr 172.21.15.153:0/3065568363 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b580a69b0 0x7f1b580a4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b57fff700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b580c3a30 0x7f1b5814dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 -- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b580a69b0 msgr2=0x7f1b580a4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b580a69b0 0x7f1b580a4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 -- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b580c3a30 msgr2=0x7f1b5814dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b580c3a30 0x7f1b5814dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.019+0000 7f1b577fe700 1 -- 172.21.15.153:0/3065568363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50009ae0 con 0x7f1b58066ee0 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.023+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b580a4230 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f1b4800c4c0 tx=0x7f1b48007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.023+0000 7f1b3f7fe700 1 -- 172.21.15.153:0/3065568363 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48007020 con 0x7f1b58066ee0 2023-08-17T00:16:46.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.023+0000 7f1b3f7fe700 1 -- 172.21.15.153:0/3065568363 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48001e90 con 0x7f1b58066ee0 2023-08-17T00:16:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.023+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580a50c0 con 0x7f1b58066ee0 2023-08-17T00:16:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.023+0000 7f1b3f7fe700 1 -- 172.21.15.153:0/3065568363 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480073b0 con 0x7f1b58066ee0 2023-08-17T00:16:46.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.023+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580a5680 con 0x7f1b58066ee0 2023-08-17T00:16:46.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.027+0000 7f1b3f7fe700 1 -- 172.21.15.153:0/3065568363 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1b48010070 con 0x7f1b58066ee0 2023-08-17T00:16:46.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.027+0000 7f1b3f7fe700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b4405a150 0x7f1b4405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.027+0000 7f1b3f7fe700 1 -- 172.21.15.153:0/3065568363 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f1b48073a80 con 0x7f1b58066ee0 2023-08-17T00:16:46.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.027+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b4405a150 0x7f1b4405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.027+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b4405a150 0x7f1b4405c610 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f1b58150290 tx=0x7f1b4c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 Processor -- start 2023-08-17T00:16:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 -- start start 2023-08-17T00:16:46.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1ec1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f0a390 0x1ebda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1e101a0 con 0x1ec40c0 2023-08-17T00:16:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ec3920 con 0x1f04fd0 2023-08-17T00:16:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ec3be0 con 0x1f0a390 2023-08-17T00:16:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33352/0 (socket says 172.21.15.153:33352) 2023-08-17T00:16:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 -- 172.21.15.153:0/4170316531 learned_addr learned my addr 172.21.15.153:0/4170316531 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b57fff700 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f0a390 0x1ebda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b577fe700 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1ec1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 -- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f0a390 msgr2=0x1ebda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f0a390 0x1ebda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 -- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 msgr2=0x1ec1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1ec1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 -- 172.21.15.153:0/4170316531 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e4fe30 con 0x1ec40c0 2023-08-17T00:16:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 0x1f053b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f1b580c3e10 tx=0x7f1b4c015000).ready entity=mon.0 client_cookie=66285ae22e2d9c5c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b3cff9700 1 -- 172.21.15.153:0/4170316531 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0148d0 con 0x1ec40c0 2023-08-17T00:16:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b3cff9700 1 -- 172.21.15.153:0/4170316531 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c014a30 con 0x1ec40c0 2023-08-17T00:16:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b3cff9700 1 -- 172.21.15.153:0/4170316531 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c014db0 con 0x1ec40c0 2023-08-17T00:16:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 -- 172.21.15.153:0/4170316531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 msgr2=0x1f053b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.031+0000 7f1b68090740 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 0x1f053b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 rx=0x7f1b580c3e10 tx=0x7f1b4c015000).stop 2023-08-17T00:16:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- 172.21.15.153:0/4170316531 shutdown_connections 2023-08-17T00:16:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f0a390 0x1ebda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 --2- 172.21.15.153:0/4170316531 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1ec1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- 172.21.15.153:0/4170316531 >> 172.21.15.153:0/4170316531 conn(0x1ca3680 msgr2=0x1f0a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- 172.21.15.153:0/4170316531 shutdown_connections 2023-08-17T00:16:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- 172.21.15.153:0/4170316531 wait complete. 2023-08-17T00:16:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- start start 2023-08-17T00:16:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 Processor -- start 2023-08-17T00:16:46.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1ee8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1eef660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f074d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f17d90 con 0x1f0a390 2023-08-17T00:16:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eedaf0 con 0x1f04fd0 2023-08-17T00:16:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1f16590 con 0x1ec40c0 2023-08-17T00:16:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.035+0000 7f1b68090740 10 client.0 ll_register_callbacks cb 0x1e06b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f074d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f074d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33366/0 (socket says 172.21.15.153:33366) 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 -- 172.21.15.153:0/4282650214 learned_addr learned my addr 172.21.15.153:0/4282650214 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1eef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b577fe700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1ee8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 -- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 msgr2=0x1ee8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1ee8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 -- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 msgr2=0x1eef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1eef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 -- 172.21.15.153:0/4282650214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b4c00e040 con 0x1f0a390 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b57fff700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f074d0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f1b580c32b0 tx=0x7f1b50009840).ready entity=mon.0 client_cookie=35afbd7472c01b8b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 1 -- 172.21.15.153:0/4282650214 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50013910 con 0x1f0a390 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 1 -- 172.21.15.153:0/4282650214 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f1b50013a70 con 0x1f0a390 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1e3acf0 con 0x1f0a390 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 1 -- 172.21.15.153:0/4282650214 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b50013e40 con 0x1f0a390 2023-08-17T00:16:46.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 10 client.9990 fetch_fsmap learned FSMap version 137 2023-08-17T00:16:46.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) v3 -- 0x1e3e010 con 0x1f0a390 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 1 -- 172.21.15.153:0/4282650214 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1e3acf0 con 0x1f0a390 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 1 -- 172.21.15.153:0/4282650214 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 137) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1b50020470 con 0x1f0a390 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 10 client.9990 fetch_fsmap finished waiting for FSMap version 137 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 10 client.9990 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 20 client.9990 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eea600 0x1eeaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 4 client.9990 mds_command: new command op to 9789 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 --> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1e31240 con 0x1eea600 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b577fe700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eea600 0x1eeaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b577fe700 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eea600 0x1eeaa10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3af59011b3b59afb server_cookie=c59e810abbdd07bb in_seq=0 out_seq=0 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.039+0000 7f1b35ffb700 10 client.9990 ms_handle_connect on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b35ffb700 1 -- 172.21.15.153:0/4282650214 <== mds.0 v2:172.21.15.153:6833/935397889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1e31240 con 0x1eea600 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b35ffb700 10 client.9990 handle_command_reply: tid=0 2023-08-17T00:16:46.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 client.9990 shutdown 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 msgr2=0x1f074d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f074d0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 rx=0x7f1b580c32b0 tx=0x7f1b50009840).stop 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 shutdown_connections 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eea600 0x1eeaa10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f074d0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f04fd0 0x1eef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 --2- 172.21.15.153:0/4282650214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1ee8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b35ffb700 0 client.9990 ms_handle_reset on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 >> 172.21.15.153:0/4282650214 conn(0x1ca3680 msgr2=0x1f053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 shutdown_connections 2023-08-17T00:16:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 1 -- 172.21.15.153:0/4282650214 wait complete. 2023-08-17T00:16:46.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.043+0000 7f1b68090740 20 client.9990 trim_cache size 0 max 16384 2023-08-17T00:16:46.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 Processor -- start 2023-08-17T00:16:46.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 -- start start 2023-08-17T00:16:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f04fd0 0x1eea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f200c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f06080 con 0x1f0a390 2023-08-17T00:16:46.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ebec30 con 0x1ec40c0 2023-08-17T00:16:46.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eeaed0 con 0x1f04fd0 2023-08-17T00:16:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f200c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f200c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33380/0 (socket says 172.21.15.153:33380) 2023-08-17T00:16:46.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 -- 172.21.15.153:0/1980427610 learned_addr learned my addr 172.21.15.153:0/1980427610 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f04fd0 0x1eea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b577fe700 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 -- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f04fd0 msgr2=0x1eea9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f04fd0 0x1eea9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 -- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ec40c0 msgr2=0x1f053b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 -- 172.21.15.153:0/1980427610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5814e570 con 0x1f0a390 2023-08-17T00:16:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b577fe700 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b57fff700 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f200c0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f1b5000b010 tx=0x7f1b50020000).ready entity=mon.0 client_cookie=14c5ff72d2f40734 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b3d7fa700 1 -- 172.21.15.153:0/1980427610 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50013e40 con 0x1f0a390 2023-08-17T00:16:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b3d7fa700 1 -- 172.21.15.153:0/1980427610 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b50013420 con 0x1f0a390 2023-08-17T00:16:46.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b3d7fa700 1 -- 172.21.15.153:0/1980427610 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b50020930 con 0x1f0a390 2023-08-17T00:16:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 -- 172.21.15.153:0/1980427610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 msgr2=0x1f200c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.059+0000 7f1b68090740 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f200c0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 rx=0x7f1b5000b010 tx=0x7f1b50020000).stop 2023-08-17T00:16:46.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- 172.21.15.153:0/1980427610 shutdown_connections 2023-08-17T00:16:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f0a390 0x1f200c0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1f04fd0 0x1eea9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 --2- 172.21.15.153:0/1980427610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ec40c0 0x1f053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- 172.21.15.153:0/1980427610 >> 172.21.15.153:0/1980427610 conn(0x1ca3680 msgr2=0x1f158f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:46.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- 172.21.15.153:0/1980427610 shutdown_connections 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- 172.21.15.153:0/1980427610 wait complete. 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- start start 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 Processor -- start 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1f72810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 0x1f06b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f0a390 0x1f07050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f07540 con 0x1f04fd0 2023-08-17T00:16:46.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f0af20 con 0x1f0a390 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ebe240 con 0x1ec40c0 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b68090740 10 client.0 ll_register_callbacks cb 0x7f1b5000b330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 0x1f06b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 0x1f06b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33382/0 (socket says 172.21.15.153:33382) 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 -- 172.21.15.153:0/3922977967 learned_addr learned my addr 172.21.15.153:0/3922977967 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b57fff700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f0a390 0x1f07050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1f72810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 -- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 msgr2=0x1f72810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1f72810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 -- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f0a390 msgr2=0x1f07050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:46.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f0a390 0x1f07050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 -- 172.21.15.153:0/3922977967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1e3e010 con 0x1f04fd0 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b57fff700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f0a390 0x1f07050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1f72810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b56ffd700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 0x1f06b60 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7f1b4c01e000 tx=0x7f1b4c022000).ready entity=mon.0 client_cookie=b48a70af07b0e5f7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.063+0000 7f1b35ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 1 -- 172.21.15.153:0/3922977967 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c0148d0 con 0x1f04fd0 2023-08-17T00:16:46.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 1 -- 172.21.15.153:0/3922977967 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f1b4c01fdb0 con 0x1f04fd0 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b4c014a30 con 0x1f04fd0 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 1 -- 172.21.15.153:0/3922977967 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=137) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b4c02a630 con 0x1f04fd0 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 10 client.9996 fetch_fsmap learned FSMap version 137 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=137,monmap=2+}) v3 -- 0x1e394b0 con 0x1f04fd0 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 1 -- 172.21.15.153:0/3922977967 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c014a30 con 0x1f04fd0 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 1 -- 172.21.15.153:0/3922977967 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 137) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1b4c02a790 con 0x1f04fd0 2023-08-17T00:16:46.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 10 client.9996 fetch_fsmap finished waiting for FSMap version 137 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 10 client.9996 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 20 client.9996 populate_metadata read hostname 'smithi153' 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eedf40 0x1ebd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 4 client.9996 mds_command: new command op to 9789 tid=0[{"prefix": "damage ls"}] 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 --> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x1cfa610 con 0x1eedf40 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eedf40 0x1ebd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:46.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 10 client.9996 ms_handle_connect on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b577fe700 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eedf40 0x1ebd210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=115aadb66b1b711 server_cookie=e978c461c96a6a4d in_seq=0 out_seq=0 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 1 -- 172.21.15.153:0/3922977967 <== mds.0 v2:172.21.15.153:6833/935397889 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x1cfa610 con 0x1eedf40 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 10 client.9996 handle_command_reply: tid=0 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 client.9996 shutdown 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 msgr2=0x1f06b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 0x1f06b60 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 rx=0x7f1b4c01e000 tx=0x7f1b4c022000).stop 2023-08-17T00:16:46.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 shutdown_connections 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:6833/935397889,v1:172.21.15.153:6835/935397889] conn(0x1eedf40 0x1ebd210 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1f0a390 0x1f07050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1f04fd0 0x1f06b60 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b35ffb700 0 client.9996 ms_handle_reset on v2:172.21.15.153:6833/935397889 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 --2- 172.21.15.153:0/3922977967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ec40c0 0x1f72810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 >> 172.21.15.153:0/3922977967 conn(0x1ca3680 msgr2=0x1f200c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:46.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 shutdown_connections 2023-08-17T00:16:46.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.067+0000 7f1b68090740 1 -- 172.21.15.153:0/3922977967 wait complete. 2023-08-17T00:16:46.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b68090740 20 client.9996 trim_cache size 0 max 16384 2023-08-17T00:16:46.084 INFO:teuthology.orchestra.run.smithi153.stdout:[] 2023-08-17T00:16:46.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b4405a150 msgr2=0x7f1b4405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b4405a150 0x7f1b4405c610 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 rx=0x7f1b58150290 tx=0x7f1b4c008040).stop 2023-08-17T00:16:46.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 msgr2=0x7f1b580a4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b580a4230 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 rx=0x7f1b4800c4c0 tx=0x7f1b48007e00).stop 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 shutdown_connections 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b4405a150 0x7f1b4405c610 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b580c3a30 0x7f1b5814dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b580a69b0 0x7f1b580a4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 --2- 172.21.15.153:0/3065568363 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b58066ee0 0x7f1b580a4230 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:46.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 >> 172.21.15.153:0/3065568363 conn(0x7f1b580c4250 msgr2=0x7f1b58061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 shutdown_connections 2023-08-17T00:16:46.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:46.071+0000 7f1b5dd1b700 1 -- 172.21.15.153:0/3065568363 wait complete. 2023-08-17T00:16:46.096 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:16:46.096 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:46.133 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:46.178 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:16:46.179 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:16:46.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:16:46.179 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:16:46.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:16:46.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:16:46.778 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:16:46.795 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:47.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 Processor -- start 2023-08-17T00:16:47.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 -- start start 2023-08-17T00:16:47.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15c40a89c0 0x7f15c40a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15c40c0c80 0x7f15c40bcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40bc0b0 con 0x7f15c41505d0 2023-08-17T00:16:47.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40bd590 con 0x7f15c40a89c0 2023-08-17T00:16:47.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.055+0000 7f15caddb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c4062fb0 con 0x7f15c40c0c80 2023-08-17T00:16:47.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15c40a89c0 0x7f15c40a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f15c40a89c0 0x7f15c40a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33396/0 (socket says 172.21.15.153:33396) 2023-08-17T00:16:47.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 -- 172.21.15.153:0/3064295694 learned_addr learned my addr 172.21.15.153:0/3064295694 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:47.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15bbfff700 1 --2- 172.21.15.153:0/3064295694 >> v2:172.21.15.178:3300/0 conn(0x7f15c40c0c80 0x7f15c40bcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 -- 172.21.15.153:0/3064295694 >> v2:172.21.15.178:3300/0 conn(0x7f15c40c0c80 msgr2=0x7f15c40bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:47.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 --2- 172.21.15.153:0/3064295694 >> v2:172.21.15.178:3300/0 conn(0x7f15c40c0c80 0x7f15c40bcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 -- 172.21.15.153:0/3064295694 >> v1:172.21.15.178:6789/0 conn(0x7f15c41505d0 legacy=0x7f15c4150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 -- 172.21.15.153:0/3064295694 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40bb780 con 0x7f15c40a89c0 2023-08-17T00:16:47.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15c8b77700 1 --2- 172.21.15.153:0/3064295694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c40a89c0 0x7f15c40a8da0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f15c40c3030 tx=0x7f15c0009840).ready entity=mon.0 client_cookie=f08b76d7e624ab50 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15bb7fe700 1 -- 172.21.15.153:0/3064295694 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c000e070 con 0x7f15c40a89c0 2023-08-17T00:16:47.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15bb7fe700 1 -- 172.21.15.153:0/3064295694 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c000ba20 con 0x7f15c40a89c0 2023-08-17T00:16:47.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15bb7fe700 1 -- 172.21.15.153:0/3064295694 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c000bda0 con 0x7f15c40a89c0 2023-08-17T00:16:47.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 -- 172.21.15.153:0/3064295694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c40a89c0 msgr2=0x7f15c40a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 --2- 172.21.15.153:0/3064295694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c40a89c0 0x7f15c40a8da0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 rx=0x7f15c40c3030 tx=0x7f15c0009840).stop 2023-08-17T00:16:47.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 -- 172.21.15.153:0/3064295694 shutdown_connections 2023-08-17T00:16:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 --2- 172.21.15.153:0/3064295694 >> v2:172.21.15.178:3300/0 conn(0x7f15c40c0c80 0x7f15c40bcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 --2- 172.21.15.153:0/3064295694 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c40a89c0 0x7f15c40a8da0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 -- 172.21.15.153:0/3064295694 >> 172.21.15.153:0/3064295694 conn(0x7f15c40c7150 msgr2=0x7f15c40c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 -- 172.21.15.153:0/3064295694 shutdown_connections 2023-08-17T00:16:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.059+0000 7f15caddb700 1 -- 172.21.15.153:0/3064295694 wait complete. 2023-08-17T00:16:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 Processor -- start 2023-08-17T00:16:47.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 -- start start 2023-08-17T00:16:47.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40a89c0 0x7f15c40a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40c0c80 0x7f15c40bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 0x7f15c4164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c414df20 con 0x7f15c41505d0 2023-08-17T00:16:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40a7950 con 0x7f15c40c0c80 2023-08-17T00:16:47.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.063+0000 7f15caddb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40bf650 con 0x7f15c40a89c0 2023-08-17T00:16:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 0x7f15c4164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15bbfff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40c0c80 0x7f15c40bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 0x7f15c4164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33408/0 (socket says 172.21.15.153:33408) 2023-08-17T00:16:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 -- 172.21.15.153:0/2249799481 learned_addr learned my addr 172.21.15.153:0/2249799481 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c8b77700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40a89c0 0x7f15c40a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 -- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40a89c0 msgr2=0x7f15c40a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40a89c0 0x7f15c40a7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 -- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40c0c80 msgr2=0x7f15c40bfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40c0c80 0x7f15c40bfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 -- 172.21.15.153:0/2249799481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c0009ae0 con 0x7f15c41505d0 2023-08-17T00:16:47.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15c9378700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 0x7f15c4164290 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f15bc00c440 tx=0x7f15bc007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00ce20 con 0x7f15c41505d0 2023-08-17T00:16:47.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00f470 con 0x7f15c41505d0 2023-08-17T00:16:47.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00f7f0 con 0x7f15c41505d0 2023-08-17T00:16:47.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c41533e0 con 0x7f15c41505d0 2023-08-17T00:16:47.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c40bf000 con 0x7f15c41505d0 2023-08-17T00:16:47.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.067+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40bead0 con 0x7f15c41505d0 2023-08-17T00:16:47.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.071+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f15bc010070 con 0x7f15c41505d0 2023-08-17T00:16:47.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.071+0000 7f15b8ff9700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f15b005a120 0x7f15b005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.071+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f15bc073550 con 0x7f15c41505d0 2023-08-17T00:16:47.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.071+0000 7f15c8b77700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f15b005a120 0x7f15b005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.075+0000 7f15c8b77700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f15b005a120 0x7f15b005c5e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f15c000c010 tx=0x7f15c0009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.079+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15bc046eb0 con 0x7f15c41505d0 2023-08-17T00:16:47.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.271+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15c40bf7f0 con 0x7f15c41505d0 2023-08-17T00:16:47.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.271+0000 7f15b8ff9700 1 -- 172.21.15.153:0/2249799481 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f15bc04a4d0 con 0x7f15c41505d0 2023-08-17T00:16:47.281 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:47.281 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":137,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":137,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:16:37.314463+0000","modified":"2023-08-17T00:16:40.409153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"a","rank":0,"incarnation":134,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/935397889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":935397889},{"type":"v1","addr":"172.21.15.153:6835","nonce":935397889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-08-17T00:16:47.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f15b005a120 msgr2=0x7f15b005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f15b005a120 0x7f15b005c5e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f15c000c010 tx=0x7f15c0009840).stop 2023-08-17T00:16:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 msgr2=0x7f15c4164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 0x7f15c4164290 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 rx=0x7f15bc00c440 tx=0x7f15bc007dd0).stop 2023-08-17T00:16:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 shutdown_connections 2023-08-17T00:16:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f15b005a120 0x7f15b005c5e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f15c41505d0 0x7f15c4164290 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15c40c0c80 0x7f15c40bfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 --2- 172.21.15.153:0/2249799481 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15c40a89c0 0x7f15c40a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 >> 172.21.15.153:0/2249799481 conn(0x7f15c40c7150 msgr2=0x7f15c40abef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:47.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 shutdown_connections 2023-08-17T00:16:47.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.279+0000 7f15caddb700 1 -- 172.21.15.153:0/2249799481 wait complete. 2023-08-17T00:16:47.289 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 137 2023-08-17T00:16:47.306 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:47.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.455+0000 7fcd6d69b700 1 Processor -- start 2023-08-17T00:16:47.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.455+0000 7fcd6d69b700 1 -- start start 2023-08-17T00:16:47.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd6d69b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd680a9fa0 0x7fcd68153b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd6d69b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd68157670 con 0x7fcd680c5750 2023-08-17T00:16:47.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd6d69b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd681578e0 con 0x7fcd681537b0 2023-08-17T00:16:47.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd6d69b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd68157bc0 con 0x7fcd680a9fa0 2023-08-17T00:16:47.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd677fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fcd680c5750 0x7fcd680c5be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50104/0 (socket says 172.21.15.153:50104) 2023-08-17T00:16:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd677fe700 1 -- 172.21.15.153:0/512742135 learned_addr learned my addr 172.21.15.153:0/512742135 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd5e7fc700 1 --2- 172.21.15.153:0/512742135 >> v2:172.21.15.178:3300/0 conn(0x7fcd680a9fa0 0x7fcd68153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222576393 0 0) 0x7fcd68157670 con 0x7fcd680c5750 2023-08-17T00:16:47.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd540033f0 con 0x7fcd680c5750 2023-08-17T00:16:47.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 90530310 0 0) 0x7fcd540033f0 con 0x7fcd680c5750 2023-08-17T00:16:47.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 >> v2:172.21.15.178:3300/0 conn(0x7fcd680a9fa0 msgr2=0x7fcd68153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:47.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 --2- 172.21.15.153:0/512742135 >> v2:172.21.15.178:3300/0 conn(0x7fcd680a9fa0 0x7fcd68153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 >> v1:172.21.15.178:6789/0 conn(0x7fcd681537b0 legacy=0x7fcd680a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68157ea0 con 0x7fcd680c5750 2023-08-17T00:16:47.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fcd600017f0 con 0x7fcd680c5750 2023-08-17T00:16:47.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 >> v1:172.21.15.153:6789/0 conn(0x7fcd680c5750 legacy=0x7fcd680c5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd540038e0 0x7fcd54003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd54004690 0x7fcd54004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd54005000 0x7fcd5400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68157bc0 con 0x7fcd540038e0 2023-08-17T00:16:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5400bf60 con 0x7fcd54004690 2023-08-17T00:16:47.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5400c0f0 con 0x7fcd54005000 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd540038e0 0x7fcd54003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 -- 172.21.15.153:0/512742135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd54005000 msgr2=0x7fcd5400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd54005000 0x7fcd5400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 -- 172.21.15.153:0/512742135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd54004690 msgr2=0x7fcd54004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd54004690 0x7fcd54004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 -- 172.21.15.153:0/512742135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd540033f0 con 0x7fcd540038e0 2023-08-17T00:16:47.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd677fe700 1 -- 172.21.15.153:0/512742135 reap_dead start 2023-08-17T00:16:47.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd540038e0 0x7fcd54003d00 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fcd58001730 tx=0x7fcd58007bb0).ready entity=mon.0 client_cookie=406a884a228a8c10 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.459+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58007020 con 0x7fcd540038e0 2023-08-17T00:16:47.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58007180 con 0x7fcd540038e0 2023-08-17T00:16:47.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd667fc700 1 -- 172.21.15.153:0/512742135 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58007520 con 0x7fcd540038e0 2023-08-17T00:16:47.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 -- 172.21.15.153:0/512742135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd540038e0 msgr2=0x7fcd54003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd540038e0 0x7fcd54003d00 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 rx=0x7fcd58001730 tx=0x7fcd58007bb0).stop 2023-08-17T00:16:47.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 -- 172.21.15.153:0/512742135 shutdown_connections 2023-08-17T00:16:47.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/512742135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd540038e0 0x7fcd54003d00 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 -- 172.21.15.153:0/512742135 >> 172.21.15.153:0/512742135 conn(0x7fcd68061fa0 msgr2=0x7fcd680623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:47.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 -- 172.21.15.153:0/512742135 shutdown_connections 2023-08-17T00:16:47.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 -- 172.21.15.153:0/512742135 wait complete. 2023-08-17T00:16:47.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 Processor -- start 2023-08-17T00:16:47.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.463+0000 7fcd6d69b700 1 -- start start 2023-08-17T00:16:47.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd540038e0 0x7fcd6814c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd68152270 0x7fcd681526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 0x7fcd680c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68151690 con 0x7fcd680c7120 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680ae6b0 con 0x7fcd540038e0 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd680c7a90 con 0x7fcd68152270 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 0x7fcd680c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 0x7fcd680c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33436/0 (socket says 172.21.15.153:33436) 2023-08-17T00:16:47.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 -- 172.21.15.153:0/1686986687 learned_addr learned my addr 172.21.15.153:0/1686986687 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd540038e0 0x7fcd6814c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd5e7fc700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd68152270 0x7fcd681526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 -- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd68152270 msgr2=0x7fcd681526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd68152270 0x7fcd681526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 -- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd540038e0 msgr2=0x7fcd6814c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd540038e0 0x7fcd6814c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 -- 172.21.15.153:0/1686986687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680adae0 con 0x7fcd680c7120 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd540038e0 0x7fcd6814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd677fe700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 0x7fcd680c75a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fcd680839f0 tx=0x7fcd60001e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60004c40 con 0x7fcd680c7120 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd60004dc0 con 0x7fcd680c7120 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd680add80 con 0x7fcd680c7120 2023-08-17T00:16:47.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd60007320 con 0x7fcd680c7120 2023-08-17T00:16:47.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd680ae340 con 0x7fcd680c7120 2023-08-17T00:16:47.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.467+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd680ae860 con 0x7fcd680c7120 2023-08-17T00:16:47.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.471+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fcd6001c070 con 0x7fcd680c7120 2023-08-17T00:16:47.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.471+0000 7fcd5f7fe700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd4805a150 0x7fcd4805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.471+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fcd60073700 con 0x7fcd680c7120 2023-08-17T00:16:47.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.471+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd4805a150 0x7fcd4805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.475+0000 7fcd66ffd700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd4805a150 0x7fcd4805c610 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fcd58000fd0 tx=0x7fcd58015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.479+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fcd680ae860 con 0x7fcd680c7120 2023-08-17T00:16:47.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.639+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd680ae820 con 0x7fcd680c7120 2023-08-17T00:16:47.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd5f7fe700 1 -- 172.21.15.153:0/1686986687 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17087 (secure 0 0 0) 0x7fcd6001a030 con 0x7fcd680c7120 2023-08-17T00:16:47.650 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:47.651 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":180,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:42.423611+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:16:35.234407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-17T00:16:36.324685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.f","mappings":[{"from":7,"to":3}]},{"pgid":"25.2a","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:47.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd4805a150 msgr2=0x7fcd4805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd4805a150 0x7fcd4805c610 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7fcd58000fd0 tx=0x7fcd58015000).stop 2023-08-17T00:16:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 msgr2=0x7fcd680c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 0x7fcd680c75a0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 rx=0x7fcd680839f0 tx=0x7fcd60001e20).stop 2023-08-17T00:16:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 shutdown_connections 2023-08-17T00:16:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fcd4805a150 0x7fcd4805c610 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fcd680c7120 0x7fcd680c75a0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd68152270 0x7fcd681526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 --2- 172.21.15.153:0/1686986687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd540038e0 0x7fcd6814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 >> 172.21.15.153:0/1686986687 conn(0x7fcd68061fa0 msgr2=0x7fcd6814cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 shutdown_connections 2023-08-17T00:16:47.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.643+0000 7fcd6d69b700 1 -- 172.21.15.153:0/1686986687 wait complete. 2023-08-17T00:16:47.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:16:35.234407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:16:36.324685+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '178', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:16:47.674 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:16:47.764 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:16:47.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:16:47.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 Processor -- start 2023-08-17T00:16:47.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 -- start start 2023-08-17T00:16:47.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84680a8df0 0x7f84680c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8468068820 0x7f8468068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8468061fa0 0x7f8468062420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84681585a0 con 0x7f8468068820 2023-08-17T00:16:47.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8468066400 con 0x7f8468061fa0 2023-08-17T00:16:47.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8467fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8468069170 con 0x7f84680a8df0 2023-08-17T00:16:47.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8468068820 0x7f8468068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f8468068820 0x7f8468068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33448/0 (socket says 172.21.15.153:33448) 2023-08-17T00:16:47.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 -- 172.21.15.153:0/894691045 learned_addr learned my addr 172.21.15.153:0/894691045 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:47.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 -- 172.21.15.153:0/894691045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84680a8df0 msgr2=0x7f84680c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:47.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 --2- 172.21.15.153:0/894691045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84680a8df0 0x7f84680c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:47.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 -- 172.21.15.153:0/894691045 >> v2:172.21.15.178:3300/0 conn(0x7f8468061fa0 msgr2=0x7f8468062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:47.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 --2- 172.21.15.153:0/894691045 >> v2:172.21.15.178:3300/0 conn(0x7f8468061fa0 0x7f8468062420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:47.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 -- 172.21.15.153:0/894691045 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84680b9d30 con 0x7f8468068820 2023-08-17T00:16:47.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f84667fc700 1 --2- 172.21.15.153:0/894691045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8468068820 0x7f8468068c80 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f84680c09b0 tx=0x7f845c0090f0).ready entity=mon.0 client_cookie=df43b0c9ad0bede5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8465ffb700 1 -- 172.21.15.153:0/894691045 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00b600 con 0x7f8468068820 2023-08-17T00:16:47.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8465ffb700 1 -- 172.21.15.153:0/894691045 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f845c00b760 con 0x7f8468068820 2023-08-17T00:16:47.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.819+0000 7f8465ffb700 1 -- 172.21.15.153:0/894691045 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845c00bae0 con 0x7f8468068820 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 -- 172.21.15.153:0/894691045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8468068820 msgr2=0x7f8468068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 --2- 172.21.15.153:0/894691045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8468068820 0x7f8468068c80 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 rx=0x7f84680c09b0 tx=0x7f845c0090f0).stop 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 -- 172.21.15.153:0/894691045 shutdown_connections 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 --2- 172.21.15.153:0/894691045 >> v2:172.21.15.178:3300/0 conn(0x7f8468061fa0 0x7f8468062420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 --2- 172.21.15.153:0/894691045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8468068820 0x7f8468068c80 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 --2- 172.21.15.153:0/894691045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f84680a8df0 0x7f84680c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 -- 172.21.15.153:0/894691045 >> 172.21.15.153:0/894691045 conn(0x7f84680c6620 msgr2=0x7f84680c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:47.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 -- 172.21.15.153:0/894691045 shutdown_connections 2023-08-17T00:16:47.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 -- 172.21.15.153:0/894691045 wait complete. 2023-08-17T00:16:47.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.823+0000 7f8467fff700 1 Processor -- start 2023-08-17T00:16:47.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 -- start start 2023-08-17T00:16:47.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8468061fa0 0x7f84680bfea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8468068820 0x7f84680aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 0x7f84680ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84680ab8f0 con 0x7f84680a8df0 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f846816cdb0 con 0x7f8468061fa0 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8468168ae0 con 0x7f8468068820 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 0x7f84680ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 0x7f84680ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33454/0 (socket says 172.21.15.153:33454) 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 -- 172.21.15.153:0/1645364940 learned_addr learned my addr 172.21.15.153:0/1645364940 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8466ffd700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8468061fa0 0x7f84680bfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84667fc700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8468068820 0x7f84680aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 -- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8468068820 msgr2=0x7f84680aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8468068820 0x7f84680aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 -- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8468061fa0 msgr2=0x7f84680bfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:47.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8468061fa0 0x7f84680bfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 -- 172.21.15.153:0/1645364940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c009370 con 0x7f84680a8df0 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f84677fe700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 0x7f84680ab400 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f846000b790 tx=0x7f8460009330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000d500 con 0x7f84680a8df0 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846000d680 con 0x7f84680a8df0 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846000da40 con 0x7f84680a8df0 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.827+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8468168dc0 con 0x7f84680a8df0 2023-08-17T00:16:47.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.831+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8468169380 con 0x7f84680a8df0 2023-08-17T00:16:47.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.831+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8468169570 con 0x7f84680a8df0 2023-08-17T00:16:47.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.831+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8460018030 con 0x7f84680a8df0 2023-08-17T00:16:47.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.831+0000 7f844effd700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f845405a150 0x7f845405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:47.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.831+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f84600739e0 con 0x7f84680a8df0 2023-08-17T00:16:47.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.835+0000 7f8466ffd700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f845405a150 0x7f845405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:47.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.835+0000 7f8466ffd700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f845405a150 0x7f845405c610 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f84680aaca0 tx=0x7f8458006f90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:47.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.839+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8460047500 con 0x7f84680a8df0 2023-08-17T00:16:48.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.995+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f846806b4c0 con 0x7f84680a8df0 2023-08-17T00:16:48.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f844effd700 1 -- 172.21.15.153:0/1645364940 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v180) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8460009430 con 0x7f84680a8df0 2023-08-17T00:16:48.006 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:16:48.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f845405a150 msgr2=0x7f845405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f845405a150 0x7f845405c610 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 rx=0x7f84680aaca0 tx=0x7f8458006f90).stop 2023-08-17T00:16:48.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 msgr2=0x7f84680ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 0x7f84680ab400 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 rx=0x7f846000b790 tx=0x7f8460009330).stop 2023-08-17T00:16:48.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 shutdown_connections 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f845405a150 0x7f845405c610 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f84680a8df0 0x7f84680ab400 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8468068820 0x7f84680aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 --2- 172.21.15.153:0/1645364940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8468061fa0 0x7f84680bfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 >> 172.21.15.153:0/1645364940 conn(0x7f84680c6620 msgr2=0x7f8468157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 shutdown_connections 2023-08-17T00:16:48.010 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:47.999+0000 7f8467fff700 1 -- 172.21.15.153:0/1645364940 wait complete. 2023-08-17T00:16:48.026 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:16:48.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.175+0000 7fd126ce4700 1 Processor -- start 2023-08-17T00:16:48.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.175+0000 7fd126ce4700 1 -- start start 2023-08-17T00:16:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd126ce4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd120068c80 0x7fd1200a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd126ce4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1201585a0 con 0x7fd1200a8df0 2023-08-17T00:16:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd126ce4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd120066400 con 0x7fd120068820 2023-08-17T00:16:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd126ce4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1200c1ba0 con 0x7fd120068c80 2023-08-17T00:16:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd125ce2700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd1200a8df0 0x7fd1200c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50112/0 (socket says 172.21.15.153:50112) 2023-08-17T00:16:48.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd125ce2700 1 -- 172.21.15.153:0/2841622092 learned_addr learned my addr 172.21.15.153:0/2841622092 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd1264e3700 1 --2- 172.21.15.153:0/2841622092 >> v2:172.21.15.178:3300/0 conn(0x7fd120068c80 0x7fd1200a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd124ce0700 1 -- 172.21.15.153:0/2841622092 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749305907 0 0) 0x7fd1201585a0 con 0x7fd1200a8df0 2023-08-17T00:16:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.179+0000 7fd124ce0700 1 -- 172.21.15.153:0/2841622092 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd10c0033f0 con 0x7fd1200a8df0 2023-08-17T00:16:48.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd1264e3700 1 -- 172.21.15.153:0/2841622092 >> v1:172.21.15.178:6789/0 conn(0x7fd120068820 legacy=0x7fd1200a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd1264e3700 1 -- 172.21.15.153:0/2841622092 >> v1:172.21.15.153:6789/0 conn(0x7fd1200a8df0 legacy=0x7fd1200c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd1264e3700 1 -- 172.21.15.153:0/2841622092 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200b9d30 con 0x7fd120068c80 2023-08-17T00:16:48.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd1264e3700 1 --2- 172.21.15.153:0/2841622092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd1200a9de0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fd118009e60 tx=0x7fd118009780).ready entity=mon.1 client_cookie=14c9b9813c3d3ae9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd124ce0700 1 -- 172.21.15.153:0/2841622092 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11800e070 con 0x7fd120068c80 2023-08-17T00:16:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd124ce0700 1 -- 172.21.15.153:0/2841622092 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11800bb60 con 0x7fd120068c80 2023-08-17T00:16:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd124ce0700 1 -- 172.21.15.153:0/2841622092 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118012410 con 0x7fd120068c80 2023-08-17T00:16:48.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 -- 172.21.15.153:0/2841622092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 msgr2=0x7fd1200a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 --2- 172.21.15.153:0/2841622092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd1200a9de0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fd118009e60 tx=0x7fd118009780).stop 2023-08-17T00:16:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 -- 172.21.15.153:0/2841622092 shutdown_connections 2023-08-17T00:16:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 --2- 172.21.15.153:0/2841622092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd1200a9de0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 -- 172.21.15.153:0/2841622092 >> 172.21.15.153:0/2841622092 conn(0x7fd1200c6620 msgr2=0x7fd1200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 -- 172.21.15.153:0/2841622092 shutdown_connections 2023-08-17T00:16:48.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.183+0000 7fd126ce4700 1 -- 172.21.15.153:0/2841622092 wait complete. 2023-08-17T00:16:48.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 Processor -- start 2023-08-17T00:16:48.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 -- start start 2023-08-17T00:16:48.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 0x7fd1200bef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd12015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1200a8df0 0x7fd120157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd120168300 con 0x7fd120068820 2023-08-17T00:16:48.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1201685a0 con 0x7fd120068c80 2023-08-17T00:16:48.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd126ce4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1200bf470 con 0x7fd1200a8df0 2023-08-17T00:16:48.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 0x7fd1200bef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 0x7fd1200bef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33466/0 (socket says 172.21.15.153:33466) 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 -- 172.21.15.153:0/1774103093 learned_addr learned my addr 172.21.15.153:0/1774103093 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd1264e3700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1200a8df0 0x7fd120157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd1254e1700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd12015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 -- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1200a8df0 msgr2=0x7fd120157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1200a8df0 0x7fd120157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 -- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 msgr2=0x7fd12015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.198 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd12015bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.187+0000 7fd125ce2700 1 -- 172.21.15.153:0/1774103093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118009a20 con 0x7fd120068820 2023-08-17T00:16:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd125ce2700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 0x7fd1200bef80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7fd11c0049d0 tx=0x7fd11c007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0072e0 con 0x7fd120068820 2023-08-17T00:16:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c007440 con 0x7fd120068820 2023-08-17T00:16:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1200bf6f0 con 0x7fd120068820 2023-08-17T00:16:48.199 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c0057a0 con 0x7fd120068820 2023-08-17T00:16:48.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1200bfcb0 con 0x7fd120068820 2023-08-17T00:16:48.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1200bfed0 con 0x7fd120068820 2023-08-17T00:16:48.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.191+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd11c010070 con 0x7fd120068820 2023-08-17T00:16:48.201 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.195+0000 7fd115ffb700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd10405a150 0x7fd10405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.195+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fd11c0736d0 con 0x7fd120068820 2023-08-17T00:16:48.202 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.195+0000 7fd1254e1700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd10405a150 0x7fd10405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.195+0000 7fd1254e1700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd10405a150 0x7fd10405c610 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fd1200a8c20 tx=0x7fd110007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.208 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.199+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd11c047140 con 0x7fd120068820 2023-08-17T00:16:48.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.359+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd12006b4c0 con 0x7fd120068820 2023-08-17T00:16:48.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.359+0000 7fd115ffb700 1 -- 172.21.15.153:0/1774103093 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd11c04a760 con 0x7fd120068820 2023-08-17T00:16:48.367 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:16:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd10405a150 msgr2=0x7fd10405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd10405a150 0x7fd10405c610 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 rx=0x7fd1200a8c20 tx=0x7fd110007d40).stop 2023-08-17T00:16:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 msgr2=0x7fd1200bef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 0x7fd1200bef80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 rx=0x7fd11c0049d0 tx=0x7fd11c007c50).stop 2023-08-17T00:16:48.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 shutdown_connections 2023-08-17T00:16:48.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd10405a150 0x7fd10405c610 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd1200a8df0 0x7fd120157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd120068c80 0x7fd12015bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 --2- 172.21.15.153:0/1774103093 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd120068820 0x7fd1200bef80 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 >> 172.21.15.153:0/1774103093 conn(0x7fd1200c6620 msgr2=0x7fd1200a9f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:48.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 shutdown_connections 2023-08-17T00:16:48.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.363+0000 7fd126ce4700 1 -- 172.21.15.153:0/1774103093 wait complete. 2023-08-17T00:16:48.389 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:16:48.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.547+0000 7fca56d46700 1 Processor -- start 2023-08-17T00:16:48.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.547+0000 7fca56d46700 1 -- start start 2023-08-17T00:16:48.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.547+0000 7fca56d46700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca5014fff0 0x7fca50062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.547+0000 7fca56d46700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500a9170 con 0x7fca501503d0 2023-08-17T00:16:48.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.547+0000 7fca56d46700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca500c2e90 con 0x7fca50153da0 2023-08-17T00:16:48.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.547+0000 7fca56d46700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca500c1b90 con 0x7fca5014fff0 2023-08-17T00:16:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca552e3700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fca501503d0 0x7fca500c2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50124/0 (socket says 172.21.15.153:50124) 2023-08-17T00:16:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca552e3700 1 -- 172.21.15.153:0/3167197463 learned_addr learned my addr 172.21.15.153:0/3167197463 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:48.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca54ae2700 1 --2- 172.21.15.153:0/3167197463 >> v2:172.21.15.178:3300/0 conn(0x7fca5014fff0 0x7fca50062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca4f7fe700 1 -- 172.21.15.153:0/3167197463 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470421822 0 0) 0x7fca500a9170 con 0x7fca501503d0 2023-08-17T00:16:48.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca4f7fe700 1 -- 172.21.15.153:0/3167197463 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca400033f0 con 0x7fca501503d0 2023-08-17T00:16:48.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca54ae2700 1 -- 172.21.15.153:0/3167197463 >> v1:172.21.15.178:6789/0 conn(0x7fca50153da0 legacy=0x7fca500c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca4f7fe700 1 -- 172.21.15.153:0/3167197463 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3961196242 0 0) 0x7fca500c2e90 con 0x7fca50153da0 2023-08-17T00:16:48.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca54ae2700 1 -- 172.21.15.153:0/3167197463 >> v1:172.21.15.153:6789/0 conn(0x7fca501503d0 legacy=0x7fca500c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca54ae2700 1 -- 172.21.15.153:0/3167197463 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca50154280 con 0x7fca5014fff0 2023-08-17T00:16:48.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca54ae2700 1 --2- 172.21.15.153:0/3167197463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5014fff0 0x7fca50062970 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fca44009760 tx=0x7fca44009060).ready entity=mon.1 client_cookie=d7470efa1737af93 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca4f7fe700 1 -- 172.21.15.153:0/3167197463 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440090d0 con 0x7fca5014fff0 2023-08-17T00:16:48.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca4f7fe700 1 -- 172.21.15.153:0/3167197463 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400f510 con 0x7fca5014fff0 2023-08-17T00:16:48.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca4f7fe700 1 -- 172.21.15.153:0/3167197463 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400f890 con 0x7fca5014fff0 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca56d46700 1 -- 172.21.15.153:0/3167197463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5014fff0 msgr2=0x7fca50062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca56d46700 1 --2- 172.21.15.153:0/3167197463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5014fff0 0x7fca50062970 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7fca44009760 tx=0x7fca44009060).stop 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca56d46700 1 -- 172.21.15.153:0/3167197463 shutdown_connections 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca56d46700 1 --2- 172.21.15.153:0/3167197463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca5014fff0 0x7fca50062970 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.551+0000 7fca56d46700 1 -- 172.21.15.153:0/3167197463 >> 172.21.15.153:0/3167197463 conn(0x7fca500c7150 msgr2=0x7fca500c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.555+0000 7fca56d46700 1 -- 172.21.15.153:0/3167197463 shutdown_connections 2023-08-17T00:16:48.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.555+0000 7fca56d46700 1 -- 172.21.15.153:0/3167197463 wait complete. 2023-08-17T00:16:48.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.555+0000 7fca56d46700 1 Processor -- start 2023-08-17T00:16:48.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.555+0000 7fca56d46700 1 -- start start 2023-08-17T00:16:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 0x7fca5014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca501503d0 0x7fca50167aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca50153da0 0x7fca50167f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5014b930 con 0x7fca5014fff0 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca500ab580 con 0x7fca50153da0 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca5014ae30 con 0x7fca501503d0 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 0x7fca5014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 0x7fca5014a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33478/0 (socket says 172.21.15.153:33478) 2023-08-17T00:16:48.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 -- 172.21.15.153:0/2997289471 learned_addr learned my addr 172.21.15.153:0/2997289471 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca4ffff700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca501503d0 0x7fca50167aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca552e3700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca50153da0 0x7fca50167f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 -- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca501503d0 msgr2=0x7fca50167aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca501503d0 0x7fca50167aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 -- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca50153da0 msgr2=0x7fca50167f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca50153da0 0x7fca50167f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 -- 172.21.15.153:0/2997289471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440092a0 con 0x7fca5014fff0 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca552e3700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca50153da0 0x7fca50167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca54ae2700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 0x7fca5014a940 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7fca44009e00 tx=0x7fca44017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca44006990 con 0x7fca5014fff0 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400fc50 con 0x7fca5014fff0 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4401b440 con 0x7fca5014fff0 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca500aa7c0 con 0x7fca5014fff0 2023-08-17T00:16:48.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.559+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca500aad80 con 0x7fca5014fff0 2023-08-17T00:16:48.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.563+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5006b530 con 0x7fca5014fff0 2023-08-17T00:16:48.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.563+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fca4402a070 con 0x7fca5014fff0 2023-08-17T00:16:48.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.563+0000 7fca4cff9700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca3405a180 0x7fca3405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.563+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fca440755d0 con 0x7fca5014fff0 2023-08-17T00:16:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.563+0000 7fca4ffff700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca3405a180 0x7fca3405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.567+0000 7fca4ffff700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca3405a180 0x7fca3405c640 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fca500abf10 tx=0x7fca3c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.571+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fca44049040 con 0x7fca5014fff0 2023-08-17T00:16:48.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.735+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca500630b0 con 0x7fca5014fff0 2023-08-17T00:16:48.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.735+0000 7fca4cff9700 1 -- 172.21.15.153:0/2997289471 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca44028020 con 0x7fca5014fff0 2023-08-17T00:16:48.743 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:16:48.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca3405a180 msgr2=0x7fca3405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca3405a180 0x7fca3405c640 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 rx=0x7fca500abf10 tx=0x7fca3c009040).stop 2023-08-17T00:16:48.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 msgr2=0x7fca5014a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 0x7fca5014a940 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 rx=0x7fca44009e00 tx=0x7fca44017000).stop 2023-08-17T00:16:48.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 shutdown_connections 2023-08-17T00:16:48.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fca3405a180 0x7fca3405c640 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca50153da0 0x7fca50167f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca501503d0 0x7fca50167aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 --2- 172.21.15.153:0/2997289471 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fca5014fff0 0x7fca5014a940 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 >> 172.21.15.153:0/2997289471 conn(0x7fca500c7150 msgr2=0x7fca500bb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:48.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 shutdown_connections 2023-08-17T00:16:48.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.739+0000 7fca56d46700 1 -- 172.21.15.153:0/2997289471 wait complete. 2023-08-17T00:16:48.768 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:16:48.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 Processor -- start 2023-08-17T00:16:48.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 -- start start 2023-08-17T00:16:48.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda2c0a89c0 0x7fda2c0a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fda2c1505d0 0x7fda2c150a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda2c0bc0b0 con 0x7fda2c0c0c80 2023-08-17T00:16:48.943 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c0bd590 con 0x7fda2c0a89c0 2023-08-17T00:16:48.944 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda3181b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda2c062fb0 con 0x7fda2c1505d0 2023-08-17T00:16:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda2c0a89c0 0x7fda2c0a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fda2c0a89c0 0x7fda2c0a8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33480/0 (socket says 172.21.15.153:33480) 2023-08-17T00:16:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 -- 172.21.15.153:0/4197133340 learned_addr learned my addr 172.21.15.153:0/4197133340 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 -- 172.21.15.153:0/4197133340 >> v2:172.21.15.178:3300/0 conn(0x7fda2c1505d0 msgr2=0x7fda2c150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:48.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2b7fe700 1 --2- 172.21.15.153:0/4197133340 >> v2:172.21.15.178:3300/0 conn(0x7fda2c1505d0 0x7fda2c150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 --2- 172.21.15.153:0/4197133340 >> v2:172.21.15.178:3300/0 conn(0x7fda2c1505d0 0x7fda2c150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 -- 172.21.15.153:0/4197133340 >> v1:172.21.15.153:6789/0 conn(0x7fda2c0c0c80 legacy=0x7fda2c0bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 -- 172.21.15.153:0/4197133340 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0bb780 con 0x7fda2c0a89c0 2023-08-17T00:16:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2b7fe700 1 --2- 172.21.15.153:0/4197133340 >> v2:172.21.15.178:3300/0 conn(0x7fda2c1505d0 0x7fda2c150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:48.946 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2affd700 1 --2- 172.21.15.153:0/4197133340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0a8da0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7fda2c0c1110 tx=0x7fda1c009840).ready entity=mon.0 client_cookie=939cc92ee647978b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.935+0000 7fda2a7fc700 1 -- 172.21.15.153:0/4197133340 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00e070 con 0x7fda2c0a89c0 2023-08-17T00:16:48.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda2a7fc700 1 -- 172.21.15.153:0/4197133340 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c00ba50 con 0x7fda2c0a89c0 2023-08-17T00:16:48.947 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda2a7fc700 1 -- 172.21.15.153:0/4197133340 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c00bdd0 con 0x7fda2c0a89c0 2023-08-17T00:16:48.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 -- 172.21.15.153:0/4197133340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c0a89c0 msgr2=0x7fda2c0a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 --2- 172.21.15.153:0/4197133340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0a8da0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 rx=0x7fda2c0c1110 tx=0x7fda1c009840).stop 2023-08-17T00:16:48.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 -- 172.21.15.153:0/4197133340 shutdown_connections 2023-08-17T00:16:48.948 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 --2- 172.21.15.153:0/4197133340 >> v2:172.21.15.178:3300/0 conn(0x7fda2c1505d0 0x7fda2c150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 --2- 172.21.15.153:0/4197133340 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0a8da0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 -- 172.21.15.153:0/4197133340 >> 172.21.15.153:0/4197133340 conn(0x7fda2c0c7150 msgr2=0x7fda2c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 -- 172.21.15.153:0/4197133340 shutdown_connections 2023-08-17T00:16:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 -- 172.21.15.153:0/4197133340 wait complete. 2023-08-17T00:16:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 Processor -- start 2023-08-17T00:16:48.949 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.939+0000 7fda3181b700 1 -- start start 2023-08-17T00:16:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2c0c0c80 0x7fda2c1436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.951 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 0x7fda2c167d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c09f450 con 0x7fda2c1505d0 2023-08-17T00:16:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c155530 con 0x7fda2c0a89c0 2023-08-17T00:16:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda2c0c62b0 con 0x7fda2c0c0c80 2023-08-17T00:16:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 0x7fda2c167d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 0x7fda2c167d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33488/0 (socket says 172.21.15.153:33488) 2023-08-17T00:16:48.952 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 -- 172.21.15.153:0/3385574082 learned_addr learned my addr 172.21.15.153:0/3385574082 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2affd700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda23fff700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2c0c0c80 0x7fda2c1436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 -- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2c0c0c80 msgr2=0x7fda2c1436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2c0c0c80 0x7fda2c1436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 -- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2c0a89c0 msgr2=0x7fda2c0c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:48.953 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 -- 172.21.15.153:0/3385574082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c009ae0 con 0x7fda2c1505d0 2023-08-17T00:16:48.954 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda2b7fe700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 0x7fda2c167d70 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7fda2400c680 tx=0x7fda24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24010580 con 0x7fda2c1505d0 2023-08-17T00:16:48.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda240106e0 con 0x7fda2c1505d0 2023-08-17T00:16:48.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2c09f6a0 con 0x7fda2c1505d0 2023-08-17T00:16:48.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24010a60 con 0x7fda2c1505d0 2023-08-17T00:16:48.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.943+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2c154ee0 con 0x7fda2c1505d0 2023-08-17T00:16:48.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.947+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2c1556c0 con 0x7fda2c1505d0 2023-08-17T00:16:48.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.947+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fda2401b460 con 0x7fda2c1505d0 2023-08-17T00:16:48.957 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.947+0000 7fda22ffd700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0c05a180 0x7fda0c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:48.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.947+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fda24074310 con 0x7fda2c1505d0 2023-08-17T00:16:48.958 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.951+0000 7fda2affd700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0c05a180 0x7fda0c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:48.959 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.951+0000 7fda2affd700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0c05a180 0x7fda0c05c640 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fda2c0c1110 tx=0x7fda1c009840).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:48.963 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:48.955+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fda24047c10 con 0x7fda2c1505d0 2023-08-17T00:16:49.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.115+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fda2c0bba60 con 0x7fda2c1505d0 2023-08-17T00:16:49.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.115+0000 7fda22ffd700 1 -- 172.21.15.153:0/3385574082 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7fda2404b230 con 0x7fda2c1505d0 2023-08-17T00:16:49.125 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:16:49.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0c05a180 msgr2=0x7fda0c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0c05a180 0x7fda0c05c640 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 rx=0x7fda2c0c1110 tx=0x7fda1c009840).stop 2023-08-17T00:16:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 msgr2=0x7fda2c167d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 0x7fda2c167d70 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 rx=0x7fda2400c680 tx=0x7fda24008040).stop 2023-08-17T00:16:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 shutdown_connections 2023-08-17T00:16:49.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fda0c05a180 0x7fda0c05c640 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fda2c1505d0 0x7fda2c167d70 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fda2c0c0c80 0x7fda2c1436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 --2- 172.21.15.153:0/3385574082 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fda2c0a89c0 0x7fda2c0c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 >> 172.21.15.153:0/3385574082 conn(0x7fda2c0c7150 msgr2=0x7fda2c0abae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 shutdown_connections 2023-08-17T00:16:49.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.119+0000 7fda3181b700 1 -- 172.21.15.153:0/3385574082 wait complete. 2023-08-17T00:16:49.150 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:49.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 Processor -- start 2023-08-17T00:16:49.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 -- start start 2023-08-17T00:16:49.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4e880bb470 0x7f4e880c2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e88061fa0 0x7f4e880a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e88151a40 con 0x7f4e880a56e0 2023-08-17T00:16:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e880647c0 con 0x7f4e880bb470 2023-08-17T00:16:49.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e8da5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880649d0 con 0x7f4e88061fa0 2023-08-17T00:16:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.295+0000 7f4e86ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4e880a56e0 0x7f4e880c20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50142/0 (socket says 172.21.15.153:50142) 2023-08-17T00:16:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e86ffd700 1 -- 172.21.15.153:0/3000055742 learned_addr learned my addr 172.21.15.153:0/3000055742 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e877fe700 1 --2- 172.21.15.153:0/3000055742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e88061fa0 0x7f4e880a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e867fc700 1 --2- 172.21.15.153:0/3000055742 >> v2:172.21.15.178:3300/0 conn(0x7f4e880bb470 0x7f4e880c2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e85ffb700 1 -- 172.21.15.153:0/3000055742 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336212324 0 0) 0x7f4e88151a40 con 0x7f4e880a56e0 2023-08-17T00:16:49.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e85ffb700 1 -- 172.21.15.153:0/3000055742 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e700033f0 con 0x7f4e880a56e0 2023-08-17T00:16:49.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e85ffb700 1 -- 172.21.15.153:0/3000055742 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1940494352 0 0) 0x7f4e700033f0 con 0x7f4e880a56e0 2023-08-17T00:16:49.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e877fe700 1 -- 172.21.15.153:0/3000055742 >> v2:172.21.15.178:3300/0 conn(0x7f4e880bb470 msgr2=0x7f4e880c2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:49.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e877fe700 1 --2- 172.21.15.153:0/3000055742 >> v2:172.21.15.178:3300/0 conn(0x7f4e880bb470 0x7f4e880c2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e877fe700 1 -- 172.21.15.153:0/3000055742 >> v1:172.21.15.153:6789/0 conn(0x7f4e880a56e0 legacy=0x7f4e880c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e877fe700 1 -- 172.21.15.153:0/3000055742 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88064cb0 con 0x7f4e88061fa0 2023-08-17T00:16:49.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e867fc700 1 --2- 172.21.15.153:0/3000055742 >> v2:172.21.15.178:3300/0 conn(0x7f4e880bb470 0x7f4e880c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:49.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e877fe700 1 --2- 172.21.15.153:0/3000055742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e88061fa0 0x7f4e880a5ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f4e80009e60 tx=0x7f4e80009780).ready entity=mon.2 client_cookie=6c33a804b5ea9608 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:49.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e85ffb700 1 -- 172.21.15.153:0/3000055742 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000e070 con 0x7f4e88061fa0 2023-08-17T00:16:49.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e85ffb700 1 -- 172.21.15.153:0/3000055742 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000b7a0 con 0x7f4e88061fa0 2023-08-17T00:16:49.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e85ffb700 1 -- 172.21.15.153:0/3000055742 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78001470 con 0x7f4e88061fa0 2023-08-17T00:16:49.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3000055742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e88061fa0 msgr2=0x7f4e880a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3000055742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e88061fa0 0x7f4e880a5ac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f4e80009e60 tx=0x7f4e80009780).stop 2023-08-17T00:16:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3000055742 shutdown_connections 2023-08-17T00:16:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3000055742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e88061fa0 0x7f4e880a5ac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3000055742 >> v2:172.21.15.178:3300/0 conn(0x7f4e880bb470 0x7f4e880c2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.299+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3000055742 >> 172.21.15.153:0/3000055742 conn(0x7f4e880c2fb0 msgr2=0x7f4e880c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.303+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3000055742 shutdown_connections 2023-08-17T00:16:49.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.303+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3000055742 wait complete. 2023-08-17T00:16:49.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.303+0000 7f4e8da5b700 1 Processor -- start 2023-08-17T00:16:49.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 -- start start 2023-08-17T00:16:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 0x7f4e8813dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e880a56e0 0x7f4e880c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e880bb470 0x7f4e880c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880c4d20 con 0x7f4e88061fa0 2023-08-17T00:16:49.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88165480 con 0x7f4e880a56e0 2023-08-17T00:16:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e880c5610 con 0x7f4e880bb470 2023-08-17T00:16:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 0x7f4e8813dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 0x7f4e8813dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33494/0 (socket says 172.21.15.153:33494) 2023-08-17T00:16:49.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 -- 172.21.15.153:0/3156168768 learned_addr learned my addr 172.21.15.153:0/3156168768 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e867fc700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e880a56e0 0x7f4e880c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e877fe700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e880bb470 0x7f4e880c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 -- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e880bb470 msgr2=0x7f4e880c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e880bb470 0x7f4e880c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 -- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e880a56e0 msgr2=0x7f4e880c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e880a56e0 0x7f4e880c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 -- 172.21.15.153:0/3156168768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7c0092a0 con 0x7f4e88061fa0 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e877fe700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e880bb470 0x7f4e880c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e86ffd700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 0x7f4e8813dfd0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f4e7800c810 tx=0x7f4e78001ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:49.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e78007170 con 0x7f4e88061fa0 2023-08-17T00:16:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e780072d0 con 0x7f4e88061fa0 2023-08-17T00:16:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e80009a20 con 0x7f4e88061fa0 2023-08-17T00:16:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e780048c0 con 0x7f4e88061fa0 2023-08-17T00:16:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.307+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e88164870 con 0x7f4e88061fa0 2023-08-17T00:16:49.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.311+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8806b4c0 con 0x7f4e88061fa0 2023-08-17T00:16:49.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.311+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4e7801b060 con 0x7f4e88061fa0 2023-08-17T00:16:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.311+0000 7f4e6effd700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e7405a180 0x7f4e7405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.315+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f4e78073c10 con 0x7f4e88061fa0 2023-08-17T00:16:49.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.315+0000 7f4e867fc700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e7405a180 0x7f4e7405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.315+0000 7f4e867fc700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e7405a180 0x7f4e7405c640 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f4e7c006d80 tx=0x7f4e7c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:49.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.319+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4e78047680 con 0x7f4e88061fa0 2023-08-17T00:16:49.535 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.527+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e8805e300 con 0x7f4e88061fa0 2023-08-17T00:16:49.536 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.527+0000 7f4e6effd700 1 -- 172.21.15.153:0/3156168768 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f4e78019030 con 0x7f4e88061fa0 2023-08-17T00:16:49.537 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:49.537 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":138,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:16:37.314463+0000","modified":"2023-08-17T00:16:49.414139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"a","rank":0,"incarnation":134,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/935397889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":935397889},{"type":"v1","addr":"172.21.15.153:6835","nonce":935397889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-08-17T00:16:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e7405a180 msgr2=0x7f4e7405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e7405a180 0x7f4e7405c640 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 rx=0x7f4e7c006d80 tx=0x7f4e7c008040).stop 2023-08-17T00:16:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 msgr2=0x7f4e8813dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.541 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 0x7f4e8813dfd0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 rx=0x7f4e7800c810 tx=0x7f4e78001ab0).stop 2023-08-17T00:16:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 shutdown_connections 2023-08-17T00:16:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4e7405a180 0x7f4e7405c640 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e880bb470 0x7f4e880c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e880a56e0 0x7f4e880c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 --2- 172.21.15.153:0/3156168768 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4e88061fa0 0x7f4e8813dfd0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.542 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.531+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 >> 172.21.15.153:0/3156168768 conn(0x7f4e880c2fb0 msgr2=0x7f4e880687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.535+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 shutdown_connections 2023-08-17T00:16:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.535+0000 7f4e8da5b700 1 -- 172.21.15.153:0/3156168768 wait complete. 2023-08-17T00:16:49.543 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 138 2023-08-17T00:16:49.562 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:49.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.703+0000 7f2495df9700 1 Processor -- start 2023-08-17T00:16:49.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2495df9700 1 -- start start 2023-08-17T00:16:49.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2495df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 0x7f24901560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2495df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2490065da0 con 0x7f2490068da0 2023-08-17T00:16:49.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2495df9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2490155c60 con 0x7f24900689c0 2023-08-17T00:16:49.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2495df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2490069200 con 0x7f2490151c40 2023-08-17T00:16:49.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2487fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2490068da0 0x7f2490151530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50144/0 (socket says 172.21.15.153:50144) 2023-08-17T00:16:49.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f2487fff700 1 -- 172.21.15.153:0/3093703241 learned_addr learned my addr 172.21.15.153:0/3093703241 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:49.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24955f8700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 0x7f24901560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962512910 0 0) 0x7f2490065da0 con 0x7f2490068da0 2023-08-17T00:16:49.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24780033f0 con 0x7f2490068da0 2023-08-17T00:16:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697591588 0 0) 0x7f2490155c60 con 0x7f24900689c0 2023-08-17T00:16:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2490065da0 con 0x7f24900689c0 2023-08-17T00:16:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481731874 0 0) 0x7f24780033f0 con 0x7f2490068da0 2023-08-17T00:16:49.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 msgr2=0x7f24901560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 0x7f24901560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 >> v1:172.21.15.178:6789/0 conn(0x7f24900689c0 legacy=0x7f24900c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2490065ff0 con 0x7f2490068da0 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.707+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f2480001470 con 0x7f2490068da0 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 >> v1:172.21.15.153:6789/0 conn(0x7f2490068da0 legacy=0x7f2490151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2478003aa0 0x7f2478003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 0x7f2478004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2478004b80 0x7f2478005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2490069200 con 0x7f2478004b80 2023-08-17T00:16:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247800b9c0 con 0x7f2478003aa0 2023-08-17T00:16:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247800bb80 con 0x7f2490151c40 2023-08-17T00:16:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2478004b80 0x7f2478005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2487fff700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 0x7f2478004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2494df7700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2478003aa0 0x7f2478003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 -- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 msgr2=0x7f2478004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2490151c40 0x7f2478004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 -- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2478003aa0 msgr2=0x7f2478003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2478003aa0 0x7f2478003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 -- 172.21.15.153:0/3093703241 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24780033f0 con 0x7f2478004b80 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2478004b80 0x7f2478005000 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f248800e210 tx=0x7f248800b040).ready entity=mon.0 client_cookie=cb989f1c738cf511 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488009ac0 con 0x7f2478004b80 2023-08-17T00:16:49.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248800f040 con 0x7f2478004b80 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24877fe700 1 -- 172.21.15.153:0/3093703241 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800ecd0 con 0x7f2478004b80 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2495df9700 1 -- 172.21.15.153:0/3093703241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2478004b80 msgr2=0x7f2478005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2495df9700 1 --2- 172.21.15.153:0/3093703241 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2478004b80 0x7f2478005000 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 rx=0x7f248800e210 tx=0x7f248800b040).stop 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f24955f8700 1 -- 172.21.15.153:0/3093703241 reap_dead start 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2495df9700 1 -- 172.21.15.153:0/3093703241 shutdown_connections 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2495df9700 1 -- 172.21.15.153:0/3093703241 >> 172.21.15.153:0/3093703241 conn(0x7f24900c6620 msgr2=0x7f24900c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2495df9700 1 -- 172.21.15.153:0/3093703241 shutdown_connections 2023-08-17T00:16:49.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.711+0000 7f2495df9700 1 -- 172.21.15.153:0/3093703241 wait complete. 2023-08-17T00:16:49.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.715+0000 7f2495df9700 1 Processor -- start 2023-08-17T00:16:49.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.715+0000 7f2495df9700 1 -- start start 2023-08-17T00:16:49.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 0x7f2490162a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24900a1550 0x7f24900a4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24900a4680 0x7f2490165610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900a34e0 con 0x7f24900a1170 2023-08-17T00:16:49.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24900a4b00 con 0x7f24900a1550 2023-08-17T00:16:49.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2490162f70 con 0x7f24900a4680 2023-08-17T00:16:49.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 0x7f2490162a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 0x7f2490162a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33514/0 (socket says 172.21.15.153:33514) 2023-08-17T00:16:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 -- 172.21.15.153:0/1986009128 learned_addr learned my addr 172.21.15.153:0/1986009128 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 -- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24900a4680 msgr2=0x7f2490165610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24900a4680 0x7f2490165610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 -- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24900a1550 msgr2=0x7f24900a4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24900a1550 0x7f24900a4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 -- 172.21.15.153:0/1986009128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900a28d0 con 0x7f24900a1170 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2494df7700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 0x7f2490162a80 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f248c002a40 tx=0x7f248c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00f8d0 con 0x7f24900a1170 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248c00fa30 con 0x7f24900a1170 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24900a2bb0 con 0x7f24900a1170 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248c00fdb0 con 0x7f24900a1170 2023-08-17T00:16:49.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24900a3170 con 0x7f24900a1170 2023-08-17T00:16:49.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.719+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24900a3330 con 0x7f24900a1170 2023-08-17T00:16:49.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.723+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f248c01b030 con 0x7f24900a1170 2023-08-17T00:16:49.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.723+0000 7f2484ff9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f247c05a150 0x7f247c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:49.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.723+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f248c074830 con 0x7f24900a1170 2023-08-17T00:16:49.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.723+0000 7f2487fff700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f247c05a150 0x7f247c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:49.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.727+0000 7f2487fff700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f247c05a150 0x7f247c05c610 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f2480000e10 tx=0x7f2480001e10).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:49.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.727+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f248c0482c0 con 0x7f24900a1170 2023-08-17T00:16:49.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.883+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2490065720 con 0x7f24900a1170 2023-08-17T00:16:49.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2484ff9700 1 -- 172.21.15.153:0/1986009128 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f2490065720 con 0x7f24900a1170 2023-08-17T00:16:49.894 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:49.894 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":180,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:42.423611+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:16:35.234407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-17T00:16:36.324685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.f","mappings":[{"from":7,"to":3}]},{"pgid":"25.2a","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:49.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f247c05a150 msgr2=0x7f247c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f247c05a150 0x7f247c05c610 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 rx=0x7f2480000e10 tx=0x7f2480001e10).stop 2023-08-17T00:16:49.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 msgr2=0x7f2490162a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:49.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 0x7f2490162a80 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 rx=0x7f248c002a40 tx=0x7f248c007c00).stop 2023-08-17T00:16:49.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 shutdown_connections 2023-08-17T00:16:49.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f247c05a150 0x7f247c05c610 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24900a4680 0x7f2490165610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:49.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24900a1550 0x7f24900a4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:49.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 --2- 172.21.15.153:0/1986009128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f24900a1170 0x7f2490162a80 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:49.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 >> 172.21.15.153:0/1986009128 conn(0x7f24900c6620 msgr2=0x7f24900c5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:49.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 shutdown_connections 2023-08-17T00:16:49.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:49.887+0000 7f2495df9700 1 -- 172.21.15.153:0/1986009128 wait complete. 2023-08-17T00:16:49.918 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:16:49.918 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:50.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 Processor -- start 2023-08-17T00:16:50.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 -- start start 2023-08-17T00:16:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f240a8b70 0x7f9f240632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f240a8f50 0x7f9f240629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f24065240 con 0x7f9f240656d0 2023-08-17T00:16:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f24062ea0 con 0x7f9f240a8b70 2023-08-17T00:16:50.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.071+0000 7f9f2bc5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f240638a0 con 0x7f9f240a8f50 2023-08-17T00:16:50.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2a1f8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9f240656d0 0x7f9f240bbdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50154/0 (socket says 172.21.15.153:50154) 2023-08-17T00:16:50.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2a1f8700 1 -- 172.21.15.153:0/2398433213 learned_addr learned my addr 172.21.15.153:0/2398433213 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:50.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f299f7700 1 --2- 172.21.15.153:0/2398433213 >> v2:172.21.15.153:3300/0 conn(0x7f9f240a8b70 0x7f9f240632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f291f6700 1 --2- 172.21.15.153:0/2398433213 >> v2:172.21.15.178:3300/0 conn(0x7f9f240a8f50 0x7f9f240629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f289f5700 1 -- 172.21.15.153:0/2398433213 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693722251 0 0) 0x7f9f24065240 con 0x7f9f240656d0 2023-08-17T00:16:50.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f289f5700 1 -- 172.21.15.153:0/2398433213 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f100033f0 con 0x7f9f240656d0 2023-08-17T00:16:50.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f299f7700 1 -- 172.21.15.153:0/2398433213 >> v2:172.21.15.178:3300/0 conn(0x7f9f240a8f50 msgr2=0x7f9f240629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:50.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f299f7700 1 --2- 172.21.15.153:0/2398433213 >> v2:172.21.15.178:3300/0 conn(0x7f9f240a8f50 0x7f9f240629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f299f7700 1 -- 172.21.15.153:0/2398433213 >> v1:172.21.15.153:6789/0 conn(0x7f9f240656d0 legacy=0x7f9f240bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f299f7700 1 -- 172.21.15.153:0/2398433213 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24064910 con 0x7f9f240a8b70 2023-08-17T00:16:50.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f299f7700 1 --2- 172.21.15.153:0/2398433213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240a8b70 0x7f9f240632e0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f9f24069d30 tx=0x7f9f20009060).ready entity=mon.0 client_cookie=a71a51b2456c6c0c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f289f5700 1 -- 172.21.15.153:0/2398433213 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000d4a0 con 0x7f9f240a8b70 2023-08-17T00:16:50.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f289f5700 1 -- 172.21.15.153:0/2398433213 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2000d600 con 0x7f9f240a8b70 2023-08-17T00:16:50.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f289f5700 1 -- 172.21.15.153:0/2398433213 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000d980 con 0x7f9f240a8b70 2023-08-17T00:16:50.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2398433213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240a8b70 msgr2=0x7f9f240632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2398433213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240a8b70 0x7f9f240632e0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 rx=0x7f9f24069d30 tx=0x7f9f20009060).stop 2023-08-17T00:16:50.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2398433213 shutdown_connections 2023-08-17T00:16:50.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2398433213 >> v2:172.21.15.178:3300/0 conn(0x7f9f240a8f50 0x7f9f240629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2398433213 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240a8b70 0x7f9f240632e0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2398433213 >> 172.21.15.153:0/2398433213 conn(0x7f9f240c7150 msgr2=0x7f9f240c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:50.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2398433213 shutdown_connections 2023-08-17T00:16:50.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.075+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2398433213 wait complete. 2023-08-17T00:16:50.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.079+0000 7f9f2bc5b700 1 Processor -- start 2023-08-17T00:16:50.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.079+0000 7f9f2bc5b700 1 -- start start 2023-08-17T00:16:50.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 0x7f9f240bef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f240a8b70 0x7f9f2414dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f240a8f50 0x7f9f240a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c0570 con 0x7f9f240656d0 2023-08-17T00:16:50.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240beae0 con 0x7f9f240a8f50 2023-08-17T00:16:50.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2414e1f0 con 0x7f9f240a8b70 2023-08-17T00:16:50.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 0x7f9f240bef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 0x7f9f240bef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33518/0 (socket says 172.21.15.153:33518) 2023-08-17T00:16:50.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 -- 172.21.15.153:0/2873448933 learned_addr learned my addr 172.21.15.153:0/2873448933 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f291f6700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f240a8b70 0x7f9f2414dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2a1f8700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f240a8f50 0x7f9f240a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 -- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f240a8b70 msgr2=0x7f9f2414dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f240a8b70 0x7f9f2414dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 -- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f240a8f50 msgr2=0x7f9f240a9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f240a8f50 0x7f9f240a9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 -- 172.21.15.153:0/2873448933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200092a0 con 0x7f9f240656d0 2023-08-17T00:16:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2a1f8700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f240a8f50 0x7f9f240a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:50.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f299f7700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 0x7f9f240bef70 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f9f20009d20 tx=0x7f9f20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000dd40 con 0x7f9f240656d0 2023-08-17T00:16:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2000d770 con 0x7f9f240656d0 2023-08-17T00:16:50.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f240c0290 con 0x7f9f240656d0 2023-08-17T00:16:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2000dea0 con 0x7f9f240656d0 2023-08-17T00:16:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.083+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f240be770 con 0x7f9f240656d0 2023-08-17T00:16:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.087+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2406b530 con 0x7f9f240656d0 2023-08-17T00:16:50.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.087+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9f2000f070 con 0x7f9f240656d0 2023-08-17T00:16:50.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.091+0000 7f9f19ffb700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f0805a150 0x7f9f0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.091+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f9f200757a0 con 0x7f9f240656d0 2023-08-17T00:16:50.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.091+0000 7f9f291f6700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f0805a150 0x7f9f0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.091+0000 7f9f291f6700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f0805a150 0x7f9f0805c610 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f9f241583c0 tx=0x7f9f14009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.095+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f20049100 con 0x7f9f240656d0 2023-08-17T00:16:50.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f24064bf0 con 0x7f9f240656d0 2023-08-17T00:16:50.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f19ffb700 1 -- 172.21.15.153:0/2873448933 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) v1 ==== 95+0+4505 (secure 0 0 0) 0x7f9f2004c720 con 0x7f9f240656d0 2023-08-17T00:16:50.303 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:50.303 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":138,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:16:37.314463+0000","modified":"2023-08-17T00:16:49.414139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"a","rank":0,"incarnation":134,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/935397889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":935397889},{"type":"v1","addr":"172.21.15.153:6835","nonce":935397889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-08-17T00:16:50.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f0805a150 msgr2=0x7f9f0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.305 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f0805a150 0x7f9f0805c610 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f9f241583c0 tx=0x7f9f14009060).stop 2023-08-17T00:16:50.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 msgr2=0x7f9f240bef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 0x7f9f240bef70 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 rx=0x7f9f20009d20 tx=0x7f9f20016000).stop 2023-08-17T00:16:50.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 shutdown_connections 2023-08-17T00:16:50.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f0805a150 0x7f9f0805c610 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f240a8f50 0x7f9f240a9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f240a8b70 0x7f9f2414dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 --2- 172.21.15.153:0/2873448933 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f240656d0 0x7f9f240bef70 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.295+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 >> 172.21.15.153:0/2873448933 conn(0x7f9f240c7150 msgr2=0x7f9f240c1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.299+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 shutdown_connections 2023-08-17T00:16:50.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.299+0000 7f9f2bc5b700 1 -- 172.21.15.153:0/2873448933 wait complete. 2023-08-17T00:16:50.309 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 138 2023-08-17T00:16:50.326 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:50.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.471+0000 7fd488d07700 1 Processor -- start 2023-08-17T00:16:50.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.471+0000 7fd488d07700 1 -- start start 2023-08-17T00:16:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd488d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd484068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd488d07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd484151530 0x7fd4841519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd488d07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd484065da0 con 0x7fd4841560f0 2023-08-17T00:16:50.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd488d07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd484155c60 con 0x7fd484151530 2023-08-17T00:16:50.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd488d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd484156550 con 0x7fd4840689c0 2023-08-17T00:16:50.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd482ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd4841560f0 0x7fd4840c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50166/0 (socket says 172.21.15.153:50166) 2023-08-17T00:16:50.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd482ffd700 1 -- 172.21.15.153:0/4052505377 learned_addr learned my addr 172.21.15.153:0/4052505377 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:50.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd4837fe700 1 --2- 172.21.15.153:0/4052505377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd484068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd483fff700 1 --2- 172.21.15.153:0/4052505377 >> v2:172.21.15.153:3300/0 conn(0x7fd484151530 0x7fd4841519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd4827fc700 1 -- 172.21.15.153:0/4052505377 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152031803 0 0) 0x7fd484065da0 con 0x7fd4841560f0 2023-08-17T00:16:50.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd4827fc700 1 -- 172.21.15.153:0/4052505377 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd46c0033f0 con 0x7fd4841560f0 2023-08-17T00:16:50.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd483fff700 1 -- 172.21.15.153:0/4052505377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 msgr2=0x7fd484068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd483fff700 1 --2- 172.21.15.153:0/4052505377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd484068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd483fff700 1 -- 172.21.15.153:0/4052505377 >> v1:172.21.15.153:6789/0 conn(0x7fd4841560f0 legacy=0x7fd4840c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.475+0000 7fd483fff700 1 -- 172.21.15.153:0/4052505377 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484065ff0 con 0x7fd484151530 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd483fff700 1 --2- 172.21.15.153:0/4052505377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd484151530 0x7fd4841519e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fd47c009e90 tx=0x7fd47c009780).ready entity=mon.0 client_cookie=873197e7f513f748 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd4827fc700 1 -- 172.21.15.153:0/4052505377 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00e070 con 0x7fd484151530 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd4827fc700 1 -- 172.21.15.153:0/4052505377 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00ba70 con 0x7fd484151530 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd4827fc700 1 -- 172.21.15.153:0/4052505377 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c00bdf0 con 0x7fd484151530 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 -- 172.21.15.153:0/4052505377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd484151530 msgr2=0x7fd4841519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 --2- 172.21.15.153:0/4052505377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd484151530 0x7fd4841519e0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 rx=0x7fd47c009e90 tx=0x7fd47c009780).stop 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 -- 172.21.15.153:0/4052505377 shutdown_connections 2023-08-17T00:16:50.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 --2- 172.21.15.153:0/4052505377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd484151530 0x7fd4841519e0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 --2- 172.21.15.153:0/4052505377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd484068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 -- 172.21.15.153:0/4052505377 >> 172.21.15.153:0/4052505377 conn(0x7fd4840c6620 msgr2=0x7fd4840c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 -- 172.21.15.153:0/4052505377 shutdown_connections 2023-08-17T00:16:50.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 -- 172.21.15.153:0/4052505377 wait complete. 2023-08-17T00:16:50.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 Processor -- start 2023-08-17T00:16:50.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.479+0000 7fd488d07700 1 -- start start 2023-08-17T00:16:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd4841468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd484151530 0x7fd4840645a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 0x7fd484064a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd484064f80 con 0x7fd4841560f0 2023-08-17T00:16:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd484151f60 con 0x7fd484151530 2023-08-17T00:16:50.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4840bac80 con 0x7fd4840689c0 2023-08-17T00:16:50.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 0x7fd484064a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 0x7fd484064a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33530/0 (socket says 172.21.15.153:33530) 2023-08-17T00:16:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 -- 172.21.15.153:0/3760479592 learned_addr learned my addr 172.21.15.153:0/3760479592 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd4837fe700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd4841468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd482ffd700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd484151530 0x7fd4840645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 -- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 msgr2=0x7fd4841468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd4841468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 -- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd484151530 msgr2=0x7fd4840645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd484151530 0x7fd4840645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 -- 172.21.15.153:0/3760479592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c009a20 con 0x7fd4841560f0 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd482ffd700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd484151530 0x7fd4840645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd483fff700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 0x7fd484064a90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fd47c00b610 tx=0x7fd47c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c01d630 con 0x7fd4841560f0 2023-08-17T00:16:50.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c01d790 con 0x7fd4841560f0 2023-08-17T00:16:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4840baf60 con 0x7fd4841560f0 2023-08-17T00:16:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c01db10 con 0x7fd4841560f0 2023-08-17T00:16:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.483+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd484151bf0 con 0x7fd4841560f0 2023-08-17T00:16:50.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.487+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48406b4c0 con 0x7fd4841560f0 2023-08-17T00:16:50.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.487+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd47c027460 con 0x7fd4841560f0 2023-08-17T00:16:50.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.487+0000 7fd46b7fe700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd47005a150 0x7fd47005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.487+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fd47c0764c0 con 0x7fd4841560f0 2023-08-17T00:16:50.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.487+0000 7fd4837fe700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd47005a150 0x7fd47005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.491+0000 7fd4837fe700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd47005a150 0x7fd47005c610 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fd474006fd0 tx=0x7fd474006f40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.495+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd47c049dc0 con 0x7fd4841560f0 2023-08-17T00:16:50.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.691+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd484063750 con 0x7fd4841560f0 2023-08-17T00:16:50.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.691+0000 7fd46b7fe700 1 -- 172.21.15.153:0/3760479592 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) v1 ==== 95+0+4505 (secure 0 0 0) 0x7fd47c04d3e0 con 0x7fd4841560f0 2023-08-17T00:16:50.698 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:50.699 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":138,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133}],"filesystems":[{"mdsmap":{"epoch":138,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:16:37.314463+0000","modified":"2023-08-17T00:16:49.414139+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"a","rank":0,"incarnation":134,"state":"up:active","state_seq":6,"addr":"172.21.15.153:6835/935397889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":935397889},{"type":"v1","addr":"172.21.15.153:6835","nonce":935397889}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-08-17T00:16:50.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.691+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd47005a150 msgr2=0x7fd47005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.691+0000 7fd488d07700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd47005a150 0x7fd47005c610 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 rx=0x7fd474006fd0 tx=0x7fd474006f40).stop 2023-08-17T00:16:50.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.691+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 msgr2=0x7fd484064a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.691+0000 7fd488d07700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 0x7fd484064a90 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 rx=0x7fd47c00b610 tx=0x7fd47c009780).stop 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 shutdown_connections 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd47005a150 0x7fd47005c610 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd4841560f0 0x7fd484064a90 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd484151530 0x7fd4840645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 --2- 172.21.15.153:0/3760479592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4840689c0 0x7fd4841468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 >> 172.21.15.153:0/3760479592 conn(0x7fd4840c6620 msgr2=0x7fd484150bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:50.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 shutdown_connections 2023-08-17T00:16:50.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.695+0000 7fd488d07700 1 -- 172.21.15.153:0/3760479592 wait complete. 2023-08-17T00:16:50.704 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 138 2023-08-17T00:16:50.721 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:16:50.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.867+0000 7f9075b07700 1 Processor -- start 2023-08-17T00:16:50.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.867+0000 7f9075b07700 1 -- start start 2023-08-17T00:16:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90700c57a0 0x7f90700c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075b07700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9070153f50 0x7f9070154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075b07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90700bfd10 con 0x7f9070157600 2023-08-17T00:16:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075b07700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9070154860 con 0x7f9070153f50 2023-08-17T00:16:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9070154af0 con 0x7f90700c57a0 2023-08-17T00:16:50.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075306700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9070157600 0x7f9070157ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50178/0 (socket says 172.21.15.153:50178) 2023-08-17T00:16:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9075306700 1 -- 172.21.15.153:0/2024821468 learned_addr learned my addr 172.21.15.153:0/2024821468 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906ffff700 1 --2- 172.21.15.153:0/2024821468 >> v2:172.21.15.153:3300/0 conn(0x7f9070153f50 0x7f9070154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f9074b05700 1 --2- 172.21.15.153:0/2024821468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90700c57a0 0x7f90700c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906f7fe700 1 -- 172.21.15.153:0/2024821468 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535973418 0 0) 0x7f90700bfd10 con 0x7f9070157600 2023-08-17T00:16:50.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906f7fe700 1 -- 172.21.15.153:0/2024821468 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90600033f0 con 0x7f9070157600 2023-08-17T00:16:50.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906ffff700 1 -- 172.21.15.153:0/2024821468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90700c57a0 msgr2=0x7f90700c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:50.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906ffff700 1 --2- 172.21.15.153:0/2024821468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90700c57a0 0x7f90700c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906ffff700 1 -- 172.21.15.153:0/2024821468 >> v1:172.21.15.153:6789/0 conn(0x7f9070157600 legacy=0x7f9070157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906ffff700 1 -- 172.21.15.153:0/2024821468 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9070154dd0 con 0x7f9070153f50 2023-08-17T00:16:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906ffff700 1 --2- 172.21.15.153:0/2024821468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9070153f50 0x7f9070154370 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f905c009760 tx=0x7f905c009060).ready entity=mon.0 client_cookie=f06ed51e371bbd6e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906f7fe700 1 -- 172.21.15.153:0/2024821468 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00d4a0 con 0x7f9070153f50 2023-08-17T00:16:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906f7fe700 1 -- 172.21.15.153:0/2024821468 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00d600 con 0x7f9070153f50 2023-08-17T00:16:50.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.871+0000 7f906f7fe700 1 -- 172.21.15.153:0/2024821468 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00d980 con 0x7f9070153f50 2023-08-17T00:16:50.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 -- 172.21.15.153:0/2024821468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9070153f50 msgr2=0x7f9070154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 --2- 172.21.15.153:0/2024821468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9070153f50 0x7f9070154370 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 rx=0x7f905c009760 tx=0x7f905c009060).stop 2023-08-17T00:16:50.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 -- 172.21.15.153:0/2024821468 shutdown_connections 2023-08-17T00:16:50.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 --2- 172.21.15.153:0/2024821468 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9070153f50 0x7f9070154370 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 --2- 172.21.15.153:0/2024821468 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90700c57a0 0x7f90700c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 -- 172.21.15.153:0/2024821468 >> 172.21.15.153:0/2024821468 conn(0x7f9070062a70 msgr2=0x7f90700ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:50.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 -- 172.21.15.153:0/2024821468 shutdown_connections 2023-08-17T00:16:50.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 -- 172.21.15.153:0/2024821468 wait complete. 2023-08-17T00:16:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.875+0000 7f9075b07700 1 Processor -- start 2023-08-17T00:16:50.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 -- start start 2023-08-17T00:16:50.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 0x7f90700c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9070153f50 0x7f90700c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9070157600 0x7f9070163f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700c78e0 con 0x7f90700c57a0 2023-08-17T00:16:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90700c3280 con 0x7f9070157600 2023-08-17T00:16:50.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075b07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90700c7290 con 0x7f9070153f50 2023-08-17T00:16:50.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 0x7f90700c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 0x7f90700c24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33536/0 (socket says 172.21.15.153:33536) 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 -- 172.21.15.153:0/2586320907 learned_addr learned my addr 172.21.15.153:0/2586320907 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f906ffff700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9070153f50 0x7f90700c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075306700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9070157600 0x7f9070163f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 -- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9070153f50 msgr2=0x7f90700c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9070153f50 0x7f90700c29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 -- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9070157600 msgr2=0x7f9070163f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9070157600 0x7f9070163f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9074b05700 1 -- 172.21.15.153:0/2586320907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0092a0 con 0x7f90700c57a0 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.879+0000 7f9075306700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9070157600 0x7f9070163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f9074b05700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 0x7f90700c24e0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f906400e900 tx=0x7f9064009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064012600 con 0x7f90700c57a0 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9064012760 con 0x7f90700c57a0 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90700c7570 con 0x7f90700c57a0 2023-08-17T00:16:50.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064012ae0 con 0x7f90700c57a0 2023-08-17T00:16:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90700c3560 con 0x7f90700c57a0 2023-08-17T00:16:50.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.883+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907006b4c0 con 0x7f90700c57a0 2023-08-17T00:16:50.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.887+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9064022070 con 0x7f90700c57a0 2023-08-17T00:16:50.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.887+0000 7f906cff9700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905405a150 0x7f905405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:50.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.887+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7f9064074440 con 0x7f90700c57a0 2023-08-17T00:16:50.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.887+0000 7f906ffff700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905405a150 0x7f905405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:50.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.887+0000 7f906ffff700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905405a150 0x7f905405c610 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f905c009760 tx=0x7f905c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:50.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:50.891+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9064047de0 con 0x7f90700c57a0 2023-08-17T00:16:51.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.051+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90700bf9a0 con 0x7f90700c57a0 2023-08-17T00:16:51.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.051+0000 7f906cff9700 1 -- 172.21.15.153:0/2586320907 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17087 (secure 0 0 0) 0x7f906404b400 con 0x7f90700c57a0 2023-08-17T00:16:51.060 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:51.060 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":180,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:42.423611+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:16:35.234407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-08-17T00:16:36.324685+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"178","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"25.f","mappings":[{"from":7,"to":3}]},{"pgid":"25.2a","mappings":[{"from":7,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:16:51.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905405a150 msgr2=0x7f905405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905405a150 0x7f905405c610 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7f905c009760 tx=0x7f905c016000).stop 2023-08-17T00:16:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 msgr2=0x7f90700c24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 0x7f90700c24e0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 rx=0x7f906400e900 tx=0x7f9064009060).stop 2023-08-17T00:16:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 shutdown_connections 2023-08-17T00:16:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f905405a150 0x7f905405c610 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9070157600 0x7f9070163f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9070153f50 0x7f90700c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 --2- 172.21.15.153:0/2586320907 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f90700c57a0 0x7f90700c24e0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 >> 172.21.15.153:0/2586320907 conn(0x7f9070062a70 msgr2=0x7f90700aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:51.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 shutdown_connections 2023-08-17T00:16:51.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.055+0000 7f9075b07700 1 -- 172.21.15.153:0/2586320907 wait complete. 2023-08-17T00:16:51.082 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:16:51.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 Processor -- start 2023-08-17T00:16:51.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 -- start start 2023-08-17T00:16:51.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae5c0a8df0 0x7fae5c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae5c068820 0x7fae5c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5c1585a0 con 0x7fae5c061fa0 2023-08-17T00:16:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c066400 con 0x7fae5c0a8df0 2023-08-17T00:16:51.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae62439700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5c069170 con 0x7fae5c068820 2023-08-17T00:16:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae61437700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae5c0a8df0 0x7fae5c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae61437700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fae5c0a8df0 0x7fae5c0c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33546/0 (socket says 172.21.15.153:33546) 2023-08-17T00:16:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae61437700 1 -- 172.21.15.153:0/1499851398 learned_addr learned my addr 172.21.15.153:0/1499851398 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:51.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.235+0000 7fae60c36700 1 --2- 172.21.15.153:0/1499851398 >> v2:172.21.15.178:3300/0 conn(0x7fae5c068820 0x7fae5c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae53fff700 1 -- 172.21.15.153:0/1499851398 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1178120213 0 0) 0x7fae5c1585a0 con 0x7fae5c061fa0 2023-08-17T00:16:51.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae53fff700 1 -- 172.21.15.153:0/1499851398 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae480033f0 con 0x7fae5c061fa0 2023-08-17T00:16:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae61437700 1 -- 172.21.15.153:0/1499851398 >> v2:172.21.15.178:3300/0 conn(0x7fae5c068820 msgr2=0x7fae5c068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae61437700 1 --2- 172.21.15.153:0/1499851398 >> v2:172.21.15.178:3300/0 conn(0x7fae5c068820 0x7fae5c068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae61437700 1 -- 172.21.15.153:0/1499851398 >> v1:172.21.15.178:6789/0 conn(0x7fae5c061fa0 legacy=0x7fae5c062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae61437700 1 -- 172.21.15.153:0/1499851398 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0b9d30 con 0x7fae5c0a8df0 2023-08-17T00:16:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae60c36700 1 --2- 172.21.15.153:0/1499851398 >> v2:172.21.15.178:3300/0 conn(0x7fae5c068820 0x7fae5c068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:51.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae61437700 1 --2- 172.21.15.153:0/1499851398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c0a8df0 0x7fae5c0c1490 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fae5c0c2ef0 tx=0x7fae58009060).ready entity=mon.0 client_cookie=9c0ced1f39161538 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:51.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae53fff700 1 -- 172.21.15.153:0/1499851398 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58005880 con 0x7fae5c0a8df0 2023-08-17T00:16:51.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae53fff700 1 -- 172.21.15.153:0/1499851398 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae580059e0 con 0x7fae5c0a8df0 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae53fff700 1 -- 172.21.15.153:0/1499851398 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae58005d60 con 0x7fae5c0a8df0 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 -- 172.21.15.153:0/1499851398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c0a8df0 msgr2=0x7fae5c0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 --2- 172.21.15.153:0/1499851398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c0a8df0 0x7fae5c0c1490 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 rx=0x7fae5c0c2ef0 tx=0x7fae58009060).stop 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 -- 172.21.15.153:0/1499851398 shutdown_connections 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 --2- 172.21.15.153:0/1499851398 >> v2:172.21.15.178:3300/0 conn(0x7fae5c068820 0x7fae5c068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 --2- 172.21.15.153:0/1499851398 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c0a8df0 0x7fae5c0c1490 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 -- 172.21.15.153:0/1499851398 >> 172.21.15.153:0/1499851398 conn(0x7fae5c0c6620 msgr2=0x7fae5c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 -- 172.21.15.153:0/1499851398 shutdown_connections 2023-08-17T00:16:51.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.239+0000 7fae62439700 1 -- 172.21.15.153:0/1499851398 wait complete. 2023-08-17T00:16:51.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.243+0000 7fae62439700 1 Processor -- start 2023-08-17T00:16:51.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.243+0000 7fae62439700 1 -- start start 2023-08-17T00:16:51.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 0x7fae5c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:51.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c068820 0x7fae5c1687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:51.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0a8df0 0x7fae5c0bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:51.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c169740 con 0x7fae5c061fa0 2023-08-17T00:16:51.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c169180 con 0x7fae5c068820 2023-08-17T00:16:51.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c169460 con 0x7fae5c0a8df0 2023-08-17T00:16:51.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 0x7fae5c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:51.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 0x7fae5c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33552/0 (socket says 172.21.15.153:33552) 2023-08-17T00:16:51.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 -- 172.21.15.153:0/2784919259 learned_addr learned my addr 172.21.15.153:0/2784919259 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:51.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61c38700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0a8df0 0x7fae5c0bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:51.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae60c36700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c068820 0x7fae5c1687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:51.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 -- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0a8df0 msgr2=0x7fae5c0bf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0a8df0 0x7fae5c0bf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 -- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c068820 msgr2=0x7fae5c1687b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c068820 0x7fae5c1687b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 -- 172.21.15.153:0/2784919259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c0092a0 con 0x7fae5c061fa0 2023-08-17T00:16:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61c38700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0a8df0 0x7fae5c0bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:51.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae61437700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 0x7fae5c156ec0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fae58009dd0 tx=0x7fae58016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:51.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800f720 con 0x7fae5c061fa0 2023-08-17T00:16:51.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5800f880 con 0x7fae5c061fa0 2023-08-17T00:16:51.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae58009300 con 0x7fae5c061fa0 2023-08-17T00:16:51.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5800fc20 con 0x7fae5c061fa0 2023-08-17T00:16:51.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.247+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5c15a090 con 0x7fae5c061fa0 2023-08-17T00:16:51.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.251+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5c06b4c0 con 0x7fae5c061fa0 2023-08-17T00:16:51.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.251+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fae5800f070 con 0x7fae5c061fa0 2023-08-17T00:16:51.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.255+0000 7fae517fa700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae4005a180 0x7fae4005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:51.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.255+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6179+0+0 (secure 0 0 0) 0x7fae58075140 con 0x7fae5c061fa0 2023-08-17T00:16:51.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.255+0000 7fae60c36700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae4005a180 0x7fae4005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:51.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.255+0000 7fae60c36700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae4005a180 0x7fae4005c640 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fae4c009270 tx=0x7fae4c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:51.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.259+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae58048aa0 con 0x7fae5c061fa0 2023-08-17T00:16:51.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:51.455+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fae5c05e300 con 0x7fae5c061fa0 2023-08-17T00:16:51.819 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:16:51.811+0000 7fb0472d5700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (108) Cannot send after transport endpoint shutdown 2023-08-17T00:16:51.819 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:16:51.811+0000 7fb0472d5700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T00:16:51.819 INFO:tasks.ceph.mds.a.smithi153.stderr:2023-08-17T00:16:51.811+0000 7fb0472d5700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T00:16:51.853 INFO:tasks.ceph.mds.a.smithi153.stderr: -4> 2023-08-17T00:16:51.811+0000 7fb0472d5700 -1 mds.0.journaler.mdlog(rw) _finish_write_head got (108) Cannot send after transport endpoint shutdown 2023-08-17T00:16:51.853 INFO:tasks.ceph.mds.a.smithi153.stderr: -3> 2023-08-17T00:16:51.811+0000 7fb0472d5700 -1 mds.0.journaler.mdlog(rw) handle_write_error (108) Cannot send after transport endpoint shutdown 2023-08-17T00:16:51.853 INFO:tasks.ceph.mds.a.smithi153.stderr: -1> 2023-08-17T00:16:51.811+0000 7fb0472d5700 -1 MDSIOContextBase: failed with -108, restarting... 2023-08-17T00:16:51.895 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:16:52.436 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:16:52.431+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:16:52.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.439+0000 7fae517fa700 1 -- 172.21.15.153:0/2784919259 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v139) v1 ==== 161+0+0 (secure 0 0 0) 0x7fae5804c0c0 con 0x7fae5c061fa0 2023-08-17T00:16:52.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae4005a180 msgr2=0x7fae4005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae4005a180 0x7fae4005c640 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fae4c009270 tx=0x7fae4c008040).stop 2023-08-17T00:16:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 msgr2=0x7fae5c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:52.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 0x7fae5c156ec0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 rx=0x7fae58009dd0 tx=0x7fae58016000).stop 2023-08-17T00:16:52.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 shutdown_connections 2023-08-17T00:16:52.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae4005a180 0x7fae4005c640 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0a8df0 0x7fae5c0bf6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c068820 0x7fae5c1687b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 --2- 172.21.15.153:0/2784919259 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c061fa0 0x7fae5c156ec0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 >> 172.21.15.153:0/2784919259 conn(0x7fae5c0c6620 msgr2=0x7fae5c0ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 shutdown_connections 2023-08-17T00:16:52.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.443+0000 7fae62439700 1 -- 172.21.15.153:0/2784919259 wait complete. 2023-08-17T00:16:52.456 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:16:52.472 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:16:52.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.619+0000 7fedc5eb9700 1 Processor -- start 2023-08-17T00:16:52.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.619+0000 7fedc5eb9700 1 -- start start 2023-08-17T00:16:52.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc5eb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fedc00689c0 0x7fedc0068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:52.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc5eb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc01560f0 0x7fedc00c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:52.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc5eb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc0065da0 con 0x7fedc0151530 2023-08-17T00:16:52.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc5eb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc0155c60 con 0x7fedc00689c0 2023-08-17T00:16:52.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc5eb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc0156550 con 0x7fedc01560f0 2023-08-17T00:16:52.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc4eb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fedc00689c0 0x7fedc0068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:52.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc56b8700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fedc0151530 0x7fedc01519c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:36486/0 (socket says 172.21.15.153:36486) 2023-08-17T00:16:52.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc56b8700 1 -- 172.21.15.153:0/3405614580 learned_addr learned my addr 172.21.15.153:0/3405614580 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:52.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedbffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc01560f0 0x7fedc00c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:52.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc4eb7700 1 -- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc01560f0 msgr2=0x7fedc00c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:52.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc4eb7700 1 --2- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc01560f0 0x7fedc00c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc4eb7700 1 -- 172.21.15.153:0/3405614580 >> v1:172.21.15.178:6789/0 conn(0x7fedc0151530 legacy=0x7fedc01519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:52.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedbf7fe700 1 -- 172.21.15.153:0/3405614580 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401004302 0 0) 0x7fedc0065da0 con 0x7fedc0151530 2023-08-17T00:16:52.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc4eb7700 1 -- 172.21.15.153:0/3405614580 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0065ff0 con 0x7fedc00689c0 2023-08-17T00:16:52.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.623+0000 7fedc4eb7700 1 --2- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc0068da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fedb4006fd0 tx=0x7fedb4006f40).ready entity=mon.1 client_cookie=301b0926bd800d45 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:52.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedbf7fe700 1 -- 172.21.15.153:0/3405614580 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4005880 con 0x7fedc00689c0 2023-08-17T00:16:52.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedbf7fe700 1 -- 172.21.15.153:0/3405614580 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb40059e0 con 0x7fedc00689c0 2023-08-17T00:16:52.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedbf7fe700 1 -- 172.21.15.153:0/3405614580 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4005d60 con 0x7fedc00689c0 2023-08-17T00:16:52.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 -- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 msgr2=0x7fedc0068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:52.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc0068da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7fedb4006fd0 tx=0x7fedb4006f40).stop 2023-08-17T00:16:52.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 -- 172.21.15.153:0/3405614580 shutdown_connections 2023-08-17T00:16:52.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc01560f0 0x7fedc00c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/3405614580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc0068da0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 -- 172.21.15.153:0/3405614580 >> 172.21.15.153:0/3405614580 conn(0x7fedc00c6620 msgr2=0x7fedc00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:52.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 -- 172.21.15.153:0/3405614580 shutdown_connections 2023-08-17T00:16:52.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.627+0000 7fedc5eb9700 1 -- 172.21.15.153:0/3405614580 wait complete. 2023-08-17T00:16:52.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 Processor -- start 2023-08-17T00:16:52.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 -- start start 2023-08-17T00:16:52.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc016bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:52.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc0151530 0x7fedc016c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:52.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 0x7fedc0167ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:52.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00ba680 con 0x7fedc01560f0 2023-08-17T00:16:52.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc00c2420 con 0x7fedc00689c0 2023-08-17T00:16:52.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc5eb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc016c760 con 0x7fedc0151530 2023-08-17T00:16:52.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc56b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 0x7fedc0167ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc56b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 0x7fedc0167ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33586/0 (socket says 172.21.15.153:33586) 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc56b8700 1 -- 172.21.15.153:0/1887430377 learned_addr learned my addr 172.21.15.153:0/1887430377 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedbffff700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc0151530 0x7fedc016c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.631+0000 7fedc4eb7700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc016bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc56b8700 1 -- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc0151530 msgr2=0x7fedc016c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc56b8700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc0151530 0x7fedc016c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc56b8700 1 -- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 msgr2=0x7fedc016bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:52.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc56b8700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc016bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:52.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc56b8700 1 -- 172.21.15.153:0/1887430377 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4009250 con 0x7fedc01560f0 2023-08-17T00:16:52.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc56b8700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 0x7fedc0167ce0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7fedb800c7e0 tx=0x7fedb8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:52.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8005d30 con 0x7fedc01560f0 2023-08-17T00:16:52.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb8005e90 con 0x7fedc01560f0 2023-08-17T00:16:52.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc00ba030 con 0x7fedc01560f0 2023-08-17T00:16:52.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8007320 con 0x7fedc01560f0 2023-08-17T00:16:52.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc016ca40 con 0x7fedc01560f0 2023-08-17T00:16:52.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.635+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc00ba830 con 0x7fedc01560f0 2023-08-17T00:16:52.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.639+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fedb8010030 con 0x7fedc01560f0 2023-08-17T00:16:52.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.639+0000 7fedbcff9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a150 0x7feda405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:52.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.639+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6265+0+0 (secure 0 0 0) 0x7fedb8074160 con 0x7fedc01560f0 2023-08-17T00:16:52.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.639+0000 7fedc4eb7700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a150 0x7feda405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:52.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.639+0000 7fedc4eb7700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a150 0x7feda405c610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fedb4006fa0 tx=0x7fedb4015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:52.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.647+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fedc00ba830 con 0x7fedc01560f0 2023-08-17T00:16:52.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:52.843+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fedc00ba7c0 con 0x7fedc01560f0 2023-08-17T00:16:53.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.471+0000 7fedbcff9700 1 -- 172.21.15.153:0/1887430377 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v140) v1 ==== 104+0+0 (secure 0 0 0) 0x7fedb8047a90 con 0x7fedc01560f0 2023-08-17T00:16:53.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a150 msgr2=0x7feda405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:53.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a150 0x7feda405c610 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7fedb4006fa0 tx=0x7fedb4015000).stop 2023-08-17T00:16:53.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 msgr2=0x7fedc0167ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:53.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 0x7fedc0167ce0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 rx=0x7fedb800c7e0 tx=0x7fedb8007f90).stop 2023-08-17T00:16:53.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 shutdown_connections 2023-08-17T00:16:53.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a150 0x7feda405c610 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc01560f0 0x7fedc0167ce0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc0151530 0x7fedc016c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 --2- 172.21.15.153:0/1887430377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc00689c0 0x7fedc016bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 >> 172.21.15.153:0/1887430377 conn(0x7fedc00c6620 msgr2=0x7fedc00bffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:53.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 shutdown_connections 2023-08-17T00:16:53.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.475+0000 7fedc5eb9700 1 -- 172.21.15.153:0/1887430377 wait complete. 2023-08-17T00:16:53.507 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:16:53.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.663+0000 7f44b03db700 1 Processor -- start 2023-08-17T00:16:53.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.667+0000 7f44b03db700 1 -- start start 2023-08-17T00:16:53.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44a80acc00 0x7f44a80c5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44a80c5110 0x7f44a8061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a8062490 0x7f44a8063710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a8062920 con 0x7f44a80acc00 2023-08-17T00:16:53.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a815bd60 con 0x7f44a80c5110 2023-08-17T00:16:53.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a815c040 con 0x7f44a8062490 2023-08-17T00:16:53.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44a80acc00 0x7f44a80c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f44a80acc00 0x7f44a80c5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33590/0 (socket says 172.21.15.153:33590) 2023-08-17T00:16:53.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 -- 172.21.15.153:0/2779016070 learned_addr learned my addr 172.21.15.153:0/2779016070 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:53.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ad976700 1 --2- 172.21.15.153:0/2779016070 >> v2:172.21.15.178:3300/0 conn(0x7f44a80c5110 0x7f44a8061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae978700 1 --2- 172.21.15.153:0/2779016070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a8062490 0x7f44a8063710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 -- 172.21.15.153:0/2779016070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a8062490 msgr2=0x7f44a8063710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 --2- 172.21.15.153:0/2779016070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a8062490 0x7f44a8063710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 -- 172.21.15.153:0/2779016070 >> v2:172.21.15.178:3300/0 conn(0x7f44a80c5110 msgr2=0x7f44a8061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 --2- 172.21.15.153:0/2779016070 >> v2:172.21.15.178:3300/0 conn(0x7f44a80c5110 0x7f44a8061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 -- 172.21.15.153:0/2779016070 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a815c320 con 0x7f44a80acc00 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ad976700 1 --2- 172.21.15.153:0/2779016070 >> v2:172.21.15.178:3300/0 conn(0x7f44a80c5110 0x7f44a8061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:53.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ae177700 1 --2- 172.21.15.153:0/2779016070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80acc00 0x7f44a80c5590 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f44a8083fe0 tx=0x7f44a40090f0).ready entity=mon.0 client_cookie=e30f56c0fbd791d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:53.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ad175700 1 -- 172.21.15.153:0/2779016070 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400b600 con 0x7f44a80acc00 2023-08-17T00:16:53.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ad175700 1 -- 172.21.15.153:0/2779016070 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a400b760 con 0x7f44a80acc00 2023-08-17T00:16:53.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44ad175700 1 -- 172.21.15.153:0/2779016070 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a400bb00 con 0x7f44a80acc00 2023-08-17T00:16:53.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 -- 172.21.15.153:0/2779016070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80acc00 msgr2=0x7f44a80c5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:53.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- 172.21.15.153:0/2779016070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80acc00 0x7f44a80c5590 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 rx=0x7f44a8083fe0 tx=0x7f44a40090f0).stop 2023-08-17T00:16:53.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 -- 172.21.15.153:0/2779016070 shutdown_connections 2023-08-17T00:16:53.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- 172.21.15.153:0/2779016070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a8062490 0x7f44a8063710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- 172.21.15.153:0/2779016070 >> v2:172.21.15.178:3300/0 conn(0x7f44a80c5110 0x7f44a8061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 --2- 172.21.15.153:0/2779016070 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80acc00 0x7f44a80c5590 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.671+0000 7f44b03db700 1 -- 172.21.15.153:0/2779016070 >> 172.21.15.153:0/2779016070 conn(0x7f44a80caa10 msgr2=0x7f44a80cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:53.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 -- 172.21.15.153:0/2779016070 shutdown_connections 2023-08-17T00:16:53.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 -- 172.21.15.153:0/2779016070 wait complete. 2023-08-17T00:16:53.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 Processor -- start 2023-08-17T00:16:53.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 -- start start 2023-08-17T00:16:53.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a8062490 0x7f44a8140910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a80acc00 0x7f44a80ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 0x7f44a80af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80af3e0 con 0x7f44a80c5110 2023-08-17T00:16:53.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80aee20 con 0x7f44a8062490 2023-08-17T00:16:53.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.675+0000 7f44b03db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a80af100 con 0x7f44a80acc00 2023-08-17T00:16:53.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 0x7f44a80af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae177700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a8062490 0x7f44a8140910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 0x7f44a80af630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33606/0 (socket says 172.21.15.153:33606) 2023-08-17T00:16:53.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 -- 172.21.15.153:0/3582620680 learned_addr learned my addr 172.21.15.153:0/3582620680 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:53.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ad976700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a80acc00 0x7f44a80ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 -- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a80acc00 msgr2=0x7f44a80ae3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:53.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a80acc00 0x7f44a80ae3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 -- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a8062490 msgr2=0x7f44a8140910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:53.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a8062490 0x7f44a8140910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:53.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 -- 172.21.15.153:0/3582620680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009370 con 0x7f44a80c5110 2023-08-17T00:16:53.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44ae978700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 0x7f44a80af630 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f44a0007f20 tx=0x7f44a0009860).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:53.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a000eb90 con 0x7f44a80c5110 2023-08-17T00:16:53.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a000ecf0 con 0x7f44a80c5110 2023-08-17T00:16:53.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a0014630 con 0x7f44a80c5110 2023-08-17T00:16:53.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a80c1be0 con 0x7f44a80c5110 2023-08-17T00:16:53.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a8068ad0 con 0x7f44a80c5110 2023-08-17T00:16:53.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.679+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a806b530 con 0x7f44a80c5110 2023-08-17T00:16:53.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.683+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f44a001b030 con 0x7f44a80c5110 2023-08-17T00:16:53.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.683+0000 7f449e7fc700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a150 0x7f448c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:53.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.683+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6265+0+0 (secure 0 0 0) 0x7f44a0074390 con 0x7f44a80c5110 2023-08-17T00:16:53.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.683+0000 7f44ae177700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a150 0x7f448c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:53.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.687+0000 7f44ae177700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a150 0x7f448c05c610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f44a400b3c0 tx=0x7f44a4017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:53.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.691+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f44a0047ca0 con 0x7f44a80c5110 2023-08-17T00:16:53.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:53.855+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f44a8062b40 con 0x7f44a80c5110 2023-08-17T00:16:54.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.479+0000 7f449e7fc700 1 -- 172.21.15.153:0/3582620680 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7f44a000ee60 con 0x7f44a80c5110 2023-08-17T00:16:54.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a150 msgr2=0x7f448c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:54.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a150 0x7f448c05c610 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f44a400b3c0 tx=0x7f44a4017000).stop 2023-08-17T00:16:54.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 msgr2=0x7f44a80af630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 0x7f44a80af630 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 rx=0x7f44a0007f20 tx=0x7f44a0009860).stop 2023-08-17T00:16:54.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 shutdown_connections 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f448c05a150 0x7f448c05c610 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f44a80c5110 0x7f44a80af630 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44a80acc00 0x7f44a80ae3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 --2- 172.21.15.153:0/3582620680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a8062490 0x7f44a8140910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 >> 172.21.15.153:0/3582620680 conn(0x7f44a80caa10 msgr2=0x7f44a8141530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 shutdown_connections 2023-08-17T00:16:54.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.483+0000 7f44b03db700 1 -- 172.21.15.153:0/3582620680 wait complete. 2023-08-17T00:16:54.494 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:16:54.513 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:16:54.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.663+0000 7fae54bb9700 1 Processor -- start 2023-08-17T00:16:54.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.663+0000 7fae54bb9700 1 -- start start 2023-08-17T00:16:54.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.663+0000 7fae54bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500651d0 0x7fae500bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.663+0000 7fae54bb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500bc570 con 0x7fae5014b6b0 2023-08-17T00:16:54.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.663+0000 7fae54bb9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae500bc850 con 0x7fae50064df0 2023-08-17T00:16:54.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.663+0000 7fae54bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae50152d00 con 0x7fae500651d0 2023-08-17T00:16:54.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fae5014b6b0 0x7fae5014bb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:50194/0 (socket says 172.21.15.153:50194) 2023-08-17T00:16:54.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 -- 172.21.15.153:0/1506002834 learned_addr learned my addr 172.21.15.153:0/1506002834 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:54.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191998530 0 0) 0x7fae500bc570 con 0x7fae5014b6b0 2023-08-17T00:16:54.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae380033f0 con 0x7fae5014b6b0 2023-08-17T00:16:54.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4effd700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500651d0 0x7fae500bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 557503913 0 0) 0x7fae380033f0 con 0x7fae5014b6b0 2023-08-17T00:16:54.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500651d0 msgr2=0x7fae500bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:54.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500651d0 0x7fae500bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 >> v1:172.21.15.178:6789/0 conn(0x7fae50064df0 legacy=0x7fae500bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:54.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500bcb30 con 0x7fae5014b6b0 2023-08-17T00:16:54.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fae480017f0 con 0x7fae5014b6b0 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 >> v1:172.21.15.153:6789/0 conn(0x7fae5014b6b0 legacy=0x7fae5014bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae38003910 0x7fae38003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae38004690 0x7fae38004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae380050d0 0x7fae3800fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50152d00 con 0x7fae380050d0 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae38010420 con 0x7fae38004690 2023-08-17T00:16:54.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae380105e0 con 0x7fae38003910 2023-08-17T00:16:54.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4effd700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae500651d0 0x7fae500bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:54.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae380050d0 0x7fae3800fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4effd700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae38004690 0x7fae38004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae38003910 0x7fae38003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 -- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae38003910 msgr2=0x7fae38003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae38003910 0x7fae38003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 -- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae38004690 msgr2=0x7fae38004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae38004690 0x7fae38004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 -- 172.21.15.153:0/1506002834 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae380033f0 con 0x7fae380050d0 2023-08-17T00:16:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4effd700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae38004690 0x7fae38004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:54.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae38003910 0x7fae38003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae380050d0 0x7fae3800fcf0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7fae4800c5f0 tx=0x7fae48001d90).ready entity=mon.0 client_cookie=e8e913f2989cb8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48001fc0 con 0x7fae380050d0 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48005b20 con 0x7fae380050d0 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4e7fc700 1 -- 172.21.15.153:0/1506002834 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480070d0 con 0x7fae380050d0 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae54bb9700 1 -- 172.21.15.153:0/1506002834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae380050d0 msgr2=0x7fae3800fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae54bb9700 1 --2- 172.21.15.153:0/1506002834 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae380050d0 0x7fae3800fcf0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 rx=0x7fae4800c5f0 tx=0x7fae48001d90).stop 2023-08-17T00:16:54.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae4ffff700 1 -- 172.21.15.153:0/1506002834 reap_dead start 2023-08-17T00:16:54.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae54bb9700 1 -- 172.21.15.153:0/1506002834 shutdown_connections 2023-08-17T00:16:54.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae54bb9700 1 -- 172.21.15.153:0/1506002834 >> 172.21.15.153:0/1506002834 conn(0x7fae500c6ee0 msgr2=0x7fae500c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:54.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae54bb9700 1 -- 172.21.15.153:0/1506002834 shutdown_connections 2023-08-17T00:16:54.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.667+0000 7fae54bb9700 1 -- 172.21.15.153:0/1506002834 wait complete. 2023-08-17T00:16:54.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.671+0000 7fae54bb9700 1 Processor -- start 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.671+0000 7fae54bb9700 1 -- start start 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae380050d0 0x7fae501556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae50149b50 0x7fae50149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 0x7fae500a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014c3b0 con 0x7fae500a6220 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5014a4c0 con 0x7fae50149b50 2023-08-17T00:16:54.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500a6e70 con 0x7fae380050d0 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 0x7fae500a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 0x7fae500a66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:33626/0 (socket says 172.21.15.153:33626) 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 -- 172.21.15.153:0/2790750773 learned_addr learned my addr 172.21.15.153:0/2790750773 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae380050d0 0x7fae501556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4effd700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae50149b50 0x7fae50149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 -- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae380050d0 msgr2=0x7fae501556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:54.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae380050d0 0x7fae501556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 -- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae50149b50 msgr2=0x7fae50149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:54.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae50149b50 0x7fae50149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:54.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 -- 172.21.15.153:0/2790750773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae500a7150 con 0x7fae500a6220 2023-08-17T00:16:54.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae4ffff700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 0x7fae500a66a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7fae4800a000 tx=0x7fae48015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:54.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480070d0 con 0x7fae500a6220 2023-08-17T00:16:54.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800cec0 con 0x7fae500a6220 2023-08-17T00:16:54.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae500a7430 con 0x7fae500a6220 2023-08-17T00:16:54.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48001fc0 con 0x7fae500a6220 2023-08-17T00:16:54.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.675+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae500a6b90 con 0x7fae500a6220 2023-08-17T00:16:54.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.679+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5005f850 con 0x7fae500a6220 2023-08-17T00:16:54.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.679+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fae4801d070 con 0x7fae500a6220 2023-08-17T00:16:54.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.679+0000 7fae377fe700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a180 0x7fae3c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:54.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.679+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5769+0+0 (secure 0 0 0) 0x7fae48075180 con 0x7fae500a6220 2023-08-17T00:16:54.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.683+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a180 0x7fae3c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:54.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.683+0000 7fae4f7fe700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a180 0x7fae3c05c640 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fae4000e930 tx=0x7fae40009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:54.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.687+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae48048c80 con 0x7fae500a6220 2023-08-17T00:16:54.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:54.843+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fae500a75c0 con 0x7fae500a6220 2023-08-17T00:16:55.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.495+0000 7fae377fe700 1 -- 172.21.15.153:0/2790750773 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7fae4801a030 con 0x7fae500a6220 2023-08-17T00:16:55.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a180 msgr2=0x7fae3c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a180 0x7fae3c05c640 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7fae4000e930 tx=0x7fae40009040).stop 2023-08-17T00:16:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 msgr2=0x7fae500a66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 0x7fae500a66a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 rx=0x7fae4800a000 tx=0x7fae48015000).stop 2023-08-17T00:16:55.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 shutdown_connections 2023-08-17T00:16:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae3c05a180 0x7fae3c05c640 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae500a6220 0x7fae500a66a0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae50149b50 0x7fae50149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 --2- 172.21.15.153:0/2790750773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae380050d0 0x7fae501556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 >> 172.21.15.153:0/2790750773 conn(0x7fae500c6ee0 msgr2=0x7fae5014fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 shutdown_connections 2023-08-17T00:16:55.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.499+0000 7fae54bb9700 1 -- 172.21.15.153:0/2790750773 wait complete. 2023-08-17T00:16:55.512 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:16:55.531 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:16:55.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.675+0000 7f3f16479700 1 Processor -- start 2023-08-17T00:16:55.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.675+0000 7f3f16479700 1 -- start start 2023-08-17T00:16:55.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f16479700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f10153f50 0x7f3f10154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:55.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f16479700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f100bfd10 con 0x7f3f100c01a0 2023-08-17T00:16:55.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f16479700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f10154860 con 0x7f3f100c57a0 2023-08-17T00:16:55.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f16479700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f10154af0 con 0x7f3f10153f50 2023-08-17T00:16:55.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f10153f50 0x7f3f10154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:55.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3f10153f50 0x7f3f10154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37602/0 (socket says 172.21.15.153:37602) 2023-08-17T00:16:55.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 -- 172.21.15.153:0/2361479326 learned_addr learned my addr 172.21.15.153:0/2361479326 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:55.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 -- 172.21.15.153:0/2361479326 >> v1:172.21.15.178:6789/0 conn(0x7f3f100c57a0 legacy=0x7f3f100c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:55.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 -- 172.21.15.153:0/2361479326 >> v1:172.21.15.153:6789/0 conn(0x7f3f100c01a0 legacy=0x7f3f100c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:55.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 -- 172.21.15.153:0/2361479326 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10154dd0 con 0x7f3f10153f50 2023-08-17T00:16:55.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f14c76700 1 --2- 172.21.15.153:0/2361479326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f10153f50 0x7f3f10154370 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f3f00006fd0 tx=0x7f3f000090f0).ready entity=mon.0 client_cookie=1cbf89bf52db2eff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:55.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f07fff700 1 -- 172.21.15.153:0/2361479326 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000b600 con 0x7f3f10153f50 2023-08-17T00:16:55.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f07fff700 1 -- 172.21.15.153:0/2361479326 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0000b760 con 0x7f3f10153f50 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f07fff700 1 -- 172.21.15.153:0/2361479326 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000bae0 con 0x7f3f10153f50 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f16479700 1 -- 172.21.15.153:0/2361479326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f10153f50 msgr2=0x7f3f10154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.679+0000 7f3f16479700 1 --2- 172.21.15.153:0/2361479326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f10153f50 0x7f3f10154370 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 rx=0x7f3f00006fd0 tx=0x7f3f000090f0).stop 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.683+0000 7f3f16479700 1 -- 172.21.15.153:0/2361479326 shutdown_connections 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.683+0000 7f3f16479700 1 --2- 172.21.15.153:0/2361479326 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f10153f50 0x7f3f10154370 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.683+0000 7f3f16479700 1 -- 172.21.15.153:0/2361479326 >> 172.21.15.153:0/2361479326 conn(0x7f3f10062a70 msgr2=0x7f3f100ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.683+0000 7f3f16479700 1 -- 172.21.15.153:0/2361479326 shutdown_connections 2023-08-17T00:16:55.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.683+0000 7f3f16479700 1 -- 172.21.15.153:0/2361479326 wait complete. 2023-08-17T00:16:55.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.683+0000 7f3f16479700 1 Processor -- start 2023-08-17T00:16:55.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 -- start start 2023-08-17T00:16:55.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f100c01a0 0x7f3f1014a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 0x7f3f100c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f10153f50 0x7f3f1014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f10165800 con 0x7f3f100c57a0 2023-08-17T00:16:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f10164b80 con 0x7f3f10153f50 2023-08-17T00:16:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f16479700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f10164e60 con 0x7f3f100c01a0 2023-08-17T00:16:55.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 0x7f3f100c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:55.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 0x7f3f100c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37612/0 (socket says 172.21.15.153:37612) 2023-08-17T00:16:55.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 -- 172.21.15.153:0/3580888970 learned_addr learned my addr 172.21.15.153:0/3580888970 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f15477700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f100c01a0 0x7f3f1014a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f15c78700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f10153f50 0x7f3f1014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 -- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f100c01a0 msgr2=0x7f3f1014a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f100c01a0 0x7f3f1014a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 -- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f10153f50 msgr2=0x7f3f1014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f10153f50 0x7f3f1014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 -- 172.21.15.153:0/3580888970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009370 con 0x7f3f100c57a0 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.687+0000 7f3f14c76700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 0x7f3f100c9bb0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f3f00009130 tx=0x7f3f00017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0000bae0 con 0x7f3f100c57a0 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00000c90 con 0x7f3f100c57a0 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0001c670 con 0x7f3f100c57a0 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f10165140 con 0x7f3f100c57a0 2023-08-17T00:16:55.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1014ce70 con 0x7f3f100c57a0 2023-08-17T00:16:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1006b4c0 con 0x7f3f100c57a0 2023-08-17T00:16:55.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.691+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3f00022020 con 0x7f3f100c57a0 2023-08-17T00:16:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.695+0000 7f3f057fa700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ef405a180 0x7f3ef405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.695+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5355+0+0 (secure 0 0 0) 0x7f3f00075900 con 0x7f3f100c57a0 2023-08-17T00:16:55.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.695+0000 7f3f15477700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ef405a180 0x7f3ef405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:55.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.695+0000 7f3f15477700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ef405a180 0x7f3ef405c640 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f3f0c006fd0 tx=0x7f3f0c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:55.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.699+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3f000496b0 con 0x7f3f100c57a0 2023-08-17T00:16:55.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.867+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3f100c4cc0 con 0x7f3f100c57a0 2023-08-17T00:16:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.875+0000 7f3f057fa700 1 -- 172.21.15.153:0/3580888970 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3f0004ccd0 con 0x7f3f100c57a0 2023-08-17T00:16:55.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ef405a180 msgr2=0x7f3ef405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ef405a180 0x7f3ef405c640 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7f3f0c006fd0 tx=0x7f3f0c008040).stop 2023-08-17T00:16:55.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 msgr2=0x7f3f100c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:55.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 0x7f3f100c9bb0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 rx=0x7f3f00009130 tx=0x7f3f00017000).stop 2023-08-17T00:16:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 shutdown_connections 2023-08-17T00:16:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3ef405a180 0x7f3ef405c640 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f10153f50 0x7f3f1014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3f100c57a0 0x7f3f100c9bb0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 --2- 172.21.15.153:0/3580888970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f100c01a0 0x7f3f1014a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 >> 172.21.15.153:0/3580888970 conn(0x7f3f10062a70 msgr2=0x7f3f100b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 shutdown_connections 2023-08-17T00:16:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:55.879+0000 7f3f16479700 1 -- 172.21.15.153:0/3580888970 wait complete. 2023-08-17T00:16:55.909 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2023-08-17T00:16:56.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe651a5b700 1 Processor -- start 2023-08-17T00:16:56.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe651a5b700 1 -- start start 2023-08-17T00:16:56.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe651a5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c0cb240 0x7fe64c061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe651a5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c0c11d0 con 0x7fe64c153aa0 2023-08-17T00:16:56.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe651a5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64c0c5e80 con 0x7fe64c062490 2023-08-17T00:16:56.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe651a5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c0628f0 con 0x7fe64c0cb240 2023-08-17T00:16:56.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe64affd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fe64c153aa0 0x7fe64c0c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46112/0 (socket says 172.21.15.153:46112) 2023-08-17T00:16:56.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe64a7fc700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c0cb240 0x7fe64c061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.059+0000 7fe64affd700 1 -- 172.21.15.153:0/1818052699 learned_addr learned my addr 172.21.15.153:0/1818052699 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:56.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe64a7fc700 1 -- 172.21.15.153:0/1818052699 >> v1:172.21.15.178:6789/0 conn(0x7fe64c062490 legacy=0x7fe64c0aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe64a7fc700 1 -- 172.21.15.153:0/1818052699 >> v1:172.21.15.153:6789/0 conn(0x7fe64c153aa0 legacy=0x7fe64c0c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe649ffb700 1 -- 172.21.15.153:0/1818052699 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211079408 0 0) 0x7fe64c0c5e80 con 0x7fe64c062490 2023-08-17T00:16:56.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe64a7fc700 1 -- 172.21.15.153:0/1818052699 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c0c1660 con 0x7fe64c0cb240 2023-08-17T00:16:56.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe64a7fc700 1 --2- 172.21.15.153:0/1818052699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c0cb240 0x7fe64c061fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe640009790 tx=0x7fe640009060).ready entity=mon.2 client_cookie=756349603d41580d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:56.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe649ffb700 1 -- 172.21.15.153:0/1818052699 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe640009130 con 0x7fe64c0cb240 2023-08-17T00:16:56.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe649ffb700 1 -- 172.21.15.153:0/1818052699 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64000f510 con 0x7fe64c0cb240 2023-08-17T00:16:56.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe649ffb700 1 -- 172.21.15.153:0/1818052699 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64000f890 con 0x7fe64c0cb240 2023-08-17T00:16:56.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 -- 172.21.15.153:0/1818052699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c0cb240 msgr2=0x7fe64c061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 --2- 172.21.15.153:0/1818052699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c0cb240 0x7fe64c061fa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fe640009790 tx=0x7fe640009060).stop 2023-08-17T00:16:56.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 -- 172.21.15.153:0/1818052699 shutdown_connections 2023-08-17T00:16:56.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 --2- 172.21.15.153:0/1818052699 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c0cb240 0x7fe64c061fa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 -- 172.21.15.153:0/1818052699 >> 172.21.15.153:0/1818052699 conn(0x7fe64c0640b0 msgr2=0x7fe64c0ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:56.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 -- 172.21.15.153:0/1818052699 shutdown_connections 2023-08-17T00:16:56.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.063+0000 7fe651a5b700 1 -- 172.21.15.153:0/1818052699 wait complete. 2023-08-17T00:16:56.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 Processor -- start 2023-08-17T00:16:56.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 -- start start 2023-08-17T00:16:56.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 0x7fe64c0ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe64c0cb240 0x7fe64c1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c153aa0 0x7fe64c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c157300 con 0x7fe64c062490 2023-08-17T00:16:56.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c1566f0 con 0x7fe64c0cb240 2023-08-17T00:16:56.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe651a5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64c1569d0 con 0x7fe64c153aa0 2023-08-17T00:16:56.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 0x7fe64c0ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 0x7fe64c0ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37616/0 (socket says 172.21.15.153:37616) 2023-08-17T00:16:56.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 -- 172.21.15.153:0/179929536 learned_addr learned my addr 172.21.15.153:0/179929536 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:56.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64a7fc700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe64c0cb240 0x7fe64c1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64b7fe700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c153aa0 0x7fe64c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 -- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c153aa0 msgr2=0x7fe64c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c153aa0 0x7fe64c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 -- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe64c0cb240 msgr2=0x7fe64c1502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe64c0cb240 0x7fe64c1502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 -- 172.21.15.153:0/179929536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400092a0 con 0x7fe64c062490 2023-08-17T00:16:56.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64a7fc700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe64c0cb240 0x7fe64c1502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:56.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe64affd700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 0x7fe64c0ae650 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7fe63c00c810 tx=0x7fe63c007db0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:56.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.067+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0072e0 con 0x7fe64c062490 2023-08-17T00:16:56.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.071+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c007440 con 0x7fe64c062490 2023-08-17T00:16:56.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.071+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64c156cb0 con 0x7fe64c062490 2023-08-17T00:16:56.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.071+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0057a0 con 0x7fe64c062490 2023-08-17T00:16:56.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.071+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c156260 con 0x7fe64c062490 2023-08-17T00:16:56.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.071+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64c06b4c0 con 0x7fe64c062490 2023-08-17T00:16:56.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.071+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe63c010070 con 0x7fe64c062490 2023-08-17T00:16:56.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.075+0000 7fe632ffd700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe63805a150 0x7fe63805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.075+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fe63c0736b0 con 0x7fe64c062490 2023-08-17T00:16:56.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.075+0000 7fe64a7fc700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe63805a150 0x7fe63805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.075+0000 7fe64a7fc700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe63805a150 0x7fe63805c610 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fe64c0cb660 tx=0x7fe640015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:56.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.079+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe63c047350 con 0x7fe64c062490 2023-08-17T00:16:56.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.299+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) v1 -- 0x7fe64c157130 con 0x7fe64c062490 2023-08-17T00:16:56.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.495+0000 7fe632ffd700 1 -- 172.21.15.153:0/179929536 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v658) v1 ==== 147+0+0 (secure 0 0 0) 0x7fe63c04a970 con 0x7fe64c062490 2023-08-17T00:16:56.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe63805a150 msgr2=0x7fe63805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe63805a150 0x7fe63805c610 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fe64c0cb660 tx=0x7fe640015000).stop 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 msgr2=0x7fe64c0ae650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 0x7fe64c0ae650 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 rx=0x7fe63c00c810 tx=0x7fe63c007db0).stop 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 shutdown_connections 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe63805a150 0x7fe63805c610 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe64c153aa0 0x7fe64c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe64c0cb240 0x7fe64c1502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 --2- 172.21.15.153:0/179929536 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe64c062490 0x7fe64c0ae650 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 >> 172.21.15.153:0/179929536 conn(0x7fe64c0640b0 msgr2=0x7fe64c155a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:56.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 shutdown_connections 2023-08-17T00:16:56.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.499+0000 7fe651a5b700 1 -- 172.21.15.153:0/179929536 wait complete. 2023-08-17T00:16:56.528 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-08-17T00:16:56.529 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2023-08-17T00:16:56.529 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2023-08-17T00:16:56.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae79039700 1 Processor -- start 2023-08-17T00:16:56.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae79039700 1 -- start start 2023-08-17T00:16:56.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae79039700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fae740bd520 0x7fae740c3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae79039700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae740a6cd0 con 0x7fae740be1e0 2023-08-17T00:16:56.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae79039700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae74067040 con 0x7fae740bde00 2023-08-17T00:16:56.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae79039700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae74150e90 con 0x7fae740bd520 2023-08-17T00:16:56.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.679+0000 7fae737fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fae740be1e0 0x7fae740c30f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46116/0 (socket says 172.21.15.153:46116) 2023-08-17T00:16:56.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 -- 172.21.15.153:0/2955506306 learned_addr learned my addr 172.21.15.153:0/2955506306 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:56.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae78838700 1 --2- 172.21.15.153:0/2955506306 >> v2:172.21.15.178:3300/0 conn(0x7fae740bd520 0x7fae740c3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430035824 0 0) 0x7fae740a6cd0 con 0x7fae740be1e0 2023-08-17T00:16:56.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae5c0033f0 con 0x7fae740be1e0 2023-08-17T00:16:56.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3069542461 0 0) 0x7fae5c0033f0 con 0x7fae740be1e0 2023-08-17T00:16:56.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 >> v2:172.21.15.178:3300/0 conn(0x7fae740bd520 msgr2=0x7fae740c3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:56.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 --2- 172.21.15.153:0/2955506306 >> v2:172.21.15.178:3300/0 conn(0x7fae740bd520 0x7fae740c3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 >> v1:172.21.15.178:6789/0 conn(0x7fae740bde00 legacy=0x7fae74063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74067320 con 0x7fae740be1e0 2023-08-17T00:16:56.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fae68001470 con 0x7fae740be1e0 2023-08-17T00:16:56.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 >> v1:172.21.15.153:6789/0 conn(0x7fae740be1e0 legacy=0x7fae740c30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0038e0 0x7fae5c003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae5c004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c005000 0x7fae5c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74150e90 con 0x7fae5c004690 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c00bf60 con 0x7fae5c005000 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5c00c0f0 con 0x7fae5c0038e0 2023-08-17T00:16:56.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae5c004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 -- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0038e0 msgr2=0x7fae5c003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae5c0038e0 0x7fae5c003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 -- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c005000 msgr2=0x7fae5c00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae78838700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c005000 0x7fae5c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c005000 0x7fae5c00b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 -- 172.21.15.153:0/2955506306 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c0033f0 con 0x7fae5c004690 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae78838700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae5c005000 0x7fae5c00b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:56.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae78838700 1 -- 172.21.15.153:0/2955506306 reap_dead start 2023-08-17T00:16:56.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae737fe700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae5c004b10 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7fae6800c190 tx=0x7fae68001e50).ready entity=mon.0 client_cookie=d144ffa64cc780c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:56.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68007a20 con 0x7fae5c004690 2023-08-17T00:16:56.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae6800cac0 con 0x7fae5c004690 2023-08-17T00:16:56.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae72ffd700 1 -- 172.21.15.153:0/2955506306 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6800ce40 con 0x7fae5c004690 2023-08-17T00:16:56.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae79039700 1 -- 172.21.15.153:0/2955506306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 msgr2=0x7fae5c004b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.683+0000 7fae79039700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae5c004b10 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 rx=0x7fae6800c190 tx=0x7fae68001e50).stop 2023-08-17T00:16:56.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.687+0000 7fae79039700 1 -- 172.21.15.153:0/2955506306 shutdown_connections 2023-08-17T00:16:56.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.687+0000 7fae79039700 1 --2- 172.21.15.153:0/2955506306 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae5c004b10 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.687+0000 7fae79039700 1 -- 172.21.15.153:0/2955506306 >> 172.21.15.153:0/2955506306 conn(0x7fae74069760 msgr2=0x7fae74069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:56.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.687+0000 7fae79039700 1 -- 172.21.15.153:0/2955506306 shutdown_connections 2023-08-17T00:16:56.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.687+0000 7fae79039700 1 -- 172.21.15.153:0/2955506306 wait complete. 2023-08-17T00:16:56.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.687+0000 7fae79039700 1 Processor -- start 2023-08-17T00:16:56.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 -- start start 2023-08-17T00:16:56.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae740bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae740abb50 0x7fae741492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae741553b0 0x7fae74155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c0ec0 con 0x7fae5c004690 2023-08-17T00:16:56.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae74155d20 con 0x7fae740abb50 2023-08-17T00:16:56.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae79039700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae740c02b0 con 0x7fae741553b0 2023-08-17T00:16:56.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae73fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae740bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae740abb50 0x7fae741492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae73fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae740bfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37638/0 (socket says 172.21.15.153:37638) 2023-08-17T00:16:56.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae73fff700 1 -- 172.21.15.153:0/1084258725 learned_addr learned my addr 172.21.15.153:0/1084258725 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:56.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae78838700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae741553b0 0x7fae74155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 -- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae741553b0 msgr2=0x7fae74155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae741553b0 0x7fae74155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 -- 172.21.15.153:0/1084258725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 msgr2=0x7fae740bfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:56.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae740bfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:56.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 -- 172.21.15.153:0/1084258725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae740c0590 con 0x7fae740abb50 2023-08-17T00:16:56.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae73fff700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae740bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:16:56.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.691+0000 7fae737fe700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae740abb50 0x7fae741492d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fae68012000 tx=0x7fae68015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:56.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680072e0 con 0x7fae740abb50 2023-08-17T00:16:56.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68007440 con 0x7fae740abb50 2023-08-17T00:16:56.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae740c0870 con 0x7fae740abb50 2023-08-17T00:16:56.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae680046b0 con 0x7fae740abb50 2023-08-17T00:16:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae740bff70 con 0x7fae740abb50 2023-08-17T00:16:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7405e240 con 0x7fae740abb50 2023-08-17T00:16:56.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.695+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fae68010070 con 0x7fae740abb50 2023-08-17T00:16:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.699+0000 7fae5bfff700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae6005a120 0x7fae6005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.699+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fae68074630 con 0x7fae740abb50 2023-08-17T00:16:56.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.699+0000 7fae73fff700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae6005a120 0x7fae6005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:56.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.699+0000 7fae73fff700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae6005a120 0x7fae6005c5e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fae64007fd0 tx=0x7fae64007db0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:56.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.703+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fae68048350 con 0x7fae740abb50 2023-08-17T00:16:56.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:56.919+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) v1 -- 0x7fae74067600 con 0x7fae740abb50 2023-08-17T00:16:57.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.503+0000 7fae5bfff700 1 -- 172.21.15.153:0/1084258725 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v659) v1 ==== 136+0+0 (secure 0 0 0) 0x7fae6804b970 con 0x7fae740abb50 2023-08-17T00:16:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae6005a120 msgr2=0x7fae6005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae6005a120 0x7fae6005c5e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7fae64007fd0 tx=0x7fae64007db0).stop 2023-08-17T00:16:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae740abb50 msgr2=0x7fae741492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.515 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae740abb50 0x7fae741492d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 rx=0x7fae68012000 tx=0x7fae68015000).stop 2023-08-17T00:16:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 shutdown_connections 2023-08-17T00:16:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fae6005a120 0x7fae6005c5e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fae741553b0 0x7fae74155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fae740abb50 0x7fae741492d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 --2- 172.21.15.153:0/1084258725 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fae5c004690 0x7fae740bfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.516 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 >> 172.21.15.153:0/1084258725 conn(0x7fae74069760 msgr2=0x7fae740a7500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:57.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 shutdown_connections 2023-08-17T00:16:57.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.507+0000 7fae79039700 1 -- 172.21.15.153:0/1084258725 wait complete. 2023-08-17T00:16:57.539 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-17T00:16:57.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.699+0000 7fedc9fa9700 1 Processor -- start 2023-08-17T00:16:57.708 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.699+0000 7fedc9fa9700 1 -- start start 2023-08-17T00:16:57.710 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc9fa9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fedc4153ab0 0x7fedc4153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc9fa9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40aa750 con 0x7fedc40c7ba0 2023-08-17T00:16:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc9fa9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40c9dd0 con 0x7fedc40c8d50 2023-08-17T00:16:57.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc9fa9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc40aacf0 con 0x7fedc4153ab0 2023-08-17T00:16:57.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc3fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fedc40c7ba0 0x7fedc40ab180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46132/0 (socket says 172.21.15.153:46132) 2023-08-17T00:16:57.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc3fff700 1 -- 172.21.15.153:0/342235988 learned_addr learned my addr 172.21.15.153:0/342235988 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:57.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc37fe700 1 --2- 172.21.15.153:0/342235988 >> v2:172.21.15.178:3300/0 conn(0x7fedc4153ab0 0x7fedc4153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:57.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc2ffd700 1 -- 172.21.15.153:0/342235988 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789759258 0 0) 0x7fedc40aa750 con 0x7fedc40c7ba0 2023-08-17T00:16:57.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc2ffd700 1 -- 172.21.15.153:0/342235988 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb00033f0 con 0x7fedc40c7ba0 2023-08-17T00:16:57.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc37fe700 1 -- 172.21.15.153:0/342235988 >> v1:172.21.15.178:6789/0 conn(0x7fedc40c8d50 legacy=0x7fedc40c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc37fe700 1 -- 172.21.15.153:0/342235988 >> v1:172.21.15.153:6789/0 conn(0x7fedc40c7ba0 legacy=0x7fedc40ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc37fe700 1 -- 172.21.15.153:0/342235988 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40c5ca0 con 0x7fedc4153ab0 2023-08-17T00:16:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.703+0000 7fedc37fe700 1 --2- 172.21.15.153:0/342235988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc4153ab0 0x7fedc4153e90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fedb4009760 tx=0x7fedb4009060).ready entity=mon.1 client_cookie=6322233f9fe95cc9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc2ffd700 1 -- 172.21.15.153:0/342235988 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb40090d0 con 0x7fedc4153ab0 2023-08-17T00:16:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc2ffd700 1 -- 172.21.15.153:0/342235988 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb400f510 con 0x7fedc4153ab0 2023-08-17T00:16:57.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc2ffd700 1 -- 172.21.15.153:0/342235988 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb400f890 con 0x7fedc4153ab0 2023-08-17T00:16:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 -- 172.21.15.153:0/342235988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc4153ab0 msgr2=0x7fedc4153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/342235988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc4153ab0 0x7fedc4153e90 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 rx=0x7fedb4009760 tx=0x7fedb4009060).stop 2023-08-17T00:16:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 -- 172.21.15.153:0/342235988 shutdown_connections 2023-08-17T00:16:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/342235988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc4153ab0 0x7fedc4153e90 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 -- 172.21.15.153:0/342235988 >> 172.21.15.153:0/342235988 conn(0x7fedc4061fa0 msgr2=0x7fedc40623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:57.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 -- 172.21.15.153:0/342235988 shutdown_connections 2023-08-17T00:16:57.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 -- 172.21.15.153:0/342235988 wait complete. 2023-08-17T00:16:57.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.707+0000 7fedc9fa9700 1 Processor -- start 2023-08-17T00:16:57.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 -- start start 2023-08-17T00:16:57.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 0x7fedc4156510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc40c8d50 0x7fedc41580f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc4153ab0 0x7fedc41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40c3950 con 0x7fedc40c7ba0 2023-08-17T00:16:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40c3c30 con 0x7fedc40c8d50 2023-08-17T00:16:57.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40c3f10 con 0x7fedc4153ab0 2023-08-17T00:16:57.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 0x7fedc4156510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:57.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 0x7fedc4156510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37654/0 (socket says 172.21.15.153:37654) 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 -- 172.21.15.153:0/2332580110 learned_addr learned my addr 172.21.15.153:0/2332580110 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedbbfff700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc40c8d50 0x7fedc41580f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc3fff700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc4153ab0 0x7fedc41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 -- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc4153ab0 msgr2=0x7fedc41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc4153ab0 0x7fedc41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 -- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc40c8d50 msgr2=0x7fedc41580f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc40c8d50 0x7fedc41580f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 -- 172.21.15.153:0/2332580110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40092a0 con 0x7fedc40c7ba0 2023-08-17T00:16:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc37fe700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 0x7fedc4156510 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7fedb4009e00 tx=0x7fedb4017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb4011af0 con 0x7fedc40c7ba0 2023-08-17T00:16:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb4011c50 con 0x7fedc40c7ba0 2023-08-17T00:16:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb401b440 con 0x7fedc40c7ba0 2023-08-17T00:16:57.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc40c41f0 con 0x7fedc40c7ba0 2023-08-17T00:16:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.711+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc40c34e0 con 0x7fedc40c7ba0 2023-08-17T00:16:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.715+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc40ade50 con 0x7fedc40c7ba0 2023-08-17T00:16:57.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.715+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fedb400f070 con 0x7fedc40c7ba0 2023-08-17T00:16:57.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.715+0000 7fedbb7fe700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a180 0x7feda405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:57.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.719+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fedb40754e0 con 0x7fedc40c7ba0 2023-08-17T00:16:57.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.719+0000 7fedbbfff700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a180 0x7feda405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:57.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.719+0000 7fedbbfff700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a180 0x7feda405c640 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fedc40cb700 tx=0x7fedac009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:57.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.723+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fedc40ade50 con 0x7fedc40c7ba0 2023-08-17T00:16:57.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.887+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fedc40ade50 con 0x7fedc40c7ba0 2023-08-17T00:16:57.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.895+0000 7fedbb7fe700 1 -- 172.21.15.153:0/2332580110 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7fedc40ade50 con 0x7fedc40c7ba0 2023-08-17T00:16:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a180 msgr2=0x7feda405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a180 0x7feda405c640 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 rx=0x7fedc40cb700 tx=0x7fedac009040).stop 2023-08-17T00:16:57.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 msgr2=0x7fedc4156510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 0x7fedc4156510 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 rx=0x7fedb4009e00 tx=0x7fedb4017000).stop 2023-08-17T00:16:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 shutdown_connections 2023-08-17T00:16:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feda405a180 0x7feda405c640 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedc4153ab0 0x7fedc41585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedc40c8d50 0x7fedc41580f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 --2- 172.21.15.153:0/2332580110 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fedc40c7ba0 0x7fedc4156510 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:57.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 >> 172.21.15.153:0/2332580110 conn(0x7fedc4061fa0 msgr2=0x7fedc40cadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:57.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 shutdown_connections 2023-08-17T00:16:57.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:57.899+0000 7fedc9fa9700 1 -- 172.21.15.153:0/2332580110 wait complete. 2023-08-17T00:16:57.927 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:16:57.928 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:57.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:16:58.015 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:16:58.015 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-17T00:16:58.016 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:16:58.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 Processor -- start 2023-08-17T00:16:58.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 -- start start 2023-08-17T00:16:58.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0abf10 0x7ff05c068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff05c0ac2f0 0x7ff05c068d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff05c0c0a80 0x7ff05c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c069200 con 0x7ff05c0ac2f0 2023-08-17T00:16:58.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c1545e0 con 0x7ff05c0c0a80 2023-08-17T00:16:58.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.171+0000 7ff060ee4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0a96d0 con 0x7ff05c0abf10 2023-08-17T00:16:58.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff05c0ac2f0 0x7ff05c068d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff05c0ac2f0 0x7ff05c068d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37668/0 (socket says 172.21.15.153:37668) 2023-08-17T00:16:58.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 -- 172.21.15.153:0/1748054092 learned_addr learned my addr 172.21.15.153:0/1748054092 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:58.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05b7fe700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0abf10 0x7ff05c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 -- 172.21.15.153:0/1748054092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0abf10 msgr2=0x7ff05c068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:58.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0abf10 0x7ff05c068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 -- 172.21.15.153:0/1748054092 >> v2:172.21.15.178:3300/0 conn(0x7ff05c0c0a80 msgr2=0x7ff05c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:58.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05bfff700 1 --2- 172.21.15.153:0/1748054092 >> v2:172.21.15.178:3300/0 conn(0x7ff05c0c0a80 0x7ff05c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 --2- 172.21.15.153:0/1748054092 >> v2:172.21.15.178:3300/0 conn(0x7ff05c0c0a80 0x7ff05c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 -- 172.21.15.153:0/1748054092 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c0c1c50 con 0x7ff05c0ac2f0 2023-08-17T00:16:58.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05b7fe700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0abf10 0x7ff05c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:58.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05bfff700 1 --2- 172.21.15.153:0/1748054092 >> v2:172.21.15.178:3300/0 conn(0x7ff05c0c0a80 0x7ff05c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:16:58.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05affd700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0ac2f0 0x7ff05c068d10 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7ff05c0bd530 tx=0x7ff0500090f0).ready entity=mon.0 client_cookie=4c172ada59a1874f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:58.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05a7fc700 1 -- 172.21.15.153:0/1748054092 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000b600 con 0x7ff05c0ac2f0 2023-08-17T00:16:58.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05a7fc700 1 -- 172.21.15.153:0/1748054092 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05000b760 con 0x7ff05c0ac2f0 2023-08-17T00:16:58.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff05a7fc700 1 -- 172.21.15.153:0/1748054092 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05000bb00 con 0x7ff05c0ac2f0 2023-08-17T00:16:58.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 -- 172.21.15.153:0/1748054092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0ac2f0 msgr2=0x7ff05c068d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0ac2f0 0x7ff05c068d10 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 rx=0x7ff05c0bd530 tx=0x7ff0500090f0).stop 2023-08-17T00:16:58.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 -- 172.21.15.153:0/1748054092 shutdown_connections 2023-08-17T00:16:58.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 --2- 172.21.15.153:0/1748054092 >> v2:172.21.15.178:3300/0 conn(0x7ff05c0c0a80 0x7ff05c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0ac2f0 0x7ff05c068d10 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 --2- 172.21.15.153:0/1748054092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0abf10 0x7ff05c068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 -- 172.21.15.153:0/1748054092 >> 172.21.15.153:0/1748054092 conn(0x7ff05c0c6620 msgr2=0x7ff05c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:58.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 -- 172.21.15.153:0/1748054092 shutdown_connections 2023-08-17T00:16:58.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.175+0000 7ff060ee4700 1 -- 172.21.15.153:0/1748054092 wait complete. 2023-08-17T00:16:58.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 Processor -- start 2023-08-17T00:16:58.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 -- start start 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 0x7ff05c0c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0ac2f0 0x7ff05c158cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c0c0a80 0x7ff05c0aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0c0570 con 0x7ff05c0abf10 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c14b740 con 0x7ff05c0c0a80 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff060ee4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0bc450 con 0x7ff05c0ac2f0 2023-08-17T00:16:58.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 0x7ff05c0c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 0x7ff05c0c0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37680/0 (socket says 172.21.15.153:37680) 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 -- 172.21.15.153:0/4008008347 learned_addr learned my addr 172.21.15.153:0/4008008347 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05affd700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0ac2f0 0x7ff05c158cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05bfff700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c0c0a80 0x7ff05c0aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 -- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0ac2f0 msgr2=0x7ff05c158cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0ac2f0 0x7ff05c158cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 -- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c0c0a80 msgr2=0x7ff05c0aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c0c0a80 0x7ff05c0aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 -- 172.21.15.153:0/4008008347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050009370 con 0x7ff05c0abf10 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.179+0000 7ff05b7fe700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 0x7ff05c0c0080 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7ff04c00c8b0 tx=0x7ff04c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c010580 con 0x7ff05c0abf10 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c0106e0 con 0x7ff05c0abf10 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c0bc730 con 0x7ff05c0abf10 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c010a60 con 0x7ff05c0abf10 2023-08-17T00:16:58.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c0bd5a0 con 0x7ff05c0abf10 2023-08-17T00:16:58.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c06b4c0 con 0x7ff05c0abf10 2023-08-17T00:16:58.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff04c01a410 con 0x7ff05c0abf10 2023-08-17T00:16:58.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff0437fe700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04805a120 0x7ff04805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.183+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5355+0+0 (secure 0 0 0) 0x7ff04c0737f0 con 0x7ff05c0abf10 2023-08-17T00:16:58.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.187+0000 7ff05affd700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04805a120 0x7ff04805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.187+0000 7ff05affd700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04805a120 0x7ff04805c5e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7ff05c0bd530 tx=0x7ff050017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:58.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.191+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff04c047540 con 0x7ff05c0abf10 2023-08-17T00:16:58.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.383+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff05c05e300 con 0x7ff05c0abf10 2023-08-17T00:16:58.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff0437fe700 1 -- 172.21.15.153:0/4008008347 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 140 v140) v1 ==== 95+0+3544 (secure 0 0 0) 0x7ff04c04ab60 con 0x7ff05c0abf10 2023-08-17T00:16:58.394 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:16:58.394 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":140,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8114,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/836759523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":836759523},{"type":"v1","addr":"172.21.15.178:6836","nonce":836759523}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":8117,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1894174681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1894174681},{"type":"v1","addr":"172.21.15.178:6837","nonce":1894174681}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":9786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/2582700154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":2582700154},{"type":"v1","addr":"172.21.15.153:6834","nonce":2582700154}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":133},{"gid":10086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/1234132710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":1234132710},{"type":"v1","addr":"172.21.15.153:6835","nonce":1234132710}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139}],"filesystems":[]} 2023-08-17T00:16:58.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04805a120 msgr2=0x7ff04805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04805a120 0x7ff04805c5e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7ff05c0bd530 tx=0x7ff050017000).stop 2023-08-17T00:16:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 msgr2=0x7ff05c0c0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 0x7ff05c0c0080 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 rx=0x7ff04c00c8b0 tx=0x7ff04c008040).stop 2023-08-17T00:16:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 shutdown_connections 2023-08-17T00:16:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff04805a120 0x7ff04805c5e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff05c0c0a80 0x7ff05c0aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff05c0ac2f0 0x7ff05c158cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 --2- 172.21.15.153:0/4008008347 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff05c0abf10 0x7ff05c0c0080 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 >> 172.21.15.153:0/4008008347 conn(0x7ff05c0c6620 msgr2=0x7ff05c0c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:58.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 shutdown_connections 2023-08-17T00:16:58.399 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.387+0000 7ff060ee4700 1 -- 172.21.15.153:0/4008008347 wait complete. 2023-08-17T00:16:58.400 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 140 2023-08-17T00:16:58.416 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-17T00:16:58.417 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-17T00:16:58.417 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:16:58.417 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:58.417 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-17T00:16:58.418 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-17T00:16:58.418 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:16:58.418 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:58.418 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-17T00:16:58.418 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-17T00:16:58.419 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:16:58.419 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:58.419 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-17T00:16:58.419 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-17T00:16:58.420 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:16:58.420 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:16:58.434 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:16:58.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-17T00:16:58.438 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:16:58.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-17T00:16:58.442 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:16:58.443 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-17T00:16:58.443 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:16:58.444 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-17T00:16:58.493 INFO:tasks.ceph.mds.b:Started 2023-08-17T00:16:58.494 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:58.495 INFO:tasks.ceph.mds.a:Started 2023-08-17T00:16:58.496 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:58.497 INFO:tasks.ceph.mds.d:Started 2023-08-17T00:16:58.498 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:58.499 INFO:tasks.ceph.mds.c:Started 2023-08-17T00:16:58.500 DEBUG:teuthology.parallel:result is None 2023-08-17T00:16:58.500 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-17T00:16:58.600 INFO:tasks.ceph.mds.a.smithi153.stdout:starting mds.a at 2023-08-17T00:16:58.601 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:16:58.605 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2023-08-17T00:16:58.605 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2023-08-17T00:16:58.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885a39700 1 Processor -- start 2023-08-17T00:16:58.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885a39700 1 -- start start 2023-08-17T00:16:58.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800c5ea0 0x7fc8800634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885a39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc880154e90 con 0x7fc8800639a0 2023-08-17T00:16:58.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885a39700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc880063e10 con 0x7fc8800acf30 2023-08-17T00:16:58.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800c1730 con 0x7fc8800c5ea0 2023-08-17T00:16:58.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885238700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc8800639a0 0x7fc8800bfad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46148/0 (socket says 172.21.15.153:46148) 2023-08-17T00:16:58.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc885238700 1 -- 172.21.15.153:0/3425865576 learned_addr learned my addr 172.21.15.153:0/3425865576 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc884a37700 1 --1- 172.21.15.153:0/3425865576 >> v1:172.21.15.178:6789/0 conn(0x7fc8800acf30 0x7fc8800c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:34816/0 (socket says 172.21.15.153:34816) 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87ffff700 1 --2- 172.21.15.153:0/3425865576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800c5ea0 0x7fc8800634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198227384 0 0) 0x7fc880154e90 con 0x7fc8800639a0 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8700033f0 con 0x7fc8800639a0 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138251743 0 0) 0x7fc880063e10 con 0x7fc8800acf30 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc880154e90 con 0x7fc8800acf30 2023-08-17T00:16:58.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87ffff700 1 -- 172.21.15.153:0/3425865576 >> v1:172.21.15.178:6789/0 conn(0x7fc8800acf30 legacy=0x7fc8800c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87ffff700 1 -- 172.21.15.153:0/3425865576 >> v1:172.21.15.153:6789/0 conn(0x7fc8800639a0 legacy=0x7fc8800bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87ffff700 1 -- 172.21.15.153:0/3425865576 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc880153fc0 con 0x7fc8800c5ea0 2023-08-17T00:16:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.639+0000 7fc87ffff700 1 --2- 172.21.15.153:0/3425865576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800c5ea0 0x7fc8800634b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fc86c009790 tx=0x7fc86c009060).ready entity=mon.2 client_cookie=a77f5d1097731145 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c0090d0 con 0x7fc8800c5ea0 2023-08-17T00:16:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c00f510 con 0x7fc8800c5ea0 2023-08-17T00:16:58.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc87f7fe700 1 -- 172.21.15.153:0/3425865576 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f890 con 0x7fc8800c5ea0 2023-08-17T00:16:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 -- 172.21.15.153:0/3425865576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800c5ea0 msgr2=0x7fc8800634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 --2- 172.21.15.153:0/3425865576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800c5ea0 0x7fc8800634b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fc86c009790 tx=0x7fc86c009060).stop 2023-08-17T00:16:58.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 -- 172.21.15.153:0/3425865576 shutdown_connections 2023-08-17T00:16:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 --2- 172.21.15.153:0/3425865576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800c5ea0 0x7fc8800634b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 -- 172.21.15.153:0/3425865576 >> 172.21.15.153:0/3425865576 conn(0x7fc8800cb330 msgr2=0x7fc8800c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 -- 172.21.15.153:0/3425865576 shutdown_connections 2023-08-17T00:16:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 -- 172.21.15.153:0/3425865576 wait complete. 2023-08-17T00:16:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 Processor -- start 2023-08-17T00:16:58.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.643+0000 7fc885a39700 1 -- start start 2023-08-17T00:16:58.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 0x7fc8800c1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800acf30 0x7fc8801505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8800c3aa0 0x7fc8800c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800aef40 con 0x7fc8800639a0 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800c44f0 con 0x7fc8800c3aa0 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8800af1c0 con 0x7fc8800acf30 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 0x7fc8800c1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 0x7fc8800c1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37724/0 (socket says 172.21.15.153:37724) 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 -- 172.21.15.153:0/179394610 learned_addr learned my addr 172.21.15.153:0/179394610 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:58.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc87ffff700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800acf30 0x7fc8801505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885238700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8800c3aa0 0x7fc8800c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 -- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800acf30 msgr2=0x7fc8801505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800acf30 0x7fc8801505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 -- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8800c3aa0 msgr2=0x7fc8800c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8800c3aa0 0x7fc8800c3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 -- 172.21.15.153:0/179394610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c0092a0 con 0x7fc8800639a0 2023-08-17T00:16:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc884a37700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 0x7fc8800c1930 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fc87400c440 tx=0x7fc874007d80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:58.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740070d0 con 0x7fc8800639a0 2023-08-17T00:16:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc874007230 con 0x7fc8800639a0 2023-08-17T00:16:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8800af4a0 con 0x7fc8800639a0 2023-08-17T00:16:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8740056e0 con 0x7fc8800639a0 2023-08-17T00:16:58.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.647+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc880165130 con 0x7fc8800639a0 2023-08-17T00:16:58.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.651+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc88006b4c0 con 0x7fc8800639a0 2023-08-17T00:16:58.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.651+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc874010070 con 0x7fc8800639a0 2023-08-17T00:16:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.651+0000 7fc87cff9700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86405a150 0x7fc86405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.651+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5355+0+0 (secure 0 0 0) 0x7fc874073410 con 0x7fc8800639a0 2023-08-17T00:16:58.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.651+0000 7fc87ffff700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86405a150 0x7fc86405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:58.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.655+0000 7fc87ffff700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86405a150 0x7fc86405c610 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc86c009fd0 tx=0x7fc86c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:58.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.659+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc8740471c0 con 0x7fc8800639a0 2023-08-17T00:16:58.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:58.831+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc880154280 con 0x7fc8800639a0 2023-08-17T00:16:59.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.647+0000 7fc87cff9700 1 -- 172.21.15.153:0/179394610 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v188) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc87404a7e0 con 0x7fc8800639a0 2023-08-17T00:16:59.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86405a150 msgr2=0x7fc86405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86405a150 0x7fc86405c610 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 rx=0x7fc86c009fd0 tx=0x7fc86c017000).stop 2023-08-17T00:16:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 msgr2=0x7fc8800c1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 0x7fc8800c1930 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 rx=0x7fc87400c440 tx=0x7fc874007d80).stop 2023-08-17T00:16:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 shutdown_connections 2023-08-17T00:16:59.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc86405a150 0x7fc86405c610 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8800c3aa0 0x7fc8800c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8800acf30 0x7fc8801505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 --2- 172.21.15.153:0/179394610 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc8800639a0 0x7fc8800c1930 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 >> 172.21.15.153:0/179394610 conn(0x7fc8800cb330 msgr2=0x7fc880152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:59.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 shutdown_connections 2023-08-17T00:16:59.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.655+0000 7fc885a39700 1 -- 172.21.15.153:0/179394610 wait complete. 2023-08-17T00:16:59.665 INFO:teuthology.orchestra.run.smithi153.stderr: removed all blocklist entries 2023-08-17T00:16:59.684 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-17T00:16:59.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.835+0000 7f4d09e8f700 1 Processor -- start 2023-08-17T00:16:59.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.835+0000 7f4d09e8f700 1 -- start start 2023-08-17T00:16:59.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d09e8f700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d040689c0 0x7f4d04068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d09e8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d040c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d09e8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d04151530 0x7f4d041519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d09e8f700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d04065da0 con 0x7f4d040689c0 2023-08-17T00:16:59.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d09e8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d04155c60 con 0x7f4d04151530 2023-08-17T00:16:59.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d09e8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04156550 con 0x7f4d041560f0 2023-08-17T00:16:59.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d08e8d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d040689c0 0x7f4d04068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d08e8d700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d040689c0 0x7f4d04068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37740/0 (socket says 172.21.15.153:37740) 2023-08-17T00:16:59.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d08e8d700 1 -- 172.21.15.153:0/127268371 learned_addr learned my addr 172.21.15.153:0/127268371 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:59.850 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d0968e700 1 --2- 172.21.15.153:0/127268371 >> v2:172.21.15.178:3300/0 conn(0x7f4d04151530 0x7f4d041519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4cfbfff700 1 --2- 172.21.15.153:0/127268371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d040c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.839+0000 7f4d08e8d700 1 -- 172.21.15.153:0/127268371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 msgr2=0x7f4d040c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:59.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d08e8d700 1 --2- 172.21.15.153:0/127268371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d040c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d08e8d700 1 -- 172.21.15.153:0/127268371 >> v2:172.21.15.178:3300/0 conn(0x7f4d04151530 msgr2=0x7f4d041519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:16:59.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d08e8d700 1 --2- 172.21.15.153:0/127268371 >> v2:172.21.15.178:3300/0 conn(0x7f4d04151530 0x7f4d041519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d08e8d700 1 -- 172.21.15.153:0/127268371 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04065ff0 con 0x7f4d040689c0 2023-08-17T00:16:59.852 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d08e8d700 1 --2- 172.21.15.153:0/127268371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04068da0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f4d04063720 tx=0x7f4d00009840).ready entity=mon.0 client_cookie=d77afabab7dd9893 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:59.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/127268371 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000e070 con 0x7f4d040689c0 2023-08-17T00:16:59.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/127268371 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d000098b0 con 0x7f4d040689c0 2023-08-17T00:16:59.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4cfb7fe700 1 -- 172.21.15.153:0/127268371 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000bb80 con 0x7f4d040689c0 2023-08-17T00:16:59.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 -- 172.21.15.153:0/127268371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 msgr2=0x7f4d04068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/127268371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04068da0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 rx=0x7f4d04063720 tx=0x7f4d00009840).stop 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 -- 172.21.15.153:0/127268371 shutdown_connections 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/127268371 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d040c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/127268371 >> v2:172.21.15.178:3300/0 conn(0x7f4d04151530 0x7f4d041519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/127268371 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04068da0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 -- 172.21.15.153:0/127268371 >> 172.21.15.153:0/127268371 conn(0x7f4d040c6620 msgr2=0x7f4d040c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:16:59.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 -- 172.21.15.153:0/127268371 shutdown_connections 2023-08-17T00:16:59.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.843+0000 7f4d09e8f700 1 -- 172.21.15.153:0/127268371 wait complete. 2023-08-17T00:16:59.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 Processor -- start 2023-08-17T00:16:59.856 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 -- start start 2023-08-17T00:16:59.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04151530 0x7f4d04165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d04152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04152a40 con 0x7f4d040689c0 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d040bbf50 con 0x7f4d04151530 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.847+0000 7f4d09e8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04169700 con 0x7f4d041560f0 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04169210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37754/0 (socket says 172.21.15.153:37754) 2023-08-17T00:16:59.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 -- 172.21.15.153:0/496097950 learned_addr learned my addr 172.21.15.153:0/496097950 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:16:59.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d0968e700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d04152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4cfbfff700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04151530 0x7f4d04165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 -- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 msgr2=0x7f4d04152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:59.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d04152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 -- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04151530 msgr2=0x7f4d04165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:16:59.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04151530 0x7f4d04165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:16:59.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 -- 172.21.15.153:0/496097950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00009a80 con 0x7f4d040689c0 2023-08-17T00:16:59.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4cfbfff700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04151530 0x7f4d04165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:16:59.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d08e8d700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04169210 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f4d0000b610 tx=0x7f4d00009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:59.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00013880 con 0x7f4d040689c0 2023-08-17T00:16:59.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d000139e0 con 0x7f4d040689c0 2023-08-17T00:16:59.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00013da0 con 0x7f4d040689c0 2023-08-17T00:16:59.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d04151e30 con 0x7f4d040689c0 2023-08-17T00:16:59.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d041523f0 con 0x7f4d040689c0 2023-08-17T00:16:59.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.851+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0406b4c0 con 0x7f4d040689c0 2023-08-17T00:16:59.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.855+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d00024030 con 0x7f4d040689c0 2023-08-17T00:16:59.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.855+0000 7f4cf8ff9700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf005a150 0x7f4cf005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:16:59.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.855+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4d00074fe0 con 0x7f4d040689c0 2023-08-17T00:16:59.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.855+0000 7f4cfbfff700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf005a150 0x7f4cf005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:16:59.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.859+0000 7f4cfbfff700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf005a150 0x7f4cf005c610 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f4d040a7d40 tx=0x7f4cf4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:16:59.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:16:59.859+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d000a38f0 con 0x7f4d040689c0 2023-08-17T00:17:00.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.071+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4d040662d0 con 0x7f4d040689c0 2023-08-17T00:17:00.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.071+0000 7f4cf8ff9700 1 -- 172.21.15.153:0/496097950 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4d00022030 con 0x7f4d040689c0 2023-08-17T00:17:00.080 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:00.080 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "auth_dump": [ 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.a", 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kx/VlFxAA7VTc9DS3HaaGfAi/FAzxeQ==", 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.081 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.b", 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kkgGDKRAA4eTSIU/RJQh+2Vyuh2v6Bg==", 2023-08-17T00:17:00.082 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.083 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.c", 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kPTrEIRAARvFqMSEOA9LPv7xysqB7Kg==", 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:17:00.084 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mds.d", 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kxGfFMxAAVZ5fBKrUmDNaIrWGVgRDdQ==", 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.085 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.086 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.0", 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBsY91kyGl2IxAAFOO/ZPMj+QeKcsbSgzy7LQ==", 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.087 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.1", 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBwY91k9Ni9EBAA/8gh+LE+v9naTWSowpfIlg==", 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.088 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.2", 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBzY91kpfdyKxAA5GRlhDwzzGcpoobpUjgNUg==", 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.089 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.3", 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB3Y91kbk2hGBAAkw6R6zh3IAgbgA6cEynJcg==", 2023-08-17T00:17:00.090 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.091 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.4", 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQB8Y91klM50FBAALp+sr5cgKXdNzAjIRyqNkQ==", 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.092 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.5", 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCAY91kuLRtARAA4M5RN4FR2bqEAoAnUshwaw==", 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.093 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.6", 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCDY91kkoTgKBAAvVNq/hi/ykl0mVKv4GeZLA==", 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.094 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "osd.7", 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQCHY91k8xRCBhAAUK50z9XhW35ldZmx322JfQ==", 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.095 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow profile osd", 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile osd", 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.0", 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kZ4JpOhAAbXw/0veJqwMu6fbQ7Qha/Q==", 2023-08-17T00:17:00.096 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow r", 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.097 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.1", 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kUoFrCRAAlfKtX8Qc7zEjvLhEC53eig==", 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.098 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.2", 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91k84XtAxAAdwfp/XFD0JyBmCfjiHjqsQ==", 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:17:00.099 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.3", 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBpY91kMnbaDhAABqBzO2B6sc/6PM9gsWzZYA==", 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.100 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow", 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow r", 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow rw", 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow rwx" 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.101 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "client.admin", 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBnY91kfbcUHhAATQTqNuUy4bsgpjS35RSzeQ==", 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mgr": "allow *", 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow *", 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.102 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.x", 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91kLg8qERAASg0mrZJiLcXErGLCoTHd1A==", 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:17:00.103 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "entity": "mgr.y", 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "key": "AQBoY91knxISCxAANyYm90y5zfezDWmJ2egqNA==", 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "caps": { 2023-08-17T00:17:00.104 INFO:teuthology.orchestra.run.smithi153.stdout: "mds": "allow *", 2023-08-17T00:17:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "mon": "allow profile mgr", 2023-08-17T00:17:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: "osd": "allow *" 2023-08-17T00:17:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:00.105 INFO:teuthology.orchestra.run.smithi153.stdout: ] 2023-08-17T00:17:00.105 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf005a150 msgr2=0x7f4cf005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf005a150 0x7f4cf005c610 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f4d040a7d40 tx=0x7f4cf4008040).stop 2023-08-17T00:17:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 msgr2=0x7f4d04169210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04169210 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 rx=0x7f4d0000b610 tx=0x7f4d00009840).stop 2023-08-17T00:17:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 shutdown_connections 2023-08-17T00:17:00.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4cf005a150 0x7f4cf005c610 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d041560f0 0x7f4d04152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d04151530 0x7f4d04165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 --2- 172.21.15.153:0/496097950 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d040689c0 0x7f4d04169210 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 >> 172.21.15.153:0/496097950 conn(0x7f4d040c6620 msgr2=0x7f4d040a8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 shutdown_connections 2023-08-17T00:17:00.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.075+0000 7f4d09e8f700 1 -- 172.21.15.153:0/496097950 wait complete. 2023-08-17T00:17:00.109 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:17:00.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.255+0000 7fc411679700 1 Processor -- start 2023-08-17T00:17:00.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.255+0000 7fc411679700 1 -- start start 2023-08-17T00:17:00.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc411679700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc40c0689c0 0x7fc40c068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc411679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c0c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc411679700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc40c151530 0x7fc40c1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc411679700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c065da0 con 0x7fc40c151530 2023-08-17T00:17:00.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc411679700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc40c155c60 con 0x7fc40c0689c0 2023-08-17T00:17:00.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc411679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c156550 con 0x7fc40c1560f0 2023-08-17T00:17:00.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc40c151530 0x7fc40c1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc40c151530 0x7fc40c1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37770/0 (socket says 172.21.15.153:37770) 2023-08-17T00:17:00.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 -- 172.21.15.153:0/3616611248 learned_addr learned my addr 172.21.15.153:0/3616611248 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:00.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc4037fe700 1 --2- 172.21.15.153:0/3616611248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c0c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc40bfff700 1 --2- 172.21.15.153:0/3616611248 >> v2:172.21.15.178:3300/0 conn(0x7fc40c0689c0 0x7fc40c068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 -- 172.21.15.153:0/3616611248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 msgr2=0x7fc40c0c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 --2- 172.21.15.153:0/3616611248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c0c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 -- 172.21.15.153:0/3616611248 >> v2:172.21.15.178:3300/0 conn(0x7fc40c0689c0 msgr2=0x7fc40c068da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 --2- 172.21.15.153:0/3616611248 >> v2:172.21.15.178:3300/0 conn(0x7fc40c0689c0 0x7fc40c068da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 -- 172.21.15.153:0/3616611248 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40c065ff0 con 0x7fc40c151530 2023-08-17T00:17:00.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc410e78700 1 --2- 172.21.15.153:0/3616611248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c1519c0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7fc40c0c2d60 tx=0x7fc404009840).ready entity=mon.0 client_cookie=a6269caec9594d8f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:00.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc40b7fe700 1 -- 172.21.15.153:0/3616611248 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400e070 con 0x7fc40c151530 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc40b7fe700 1 -- 172.21.15.153:0/3616611248 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40400ba20 con 0x7fc40c151530 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.259+0000 7fc40b7fe700 1 -- 172.21.15.153:0/3616611248 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40400bda0 con 0x7fc40c151530 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 -- 172.21.15.153:0/3616611248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 msgr2=0x7fc40c1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 --2- 172.21.15.153:0/3616611248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c1519c0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 rx=0x7fc40c0c2d60 tx=0x7fc404009840).stop 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 -- 172.21.15.153:0/3616611248 shutdown_connections 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 --2- 172.21.15.153:0/3616611248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c0c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.271 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 --2- 172.21.15.153:0/3616611248 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c1519c0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 --2- 172.21.15.153:0/3616611248 >> v2:172.21.15.178:3300/0 conn(0x7fc40c0689c0 0x7fc40c068da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 -- 172.21.15.153:0/3616611248 >> 172.21.15.153:0/3616611248 conn(0x7fc40c0c6620 msgr2=0x7fc40c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 -- 172.21.15.153:0/3616611248 shutdown_connections 2023-08-17T00:17:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 -- 172.21.15.153:0/3616611248 wait complete. 2023-08-17T00:17:00.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 Processor -- start 2023-08-17T00:17:00.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.263+0000 7fc411679700 1 -- start start 2023-08-17T00:17:00.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40c0689c0 0x7fc40c153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c0a0150 con 0x7fc40c151530 2023-08-17T00:17:00.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c153d10 con 0x7fc40c0689c0 2023-08-17T00:17:00.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40c09f820 con 0x7fc40c1560f0 2023-08-17T00:17:00.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37776/0 (socket says 172.21.15.153:37776) 2023-08-17T00:17:00.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 -- 172.21.15.153:0/973850474 learned_addr learned my addr 172.21.15.153:0/973850474 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:00.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc40bfff700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40c0689c0 0x7fc40c153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc410e78700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 -- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 msgr2=0x7fc40c150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 -- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40c0689c0 msgr2=0x7fc40c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40c0689c0 0x7fc40c153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 -- 172.21.15.153:0/973850474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009ae0 con 0x7fc40c151530 2023-08-17T00:17:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc40bfff700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40c0689c0 0x7fc40c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc4037fe700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c154b60 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7fc3f400e950 tx=0x7fc3f4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:00.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400c850 con 0x7fc40c151530 2023-08-17T00:17:00.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3f400c9b0 con 0x7fc40c151530 2023-08-17T00:17:00.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40c09fb00 con 0x7fc40c151530 2023-08-17T00:17:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3f400cd30 con 0x7fc40c151530 2023-08-17T00:17:00.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.267+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40c155050 con 0x7fc40c151530 2023-08-17T00:17:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.271+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40c06b4c0 con 0x7fc40c151530 2023-08-17T00:17:00.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.271+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc3f4022070 con 0x7fc40c151530 2023-08-17T00:17:00.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.271+0000 7fc408ff9700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3ec05a150 0x7fc3ec05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.271+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5269+0+0 (secure 0 0 0) 0x7fc3f4074330 con 0x7fc40c151530 2023-08-17T00:17:00.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.271+0000 7fc40bfff700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3ec05a150 0x7fc3ec05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.275+0000 7fc40bfff700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3ec05a150 0x7fc3ec05c610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fc3fc00baa0 tx=0x7fc3fc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:00.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.279+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc3f4048020 con 0x7fc40c151530 2023-08-17T00:17:00.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.439+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc40c063750 con 0x7fc40c151530 2023-08-17T00:17:00.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.439+0000 7fc408ff9700 1 -- 172.21.15.153:0/973850474 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+13770 (secure 0 0 0) 0x7fc3f4016090 con 0x7fc40c151530 2023-08-17T00:17:00.449 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:00.449 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":188,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:16:59.639910+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3ec05a150 msgr2=0x7fc3ec05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3ec05a150 0x7fc3ec05c610 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7fc3fc00baa0 tx=0x7fc3fc008040).stop 2023-08-17T00:17:00.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 msgr2=0x7fc40c154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c154b60 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 rx=0x7fc3f400e950 tx=0x7fc3f4009060).stop 2023-08-17T00:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 shutdown_connections 2023-08-17T00:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc3ec05a150 0x7fc3ec05c610 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc40c1560f0 0x7fc40c150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc40c151530 0x7fc40c154b60 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 --2- 172.21.15.153:0/973850474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc40c0689c0 0x7fc40c153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 >> 172.21.15.153:0/973850474 conn(0x7fc40c0c6620 msgr2=0x7fc40c0c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 shutdown_connections 2023-08-17T00:17:00.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.447+0000 7fc411679700 1 -- 172.21.15.153:0/973850474 wait complete. 2023-08-17T00:17:00.477 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-08-17T00:17:00.478 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:17:00.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.627+0000 7f4d6fb1b700 1 Processor -- start 2023-08-17T00:17:00.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.627+0000 7f4d6fb1b700 1 -- start start 2023-08-17T00:17:00.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6fb1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d680632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6fb1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d680a8f50 0x7f4d680629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6fb1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d680656d0 0x7f4d680bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6fb1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d68065240 con 0x7f4d680656d0 2023-08-17T00:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6fb1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d68062ea0 con 0x7f4d680a8f50 2023-08-17T00:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6fb1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680638a0 con 0x7f4d680a8b70 2023-08-17T00:17:00.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d680656d0 0x7f4d680bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6d8b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d680632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6d8b7700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d680632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:46922/0 (socket says 172.21.15.153:46922) 2023-08-17T00:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6d8b7700 1 -- 172.21.15.153:0/1076038336 learned_addr learned my addr 172.21.15.153:0/1076038336 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:00.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6d0b6700 1 --2- 172.21.15.153:0/1076038336 >> v2:172.21.15.178:3300/0 conn(0x7f4d680a8f50 0x7f4d680629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 -- 172.21.15.153:0/1076038336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 msgr2=0x7f4d680632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 --2- 172.21.15.153:0/1076038336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d680632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 -- 172.21.15.153:0/1076038336 >> v2:172.21.15.178:3300/0 conn(0x7f4d680a8f50 msgr2=0x7f4d680629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 --2- 172.21.15.153:0/1076038336 >> v2:172.21.15.178:3300/0 conn(0x7f4d680a8f50 0x7f4d680629b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 -- 172.21.15.153:0/1076038336 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d68064910 con 0x7f4d680656d0 2023-08-17T00:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.631+0000 7f4d6e0b8700 1 --2- 172.21.15.153:0/1076038336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680bbdc0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f4d68068340 tx=0x7f4d60009780).ready entity=mon.0 client_cookie=4aba2fefe05afea0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6c8b5700 1 -- 172.21.15.153:0/1076038336 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000e070 con 0x7f4d680656d0 2023-08-17T00:17:00.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6c8b5700 1 -- 172.21.15.153:0/1076038336 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000bb60 con 0x7f4d680656d0 2023-08-17T00:17:00.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6c8b5700 1 -- 172.21.15.153:0/1076038336 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60012410 con 0x7f4d680656d0 2023-08-17T00:17:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1076038336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 msgr2=0x7f4d680bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1076038336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680bbdc0 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 rx=0x7f4d68068340 tx=0x7f4d60009780).stop 2023-08-17T00:17:00.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1076038336 shutdown_connections 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1076038336 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680bbdc0 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1076038336 >> v2:172.21.15.178:3300/0 conn(0x7f4d680a8f50 0x7f4d680629b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1076038336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d680632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1076038336 >> 172.21.15.153:0/1076038336 conn(0x7f4d680c7150 msgr2=0x7f4d680c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1076038336 shutdown_connections 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.635+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1076038336 wait complete. 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 Processor -- start 2023-08-17T00:17:00.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 -- start start 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d68159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680a8f50 0x7f4d681597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6815a9d0 con 0x7f4d680656d0 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68159dc0 con 0x7f4d680a8f50 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.639+0000 7f4d6fb1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6815a0a0 con 0x7f4d680a8b70 2023-08-17T00:17:00.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680c5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37790/0 (socket says 172.21.15.153:37790) 2023-08-17T00:17:00.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 -- 172.21.15.153:0/1695354190 learned_addr learned my addr 172.21.15.153:0/1695354190 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:00.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d0b6700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d68159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6e0b8700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680a8f50 0x7f4d681597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 -- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 msgr2=0x7f4d68159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d68159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 -- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680a8f50 msgr2=0x7f4d681597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680a8f50 0x7f4d681597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 -- 172.21.15.153:0/1695354190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009a20 con 0x7f4d680656d0 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6e0b8700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680a8f50 0x7f4d681597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6d8b7700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680c5c30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f4d6400e8d0 tx=0x7f4d640090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:00.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64012600 con 0x7f4d680656d0 2023-08-17T00:17:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64012760 con 0x7f4d680656d0 2023-08-17T00:17:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d6815a380 con 0x7f4d680656d0 2023-08-17T00:17:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64012b20 con 0x7f4d680656d0 2023-08-17T00:17:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.643+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d680bf8c0 con 0x7f4d680656d0 2023-08-17T00:17:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.647+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6806b530 con 0x7f4d680656d0 2023-08-17T00:17:00.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.647+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d64022070 con 0x7f4d680656d0 2023-08-17T00:17:00.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.647+0000 7f4d5dffb700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a150 0x7f4d4c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:00.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.647+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f4d64074190 con 0x7f4d680656d0 2023-08-17T00:17:00.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.651+0000 7f4d6d0b6700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a150 0x7f4d4c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:00.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.651+0000 7f4d6d0b6700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a150 0x7f4d4c05c610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f4d680ac890 tx=0x7f4d58008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:00.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.655+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d64047e80 con 0x7f4d680656d0 2023-08-17T00:17:00.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.819+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4d680c3ab0 con 0x7f4d680656d0 2023-08-17T00:17:00.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.819+0000 7f4d5dffb700 1 -- 172.21.15.153:0/1695354190 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v188) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4d64016020 con 0x7f4d680656d0 2023-08-17T00:17:00.827 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:17:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a150 msgr2=0x7f4d4c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a150 0x7f4d4c05c610 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 rx=0x7f4d680ac890 tx=0x7f4d58008040).stop 2023-08-17T00:17:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 msgr2=0x7f4d680c5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:00.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680c5c30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 rx=0x7f4d6400e8d0 tx=0x7f4d640090f0).stop 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 shutdown_connections 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d4c05a150 0x7f4d4c05c610 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d680a8f50 0x7f4d681597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d680a8b70 0x7f4d68159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 --2- 172.21.15.153:0/1695354190 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d680656d0 0x7f4d680c5c30 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 >> 172.21.15.153:0/1695354190 conn(0x7f4d680c7150 msgr2=0x7f4d680c1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 shutdown_connections 2023-08-17T00:17:00.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:00.823+0000 7f4d6fb1b700 1 -- 172.21.15.153:0/1695354190 wait complete. 2023-08-17T00:17:00.848 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.003+0000 7f2991639700 1 Processor -- start 2023-08-17T00:17:01.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.003+0000 7f2991639700 1 -- start start 2023-08-17T00:17:01.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2991639700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f298c068c80 0x7f298c0a9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2991639700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c1585a0 con 0x7f298c0a8df0 2023-08-17T00:17:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2991639700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c066400 con 0x7f298c068820 2023-08-17T00:17:01.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2991639700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0c1ba0 con 0x7f298c068c80 2023-08-17T00:17:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f298bfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f298c0a8df0 0x7f298c0c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46162/0 (socket says 172.21.15.153:46162) 2023-08-17T00:17:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f298bfff700 1 -- 172.21.15.153:0/1301759645 learned_addr learned my addr 172.21.15.153:0/1301759645 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2990e38700 1 --2- 172.21.15.153:0/1301759645 >> v2:172.21.15.153:3300/0 conn(0x7f298c068c80 0x7f298c0a9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f298b7fe700 1 -- 172.21.15.153:0/1301759645 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4018053823 0 0) 0x7f298c1585a0 con 0x7f298c0a8df0 2023-08-17T00:17:01.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f298b7fe700 1 -- 172.21.15.153:0/1301759645 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29780033f0 con 0x7f298c0a8df0 2023-08-17T00:17:01.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f298b7fe700 1 -- 172.21.15.153:0/1301759645 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 14242619 0 0) 0x7f298c066400 con 0x7f298c068820 2023-08-17T00:17:01.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2990e38700 1 -- 172.21.15.153:0/1301759645 >> v1:172.21.15.178:6789/0 conn(0x7f298c068820 legacy=0x7f298c0a96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2990e38700 1 -- 172.21.15.153:0/1301759645 >> v1:172.21.15.153:6789/0 conn(0x7f298c0a8df0 legacy=0x7f298c0c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2990e38700 1 -- 172.21.15.153:0/1301759645 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0b9d30 con 0x7f298c068c80 2023-08-17T00:17:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.007+0000 7f2990e38700 1 --2- 172.21.15.153:0/1301759645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c0a9de0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f2984009e60 tx=0x7f2984009780).ready entity=mon.0 client_cookie=19dc4f4eb644b604 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f298b7fe700 1 -- 172.21.15.153:0/1301759645 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400e070 con 0x7f298c068c80 2023-08-17T00:17:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f298b7fe700 1 -- 172.21.15.153:0/1301759645 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400bb60 con 0x7f298c068c80 2023-08-17T00:17:01.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f298b7fe700 1 -- 172.21.15.153:0/1301759645 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400bee0 con 0x7f298c068c80 2023-08-17T00:17:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 -- 172.21.15.153:0/1301759645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 msgr2=0x7f298c0a9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 --2- 172.21.15.153:0/1301759645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c0a9de0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 rx=0x7f2984009e60 tx=0x7f2984009780).stop 2023-08-17T00:17:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 -- 172.21.15.153:0/1301759645 shutdown_connections 2023-08-17T00:17:01.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 --2- 172.21.15.153:0/1301759645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c0a9de0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 -- 172.21.15.153:0/1301759645 >> 172.21.15.153:0/1301759645 conn(0x7f298c0c6620 msgr2=0x7f298c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 -- 172.21.15.153:0/1301759645 shutdown_connections 2023-08-17T00:17:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 -- 172.21.15.153:0/1301759645 wait complete. 2023-08-17T00:17:01.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 Processor -- start 2023-08-17T00:17:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.011+0000 7f2991639700 1 -- start start 2023-08-17T00:17:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c068820 0x7f298c159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0a8df0 0x7f298c0bc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c15a040 con 0x7f298c068c80 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0bb510 con 0x7f298c0a8df0 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c15b470 con 0x7f298c068820 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37798/0 (socket says 172.21.15.153:37798) 2023-08-17T00:17:01.022 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 -- 172.21.15.153:0/960108041 learned_addr learned my addr 172.21.15.153:0/960108041 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2990e38700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0a8df0 0x7f298c0bc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f298bfff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c068820 0x7f298c159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 -- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c068820 msgr2=0x7f298c159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c068820 0x7f298c159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 -- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0a8df0 msgr2=0x7f298c0bc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0a8df0 0x7f298c0bc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 -- 172.21.15.153:0/960108041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2984009a20 con 0x7f298c068c80 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f298bfff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c068820 0x7f298c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2983fff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c168dd0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f297400c410 tx=0x7f2974007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974007020 con 0x7f298c068c80 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29740071a0 con 0x7f298c068c80 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c1692c0 con 0x7f298c068c80 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974007560 con 0x7f298c068c80 2023-08-17T00:17:01.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c0babe0 con 0x7f298c068c80 2023-08-17T00:17:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.015+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298c06b4c0 con 0x7f298c068c80 2023-08-17T00:17:01.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.019+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2974010070 con 0x7f298c068c80 2023-08-17T00:17:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.019+0000 7f2988ff9700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f296c05a150 0x7f296c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.019+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f2974073200 con 0x7f298c068c80 2023-08-17T00:17:01.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.019+0000 7f298bfff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f296c05a150 0x7f296c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.019+0000 7f298bfff700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f296c05a150 0x7f296c05c610 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f297c000c00 tx=0x7f297c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.027+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2974046ef0 con 0x7f298c068c80 2023-08-17T00:17:01.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.183+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f298c064010 con 0x7f298c068c80 2023-08-17T00:17:01.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.183+0000 7f2988ff9700 1 -- 172.21.15.153:0/960108041 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v188) v1 ==== 92+0+10 (secure 0 0 0) 0x7f297404a510 con 0x7f298c068c80 2023-08-17T00:17:01.192 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:17:01.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f296c05a150 msgr2=0x7f296c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f296c05a150 0x7f296c05c610 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7f297c000c00 tx=0x7f297c009040).stop 2023-08-17T00:17:01.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 msgr2=0x7f298c168dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c168dd0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 rx=0x7f297400c410 tx=0x7f2974007e00).stop 2023-08-17T00:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 shutdown_connections 2023-08-17T00:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f296c05a150 0x7f296c05c610 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f298c0a8df0 0x7f298c0bc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f298c068c80 0x7f298c168dd0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 --2- 172.21.15.153:0/960108041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f298c068820 0x7f298c159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 >> 172.21.15.153:0/960108041 conn(0x7f298c0c6620 msgr2=0x7f298c0c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 shutdown_connections 2023-08-17T00:17:01.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.187+0000 7f2991639700 1 -- 172.21.15.153:0/960108041 wait complete. 2023-08-17T00:17:01.215 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-17T00:17:01.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.363+0000 7f31ccce4700 1 Processor -- start 2023-08-17T00:17:01.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.363+0000 7f31ccce4700 1 -- start start 2023-08-17T00:17:01.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31c8150880 0x7f31c80a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c80ab9b0 con 0x7f31c8068f30 2023-08-17T00:17:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c80aada0 con 0x7f31c80a8e60 2023-08-17T00:17:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c80ab080 con 0x7f31c8150880 2023-08-17T00:17:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31c8150880 0x7f31c80a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f31c8150880 0x7f31c80a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37808/0 (socket says 172.21.15.153:37808) 2023-08-17T00:17:01.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 -- 172.21.15.153:0/3452472325 learned_addr learned my addr 172.21.15.153:0/3452472325 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:01.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c7fff700 1 --1- 172.21.15.153:0/3452472325 >> v1:172.21.15.153:6789/0 conn(0x7f31c8068f30 0x7f31c8064670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46172/0 (socket says 172.21.15.153:46172) 2023-08-17T00:17:01.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 -- 172.21.15.153:0/3452472325 >> v1:172.21.15.178:6789/0 conn(0x7f31c80a8e60 legacy=0x7f31c8068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 -- 172.21.15.153:0/3452472325 >> v1:172.21.15.153:6789/0 conn(0x7f31c8068f30 legacy=0x7f31c8064670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 -- 172.21.15.153:0/3452472325 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c80ab360 con 0x7f31c8150880 2023-08-17T00:17:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c77fe700 1 --2- 172.21.15.153:0/3452472325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8150880 0x7f31c80a8970 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f31b8006fd0 tx=0x7f31b80090f0).ready entity=mon.0 client_cookie=ae8573e0bce22099 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c67fc700 1 -- 172.21.15.153:0/3452472325 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8009160 con 0x7f31c8150880 2023-08-17T00:17:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c67fc700 1 -- 172.21.15.153:0/3452472325 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800b600 con 0x7f31c8150880 2023-08-17T00:17:01.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31c67fc700 1 -- 172.21.15.153:0/3452472325 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800b980 con 0x7f31c8150880 2023-08-17T00:17:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 -- 172.21.15.153:0/3452472325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8150880 msgr2=0x7f31c80a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 --2- 172.21.15.153:0/3452472325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8150880 0x7f31c80a8970 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 rx=0x7f31b8006fd0 tx=0x7f31b80090f0).stop 2023-08-17T00:17:01.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 -- 172.21.15.153:0/3452472325 shutdown_connections 2023-08-17T00:17:01.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 --2- 172.21.15.153:0/3452472325 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8150880 0x7f31c80a8970 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.367+0000 7f31ccce4700 1 -- 172.21.15.153:0/3452472325 >> 172.21.15.153:0/3452472325 conn(0x7f31c80c6620 msgr2=0x7f31c80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:01.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.371+0000 7f31ccce4700 1 -- 172.21.15.153:0/3452472325 shutdown_connections 2023-08-17T00:17:01.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.371+0000 7f31ccce4700 1 -- 172.21.15.153:0/3452472325 wait complete. 2023-08-17T00:17:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.371+0000 7f31ccce4700 1 Processor -- start 2023-08-17T00:17:01.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.371+0000 7f31ccce4700 1 -- start start 2023-08-17T00:17:01.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 0x7f31c80bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c80a8e60 0x7f31c80c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8150880 0x7f31c80c0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8164530 con 0x7f31c8068f30 2023-08-17T00:17:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c80c1390 con 0x7f31c80a8e60 2023-08-17T00:17:01.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c8165000 con 0x7f31c8150880 2023-08-17T00:17:01.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 0x7f31c80bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 0x7f31c80bfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37814/0 (socket says 172.21.15.153:37814) 2023-08-17T00:17:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 -- 172.21.15.153:0/2650519900 learned_addr learned my addr 172.21.15.153:0/2650519900 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c6ffd700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c80a8e60 0x7f31c80c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 -- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8150880 msgr2=0x7f31c80c0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c7fff700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8150880 0x7f31c80c0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8150880 0x7f31c80c0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 -- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c80a8e60 msgr2=0x7f31c80c09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c80a8e60 0x7f31c80c09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 -- 172.21.15.153:0/2650519900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b8009310 con 0x7f31c8068f30 2023-08-17T00:17:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c6ffd700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c80a8e60 0x7f31c80c09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c7fff700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8150880 0x7f31c80c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:01.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31c77fe700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 0x7f31c80bfec0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f31c80669d0 tx=0x7f31b8017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b800b770 con 0x7f31c8068f30 2023-08-17T00:17:01.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b800b8d0 con 0x7f31c8068f30 2023-08-17T00:17:01.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b801b660 con 0x7f31c8068f30 2023-08-17T00:17:01.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8164710 con 0x7f31c8068f30 2023-08-17T00:17:01.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.375+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c8164a30 con 0x7f31c8068f30 2023-08-17T00:17:01.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.379+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c806b4c0 con 0x7f31c8068f30 2023-08-17T00:17:01.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.379+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f31b802b070 con 0x7f31c8068f30 2023-08-17T00:17:01.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.379+0000 7f31af7fe700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.379+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f31b8075780 con 0x7f31c8068f30 2023-08-17T00:17:01.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.379+0000 7f31c6ffd700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.383+0000 7f31c6ffd700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f31c80c1a00 tx=0x7f31bc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.387+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f31b8049470 con 0x7f31c8068f30 2023-08-17T00:17:01.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f31c80ab640 con 0x7f31c8068f30 2023-08-17T00:17:01.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31af7fe700 1 -- 172.21.15.153:0/2650519900 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v188) v1 ==== 84+0+143 (secure 0 0 0) 0x7f31b8029070 con 0x7f31c8068f30 2023-08-17T00:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout:[ 2023-08-17T00:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 1, 2023-08-17T00:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "device_health_metrics" 2023-08-17T00:17:01.559 INFO:teuthology.orchestra.run.smithi153.stdout: }, 2023-08-17T00:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: { 2023-08-17T00:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "poolnum": 2, 2023-08-17T00:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: "poolname": "rbd" 2023-08-17T00:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:01.560 INFO:teuthology.orchestra.run.smithi153.stdout:] 2023-08-17T00:17:01.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 msgr2=0x7f31b405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7f31c80c1a00 tx=0x7f31bc009040).stop 2023-08-17T00:17:01.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 msgr2=0x7f31c80bfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 0x7f31c80bfec0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 rx=0x7f31c80669d0 tx=0x7f31b8017000).stop 2023-08-17T00:17:01.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 shutdown_connections 2023-08-17T00:17:01.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f31b405a180 0x7f31b405c640 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31c8150880 0x7f31c80c0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f31c80a8e60 0x7f31c80c09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 --2- 172.21.15.153:0/2650519900 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f31c8068f30 0x7f31c80bfec0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.551+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 >> 172.21.15.153:0/2650519900 conn(0x7f31c80c6620 msgr2=0x7f31c80c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:01.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.555+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 shutdown_connections 2023-08-17T00:17:01.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.555+0000 7f31ccce4700 1 -- 172.21.15.153:0/2650519900 wait complete. 2023-08-17T00:17:01.579 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-17T00:17:01.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 64 --pg_num_min 64 2023-08-17T00:17:01.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731b59e700 1 Processor -- start 2023-08-17T00:17:01.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731b59e700 1 -- start start 2023-08-17T00:17:01.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f731c153d90 0x7f731c0a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c0c00d0 con 0x7f731c1539b0 2023-08-17T00:17:01.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731b59e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c0bf810 con 0x7f731c0cb450 2023-08-17T00:17:01.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c0639c0 con 0x7f731c153d90 2023-08-17T00:17:01.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731a59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f731c1539b0 0x7f731c0632b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46186/0 (socket says 172.21.15.153:46186) 2023-08-17T00:17:01.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f731a59c700 1 -- 172.21.15.153:0/3584305125 learned_addr learned my addr 172.21.15.153:0/3584305125 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:01.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.735+0000 7f7319d9b700 1 --2- 172.21.15.153:0/3584305125 >> v2:172.21.15.153:3300/0 conn(0x7f731c153d90 0x7f731c0a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771652304 0 0) 0x7f731c0c00d0 con 0x7f731c1539b0 2023-08-17T00:17:01.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73040033f0 con 0x7f731c1539b0 2023-08-17T00:17:01.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258293793 0 0) 0x7f731c0bf810 con 0x7f731c0cb450 2023-08-17T00:17:01.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f731c0c00d0 con 0x7f731c0cb450 2023-08-17T00:17:01.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f7319d9b700 1 -- 172.21.15.153:0/3584305125 >> v1:172.21.15.178:6789/0 conn(0x7f731c0cb450 legacy=0x7f731c0c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f7319d9b700 1 -- 172.21.15.153:0/3584305125 >> v1:172.21.15.153:6789/0 conn(0x7f731c1539b0 legacy=0x7f731c0632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852789941 0 0) 0x7f73040033f0 con 0x7f731c1539b0 2023-08-17T00:17:01.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f7319d9b700 1 -- 172.21.15.153:0/3584305125 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0aa910 con 0x7f731c153d90 2023-08-17T00:17:01.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f7319d9b700 1 --2- 172.21.15.153:0/3584305125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c153d90 0x7f731c0a97a0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f7310009760 tx=0x7f7310009060).ready entity=mon.0 client_cookie=1910d1efda4adabd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0015f0 con 0x7f731c153d90 2023-08-17T00:17:01.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310011400 con 0x7f731c153d90 2023-08-17T00:17:01.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731959a700 1 -- 172.21.15.153:0/3584305125 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310011780 con 0x7f731c153d90 2023-08-17T00:17:01.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 -- 172.21.15.153:0/3584305125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c153d90 msgr2=0x7f731c0a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 --2- 172.21.15.153:0/3584305125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c153d90 0x7f731c0a97a0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 rx=0x7f7310009760 tx=0x7f7310009060).stop 2023-08-17T00:17:01.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 -- 172.21.15.153:0/3584305125 shutdown_connections 2023-08-17T00:17:01.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 --2- 172.21.15.153:0/3584305125 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c153d90 0x7f731c0a97a0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 -- 172.21.15.153:0/3584305125 >> 172.21.15.153:0/3584305125 conn(0x7f731c062a10 msgr2=0x7f731c0ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:01.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 -- 172.21.15.153:0/3584305125 shutdown_connections 2023-08-17T00:17:01.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.739+0000 7f731b59e700 1 -- 172.21.15.153:0/3584305125 wait complete. 2023-08-17T00:17:01.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.743+0000 7f731b59e700 1 Processor -- start 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.743+0000 7f731b59e700 1 -- start start 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f731c0cb450 0x7f731c0a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 0x7f731c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f731c153d90 0x7f731c0c0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0a9ef0 con 0x7f731c1539b0 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c164240 con 0x7f731c0cb450 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c1515d0 con 0x7f731c153d90 2023-08-17T00:17:01.758 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 0x7f731c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 0x7f731c150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37846/0 (socket says 172.21.15.153:37846) 2023-08-17T00:17:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 -- 172.21.15.153:0/1045511037 learned_addr learned my addr 172.21.15.153:0/1045511037 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731a59c700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f731c0cb450 0x7f731c0a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 -- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f731c153d90 msgr2=0x7f731c0c0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731ad9d700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f731c153d90 0x7f731c0c0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f731c153d90 0x7f731c0c0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 -- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f731c0cb450 msgr2=0x7f731c0a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f731c0cb450 0x7f731c0a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 -- 172.21.15.153:0/1045511037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73100092a0 con 0x7f731c1539b0 2023-08-17T00:17:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731ad9d700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f731c153d90 0x7f731c0c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731a59c700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f731c0cb450 0x7f731c0a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:01.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f7319d9b700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 0x7f731c150d40 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f7310009d50 tx=0x7f7310016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73100108e0 con 0x7f731c1539b0 2023-08-17T00:17:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7310010a40 con 0x7f731c1539b0 2023-08-17T00:17:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7310010dc0 con 0x7f731c1539b0 2023-08-17T00:17:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c1518b0 con 0x7f731c1539b0 2023-08-17T00:17:01.761 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c151e70 con 0x7f731c1539b0 2023-08-17T00:17:01.762 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.747+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c046dd0 con 0x7f731c1539b0 2023-08-17T00:17:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.751+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f731000f070 con 0x7f731c1539b0 2023-08-17T00:17:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.751+0000 7f730a7fc700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72fc05a150 0x7f72fc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.751+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5269+0+0 (secure 0 0 0) 0x7f7310075210 con 0x7f731c1539b0 2023-08-17T00:17:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.751+0000 7f731a59c700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72fc05a150 0x7f72fc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:01.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.751+0000 7f731a59c700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72fc05a150 0x7f72fc05c610 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f730c000c00 tx=0x7f730c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:01.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.759+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7310049050 con 0x7f731c1539b0 2023-08-17T00:17:01.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:01.919+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64} v 0) v1 -- 0x7f731c0c09e0 con 0x7f731c1539b0 2023-08-17T00:17:02.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.555+0000 7f730a7fc700 1 -- 172.21.15.153:0/1045511037 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 64, "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v189) v1 ==== 152+0+0 (secure 0 0 0) 0x7f731004c630 con 0x7f731c1539b0 2023-08-17T00:17:02.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72fc05a150 msgr2=0x7f72fc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:02.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72fc05a150 0x7f72fc05c610 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f730c000c00 tx=0x7f730c009040).stop 2023-08-17T00:17:02.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 msgr2=0x7f731c150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:02.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 0x7f731c150d40 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 rx=0x7f7310009d50 tx=0x7f7310016000).stop 2023-08-17T00:17:02.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 shutdown_connections 2023-08-17T00:17:02.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f72fc05a150 0x7f72fc05c610 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f731c153d90 0x7f731c0c0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f731c1539b0 0x7f731c150d40 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 --2- 172.21.15.153:0/1045511037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f731c0cb450 0x7f731c0a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 >> 172.21.15.153:0/1045511037 conn(0x7f731c062a10 msgr2=0x7f731c0c9980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:02.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 shutdown_connections 2023-08-17T00:17:02.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.563+0000 7f731b59e700 1 -- 172.21.15.153:0/1045511037 wait complete. 2023-08-17T00:17:02.576 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' created 2023-08-17T00:17:02.593 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-17T00:17:02.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 Processor -- start 2023-08-17T00:17:02.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 -- start start 2023-08-17T00:17:02.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa5f00c57a0 0x7fa5f00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5f0153f50 0x7fa5f0154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f00bfd10 con 0x7fa5f0157600 2023-08-17T00:17:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f0154860 con 0x7fa5f0153f50 2023-08-17T00:17:02.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.759+0000 7fa5f5c39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f0154af0 con 0x7fa5f00c57a0 2023-08-17T00:17:02.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5f0153f50 0x7fa5f0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:02.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5438700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa5f0157600 0x7fa5f0157a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46188/0 (socket says 172.21.15.153:46188) 2023-08-17T00:17:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fa5f0153f50 0x7fa5f0154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37854/0 (socket says 172.21.15.153:37854) 2023-08-17T00:17:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5438700 1 -- 172.21.15.153:0/1620348094 learned_addr learned my addr 172.21.15.153:0/1620348094 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f4c37700 1 --2- 172.21.15.153:0/1620348094 >> v2:172.21.15.178:3300/0 conn(0x7fa5f00c57a0 0x7fa5f00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 -- 172.21.15.153:0/1620348094 >> v2:172.21.15.178:3300/0 conn(0x7fa5f00c57a0 msgr2=0x7fa5f00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 --2- 172.21.15.153:0/1620348094 >> v2:172.21.15.178:3300/0 conn(0x7fa5f00c57a0 0x7fa5f00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 -- 172.21.15.153:0/1620348094 >> v1:172.21.15.153:6789/0 conn(0x7fa5f0157600 legacy=0x7fa5f0157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5ef7fe700 1 -- 172.21.15.153:0/1620348094 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504935789 0 0) 0x7fa5f00bfd10 con 0x7fa5f0157600 2023-08-17T00:17:02.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 -- 172.21.15.153:0/1620348094 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0154dd0 con 0x7fa5f0153f50 2023-08-17T00:17:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5effff700 1 --2- 172.21.15.153:0/1620348094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f0153f50 0x7fa5f0154370 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7fa5f00c54c0 tx=0x7fa5dc009060).ready entity=mon.0 client_cookie=2312e922d0c4b2bf server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5ef7fe700 1 -- 172.21.15.153:0/1620348094 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00f510 con 0x7fa5f0153f50 2023-08-17T00:17:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5ef7fe700 1 -- 172.21.15.153:0/1620348094 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5dc00f670 con 0x7fa5f0153f50 2023-08-17T00:17:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5ef7fe700 1 -- 172.21.15.153:0/1620348094 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc00f9f0 con 0x7fa5f0153f50 2023-08-17T00:17:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 -- 172.21.15.153:0/1620348094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f0153f50 msgr2=0x7fa5f0154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:02.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/1620348094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f0153f50 0x7fa5f0154370 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 rx=0x7fa5f00c54c0 tx=0x7fa5dc009060).stop 2023-08-17T00:17:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 -- 172.21.15.153:0/1620348094 shutdown_connections 2023-08-17T00:17:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/1620348094 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f0153f50 0x7fa5f0154370 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/1620348094 >> v2:172.21.15.178:3300/0 conn(0x7fa5f00c57a0 0x7fa5f00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 -- 172.21.15.153:0/1620348094 >> 172.21.15.153:0/1620348094 conn(0x7fa5f0062a70 msgr2=0x7fa5f00ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 -- 172.21.15.153:0/1620348094 shutdown_connections 2023-08-17T00:17:02.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.763+0000 7fa5f5c39700 1 -- 172.21.15.153:0/1620348094 wait complete. 2023-08-17T00:17:02.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.767+0000 7fa5f5c39700 1 Processor -- start 2023-08-17T00:17:02.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.767+0000 7fa5f5c39700 1 -- start start 2023-08-17T00:17:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 0x7fa5f0150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0153f50 0x7fa5f0063390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:02.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f0157600 0x7fa5f0063880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0063d70 con 0x7fa5f00c57a0 2023-08-17T00:17:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00c1cc0 con 0x7fa5f0157600 2023-08-17T00:17:02.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f00ae2a0 con 0x7fa5f0153f50 2023-08-17T00:17:02.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 0x7fa5f0150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:02.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 0x7fa5f0150140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37866/0 (socket says 172.21.15.153:37866) 2023-08-17T00:17:02.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 -- 172.21.15.153:0/2268823951 learned_addr learned my addr 172.21.15.153:0/2268823951 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5effff700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0153f50 0x7fa5f0063390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5438700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f0157600 0x7fa5f0063880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 -- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0153f50 msgr2=0x7fa5f0063390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0153f50 0x7fa5f0063390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 -- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f0157600 msgr2=0x7fa5f0063880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f0157600 0x7fa5f0063880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 -- 172.21.15.153:0/2268823951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0092a0 con 0x7fa5f00c57a0 2023-08-17T00:17:02.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f4c37700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 0x7fa5f0150140 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7fa5e400e930 tx=0x7fa5e4009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:02.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4012600 con 0x7fa5f00c57a0 2023-08-17T00:17:02.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e4012760 con 0x7fa5f00c57a0 2023-08-17T00:17:02.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4012ae0 con 0x7fa5f00c57a0 2023-08-17T00:17:02.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00adf90 con 0x7fa5f00c57a0 2023-08-17T00:17:02.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.771+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00c3470 con 0x7fa5f00c57a0 2023-08-17T00:17:02.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.775+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f006b4c0 con 0x7fa5f00c57a0 2023-08-17T00:17:02.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.775+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa5e4022070 con 0x7fa5f00c57a0 2023-08-17T00:17:02.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.779+0000 7fa5ecff9700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa5d405a150 0x7fa5d405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:02.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.779+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5639+0+0 (secure 0 0 0) 0x7fa5e40741c0 con 0x7fa5f00c57a0 2023-08-17T00:17:02.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.779+0000 7fa5effff700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa5d405a150 0x7fa5d405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:02.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.779+0000 7fa5effff700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa5d405a150 0x7fa5d405c610 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa5f00b0940 tx=0x7fa5dc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:02.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.783+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa5e4047d40 con 0x7fa5f00c57a0 2023-08-17T00:17:02.956 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:02.947+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa5f00bf9a0 con 0x7fa5f00c57a0 2023-08-17T00:17:03.582 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.575+0000 7fa5ecff9700 1 -- 172.21.15.153:0/2268823951 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v190) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa5e40160d0 con 0x7fa5f00c57a0 2023-08-17T00:17:03.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.579+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa5d405a150 msgr2=0x7fa5d405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:03.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.579+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa5d405a150 0x7fa5d405c610 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7fa5f00b0940 tx=0x7fa5dc017000).stop 2023-08-17T00:17:03.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.579+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 msgr2=0x7fa5f0150140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:03.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.579+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 0x7fa5f0150140 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 rx=0x7fa5e400e930 tx=0x7fa5e4009060).stop 2023-08-17T00:17:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.587+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 shutdown_connections 2023-08-17T00:17:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.587+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa5d405a150 0x7fa5d405c610 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.587+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa5f0157600 0x7fa5f0063880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.587+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa5f0153f50 0x7fa5f0063390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.587+0000 7fa5f5c39700 1 --2- 172.21.15.153:0/2268823951 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa5f00c57a0 0x7fa5f0150140 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.587+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 >> 172.21.15.153:0/2268823951 conn(0x7fa5f0062a70 msgr2=0x7fa5f00ab230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:03.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.595+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 shutdown_connections 2023-08-17T00:17:03.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.599+0000 7fa5f5c39700 1 -- 172.21.15.153:0/2268823951 wait complete. 2023-08-17T00:17:03.615 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' created 2023-08-17T00:17:03.632 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-17T00:17:03.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.787+0000 7f6725a8f700 1 Processor -- start 2023-08-17T00:17:03.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6725a8f700 1 -- start start 2023-08-17T00:17:03.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6725a8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f67200689c0 0x7f6720068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:03.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6725a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67201519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:03.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6725a8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6720065da0 con 0x7f67201560f0 2023-08-17T00:17:03.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6725a8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6720155c60 con 0x7f67200689c0 2023-08-17T00:17:03.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6725a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6720156550 con 0x7f6720151530 2023-08-17T00:17:03.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f672528e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67201519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:03.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f671ffff700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f67201560f0 0x7f67200c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:34858/0 (socket says 172.21.15.153:34858) 2023-08-17T00:17:03.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f671ffff700 1 -- 172.21.15.153:0/3451879325 learned_addr learned my addr 172.21.15.153:0/3451879325 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:03.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.791+0000 7f6724a8d700 1 --2- 172.21.15.153:0/3451879325 >> v2:172.21.15.178:3300/0 conn(0x7f67200689c0 0x7f6720068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f671f7fe700 1 -- 172.21.15.153:0/3451879325 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243302580 0 0) 0x7f6720065da0 con 0x7f67201560f0 2023-08-17T00:17:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f671f7fe700 1 -- 172.21.15.153:0/3451879325 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67100033f0 con 0x7f67201560f0 2023-08-17T00:17:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6724a8d700 1 -- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 msgr2=0x7f67201519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:03.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6724a8d700 1 --2- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67201519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6724a8d700 1 -- 172.21.15.153:0/3451879325 >> v1:172.21.15.178:6789/0 conn(0x7f67201560f0 legacy=0x7f67200c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:03.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f671f7fe700 1 -- 172.21.15.153:0/3451879325 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3212215954 0 0) 0x7f67100033f0 con 0x7f67201560f0 2023-08-17T00:17:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6724a8d700 1 -- 172.21.15.153:0/3451879325 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6720065ff0 con 0x7f67200689c0 2023-08-17T00:17:03.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6724a8d700 1 --2- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67200689c0 0x7f6720068da0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f6714009eb0 tx=0x7f6714009780).ready entity=mon.1 client_cookie=89ffa2b8342b8a48 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f671f7fe700 1 -- 172.21.15.153:0/3451879325 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671400e070 con 0x7f67200689c0 2023-08-17T00:17:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f671f7fe700 1 -- 172.21.15.153:0/3451879325 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671400b870 con 0x7f67200689c0 2023-08-17T00:17:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f671f7fe700 1 -- 172.21.15.153:0/3451879325 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c001470 con 0x7f67200689c0 2023-08-17T00:17:03.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 -- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67200689c0 msgr2=0x7f6720068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 --2- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67200689c0 0x7f6720068da0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f6714009eb0 tx=0x7f6714009780).stop 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 -- 172.21.15.153:0/3451879325 shutdown_connections 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 --2- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67201519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 --2- 172.21.15.153:0/3451879325 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67200689c0 0x7f6720068da0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 -- 172.21.15.153:0/3451879325 >> 172.21.15.153:0/3451879325 conn(0x7f67200c6620 msgr2=0x7f67200c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 -- 172.21.15.153:0/3451879325 shutdown_connections 2023-08-17T00:17:03.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.795+0000 7f6725a8f700 1 -- 172.21.15.153:0/3451879325 wait complete. 2023-08-17T00:17:03.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 Processor -- start 2023-08-17T00:17:03.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 -- start start 2023-08-17T00:17:03.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 0x7f67200a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:03.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67200c2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:03.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67201560f0 0x7f67200a62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:03.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200a8360 con 0x7f67200689c0 2023-08-17T00:17:03.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6720164630 con 0x7f67201560f0 2023-08-17T00:17:03.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6725a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6720164910 con 0x7f6720151530 2023-08-17T00:17:03.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6724a8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 0x7f67200a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:03.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6724a8d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 0x7f67200a3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37882/0 (socket says 172.21.15.153:37882) 2023-08-17T00:17:03.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6724a8d700 1 -- 172.21.15.153:0/24410206 learned_addr learned my addr 172.21.15.153:0/24410206 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f671ffff700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67200c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f672528e700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67201560f0 0x7f67200a62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.799+0000 7f6724a8d700 1 -- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 msgr2=0x7f67200c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6724a8d700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67200c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6724a8d700 1 -- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67201560f0 msgr2=0x7f67200a62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6724a8d700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67201560f0 0x7f67200a62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6724a8d700 1 -- 172.21.15.153:0/24410206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6714009a20 con 0x7f67200689c0 2023-08-17T00:17:03.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f671ffff700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67200c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:03.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6724a8d700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 0x7f67200a3870 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f671400b610 tx=0x7f6714009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:03.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714000f40 con 0x7f67200689c0 2023-08-17T00:17:03.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671401d420 con 0x7f67200689c0 2023-08-17T00:17:03.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720164bf0 con 0x7f67200689c0 2023-08-17T00:17:03.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67140010a0 con 0x7f67200689c0 2023-08-17T00:17:03.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67200a3d60 con 0x7f67200689c0 2023-08-17T00:17:03.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.803+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672006b4c0 con 0x7f67200689c0 2023-08-17T00:17:03.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.807+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f671401da70 con 0x7f67200689c0 2023-08-17T00:17:03.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.807+0000 7f671cff9700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670405a150 0x7f670405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:03.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.807+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6021+0+0 (secure 0 0 0) 0x7f6714075e80 con 0x7f67200689c0 2023-08-17T00:17:03.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.807+0000 7f671ffff700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670405a150 0x7f670405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:03.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.807+0000 7f671ffff700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670405a150 0x7f670405c610 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f6720150c90 tx=0x7f670c0015e0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:03.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:03.815+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6714049880 con 0x7f67200689c0 2023-08-17T00:17:04.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.003+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f67200662d0 con 0x7f67200689c0 2023-08-17T00:17:04.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.031+0000 7f671cff9700 1 -- 172.21.15.153:0/24410206 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v142) v1 ==== 174+0+0 (secure 0 0 0) 0x7f671404cea0 con 0x7f67200689c0 2023-08-17T00:17:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.043+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670405a150 msgr2=0x7f670405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.043+0000 7f6725a8f700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670405a150 0x7f670405c610 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 rx=0x7f6720150c90 tx=0x7f670c0015e0).stop 2023-08-17T00:17:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.043+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 msgr2=0x7f67200a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.043+0000 7f6725a8f700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 0x7f67200a3870 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 rx=0x7f671400b610 tx=0x7f6714009780).stop 2023-08-17T00:17:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 shutdown_connections 2023-08-17T00:17:04.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f670405a150 0x7f670405c610 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f67201560f0 0x7f67200a62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6720151530 0x7f67200c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 --2- 172.21.15.153:0/24410206 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f67200689c0 0x7f67200a3870 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.055 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 >> 172.21.15.153:0/24410206 conn(0x7f67200c6620 msgr2=0x7f6720150df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 shutdown_connections 2023-08-17T00:17:04.056 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.047+0000 7f6725a8f700 1 -- 172.21.15.153:0/24410206 wait complete. 2023-08-17T00:17:04.060 INFO:teuthology.orchestra.run.smithi153.stderr:new fs with metadata pool 27 and data pool 28 2023-08-17T00:17:04.076 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:17:04.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 Processor -- start 2023-08-17T00:17:04.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 -- start start 2023-08-17T00:17:04.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c8c151f70 0x7f2c8c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c065b50 0x7f2c8c064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c061fa0 con 0x7f2c8c151b90 2023-08-17T00:17:04.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8c0c3fb0 con 0x7f2c8c151f70 2023-08-17T00:17:04.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.227+0000 7f2c9389b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c1523d0 con 0x7f2c8c065b50 2023-08-17T00:17:04.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c90e36700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c8c151f70 0x7f2c8c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c91637700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f2c8c151b90 0x7f2c8c063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46190/0 (socket says 172.21.15.153:46190) 2023-08-17T00:17:04.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c91637700 1 -- 172.21.15.153:0/3557454427 learned_addr learned my addr 172.21.15.153:0/3557454427 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:04.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c91e38700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c065b50 0x7f2c8c064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c90e36700 1 -- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c065b50 msgr2=0x7f2c8c064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:04.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c90e36700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c065b50 0x7f2c8c064870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c90e36700 1 -- 172.21.15.153:0/3557454427 >> v1:172.21.15.153:6789/0 conn(0x7f2c8c151b90 legacy=0x7f2c8c063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c90e36700 1 -- 172.21.15.153:0/3557454427 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c0621f0 con 0x7f2c8c151f70 2023-08-17T00:17:04.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c83fff700 1 -- 172.21.15.153:0/3557454427 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747333120 0 0) 0x7f2c8c061fa0 con 0x7f2c8c151b90 2023-08-17T00:17:04.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c91e38700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c065b50 0x7f2c8c064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:04.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c90e36700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c151f70 0x7f2c8c065660 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f2c7c009760 tx=0x7f2c7c009060).ready entity=mon.1 client_cookie=54eeec114fde8f47 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c83fff700 1 -- 172.21.15.153:0/3557454427 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c0090d0 con 0x7f2c8c151f70 2023-08-17T00:17:04.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c83fff700 1 -- 172.21.15.153:0/3557454427 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c00f510 con 0x7f2c8c151f70 2023-08-17T00:17:04.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c83fff700 1 -- 172.21.15.153:0/3557454427 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00f890 con 0x7f2c8c151f70 2023-08-17T00:17:04.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c9389b700 1 -- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c151f70 msgr2=0x7f2c8c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c9389b700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c151f70 0x7f2c8c065660 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f2c7c009760 tx=0x7f2c7c009060).stop 2023-08-17T00:17:04.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c9389b700 1 -- 172.21.15.153:0/3557454427 shutdown_connections 2023-08-17T00:17:04.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c9389b700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c065b50 0x7f2c8c064870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c9389b700 1 --2- 172.21.15.153:0/3557454427 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c151f70 0x7f2c8c065660 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.231+0000 7f2c9389b700 1 -- 172.21.15.153:0/3557454427 >> 172.21.15.153:0/3557454427 conn(0x7f2c8c0c7150 msgr2=0x7f2c8c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:04.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.235+0000 7f2c9389b700 1 -- 172.21.15.153:0/3557454427 shutdown_connections 2023-08-17T00:17:04.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.235+0000 7f2c9389b700 1 -- 172.21.15.153:0/3557454427 wait complete. 2023-08-17T00:17:04.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.235+0000 7f2c9389b700 1 Processor -- start 2023-08-17T00:17:04.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.235+0000 7f2c9389b700 1 -- start start 2023-08-17T00:17:04.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c9389b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c065b50 0x7f2c8c0abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c9389b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 0x7f2c8c0c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c9389b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c151f70 0x7f2c8c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c9389b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c153110 con 0x7f2c8c151b90 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c9389b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c0c2ad0 con 0x7f2c8c065b50 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c9389b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c152770 con 0x7f2c8c151f70 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 0x7f2c8c0c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 0x7f2c8c0c25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37892/0 (socket says 172.21.15.153:37892) 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 -- 172.21.15.153:0/516827045 learned_addr learned my addr 172.21.15.153:0/516827045 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c91637700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c065b50 0x7f2c8c0abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c91e38700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c151f70 0x7f2c8c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 -- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c151f70 msgr2=0x7f2c8c0aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c151f70 0x7f2c8c0aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 -- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c065b50 msgr2=0x7f2c8c0abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c065b50 0x7f2c8c0abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.239+0000 7f2c90e36700 1 -- 172.21.15.153:0/516827045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c840092a0 con 0x7f2c8c151b90 2023-08-17T00:17:04.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c90e36700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 0x7f2c8c0c25e0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f2c7c009e00 tx=0x7f2c7c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c00f890 con 0x7f2c8c151b90 2023-08-17T00:17:04.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7c00fc50 con 0x7f2c8c151b90 2023-08-17T00:17:04.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7c0092a0 con 0x7f2c8c151b90 2023-08-17T00:17:04.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7c01c650 con 0x7f2c8c151b90 2023-08-17T00:17:04.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c152d30 con 0x7f2c8c151b90 2023-08-17T00:17:04.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.243+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8c06b530 con 0x7f2c8c151b90 2023-08-17T00:17:04.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.247+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2c7c02b070 con 0x7f2c8c151b90 2023-08-17T00:17:04.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.247+0000 7f2c817fa700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c7005a150 0x7f2c7005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.247+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f2c7c075e00 con 0x7f2c8c151b90 2023-08-17T00:17:04.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.247+0000 7f2c91637700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c7005a150 0x7f2c7005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.247+0000 7f2c91637700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c7005a150 0x7f2c7005c610 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f2c88001560 tx=0x7f2c88007f30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.251+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f2c7c049820 con 0x7f2c8c151b90 2023-08-17T00:17:04.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.415+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c8c0c3ab0 con 0x7f2c8c151b90 2023-08-17T00:17:04.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.415+0000 7f2c817fa700 1 -- 172.21.15.153:0/516827045 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+17003 (secure 0 0 0) 0x7f2c7c020020 con 0x7f2c8c151b90 2023-08-17T00:17:04.424 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:04.424 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":191,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:17:04.011660+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:17:01.995187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-08-17T00:17:03.026269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:17:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c7005a150 msgr2=0x7f2c7005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c7005a150 0x7f2c7005c610 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7f2c88001560 tx=0x7f2c88007f30).stop 2023-08-17T00:17:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 msgr2=0x7f2c8c0c25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 0x7f2c8c0c25e0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 rx=0x7f2c7c009e00 tx=0x7f2c7c017000).stop 2023-08-17T00:17:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 shutdown_connections 2023-08-17T00:17:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2c7005a150 0x7f2c7005c610 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8c151f70 0x7f2c8c0aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2c8c151b90 0x7f2c8c0c25e0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 --2- 172.21.15.153:0/516827045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8c065b50 0x7f2c8c0abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 >> 172.21.15.153:0/516827045 conn(0x7f2c8c0c7150 msgr2=0x7f2c8c150670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:04.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 shutdown_connections 2023-08-17T00:17:04.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.419+0000 7f2c9389b700 1 -- 172.21.15.153:0/516827045 wait complete. 2023-08-17T00:17:04.447 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:17:04.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.587+0000 7fc766b79700 1 Processor -- start 2023-08-17T00:17:04.598 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766b79700 1 -- start start 2023-08-17T00:17:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766b79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 0x7fc7600c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766b79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc760068820 0x7fc760068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.599 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766b79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7601585a0 con 0x7fc760061fa0 2023-08-17T00:17:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766b79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc760066400 con 0x7fc760068820 2023-08-17T00:17:04.600 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766b79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc760069170 con 0x7fc7600a8df0 2023-08-17T00:17:04.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766378700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc760061fa0 0x7fc760062420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:46204/0 (socket says 172.21.15.153:46204) 2023-08-17T00:17:04.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc766378700 1 -- 172.21.15.153:0/929878315 learned_addr learned my addr 172.21.15.153:0/929878315 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:04.602 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc765b77700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 0x7fc7600c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc765376700 1 --2- 172.21.15.153:0/929878315 >> v2:172.21.15.178:3300/0 conn(0x7fc760068820 0x7fc760068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773125423 0 0) 0x7fc7601585a0 con 0x7fc760061fa0 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480033f0 con 0x7fc760061fa0 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3485207129 0 0) 0x7fc7480033f0 con 0x7fc760061fa0 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 msgr2=0x7fc7600c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 0x7fc7600c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 >> v2:172.21.15.178:3300/0 conn(0x7fc760068820 msgr2=0x7fc760068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 --2- 172.21.15.153:0/929878315 >> v2:172.21.15.178:3300/0 conn(0x7fc760068820 0x7fc760068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7600b9d30 con 0x7fc760061fa0 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7fc7580017f0 con 0x7fc760061fa0 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 >> v1:172.21.15.153:6789/0 conn(0x7fc760061fa0 legacy=0x7fc760062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc748003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 0x7fc748004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.591+0000 7fc764b75700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc748004b80 0x7fc748005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc760066400 con 0x7fc7480038e0 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc760069170 con 0x7fc748004b80 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800b8e0 con 0x7fc7600a8df0 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc748003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765376700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 0x7fc748004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766378700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc748004b80 0x7fc748005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 -- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 msgr2=0x7fc748004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:04.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600a8df0 0x7fc748004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 -- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc748004b80 msgr2=0x7fc748005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:04.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc748004b80 0x7fc748005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 -- 172.21.15.153:0/929878315 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480033f0 con 0x7fc7480038e0 2023-08-17T00:17:04.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766378700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc748004b80 0x7fc748005000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:04.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc765b77700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc748003d00 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7fc750006fd0 tx=0x7fc750006f40).ready entity=mon.0 client_cookie=4b655e5b2a972b3d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750009430 con 0x7fc7480038e0 2023-08-17T00:17:04.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75000e640 con 0x7fc7480038e0 2023-08-17T00:17:04.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc764b75700 1 -- 172.21.15.153:0/929878315 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75000e9c0 con 0x7fc7480038e0 2023-08-17T00:17:04.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766b79700 1 -- 172.21.15.153:0/929878315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 msgr2=0x7fc748003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766b79700 1 --2- 172.21.15.153:0/929878315 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc748003d00 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 rx=0x7fc750006fd0 tx=0x7fc750006f40).stop 2023-08-17T00:17:04.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766378700 1 -- 172.21.15.153:0/929878315 reap_dead start 2023-08-17T00:17:04.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766b79700 1 -- 172.21.15.153:0/929878315 shutdown_connections 2023-08-17T00:17:04.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766b79700 1 -- 172.21.15.153:0/929878315 >> 172.21.15.153:0/929878315 conn(0x7fc7600c6620 msgr2=0x7fc7600c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:04.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766b79700 1 -- 172.21.15.153:0/929878315 shutdown_connections 2023-08-17T00:17:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.595+0000 7fc766b79700 1 -- 172.21.15.153:0/929878315 wait complete. 2023-08-17T00:17:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 Processor -- start 2023-08-17T00:17:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 -- start start 2023-08-17T00:17:04.610 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc76014d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc760158960 0x7fc760158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600c4290 0x7fc7600c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76016bf40 con 0x7fc7480038e0 2023-08-17T00:17:04.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76015a150 con 0x7fc760158960 2023-08-17T00:17:04.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766b79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7601592d0 con 0x7fc7600c4290 2023-08-17T00:17:04.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc76014d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc76014d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:37916/0 (socket says 172.21.15.153:37916) 2023-08-17T00:17:04.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 -- 172.21.15.153:0/63829632 learned_addr learned my addr 172.21.15.153:0/63829632 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:04.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765376700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc760158960 0x7fc760158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc766378700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600c4290 0x7fc7600c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 -- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600c4290 msgr2=0x7fc7600c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600c4290 0x7fc7600c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 -- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc760158960 msgr2=0x7fc760158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc760158960 0x7fc760158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 -- 172.21.15.153:0/63829632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760159540 con 0x7fc7480038e0 2023-08-17T00:17:04.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.599+0000 7fc765b77700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc76014d050 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7fc748004490 tx=0x7fc75001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75000e9c0 con 0x7fc7480038e0 2023-08-17T00:17:04.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750006040 con 0x7fc7480038e0 2023-08-17T00:17:04.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750006400 con 0x7fc7480038e0 2023-08-17T00:17:04.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc760159820 con 0x7fc7480038e0 2023-08-17T00:17:04.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc760159de0 con 0x7fc7480038e0 2023-08-17T00:17:04.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76006b4c0 con 0x7fc7480038e0 2023-08-17T00:17:04.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.603+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc75001b450 con 0x7fc7480038e0 2023-08-17T00:17:04.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.607+0000 7fc75dffb700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc74c05a180 0x7fc74c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.607+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fc750075580 con 0x7fc7480038e0 2023-08-17T00:17:04.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.607+0000 7fc765376700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc74c05a180 0x7fc74c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.607+0000 7fc765376700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc74c05a180 0x7fc74c05c640 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fc76016cd20 tx=0x7fc754008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.611+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc750048f00 con 0x7fc7480038e0 2023-08-17T00:17:04.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.775+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc760064010 con 0x7fc7480038e0 2023-08-17T00:17:04.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.775+0000 7fc75dffb700 1 -- 172.21.15.153:0/63829632 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v191) v1 ==== 74+0+17003 (secure 0 0 0) 0x7fc750016020 con 0x7fc7480038e0 2023-08-17T00:17:04.784 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:04.785 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":191,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:17:04.011660+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:17:01.995187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-08-17T00:17:03.026269+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:17:04.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc74c05a180 msgr2=0x7fc74c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc74c05a180 0x7fc74c05c640 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7fc76016cd20 tx=0x7fc754008040).stop 2023-08-17T00:17:04.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 msgr2=0x7fc76014d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc76014d050 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 rx=0x7fc748004490 tx=0x7fc75001a000).stop 2023-08-17T00:17:04.788 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 shutdown_connections 2023-08-17T00:17:04.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc74c05a180 0x7fc74c05c640 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7600c4290 0x7fc7600c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc760158960 0x7fc760158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 --2- 172.21.15.153:0/63829632 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc7480038e0 0x7fc76014d050 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 >> 172.21.15.153:0/63829632 conn(0x7fc7600c6620 msgr2=0x7fc760157c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:04.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 shutdown_connections 2023-08-17T00:17:04.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.779+0000 7fc766b79700 1 -- 172.21.15.153:0/63829632 wait complete. 2023-08-17T00:17:04.809 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-17T00:17:04.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.967+0000 7f5f147a9700 1 Processor -- start 2023-08-17T00:17:04.974 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.967+0000 7f5f147a9700 1 -- start start 2023-08-17T00:17:04.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f147a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5f0c150ce0 0x7f5f0c0a8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f147a9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c0bc0b0 con 0x7f5f0c0c0c80 2023-08-17T00:17:04.978 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f147a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c062fb0 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f147a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c0bd590 con 0x7f5f0c150ce0 2023-08-17T00:17:04.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f11d44700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5f0c0c0c80 0x7f5f0c1505d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45056/0 (socket says 172.21.15.153:45056) 2023-08-17T00:17:04.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f11d44700 1 -- 172.21.15.153:0/140632643 learned_addr learned my addr 172.21.15.153:0/140632643 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:04.979 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f12d46700 1 --2- 172.21.15.153:0/140632643 >> v2:172.21.15.178:3300/0 conn(0x7f5f0c150ce0 0x7f5f0c0a8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661563768 0 0) 0x7f5f0c0bc0b0 con 0x7f5f0c0c0c80 2023-08-17T00:17:04.980 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef80033f0 con 0x7f5f0c0c0c80 2023-08-17T00:17:04.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813260397 0 0) 0x7f5f0c062fb0 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f0c0bc0b0 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f12d46700 1 -- 172.21.15.153:0/140632643 >> v1:172.21.15.178:6789/0 conn(0x7f5f0c0a89c0 legacy=0x7f5f0c0bcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f12d46700 1 -- 172.21.15.153:0/140632643 >> v1:172.21.15.153:6789/0 conn(0x7f5f0c0c0c80 legacy=0x7f5f0c1505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f12d46700 1 -- 172.21.15.153:0/140632643 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0bb780 con 0x7f5f0c150ce0 2023-08-17T00:17:04.981 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.971+0000 7f5f12d46700 1 --2- 172.21.15.153:0/140632643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c0a8da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5f04009e60 tx=0x7f5f04009780).ready entity=mon.1 client_cookie=33351f13fc42ef9b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400e070 con 0x7f5f0c150ce0 2023-08-17T00:17:04.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400bab0 con 0x7f5f0c150ce0 2023-08-17T00:17:04.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f11543700 1 -- 172.21.15.153:0/140632643 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400be30 con 0x7f5f0c150ce0 2023-08-17T00:17:04.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 -- 172.21.15.153:0/140632643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 msgr2=0x7f5f0c0a8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 --2- 172.21.15.153:0/140632643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c0a8da0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 rx=0x7f5f04009e60 tx=0x7f5f04009780).stop 2023-08-17T00:17:04.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 -- 172.21.15.153:0/140632643 shutdown_connections 2023-08-17T00:17:04.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 --2- 172.21.15.153:0/140632643 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c0a8da0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 -- 172.21.15.153:0/140632643 >> 172.21.15.153:0/140632643 conn(0x7f5f0c0c7150 msgr2=0x7f5f0c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:04.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 -- 172.21.15.153:0/140632643 shutdown_connections 2023-08-17T00:17:04.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 -- 172.21.15.153:0/140632643 wait complete. 2023-08-17T00:17:04.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 Processor -- start 2023-08-17T00:17:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.975+0000 7f5f147a9700 1 -- start start 2023-08-17T00:17:04.985 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 0x7f5f0c13bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f0c0c0c80 0x7f5f0c0bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c13c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c163f00 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0bfb30 con 0x7f5f0c150ce0 2023-08-17T00:17:04.986 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0bef20 con 0x7f5f0c0c0c80 2023-08-17T00:17:04.987 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 0x7f5f0c13bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 0x7f5f0c13bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47000/0 (socket says 172.21.15.153:47000) 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 -- 172.21.15.153:0/1652593397 learned_addr learned my addr 172.21.15.153:0/1652593397 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12d46700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c13c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f11d44700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f0c0c0c80 0x7f5f0c0bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 -- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f0c0c0c80 msgr2=0x7f5f0c0bffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f0c0c0c80 0x7f5f0c0bffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.988 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 -- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 msgr2=0x7f5f0c13c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c13c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 -- 172.21.15.153:0/1652593397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04009a20 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f11d44700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f0c0c0c80 0x7f5f0c0bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f12545700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 0x7f5f0c13bbd0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f5f0800c490 tx=0x7f5f08007c90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800f470 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0800f5d0 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.989 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800f970 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c0bf200 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c0bf7c0 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.979+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c06b530 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.983+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5f08019030 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.983+0000 7f5f027fc700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ef005a120 0x7f5ef005c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:04.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.983+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5f080735f0 con 0x7f5f0c0a89c0 2023-08-17T00:17:04.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.983+0000 7f5f11d44700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ef005a120 0x7f5ef005c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:04.993 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.987+0000 7f5f11d44700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ef005a120 0x7f5ef005c5e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f5efc005750 tx=0x7f5efc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:04.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:04.987+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f080470a0 con 0x7f5f0c0a89c0 2023-08-17T00:17:05.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:05.187+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5f0c0bba60 con 0x7f5f0c0a89c0 2023-08-17T00:17:06.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.035+0000 7f5f027fc700 1 -- 172.21.15.153:0/1652593397 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v145) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5f0804a6c0 con 0x7f5f0c0a89c0 2023-08-17T00:17:06.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ef005a120 msgr2=0x7f5ef005c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ef005a120 0x7f5ef005c5e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 rx=0x7f5efc005750 tx=0x7f5efc009040).stop 2023-08-17T00:17:06.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 msgr2=0x7f5f0c13bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 0x7f5f0c13bbd0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 rx=0x7f5f0800c490 tx=0x7f5f08007c90).stop 2023-08-17T00:17:06.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 shutdown_connections 2023-08-17T00:17:06.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5ef005a120 0x7f5ef005c5e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f0c150ce0 0x7f5f0c13c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f0c0c0c80 0x7f5f0c0bffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 --2- 172.21.15.153:0/1652593397 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f0c0a89c0 0x7f5f0c13bbd0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 >> 172.21.15.153:0/1652593397 conn(0x7f5f0c0c7150 msgr2=0x7f5f0c0c4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:06.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 shutdown_connections 2023-08-17T00:17:06.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.039+0000 7f5f147a9700 1 -- 172.21.15.153:0/1652593397 wait complete. 2023-08-17T00:17:06.071 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-17T00:17:06.071 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-17T00:17:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.223+0000 7f7a79907700 1 Processor -- start 2023-08-17T00:17:06.232 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.223+0000 7f7a79907700 1 -- start start 2023-08-17T00:17:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a79907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a740c57a0 0x7f7a740c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a79907700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a740bfd10 con 0x7f7a740c11b0 2023-08-17T00:17:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a79907700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a74158420 con 0x7f7a74153f50 2023-08-17T00:17:06.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a79907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a74154af0 con 0x7f7a740c57a0 2023-08-17T00:17:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a79106700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7a740c11b0 0x7f7a74157d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45058/0 (socket says 172.21.15.153:45058) 2023-08-17T00:17:06.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a79106700 1 -- 172.21.15.153:0/3684886563 learned_addr learned my addr 172.21.15.153:0/3684886563 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a78905700 1 --2- 172.21.15.153:0/3684886563 >> v2:172.21.15.178:3300/0 conn(0x7f7a740c57a0 0x7f7a740c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a737fe700 1 -- 172.21.15.153:0/3684886563 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951281848 0 0) 0x7f7a740bfd10 con 0x7f7a740c11b0 2023-08-17T00:17:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.227+0000 7f7a737fe700 1 -- 172.21.15.153:0/3684886563 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a640033f0 con 0x7f7a740c11b0 2023-08-17T00:17:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a78905700 1 -- 172.21.15.153:0/3684886563 >> v1:172.21.15.178:6789/0 conn(0x7f7a74153f50 legacy=0x7f7a74157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a737fe700 1 -- 172.21.15.153:0/3684886563 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527056298 0 0) 0x7f7a74158420 con 0x7f7a74153f50 2023-08-17T00:17:06.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a78905700 1 -- 172.21.15.153:0/3684886563 >> v1:172.21.15.153:6789/0 conn(0x7f7a740c11b0 legacy=0x7f7a74157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a78905700 1 -- 172.21.15.153:0/3684886563 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a74154dd0 con 0x7f7a740c57a0 2023-08-17T00:17:06.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a78905700 1 --2- 172.21.15.153:0/3684886563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c5b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f7a68009760 tx=0x7f7a68009060).ready entity=mon.1 client_cookie=5ad498328b5739dd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:06.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a737fe700 1 -- 172.21.15.153:0/3684886563 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f510 con 0x7f7a740c57a0 2023-08-17T00:17:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a737fe700 1 -- 172.21.15.153:0/3684886563 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800f670 con 0x7f7a740c57a0 2023-08-17T00:17:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a737fe700 1 -- 172.21.15.153:0/3684886563 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f9f0 con 0x7f7a740c57a0 2023-08-17T00:17:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 -- 172.21.15.153:0/3684886563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 msgr2=0x7f7a740c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 --2- 172.21.15.153:0/3684886563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c5b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f7a68009760 tx=0x7f7a68009060).stop 2023-08-17T00:17:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 -- 172.21.15.153:0/3684886563 shutdown_connections 2023-08-17T00:17:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 --2- 172.21.15.153:0/3684886563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c5b80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 -- 172.21.15.153:0/3684886563 >> 172.21.15.153:0/3684886563 conn(0x7f7a74062a70 msgr2=0x7f7a740ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 -- 172.21.15.153:0/3684886563 shutdown_connections 2023-08-17T00:17:06.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.231+0000 7f7a79907700 1 -- 172.21.15.153:0/3684886563 wait complete. 2023-08-17T00:17:06.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 Processor -- start 2023-08-17T00:17:06.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 -- start start 2023-08-17T00:17:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 0x7f7a741682b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:06.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a74153f50 0x7f7a740c71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740c8630 con 0x7f7a740c11b0 2023-08-17T00:17:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740c8910 con 0x7f7a740c57a0 2023-08-17T00:17:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740c2810 con 0x7f7a74153f50 2023-08-17T00:17:06.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 0x7f7a741682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:06.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 0x7f7a741682b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47002/0 (socket says 172.21.15.153:47002) 2023-08-17T00:17:06.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 -- 172.21.15.153:0/807679467 learned_addr learned my addr 172.21.15.153:0/807679467 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:06.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a73fff700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:06.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79106700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a74153f50 0x7f7a740c71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:06.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 -- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a74153f50 msgr2=0x7f7a740c71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a74153f50 0x7f7a740c71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 -- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 msgr2=0x7f7a740c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 -- 172.21.15.153:0/807679467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a680092a0 con 0x7f7a740c11b0 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a73fff700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a79106700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a74153f50 0x7f7a740c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a78905700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 0x7f7a741682b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f7a68006d70 tx=0x7f7a68017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:06.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f7e0 con 0x7f7a740c11b0 2023-08-17T00:17:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.235+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800f940 con 0x7f7a740c11b0 2023-08-17T00:17:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.239+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a740c79f0 con 0x7f7a740c11b0 2023-08-17T00:17:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.239+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6801b690 con 0x7f7a740c11b0 2023-08-17T00:17:06.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.239+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740c7fb0 con 0x7f7a740c11b0 2023-08-17T00:17:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.239+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7406b4c0 con 0x7f7a740c11b0 2023-08-17T00:17:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.239+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7a6800f070 con 0x7f7a740c11b0 2023-08-17T00:17:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.243+0000 7f7a70ff9700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a5805a150 0x7f7a5805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:06.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.243+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f7a680757f0 con 0x7f7a740c11b0 2023-08-17T00:17:06.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.243+0000 7f7a73fff700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a5805a150 0x7f7a5805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:06.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.243+0000 7f7a73fff700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a5805a150 0x7f7a5805c610 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f7a740c5080 tx=0x7f7a60009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:06.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.247+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7a68049240 con 0x7f7a740c11b0 2023-08-17T00:17:06.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:06.439+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7a740bf9a0 con 0x7f7a740c11b0 2023-08-17T00:17:07.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.047+0000 7f7a70ff9700 1 -- 172.21.15.153:0/807679467 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v146) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a6804c860 con 0x7f7a740c11b0 2023-08-17T00:17:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a5805a150 msgr2=0x7f7a5805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a5805a150 0x7f7a5805c610 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f7a740c5080 tx=0x7f7a60009040).stop 2023-08-17T00:17:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 msgr2=0x7f7a741682b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 0x7f7a741682b0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 rx=0x7f7a68006d70 tx=0x7f7a68017000).stop 2023-08-17T00:17:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 shutdown_connections 2023-08-17T00:17:07.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7a5805a150 0x7f7a5805c610 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a74153f50 0x7f7a740c71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a740c57a0 0x7f7a740c2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 --2- 172.21.15.153:0/807679467 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7a740c11b0 0x7f7a741682b0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.051+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 >> 172.21.15.153:0/807679467 conn(0x7f7a74062a70 msgr2=0x7f7a74063390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:07.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.055+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 shutdown_connections 2023-08-17T00:17:07.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.055+0000 7f7a79907700 1 -- 172.21.15.153:0/807679467 wait complete. 2023-08-17T00:17:07.084 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-17T00:17:07.085 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:17:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.239+0000 7f8a92d79700 1 Processor -- start 2023-08-17T00:17:07.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.239+0000 7f8a92d79700 1 -- start start 2023-08-17T00:17:07.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a92d79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 0x7f8a8c0c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a92d79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8a8c0c0f70 0x7f8a8c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a92d79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8c154ae0 con 0x7f8a8c069250 2023-08-17T00:17:07.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a92d79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8c0664a0 con 0x7f8a8c0c0f70 2023-08-17T00:17:07.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a92d79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c069a90 con 0x7f8a8c069630 2023-08-17T00:17:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a91d77700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f8a8c069250 0x7f8a8c065d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45060/0 (socket says 172.21.15.153:45060) 2023-08-17T00:17:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a91d77700 1 -- 172.21.15.153:0/2341567688 learned_addr learned my addr 172.21.15.153:0/2341567688 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a92578700 1 --2- 172.21.15.153:0/2341567688 >> v2:172.21.15.178:3300/0 conn(0x7f8a8c0c0f70 0x7f8a8c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a91576700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 0x7f8a8c0c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978420701 0 0) 0x7f8a8c154ae0 con 0x7f8a8c069250 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a78004500 con 0x7f8a8c069250 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.243+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2530107275 0 0) 0x7f8a78004500 con 0x7f8a8c069250 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 msgr2=0x7f8a8c0c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 0x7f8a8c0c0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 >> v2:172.21.15.178:3300/0 conn(0x7f8a8c0c0f70 msgr2=0x7f8a8c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 --2- 172.21.15.153:0/2341567688 >> v2:172.21.15.178:3300/0 conn(0x7f8a8c0c0f70 0x7f8a8c153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c064fd0 con 0x7f8a8c069250 2023-08-17T00:17:07.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f8a880015f0 con 0x7f8a8c069250 2023-08-17T00:17:07.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 >> v1:172.21.15.153:6789/0 conn(0x7f8a8c069250 legacy=0x7f8a8c065d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 0x7f8a780049f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a780057a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a78005c90 0x7f8a78006110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0664a0 con 0x7f8a78004f20 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c069a90 con 0x7f8a78005c90 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7800c9f0 con 0x7f8a8c069630 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a780057a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a92578700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a78005c90 0x7f8a78006110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91d77700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 0x7f8a780049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 -- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 msgr2=0x7f8a780049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c069630 0x7f8a780049f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 -- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a78005c90 msgr2=0x7f8a78006110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a78005c90 0x7f8a78006110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 -- 172.21.15.153:0/2341567688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a78004500 con 0x7f8a78004f20 2023-08-17T00:17:07.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a91576700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a780057a0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f8a7c009ab0 tx=0x7f8a7c009060).ready entity=mon.0 client_cookie=86669de75c792f2d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c009430 con 0x7f8a78004f20 2023-08-17T00:17:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c00e640 con 0x7f8a78004f20 2023-08-17T00:17:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a90d75700 1 -- 172.21.15.153:0/2341567688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00e9c0 con 0x7f8a78004f20 2023-08-17T00:17:07.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a92d79700 1 -- 172.21.15.153:0/2341567688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 msgr2=0x7f8a780057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a92d79700 1 --2- 172.21.15.153:0/2341567688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a780057a0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 rx=0x7f8a7c009ab0 tx=0x7f8a7c009060).stop 2023-08-17T00:17:07.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a92578700 1 -- 172.21.15.153:0/2341567688 reap_dead start 2023-08-17T00:17:07.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a92d79700 1 -- 172.21.15.153:0/2341567688 shutdown_connections 2023-08-17T00:17:07.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.247+0000 7f8a92d79700 1 -- 172.21.15.153:0/2341567688 >> 172.21.15.153:0/2341567688 conn(0x7f8a8c0c6620 msgr2=0x7f8a8c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:07.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.251+0000 7f8a92d79700 1 -- 172.21.15.153:0/2341567688 shutdown_connections 2023-08-17T00:17:07.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.251+0000 7f8a92d79700 1 -- 172.21.15.153:0/2341567688 wait complete. 2023-08-17T00:17:07.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.251+0000 7f8a92d79700 1 Processor -- start 2023-08-17T00:17:07.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.251+0000 7f8a92d79700 1 -- start start 2023-08-17T00:17:07.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a8c0bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a8c0b9fb0 0x7f8a8c14ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c0beac0 0x7f8a8c0bef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c1573c0 con 0x7f8a78004f20 2023-08-17T00:17:07.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0bf410 con 0x7f8a8c0b9fb0 2023-08-17T00:17:07.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c0ba770 con 0x7f8a8c0beac0 2023-08-17T00:17:07.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a8c0bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a8c0bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47022/0 (socket says 172.21.15.153:47022) 2023-08-17T00:17:07.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 -- 172.21.15.153:0/45227078 learned_addr learned my addr 172.21.15.153:0/45227078 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:07.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91576700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a8c0b9fb0 0x7f8a8c14ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92578700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c0beac0 0x7f8a8c0bef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 -- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c0beac0 msgr2=0x7f8a8c0bef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c0beac0 0x7f8a8c0bef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 -- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a8c0b9fb0 msgr2=0x7f8a8c14ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a8c0b9fb0 0x7f8a8c14ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 -- 172.21.15.153:0/45227078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a8c0baa50 con 0x7f8a78004f20 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a91d77700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a8c0bcc70 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f8a8800e840 tx=0x7f8a88009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a880070d0 con 0x7f8a78004f20 2023-08-17T00:17:07.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a88007230 con 0x7f8a78004f20 2023-08-17T00:17:07.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c0bad30 con 0x7f8a78004f20 2023-08-17T00:17:07.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a88005880 con 0x7f8a78004f20 2023-08-17T00:17:07.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.255+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c161f80 con 0x7f8a78004f20 2023-08-17T00:17:07.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.259+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c157190 con 0x7f8a78004f20 2023-08-17T00:17:07.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.259+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8a88005c30 con 0x7f8a78004f20 2023-08-17T00:17:07.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.259+0000 7f8a81ffb700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a7005a150 0x7f8a7005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.259+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f8a88074440 con 0x7f8a78004f20 2023-08-17T00:17:07.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.259+0000 7f8a91576700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a7005a150 0x7f8a7005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.263+0000 7f8a91576700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a7005a150 0x7f8a7005c610 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f8a8c0b9e20 tx=0x7f8a7c01a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:07.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.271+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f8a8c157190 con 0x7f8a78004f20 2023-08-17T00:17:07.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.459+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a8c06b4c0 con 0x7f8a78004f20 2023-08-17T00:17:07.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.459+0000 7f8a81ffb700 1 -- 172.21.15.153:0/45227078 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f8a88047d80 con 0x7f8a78004f20 2023-08-17T00:17:07.468 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:07.468 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":146,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:07.040208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9649":{"gid":9649,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4264536439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4264536439},{"type":"v1","addr":"172.21.15.153:6835","nonce":4264536439}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:17:07.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a7005a150 msgr2=0x7f8a7005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a7005a150 0x7f8a7005c610 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f8a8c0b9e20 tx=0x7f8a7c01a000).stop 2023-08-17T00:17:07.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 msgr2=0x7f8a8c0bcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a8c0bcc70 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 rx=0x7f8a8800e840 tx=0x7f8a88009040).stop 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 shutdown_connections 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f8a7005a150 0x7f8a7005c610 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8a8c0beac0 0x7f8a8c0bef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8a8c0b9fb0 0x7f8a8c14ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 --2- 172.21.15.153:0/45227078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f8a78004f20 0x7f8a8c0bcc70 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 >> 172.21.15.153:0/45227078 conn(0x7f8a8c0c6620 msgr2=0x7f8a8c063040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:07.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 shutdown_connections 2023-08-17T00:17:07.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.463+0000 7f8a92d79700 1 -- 172.21.15.153:0/45227078 wait complete. 2023-08-17T00:17:07.474 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 146 2023-08-17T00:17:07.491 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:17:07.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.647+0000 7ff415079700 1 Processor -- start 2023-08-17T00:17:07.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.647+0000 7ff415079700 1 -- start start 2023-08-17T00:17:07.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff415079700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff410068da0 0x7ff4101560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff415079700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410065da0 con 0x7ff4100689c0 2023-08-17T00:17:07.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff415079700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff410155c60 con 0x7ff410151530 2023-08-17T00:17:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff415079700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff410069200 con 0x7ff410068da0 2023-08-17T00:17:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40ffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff4100689c0 0x7ff4100c0270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45064/0 (socket says 172.21.15.153:45064) 2023-08-17T00:17:07.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40ffff700 1 -- 172.21.15.153:0/1160286734 learned_addr learned my addr 172.21.15.153:0/1160286734 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:07.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40f7fe700 1 --2- 172.21.15.153:0/1160286734 >> v2:172.21.15.178:3300/0 conn(0x7ff410068da0 0x7ff4101560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488176121 0 0) 0x7ff410065da0 con 0x7ff4100689c0 2023-08-17T00:17:07.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f80033f0 con 0x7ff4100689c0 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371313453 0 0) 0x7ff410155c60 con 0x7ff410151530 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff410065da0 con 0x7ff410151530 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2349773943 0 0) 0x7ff3f80033f0 con 0x7ff4100689c0 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 >> v2:172.21.15.178:3300/0 conn(0x7ff410068da0 msgr2=0x7ff4101560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 --2- 172.21.15.153:0/1160286734 >> v2:172.21.15.178:3300/0 conn(0x7ff410068da0 0x7ff4101560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 >> v1:172.21.15.178:6789/0 conn(0x7ff410151530 legacy=0x7ff4101519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff410065ff0 con 0x7ff4100689c0 2023-08-17T00:17:07.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7ff4000015f0 con 0x7ff4100689c0 2023-08-17T00:17:07.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 >> v1:172.21.15.153:6789/0 conn(0x7ff4100689c0 legacy=0x7ff4100c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.651+0000 7ff40effd700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f8003a70 0x7ff3f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004690 0x7ff3f8004b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8005050 0x7ff3f800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410069200 con 0x7ff3f8003a70 2023-08-17T00:17:07.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f800bfc0 con 0x7ff3f8004690 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f800c180 con 0x7ff3f8005050 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f8003a70 0x7ff3f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40f7fe700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004690 0x7ff3f8004b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff414878700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8005050 0x7ff3f800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 -- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8005050 msgr2=0x7ff3f800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff3f8005050 0x7ff3f800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 -- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004690 msgr2=0x7ff3f8004b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:07.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004690 0x7ff3f8004b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 -- 172.21.15.153:0/1160286734 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f80033f0 con 0x7ff3f8003a70 2023-08-17T00:17:07.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40f7fe700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8004690 0x7ff3f8004b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:07.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff414878700 1 -- 172.21.15.153:0/1160286734 reap_dead start 2023-08-17T00:17:07.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f8003a70 0x7ff3f8003e70 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7ff40000c190 tx=0x7ff400007720).ready entity=mon.0 client_cookie=78c67e24fbef29d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:07.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff40000ca60 con 0x7ff3f8003a70 2023-08-17T00:17:07.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff40000cbc0 con 0x7ff3f8003a70 2023-08-17T00:17:07.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff40effd700 1 -- 172.21.15.153:0/1160286734 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4000070d0 con 0x7ff3f8003a70 2023-08-17T00:17:07.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 -- 172.21.15.153:0/1160286734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f8003a70 msgr2=0x7ff3f8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f8003a70 0x7ff3f8003e70 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 rx=0x7ff40000c190 tx=0x7ff400007720).stop 2023-08-17T00:17:07.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 -- 172.21.15.153:0/1160286734 shutdown_connections 2023-08-17T00:17:07.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 --2- 172.21.15.153:0/1160286734 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff3f8003a70 0x7ff3f8003e70 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 -- 172.21.15.153:0/1160286734 >> 172.21.15.153:0/1160286734 conn(0x7ff4100c6620 msgr2=0x7ff4100c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:07.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 -- 172.21.15.153:0/1160286734 shutdown_connections 2023-08-17T00:17:07.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.655+0000 7ff415079700 1 -- 172.21.15.153:0/1160286734 wait complete. 2023-08-17T00:17:07.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.659+0000 7ff415079700 1 Processor -- start 2023-08-17T00:17:07.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.659+0000 7ff415079700 1 -- start start 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8003a70 0x7ff410150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4100c0a80 0x7ff4100c0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 0x7ff410153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410153860 con 0x7ff410152f30 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff410157c50 con 0x7ff3f8003a70 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4100c1500 con 0x7ff4100c0a80 2023-08-17T00:17:07.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 0x7ff410153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 0x7ff410153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47040/0 (socket says 172.21.15.153:47040) 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 -- 172.21.15.153:0/1465109799 learned_addr learned my addr 172.21.15.153:0/1465109799 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8003a70 0x7ff410150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff40f7fe700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4100c0a80 0x7ff4100c0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 -- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4100c0a80 msgr2=0x7ff4100c0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4100c0a80 0x7ff4100c0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 -- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8003a70 msgr2=0x7ff410150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8003a70 0x7ff410150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 -- 172.21.15.153:0/1465109799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4100c17e0 con 0x7ff410152f30 2023-08-17T00:17:07.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff414878700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 0x7ff410153370 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7ff410068440 tx=0x7ff408009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:07.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408006c30 con 0x7ff410152f30 2023-08-17T00:17:07.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff408006d90 con 0x7ff410152f30 2023-08-17T00:17:07.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408003260 con 0x7ff410152f30 2023-08-17T00:17:07.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4100c1ac0 con 0x7ff410152f30 2023-08-17T00:17:07.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4100c23f0 con 0x7ff410152f30 2023-08-17T00:17:07.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.663+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff410157de0 con 0x7ff410152f30 2023-08-17T00:17:07.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.667+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff40801e070 con 0x7ff410152f30 2023-08-17T00:17:07.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.667+0000 7ff3f7fff700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3fc05a180 0x7ff3fc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:07.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.667+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7ff4080734d0 con 0x7ff410152f30 2023-08-17T00:17:07.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.667+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3fc05a180 0x7ff3fc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:07.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.667+0000 7ff40ffff700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3fc05a180 0x7ff3fc05c640 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7ff400000ef0 tx=0x7ff400015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:07.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.675+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff408046e70 con 0x7ff410152f30 2023-08-17T00:17:07.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.839+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4100662d0 con 0x7ff410152f30 2023-08-17T00:17:07.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.839+0000 7ff3f7fff700 1 -- 172.21.15.153:0/1465109799 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+16990 (secure 0 0 0) 0x7ff40801c070 con 0x7ff410152f30 2023-08-17T00:17:07.844 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:07.844 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":192,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:17:05.016951+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:17:01.995187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-08-17T00:17:03.026269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:17:07.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3fc05a180 msgr2=0x7ff3fc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3fc05a180 0x7ff3fc05c640 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 rx=0x7ff400000ef0 tx=0x7ff400015000).stop 2023-08-17T00:17:07.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 msgr2=0x7ff410153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:07.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 0x7ff410153370 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 rx=0x7ff410068440 tx=0x7ff408009040).stop 2023-08-17T00:17:07.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 shutdown_connections 2023-08-17T00:17:07.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff3fc05a180 0x7ff3fc05c640 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff410152f30 0x7ff410153370 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4100c0a80 0x7ff4100c0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 --2- 172.21.15.153:0/1465109799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff3f8003a70 0x7ff410150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:07.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 >> 172.21.15.153:0/1465109799 conn(0x7ff4100c6620 msgr2=0x7ff4100c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:07.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 shutdown_connections 2023-08-17T00:17:07.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:07.843+0000 7ff415079700 1 -- 172.21.15.153:0/1465109799 wait complete. 2023-08-17T00:17:07.869 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-17T00:17:07.870 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:17:08.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.019+0000 7f3d9b89b700 1 Processor -- start 2023-08-17T00:17:08.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d9b89b700 1 -- start start 2023-08-17T00:17:08.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d9b89b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d9414e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d9b89b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d940c6a40 0x7f3d940c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d9b89b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d941540a0 con 0x7f3d94066ee0 2023-08-17T00:17:08.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d9b89b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d941550a0 con 0x7f3d940c6a40 2023-08-17T00:17:08.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d9b89b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94154c10 con 0x7f3d9414de30 2023-08-17T00:17:08.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d99e38700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f3d94066ee0 0x7f3d940c5310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45074/0 (socket says 172.21.15.153:45074) 2023-08-17T00:17:08.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d99e38700 1 -- 172.21.15.153:0/4060036423 learned_addr learned my addr 172.21.15.153:0/4060036423 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:08.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d98e36700 1 --2- 172.21.15.153:0/4060036423 >> v2:172.21.15.178:3300/0 conn(0x7f3d940c6a40 0x7f3d940c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.023+0000 7f3d99637700 1 --2- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d9414e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d98e36700 1 -- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 msgr2=0x7f3d9414e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:08.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d98e36700 1 --2- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d9414e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d98e36700 1 -- 172.21.15.153:0/4060036423 >> v1:172.21.15.153:6789/0 conn(0x7f3d94066ee0 legacy=0x7f3d940c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d98e36700 1 -- 172.21.15.153:0/4060036423 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940c73b0 con 0x7f3d940c6a40 2023-08-17T00:17:08.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d98e36700 1 --2- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 0x7f3d940c6ec0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f3d84009760 tx=0x7f3d84009060).ready entity=mon.1 client_cookie=33c897fb9dc2599d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d8bfff700 1 -- 172.21.15.153:0/4060036423 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d840090d0 con 0x7f3d940c6a40 2023-08-17T00:17:08.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d8bfff700 1 -- 172.21.15.153:0/4060036423 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8400d4a0 con 0x7f3d940c6a40 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d8bfff700 1 -- 172.21.15.153:0/4060036423 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400d820 con 0x7f3d940c6a40 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 -- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 msgr2=0x7f3d940c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 0x7f3d940c6ec0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7f3d84009760 tx=0x7f3d84009060).stop 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 -- 172.21.15.153:0/4060036423 shutdown_connections 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 0x7f3d940c6ec0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/4060036423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d9414e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 -- 172.21.15.153:0/4060036423 >> 172.21.15.153:0/4060036423 conn(0x7f3d940c4250 msgr2=0x7f3d940c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:08.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 -- 172.21.15.153:0/4060036423 shutdown_connections 2023-08-17T00:17:08.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.027+0000 7f3d9b89b700 1 -- 172.21.15.153:0/4060036423 wait complete. 2023-08-17T00:17:08.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 Processor -- start 2023-08-17T00:17:08.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 -- start start 2023-08-17T00:17:08.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 0x7f3d9414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 0x7f3d940a7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d940a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d94150580 con 0x7f3d94066ee0 2023-08-17T00:17:08.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d940a7780 con 0x7f3d940c6a40 2023-08-17T00:17:08.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d9b89b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9414ed80 con 0x7f3d9414de30 2023-08-17T00:17:08.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 0x7f3d9414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 0x7f3d9414e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47056/0 (socket says 172.21.15.153:47056) 2023-08-17T00:17:08.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 -- 172.21.15.153:0/3225657728 learned_addr learned my addr 172.21.15.153:0/3225657728 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:08.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 -- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 msgr2=0x7f3d940a9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99e38700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d940a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d940a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 -- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 msgr2=0x7f3d940a7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 0x7f3d940a7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 -- 172.21.15.153:0/3225657728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d840092a0 con 0x7f3d94066ee0 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d99637700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 0x7f3d9414e7a0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f3d9000e900 tx=0x7f3d90009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000c640 con 0x7f3d94066ee0 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9414f060 con 0x7f3d94066ee0 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.031+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9000c7a0 con 0x7f3d94066ee0 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000cb20 con 0x7f3d94066ee0 2023-08-17T00:17:08.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9414f620 con 0x7f3d94066ee0 2023-08-17T00:17:08.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9406b530 con 0x7f3d94066ee0 2023-08-17T00:17:08.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3d90022070 con 0x7f3d94066ee0 2023-08-17T00:17:08.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d897fa700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d7805a150 0x7f3d7805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.035+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f3d900744f0 con 0x7f3d94066ee0 2023-08-17T00:17:08.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.039+0000 7f3d98e36700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d7805a150 0x7f3d7805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.039+0000 7f3d98e36700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d7805a150 0x7f3d7805c610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f3d84009760 tx=0x7f3d84014000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.043+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f3d90047e90 con 0x7f3d94066ee0 2023-08-17T00:17:08.203 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.199+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d941506c0 con 0x7f3d7805a150 2023-08-17T00:17:08.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.219+0000 7f3d897fa700 1 -- 172.21.15.153:0/3225657728 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358275 (secure 0 0 0) 0x7f3d8400d610 con 0x7f3d7805a150 2023-08-17T00:17:08.226 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:08.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d7805a150 msgr2=0x7f3d7805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d7805a150 0x7f3d7805c610 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f3d84009760 tx=0x7f3d84014000).stop 2023-08-17T00:17:08.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 msgr2=0x7f3d9414e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 0x7f3d9414e7a0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 rx=0x7f3d9000e900 tx=0x7f3d90009060).stop 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 shutdown_connections 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3d7805a150 0x7f3d7805c610 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d9414de30 0x7f3d940a9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d940c6a40 0x7f3d940a7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 --2- 172.21.15.153:0/3225657728 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3d94066ee0 0x7f3d9414e7a0 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.229 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 >> 172.21.15.153:0/3225657728 conn(0x7f3d940c4250 msgr2=0x7f3d94153960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:08.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 shutdown_connections 2023-08-17T00:17:08.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.223+0000 7f3d9b89b700 1 -- 172.21.15.153:0/3225657728 wait complete. 2023-08-17T00:17:08.230 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:17:08.249 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":617,"stamp":"2023-08-17T00:17:07.502423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453812,"kb_used_data":18676,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520908,"statfs":{"total":773094113280,"available":770581409792,"internally_reserved":0,"allocated":19124224,"data_stored":8985426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308502,"num_objects":-1024,"num_object_clones":0,"num_object_copies":-2048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3064,"num_write_kb":-7684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-22,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.500712"},"pg_stats":[{"pgid":"28.38","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040967+0000","last_change":"2023-08-17T00:17:04.040967+0000","last_active":"2023-08-17T00:17:04.040967+0000","last_peered":"2023-08-17T00:17:04.040967+0000","last_clean":"2023-08-17T00:17:04.040967+0000","last_became_active":"2023-08-17T00:17:04.040675+0000","last_became_peered":"2023-08-17T00:17:04.040675+0000","last_unstale":"2023-08-17T00:17:04.040967+0000","last_undegraded":"2023-08-17T00:17:04.040967+0000","last_fullsized":"2023-08-17T00:17:04.040967+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"191'3","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055847+0000","last_change":"2023-08-17T00:17:03.602509+0000","last_active":"2023-08-17T00:17:04.055847+0000","last_peered":"2023-08-17T00:17:04.055847+0000","last_clean":"2023-08-17T00:17:04.055847+0000","last_became_active":"2023-08-17T00:17:03.600517+0000","last_became_peered":"2023-08-17T00:17:03.600517+0000","last_unstale":"2023-08-17T00:17:04.055847+0000","last_undegraded":"2023-08-17T00:17:04.055847+0000","last_fullsized":"2023-08-17T00:17:04.055847+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051198+0000","last_change":"2023-08-17T00:17:04.051198+0000","last_active":"2023-08-17T00:17:04.051198+0000","last_peered":"2023-08-17T00:17:04.051198+0000","last_clean":"2023-08-17T00:17:04.051198+0000","last_became_active":"2023-08-17T00:17:04.050838+0000","last_became_peered":"2023-08-17T00:17:04.050838+0000","last_unstale":"2023-08-17T00:17:04.051198+0000","last_undegraded":"2023-08-17T00:17:04.051198+0000","last_fullsized":"2023-08-17T00:17:04.051198+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607848+0000","last_change":"2023-08-17T00:17:03.604286+0000","last_active":"2023-08-17T00:17:03.607848+0000","last_peered":"2023-08-17T00:17:03.607848+0000","last_clean":"2023-08-17T00:17:03.607848+0000","last_became_active":"2023-08-17T00:17:03.603847+0000","last_became_peered":"2023-08-17T00:17:03.603847+0000","last_unstale":"2023-08-17T00:17:03.607848+0000","last_undegraded":"2023-08-17T00:17:03.607848+0000","last_fullsized":"2023-08-17T00:17:03.607848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032945+0000","last_change":"2023-08-17T00:17:04.032945+0000","last_active":"2023-08-17T00:17:04.032945+0000","last_peered":"2023-08-17T00:17:04.032945+0000","last_clean":"2023-08-17T00:17:04.032945+0000","last_became_active":"2023-08-17T00:17:04.032690+0000","last_became_peered":"2023-08-17T00:17:04.032690+0000","last_unstale":"2023-08-17T00:17:04.032945+0000","last_undegraded":"2023-08-17T00:17:04.032945+0000","last_fullsized":"2023-08-17T00:17:04.032945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.616335+0000","last_change":"2023-08-17T00:17:03.610919+0000","last_active":"2023-08-17T00:17:03.616335+0000","last_peered":"2023-08-17T00:17:03.616335+0000","last_clean":"2023-08-17T00:17:03.616335+0000","last_became_active":"2023-08-17T00:17:03.610412+0000","last_became_peered":"2023-08-17T00:17:03.610412+0000","last_unstale":"2023-08-17T00:17:03.616335+0000","last_undegraded":"2023-08-17T00:17:03.616335+0000","last_fullsized":"2023-08-17T00:17:03.616335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056564+0000","last_change":"2023-08-17T00:17:04.056564+0000","last_active":"2023-08-17T00:17:04.056564+0000","last_peered":"2023-08-17T00:17:04.056564+0000","last_clean":"2023-08-17T00:17:04.056564+0000","last_became_active":"2023-08-17T00:17:04.055878+0000","last_became_peered":"2023-08-17T00:17:04.055878+0000","last_unstale":"2023-08-17T00:17:04.056564+0000","last_undegraded":"2023-08-17T00:17:04.056564+0000","last_fullsized":"2023-08-17T00:17:04.056564+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3c","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052608+0000","last_change":"2023-08-17T00:17:03.607955+0000","last_active":"2023-08-17T00:17:04.052608+0000","last_peered":"2023-08-17T00:17:04.052608+0000","last_clean":"2023-08-17T00:17:04.052608+0000","last_became_active":"2023-08-17T00:17:03.605724+0000","last_became_peered":"2023-08-17T00:17:03.605724+0000","last_unstale":"2023-08-17T00:17:04.052608+0000","last_undegraded":"2023-08-17T00:17:04.052608+0000","last_fullsized":"2023-08-17T00:17:04.052608+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050546+0000","last_change":"2023-08-17T00:17:04.050546+0000","last_active":"2023-08-17T00:17:04.050546+0000","last_peered":"2023-08-17T00:17:04.050546+0000","last_clean":"2023-08-17T00:17:04.050546+0000","last_became_active":"2023-08-17T00:17:04.048601+0000","last_became_peered":"2023-08-17T00:17:04.048601+0000","last_unstale":"2023-08-17T00:17:04.050546+0000","last_undegraded":"2023-08-17T00:17:04.050546+0000","last_fullsized":"2023-08-17T00:17:04.050546+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039450+0000","last_change":"2023-08-17T00:17:03.609495+0000","last_active":"2023-08-17T00:17:04.039450+0000","last_peered":"2023-08-17T00:17:04.039450+0000","last_clean":"2023-08-17T00:17:04.039450+0000","last_became_active":"2023-08-17T00:17:03.609224+0000","last_became_peered":"2023-08-17T00:17:03.609224+0000","last_unstale":"2023-08-17T00:17:04.039450+0000","last_undegraded":"2023-08-17T00:17:04.039450+0000","last_fullsized":"2023-08-17T00:17:04.039450+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050914+0000","last_change":"2023-08-17T00:17:04.050914+0000","last_active":"2023-08-17T00:17:04.050914+0000","last_peered":"2023-08-17T00:17:04.050914+0000","last_clean":"2023-08-17T00:17:04.050914+0000","last_became_active":"2023-08-17T00:17:04.050552+0000","last_became_peered":"2023-08-17T00:17:04.050552+0000","last_unstale":"2023-08-17T00:17:04.050914+0000","last_undegraded":"2023-08-17T00:17:04.050914+0000","last_fullsized":"2023-08-17T00:17:04.050914+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3a","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028601+0000","last_change":"2023-08-17T00:17:03.592834+0000","last_active":"2023-08-17T00:17:04.028601+0000","last_peered":"2023-08-17T00:17:04.028601+0000","last_clean":"2023-08-17T00:17:04.028601+0000","last_became_active":"2023-08-17T00:17:03.592529+0000","last_became_peered":"2023-08-17T00:17:03.592529+0000","last_unstale":"2023-08-17T00:17:04.028601+0000","last_undegraded":"2023-08-17T00:17:04.028601+0000","last_fullsized":"2023-08-17T00:17:04.028601+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613512+0000","last_change":"2023-08-17T00:17:03.603048+0000","last_active":"2023-08-17T00:17:03.613512+0000","last_peered":"2023-08-17T00:17:03.613512+0000","last_clean":"2023-08-17T00:17:03.613512+0000","last_became_active":"2023-08-17T00:17:03.600931+0000","last_became_peered":"2023-08-17T00:17:03.600931+0000","last_unstale":"2023-08-17T00:17:03.613512+0000","last_undegraded":"2023-08-17T00:17:03.613512+0000","last_fullsized":"2023-08-17T00:17:03.613512+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.043639+0000","last_change":"2023-08-17T00:17:04.043639+0000","last_active":"2023-08-17T00:17:04.043639+0000","last_peered":"2023-08-17T00:17:04.043639+0000","last_clean":"2023-08-17T00:17:04.043639+0000","last_became_active":"2023-08-17T00:17:04.043074+0000","last_became_peered":"2023-08-17T00:17:04.043074+0000","last_unstale":"2023-08-17T00:17:04.043639+0000","last_undegraded":"2023-08-17T00:17:04.043639+0000","last_fullsized":"2023-08-17T00:17:04.043639+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.564705+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045697+0000","last_change":"2023-08-17T00:17:04.045697+0000","last_active":"2023-08-17T00:17:04.045697+0000","last_peered":"2023-08-17T00:17:04.045697+0000","last_clean":"2023-08-17T00:17:04.045697+0000","last_became_active":"2023-08-17T00:17:04.045400+0000","last_became_peered":"2023-08-17T00:17:04.045400+0000","last_unstale":"2023-08-17T00:17:04.045697+0000","last_undegraded":"2023-08-17T00:17:04.045697+0000","last_fullsized":"2023-08-17T00:17:04.045697+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.604216+0000","last_change":"2023-08-17T00:17:03.597710+0000","last_active":"2023-08-17T00:17:03.604216+0000","last_peered":"2023-08-17T00:17:03.604216+0000","last_clean":"2023-08-17T00:17:03.604216+0000","last_became_active":"2023-08-17T00:17:03.597376+0000","last_became_peered":"2023-08-17T00:17:03.597376+0000","last_unstale":"2023-08-17T00:17:03.604216+0000","last_undegraded":"2023-08-17T00:17:03.604216+0000","last_fullsized":"2023-08-17T00:17:03.604216+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058213+0000","last_change":"2023-08-17T00:17:04.058213+0000","last_active":"2023-08-17T00:17:04.058213+0000","last_peered":"2023-08-17T00:17:04.058213+0000","last_clean":"2023-08-17T00:17:04.058213+0000","last_became_active":"2023-08-17T00:17:04.057812+0000","last_became_peered":"2023-08-17T00:17:04.057812+0000","last_unstale":"2023-08-17T00:17:04.058213+0000","last_undegraded":"2023-08-17T00:17:04.058213+0000","last_fullsized":"2023-08-17T00:17:04.058213+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617346+0000","last_change":"2023-08-17T00:17:03.614190+0000","last_active":"2023-08-17T00:17:03.617346+0000","last_peered":"2023-08-17T00:17:03.617346+0000","last_clean":"2023-08-17T00:17:03.617346+0000","last_became_active":"2023-08-17T00:17:03.613882+0000","last_became_peered":"2023-08-17T00:17:03.613882+0000","last_unstale":"2023-08-17T00:17:03.617346+0000","last_undegraded":"2023-08-17T00:17:03.617346+0000","last_fullsized":"2023-08-17T00:17:03.617346+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040600+0000","last_change":"2023-08-17T00:17:04.040600+0000","last_active":"2023-08-17T00:17:04.040600+0000","last_peered":"2023-08-17T00:17:04.040600+0000","last_clean":"2023-08-17T00:17:04.040600+0000","last_became_active":"2023-08-17T00:17:04.040327+0000","last_became_peered":"2023-08-17T00:17:04.040327+0000","last_unstale":"2023-08-17T00:17:04.040600+0000","last_undegraded":"2023-08-17T00:17:04.040600+0000","last_fullsized":"2023-08-17T00:17:04.040600+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613478+0000","last_change":"2023-08-17T00:17:03.606219+0000","last_active":"2023-08-17T00:17:03.613478+0000","last_peered":"2023-08-17T00:17:03.613478+0000","last_clean":"2023-08-17T00:17:03.613478+0000","last_became_active":"2023-08-17T00:17:03.605882+0000","last_became_peered":"2023-08-17T00:17:03.605882+0000","last_unstale":"2023-08-17T00:17:03.613478+0000","last_undegraded":"2023-08-17T00:17:03.613478+0000","last_fullsized":"2023-08-17T00:17:03.613478+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056101+0000","last_change":"2023-08-17T00:17:04.056101+0000","last_active":"2023-08-17T00:17:04.056101+0000","last_peered":"2023-08-17T00:17:04.056101+0000","last_clean":"2023-08-17T00:17:04.056101+0000","last_became_active":"2023-08-17T00:17:04.055714+0000","last_became_peered":"2023-08-17T00:17:04.055714+0000","last_unstale":"2023-08-17T00:17:04.056101+0000","last_undegraded":"2023-08-17T00:17:04.056101+0000","last_fullsized":"2023-08-17T00:17:04.056101+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.043499+0000","last_change":"2023-08-17T00:17:03.604784+0000","last_active":"2023-08-17T00:17:04.043499+0000","last_peered":"2023-08-17T00:17:04.043499+0000","last_clean":"2023-08-17T00:17:04.043499+0000","last_became_active":"2023-08-17T00:17:03.604488+0000","last_became_peered":"2023-08-17T00:17:03.604488+0000","last_unstale":"2023-08-17T00:17:04.043499+0000","last_undegraded":"2023-08-17T00:17:04.043499+0000","last_fullsized":"2023-08-17T00:17:04.043499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034467+0000","last_change":"2023-08-17T00:17:03.611509+0000","last_active":"2023-08-17T00:17:04.034467+0000","last_peered":"2023-08-17T00:17:04.034467+0000","last_clean":"2023-08-17T00:17:04.034467+0000","last_became_active":"2023-08-17T00:17:03.610877+0000","last_became_peered":"2023-08-17T00:17:03.610877+0000","last_unstale":"2023-08-17T00:17:04.034467+0000","last_undegraded":"2023-08-17T00:17:04.034467+0000","last_fullsized":"2023-08-17T00:17:04.034467+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048382+0000","last_change":"2023-08-17T00:17:04.048382+0000","last_active":"2023-08-17T00:17:04.048382+0000","last_peered":"2023-08-17T00:17:04.048382+0000","last_clean":"2023-08-17T00:17:04.048382+0000","last_became_active":"2023-08-17T00:17:04.048079+0000","last_became_peered":"2023-08-17T00:17:04.048079+0000","last_unstale":"2023-08-17T00:17:04.048382+0000","last_undegraded":"2023-08-17T00:17:04.048382+0000","last_fullsized":"2023-08-17T00:17:04.048382+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.610430+0000","last_change":"2023-08-17T00:17:03.609075+0000","last_active":"2023-08-17T00:17:03.610430+0000","last_peered":"2023-08-17T00:17:03.610430+0000","last_clean":"2023-08-17T00:17:03.610430+0000","last_became_active":"2023-08-17T00:17:03.608809+0000","last_became_peered":"2023-08-17T00:17:03.608809+0000","last_unstale":"2023-08-17T00:17:03.610430+0000","last_undegraded":"2023-08-17T00:17:03.610430+0000","last_fullsized":"2023-08-17T00:17:03.610430+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038159+0000","last_change":"2023-08-17T00:17:04.038159+0000","last_active":"2023-08-17T00:17:04.038159+0000","last_peered":"2023-08-17T00:17:04.038159+0000","last_clean":"2023-08-17T00:17:04.038159+0000","last_became_active":"2023-08-17T00:17:04.037825+0000","last_became_peered":"2023-08-17T00:17:04.037825+0000","last_unstale":"2023-08-17T00:17:04.038159+0000","last_undegraded":"2023-08-17T00:17:04.038159+0000","last_fullsized":"2023-08-17T00:17:04.038159+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603144+0000","last_change":"2023-08-17T00:17:03.597502+0000","last_active":"2023-08-17T00:17:03.603144+0000","last_peered":"2023-08-17T00:17:03.603144+0000","last_clean":"2023-08-17T00:17:03.603144+0000","last_became_active":"2023-08-17T00:17:03.597168+0000","last_became_peered":"2023-08-17T00:17:03.597168+0000","last_unstale":"2023-08-17T00:17:03.603144+0000","last_undegraded":"2023-08-17T00:17:03.603144+0000","last_fullsized":"2023-08-17T00:17:03.603144+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048095+0000","last_change":"2023-08-17T00:17:04.048095+0000","last_active":"2023-08-17T00:17:04.048095+0000","last_peered":"2023-08-17T00:17:04.048095+0000","last_clean":"2023-08-17T00:17:04.048095+0000","last_became_active":"2023-08-17T00:17:04.047658+0000","last_became_peered":"2023-08-17T00:17:04.047658+0000","last_unstale":"2023-08-17T00:17:04.048095+0000","last_undegraded":"2023-08-17T00:17:04.048095+0000","last_fullsized":"2023-08-17T00:17:04.048095+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.30","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055789+0000","last_change":"2023-08-17T00:17:03.600911+0000","last_active":"2023-08-17T00:17:04.055789+0000","last_peered":"2023-08-17T00:17:04.055789+0000","last_clean":"2023-08-17T00:17:04.055789+0000","last_became_active":"2023-08-17T00:17:03.600488+0000","last_became_peered":"2023-08-17T00:17:03.600488+0000","last_unstale":"2023-08-17T00:17:04.055789+0000","last_undegraded":"2023-08-17T00:17:04.055789+0000","last_fullsized":"2023-08-17T00:17:04.055789+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056919+0000","last_change":"2023-08-17T00:17:04.056919+0000","last_active":"2023-08-17T00:17:04.056919+0000","last_peered":"2023-08-17T00:17:04.056919+0000","last_clean":"2023-08-17T00:17:04.056919+0000","last_became_active":"2023-08-17T00:17:04.056440+0000","last_became_peered":"2023-08-17T00:17:04.056440+0000","last_unstale":"2023-08-17T00:17:04.056919+0000","last_undegraded":"2023-08-17T00:17:04.056919+0000","last_fullsized":"2023-08-17T00:17:04.056919+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.614822+0000","last_change":"2023-08-17T00:17:03.609894+0000","last_active":"2023-08-17T00:17:03.614822+0000","last_peered":"2023-08-17T00:17:03.614822+0000","last_clean":"2023-08-17T00:17:03.614822+0000","last_became_active":"2023-08-17T00:17:03.609602+0000","last_became_peered":"2023-08-17T00:17:03.609602+0000","last_unstale":"2023-08-17T00:17:03.614822+0000","last_undegraded":"2023-08-17T00:17:03.614822+0000","last_fullsized":"2023-08-17T00:17:03.614822+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050491+0000","last_change":"2023-08-17T00:17:04.050491+0000","last_active":"2023-08-17T00:17:04.050491+0000","last_peered":"2023-08-17T00:17:04.050491+0000","last_clean":"2023-08-17T00:17:04.050491+0000","last_became_active":"2023-08-17T00:17:04.050001+0000","last_became_peered":"2023-08-17T00:17:04.050001+0000","last_unstale":"2023-08-17T00:17:04.050491+0000","last_undegraded":"2023-08-17T00:17:04.050491+0000","last_fullsized":"2023-08-17T00:17:04.050491+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.616455+0000","last_change":"2023-08-17T00:17:03.611855+0000","last_active":"2023-08-17T00:17:03.616455+0000","last_peered":"2023-08-17T00:17:03.616455+0000","last_clean":"2023-08-17T00:17:03.616455+0000","last_became_active":"2023-08-17T00:17:03.611566+0000","last_became_peered":"2023-08-17T00:17:03.611566+0000","last_unstale":"2023-08-17T00:17:03.616455+0000","last_undegraded":"2023-08-17T00:17:03.616455+0000","last_fullsized":"2023-08-17T00:17:03.616455+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049971+0000","last_change":"2023-08-17T00:17:04.049971+0000","last_active":"2023-08-17T00:17:04.049971+0000","last_peered":"2023-08-17T00:17:04.049971+0000","last_clean":"2023-08-17T00:17:04.049971+0000","last_became_active":"2023-08-17T00:17:04.049710+0000","last_became_peered":"2023-08-17T00:17:04.049710+0000","last_unstale":"2023-08-17T00:17:04.049971+0000","last_undegraded":"2023-08-17T00:17:04.049971+0000","last_fullsized":"2023-08-17T00:17:04.049971+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2d","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040966+0000","last_change":"2023-08-17T00:17:03.611104+0000","last_active":"2023-08-17T00:17:04.040966+0000","last_peered":"2023-08-17T00:17:04.040966+0000","last_clean":"2023-08-17T00:17:04.040966+0000","last_became_active":"2023-08-17T00:17:03.610764+0000","last_became_peered":"2023-08-17T00:17:03.610764+0000","last_unstale":"2023-08-17T00:17:04.040966+0000","last_undegraded":"2023-08-17T00:17:04.040966+0000","last_fullsized":"2023-08-17T00:17:04.040966+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054835+0000","last_change":"2023-08-17T00:17:04.054835+0000","last_active":"2023-08-17T00:17:04.054835+0000","last_peered":"2023-08-17T00:17:04.054835+0000","last_clean":"2023-08-17T00:17:04.054835+0000","last_became_active":"2023-08-17T00:17:04.054587+0000","last_became_peered":"2023-08-17T00:17:04.054587+0000","last_unstale":"2023-08-17T00:17:04.054835+0000","last_undegraded":"2023-08-17T00:17:04.054835+0000","last_fullsized":"2023-08-17T00:17:04.054835+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617261+0000","last_change":"2023-08-17T00:17:03.612980+0000","last_active":"2023-08-17T00:17:03.617261+0000","last_peered":"2023-08-17T00:17:03.617261+0000","last_clean":"2023-08-17T00:17:03.617261+0000","last_became_active":"2023-08-17T00:17:03.612688+0000","last_became_peered":"2023-08-17T00:17:03.612688+0000","last_unstale":"2023-08-17T00:17:03.617261+0000","last_undegraded":"2023-08-17T00:17:03.617261+0000","last_fullsized":"2023-08-17T00:17:03.617261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055847+0000","last_change":"2023-08-17T00:17:04.055847+0000","last_active":"2023-08-17T00:17:04.055847+0000","last_peered":"2023-08-17T00:17:04.055847+0000","last_clean":"2023-08-17T00:17:04.055847+0000","last_became_active":"2023-08-17T00:17:04.051524+0000","last_became_peered":"2023-08-17T00:17:04.051524+0000","last_unstale":"2023-08-17T00:17:04.055847+0000","last_undegraded":"2023-08-17T00:17:04.055847+0000","last_fullsized":"2023-08-17T00:17:04.055847+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022175+0000","last_change":"2023-08-17T00:17:03.606708+0000","last_active":"2023-08-17T00:17:04.022175+0000","last_peered":"2023-08-17T00:17:04.022175+0000","last_clean":"2023-08-17T00:17:04.022175+0000","last_became_active":"2023-08-17T00:17:03.606429+0000","last_became_peered":"2023-08-17T00:17:03.606429+0000","last_unstale":"2023-08-17T00:17:04.022175+0000","last_undegraded":"2023-08-17T00:17:04.022175+0000","last_fullsized":"2023-08-17T00:17:04.022175+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050797+0000","last_change":"2023-08-17T00:17:04.050797+0000","last_active":"2023-08-17T00:17:04.050797+0000","last_peered":"2023-08-17T00:17:04.050797+0000","last_clean":"2023-08-17T00:17:04.050797+0000","last_became_active":"2023-08-17T00:17:04.050543+0000","last_became_peered":"2023-08-17T00:17:04.050543+0000","last_unstale":"2023-08-17T00:17:04.050797+0000","last_undegraded":"2023-08-17T00:17:04.050797+0000","last_fullsized":"2023-08-17T00:17:04.050797+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.600754+0000","last_change":"2023-08-17T00:17:03.597621+0000","last_active":"2023-08-17T00:17:03.600754+0000","last_peered":"2023-08-17T00:17:03.600754+0000","last_clean":"2023-08-17T00:17:03.600754+0000","last_became_active":"2023-08-17T00:17:03.597317+0000","last_became_peered":"2023-08-17T00:17:03.597317+0000","last_unstale":"2023-08-17T00:17:03.600754+0000","last_undegraded":"2023-08-17T00:17:03.600754+0000","last_fullsized":"2023-08-17T00:17:03.600754+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603854+0000","last_change":"2023-08-17T00:17:03.599495+0000","last_active":"2023-08-17T00:17:03.603854+0000","last_peered":"2023-08-17T00:17:03.603854+0000","last_clean":"2023-08-17T00:17:03.603854+0000","last_became_active":"2023-08-17T00:17:03.599051+0000","last_became_peered":"2023-08-17T00:17:03.599051+0000","last_unstale":"2023-08-17T00:17:03.603854+0000","last_undegraded":"2023-08-17T00:17:03.603854+0000","last_fullsized":"2023-08-17T00:17:03.603854+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040949+0000","last_change":"2023-08-17T00:17:04.040949+0000","last_active":"2023-08-17T00:17:04.040949+0000","last_peered":"2023-08-17T00:17:04.040949+0000","last_clean":"2023-08-17T00:17:04.040949+0000","last_became_active":"2023-08-17T00:17:04.040663+0000","last_became_peered":"2023-08-17T00:17:04.040663+0000","last_unstale":"2023-08-17T00:17:04.040949+0000","last_undegraded":"2023-08-17T00:17:04.040949+0000","last_fullsized":"2023-08-17T00:17:04.040949+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607214+0000","last_change":"2023-08-17T00:17:03.601055+0000","last_active":"2023-08-17T00:17:03.607214+0000","last_peered":"2023-08-17T00:17:03.607214+0000","last_clean":"2023-08-17T00:17:03.607214+0000","last_became_active":"2023-08-17T00:17:03.600760+0000","last_became_peered":"2023-08-17T00:17:03.600760+0000","last_unstale":"2023-08-17T00:17:03.607214+0000","last_undegraded":"2023-08-17T00:17:03.607214+0000","last_fullsized":"2023-08-17T00:17:03.607214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042770+0000","last_change":"2023-08-17T00:17:04.042770+0000","last_active":"2023-08-17T00:17:04.042770+0000","last_peered":"2023-08-17T00:17:04.042770+0000","last_clean":"2023-08-17T00:17:04.042770+0000","last_became_active":"2023-08-17T00:17:04.042363+0000","last_became_peered":"2023-08-17T00:17:04.042363+0000","last_unstale":"2023-08-17T00:17:04.042770+0000","last_undegraded":"2023-08-17T00:17:04.042770+0000","last_fullsized":"2023-08-17T00:17:04.042770+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617826+0000","last_change":"2023-08-17T00:17:03.610988+0000","last_active":"2023-08-17T00:17:03.617826+0000","last_peered":"2023-08-17T00:17:03.617826+0000","last_clean":"2023-08-17T00:17:03.617826+0000","last_became_active":"2023-08-17T00:17:03.609830+0000","last_became_peered":"2023-08-17T00:17:03.609830+0000","last_unstale":"2023-08-17T00:17:03.617826+0000","last_undegraded":"2023-08-17T00:17:03.617826+0000","last_fullsized":"2023-08-17T00:17:03.617826+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052392+0000","last_change":"2023-08-17T00:17:04.052392+0000","last_active":"2023-08-17T00:17:04.052392+0000","last_peered":"2023-08-17T00:17:04.052392+0000","last_clean":"2023-08-17T00:17:04.052392+0000","last_became_active":"2023-08-17T00:17:04.052134+0000","last_became_peered":"2023-08-17T00:17:04.052134+0000","last_unstale":"2023-08-17T00:17:04.052392+0000","last_undegraded":"2023-08-17T00:17:04.052392+0000","last_fullsized":"2023-08-17T00:17:04.052392+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563951+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035061+0000","last_change":"2023-08-17T00:17:04.035061+0000","last_active":"2023-08-17T00:17:04.035061+0000","last_peered":"2023-08-17T00:17:04.035061+0000","last_clean":"2023-08-17T00:17:04.035061+0000","last_became_active":"2023-08-17T00:17:04.034776+0000","last_became_peered":"2023-08-17T00:17:04.034776+0000","last_unstale":"2023-08-17T00:17:04.035061+0000","last_undegraded":"2023-08-17T00:17:04.035061+0000","last_fullsized":"2023-08-17T00:17:04.035061+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.612779+0000","last_change":"2023-08-17T00:17:03.607437+0000","last_active":"2023-08-17T00:17:03.612779+0000","last_peered":"2023-08-17T00:17:03.612779+0000","last_clean":"2023-08-17T00:17:03.612779+0000","last_became_active":"2023-08-17T00:17:03.603660+0000","last_became_peered":"2023-08-17T00:17:03.603660+0000","last_unstale":"2023-08-17T00:17:03.612779+0000","last_undegraded":"2023-08-17T00:17:03.612779+0000","last_fullsized":"2023-08-17T00:17:03.612779+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563287+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.600610+0000","last_change":"2023-08-17T00:17:03.597907+0000","last_active":"2023-08-17T00:17:03.600610+0000","last_peered":"2023-08-17T00:17:03.600610+0000","last_clean":"2023-08-17T00:17:03.600610+0000","last_became_active":"2023-08-17T00:17:03.597644+0000","last_became_peered":"2023-08-17T00:17:03.597644+0000","last_unstale":"2023-08-17T00:17:03.600610+0000","last_undegraded":"2023-08-17T00:17:03.600610+0000","last_fullsized":"2023-08-17T00:17:03.600610+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056716+0000","last_change":"2023-08-17T00:17:04.056716+0000","last_active":"2023-08-17T00:17:04.056716+0000","last_peered":"2023-08-17T00:17:04.056716+0000","last_clean":"2023-08-17T00:17:04.056716+0000","last_became_active":"2023-08-17T00:17:04.055773+0000","last_became_peered":"2023-08-17T00:17:04.055773+0000","last_unstale":"2023-08-17T00:17:04.056716+0000","last_undegraded":"2023-08-17T00:17:04.056716+0000","last_fullsized":"2023-08-17T00:17:04.056716+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617889+0000","last_change":"2023-08-17T00:17:03.611346+0000","last_active":"2023-08-17T00:17:03.617889+0000","last_peered":"2023-08-17T00:17:03.617889+0000","last_clean":"2023-08-17T00:17:03.617889+0000","last_became_active":"2023-08-17T00:17:03.611004+0000","last_became_peered":"2023-08-17T00:17:03.611004+0000","last_unstale":"2023-08-17T00:17:03.617889+0000","last_undegraded":"2023-08-17T00:17:03.617889+0000","last_fullsized":"2023-08-17T00:17:03.617889+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048187+0000","last_change":"2023-08-17T00:17:04.048187+0000","last_active":"2023-08-17T00:17:04.048187+0000","last_peered":"2023-08-17T00:17:04.048187+0000","last_clean":"2023-08-17T00:17:04.048187+0000","last_became_active":"2023-08-17T00:17:04.047889+0000","last_became_peered":"2023-08-17T00:17:04.047889+0000","last_unstale":"2023-08-17T00:17:04.048187+0000","last_undegraded":"2023-08-17T00:17:04.048187+0000","last_fullsized":"2023-08-17T00:17:04.048187+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617311+0000","last_change":"2023-08-17T00:17:03.613617+0000","last_active":"2023-08-17T00:17:03.617311+0000","last_peered":"2023-08-17T00:17:03.617311+0000","last_clean":"2023-08-17T00:17:03.617311+0000","last_became_active":"2023-08-17T00:17:03.612763+0000","last_became_peered":"2023-08-17T00:17:03.612763+0000","last_unstale":"2023-08-17T00:17:03.617311+0000","last_undegraded":"2023-08-17T00:17:03.617311+0000","last_fullsized":"2023-08-17T00:17:03.617311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049571+0000","last_change":"2023-08-17T00:17:04.049571+0000","last_active":"2023-08-17T00:17:04.049571+0000","last_peered":"2023-08-17T00:17:04.049571+0000","last_clean":"2023-08-17T00:17:04.049571+0000","last_became_active":"2023-08-17T00:17:04.049298+0000","last_became_peered":"2023-08-17T00:17:04.049298+0000","last_unstale":"2023-08-17T00:17:04.049571+0000","last_undegraded":"2023-08-17T00:17:04.049571+0000","last_fullsized":"2023-08-17T00:17:04.049571+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.601713+0000","last_change":"2023-08-17T00:17:03.596004+0000","last_active":"2023-08-17T00:17:03.601713+0000","last_peered":"2023-08-17T00:17:03.601713+0000","last_clean":"2023-08-17T00:17:03.601713+0000","last_became_active":"2023-08-17T00:17:03.595679+0000","last_became_peered":"2023-08-17T00:17:03.595679+0000","last_unstale":"2023-08-17T00:17:03.601713+0000","last_undegraded":"2023-08-17T00:17:03.601713+0000","last_fullsized":"2023-08-17T00:17:03.601713+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045491+0000","last_change":"2023-08-17T00:17:04.045491+0000","last_active":"2023-08-17T00:17:04.045491+0000","last_peered":"2023-08-17T00:17:04.045491+0000","last_clean":"2023-08-17T00:17:04.045491+0000","last_became_active":"2023-08-17T00:17:04.044996+0000","last_became_peered":"2023-08-17T00:17:04.044996+0000","last_unstale":"2023-08-17T00:17:04.045491+0000","last_undegraded":"2023-08-17T00:17:04.045491+0000","last_fullsized":"2023-08-17T00:17:04.045491+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602324+0000","last_change":"2023-08-17T00:17:03.596073+0000","last_active":"2023-08-17T00:17:03.602324+0000","last_peered":"2023-08-17T00:17:03.602324+0000","last_clean":"2023-08-17T00:17:03.602324+0000","last_became_active":"2023-08-17T00:17:03.595733+0000","last_became_peered":"2023-08-17T00:17:03.595733+0000","last_unstale":"2023-08-17T00:17:03.602324+0000","last_undegraded":"2023-08-17T00:17:03.602324+0000","last_fullsized":"2023-08-17T00:17:03.602324+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045670+0000","last_change":"2023-08-17T00:17:04.045670+0000","last_active":"2023-08-17T00:17:04.045670+0000","last_peered":"2023-08-17T00:17:04.045670+0000","last_clean":"2023-08-17T00:17:04.045670+0000","last_became_active":"2023-08-17T00:17:04.045375+0000","last_became_peered":"2023-08-17T00:17:04.045375+0000","last_unstale":"2023-08-17T00:17:04.045670+0000","last_undegraded":"2023-08-17T00:17:04.045670+0000","last_fullsized":"2023-08-17T00:17:04.045670+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617765+0000","last_change":"2023-08-17T00:17:03.609853+0000","last_active":"2023-08-17T00:17:03.617765+0000","last_peered":"2023-08-17T00:17:03.617765+0000","last_clean":"2023-08-17T00:17:03.617765+0000","last_became_active":"2023-08-17T00:17:03.609486+0000","last_became_peered":"2023-08-17T00:17:03.609486+0000","last_unstale":"2023-08-17T00:17:03.617765+0000","last_undegraded":"2023-08-17T00:17:03.617765+0000","last_fullsized":"2023-08-17T00:17:03.617765+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056410+0000","last_change":"2023-08-17T00:17:04.056410+0000","last_active":"2023-08-17T00:17:04.056410+0000","last_peered":"2023-08-17T00:17:04.056410+0000","last_clean":"2023-08-17T00:17:04.056410+0000","last_became_active":"2023-08-17T00:17:04.056085+0000","last_became_peered":"2023-08-17T00:17:04.056085+0000","last_unstale":"2023-08-17T00:17:04.056410+0000","last_undegraded":"2023-08-17T00:17:04.056410+0000","last_fullsized":"2023-08-17T00:17:04.056410+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563201+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056552+0000","last_change":"2023-08-17T00:17:04.056552+0000","last_active":"2023-08-17T00:17:04.056552+0000","last_peered":"2023-08-17T00:17:04.056552+0000","last_clean":"2023-08-17T00:17:04.056552+0000","last_became_active":"2023-08-17T00:17:04.055842+0000","last_became_peered":"2023-08-17T00:17:04.055842+0000","last_unstale":"2023-08-17T00:17:04.056552+0000","last_undegraded":"2023-08-17T00:17:04.056552+0000","last_fullsized":"2023-08-17T00:17:04.056552+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.14","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056273+0000","last_change":"2023-08-17T00:17:03.600325+0000","last_active":"2023-08-17T00:17:04.056273+0000","last_peered":"2023-08-17T00:17:04.056273+0000","last_clean":"2023-08-17T00:17:04.056273+0000","last_became_active":"2023-08-17T00:17:03.600007+0000","last_became_peered":"2023-08-17T00:17:03.600007+0000","last_unstale":"2023-08-17T00:17:04.056273+0000","last_undegraded":"2023-08-17T00:17:04.056273+0000","last_fullsized":"2023-08-17T00:17:04.056273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.033044+0000","last_change":"2023-08-17T00:17:04.033044+0000","last_active":"2023-08-17T00:17:04.033044+0000","last_peered":"2023-08-17T00:17:04.033044+0000","last_clean":"2023-08-17T00:17:04.033044+0000","last_became_active":"2023-08-17T00:17:04.032572+0000","last_became_peered":"2023-08-17T00:17:04.032572+0000","last_unstale":"2023-08-17T00:17:04.033044+0000","last_undegraded":"2023-08-17T00:17:04.033044+0000","last_fullsized":"2023-08-17T00:17:04.033044+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.13","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039535+0000","last_change":"2023-08-17T00:17:03.611763+0000","last_active":"2023-08-17T00:17:04.039535+0000","last_peered":"2023-08-17T00:17:04.039535+0000","last_clean":"2023-08-17T00:17:04.039535+0000","last_became_active":"2023-08-17T00:17:03.611425+0000","last_became_peered":"2023-08-17T00:17:03.611425+0000","last_unstale":"2023-08-17T00:17:04.039535+0000","last_undegraded":"2023-08-17T00:17:04.039535+0000","last_fullsized":"2023-08-17T00:17:04.039535+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050251+0000","last_change":"2023-08-17T00:17:04.050251+0000","last_active":"2023-08-17T00:17:04.050251+0000","last_peered":"2023-08-17T00:17:04.050251+0000","last_clean":"2023-08-17T00:17:04.050251+0000","last_became_active":"2023-08-17T00:17:04.049738+0000","last_became_peered":"2023-08-17T00:17:04.049738+0000","last_unstale":"2023-08-17T00:17:04.050251+0000","last_undegraded":"2023-08-17T00:17:04.050251+0000","last_fullsized":"2023-08-17T00:17:04.050251+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602708+0000","last_change":"2023-08-17T00:17:03.600255+0000","last_active":"2023-08-17T00:17:03.602708+0000","last_peered":"2023-08-17T00:17:03.602708+0000","last_clean":"2023-08-17T00:17:03.602708+0000","last_became_active":"2023-08-17T00:17:03.599911+0000","last_became_peered":"2023-08-17T00:17:03.599911+0000","last_unstale":"2023-08-17T00:17:03.602708+0000","last_undegraded":"2023-08-17T00:17:03.602708+0000","last_fullsized":"2023-08-17T00:17:03.602708+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613531+0000","last_change":"2023-08-17T00:17:03.604322+0000","last_active":"2023-08-17T00:17:03.613531+0000","last_peered":"2023-08-17T00:17:03.613531+0000","last_clean":"2023-08-17T00:17:03.613531+0000","last_became_active":"2023-08-17T00:17:03.603995+0000","last_became_peered":"2023-08-17T00:17:03.603995+0000","last_unstale":"2023-08-17T00:17:03.613531+0000","last_undegraded":"2023-08-17T00:17:03.613531+0000","last_fullsized":"2023-08-17T00:17:03.613531+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053850+0000","last_change":"2023-08-17T00:17:04.053850+0000","last_active":"2023-08-17T00:17:04.053850+0000","last_peered":"2023-08-17T00:17:04.053850+0000","last_clean":"2023-08-17T00:17:04.053850+0000","last_became_active":"2023-08-17T00:17:04.053597+0000","last_became_peered":"2023-08-17T00:17:04.053597+0000","last_unstale":"2023-08-17T00:17:04.053850+0000","last_undegraded":"2023-08-17T00:17:04.053850+0000","last_fullsized":"2023-08-17T00:17:04.053850+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047575+0000","last_change":"2023-08-17T00:17:03.606608+0000","last_active":"2023-08-17T00:17:04.047575+0000","last_peered":"2023-08-17T00:17:04.047575+0000","last_clean":"2023-08-17T00:17:04.047575+0000","last_became_active":"2023-08-17T00:17:03.606317+0000","last_became_peered":"2023-08-17T00:17:03.606317+0000","last_unstale":"2023-08-17T00:17:04.047575+0000","last_undegraded":"2023-08-17T00:17:04.047575+0000","last_fullsized":"2023-08-17T00:17:04.047575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042596+0000","last_change":"2023-08-17T00:17:04.042596+0000","last_active":"2023-08-17T00:17:04.042596+0000","last_peered":"2023-08-17T00:17:04.042596+0000","last_clean":"2023-08-17T00:17:04.042596+0000","last_became_active":"2023-08-17T00:17:04.042057+0000","last_became_peered":"2023-08-17T00:17:04.042057+0000","last_unstale":"2023-08-17T00:17:04.042596+0000","last_undegraded":"2023-08-17T00:17:04.042596+0000","last_fullsized":"2023-08-17T00:17:04.042596+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034398+0000","last_change":"2023-08-17T00:17:03.608573+0000","last_active":"2023-08-17T00:17:04.034398+0000","last_peered":"2023-08-17T00:17:04.034398+0000","last_clean":"2023-08-17T00:17:04.034398+0000","last_became_active":"2023-08-17T00:17:03.608193+0000","last_became_peered":"2023-08-17T00:17:03.608193+0000","last_unstale":"2023-08-17T00:17:04.034398+0000","last_undegraded":"2023-08-17T00:17:04.034398+0000","last_fullsized":"2023-08-17T00:17:04.034398+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053237+0000","last_change":"2023-08-17T00:17:04.053237+0000","last_active":"2023-08-17T00:17:04.053237+0000","last_peered":"2023-08-17T00:17:04.053237+0000","last_clean":"2023-08-17T00:17:04.053237+0000","last_became_active":"2023-08-17T00:17:04.052979+0000","last_became_peered":"2023-08-17T00:17:04.052979+0000","last_unstale":"2023-08-17T00:17:04.053237+0000","last_undegraded":"2023-08-17T00:17:04.053237+0000","last_fullsized":"2023-08-17T00:17:04.053237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.e","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047976+0000","last_change":"2023-08-17T00:17:03.604251+0000","last_active":"2023-08-17T00:17:04.047976+0000","last_peered":"2023-08-17T00:17:04.047976+0000","last_clean":"2023-08-17T00:17:04.047976+0000","last_became_active":"2023-08-17T00:17:03.603083+0000","last_became_peered":"2023-08-17T00:17:03.603083+0000","last_unstale":"2023-08-17T00:17:04.047976+0000","last_undegraded":"2023-08-17T00:17:04.047976+0000","last_fullsized":"2023-08-17T00:17:04.047976+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047137+0000","last_change":"2023-08-17T00:17:04.047137+0000","last_active":"2023-08-17T00:17:04.047137+0000","last_peered":"2023-08-17T00:17:04.047137+0000","last_clean":"2023-08-17T00:17:04.047137+0000","last_became_active":"2023-08-17T00:17:04.046858+0000","last_became_peered":"2023-08-17T00:17:04.046858+0000","last_unstale":"2023-08-17T00:17:04.047137+0000","last_undegraded":"2023-08-17T00:17:04.047137+0000","last_fullsized":"2023-08-17T00:17:04.047137+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.608668+0000","last_change":"2023-08-17T00:17:03.601090+0000","last_active":"2023-08-17T00:17:03.608668+0000","last_peered":"2023-08-17T00:17:03.608668+0000","last_clean":"2023-08-17T00:17:03.608668+0000","last_became_active":"2023-08-17T00:17:03.600472+0000","last_became_peered":"2023-08-17T00:17:03.600472+0000","last_unstale":"2023-08-17T00:17:03.608668+0000","last_undegraded":"2023-08-17T00:17:03.608668+0000","last_fullsized":"2023-08-17T00:17:03.608668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056944+0000","last_change":"2023-08-17T00:17:04.056944+0000","last_active":"2023-08-17T00:17:04.056944+0000","last_peered":"2023-08-17T00:17:04.056944+0000","last_clean":"2023-08-17T00:17:04.056944+0000","last_became_active":"2023-08-17T00:17:04.056627+0000","last_became_peered":"2023-08-17T00:17:04.056627+0000","last_unstale":"2023-08-17T00:17:04.056944+0000","last_undegraded":"2023-08-17T00:17:04.056944+0000","last_fullsized":"2023-08-17T00:17:04.056944+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617518+0000","last_change":"2023-08-17T00:17:03.615987+0000","last_active":"2023-08-17T00:17:03.617518+0000","last_peered":"2023-08-17T00:17:03.617518+0000","last_clean":"2023-08-17T00:17:03.617518+0000","last_became_active":"2023-08-17T00:17:03.615694+0000","last_became_peered":"2023-08-17T00:17:03.615694+0000","last_unstale":"2023-08-17T00:17:03.617518+0000","last_undegraded":"2023-08-17T00:17:03.617518+0000","last_fullsized":"2023-08-17T00:17:03.617518+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028263+0000","last_change":"2023-08-17T00:17:03.606480+0000","last_active":"2023-08-17T00:17:04.028263+0000","last_peered":"2023-08-17T00:17:04.028263+0000","last_clean":"2023-08-17T00:17:04.028263+0000","last_became_active":"2023-08-17T00:17:03.606201+0000","last_became_peered":"2023-08-17T00:17:03.606201+0000","last_unstale":"2023-08-17T00:17:04.028263+0000","last_undegraded":"2023-08-17T00:17:04.028263+0000","last_fullsized":"2023-08-17T00:17:04.028263+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040428+0000","last_change":"2023-08-17T00:17:04.040428+0000","last_active":"2023-08-17T00:17:04.040428+0000","last_peered":"2023-08-17T00:17:04.040428+0000","last_clean":"2023-08-17T00:17:04.040428+0000","last_became_active":"2023-08-17T00:17:04.040152+0000","last_became_peered":"2023-08-17T00:17:04.040152+0000","last_unstale":"2023-08-17T00:17:04.040428+0000","last_undegraded":"2023-08-17T00:17:04.040428+0000","last_fullsized":"2023-08-17T00:17:04.040428+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617229+0000","last_change":"2023-08-17T00:17:03.612657+0000","last_active":"2023-08-17T00:17:03.617229+0000","last_peered":"2023-08-17T00:17:03.617229+0000","last_clean":"2023-08-17T00:17:03.617229+0000","last_became_active":"2023-08-17T00:17:03.612391+0000","last_became_peered":"2023-08-17T00:17:03.612391+0000","last_unstale":"2023-08-17T00:17:03.617229+0000","last_undegraded":"2023-08-17T00:17:03.617229+0000","last_fullsized":"2023-08-17T00:17:03.617229+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048967+0000","last_change":"2023-08-17T00:17:04.048967+0000","last_active":"2023-08-17T00:17:04.048967+0000","last_peered":"2023-08-17T00:17:04.048967+0000","last_clean":"2023-08-17T00:17:04.048967+0000","last_became_active":"2023-08-17T00:17:04.048659+0000","last_became_peered":"2023-08-17T00:17:04.048659+0000","last_unstale":"2023-08-17T00:17:04.048967+0000","last_undegraded":"2023-08-17T00:17:04.048967+0000","last_fullsized":"2023-08-17T00:17:04.048967+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617867+0000","last_change":"2023-08-17T00:17:03.611238+0000","last_active":"2023-08-17T00:17:03.617867+0000","last_peered":"2023-08-17T00:17:03.617867+0000","last_clean":"2023-08-17T00:17:03.617867+0000","last_became_active":"2023-08-17T00:17:03.609987+0000","last_became_peered":"2023-08-17T00:17:03.609987+0000","last_unstale":"2023-08-17T00:17:03.617867+0000","last_undegraded":"2023-08-17T00:17:03.617867+0000","last_fullsized":"2023-08-17T00:17:03.617867+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050256+0000","last_change":"2023-08-17T00:17:04.050256+0000","last_active":"2023-08-17T00:17:04.050256+0000","last_peered":"2023-08-17T00:17:04.050256+0000","last_clean":"2023-08-17T00:17:04.050256+0000","last_became_active":"2023-08-17T00:17:04.049997+0000","last_became_peered":"2023-08-17T00:17:04.049997+0000","last_unstale":"2023-08-17T00:17:04.050256+0000","last_undegraded":"2023-08-17T00:17:04.050256+0000","last_fullsized":"2023-08-17T00:17:04.050256+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617682+0000","last_change":"2023-08-17T00:17:03.608995+0000","last_active":"2023-08-17T00:17:03.617682+0000","last_peered":"2023-08-17T00:17:03.617682+0000","last_clean":"2023-08-17T00:17:03.617682+0000","last_became_active":"2023-08-17T00:17:03.608716+0000","last_became_peered":"2023-08-17T00:17:03.608716+0000","last_unstale":"2023-08-17T00:17:03.617682+0000","last_undegraded":"2023-08-17T00:17:03.617682+0000","last_fullsized":"2023-08-17T00:17:03.617682+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039299+0000","last_change":"2023-08-17T00:17:04.039299+0000","last_active":"2023-08-17T00:17:04.039299+0000","last_peered":"2023-08-17T00:17:04.039299+0000","last_clean":"2023-08-17T00:17:04.039299+0000","last_became_active":"2023-08-17T00:17:04.039008+0000","last_became_peered":"2023-08-17T00:17:04.039008+0000","last_unstale":"2023-08-17T00:17:04.039299+0000","last_undegraded":"2023-08-17T00:17:04.039299+0000","last_fullsized":"2023-08-17T00:17:04.039299+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.7","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055570+0000","last_change":"2023-08-17T00:17:03.604168+0000","last_active":"2023-08-17T00:17:04.055570+0000","last_peered":"2023-08-17T00:17:04.055570+0000","last_clean":"2023-08-17T00:17:04.055570+0000","last_became_active":"2023-08-17T00:17:03.603901+0000","last_became_peered":"2023-08-17T00:17:03.603901+0000","last_unstale":"2023-08-17T00:17:04.055570+0000","last_undegraded":"2023-08-17T00:17:04.055570+0000","last_fullsized":"2023-08-17T00:17:04.055570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050279+0000","last_change":"2023-08-17T00:17:04.050279+0000","last_active":"2023-08-17T00:17:04.050279+0000","last_peered":"2023-08-17T00:17:04.050279+0000","last_clean":"2023-08-17T00:17:04.050279+0000","last_became_active":"2023-08-17T00:17:04.049619+0000","last_became_peered":"2023-08-17T00:17:04.049619+0000","last_unstale":"2023-08-17T00:17:04.050279+0000","last_undegraded":"2023-08-17T00:17:04.050279+0000","last_fullsized":"2023-08-17T00:17:04.050279+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.606504+0000","last_change":"2023-08-17T00:17:03.598312+0000","last_active":"2023-08-17T00:17:03.606504+0000","last_peered":"2023-08-17T00:17:03.606504+0000","last_clean":"2023-08-17T00:17:03.606504+0000","last_became_active":"2023-08-17T00:17:03.597966+0000","last_became_peered":"2023-08-17T00:17:03.597966+0000","last_unstale":"2023-08-17T00:17:03.606504+0000","last_undegraded":"2023-08-17T00:17:03.606504+0000","last_fullsized":"2023-08-17T00:17:03.606504+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054458+0000","last_change":"2023-08-17T00:17:04.054458+0000","last_active":"2023-08-17T00:17:04.054458+0000","last_peered":"2023-08-17T00:17:04.054458+0000","last_clean":"2023-08-17T00:17:04.054458+0000","last_became_active":"2023-08-17T00:17:04.054168+0000","last_became_peered":"2023-08-17T00:17:04.054168+0000","last_unstale":"2023-08-17T00:17:04.054458+0000","last_undegraded":"2023-08-17T00:17:04.054458+0000","last_fullsized":"2023-08-17T00:17:04.054458+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607544+0000","last_change":"2023-08-17T00:17:03.600702+0000","last_active":"2023-08-17T00:17:03.607544+0000","last_peered":"2023-08-17T00:17:03.607544+0000","last_clean":"2023-08-17T00:17:03.607544+0000","last_became_active":"2023-08-17T00:17:03.600329+0000","last_became_peered":"2023-08-17T00:17:03.600329+0000","last_unstale":"2023-08-17T00:17:03.607544+0000","last_undegraded":"2023-08-17T00:17:03.607544+0000","last_fullsized":"2023-08-17T00:17:03.607544+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048843+0000","last_change":"2023-08-17T00:17:04.048843+0000","last_active":"2023-08-17T00:17:04.048843+0000","last_peered":"2023-08-17T00:17:04.048843+0000","last_clean":"2023-08-17T00:17:04.048843+0000","last_became_active":"2023-08-17T00:17:04.048452+0000","last_became_peered":"2023-08-17T00:17:04.048452+0000","last_unstale":"2023-08-17T00:17:04.048843+0000","last_undegraded":"2023-08-17T00:17:04.048843+0000","last_fullsized":"2023-08-17T00:17:04.048843+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602500+0000","last_change":"2023-08-17T00:17:03.601397+0000","last_active":"2023-08-17T00:17:03.602500+0000","last_peered":"2023-08-17T00:17:03.602500+0000","last_clean":"2023-08-17T00:17:03.602500+0000","last_became_active":"2023-08-17T00:17:03.601090+0000","last_became_peered":"2023-08-17T00:17:03.601090+0000","last_unstale":"2023-08-17T00:17:03.602500+0000","last_undegraded":"2023-08-17T00:17:03.602500+0000","last_fullsized":"2023-08-17T00:17:03.602500+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044730+0000","last_change":"2023-08-17T00:17:04.044730+0000","last_active":"2023-08-17T00:17:04.044730+0000","last_peered":"2023-08-17T00:17:04.044730+0000","last_clean":"2023-08-17T00:17:04.044730+0000","last_became_active":"2023-08-17T00:17:04.044474+0000","last_became_peered":"2023-08-17T00:17:04.044474+0000","last_unstale":"2023-08-17T00:17:04.044730+0000","last_undegraded":"2023-08-17T00:17:04.044730+0000","last_fullsized":"2023-08-17T00:17:04.044730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607491+0000","last_change":"2023-08-17T00:17:03.604924+0000","last_active":"2023-08-17T00:17:03.607491+0000","last_peered":"2023-08-17T00:17:03.607491+0000","last_clean":"2023-08-17T00:17:03.607491+0000","last_became_active":"2023-08-17T00:17:03.604666+0000","last_became_peered":"2023-08-17T00:17:03.604666+0000","last_unstale":"2023-08-17T00:17:03.607491+0000","last_undegraded":"2023-08-17T00:17:03.607491+0000","last_fullsized":"2023-08-17T00:17:03.607491+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052415+0000","last_change":"2023-08-17T00:17:04.052415+0000","last_active":"2023-08-17T00:17:04.052415+0000","last_peered":"2023-08-17T00:17:04.052415+0000","last_clean":"2023-08-17T00:17:04.052415+0000","last_became_active":"2023-08-17T00:17:04.052144+0000","last_became_peered":"2023-08-17T00:17:04.052144+0000","last_unstale":"2023-08-17T00:17:04.052415+0000","last_undegraded":"2023-08-17T00:17:04.052415+0000","last_fullsized":"2023-08-17T00:17:04.052415+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613270+0000","last_change":"2023-08-17T00:17:03.604890+0000","last_active":"2023-08-17T00:17:03.613270+0000","last_peered":"2023-08-17T00:17:03.613270+0000","last_clean":"2023-08-17T00:17:03.613270+0000","last_became_active":"2023-08-17T00:17:03.604627+0000","last_became_peered":"2023-08-17T00:17:03.604627+0000","last_unstale":"2023-08-17T00:17:03.613270+0000","last_undegraded":"2023-08-17T00:17:03.613270+0000","last_fullsized":"2023-08-17T00:17:03.613270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040497+0000","last_change":"2023-08-17T00:17:04.040497+0000","last_active":"2023-08-17T00:17:04.040497+0000","last_peered":"2023-08-17T00:17:04.040497+0000","last_clean":"2023-08-17T00:17:04.040497+0000","last_became_active":"2023-08-17T00:17:04.039861+0000","last_became_peered":"2023-08-17T00:17:04.039861+0000","last_unstale":"2023-08-17T00:17:04.040497+0000","last_undegraded":"2023-08-17T00:17:04.040497+0000","last_fullsized":"2023-08-17T00:17:04.040497+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617792+0000","last_change":"2023-08-17T00:17:03.610904+0000","last_active":"2023-08-17T00:17:03.617792+0000","last_peered":"2023-08-17T00:17:03.617792+0000","last_clean":"2023-08-17T00:17:03.617792+0000","last_became_active":"2023-08-17T00:17:03.609650+0000","last_became_peered":"2023-08-17T00:17:03.609650+0000","last_unstale":"2023-08-17T00:17:03.617792+0000","last_undegraded":"2023-08-17T00:17:03.617792+0000","last_fullsized":"2023-08-17T00:17:03.617792+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052784+0000","last_change":"2023-08-17T00:17:04.052784+0000","last_active":"2023-08-17T00:17:04.052784+0000","last_peered":"2023-08-17T00:17:04.052784+0000","last_clean":"2023-08-17T00:17:04.052784+0000","last_became_active":"2023-08-17T00:17:04.052382+0000","last_became_peered":"2023-08-17T00:17:04.052382+0000","last_unstale":"2023-08-17T00:17:04.052784+0000","last_undegraded":"2023-08-17T00:17:04.052784+0000","last_fullsized":"2023-08-17T00:17:04.052784+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.564089+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045593+0000","last_change":"2023-08-17T00:17:04.045593+0000","last_active":"2023-08-17T00:17:04.045593+0000","last_peered":"2023-08-17T00:17:04.045593+0000","last_clean":"2023-08-17T00:17:04.045593+0000","last_became_active":"2023-08-17T00:17:04.045320+0000","last_became_peered":"2023-08-17T00:17:04.045320+0000","last_unstale":"2023-08-17T00:17:04.045593+0000","last_undegraded":"2023-08-17T00:17:04.045593+0000","last_fullsized":"2023-08-17T00:17:04.045593+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1e","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.023391+0000","last_change":"2023-08-17T00:17:03.608379+0000","last_active":"2023-08-17T00:17:04.023391+0000","last_peered":"2023-08-17T00:17:04.023391+0000","last_clean":"2023-08-17T00:17:04.023391+0000","last_became_active":"2023-08-17T00:17:03.608068+0000","last_became_peered":"2023-08-17T00:17:03.608068+0000","last_unstale":"2023-08-17T00:17:04.023391+0000","last_undegraded":"2023-08-17T00:17:04.023391+0000","last_fullsized":"2023-08-17T00:17:04.023391+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581918+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:17:03.581918+0000","last_peered":"2023-08-17T00:17:03.581918+0000","last_clean":"2023-08-17T00:17:03.581918+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:17:03.581918+0000","last_undegraded":"2023-08-17T00:17:03.581918+0000","last_fullsized":"2023-08-17T00:17:03.581918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038193+0000","last_change":"2023-08-17T00:17:04.038193+0000","last_active":"2023-08-17T00:17:04.038193+0000","last_peered":"2023-08-17T00:17:04.038193+0000","last_clean":"2023-08-17T00:17:04.038193+0000","last_became_active":"2023-08-17T00:17:04.037874+0000","last_became_peered":"2023-08-17T00:17:04.037874+0000","last_unstale":"2023-08-17T00:17:04.038193+0000","last_undegraded":"2023-08-17T00:17:04.038193+0000","last_fullsized":"2023-08-17T00:17:04.038193+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1f","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034308+0000","last_change":"2023-08-17T00:17:03.605442+0000","last_active":"2023-08-17T00:17:04.034308+0000","last_peered":"2023-08-17T00:17:04.034308+0000","last_clean":"2023-08-17T00:17:04.034308+0000","last_became_active":"2023-08-17T00:17:03.605139+0000","last_became_peered":"2023-08-17T00:17:03.605139+0000","last_unstale":"2023-08-17T00:17:04.034308+0000","last_undegraded":"2023-08-17T00:17:04.034308+0000","last_fullsized":"2023-08-17T00:17:04.034308+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-17T00:16:59.656637+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:16:59.656637+0000","last_peered":"2023-08-17T00:16:59.656637+0000","last_clean":"2023-08-17T00:16:59.656637+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:16:59.656637+0000","last_undegraded":"2023-08-17T00:16:59.656637+0000","last_fullsized":"2023-08-17T00:16:59.656637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617366+0000","last_change":"2023-08-17T00:17:03.614980+0000","last_active":"2023-08-17T00:17:03.617366+0000","last_peered":"2023-08-17T00:17:03.617366+0000","last_clean":"2023-08-17T00:17:03.617366+0000","last_became_active":"2023-08-17T00:17:03.614675+0000","last_became_peered":"2023-08-17T00:17:03.614675+0000","last_unstale":"2023-08-17T00:17:03.617366+0000","last_undegraded":"2023-08-17T00:17:03.617366+0000","last_fullsized":"2023-08-17T00:17:03.617366+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.580971+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:17:03.580971+0000","last_peered":"2023-08-17T00:17:03.580971+0000","last_clean":"2023-08-17T00:17:03.580971+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:17:03.580971+0000","last_undegraded":"2023-08-17T00:17:03.580971+0000","last_fullsized":"2023-08-17T00:17:03.580971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042523+0000","last_change":"2023-08-17T00:17:04.042523+0000","last_active":"2023-08-17T00:17:04.042523+0000","last_peered":"2023-08-17T00:17:04.042523+0000","last_clean":"2023-08-17T00:17:04.042523+0000","last_became_active":"2023-08-17T00:17:04.042059+0000","last_became_peered":"2023-08-17T00:17:04.042059+0000","last_unstale":"2023-08-17T00:17:04.042523+0000","last_undegraded":"2023-08-17T00:17:04.042523+0000","last_fullsized":"2023-08-17T00:17:04.042523+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1d","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054171+0000","last_change":"2023-08-17T00:17:03.611041+0000","last_active":"2023-08-17T00:17:04.054171+0000","last_peered":"2023-08-17T00:17:04.054171+0000","last_clean":"2023-08-17T00:17:04.054171+0000","last_became_active":"2023-08-17T00:17:03.610638+0000","last_became_peered":"2023-08-17T00:17:03.610638+0000","last_unstale":"2023-08-17T00:17:04.054171+0000","last_undegraded":"2023-08-17T00:17:04.054171+0000","last_fullsized":"2023-08-17T00:17:04.054171+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.586419+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:17:03.586419+0000","last_peered":"2023-08-17T00:17:03.586419+0000","last_clean":"2023-08-17T00:17:03.586419+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:17:03.586419+0000","last_undegraded":"2023-08-17T00:17:03.586419+0000","last_fullsized":"2023-08-17T00:17:03.586419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045916+0000","last_change":"2023-08-17T00:17:04.045916+0000","last_active":"2023-08-17T00:17:04.045916+0000","last_peered":"2023-08-17T00:17:04.045916+0000","last_clean":"2023-08-17T00:17:04.045916+0000","last_became_active":"2023-08-17T00:17:04.045632+0000","last_became_peered":"2023-08-17T00:17:04.045632+0000","last_unstale":"2023-08-17T00:17:04.045916+0000","last_undegraded":"2023-08-17T00:17:04.045916+0000","last_fullsized":"2023-08-17T00:17:04.045916+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617603+0000","last_change":"2023-08-17T00:17:03.608444+0000","last_active":"2023-08-17T00:17:03.617603+0000","last_peered":"2023-08-17T00:17:03.617603+0000","last_clean":"2023-08-17T00:17:03.617603+0000","last_became_active":"2023-08-17T00:17:03.605953+0000","last_became_peered":"2023-08-17T00:17:03.605953+0000","last_unstale":"2023-08-17T00:17:03.617603+0000","last_undegraded":"2023-08-17T00:17:03.617603+0000","last_fullsized":"2023-08-17T00:17:03.617603+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581175+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:17:03.581175+0000","last_peered":"2023-08-17T00:17:03.581175+0000","last_clean":"2023-08-17T00:17:03.581175+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:17:03.581175+0000","last_undegraded":"2023-08-17T00:17:03.581175+0000","last_fullsized":"2023-08-17T00:17:03.581175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050181+0000","last_change":"2023-08-17T00:17:04.050181+0000","last_active":"2023-08-17T00:17:04.050181+0000","last_peered":"2023-08-17T00:17:04.050181+0000","last_clean":"2023-08-17T00:17:04.050181+0000","last_became_active":"2023-08-17T00:17:04.049847+0000","last_became_peered":"2023-08-17T00:17:04.049847+0000","last_unstale":"2023-08-17T00:17:04.050181+0000","last_undegraded":"2023-08-17T00:17:04.050181+0000","last_fullsized":"2023-08-17T00:17:04.050181+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613446+0000","last_change":"2023-08-17T00:17:03.607083+0000","last_active":"2023-08-17T00:17:03.613446+0000","last_peered":"2023-08-17T00:17:03.613446+0000","last_clean":"2023-08-17T00:17:03.613446+0000","last_became_active":"2023-08-17T00:17:03.606777+0000","last_became_peered":"2023-08-17T00:17:03.606777+0000","last_unstale":"2023-08-17T00:17:03.613446+0000","last_undegraded":"2023-08-17T00:17:03.613446+0000","last_fullsized":"2023-08-17T00:17:03.613446+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603188+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:17:03.603188+0000","last_peered":"2023-08-17T00:17:03.603188+0000","last_clean":"2023-08-17T00:17:03.603188+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:17:03.603188+0000","last_undegraded":"2023-08-17T00:17:03.603188+0000","last_fullsized":"2023-08-17T00:17:03.603188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040677+0000","last_change":"2023-08-17T00:17:04.040677+0000","last_active":"2023-08-17T00:17:04.040677+0000","last_peered":"2023-08-17T00:17:04.040677+0000","last_clean":"2023-08-17T00:17:04.040677+0000","last_became_active":"2023-08-17T00:17:04.040201+0000","last_became_peered":"2023-08-17T00:17:04.040201+0000","last_unstale":"2023-08-17T00:17:04.040677+0000","last_undegraded":"2023-08-17T00:17:04.040677+0000","last_fullsized":"2023-08-17T00:17:04.040677+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.612249+0000","last_change":"2023-08-17T00:17:03.607962+0000","last_active":"2023-08-17T00:17:03.612249+0000","last_peered":"2023-08-17T00:17:03.612249+0000","last_clean":"2023-08-17T00:17:03.612249+0000","last_became_active":"2023-08-17T00:17:03.607587+0000","last_became_peered":"2023-08-17T00:17:03.607587+0000","last_unstale":"2023-08-17T00:17:03.612249+0000","last_undegraded":"2023-08-17T00:17:03.612249+0000","last_fullsized":"2023-08-17T00:17:03.612249+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.580792+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:17:03.580792+0000","last_peered":"2023-08-17T00:17:03.580792+0000","last_clean":"2023-08-17T00:17:03.580792+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:17:03.580792+0000","last_undegraded":"2023-08-17T00:17:03.580792+0000","last_fullsized":"2023-08-17T00:17:03.580792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046586+0000","last_change":"2023-08-17T00:17:04.046586+0000","last_active":"2023-08-17T00:17:04.046586+0000","last_peered":"2023-08-17T00:17:04.046586+0000","last_clean":"2023-08-17T00:17:04.046586+0000","last_became_active":"2023-08-17T00:17:04.046283+0000","last_became_peered":"2023-08-17T00:17:04.046283+0000","last_unstale":"2023-08-17T00:17:04.046586+0000","last_undegraded":"2023-08-17T00:17:04.046586+0000","last_fullsized":"2023-08-17T00:17:04.046586+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617401+0000","last_change":"2023-08-17T00:17:03.615539+0000","last_active":"2023-08-17T00:17:03.617401+0000","last_peered":"2023-08-17T00:17:03.617401+0000","last_clean":"2023-08-17T00:17:03.617401+0000","last_became_active":"2023-08-17T00:17:03.615065+0000","last_became_peered":"2023-08-17T00:17:03.615065+0000","last_unstale":"2023-08-17T00:17:03.617401+0000","last_undegraded":"2023-08-17T00:17:03.617401+0000","last_fullsized":"2023-08-17T00:17:03.617401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581820+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:17:03.581820+0000","last_peered":"2023-08-17T00:17:03.581820+0000","last_clean":"2023-08-17T00:17:03.581820+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:17:03.581820+0000","last_undegraded":"2023-08-17T00:17:03.581820+0000","last_fullsized":"2023-08-17T00:17:03.581820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.588315+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:17:03.588315+0000","last_peered":"2023-08-17T00:17:03.588315+0000","last_clean":"2023-08-17T00:17:03.588315+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:17:03.588315+0000","last_undegraded":"2023-08-17T00:17:03.588315+0000","last_fullsized":"2023-08-17T00:17:03.588315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299580,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072260,"statfs":{"total":96636764160,"available":96329994240,"internally_reserved":0,"allocated":2412544,"data_stored":1130262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":1.054},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.871}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":1.151}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.2549999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.208},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":0.754}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.091},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":0.77800000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299556,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072284,"statfs":{"total":96636764160,"available":96330018816,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":6.2050000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":4.468}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":2.0870000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":3.5409999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":3.0569999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":2.4670000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":6.1660000000000004},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":8.4809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":5.2199999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":3.7519999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542319,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.143}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.409},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.272}]}]},{"osd":3,"up_from":14,"seq":60129542318,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2408448,"data_stored":1130780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.224}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.056}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.167}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.351},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.198}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.304}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.391},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.0149999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311844,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059996,"statfs":{"total":96636764160,"available":96317435904,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":1.165},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.044}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.159}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.347}]}]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307736,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064104,"statfs":{"total":96636764160,"available":96321642496,"internally_reserved":0,"allocated":2375680,"data_stored":1116278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.873,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.2789999999999999,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91800000000000004,"15min":0.91300000000000003},"min":{"1min":0.752,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.214,"5min":1.6200000000000001,"15min":13.093},"last":1.367}]},{"osd":2,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.2689999999999999,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0249999999999999,"15min":1.0129999999999999},"min":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.363,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.625}]},{"osd":4,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.0800000000000001,"15min":1.139},"min":{"1min":0.92600000000000005,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.552,"5min":1.671,"15min":20.548999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3,"5min":1.214,"15min":1.204},"min":{"1min":0.97399999999999998,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":1.1779999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.623,"5min":3.137,"15min":13.170999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.2270000000000001,"15min":1.236},"min":{"1min":1.0760000000000001,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.4510000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.95899999999999996,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.603,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.216,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5620000000000001,"5min":2.0150000000000001,"15min":5.5359999999999996},"last":1.222}]},{"osd":7,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.294,"15min":1.298},"min":{"1min":1.0409999999999999,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.675,"5min":3.1520000000000001,"15min":6.9779999999999998},"last":1.202},{"interface":"front","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.319},"min":{"1min":1.0229999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7230000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.167}]}]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311844,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059996,"statfs":{"total":96636764160,"available":96317435904,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":0.755}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":1.073},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":1.585}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":1.423},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":1.534}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.375}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307736,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064104,"statfs":{"total":96636764160,"available":96321642496,"internally_reserved":0,"allocated":2375680,"data_stored":1116278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":1.0600000000000001},"min":{"1min":0.77600000000000002,"5min":0.622,"15min":0.38300000000000001},"max":{"1min":1.4350000000000001,"5min":1.677,"15min":7.1379999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.345,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":1.117}]},{"osd":1,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1379999999999999,"15min":1.22},"min":{"1min":0.745,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.4039999999999999,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.181},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.153,"15min":1.216},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.732,"5min":1.732,"15min":6.9000000000000004},"last":1.252}]},{"osd":2,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.083,"15min":1.2130000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.4179999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.083,"15min":1.3089999999999999},"min":{"1min":0.91600000000000004,"5min":0.755,"15min":0.36699999999999999},"max":{"1min":1.5880000000000001,"5min":1.623,"15min":36.531999999999996},"last":1.036}]},{"osd":3,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.117},"min":{"1min":0.79300000000000004,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.522,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.175,"15min":1.3779999999999999},"min":{"1min":0.876,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.603,"5min":1.7569999999999999,"15min":36.530000000000001},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.24},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.466},{"interface":"front","average":{"1min":1.254,"5min":1.228,"15min":1.2829999999999999},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.633,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2390000000000001,"15min":1.3200000000000001},"min":{"1min":0.877,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.875,"15min":8.4190000000000005},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.321,"15min":1.369},"min":{"1min":1.032,"5min":0.77400000000000002,"15min":0.49399999999999999},"max":{"1min":1.8260000000000001,"5min":1.911,"15min":6.1689999999999996},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.222,"15min":1.248},"min":{"1min":0.83399999999999996,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.5249999999999999,"5min":3.645,"15min":3.645},"last":1.306},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3220000000000001,"15min":1.3879999999999999},"min":{"1min":1.0149999999999999,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.879,"5min":1.9690000000000001,"15min":8.327},"last":1.2689999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:17:08.258 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:17:08.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.447+0000 7f551cf47700 1 Processor -- start 2023-08-17T00:17:08.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f551cf47700 1 -- start start 2023-08-17T00:17:08.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f551cf47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f5518068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f551cf47700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55181545e0 con 0x7f55180ac2f0 2023-08-17T00:17:08.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f551cf47700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55180a96d0 con 0x7f55180c1190 2023-08-17T00:17:08.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f551cf47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180c1c50 con 0x7f55180abf10 2023-08-17T00:17:08.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f5516ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f55180ac2f0 0x7f55180c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45076/0 (socket says 172.21.15.153:45076) 2023-08-17T00:17:08.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f5516ffd700 1 -- 172.21.15.153:0/2995930062 learned_addr learned my addr 172.21.15.153:0/2995930062 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:08.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f55177fe700 1 --2- 172.21.15.153:0/2995930062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f5518068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.451+0000 7f55167fc700 1 -- 172.21.15.153:0/2995930062 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617398902 0 0) 0x7f55181545e0 con 0x7f55180ac2f0 2023-08-17T00:17:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55167fc700 1 -- 172.21.15.153:0/2995930062 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55000033f0 con 0x7f55180ac2f0 2023-08-17T00:17:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55177fe700 1 -- 172.21.15.153:0/2995930062 >> v1:172.21.15.178:6789/0 conn(0x7f55180c1190 legacy=0x7f5518156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55167fc700 1 -- 172.21.15.153:0/2995930062 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258226564 0 0) 0x7f55180a96d0 con 0x7f55180c1190 2023-08-17T00:17:08.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55177fe700 1 -- 172.21.15.153:0/2995930062 >> v1:172.21.15.153:6789/0 conn(0x7f55180ac2f0 legacy=0x7f55180c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55177fe700 1 -- 172.21.15.153:0/2995930062 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5518064b80 con 0x7f55180abf10 2023-08-17T00:17:08.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55177fe700 1 --2- 172.21.15.153:0/2995930062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f5518068820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5508009760 tx=0x7f5508006f40).ready entity=mon.2 client_cookie=116df490cdef3872 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55167fc700 1 -- 172.21.15.153:0/2995930062 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508005880 con 0x7f55180abf10 2023-08-17T00:17:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55167fc700 1 -- 172.21.15.153:0/2995930062 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55080059e0 con 0x7f55180abf10 2023-08-17T00:17:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f55167fc700 1 -- 172.21.15.153:0/2995930062 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508005d60 con 0x7f55180abf10 2023-08-17T00:17:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 -- 172.21.15.153:0/2995930062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 msgr2=0x7f5518068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 --2- 172.21.15.153:0/2995930062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f5518068820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5508009760 tx=0x7f5508006f40).stop 2023-08-17T00:17:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 -- 172.21.15.153:0/2995930062 shutdown_connections 2023-08-17T00:17:08.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 --2- 172.21.15.153:0/2995930062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f5518068820 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 -- 172.21.15.153:0/2995930062 >> 172.21.15.153:0/2995930062 conn(0x7f55180c6620 msgr2=0x7f55180c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 -- 172.21.15.153:0/2995930062 shutdown_connections 2023-08-17T00:17:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.455+0000 7f551cf47700 1 -- 172.21.15.153:0/2995930062 wait complete. 2023-08-17T00:17:08.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 Processor -- start 2023-08-17T00:17:08.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 -- start start 2023-08-17T00:17:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f551816bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55180ac2f0 0x7f55180bb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55180c1190 0x7f551814fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180bf260 con 0x7f55180ac2f0 2023-08-17T00:17:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551816ca30 con 0x7f55180c1190 2023-08-17T00:17:08.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180bbb40 con 0x7f55180abf10 2023-08-17T00:17:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f5516ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55180ac2f0 0x7f55180bb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f551816bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f551816bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:48224/0 (socket says 172.21.15.153:48224) 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 -- 172.21.15.153:0/2609713730 learned_addr learned my addr 172.21.15.153:0/2609713730 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f5517fff700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55180c1190 0x7f551814fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 -- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55180c1190 msgr2=0x7f551814fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55180c1190 0x7f551814fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 -- 172.21.15.153:0/2609713730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55180ac2f0 msgr2=0x7f55180bb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55180ac2f0 0x7f55180bb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 -- 172.21.15.153:0/2609713730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5508009250 con 0x7f55180abf10 2023-08-17T00:17:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f55177fe700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f551816bb40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5508009fd0 tx=0x7f5508015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508005880 con 0x7f55180abf10 2023-08-17T00:17:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550800f510 con 0x7f55180abf10 2023-08-17T00:17:08.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550800f8d0 con 0x7f55180abf10 2023-08-17T00:17:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.459+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551816c190 con 0x7f55180abf10 2023-08-17T00:17:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.463+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551816c750 con 0x7f55180abf10 2023-08-17T00:17:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.463+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55180c2110 con 0x7f55180abf10 2023-08-17T00:17:08.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.463+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f550800f070 con 0x7f55180abf10 2023-08-17T00:17:08.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.463+0000 7f54ff7fe700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550405a150 0x7f550405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.463+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f5508075870 con 0x7f55180abf10 2023-08-17T00:17:08.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.467+0000 7f5516ffd700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550405a150 0x7f550405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.467+0000 7f5516ffd700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550405a150 0x7f550405c610 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f55180c3c50 tx=0x7f550c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.471+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f55180c2110 con 0x7f55180abf10 2023-08-17T00:17:08.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.631+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55180c2110 con 0x7f550405a150 2023-08-17T00:17:08.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.651+0000 7f54ff7fe700 1 -- 172.21.15.153:0/2609713730 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358275 (secure 0 0 0) 0x7f55180c2110 con 0x7f550405a150 2023-08-17T00:17:08.659 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:08.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.659+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550405a150 msgr2=0x7f550405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.659+0000 7f551cf47700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550405a150 0x7f550405c610 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f55180c3c50 tx=0x7f550c009040).stop 2023-08-17T00:17:08.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.659+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 msgr2=0x7f551816bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.659+0000 7f551cf47700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f551816bb40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f5508009fd0 tx=0x7f5508015000).stop 2023-08-17T00:17:08.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 shutdown_connections 2023-08-17T00:17:08.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f550405a150 0x7f550405c610 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55180c1190 0x7f551814fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55180ac2f0 0x7f55180bb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 --2- 172.21.15.153:0/2609713730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55180abf10 0x7f551816bb40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 >> 172.21.15.153:0/2609713730 conn(0x7f55180c6620 msgr2=0x7f55180a9660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:08.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 shutdown_connections 2023-08-17T00:17:08.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.663+0000 7f551cf47700 1 -- 172.21.15.153:0/2609713730 wait complete. 2023-08-17T00:17:08.669 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:17:08.687 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":617,"stamp":"2023-08-17T00:17:07.502423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453812,"kb_used_data":18676,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520908,"statfs":{"total":773094113280,"available":770581409792,"internally_reserved":0,"allocated":19124224,"data_stored":8985426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308502,"num_objects":-1024,"num_object_clones":0,"num_object_copies":-2048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3064,"num_write_kb":-7684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-22,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.500712"},"pg_stats":[{"pgid":"28.38","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040967+0000","last_change":"2023-08-17T00:17:04.040967+0000","last_active":"2023-08-17T00:17:04.040967+0000","last_peered":"2023-08-17T00:17:04.040967+0000","last_clean":"2023-08-17T00:17:04.040967+0000","last_became_active":"2023-08-17T00:17:04.040675+0000","last_became_peered":"2023-08-17T00:17:04.040675+0000","last_unstale":"2023-08-17T00:17:04.040967+0000","last_undegraded":"2023-08-17T00:17:04.040967+0000","last_fullsized":"2023-08-17T00:17:04.040967+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"191'3","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055847+0000","last_change":"2023-08-17T00:17:03.602509+0000","last_active":"2023-08-17T00:17:04.055847+0000","last_peered":"2023-08-17T00:17:04.055847+0000","last_clean":"2023-08-17T00:17:04.055847+0000","last_became_active":"2023-08-17T00:17:03.600517+0000","last_became_peered":"2023-08-17T00:17:03.600517+0000","last_unstale":"2023-08-17T00:17:04.055847+0000","last_undegraded":"2023-08-17T00:17:04.055847+0000","last_fullsized":"2023-08-17T00:17:04.055847+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051198+0000","last_change":"2023-08-17T00:17:04.051198+0000","last_active":"2023-08-17T00:17:04.051198+0000","last_peered":"2023-08-17T00:17:04.051198+0000","last_clean":"2023-08-17T00:17:04.051198+0000","last_became_active":"2023-08-17T00:17:04.050838+0000","last_became_peered":"2023-08-17T00:17:04.050838+0000","last_unstale":"2023-08-17T00:17:04.051198+0000","last_undegraded":"2023-08-17T00:17:04.051198+0000","last_fullsized":"2023-08-17T00:17:04.051198+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607848+0000","last_change":"2023-08-17T00:17:03.604286+0000","last_active":"2023-08-17T00:17:03.607848+0000","last_peered":"2023-08-17T00:17:03.607848+0000","last_clean":"2023-08-17T00:17:03.607848+0000","last_became_active":"2023-08-17T00:17:03.603847+0000","last_became_peered":"2023-08-17T00:17:03.603847+0000","last_unstale":"2023-08-17T00:17:03.607848+0000","last_undegraded":"2023-08-17T00:17:03.607848+0000","last_fullsized":"2023-08-17T00:17:03.607848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032945+0000","last_change":"2023-08-17T00:17:04.032945+0000","last_active":"2023-08-17T00:17:04.032945+0000","last_peered":"2023-08-17T00:17:04.032945+0000","last_clean":"2023-08-17T00:17:04.032945+0000","last_became_active":"2023-08-17T00:17:04.032690+0000","last_became_peered":"2023-08-17T00:17:04.032690+0000","last_unstale":"2023-08-17T00:17:04.032945+0000","last_undegraded":"2023-08-17T00:17:04.032945+0000","last_fullsized":"2023-08-17T00:17:04.032945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.616335+0000","last_change":"2023-08-17T00:17:03.610919+0000","last_active":"2023-08-17T00:17:03.616335+0000","last_peered":"2023-08-17T00:17:03.616335+0000","last_clean":"2023-08-17T00:17:03.616335+0000","last_became_active":"2023-08-17T00:17:03.610412+0000","last_became_peered":"2023-08-17T00:17:03.610412+0000","last_unstale":"2023-08-17T00:17:03.616335+0000","last_undegraded":"2023-08-17T00:17:03.616335+0000","last_fullsized":"2023-08-17T00:17:03.616335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056564+0000","last_change":"2023-08-17T00:17:04.056564+0000","last_active":"2023-08-17T00:17:04.056564+0000","last_peered":"2023-08-17T00:17:04.056564+0000","last_clean":"2023-08-17T00:17:04.056564+0000","last_became_active":"2023-08-17T00:17:04.055878+0000","last_became_peered":"2023-08-17T00:17:04.055878+0000","last_unstale":"2023-08-17T00:17:04.056564+0000","last_undegraded":"2023-08-17T00:17:04.056564+0000","last_fullsized":"2023-08-17T00:17:04.056564+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3c","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052608+0000","last_change":"2023-08-17T00:17:03.607955+0000","last_active":"2023-08-17T00:17:04.052608+0000","last_peered":"2023-08-17T00:17:04.052608+0000","last_clean":"2023-08-17T00:17:04.052608+0000","last_became_active":"2023-08-17T00:17:03.605724+0000","last_became_peered":"2023-08-17T00:17:03.605724+0000","last_unstale":"2023-08-17T00:17:04.052608+0000","last_undegraded":"2023-08-17T00:17:04.052608+0000","last_fullsized":"2023-08-17T00:17:04.052608+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050546+0000","last_change":"2023-08-17T00:17:04.050546+0000","last_active":"2023-08-17T00:17:04.050546+0000","last_peered":"2023-08-17T00:17:04.050546+0000","last_clean":"2023-08-17T00:17:04.050546+0000","last_became_active":"2023-08-17T00:17:04.048601+0000","last_became_peered":"2023-08-17T00:17:04.048601+0000","last_unstale":"2023-08-17T00:17:04.050546+0000","last_undegraded":"2023-08-17T00:17:04.050546+0000","last_fullsized":"2023-08-17T00:17:04.050546+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039450+0000","last_change":"2023-08-17T00:17:03.609495+0000","last_active":"2023-08-17T00:17:04.039450+0000","last_peered":"2023-08-17T00:17:04.039450+0000","last_clean":"2023-08-17T00:17:04.039450+0000","last_became_active":"2023-08-17T00:17:03.609224+0000","last_became_peered":"2023-08-17T00:17:03.609224+0000","last_unstale":"2023-08-17T00:17:04.039450+0000","last_undegraded":"2023-08-17T00:17:04.039450+0000","last_fullsized":"2023-08-17T00:17:04.039450+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050914+0000","last_change":"2023-08-17T00:17:04.050914+0000","last_active":"2023-08-17T00:17:04.050914+0000","last_peered":"2023-08-17T00:17:04.050914+0000","last_clean":"2023-08-17T00:17:04.050914+0000","last_became_active":"2023-08-17T00:17:04.050552+0000","last_became_peered":"2023-08-17T00:17:04.050552+0000","last_unstale":"2023-08-17T00:17:04.050914+0000","last_undegraded":"2023-08-17T00:17:04.050914+0000","last_fullsized":"2023-08-17T00:17:04.050914+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3a","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028601+0000","last_change":"2023-08-17T00:17:03.592834+0000","last_active":"2023-08-17T00:17:04.028601+0000","last_peered":"2023-08-17T00:17:04.028601+0000","last_clean":"2023-08-17T00:17:04.028601+0000","last_became_active":"2023-08-17T00:17:03.592529+0000","last_became_peered":"2023-08-17T00:17:03.592529+0000","last_unstale":"2023-08-17T00:17:04.028601+0000","last_undegraded":"2023-08-17T00:17:04.028601+0000","last_fullsized":"2023-08-17T00:17:04.028601+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613512+0000","last_change":"2023-08-17T00:17:03.603048+0000","last_active":"2023-08-17T00:17:03.613512+0000","last_peered":"2023-08-17T00:17:03.613512+0000","last_clean":"2023-08-17T00:17:03.613512+0000","last_became_active":"2023-08-17T00:17:03.600931+0000","last_became_peered":"2023-08-17T00:17:03.600931+0000","last_unstale":"2023-08-17T00:17:03.613512+0000","last_undegraded":"2023-08-17T00:17:03.613512+0000","last_fullsized":"2023-08-17T00:17:03.613512+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.043639+0000","last_change":"2023-08-17T00:17:04.043639+0000","last_active":"2023-08-17T00:17:04.043639+0000","last_peered":"2023-08-17T00:17:04.043639+0000","last_clean":"2023-08-17T00:17:04.043639+0000","last_became_active":"2023-08-17T00:17:04.043074+0000","last_became_peered":"2023-08-17T00:17:04.043074+0000","last_unstale":"2023-08-17T00:17:04.043639+0000","last_undegraded":"2023-08-17T00:17:04.043639+0000","last_fullsized":"2023-08-17T00:17:04.043639+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.564705+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045697+0000","last_change":"2023-08-17T00:17:04.045697+0000","last_active":"2023-08-17T00:17:04.045697+0000","last_peered":"2023-08-17T00:17:04.045697+0000","last_clean":"2023-08-17T00:17:04.045697+0000","last_became_active":"2023-08-17T00:17:04.045400+0000","last_became_peered":"2023-08-17T00:17:04.045400+0000","last_unstale":"2023-08-17T00:17:04.045697+0000","last_undegraded":"2023-08-17T00:17:04.045697+0000","last_fullsized":"2023-08-17T00:17:04.045697+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.604216+0000","last_change":"2023-08-17T00:17:03.597710+0000","last_active":"2023-08-17T00:17:03.604216+0000","last_peered":"2023-08-17T00:17:03.604216+0000","last_clean":"2023-08-17T00:17:03.604216+0000","last_became_active":"2023-08-17T00:17:03.597376+0000","last_became_peered":"2023-08-17T00:17:03.597376+0000","last_unstale":"2023-08-17T00:17:03.604216+0000","last_undegraded":"2023-08-17T00:17:03.604216+0000","last_fullsized":"2023-08-17T00:17:03.604216+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058213+0000","last_change":"2023-08-17T00:17:04.058213+0000","last_active":"2023-08-17T00:17:04.058213+0000","last_peered":"2023-08-17T00:17:04.058213+0000","last_clean":"2023-08-17T00:17:04.058213+0000","last_became_active":"2023-08-17T00:17:04.057812+0000","last_became_peered":"2023-08-17T00:17:04.057812+0000","last_unstale":"2023-08-17T00:17:04.058213+0000","last_undegraded":"2023-08-17T00:17:04.058213+0000","last_fullsized":"2023-08-17T00:17:04.058213+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617346+0000","last_change":"2023-08-17T00:17:03.614190+0000","last_active":"2023-08-17T00:17:03.617346+0000","last_peered":"2023-08-17T00:17:03.617346+0000","last_clean":"2023-08-17T00:17:03.617346+0000","last_became_active":"2023-08-17T00:17:03.613882+0000","last_became_peered":"2023-08-17T00:17:03.613882+0000","last_unstale":"2023-08-17T00:17:03.617346+0000","last_undegraded":"2023-08-17T00:17:03.617346+0000","last_fullsized":"2023-08-17T00:17:03.617346+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040600+0000","last_change":"2023-08-17T00:17:04.040600+0000","last_active":"2023-08-17T00:17:04.040600+0000","last_peered":"2023-08-17T00:17:04.040600+0000","last_clean":"2023-08-17T00:17:04.040600+0000","last_became_active":"2023-08-17T00:17:04.040327+0000","last_became_peered":"2023-08-17T00:17:04.040327+0000","last_unstale":"2023-08-17T00:17:04.040600+0000","last_undegraded":"2023-08-17T00:17:04.040600+0000","last_fullsized":"2023-08-17T00:17:04.040600+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613478+0000","last_change":"2023-08-17T00:17:03.606219+0000","last_active":"2023-08-17T00:17:03.613478+0000","last_peered":"2023-08-17T00:17:03.613478+0000","last_clean":"2023-08-17T00:17:03.613478+0000","last_became_active":"2023-08-17T00:17:03.605882+0000","last_became_peered":"2023-08-17T00:17:03.605882+0000","last_unstale":"2023-08-17T00:17:03.613478+0000","last_undegraded":"2023-08-17T00:17:03.613478+0000","last_fullsized":"2023-08-17T00:17:03.613478+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056101+0000","last_change":"2023-08-17T00:17:04.056101+0000","last_active":"2023-08-17T00:17:04.056101+0000","last_peered":"2023-08-17T00:17:04.056101+0000","last_clean":"2023-08-17T00:17:04.056101+0000","last_became_active":"2023-08-17T00:17:04.055714+0000","last_became_peered":"2023-08-17T00:17:04.055714+0000","last_unstale":"2023-08-17T00:17:04.056101+0000","last_undegraded":"2023-08-17T00:17:04.056101+0000","last_fullsized":"2023-08-17T00:17:04.056101+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.043499+0000","last_change":"2023-08-17T00:17:03.604784+0000","last_active":"2023-08-17T00:17:04.043499+0000","last_peered":"2023-08-17T00:17:04.043499+0000","last_clean":"2023-08-17T00:17:04.043499+0000","last_became_active":"2023-08-17T00:17:03.604488+0000","last_became_peered":"2023-08-17T00:17:03.604488+0000","last_unstale":"2023-08-17T00:17:04.043499+0000","last_undegraded":"2023-08-17T00:17:04.043499+0000","last_fullsized":"2023-08-17T00:17:04.043499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034467+0000","last_change":"2023-08-17T00:17:03.611509+0000","last_active":"2023-08-17T00:17:04.034467+0000","last_peered":"2023-08-17T00:17:04.034467+0000","last_clean":"2023-08-17T00:17:04.034467+0000","last_became_active":"2023-08-17T00:17:03.610877+0000","last_became_peered":"2023-08-17T00:17:03.610877+0000","last_unstale":"2023-08-17T00:17:04.034467+0000","last_undegraded":"2023-08-17T00:17:04.034467+0000","last_fullsized":"2023-08-17T00:17:04.034467+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048382+0000","last_change":"2023-08-17T00:17:04.048382+0000","last_active":"2023-08-17T00:17:04.048382+0000","last_peered":"2023-08-17T00:17:04.048382+0000","last_clean":"2023-08-17T00:17:04.048382+0000","last_became_active":"2023-08-17T00:17:04.048079+0000","last_became_peered":"2023-08-17T00:17:04.048079+0000","last_unstale":"2023-08-17T00:17:04.048382+0000","last_undegraded":"2023-08-17T00:17:04.048382+0000","last_fullsized":"2023-08-17T00:17:04.048382+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.610430+0000","last_change":"2023-08-17T00:17:03.609075+0000","last_active":"2023-08-17T00:17:03.610430+0000","last_peered":"2023-08-17T00:17:03.610430+0000","last_clean":"2023-08-17T00:17:03.610430+0000","last_became_active":"2023-08-17T00:17:03.608809+0000","last_became_peered":"2023-08-17T00:17:03.608809+0000","last_unstale":"2023-08-17T00:17:03.610430+0000","last_undegraded":"2023-08-17T00:17:03.610430+0000","last_fullsized":"2023-08-17T00:17:03.610430+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038159+0000","last_change":"2023-08-17T00:17:04.038159+0000","last_active":"2023-08-17T00:17:04.038159+0000","last_peered":"2023-08-17T00:17:04.038159+0000","last_clean":"2023-08-17T00:17:04.038159+0000","last_became_active":"2023-08-17T00:17:04.037825+0000","last_became_peered":"2023-08-17T00:17:04.037825+0000","last_unstale":"2023-08-17T00:17:04.038159+0000","last_undegraded":"2023-08-17T00:17:04.038159+0000","last_fullsized":"2023-08-17T00:17:04.038159+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603144+0000","last_change":"2023-08-17T00:17:03.597502+0000","last_active":"2023-08-17T00:17:03.603144+0000","last_peered":"2023-08-17T00:17:03.603144+0000","last_clean":"2023-08-17T00:17:03.603144+0000","last_became_active":"2023-08-17T00:17:03.597168+0000","last_became_peered":"2023-08-17T00:17:03.597168+0000","last_unstale":"2023-08-17T00:17:03.603144+0000","last_undegraded":"2023-08-17T00:17:03.603144+0000","last_fullsized":"2023-08-17T00:17:03.603144+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048095+0000","last_change":"2023-08-17T00:17:04.048095+0000","last_active":"2023-08-17T00:17:04.048095+0000","last_peered":"2023-08-17T00:17:04.048095+0000","last_clean":"2023-08-17T00:17:04.048095+0000","last_became_active":"2023-08-17T00:17:04.047658+0000","last_became_peered":"2023-08-17T00:17:04.047658+0000","last_unstale":"2023-08-17T00:17:04.048095+0000","last_undegraded":"2023-08-17T00:17:04.048095+0000","last_fullsized":"2023-08-17T00:17:04.048095+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.30","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055789+0000","last_change":"2023-08-17T00:17:03.600911+0000","last_active":"2023-08-17T00:17:04.055789+0000","last_peered":"2023-08-17T00:17:04.055789+0000","last_clean":"2023-08-17T00:17:04.055789+0000","last_became_active":"2023-08-17T00:17:03.600488+0000","last_became_peered":"2023-08-17T00:17:03.600488+0000","last_unstale":"2023-08-17T00:17:04.055789+0000","last_undegraded":"2023-08-17T00:17:04.055789+0000","last_fullsized":"2023-08-17T00:17:04.055789+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056919+0000","last_change":"2023-08-17T00:17:04.056919+0000","last_active":"2023-08-17T00:17:04.056919+0000","last_peered":"2023-08-17T00:17:04.056919+0000","last_clean":"2023-08-17T00:17:04.056919+0000","last_became_active":"2023-08-17T00:17:04.056440+0000","last_became_peered":"2023-08-17T00:17:04.056440+0000","last_unstale":"2023-08-17T00:17:04.056919+0000","last_undegraded":"2023-08-17T00:17:04.056919+0000","last_fullsized":"2023-08-17T00:17:04.056919+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.614822+0000","last_change":"2023-08-17T00:17:03.609894+0000","last_active":"2023-08-17T00:17:03.614822+0000","last_peered":"2023-08-17T00:17:03.614822+0000","last_clean":"2023-08-17T00:17:03.614822+0000","last_became_active":"2023-08-17T00:17:03.609602+0000","last_became_peered":"2023-08-17T00:17:03.609602+0000","last_unstale":"2023-08-17T00:17:03.614822+0000","last_undegraded":"2023-08-17T00:17:03.614822+0000","last_fullsized":"2023-08-17T00:17:03.614822+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050491+0000","last_change":"2023-08-17T00:17:04.050491+0000","last_active":"2023-08-17T00:17:04.050491+0000","last_peered":"2023-08-17T00:17:04.050491+0000","last_clean":"2023-08-17T00:17:04.050491+0000","last_became_active":"2023-08-17T00:17:04.050001+0000","last_became_peered":"2023-08-17T00:17:04.050001+0000","last_unstale":"2023-08-17T00:17:04.050491+0000","last_undegraded":"2023-08-17T00:17:04.050491+0000","last_fullsized":"2023-08-17T00:17:04.050491+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.616455+0000","last_change":"2023-08-17T00:17:03.611855+0000","last_active":"2023-08-17T00:17:03.616455+0000","last_peered":"2023-08-17T00:17:03.616455+0000","last_clean":"2023-08-17T00:17:03.616455+0000","last_became_active":"2023-08-17T00:17:03.611566+0000","last_became_peered":"2023-08-17T00:17:03.611566+0000","last_unstale":"2023-08-17T00:17:03.616455+0000","last_undegraded":"2023-08-17T00:17:03.616455+0000","last_fullsized":"2023-08-17T00:17:03.616455+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049971+0000","last_change":"2023-08-17T00:17:04.049971+0000","last_active":"2023-08-17T00:17:04.049971+0000","last_peered":"2023-08-17T00:17:04.049971+0000","last_clean":"2023-08-17T00:17:04.049971+0000","last_became_active":"2023-08-17T00:17:04.049710+0000","last_became_peered":"2023-08-17T00:17:04.049710+0000","last_unstale":"2023-08-17T00:17:04.049971+0000","last_undegraded":"2023-08-17T00:17:04.049971+0000","last_fullsized":"2023-08-17T00:17:04.049971+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2d","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040966+0000","last_change":"2023-08-17T00:17:03.611104+0000","last_active":"2023-08-17T00:17:04.040966+0000","last_peered":"2023-08-17T00:17:04.040966+0000","last_clean":"2023-08-17T00:17:04.040966+0000","last_became_active":"2023-08-17T00:17:03.610764+0000","last_became_peered":"2023-08-17T00:17:03.610764+0000","last_unstale":"2023-08-17T00:17:04.040966+0000","last_undegraded":"2023-08-17T00:17:04.040966+0000","last_fullsized":"2023-08-17T00:17:04.040966+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054835+0000","last_change":"2023-08-17T00:17:04.054835+0000","last_active":"2023-08-17T00:17:04.054835+0000","last_peered":"2023-08-17T00:17:04.054835+0000","last_clean":"2023-08-17T00:17:04.054835+0000","last_became_active":"2023-08-17T00:17:04.054587+0000","last_became_peered":"2023-08-17T00:17:04.054587+0000","last_unstale":"2023-08-17T00:17:04.054835+0000","last_undegraded":"2023-08-17T00:17:04.054835+0000","last_fullsized":"2023-08-17T00:17:04.054835+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617261+0000","last_change":"2023-08-17T00:17:03.612980+0000","last_active":"2023-08-17T00:17:03.617261+0000","last_peered":"2023-08-17T00:17:03.617261+0000","last_clean":"2023-08-17T00:17:03.617261+0000","last_became_active":"2023-08-17T00:17:03.612688+0000","last_became_peered":"2023-08-17T00:17:03.612688+0000","last_unstale":"2023-08-17T00:17:03.617261+0000","last_undegraded":"2023-08-17T00:17:03.617261+0000","last_fullsized":"2023-08-17T00:17:03.617261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055847+0000","last_change":"2023-08-17T00:17:04.055847+0000","last_active":"2023-08-17T00:17:04.055847+0000","last_peered":"2023-08-17T00:17:04.055847+0000","last_clean":"2023-08-17T00:17:04.055847+0000","last_became_active":"2023-08-17T00:17:04.051524+0000","last_became_peered":"2023-08-17T00:17:04.051524+0000","last_unstale":"2023-08-17T00:17:04.055847+0000","last_undegraded":"2023-08-17T00:17:04.055847+0000","last_fullsized":"2023-08-17T00:17:04.055847+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022175+0000","last_change":"2023-08-17T00:17:03.606708+0000","last_active":"2023-08-17T00:17:04.022175+0000","last_peered":"2023-08-17T00:17:04.022175+0000","last_clean":"2023-08-17T00:17:04.022175+0000","last_became_active":"2023-08-17T00:17:03.606429+0000","last_became_peered":"2023-08-17T00:17:03.606429+0000","last_unstale":"2023-08-17T00:17:04.022175+0000","last_undegraded":"2023-08-17T00:17:04.022175+0000","last_fullsized":"2023-08-17T00:17:04.022175+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050797+0000","last_change":"2023-08-17T00:17:04.050797+0000","last_active":"2023-08-17T00:17:04.050797+0000","last_peered":"2023-08-17T00:17:04.050797+0000","last_clean":"2023-08-17T00:17:04.050797+0000","last_became_active":"2023-08-17T00:17:04.050543+0000","last_became_peered":"2023-08-17T00:17:04.050543+0000","last_unstale":"2023-08-17T00:17:04.050797+0000","last_undegraded":"2023-08-17T00:17:04.050797+0000","last_fullsized":"2023-08-17T00:17:04.050797+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.600754+0000","last_change":"2023-08-17T00:17:03.597621+0000","last_active":"2023-08-17T00:17:03.600754+0000","last_peered":"2023-08-17T00:17:03.600754+0000","last_clean":"2023-08-17T00:17:03.600754+0000","last_became_active":"2023-08-17T00:17:03.597317+0000","last_became_peered":"2023-08-17T00:17:03.597317+0000","last_unstale":"2023-08-17T00:17:03.600754+0000","last_undegraded":"2023-08-17T00:17:03.600754+0000","last_fullsized":"2023-08-17T00:17:03.600754+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603854+0000","last_change":"2023-08-17T00:17:03.599495+0000","last_active":"2023-08-17T00:17:03.603854+0000","last_peered":"2023-08-17T00:17:03.603854+0000","last_clean":"2023-08-17T00:17:03.603854+0000","last_became_active":"2023-08-17T00:17:03.599051+0000","last_became_peered":"2023-08-17T00:17:03.599051+0000","last_unstale":"2023-08-17T00:17:03.603854+0000","last_undegraded":"2023-08-17T00:17:03.603854+0000","last_fullsized":"2023-08-17T00:17:03.603854+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040949+0000","last_change":"2023-08-17T00:17:04.040949+0000","last_active":"2023-08-17T00:17:04.040949+0000","last_peered":"2023-08-17T00:17:04.040949+0000","last_clean":"2023-08-17T00:17:04.040949+0000","last_became_active":"2023-08-17T00:17:04.040663+0000","last_became_peered":"2023-08-17T00:17:04.040663+0000","last_unstale":"2023-08-17T00:17:04.040949+0000","last_undegraded":"2023-08-17T00:17:04.040949+0000","last_fullsized":"2023-08-17T00:17:04.040949+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607214+0000","last_change":"2023-08-17T00:17:03.601055+0000","last_active":"2023-08-17T00:17:03.607214+0000","last_peered":"2023-08-17T00:17:03.607214+0000","last_clean":"2023-08-17T00:17:03.607214+0000","last_became_active":"2023-08-17T00:17:03.600760+0000","last_became_peered":"2023-08-17T00:17:03.600760+0000","last_unstale":"2023-08-17T00:17:03.607214+0000","last_undegraded":"2023-08-17T00:17:03.607214+0000","last_fullsized":"2023-08-17T00:17:03.607214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042770+0000","last_change":"2023-08-17T00:17:04.042770+0000","last_active":"2023-08-17T00:17:04.042770+0000","last_peered":"2023-08-17T00:17:04.042770+0000","last_clean":"2023-08-17T00:17:04.042770+0000","last_became_active":"2023-08-17T00:17:04.042363+0000","last_became_peered":"2023-08-17T00:17:04.042363+0000","last_unstale":"2023-08-17T00:17:04.042770+0000","last_undegraded":"2023-08-17T00:17:04.042770+0000","last_fullsized":"2023-08-17T00:17:04.042770+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617826+0000","last_change":"2023-08-17T00:17:03.610988+0000","last_active":"2023-08-17T00:17:03.617826+0000","last_peered":"2023-08-17T00:17:03.617826+0000","last_clean":"2023-08-17T00:17:03.617826+0000","last_became_active":"2023-08-17T00:17:03.609830+0000","last_became_peered":"2023-08-17T00:17:03.609830+0000","last_unstale":"2023-08-17T00:17:03.617826+0000","last_undegraded":"2023-08-17T00:17:03.617826+0000","last_fullsized":"2023-08-17T00:17:03.617826+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052392+0000","last_change":"2023-08-17T00:17:04.052392+0000","last_active":"2023-08-17T00:17:04.052392+0000","last_peered":"2023-08-17T00:17:04.052392+0000","last_clean":"2023-08-17T00:17:04.052392+0000","last_became_active":"2023-08-17T00:17:04.052134+0000","last_became_peered":"2023-08-17T00:17:04.052134+0000","last_unstale":"2023-08-17T00:17:04.052392+0000","last_undegraded":"2023-08-17T00:17:04.052392+0000","last_fullsized":"2023-08-17T00:17:04.052392+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563951+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035061+0000","last_change":"2023-08-17T00:17:04.035061+0000","last_active":"2023-08-17T00:17:04.035061+0000","last_peered":"2023-08-17T00:17:04.035061+0000","last_clean":"2023-08-17T00:17:04.035061+0000","last_became_active":"2023-08-17T00:17:04.034776+0000","last_became_peered":"2023-08-17T00:17:04.034776+0000","last_unstale":"2023-08-17T00:17:04.035061+0000","last_undegraded":"2023-08-17T00:17:04.035061+0000","last_fullsized":"2023-08-17T00:17:04.035061+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.612779+0000","last_change":"2023-08-17T00:17:03.607437+0000","last_active":"2023-08-17T00:17:03.612779+0000","last_peered":"2023-08-17T00:17:03.612779+0000","last_clean":"2023-08-17T00:17:03.612779+0000","last_became_active":"2023-08-17T00:17:03.603660+0000","last_became_peered":"2023-08-17T00:17:03.603660+0000","last_unstale":"2023-08-17T00:17:03.612779+0000","last_undegraded":"2023-08-17T00:17:03.612779+0000","last_fullsized":"2023-08-17T00:17:03.612779+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563287+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.600610+0000","last_change":"2023-08-17T00:17:03.597907+0000","last_active":"2023-08-17T00:17:03.600610+0000","last_peered":"2023-08-17T00:17:03.600610+0000","last_clean":"2023-08-17T00:17:03.600610+0000","last_became_active":"2023-08-17T00:17:03.597644+0000","last_became_peered":"2023-08-17T00:17:03.597644+0000","last_unstale":"2023-08-17T00:17:03.600610+0000","last_undegraded":"2023-08-17T00:17:03.600610+0000","last_fullsized":"2023-08-17T00:17:03.600610+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056716+0000","last_change":"2023-08-17T00:17:04.056716+0000","last_active":"2023-08-17T00:17:04.056716+0000","last_peered":"2023-08-17T00:17:04.056716+0000","last_clean":"2023-08-17T00:17:04.056716+0000","last_became_active":"2023-08-17T00:17:04.055773+0000","last_became_peered":"2023-08-17T00:17:04.055773+0000","last_unstale":"2023-08-17T00:17:04.056716+0000","last_undegraded":"2023-08-17T00:17:04.056716+0000","last_fullsized":"2023-08-17T00:17:04.056716+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617889+0000","last_change":"2023-08-17T00:17:03.611346+0000","last_active":"2023-08-17T00:17:03.617889+0000","last_peered":"2023-08-17T00:17:03.617889+0000","last_clean":"2023-08-17T00:17:03.617889+0000","last_became_active":"2023-08-17T00:17:03.611004+0000","last_became_peered":"2023-08-17T00:17:03.611004+0000","last_unstale":"2023-08-17T00:17:03.617889+0000","last_undegraded":"2023-08-17T00:17:03.617889+0000","last_fullsized":"2023-08-17T00:17:03.617889+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048187+0000","last_change":"2023-08-17T00:17:04.048187+0000","last_active":"2023-08-17T00:17:04.048187+0000","last_peered":"2023-08-17T00:17:04.048187+0000","last_clean":"2023-08-17T00:17:04.048187+0000","last_became_active":"2023-08-17T00:17:04.047889+0000","last_became_peered":"2023-08-17T00:17:04.047889+0000","last_unstale":"2023-08-17T00:17:04.048187+0000","last_undegraded":"2023-08-17T00:17:04.048187+0000","last_fullsized":"2023-08-17T00:17:04.048187+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617311+0000","last_change":"2023-08-17T00:17:03.613617+0000","last_active":"2023-08-17T00:17:03.617311+0000","last_peered":"2023-08-17T00:17:03.617311+0000","last_clean":"2023-08-17T00:17:03.617311+0000","last_became_active":"2023-08-17T00:17:03.612763+0000","last_became_peered":"2023-08-17T00:17:03.612763+0000","last_unstale":"2023-08-17T00:17:03.617311+0000","last_undegraded":"2023-08-17T00:17:03.617311+0000","last_fullsized":"2023-08-17T00:17:03.617311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049571+0000","last_change":"2023-08-17T00:17:04.049571+0000","last_active":"2023-08-17T00:17:04.049571+0000","last_peered":"2023-08-17T00:17:04.049571+0000","last_clean":"2023-08-17T00:17:04.049571+0000","last_became_active":"2023-08-17T00:17:04.049298+0000","last_became_peered":"2023-08-17T00:17:04.049298+0000","last_unstale":"2023-08-17T00:17:04.049571+0000","last_undegraded":"2023-08-17T00:17:04.049571+0000","last_fullsized":"2023-08-17T00:17:04.049571+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.601713+0000","last_change":"2023-08-17T00:17:03.596004+0000","last_active":"2023-08-17T00:17:03.601713+0000","last_peered":"2023-08-17T00:17:03.601713+0000","last_clean":"2023-08-17T00:17:03.601713+0000","last_became_active":"2023-08-17T00:17:03.595679+0000","last_became_peered":"2023-08-17T00:17:03.595679+0000","last_unstale":"2023-08-17T00:17:03.601713+0000","last_undegraded":"2023-08-17T00:17:03.601713+0000","last_fullsized":"2023-08-17T00:17:03.601713+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045491+0000","last_change":"2023-08-17T00:17:04.045491+0000","last_active":"2023-08-17T00:17:04.045491+0000","last_peered":"2023-08-17T00:17:04.045491+0000","last_clean":"2023-08-17T00:17:04.045491+0000","last_became_active":"2023-08-17T00:17:04.044996+0000","last_became_peered":"2023-08-17T00:17:04.044996+0000","last_unstale":"2023-08-17T00:17:04.045491+0000","last_undegraded":"2023-08-17T00:17:04.045491+0000","last_fullsized":"2023-08-17T00:17:04.045491+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602324+0000","last_change":"2023-08-17T00:17:03.596073+0000","last_active":"2023-08-17T00:17:03.602324+0000","last_peered":"2023-08-17T00:17:03.602324+0000","last_clean":"2023-08-17T00:17:03.602324+0000","last_became_active":"2023-08-17T00:17:03.595733+0000","last_became_peered":"2023-08-17T00:17:03.595733+0000","last_unstale":"2023-08-17T00:17:03.602324+0000","last_undegraded":"2023-08-17T00:17:03.602324+0000","last_fullsized":"2023-08-17T00:17:03.602324+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045670+0000","last_change":"2023-08-17T00:17:04.045670+0000","last_active":"2023-08-17T00:17:04.045670+0000","last_peered":"2023-08-17T00:17:04.045670+0000","last_clean":"2023-08-17T00:17:04.045670+0000","last_became_active":"2023-08-17T00:17:04.045375+0000","last_became_peered":"2023-08-17T00:17:04.045375+0000","last_unstale":"2023-08-17T00:17:04.045670+0000","last_undegraded":"2023-08-17T00:17:04.045670+0000","last_fullsized":"2023-08-17T00:17:04.045670+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617765+0000","last_change":"2023-08-17T00:17:03.609853+0000","last_active":"2023-08-17T00:17:03.617765+0000","last_peered":"2023-08-17T00:17:03.617765+0000","last_clean":"2023-08-17T00:17:03.617765+0000","last_became_active":"2023-08-17T00:17:03.609486+0000","last_became_peered":"2023-08-17T00:17:03.609486+0000","last_unstale":"2023-08-17T00:17:03.617765+0000","last_undegraded":"2023-08-17T00:17:03.617765+0000","last_fullsized":"2023-08-17T00:17:03.617765+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056410+0000","last_change":"2023-08-17T00:17:04.056410+0000","last_active":"2023-08-17T00:17:04.056410+0000","last_peered":"2023-08-17T00:17:04.056410+0000","last_clean":"2023-08-17T00:17:04.056410+0000","last_became_active":"2023-08-17T00:17:04.056085+0000","last_became_peered":"2023-08-17T00:17:04.056085+0000","last_unstale":"2023-08-17T00:17:04.056410+0000","last_undegraded":"2023-08-17T00:17:04.056410+0000","last_fullsized":"2023-08-17T00:17:04.056410+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563201+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056552+0000","last_change":"2023-08-17T00:17:04.056552+0000","last_active":"2023-08-17T00:17:04.056552+0000","last_peered":"2023-08-17T00:17:04.056552+0000","last_clean":"2023-08-17T00:17:04.056552+0000","last_became_active":"2023-08-17T00:17:04.055842+0000","last_became_peered":"2023-08-17T00:17:04.055842+0000","last_unstale":"2023-08-17T00:17:04.056552+0000","last_undegraded":"2023-08-17T00:17:04.056552+0000","last_fullsized":"2023-08-17T00:17:04.056552+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.14","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056273+0000","last_change":"2023-08-17T00:17:03.600325+0000","last_active":"2023-08-17T00:17:04.056273+0000","last_peered":"2023-08-17T00:17:04.056273+0000","last_clean":"2023-08-17T00:17:04.056273+0000","last_became_active":"2023-08-17T00:17:03.600007+0000","last_became_peered":"2023-08-17T00:17:03.600007+0000","last_unstale":"2023-08-17T00:17:04.056273+0000","last_undegraded":"2023-08-17T00:17:04.056273+0000","last_fullsized":"2023-08-17T00:17:04.056273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.033044+0000","last_change":"2023-08-17T00:17:04.033044+0000","last_active":"2023-08-17T00:17:04.033044+0000","last_peered":"2023-08-17T00:17:04.033044+0000","last_clean":"2023-08-17T00:17:04.033044+0000","last_became_active":"2023-08-17T00:17:04.032572+0000","last_became_peered":"2023-08-17T00:17:04.032572+0000","last_unstale":"2023-08-17T00:17:04.033044+0000","last_undegraded":"2023-08-17T00:17:04.033044+0000","last_fullsized":"2023-08-17T00:17:04.033044+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.13","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039535+0000","last_change":"2023-08-17T00:17:03.611763+0000","last_active":"2023-08-17T00:17:04.039535+0000","last_peered":"2023-08-17T00:17:04.039535+0000","last_clean":"2023-08-17T00:17:04.039535+0000","last_became_active":"2023-08-17T00:17:03.611425+0000","last_became_peered":"2023-08-17T00:17:03.611425+0000","last_unstale":"2023-08-17T00:17:04.039535+0000","last_undegraded":"2023-08-17T00:17:04.039535+0000","last_fullsized":"2023-08-17T00:17:04.039535+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050251+0000","last_change":"2023-08-17T00:17:04.050251+0000","last_active":"2023-08-17T00:17:04.050251+0000","last_peered":"2023-08-17T00:17:04.050251+0000","last_clean":"2023-08-17T00:17:04.050251+0000","last_became_active":"2023-08-17T00:17:04.049738+0000","last_became_peered":"2023-08-17T00:17:04.049738+0000","last_unstale":"2023-08-17T00:17:04.050251+0000","last_undegraded":"2023-08-17T00:17:04.050251+0000","last_fullsized":"2023-08-17T00:17:04.050251+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602708+0000","last_change":"2023-08-17T00:17:03.600255+0000","last_active":"2023-08-17T00:17:03.602708+0000","last_peered":"2023-08-17T00:17:03.602708+0000","last_clean":"2023-08-17T00:17:03.602708+0000","last_became_active":"2023-08-17T00:17:03.599911+0000","last_became_peered":"2023-08-17T00:17:03.599911+0000","last_unstale":"2023-08-17T00:17:03.602708+0000","last_undegraded":"2023-08-17T00:17:03.602708+0000","last_fullsized":"2023-08-17T00:17:03.602708+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613531+0000","last_change":"2023-08-17T00:17:03.604322+0000","last_active":"2023-08-17T00:17:03.613531+0000","last_peered":"2023-08-17T00:17:03.613531+0000","last_clean":"2023-08-17T00:17:03.613531+0000","last_became_active":"2023-08-17T00:17:03.603995+0000","last_became_peered":"2023-08-17T00:17:03.603995+0000","last_unstale":"2023-08-17T00:17:03.613531+0000","last_undegraded":"2023-08-17T00:17:03.613531+0000","last_fullsized":"2023-08-17T00:17:03.613531+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053850+0000","last_change":"2023-08-17T00:17:04.053850+0000","last_active":"2023-08-17T00:17:04.053850+0000","last_peered":"2023-08-17T00:17:04.053850+0000","last_clean":"2023-08-17T00:17:04.053850+0000","last_became_active":"2023-08-17T00:17:04.053597+0000","last_became_peered":"2023-08-17T00:17:04.053597+0000","last_unstale":"2023-08-17T00:17:04.053850+0000","last_undegraded":"2023-08-17T00:17:04.053850+0000","last_fullsized":"2023-08-17T00:17:04.053850+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047575+0000","last_change":"2023-08-17T00:17:03.606608+0000","last_active":"2023-08-17T00:17:04.047575+0000","last_peered":"2023-08-17T00:17:04.047575+0000","last_clean":"2023-08-17T00:17:04.047575+0000","last_became_active":"2023-08-17T00:17:03.606317+0000","last_became_peered":"2023-08-17T00:17:03.606317+0000","last_unstale":"2023-08-17T00:17:04.047575+0000","last_undegraded":"2023-08-17T00:17:04.047575+0000","last_fullsized":"2023-08-17T00:17:04.047575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042596+0000","last_change":"2023-08-17T00:17:04.042596+0000","last_active":"2023-08-17T00:17:04.042596+0000","last_peered":"2023-08-17T00:17:04.042596+0000","last_clean":"2023-08-17T00:17:04.042596+0000","last_became_active":"2023-08-17T00:17:04.042057+0000","last_became_peered":"2023-08-17T00:17:04.042057+0000","last_unstale":"2023-08-17T00:17:04.042596+0000","last_undegraded":"2023-08-17T00:17:04.042596+0000","last_fullsized":"2023-08-17T00:17:04.042596+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034398+0000","last_change":"2023-08-17T00:17:03.608573+0000","last_active":"2023-08-17T00:17:04.034398+0000","last_peered":"2023-08-17T00:17:04.034398+0000","last_clean":"2023-08-17T00:17:04.034398+0000","last_became_active":"2023-08-17T00:17:03.608193+0000","last_became_peered":"2023-08-17T00:17:03.608193+0000","last_unstale":"2023-08-17T00:17:04.034398+0000","last_undegraded":"2023-08-17T00:17:04.034398+0000","last_fullsized":"2023-08-17T00:17:04.034398+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053237+0000","last_change":"2023-08-17T00:17:04.053237+0000","last_active":"2023-08-17T00:17:04.053237+0000","last_peered":"2023-08-17T00:17:04.053237+0000","last_clean":"2023-08-17T00:17:04.053237+0000","last_became_active":"2023-08-17T00:17:04.052979+0000","last_became_peered":"2023-08-17T00:17:04.052979+0000","last_unstale":"2023-08-17T00:17:04.053237+0000","last_undegraded":"2023-08-17T00:17:04.053237+0000","last_fullsized":"2023-08-17T00:17:04.053237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.e","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047976+0000","last_change":"2023-08-17T00:17:03.604251+0000","last_active":"2023-08-17T00:17:04.047976+0000","last_peered":"2023-08-17T00:17:04.047976+0000","last_clean":"2023-08-17T00:17:04.047976+0000","last_became_active":"2023-08-17T00:17:03.603083+0000","last_became_peered":"2023-08-17T00:17:03.603083+0000","last_unstale":"2023-08-17T00:17:04.047976+0000","last_undegraded":"2023-08-17T00:17:04.047976+0000","last_fullsized":"2023-08-17T00:17:04.047976+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047137+0000","last_change":"2023-08-17T00:17:04.047137+0000","last_active":"2023-08-17T00:17:04.047137+0000","last_peered":"2023-08-17T00:17:04.047137+0000","last_clean":"2023-08-17T00:17:04.047137+0000","last_became_active":"2023-08-17T00:17:04.046858+0000","last_became_peered":"2023-08-17T00:17:04.046858+0000","last_unstale":"2023-08-17T00:17:04.047137+0000","last_undegraded":"2023-08-17T00:17:04.047137+0000","last_fullsized":"2023-08-17T00:17:04.047137+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.608668+0000","last_change":"2023-08-17T00:17:03.601090+0000","last_active":"2023-08-17T00:17:03.608668+0000","last_peered":"2023-08-17T00:17:03.608668+0000","last_clean":"2023-08-17T00:17:03.608668+0000","last_became_active":"2023-08-17T00:17:03.600472+0000","last_became_peered":"2023-08-17T00:17:03.600472+0000","last_unstale":"2023-08-17T00:17:03.608668+0000","last_undegraded":"2023-08-17T00:17:03.608668+0000","last_fullsized":"2023-08-17T00:17:03.608668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056944+0000","last_change":"2023-08-17T00:17:04.056944+0000","last_active":"2023-08-17T00:17:04.056944+0000","last_peered":"2023-08-17T00:17:04.056944+0000","last_clean":"2023-08-17T00:17:04.056944+0000","last_became_active":"2023-08-17T00:17:04.056627+0000","last_became_peered":"2023-08-17T00:17:04.056627+0000","last_unstale":"2023-08-17T00:17:04.056944+0000","last_undegraded":"2023-08-17T00:17:04.056944+0000","last_fullsized":"2023-08-17T00:17:04.056944+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617518+0000","last_change":"2023-08-17T00:17:03.615987+0000","last_active":"2023-08-17T00:17:03.617518+0000","last_peered":"2023-08-17T00:17:03.617518+0000","last_clean":"2023-08-17T00:17:03.617518+0000","last_became_active":"2023-08-17T00:17:03.615694+0000","last_became_peered":"2023-08-17T00:17:03.615694+0000","last_unstale":"2023-08-17T00:17:03.617518+0000","last_undegraded":"2023-08-17T00:17:03.617518+0000","last_fullsized":"2023-08-17T00:17:03.617518+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028263+0000","last_change":"2023-08-17T00:17:03.606480+0000","last_active":"2023-08-17T00:17:04.028263+0000","last_peered":"2023-08-17T00:17:04.028263+0000","last_clean":"2023-08-17T00:17:04.028263+0000","last_became_active":"2023-08-17T00:17:03.606201+0000","last_became_peered":"2023-08-17T00:17:03.606201+0000","last_unstale":"2023-08-17T00:17:04.028263+0000","last_undegraded":"2023-08-17T00:17:04.028263+0000","last_fullsized":"2023-08-17T00:17:04.028263+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040428+0000","last_change":"2023-08-17T00:17:04.040428+0000","last_active":"2023-08-17T00:17:04.040428+0000","last_peered":"2023-08-17T00:17:04.040428+0000","last_clean":"2023-08-17T00:17:04.040428+0000","last_became_active":"2023-08-17T00:17:04.040152+0000","last_became_peered":"2023-08-17T00:17:04.040152+0000","last_unstale":"2023-08-17T00:17:04.040428+0000","last_undegraded":"2023-08-17T00:17:04.040428+0000","last_fullsized":"2023-08-17T00:17:04.040428+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617229+0000","last_change":"2023-08-17T00:17:03.612657+0000","last_active":"2023-08-17T00:17:03.617229+0000","last_peered":"2023-08-17T00:17:03.617229+0000","last_clean":"2023-08-17T00:17:03.617229+0000","last_became_active":"2023-08-17T00:17:03.612391+0000","last_became_peered":"2023-08-17T00:17:03.612391+0000","last_unstale":"2023-08-17T00:17:03.617229+0000","last_undegraded":"2023-08-17T00:17:03.617229+0000","last_fullsized":"2023-08-17T00:17:03.617229+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048967+0000","last_change":"2023-08-17T00:17:04.048967+0000","last_active":"2023-08-17T00:17:04.048967+0000","last_peered":"2023-08-17T00:17:04.048967+0000","last_clean":"2023-08-17T00:17:04.048967+0000","last_became_active":"2023-08-17T00:17:04.048659+0000","last_became_peered":"2023-08-17T00:17:04.048659+0000","last_unstale":"2023-08-17T00:17:04.048967+0000","last_undegraded":"2023-08-17T00:17:04.048967+0000","last_fullsized":"2023-08-17T00:17:04.048967+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617867+0000","last_change":"2023-08-17T00:17:03.611238+0000","last_active":"2023-08-17T00:17:03.617867+0000","last_peered":"2023-08-17T00:17:03.617867+0000","last_clean":"2023-08-17T00:17:03.617867+0000","last_became_active":"2023-08-17T00:17:03.609987+0000","last_became_peered":"2023-08-17T00:17:03.609987+0000","last_unstale":"2023-08-17T00:17:03.617867+0000","last_undegraded":"2023-08-17T00:17:03.617867+0000","last_fullsized":"2023-08-17T00:17:03.617867+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050256+0000","last_change":"2023-08-17T00:17:04.050256+0000","last_active":"2023-08-17T00:17:04.050256+0000","last_peered":"2023-08-17T00:17:04.050256+0000","last_clean":"2023-08-17T00:17:04.050256+0000","last_became_active":"2023-08-17T00:17:04.049997+0000","last_became_peered":"2023-08-17T00:17:04.049997+0000","last_unstale":"2023-08-17T00:17:04.050256+0000","last_undegraded":"2023-08-17T00:17:04.050256+0000","last_fullsized":"2023-08-17T00:17:04.050256+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617682+0000","last_change":"2023-08-17T00:17:03.608995+0000","last_active":"2023-08-17T00:17:03.617682+0000","last_peered":"2023-08-17T00:17:03.617682+0000","last_clean":"2023-08-17T00:17:03.617682+0000","last_became_active":"2023-08-17T00:17:03.608716+0000","last_became_peered":"2023-08-17T00:17:03.608716+0000","last_unstale":"2023-08-17T00:17:03.617682+0000","last_undegraded":"2023-08-17T00:17:03.617682+0000","last_fullsized":"2023-08-17T00:17:03.617682+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039299+0000","last_change":"2023-08-17T00:17:04.039299+0000","last_active":"2023-08-17T00:17:04.039299+0000","last_peered":"2023-08-17T00:17:04.039299+0000","last_clean":"2023-08-17T00:17:04.039299+0000","last_became_active":"2023-08-17T00:17:04.039008+0000","last_became_peered":"2023-08-17T00:17:04.039008+0000","last_unstale":"2023-08-17T00:17:04.039299+0000","last_undegraded":"2023-08-17T00:17:04.039299+0000","last_fullsized":"2023-08-17T00:17:04.039299+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.7","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055570+0000","last_change":"2023-08-17T00:17:03.604168+0000","last_active":"2023-08-17T00:17:04.055570+0000","last_peered":"2023-08-17T00:17:04.055570+0000","last_clean":"2023-08-17T00:17:04.055570+0000","last_became_active":"2023-08-17T00:17:03.603901+0000","last_became_peered":"2023-08-17T00:17:03.603901+0000","last_unstale":"2023-08-17T00:17:04.055570+0000","last_undegraded":"2023-08-17T00:17:04.055570+0000","last_fullsized":"2023-08-17T00:17:04.055570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050279+0000","last_change":"2023-08-17T00:17:04.050279+0000","last_active":"2023-08-17T00:17:04.050279+0000","last_peered":"2023-08-17T00:17:04.050279+0000","last_clean":"2023-08-17T00:17:04.050279+0000","last_became_active":"2023-08-17T00:17:04.049619+0000","last_became_peered":"2023-08-17T00:17:04.049619+0000","last_unstale":"2023-08-17T00:17:04.050279+0000","last_undegraded":"2023-08-17T00:17:04.050279+0000","last_fullsized":"2023-08-17T00:17:04.050279+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.606504+0000","last_change":"2023-08-17T00:17:03.598312+0000","last_active":"2023-08-17T00:17:03.606504+0000","last_peered":"2023-08-17T00:17:03.606504+0000","last_clean":"2023-08-17T00:17:03.606504+0000","last_became_active":"2023-08-17T00:17:03.597966+0000","last_became_peered":"2023-08-17T00:17:03.597966+0000","last_unstale":"2023-08-17T00:17:03.606504+0000","last_undegraded":"2023-08-17T00:17:03.606504+0000","last_fullsized":"2023-08-17T00:17:03.606504+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054458+0000","last_change":"2023-08-17T00:17:04.054458+0000","last_active":"2023-08-17T00:17:04.054458+0000","last_peered":"2023-08-17T00:17:04.054458+0000","last_clean":"2023-08-17T00:17:04.054458+0000","last_became_active":"2023-08-17T00:17:04.054168+0000","last_became_peered":"2023-08-17T00:17:04.054168+0000","last_unstale":"2023-08-17T00:17:04.054458+0000","last_undegraded":"2023-08-17T00:17:04.054458+0000","last_fullsized":"2023-08-17T00:17:04.054458+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607544+0000","last_change":"2023-08-17T00:17:03.600702+0000","last_active":"2023-08-17T00:17:03.607544+0000","last_peered":"2023-08-17T00:17:03.607544+0000","last_clean":"2023-08-17T00:17:03.607544+0000","last_became_active":"2023-08-17T00:17:03.600329+0000","last_became_peered":"2023-08-17T00:17:03.600329+0000","last_unstale":"2023-08-17T00:17:03.607544+0000","last_undegraded":"2023-08-17T00:17:03.607544+0000","last_fullsized":"2023-08-17T00:17:03.607544+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048843+0000","last_change":"2023-08-17T00:17:04.048843+0000","last_active":"2023-08-17T00:17:04.048843+0000","last_peered":"2023-08-17T00:17:04.048843+0000","last_clean":"2023-08-17T00:17:04.048843+0000","last_became_active":"2023-08-17T00:17:04.048452+0000","last_became_peered":"2023-08-17T00:17:04.048452+0000","last_unstale":"2023-08-17T00:17:04.048843+0000","last_undegraded":"2023-08-17T00:17:04.048843+0000","last_fullsized":"2023-08-17T00:17:04.048843+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602500+0000","last_change":"2023-08-17T00:17:03.601397+0000","last_active":"2023-08-17T00:17:03.602500+0000","last_peered":"2023-08-17T00:17:03.602500+0000","last_clean":"2023-08-17T00:17:03.602500+0000","last_became_active":"2023-08-17T00:17:03.601090+0000","last_became_peered":"2023-08-17T00:17:03.601090+0000","last_unstale":"2023-08-17T00:17:03.602500+0000","last_undegraded":"2023-08-17T00:17:03.602500+0000","last_fullsized":"2023-08-17T00:17:03.602500+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044730+0000","last_change":"2023-08-17T00:17:04.044730+0000","last_active":"2023-08-17T00:17:04.044730+0000","last_peered":"2023-08-17T00:17:04.044730+0000","last_clean":"2023-08-17T00:17:04.044730+0000","last_became_active":"2023-08-17T00:17:04.044474+0000","last_became_peered":"2023-08-17T00:17:04.044474+0000","last_unstale":"2023-08-17T00:17:04.044730+0000","last_undegraded":"2023-08-17T00:17:04.044730+0000","last_fullsized":"2023-08-17T00:17:04.044730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607491+0000","last_change":"2023-08-17T00:17:03.604924+0000","last_active":"2023-08-17T00:17:03.607491+0000","last_peered":"2023-08-17T00:17:03.607491+0000","last_clean":"2023-08-17T00:17:03.607491+0000","last_became_active":"2023-08-17T00:17:03.604666+0000","last_became_peered":"2023-08-17T00:17:03.604666+0000","last_unstale":"2023-08-17T00:17:03.607491+0000","last_undegraded":"2023-08-17T00:17:03.607491+0000","last_fullsized":"2023-08-17T00:17:03.607491+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052415+0000","last_change":"2023-08-17T00:17:04.052415+0000","last_active":"2023-08-17T00:17:04.052415+0000","last_peered":"2023-08-17T00:17:04.052415+0000","last_clean":"2023-08-17T00:17:04.052415+0000","last_became_active":"2023-08-17T00:17:04.052144+0000","last_became_peered":"2023-08-17T00:17:04.052144+0000","last_unstale":"2023-08-17T00:17:04.052415+0000","last_undegraded":"2023-08-17T00:17:04.052415+0000","last_fullsized":"2023-08-17T00:17:04.052415+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613270+0000","last_change":"2023-08-17T00:17:03.604890+0000","last_active":"2023-08-17T00:17:03.613270+0000","last_peered":"2023-08-17T00:17:03.613270+0000","last_clean":"2023-08-17T00:17:03.613270+0000","last_became_active":"2023-08-17T00:17:03.604627+0000","last_became_peered":"2023-08-17T00:17:03.604627+0000","last_unstale":"2023-08-17T00:17:03.613270+0000","last_undegraded":"2023-08-17T00:17:03.613270+0000","last_fullsized":"2023-08-17T00:17:03.613270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040497+0000","last_change":"2023-08-17T00:17:04.040497+0000","last_active":"2023-08-17T00:17:04.040497+0000","last_peered":"2023-08-17T00:17:04.040497+0000","last_clean":"2023-08-17T00:17:04.040497+0000","last_became_active":"2023-08-17T00:17:04.039861+0000","last_became_peered":"2023-08-17T00:17:04.039861+0000","last_unstale":"2023-08-17T00:17:04.040497+0000","last_undegraded":"2023-08-17T00:17:04.040497+0000","last_fullsized":"2023-08-17T00:17:04.040497+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617792+0000","last_change":"2023-08-17T00:17:03.610904+0000","last_active":"2023-08-17T00:17:03.617792+0000","last_peered":"2023-08-17T00:17:03.617792+0000","last_clean":"2023-08-17T00:17:03.617792+0000","last_became_active":"2023-08-17T00:17:03.609650+0000","last_became_peered":"2023-08-17T00:17:03.609650+0000","last_unstale":"2023-08-17T00:17:03.617792+0000","last_undegraded":"2023-08-17T00:17:03.617792+0000","last_fullsized":"2023-08-17T00:17:03.617792+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052784+0000","last_change":"2023-08-17T00:17:04.052784+0000","last_active":"2023-08-17T00:17:04.052784+0000","last_peered":"2023-08-17T00:17:04.052784+0000","last_clean":"2023-08-17T00:17:04.052784+0000","last_became_active":"2023-08-17T00:17:04.052382+0000","last_became_peered":"2023-08-17T00:17:04.052382+0000","last_unstale":"2023-08-17T00:17:04.052784+0000","last_undegraded":"2023-08-17T00:17:04.052784+0000","last_fullsized":"2023-08-17T00:17:04.052784+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.564089+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045593+0000","last_change":"2023-08-17T00:17:04.045593+0000","last_active":"2023-08-17T00:17:04.045593+0000","last_peered":"2023-08-17T00:17:04.045593+0000","last_clean":"2023-08-17T00:17:04.045593+0000","last_became_active":"2023-08-17T00:17:04.045320+0000","last_became_peered":"2023-08-17T00:17:04.045320+0000","last_unstale":"2023-08-17T00:17:04.045593+0000","last_undegraded":"2023-08-17T00:17:04.045593+0000","last_fullsized":"2023-08-17T00:17:04.045593+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1e","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.023391+0000","last_change":"2023-08-17T00:17:03.608379+0000","last_active":"2023-08-17T00:17:04.023391+0000","last_peered":"2023-08-17T00:17:04.023391+0000","last_clean":"2023-08-17T00:17:04.023391+0000","last_became_active":"2023-08-17T00:17:03.608068+0000","last_became_peered":"2023-08-17T00:17:03.608068+0000","last_unstale":"2023-08-17T00:17:04.023391+0000","last_undegraded":"2023-08-17T00:17:04.023391+0000","last_fullsized":"2023-08-17T00:17:04.023391+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581918+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:17:03.581918+0000","last_peered":"2023-08-17T00:17:03.581918+0000","last_clean":"2023-08-17T00:17:03.581918+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:17:03.581918+0000","last_undegraded":"2023-08-17T00:17:03.581918+0000","last_fullsized":"2023-08-17T00:17:03.581918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038193+0000","last_change":"2023-08-17T00:17:04.038193+0000","last_active":"2023-08-17T00:17:04.038193+0000","last_peered":"2023-08-17T00:17:04.038193+0000","last_clean":"2023-08-17T00:17:04.038193+0000","last_became_active":"2023-08-17T00:17:04.037874+0000","last_became_peered":"2023-08-17T00:17:04.037874+0000","last_unstale":"2023-08-17T00:17:04.038193+0000","last_undegraded":"2023-08-17T00:17:04.038193+0000","last_fullsized":"2023-08-17T00:17:04.038193+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1f","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034308+0000","last_change":"2023-08-17T00:17:03.605442+0000","last_active":"2023-08-17T00:17:04.034308+0000","last_peered":"2023-08-17T00:17:04.034308+0000","last_clean":"2023-08-17T00:17:04.034308+0000","last_became_active":"2023-08-17T00:17:03.605139+0000","last_became_peered":"2023-08-17T00:17:03.605139+0000","last_unstale":"2023-08-17T00:17:04.034308+0000","last_undegraded":"2023-08-17T00:17:04.034308+0000","last_fullsized":"2023-08-17T00:17:04.034308+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-17T00:16:59.656637+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:16:59.656637+0000","last_peered":"2023-08-17T00:16:59.656637+0000","last_clean":"2023-08-17T00:16:59.656637+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:16:59.656637+0000","last_undegraded":"2023-08-17T00:16:59.656637+0000","last_fullsized":"2023-08-17T00:16:59.656637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617366+0000","last_change":"2023-08-17T00:17:03.614980+0000","last_active":"2023-08-17T00:17:03.617366+0000","last_peered":"2023-08-17T00:17:03.617366+0000","last_clean":"2023-08-17T00:17:03.617366+0000","last_became_active":"2023-08-17T00:17:03.614675+0000","last_became_peered":"2023-08-17T00:17:03.614675+0000","last_unstale":"2023-08-17T00:17:03.617366+0000","last_undegraded":"2023-08-17T00:17:03.617366+0000","last_fullsized":"2023-08-17T00:17:03.617366+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.580971+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:17:03.580971+0000","last_peered":"2023-08-17T00:17:03.580971+0000","last_clean":"2023-08-17T00:17:03.580971+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:17:03.580971+0000","last_undegraded":"2023-08-17T00:17:03.580971+0000","last_fullsized":"2023-08-17T00:17:03.580971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042523+0000","last_change":"2023-08-17T00:17:04.042523+0000","last_active":"2023-08-17T00:17:04.042523+0000","last_peered":"2023-08-17T00:17:04.042523+0000","last_clean":"2023-08-17T00:17:04.042523+0000","last_became_active":"2023-08-17T00:17:04.042059+0000","last_became_peered":"2023-08-17T00:17:04.042059+0000","last_unstale":"2023-08-17T00:17:04.042523+0000","last_undegraded":"2023-08-17T00:17:04.042523+0000","last_fullsized":"2023-08-17T00:17:04.042523+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1d","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054171+0000","last_change":"2023-08-17T00:17:03.611041+0000","last_active":"2023-08-17T00:17:04.054171+0000","last_peered":"2023-08-17T00:17:04.054171+0000","last_clean":"2023-08-17T00:17:04.054171+0000","last_became_active":"2023-08-17T00:17:03.610638+0000","last_became_peered":"2023-08-17T00:17:03.610638+0000","last_unstale":"2023-08-17T00:17:04.054171+0000","last_undegraded":"2023-08-17T00:17:04.054171+0000","last_fullsized":"2023-08-17T00:17:04.054171+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.586419+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:17:03.586419+0000","last_peered":"2023-08-17T00:17:03.586419+0000","last_clean":"2023-08-17T00:17:03.586419+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:17:03.586419+0000","last_undegraded":"2023-08-17T00:17:03.586419+0000","last_fullsized":"2023-08-17T00:17:03.586419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045916+0000","last_change":"2023-08-17T00:17:04.045916+0000","last_active":"2023-08-17T00:17:04.045916+0000","last_peered":"2023-08-17T00:17:04.045916+0000","last_clean":"2023-08-17T00:17:04.045916+0000","last_became_active":"2023-08-17T00:17:04.045632+0000","last_became_peered":"2023-08-17T00:17:04.045632+0000","last_unstale":"2023-08-17T00:17:04.045916+0000","last_undegraded":"2023-08-17T00:17:04.045916+0000","last_fullsized":"2023-08-17T00:17:04.045916+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617603+0000","last_change":"2023-08-17T00:17:03.608444+0000","last_active":"2023-08-17T00:17:03.617603+0000","last_peered":"2023-08-17T00:17:03.617603+0000","last_clean":"2023-08-17T00:17:03.617603+0000","last_became_active":"2023-08-17T00:17:03.605953+0000","last_became_peered":"2023-08-17T00:17:03.605953+0000","last_unstale":"2023-08-17T00:17:03.617603+0000","last_undegraded":"2023-08-17T00:17:03.617603+0000","last_fullsized":"2023-08-17T00:17:03.617603+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581175+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:17:03.581175+0000","last_peered":"2023-08-17T00:17:03.581175+0000","last_clean":"2023-08-17T00:17:03.581175+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:17:03.581175+0000","last_undegraded":"2023-08-17T00:17:03.581175+0000","last_fullsized":"2023-08-17T00:17:03.581175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050181+0000","last_change":"2023-08-17T00:17:04.050181+0000","last_active":"2023-08-17T00:17:04.050181+0000","last_peered":"2023-08-17T00:17:04.050181+0000","last_clean":"2023-08-17T00:17:04.050181+0000","last_became_active":"2023-08-17T00:17:04.049847+0000","last_became_peered":"2023-08-17T00:17:04.049847+0000","last_unstale":"2023-08-17T00:17:04.050181+0000","last_undegraded":"2023-08-17T00:17:04.050181+0000","last_fullsized":"2023-08-17T00:17:04.050181+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613446+0000","last_change":"2023-08-17T00:17:03.607083+0000","last_active":"2023-08-17T00:17:03.613446+0000","last_peered":"2023-08-17T00:17:03.613446+0000","last_clean":"2023-08-17T00:17:03.613446+0000","last_became_active":"2023-08-17T00:17:03.606777+0000","last_became_peered":"2023-08-17T00:17:03.606777+0000","last_unstale":"2023-08-17T00:17:03.613446+0000","last_undegraded":"2023-08-17T00:17:03.613446+0000","last_fullsized":"2023-08-17T00:17:03.613446+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603188+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:17:03.603188+0000","last_peered":"2023-08-17T00:17:03.603188+0000","last_clean":"2023-08-17T00:17:03.603188+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:17:03.603188+0000","last_undegraded":"2023-08-17T00:17:03.603188+0000","last_fullsized":"2023-08-17T00:17:03.603188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040677+0000","last_change":"2023-08-17T00:17:04.040677+0000","last_active":"2023-08-17T00:17:04.040677+0000","last_peered":"2023-08-17T00:17:04.040677+0000","last_clean":"2023-08-17T00:17:04.040677+0000","last_became_active":"2023-08-17T00:17:04.040201+0000","last_became_peered":"2023-08-17T00:17:04.040201+0000","last_unstale":"2023-08-17T00:17:04.040677+0000","last_undegraded":"2023-08-17T00:17:04.040677+0000","last_fullsized":"2023-08-17T00:17:04.040677+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.612249+0000","last_change":"2023-08-17T00:17:03.607962+0000","last_active":"2023-08-17T00:17:03.612249+0000","last_peered":"2023-08-17T00:17:03.612249+0000","last_clean":"2023-08-17T00:17:03.612249+0000","last_became_active":"2023-08-17T00:17:03.607587+0000","last_became_peered":"2023-08-17T00:17:03.607587+0000","last_unstale":"2023-08-17T00:17:03.612249+0000","last_undegraded":"2023-08-17T00:17:03.612249+0000","last_fullsized":"2023-08-17T00:17:03.612249+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.580792+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:17:03.580792+0000","last_peered":"2023-08-17T00:17:03.580792+0000","last_clean":"2023-08-17T00:17:03.580792+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:17:03.580792+0000","last_undegraded":"2023-08-17T00:17:03.580792+0000","last_fullsized":"2023-08-17T00:17:03.580792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046586+0000","last_change":"2023-08-17T00:17:04.046586+0000","last_active":"2023-08-17T00:17:04.046586+0000","last_peered":"2023-08-17T00:17:04.046586+0000","last_clean":"2023-08-17T00:17:04.046586+0000","last_became_active":"2023-08-17T00:17:04.046283+0000","last_became_peered":"2023-08-17T00:17:04.046283+0000","last_unstale":"2023-08-17T00:17:04.046586+0000","last_undegraded":"2023-08-17T00:17:04.046586+0000","last_fullsized":"2023-08-17T00:17:04.046586+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617401+0000","last_change":"2023-08-17T00:17:03.615539+0000","last_active":"2023-08-17T00:17:03.617401+0000","last_peered":"2023-08-17T00:17:03.617401+0000","last_clean":"2023-08-17T00:17:03.617401+0000","last_became_active":"2023-08-17T00:17:03.615065+0000","last_became_peered":"2023-08-17T00:17:03.615065+0000","last_unstale":"2023-08-17T00:17:03.617401+0000","last_undegraded":"2023-08-17T00:17:03.617401+0000","last_fullsized":"2023-08-17T00:17:03.617401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581820+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:17:03.581820+0000","last_peered":"2023-08-17T00:17:03.581820+0000","last_clean":"2023-08-17T00:17:03.581820+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:17:03.581820+0000","last_undegraded":"2023-08-17T00:17:03.581820+0000","last_fullsized":"2023-08-17T00:17:03.581820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.588315+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:17:03.588315+0000","last_peered":"2023-08-17T00:17:03.588315+0000","last_clean":"2023-08-17T00:17:03.588315+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:17:03.588315+0000","last_undegraded":"2023-08-17T00:17:03.588315+0000","last_fullsized":"2023-08-17T00:17:03.588315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299580,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072260,"statfs":{"total":96636764160,"available":96329994240,"internally_reserved":0,"allocated":2412544,"data_stored":1130262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":1.054},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.871}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":1.151}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.2549999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.208},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":0.754}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.091},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":0.77800000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299556,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072284,"statfs":{"total":96636764160,"available":96330018816,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":6.2050000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":4.468}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":2.0870000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":3.5409999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":3.0569999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":2.4670000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":6.1660000000000004},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":8.4809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":5.2199999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":3.7519999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542319,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.143}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.409},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.272}]}]},{"osd":3,"up_from":14,"seq":60129542318,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2408448,"data_stored":1130780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.224}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.056}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.167}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.351},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.198}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.304}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.391},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.0149999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311844,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059996,"statfs":{"total":96636764160,"available":96317435904,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":1.165},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.044}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.159}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.347}]}]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307736,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064104,"statfs":{"total":96636764160,"available":96321642496,"internally_reserved":0,"allocated":2375680,"data_stored":1116278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.873,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.2789999999999999,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91800000000000004,"15min":0.91300000000000003},"min":{"1min":0.752,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.214,"5min":1.6200000000000001,"15min":13.093},"last":1.367}]},{"osd":2,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.2689999999999999,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0249999999999999,"15min":1.0129999999999999},"min":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.363,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.625}]},{"osd":4,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.0800000000000001,"15min":1.139},"min":{"1min":0.92600000000000005,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.552,"5min":1.671,"15min":20.548999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3,"5min":1.214,"15min":1.204},"min":{"1min":0.97399999999999998,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":1.1779999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.623,"5min":3.137,"15min":13.170999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.2270000000000001,"15min":1.236},"min":{"1min":1.0760000000000001,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.4510000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.95899999999999996,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.603,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.216,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5620000000000001,"5min":2.0150000000000001,"15min":5.5359999999999996},"last":1.222}]},{"osd":7,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.294,"15min":1.298},"min":{"1min":1.0409999999999999,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.675,"5min":3.1520000000000001,"15min":6.9779999999999998},"last":1.202},{"interface":"front","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.319},"min":{"1min":1.0229999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7230000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.167}]}]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311844,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059996,"statfs":{"total":96636764160,"available":96317435904,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":0.755}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":1.073},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":1.585}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":1.423},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":1.534}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.375}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307736,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064104,"statfs":{"total":96636764160,"available":96321642496,"internally_reserved":0,"allocated":2375680,"data_stored":1116278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":1.0600000000000001},"min":{"1min":0.77600000000000002,"5min":0.622,"15min":0.38300000000000001},"max":{"1min":1.4350000000000001,"5min":1.677,"15min":7.1379999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.345,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":1.117}]},{"osd":1,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1379999999999999,"15min":1.22},"min":{"1min":0.745,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.4039999999999999,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.181},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.153,"15min":1.216},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.732,"5min":1.732,"15min":6.9000000000000004},"last":1.252}]},{"osd":2,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.083,"15min":1.2130000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.4179999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.083,"15min":1.3089999999999999},"min":{"1min":0.91600000000000004,"5min":0.755,"15min":0.36699999999999999},"max":{"1min":1.5880000000000001,"5min":1.623,"15min":36.531999999999996},"last":1.036}]},{"osd":3,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.117},"min":{"1min":0.79300000000000004,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.522,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.175,"15min":1.3779999999999999},"min":{"1min":0.876,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.603,"5min":1.7569999999999999,"15min":36.530000000000001},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.24},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.466},{"interface":"front","average":{"1min":1.254,"5min":1.228,"15min":1.2829999999999999},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.633,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2390000000000001,"15min":1.3200000000000001},"min":{"1min":0.877,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.875,"15min":8.4190000000000005},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.321,"15min":1.369},"min":{"1min":1.032,"5min":0.77400000000000002,"15min":0.49399999999999999},"max":{"1min":1.8260000000000001,"5min":1.911,"15min":6.1689999999999996},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.222,"15min":1.248},"min":{"1min":0.83399999999999996,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.5249999999999999,"5min":3.645,"15min":3.645},"last":1.306},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3220000000000001,"15min":1.3879999999999999},"min":{"1min":1.0149999999999999,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.879,"5min":1.9690000000000001,"15min":8.327},"last":1.2689999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:17:08.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:17:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.887+0000 7f1b3dedb700 1 Processor -- start 2023-08-17T00:17:08.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.887+0000 7f1b3dedb700 1 -- start start 2023-08-17T00:17:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b3dedb700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b38151b90 0x7f1b38151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b3dedb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b38063290 0x7f1b38065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b3dedb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b38061fa0 con 0x7f1b38065b50 2023-08-17T00:17:08.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b3dedb700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b380c3fb0 con 0x7f1b38151b90 2023-08-17T00:17:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b3dedb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b38152460 con 0x7f1b38063290 2023-08-17T00:17:08.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b38151b90 0x7f1b38151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1b38151b90 0x7f1b38151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47068/0 (socket says 172.21.15.153:47068) 2023-08-17T00:17:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 -- 172.21.15.153:0/3949790161 learned_addr learned my addr 172.21.15.153:0/3949790161 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b36ffd700 1 --2- 172.21.15.153:0/3949790161 >> v2:172.21.15.178:3300/0 conn(0x7f1b38063290 0x7f1b38065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 -- 172.21.15.153:0/3949790161 >> v2:172.21.15.178:3300/0 conn(0x7f1b38063290 msgr2=0x7f1b38065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 --2- 172.21.15.153:0/3949790161 >> v2:172.21.15.178:3300/0 conn(0x7f1b38063290 0x7f1b38065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 -- 172.21.15.153:0/3949790161 >> v1:172.21.15.178:6789/0 conn(0x7f1b38065b50 legacy=0x7f1b38064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 -- 172.21.15.153:0/3949790161 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b380621f0 con 0x7f1b38151b90 2023-08-17T00:17:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b36ffd700 1 --2- 172.21.15.153:0/3949790161 >> v2:172.21.15.178:3300/0 conn(0x7f1b38063290 0x7f1b38065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:08.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b377fe700 1 --2- 172.21.15.153:0/3949790161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38151b90 0x7f1b38151f70 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f1b3805ebc0 tx=0x7f1b280090f0).ready entity=mon.0 client_cookie=b7afd78a9422f724 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.891+0000 7f1b367fc700 1 -- 172.21.15.153:0/3949790161 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800b600 con 0x7f1b38151b90 2023-08-17T00:17:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b367fc700 1 -- 172.21.15.153:0/3949790161 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2800b760 con 0x7f1b38151b90 2023-08-17T00:17:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b367fc700 1 -- 172.21.15.153:0/3949790161 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2800bae0 con 0x7f1b38151b90 2023-08-17T00:17:08.899 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 -- 172.21.15.153:0/3949790161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38151b90 msgr2=0x7f1b38151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/3949790161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38151b90 0x7f1b38151f70 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 rx=0x7f1b3805ebc0 tx=0x7f1b280090f0).stop 2023-08-17T00:17:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 -- 172.21.15.153:0/3949790161 shutdown_connections 2023-08-17T00:17:08.900 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/3949790161 >> v2:172.21.15.178:3300/0 conn(0x7f1b38063290 0x7f1b38065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/3949790161 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38151b90 0x7f1b38151f70 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 -- 172.21.15.153:0/3949790161 >> 172.21.15.153:0/3949790161 conn(0x7f1b380c7150 msgr2=0x7f1b380c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 -- 172.21.15.153:0/3949790161 shutdown_connections 2023-08-17T00:17:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.895+0000 7f1b3dedb700 1 -- 172.21.15.153:0/3949790161 wait complete. 2023-08-17T00:17:08.901 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 Processor -- start 2023-08-17T00:17:08.902 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 -- start start 2023-08-17T00:17:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b38063290 0x7f1b380bff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 0x7f1b381433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b38151b90 0x7f1b380c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.904 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38143cb0 con 0x7f1b38065b50 2023-08-17T00:17:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38153d20 con 0x7f1b38151b90 2023-08-17T00:17:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b3dedb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b38153110 con 0x7f1b38063290 2023-08-17T00:17:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 0x7f1b381433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 0x7f1b381433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47072/0 (socket says 172.21.15.153:47072) 2023-08-17T00:17:08.905 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 -- 172.21.15.153:0/4162598976 learned_addr learned my addr 172.21.15.153:0/4162598976 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b377fe700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b38063290 0x7f1b380bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.906 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b37fff700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b38151b90 0x7f1b380c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 -- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b38063290 msgr2=0x7f1b380bff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b38063290 0x7f1b380bff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 -- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b38151b90 msgr2=0x7f1b380c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b38151b90 0x7f1b380c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.899+0000 7f1b36ffd700 1 -- 172.21.15.153:0/4162598976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b28009370 con 0x7f1b38065b50 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b36ffd700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 0x7f1b381433d0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f1b2c00d860 tx=0x7f1b2c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.907 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c011590 con 0x7f1b38065b50 2023-08-17T00:17:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2c0116f0 con 0x7f1b38065b50 2023-08-17T00:17:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b381533f0 con 0x7f1b38065b50 2023-08-17T00:17:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c011a70 con 0x7f1b38065b50 2023-08-17T00:17:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b381539b0 con 0x7f1b38065b50 2023-08-17T00:17:08.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3806b530 con 0x7f1b38065b50 2023-08-17T00:17:08.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.903+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1b2c01c460 con 0x7f1b38065b50 2023-08-17T00:17:08.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.907+0000 7f1b1f7fe700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b2405a150 0x7f1b2405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:08.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.907+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b2c0740a0 con 0x7f1b38065b50 2023-08-17T00:17:08.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.907+0000 7f1b377fe700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b2405a150 0x7f1b2405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:08.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.907+0000 7f1b377fe700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b2405a150 0x7f1b2405c610 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f1b2800b3c0 tx=0x7f1b28017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:08.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:08.911+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b2c047af0 con 0x7f1b38065b50 2023-08-17T00:17:09.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.071+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b380624d0 con 0x7f1b2405a150 2023-08-17T00:17:09.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.087+0000 7f1b1f7fe700 1 -- 172.21.15.153:0/4162598976 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+358275 (secure 0 0 0) 0x7f1b380624d0 con 0x7f1b2405a150 2023-08-17T00:17:09.094 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:09.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b2405a150 msgr2=0x7f1b2405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b2405a150 0x7f1b2405c610 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f1b2800b3c0 tx=0x7f1b28017000).stop 2023-08-17T00:17:09.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 msgr2=0x7f1b381433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 0x7f1b381433d0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 rx=0x7f1b2c00d860 tx=0x7f1b2c008040).stop 2023-08-17T00:17:09.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 shutdown_connections 2023-08-17T00:17:09.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b2405a150 0x7f1b2405c610 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b38151b90 0x7f1b380c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b38065b50 0x7f1b381433d0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 --2- 172.21.15.153:0/4162598976 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b38063290 0x7f1b380bff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 >> 172.21.15.153:0/4162598976 conn(0x7f1b380c7150 msgr2=0x7f1b380a7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:09.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 shutdown_connections 2023-08-17T00:17:09.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.099+0000 7f1b3dedb700 1 -- 172.21.15.153:0/4162598976 wait complete. 2023-08-17T00:17:09.108 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:17:09.124 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":617,"stamp":"2023-08-17T00:17:07.502423+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453812,"kb_used_data":18676,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520908,"statfs":{"total":773094113280,"available":770581409792,"internally_reserved":0,"allocated":19124224,"data_stored":8985426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308502,"num_objects":-1024,"num_object_clones":0,"num_object_copies":-2048,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1024,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3064,"num_write_kb":-7684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-22,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.500712"},"pg_stats":[{"pgid":"28.38","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040967+0000","last_change":"2023-08-17T00:17:04.040967+0000","last_active":"2023-08-17T00:17:04.040967+0000","last_peered":"2023-08-17T00:17:04.040967+0000","last_clean":"2023-08-17T00:17:04.040967+0000","last_became_active":"2023-08-17T00:17:04.040675+0000","last_became_peered":"2023-08-17T00:17:04.040675+0000","last_unstale":"2023-08-17T00:17:04.040967+0000","last_undegraded":"2023-08-17T00:17:04.040967+0000","last_fullsized":"2023-08-17T00:17:04.040967+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"191'3","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055847+0000","last_change":"2023-08-17T00:17:03.602509+0000","last_active":"2023-08-17T00:17:04.055847+0000","last_peered":"2023-08-17T00:17:04.055847+0000","last_clean":"2023-08-17T00:17:04.055847+0000","last_became_active":"2023-08-17T00:17:03.600517+0000","last_became_peered":"2023-08-17T00:17:03.600517+0000","last_unstale":"2023-08-17T00:17:04.055847+0000","last_undegraded":"2023-08-17T00:17:04.055847+0000","last_fullsized":"2023-08-17T00:17:04.055847+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051198+0000","last_change":"2023-08-17T00:17:04.051198+0000","last_active":"2023-08-17T00:17:04.051198+0000","last_peered":"2023-08-17T00:17:04.051198+0000","last_clean":"2023-08-17T00:17:04.051198+0000","last_became_active":"2023-08-17T00:17:04.050838+0000","last_became_peered":"2023-08-17T00:17:04.050838+0000","last_unstale":"2023-08-17T00:17:04.051198+0000","last_undegraded":"2023-08-17T00:17:04.051198+0000","last_fullsized":"2023-08-17T00:17:04.051198+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607848+0000","last_change":"2023-08-17T00:17:03.604286+0000","last_active":"2023-08-17T00:17:03.607848+0000","last_peered":"2023-08-17T00:17:03.607848+0000","last_clean":"2023-08-17T00:17:03.607848+0000","last_became_active":"2023-08-17T00:17:03.603847+0000","last_became_peered":"2023-08-17T00:17:03.603847+0000","last_unstale":"2023-08-17T00:17:03.607848+0000","last_undegraded":"2023-08-17T00:17:03.607848+0000","last_fullsized":"2023-08-17T00:17:03.607848+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032945+0000","last_change":"2023-08-17T00:17:04.032945+0000","last_active":"2023-08-17T00:17:04.032945+0000","last_peered":"2023-08-17T00:17:04.032945+0000","last_clean":"2023-08-17T00:17:04.032945+0000","last_became_active":"2023-08-17T00:17:04.032690+0000","last_became_peered":"2023-08-17T00:17:04.032690+0000","last_unstale":"2023-08-17T00:17:04.032945+0000","last_undegraded":"2023-08-17T00:17:04.032945+0000","last_fullsized":"2023-08-17T00:17:04.032945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.616335+0000","last_change":"2023-08-17T00:17:03.610919+0000","last_active":"2023-08-17T00:17:03.616335+0000","last_peered":"2023-08-17T00:17:03.616335+0000","last_clean":"2023-08-17T00:17:03.616335+0000","last_became_active":"2023-08-17T00:17:03.610412+0000","last_became_peered":"2023-08-17T00:17:03.610412+0000","last_unstale":"2023-08-17T00:17:03.616335+0000","last_undegraded":"2023-08-17T00:17:03.616335+0000","last_fullsized":"2023-08-17T00:17:03.616335+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056564+0000","last_change":"2023-08-17T00:17:04.056564+0000","last_active":"2023-08-17T00:17:04.056564+0000","last_peered":"2023-08-17T00:17:04.056564+0000","last_clean":"2023-08-17T00:17:04.056564+0000","last_became_active":"2023-08-17T00:17:04.055878+0000","last_became_peered":"2023-08-17T00:17:04.055878+0000","last_unstale":"2023-08-17T00:17:04.056564+0000","last_undegraded":"2023-08-17T00:17:04.056564+0000","last_fullsized":"2023-08-17T00:17:04.056564+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3c","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052608+0000","last_change":"2023-08-17T00:17:03.607955+0000","last_active":"2023-08-17T00:17:04.052608+0000","last_peered":"2023-08-17T00:17:04.052608+0000","last_clean":"2023-08-17T00:17:04.052608+0000","last_became_active":"2023-08-17T00:17:03.605724+0000","last_became_peered":"2023-08-17T00:17:03.605724+0000","last_unstale":"2023-08-17T00:17:04.052608+0000","last_undegraded":"2023-08-17T00:17:04.052608+0000","last_fullsized":"2023-08-17T00:17:04.052608+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050546+0000","last_change":"2023-08-17T00:17:04.050546+0000","last_active":"2023-08-17T00:17:04.050546+0000","last_peered":"2023-08-17T00:17:04.050546+0000","last_clean":"2023-08-17T00:17:04.050546+0000","last_became_active":"2023-08-17T00:17:04.048601+0000","last_became_peered":"2023-08-17T00:17:04.048601+0000","last_unstale":"2023-08-17T00:17:04.050546+0000","last_undegraded":"2023-08-17T00:17:04.050546+0000","last_fullsized":"2023-08-17T00:17:04.050546+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039450+0000","last_change":"2023-08-17T00:17:03.609495+0000","last_active":"2023-08-17T00:17:04.039450+0000","last_peered":"2023-08-17T00:17:04.039450+0000","last_clean":"2023-08-17T00:17:04.039450+0000","last_became_active":"2023-08-17T00:17:03.609224+0000","last_became_peered":"2023-08-17T00:17:03.609224+0000","last_unstale":"2023-08-17T00:17:04.039450+0000","last_undegraded":"2023-08-17T00:17:04.039450+0000","last_fullsized":"2023-08-17T00:17:04.039450+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050914+0000","last_change":"2023-08-17T00:17:04.050914+0000","last_active":"2023-08-17T00:17:04.050914+0000","last_peered":"2023-08-17T00:17:04.050914+0000","last_clean":"2023-08-17T00:17:04.050914+0000","last_became_active":"2023-08-17T00:17:04.050552+0000","last_became_peered":"2023-08-17T00:17:04.050552+0000","last_unstale":"2023-08-17T00:17:04.050914+0000","last_undegraded":"2023-08-17T00:17:04.050914+0000","last_fullsized":"2023-08-17T00:17:04.050914+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3a","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028601+0000","last_change":"2023-08-17T00:17:03.592834+0000","last_active":"2023-08-17T00:17:04.028601+0000","last_peered":"2023-08-17T00:17:04.028601+0000","last_clean":"2023-08-17T00:17:04.028601+0000","last_became_active":"2023-08-17T00:17:03.592529+0000","last_became_peered":"2023-08-17T00:17:03.592529+0000","last_unstale":"2023-08-17T00:17:04.028601+0000","last_undegraded":"2023-08-17T00:17:04.028601+0000","last_fullsized":"2023-08-17T00:17:04.028601+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613512+0000","last_change":"2023-08-17T00:17:03.603048+0000","last_active":"2023-08-17T00:17:03.613512+0000","last_peered":"2023-08-17T00:17:03.613512+0000","last_clean":"2023-08-17T00:17:03.613512+0000","last_became_active":"2023-08-17T00:17:03.600931+0000","last_became_peered":"2023-08-17T00:17:03.600931+0000","last_unstale":"2023-08-17T00:17:03.613512+0000","last_undegraded":"2023-08-17T00:17:03.613512+0000","last_fullsized":"2023-08-17T00:17:03.613512+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.043639+0000","last_change":"2023-08-17T00:17:04.043639+0000","last_active":"2023-08-17T00:17:04.043639+0000","last_peered":"2023-08-17T00:17:04.043639+0000","last_clean":"2023-08-17T00:17:04.043639+0000","last_became_active":"2023-08-17T00:17:04.043074+0000","last_became_peered":"2023-08-17T00:17:04.043074+0000","last_unstale":"2023-08-17T00:17:04.043639+0000","last_undegraded":"2023-08-17T00:17:04.043639+0000","last_fullsized":"2023-08-17T00:17:04.043639+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.564705+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045697+0000","last_change":"2023-08-17T00:17:04.045697+0000","last_active":"2023-08-17T00:17:04.045697+0000","last_peered":"2023-08-17T00:17:04.045697+0000","last_clean":"2023-08-17T00:17:04.045697+0000","last_became_active":"2023-08-17T00:17:04.045400+0000","last_became_peered":"2023-08-17T00:17:04.045400+0000","last_unstale":"2023-08-17T00:17:04.045697+0000","last_undegraded":"2023-08-17T00:17:04.045697+0000","last_fullsized":"2023-08-17T00:17:04.045697+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.604216+0000","last_change":"2023-08-17T00:17:03.597710+0000","last_active":"2023-08-17T00:17:03.604216+0000","last_peered":"2023-08-17T00:17:03.604216+0000","last_clean":"2023-08-17T00:17:03.604216+0000","last_became_active":"2023-08-17T00:17:03.597376+0000","last_became_peered":"2023-08-17T00:17:03.597376+0000","last_unstale":"2023-08-17T00:17:03.604216+0000","last_undegraded":"2023-08-17T00:17:03.604216+0000","last_fullsized":"2023-08-17T00:17:03.604216+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058213+0000","last_change":"2023-08-17T00:17:04.058213+0000","last_active":"2023-08-17T00:17:04.058213+0000","last_peered":"2023-08-17T00:17:04.058213+0000","last_clean":"2023-08-17T00:17:04.058213+0000","last_became_active":"2023-08-17T00:17:04.057812+0000","last_became_peered":"2023-08-17T00:17:04.057812+0000","last_unstale":"2023-08-17T00:17:04.058213+0000","last_undegraded":"2023-08-17T00:17:04.058213+0000","last_fullsized":"2023-08-17T00:17:04.058213+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617346+0000","last_change":"2023-08-17T00:17:03.614190+0000","last_active":"2023-08-17T00:17:03.617346+0000","last_peered":"2023-08-17T00:17:03.617346+0000","last_clean":"2023-08-17T00:17:03.617346+0000","last_became_active":"2023-08-17T00:17:03.613882+0000","last_became_peered":"2023-08-17T00:17:03.613882+0000","last_unstale":"2023-08-17T00:17:03.617346+0000","last_undegraded":"2023-08-17T00:17:03.617346+0000","last_fullsized":"2023-08-17T00:17:03.617346+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040600+0000","last_change":"2023-08-17T00:17:04.040600+0000","last_active":"2023-08-17T00:17:04.040600+0000","last_peered":"2023-08-17T00:17:04.040600+0000","last_clean":"2023-08-17T00:17:04.040600+0000","last_became_active":"2023-08-17T00:17:04.040327+0000","last_became_peered":"2023-08-17T00:17:04.040327+0000","last_unstale":"2023-08-17T00:17:04.040600+0000","last_undegraded":"2023-08-17T00:17:04.040600+0000","last_fullsized":"2023-08-17T00:17:04.040600+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613478+0000","last_change":"2023-08-17T00:17:03.606219+0000","last_active":"2023-08-17T00:17:03.613478+0000","last_peered":"2023-08-17T00:17:03.613478+0000","last_clean":"2023-08-17T00:17:03.613478+0000","last_became_active":"2023-08-17T00:17:03.605882+0000","last_became_peered":"2023-08-17T00:17:03.605882+0000","last_unstale":"2023-08-17T00:17:03.613478+0000","last_undegraded":"2023-08-17T00:17:03.613478+0000","last_fullsized":"2023-08-17T00:17:03.613478+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056101+0000","last_change":"2023-08-17T00:17:04.056101+0000","last_active":"2023-08-17T00:17:04.056101+0000","last_peered":"2023-08-17T00:17:04.056101+0000","last_clean":"2023-08-17T00:17:04.056101+0000","last_became_active":"2023-08-17T00:17:04.055714+0000","last_became_peered":"2023-08-17T00:17:04.055714+0000","last_unstale":"2023-08-17T00:17:04.056101+0000","last_undegraded":"2023-08-17T00:17:04.056101+0000","last_fullsized":"2023-08-17T00:17:04.056101+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.043499+0000","last_change":"2023-08-17T00:17:03.604784+0000","last_active":"2023-08-17T00:17:04.043499+0000","last_peered":"2023-08-17T00:17:04.043499+0000","last_clean":"2023-08-17T00:17:04.043499+0000","last_became_active":"2023-08-17T00:17:03.604488+0000","last_became_peered":"2023-08-17T00:17:03.604488+0000","last_unstale":"2023-08-17T00:17:04.043499+0000","last_undegraded":"2023-08-17T00:17:04.043499+0000","last_fullsized":"2023-08-17T00:17:04.043499+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.33","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034467+0000","last_change":"2023-08-17T00:17:03.611509+0000","last_active":"2023-08-17T00:17:04.034467+0000","last_peered":"2023-08-17T00:17:04.034467+0000","last_clean":"2023-08-17T00:17:04.034467+0000","last_became_active":"2023-08-17T00:17:03.610877+0000","last_became_peered":"2023-08-17T00:17:03.610877+0000","last_unstale":"2023-08-17T00:17:04.034467+0000","last_undegraded":"2023-08-17T00:17:04.034467+0000","last_fullsized":"2023-08-17T00:17:04.034467+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048382+0000","last_change":"2023-08-17T00:17:04.048382+0000","last_active":"2023-08-17T00:17:04.048382+0000","last_peered":"2023-08-17T00:17:04.048382+0000","last_clean":"2023-08-17T00:17:04.048382+0000","last_became_active":"2023-08-17T00:17:04.048079+0000","last_became_peered":"2023-08-17T00:17:04.048079+0000","last_unstale":"2023-08-17T00:17:04.048382+0000","last_undegraded":"2023-08-17T00:17:04.048382+0000","last_fullsized":"2023-08-17T00:17:04.048382+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.610430+0000","last_change":"2023-08-17T00:17:03.609075+0000","last_active":"2023-08-17T00:17:03.610430+0000","last_peered":"2023-08-17T00:17:03.610430+0000","last_clean":"2023-08-17T00:17:03.610430+0000","last_became_active":"2023-08-17T00:17:03.608809+0000","last_became_peered":"2023-08-17T00:17:03.608809+0000","last_unstale":"2023-08-17T00:17:03.610430+0000","last_undegraded":"2023-08-17T00:17:03.610430+0000","last_fullsized":"2023-08-17T00:17:03.610430+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038159+0000","last_change":"2023-08-17T00:17:04.038159+0000","last_active":"2023-08-17T00:17:04.038159+0000","last_peered":"2023-08-17T00:17:04.038159+0000","last_clean":"2023-08-17T00:17:04.038159+0000","last_became_active":"2023-08-17T00:17:04.037825+0000","last_became_peered":"2023-08-17T00:17:04.037825+0000","last_unstale":"2023-08-17T00:17:04.038159+0000","last_undegraded":"2023-08-17T00:17:04.038159+0000","last_fullsized":"2023-08-17T00:17:04.038159+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603144+0000","last_change":"2023-08-17T00:17:03.597502+0000","last_active":"2023-08-17T00:17:03.603144+0000","last_peered":"2023-08-17T00:17:03.603144+0000","last_clean":"2023-08-17T00:17:03.603144+0000","last_became_active":"2023-08-17T00:17:03.597168+0000","last_became_peered":"2023-08-17T00:17:03.597168+0000","last_unstale":"2023-08-17T00:17:03.603144+0000","last_undegraded":"2023-08-17T00:17:03.603144+0000","last_fullsized":"2023-08-17T00:17:03.603144+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048095+0000","last_change":"2023-08-17T00:17:04.048095+0000","last_active":"2023-08-17T00:17:04.048095+0000","last_peered":"2023-08-17T00:17:04.048095+0000","last_clean":"2023-08-17T00:17:04.048095+0000","last_became_active":"2023-08-17T00:17:04.047658+0000","last_became_peered":"2023-08-17T00:17:04.047658+0000","last_unstale":"2023-08-17T00:17:04.048095+0000","last_undegraded":"2023-08-17T00:17:04.048095+0000","last_fullsized":"2023-08-17T00:17:04.048095+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.30","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055789+0000","last_change":"2023-08-17T00:17:03.600911+0000","last_active":"2023-08-17T00:17:04.055789+0000","last_peered":"2023-08-17T00:17:04.055789+0000","last_clean":"2023-08-17T00:17:04.055789+0000","last_became_active":"2023-08-17T00:17:03.600488+0000","last_became_peered":"2023-08-17T00:17:03.600488+0000","last_unstale":"2023-08-17T00:17:04.055789+0000","last_undegraded":"2023-08-17T00:17:04.055789+0000","last_fullsized":"2023-08-17T00:17:04.055789+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056919+0000","last_change":"2023-08-17T00:17:04.056919+0000","last_active":"2023-08-17T00:17:04.056919+0000","last_peered":"2023-08-17T00:17:04.056919+0000","last_clean":"2023-08-17T00:17:04.056919+0000","last_became_active":"2023-08-17T00:17:04.056440+0000","last_became_peered":"2023-08-17T00:17:04.056440+0000","last_unstale":"2023-08-17T00:17:04.056919+0000","last_undegraded":"2023-08-17T00:17:04.056919+0000","last_fullsized":"2023-08-17T00:17:04.056919+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.614822+0000","last_change":"2023-08-17T00:17:03.609894+0000","last_active":"2023-08-17T00:17:03.614822+0000","last_peered":"2023-08-17T00:17:03.614822+0000","last_clean":"2023-08-17T00:17:03.614822+0000","last_became_active":"2023-08-17T00:17:03.609602+0000","last_became_peered":"2023-08-17T00:17:03.609602+0000","last_unstale":"2023-08-17T00:17:03.614822+0000","last_undegraded":"2023-08-17T00:17:03.614822+0000","last_fullsized":"2023-08-17T00:17:03.614822+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050491+0000","last_change":"2023-08-17T00:17:04.050491+0000","last_active":"2023-08-17T00:17:04.050491+0000","last_peered":"2023-08-17T00:17:04.050491+0000","last_clean":"2023-08-17T00:17:04.050491+0000","last_became_active":"2023-08-17T00:17:04.050001+0000","last_became_peered":"2023-08-17T00:17:04.050001+0000","last_unstale":"2023-08-17T00:17:04.050491+0000","last_undegraded":"2023-08-17T00:17:04.050491+0000","last_fullsized":"2023-08-17T00:17:04.050491+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.616455+0000","last_change":"2023-08-17T00:17:03.611855+0000","last_active":"2023-08-17T00:17:03.616455+0000","last_peered":"2023-08-17T00:17:03.616455+0000","last_clean":"2023-08-17T00:17:03.616455+0000","last_became_active":"2023-08-17T00:17:03.611566+0000","last_became_peered":"2023-08-17T00:17:03.611566+0000","last_unstale":"2023-08-17T00:17:03.616455+0000","last_undegraded":"2023-08-17T00:17:03.616455+0000","last_fullsized":"2023-08-17T00:17:03.616455+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049971+0000","last_change":"2023-08-17T00:17:04.049971+0000","last_active":"2023-08-17T00:17:04.049971+0000","last_peered":"2023-08-17T00:17:04.049971+0000","last_clean":"2023-08-17T00:17:04.049971+0000","last_became_active":"2023-08-17T00:17:04.049710+0000","last_became_peered":"2023-08-17T00:17:04.049710+0000","last_unstale":"2023-08-17T00:17:04.049971+0000","last_undegraded":"2023-08-17T00:17:04.049971+0000","last_fullsized":"2023-08-17T00:17:04.049971+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2d","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040966+0000","last_change":"2023-08-17T00:17:03.611104+0000","last_active":"2023-08-17T00:17:04.040966+0000","last_peered":"2023-08-17T00:17:04.040966+0000","last_clean":"2023-08-17T00:17:04.040966+0000","last_became_active":"2023-08-17T00:17:03.610764+0000","last_became_peered":"2023-08-17T00:17:03.610764+0000","last_unstale":"2023-08-17T00:17:04.040966+0000","last_undegraded":"2023-08-17T00:17:04.040966+0000","last_fullsized":"2023-08-17T00:17:04.040966+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054835+0000","last_change":"2023-08-17T00:17:04.054835+0000","last_active":"2023-08-17T00:17:04.054835+0000","last_peered":"2023-08-17T00:17:04.054835+0000","last_clean":"2023-08-17T00:17:04.054835+0000","last_became_active":"2023-08-17T00:17:04.054587+0000","last_became_peered":"2023-08-17T00:17:04.054587+0000","last_unstale":"2023-08-17T00:17:04.054835+0000","last_undegraded":"2023-08-17T00:17:04.054835+0000","last_fullsized":"2023-08-17T00:17:04.054835+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617261+0000","last_change":"2023-08-17T00:17:03.612980+0000","last_active":"2023-08-17T00:17:03.617261+0000","last_peered":"2023-08-17T00:17:03.617261+0000","last_clean":"2023-08-17T00:17:03.617261+0000","last_became_active":"2023-08-17T00:17:03.612688+0000","last_became_peered":"2023-08-17T00:17:03.612688+0000","last_unstale":"2023-08-17T00:17:03.617261+0000","last_undegraded":"2023-08-17T00:17:03.617261+0000","last_fullsized":"2023-08-17T00:17:03.617261+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055847+0000","last_change":"2023-08-17T00:17:04.055847+0000","last_active":"2023-08-17T00:17:04.055847+0000","last_peered":"2023-08-17T00:17:04.055847+0000","last_clean":"2023-08-17T00:17:04.055847+0000","last_became_active":"2023-08-17T00:17:04.051524+0000","last_became_peered":"2023-08-17T00:17:04.051524+0000","last_unstale":"2023-08-17T00:17:04.055847+0000","last_undegraded":"2023-08-17T00:17:04.055847+0000","last_fullsized":"2023-08-17T00:17:04.055847+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022175+0000","last_change":"2023-08-17T00:17:03.606708+0000","last_active":"2023-08-17T00:17:04.022175+0000","last_peered":"2023-08-17T00:17:04.022175+0000","last_clean":"2023-08-17T00:17:04.022175+0000","last_became_active":"2023-08-17T00:17:03.606429+0000","last_became_peered":"2023-08-17T00:17:03.606429+0000","last_unstale":"2023-08-17T00:17:04.022175+0000","last_undegraded":"2023-08-17T00:17:04.022175+0000","last_fullsized":"2023-08-17T00:17:04.022175+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050797+0000","last_change":"2023-08-17T00:17:04.050797+0000","last_active":"2023-08-17T00:17:04.050797+0000","last_peered":"2023-08-17T00:17:04.050797+0000","last_clean":"2023-08-17T00:17:04.050797+0000","last_became_active":"2023-08-17T00:17:04.050543+0000","last_became_peered":"2023-08-17T00:17:04.050543+0000","last_unstale":"2023-08-17T00:17:04.050797+0000","last_undegraded":"2023-08-17T00:17:04.050797+0000","last_fullsized":"2023-08-17T00:17:04.050797+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.600754+0000","last_change":"2023-08-17T00:17:03.597621+0000","last_active":"2023-08-17T00:17:03.600754+0000","last_peered":"2023-08-17T00:17:03.600754+0000","last_clean":"2023-08-17T00:17:03.600754+0000","last_became_active":"2023-08-17T00:17:03.597317+0000","last_became_peered":"2023-08-17T00:17:03.597317+0000","last_unstale":"2023-08-17T00:17:03.600754+0000","last_undegraded":"2023-08-17T00:17:03.600754+0000","last_fullsized":"2023-08-17T00:17:03.600754+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603854+0000","last_change":"2023-08-17T00:17:03.599495+0000","last_active":"2023-08-17T00:17:03.603854+0000","last_peered":"2023-08-17T00:17:03.603854+0000","last_clean":"2023-08-17T00:17:03.603854+0000","last_became_active":"2023-08-17T00:17:03.599051+0000","last_became_peered":"2023-08-17T00:17:03.599051+0000","last_unstale":"2023-08-17T00:17:03.603854+0000","last_undegraded":"2023-08-17T00:17:03.603854+0000","last_fullsized":"2023-08-17T00:17:03.603854+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040949+0000","last_change":"2023-08-17T00:17:04.040949+0000","last_active":"2023-08-17T00:17:04.040949+0000","last_peered":"2023-08-17T00:17:04.040949+0000","last_clean":"2023-08-17T00:17:04.040949+0000","last_became_active":"2023-08-17T00:17:04.040663+0000","last_became_peered":"2023-08-17T00:17:04.040663+0000","last_unstale":"2023-08-17T00:17:04.040949+0000","last_undegraded":"2023-08-17T00:17:04.040949+0000","last_fullsized":"2023-08-17T00:17:04.040949+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607214+0000","last_change":"2023-08-17T00:17:03.601055+0000","last_active":"2023-08-17T00:17:03.607214+0000","last_peered":"2023-08-17T00:17:03.607214+0000","last_clean":"2023-08-17T00:17:03.607214+0000","last_became_active":"2023-08-17T00:17:03.600760+0000","last_became_peered":"2023-08-17T00:17:03.600760+0000","last_unstale":"2023-08-17T00:17:03.607214+0000","last_undegraded":"2023-08-17T00:17:03.607214+0000","last_fullsized":"2023-08-17T00:17:03.607214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042770+0000","last_change":"2023-08-17T00:17:04.042770+0000","last_active":"2023-08-17T00:17:04.042770+0000","last_peered":"2023-08-17T00:17:04.042770+0000","last_clean":"2023-08-17T00:17:04.042770+0000","last_became_active":"2023-08-17T00:17:04.042363+0000","last_became_peered":"2023-08-17T00:17:04.042363+0000","last_unstale":"2023-08-17T00:17:04.042770+0000","last_undegraded":"2023-08-17T00:17:04.042770+0000","last_fullsized":"2023-08-17T00:17:04.042770+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617826+0000","last_change":"2023-08-17T00:17:03.610988+0000","last_active":"2023-08-17T00:17:03.617826+0000","last_peered":"2023-08-17T00:17:03.617826+0000","last_clean":"2023-08-17T00:17:03.617826+0000","last_became_active":"2023-08-17T00:17:03.609830+0000","last_became_peered":"2023-08-17T00:17:03.609830+0000","last_unstale":"2023-08-17T00:17:03.617826+0000","last_undegraded":"2023-08-17T00:17:03.617826+0000","last_fullsized":"2023-08-17T00:17:03.617826+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052392+0000","last_change":"2023-08-17T00:17:04.052392+0000","last_active":"2023-08-17T00:17:04.052392+0000","last_peered":"2023-08-17T00:17:04.052392+0000","last_clean":"2023-08-17T00:17:04.052392+0000","last_became_active":"2023-08-17T00:17:04.052134+0000","last_became_peered":"2023-08-17T00:17:04.052134+0000","last_unstale":"2023-08-17T00:17:04.052392+0000","last_undegraded":"2023-08-17T00:17:04.052392+0000","last_fullsized":"2023-08-17T00:17:04.052392+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563951+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035061+0000","last_change":"2023-08-17T00:17:04.035061+0000","last_active":"2023-08-17T00:17:04.035061+0000","last_peered":"2023-08-17T00:17:04.035061+0000","last_clean":"2023-08-17T00:17:04.035061+0000","last_became_active":"2023-08-17T00:17:04.034776+0000","last_became_peered":"2023-08-17T00:17:04.034776+0000","last_unstale":"2023-08-17T00:17:04.035061+0000","last_undegraded":"2023-08-17T00:17:04.035061+0000","last_fullsized":"2023-08-17T00:17:04.035061+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.612779+0000","last_change":"2023-08-17T00:17:03.607437+0000","last_active":"2023-08-17T00:17:03.612779+0000","last_peered":"2023-08-17T00:17:03.612779+0000","last_clean":"2023-08-17T00:17:03.612779+0000","last_became_active":"2023-08-17T00:17:03.603660+0000","last_became_peered":"2023-08-17T00:17:03.603660+0000","last_unstale":"2023-08-17T00:17:03.612779+0000","last_undegraded":"2023-08-17T00:17:03.612779+0000","last_fullsized":"2023-08-17T00:17:03.612779+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563287+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.600610+0000","last_change":"2023-08-17T00:17:03.597907+0000","last_active":"2023-08-17T00:17:03.600610+0000","last_peered":"2023-08-17T00:17:03.600610+0000","last_clean":"2023-08-17T00:17:03.600610+0000","last_became_active":"2023-08-17T00:17:03.597644+0000","last_became_peered":"2023-08-17T00:17:03.597644+0000","last_unstale":"2023-08-17T00:17:03.600610+0000","last_undegraded":"2023-08-17T00:17:03.600610+0000","last_fullsized":"2023-08-17T00:17:03.600610+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056716+0000","last_change":"2023-08-17T00:17:04.056716+0000","last_active":"2023-08-17T00:17:04.056716+0000","last_peered":"2023-08-17T00:17:04.056716+0000","last_clean":"2023-08-17T00:17:04.056716+0000","last_became_active":"2023-08-17T00:17:04.055773+0000","last_became_peered":"2023-08-17T00:17:04.055773+0000","last_unstale":"2023-08-17T00:17:04.056716+0000","last_undegraded":"2023-08-17T00:17:04.056716+0000","last_fullsized":"2023-08-17T00:17:04.056716+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617889+0000","last_change":"2023-08-17T00:17:03.611346+0000","last_active":"2023-08-17T00:17:03.617889+0000","last_peered":"2023-08-17T00:17:03.617889+0000","last_clean":"2023-08-17T00:17:03.617889+0000","last_became_active":"2023-08-17T00:17:03.611004+0000","last_became_peered":"2023-08-17T00:17:03.611004+0000","last_unstale":"2023-08-17T00:17:03.617889+0000","last_undegraded":"2023-08-17T00:17:03.617889+0000","last_fullsized":"2023-08-17T00:17:03.617889+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048187+0000","last_change":"2023-08-17T00:17:04.048187+0000","last_active":"2023-08-17T00:17:04.048187+0000","last_peered":"2023-08-17T00:17:04.048187+0000","last_clean":"2023-08-17T00:17:04.048187+0000","last_became_active":"2023-08-17T00:17:04.047889+0000","last_became_peered":"2023-08-17T00:17:04.047889+0000","last_unstale":"2023-08-17T00:17:04.048187+0000","last_undegraded":"2023-08-17T00:17:04.048187+0000","last_fullsized":"2023-08-17T00:17:04.048187+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617311+0000","last_change":"2023-08-17T00:17:03.613617+0000","last_active":"2023-08-17T00:17:03.617311+0000","last_peered":"2023-08-17T00:17:03.617311+0000","last_clean":"2023-08-17T00:17:03.617311+0000","last_became_active":"2023-08-17T00:17:03.612763+0000","last_became_peered":"2023-08-17T00:17:03.612763+0000","last_unstale":"2023-08-17T00:17:03.617311+0000","last_undegraded":"2023-08-17T00:17:03.617311+0000","last_fullsized":"2023-08-17T00:17:03.617311+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049571+0000","last_change":"2023-08-17T00:17:04.049571+0000","last_active":"2023-08-17T00:17:04.049571+0000","last_peered":"2023-08-17T00:17:04.049571+0000","last_clean":"2023-08-17T00:17:04.049571+0000","last_became_active":"2023-08-17T00:17:04.049298+0000","last_became_peered":"2023-08-17T00:17:04.049298+0000","last_unstale":"2023-08-17T00:17:04.049571+0000","last_undegraded":"2023-08-17T00:17:04.049571+0000","last_fullsized":"2023-08-17T00:17:04.049571+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.601713+0000","last_change":"2023-08-17T00:17:03.596004+0000","last_active":"2023-08-17T00:17:03.601713+0000","last_peered":"2023-08-17T00:17:03.601713+0000","last_clean":"2023-08-17T00:17:03.601713+0000","last_became_active":"2023-08-17T00:17:03.595679+0000","last_became_peered":"2023-08-17T00:17:03.595679+0000","last_unstale":"2023-08-17T00:17:03.601713+0000","last_undegraded":"2023-08-17T00:17:03.601713+0000","last_fullsized":"2023-08-17T00:17:03.601713+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045491+0000","last_change":"2023-08-17T00:17:04.045491+0000","last_active":"2023-08-17T00:17:04.045491+0000","last_peered":"2023-08-17T00:17:04.045491+0000","last_clean":"2023-08-17T00:17:04.045491+0000","last_became_active":"2023-08-17T00:17:04.044996+0000","last_became_peered":"2023-08-17T00:17:04.044996+0000","last_unstale":"2023-08-17T00:17:04.045491+0000","last_undegraded":"2023-08-17T00:17:04.045491+0000","last_fullsized":"2023-08-17T00:17:04.045491+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602324+0000","last_change":"2023-08-17T00:17:03.596073+0000","last_active":"2023-08-17T00:17:03.602324+0000","last_peered":"2023-08-17T00:17:03.602324+0000","last_clean":"2023-08-17T00:17:03.602324+0000","last_became_active":"2023-08-17T00:17:03.595733+0000","last_became_peered":"2023-08-17T00:17:03.595733+0000","last_unstale":"2023-08-17T00:17:03.602324+0000","last_undegraded":"2023-08-17T00:17:03.602324+0000","last_fullsized":"2023-08-17T00:17:03.602324+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045670+0000","last_change":"2023-08-17T00:17:04.045670+0000","last_active":"2023-08-17T00:17:04.045670+0000","last_peered":"2023-08-17T00:17:04.045670+0000","last_clean":"2023-08-17T00:17:04.045670+0000","last_became_active":"2023-08-17T00:17:04.045375+0000","last_became_peered":"2023-08-17T00:17:04.045375+0000","last_unstale":"2023-08-17T00:17:04.045670+0000","last_undegraded":"2023-08-17T00:17:04.045670+0000","last_fullsized":"2023-08-17T00:17:04.045670+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617765+0000","last_change":"2023-08-17T00:17:03.609853+0000","last_active":"2023-08-17T00:17:03.617765+0000","last_peered":"2023-08-17T00:17:03.617765+0000","last_clean":"2023-08-17T00:17:03.617765+0000","last_became_active":"2023-08-17T00:17:03.609486+0000","last_became_peered":"2023-08-17T00:17:03.609486+0000","last_unstale":"2023-08-17T00:17:03.617765+0000","last_undegraded":"2023-08-17T00:17:03.617765+0000","last_fullsized":"2023-08-17T00:17:03.617765+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056410+0000","last_change":"2023-08-17T00:17:04.056410+0000","last_active":"2023-08-17T00:17:04.056410+0000","last_peered":"2023-08-17T00:17:04.056410+0000","last_clean":"2023-08-17T00:17:04.056410+0000","last_became_active":"2023-08-17T00:17:04.056085+0000","last_became_peered":"2023-08-17T00:17:04.056085+0000","last_unstale":"2023-08-17T00:17:04.056410+0000","last_undegraded":"2023-08-17T00:17:04.056410+0000","last_fullsized":"2023-08-17T00:17:04.056410+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.563201+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056552+0000","last_change":"2023-08-17T00:17:04.056552+0000","last_active":"2023-08-17T00:17:04.056552+0000","last_peered":"2023-08-17T00:17:04.056552+0000","last_clean":"2023-08-17T00:17:04.056552+0000","last_became_active":"2023-08-17T00:17:04.055842+0000","last_became_peered":"2023-08-17T00:17:04.055842+0000","last_unstale":"2023-08-17T00:17:04.056552+0000","last_undegraded":"2023-08-17T00:17:04.056552+0000","last_fullsized":"2023-08-17T00:17:04.056552+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.14","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056273+0000","last_change":"2023-08-17T00:17:03.600325+0000","last_active":"2023-08-17T00:17:04.056273+0000","last_peered":"2023-08-17T00:17:04.056273+0000","last_clean":"2023-08-17T00:17:04.056273+0000","last_became_active":"2023-08-17T00:17:03.600007+0000","last_became_peered":"2023-08-17T00:17:03.600007+0000","last_unstale":"2023-08-17T00:17:04.056273+0000","last_undegraded":"2023-08-17T00:17:04.056273+0000","last_fullsized":"2023-08-17T00:17:04.056273+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.033044+0000","last_change":"2023-08-17T00:17:04.033044+0000","last_active":"2023-08-17T00:17:04.033044+0000","last_peered":"2023-08-17T00:17:04.033044+0000","last_clean":"2023-08-17T00:17:04.033044+0000","last_became_active":"2023-08-17T00:17:04.032572+0000","last_became_peered":"2023-08-17T00:17:04.032572+0000","last_unstale":"2023-08-17T00:17:04.033044+0000","last_undegraded":"2023-08-17T00:17:04.033044+0000","last_fullsized":"2023-08-17T00:17:04.033044+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.13","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039535+0000","last_change":"2023-08-17T00:17:03.611763+0000","last_active":"2023-08-17T00:17:04.039535+0000","last_peered":"2023-08-17T00:17:04.039535+0000","last_clean":"2023-08-17T00:17:04.039535+0000","last_became_active":"2023-08-17T00:17:03.611425+0000","last_became_peered":"2023-08-17T00:17:03.611425+0000","last_unstale":"2023-08-17T00:17:04.039535+0000","last_undegraded":"2023-08-17T00:17:04.039535+0000","last_fullsized":"2023-08-17T00:17:04.039535+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050251+0000","last_change":"2023-08-17T00:17:04.050251+0000","last_active":"2023-08-17T00:17:04.050251+0000","last_peered":"2023-08-17T00:17:04.050251+0000","last_clean":"2023-08-17T00:17:04.050251+0000","last_became_active":"2023-08-17T00:17:04.049738+0000","last_became_peered":"2023-08-17T00:17:04.049738+0000","last_unstale":"2023-08-17T00:17:04.050251+0000","last_undegraded":"2023-08-17T00:17:04.050251+0000","last_fullsized":"2023-08-17T00:17:04.050251+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602708+0000","last_change":"2023-08-17T00:17:03.600255+0000","last_active":"2023-08-17T00:17:03.602708+0000","last_peered":"2023-08-17T00:17:03.602708+0000","last_clean":"2023-08-17T00:17:03.602708+0000","last_became_active":"2023-08-17T00:17:03.599911+0000","last_became_peered":"2023-08-17T00:17:03.599911+0000","last_unstale":"2023-08-17T00:17:03.602708+0000","last_undegraded":"2023-08-17T00:17:03.602708+0000","last_fullsized":"2023-08-17T00:17:03.602708+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613531+0000","last_change":"2023-08-17T00:17:03.604322+0000","last_active":"2023-08-17T00:17:03.613531+0000","last_peered":"2023-08-17T00:17:03.613531+0000","last_clean":"2023-08-17T00:17:03.613531+0000","last_became_active":"2023-08-17T00:17:03.603995+0000","last_became_peered":"2023-08-17T00:17:03.603995+0000","last_unstale":"2023-08-17T00:17:03.613531+0000","last_undegraded":"2023-08-17T00:17:03.613531+0000","last_fullsized":"2023-08-17T00:17:03.613531+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053850+0000","last_change":"2023-08-17T00:17:04.053850+0000","last_active":"2023-08-17T00:17:04.053850+0000","last_peered":"2023-08-17T00:17:04.053850+0000","last_clean":"2023-08-17T00:17:04.053850+0000","last_became_active":"2023-08-17T00:17:04.053597+0000","last_became_peered":"2023-08-17T00:17:04.053597+0000","last_unstale":"2023-08-17T00:17:04.053850+0000","last_undegraded":"2023-08-17T00:17:04.053850+0000","last_fullsized":"2023-08-17T00:17:04.053850+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"191'4","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047575+0000","last_change":"2023-08-17T00:17:03.606608+0000","last_active":"2023-08-17T00:17:04.047575+0000","last_peered":"2023-08-17T00:17:04.047575+0000","last_clean":"2023-08-17T00:17:04.047575+0000","last_became_active":"2023-08-17T00:17:03.606317+0000","last_became_peered":"2023-08-17T00:17:03.606317+0000","last_unstale":"2023-08-17T00:17:04.047575+0000","last_undegraded":"2023-08-17T00:17:04.047575+0000","last_fullsized":"2023-08-17T00:17:04.047575+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042596+0000","last_change":"2023-08-17T00:17:04.042596+0000","last_active":"2023-08-17T00:17:04.042596+0000","last_peered":"2023-08-17T00:17:04.042596+0000","last_clean":"2023-08-17T00:17:04.042596+0000","last_became_active":"2023-08-17T00:17:04.042057+0000","last_became_peered":"2023-08-17T00:17:04.042057+0000","last_unstale":"2023-08-17T00:17:04.042596+0000","last_undegraded":"2023-08-17T00:17:04.042596+0000","last_fullsized":"2023-08-17T00:17:04.042596+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034398+0000","last_change":"2023-08-17T00:17:03.608573+0000","last_active":"2023-08-17T00:17:04.034398+0000","last_peered":"2023-08-17T00:17:04.034398+0000","last_clean":"2023-08-17T00:17:04.034398+0000","last_became_active":"2023-08-17T00:17:03.608193+0000","last_became_peered":"2023-08-17T00:17:03.608193+0000","last_unstale":"2023-08-17T00:17:04.034398+0000","last_undegraded":"2023-08-17T00:17:04.034398+0000","last_fullsized":"2023-08-17T00:17:04.034398+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053237+0000","last_change":"2023-08-17T00:17:04.053237+0000","last_active":"2023-08-17T00:17:04.053237+0000","last_peered":"2023-08-17T00:17:04.053237+0000","last_clean":"2023-08-17T00:17:04.053237+0000","last_became_active":"2023-08-17T00:17:04.052979+0000","last_became_peered":"2023-08-17T00:17:04.052979+0000","last_unstale":"2023-08-17T00:17:04.053237+0000","last_undegraded":"2023-08-17T00:17:04.053237+0000","last_fullsized":"2023-08-17T00:17:04.053237+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.e","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047976+0000","last_change":"2023-08-17T00:17:03.604251+0000","last_active":"2023-08-17T00:17:04.047976+0000","last_peered":"2023-08-17T00:17:04.047976+0000","last_clean":"2023-08-17T00:17:04.047976+0000","last_became_active":"2023-08-17T00:17:03.603083+0000","last_became_peered":"2023-08-17T00:17:03.603083+0000","last_unstale":"2023-08-17T00:17:04.047976+0000","last_undegraded":"2023-08-17T00:17:04.047976+0000","last_fullsized":"2023-08-17T00:17:04.047976+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047137+0000","last_change":"2023-08-17T00:17:04.047137+0000","last_active":"2023-08-17T00:17:04.047137+0000","last_peered":"2023-08-17T00:17:04.047137+0000","last_clean":"2023-08-17T00:17:04.047137+0000","last_became_active":"2023-08-17T00:17:04.046858+0000","last_became_peered":"2023-08-17T00:17:04.046858+0000","last_unstale":"2023-08-17T00:17:04.047137+0000","last_undegraded":"2023-08-17T00:17:04.047137+0000","last_fullsized":"2023-08-17T00:17:04.047137+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.608668+0000","last_change":"2023-08-17T00:17:03.601090+0000","last_active":"2023-08-17T00:17:03.608668+0000","last_peered":"2023-08-17T00:17:03.608668+0000","last_clean":"2023-08-17T00:17:03.608668+0000","last_became_active":"2023-08-17T00:17:03.600472+0000","last_became_peered":"2023-08-17T00:17:03.600472+0000","last_unstale":"2023-08-17T00:17:03.608668+0000","last_undegraded":"2023-08-17T00:17:03.608668+0000","last_fullsized":"2023-08-17T00:17:03.608668+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056944+0000","last_change":"2023-08-17T00:17:04.056944+0000","last_active":"2023-08-17T00:17:04.056944+0000","last_peered":"2023-08-17T00:17:04.056944+0000","last_clean":"2023-08-17T00:17:04.056944+0000","last_became_active":"2023-08-17T00:17:04.056627+0000","last_became_peered":"2023-08-17T00:17:04.056627+0000","last_unstale":"2023-08-17T00:17:04.056944+0000","last_undegraded":"2023-08-17T00:17:04.056944+0000","last_fullsized":"2023-08-17T00:17:04.056944+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617518+0000","last_change":"2023-08-17T00:17:03.615987+0000","last_active":"2023-08-17T00:17:03.617518+0000","last_peered":"2023-08-17T00:17:03.617518+0000","last_clean":"2023-08-17T00:17:03.617518+0000","last_became_active":"2023-08-17T00:17:03.615694+0000","last_became_peered":"2023-08-17T00:17:03.615694+0000","last_unstale":"2023-08-17T00:17:03.617518+0000","last_undegraded":"2023-08-17T00:17:03.617518+0000","last_fullsized":"2023-08-17T00:17:03.617518+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028263+0000","last_change":"2023-08-17T00:17:03.606480+0000","last_active":"2023-08-17T00:17:04.028263+0000","last_peered":"2023-08-17T00:17:04.028263+0000","last_clean":"2023-08-17T00:17:04.028263+0000","last_became_active":"2023-08-17T00:17:03.606201+0000","last_became_peered":"2023-08-17T00:17:03.606201+0000","last_unstale":"2023-08-17T00:17:04.028263+0000","last_undegraded":"2023-08-17T00:17:04.028263+0000","last_fullsized":"2023-08-17T00:17:04.028263+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040428+0000","last_change":"2023-08-17T00:17:04.040428+0000","last_active":"2023-08-17T00:17:04.040428+0000","last_peered":"2023-08-17T00:17:04.040428+0000","last_clean":"2023-08-17T00:17:04.040428+0000","last_became_active":"2023-08-17T00:17:04.040152+0000","last_became_peered":"2023-08-17T00:17:04.040152+0000","last_unstale":"2023-08-17T00:17:04.040428+0000","last_undegraded":"2023-08-17T00:17:04.040428+0000","last_fullsized":"2023-08-17T00:17:04.040428+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617229+0000","last_change":"2023-08-17T00:17:03.612657+0000","last_active":"2023-08-17T00:17:03.617229+0000","last_peered":"2023-08-17T00:17:03.617229+0000","last_clean":"2023-08-17T00:17:03.617229+0000","last_became_active":"2023-08-17T00:17:03.612391+0000","last_became_peered":"2023-08-17T00:17:03.612391+0000","last_unstale":"2023-08-17T00:17:03.617229+0000","last_undegraded":"2023-08-17T00:17:03.617229+0000","last_fullsized":"2023-08-17T00:17:03.617229+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048967+0000","last_change":"2023-08-17T00:17:04.048967+0000","last_active":"2023-08-17T00:17:04.048967+0000","last_peered":"2023-08-17T00:17:04.048967+0000","last_clean":"2023-08-17T00:17:04.048967+0000","last_became_active":"2023-08-17T00:17:04.048659+0000","last_became_peered":"2023-08-17T00:17:04.048659+0000","last_unstale":"2023-08-17T00:17:04.048967+0000","last_undegraded":"2023-08-17T00:17:04.048967+0000","last_fullsized":"2023-08-17T00:17:04.048967+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617867+0000","last_change":"2023-08-17T00:17:03.611238+0000","last_active":"2023-08-17T00:17:03.617867+0000","last_peered":"2023-08-17T00:17:03.617867+0000","last_clean":"2023-08-17T00:17:03.617867+0000","last_became_active":"2023-08-17T00:17:03.609987+0000","last_became_peered":"2023-08-17T00:17:03.609987+0000","last_unstale":"2023-08-17T00:17:03.617867+0000","last_undegraded":"2023-08-17T00:17:03.617867+0000","last_fullsized":"2023-08-17T00:17:03.617867+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050256+0000","last_change":"2023-08-17T00:17:04.050256+0000","last_active":"2023-08-17T00:17:04.050256+0000","last_peered":"2023-08-17T00:17:04.050256+0000","last_clean":"2023-08-17T00:17:04.050256+0000","last_became_active":"2023-08-17T00:17:04.049997+0000","last_became_peered":"2023-08-17T00:17:04.049997+0000","last_unstale":"2023-08-17T00:17:04.050256+0000","last_undegraded":"2023-08-17T00:17:04.050256+0000","last_fullsized":"2023-08-17T00:17:04.050256+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617682+0000","last_change":"2023-08-17T00:17:03.608995+0000","last_active":"2023-08-17T00:17:03.617682+0000","last_peered":"2023-08-17T00:17:03.617682+0000","last_clean":"2023-08-17T00:17:03.617682+0000","last_became_active":"2023-08-17T00:17:03.608716+0000","last_became_peered":"2023-08-17T00:17:03.608716+0000","last_unstale":"2023-08-17T00:17:03.617682+0000","last_undegraded":"2023-08-17T00:17:03.617682+0000","last_fullsized":"2023-08-17T00:17:03.617682+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039299+0000","last_change":"2023-08-17T00:17:04.039299+0000","last_active":"2023-08-17T00:17:04.039299+0000","last_peered":"2023-08-17T00:17:04.039299+0000","last_clean":"2023-08-17T00:17:04.039299+0000","last_became_active":"2023-08-17T00:17:04.039008+0000","last_became_peered":"2023-08-17T00:17:04.039008+0000","last_unstale":"2023-08-17T00:17:04.039299+0000","last_undegraded":"2023-08-17T00:17:04.039299+0000","last_fullsized":"2023-08-17T00:17:04.039299+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.7","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055570+0000","last_change":"2023-08-17T00:17:03.604168+0000","last_active":"2023-08-17T00:17:04.055570+0000","last_peered":"2023-08-17T00:17:04.055570+0000","last_clean":"2023-08-17T00:17:04.055570+0000","last_became_active":"2023-08-17T00:17:03.603901+0000","last_became_peered":"2023-08-17T00:17:03.603901+0000","last_unstale":"2023-08-17T00:17:04.055570+0000","last_undegraded":"2023-08-17T00:17:04.055570+0000","last_fullsized":"2023-08-17T00:17:04.055570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050279+0000","last_change":"2023-08-17T00:17:04.050279+0000","last_active":"2023-08-17T00:17:04.050279+0000","last_peered":"2023-08-17T00:17:04.050279+0000","last_clean":"2023-08-17T00:17:04.050279+0000","last_became_active":"2023-08-17T00:17:04.049619+0000","last_became_peered":"2023-08-17T00:17:04.049619+0000","last_unstale":"2023-08-17T00:17:04.050279+0000","last_undegraded":"2023-08-17T00:17:04.050279+0000","last_fullsized":"2023-08-17T00:17:04.050279+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.606504+0000","last_change":"2023-08-17T00:17:03.598312+0000","last_active":"2023-08-17T00:17:03.606504+0000","last_peered":"2023-08-17T00:17:03.606504+0000","last_clean":"2023-08-17T00:17:03.606504+0000","last_became_active":"2023-08-17T00:17:03.597966+0000","last_became_peered":"2023-08-17T00:17:03.597966+0000","last_unstale":"2023-08-17T00:17:03.606504+0000","last_undegraded":"2023-08-17T00:17:03.606504+0000","last_fullsized":"2023-08-17T00:17:03.606504+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054458+0000","last_change":"2023-08-17T00:17:04.054458+0000","last_active":"2023-08-17T00:17:04.054458+0000","last_peered":"2023-08-17T00:17:04.054458+0000","last_clean":"2023-08-17T00:17:04.054458+0000","last_became_active":"2023-08-17T00:17:04.054168+0000","last_became_peered":"2023-08-17T00:17:04.054168+0000","last_unstale":"2023-08-17T00:17:04.054458+0000","last_undegraded":"2023-08-17T00:17:04.054458+0000","last_fullsized":"2023-08-17T00:17:04.054458+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607544+0000","last_change":"2023-08-17T00:17:03.600702+0000","last_active":"2023-08-17T00:17:03.607544+0000","last_peered":"2023-08-17T00:17:03.607544+0000","last_clean":"2023-08-17T00:17:03.607544+0000","last_became_active":"2023-08-17T00:17:03.600329+0000","last_became_peered":"2023-08-17T00:17:03.600329+0000","last_unstale":"2023-08-17T00:17:03.607544+0000","last_undegraded":"2023-08-17T00:17:03.607544+0000","last_fullsized":"2023-08-17T00:17:03.607544+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048843+0000","last_change":"2023-08-17T00:17:04.048843+0000","last_active":"2023-08-17T00:17:04.048843+0000","last_peered":"2023-08-17T00:17:04.048843+0000","last_clean":"2023-08-17T00:17:04.048843+0000","last_became_active":"2023-08-17T00:17:04.048452+0000","last_became_peered":"2023-08-17T00:17:04.048452+0000","last_unstale":"2023-08-17T00:17:04.048843+0000","last_undegraded":"2023-08-17T00:17:04.048843+0000","last_fullsized":"2023-08-17T00:17:04.048843+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.602500+0000","last_change":"2023-08-17T00:17:03.601397+0000","last_active":"2023-08-17T00:17:03.602500+0000","last_peered":"2023-08-17T00:17:03.602500+0000","last_clean":"2023-08-17T00:17:03.602500+0000","last_became_active":"2023-08-17T00:17:03.601090+0000","last_became_peered":"2023-08-17T00:17:03.601090+0000","last_unstale":"2023-08-17T00:17:03.602500+0000","last_undegraded":"2023-08-17T00:17:03.602500+0000","last_fullsized":"2023-08-17T00:17:03.602500+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044730+0000","last_change":"2023-08-17T00:17:04.044730+0000","last_active":"2023-08-17T00:17:04.044730+0000","last_peered":"2023-08-17T00:17:04.044730+0000","last_clean":"2023-08-17T00:17:04.044730+0000","last_became_active":"2023-08-17T00:17:04.044474+0000","last_became_peered":"2023-08-17T00:17:04.044474+0000","last_unstale":"2023-08-17T00:17:04.044730+0000","last_undegraded":"2023-08-17T00:17:04.044730+0000","last_fullsized":"2023-08-17T00:17:04.044730+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.607491+0000","last_change":"2023-08-17T00:17:03.604924+0000","last_active":"2023-08-17T00:17:03.607491+0000","last_peered":"2023-08-17T00:17:03.607491+0000","last_clean":"2023-08-17T00:17:03.607491+0000","last_became_active":"2023-08-17T00:17:03.604666+0000","last_became_peered":"2023-08-17T00:17:03.604666+0000","last_unstale":"2023-08-17T00:17:03.607491+0000","last_undegraded":"2023-08-17T00:17:03.607491+0000","last_fullsized":"2023-08-17T00:17:03.607491+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052415+0000","last_change":"2023-08-17T00:17:04.052415+0000","last_active":"2023-08-17T00:17:04.052415+0000","last_peered":"2023-08-17T00:17:04.052415+0000","last_clean":"2023-08-17T00:17:04.052415+0000","last_became_active":"2023-08-17T00:17:04.052144+0000","last_became_peered":"2023-08-17T00:17:04.052144+0000","last_unstale":"2023-08-17T00:17:04.052415+0000","last_undegraded":"2023-08-17T00:17:04.052415+0000","last_fullsized":"2023-08-17T00:17:04.052415+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613270+0000","last_change":"2023-08-17T00:17:03.604890+0000","last_active":"2023-08-17T00:17:03.613270+0000","last_peered":"2023-08-17T00:17:03.613270+0000","last_clean":"2023-08-17T00:17:03.613270+0000","last_became_active":"2023-08-17T00:17:03.604627+0000","last_became_peered":"2023-08-17T00:17:03.604627+0000","last_unstale":"2023-08-17T00:17:03.613270+0000","last_undegraded":"2023-08-17T00:17:03.613270+0000","last_fullsized":"2023-08-17T00:17:03.613270+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040497+0000","last_change":"2023-08-17T00:17:04.040497+0000","last_active":"2023-08-17T00:17:04.040497+0000","last_peered":"2023-08-17T00:17:04.040497+0000","last_clean":"2023-08-17T00:17:04.040497+0000","last_became_active":"2023-08-17T00:17:04.039861+0000","last_became_peered":"2023-08-17T00:17:04.039861+0000","last_unstale":"2023-08-17T00:17:04.040497+0000","last_undegraded":"2023-08-17T00:17:04.040497+0000","last_fullsized":"2023-08-17T00:17:04.040497+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617792+0000","last_change":"2023-08-17T00:17:03.610904+0000","last_active":"2023-08-17T00:17:03.617792+0000","last_peered":"2023-08-17T00:17:03.617792+0000","last_clean":"2023-08-17T00:17:03.617792+0000","last_became_active":"2023-08-17T00:17:03.609650+0000","last_became_peered":"2023-08-17T00:17:03.609650+0000","last_unstale":"2023-08-17T00:17:03.617792+0000","last_undegraded":"2023-08-17T00:17:03.617792+0000","last_fullsized":"2023-08-17T00:17:03.617792+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052784+0000","last_change":"2023-08-17T00:17:04.052784+0000","last_active":"2023-08-17T00:17:04.052784+0000","last_peered":"2023-08-17T00:17:04.052784+0000","last_clean":"2023-08-17T00:17:04.052784+0000","last_became_active":"2023-08-17T00:17:04.052382+0000","last_became_peered":"2023-08-17T00:17:04.052382+0000","last_unstale":"2023-08-17T00:17:04.052784+0000","last_undegraded":"2023-08-17T00:17:04.052784+0000","last_fullsized":"2023-08-17T00:17:04.052784+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-08-17T00:17:02.543174+0000","last_change":"2023-08-17T00:17:02.564089+0000","last_active":"2023-08-17T00:17:02.543174+0000","last_peered":"2023-08-17T00:17:02.543174+0000","last_clean":"2023-08-17T00:17:02.543174+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:02.543174+0000","last_undegraded":"2023-08-17T00:17:02.543174+0000","last_fullsized":"2023-08-17T00:17:02.543174+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045593+0000","last_change":"2023-08-17T00:17:04.045593+0000","last_active":"2023-08-17T00:17:04.045593+0000","last_peered":"2023-08-17T00:17:04.045593+0000","last_clean":"2023-08-17T00:17:04.045593+0000","last_became_active":"2023-08-17T00:17:04.045320+0000","last_became_peered":"2023-08-17T00:17:04.045320+0000","last_unstale":"2023-08-17T00:17:04.045593+0000","last_undegraded":"2023-08-17T00:17:04.045593+0000","last_fullsized":"2023-08-17T00:17:04.045593+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1e","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.023391+0000","last_change":"2023-08-17T00:17:03.608379+0000","last_active":"2023-08-17T00:17:04.023391+0000","last_peered":"2023-08-17T00:17:04.023391+0000","last_clean":"2023-08-17T00:17:04.023391+0000","last_became_active":"2023-08-17T00:17:03.608068+0000","last_became_peered":"2023-08-17T00:17:03.608068+0000","last_unstale":"2023-08-17T00:17:04.023391+0000","last_undegraded":"2023-08-17T00:17:04.023391+0000","last_fullsized":"2023-08-17T00:17:04.023391+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581918+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:17:03.581918+0000","last_peered":"2023-08-17T00:17:03.581918+0000","last_clean":"2023-08-17T00:17:03.581918+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:17:03.581918+0000","last_undegraded":"2023-08-17T00:17:03.581918+0000","last_fullsized":"2023-08-17T00:17:03.581918+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038193+0000","last_change":"2023-08-17T00:17:04.038193+0000","last_active":"2023-08-17T00:17:04.038193+0000","last_peered":"2023-08-17T00:17:04.038193+0000","last_clean":"2023-08-17T00:17:04.038193+0000","last_became_active":"2023-08-17T00:17:04.037874+0000","last_became_peered":"2023-08-17T00:17:04.037874+0000","last_unstale":"2023-08-17T00:17:04.038193+0000","last_undegraded":"2023-08-17T00:17:04.038193+0000","last_fullsized":"2023-08-17T00:17:04.038193+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1f","version":"191'1","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034308+0000","last_change":"2023-08-17T00:17:03.605442+0000","last_active":"2023-08-17T00:17:04.034308+0000","last_peered":"2023-08-17T00:17:04.034308+0000","last_clean":"2023-08-17T00:17:04.034308+0000","last_became_active":"2023-08-17T00:17:03.605139+0000","last_became_peered":"2023-08-17T00:17:03.605139+0000","last_unstale":"2023-08-17T00:17:04.034308+0000","last_undegraded":"2023-08-17T00:17:04.034308+0000","last_fullsized":"2023-08-17T00:17:04.034308+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":180,"reported_epoch":188,"state":"active+clean","last_fresh":"2023-08-17T00:16:59.656637+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:16:59.656637+0000","last_peered":"2023-08-17T00:16:59.656637+0000","last_clean":"2023-08-17T00:16:59.656637+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:16:59.656637+0000","last_undegraded":"2023-08-17T00:16:59.656637+0000","last_fullsized":"2023-08-17T00:16:59.656637+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-17T00:17:03.558637+0000","last_change":"2023-08-17T00:17:03.558637+0000","last_active":"2023-08-17T00:17:03.558637+0000","last_peered":"2023-08-17T00:17:03.558637+0000","last_clean":"2023-08-17T00:17:03.558637+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-17T00:17:03.558637+0000","last_undegraded":"2023-08-17T00:17:03.558637+0000","last_fullsized":"2023-08-17T00:17:03.558637+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617366+0000","last_change":"2023-08-17T00:17:03.614980+0000","last_active":"2023-08-17T00:17:03.617366+0000","last_peered":"2023-08-17T00:17:03.617366+0000","last_clean":"2023-08-17T00:17:03.617366+0000","last_became_active":"2023-08-17T00:17:03.614675+0000","last_became_peered":"2023-08-17T00:17:03.614675+0000","last_unstale":"2023-08-17T00:17:03.617366+0000","last_undegraded":"2023-08-17T00:17:03.617366+0000","last_fullsized":"2023-08-17T00:17:03.617366+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.580971+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:17:03.580971+0000","last_peered":"2023-08-17T00:17:03.580971+0000","last_clean":"2023-08-17T00:17:03.580971+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:17:03.580971+0000","last_undegraded":"2023-08-17T00:17:03.580971+0000","last_fullsized":"2023-08-17T00:17:03.580971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042523+0000","last_change":"2023-08-17T00:17:04.042523+0000","last_active":"2023-08-17T00:17:04.042523+0000","last_peered":"2023-08-17T00:17:04.042523+0000","last_clean":"2023-08-17T00:17:04.042523+0000","last_became_active":"2023-08-17T00:17:04.042059+0000","last_became_peered":"2023-08-17T00:17:04.042059+0000","last_unstale":"2023-08-17T00:17:04.042523+0000","last_undegraded":"2023-08-17T00:17:04.042523+0000","last_fullsized":"2023-08-17T00:17:04.042523+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1d","version":"191'2","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054171+0000","last_change":"2023-08-17T00:17:03.611041+0000","last_active":"2023-08-17T00:17:04.054171+0000","last_peered":"2023-08-17T00:17:04.054171+0000","last_clean":"2023-08-17T00:17:04.054171+0000","last_became_active":"2023-08-17T00:17:03.610638+0000","last_became_peered":"2023-08-17T00:17:03.610638+0000","last_unstale":"2023-08-17T00:17:04.054171+0000","last_undegraded":"2023-08-17T00:17:04.054171+0000","last_fullsized":"2023-08-17T00:17:04.054171+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":174,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.586419+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:17:03.586419+0000","last_peered":"2023-08-17T00:17:03.586419+0000","last_clean":"2023-08-17T00:17:03.586419+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:17:03.586419+0000","last_undegraded":"2023-08-17T00:17:03.586419+0000","last_fullsized":"2023-08-17T00:17:03.586419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045916+0000","last_change":"2023-08-17T00:17:04.045916+0000","last_active":"2023-08-17T00:17:04.045916+0000","last_peered":"2023-08-17T00:17:04.045916+0000","last_clean":"2023-08-17T00:17:04.045916+0000","last_became_active":"2023-08-17T00:17:04.045632+0000","last_became_peered":"2023-08-17T00:17:04.045632+0000","last_unstale":"2023-08-17T00:17:04.045916+0000","last_undegraded":"2023-08-17T00:17:04.045916+0000","last_fullsized":"2023-08-17T00:17:04.045916+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617603+0000","last_change":"2023-08-17T00:17:03.608444+0000","last_active":"2023-08-17T00:17:03.617603+0000","last_peered":"2023-08-17T00:17:03.617603+0000","last_clean":"2023-08-17T00:17:03.617603+0000","last_became_active":"2023-08-17T00:17:03.605953+0000","last_became_peered":"2023-08-17T00:17:03.605953+0000","last_unstale":"2023-08-17T00:17:03.617603+0000","last_undegraded":"2023-08-17T00:17:03.617603+0000","last_fullsized":"2023-08-17T00:17:03.617603+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581175+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:17:03.581175+0000","last_peered":"2023-08-17T00:17:03.581175+0000","last_clean":"2023-08-17T00:17:03.581175+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:17:03.581175+0000","last_undegraded":"2023-08-17T00:17:03.581175+0000","last_fullsized":"2023-08-17T00:17:03.581175+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050181+0000","last_change":"2023-08-17T00:17:04.050181+0000","last_active":"2023-08-17T00:17:04.050181+0000","last_peered":"2023-08-17T00:17:04.050181+0000","last_clean":"2023-08-17T00:17:04.050181+0000","last_became_active":"2023-08-17T00:17:04.049847+0000","last_became_peered":"2023-08-17T00:17:04.049847+0000","last_unstale":"2023-08-17T00:17:04.050181+0000","last_undegraded":"2023-08-17T00:17:04.050181+0000","last_fullsized":"2023-08-17T00:17:04.050181+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.613446+0000","last_change":"2023-08-17T00:17:03.607083+0000","last_active":"2023-08-17T00:17:03.613446+0000","last_peered":"2023-08-17T00:17:03.613446+0000","last_clean":"2023-08-17T00:17:03.613446+0000","last_became_active":"2023-08-17T00:17:03.606777+0000","last_became_peered":"2023-08-17T00:17:03.606777+0000","last_unstale":"2023-08-17T00:17:03.613446+0000","last_undegraded":"2023-08-17T00:17:03.613446+0000","last_fullsized":"2023-08-17T00:17:03.613446+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":150,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.603188+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:17:03.603188+0000","last_peered":"2023-08-17T00:17:03.603188+0000","last_clean":"2023-08-17T00:17:03.603188+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:17:03.603188+0000","last_undegraded":"2023-08-17T00:17:03.603188+0000","last_fullsized":"2023-08-17T00:17:03.603188+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040677+0000","last_change":"2023-08-17T00:17:04.040677+0000","last_active":"2023-08-17T00:17:04.040677+0000","last_peered":"2023-08-17T00:17:04.040677+0000","last_clean":"2023-08-17T00:17:04.040677+0000","last_became_active":"2023-08-17T00:17:04.040201+0000","last_became_peered":"2023-08-17T00:17:04.040201+0000","last_unstale":"2023-08-17T00:17:04.040677+0000","last_undegraded":"2023-08-17T00:17:04.040677+0000","last_fullsized":"2023-08-17T00:17:04.040677+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.612249+0000","last_change":"2023-08-17T00:17:03.607962+0000","last_active":"2023-08-17T00:17:03.612249+0000","last_peered":"2023-08-17T00:17:03.612249+0000","last_clean":"2023-08-17T00:17:03.612249+0000","last_became_active":"2023-08-17T00:17:03.607587+0000","last_became_peered":"2023-08-17T00:17:03.607587+0000","last_unstale":"2023-08-17T00:17:03.612249+0000","last_undegraded":"2023-08-17T00:17:03.612249+0000","last_fullsized":"2023-08-17T00:17:03.612249+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.580792+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:17:03.580792+0000","last_peered":"2023-08-17T00:17:03.580792+0000","last_clean":"2023-08-17T00:17:03.580792+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:17:03.580792+0000","last_undegraded":"2023-08-17T00:17:03.580792+0000","last_fullsized":"2023-08-17T00:17:03.580792+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":8,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046586+0000","last_change":"2023-08-17T00:17:04.046586+0000","last_active":"2023-08-17T00:17:04.046586+0000","last_peered":"2023-08-17T00:17:04.046586+0000","last_clean":"2023-08-17T00:17:04.046586+0000","last_became_active":"2023-08-17T00:17:04.046283+0000","last_became_peered":"2023-08-17T00:17:04.046283+0000","last_unstale":"2023-08-17T00:17:04.046586+0000","last_undegraded":"2023-08-17T00:17:04.046586+0000","last_fullsized":"2023-08-17T00:17:04.046586+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":9,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.617401+0000","last_change":"2023-08-17T00:17:03.615539+0000","last_active":"2023-08-17T00:17:03.617401+0000","last_peered":"2023-08-17T00:17:03.617401+0000","last_clean":"2023-08-17T00:17:03.617401+0000","last_became_active":"2023-08-17T00:17:03.615065+0000","last_became_peered":"2023-08-17T00:17:03.615065+0000","last_unstale":"2023-08-17T00:17:03.617401+0000","last_undegraded":"2023-08-17T00:17:03.617401+0000","last_fullsized":"2023-08-17T00:17:03.617401+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.581820+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:17:03.581820+0000","last_peered":"2023-08-17T00:17:03.581820+0000","last_clean":"2023-08-17T00:17:03.581820+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:17:03.581820+0000","last_undegraded":"2023-08-17T00:17:03.581820+0000","last_fullsized":"2023-08-17T00:17:03.581820+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":190,"state":"active+clean","last_fresh":"2023-08-17T00:17:03.588315+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:17:03.588315+0000","last_peered":"2023-08-17T00:17:03.588315+0000","last_clean":"2023-08-17T00:17:03.588315+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:17:03.588315+0000","last_undegraded":"2023-08-17T00:17:03.588315+0000","last_fullsized":"2023-08-17T00:17:03.588315+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":112,"acting":112,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":2216,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35,"ondisk_log_size":35,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299580,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072260,"statfs":{"total":96636764160,"available":96329994240,"internally_reserved":0,"allocated":2412544,"data_stored":1130262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":1.054},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.871}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":1.151}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.2549999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.0800000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.208},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":0.754}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.091},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":0.77800000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542318,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299556,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072284,"statfs":{"total":96636764160,"available":96330018816,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":6.2050000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":4.468}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":2.0870000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":3.5409999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":3.0569999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":2.4670000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":6.1660000000000004},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":8.4809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":5.2199999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":3.7519999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542319,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307748,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064092,"statfs":{"total":96636764160,"available":96321630208,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.143}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.409},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.272}]}]},{"osd":3,"up_from":14,"seq":60129542318,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307768,"kb_used_data":2352,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064072,"statfs":{"total":96636764160,"available":96321609728,"internally_reserved":0,"allocated":2408448,"data_stored":1130780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":1.224}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":1.056}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.167}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.351},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.198}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.3200000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.304}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.391},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.0149999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311844,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059996,"statfs":{"total":96636764160,"available":96317435904,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.84399999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":1.165},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":0.93100000000000005}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.044}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.159}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.347}]}]},{"osd":1,"up_from":14,"seq":60129542318,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307736,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064104,"statfs":{"total":96636764160,"available":96321642496,"internally_reserved":0,"allocated":2375680,"data_stored":1116278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.873,"15min":0.83599999999999997},"min":{"1min":0.64500000000000002,"5min":0.46000000000000002,"15min":0.309},"max":{"1min":1.2789999999999999,"5min":2.6970000000000001,"15min":6.4329999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.91800000000000004,"15min":0.91300000000000003},"min":{"1min":0.752,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.214,"5min":1.6200000000000001,"15min":13.093},"last":1.367}]},{"osd":2,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.82299999999999995,"15min":0.80600000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.3839999999999999,"15min":5.4989999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.88900000000000001},"min":{"1min":0.64600000000000002,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.2689999999999999,"5min":2.8199999999999998,"15min":7.0620000000000003},"last":1.0129999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0249999999999999,"15min":1.0129999999999999},"min":{"1min":0.70599999999999996,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.363,"5min":2.7519999999999998,"15min":8.8279999999999994},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.93999999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":3.3700000000000001,"15min":12.981999999999999},"last":0.625}]},{"osd":4,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.0800000000000001,"15min":1.139},"min":{"1min":0.92600000000000005,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.552,"5min":1.671,"15min":20.548999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3,"5min":1.214,"15min":1.204},"min":{"1min":0.97399999999999998,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.5169999999999999,"5min":2.7839999999999998,"15min":8.8670000000000009},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.266,"15min":1.2909999999999999},"min":{"1min":1.1779999999999999,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.623,"5min":3.137,"15min":13.170999999999999},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.2270000000000001,"15min":1.236},"min":{"1min":1.0760000000000001,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.4510000000000001,"5min":1.9690000000000001,"15min":5.4240000000000004},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2370000000000001,"15min":1.246},"min":{"1min":0.95899999999999996,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.603,"5min":3.2610000000000001,"15min":13.050000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.216,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.5620000000000001,"5min":2.0150000000000001,"15min":5.5359999999999996},"last":1.222}]},{"osd":7,"last update":"Thu Aug 17 00:16:05 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.294,"15min":1.298},"min":{"1min":1.0409999999999999,"5min":0.85299999999999998,"15min":0.79100000000000004},"max":{"1min":1.675,"5min":3.1520000000000001,"15min":6.9779999999999998},"last":1.202},{"interface":"front","average":{"1min":1.335,"5min":1.3069999999999999,"15min":1.319},"min":{"1min":1.0229999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.7230000000000001,"5min":3.4180000000000001,"15min":13.131},"last":1.167}]}]},{"osd":0,"up_from":14,"seq":60129542319,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311844,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059996,"statfs":{"total":96636764160,"available":96317435904,"internally_reserved":0,"allocated":2387968,"data_stored":1122957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":0.755}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":1.073},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":1.585}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":1.423},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":1.534}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.4990000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":1.4350000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.375}]}]},{"osd":4,"up_from":13,"seq":55834575023,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307736,"kb_used_data":2320,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064104,"statfs":{"total":96636764160,"available":96321642496,"internally_reserved":0,"allocated":2375680,"data_stored":1116278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":1.0049999999999999,"15min":1.0600000000000001},"min":{"1min":0.77600000000000002,"5min":0.622,"15min":0.38300000000000001},"max":{"1min":1.4350000000000001,"5min":1.677,"15min":7.1379999999999999},"last":1.147},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0369999999999999,"15min":1.0569999999999999},"min":{"1min":0.64900000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.345,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":1.117}]},{"osd":1,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.1379999999999999,"15min":1.22},"min":{"1min":0.745,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.4039999999999999,"5min":1.5960000000000001,"15min":8.3800000000000008},"last":1.181},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.153,"15min":1.216},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.732,"5min":1.732,"15min":6.9000000000000004},"last":1.252}]},{"osd":2,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.083,"15min":1.2130000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.4179999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.083,"15min":1.3089999999999999},"min":{"1min":0.91600000000000004,"5min":0.755,"15min":0.36699999999999999},"max":{"1min":1.5880000000000001,"5min":1.623,"15min":36.531999999999996},"last":1.036}]},{"osd":3,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.113,"15min":1.117},"min":{"1min":0.79300000000000004,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.522,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.175,"15min":1.3779999999999999},"min":{"1min":0.876,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.603,"5min":1.7569999999999999,"15min":36.530000000000001},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.1899999999999999,"15min":1.24},"min":{"1min":1.036,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.635,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.466},{"interface":"front","average":{"1min":1.254,"5min":1.228,"15min":1.2829999999999999},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.633,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.2390000000000001,"15min":1.3200000000000001},"min":{"1min":0.877,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6659999999999999,"5min":1.875,"15min":8.4190000000000005},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.321,"15min":1.369},"min":{"1min":1.032,"5min":0.77400000000000002,"15min":0.49399999999999999},"max":{"1min":1.8260000000000001,"5min":1.911,"15min":6.1689999999999996},"last":1.3600000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:04 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.222,"15min":1.248},"min":{"1min":0.83399999999999996,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.5249999999999999,"5min":3.645,"15min":3.645},"last":1.306},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3220000000000001,"15min":1.3879999999999999},"min":{"1min":1.0149999999999999,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.879,"5min":1.9690000000000001,"15min":8.327},"last":1.2689999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:17:09.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3e is not active+clean 2023-08-17T00:17:09.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.38 is not active+clean 2023-08-17T00:17:09.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:17:02.543174+0000', 'last_change': '2023-08-17T00:17:02.564705+0000', 'last_active': '2023-08-17T00:17:02.543174+0000', 'last_peered': '2023-08-17T00:17:02.543174+0000', 'last_clean': '2023-08-17T00:17:02.543174+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:02.543174+0000', 'last_undegraded': '2023-08-17T00:17:02.543174+0000', 'last_fullsized': '2023-08-17T00:17:02.543174+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T00:17:09.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.34 is not active+clean 2023-08-17T00:17:09.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2e is not active+clean 2023-08-17T00:17:09.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.26 is not active+clean 2023-08-17T00:17:09.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:17:02.543174+0000', 'last_change': '2023-08-17T00:17:02.563951+0000', 'last_active': '2023-08-17T00:17:02.543174+0000', 'last_peered': '2023-08-17T00:17:02.543174+0000', 'last_clean': '2023-08-17T00:17:02.543174+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:02.543174+0000', 'last_undegraded': '2023-08-17T00:17:02.543174+0000', 'last_fullsized': '2023-08-17T00:17:02.543174+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T00:17:09.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.23 is not active+clean 2023-08-17T00:17:09.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.24 is not active+clean 2023-08-17T00:17:09.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:17:02.543174+0000', 'last_change': '2023-08-17T00:17:02.563287+0000', 'last_active': '2023-08-17T00:17:02.543174+0000', 'last_peered': '2023-08-17T00:17:02.543174+0000', 'last_clean': '2023-08-17T00:17:02.543174+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:02.543174+0000', 'last_undegraded': '2023-08-17T00:17:02.543174+0000', 'last_fullsized': '2023-08-17T00:17:02.543174+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T00:17:09.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.24 is not active+clean 2023-08-17T00:17:09.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.15 is not active+clean 2023-08-17T00:17:09.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:17:02.543174+0000', 'last_change': '2023-08-17T00:17:02.563201+0000', 'last_active': '2023-08-17T00:17:02.543174+0000', 'last_peered': '2023-08-17T00:17:02.543174+0000', 'last_clean': '2023-08-17T00:17:02.543174+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:02.543174+0000', 'last_undegraded': '2023-08-17T00:17:02.543174+0000', 'last_fullsized': '2023-08-17T00:17:02.543174+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T00:17:09.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.16 is not active+clean 2023-08-17T00:17:09.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.c is not active+clean 2023-08-17T00:17:09.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.0 is not active+clean 2023-08-17T00:17:09.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-08-17T00:17:02.543174+0000', 'last_change': '2023-08-17T00:17:02.564089+0000', 'last_active': '2023-08-17T00:17:02.543174+0000', 'last_peered': '2023-08-17T00:17:02.543174+0000', 'last_clean': '2023-08-17T00:17:02.543174+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:02.543174+0000', 'last_undegraded': '2023-08-17T00:17:02.543174+0000', 'last_fullsized': '2023-08-17T00:17:02.543174+0000', 'mapping_epoch': 189, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 189, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:02.543174+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-17T00:17:09.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1b is not active+clean 2023-08-17T00:17:09.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-17T00:17:03.558637+0000', 'last_change': '2023-08-17T00:17:03.558637+0000', 'last_active': '2023-08-17T00:17:03.558637+0000', 'last_peered': '2023-08-17T00:17:03.558637+0000', 'last_clean': '2023-08-17T00:17:03.558637+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-17T00:17:03.558637+0000', 'last_undegraded': '2023-08-17T00:17:03.558637+0000', 'last_fullsized': '2023-08-17T00:17:03.558637+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'last_clean_scrub_stamp': '2023-08-17T00:17:03.558637+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-17T00:17:09.145 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-17T00:17:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 Processor -- start 2023-08-17T00:17:09.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 -- start start 2023-08-17T00:17:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd71c150c80 0x7fd71c0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd71c154e50 0x7fd71c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71c066de0 con 0x7fd71c1508a0 2023-08-17T00:17:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c0ad7b0 con 0x7fd71c154e50 2023-08-17T00:17:09.325 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd7219a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71c1510e0 con 0x7fd71c150c80 2023-08-17T00:17:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd71bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd71c154e50 0x7fd71c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd71bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fd71c154e50 0x7fd71c1552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47088/0 (socket says 172.21.15.153:47088) 2023-08-17T00:17:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd71bfff700 1 -- 172.21.15.153:0/2707144969 learned_addr learned my addr 172.21.15.153:0/2707144969 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.319+0000 7fd713fff700 1 --2- 172.21.15.153:0/2707144969 >> v2:172.21.15.178:3300/0 conn(0x7fd71c150c80 0x7fd71c0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.326 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71bfff700 1 -- 172.21.15.153:0/2707144969 >> v2:172.21.15.178:3300/0 conn(0x7fd71c150c80 msgr2=0x7fd71c0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71bfff700 1 --2- 172.21.15.153:0/2707144969 >> v2:172.21.15.178:3300/0 conn(0x7fd71c150c80 0x7fd71c0ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71bfff700 1 -- 172.21.15.153:0/2707144969 >> v1:172.21.15.178:6789/0 conn(0x7fd71c1508a0 legacy=0x7fd71c154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71bfff700 1 -- 172.21.15.153:0/2707144969 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0ad9a0 con 0x7fd71c154e50 2023-08-17T00:17:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd713fff700 1 --2- 172.21.15.153:0/2707144969 >> v2:172.21.15.178:3300/0 conn(0x7fd71c150c80 0x7fd71c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:09.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71bfff700 1 --2- 172.21.15.153:0/2707144969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c1552e0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7fd71c067d70 tx=0x7fd71400b3b0).ready entity=mon.0 client_cookie=91d406b2a6b9a839 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71a7fc700 1 -- 172.21.15.153:0/2707144969 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71400db00 con 0x7fd71c154e50 2023-08-17T00:17:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71a7fc700 1 -- 172.21.15.153:0/2707144969 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71400dc60 con 0x7fd71c154e50 2023-08-17T00:17:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd71a7fc700 1 -- 172.21.15.153:0/2707144969 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714010470 con 0x7fd71c154e50 2023-08-17T00:17:09.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 -- 172.21.15.153:0/2707144969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 msgr2=0x7fd71c1552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 --2- 172.21.15.153:0/2707144969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c1552e0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 rx=0x7fd71c067d70 tx=0x7fd71400b3b0).stop 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 -- 172.21.15.153:0/2707144969 shutdown_connections 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 --2- 172.21.15.153:0/2707144969 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c1552e0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 --2- 172.21.15.153:0/2707144969 >> v2:172.21.15.178:3300/0 conn(0x7fd71c150c80 0x7fd71c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 -- 172.21.15.153:0/2707144969 >> 172.21.15.153:0/2707144969 conn(0x7fd71c0c4950 msgr2=0x7fd71c0c4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 -- 172.21.15.153:0/2707144969 shutdown_connections 2023-08-17T00:17:09.329 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.323+0000 7fd7219a9700 1 -- 172.21.15.153:0/2707144969 wait complete. 2023-08-17T00:17:09.330 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 Processor -- start 2023-08-17T00:17:09.331 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 -- start start 2023-08-17T00:17:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71c1508a0 0x7fd71c0a9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd71c150c80 0x7fd71c14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c151550 con 0x7fd71c154e50 2023-08-17T00:17:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c151220 con 0x7fd71c150c80 2023-08-17T00:17:09.333 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.327+0000 7fd7219a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c0aa250 con 0x7fd71c1508a0 2023-08-17T00:17:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd713fff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd71c150c80 0x7fd71c14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71affd700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71c1508a0 0x7fd71c0a9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47090/0 (socket says 172.21.15.153:47090) 2023-08-17T00:17:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 -- 172.21.15.153:0/1089819930 learned_addr learned my addr 172.21.15.153:0/1089819930 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:09.335 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 -- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71c1508a0 msgr2=0x7fd71c0a9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71c1508a0 0x7fd71c0a9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 -- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd71c150c80 msgr2=0x7fd71c14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd71c150c80 0x7fd71c14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 -- 172.21.15.153:0/1089819930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71400b610 con 0x7fd71c154e50 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd71bfff700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c153800 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7fd71400bf90 tx=0x7fd71400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714002f70 con 0x7fd71c154e50 2023-08-17T00:17:09.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714019660 con 0x7fd71c154e50 2023-08-17T00:17:09.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c0aa530 con 0x7fd71c154e50 2023-08-17T00:17:09.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714019a00 con 0x7fd71c154e50 2023-08-17T00:17:09.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c0a9f20 con 0x7fd71c154e50 2023-08-17T00:17:09.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.331+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c1516c0 con 0x7fd71c154e50 2023-08-17T00:17:09.338 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.335+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd71402a070 con 0x7fd71c154e50 2023-08-17T00:17:09.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.335+0000 7fd712ffd700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd6fc05a180 0x7fd6fc05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.335+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd714075840 con 0x7fd71c154e50 2023-08-17T00:17:09.339 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.335+0000 7fd71affd700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd6fc05a180 0x7fd6fc05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.340 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.335+0000 7fd71affd700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd6fc05a180 0x7fd6fc05c640 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fd70c003900 tx=0x7fd70c007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:09.342 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.339+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd7140491e0 con 0x7fd71c154e50 2023-08-17T00:17:09.541 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:17:09.539+0000 7f4d7c1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:17:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.551+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd71c0664b0 con 0x7fd71c154e50 2023-08-17T00:17:09.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.551+0000 7fd712ffd700 1 -- 172.21.15.153:0/1089819930 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1119 (secure 0 0 0) 0x7fd714028020 con 0x7fd71c154e50 2023-08-17T00:17:09.556 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:09.556 INFO:teuthology.orchestra.run.smithi153.stdout:{"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":877,"monmap":{"epoch":1,"min_mon_release_name":"pacific","num_mons":3},"osdmap":{"epoch":192,"num_osds":8,"num_up_osds":8,"osd_up_since":1692230563,"num_in_osds":8,"osd_in_since":1692230555,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":124},{"state_name":"unknown","count":8},{"state_name":"creating+peering","count":5}],"num_pgs":137,"num_pools":4,"num_objects":19,"data_bytes":2216,"bytes_used":2512703488,"bytes_avail":770581409792,"bytes_total":773094113280,"unknown_pgs_ratio":0.058394160121679306,"inactive_pgs_ratio":0.036496348679065704},"fsmap":{"epoch":146,"id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"c","status":"up:active","gid":9649}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2023-08-17T00:14:31.442590+0000","services":{}},"progress_events":{}} 2023-08-17T00:17:09.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd6fc05a180 msgr2=0x7fd6fc05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd6fc05a180 0x7fd6fc05c640 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7fd70c003900 tx=0x7fd70c007d40).stop 2023-08-17T00:17:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 msgr2=0x7fd71c153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c153800 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 rx=0x7fd71400bf90 tx=0x7fd71400b3b0).stop 2023-08-17T00:17:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 shutdown_connections 2023-08-17T00:17:09.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd6fc05a180 0x7fd6fc05c640 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd71c154e50 0x7fd71c153800 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd71c150c80 0x7fd71c14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 --2- 172.21.15.153:0/1089819930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71c1508a0 0x7fd71c0a9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 >> 172.21.15.153:0/1089819930 conn(0x7fd71c0c4950 msgr2=0x7fd71c0c7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:09.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 shutdown_connections 2023-08-17T00:17:09.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.555+0000 7fd7219a9700 1 -- 172.21.15.153:0/1089819930 wait complete. 2023-08-17T00:17:09.576 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-17T00:17:09.577 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:17:09.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.727+0000 7f78c488f700 1 Processor -- start 2023-08-17T00:17:09.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.727+0000 7f78c488f700 1 -- start start 2023-08-17T00:17:09.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78c488f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f78c00a8df0 0x7f78c00c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78c488f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 0x7f78c0068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78c488f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c01585a0 con 0x7f78c0061fa0 2023-08-17T00:17:09.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78c488f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c0066400 con 0x7f78c00a8df0 2023-08-17T00:17:09.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78c488f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0069170 con 0x7f78c0068820 2023-08-17T00:17:09.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f78c0061fa0 0x7f78c0062400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45082/0 (socket says 172.21.15.153:45082) 2023-08-17T00:17:09.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bffff700 1 -- 172.21.15.153:0/2478276290 learned_addr learned my addr 172.21.15.153:0/2478276290 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:09.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/2478276290 >> v2:172.21.15.178:3300/0 conn(0x7f78c00a8df0 0x7f78c00c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78b6ffd700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 0x7f78c0068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147132542 0 0) 0x7f78c01585a0 con 0x7f78c0061fa0 2023-08-17T00:17:09.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ac0033f0 con 0x7f78c0061fa0 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2063961431 0 0) 0x7f78ac0033f0 con 0x7f78c0061fa0 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 msgr2=0x7f78c0068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 0x7f78c0068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 >> v2:172.21.15.178:3300/0 conn(0x7f78c00a8df0 msgr2=0x7f78c00c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 --2- 172.21.15.153:0/2478276290 >> v2:172.21.15.178:3300/0 conn(0x7f78c00a8df0 0x7f78c00c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c00b9d30 con 0x7f78c0061fa0 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f78b80017f0 con 0x7f78c0061fa0 2023-08-17T00:17:09.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 >> v1:172.21.15.153:6789/0 conn(0x7f78c0061fa0 legacy=0x7f78c0062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0038e0 0x7f78ac003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 0x7f78ac004690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78ac004b80 0x7f78ac005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0066400 con 0x7f78ac0038e0 2023-08-17T00:17:09.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0069170 con 0x7f78ac004b80 2023-08-17T00:17:09.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac00b8e0 con 0x7f78c0068820 2023-08-17T00:17:09.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0038e0 0x7f78ac003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78b6ffd700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 0x7f78ac004690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bffff700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78ac004b80 0x7f78ac005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 -- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 msgr2=0x7f78ac004690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:09.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78c0068820 0x7f78ac004690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 -- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78ac004b80 msgr2=0x7f78ac005000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:09.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78ac004b80 0x7f78ac005000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.731+0000 7f78bf7fe700 1 -- 172.21.15.153:0/2478276290 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0033f0 con 0x7f78ac0038e0 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0038e0 0x7f78ac003d00 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f78b0006fd0 tx=0x7f78b0006f40).ready entity=mon.0 client_cookie=2a2be0c9a4b6c54d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0009430 con 0x7f78ac0038e0 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b000e640 con 0x7f78ac0038e0 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78beffd700 1 -- 172.21.15.153:0/2478276290 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b000e9c0 con 0x7f78ac0038e0 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78c488f700 1 -- 172.21.15.153:0/2478276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0038e0 msgr2=0x7f78ac003d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78c488f700 1 --2- 172.21.15.153:0/2478276290 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78ac0038e0 0x7f78ac003d00 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 rx=0x7f78b0006fd0 tx=0x7f78b0006f40).stop 2023-08-17T00:17:09.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78bffff700 1 -- 172.21.15.153:0/2478276290 reap_dead start 2023-08-17T00:17:09.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78c488f700 1 -- 172.21.15.153:0/2478276290 shutdown_connections 2023-08-17T00:17:09.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78c488f700 1 -- 172.21.15.153:0/2478276290 >> 172.21.15.153:0/2478276290 conn(0x7f78c00c6620 msgr2=0x7f78c00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:09.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78c488f700 1 -- 172.21.15.153:0/2478276290 shutdown_connections 2023-08-17T00:17:09.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.735+0000 7f78c488f700 1 -- 172.21.15.153:0/2478276290 wait complete. 2023-08-17T00:17:09.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 Processor -- start 2023-08-17T00:17:09.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 -- start start 2023-08-17T00:17:09.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78ac0038e0 0x7f78c0144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78c015e9d0 0x7f78c00b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 0x7f78c0159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c015ae00 con 0x7f78c00ba450 2023-08-17T00:17:09.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c00ba8d0 con 0x7f78c015e9d0 2023-08-17T00:17:09.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78c488f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c015a1f0 con 0x7f78ac0038e0 2023-08-17T00:17:09.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 0x7f78c0159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 0x7f78c0159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47104/0 (socket says 172.21.15.153:47104) 2023-08-17T00:17:09.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 -- 172.21.15.153:0/653961069 learned_addr learned my addr 172.21.15.153:0/653961069 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:09.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78b6ffd700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78c015e9d0 0x7f78c00b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78ac0038e0 0x7f78c0144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 -- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78ac0038e0 msgr2=0x7f78c0144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78ac0038e0 0x7f78c0144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 -- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78c015e9d0 msgr2=0x7f78c00b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.739+0000 7f78bffff700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78c015e9d0 0x7f78c00b9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78bffff700 1 -- 172.21.15.153:0/653961069 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c015a4d0 con 0x7f78c00ba450 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78bffff700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 0x7f78c0159570 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f78b8000f80 tx=0x7f78b80020e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800ee70 con 0x7f78c00ba450 2023-08-17T00:17:09.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800c7b0 con 0x7f78c00ba450 2023-08-17T00:17:09.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c015a7b0 con 0x7f78c00ba450 2023-08-17T00:17:09.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b800cb70 con 0x7f78c00ba450 2023-08-17T00:17:09.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c0159a60 con 0x7f78c00ba450 2023-08-17T00:17:09.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c006b4c0 con 0x7f78c00ba450 2023-08-17T00:17:09.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.743+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f78b8014430 con 0x7f78c00ba450 2023-08-17T00:17:09.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.747+0000 7f78b7fff700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78a005a150 0x7f78a005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:09.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.747+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f78b8073e30 con 0x7f78c00ba450 2023-08-17T00:17:09.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.747+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78a005a150 0x7f78a005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:09.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.747+0000 7f78bf7fe700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78a005a150 0x7f78a005c610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f78b0006f80 tx=0x7f78b001a000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:09.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.751+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f78b8047770 con 0x7f78c00ba450 2023-08-17T00:17:09.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.907+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78c0158150 con 0x7f78a005a150 2023-08-17T00:17:09.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.923+0000 7f78b7fff700 1 -- 172.21.15.153:0/653961069 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359510 (secure 0 0 0) 0x7f78c0158150 con 0x7f78a005a150 2023-08-17T00:17:09.931 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:09.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78a005a150 msgr2=0x7f78a005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78a005a150 0x7f78a005c610 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7f78b0006f80 tx=0x7f78b001a000).stop 2023-08-17T00:17:09.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 msgr2=0x7f78c0159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:09.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 0x7f78c0159570 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 rx=0x7f78b8000f80 tx=0x7f78b80020e0).stop 2023-08-17T00:17:09.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 shutdown_connections 2023-08-17T00:17:09.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f78a005a150 0x7f78a005c610 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f78c00ba450 0x7f78c0159570 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f78c015e9d0 0x7f78c00b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 --2- 172.21.15.153:0/653961069 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78ac0038e0 0x7f78c0144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:09.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 >> 172.21.15.153:0/653961069 conn(0x7f78c00c6620 msgr2=0x7f78c0062400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:09.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 shutdown_connections 2023-08-17T00:17:09.941 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:09.935+0000 7f78c488f700 1 -- 172.21.15.153:0/653961069 wait complete. 2023-08-17T00:17:09.942 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:17:09.961 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":618,"stamp":"2023-08-17T00:17:09.503014+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454048,"kb_used_data":18912,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520672,"statfs":{"total":773094113280,"available":770581168128,"internally_reserved":0,"allocated":19365888,"data_stored":9099332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308412,"num_objects":-1022,"num_object_clones":0,"num_object_copies":-2044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3060,"num_write_kb":-7683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-22,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.471758"},"pg_stats":[{"pgid":"28.38","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049084+0000","last_change":"2023-08-17T00:17:04.040967+0000","last_active":"2023-08-17T00:17:04.049084+0000","last_peered":"2023-08-17T00:17:04.049084+0000","last_clean":"2023-08-17T00:17:04.049084+0000","last_became_active":"2023-08-17T00:17:04.040675+0000","last_became_peered":"2023-08-17T00:17:04.040675+0000","last_unstale":"2023-08-17T00:17:04.049084+0000","last_undegraded":"2023-08-17T00:17:04.049084+0000","last_fullsized":"2023-08-17T00:17:04.049084+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055948+0000","last_change":"2023-08-17T00:17:03.602509+0000","last_active":"2023-08-17T00:17:04.055948+0000","last_peered":"2023-08-17T00:17:04.055948+0000","last_clean":"2023-08-17T00:17:04.055948+0000","last_became_active":"2023-08-17T00:17:03.600517+0000","last_became_peered":"2023-08-17T00:17:03.600517+0000","last_unstale":"2023-08-17T00:17:04.055948+0000","last_undegraded":"2023-08-17T00:17:04.055948+0000","last_fullsized":"2023-08-17T00:17:04.055948+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057466+0000","last_change":"2023-08-17T00:17:04.051198+0000","last_active":"2023-08-17T00:17:04.057466+0000","last_peered":"2023-08-17T00:17:04.057466+0000","last_clean":"2023-08-17T00:17:04.057466+0000","last_became_active":"2023-08-17T00:17:04.050838+0000","last_became_peered":"2023-08-17T00:17:04.050838+0000","last_unstale":"2023-08-17T00:17:04.057466+0000","last_undegraded":"2023-08-17T00:17:04.057466+0000","last_fullsized":"2023-08-17T00:17:04.057466+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032376+0000","last_change":"2023-08-17T00:17:03.604286+0000","last_active":"2023-08-17T00:17:04.032376+0000","last_peered":"2023-08-17T00:17:04.032376+0000","last_clean":"2023-08-17T00:17:04.032376+0000","last_became_active":"2023-08-17T00:17:03.603847+0000","last_became_peered":"2023-08-17T00:17:03.603847+0000","last_unstale":"2023-08-17T00:17:04.032376+0000","last_undegraded":"2023-08-17T00:17:04.032376+0000","last_fullsized":"2023-08-17T00:17:04.032376+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045431+0000","last_change":"2023-08-17T00:17:04.032945+0000","last_active":"2023-08-17T00:17:04.045431+0000","last_peered":"2023-08-17T00:17:04.045431+0000","last_clean":"2023-08-17T00:17:04.045431+0000","last_became_active":"2023-08-17T00:17:04.032690+0000","last_became_peered":"2023-08-17T00:17:04.032690+0000","last_unstale":"2023-08-17T00:17:04.045431+0000","last_undegraded":"2023-08-17T00:17:04.045431+0000","last_fullsized":"2023-08-17T00:17:04.045431+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040747+0000","last_change":"2023-08-17T00:17:03.610919+0000","last_active":"2023-08-17T00:17:04.040747+0000","last_peered":"2023-08-17T00:17:04.040747+0000","last_clean":"2023-08-17T00:17:04.040747+0000","last_became_active":"2023-08-17T00:17:03.610412+0000","last_became_peered":"2023-08-17T00:17:03.610412+0000","last_unstale":"2023-08-17T00:17:04.040747+0000","last_undegraded":"2023-08-17T00:17:04.040747+0000","last_fullsized":"2023-08-17T00:17:04.040747+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058183+0000","last_change":"2023-08-17T00:17:04.056564+0000","last_active":"2023-08-17T00:17:04.058183+0000","last_peered":"2023-08-17T00:17:04.058183+0000","last_clean":"2023-08-17T00:17:04.058183+0000","last_became_active":"2023-08-17T00:17:04.055878+0000","last_became_peered":"2023-08-17T00:17:04.055878+0000","last_unstale":"2023-08-17T00:17:04.058183+0000","last_undegraded":"2023-08-17T00:17:04.058183+0000","last_fullsized":"2023-08-17T00:17:04.058183+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3c","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053315+0000","last_change":"2023-08-17T00:17:03.607955+0000","last_active":"2023-08-17T00:17:04.053315+0000","last_peered":"2023-08-17T00:17:04.053315+0000","last_clean":"2023-08-17T00:17:04.053315+0000","last_became_active":"2023-08-17T00:17:03.605724+0000","last_became_peered":"2023-08-17T00:17:03.605724+0000","last_unstale":"2023-08-17T00:17:04.053315+0000","last_undegraded":"2023-08-17T00:17:04.053315+0000","last_fullsized":"2023-08-17T00:17:04.053315+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056394+0000","last_change":"2023-08-17T00:17:04.050546+0000","last_active":"2023-08-17T00:17:04.056394+0000","last_peered":"2023-08-17T00:17:04.056394+0000","last_clean":"2023-08-17T00:17:04.056394+0000","last_became_active":"2023-08-17T00:17:04.048601+0000","last_became_peered":"2023-08-17T00:17:04.048601+0000","last_unstale":"2023-08-17T00:17:04.056394+0000","last_undegraded":"2023-08-17T00:17:04.056394+0000","last_fullsized":"2023-08-17T00:17:04.056394+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045696+0000","last_change":"2023-08-17T00:17:03.609495+0000","last_active":"2023-08-17T00:17:04.045696+0000","last_peered":"2023-08-17T00:17:04.045696+0000","last_clean":"2023-08-17T00:17:04.045696+0000","last_became_active":"2023-08-17T00:17:03.609224+0000","last_became_peered":"2023-08-17T00:17:03.609224+0000","last_unstale":"2023-08-17T00:17:04.045696+0000","last_undegraded":"2023-08-17T00:17:04.045696+0000","last_fullsized":"2023-08-17T00:17:04.045696+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057402+0000","last_change":"2023-08-17T00:17:04.050914+0000","last_active":"2023-08-17T00:17:04.057402+0000","last_peered":"2023-08-17T00:17:04.057402+0000","last_clean":"2023-08-17T00:17:04.057402+0000","last_became_active":"2023-08-17T00:17:04.050552+0000","last_became_peered":"2023-08-17T00:17:04.050552+0000","last_unstale":"2023-08-17T00:17:04.057402+0000","last_undegraded":"2023-08-17T00:17:04.057402+0000","last_fullsized":"2023-08-17T00:17:04.057402+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3a","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044509+0000","last_change":"2023-08-17T00:17:03.592834+0000","last_active":"2023-08-17T00:17:04.044509+0000","last_peered":"2023-08-17T00:17:04.044509+0000","last_clean":"2023-08-17T00:17:04.044509+0000","last_became_active":"2023-08-17T00:17:03.592529+0000","last_became_peered":"2023-08-17T00:17:03.592529+0000","last_unstale":"2023-08-17T00:17:04.044509+0000","last_undegraded":"2023-08-17T00:17:04.044509+0000","last_fullsized":"2023-08-17T00:17:04.044509+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049216+0000","last_change":"2023-08-17T00:17:04.045779+0000","last_active":"2023-08-17T00:17:04.049216+0000","last_peered":"2023-08-17T00:17:04.049216+0000","last_clean":"2023-08-17T00:17:04.049216+0000","last_became_active":"2023-08-17T00:17:04.045489+0000","last_became_peered":"2023-08-17T00:17:04.045489+0000","last_unstale":"2023-08-17T00:17:04.049216+0000","last_undegraded":"2023-08-17T00:17:04.049216+0000","last_fullsized":"2023-08-17T00:17:04.049216+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.026280+0000","last_change":"2023-08-17T00:17:03.603048+0000","last_active":"2023-08-17T00:17:04.026280+0000","last_peered":"2023-08-17T00:17:04.026280+0000","last_clean":"2023-08-17T00:17:04.026280+0000","last_became_active":"2023-08-17T00:17:03.600931+0000","last_became_peered":"2023-08-17T00:17:03.600931+0000","last_unstale":"2023-08-17T00:17:04.026280+0000","last_undegraded":"2023-08-17T00:17:04.026280+0000","last_fullsized":"2023-08-17T00:17:04.026280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056023+0000","last_change":"2023-08-17T00:17:04.043639+0000","last_active":"2023-08-17T00:17:04.056023+0000","last_peered":"2023-08-17T00:17:04.056023+0000","last_clean":"2023-08-17T00:17:04.056023+0000","last_became_active":"2023-08-17T00:17:04.043074+0000","last_became_peered":"2023-08-17T00:17:04.043074+0000","last_unstale":"2023-08-17T00:17:04.056023+0000","last_undegraded":"2023-08-17T00:17:04.056023+0000","last_fullsized":"2023-08-17T00:17:04.056023+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025187+0000","last_change":"2023-08-17T00:17:03.607462+0000","last_active":"2023-08-17T00:17:04.025187+0000","last_peered":"2023-08-17T00:17:04.025187+0000","last_clean":"2023-08-17T00:17:04.025187+0000","last_became_active":"2023-08-17T00:17:03.607116+0000","last_became_peered":"2023-08-17T00:17:03.607116+0000","last_unstale":"2023-08-17T00:17:04.025187+0000","last_undegraded":"2023-08-17T00:17:04.025187+0000","last_fullsized":"2023-08-17T00:17:04.025187+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050917+0000","last_change":"2023-08-17T00:17:04.045697+0000","last_active":"2023-08-17T00:17:04.050917+0000","last_peered":"2023-08-17T00:17:04.050917+0000","last_clean":"2023-08-17T00:17:04.050917+0000","last_became_active":"2023-08-17T00:17:04.045400+0000","last_became_peered":"2023-08-17T00:17:04.045400+0000","last_unstale":"2023-08-17T00:17:04.050917+0000","last_undegraded":"2023-08-17T00:17:04.050917+0000","last_fullsized":"2023-08-17T00:17:04.050917+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042231+0000","last_change":"2023-08-17T00:17:03.597710+0000","last_active":"2023-08-17T00:17:04.042231+0000","last_peered":"2023-08-17T00:17:04.042231+0000","last_clean":"2023-08-17T00:17:04.042231+0000","last_became_active":"2023-08-17T00:17:03.597376+0000","last_became_peered":"2023-08-17T00:17:03.597376+0000","last_unstale":"2023-08-17T00:17:04.042231+0000","last_undegraded":"2023-08-17T00:17:04.042231+0000","last_fullsized":"2023-08-17T00:17:04.042231+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.061979+0000","last_change":"2023-08-17T00:17:04.058213+0000","last_active":"2023-08-17T00:17:04.061979+0000","last_peered":"2023-08-17T00:17:04.061979+0000","last_clean":"2023-08-17T00:17:04.061979+0000","last_became_active":"2023-08-17T00:17:04.057812+0000","last_became_peered":"2023-08-17T00:17:04.057812+0000","last_unstale":"2023-08-17T00:17:04.061979+0000","last_undegraded":"2023-08-17T00:17:04.061979+0000","last_fullsized":"2023-08-17T00:17:04.061979+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042752+0000","last_change":"2023-08-17T00:17:03.614190+0000","last_active":"2023-08-17T00:17:04.042752+0000","last_peered":"2023-08-17T00:17:04.042752+0000","last_clean":"2023-08-17T00:17:04.042752+0000","last_became_active":"2023-08-17T00:17:03.613882+0000","last_became_peered":"2023-08-17T00:17:03.613882+0000","last_unstale":"2023-08-17T00:17:04.042752+0000","last_undegraded":"2023-08-17T00:17:04.042752+0000","last_fullsized":"2023-08-17T00:17:04.042752+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054949+0000","last_change":"2023-08-17T00:17:04.040600+0000","last_active":"2023-08-17T00:17:04.054949+0000","last_peered":"2023-08-17T00:17:04.054949+0000","last_clean":"2023-08-17T00:17:04.054949+0000","last_became_active":"2023-08-17T00:17:04.040327+0000","last_became_peered":"2023-08-17T00:17:04.040327+0000","last_unstale":"2023-08-17T00:17:04.054949+0000","last_undegraded":"2023-08-17T00:17:04.054949+0000","last_fullsized":"2023-08-17T00:17:04.054949+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.029816+0000","last_change":"2023-08-17T00:17:03.606219+0000","last_active":"2023-08-17T00:17:04.029816+0000","last_peered":"2023-08-17T00:17:04.029816+0000","last_clean":"2023-08-17T00:17:04.029816+0000","last_became_active":"2023-08-17T00:17:03.605882+0000","last_became_peered":"2023-08-17T00:17:03.605882+0000","last_unstale":"2023-08-17T00:17:04.029816+0000","last_undegraded":"2023-08-17T00:17:04.029816+0000","last_fullsized":"2023-08-17T00:17:04.029816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059249+0000","last_change":"2023-08-17T00:17:04.056101+0000","last_active":"2023-08-17T00:17:04.059249+0000","last_peered":"2023-08-17T00:17:04.059249+0000","last_clean":"2023-08-17T00:17:04.059249+0000","last_became_active":"2023-08-17T00:17:04.055714+0000","last_became_peered":"2023-08-17T00:17:04.055714+0000","last_unstale":"2023-08-17T00:17:04.059249+0000","last_undegraded":"2023-08-17T00:17:04.059249+0000","last_fullsized":"2023-08-17T00:17:04.059249+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056479+0000","last_change":"2023-08-17T00:17:03.604784+0000","last_active":"2023-08-17T00:17:04.056479+0000","last_peered":"2023-08-17T00:17:04.056479+0000","last_clean":"2023-08-17T00:17:04.056479+0000","last_became_active":"2023-08-17T00:17:03.604488+0000","last_became_peered":"2023-08-17T00:17:03.604488+0000","last_unstale":"2023-08-17T00:17:04.056479+0000","last_undegraded":"2023-08-17T00:17:04.056479+0000","last_fullsized":"2023-08-17T00:17:04.056479+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053358+0000","last_change":"2023-08-17T00:17:04.048450+0000","last_active":"2023-08-17T00:17:04.053358+0000","last_peered":"2023-08-17T00:17:04.053358+0000","last_clean":"2023-08-17T00:17:04.053358+0000","last_became_active":"2023-08-17T00:17:04.048159+0000","last_became_peered":"2023-08-17T00:17:04.048159+0000","last_unstale":"2023-08-17T00:17:04.053358+0000","last_undegraded":"2023-08-17T00:17:04.053358+0000","last_fullsized":"2023-08-17T00:17:04.053358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055804+0000","last_change":"2023-08-17T00:17:03.611509+0000","last_active":"2023-08-17T00:17:04.055804+0000","last_peered":"2023-08-17T00:17:04.055804+0000","last_clean":"2023-08-17T00:17:04.055804+0000","last_became_active":"2023-08-17T00:17:03.610877+0000","last_became_peered":"2023-08-17T00:17:03.610877+0000","last_unstale":"2023-08-17T00:17:04.055804+0000","last_undegraded":"2023-08-17T00:17:04.055804+0000","last_fullsized":"2023-08-17T00:17:04.055804+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051902+0000","last_change":"2023-08-17T00:17:04.048382+0000","last_active":"2023-08-17T00:17:04.051902+0000","last_peered":"2023-08-17T00:17:04.051902+0000","last_clean":"2023-08-17T00:17:04.051902+0000","last_became_active":"2023-08-17T00:17:04.048079+0000","last_became_peered":"2023-08-17T00:17:04.048079+0000","last_unstale":"2023-08-17T00:17:04.051902+0000","last_undegraded":"2023-08-17T00:17:04.051902+0000","last_fullsized":"2023-08-17T00:17:04.051902+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.037833+0000","last_change":"2023-08-17T00:17:03.609075+0000","last_active":"2023-08-17T00:17:04.037833+0000","last_peered":"2023-08-17T00:17:04.037833+0000","last_clean":"2023-08-17T00:17:04.037833+0000","last_became_active":"2023-08-17T00:17:03.608809+0000","last_became_peered":"2023-08-17T00:17:03.608809+0000","last_unstale":"2023-08-17T00:17:04.037833+0000","last_undegraded":"2023-08-17T00:17:04.037833+0000","last_fullsized":"2023-08-17T00:17:04.037833+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054062+0000","last_change":"2023-08-17T00:17:04.038159+0000","last_active":"2023-08-17T00:17:04.054062+0000","last_peered":"2023-08-17T00:17:04.054062+0000","last_clean":"2023-08-17T00:17:04.054062+0000","last_became_active":"2023-08-17T00:17:04.037825+0000","last_became_peered":"2023-08-17T00:17:04.037825+0000","last_unstale":"2023-08-17T00:17:04.054062+0000","last_undegraded":"2023-08-17T00:17:04.054062+0000","last_fullsized":"2023-08-17T00:17:04.054062+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.027416+0000","last_change":"2023-08-17T00:17:03.597502+0000","last_active":"2023-08-17T00:17:04.027416+0000","last_peered":"2023-08-17T00:17:04.027416+0000","last_clean":"2023-08-17T00:17:04.027416+0000","last_became_active":"2023-08-17T00:17:03.597168+0000","last_became_peered":"2023-08-17T00:17:03.597168+0000","last_unstale":"2023-08-17T00:17:04.027416+0000","last_undegraded":"2023-08-17T00:17:04.027416+0000","last_fullsized":"2023-08-17T00:17:04.027416+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057023+0000","last_change":"2023-08-17T00:17:04.048095+0000","last_active":"2023-08-17T00:17:04.057023+0000","last_peered":"2023-08-17T00:17:04.057023+0000","last_clean":"2023-08-17T00:17:04.057023+0000","last_became_active":"2023-08-17T00:17:04.047658+0000","last_became_peered":"2023-08-17T00:17:04.047658+0000","last_unstale":"2023-08-17T00:17:04.057023+0000","last_undegraded":"2023-08-17T00:17:04.057023+0000","last_fullsized":"2023-08-17T00:17:04.057023+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.30","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055897+0000","last_change":"2023-08-17T00:17:03.600911+0000","last_active":"2023-08-17T00:17:04.055897+0000","last_peered":"2023-08-17T00:17:04.055897+0000","last_clean":"2023-08-17T00:17:04.055897+0000","last_became_active":"2023-08-17T00:17:03.600488+0000","last_became_peered":"2023-08-17T00:17:03.600488+0000","last_unstale":"2023-08-17T00:17:04.055897+0000","last_undegraded":"2023-08-17T00:17:04.055897+0000","last_fullsized":"2023-08-17T00:17:04.055897+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058012+0000","last_change":"2023-08-17T00:17:04.056919+0000","last_active":"2023-08-17T00:17:04.058012+0000","last_peered":"2023-08-17T00:17:04.058012+0000","last_clean":"2023-08-17T00:17:04.058012+0000","last_became_active":"2023-08-17T00:17:04.056440+0000","last_became_peered":"2023-08-17T00:17:04.056440+0000","last_unstale":"2023-08-17T00:17:04.058012+0000","last_undegraded":"2023-08-17T00:17:04.058012+0000","last_fullsized":"2023-08-17T00:17:04.058012+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.029534+0000","last_change":"2023-08-17T00:17:03.609894+0000","last_active":"2023-08-17T00:17:04.029534+0000","last_peered":"2023-08-17T00:17:04.029534+0000","last_clean":"2023-08-17T00:17:04.029534+0000","last_became_active":"2023-08-17T00:17:03.609602+0000","last_became_peered":"2023-08-17T00:17:03.609602+0000","last_unstale":"2023-08-17T00:17:04.029534+0000","last_undegraded":"2023-08-17T00:17:04.029534+0000","last_fullsized":"2023-08-17T00:17:04.029534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057446+0000","last_change":"2023-08-17T00:17:04.050491+0000","last_active":"2023-08-17T00:17:04.057446+0000","last_peered":"2023-08-17T00:17:04.057446+0000","last_clean":"2023-08-17T00:17:04.057446+0000","last_became_active":"2023-08-17T00:17:04.050001+0000","last_became_peered":"2023-08-17T00:17:04.050001+0000","last_unstale":"2023-08-17T00:17:04.057446+0000","last_undegraded":"2023-08-17T00:17:04.057446+0000","last_fullsized":"2023-08-17T00:17:04.057446+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042845+0000","last_change":"2023-08-17T00:17:03.611855+0000","last_active":"2023-08-17T00:17:04.042845+0000","last_peered":"2023-08-17T00:17:04.042845+0000","last_clean":"2023-08-17T00:17:04.042845+0000","last_became_active":"2023-08-17T00:17:03.611566+0000","last_became_peered":"2023-08-17T00:17:03.611566+0000","last_unstale":"2023-08-17T00:17:04.042845+0000","last_undegraded":"2023-08-17T00:17:04.042845+0000","last_fullsized":"2023-08-17T00:17:04.042845+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059096+0000","last_change":"2023-08-17T00:17:04.049971+0000","last_active":"2023-08-17T00:17:04.059096+0000","last_peered":"2023-08-17T00:17:04.059096+0000","last_clean":"2023-08-17T00:17:04.059096+0000","last_became_active":"2023-08-17T00:17:04.049710+0000","last_became_peered":"2023-08-17T00:17:04.049710+0000","last_unstale":"2023-08-17T00:17:04.059096+0000","last_undegraded":"2023-08-17T00:17:04.059096+0000","last_fullsized":"2023-08-17T00:17:04.059096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2d","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054421+0000","last_change":"2023-08-17T00:17:03.611104+0000","last_active":"2023-08-17T00:17:04.054421+0000","last_peered":"2023-08-17T00:17:04.054421+0000","last_clean":"2023-08-17T00:17:04.054421+0000","last_became_active":"2023-08-17T00:17:03.610764+0000","last_became_peered":"2023-08-17T00:17:03.610764+0000","last_unstale":"2023-08-17T00:17:04.054421+0000","last_undegraded":"2023-08-17T00:17:04.054421+0000","last_fullsized":"2023-08-17T00:17:04.054421+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057336+0000","last_change":"2023-08-17T00:17:04.054835+0000","last_active":"2023-08-17T00:17:04.057336+0000","last_peered":"2023-08-17T00:17:04.057336+0000","last_clean":"2023-08-17T00:17:04.057336+0000","last_became_active":"2023-08-17T00:17:04.054587+0000","last_became_peered":"2023-08-17T00:17:04.054587+0000","last_unstale":"2023-08-17T00:17:04.057336+0000","last_undegraded":"2023-08-17T00:17:04.057336+0000","last_fullsized":"2023-08-17T00:17:04.057336+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039701+0000","last_change":"2023-08-17T00:17:03.612980+0000","last_active":"2023-08-17T00:17:04.039701+0000","last_peered":"2023-08-17T00:17:04.039701+0000","last_clean":"2023-08-17T00:17:04.039701+0000","last_became_active":"2023-08-17T00:17:03.612688+0000","last_became_peered":"2023-08-17T00:17:03.612688+0000","last_unstale":"2023-08-17T00:17:04.039701+0000","last_undegraded":"2023-08-17T00:17:04.039701+0000","last_fullsized":"2023-08-17T00:17:04.039701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059178+0000","last_change":"2023-08-17T00:17:04.055847+0000","last_active":"2023-08-17T00:17:04.059178+0000","last_peered":"2023-08-17T00:17:04.059178+0000","last_clean":"2023-08-17T00:17:04.059178+0000","last_became_active":"2023-08-17T00:17:04.051524+0000","last_became_peered":"2023-08-17T00:17:04.051524+0000","last_unstale":"2023-08-17T00:17:04.059178+0000","last_undegraded":"2023-08-17T00:17:04.059178+0000","last_fullsized":"2023-08-17T00:17:04.059178+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054353+0000","last_change":"2023-08-17T00:17:03.606708+0000","last_active":"2023-08-17T00:17:04.054353+0000","last_peered":"2023-08-17T00:17:04.054353+0000","last_clean":"2023-08-17T00:17:04.054353+0000","last_became_active":"2023-08-17T00:17:03.606429+0000","last_became_peered":"2023-08-17T00:17:03.606429+0000","last_unstale":"2023-08-17T00:17:04.054353+0000","last_undegraded":"2023-08-17T00:17:04.054353+0000","last_fullsized":"2023-08-17T00:17:04.054353+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055258+0000","last_change":"2023-08-17T00:17:04.050797+0000","last_active":"2023-08-17T00:17:04.055258+0000","last_peered":"2023-08-17T00:17:04.055258+0000","last_clean":"2023-08-17T00:17:04.055258+0000","last_became_active":"2023-08-17T00:17:04.050543+0000","last_became_peered":"2023-08-17T00:17:04.050543+0000","last_unstale":"2023-08-17T00:17:04.055258+0000","last_undegraded":"2023-08-17T00:17:04.055258+0000","last_fullsized":"2023-08-17T00:17:04.055258+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035997+0000","last_change":"2023-08-17T00:17:03.597621+0000","last_active":"2023-08-17T00:17:04.035997+0000","last_peered":"2023-08-17T00:17:04.035997+0000","last_clean":"2023-08-17T00:17:04.035997+0000","last_became_active":"2023-08-17T00:17:03.597317+0000","last_became_peered":"2023-08-17T00:17:03.597317+0000","last_unstale":"2023-08-17T00:17:04.035997+0000","last_undegraded":"2023-08-17T00:17:04.035997+0000","last_fullsized":"2023-08-17T00:17:04.035997+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053492+0000","last_change":"2023-08-17T00:17:04.049264+0000","last_active":"2023-08-17T00:17:04.053492+0000","last_peered":"2023-08-17T00:17:04.053492+0000","last_clean":"2023-08-17T00:17:04.053492+0000","last_became_active":"2023-08-17T00:17:04.047002+0000","last_became_peered":"2023-08-17T00:17:04.047002+0000","last_unstale":"2023-08-17T00:17:04.053492+0000","last_undegraded":"2023-08-17T00:17:04.053492+0000","last_fullsized":"2023-08-17T00:17:04.053492+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032810+0000","last_change":"2023-08-17T00:17:03.599495+0000","last_active":"2023-08-17T00:17:04.032810+0000","last_peered":"2023-08-17T00:17:04.032810+0000","last_clean":"2023-08-17T00:17:04.032810+0000","last_became_active":"2023-08-17T00:17:03.599051+0000","last_became_peered":"2023-08-17T00:17:03.599051+0000","last_unstale":"2023-08-17T00:17:04.032810+0000","last_undegraded":"2023-08-17T00:17:04.032810+0000","last_fullsized":"2023-08-17T00:17:04.032810+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044945+0000","last_change":"2023-08-17T00:17:04.040949+0000","last_active":"2023-08-17T00:17:04.044945+0000","last_peered":"2023-08-17T00:17:04.044945+0000","last_clean":"2023-08-17T00:17:04.044945+0000","last_became_active":"2023-08-17T00:17:04.040663+0000","last_became_peered":"2023-08-17T00:17:04.040663+0000","last_unstale":"2023-08-17T00:17:04.044945+0000","last_undegraded":"2023-08-17T00:17:04.044945+0000","last_fullsized":"2023-08-17T00:17:04.044945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.036851+0000","last_change":"2023-08-17T00:17:03.601055+0000","last_active":"2023-08-17T00:17:04.036851+0000","last_peered":"2023-08-17T00:17:04.036851+0000","last_clean":"2023-08-17T00:17:04.036851+0000","last_became_active":"2023-08-17T00:17:03.600760+0000","last_became_peered":"2023-08-17T00:17:03.600760+0000","last_unstale":"2023-08-17T00:17:04.036851+0000","last_undegraded":"2023-08-17T00:17:04.036851+0000","last_fullsized":"2023-08-17T00:17:04.036851+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054201+0000","last_change":"2023-08-17T00:17:04.042770+0000","last_active":"2023-08-17T00:17:04.054201+0000","last_peered":"2023-08-17T00:17:04.054201+0000","last_clean":"2023-08-17T00:17:04.054201+0000","last_became_active":"2023-08-17T00:17:04.042363+0000","last_became_peered":"2023-08-17T00:17:04.042363+0000","last_unstale":"2023-08-17T00:17:04.054201+0000","last_undegraded":"2023-08-17T00:17:04.054201+0000","last_fullsized":"2023-08-17T00:17:04.054201+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034220+0000","last_change":"2023-08-17T00:17:03.610988+0000","last_active":"2023-08-17T00:17:04.034220+0000","last_peered":"2023-08-17T00:17:04.034220+0000","last_clean":"2023-08-17T00:17:04.034220+0000","last_became_active":"2023-08-17T00:17:03.609830+0000","last_became_peered":"2023-08-17T00:17:03.609830+0000","last_unstale":"2023-08-17T00:17:04.034220+0000","last_undegraded":"2023-08-17T00:17:04.034220+0000","last_fullsized":"2023-08-17T00:17:04.034220+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056075+0000","last_change":"2023-08-17T00:17:04.052392+0000","last_active":"2023-08-17T00:17:04.056075+0000","last_peered":"2023-08-17T00:17:04.056075+0000","last_clean":"2023-08-17T00:17:04.056075+0000","last_became_active":"2023-08-17T00:17:04.052134+0000","last_became_peered":"2023-08-17T00:17:04.052134+0000","last_unstale":"2023-08-17T00:17:04.056075+0000","last_undegraded":"2023-08-17T00:17:04.056075+0000","last_fullsized":"2023-08-17T00:17:04.056075+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025711+0000","last_change":"2023-08-17T00:17:03.595481+0000","last_active":"2023-08-17T00:17:04.025711+0000","last_peered":"2023-08-17T00:17:04.025711+0000","last_clean":"2023-08-17T00:17:04.025711+0000","last_became_active":"2023-08-17T00:17:03.595149+0000","last_became_peered":"2023-08-17T00:17:03.595149+0000","last_unstale":"2023-08-17T00:17:04.025711+0000","last_undegraded":"2023-08-17T00:17:04.025711+0000","last_fullsized":"2023-08-17T00:17:04.025711+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045453+0000","last_change":"2023-08-17T00:17:04.035061+0000","last_active":"2023-08-17T00:17:04.045453+0000","last_peered":"2023-08-17T00:17:04.045453+0000","last_clean":"2023-08-17T00:17:04.045453+0000","last_became_active":"2023-08-17T00:17:04.034776+0000","last_became_peered":"2023-08-17T00:17:04.034776+0000","last_unstale":"2023-08-17T00:17:04.045453+0000","last_undegraded":"2023-08-17T00:17:04.045453+0000","last_fullsized":"2023-08-17T00:17:04.045453+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022786+0000","last_change":"2023-08-17T00:17:03.607437+0000","last_active":"2023-08-17T00:17:04.022786+0000","last_peered":"2023-08-17T00:17:04.022786+0000","last_clean":"2023-08-17T00:17:04.022786+0000","last_became_active":"2023-08-17T00:17:03.603660+0000","last_became_peered":"2023-08-17T00:17:03.603660+0000","last_unstale":"2023-08-17T00:17:04.022786+0000","last_undegraded":"2023-08-17T00:17:04.022786+0000","last_fullsized":"2023-08-17T00:17:04.022786+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038525+0000","last_change":"2023-08-17T00:17:04.032614+0000","last_active":"2023-08-17T00:17:04.038525+0000","last_peered":"2023-08-17T00:17:04.038525+0000","last_clean":"2023-08-17T00:17:04.038525+0000","last_became_active":"2023-08-17T00:17:04.032240+0000","last_became_peered":"2023-08-17T00:17:04.032240+0000","last_unstale":"2023-08-17T00:17:04.038525+0000","last_undegraded":"2023-08-17T00:17:04.038525+0000","last_fullsized":"2023-08-17T00:17:04.038525+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025722+0000","last_change":"2023-08-17T00:17:03.608941+0000","last_active":"2023-08-17T00:17:04.025722+0000","last_peered":"2023-08-17T00:17:04.025722+0000","last_clean":"2023-08-17T00:17:04.025722+0000","last_became_active":"2023-08-17T00:17:03.608636+0000","last_became_peered":"2023-08-17T00:17:03.608636+0000","last_unstale":"2023-08-17T00:17:04.025722+0000","last_undegraded":"2023-08-17T00:17:04.025722+0000","last_fullsized":"2023-08-17T00:17:04.025722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053581+0000","last_change":"2023-08-17T00:17:04.050969+0000","last_active":"2023-08-17T00:17:04.053581+0000","last_peered":"2023-08-17T00:17:04.053581+0000","last_clean":"2023-08-17T00:17:04.053581+0000","last_became_active":"2023-08-17T00:17:04.050486+0000","last_became_peered":"2023-08-17T00:17:04.050486+0000","last_unstale":"2023-08-17T00:17:04.053581+0000","last_undegraded":"2023-08-17T00:17:04.053581+0000","last_fullsized":"2023-08-17T00:17:04.053581+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032040+0000","last_change":"2023-08-17T00:17:03.597907+0000","last_active":"2023-08-17T00:17:04.032040+0000","last_peered":"2023-08-17T00:17:04.032040+0000","last_clean":"2023-08-17T00:17:04.032040+0000","last_became_active":"2023-08-17T00:17:03.597644+0000","last_became_peered":"2023-08-17T00:17:03.597644+0000","last_unstale":"2023-08-17T00:17:04.032040+0000","last_undegraded":"2023-08-17T00:17:04.032040+0000","last_fullsized":"2023-08-17T00:17:04.032040+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058180+0000","last_change":"2023-08-17T00:17:04.056716+0000","last_active":"2023-08-17T00:17:04.058180+0000","last_peered":"2023-08-17T00:17:04.058180+0000","last_clean":"2023-08-17T00:17:04.058180+0000","last_became_active":"2023-08-17T00:17:04.055773+0000","last_became_peered":"2023-08-17T00:17:04.055773+0000","last_unstale":"2023-08-17T00:17:04.058180+0000","last_undegraded":"2023-08-17T00:17:04.058180+0000","last_fullsized":"2023-08-17T00:17:04.058180+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.036565+0000","last_change":"2023-08-17T00:17:03.611346+0000","last_active":"2023-08-17T00:17:04.036565+0000","last_peered":"2023-08-17T00:17:04.036565+0000","last_clean":"2023-08-17T00:17:04.036565+0000","last_became_active":"2023-08-17T00:17:03.611004+0000","last_became_peered":"2023-08-17T00:17:03.611004+0000","last_unstale":"2023-08-17T00:17:04.036565+0000","last_undegraded":"2023-08-17T00:17:04.036565+0000","last_fullsized":"2023-08-17T00:17:04.036565+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051645+0000","last_change":"2023-08-17T00:17:04.048187+0000","last_active":"2023-08-17T00:17:04.051645+0000","last_peered":"2023-08-17T00:17:04.051645+0000","last_clean":"2023-08-17T00:17:04.051645+0000","last_became_active":"2023-08-17T00:17:04.047889+0000","last_became_peered":"2023-08-17T00:17:04.047889+0000","last_unstale":"2023-08-17T00:17:04.051645+0000","last_undegraded":"2023-08-17T00:17:04.051645+0000","last_fullsized":"2023-08-17T00:17:04.051645+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035526+0000","last_change":"2023-08-17T00:17:03.613617+0000","last_active":"2023-08-17T00:17:04.035526+0000","last_peered":"2023-08-17T00:17:04.035526+0000","last_clean":"2023-08-17T00:17:04.035526+0000","last_became_active":"2023-08-17T00:17:03.612763+0000","last_became_peered":"2023-08-17T00:17:03.612763+0000","last_unstale":"2023-08-17T00:17:04.035526+0000","last_undegraded":"2023-08-17T00:17:04.035526+0000","last_fullsized":"2023-08-17T00:17:04.035526+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051952+0000","last_change":"2023-08-17T00:17:04.049571+0000","last_active":"2023-08-17T00:17:04.051952+0000","last_peered":"2023-08-17T00:17:04.051952+0000","last_clean":"2023-08-17T00:17:04.051952+0000","last_became_active":"2023-08-17T00:17:04.049298+0000","last_became_peered":"2023-08-17T00:17:04.049298+0000","last_unstale":"2023-08-17T00:17:04.051952+0000","last_undegraded":"2023-08-17T00:17:04.051952+0000","last_fullsized":"2023-08-17T00:17:04.051952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034070+0000","last_change":"2023-08-17T00:17:03.596004+0000","last_active":"2023-08-17T00:17:04.034070+0000","last_peered":"2023-08-17T00:17:04.034070+0000","last_clean":"2023-08-17T00:17:04.034070+0000","last_became_active":"2023-08-17T00:17:03.595679+0000","last_became_peered":"2023-08-17T00:17:03.595679+0000","last_unstale":"2023-08-17T00:17:04.034070+0000","last_undegraded":"2023-08-17T00:17:04.034070+0000","last_fullsized":"2023-08-17T00:17:04.034070+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056080+0000","last_change":"2023-08-17T00:17:04.045491+0000","last_active":"2023-08-17T00:17:04.056080+0000","last_peered":"2023-08-17T00:17:04.056080+0000","last_clean":"2023-08-17T00:17:04.056080+0000","last_became_active":"2023-08-17T00:17:04.044996+0000","last_became_peered":"2023-08-17T00:17:04.044996+0000","last_unstale":"2023-08-17T00:17:04.056080+0000","last_undegraded":"2023-08-17T00:17:04.056080+0000","last_fullsized":"2023-08-17T00:17:04.056080+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038080+0000","last_change":"2023-08-17T00:17:03.596073+0000","last_active":"2023-08-17T00:17:04.038080+0000","last_peered":"2023-08-17T00:17:04.038080+0000","last_clean":"2023-08-17T00:17:04.038080+0000","last_became_active":"2023-08-17T00:17:03.595733+0000","last_became_peered":"2023-08-17T00:17:03.595733+0000","last_unstale":"2023-08-17T00:17:04.038080+0000","last_undegraded":"2023-08-17T00:17:04.038080+0000","last_fullsized":"2023-08-17T00:17:04.038080+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050767+0000","last_change":"2023-08-17T00:17:04.045670+0000","last_active":"2023-08-17T00:17:04.050767+0000","last_peered":"2023-08-17T00:17:04.050767+0000","last_clean":"2023-08-17T00:17:04.050767+0000","last_became_active":"2023-08-17T00:17:04.045375+0000","last_became_peered":"2023-08-17T00:17:04.045375+0000","last_unstale":"2023-08-17T00:17:04.050767+0000","last_undegraded":"2023-08-17T00:17:04.050767+0000","last_fullsized":"2023-08-17T00:17:04.050767+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034395+0000","last_change":"2023-08-17T00:17:03.609853+0000","last_active":"2023-08-17T00:17:04.034395+0000","last_peered":"2023-08-17T00:17:04.034395+0000","last_clean":"2023-08-17T00:17:04.034395+0000","last_became_active":"2023-08-17T00:17:03.609486+0000","last_became_peered":"2023-08-17T00:17:03.609486+0000","last_unstale":"2023-08-17T00:17:04.034395+0000","last_undegraded":"2023-08-17T00:17:04.034395+0000","last_fullsized":"2023-08-17T00:17:04.034395+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057622+0000","last_change":"2023-08-17T00:17:04.056410+0000","last_active":"2023-08-17T00:17:04.057622+0000","last_peered":"2023-08-17T00:17:04.057622+0000","last_clean":"2023-08-17T00:17:04.057622+0000","last_became_active":"2023-08-17T00:17:04.056085+0000","last_became_peered":"2023-08-17T00:17:04.056085+0000","last_unstale":"2023-08-17T00:17:04.057622+0000","last_undegraded":"2023-08-17T00:17:04.057622+0000","last_fullsized":"2023-08-17T00:17:04.057622+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.15","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054056+0000","last_change":"2023-08-17T00:17:03.601584+0000","last_active":"2023-08-17T00:17:04.054056+0000","last_peered":"2023-08-17T00:17:04.054056+0000","last_clean":"2023-08-17T00:17:04.054056+0000","last_became_active":"2023-08-17T00:17:03.601218+0000","last_became_peered":"2023-08-17T00:17:03.601218+0000","last_unstale":"2023-08-17T00:17:04.054056+0000","last_undegraded":"2023-08-17T00:17:04.054056+0000","last_fullsized":"2023-08-17T00:17:04.054056+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058154+0000","last_change":"2023-08-17T00:17:04.056552+0000","last_active":"2023-08-17T00:17:04.058154+0000","last_peered":"2023-08-17T00:17:04.058154+0000","last_clean":"2023-08-17T00:17:04.058154+0000","last_became_active":"2023-08-17T00:17:04.055842+0000","last_became_peered":"2023-08-17T00:17:04.055842+0000","last_unstale":"2023-08-17T00:17:04.058154+0000","last_undegraded":"2023-08-17T00:17:04.058154+0000","last_fullsized":"2023-08-17T00:17:04.058154+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.14","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056352+0000","last_change":"2023-08-17T00:17:03.600325+0000","last_active":"2023-08-17T00:17:04.056352+0000","last_peered":"2023-08-17T00:17:04.056352+0000","last_clean":"2023-08-17T00:17:04.056352+0000","last_became_active":"2023-08-17T00:17:03.600007+0000","last_became_peered":"2023-08-17T00:17:03.600007+0000","last_unstale":"2023-08-17T00:17:04.056352+0000","last_undegraded":"2023-08-17T00:17:04.056352+0000","last_fullsized":"2023-08-17T00:17:04.056352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044551+0000","last_change":"2023-08-17T00:17:04.033044+0000","last_active":"2023-08-17T00:17:04.044551+0000","last_peered":"2023-08-17T00:17:04.044551+0000","last_clean":"2023-08-17T00:17:04.044551+0000","last_became_active":"2023-08-17T00:17:04.032572+0000","last_became_peered":"2023-08-17T00:17:04.032572+0000","last_unstale":"2023-08-17T00:17:04.044551+0000","last_undegraded":"2023-08-17T00:17:04.044551+0000","last_fullsized":"2023-08-17T00:17:04.044551+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.13","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054893+0000","last_change":"2023-08-17T00:17:03.611763+0000","last_active":"2023-08-17T00:17:04.054893+0000","last_peered":"2023-08-17T00:17:04.054893+0000","last_clean":"2023-08-17T00:17:04.054893+0000","last_became_active":"2023-08-17T00:17:03.611425+0000","last_became_peered":"2023-08-17T00:17:03.611425+0000","last_unstale":"2023-08-17T00:17:04.054893+0000","last_undegraded":"2023-08-17T00:17:04.054893+0000","last_fullsized":"2023-08-17T00:17:04.054893+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057384+0000","last_change":"2023-08-17T00:17:04.050251+0000","last_active":"2023-08-17T00:17:04.057384+0000","last_peered":"2023-08-17T00:17:04.057384+0000","last_clean":"2023-08-17T00:17:04.057384+0000","last_became_active":"2023-08-17T00:17:04.049738+0000","last_became_peered":"2023-08-17T00:17:04.049738+0000","last_unstale":"2023-08-17T00:17:04.057384+0000","last_undegraded":"2023-08-17T00:17:04.057384+0000","last_fullsized":"2023-08-17T00:17:04.057384+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.037964+0000","last_change":"2023-08-17T00:17:03.600255+0000","last_active":"2023-08-17T00:17:04.037964+0000","last_peered":"2023-08-17T00:17:04.037964+0000","last_clean":"2023-08-17T00:17:04.037964+0000","last_became_active":"2023-08-17T00:17:03.599911+0000","last_became_peered":"2023-08-17T00:17:03.599911+0000","last_unstale":"2023-08-17T00:17:04.037964+0000","last_undegraded":"2023-08-17T00:17:04.037964+0000","last_fullsized":"2023-08-17T00:17:04.037964+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053470+0000","last_change":"2023-08-17T00:17:04.046927+0000","last_active":"2023-08-17T00:17:04.053470+0000","last_peered":"2023-08-17T00:17:04.053470+0000","last_clean":"2023-08-17T00:17:04.053470+0000","last_became_active":"2023-08-17T00:17:04.046626+0000","last_became_peered":"2023-08-17T00:17:04.046626+0000","last_unstale":"2023-08-17T00:17:04.053470+0000","last_undegraded":"2023-08-17T00:17:04.053470+0000","last_fullsized":"2023-08-17T00:17:04.053470+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.027262+0000","last_change":"2023-08-17T00:17:03.604322+0000","last_active":"2023-08-17T00:17:04.027262+0000","last_peered":"2023-08-17T00:17:04.027262+0000","last_clean":"2023-08-17T00:17:04.027262+0000","last_became_active":"2023-08-17T00:17:03.603995+0000","last_became_peered":"2023-08-17T00:17:03.603995+0000","last_unstale":"2023-08-17T00:17:04.027262+0000","last_undegraded":"2023-08-17T00:17:04.027262+0000","last_fullsized":"2023-08-17T00:17:04.027262+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.061860+0000","last_change":"2023-08-17T00:17:04.053850+0000","last_active":"2023-08-17T00:17:04.061860+0000","last_peered":"2023-08-17T00:17:04.061860+0000","last_clean":"2023-08-17T00:17:04.061860+0000","last_became_active":"2023-08-17T00:17:04.053597+0000","last_became_peered":"2023-08-17T00:17:04.053597+0000","last_unstale":"2023-08-17T00:17:04.061860+0000","last_undegraded":"2023-08-17T00:17:04.061860+0000","last_fullsized":"2023-08-17T00:17:04.061860+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047657+0000","last_change":"2023-08-17T00:17:03.606608+0000","last_active":"2023-08-17T00:17:04.047657+0000","last_peered":"2023-08-17T00:17:04.047657+0000","last_clean":"2023-08-17T00:17:04.047657+0000","last_became_active":"2023-08-17T00:17:03.606317+0000","last_became_peered":"2023-08-17T00:17:03.606317+0000","last_unstale":"2023-08-17T00:17:04.047657+0000","last_undegraded":"2023-08-17T00:17:04.047657+0000","last_fullsized":"2023-08-17T00:17:04.047657+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054182+0000","last_change":"2023-08-17T00:17:04.042596+0000","last_active":"2023-08-17T00:17:04.054182+0000","last_peered":"2023-08-17T00:17:04.054182+0000","last_clean":"2023-08-17T00:17:04.054182+0000","last_became_active":"2023-08-17T00:17:04.042057+0000","last_became_peered":"2023-08-17T00:17:04.042057+0000","last_unstale":"2023-08-17T00:17:04.054182+0000","last_undegraded":"2023-08-17T00:17:04.054182+0000","last_fullsized":"2023-08-17T00:17:04.054182+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046244+0000","last_change":"2023-08-17T00:17:03.608573+0000","last_active":"2023-08-17T00:17:04.046244+0000","last_peered":"2023-08-17T00:17:04.046244+0000","last_clean":"2023-08-17T00:17:04.046244+0000","last_became_active":"2023-08-17T00:17:03.608193+0000","last_became_peered":"2023-08-17T00:17:03.608193+0000","last_unstale":"2023-08-17T00:17:04.046244+0000","last_undegraded":"2023-08-17T00:17:04.046244+0000","last_fullsized":"2023-08-17T00:17:04.046244+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057020+0000","last_change":"2023-08-17T00:17:04.053237+0000","last_active":"2023-08-17T00:17:04.057020+0000","last_peered":"2023-08-17T00:17:04.057020+0000","last_clean":"2023-08-17T00:17:04.057020+0000","last_became_active":"2023-08-17T00:17:04.052979+0000","last_became_peered":"2023-08-17T00:17:04.052979+0000","last_unstale":"2023-08-17T00:17:04.057020+0000","last_undegraded":"2023-08-17T00:17:04.057020+0000","last_fullsized":"2023-08-17T00:17:04.057020+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.e","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048095+0000","last_change":"2023-08-17T00:17:03.604251+0000","last_active":"2023-08-17T00:17:04.048095+0000","last_peered":"2023-08-17T00:17:04.048095+0000","last_clean":"2023-08-17T00:17:04.048095+0000","last_became_active":"2023-08-17T00:17:03.603083+0000","last_became_peered":"2023-08-17T00:17:03.603083+0000","last_unstale":"2023-08-17T00:17:04.048095+0000","last_undegraded":"2023-08-17T00:17:04.048095+0000","last_fullsized":"2023-08-17T00:17:04.048095+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050118+0000","last_change":"2023-08-17T00:17:04.047137+0000","last_active":"2023-08-17T00:17:04.050118+0000","last_peered":"2023-08-17T00:17:04.050118+0000","last_clean":"2023-08-17T00:17:04.050118+0000","last_became_active":"2023-08-17T00:17:04.046858+0000","last_became_peered":"2023-08-17T00:17:04.046858+0000","last_unstale":"2023-08-17T00:17:04.050118+0000","last_undegraded":"2023-08-17T00:17:04.050118+0000","last_fullsized":"2023-08-17T00:17:04.050118+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.029440+0000","last_change":"2023-08-17T00:17:03.601090+0000","last_active":"2023-08-17T00:17:04.029440+0000","last_peered":"2023-08-17T00:17:04.029440+0000","last_clean":"2023-08-17T00:17:04.029440+0000","last_became_active":"2023-08-17T00:17:03.600472+0000","last_became_peered":"2023-08-17T00:17:03.600472+0000","last_unstale":"2023-08-17T00:17:04.029440+0000","last_undegraded":"2023-08-17T00:17:04.029440+0000","last_fullsized":"2023-08-17T00:17:04.029440+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.061903+0000","last_change":"2023-08-17T00:17:04.056944+0000","last_active":"2023-08-17T00:17:04.061903+0000","last_peered":"2023-08-17T00:17:04.061903+0000","last_clean":"2023-08-17T00:17:04.061903+0000","last_became_active":"2023-08-17T00:17:04.056627+0000","last_became_peered":"2023-08-17T00:17:04.056627+0000","last_unstale":"2023-08-17T00:17:04.061903+0000","last_undegraded":"2023-08-17T00:17:04.061903+0000","last_fullsized":"2023-08-17T00:17:04.061903+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040018+0000","last_change":"2023-08-17T00:17:03.615987+0000","last_active":"2023-08-17T00:17:04.040018+0000","last_peered":"2023-08-17T00:17:04.040018+0000","last_clean":"2023-08-17T00:17:04.040018+0000","last_became_active":"2023-08-17T00:17:03.615694+0000","last_became_peered":"2023-08-17T00:17:03.615694+0000","last_unstale":"2023-08-17T00:17:04.040018+0000","last_undegraded":"2023-08-17T00:17:04.040018+0000","last_fullsized":"2023-08-17T00:17:04.040018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053562+0000","last_change":"2023-08-17T00:17:04.050789+0000","last_active":"2023-08-17T00:17:04.053562+0000","last_peered":"2023-08-17T00:17:04.053562+0000","last_clean":"2023-08-17T00:17:04.053562+0000","last_became_active":"2023-08-17T00:17:04.050094+0000","last_became_peered":"2023-08-17T00:17:04.050094+0000","last_unstale":"2023-08-17T00:17:04.053562+0000","last_undegraded":"2023-08-17T00:17:04.053562+0000","last_fullsized":"2023-08-17T00:17:04.053562+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046352+0000","last_change":"2023-08-17T00:17:03.606480+0000","last_active":"2023-08-17T00:17:04.046352+0000","last_peered":"2023-08-17T00:17:04.046352+0000","last_clean":"2023-08-17T00:17:04.046352+0000","last_became_active":"2023-08-17T00:17:03.606201+0000","last_became_peered":"2023-08-17T00:17:03.606201+0000","last_unstale":"2023-08-17T00:17:04.046352+0000","last_undegraded":"2023-08-17T00:17:04.046352+0000","last_fullsized":"2023-08-17T00:17:04.046352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049052+0000","last_change":"2023-08-17T00:17:04.040428+0000","last_active":"2023-08-17T00:17:04.049052+0000","last_peered":"2023-08-17T00:17:04.049052+0000","last_clean":"2023-08-17T00:17:04.049052+0000","last_became_active":"2023-08-17T00:17:04.040152+0000","last_became_peered":"2023-08-17T00:17:04.040152+0000","last_unstale":"2023-08-17T00:17:04.049052+0000","last_undegraded":"2023-08-17T00:17:04.049052+0000","last_fullsized":"2023-08-17T00:17:04.049052+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039093+0000","last_change":"2023-08-17T00:17:03.612657+0000","last_active":"2023-08-17T00:17:04.039093+0000","last_peered":"2023-08-17T00:17:04.039093+0000","last_clean":"2023-08-17T00:17:04.039093+0000","last_became_active":"2023-08-17T00:17:03.612391+0000","last_became_peered":"2023-08-17T00:17:03.612391+0000","last_unstale":"2023-08-17T00:17:04.039093+0000","last_undegraded":"2023-08-17T00:17:04.039093+0000","last_fullsized":"2023-08-17T00:17:04.039093+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051994+0000","last_change":"2023-08-17T00:17:04.048967+0000","last_active":"2023-08-17T00:17:04.051994+0000","last_peered":"2023-08-17T00:17:04.051994+0000","last_clean":"2023-08-17T00:17:04.051994+0000","last_became_active":"2023-08-17T00:17:04.048659+0000","last_became_peered":"2023-08-17T00:17:04.048659+0000","last_unstale":"2023-08-17T00:17:04.051994+0000","last_undegraded":"2023-08-17T00:17:04.051994+0000","last_fullsized":"2023-08-17T00:17:04.051994+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032901+0000","last_change":"2023-08-17T00:17:03.611238+0000","last_active":"2023-08-17T00:17:04.032901+0000","last_peered":"2023-08-17T00:17:04.032901+0000","last_clean":"2023-08-17T00:17:04.032901+0000","last_became_active":"2023-08-17T00:17:03.609987+0000","last_became_peered":"2023-08-17T00:17:03.609987+0000","last_unstale":"2023-08-17T00:17:04.032901+0000","last_undegraded":"2023-08-17T00:17:04.032901+0000","last_fullsized":"2023-08-17T00:17:04.032901+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059113+0000","last_change":"2023-08-17T00:17:04.050256+0000","last_active":"2023-08-17T00:17:04.059113+0000","last_peered":"2023-08-17T00:17:04.059113+0000","last_clean":"2023-08-17T00:17:04.059113+0000","last_became_active":"2023-08-17T00:17:04.049997+0000","last_became_peered":"2023-08-17T00:17:04.049997+0000","last_unstale":"2023-08-17T00:17:04.059113+0000","last_undegraded":"2023-08-17T00:17:04.059113+0000","last_fullsized":"2023-08-17T00:17:04.059113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.030393+0000","last_change":"2023-08-17T00:17:03.608995+0000","last_active":"2023-08-17T00:17:04.030393+0000","last_peered":"2023-08-17T00:17:04.030393+0000","last_clean":"2023-08-17T00:17:04.030393+0000","last_became_active":"2023-08-17T00:17:03.608716+0000","last_became_peered":"2023-08-17T00:17:03.608716+0000","last_unstale":"2023-08-17T00:17:04.030393+0000","last_undegraded":"2023-08-17T00:17:04.030393+0000","last_fullsized":"2023-08-17T00:17:04.030393+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049037+0000","last_change":"2023-08-17T00:17:04.039299+0000","last_active":"2023-08-17T00:17:04.049037+0000","last_peered":"2023-08-17T00:17:04.049037+0000","last_clean":"2023-08-17T00:17:04.049037+0000","last_became_active":"2023-08-17T00:17:04.039008+0000","last_became_peered":"2023-08-17T00:17:04.039008+0000","last_unstale":"2023-08-17T00:17:04.049037+0000","last_undegraded":"2023-08-17T00:17:04.049037+0000","last_fullsized":"2023-08-17T00:17:04.049037+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.7","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055739+0000","last_change":"2023-08-17T00:17:03.604168+0000","last_active":"2023-08-17T00:17:04.055739+0000","last_peered":"2023-08-17T00:17:04.055739+0000","last_clean":"2023-08-17T00:17:04.055739+0000","last_became_active":"2023-08-17T00:17:03.603901+0000","last_became_peered":"2023-08-17T00:17:03.603901+0000","last_unstale":"2023-08-17T00:17:04.055739+0000","last_undegraded":"2023-08-17T00:17:04.055739+0000","last_fullsized":"2023-08-17T00:17:04.055739+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057426+0000","last_change":"2023-08-17T00:17:04.050279+0000","last_active":"2023-08-17T00:17:04.057426+0000","last_peered":"2023-08-17T00:17:04.057426+0000","last_clean":"2023-08-17T00:17:04.057426+0000","last_became_active":"2023-08-17T00:17:04.049619+0000","last_became_peered":"2023-08-17T00:17:04.049619+0000","last_unstale":"2023-08-17T00:17:04.057426+0000","last_undegraded":"2023-08-17T00:17:04.057426+0000","last_fullsized":"2023-08-17T00:17:04.057426+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.023559+0000","last_change":"2023-08-17T00:17:03.598312+0000","last_active":"2023-08-17T00:17:04.023559+0000","last_peered":"2023-08-17T00:17:04.023559+0000","last_clean":"2023-08-17T00:17:04.023559+0000","last_became_active":"2023-08-17T00:17:03.597966+0000","last_became_peered":"2023-08-17T00:17:03.597966+0000","last_unstale":"2023-08-17T00:17:04.023559+0000","last_undegraded":"2023-08-17T00:17:04.023559+0000","last_fullsized":"2023-08-17T00:17:04.023559+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056119+0000","last_change":"2023-08-17T00:17:04.054458+0000","last_active":"2023-08-17T00:17:04.056119+0000","last_peered":"2023-08-17T00:17:04.056119+0000","last_clean":"2023-08-17T00:17:04.056119+0000","last_became_active":"2023-08-17T00:17:04.054168+0000","last_became_peered":"2023-08-17T00:17:04.054168+0000","last_unstale":"2023-08-17T00:17:04.056119+0000","last_undegraded":"2023-08-17T00:17:04.056119+0000","last_fullsized":"2023-08-17T00:17:04.056119+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022921+0000","last_change":"2023-08-17T00:17:03.600702+0000","last_active":"2023-08-17T00:17:04.022921+0000","last_peered":"2023-08-17T00:17:04.022921+0000","last_clean":"2023-08-17T00:17:04.022921+0000","last_became_active":"2023-08-17T00:17:03.600329+0000","last_became_peered":"2023-08-17T00:17:03.600329+0000","last_unstale":"2023-08-17T00:17:04.022921+0000","last_undegraded":"2023-08-17T00:17:04.022921+0000","last_fullsized":"2023-08-17T00:17:04.022921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056644+0000","last_change":"2023-08-17T00:17:04.048843+0000","last_active":"2023-08-17T00:17:04.056644+0000","last_peered":"2023-08-17T00:17:04.056644+0000","last_clean":"2023-08-17T00:17:04.056644+0000","last_became_active":"2023-08-17T00:17:04.048452+0000","last_became_peered":"2023-08-17T00:17:04.048452+0000","last_unstale":"2023-08-17T00:17:04.056644+0000","last_undegraded":"2023-08-17T00:17:04.056644+0000","last_fullsized":"2023-08-17T00:17:04.056644+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032195+0000","last_change":"2023-08-17T00:17:03.601397+0000","last_active":"2023-08-17T00:17:04.032195+0000","last_peered":"2023-08-17T00:17:04.032195+0000","last_clean":"2023-08-17T00:17:04.032195+0000","last_became_active":"2023-08-17T00:17:03.601090+0000","last_became_peered":"2023-08-17T00:17:03.601090+0000","last_unstale":"2023-08-17T00:17:04.032195+0000","last_undegraded":"2023-08-17T00:17:04.032195+0000","last_fullsized":"2023-08-17T00:17:04.032195+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056057+0000","last_change":"2023-08-17T00:17:04.044730+0000","last_active":"2023-08-17T00:17:04.056057+0000","last_peered":"2023-08-17T00:17:04.056057+0000","last_clean":"2023-08-17T00:17:04.056057+0000","last_became_active":"2023-08-17T00:17:04.044474+0000","last_became_peered":"2023-08-17T00:17:04.044474+0000","last_unstale":"2023-08-17T00:17:04.056057+0000","last_undegraded":"2023-08-17T00:17:04.056057+0000","last_fullsized":"2023-08-17T00:17:04.056057+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032141+0000","last_change":"2023-08-17T00:17:03.604924+0000","last_active":"2023-08-17T00:17:04.032141+0000","last_peered":"2023-08-17T00:17:04.032141+0000","last_clean":"2023-08-17T00:17:04.032141+0000","last_became_active":"2023-08-17T00:17:03.604666+0000","last_became_peered":"2023-08-17T00:17:03.604666+0000","last_unstale":"2023-08-17T00:17:04.032141+0000","last_undegraded":"2023-08-17T00:17:04.032141+0000","last_fullsized":"2023-08-17T00:17:04.032141+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054934+0000","last_change":"2023-08-17T00:17:04.052415+0000","last_active":"2023-08-17T00:17:04.054934+0000","last_peered":"2023-08-17T00:17:04.054934+0000","last_clean":"2023-08-17T00:17:04.054934+0000","last_became_active":"2023-08-17T00:17:04.052144+0000","last_became_peered":"2023-08-17T00:17:04.052144+0000","last_unstale":"2023-08-17T00:17:04.054934+0000","last_undegraded":"2023-08-17T00:17:04.054934+0000","last_fullsized":"2023-08-17T00:17:04.054934+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028728+0000","last_change":"2023-08-17T00:17:03.604890+0000","last_active":"2023-08-17T00:17:04.028728+0000","last_peered":"2023-08-17T00:17:04.028728+0000","last_clean":"2023-08-17T00:17:04.028728+0000","last_became_active":"2023-08-17T00:17:03.604627+0000","last_became_peered":"2023-08-17T00:17:03.604627+0000","last_unstale":"2023-08-17T00:17:04.028728+0000","last_undegraded":"2023-08-17T00:17:04.028728+0000","last_fullsized":"2023-08-17T00:17:04.028728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049187+0000","last_change":"2023-08-17T00:17:04.040497+0000","last_active":"2023-08-17T00:17:04.049187+0000","last_peered":"2023-08-17T00:17:04.049187+0000","last_clean":"2023-08-17T00:17:04.049187+0000","last_became_active":"2023-08-17T00:17:04.039861+0000","last_became_peered":"2023-08-17T00:17:04.039861+0000","last_unstale":"2023-08-17T00:17:04.049187+0000","last_undegraded":"2023-08-17T00:17:04.049187+0000","last_fullsized":"2023-08-17T00:17:04.049187+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032987+0000","last_change":"2023-08-17T00:17:03.610904+0000","last_active":"2023-08-17T00:17:04.032987+0000","last_peered":"2023-08-17T00:17:04.032987+0000","last_clean":"2023-08-17T00:17:04.032987+0000","last_became_active":"2023-08-17T00:17:03.609650+0000","last_became_peered":"2023-08-17T00:17:03.609650+0000","last_unstale":"2023-08-17T00:17:04.032987+0000","last_undegraded":"2023-08-17T00:17:04.032987+0000","last_fullsized":"2023-08-17T00:17:04.032987+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053715+0000","last_change":"2023-08-17T00:17:04.052784+0000","last_active":"2023-08-17T00:17:04.053715+0000","last_peered":"2023-08-17T00:17:04.053715+0000","last_clean":"2023-08-17T00:17:04.053715+0000","last_became_active":"2023-08-17T00:17:04.052382+0000","last_became_peered":"2023-08-17T00:17:04.052382+0000","last_unstale":"2023-08-17T00:17:04.053715+0000","last_undegraded":"2023-08-17T00:17:04.053715+0000","last_fullsized":"2023-08-17T00:17:04.053715+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025362+0000","last_change":"2023-08-17T00:17:03.604509+0000","last_active":"2023-08-17T00:17:04.025362+0000","last_peered":"2023-08-17T00:17:04.025362+0000","last_clean":"2023-08-17T00:17:04.025362+0000","last_became_active":"2023-08-17T00:17:03.604207+0000","last_became_peered":"2023-08-17T00:17:03.604207+0000","last_unstale":"2023-08-17T00:17:04.025362+0000","last_undegraded":"2023-08-17T00:17:04.025362+0000","last_fullsized":"2023-08-17T00:17:04.025362+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056058+0000","last_change":"2023-08-17T00:17:04.045593+0000","last_active":"2023-08-17T00:17:04.056058+0000","last_peered":"2023-08-17T00:17:04.056058+0000","last_clean":"2023-08-17T00:17:04.056058+0000","last_became_active":"2023-08-17T00:17:04.045320+0000","last_became_peered":"2023-08-17T00:17:04.045320+0000","last_unstale":"2023-08-17T00:17:04.056058+0000","last_undegraded":"2023-08-17T00:17:04.056058+0000","last_fullsized":"2023-08-17T00:17:04.056058+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1e","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047214+0000","last_change":"2023-08-17T00:17:03.608379+0000","last_active":"2023-08-17T00:17:04.047214+0000","last_peered":"2023-08-17T00:17:04.047214+0000","last_clean":"2023-08-17T00:17:04.047214+0000","last_became_active":"2023-08-17T00:17:03.608068+0000","last_became_peered":"2023-08-17T00:17:03.608068+0000","last_unstale":"2023-08-17T00:17:04.047214+0000","last_undegraded":"2023-08-17T00:17:04.047214+0000","last_fullsized":"2023-08-17T00:17:04.047214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032471+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:17:04.032471+0000","last_peered":"2023-08-17T00:17:04.032471+0000","last_clean":"2023-08-17T00:17:04.032471+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:17:04.032471+0000","last_undegraded":"2023-08-17T00:17:04.032471+0000","last_fullsized":"2023-08-17T00:17:04.032471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044858+0000","last_change":"2023-08-17T00:17:04.038193+0000","last_active":"2023-08-17T00:17:04.044858+0000","last_peered":"2023-08-17T00:17:04.044858+0000","last_clean":"2023-08-17T00:17:04.044858+0000","last_became_active":"2023-08-17T00:17:04.037874+0000","last_became_peered":"2023-08-17T00:17:04.037874+0000","last_unstale":"2023-08-17T00:17:04.044858+0000","last_undegraded":"2023-08-17T00:17:04.044858+0000","last_fullsized":"2023-08-17T00:17:04.044858+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053978+0000","last_change":"2023-08-17T00:17:03.605442+0000","last_active":"2023-08-17T00:17:04.053978+0000","last_peered":"2023-08-17T00:17:04.053978+0000","last_clean":"2023-08-17T00:17:04.053978+0000","last_became_active":"2023-08-17T00:17:03.605139+0000","last_became_peered":"2023-08-17T00:17:03.605139+0000","last_unstale":"2023-08-17T00:17:04.053978+0000","last_undegraded":"2023-08-17T00:17:04.053978+0000","last_fullsized":"2023-08-17T00:17:04.053978+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025808+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:17:04.025808+0000","last_peered":"2023-08-17T00:17:04.025808+0000","last_clean":"2023-08-17T00:17:04.025808+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:17:04.025808+0000","last_undegraded":"2023-08-17T00:17:04.025808+0000","last_fullsized":"2023-08-17T00:17:04.025808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053428+0000","last_change":"2023-08-17T00:17:04.048819+0000","last_active":"2023-08-17T00:17:04.053428+0000","last_peered":"2023-08-17T00:17:04.053428+0000","last_clean":"2023-08-17T00:17:04.053428+0000","last_became_active":"2023-08-17T00:17:04.048527+0000","last_became_peered":"2023-08-17T00:17:04.048527+0000","last_unstale":"2023-08-17T00:17:04.053428+0000","last_undegraded":"2023-08-17T00:17:04.053428+0000","last_fullsized":"2023-08-17T00:17:04.053428+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039904+0000","last_change":"2023-08-17T00:17:03.614980+0000","last_active":"2023-08-17T00:17:04.039904+0000","last_peered":"2023-08-17T00:17:04.039904+0000","last_clean":"2023-08-17T00:17:04.039904+0000","last_became_active":"2023-08-17T00:17:03.614675+0000","last_became_peered":"2023-08-17T00:17:03.614675+0000","last_unstale":"2023-08-17T00:17:04.039904+0000","last_undegraded":"2023-08-17T00:17:04.039904+0000","last_fullsized":"2023-08-17T00:17:04.039904+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.031984+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:17:04.031984+0000","last_peered":"2023-08-17T00:17:04.031984+0000","last_clean":"2023-08-17T00:17:04.031984+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:17:04.031984+0000","last_undegraded":"2023-08-17T00:17:04.031984+0000","last_fullsized":"2023-08-17T00:17:04.031984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049122+0000","last_change":"2023-08-17T00:17:04.042523+0000","last_active":"2023-08-17T00:17:04.049122+0000","last_peered":"2023-08-17T00:17:04.049122+0000","last_clean":"2023-08-17T00:17:04.049122+0000","last_became_active":"2023-08-17T00:17:04.042059+0000","last_became_peered":"2023-08-17T00:17:04.042059+0000","last_unstale":"2023-08-17T00:17:04.049122+0000","last_undegraded":"2023-08-17T00:17:04.049122+0000","last_fullsized":"2023-08-17T00:17:04.049122+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1d","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054300+0000","last_change":"2023-08-17T00:17:03.611041+0000","last_active":"2023-08-17T00:17:04.054300+0000","last_peered":"2023-08-17T00:17:04.054300+0000","last_clean":"2023-08-17T00:17:04.054300+0000","last_became_active":"2023-08-17T00:17:03.610638+0000","last_became_peered":"2023-08-17T00:17:03.610638+0000","last_unstale":"2023-08-17T00:17:04.054300+0000","last_undegraded":"2023-08-17T00:17:04.054300+0000","last_fullsized":"2023-08-17T00:17:04.054300+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028249+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:17:04.028249+0000","last_peered":"2023-08-17T00:17:04.028249+0000","last_clean":"2023-08-17T00:17:04.028249+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:17:04.028249+0000","last_undegraded":"2023-08-17T00:17:04.028249+0000","last_fullsized":"2023-08-17T00:17:04.028249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050165+0000","last_change":"2023-08-17T00:17:04.045916+0000","last_active":"2023-08-17T00:17:04.050165+0000","last_peered":"2023-08-17T00:17:04.050165+0000","last_clean":"2023-08-17T00:17:04.050165+0000","last_became_active":"2023-08-17T00:17:04.045632+0000","last_became_peered":"2023-08-17T00:17:04.045632+0000","last_unstale":"2023-08-17T00:17:04.050165+0000","last_undegraded":"2023-08-17T00:17:04.050165+0000","last_fullsized":"2023-08-17T00:17:04.050165+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034570+0000","last_change":"2023-08-17T00:17:03.608444+0000","last_active":"2023-08-17T00:17:04.034570+0000","last_peered":"2023-08-17T00:17:04.034570+0000","last_clean":"2023-08-17T00:17:04.034570+0000","last_became_active":"2023-08-17T00:17:03.605953+0000","last_became_peered":"2023-08-17T00:17:03.605953+0000","last_unstale":"2023-08-17T00:17:04.034570+0000","last_undegraded":"2023-08-17T00:17:04.034570+0000","last_fullsized":"2023-08-17T00:17:04.034570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035062+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:17:04.035062+0000","last_peered":"2023-08-17T00:17:04.035062+0000","last_clean":"2023-08-17T00:17:04.035062+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:17:04.035062+0000","last_undegraded":"2023-08-17T00:17:04.035062+0000","last_fullsized":"2023-08-17T00:17:04.035062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054499+0000","last_change":"2023-08-17T00:17:04.050181+0000","last_active":"2023-08-17T00:17:04.054499+0000","last_peered":"2023-08-17T00:17:04.054499+0000","last_clean":"2023-08-17T00:17:04.054499+0000","last_became_active":"2023-08-17T00:17:04.049847+0000","last_became_peered":"2023-08-17T00:17:04.049847+0000","last_unstale":"2023-08-17T00:17:04.054499+0000","last_undegraded":"2023-08-17T00:17:04.054499+0000","last_fullsized":"2023-08-17T00:17:04.054499+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.027220+0000","last_change":"2023-08-17T00:17:03.607083+0000","last_active":"2023-08-17T00:17:04.027220+0000","last_peered":"2023-08-17T00:17:04.027220+0000","last_clean":"2023-08-17T00:17:04.027220+0000","last_became_active":"2023-08-17T00:17:03.606777+0000","last_became_peered":"2023-08-17T00:17:03.606777+0000","last_unstale":"2023-08-17T00:17:04.027220+0000","last_undegraded":"2023-08-17T00:17:04.027220+0000","last_fullsized":"2023-08-17T00:17:04.027220+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038864+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:17:04.038864+0000","last_peered":"2023-08-17T00:17:04.038864+0000","last_clean":"2023-08-17T00:17:04.038864+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:17:04.038864+0000","last_undegraded":"2023-08-17T00:17:04.038864+0000","last_fullsized":"2023-08-17T00:17:04.038864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049207+0000","last_change":"2023-08-17T00:17:04.040677+0000","last_active":"2023-08-17T00:17:04.049207+0000","last_peered":"2023-08-17T00:17:04.049207+0000","last_clean":"2023-08-17T00:17:04.049207+0000","last_became_active":"2023-08-17T00:17:04.040201+0000","last_became_peered":"2023-08-17T00:17:04.040201+0000","last_unstale":"2023-08-17T00:17:04.049207+0000","last_undegraded":"2023-08-17T00:17:04.049207+0000","last_fullsized":"2023-08-17T00:17:04.049207+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040617+0000","last_change":"2023-08-17T00:17:03.607962+0000","last_active":"2023-08-17T00:17:04.040617+0000","last_peered":"2023-08-17T00:17:04.040617+0000","last_clean":"2023-08-17T00:17:04.040617+0000","last_became_active":"2023-08-17T00:17:03.607587+0000","last_became_peered":"2023-08-17T00:17:03.607587+0000","last_unstale":"2023-08-17T00:17:04.040617+0000","last_undegraded":"2023-08-17T00:17:04.040617+0000","last_fullsized":"2023-08-17T00:17:04.040617+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032641+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:17:04.032641+0000","last_peered":"2023-08-17T00:17:04.032641+0000","last_clean":"2023-08-17T00:17:04.032641+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:17:04.032641+0000","last_undegraded":"2023-08-17T00:17:04.032641+0000","last_fullsized":"2023-08-17T00:17:04.032641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052122+0000","last_change":"2023-08-17T00:17:04.046586+0000","last_active":"2023-08-17T00:17:04.052122+0000","last_peered":"2023-08-17T00:17:04.052122+0000","last_clean":"2023-08-17T00:17:04.052122+0000","last_became_active":"2023-08-17T00:17:04.046283+0000","last_became_peered":"2023-08-17T00:17:04.046283+0000","last_unstale":"2023-08-17T00:17:04.052122+0000","last_undegraded":"2023-08-17T00:17:04.052122+0000","last_fullsized":"2023-08-17T00:17:04.052122+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038996+0000","last_change":"2023-08-17T00:17:03.615539+0000","last_active":"2023-08-17T00:17:04.038996+0000","last_peered":"2023-08-17T00:17:04.038996+0000","last_clean":"2023-08-17T00:17:04.038996+0000","last_became_active":"2023-08-17T00:17:03.615065+0000","last_became_peered":"2023-08-17T00:17:03.615065+0000","last_unstale":"2023-08-17T00:17:04.038996+0000","last_undegraded":"2023-08-17T00:17:04.038996+0000","last_fullsized":"2023-08-17T00:17:04.038996+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032220+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:17:04.032220+0000","last_peered":"2023-08-17T00:17:04.032220+0000","last_clean":"2023-08-17T00:17:04.032220+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:17:04.032220+0000","last_undegraded":"2023-08-17T00:17:04.032220+0000","last_fullsized":"2023-08-17T00:17:04.032220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.033068+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:17:04.033068+0000","last_peered":"2023-08-17T00:17:04.033068+0000","last_clean":"2023-08-17T00:17:04.033068+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:17:04.033068+0000","last_undegraded":"2023-08-17T00:17:04.033068+0000","last_fullsized":"2023-08-17T00:17:04.033068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542319,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299592,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072248,"statfs":{"total":96636764160,"available":96329981952,"internally_reserved":0,"allocated":2424832,"data_stored":1136966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.1759999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.425},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.306}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":1.363}]}]},{"osd":6,"up_from":14,"seq":60129542319,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299588,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072252,"statfs":{"total":96636764160,"available":96329986048,"internally_reserved":0,"allocated":2420736,"data_stored":1137000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":6.2050000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":4.468}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":2.0870000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":3.5409999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":3.0569999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":2.4670000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":6.1660000000000004},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":8.4809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":5.2199999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":3.7519999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542320,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2416640,"data_stored":1137394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.143}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.409},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.272}]}]},{"osd":3,"up_from":14,"seq":60129542319,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2420736,"data_stored":1137484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.4590000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.409}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.484},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.375},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.0980000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.2949999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542319,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311880,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059960,"statfs":{"total":96636764160,"available":96317399040,"internally_reserved":0,"allocated":2424832,"data_stored":1138038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.2909999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.234},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.123}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.264},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.2549999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542319,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2416640,"data_stored":1136862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86599999999999999,"15min":0.84199999999999997},"min":{"1min":0.58399999999999996,"5min":0.53200000000000003,"15min":0.309},"max":{"1min":1.2869999999999999,"5min":1.298,"15min":6.4329999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.94799999999999995,"15min":0.92200000000000004},"min":{"1min":0.64500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4670000000000001,"5min":1.6200000000000001,"15min":13.093},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.82499999999999996,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.314},"max":{"1min":1.109,"5min":1.3420000000000001,"15min":5.4989999999999997},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91600000000000004,"15min":0.89700000000000002},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.619,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0289999999999999,"15min":1.0149999999999999},"min":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.625,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.1919999999999999,"5min":1.359,"15min":12.981999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1100000000000001,"15min":1.1419999999999999},"min":{"1min":0.93899999999999995,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.5840000000000001,"5min":1.671,"15min":20.548999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2330000000000001,"15min":1.208},"min":{"1min":1.0029999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.746,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.27,"15min":1.2889999999999999},"min":{"1min":1.028,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8879999999999999,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.228,"15min":1.232},"min":{"1min":0.97499999999999998,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.577,"5min":1.8009999999999999,"15min":5.4240000000000004},"last":1.3380000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2370000000000001,"15min":1.248},"min":{"1min":1.0449999999999999,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.8400000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2070000000000001,"15min":1.2050000000000001},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.49,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.302}]},{"osd":7,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2949999999999999,"15min":1.2969999999999999},"min":{"1min":1.0940000000000001,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.8120000000000001,"5min":1.9179999999999999,"15min":6.9779999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.288,"15min":1.3140000000000001},"min":{"1min":1.1259999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":13.131},"last":1.127}]}]},{"osd":0,"up_from":14,"seq":60129542320,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311876,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059964,"statfs":{"total":96636764160,"available":96317403136,"internally_reserved":0,"allocated":2420736,"data_stored":1137766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":1.127}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":1.254},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.419}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":1.345}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":1.216},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":1.5609999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.397}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.681},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":2.0619999999999998}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.3109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575024,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2420736,"data_stored":1137822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.997,"15min":1.0509999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.38300000000000001},"max":{"1min":1.4299999999999999,"5min":1.53,"15min":7.1379999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0169999999999999,"15min":1.0469999999999999},"min":{"1min":0.77200000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.2030000000000001,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.161,"15min":1.2230000000000001},"min":{"1min":0.84299999999999997,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.665,"5min":1.665,"15min":8.3800000000000008},"last":1.355},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1619999999999999,"15min":1.21},"min":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.6120000000000001,"5min":1.732,"15min":6.9000000000000004},"last":1.1990000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.087,"15min":1.2090000000000001},"min":{"1min":0.84499999999999997,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.3999999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.103,"15min":1.3029999999999999},"min":{"1min":0.86799999999999999,"5min":0.78600000000000003,"15min":0.36699999999999999},"max":{"1min":1.53,"5min":1.623,"15min":36.531999999999996},"last":1.083}]},{"osd":3,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1100000000000001,"15min":1.107},"min":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.5600000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.032},{"interface":"front","average":{"1min":1.23,"5min":1.157,"15min":1.373},"min":{"1min":0.90700000000000003,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.875,"5min":1.875,"15min":36.530000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.22,"15min":1.2430000000000001},"min":{"1min":0.76900000000000002,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.6919999999999999,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.286},{"interface":"front","average":{"1min":1.248,"5min":1.2330000000000001,"15min":1.278},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.6519999999999999,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.222}]},{"osd":6,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.234,"15min":1.3080000000000001},"min":{"1min":0.82299999999999995,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.242},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.88900000000000001,"5min":0.81399999999999995,"15min":0.49399999999999999},"max":{"1min":1.7829999999999999,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.391}]},{"osd":7,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.232,"15min":1.24},"min":{"1min":0.85599999999999998,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.7,"5min":3.645,"15min":3.645},"last":1.135},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3799999999999999},"min":{"1min":1.095,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.758,"5min":1.879,"15min":8.327},"last":1.419}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:17:12.970 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:17:13.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 Processor -- start 2023-08-17T00:17:13.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 -- start start 2023-08-17T00:17:13.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19a0068f30 0x7f19a00c0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f19a00ac2f0 0x7f19a00c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a01545e0 con 0x7f19a00abf10 2023-08-17T00:17:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a00c1c50 con 0x7f19a00ac2f0 2023-08-17T00:17:13.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199f59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a0064b80 con 0x7f19a0068f30 2023-08-17T00:17:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.127+0000 7f199e59c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f19a00abf10 0x7f19a0068820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45090/0 (socket says 172.21.15.153:45090) 2023-08-17T00:17:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199e59c700 1 -- 172.21.15.153:0/1670274598 learned_addr learned my addr 172.21.15.153:0/1670274598 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199dd9b700 1 --2- 172.21.15.153:0/1670274598 >> v2:172.21.15.178:3300/0 conn(0x7f19a0068f30 0x7f19a00c0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199ed9d700 1 --2- 172.21.15.153:0/1670274598 >> v2:172.21.15.153:3300/0 conn(0x7f19a00ac2f0 0x7f19a00c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199dd9b700 1 -- 172.21.15.153:0/1670274598 >> v2:172.21.15.153:3300/0 conn(0x7f19a00ac2f0 msgr2=0x7f19a00c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:13.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199dd9b700 1 --2- 172.21.15.153:0/1670274598 >> v2:172.21.15.153:3300/0 conn(0x7f19a00ac2f0 0x7f19a00c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199dd9b700 1 -- 172.21.15.153:0/1670274598 >> v1:172.21.15.153:6789/0 conn(0x7f19a00abf10 legacy=0x7f19a0068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199dd9b700 1 -- 172.21.15.153:0/1670274598 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00c1460 con 0x7f19a0068f30 2023-08-17T00:17:13.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199d59a700 1 -- 172.21.15.153:0/1670274598 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657866399 0 0) 0x7f19a01545e0 con 0x7f19a00abf10 2023-08-17T00:17:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199dd9b700 1 --2- 172.21.15.153:0/1670274598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00c0a80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f19a00693d0 tx=0x7f1994009060).ready entity=mon.1 client_cookie=201ba9716fb471e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199d59a700 1 -- 172.21.15.153:0/1670274598 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400f510 con 0x7f19a0068f30 2023-08-17T00:17:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199d59a700 1 -- 172.21.15.153:0/1670274598 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400f670 con 0x7f19a0068f30 2023-08-17T00:17:13.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199d59a700 1 -- 172.21.15.153:0/1670274598 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400f9f0 con 0x7f19a0068f30 2023-08-17T00:17:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 -- 172.21.15.153:0/1670274598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 msgr2=0x7f19a00c0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 --2- 172.21.15.153:0/1670274598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00c0a80 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7f19a00693d0 tx=0x7f1994009060).stop 2023-08-17T00:17:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 -- 172.21.15.153:0/1670274598 shutdown_connections 2023-08-17T00:17:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 --2- 172.21.15.153:0/1670274598 >> v2:172.21.15.153:3300/0 conn(0x7f19a00ac2f0 0x7f19a00c0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 --2- 172.21.15.153:0/1670274598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00c0a80 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 -- 172.21.15.153:0/1670274598 >> 172.21.15.153:0/1670274598 conn(0x7f19a00c6620 msgr2=0x7f19a00c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 -- 172.21.15.153:0/1670274598 shutdown_connections 2023-08-17T00:17:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.131+0000 7f199f59e700 1 -- 172.21.15.153:0/1670274598 wait complete. 2023-08-17T00:17:13.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 Processor -- start 2023-08-17T00:17:13.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 -- start start 2023-08-17T00:17:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00bcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 0x7f19a01648c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a00ac2f0 0x7f19a014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0167e90 con 0x7f19a00abf10 2023-08-17T00:17:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00bd210 con 0x7f19a0068f30 2023-08-17T00:17:13.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199f59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a0168130 con 0x7f19a00ac2f0 2023-08-17T00:17:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 0x7f19a01648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 0x7f19a01648c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47126/0 (socket says 172.21.15.153:47126) 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 -- 172.21.15.153:0/3240882762 learned_addr learned my addr 172.21.15.153:0/3240882762 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199e59c700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00bcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199ed9d700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a00ac2f0 0x7f19a014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 -- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a00ac2f0 msgr2=0x7f19a014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a00ac2f0 0x7f19a014db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 -- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 msgr2=0x7f19a00bcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.135+0000 7f199dd9b700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00bcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f199dd9b700 1 -- 172.21.15.153:0/3240882762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19940092a0 con 0x7f19a00abf10 2023-08-17T00:17:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f199dd9b700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 0x7f19a01648c0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f19a0064cc0 tx=0x7f1994017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:13.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400f510 con 0x7f19a00abf10 2023-08-17T00:17:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400fe80 con 0x7f19a00abf10 2023-08-17T00:17:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00a96d0 con 0x7f19a00abf10 2023-08-17T00:17:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199401b410 con 0x7f19a00abf10 2023-08-17T00:17:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a0165080 con 0x7f19a00abf10 2023-08-17T00:17:13.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.139+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a00c6bb0 con 0x7f19a00abf10 2023-08-17T00:17:13.145 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.143+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f199400f070 con 0x7f19a00abf10 2023-08-17T00:17:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.143+0000 7f198e7fc700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f198005a150 0x7f198005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.146 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.143+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f19940757b0 con 0x7f19a00abf10 2023-08-17T00:17:13.147 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.143+0000 7f199e59c700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f198005a150 0x7f198005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.148 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.143+0000 7f199e59c700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f198005a150 0x7f198005c610 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f1990000c00 tx=0x7f1990007ad0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:13.153 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.147+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f19a00c6bb0 con 0x7f19a00abf10 2023-08-17T00:17:13.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.307+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19a0168270 con 0x7f198005a150 2023-08-17T00:17:13.328 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.323+0000 7f198e7fc700 1 -- 172.21.15.153:0/3240882762 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+359510 (secure 0 0 0) 0x7f19a0168270 con 0x7f198005a150 2023-08-17T00:17:13.334 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f198005a150 msgr2=0x7f198005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f198005a150 0x7f198005c610 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 rx=0x7f1990000c00 tx=0x7f1990007ad0).stop 2023-08-17T00:17:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 msgr2=0x7f19a01648c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 0x7f19a01648c0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 rx=0x7f19a0064cc0 tx=0x7f1994017000).stop 2023-08-17T00:17:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 shutdown_connections 2023-08-17T00:17:13.336 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f198005a150 0x7f198005c610 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19a00ac2f0 0x7f19a014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f19a00abf10 0x7f19a01648c0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 --2- 172.21.15.153:0/3240882762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19a0068f30 0x7f19a00bcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 >> 172.21.15.153:0/3240882762 conn(0x7f19a00c6620 msgr2=0x7f19a00bf5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 shutdown_connections 2023-08-17T00:17:13.337 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.331+0000 7f199f59e700 1 -- 172.21.15.153:0/3240882762 wait complete. 2023-08-17T00:17:13.338 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:17:13.354 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":619,"stamp":"2023-08-17T00:17:11.504129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":274,"acting":274,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":237,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2454048,"kb_used_data":18912,"kb_used_omap":0,"kb_used_meta":2435072,"kb_avail":752520672,"statfs":{"total":773094113280,"available":770581168128,"internally_reserved":0,"allocated":19365888,"data_stored":9099332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2493513728},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6308412,"num_objects":-1022,"num_object_clones":0,"num_object_copies":-2044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1022,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-3060,"num_write_kb":-7683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-1,"num_bytes_recovered":-22,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.472375"},"pg_stats":[{"pgid":"28.38","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049084+0000","last_change":"2023-08-17T00:17:04.040967+0000","last_active":"2023-08-17T00:17:04.049084+0000","last_peered":"2023-08-17T00:17:04.049084+0000","last_clean":"2023-08-17T00:17:04.049084+0000","last_became_active":"2023-08-17T00:17:04.040675+0000","last_became_peered":"2023-08-17T00:17:04.040675+0000","last_unstale":"2023-08-17T00:17:04.049084+0000","last_undegraded":"2023-08-17T00:17:04.049084+0000","last_fullsized":"2023-08-17T00:17:04.049084+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3f","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055948+0000","last_change":"2023-08-17T00:17:03.602509+0000","last_active":"2023-08-17T00:17:04.055948+0000","last_peered":"2023-08-17T00:17:04.055948+0000","last_clean":"2023-08-17T00:17:04.055948+0000","last_became_active":"2023-08-17T00:17:03.600517+0000","last_became_peered":"2023-08-17T00:17:03.600517+0000","last_unstale":"2023-08-17T00:17:04.055948+0000","last_undegraded":"2023-08-17T00:17:04.055948+0000","last_fullsized":"2023-08-17T00:17:04.055948+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057466+0000","last_change":"2023-08-17T00:17:04.051198+0000","last_active":"2023-08-17T00:17:04.057466+0000","last_peered":"2023-08-17T00:17:04.057466+0000","last_clean":"2023-08-17T00:17:04.057466+0000","last_became_active":"2023-08-17T00:17:04.050838+0000","last_became_peered":"2023-08-17T00:17:04.050838+0000","last_unstale":"2023-08-17T00:17:04.057466+0000","last_undegraded":"2023-08-17T00:17:04.057466+0000","last_fullsized":"2023-08-17T00:17:04.057466+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032376+0000","last_change":"2023-08-17T00:17:03.604286+0000","last_active":"2023-08-17T00:17:04.032376+0000","last_peered":"2023-08-17T00:17:04.032376+0000","last_clean":"2023-08-17T00:17:04.032376+0000","last_became_active":"2023-08-17T00:17:03.603847+0000","last_became_peered":"2023-08-17T00:17:03.603847+0000","last_unstale":"2023-08-17T00:17:04.032376+0000","last_undegraded":"2023-08-17T00:17:04.032376+0000","last_fullsized":"2023-08-17T00:17:04.032376+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045431+0000","last_change":"2023-08-17T00:17:04.032945+0000","last_active":"2023-08-17T00:17:04.045431+0000","last_peered":"2023-08-17T00:17:04.045431+0000","last_clean":"2023-08-17T00:17:04.045431+0000","last_became_active":"2023-08-17T00:17:04.032690+0000","last_became_peered":"2023-08-17T00:17:04.032690+0000","last_unstale":"2023-08-17T00:17:04.045431+0000","last_undegraded":"2023-08-17T00:17:04.045431+0000","last_fullsized":"2023-08-17T00:17:04.045431+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040747+0000","last_change":"2023-08-17T00:17:03.610919+0000","last_active":"2023-08-17T00:17:04.040747+0000","last_peered":"2023-08-17T00:17:04.040747+0000","last_clean":"2023-08-17T00:17:04.040747+0000","last_became_active":"2023-08-17T00:17:03.610412+0000","last_became_peered":"2023-08-17T00:17:03.610412+0000","last_unstale":"2023-08-17T00:17:04.040747+0000","last_undegraded":"2023-08-17T00:17:04.040747+0000","last_fullsized":"2023-08-17T00:17:04.040747+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058183+0000","last_change":"2023-08-17T00:17:04.056564+0000","last_active":"2023-08-17T00:17:04.058183+0000","last_peered":"2023-08-17T00:17:04.058183+0000","last_clean":"2023-08-17T00:17:04.058183+0000","last_became_active":"2023-08-17T00:17:04.055878+0000","last_became_peered":"2023-08-17T00:17:04.055878+0000","last_unstale":"2023-08-17T00:17:04.058183+0000","last_undegraded":"2023-08-17T00:17:04.058183+0000","last_fullsized":"2023-08-17T00:17:04.058183+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3c","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053315+0000","last_change":"2023-08-17T00:17:03.607955+0000","last_active":"2023-08-17T00:17:04.053315+0000","last_peered":"2023-08-17T00:17:04.053315+0000","last_clean":"2023-08-17T00:17:04.053315+0000","last_became_active":"2023-08-17T00:17:03.605724+0000","last_became_peered":"2023-08-17T00:17:03.605724+0000","last_unstale":"2023-08-17T00:17:04.053315+0000","last_undegraded":"2023-08-17T00:17:04.053315+0000","last_fullsized":"2023-08-17T00:17:04.053315+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056394+0000","last_change":"2023-08-17T00:17:04.050546+0000","last_active":"2023-08-17T00:17:04.056394+0000","last_peered":"2023-08-17T00:17:04.056394+0000","last_clean":"2023-08-17T00:17:04.056394+0000","last_became_active":"2023-08-17T00:17:04.048601+0000","last_became_peered":"2023-08-17T00:17:04.048601+0000","last_unstale":"2023-08-17T00:17:04.056394+0000","last_undegraded":"2023-08-17T00:17:04.056394+0000","last_fullsized":"2023-08-17T00:17:04.056394+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045696+0000","last_change":"2023-08-17T00:17:03.609495+0000","last_active":"2023-08-17T00:17:04.045696+0000","last_peered":"2023-08-17T00:17:04.045696+0000","last_clean":"2023-08-17T00:17:04.045696+0000","last_became_active":"2023-08-17T00:17:03.609224+0000","last_became_peered":"2023-08-17T00:17:03.609224+0000","last_unstale":"2023-08-17T00:17:04.045696+0000","last_undegraded":"2023-08-17T00:17:04.045696+0000","last_fullsized":"2023-08-17T00:17:04.045696+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057402+0000","last_change":"2023-08-17T00:17:04.050914+0000","last_active":"2023-08-17T00:17:04.057402+0000","last_peered":"2023-08-17T00:17:04.057402+0000","last_clean":"2023-08-17T00:17:04.057402+0000","last_became_active":"2023-08-17T00:17:04.050552+0000","last_became_peered":"2023-08-17T00:17:04.050552+0000","last_unstale":"2023-08-17T00:17:04.057402+0000","last_undegraded":"2023-08-17T00:17:04.057402+0000","last_fullsized":"2023-08-17T00:17:04.057402+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3a","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044509+0000","last_change":"2023-08-17T00:17:03.592834+0000","last_active":"2023-08-17T00:17:04.044509+0000","last_peered":"2023-08-17T00:17:04.044509+0000","last_clean":"2023-08-17T00:17:04.044509+0000","last_became_active":"2023-08-17T00:17:03.592529+0000","last_became_peered":"2023-08-17T00:17:03.592529+0000","last_unstale":"2023-08-17T00:17:04.044509+0000","last_undegraded":"2023-08-17T00:17:04.044509+0000","last_fullsized":"2023-08-17T00:17:04.044509+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049216+0000","last_change":"2023-08-17T00:17:04.045779+0000","last_active":"2023-08-17T00:17:04.049216+0000","last_peered":"2023-08-17T00:17:04.049216+0000","last_clean":"2023-08-17T00:17:04.049216+0000","last_became_active":"2023-08-17T00:17:04.045489+0000","last_became_peered":"2023-08-17T00:17:04.045489+0000","last_unstale":"2023-08-17T00:17:04.049216+0000","last_undegraded":"2023-08-17T00:17:04.049216+0000","last_fullsized":"2023-08-17T00:17:04.049216+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.026280+0000","last_change":"2023-08-17T00:17:03.603048+0000","last_active":"2023-08-17T00:17:04.026280+0000","last_peered":"2023-08-17T00:17:04.026280+0000","last_clean":"2023-08-17T00:17:04.026280+0000","last_became_active":"2023-08-17T00:17:03.600931+0000","last_became_peered":"2023-08-17T00:17:03.600931+0000","last_unstale":"2023-08-17T00:17:04.026280+0000","last_undegraded":"2023-08-17T00:17:04.026280+0000","last_fullsized":"2023-08-17T00:17:04.026280+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056023+0000","last_change":"2023-08-17T00:17:04.043639+0000","last_active":"2023-08-17T00:17:04.056023+0000","last_peered":"2023-08-17T00:17:04.056023+0000","last_clean":"2023-08-17T00:17:04.056023+0000","last_became_active":"2023-08-17T00:17:04.043074+0000","last_became_peered":"2023-08-17T00:17:04.043074+0000","last_unstale":"2023-08-17T00:17:04.056023+0000","last_undegraded":"2023-08-17T00:17:04.056023+0000","last_fullsized":"2023-08-17T00:17:04.056023+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025187+0000","last_change":"2023-08-17T00:17:03.607462+0000","last_active":"2023-08-17T00:17:04.025187+0000","last_peered":"2023-08-17T00:17:04.025187+0000","last_clean":"2023-08-17T00:17:04.025187+0000","last_became_active":"2023-08-17T00:17:03.607116+0000","last_became_peered":"2023-08-17T00:17:03.607116+0000","last_unstale":"2023-08-17T00:17:04.025187+0000","last_undegraded":"2023-08-17T00:17:04.025187+0000","last_fullsized":"2023-08-17T00:17:04.025187+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050917+0000","last_change":"2023-08-17T00:17:04.045697+0000","last_active":"2023-08-17T00:17:04.050917+0000","last_peered":"2023-08-17T00:17:04.050917+0000","last_clean":"2023-08-17T00:17:04.050917+0000","last_became_active":"2023-08-17T00:17:04.045400+0000","last_became_peered":"2023-08-17T00:17:04.045400+0000","last_unstale":"2023-08-17T00:17:04.050917+0000","last_undegraded":"2023-08-17T00:17:04.050917+0000","last_fullsized":"2023-08-17T00:17:04.050917+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042231+0000","last_change":"2023-08-17T00:17:03.597710+0000","last_active":"2023-08-17T00:17:04.042231+0000","last_peered":"2023-08-17T00:17:04.042231+0000","last_clean":"2023-08-17T00:17:04.042231+0000","last_became_active":"2023-08-17T00:17:03.597376+0000","last_became_peered":"2023-08-17T00:17:03.597376+0000","last_unstale":"2023-08-17T00:17:04.042231+0000","last_undegraded":"2023-08-17T00:17:04.042231+0000","last_fullsized":"2023-08-17T00:17:04.042231+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.061979+0000","last_change":"2023-08-17T00:17:04.058213+0000","last_active":"2023-08-17T00:17:04.061979+0000","last_peered":"2023-08-17T00:17:04.061979+0000","last_clean":"2023-08-17T00:17:04.061979+0000","last_became_active":"2023-08-17T00:17:04.057812+0000","last_became_peered":"2023-08-17T00:17:04.057812+0000","last_unstale":"2023-08-17T00:17:04.061979+0000","last_undegraded":"2023-08-17T00:17:04.061979+0000","last_fullsized":"2023-08-17T00:17:04.061979+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042752+0000","last_change":"2023-08-17T00:17:03.614190+0000","last_active":"2023-08-17T00:17:04.042752+0000","last_peered":"2023-08-17T00:17:04.042752+0000","last_clean":"2023-08-17T00:17:04.042752+0000","last_became_active":"2023-08-17T00:17:03.613882+0000","last_became_peered":"2023-08-17T00:17:03.613882+0000","last_unstale":"2023-08-17T00:17:04.042752+0000","last_undegraded":"2023-08-17T00:17:04.042752+0000","last_fullsized":"2023-08-17T00:17:04.042752+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054949+0000","last_change":"2023-08-17T00:17:04.040600+0000","last_active":"2023-08-17T00:17:04.054949+0000","last_peered":"2023-08-17T00:17:04.054949+0000","last_clean":"2023-08-17T00:17:04.054949+0000","last_became_active":"2023-08-17T00:17:04.040327+0000","last_became_peered":"2023-08-17T00:17:04.040327+0000","last_unstale":"2023-08-17T00:17:04.054949+0000","last_undegraded":"2023-08-17T00:17:04.054949+0000","last_fullsized":"2023-08-17T00:17:04.054949+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.029816+0000","last_change":"2023-08-17T00:17:03.606219+0000","last_active":"2023-08-17T00:17:04.029816+0000","last_peered":"2023-08-17T00:17:04.029816+0000","last_clean":"2023-08-17T00:17:04.029816+0000","last_became_active":"2023-08-17T00:17:03.605882+0000","last_became_peered":"2023-08-17T00:17:03.605882+0000","last_unstale":"2023-08-17T00:17:04.029816+0000","last_undegraded":"2023-08-17T00:17:04.029816+0000","last_fullsized":"2023-08-17T00:17:04.029816+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059249+0000","last_change":"2023-08-17T00:17:04.056101+0000","last_active":"2023-08-17T00:17:04.059249+0000","last_peered":"2023-08-17T00:17:04.059249+0000","last_clean":"2023-08-17T00:17:04.059249+0000","last_became_active":"2023-08-17T00:17:04.055714+0000","last_became_peered":"2023-08-17T00:17:04.055714+0000","last_unstale":"2023-08-17T00:17:04.059249+0000","last_undegraded":"2023-08-17T00:17:04.059249+0000","last_fullsized":"2023-08-17T00:17:04.059249+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056479+0000","last_change":"2023-08-17T00:17:03.604784+0000","last_active":"2023-08-17T00:17:04.056479+0000","last_peered":"2023-08-17T00:17:04.056479+0000","last_clean":"2023-08-17T00:17:04.056479+0000","last_became_active":"2023-08-17T00:17:03.604488+0000","last_became_peered":"2023-08-17T00:17:03.604488+0000","last_unstale":"2023-08-17T00:17:04.056479+0000","last_undegraded":"2023-08-17T00:17:04.056479+0000","last_fullsized":"2023-08-17T00:17:04.056479+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":892,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053358+0000","last_change":"2023-08-17T00:17:04.048450+0000","last_active":"2023-08-17T00:17:04.053358+0000","last_peered":"2023-08-17T00:17:04.053358+0000","last_clean":"2023-08-17T00:17:04.053358+0000","last_became_active":"2023-08-17T00:17:04.048159+0000","last_became_peered":"2023-08-17T00:17:04.048159+0000","last_unstale":"2023-08-17T00:17:04.053358+0000","last_undegraded":"2023-08-17T00:17:04.053358+0000","last_fullsized":"2023-08-17T00:17:04.053358+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.33","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055804+0000","last_change":"2023-08-17T00:17:03.611509+0000","last_active":"2023-08-17T00:17:04.055804+0000","last_peered":"2023-08-17T00:17:04.055804+0000","last_clean":"2023-08-17T00:17:04.055804+0000","last_became_active":"2023-08-17T00:17:03.610877+0000","last_became_peered":"2023-08-17T00:17:03.610877+0000","last_unstale":"2023-08-17T00:17:04.055804+0000","last_undegraded":"2023-08-17T00:17:04.055804+0000","last_fullsized":"2023-08-17T00:17:04.055804+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051902+0000","last_change":"2023-08-17T00:17:04.048382+0000","last_active":"2023-08-17T00:17:04.051902+0000","last_peered":"2023-08-17T00:17:04.051902+0000","last_clean":"2023-08-17T00:17:04.051902+0000","last_became_active":"2023-08-17T00:17:04.048079+0000","last_became_peered":"2023-08-17T00:17:04.048079+0000","last_unstale":"2023-08-17T00:17:04.051902+0000","last_undegraded":"2023-08-17T00:17:04.051902+0000","last_fullsized":"2023-08-17T00:17:04.051902+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.037833+0000","last_change":"2023-08-17T00:17:03.609075+0000","last_active":"2023-08-17T00:17:04.037833+0000","last_peered":"2023-08-17T00:17:04.037833+0000","last_clean":"2023-08-17T00:17:04.037833+0000","last_became_active":"2023-08-17T00:17:03.608809+0000","last_became_peered":"2023-08-17T00:17:03.608809+0000","last_unstale":"2023-08-17T00:17:04.037833+0000","last_undegraded":"2023-08-17T00:17:04.037833+0000","last_fullsized":"2023-08-17T00:17:04.037833+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054062+0000","last_change":"2023-08-17T00:17:04.038159+0000","last_active":"2023-08-17T00:17:04.054062+0000","last_peered":"2023-08-17T00:17:04.054062+0000","last_clean":"2023-08-17T00:17:04.054062+0000","last_became_active":"2023-08-17T00:17:04.037825+0000","last_became_peered":"2023-08-17T00:17:04.037825+0000","last_unstale":"2023-08-17T00:17:04.054062+0000","last_undegraded":"2023-08-17T00:17:04.054062+0000","last_fullsized":"2023-08-17T00:17:04.054062+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.027416+0000","last_change":"2023-08-17T00:17:03.597502+0000","last_active":"2023-08-17T00:17:04.027416+0000","last_peered":"2023-08-17T00:17:04.027416+0000","last_clean":"2023-08-17T00:17:04.027416+0000","last_became_active":"2023-08-17T00:17:03.597168+0000","last_became_peered":"2023-08-17T00:17:03.597168+0000","last_unstale":"2023-08-17T00:17:04.027416+0000","last_undegraded":"2023-08-17T00:17:04.027416+0000","last_fullsized":"2023-08-17T00:17:04.027416+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057023+0000","last_change":"2023-08-17T00:17:04.048095+0000","last_active":"2023-08-17T00:17:04.057023+0000","last_peered":"2023-08-17T00:17:04.057023+0000","last_clean":"2023-08-17T00:17:04.057023+0000","last_became_active":"2023-08-17T00:17:04.047658+0000","last_became_peered":"2023-08-17T00:17:04.047658+0000","last_unstale":"2023-08-17T00:17:04.057023+0000","last_undegraded":"2023-08-17T00:17:04.057023+0000","last_fullsized":"2023-08-17T00:17:04.057023+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.30","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055897+0000","last_change":"2023-08-17T00:17:03.600911+0000","last_active":"2023-08-17T00:17:04.055897+0000","last_peered":"2023-08-17T00:17:04.055897+0000","last_clean":"2023-08-17T00:17:04.055897+0000","last_became_active":"2023-08-17T00:17:03.600488+0000","last_became_peered":"2023-08-17T00:17:03.600488+0000","last_unstale":"2023-08-17T00:17:04.055897+0000","last_undegraded":"2023-08-17T00:17:04.055897+0000","last_fullsized":"2023-08-17T00:17:04.055897+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058012+0000","last_change":"2023-08-17T00:17:04.056919+0000","last_active":"2023-08-17T00:17:04.058012+0000","last_peered":"2023-08-17T00:17:04.058012+0000","last_clean":"2023-08-17T00:17:04.058012+0000","last_became_active":"2023-08-17T00:17:04.056440+0000","last_became_peered":"2023-08-17T00:17:04.056440+0000","last_unstale":"2023-08-17T00:17:04.058012+0000","last_undegraded":"2023-08-17T00:17:04.058012+0000","last_fullsized":"2023-08-17T00:17:04.058012+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.029534+0000","last_change":"2023-08-17T00:17:03.609894+0000","last_active":"2023-08-17T00:17:04.029534+0000","last_peered":"2023-08-17T00:17:04.029534+0000","last_clean":"2023-08-17T00:17:04.029534+0000","last_became_active":"2023-08-17T00:17:03.609602+0000","last_became_peered":"2023-08-17T00:17:03.609602+0000","last_unstale":"2023-08-17T00:17:04.029534+0000","last_undegraded":"2023-08-17T00:17:04.029534+0000","last_fullsized":"2023-08-17T00:17:04.029534+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057446+0000","last_change":"2023-08-17T00:17:04.050491+0000","last_active":"2023-08-17T00:17:04.057446+0000","last_peered":"2023-08-17T00:17:04.057446+0000","last_clean":"2023-08-17T00:17:04.057446+0000","last_became_active":"2023-08-17T00:17:04.050001+0000","last_became_peered":"2023-08-17T00:17:04.050001+0000","last_unstale":"2023-08-17T00:17:04.057446+0000","last_undegraded":"2023-08-17T00:17:04.057446+0000","last_fullsized":"2023-08-17T00:17:04.057446+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.042845+0000","last_change":"2023-08-17T00:17:03.611855+0000","last_active":"2023-08-17T00:17:04.042845+0000","last_peered":"2023-08-17T00:17:04.042845+0000","last_clean":"2023-08-17T00:17:04.042845+0000","last_became_active":"2023-08-17T00:17:03.611566+0000","last_became_peered":"2023-08-17T00:17:03.611566+0000","last_unstale":"2023-08-17T00:17:04.042845+0000","last_undegraded":"2023-08-17T00:17:04.042845+0000","last_fullsized":"2023-08-17T00:17:04.042845+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059096+0000","last_change":"2023-08-17T00:17:04.049971+0000","last_active":"2023-08-17T00:17:04.059096+0000","last_peered":"2023-08-17T00:17:04.059096+0000","last_clean":"2023-08-17T00:17:04.059096+0000","last_became_active":"2023-08-17T00:17:04.049710+0000","last_became_peered":"2023-08-17T00:17:04.049710+0000","last_unstale":"2023-08-17T00:17:04.059096+0000","last_undegraded":"2023-08-17T00:17:04.059096+0000","last_fullsized":"2023-08-17T00:17:04.059096+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2d","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054421+0000","last_change":"2023-08-17T00:17:03.611104+0000","last_active":"2023-08-17T00:17:04.054421+0000","last_peered":"2023-08-17T00:17:04.054421+0000","last_clean":"2023-08-17T00:17:04.054421+0000","last_became_active":"2023-08-17T00:17:03.610764+0000","last_became_peered":"2023-08-17T00:17:03.610764+0000","last_unstale":"2023-08-17T00:17:04.054421+0000","last_undegraded":"2023-08-17T00:17:04.054421+0000","last_fullsized":"2023-08-17T00:17:04.054421+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057336+0000","last_change":"2023-08-17T00:17:04.054835+0000","last_active":"2023-08-17T00:17:04.057336+0000","last_peered":"2023-08-17T00:17:04.057336+0000","last_clean":"2023-08-17T00:17:04.057336+0000","last_became_active":"2023-08-17T00:17:04.054587+0000","last_became_peered":"2023-08-17T00:17:04.054587+0000","last_unstale":"2023-08-17T00:17:04.057336+0000","last_undegraded":"2023-08-17T00:17:04.057336+0000","last_fullsized":"2023-08-17T00:17:04.057336+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039701+0000","last_change":"2023-08-17T00:17:03.612980+0000","last_active":"2023-08-17T00:17:04.039701+0000","last_peered":"2023-08-17T00:17:04.039701+0000","last_clean":"2023-08-17T00:17:04.039701+0000","last_became_active":"2023-08-17T00:17:03.612688+0000","last_became_peered":"2023-08-17T00:17:03.612688+0000","last_unstale":"2023-08-17T00:17:04.039701+0000","last_undegraded":"2023-08-17T00:17:04.039701+0000","last_fullsized":"2023-08-17T00:17:04.039701+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059178+0000","last_change":"2023-08-17T00:17:04.055847+0000","last_active":"2023-08-17T00:17:04.059178+0000","last_peered":"2023-08-17T00:17:04.059178+0000","last_clean":"2023-08-17T00:17:04.059178+0000","last_became_active":"2023-08-17T00:17:04.051524+0000","last_became_peered":"2023-08-17T00:17:04.051524+0000","last_unstale":"2023-08-17T00:17:04.059178+0000","last_undegraded":"2023-08-17T00:17:04.059178+0000","last_fullsized":"2023-08-17T00:17:04.059178+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054353+0000","last_change":"2023-08-17T00:17:03.606708+0000","last_active":"2023-08-17T00:17:04.054353+0000","last_peered":"2023-08-17T00:17:04.054353+0000","last_clean":"2023-08-17T00:17:04.054353+0000","last_became_active":"2023-08-17T00:17:03.606429+0000","last_became_peered":"2023-08-17T00:17:03.606429+0000","last_unstale":"2023-08-17T00:17:04.054353+0000","last_undegraded":"2023-08-17T00:17:04.054353+0000","last_fullsized":"2023-08-17T00:17:04.054353+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055258+0000","last_change":"2023-08-17T00:17:04.050797+0000","last_active":"2023-08-17T00:17:04.055258+0000","last_peered":"2023-08-17T00:17:04.055258+0000","last_clean":"2023-08-17T00:17:04.055258+0000","last_became_active":"2023-08-17T00:17:04.050543+0000","last_became_peered":"2023-08-17T00:17:04.050543+0000","last_unstale":"2023-08-17T00:17:04.055258+0000","last_undegraded":"2023-08-17T00:17:04.055258+0000","last_fullsized":"2023-08-17T00:17:04.055258+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035997+0000","last_change":"2023-08-17T00:17:03.597621+0000","last_active":"2023-08-17T00:17:04.035997+0000","last_peered":"2023-08-17T00:17:04.035997+0000","last_clean":"2023-08-17T00:17:04.035997+0000","last_became_active":"2023-08-17T00:17:03.597317+0000","last_became_peered":"2023-08-17T00:17:03.597317+0000","last_unstale":"2023-08-17T00:17:04.035997+0000","last_undegraded":"2023-08-17T00:17:04.035997+0000","last_fullsized":"2023-08-17T00:17:04.035997+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053492+0000","last_change":"2023-08-17T00:17:04.049264+0000","last_active":"2023-08-17T00:17:04.053492+0000","last_peered":"2023-08-17T00:17:04.053492+0000","last_clean":"2023-08-17T00:17:04.053492+0000","last_became_active":"2023-08-17T00:17:04.047002+0000","last_became_peered":"2023-08-17T00:17:04.047002+0000","last_unstale":"2023-08-17T00:17:04.053492+0000","last_undegraded":"2023-08-17T00:17:04.053492+0000","last_fullsized":"2023-08-17T00:17:04.053492+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032810+0000","last_change":"2023-08-17T00:17:03.599495+0000","last_active":"2023-08-17T00:17:04.032810+0000","last_peered":"2023-08-17T00:17:04.032810+0000","last_clean":"2023-08-17T00:17:04.032810+0000","last_became_active":"2023-08-17T00:17:03.599051+0000","last_became_peered":"2023-08-17T00:17:03.599051+0000","last_unstale":"2023-08-17T00:17:04.032810+0000","last_undegraded":"2023-08-17T00:17:04.032810+0000","last_fullsized":"2023-08-17T00:17:04.032810+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044945+0000","last_change":"2023-08-17T00:17:04.040949+0000","last_active":"2023-08-17T00:17:04.044945+0000","last_peered":"2023-08-17T00:17:04.044945+0000","last_clean":"2023-08-17T00:17:04.044945+0000","last_became_active":"2023-08-17T00:17:04.040663+0000","last_became_peered":"2023-08-17T00:17:04.040663+0000","last_unstale":"2023-08-17T00:17:04.044945+0000","last_undegraded":"2023-08-17T00:17:04.044945+0000","last_fullsized":"2023-08-17T00:17:04.044945+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.036851+0000","last_change":"2023-08-17T00:17:03.601055+0000","last_active":"2023-08-17T00:17:04.036851+0000","last_peered":"2023-08-17T00:17:04.036851+0000","last_clean":"2023-08-17T00:17:04.036851+0000","last_became_active":"2023-08-17T00:17:03.600760+0000","last_became_peered":"2023-08-17T00:17:03.600760+0000","last_unstale":"2023-08-17T00:17:04.036851+0000","last_undegraded":"2023-08-17T00:17:04.036851+0000","last_fullsized":"2023-08-17T00:17:04.036851+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054201+0000","last_change":"2023-08-17T00:17:04.042770+0000","last_active":"2023-08-17T00:17:04.054201+0000","last_peered":"2023-08-17T00:17:04.054201+0000","last_clean":"2023-08-17T00:17:04.054201+0000","last_became_active":"2023-08-17T00:17:04.042363+0000","last_became_peered":"2023-08-17T00:17:04.042363+0000","last_unstale":"2023-08-17T00:17:04.054201+0000","last_undegraded":"2023-08-17T00:17:04.054201+0000","last_fullsized":"2023-08-17T00:17:04.054201+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034220+0000","last_change":"2023-08-17T00:17:03.610988+0000","last_active":"2023-08-17T00:17:04.034220+0000","last_peered":"2023-08-17T00:17:04.034220+0000","last_clean":"2023-08-17T00:17:04.034220+0000","last_became_active":"2023-08-17T00:17:03.609830+0000","last_became_peered":"2023-08-17T00:17:03.609830+0000","last_unstale":"2023-08-17T00:17:04.034220+0000","last_undegraded":"2023-08-17T00:17:04.034220+0000","last_fullsized":"2023-08-17T00:17:04.034220+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056075+0000","last_change":"2023-08-17T00:17:04.052392+0000","last_active":"2023-08-17T00:17:04.056075+0000","last_peered":"2023-08-17T00:17:04.056075+0000","last_clean":"2023-08-17T00:17:04.056075+0000","last_became_active":"2023-08-17T00:17:04.052134+0000","last_became_peered":"2023-08-17T00:17:04.052134+0000","last_unstale":"2023-08-17T00:17:04.056075+0000","last_undegraded":"2023-08-17T00:17:04.056075+0000","last_fullsized":"2023-08-17T00:17:04.056075+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025711+0000","last_change":"2023-08-17T00:17:03.595481+0000","last_active":"2023-08-17T00:17:04.025711+0000","last_peered":"2023-08-17T00:17:04.025711+0000","last_clean":"2023-08-17T00:17:04.025711+0000","last_became_active":"2023-08-17T00:17:03.595149+0000","last_became_peered":"2023-08-17T00:17:03.595149+0000","last_unstale":"2023-08-17T00:17:04.025711+0000","last_undegraded":"2023-08-17T00:17:04.025711+0000","last_fullsized":"2023-08-17T00:17:04.025711+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.045453+0000","last_change":"2023-08-17T00:17:04.035061+0000","last_active":"2023-08-17T00:17:04.045453+0000","last_peered":"2023-08-17T00:17:04.045453+0000","last_clean":"2023-08-17T00:17:04.045453+0000","last_became_active":"2023-08-17T00:17:04.034776+0000","last_became_peered":"2023-08-17T00:17:04.034776+0000","last_unstale":"2023-08-17T00:17:04.045453+0000","last_undegraded":"2023-08-17T00:17:04.045453+0000","last_fullsized":"2023-08-17T00:17:04.045453+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022786+0000","last_change":"2023-08-17T00:17:03.607437+0000","last_active":"2023-08-17T00:17:04.022786+0000","last_peered":"2023-08-17T00:17:04.022786+0000","last_clean":"2023-08-17T00:17:04.022786+0000","last_became_active":"2023-08-17T00:17:03.603660+0000","last_became_peered":"2023-08-17T00:17:03.603660+0000","last_unstale":"2023-08-17T00:17:04.022786+0000","last_undegraded":"2023-08-17T00:17:04.022786+0000","last_fullsized":"2023-08-17T00:17:04.022786+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038525+0000","last_change":"2023-08-17T00:17:04.032614+0000","last_active":"2023-08-17T00:17:04.038525+0000","last_peered":"2023-08-17T00:17:04.038525+0000","last_clean":"2023-08-17T00:17:04.038525+0000","last_became_active":"2023-08-17T00:17:04.032240+0000","last_became_peered":"2023-08-17T00:17:04.032240+0000","last_unstale":"2023-08-17T00:17:04.038525+0000","last_undegraded":"2023-08-17T00:17:04.038525+0000","last_fullsized":"2023-08-17T00:17:04.038525+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025722+0000","last_change":"2023-08-17T00:17:03.608941+0000","last_active":"2023-08-17T00:17:04.025722+0000","last_peered":"2023-08-17T00:17:04.025722+0000","last_clean":"2023-08-17T00:17:04.025722+0000","last_became_active":"2023-08-17T00:17:03.608636+0000","last_became_peered":"2023-08-17T00:17:03.608636+0000","last_unstale":"2023-08-17T00:17:04.025722+0000","last_undegraded":"2023-08-17T00:17:04.025722+0000","last_fullsized":"2023-08-17T00:17:04.025722+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053581+0000","last_change":"2023-08-17T00:17:04.050969+0000","last_active":"2023-08-17T00:17:04.053581+0000","last_peered":"2023-08-17T00:17:04.053581+0000","last_clean":"2023-08-17T00:17:04.053581+0000","last_became_active":"2023-08-17T00:17:04.050486+0000","last_became_peered":"2023-08-17T00:17:04.050486+0000","last_unstale":"2023-08-17T00:17:04.053581+0000","last_undegraded":"2023-08-17T00:17:04.053581+0000","last_fullsized":"2023-08-17T00:17:04.053581+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032040+0000","last_change":"2023-08-17T00:17:03.597907+0000","last_active":"2023-08-17T00:17:04.032040+0000","last_peered":"2023-08-17T00:17:04.032040+0000","last_clean":"2023-08-17T00:17:04.032040+0000","last_became_active":"2023-08-17T00:17:03.597644+0000","last_became_peered":"2023-08-17T00:17:03.597644+0000","last_unstale":"2023-08-17T00:17:04.032040+0000","last_undegraded":"2023-08-17T00:17:04.032040+0000","last_fullsized":"2023-08-17T00:17:04.032040+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058180+0000","last_change":"2023-08-17T00:17:04.056716+0000","last_active":"2023-08-17T00:17:04.058180+0000","last_peered":"2023-08-17T00:17:04.058180+0000","last_clean":"2023-08-17T00:17:04.058180+0000","last_became_active":"2023-08-17T00:17:04.055773+0000","last_became_peered":"2023-08-17T00:17:04.055773+0000","last_unstale":"2023-08-17T00:17:04.058180+0000","last_undegraded":"2023-08-17T00:17:04.058180+0000","last_fullsized":"2023-08-17T00:17:04.058180+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.036565+0000","last_change":"2023-08-17T00:17:03.611346+0000","last_active":"2023-08-17T00:17:04.036565+0000","last_peered":"2023-08-17T00:17:04.036565+0000","last_clean":"2023-08-17T00:17:04.036565+0000","last_became_active":"2023-08-17T00:17:03.611004+0000","last_became_peered":"2023-08-17T00:17:03.611004+0000","last_unstale":"2023-08-17T00:17:04.036565+0000","last_undegraded":"2023-08-17T00:17:04.036565+0000","last_fullsized":"2023-08-17T00:17:04.036565+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051645+0000","last_change":"2023-08-17T00:17:04.048187+0000","last_active":"2023-08-17T00:17:04.051645+0000","last_peered":"2023-08-17T00:17:04.051645+0000","last_clean":"2023-08-17T00:17:04.051645+0000","last_became_active":"2023-08-17T00:17:04.047889+0000","last_became_peered":"2023-08-17T00:17:04.047889+0000","last_unstale":"2023-08-17T00:17:04.051645+0000","last_undegraded":"2023-08-17T00:17:04.051645+0000","last_fullsized":"2023-08-17T00:17:04.051645+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035526+0000","last_change":"2023-08-17T00:17:03.613617+0000","last_active":"2023-08-17T00:17:04.035526+0000","last_peered":"2023-08-17T00:17:04.035526+0000","last_clean":"2023-08-17T00:17:04.035526+0000","last_became_active":"2023-08-17T00:17:03.612763+0000","last_became_peered":"2023-08-17T00:17:03.612763+0000","last_unstale":"2023-08-17T00:17:04.035526+0000","last_undegraded":"2023-08-17T00:17:04.035526+0000","last_fullsized":"2023-08-17T00:17:04.035526+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051952+0000","last_change":"2023-08-17T00:17:04.049571+0000","last_active":"2023-08-17T00:17:04.051952+0000","last_peered":"2023-08-17T00:17:04.051952+0000","last_clean":"2023-08-17T00:17:04.051952+0000","last_became_active":"2023-08-17T00:17:04.049298+0000","last_became_peered":"2023-08-17T00:17:04.049298+0000","last_unstale":"2023-08-17T00:17:04.051952+0000","last_undegraded":"2023-08-17T00:17:04.051952+0000","last_fullsized":"2023-08-17T00:17:04.051952+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034070+0000","last_change":"2023-08-17T00:17:03.596004+0000","last_active":"2023-08-17T00:17:04.034070+0000","last_peered":"2023-08-17T00:17:04.034070+0000","last_clean":"2023-08-17T00:17:04.034070+0000","last_became_active":"2023-08-17T00:17:03.595679+0000","last_became_peered":"2023-08-17T00:17:03.595679+0000","last_unstale":"2023-08-17T00:17:04.034070+0000","last_undegraded":"2023-08-17T00:17:04.034070+0000","last_fullsized":"2023-08-17T00:17:04.034070+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056080+0000","last_change":"2023-08-17T00:17:04.045491+0000","last_active":"2023-08-17T00:17:04.056080+0000","last_peered":"2023-08-17T00:17:04.056080+0000","last_clean":"2023-08-17T00:17:04.056080+0000","last_became_active":"2023-08-17T00:17:04.044996+0000","last_became_peered":"2023-08-17T00:17:04.044996+0000","last_unstale":"2023-08-17T00:17:04.056080+0000","last_undegraded":"2023-08-17T00:17:04.056080+0000","last_fullsized":"2023-08-17T00:17:04.056080+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038080+0000","last_change":"2023-08-17T00:17:03.596073+0000","last_active":"2023-08-17T00:17:04.038080+0000","last_peered":"2023-08-17T00:17:04.038080+0000","last_clean":"2023-08-17T00:17:04.038080+0000","last_became_active":"2023-08-17T00:17:03.595733+0000","last_became_peered":"2023-08-17T00:17:03.595733+0000","last_unstale":"2023-08-17T00:17:04.038080+0000","last_undegraded":"2023-08-17T00:17:04.038080+0000","last_fullsized":"2023-08-17T00:17:04.038080+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050767+0000","last_change":"2023-08-17T00:17:04.045670+0000","last_active":"2023-08-17T00:17:04.050767+0000","last_peered":"2023-08-17T00:17:04.050767+0000","last_clean":"2023-08-17T00:17:04.050767+0000","last_became_active":"2023-08-17T00:17:04.045375+0000","last_became_peered":"2023-08-17T00:17:04.045375+0000","last_unstale":"2023-08-17T00:17:04.050767+0000","last_undegraded":"2023-08-17T00:17:04.050767+0000","last_fullsized":"2023-08-17T00:17:04.050767+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034395+0000","last_change":"2023-08-17T00:17:03.609853+0000","last_active":"2023-08-17T00:17:04.034395+0000","last_peered":"2023-08-17T00:17:04.034395+0000","last_clean":"2023-08-17T00:17:04.034395+0000","last_became_active":"2023-08-17T00:17:03.609486+0000","last_became_peered":"2023-08-17T00:17:03.609486+0000","last_unstale":"2023-08-17T00:17:04.034395+0000","last_undegraded":"2023-08-17T00:17:04.034395+0000","last_fullsized":"2023-08-17T00:17:04.034395+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057622+0000","last_change":"2023-08-17T00:17:04.056410+0000","last_active":"2023-08-17T00:17:04.057622+0000","last_peered":"2023-08-17T00:17:04.057622+0000","last_clean":"2023-08-17T00:17:04.057622+0000","last_became_active":"2023-08-17T00:17:04.056085+0000","last_became_peered":"2023-08-17T00:17:04.056085+0000","last_unstale":"2023-08-17T00:17:04.057622+0000","last_undegraded":"2023-08-17T00:17:04.057622+0000","last_fullsized":"2023-08-17T00:17:04.057622+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.15","version":"191'3","reported_seq":13,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054056+0000","last_change":"2023-08-17T00:17:03.601584+0000","last_active":"2023-08-17T00:17:04.054056+0000","last_peered":"2023-08-17T00:17:04.054056+0000","last_clean":"2023-08-17T00:17:04.054056+0000","last_became_active":"2023-08-17T00:17:03.601218+0000","last_became_peered":"2023-08-17T00:17:03.601218+0000","last_unstale":"2023-08-17T00:17:04.054056+0000","last_undegraded":"2023-08-17T00:17:04.054056+0000","last_fullsized":"2023-08-17T00:17:04.054056+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.058154+0000","last_change":"2023-08-17T00:17:04.056552+0000","last_active":"2023-08-17T00:17:04.058154+0000","last_peered":"2023-08-17T00:17:04.058154+0000","last_clean":"2023-08-17T00:17:04.058154+0000","last_became_active":"2023-08-17T00:17:04.055842+0000","last_became_peered":"2023-08-17T00:17:04.055842+0000","last_unstale":"2023-08-17T00:17:04.058154+0000","last_undegraded":"2023-08-17T00:17:04.058154+0000","last_fullsized":"2023-08-17T00:17:04.058154+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.14","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056352+0000","last_change":"2023-08-17T00:17:03.600325+0000","last_active":"2023-08-17T00:17:04.056352+0000","last_peered":"2023-08-17T00:17:04.056352+0000","last_clean":"2023-08-17T00:17:04.056352+0000","last_became_active":"2023-08-17T00:17:03.600007+0000","last_became_peered":"2023-08-17T00:17:03.600007+0000","last_unstale":"2023-08-17T00:17:04.056352+0000","last_undegraded":"2023-08-17T00:17:04.056352+0000","last_fullsized":"2023-08-17T00:17:04.056352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044551+0000","last_change":"2023-08-17T00:17:04.033044+0000","last_active":"2023-08-17T00:17:04.044551+0000","last_peered":"2023-08-17T00:17:04.044551+0000","last_clean":"2023-08-17T00:17:04.044551+0000","last_became_active":"2023-08-17T00:17:04.032572+0000","last_became_peered":"2023-08-17T00:17:04.032572+0000","last_unstale":"2023-08-17T00:17:04.044551+0000","last_undegraded":"2023-08-17T00:17:04.044551+0000","last_fullsized":"2023-08-17T00:17:04.044551+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.13","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054893+0000","last_change":"2023-08-17T00:17:03.611763+0000","last_active":"2023-08-17T00:17:04.054893+0000","last_peered":"2023-08-17T00:17:04.054893+0000","last_clean":"2023-08-17T00:17:04.054893+0000","last_became_active":"2023-08-17T00:17:03.611425+0000","last_became_peered":"2023-08-17T00:17:03.611425+0000","last_unstale":"2023-08-17T00:17:04.054893+0000","last_undegraded":"2023-08-17T00:17:04.054893+0000","last_fullsized":"2023-08-17T00:17:04.054893+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057384+0000","last_change":"2023-08-17T00:17:04.050251+0000","last_active":"2023-08-17T00:17:04.057384+0000","last_peered":"2023-08-17T00:17:04.057384+0000","last_clean":"2023-08-17T00:17:04.057384+0000","last_became_active":"2023-08-17T00:17:04.049738+0000","last_became_peered":"2023-08-17T00:17:04.049738+0000","last_unstale":"2023-08-17T00:17:04.057384+0000","last_undegraded":"2023-08-17T00:17:04.057384+0000","last_fullsized":"2023-08-17T00:17:04.057384+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.037964+0000","last_change":"2023-08-17T00:17:03.600255+0000","last_active":"2023-08-17T00:17:04.037964+0000","last_peered":"2023-08-17T00:17:04.037964+0000","last_clean":"2023-08-17T00:17:04.037964+0000","last_became_active":"2023-08-17T00:17:03.599911+0000","last_became_peered":"2023-08-17T00:17:03.599911+0000","last_unstale":"2023-08-17T00:17:04.037964+0000","last_undegraded":"2023-08-17T00:17:04.037964+0000","last_fullsized":"2023-08-17T00:17:04.037964+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053470+0000","last_change":"2023-08-17T00:17:04.046927+0000","last_active":"2023-08-17T00:17:04.053470+0000","last_peered":"2023-08-17T00:17:04.053470+0000","last_clean":"2023-08-17T00:17:04.053470+0000","last_became_active":"2023-08-17T00:17:04.046626+0000","last_became_peered":"2023-08-17T00:17:04.046626+0000","last_unstale":"2023-08-17T00:17:04.053470+0000","last_undegraded":"2023-08-17T00:17:04.053470+0000","last_fullsized":"2023-08-17T00:17:04.053470+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.027262+0000","last_change":"2023-08-17T00:17:03.604322+0000","last_active":"2023-08-17T00:17:04.027262+0000","last_peered":"2023-08-17T00:17:04.027262+0000","last_clean":"2023-08-17T00:17:04.027262+0000","last_became_active":"2023-08-17T00:17:03.603995+0000","last_became_peered":"2023-08-17T00:17:03.603995+0000","last_unstale":"2023-08-17T00:17:04.027262+0000","last_undegraded":"2023-08-17T00:17:04.027262+0000","last_fullsized":"2023-08-17T00:17:04.027262+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.061860+0000","last_change":"2023-08-17T00:17:04.053850+0000","last_active":"2023-08-17T00:17:04.061860+0000","last_peered":"2023-08-17T00:17:04.061860+0000","last_clean":"2023-08-17T00:17:04.061860+0000","last_became_active":"2023-08-17T00:17:04.053597+0000","last_became_peered":"2023-08-17T00:17:04.053597+0000","last_unstale":"2023-08-17T00:17:04.061860+0000","last_undegraded":"2023-08-17T00:17:04.061860+0000","last_fullsized":"2023-08-17T00:17:04.061860+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.10","version":"191'4","reported_seq":14,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047657+0000","last_change":"2023-08-17T00:17:03.606608+0000","last_active":"2023-08-17T00:17:04.047657+0000","last_peered":"2023-08-17T00:17:04.047657+0000","last_clean":"2023-08-17T00:17:04.047657+0000","last_became_active":"2023-08-17T00:17:03.606317+0000","last_became_peered":"2023-08-17T00:17:03.606317+0000","last_unstale":"2023-08-17T00:17:04.047657+0000","last_undegraded":"2023-08-17T00:17:04.047657+0000","last_fullsized":"2023-08-17T00:17:04.047657+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054182+0000","last_change":"2023-08-17T00:17:04.042596+0000","last_active":"2023-08-17T00:17:04.054182+0000","last_peered":"2023-08-17T00:17:04.054182+0000","last_clean":"2023-08-17T00:17:04.054182+0000","last_became_active":"2023-08-17T00:17:04.042057+0000","last_became_peered":"2023-08-17T00:17:04.042057+0000","last_unstale":"2023-08-17T00:17:04.054182+0000","last_undegraded":"2023-08-17T00:17:04.054182+0000","last_fullsized":"2023-08-17T00:17:04.054182+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046244+0000","last_change":"2023-08-17T00:17:03.608573+0000","last_active":"2023-08-17T00:17:04.046244+0000","last_peered":"2023-08-17T00:17:04.046244+0000","last_clean":"2023-08-17T00:17:04.046244+0000","last_became_active":"2023-08-17T00:17:03.608193+0000","last_became_peered":"2023-08-17T00:17:03.608193+0000","last_unstale":"2023-08-17T00:17:04.046244+0000","last_undegraded":"2023-08-17T00:17:04.046244+0000","last_fullsized":"2023-08-17T00:17:04.046244+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057020+0000","last_change":"2023-08-17T00:17:04.053237+0000","last_active":"2023-08-17T00:17:04.057020+0000","last_peered":"2023-08-17T00:17:04.057020+0000","last_clean":"2023-08-17T00:17:04.057020+0000","last_became_active":"2023-08-17T00:17:04.052979+0000","last_became_peered":"2023-08-17T00:17:04.052979+0000","last_unstale":"2023-08-17T00:17:04.057020+0000","last_undegraded":"2023-08-17T00:17:04.057020+0000","last_fullsized":"2023-08-17T00:17:04.057020+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.e","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.048095+0000","last_change":"2023-08-17T00:17:03.604251+0000","last_active":"2023-08-17T00:17:04.048095+0000","last_peered":"2023-08-17T00:17:04.048095+0000","last_clean":"2023-08-17T00:17:04.048095+0000","last_became_active":"2023-08-17T00:17:03.603083+0000","last_became_peered":"2023-08-17T00:17:03.603083+0000","last_unstale":"2023-08-17T00:17:04.048095+0000","last_undegraded":"2023-08-17T00:17:04.048095+0000","last_fullsized":"2023-08-17T00:17:04.048095+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050118+0000","last_change":"2023-08-17T00:17:04.047137+0000","last_active":"2023-08-17T00:17:04.050118+0000","last_peered":"2023-08-17T00:17:04.050118+0000","last_clean":"2023-08-17T00:17:04.050118+0000","last_became_active":"2023-08-17T00:17:04.046858+0000","last_became_peered":"2023-08-17T00:17:04.046858+0000","last_unstale":"2023-08-17T00:17:04.050118+0000","last_undegraded":"2023-08-17T00:17:04.050118+0000","last_fullsized":"2023-08-17T00:17:04.050118+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.029440+0000","last_change":"2023-08-17T00:17:03.601090+0000","last_active":"2023-08-17T00:17:04.029440+0000","last_peered":"2023-08-17T00:17:04.029440+0000","last_clean":"2023-08-17T00:17:04.029440+0000","last_became_active":"2023-08-17T00:17:03.600472+0000","last_became_peered":"2023-08-17T00:17:03.600472+0000","last_unstale":"2023-08-17T00:17:04.029440+0000","last_undegraded":"2023-08-17T00:17:04.029440+0000","last_fullsized":"2023-08-17T00:17:04.029440+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.061903+0000","last_change":"2023-08-17T00:17:04.056944+0000","last_active":"2023-08-17T00:17:04.061903+0000","last_peered":"2023-08-17T00:17:04.061903+0000","last_clean":"2023-08-17T00:17:04.061903+0000","last_became_active":"2023-08-17T00:17:04.056627+0000","last_became_peered":"2023-08-17T00:17:04.056627+0000","last_unstale":"2023-08-17T00:17:04.061903+0000","last_undegraded":"2023-08-17T00:17:04.061903+0000","last_fullsized":"2023-08-17T00:17:04.061903+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040018+0000","last_change":"2023-08-17T00:17:03.615987+0000","last_active":"2023-08-17T00:17:04.040018+0000","last_peered":"2023-08-17T00:17:04.040018+0000","last_clean":"2023-08-17T00:17:04.040018+0000","last_became_active":"2023-08-17T00:17:03.615694+0000","last_became_peered":"2023-08-17T00:17:03.615694+0000","last_unstale":"2023-08-17T00:17:04.040018+0000","last_undegraded":"2023-08-17T00:17:04.040018+0000","last_fullsized":"2023-08-17T00:17:04.040018+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053562+0000","last_change":"2023-08-17T00:17:04.050789+0000","last_active":"2023-08-17T00:17:04.053562+0000","last_peered":"2023-08-17T00:17:04.053562+0000","last_clean":"2023-08-17T00:17:04.053562+0000","last_became_active":"2023-08-17T00:17:04.050094+0000","last_became_peered":"2023-08-17T00:17:04.050094+0000","last_unstale":"2023-08-17T00:17:04.053562+0000","last_undegraded":"2023-08-17T00:17:04.053562+0000","last_fullsized":"2023-08-17T00:17:04.053562+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.b","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.046352+0000","last_change":"2023-08-17T00:17:03.606480+0000","last_active":"2023-08-17T00:17:04.046352+0000","last_peered":"2023-08-17T00:17:04.046352+0000","last_clean":"2023-08-17T00:17:04.046352+0000","last_became_active":"2023-08-17T00:17:03.606201+0000","last_became_peered":"2023-08-17T00:17:03.606201+0000","last_unstale":"2023-08-17T00:17:04.046352+0000","last_undegraded":"2023-08-17T00:17:04.046352+0000","last_fullsized":"2023-08-17T00:17:04.046352+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049052+0000","last_change":"2023-08-17T00:17:04.040428+0000","last_active":"2023-08-17T00:17:04.049052+0000","last_peered":"2023-08-17T00:17:04.049052+0000","last_clean":"2023-08-17T00:17:04.049052+0000","last_became_active":"2023-08-17T00:17:04.040152+0000","last_became_peered":"2023-08-17T00:17:04.040152+0000","last_unstale":"2023-08-17T00:17:04.049052+0000","last_undegraded":"2023-08-17T00:17:04.049052+0000","last_fullsized":"2023-08-17T00:17:04.049052+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039093+0000","last_change":"2023-08-17T00:17:03.612657+0000","last_active":"2023-08-17T00:17:04.039093+0000","last_peered":"2023-08-17T00:17:04.039093+0000","last_clean":"2023-08-17T00:17:04.039093+0000","last_became_active":"2023-08-17T00:17:03.612391+0000","last_became_peered":"2023-08-17T00:17:03.612391+0000","last_unstale":"2023-08-17T00:17:04.039093+0000","last_undegraded":"2023-08-17T00:17:04.039093+0000","last_fullsized":"2023-08-17T00:17:04.039093+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.051994+0000","last_change":"2023-08-17T00:17:04.048967+0000","last_active":"2023-08-17T00:17:04.051994+0000","last_peered":"2023-08-17T00:17:04.051994+0000","last_clean":"2023-08-17T00:17:04.051994+0000","last_became_active":"2023-08-17T00:17:04.048659+0000","last_became_peered":"2023-08-17T00:17:04.048659+0000","last_unstale":"2023-08-17T00:17:04.051994+0000","last_undegraded":"2023-08-17T00:17:04.051994+0000","last_fullsized":"2023-08-17T00:17:04.051994+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032901+0000","last_change":"2023-08-17T00:17:03.611238+0000","last_active":"2023-08-17T00:17:04.032901+0000","last_peered":"2023-08-17T00:17:04.032901+0000","last_clean":"2023-08-17T00:17:04.032901+0000","last_became_active":"2023-08-17T00:17:03.609987+0000","last_became_peered":"2023-08-17T00:17:03.609987+0000","last_unstale":"2023-08-17T00:17:04.032901+0000","last_undegraded":"2023-08-17T00:17:04.032901+0000","last_fullsized":"2023-08-17T00:17:04.032901+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.059113+0000","last_change":"2023-08-17T00:17:04.050256+0000","last_active":"2023-08-17T00:17:04.059113+0000","last_peered":"2023-08-17T00:17:04.059113+0000","last_clean":"2023-08-17T00:17:04.059113+0000","last_became_active":"2023-08-17T00:17:04.049997+0000","last_became_peered":"2023-08-17T00:17:04.049997+0000","last_unstale":"2023-08-17T00:17:04.059113+0000","last_undegraded":"2023-08-17T00:17:04.059113+0000","last_fullsized":"2023-08-17T00:17:04.059113+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.030393+0000","last_change":"2023-08-17T00:17:03.608995+0000","last_active":"2023-08-17T00:17:04.030393+0000","last_peered":"2023-08-17T00:17:04.030393+0000","last_clean":"2023-08-17T00:17:04.030393+0000","last_became_active":"2023-08-17T00:17:03.608716+0000","last_became_peered":"2023-08-17T00:17:03.608716+0000","last_unstale":"2023-08-17T00:17:04.030393+0000","last_undegraded":"2023-08-17T00:17:04.030393+0000","last_fullsized":"2023-08-17T00:17:04.030393+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049037+0000","last_change":"2023-08-17T00:17:04.039299+0000","last_active":"2023-08-17T00:17:04.049037+0000","last_peered":"2023-08-17T00:17:04.049037+0000","last_clean":"2023-08-17T00:17:04.049037+0000","last_became_active":"2023-08-17T00:17:04.039008+0000","last_became_peered":"2023-08-17T00:17:04.039008+0000","last_unstale":"2023-08-17T00:17:04.049037+0000","last_undegraded":"2023-08-17T00:17:04.049037+0000","last_fullsized":"2023-08-17T00:17:04.049037+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.7","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.055739+0000","last_change":"2023-08-17T00:17:03.604168+0000","last_active":"2023-08-17T00:17:04.055739+0000","last_peered":"2023-08-17T00:17:04.055739+0000","last_clean":"2023-08-17T00:17:04.055739+0000","last_became_active":"2023-08-17T00:17:03.603901+0000","last_became_peered":"2023-08-17T00:17:03.603901+0000","last_unstale":"2023-08-17T00:17:04.055739+0000","last_undegraded":"2023-08-17T00:17:04.055739+0000","last_fullsized":"2023-08-17T00:17:04.055739+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.057426+0000","last_change":"2023-08-17T00:17:04.050279+0000","last_active":"2023-08-17T00:17:04.057426+0000","last_peered":"2023-08-17T00:17:04.057426+0000","last_clean":"2023-08-17T00:17:04.057426+0000","last_became_active":"2023-08-17T00:17:04.049619+0000","last_became_peered":"2023-08-17T00:17:04.049619+0000","last_unstale":"2023-08-17T00:17:04.057426+0000","last_undegraded":"2023-08-17T00:17:04.057426+0000","last_fullsized":"2023-08-17T00:17:04.057426+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.023559+0000","last_change":"2023-08-17T00:17:03.598312+0000","last_active":"2023-08-17T00:17:04.023559+0000","last_peered":"2023-08-17T00:17:04.023559+0000","last_clean":"2023-08-17T00:17:04.023559+0000","last_became_active":"2023-08-17T00:17:03.597966+0000","last_became_peered":"2023-08-17T00:17:03.597966+0000","last_unstale":"2023-08-17T00:17:04.023559+0000","last_undegraded":"2023-08-17T00:17:04.023559+0000","last_fullsized":"2023-08-17T00:17:04.023559+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056119+0000","last_change":"2023-08-17T00:17:04.054458+0000","last_active":"2023-08-17T00:17:04.056119+0000","last_peered":"2023-08-17T00:17:04.056119+0000","last_clean":"2023-08-17T00:17:04.056119+0000","last_became_active":"2023-08-17T00:17:04.054168+0000","last_became_peered":"2023-08-17T00:17:04.054168+0000","last_unstale":"2023-08-17T00:17:04.056119+0000","last_undegraded":"2023-08-17T00:17:04.056119+0000","last_fullsized":"2023-08-17T00:17:04.056119+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.022921+0000","last_change":"2023-08-17T00:17:03.600702+0000","last_active":"2023-08-17T00:17:04.022921+0000","last_peered":"2023-08-17T00:17:04.022921+0000","last_clean":"2023-08-17T00:17:04.022921+0000","last_became_active":"2023-08-17T00:17:03.600329+0000","last_became_peered":"2023-08-17T00:17:03.600329+0000","last_unstale":"2023-08-17T00:17:04.022921+0000","last_undegraded":"2023-08-17T00:17:04.022921+0000","last_fullsized":"2023-08-17T00:17:04.022921+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056644+0000","last_change":"2023-08-17T00:17:04.048843+0000","last_active":"2023-08-17T00:17:04.056644+0000","last_peered":"2023-08-17T00:17:04.056644+0000","last_clean":"2023-08-17T00:17:04.056644+0000","last_became_active":"2023-08-17T00:17:04.048452+0000","last_became_peered":"2023-08-17T00:17:04.048452+0000","last_unstale":"2023-08-17T00:17:04.056644+0000","last_undegraded":"2023-08-17T00:17:04.056644+0000","last_fullsized":"2023-08-17T00:17:04.056644+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032195+0000","last_change":"2023-08-17T00:17:03.601397+0000","last_active":"2023-08-17T00:17:04.032195+0000","last_peered":"2023-08-17T00:17:04.032195+0000","last_clean":"2023-08-17T00:17:04.032195+0000","last_became_active":"2023-08-17T00:17:03.601090+0000","last_became_peered":"2023-08-17T00:17:03.601090+0000","last_unstale":"2023-08-17T00:17:04.032195+0000","last_undegraded":"2023-08-17T00:17:04.032195+0000","last_fullsized":"2023-08-17T00:17:04.032195+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056057+0000","last_change":"2023-08-17T00:17:04.044730+0000","last_active":"2023-08-17T00:17:04.056057+0000","last_peered":"2023-08-17T00:17:04.056057+0000","last_clean":"2023-08-17T00:17:04.056057+0000","last_became_active":"2023-08-17T00:17:04.044474+0000","last_became_peered":"2023-08-17T00:17:04.044474+0000","last_unstale":"2023-08-17T00:17:04.056057+0000","last_undegraded":"2023-08-17T00:17:04.056057+0000","last_fullsized":"2023-08-17T00:17:04.056057+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032141+0000","last_change":"2023-08-17T00:17:03.604924+0000","last_active":"2023-08-17T00:17:04.032141+0000","last_peered":"2023-08-17T00:17:04.032141+0000","last_clean":"2023-08-17T00:17:04.032141+0000","last_became_active":"2023-08-17T00:17:03.604666+0000","last_became_peered":"2023-08-17T00:17:03.604666+0000","last_unstale":"2023-08-17T00:17:04.032141+0000","last_undegraded":"2023-08-17T00:17:04.032141+0000","last_fullsized":"2023-08-17T00:17:04.032141+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054934+0000","last_change":"2023-08-17T00:17:04.052415+0000","last_active":"2023-08-17T00:17:04.054934+0000","last_peered":"2023-08-17T00:17:04.054934+0000","last_clean":"2023-08-17T00:17:04.054934+0000","last_became_active":"2023-08-17T00:17:04.052144+0000","last_became_peered":"2023-08-17T00:17:04.052144+0000","last_unstale":"2023-08-17T00:17:04.054934+0000","last_undegraded":"2023-08-17T00:17:04.054934+0000","last_fullsized":"2023-08-17T00:17:04.054934+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028728+0000","last_change":"2023-08-17T00:17:03.604890+0000","last_active":"2023-08-17T00:17:04.028728+0000","last_peered":"2023-08-17T00:17:04.028728+0000","last_clean":"2023-08-17T00:17:04.028728+0000","last_became_active":"2023-08-17T00:17:03.604627+0000","last_became_peered":"2023-08-17T00:17:03.604627+0000","last_unstale":"2023-08-17T00:17:04.028728+0000","last_undegraded":"2023-08-17T00:17:04.028728+0000","last_fullsized":"2023-08-17T00:17:04.028728+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049187+0000","last_change":"2023-08-17T00:17:04.040497+0000","last_active":"2023-08-17T00:17:04.049187+0000","last_peered":"2023-08-17T00:17:04.049187+0000","last_clean":"2023-08-17T00:17:04.049187+0000","last_became_active":"2023-08-17T00:17:04.039861+0000","last_became_peered":"2023-08-17T00:17:04.039861+0000","last_unstale":"2023-08-17T00:17:04.049187+0000","last_undegraded":"2023-08-17T00:17:04.049187+0000","last_fullsized":"2023-08-17T00:17:04.049187+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032987+0000","last_change":"2023-08-17T00:17:03.610904+0000","last_active":"2023-08-17T00:17:04.032987+0000","last_peered":"2023-08-17T00:17:04.032987+0000","last_clean":"2023-08-17T00:17:04.032987+0000","last_became_active":"2023-08-17T00:17:03.609650+0000","last_became_peered":"2023-08-17T00:17:03.609650+0000","last_unstale":"2023-08-17T00:17:04.032987+0000","last_undegraded":"2023-08-17T00:17:04.032987+0000","last_fullsized":"2023-08-17T00:17:04.032987+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053715+0000","last_change":"2023-08-17T00:17:04.052784+0000","last_active":"2023-08-17T00:17:04.053715+0000","last_peered":"2023-08-17T00:17:04.053715+0000","last_clean":"2023-08-17T00:17:04.053715+0000","last_became_active":"2023-08-17T00:17:04.052382+0000","last_became_peered":"2023-08-17T00:17:04.052382+0000","last_unstale":"2023-08-17T00:17:04.053715+0000","last_undegraded":"2023-08-17T00:17:04.053715+0000","last_fullsized":"2023-08-17T00:17:04.053715+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025362+0000","last_change":"2023-08-17T00:17:03.604509+0000","last_active":"2023-08-17T00:17:04.025362+0000","last_peered":"2023-08-17T00:17:04.025362+0000","last_clean":"2023-08-17T00:17:04.025362+0000","last_became_active":"2023-08-17T00:17:03.604207+0000","last_became_peered":"2023-08-17T00:17:03.604207+0000","last_unstale":"2023-08-17T00:17:04.025362+0000","last_undegraded":"2023-08-17T00:17:04.025362+0000","last_fullsized":"2023-08-17T00:17:04.025362+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.056058+0000","last_change":"2023-08-17T00:17:04.045593+0000","last_active":"2023-08-17T00:17:04.056058+0000","last_peered":"2023-08-17T00:17:04.056058+0000","last_clean":"2023-08-17T00:17:04.056058+0000","last_became_active":"2023-08-17T00:17:04.045320+0000","last_became_peered":"2023-08-17T00:17:04.045320+0000","last_unstale":"2023-08-17T00:17:04.056058+0000","last_undegraded":"2023-08-17T00:17:04.056058+0000","last_fullsized":"2023-08-17T00:17:04.056058+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1e","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.047214+0000","last_change":"2023-08-17T00:17:03.608379+0000","last_active":"2023-08-17T00:17:04.047214+0000","last_peered":"2023-08-17T00:17:04.047214+0000","last_clean":"2023-08-17T00:17:04.047214+0000","last_became_active":"2023-08-17T00:17:03.608068+0000","last_became_peered":"2023-08-17T00:17:03.608068+0000","last_unstale":"2023-08-17T00:17:04.047214+0000","last_undegraded":"2023-08-17T00:17:04.047214+0000","last_fullsized":"2023-08-17T00:17:04.047214+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032471+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:17:04.032471+0000","last_peered":"2023-08-17T00:17:04.032471+0000","last_clean":"2023-08-17T00:17:04.032471+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:17:04.032471+0000","last_undegraded":"2023-08-17T00:17:04.032471+0000","last_fullsized":"2023-08-17T00:17:04.032471+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.044858+0000","last_change":"2023-08-17T00:17:04.038193+0000","last_active":"2023-08-17T00:17:04.044858+0000","last_peered":"2023-08-17T00:17:04.044858+0000","last_clean":"2023-08-17T00:17:04.044858+0000","last_became_active":"2023-08-17T00:17:04.037874+0000","last_became_peered":"2023-08-17T00:17:04.037874+0000","last_unstale":"2023-08-17T00:17:04.044858+0000","last_undegraded":"2023-08-17T00:17:04.044858+0000","last_fullsized":"2023-08-17T00:17:04.044858+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1f","version":"191'1","reported_seq":11,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053978+0000","last_change":"2023-08-17T00:17:03.605442+0000","last_active":"2023-08-17T00:17:04.053978+0000","last_peered":"2023-08-17T00:17:04.053978+0000","last_clean":"2023-08-17T00:17:04.053978+0000","last_became_active":"2023-08-17T00:17:03.605139+0000","last_became_peered":"2023-08-17T00:17:03.605139+0000","last_unstale":"2023-08-17T00:17:04.053978+0000","last_undegraded":"2023-08-17T00:17:04.053978+0000","last_fullsized":"2023-08-17T00:17:04.053978+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":183,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.025808+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:17:04.025808+0000","last_peered":"2023-08-17T00:17:04.025808+0000","last_clean":"2023-08-17T00:17:04.025808+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:17:04.025808+0000","last_undegraded":"2023-08-17T00:17:04.025808+0000","last_fullsized":"2023-08-17T00:17:04.025808+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.053428+0000","last_change":"2023-08-17T00:17:04.048819+0000","last_active":"2023-08-17T00:17:04.053428+0000","last_peered":"2023-08-17T00:17:04.053428+0000","last_clean":"2023-08-17T00:17:04.053428+0000","last_became_active":"2023-08-17T00:17:04.048527+0000","last_became_peered":"2023-08-17T00:17:04.048527+0000","last_unstale":"2023-08-17T00:17:04.053428+0000","last_undegraded":"2023-08-17T00:17:04.053428+0000","last_fullsized":"2023-08-17T00:17:04.053428+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.039904+0000","last_change":"2023-08-17T00:17:03.614980+0000","last_active":"2023-08-17T00:17:04.039904+0000","last_peered":"2023-08-17T00:17:04.039904+0000","last_clean":"2023-08-17T00:17:04.039904+0000","last_became_active":"2023-08-17T00:17:03.614675+0000","last_became_peered":"2023-08-17T00:17:03.614675+0000","last_unstale":"2023-08-17T00:17:04.039904+0000","last_undegraded":"2023-08-17T00:17:04.039904+0000","last_fullsized":"2023-08-17T00:17:04.039904+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.031984+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:17:04.031984+0000","last_peered":"2023-08-17T00:17:04.031984+0000","last_clean":"2023-08-17T00:17:04.031984+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:17:04.031984+0000","last_undegraded":"2023-08-17T00:17:04.031984+0000","last_fullsized":"2023-08-17T00:17:04.031984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049122+0000","last_change":"2023-08-17T00:17:04.042523+0000","last_active":"2023-08-17T00:17:04.049122+0000","last_peered":"2023-08-17T00:17:04.049122+0000","last_clean":"2023-08-17T00:17:04.049122+0000","last_became_active":"2023-08-17T00:17:04.042059+0000","last_became_peered":"2023-08-17T00:17:04.042059+0000","last_unstale":"2023-08-17T00:17:04.049122+0000","last_undegraded":"2023-08-17T00:17:04.049122+0000","last_fullsized":"2023-08-17T00:17:04.049122+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1d","version":"191'2","reported_seq":12,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054300+0000","last_change":"2023-08-17T00:17:03.611041+0000","last_active":"2023-08-17T00:17:04.054300+0000","last_peered":"2023-08-17T00:17:04.054300+0000","last_clean":"2023-08-17T00:17:04.054300+0000","last_became_active":"2023-08-17T00:17:03.610638+0000","last_became_peered":"2023-08-17T00:17:03.610638+0000","last_unstale":"2023-08-17T00:17:04.054300+0000","last_undegraded":"2023-08-17T00:17:04.054300+0000","last_fullsized":"2023-08-17T00:17:04.054300+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":175,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.028249+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:17:04.028249+0000","last_peered":"2023-08-17T00:17:04.028249+0000","last_clean":"2023-08-17T00:17:04.028249+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:17:04.028249+0000","last_undegraded":"2023-08-17T00:17:04.028249+0000","last_fullsized":"2023-08-17T00:17:04.028249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.050165+0000","last_change":"2023-08-17T00:17:04.045916+0000","last_active":"2023-08-17T00:17:04.050165+0000","last_peered":"2023-08-17T00:17:04.050165+0000","last_clean":"2023-08-17T00:17:04.050165+0000","last_became_active":"2023-08-17T00:17:04.045632+0000","last_became_peered":"2023-08-17T00:17:04.045632+0000","last_unstale":"2023-08-17T00:17:04.050165+0000","last_undegraded":"2023-08-17T00:17:04.050165+0000","last_fullsized":"2023-08-17T00:17:04.050165+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.034570+0000","last_change":"2023-08-17T00:17:03.608444+0000","last_active":"2023-08-17T00:17:04.034570+0000","last_peered":"2023-08-17T00:17:04.034570+0000","last_clean":"2023-08-17T00:17:04.034570+0000","last_became_active":"2023-08-17T00:17:03.605953+0000","last_became_peered":"2023-08-17T00:17:03.605953+0000","last_unstale":"2023-08-17T00:17:04.034570+0000","last_undegraded":"2023-08-17T00:17:04.034570+0000","last_fullsized":"2023-08-17T00:17:04.034570+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.035062+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:17:04.035062+0000","last_peered":"2023-08-17T00:17:04.035062+0000","last_clean":"2023-08-17T00:17:04.035062+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:17:04.035062+0000","last_undegraded":"2023-08-17T00:17:04.035062+0000","last_fullsized":"2023-08-17T00:17:04.035062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.054499+0000","last_change":"2023-08-17T00:17:04.050181+0000","last_active":"2023-08-17T00:17:04.054499+0000","last_peered":"2023-08-17T00:17:04.054499+0000","last_clean":"2023-08-17T00:17:04.054499+0000","last_became_active":"2023-08-17T00:17:04.049847+0000","last_became_peered":"2023-08-17T00:17:04.049847+0000","last_unstale":"2023-08-17T00:17:04.054499+0000","last_undegraded":"2023-08-17T00:17:04.054499+0000","last_fullsized":"2023-08-17T00:17:04.054499+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.027220+0000","last_change":"2023-08-17T00:17:03.607083+0000","last_active":"2023-08-17T00:17:04.027220+0000","last_peered":"2023-08-17T00:17:04.027220+0000","last_clean":"2023-08-17T00:17:04.027220+0000","last_became_active":"2023-08-17T00:17:03.606777+0000","last_became_peered":"2023-08-17T00:17:03.606777+0000","last_unstale":"2023-08-17T00:17:04.027220+0000","last_undegraded":"2023-08-17T00:17:04.027220+0000","last_fullsized":"2023-08-17T00:17:04.027220+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038864+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:17:04.038864+0000","last_peered":"2023-08-17T00:17:04.038864+0000","last_clean":"2023-08-17T00:17:04.038864+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:17:04.038864+0000","last_undegraded":"2023-08-17T00:17:04.038864+0000","last_fullsized":"2023-08-17T00:17:04.038864+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.049207+0000","last_change":"2023-08-17T00:17:04.040677+0000","last_active":"2023-08-17T00:17:04.049207+0000","last_peered":"2023-08-17T00:17:04.049207+0000","last_clean":"2023-08-17T00:17:04.049207+0000","last_became_active":"2023-08-17T00:17:04.040201+0000","last_became_peered":"2023-08-17T00:17:04.040201+0000","last_unstale":"2023-08-17T00:17:04.049207+0000","last_undegraded":"2023-08-17T00:17:04.049207+0000","last_fullsized":"2023-08-17T00:17:04.049207+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.040617+0000","last_change":"2023-08-17T00:17:03.607962+0000","last_active":"2023-08-17T00:17:04.040617+0000","last_peered":"2023-08-17T00:17:04.040617+0000","last_clean":"2023-08-17T00:17:04.040617+0000","last_became_active":"2023-08-17T00:17:03.607587+0000","last_became_peered":"2023-08-17T00:17:03.607587+0000","last_unstale":"2023-08-17T00:17:04.040617+0000","last_undegraded":"2023-08-17T00:17:04.040617+0000","last_fullsized":"2023-08-17T00:17:04.040617+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032641+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:17:04.032641+0000","last_peered":"2023-08-17T00:17:04.032641+0000","last_clean":"2023-08-17T00:17:04.032641+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:17:04.032641+0000","last_undegraded":"2023-08-17T00:17:04.032641+0000","last_fullsized":"2023-08-17T00:17:04.032641+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.052122+0000","last_change":"2023-08-17T00:17:04.046586+0000","last_active":"2023-08-17T00:17:04.052122+0000","last_peered":"2023-08-17T00:17:04.052122+0000","last_clean":"2023-08-17T00:17:04.052122+0000","last_became_active":"2023-08-17T00:17:04.046283+0000","last_became_peered":"2023-08-17T00:17:04.046283+0000","last_unstale":"2023-08-17T00:17:04.052122+0000","last_undegraded":"2023-08-17T00:17:04.052122+0000","last_fullsized":"2023-08-17T00:17:04.052122+0000","mapping_epoch":190,"log_start":"0'0","ondisk_log_start":"0'0","created":190,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:03.558637+0000","last_clean_scrub_stamp":"2023-08-17T00:17:03.558637+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":10,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.038996+0000","last_change":"2023-08-17T00:17:03.615539+0000","last_active":"2023-08-17T00:17:04.038996+0000","last_peered":"2023-08-17T00:17:04.038996+0000","last_clean":"2023-08-17T00:17:04.038996+0000","last_became_active":"2023-08-17T00:17:03.615065+0000","last_became_peered":"2023-08-17T00:17:03.615065+0000","last_unstale":"2023-08-17T00:17:04.038996+0000","last_undegraded":"2023-08-17T00:17:04.038996+0000","last_fullsized":"2023-08-17T00:17:04.038996+0000","mapping_epoch":189,"log_start":"0'0","ondisk_log_start":"0'0","created":189,"last_epoch_clean":190,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:17:02.543174+0000","last_clean_scrub_stamp":"2023-08-17T00:17:02.543174+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.032220+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:17:04.032220+0000","last_peered":"2023-08-17T00:17:04.032220+0000","last_clean":"2023-08-17T00:17:04.032220+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:17:04.032220+0000","last_undegraded":"2023-08-17T00:17:04.032220+0000","last_fullsized":"2023-08-17T00:17:04.032220+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":191,"state":"active+clean","last_fresh":"2023-08-17T00:17:04.033068+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:17:04.033068+0000","last_peered":"2023-08-17T00:17:04.033068+0000","last_clean":"2023-08-17T00:17:04.033068+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:17:04.033068+0000","last_undegraded":"2023-08-17T00:17:04.033068+0000","last_fullsized":"2023-08-17T00:17:04.033068+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542319,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299592,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072248,"statfs":{"total":96636764160,"available":96329981952,"internally_reserved":0,"allocated":2424832,"data_stored":1136966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.048,"15min":1.1279999999999999},"min":{"1min":0.81100000000000005,"5min":0.52900000000000003,"15min":0.51200000000000001},"max":{"1min":1.524,"5min":1.6539999999999999,"15min":8.7769999999999992},"last":0.71299999999999997},{"interface":"front","average":{"1min":1.149,"5min":1.036,"15min":1.1519999999999999},"min":{"1min":0.89300000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.5549999999999999,"5min":2.1379999999999999,"15min":9.6530000000000005},"last":0.94399999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.0920000000000001,"15min":1.1879999999999999},"min":{"1min":0.83899999999999997,"5min":0.627,"15min":0.48199999999999998},"max":{"1min":1.4750000000000001,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.125,"15min":1.1850000000000001},"min":{"1min":0.94499999999999995,"5min":0.59599999999999997,"15min":0.57199999999999995},"max":{"1min":1.427,"5min":3.7669999999999999,"15min":8.8399999999999999},"last":1.1220000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.0960000000000001,"5min":1.0389999999999999,"15min":1.1160000000000001},"min":{"1min":0.78500000000000003,"5min":0.65200000000000002,"15min":0.437},"max":{"1min":1.4510000000000001,"5min":1.478,"15min":7.0190000000000001},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.133,"15min":1.2390000000000001},"min":{"1min":0.88100000000000001,"5min":0.629,"15min":0.57899999999999996},"max":{"1min":1.617,"5min":1.8340000000000001,"15min":9.4239999999999995},"last":0.92100000000000004}]},{"osd":3,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1160000000000001,"15min":1.1759999999999999},"min":{"1min":0.879,"5min":0.57499999999999996,"15min":0.55900000000000005},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":7.7080000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.181,"15min":1.351},"min":{"1min":1.0009999999999999,"5min":0.69599999999999995,"15min":0.57599999999999996},"max":{"1min":1.5680000000000001,"5min":1.782,"15min":13.074999999999999},"last":1.2430000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.109,"15min":1.284},"min":{"1min":0.83399999999999996,"5min":0.62,"15min":0.62},"max":{"1min":1.7949999999999999,"5min":2.2370000000000001,"15min":13.784000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1240000000000001,"15min":1.266},"min":{"1min":0.82599999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4810000000000001,"5min":1.796,"15min":10.045999999999999},"last":1.1759999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.1879999999999999,"15min":1.393},"min":{"1min":0.90800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.657,"5min":2.0840000000000001,"15min":14.435},"last":1.425},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.3919999999999999},"min":{"1min":1.0760000000000001,"5min":0.68100000000000005,"15min":0.64500000000000002},"max":{"1min":1.5760000000000001,"5min":2.3239999999999998,"15min":12.617000000000001},"last":1.306}]},{"osd":6,"last update":"Thu Aug 17 00:16:09 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.2709999999999999,"15min":1.427},"min":{"1min":1.155,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6240000000000001,"5min":2.427,"15min":11.279999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.3640000000000001},"min":{"1min":0.85799999999999998,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.758,"5min":1.9299999999999999,"15min":11.365},"last":1.363}]}]},{"osd":6,"up_from":14,"seq":60129542319,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299588,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072252,"statfs":{"total":96636764160,"available":96329986048,"internally_reserved":0,"allocated":2420736,"data_stored":1137000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":0.97499999999999998,"15min":1.054},"min":{"1min":0.752,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.26,"5min":1.6819999999999999,"15min":8.0909999999999993},"last":6.2050000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.016,"15min":1.1100000000000001},"min":{"1min":0.66000000000000003,"5min":0.59299999999999997,"15min":0.502},"max":{"1min":1.4079999999999999,"5min":1.429,"15min":10.519},"last":4.468}]},{"osd":1,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.069,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.63300000000000001,"15min":0.443},"max":{"1min":1.458,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.046,"15min":1.0640000000000001},"min":{"1min":0.755,"5min":0.56000000000000005,"15min":0.47199999999999998},"max":{"1min":1.3979999999999999,"5min":2.2490000000000001,"15min":11.391999999999999},"last":2.0870000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.141,"15min":1.165},"min":{"1min":0.86899999999999999,"5min":0.65300000000000002,"15min":0.372},"max":{"1min":1.4139999999999999,"5min":1.6299999999999999,"15min":5.3799999999999999},"last":1.101},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2170000000000001,"15min":1.2809999999999999},"min":{"1min":1.1259999999999999,"5min":0.60999999999999999,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":1.708,"15min":10.669},"last":3.5409999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1779999999999999,"15min":1.1870000000000001},"min":{"1min":0.87,"5min":0.73899999999999999,"15min":0.48599999999999999},"max":{"1min":1.3580000000000001,"5min":3.4809999999999999,"15min":11.475},"last":3.0569999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2330000000000001,"15min":1.256},"min":{"1min":0.84099999999999997,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.4950000000000001,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":2.4670000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1539999999999999,"15min":1.2629999999999999},"min":{"1min":0.88400000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.534,"5min":1.992,"15min":10.632},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1479999999999999,"15min":1.2330000000000001},"min":{"1min":0.78900000000000003,"5min":0.68000000000000005,"15min":0.58099999999999996},"max":{"1min":1.5940000000000001,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.198,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.71399999999999997,"15min":0.40899999999999997},"max":{"1min":1.429,"5min":2.7320000000000002,"15min":5.2640000000000002},"last":6.1660000000000004},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3160000000000001,"15min":1.3779999999999999},"min":{"1min":1.0349999999999999,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.5649999999999999,"5min":2.2949999999999999,"15min":10.592000000000001},"last":8.4809999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:16:08 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.248,"15min":1.325},"min":{"1min":0.92200000000000004,"5min":0.67100000000000004,"15min":0.65100000000000002},"max":{"1min":1.4590000000000001,"5min":2.3519999999999999,"15min":11.51},"last":5.2199999999999998},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3100000000000001,"15min":1.3819999999999999},"min":{"1min":1.0549999999999999,"5min":0.81699999999999995,"15min":0.66900000000000004},"max":{"1min":1.53,"5min":2.532,"15min":5.4100000000000001},"last":3.7519999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542320,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2416640,"data_stored":1137394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.024,"15min":1.165},"min":{"1min":0.78300000000000003,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.4039999999999999,"5min":1.679,"15min":15.007999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.117,"15min":1.248},"min":{"1min":0.89200000000000002,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.5109999999999999,"5min":4.0629999999999997,"15min":16.838999999999999},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.117,"15min":1.1040000000000001},"min":{"1min":0.70599999999999996,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5169999999999999,"5min":1.746,"15min":4.2270000000000003},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.1040000000000001,"15min":1.2090000000000001},"min":{"1min":0.95299999999999996,"5min":0.624,"15min":0.58799999999999997},"max":{"1min":1.4370000000000001,"5min":4.1779999999999999,"15min":9.6579999999999995},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.159,"15min":1.3140000000000001},"min":{"1min":0.86799999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.48,"5min":4.2750000000000004,"15min":16.675000000000001},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.1739999999999999,"15min":1.266},"min":{"1min":0.91800000000000004,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.526,"5min":1.647,"15min":11.949},"last":1.181}]},{"osd":3,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2150000000000001,"15min":1.3109999999999999},"min":{"1min":1.008,"5min":0.70699999999999996,"15min":0.64100000000000001},"max":{"1min":1.536,"5min":4.3250000000000002,"15min":13.125},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2170000000000001,"15min":1.284},"min":{"1min":0.83099999999999996,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.569,"5min":2.306,"15min":8.4809999999999999},"last":1.1140000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1259999999999999,"15min":1.335},"min":{"1min":0.78400000000000003,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.405,"5min":1.7,"15min":17.510000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.256,"5min":1.2310000000000001,"15min":1.4390000000000001},"min":{"1min":0.93300000000000005,"5min":0.61499999999999999,"15min":0.54000000000000004},"max":{"1min":1.528,"5min":4.8170000000000002,"15min":19.591000000000001},"last":1.3100000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":1.234,"15min":1.431},"min":{"1min":1.024,"5min":0.79800000000000004,"15min":0.60099999999999998},"max":{"1min":1.6819999999999999,"5min":2.0790000000000002,"15min":17.158000000000001},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.302,"5min":1.1850000000000001,"15min":1.4219999999999999},"min":{"1min":0.90400000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.625,"5min":1.625,"15min":17.050000000000001},"last":1.143}]},{"osd":7,"last update":"Thu Aug 17 00:16:06 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.5329999999999999},"min":{"1min":1.1060000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.804,"5min":5.2130000000000001,"15min":18.158000000000001},"last":1.409},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.3520000000000001,"15min":1.5229999999999999},"min":{"1min":1.0940000000000001,"5min":0.79800000000000004,"15min":0.76600000000000001},"max":{"1min":1.774,"5min":2.0019999999999998,"15min":14.818},"last":1.272}]}]},{"osd":3,"up_from":14,"seq":60129542319,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2420736,"data_stored":1137484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83099999999999996,"15min":0.79700000000000004},"min":{"1min":0.496,"5min":0.47399999999999998,"15min":0.32000000000000001},"max":{"1min":1.3420000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.91600000000000004,"15min":0.86399999999999999},"min":{"1min":0.76600000000000001,"5min":0.55400000000000005,"15min":0.38100000000000001},"max":{"1min":1.246,"5min":2.6709999999999998,"15min":2.6709999999999998},"last":0.86599999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.84499999999999997,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.5389999999999999,"5min":3.274,"15min":11.215999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.873,"5min":0.89700000000000002,"15min":0.88100000000000001},"min":{"1min":0.55900000000000005,"5min":0.47499999999999998,"15min":0.35499999999999998},"max":{"1min":1.377,"5min":3.7810000000000001,"15min":3.7810000000000001},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.89000000000000001,"15min":0.89900000000000002},"min":{"1min":0.751,"5min":0.499,"15min":0.33800000000000002},"max":{"1min":1.3839999999999999,"5min":1.587,"15min":2.0270000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.085,"5min":1.04,"15min":1.03},"min":{"1min":0.73199999999999998,"5min":0.47999999999999998,"15min":0.433},"max":{"1min":1.357,"5min":1.4139999999999999,"15min":2.6360000000000001},"last":1.4590000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.1950000000000001,"15min":1.1930000000000001},"min":{"1min":1.0089999999999999,"5min":0.74199999999999999,"15min":0.58099999999999996},"max":{"1min":1.3480000000000001,"5min":1.6799999999999999,"15min":3.9449999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.2090000000000001,"15min":1.198},"min":{"1min":0.88500000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.631,"5min":1.631,"15min":3.9790000000000001},"last":1.409}]},{"osd":5,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.196,"15min":1.1899999999999999},"min":{"1min":1.127,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.706,"5min":1.9390000000000001,"15min":2.1309999999999998},"last":1.484},{"interface":"front","average":{"1min":1.286,"5min":1.254,"15min":1.244},"min":{"1min":0.86699999999999999,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.4710000000000001,"5min":1.6539999999999999,"15min":2.6789999999999998},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.218,"15min":1.2150000000000001},"min":{"1min":0.95499999999999996,"5min":0.629,"15min":0.58299999999999996},"max":{"1min":1.5620000000000001,"5min":1.702,"15min":3.4249999999999998},"last":1.375},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.222,"15min":1.1950000000000001},"min":{"1min":1.0069999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.4139999999999999,"5min":1.968,"15min":3.585},"last":1.0980000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:16:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2589999999999999,"15min":1.2290000000000001},"min":{"1min":0.99299999999999999,"5min":0.84199999999999997,"15min":0.52600000000000002},"max":{"1min":1.621,"5min":1.996,"15min":2.1930000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.226,"15min":1.208},"min":{"1min":0.92900000000000005,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.768,"5min":1.768,"15min":2.0419999999999998},"last":1.2949999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542319,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311880,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059960,"statfs":{"total":96636764160,"available":96317399040,"internally_reserved":0,"allocated":2424832,"data_stored":1138038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.501,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.454,"5min":1.855,"15min":3.1099999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.83799999999999997,"15min":0.85699999999999998},"min":{"1min":0.60599999999999998,"5min":0.435,"15min":0.28799999999999998},"max":{"1min":1.337,"5min":3.1059999999999999,"15min":6.4859999999999998},"last":0.80000000000000004}]},{"osd":1,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.878,"15min":0.86399999999999999},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.2430000000000001,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0209999999999999},"min":{"1min":0.64500000000000002,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.605,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1,"15min":1.0269999999999999},"min":{"1min":0.72499999999999998,"5min":0.628,"15min":0.42899999999999999},"max":{"1min":1.3979999999999999,"5min":1.6379999999999999,"15min":5.4059999999999997},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.93400000000000005,"15min":0.93999999999999995},"min":{"1min":0.64700000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.2969999999999999,"5min":2.4049999999999998,"15min":3.3410000000000002},"last":0.85799999999999998}]},{"osd":4,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.288,"15min":1.3580000000000001},"min":{"1min":0.86099999999999999,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.6910000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.3939999999999999,"15min":1.363},"min":{"1min":0.77500000000000002,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.496,"5min":17.988,"15min":17.988},"last":1.2909999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3220000000000001,"15min":1.417},"min":{"1min":0.93799999999999994,"5min":0.82899999999999996,"15min":0.58799999999999997},"max":{"1min":1.617,"5min":1.873,"15min":12.914},"last":1.234},{"interface":"front","average":{"1min":1.234,"5min":1.2230000000000001,"15min":1.306},"min":{"1min":1.0309999999999999,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.6719999999999999,"5min":1.772,"15min":9.5519999999999996},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.171,"15min":1.3300000000000001},"min":{"1min":0.82199999999999995,"5min":0.67000000000000004,"15min":0.58899999999999997},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.304,"15min":1.4079999999999999},"min":{"1min":0.89800000000000002,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.6399999999999999,"5min":1.9359999999999999,"15min":12.698},"last":1.123}]},{"osd":7,"last update":"Thu Aug 17 00:16:19 2023","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93999999999999995,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.5820000000000001,"5min":1.7609999999999999,"15min":10.592000000000001},"last":1.264},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.306,"15min":1.4139999999999999},"min":{"1min":0.91400000000000003,"5min":0.79200000000000004,"15min":0.54100000000000004},"max":{"1min":1.891,"5min":1.9159999999999999,"15min":11.417},"last":1.2549999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542319,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307776,"kb_used_data":2360,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064064,"statfs":{"total":96636764160,"available":96321601536,"internally_reserved":0,"allocated":2416640,"data_stored":1136862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.86599999999999999,"15min":0.84199999999999997},"min":{"1min":0.58399999999999996,"5min":0.53200000000000003,"15min":0.309},"max":{"1min":1.2869999999999999,"5min":1.298,"15min":6.4329999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":0.94799999999999995,"15min":0.92200000000000004},"min":{"1min":0.64500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.4670000000000001,"5min":1.6200000000000001,"15min":13.093},"last":0.86099999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.82499999999999996,"15min":0.80400000000000005},"min":{"1min":0.60799999999999998,"5min":0.504,"15min":0.314},"max":{"1min":1.109,"5min":1.3420000000000001,"15min":5.4989999999999997},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.91600000000000004,"15min":0.89700000000000002},"min":{"1min":0.747,"5min":0.54400000000000004,"15min":0.432},"max":{"1min":1.619,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0289999999999999,"15min":1.0149999999999999},"min":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.437},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.91500000000000004,"15min":0.94099999999999995},"min":{"1min":0.625,"5min":0.47399999999999998,"15min":0.39000000000000001},"max":{"1min":1.1919999999999999,"5min":1.359,"15min":12.981999999999999},"last":0.64800000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1100000000000001,"15min":1.1419999999999999},"min":{"1min":0.93899999999999995,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.5840000000000001,"5min":1.671,"15min":20.548999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2330000000000001,"15min":1.208},"min":{"1min":1.0029999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.746,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":0.92800000000000005}]},{"osd":5,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.27,"15min":1.2889999999999999},"min":{"1min":1.028,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.8879999999999999,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.228,"15min":1.232},"min":{"1min":0.97499999999999998,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.577,"5min":1.8009999999999999,"15min":5.4240000000000004},"last":1.3380000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2370000000000001,"15min":1.248},"min":{"1min":1.0449999999999999,"5min":0.68999999999999995,"15min":0.68899999999999995},"max":{"1min":1.8400000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.2070000000000001,"15min":1.2050000000000001},"min":{"1min":0.86699999999999999,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.49,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.302}]},{"osd":7,"last update":"Thu Aug 17 00:17:08 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.2949999999999999,"15min":1.2969999999999999},"min":{"1min":1.0940000000000001,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.8120000000000001,"5min":1.9179999999999999,"15min":6.9779999999999998},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.343,"5min":1.288,"15min":1.3140000000000001},"min":{"1min":1.1259999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":13.131},"last":1.127}]}]},{"osd":0,"up_from":14,"seq":60129542320,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311876,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059964,"statfs":{"total":96636764160,"available":96317403136,"internally_reserved":0,"allocated":2420736,"data_stored":1137766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.77200000000000002,"15min":0.82999999999999996},"min":{"1min":0.498,"5min":0.39100000000000001,"15min":0.30299999999999999},"max":{"1min":1.179,"5min":1.4830000000000001,"15min":18.442},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.81799999999999995,"15min":0.83899999999999997},"min":{"1min":0.623,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.2909999999999999,"5min":1.5669999999999999,"15min":7.9720000000000004},"last":1.127}]},{"osd":2,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.879,"15min":0.94299999999999995},"min":{"1min":0.66300000000000003,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.323,"5min":1.323,"15min":18.481999999999999},"last":1.254},{"interface":"front","average":{"1min":1.016,"5min":0.91700000000000004,"15min":0.92200000000000004},"min":{"1min":0.81799999999999995,"5min":0.432,"15min":0.39800000000000002},"max":{"1min":1.3859999999999999,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.419}]},{"osd":3,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.88800000000000001,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.4370000000000001,"5min":1.5840000000000001,"15min":1.613},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.117,"5min":1.0169999999999999,"15min":1.0580000000000001},"min":{"1min":0.82699999999999996,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.415,"5min":1.9079999999999999,"15min":18.577000000000002},"last":1.345}]},{"osd":4,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.105,"15min":1.0960000000000001},"min":{"1min":1.0249999999999999,"5min":0.60299999999999998,"15min":0.56399999999999995},"max":{"1min":1.4330000000000001,"5min":1.728,"15min":1.7609999999999999},"last":1.216},{"interface":"front","average":{"1min":1.27,"5min":1.1879999999999999,"15min":1.252},"min":{"1min":0.96499999999999997,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.792,"5min":1.792,"15min":18.515000000000001},"last":1.5609999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.234,"15min":1.29},"min":{"1min":1.087,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.643,"5min":1.9199999999999999,"15min":17.152999999999999},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":1.105,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.569,"5min":1.754,"15min":1.984},"last":1.397}]},{"osd":6,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.224,"15min":1.2949999999999999},"min":{"1min":1.079,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.681},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.1950000000000001,"15min":1.268},"min":{"1min":1.034,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5089999999999999,"5min":1.665,"15min":17.204000000000001},"last":2.0619999999999998}]},{"osd":7,"last update":"Thu Aug 17 00:16:17 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.23,"15min":1.294},"min":{"1min":1.095,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.7549999999999999,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.2110000000000001,"15min":1.206},"min":{"1min":0.90600000000000003,"5min":0.72799999999999998,"15min":0.60199999999999998},"max":{"1min":1.681,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.3109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575024,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307780,"kb_used_data":2364,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94064060,"statfs":{"total":96636764160,"available":96321597440,"internally_reserved":0,"allocated":2420736,"data_stored":1137822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.98599999999999999,"5min":0.997,"15min":1.0509999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.38300000000000001},"max":{"1min":1.4299999999999999,"5min":1.53,"15min":7.1379999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.0169999999999999,"15min":1.0469999999999999},"min":{"1min":0.77200000000000002,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.2030000000000001,"5min":2.5539999999999998,"15min":7.7380000000000004},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.161,"15min":1.2230000000000001},"min":{"1min":0.84299999999999997,"5min":0.49099999999999999,"15min":0.42499999999999999},"max":{"1min":1.665,"5min":1.665,"15min":8.3800000000000008},"last":1.355},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.1619999999999999,"15min":1.21},"min":{"1min":0.85599999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.6120000000000001,"5min":1.732,"15min":6.9000000000000004},"last":1.1990000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.087,"15min":1.2090000000000001},"min":{"1min":0.84499999999999997,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.3999999999999999,"5min":1.7030000000000001,"15min":18.431000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.103,"15min":1.3029999999999999},"min":{"1min":0.86799999999999999,"5min":0.78600000000000003,"15min":0.36699999999999999},"max":{"1min":1.53,"5min":1.623,"15min":36.531999999999996},"last":1.083}]},{"osd":3,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.1100000000000001,"15min":1.107},"min":{"1min":0.67700000000000005,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.5600000000000001,"5min":2.9889999999999999,"15min":2.9889999999999999},"last":1.032},{"interface":"front","average":{"1min":1.23,"5min":1.157,"15min":1.373},"min":{"1min":0.90700000000000003,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.875,"5min":1.875,"15min":36.530000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.22,"15min":1.2430000000000001},"min":{"1min":0.76900000000000002,"5min":0.57099999999999995,"15min":0.433},"max":{"1min":1.6919999999999999,"5min":1.7130000000000001,"15min":6.3250000000000002},"last":1.286},{"interface":"front","average":{"1min":1.248,"5min":1.2330000000000001,"15min":1.278},"min":{"1min":0.80700000000000005,"5min":0.73099999999999998,"15min":0.63500000000000001},"max":{"1min":1.6519999999999999,"5min":3.2519999999999998,"15min":9.4120000000000008},"last":1.222}]},{"osd":6,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.234,"15min":1.3080000000000001},"min":{"1min":0.82299999999999995,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.242},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3280000000000001,"15min":1.359},"min":{"1min":0.88900000000000001,"5min":0.81399999999999995,"15min":0.49399999999999999},"max":{"1min":1.7829999999999999,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.391}]},{"osd":7,"last update":"Thu Aug 17 00:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.232,"15min":1.24},"min":{"1min":0.85599999999999998,"5min":0.64800000000000002,"15min":0.56100000000000005},"max":{"1min":1.7,"5min":3.645,"15min":3.645},"last":1.135},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3300000000000001,"15min":1.3799999999999999},"min":{"1min":1.095,"5min":0.68600000000000005,"15min":0.629},"max":{"1min":1.758,"5min":1.879,"15min":8.327},"last":1.419}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:17:13.363 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-17T00:17:13.363 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-17T00:17:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 Processor -- start 2023-08-17T00:17:13.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 -- start start 2023-08-17T00:17:13.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53c0153ab0 0x7f53c0153e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53c00c59e0 0x7f53c00641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c00c0330 con 0x7f53c00c07c0 2023-08-17T00:17:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c00646e0 con 0x7f53c00c59e0 2023-08-17T00:17:13.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.567+0000 7f53c811b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c00c5e40 con 0x7f53c0153ab0 2023-08-17T00:17:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c56b6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f53c00c59e0 0x7f53c00641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53c0153ab0 0x7f53c0153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53c0153ab0 0x7f53c0153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:39682/0 (socket says 172.21.15.153:39682) 2023-08-17T00:17:13.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 -- 172.21.15.153:0/2453575996 learned_addr learned my addr 172.21.15.153:0/2453575996 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c66b8700 1 --1- 172.21.15.153:0/2453575996 >> v1:172.21.15.178:6789/0 conn(0x7f53c00c07c0 0x7f53c0061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:48934/0 (socket says 172.21.15.153:48934) 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 -- 172.21.15.153:0/2453575996 >> v2:172.21.15.153:3300/0 conn(0x7f53c00c59e0 msgr2=0x7f53c00641f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 --2- 172.21.15.153:0/2453575996 >> v2:172.21.15.153:3300/0 conn(0x7f53c00c59e0 0x7f53c00641f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 -- 172.21.15.153:0/2453575996 >> v1:172.21.15.178:6789/0 conn(0x7f53c00c07c0 legacy=0x7f53c0061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 -- 172.21.15.153:0/2453575996 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c00c60a0 con 0x7f53c0153ab0 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c56b6700 1 --2- 172.21.15.153:0/2453575996 >> v2:172.21.15.153:3300/0 conn(0x7f53c00c59e0 0x7f53c00641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:13.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c4eb5700 1 -- 172.21.15.153:0/2453575996 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039701111 0 0) 0x7f53c00c0330 con 0x7f53c00c07c0 2023-08-17T00:17:13.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c5eb7700 1 --2- 172.21.15.153:0/2453575996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c0153ab0 0x7f53c0153e90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f53c005eb60 tx=0x7f53bc0090f0).ready entity=mon.1 client_cookie=1ef67406109d3ecb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:13.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c4eb5700 1 -- 172.21.15.153:0/2453575996 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00b520 con 0x7f53c0153ab0 2023-08-17T00:17:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c4eb5700 1 -- 172.21.15.153:0/2453575996 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc00b680 con 0x7f53c0153ab0 2023-08-17T00:17:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c4eb5700 1 -- 172.21.15.153:0/2453575996 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00ba20 con 0x7f53c0153ab0 2023-08-17T00:17:13.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 -- 172.21.15.153:0/2453575996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c0153ab0 msgr2=0x7f53c0153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 --2- 172.21.15.153:0/2453575996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c0153ab0 0x7f53c0153e90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f53c005eb60 tx=0x7f53bc0090f0).stop 2023-08-17T00:17:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 -- 172.21.15.153:0/2453575996 shutdown_connections 2023-08-17T00:17:13.579 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 --2- 172.21.15.153:0/2453575996 >> v2:172.21.15.153:3300/0 conn(0x7f53c00c59e0 0x7f53c00641f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 --2- 172.21.15.153:0/2453575996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c0153ab0 0x7f53c0153e90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 -- 172.21.15.153:0/2453575996 >> 172.21.15.153:0/2453575996 conn(0x7f53c00caaa0 msgr2=0x7f53c00caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 -- 172.21.15.153:0/2453575996 shutdown_connections 2023-08-17T00:17:13.580 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.571+0000 7f53c811b700 1 -- 172.21.15.153:0/2453575996 wait complete. 2023-08-17T00:17:13.583 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 Processor -- start 2023-08-17T00:17:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 -- start start 2023-08-17T00:17:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53c00c07c0 0x7f53c00c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c00c59e0 0x7f53c014c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.584 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 0x7f53c0154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0164050 con 0x7f53c0153ab0 2023-08-17T00:17:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c00c1b40 con 0x7f53c00c59e0 2023-08-17T00:17:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.575+0000 7f53c811b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c0156490 con 0x7f53c00c07c0 2023-08-17T00:17:13.585 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 0x7f53c0154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 0x7f53c0154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47152/0 (socket says 172.21.15.153:47152) 2023-08-17T00:17:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 -- 172.21.15.153:0/1403379985 learned_addr learned my addr 172.21.15.153:0/1403379985 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c56b6700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c00c59e0 0x7f53c014c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.586 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c5eb7700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53c00c07c0 0x7f53c00c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 -- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53c00c07c0 msgr2=0x7f53c00c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53c00c07c0 0x7f53c00c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 -- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c00c59e0 msgr2=0x7f53c014c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.587 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c00c59e0 0x7f53c014c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 -- 172.21.15.153:0/1403379985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b00092a0 con 0x7f53c0153ab0 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c66b8700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 0x7f53c0154410 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f53b800c810 tx=0x7f53b8007f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8005c70 con 0x7f53c0153ab0 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b8005df0 con 0x7f53c0153ab0 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b8007360 con 0x7f53c0153ab0 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53bc009370 con 0x7f53c0153ab0 2023-08-17T00:17:13.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c0156ad0 con 0x7f53c0153ab0 2023-08-17T00:17:13.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.579+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c006b530 con 0x7f53c0153ab0 2023-08-17T00:17:13.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.583+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f53b8010030 con 0x7f53c0153ab0 2023-08-17T00:17:13.589 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.583+0000 7f53b5ffb700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53a405a150 0x7f53a405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:13.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.583+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f53b8073f40 con 0x7f53c0153ab0 2023-08-17T00:17:13.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.583+0000 7f53c5eb7700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53a405a150 0x7f53a405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:13.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.583+0000 7f53c5eb7700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53a405a150 0x7f53a405c610 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f53bc00b2e0 tx=0x7f53bc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:13.593 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.591+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f53b80478e0 con 0x7f53c0153ab0 2023-08-17T00:17:13.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.803+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f53c00bfa00 con 0x7f53c0153ab0 2023-08-17T00:17:13.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.811+0000 7f53b5ffb700 1 -- 172.21.15.153:0/1403379985 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f53b804af00 con 0x7f53c0153ab0 2023-08-17T00:17:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53a405a150 msgr2=0x7f53a405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53a405a150 0x7f53a405c610 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f53bc00b2e0 tx=0x7f53bc017000).stop 2023-08-17T00:17:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 msgr2=0x7f53c0154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:13.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 0x7f53c0154410 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 rx=0x7f53b800c810 tx=0x7f53b8007f10).stop 2023-08-17T00:17:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 shutdown_connections 2023-08-17T00:17:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f53a405a150 0x7f53a405c610 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f53c0153ab0 0x7f53c0154410 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53c00c59e0 0x7f53c014c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 --2- 172.21.15.153:0/1403379985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53c00c07c0 0x7f53c00c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 >> 172.21.15.153:0/1403379985 conn(0x7f53c00caaa0 msgr2=0x7f53c014d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 shutdown_connections 2023-08-17T00:17:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.815+0000 7f53c811b700 1 -- 172.21.15.153:0/1403379985 wait complete. 2023-08-17T00:17:13.820 INFO:teuthology.orchestra.run.smithi153.stderr:updated caps for client.0 2023-08-17T00:17:13.836 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:17:13.997 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 Processor -- start 2023-08-17T00:17:13.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 -- start start 2023-08-17T00:17:13.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b880a8df0 0x7f1b880c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b88068820 0x7f1b88068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b881585a0 con 0x7f1b88061fa0 2023-08-17T00:17:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b88066400 con 0x7f1b88068820 2023-08-17T00:17:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8de79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b88069170 con 0x7f1b880a8df0 2023-08-17T00:17:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8d678700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1b88061fa0 0x7f1b88062420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:45092/0 (socket says 172.21.15.153:45092) 2023-08-17T00:17:14.001 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8d678700 1 -- 172.21.15.153:0/2331892336 learned_addr learned my addr 172.21.15.153:0/2331892336 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b8ce77700 1 --2- 172.21.15.153:0/2331892336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b880a8df0 0x7f1b880c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.002 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b87fff700 1 --2- 172.21.15.153:0/2331892336 >> v2:172.21.15.178:3300/0 conn(0x7f1b88068820 0x7f1b88068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b877fe700 1 -- 172.21.15.153:0/2331892336 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1558230891 0 0) 0x7f1b881585a0 con 0x7f1b88061fa0 2023-08-17T00:17:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.995+0000 7f1b877fe700 1 -- 172.21.15.153:0/2331892336 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b780033f0 con 0x7f1b88061fa0 2023-08-17T00:17:14.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8ce77700 1 -- 172.21.15.153:0/2331892336 >> v2:172.21.15.178:3300/0 conn(0x7f1b88068820 msgr2=0x7f1b88068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8ce77700 1 --2- 172.21.15.153:0/2331892336 >> v2:172.21.15.178:3300/0 conn(0x7f1b88068820 0x7f1b88068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b877fe700 1 -- 172.21.15.153:0/2331892336 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 673751806 0 0) 0x7f1b780033f0 con 0x7f1b88061fa0 2023-08-17T00:17:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8ce77700 1 -- 172.21.15.153:0/2331892336 >> v1:172.21.15.153:6789/0 conn(0x7f1b88061fa0 legacy=0x7f1b88062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8ce77700 1 -- 172.21.15.153:0/2331892336 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b880b9d30 con 0x7f1b880a8df0 2023-08-17T00:17:14.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8ce77700 1 --2- 172.21.15.153:0/2331892336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b880a8df0 0x7f1b880c1490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1b7c006fd0 tx=0x7f1b7c006f40).ready entity=mon.2 client_cookie=7579fb44e0d8b1b1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b877fe700 1 -- 172.21.15.153:0/2331892336 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c005880 con 0x7f1b880a8df0 2023-08-17T00:17:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b877fe700 1 -- 172.21.15.153:0/2331892336 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0059e0 con 0x7f1b880a8df0 2023-08-17T00:17:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b877fe700 1 -- 172.21.15.153:0/2331892336 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c005d60 con 0x7f1b880a8df0 2023-08-17T00:17:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 -- 172.21.15.153:0/2331892336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b880a8df0 msgr2=0x7f1b880c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 --2- 172.21.15.153:0/2331892336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b880a8df0 0x7f1b880c1490 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f1b7c006fd0 tx=0x7f1b7c006f40).stop 2023-08-17T00:17:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 -- 172.21.15.153:0/2331892336 shutdown_connections 2023-08-17T00:17:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 --2- 172.21.15.153:0/2331892336 >> v2:172.21.15.178:3300/0 conn(0x7f1b88068820 0x7f1b88068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 --2- 172.21.15.153:0/2331892336 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b880a8df0 0x7f1b880c1490 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.008 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 -- 172.21.15.153:0/2331892336 >> 172.21.15.153:0/2331892336 conn(0x7f1b880c6620 msgr2=0x7f1b880c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 -- 172.21.15.153:0/2331892336 shutdown_connections 2023-08-17T00:17:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:13.999+0000 7f1b8de79700 1 -- 172.21.15.153:0/2331892336 wait complete. 2023-08-17T00:17:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 Processor -- start 2023-08-17T00:17:14.009 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 -- start start 2023-08-17T00:17:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 0x7f1b88155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b88068820 0x7f1b880bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b880a8df0 0x7f1b880bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b881586d0 con 0x7f1b88061fa0 2023-08-17T00:17:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880be950 con 0x7f1b880a8df0 2023-08-17T00:17:14.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8de79700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b880bec30 con 0x7f1b88068820 2023-08-17T00:17:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8ce77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 0x7f1b88155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8ce77700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 0x7f1b88155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47158/0 (socket says 172.21.15.153:47158) 2023-08-17T00:17:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8ce77700 1 -- 172.21.15.153:0/3437246681 learned_addr learned my addr 172.21.15.153:0/3437246681 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b87fff700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b88068820 0x7f1b880bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.003+0000 7f1b8d678700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b880a8df0 0x7f1b880bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8ce77700 1 -- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b88068820 msgr2=0x7f1b880bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8ce77700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b88068820 0x7f1b880bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8ce77700 1 -- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b880a8df0 msgr2=0x7f1b880bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8ce77700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b880a8df0 0x7f1b880bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8ce77700 1 -- 172.21.15.153:0/3437246681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009250 con 0x7f1b88061fa0 2023-08-17T00:17:14.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b87fff700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b88068820 0x7f1b880bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8ce77700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 0x7f1b88155c40 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7f1b880692b0 tx=0x7f1b7c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c006bd0 con 0x7f1b88061fa0 2023-08-17T00:17:14.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c00d6b0 con 0x7f1b88061fa0 2023-08-17T00:17:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00da70 con 0x7f1b88061fa0 2023-08-17T00:17:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b880bef10 con 0x7f1b88061fa0 2023-08-17T00:17:14.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88156130 con 0x7f1b88061fa0 2023-08-17T00:17:14.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.007+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8806b4c0 con 0x7f1b88061fa0 2023-08-17T00:17:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.011+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1b7c025030 con 0x7f1b88061fa0 2023-08-17T00:17:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.011+0000 7f1b84ff9700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b6c05a180 0x7f1b6c05c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.011+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f1b7c0754a0 con 0x7f1b88061fa0 2023-08-17T00:17:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.011+0000 7f1b87fff700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b6c05a180 0x7f1b6c05c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.011+0000 7f1b87fff700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b6c05a180 0x7f1b6c05c640 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f1b880c3cd0 tx=0x7f1b74009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.015+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1b7c048f50 con 0x7f1b88061fa0 2023-08-17T00:17:14.209 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b88064010 con 0x7f1b88061fa0 2023-08-17T00:17:14.210 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b84ff9700 1 -- 172.21.15.153:0/3437246681 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f1b7c023070 con 0x7f1b88061fa0 2023-08-17T00:17:14.210 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:14.211 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":146,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:07.040208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9649":{"gid":9649,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4264536439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4264536439},{"type":"v1","addr":"172.21.15.153:6835","nonce":4264536439}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:17:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b6c05a180 msgr2=0x7f1b6c05c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b6c05a180 0x7f1b6c05c640 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f1b880c3cd0 tx=0x7f1b74009060).stop 2023-08-17T00:17:14.213 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 msgr2=0x7f1b88155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 0x7f1b88155c40 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 rx=0x7f1b880692b0 tx=0x7f1b7c015000).stop 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 shutdown_connections 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1b6c05a180 0x7f1b6c05c640 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b880a8df0 0x7f1b880bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b88068820 0x7f1b880bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 --2- 172.21.15.153:0/3437246681 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1b88061fa0 0x7f1b88155c40 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.207+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 >> 172.21.15.153:0/3437246681 conn(0x7f1b880c6620 msgr2=0x7f1b88157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.214 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.211+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 shutdown_connections 2023-08-17T00:17:14.215 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.211+0000 7f1b8de79700 1 -- 172.21.15.153:0/3437246681 wait complete. 2023-08-17T00:17:14.215 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 146 2023-08-17T00:17:14.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 146, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:17:04.011993+0000', 'modified': '2023-08-17T00:17:07.040208+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9649}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9649': {'gid': 9649, 'name': 'c', 'rank': 0, 'incarnation': 142, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.153:6835/4264536439', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 4264536439}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 4264536439}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:17:14.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:17:14.640 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T00:17:14.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.803+0000 7facbe0ff700 1 Processor -- start 2023-08-17T00:17:14.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.803+0000 7facbe0ff700 1 -- start start 2023-08-17T00:17:14.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.803+0000 7facbe0ff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7facb8151b90 0x7facb8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.803+0000 7facbe0ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8063290 0x7facb8065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.803+0000 7facbe0ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb8061fa0 con 0x7facb8065b50 2023-08-17T00:17:14.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb80c3fb0 con 0x7facb8151b90 2023-08-17T00:17:14.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb8152460 con 0x7facb8063290 2023-08-17T00:17:14.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7facb8151b90 0x7facb8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7facb8151b90 0x7facb8151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47160/0 (socket says 172.21.15.153:47160) 2023-08-17T00:17:14.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 -- 172.21.15.153:0/4245226668 learned_addr learned my addr 172.21.15.153:0/4245226668 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facaeffd700 1 --2- 172.21.15.153:0/4245226668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8063290 0x7facb8065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 -- 172.21.15.153:0/4245226668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8063290 msgr2=0x7facb8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 --2- 172.21.15.153:0/4245226668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8063290 0x7facb8065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 -- 172.21.15.153:0/4245226668 >> v1:172.21.15.178:6789/0 conn(0x7facb8065b50 legacy=0x7facb8064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 -- 172.21.15.153:0/4245226668 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80621f0 con 0x7facb8151b90 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb77fe700 1 --2- 172.21.15.153:0/4245226668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb8151f70 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7faca8006fd0 tx=0x7faca80090f0).ready entity=mon.0 client_cookie=be3287a0d60567d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb6ffd700 1 -- 172.21.15.153:0/4245226668 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800b600 con 0x7facb8151b90 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb6ffd700 1 -- 172.21.15.153:0/4245226668 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca800b760 con 0x7facb8151b90 2023-08-17T00:17:14.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facb6ffd700 1 -- 172.21.15.153:0/4245226668 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca800bb00 con 0x7facb8151b90 2023-08-17T00:17:14.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- 172.21.15.153:0/4245226668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 msgr2=0x7facb8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4245226668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb8151f70 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 rx=0x7faca8006fd0 tx=0x7faca80090f0).stop 2023-08-17T00:17:14.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- 172.21.15.153:0/4245226668 shutdown_connections 2023-08-17T00:17:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4245226668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8063290 0x7facb8065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4245226668 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb8151f70 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- 172.21.15.153:0/4245226668 >> 172.21.15.153:0/4245226668 conn(0x7facb80c7150 msgr2=0x7facb80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- 172.21.15.153:0/4245226668 shutdown_connections 2023-08-17T00:17:14.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.807+0000 7facbe0ff700 1 -- 172.21.15.153:0/4245226668 wait complete. 2023-08-17T00:17:14.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.811+0000 7facbe0ff700 1 Processor -- start 2023-08-17T00:17:14.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.811+0000 7facbe0ff700 1 -- start start 2023-08-17T00:17:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facb8063290 0x7facb813dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8065b50 0x7facb80bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb80bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c0970 con 0x7facb8151b90 2023-08-17T00:17:14.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81534d0 con 0x7facb8063290 2023-08-17T00:17:14.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80c00d0 con 0x7facb8065b50 2023-08-17T00:17:14.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb80bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb80bfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47164/0 (socket says 172.21.15.153:47164) 2023-08-17T00:17:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 -- 172.21.15.153:0/4146807075 learned_addr learned my addr 172.21.15.153:0/4146807075 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb77fe700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facb8063290 0x7facb813dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facaeffd700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8065b50 0x7facb80bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 -- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8065b50 msgr2=0x7facb80bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8065b50 0x7facb80bf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 -- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facb8063290 msgr2=0x7facb813dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facb8063290 0x7facb813dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 -- 172.21.15.153:0/4146807075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8009370 con 0x7facb8151b90 2023-08-17T00:17:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facb7fff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb80bfae0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7facb0002230 tx=0x7facb00015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facaffff700 1 -- 172.21.15.153:0/4146807075 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000e4a0 con 0x7facb8151b90 2023-08-17T00:17:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facaffff700 1 -- 172.21.15.153:0/4146807075 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb000e600 con 0x7facb8151b90 2023-08-17T00:17:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb80c03b0 con 0x7facb8151b90 2023-08-17T00:17:14.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facaffff700 1 -- 172.21.15.153:0/4146807075 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000e980 con 0x7facb8151b90 2023-08-17T00:17:14.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.815+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb813e0e0 con 0x7facb8151b90 2023-08-17T00:17:14.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.823+0000 7facaffff700 1 -- 172.21.15.153:0/4146807075 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7facb0019030 con 0x7facb8151b90 2023-08-17T00:17:14.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.823+0000 7facaffff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fac9805a150 0x7fac9805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.823+0000 7facaffff700 1 -- 172.21.15.153:0/4146807075 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facb00736d0 con 0x7facb8151b90 2023-08-17T00:17:14.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.823+0000 7facc84a0740 1 Processor -- start 2023-08-17T00:17:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.823+0000 7facb77fe700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fac9805a150 0x7fac9805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.823+0000 7facc84a0740 1 -- start start 2023-08-17T00:17:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb77fe700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fac9805a150 0x7fac9805c610 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7faca800b3c0 tx=0x7faca8017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22e2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a17f0 0x22e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x229e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x220c5c0 con 0x22e52f0 2023-08-17T00:17:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2221e90 con 0x22a17f0 2023-08-17T00:17:14.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x21e8220 con 0x22e2a10 2023-08-17T00:17:14.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x229e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x229e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47172/0 (socket says 172.21.15.153:47172) 2023-08-17T00:17:14.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 -- 172.21.15.153:0/2927456791 learned_addr learned my addr 172.21.15.153:0/2927456791 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb77fe700 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22e2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facaeffd700 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a17f0 0x22e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 -- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 msgr2=0x22e2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22e2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 -- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a17f0 msgr2=0x22e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a17f0 0x22e4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 -- 172.21.15.153:0/2927456791 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x222d500 con 0x22e52f0 2023-08-17T00:17:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facb7fff700 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x229e350 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7facb004a740 tx=0x7facb000f000).ready entity=mon.0 client_cookie=f7b21e2a3ef047ff server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facacff9700 1 -- 172.21.15.153:0/2927456791 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0049180 con 0x22e52f0 2023-08-17T00:17:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facacff9700 1 -- 172.21.15.153:0/2927456791 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb000ed70 con 0x22e52f0 2023-08-17T00:17:14.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facacff9700 1 -- 172.21.15.153:0/2927456791 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00502c0 con 0x22e52f0 2023-08-17T00:17:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 -- 172.21.15.153:0/2927456791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 msgr2=0x229e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x229e350 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 rx=0x7facb004a740 tx=0x7facb000f000).stop 2023-08-17T00:17:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 -- 172.21.15.153:0/2927456791 shutdown_connections 2023-08-17T00:17:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x229e350 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22a17f0 0x22e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 --2- 172.21.15.153:0/2927456791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22e2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.827+0000 7facc84a0740 1 -- 172.21.15.153:0/2927456791 >> 172.21.15.153:0/2927456791 conn(0x2080550 msgr2=0x22a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 -- 172.21.15.153:0/2927456791 shutdown_connections 2023-08-17T00:17:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 -- 172.21.15.153:0/2927456791 wait complete. 2023-08-17T00:17:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 -- start start 2023-08-17T00:17:14.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 Processor -- start 2023-08-17T00:17:14.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a17f0 0x22c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x22e5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x21ed110 con 0x22e52f0 2023-08-17T00:17:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e8250 con 0x22e2a10 2023-08-17T00:17:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22e61d0 con 0x22a17f0 2023-08-17T00:17:14.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facc84a0740 10 client.0 ll_register_callbacks cb 0x22593c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x22e5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x22e5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47180/0 (socket says 172.21.15.153:47180) 2023-08-17T00:17:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facb7fff700 1 -- 172.21.15.153:0/1840160877 learned_addr learned my addr 172.21.15.153:0/1840160877 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facaeffd700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.831+0000 7facb77fe700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a17f0 0x22c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb7fff700 1 -- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a17f0 msgr2=0x22c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb7fff700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a17f0 0x22c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb7fff700 1 -- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 msgr2=0x22e57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb7fff700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22e57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb7fff700 1 -- 172.21.15.153:0/1840160877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb813e0e0 con 0x22e52f0 2023-08-17T00:17:14.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facaeffd700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:14.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb7fff700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x22e5ce0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7facb004a740 tx=0x7facb004d000).ready entity=mon.0 client_cookie=dc38afcbaa5ba75a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:14.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 1 -- 172.21.15.153:0/1840160877 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0056070 con 0x22e52f0 2023-08-17T00:17:14.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2217c60 con 0x22e52f0 2023-08-17T00:17:14.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 1 -- 172.21.15.153:0/1840160877 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facb0046bd0 con 0x22e52f0 2023-08-17T00:17:14.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 1 -- 172.21.15.153:0/1840160877 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb0049250 con 0x22e52f0 2023-08-17T00:17:14.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 10 client.10320 fetch_fsmap learned FSMap version 146 2023-08-17T00:17:14.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) v3 -- 0x221af80 con 0x22e52f0 2023-08-17T00:17:14.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 1 -- 172.21.15.153:0/1840160877 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2217c60 con 0x22e52f0 2023-08-17T00:17:14.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 1 -- 172.21.15.153:0/1840160877 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 146) v1 ==== 3100+0+0 (secure 0 0 0) 0x7facb0049d40 con 0x22e52f0 2023-08-17T00:17:14.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 10 client.10320 fetch_fsmap finished waiting for FSMap version 146 2023-08-17T00:17:14.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 10 client.10320 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:17:14.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 20 client.10320 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:14.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x22e7b90 0x23012b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 4 client.10320 mds_command: new command op to 9649 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 --> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x220e1b0 con 0x22e7b90 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb77fe700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x22e7b90 0x23012b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7facb77fe700 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x22e7b90 0x23012b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=3ef3187897cbc1d9 server_cookie=f2c9e3a3fddc8495 in_seq=0 out_seq=0 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.835+0000 7fac95ffb700 10 client.10320 ms_handle_connect on v2:172.21.15.153:6833/4264536439 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7fac95ffb700 1 -- 172.21.15.153:0/1840160877 <== mds.0 v2:172.21.15.153:6833/4264536439 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x220e1b0 con 0x22e7b90 2023-08-17T00:17:14.847 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7fac95ffb700 10 client.10320 handle_command_reply: tid=0 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 client.10320 shutdown 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 msgr2=0x22e5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x22e5ce0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 rx=0x7facb004a740 tx=0x7facb004d000).stop 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 shutdown_connections 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e52f0 0x22e5ce0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x22e7b90 0x23012b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22e57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.848 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7fac95ffb700 0 client.10320 ms_handle_reset on v2:172.21.15.153:6833/4264536439 2023-08-17T00:17:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 --2- 172.21.15.153:0/1840160877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22a17f0 0x22c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 >> 172.21.15.153:0/1840160877 conn(0x2080550 msgr2=0x22a0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 shutdown_connections 2023-08-17T00:17:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 1 -- 172.21.15.153:0/1840160877 wait complete. 2023-08-17T00:17:14.849 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.839+0000 7facc84a0740 20 client.10320 trim_cache size 0 max 16384 2023-08-17T00:17:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.855+0000 7facc84a0740 1 Processor -- start 2023-08-17T00:17:14.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.855+0000 7facc84a0740 1 -- start start 2023-08-17T00:17:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.855+0000 7facc84a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 0x22df2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.855+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22df7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.855+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e52f0 0x22e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22cd950 con 0x22a17f0 2023-08-17T00:17:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x22e5150 con 0x22e2a10 2023-08-17T00:17:14.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x220e1b0 con 0x22e52f0 2023-08-17T00:17:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 0x22df2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 0x22df2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47182/0 (socket says 172.21.15.153:47182) 2023-08-17T00:17:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 -- 172.21.15.153:0/1670324373 learned_addr learned my addr 172.21.15.153:0/1670324373 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facaeffd700 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22df7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 -- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e52f0 msgr2=0x22e56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e52f0 0x22e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 -- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 msgr2=0x22df7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22df7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 -- 172.21.15.153:0/1670324373 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8068af0 con 0x22a17f0 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facaeffd700 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facb77fe700 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 0x22df2e0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7faca8009f50 tx=0x7faca802e280).ready entity=mon.0 client_cookie=4cec8b4fc7ab48fb server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facad7fa700 1 -- 172.21.15.153:0/1670324373 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca801ea20 con 0x22a17f0 2023-08-17T00:17:14.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facad7fa700 1 -- 172.21.15.153:0/1670324373 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca801eb80 con 0x22a17f0 2023-08-17T00:17:14.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facad7fa700 1 -- 172.21.15.153:0/1670324373 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca801ecf0 con 0x22a17f0 2023-08-17T00:17:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- 172.21.15.153:0/1670324373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 msgr2=0x22df2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 0x22df2e0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 rx=0x7faca8009f50 tx=0x7faca802e280).stop 2023-08-17T00:17:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- 172.21.15.153:0/1670324373 shutdown_connections 2023-08-17T00:17:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e52f0 0x22e56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e2a10 0x22df7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 --2- 172.21.15.153:0/1670324373 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22a17f0 0x22df2e0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- 172.21.15.153:0/1670324373 >> 172.21.15.153:0/1670324373 conn(0x2080550 msgr2=0x22de810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- 172.21.15.153:0/1670324373 shutdown_connections 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- 172.21.15.153:0/1670324373 wait complete. 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 -- start start 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.859+0000 7facc84a0740 1 Processor -- start 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22a1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e52f0 0x2348b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 0x22f5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x22df8d0 con 0x22e30c0 2023-08-17T00:17:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2352080 con 0x22e52f0 2023-08-17T00:17:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x22c9510 con 0x22e2a10 2023-08-17T00:17:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 10 client.0 ll_register_callbacks cb 0x7facb000cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:14.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 0x22f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 0x22f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:47198/0 (socket says 172.21.15.153:47198) 2023-08-17T00:17:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 -- 172.21.15.153:0/2738635515 learned_addr learned my addr 172.21.15.153:0/2738635515 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:14.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facaeffd700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e52f0 0x2348b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb77fe700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22a1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 -- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 msgr2=0x22a1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22a1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 -- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e52f0 msgr2=0x2348b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e52f0 0x2348b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 -- 172.21.15.153:0/2738635515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb80621f0 con 0x22e30c0 2023-08-17T00:17:14.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb77fe700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facaeffd700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e52f0 0x2348b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb7fff700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 0x22f5380 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7facb0047800 tx=0x7facb0056000).ready entity=mon.0 client_cookie=8fe1ef16b4a9ff22 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7fac95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7fac95ffb700 1 -- 172.21.15.153:0/2738635515 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0068070 con 0x22e30c0 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7fac95ffb700 1 -- 172.21.15.153:0/2738635515 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7facb0046bd0 con 0x22e30c0 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facb000ed70 con 0x22e30c0 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7fac95ffb700 1 -- 172.21.15.153:0/2738635515 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=146) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb0048fa0 con 0x22e30c0 2023-08-17T00:17:14.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 10 client.10326 fetch_fsmap learned FSMap version 146 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=146,monmap=2+}) v3 -- 0x2216420 con 0x22e30c0 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7fac95ffb700 1 -- 172.21.15.153:0/2738635515 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb000ed70 con 0x22e30c0 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7fac95ffb700 1 -- 172.21.15.153:0/2738635515 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 146) v1 ==== 3100+0+0 (secure 0 0 0) 0x7facb0049d40 con 0x22e30c0 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 10 client.10326 fetch_fsmap finished waiting for FSMap version 146 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 10 client.10326 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 20 client.10326 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:14.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x229ff90 0x22a0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 4 client.10326 mds_command: new command op to 9649 tid=0[{"prefix": "status"}] 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 --> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] -- command(tid 0: {"prefix": "status"}) v1 -- 0x20d74e0 con 0x229ff90 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.863+0000 7facb77fe700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x229ff90 0x22a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facb77fe700 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x229ff90 0x22a0370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=837f249e127fc219 server_cookie=77b62be8d322af64 in_seq=0 out_seq=0 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7fac95ffb700 10 client.10326 ms_handle_connect on v2:172.21.15.153:6833/4264536439 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7fac95ffb700 1 -- 172.21.15.153:0/2738635515 <== mds.0 v2:172.21.15.153:6833/4264536439 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x20d74e0 con 0x229ff90 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7fac95ffb700 10 client.10326 handle_command_reply: tid=0 2023-08-17T00:17:14.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 client.10326 shutdown 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 msgr2=0x22f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 0x22f5380 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 rx=0x7facb0047800 tx=0x7facb0056000).stop 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 shutdown_connections 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x22e30c0 0x22f5380 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.153:6833/4264536439,v1:172.21.15.153:6835/4264536439] conn(0x229ff90 0x22a0370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x22e52f0 0x2348b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 --2- 172.21.15.153:0/2738635515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x22e2a10 0x22a1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7fac95ffb700 0 client.10326 ms_handle_reset on v2:172.21.15.153:6833/4264536439 2023-08-17T00:17:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 >> 172.21.15.153:0/2738635515 conn(0x2080550 msgr2=0x22e1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 shutdown_connections 2023-08-17T00:17:14.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 1 -- 172.21.15.153:0/2738635515 wait complete. 2023-08-17T00:17:14.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facc84a0740 20 client.10326 trim_cache size 0 max 16384 2023-08-17T00:17:14.877 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:17:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:17:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 9649, 2023-08-17T00:17:14.877 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 10.848172182000001, 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 146, 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 192, 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 192, 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 16.263353276 2023-08-17T00:17:14.878 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fac9805a150 msgr2=0x7fac9805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fac9805a150 0x7fac9805c610 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7faca800b3c0 tx=0x7faca8017000).stop 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 msgr2=0x7facb80bfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb80bfae0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 rx=0x7facb0002230 tx=0x7facb00015e0).stop 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 shutdown_connections 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fac9805a150 0x7fac9805c610 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7facb8151b90 0x7facb80bfae0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7facb8065b50 0x7facb80bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 --2- 172.21.15.153:0/4146807075 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7facb8063290 0x7facb813dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:14.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 >> 172.21.15.153:0/4146807075 conn(0x7facb80c7150 msgr2=0x7facb8151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:14.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 shutdown_connections 2023-08-17T00:17:14.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:14.867+0000 7facbe0ff700 1 -- 172.21.15.153:0/4146807075 wait complete. 2023-08-17T00:17:14.892 DEBUG:teuthology.orchestra.run.smithi153:> ceph fs ls 2023-08-17T00:17:15.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.019+0000 7fd8d759e700 1 Processor -- start 2023-08-17T00:17:15.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.019+0000 7fd8d759e700 1 -- start start 2023-08-17T00:17:15.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.023+0000 7fd8d759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd8d8061f00 0x7fd8d8062360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:15.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.023+0000 7fd8d759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d80a3d70 0x7fd8d80a4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:15.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.023+0000 7fd8d759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80a38e0 con 0x7fd8d8153ac0 2023-08-17T00:17:15.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.023+0000 7fd8d759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d8062850 con 0x7fd8d8061f00 2023-08-17T00:17:15.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.023+0000 7fd8d759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80c4fb0 con 0x7fd8d80a3d70 2023-08-17T00:17:15.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.023+0000 7fd8d659c700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fd8d8153ac0 0x7fd8d80bb600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60536/0 (socket says 172.21.15.153:60536) 2023-08-17T00:17:15.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d659c700 1 -- 172.21.15.153:0/2923012 learned_addr learned my addr 172.21.15.153:0/2923012 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:15.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d5d9b700 1 --2- 172.21.15.153:0/2923012 >> v2:172.21.15.178:3300/0 conn(0x7fd8d8061f00 0x7fd8d8062360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:15.030 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d6d9d700 1 --2- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d80a3d70 0x7fd8d80a4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:15.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d559a700 1 -- 172.21.15.153:0/2923012 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992887506 0 0) 0x7fd8d80a38e0 con 0x7fd8d8153ac0 2023-08-17T00:17:15.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d5d9b700 1 -- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d80a3d70 msgr2=0x7fd8d80a4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:15.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d5d9b700 1 --2- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d80a3d70 0x7fd8d80a4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d5d9b700 1 -- 172.21.15.153:0/2923012 >> v1:172.21.15.153:6789/0 conn(0x7fd8d8153ac0 legacy=0x7fd8d80bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:15.031 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d5d9b700 1 -- 172.21.15.153:0/2923012 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80c5290 con 0x7fd8d8061f00 2023-08-17T00:17:15.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d5d9b700 1 --2- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d8061f00 0x7fd8d8062360 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fd8cc009760 tx=0x7fd8cc009060).ready entity=mon.1 client_cookie=6a9f425750fd67c2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:15.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d559a700 1 -- 172.21.15.153:0/2923012 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00f510 con 0x7fd8d8061f00 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d559a700 1 -- 172.21.15.153:0/2923012 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc00f670 con 0x7fd8d8061f00 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d559a700 1 -- 172.21.15.153:0/2923012 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc00f9f0 con 0x7fd8d8061f00 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 -- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d8061f00 msgr2=0x7fd8d8062360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 --2- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d8061f00 0x7fd8d8062360 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7fd8cc009760 tx=0x7fd8cc009060).stop 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 -- 172.21.15.153:0/2923012 shutdown_connections 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 --2- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d80a3d70 0x7fd8d80a4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 --2- 172.21.15.153:0/2923012 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d8061f00 0x7fd8d8062360 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 -- 172.21.15.153:0/2923012 >> 172.21.15.153:0/2923012 conn(0x7fd8d805dca0 msgr2=0x7fd8d805e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:15.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 -- 172.21.15.153:0/2923012 shutdown_connections 2023-08-17T00:17:15.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.027+0000 7fd8d759e700 1 -- 172.21.15.153:0/2923012 wait complete. 2023-08-17T00:17:15.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.031+0000 7fd8d759e700 1 Processor -- start 2023-08-17T00:17:15.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.031+0000 7fd8d759e700 1 -- start start 2023-08-17T00:17:15.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.031+0000 7fd8d759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d8061f00 0x7fd8d813fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:15.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.031+0000 7fd8d759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d80a3d70 0x7fd8d80a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:15.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 0x7fd8d80bb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:15.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80a92f0 con 0x7fd8d8153ac0 2023-08-17T00:17:15.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80a8530 con 0x7fd8d80a3d70 2023-08-17T00:17:15.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80a8810 con 0x7fd8d8061f00 2023-08-17T00:17:15.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 0x7fd8d80bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:15.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d6d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 0x7fd8d80bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42780/0 (socket says 172.21.15.153:42780) 2023-08-17T00:17:15.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d6d9d700 1 -- 172.21.15.153:0/1815837961 learned_addr learned my addr 172.21.15.153:0/1815837961 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:15.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d8061f00 0x7fd8d813fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:15.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d5d9b700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d80a3d70 0x7fd8d80a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:15.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 -- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d80a3d70 msgr2=0x7fd8d80a64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:15.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d80a3d70 0x7fd8d80a64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 -- 172.21.15.153:0/1815837961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 msgr2=0x7fd8d80bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:15.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 0x7fd8d80bb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 -- 172.21.15.153:0/1815837961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc0092a0 con 0x7fd8d8061f00 2023-08-17T00:17:15.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d6d9d700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 0x7fd8d80bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:15.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d659c700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d8061f00 0x7fd8d813fd70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd8c800c490 tx=0x7fd8c8007dd0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:15.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80070d0 con 0x7fd8d8061f00 2023-08-17T00:17:15.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8007230 con 0x7fd8d8061f00 2023-08-17T00:17:15.041 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d80a8af0 con 0x7fd8d8061f00 2023-08-17T00:17:15.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80075b0 con 0x7fd8d8061f00 2023-08-17T00:17:15.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.035+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d8140260 con 0x7fd8d8061f00 2023-08-17T00:17:15.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.039+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d805ec30 con 0x7fd8d8061f00 2023-08-17T00:17:15.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.039+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd8c8010070 con 0x7fd8d8061f00 2023-08-17T00:17:15.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.039+0000 7fd8c67fc700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd8b805a150 0x7fd8b805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.039+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7fd8c8073600 con 0x7fd8d8061f00 2023-08-17T00:17:15.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.039+0000 7fd8d5d9b700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd8b805a150 0x7fd8b805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:15.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.043+0000 7fd8d5d9b700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd8b805a150 0x7fd8b805c610 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fd8d80bc6a0 tx=0x7fd8cc017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:15.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.047+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd8c80470b0 con 0x7fd8d8061f00 2023-08-17T00:17:15.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.243+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd8d80c5570 con 0x7fd8d8061f00 2023-08-17T00:17:15.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.247+0000 7fd8c67fc700 1 -- 172.21.15.153:0/1815837961 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v146) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd8c804a6d0 con 0x7fd8d8061f00 2023-08-17T00:17:15.250 INFO:teuthology.orchestra.run.smithi153.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-17T00:17:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.247+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd8b805a150 msgr2=0x7fd8b805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:15.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.247+0000 7fd8d759e700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd8b805a150 0x7fd8b805c610 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 rx=0x7fd8d80bc6a0 tx=0x7fd8cc017000).stop 2023-08-17T00:17:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.247+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d8061f00 msgr2=0x7fd8d813fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.247+0000 7fd8d759e700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d8061f00 0x7fd8d813fd70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fd8c800c490 tx=0x7fd8c8007dd0).stop 2023-08-17T00:17:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.247+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 shutdown_connections 2023-08-17T00:17:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd8b805a150 0x7fd8b805c610 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd8d8153ac0 0x7fd8d80bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd8d80a3d70 0x7fd8d80a64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 --2- 172.21.15.153:0/1815837961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd8d8061f00 0x7fd8d813fd70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 >> 172.21.15.153:0/1815837961 conn(0x7fd8d805dca0 msgr2=0x7fd8d80c29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 shutdown_connections 2023-08-17T00:17:15.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:15.251+0000 7fd8d759e700 1 -- 172.21.15.153:0/1815837961 wait complete. 2023-08-17T00:17:15.270 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-17T00:17:15.271 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-17T00:17:15.271 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi153.front.sepia.ceph.com 2023-08-17T00:17:15.271 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-17T00:17:15.272 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-17T00:17:15.272 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-17T00:17:15.272 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-08-17T00:17:15.273 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-17T00:17:15.273 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:17:15.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.274 DEBUG:teuthology.orchestra.run.smithi153:> ip addr 2023-08-17T00:17:15.289 INFO:teuthology.orchestra.run.smithi153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-17T00:17:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-17T00:17:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: inet 127.0.0.1/8 scope host lo 2023-08-17T00:17:15.289 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 ::1/128 scope host 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b2 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f0 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:17:15.290 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:da:6a:b3 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: altname enp7s0f1 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:ea brd ff:ff:ff:ff:ff:ff 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 0c:c4:7a:88:6d:eb brd ff:ff:ff:ff:ff:ff 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.21.15.153/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-08-17T00:17:15.291 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft 41578sec preferred_lft 41578sec 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::ec4:7aff:fe88:6deb/64 scope link 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether 02:42:94:d8:61:e7 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.292 INFO:teuthology.orchestra.run.smithi153.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::dc5a:6dff:fe17:e1fb/64 scope link 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether d6:e8:e3:d7:b0:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:17:15.293 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::d4e8:e3ff:fed7:b026/64 scope link 2023-08-17T00:17:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.294 INFO:teuthology.orchestra.run.smithi153.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-17T00:17:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: link/ether ea:42:3f:81:74:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:17:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: inet6 fe80::e842:3fff:fe81:7470/64 scope link 2023-08-17T00:17:15.294 INFO:teuthology.orchestra.run.smithi153.stdout: valid_lft forever preferred_lft forever 2023-08-17T00:17:15.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.296 DEBUG:teuthology.orchestra.run.smithi153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-17T00:17:15.375 INFO:teuthology.orchestra.run.smithi153.stdout:1 2023-08-17T00:17:15.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.378 DEBUG:teuthology.orchestra.run.smithi153:> route 2023-08-17T00:17:15.445 INFO:teuthology.orchestra.run.smithi153.stdout:Kernel IP routing table 2023-08-17T00:17:15.445 INFO:teuthology.orchestra.run.smithi153.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-17T00:17:15.445 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-08-17T00:17:15.446 INFO:teuthology.orchestra.run.smithi153.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-17T00:17:15.446 INFO:teuthology.orchestra.run.smithi153.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-08-17T00:17:15.446 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-08-17T00:17:15.446 INFO:teuthology.orchestra.run.smithi153.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-08-17T00:17:15.446 INFO:teuthology.orchestra.run.smithi153.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-17T00:17:15.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.447 DEBUG:teuthology.orchestra.run.smithi153:> (cd / && exec bash -c ' 2023-08-17T00:17:15.448 DEBUG:teuthology.orchestra.run.smithi153:> set -e 2023-08-17T00:17:15.448 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-17T00:17:15.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-17T00:17:15.449 DEBUG:teuthology.orchestra.run.smithi153:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-17T00:17:15.449 DEBUG:teuthology.orchestra.run.smithi153:> ') 2023-08-17T00:17:15.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.587 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:17:15.601 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:17:15.602 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:17:15.603 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-17T00:17:15.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.603 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link set brx.0 up 2023-08-17T00:17:15.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.683 DEBUG:teuthology.orchestra.run.smithi153:> mkdir -p /home/ubuntu/cephtest/mnt.0 2023-08-17T00:17:15.747 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-08-17T00:17:15.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:17:15.863 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:17:15.864 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:17:15.886 INFO:teuthology.orchestra.run.smithi153.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,mds_namespace=cephfs,norbytes 2023-08-17T00:17:15.887 INFO:teuthology.orchestra.run.smithi153.stdout:mount.ceph: options "norequire_active_mds,name=0,mds_namespace=cephfs,norbytes" will pass to kernel. 2023-08-17T00:17:15.892 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-17T00:17:15.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:15.893 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-17T00:17:15.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:17:15.926 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2023-08-17T00:17:16.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:17:16.003 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2023-08-17T00:17:16.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:17:16.075 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2023-08-17T00:17:16.228 INFO:teuthology.orchestra.run.smithi153.stderr:6+0 records in 2023-08-17T00:17:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:6+0 records out 2023-08-17T00:17:16.229 INFO:teuthology.orchestra.run.smithi153.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0881602 s, 71.4 MB/s 2023-08-17T00:17:16.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:17:16.231 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2023-08-17T00:17:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:6+0 records in 2023-08-17T00:17:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:6+0 records out 2023-08-17T00:17:16.320 INFO:teuthology.orchestra.run.smithi153.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0746984 s, 84.2 MB/s 2023-08-17T00:17:16.322 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:17:16.325 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:17:16.380 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-08-17T00:17:16.380 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-08-17T00:17:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:17:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-08-17T00:17:16.381 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-08-17T00:17:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-08-17T00:17:16.382 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-08-17T00:17:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-08-17T00:17:16.383 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-08-17T00:17:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-08-17T00:17:16.384 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:17:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-08-17T00:17:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.385 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:17:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:17:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.386 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-08-17T00:17:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-08-17T00:17:16.387 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-08-17T00:17:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:17:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:17:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-08-17T00:17:16.388 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:17:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-08-17T00:17:16.389 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:17:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:17:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-08-17T00:17:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.390 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:17:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-08-17T00:17:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-08-17T00:17:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.391 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-08-17T00:17:16.392 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-08-17T00:17:16.393 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.394 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:17:16.395 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-08-17T00:17:16.396 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-08-17T00:17:16.397 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.398 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.399 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:17:16.400 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-08-17T00:17:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-08-17T00:17:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-08-17T00:17:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-08-17T00:17:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.401 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:17:16.402 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:17:16.403 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.404 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-08-17T00:17:16.405 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: mds cache max size = 1000 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = False 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: mds log max segments = 1 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = False 2023-08-17T00:17:16.406 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:17:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.407 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.407 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.408 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.409 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.410 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:17:16.411 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.412 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:17:16.413 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-08-17T00:17:16.414 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-08-17T00:17:16.415 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.416 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2023-08-17T00:17:16.417 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:17:16.418 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.419 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.420 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.421 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.422 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-08-17T00:17:16.423 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.424 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-08-17T00:17:16.425 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: mds cache max size = 1000 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = False 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: mds log max segments = 1 2023-08-17T00:17:16.426 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-08-17T00:17:16.427 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = False 2023-08-17T00:17:16.427 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:17:16.427 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.427 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.429 DEBUG:teuthology.orchestra.run.smithi153:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:17:16.475 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-17T00:17:16.553 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2023-08-17T00:17:16.553 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2023-08-17T00:17:16.553 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:17:16.553 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2023-08-17T00:17:16.553 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2023-08-17T00:17:16.554 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.555 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:17:16.556 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:17:16.556 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.556 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2023-08-17T00:17:16.556 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.556 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2023-08-17T00:17:16.556 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:17:16.557 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.558 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2023-08-17T00:17:16.559 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.559 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2023-08-17T00:17:16.559 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2023-08-17T00:17:16.559 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2023-08-17T00:17:16.559 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:17:16.559 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2023-08-17T00:17:16.560 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:17:16.560 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.560 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2023-08-17T00:17:16.560 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2023-08-17T00:17:16.560 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.560 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2023-08-17T00:17:16.561 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2023-08-17T00:17:16.561 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.561 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2023-08-17T00:17:16.561 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2023-08-17T00:17:16.561 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.561 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:17:16.562 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2023-08-17T00:17:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2023-08-17T00:17:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:17:16.563 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2023-08-17T00:17:16.564 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:17:16.565 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.566 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2023-08-17T00:17:16.567 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:17:16.567 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:17:16.567 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.567 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.567 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2023-08-17T00:17:16.568 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.568 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2023-08-17T00:17:16.568 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.568 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2023-08-17T00:17:16.569 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2023-08-17T00:17:16.569 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2023-08-17T00:17:16.569 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2023-08-17T00:17:16.570 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2023-08-17T00:17:16.570 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.570 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2023-08-17T00:17:16.570 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2023-08-17T00:17:16.571 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.571 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.571 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:17:16.572 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:17:16.572 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:17:16.572 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.572 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:17:16.573 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:17:16.573 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:17:16.573 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2023-08-17T00:17:16.573 INFO:teuthology.orchestra.run.smithi178.stdout: 2023-08-17T00:17:16.574 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2023-08-17T00:17:16.574 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2023-08-17T00:17:16.574 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2023-08-17T00:17:16.574 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2023-08-17T00:17:16.575 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:17:16.575 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:17:16.575 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2023-08-17T00:17:16.575 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2023-08-17T00:17:16.575 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.575 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2023-08-17T00:17:16.576 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout: mds cache max size = 1000 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2023-08-17T00:17:16.577 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = False 2023-08-17T00:17:16.578 INFO:teuthology.orchestra.run.smithi178.stdout: mds log max segments = 1 2023-08-17T00:17:16.578 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2023-08-17T00:17:16.578 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = False 2023-08-17T00:17:16.578 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2023-08-17T00:17:16.578 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.578 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.757 INFO:teuthology.orchestra.run.smithi153.stdout:[global] 2023-08-17T00:17:16.758 INFO:teuthology.orchestra.run.smithi153.stdout: chdir = "" 2023-08-17T00:17:16.758 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-17T00:17:16.758 INFO:teuthology.orchestra.run.smithi153.stdout: auth supported = cephx 2023-08-17T00:17:16.759 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.759 INFO:teuthology.orchestra.run.smithi153.stdout: filestore xattr use omap = true 2023-08-17T00:17:16.759 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.760 INFO:teuthology.orchestra.run.smithi153.stdout: mon clock drift allowed = 1.000 2023-08-17T00:17:16.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.760 INFO:teuthology.orchestra.run.smithi153.stdout: osd crush chooseleaf type = 0 2023-08-17T00:17:16.760 INFO:teuthology.orchestra.run.smithi153.stdout: auth debug = true 2023-08-17T00:17:16.760 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.761 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on old message = true 2023-08-17T00:17:16.761 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on bug = true 2023-08-17T00:17:16.761 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.761 INFO:teuthology.orchestra.run.smithi153.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-17T00:17:16.762 INFO:teuthology.orchestra.run.smithi153.stdout: mon pg warn max object skew = 0 2023-08-17T00:17:16.762 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.762 INFO:teuthology.orchestra.run.smithi153.stdout: # disable pg_autoscaler by default for new pools 2023-08-17T00:17:16.762 INFO:teuthology.orchestra.run.smithi153.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-17T00:17:16.762 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.762 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default size = 2 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow primary affinity = true 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd allow pg remap = true 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on legacy crush tunables = false 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on crush straw calc version zero = false 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on no sortbitwise = false 2023-08-17T00:17:16.763 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on osd down out interval zero = false 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: mon warn on too few osds = false 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: mon_allow_pool_size_one = true 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-17T00:17:16.764 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: osd default data pool replay window = 5 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: mon allow pool delete = true 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: mon cluster log file level = debug 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: debug asserts on shutdown = true 2023-08-17T00:17:16.765 INFO:teuthology.orchestra.run.smithi153.stdout: mon health detail to clog = false 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: mon host = "172.21.15.153,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: ms die on skipped message = False 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: fsid = 26772232-6872-4f9c-a0de-c26dcf774179 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout:[osd] 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: osd journal size = 100 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.766 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub load threshold = 5.0 2023-08-17T00:17:16.767 INFO:teuthology.orchestra.run.smithi153.stdout: osd scrub max interval = 600 2023-08-17T00:17:16.767 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.767 INFO:teuthology.orchestra.run.smithi153.stdout: osd recover clone overlap = true 2023-08-17T00:17:16.767 INFO:teuthology.orchestra.run.smithi153.stdout: osd recovery max chunk = 1048576 2023-08-17T00:17:16.767 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.767 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug shutdown = true 2023-08-17T00:17:16.768 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug op order = true 2023-08-17T00:17:16.768 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug verify stray on activate = true 2023-08-17T00:17:16.768 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.768 INFO:teuthology.orchestra.run.smithi153.stdout: osd open classes on start = true 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug pg log writeout = true 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: osd deep scrub update digest min age = 30 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: osd map max advance = 10 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.769 INFO:teuthology.orchestra.run.smithi153.stdout: journal zero on create = true 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: filestore ondisk finisher threads = 3 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: filestore apply finisher threads = 3 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: bdev debug aio = true 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: osd debug misdirected ops = true 2023-08-17T00:17:16.770 INFO:teuthology.orchestra.run.smithi153.stdout: bdev async discard = True 2023-08-17T00:17:16.771 INFO:teuthology.orchestra.run.smithi153.stdout: bdev enable discard = True 2023-08-17T00:17:16.771 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore allocator = bitmap 2023-08-17T00:17:16.771 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore block size = 96636764160 2023-08-17T00:17:16.771 INFO:teuthology.orchestra.run.smithi153.stdout: bluestore fsck on mount = True 2023-08-17T00:17:16.771 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluefs = 1/20 2023-08-17T00:17:16.771 INFO:teuthology.orchestra.run.smithi153.stdout: debug bluestore = 1/20 2023-08-17T00:17:16.772 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.772 INFO:teuthology.orchestra.run.smithi153.stdout: debug osd = 20 2023-08-17T00:17:16.772 INFO:teuthology.orchestra.run.smithi153.stdout: debug rocksdb = 4/10 2023-08-17T00:17:16.772 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd backfillfull_ratio = 0.85 2023-08-17T00:17:16.772 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd full ratio = 0.9 2023-08-17T00:17:16.773 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd nearfull ratio = 0.8 2023-08-17T00:17:16.773 INFO:teuthology.orchestra.run.smithi153.stdout: osd failsafe full ratio = 0.95 2023-08-17T00:17:16.773 INFO:teuthology.orchestra.run.smithi153.stdout: osd objectstore = bluestore 2023-08-17T00:17:16.773 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:17:16.773 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.773 INFO:teuthology.orchestra.run.smithi153.stdout:[mgr] 2023-08-17T00:17:16.774 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.774 INFO:teuthology.orchestra.run.smithi153.stdout: debug mgr = 20 2023-08-17T00:17:16.774 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:17:16.774 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:17:16.774 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.775 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.775 INFO:teuthology.orchestra.run.smithi153.stdout: mgr/telemetry/nag = false 2023-08-17T00:17:16.775 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.775 INFO:teuthology.orchestra.run.smithi153.stdout:[mon] 2023-08-17T00:17:16.775 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.775 INFO:teuthology.orchestra.run.smithi153.stdout: debug mon = 20 2023-08-17T00:17:16.776 INFO:teuthology.orchestra.run.smithi153.stdout: debug paxos = 20 2023-08-17T00:17:16.776 INFO:teuthology.orchestra.run.smithi153.stdout: debug auth = 20 2023-08-17T00:17:16.776 INFO:teuthology.orchestra.run.smithi153.stdout: mon data avail warn = 5 2023-08-17T00:17:16.776 INFO:teuthology.orchestra.run.smithi153.stdout: mon mgr mkfs grace = 240 2023-08-17T00:17:16.777 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min pgs per osd = 4 2023-08-17T00:17:16.777 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd reporter subtree level = osd 2023-08-17T00:17:16.777 INFO:teuthology.orchestra.run.smithi153.stdout: mon osd prime pg temp = true 2023-08-17T00:17:16.777 INFO:teuthology.orchestra.run.smithi153.stdout: mon reweight min bytes per osd = 10 2023-08-17T00:17:16.777 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.778 INFO:teuthology.orchestra.run.smithi153.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-17T00:17:16.778 INFO:teuthology.orchestra.run.smithi153.stdout: auth mon ticket ttl = 660 # 11m 2023-08-17T00:17:16.778 INFO:teuthology.orchestra.run.smithi153.stdout: auth service ticket ttl = 240 # 4m 2023-08-17T00:17:16.778 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.778 INFO:teuthology.orchestra.run.smithi153.stdout: # don't complain about insecure global_id in the test suite 2023-08-17T00:17:16.779 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-17T00:17:16.779 INFO:teuthology.orchestra.run.smithi153.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-17T00:17:16.779 INFO:teuthology.orchestra.run.smithi153.stdout: mon op complaint time = 120 2023-08-17T00:17:16.779 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:16.779 INFO:teuthology.orchestra.run.smithi153.stdout:[client] 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: rgw cache enabled = true 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable ops log = true 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: rgw enable usage log = true 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: client mount timeout = 600 2023-08-17T00:17:16.780 INFO:teuthology.orchestra.run.smithi153.stdout: debug client = 20 2023-08-17T00:17:16.781 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.781 INFO:teuthology.orchestra.run.smithi153.stdout: pid file = "" 2023-08-17T00:17:16.781 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.781 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.781 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.a] 2023-08-17T00:17:16.782 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.b] 2023-08-17T00:17:16.782 INFO:teuthology.orchestra.run.smithi153.stdout:[mon.c] 2023-08-17T00:17:16.782 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.a] 2023-08-17T00:17:16.783 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.c] 2023-08-17T00:17:16.783 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.b] 2023-08-17T00:17:16.783 INFO:teuthology.orchestra.run.smithi153.stdout:[mds.d] 2023-08-17T00:17:16.784 INFO:teuthology.orchestra.run.smithi153.stdout:[mds] 2023-08-17T00:17:16.784 INFO:teuthology.orchestra.run.smithi153.stdout: debug mds = 20 2023-08-17T00:17:16.784 INFO:teuthology.orchestra.run.smithi153.stdout: debug ms = 1 2023-08-17T00:17:16.784 INFO:teuthology.orchestra.run.smithi153.stdout: mds cache max size = 1000 2023-08-17T00:17:16.785 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug frag = True 2023-08-17T00:17:16.785 INFO:teuthology.orchestra.run.smithi153.stdout: mds debug scatterstat = False 2023-08-17T00:17:16.785 INFO:teuthology.orchestra.run.smithi153.stdout: mds log max segments = 1 2023-08-17T00:17:16.786 INFO:teuthology.orchestra.run.smithi153.stdout: mds op complaint time = 180 2023-08-17T00:17:16.786 INFO:teuthology.orchestra.run.smithi153.stdout: mds verify scatter = False 2023-08-17T00:17:16.786 INFO:teuthology.orchestra.run.smithi153.stdout: osd op complaint time = 180 2023-08-17T00:17:16.786 INFO:teuthology.orchestra.run.smithi153.stdout: rados mon op timeout = 900 2023-08-17T00:17:16.786 INFO:teuthology.orchestra.run.smithi153.stdout: rados osd op timeout = 900 2023-08-17T00:17:16.788 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-17T00:17:16.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-08-17T00:17:16.789 DEBUG:teuthology.orchestra.run.smithi153:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-17T00:17:16.925 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:17:16.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:17:16.926 DEBUG:teuthology.orchestra.run.smithi153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-17T00:17:16.941 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:17:17.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.147+0000 7f4208369700 1 Processor -- start 2023-08-17T00:17:17.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.147+0000 7f4208369700 1 -- start start 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4208369700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4200153d50 0x7f42000632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4208369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42000656d0 0x7f4200065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4208369700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4200065240 con 0x7f4200154130 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4208369700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4200063880 con 0x7f4200153d50 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4208369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4200064910 con 0x7f42000656d0 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206105700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4200153d50 0x7f42000632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4205904700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4200154130 0x7f42000629b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60550/0 (socket says 172.21.15.153:60550) 2023-08-17T00:17:17.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4205904700 1 -- 172.21.15.153:0/2465520312 learned_addr learned my addr 172.21.15.153:0/2465520312 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:17.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206906700 1 --2- 172.21.15.153:0/2465520312 >> v2:172.21.15.178:3300/0 conn(0x7f42000656d0 0x7f4200065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206105700 1 -- 172.21.15.153:0/2465520312 >> v2:172.21.15.178:3300/0 conn(0x7f42000656d0 msgr2=0x7f4200065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:17.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206105700 1 --2- 172.21.15.153:0/2465520312 >> v2:172.21.15.178:3300/0 conn(0x7f42000656d0 0x7f4200065ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4205103700 1 -- 172.21.15.153:0/2465520312 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684611074 0 0) 0x7f4200065240 con 0x7f4200154130 2023-08-17T00:17:17.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206105700 1 -- 172.21.15.153:0/2465520312 >> v1:172.21.15.153:6789/0 conn(0x7f4200154130 legacy=0x7f42000629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206105700 1 -- 172.21.15.153:0/2465520312 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200064bf0 con 0x7f4200153d50 2023-08-17T00:17:17.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4206105700 1 --2- 172.21.15.153:0/2465520312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200153d50 0x7f42000632e0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7f42000bbac0 tx=0x7f41fc009780).ready entity=mon.0 client_cookie=fb9f6d51d10a63f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:17.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4205103700 1 -- 172.21.15.153:0/2465520312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00e070 con 0x7f4200153d50 2023-08-17T00:17:17.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4205103700 1 -- 172.21.15.153:0/2465520312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc00bb60 con 0x7f4200153d50 2023-08-17T00:17:17.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.151+0000 7f4205103700 1 -- 172.21.15.153:0/2465520312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc012410 con 0x7f4200153d50 2023-08-17T00:17:17.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 -- 172.21.15.153:0/2465520312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200153d50 msgr2=0x7f42000632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 --2- 172.21.15.153:0/2465520312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200153d50 0x7f42000632e0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 rx=0x7f42000bbac0 tx=0x7f41fc009780).stop 2023-08-17T00:17:17.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 -- 172.21.15.153:0/2465520312 shutdown_connections 2023-08-17T00:17:17.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 --2- 172.21.15.153:0/2465520312 >> v2:172.21.15.178:3300/0 conn(0x7f42000656d0 0x7f4200065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 --2- 172.21.15.153:0/2465520312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200153d50 0x7f42000632e0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 -- 172.21.15.153:0/2465520312 >> 172.21.15.153:0/2465520312 conn(0x7f42000c7150 msgr2=0x7f42000c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:17.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 -- 172.21.15.153:0/2465520312 shutdown_connections 2023-08-17T00:17:17.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 -- 172.21.15.153:0/2465520312 wait complete. 2023-08-17T00:17:17.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.155+0000 7f4208369700 1 Processor -- start 2023-08-17T00:17:17.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 -- start start 2023-08-17T00:17:17.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42000656d0 0x7f4200154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4200153d50 0x7f42000bea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 0x7f42000abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42000aba00 con 0x7f4200154130 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4200154a00 con 0x7f42000656d0 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4200155b20 con 0x7f4200153d50 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 0x7f42000abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 0x7f42000abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42802/0 (socket says 172.21.15.153:42802) 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 -- 172.21.15.153:0/415595889 learned_addr learned my addr 172.21.15.153:0/415595889 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206105700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42000656d0 0x7f4200154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4205904700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4200153d50 0x7f42000bea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 -- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4200153d50 msgr2=0x7f42000bea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4200153d50 0x7f42000bea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 -- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42000656d0 msgr2=0x7f4200154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42000656d0 0x7f4200154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 -- 172.21.15.153:0/415595889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41fc009a20 con 0x7f4200154130 2023-08-17T00:17:17.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4206906700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 0x7f42000abe90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7f41f800e6f0 tx=0x7f41f8009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:17.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8012600 con 0x7f4200154130 2023-08-17T00:17:17.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f8012760 con 0x7f4200154130 2023-08-17T00:17:17.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42000ab3b0 con 0x7f4200154130 2023-08-17T00:17:17.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f8012ae0 con 0x7f4200154130 2023-08-17T00:17:17.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.159+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000ab060 con 0x7f4200154130 2023-08-17T00:17:17.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.163+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42000abbb0 con 0x7f4200154130 2023-08-17T00:17:17.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.163+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f41f8022070 con 0x7f4200154130 2023-08-17T00:17:17.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.167+0000 7f41f67fc700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e405a150 0x7f41e405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.167+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f41f8074370 con 0x7f4200154130 2023-08-17T00:17:17.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.167+0000 7f4206105700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e405a150 0x7f41e405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.167+0000 7f4206105700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e405a150 0x7f41e405c610 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f41fc009870 tx=0x7f41fc009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:17.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.171+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f42000abbb0 con 0x7f4200154130 2023-08-17T00:17:17.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.363+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f420006b530 con 0x7f4200154130 2023-08-17T00:17:17.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.363+0000 7f41f67fc700 1 -- 172.21.15.153:0/415595889 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 146 v146) v1 ==== 95+0+4511 (secure 0 0 0) 0x7f41f8047d10 con 0x7f4200154130 2023-08-17T00:17:17.369 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:17.369 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":146,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":146,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:07.040208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9649},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9649":{"gid":9649,"name":"c","rank":0,"incarnation":142,"state":"up:active","state_seq":3,"addr":"172.21.15.153:6835/4264536439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4264536439},{"type":"v1","addr":"172.21.15.153:6835","nonce":4264536439}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:17:17.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e405a150 msgr2=0x7f41e405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e405a150 0x7f41e405c610 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7f41fc009870 tx=0x7f41fc009780).stop 2023-08-17T00:17:17.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 msgr2=0x7f42000abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 0x7f42000abe90 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 rx=0x7f41f800e6f0 tx=0x7f41f8009060).stop 2023-08-17T00:17:17.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 shutdown_connections 2023-08-17T00:17:17.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f41e405a150 0x7f41e405c610 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4200154130 0x7f42000abe90 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4200153d50 0x7f42000bea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 --2- 172.21.15.153:0/415595889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42000656d0 0x7f4200154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 >> 172.21.15.153:0/415595889 conn(0x7f42000c7150 msgr2=0x7f4200151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:17.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 shutdown_connections 2023-08-17T00:17:17.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.367+0000 7f4208369700 1 -- 172.21.15.153:0/415595889 wait complete. 2023-08-17T00:17:17.375 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 146 2023-08-17T00:17:17.394 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-08-17T00:17:17.579 INFO:teuthology.orchestra.run.smithi153.stdout:{"message":"","return_code":0} 2023-08-17T00:17:17.580 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-08-17T00:17:17.580 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:17:17.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.731+0000 7f88ad1a9700 1 Processor -- start 2023-08-17T00:17:17.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.731+0000 7f88ad1a9700 1 -- start start 2023-08-17T00:17:17.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88ad1a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8151b90 0x7f88a8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88ad1a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f88a8064870 0x7f88a8064d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88ad1a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a8065210 con 0x7f88a8063290 2023-08-17T00:17:17.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88ad1a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a80c3fb0 con 0x7f88a8064870 2023-08-17T00:17:17.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88ad1a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8152460 con 0x7f88a8151b90 2023-08-17T00:17:17.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f88a8064870 0x7f88a8064d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f88a8064870 0x7f88a8064d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42808/0 (socket says 172.21.15.153:42808) 2023-08-17T00:17:17.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 -- 172.21.15.153:0/1610241712 learned_addr learned my addr 172.21.15.153:0/1610241712 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:17.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a6d9d700 1 --2- 172.21.15.153:0/1610241712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8151b90 0x7f88a8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 -- 172.21.15.153:0/1610241712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8151b90 msgr2=0x7f88a8151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 --2- 172.21.15.153:0/1610241712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8151b90 0x7f88a8151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 -- 172.21.15.153:0/1610241712 >> v1:172.21.15.178:6789/0 conn(0x7f88a8063290 legacy=0x7f88a8065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 -- 172.21.15.153:0/1610241712 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a8061fa0 con 0x7f88a8064870 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a759e700 1 --2- 172.21.15.153:0/1610241712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8064870 0x7f88a8064d20 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f88a0009f20 tx=0x7f88a0009840).ready entity=mon.0 client_cookie=2af04ebd61c26a9f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a659c700 1 -- 172.21.15.153:0/1610241712 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000e070 con 0x7f88a8064870 2023-08-17T00:17:17.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a659c700 1 -- 172.21.15.153:0/1610241712 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a000ba80 con 0x7f88a8064870 2023-08-17T00:17:17.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.735+0000 7f88a659c700 1 -- 172.21.15.153:0/1610241712 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a000be00 con 0x7f88a8064870 2023-08-17T00:17:17.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 -- 172.21.15.153:0/1610241712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8064870 msgr2=0x7f88a8064d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/1610241712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8064870 0x7f88a8064d20 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 rx=0x7f88a0009f20 tx=0x7f88a0009840).stop 2023-08-17T00:17:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 -- 172.21.15.153:0/1610241712 shutdown_connections 2023-08-17T00:17:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/1610241712 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8064870 0x7f88a8064d20 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/1610241712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8151b90 0x7f88a8151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 -- 172.21.15.153:0/1610241712 >> 172.21.15.153:0/1610241712 conn(0x7f88a80c7150 msgr2=0x7f88a80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 -- 172.21.15.153:0/1610241712 shutdown_connections 2023-08-17T00:17:17.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 -- 172.21.15.153:0/1610241712 wait complete. 2023-08-17T00:17:17.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 Processor -- start 2023-08-17T00:17:17.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.739+0000 7f88ad1a9700 1 -- start start 2023-08-17T00:17:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88a8063290 0x7f88a80a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8064870 0x7f88a80aa310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 0x7f88a814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80aa800 con 0x7f88a8151b90 2023-08-17T00:17:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a81647d0 con 0x7f88a8063290 2023-08-17T00:17:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80aace0 con 0x7f88a8064870 2023-08-17T00:17:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 0x7f88a814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 0x7f88a814ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42824/0 (socket says 172.21.15.153:42824) 2023-08-17T00:17:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 -- 172.21.15.153:0/2783103078 learned_addr learned my addr 172.21.15.153:0/2783103078 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:17.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a6d9d700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88a8063290 0x7f88a80a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f889e59c700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8064870 0x7f88a80aa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 -- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8064870 msgr2=0x7f88a80aa310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8064870 0x7f88a80aa310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 -- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88a8063290 msgr2=0x7f88a80a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88a8063290 0x7f88a80a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 -- 172.21.15.153:0/2783103078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0009ae0 con 0x7f88a8151b90 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88a759e700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 0x7f88a814ea20 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f88a0013d30 tx=0x7f88a0009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:17.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a00092e0 con 0x7f88a8151b90 2023-08-17T00:17:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a001e470 con 0x7f88a8151b90 2023-08-17T00:17:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a81580e0 con 0x7f88a8151b90 2023-08-17T00:17:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a001e830 con 0x7f88a8151b90 2023-08-17T00:17:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.743+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a8157a90 con 0x7f88a8151b90 2023-08-17T00:17:17.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.747+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a8158270 con 0x7f88a8151b90 2023-08-17T00:17:17.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.747+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f88a0025030 con 0x7f88a8151b90 2023-08-17T00:17:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.747+0000 7f889f7fe700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f888805a180 0x7f888805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.747+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 6121+0+0 (secure 0 0 0) 0x7f88a00757e0 con 0x7f88a8151b90 2023-08-17T00:17:17.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.747+0000 7f88a6d9d700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f888805a180 0x7f888805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:17.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.751+0000 7f88a6d9d700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f888805a180 0x7f888805c640 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f889800bb10 tx=0x7f8898008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:17.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.755+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f88a0049230 con 0x7f88a8151b90 2023-08-17T00:17:17.853 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:17:17.861 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:17:17.955 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:17.951+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88a806b530 con 0x7f88a8151b90 2023-08-17T00:17:18.426 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:17:18.423+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:17:18.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.435+0000 7f889f7fe700 1 -- 172.21.15.153:0/2783103078 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v147) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88a0023070 con 0x7f88a8151b90 2023-08-17T00:17:18.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f888805a180 msgr2=0x7f888805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f888805a180 0x7f888805c640 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7f889800bb10 tx=0x7f8898008040).stop 2023-08-17T00:17:18.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 msgr2=0x7f88a814ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 0x7f88a814ea20 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 rx=0x7f88a0013d30 tx=0x7f88a0009840).stop 2023-08-17T00:17:18.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 shutdown_connections 2023-08-17T00:17:18.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f888805a180 0x7f888805c640 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f88a8151b90 0x7f88a814ea20 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88a8064870 0x7f88a80aa310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 --2- 172.21.15.153:0/2783103078 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88a8063290 0x7f88a80a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 >> 172.21.15.153:0/2783103078 conn(0x7f88a80c7150 msgr2=0x7f88a80629b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:18.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 shutdown_connections 2023-08-17T00:17:18.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.439+0000 7f88ad1a9700 1 -- 172.21.15.153:0/2783103078 wait complete. 2023-08-17T00:17:18.446 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:17:18.452 INFO:tasks.ceph.mds.c.smithi153.stderr: -4196> 2023-08-17T00:17:09.539+0000 7f4d7c1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:17:18.466 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2023-08-17T00:17:18.500 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:17:18.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 Processor -- start 2023-08-17T00:17:18.551 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 -- start start 2023-08-17T00:17:18.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b61641c90 0x556b6165e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b616e8b70 0x556b6165d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 0x556b6165dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b615838b0 con 0x556b616e8f50 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b61588ce0 con 0x556b61641c90 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f459ff39d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b6165ec50 con 0x556b616e8b70 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 0x556b6165dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 0x556b6165dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42842/0 (socket says 172.21.15.153:42842) 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 -- 172.21.15.153:0/4191806009 learned_addr learned my addr 172.21.15.153:0/4191806009 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f458bdcc700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b616e8b70 0x556b6165d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f45945cd700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b61641c90 0x556b6165e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 -- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b616e8b70 msgr2=0x556b6165d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b616e8b70 0x556b6165d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 -- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b61641c90 msgr2=0x556b6165e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:18.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b61641c90 0x556b6165e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f4594dce700 1 -- 172.21.15.153:0/4191806009 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584005cf0 con 0x556b616e8f50 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f458bdcc700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b616e8b70 0x556b6165d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.547+0000 7f45945cd700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b61641c90 0x556b6165e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f4594dce700 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 0x556b6165dd30 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f458c006f30 tx=0x7f458c0069b0).ready entity=mon.0 client_cookie=bc2b9e82b6bba913 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f45935cb700 1 -- 172.21.15.153:0/4191806009 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c006110 con 0x556b616e8f50 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f45935cb700 1 -- 172.21.15.153:0/4191806009 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458c006270 con 0x556b616e8f50 2023-08-17T00:17:18.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f45935cb700 1 -- 172.21.15.153:0/4191806009 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c004770 con 0x556b616e8f50 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- 172.21.15.153:0/4191806009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 msgr2=0x556b6165dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 0x556b6165dd30 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 rx=0x7f458c006f30 tx=0x7f458c0069b0).stop 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- 172.21.15.153:0/4191806009 shutdown_connections 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8f50 0x556b6165dd30 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b616e8b70 0x556b6165d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4191806009 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b61641c90 0x556b6165e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- 172.21.15.153:0/4191806009 >> 172.21.15.153:0/4191806009 conn(0x556b61660790 msgr2=0x556b6163f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:18.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- 172.21.15.153:0/4191806009 shutdown_connections 2023-08-17T00:17:18.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- 172.21.15.153:0/4191806009 wait complete. 2023-08-17T00:17:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 Processor -- start 2023-08-17T00:17:18.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- start start 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b61641c90 0x556b61642d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8b70 0x556b616df780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b616e8f50 0x556b616443d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b61643f40 con 0x556b616e8b70 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b61643330 con 0x556b616e8f50 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.551+0000 7f459ff39d00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b61643610 con 0x556b61641c90 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8b70 0x556b616df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8b70 0x556b616df780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42854/0 (socket says 172.21.15.153:42854) 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 -- 172.21.15.153:0/4267264906 learned_addr learned my addr 172.21.15.153:0/4267264906 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f4594dce700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b616e8f50 0x556b616443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f45945cd700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b61641c90 0x556b61642d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 -- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b61641c90 msgr2=0x556b61642d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b61641c90 0x556b61642d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 -- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b616e8f50 msgr2=0x556b616443d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b616e8f50 0x556b616443d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 -- 172.21.15.153:0/4267264906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b615b24e0 con 0x556b616e8b70 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f458bdcc700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8b70 0x556b616df780 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x556b616ec890 tx=0x7f457c0039b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f4591dc8700 1 -- 172.21.15.153:0/4267264906 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c00bd10 con 0x556b616e8b70 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556b61581a70 con 0x556b616e8b70 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f4591dc8700 1 -- 172.21.15.153:0/4267264906 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c008040 con 0x556b616e8b70 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f4591dc8700 1 -- 172.21.15.153:0/4267264906 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011690 con 0x556b616e8b70 2023-08-17T00:17:18.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.555+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b6158cad0 con 0x556b616e8b70 2023-08-17T00:17:18.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f4591dc8700 1 -- 172.21.15.153:0/4267264906 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f457c00e040 con 0x556b616e8b70 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f4591dc8700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4574058c30 0x7f457405b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f4591dc8700 1 -- 172.21.15.153:0/4267264906 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f457c072e00 con 0x556b616e8b70 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556b616dfc70 0x556b616e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- osd_op(unknown.0.0:1 27.30 27:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected e193) v8 -- 0x556b616448c0 con 0x556b616dfc70 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f45945cd700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4574058c30 0x7f457405b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f4594dce700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556b616dfc70 0x556b616e52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f45945cd700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4574058c30 0x7f457405b0f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f458400afd0 tx=0x7f4584015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f4594dce700 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556b616dfc70 0x556b616e52c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.559+0000 7f4594dce700 1 -- 172.21.15.153:0/4267264906 <== osd.5 v2:172.21.15.178:6816/33067 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x7f458c0044f0 con 0x556b616dfc70 2023-08-17T00:17:18.566 INFO:teuthology.orchestra.run.smithi153.stderr:Writing to - 2023-08-17T00:17:18.567 INFO:teuthology.orchestra.run.smithi153.stdout:i��� g�d��� 2023-08-17T00:17:18.567 INFO:teuthology.orchestra.run.smithi153.stdout:����@@`�������� g�d��� 2023-08-17T00:17:18.567 INFO:teuthology.orchestra.run.smithi153.stdout: g�d[' (8` g�d��� 2023-08-17T00:17:18.567 INFO:teuthology.orchestra.run.smithi153.stdout:8` g�d��� 2023-08-17T00:17:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556b616dfc70 msgr2=0x556b616e52c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556b616dfc70 0x556b616e52c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4574058c30 msgr2=0x7f457405b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4574058c30 0x7f457405b0f0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 rx=0x7f458400afd0 tx=0x7f4584015000).stop 2023-08-17T00:17:18.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8b70 msgr2=0x556b616df780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 --2- 172.21.15.153:0/4267264906 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556b616e8b70 0x556b616df780 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 rx=0x556b616ec890 tx=0x7f457c0039b0).stop 2023-08-17T00:17:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f4594dce700 1 -- 172.21.15.153:0/4267264906 reap_dead start 2023-08-17T00:17:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 shutdown_connections 2023-08-17T00:17:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 >> 172.21.15.153:0/4267264906 conn(0x556b61660790 msgr2=0x556b616126c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 shutdown_connections 2023-08-17T00:17:18.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.563+0000 7f459ff39d00 1 -- 172.21.15.153:0/4267264906 wait complete. 2023-08-17T00:17:18.571 INFO:teuthology.orchestra.run.smithi153.stdout:�������� g�d[' ������������ 2023-08-17T00:17:18.571 DEBUG:teuthology.orchestra.run.smithi153:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2023-08-17T00:17:18.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.663+0000 7f0277d8ed00 1 Processor -- start 2023-08-17T00:17:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.663+0000 7f0277d8ed00 1 -- start start 2023-08-17T00:17:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dbc40 0x556d7b830910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dc020 0x556d7b84b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7b77bce0 con 0x556d7b8dca20 2023-08-17T00:17:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7b835a80 con 0x556d7b8dc020 2023-08-17T00:17:18.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d7b830e00 con 0x556d7b8dbc40 2023-08-17T00:17:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8de1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42866/0 (socket says 172.21.15.153:42866) 2023-08-17T00:17:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 -- 172.21.15.153:0/1599324934 learned_addr learned my addr 172.21.15.153:0/1599324934 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:18.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 -- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dbc40 msgr2=0x556d7b830910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dbc40 0x556d7b830910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f026ffff700 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dc020 0x556d7b84b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 -- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dc020 msgr2=0x556d7b84b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:18.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dc020 0x556d7b84b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 -- 172.21.15.153:0/1599324934 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027000a0e0 con 0x556d7b8dca20 2023-08-17T00:17:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f026ffff700 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dc020 0x556d7b84b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0275eb8700 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8de1b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7f027000ac40 tx=0x7f0270015000).ready entity=mon.0 client_cookie=451798408bbc519d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f026f7fe700 1 -- 172.21.15.153:0/1599324934 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000d470 con 0x556d7b8dca20 2023-08-17T00:17:18.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f026f7fe700 1 -- 172.21.15.153:0/1599324934 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000dcc0 con 0x556d7b8dca20 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f026f7fe700 1 -- 172.21.15.153:0/1599324934 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270005710 con 0x556d7b8dca20 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1599324934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 msgr2=0x556d7b8de1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8de1b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 rx=0x7f027000ac40 tx=0x7f0270015000).stop 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1599324934 shutdown_connections 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8de1b0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dc020 0x556d7b84b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1599324934 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dbc40 0x556d7b830910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:18.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1599324934 >> 172.21.15.153:0/1599324934 conn(0x556d7b84cf40 msgr2=0x556d7b804c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1599324934 shutdown_connections 2023-08-17T00:17:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.667+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1599324934 wait complete. 2023-08-17T00:17:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 Processor -- start 2023-08-17T00:17:18.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 -- start start 2023-08-17T00:17:18.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dbc40 0x556d7b8cf510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dc020 0x556d7b8d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8310f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7b8d2890 con 0x556d7b8dca20 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d7b8d19f0 con 0x556d7b8dbc40 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0277d8ed00 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556d7b831e30 con 0x556d7b8dc020 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8310f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42868/0 (socket says 172.21.15.153:42868) 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 -- 172.21.15.153:0/1536611354 learned_addr learned my addr 172.21.15.153:0/1536611354 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f026ffff700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dc020 0x556d7b8d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f02756b7700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dbc40 0x556d7b8cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 -- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dc020 msgr2=0x556d7b8d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dc020 0x556d7b8d2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 -- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dbc40 msgr2=0x556d7b8cf510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556d7b8dbc40 0x556d7b8cf510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 -- 172.21.15.153:0/1536611354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d7b7a54e0 con 0x556d7b8dca20 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f026ffff700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556d7b8dc020 0x556d7b8d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.671+0000 7f0275eb8700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8310f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f027000a470 tx=0x7f027001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.675+0000 7f026dffb700 1 -- 172.21.15.153:0/1536611354 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027000d950 con 0x556d7b8dca20 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.675+0000 7f026dffb700 1 -- 172.21.15.153:0/1536611354 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027000de30 con 0x556d7b8dca20 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.675+0000 7f026dffb700 1 -- 172.21.15.153:0/1536611354 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027002c6b0 con 0x556d7b8dca20 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.675+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556d7b7a5230 con 0x556d7b8dca20 2023-08-17T00:17:18.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.675+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d7b774a70 con 0x556d7b8dca20 2023-08-17T00:17:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.675+0000 7f026dffb700 1 -- 172.21.15.153:0/1536611354 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f027000e070 con 0x556d7b8dca20 2023-08-17T00:17:18.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f026dffb700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0258058c30 0x7f025805b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f026dffb700 1 -- 172.21.15.153:0/1536611354 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f0270075920 con 0x556d7b8dca20 2023-08-17T00:17:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556d7b8f0930 0x556d7b8f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f02756b7700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0258058c30 0x7f025805b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- osd_op(unknown.0.0:1 27.30 27:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected e193) v8 -- 0x556d7b832a80 con 0x556d7b8f0930 2023-08-17T00:17:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f026ffff700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556d7b8f0930 0x556d7b8f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f02756b7700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0258058c30 0x7f025805b0f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f0268006fd0 tx=0x7f0268000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.679+0000 7f026ffff700 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556d7b8f0930 0x556d7b8f0d50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f026ffff700 1 -- 172.21.15.153:0/1536611354 <== osd.5 v2:172.21.15.178:6816/33067 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v193'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0260007410 con 0x556d7b8f0930 2023-08-17T00:17:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556d7b8f0930 msgr2=0x556d7b8f0d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x556d7b8f0930 0x556d7b8f0d50 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0258058c30 msgr2=0x7f025805b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f0258058c30 0x7f025805b0f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f0268006fd0 tx=0x7f0268000bc0).stop 2023-08-17T00:17:18.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 msgr2=0x556d7b8310f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 --2- 172.21.15.153:0/1536611354 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x556d7b8dca20 0x556d7b8310f0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 rx=0x7f027000a470 tx=0x7f027001a000).stop 2023-08-17T00:17:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0275eb8700 1 -- 172.21.15.153:0/1536611354 reap_dead start 2023-08-17T00:17:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 shutdown_connections 2023-08-17T00:17:18.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 >> 172.21.15.153:0/1536611354 conn(0x556d7b84cf40 msgr2=0x556d7b84b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 shutdown_connections 2023-08-17T00:17:18.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.683+0000 7f0277d8ed00 1 -- 172.21.15.153:0/1536611354 wait complete. 2023-08-17T00:17:18.695 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2023-08-17T00:17:18.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.907+0000 7f7cee546700 1 Processor -- start 2023-08-17T00:17:18.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.911+0000 7f7cee546700 1 -- start start 2023-08-17T00:17:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.911+0000 7f7cee546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce8151770 0x7f7ce8154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80bc5b0 con 0x7f7ce80652d0 2023-08-17T00:17:18.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80bc890 con 0x7f7ce80bbe80 2023-08-17T00:17:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80bcb70 con 0x7f7ce8151770 2023-08-17T00:17:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cecae3700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7ce80652d0 0x7f7ce8062280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60580/0 (socket says 172.21.15.153:60580) 2023-08-17T00:17:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cecae3700 1 -- 172.21.15.153:0/3350270561 learned_addr learned my addr 172.21.15.153:0/3350270561 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:18.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce7fff700 1 --2- 172.21.15.153:0/3350270561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce8151770 0x7f7ce8154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce77fe700 1 -- 172.21.15.153:0/3350270561 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132648176 0 0) 0x7f7ce80bc5b0 con 0x7f7ce80652d0 2023-08-17T00:17:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce77fe700 1 -- 172.21.15.153:0/3350270561 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd40033f0 con 0x7f7ce80652d0 2023-08-17T00:17:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce7fff700 1 -- 172.21.15.153:0/3350270561 >> v1:172.21.15.178:6789/0 conn(0x7f7ce80bbe80 legacy=0x7f7ce8064bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce7fff700 1 -- 172.21.15.153:0/3350270561 >> v1:172.21.15.153:6789/0 conn(0x7f7ce80652d0 legacy=0x7f7ce8062280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce77fe700 1 -- 172.21.15.153:0/3350270561 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84745973 0 0) 0x7f7ce80bc890 con 0x7f7ce80bbe80 2023-08-17T00:17:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce7fff700 1 -- 172.21.15.153:0/3350270561 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce80bce50 con 0x7f7ce8151770 2023-08-17T00:17:18.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce7fff700 1 --2- 172.21.15.153:0/3350270561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce8151770 0x7f7ce8154cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7cd8009e90 tx=0x7f7cd8009780).ready entity=mon.2 client_cookie=b9ab96667992b8c5 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce77fe700 1 -- 172.21.15.153:0/3350270561 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800e070 con 0x7f7ce8151770 2023-08-17T00:17:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce77fe700 1 -- 172.21.15.153:0/3350270561 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd800bb60 con 0x7f7ce8151770 2023-08-17T00:17:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7ce77fe700 1 -- 172.21.15.153:0/3350270561 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800bee0 con 0x7f7ce8151770 2023-08-17T00:17:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- 172.21.15.153:0/3350270561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce8151770 msgr2=0x7f7ce8154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 --2- 172.21.15.153:0/3350270561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce8151770 0x7f7ce8154cc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f7cd8009e90 tx=0x7f7cd8009780).stop 2023-08-17T00:17:18.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- 172.21.15.153:0/3350270561 shutdown_connections 2023-08-17T00:17:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 --2- 172.21.15.153:0/3350270561 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce8151770 0x7f7ce8154cc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- 172.21.15.153:0/3350270561 >> 172.21.15.153:0/3350270561 conn(0x7f7ce80c39c0 msgr2=0x7f7ce80c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- 172.21.15.153:0/3350270561 shutdown_connections 2023-08-17T00:17:18.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.915+0000 7f7cee546700 1 -- 172.21.15.153:0/3350270561 wait complete. 2023-08-17T00:17:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 Processor -- start 2023-08-17T00:17:18.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 -- start start 2023-08-17T00:17:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 0x7f7ce80aa370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce80bbe80 0x7f7ce80be130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce8151770 0x7f7ce8153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80a78f0 con 0x7f7ce80652d0 2023-08-17T00:17:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80a6a00 con 0x7f7ce8151770 2023-08-17T00:17:18.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7cee546700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80a6ce0 con 0x7f7ce80bbe80 2023-08-17T00:17:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 0x7f7ce80aa370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 0x7f7ce80aa370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42870/0 (socket says 172.21.15.153:42870) 2023-08-17T00:17:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 -- 172.21.15.153:0/1651386267 learned_addr learned my addr 172.21.15.153:0/1651386267 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 -- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce80bbe80 msgr2=0x7f7ce80be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce80bbe80 0x7f7ce80be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:18.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 -- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce8151770 msgr2=0x7f7ce8153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce8151770 0x7f7ce8153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.919+0000 7f7ce7fff700 1 -- 172.21.15.153:0/1651386267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8009a20 con 0x7f7ce80652d0 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7ce7fff700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 0x7f7ce80aa370 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f7ce8068bd0 tx=0x7f7cd8009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800bea0 con 0x7f7ce80652d0 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd801d630 con 0x7f7ce80652d0 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd801d9f0 con 0x7f7ce80652d0 2023-08-17T00:17:18.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce80a6fc0 con 0x7f7ce80652d0 2023-08-17T00:17:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce80a7580 con 0x7f7ce80652d0 2023-08-17T00:17:18.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce806b530 con 0x7f7ce80652d0 2023-08-17T00:17:18.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.923+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7cd8026410 con 0x7f7ce80652d0 2023-08-17T00:17:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.927+0000 7f7ce4ff9700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7cc805a150 0x7f7cc805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:18.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.927+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f7cd80762c0 con 0x7f7ce80652d0 2023-08-17T00:17:18.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.927+0000 7f7cdf7fe700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7cc805a150 0x7f7cc805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:18.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.927+0000 7f7cdf7fe700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7cc805a150 0x7f7cc805c610 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f7ce80a9b70 tx=0x7f7cd0007830).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:18.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:18.935+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7cd8049c30 con 0x7f7ce80652d0 2023-08-17T00:17:19.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.095+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) v1 -- 0x7f7ce81543b0 con 0x7f7ce80652d0 2023-08-17T00:17:19.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.103+0000 7f7ce4ff9700 1 -- 172.21.15.153:0/1651386267 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v25)=0 v25) v1 ==== 140+0+0 (secure 0 0 0) 0x7f7cd804d250 con 0x7f7ce80652d0 2023-08-17T00:17:19.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7cc805a150 msgr2=0x7f7cc805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7cc805a150 0x7f7cc805c610 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f7ce80a9b70 tx=0x7f7cd0007830).stop 2023-08-17T00:17:19.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 msgr2=0x7f7ce80aa370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 0x7f7ce80aa370 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 rx=0x7f7ce8068bd0 tx=0x7f7cd8009780).stop 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 shutdown_connections 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7cc805a150 0x7f7cc805c610 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ce8151770 0x7f7ce8153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ce80bbe80 0x7f7ce80be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 --2- 172.21.15.153:0/1651386267 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7ce80652d0 0x7f7ce80aa370 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:19.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 >> 172.21.15.153:0/1651386267 conn(0x7f7ce80c39c0 msgr2=0x7f7ce8150a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:19.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 shutdown_connections 2023-08-17T00:17:19.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.107+0000 7f7cee546700 1 -- 172.21.15.153:0/1651386267 wait complete. 2023-08-17T00:17:19.133 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-08-17T00:17:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.299+0000 7f9f754ff700 1 Processor -- start 2023-08-17T00:17:19.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.299+0000 7f9f754ff700 1 -- start start 2023-08-17T00:17:19.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f754ff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f7014fff0 0x7f9f70062970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f754ff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700a9170 con 0x7f9f70153da0 2023-08-17T00:17:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f754ff700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700c2e90 con 0x7f9f701503d0 2023-08-17T00:17:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f754ff700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700c1b90 con 0x7f9f7014fff0 2023-08-17T00:17:19.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6effd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9f7014fff0 0x7f9f70062970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6e7fc700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9f70153da0 0x7f9f700c2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60596/0 (socket says 172.21.15.153:60596) 2023-08-17T00:17:19.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6e7fc700 1 -- 172.21.15.153:0/3146678823 learned_addr learned my addr 172.21.15.153:0/3146678823 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6dffb700 1 -- 172.21.15.153:0/3146678823 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985443149 0 0) 0x7f9f700a9170 con 0x7f9f70153da0 2023-08-17T00:17:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6dffb700 1 -- 172.21.15.153:0/3146678823 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f58004500 con 0x7f9f70153da0 2023-08-17T00:17:19.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6effd700 1 -- 172.21.15.153:0/3146678823 >> v1:172.21.15.178:6789/0 conn(0x7f9f701503d0 legacy=0x7f9f700c2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6effd700 1 -- 172.21.15.153:0/3146678823 >> v1:172.21.15.153:6789/0 conn(0x7f9f70153da0 legacy=0x7f9f700c2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6effd700 1 -- 172.21.15.153:0/3146678823 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70154280 con 0x7f9f7014fff0 2023-08-17T00:17:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6effd700 1 --2- 172.21.15.153:0/3146678823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f7014fff0 0x7f9f70062970 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7f9f60009760 tx=0x7f9f60009060).ready entity=mon.0 client_cookie=dfbebb44c6f9e6f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6dffb700 1 -- 172.21.15.153:0/3146678823 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600090d0 con 0x7f9f7014fff0 2023-08-17T00:17:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.303+0000 7f9f6dffb700 1 -- 172.21.15.153:0/3146678823 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000f6b0 con 0x7f9f7014fff0 2023-08-17T00:17:19.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f6dffb700 1 -- 172.21.15.153:0/3146678823 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000fa30 con 0x7f9f7014fff0 2023-08-17T00:17:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 -- 172.21.15.153:0/3146678823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f7014fff0 msgr2=0x7f9f70062970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 --2- 172.21.15.153:0/3146678823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f7014fff0 0x7f9f70062970 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 rx=0x7f9f60009760 tx=0x7f9f60009060).stop 2023-08-17T00:17:19.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 -- 172.21.15.153:0/3146678823 shutdown_connections 2023-08-17T00:17:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 --2- 172.21.15.153:0/3146678823 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f7014fff0 0x7f9f70062970 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 -- 172.21.15.153:0/3146678823 >> 172.21.15.153:0/3146678823 conn(0x7f9f700c7150 msgr2=0x7f9f700c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 -- 172.21.15.153:0/3146678823 shutdown_connections 2023-08-17T00:17:19.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 -- 172.21.15.153:0/3146678823 wait complete. 2023-08-17T00:17:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.307+0000 7f9f754ff700 1 Processor -- start 2023-08-17T00:17:19.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 -- start start 2023-08-17T00:17:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f7014fff0 0x7f9f700c0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f701503d0 0x7f9f700a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 0x7f9f700a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:19.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700a84b0 con 0x7f9f70153da0 2023-08-17T00:17:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700c0d10 con 0x7f9f7014fff0 2023-08-17T00:17:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f754ff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7014e7e0 con 0x7f9f701503d0 2023-08-17T00:17:19.316 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 0x7f9f700a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:19.317 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 0x7f9f700a7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42886/0 (socket says 172.21.15.153:42886) 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6effd700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f7014fff0 0x7f9f700c0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 -- 172.21.15.153:0/1782280573 learned_addr learned my addr 172.21.15.153:0/1782280573 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6e7fc700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f701503d0 0x7f9f700a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 -- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f701503d0 msgr2=0x7f9f700a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f701503d0 0x7f9f700a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 -- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f7014fff0 msgr2=0x7f9f700c0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:19.318 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f7014fff0 0x7f9f700c0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:19.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 -- 172.21.15.153:0/1782280573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f600092a0 con 0x7f9f70153da0 2023-08-17T00:17:19.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.311+0000 7f9f6f7fe700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 0x7f9f700a7fc0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f9f68002230 tx=0x7f9f680015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:19.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.315+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800e4a0 con 0x7f9f70153da0 2023-08-17T00:17:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.315+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800e600 con 0x7f9f70153da0 2023-08-17T00:17:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.315+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f7014dbd0 con 0x7f9f70153da0 2023-08-17T00:17:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.315+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800e980 con 0x7f9f70153da0 2023-08-17T00:17:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.315+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7014e190 con 0x7f9f70153da0 2023-08-17T00:17:19.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.315+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7006b530 con 0x7f9f70153da0 2023-08-17T00:17:19.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.319+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f9f68019030 con 0x7f9f70153da0 2023-08-17T00:17:19.322 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.319+0000 7f9f56ffd700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f5c05a150 0x7f9f5c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.319+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f9f68073720 con 0x7f9f70153da0 2023-08-17T00:17:19.323 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.319+0000 7f9f6effd700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f5c05a150 0x7f9f5c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:19.324 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.319+0000 7f9f6effd700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f5c05a150 0x7f9f5c05c610 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f9f6000f470 tx=0x7f9f60019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:19.327 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.323+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9f68047120 con 0x7f9f70153da0 2023-08-17T00:17:19.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:19.519+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f9f700630b0 con 0x7f9f70153da0 2023-08-17T00:17:20.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.458+0000 7f9f56ffd700 1 -- 172.21.15.153:0/1782280573 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v149) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9f6804a740 con 0x7f9f70153da0 2023-08-17T00:17:20.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f5c05a150 msgr2=0x7f9f5c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f5c05a150 0x7f9f5c05c610 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f9f6000f470 tx=0x7f9f60019000).stop 2023-08-17T00:17:20.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 msgr2=0x7f9f700a7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 0x7f9f700a7fc0 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 rx=0x7f9f68002230 tx=0x7f9f680015e0).stop 2023-08-17T00:17:20.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 shutdown_connections 2023-08-17T00:17:20.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f9f5c05a150 0x7f9f5c05c610 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9f70153da0 0x7f9f700a7fc0 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f701503d0 0x7f9f700a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 --2- 172.21.15.153:0/1782280573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f7014fff0 0x7f9f700c0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 >> 172.21.15.153:0/1782280573 conn(0x7f9f700c7150 msgr2=0x7f9f700ab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:20.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 shutdown_connections 2023-08-17T00:17:20.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.462+0000 7f9f754ff700 1 -- 172.21.15.153:0/1782280573 wait complete. 2023-08-17T00:17:20.471 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked joinable; MDS may join as newly active. 2023-08-17T00:17:20.493 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:17:20.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 Processor -- start 2023-08-17T00:17:20.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 -- start start 2023-08-17T00:17:20.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151f70 0x7f1538065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:20.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1538065b50 0x7f1538064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:20.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1538061fa0 con 0x7f1538151b90 2023-08-17T00:17:20.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15380c3fb0 con 0x7f1538065b50 2023-08-17T00:17:20.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f153e1a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15381523d0 con 0x7f1538151f70 2023-08-17T00:17:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1538065b50 0x7f1538064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1538065b50 0x7f1538064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:42764/0 (socket says 172.21.15.153:42764) 2023-08-17T00:17:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 -- 172.21.15.153:0/2997727186 learned_addr learned my addr 172.21.15.153:0/2997727186 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f15377fe700 1 --1- 172.21.15.153:0/2997727186 >> v1:172.21.15.178:6789/0 conn(0x7f1538151b90 0x7f1538063290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42708/0 (socket says 172.21.15.153:42708) 2023-08-17T00:17:20.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f152effd700 1 --2- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151f70 0x7f1538065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:20.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 -- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151f70 msgr2=0x7f1538065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:20.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 --2- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151f70 0x7f1538065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 -- 172.21.15.153:0/2997727186 >> v1:172.21.15.178:6789/0 conn(0x7f1538151b90 legacy=0x7f1538063290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.646+0000 7f1537fff700 1 -- 172.21.15.153:0/2997727186 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15380621f0 con 0x7f1538065b50 2023-08-17T00:17:20.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f1537fff700 1 --2- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f1538064870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f1530006fd0 tx=0x7f15300090f0).ready entity=mon.1 client_cookie=27566ade97ab6b77 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f1536ffd700 1 -- 172.21.15.153:0/2997727186 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153000b580 con 0x7f1538065b50 2023-08-17T00:17:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f1536ffd700 1 -- 172.21.15.153:0/2997727186 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153000b6e0 con 0x7f1538065b50 2023-08-17T00:17:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f1536ffd700 1 -- 172.21.15.153:0/2997727186 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153000ba80 con 0x7f1538065b50 2023-08-17T00:17:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 -- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 msgr2=0x7f1538064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 --2- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f1538064870 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f1530006fd0 tx=0x7f15300090f0).stop 2023-08-17T00:17:20.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 -- 172.21.15.153:0/2997727186 shutdown_connections 2023-08-17T00:17:20.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 --2- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f1538064870 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 --2- 172.21.15.153:0/2997727186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151f70 0x7f1538065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 -- 172.21.15.153:0/2997727186 >> 172.21.15.153:0/2997727186 conn(0x7f15380c7150 msgr2=0x7f15380c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:20.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 -- 172.21.15.153:0/2997727186 shutdown_connections 2023-08-17T00:17:20.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.650+0000 7f153e1a9700 1 -- 172.21.15.153:0/2997727186 wait complete. 2023-08-17T00:17:20.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.654+0000 7f153e1a9700 1 Processor -- start 2023-08-17T00:17:20.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.654+0000 7f153e1a9700 1 -- start start 2023-08-17T00:17:20.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.654+0000 7f153e1a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f15380bf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:20.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151b90 0x7f153814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:20.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 0x7f15380abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:20.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15380c04a0 con 0x7f1538151f70 2023-08-17T00:17:20.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15380bf890 con 0x7f1538065b50 2023-08-17T00:17:20.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15380bfb70 con 0x7f1538151b90 2023-08-17T00:17:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 0x7f15380abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 0x7f15380abba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42902/0 (socket says 172.21.15.153:42902) 2023-08-17T00:17:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 -- 172.21.15.153:0/3588886056 learned_addr learned my addr 172.21.15.153:0/3588886056 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:20.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f15377fe700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f15380bf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f152effd700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151b90 0x7f153814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 -- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151b90 msgr2=0x7f153814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151b90 0x7f153814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 -- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 msgr2=0x7f15380bf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f15380bf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 -- 172.21.15.153:0/3588886056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530009370 con 0x7f1538151f70 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f15377fe700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f15380bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:20.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f1537fff700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 0x7f15380abba0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f153805e420 tx=0x7f1530017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530006d90 con 0x7f1538151f70 2023-08-17T00:17:20.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153000ba60 con 0x7f1538151f70 2023-08-17T00:17:20.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15380bfe50 con 0x7f1538151f70 2023-08-17T00:17:20.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153001c630 con 0x7f1538151f70 2023-08-17T00:17:20.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.658+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f153814e6a0 con 0x7f1538151f70 2023-08-17T00:17:20.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.662+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15380c0610 con 0x7f1538151f70 2023-08-17T00:17:20.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.662+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f153002c070 con 0x7f1538151f70 2023-08-17T00:17:20.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.662+0000 7f152ffff700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f151805a120 0x7f151805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:20.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.662+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f1530075d60 con 0x7f1538151f70 2023-08-17T00:17:20.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.666+0000 7f15377fe700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f151805a120 0x7f151805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:20.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.666+0000 7f15377fe700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f151805a120 0x7f151805c5e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f1528007500 tx=0x7f1528005ad0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:20.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.670+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f15300496b0 con 0x7f1538151f70 2023-08-17T00:17:20.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.862+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15380624d0 con 0x7f1538151f70 2023-08-17T00:17:20.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.862+0000 7f152ffff700 1 -- 172.21.15.153:0/3588886056 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f153002a070 con 0x7f1538151f70 2023-08-17T00:17:20.869 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:20.870 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:20.461581+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:replay","state_seq":1,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:17:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f151805a120 msgr2=0x7f151805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f151805a120 0x7f151805c5e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 rx=0x7f1528007500 tx=0x7f1528005ad0).stop 2023-08-17T00:17:20.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 msgr2=0x7f15380abba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:20.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 0x7f15380abba0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 rx=0x7f153805e420 tx=0x7f1530017000).stop 2023-08-17T00:17:20.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 shutdown_connections 2023-08-17T00:17:20.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f151805a120 0x7f151805c5e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1538151f70 0x7f15380abba0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1538151b90 0x7f153814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 --2- 172.21.15.153:0/3588886056 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1538065b50 0x7f15380bf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:20.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 >> 172.21.15.153:0/3588886056 conn(0x7f15380c7150 msgr2=0x7f153814eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:20.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 shutdown_connections 2023-08-17T00:17:20.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:20.866+0000 7f153e1a9700 1 -- 172.21.15.153:0/3588886056 wait complete. 2023-08-17T00:17:20.878 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 150 2023-08-17T00:17:21.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 150, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:17:04.011993+0000', 'modified': '2023-08-17T00:17:20.461581+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 193, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10353}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10353': {'gid': 10353, 'name': 'c', 'rank': 0, 'incarnation': 150, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.153:6835/214968761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 214968761}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 214968761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:17:21.296 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10353:up:replay 2023-08-17T00:17:22.298 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:17:22.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.458+0000 7fecaebf9700 1 Processor -- start 2023-08-17T00:17:22.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.458+0000 7fecaebf9700 1 -- start start 2023-08-17T00:17:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.458+0000 7fecaebf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca8068820 0x7feca8068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:22.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecaebf9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca81585a0 con 0x7feca80a8df0 2023-08-17T00:17:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecaebf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca8066400 con 0x7feca80a96d0 2023-08-17T00:17:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecaebf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80c1ba0 con 0x7feca8068820 2023-08-17T00:17:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecadbf7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7feca80a8df0 0x7feca80c1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:60604/0 (socket says 172.21.15.153:60604) 2023-08-17T00:17:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecadbf7700 1 -- 172.21.15.153:0/490912876 learned_addr learned my addr 172.21.15.153:0/490912876 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:22.466 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecad3f6700 1 --2- 172.21.15.153:0/490912876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca8068820 0x7feca8068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:22.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309825217 0 0) 0x7feca81585a0 con 0x7feca80a8df0 2023-08-17T00:17:22.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec940033f0 con 0x7feca80a8df0 2023-08-17T00:17:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329439156 0 0) 0x7feca8066400 con 0x7feca80a96d0 2023-08-17T00:17:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca81585a0 con 0x7feca80a96d0 2023-08-17T00:17:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecad3f6700 1 -- 172.21.15.153:0/490912876 >> v1:172.21.15.178:6789/0 conn(0x7feca80a96d0 legacy=0x7feca80a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecad3f6700 1 -- 172.21.15.153:0/490912876 >> v1:172.21.15.153:6789/0 conn(0x7feca80a8df0 legacy=0x7feca80c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecad3f6700 1 -- 172.21.15.153:0/490912876 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8069170 con 0x7feca8068820 2023-08-17T00:17:22.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecad3f6700 1 --2- 172.21.15.153:0/490912876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca8068820 0x7feca8068c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fec98009790 tx=0x7fec98009060).ready entity=mon.2 client_cookie=264d5566250e8c12 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:22.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800f510 con 0x7feca8068820 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800f670 con 0x7feca8068820 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecacbf5700 1 -- 172.21.15.153:0/490912876 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800f9f0 con 0x7feca8068820 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecaebf9700 1 -- 172.21.15.153:0/490912876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca8068820 msgr2=0x7feca8068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.462+0000 7fecaebf9700 1 --2- 172.21.15.153:0/490912876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca8068820 0x7feca8068c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fec98009790 tx=0x7fec98009060).stop 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 -- 172.21.15.153:0/490912876 shutdown_connections 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 --2- 172.21.15.153:0/490912876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca8068820 0x7feca8068c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 -- 172.21.15.153:0/490912876 >> 172.21.15.153:0/490912876 conn(0x7feca80c6620 msgr2=0x7feca80c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:22.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 -- 172.21.15.153:0/490912876 shutdown_connections 2023-08-17T00:17:22.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 -- 172.21.15.153:0/490912876 wait complete. 2023-08-17T00:17:22.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 Processor -- start 2023-08-17T00:17:22.472 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.466+0000 7fecaebf9700 1 -- start start 2023-08-17T00:17:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feca8068820 0x7feca8144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 0x7feca80b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:22.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca80a96d0 0x7feca80ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80ba990 con 0x7feca80a8df0 2023-08-17T00:17:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca816bf90 con 0x7feca8068820 2023-08-17T00:17:22.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca8169870 con 0x7feca80a96d0 2023-08-17T00:17:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 0x7feca80b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 0x7feca80b9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42908/0 (socket says 172.21.15.153:42908) 2023-08-17T00:17:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 -- 172.21.15.153:0/657212592 learned_addr learned my addr 172.21.15.153:0/657212592 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecadbf7700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feca8068820 0x7feca8144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:22.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecae3f8700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca80a96d0 0x7feca80ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 -- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca80a96d0 msgr2=0x7feca80ba4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca80a96d0 0x7feca80ba4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 -- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feca8068820 msgr2=0x7feca8144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feca8068820 0x7feca8144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 -- 172.21.15.153:0/657212592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec980092a0 con 0x7feca80a8df0 2023-08-17T00:17:22.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecad3f6700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 0x7feca80b9fb0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7feca80668e0 tx=0x7fec98017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:22.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800fe80 con 0x7feca80a8df0 2023-08-17T00:17:22.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800f7e0 con 0x7feca80a8df0 2023-08-17T00:17:22.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80be7c0 con 0x7feca80a8df0 2023-08-17T00:17:22.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.470+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9801b640 con 0x7feca80a8df0 2023-08-17T00:17:22.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.474+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca80bcf00 con 0x7feca80a8df0 2023-08-17T00:17:22.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.474+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca806b4c0 con 0x7feca80a8df0 2023-08-17T00:17:22.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.474+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fec9800f070 con 0x7feca80a8df0 2023-08-17T00:17:22.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.474+0000 7fec9dffb700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fec8c05a150 0x7fec8c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:22.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.478+0000 7fecadbf7700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fec8c05a150 0x7fec8c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:22.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.478+0000 7fecadbf7700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fec8c05a150 0x7fec8c05c610 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7feca40015b0 tx=0x7feca4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:22.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.478+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7fec98019e30 con 0x7feca80a8df0 2023-08-17T00:17:22.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.482+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fec98049360 con 0x7feca80a8df0 2023-08-17T00:17:22.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.678+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feca8064010 con 0x7feca80a8df0 2023-08-17T00:17:22.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fec9dffb700 1 -- 172.21.15.153:0/657212592 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) v1 ==== 95+0+4513 (secure 0 0 0) 0x7fec9804c980 con 0x7feca80a8df0 2023-08-17T00:17:22.690 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:22.690 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":152,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":152,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:22.473184+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:17:22.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fec8c05a150 msgr2=0x7fec8c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fec8c05a150 0x7fec8c05c610 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7feca40015b0 tx=0x7feca4009040).stop 2023-08-17T00:17:22.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 msgr2=0x7feca80b9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:22.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 0x7feca80b9fb0 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 rx=0x7feca80668e0 tx=0x7fec98017000).stop 2023-08-17T00:17:22.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 shutdown_connections 2023-08-17T00:17:22.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fec8c05a150 0x7fec8c05c610 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feca80a96d0 0x7feca80ba4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7feca80a8df0 0x7feca80b9fb0 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 --2- 172.21.15.153:0/657212592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feca8068820 0x7feca8144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:22.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 >> 172.21.15.153:0/657212592 conn(0x7feca80c6620 msgr2=0x7feca80a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:22.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 shutdown_connections 2023-08-17T00:17:22.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:22.682+0000 7fecaebf9700 1 -- 172.21.15.153:0/657212592 wait complete. 2023-08-17T00:17:22.693 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 152 2023-08-17T00:17:23.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 152, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:17:04.011993+0000', 'modified': '2023-08-17T00:17:22.473184+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 193, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10353}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10353': {'gid': 10353, 'name': 'c', 'rank': 0, 'incarnation': 150, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.153:6835/214968761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 214968761}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 214968761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:17:23.111 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10353:up:rejoin 2023-08-17T00:17:24.112 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:17:24.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.266+0000 7f89e97f9700 1 Processor -- start 2023-08-17T00:17:24.272 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.266+0000 7f89e97f9700 1 -- start start 2023-08-17T00:17:24.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e97f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89e40a8df0 0x7f89e40c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e97f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89e4068820 0x7f89e4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e97f9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e41585a0 con 0x7f89e4061fa0 2023-08-17T00:17:24.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e97f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e4066400 con 0x7f89e40a8df0 2023-08-17T00:17:24.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e97f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e4069170 con 0x7f89e4068820 2023-08-17T00:17:24.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89e40a8df0 0x7f89e40c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:24.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f89e40a8df0 0x7f89e40c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42924/0 (socket says 172.21.15.153:42924) 2023-08-17T00:17:24.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 -- 172.21.15.153:0/1112997264 learned_addr learned my addr 172.21.15.153:0/1112997264 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:24.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89db7fe700 1 --2- 172.21.15.153:0/1112997264 >> v2:172.21.15.178:3300/0 conn(0x7f89e4068820 0x7f89e4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:24.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 -- 172.21.15.153:0/1112997264 >> v2:172.21.15.178:3300/0 conn(0x7f89e4068820 msgr2=0x7f89e4068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:24.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 --2- 172.21.15.153:0/1112997264 >> v2:172.21.15.178:3300/0 conn(0x7f89e4068820 0x7f89e4068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 -- 172.21.15.153:0/1112997264 >> v1:172.21.15.178:6789/0 conn(0x7f89e4061fa0 legacy=0x7f89e4062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:24.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 -- 172.21.15.153:0/1112997264 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40b9d30 con 0x7f89e40a8df0 2023-08-17T00:17:24.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89db7fe700 1 --2- 172.21.15.153:0/1112997264 >> v2:172.21.15.178:3300/0 conn(0x7f89e4068820 0x7f89e4068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:24.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.270+0000 7f89e3fff700 1 --2- 172.21.15.153:0/1112997264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8df0 0x7f89e40c1490 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f89e40c2ef0 tx=0x7f89d4009060).ready entity=mon.0 client_cookie=b76bfbb44706e903 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:24.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e37fe700 1 -- 172.21.15.153:0/1112997264 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4005880 con 0x7f89e40a8df0 2023-08-17T00:17:24.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e37fe700 1 -- 172.21.15.153:0/1112997264 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d40059e0 con 0x7f89e40a8df0 2023-08-17T00:17:24.279 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e37fe700 1 -- 172.21.15.153:0/1112997264 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4005d60 con 0x7f89e40a8df0 2023-08-17T00:17:24.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 -- 172.21.15.153:0/1112997264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8df0 msgr2=0x7f89e40c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:24.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 --2- 172.21.15.153:0/1112997264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8df0 0x7f89e40c1490 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 rx=0x7f89e40c2ef0 tx=0x7f89d4009060).stop 2023-08-17T00:17:24.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 -- 172.21.15.153:0/1112997264 shutdown_connections 2023-08-17T00:17:24.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 --2- 172.21.15.153:0/1112997264 >> v2:172.21.15.178:3300/0 conn(0x7f89e4068820 0x7f89e4068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 --2- 172.21.15.153:0/1112997264 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e40a8df0 0x7f89e40c1490 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 -- 172.21.15.153:0/1112997264 >> 172.21.15.153:0/1112997264 conn(0x7f89e40c6620 msgr2=0x7f89e40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 -- 172.21.15.153:0/1112997264 shutdown_connections 2023-08-17T00:17:24.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 -- 172.21.15.153:0/1112997264 wait complete. 2023-08-17T00:17:24.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.274+0000 7f89e97f9700 1 Processor -- start 2023-08-17T00:17:24.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 -- start start 2023-08-17T00:17:24.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 0x7f89e4156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:24.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068820 0x7f89e40b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:24.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e40a8df0 0x7f89e40ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:24.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40bb8a0 con 0x7f89e4061fa0 2023-08-17T00:17:24.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40ba970 con 0x7f89e40a8df0 2023-08-17T00:17:24.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e97f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40bd760 con 0x7f89e4068820 2023-08-17T00:17:24.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 0x7f89e4156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:24.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 0x7f89e4156f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42932/0 (socket says 172.21.15.153:42932) 2023-08-17T00:17:24.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 -- 172.21.15.153:0/2099537222 learned_addr learned my addr 172.21.15.153:0/2099537222 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:24.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e8ff8700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e40a8df0 0x7f89e40ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:24.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89db7fe700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068820 0x7f89e40b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 -- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068820 msgr2=0x7f89e40b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:24.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068820 0x7f89e40b8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 -- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e40a8df0 msgr2=0x7f89e40ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:24.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e40a8df0 0x7f89e40ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 -- 172.21.15.153:0/2099537222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009300 con 0x7f89e4061fa0 2023-08-17T00:17:24.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e8ff8700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e40a8df0 0x7f89e40ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:24.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.278+0000 7f89e3fff700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 0x7f89e4156f50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f89d4009f30 tx=0x7f89d4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:24.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d40069e0 con 0x7f89e4061fa0 2023-08-17T00:17:24.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400b7b0 con 0x7f89e4061fa0 2023-08-17T00:17:24.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e40babc0 con 0x7f89e4061fa0 2023-08-17T00:17:24.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400bb70 con 0x7f89e4061fa0 2023-08-17T00:17:24.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e40bb180 con 0x7f89e4061fa0 2023-08-17T00:17:24.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e40c62b0 con 0x7f89e4061fa0 2023-08-17T00:17:24.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.282+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f89d400f070 con 0x7f89e4061fa0 2023-08-17T00:17:24.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.286+0000 7f89e0ff9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c405a150 0x7f89c405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:24.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.286+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f89d4075400 con 0x7f89e4061fa0 2023-08-17T00:17:24.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.286+0000 7f89db7fe700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c405a150 0x7f89c405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:24.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.286+0000 7f89db7fe700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c405a150 0x7f89c405c610 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f89e415b2f0 tx=0x7f89cc008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:24.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.290+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f89e40c62b0 con 0x7f89e4061fa0 2023-08-17T00:17:24.459 INFO:tasks.ceph.mds.c.smithi153.stderr:2023-08-17T00:17:24.454+0000 7f5ff6d2a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:17:24.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.490+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89e40c62b0 con 0x7f89e4061fa0 2023-08-17T00:17:24.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.494+0000 7f89e0ff9700 1 -- 172.21.15.153:0/2099537222 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f89e40c62b0 con 0x7f89e4061fa0 2023-08-17T00:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:17:24.499 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:23.488626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:17:24.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c405a150 msgr2=0x7f89c405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:24.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c405a150 0x7f89c405c610 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 rx=0x7f89e415b2f0 tx=0x7f89cc008040).stop 2023-08-17T00:17:24.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 msgr2=0x7f89e4156f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 0x7f89e4156f50 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 rx=0x7f89d4009f30 tx=0x7f89d4016000).stop 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 shutdown_connections 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f89c405a150 0x7f89c405c610 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89e40a8df0 0x7f89e40ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89e4068820 0x7f89e40b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 --2- 172.21.15.153:0/2099537222 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f89e4061fa0 0x7f89e4156f50 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 >> 172.21.15.153:0/2099537222 conn(0x7f89e40c6620 msgr2=0x7f89e40c0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:24.503 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 shutdown_connections 2023-08-17T00:17:24.504 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:24.498+0000 7f89e97f9700 1 -- 172.21.15.153:0/2099537222 wait complete. 2023-08-17T00:17:24.504 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 153 2023-08-17T00:17:24.925 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:17:04.011993+0000', 'modified': '2023-08-17T00:17:23.488626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 193, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10353}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10353': {'gid': 10353, 'name': 'c', 'rank': 0, 'incarnation': 150, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.153:6835/214968761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 214968761}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 214968761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:17:24.926 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:17:24.926 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T00:17:25.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878359e700 1 Processor -- start 2023-08-17T00:17:25.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878359e700 1 -- start start 2023-08-17T00:17:25.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8784068820 0x7f8784068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878359e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87841585a0 con 0x7f87840a96d0 2023-08-17T00:17:25.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878359e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8784066400 con 0x7f87840a8df0 2023-08-17T00:17:25.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87840c1ba0 con 0x7f8784068820 2023-08-17T00:17:25.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f8782d9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f87840a96d0 0x7f87840a9b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37890/0 (socket says 172.21.15.153:37890) 2023-08-17T00:17:25.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f8782d9d700 1 -- 172.21.15.153:0/2964688502 learned_addr learned my addr 172.21.15.153:0/2964688502 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:25.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2964688502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8784068820 0x7f8784068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878159a700 1 -- 172.21.15.153:0/2964688502 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908990786 0 0) 0x7f87841585a0 con 0x7f87840a96d0 2023-08-17T00:17:25.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878159a700 1 -- 172.21.15.153:0/2964688502 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f876c0033f0 con 0x7f87840a96d0 2023-08-17T00:17:25.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f878159a700 1 -- 172.21.15.153:0/2964688502 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078283006 0 0) 0x7f8784066400 con 0x7f87840a8df0 2023-08-17T00:17:25.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f8781d9b700 1 -- 172.21.15.153:0/2964688502 >> v1:172.21.15.178:6789/0 conn(0x7f87840a8df0 legacy=0x7f87840c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.082+0000 7f8781d9b700 1 -- 172.21.15.153:0/2964688502 >> v1:172.21.15.153:6789/0 conn(0x7f87840a96d0 legacy=0x7f87840a9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f8781d9b700 1 -- 172.21.15.153:0/2964688502 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8784069170 con 0x7f8784068820 2023-08-17T00:17:25.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2964688502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8784068820 0x7f8784068c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f8778009790 tx=0x7f8778009060).ready entity=mon.2 client_cookie=a310068bd5fdfb46 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878159a700 1 -- 172.21.15.153:0/2964688502 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800f510 con 0x7f8784068820 2023-08-17T00:17:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878159a700 1 -- 172.21.15.153:0/2964688502 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877800f670 con 0x7f8784068820 2023-08-17T00:17:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878159a700 1 -- 172.21.15.153:0/2964688502 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877800f9f0 con 0x7f8784068820 2023-08-17T00:17:25.091 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 -- 172.21.15.153:0/2964688502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8784068820 msgr2=0x7f8784068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 --2- 172.21.15.153:0/2964688502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8784068820 0x7f8784068c80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f8778009790 tx=0x7f8778009060).stop 2023-08-17T00:17:25.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 -- 172.21.15.153:0/2964688502 shutdown_connections 2023-08-17T00:17:25.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 --2- 172.21.15.153:0/2964688502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8784068820 0x7f8784068c80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.092 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 -- 172.21.15.153:0/2964688502 >> 172.21.15.153:0/2964688502 conn(0x7f87840c6620 msgr2=0x7f87840c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 -- 172.21.15.153:0/2964688502 shutdown_connections 2023-08-17T00:17:25.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.086+0000 7f878359e700 1 -- 172.21.15.153:0/2964688502 wait complete. 2023-08-17T00:17:25.094 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 Processor -- start 2023-08-17T00:17:25.095 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 -- start start 2023-08-17T00:17:25.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784068820 0x7f8784159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 0x7f878415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.096 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840a96d0 0x7f8784159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8784158ed0 con 0x7f87840a8df0 2023-08-17T00:17:25.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878416c6d0 con 0x7f8784068820 2023-08-17T00:17:25.097 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878359e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87841585a0 con 0x7f87840a96d0 2023-08-17T00:17:25.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f8781d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 0x7f878415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f8781d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 0x7f878415af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55448/0 (socket says 172.21.15.153:55448) 2023-08-17T00:17:25.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f8781d9b700 1 -- 172.21.15.153:0/1539268688 learned_addr learned my addr 172.21.15.153:0/1539268688 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.098 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f878259c700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784068820 0x7f8784159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.090+0000 7f8782d9d700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840a96d0 0x7f8784159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f8781d9b700 1 -- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840a96d0 msgr2=0x7f8784159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840a96d0 0x7f8784159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f8781d9b700 1 -- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784068820 msgr2=0x7f8784159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784068820 0x7f8784159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f8781d9b700 1 -- 172.21.15.153:0/1539268688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780092a0 con 0x7f87840a8df0 2023-08-17T00:17:25.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 0x7f878415af50 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f8778009e30 tx=0x7f8778017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f87727fc700 1 -- 172.21.15.153:0/1539268688 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780115d0 con 0x7f87840a8df0 2023-08-17T00:17:25.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f87727fc700 1 -- 172.21.15.153:0/1539268688 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877801e070 con 0x7f87840a8df0 2023-08-17T00:17:25.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8784158880 con 0x7f87840a8df0 2023-08-17T00:17:25.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f87727fc700 1 -- 172.21.15.153:0/1539268688 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87780119a0 con 0x7f87840a8df0 2023-08-17T00:17:25.100 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.094+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8784159850 con 0x7f87840a8df0 2023-08-17T00:17:25.101 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.098+0000 7f87727fc700 1 -- 172.21.15.153:0/1539268688 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f8778029020 con 0x7f87840a8df0 2023-08-17T00:17:25.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.098+0000 7f87727fc700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f876405a150 0x7f876405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.098+0000 7f87727fc700 1 -- 172.21.15.153:0/1539268688 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8778075490 con 0x7f87840a8df0 2023-08-17T00:17:25.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f878259c700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f876405a150 0x7f876405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 Processor -- start 2023-08-17T00:17:25.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 -- start start 2023-08-17T00:17:25.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f878259c700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f876405a150 0x7f876405c610 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f87840bf0c0 tx=0x7f8774009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x16d4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 0x168e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15fe5c0 con 0x1690380 2023-08-17T00:17:25.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1613e90 con 0x168ed90 2023-08-17T00:17:25.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x15da220 con 0x16d4b60 2023-08-17T00:17:25.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 0x168e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 0x168e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55458/0 (socket says 172.21.15.153:55458) 2023-08-17T00:17:25.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 -- 172.21.15.153:0/1903999270 learned_addr learned my addr 172.21.15.153:0/1903999270 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8782d9d700 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f878259c700 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x16d4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 -- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 msgr2=0x16d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x16d4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 -- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 msgr2=0x16df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 -- 172.21.15.153:0/1903999270 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x161f500 con 0x1690380 2023-08-17T00:17:25.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f878259c700 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x16d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 0x168e8a0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f877804c8f0 tx=0x7f8778075040).ready entity=mon.0 client_cookie=f1dfa07f59c96d98 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f87637fe700 1 -- 172.21.15.153:0/1903999270 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877804ca40 con 0x1690380 2023-08-17T00:17:25.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f87637fe700 1 -- 172.21.15.153:0/1903999270 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877804ae40 con 0x1690380 2023-08-17T00:17:25.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.102+0000 7f87637fe700 1 -- 172.21.15.153:0/1903999270 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8778073230 con 0x1690380 2023-08-17T00:17:25.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 -- 172.21.15.153:0/1903999270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 msgr2=0x168e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 0x168e8a0 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 rx=0x7f877804c8f0 tx=0x7f8778075040).stop 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 -- 172.21.15.153:0/1903999270 shutdown_connections 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1690380 0x168e8a0 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 --2- 172.21.15.153:0/1903999270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x16d4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 -- 172.21.15.153:0/1903999270 >> 172.21.15.153:0/1903999270 conn(0x1472550 msgr2=0x1693e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 -- 172.21.15.153:0/1903999270 shutdown_connections 2023-08-17T00:17:25.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 -- 172.21.15.153:0/1903999270 wait complete. 2023-08-17T00:17:25.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 -- start start 2023-08-17T00:17:25.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.106+0000 7f8792f56740 1 Processor -- start 2023-08-17T00:17:25.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16d3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16d6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 0x16b8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x15df110 con 0x16d4b60 2023-08-17T00:17:25.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x16be4c0 con 0x168ed90 2023-08-17T00:17:25.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16d7760 con 0x1690380 2023-08-17T00:17:25.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 10 client.0 ll_register_callbacks cb 0x164b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 0x16b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 0x16b8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55462/0 (socket says 172.21.15.153:55462) 2023-08-17T00:17:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 -- 172.21.15.153:0/2768071112 learned_addr learned my addr 172.21.15.153:0/2768071112 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f878259c700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16d3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 -- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 msgr2=0x16d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 -- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 msgr2=0x16d3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16d3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 -- 172.21.15.153:0/2768071112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8784159850 con 0x16d4b60 2023-08-17T00:17:25.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8782d9d700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 0x16b8700 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f877c0012e0 tx=0x7f877c009040).ready entity=mon.0 client_cookie=a6e6cfaf5b014df9 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:25.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8760ff9700 1 -- 172.21.15.153:0/2768071112 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c005d10 con 0x16d4b60 2023-08-17T00:17:25.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1609c60 con 0x16d4b60 2023-08-17T00:17:25.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8760ff9700 1 -- 172.21.15.153:0/2768071112 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f877c0070d0 con 0x16d4b60 2023-08-17T00:17:25.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8760ff9700 1 -- 172.21.15.153:0/2768071112 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f877c005e70 con 0x16d4b60 2023-08-17T00:17:25.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 10 client.10413 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:25.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x160cf80 con 0x16d4b60 2023-08-17T00:17:25.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8760ff9700 1 -- 172.21.15.153:0/2768071112 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1609c60 con 0x16d4b60 2023-08-17T00:17:25.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8760ff9700 1 -- 172.21.15.153:0/2768071112 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f877c0074a0 con 0x16d4b60 2023-08-17T00:17:25.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 10 client.10413 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:25.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 10 client.10413 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 20 client.10413 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16bf850 0x16be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 4 client.10413 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.110+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x16001b0 con 0x16bf850 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f878259c700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16bf850 0x16be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f878259c700 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16bf850 0x16be9d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a6f7d97897f03eca server_cookie=46d22ad204ab25f2 in_seq=0 out_seq=0 2023-08-17T00:17:25.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8760ff9700 10 client.10413 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8760ff9700 1 -- 172.21.15.153:0/2768071112 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x16001b0 con 0x16bf850 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8760ff9700 10 client.10413 handle_command_reply: tid=0 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 client.10413 shutdown 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 msgr2=0x16b8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 0x16b8700 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 rx=0x7f877c0012e0 tx=0x7f877c009040).stop 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 shutdown_connections 2023-08-17T00:17:25.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16bf850 0x16be9d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x16d4b60 0x16b8700 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8760ff9700 0 client.10413 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 --2- 172.21.15.153:0/2768071112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x168ed90 0x16d3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 >> 172.21.15.153:0/2768071112 conn(0x1472550 msgr2=0x16daad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 shutdown_connections 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 1 -- 172.21.15.153:0/2768071112 wait complete. 2023-08-17T00:17:25.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.114+0000 7f8792f56740 20 client.10413 trim_cache size 0 max 16384 2023-08-17T00:17:25.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 Processor -- start 2023-08-17T00:17:25.138 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 -- start start 2023-08-17T00:17:25.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16bdd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16bfc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16d4b60 0x1690760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x16d74f0 con 0x168ed90 2023-08-17T00:17:25.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1656db0 con 0x16d4b60 2023-08-17T00:17:25.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1691af0 con 0x1690380 2023-08-17T00:17:25.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f878259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16bdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.134+0000 7f878259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16bdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55472/0 (socket says 172.21.15.153:55472) 2023-08-17T00:17:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 -- 172.21.15.153:0/1853384466 learned_addr learned my addr 172.21.15.153:0/1853384466 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8782d9d700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16d4b60 0x1690760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16bfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 -- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 msgr2=0x16bfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16bfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 -- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16d4b60 msgr2=0x1690760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16d4b60 0x1690760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 -- 172.21.15.153:0/1853384466 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878415a520 con 0x168ed90 2023-08-17T00:17:25.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8782d9d700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16d4b60 0x1690760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8781d9b700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f878259c700 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16bdd30 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f8774007ce0 tx=0x7f8774002000).ready entity=mon.0 client_cookie=1c5016d7aad78122 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8763fff700 1 -- 172.21.15.153:0/1853384466 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774028030 con 0x168ed90 2023-08-17T00:17:25.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8763fff700 1 -- 172.21.15.153:0/1853384466 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877401e040 con 0x168ed90 2023-08-17T00:17:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8763fff700 1 -- 172.21.15.153:0/1853384466 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8774024930 con 0x168ed90 2023-08-17T00:17:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 -- 172.21.15.153:0/1853384466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 msgr2=0x16bdd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16bdd30 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 rx=0x7f8774007ce0 tx=0x7f8774002000).stop 2023-08-17T00:17:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 -- 172.21.15.153:0/1853384466 shutdown_connections 2023-08-17T00:17:25.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x16d4b60 0x1690760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1690380 0x16bfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 --2- 172.21.15.153:0/1853384466 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16bdd30 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 -- 172.21.15.153:0/1853384466 >> 172.21.15.153:0/1853384466 conn(0x1472550 msgr2=0x16d5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 -- 172.21.15.153:0/1853384466 shutdown_connections 2023-08-17T00:17:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.138+0000 7f8792f56740 1 -- 172.21.15.153:0/1853384466 wait complete. 2023-08-17T00:17:25.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 -- start start 2023-08-17T00:17:25.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 Processor -- start 2023-08-17T00:17:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1690380 0x173c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x168dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x168d290 con 0x168ed90 2023-08-17T00:17:25.162 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x173d240 con 0x1690380 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x16e5450 con 0x16d4b60 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f8792f56740 10 client.0 ll_register_callbacks cb 0x7f877c002150 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f878259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f878259c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55488/0 (socket says 172.21.15.153:55488) 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.142+0000 7f878259c700 1 -- 172.21.15.153:0/2826912353 learned_addr learned my addr 172.21.15.153:0/2826912353 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8782d9d700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x168dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1690380 0x173c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.163 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f878259c700 1 -- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 msgr2=0x168dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f878259c700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x168dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f878259c700 1 -- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1690380 msgr2=0x173c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f878259c700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1690380 0x173c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f878259c700 1 -- 172.21.15.153:0/2826912353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877400f040 con 0x168ed90 2023-08-17T00:17:25.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f878259c700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16b8290 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7f8774029040 tx=0x7f8774026070).ready entity=mon.0 client_cookie=4f4c3f46706cb5d1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 1 -- 172.21.15.153:0/2826912353 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877402e6f0 con 0x168ed90 2023-08-17T00:17:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 1 -- 172.21.15.153:0/2826912353 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f8774029070 con 0x168ed90 2023-08-17T00:17:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f877804ae40 con 0x168ed90 2023-08-17T00:17:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 1 -- 172.21.15.153:0/2826912353 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f877402ea60 con 0x168ed90 2023-08-17T00:17:25.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 10 client.10419 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x1608420 con 0x168ed90 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 1 -- 172.21.15.153:0/2826912353 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877804ae40 con 0x168ed90 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 1 -- 172.21.15.153:0/2826912353 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8774034020 con 0x168ed90 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 10 client.10419 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 10 client.10419 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 20 client.10419 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:25.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16b7220 0x16b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 4 client.10419 mds_command: new command op to 10353 tid=0[{"prefix": "status"}] 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "status"}) v1 -- 0x14c94e0 con 0x16b7220 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16b7220 0x16b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8781d9b700 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16b7220 0x16b7600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=90d31e3de5862d8 server_cookie=8ffbfdea91c8c485 in_seq=0 out_seq=0 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 10 client.10419 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 1 -- 172.21.15.153:0/2826912353 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x14c94e0 con 0x16b7220 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8760ff9700 10 client.10419 handle_command_reply: tid=0 2023-08-17T00:17:25.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.146+0000 7f8792f56740 1 client.10419 shutdown 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 msgr2=0x16b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16b8290 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 rx=0x7f8774029040 tx=0x7f8774026070).stop 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 shutdown_connections 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x16b7220 0x16b7600 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x16d4b60 0x168dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1690380 0x173c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8760ff9700 0 client.10419 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 --2- 172.21.15.153:0/2826912353 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x168ed90 0x16b8290 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 >> 172.21.15.153:0/2826912353 conn(0x1472550 msgr2=0x16d5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 shutdown_connections 2023-08-17T00:17:25.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 1 -- 172.21.15.153:0/2826912353 wait complete. 2023-08-17T00:17:25.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f8792f56740 20 client.10419 trim_cache size 0 max 16384 2023-08-17T00:17:25.169 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:17:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:17:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 10353, 2023-08-17T00:17:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:17:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:17:25.170 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:17:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 4.6850515919999998, 2023-08-17T00:17:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 153, 2023-08-17T00:17:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 193, 2023-08-17T00:17:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 193, 2023-08-17T00:17:25.171 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 6.6472299709999998 2023-08-17T00:17:25.171 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f876405a150 msgr2=0x7f876405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f876405a150 0x7f876405c610 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f87840bf0c0 tx=0x7f8774009040).stop 2023-08-17T00:17:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 msgr2=0x7f878415af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 0x7f878415af50 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 rx=0x7f8778009e30 tx=0x7f8778017000).stop 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 shutdown_connections 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f876405a150 0x7f876405c610 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87840a96d0 0x7f8784159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f87840a8df0 0x7f878415af50 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 --2- 172.21.15.153:0/1539268688 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8784068820 0x7f8784159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 >> 172.21.15.153:0/1539268688 conn(0x7f87840c6620 msgr2=0x7f8784157a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.173 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 shutdown_connections 2023-08-17T00:17:25.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.150+0000 7f878359e700 1 -- 172.21.15.153:0/1539268688 wait complete. 2023-08-17T00:17:25.177 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub start / recursive,repair 2023-08-17T00:17:25.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.338+0000 7f6ae1c1b700 1 Processor -- start 2023-08-17T00:17:25.343 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.338+0000 7f6ae1c1b700 1 -- start start 2023-08-17T00:17:25.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ae1c1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6adc153aa0 0x7f6adc0aa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ae1c1b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0c98d0 con 0x7f6adc0aacd0 2023-08-17T00:17:25.347 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ae1c1b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0c89e0 con 0x7f6adc1536c0 2023-08-17T00:17:25.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ae1c1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc0c8cc0 con 0x7f6adc153aa0 2023-08-17T00:17:25.348 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6adbfff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6adc0aacd0 0x7f6adc0c9d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:37896/0 (socket says 172.21.15.153:37896) 2023-08-17T00:17:25.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6adbfff700 1 -- 172.21.15.153:0/3734807716 learned_addr learned my addr 172.21.15.153:0/3734807716 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:25.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3734807716 >> v2:172.21.15.178:3300/0 conn(0x7f6adc153aa0 0x7f6adc0aa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970075971 0 0) 0x7f6adc0c98d0 con 0x7f6adc0aacd0 2023-08-17T00:17:25.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac40033f0 con 0x7f6adc0aacd0 2023-08-17T00:17:25.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037907053 0 0) 0x7f6adc0c89e0 con 0x7f6adc1536c0 2023-08-17T00:17:25.349 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc0c98d0 con 0x7f6adc1536c0 2023-08-17T00:17:25.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 162087968 0 0) 0x7f6ac40033f0 con 0x7f6adc0aacd0 2023-08-17T00:17:25.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 >> v2:172.21.15.178:3300/0 conn(0x7f6adc153aa0 msgr2=0x7f6adc0aa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 --2- 172.21.15.153:0/3734807716 >> v2:172.21.15.178:3300/0 conn(0x7f6adc153aa0 0x7f6adc0aa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 >> v1:172.21.15.178:6789/0 conn(0x7f6adc1536c0 legacy=0x7f6adc158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0c8fa0 con 0x7f6adc0aacd0 2023-08-17T00:17:25.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f6ad40017f0 con 0x7f6adc0aacd0 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3734807716 >> v2:172.21.15.178:3300/0 conn(0x7f6adc153aa0 0x7f6adc0aa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.342+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 >> v1:172.21.15.153:6789/0 conn(0x7f6adc0aacd0 legacy=0x7f6adc0c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6ac4004ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac4003630 0x7f6ac4003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac4003ff0 0x7f6ac400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0c8cc0 con 0x7f6ac4004ad0 2023-08-17T00:17:25.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400bfc0 con 0x7f6ac4003630 2023-08-17T00:17:25.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c180 con 0x7f6ac4003ff0 2023-08-17T00:17:25.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6ac4004ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac4003ff0 msgr2=0x7f6ac400b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac4003630 0x7f6ac4003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ac4003ff0 0x7f6ac400b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:17:25.356 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac4003630 msgr2=0x7f6ac4003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ac4003630 0x7f6ac4003ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3734807716 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac40033f0 con 0x7f6ac4004ad0 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adbfff700 1 -- 172.21.15.153:0/3734807716 reap_dead start 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6ac4004ed0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f6acc001890 tx=0x7f6acc007bb0).ready entity=mon.0 client_cookie=aea1bcdf3e6975c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc007020 con 0x7f6ac4004ad0 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc007180 con 0x7f6ac4004ad0 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ada7fc700 1 -- 172.21.15.153:0/3734807716 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc007500 con 0x7f6ac4004ad0 2023-08-17T00:17:25.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/3734807716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 msgr2=0x7f6ac4004ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6ac4004ed0 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 rx=0x7f6acc001890 tx=0x7f6acc007bb0).stop 2023-08-17T00:17:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/3734807716 shutdown_connections 2023-08-17T00:17:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/3734807716 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6ac4004ed0 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/3734807716 >> 172.21.15.153:0/3734807716 conn(0x7f6adc061fa0 msgr2=0x7f6adc0623b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/3734807716 shutdown_connections 2023-08-17T00:17:25.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.346+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/3734807716 wait complete. 2023-08-17T00:17:25.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 Processor -- start 2023-08-17T00:17:25.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 -- start start 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6adc0ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6adc1528d0 0x7f6adc1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6adc152d30 0x7f6adc1555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc167570 con 0x7f6ac4004ad0 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc1677c0 con 0x7f6adc152d30 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6ae1c1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc167aa0 con 0x7f6adc1528d0 2023-08-17T00:17:25.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.350+0000 7f6adb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6adc0ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6adc0ad900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55512/0 (socket says 172.21.15.153:55512) 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 -- 172.21.15.153:0/2830083208 learned_addr learned my addr 172.21.15.153:0/2830083208 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adbfff700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6adc152d30 0x7f6adc1555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adaffd700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6adc1528d0 0x7f6adc1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 -- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6adc1528d0 msgr2=0x7f6adc1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6adc1528d0 0x7f6adc1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 -- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6adc152d30 msgr2=0x7f6adc1555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6adc152d30 0x7f6adc1555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 -- 172.21.15.153:0/2830083208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc167d80 con 0x7f6ac4004ad0 2023-08-17T00:17:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6adc0ad900 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f6ac400bf90 tx=0x7f6acc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.367 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6ac37fe700 1 -- 172.21.15.153:0/2830083208 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc018030 con 0x7f6ac4004ad0 2023-08-17T00:17:25.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6ac37fe700 1 -- 172.21.15.153:0/2830083208 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc006ff0 con 0x7f6ac4004ad0 2023-08-17T00:17:25.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6ac37fe700 1 -- 172.21.15.153:0/2830083208 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc013670 con 0x7f6ac4004ad0 2023-08-17T00:17:25.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc168060 con 0x7f6ac4004ad0 2023-08-17T00:17:25.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.354+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0ca040 con 0x7f6ac4004ad0 2023-08-17T00:17:25.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.358+0000 7f6ac37fe700 1 -- 172.21.15.153:0/2830083208 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6acc01d070 con 0x7f6ac4004ad0 2023-08-17T00:17:25.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.358+0000 7f6ac37fe700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ac805a180 0x7f6ac805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.358+0000 7f6ac37fe700 1 -- 172.21.15.153:0/2830083208 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6acc0742a0 con 0x7f6ac4004ad0 2023-08-17T00:17:25.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.358+0000 7f6adaffd700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ac805a180 0x7f6ac805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.358+0000 7f6adaffd700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ac805a180 0x7f6ac805c640 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f6adc154f00 tx=0x7f6ad0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 Processor -- start 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 -- start start 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf1ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xf1ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf622f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xe6b270 con 0xf1f0d0 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xe8c100 con 0xf1a7e0 2023-08-17T00:17:25.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xe959e0 con 0xcfe7f0 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55526/0 (socket says 172.21.15.153:55526) 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 -- 172.21.15.153:0/797925522 learned_addr learned my addr 172.21.15.153:0/797925522 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf1ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adaffd700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xf1ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 -- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 msgr2=0xf1ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf1ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 -- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 msgr2=0xf1ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xf1ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adbfff700 1 -- 172.21.15.153:0/797925522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe990e0 con 0xf1f0d0 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adaffd700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xf1ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.362+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf1ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6adbfff700 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf622f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f6adc064720 tx=0x7f6ad4001930).ready entity=mon.0 client_cookie=97ab0c9cdee86380 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6ac0ff9700 1 -- 172.21.15.153:0/797925522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40020c0 con 0xf1f0d0 2023-08-17T00:17:25.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6ac0ff9700 1 -- 172.21.15.153:0/797925522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400f9c0 con 0xf1f0d0 2023-08-17T00:17:25.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6ac0ff9700 1 -- 172.21.15.153:0/797925522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400fd40 con 0xf1f0d0 2023-08-17T00:17:25.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 -- 172.21.15.153:0/797925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 msgr2=0xf622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf622f0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 rx=0x7f6adc064720 tx=0x7f6ad4001930).stop 2023-08-17T00:17:25.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 -- 172.21.15.153:0/797925522 shutdown_connections 2023-08-17T00:17:25.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf622f0 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xf1ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/797925522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf1ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 -- 172.21.15.153:0/797925522 >> 172.21.15.153:0/797925522 conn(0xedcd50 msgr2=0xf1f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 -- 172.21.15.153:0/797925522 shutdown_connections 2023-08-17T00:17:25.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 -- 172.21.15.153:0/797925522 wait complete. 2023-08-17T00:17:25.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 -- start start 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.366+0000 7f6aebf9c740 1 Processor -- start 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf5ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1f0d0 0xf43b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf74f60 con 0xcfe7f0 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xf75d30 con 0xf1f0d0 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf656c0 con 0xf1a7e0 2023-08-17T00:17:25.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 10 client.0 ll_register_callbacks cb 0xed6900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55542/0 (socket says 172.21.15.153:55542) 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3494470076 learned_addr learned my addr 172.21.15.153:0/3494470076 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1f0d0 0xf43b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 msgr2=0xf5ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf5ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf5ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1f0d0 msgr2=0xf43b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1f0d0 0xf43b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 -- 172.21.15.153:0/3494470076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad00092a0 con 0xcfe7f0 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1f0d0 0xf43b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf5ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 0xf651d0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7f6acc001e80 tx=0x7f6acc04d040).ready entity=mon.0 client_cookie=d4f2d615d1c51fd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6ab9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3494470076 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc04afe0 con 0xcfe7f0 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3494470076 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6acc04bb10 con 0xcfe7f0 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe95dc0 con 0xcfe7f0 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3494470076 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6acc0476d0 con 0xcfe7f0 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 10 client.10431 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0xe94580 con 0xcfe7f0 2023-08-17T00:17:25.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3494470076 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe95dc0 con 0xcfe7f0 2023-08-17T00:17:25.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3494470076 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6acc047830 con 0xcfe7f0 2023-08-17T00:17:25.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 10 client.10431 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:25.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 10 client.10431 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:25.383 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 20 client.10431 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf44550 0xf637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 4 client.10431 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe8c310 con 0xf44550 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.370+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf44550 0xf637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6ab9ffb700 10 client.10431 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf44550 0xf637c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ba60af955a03a1 server_cookie=8d23c1e0988e48b6 in_seq=0 out_seq=0 2023-08-17T00:17:25.384 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3494470076 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0xe8c310 con 0xf44550 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6ab9ffb700 10 client.10431 handle_command_reply: tid=0 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 client.10431 shutdown 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 msgr2=0xf651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 0xf651d0 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 rx=0x7f6acc001e80 tx=0x7f6acc04d040).stop 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 shutdown_connections 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf44550 0xf637c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1f0d0 0xf43b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.385 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6ab9ffb700 0 client.10431 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf5ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3494470076 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 >> 172.21.15.153:0/3494470076 conn(0xedcd50 msgr2=0xf62940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 shutdown_connections 2023-08-17T00:17:25.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3494470076 wait complete. 2023-08-17T00:17:25.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.374+0000 7f6aebf9c740 20 client.10431 trim_cache size 0 max 16384 2023-08-17T00:17:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 Processor -- start 2023-08-17T00:17:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 -- start start 2023-08-17T00:17:25.400 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xfbeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf47af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xf47730 con 0xf1f0d0 2023-08-17T00:17:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbf3e0 con 0xf1a7e0 2023-08-17T00:17:25.401 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.394+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf7bef0 con 0xcfe7f0 2023-08-17T00:17:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf47af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf47af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55558/0 (socket says 172.21.15.153:55558) 2023-08-17T00:17:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 -- 172.21.15.153:0/3456629163 learned_addr learned my addr 172.21.15.153:0/3456629163 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xfbeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.402 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 -- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 msgr2=0xf651d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 -- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 msgr2=0xfbeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xfbeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 -- 172.21.15.153:0/3456629163 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0c08e0 con 0xf1f0d0 2023-08-17T00:17:25.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xfbeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:25.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf47af0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f6ad4001930 tx=0x7f6ad4016000).ready entity=mon.0 client_cookie=e15b14613fc54055 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6ac17fa700 1 -- 172.21.15.153:0/3456629163 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40020a0 con 0xf1f0d0 2023-08-17T00:17:25.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6ac17fa700 1 -- 172.21.15.153:0/3456629163 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4001a10 con 0xf1f0d0 2023-08-17T00:17:25.405 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6ac17fa700 1 -- 172.21.15.153:0/3456629163 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad400fd40 con 0xf1f0d0 2023-08-17T00:17:25.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3456629163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 msgr2=0xf47af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf47af0 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 rx=0x7f6ad4001930 tx=0x7f6ad4016000).stop 2023-08-17T00:17:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3456629163 shutdown_connections 2023-08-17T00:17:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf47af0 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xf1a7e0 0xfbeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3456629163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xcfe7f0 0xf651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3456629163 >> 172.21.15.153:0/3456629163 conn(0xedcd50 msgr2=0xf1df00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3456629163 shutdown_connections 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3456629163 wait complete. 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 -- start start 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.398+0000 7f6aebf9c740 1 Processor -- start 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xcfe7f0 0xfbb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf62af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf62fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbc2e0 con 0xf1f0d0 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0xfbbfb0 con 0xcfe7f0 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0xf41120 con 0xf1a7e0 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 10 client.0 ll_register_callbacks cb 0xf1de50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf62fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf62fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55568/0 (socket says 172.21.15.153:55568) 2023-08-17T00:17:25.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 -- 172.21.15.153:0/3997132376 learned_addr learned my addr 172.21.15.153:0/3997132376 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adaffd700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf62af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xcfe7f0 0xfbb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 -- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 msgr2=0xf62af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf62af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 -- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xcfe7f0 msgr2=0xfbb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xcfe7f0 0xfbb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 -- 172.21.15.153:0/3997132376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad000e030 con 0xf1f0d0 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xcfe7f0 0xfbb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6adbfff700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf62fe0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f6ad4001960 tx=0x7f6ad401f000).ready entity=mon.0 client_cookie=804636fa82706308 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6ab9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3997132376 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4028070 con 0xf1f0d0 2023-08-17T00:17:25.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ad400f9c0 con 0xf1f0d0 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3997132376 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f6ad40020a0 con 0xf1f0d0 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3997132376 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ad4014a80 con 0xf1f0d0 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 10 client.10437 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.402+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0xe990e0 con 0xf1f0d0 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3997132376 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad400f9c0 con 0xf1f0d0 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3997132376 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6ad4021030 con 0xf1f0d0 2023-08-17T00:17:25.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 10 client.10437 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 10 client.10437 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 20 client.10437 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf45130 0xf47980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 4 client.10437 mds_command: new command op to 10353 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0xd55780 con 0xf45130 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf45130 0xf47980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6ab9ffb700 10 client.10437 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6adb7fe700 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf45130 0xf47980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9db6f0ee342e1dc3 server_cookie=ae35e360eef11ced in_seq=0 out_seq=0 2023-08-17T00:17:25.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6ab9ffb700 1 -- 172.21.15.153:0/3997132376 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0xd55780 con 0xf45130 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6ab9ffb700 10 client.10437 handle_command_reply: tid=0 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 client.10437 shutdown 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 msgr2=0xf62fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf62fe0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 rx=0x7f6ad4001960 tx=0x7f6ad401f000).stop 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 shutdown_connections 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0xf45130 0xf47980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0xf1f0d0 0xf62fe0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0xf1a7e0 0xf62af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6ab9ffb700 0 client.10437 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 --2- 172.21.15.153:0/3997132376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0xcfe7f0 0xfbb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 >> 172.21.15.153:0/3997132376 conn(0xedcd50 msgr2=0xf44a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 shutdown_connections 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 1 -- 172.21.15.153:0/3997132376 wait complete. 2023-08-17T00:17:25.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.406+0000 7f6aebf9c740 20 client.10437 trim_cache size 0 max 16384 2023-08-17T00:17:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:25.418 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:17:25.418 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "0f17cc2f-eb37-4c14-91a4-41588d75c907", 2023-08-17T00:17:25.418 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:17:25.418 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ac805a180 msgr2=0x7f6ac805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ac805a180 0x7f6ac805c640 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f6adc154f00 tx=0x7f6ad0008040).stop 2023-08-17T00:17:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 msgr2=0x7f6adc0ad900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6adc0ad900 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 rx=0x7f6ac400bf90 tx=0x7f6acc015000).stop 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 shutdown_connections 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6ac805a180 0x7f6ac805c640 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6adc152d30 0x7f6adc1555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6adc1528d0 0x7f6adc1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 --2- 172.21.15.153:0/2830083208 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6ac4004ad0 0x7f6adc0ad900 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 >> 172.21.15.153:0/2830083208 conn(0x7f6adc061fa0 msgr2=0x7f6adc0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 shutdown_connections 2023-08-17T00:17:25.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.410+0000 7f6ae1c1b700 1 -- 172.21.15.153:0/2830083208 wait complete. 2023-08-17T00:17:25.434 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-08-17T00:17:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.594+0000 7f33f9369700 1 Processor -- start 2023-08-17T00:17:25.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.594+0000 7f33f9369700 1 -- start start 2023-08-17T00:17:25.603 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f9369700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33f40c7910 0x7f33f40c1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f9369700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33f4153d10 0x7f33f40a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f9369700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f4157660 con 0x7f33f4153930 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f9369700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40a9de0 con 0x7f33f4153d10 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f9369700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40aa060 con 0x7f33f40c7910 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33f4153d10 0x7f33f40a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f33f4153d10 0x7f33f40a98f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55580/0 (socket says 172.21.15.153:55580) 2023-08-17T00:17:25.604 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 -- 172.21.15.153:0/4086843135 learned_addr learned my addr 172.21.15.153:0/4086843135 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f27fc700 1 --2- 172.21.15.153:0/4086843135 >> v2:172.21.15.178:3300/0 conn(0x7f33f40c7910 0x7f33f40c1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.605 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 -- 172.21.15.153:0/4086843135 >> v2:172.21.15.178:3300/0 conn(0x7f33f40c7910 msgr2=0x7f33f40c1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 --2- 172.21.15.153:0/4086843135 >> v2:172.21.15.178:3300/0 conn(0x7f33f40c7910 0x7f33f40c1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 -- 172.21.15.153:0/4086843135 >> v1:172.21.15.178:6789/0 conn(0x7f33f4153930 legacy=0x7f33f40c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 -- 172.21.15.153:0/4086843135 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f41578b0 con 0x7f33f4153d10 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f37fe700 1 --2- 172.21.15.153:0/4086843135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f40a98f0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f33f4084140 tx=0x7f33ec009840).ready entity=mon.0 client_cookie=244a0e7e62d352f1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f1ffb700 1 -- 172.21.15.153:0/4086843135 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00e070 con 0x7f33f4153d10 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f1ffb700 1 -- 172.21.15.153:0/4086843135 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec00ba10 con 0x7f33f4153d10 2023-08-17T00:17:25.606 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.598+0000 7f33f1ffb700 1 -- 172.21.15.153:0/4086843135 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec00bd90 con 0x7f33f4153d10 2023-08-17T00:17:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 -- 172.21.15.153:0/4086843135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 msgr2=0x7f33f40a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 --2- 172.21.15.153:0/4086843135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f40a98f0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 rx=0x7f33f4084140 tx=0x7f33ec009840).stop 2023-08-17T00:17:25.607 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 -- 172.21.15.153:0/4086843135 shutdown_connections 2023-08-17T00:17:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 --2- 172.21.15.153:0/4086843135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f40a98f0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 --2- 172.21.15.153:0/4086843135 >> v2:172.21.15.178:3300/0 conn(0x7f33f40c7910 0x7f33f40c1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 -- 172.21.15.153:0/4086843135 >> 172.21.15.153:0/4086843135 conn(0x7f33f40635c0 msgr2=0x7f33f40639d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 -- 172.21.15.153:0/4086843135 shutdown_connections 2023-08-17T00:17:25.608 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 -- 172.21.15.153:0/4086843135 wait complete. 2023-08-17T00:17:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.602+0000 7f33f9369700 1 Processor -- start 2023-08-17T00:17:25.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 -- start start 2023-08-17T00:17:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33f40c7910 0x7f33f4156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33f4153930 0x7f33f41542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.611 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f4142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4156340 con 0x7f33f4153d10 2023-08-17T00:17:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41547e0 con 0x7f33f40c7910 2023-08-17T00:17:25.612 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f9369700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4155d80 con 0x7f33f4153930 2023-08-17T00:17:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f4142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f4142260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55590/0 (socket says 172.21.15.153:55590) 2023-08-17T00:17:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 -- 172.21.15.153:0/3158038201 learned_addr learned my addr 172.21.15.153:0/3158038201 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33f40c7910 0x7f33f4156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f27fc700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33f4153930 0x7f33f41542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 -- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33f4153930 msgr2=0x7f33f41542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33f4153930 0x7f33f41542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 -- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33f40c7910 msgr2=0x7f33f4156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33f40c7910 0x7f33f4156c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 -- 172.21.15.153:0/3158038201 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec009ae0 con 0x7f33f4153d10 2023-08-17T00:17:25.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.606+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f4142260 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f33f4083e80 tx=0x7f33ec009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33daffd700 1 -- 172.21.15.153:0/3158038201 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec013e60 con 0x7f33f4153d10 2023-08-17T00:17:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33daffd700 1 -- 172.21.15.153:0/3158038201 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec0092e0 con 0x7f33f4153d10 2023-08-17T00:17:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f4156060 con 0x7f33f4153d10 2023-08-17T00:17:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33daffd700 1 -- 172.21.15.153:0/3158038201 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec01e470 con 0x7f33f4153d10 2023-08-17T00:17:25.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f4142750 con 0x7f33f4153d10 2023-08-17T00:17:25.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33daffd700 1 -- 172.21.15.153:0/3158038201 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f33ec025030 con 0x7f33f4153d10 2023-08-17T00:17:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.610+0000 7f33daffd700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33e005a150 0x7f33e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.617 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.614+0000 7f33daffd700 1 -- 172.21.15.153:0/3158038201 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f33ec075760 con 0x7f33f4153d10 2023-08-17T00:17:25.618 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.614+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33e005a150 0x7f33e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.614+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33e005a150 0x7f33e005c610 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f33e4007fd0 tx=0x7f33e4007d70).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.614+0000 7f340372f740 1 Processor -- start 2023-08-17T00:17:25.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.614+0000 7f340372f740 1 -- start start 2023-08-17T00:17:25.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a255b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a26f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19761a0 con 0x1a2a330 2023-08-17T00:17:25.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a6c9b0 con 0x1a6bdd0 2023-08-17T00:17:25.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a50960 con 0x1a6b9f0 2023-08-17T00:17:25.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a255b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55606/0 (socket says 172.21.15.153:55606) 2023-08-17T00:17:25.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 -- 172.21.15.153:0/57301542 learned_addr learned my addr 172.21.15.153:0/57301542 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f37fe700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a26f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 -- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 msgr2=0x1a50050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 -- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 msgr2=0x1a26f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a26f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 -- 172.21.15.153:0/57301542 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19a4010 con 0x1a2a330 2023-08-17T00:17:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f37fe700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a26f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:25.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33f27fc700 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a255b0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f33e800b900 tx=0x7f33e8008040).ready entity=mon.0 client_cookie=2cb1a91354e08b48 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33d3fff700 1 -- 172.21.15.153:0/57301542 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e800bea0 con 0x1a2a330 2023-08-17T00:17:25.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33d3fff700 1 -- 172.21.15.153:0/57301542 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800b530 con 0x1a2a330 2023-08-17T00:17:25.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f33d3fff700 1 -- 172.21.15.153:0/57301542 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8010b00 con 0x1a2a330 2023-08-17T00:17:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 -- 172.21.15.153:0/57301542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 msgr2=0x1a255b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a255b0 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 rx=0x7f33e800b900 tx=0x7f33e8008040).stop 2023-08-17T00:17:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 -- 172.21.15.153:0/57301542 shutdown_connections 2023-08-17T00:17:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a26f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a255b0 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.627 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 --2- 172.21.15.153:0/57301542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.618+0000 7f340372f740 1 -- 172.21.15.153:0/57301542 >> 172.21.15.153:0/57301542 conn(0x1809680 msgr2=0x1a70f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 -- 172.21.15.153:0/57301542 shutdown_connections 2023-08-17T00:17:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 -- 172.21.15.153:0/57301542 wait complete. 2023-08-17T00:17:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 -- start start 2023-08-17T00:17:25.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 Processor -- start 2023-08-17T00:17:25.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2a330 0x1a4d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a52e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a53320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a53810 con 0x1a6bdd0 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a55a70 con 0x1a2a330 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a51aa0 con 0x1a6b9f0 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f340372f740 10 client.0 ll_register_callbacks cb 0x19e1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a53320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a53320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55614/0 (socket says 172.21.15.153:55614) 2023-08-17T00:17:25.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 -- 172.21.15.153:0/3326729223 learned_addr learned my addr 172.21.15.153:0/3326729223 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f27fc700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a52e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2a330 0x1a4d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 -- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 msgr2=0x1a52e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a52e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 -- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2a330 msgr2=0x1a4d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2a330 0x1a4d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.622+0000 7f33f37fe700 1 -- 172.21.15.153:0/3326729223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e800e040 con 0x1a6bdd0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a53320 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f33ec00b9e0 tx=0x7f33ec075040).ready entity=mon.0 client_cookie=a654986e5e771199 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 1 -- 172.21.15.153:0/3326729223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec04e040 con 0x1a6bdd0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 1 -- 172.21.15.153:0/3326729223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f33ec048f00 con 0x1a6bdd0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1972200 con 0x1a6bdd0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 1 -- 172.21.15.153:0/3326729223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33ec0525c0 con 0x1a6bdd0 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 10 client.10449 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:25.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x199f4b0 con 0x1a6bdd0 2023-08-17T00:17:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 1 -- 172.21.15.153:0/3326729223 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1972200 con 0x1a6bdd0 2023-08-17T00:17:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 1 -- 172.21.15.153:0/3326729223 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f33ec051070 con 0x1a6bdd0 2023-08-17T00:17:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 10 client.10449 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 10 client.10449 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 20 client.10449 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:25.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1a50af0 0x1a28130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 4 client.10449 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x19a0cf0 con 0x1a50af0 2023-08-17T00:17:25.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1a50af0 0x1a28130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1a50af0 0x1a28130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=7f7bd694b89c1115 server_cookie=740ff777b841affc in_seq=0 out_seq=0 2023-08-17T00:17:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 10 client.10449 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 1 -- 172.21.15.153:0/3326729223 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x19a0cf0 con 0x1a50af0 2023-08-17T00:17:25.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f33d17fa700 10 client.10449 handle_command_reply: tid=0 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 client.10449 shutdown 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 msgr2=0x1a53320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.626+0000 7f340372f740 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a53320 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 rx=0x7f33ec00b9e0 tx=0x7f33ec075040).stop 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 shutdown_connections 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1a50af0 0x1a28130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a53320 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a52e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 --2- 172.21.15.153:0/3326729223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a2a330 0x1a4d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 >> 172.21.15.153:0/3326729223 conn(0x1809680 msgr2=0x1a6e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f33d17fa700 0 client.10449 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 shutdown_connections 2023-08-17T00:17:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 1 -- 172.21.15.153:0/3326729223 wait complete. 2023-08-17T00:17:25.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.630+0000 7f340372f740 20 client.10449 trim_cache size 0 max 16384 2023-08-17T00:17:25.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 Processor -- start 2023-08-17T00:17:25.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 -- start start 2023-08-17T00:17:25.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a549b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a51410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x197ff60 con 0x1a2a330 2023-08-17T00:17:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a53430 con 0x1a6bdd0 2023-08-17T00:17:25.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19ed240 con 0x1a6b9f0 2023-08-17T00:17:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f33f2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f33f2ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55618/0 (socket says 172.21.15.153:55618) 2023-08-17T00:17:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.646+0000 7f33f2ffd700 1 -- 172.21.15.153:0/1765388403 learned_addr learned my addr 172.21.15.153:0/1765388403 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f37fe700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a51410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f27fc700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f2ffd700 1 -- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 msgr2=0x1a50f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f2ffd700 1 -- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 msgr2=0x1a51410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a51410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f2ffd700 1 -- 172.21.15.153:0/1765388403 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f40c0150 con 0x1a2a330 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f37fe700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a51410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:25.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f27fc700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:17:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a549b0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x1a55640 tx=0x7f33e4014000).ready entity=mon.0 client_cookie=24506605a372f6a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33d8ff9700 1 -- 172.21.15.153:0/1765388403 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e400fe70 con 0x1a2a330 2023-08-17T00:17:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33d8ff9700 1 -- 172.21.15.153:0/1765388403 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4025b10 con 0x1a2a330 2023-08-17T00:17:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f33d8ff9700 1 -- 172.21.15.153:0/1765388403 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4025e90 con 0x1a2a330 2023-08-17T00:17:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 -- 172.21.15.153:0/1765388403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 msgr2=0x1a549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a549b0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 rx=0x1a55640 tx=0x7f33e4014000).stop 2023-08-17T00:17:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 -- 172.21.15.153:0/1765388403 shutdown_connections 2023-08-17T00:17:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a6bdd0 0x1a51410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1a50f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 --2- 172.21.15.153:0/1765388403 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a2a330 0x1a549b0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 -- 172.21.15.153:0/1765388403 >> 172.21.15.153:0/1765388403 conn(0x1809680 msgr2=0x1a866e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 -- 172.21.15.153:0/1765388403 shutdown_connections 2023-08-17T00:17:25.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 -- 172.21.15.153:0/1765388403 wait complete. 2023-08-17T00:17:25.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.650+0000 7f340372f740 1 -- start start 2023-08-17T00:17:25.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 Processor -- start 2023-08-17T00:17:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1ad3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a4d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a252d0 0x1a4d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ad5710 con 0x1a6bdd0 2023-08-17T00:17:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a56e00 con 0x1a252d0 2023-08-17T00:17:25.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ad3ef0 con 0x1a6b9f0 2023-08-17T00:17:25.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f340372f740 10 client.0 ll_register_callbacks cb 0x7f33ec04cd10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:25.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a4d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a4d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:55630/0 (socket says 172.21.15.153:55630) 2023-08-17T00:17:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 -- 172.21.15.153:0/3729173266 learned_addr learned my addr 172.21.15.153:0/3729173266 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1ad3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f37fe700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a252d0 0x1a4d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 -- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 msgr2=0x1ad3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1ad3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 -- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a252d0 msgr2=0x1a4d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a252d0 0x1a4d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 -- 172.21.15.153:0/3729173266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e400fb20 con 0x1a6bdd0 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33f27fc700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a4d460 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f33e8015000 tx=0x7f33e8008040).ready entity=mon.0 client_cookie=17e551c5c1224f66 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.654+0000 7f33d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 1 -- 172.21.15.153:0/3729173266 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8022070 con 0x1a6bdd0 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33e800b530 con 0x1a6bdd0 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 1 -- 172.21.15.153:0/3729173266 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(193..193 src has 1..193) v4 ==== 6207+0+0 (secure 0 0 0) 0x7f33e8005880 con 0x1a6bdd0 2023-08-17T00:17:25.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 1 -- 172.21.15.153:0/3729173266 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33e8005c50 con 0x1a6bdd0 2023-08-17T00:17:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 10 client.10455 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:25.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x199f200 con 0x1a6bdd0 2023-08-17T00:17:25.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 1 -- 172.21.15.153:0/3729173266 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e800b530 con 0x1a6bdd0 2023-08-17T00:17:25.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 1 -- 172.21.15.153:0/3729173266 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f33e8006040 con 0x1a6bdd0 2023-08-17T00:17:25.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 10 client.10455 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:25.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 10 client.10455 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:25.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 20 client.10455 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:25.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1ad43d0 0x1ad47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:25.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 4 client.10455 mds_command: new command op to 10353 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1997240 con 0x1ad43d0 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1ad43d0 0x1ad47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33f2ffd700 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1ad43d0 0x1ad47e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=a6d2f426abecfef0 server_cookie=42990c18916f537e in_seq=0 out_seq=0 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 10 client.10455 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 1 -- 172.21.15.153:0/3729173266 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x1997240 con 0x1ad43d0 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 10 client.10455 handle_command_reply: tid=0 2023-08-17T00:17:25.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 client.10455 shutdown 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 msgr2=0x1a4d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a4d460 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 rx=0x7f33e8015000 tx=0x7f33e8008040).stop 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 shutdown_connections 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1ad43d0 0x1ad47e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1a252d0 0x1a4d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f33d17fa700 0 client.10455 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1a6bdd0 0x1a4d460 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 --2- 172.21.15.153:0/3729173266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1a6b9f0 0x1ad3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 >> 172.21.15.153:0/3729173266 conn(0x1809680 msgr2=0x1a50f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 shutdown_connections 2023-08-17T00:17:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 1 -- 172.21.15.153:0/3729173266 wait complete. 2023-08-17T00:17:25.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.658+0000 7f340372f740 20 client.10455 trim_cache size 0 max 16384 2023-08-17T00:17:25.671 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: "0f17cc2f-eb37-4c14-91a4-41588d75c907": { 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "0f17cc2f-eb37-4c14-91a4-41588d75c907", 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive,repair" 2023-08-17T00:17:25.672 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:25.673 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:25.673 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:25.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33e005a150 msgr2=0x7f33e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33e005a150 0x7f33e005c610 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 rx=0x7f33e4007fd0 tx=0x7f33e4007d70).stop 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 msgr2=0x7f33f4142260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f4142260 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 rx=0x7f33f4083e80 tx=0x7f33ec009840).stop 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 shutdown_connections 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f33e005a150 0x7f33e005c610 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f33f4153d10 0x7f33f4142260 unknown :-1 s=CLOSED pgs=2032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33f4153930 0x7f33f41542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 --2- 172.21.15.153:0/3158038201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33f40c7910 0x7f33f4156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:25.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 >> 172.21.15.153:0/3158038201 conn(0x7f33f40635c0 msgr2=0x7f33f40c0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:25.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 shutdown_connections 2023-08-17T00:17:25.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:25.662+0000 7f33f9369700 1 -- 172.21.15.153:0/3158038201 wait complete. 2023-08-17T00:17:25.685 INFO:tasks.cephfs.filesystem:scrub status for tag:0f17cc2f-eb37-4c14-91a4-41588d75c907 - {'path': '/', 'tag': '0f17cc2f-eb37-4c14-91a4-41588d75c907', 'options': 'recursive,repair'} 2023-08-17T00:17:47.924 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:17:47.932 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:17:55.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-08-17T00:17:55.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 Processor -- start 2023-08-17T00:17:55.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 -- start start 2023-08-17T00:17:55.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814151b90 0x7f9814151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9814063290 0x7f9814065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9814061fa0 con 0x7f9814065b50 2023-08-17T00:17:55.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140c3fb0 con 0x7f9814063290 2023-08-17T00:17:55.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981c2f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9814152460 con 0x7f9814151b90 2023-08-17T00:17:55.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.850+0000 7f981a88e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f9814065b50 0x7f9814064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35930/0 (socket says 172.21.15.153:35930) 2023-08-17T00:17:55.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981988c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9814063290 0x7f9814065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981a88e700 1 -- 172.21.15.153:0/3475175023 learned_addr learned my addr 172.21.15.153:0/3475175023 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:17:55.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981a08d700 1 --2- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814151b90 0x7f9814151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981988c700 1 -- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814151b90 msgr2=0x7f9814151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981988c700 1 --2- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814151b90 0x7f9814151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981988c700 1 -- 172.21.15.153:0/3475175023 >> v1:172.21.15.153:6789/0 conn(0x7f9814065b50 legacy=0x7f9814064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981988c700 1 -- 172.21.15.153:0/3475175023 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140621f0 con 0x7f9814063290 2023-08-17T00:17:55.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981988c700 1 --2- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814063290 0x7f9814065660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f9804009760 tx=0x7f9804009060).ready entity=mon.1 client_cookie=3dda54049a1b9b31 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981908b700 1 -- 172.21.15.153:0/3475175023 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400f510 con 0x7f9814063290 2023-08-17T00:17:55.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981908b700 1 -- 172.21.15.153:0/3475175023 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980400f670 con 0x7f9814063290 2023-08-17T00:17:55.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981908b700 1 -- 172.21.15.153:0/3475175023 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980400f9f0 con 0x7f9814063290 2023-08-17T00:17:55.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 -- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814063290 msgr2=0x7f9814065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 --2- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814063290 0x7f9814065660 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7f9804009760 tx=0x7f9804009060).stop 2023-08-17T00:17:55.864 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 -- 172.21.15.153:0/3475175023 shutdown_connections 2023-08-17T00:17:55.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 --2- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814063290 0x7f9814065660 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 --2- 172.21.15.153:0/3475175023 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814151b90 0x7f9814151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 -- 172.21.15.153:0/3475175023 >> 172.21.15.153:0/3475175023 conn(0x7f98140c7150 msgr2=0x7f98140c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:55.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 -- 172.21.15.153:0/3475175023 shutdown_connections 2023-08-17T00:17:55.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.854+0000 7f981c2f1700 1 -- 172.21.15.153:0/3475175023 wait complete. 2023-08-17T00:17:55.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 Processor -- start 2023-08-17T00:17:55.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 -- start start 2023-08-17T00:17:55.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814063290 0x7f981413f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814065b50 0x7f98140bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 0x7f98140c0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981413fa80 con 0x7f9814151b90 2023-08-17T00:17:55.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140c0ff0 con 0x7f9814065b50 2023-08-17T00:17:55.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.858+0000 7f981c2f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140c12d0 con 0x7f9814063290 2023-08-17T00:17:55.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 0x7f98140c0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 0x7f98140c0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42738/0 (socket says 172.21.15.153:42738) 2023-08-17T00:17:55.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 -- 172.21.15.153:0/1918141905 learned_addr learned my addr 172.21.15.153:0/1918141905 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:55.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981988c700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814065b50 0x7f98140bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a08d700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814063290 0x7f981413f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 -- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814063290 msgr2=0x7f981413f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814063290 0x7f981413f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 -- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814065b50 msgr2=0x7f98140bfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814065b50 0x7f98140bfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 -- 172.21.15.153:0/1918141905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040092a0 con 0x7f9814151b90 2023-08-17T00:17:55.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981a88e700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 0x7f98140c0180 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f980c00c410 tx=0x7f980c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f980a7fc700 1 -- 172.21.15.153:0/1918141905 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0070d0 con 0x7f9814151b90 2023-08-17T00:17:55.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f980a7fc700 1 -- 172.21.15.153:0/1918141905 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c007230 con 0x7f9814151b90 2023-08-17T00:17:55.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f980a7fc700 1 -- 172.21.15.153:0/1918141905 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0075b0 con 0x7f9814151b90 2023-08-17T00:17:55.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98140c15b0 con 0x7f9814151b90 2023-08-17T00:17:55.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.862+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140c1b70 con 0x7f9814151b90 2023-08-17T00:17:55.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.866+0000 7f980a7fc700 1 -- 172.21.15.153:0/1918141905 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f980c010070 con 0x7f9814151b90 2023-08-17T00:17:55.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.866+0000 7f980a7fc700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97f805a150 0x7f97f805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.866+0000 7f980a7fc700 1 -- 172.21.15.153:0/1918141905 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f980c0738b0 con 0x7f9814151b90 2023-08-17T00:17:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.866+0000 7f98266c3740 1 Processor -- start 2023-08-17T00:17:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.866+0000 7f98266c3740 1 -- start start 2023-08-17T00:17:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.866+0000 7f981a08d700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97f805a150 0x7f97f805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a08d700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97f805a150 0x7f97f805c610 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f9810009fd0 tx=0x7f981000b040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19c8d20 0x19c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19ac860 0x19d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 0x19d3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d31a0 con 0x19acce0 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1987300 con 0x19c8d20 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1986730 con 0x19ac860 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 0x19d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 0x19d3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42740/0 (socket says 172.21.15.153:42740) 2023-08-17T00:17:55.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 -- 172.21.15.153:0/2953672818 learned_addr learned my addr 172.21.15.153:0/2953672818 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a08d700 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19c8d20 0x19c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981988c700 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19ac860 0x19d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 -- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19ac860 msgr2=0x19d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19ac860 0x19d3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 -- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19c8d20 msgr2=0x19c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19c8d20 0x19c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 -- 172.21.15.153:0/2953672818 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1901010 con 0x19acce0 2023-08-17T00:17:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a08d700 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19c8d20 0x19c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f981a88e700 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 0x19d3630 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f980c00cfd0 tx=0x7f980c00f000).ready entity=mon.0 client_cookie=1eaf87b4312ef8ce server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f97f77fe700 1 -- 172.21.15.153:0/2953672818 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c054030 con 0x19acce0 2023-08-17T00:17:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f97f77fe700 1 -- 172.21.15.153:0/2953672818 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c048fc0 con 0x19acce0 2023-08-17T00:17:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f97f77fe700 1 -- 172.21.15.153:0/2953672818 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c010300 con 0x19acce0 2023-08-17T00:17:55.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- 172.21.15.153:0/2953672818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 msgr2=0x19d3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 0x19d3630 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 rx=0x7f980c00cfd0 tx=0x7f980c00f000).stop 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- 172.21.15.153:0/2953672818 shutdown_connections 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19acce0 0x19d3630 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19ac860 0x19d3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 --2- 172.21.15.153:0/2953672818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19c8d20 0x19c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- 172.21.15.153:0/2953672818 >> 172.21.15.153:0/2953672818 conn(0x1766680 msgr2=0x19877d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- 172.21.15.153:0/2953672818 shutdown_connections 2023-08-17T00:17:55.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.870+0000 7f98266c3740 1 -- 172.21.15.153:0/2953672818 wait complete. 2023-08-17T00:17:55.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.874+0000 7f98266c3740 1 -- start start 2023-08-17T00:17:55.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.874+0000 7f98266c3740 1 Processor -- start 2023-08-17T00:17:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x19c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19acce0 0x19c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19aec70 con 0x19ac860 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19c7f90 con 0x19acce0 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19b14c0 con 0x19c8d20 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 10 client.0 ll_register_callbacks cb 0x193e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x19c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x19c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42748/0 (socket says 172.21.15.153:42748) 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 -- 172.21.15.153:0/2226480491 learned_addr learned my addr 172.21.15.153:0/2226480491 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a88e700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981988c700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19acce0 0x19c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 -- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 msgr2=0x19cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 -- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19acce0 msgr2=0x19c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19acce0 0x19c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 -- 172.21.15.153:0/2226480491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140c1b70 con 0x19ac860 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f981a08d700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x19c6af0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f9810015ee0 tx=0x7f9810017000).ready entity=mon.0 client_cookie=4b94a6a56a403077 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f97f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f97f4ff9700 1 -- 172.21.15.153:0/2226480491 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e040 con 0x19ac860 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f97f4ff9700 1 -- 172.21.15.153:0/2226480491 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f981001a040 con 0x19ac860 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x18cf200 con 0x19ac860 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f97f4ff9700 1 -- 172.21.15.153:0/2226480491 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9810020410 con 0x19ac860 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 10 client.10467 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x18fc4b0 con 0x19ac860 2023-08-17T00:17:55.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f97f4ff9700 1 -- 172.21.15.153:0/2226480491 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x18cf200 con 0x19ac860 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f97f4ff9700 1 -- 172.21.15.153:0/2226480491 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9810028350 con 0x19ac860 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 10 client.10467 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 10 client.10467 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 20 client.10467 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19afee0 0x19b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 4 client.10467 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:55.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.878+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18fdcf0 con 0x19afee0 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f981988c700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19afee0 0x19b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f97f4ff9700 10 client.10467 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f981988c700 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19afee0 0x19b02c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b5474b52e22a0621 server_cookie=d120ea41cb66e415 in_seq=0 out_seq=0 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f97f4ff9700 1 -- 172.21.15.153:0/2226480491 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x18fdcf0 con 0x19afee0 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f97f4ff9700 10 client.10467 handle_command_reply: tid=0 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 client.10467 shutdown 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 msgr2=0x19c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x19c6af0 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 rx=0x7f9810015ee0 tx=0x7f9810017000).stop 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 shutdown_connections 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19afee0 0x19b02c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19acce0 0x19c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 --2- 172.21.15.153:0/2226480491 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x19c6af0 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f97f4ff9700 0 client.10467 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:55.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 >> 172.21.15.153:0/2226480491 conn(0x1766680 msgr2=0x19abe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:55.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 shutdown_connections 2023-08-17T00:17:55.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 1 -- 172.21.15.153:0/2226480491 wait complete. 2023-08-17T00:17:55.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.882+0000 7f98266c3740 20 client.10467 trim_cache size 0 max 16384 2023-08-17T00:17:55.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 Processor -- start 2023-08-17T00:17:55.908 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 -- start start 2023-08-17T00:17:55.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19ac860 0x19abf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19acce0 0x19add90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 0x19aa940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.909 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1987440 con 0x19c8d20 2023-08-17T00:17:55.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x19ad760 con 0x19ac860 2023-08-17T00:17:55.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.902+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19aef20 con 0x19acce0 2023-08-17T00:17:55.910 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981a88e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 0x19aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19acce0 0x19add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981a88e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 0x19aa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42758/0 (socket says 172.21.15.153:42758) 2023-08-17T00:17:55.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981a88e700 1 -- 172.21.15.153:0/594049007 learned_addr learned my addr 172.21.15.153:0/594049007 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:55.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981a08d700 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19ac860 0x19abf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 -- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19ac860 msgr2=0x19abf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.911 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19ac860 0x19abf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 -- 172.21.15.153:0/594049007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 msgr2=0x19aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 0x19aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 -- 172.21.15.153:0/594049007 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140c5730 con 0x19acce0 2023-08-17T00:17:55.912 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981a88e700 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 0x19aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:55.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f981988c700 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19acce0 0x19add90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f98140a9df0 tx=0x7f980401e040).ready entity=mon.2 client_cookie=c5963f9cffff158c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f97f7fff700 1 -- 172.21.15.153:0/594049007 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804021040 con 0x19acce0 2023-08-17T00:17:55.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f97f7fff700 1 -- 172.21.15.153:0/594049007 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9804022040 con 0x19acce0 2023-08-17T00:17:55.913 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f97f7fff700 1 -- 172.21.15.153:0/594049007 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9804000c90 con 0x19acce0 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 -- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19acce0 msgr2=0x19add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19acce0 0x19add90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f98140a9df0 tx=0x7f980401e040).stop 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 -- 172.21.15.153:0/594049007 shutdown_connections 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19c8d20 0x19aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19acce0 0x19add90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 --2- 172.21.15.153:0/594049007 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19ac860 0x19abf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.914 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 -- 172.21.15.153:0/594049007 >> 172.21.15.153:0/594049007 conn(0x1766680 msgr2=0x19c7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:55.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 -- 172.21.15.153:0/594049007 shutdown_connections 2023-08-17T00:17:55.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.906+0000 7f98266c3740 1 -- 172.21.15.153:0/594049007 wait complete. 2023-08-17T00:17:55.915 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 -- start start 2023-08-17T00:17:55.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 Processor -- start 2023-08-17T00:17:55.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x1a2d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19e8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19daea0 0x19cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x19cd2c0 con 0x19ac860 2023-08-17T00:17:55.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a2da50 con 0x19daea0 2023-08-17T00:17:55.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x19db5a0 con 0x19c8d20 2023-08-17T00:17:55.917 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f98266c3740 10 client.0 ll_register_callbacks cb 0x7f98100159e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:55.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x1a2d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x1a2d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42772/0 (socket says 172.21.15.153:42772) 2023-08-17T00:17:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981988c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19e8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 -- 172.21.15.153:0/1670358582 learned_addr learned my addr 172.21.15.153:0/1670358582 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a88e700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19daea0 0x19cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 -- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 msgr2=0x19e8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19e8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 -- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19daea0 msgr2=0x19cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19daea0 0x19cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a08d700 1 -- 172.21.15.153:0/1670358582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1901010 con 0x19ac860 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981988c700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.910+0000 7f981a88e700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19daea0 0x19cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f981a08d700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x1a2d560 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f9810009fa0 tx=0x7f9810022000).ready entity=mon.0 client_cookie=3bd6566a7a2e3af6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:55.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 1 -- 172.21.15.153:0/1670358582 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981000e040 con 0x19ac860 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f980c048fc0 con 0x19ac860 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 1 -- 172.21.15.153:0/1670358582 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f9810028350 con 0x19ac860 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 1 -- 172.21.15.153:0/1670358582 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9810014970 con 0x19ac860 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 10 client.10473 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x7f98140621f0 con 0x19ac860 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 1 -- 172.21.15.153:0/1670358582 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c048fc0 con 0x19ac860 2023-08-17T00:17:55.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 1 -- 172.21.15.153:0/1670358582 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9810038330 con 0x19ac860 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 10 client.10473 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 10 client.10473 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 20 client.10473 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19e8520 0x19cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 4 client.10473 mds_command: new command op to 10353 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x18f4240 con 0x19e8520 2023-08-17T00:17:55.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f981988c700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19e8520 0x19cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:55.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 10 client.10473 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f981988c700 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19e8520 0x19cc960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=b15c55b3048e21dc server_cookie=7cf2ad8a4cf5d1f2 in_seq=0 out_seq=0 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 1 -- 172.21.15.153:0/1670358582 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x18f4240 con 0x19e8520 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 10 client.10473 handle_command_reply: tid=0 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 client.10473 shutdown 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 msgr2=0x1a2d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x1a2d560 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 rx=0x7f9810009fa0 tx=0x7f9810022000).stop 2023-08-17T00:17:55.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 shutdown_connections 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x19e8520 0x19cc960 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x19daea0 0x19cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x19c8d20 0x19e8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 --2- 172.21.15.153:0/1670358582 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x19ac860 0x1a2d560 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f97f4ff9700 0 client.10473 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.914+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 >> 172.21.15.153:0/1670358582 conn(0x1766680 msgr2=0x19ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:55.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 shutdown_connections 2023-08-17T00:17:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f98266c3740 1 -- 172.21.15.153:0/1670358582 wait complete. 2023-08-17T00:17:55.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f98266c3740 20 client.10473 trim_cache size 0 max 16384 2023-08-17T00:17:55.927 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:55.927 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:17:55.927 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:17:55.927 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97f805a150 msgr2=0x7f97f805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97f805a150 0x7f97f805c610 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f9810009fd0 tx=0x7f981000b040).stop 2023-08-17T00:17:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 msgr2=0x7f98140c0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 0x7f98140c0180 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 rx=0x7f980c00c410 tx=0x7f980c007d70).stop 2023-08-17T00:17:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 shutdown_connections 2023-08-17T00:17:55.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f97f805a150 0x7f97f805c610 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9814151b90 0x7f98140c0180 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9814065b50 0x7f98140bfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 --2- 172.21.15.153:0/1918141905 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9814063290 0x7f981413f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 >> 172.21.15.153:0/1918141905 conn(0x7f98140c7150 msgr2=0x7f981414f030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 shutdown_connections 2023-08-17T00:17:55.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:55.918+0000 7f981c2f1700 1 -- 172.21.15.153:0/1918141905 wait complete. 2023-08-17T00:17:55.943 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:17:55.944 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub start / recursive,repair 2023-08-17T00:17:56.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.094+0000 7f0137946700 1 Processor -- start 2023-08-17T00:17:56.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.094+0000 7f0137946700 1 -- start start 2023-08-17T00:17:56.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0137946700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01300652f0 0x7f01300656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0137946700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f013014bf70 0x7f01300c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0137946700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01300c1f00 con 0x7f01300c1560 2023-08-17T00:17:56.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0137946700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0130152e10 con 0x7f013014bf70 2023-08-17T00:17:56.103 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0137946700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01300c2d50 con 0x7f01300652f0 2023-08-17T00:17:56.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f013014bf70 0x7f01300c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.104 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f013014bf70 0x7f01300c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42784/0 (socket says 172.21.15.153:42784) 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 -- 172.21.15.153:0/1304653439 learned_addr learned my addr 172.21.15.153:0/1304653439 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0134ee1700 1 --1- 172.21.15.153:0/1304653439 >> v1:172.21.15.153:6789/0 conn(0x7f01300c1560 0x7f013014b860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:35942/0 (socket says 172.21.15.153:35942) 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f01356e2700 1 --2- 172.21.15.153:0/1304653439 >> v2:172.21.15.178:3300/0 conn(0x7f01300652f0 0x7f01300656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 -- 172.21.15.153:0/1304653439 >> v2:172.21.15.178:3300/0 conn(0x7f01300652f0 msgr2=0x7f01300656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 --2- 172.21.15.153:0/1304653439 >> v2:172.21.15.178:3300/0 conn(0x7f01300652f0 0x7f01300656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 -- 172.21.15.153:0/1304653439 >> v1:172.21.15.153:6789/0 conn(0x7f01300c1560 legacy=0x7f013014b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 -- 172.21.15.153:0/1304653439 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01301521f0 con 0x7f013014bf70 2023-08-17T00:17:56.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0127fff700 1 -- 172.21.15.153:0/1304653439 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114646712 0 0) 0x7f0120001110 con 0x7f01300c1560 2023-08-17T00:17:56.106 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0135ee3700 1 --2- 172.21.15.153:0/1304653439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300c1a10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f0130152380 tx=0x7f0128009840).ready entity=mon.0 client_cookie=6e729d191386edc3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0127fff700 1 -- 172.21.15.153:0/1304653439 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800e070 con 0x7f013014bf70 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.098+0000 7f0127fff700 1 -- 172.21.15.153:0/1304653439 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012800b9f0 con 0x7f013014bf70 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0127fff700 1 -- 172.21.15.153:0/1304653439 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800bd70 con 0x7f013014bf70 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 -- 172.21.15.153:0/1304653439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 msgr2=0x7f01300c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 --2- 172.21.15.153:0/1304653439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300c1a10 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 rx=0x7f0130152380 tx=0x7f0128009840).stop 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 -- 172.21.15.153:0/1304653439 shutdown_connections 2023-08-17T00:17:56.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 --2- 172.21.15.153:0/1304653439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300c1a10 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 --2- 172.21.15.153:0/1304653439 >> v2:172.21.15.178:3300/0 conn(0x7f01300652f0 0x7f01300656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 -- 172.21.15.153:0/1304653439 >> 172.21.15.153:0/1304653439 conn(0x7f01300c7090 msgr2=0x7f01300c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 -- 172.21.15.153:0/1304653439 shutdown_connections 2023-08-17T00:17:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 -- 172.21.15.153:0/1304653439 wait complete. 2023-08-17T00:17:56.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 Processor -- start 2023-08-17T00:17:56.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.102+0000 7f0137946700 1 -- start start 2023-08-17T00:17:56.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01300652f0 0x7f01300be070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01300c1560 0x7f013014ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013014b110 con 0x7f013014bf70 2023-08-17T00:17:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01300c52f0 con 0x7f01300652f0 2023-08-17T00:17:56.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01300c55d0 con 0x7f01300c1560 2023-08-17T00:17:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f01356e2700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01300652f0 0x7f01300be070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300bf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42792/0 (socket says 172.21.15.153:42792) 2023-08-17T00:17:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 -- 172.21.15.153:0/2851869523 learned_addr learned my addr 172.21.15.153:0/2851869523 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0134ee1700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01300c1560 0x7f013014ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 -- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01300c1560 msgr2=0x7f013014ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01300c1560 0x7f013014ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 -- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01300652f0 msgr2=0x7f01300be070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01300652f0 0x7f01300be070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 -- 172.21.15.153:0/2851869523 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0128009ae0 con 0x7f013014bf70 2023-08-17T00:17:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0135ee3700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300bf930 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f0130063b20 tx=0x7f0128009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f01257fa700 1 -- 172.21.15.153:0/2851869523 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01280092e0 con 0x7f013014bf70 2023-08-17T00:17:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f01257fa700 1 -- 172.21.15.153:0/2851869523 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0128009500 con 0x7f013014bf70 2023-08-17T00:17:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f01257fa700 1 -- 172.21.15.153:0/2851869523 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012801d620 con 0x7f013014bf70 2023-08-17T00:17:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01300c58b0 con 0x7f013014bf70 2023-08-17T00:17:56.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.106+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01300c5e70 con 0x7f013014bf70 2023-08-17T00:17:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.110+0000 7f01257fa700 1 -- 172.21.15.153:0/2851869523 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f012801b040 con 0x7f013014bf70 2023-08-17T00:17:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f01257fa700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f011405a180 0x7f011405c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f01257fa700 1 -- 172.21.15.153:0/2851869523 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f0128075b50 con 0x7f013014bf70 2023-08-17T00:17:56.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f01356e2700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f011405a180 0x7f011405c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 Processor -- start 2023-08-17T00:17:56.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f01356e2700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f011405a180 0x7f011405c640 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f012c009c30 tx=0x7f012c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 -- start start 2023-08-17T00:17:56.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2578a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.120 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x257bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c8270 con 0x25777e0 2023-08-17T00:17:56.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e9100 con 0x257c0d0 2023-08-17T00:17:56.122 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x24f29e0 con 0x235b7f0 2023-08-17T00:17:56.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0134ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x257bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0134ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x257bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42796/0 (socket says 172.21.15.153:42796) 2023-08-17T00:17:56.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0134ee1700 1 -- 172.21.15.153:0/3888270680 learned_addr learned my addr 172.21.15.153:0/3888270680 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f0135ee3700 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.114+0000 7f01356e2700 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2578a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0134ee1700 1 -- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 msgr2=0x2578a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0134ee1700 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2578a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0134ee1700 1 -- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 msgr2=0x25bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0134ee1700 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25bf2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0134ee1700 1 -- 172.21.15.153:0/3888270680 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24f60e0 con 0x25777e0 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0135ee3700 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0134ee1700 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x257bbe0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f0120007460 tx=0x7f0120007a10).ready entity=mon.0 client_cookie=43a9d7f3789c9b3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f011a7fc700 1 -- 172.21.15.153:0/3888270680 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120007540 con 0x25777e0 2023-08-17T00:17:56.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f011a7fc700 1 -- 172.21.15.153:0/3888270680 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120001650 con 0x25777e0 2023-08-17T00:17:56.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f011a7fc700 1 -- 172.21.15.153:0/3888270680 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200019f0 con 0x25777e0 2023-08-17T00:17:56.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 -- 172.21.15.153:0/3888270680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 msgr2=0x257bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x257bbe0 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 rx=0x7f0120007460 tx=0x7f0120007a10).stop 2023-08-17T00:17:56.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 -- 172.21.15.153:0/3888270680 shutdown_connections 2023-08-17T00:17:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x257bbe0 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3888270680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2578a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 -- 172.21.15.153:0/3888270680 >> 172.21.15.153:0/3888270680 conn(0x2539d50 msgr2=0x257c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 -- 172.21.15.153:0/3888270680 shutdown_connections 2023-08-17T00:17:56.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 -- 172.21.15.153:0/3888270680 wait complete. 2023-08-17T00:17:56.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.118+0000 7f0141cd8740 1 -- start start 2023-08-17T00:17:56.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 Processor -- start 2023-08-17T00:17:56.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x25c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25777e0 0x25c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 0x25a3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25a27b0 con 0x257c0d0 2023-08-17T00:17:56.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x25a2a90 con 0x235b7f0 2023-08-17T00:17:56.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25a2d70 con 0x25777e0 2023-08-17T00:17:56.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 10 client.0 ll_register_callbacks cb 0x2533900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:56.131 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 0x25a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 0x25a3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42798/0 (socket says 172.21.15.153:42798) 2023-08-17T00:17:56.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 -- 172.21.15.153:0/1451881428 learned_addr learned my addr 172.21.15.153:0/1451881428 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f01356e2700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x25c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0134ee1700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25777e0 0x25c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 -- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25777e0 msgr2=0x25c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25777e0 0x25c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.133 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 -- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 msgr2=0x25c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x25c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 -- 172.21.15.153:0/1451881428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0120007060 con 0x257c0d0 2023-08-17T00:17:56.134 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0135ee3700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 0x25a3270 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f012804ca60 tx=0x7f012800e000).ready entity=mon.0 client_cookie=dbf88298c0ad7d5a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f010f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:56.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f010f7fe700 1 -- 172.21.15.153:0/1451881428 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012804c750 con 0x257c0d0 2023-08-17T00:17:56.135 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f010f7fe700 1 -- 172.21.15.153:0/1451881428 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f012801d990 con 0x257c0d0 2023-08-17T00:17:56.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.122+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x24f2dc0 con 0x257c0d0 2023-08-17T00:17:56.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 1 -- 172.21.15.153:0/1451881428 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f012804bfb0 con 0x257c0d0 2023-08-17T00:17:56.136 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 10 client.10488 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:56.137 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x24f1580 con 0x257c0d0 2023-08-17T00:17:56.139 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 1 -- 172.21.15.153:0/1451881428 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x24f2dc0 con 0x257c0d0 2023-08-17T00:17:56.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 1 -- 172.21.15.153:0/1451881428 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f012804c110 con 0x257c0d0 2023-08-17T00:17:56.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 10 client.10488 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:56.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 10 client.10488 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:56.140 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 20 client.10488 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x25a1320 0x25a3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 4 client.10488 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x24e9310 con 0x25a1320 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f01356e2700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x25a1320 0x25a3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f01356e2700 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x25a1320 0x25a3ac0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=9d66ad060a3a82bb server_cookie=4484265b6dd4f42e in_seq=0 out_seq=0 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 10 client.10488 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.141 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 1 -- 172.21.15.153:0/1451881428 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x24e9310 con 0x25a1320 2023-08-17T00:17:56.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 10 client.10488 handle_command_reply: tid=0 2023-08-17T00:17:56.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 client.10488 shutdown 2023-08-17T00:17:56.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 msgr2=0x25a3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 0x25a3270 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 rx=0x7f012804ca60 tx=0x7f012800e000).stop 2023-08-17T00:17:56.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 shutdown_connections 2023-08-17T00:17:56.142 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x25a1320 0x25a3ac0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f010f7fe700 0 client.10488 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x257c0d0 0x25a3270 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x25777e0 0x25c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1451881428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x25c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.126+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 >> 172.21.15.153:0/1451881428 conn(0x2539d50 msgr2=0x2576c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.130+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 shutdown_connections 2023-08-17T00:17:56.143 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.130+0000 7f0141cd8740 1 -- 172.21.15.153:0/1451881428 wait complete. 2023-08-17T00:17:56.144 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.130+0000 7f0141cd8740 20 client.10488 trim_cache size 0 max 16384 2023-08-17T00:17:56.151 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 Processor -- start 2023-08-17T00:17:56.152 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 -- start start 2023-08-17T00:17:56.155 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2579430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x25bd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25a2c30 con 0x25777e0 2023-08-17T00:17:56.156 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x24d1f60 con 0x257c0d0 2023-08-17T00:17:56.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25c2cb0 con 0x235b7f0 2023-08-17T00:17:56.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0134ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x25bd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f01356e2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2579430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f01356e2700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2579430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:50620/0 (socket says 172.21.15.153:50620) 2023-08-17T00:17:56.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f01356e2700 1 -- 172.21.15.153:0/1415820954 learned_addr learned my addr 172.21.15.153:0/1415820954 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.157 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0135ee3700 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.146+0000 7f0134ee1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x25bd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42810/0 (socket says 172.21.15.153:42810) 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0134ee1700 1 -- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 msgr2=0x2579430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0134ee1700 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2579430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0134ee1700 1 -- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 msgr2=0x25c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0134ee1700 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0134ee1700 1 -- 172.21.15.153:0/1415820954 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25a35d0 con 0x25777e0 2023-08-17T00:17:56.158 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0134ee1700 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x25bd1c0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x2577be0 tx=0x7f0120018000).ready entity=mon.0 client_cookie=5bd3ab06dbb569d0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f011affd700 1 -- 172.21.15.153:0/1415820954 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120001da0 con 0x25777e0 2023-08-17T00:17:56.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f011affd700 1 -- 172.21.15.153:0/1415820954 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120007540 con 0x25777e0 2023-08-17T00:17:56.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f011affd700 1 -- 172.21.15.153:0/1415820954 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200017c0 con 0x25777e0 2023-08-17T00:17:56.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 -- 172.21.15.153:0/1415820954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 msgr2=0x25bd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x25bd1c0 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 rx=0x2577be0 tx=0x7f0120018000).stop 2023-08-17T00:17:56.159 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 -- 172.21.15.153:0/1415820954 shutdown_connections 2023-08-17T00:17:56.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x257c0d0 0x25c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25777e0 0x25bd1c0 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.160 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 --2- 172.21.15.153:0/1415820954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x235b7f0 0x2579430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 -- 172.21.15.153:0/1415820954 >> 172.21.15.153:0/1415820954 conn(0x2539d50 msgr2=0x25c0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 -- 172.21.15.153:0/1415820954 shutdown_connections 2023-08-17T00:17:56.161 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 -- 172.21.15.153:0/1415820954 wait complete. 2023-08-17T00:17:56.164 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.150+0000 7f0141cd8740 1 -- start start 2023-08-17T00:17:56.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 Processor -- start 2023-08-17T00:17:56.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x261d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x257c0d0 0x25a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 0x25a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.165 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x25a4370 con 0x25c28c0 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x262e730 con 0x235b7f0 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x25bd4f0 con 0x257c0d0 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 10 client.0 ll_register_callbacks cb 0x7f0128013ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 0x25a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 0x25a3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42822/0 (socket says 172.21.15.153:42822) 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 -- 172.21.15.153:0/3878335657 learned_addr learned my addr 172.21.15.153:0/3878335657 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.166 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f01356e2700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x261d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0134ee1700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x257c0d0 0x25a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 -- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x257c0d0 msgr2=0x25a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x257c0d0 0x25a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 -- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 msgr2=0x261d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x261d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 -- 172.21.15.153:0/3878335657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0120019040 con 0x25c28c0 2023-08-17T00:17:56.167 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0135ee3700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 0x25a3e80 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f012800b9a0 tx=0x7f0128032000).ready entity=mon.0 client_cookie=8d62bb876482e83d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f010f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f010f7fe700 1 -- 172.21.15.153:0/3878335657 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012800e040 con 0x25c28c0 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0120001650 con 0x25c28c0 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f010f7fe700 1 -- 172.21.15.153:0/3878335657 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f012804bfb0 con 0x25c28c0 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f010f7fe700 1 -- 172.21.15.153:0/3878335657 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01280490a0 con 0x25c28c0 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 10 client.10494 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:56.168 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x24f12d0 con 0x25c28c0 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f010f7fe700 1 -- 172.21.15.153:0/3878335657 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120001650 con 0x25c28c0 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.154+0000 7f010f7fe700 1 -- 172.21.15.153:0/3878335657 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f01280522e0 con 0x25c28c0 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 10 client.10494 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 10 client.10494 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 20 client.10494 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x26261c0 0x262d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.169 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 4 client.10494 mds_command: new command op to 10353 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2023-08-17T00:17:56.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x23b2780 con 0x26261c0 2023-08-17T00:17:56.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f01356e2700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x26261c0 0x262d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f010f7fe700 10 client.10494 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f01356e2700 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x26261c0 0x262d810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=22412a1e3f642d1b server_cookie=9e0b6f0a892327d7 in_seq=0 out_seq=0 2023-08-17T00:17:56.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f010f7fe700 1 -- 172.21.15.153:0/3878335657 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x23b2780 con 0x26261c0 2023-08-17T00:17:56.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f010f7fe700 10 client.10494 handle_command_reply: tid=0 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 client.10494 shutdown 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 msgr2=0x25a3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 0x25a3e80 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 rx=0x7f012800b9a0 tx=0x7f0128032000).stop 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 shutdown_connections 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x26261c0 0x262d810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x25c28c0 0x25a3e80 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x257c0d0 0x25a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f010f7fe700 0 client.10494 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 --2- 172.21.15.153:0/3878335657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x235b7f0 0x261d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 >> 172.21.15.153:0/3878335657 conn(0x2539d50 msgr2=0x25a8390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 shutdown_connections 2023-08-17T00:17:56.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 1 -- 172.21.15.153:0/3878335657 wait complete. 2023-08-17T00:17:56.172 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.158+0000 7f0141cd8740 20 client.10494 trim_cache size 0 max 16384 2023-08-17T00:17:56.173 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:56.173 INFO:teuthology.orchestra.run.smithi153.stdout: "return_code": 0, 2023-08-17T00:17:56.173 INFO:teuthology.orchestra.run.smithi153.stdout: "scrub_tag": "64e5de8e-522c-4704-b474-68049c82735a", 2023-08-17T00:17:56.173 INFO:teuthology.orchestra.run.smithi153.stdout: "mode": "asynchronous" 2023-08-17T00:17:56.173 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:56.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f011405a180 msgr2=0x7f011405c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f011405a180 0x7f011405c640 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f012c009c30 tx=0x7f012c009060).stop 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 msgr2=0x7f01300bf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300bf930 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 rx=0x7f0130063b20 tx=0x7f0128009840).stop 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 shutdown_connections 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f011405a180 0x7f011405c640 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f013014bf70 0x7f01300bf930 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01300c1560 0x7f013014ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 --2- 172.21.15.153:0/2851869523 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01300652f0 0x7f01300be070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 >> 172.21.15.153:0/2851869523 conn(0x7f01300c7090 msgr2=0x7f01300a86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 shutdown_connections 2023-08-17T00:17:56.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.162+0000 7f0137946700 1 -- 172.21.15.153:0/2851869523 wait complete. 2023-08-17T00:17:56.185 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-08-17T00:17:56.354 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.350+0000 7f2e8f2b9700 1 Processor -- start 2023-08-17T00:17:56.355 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.350+0000 7f2e8f2b9700 1 -- start start 2023-08-17T00:17:56.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.350+0000 7f2e8f2b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e880a8df0 0x7f2e880c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.350+0000 7f2e8f2b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2e88068820 0x7f2e88068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.350+0000 7f2e8f2b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e881585a0 con 0x7f2e88061fa0 2023-08-17T00:17:56.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.350+0000 7f2e8f2b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e88066400 con 0x7f2e880a8df0 2023-08-17T00:17:56.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e88069170 con 0x7f2e88068820 2023-08-17T00:17:56.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e880a8df0 0x7f2e880c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f2e880a8df0 0x7f2e880c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42836/0 (socket says 172.21.15.153:42836) 2023-08-17T00:17:56.359 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2869375977 learned_addr learned my addr 172.21.15.153:0/2869375977 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/2869375977 >> v2:172.21.15.178:3300/0 conn(0x7f2e88068820 0x7f2e88068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2869375977 >> v2:172.21.15.178:3300/0 conn(0x7f2e88068820 msgr2=0x7f2e88068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2869375977 >> v2:172.21.15.178:3300/0 conn(0x7f2e88068820 0x7f2e88068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2869375977 >> v1:172.21.15.178:6789/0 conn(0x7f2e88061fa0 legacy=0x7f2e88062430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2869375977 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880b9d30 con 0x7f2e880a8df0 2023-08-17T00:17:56.360 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2869375977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e880c1490 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f2e880c2ef0 tx=0x7f2e840090f0).ready entity=mon.0 client_cookie=caf8933ddf36aa9c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8d2b5700 1 -- 172.21.15.153:0/2869375977 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400b600 con 0x7f2e880a8df0 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8d2b5700 1 -- 172.21.15.153:0/2869375977 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400b760 con 0x7f2e880a8df0 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8d2b5700 1 -- 172.21.15.153:0/2869375977 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400bae0 con 0x7f2e880a8df0 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2869375977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 msgr2=0x7f2e880c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2869375977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e880c1490 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 rx=0x7f2e880c2ef0 tx=0x7f2e840090f0).stop 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2869375977 shutdown_connections 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2869375977 >> v2:172.21.15.178:3300/0 conn(0x7f2e88068820 0x7f2e88068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2869375977 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e880c1490 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2869375977 >> 172.21.15.153:0/2869375977 conn(0x7f2e880c6620 msgr2=0x7f2e880c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2869375977 shutdown_connections 2023-08-17T00:17:56.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.354+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2869375977 wait complete. 2023-08-17T00:17:56.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.358+0000 7f2e8f2b9700 1 Processor -- start 2023-08-17T00:17:56.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.358+0000 7f2e8f2b9700 1 -- start start 2023-08-17T00:17:56.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e88061fa0 0x7f2e880bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e88068820 0x7f2e881688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e88168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880ba2e0 con 0x7f2e880a8df0 2023-08-17T00:17:56.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e881597c0 con 0x7f2e88061fa0 2023-08-17T00:17:56.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880bc670 con 0x7f2e88068820 2023-08-17T00:17:56.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e88168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e88168dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42848/0 (socket says 172.21.15.153:42848) 2023-08-17T00:17:56.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2718055923 learned_addr learned my addr 172.21.15.153:0/2718055923 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.368 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e88061fa0 0x7f2e880bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e88068820 0x7f2e881688e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e88068820 msgr2=0x7f2e881688e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e88068820 0x7f2e881688e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e88061fa0 msgr2=0x7f2e880bd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e88061fa0 0x7f2e880bd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2718055923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009310 con 0x7f2e880a8df0 2023-08-17T00:17:56.369 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e88061fa0 0x7f2e880bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e88168dd0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f2e8000c7c0 tx=0x7f2e80001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e7e7fc700 1 -- 172.21.15.153:0/2718055923 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80010510 con 0x7f2e880a8df0 2023-08-17T00:17:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e7e7fc700 1 -- 172.21.15.153:0/2718055923 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80010670 con 0x7f2e880a8df0 2023-08-17T00:17:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e7e7fc700 1 -- 172.21.15.153:0/2718055923 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e800109f0 con 0x7f2e880a8df0 2023-08-17T00:17:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e880bc950 con 0x7f2e880a8df0 2023-08-17T00:17:56.370 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.362+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e880bcf10 con 0x7f2e880a8df0 2023-08-17T00:17:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.366+0000 7f2e7e7fc700 1 -- 172.21.15.153:0/2718055923 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f2e80010070 con 0x7f2e880a8df0 2023-08-17T00:17:56.371 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.366+0000 7f2e7e7fc700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e6c05a150 0x7f2e6c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.366+0000 7f2e7e7fc700 1 -- 172.21.15.153:0/2718055923 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f2e80073f30 con 0x7f2e880a8df0 2023-08-17T00:17:56.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.366+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e6c05a150 0x7f2e6c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e6c05a150 0x7f2e6c05c610 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f2e84009130 tx=0x7f2e84017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.374 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 Processor -- start 2023-08-17T00:17:56.375 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 -- start start 2023-08-17T00:17:56.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x187a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1854330 0x184f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x1850f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.376 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x17a01a0 con 0x18959f0 2023-08-17T00:17:56.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x18969b0 con 0x1895dd0 2023-08-17T00:17:56.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x187a960 con 0x1854330 2023-08-17T00:17:56.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x187a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x187a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42852/0 (socket says 172.21.15.153:42852) 2023-08-17T00:17:56.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/620395752 learned_addr learned my addr 172.21.15.153:0/620395752 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1854330 0x184f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x1850f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1854330 msgr2=0x184f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1854330 0x184f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 msgr2=0x1850f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x1850f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.380 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.370+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/620395752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17ce010 con 0x18959f0 2023-08-17T00:17:56.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x187a050 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f2e84006fd0 tx=0x7f2e8401f070).ready entity=mon.0 client_cookie=f39d591af0185ed4 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e6b7fe700 1 -- 172.21.15.153:0/620395752 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840069b0 con 0x18959f0 2023-08-17T00:17:56.381 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e6b7fe700 1 -- 172.21.15.153:0/620395752 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400ba50 con 0x18959f0 2023-08-17T00:17:56.382 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e6b7fe700 1 -- 172.21.15.153:0/620395752 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8401daa0 con 0x18959f0 2023-08-17T00:17:56.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 -- 172.21.15.153:0/620395752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 msgr2=0x187a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x187a050 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 rx=0x7f2e84006fd0 tx=0x7f2e8401f070).stop 2023-08-17T00:17:56.386 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 -- 172.21.15.153:0/620395752 shutdown_connections 2023-08-17T00:17:56.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x1850f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1854330 0x184f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/620395752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x187a050 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 -- 172.21.15.153:0/620395752 >> 172.21.15.153:0/620395752 conn(0x1633680 msgr2=0x189af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.387 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 -- 172.21.15.153:0/620395752 shutdown_connections 2023-08-17T00:17:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 -- 172.21.15.153:0/620395752 wait complete. 2023-08-17T00:17:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 -- start start 2023-08-17T00:17:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.374+0000 7f2e9a88d740 1 Processor -- start 2023-08-17T00:17:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 0x1880960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.388 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x18a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x18aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x18aa940 con 0x1854330 2023-08-17T00:17:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x187f380 con 0x1895dd0 2023-08-17T00:17:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x187c950 con 0x18959f0 2023-08-17T00:17:56.389 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 10 client.0 ll_register_callbacks cb 0x180b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 0x1880960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 0x1880960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42872/0 (socket says 172.21.15.153:42872) 2023-08-17T00:17:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2792508968 learned_addr learned my addr 172.21.15.153:0/2792508968 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x18aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x18a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.390 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 msgr2=0x18a9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x18a9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 msgr2=0x18aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x18aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 -- 172.21.15.153:0/2792508968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e880b9d30 con 0x1854330 2023-08-17T00:17:56.391 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x18a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x18aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:17:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 0x1880960 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f2e84020040 tx=0x7f2e84028000).ready entity=mon.0 client_cookie=aaedc5a314e046a3 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e68ff9700 1 -- 172.21.15.153:0/2792508968 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84030830 con 0x1854330 2023-08-17T00:17:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e68ff9700 1 -- 172.21.15.153:0/2792508968 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f2e84030990 con 0x1854330 2023-08-17T00:17:56.392 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x179c200 con 0x1854330 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e68ff9700 1 -- 172.21.15.153:0/2792508968 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e84030d60 con 0x1854330 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 10 client.10506 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x17c94b0 con 0x1854330 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e68ff9700 1 -- 172.21.15.153:0/2792508968 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x179c200 con 0x1854330 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e68ff9700 1 -- 172.21.15.153:0/2792508968 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2e8403a420 con 0x1854330 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 10 client.10506 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:56.393 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 10 client.10506 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 20 client.10506 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1876c00 0x1876fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 4 client.10506 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:17:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17cacf0 con 0x1876c00 2023-08-17T00:17:56.394 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.378+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1876c00 0x1876fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1876c00 0x1876fe0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=2258f7a1f46fdfb6 server_cookie=f117be52d745466e in_seq=0 out_seq=0 2023-08-17T00:17:56.395 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e68ff9700 10 client.10506 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e68ff9700 1 -- 172.21.15.153:0/2792508968 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x17cacf0 con 0x1876c00 2023-08-17T00:17:56.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e68ff9700 10 client.10506 handle_command_reply: tid=0 2023-08-17T00:17:56.396 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 client.10506 shutdown 2023-08-17T00:17:56.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 msgr2=0x1880960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 0x1880960 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 rx=0x7f2e84020040 tx=0x7f2e84028000).stop 2023-08-17T00:17:56.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 shutdown_connections 2023-08-17T00:17:56.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1876c00 0x1876fe0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1895dd0 0x18aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.397 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x18a9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2792508968 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1854330 0x1880960 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e68ff9700 0 client.10506 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 >> 172.21.15.153:0/2792508968 conn(0x1633680 msgr2=0x1896d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 shutdown_connections 2023-08-17T00:17:56.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2792508968 wait complete. 2023-08-17T00:17:56.398 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.382+0000 7f2e9a88d740 20 client.10506 trim_cache size 0 max 16384 2023-08-17T00:17:56.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 Processor -- start 2023-08-17T00:17:56.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 -- start start 2023-08-17T00:17:56.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1875600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x1875af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 0x189ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x18a9f90 con 0x1895dd0 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x181a540 con 0x1854330 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1817240 con 0x18959f0 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 0x189ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8dab6700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x1875af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 0x189ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42882/0 (socket says 172.21.15.153:42882) 2023-08-17T00:17:56.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2434095918 learned_addr learned my addr 172.21.15.153:0/2434095918 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1875600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 msgr2=0x1875af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x1875af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 msgr2=0x1875600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1875600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 -- 172.21.15.153:0/2434095918 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88169620 con 0x1895dd0 2023-08-17T00:17:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 0x189ae40 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7f2e8004b470 tx=0x7f2e8004d040).ready entity=mon.0 client_cookie=5aa3dabc8c4d138f server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e6bfff700 1 -- 172.21.15.153:0/2434095918 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80050040 con 0x1895dd0 2023-08-17T00:17:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e6bfff700 1 -- 172.21.15.153:0/2434095918 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e80010da0 con 0x1895dd0 2023-08-17T00:17:56.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.402+0000 7f2e6bfff700 1 -- 172.21.15.153:0/2434095918 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e80072050 con 0x1895dd0 2023-08-17T00:17:56.413 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2434095918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 msgr2=0x189ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 0x189ae40 secure :-1 s=READY pgs=2053 cs=0 l=1 rev1=1 rx=0x7f2e8004b470 tx=0x7f2e8004d040).stop 2023-08-17T00:17:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2434095918 shutdown_connections 2023-08-17T00:17:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1895dd0 0x189ae40 unknown :-1 s=CLOSED pgs=2053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x18959f0 0x1875af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/2434095918 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1875600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2434095918 >> 172.21.15.153:0/2434095918 conn(0x1633680 msgr2=0x1894680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2434095918 shutdown_connections 2023-08-17T00:17:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 -- 172.21.15.153:0/2434095918 wait complete. 2023-08-17T00:17:56.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 -- start start 2023-08-17T00:17:56.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.406+0000 7f2e9a88d740 1 Processor -- start 2023-08-17T00:17:56.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1851280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x1851770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1895dd0 0x1877890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1851c60 con 0x18959f0 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x187abf0 con 0x1854330 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x18fe950 con 0x1895dd0 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 10 client.0 ll_register_callbacks cb 0x7f2e8401ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x1851770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x1851770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:42888/0 (socket says 172.21.15.153:42888) 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 -- 172.21.15.153:0/3952171459 learned_addr learned my addr 172.21.15.153:0/3952171459 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:17:56.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8eab8700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1895dd0 0x1877890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1851280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 -- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1895dd0 msgr2=0x1877890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1895dd0 0x1877890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 -- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 msgr2=0x1851280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1851280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 -- 172.21.15.153:0/3952171459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e880bcf10 con 0x18959f0 2023-08-17T00:17:56.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e8dab6700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x1851770 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f2e880abfa0 tx=0x7f2e78019040).ready entity=mon.0 client_cookie=d0542cf6cb5aca95 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e68ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e68ff9700 1 -- 172.21.15.153:0/3952171459 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7801e5e0 con 0x18959f0 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2e8400ba50 con 0x18959f0 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e68ff9700 1 -- 172.21.15.153:0/3952171459 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f2e7801e740 con 0x18959f0 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e68ff9700 1 -- 172.21.15.153:0/3952171459 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e7801eb10 con 0x18959f0 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 10 client.10512 fetch_fsmap learned FSMap version 153 2023-08-17T00:17:56.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x17c9200 con 0x18959f0 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.410+0000 7f2e68ff9700 1 -- 172.21.15.153:0/3952171459 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400ba50 con 0x18959f0 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e68ff9700 1 -- 172.21.15.153:0/3952171459 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2e7801ec70 con 0x18959f0 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 10 client.10512 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 10 client.10512 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 20 client.10512 populate_metadata read hostname 'smithi153' 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1877d80 0x1878160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:17:56.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 4 client.10512 mds_command: new command op to 10353 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x17c1240 con 0x1877d80 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1877d80 0x1878160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e68ff9700 10 client.10512 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8e2b7700 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1877d80 0x1878160 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4f25e301441ebab8 server_cookie=88731346d422fd62 in_seq=0 out_seq=0 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e68ff9700 1 -- 172.21.15.153:0/3952171459 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x17c1240 con 0x1877d80 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e68ff9700 10 client.10512 handle_command_reply: tid=0 2023-08-17T00:17:56.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 client.10512 shutdown 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 msgr2=0x1851770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x1851770 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 rx=0x7f2e880abfa0 tx=0x7f2e78019040).stop 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 shutdown_connections 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x1877d80 0x1878160 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1895dd0 0x1877890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x18959f0 0x1851770 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 --2- 172.21.15.153:0/3952171459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1854330 0x1851280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 >> 172.21.15.153:0/3952171459 conn(0x1633680 msgr2=0x1894680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e68ff9700 0 client.10512 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:17:56.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 shutdown_connections 2023-08-17T00:17:56.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 1 -- 172.21.15.153:0/3952171459 wait complete. 2023-08-17T00:17:56.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e9a88d740 20 client.10512 trim_cache size 0 max 16384 2023-08-17T00:17:56.429 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:17:56.429 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "IDLE (waiting for more scrubs)", 2023-08-17T00:17:56.429 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": { 2023-08-17T00:17:56.429 INFO:teuthology.orchestra.run.smithi153.stdout: "64e5de8e-522c-4704-b474-68049c82735a": { 2023-08-17T00:17:56.429 INFO:teuthology.orchestra.run.smithi153.stdout: "path": "/", 2023-08-17T00:17:56.429 INFO:teuthology.orchestra.run.smithi153.stdout: "tag": "64e5de8e-522c-4704-b474-68049c82735a", 2023-08-17T00:17:56.430 INFO:teuthology.orchestra.run.smithi153.stdout: "options": "recursive,repair" 2023-08-17T00:17:56.430 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:56.430 INFO:teuthology.orchestra.run.smithi153.stdout: } 2023-08-17T00:17:56.430 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:17:56.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e6c05a150 msgr2=0x7f2e6c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e6c05a150 0x7f2e6c05c610 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f2e84009130 tx=0x7f2e84017000).stop 2023-08-17T00:17:56.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 msgr2=0x7f2e88168dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:17:56.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e88168dd0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 rx=0x7f2e8000c7c0 tx=0x7f2e80001510).stop 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 shutdown_connections 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f2e6c05a150 0x7f2e6c05c610 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f2e880a8df0 0x7f2e88168dd0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2e88068820 0x7f2e881688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 --2- 172.21.15.153:0/2718055923 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2e88061fa0 0x7f2e880bd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.414+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 >> 172.21.15.153:0/2718055923 conn(0x7f2e880c6620 msgr2=0x7f2e880645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:17:56.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.418+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 shutdown_connections 2023-08-17T00:17:56.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:17:56.418+0000 7f2e8f2b9700 1 -- 172.21.15.153:0/2718055923 wait complete. 2023-08-17T00:17:56.441 INFO:tasks.cephfs.filesystem:scrub status for tag:64e5de8e-522c-4704-b474-68049c82735a - {'path': '/', 'tag': '64e5de8e-522c-4704-b474-68049c82735a', 'options': 'recursive,repair'} 2023-08-17T00:18:18.012 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:18:18.020 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:18:26.442 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-08-17T00:18:26.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.609+0000 7f5469d07700 1 Processor -- start 2023-08-17T00:18:26.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.609+0000 7f5469d07700 1 -- start start 2023-08-17T00:18:26.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5464063bc0 0x7f546415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469d07700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5464154e90 con 0x7f54640c5ea0 2023-08-17T00:18:26.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469d07700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5464153fc0 con 0x7f54640acf30 2023-08-17T00:18:26.619 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640c1730 con 0x7f5464063bc0 2023-08-17T00:18:26.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5463fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f54640c5ea0 0x7f54640634b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49300/0 (socket says 172.21.15.153:49300) 2023-08-17T00:18:26.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5463fff700 1 -- 172.21.15.153:0/2919063503 learned_addr learned my addr 172.21.15.153:0/2919063503 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:26.620 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469506700 1 --2- 172.21.15.153:0/2919063503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5464063bc0 0x7f546415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f54637fe700 1 -- 172.21.15.153:0/2919063503 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590626646 0 0) 0x7f5464154e90 con 0x7f54640c5ea0 2023-08-17T00:18:26.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469506700 1 -- 172.21.15.153:0/2919063503 >> v1:172.21.15.178:6789/0 conn(0x7f54640acf30 legacy=0x7f54640c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.621 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469506700 1 -- 172.21.15.153:0/2919063503 >> v1:172.21.15.153:6789/0 conn(0x7f54640c5ea0 legacy=0x7f54640634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469506700 1 -- 172.21.15.153:0/2919063503 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464154280 con 0x7f5464063bc0 2023-08-17T00:18:26.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f5469506700 1 --2- 172.21.15.153:0/2919063503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5464063bc0 0x7f546415e660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f545c009e90 tx=0x7f545c009780).ready entity=mon.2 client_cookie=d9c10be1bae5852e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.622 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f54637fe700 1 -- 172.21.15.153:0/2919063503 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00e070 con 0x7f5464063bc0 2023-08-17T00:18:26.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f54637fe700 1 -- 172.21.15.153:0/2919063503 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00bc30 con 0x7f5464063bc0 2023-08-17T00:18:26.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.613+0000 7f54637fe700 1 -- 172.21.15.153:0/2919063503 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c012410 con 0x7f5464063bc0 2023-08-17T00:18:26.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 -- 172.21.15.153:0/2919063503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5464063bc0 msgr2=0x7f546415e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.623 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 --2- 172.21.15.153:0/2919063503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5464063bc0 0x7f546415e660 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f545c009e90 tx=0x7f545c009780).stop 2023-08-17T00:18:26.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 -- 172.21.15.153:0/2919063503 shutdown_connections 2023-08-17T00:18:26.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 --2- 172.21.15.153:0/2919063503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5464063bc0 0x7f546415e660 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 -- 172.21.15.153:0/2919063503 >> 172.21.15.153:0/2919063503 conn(0x7f54640cb330 msgr2=0x7f54640c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:26.624 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 -- 172.21.15.153:0/2919063503 shutdown_connections 2023-08-17T00:18:26.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.617+0000 7f5469d07700 1 -- 172.21.15.153:0/2919063503 wait complete. 2023-08-17T00:18:26.625 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 Processor -- start 2023-08-17T00:18:26.626 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 -- start start 2023-08-17T00:18:26.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 0x7f54641685a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.628 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54640acf30 0x7f54640c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54640af990 0x7f54640afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640c3b40 con 0x7f5464063bc0 2023-08-17T00:18:26.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b02e0 con 0x7f54640af990 2023-08-17T00:18:26.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469d07700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640c3870 con 0x7f54640acf30 2023-08-17T00:18:26.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5468d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 0x7f54641685a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5468d05700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 0x7f54641685a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45636/0 (socket says 172.21.15.153:45636) 2023-08-17T00:18:26.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5468d05700 1 -- 172.21.15.153:0/2487742584 learned_addr learned my addr 172.21.15.153:0/2487742584 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:26.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5463fff700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54640acf30 0x7f54640c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.630 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.621+0000 7f5469506700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54640af990 0x7f54640afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5468d05700 1 -- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54640acf30 msgr2=0x7f54640c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.631 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5468d05700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54640acf30 0x7f54640c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5468d05700 1 -- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54640af990 msgr2=0x7f54640afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5468d05700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54640af990 0x7f54640afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5468d05700 1 -- 172.21.15.153:0/2487742584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c009a20 con 0x7f5464063bc0 2023-08-17T00:18:26.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5468d05700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 0x7f54641685a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f545800c4c0 tx=0x7f5458007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5460ff9700 1 -- 172.21.15.153:0/2487742584 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545800ce70 con 0x7f5464063bc0 2023-08-17T00:18:26.632 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5460ff9700 1 -- 172.21.15.153:0/2487742584 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5458001e90 con 0x7f5464063bc0 2023-08-17T00:18:26.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54640c3e70 con 0x7f5464063bc0 2023-08-17T00:18:26.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5460ff9700 1 -- 172.21.15.153:0/2487742584 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5458007250 con 0x7f5464063bc0 2023-08-17T00:18:26.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.625+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54640c4430 con 0x7f5464063bc0 2023-08-17T00:18:26.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.629+0000 7f5460ff9700 1 -- 172.21.15.153:0/2487742584 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5458010070 con 0x7f5464063bc0 2023-08-17T00:18:26.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.629+0000 7f5460ff9700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f544805a150 0x7f544805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.629+0000 7f5460ff9700 1 -- 172.21.15.153:0/2487742584 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f5458073a20 con 0x7f5464063bc0 2023-08-17T00:18:26.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.629+0000 7f5463fff700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f544805a150 0x7f544805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.629+0000 7f5463fff700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f544805a150 0x7f544805c610 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f54640c2ea0 tx=0x7f5450007dd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 Processor -- start 2023-08-17T00:18:26.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 -- start start 2023-08-17T00:18:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203a9f0 0x201f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 0x1ff45b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x1ff5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f451a0 con 0x1ff9330 2023-08-17T00:18:26.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x203b9b0 con 0x203a9f0 2023-08-17T00:18:26.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x201f960 con 0x203add0 2023-08-17T00:18:26.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 0x1ff45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 0x1ff45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45644/0 (socket says 172.21.15.153:45644) 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 -- 172.21.15.153:0/1477461826 learned_addr learned my addr 172.21.15.153:0/1477461826 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5469506700 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x1ff5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5468d05700 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203a9f0 0x201f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 -- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 msgr2=0x1ff5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x1ff5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 -- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203a9f0 msgr2=0x201f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203a9f0 0x201f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 -- 172.21.15.153:0/1477461826 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f73010 con 0x1ff9330 2023-08-17T00:18:26.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f5463fff700 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 0x1ff45b0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f54500147c0 tx=0x7f5450013000).ready entity=mon.0 client_cookie=54435fddd589ad34 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f544dffb700 1 -- 172.21.15.153:0/1477461826 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450014e00 con 0x1ff9330 2023-08-17T00:18:26.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f544dffb700 1 -- 172.21.15.153:0/1477461826 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450014240 con 0x1ff9330 2023-08-17T00:18:26.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.633+0000 7f544dffb700 1 -- 172.21.15.153:0/1477461826 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450020660 con 0x1ff9330 2023-08-17T00:18:26.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- 172.21.15.153:0/1477461826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 msgr2=0x1ff45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 0x1ff45b0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 rx=0x7f54500147c0 tx=0x7f5450013000).stop 2023-08-17T00:18:26.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- 172.21.15.153:0/1477461826 shutdown_connections 2023-08-17T00:18:26.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x1ff5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x1ff9330 0x1ff45b0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- 172.21.15.153:0/1477461826 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203a9f0 0x201f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- 172.21.15.153:0/1477461826 >> 172.21.15.153:0/1477461826 conn(0x1dd8680 msgr2=0x203ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:26.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- 172.21.15.153:0/1477461826 shutdown_connections 2023-08-17T00:18:26.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- 172.21.15.153:0/1477461826 wait complete. 2023-08-17T00:18:26.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- start start 2023-08-17T00:18:26.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 Processor -- start 2023-08-17T00:18:26.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x204c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x1ff6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203add0 0x201c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x204b7c0 con 0x203a9f0 2023-08-17T00:18:26.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ff79c0 con 0x203add0 2023-08-17T00:18:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x20225d0 con 0x1ff9330 2023-08-17T00:18:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.637+0000 7f5475325740 10 client.0 ll_register_callbacks cb 0x1fb0400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:18:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x1ff6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x1ff6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45646/0 (socket says 172.21.15.153:45646) 2023-08-17T00:18:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 -- 172.21.15.153:0/3289859451 learned_addr learned my addr 172.21.15.153:0/3289859451 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:26.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5468d05700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x204c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5469506700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203add0 0x201c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 -- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 msgr2=0x204c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x204c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 -- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203add0 msgr2=0x201c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203add0 0x201c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 -- 172.21.15.153:0/3289859451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5450014460 con 0x203a9f0 2023-08-17T00:18:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5463fff700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x1ff6e90 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f5450017000 tx=0x7f5450016000).ready entity=mon.0 client_cookie=b5cc0bc2f702f709 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:18:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5442ffd700 1 -- 172.21.15.153:0/3289859451 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450024070 con 0x203a9f0 2023-08-17T00:18:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5442ffd700 1 -- 172.21.15.153:0/3289859451 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f5450014e00 con 0x203a9f0 2023-08-17T00:18:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1f41200 con 0x203a9f0 2023-08-17T00:18:26.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5442ffd700 1 -- 172.21.15.153:0/3289859451 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5450027040 con 0x203a9f0 2023-08-17T00:18:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 10 client.10524 fetch_fsmap learned FSMap version 153 2023-08-17T00:18:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x1f6e4b0 con 0x203a9f0 2023-08-17T00:18:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5442ffd700 1 -- 172.21.15.153:0/3289859451 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1f41200 con 0x203a9f0 2023-08-17T00:18:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5442ffd700 1 -- 172.21.15.153:0/3289859451 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f545002a020 con 0x203a9f0 2023-08-17T00:18:26.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 10 client.10524 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:18:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 10 client.10524 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:18:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 20 client.10524 populate_metadata read hostname 'smithi153' 2023-08-17T00:18:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x20217f0 0x2021bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 4 client.10524 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:18:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1f6fcf0 con 0x20217f0 2023-08-17T00:18:26.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.641+0000 7f5468d05700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x20217f0 0x2021bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5468d05700 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x20217f0 0x2021bd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=db8ba03a695db219 server_cookie=6b812cf6ad5ad945 in_seq=0 out_seq=0 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5442ffd700 10 client.10524 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5442ffd700 1 -- 172.21.15.153:0/3289859451 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x1f6fcf0 con 0x20217f0 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5442ffd700 10 client.10524 handle_command_reply: tid=0 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 client.10524 shutdown 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 msgr2=0x1ff6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x1ff6e90 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 rx=0x7f5450017000 tx=0x7f5450016000).stop 2023-08-17T00:18:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 shutdown_connections 2023-08-17T00:18:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x20217f0 0x2021bd0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203add0 0x201c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5442ffd700 0 client.10524 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x1ff6e90 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 --2- 172.21.15.153:0/3289859451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x204c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 >> 172.21.15.153:0/3289859451 conn(0x1dd8680 msgr2=0x203d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:26.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 shutdown_connections 2023-08-17T00:18:26.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 1 -- 172.21.15.153:0/3289859451 wait complete. 2023-08-17T00:18:26.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.645+0000 7f5475325740 20 client.10524 trim_cache size 0 max 16384 2023-08-17T00:18:26.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.661+0000 7f5475325740 1 Processor -- start 2023-08-17T00:18:26.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.661+0000 7f5475325740 1 -- start start 2023-08-17T00:18:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ff9330 0x203f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x2024dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x2039860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ff89d0 con 0x203a9f0 2023-08-17T00:18:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fbf540 con 0x1ff9330 2023-08-17T00:18:26.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fbc240 con 0x203add0 2023-08-17T00:18:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x2024dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x2024dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45658/0 (socket says 172.21.15.153:45658) 2023-08-17T00:18:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 -- 172.21.15.153:0/2400996722 learned_addr learned my addr 172.21.15.153:0/2400996722 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5468d05700 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ff9330 0x203f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5469506700 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x2039860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 -- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 msgr2=0x2039860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x2039860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 -- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ff9330 msgr2=0x203f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ff9330 0x203f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 -- 172.21.15.153:0/2400996722 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1f6e200 con 0x203a9f0 2023-08-17T00:18:26.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5463fff700 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x2024dd0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f5450013900 tx=0x7f5450029000).ready entity=mon.0 client_cookie=fbe9085010a16d4e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f544e7fc700 1 -- 172.21.15.153:0/2400996722 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450024020 con 0x203a9f0 2023-08-17T00:18:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f544e7fc700 1 -- 172.21.15.153:0/2400996722 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450018030 con 0x203a9f0 2023-08-17T00:18:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f544e7fc700 1 -- 172.21.15.153:0/2400996722 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500062c0 con 0x203a9f0 2023-08-17T00:18:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- 172.21.15.153:0/2400996722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 msgr2=0x2024dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x2024dd0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 rx=0x7f5450013900 tx=0x7f5450029000).stop 2023-08-17T00:18:26.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- 172.21.15.153:0/2400996722 shutdown_connections 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x203add0 0x2039860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203a9f0 0x2024dd0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 --2- 172.21.15.153:0/2400996722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x1ff9330 0x203f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- 172.21.15.153:0/2400996722 >> 172.21.15.153:0/2400996722 conn(0x1dd8680 msgr2=0x2021bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- 172.21.15.153:0/2400996722 shutdown_connections 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.665+0000 7f5475325740 1 -- 172.21.15.153:0/2400996722 wait complete. 2023-08-17T00:18:26.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 -- start start 2023-08-17T00:18:26.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 Processor -- start 2023-08-17T00:18:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x2096e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 0x203e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203ee50 0x203f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x209cfe0 con 0x203add0 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x20392e0 con 0x203ee50 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x209b810 con 0x1ff9330 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 10 client.0 ll_register_callbacks cb 0x7f54500143b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 0x203e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 0x203e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45664/0 (socket says 172.21.15.153:45664) 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 -- 172.21.15.153:0/3487740011 learned_addr learned my addr 172.21.15.153:0/3487740011 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5468d05700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x2096e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5469506700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203ee50 0x203f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 -- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 msgr2=0x2096e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x2096e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 -- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203ee50 msgr2=0x203f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:26.683 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203ee50 0x203f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 -- 172.21.15.153:0/3487740011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1f6e4b0 con 0x203add0 2023-08-17T00:18:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5463fff700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 0x203e960 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f5450013880 tx=0x7f5450006040).ready entity=mon.0 client_cookie=26729f8144c1c906 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5442ffd700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:18:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5442ffd700 1 -- 172.21.15.153:0/3487740011 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450024030 con 0x203add0 2023-08-17T00:18:26.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5450014240 con 0x203add0 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5442ffd700 1 -- 172.21.15.153:0/3487740011 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f54500145f0 con 0x203add0 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5442ffd700 1 -- 172.21.15.153:0/3487740011 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7f545003b070 con 0x203add0 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 10 client.10530 fetch_fsmap learned FSMap version 153 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.669+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x1e76980 con 0x203add0 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5442ffd700 1 -- 172.21.15.153:0/3487740011 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450014240 con 0x203add0 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5442ffd700 1 -- 172.21.15.153:0/3487740011 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f545003e030 con 0x203add0 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 10 client.10530 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:18:26.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 10 client.10530 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-08-17T00:18:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 20 client.10530 populate_metadata read hostname 'smithi153' 2023-08-17T00:18:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2049e90 0x204a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:26.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 4 client.10530 mds_command: new command op to 10353 tid=0[{"prefix": "scrub status"}] 2023-08-17T00:18:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1f66240 con 0x2049e90 2023-08-17T00:18:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5468d05700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2049e90 0x204a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5442ffd700 10 client.10530 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:26.687 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5468d05700 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2049e90 0x204a2a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1e6004ebea469107 server_cookie=c1f090a0298f05ac in_seq=0 out_seq=0 2023-08-17T00:18:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5442ffd700 1 -- 172.21.15.153:0/3487740011 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1f66240 con 0x2049e90 2023-08-17T00:18:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5442ffd700 10 client.10530 handle_command_reply: tid=0 2023-08-17T00:18:26.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 client.10530 shutdown 2023-08-17T00:18:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 msgr2=0x203e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 0x203e960 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 rx=0x7f5450013880 tx=0x7f5450006040).stop 2023-08-17T00:18:26.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 shutdown_connections 2023-08-17T00:18:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2049e90 0x204a2a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x203ee50 0x203f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x203add0 0x203e960 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5442ffd700 0 client.10530 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 --2- 172.21.15.153:0/3487740011 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x1ff9330 0x2096e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 >> 172.21.15.153:0/3487740011 conn(0x1dd8680 msgr2=0x2021bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 shutdown_connections 2023-08-17T00:18:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 1 -- 172.21.15.153:0/3487740011 wait complete. 2023-08-17T00:18:26.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.673+0000 7f5475325740 20 client.10530 trim_cache size 0 max 16384 2023-08-17T00:18:26.692 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:26.693 INFO:teuthology.orchestra.run.smithi153.stdout: "status": "no active scrubs running", 2023-08-17T00:18:26.693 INFO:teuthology.orchestra.run.smithi153.stdout: "scrubs": {} 2023-08-17T00:18:26.693 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f544805a150 msgr2=0x7f544805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f544805a150 0x7f544805c610 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f54640c2ea0 tx=0x7f5450007dd0).stop 2023-08-17T00:18:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 msgr2=0x7f54641685a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:26.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 0x7f54641685a0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 rx=0x7f545800c4c0 tx=0x7f5458007e00).stop 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 shutdown_connections 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f544805a150 0x7f544805c610 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54640af990 0x7f54640afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54640acf30 0x7f54640c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 --2- 172.21.15.153:0/2487742584 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5464063bc0 0x7f54641685a0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 >> 172.21.15.153:0/2487742584 conn(0x7f54640cb330 msgr2=0x7f54640abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:26.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 shutdown_connections 2023-08-17T00:18:26.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:26.677+0000 7f5469d07700 1 -- 172.21.15.153:0/2487742584 wait complete. 2023-08-17T00:18:26.701 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-08-17T00:18:27.103 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:18:27.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 Processor -- start 2023-08-17T00:18:27.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 -- start start 2023-08-17T00:18:27.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670151760 0x7f4670151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4670063320 0x7f46700c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4670063780 0x7f46700c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4670062e90 con 0x7f4670063320 2023-08-17T00:18:27.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4670061fa0 con 0x7f4670063780 2023-08-17T00:18:27.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4678569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4670062280 con 0x7f4670151760 2023-08-17T00:18:27.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4675b04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4670063320 0x7f46700c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.274 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4675b04700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4670063320 0x7f46700c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45670/0 (socket says 172.21.15.153:45670) 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.265+0000 7f4675b04700 1 -- 172.21.15.153:0/4222332425 learned_addr learned my addr 172.21.15.153:0/4222332425 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4676b06700 1 --2- 172.21.15.153:0/4222332425 >> v2:172.21.15.178:3300/0 conn(0x7f4670063780 0x7f46700c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4676305700 1 --2- 172.21.15.153:0/4222332425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670151760 0x7f4670151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675b04700 1 -- 172.21.15.153:0/4222332425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670151760 msgr2=0x7f4670151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675b04700 1 --2- 172.21.15.153:0/4222332425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670151760 0x7f4670151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675b04700 1 -- 172.21.15.153:0/4222332425 >> v2:172.21.15.178:3300/0 conn(0x7f4670063780 msgr2=0x7f46700c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.275 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675b04700 1 --2- 172.21.15.153:0/4222332425 >> v2:172.21.15.178:3300/0 conn(0x7f4670063780 0x7f46700c2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675b04700 1 -- 172.21.15.153:0/4222332425 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4670062560 con 0x7f4670063320 2023-08-17T00:18:27.276 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675b04700 1 --2- 172.21.15.153:0/4222332425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063320 0x7f46700c2630 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f4670062e00 tx=0x7f46600090f0).ready entity=mon.0 client_cookie=30e339c6e8403df8 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675303700 1 -- 172.21.15.153:0/4222332425 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000b520 con 0x7f4670063320 2023-08-17T00:18:27.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675303700 1 -- 172.21.15.153:0/4222332425 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000b680 con 0x7f4670063320 2023-08-17T00:18:27.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4675303700 1 -- 172.21.15.153:0/4222332425 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000ba20 con 0x7f4670063320 2023-08-17T00:18:27.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 -- 172.21.15.153:0/4222332425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063320 msgr2=0x7f46700c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 --2- 172.21.15.153:0/4222332425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063320 0x7f46700c2630 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 rx=0x7f4670062e00 tx=0x7f46600090f0).stop 2023-08-17T00:18:27.277 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 -- 172.21.15.153:0/4222332425 shutdown_connections 2023-08-17T00:18:27.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 --2- 172.21.15.153:0/4222332425 >> v2:172.21.15.178:3300/0 conn(0x7f4670063780 0x7f46700c2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 --2- 172.21.15.153:0/4222332425 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063320 0x7f46700c2630 unknown :-1 s=CLOSED pgs=2061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 --2- 172.21.15.153:0/4222332425 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670151760 0x7f4670151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 -- 172.21.15.153:0/4222332425 >> 172.21.15.153:0/4222332425 conn(0x7f46700c30b0 msgr2=0x7f46700c34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 -- 172.21.15.153:0/4222332425 shutdown_connections 2023-08-17T00:18:27.278 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.269+0000 7f4678569700 1 -- 172.21.15.153:0/4222332425 wait complete. 2023-08-17T00:18:27.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.273+0000 7f4678569700 1 Processor -- start 2023-08-17T00:18:27.280 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.273+0000 7f4678569700 1 -- start start 2023-08-17T00:18:27.281 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670063320 0x7f4670165220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 0x7f46701422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4670151760 0x7f46701538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700a3bd0 con 0x7f4670063780 2023-08-17T00:18:27.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46700a3f40 con 0x7f4670151760 2023-08-17T00:18:27.282 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4670165710 con 0x7f4670063320 2023-08-17T00:18:27.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 0x7f46701422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 0x7f46701422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45684/0 (socket says 172.21.15.153:45684) 2023-08-17T00:18:27.283 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 -- 172.21.15.153:0/2351499812 learned_addr learned my addr 172.21.15.153:0/2351499812 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4676b06700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4670151760 0x7f46701538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4676305700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670063320 0x7f4670165220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 -- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670063320 msgr2=0x7f4670165220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670063320 0x7f4670165220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 -- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4670151760 msgr2=0x7f46701538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4670151760 0x7f46701538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 -- 172.21.15.153:0/2351499812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009370 con 0x7f4670063780 2023-08-17T00:18:27.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4675b04700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 0x7f46701422b0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f46700bd610 tx=0x7f4660017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660006d90 con 0x7f4670063780 2023-08-17T00:18:27.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4660000bc0 con 0x7f4670063780 2023-08-17T00:18:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466001c420 con 0x7f4670063780 2023-08-17T00:18:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46700c5a60 con 0x7f4670063780 2023-08-17T00:18:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.277+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46700c6020 con 0x7f4670063780 2023-08-17T00:18:27.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.281+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46700c61e0 con 0x7f4670063780 2023-08-17T00:18:27.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.281+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f466002c070 con 0x7f4670063780 2023-08-17T00:18:27.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.281+0000 7f46667fc700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f465405a150 0x7f465405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.281+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f4660075cd0 con 0x7f4670063780 2023-08-17T00:18:27.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.285+0000 7f4676305700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f465405a150 0x7f465405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.285+0000 7f4676305700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f465405a150 0x7f465405c610 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f4670151230 tx=0x7f466c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.289+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f46700c61e0 con 0x7f4670063780 2023-08-17T00:18:27.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.485+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46700a40d0 con 0x7f4670063780 2023-08-17T00:18:27.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f46667fc700 1 -- 172.21.15.153:0/2351499812 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f466002a020 con 0x7f4670063780 2023-08-17T00:18:27.494 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:27.494 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:23.488626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:18:27.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f465405a150 msgr2=0x7f465405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f465405a150 0x7f465405c610 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 rx=0x7f4670151230 tx=0x7f466c008040).stop 2023-08-17T00:18:27.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 msgr2=0x7f46701422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 0x7f46701422b0 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 rx=0x7f46700bd610 tx=0x7f4660017000).stop 2023-08-17T00:18:27.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 shutdown_connections 2023-08-17T00:18:27.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f465405a150 0x7f465405c610 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4670151760 0x7f46701538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4670063780 0x7f46701422b0 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 --2- 172.21.15.153:0/2351499812 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4670063320 0x7f4670165220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 >> 172.21.15.153:0/2351499812 conn(0x7f46700c30b0 msgr2=0x7f46701555d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 shutdown_connections 2023-08-17T00:18:27.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.489+0000 7f4678569700 1 -- 172.21.15.153:0/2351499812 wait complete. 2023-08-17T00:18:27.500 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 153 2023-08-17T00:18:27.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 153, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-17T00:17:04.011993+0000', 'modified': '2023-08-17T00:17:23.488626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 193, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10353}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10353': {'gid': 10353, 'name': 'c', 'rank': 0, 'incarnation': 150, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.153:6835/214968761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.153:6833', 'nonce': 214968761}, {'type': 'v1', 'addr': '172.21.15.153:6835', 'nonce': 214968761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138314316775423, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-08-17T00:18:27.516 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-17T00:18:27.516 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-08-17T00:18:27.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.665+0000 7fb15759e700 1 Processor -- start 2023-08-17T00:18:27.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.665+0000 7fb15759e700 1 -- start start 2023-08-17T00:18:27.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15759e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1580a8df0 0x7fb1580c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb158068820 0x7fb158068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb158062400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1581585a0 con 0x7fb158068820 2023-08-17T00:18:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15759e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb158066400 con 0x7fb1580a8df0 2023-08-17T00:18:27.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb158069170 con 0x7fb158061fa0 2023-08-17T00:18:27.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb158068820 0x7fb158068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fb158068820 0x7fb158068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45686/0 (socket says 172.21.15.153:45686) 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 -- 172.21.15.153:0/3586166199 learned_addr learned my addr 172.21.15.153:0/3586166199 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb156d9d700 1 --2- 172.21.15.153:0/3586166199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb158062400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15659c700 1 --2- 172.21.15.153:0/3586166199 >> v2:172.21.15.178:3300/0 conn(0x7fb1580a8df0 0x7fb1580c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 -- 172.21.15.153:0/3586166199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 msgr2=0x7fb158062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 --2- 172.21.15.153:0/3586166199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb158062400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 -- 172.21.15.153:0/3586166199 >> v2:172.21.15.178:3300/0 conn(0x7fb1580a8df0 msgr2=0x7fb1580c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 --2- 172.21.15.153:0/3586166199 >> v2:172.21.15.178:3300/0 conn(0x7fb1580a8df0 0x7fb1580c1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 -- 172.21.15.153:0/3586166199 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580b9d30 con 0x7fb158068820 2023-08-17T00:18:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15659c700 1 --2- 172.21.15.153:0/3586166199 >> v2:172.21.15.178:3300/0 conn(0x7fb1580a8df0 0x7fb1580c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb155d9b700 1 --2- 172.21.15.153:0/3586166199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158068c80 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fb1580c3f30 tx=0x7fb14c0090f0).ready entity=mon.0 client_cookie=1a9d43862b03b555 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15559a700 1 -- 172.21.15.153:0/3586166199 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00b520 con 0x7fb158068820 2023-08-17T00:18:27.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15559a700 1 -- 172.21.15.153:0/3586166199 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00b680 con 0x7fb158068820 2023-08-17T00:18:27.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.669+0000 7fb15559a700 1 -- 172.21.15.153:0/3586166199 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c00ba00 con 0x7fb158068820 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 -- 172.21.15.153:0/3586166199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 msgr2=0x7fb158068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 --2- 172.21.15.153:0/3586166199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158068c80 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 rx=0x7fb1580c3f30 tx=0x7fb14c0090f0).stop 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 -- 172.21.15.153:0/3586166199 shutdown_connections 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 --2- 172.21.15.153:0/3586166199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb158062400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 --2- 172.21.15.153:0/3586166199 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158068c80 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 --2- 172.21.15.153:0/3586166199 >> v2:172.21.15.178:3300/0 conn(0x7fb1580a8df0 0x7fb1580c1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 -- 172.21.15.153:0/3586166199 >> 172.21.15.153:0/3586166199 conn(0x7fb1580c6620 msgr2=0x7fb1580c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 -- 172.21.15.153:0/3586166199 shutdown_connections 2023-08-17T00:18:27.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 -- 172.21.15.153:0/3586166199 wait complete. 2023-08-17T00:18:27.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 Processor -- start 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.673+0000 7fb15759e700 1 -- start start 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb15815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1580a8df0 0x7fb1580bc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15815cad0 con 0x7fb158068820 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb15815c7f0 con 0x7fb1580a8df0 2023-08-17T00:18:27.682 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580bd6d0 con 0x7fb158061fa0 2023-08-17T00:18:27.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45690/0 (socket says 172.21.15.153:45690) 2023-08-17T00:18:27.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 -- 172.21.15.153:0/3665111871 learned_addr learned my addr 172.21.15.153:0/3665111871 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15659c700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb15815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb156d9d700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1580a8df0 0x7fb1580bc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.684 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 -- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 msgr2=0x7fb15815bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb15815bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 -- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1580a8df0 msgr2=0x7fb1580bc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1580a8df0 0x7fb1580bc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 -- 172.21.15.153:0/3665111871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c009370 con 0x7fb158068820 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb155d9b700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158156cd0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7fb1580668e0 tx=0x7fb14c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb1467fc700 1 -- 172.21.15.153:0/3665111871 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c000bc0 con 0x7fb158068820 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb1467fc700 1 -- 172.21.15.153:0/3665111871 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14c00b7f0 con 0x7fb158068820 2023-08-17T00:18:27.685 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580bd9b0 con 0x7fb158068820 2023-08-17T00:18:27.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb1467fc700 1 -- 172.21.15.153:0/3665111871 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c000d20 con 0x7fb158068820 2023-08-17T00:18:27.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.677+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb15815c4b0 con 0x7fb158068820 2023-08-17T00:18:27.686 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.681+0000 7fb1467fc700 1 -- 172.21.15.153:0/3665111871 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fb14c02b070 con 0x7fb158068820 2023-08-17T00:18:27.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.681+0000 7fb1467fc700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb13805a150 0x7fb13805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.688 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.681+0000 7fb1467fc700 1 -- 172.21.15.153:0/3665111871 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fb14c0759b0 con 0x7fb158068820 2023-08-17T00:18:27.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.681+0000 7fb15659c700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb13805a150 0x7fb13805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.689 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb15659c700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb13805a150 0x7fb13805c610 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fb148006d20 tx=0x7fb148008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 Processor -- start 2023-08-17T00:18:27.690 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 -- start start 2023-08-17T00:18:27.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a3ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29fb380 0x29f98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.691 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a4a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x29695c0 con 0x29f9d90 2023-08-17T00:18:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x297ee90 con 0x2a3fb60 2023-08-17T00:18:27.692 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2945220 con 0x29fb380 2023-08-17T00:18:27.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a4a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a4a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45694/0 (socket says 172.21.15.153:45694) 2023-08-17T00:18:27.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 -- 172.21.15.153:0/284561659 learned_addr learned my addr 172.21.15.153:0/284561659 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.693 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb155d9b700 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29fb380 0x29f98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb15659c700 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a3ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 -- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29fb380 msgr2=0x29f98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29fb380 0x29f98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 -- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 msgr2=0x2a3ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a3ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 -- 172.21.15.153:0/284561659 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x298a500 con 0x29f9d90 2023-08-17T00:18:27.694 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb155d9b700 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29fb380 0x29f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:27.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb156d9d700 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a4a760 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7fb1500074e0 tx=0x7fb15000b040).ready entity=mon.0 client_cookie=6dfa2fb9d0bfb2d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb1377fe700 1 -- 172.21.15.153:0/284561659 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000e070 con 0x29f9d90 2023-08-17T00:18:27.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb1377fe700 1 -- 172.21.15.153:0/284561659 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150007e90 con 0x29f9d90 2023-08-17T00:18:27.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.685+0000 7fb1377fe700 1 -- 172.21.15.153:0/284561659 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500136d0 con 0x29f9d90 2023-08-17T00:18:27.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 -- 172.21.15.153:0/284561659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 msgr2=0x2a4a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a4a760 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 rx=0x7fb1500074e0 tx=0x7fb15000b040).stop 2023-08-17T00:18:27.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 -- 172.21.15.153:0/284561659 shutdown_connections 2023-08-17T00:18:27.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a4a760 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29fb380 0x29f98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.696 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 --2- 172.21.15.153:0/284561659 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a3ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 -- 172.21.15.153:0/284561659 >> 172.21.15.153:0/284561659 conn(0x27dd550 msgr2=0x29fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 -- 172.21.15.153:0/284561659 shutdown_connections 2023-08-17T00:18:27.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 -- 172.21.15.153:0/284561659 wait complete. 2023-08-17T00:18:27.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 -- start start 2023-08-17T00:18:27.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.689+0000 7fb166ffc740 1 Processor -- start 2023-08-17T00:18:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29f9d90 0x2a41990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a235c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a23ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x294a110 con 0x29fb380 2023-08-17T00:18:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a42c10 con 0x2a3fb60 2023-08-17T00:18:27.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a42650 con 0x29f9d90 2023-08-17T00:18:27.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 10 client.0 ll_register_callbacks cb 0x29b63c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:18:27.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a235c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a235c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45708/0 (socket says 172.21.15.153:45708) 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 -- 172.21.15.153:0/547654657 learned_addr learned my addr 172.21.15.153:0/547654657 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb156d9d700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a23ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb15659c700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29f9d90 0x2a41990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 -- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29f9d90 msgr2=0x2a41990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29f9d90 0x2a41990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 -- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 msgr2=0x2a23ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a23ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 -- 172.21.15.153:0/547654657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb150009e70 con 0x29fb380 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb156d9d700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a23ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb15659c700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29f9d90 0x2a41990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb155d9b700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a235c0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fb14c00c010 tx=0x7fb14c075040).ready entity=mon.0 client_cookie=1bc7af14b650b938 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 1 -- 172.21.15.153:0/547654657 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14c0495c0 con 0x29fb380 2023-08-17T00:18:27.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 1 -- 172.21.15.153:0/547654657 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fb14c049720 con 0x29fb380 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2974c60 con 0x29fb380 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 1 -- 172.21.15.153:0/547654657 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb14c052570 con 0x29fb380 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 10 client.10548 fetch_fsmap learned FSMap version 153 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x2977f80 con 0x29fb380 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 1 -- 172.21.15.153:0/547654657 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2974c60 con 0x29fb380 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 1 -- 172.21.15.153:0/547654657 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb14c04c3a0 con 0x29fb380 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 10 client.10548 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:18:27.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 10 client.10548 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:18:27.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 20 client.10548 populate_metadata read hostname 'smithi153' 2023-08-17T00:18:27.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a29b80 0x2a2a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 4 client.10548 mds_command: new command op to 10353 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-17T00:18:27.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x296b1b0 con 0x2a29b80 2023-08-17T00:18:27.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb15659c700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a29b80 0x2a2a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb15659c700 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a29b80 0x2a2a830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=1e9e23dfc6125fcf server_cookie=de973025b55ad1cc in_seq=0 out_seq=0 2023-08-17T00:18:27.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.693+0000 7fb134ff9700 10 client.10548 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:27.705 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb134ff9700 1 -- 172.21.15.153:0/547654657 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17015 (crc 0 0 0) 0x296b1b0 con 0x2a29b80 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb134ff9700 10 client.10548 handle_command_reply: tid=0 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 client.10548 shutdown 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 msgr2=0x2a235c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a235c0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 rx=0x7fb14c00c010 tx=0x7fb14c075040).stop 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 shutdown_connections 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a29b80 0x2a2a830 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.706 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a3fb60 0x2a23ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a235c0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 --2- 172.21.15.153:0/547654657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x29f9d90 0x2a41990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 >> 172.21.15.153:0/547654657 conn(0x27dd550 msgr2=0x2a45ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb134ff9700 0 client.10548 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 shutdown_connections 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 1 -- 172.21.15.153:0/547654657 wait complete. 2023-08-17T00:18:27.707 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.697+0000 7fb166ffc740 20 client.10548 trim_cache size 0 max 16384 2023-08-17T00:18:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.713+0000 7fb166ffc740 1 Processor -- start 2023-08-17T00:18:27.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.713+0000 7fb166ffc740 1 -- start start 2023-08-17T00:18:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a3f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29fb380 0x2a3d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a3dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x29ff860 con 0x29f9d90 2023-08-17T00:18:27.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a3e3b0 con 0x29fb380 2023-08-17T00:18:27.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x29fd350 con 0x2a3fb60 2023-08-17T00:18:27.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a3f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a3f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45710/0 (socket says 172.21.15.153:45710) 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 -- 172.21.15.153:0/472479861 learned_addr learned my addr 172.21.15.153:0/472479861 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb156d9d700 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a3dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb155d9b700 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29fb380 0x2a3d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 -- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 msgr2=0x2a3dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a3dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.724 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 -- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29fb380 msgr2=0x2a3d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29fb380 0x2a3d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 -- 172.21.15.153:0/472479861 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580bd100 con 0x29f9d90 2023-08-17T00:18:27.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb15659c700 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a3f3b0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x2a2a040 tx=0x7fb148015000).ready entity=mon.0 client_cookie=c2106ff5820e5504 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb137fff700 1 -- 172.21.15.153:0/472479861 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148025a70 con 0x29f9d90 2023-08-17T00:18:27.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb137fff700 1 -- 172.21.15.153:0/472479861 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148025bd0 con 0x29f9d90 2023-08-17T00:18:27.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb137fff700 1 -- 172.21.15.153:0/472479861 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148014470 con 0x29f9d90 2023-08-17T00:18:27.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 -- 172.21.15.153:0/472479861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 msgr2=0x2a3f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.717+0000 7fb166ffc740 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a3f3b0 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 rx=0x2a2a040 tx=0x7fb148015000).stop 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- 172.21.15.153:0/472479861 shutdown_connections 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a3dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x29fb380 0x2a3d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 --2- 172.21.15.153:0/472479861 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29f9d90 0x2a3f3b0 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- 172.21.15.153:0/472479861 >> 172.21.15.153:0/472479861 conn(0x27dd550 msgr2=0x2a242a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- 172.21.15.153:0/472479861 shutdown_connections 2023-08-17T00:18:27.727 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- 172.21.15.153:0/472479861 wait complete. 2023-08-17T00:18:27.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- start start 2023-08-17T00:18:27.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 Processor -- start 2023-08-17T00:18:27.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a28420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a28910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.729 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5d0a0 0x2a5d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a9d8a0 con 0x29fb380 2023-08-17T00:18:27.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a28e00 con 0x2a5d0a0 2023-08-17T00:18:27.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.721+0000 7fb166ffc740 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aa7d10 con 0x2a3fb60 2023-08-17T00:18:27.730 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 10 client.0 ll_register_callbacks cb 0x7fb14c04ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-17T00:18:27.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a28420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a28420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45722/0 (socket says 172.21.15.153:45722) 2023-08-17T00:18:27.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 -- 172.21.15.153:0/1720395580 learned_addr learned my addr 172.21.15.153:0/1720395580 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb156d9d700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5d0a0 0x2a5d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 -- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 msgr2=0x2a28910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb155d9b700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a28910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a28910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 -- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5d0a0 msgr2=0x2a5d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5d0a0 0x2a5d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.732 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 -- 172.21.15.153:0/1720395580 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14800e040 con 0x29fb380 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb156d9d700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5d0a0 0x2a5d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb155d9b700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a28910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb15659c700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a28420 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fb148010ba0 tx=0x7fb148017000).ready entity=mon.0 client_cookie=cc8fc9a535c31b03 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 10 client.0 ms_handle_connect on v2:172.21.15.153:3300/0 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 1 -- 172.21.15.153:0/1720395580 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148005a90 con 0x29fb380 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb150007e90 con 0x29fb380 2023-08-17T00:18:27.733 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 1 -- 172.21.15.153:0/1720395580 <== mon.0 v2:172.21.15.153:3300/0 2 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fb14801c040 con 0x29fb380 2023-08-17T00:18:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 1 -- 172.21.15.153:0/1720395580 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_get_version_reply(handle=1 version=153) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb148005e00 con 0x29fb380 2023-08-17T00:18:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 10 client.10554 fetch_fsmap learned FSMap version 153 2023-08-17T00:18:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,fsmap=153,monmap=2+}) v3 -- 0x2973420 con 0x29fb380 2023-08-17T00:18:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 1 -- 172.21.15.153:0/1720395580 <== mon.0 v2:172.21.15.153:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150007e90 con 0x29fb380 2023-08-17T00:18:27.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 1 -- 172.21.15.153:0/1720395580 <== mon.0 v2:172.21.15.153:3300/0 5 ==== fsmap(e 153) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb148006040 con 0x29fb380 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 10 client.10554 fetch_fsmap finished waiting for FSMap version 153 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 10 client.10554 resolve_mds: resolved name 'c' to daemon mds.c 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 20 client.10554 populate_metadata read hostname 'smithi153' 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a5da10 0x2ab2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 4 client.10554 mds_command: new command op to 10353 tid=0[{"prefix": "status"}] 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 --> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] -- command(tid 0: {"prefix": "status"}) v1 -- 0x28344e0 con 0x2a5da10 2023-08-17T00:18:27.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb155d9b700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a5da10 0x2ab2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb155d9b700 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a5da10 0x2ab2d30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=8341fb8534ca15a0 server_cookie=b972854a35527273 in_seq=0 out_seq=0 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.725+0000 7fb134ff9700 10 client.10554 ms_handle_connect on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb134ff9700 1 -- 172.21.15.153:0/1720395580 <== mds.0 v2:172.21.15.153:6833/214968761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x28344e0 con 0x2a5da10 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb134ff9700 10 client.10554 handle_command_reply: tid=0 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 client.10554 shutdown 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 msgr2=0x2a28420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a28420 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 rx=0x7fb148010ba0 tx=0x7fb148017000).stop 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 shutdown_connections 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:6833/214968761,v1:172.21.15.153:6835/214968761] conn(0x2a5da10 0x2ab2d30 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x2a5d0a0 0x2a5d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x2a3fb60 0x2a28910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 --2- 172.21.15.153:0/1720395580 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x29fb380 0x2a28420 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 >> 172.21.15.153:0/1720395580 conn(0x27dd550 msgr2=0x29fb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb134ff9700 0 client.10554 ms_handle_reset on v2:172.21.15.153:6833/214968761 2023-08-17T00:18:27.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 shutdown_connections 2023-08-17T00:18:27.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 1 -- 172.21.15.153:0/1720395580 wait complete. 2023-08-17T00:18:27.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb166ffc740 20 client.10554 trim_cache size 0 max 16384 2023-08-17T00:18:27.739 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:27.739 INFO:teuthology.orchestra.run.smithi153.stdout: "cluster_fsid": "26772232-6872-4f9c-a0de-c26dcf774179", 2023-08-17T00:18:27.739 INFO:teuthology.orchestra.run.smithi153.stdout: "whoami": 0, 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "id": 10353, 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "want_state": "up:active", 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "state": "up:active", 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "fs_name": "cephfs", 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "rank_uptime": 67.265573739999994, 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "mdsmap_epoch": 153, 2023-08-17T00:18:27.740 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch": 195, 2023-08-17T00:18:27.741 INFO:teuthology.orchestra.run.smithi153.stdout: "osdmap_epoch_barrier": 193, 2023-08-17T00:18:27.741 INFO:teuthology.orchestra.run.smithi153.stdout: "uptime": 69.227756272999997 2023-08-17T00:18:27.741 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:27.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb13805a150 msgr2=0x7fb13805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb13805a150 0x7fb13805c610 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fb148006d20 tx=0x7fb148008040).stop 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 msgr2=0x7fb158156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158156cd0 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 rx=0x7fb1580668e0 tx=0x7fb14c017000).stop 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 shutdown_connections 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fb13805a150 0x7fb13805c610 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1580a8df0 0x7fb1580bc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fb158068820 0x7fb158156cd0 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 --2- 172.21.15.153:0/3665111871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb158061fa0 0x7fb15815bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:27.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 >> 172.21.15.153:0/3665111871 conn(0x7fb1580c6620 msgr2=0x7fb1580c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:27.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 shutdown_connections 2023-08-17T00:18:27.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:27.729+0000 7fb15759e700 1 -- 172.21.15.153:0/3665111871 wait complete. 2023-08-17T00:18:27.756 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-17T00:18:27.757 DEBUG:teuthology.orchestra.run.smithi153:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:18:27.798 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-17T00:18:27.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-17T00:18:27.843 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:18:28.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.001+0000 7f6c6ac39700 1 Processor -- start 2023-08-17T00:18:28.007 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.001+0000 7f6c6ac39700 1 -- start start 2023-08-17T00:18:28.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c6ac39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640a8df0 0x7f6c640c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c6ac39700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6c640aa6e0 0x7f6c64068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c6ac39700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c641585a0 con 0x7f6c64068820 2023-08-17T00:18:28.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c6ac39700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c64066400 con 0x7f6c640aa6e0 2023-08-17T00:18:28.011 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c6ac39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64069170 con 0x7f6c640a8df0 2023-08-17T00:18:28.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69436700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6c64068820 0x7f6c64061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49314/0 (socket says 172.21.15.153:49314) 2023-08-17T00:18:28.012 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69436700 1 -- 172.21.15.153:0/2666510413 learned_addr learned my addr 172.21.15.153:0/2666510413 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c6a438700 1 --2- 172.21.15.153:0/2666510413 >> v2:172.21.15.178:3300/0 conn(0x7f6c640aa6e0 0x7f6c64068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69c37700 1 --2- 172.21.15.153:0/2666510413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640a8df0 0x7f6c640c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c68c35700 1 -- 172.21.15.153:0/2666510413 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400452806 0 0) 0x7f6c641585a0 con 0x7f6c64068820 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c68c35700 1 -- 172.21.15.153:0/2666510413 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c500033f0 con 0x7f6c64068820 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69c37700 1 -- 172.21.15.153:0/2666510413 >> v2:172.21.15.178:3300/0 conn(0x7f6c640aa6e0 msgr2=0x7f6c64068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69c37700 1 --2- 172.21.15.153:0/2666510413 >> v2:172.21.15.178:3300/0 conn(0x7f6c640aa6e0 0x7f6c64068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.013 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69c37700 1 -- 172.21.15.153:0/2666510413 >> v1:172.21.15.153:6789/0 conn(0x7f6c64068820 legacy=0x7f6c64061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.014 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69c37700 1 -- 172.21.15.153:0/2666510413 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640b9d30 con 0x7f6c640a8df0 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c69c37700 1 --2- 172.21.15.153:0/2666510413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640a8df0 0x7f6c640c1490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f6c60006fd0 tx=0x7f6c60006f40).ready entity=mon.2 client_cookie=2902308f797c2558 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.005+0000 7f6c68c35700 1 -- 172.21.15.153:0/2666510413 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60005880 con 0x7f6c640a8df0 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c68c35700 1 -- 172.21.15.153:0/2666510413 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c600059e0 con 0x7f6c640a8df0 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c68c35700 1 -- 172.21.15.153:0/2666510413 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60005d60 con 0x7f6c640a8df0 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 -- 172.21.15.153:0/2666510413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640a8df0 msgr2=0x7f6c640c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/2666510413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640a8df0 0x7f6c640c1490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f6c60006fd0 tx=0x7f6c60006f40).stop 2023-08-17T00:18:28.015 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 -- 172.21.15.153:0/2666510413 shutdown_connections 2023-08-17T00:18:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/2666510413 >> v2:172.21.15.178:3300/0 conn(0x7f6c640aa6e0 0x7f6c64068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/2666510413 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c640a8df0 0x7f6c640c1490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 -- 172.21.15.153:0/2666510413 >> 172.21.15.153:0/2666510413 conn(0x7f6c640c6620 msgr2=0x7f6c640c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 -- 172.21.15.153:0/2666510413 shutdown_connections 2023-08-17T00:18:28.016 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 -- 172.21.15.153:0/2666510413 wait complete. 2023-08-17T00:18:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 Processor -- start 2023-08-17T00:18:28.017 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.009+0000 7f6c6ac39700 1 -- start start 2023-08-17T00:18:28.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c64068820 0x7f6c641571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640a8df0 0x7f6c640b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.018 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 0x7f6c6416ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c641598a0 con 0x7f6c640aa6e0 2023-08-17T00:18:28.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c640b6cd0 con 0x7f6c640a8df0 2023-08-17T00:18:28.019 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c64158c90 con 0x7f6c64068820 2023-08-17T00:18:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 0x7f6c6416ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 0x7f6c6416ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45724/0 (socket says 172.21.15.153:45724) 2023-08-17T00:18:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 -- 172.21.15.153:0/3043405857 learned_addr learned my addr 172.21.15.153:0/3043405857 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c69c37700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c64068820 0x7f6c641571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c69436700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640a8df0 0x7f6c640b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.020 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 -- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c64068820 msgr2=0x7f6c641571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c64068820 0x7f6c641571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 -- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640a8df0 msgr2=0x7f6c640b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640a8df0 0x7f6c640b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 -- 172.21.15.153:0/3043405857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60009250 con 0x7f6c640aa6e0 2023-08-17T00:18:28.021 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c69436700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640a8df0 0x7f6c640b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:28.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c69c37700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c64068820 0x7f6c641571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:28.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6a438700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 0x7f6c6416ba30 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f6c5c009e20 tx=0x7f6c5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00cc20 con 0x7f6c640aa6e0 2023-08-17T00:18:28.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c00f040 con 0x7f6c640aa6e0 2023-08-17T00:18:28.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c64158f70 con 0x7f6c640aa6e0 2023-08-17T00:18:28.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c013400 con 0x7f6c640aa6e0 2023-08-17T00:18:28.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.013+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c64159530 con 0x7f6c640aa6e0 2023-08-17T00:18:28.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.017+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c64159a50 con 0x7f6c640aa6e0 2023-08-17T00:18:28.025 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.017+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6c5c0137b0 con 0x7f6c640aa6e0 2023-08-17T00:18:28.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.017+0000 7f6c59ffb700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c4805a150 0x7f6c4805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.017+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f6c5c074d30 con 0x7f6c640aa6e0 2023-08-17T00:18:28.026 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.021+0000 7f6c69c37700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c4805a150 0x7f6c4805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.027 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.021+0000 7f6c69c37700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c4805a150 0x7f6c4805c610 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f6c60006f80 tx=0x7f6c60015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.032 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.025+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6c64159a50 con 0x7f6c640aa6e0 2023-08-17T00:18:28.222 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.217+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c64159a50 con 0x7f6c640aa6e0 2023-08-17T00:18:28.223 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.217+0000 7f6c59ffb700 1 -- 172.21.15.153:0/3043405857 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f6c64159a50 con 0x7f6c640aa6e0 2023-08-17T00:18:28.223 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:28.224 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:23.488626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:18:28.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c4805a150 msgr2=0x7f6c4805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.226 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c4805a150 0x7f6c4805c610 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 rx=0x7f6c60006f80 tx=0x7f6c60015000).stop 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 msgr2=0x7f6c6416ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 0x7f6c6416ba30 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 rx=0x7f6c5c009e20 tx=0x7f6c5c00b040).stop 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 shutdown_connections 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6c4805a150 0x7f6c4805c610 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6c640aa6e0 0x7f6c6416ba30 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c640a8df0 0x7f6c640b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 --2- 172.21.15.153:0/3043405857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c64068820 0x7f6c641571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.227 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 >> 172.21.15.153:0/3043405857 conn(0x7f6c640c6620 msgr2=0x7f6c640c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:28.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 shutdown_connections 2023-08-17T00:18:28.228 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.221+0000 7f6c6ac39700 1 -- 172.21.15.153:0/3043405857 wait complete. 2023-08-17T00:18:28.228 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 153 2023-08-17T00:18:28.245 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:18:28.403 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.397+0000 7f58fa29d700 1 Processor -- start 2023-08-17T00:18:28.404 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.397+0000 7f58fa29d700 1 -- start start 2023-08-17T00:18:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58fa29d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58f4068820 0x7f58f4068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58fa29d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 0x7f58f40a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58fa29d700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f41585a0 con 0x7f58f40a8df0 2023-08-17T00:18:28.406 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58fa29d700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40c1ba0 con 0x7f58f4068820 2023-08-17T00:18:28.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58fa29d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4066400 con 0x7f58f40a96d0 2023-08-17T00:18:28.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f8a9a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58f4068820 0x7f58f4068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.407 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 0x7f58f40a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 0x7f58f40a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:43666/0 (socket says 172.21.15.153:43666) 2023-08-17T00:18:28.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 -- 172.21.15.153:0/4152430185 learned_addr learned my addr 172.21.15.153:0/4152430185 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:28.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 -- 172.21.15.153:0/4152430185 >> v2:172.21.15.178:3300/0 conn(0x7f58f4068820 msgr2=0x7f58f4068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:28.408 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 --2- 172.21.15.153:0/4152430185 >> v2:172.21.15.178:3300/0 conn(0x7f58f4068820 0x7f58f4068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 -- 172.21.15.153:0/4152430185 >> v1:172.21.15.178:6789/0 conn(0x7f58f40a8df0 legacy=0x7f58f40c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 -- 172.21.15.153:0/4152430185 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4069170 con 0x7f58f40a96d0 2023-08-17T00:18:28.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58f9a9c700 1 --2- 172.21.15.153:0/4152430185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 0x7f58f40a9b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f58ec009f20 tx=0x7f58ec009840).ready entity=mon.2 client_cookie=906fe2e28173dcac server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.409 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58ebfff700 1 -- 172.21.15.153:0/4152430185 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00e070 con 0x7f58f40a96d0 2023-08-17T00:18:28.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58ebfff700 1 -- 172.21.15.153:0/4152430185 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec00b9d0 con 0x7f58f40a96d0 2023-08-17T00:18:28.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.401+0000 7f58ebfff700 1 -- 172.21.15.153:0/4152430185 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec00bd50 con 0x7f58f40a96d0 2023-08-17T00:18:28.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 -- 172.21.15.153:0/4152430185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 msgr2=0x7f58f40a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.410 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 --2- 172.21.15.153:0/4152430185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 0x7f58f40a9b30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f58ec009f20 tx=0x7f58ec009840).stop 2023-08-17T00:18:28.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 -- 172.21.15.153:0/4152430185 shutdown_connections 2023-08-17T00:18:28.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 --2- 172.21.15.153:0/4152430185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f40a96d0 0x7f58f40a9b30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.411 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 --2- 172.21.15.153:0/4152430185 >> v2:172.21.15.178:3300/0 conn(0x7f58f4068820 0x7f58f4068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 -- 172.21.15.153:0/4152430185 >> 172.21.15.153:0/4152430185 conn(0x7f58f40c6620 msgr2=0x7f58f40c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:28.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 -- 172.21.15.153:0/4152430185 shutdown_connections 2023-08-17T00:18:28.412 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.405+0000 7f58fa29d700 1 -- 172.21.15.153:0/4152430185 wait complete. 2023-08-17T00:18:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 Processor -- start 2023-08-17T00:18:28.414 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 -- start start 2023-08-17T00:18:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f4068820 0x7f58f41467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.415 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f40a8df0 0x7f58f40aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 0x7f58f40aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4146cd0 con 0x7f58f40a96d0 2023-08-17T00:18:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40bf390 con 0x7f58f40a8df0 2023-08-17T00:18:28.416 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40ab4c0 con 0x7f58f4068820 2023-08-17T00:18:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 0x7f58f40aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.417 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 0x7f58f40aafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45730/0 (socket says 172.21.15.153:45730) 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 -- 172.21.15.153:0/3832106956 learned_addr learned my addr 172.21.15.153:0/3832106956 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f929b700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f4068820 0x7f58f41467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f8a9a700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f40a8df0 0x7f58f40aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 -- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f4068820 msgr2=0x7f58f41467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f4068820 0x7f58f41467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 -- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f40a8df0 msgr2=0x7f58f40aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f40a8df0 0x7f58f40aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 -- 172.21.15.153:0/3832106956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec009ae0 con 0x7f58f40a96d0 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58f9a9c700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 0x7f58f40aafd0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f58ec00b610 tx=0x7f58ec009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0092e0 con 0x7f58f40a96d0 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec007610 con 0x7f58f40a96d0 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f40be7c0 con 0x7f58f40a96d0 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.409+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec0079d0 con 0x7f58f40a96d0 2023-08-17T00:18:28.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.413+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f40bed40 con 0x7f58f40a96d0 2023-08-17T00:18:28.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.413+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f40a8700 con 0x7f58f40a96d0 2023-08-17T00:18:28.420 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.413+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f58ec025030 con 0x7f58f40a96d0 2023-08-17T00:18:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.417+0000 7f58e97fa700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d805a180 0x7f58d805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.417+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f58ec075de0 con 0x7f58f40a96d0 2023-08-17T00:18:28.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.417+0000 7f58f929b700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d805a180 0x7f58d805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.417+0000 7f58f929b700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d805a180 0x7f58d805c640 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f58f40c3c20 tx=0x7f58f0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.428 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.421+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f58f40a8700 con 0x7f58f40a96d0 2023-08-17T00:18:28.588 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.581+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58f40a8700 con 0x7f58f40a96d0 2023-08-17T00:18:28.590 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.585+0000 7f58e97fa700 1 -- 172.21.15.153:0/3832106956 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+17551 (secure 0 0 0) 0x7f58f40a8700 con 0x7f58f40a96d0 2023-08-17T00:18:28.590 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:28.591 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":195,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:17:42.511610+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:17:01.995187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-08-17T00:17:03.026269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.f","mappings":[{"from":7,"to":6}]},{"pgid":"27.18","mappings":[{"from":5,"to":2}]},{"pgid":"27.30","mappings":[{"from":5,"to":6}]},{"pgid":"28.5","mappings":[{"from":2,"to":3}]},{"pgid":"28.8","mappings":[{"from":1,"to":5}]},{"pgid":"28.a","mappings":[{"from":1,"to":4}]},{"pgid":"28.1d","mappings":[{"from":1,"to":3}]},{"pgid":"28.33","mappings":[{"from":6,"to":4}]},{"pgid":"28.3b","mappings":[{"from":6,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/4264536439":"2023-08-18T00:17:17.953681+0000","172.21.15.153:6833/4264536439":"2023-08-18T00:17:17.953681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:18:28.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d805a180 msgr2=0x7f58d805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d805a180 0x7f58d805c640 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f58f40c3c20 tx=0x7f58f0009040).stop 2023-08-17T00:18:28.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 msgr2=0x7f58f40aafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.595 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 0x7f58f40aafd0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 rx=0x7f58ec00b610 tx=0x7f58ec009840).stop 2023-08-17T00:18:28.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 shutdown_connections 2023-08-17T00:18:28.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f58d805a180 0x7f58d805c640 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f58f40a96d0 0x7f58f40aafd0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.596 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58f40a8df0 0x7f58f40aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 --2- 172.21.15.153:0/3832106956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58f4068820 0x7f58f41467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 >> 172.21.15.153:0/3832106956 conn(0x7f58f40c6620 msgr2=0x7f58f40694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:28.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 shutdown_connections 2023-08-17T00:18:28.597 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.589+0000 7f58fa29d700 1 -- 172.21.15.153:0/3832106956 wait complete. 2023-08-17T00:18:28.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-08-17T00:02:43.299528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-17T00:02:44.374999+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-17T00:17:01.995187+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '191', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2023-08-17T00:17:03.026269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '192', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-17T00:18:28.615 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2023-08-17T00:18:28.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 Processor -- start 2023-08-17T00:18:28.787 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 -- start start 2023-08-17T00:18:28.789 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff448151570 0x7ff448066ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff4480c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff44805e300 0x7ff4480c1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4480c1f90 con 0x7ff44805e300 2023-08-17T00:18:28.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff448067090 con 0x7ff448151570 2023-08-17T00:18:28.790 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.781+0000 7ff44f1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff448067880 con 0x7ff448151950 2023-08-17T00:18:28.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff44805e300 0x7ff4480c1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7ff44805e300 0x7ff4480c1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45736/0 (socket says 172.21.15.153:45736) 2023-08-17T00:18:28.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 -- 172.21.15.153:0/3508943842 learned_addr learned my addr 172.21.15.153:0/3508943842 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:28.791 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44d9b6700 1 --2- 172.21.15.153:0/3508943842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff4480c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e1b7700 1 --2- 172.21.15.153:0/3508943842 >> v2:172.21.15.178:3300/0 conn(0x7ff448151570 0x7ff448066ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 -- 172.21.15.153:0/3508943842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 msgr2=0x7ff4480c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 --2- 172.21.15.153:0/3508943842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff4480c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 -- 172.21.15.153:0/3508943842 >> v2:172.21.15.178:3300/0 conn(0x7ff448151570 msgr2=0x7ff448066ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 --2- 172.21.15.153:0/3508943842 >> v2:172.21.15.178:3300/0 conn(0x7ff448151570 0x7ff448066ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 -- 172.21.15.153:0/3508943842 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff448062440 con 0x7ff44805e300 2023-08-17T00:18:28.792 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44e9b8700 1 --2- 172.21.15.153:0/3508943842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4480c1aa0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7ff4480c6c20 tx=0x7ff4400090f0).ready entity=mon.0 client_cookie=92dd11cc94052ccd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44d1b5700 1 -- 172.21.15.153:0/3508943842 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000b520 con 0x7ff44805e300 2023-08-17T00:18:28.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44d1b5700 1 -- 172.21.15.153:0/3508943842 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff44000b680 con 0x7ff44805e300 2023-08-17T00:18:28.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44d1b5700 1 -- 172.21.15.153:0/3508943842 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44000ba20 con 0x7ff44805e300 2023-08-17T00:18:28.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44f1b9700 1 -- 172.21.15.153:0/3508943842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 msgr2=0x7ff4480c1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.794 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.785+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/3508943842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4480c1aa0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 rx=0x7ff4480c6c20 tx=0x7ff4400090f0).stop 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 -- 172.21.15.153:0/3508943842 shutdown_connections 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/3508943842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff4480c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/3508943842 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4480c1aa0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/3508943842 >> v2:172.21.15.178:3300/0 conn(0x7ff448151570 0x7ff448066ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 -- 172.21.15.153:0/3508943842 >> 172.21.15.153:0/3508943842 conn(0x7ff448064d60 msgr2=0x7ff448065140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 -- 172.21.15.153:0/3508943842 shutdown_connections 2023-08-17T00:18:28.795 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 -- 172.21.15.153:0/3508943842 wait complete. 2023-08-17T00:18:28.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 Processor -- start 2023-08-17T00:18:28.797 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.789+0000 7ff44f1b9700 1 -- start start 2023-08-17T00:18:28.798 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4481417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff448151570 0x7ff4480be030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff44814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff448142080 con 0x7ff44805e300 2023-08-17T00:18:28.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480be810 con 0x7ff448151570 2023-08-17T00:18:28.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4480bf0b0 con 0x7ff448151950 2023-08-17T00:18:28.799 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4481417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.800 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4481417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45746/0 (socket says 172.21.15.153:45746) 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 -- 172.21.15.153:0/593277752 learned_addr learned my addr 172.21.15.153:0/593277752 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44d9b6700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff448151570 0x7ff4480be030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e9b8700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff44814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 -- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 msgr2=0x7ff44814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff44814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 -- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff448151570 msgr2=0x7ff4480be030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.801 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff448151570 0x7ff4480be030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 -- 172.21.15.153:0/593277752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff440009370 con 0x7ff44805e300 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e9b8700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff44814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44e1b7700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4481417f0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7ff44400e190 tx=0x7ff444009920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff44400ee30 con 0x7ff44805e300 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff444014400 con 0x7ff44805e300 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff444014780 con 0x7ff44805e300 2023-08-17T00:18:28.802 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4480c0a80 con 0x7ff44805e300 2023-08-17T00:18:28.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.793+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4480bed40 con 0x7ff44805e300 2023-08-17T00:18:28.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.797+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff44806b4c0 con 0x7ff44805e300 2023-08-17T00:18:28.803 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.797+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff44401b030 con 0x7ff44805e300 2023-08-17T00:18:28.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.801+0000 7ff43e7fc700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff42c05a150 0x7ff42c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:28.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.801+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7ff444074750 con 0x7ff44805e300 2023-08-17T00:18:28.806 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.801+0000 7ff44d9b6700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff42c05a150 0x7ff42c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:28.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.801+0000 7ff44d9b6700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff42c05a150 0x7ff42c05c610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7ff4481429d0 tx=0x7ff438008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:28.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.805+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff444047f30 con 0x7ff44805e300 2023-08-17T00:18:28.976 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.969+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff4480672c0 con 0x7ff44805e300 2023-08-17T00:18:28.977 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.973+0000 7ff43e7fc700 1 -- 172.21.15.153:0/593277752 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v195) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff44404b550 con 0x7ff44805e300 2023-08-17T00:18:28.978 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 1 2023-08-17T00:18:28.982 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff42c05a150 msgr2=0x7ff42c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff42c05a150 0x7ff42c05c610 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7ff4481429d0 tx=0x7ff438008040).stop 2023-08-17T00:18:28.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 msgr2=0x7ff4481417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:28.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4481417f0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 rx=0x7ff44400e190 tx=0x7ff444009920).stop 2023-08-17T00:18:28.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 shutdown_connections 2023-08-17T00:18:28.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff42c05a150 0x7ff42c05c610 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.983 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff448151950 0x7ff44814d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff448151570 0x7ff4480be030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 --2- 172.21.15.153:0/593277752 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff44805e300 0x7ff4481417f0 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:28.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 >> 172.21.15.153:0/593277752 conn(0x7ff448064d60 msgr2=0x7ff448142c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:28.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 shutdown_connections 2023-08-17T00:18:28.984 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:28.977+0000 7ff44f1b9700 1 -- 172.21.15.153:0/593277752 wait complete. 2023-08-17T00:18:29.003 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-17T00:18:29.170 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.165+0000 7f1e4b147700 1 Processor -- start 2023-08-17T00:18:29.171 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.165+0000 7f1e4b147700 1 -- start start 2023-08-17T00:18:29.174 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e4b147700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e44068820 0x7f1e44068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e4b147700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e441585a0 con 0x7f1e440a96d0 2023-08-17T00:18:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e4b147700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e44066400 con 0x7f1e440a8df0 2023-08-17T00:18:29.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e4b147700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e440c1ba0 con 0x7f1e44068820 2023-08-17T00:18:29.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e4a946700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f1e440a96d0 0x7f1e440a9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49322/0 (socket says 172.21.15.153:49322) 2023-08-17T00:18:29.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e4a946700 1 -- 172.21.15.153:0/2625607751 learned_addr learned my addr 172.21.15.153:0/2625607751 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:29.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49944700 1 --2- 172.21.15.153:0/2625607751 >> v2:172.21.15.178:3300/0 conn(0x7f1e44068820 0x7f1e44068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506169696 0 0) 0x7f1e441585a0 con 0x7f1e440a96d0 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e300033f0 con 0x7f1e440a96d0 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392923790 0 0) 0x7f1e44066400 con 0x7f1e440a8df0 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e441585a0 con 0x7f1e440a8df0 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49944700 1 -- 172.21.15.153:0/2625607751 >> v1:172.21.15.178:6789/0 conn(0x7f1e440a8df0 legacy=0x7f1e440c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49944700 1 -- 172.21.15.153:0/2625607751 >> v1:172.21.15.153:6789/0 conn(0x7f1e440a96d0 legacy=0x7f1e440a9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4011842233 0 0) 0x7f1e300033f0 con 0x7f1e440a96d0 2023-08-17T00:18:29.177 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49944700 1 -- 172.21.15.153:0/2625607751 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e44069170 con 0x7f1e44068820 2023-08-17T00:18:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49944700 1 --2- 172.21.15.153:0/2625607751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e44068c80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f1e34009760 tx=0x7f1e34009060).ready entity=mon.1 client_cookie=5ef5820f1486eefc server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0017f0 con 0x7f1e44068820 2023-08-17T00:18:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e34011400 con 0x7f1e44068820 2023-08-17T00:18:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.169+0000 7f1e49143700 1 -- 172.21.15.153:0/2625607751 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e34011780 con 0x7f1e44068820 2023-08-17T00:18:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 -- 172.21.15.153:0/2625607751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 msgr2=0x7f1e44068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 --2- 172.21.15.153:0/2625607751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e44068c80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f1e34009760 tx=0x7f1e34009060).stop 2023-08-17T00:18:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 -- 172.21.15.153:0/2625607751 shutdown_connections 2023-08-17T00:18:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 --2- 172.21.15.153:0/2625607751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e44068c80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 -- 172.21.15.153:0/2625607751 >> 172.21.15.153:0/2625607751 conn(0x7f1e440c6620 msgr2=0x7f1e440c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 -- 172.21.15.153:0/2625607751 shutdown_connections 2023-08-17T00:18:29.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.173+0000 7f1e4b147700 1 -- 172.21.15.153:0/2625607751 wait complete. 2023-08-17T00:18:29.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 Processor -- start 2023-08-17T00:18:29.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 -- start start 2023-08-17T00:18:29.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e4415c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e440a8df0 0x7f1e440bff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 0x7f1e441568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440bfad0 con 0x7f1e440a96d0 2023-08-17T00:18:29.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440beec0 con 0x7f1e44068820 2023-08-17T00:18:29.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4b147700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e440bf1a0 con 0x7f1e440a8df0 2023-08-17T00:18:29.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 0x7f1e441568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 0x7f1e441568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45748/0 (socket says 172.21.15.153:45748) 2023-08-17T00:18:29.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 -- 172.21.15.153:0/3070787757 learned_addr learned my addr 172.21.15.153:0/3070787757 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:29.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a145700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e4415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e49944700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e440a8df0 0x7f1e440bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 -- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e440a8df0 msgr2=0x7f1e440bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e440a8df0 0x7f1e440bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 -- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 msgr2=0x7f1e4415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e4415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.177+0000 7f1e4a946700 1 -- 172.21.15.153:0/3070787757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e340092a0 con 0x7f1e440a96d0 2023-08-17T00:18:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e4a946700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 0x7f1e441568a0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f1e3c00cb90 tx=0x7f1e3c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c004c40 con 0x7f1e440a96d0 2023-08-17T00:18:29.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3c004da0 con 0x7f1e440a96d0 2023-08-17T00:18:29.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c0073a0 con 0x7f1e440a96d0 2023-08-17T00:18:29.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e440bf480 con 0x7f1e440a96d0 2023-08-17T00:18:29.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4415ca60 con 0x7f1e440a96d0 2023-08-17T00:18:29.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.181+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e440bfc40 con 0x7f1e440a96d0 2023-08-17T00:18:29.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.185+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1e3c010070 con 0x7f1e440a96d0 2023-08-17T00:18:29.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.185+0000 7f1e3a7fc700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e2805a150 0x7f1e2805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.185+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f1e3c073fd0 con 0x7f1e440a96d0 2023-08-17T00:18:29.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.185+0000 7f1e4a145700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e2805a150 0x7f1e2805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.189+0000 7f1e4a145700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e2805a150 0x7f1e2805c610 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1e4415d5b0 tx=0x7f1e40007bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.189+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1e3c047810 con 0x7f1e440a96d0 2023-08-17T00:18:29.357 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.353+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1e4406b4c0 con 0x7f1e440a96d0 2023-08-17T00:18:29.358 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.353+0000 7f1e3a7fc700 1 -- 172.21.15.153:0/3070787757 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v195) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1e3c04ae30 con 0x7f1e440a96d0 2023-08-17T00:18:29.359 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 8 2023-08-17T00:18:29.362 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e2805a150 msgr2=0x7f1e2805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e2805a150 0x7f1e2805c610 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1e4415d5b0 tx=0x7f1e40007bc0).stop 2023-08-17T00:18:29.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 msgr2=0x7f1e441568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 0x7f1e441568a0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 rx=0x7f1e3c00cb90 tx=0x7f1e3c007bd0).stop 2023-08-17T00:18:29.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 shutdown_connections 2023-08-17T00:18:29.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f1e2805a150 0x7f1e2805c610 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.363 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1e440a96d0 0x7f1e441568a0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e440a8df0 0x7f1e440bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 --2- 172.21.15.153:0/3070787757 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e44068820 0x7f1e4415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 >> 172.21.15.153:0/3070787757 conn(0x7f1e440c6620 msgr2=0x7f1e440c5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 shutdown_connections 2023-08-17T00:18:29.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.357+0000 7f1e4b147700 1 -- 172.21.15.153:0/3070787757 wait complete. 2023-08-17T00:18:29.383 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-17T00:18:29.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.541+0000 7fed8a81b700 1 Processor -- start 2023-08-17T00:18:29.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.541+0000 7fed8a81b700 1 -- start start 2023-08-17T00:18:29.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed8a81b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed84066990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed8a81b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed84067590 0x7fed840c37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed8a81b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed840c6150 con 0x7fed84063fd0 2023-08-17T00:18:29.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed8a81b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed840c3330 con 0x7fed84067590 2023-08-17T00:18:29.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed8a81b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed840be7d0 con 0x7fed84153bb0 2023-08-17T00:18:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed88db8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed84067590 0x7fed840c37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed83fff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed84066990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed88db8700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed84067590 0x7fed840c37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:46668/0 (socket says 172.21.15.153:46668) 2023-08-17T00:18:29.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.545+0000 7fed88db8700 1 -- 172.21.15.153:0/3834962593 learned_addr learned my addr 172.21.15.153:0/3834962593 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed837fe700 1 -- 172.21.15.153:0/3834962593 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799512863 0 0) 0x7fed840c6150 con 0x7fed84063fd0 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed837fe700 1 -- 172.21.15.153:0/3834962593 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed700033f0 con 0x7fed84063fd0 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed88db8700 1 -- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 msgr2=0x7fed84066990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed88db8700 1 --2- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed84066990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed88db8700 1 -- 172.21.15.153:0/3834962593 >> v1:172.21.15.178:6789/0 conn(0x7fed84063fd0 legacy=0x7fed84066e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed88db8700 1 -- 172.21.15.153:0/3834962593 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84064d40 con 0x7fed84067590 2023-08-17T00:18:29.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed83fff700 1 --2- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed84066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:29.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed88db8700 1 --2- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed840c37c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fed7c006fd0 tx=0x7fed7c0090f0).ready entity=mon.1 client_cookie=c4ac9ddeaeb1d80b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed837fe700 1 -- 172.21.15.153:0/3834962593 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00f510 con 0x7fed84067590 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed837fe700 1 -- 172.21.15.153:0/3834962593 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7c00f670 con 0x7fed84067590 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed837fe700 1 -- 172.21.15.153:0/3834962593 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7c00f9f0 con 0x7fed84067590 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 -- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 msgr2=0x7fed840c37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 --2- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed840c37c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 rx=0x7fed7c006fd0 tx=0x7fed7c0090f0).stop 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 -- 172.21.15.153:0/3834962593 shutdown_connections 2023-08-17T00:18:29.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 --2- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed840c37c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 --2- 172.21.15.153:0/3834962593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed84066990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 -- 172.21.15.153:0/3834962593 >> 172.21.15.153:0/3834962593 conn(0x7fed840c92e0 msgr2=0x7fed840c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:29.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 -- 172.21.15.153:0/3834962593 shutdown_connections 2023-08-17T00:18:29.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 -- 172.21.15.153:0/3834962593 wait complete. 2023-08-17T00:18:29.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.549+0000 7fed8a81b700 1 Processor -- start 2023-08-17T00:18:29.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 -- start start 2023-08-17T00:18:29.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 0x7fed84149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed84154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed840c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed841559a0 con 0x7fed84063fd0 2023-08-17T00:18:29.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed84159280 con 0x7fed84067590 2023-08-17T00:18:29.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed84154e50 con 0x7fed84153bb0 2023-08-17T00:18:29.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 0x7fed84149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 0x7fed84149ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45762/0 (socket says 172.21.15.153:45762) 2023-08-17T00:18:29.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 -- 172.21.15.153:0/1336596426 learned_addr learned my addr 172.21.15.153:0/1336596426 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:29.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed88db8700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed840c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed7b7fe700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed84154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 -- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 msgr2=0x7fed840c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed840c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 -- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 msgr2=0x7fed84154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed84154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 -- 172.21.15.153:0/1336596426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740092a0 con 0x7fed84063fd0 2023-08-17T00:18:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed7b7fe700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed84154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:29.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed83fff700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 0x7fed84149ce0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7fed7400ea50 tx=0x7fed74009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7400c850 con 0x7fed84063fd0 2023-08-17T00:18:29.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7400c9b0 con 0x7fed84063fd0 2023-08-17T00:18:29.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c009370 con 0x7fed84063fd0 2023-08-17T00:18:29.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7400cd30 con 0x7fed84063fd0 2023-08-17T00:18:29.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.553+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed84158950 con 0x7fed84063fd0 2023-08-17T00:18:29.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.557+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8406b530 con 0x7fed84063fd0 2023-08-17T00:18:29.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.557+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fed74022070 con 0x7fed84063fd0 2023-08-17T00:18:29.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.561+0000 7fed80ff9700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fed6405a150 0x7fed6405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.561+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fed740747e0 con 0x7fed84063fd0 2023-08-17T00:18:29.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.561+0000 7fed7b7fe700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fed6405a150 0x7fed6405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.561+0000 7fed7b7fe700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fed6405a150 0x7fed6405c610 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fed84150870 tx=0x7fed6c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.565+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fed74048020 con 0x7fed84063fd0 2023-08-17T00:18:29.734 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.729+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed840bff30 con 0x7fed84063fd0 2023-08-17T00:18:29.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.729+0000 7fed80ff9700 1 -- 172.21.15.153:0/1336596426 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v195) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed7404b640 con 0x7fed84063fd0 2023-08-17T00:18:29.735 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:18:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fed6405a150 msgr2=0x7fed6405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fed6405a150 0x7fed6405c610 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7fed84150870 tx=0x7fed6c009040).stop 2023-08-17T00:18:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 msgr2=0x7fed84149ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 0x7fed84149ce0 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 rx=0x7fed7400ea50 tx=0x7fed74009060).stop 2023-08-17T00:18:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 shutdown_connections 2023-08-17T00:18:29.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fed6405a150 0x7fed6405c610 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed84153bb0 0x7fed840c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed84067590 0x7fed84154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 --2- 172.21.15.153:0/1336596426 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fed84063fd0 0x7fed84149ce0 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 >> 172.21.15.153:0/1336596426 conn(0x7fed840c92e0 msgr2=0x7fed8413c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:29.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 shutdown_connections 2023-08-17T00:18:29.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.733+0000 7fed8a81b700 1 -- 172.21.15.153:0/1336596426 wait complete. 2023-08-17T00:18:29.761 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-17T00:18:29.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc221c5b700 1 Processor -- start 2023-08-17T00:18:29.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc221c5b700 1 -- start start 2023-08-17T00:18:29.924 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc221c5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc21c0a8b70 0x7fc21c0632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc221c5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c065240 con 0x7fc21c0a8f50 2023-08-17T00:18:29.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc221c5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21c062e40 con 0x7fc21c0629b0 2023-08-17T00:18:29.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc221c5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21c0638a0 con 0x7fc21c0a8b70 2023-08-17T00:18:29.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc21b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc21c0a8b70 0x7fc21c0632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc21b7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc21c0a8b70 0x7fc21c0632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45778/0 (socket says 172.21.15.153:45778) 2023-08-17T00:18:29.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.917+0000 7fc21b7fe700 1 -- 172.21.15.153:0/725276833 learned_addr learned my addr 172.21.15.153:0/725276833 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:29.926 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21b7fe700 1 -- 172.21.15.153:0/725276833 >> v1:172.21.15.178:6789/0 conn(0x7fc21c0629b0 legacy=0x7fc21c0bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:29.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21b7fe700 1 -- 172.21.15.153:0/725276833 >> v1:172.21.15.153:6789/0 conn(0x7fc21c0a8f50 legacy=0x7fc21c0656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:29.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21b7fe700 1 -- 172.21.15.153:0/725276833 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c065de0 con 0x7fc21c0a8b70 2023-08-17T00:18:29.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21b7fe700 1 --2- 172.21.15.153:0/725276833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0a8b70 0x7fc21c0632e0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7fc20c006fd0 tx=0x7fc20c0090f0).ready entity=mon.0 client_cookie=cf0029d9eb7a0bd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21affd700 1 -- 172.21.15.153:0/725276833 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00b580 con 0x7fc21c0a8b70 2023-08-17T00:18:29.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21affd700 1 -- 172.21.15.153:0/725276833 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00b6e0 con 0x7fc21c0a8b70 2023-08-17T00:18:29.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc21affd700 1 -- 172.21.15.153:0/725276833 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00ba60 con 0x7fc21c0a8b70 2023-08-17T00:18:29.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 -- 172.21.15.153:0/725276833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0a8b70 msgr2=0x7fc21c0632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 --2- 172.21.15.153:0/725276833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0a8b70 0x7fc21c0632e0 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 rx=0x7fc20c006fd0 tx=0x7fc20c0090f0).stop 2023-08-17T00:18:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 -- 172.21.15.153:0/725276833 shutdown_connections 2023-08-17T00:18:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 --2- 172.21.15.153:0/725276833 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0a8b70 0x7fc21c0632e0 unknown :-1 s=CLOSED pgs=2078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 -- 172.21.15.153:0/725276833 >> 172.21.15.153:0/725276833 conn(0x7fc21c0c7150 msgr2=0x7fc21c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 -- 172.21.15.153:0/725276833 shutdown_connections 2023-08-17T00:18:29.929 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.921+0000 7fc221c5b700 1 -- 172.21.15.153:0/725276833 wait complete. 2023-08-17T00:18:29.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 Processor -- start 2023-08-17T00:18:29.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 -- start start 2023-08-17T00:18:29.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 0x7fc21c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc21c0a8b70 0x7fc21c0aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc21c0a8f50 0x7fc21c0ab3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0ac640 con 0x7fc21c0629b0 2023-08-17T00:18:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1593d0 con 0x7fc21c0a8f50 2023-08-17T00:18:29.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc221c5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c0aba30 con 0x7fc21c0a8b70 2023-08-17T00:18:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc21b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 0x7fc21c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc21b7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 0x7fc21c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45790/0 (socket says 172.21.15.153:45790) 2023-08-17T00:18:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.925+0000 7fc21b7fe700 1 -- 172.21.15.153:0/1076069269 learned_addr learned my addr 172.21.15.153:0/1076069269 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:29.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21bfff700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc21c0a8f50 0x7fc21c0ab3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc213fff700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc21c0a8b70 0x7fc21c0aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21b7fe700 1 -- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc21c0a8b70 msgr2=0x7fc21c0aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21b7fe700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc21c0a8b70 0x7fc21c0aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21b7fe700 1 -- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc21c0a8f50 msgr2=0x7fc21c0ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21b7fe700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc21c0a8f50 0x7fc21c0ab3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:29.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21b7fe700 1 -- 172.21.15.153:0/1076069269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c009370 con 0x7fc21c0629b0 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc213fff700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc21c0a8b70 0x7fc21c0aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc21b7fe700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 0x7fc21c155010 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7fc20c006df0 tx=0x7fc20c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00b850 con 0x7fc21c0629b0 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20c00b9b0 con 0x7fc21c0629b0 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c0abd10 con 0x7fc21c0629b0 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c01c650 con 0x7fc21c0629b0 2023-08-17T00:18:29.937 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c0ac2d0 con 0x7fc21c0629b0 2023-08-17T00:18:29.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.929+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc21c06b530 con 0x7fc21c0629b0 2023-08-17T00:18:29.938 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.933+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc20c02c070 con 0x7fc21c0629b0 2023-08-17T00:18:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.933+0000 7fc2137fe700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc1fc05a150 0x7fc1fc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:29.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.933+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fc20c0760a0 con 0x7fc21c0629b0 2023-08-17T00:18:29.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.933+0000 7fc213fff700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc1fc05a150 0x7fc1fc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:29.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.933+0000 7fc213fff700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc1fc05a150 0x7fc1fc05c610 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fc21c16bc10 tx=0x7fc204008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:29.945 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:29.937+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc20c0498e0 con 0x7fc21c0629b0 2023-08-17T00:18:30.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.101+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc21c0c3ab0 con 0x7fc21c0629b0 2023-08-17T00:18:30.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.101+0000 7fc2137fe700 1 -- 172.21.15.153:0/1076069269 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v195) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc20c020070 con 0x7fc21c0629b0 2023-08-17T00:18:30.108 INFO:teuthology.orchestra.run.smithi153.stdout:pg_num: 64 2023-08-17T00:18:30.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc1fc05a150 msgr2=0x7fc1fc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc1fc05a150 0x7fc1fc05c610 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 rx=0x7fc21c16bc10 tx=0x7fc204008040).stop 2023-08-17T00:18:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 msgr2=0x7fc21c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 0x7fc21c155010 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 rx=0x7fc20c006df0 tx=0x7fc20c017000).stop 2023-08-17T00:18:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 shutdown_connections 2023-08-17T00:18:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc1fc05a150 0x7fc1fc05c610 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc21c0a8f50 0x7fc21c0ab3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc21c0a8b70 0x7fc21c0aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 --2- 172.21.15.153:0/1076069269 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc21c0629b0 0x7fc21c155010 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.112 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 >> 172.21.15.153:0/1076069269 conn(0x7fc21c0c7150 msgr2=0x7fc21c0c2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 shutdown_connections 2023-08-17T00:18:30.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.105+0000 7fc221c5b700 1 -- 172.21.15.153:0/1076069269 wait complete. 2023-08-17T00:18:30.134 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:18:30.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.285+0000 7fe4c4adb700 1 Processor -- start 2023-08-17T00:18:30.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.285+0000 7fe4c4adb700 1 -- start start 2023-08-17T00:18:30.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4c4adb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 0x7fe4c00a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4c4adb700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4c00629b0 0x7fe4c00bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4c4adb700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c0065240 con 0x7fe4c00a8b70 2023-08-17T00:18:30.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4c4adb700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c0062e40 con 0x7fe4c00629b0 2023-08-17T00:18:30.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4c4adb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00638a0 con 0x7fe4c00632e0 2023-08-17T00:18:30.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 0x7fe4c00a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 0x7fe4c00a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:43720/0 (socket says 172.21.15.153:43720) 2023-08-17T00:18:30.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4bed9d700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4c00629b0 0x7fe4c00bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 -- 172.21.15.153:0/1996960978 learned_addr learned my addr 172.21.15.153:0/1996960978 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4be59c700 1 --1- 172.21.15.153:0/1996960978 >> v1:172.21.15.178:6789/0 conn(0x7fe4c00a8b70 0x7fe4c00656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:42182/0 (socket says 172.21.15.153:42182) 2023-08-17T00:18:30.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 -- 172.21.15.153:0/1996960978 >> v2:172.21.15.178:3300/0 conn(0x7fe4c00629b0 msgr2=0x7fe4c00bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:30.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 --2- 172.21.15.153:0/1996960978 >> v2:172.21.15.178:3300/0 conn(0x7fe4c00629b0 0x7fe4c00bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 -- 172.21.15.153:0/1996960978 >> v1:172.21.15.178:6789/0 conn(0x7fe4c00a8b70 legacy=0x7fe4c00656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 -- 172.21.15.153:0/1996960978 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0065de0 con 0x7fe4c00632e0 2023-08-17T00:18:30.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4bed9d700 1 --2- 172.21.15.153:0/1996960978 >> v2:172.21.15.178:3300/0 conn(0x7fe4c00629b0 0x7fe4c00bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:30.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4bdd9b700 1 -- 172.21.15.153:0/1996960978 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208838170 0 0) 0x7fe4c0065240 con 0x7fe4c00a8b70 2023-08-17T00:18:30.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4b5d9b700 1 --2- 172.21.15.153:0/1996960978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 0x7fe4c00a8f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fe4a8006fd0 tx=0x7fe4a80090f0).ready entity=mon.2 client_cookie=90e5fc7112ab2bd6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:30.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.289+0000 7fe4bdd9b700 1 -- 172.21.15.153:0/1996960978 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800b580 con 0x7fe4c00632e0 2023-08-17T00:18:30.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4bdd9b700 1 -- 172.21.15.153:0/1996960978 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4a800b6e0 con 0x7fe4c00632e0 2023-08-17T00:18:30.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4bdd9b700 1 -- 172.21.15.153:0/1996960978 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4a800ba60 con 0x7fe4c00632e0 2023-08-17T00:18:30.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 -- 172.21.15.153:0/1996960978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 msgr2=0x7fe4c00a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/1996960978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 0x7fe4c00a8f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fe4a8006fd0 tx=0x7fe4a80090f0).stop 2023-08-17T00:18:30.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 -- 172.21.15.153:0/1996960978 shutdown_connections 2023-08-17T00:18:30.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/1996960978 >> v2:172.21.15.178:3300/0 conn(0x7fe4c00629b0 0x7fe4c00bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/1996960978 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00632e0 0x7fe4c00a8f50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 -- 172.21.15.153:0/1996960978 >> 172.21.15.153:0/1996960978 conn(0x7fe4c00c7150 msgr2=0x7fe4c00c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:30.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 -- 172.21.15.153:0/1996960978 shutdown_connections 2023-08-17T00:18:30.304 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.293+0000 7fe4c4adb700 1 -- 172.21.15.153:0/1996960978 wait complete. 2023-08-17T00:18:30.306 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 Processor -- start 2023-08-17T00:18:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 -- start start 2023-08-17T00:18:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4c00629b0 0x7fe4c0150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.307 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00632e0 0x7fe4c00abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 0x7fe4c015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00abb10 con 0x7fe4c00632e0 2023-08-17T00:18:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00aaf00 con 0x7fe4c00629b0 2023-08-17T00:18:30.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4c4adb700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c00ab1e0 con 0x7fe4c00a8b70 2023-08-17T00:18:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 0x7fe4c015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4be59c700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4c00629b0 0x7fe4c0150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4b5d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00632e0 0x7fe4c00abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 0x7fe4c015b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:43724/0 (socket says 172.21.15.153:43724) 2023-08-17T00:18:30.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 -- 172.21.15.153:0/3562603920 learned_addr learned my addr 172.21.15.153:0/3562603920 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:30.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 -- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4c00629b0 msgr2=0x7fe4c0150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4c00629b0 0x7fe4c0150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.310 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 -- 172.21.15.153:0/3562603920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00632e0 msgr2=0x7fe4c00abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00632e0 0x7fe4c00abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4bed9d700 1 -- 172.21.15.153:0/3562603920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b8009a20 con 0x7fe4c00a8b70 2023-08-17T00:18:30.311 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.297+0000 7fe4b5d9b700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00632e0 0x7fe4c00abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:30.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4bed9d700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 0x7fe4c015b2b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe4b8009f20 tx=0x7fe4b800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:30.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b800cb70 con 0x7fe4c00a8b70 2023-08-17T00:18:30.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b800f040 con 0x7fe4c00a8b70 2023-08-17T00:18:30.312 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b8013400 con 0x7fe4c00a8b70 2023-08-17T00:18:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a8009370 con 0x7fe4c00a8b70 2023-08-17T00:18:30.313 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c00ab7a0 con 0x7fe4c00a8b70 2023-08-17T00:18:30.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.301+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c00c7850 con 0x7fe4c00a8b70 2023-08-17T00:18:30.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.305+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe4b80137f0 con 0x7fe4c00a8b70 2023-08-17T00:18:30.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.305+0000 7fe4b6ffd700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4a405a1d0 0x7fe4a405c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.305+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fe4b8074c70 con 0x7fe4c00a8b70 2023-08-17T00:18:30.314 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.305+0000 7fe4be59c700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4a405a1d0 0x7fe4a405c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.305+0000 7fe4be59c700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4a405a1d0 0x7fe4a405c690 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fe4b00011e0 tx=0x7fe4b0007bd0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:30.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.313+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe4c00c7850 con 0x7fe4c00a8b70 2023-08-17T00:18:30.517 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.509+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4c00c7850 con 0x7fe4c00a8b70 2023-08-17T00:18:30.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.513+0000 7fe4b6ffd700 1 -- 172.21.15.153:0/3562603920 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4513 (secure 0 0 0) 0x7fe4c00c7850 con 0x7fe4c00a8b70 2023-08-17T00:18:30.519 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:30.519 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:23.488626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:18:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4a405a1d0 msgr2=0x7fe4a405c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.523 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4a405a1d0 0x7fe4a405c690 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fe4b00011e0 tx=0x7fe4b0007bd0).stop 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 msgr2=0x7fe4c015b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 0x7fe4c015b2b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7fe4b8009f20 tx=0x7fe4b800b040).stop 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 shutdown_connections 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe4a405a1d0 0x7fe4a405c690 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4c00a8b70 0x7fe4c015b2b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe4c00632e0 0x7fe4c00abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.524 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 --2- 172.21.15.153:0/3562603920 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4c00629b0 0x7fe4c0150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 >> 172.21.15.153:0/3562603920 conn(0x7fe4c00c7150 msgr2=0x7fe4c0151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:30.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 shutdown_connections 2023-08-17T00:18:30.525 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.517+0000 7fe4c4adb700 1 -- 172.21.15.153:0/3562603920 wait complete. 2023-08-17T00:18:30.526 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 153 2023-08-17T00:18:30.543 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:18:30.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.701+0000 7f94060db700 1 Processor -- start 2023-08-17T00:18:30.709 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.701+0000 7f94060db700 1 -- start start 2023-08-17T00:18:30.711 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f94060db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9400151b90 0x7f9400151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f94060db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400063290 0x7f9400065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f94060db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9400065b50 0x7f9400064870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f94060db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94000c3fb0 con 0x7f9400065b50 2023-08-17T00:18:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f94060db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9400152460 con 0x7f9400151b90 2023-08-17T00:18:30.712 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f94060db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9400061fa0 con 0x7f9400063290 2023-08-17T00:18:30.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9400065b50 0x7f9400064870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.713 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f9400065b50 0x7f9400064870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45812/0 (socket says 172.21.15.153:45812) 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 -- 172.21.15.153:0/2227698919 learned_addr learned my addr 172.21.15.153:0/2227698919 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93ff7fe700 1 --2- 172.21.15.153:0/2227698919 >> v2:172.21.15.178:3300/0 conn(0x7f9400151b90 0x7f9400151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93f7fff700 1 --2- 172.21.15.153:0/2227698919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400063290 0x7f9400065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 -- 172.21.15.153:0/2227698919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400063290 msgr2=0x7f9400065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 --2- 172.21.15.153:0/2227698919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400063290 0x7f9400065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 -- 172.21.15.153:0/2227698919 >> v2:172.21.15.178:3300/0 conn(0x7f9400151b90 msgr2=0x7f9400151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:30.714 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 --2- 172.21.15.153:0/2227698919 >> v2:172.21.15.178:3300/0 conn(0x7f9400151b90 0x7f9400151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.705+0000 7f93fffff700 1 -- 172.21.15.153:0/2227698919 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000621f0 con 0x7f9400065b50 2023-08-17T00:18:30.715 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f93fffff700 1 --2- 172.21.15.153:0/2227698919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400065b50 0x7f9400064870 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7f94000682a0 tx=0x7f93f8009840).ready entity=mon.0 client_cookie=492c17b2b6e082c0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f93feffd700 1 -- 172.21.15.153:0/2227698919 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800e070 con 0x7f9400065b50 2023-08-17T00:18:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f93feffd700 1 -- 172.21.15.153:0/2227698919 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f800ba50 con 0x7f9400065b50 2023-08-17T00:18:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f93feffd700 1 -- 172.21.15.153:0/2227698919 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f800bdd0 con 0x7f9400065b50 2023-08-17T00:18:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 -- 172.21.15.153:0/2227698919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400065b50 msgr2=0x7f9400064870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 --2- 172.21.15.153:0/2227698919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400065b50 0x7f9400064870 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 rx=0x7f94000682a0 tx=0x7f93f8009840).stop 2023-08-17T00:18:30.716 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 -- 172.21.15.153:0/2227698919 shutdown_connections 2023-08-17T00:18:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 --2- 172.21.15.153:0/2227698919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400063290 0x7f9400065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 --2- 172.21.15.153:0/2227698919 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400065b50 0x7f9400064870 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 --2- 172.21.15.153:0/2227698919 >> v2:172.21.15.178:3300/0 conn(0x7f9400151b90 0x7f9400151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 -- 172.21.15.153:0/2227698919 >> 172.21.15.153:0/2227698919 conn(0x7f94000c7150 msgr2=0x7f94000c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 -- 172.21.15.153:0/2227698919 shutdown_connections 2023-08-17T00:18:30.717 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 -- 172.21.15.153:0/2227698919 wait complete. 2023-08-17T00:18:30.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.709+0000 7f94060db700 1 Processor -- start 2023-08-17T00:18:30.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 -- start start 2023-08-17T00:18:30.718 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9400063290 0x7f940014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400065b50 0x7f94000aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 0x7f940014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940014ccf0 con 0x7f9400151b90 2023-08-17T00:18:30.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94000bdef0 con 0x7f9400063290 2023-08-17T00:18:30.719 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94000ab270 con 0x7f9400065b50 2023-08-17T00:18:30.720 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 0x7f940014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 0x7f940014de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45818/0 (socket says 172.21.15.153:45818) 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 -- 172.21.15.153:0/285322588 learned_addr learned my addr 172.21.15.153:0/285322588 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93f7fff700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400065b50 0x7f94000aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93ff7fe700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9400063290 0x7f940014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 -- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400065b50 msgr2=0x7f94000aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400065b50 0x7f94000aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.721 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 -- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9400063290 msgr2=0x7f940014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9400063290 0x7f940014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 -- 172.21.15.153:0/285322588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f8009ae0 con 0x7f9400151b90 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93fffff700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 0x7f940014de70 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7f93f8009fd0 tx=0x7f93f8009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f8007080 con 0x7f9400151b90 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f80092e0 con 0x7f9400151b90 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94000bd8a0 con 0x7f9400151b90 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f801e680 con 0x7f9400151b90 2023-08-17T00:18:30.722 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.713+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94000aba10 con 0x7f9400151b90 2023-08-17T00:18:30.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.717+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940006b530 con 0x7f9400151b90 2023-08-17T00:18:30.723 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.717+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f93f8025030 con 0x7f9400151b90 2023-08-17T00:18:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.717+0000 7f93f77fe700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93e005a150 0x7f93e005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.717+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f93f8075960 con 0x7f9400151b90 2023-08-17T00:18:30.725 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.721+0000 7f93ff7fe700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93e005a150 0x7f93e005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:30.726 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.721+0000 7f93ff7fe700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93e005a150 0x7f93e005c610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f93f0006fd0 tx=0x7f93f0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:30.731 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.725+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f93f8049250 con 0x7f9400151b90 2023-08-17T00:18:30.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.885+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94000624d0 con 0x7f9400151b90 2023-08-17T00:18:30.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.885+0000 7f93f77fe700 1 -- 172.21.15.153:0/285322588 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+17551 (secure 0 0 0) 0x7f93f8023070 con 0x7f9400151b90 2023-08-17T00:18:30.894 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:30.894 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":195,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:17:42.511610+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:17:01.995187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-08-17T00:17:03.026269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.f","mappings":[{"from":7,"to":6}]},{"pgid":"27.18","mappings":[{"from":5,"to":2}]},{"pgid":"27.30","mappings":[{"from":5,"to":6}]},{"pgid":"28.5","mappings":[{"from":2,"to":3}]},{"pgid":"28.8","mappings":[{"from":1,"to":5}]},{"pgid":"28.a","mappings":[{"from":1,"to":4}]},{"pgid":"28.1d","mappings":[{"from":1,"to":3}]},{"pgid":"28.33","mappings":[{"from":6,"to":4}]},{"pgid":"28.3b","mappings":[{"from":6,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/4264536439":"2023-08-18T00:17:17.953681+0000","172.21.15.153:6833/4264536439":"2023-08-18T00:17:17.953681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:18:30.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93e005a150 msgr2=0x7f93e005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93e005a150 0x7f93e005c610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7f93f0006fd0 tx=0x7f93f0008040).stop 2023-08-17T00:18:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 msgr2=0x7f940014de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:30.896 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 0x7f940014de70 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 rx=0x7f93f8009fd0 tx=0x7f93f8009840).stop 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 shutdown_connections 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f93e005a150 0x7f93e005c610 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f9400151b90 0x7f940014de70 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9400065b50 0x7f94000aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 --2- 172.21.15.153:0/285322588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9400063290 0x7f940014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 >> 172.21.15.153:0/285322588 conn(0x7f94000c7150 msgr2=0x7f94001503f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:30.897 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 shutdown_connections 2023-08-17T00:18:30.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:30.889+0000 7f94060db700 1 -- 172.21.15.153:0/285322588 wait complete. 2023-08-17T00:18:30.915 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:18:30.916 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:18:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.061+0000 7f4dd54db700 1 Processor -- start 2023-08-17T00:18:31.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.061+0000 7f4dd54db700 1 -- start start 2023-08-17T00:18:31.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dd54db700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4dd015b080 0x7f4dd015b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dd54db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd0065f10 0x7f4dd00647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dd54db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd0066660 con 0x7f4dd00bbfa0 2023-08-17T00:18:31.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dd54db700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00bcea0 con 0x7f4dd015b080 2023-08-17T00:18:31.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dd54db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd0062a00 con 0x7f4dd0065f10 2023-08-17T00:18:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4dd015b080 0x7f4dd015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4dd015b080 0x7f4dd015b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45826/0 (socket says 172.21.15.153:45826) 2023-08-17T00:18:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 -- 172.21.15.153:0/3386064898 learned_addr learned my addr 172.21.15.153:0/3386064898 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:31.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dc67fc700 1 --1- 172.21.15.153:0/3386064898 >> v1:172.21.15.153:6789/0 conn(0x7f4dd00bbfa0 0x7f4dd00c0ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49342/0 (socket says 172.21.15.153:49342) 2023-08-17T00:18:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dcf7fe700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd0065f10 0x7f4dd00647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 -- 172.21.15.153:0/3386064898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd0065f10 msgr2=0x7f4dd00647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd0065f10 0x7f4dd00647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 -- 172.21.15.153:0/3386064898 >> v1:172.21.15.153:6789/0 conn(0x7f4dd00bbfa0 legacy=0x7f4dd00c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 -- 172.21.15.153:0/3386064898 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd00bc410 con 0x7f4dd015b080 2023-08-17T00:18:31.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dcf7fe700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd0065f10 0x7f4dd00647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:31.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.065+0000 7f4dceffd700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd015b080 0x7f4dd015b460 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f4dc0006fd0 tx=0x7f4dc00090f0).ready entity=mon.0 client_cookie=debfd56c8db1015 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dce7fc700 1 -- 172.21.15.153:0/3386064898 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000b600 con 0x7f4dd015b080 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dce7fc700 1 -- 172.21.15.153:0/3386064898 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000b760 con 0x7f4dd015b080 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dce7fc700 1 -- 172.21.15.153:0/3386064898 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc000bb00 con 0x7f4dd015b080 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 -- 172.21.15.153:0/3386064898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd015b080 msgr2=0x7f4dd015b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd015b080 0x7f4dd015b460 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 rx=0x7f4dc0006fd0 tx=0x7f4dc00090f0).stop 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 -- 172.21.15.153:0/3386064898 shutdown_connections 2023-08-17T00:18:31.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd0065f10 0x7f4dd00647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 --2- 172.21.15.153:0/3386064898 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd015b080 0x7f4dd015b460 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 -- 172.21.15.153:0/3386064898 >> 172.21.15.153:0/3386064898 conn(0x7f4dd00c2fb0 msgr2=0x7f4dd00c33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:31.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 -- 172.21.15.153:0/3386064898 shutdown_connections 2023-08-17T00:18:31.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.069+0000 7f4dd54db700 1 -- 172.21.15.153:0/3386064898 wait complete. 2023-08-17T00:18:31.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 Processor -- start 2023-08-17T00:18:31.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 -- start start 2023-08-17T00:18:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 0x7f4dd0156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dd00bbfa0 0x7f4dd0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd015b080 0x7f4dd00becd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd016bf30 con 0x7f4dd0065f10 2023-08-17T00:18:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd016cd90 con 0x7f4dd00bbfa0 2023-08-17T00:18:31.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dd54db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd016c180 con 0x7f4dd015b080 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 0x7f4dd0156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 0x7f4dd0156e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45828/0 (socket says 172.21.15.153:45828) 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 -- 172.21.15.153:0/390283135 learned_addr learned my addr 172.21.15.153:0/390283135 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dc67fc700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dd00bbfa0 0x7f4dd0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dcf7fe700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd015b080 0x7f4dd00becd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 -- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd015b080 msgr2=0x7f4dd00becd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd015b080 0x7f4dd00becd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 -- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dd00bbfa0 msgr2=0x7f4dd0155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dd00bbfa0 0x7f4dd0155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.073+0000 7f4dceffd700 1 -- 172.21.15.153:0/390283135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc0009370 con 0x7f4dd0065f10 2023-08-17T00:18:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dcf7fe700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd015b080 0x7f4dd00becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:31.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dceffd700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 0x7f4dd0156e10 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f4dc0009f50 tx=0x7f4dc0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0002f30 con 0x7f4dd0065f10 2023-08-17T00:18:31.085 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc000b8d0 con 0x7f4dd0065f10 2023-08-17T00:18:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd016c460 con 0x7f4dd0065f10 2023-08-17T00:18:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0024470 con 0x7f4dd0065f10 2023-08-17T00:18:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd016ca20 con 0x7f4dd0065f10 2023-08-17T00:18:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.077+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd006b4c0 con 0x7f4dd0065f10 2023-08-17T00:18:31.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.081+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4dc000f070 con 0x7f4dd0065f10 2023-08-17T00:18:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.081+0000 7f4dc77fe700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4db005a150 0x7f4db005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.081+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f4dc0075ed0 con 0x7f4dd0065f10 2023-08-17T00:18:31.089 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.081+0000 7f4dc67fc700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4db005a150 0x7f4db005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.090 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.085+0000 7f4dc67fc700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4db005a150 0x7f4db005c610 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f4dd015a020 tx=0x7f4db8007bf0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.085+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4dc0049710 con 0x7f4dd0065f10 2023-08-17T00:18:31.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.285+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dd0065ad0 con 0x7f4dd0065f10 2023-08-17T00:18:31.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dc77fe700 1 -- 172.21.15.153:0/390283135 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4513 (secure 0 0 0) 0x7f4dc0029030 con 0x7f4dd0065f10 2023-08-17T00:18:31.294 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:31.295 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:23.488626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:18:31.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4db005a150 msgr2=0x7f4db005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4db005a150 0x7f4db005c610 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 rx=0x7f4dd015a020 tx=0x7f4db8007bf0).stop 2023-08-17T00:18:31.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 msgr2=0x7f4dd0156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.297 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 0x7f4dd0156e10 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 rx=0x7f4dc0009f50 tx=0x7f4dc0017000).stop 2023-08-17T00:18:31.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 shutdown_connections 2023-08-17T00:18:31.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4db005a150 0x7f4db005c610 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4dd015b080 0x7f4dd00becd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4dd00bbfa0 0x7f4dd0155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 --2- 172.21.15.153:0/390283135 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4dd0065f10 0x7f4dd0156e10 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 >> 172.21.15.153:0/390283135 conn(0x7f4dd00c2fb0 msgr2=0x7f4dd0062e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 shutdown_connections 2023-08-17T00:18:31.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.289+0000 7f4dd54db700 1 -- 172.21.15.153:0/390283135 wait complete. 2023-08-17T00:18:31.300 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 153 2023-08-17T00:18:31.317 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:18:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.465+0000 7fc68b61b700 1 Processor -- start 2023-08-17T00:18:31.471 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.465+0000 7fc68b61b700 1 -- start start 2023-08-17T00:18:31.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc68b61b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc6840632e0 0x7fc6840bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc68b61b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc684065240 con 0x7fc684154130 2023-08-17T00:18:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc68b61b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc684065de0 con 0x7fc684153d50 2023-08-17T00:18:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc68b61b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc684063880 con 0x7fc6840632e0 2023-08-17T00:18:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc688bb6700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc684154130 0x7fc6840656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:49344/0 (socket says 172.21.15.153:49344) 2023-08-17T00:18:31.475 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc688bb6700 1 -- 172.21.15.153:0/3434602434 learned_addr learned my addr 172.21.15.153:0/3434602434 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:31.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc689bb8700 1 --2- 172.21.15.153:0/3434602434 >> v2:172.21.15.178:3300/0 conn(0x7fc6840632e0 0x7fc6840bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc67bfff700 1 -- 172.21.15.153:0/3434602434 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 320984629 0 0) 0x7fc684065240 con 0x7fc684154130 2023-08-17T00:18:31.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc67bfff700 1 -- 172.21.15.153:0/3434602434 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6700033f0 con 0x7fc684154130 2023-08-17T00:18:31.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc689bb8700 1 -- 172.21.15.153:0/3434602434 >> v1:172.21.15.178:6789/0 conn(0x7fc684153d50 legacy=0x7fc6840629b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc689bb8700 1 -- 172.21.15.153:0/3434602434 >> v1:172.21.15.153:6789/0 conn(0x7fc684154130 legacy=0x7fc6840656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc689bb8700 1 -- 172.21.15.153:0/3434602434 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc684064910 con 0x7fc6840632e0 2023-08-17T00:18:31.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc689bb8700 1 --2- 172.21.15.153:0/3434602434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc6840bbdc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fc67c009e60 tx=0x7fc67c009780).ready entity=mon.1 client_cookie=975a6112ffcf2f49 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.478 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc67bfff700 1 -- 172.21.15.153:0/3434602434 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c00e070 con 0x7fc6840632e0 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc67bfff700 1 -- 172.21.15.153:0/3434602434 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00bb60 con 0x7fc6840632e0 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.469+0000 7fc67bfff700 1 -- 172.21.15.153:0/3434602434 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c012410 con 0x7fc6840632e0 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 -- 172.21.15.153:0/3434602434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 msgr2=0x7fc6840bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 --2- 172.21.15.153:0/3434602434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc6840bbdc0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7fc67c009e60 tx=0x7fc67c009780).stop 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 -- 172.21.15.153:0/3434602434 shutdown_connections 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 --2- 172.21.15.153:0/3434602434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc6840bbdc0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 -- 172.21.15.153:0/3434602434 >> 172.21.15.153:0/3434602434 conn(0x7fc6840c7150 msgr2=0x7fc6840c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 -- 172.21.15.153:0/3434602434 shutdown_connections 2023-08-17T00:18:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 -- 172.21.15.153:0/3434602434 wait complete. 2023-08-17T00:18:31.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 Processor -- start 2023-08-17T00:18:31.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.473+0000 7fc68b61b700 1 -- start start 2023-08-17T00:18:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc684152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc684153d50 0x7fc684154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 0x7fc684154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684155ba0 con 0x7fc684154130 2023-08-17T00:18:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc684152680 con 0x7fc6840632e0 2023-08-17T00:18:31.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc684154f90 con 0x7fc684153d50 2023-08-17T00:18:31.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 0x7fc684154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 0x7fc684154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45832/0 (socket says 172.21.15.153:45832) 2023-08-17T00:18:31.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 -- 172.21.15.153:0/815579301 learned_addr learned my addr 172.21.15.153:0/815579301 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc6893b7700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc684152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc688bb6700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc684153d50 0x7fc684154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 -- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc684153d50 msgr2=0x7fc684154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc684153d50 0x7fc684154510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 -- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 msgr2=0x7fc684152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc684152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 -- 172.21.15.153:0/815579301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009a20 con 0x7fc684154130 2023-08-17T00:18:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc689bb8700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 0x7fc684154a00 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7fc67c00b6c0 tx=0x7fc67c009780).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c012410 con 0x7fc684154130 2023-08-17T00:18:31.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c01d630 con 0x7fc684154130 2023-08-17T00:18:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67c01d9f0 con 0x7fc684154130 2023-08-17T00:18:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc684155270 con 0x7fc684154130 2023-08-17T00:18:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.477+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc684155830 con 0x7fc684154130 2023-08-17T00:18:31.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.481+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc684155d10 con 0x7fc684154130 2023-08-17T00:18:31.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.481+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc67c027460 con 0x7fc684154130 2023-08-17T00:18:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.481+0000 7fc6797fa700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc66805a120 0x7fc66805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.481+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7fc67c076400 con 0x7fc684154130 2023-08-17T00:18:31.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.481+0000 7fc6893b7700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc66805a120 0x7fc66805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.493 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.485+0000 7fc6893b7700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc66805a120 0x7fc66805c5e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fc6841565f0 tx=0x7fc680009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.489+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc67c04d610 con 0x7fc684154130 2023-08-17T00:18:31.695 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.689+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc68406b530 con 0x7fc684154130 2023-08-17T00:18:31.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.689+0000 7fc6797fa700 1 -- 172.21.15.153:0/815579301 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 153 v153) v1 ==== 95+0+4513 (secure 0 0 0) 0x7fc67c04d200 con 0x7fc684154130 2023-08-17T00:18:31.697 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:31.697 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":153,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141}],"filesystems":[{"mdsmap":{"epoch":153,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-17T00:17:04.011993+0000","modified":"2023-08-17T00:17:23.488626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":193,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10353},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10353":{"gid":10353,"name":"c","rank":0,"incarnation":150,"state":"up:active","state_seq":4,"addr":"172.21.15.153:6835/214968761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":214968761},{"type":"v1","addr":"172.21.15.153:6835","nonce":214968761}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-08-17T00:18:31.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc66805a120 msgr2=0x7fc66805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc66805a120 0x7fc66805c5e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 rx=0x7fc6841565f0 tx=0x7fc680009040).stop 2023-08-17T00:18:31.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 msgr2=0x7fc684154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.702 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 0x7fc684154a00 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 rx=0x7fc67c00b6c0 tx=0x7fc67c009780).stop 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 shutdown_connections 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc66805a120 0x7fc66805c5e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc684154130 0x7fc684154a00 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc684153d50 0x7fc684154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 --2- 172.21.15.153:0/815579301 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc6840632e0 0x7fc684152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 >> 172.21.15.153:0/815579301 conn(0x7fc6840c7150 msgr2=0x7fc684157980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:31.703 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 shutdown_connections 2023-08-17T00:18:31.704 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.697+0000 7fc68b61b700 1 -- 172.21.15.153:0/815579301 wait complete. 2023-08-17T00:18:31.705 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 153 2023-08-17T00:18:31.722 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:18:31.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.869+0000 7f5f6f3a9700 1 Processor -- start 2023-08-17T00:18:31.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.869+0000 7f5f6f3a9700 1 -- start start 2023-08-17T00:18:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6f3a9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5f680a8b70 0x7f5f680632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6f3a9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f680a8f50 0x7f5f680629b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6f3a9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f68065240 con 0x7f5f680656d0 2023-08-17T00:18:31.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6f3a9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f68062ea0 con 0x7f5f680a8f50 2023-08-17T00:18:31.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6f3a9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f680638a0 con 0x7f5f680a8b70 2023-08-17T00:18:31.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f680a8f50 0x7f5f680629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f5f680a8f50 0x7f5f680629b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45836/0 (socket says 172.21.15.153:45836) 2023-08-17T00:18:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 -- 172.21.15.153:0/2571065539 learned_addr learned my addr 172.21.15.153:0/2571065539 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6d145700 1 --2- 172.21.15.153:0/2571065539 >> v2:172.21.15.178:3300/0 conn(0x7f5f680a8b70 0x7f5f680632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 -- 172.21.15.153:0/2571065539 >> v2:172.21.15.178:3300/0 conn(0x7f5f680a8b70 msgr2=0x7f5f680632e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:31.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 --2- 172.21.15.153:0/2571065539 >> v2:172.21.15.178:3300/0 conn(0x7f5f680a8b70 0x7f5f680632e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 -- 172.21.15.153:0/2571065539 >> v1:172.21.15.178:6789/0 conn(0x7f5f680656d0 legacy=0x7f5f680bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 -- 172.21.15.153:0/2571065539 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f68064910 con 0x7f5f680a8f50 2023-08-17T00:18:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6d145700 1 --2- 172.21.15.153:0/2571065539 >> v2:172.21.15.178:3300/0 conn(0x7f5f680a8b70 0x7f5f680632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.873+0000 7f5f6c944700 1 --2- 172.21.15.153:0/2571065539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680629b0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f5f68069ba0 tx=0x7f5f580090f0).ready entity=mon.0 client_cookie=cb85228ff53098d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f5ffff700 1 -- 172.21.15.153:0/2571065539 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800b520 con 0x7f5f680a8f50 2023-08-17T00:18:31.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f5ffff700 1 -- 172.21.15.153:0/2571065539 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5800b680 con 0x7f5f680a8f50 2023-08-17T00:18:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f5ffff700 1 -- 172.21.15.153:0/2571065539 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5800ba00 con 0x7f5f680a8f50 2023-08-17T00:18:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2571065539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 msgr2=0x7f5f680629b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2571065539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680629b0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 rx=0x7f5f68069ba0 tx=0x7f5f580090f0).stop 2023-08-17T00:18:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2571065539 shutdown_connections 2023-08-17T00:18:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2571065539 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680629b0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2571065539 >> v2:172.21.15.178:3300/0 conn(0x7f5f680a8b70 0x7f5f680632e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2571065539 >> 172.21.15.153:0/2571065539 conn(0x7f5f680c7150 msgr2=0x7f5f680c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2571065539 shutdown_connections 2023-08-17T00:18:31.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.877+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2571065539 wait complete. 2023-08-17T00:18:31.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 Processor -- start 2023-08-17T00:18:31.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 -- start start 2023-08-17T00:18:31.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f680656d0 0x7f5f68154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f680a8b70 0x7f5f680c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f680c57f0 con 0x7f5f680a8f50 2023-08-17T00:18:31.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68168910 con 0x7f5f680a8b70 2023-08-17T00:18:31.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6f3a9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f68169730 con 0x7f5f680656d0 2023-08-17T00:18:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45840/0 (socket says 172.21.15.153:45840) 2023-08-17T00:18:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 -- 172.21.15.153:0/2342877719 learned_addr learned my addr 172.21.15.153:0/2342877719 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d145700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f680656d0 0x7f5f68154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6c944700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f680a8b70 0x7f5f680c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 -- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f680656d0 msgr2=0x7f5f68154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f680656d0 0x7f5f68154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 -- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f680a8b70 msgr2=0x7f5f680c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f680a8b70 0x7f5f680c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.881+0000 7f5f6d946700 1 -- 172.21.15.153:0/2342877719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640092a0 con 0x7f5f680a8f50 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f6d946700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680c5300 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f5f60002230 tx=0x7f5f600015e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000e4a0 con 0x7f5f680a8f50 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6000e600 con 0x7f5f680a8f50 2023-08-17T00:18:31.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f58009370 con 0x7f5f680a8f50 2023-08-17T00:18:31.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6000e980 con 0x7f5f680a8f50 2023-08-17T00:18:31.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f68168e00 con 0x7f5f680a8f50 2023-08-17T00:18:31.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f681698a0 con 0x7f5f680a8f50 2023-08-17T00:18:31.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.885+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5f60019030 con 0x7f5f680a8f50 2023-08-17T00:18:31.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.889+0000 7f5f5d7fa700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5f4c05a150 0x7f5f4c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:31.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.889+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f5f60073770 con 0x7f5f680a8f50 2023-08-17T00:18:31.894 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.889+0000 7f5f6d145700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5f4c05a150 0x7f5f4c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:31.895 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.889+0000 7f5f6d145700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5f4c05a150 0x7f5f4c05c610 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f5f680c2490 tx=0x7f5f64009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:31.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:31.893+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5f60047170 con 0x7f5f680a8f50 2023-08-17T00:18:32.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.057+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f68064bf0 con 0x7f5f680a8f50 2023-08-17T00:18:32.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.057+0000 7f5f5d7fa700 1 -- 172.21.15.153:0/2342877719 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+17551 (secure 0 0 0) 0x7f5f6004a790 con 0x7f5f680a8f50 2023-08-17T00:18:32.065 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:32.065 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":195,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:17:42.511610+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-08-17T00:17:01.995187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"191","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-08-17T00:17:03.026269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"192","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"27.f","mappings":[{"from":7,"to":6}]},{"pgid":"27.18","mappings":[{"from":5,"to":2}]},{"pgid":"27.30","mappings":[{"from":5,"to":6}]},{"pgid":"28.5","mappings":[{"from":2,"to":3}]},{"pgid":"28.8","mappings":[{"from":1,"to":5}]},{"pgid":"28.a","mappings":[{"from":1,"to":4}]},{"pgid":"28.1d","mappings":[{"from":1,"to":3}]},{"pgid":"28.33","mappings":[{"from":6,"to":4}]},{"pgid":"28.3b","mappings":[{"from":6,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/4264536439":"2023-08-18T00:17:17.953681+0000","172.21.15.153:6833/4264536439":"2023-08-18T00:17:17.953681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:18:32.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5f4c05a150 msgr2=0x7f5f4c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:32.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5f4c05a150 0x7f5f4c05c610 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 rx=0x7f5f680c2490 tx=0x7f5f64009060).stop 2023-08-17T00:18:32.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 msgr2=0x7f5f680c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:32.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680c5300 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 rx=0x7f5f60002230 tx=0x7f5f600015e0).stop 2023-08-17T00:18:32.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 shutdown_connections 2023-08-17T00:18:32.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f5f4c05a150 0x7f5f4c05c610 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5f680a8f50 0x7f5f680c5300 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f680a8b70 0x7f5f680c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 --2- 172.21.15.153:0/2342877719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f680656d0 0x7f5f68154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 >> 172.21.15.153:0/2342877719 conn(0x7f5f680c7150 msgr2=0x7f5f680c24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 shutdown_connections 2023-08-17T00:18:32.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.061+0000 7f5f6f3a9700 1 -- 172.21.15.153:0/2342877719 wait complete. 2023-08-17T00:18:32.088 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-17T00:18:32.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 Processor -- start 2023-08-17T00:18:32.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 -- start start 2023-08-17T00:18:32.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f44900c5bf0 0x7f44900c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:32.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4490154dd0 0x7f44900a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4490158930 con 0x7f44900a9d10 2023-08-17T00:18:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4490157d20 con 0x7f4490154dd0 2023-08-17T00:18:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.245+0000 7f4494af1700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4490158000 con 0x7f44900c5bf0 2023-08-17T00:18:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4490154dd0 0x7f44900a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:32.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4490154dd0 0x7f44900a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45846/0 (socket says 172.21.15.153:45846) 2023-08-17T00:18:32.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 -- 172.21.15.153:0/1196543684 learned_addr learned my addr 172.21.15.153:0/1196543684 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:32.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f448e59c700 1 --2- 172.21.15.153:0/1196543684 >> v2:172.21.15.178:3300/0 conn(0x7f44900c5bf0 0x7f44900c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:32.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 -- 172.21.15.153:0/1196543684 >> v2:172.21.15.178:3300/0 conn(0x7f44900c5bf0 msgr2=0x7f44900c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 --2- 172.21.15.153:0/1196543684 >> v2:172.21.15.178:3300/0 conn(0x7f44900c5bf0 0x7f44900c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 -- 172.21.15.153:0/1196543684 >> v1:172.21.15.178:6789/0 conn(0x7f44900a9d10 legacy=0x7f449014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 -- 172.21.15.153:0/1196543684 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44901582e0 con 0x7f4490154dd0 2023-08-17T00:18:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4487fff700 1 --2- 172.21.15.153:0/1196543684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900a9820 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f4490064bf0 tx=0x7f44780090f0).ready entity=mon.0 client_cookie=79ed479faa3f5990 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f448dd9b700 1 -- 172.21.15.153:0/1196543684 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447800b600 con 0x7f4490154dd0 2023-08-17T00:18:32.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f448dd9b700 1 -- 172.21.15.153:0/1196543684 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447800b760 con 0x7f4490154dd0 2023-08-17T00:18:32.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f448dd9b700 1 -- 172.21.15.153:0/1196543684 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447800bb00 con 0x7f4490154dd0 2023-08-17T00:18:32.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 -- 172.21.15.153:0/1196543684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 msgr2=0x7f44900a9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:32.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 --2- 172.21.15.153:0/1196543684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900a9820 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 rx=0x7f4490064bf0 tx=0x7f44780090f0).stop 2023-08-17T00:18:32.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 -- 172.21.15.153:0/1196543684 shutdown_connections 2023-08-17T00:18:32.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 --2- 172.21.15.153:0/1196543684 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900a9820 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 --2- 172.21.15.153:0/1196543684 >> v2:172.21.15.178:3300/0 conn(0x7f44900c5bf0 0x7f44900c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 -- 172.21.15.153:0/1196543684 >> 172.21.15.153:0/1196543684 conn(0x7f44900caaa0 msgr2=0x7f44900caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:32.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 -- 172.21.15.153:0/1196543684 shutdown_connections 2023-08-17T00:18:32.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.249+0000 7f4494af1700 1 -- 172.21.15.153:0/1196543684 wait complete. 2023-08-17T00:18:32.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 Processor -- start 2023-08-17T00:18:32.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 -- start start 2023-08-17T00:18:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44900a9d10 0x7f44900c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900c5bf0 0x7f44900ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:32.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490150ef0 con 0x7f4490154dd0 2023-08-17T00:18:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4490168640 con 0x7f44900a9d10 2023-08-17T00:18:32.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4494af1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44900aecd0 con 0x7f44900c5bf0 2023-08-17T00:18:32.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:32.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900cae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45860/0 (socket says 172.21.15.153:45860) 2023-08-17T00:18:32.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 -- 172.21.15.153:0/244054439 learned_addr learned my addr 172.21.15.153:0/244054439 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:32.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f4487fff700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900c5bf0 0x7f44900ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:32.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448e59c700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44900a9d10 0x7f44900c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 -- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900c5bf0 msgr2=0x7f44900ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900c5bf0 0x7f44900ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 -- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44900a9d10 msgr2=0x7f44900c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44900a9d10 0x7f44900c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.253+0000 7f448ed9d700 1 -- 172.21.15.153:0/244054439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4478009370 con 0x7f4490154dd0 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f448ed9d700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900cae80 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f448800c7c0 tx=0x7f4488001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:32.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488010510 con 0x7f4490154dd0 2023-08-17T00:18:32.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488010670 con 0x7f4490154dd0 2023-08-17T00:18:32.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880109f0 con 0x7f4490154dd0 2023-08-17T00:18:32.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4490167d10 con 0x7f4490154dd0 2023-08-17T00:18:32.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44901682d0 con 0x7f4490154dd0 2023-08-17T00:18:32.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44901687d0 con 0x7f4490154dd0 2023-08-17T00:18:32.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.257+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4488010070 con 0x7f4490154dd0 2023-08-17T00:18:32.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.261+0000 7f44867fc700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f447005a150 0x7f447005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:32.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.261+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6468+0+0 (secure 0 0 0) 0x7f4488073ed0 con 0x7f4490154dd0 2023-08-17T00:18:32.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.261+0000 7f448e59c700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f447005a150 0x7f447005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:32.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.261+0000 7f448e59c700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f447005a150 0x7f447005c610 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f448000bb20 tx=0x7f4480008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:32.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.265+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4488047820 con 0x7f4490154dd0 2023-08-17T00:18:32.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:32.469+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f449006b530 con 0x7f4490154dd0 2023-08-17T00:18:33.448 INFO:tasks.ceph.mon.a.smithi153.stderr:2023-08-17T00:18:33.441+0000 7f7e9fc93700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-17T00:18:33.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.449+0000 7f44867fc700 1 -- 172.21.15.153:0/244054439 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v154) v1 ==== 161+0+0 (secure 0 0 0) 0x7f448804ae40 con 0x7f4490154dd0 2023-08-17T00:18:33.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f447005a150 msgr2=0x7f447005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:33.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f447005a150 0x7f447005c610 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f448000bb20 tx=0x7f4480008040).stop 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 msgr2=0x7f44900cae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900cae80 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 rx=0x7f448800c7c0 tx=0x7f4488001510).stop 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 shutdown_connections 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f447005a150 0x7f447005c610 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4490154dd0 0x7f44900cae80 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44900c5bf0 0x7f44900ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 --2- 172.21.15.153:0/244054439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44900a9d10 0x7f44900c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 >> 172.21.15.153:0/244054439 conn(0x7f44900caaa0 msgr2=0x7f4490153760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:33.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 shutdown_connections 2023-08-17T00:18:33.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.453+0000 7f4494af1700 1 -- 172.21.15.153:0/244054439 wait complete. 2023-08-17T00:18:33.462 INFO:teuthology.orchestra.run.smithi153.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-17T00:18:33.466 INFO:tasks.ceph.mds.c.smithi153.stderr: -2578> 2023-08-17T00:17:24.454+0000 7f5ff6d2a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-17T00:18:33.481 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-17T00:18:33.512 INFO:tasks.ceph.mds.c.smithi153.stdout:starting mds.c at 2023-08-17T00:18:33.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 Processor -- start 2023-08-17T00:18:33.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 -- start start 2023-08-17T00:18:33.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff1c153ce0 0x7eff1c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:33.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0644b0 0x7eff1c063df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:33.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1c0bfb60 con 0x7eff1c0aaa80 2023-08-17T00:18:33.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0642e0 con 0x7eff1c153ce0 2023-08-17T00:18:33.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff2289b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c09c0 con 0x7eff1c0644b0 2023-08-17T00:18:33.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff1bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff1c153ce0 0x7eff1c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:33.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff1bfff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff1c153ce0 0x7eff1c1540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45868/0 (socket says 172.21.15.153:45868) 2023-08-17T00:18:33.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.633+0000 7eff1bfff700 1 -- 172.21.15.153:0/1772057857 learned_addr learned my addr 172.21.15.153:0/1772057857 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:33.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff137fe700 1 --2- 172.21.15.153:0/1772057857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0644b0 0x7eff1c063df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:33.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1bfff700 1 -- 172.21.15.153:0/1772057857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0644b0 msgr2=0x7eff1c063df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:33.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1bfff700 1 --2- 172.21.15.153:0/1772057857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0644b0 0x7eff1c063df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1bfff700 1 -- 172.21.15.153:0/1772057857 >> v1:172.21.15.178:6789/0 conn(0x7eff1c0aaa80 legacy=0x7eff1c0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:33.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1bfff700 1 -- 172.21.15.153:0/1772057857 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0bfdb0 con 0x7eff1c153ce0 2023-08-17T00:18:33.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1bfff700 1 --2- 172.21.15.153:0/1772057857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c153ce0 0x7eff1c1540c0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7eff0c009f20 tx=0x7eff0c009840).ready entity=mon.0 client_cookie=cab4d8e3a3467cad server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:33.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1b7fe700 1 -- 172.21.15.153:0/1772057857 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00e070 con 0x7eff1c153ce0 2023-08-17T00:18:33.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1b7fe700 1 -- 172.21.15.153:0/1772057857 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c00ba80 con 0x7eff1c153ce0 2023-08-17T00:18:33.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff1b7fe700 1 -- 172.21.15.153:0/1772057857 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c00be00 con 0x7eff1c153ce0 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 -- 172.21.15.153:0/1772057857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c153ce0 msgr2=0x7eff1c1540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 --2- 172.21.15.153:0/1772057857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c153ce0 0x7eff1c1540c0 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 rx=0x7eff0c009f20 tx=0x7eff0c009840).stop 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 -- 172.21.15.153:0/1772057857 shutdown_connections 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 --2- 172.21.15.153:0/1772057857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0644b0 0x7eff1c063df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 --2- 172.21.15.153:0/1772057857 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c153ce0 0x7eff1c1540c0 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 -- 172.21.15.153:0/1772057857 >> 172.21.15.153:0/1772057857 conn(0x7eff1c0cb710 msgr2=0x7eff1c0c76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:33.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 -- 172.21.15.153:0/1772057857 shutdown_connections 2023-08-17T00:18:33.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.637+0000 7eff2289b700 1 -- 172.21.15.153:0/1772057857 wait complete. 2023-08-17T00:18:33.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 Processor -- start 2023-08-17T00:18:33.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 -- start start 2023-08-17T00:18:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 0x7eff1c139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0aaa80 0x7eff1c0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c153ce0 0x7eff1c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0af580 con 0x7eff1c0644b0 2023-08-17T00:18:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0afd40 con 0x7eff1c153ce0 2023-08-17T00:18:33.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff2289b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1499c0 con 0x7eff1c0aaa80 2023-08-17T00:18:33.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 0x7eff1c139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff1bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 0x7eff1c139750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45882/0 (socket says 172.21.15.153:45882) 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.641+0000 7eff1bfff700 1 -- 172.21.15.153:0/3693476778 learned_addr learned my addr 172.21.15.153:0/3693476778 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff20e38700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c153ce0 0x7eff1c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff137fe700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0aaa80 0x7eff1c0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff1bfff700 1 -- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0aaa80 msgr2=0x7eff1c0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff1bfff700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0aaa80 0x7eff1c0aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff1bfff700 1 -- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c153ce0 msgr2=0x7eff1c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff1bfff700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c153ce0 0x7eff1c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff1bfff700 1 -- 172.21.15.153:0/3693476778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c009ae0 con 0x7eff1c0644b0 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff20e38700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c153ce0 0x7eff1c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff1bfff700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 0x7eff1c139750 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7eff0c00b6c0 tx=0x7eff0c009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c013a90 con 0x7eff1c0644b0 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0c013bf0 con 0x7eff1c0644b0 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c149410 con 0x7eff1c0644b0 2023-08-17T00:18:33.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0c01d460 con 0x7eff1c0644b0 2023-08-17T00:18:33.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c0af780 con 0x7eff1c0644b0 2023-08-17T00:18:33.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c06b530 con 0x7eff1c0644b0 2023-08-17T00:18:33.653 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.645+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7eff0c024030 con 0x7eff1c0644b0 2023-08-17T00:18:33.655 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.649+0000 7eff18ff9700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efefc05a150 0x7efefc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:33.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.649+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6554+0+0 (secure 0 0 0) 0x7eff0c075780 con 0x7eff1c0644b0 2023-08-17T00:18:33.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.649+0000 7eff137fe700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efefc05a150 0x7efefc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:33.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.653+0000 7eff137fe700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efefc05a150 0x7efefc05c610 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7eff1c147b80 tx=0x7eff04008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:33.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.657+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff0c049080 con 0x7eff1c0644b0 2023-08-17T00:18:33.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:33.849+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff1c0c0090 con 0x7eff1c0644b0 2023-08-17T00:18:34.520 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.513+0000 7eff18ff9700 1 -- 172.21.15.153:0/3693476778 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v155) v1 ==== 104+0+0 (secure 0 0 0) 0x7eff0c022020 con 0x7eff1c0644b0 2023-08-17T00:18:34.526 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efefc05a150 msgr2=0x7efefc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:34.527 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efefc05a150 0x7efefc05c610 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7eff1c147b80 tx=0x7eff04008040).stop 2023-08-17T00:18:34.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 msgr2=0x7eff1c139750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:34.528 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 0x7eff1c139750 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 rx=0x7eff0c00b6c0 tx=0x7eff0c009840).stop 2023-08-17T00:18:34.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 shutdown_connections 2023-08-17T00:18:34.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efefc05a150 0x7efefc05c610 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff1c153ce0 0x7eff1c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff1c0aaa80 0x7eff1c0aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 --2- 172.21.15.153:0/3693476778 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff1c0644b0 0x7eff1c139750 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.529 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 >> 172.21.15.153:0/3693476778 conn(0x7eff1c0cb710 msgr2=0x7eff1c14e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:34.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 shutdown_connections 2023-08-17T00:18:34.530 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.521+0000 7eff2289b700 1 -- 172.21.15.153:0/3693476778 wait complete. 2023-08-17T00:18:34.547 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-17T00:18:34.763 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 Processor -- start 2023-08-17T00:18:34.764 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 -- start start 2023-08-17T00:18:34.765 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d2c157c00 0x7f4d2c0bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:34.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d2c154b20 0x7f4d2c0bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:34.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2c061fa0 con 0x7f4d2c153730 2023-08-17T00:18:34.766 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c066870 con 0x7f4d2c157c00 2023-08-17T00:18:34.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.757+0000 7f4d30839700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0bc740 con 0x7f4d2c154b20 2023-08-17T00:18:34.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d2c157c00 0x7f4d2c0bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:34.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4d2c157c00 0x7f4d2c0bba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45888/0 (socket says 172.21.15.153:45888) 2023-08-17T00:18:34.767 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 -- 172.21.15.153:0/463611132 learned_addr learned my addr 172.21.15.153:0/463611132 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:34.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 -- 172.21.15.153:0/463611132 >> v2:172.21.15.178:3300/0 conn(0x7f4d2c154b20 msgr2=0x7f4d2c0bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:34.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 --2- 172.21.15.153:0/463611132 >> v2:172.21.15.178:3300/0 conn(0x7f4d2c154b20 0x7f4d2c0bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:18:34.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 -- 172.21.15.153:0/463611132 >> v1:172.21.15.178:6789/0 conn(0x7f4d2c153730 legacy=0x7f4d2c1574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:34.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 -- 172.21.15.153:0/463611132 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0bca20 con 0x7f4d2c157c00 2023-08-17T00:18:34.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2affd700 1 --2- 172.21.15.153:0/463611132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0bba10 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f4d2c0645b0 tx=0x7f4d200090f0).ready entity=mon.0 client_cookie=6a47c831f43329b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:34.770 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2a7fc700 1 -- 172.21.15.153:0/463611132 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000b5a0 con 0x7f4d2c157c00 2023-08-17T00:18:34.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2a7fc700 1 -- 172.21.15.153:0/463611132 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2000b700 con 0x7f4d2c157c00 2023-08-17T00:18:34.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d2a7fc700 1 -- 172.21.15.153:0/463611132 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000ba80 con 0x7f4d2c157c00 2023-08-17T00:18:34.771 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 -- 172.21.15.153:0/463611132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 msgr2=0x7f4d2c0bba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:34.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 --2- 172.21.15.153:0/463611132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0bba10 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 rx=0x7f4d2c0645b0 tx=0x7f4d200090f0).stop 2023-08-17T00:18:34.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 -- 172.21.15.153:0/463611132 shutdown_connections 2023-08-17T00:18:34.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 --2- 172.21.15.153:0/463611132 >> v2:172.21.15.178:3300/0 conn(0x7f4d2c154b20 0x7f4d2c0bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:18:34.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 --2- 172.21.15.153:0/463611132 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0bba10 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 -- 172.21.15.153:0/463611132 >> 172.21.15.153:0/463611132 conn(0x7f4d2c0c6ee0 msgr2=0x7f4d2c0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:34.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 -- 172.21.15.153:0/463611132 shutdown_connections 2023-08-17T00:18:34.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.761+0000 7f4d30839700 1 -- 172.21.15.153:0/463611132 wait complete. 2023-08-17T00:18:34.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 Processor -- start 2023-08-17T00:18:34.776 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 -- start start 2023-08-17T00:18:34.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d2c153730 0x7f4d2c0bd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:34.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d2c154b20 0x7f4d2c164940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:34.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:34.777 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0bd820 con 0x7f4d2c157c00 2023-08-17T00:18:34.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c164e30 con 0x7f4d2c154b20 2023-08-17T00:18:34.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d30839700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c0be640 con 0x7f4d2c153730 2023-08-17T00:18:34.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:34.778 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0a8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:45894/0 (socket says 172.21.15.153:45894) 2023-08-17T00:18:34.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 -- 172.21.15.153:0/4177274233 learned_addr learned my addr 172.21.15.153:0/4177274233 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:34.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2b7fe700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d2c153730 0x7f4d2c0bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:34.779 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2affd700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d2c154b20 0x7f4d2c164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:34.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 -- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d2c153730 msgr2=0x7f4d2c0bd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:34.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d2c153730 0x7f4d2c0bd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 -- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d2c154b20 msgr2=0x7f4d2c164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:34.780 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d2c154b20 0x7f4d2c164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:34.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.765+0000 7f4d2bfff700 1 -- 172.21.15.153:0/4177274233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d20009370 con 0x7f4d2c157c00 2023-08-17T00:18:34.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d2bfff700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0a8840 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f4d2400bb90 tx=0x7f4d24009810).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:34.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400c7e0 con 0x7f4d2c157c00 2023-08-17T00:18:34.781 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2400c960 con 0x7f4d2c157c00 2023-08-17T00:18:34.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c0bda30 con 0x7f4d2c157c00 2023-08-17T00:18:34.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2400cb10 con 0x7f4d2c157c00 2023-08-17T00:18:34.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0bdff0 con 0x7f4d2c157c00 2023-08-17T00:18:34.782 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c046dd0 con 0x7f4d2c157c00 2023-08-17T00:18:34.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.769+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4d2401c070 con 0x7f4d2c157c00 2023-08-17T00:18:34.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.773+0000 7f4d137fe700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a120 0x7f4d1805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:34.783 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.773+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6554+0+0 (secure 0 0 0) 0x7f4d24073fe0 con 0x7f4d2c157c00 2023-08-17T00:18:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.773+0000 7f4d2b7fe700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a120 0x7f4d1805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.773+0000 7f4d2b7fe700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a120 0x7f4d1805c5e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f4d2c150de0 tx=0x7f4d1c006ee0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:34.784 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.777+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4d240477f0 con 0x7f4d2c157c00 2023-08-17T00:18:34.940 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:34.933+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d2c0bcd00 con 0x7f4d2c157c00 2023-08-17T00:18:35.539 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.533+0000 7f4d137fe700 1 -- 172.21.15.153:0/4177274233 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v197) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4d2401a030 con 0x7f4d2c157c00 2023-08-17T00:18:35.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.537+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a120 msgr2=0x7f4d1805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.537+0000 7f4d30839700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a120 0x7f4d1805c5e0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f4d2c150de0 tx=0x7f4d1c006ee0).stop 2023-08-17T00:18:35.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.537+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 msgr2=0x7f4d2c0a8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.537+0000 7f4d30839700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0a8840 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 rx=0x7f4d2400bb90 tx=0x7f4d24009810).stop 2023-08-17T00:18:35.546 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 shutdown_connections 2023-08-17T00:18:35.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4d1805a120 0x7f4d1805c5e0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4d2c157c00 0x7f4d2c0a8840 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d2c154b20 0x7f4d2c164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 --2- 172.21.15.153:0/4177274233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d2c153730 0x7f4d2c0bd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 >> 172.21.15.153:0/4177274233 conn(0x7f4d2c0c6ee0 msgr2=0x7f4d2c068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:35.547 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 shutdown_connections 2023-08-17T00:18:35.548 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.541+0000 7f4d30839700 1 -- 172.21.15.153:0/4177274233 wait complete. 2023-08-17T00:18:35.548 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_metadata' removed 2023-08-17T00:18:35.566 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-17T00:18:35.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.729+0000 7f4a96839700 1 Processor -- start 2023-08-17T00:18:35.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.729+0000 7f4a96839700 1 -- start start 2023-08-17T00:18:35.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a96839700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a90064df0 0x7f4a900651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:35.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a96839700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a900bc570 con 0x7f4a9014b6b0 2023-08-17T00:18:35.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a96839700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a900bc850 con 0x7f4a900bb820 2023-08-17T00:18:35.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a96839700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a900bc390 con 0x7f4a90064df0 2023-08-17T00:18:35.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a96038700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f4a9014b6b0 0x7f4a9014bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43812/0 (socket says 172.21.15.153:43812) 2023-08-17T00:18:35.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a96038700 1 -- 172.21.15.153:0/4103446618 learned_addr learned my addr 172.21.15.153:0/4103446618 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:35.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.733+0000 7f4a95837700 1 --2- 172.21.15.153:0/4103446618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a90064df0 0x7f4a900651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:35.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a94835700 1 -- 172.21.15.153:0/4103446618 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3380374916 0 0) 0x7f4a900bc570 con 0x7f4a9014b6b0 2023-08-17T00:18:35.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a94835700 1 -- 172.21.15.153:0/4103446618 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a7c0033f0 con 0x7f4a9014b6b0 2023-08-17T00:18:35.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a95837700 1 -- 172.21.15.153:0/4103446618 >> v1:172.21.15.178:6789/0 conn(0x7f4a900bb820 legacy=0x7f4a900bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a94835700 1 -- 172.21.15.153:0/4103446618 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3863460490 0 0) 0x7f4a900bc850 con 0x7f4a900bb820 2023-08-17T00:18:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a95837700 1 -- 172.21.15.153:0/4103446618 >> v1:172.21.15.153:6789/0 conn(0x7f4a9014b6b0 legacy=0x7f4a9014bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a95837700 1 -- 172.21.15.153:0/4103446618 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a900bcb30 con 0x7f4a90064df0 2023-08-17T00:18:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a95837700 1 --2- 172.21.15.153:0/4103446618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a90064df0 0x7f4a900651d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f4a8c009790 tx=0x7f4a8c009060).ready entity=mon.2 client_cookie=feeffa3f7e70ac7e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a94835700 1 -- 172.21.15.153:0/4103446618 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f510 con 0x7f4a90064df0 2023-08-17T00:18:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a94835700 1 -- 172.21.15.153:0/4103446618 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c00f670 con 0x7f4a90064df0 2023-08-17T00:18:35.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a94835700 1 -- 172.21.15.153:0/4103446618 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c00f9f0 con 0x7f4a90064df0 2023-08-17T00:18:35.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 -- 172.21.15.153:0/4103446618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a90064df0 msgr2=0x7f4a900651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 --2- 172.21.15.153:0/4103446618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a90064df0 0x7f4a900651d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f4a8c009790 tx=0x7f4a8c009060).stop 2023-08-17T00:18:35.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 -- 172.21.15.153:0/4103446618 shutdown_connections 2023-08-17T00:18:35.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 --2- 172.21.15.153:0/4103446618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a90064df0 0x7f4a900651d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 -- 172.21.15.153:0/4103446618 >> 172.21.15.153:0/4103446618 conn(0x7f4a900c6ee0 msgr2=0x7f4a900c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:35.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 -- 172.21.15.153:0/4103446618 shutdown_connections 2023-08-17T00:18:35.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.737+0000 7f4a96839700 1 -- 172.21.15.153:0/4103446618 wait complete. 2023-08-17T00:18:35.746 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 Processor -- start 2023-08-17T00:18:35.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 -- start start 2023-08-17T00:18:35.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 0x7f4a900c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:35.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a900bb820 0x7f4a90163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:35.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a9014b6b0 0x7f4a900c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:35.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90164d80 con 0x7f4a90064df0 2023-08-17T00:18:35.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a901647c0 con 0x7f4a900bb820 2023-08-17T00:18:35.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96839700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a90164aa0 con 0x7f4a9014b6b0 2023-08-17T00:18:35.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 0x7f4a900c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:35.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 0x7f4a900c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50408/0 (socket says 172.21.15.153:50408) 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 -- 172.21.15.153:0/2181613744 learned_addr learned my addr 172.21.15.153:0/2181613744 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96038700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a9014b6b0 0x7f4a900c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 -- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a9014b6b0 msgr2=0x7f4a900c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95036700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a900bb820 0x7f4a90163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a9014b6b0 0x7f4a900c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 -- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a900bb820 msgr2=0x7f4a90163e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:35.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a900bb820 0x7f4a90163e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 -- 172.21.15.153:0/2181613744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c0092a0 con 0x7f4a90064df0 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95036700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a900bb820 0x7f4a90163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a96038700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a9014b6b0 0x7f4a900c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.741+0000 7f4a95837700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 0x7f4a900c24f0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f4a900c4180 tx=0x7f4a8c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c0117e0 con 0x7f4a90064df0 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8c011980 con 0x7f4a90064df0 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a901650b0 con 0x7f4a90064df0 2023-08-17T00:18:35.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8c011d40 con 0x7f4a90064df0 2023-08-17T00:18:35.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a900c29e0 con 0x7f4a90064df0 2023-08-17T00:18:35.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a90046dd0 con 0x7f4a90064df0 2023-08-17T00:18:35.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.745+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4a8c00f070 con 0x7f4a90064df0 2023-08-17T00:18:35.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.749+0000 7f4a85ffb700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a7405a1a0 0x7f4a7405c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:35.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.749+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a8c075620 con 0x7f4a90064df0 2023-08-17T00:18:35.756 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.749+0000 7f4a95036700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a7405a1a0 0x7f4a7405c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:35.757 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.749+0000 7f4a95036700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a7405a1a0 0x7f4a7405c660 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f4a800011e0 tx=0x7f4a80009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:35.759 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.753+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4a8c0490e0 con 0x7f4a90064df0 2023-08-17T00:18:35.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:35.913+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4a900bb440 con 0x7f4a90064df0 2023-08-17T00:18:36.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.549+0000 7f4a85ffb700 1 -- 172.21.15.153:0/2181613744 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v198) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4a8c04c6c0 con 0x7f4a90064df0 2023-08-17T00:18:36.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a7405a1a0 msgr2=0x7f4a7405c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a7405a1a0 0x7f4a7405c660 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f4a800011e0 tx=0x7f4a80009040).stop 2023-08-17T00:18:36.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 msgr2=0x7f4a900c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 0x7f4a900c24f0 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 rx=0x7f4a900c4180 tx=0x7f4a8c017000).stop 2023-08-17T00:18:36.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 shutdown_connections 2023-08-17T00:18:36.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4a7405a1a0 0x7f4a7405c660 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a9014b6b0 0x7f4a900c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a900bb820 0x7f4a90163e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 --2- 172.21.15.153:0/2181613744 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4a90064df0 0x7f4a900c24f0 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 >> 172.21.15.153:0/2181613744 conn(0x7f4a900c6ee0 msgr2=0x7f4a900c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:36.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 shutdown_connections 2023-08-17T00:18:36.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.553+0000 7f4a96839700 1 -- 172.21.15.153:0/2181613744 wait complete. 2023-08-17T00:18:36.562 INFO:teuthology.orchestra.run.smithi153.stderr:pool 'cephfs_data' removed 2023-08-17T00:18:36.579 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_hack_allow_loading_invalid_metadata 2023-08-17T00:18:36.736 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.729+0000 7f85cd769700 1 Processor -- start 2023-08-17T00:18:36.737 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.729+0000 7f85cd769700 1 -- start start 2023-08-17T00:18:36.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85cd769700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f85c80cb240 0x7f85c8061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:36.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85cd769700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f85c8062490 0x7f85c80aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:36.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85cd769700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c80c11d0 con 0x7f85c8153aa0 2023-08-17T00:18:36.738 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85cd769700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c80c5e80 con 0x7f85c8062490 2023-08-17T00:18:36.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85cd769700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c8062920 con 0x7f85c80cb240 2023-08-17T00:18:36.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c6ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f85c8153aa0 0x7f85c80c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43814/0 (socket says 172.21.15.153:43814) 2023-08-17T00:18:36.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c6ffd700 1 -- 172.21.15.153:0/3989094883 learned_addr learned my addr 172.21.15.153:0/3989094883 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:36.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c77fe700 1 --2- 172.21.15.153:0/3989094883 >> v2:172.21.15.153:3300/0 conn(0x7f85c8062490 0x7f85c80aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:36.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85be7fc700 1 --2- 172.21.15.153:0/3989094883 >> v2:172.21.15.178:3300/0 conn(0x7f85c80cb240 0x7f85c8061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:36.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c67fc700 1 -- 172.21.15.153:0/3989094883 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889870464 0 0) 0x7f85c80c11d0 con 0x7f85c8153aa0 2023-08-17T00:18:36.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c67fc700 1 -- 172.21.15.153:0/3989094883 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85b40033f0 con 0x7f85c8153aa0 2023-08-17T00:18:36.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85be7fc700 1 -- 172.21.15.153:0/3989094883 >> v2:172.21.15.153:3300/0 conn(0x7f85c8062490 msgr2=0x7f85c80aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85be7fc700 1 --2- 172.21.15.153:0/3989094883 >> v2:172.21.15.153:3300/0 conn(0x7f85c8062490 0x7f85c80aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c67fc700 1 -- 172.21.15.153:0/3989094883 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 399892738 0 0) 0x7f85b40033f0 con 0x7f85c8153aa0 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85be7fc700 1 -- 172.21.15.153:0/3989094883 >> v1:172.21.15.153:6789/0 conn(0x7f85c8153aa0 legacy=0x7f85c80c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85be7fc700 1 -- 172.21.15.153:0/3989094883 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c80c1660 con 0x7f85c80cb240 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c77fe700 1 --2- 172.21.15.153:0/3989094883 >> v2:172.21.15.153:3300/0 conn(0x7f85c8062490 0x7f85c80aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85be7fc700 1 --2- 172.21.15.153:0/3989094883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c80cb240 0x7f85c8061fa0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f85c8082070 tx=0x7f85b8009060).ready entity=mon.1 client_cookie=a4f5469f320c7d5b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c67fc700 1 -- 172.21.15.153:0/3989094883 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0001470 con 0x7f85c80cb240 2023-08-17T00:18:36.742 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c67fc700 1 -- 172.21.15.153:0/3989094883 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8011400 con 0x7f85c80cb240 2023-08-17T00:18:36.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.733+0000 7f85c67fc700 1 -- 172.21.15.153:0/3989094883 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8011780 con 0x7f85c80cb240 2023-08-17T00:18:36.743 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 -- 172.21.15.153:0/3989094883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c80cb240 msgr2=0x7f85c8061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 --2- 172.21.15.153:0/3989094883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c80cb240 0x7f85c8061fa0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7f85c8082070 tx=0x7f85b8009060).stop 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 -- 172.21.15.153:0/3989094883 shutdown_connections 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 --2- 172.21.15.153:0/3989094883 >> v2:172.21.15.153:3300/0 conn(0x7f85c8062490 0x7f85c80aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 --2- 172.21.15.153:0/3989094883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c80cb240 0x7f85c8061fa0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 -- 172.21.15.153:0/3989094883 >> 172.21.15.153:0/3989094883 conn(0x7f85c80640b0 msgr2=0x7f85c80ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 -- 172.21.15.153:0/3989094883 shutdown_connections 2023-08-17T00:18:36.744 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 -- 172.21.15.153:0/3989094883 wait complete. 2023-08-17T00:18:36.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 Processor -- start 2023-08-17T00:18:36.745 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.737+0000 7f85cd769700 1 -- start start 2023-08-17T00:18:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c8062490 0x7f85c80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 0x7f85c81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85c8153aa0 0x7f85c80c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:36.747 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80ae120 con 0x7f85c80cb240 2023-08-17T00:18:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80ae400 con 0x7f85c8062490 2023-08-17T00:18:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c80ae6e0 con 0x7f85c8153aa0 2023-08-17T00:18:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 0x7f85c81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 0x7f85c81513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50422/0 (socket says 172.21.15.153:50422) 2023-08-17T00:18:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 -- 172.21.15.153:0/4279137524 learned_addr learned my addr 172.21.15.153:0/4279137524 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:36.748 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85c6ffd700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c8062490 0x7f85c80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:36.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85c77fe700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85c8153aa0 0x7f85c80c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:36.749 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 -- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85c8153aa0 msgr2=0x7f85c80c3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85c8153aa0 0x7f85c80c3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 -- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c8062490 msgr2=0x7f85c80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c8062490 0x7f85c80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 -- 172.21.15.153:0/4279137524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c0009a20 con 0x7f85c80cb240 2023-08-17T00:18:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85c6ffd700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c8062490 0x7f85c80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:36.750 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85be7fc700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 0x7f85c81513f0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f85c8083bf0 tx=0x7f85b8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:36.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80108f0 con 0x7f85c80cb240 2023-08-17T00:18:36.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b8010a50 con 0x7f85c80cb240 2023-08-17T00:18:36.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b80092a0 con 0x7f85c80cb240 2023-08-17T00:18:36.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b8010df0 con 0x7f85c80cb240 2023-08-17T00:18:36.751 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.741+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c80aeca0 con 0x7f85c80cb240 2023-08-17T00:18:36.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.745+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c806b4c0 con 0x7f85c80cb240 2023-08-17T00:18:36.752 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.745+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f85b800f070 con 0x7f85c80cb240 2023-08-17T00:18:36.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.745+0000 7f85bf7fe700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f85a805a180 0x7f85a805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:36.753 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.745+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f85b8075070 con 0x7f85c80cb240 2023-08-17T00:18:36.754 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.749+0000 7f85c6ffd700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f85a805a180 0x7f85a805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:36.755 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.749+0000 7f85c6ffd700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f85a805a180 0x7f85a805c640 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f85b0007060 tx=0x7f85b0001680).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:36.760 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.753+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f85b8048e70 con 0x7f85c80cb240 2023-08-17T00:18:36.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.913+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_hack_allow_loading_invalid_metadata"} v 0) v1 -- 0x7f85c80c60e0 con 0x7f85c80cb240 2023-08-17T00:18:36.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.925+0000 7f85bf7fe700 1 -- 172.21.15.153:0/4279137524 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_hack_allow_loading_invalid_metadata"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f85b8021070 con 0x7f85c80cb240 2023-08-17T00:18:36.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f85a805a180 msgr2=0x7f85a805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f85a805a180 0x7f85a805c640 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f85b0007060 tx=0x7f85b0001680).stop 2023-08-17T00:18:36.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 msgr2=0x7f85c81513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:36.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 0x7f85c81513f0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 rx=0x7f85c8083bf0 tx=0x7f85b8016000).stop 2023-08-17T00:18:36.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 shutdown_connections 2023-08-17T00:18:36.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f85a805a180 0x7f85a805c640 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85c8153aa0 0x7f85c80c3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f85c80cb240 0x7f85c81513f0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 --2- 172.21.15.153:0/4279137524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85c8062490 0x7f85c80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:36.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 >> 172.21.15.153:0/4279137524 conn(0x7f85c80640b0 msgr2=0x7f85c80a9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:36.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 shutdown_connections 2023-08-17T00:18:36.936 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:36.929+0000 7f85cd769700 1 -- 172.21.15.153:0/4279137524 wait complete. 2023-08-17T00:18:36.955 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-08-17T00:18:37.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.105+0000 7f582971b700 1 Processor -- start 2023-08-17T00:18:37.111 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.105+0000 7f582971b700 1 -- start start 2023-08-17T00:18:37.113 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f582971b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58240cb240 0x7f5824061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f582971b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58240c11d0 con 0x7f5824153aa0 2023-08-17T00:18:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f582971b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58240c5e80 con 0x7f5824062490 2023-08-17T00:18:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f582971b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5824062920 con 0x7f58240cb240 2023-08-17T00:18:37.114 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f5822ffd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5824153aa0 0x7f58240c5770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43828/0 (socket says 172.21.15.153:43828) 2023-08-17T00:18:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f5822ffd700 1 -- 172.21.15.153:0/1703392172 learned_addr learned my addr 172.21.15.153:0/1703392172 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:37.115 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f581a7fc700 1 --2- 172.21.15.153:0/1703392172 >> v2:172.21.15.178:3300/0 conn(0x7f58240cb240 0x7f5824061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373009512 0 0) 0x7f58240c11d0 con 0x7f5824153aa0 2023-08-17T00:18:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58100033f0 con 0x7f5824153aa0 2023-08-17T00:18:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924248138 0 0) 0x7f58240c5e80 con 0x7f5824062490 2023-08-17T00:18:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58240c11d0 con 0x7f5824062490 2023-08-17T00:18:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f581a7fc700 1 -- 172.21.15.153:0/1703392172 >> v1:172.21.15.178:6789/0 conn(0x7f5824062490 legacy=0x7f58240aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.116 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f581a7fc700 1 -- 172.21.15.153:0/1703392172 >> v1:172.21.15.153:6789/0 conn(0x7f5824153aa0 legacy=0x7f58240c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f581a7fc700 1 -- 172.21.15.153:0/1703392172 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58240c1660 con 0x7f58240cb240 2023-08-17T00:18:37.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f581a7fc700 1 --2- 172.21.15.153:0/1703392172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824061fa0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f580c009e60 tx=0x7f580c009780).ready entity=mon.1 client_cookie=77646617e3458da6 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:37.117 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c00e070 con 0x7f58240cb240 2023-08-17T00:18:37.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c00bab0 con 0x7f58240cb240 2023-08-17T00:18:37.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.109+0000 7f58227fc700 1 -- 172.21.15.153:0/1703392172 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c00be30 con 0x7f58240cb240 2023-08-17T00:18:37.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 -- 172.21.15.153:0/1703392172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 msgr2=0x7f5824061fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.118 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 --2- 172.21.15.153:0/1703392172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824061fa0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7f580c009e60 tx=0x7f580c009780).stop 2023-08-17T00:18:37.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 -- 172.21.15.153:0/1703392172 shutdown_connections 2023-08-17T00:18:37.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 --2- 172.21.15.153:0/1703392172 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824061fa0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 -- 172.21.15.153:0/1703392172 >> 172.21.15.153:0/1703392172 conn(0x7f58240640b0 msgr2=0x7f58240ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:37.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 -- 172.21.15.153:0/1703392172 shutdown_connections 2023-08-17T00:18:37.119 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 -- 172.21.15.153:0/1703392172 wait complete. 2023-08-17T00:18:37.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.113+0000 7f582971b700 1 Processor -- start 2023-08-17T00:18:37.121 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 -- start start 2023-08-17T00:18:37.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 0x7f58240c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824164610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.123 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5824153aa0 0x7f58240b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58240c34a0 con 0x7f5824062490 2023-08-17T00:18:37.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58240c3780 con 0x7f58240cb240 2023-08-17T00:18:37.124 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58240c3a60 con 0x7f5824153aa0 2023-08-17T00:18:37.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 0x7f58240c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.125 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 0x7f58240c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50436/0 (socket says 172.21.15.153:50436) 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 -- 172.21.15.153:0/2417397149 learned_addr learned my addr 172.21.15.153:0/2417397149 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f58237fe700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5824153aa0 0x7f58240b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f581a7fc700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824164610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 -- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5824153aa0 msgr2=0x7f58240b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5824153aa0 0x7f58240b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 -- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 msgr2=0x7f5824164610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.126 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824164610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 -- 172.21.15.153:0/2417397149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f580c009a20 con 0x7f5824062490 2023-08-17T00:18:37.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f5822ffd700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 0x7f58240c2de0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f581400c560 tx=0x7f5814007d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:37.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140072e0 con 0x7f5824062490 2023-08-17T00:18:37.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5814007440 con 0x7f5824062490 2023-08-17T00:18:37.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.117+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58240c3d40 con 0x7f5824062490 2023-08-17T00:18:37.127 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.121+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140057a0 con 0x7f5824062490 2023-08-17T00:18:37.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.121+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5824164b00 con 0x7f5824062490 2023-08-17T00:18:37.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.121+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582406b4c0 con 0x7f5824062490 2023-08-17T00:18:37.128 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.121+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5814010070 con 0x7f5824062490 2023-08-17T00:18:37.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.121+0000 7f581b7fe700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f580405a150 0x7f580405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.129 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.125+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f5814073580 con 0x7f5824062490 2023-08-17T00:18:37.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.125+0000 7f581a7fc700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f580405a150 0x7f580405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.130 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.125+0000 7f581a7fc700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f580405a150 0x7f580405c610 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f58240cb660 tx=0x7f580c009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:37.132 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.125+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f581404abf0 con 0x7f5824062490 2023-08-17T00:18:37.309 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.305+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f58240c60e0 con 0x7f5824062490 2023-08-17T00:18:37.315 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.309+0000 7f581b7fe700 1 -- 172.21.15.153:0/2417397149 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5814007e60 con 0x7f5824062490 2023-08-17T00:18:37.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f580405a150 msgr2=0x7f580405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f580405a150 0x7f580405c610 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 rx=0x7f58240cb660 tx=0x7f580c009780).stop 2023-08-17T00:18:37.319 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 msgr2=0x7f58240c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 0x7f58240c2de0 secure :-1 s=READY pgs=2101 cs=0 l=1 rev1=1 rx=0x7f581400c560 tx=0x7f5814007d20).stop 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 shutdown_connections 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f580405a150 0x7f580405c610 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5824153aa0 0x7f58240b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58240cb240 0x7f5824164610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 --2- 172.21.15.153:0/2417397149 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f5824062490 0x7f58240c2de0 unknown :-1 s=CLOSED pgs=2101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.320 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 >> 172.21.15.153:0/2417397149 conn(0x7f58240640b0 msgr2=0x7f58240c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:37.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 shutdown_connections 2023-08-17T00:18:37.321 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.313+0000 7f582971b700 1 -- 172.21.15.153:0/2417397149 wait complete. 2023-08-17T00:18:37.339 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2023-08-17T00:18:37.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.485+0000 7f796d9f9700 1 Processor -- start 2023-08-17T00:18:37.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.485+0000 7f796d9f9700 1 -- start start 2023-08-17T00:18:37.494 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d9f9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f79680c5ea0 0x7f79680634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d9f9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f79680639a0 0x7f79680bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d9f9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7968154e90 con 0x7f79680acf30 2023-08-17T00:18:37.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d9f9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680c1730 con 0x7f79680639a0 2023-08-17T00:18:37.495 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d9f9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7968153fc0 con 0x7f79680c5ea0 2023-08-17T00:18:37.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796c9f7700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f79680acf30 0x7f79680c1020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43834/0 (socket says 172.21.15.153:43834) 2023-08-17T00:18:37.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796c9f7700 1 -- 172.21.15.153:0/1158324597 learned_addr learned my addr 172.21.15.153:0/1158324597 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:37.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d1f8700 1 --2- 172.21.15.153:0/1158324597 >> v2:172.21.15.153:3300/0 conn(0x7f79680639a0 0x7f79680bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f7967fff700 1 --2- 172.21.15.153:0/1158324597 >> v2:172.21.15.178:3300/0 conn(0x7f79680c5ea0 0x7f79680634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d1f8700 1 -- 172.21.15.153:0/1158324597 >> v2:172.21.15.178:3300/0 conn(0x7f79680c5ea0 msgr2=0x7f79680634b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:37.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d1f8700 1 --2- 172.21.15.153:0/1158324597 >> v2:172.21.15.178:3300/0 conn(0x7f79680c5ea0 0x7f79680634b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.497 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d1f8700 1 -- 172.21.15.153:0/1158324597 >> v1:172.21.15.153:6789/0 conn(0x7f79680acf30 legacy=0x7f79680c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f79677fe700 1 -- 172.21.15.153:0/1158324597 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554856226 0 0) 0x7f7968154e90 con 0x7f79680acf30 2023-08-17T00:18:37.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d1f8700 1 -- 172.21.15.153:0/1158324597 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968154280 con 0x7f79680639a0 2023-08-17T00:18:37.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f796d1f8700 1 --2- 172.21.15.153:0/1158324597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680639a0 0x7f79680bfad0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7f79680b0a60 tx=0x7f7960009780).ready entity=mon.0 client_cookie=3ca6a173ccc9c90b server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:37.498 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f79677fe700 1 -- 172.21.15.153:0/1158324597 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796000e070 con 0x7f79680639a0 2023-08-17T00:18:37.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f79677fe700 1 -- 172.21.15.153:0/1158324597 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796000bb60 con 0x7f79680639a0 2023-08-17T00:18:37.499 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.489+0000 7f79677fe700 1 -- 172.21.15.153:0/1158324597 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7960012410 con 0x7f79680639a0 2023-08-17T00:18:37.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 -- 172.21.15.153:0/1158324597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680639a0 msgr2=0x7f79680bfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1158324597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680639a0 0x7f79680bfad0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 rx=0x7f79680b0a60 tx=0x7f7960009780).stop 2023-08-17T00:18:37.500 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 -- 172.21.15.153:0/1158324597 shutdown_connections 2023-08-17T00:18:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1158324597 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680639a0 0x7f79680bfad0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1158324597 >> v2:172.21.15.178:3300/0 conn(0x7f79680c5ea0 0x7f79680634b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 -- 172.21.15.153:0/1158324597 >> 172.21.15.153:0/1158324597 conn(0x7f79680cb330 msgr2=0x7f79680c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 -- 172.21.15.153:0/1158324597 shutdown_connections 2023-08-17T00:18:37.501 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.493+0000 7f796d9f9700 1 -- 172.21.15.153:0/1158324597 wait complete. 2023-08-17T00:18:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 Processor -- start 2023-08-17T00:18:37.502 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 -- start start 2023-08-17T00:18:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79680639a0 0x7f79680c2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 0x7f79681640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.506 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79680c4010 0x7f79680a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7968164590 con 0x7f79680acf30 2023-08-17T00:18:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680c3b80 con 0x7f79680639a0 2023-08-17T00:18:37.507 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d9f9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680c2f70 con 0x7f79680c4010 2023-08-17T00:18:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 0x7f79681640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 0x7f79681640a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50446/0 (socket says 172.21.15.153:50446) 2023-08-17T00:18:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796c9f7700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79680639a0 0x7f79680c2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.508 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 -- 172.21.15.153:0/1169499008 learned_addr learned my addr 172.21.15.153:0/1169499008 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f796d1f8700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79680c4010 0x7f79680a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.509 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 -- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79680c4010 msgr2=0x7f79680a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79680c4010 0x7f79680a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 -- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79680639a0 msgr2=0x7f79680c2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:37.510 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79680639a0 0x7f79680c2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 -- 172.21.15.153:0/1169499008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009a20 con 0x7f79680acf30 2023-08-17T00:18:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.497+0000 7f7967fff700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 0x7f79681640a0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f795400e900 tx=0x7f7954009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.501+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954012600 con 0x7f79680acf30 2023-08-17T00:18:37.511 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.501+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954012760 con 0x7f79680acf30 2023-08-17T00:18:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.501+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954012ae0 con 0x7f79680acf30 2023-08-17T00:18:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.501+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680c3250 con 0x7f79680acf30 2023-08-17T00:18:37.512 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.501+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79680c3810 con 0x7f79680acf30 2023-08-17T00:18:37.513 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.501+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796806b4c0 con 0x7f79680acf30 2023-08-17T00:18:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.505+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7954022070 con 0x7f79680acf30 2023-08-17T00:18:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.505+0000 7f7964ff9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794c05a120 0x7f794c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.505+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f7954074270 con 0x7f79680acf30 2023-08-17T00:18:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.505+0000 7f796c9f7700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794c05a120 0x7f794c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:37.514 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.505+0000 7f796c9f7700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794c05a120 0x7f794c05c5e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f795c0011e0 tx=0x7f795c007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:37.518 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.513+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f7954047eb0 con 0x7f79680acf30 2023-08-17T00:18:37.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:37.729+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) v1 -- 0x7f7968154560 con 0x7f79680acf30 2023-08-17T00:18:38.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.553+0000 7f7964ff9700 1 -- 172.21.15.153:0/1169499008 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v729) v1 ==== 133+0+0 (secure 0 0 0) 0x7f795404b4d0 con 0x7f79680acf30 2023-08-17T00:18:38.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794c05a120 msgr2=0x7f794c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:38.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794c05a120 0x7f794c05c5e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f795c0011e0 tx=0x7f795c007bb0).stop 2023-08-17T00:18:38.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 msgr2=0x7f79681640a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:38.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 0x7f79681640a0 secure :-1 s=READY pgs=2104 cs=0 l=1 rev1=1 rx=0x7f795400e900 tx=0x7f7954009060).stop 2023-08-17T00:18:38.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 shutdown_connections 2023-08-17T00:18:38.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f794c05a120 0x7f794c05c5e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:38.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f79680c4010 0x7f79680a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:38.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f79680acf30 0x7f79681640a0 unknown :-1 s=CLOSED pgs=2104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:38.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 --2- 172.21.15.153:0/1169499008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f79680639a0 0x7f79680c2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:38.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 >> 172.21.15.153:0/1169499008 conn(0x7f79680cb330 msgr2=0x7f79680c0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.557+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 shutdown_connections 2023-08-17T00:18:38.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:38.561+0000 7f796d9f9700 1 -- 172.21.15.153:0/1169499008 wait complete. 2023-08-17T00:18:38.588 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-08-17T00:18:38.589 INFO:tasks.cephfs_test_runner: 2023-08-17T00:18:38.589 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-17T00:18:38.590 INFO:tasks.cephfs_test_runner:Ran 12 tests in 914.727s 2023-08-17T00:18:38.590 INFO:tasks.cephfs_test_runner: 2023-08-17T00:18:38.590 INFO:tasks.cephfs_test_runner:OK 2023-08-17T00:18:38.590 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-17T00:18:38.600 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-17T00:18:38.632 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-17T00:18:38.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:38.632 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:18:38.650 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-17T00:18:38.651 INFO:teuthology.orchestra.run.smithi153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-17T00:18:38.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:38.652 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-17T00:18:38.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:38.734 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-17T00:18:38.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:38.818 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-08-17T00:18:39.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.025 DEBUG:teuthology.orchestra.run.smithi153:> ip netns list 2023-08-17T00:18:39.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.041 DEBUG:teuthology.orchestra.run.smithi153:> sudo ip link delete ceph-brx 2023-08-17T00:18:39.127 INFO:teuthology.orchestra.run.smithi153.stderr:Cannot find device "ceph-brx" 2023-08-17T00:18:39.130 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:18:39.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.131 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-08-17T00:18:39.150 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-17T00:18:39.150 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-17T00:18:39.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-17T00:18:39.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.227 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-17T00:18:39.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.316 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-08-17T00:18:39.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.528 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2023-08-17T00:18:39.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-17T00:18:39.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2023-08-17T00:18:39.630 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2023-08-17T00:18:39.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:18:39.633 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-17T00:18:39.649 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-08-17T00:18:39.649 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:18:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.801+0000 7ff089e8f700 1 Processor -- start 2023-08-17T00:18:39.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.801+0000 7ff089e8f700 1 -- start start 2023-08-17T00:18:39.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.801+0000 7ff089e8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff0840c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:39.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.801+0000 7ff089e8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0841585a0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.801+0000 7ff089e8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff084066400 con 0x7ff084068820 2023-08-17T00:18:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.801+0000 7ff089e8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff084062dc0 con 0x7ff0840a8df0 2023-08-17T00:18:39.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff08968e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7ff0840aa6e0 0x7ff0840626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43840/0 (socket says 172.21.15.153:43840) 2023-08-17T00:18:39.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff08968e700 1 -- 172.21.15.153:0/3121187616 learned_addr learned my addr 172.21.15.153:0/3121187616 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:39.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff088e8d700 1 --2- 172.21.15.153:0/3121187616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff0840c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:39.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff07b7fe700 1 -- 172.21.15.153:0/3121187616 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533577887 0 0) 0x7ff0841585a0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff07b7fe700 1 -- 172.21.15.153:0/3121187616 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff06c0033f0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff088e8d700 1 -- 172.21.15.153:0/3121187616 >> v1:172.21.15.178:6789/0 conn(0x7ff084068820 legacy=0x7ff084061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff07b7fe700 1 -- 172.21.15.153:0/3121187616 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433872116 0 0) 0x7ff084066400 con 0x7ff084068820 2023-08-17T00:18:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff088e8d700 1 -- 172.21.15.153:0/3121187616 >> v1:172.21.15.153:6789/0 conn(0x7ff0840aa6e0 legacy=0x7ff0840626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff088e8d700 1 -- 172.21.15.153:0/3121187616 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0840b9d30 con 0x7ff0840a8df0 2023-08-17T00:18:39.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff088e8d700 1 --2- 172.21.15.153:0/3121187616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff0840c1490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7ff080009ee0 tx=0x7ff080009780).ready entity=mon.2 client_cookie=7c17f6d7223f6854 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:39.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff07b7fe700 1 -- 172.21.15.153:0/3121187616 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08000e070 con 0x7ff0840a8df0 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff07b7fe700 1 -- 172.21.15.153:0/3121187616 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08000bc30 con 0x7ff0840a8df0 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff07b7fe700 1 -- 172.21.15.153:0/3121187616 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080012410 con 0x7ff0840a8df0 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff089e8f700 1 -- 172.21.15.153:0/3121187616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 msgr2=0x7ff0840c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff089e8f700 1 --2- 172.21.15.153:0/3121187616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff0840c1490 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7ff080009ee0 tx=0x7ff080009780).stop 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff089e8f700 1 -- 172.21.15.153:0/3121187616 shutdown_connections 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.805+0000 7ff089e8f700 1 --2- 172.21.15.153:0/3121187616 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff0840c1490 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:39.814 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.809+0000 7ff089e8f700 1 -- 172.21.15.153:0/3121187616 >> 172.21.15.153:0/3121187616 conn(0x7ff0840c6620 msgr2=0x7ff0840c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.809+0000 7ff089e8f700 1 -- 172.21.15.153:0/3121187616 shutdown_connections 2023-08-17T00:18:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.809+0000 7ff089e8f700 1 -- 172.21.15.153:0/3121187616 wait complete. 2023-08-17T00:18:39.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.809+0000 7ff089e8f700 1 Processor -- start 2023-08-17T00:18:39.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.809+0000 7ff089e8f700 1 -- start start 2023-08-17T00:18:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff084068820 0x7ff0840bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff08416b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 0x7ff084169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08416b120 con 0x7ff0840aa6e0 2023-08-17T00:18:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08416a510 con 0x7ff084068820 2023-08-17T00:18:39.818 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08416a7f0 con 0x7ff0840a8df0 2023-08-17T00:18:39.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 0x7ff084169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 0x7ff084169a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50448/0 (socket says 172.21.15.153:50448) 2023-08-17T00:18:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 -- 172.21.15.153:0/4047465114 learned_addr learned my addr 172.21.15.153:0/4047465114 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff088e8d700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff084068820 0x7ff0840bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff07bfff700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff08416b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 -- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 msgr2=0x7ff08416b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff08416b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 -- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff084068820 msgr2=0x7ff0840bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff084068820 0x7ff0840bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 -- 172.21.15.153:0/4047465114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff080009a20 con 0x7ff0840aa6e0 2023-08-17T00:18:39.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff08968e700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 0x7ff084169a50 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7ff07c00c410 tx=0x7ff07c007bd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0070d0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c007230 con 0x7ff0840aa6e0 2023-08-17T00:18:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08416aad0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0075f0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.813+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0840b53e0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.817+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08416af50 con 0x7ff0840aa6e0 2023-08-17T00:18:39.823 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.817+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff07c010070 con 0x7ff0840aa6e0 2023-08-17T00:18:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.817+0000 7ff078ff9700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff07005a150 0x7ff07005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.817+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7ff07c0732d0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.821+0000 7ff088e8d700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff07005a150 0x7ff07005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:39.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.821+0000 7ff088e8d700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff07005a150 0x7ff07005c610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ff080009f90 tx=0x7ff080009780).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:39.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.825+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7ff07c046f10 con 0x7ff0840aa6e0 2023-08-17T00:18:39.990 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.985+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff08406b4c0 con 0x7ff0840aa6e0 2023-08-17T00:18:39.992 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.985+0000 7ff078ff9700 1 -- 172.21.15.153:0/4047465114 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+14031 (secure 0 0 0) 0x7ff07c04a530 con 0x7ff0840aa6e0 2023-08-17T00:18:39.993 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:39.994 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":198,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:18:36.535838+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/214968761":"2023-08-18T00:18:32.472846+0000","172.21.15.153:6833/214968761":"2023-08-18T00:18:32.472846+0000","172.21.15.153:6835/4264536439":"2023-08-18T00:17:17.953681+0000","172.21.15.153:6833/4264536439":"2023-08-18T00:17:17.953681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:18:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff07005a150 msgr2=0x7ff07005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff07005a150 0x7ff07005c610 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7ff080009f90 tx=0x7ff080009780).stop 2023-08-17T00:18:39.998 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 msgr2=0x7ff084169a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 0x7ff084169a50 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 rx=0x7ff07c00c410 tx=0x7ff07c007bd0).stop 2023-08-17T00:18:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 shutdown_connections 2023-08-17T00:18:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff07005a150 0x7ff07005c610 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff0840aa6e0 0x7ff084169a50 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:39.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff0840a8df0 0x7ff08416b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.989+0000 7ff089e8f700 1 --2- 172.21.15.153:0/4047465114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff084068820 0x7ff0840bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.993+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 >> 172.21.15.153:0/4047465114 conn(0x7ff0840c6620 msgr2=0x7ff0840c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:40.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.993+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 shutdown_connections 2023-08-17T00:18:40.000 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:39.993+0000 7ff089e8f700 1 -- 172.21.15.153:0/4047465114 wait complete. 2023-08-17T00:18:40.020 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-17T00:18:40.021 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:18:40.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.169+0000 7f46a0df9700 1 Processor -- start 2023-08-17T00:18:40.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.169+0000 7f46a0df9700 1 -- start start 2023-08-17T00:18:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f46a0df9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f469c153f50 0x7f469c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f46a0df9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f469c0c01a0 0x7f469c0c0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f46a0df9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469c0bfd10 con 0x7f469c0c57a0 2023-08-17T00:18:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f46a0df9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c154860 con 0x7f469c153f50 2023-08-17T00:18:40.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f46a0df9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469c154af0 con 0x7f469c0c01a0 2023-08-17T00:18:40.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469b7fe700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f469c0c57a0 0x7f469c0c5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43842/0 (socket says 172.21.15.153:43842) 2023-08-17T00:18:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469b7fe700 1 -- 172.21.15.153:0/2696979219 learned_addr learned my addr 172.21.15.153:0/2696979219 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469affd700 1 --2- 172.21.15.153:0/2696979219 >> v2:172.21.15.153:3300/0 conn(0x7f469c153f50 0x7f469c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469bfff700 1 --2- 172.21.15.153:0/2696979219 >> v2:172.21.15.178:3300/0 conn(0x7f469c0c01a0 0x7f469c0c0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469a7fc700 1 -- 172.21.15.153:0/2696979219 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497044055 0 0) 0x7f469c0bfd10 con 0x7f469c0c57a0 2023-08-17T00:18:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469a7fc700 1 -- 172.21.15.153:0/2696979219 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46840033f0 con 0x7f469c0c57a0 2023-08-17T00:18:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469affd700 1 -- 172.21.15.153:0/2696979219 >> v2:172.21.15.178:3300/0 conn(0x7f469c0c01a0 msgr2=0x7f469c0c0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469affd700 1 --2- 172.21.15.153:0/2696979219 >> v2:172.21.15.178:3300/0 conn(0x7f469c0c01a0 0x7f469c0c0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469affd700 1 -- 172.21.15.153:0/2696979219 >> v1:172.21.15.153:6789/0 conn(0x7f469c0c57a0 legacy=0x7f469c0c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469affd700 1 -- 172.21.15.153:0/2696979219 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c154dd0 con 0x7f469c153f50 2023-08-17T00:18:40.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469affd700 1 --2- 172.21.15.153:0/2696979219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c153f50 0x7f469c154370 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f469c06a440 tx=0x7f4690009060).ready entity=mon.0 client_cookie=c13e581a431e1c39 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469a7fc700 1 -- 172.21.15.153:0/2696979219 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000d4a0 con 0x7f469c153f50 2023-08-17T00:18:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469a7fc700 1 -- 172.21.15.153:0/2696979219 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469000d600 con 0x7f469c153f50 2023-08-17T00:18:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.173+0000 7f469a7fc700 1 -- 172.21.15.153:0/2696979219 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000d980 con 0x7f469c153f50 2023-08-17T00:18:40.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- 172.21.15.153:0/2696979219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c153f50 msgr2=0x7f469c154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 --2- 172.21.15.153:0/2696979219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c153f50 0x7f469c154370 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 rx=0x7f469c06a440 tx=0x7f4690009060).stop 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- 172.21.15.153:0/2696979219 shutdown_connections 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 --2- 172.21.15.153:0/2696979219 >> v2:172.21.15.178:3300/0 conn(0x7f469c0c01a0 0x7f469c0c0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 --2- 172.21.15.153:0/2696979219 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c153f50 0x7f469c154370 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- 172.21.15.153:0/2696979219 >> 172.21.15.153:0/2696979219 conn(0x7f469c062a70 msgr2=0x7f469c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- 172.21.15.153:0/2696979219 shutdown_connections 2023-08-17T00:18:40.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- 172.21.15.153:0/2696979219 wait complete. 2023-08-17T00:18:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 Processor -- start 2023-08-17T00:18:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- start start 2023-08-17T00:18:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469c0c01a0 0x7f469c0ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 0x7f469c147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f469c153f50 0x7f469c0a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c1481c0 con 0x7f469c0c57a0 2023-08-17T00:18:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0c7340 con 0x7f469c153f50 2023-08-17T00:18:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.177+0000 7f46a0df9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0a24a0 con 0x7f469c0c01a0 2023-08-17T00:18:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 0x7f469c147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 0x7f469c147cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50468/0 (socket says 172.21.15.153:50468) 2023-08-17T00:18:40.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 -- 172.21.15.153:0/290531066 learned_addr learned my addr 172.21.15.153:0/290531066 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:40.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469b7fe700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469c0c01a0 0x7f469c0ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469bfff700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f469c153f50 0x7f469c0a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 -- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469c0c01a0 msgr2=0x7f469c0ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469c0c01a0 0x7f469c0ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 -- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f469c153f50 msgr2=0x7f469c0a1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f469c153f50 0x7f469c0a1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 -- 172.21.15.153:0/290531066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46900092a0 con 0x7f469c0c57a0 2023-08-17T00:18:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f469affd700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 0x7f469c147cd0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f469c083860 tx=0x7f4690016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690000c90 con 0x7f469c0c57a0 2023-08-17T00:18:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f469000d770 con 0x7f469c0c57a0 2023-08-17T00:18:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c0a2760 con 0x7f469c0c57a0 2023-08-17T00:18:40.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469001d430 con 0x7f469c0c57a0 2023-08-17T00:18:40.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c0c7870 con 0x7f469c0c57a0 2023-08-17T00:18:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.181+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469c06b4c0 con 0x7f469c0c57a0 2023-08-17T00:18:40.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.185+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4690024030 con 0x7f469c0c57a0 2023-08-17T00:18:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.185+0000 7f46837fe700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468805a150 0x7f468805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.185+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f4690074e40 con 0x7f469c0c57a0 2023-08-17T00:18:40.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.185+0000 7f469b7fe700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468805a150 0x7f468805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.196 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.185+0000 7f469b7fe700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468805a150 0x7f468805c610 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f468c005750 tx=0x7f468c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.197 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.189+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4690048a80 con 0x7f469c0c57a0 2023-08-17T00:18:40.353 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.345+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f469c0bf9a0 con 0x7f468805a150 2023-08-17T00:18:40.361 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46837fe700 1 -- 172.21.15.153:0/290531066 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68824 (secure 0 0 0) 0x7f469c0bf9a0 con 0x7f468805a150 2023-08-17T00:18:40.363 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:40.364 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468805a150 msgr2=0x7f468805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468805a150 0x7f468805c610 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 rx=0x7f468c005750 tx=0x7f468c009040).stop 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 msgr2=0x7f469c147cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 0x7f469c147cd0 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 rx=0x7f469c083860 tx=0x7f4690016000).stop 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 shutdown_connections 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f468805a150 0x7f468805c610 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f469c153f50 0x7f469c0a1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f469c0c57a0 0x7f469c147cd0 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 --2- 172.21.15.153:0/290531066 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469c0c01a0 0x7f469c0ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 >> 172.21.15.153:0/290531066 conn(0x7f469c062a70 msgr2=0x7f469c0ab6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:40.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 shutdown_connections 2023-08-17T00:18:40.366 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.357+0000 7f46a0df9700 1 -- 172.21.15.153:0/290531066 wait complete. 2023-08-17T00:18:40.367 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:18:40.385 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2023-08-17T00:18:39.540538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458720,"kb_used_data":19488,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752516000,"statfs":{"total":773094113280,"available":770576384000,"internally_reserved":0,"allocated":19955712,"data_stored":9413224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620480,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-55,"num_read_kb":-59,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-2097174,"num_keys_recovered":-3,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.013561"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540890+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:18:35.540890+0000","last_peered":"2023-08-17T00:18:35.540890+0000","last_clean":"2023-08-17T00:18:35.540890+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:18:35.540890+0000","last_undegraded":"2023-08-17T00:18:35.540890+0000","last_fullsized":"2023-08-17T00:18:35.540890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":189,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542826+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:18:35.542826+0000","last_peered":"2023-08-17T00:18:35.542826+0000","last_clean":"2023-08-17T00:18:35.542826+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:18:35.542826+0000","last_undegraded":"2023-08-17T00:18:35.542826+0000","last_fullsized":"2023-08-17T00:18:35.542826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.539826+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:18:35.539826+0000","last_peered":"2023-08-17T00:18:35.539826+0000","last_clean":"2023-08-17T00:18:35.539826+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:18:35.539826+0000","last_undegraded":"2023-08-17T00:18:35.539826+0000","last_fullsized":"2023-08-17T00:18:35.539826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.682253+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:18:35.682253+0000","last_peered":"2023-08-17T00:18:35.682253+0000","last_clean":"2023-08-17T00:18:35.682253+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:18:35.682253+0000","last_undegraded":"2023-08-17T00:18:35.682253+0000","last_fullsized":"2023-08-17T00:18:35.682253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540743+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:18:35.540743+0000","last_peered":"2023-08-17T00:18:35.540743+0000","last_clean":"2023-08-17T00:18:35.540743+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:18:35.540743+0000","last_undegraded":"2023-08-17T00:18:35.540743+0000","last_fullsized":"2023-08-17T00:18:35.540743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542685+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:18:35.542685+0000","last_peered":"2023-08-17T00:18:35.542685+0000","last_clean":"2023-08-17T00:18:35.542685+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:18:35.542685+0000","last_undegraded":"2023-08-17T00:18:35.542685+0000","last_fullsized":"2023-08-17T00:18:35.542685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.538876+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:18:35.538876+0000","last_peered":"2023-08-17T00:18:35.538876+0000","last_clean":"2023-08-17T00:18:35.538876+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:18:35.538876+0000","last_undegraded":"2023-08-17T00:18:35.538876+0000","last_fullsized":"2023-08-17T00:18:35.538876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.541024+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:18:35.541024+0000","last_peered":"2023-08-17T00:18:35.541024+0000","last_clean":"2023-08-17T00:18:35.541024+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:18:35.541024+0000","last_undegraded":"2023-08-17T00:18:35.541024+0000","last_fullsized":"2023-08-17T00:18:35.541024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.677540+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:18:35.677540+0000","last_peered":"2023-08-17T00:18:35.677540+0000","last_clean":"2023-08-17T00:18:35.677540+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:18:35.677540+0000","last_undegraded":"2023-08-17T00:18:35.677540+0000","last_fullsized":"2023-08-17T00:18:35.677540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542337,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.073},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.51200000000000001},"max":{"1min":1.413,"5min":2.331,"15min":8.7769999999999992},"last":1.2},{"interface":"front","average":{"1min":1.097,"5min":1.099,"15min":1.0980000000000001},"min":{"1min":0.77500000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.403,"5min":3.1269999999999998,"15min":9.6530000000000005},"last":1.111}]},{"osd":1,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.131,"15min":1.1240000000000001},"min":{"1min":0.82899999999999996,"5min":0.72099999999999997,"15min":0.48199999999999998},"max":{"1min":1.45,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.349,"15min":1.204},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.57199999999999995},"max":{"1min":1.464,"5min":20.373000000000001,"15min":20.373000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.198,"15min":1.1140000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":9.8840000000000003,"15min":9.8840000000000003},"last":1.05},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.2230000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":12.411,"15min":12.411},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1990000000000001,"15min":1.153},"min":{"1min":0.91300000000000003,"5min":0.628,"15min":0.55900000000000005},"max":{"1min":1.4299999999999999,"5min":4.0579999999999998,"15min":7.7080000000000002},"last":1.143},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.77500000000000002,"15min":0.57599999999999996},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":13.074999999999999},"last":1.302}]},{"osd":4,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.143,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.597,"5min":4.6029999999999998,"15min":13.784000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.208,"15min":1.2070000000000001},"min":{"1min":0.74199999999999999,"5min":0.64600000000000002,"15min":0.44700000000000001},"max":{"1min":1.411,"5min":4.1529999999999996,"15min":10.045999999999999},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1859999999999999,"15min":1.2789999999999999},"min":{"1min":0.80500000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.536,"5min":1.657,"15min":14.435},"last":1.093},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.462,"15min":1.365},"min":{"1min":0.83299999999999996,"5min":0.754,"15min":0.64500000000000002},"max":{"1min":1.4299999999999999,"5min":20.285,"15min":20.285},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.788,"15min":1.506},"min":{"1min":0.77300000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5580000000000001,"5min":45.982999999999997,"15min":45.982999999999997},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.343,"15min":1.3200000000000001},"min":{"1min":0.74399999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.51,"5min":10.542999999999999,"15min":11.365},"last":1.2430000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542337,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.085,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.56299999999999994,"15min":0.32700000000000001},"max":{"1min":1.484,"5min":6.2050000000000001,"15min":8.0909999999999993},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.0960000000000001,"15min":1.119},"min":{"1min":0.80100000000000005,"5min":0.61399999999999999,"15min":0.502},"max":{"1min":1.6459999999999999,"5min":4.468,"15min":10.519},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.113,"15min":1.157},"min":{"1min":0.84399999999999997,"5min":0.65800000000000003,"15min":0.443},"max":{"1min":1.5249999999999999,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.325},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.0840000000000001},"min":{"1min":0.83099999999999996,"5min":0.69299999999999995,"15min":0.47199999999999998},"max":{"1min":1.502,"5min":2.2490000000000001,"15min":11.391999999999999},"last":1.194}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1910000000000001,"15min":1.1699999999999999},"min":{"1min":0.83599999999999997,"5min":0.79300000000000004,"15min":0.372},"max":{"1min":1.361,"5min":1.792,"15min":5.3799999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.302,"15min":1.298},"min":{"1min":1.0349999999999999,"5min":0.76400000000000001,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":3.5409999999999999,"15min":10.669},"last":1.514}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":1.0720000000000001,"5min":0.80400000000000005,"15min":0.48599999999999999},"max":{"1min":1.4350000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.2609999999999999},"min":{"1min":0.873,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.5449999999999999,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.482}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1679999999999999,"15min":1.2569999999999999},"min":{"1min":0.874,"5min":0.77500000000000002,"15min":0.56699999999999995},"max":{"1min":1.3859999999999999,"5min":1.758,"15min":10.632},"last":1.232},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.208,"15min":1.2390000000000001},"min":{"1min":0.85499999999999998,"5min":0.71799999999999997,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.351}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.40899999999999997},"max":{"1min":1.661,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.379},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.4199999999999999,"15min":1.411},"min":{"1min":1.054,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.78,"5min":8.4809999999999999,"15min":10.592000000000001},"last":1.417}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3460000000000001,"15min":1.345},"min":{"1min":0.98999999999999999,"5min":0.74299999999999999,"15min":0.65100000000000002},"max":{"1min":1.655,"5min":5.2199999999999998,"15min":11.51},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.66900000000000004},"max":{"1min":1.671,"5min":3.7519999999999998,"15min":5.4100000000000001},"last":1.5620000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.093,"15min":1.0780000000000001},"min":{"1min":0.76500000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.988,"5min":1.988,"15min":15.007999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.125,"15min":1.127},"min":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.623,"5min":1.946,"15min":16.838999999999999},"last":1.3220000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.117,"15min":1.0860000000000001},"min":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5840000000000001,"5min":1.746,"15min":4.2270000000000003},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1200000000000001,"15min":1.143},"min":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.58799999999999997},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":9.6579999999999995},"last":1.302}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1279999999999999,"15min":1.1930000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.67700000000000005},"max":{"1min":1.7649999999999999,"5min":1.8100000000000001,"15min":16.675000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.1919999999999999,"15min":1.1870000000000001},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":11.949},"last":1.272}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.64100000000000001},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":13.125},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89900000000000002,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.8740000000000001,"5min":1.887,"15min":8.4809999999999999},"last":1.415}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1499999999999999,"15min":1.214},"min":{"1min":0.76800000000000002,"5min":0.63200000000000001,"15min":0.58599999999999997},"max":{"1min":2.286,"5min":2.286,"15min":17.510000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.294},"min":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.54000000000000004},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":19.591000000000001},"last":1.4790000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.22,"15min":1.294},"min":{"1min":0.72199999999999998,"5min":0.63700000000000001,"15min":0.60099999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":17.158000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.2490000000000001,"15min":1.3049999999999999},"min":{"1min":0.91900000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":17.050000000000001},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.347,"15min":1.4059999999999999},"min":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.57199999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":18.158000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.3660000000000001,"15min":1.4139999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":14.818},"last":1.1379999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542337,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.35499999999999998,"15min":0.32000000000000001},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.7529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92900000000000005,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.45200000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":2.6709999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.82199999999999995},"min":{"1min":0.64700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.159,"5min":3.274,"15min":11.215999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.76000000000000001,"5min":0.43099999999999999,"15min":0.35499999999999998},"max":{"1min":1.319,"5min":1.377,"15min":3.7810000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.92700000000000005,"15min":0.89900000000000002},"min":{"1min":0.78100000000000003,"5min":0.52000000000000002,"15min":0.33800000000000002},"max":{"1min":1.4359999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.0820000000000001,"15min":1.036},"min":{"1min":0.98099999999999998,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":1.548,"5min":1.6020000000000001,"15min":2.6360000000000001},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2470000000000001,"15min":1.1970000000000001},"min":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.58099999999999996},"max":{"1min":1.5049999999999999,"5min":1.7829999999999999,"15min":3.9449999999999998},"last":1.371},{"interface":"front","average":{"1min":1.224,"5min":1.222,"15min":1.1919999999999999},"min":{"1min":0.81000000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4490000000000001,"5min":1.631,"15min":3.9790000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":1.0900000000000001,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.5,"5min":1.706,"15min":2.1309999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.284,"15min":1.2430000000000001},"min":{"1min":1.2370000000000001,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.5329999999999999,"5min":1.829,"15min":2.6789999999999998},"last":1.45}]},{"osd":6,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2290000000000001,"15min":1.2030000000000001},"min":{"1min":1.0349999999999999,"5min":0.61099999999999999,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":1.708,"15min":3.4249999999999998},"last":1.343},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.1870000000000001},"min":{"1min":1.0169999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.3879999999999999,"5min":1.891,"15min":3.585},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.2230000000000001},"min":{"1min":1.105,"5min":0.81399999999999995,"15min":0.52600000000000002},"max":{"1min":1.4990000000000001,"5min":1.996,"15min":2.1930000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.202},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.9890000000000001,"15min":2.0419999999999998},"last":1.208}]}]},{"osd":2,"up_from":14,"seq":60129542337,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.292,"5min":1.855,"15min":3.1099999999999999},"last":1.502},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.28799999999999998},"max":{"1min":1.1259999999999999,"5min":1.337,"15min":6.4859999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91500000000000004,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.1379999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.1140000000000001,"15min":1.014},"min":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.3819999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0089999999999999,"15min":0.98099999999999998},"min":{"1min":0.66900000000000004,"5min":0.63400000000000001,"15min":0.42899999999999999},"max":{"1min":1.595,"5min":1.595,"15min":5.4059999999999997},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93500000000000005,"15min":0.92000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.361,"5min":1.6020000000000001,"15min":3.3410000000000002},"last":1.046}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3280000000000001,"15min":1.2250000000000001},"min":{"1min":0.82699999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.409,"15min":1.286},"min":{"1min":0.92500000000000004,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.472,"5min":17.988,"15min":17.988},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3240000000000001,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.58799999999999997},"max":{"1min":1.665,"5min":1.7430000000000001,"15min":12.914},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2310000000000001,"15min":1.242},"min":{"1min":0.98199999999999998,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":9.5519999999999996},"last":1.5900000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1839999999999999,"15min":1.2290000000000001},"min":{"1min":0.95499999999999996,"5min":0.74299999999999999,"15min":0.58899999999999997},"max":{"1min":1.625,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.323},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3140000000000001,"15min":1.319},"min":{"1min":0.96299999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.7190000000000001,"5min":1.909,"15min":12.698},"last":1.389}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":1.0800000000000001,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.621,"5min":1.798,"15min":10.592000000000001},"last":1.657},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.335},"min":{"1min":0.91400000000000003,"5min":0.81100000000000005,"15min":0.54100000000000004},"max":{"1min":1.6930000000000001,"5min":1.891,"15min":11.417},"last":1.736}]}]},{"osd":1,"up_from":14,"seq":60129542337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.879,"15min":0.84699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.309},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":6.4329999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.39400000000000002},"max":{"1min":1.454,"5min":1.6200000000000001,"15min":13.093},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.314},"max":{"1min":1.1879999999999999,"5min":1.3069999999999999,"15min":5.4989999999999997},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":0.95999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.036,"15min":1.014},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":1.3620000000000001,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.93200000000000005},"min":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":1.359,"15min":12.981999999999999},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.123,"15min":1.1439999999999999},"min":{"1min":0.875,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":20.548999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.238,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.48,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2889999999999999,"15min":1.2809999999999999},"min":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0739999999999998,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2609999999999999,"15min":1.2350000000000001},"min":{"1min":0.84299999999999997,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":5.4240000000000004},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.244,"15min":1.244},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4370000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.232,"15min":1.2090000000000001},"min":{"1min":1.02,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.694,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.294,"15min":1.29},"min":{"1min":0.96199999999999997,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.468,"5min":1.8959999999999999,"15min":6.9779999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3049999999999999,"15min":1.3080000000000001},"min":{"1min":1.0189999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.649,"5min":1.9119999999999999,"15min":13.131},"last":1.573}]}]},{"osd":0,"up_from":14,"seq":60129542338,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78100000000000003,"15min":0.82899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.30299999999999999},"max":{"1min":1.248,"5min":1.3080000000000001,"15min":18.442},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.143,"5min":1.571,"15min":7.9720000000000004},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.94199999999999995},"min":{"1min":0.70399999999999996,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.347,"5min":1.347,"15min":18.481999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93500000000000005,"15min":0.92200000000000004},"min":{"1min":0.73499999999999999,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":1.258,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.266}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.86299999999999999},"min":{"1min":0.61099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3879999999999999,"5min":1.46,"15min":1.613},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0129999999999999,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.4390000000000001,"5min":1.585,"15min":18.577000000000002},"last":1.232}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.159,"15min":1.1020000000000001},"min":{"1min":0.90400000000000003,"5min":0.754,"15min":0.56399999999999995},"max":{"1min":1.476,"5min":1.6830000000000001,"15min":1.7609999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.21,"15min":1.2490000000000001},"min":{"1min":1.0720000000000001,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.587,"5min":1.792,"15min":18.515000000000001},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.26,"15min":1.2809999999999999},"min":{"1min":1.069,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.534,"5min":1.746,"15min":17.152999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.258,"15min":1.2230000000000001},"min":{"1min":1.0600000000000001,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.5229999999999999,"5min":1.6379999999999999,"15min":1.984},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.284},"min":{"1min":1.0349999999999999,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.518,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.2589999999999999},"min":{"1min":0.95999999999999996,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.706,"5min":2.0619999999999998,"15min":17.204000000000001},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0329999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.244,"15min":1.1990000000000001},"min":{"1min":1.03,"5min":0.80300000000000005,"15min":0.60199999999999998},"max":{"1min":1.5129999999999999,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.673}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.042},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.38300000000000001},"max":{"1min":1.371,"5min":1.53,"15min":7.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.0429999999999999,"15min":1.0489999999999999},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.6279999999999999,"5min":1.8169999999999999,"15min":7.7380000000000004},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1819999999999999,"15min":1.218},"min":{"1min":0.81999999999999995,"5min":0.61599999999999999,"15min":0.42499999999999999},"max":{"1min":1.4379999999999999,"5min":1.665,"15min":8.3800000000000008},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.198},"min":{"1min":0.85699999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.347,"5min":1.732,"15min":6.9000000000000004},"last":0.879}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0900000000000001,"15min":1.2050000000000001},"min":{"1min":0.82499999999999996,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.581,"5min":1.581,"15min":18.431000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.292},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36699999999999999},"max":{"1min":1.2989999999999999,"5min":1.5880000000000001,"15min":36.531999999999996},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.099,"15min":1.1000000000000001},"min":{"1min":0.71699999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4419999999999999,"5min":1.8600000000000001,"15min":2.9889999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1659999999999999,"15min":1.3660000000000001},"min":{"1min":0.96399999999999997,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.5389999999999999,"5min":1.875,"15min":36.530000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.276,"15min":1.2549999999999999},"min":{"1min":0.98499999999999999,"5min":0.76900000000000002,"15min":0.433},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":6.3250000000000002},"last":2.4590000000000001},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3069999999999999,"15min":1.2969999999999999},"min":{"1min":0.91200000000000003,"5min":0.80700000000000005,"15min":0.63500000000000001},"max":{"1min":2.605,"5min":2.605,"15min":9.4120000000000008},"last":2.2570000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.3},"min":{"1min":0.80300000000000005,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6559999999999999,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.325},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3580000000000001,"15min":1.3520000000000001},"min":{"1min":1.1120000000000001,"5min":0.88900000000000001,"15min":0.49399999999999999},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.014}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.875,"5min":0.72499999999999998,"15min":0.56100000000000005},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":3.645},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.371},"min":{"1min":0.95899999999999996,"5min":0.84599999999999997,"15min":0.629},"max":{"1min":1.875,"5min":1.879,"15min":8.327},"last":1.238}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:18:40.387 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:18:40.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.541+0000 7eff1ca9b700 1 Processor -- start 2023-08-17T00:18:40.549 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.541+0000 7eff1ca9b700 1 -- start start 2023-08-17T00:18:40.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1ca9b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff18151b90 0x7eff18151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1ca9b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 0x7eff18065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.552 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1ca9b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff18061fa0 con 0x7eff18065b50 2023-08-17T00:18:40.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1ca9b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff180c3fb0 con 0x7eff18063290 2023-08-17T00:18:40.553 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1ca9b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff18152460 con 0x7eff18151b90 2023-08-17T00:18:40.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff0ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 0x7eff18065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1659c700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff18151b90 0x7eff18151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff0ffff700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 0x7eff18065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50474/0 (socket says 172.21.15.153:50474) 2023-08-17T00:18:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff0ffff700 1 -- 172.21.15.153:0/4281986557 learned_addr learned my addr 172.21.15.153:0/4281986557 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1659c700 1 -- 172.21.15.153:0/4281986557 >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 msgr2=0x7eff18065660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:40.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1659c700 1 --2- 172.21.15.153:0/4281986557 >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 0x7eff18065660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1659c700 1 -- 172.21.15.153:0/4281986557 >> v1:172.21.15.178:6789/0 conn(0x7eff18065b50 legacy=0x7eff18064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff1659c700 1 -- 172.21.15.153:0/4281986557 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff180621f0 con 0x7eff18151b90 2023-08-17T00:18:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.545+0000 7eff0ffff700 1 --2- 172.21.15.153:0/4281986557 >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 0x7eff18065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1659c700 1 --2- 172.21.15.153:0/4281986557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18151f70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7eff180682a0 tx=0x7eff08009060).ready entity=mon.1 client_cookie=bba98ecd0318fbf1 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.556 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff15d9b700 1 -- 172.21.15.153:0/4281986557 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800f510 con 0x7eff18151b90 2023-08-17T00:18:40.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff15d9b700 1 -- 172.21.15.153:0/4281986557 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0800f670 con 0x7eff18151b90 2023-08-17T00:18:40.557 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff15d9b700 1 -- 172.21.15.153:0/4281986557 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0800f9f0 con 0x7eff18151b90 2023-08-17T00:18:40.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 -- 172.21.15.153:0/4281986557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 msgr2=0x7eff18151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/4281986557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18151f70 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7eff180682a0 tx=0x7eff08009060).stop 2023-08-17T00:18:40.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 -- 172.21.15.153:0/4281986557 shutdown_connections 2023-08-17T00:18:40.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/4281986557 >> v2:172.21.15.153:3300/0 conn(0x7eff18063290 0x7eff18065660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/4281986557 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18151f70 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 -- 172.21.15.153:0/4281986557 >> 172.21.15.153:0/4281986557 conn(0x7eff180c7150 msgr2=0x7eff180c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 -- 172.21.15.153:0/4281986557 shutdown_connections 2023-08-17T00:18:40.561 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 -- 172.21.15.153:0/4281986557 wait complete. 2023-08-17T00:18:40.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.549+0000 7eff1ca9b700 1 Processor -- start 2023-08-17T00:18:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 -- start start 2023-08-17T00:18:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff18063290 0x7eff181595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 0x7eff18157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18159120 con 0x7eff18065b50 2023-08-17T00:18:40.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff18158510 con 0x7eff18151b90 2023-08-17T00:18:40.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff181587f0 con 0x7eff18063290 2023-08-17T00:18:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 0x7eff18157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 0x7eff18157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50476/0 (socket says 172.21.15.153:50476) 2023-08-17T00:18:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 -- 172.21.15.153:0/3656533677 learned_addr learned my addr 172.21.15.153:0/3656533677 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:40.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1659c700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff18063290 0x7eff181595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff16d9d700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 -- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff18063290 msgr2=0x7eff181595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.568 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff18063290 0x7eff181595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 -- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 msgr2=0x7eff18143170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18143170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 -- 172.21.15.153:0/3656533677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00009370 con 0x7eff18065b50 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0ffff700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 0x7eff18157c00 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7eff0000ea20 tx=0x7eff000090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000ee60 con 0x7eff18065b50 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000c850 con 0x7eff18065b50 2023-08-17T00:18:40.569 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff080092a0 con 0x7eff18065b50 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000cbd0 con 0x7eff18065b50 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.553+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff18158db0 con 0x7eff18065b50 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.557+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1806b530 con 0x7eff18065b50 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.557+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7eff00022070 con 0x7eff18065b50 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.557+0000 7eff0e7fc700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef805a150 0x7efef805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.557+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7eff00074380 con 0x7eff18065b50 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.561+0000 7eff1659c700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef805a150 0x7efef805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.570 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.561+0000 7eff1659c700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef805a150 0x7efef805c610 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7eff180682a0 tx=0x7eff08017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.565+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7eff00047fc0 con 0x7eff18065b50 2023-08-17T00:18:40.728 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.721+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff180c3ab0 con 0x7efef805a150 2023-08-17T00:18:40.735 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.729+0000 7eff0e7fc700 1 -- 172.21.15.153:0/3656533677 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68824 (secure 0 0 0) 0x7eff180c3ab0 con 0x7efef805a150 2023-08-17T00:18:40.737 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:40.739 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef805a150 msgr2=0x7efef805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef805a150 0x7efef805c610 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 rx=0x7eff180682a0 tx=0x7eff08017000).stop 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 msgr2=0x7eff18157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 0x7eff18157c00 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 rx=0x7eff0000ea20 tx=0x7eff000090f0).stop 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 shutdown_connections 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efef805a150 0x7efef805c610 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff18151b90 0x7eff18143170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.740 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7eff18065b50 0x7eff18157c00 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 --2- 172.21.15.153:0/3656533677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff18063290 0x7eff181595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 >> 172.21.15.153:0/3656533677 conn(0x7eff180c7150 msgr2=0x7eff181511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 shutdown_connections 2023-08-17T00:18:40.741 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.733+0000 7eff1ca9b700 1 -- 172.21.15.153:0/3656533677 wait complete. 2023-08-17T00:18:40.742 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:18:40.760 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2023-08-17T00:18:39.540538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458720,"kb_used_data":19488,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752516000,"statfs":{"total":773094113280,"available":770576384000,"internally_reserved":0,"allocated":19955712,"data_stored":9413224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620480,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-55,"num_read_kb":-59,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-2097174,"num_keys_recovered":-3,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.013561"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540890+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:18:35.540890+0000","last_peered":"2023-08-17T00:18:35.540890+0000","last_clean":"2023-08-17T00:18:35.540890+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:18:35.540890+0000","last_undegraded":"2023-08-17T00:18:35.540890+0000","last_fullsized":"2023-08-17T00:18:35.540890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":189,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542826+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:18:35.542826+0000","last_peered":"2023-08-17T00:18:35.542826+0000","last_clean":"2023-08-17T00:18:35.542826+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:18:35.542826+0000","last_undegraded":"2023-08-17T00:18:35.542826+0000","last_fullsized":"2023-08-17T00:18:35.542826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.539826+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:18:35.539826+0000","last_peered":"2023-08-17T00:18:35.539826+0000","last_clean":"2023-08-17T00:18:35.539826+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:18:35.539826+0000","last_undegraded":"2023-08-17T00:18:35.539826+0000","last_fullsized":"2023-08-17T00:18:35.539826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.682253+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:18:35.682253+0000","last_peered":"2023-08-17T00:18:35.682253+0000","last_clean":"2023-08-17T00:18:35.682253+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:18:35.682253+0000","last_undegraded":"2023-08-17T00:18:35.682253+0000","last_fullsized":"2023-08-17T00:18:35.682253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540743+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:18:35.540743+0000","last_peered":"2023-08-17T00:18:35.540743+0000","last_clean":"2023-08-17T00:18:35.540743+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:18:35.540743+0000","last_undegraded":"2023-08-17T00:18:35.540743+0000","last_fullsized":"2023-08-17T00:18:35.540743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542685+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:18:35.542685+0000","last_peered":"2023-08-17T00:18:35.542685+0000","last_clean":"2023-08-17T00:18:35.542685+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:18:35.542685+0000","last_undegraded":"2023-08-17T00:18:35.542685+0000","last_fullsized":"2023-08-17T00:18:35.542685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.538876+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:18:35.538876+0000","last_peered":"2023-08-17T00:18:35.538876+0000","last_clean":"2023-08-17T00:18:35.538876+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:18:35.538876+0000","last_undegraded":"2023-08-17T00:18:35.538876+0000","last_fullsized":"2023-08-17T00:18:35.538876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.541024+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:18:35.541024+0000","last_peered":"2023-08-17T00:18:35.541024+0000","last_clean":"2023-08-17T00:18:35.541024+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:18:35.541024+0000","last_undegraded":"2023-08-17T00:18:35.541024+0000","last_fullsized":"2023-08-17T00:18:35.541024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.677540+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:18:35.677540+0000","last_peered":"2023-08-17T00:18:35.677540+0000","last_clean":"2023-08-17T00:18:35.677540+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:18:35.677540+0000","last_undegraded":"2023-08-17T00:18:35.677540+0000","last_fullsized":"2023-08-17T00:18:35.677540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542337,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.073},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.51200000000000001},"max":{"1min":1.413,"5min":2.331,"15min":8.7769999999999992},"last":1.2},{"interface":"front","average":{"1min":1.097,"5min":1.099,"15min":1.0980000000000001},"min":{"1min":0.77500000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.403,"5min":3.1269999999999998,"15min":9.6530000000000005},"last":1.111}]},{"osd":1,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.131,"15min":1.1240000000000001},"min":{"1min":0.82899999999999996,"5min":0.72099999999999997,"15min":0.48199999999999998},"max":{"1min":1.45,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.349,"15min":1.204},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.57199999999999995},"max":{"1min":1.464,"5min":20.373000000000001,"15min":20.373000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.198,"15min":1.1140000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":9.8840000000000003,"15min":9.8840000000000003},"last":1.05},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.2230000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":12.411,"15min":12.411},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1990000000000001,"15min":1.153},"min":{"1min":0.91300000000000003,"5min":0.628,"15min":0.55900000000000005},"max":{"1min":1.4299999999999999,"5min":4.0579999999999998,"15min":7.7080000000000002},"last":1.143},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.77500000000000002,"15min":0.57599999999999996},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":13.074999999999999},"last":1.302}]},{"osd":4,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.143,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.597,"5min":4.6029999999999998,"15min":13.784000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.208,"15min":1.2070000000000001},"min":{"1min":0.74199999999999999,"5min":0.64600000000000002,"15min":0.44700000000000001},"max":{"1min":1.411,"5min":4.1529999999999996,"15min":10.045999999999999},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1859999999999999,"15min":1.2789999999999999},"min":{"1min":0.80500000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.536,"5min":1.657,"15min":14.435},"last":1.093},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.462,"15min":1.365},"min":{"1min":0.83299999999999996,"5min":0.754,"15min":0.64500000000000002},"max":{"1min":1.4299999999999999,"5min":20.285,"15min":20.285},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.788,"15min":1.506},"min":{"1min":0.77300000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5580000000000001,"5min":45.982999999999997,"15min":45.982999999999997},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.343,"15min":1.3200000000000001},"min":{"1min":0.74399999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.51,"5min":10.542999999999999,"15min":11.365},"last":1.2430000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542337,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.085,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.56299999999999994,"15min":0.32700000000000001},"max":{"1min":1.484,"5min":6.2050000000000001,"15min":8.0909999999999993},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.0960000000000001,"15min":1.119},"min":{"1min":0.80100000000000005,"5min":0.61399999999999999,"15min":0.502},"max":{"1min":1.6459999999999999,"5min":4.468,"15min":10.519},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.113,"15min":1.157},"min":{"1min":0.84399999999999997,"5min":0.65800000000000003,"15min":0.443},"max":{"1min":1.5249999999999999,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.325},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.0840000000000001},"min":{"1min":0.83099999999999996,"5min":0.69299999999999995,"15min":0.47199999999999998},"max":{"1min":1.502,"5min":2.2490000000000001,"15min":11.391999999999999},"last":1.194}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1910000000000001,"15min":1.1699999999999999},"min":{"1min":0.83599999999999997,"5min":0.79300000000000004,"15min":0.372},"max":{"1min":1.361,"5min":1.792,"15min":5.3799999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.302,"15min":1.298},"min":{"1min":1.0349999999999999,"5min":0.76400000000000001,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":3.5409999999999999,"15min":10.669},"last":1.514}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":1.0720000000000001,"5min":0.80400000000000005,"15min":0.48599999999999999},"max":{"1min":1.4350000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.2609999999999999},"min":{"1min":0.873,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.5449999999999999,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.482}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1679999999999999,"15min":1.2569999999999999},"min":{"1min":0.874,"5min":0.77500000000000002,"15min":0.56699999999999995},"max":{"1min":1.3859999999999999,"5min":1.758,"15min":10.632},"last":1.232},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.208,"15min":1.2390000000000001},"min":{"1min":0.85499999999999998,"5min":0.71799999999999997,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.351}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.40899999999999997},"max":{"1min":1.661,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.379},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.4199999999999999,"15min":1.411},"min":{"1min":1.054,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.78,"5min":8.4809999999999999,"15min":10.592000000000001},"last":1.417}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3460000000000001,"15min":1.345},"min":{"1min":0.98999999999999999,"5min":0.74299999999999999,"15min":0.65100000000000002},"max":{"1min":1.655,"5min":5.2199999999999998,"15min":11.51},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.66900000000000004},"max":{"1min":1.671,"5min":3.7519999999999998,"15min":5.4100000000000001},"last":1.5620000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.093,"15min":1.0780000000000001},"min":{"1min":0.76500000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.988,"5min":1.988,"15min":15.007999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.125,"15min":1.127},"min":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.623,"5min":1.946,"15min":16.838999999999999},"last":1.3220000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.117,"15min":1.0860000000000001},"min":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5840000000000001,"5min":1.746,"15min":4.2270000000000003},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1200000000000001,"15min":1.143},"min":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.58799999999999997},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":9.6579999999999995},"last":1.302}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1279999999999999,"15min":1.1930000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.67700000000000005},"max":{"1min":1.7649999999999999,"5min":1.8100000000000001,"15min":16.675000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.1919999999999999,"15min":1.1870000000000001},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":11.949},"last":1.272}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.64100000000000001},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":13.125},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89900000000000002,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.8740000000000001,"5min":1.887,"15min":8.4809999999999999},"last":1.415}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1499999999999999,"15min":1.214},"min":{"1min":0.76800000000000002,"5min":0.63200000000000001,"15min":0.58599999999999997},"max":{"1min":2.286,"5min":2.286,"15min":17.510000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.294},"min":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.54000000000000004},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":19.591000000000001},"last":1.4790000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.22,"15min":1.294},"min":{"1min":0.72199999999999998,"5min":0.63700000000000001,"15min":0.60099999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":17.158000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.2490000000000001,"15min":1.3049999999999999},"min":{"1min":0.91900000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":17.050000000000001},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.347,"15min":1.4059999999999999},"min":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.57199999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":18.158000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.3660000000000001,"15min":1.4139999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":14.818},"last":1.1379999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542337,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.35499999999999998,"15min":0.32000000000000001},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.7529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92900000000000005,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.45200000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":2.6709999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.82199999999999995},"min":{"1min":0.64700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.159,"5min":3.274,"15min":11.215999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.76000000000000001,"5min":0.43099999999999999,"15min":0.35499999999999998},"max":{"1min":1.319,"5min":1.377,"15min":3.7810000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.92700000000000005,"15min":0.89900000000000002},"min":{"1min":0.78100000000000003,"5min":0.52000000000000002,"15min":0.33800000000000002},"max":{"1min":1.4359999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.0820000000000001,"15min":1.036},"min":{"1min":0.98099999999999998,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":1.548,"5min":1.6020000000000001,"15min":2.6360000000000001},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2470000000000001,"15min":1.1970000000000001},"min":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.58099999999999996},"max":{"1min":1.5049999999999999,"5min":1.7829999999999999,"15min":3.9449999999999998},"last":1.371},{"interface":"front","average":{"1min":1.224,"5min":1.222,"15min":1.1919999999999999},"min":{"1min":0.81000000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4490000000000001,"5min":1.631,"15min":3.9790000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":1.0900000000000001,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.5,"5min":1.706,"15min":2.1309999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.284,"15min":1.2430000000000001},"min":{"1min":1.2370000000000001,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.5329999999999999,"5min":1.829,"15min":2.6789999999999998},"last":1.45}]},{"osd":6,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2290000000000001,"15min":1.2030000000000001},"min":{"1min":1.0349999999999999,"5min":0.61099999999999999,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":1.708,"15min":3.4249999999999998},"last":1.343},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.1870000000000001},"min":{"1min":1.0169999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.3879999999999999,"5min":1.891,"15min":3.585},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.2230000000000001},"min":{"1min":1.105,"5min":0.81399999999999995,"15min":0.52600000000000002},"max":{"1min":1.4990000000000001,"5min":1.996,"15min":2.1930000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.202},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.9890000000000001,"15min":2.0419999999999998},"last":1.208}]}]},{"osd":2,"up_from":14,"seq":60129542337,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.292,"5min":1.855,"15min":3.1099999999999999},"last":1.502},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.28799999999999998},"max":{"1min":1.1259999999999999,"5min":1.337,"15min":6.4859999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91500000000000004,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.1379999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.1140000000000001,"15min":1.014},"min":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.3819999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0089999999999999,"15min":0.98099999999999998},"min":{"1min":0.66900000000000004,"5min":0.63400000000000001,"15min":0.42899999999999999},"max":{"1min":1.595,"5min":1.595,"15min":5.4059999999999997},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93500000000000005,"15min":0.92000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.361,"5min":1.6020000000000001,"15min":3.3410000000000002},"last":1.046}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3280000000000001,"15min":1.2250000000000001},"min":{"1min":0.82699999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.409,"15min":1.286},"min":{"1min":0.92500000000000004,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.472,"5min":17.988,"15min":17.988},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3240000000000001,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.58799999999999997},"max":{"1min":1.665,"5min":1.7430000000000001,"15min":12.914},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2310000000000001,"15min":1.242},"min":{"1min":0.98199999999999998,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":9.5519999999999996},"last":1.5900000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1839999999999999,"15min":1.2290000000000001},"min":{"1min":0.95499999999999996,"5min":0.74299999999999999,"15min":0.58899999999999997},"max":{"1min":1.625,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.323},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3140000000000001,"15min":1.319},"min":{"1min":0.96299999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.7190000000000001,"5min":1.909,"15min":12.698},"last":1.389}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":1.0800000000000001,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.621,"5min":1.798,"15min":10.592000000000001},"last":1.657},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.335},"min":{"1min":0.91400000000000003,"5min":0.81100000000000005,"15min":0.54100000000000004},"max":{"1min":1.6930000000000001,"5min":1.891,"15min":11.417},"last":1.736}]}]},{"osd":1,"up_from":14,"seq":60129542337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.879,"15min":0.84699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.309},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":6.4329999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.39400000000000002},"max":{"1min":1.454,"5min":1.6200000000000001,"15min":13.093},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.314},"max":{"1min":1.1879999999999999,"5min":1.3069999999999999,"15min":5.4989999999999997},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":0.95999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.036,"15min":1.014},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":1.3620000000000001,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.93200000000000005},"min":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":1.359,"15min":12.981999999999999},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.123,"15min":1.1439999999999999},"min":{"1min":0.875,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":20.548999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.238,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.48,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2889999999999999,"15min":1.2809999999999999},"min":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0739999999999998,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2609999999999999,"15min":1.2350000000000001},"min":{"1min":0.84299999999999997,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":5.4240000000000004},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.244,"15min":1.244},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4370000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.232,"15min":1.2090000000000001},"min":{"1min":1.02,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.694,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.294,"15min":1.29},"min":{"1min":0.96199999999999997,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.468,"5min":1.8959999999999999,"15min":6.9779999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3049999999999999,"15min":1.3080000000000001},"min":{"1min":1.0189999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.649,"5min":1.9119999999999999,"15min":13.131},"last":1.573}]}]},{"osd":0,"up_from":14,"seq":60129542338,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78100000000000003,"15min":0.82899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.30299999999999999},"max":{"1min":1.248,"5min":1.3080000000000001,"15min":18.442},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.143,"5min":1.571,"15min":7.9720000000000004},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.94199999999999995},"min":{"1min":0.70399999999999996,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.347,"5min":1.347,"15min":18.481999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93500000000000005,"15min":0.92200000000000004},"min":{"1min":0.73499999999999999,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":1.258,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.266}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.86299999999999999},"min":{"1min":0.61099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3879999999999999,"5min":1.46,"15min":1.613},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0129999999999999,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.4390000000000001,"5min":1.585,"15min":18.577000000000002},"last":1.232}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.159,"15min":1.1020000000000001},"min":{"1min":0.90400000000000003,"5min":0.754,"15min":0.56399999999999995},"max":{"1min":1.476,"5min":1.6830000000000001,"15min":1.7609999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.21,"15min":1.2490000000000001},"min":{"1min":1.0720000000000001,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.587,"5min":1.792,"15min":18.515000000000001},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.26,"15min":1.2809999999999999},"min":{"1min":1.069,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.534,"5min":1.746,"15min":17.152999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.258,"15min":1.2230000000000001},"min":{"1min":1.0600000000000001,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.5229999999999999,"5min":1.6379999999999999,"15min":1.984},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.284},"min":{"1min":1.0349999999999999,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.518,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.2589999999999999},"min":{"1min":0.95999999999999996,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.706,"5min":2.0619999999999998,"15min":17.204000000000001},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0329999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.244,"15min":1.1990000000000001},"min":{"1min":1.03,"5min":0.80300000000000005,"15min":0.60199999999999998},"max":{"1min":1.5129999999999999,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.673}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.042},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.38300000000000001},"max":{"1min":1.371,"5min":1.53,"15min":7.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.0429999999999999,"15min":1.0489999999999999},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.6279999999999999,"5min":1.8169999999999999,"15min":7.7380000000000004},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1819999999999999,"15min":1.218},"min":{"1min":0.81999999999999995,"5min":0.61599999999999999,"15min":0.42499999999999999},"max":{"1min":1.4379999999999999,"5min":1.665,"15min":8.3800000000000008},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.198},"min":{"1min":0.85699999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.347,"5min":1.732,"15min":6.9000000000000004},"last":0.879}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0900000000000001,"15min":1.2050000000000001},"min":{"1min":0.82499999999999996,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.581,"5min":1.581,"15min":18.431000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.292},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36699999999999999},"max":{"1min":1.2989999999999999,"5min":1.5880000000000001,"15min":36.531999999999996},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.099,"15min":1.1000000000000001},"min":{"1min":0.71699999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4419999999999999,"5min":1.8600000000000001,"15min":2.9889999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1659999999999999,"15min":1.3660000000000001},"min":{"1min":0.96399999999999997,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.5389999999999999,"5min":1.875,"15min":36.530000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.276,"15min":1.2549999999999999},"min":{"1min":0.98499999999999999,"5min":0.76900000000000002,"15min":0.433},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":6.3250000000000002},"last":2.4590000000000001},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3069999999999999,"15min":1.2969999999999999},"min":{"1min":0.91200000000000003,"5min":0.80700000000000005,"15min":0.63500000000000001},"max":{"1min":2.605,"5min":2.605,"15min":9.4120000000000008},"last":2.2570000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.3},"min":{"1min":0.80300000000000005,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6559999999999999,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.325},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3580000000000001,"15min":1.3520000000000001},"min":{"1min":1.1120000000000001,"5min":0.88900000000000001,"15min":0.49399999999999999},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.014}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.875,"5min":0.72499999999999998,"15min":0.56100000000000005},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":3.645},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.371},"min":{"1min":0.95899999999999996,"5min":0.84599999999999997,"15min":0.629},"max":{"1min":1.875,"5min":1.879,"15min":8.327},"last":1.238}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:18:40.763 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-17T00:18:40.763 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:18:40.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.909+0000 7f550b969700 1 Processor -- start 2023-08-17T00:18:40.916 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.909+0000 7f550b969700 1 -- start start 2023-08-17T00:18:40.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55040a8b70 0x7f55040632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55040629b0 0x7f55040bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5504065240 con 0x7f55040a8f50 2023-08-17T00:18:40.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5504062e40 con 0x7f55040a8b70 2023-08-17T00:18:40.918 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55040638a0 con 0x7f55040629b0 2023-08-17T00:18:40.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55040a8b70 0x7f55040632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.919 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f55040a8b70 0x7f55040632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50492/0 (socket says 172.21.15.153:50492) 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 -- 172.21.15.153:0/829697166 learned_addr learned my addr 172.21.15.153:0/829697166 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509f06700 1 --2- 172.21.15.153:0/829697166 >> v2:172.21.15.178:3300/0 conn(0x7f55040629b0 0x7f55040bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 -- 172.21.15.153:0/829697166 >> v2:172.21.15.178:3300/0 conn(0x7f55040629b0 msgr2=0x7f55040bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 --2- 172.21.15.153:0/829697166 >> v2:172.21.15.178:3300/0 conn(0x7f55040629b0 0x7f55040bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 -- 172.21.15.153:0/829697166 >> v1:172.21.15.153:6789/0 conn(0x7f55040a8f50 legacy=0x7f55040656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 -- 172.21.15.153:0/829697166 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5504065de0 con 0x7f55040a8b70 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f54fbfff700 1 -- 172.21.15.153:0/829697166 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680731459 0 0) 0x7f5504065240 con 0x7f55040a8f50 2023-08-17T00:18:40.920 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f5509705700 1 --2- 172.21.15.153:0/829697166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040a8b70 0x7f55040632e0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f5504069b10 tx=0x7f5500009840).ready entity=mon.0 client_cookie=23cbdcb12add062e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.921 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f54fbfff700 1 -- 172.21.15.153:0/829697166 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000e070 con 0x7f55040a8b70 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f54fbfff700 1 -- 172.21.15.153:0/829697166 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550000ba20 con 0x7f55040a8b70 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f54fbfff700 1 -- 172.21.15.153:0/829697166 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000bda0 con 0x7f55040a8b70 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 -- 172.21.15.153:0/829697166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040a8b70 msgr2=0x7f55040632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 --2- 172.21.15.153:0/829697166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040a8b70 0x7f55040632e0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 rx=0x7f5504069b10 tx=0x7f5500009840).stop 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 -- 172.21.15.153:0/829697166 shutdown_connections 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 --2- 172.21.15.153:0/829697166 >> v2:172.21.15.178:3300/0 conn(0x7f55040629b0 0x7f55040bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.922 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 --2- 172.21.15.153:0/829697166 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040a8b70 0x7f55040632e0 unknown :-1 s=CLOSED pgs=2112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.913+0000 7f550b969700 1 -- 172.21.15.153:0/829697166 >> 172.21.15.153:0/829697166 conn(0x7f55040c7150 msgr2=0x7f55040c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.917+0000 7f550b969700 1 -- 172.21.15.153:0/829697166 shutdown_connections 2023-08-17T00:18:40.923 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.917+0000 7f550b969700 1 -- 172.21.15.153:0/829697166 wait complete. 2023-08-17T00:18:40.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.917+0000 7f550b969700 1 Processor -- start 2023-08-17T00:18:40.925 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.917+0000 7f550b969700 1 -- start start 2023-08-17T00:18:40.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f550b969700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 0x7f55041684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.927 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f550b969700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55040a8b70 0x7f550414f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f550b969700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55040a8f50 0x7f55040aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f550b969700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55040a9850 con 0x7f55040629b0 2023-08-17T00:18:40.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f550b969700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55041689d0 con 0x7f55040a8f50 2023-08-17T00:18:40.928 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f550b969700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550414fc50 con 0x7f55040a8b70 2023-08-17T00:18:40.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 0x7f55041684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 0x7f55041684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50496/0 (socket says 172.21.15.153:50496) 2023-08-17T00:18:40.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 -- 172.21.15.153:0/4045177897 learned_addr learned my addr 172.21.15.153:0/4045177897 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:40.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509f06700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55040a8f50 0x7f55040aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.930 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5508f04700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55040a8b70 0x7f550414f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 -- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55040a8b70 msgr2=0x7f550414f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55040a8b70 0x7f550414f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 -- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55040a8f50 msgr2=0x7f55040aba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:40.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55040a8f50 0x7f55040aba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:40.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 -- 172.21.15.153:0/4045177897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500009ae0 con 0x7f55040629b0 2023-08-17T00:18:40.931 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.921+0000 7f5509705700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 0x7f55041684e0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f550000b6c0 tx=0x7f5500009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55000092e0 con 0x7f55040629b0 2023-08-17T00:18:40.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500009500 con 0x7f55040629b0 2023-08-17T00:18:40.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55040abf60 con 0x7f55040629b0 2023-08-17T00:18:40.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550000bda0 con 0x7f55040629b0 2023-08-17T00:18:40.932 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5504168be0 con 0x7f55040629b0 2023-08-17T00:18:40.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550406b530 con 0x7f55040629b0 2023-08-17T00:18:40.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.925+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5500025030 con 0x7f55040629b0 2023-08-17T00:18:40.933 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.929+0000 7f54f97fa700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54e805a180 0x7f54e805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:40.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.929+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f55000751f0 con 0x7f55040629b0 2023-08-17T00:18:40.934 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.929+0000 7f5508f04700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54e805a180 0x7f54e805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:40.935 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.929+0000 7f5508f04700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54e805a180 0x7f54e805c640 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f55040a8840 tx=0x7f54f4007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:40.939 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:40.933+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5500048ee0 con 0x7f55040629b0 2023-08-17T00:18:41.099 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.093+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55040c3ab0 con 0x7f54e805a180 2023-08-17T00:18:41.105 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f54f97fa700 1 -- 172.21.15.153:0/4045177897 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68824 (secure 0 0 0) 0x7f55040c3ab0 con 0x7f54e805a180 2023-08-17T00:18:41.106 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:41.107 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54e805a180 msgr2=0x7f54e805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54e805a180 0x7f54e805c640 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 rx=0x7f55040a8840 tx=0x7f54f4007d40).stop 2023-08-17T00:18:41.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 msgr2=0x7f55041684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.108 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 0x7f55041684e0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 rx=0x7f550000b6c0 tx=0x7f5500009840).stop 2023-08-17T00:18:41.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 shutdown_connections 2023-08-17T00:18:41.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f54e805a180 0x7f54e805c640 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55040a8f50 0x7f55040aba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55040a8b70 0x7f550414f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 --2- 172.21.15.153:0/4045177897 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f55040629b0 0x7f55041684e0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.109 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 >> 172.21.15.153:0/4045177897 conn(0x7f55040c7150 msgr2=0x7f550415be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:41.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 shutdown_connections 2023-08-17T00:18:41.110 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.101+0000 7f550b969700 1 -- 172.21.15.153:0/4045177897 wait complete. 2023-08-17T00:18:41.110 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:18:41.129 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":669,"stamp":"2023-08-17T00:18:39.540538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458720,"kb_used_data":19488,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752516000,"statfs":{"total":773094113280,"available":770576384000,"internally_reserved":0,"allocated":19955712,"data_stored":9413224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620480,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-55,"num_read_kb":-59,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-2097174,"num_keys_recovered":-3,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.013561"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540890+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:18:35.540890+0000","last_peered":"2023-08-17T00:18:35.540890+0000","last_clean":"2023-08-17T00:18:35.540890+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:18:35.540890+0000","last_undegraded":"2023-08-17T00:18:35.540890+0000","last_fullsized":"2023-08-17T00:18:35.540890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":189,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542826+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:18:35.542826+0000","last_peered":"2023-08-17T00:18:35.542826+0000","last_clean":"2023-08-17T00:18:35.542826+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:18:35.542826+0000","last_undegraded":"2023-08-17T00:18:35.542826+0000","last_fullsized":"2023-08-17T00:18:35.542826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.539826+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:18:35.539826+0000","last_peered":"2023-08-17T00:18:35.539826+0000","last_clean":"2023-08-17T00:18:35.539826+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:18:35.539826+0000","last_undegraded":"2023-08-17T00:18:35.539826+0000","last_fullsized":"2023-08-17T00:18:35.539826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.682253+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:18:35.682253+0000","last_peered":"2023-08-17T00:18:35.682253+0000","last_clean":"2023-08-17T00:18:35.682253+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:18:35.682253+0000","last_undegraded":"2023-08-17T00:18:35.682253+0000","last_fullsized":"2023-08-17T00:18:35.682253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540743+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:18:35.540743+0000","last_peered":"2023-08-17T00:18:35.540743+0000","last_clean":"2023-08-17T00:18:35.540743+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:18:35.540743+0000","last_undegraded":"2023-08-17T00:18:35.540743+0000","last_fullsized":"2023-08-17T00:18:35.540743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542685+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:18:35.542685+0000","last_peered":"2023-08-17T00:18:35.542685+0000","last_clean":"2023-08-17T00:18:35.542685+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:18:35.542685+0000","last_undegraded":"2023-08-17T00:18:35.542685+0000","last_fullsized":"2023-08-17T00:18:35.542685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.538876+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:18:35.538876+0000","last_peered":"2023-08-17T00:18:35.538876+0000","last_clean":"2023-08-17T00:18:35.538876+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:18:35.538876+0000","last_undegraded":"2023-08-17T00:18:35.538876+0000","last_fullsized":"2023-08-17T00:18:35.538876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.541024+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:18:35.541024+0000","last_peered":"2023-08-17T00:18:35.541024+0000","last_clean":"2023-08-17T00:18:35.541024+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:18:35.541024+0000","last_undegraded":"2023-08-17T00:18:35.541024+0000","last_fullsized":"2023-08-17T00:18:35.541024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.677540+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:18:35.677540+0000","last_peered":"2023-08-17T00:18:35.677540+0000","last_clean":"2023-08-17T00:18:35.677540+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:18:35.677540+0000","last_undegraded":"2023-08-17T00:18:35.677540+0000","last_fullsized":"2023-08-17T00:18:35.677540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542337,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.073},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.51200000000000001},"max":{"1min":1.413,"5min":2.331,"15min":8.7769999999999992},"last":1.2},{"interface":"front","average":{"1min":1.097,"5min":1.099,"15min":1.0980000000000001},"min":{"1min":0.77500000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.403,"5min":3.1269999999999998,"15min":9.6530000000000005},"last":1.111}]},{"osd":1,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.131,"15min":1.1240000000000001},"min":{"1min":0.82899999999999996,"5min":0.72099999999999997,"15min":0.48199999999999998},"max":{"1min":1.45,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.349,"15min":1.204},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.57199999999999995},"max":{"1min":1.464,"5min":20.373000000000001,"15min":20.373000000000001},"last":1.2749999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.198,"15min":1.1140000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":9.8840000000000003,"15min":9.8840000000000003},"last":1.05},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.2230000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":12.411,"15min":12.411},"last":1.3700000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1990000000000001,"15min":1.153},"min":{"1min":0.91300000000000003,"5min":0.628,"15min":0.55900000000000005},"max":{"1min":1.4299999999999999,"5min":4.0579999999999998,"15min":7.7080000000000002},"last":1.143},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.77500000000000002,"15min":0.57599999999999996},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":13.074999999999999},"last":1.302}]},{"osd":4,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.143,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.597,"5min":4.6029999999999998,"15min":13.784000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.208,"15min":1.2070000000000001},"min":{"1min":0.74199999999999999,"5min":0.64600000000000002,"15min":0.44700000000000001},"max":{"1min":1.411,"5min":4.1529999999999996,"15min":10.045999999999999},"last":0.95999999999999996}]},{"osd":5,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1859999999999999,"15min":1.2789999999999999},"min":{"1min":0.80500000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.536,"5min":1.657,"15min":14.435},"last":1.093},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.462,"15min":1.365},"min":{"1min":0.83299999999999996,"5min":0.754,"15min":0.64500000000000002},"max":{"1min":1.4299999999999999,"5min":20.285,"15min":20.285},"last":1.2170000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.788,"15min":1.506},"min":{"1min":0.77300000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5580000000000001,"5min":45.982999999999997,"15min":45.982999999999997},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.228,"5min":1.343,"15min":1.3200000000000001},"min":{"1min":0.74399999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.51,"5min":10.542999999999999,"15min":11.365},"last":1.2430000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542337,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.085,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.56299999999999994,"15min":0.32700000000000001},"max":{"1min":1.484,"5min":6.2050000000000001,"15min":8.0909999999999993},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.0960000000000001,"15min":1.119},"min":{"1min":0.80100000000000005,"5min":0.61399999999999999,"15min":0.502},"max":{"1min":1.6459999999999999,"5min":4.468,"15min":10.519},"last":0.85999999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.113,"15min":1.157},"min":{"1min":0.84399999999999997,"5min":0.65800000000000003,"15min":0.443},"max":{"1min":1.5249999999999999,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.325},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.0840000000000001},"min":{"1min":0.83099999999999996,"5min":0.69299999999999995,"15min":0.47199999999999998},"max":{"1min":1.502,"5min":2.2490000000000001,"15min":11.391999999999999},"last":1.194}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1910000000000001,"15min":1.1699999999999999},"min":{"1min":0.83599999999999997,"5min":0.79300000000000004,"15min":0.372},"max":{"1min":1.361,"5min":1.792,"15min":5.3799999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.302,"15min":1.298},"min":{"1min":1.0349999999999999,"5min":0.76400000000000001,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":3.5409999999999999,"15min":10.669},"last":1.514}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":1.0720000000000001,"5min":0.80400000000000005,"15min":0.48599999999999999},"max":{"1min":1.4350000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.2609999999999999},"min":{"1min":0.873,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.5449999999999999,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.482}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1679999999999999,"15min":1.2569999999999999},"min":{"1min":0.874,"5min":0.77500000000000002,"15min":0.56699999999999995},"max":{"1min":1.3859999999999999,"5min":1.758,"15min":10.632},"last":1.232},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.208,"15min":1.2390000000000001},"min":{"1min":0.85499999999999998,"5min":0.71799999999999997,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.351}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.40899999999999997},"max":{"1min":1.661,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.379},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.4199999999999999,"15min":1.411},"min":{"1min":1.054,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.78,"5min":8.4809999999999999,"15min":10.592000000000001},"last":1.417}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3460000000000001,"15min":1.345},"min":{"1min":0.98999999999999999,"5min":0.74299999999999999,"15min":0.65100000000000002},"max":{"1min":1.655,"5min":5.2199999999999998,"15min":11.51},"last":1.7969999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.66900000000000004},"max":{"1min":1.671,"5min":3.7519999999999998,"15min":5.4100000000000001},"last":1.5620000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542338,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.093,"15min":1.0780000000000001},"min":{"1min":0.76500000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.988,"5min":1.988,"15min":15.007999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.125,"15min":1.127},"min":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.623,"5min":1.946,"15min":16.838999999999999},"last":1.3220000000000001}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.117,"15min":1.0860000000000001},"min":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5840000000000001,"5min":1.746,"15min":4.2270000000000003},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1200000000000001,"15min":1.143},"min":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.58799999999999997},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":9.6579999999999995},"last":1.302}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1279999999999999,"15min":1.1930000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.67700000000000005},"max":{"1min":1.7649999999999999,"5min":1.8100000000000001,"15min":16.675000000000001},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.1919999999999999,"15min":1.1870000000000001},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":11.949},"last":1.272}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.64100000000000001},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":13.125},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89900000000000002,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.8740000000000001,"5min":1.887,"15min":8.4809999999999999},"last":1.415}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1499999999999999,"15min":1.214},"min":{"1min":0.76800000000000002,"5min":0.63200000000000001,"15min":0.58599999999999997},"max":{"1min":2.286,"5min":2.286,"15min":17.510000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.294},"min":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.54000000000000004},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":19.591000000000001},"last":1.4790000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.22,"15min":1.294},"min":{"1min":0.72199999999999998,"5min":0.63700000000000001,"15min":0.60099999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":17.158000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.2490000000000001,"15min":1.3049999999999999},"min":{"1min":0.91900000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":17.050000000000001},"last":0.90400000000000003}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.347,"15min":1.4059999999999999},"min":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.57199999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":18.158000000000001},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.361,"5min":1.3660000000000001,"15min":1.4139999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":14.818},"last":1.1379999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542337,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.35499999999999998,"15min":0.32000000000000001},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.7529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92900000000000005,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.45200000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":2.6709999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.82199999999999995},"min":{"1min":0.64700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.159,"5min":3.274,"15min":11.215999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.76000000000000001,"5min":0.43099999999999999,"15min":0.35499999999999998},"max":{"1min":1.319,"5min":1.377,"15min":3.7810000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.92700000000000005,"15min":0.89900000000000002},"min":{"1min":0.78100000000000003,"5min":0.52000000000000002,"15min":0.33800000000000002},"max":{"1min":1.4359999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.0820000000000001,"15min":1.036},"min":{"1min":0.98099999999999998,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":1.548,"5min":1.6020000000000001,"15min":2.6360000000000001},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2470000000000001,"15min":1.1970000000000001},"min":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.58099999999999996},"max":{"1min":1.5049999999999999,"5min":1.7829999999999999,"15min":3.9449999999999998},"last":1.371},{"interface":"front","average":{"1min":1.224,"5min":1.222,"15min":1.1919999999999999},"min":{"1min":0.81000000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4490000000000001,"5min":1.631,"15min":3.9790000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":1.0900000000000001,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.5,"5min":1.706,"15min":2.1309999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.284,"15min":1.2430000000000001},"min":{"1min":1.2370000000000001,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.5329999999999999,"5min":1.829,"15min":2.6789999999999998},"last":1.45}]},{"osd":6,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2290000000000001,"15min":1.2030000000000001},"min":{"1min":1.0349999999999999,"5min":0.61099999999999999,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":1.708,"15min":3.4249999999999998},"last":1.343},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.1870000000000001},"min":{"1min":1.0169999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.3879999999999999,"5min":1.891,"15min":3.585},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.2230000000000001},"min":{"1min":1.105,"5min":0.81399999999999995,"15min":0.52600000000000002},"max":{"1min":1.4990000000000001,"5min":1.996,"15min":2.1930000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.202},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.9890000000000001,"15min":2.0419999999999998},"last":1.208}]}]},{"osd":2,"up_from":14,"seq":60129542337,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.292,"5min":1.855,"15min":3.1099999999999999},"last":1.502},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.28799999999999998},"max":{"1min":1.1259999999999999,"5min":1.337,"15min":6.4859999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91500000000000004,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.1379999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.107,"5min":1.1140000000000001,"15min":1.014},"min":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.3819999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0089999999999999,"15min":0.98099999999999998},"min":{"1min":0.66900000000000004,"5min":0.63400000000000001,"15min":0.42899999999999999},"max":{"1min":1.595,"5min":1.595,"15min":5.4059999999999997},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93500000000000005,"15min":0.92000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.361,"5min":1.6020000000000001,"15min":3.3410000000000002},"last":1.046}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3280000000000001,"15min":1.2250000000000001},"min":{"1min":0.82699999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.22,"5min":1.409,"15min":1.286},"min":{"1min":0.92500000000000004,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.472,"5min":17.988,"15min":17.988},"last":1.2889999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3240000000000001,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.58799999999999997},"max":{"1min":1.665,"5min":1.7430000000000001,"15min":12.914},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2310000000000001,"15min":1.242},"min":{"1min":0.98199999999999998,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":9.5519999999999996},"last":1.5900000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1839999999999999,"15min":1.2290000000000001},"min":{"1min":0.95499999999999996,"5min":0.74299999999999999,"15min":0.58899999999999997},"max":{"1min":1.625,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.323},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3140000000000001,"15min":1.319},"min":{"1min":0.96299999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.7190000000000001,"5min":1.909,"15min":12.698},"last":1.389}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":1.0800000000000001,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.621,"5min":1.798,"15min":10.592000000000001},"last":1.657},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.335},"min":{"1min":0.91400000000000003,"5min":0.81100000000000005,"15min":0.54100000000000004},"max":{"1min":1.6930000000000001,"5min":1.891,"15min":11.417},"last":1.736}]}]},{"osd":1,"up_from":14,"seq":60129542337,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.879,"15min":0.84699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.309},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":6.4329999999999998},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.39400000000000002},"max":{"1min":1.454,"5min":1.6200000000000001,"15min":13.093},"last":1.3140000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.314},"max":{"1min":1.1879999999999999,"5min":1.3069999999999999,"15min":5.4989999999999997},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":0.95999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.036,"15min":1.014},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":1.3620000000000001,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":1.0640000000000001},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.93200000000000005},"min":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":1.359,"15min":12.981999999999999},"last":1.1200000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.123,"15min":1.1439999999999999},"min":{"1min":0.875,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":20.548999999999999},"last":1.095},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.238,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.48,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":1.2470000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2889999999999999,"15min":1.2809999999999999},"min":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0739999999999998,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2609999999999999,"15min":1.2350000000000001},"min":{"1min":0.84299999999999997,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":5.4240000000000004},"last":1.2909999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.244,"15min":1.244},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4370000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.232,"15min":1.2090000000000001},"min":{"1min":1.02,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.694,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.3899999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.294,"15min":1.29},"min":{"1min":0.96199999999999997,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.468,"5min":1.8959999999999999,"15min":6.9779999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3049999999999999,"15min":1.3080000000000001},"min":{"1min":1.0189999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.649,"5min":1.9119999999999999,"15min":13.131},"last":1.573}]}]},{"osd":0,"up_from":14,"seq":60129542338,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78100000000000003,"15min":0.82899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.30299999999999999},"max":{"1min":1.248,"5min":1.3080000000000001,"15min":18.442},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.143,"5min":1.571,"15min":7.9720000000000004},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.94199999999999995},"min":{"1min":0.70399999999999996,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.347,"5min":1.347,"15min":18.481999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93500000000000005,"15min":0.92200000000000004},"min":{"1min":0.73499999999999999,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":1.258,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.266}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.86299999999999999},"min":{"1min":0.61099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3879999999999999,"5min":1.46,"15min":1.613},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0129999999999999,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.4390000000000001,"5min":1.585,"15min":18.577000000000002},"last":1.232}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.159,"15min":1.1020000000000001},"min":{"1min":0.90400000000000003,"5min":0.754,"15min":0.56399999999999995},"max":{"1min":1.476,"5min":1.6830000000000001,"15min":1.7609999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.21,"15min":1.2490000000000001},"min":{"1min":1.0720000000000001,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.587,"5min":1.792,"15min":18.515000000000001},"last":1.5720000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.26,"15min":1.2809999999999999},"min":{"1min":1.069,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.534,"5min":1.746,"15min":17.152999999999999},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.258,"15min":1.2230000000000001},"min":{"1min":1.0600000000000001,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.5229999999999999,"5min":1.6379999999999999,"15min":1.984},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.284},"min":{"1min":1.0349999999999999,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.518,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.2589999999999999},"min":{"1min":0.95999999999999996,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.706,"5min":2.0619999999999998,"15min":17.204000000000001},"last":1.1639999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0329999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.6000000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.244,"15min":1.1990000000000001},"min":{"1min":1.03,"5min":0.80300000000000005,"15min":0.60199999999999998},"max":{"1min":1.5129999999999999,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.673}]}]},{"osd":4,"up_from":13,"seq":55834575042,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.042},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.38300000000000001},"max":{"1min":1.371,"5min":1.53,"15min":7.1379999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.135,"5min":1.0429999999999999,"15min":1.0489999999999999},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.6279999999999999,"5min":1.8169999999999999,"15min":7.7380000000000004},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1819999999999999,"15min":1.218},"min":{"1min":0.81999999999999995,"5min":0.61599999999999999,"15min":0.42499999999999999},"max":{"1min":1.4379999999999999,"5min":1.665,"15min":8.3800000000000008},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.198},"min":{"1min":0.85699999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.347,"5min":1.732,"15min":6.9000000000000004},"last":0.879}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0900000000000001,"15min":1.2050000000000001},"min":{"1min":0.82499999999999996,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.581,"5min":1.581,"15min":18.431000000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.292},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36699999999999999},"max":{"1min":1.2989999999999999,"5min":1.5880000000000001,"15min":36.531999999999996},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.099,"15min":1.1000000000000001},"min":{"1min":0.71699999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4419999999999999,"5min":1.8600000000000001,"15min":2.9889999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1659999999999999,"15min":1.3660000000000001},"min":{"1min":0.96399999999999997,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.5389999999999999,"5min":1.875,"15min":36.530000000000001},"last":1.1899999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.276,"15min":1.2549999999999999},"min":{"1min":0.98499999999999999,"5min":0.76900000000000002,"15min":0.433},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":6.3250000000000002},"last":2.4590000000000001},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3069999999999999,"15min":1.2969999999999999},"min":{"1min":0.91200000000000003,"5min":0.80700000000000005,"15min":0.63500000000000001},"max":{"1min":2.605,"5min":2.605,"15min":9.4120000000000008},"last":2.2570000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.3},"min":{"1min":0.80300000000000005,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6559999999999999,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.325},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3580000000000001,"15min":1.3520000000000001},"min":{"1min":1.1120000000000001,"5min":0.88900000000000001,"15min":0.49399999999999999},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.014}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.875,"5min":0.72499999999999998,"15min":0.56100000000000005},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":3.645},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.371},"min":{"1min":0.95899999999999996,"5min":0.84599999999999997,"15min":0.629},"max":{"1min":1.875,"5min":1.879,"15min":8.327},"last":1.238}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:18:41.131 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-17T00:18:41.284 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.277+0000 7f129a979700 1 Processor -- start 2023-08-17T00:18:41.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.277+0000 7f129a979700 1 -- start start 2023-08-17T00:18:41.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f129a979700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1294066e40 0x7f1294067220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f129a979700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940c2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f129a979700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f12940c3270 0x7f1294157b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f129a979700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940638d0 con 0x7f1294066e40 2023-08-17T00:18:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f129a979700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12940c3840 con 0x7f12940c3270 2023-08-17T00:18:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f129a979700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1294062fa0 con 0x7f12940bc520 2023-08-17T00:18:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1294066e40 0x7f1294067220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f1294066e40 0x7f1294067220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50500/0 (socket says 172.21.15.153:50500) 2023-08-17T00:18:41.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 -- 172.21.15.153:0/714969810 learned_addr learned my addr 172.21.15.153:0/714969810 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:41.290 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 -- 172.21.15.153:0/714969810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 msgr2=0x7f12940c2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:41.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 --2- 172.21.15.153:0/714969810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940c2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:18:41.291 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 -- 172.21.15.153:0/714969810 >> v2:172.21.15.178:3300/0 conn(0x7f12940c3270 msgr2=0x7f1294157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 --2- 172.21.15.153:0/714969810 >> v2:172.21.15.178:3300/0 conn(0x7f12940c3270 0x7f1294157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 -- 172.21.15.153:0/714969810 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1294063280 con 0x7f1294066e40 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1299977700 1 --2- 172.21.15.153:0/714969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294067220 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7f129406a510 tx=0x7f1290009840).ready entity=mon.0 client_cookie=6066e367041d1be7 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1298975700 1 -- 172.21.15.153:0/714969810 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000e070 con 0x7f1294066e40 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1298975700 1 -- 172.21.15.153:0/714969810 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000ba50 con 0x7f1294066e40 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.281+0000 7f1298975700 1 -- 172.21.15.153:0/714969810 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000bdd0 con 0x7f1294066e40 2023-08-17T00:18:41.292 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 -- 172.21.15.153:0/714969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 msgr2=0x7f1294067220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 --2- 172.21.15.153:0/714969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294067220 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 rx=0x7f129406a510 tx=0x7f1290009840).stop 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 -- 172.21.15.153:0/714969810 shutdown_connections 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 --2- 172.21.15.153:0/714969810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940c2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 --2- 172.21.15.153:0/714969810 >> v2:172.21.15.178:3300/0 conn(0x7f12940c3270 0x7f1294157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 --2- 172.21.15.153:0/714969810 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294067220 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 -- 172.21.15.153:0/714969810 >> 172.21.15.153:0/714969810 conn(0x7f1294069700 msgr2=0x7f1294069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 -- 172.21.15.153:0/714969810 shutdown_connections 2023-08-17T00:18:41.293 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.285+0000 7f129a979700 1 -- 172.21.15.153:0/714969810 wait complete. 2023-08-17T00:18:41.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 Processor -- start 2023-08-17T00:18:41.294 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 -- start start 2023-08-17T00:18:41.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.295 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940bf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12940c3270 0x7f129416bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940bea40 con 0x7f1294066e40 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12940bf000 con 0x7f12940c3270 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129416c590 con 0x7f12940bc520 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50508/0 (socket says 172.21.15.153:50508) 2023-08-17T00:18:41.296 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 -- 172.21.15.153:0/2434303814 learned_addr learned my addr 172.21.15.153:0/2434303814 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:41.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 -- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 msgr2=0x7f12940bf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299176700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940bf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:41.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a178700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12940c3270 0x7f129416bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:41.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940bf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 -- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12940c3270 msgr2=0x7f129416bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.298 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12940c3270 0x7f129416bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 -- 172.21.15.153:0/2434303814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290009ae0 con 0x7f1294066e40 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299176700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a178700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12940c3270 0x7f129416bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1299977700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294154ed0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f1290007280 tx=0x7f1290009840).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290001090 con 0x7f1294066e40 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000bdd0 con 0x7f1294066e40 2023-08-17T00:18:41.299 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129416c870 con 0x7f1294066e40 2023-08-17T00:18:41.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.289+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129001d690 con 0x7f1294066e40 2023-08-17T00:18:41.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.293+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12941553c0 con 0x7f1294066e40 2023-08-17T00:18:41.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.293+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129406b4c0 con 0x7f1294066e40 2023-08-17T00:18:41.300 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.293+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f1290024030 con 0x7f1294066e40 2023-08-17T00:18:41.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.297+0000 7f1289ffb700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f127805a150 0x7f127805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:41.301 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.297+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f12900754a0 con 0x7f1294066e40 2023-08-17T00:18:41.302 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.297+0000 7f1299176700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f127805a150 0x7f127805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:41.303 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.297+0000 7f1299176700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f127805a150 0x7f127805c610 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f129415acc0 tx=0x7f1284008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:41.308 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.301+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f1290049270 con 0x7f1294066e40 2023-08-17T00:18:41.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.457+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1294063560 con 0x7f1294066e40 2023-08-17T00:18:41.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f1289ffb700 1 -- 172.21.15.153:0/2434303814 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+14031 (secure 0 0 0) 0x7f1290022070 con 0x7f1294066e40 2023-08-17T00:18:41.467 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:41.468 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":198,"fsid":"26772232-6872-4f9c-a0de-c26dcf774179","created":"2023-08-17T00:02:32.290101+0000","modified":"2023-08-17T00:18:36.535838+0000","last_up_change":"2023-08-17T00:02:43.205525+0000","last_in_change":"2023-08-17T00:02:35.342505+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-17T00:02:43.299528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-17T00:02:44.374999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"1969b88b-c81b-4fac-b199-213b2b513b68","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6800","nonce":32815},{"type":"v1","addr":"172.21.15.153:6802","nonce":32815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6805","nonce":32815},{"type":"v1","addr":"172.21.15.153:6808","nonce":32815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6819","nonce":32815},{"type":"v1","addr":"172.21.15.153:6822","nonce":32815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6811","nonce":32815},{"type":"v1","addr":"172.21.15.153:6814","nonce":32815}]},"public_addr":"172.21.15.153:6802/32815","cluster_addr":"172.21.15.153:6808/32815","heartbeat_back_addr":"172.21.15.153:6822/32815","heartbeat_front_addr":"172.21.15.153:6814/32815","state":["exists","up"]},{"osd":1,"uuid":"7f30a16f-3732-4b50-867d-711abe9e1a92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6824","nonce":32819},{"type":"v1","addr":"172.21.15.153:6825","nonce":32819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6826","nonce":32819},{"type":"v1","addr":"172.21.15.153:6827","nonce":32819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6830","nonce":32819},{"type":"v1","addr":"172.21.15.153:6831","nonce":32819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6828","nonce":32819},{"type":"v1","addr":"172.21.15.153:6829","nonce":32819}]},"public_addr":"172.21.15.153:6825/32819","cluster_addr":"172.21.15.153:6827/32819","heartbeat_back_addr":"172.21.15.153:6831/32819","heartbeat_front_addr":"172.21.15.153:6829/32819","state":["exists","up"]},{"osd":2,"uuid":"1ff82dc3-9026-4869-9ef6-399407eea4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6803","nonce":32817},{"type":"v1","addr":"172.21.15.153:6806","nonce":32817}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6809","nonce":32817},{"type":"v1","addr":"172.21.15.153:6812","nonce":32817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6821","nonce":32817},{"type":"v1","addr":"172.21.15.153:6823","nonce":32817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6815","nonce":32817},{"type":"v1","addr":"172.21.15.153:6817","nonce":32817}]},"public_addr":"172.21.15.153:6806/32817","cluster_addr":"172.21.15.153:6812/32817","heartbeat_back_addr":"172.21.15.153:6823/32817","heartbeat_front_addr":"172.21.15.153:6817/32817","state":["exists","up"]},{"osd":3,"uuid":"80d9c3af-d21a-44eb-a74b-e2b90bea159b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6801","nonce":32816},{"type":"v1","addr":"172.21.15.153:6804","nonce":32816}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6807","nonce":32816},{"type":"v1","addr":"172.21.15.153:6810","nonce":32816}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6818","nonce":32816},{"type":"v1","addr":"172.21.15.153:6820","nonce":32816}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6813","nonce":32816},{"type":"v1","addr":"172.21.15.153:6816","nonce":32816}]},"public_addr":"172.21.15.153:6804/32816","cluster_addr":"172.21.15.153:6810/32816","heartbeat_back_addr":"172.21.15.153:6820/32816","heartbeat_front_addr":"172.21.15.153:6816/32816","state":["exists","up"]},{"osd":4,"uuid":"8471906c-9ca7-47db-91eb-5bc3fe5091b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":33066},{"type":"v1","addr":"172.21.15.178:6801","nonce":33066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":33066},{"type":"v1","addr":"172.21.15.178:6803","nonce":33066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":33066},{"type":"v1","addr":"172.21.15.178:6807","nonce":33066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":33066},{"type":"v1","addr":"172.21.15.178:6805","nonce":33066}]},"public_addr":"172.21.15.178:6801/33066","cluster_addr":"172.21.15.178:6803/33066","heartbeat_back_addr":"172.21.15.178:6807/33066","heartbeat_front_addr":"172.21.15.178:6805/33066","state":["exists","up"]},{"osd":5,"uuid":"df266beb-aa49-4403-a360-0f6345ad9639","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":33067},{"type":"v1","addr":"172.21.15.178:6817","nonce":33067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6818","nonce":33067},{"type":"v1","addr":"172.21.15.178:6819","nonce":33067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":33067},{"type":"v1","addr":"172.21.15.178:6823","nonce":33067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":33067},{"type":"v1","addr":"172.21.15.178:6821","nonce":33067}]},"public_addr":"172.21.15.178:6817/33067","cluster_addr":"172.21.15.178:6819/33067","heartbeat_back_addr":"172.21.15.178:6823/33067","heartbeat_front_addr":"172.21.15.178:6821/33067","state":["exists","up"]},{"osd":6,"uuid":"cb6d5df1-3d2a-438d-bc86-7dcbb0eb09ff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":33068},{"type":"v1","addr":"172.21.15.178:6809","nonce":33068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6810","nonce":33068},{"type":"v1","addr":"172.21.15.178:6811","nonce":33068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":33068},{"type":"v1","addr":"172.21.15.178:6815","nonce":33068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6812","nonce":33068},{"type":"v1","addr":"172.21.15.178:6813","nonce":33068}]},"public_addr":"172.21.15.178:6809/33068","cluster_addr":"172.21.15.178:6811/33068","heartbeat_back_addr":"172.21.15.178:6815/33068","heartbeat_front_addr":"172.21.15.178:6813/33068","state":["exists","up"]},{"osd":7,"uuid":"1ff7c332-f204-41a0-a83d-bf2278444a50","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":190,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":33069},{"type":"v1","addr":"172.21.15.178:6825","nonce":33069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":33069},{"type":"v1","addr":"172.21.15.178:6827","nonce":33069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":33069},{"type":"v1","addr":"172.21.15.178:6831","nonce":33069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":33069},{"type":"v1","addr":"172.21.15.178:6829","nonce":33069}]},"public_addr":"172.21.15.178:6825/33069","cluster_addr":"172.21.15.178:6827/33069","heartbeat_back_addr":"172.21.15.178:6831/33069","heartbeat_front_addr":"172.21.15.178:6829/33069","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.253316+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.319263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.329941+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.255616+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.191273+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.341623+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.331251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-17T00:02:41.361039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.153:6835/214968761":"2023-08-18T00:18:32.472846+0000","172.21.15.153:6833/214968761":"2023-08-18T00:18:32.472846+0000","172.21.15.153:6835/4264536439":"2023-08-18T00:17:17.953681+0000","172.21.15.153:6833/4264536439":"2023-08-18T00:17:17.953681+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-17T00:18:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f127805a150 msgr2=0x7f127805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f127805a150 0x7f127805c610 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 rx=0x7f129415acc0 tx=0x7f1284008040).stop 2023-08-17T00:18:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 msgr2=0x7f1294154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294154ed0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 rx=0x7f1290007280 tx=0x7f1290009840).stop 2023-08-17T00:18:41.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 shutdown_connections 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f127805a150 0x7f127805c610 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12940c3270 0x7f129416bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12940bc520 0x7f12940bf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 --2- 172.21.15.153:0/2434303814 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f1294066e40 0x7f1294154ed0 unknown :-1 s=CLOSED pgs=2115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 >> 172.21.15.153:0/2434303814 conn(0x7f1294069700 msgr2=0x7f12940c6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 shutdown_connections 2023-08-17T00:18:41.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:41.461+0000 7f129a979700 1 -- 172.21.15.153:0/2434303814 wait complete. 2023-08-17T00:18:42.489 INFO:tasks.ceph:Scrubbing osd.0 2023-08-17T00:18:42.489 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:42.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.653+0000 7f682fe5b700 1 Processor -- start 2023-08-17T00:18:42.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.653+0000 7f682fe5b700 1 -- start start 2023-08-17T00:18:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682fe5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f68280ad250 0x7f68280c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682fe5b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f68280bfe50 0x7f6828154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682fe5b700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6828155170 con 0x7f6828061fa0 2023-08-17T00:18:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682fe5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68280ad630 con 0x7f68280ad250 2023-08-17T00:18:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682fe5b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68280c02e0 con 0x7f68280bfe50 2023-08-17T00:18:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682e3f8700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f6828061fa0 0x7f68280623d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43866/0 (socket says 172.21.15.153:43866) 2023-08-17T00:18:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682e3f8700 1 -- 172.21.15.153:0/3959180061 learned_addr learned my addr 172.21.15.153:0/3959180061 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:42.664 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682dbf7700 1 --2- 172.21.15.153:0/3959180061 >> v2:172.21.15.153:3300/0 conn(0x7f68280ad250 0x7f68280c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682d3f6700 1 --2- 172.21.15.153:0/3959180061 >> v2:172.21.15.178:3300/0 conn(0x7f68280bfe50 0x7f6828154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682cbf5700 1 -- 172.21.15.153:0/3959180061 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944388959 0 0) 0x7f6828155170 con 0x7f6828061fa0 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682cbf5700 1 -- 172.21.15.153:0/3959180061 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68140033f0 con 0x7f6828061fa0 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682dbf7700 1 -- 172.21.15.153:0/3959180061 >> v2:172.21.15.178:3300/0 conn(0x7f68280bfe50 msgr2=0x7f6828154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682dbf7700 1 --2- 172.21.15.153:0/3959180061 >> v2:172.21.15.178:3300/0 conn(0x7f68280bfe50 0x7f6828154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682dbf7700 1 -- 172.21.15.153:0/3959180061 >> v1:172.21.15.153:6789/0 conn(0x7f6828061fa0 legacy=0x7f68280623d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682cbf5700 1 -- 172.21.15.153:0/3959180061 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 171571604 0 0) 0x7f68140033f0 con 0x7f6828061fa0 2023-08-17T00:18:42.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682dbf7700 1 -- 172.21.15.153:0/3959180061 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68280c04c0 con 0x7f68280ad250 2023-08-17T00:18:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.657+0000 7f682d3f6700 1 --2- 172.21.15.153:0/3959180061 >> v2:172.21.15.178:3300/0 conn(0x7f68280bfe50 0x7f6828154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:42.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682dbf7700 1 --2- 172.21.15.153:0/3959180061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c1560 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7f68280c8520 tx=0x7f6824009060).ready entity=mon.0 client_cookie=fec3fe17efb19266 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682cbf5700 1 -- 172.21.15.153:0/3959180061 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820001810 con 0x7f68280ad250 2023-08-17T00:18:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682cbf5700 1 -- 172.21.15.153:0/3959180061 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68240090d0 con 0x7f68280ad250 2023-08-17T00:18:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682cbf5700 1 -- 172.21.15.153:0/3959180061 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6824011610 con 0x7f68280ad250 2023-08-17T00:18:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 -- 172.21.15.153:0/3959180061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 msgr2=0x7f68280c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 --2- 172.21.15.153:0/3959180061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c1560 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 rx=0x7f68280c8520 tx=0x7f6824009060).stop 2023-08-17T00:18:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 -- 172.21.15.153:0/3959180061 shutdown_connections 2023-08-17T00:18:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 --2- 172.21.15.153:0/3959180061 >> v2:172.21.15.178:3300/0 conn(0x7f68280bfe50 0x7f6828154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 --2- 172.21.15.153:0/3959180061 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c1560 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 -- 172.21.15.153:0/3959180061 >> 172.21.15.153:0/3959180061 conn(0x7f68280caa10 msgr2=0x7f68280cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 -- 172.21.15.153:0/3959180061 shutdown_connections 2023-08-17T00:18:42.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.661+0000 7f682fe5b700 1 -- 172.21.15.153:0/3959180061 wait complete. 2023-08-17T00:18:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 Processor -- start 2023-08-17T00:18:42.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 -- start start 2023-08-17T00:18:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828061fa0 0x7f682814ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68280bfe50 0x7f68280c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280c9790 con 0x7f68280ad250 2023-08-17T00:18:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68280c1f70 con 0x7f6828061fa0 2023-08-17T00:18:42.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682fe5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68280ab800 con 0x7f68280bfe50 2023-08-17T00:18:42.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50532/0 (socket says 172.21.15.153:50532) 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 -- 172.21.15.153:0/758577856 learned_addr learned my addr 172.21.15.153:0/758577856 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682e3f8700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68280bfe50 0x7f68280c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682dbf7700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828061fa0 0x7f682814ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 -- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68280bfe50 msgr2=0x7f68280c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68280bfe50 0x7f68280c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 -- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828061fa0 msgr2=0x7f682814ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6828061fa0 0x7f682814ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682d3f6700 1 -- 172.21.15.153:0/758577856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180092a0 con 0x7f68280ad250 2023-08-17T00:18:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.665+0000 7f682e3f8700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f68280bfe50 0x7f68280c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:42.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f682d3f6700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c8db0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f681800ea50 tx=0x7f6818009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800c850 con 0x7f68280ad250 2023-08-17T00:18:42.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681800c9b0 con 0x7f68280ad250 2023-08-17T00:18:42.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68240092a0 con 0x7f68280ad250 2023-08-17T00:18:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800cd30 con 0x7f68280ad250 2023-08-17T00:18:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68280ae0e0 con 0x7f68280ad250 2023-08-17T00:18:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.669+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68280c1280 con 0x7f68280ad250 2023-08-17T00:18:42.677 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6818022070 con 0x7f68280ad250 2023-08-17T00:18:42.678 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f681dffb700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680c05a150 0x7f680c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f68180742c0 con 0x7f68280ad250 2023-08-17T00:18:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f681dffb700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f680c0607e0 0x7f680c062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 --> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f680c0632c0 con 0x7f680c0607e0 2023-08-17T00:18:42.679 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6818076930 con 0x7f68280ad250 2023-08-17T00:18:42.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f682dbf7700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680c05a150 0x7f680c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f682e3f8700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f680c0607e0 0x7f680c062c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.680 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f682e3f8700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f680c0607e0 0x7f680c062c40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.673+0000 7f682dbf7700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680c05a150 0x7f680c05c610 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f6824006be0 tx=0x7f6824016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.681 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.677+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== osd.0 v2:172.21.15.153:6800/32815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f680c0632c0 con 0x7f680c0607e0 2023-08-17T00:18:42.697 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.689+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 --> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f682806b530 con 0x7f680c0607e0 2023-08-17T00:18:42.698 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f681dffb700 1 -- 172.21.15.153:0/758577856 <== osd.0 v2:172.21.15.153:6800/32815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f682806b530 con 0x7f680c0607e0 2023-08-17T00:18:42.698 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:42.698 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:42.698 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f680c0607e0 msgr2=0x7f680c062c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:6800/32815,v1:172.21.15.153:6802/32815] conn(0x7f680c0607e0 0x7f680c062c40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.699 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680c05a150 msgr2=0x7f680c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f680c05a150 0x7f680c05c610 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 rx=0x7f6824006be0 tx=0x7f6824016000).stop 2023-08-17T00:18:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 msgr2=0x7f68280c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 --2- 172.21.15.153:0/758577856 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f68280ad250 0x7f68280c8db0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 rx=0x7f681800ea50 tx=0x7f6818009060).stop 2023-08-17T00:18:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682e3f8700 1 -- 172.21.15.153:0/758577856 reap_dead start 2023-08-17T00:18:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 shutdown_connections 2023-08-17T00:18:42.700 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 >> 172.21.15.153:0/758577856 conn(0x7f68280caa10 msgr2=0x7f68281534f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:42.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 shutdown_connections 2023-08-17T00:18:42.701 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.693+0000 7f682fe5b700 1 -- 172.21.15.153:0/758577856 wait complete. 2023-08-17T00:18:42.718 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-17T00:18:42.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.865+0000 7f6b78bf9700 1 Processor -- start 2023-08-17T00:18:42.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b78bf9700 1 -- start start 2023-08-17T00:18:42.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b78bf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 0x7f6b740a8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b78bf9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b740a8e60 0x7f6b74068820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b78bf9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740ab9b0 con 0x7f6b740aa8c0 2023-08-17T00:18:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b78bf9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740aada0 con 0x7f6b740a8e60 2023-08-17T00:18:42.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b78bf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740ab080 con 0x7f6b74150880 2023-08-17T00:18:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 0x7f6b740a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b6affd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b740a8e60 0x7f6b74068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 0x7f6b740a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:51622/0 (socket says 172.21.15.153:51622) 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 -- 172.21.15.153:0/1936300465 learned_addr learned my addr 172.21.15.153:0/1936300465 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b73fff700 1 --1- 172.21.15.153:0/1936300465 >> v1:172.21.15.178:6789/0 conn(0x7f6b740aa8c0 0x7f6b740c0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:36916/0 (socket says 172.21.15.153:36916) 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 -- 172.21.15.153:0/1936300465 >> v2:172.21.15.178:3300/0 conn(0x7f6b740a8e60 msgr2=0x7f6b74068820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 --2- 172.21.15.153:0/1936300465 >> v2:172.21.15.178:3300/0 conn(0x7f6b740a8e60 0x7f6b74068820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 -- 172.21.15.153:0/1936300465 >> v1:172.21.15.178:6789/0 conn(0x7f6b740aa8c0 legacy=0x7f6b740c0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 -- 172.21.15.153:0/1936300465 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740ab360 con 0x7f6b74150880 2023-08-17T00:18:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b737fe700 1 --2- 172.21.15.153:0/1936300465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 0x7f6b740a8970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f6b64009810 tx=0x7f6b64009060).ready entity=mon.2 client_cookie=2f2b15092e386348 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.869+0000 7f6b72ffd700 1 -- 172.21.15.153:0/1936300465 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64005880 con 0x7f6b74150880 2023-08-17T00:18:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b72ffd700 1 -- 172.21.15.153:0/1936300465 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b640059e0 con 0x7f6b74150880 2023-08-17T00:18:42.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b72ffd700 1 -- 172.21.15.153:0/1936300465 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64005d60 con 0x7f6b74150880 2023-08-17T00:18:42.880 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 -- 172.21.15.153:0/1936300465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 msgr2=0x7f6b740a8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/1936300465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 0x7f6b740a8970 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f6b64009810 tx=0x7f6b64009060).stop 2023-08-17T00:18:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 -- 172.21.15.153:0/1936300465 shutdown_connections 2023-08-17T00:18:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/1936300465 >> v2:172.21.15.178:3300/0 conn(0x7f6b740a8e60 0x7f6b74068820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/1936300465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b74150880 0x7f6b740a8970 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.881 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 -- 172.21.15.153:0/1936300465 >> 172.21.15.153:0/1936300465 conn(0x7f6b740c6620 msgr2=0x7f6b740c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 -- 172.21.15.153:0/1936300465 shutdown_connections 2023-08-17T00:18:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.873+0000 7f6b78bf9700 1 -- 172.21.15.153:0/1936300465 wait complete. 2023-08-17T00:18:42.882 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 Processor -- start 2023-08-17T00:18:42.883 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 -- start start 2023-08-17T00:18:42.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b740a8e60 0x7f6b74145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.884 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b740aa8c0 0x7f6b740bbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 0x7f6b740bf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740b9f70 con 0x7f6b74150880 2023-08-17T00:18:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740bad60 con 0x7f6b740a8e60 2023-08-17T00:18:42.885 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b78bf9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740ba150 con 0x7f6b740aa8c0 2023-08-17T00:18:42.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 0x7f6b740bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b737fe700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b740a8e60 0x7f6b74145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b73fff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 0x7f6b740bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50534/0 (socket says 172.21.15.153:50534) 2023-08-17T00:18:42.886 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b73fff700 1 -- 172.21.15.153:0/930892084 learned_addr learned my addr 172.21.15.153:0/930892084 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.877+0000 7f6b6affd700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b740aa8c0 0x7f6b740bbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b737fe700 1 -- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b740aa8c0 msgr2=0x7f6b740bbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b737fe700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b740aa8c0 0x7f6b740bbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b737fe700 1 -- 172.21.15.153:0/930892084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 msgr2=0x7f6b740bf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b737fe700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 0x7f6b740bf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b737fe700 1 -- 172.21.15.153:0/930892084 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64009300 con 0x7f6b740a8e60 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b73fff700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 0x7f6b740bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:42.887 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b737fe700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b740a8e60 0x7f6b74145be0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f6b64013000 tx=0x7f6b64016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64005d60 con 0x7f6b740a8e60 2023-08-17T00:18:42.888 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64020070 con 0x7f6b740a8e60 2023-08-17T00:18:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b740ba430 con 0x7f6b740a8e60 2023-08-17T00:18:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6400b580 con 0x7f6b740a8e60 2023-08-17T00:18:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b740ba9f0 con 0x7f6b740a8e60 2023-08-17T00:18:42.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.881+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7406b4c0 con 0x7f6b740a8e60 2023-08-17T00:18:42.890 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.885+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f6b6402c070 con 0x7f6b740a8e60 2023-08-17T00:18:42.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.885+0000 7f6b6bfff700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5405a150 0x7f6b5405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.885+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f6b64076e80 con 0x7f6b740a8e60 2023-08-17T00:18:42.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.885+0000 7f6b6affd700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5405a150 0x7f6b5405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:42.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.889+0000 7f6b6affd700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5405a150 0x7f6b5405c610 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f6b7405e760 tx=0x7f6b5c009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:42.898 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:42.893+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f6b6404ac00 con 0x7f6b740a8e60 2023-08-17T00:18:43.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.053+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b74064010 con 0x7f6b5405a150 2023-08-17T00:18:43.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.057+0000 7f6b6bfff700 1 -- 172.21.15.153:0/930892084 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6b74064010 con 0x7f6b5405a150 2023-08-17T00:18:43.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5405a150 msgr2=0x7f6b5405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5405a150 0x7f6b5405c610 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 rx=0x7f6b7405e760 tx=0x7f6b5c009060).stop 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b740a8e60 msgr2=0x7f6b74145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b740a8e60 0x7f6b74145be0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 rx=0x7f6b64013000 tx=0x7f6b64016000).stop 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 shutdown_connections 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f6b5405a150 0x7f6b5405c610 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f6b74150880 0x7f6b740bf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b740aa8c0 0x7f6b740bbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 --2- 172.21.15.153:0/930892084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b740a8e60 0x7f6b74145be0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 >> 172.21.15.153:0/930892084 conn(0x7f6b740c6620 msgr2=0x7f6b740c5740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 shutdown_connections 2023-08-17T00:18:43.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.061+0000 7f6b78bf9700 1 -- 172.21.15.153:0/930892084 wait complete. 2023-08-17T00:18:43.070 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 0 to deep-scrub 2023-08-17T00:18:43.088 INFO:tasks.ceph:Scrubbing osd.1 2023-08-17T00:18:43.089 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:43.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.241+0000 7f294ffff700 1 Processor -- start 2023-08-17T00:18:43.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.241+0000 7f294ffff700 1 -- start start 2023-08-17T00:18:43.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294ffff700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29500cb450 0x7f29500a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294ffff700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29500c00d0 con 0x7f29501539b0 2023-08-17T00:18:43.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294ffff700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29500639c0 con 0x7f29500cb450 2023-08-17T00:18:43.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29500aa180 con 0x7f2950153d90 2023-08-17T00:18:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294effd700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f29501539b0 0x7f29500632b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43870/0 (socket says 172.21.15.153:43870) 2023-08-17T00:18:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294effd700 1 -- 172.21.15.153:0/1294613611 learned_addr learned my addr 172.21.15.153:0/1294613611 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294e7fc700 1 --2- 172.21.15.153:0/1294613611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.245+0000 7f294f7fe700 1 --2- 172.21.15.153:0/1294613611 >> v2:172.21.15.178:3300/0 conn(0x7f29500cb450 0x7f29500a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294dffb700 1 -- 172.21.15.153:0/1294613611 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793180636 0 0) 0x7f29500c00d0 con 0x7f29501539b0 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294dffb700 1 -- 172.21.15.153:0/1294613611 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29380033f0 con 0x7f29501539b0 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294e7fc700 1 -- 172.21.15.153:0/1294613611 >> v2:172.21.15.178:3300/0 conn(0x7f29500cb450 msgr2=0x7f29500a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294e7fc700 1 --2- 172.21.15.153:0/1294613611 >> v2:172.21.15.178:3300/0 conn(0x7f29500cb450 0x7f29500a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294e7fc700 1 -- 172.21.15.153:0/1294613611 >> v1:172.21.15.153:6789/0 conn(0x7f29501539b0 legacy=0x7f29500632b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294e7fc700 1 -- 172.21.15.153:0/1294613611 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29500bf810 con 0x7f2950153d90 2023-08-17T00:18:43.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294f7fe700 1 --2- 172.21.15.153:0/1294613611 >> v2:172.21.15.178:3300/0 conn(0x7f29500cb450 0x7f29500a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294e7fc700 1 --2- 172.21.15.153:0/1294613611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500a97a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f2944009760 tx=0x7f2944009060).ready entity=mon.2 client_cookie=dee8ae89009603bd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294dffb700 1 -- 172.21.15.153:0/1294613611 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294400d4a0 con 0x7f2950153d90 2023-08-17T00:18:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294dffb700 1 -- 172.21.15.153:0/1294613611 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294400d600 con 0x7f2950153d90 2023-08-17T00:18:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294dffb700 1 -- 172.21.15.153:0/1294613611 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294400d980 con 0x7f2950153d90 2023-08-17T00:18:43.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 -- 172.21.15.153:0/1294613611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 msgr2=0x7f29500a97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 --2- 172.21.15.153:0/1294613611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500a97a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f2944009760 tx=0x7f2944009060).stop 2023-08-17T00:18:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 -- 172.21.15.153:0/1294613611 shutdown_connections 2023-08-17T00:18:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 --2- 172.21.15.153:0/1294613611 >> v2:172.21.15.178:3300/0 conn(0x7f29500cb450 0x7f29500a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 --2- 172.21.15.153:0/1294613611 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500a97a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 -- 172.21.15.153:0/1294613611 >> 172.21.15.153:0/1294613611 conn(0x7f2950062a10 msgr2=0x7f29500ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 -- 172.21.15.153:0/1294613611 shutdown_connections 2023-08-17T00:18:43.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.249+0000 7f294ffff700 1 -- 172.21.15.153:0/1294613611 wait complete. 2023-08-17T00:18:43.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 Processor -- start 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 -- start start 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29500cb450 0x7f2950164e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29501539b0 0x7f2950162030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2950152de0 con 0x7f29500cb450 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29501666a0 con 0x7f29501539b0 2023-08-17T00:18:43.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294ffff700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2950165330 con 0x7f2950153d90 2023-08-17T00:18:43.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29500cb450 0x7f2950164e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29500cb450 0x7f2950164e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50546/0 (socket says 172.21.15.153:50546) 2023-08-17T00:18:43.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 -- 172.21.15.153:0/3988483839 learned_addr learned my addr 172.21.15.153:0/3988483839 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:43.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294e7fc700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29501539b0 0x7f2950162030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294f7fe700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 -- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 msgr2=0x7f29500c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2950153d90 0x7f29500c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 -- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29501539b0 msgr2=0x7f2950162030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29501539b0 0x7f2950162030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.253+0000 7f294effd700 1 -- 172.21.15.153:0/3988483839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009a20 con 0x7f29500cb450 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f294effd700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29500cb450 0x7f2950164e40 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f294000c4b0 tx=0x7f2940007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294000ce60 con 0x7f29500cb450 2023-08-17T00:18:43.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29400072e0 con 0x7f29500cb450 2023-08-17T00:18:43.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29440092a0 con 0x7f29500cb450 2023-08-17T00:18:43.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2940005670 con 0x7f29500cb450 2023-08-17T00:18:43.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2950165a90 con 0x7f29500cb450 2023-08-17T00:18:43.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2950046dd0 con 0x7f29500cb450 2023-08-17T00:18:43.265 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.257+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f294001a060 con 0x7f29500cb450 2023-08-17T00:18:43.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f2936ffd700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f293c05a120 0x7f293c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f29400734f0 con 0x7f29500cb450 2023-08-17T00:18:43.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f2936ffd700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f293c0607b0 0x7f293c062c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 --> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f293c063290 con 0x7f293c0607b0 2023-08-17T00:18:43.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2940075b60 con 0x7f29500cb450 2023-08-17T00:18:43.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f294e7fc700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f293c05a120 0x7f293c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f294f7fe700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f293c0607b0 0x7f293c062c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f294f7fe700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f293c0607b0 0x7f293c062c10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.268 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f294e7fc700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f293c05a120 0x7f293c05c5e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f29501541b0 tx=0x7f2944016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.261+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== osd.1 v2:172.21.15.153:6824/32819 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f293c063290 con 0x7f293c0607b0 2023-08-17T00:18:43.285 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.277+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 --> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2950081f80 con 0x7f293c0607b0 2023-08-17T00:18:43.286 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f2936ffd700 1 -- 172.21.15.153:0/3988483839 <== osd.1 v2:172.21.15.153:6824/32819 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2950081f80 con 0x7f293c0607b0 2023-08-17T00:18:43.286 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:43.286 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:43.286 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:43.287 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f293c0607b0 msgr2=0x7f293c062c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:6824/32819,v1:172.21.15.153:6825/32819] conn(0x7f293c0607b0 0x7f293c062c10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f293c05a120 msgr2=0x7f293c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f293c05a120 0x7f293c05c5e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 rx=0x7f29501541b0 tx=0x7f2944016000).stop 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29500cb450 msgr2=0x7f2950164e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 --2- 172.21.15.153:0/3988483839 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f29500cb450 0x7f2950164e40 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 rx=0x7f294000c4b0 tx=0x7f2940007b00).stop 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294f7fe700 1 -- 172.21.15.153:0/3988483839 reap_dead start 2023-08-17T00:18:43.288 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 shutdown_connections 2023-08-17T00:18:43.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 >> 172.21.15.153:0/3988483839 conn(0x7f2950062a10 msgr2=0x7f29500aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 shutdown_connections 2023-08-17T00:18:43.289 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.281+0000 7f294ffff700 1 -- 172.21.15.153:0/3988483839 wait complete. 2023-08-17T00:18:43.308 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-17T00:18:43.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.465+0000 7f4f9bc5b700 1 Processor -- start 2023-08-17T00:18:43.474 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9bc5b700 1 -- start start 2023-08-17T00:18:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9bc5b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f94153e90 0x7f4f940c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9bc5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f940641f0 0x7f4f94061fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.476 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9bc5b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940c0330 con 0x7f4f94153ab0 2023-08-17T00:18:43.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9bc5b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f941542f0 con 0x7f4f94153e90 2023-08-17T00:18:43.477 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9bc5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c0ed0 con 0x7f4f940641f0 2023-08-17T00:18:43.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f991f6700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f4f94153e90 0x7f4f940c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f999f7700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4f94153ab0 0x7f4f940c07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:36928/0 (socket says 172.21.15.153:36928) 2023-08-17T00:18:43.479 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f999f7700 1 -- 172.21.15.153:0/2531394038 learned_addr learned my addr 172.21.15.153:0/2531394038 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:43.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f9a1f8700 1 --2- 172.21.15.153:0/2531394038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f940641f0 0x7f4f94061fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f991f6700 1 -- 172.21.15.153:0/2531394038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f940641f0 msgr2=0x7f4f94061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:43.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f991f6700 1 --2- 172.21.15.153:0/2531394038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f940641f0 0x7f4f94061fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f991f6700 1 -- 172.21.15.153:0/2531394038 >> v1:172.21.15.178:6789/0 conn(0x7f4f94153ab0 legacy=0x7f4f940c07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f989f5700 1 -- 172.21.15.153:0/2531394038 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517871585 0 0) 0x7f4f940c0330 con 0x7f4f94153ab0 2023-08-17T00:18:43.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.469+0000 7f4f991f6700 1 -- 172.21.15.153:0/2531394038 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94064660 con 0x7f4f94153e90 2023-08-17T00:18:43.481 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f991f6700 1 --2- 172.21.15.153:0/2531394038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f94153e90 0x7f4f940c59e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f4f84009760 tx=0x7f4f84009060).ready entity=mon.0 client_cookie=a270f526c21f16a server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f989f5700 1 -- 172.21.15.153:0/2531394038 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840090d0 con 0x7f4f94153e90 2023-08-17T00:18:43.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f989f5700 1 -- 172.21.15.153:0/2531394038 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400f510 con 0x7f4f94153e90 2023-08-17T00:18:43.482 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f989f5700 1 -- 172.21.15.153:0/2531394038 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400f890 con 0x7f4f94153e90 2023-08-17T00:18:43.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/2531394038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f94153e90 msgr2=0x7f4f940c59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/2531394038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f94153e90 0x7f4f940c59e0 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 rx=0x7f4f84009760 tx=0x7f4f84009060).stop 2023-08-17T00:18:43.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/2531394038 shutdown_connections 2023-08-17T00:18:43.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/2531394038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f940641f0 0x7f4f94061fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/2531394038 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f94153e90 0x7f4f940c59e0 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/2531394038 >> 172.21.15.153:0/2531394038 conn(0x7f4f940caaa0 msgr2=0x7f4f940caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/2531394038 shutdown_connections 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.473+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/2531394038 wait complete. 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 Processor -- start 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 -- start start 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 0x7f4f9414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f94153ab0 0x7f4f940c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f94153e90 0x7f4f940c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940c9d80 con 0x7f4f940641f0 2023-08-17T00:18:43.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f941511c0 con 0x7f4f94153e90 2023-08-17T00:18:43.486 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9bc5b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f94150160 con 0x7f4f94153ab0 2023-08-17T00:18:43.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 0x7f4f9414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 0x7f4f9414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50558/0 (socket says 172.21.15.153:50558) 2023-08-17T00:18:43.487 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 -- 172.21.15.153:0/643555902 learned_addr learned my addr 172.21.15.153:0/643555902 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f9a1f8700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f94153e90 0x7f4f940c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f991f6700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f94153ab0 0x7f4f940c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 -- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f94153ab0 msgr2=0x7f4f940c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f94153ab0 0x7f4f940c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 -- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f94153e90 msgr2=0x7f4f940c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f94153e90 0x7f4f940c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.488 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.477+0000 7f4f999f7700 1 -- 172.21.15.153:0/643555902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f840092a0 con 0x7f4f940641f0 2023-08-17T00:18:43.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f999f7700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 0x7f4f9414dfe0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f4f9000c510 tx=0x7f4f90007c70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000ce80 con 0x7f4f940641f0 2023-08-17T00:18:43.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f900072e0 con 0x7f4f940641f0 2023-08-17T00:18:43.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f90007660 con 0x7f4f940641f0 2023-08-17T00:18:43.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f94150400 con 0x7f4f940641f0 2023-08-17T00:18:43.489 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f941509c0 con 0x7f4f940641f0 2023-08-17T00:18:43.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.481+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9406b530 con 0x7f4f940641f0 2023-08-17T00:18:43.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.485+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f4f90010070 con 0x7f4f940641f0 2023-08-17T00:18:43.490 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.485+0000 7f4f89ffb700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f7805a150 0x7f4f7805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.485+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f4f90073510 con 0x7f4f940641f0 2023-08-17T00:18:43.491 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.485+0000 7f4f991f6700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f7805a150 0x7f4f7805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.492 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.485+0000 7f4f991f6700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f7805a150 0x7f4f7805c610 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f4f84009fd0 tx=0x7f4f84017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.496 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.489+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f4f90047200 con 0x7f4f940641f0 2023-08-17T00:18:43.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.653+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f94063080 con 0x7f4f7805a150 2023-08-17T00:18:43.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.653+0000 7f4f89ffb700 1 -- 172.21.15.153:0/643555902 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f94063080 con 0x7f4f7805a150 2023-08-17T00:18:43.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f7805a150 msgr2=0x7f4f7805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f7805a150 0x7f4f7805c610 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 rx=0x7f4f84009fd0 tx=0x7f4f84017000).stop 2023-08-17T00:18:43.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 msgr2=0x7f4f9414dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 0x7f4f9414dfe0 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 rx=0x7f4f9000c510 tx=0x7f4f90007c70).stop 2023-08-17T00:18:43.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 shutdown_connections 2023-08-17T00:18:43.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f4f7805a150 0x7f4f7805c610 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f94153e90 0x7f4f940c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f94153ab0 0x7f4f940c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 --2- 172.21.15.153:0/643555902 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f4f940641f0 0x7f4f9414dfe0 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 >> 172.21.15.153:0/643555902 conn(0x7f4f940caaa0 msgr2=0x7f4f940c3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.667 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 shutdown_connections 2023-08-17T00:18:43.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.661+0000 7f4f9bc5b700 1 -- 172.21.15.153:0/643555902 wait complete. 2023-08-17T00:18:43.669 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 1 to deep-scrub 2023-08-17T00:18:43.686 INFO:tasks.ceph:Scrubbing osd.2 2023-08-17T00:18:43.687 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:43.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.845+0000 7ff1e8a5a700 1 Processor -- start 2023-08-17T00:18:43.851 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.845+0000 7ff1e8a5a700 1 -- start start 2023-08-17T00:18:43.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e8a5a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e8a5a700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1e4154b20 0x7ff1e40bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e8a5a700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e4061fa0 con 0x7ff1e4153730 2023-08-17T00:18:43.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e8a5a700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e4066870 con 0x7ff1e4154b20 2023-08-17T00:18:43.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e8a5a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40bc740 con 0x7ff1e4157c00 2023-08-17T00:18:43.859 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1e4154b20 0x7ff1e40bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff1e4154b20 0x7ff1e40bbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:51376/0 (socket says 172.21.15.153:51376) 2023-08-17T00:18:43.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 -- 172.21.15.153:0/4135199137 learned_addr learned my addr 172.21.15.153:0/4135199137 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:43.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e259c700 1 --2- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 -- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 msgr2=0x7ff1e40bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 --2- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 -- 172.21.15.153:0/4135199137 >> v1:172.21.15.178:6789/0 conn(0x7ff1e4153730 legacy=0x7ff1e41574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 -- 172.21.15.153:0/4135199137 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40bca20 con 0x7ff1e4154b20 2023-08-17T00:18:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e359e700 1 --2- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40bbf00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7ff1dc009f20 tx=0x7ff1dc009840).ready entity=mon.1 client_cookie=c12ffa9fe5216741 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e1d9b700 1 -- 172.21.15.153:0/4135199137 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00e070 con 0x7ff1e4154b20 2023-08-17T00:18:43.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e1d9b700 1 -- 172.21.15.153:0/4135199137 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1dc00b9d0 con 0x7ff1e4154b20 2023-08-17T00:18:43.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.849+0000 7ff1e1d9b700 1 -- 172.21.15.153:0/4135199137 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00bd50 con 0x7ff1e4154b20 2023-08-17T00:18:43.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 msgr2=0x7ff1e40bbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 --2- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40bbf00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7ff1dc009f20 tx=0x7ff1dc009840).stop 2023-08-17T00:18:43.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/4135199137 shutdown_connections 2023-08-17T00:18:43.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 --2- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40bbf00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 --2- 172.21.15.153:0/4135199137 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/4135199137 >> 172.21.15.153:0/4135199137 conn(0x7ff1e40c6ee0 msgr2=0x7ff1e40c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/4135199137 shutdown_connections 2023-08-17T00:18:43.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/4135199137 wait complete. 2023-08-17T00:18:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 Processor -- start 2023-08-17T00:18:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.853+0000 7ff1e8a5a700 1 -- start start 2023-08-17T00:18:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e4153730 0x7ff1e41504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40ac4d0 con 0x7ff1e4153730 2023-08-17T00:18:43.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40aadc0 con 0x7ff1e4154b20 2023-08-17T00:18:43.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40aa220 con 0x7ff1e4157c00 2023-08-17T00:18:43.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e4153730 0x7ff1e41504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e4153730 0x7ff1e41504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50574/0 (socket says 172.21.15.153:50574) 2023-08-17T00:18:43.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 -- 172.21.15.153:0/2499291286 learned_addr learned my addr 172.21.15.153:0/2499291286 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:43.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e259c700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e359e700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 -- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 msgr2=0x7ff1e40abfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1e4157c00 0x7ff1e40abfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.873 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 -- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 msgr2=0x7ff1e40abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 -- 172.21.15.153:0/2499291286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1dc009ae0 con 0x7ff1e4153730 2023-08-17T00:18:43.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e259c700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1e4154b20 0x7ff1e40abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:43.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e2d9d700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e4153730 0x7ff1e41504b0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7ff1d400c470 tx=0x7ff1d4007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4007020 con 0x7ff1e4153730 2023-08-17T00:18:43.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1d4007180 con 0x7ff1e4153730 2023-08-17T00:18:43.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e40aa490 con 0x7ff1e4153730 2023-08-17T00:18:43.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1d4007520 con 0x7ff1e4153730 2023-08-17T00:18:43.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.857+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e40aaa50 con 0x7ff1e4153730 2023-08-17T00:18:43.876 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.861+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff1e4046dd0 con 0x7ff1e4153730 2023-08-17T00:18:43.877 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.861+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7ff1d4010070 con 0x7ff1e4153730 2023-08-17T00:18:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.861+0000 7ff1caffd700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1d005a180 0x7ff1d005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.861+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7ff1d4072ff0 con 0x7ff1e4153730 2023-08-17T00:18:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.861+0000 7ff1caffd700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7ff1d0060810 0x7ff1d0062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 --> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff1d00632f0 con 0x7ff1d0060810 2023-08-17T00:18:43.878 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1d4075590 con 0x7ff1e4153730 2023-08-17T00:18:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1e259c700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1d005a180 0x7ff1d005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1e359e700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7ff1d0060810 0x7ff1d0062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1e259c700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1d005a180 0x7ff1d005c640 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff1e4069730 tx=0x7ff1d8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1e359e700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7ff1d0060810 0x7ff1d0062c70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:43.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.865+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== osd.2 v2:172.21.15.153:6803/32817 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7ff1d00632f0 con 0x7ff1d0060810 2023-08-17T00:18:43.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.881+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 --> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff1e40bcd00 con 0x7ff1d0060810 2023-08-17T00:18:43.889 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.881+0000 7ff1caffd700 1 -- 172.21.15.153:0/2499291286 <== osd.2 v2:172.21.15.153:6803/32817 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff1e40bcd00 con 0x7ff1d0060810 2023-08-17T00:18:43.890 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:43.890 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:43.890 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:43.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7ff1d0060810 msgr2=0x7ff1d0062c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:6803/32817,v1:172.21.15.153:6806/32817] conn(0x7ff1d0060810 0x7ff1d0062c70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:43.891 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1d005a180 msgr2=0x7ff1d005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7ff1d005a180 0x7ff1d005c640 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7ff1e4069730 tx=0x7ff1d8009060).stop 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e4153730 msgr2=0x7ff1e41504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 --2- 172.21.15.153:0/2499291286 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7ff1e4153730 0x7ff1e41504b0 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 rx=0x7ff1d400c470 tx=0x7ff1d4007e00).stop 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e359e700 1 -- 172.21.15.153:0/2499291286 reap_dead start 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 shutdown_connections 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 >> 172.21.15.153:0/2499291286 conn(0x7ff1e40c6ee0 msgr2=0x7ff1e4062330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:43.892 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 shutdown_connections 2023-08-17T00:18:43.893 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:43.885+0000 7ff1e8a5a700 1 -- 172.21.15.153:0/2499291286 wait complete. 2023-08-17T00:18:43.909 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-17T00:18:44.067 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.061+0000 7f795b59e700 1 Processor -- start 2023-08-17T00:18:44.068 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.061+0000 7f795b59e700 1 -- start start 2023-08-17T00:18:44.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795b59e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f795c0a8df0 0x7f795c0c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795b59e700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f795c0aa6e0 0x7f795c068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795b59e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c1585a0 con 0x7f795c068820 2023-08-17T00:18:44.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795b59e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c066400 con 0x7f795c0a8df0 2023-08-17T00:18:44.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795b59e700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c069170 con 0x7f795c0aa6e0 2023-08-17T00:18:44.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f7959d9b700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f795c068820 0x7f795c061fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43886/0 (socket says 172.21.15.153:43886) 2023-08-17T00:18:44.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f7959d9b700 1 -- 172.21.15.153:0/3326241223 learned_addr learned my addr 172.21.15.153:0/3326241223 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:44.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795a59c700 1 --2- 172.21.15.153:0/3326241223 >> v2:172.21.15.153:3300/0 conn(0x7f795c0a8df0 0x7f795c0c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795ad9d700 1 --2- 172.21.15.153:0/3326241223 >> v2:172.21.15.178:3300/0 conn(0x7f795c0aa6e0 0x7f795c068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795959a700 1 -- 172.21.15.153:0/3326241223 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828606571 0 0) 0x7f795c1585a0 con 0x7f795c068820 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795959a700 1 -- 172.21.15.153:0/3326241223 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79440033f0 con 0x7f795c068820 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795a59c700 1 -- 172.21.15.153:0/3326241223 >> v2:172.21.15.178:3300/0 conn(0x7f795c0aa6e0 msgr2=0x7f795c068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795a59c700 1 --2- 172.21.15.153:0/3326241223 >> v2:172.21.15.178:3300/0 conn(0x7f795c0aa6e0 0x7f795c068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795a59c700 1 -- 172.21.15.153:0/3326241223 >> v1:172.21.15.153:6789/0 conn(0x7f795c068820 legacy=0x7f795c061fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795a59c700 1 -- 172.21.15.153:0/3326241223 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c0b9d30 con 0x7f795c0a8df0 2023-08-17T00:18:44.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.065+0000 7f795a59c700 1 --2- 172.21.15.153:0/3326241223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c0a8df0 0x7f795c0c1490 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7f795c0632a0 tx=0x7f794c006f40).ready entity=mon.0 client_cookie=f52699e21deaeeed server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795959a700 1 -- 172.21.15.153:0/3326241223 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c005880 con 0x7f795c0a8df0 2023-08-17T00:18:44.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795959a700 1 -- 172.21.15.153:0/3326241223 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c0059e0 con 0x7f795c0a8df0 2023-08-17T00:18:44.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795959a700 1 -- 172.21.15.153:0/3326241223 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c005d60 con 0x7f795c0a8df0 2023-08-17T00:18:44.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 -- 172.21.15.153:0/3326241223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c0a8df0 msgr2=0x7f795c0c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 --2- 172.21.15.153:0/3326241223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c0a8df0 0x7f795c0c1490 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 rx=0x7f795c0632a0 tx=0x7f794c006f40).stop 2023-08-17T00:18:44.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 -- 172.21.15.153:0/3326241223 shutdown_connections 2023-08-17T00:18:44.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 --2- 172.21.15.153:0/3326241223 >> v2:172.21.15.178:3300/0 conn(0x7f795c0aa6e0 0x7f795c068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 --2- 172.21.15.153:0/3326241223 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c0a8df0 0x7f795c0c1490 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 -- 172.21.15.153:0/3326241223 >> 172.21.15.153:0/3326241223 conn(0x7f795c0c6620 msgr2=0x7f795c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:44.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 -- 172.21.15.153:0/3326241223 shutdown_connections 2023-08-17T00:18:44.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 -- 172.21.15.153:0/3326241223 wait complete. 2023-08-17T00:18:44.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 Processor -- start 2023-08-17T00:18:44.078 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.069+0000 7f795b59e700 1 -- start start 2023-08-17T00:18:44.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 0x7f795c16c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795c0a8df0 0x7f795c0bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f795c0aa6e0 0x7f795c0bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0bfad0 con 0x7f795c068820 2023-08-17T00:18:44.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c16a110 con 0x7f795c0aa6e0 2023-08-17T00:18:44.079 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c169b00 con 0x7f795c0a8df0 2023-08-17T00:18:44.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 0x7f795c16c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 0x7f795c16c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50600/0 (socket says 172.21.15.153:50600) 2023-08-17T00:18:44.080 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 -- 172.21.15.153:0/4205790440 learned_addr learned my addr 172.21.15.153:0/4205790440 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795ad9d700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f795c0aa6e0 0x7f795c0bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f7959d9b700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795c0a8df0 0x7f795c0bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 -- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795c0a8df0 msgr2=0x7f795c0bf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795c0a8df0 0x7f795c0bf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 -- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f795c0aa6e0 msgr2=0x7f795c0bf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f795c0aa6e0 0x7f795c0bf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 -- 172.21.15.153:0/4205790440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009250 con 0x7f795c068820 2023-08-17T00:18:44.082 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795a59c700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 0x7f795c16c000 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7f794c006f80 tx=0x7f794c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0067f0 con 0x7f795c068820 2023-08-17T00:18:44.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c00d6b0 con 0x7f795c068820 2023-08-17T00:18:44.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00da30 con 0x7f795c068820 2023-08-17T00:18:44.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.073+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0bfd10 con 0x7f795c068820 2023-08-17T00:18:44.083 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.077+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c0bfff0 con 0x7f795c068820 2023-08-17T00:18:44.084 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.077+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c06b4c0 con 0x7f795c068820 2023-08-17T00:18:44.086 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.077+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f794c025030 con 0x7f795c068820 2023-08-17T00:18:44.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.081+0000 7f794a7fc700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f793c05a150 0x7f793c05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.087 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.081+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f794c074fe0 con 0x7f795c068820 2023-08-17T00:18:44.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.081+0000 7f7959d9b700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f793c05a150 0x7f793c05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.088 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.081+0000 7f7959d9b700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f793c05a150 0x7f793c05c610 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7950007fd0 tx=0x7f7950009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.093 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.085+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f794c0a38f0 con 0x7f795c068820 2023-08-17T00:18:44.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.245+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f795c16a250 con 0x7f793c05a150 2023-08-17T00:18:44.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.245+0000 7f794a7fc700 1 -- 172.21.15.153:0/4205790440 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7950001d90 con 0x7f793c05a150 2023-08-17T00:18:44.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f793c05a150 msgr2=0x7f793c05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f793c05a150 0x7f793c05c610 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 rx=0x7f7950007fd0 tx=0x7f7950009040).stop 2023-08-17T00:18:44.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 msgr2=0x7f795c16c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 0x7f795c16c000 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 rx=0x7f794c006f80 tx=0x7f794c015000).stop 2023-08-17T00:18:44.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 shutdown_connections 2023-08-17T00:18:44.257 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f793c05a150 0x7f793c05c610 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f795c0aa6e0 0x7f795c0bf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795c0a8df0 0x7f795c0bf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 --2- 172.21.15.153:0/4205790440 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f795c068820 0x7f795c16c000 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 >> 172.21.15.153:0/4205790440 conn(0x7f795c0c6620 msgr2=0x7f795c157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:44.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 shutdown_connections 2023-08-17T00:18:44.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.249+0000 7f795b59e700 1 -- 172.21.15.153:0/4205790440 wait complete. 2023-08-17T00:18:44.259 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 2 to deep-scrub 2023-08-17T00:18:44.275 INFO:tasks.ceph:Scrubbing osd.3 2023-08-17T00:18:44.276 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:44.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.433+0000 7f57e4a8f700 1 Processor -- start 2023-08-17T00:18:44.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.433+0000 7f57e4a8f700 1 -- start start 2023-08-17T00:18:44.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57e4a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e0157be0 0x7f57e0157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57e4a8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e00bff60 con 0x7f57e00c57d0 2023-08-17T00:18:44.444 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57e4a8f700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e0064130 con 0x7f57e00acd50 2023-08-17T00:18:44.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57e4a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0064410 con 0x7f57e0157be0 2023-08-17T00:18:44.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57dffff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f57e00c57d0 0x7f57e00c03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:43898/0 (socket says 172.21.15.153:43898) 2023-08-17T00:18:44.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57dffff700 1 -- 172.21.15.153:0/1174672238 learned_addr learned my addr 172.21.15.153:0/1174672238 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:44.445 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57df7fe700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e0157be0 0x7f57e0157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195622470 0 0) 0x7f57e00bff60 con 0x7f57e00c57d0 2023-08-17T00:18:44.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c80033f0 con 0x7f57e00c57d0 2023-08-17T00:18:44.446 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327181333 0 0) 0x7f57e0064130 con 0x7f57e00acd50 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e00bff60 con 0x7f57e00acd50 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.0 v1:172.21.15.153:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 472138370 0 0) 0x7f57c80033f0 con 0x7f57e00c57d0 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e0157be0 msgr2=0x7f57e0157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e0157be0 0x7f57e0157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 >> v1:172.21.15.178:6789/0 conn(0x7f57e00acd50 legacy=0x7f57e00c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 --> v1:172.21.15.153:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00bf910 con 0x7f57e00c57d0 2023-08-17T00:18:44.447 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.0 v1:172.21.15.153:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1555451980 0 0) 0x7f57d80017f0 con 0x7f57e00c57d0 2023-08-17T00:18:44.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 >> v1:172.21.15.153:6789/0 conn(0x7f57e00c57d0 legacy=0x7f57e00c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c8004b00 0x7f57c8004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c8003630 0x7f57c8003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8003fa0 0x7f57c800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c800bed0 con 0x7f57c8003fa0 2023-08-17T00:18:44.448 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c800c040 con 0x7f57c8004b00 2023-08-17T00:18:44.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c800c200 con 0x7f57c8003630 2023-08-17T00:18:44.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.437+0000 7f57df7fe700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e0157be0 0x7f57e0157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:44.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57dffff700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8003fa0 0x7f57c800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57deffd700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c8003630 0x7f57c8003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c8004b00 0x7f57c8004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.450 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 -- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c8003630 msgr2=0x7f57c8003ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:44.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c8003630 0x7f57c8003ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 -- 172.21.15.153:0/1174672238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8003fa0 msgr2=0x7f57c800b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:44.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8003fa0 0x7f57c800b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 -- 172.21.15.153:0/1174672238 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c80033f0 con 0x7f57c8004b00 2023-08-17T00:18:44.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57df7fe700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c8004b00 0x7f57c8004f00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f57e005f9b0 tx=0x7f57d0006f40).ready entity=mon.1 client_cookie=fc70ae53a1cb355c server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0005880 con 0x7f57c8004b00 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d00059e0 con 0x7f57c8004b00 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57de7fc700 1 -- 172.21.15.153:0/1174672238 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d0005d60 con 0x7f57c8004b00 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57e4a8f700 1 -- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c8004b00 msgr2=0x7f57c8004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57e4a8f700 1 --2- 172.21.15.153:0/1174672238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c8004b00 0x7f57c8004f00 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 rx=0x7f57e005f9b0 tx=0x7f57d0006f40).stop 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57dffff700 1 -- 172.21.15.153:0/1174672238 reap_dead start 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57e4a8f700 1 -- 172.21.15.153:0/1174672238 shutdown_connections 2023-08-17T00:18:44.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57e4a8f700 1 -- 172.21.15.153:0/1174672238 >> 172.21.15.153:0/1174672238 conn(0x7f57e0062a10 msgr2=0x7f57e00ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:44.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57e4a8f700 1 -- 172.21.15.153:0/1174672238 shutdown_connections 2023-08-17T00:18:44.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.441+0000 7f57e4a8f700 1 -- 172.21.15.153:0/1174672238 wait complete. 2023-08-17T00:18:44.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.445+0000 7f57e4a8f700 1 Processor -- start 2023-08-17T00:18:44.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.445+0000 7f57e4a8f700 1 -- start start 2023-08-17T00:18:44.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.445+0000 7f57e4a8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8004b00 0x7f57e01526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c2ed0 0x7f57e00c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e00ca750 0x7f57e00cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00667a0 con 0x7f57c8004b00 2023-08-17T00:18:44.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00c3350 con 0x7f57e00ca750 2023-08-17T00:18:44.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00c2680 con 0x7f57e00c2ed0 2023-08-17T00:18:44.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8004b00 0x7f57e01526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8004b00 0x7f57e01526d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50630/0 (socket says 172.21.15.153:50630) 2023-08-17T00:18:44.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 -- 172.21.15.153:0/717085220 learned_addr learned my addr 172.21.15.153:0/717085220 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57deffd700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c2ed0 0x7f57e00c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57dffff700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e00ca750 0x7f57e00cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 -- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c2ed0 msgr2=0x7f57e00c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57e00c2ed0 0x7f57e00c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 -- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e00ca750 msgr2=0x7f57e00cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57e00ca750 0x7f57e00cabb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.457 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 -- 172.21.15.153:0/717085220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00cb0a0 con 0x7f57c8004b00 2023-08-17T00:18:44.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57df7fe700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8004b00 0x7f57e01526d0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f57c800c1d0 tx=0x7f57d0019000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000e820 con 0x7f57c8004b00 2023-08-17T00:18:44.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d000e980 con 0x7f57c8004b00 2023-08-17T00:18:44.458 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d000ed00 con 0x7f57c8004b00 2023-08-17T00:18:44.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e00c35b0 con 0x7f57c8004b00 2023-08-17T00:18:44.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e00c3b70 con 0x7f57c8004b00 2023-08-17T00:18:44.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.449+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57e0046dd0 con 0x7f57c8004b00 2023-08-17T00:18:44.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f57d0018020 con 0x7f57c8004b00 2023-08-17T00:18:44.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57c77fe700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57cc05a150 0x7f57cc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f57d00757c0 con 0x7f57c8004b00 2023-08-17T00:18:44.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57c77fe700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7f57cc0607e0 0x7f57cc062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 --> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57cc0632c0 con 0x7f57cc0607e0 2023-08-17T00:18:44.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57d0077d20 con 0x7f57c8004b00 2023-08-17T00:18:44.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57deffd700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57cc05a150 0x7f57cc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.453+0000 7f57dffff700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7f57cc0607e0 0x7f57cc062c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.457+0000 7f57dffff700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7f57cc0607e0 0x7f57cc062c40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.457+0000 7f57deffd700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57cc05a150 0x7f57cc05c610 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f57d4000f60 tx=0x7f57d4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.457+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== osd.3 v2:172.21.15.153:6801/32816 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f57cc0632c0 con 0x7f57cc0607e0 2023-08-17T00:18:44.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 --> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57e00bfbf0 con 0x7f57cc0607e0 2023-08-17T00:18:44.480 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57c77fe700 1 -- 172.21.15.153:0/717085220 <== osd.3 v2:172.21.15.153:6801/32816 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f57e00bfbf0 con 0x7f57cc0607e0 2023-08-17T00:18:44.481 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:44.481 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:44.482 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:44.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7f57cc0607e0 msgr2=0x7f57cc062c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:6801/32816,v1:172.21.15.153:6804/32816] conn(0x7f57cc0607e0 0x7f57cc062c40 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57cc05a150 msgr2=0x7f57cc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.483 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f57cc05a150 0x7f57cc05c610 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f57d4000f60 tx=0x7f57d4009040).stop 2023-08-17T00:18:44.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8004b00 msgr2=0x7f57e01526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 --2- 172.21.15.153:0/717085220 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f57c8004b00 0x7f57e01526d0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 rx=0x7f57c800c1d0 tx=0x7f57d0019000).stop 2023-08-17T00:18:44.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57dffff700 1 -- 172.21.15.153:0/717085220 reap_dead start 2023-08-17T00:18:44.484 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 shutdown_connections 2023-08-17T00:18:44.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 >> 172.21.15.153:0/717085220 conn(0x7f57e0062a10 msgr2=0x7f57e00af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:44.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 shutdown_connections 2023-08-17T00:18:44.485 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.473+0000 7f57e4a8f700 1 -- 172.21.15.153:0/717085220 wait complete. 2023-08-17T00:18:44.499 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-17T00:18:44.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 Processor -- start 2023-08-17T00:18:44.654 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 -- start start 2023-08-17T00:18:44.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab300689c0 0x7fab30068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.656 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab300c0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab30151530 0x7fab301519c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab30065da0 con 0x7fab300689c0 2023-08-17T00:18:44.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab30155c60 con 0x7fab30151530 2023-08-17T00:18:44.657 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab34907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab30156550 con 0x7fab301560f0 2023-08-17T00:18:44.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab2f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab300689c0 0x7fab30068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab2f7fe700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fab300689c0 0x7fab30068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50642/0 (socket says 172.21.15.153:50642) 2023-08-17T00:18:44.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab2f7fe700 1 -- 172.21.15.153:0/1382620974 learned_addr learned my addr 172.21.15.153:0/1382620974 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:44.658 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab26ffd700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab300c0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.649+0000 7fab2ffff700 1 --2- 172.21.15.153:0/1382620974 >> v2:172.21.15.178:3300/0 conn(0x7fab30151530 0x7fab301519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2f7fe700 1 -- 172.21.15.153:0/1382620974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 msgr2=0x7fab300c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2f7fe700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab300c0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2f7fe700 1 -- 172.21.15.153:0/1382620974 >> v2:172.21.15.178:3300/0 conn(0x7fab30151530 msgr2=0x7fab301519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2f7fe700 1 --2- 172.21.15.153:0/1382620974 >> v2:172.21.15.178:3300/0 conn(0x7fab30151530 0x7fab301519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2f7fe700 1 -- 172.21.15.153:0/1382620974 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab30065ff0 con 0x7fab300689c0 2023-08-17T00:18:44.659 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab26ffd700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab300c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:44.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2f7fe700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab300689c0 0x7fab30068da0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7fab30063720 tx=0x7fab180090f0).ready entity=mon.0 client_cookie=fc1a3ad34bb3105e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.660 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2effd700 1 -- 172.21.15.153:0/1382620974 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18009160 con 0x7fab300689c0 2023-08-17T00:18:44.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2effd700 1 -- 172.21.15.153:0/1382620974 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1800b520 con 0x7fab300689c0 2023-08-17T00:18:44.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab2effd700 1 -- 172.21.15.153:0/1382620974 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1800b8c0 con 0x7fab300689c0 2023-08-17T00:18:44.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 -- 172.21.15.153:0/1382620974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab300689c0 msgr2=0x7fab30068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab300689c0 0x7fab30068da0 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 rx=0x7fab30063720 tx=0x7fab180090f0).stop 2023-08-17T00:18:44.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 -- 172.21.15.153:0/1382620974 shutdown_connections 2023-08-17T00:18:44.661 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab300c0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 --2- 172.21.15.153:0/1382620974 >> v2:172.21.15.178:3300/0 conn(0x7fab30151530 0x7fab301519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 --2- 172.21.15.153:0/1382620974 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab300689c0 0x7fab30068da0 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 -- 172.21.15.153:0/1382620974 >> 172.21.15.153:0/1382620974 conn(0x7fab300c6620 msgr2=0x7fab300c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 -- 172.21.15.153:0/1382620974 shutdown_connections 2023-08-17T00:18:44.662 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.653+0000 7fab34907700 1 -- 172.21.15.153:0/1382620974 wait complete. 2023-08-17T00:18:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.657+0000 7fab34907700 1 Processor -- start 2023-08-17T00:18:44.663 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.657+0000 7fab34907700 1 -- start start 2023-08-17T00:18:44.665 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab300689c0 0x7fab300baf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 0x7fab300bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab30164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab300bc110 con 0x7fab30151530 2023-08-17T00:18:44.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab300bb500 con 0x7fab300689c0 2023-08-17T00:18:44.666 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab300bb7e0 con 0x7fab301560f0 2023-08-17T00:18:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 0x7fab300bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 0x7fab300bc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:50644/0 (socket says 172.21.15.153:50644) 2023-08-17T00:18:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 -- 172.21.15.153:0/2574405171 learned_addr learned my addr 172.21.15.153:0/2574405171 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab2f7fe700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab300689c0 0x7fab300baf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.668 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab2ffff700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab30164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 -- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 msgr2=0x7fab30164b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab30164b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 -- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab300689c0 msgr2=0x7fab300baf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab300689c0 0x7fab300baf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 -- 172.21.15.153:0/2574405171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab18009310 con 0x7fab30151530 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab26ffd700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 0x7fab300bc5a0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7fab2000d1d0 tx=0x7fab20009a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000de70 con 0x7fab30151530 2023-08-17T00:18:44.669 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000f040 con 0x7fab30151530 2023-08-17T00:18:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20013600 con 0x7fab30151530 2023-08-17T00:18:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab300bbac0 con 0x7fab30151530 2023-08-17T00:18:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab30165030 con 0x7fab30151530 2023-08-17T00:18:44.670 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.661+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3006b4c0 con 0x7fab30151530 2023-08-17T00:18:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.665+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fab200139f0 con 0x7fab30151530 2023-08-17T00:18:44.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.665+0000 7fab27fff700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab1005a150 0x7fab1005c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:44.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.665+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fab20074810 con 0x7fab30151530 2023-08-17T00:18:44.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.665+0000 7fab2f7fe700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab1005a150 0x7fab1005c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:44.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.669+0000 7fab2f7fe700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab1005a150 0x7fab1005c610 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fab300aa2d0 tx=0x7fab18015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:44.676 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.669+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fab20048560 con 0x7fab30151530 2023-08-17T00:18:44.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.829+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fab300662d0 con 0x7fab1005a150 2023-08-17T00:18:44.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab27fff700 1 -- 172.21.15.153:0/2574405171 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fab300662d0 con 0x7fab1005a150 2023-08-17T00:18:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab1005a150 msgr2=0x7fab1005c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab1005a150 0x7fab1005c610 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 rx=0x7fab300aa2d0 tx=0x7fab18015000).stop 2023-08-17T00:18:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 msgr2=0x7fab300bc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 0x7fab300bc5a0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 rx=0x7fab2000d1d0 tx=0x7fab20009a90).stop 2023-08-17T00:18:44.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 shutdown_connections 2023-08-17T00:18:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fab1005a150 0x7fab1005c610 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab301560f0 0x7fab30164b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fab30151530 0x7fab300bc5a0 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 --2- 172.21.15.153:0/2574405171 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab300689c0 0x7fab300baf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:44.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 >> 172.21.15.153:0/2574405171 conn(0x7fab300c6620 msgr2=0x7fab30061fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:44.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 shutdown_connections 2023-08-17T00:18:44.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:44.833+0000 7fab34907700 1 -- 172.21.15.153:0/2574405171 wait complete. 2023-08-17T00:18:44.844 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 3 to deep-scrub 2023-08-17T00:18:44.862 INFO:tasks.ceph:Scrubbing osd.4 2023-08-17T00:18:44.862 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:45.023 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.017+0000 7f3c768b9700 1 Processor -- start 2023-08-17T00:18:45.024 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.017+0000 7f3c768b9700 1 -- start start 2023-08-17T00:18:45.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c768b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c700a9cd0 0x7f3c70153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c768b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c701543b0 0x7f3c700c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c768b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c700c5c40 0x7f3c701574f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c768b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700c6be0 con 0x7f3c700a9cd0 2023-08-17T00:18:45.028 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c768b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700bfc80 con 0x7f3c700c5c40 2023-08-17T00:18:45.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c768b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700c60d0 con 0x7f3c701543b0 2023-08-17T00:18:45.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c700a9cd0 0x7f3c70153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f3c700a9cd0 0x7f3c70153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40694/0 (socket says 172.21.15.153:40694) 2023-08-17T00:18:45.029 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 -- 172.21.15.153:0/3801703820 learned_addr learned my addr 172.21.15.153:0/3801703820 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.033 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c750b6700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c701543b0 0x7f3c700c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c760b8700 1 --2- 172.21.15.153:0/3801703820 >> v2:172.21.15.178:3300/0 conn(0x7f3c700c5c40 0x7f3c701574f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 -- 172.21.15.153:0/3801703820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c701543b0 msgr2=0x7f3c700c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c701543b0 0x7f3c700c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.034 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 -- 172.21.15.153:0/3801703820 >> v2:172.21.15.178:3300/0 conn(0x7f3c700c5c40 msgr2=0x7f3c701574f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:45.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 --2- 172.21.15.153:0/3801703820 >> v2:172.21.15.178:3300/0 conn(0x7f3c700c5c40 0x7f3c701574f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 -- 172.21.15.153:0/3801703820 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700aa0b0 con 0x7f3c700a9cd0 2023-08-17T00:18:45.035 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c760b8700 1 --2- 172.21.15.153:0/3801703820 >> v2:172.21.15.178:3300/0 conn(0x7f3c700c5c40 0x7f3c701574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:45.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c750b6700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c701543b0 0x7f3c700c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:45.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.021+0000 7f3c758b7700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c700a9cd0 0x7f3c70153ec0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f3c7006bc30 tx=0x7f3c6c0090f0).ready entity=mon.0 client_cookie=d13d1a514024b72d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.036 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c748b5700 1 -- 172.21.15.153:0/3801703820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00b600 con 0x7f3c700a9cd0 2023-08-17T00:18:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c748b5700 1 -- 172.21.15.153:0/3801703820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00b760 con 0x7f3c700a9cd0 2023-08-17T00:18:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c748b5700 1 -- 172.21.15.153:0/3801703820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c00bae0 con 0x7f3c700a9cd0 2023-08-17T00:18:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 -- 172.21.15.153:0/3801703820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c700a9cd0 msgr2=0x7f3c70153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.037 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c700a9cd0 0x7f3c70153ec0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 rx=0x7f3c7006bc30 tx=0x7f3c6c0090f0).stop 2023-08-17T00:18:45.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 -- 172.21.15.153:0/3801703820 shutdown_connections 2023-08-17T00:18:45.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c701543b0 0x7f3c700c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 --2- 172.21.15.153:0/3801703820 >> v2:172.21.15.178:3300/0 conn(0x7f3c700c5c40 0x7f3c701574f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.038 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 --2- 172.21.15.153:0/3801703820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c700a9cd0 0x7f3c70153ec0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 -- 172.21.15.153:0/3801703820 >> 172.21.15.153:0/3801703820 conn(0x7f3c70062a70 msgr2=0x7f3c700ca810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 -- 172.21.15.153:0/3801703820 shutdown_connections 2023-08-17T00:18:45.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 -- 172.21.15.153:0/3801703820 wait complete. 2023-08-17T00:18:45.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 Processor -- start 2023-08-17T00:18:45.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.025+0000 7f3c768b9700 1 -- start start 2023-08-17T00:18:45.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c700a9cd0 0x7f3c700ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c700c5c40 0x7f3c700adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c701543b0 0x7f3c700aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700cb440 con 0x7f3c701543b0 2023-08-17T00:18:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700caec0 con 0x7f3c700a9cd0 2023-08-17T00:18:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700c9930 con 0x7f3c700c5c40 2023-08-17T00:18:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c701543b0 0x7f3c700aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.045 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c701543b0 0x7f3c700aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40702/0 (socket says 172.21.15.153:40702) 2023-08-17T00:18:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 -- 172.21.15.153:0/68530494 learned_addr learned my addr 172.21.15.153:0/68530494 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c758b7700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c700a9cd0 0x7f3c700ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c750b6700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c700c5c40 0x7f3c700adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.046 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 -- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c700c5c40 msgr2=0x7f3c700adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c700c5c40 0x7f3c700adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 -- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c700a9cd0 msgr2=0x7f3c700ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.047 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c700a9cd0 0x7f3c700ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 -- 172.21.15.153:0/68530494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c009370 con 0x7f3c701543b0 2023-08-17T00:18:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c750b6700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c700c5c40 0x7f3c700adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:45.048 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c758b7700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c700a9cd0 0x7f3c700ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c760b8700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c701543b0 0x7f3c700aad30 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f3c68009fc0 tx=0x7f3c680099b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800dd40 con 0x7f3c701543b0 2023-08-17T00:18:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6800f040 con 0x7f3c701543b0 2023-08-17T00:18:45.049 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c700c9c10 con 0x7f3c701543b0 2023-08-17T00:18:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800dea0 con 0x7f3c701543b0 2023-08-17T00:18:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.029+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c700ca1d0 con 0x7f3c701543b0 2023-08-17T00:18:45.050 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.033+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c70046dd0 con 0x7f3c701543b0 2023-08-17T00:18:45.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.033+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f3c68013890 con 0x7f3c701543b0 2023-08-17T00:18:45.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.033+0000 7f3c65ffb700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3c5405a150 0x7f3c5405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.033+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f3c680746a0 con 0x7f3c701543b0 2023-08-17T00:18:45.051 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c65ffb700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f3c540607e0 0x7f3c54062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 --> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c540632c0 con 0x7f3c540607e0 2023-08-17T00:18:45.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c68076d10 con 0x7f3c701543b0 2023-08-17T00:18:45.052 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c758b7700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3c5405a150 0x7f3c5405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c750b6700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f3c540607e0 0x7f3c54062c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c750b6700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f3c540607e0 0x7f3c54062c40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c758b7700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3c5405a150 0x7f3c5405c610 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f3c6c009130 tx=0x7f3c6c017000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.037+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== osd.4 v2:172.21.15.178:6800/33066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f3c540632c0 con 0x7f3c540607e0 2023-08-17T00:18:45.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 --> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c70064070 con 0x7f3c540607e0 2023-08-17T00:18:45.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c65ffb700 1 -- 172.21.15.153:0/68530494 <== osd.4 v2:172.21.15.178:6800/33066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3c70064070 con 0x7f3c540607e0 2023-08-17T00:18:45.063 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:45.063 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:45.063 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:45.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f3c540607e0 msgr2=0x7f3c54062c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6800/33066,v1:172.21.15.178:6801/33066] conn(0x7f3c540607e0 0x7f3c54062c40 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3c5405a150 msgr2=0x7f3c5405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f3c5405a150 0x7f3c5405c610 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f3c6c009130 tx=0x7f3c6c017000).stop 2023-08-17T00:18:45.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c701543b0 msgr2=0x7f3c700aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 --2- 172.21.15.153:0/68530494 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f3c701543b0 0x7f3c700aad30 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 rx=0x7f3c68009fc0 tx=0x7f3c680099b0).stop 2023-08-17T00:18:45.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c760b8700 1 -- 172.21.15.153:0/68530494 reap_dead start 2023-08-17T00:18:45.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 shutdown_connections 2023-08-17T00:18:45.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 >> 172.21.15.153:0/68530494 conn(0x7f3c70062a70 msgr2=0x7f3c700c0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.065 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 shutdown_connections 2023-08-17T00:18:45.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.057+0000 7f3c768b9700 1 -- 172.21.15.153:0/68530494 wait complete. 2023-08-17T00:18:45.083 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-17T00:18:45.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.237+0000 7fef063b9700 1 Processor -- start 2023-08-17T00:18:45.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.241+0000 7fef063b9700 1 -- start start 2023-08-17T00:18:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.241+0000 7fef063b9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef00068820 0x7fef00068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.241+0000 7fef063b9700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef000a96d0 0x7fef000a9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.241+0000 7fef063b9700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef001585a0 con 0x7fef000a8df0 2023-08-17T00:18:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.241+0000 7fef063b9700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef000c1ba0 con 0x7fef000a96d0 2023-08-17T00:18:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.241+0000 7fef063b9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef00066400 con 0x7fef00068820 2023-08-17T00:18:45.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef000a96d0 0x7fef000a9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fef000a96d0 0x7fef000a9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40714/0 (socket says 172.21.15.153:40714) 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 -- 172.21.15.153:0/1558432003 learned_addr learned my addr 172.21.15.153:0/1558432003 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef04bb6700 1 --2- 172.21.15.153:0/1558432003 >> v2:172.21.15.178:3300/0 conn(0x7fef00068820 0x7fef00068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 -- 172.21.15.153:0/1558432003 >> v2:172.21.15.178:3300/0 conn(0x7fef00068820 msgr2=0x7fef00068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 --2- 172.21.15.153:0/1558432003 >> v2:172.21.15.178:3300/0 conn(0x7fef00068820 0x7fef00068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 -- 172.21.15.153:0/1558432003 >> v1:172.21.15.178:6789/0 conn(0x7fef000a8df0 legacy=0x7fef000c1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 -- 172.21.15.153:0/1558432003 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef00069170 con 0x7fef000a96d0 2023-08-17T00:18:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef05bb8700 1 --2- 172.21.15.153:0/1558432003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000a96d0 0x7fef000a9b60 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7fef000c2ef0 tx=0x7feef8009840).ready entity=mon.0 client_cookie=b25ffe38aed929fd server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.252 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7feef7fff700 1 -- 172.21.15.153:0/1558432003 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800e070 con 0x7fef000a96d0 2023-08-17T00:18:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7feef7fff700 1 -- 172.21.15.153:0/1558432003 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef800ba20 con 0x7fef000a96d0 2023-08-17T00:18:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7feef7fff700 1 -- 172.21.15.153:0/1558432003 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef800bda0 con 0x7fef000a96d0 2023-08-17T00:18:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 -- 172.21.15.153:0/1558432003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000a96d0 msgr2=0x7fef000a9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.253 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 --2- 172.21.15.153:0/1558432003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000a96d0 0x7fef000a9b60 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 rx=0x7fef000c2ef0 tx=0x7feef8009840).stop 2023-08-17T00:18:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 -- 172.21.15.153:0/1558432003 shutdown_connections 2023-08-17T00:18:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 --2- 172.21.15.153:0/1558432003 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef000a96d0 0x7fef000a9b60 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 --2- 172.21.15.153:0/1558432003 >> v2:172.21.15.178:3300/0 conn(0x7fef00068820 0x7fef00068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 -- 172.21.15.153:0/1558432003 >> 172.21.15.153:0/1558432003 conn(0x7fef000c6620 msgr2=0x7fef000c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 -- 172.21.15.153:0/1558432003 shutdown_connections 2023-08-17T00:18:45.254 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.245+0000 7fef063b9700 1 -- 172.21.15.153:0/1558432003 wait complete. 2023-08-17T00:18:45.255 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.249+0000 7fef063b9700 1 Processor -- start 2023-08-17T00:18:45.256 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.249+0000 7fef063b9700 1 -- start start 2023-08-17T00:18:45.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 0x7fef0015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef000a8df0 0x7fef00155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.258 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef000a96d0 0x7fef000bba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef0015a1c0 con 0x7fef00068820 2023-08-17T00:18:45.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001595b0 con 0x7fef000a96d0 2023-08-17T00:18:45.259 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef00159890 con 0x7fef000a8df0 2023-08-17T00:18:45.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 0x7fef0015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 0x7fef0015ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40716/0 (socket says 172.21.15.153:40716) 2023-08-17T00:18:45.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 -- 172.21.15.153:0/3031787697 learned_addr learned my addr 172.21.15.153:0/3031787697 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef04bb6700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef000a8df0 0x7fef00155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.260 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef05bb8700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef000a96d0 0x7fef000bba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 -- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef000a8df0 msgr2=0x7fef00155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef000a8df0 0x7fef00155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 -- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef000a96d0 msgr2=0x7fef000bba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef000a96d0 0x7fef000bba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 -- 172.21.15.153:0/3031787697 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8009ae0 con 0x7fef00068820 2023-08-17T00:18:45.261 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef04bb6700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef000a8df0 0x7fef00155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:45.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef053b7700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 0x7fef0015ae30 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7feefc00c440 tx=0x7feefc007e00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00ce40 con 0x7fef00068820 2023-08-17T00:18:45.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feefc00f470 con 0x7fef00068820 2023-08-17T00:18:45.262 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feefc00f810 con 0x7fef00068820 2023-08-17T00:18:45.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef00159b70 con 0x7fef00068820 2023-08-17T00:18:45.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.253+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0015b320 con 0x7fef00068820 2023-08-17T00:18:45.263 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.257+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef000bdfb0 con 0x7fef00068820 2023-08-17T00:18:45.264 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.257+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7feefc010070 con 0x7fef00068820 2023-08-17T00:18:45.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.261+0000 7feef57fa700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feee405a150 0x7feee405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.261+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7feefc073160 con 0x7fef00068820 2023-08-17T00:18:45.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.261+0000 7fef04bb6700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feee405a150 0x7feee405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.261+0000 7fef04bb6700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feee405a150 0x7feee405c610 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fef000bb600 tx=0x7feef0008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.273 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.265+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7feefc046eb0 con 0x7fef00068820 2023-08-17T00:18:45.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.429+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fef0006b4c0 con 0x7feee405a150 2023-08-17T00:18:45.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.429+0000 7feef57fa700 1 -- 172.21.15.153:0/3031787697 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fef0006b4c0 con 0x7feee405a150 2023-08-17T00:18:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feee405a150 msgr2=0x7feee405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feee405a150 0x7feee405c610 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7fef000bb600 tx=0x7feef0008040).stop 2023-08-17T00:18:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 msgr2=0x7fef0015ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.439 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 0x7fef0015ae30 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 rx=0x7feefc00c440 tx=0x7feefc007e00).stop 2023-08-17T00:18:45.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 shutdown_connections 2023-08-17T00:18:45.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7feee405a150 0x7feee405c610 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef000a96d0 0x7fef000bba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.440 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef000a8df0 0x7fef00155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 --2- 172.21.15.153:0/3031787697 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fef00068820 0x7fef0015ae30 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 >> 172.21.15.153:0/3031787697 conn(0x7fef000c6620 msgr2=0x7fef00157830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 shutdown_connections 2023-08-17T00:18:45.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.433+0000 7fef063b9700 1 -- 172.21.15.153:0/3031787697 wait complete. 2023-08-17T00:18:45.442 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 4 to deep-scrub 2023-08-17T00:18:45.459 INFO:tasks.ceph:Scrubbing osd.5 2023-08-17T00:18:45.460 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:45.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.621+0000 7f9859a1b700 1 Processor -- start 2023-08-17T00:18:45.629 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 -- start start 2023-08-17T00:18:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98540a9be0 0x7f98540a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9854158190 0x7f98540c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854063560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98540c7d40 con 0x7f98540a9be0 2023-08-17T00:18:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9854154620 con 0x7f9854158190 2023-08-17T00:18:45.633 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9859a1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9854154900 con 0x7f98540c78b0 2023-08-17T00:18:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9852ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98540a9be0 0x7f98540a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.634 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9852ffd700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f98540a9be0 0x7f98540a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40720/0 (socket says 172.21.15.153:40720) 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f9852ffd700 1 -- 172.21.15.153:0/2245268714 learned_addr learned my addr 172.21.15.153:0/2245268714 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.625+0000 7f98527fc700 1 --2- 172.21.15.153:0/2245268714 >> v2:172.21.15.178:3300/0 conn(0x7f9854158190 0x7f98540c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f98537fe700 1 --2- 172.21.15.153:0/2245268714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854063560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9852ffd700 1 -- 172.21.15.153:0/2245268714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 msgr2=0x7f9854063560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9852ffd700 1 --2- 172.21.15.153:0/2245268714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854063560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9852ffd700 1 -- 172.21.15.153:0/2245268714 >> v2:172.21.15.178:3300/0 conn(0x7f9854158190 msgr2=0x7f98540c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9852ffd700 1 --2- 172.21.15.153:0/2245268714 >> v2:172.21.15.178:3300/0 conn(0x7f9854158190 0x7f98540c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.635 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9852ffd700 1 -- 172.21.15.153:0/2245268714 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854154be0 con 0x7f98540a9be0 2023-08-17T00:18:45.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9852ffd700 1 --2- 172.21.15.153:0/2245268714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540a9fc0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7f98541588f0 tx=0x7f98440090f0).ready entity=mon.0 client_cookie=9d6d60b9fa1f90ca server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9851ffb700 1 -- 172.21.15.153:0/2245268714 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400b520 con 0x7f98540a9be0 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9851ffb700 1 -- 172.21.15.153:0/2245268714 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984400b680 con 0x7f98540a9be0 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9851ffb700 1 -- 172.21.15.153:0/2245268714 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400ba20 con 0x7f98540a9be0 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 -- 172.21.15.153:0/2245268714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 msgr2=0x7f98540a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 --2- 172.21.15.153:0/2245268714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540a9fc0 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 rx=0x7f98541588f0 tx=0x7f98440090f0).stop 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 -- 172.21.15.153:0/2245268714 shutdown_connections 2023-08-17T00:18:45.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 --2- 172.21.15.153:0/2245268714 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854063560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 --2- 172.21.15.153:0/2245268714 >> v2:172.21.15.178:3300/0 conn(0x7f9854158190 0x7f98540c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 --2- 172.21.15.153:0/2245268714 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540a9fc0 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 -- 172.21.15.153:0/2245268714 >> 172.21.15.153:0/2245268714 conn(0x7f9854061fa0 msgr2=0x7f9854062380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 -- 172.21.15.153:0/2245268714 shutdown_connections 2023-08-17T00:18:45.638 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.629+0000 7f9859a1b700 1 -- 172.21.15.153:0/2245268714 wait complete. 2023-08-17T00:18:45.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.633+0000 7f9859a1b700 1 Processor -- start 2023-08-17T00:18:45.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.633+0000 7f9859a1b700 1 -- start start 2023-08-17T00:18:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9854158190 0x7f98541640b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.642 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98540ad980 con 0x7f98540a9be0 2023-08-17T00:18:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98540adf40 con 0x7f9854158190 2023-08-17T00:18:45.643 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9854152cf0 con 0x7f98540c78b0 2023-08-17T00:18:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40734/0 (socket says 172.21.15.153:40734) 2023-08-17T00:18:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 -- 172.21.15.153:0/1551166271 learned_addr learned my addr 172.21.15.153:0/1551166271 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f98527fc700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f98537fe700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9854158190 0x7f98541640b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.644 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 -- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 msgr2=0x7f9854152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98540c78b0 0x7f9854152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 -- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9854158190 msgr2=0x7f98541640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9854158190 0x7f98541640b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 -- 172.21.15.153:0/1551166271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844009370 con 0x7f98540a9be0 2023-08-17T00:18:45.645 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9852ffd700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540c1a70 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7f9844006fd0 tx=0x7f9844017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844006990 con 0x7f98540a9be0 2023-08-17T00:18:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9844000bc0 con 0x7f98540a9be0 2023-08-17T00:18:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98540a90d0 con 0x7f98540a9be0 2023-08-17T00:18:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984400ba20 con 0x7f98540a9be0 2023-08-17T00:18:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.637+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9854164ea0 con 0x7f98540a9be0 2023-08-17T00:18:45.646 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.641+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f985406b530 con 0x7f98540a9be0 2023-08-17T00:18:45.647 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.641+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f984402c070 con 0x7f98540a9be0 2023-08-17T00:18:45.648 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.641+0000 7f983affd700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f984005a180 0x7f984005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.649 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.641+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f98440758e0 con 0x7f98540a9be0 2023-08-17T00:18:45.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.641+0000 7f983affd700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7f9840060810 0x7f9840062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98400632f0 con 0x7f9840060810 2023-08-17T00:18:45.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f984407a220 con 0x7f98540a9be0 2023-08-17T00:18:45.650 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f98527fc700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f984005a180 0x7f984005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f98537fe700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7f9840060810 0x7f9840062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f98527fc700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f984005a180 0x7f984005c640 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f98540a9740 tx=0x7f9848009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.651 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f98537fe700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7f9840060810 0x7f9840062c70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.652 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.645+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== osd.5 v2:172.21.15.178:6816/33067 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f98400632f0 con 0x7f9840060810 2023-08-17T00:18:45.671 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.661+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 --> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9854154ec0 con 0x7f9840060810 2023-08-17T00:18:45.672 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f983affd700 1 -- 172.21.15.153:0/1551166271 <== osd.5 v2:172.21.15.178:6816/33067 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9854154ec0 con 0x7f9840060810 2023-08-17T00:18:45.672 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:45.672 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:45.673 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:45.673 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7f9840060810 msgr2=0x7f9840062c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6816/33067,v1:172.21.15.178:6817/33067] conn(0x7f9840060810 0x7f9840062c70 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f984005a180 msgr2=0x7f984005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f984005a180 0x7f984005c640 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7f98540a9740 tx=0x7f9848009060).stop 2023-08-17T00:18:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 msgr2=0x7f98540c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 --2- 172.21.15.153:0/1551166271 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f98540a9be0 0x7f98540c1a70 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 rx=0x7f9844006fd0 tx=0x7f9844017000).stop 2023-08-17T00:18:45.674 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f98537fe700 1 -- 172.21.15.153:0/1551166271 reap_dead start 2023-08-17T00:18:45.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 shutdown_connections 2023-08-17T00:18:45.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 >> 172.21.15.153:0/1551166271 conn(0x7f9854061fa0 msgr2=0x7f9854157330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 shutdown_connections 2023-08-17T00:18:45.675 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.665+0000 7f9859a1b700 1 -- 172.21.15.153:0/1551166271 wait complete. 2023-08-17T00:18:45.694 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-17T00:18:45.854 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 Processor -- start 2023-08-17T00:18:45.855 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 -- start start 2023-08-17T00:18:45.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92140c3910 0x7f92140bdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214064520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9214155240 con 0x7f92140640c0 2023-08-17T00:18:45.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9214064a10 con 0x7f92140c3910 2023-08-17T00:18:45.857 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.849+0000 7f921931b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9214154350 con 0x7f9214066b00 2023-08-17T00:18:45.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92140c3910 0x7f92140bdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92140c3910 0x7f92140bdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:44440/0 (socket says 172.21.15.153:44440) 2023-08-17T00:18:45.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 -- 172.21.15.153:0/358212684 learned_addr learned my addr 172.21.15.153:0/358212684 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.858 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f92137fe700 1 --2- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214064520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 -- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 msgr2=0x7f9214064520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 --2- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214064520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 -- 172.21.15.153:0/358212684 >> v1:172.21.15.178:6789/0 conn(0x7f92140640c0 legacy=0x7f92140bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 -- 172.21.15.153:0/358212684 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9214154630 con 0x7f92140c3910 2023-08-17T00:18:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9211ffb700 1 -- 172.21.15.153:0/358212684 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200336169 0 0) 0x7f9214155240 con 0x7f92140640c0 2023-08-17T00:18:45.860 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9212ffd700 1 --2- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdeb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f9204006fd0 tx=0x7f920400b3b0).ready entity=mon.1 client_cookie=a4234475fe3ce1aa server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9211ffb700 1 -- 172.21.15.153:0/358212684 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920400da70 con 0x7f92140c3910 2023-08-17T00:18:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9211ffb700 1 -- 172.21.15.153:0/358212684 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920400dbd0 con 0x7f92140c3910 2023-08-17T00:18:45.861 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f9211ffb700 1 -- 172.21.15.153:0/358212684 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204010470 con 0x7f92140c3910 2023-08-17T00:18:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 -- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 msgr2=0x7f92140bdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 --2- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdeb0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f9204006fd0 tx=0x7f920400b3b0).stop 2023-08-17T00:18:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 -- 172.21.15.153:0/358212684 shutdown_connections 2023-08-17T00:18:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 --2- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214064520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 --2- 172.21.15.153:0/358212684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdeb0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.862 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 -- 172.21.15.153:0/358212684 >> 172.21.15.153:0/358212684 conn(0x7f92140c80a0 msgr2=0x7f92140c40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:45.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.853+0000 7f921931b700 1 -- 172.21.15.153:0/358212684 shutdown_connections 2023-08-17T00:18:45.863 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.857+0000 7f921931b700 1 -- 172.21.15.153:0/358212684 wait complete. 2023-08-17T00:18:45.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.857+0000 7f921931b700 1 Processor -- start 2023-08-17T00:18:45.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 -- start start 2023-08-17T00:18:45.866 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 0x7f9214163d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214166b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140bf380 con 0x7f92140640c0 2023-08-17T00:18:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9214164250 con 0x7f92140c3910 2023-08-17T00:18:45.867 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140a9df0 con 0x7f9214066b00 2023-08-17T00:18:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 0x7f9214163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 0x7f9214163d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40736/0 (socket says 172.21.15.153:40736) 2023-08-17T00:18:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 -- 172.21.15.153:0/4284538859 learned_addr learned my addr 172.21.15.153:0/4284538859 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:45.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f92137fe700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f92127fc700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214166b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 -- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 msgr2=0x7f9214166b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214166b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 -- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 msgr2=0x7f92140bdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:45.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:45.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 -- 172.21.15.153:0/4284538859 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920400b610 con 0x7f92140640c0 2023-08-17T00:18:45.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f92137fe700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:45.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f9212ffd700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 0x7f9214163d60 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f92140aa350 tx=0x7f920400b3b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204019450 con 0x7f92140640c0 2023-08-17T00:18:45.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92040195b0 con 0x7f92140640c0 2023-08-17T00:18:45.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92140be770 con 0x7f92140640c0 2023-08-17T00:18:45.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204019970 con 0x7f92140640c0 2023-08-17T00:18:45.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.861+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140bed30 con 0x7f92140640c0 2023-08-17T00:18:45.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.865+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921406b4c0 con 0x7f92140640c0 2023-08-17T00:18:45.872 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.865+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f920402a070 con 0x7f92140640c0 2023-08-17T00:18:45.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.869+0000 7f91faffd700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f920005a180 0x7f920005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:45.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.869+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f92040755d0 con 0x7f92140640c0 2023-08-17T00:18:45.874 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.869+0000 7f92127fc700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f920005a180 0x7f920005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:45.875 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.869+0000 7f92127fc700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f920005a180 0x7f920005c640 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9208007fd0 tx=0x7f9208007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:45.879 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:45.873+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f9204049210 con 0x7f92140640c0 2023-08-17T00:18:46.039 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.033+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f92140bf4c0 con 0x7f920005a180 2023-08-17T00:18:46.040 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.033+0000 7f91faffd700 1 -- 172.21.15.153:0/4284538859 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9208003570 con 0x7f920005a180 2023-08-17T00:18:46.042 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f920005a180 msgr2=0x7f920005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f920005a180 0x7f920005c640 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7f9208007fd0 tx=0x7f9208007bb0).stop 2023-08-17T00:18:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 msgr2=0x7f9214163d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 0x7f9214163d60 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 rx=0x7f92140aa350 tx=0x7f920400b3b0).stop 2023-08-17T00:18:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 shutdown_connections 2023-08-17T00:18:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f920005a180 0x7f920005c640 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.043 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92140c3910 0x7f92140bdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9214066b00 0x7f9214166b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 --2- 172.21.15.153:0/4284538859 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f92140640c0 0x7f9214163d60 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 >> 172.21.15.153:0/4284538859 conn(0x7f92140c80a0 msgr2=0x7f92140c53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 shutdown_connections 2023-08-17T00:18:46.044 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.037+0000 7f921931b700 1 -- 172.21.15.153:0/4284538859 wait complete. 2023-08-17T00:18:46.045 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 5 to deep-scrub 2023-08-17T00:18:46.063 INFO:tasks.ceph:Scrubbing osd.6 2023-08-17T00:18:46.064 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:46.230 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.225+0000 7f40c36f1700 1 Processor -- start 2023-08-17T00:18:46.231 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.225+0000 7f40c36f1700 1 -- start start 2023-08-17T00:18:46.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.225+0000 7f40c36f1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7f40bc064e40 0x7f40bc158240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.234 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.225+0000 7f40c36f1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc061fa0 con 0x7f40bc153b80 2023-08-17T00:18:46.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc062560 con 0x7f40bc1537a0 2023-08-17T00:18:46.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc153ff0 con 0x7f40bc064e40 2023-08-17T00:18:46.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c1c8e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f40bc153b80 0x7f40bc157690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55538/0 (socket says 172.21.15.153:55538) 2023-08-17T00:18:46.235 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c1c8e700 1 -- 172.21.15.153:0/2535560230 learned_addr learned my addr 172.21.15.153:0/2535560230 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:46.236 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c0c8c700 1 --2- 172.21.15.153:0/2535560230 >> v2:172.21.15.153:3300/0 conn(0x7f40bc064e40 0x7f40bc158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2535560230 >> v1:172.21.15.178:6789/0 conn(0x7f40bc1537a0 legacy=0x7f40bc0c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2535560230 >> v1:172.21.15.153:6789/0 conn(0x7f40bc153b80 legacy=0x7f40bc157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.237 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2535560230 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0c5f90 con 0x7f40bc064e40 2023-08-17T00:18:46.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c0c8c700 1 --2- 172.21.15.153:0/2535560230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc064e40 0x7f40bc158240 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f40ac009760 tx=0x7f40ac009060).ready entity=mon.0 client_cookie=9b9e83fd995f8c98 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40b3fff700 1 -- 172.21.15.153:0/2535560230 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac009120 con 0x7f40bc064e40 2023-08-17T00:18:46.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40b3fff700 1 -- 172.21.15.153:0/2535560230 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00b580 con 0x7f40bc064e40 2023-08-17T00:18:46.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40b3fff700 1 -- 172.21.15.153:0/2535560230 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00b900 con 0x7f40bc064e40 2023-08-17T00:18:46.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- 172.21.15.153:0/2535560230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc064e40 msgr2=0x7f40bc158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.238 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 --2- 172.21.15.153:0/2535560230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc064e40 0x7f40bc158240 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 rx=0x7f40ac009760 tx=0x7f40ac009060).stop 2023-08-17T00:18:46.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- 172.21.15.153:0/2535560230 shutdown_connections 2023-08-17T00:18:46.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 --2- 172.21.15.153:0/2535560230 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc064e40 0x7f40bc158240 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- 172.21.15.153:0/2535560230 >> 172.21.15.153:0/2535560230 conn(0x7f40bc0c7090 msgr2=0x7f40bc0c3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- 172.21.15.153:0/2535560230 shutdown_connections 2023-08-17T00:18:46.239 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.229+0000 7f40c36f1700 1 -- 172.21.15.153:0/2535560230 wait complete. 2023-08-17T00:18:46.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 Processor -- start 2023-08-17T00:18:46.240 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 -- start start 2023-08-17T00:18:46.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40bc064e40 0x7f40bc154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc1537a0 0x7f40bc14c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40bc153b80 0x7f40bc1674e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.241 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc143cf0 con 0x7f40bc1537a0 2023-08-17T00:18:46.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc1548b0 con 0x7f40bc153b80 2023-08-17T00:18:46.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.233+0000 7f40c36f1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc1683d0 con 0x7f40bc064e40 2023-08-17T00:18:46.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc1537a0 0x7f40bc14c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc1537a0 0x7f40bc14c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40768/0 (socket says 172.21.15.153:40768) 2023-08-17T00:18:46.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2100259058 learned_addr learned my addr 172.21.15.153:0/2100259058 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:46.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c1c8e700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40bc153b80 0x7f40bc1674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c148d700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40bc064e40 0x7f40bc154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.244 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40bc064e40 msgr2=0x7f40bc154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40bc064e40 0x7f40bc154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40bc153b80 msgr2=0x7f40bc1674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40bc153b80 0x7f40bc1674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 -- 172.21.15.153:0/2100259058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac0092a0 con 0x7f40bc1537a0 2023-08-17T00:18:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c1c8e700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40bc153b80 0x7f40bc1674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:46.245 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c148d700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f40bc064e40 0x7f40bc154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2023-08-17T00:18:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c0c8c700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc1537a0 0x7f40bc14c840 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f40ac009eb0 tx=0x7f40ac017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00b900 con 0x7f40bc1537a0 2023-08-17T00:18:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac006910 con 0x7f40bc1537a0 2023-08-17T00:18:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac01b620 con 0x7f40bc1537a0 2023-08-17T00:18:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc1680f0 con 0x7f40bc1537a0 2023-08-17T00:18:46.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc154540 con 0x7f40bc1537a0 2023-08-17T00:18:46.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.237+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40bc06b530 con 0x7f40bc1537a0 2023-08-17T00:18:46.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f40ac02b070 con 0x7f40bc1537a0 2023-08-17T00:18:46.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40b17fa700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a005a180 0x7f40a005c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f40ac0758e0 con 0x7f40bc1537a0 2023-08-17T00:18:46.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40b17fa700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f40a0060890 0x7f40a0062cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 --> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40a0063370 con 0x7f40a0060890 2023-08-17T00:18:46.249 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40ac07a200 con 0x7f40bc1537a0 2023-08-17T00:18:46.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40c1c8e700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f40a0060890 0x7f40a0062cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.250 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40c148d700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a005a180 0x7f40a005c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40c1c8e700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f40a0060890 0x7f40a0062cf0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.241+0000 7f40c148d700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a005a180 0x7f40a005c640 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f40b8001710 tx=0x7f40b8009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.251 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.245+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== osd.6 v2:172.21.15.178:6808/33068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f40a0063370 con 0x7f40a0060890 2023-08-17T00:18:46.266 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 --> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40bc0c6270 con 0x7f40a0060890 2023-08-17T00:18:46.267 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40b17fa700 1 -- 172.21.15.153:0/2100259058 <== osd.6 v2:172.21.15.178:6808/33068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f40bc0c6270 con 0x7f40a0060890 2023-08-17T00:18:46.267 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:46.267 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:46.268 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f40a0060890 msgr2=0x7f40a0062cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6808/33068,v1:172.21.15.178:6809/33068] conn(0x7f40a0060890 0x7f40a0062cf0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a005a180 msgr2=0x7f40a005c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f40a005a180 0x7f40a005c640 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 rx=0x7f40b8001710 tx=0x7f40b8009040).stop 2023-08-17T00:18:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc1537a0 msgr2=0x7f40bc14c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.269 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 --2- 172.21.15.153:0/2100259058 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f40bc1537a0 0x7f40bc14c840 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 rx=0x7f40ac009eb0 tx=0x7f40ac017000).stop 2023-08-17T00:18:46.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c1c8e700 1 -- 172.21.15.153:0/2100259058 reap_dead start 2023-08-17T00:18:46.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 shutdown_connections 2023-08-17T00:18:46.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 >> 172.21.15.153:0/2100259058 conn(0x7f40bc0c7090 msgr2=0x7f40bc14e270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 shutdown_connections 2023-08-17T00:18:46.270 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.261+0000 7f40c36f1700 1 -- 172.21.15.153:0/2100259058 wait complete. 2023-08-17T00:18:46.289 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-17T00:18:46.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.441+0000 7fe20759e700 1 Processor -- start 2023-08-17T00:18:46.449 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.441+0000 7fe20759e700 1 -- start start 2023-08-17T00:18:46.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20759e700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2080689c0 0x7fe208068da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20759e700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe208065da0 con 0x7fe208151530 2023-08-17T00:18:46.451 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20759e700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe208155c60 con 0x7fe2081560f0 2023-08-17T00:18:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20759e700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe208156550 con 0x7fe2080689c0 2023-08-17T00:18:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2080689c0 0x7fe208068da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.452 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fe2080689c0 0x7fe208068da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40776/0 (socket says 172.21.15.153:40776) 2023-08-17T00:18:46.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 -- 172.21.15.153:0/950798236 learned_addr learned my addr 172.21.15.153:0/950798236 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:46.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 -- 172.21.15.153:0/950798236 >> v1:172.21.15.178:6789/0 conn(0x7fe2081560f0 legacy=0x7fe2080c0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 -- 172.21.15.153:0/950798236 >> v1:172.21.15.153:6789/0 conn(0x7fe208151530 legacy=0x7fe2081519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 -- 172.21.15.153:0/950798236 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe208065ff0 con 0x7fe2080689c0 2023-08-17T00:18:46.453 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20659c700 1 --2- 172.21.15.153:0/950798236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2080689c0 0x7fe208068da0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7fe1f8009810 tx=0x7fe1f8009060).ready entity=mon.0 client_cookie=ee874bf9af00696d server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.445+0000 7fe20559a700 1 -- 172.21.15.153:0/950798236 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8005880 con 0x7fe2080689c0 2023-08-17T00:18:46.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20559a700 1 -- 172.21.15.153:0/950798236 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f80059e0 con 0x7fe2080689c0 2023-08-17T00:18:46.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20559a700 1 -- 172.21.15.153:0/950798236 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f8005d60 con 0x7fe2080689c0 2023-08-17T00:18:46.454 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 -- 172.21.15.153:0/950798236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2080689c0 msgr2=0x7fe208068da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 --2- 172.21.15.153:0/950798236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2080689c0 0x7fe208068da0 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 rx=0x7fe1f8009810 tx=0x7fe1f8009060).stop 2023-08-17T00:18:46.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 -- 172.21.15.153:0/950798236 shutdown_connections 2023-08-17T00:18:46.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 --2- 172.21.15.153:0/950798236 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe2080689c0 0x7fe208068da0 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 -- 172.21.15.153:0/950798236 >> 172.21.15.153:0/950798236 conn(0x7fe2080c6620 msgr2=0x7fe2080c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.455 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 -- 172.21.15.153:0/950798236 shutdown_connections 2023-08-17T00:18:46.456 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.449+0000 7fe20759e700 1 -- 172.21.15.153:0/950798236 wait complete. 2023-08-17T00:18:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 Processor -- start 2023-08-17T00:18:46.459 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 -- start start 2023-08-17T00:18:46.460 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2080689c0 0x7fe20809f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 0x7fe2080a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2081560f0 0x7fe208163560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080be760 con 0x7fe208151530 2023-08-17T00:18:46.461 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080bd8b0 con 0x7fe2080689c0 2023-08-17T00:18:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20759e700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2080bdb50 con 0x7fe2081560f0 2023-08-17T00:18:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 0x7fe2080a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 0x7fe2080a8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40784/0 (socket says 172.21.15.153:40784) 2023-08-17T00:18:46.462 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 -- 172.21.15.153:0/153206595 learned_addr learned my addr 172.21.15.153:0/153206595 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:46.463 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe20659c700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2080689c0 0x7fe20809f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe206d9d700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2081560f0 0x7fe208163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 -- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2081560f0 msgr2=0x7fe208163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.464 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2081560f0 0x7fe208163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.465 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 -- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2080689c0 msgr2=0x7fe20809f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2080689c0 0x7fe20809f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.467 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.453+0000 7fe205d9b700 1 -- 172.21.15.153:0/153206595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009300 con 0x7fe208151530 2023-08-17T00:18:46.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe205d9b700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 0x7fe2080a8510 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7fe1fc00c440 tx=0x7fe1fc007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00f470 con 0x7fe208151530 2023-08-17T00:18:46.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc00f5d0 con 0x7fe208151530 2023-08-17T00:18:46.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc00f970 con 0x7fe208151530 2023-08-17T00:18:46.468 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2080bde30 con 0x7fe208151530 2023-08-17T00:18:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2080be3f0 con 0x7fe208151530 2023-08-17T00:18:46.469 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe208069060 con 0x7fe208151530 2023-08-17T00:18:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.457+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fe1fc019030 con 0x7fe208151530 2023-08-17T00:18:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.461+0000 7fe1f67fc700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1e805a120 0x7fe1e805c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.461+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fe1fc073170 con 0x7fe208151530 2023-08-17T00:18:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.461+0000 7fe20659c700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1e805a120 0x7fe1e805c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.470 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.461+0000 7fe20659c700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1e805a120 0x7fe1e805c5e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fe1f8009fd0 tx=0x7fe1f8016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.473 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.465+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fe208069060 con 0x7fe208151530 2023-08-17T00:18:46.636 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.629+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fe208069060 con 0x7fe1e805a120 2023-08-17T00:18:46.637 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.629+0000 7fe1f67fc700 1 -- 172.21.15.153:0/153206595 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe208069060 con 0x7fe1e805a120 2023-08-17T00:18:46.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1e805a120 msgr2=0x7fe1e805c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.639 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1e805a120 0x7fe1e805c5e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7fe1f8009fd0 tx=0x7fe1f8016000).stop 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 msgr2=0x7fe2080a8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 0x7fe2080a8510 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 rx=0x7fe1fc00c440 tx=0x7fe1fc007dc0).stop 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 shutdown_connections 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fe1e805a120 0x7fe1e805c5e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2081560f0 0x7fe208163560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fe208151530 0x7fe2080a8510 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.640 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 --2- 172.21.15.153:0/153206595 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2080689c0 0x7fe20809f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 >> 172.21.15.153:0/153206595 conn(0x7fe2080c6620 msgr2=0x7fe2080645a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 shutdown_connections 2023-08-17T00:18:46.641 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.633+0000 7fe20759e700 1 -- 172.21.15.153:0/153206595 wait complete. 2023-08-17T00:18:46.641 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 6 to deep-scrub 2023-08-17T00:18:46.660 INFO:tasks.ceph:Scrubbing osd.7 2023-08-17T00:18:46.660 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-17T00:18:46.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.817+0000 7f7b9cfb9700 1 Processor -- start 2023-08-17T00:18:46.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.817+0000 7f7b9cfb9700 1 -- start start 2023-08-17T00:18:46.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b9cfb9700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7b981397e0 0x7f7b980bc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b9cfb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b98139bc0 0x7f7b980c2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b9cfb9700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b980c3430 con 0x7f7b980661f0 2023-08-17T00:18:46.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b9cfb9700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b980bcb70 con 0x7f7b981397e0 2023-08-17T00:18:46.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b9cfb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c2980 con 0x7f7b98139bc0 2023-08-17T00:18:46.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b97fff700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f7b980661f0 0x7f7b98062fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55558/0 (socket says 172.21.15.153:55558) 2023-08-17T00:18:46.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b97fff700 1 -- 172.21.15.153:0/489938439 learned_addr learned my addr 172.21.15.153:0/489938439 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:46.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b8ffff700 1 --2- 172.21.15.153:0/489938439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b98139bc0 0x7f7b980c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b977fe700 1 --2- 172.21.15.153:0/489938439 >> v2:172.21.15.178:3300/0 conn(0x7f7b981397e0 0x7f7b980bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.829 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b96ffd700 1 -- 172.21.15.153:0/489938439 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752130452 0 0) 0x7f7b980c3430 con 0x7f7b980661f0 2023-08-17T00:18:46.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b96ffd700 1 -- 172.21.15.153:0/489938439 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b840033f0 con 0x7f7b980661f0 2023-08-17T00:18:46.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b8ffff700 1 -- 172.21.15.153:0/489938439 >> v2:172.21.15.178:3300/0 conn(0x7f7b981397e0 msgr2=0x7f7b980bc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:46.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b8ffff700 1 --2- 172.21.15.153:0/489938439 >> v2:172.21.15.178:3300/0 conn(0x7f7b981397e0 0x7f7b980bc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b8ffff700 1 -- 172.21.15.153:0/489938439 >> v1:172.21.15.153:6789/0 conn(0x7f7b980661f0 legacy=0x7f7b98062fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b8ffff700 1 -- 172.21.15.153:0/489938439 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980c1490 con 0x7f7b98139bc0 2023-08-17T00:18:46.830 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.821+0000 7f7b977fe700 1 --2- 172.21.15.153:0/489938439 >> v2:172.21.15.178:3300/0 conn(0x7f7b981397e0 0x7f7b980bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2023-08-17T00:18:46.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b8ffff700 1 --2- 172.21.15.153:0/489938439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b98139bc0 0x7f7b980c2490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f7b80009760 tx=0x7f7b80009060).ready entity=mon.2 client_cookie=ff35b85fc2e443ab server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.831 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b96ffd700 1 -- 172.21.15.153:0/489938439 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b800090d0 con 0x7f7b98139bc0 2023-08-17T00:18:46.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b96ffd700 1 -- 172.21.15.153:0/489938439 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8000f6b0 con 0x7f7b98139bc0 2023-08-17T00:18:46.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b96ffd700 1 -- 172.21.15.153:0/489938439 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8000fa30 con 0x7f7b98139bc0 2023-08-17T00:18:46.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/489938439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b98139bc0 msgr2=0x7f7b980c2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 --2- 172.21.15.153:0/489938439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b98139bc0 0x7f7b980c2490 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f7b80009760 tx=0x7f7b80009060).stop 2023-08-17T00:18:46.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/489938439 shutdown_connections 2023-08-17T00:18:46.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 --2- 172.21.15.153:0/489938439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b98139bc0 0x7f7b980c2490 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 --2- 172.21.15.153:0/489938439 >> v2:172.21.15.178:3300/0 conn(0x7f7b981397e0 0x7f7b980bc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/489938439 >> 172.21.15.153:0/489938439 conn(0x7f7b98068d50 msgr2=0x7f7b98069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/489938439 shutdown_connections 2023-08-17T00:18:46.833 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.825+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/489938439 wait complete. 2023-08-17T00:18:46.834 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 Processor -- start 2023-08-17T00:18:46.835 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 -- start start 2023-08-17T00:18:46.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b980661f0 0x7f7b98133060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b981397e0 0x7f7b98150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b98139bc0 0x7f7b98150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981319e0 con 0x7f7b980661f0 2023-08-17T00:18:46.836 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98131cc0 con 0x7f7b98139bc0 2023-08-17T00:18:46.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b9cfb9700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b98131fa0 con 0x7f7b981397e0 2023-08-17T00:18:46.837 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b980661f0 0x7f7b98133060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b980661f0 0x7f7b98133060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40794/0 (socket says 172.21.15.153:40794) 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 -- 172.21.15.153:0/3318111321 learned_addr learned my addr 172.21.15.153:0/3318111321 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b8ffff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b981397e0 0x7f7b98150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b97fff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b98139bc0 0x7f7b98150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 -- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b981397e0 msgr2=0x7f7b98150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b981397e0 0x7f7b98150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.838 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 -- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b98139bc0 msgr2=0x7f7b98150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b98139bc0 0x7f7b98150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b977fe700 1 -- 172.21.15.153:0/3318111321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880092a0 con 0x7f7b980661f0 2023-08-17T00:18:46.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.829+0000 7f7b97fff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b98139bc0 0x7f7b98150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:46.839 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b977fe700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b980661f0 0x7f7b98133060 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f7b8800ea20 tx=0x7f7b88009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88009600 con 0x7f7b980661f0 2023-08-17T00:18:46.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8800c850 con 0x7f7b980661f0 2023-08-17T00:18:46.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b800092a0 con 0x7f7b980661f0 2023-08-17T00:18:46.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8800cbd0 con 0x7f7b980661f0 2023-08-17T00:18:46.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b980be7c0 con 0x7f7b980661f0 2023-08-17T00:18:46.840 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b98046dd0 con 0x7f7b980661f0 2023-08-17T00:18:46.841 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.833+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f7b88022070 con 0x7f7b980661f0 2023-08-17T00:18:46.842 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8f7fe700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b7805a180 0x7f7b7805c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f7b88074300 con 0x7f7b980661f0 2023-08-17T00:18:46.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8f7fe700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f7b78060810 0x7f7b78062c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:46.843 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 --> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b780632f0 con 0x7f7b78060810 2023-08-17T00:18:46.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_get_version_reply(handle=1 version=198) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b88076860 con 0x7f7b980661f0 2023-08-17T00:18:46.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8ffff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b7805a180 0x7f7b7805c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.844 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b97fff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f7b78060810 0x7f7b78062c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:46.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b97fff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f7b78060810 0x7f7b78062c70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.845 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.837+0000 7f7b8ffff700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b7805a180 0x7f7b7805c640 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f7b98139fe0 tx=0x7f7b80018000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:46.846 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.841+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== osd.7 v2:172.21.15.178:6824/33069 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23065 (crc 0 0 0) 0x7f7b780632f0 con 0x7f7b78060810 2023-08-17T00:18:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.857+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 --> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7b980bea10 con 0x7f7b78060810 2023-08-17T00:18:46.865 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b8f7fe700 1 -- 172.21.15.153:0/3318111321 <== osd.7 v2:172.21.15.178:6824/33069 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7b980bea10 con 0x7f7b78060810 2023-08-17T00:18:46.866 INFO:teuthology.orchestra.run.smithi153.stdout:{ 2023-08-17T00:18:46.866 INFO:teuthology.orchestra.run.smithi153.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-17T00:18:46.867 INFO:teuthology.orchestra.run.smithi153.stdout:} 2023-08-17T00:18:46.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f7b78060810 msgr2=0x7f7b78062c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.868 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6824/33069,v1:172.21.15.178:6825/33069] conn(0x7f7b78060810 0x7f7b78062c70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:46.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b7805a180 msgr2=0x7f7b7805c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f7b7805a180 0x7f7b7805c640 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7f7b98139fe0 tx=0x7f7b80018000).stop 2023-08-17T00:18:46.869 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b980661f0 msgr2=0x7f7b98133060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 --2- 172.21.15.153:0/3318111321 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f7b980661f0 0x7f7b98133060 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 rx=0x7f7b8800ea20 tx=0x7f7b88009060).stop 2023-08-17T00:18:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b97fff700 1 -- 172.21.15.153:0/3318111321 reap_dead start 2023-08-17T00:18:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 shutdown_connections 2023-08-17T00:18:46.870 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 >> 172.21.15.153:0/3318111321 conn(0x7f7b98068d50 msgr2=0x7f7b9805e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:46.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 shutdown_connections 2023-08-17T00:18:46.871 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:46.861+0000 7f7b9cfb9700 1 -- 172.21.15.153:0/3318111321 wait complete. 2023-08-17T00:18:46.889 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-17T00:18:47.053 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.049+0000 7f5146a8f700 1 Processor -- start 2023-08-17T00:18:47.054 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.049+0000 7f5146a8f700 1 -- start start 2023-08-17T00:18:47.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.049+0000 7f5146a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51400a8df0 0x7f51400c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.057 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5146a8f700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5140068820 0x7f5140068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5146a8f700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51401585a0 con 0x7f5140061fa0 2023-08-17T00:18:47.058 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5146a8f700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5140066400 con 0x7f5140068820 2023-08-17T00:18:47.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5146a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5140069170 con 0x7f51400a8df0 2023-08-17T00:18:47.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f514628e700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7f5140061fa0 0x7f5140062420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55562/0 (socket says 172.21.15.153:55562) 2023-08-17T00:18:47.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f514628e700 1 -- 172.21.15.153:0/1687554024 learned_addr learned my addr 172.21.15.153:0/1687554024 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:47.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5145a8d700 1 --2- 172.21.15.153:0/1687554024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51400a8df0 0x7f51400c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.059 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f514528c700 1 --2- 172.21.15.153:0/1687554024 >> v2:172.21.15.178:3300/0 conn(0x7f5140068820 0x7f5140068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5144a8b700 1 -- 172.21.15.153:0/1687554024 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712957573 0 0) 0x7f51401585a0 con 0x7f5140061fa0 2023-08-17T00:18:47.060 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5144a8b700 1 -- 172.21.15.153:0/1687554024 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f512c0033f0 con 0x7f5140061fa0 2023-08-17T00:18:47.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5145a8d700 1 -- 172.21.15.153:0/1687554024 >> v2:172.21.15.178:3300/0 conn(0x7f5140068820 msgr2=0x7f5140068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:47.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5145a8d700 1 --2- 172.21.15.153:0/1687554024 >> v2:172.21.15.178:3300/0 conn(0x7f5140068820 0x7f5140068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5145a8d700 1 -- 172.21.15.153:0/1687554024 >> v1:172.21.15.153:6789/0 conn(0x7f5140061fa0 legacy=0x7f5140062420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5145a8d700 1 -- 172.21.15.153:0/1687554024 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51400b9d30 con 0x7f51400a8df0 2023-08-17T00:18:47.061 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5145a8d700 1 --2- 172.21.15.153:0/1687554024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51400a8df0 0x7f51400c1490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f513c006fd0 tx=0x7f513c006f40).ready entity=mon.2 client_cookie=8b197dc0c0ba355e server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:47.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5144a8b700 1 -- 172.21.15.153:0/1687554024 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c005880 con 0x7f51400a8df0 2023-08-17T00:18:47.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5144a8b700 1 -- 172.21.15.153:0/1687554024 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c0059e0 con 0x7f51400a8df0 2023-08-17T00:18:47.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.053+0000 7f5144a8b700 1 -- 172.21.15.153:0/1687554024 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c005d60 con 0x7f51400a8df0 2023-08-17T00:18:47.062 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 -- 172.21.15.153:0/1687554024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51400a8df0 msgr2=0x7f51400c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 --2- 172.21.15.153:0/1687554024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51400a8df0 0x7f51400c1490 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f513c006fd0 tx=0x7f513c006f40).stop 2023-08-17T00:18:47.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 -- 172.21.15.153:0/1687554024 shutdown_connections 2023-08-17T00:18:47.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 --2- 172.21.15.153:0/1687554024 >> v2:172.21.15.178:3300/0 conn(0x7f5140068820 0x7f5140068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 --2- 172.21.15.153:0/1687554024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51400a8df0 0x7f51400c1490 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.063 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 -- 172.21.15.153:0/1687554024 >> 172.21.15.153:0/1687554024 conn(0x7f51400c6620 msgr2=0x7f51400c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:47.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 -- 172.21.15.153:0/1687554024 shutdown_connections 2023-08-17T00:18:47.064 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.057+0000 7f5146a8f700 1 -- 172.21.15.153:0/1687554024 wait complete. 2023-08-17T00:18:47.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 Processor -- start 2023-08-17T00:18:47.066 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 -- start start 2023-08-17T00:18:47.069 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5140061fa0 0x7f51400b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5140068820 0x7f514016b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 0x7f51400bd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400be5b0 con 0x7f51400a8df0 2023-08-17T00:18:47.070 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400bee70 con 0x7f5140061fa0 2023-08-17T00:18:47.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5146a8f700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51400bdff0 con 0x7f5140068820 2023-08-17T00:18:47.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 0x7f51400bd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.071 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 0x7f51400bd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40798/0 (socket says 172.21.15.153:40798) 2023-08-17T00:18:47.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 -- 172.21.15.153:0/3204932312 learned_addr learned my addr 172.21.15.153:0/3204932312 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:47.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514528c700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5140068820 0x7f514016b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5145a8d700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5140061fa0 0x7f51400b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.072 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 -- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5140068820 msgr2=0x7f514016b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5140068820 0x7f514016b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 -- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5140061fa0 msgr2=0x7f51400b9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5140061fa0 0x7f51400b9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.073 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 -- 172.21.15.153:0/3204932312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009250 con 0x7f51400a8df0 2023-08-17T00:18:47.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f5145a8d700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5140061fa0 0x7f51400b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:18:47.074 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.061+0000 7f514628e700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 0x7f51400bd5a0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7f5138005ad0 tx=0x7f51380015b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138005d30 con 0x7f51400a8df0 2023-08-17T00:18:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138005e90 con 0x7f51400a8df0 2023-08-17T00:18:47.075 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51400be2d0 con 0x7f51400a8df0 2023-08-17T00:18:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138007320 con 0x7f51400a8df0 2023-08-17T00:18:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5140158ca0 con 0x7f51400a8df0 2023-08-17T00:18:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51400befe0 con 0x7f51400a8df0 2023-08-17T00:18:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.065+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7f5138010030 con 0x7f51400a8df0 2023-08-17T00:18:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.069+0000 7f5135ffb700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f512405a150 0x7f512405c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.076 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.069+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7f5138073cf0 con 0x7f51400a8df0 2023-08-17T00:18:47.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.069+0000 7f5145a8d700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f512405a150 0x7f512405c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.077 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.069+0000 7f5145a8d700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f512405a150 0x7f512405c610 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f513c006f80 tx=0x7f513c015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:47.081 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.073+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7f5138047930 con 0x7f51400a8df0 2023-08-17T00:18:47.242 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f514006b4c0 con 0x7f512405a150 2023-08-17T00:18:47.243 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5135ffb700 1 -- 172.21.15.153:0/3204932312 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f514006b4c0 con 0x7f512405a150 2023-08-17T00:18:47.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f512405a150 msgr2=0x7f512405c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f512405a150 0x7f512405c610 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7f513c006f80 tx=0x7f513c015000).stop 2023-08-17T00:18:47.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 msgr2=0x7f51400bd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.246 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 0x7f51400bd5a0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 rx=0x7f5138005ad0 tx=0x7f51380015b0).stop 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 shutdown_connections 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7f512405a150 0x7f512405c610 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7f51400a8df0 0x7f51400bd5a0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5140068820 0x7f514016b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 --2- 172.21.15.153:0/3204932312 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5140061fa0 0x7f51400b9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.237+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 >> 172.21.15.153:0/3204932312 conn(0x7f51400c6620 msgr2=0x7f5140157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:47.247 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.241+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 shutdown_connections 2023-08-17T00:18:47.248 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.241+0000 7f5146a8f700 1 -- 172.21.15.153:0/3204932312 wait complete. 2023-08-17T00:18:47.248 INFO:teuthology.orchestra.run.smithi153.stderr:instructed osd(s) 7 to deep-scrub 2023-08-17T00:18:47.264 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:18:47.418 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 Processor -- start 2023-08-17T00:18:47.419 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 -- start start 2023-08-17T00:18:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c151b90 0x7fc52c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 --2- >> v2:172.21.15.153:3300/0 conn(0x7fc52c063290 0x7fc52c065660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.421 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52c061fa0 con 0x7fc52c065b50 2023-08-17T00:18:47.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 -- --> v2:172.21.15.153:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52c0c3fb0 con 0x7fc52c063290 2023-08-17T00:18:47.422 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.413+0000 7fc530ef1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c152460 con 0x7fc52c151b90 2023-08-17T00:18:47.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52ad9d700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fc52c065b50 0x7fc52c064870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:55572/0 (socket says 172.21.15.153:55572) 2023-08-17T00:18:47.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52ad9d700 1 -- 172.21.15.153:0/1133342973 learned_addr learned my addr 172.21.15.153:0/1133342973 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:18:47.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc529d9b700 1 --2- 172.21.15.153:0/1133342973 >> v2:172.21.15.153:3300/0 conn(0x7fc52c063290 0x7fc52c065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52a59c700 1 --2- 172.21.15.153:0/1133342973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c151b90 0x7fc52c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.423 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52959a700 1 -- 172.21.15.153:0/1133342973 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867762628 0 0) 0x7fc52c061fa0 con 0x7fc52c065b50 2023-08-17T00:18:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52959a700 1 -- 172.21.15.153:0/1133342973 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5140033f0 con 0x7fc52c065b50 2023-08-17T00:18:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc529d9b700 1 -- 172.21.15.153:0/1133342973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c151b90 msgr2=0x7fc52c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:18:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc529d9b700 1 --2- 172.21.15.153:0/1133342973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c151b90 0x7fc52c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc529d9b700 1 -- 172.21.15.153:0/1133342973 >> v1:172.21.15.153:6789/0 conn(0x7fc52c065b50 legacy=0x7fc52c064870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc529d9b700 1 -- 172.21.15.153:0/1133342973 --> v2:172.21.15.153:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0621f0 con 0x7fc52c063290 2023-08-17T00:18:47.424 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc529d9b700 1 --2- 172.21.15.153:0/1133342973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c063290 0x7fc52c065660 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7fc520009760 tx=0x7fc520009060).ready entity=mon.0 client_cookie=2d07c319fd156501 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:47.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52959a700 1 -- 172.21.15.153:0/1133342973 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000f510 con 0x7fc52c063290 2023-08-17T00:18:47.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52959a700 1 -- 172.21.15.153:0/1133342973 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000f670 con 0x7fc52c063290 2023-08-17T00:18:47.425 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc52959a700 1 -- 172.21.15.153:0/1133342973 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000f9f0 con 0x7fc52c063290 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 -- 172.21.15.153:0/1133342973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c063290 msgr2=0x7fc52c065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1133342973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c063290 0x7fc52c065660 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 rx=0x7fc520009760 tx=0x7fc520009060).stop 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 -- 172.21.15.153:0/1133342973 shutdown_connections 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1133342973 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c063290 0x7fc52c065660 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1133342973 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c151b90 0x7fc52c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 -- 172.21.15.153:0/1133342973 >> 172.21.15.153:0/1133342973 conn(0x7fc52c0c7150 msgr2=0x7fc52c0c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 -- 172.21.15.153:0/1133342973 shutdown_connections 2023-08-17T00:18:47.426 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.417+0000 7fc530ef1700 1 -- 172.21.15.153:0/1133342973 wait complete. 2023-08-17T00:18:47.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 Processor -- start 2023-08-17T00:18:47.427 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 -- start start 2023-08-17T00:18:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c063290 0x7fc52c0be860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc52c065b50 0x7fc52c14dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 0x7fc52c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0be3d0 con 0x7fc52c151b90 2023-08-17T00:18:47.429 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0bd7c0 con 0x7fc52c065b50 2023-08-17T00:18:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc530ef1700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c0bdaa0 con 0x7fc52c063290 2023-08-17T00:18:47.430 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc52ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 0x7fc52c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc52ad9d700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 0x7fc52c150520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:40806/0 (socket says 172.21.15.153:40806) 2023-08-17T00:18:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc52ad9d700 1 -- 172.21.15.153:0/1535641128 learned_addr learned my addr 172.21.15.153:0/1535641128 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:18:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.421+0000 7fc52a59c700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c063290 0x7fc52c0be860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.431 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc529d9b700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc52c065b50 0x7fc52c14dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc52ad9d700 1 -- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c063290 msgr2=0x7fc52c0be860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc52ad9d700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c063290 0x7fc52c0be860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc52ad9d700 1 -- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc52c065b50 msgr2=0x7fc52c14dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc52ad9d700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc52c065b50 0x7fc52c14dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc52ad9d700 1 -- 172.21.15.153:0/1535641128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200092a0 con 0x7fc52c151b90 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc52ad9d700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 0x7fc52c150520 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7fc524005ad0 tx=0x7fc524001650).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:47.432 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524005d30 con 0x7fc52c151b90 2023-08-17T00:18:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc524005e90 con 0x7fc52c151b90 2023-08-17T00:18:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c0bdd80 con 0x7fc52c151b90 2023-08-17T00:18:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524007320 con 0x7fc52c151b90 2023-08-17T00:18:47.433 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c0bed50 con 0x7fc52c151b90 2023-08-17T00:18:47.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52c0be540 con 0x7fc52c151b90 2023-08-17T00:18:47.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.425+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fc524010030 con 0x7fc52c151b90 2023-08-17T00:18:47.434 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.429+0000 7fc51a7fc700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc50c05a120 0x7fc50c05c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:18:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.429+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fc524073da0 con 0x7fc52c151b90 2023-08-17T00:18:47.435 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.429+0000 7fc52a59c700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc50c05a120 0x7fc50c05c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:18:47.436 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.429+0000 7fc52a59c700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc50c05a120 0x7fc50c05c5e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fc51c00bb10 tx=0x7fc51c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:18:47.441 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.437+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fc524047980 con 0x7fc52c151b90 2023-08-17T00:18:47.601 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.593+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc52c0624d0 con 0x7fc50c05a120 2023-08-17T00:18:47.609 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.601+0000 7fc51a7fc700 1 -- 172.21.15.153:0/1535641128 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68517 (secure 0 0 0) 0x7fc52c0624d0 con 0x7fc50c05a120 2023-08-17T00:18:47.611 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:18:47.613 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc50c05a120 msgr2=0x7fc50c05c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc50c05a120 0x7fc50c05c5e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 rx=0x7fc51c00bb10 tx=0x7fc51c008040).stop 2023-08-17T00:18:47.614 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 msgr2=0x7fc52c150520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:18:47.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 0x7fc52c150520 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 rx=0x7fc524005ad0 tx=0x7fc524001650).stop 2023-08-17T00:18:47.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 shutdown_connections 2023-08-17T00:18:47.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fc50c05a120 0x7fc50c05c5e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.615 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fc52c151b90 0x7fc52c150520 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc52c065b50 0x7fc52c14dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 --2- 172.21.15.153:0/1535641128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc52c063290 0x7fc52c0be860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:18:47.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 >> 172.21.15.153:0/1535641128 conn(0x7fc52c0c7150 msgr2=0x7fc52c14eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:18:47.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 shutdown_connections 2023-08-17T00:18:47.616 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:18:47.605+0000 7fc530ef1700 1 -- 172.21.15.153:0/1535641128 wait complete. 2023-08-17T00:18:47.617 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:18:47.635 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":673,"stamp":"2023-08-17T00:18:47.542844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458720,"kb_used_data":19488,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752516000,"statfs":{"total":773094113280,"available":770576384000,"internally_reserved":0,"allocated":19955712,"data_stored":9413224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620480,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-55,"num_read_kb":-59,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-2097174,"num_keys_recovered":-3,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.013561"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540890+0000","last_change":"2023-08-17T00:02:47.206275+0000","last_active":"2023-08-17T00:18:35.540890+0000","last_peered":"2023-08-17T00:18:35.540890+0000","last_clean":"2023-08-17T00:18:35.540890+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:18:35.540890+0000","last_undegraded":"2023-08-17T00:18:35.540890+0000","last_fullsized":"2023-08-17T00:18:35.540890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":189,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542826+0000","last_change":"2023-08-17T00:02:47.206235+0000","last_active":"2023-08-17T00:18:35.542826+0000","last_peered":"2023-08-17T00:18:35.542826+0000","last_clean":"2023-08-17T00:18:35.542826+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:18:35.542826+0000","last_undegraded":"2023-08-17T00:18:35.542826+0000","last_fullsized":"2023-08-17T00:18:35.542826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.539826+0000","last_change":"2023-08-17T00:02:46.266735+0000","last_active":"2023-08-17T00:18:35.539826+0000","last_peered":"2023-08-17T00:18:35.539826+0000","last_clean":"2023-08-17T00:18:35.539826+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:18:35.539826+0000","last_undegraded":"2023-08-17T00:18:35.539826+0000","last_fullsized":"2023-08-17T00:18:35.539826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":181,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.682253+0000","last_change":"2023-08-17T00:02:46.351651+0000","last_active":"2023-08-17T00:18:35.682253+0000","last_peered":"2023-08-17T00:18:35.682253+0000","last_clean":"2023-08-17T00:18:35.682253+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:18:35.682253+0000","last_undegraded":"2023-08-17T00:18:35.682253+0000","last_fullsized":"2023-08-17T00:18:35.682253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.540743+0000","last_change":"2023-08-17T00:02:46.352488+0000","last_active":"2023-08-17T00:18:35.540743+0000","last_peered":"2023-08-17T00:18:35.540743+0000","last_clean":"2023-08-17T00:18:35.540743+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:18:35.540743+0000","last_undegraded":"2023-08-17T00:18:35.540743+0000","last_fullsized":"2023-08-17T00:18:35.540743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":157,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.542685+0000","last_change":"2023-08-17T00:02:46.266546+0000","last_active":"2023-08-17T00:18:35.542685+0000","last_peered":"2023-08-17T00:18:35.542685+0000","last_clean":"2023-08-17T00:18:35.542685+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:18:35.542685+0000","last_undegraded":"2023-08-17T00:18:35.542685+0000","last_fullsized":"2023-08-17T00:18:35.542685+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.538876+0000","last_change":"2023-08-17T00:02:46.267677+0000","last_active":"2023-08-17T00:18:35.538876+0000","last_peered":"2023-08-17T00:18:35.538876+0000","last_clean":"2023-08-17T00:18:35.538876+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:18:35.538876+0000","last_undegraded":"2023-08-17T00:18:35.538876+0000","last_fullsized":"2023-08-17T00:18:35.538876+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.541024+0000","last_change":"2023-08-17T00:02:46.422676+0000","last_active":"2023-08-17T00:18:35.541024+0000","last_peered":"2023-08-17T00:18:35.541024+0000","last_clean":"2023-08-17T00:18:35.541024+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:18:35.541024+0000","last_undegraded":"2023-08-17T00:18:35.541024+0000","last_fullsized":"2023-08-17T00:18:35.541024+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:45.231588+0000","last_clean_scrub_stamp":"2023-08-17T00:02:45.231588+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":161,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-08-17T00:18:35.677540+0000","last_change":"2023-08-17T00:02:45.246542+0000","last_active":"2023-08-17T00:18:35.677540+0000","last_peered":"2023-08-17T00:18:35.677540+0000","last_clean":"2023-08-17T00:18:35.677540+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:18:35.677540+0000","last_undegraded":"2023-08-17T00:18:35.677540+0000","last_fullsized":"2023-08-17T00:18:35.677540+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:02:44.221671+0000","last_clean_scrub_stamp":"2023-08-17T00:02:44.221671+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542338,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.073},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.51200000000000001},"max":{"1min":1.413,"5min":2.331,"15min":8.7769999999999992},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.097,"5min":1.099,"15min":1.0980000000000001},"min":{"1min":0.77500000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.403,"5min":3.1269999999999998,"15min":9.6530000000000005},"last":1.105}]},{"osd":1,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.131,"15min":1.1240000000000001},"min":{"1min":0.82899999999999996,"5min":0.72099999999999997,"15min":0.48199999999999998},"max":{"1min":1.45,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.038},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.349,"15min":1.204},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.57199999999999995},"max":{"1min":1.464,"5min":20.373000000000001,"15min":20.373000000000001},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.198,"15min":1.1140000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":9.8840000000000003,"15min":9.8840000000000003},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.2230000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":12.411,"15min":12.411},"last":1.2070000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1990000000000001,"15min":1.153},"min":{"1min":0.91300000000000003,"5min":0.628,"15min":0.55900000000000005},"max":{"1min":1.4299999999999999,"5min":4.0579999999999998,"15min":7.7080000000000002},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.77500000000000002,"15min":0.57599999999999996},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":13.074999999999999},"last":1.3660000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.143,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.597,"5min":4.6029999999999998,"15min":13.784000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.208,"15min":1.2070000000000001},"min":{"1min":0.74199999999999999,"5min":0.64600000000000002,"15min":0.44700000000000001},"max":{"1min":1.411,"5min":4.1529999999999996,"15min":10.045999999999999},"last":1.0720000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1859999999999999,"15min":1.2789999999999999},"min":{"1min":0.80500000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.536,"5min":1.657,"15min":14.435},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.462,"15min":1.365},"min":{"1min":0.83299999999999996,"5min":0.754,"15min":0.64500000000000002},"max":{"1min":1.4299999999999999,"5min":20.285,"15min":20.285},"last":1.2250000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.788,"15min":1.506},"min":{"1min":0.77300000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5580000000000001,"5min":45.982999999999997,"15min":45.982999999999997},"last":1.274},{"interface":"front","average":{"1min":1.228,"5min":1.343,"15min":1.3200000000000001},"min":{"1min":0.74399999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.51,"5min":10.542999999999999,"15min":11.365},"last":1.4379999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542338,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.085,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.56299999999999994,"15min":0.32700000000000001},"max":{"1min":1.484,"5min":6.2050000000000001,"15min":8.0909999999999993},"last":1.179},{"interface":"front","average":{"1min":1.169,"5min":1.0960000000000001,"15min":1.119},"min":{"1min":0.80100000000000005,"5min":0.61399999999999999,"15min":0.502},"max":{"1min":1.6459999999999999,"5min":4.468,"15min":10.519},"last":0.96099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.113,"15min":1.157},"min":{"1min":0.84399999999999997,"5min":0.65800000000000003,"15min":0.443},"max":{"1min":1.5249999999999999,"5min":1.7569999999999999,"15min":10.704000000000001},"last":0.871},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.0840000000000001},"min":{"1min":0.83099999999999996,"5min":0.69299999999999995,"15min":0.47199999999999998},"max":{"1min":1.502,"5min":2.2490000000000001,"15min":11.391999999999999},"last":1.119}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1910000000000001,"15min":1.1699999999999999},"min":{"1min":0.83599999999999997,"5min":0.79300000000000004,"15min":0.372},"max":{"1min":1.361,"5min":1.792,"15min":5.3799999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.302,"15min":1.298},"min":{"1min":1.0349999999999999,"5min":0.76400000000000001,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":3.5409999999999999,"15min":10.669},"last":1.2270000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":1.0720000000000001,"5min":0.80400000000000005,"15min":0.48599999999999999},"max":{"1min":1.4350000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.25},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.2609999999999999},"min":{"1min":0.873,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.5449999999999999,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.4019999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1679999999999999,"15min":1.2569999999999999},"min":{"1min":0.874,"5min":0.77500000000000002,"15min":0.56699999999999995},"max":{"1min":1.3859999999999999,"5min":1.758,"15min":10.632},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.208,"15min":1.2390000000000001},"min":{"1min":0.85499999999999998,"5min":0.71799999999999997,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.3720000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.40899999999999997},"max":{"1min":1.661,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.456},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.4199999999999999,"15min":1.411},"min":{"1min":1.054,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.78,"5min":8.4809999999999999,"15min":10.592000000000001},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3460000000000001,"15min":1.345},"min":{"1min":0.98999999999999999,"5min":0.74299999999999999,"15min":0.65100000000000002},"max":{"1min":1.655,"5min":5.2199999999999998,"15min":11.51},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.66900000000000004},"max":{"1min":1.671,"5min":3.7519999999999998,"15min":5.4100000000000001},"last":1.6020000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542339,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.093,"15min":1.0780000000000001},"min":{"1min":0.76500000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.988,"5min":1.988,"15min":15.007999999999999},"last":1.093},{"interface":"front","average":{"1min":1.145,"5min":1.125,"15min":1.127},"min":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.623,"5min":1.946,"15min":16.838999999999999},"last":1.274}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.117,"15min":1.0860000000000001},"min":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5840000000000001,"5min":1.746,"15min":4.2270000000000003},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1200000000000001,"15min":1.143},"min":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.58799999999999997},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":9.6579999999999995},"last":0.91500000000000004}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1279999999999999,"15min":1.1930000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.67700000000000005},"max":{"1min":1.7649999999999999,"5min":1.8100000000000001,"15min":16.675000000000001},"last":1.383},{"interface":"front","average":{"1min":1.179,"5min":1.1919999999999999,"15min":1.1870000000000001},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":11.949},"last":0.87}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.64100000000000001},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":13.125},"last":1.446},{"interface":"front","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89900000000000002,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.8740000000000001,"5min":1.887,"15min":8.4809999999999999},"last":1.3520000000000001}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1499999999999999,"15min":1.214},"min":{"1min":0.76800000000000002,"5min":0.63200000000000001,"15min":0.58599999999999997},"max":{"1min":2.286,"5min":2.286,"15min":17.510000000000002},"last":1.03},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.294},"min":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.54000000000000004},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":19.591000000000001},"last":1.169}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.22,"15min":1.294},"min":{"1min":0.72199999999999998,"5min":0.63700000000000001,"15min":0.60099999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":17.158000000000001},"last":1.218},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.2490000000000001,"15min":1.3049999999999999},"min":{"1min":0.91900000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":17.050000000000001},"last":1.319}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.347,"15min":1.4059999999999999},"min":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.57199999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":18.158000000000001},"last":1.494},{"interface":"front","average":{"1min":1.361,"5min":1.3660000000000001,"15min":1.4139999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":14.818},"last":1.099}]}]},{"osd":3,"up_from":14,"seq":60129542338,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.35499999999999998,"15min":0.32000000000000001},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.7529999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92900000000000005,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.45200000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":2.6709999999999998},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.82199999999999995},"min":{"1min":0.64700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.159,"5min":3.274,"15min":11.215999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.76000000000000001,"5min":0.43099999999999999,"15min":0.35499999999999998},"max":{"1min":1.319,"5min":1.377,"15min":3.7810000000000001},"last":1.1319999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.92700000000000005,"15min":0.89900000000000002},"min":{"1min":0.78100000000000003,"5min":0.52000000000000002,"15min":0.33800000000000002},"max":{"1min":1.4359999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.171},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.0820000000000001,"15min":1.036},"min":{"1min":0.98099999999999998,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":1.548,"5min":1.6020000000000001,"15min":2.6360000000000001},"last":1.0389999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2470000000000001,"15min":1.1970000000000001},"min":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.58099999999999996},"max":{"1min":1.5049999999999999,"5min":1.7829999999999999,"15min":3.9449999999999998},"last":1.371},{"interface":"front","average":{"1min":1.224,"5min":1.222,"15min":1.1919999999999999},"min":{"1min":0.81000000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4490000000000001,"5min":1.631,"15min":3.9790000000000001},"last":1.3859999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":1.0900000000000001,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.5,"5min":1.706,"15min":2.1309999999999998},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.284,"15min":1.2430000000000001},"min":{"1min":1.2370000000000001,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.5329999999999999,"5min":1.829,"15min":2.6789999999999998},"last":1.45}]},{"osd":6,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2290000000000001,"15min":1.2030000000000001},"min":{"1min":1.0349999999999999,"5min":0.61099999999999999,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":1.708,"15min":3.4249999999999998},"last":1.343},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.1870000000000001},"min":{"1min":1.0169999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.3879999999999999,"5min":1.891,"15min":3.585},"last":1.4830000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.2230000000000001},"min":{"1min":1.105,"5min":0.81399999999999995,"15min":0.52600000000000002},"max":{"1min":1.4990000000000001,"5min":1.996,"15min":2.1930000000000001},"last":1.415},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.202},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.9890000000000001,"15min":2.0419999999999998},"last":1.208}]}]},{"osd":2,"up_from":14,"seq":60129542338,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.292,"5min":1.855,"15min":3.1099999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.28799999999999998},"max":{"1min":1.1259999999999999,"5min":1.337,"15min":6.4859999999999998},"last":0.93700000000000006}]},{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91500000000000004,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.1379999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.107,"5min":1.1140000000000001,"15min":1.014},"min":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.3819999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":1.1459999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0089999999999999,"15min":0.98099999999999998},"min":{"1min":0.66900000000000004,"5min":0.63400000000000001,"15min":0.42899999999999999},"max":{"1min":1.595,"5min":1.595,"15min":5.4059999999999997},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93500000000000005,"15min":0.92000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.361,"5min":1.6020000000000001,"15min":3.3410000000000002},"last":1.097}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3280000000000001,"15min":1.2250000000000001},"min":{"1min":0.82699999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.409,"15min":1.286},"min":{"1min":0.92500000000000004,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.472,"5min":17.988,"15min":17.988},"last":1.3029999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3240000000000001,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.58799999999999997},"max":{"1min":1.665,"5min":1.7430000000000001,"15min":12.914},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2310000000000001,"15min":1.242},"min":{"1min":0.98199999999999998,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":9.5519999999999996},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1839999999999999,"15min":1.2290000000000001},"min":{"1min":0.95499999999999996,"5min":0.74299999999999999,"15min":0.58899999999999997},"max":{"1min":1.625,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3140000000000001,"15min":1.319},"min":{"1min":0.96299999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.7190000000000001,"5min":1.909,"15min":12.698},"last":1.462}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":1.0800000000000001,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.621,"5min":1.798,"15min":10.592000000000001},"last":1.673},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.335},"min":{"1min":0.91400000000000003,"5min":0.81100000000000005,"15min":0.54100000000000004},"max":{"1min":1.6930000000000001,"5min":1.891,"15min":11.417},"last":1.6579999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542338,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.879,"15min":0.84699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.309},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":6.4329999999999998},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.39400000000000002},"max":{"1min":1.454,"5min":1.6200000000000001,"15min":13.093},"last":1.286}]},{"osd":2,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.314},"max":{"1min":1.1879999999999999,"5min":1.3069999999999999,"15min":5.4989999999999997},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":1.077}]},{"osd":3,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.036,"15min":1.014},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":1.3620000000000001,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":1.411},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.93200000000000005},"min":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":1.359,"15min":12.981999999999999},"last":1.149}]},{"osd":4,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.123,"15min":1.1439999999999999},"min":{"1min":0.875,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":20.548999999999999},"last":1.105},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.238,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.48,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":1.3120000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2889999999999999,"15min":1.2809999999999999},"min":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0739999999999998,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.454},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2609999999999999,"15min":1.2350000000000001},"min":{"1min":0.84299999999999997,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":5.4240000000000004},"last":1.343}]},{"osd":6,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.244,"15min":1.244},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4370000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.524},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.232,"15min":1.2090000000000001},"min":{"1min":1.02,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.694,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.256}]},{"osd":7,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.294,"15min":1.29},"min":{"1min":0.96199999999999997,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.468,"5min":1.8959999999999999,"15min":6.9779999999999998},"last":1.502},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3049999999999999,"15min":1.3080000000000001},"min":{"1min":1.0189999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.649,"5min":1.9119999999999999,"15min":13.131},"last":1.381}]}]},{"osd":0,"up_from":14,"seq":60129542339,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78100000000000003,"15min":0.82899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.30299999999999999},"max":{"1min":1.248,"5min":1.3080000000000001,"15min":18.442},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.143,"5min":1.571,"15min":7.9720000000000004},"last":0.90700000000000003}]},{"osd":2,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.94199999999999995},"min":{"1min":0.70399999999999996,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.347,"5min":1.347,"15min":18.481999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93500000000000005,"15min":0.92200000000000004},"min":{"1min":0.73499999999999999,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":1.258,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":1.069}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.86299999999999999},"min":{"1min":0.61099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3879999999999999,"5min":1.46,"15min":1.613},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0129999999999999,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.4390000000000001,"5min":1.585,"15min":18.577000000000002},"last":0.99099999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.159,"15min":1.1020000000000001},"min":{"1min":0.90400000000000003,"5min":0.754,"15min":0.56399999999999995},"max":{"1min":1.476,"5min":1.6830000000000001,"15min":1.7609999999999999},"last":1.347},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.21,"15min":1.2490000000000001},"min":{"1min":1.0720000000000001,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.587,"5min":1.792,"15min":18.515000000000001},"last":1.095}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.26,"15min":1.2809999999999999},"min":{"1min":1.069,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.534,"5min":1.746,"15min":17.152999999999999},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.258,"15min":1.2230000000000001},"min":{"1min":1.0600000000000001,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.5229999999999999,"5min":1.6379999999999999,"15min":1.984},"last":1.214}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.284},"min":{"1min":1.0349999999999999,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.518,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.29},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.2589999999999999},"min":{"1min":0.95999999999999996,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.706,"5min":2.0619999999999998,"15min":17.204000000000001},"last":1.151}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0329999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.228},{"interface":"front","average":{"1min":1.27,"5min":1.244,"15min":1.1990000000000001},"min":{"1min":1.03,"5min":0.80300000000000005,"15min":0.60199999999999998},"max":{"1min":1.5129999999999999,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.054}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.042},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.38300000000000001},"max":{"1min":1.371,"5min":1.53,"15min":7.1379999999999999},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.0429999999999999,"15min":1.0489999999999999},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.6279999999999999,"5min":1.8169999999999999,"15min":7.7380000000000004},"last":1.3129999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1819999999999999,"15min":1.218},"min":{"1min":0.81999999999999995,"5min":0.61599999999999999,"15min":0.42499999999999999},"max":{"1min":1.4379999999999999,"5min":1.665,"15min":8.3800000000000008},"last":1.157},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.198},"min":{"1min":0.85699999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.347,"5min":1.732,"15min":6.9000000000000004},"last":1.2869999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0900000000000001,"15min":1.2050000000000001},"min":{"1min":0.82499999999999996,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.581,"5min":1.581,"15min":18.431000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.292},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36699999999999999},"max":{"1min":1.2989999999999999,"5min":1.5880000000000001,"15min":36.531999999999996},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.099,"15min":1.1000000000000001},"min":{"1min":0.71699999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4419999999999999,"5min":1.8600000000000001,"15min":2.9889999999999999},"last":1.105},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1659999999999999,"15min":1.3660000000000001},"min":{"1min":0.96399999999999997,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.5389999999999999,"5min":1.875,"15min":36.530000000000001},"last":1.2649999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.276,"15min":1.2549999999999999},"min":{"1min":0.98499999999999999,"5min":0.76900000000000002,"15min":0.433},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":6.3250000000000002},"last":1.0009999999999999},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3069999999999999,"15min":1.2969999999999999},"min":{"1min":0.91200000000000003,"5min":0.80700000000000005,"15min":0.63500000000000001},"max":{"1min":2.605,"5min":2.605,"15min":9.4120000000000008},"last":1.2330000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.3},"min":{"1min":0.80300000000000005,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6559999999999999,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3580000000000001,"15min":1.3520000000000001},"min":{"1min":1.1120000000000001,"5min":0.88900000000000001,"15min":0.49399999999999999},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.0820000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.875,"5min":0.72499999999999998,"15min":0.56100000000000005},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":3.645},"last":1.381},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.371},"min":{"1min":0.95899999999999996,"5min":0.84599999999999997,"15min":0.629},"max":{"1min":1.875,"5min":1.879,"15min":8.327},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:18:47.640 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.640 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.641 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.641 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.641 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.641 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.642 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.642 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-17T00:02:45.231588+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=45, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.642 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-17T00:02:44.221671+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=2, tm_sec=44, tm_wday=3, tm_yday=229, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=17, tm_hour=0, tm_min=18, tm_sec=41, tm_wday=3, tm_yday=229, tm_isdst=0) 2023-08-17T00:18:47.642 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-17T00:18:48.180 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:18:48.187 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:07.644 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-17T00:19:07.804 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.796+0000 7efe2a439700 1 Processor -- start 2023-08-17T00:19:07.805 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.796+0000 7efe2a439700 1 -- start start 2023-08-17T00:19:07.807 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe2a439700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe240a8df0 0x7efe240c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:07.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe2a439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24068820 0x7efe24068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:07.808 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe2a439700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe241585a0 con 0x7efe24061fa0 2023-08-17T00:19:07.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe2a439700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe24066400 con 0x7efe240a8df0 2023-08-17T00:19:07.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe2a439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe24069170 con 0x7efe24068820 2023-08-17T00:19:07.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe29437700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe240a8df0 0x7efe240c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:07.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe29c38700 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7efe24061fa0 0x7efe24062400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.153:34496/0 (socket says 172.21.15.153:34496) 2023-08-17T00:19:07.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe29c38700 1 -- 172.21.15.153:0/2633147048 learned_addr learned my addr 172.21.15.153:0/2633147048 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:19:07.809 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe29437700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe240a8df0 0x7efe240c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.153:48784/0 (socket says 172.21.15.153:48784) 2023-08-17T00:19:07.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.800+0000 7efe28c36700 1 --2- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24068820 0x7efe24068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:07.810 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe29437700 1 -- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24068820 msgr2=0x7efe24068c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe29437700 1 --2- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24068820 0x7efe24068c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe29437700 1 -- 172.21.15.153:0/2633147048 >> v1:172.21.15.178:6789/0 conn(0x7efe24061fa0 legacy=0x7efe24062400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe29437700 1 -- 172.21.15.153:0/2633147048 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240b9d30 con 0x7efe240a8df0 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe29437700 1 --2- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe240a8df0 0x7efe240c1490 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7efe20006fd0 tx=0x7efe20006f40).ready entity=mon.1 client_cookie=be6da040a4b46650 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe1bfff700 1 -- 172.21.15.153:0/2633147048 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20005880 con 0x7efe240a8df0 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe1bfff700 1 -- 172.21.15.153:0/2633147048 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200059e0 con 0x7efe240a8df0 2023-08-17T00:19:07.811 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe1bfff700 1 -- 172.21.15.153:0/2633147048 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20005d60 con 0x7efe240a8df0 2023-08-17T00:19:07.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 -- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe240a8df0 msgr2=0x7efe240c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:07.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 --2- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe240a8df0 0x7efe240c1490 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7efe20006fd0 tx=0x7efe20006f40).stop 2023-08-17T00:19:07.812 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 -- 172.21.15.153:0/2633147048 shutdown_connections 2023-08-17T00:19:07.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 --2- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24068820 0x7efe24068c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:07.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 --2- 172.21.15.153:0/2633147048 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe240a8df0 0x7efe240c1490 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:07.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 -- 172.21.15.153:0/2633147048 >> 172.21.15.153:0/2633147048 conn(0x7efe240c6620 msgr2=0x7efe240c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:19:07.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 -- 172.21.15.153:0/2633147048 shutdown_connections 2023-08-17T00:19:07.813 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.804+0000 7efe2a439700 1 -- 172.21.15.153:0/2633147048 wait complete. 2023-08-17T00:19:07.815 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.808+0000 7efe2a439700 1 Processor -- start 2023-08-17T00:19:07.816 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.808+0000 7efe2a439700 1 -- start start 2023-08-17T00:19:07.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24061fa0 0x7efe24155ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:07.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe24068820 0x7efe240bda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:07.819 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 0x7efe240bdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:07.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240bbef0 con 0x7efe240a8df0 2023-08-17T00:19:07.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240bccf0 con 0x7efe24068820 2023-08-17T00:19:07.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240bc0e0 con 0x7efe24061fa0 2023-08-17T00:19:07.820 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 0x7efe240bdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:07.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29437700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24061fa0 0x7efe24155ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:07.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 0x7efe240bdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56716/0 (socket says 172.21.15.153:56716) 2023-08-17T00:19:07.821 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 -- 172.21.15.153:0/3000966820 learned_addr learned my addr 172.21.15.153:0/3000966820 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:19:07.822 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe28c36700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe24068820 0x7efe240bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:07.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 -- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24061fa0 msgr2=0x7efe24155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:07.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24061fa0 0x7efe24155ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:07.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 -- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe24068820 msgr2=0x7efe240bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:07.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe24068820 0x7efe240bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:07.824 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 -- 172.21.15.153:0/3000966820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20009250 con 0x7efe240a8df0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe29c38700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 0x7efe240bdf80 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7efe1c00c7c0 tx=0x7efe1c001510).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c005d30 con 0x7efe240a8df0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c005e90 con 0x7efe240a8df0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe240bc3c0 con 0x7efe240a8df0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c0072e0 con 0x7efe240a8df0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.812+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe240bc980 con 0x7efe240a8df0 2023-08-17T00:19:07.825 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.816+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2406b4c0 con 0x7efe240a8df0 2023-08-17T00:19:07.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.816+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7efe1c010070 con 0x7efe240a8df0 2023-08-17T00:19:07.826 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.816+0000 7efe197fa700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efe0805a150 0x7efe0805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:07.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.816+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7efe1c0736b0 con 0x7efe240a8df0 2023-08-17T00:19:07.827 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.820+0000 7efe29437700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efe0805a150 0x7efe0805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:07.828 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.820+0000 7efe29437700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efe0805a150 0x7efe0805c610 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7efe20006f80 tx=0x7efe20016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:07.832 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.824+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7efe1c047400 con 0x7efe240a8df0 2023-08-17T00:19:07.991 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.984+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 --> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe2405e300 con 0x7efe0805a150 2023-08-17T00:19:07.999 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.992+0000 7efe197fa700 1 -- 172.21.15.153:0/3000966820 <== mgr.4105 v2:172.21.15.178:6832/32723 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+68710 (secure 0 0 0) 0x7efe2405e300 con 0x7efe0805a150 2023-08-17T00:19:08.001 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:19:08.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efe0805a150 msgr2=0x7efe0805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.003 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efe0805a150 0x7efe0805c610 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7efe20006f80 tx=0x7efe20016000).stop 2023-08-17T00:19:08.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 msgr2=0x7efe240bdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.004 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 0x7efe240bdf80 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 rx=0x7efe1c00c7c0 tx=0x7efe1c001510).stop 2023-08-17T00:19:08.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 shutdown_connections 2023-08-17T00:19:08.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7efe0805a150 0x7efe0805c610 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7efe240a8df0 0x7efe240bdf80 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe24068820 0x7efe240bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.005 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 --2- 172.21.15.153:0/3000966820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe24061fa0 0x7efe24155ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 >> 172.21.15.153:0/3000966820 conn(0x7efe240c6620 msgr2=0x7efe24157b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:19:08.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 shutdown_connections 2023-08-17T00:19:08.006 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:07.996+0000 7efe2a439700 1 -- 172.21.15.153:0/3000966820 wait complete. 2023-08-17T00:19:08.007 INFO:teuthology.orchestra.run.smithi153.stderr:dumped all 2023-08-17T00:19:08.023 INFO:teuthology.orchestra.run.smithi153.stdout:{"pg_ready":true,"pg_map":{"version":683,"stamp":"2023-08-17T00:19:07.548008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458720,"kb_used_data":19488,"kb_used_omap":0,"kb_used_meta":2439168,"kb_avail":752516000,"statfs":{"total":773094113280,"available":770576384000,"internally_reserved":0,"allocated":19955712,"data_stored":9413224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2497708032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12620480,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-55,"num_read_kb":-59,"num_write":-91,"num_write_kb":-12349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-5,"num_bytes_recovered":-2097174,"num_keys_recovered":-3,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.013561"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:56.364110+0000","last_change":"2023-08-17T00:18:56.364110+0000","last_active":"2023-08-17T00:18:56.364110+0000","last_peered":"2023-08-17T00:18:56.364110+0000","last_clean":"2023-08-17T00:18:56.364110+0000","last_became_active":"2023-08-17T00:02:47.205941+0000","last_became_peered":"2023-08-17T00:02:47.205941+0000","last_unstale":"2023-08-17T00:18:56.364110+0000","last_undegraded":"2023-08-17T00:18:56.364110+0000","last_fullsized":"2023-08-17T00:18:56.364110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:56.363999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:56.363999+0000","last_clean_scrub_stamp":"2023-08-17T00:18:56.363999+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":194,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:46.206676+0000","last_change":"2023-08-17T00:18:46.206676+0000","last_active":"2023-08-17T00:18:46.206676+0000","last_peered":"2023-08-17T00:18:46.206676+0000","last_clean":"2023-08-17T00:18:46.206676+0000","last_became_active":"2023-08-17T00:02:47.205469+0000","last_became_peered":"2023-08-17T00:02:47.205469+0000","last_unstale":"2023-08-17T00:18:46.206676+0000","last_undegraded":"2023-08-17T00:18:46.206676+0000","last_fullsized":"2023-08-17T00:18:46.206676+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:46.206437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:46.206437+0000","last_clean_scrub_stamp":"2023-08-17T00:18:46.206437+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:54.337250+0000","last_change":"2023-08-17T00:18:54.337250+0000","last_active":"2023-08-17T00:18:54.337250+0000","last_peered":"2023-08-17T00:18:54.337250+0000","last_clean":"2023-08-17T00:18:54.337250+0000","last_became_active":"2023-08-17T00:02:46.266277+0000","last_became_peered":"2023-08-17T00:02:46.266277+0000","last_unstale":"2023-08-17T00:18:54.337250+0000","last_undegraded":"2023-08-17T00:18:54.337250+0000","last_fullsized":"2023-08-17T00:18:54.337250+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:54.337053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:54.337053+0000","last_clean_scrub_stamp":"2023-08-17T00:18:54.337053+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":186,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:48.104085+0000","last_change":"2023-08-17T00:18:48.104085+0000","last_active":"2023-08-17T00:18:48.104085+0000","last_peered":"2023-08-17T00:18:48.104085+0000","last_clean":"2023-08-17T00:18:48.104085+0000","last_became_active":"2023-08-17T00:02:46.351158+0000","last_became_peered":"2023-08-17T00:02:46.351158+0000","last_unstale":"2023-08-17T00:18:48.104085+0000","last_undegraded":"2023-08-17T00:18:48.104085+0000","last_fullsized":"2023-08-17T00:18:48.104085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:48.103929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:48.103929+0000","last_clean_scrub_stamp":"2023-08-17T00:18:48.103929+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:47.337574+0000","last_change":"2023-08-17T00:18:47.337574+0000","last_active":"2023-08-17T00:18:47.337574+0000","last_peered":"2023-08-17T00:18:47.337574+0000","last_clean":"2023-08-17T00:18:47.337574+0000","last_became_active":"2023-08-17T00:02:46.351998+0000","last_became_peered":"2023-08-17T00:02:46.351998+0000","last_unstale":"2023-08-17T00:18:47.337574+0000","last_undegraded":"2023-08-17T00:18:47.337574+0000","last_fullsized":"2023-08-17T00:18:47.337574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:47.337366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:47.337366+0000","last_clean_scrub_stamp":"2023-08-17T00:18:47.337366+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":162,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:48.555668+0000","last_change":"2023-08-17T00:18:48.555668+0000","last_active":"2023-08-17T00:18:48.555668+0000","last_peered":"2023-08-17T00:18:48.555668+0000","last_clean":"2023-08-17T00:18:48.555668+0000","last_became_active":"2023-08-17T00:02:46.266173+0000","last_became_peered":"2023-08-17T00:02:46.266173+0000","last_unstale":"2023-08-17T00:18:48.555668+0000","last_undegraded":"2023-08-17T00:18:48.555668+0000","last_fullsized":"2023-08-17T00:18:48.555668+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:48.555549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:48.555549+0000","last_clean_scrub_stamp":"2023-08-17T00:18:48.555549+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:46.293333+0000","last_change":"2023-08-17T00:18:46.293333+0000","last_active":"2023-08-17T00:18:46.293333+0000","last_peered":"2023-08-17T00:18:46.293333+0000","last_clean":"2023-08-17T00:18:46.293333+0000","last_became_active":"2023-08-17T00:02:46.267220+0000","last_became_peered":"2023-08-17T00:02:46.267220+0000","last_unstale":"2023-08-17T00:18:46.293333+0000","last_undegraded":"2023-08-17T00:18:46.293333+0000","last_fullsized":"2023-08-17T00:18:46.293333+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:46.293185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:46.293185+0000","last_clean_scrub_stamp":"2023-08-17T00:18:46.293185+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:49.325956+0000","last_change":"2023-08-17T00:18:49.325956+0000","last_active":"2023-08-17T00:18:49.325956+0000","last_peered":"2023-08-17T00:18:49.325956+0000","last_clean":"2023-08-17T00:18:49.325956+0000","last_became_active":"2023-08-17T00:02:46.422404+0000","last_became_peered":"2023-08-17T00:02:46.422404+0000","last_unstale":"2023-08-17T00:18:49.325956+0000","last_undegraded":"2023-08-17T00:18:49.325956+0000","last_fullsized":"2023-08-17T00:18:49.325956+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:49.325617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:49.325617+0000","last_clean_scrub_stamp":"2023-08-17T00:18:49.325617+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":166,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-08-17T00:18:45.056415+0000","last_change":"2023-08-17T00:18:45.056415+0000","last_active":"2023-08-17T00:18:45.056415+0000","last_peered":"2023-08-17T00:18:45.056415+0000","last_clean":"2023-08-17T00:18:45.056415+0000","last_became_active":"2023-08-17T00:02:45.245998+0000","last_became_peered":"2023-08-17T00:02:45.245998+0000","last_unstale":"2023-08-17T00:18:45.056415+0000","last_undegraded":"2023-08-17T00:18:45.056415+0000","last_fullsized":"2023-08-17T00:18:45.056415+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-17T00:18:45.056292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-17T00:18:45.056292+0000","last_clean_scrub_stamp":"2023-08-17T00:18:45.056292+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0920000000000001,"15min":1.073},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.51200000000000001},"max":{"1min":1.413,"5min":2.331,"15min":8.7769999999999992},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.099,"15min":1.0980000000000001},"min":{"1min":0.77500000000000002,"5min":0.54700000000000004,"15min":0.47399999999999998},"max":{"1min":1.403,"5min":3.1269999999999998,"15min":9.6530000000000005},"last":1.0429999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.131,"15min":1.1240000000000001},"min":{"1min":0.82899999999999996,"5min":0.72099999999999997,"15min":0.48199999999999998},"max":{"1min":1.45,"5min":1.5329999999999999,"15min":9.8800000000000008},"last":1.246},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.349,"15min":1.204},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.57199999999999995},"max":{"1min":1.464,"5min":20.373000000000001,"15min":20.373000000000001},"last":1.419}]},{"osd":2,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":1.198,"15min":1.1140000000000001},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.437},"max":{"1min":1.4299999999999999,"5min":9.8840000000000003,"15min":9.8840000000000003},"last":1.306},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.2929999999999999,"15min":1.2230000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.57899999999999996},"max":{"1min":1.482,"5min":12.411,"15min":12.411},"last":1.3859999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.1990000000000001,"15min":1.153},"min":{"1min":0.91300000000000003,"5min":0.628,"15min":0.55900000000000005},"max":{"1min":1.4299999999999999,"5min":4.0579999999999998,"15min":7.7080000000000002},"last":1.194},{"interface":"front","average":{"1min":1.196,"5min":1.228,"15min":1.2649999999999999},"min":{"1min":0.80500000000000005,"5min":0.77500000000000002,"15min":0.57599999999999996},"max":{"1min":1.3460000000000001,"5min":1.5680000000000001,"15min":13.074999999999999},"last":1.161}]},{"osd":4,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.143,"15min":1.1890000000000001},"min":{"1min":0.65800000000000003,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.597,"5min":4.6029999999999998,"15min":13.784000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.208,"15min":1.2070000000000001},"min":{"1min":0.74199999999999999,"5min":0.64600000000000002,"15min":0.44700000000000001},"max":{"1min":1.411,"5min":4.1529999999999996,"15min":10.045999999999999},"last":1.361}]},{"osd":5,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1859999999999999,"15min":1.2789999999999999},"min":{"1min":0.80500000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.536,"5min":1.657,"15min":14.435},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.462,"15min":1.365},"min":{"1min":0.83299999999999996,"5min":0.754,"15min":0.64500000000000002},"max":{"1min":1.4299999999999999,"5min":20.285,"15min":20.285},"last":1.119}]},{"osd":6,"last update":"Thu Aug 17 00:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.788,"15min":1.506},"min":{"1min":0.77300000000000002,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.5580000000000001,"5min":45.982999999999997,"15min":45.982999999999997},"last":1.28},{"interface":"front","average":{"1min":1.228,"5min":1.343,"15min":1.3200000000000001},"min":{"1min":0.74399999999999999,"5min":0.53200000000000003,"15min":0.51200000000000001},"max":{"1min":1.51,"5min":10.542999999999999,"15min":11.365},"last":1.4610000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542342,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299660,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":94072180,"statfs":{"total":96636764160,"available":96329912320,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":1.085,"15min":1.0760000000000001},"min":{"1min":0.81899999999999995,"5min":0.56299999999999994,"15min":0.32700000000000001},"max":{"1min":1.484,"5min":6.2050000000000001,"15min":8.0909999999999993},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.0960000000000001,"15min":1.119},"min":{"1min":0.80100000000000005,"5min":0.61399999999999999,"15min":0.502},"max":{"1min":1.6459999999999999,"5min":4.468,"15min":10.519},"last":0.96499999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.113,"15min":1.157},"min":{"1min":0.84399999999999997,"5min":0.65800000000000003,"15min":0.443},"max":{"1min":1.5249999999999999,"5min":1.7569999999999999,"15min":10.704000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.089,"15min":1.0840000000000001},"min":{"1min":0.83099999999999996,"5min":0.69299999999999995,"15min":0.47199999999999998},"max":{"1min":1.502,"5min":2.2490000000000001,"15min":11.391999999999999},"last":0.92700000000000005}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.1910000000000001,"15min":1.1699999999999999},"min":{"1min":0.83599999999999997,"5min":0.79300000000000004,"15min":0.372},"max":{"1min":1.361,"5min":1.792,"15min":5.3799999999999999},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.302,"15min":1.298},"min":{"1min":1.0349999999999999,"5min":0.76400000000000001,"15min":0.56699999999999995},"max":{"1min":1.516,"5min":3.5409999999999999,"15min":10.669},"last":1.2649999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2470000000000001,"15min":1.2090000000000001},"min":{"1min":1.0720000000000001,"5min":0.80400000000000005,"15min":0.48599999999999999},"max":{"1min":1.4350000000000001,"5min":3.4809999999999999,"15min":11.475},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.2609999999999999},"min":{"1min":0.873,"5min":0.74199999999999999,"15min":0.64500000000000002},"max":{"1min":1.5449999999999999,"5min":3.5339999999999998,"15min":5.3330000000000002},"last":1.278}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1679999999999999,"15min":1.2569999999999999},"min":{"1min":0.874,"5min":0.77500000000000002,"15min":0.56699999999999995},"max":{"1min":1.3859999999999999,"5min":1.758,"15min":10.632},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.208,"15min":1.2390000000000001},"min":{"1min":0.85499999999999998,"5min":0.71799999999999997,"15min":0.58099999999999996},"max":{"1min":1.577,"5min":2.4420000000000002,"15min":11.438000000000001},"last":1.002}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.2629999999999999,"15min":1.2589999999999999},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.40899999999999997},"max":{"1min":1.661,"5min":6.1660000000000004,"15min":6.1660000000000004},"last":1.109},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.4199999999999999,"15min":1.411},"min":{"1min":1.054,"5min":0.69399999999999995,"15min":0.628},"max":{"1min":1.78,"5min":8.4809999999999999,"15min":10.592000000000001},"last":1.3089999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3460000000000001,"15min":1.345},"min":{"1min":0.98999999999999999,"5min":0.74299999999999999,"15min":0.65100000000000002},"max":{"1min":1.655,"5min":5.2199999999999998,"15min":11.51},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.331,"5min":1.3600000000000001,"15min":1.3779999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.66900000000000004},"max":{"1min":1.671,"5min":3.7519999999999998,"15min":5.4100000000000001},"last":1.385}]}]},{"osd":5,"up_from":14,"seq":60129542343,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.093,"15min":1.0780000000000001},"min":{"1min":0.76500000000000001,"5min":0.47199999999999998,"15min":0.44700000000000001},"max":{"1min":1.988,"5min":1.988,"15min":15.007999999999999},"last":1.046},{"interface":"front","average":{"1min":1.145,"5min":1.125,"15min":1.127},"min":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.51700000000000002},"max":{"1min":1.623,"5min":1.946,"15min":16.838999999999999},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.117,"15min":1.0860000000000001},"min":{"1min":0.65600000000000003,"5min":0.57299999999999995,"15min":0.498},"max":{"1min":1.5840000000000001,"5min":1.746,"15min":4.2270000000000003},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.1200000000000001,"15min":1.143},"min":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.58799999999999997},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":9.6579999999999995},"last":1.1830000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1279999999999999,"15min":1.1930000000000001},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.67700000000000005},"max":{"1min":1.7649999999999999,"5min":1.8100000000000001,"15min":16.675000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.1919999999999999,"15min":1.1870000000000001},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.60299999999999998},"max":{"1min":1.9470000000000001,"5min":1.9470000000000001,"15min":11.949},"last":1.3779999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2130000000000001,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.64100000000000001},"max":{"1min":2.2509999999999999,"5min":2.2509999999999999,"15min":13.125},"last":1.234},{"interface":"front","average":{"1min":1.25,"5min":1.2250000000000001,"15min":1.2230000000000001},"min":{"1min":0.89900000000000002,"5min":0.748,"15min":0.63400000000000001},"max":{"1min":1.8740000000000001,"5min":1.887,"15min":8.4809999999999999},"last":1.1339999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.1499999999999999,"15min":1.214},"min":{"1min":0.76800000000000002,"5min":0.63200000000000001,"15min":0.58599999999999997},"max":{"1min":2.286,"5min":2.286,"15min":17.510000000000002},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.22,"15min":1.294},"min":{"1min":0.74199999999999999,"5min":0.64500000000000002,"15min":0.54000000000000004},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":19.591000000000001},"last":1.462}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.22,"15min":1.294},"min":{"1min":0.72199999999999998,"5min":0.63700000000000001,"15min":0.60099999999999998},"max":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":17.158000000000001},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.2490000000000001,"15min":1.3049999999999999},"min":{"1min":0.91900000000000004,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":17.050000000000001},"last":1.3129999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.347,"15min":1.4059999999999999},"min":{"1min":0.82399999999999995,"5min":0.76300000000000001,"15min":0.57199999999999995},"max":{"1min":2.3359999999999999,"5min":2.3359999999999999,"15min":18.158000000000001},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.361,"5min":1.3660000000000001,"15min":1.4139999999999999},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.0459999999999998,"5min":2.0459999999999998,"15min":14.818},"last":1.4890000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542342,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.82799999999999996,"15min":0.80300000000000005},"min":{"1min":0.58199999999999996,"5min":0.35499999999999998,"15min":0.32000000000000001},"max":{"1min":1.048,"5min":1.3640000000000001,"15min":1.7529999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.92900000000000005,"15min":0.874},"min":{"1min":0.60999999999999999,"5min":0.45200000000000001,"15min":0.38100000000000001},"max":{"1min":1.25,"5min":1.4490000000000001,"15min":2.6709999999999998},"last":0.98599999999999999}]},{"osd":1,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86099999999999999,"15min":0.82199999999999995},"min":{"1min":0.64700000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.159,"5min":3.274,"15min":11.215999999999999},"last":0.746},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.875,"15min":0.86799999999999999},"min":{"1min":0.76000000000000001,"5min":0.43099999999999999,"15min":0.35499999999999998},"max":{"1min":1.319,"5min":1.377,"15min":3.7810000000000001},"last":1.145}]},{"osd":2,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.92700000000000005,"15min":0.89900000000000002},"min":{"1min":0.78100000000000003,"5min":0.52000000000000002,"15min":0.33800000000000002},"max":{"1min":1.4359999999999999,"5min":1.587,"15min":2.0270000000000001},"last":1.494},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.0820000000000001,"15min":1.036},"min":{"1min":0.98099999999999998,"5min":0.47399999999999998,"15min":0.433},"max":{"1min":1.548,"5min":1.6020000000000001,"15min":2.6360000000000001},"last":1.47}]},{"osd":4,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.2470000000000001,"15min":1.1970000000000001},"min":{"1min":0.84099999999999997,"5min":0.79800000000000004,"15min":0.58099999999999996},"max":{"1min":1.5049999999999999,"5min":1.7829999999999999,"15min":3.9449999999999998},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.222,"15min":1.1919999999999999},"min":{"1min":0.81000000000000005,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4490000000000001,"5min":1.631,"15min":3.9790000000000001},"last":1.087}]},{"osd":5,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.2130000000000001,"15min":1.1830000000000001},"min":{"1min":1.0900000000000001,"5min":0.623,"15min":0.54600000000000004},"max":{"1min":1.5,"5min":1.706,"15min":2.1309999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3280000000000001,"5min":1.284,"15min":1.2430000000000001},"min":{"1min":1.2370000000000001,"5min":0.66800000000000004,"15min":0.61399999999999999},"max":{"1min":1.5329999999999999,"5min":1.829,"15min":2.6789999999999998},"last":1.5529999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2290000000000001,"15min":1.2030000000000001},"min":{"1min":1.0349999999999999,"5min":0.61099999999999999,"15min":0.58299999999999996},"max":{"1min":1.431,"5min":1.708,"15min":3.4249999999999998},"last":1.24},{"interface":"front","average":{"1min":1.194,"5min":1.2050000000000001,"15min":1.1870000000000001},"min":{"1min":1.0169999999999999,"5min":0.68799999999999994,"15min":0.48399999999999999},"max":{"1min":1.3879999999999999,"5min":1.891,"15min":3.585},"last":1.3240000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:19 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.2230000000000001},"min":{"1min":1.105,"5min":0.81399999999999995,"15min":0.52600000000000002},"max":{"1min":1.4990000000000001,"5min":1.996,"15min":2.1930000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.202},"min":{"1min":1.0069999999999999,"5min":0.67300000000000004,"15min":0.64000000000000001},"max":{"1min":1.4650000000000001,"5min":1.9890000000000001,"15min":2.0419999999999998},"last":1.4470000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52200000000000002,"5min":0.41799999999999998,"15min":0.34599999999999997},"max":{"1min":1.292,"5min":1.855,"15min":3.1099999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.81999999999999995,"15min":0.81000000000000005},"min":{"1min":0.50900000000000001,"5min":0.45800000000000002,"15min":0.28799999999999998},"max":{"1min":1.1259999999999999,"5min":1.337,"15min":6.4859999999999998},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.91500000000000004,"15min":0.85099999999999998},"min":{"1min":0.59899999999999998,"5min":0.441,"15min":0.35999999999999999},"max":{"1min":1.1379999999999999,"5min":4.4160000000000004,"15min":4.4160000000000004},"last":0.87},{"interface":"front","average":{"1min":1.107,"5min":1.1140000000000001,"15min":1.014},"min":{"1min":0.63800000000000001,"5min":0.57599999999999996,"15min":0.376},"max":{"1min":1.3819999999999999,"5min":4.3150000000000004,"15min":4.3150000000000004},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0089999999999999,"15min":0.98099999999999998},"min":{"1min":0.66900000000000004,"5min":0.63400000000000001,"15min":0.42899999999999999},"max":{"1min":1.595,"5min":1.595,"15min":5.4059999999999997},"last":1.242},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93500000000000005,"15min":0.92000000000000004},"min":{"1min":0.64300000000000002,"5min":0.48599999999999999,"15min":0.42699999999999999},"max":{"1min":1.361,"5min":1.6020000000000001,"15min":3.3410000000000002},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3280000000000001,"15min":1.2250000000000001},"min":{"1min":0.82699999999999996,"5min":0.67300000000000004,"15min":0.48399999999999999},"max":{"1min":1.4430000000000001,"5min":18.597999999999999,"15min":18.597999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.22,"5min":1.409,"15min":1.286},"min":{"1min":0.92500000000000004,"5min":0.753,"15min":0.60099999999999998},"max":{"1min":1.472,"5min":17.988,"15min":17.988},"last":1.1060000000000001}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.3240000000000001,"15min":1.3300000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.58799999999999997},"max":{"1min":1.665,"5min":1.7430000000000001,"15min":12.914},"last":1.286},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2310000000000001,"15min":1.242},"min":{"1min":0.98199999999999998,"5min":0.746,"15min":0.64200000000000002},"max":{"1min":1.5780000000000001,"5min":1.802,"15min":9.5519999999999996},"last":1.091}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.1839999999999999,"15min":1.2290000000000001},"min":{"1min":0.95499999999999996,"5min":0.74299999999999999,"15min":0.58899999999999997},"max":{"1min":1.625,"5min":1.7789999999999999,"15min":13.864000000000001},"last":1.0780000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3140000000000001,"15min":1.319},"min":{"1min":0.96299999999999997,"5min":0.84399999999999997,"15min":0.71799999999999997},"max":{"1min":1.7190000000000001,"5min":1.909,"15min":12.698},"last":1.1819999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":1.3280000000000001,"15min":1.3340000000000001},"min":{"1min":1.0800000000000001,"5min":0.77200000000000002,"15min":0.69599999999999995},"max":{"1min":1.621,"5min":1.798,"15min":10.592000000000001},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.3140000000000001,"15min":1.335},"min":{"1min":0.91400000000000003,"5min":0.81100000000000005,"15min":0.54100000000000004},"max":{"1min":1.6930000000000001,"5min":1.891,"15min":11.417},"last":1.268}]}]},{"osd":1,"up_from":14,"seq":60129542342,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.879,"15min":0.84699999999999998},"min":{"1min":0.497,"5min":0.497,"15min":0.309},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":6.4329999999999998},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.51300000000000001,"5min":0.44600000000000001,"15min":0.39400000000000002},"max":{"1min":1.454,"5min":1.6200000000000001,"15min":13.093},"last":0.98499999999999999}]},{"osd":2,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.83699999999999997,"15min":0.80500000000000005},"min":{"1min":0.67400000000000004,"5min":0.504,"15min":0.314},"max":{"1min":1.1879999999999999,"5min":1.3069999999999999,"15min":5.4989999999999997},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93400000000000005,"15min":0.89900000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.432},"max":{"1min":1.2789999999999999,"5min":1.6930000000000001,"15min":7.0620000000000003},"last":1.2190000000000001}]},{"osd":3,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.036,"15min":1.014},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":1.3620000000000001,"5min":1.5529999999999999,"15min":8.8279999999999994},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.92100000000000004,"15min":0.93200000000000005},"min":{"1min":0.56799999999999995,"5min":0.54500000000000004,"15min":0.39000000000000001},"max":{"1min":1.3080000000000001,"5min":1.359,"15min":12.981999999999999},"last":0.89800000000000002}]},{"osd":4,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.123,"15min":1.1439999999999999},"min":{"1min":0.875,"5min":0.64900000000000002,"15min":0.57599999999999996},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":20.548999999999999},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.238,"15min":1.206},"min":{"1min":0.86699999999999999,"5min":0.72599999999999998,"15min":0.59699999999999998},"max":{"1min":1.48,"5min":1.8300000000000001,"15min":8.8670000000000009},"last":1.1279999999999999}]},{"osd":5,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2889999999999999,"15min":1.2809999999999999},"min":{"1min":0.63200000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.0739999999999998,"5min":2.0830000000000002,"15min":13.170999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.2609999999999999,"15min":1.2350000000000001},"min":{"1min":0.84299999999999997,"5min":0.70799999999999996,"15min":0.68899999999999995},"max":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":5.4240000000000004},"last":1.4830000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.244,"15min":1.244},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.4370000000000001,"5min":1.9730000000000001,"15min":13.050000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.232,"15min":1.2090000000000001},"min":{"1min":1.02,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.694,"5min":1.8740000000000001,"15min":5.5359999999999996},"last":1.4039999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:12 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.294,"15min":1.29},"min":{"1min":0.96199999999999997,"5min":0.873,"15min":0.79100000000000004},"max":{"1min":1.468,"5min":1.8959999999999999,"15min":6.9779999999999998},"last":1.365},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3049999999999999,"15min":1.3080000000000001},"min":{"1min":1.0189999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.649,"5min":1.9119999999999999,"15min":13.131},"last":1.286}]}]},{"osd":0,"up_from":14,"seq":60129542343,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311948,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":94059892,"statfs":{"total":96636764160,"available":96317329408,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78100000000000003,"15min":0.82899999999999996},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.30299999999999999},"max":{"1min":1.248,"5min":1.3080000000000001,"15min":18.442},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83899999999999997,"15min":0.84299999999999997},"min":{"1min":0.54800000000000004,"5min":0.40899999999999997,"15min":0.28899999999999998},"max":{"1min":1.143,"5min":1.571,"15min":7.9720000000000004},"last":0.88800000000000001}]},{"osd":2,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.89000000000000001,"15min":0.94199999999999995},"min":{"1min":0.70399999999999996,"5min":0.45200000000000001,"15min":0.34999999999999998},"max":{"1min":1.347,"5min":1.347,"15min":18.481999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.98299999999999998,"5min":0.93500000000000005,"15min":0.92200000000000004},"min":{"1min":0.73499999999999999,"5min":0.45900000000000002,"15min":0.39800000000000002},"max":{"1min":1.258,"5min":1.4970000000000001,"15min":8.0079999999999991},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.90300000000000002,"15min":0.86299999999999999},"min":{"1min":0.61099999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.3879999999999999,"5min":1.46,"15min":1.613},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0129999999999999,"15min":1.052},"min":{"1min":0.51000000000000001,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.4390000000000001,"5min":1.585,"15min":18.577000000000002},"last":1.2589999999999999}]},{"osd":4,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.159,"15min":1.1020000000000001},"min":{"1min":0.90400000000000003,"5min":0.754,"15min":0.56399999999999995},"max":{"1min":1.476,"5min":1.6830000000000001,"15min":1.7609999999999999},"last":1.006},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.21,"15min":1.2490000000000001},"min":{"1min":1.0720000000000001,"5min":0.72199999999999998,"15min":0.56200000000000006},"max":{"1min":1.587,"5min":1.792,"15min":18.515000000000001},"last":1.153}]},{"osd":5,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.26,"15min":1.2809999999999999},"min":{"1min":1.069,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.534,"5min":1.746,"15min":17.152999999999999},"last":1.298},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.258,"15min":1.2230000000000001},"min":{"1min":1.0600000000000001,"5min":0.748,"15min":0.63200000000000001},"max":{"1min":1.5229999999999999,"5min":1.6379999999999999,"15min":1.984},"last":1.2210000000000001}]},{"osd":6,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.2410000000000001,"15min":1.284},"min":{"1min":1.0349999999999999,"5min":0.76300000000000001,"15min":0.64200000000000002},"max":{"1min":1.518,"5min":1.8480000000000001,"15min":18.545000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.2769999999999999,"5min":1.23,"15min":1.2589999999999999},"min":{"1min":0.95999999999999996,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.706,"5min":2.0619999999999998,"15min":17.204000000000001},"last":1.1140000000000001}]},{"osd":7,"last update":"Thu Aug 17 00:18:21 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2689999999999999,"15min":1.2909999999999999},"min":{"1min":1.0329999999999999,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.804,"5min":1.8779999999999999,"15min":17.236999999999998},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.27,"5min":1.244,"15min":1.1990000000000001},"min":{"1min":1.03,"5min":0.80300000000000005,"15min":0.60199999999999998},"max":{"1min":1.5129999999999999,"5min":1.8500000000000001,"15min":2.0750000000000002},"last":1.2749999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575047,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307852,"kb_used_data":2436,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":94063988,"statfs":{"total":96636764160,"available":96321523712,"internally_reserved":0,"allocated":2494464,"data_stored":1176653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":1.0089999999999999,"15min":1.042},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.38300000000000001},"max":{"1min":1.371,"5min":1.53,"15min":7.1379999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.135,"5min":1.0429999999999999,"15min":1.0489999999999999},"min":{"1min":0.64000000000000001,"5min":0.55800000000000005,"15min":0.40100000000000002},"max":{"1min":1.6279999999999999,"5min":1.8169999999999999,"15min":7.7380000000000004},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1819999999999999,"15min":1.218},"min":{"1min":0.81999999999999995,"5min":0.61599999999999999,"15min":0.42499999999999999},"max":{"1min":1.4379999999999999,"5min":1.665,"15min":8.3800000000000008},"last":1.292},{"interface":"front","average":{"1min":1.123,"5min":1.1679999999999999,"15min":1.198},"min":{"1min":0.85699999999999998,"5min":0.58599999999999997,"15min":0.48099999999999998},"max":{"1min":1.347,"5min":1.732,"15min":6.9000000000000004},"last":1.212}]},{"osd":2,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.0900000000000001,"15min":1.2050000000000001},"min":{"1min":0.82499999999999996,"5min":0.627,"15min":0.47399999999999998},"max":{"1min":1.581,"5min":1.581,"15min":18.431000000000001},"last":1.111},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.292},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.36699999999999999},"max":{"1min":1.2989999999999999,"5min":1.5880000000000001,"15min":36.531999999999996},"last":1.075}]},{"osd":3,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.099,"15min":1.1000000000000001},"min":{"1min":0.71699999999999997,"5min":0.64600000000000002,"15min":0.60699999999999998},"max":{"1min":1.4419999999999999,"5min":1.8600000000000001,"15min":2.9889999999999999},"last":1.157},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.1659999999999999,"15min":1.3660000000000001},"min":{"1min":0.96399999999999997,"5min":0.58299999999999996,"15min":0.40400000000000003},"max":{"1min":1.5389999999999999,"5min":1.875,"15min":36.530000000000001},"last":1.391}]},{"osd":5,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.276,"15min":1.2549999999999999},"min":{"1min":0.98499999999999999,"5min":0.76900000000000002,"15min":0.433},"max":{"1min":2.2959999999999998,"5min":2.2959999999999998,"15min":6.3250000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.6140000000000001,"5min":1.3069999999999999,"15min":1.2969999999999999},"min":{"1min":0.91200000000000003,"5min":0.80700000000000005,"15min":0.63500000000000001},"max":{"1min":2.605,"5min":2.605,"15min":9.4120000000000008},"last":1.2549999999999999}]},{"osd":6,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2529999999999999,"15min":1.3},"min":{"1min":0.80300000000000005,"5min":0.69299999999999995,"15min":0.44700000000000001},"max":{"1min":1.6559999999999999,"5min":1.9730000000000001,"15min":8.4190000000000005},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.4059999999999999,"5min":1.3580000000000001,"15min":1.3520000000000001},"min":{"1min":1.1120000000000001,"5min":0.88900000000000001,"15min":0.49399999999999999},"max":{"1min":1.637,"5min":1.8260000000000001,"15min":6.1689999999999996},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Aug 17 00:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.2490000000000001,"15min":1.2390000000000001},"min":{"1min":0.875,"5min":0.72499999999999998,"15min":0.56100000000000005},"max":{"1min":1.7190000000000001,"5min":1.7190000000000001,"15min":3.645},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.371},"min":{"1min":0.95899999999999996,"5min":0.84599999999999997,"15min":0.629},"max":{"1min":1.875,"5min":1.879,"15min":8.327},"last":1.222}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-17T00:19:08.027 DEBUG:teuthology.orchestra.run.smithi153:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-17T00:19:08.175 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.168+0000 7fd451307700 1 Processor -- start 2023-08-17T00:19:08.176 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.168+0000 7fd451307700 1 -- start start 2023-08-17T00:19:08.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd451307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd451307700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd44c0c11b0 0x7fd44c154370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.179 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd451307700 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44c0bfd10 con 0x7fd44c153f50 2023-08-17T00:19:08.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd451307700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c154860 con 0x7fd44c0c11b0 2023-08-17T00:19:08.180 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd451307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c154af0 con 0x7fd44c0c57a0 2023-08-17T00:19:08.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd450b06700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd44c0c11b0 0x7fd44c154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.153:35614/0 (socket says 172.21.15.153:35614) 2023-08-17T00:19:08.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 -- 172.21.15.153:0/85093928 learned_addr learned my addr 172.21.15.153:0/85093928 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:19:08.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 -- 172.21.15.153:0/85093928 >> v2:172.21.15.178:3300/0 conn(0x7fd44c0c11b0 msgr2=0x7fd44c154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:19:08.181 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 --2- 172.21.15.153:0/85093928 >> v2:172.21.15.178:3300/0 conn(0x7fd44c0c11b0 0x7fd44c154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 -- 172.21.15.153:0/85093928 >> v1:172.21.15.178:6789/0 conn(0x7fd44c153f50 legacy=0x7fd44c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.172+0000 7fd44bfff700 1 -- 172.21.15.153:0/85093928 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c154dd0 con 0x7fd44c0c57a0 2023-08-17T00:19:08.182 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd44bfff700 1 --2- 172.21.15.153:0/85093928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0c5b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fd43c006fd0 tx=0x7fd43c0090f0).ready entity=mon.2 client_cookie=f0385fda495c4d34 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:08.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd44affd700 1 -- 172.21.15.153:0/85093928 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00b580 con 0x7fd44c0c57a0 2023-08-17T00:19:08.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd44affd700 1 -- 172.21.15.153:0/85093928 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c00b6e0 con 0x7fd44c0c57a0 2023-08-17T00:19:08.183 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd44affd700 1 -- 172.21.15.153:0/85093928 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00ba60 con 0x7fd44c0c57a0 2023-08-17T00:19:08.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 -- 172.21.15.153:0/85093928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 msgr2=0x7fd44c0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 --2- 172.21.15.153:0/85093928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0c5b80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7fd43c006fd0 tx=0x7fd43c0090f0).stop 2023-08-17T00:19:08.184 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 -- 172.21.15.153:0/85093928 shutdown_connections 2023-08-17T00:19:08.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 --2- 172.21.15.153:0/85093928 >> v2:172.21.15.178:3300/0 conn(0x7fd44c0c11b0 0x7fd44c154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 --2- 172.21.15.153:0/85093928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0c5b80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 -- 172.21.15.153:0/85093928 >> 172.21.15.153:0/85093928 conn(0x7fd44c062a70 msgr2=0x7fd44c0ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:19:08.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 -- 172.21.15.153:0/85093928 shutdown_connections 2023-08-17T00:19:08.185 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.176+0000 7fd451307700 1 -- 172.21.15.153:0/85093928 wait complete. 2023-08-17T00:19:08.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 Processor -- start 2023-08-17T00:19:08.186 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 -- start start 2023-08-17T00:19:08.187 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 0x7fd44c164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c153f50 0x7fd44c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0aec00 con 0x7fd44c0c11b0 2023-08-17T00:19:08.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0add20 con 0x7fd44c153f50 2023-08-17T00:19:08.188 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd451307700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0adff0 con 0x7fd44c0c57a0 2023-08-17T00:19:08.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 0x7fd44c164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 0x7fd44c164cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56718/0 (socket says 172.21.15.153:56718) 2023-08-17T00:19:08.189 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 -- 172.21.15.153:0/2373515645 learned_addr learned my addr 172.21.15.153:0/2373515645 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44b7fe700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd450b06700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c153f50 0x7fd44c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 -- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 msgr2=0x7fd44c0ad830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0ad830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 -- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c153f50 msgr2=0x7fd44c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c153f50 0x7fd44c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.190 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 -- 172.21.15.153:0/2373515645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c009370 con 0x7fd44c0c11b0 2023-08-17T00:19:08.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd450b06700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c153f50 0x7fd44c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-17T00:19:08.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.180+0000 7fd44bfff700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 0x7fd44c164cd0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7fd43c009fd0 tx=0x7fd43c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:08.191 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c00b850 con 0x7fd44c0c11b0 2023-08-17T00:19:08.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c00b9b0 con 0x7fd44c0c11b0 2023-08-17T00:19:08.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c01c670 con 0x7fd44c0c11b0 2023-08-17T00:19:08.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c0ae2d0 con 0x7fd44c0c11b0 2023-08-17T00:19:08.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c0ae890 con 0x7fd44c0c11b0 2023-08-17T00:19:08.192 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c06b4c0 con 0x7fd44c0c11b0 2023-08-17T00:19:08.193 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.184+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fd43c02c070 con 0x7fd44c0c11b0 2023-08-17T00:19:08.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.188+0000 7fd433fff700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd43805a150 0x7fd43805c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.194 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.188+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fd43c075c20 con 0x7fd44c0c11b0 2023-08-17T00:19:08.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.188+0000 7fd44b7fe700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd43805a150 0x7fd43805c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.195 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.188+0000 7fd44b7fe700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd43805a150 0x7fd43805c610 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fd44c0b0930 tx=0x7fd440007d40).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:08.200 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.192+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fd43c049860 con 0x7fd44c0c11b0 2023-08-17T00:19:08.365 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.360+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fd44c0bf9a0 con 0x7fd44c0c11b0 2023-08-17T00:19:08.372 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.364+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd43c049860 con 0x7fd44c0c11b0 2023-08-17T00:19:08.373 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.364+0000 7fd433fff700 1 -- 172.21.15.153:0/2373515645 <== mon.0 v2:172.21.15.153:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v28)=0 v28) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd43c02a070 con 0x7fd44c0c11b0 2023-08-17T00:19:08.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd43805a150 msgr2=0x7fd43805c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd43805a150 0x7fd43805c610 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 rx=0x7fd44c0b0930 tx=0x7fd440007d40).stop 2023-08-17T00:19:08.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 msgr2=0x7fd44c164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.377 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 0x7fd44c164cd0 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 rx=0x7fd43c009fd0 tx=0x7fd43c017000).stop 2023-08-17T00:19:08.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 shutdown_connections 2023-08-17T00:19:08.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fd43805a150 0x7fd43805c610 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c153f50 0x7fd44c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0c57a0 0x7fd44c0ad830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 --2- 172.21.15.153:0/2373515645 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fd44c0c11b0 0x7fd44c164cd0 unknown :-1 s=CLOSED pgs=2152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.378 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.368+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 >> 172.21.15.153:0/2373515645 conn(0x7fd44c062a70 msgr2=0x7fd44c1533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:19:08.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.372+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 shutdown_connections 2023-08-17T00:19:08.379 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.372+0000 7fd451307700 1 -- 172.21.15.153:0/2373515645 wait complete. 2023-08-17T00:19:08.397 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-17T00:19:08.398 DEBUG:teuthology.orchestra.run.smithi153:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-17T00:19:08.554 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 Processor -- start 2023-08-17T00:19:08.555 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 -- start start 2023-08-17T00:19:08.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80632e0 0x7fa6f80a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6f80629b0 0x7fa6f80bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.558 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 -- --> v1:172.21.15.153:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f8065240 con 0x7fa6f80a8b70 2023-08-17T00:19:08.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f8062e40 con 0x7fa6f80629b0 2023-08-17T00:19:08.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.548+0000 7fa6ff3db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80638a0 con 0x7fa6f80632e0 2023-08-17T00:19:08.559 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fd177700 1 --1- >> v1:172.21.15.153:6789/0 conn(0x7fa6f80a8b70 0x7fa6f80656d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.153:6789/0 says I am v1:172.21.15.153:48846/0 (socket says 172.21.15.153:48846) 2023-08-17T00:19:08.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fd177700 1 -- 172.21.15.153:0/1386456350 learned_addr learned my addr 172.21.15.153:0/1386456350 (peer_addr_for_me v1:172.21.15.153:0/0) 2023-08-17T00:19:08.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fc976700 1 --2- 172.21.15.153:0/1386456350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80632e0 0x7fa6f80a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.560 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fd978700 1 --2- 172.21.15.153:0/1386456350 >> v2:172.21.15.178:3300/0 conn(0x7fa6f80629b0 0x7fa6f80bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.562 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6effff700 1 -- 172.21.15.153:0/1386456350 <== mon.0 v1:172.21.15.153:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993422517 0 0) 0x7fa6f8065240 con 0x7fa6f80a8b70 2023-08-17T00:19:08.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6effff700 1 -- 172.21.15.153:0/1386456350 --> v1:172.21.15.153:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6e40033f0 con 0x7fa6f80a8b70 2023-08-17T00:19:08.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fc976700 1 -- 172.21.15.153:0/1386456350 >> v2:172.21.15.178:3300/0 conn(0x7fa6f80629b0 msgr2=0x7fa6f80bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-17T00:19:08.563 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fc976700 1 --2- 172.21.15.153:0/1386456350 >> v2:172.21.15.178:3300/0 conn(0x7fa6f80629b0 0x7fa6f80bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fc976700 1 -- 172.21.15.153:0/1386456350 >> v1:172.21.15.153:6789/0 conn(0x7fa6f80a8b70 legacy=0x7fa6f80656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fc976700 1 -- 172.21.15.153:0/1386456350 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f8065de0 con 0x7fa6f80632e0 2023-08-17T00:19:08.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6fc976700 1 --2- 172.21.15.153:0/1386456350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80632e0 0x7fa6f80a8f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa6e8009760 tx=0x7fa6e8009060).ready entity=mon.2 client_cookie=eb15da5d23127928 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:08.564 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6effff700 1 -- 172.21.15.153:0/1386456350 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800d4a0 con 0x7fa6f80632e0 2023-08-17T00:19:08.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6effff700 1 -- 172.21.15.153:0/1386456350 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa6e800d600 con 0x7fa6f80632e0 2023-08-17T00:19:08.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.552+0000 7fa6effff700 1 -- 172.21.15.153:0/1386456350 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800d980 con 0x7fa6f80632e0 2023-08-17T00:19:08.565 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 -- 172.21.15.153:0/1386456350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80632e0 msgr2=0x7fa6f80a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/1386456350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80632e0 0x7fa6f80a8f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fa6e8009760 tx=0x7fa6e8009060).stop 2023-08-17T00:19:08.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 -- 172.21.15.153:0/1386456350 shutdown_connections 2023-08-17T00:19:08.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/1386456350 >> v2:172.21.15.178:3300/0 conn(0x7fa6f80629b0 0x7fa6f80bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.566 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/1386456350 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80632e0 0x7fa6f80a8f50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 -- 172.21.15.153:0/1386456350 >> 172.21.15.153:0/1386456350 conn(0x7fa6f80c7150 msgr2=0x7fa6f80c3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:19:08.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 -- 172.21.15.153:0/1386456350 shutdown_connections 2023-08-17T00:19:08.567 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 -- 172.21.15.153:0/1386456350 wait complete. 2023-08-17T00:19:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 Processor -- start 2023-08-17T00:19:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 -- start start 2023-08-17T00:19:08.571 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.556+0000 7fa6ff3db700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 0x7fa6f8159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6f80632e0 0x7fa6f814be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80a8b70 0x7fa6f816be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 -- --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80bdf30 con 0x7fa6f80629b0 2023-08-17T00:19:08.572 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f80ac170 con 0x7fa6f80632e0 2023-08-17T00:19:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f8159b40 con 0x7fa6f80a8b70 2023-08-17T00:19:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 0x7fa6f8159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 --2- >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 0x7fa6f8159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.153:3300/0 says I am v2:172.21.15.153:56720/0 (socket says 172.21.15.153:56720) 2023-08-17T00:19:08.573 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 -- 172.21.15.153:0/4130294522 learned_addr learned my addr 172.21.15.153:0/4130294522 (peer_addr_for_me v2:172.21.15.153:0/0) 2023-08-17T00:19:08.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fc976700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6f80632e0 0x7fa6f814be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd978700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80a8b70 0x7fa6f816be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 -- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80a8b70 msgr2=0x7fa6f816be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.574 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80a8b70 0x7fa6f816be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 -- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6f80632e0 msgr2=0x7fa6f814be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6f80632e0 0x7fa6f814be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 -- 172.21.15.153:0/4130294522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e80092a0 con 0x7fa6f80629b0 2023-08-17T00:19:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6fd177700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 0x7fa6f8159650 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7fa6f400c590 tx=0x7fa6f4007c80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40072e0 con 0x7fa6f80629b0 2023-08-17T00:19:08.575 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa6f4007440 con 0x7fa6f80629b0 2023-08-17T00:19:08.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f80abe90 con 0x7fa6f80629b0 2023-08-17T00:19:08.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f40057a0 con 0x7fa6f80629b0 2023-08-17T00:19:08.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.560+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f80bdbc0 con 0x7fa6f80629b0 2023-08-17T00:19:08.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.564+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f806b530 con 0x7fa6f80629b0 2023-08-17T00:19:08.576 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.564+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 4 ==== mgrmap(e 4) v1 ==== 71856+0+0 (secure 0 0 0) 0x7fa6f401a060 con 0x7fa6f80629b0 2023-08-17T00:19:08.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.564+0000 7fa6ed7fa700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa6dc05a150 0x7fa6dc05c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2023-08-17T00:19:08.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.564+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5441+0+0 (secure 0 0 0) 0x7fa6f4073250 con 0x7fa6f80629b0 2023-08-17T00:19:08.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.564+0000 7fa6fc976700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa6dc05a150 0x7fa6dc05c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2023-08-17T00:19:08.577 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.568+0000 7fa6fc976700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa6dc05a150 0x7fa6dc05c610 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fa6e800d260 tx=0x7fa6e8009060).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-17T00:19:08.578 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.568+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162005 (secure 0 0 0) 0x7fa6f4046f10 con 0x7fa6f80629b0 2023-08-17T00:19:08.768 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.760+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 --> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6f8064910 con 0x7fa6f80629b0 2023-08-17T00:19:08.769 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ed7fa700 1 -- 172.21.15.153:0/4130294522 <== mon.0 v2:172.21.15.153:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 155 v155) v1 ==== 95+0+3547 (secure 0 0 0) 0x7fa6f404a530 con 0x7fa6f80629b0 2023-08-17T00:19:08.770 INFO:teuthology.orchestra.run.smithi153.stdout: 2023-08-17T00:19:08.770 INFO:teuthology.orchestra.run.smithi153.stdout:{"epoch":155,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8345,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6834/3046046227","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6832","nonce":3046046227},{"type":"v1","addr":"172.21.15.153:6834","nonce":3046046227}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8351,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3227437759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3227437759},{"type":"v1","addr":"172.21.15.178:6836","nonce":3227437759}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":8354,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/1598381638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":1598381638},{"type":"v1","addr":"172.21.15.178:6837","nonce":1598381638}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":141},{"gid":10623,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.153:6835/4165560239","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.153:6833","nonce":4165560239},{"type":"v1","addr":"172.21.15.153:6835","nonce":4165560239}]},"join_fscid":-1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":155}],"filesystems":[]} 2023-08-17T00:19:08.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa6dc05a150 msgr2=0x7fa6dc05c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa6dc05a150 0x7fa6dc05c610 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7fa6e800d260 tx=0x7fa6e8009060).stop 2023-08-17T00:19:08.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 msgr2=0x7fa6f8159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-17T00:19:08.772 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 0x7fa6f8159650 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 rx=0x7fa6f400c590 tx=0x7fa6f4007c80).stop 2023-08-17T00:19:08.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 shutdown_connections 2023-08-17T00:19:08.773 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:6832/32723,v1:172.21.15.178:6833/32723] conn(0x7fa6dc05a150 0x7fa6dc05c610 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6f80a8b70 0x7fa6f816be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6f80632e0 0x7fa6f814be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 --2- 172.21.15.153:0/4130294522 >> [v2:172.21.15.153:3300/0,v1:172.21.15.153:6789/0] conn(0x7fa6f80629b0 0x7fa6f8159650 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2023-08-17T00:19:08.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 >> 172.21.15.153:0/4130294522 conn(0x7fa6f80c7150 msgr2=0x7fa6f80c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-17T00:19:08.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 shutdown_connections 2023-08-17T00:19:08.774 INFO:teuthology.orchestra.run.smithi153.stderr:2023-08-17T00:19:08.764+0000 7fa6ff3db700 1 -- 172.21.15.153:0/4130294522 wait complete. 2023-08-17T00:19:08.775 INFO:teuthology.orchestra.run.smithi153.stderr:dumped fsmap epoch 155 2023-08-17T00:19:08.791 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-17T00:19:08.792 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-17T00:19:08.792 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-17T00:19:08.792 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:08.809 INFO:tasks.ceph.mds.a:Stopped 2023-08-17T00:19:08.809 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-17T00:19:08.809 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:08.870 INFO:tasks.ceph.mds.c:Stopped 2023-08-17T00:19:08.871 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-17T00:19:08.871 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:08.895 INFO:tasks.ceph.mds.b:Stopped 2023-08-17T00:19:08.895 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-17T00:19:08.895 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:08.958 INFO:tasks.ceph.mds.d:Stopped 2023-08-17T00:19:08.959 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-17T00:19:08.959 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-17T00:19:08.959 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:10.886 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-08-17T00:19:15.061 INFO:tasks.ceph.osd.0:Stopped 2023-08-17T00:19:15.062 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-17T00:19:15.062 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:15.145 INFO:tasks.ceph.osd.1:Stopped 2023-08-17T00:19:15.146 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-17T00:19:15.146 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:15.247 INFO:tasks.ceph.osd.2:Stopped 2023-08-17T00:19:15.248 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-17T00:19:15.248 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:15.338 INFO:tasks.ceph.osd.3:Stopped 2023-08-17T00:19:15.338 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-17T00:19:15.339 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:16.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-08-17T00:19:16.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-08-17T00:19:18.255 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:18.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:21.441 INFO:tasks.ceph.osd.4:Stopped 2023-08-17T00:19:21.442 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-17T00:19:21.442 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:21.542 INFO:tasks.ceph.osd.5:Stopped 2023-08-17T00:19:21.543 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-17T00:19:21.543 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:22.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-08-17T00:19:22.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-08-17T00:19:27.645 INFO:tasks.ceph.osd.6:Stopped 2023-08-17T00:19:27.645 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-17T00:19:27.646 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:27.737 INFO:tasks.ceph.osd.7:Stopped 2023-08-17T00:19:27.738 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-17T00:19:27.739 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-17T00:19:27.739 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:27.796 INFO:tasks.ceph.mgr.y:Stopped 2023-08-17T00:19:27.797 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-17T00:19:27.797 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:27.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2023-08-17T00:19:27.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-08-17T00:19:27.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-08-17T00:19:27.853 INFO:tasks.ceph.mgr.x:Stopped 2023-08-17T00:19:27.854 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-17T00:19:27.854 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-17T00:19:27.855 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:27.892 INFO:tasks.ceph.mon.a:Stopped 2023-08-17T00:19:27.892 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-17T00:19:27.892 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:27.922 INFO:tasks.ceph.mon.b:Stopped 2023-08-17T00:19:27.923 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-17T00:19:27.923 INFO:teuthology.orchestra.run:waiting for 300 2023-08-17T00:19:27.994 INFO:tasks.ceph.mon.c:Stopped 2023-08-17T00:19:27.994 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-17T00:19:27.995 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-08-17T00:19:28.044 INFO:teuthology.orchestra.run.smithi153.stdout:2023-08-17T00:04:41.261923+0000 mon.a (mon.0) 335 : cluster [WRN] Health check failed: Degraded data redundancy: 29/4052 objects degraded (0.716%), 1 pg degraded (PG_DEGRADED) 2023-08-17T00:19:28.045 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-17T00:19:28.046 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-08-17T00:19:28.140 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-08-17T00:19:28.231 DEBUG:teuthology.orchestra.run.smithi153:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-08-17T00:19:28.275 INFO:teuthology.orchestra.run.smithi153.stdout:2023-08-17T00:04:41.261923+0000 mon.a (mon.0) 335 : cluster [WRN] Health check failed: Degraded data redundancy: 29/4052 objects degraded (0.716%), 1 pg degraded (PG_DEGRADED) 2023-08-17T00:19:28.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:19:28.278 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-17T00:19:28.915 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:19:28.916 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-17T00:19:29.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:19:29.415 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-17T00:19:29.894 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:19:29.894 DEBUG:teuthology.orchestra.run.smithi153:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-17T00:19:30.335 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:19:30.335 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-17T00:19:30.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:19:30.794 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-17T00:19:31.212 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:19:31.213 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-17T00:19:31.641 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:19:31.642 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-17T00:19:32.064 INFO:tasks.ceph:Archiving mon data... 2023-08-17T00:19:32.067 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/data/mon.a.tgz 2023-08-17T00:19:32.067 DEBUG:teuthology.orchestra.run.smithi153:> mktemp 2023-08-17T00:19:32.086 INFO:teuthology.orchestra.run.smithi153.stdout:/tmp/tmp.kI7kddZvX0 2023-08-17T00:19:32.087 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.kI7kddZvX0 2023-08-17T00:19:32.419 DEBUG:teuthology.orchestra.run.smithi153:> sudo chmod 0666 /tmp/tmp.kI7kddZvX0 2023-08-17T00:19:32.516 DEBUG:teuthology.orchestra.remote:smithi153:/tmp/tmp.kI7kddZvX0 is 856KB 2023-08-17T00:19:32.554 DEBUG:teuthology.orchestra.run.smithi153:> rm -fr /tmp/tmp.kI7kddZvX0 2023-08-17T00:19:32.571 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/data/mon.b.tgz 2023-08-17T00:19:32.571 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2023-08-17T00:19:32.589 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.RGBjtKs8GW 2023-08-17T00:19:32.590 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.RGBjtKs8GW 2023-08-17T00:19:32.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-08-17T00:19:32.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-08-17T00:19:32.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-08-17T00:19:32.923 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.RGBjtKs8GW 2023-08-17T00:19:33.017 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.RGBjtKs8GW is 876KB 2023-08-17T00:19:33.056 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.RGBjtKs8GW 2023-08-17T00:19:33.073 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/data/mon.c.tgz 2023-08-17T00:19:33.074 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2023-08-17T00:19:33.137 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.tk2fXrW9bE 2023-08-17T00:19:33.137 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tk2fXrW9bE 2023-08-17T00:19:33.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.tk2fXrW9bE 2023-08-17T00:19:33.568 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.tk2fXrW9bE is 877KB 2023-08-17T00:19:33.651 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.tk2fXrW9bE 2023-08-17T00:19:33.670 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-17T00:19:33.671 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-17T00:19:33.678 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-17T00:19:33.747 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-17T00:19:33.748 DEBUG:teuthology.orchestra.run.smithi153:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-17T00:19:33.756 DEBUG:teuthology.orchestra.run.smithi178:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-17T00:19:33.803 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-17T00:19:33.840 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-17T00:19:33.854 INFO:tasks.ceph:Archiving crash dumps... 2023-08-17T00:19:33.857 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/remote/smithi153/crash 2023-08-17T00:19:33.862 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-17T00:19:33.898 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/remote/smithi178/crash 2023-08-17T00:19:33.900 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-17T00:19:33.937 INFO:tasks.ceph:Shutting down logrotate 2023-08-17T00:19:33.939 DEBUG:teuthology.orchestra.run.smithi153:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:33.952 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:34.049 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:34.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-17T00:19:34.115 INFO:tasks.ceph:Compressing logs... 2023-08-17T00:19:34.116 DEBUG:teuthology.orchestra.run.smithi153:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T00:19:34.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T00:20:49.708 INFO:tasks.ceph:Archiving logs... 2023-08-17T00:20:49.709 DEBUG:teuthology.misc:Transferring archived files from smithi153:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/remote/smithi153/log 2023-08-17T00:20:49.710 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-17T00:20:57.218 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/remote/smithi178/log 2023-08-17T00:20:57.219 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-17T00:20:58.616 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-17T00:20:58.625 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-17T00:20:58.626 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-17T00:20:58.633 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-17T00:20:58.738 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-17T00:20:58.751 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-17T00:20:58.751 DEBUG:teuthology.orchestra.run.smithi153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-17T00:20:58.758 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-17T00:20:58.792 INFO:teuthology.orchestra.run.smithi153.stdout: remote refid st t when poll reach delay offset jitter 2023-08-17T00:20:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:============================================================================== 2023-08-17T00:20:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:*hv01.front.sepi 44.4.53.2 2 u 26 64 377 0.124 0.351 0.690 2023-08-17T00:20:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:+hv02.front.sepi 63.231.80.2 3 u 17 64 377 0.115 4.464 0.995 2023-08-17T00:20:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:+hv03.front.sepi 74.6.168.72 3 u 19 64 377 0.094 1.290 0.657 2023-08-17T00:20:58.793 INFO:teuthology.orchestra.run.smithi153.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-08-17T00:20:58.799 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2023-08-17T00:20:58.800 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2023-08-17T00:20:58.800 INFO:teuthology.orchestra.run.smithi178.stdout:*hv01.front.sepi 44.4.53.2 2 u 35 64 377 0.109 0.215 0.416 2023-08-17T00:20:58.800 INFO:teuthology.orchestra.run.smithi178.stdout:+hv02.front.sepi 63.231.80.2 3 u 27 64 377 0.122 5.260 0.306 2023-08-17T00:20:58.801 INFO:teuthology.orchestra.run.smithi178.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.118 1.457 0.694 2023-08-17T00:20:58.801 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-08-17T00:20:58.803 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-17T00:20:58.813 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-17T00:20:58.813 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-17T00:20:58.829 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-17T00:20:58.845 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-17T00:20:58.861 INFO:teuthology.task.internal:Duration was 1824.088328 seconds 2023-08-17T00:20:58.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-17T00:20:58.880 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-17T00:20:58.881 DEBUG:teuthology.orchestra.run.smithi153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-17T00:20:58.889 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-17T00:20:59.056 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-17T00:20:59.056 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi153.front.sepia.ceph.com 2023-08-17T00:20:59.057 DEBUG:teuthology.orchestra.run.smithi153:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-17T00:20:59.093 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2023-08-17T00:20:59.093 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-17T00:20:59.131 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-17T00:20:59.131 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T00:20:59.148 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-17T00:20:59.239 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-17T00:20:59.239 DEBUG:teuthology.orchestra.run.smithi153:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-17T00:20:59.246 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-17T00:20:59.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-17T00:20:59.379 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-17T00:20:59.379 DEBUG:teuthology.orchestra.run.smithi153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-17T00:20:59.420 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-17T00:20:59.455 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-17T00:20:59.469 DEBUG:teuthology.orchestra.run.smithi153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-17T00:20:59.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-17T00:20:59.507 INFO:teuthology.orchestra.run.smithi153.stdout:kernel.core_pattern = core 2023-08-17T00:20:59.534 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2023-08-17T00:20:59.568 DEBUG:teuthology.orchestra.run.smithi153:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-17T00:20:59.601 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:20:59.602 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-17T00:20:59.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-17T00:20:59.629 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-17T00:20:59.642 INFO:teuthology.task.internal:Transferring archived files... 2023-08-17T00:20:59.643 DEBUG:teuthology.misc:Transferring archived files from smithi153:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/remote/smithi153 2023-08-17T00:20:59.643 DEBUG:teuthology.orchestra.run.smithi153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-17T00:20:59.691 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431/remote/smithi178 2023-08-17T00:20:59.692 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-17T00:20:59.732 INFO:teuthology.task.internal:Removing archive directory... 2023-08-17T00:20:59.733 DEBUG:teuthology.orchestra.run.smithi153:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-17T00:20:59.744 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-17T00:20:59.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-17T00:20:59.807 INFO:teuthology.task.internal:Not uploading archives. 2023-08-17T00:20:59.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-17T00:20:59.823 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-17T00:20:59.824 DEBUG:teuthology.orchestra.run.smithi153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-17T00:20:59.831 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-17T00:20:59.848 INFO:teuthology.orchestra.run.smithi153.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 00:20 /home/ubuntu/cephtest 2023-08-17T00:20:59.858 INFO:teuthology.orchestra.run.smithi178.stdout: 1048601 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 00:20 /home/ubuntu/cephtest 2023-08-17T00:20:59.864 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-17T00:20:59.879 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-17T00:20:59.916 INFO:teuthology.nuke:Checking targets against current locks 2023-08-17T00:20:59.943 DEBUG:teuthology.nuke:shortname: smithi153 2023-08-17T00:20:59.944 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T00:20:59.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi153.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 23:40:28.589204', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-17T00:20:59.971 DEBUG:teuthology.nuke:shortname: smithi178 2023-08-17T00:20:59.971 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-17T00:20:59.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-16_22:36:42-fs-wip-yuri2-testing-2023-08-16-1142-pacific-distro-default-smithi/7370431', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-16 23:40:28.591044', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-17T00:21:00.047 INFO:teuthology.orchestra.console.smithi153:Power off 2023-08-17T00:21:00.049 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T00:21:00.067 INFO:teuthology.orchestra.console.smithi178:Power off 2023-08-17T00:21:00.068 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-17T00:21:00.081 DEBUG:teuthology.orchestra.console.smithi153:power off output: Chassis Power Control: Down/Off 2023-08-17T00:21:00.082 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:00.096 DEBUG:teuthology.orchestra.console.smithi178:power off output: Chassis Power Control: Down/Off 2023-08-17T00:21:00.097 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:00.109 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-17T00:21:00.121 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-17T00:21:04.111 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:04.123 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:04.226 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-17T00:21:04.237 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-17T00:21:08.228 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:08.239 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:08.340 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is on 2023-08-17T00:21:08.354 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is on 2023-08-17T00:21:12.344 DEBUG:teuthology.orchestra.console.smithi153:pexpect command: ipmitool -H smithi153.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:12.355 DEBUG:teuthology.orchestra.console.smithi178:pexpect command: ipmitool -H smithi178.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-17T00:21:12.456 DEBUG:teuthology.orchestra.console.smithi153:check power output: Chassis Power is off 2023-08-17T00:21:12.466 DEBUG:teuthology.orchestra.console.smithi178:check power output: Chassis Power is off 2023-08-17T00:21:12.558 INFO:teuthology.orchestra.console.smithi153:Power off completed 2023-08-17T00:21:12.567 INFO:teuthology.orchestra.console.smithi178:Power off completed 2023-08-17T00:21:12.673 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 client.1-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 description: fs/functional/{begin clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/testing/{flavor/ubuntu_latest k-testing} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} duration: 1824.0883283615112 failure_reason: '"2023-08-17T00:04:41.261923+0000 mon.a (mon.0) 335 : cluster [WRN] Health check failed: Degraded data redundancy: 29/4052 objects degraded (0.716%), 1 pg degraded (PG_DEGRADED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-08-17T00:21:12.674 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-17T00:21:12.760 INFO:teuthology.run:FAIL